2023-11-04T01:22:52.830 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-04T01:22:52.831 DEBUG:teuthology.run:Teuthology command: teuthology --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} --verbose --owner scheduled_pdonnell@teuthology --name pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi --archive /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445917 -- /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445917/orig.config.yaml 2023-11-04T01:22:52.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T01:22:52.958 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445917 branch: main description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} email: pdonnell@redhat.com first_in_suite: false job_id: '7445917' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - evicting unresponsive client - RECENT_CRASH sha1: 7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: dry_run: true install: ceph: flavor: default sha1: 7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20231103.180916 sha1: 702f9e6492477037e018f68dfdf636a30c24f329 owner: scheduled_pdonnell@teuthology priority: 50 repo: https://github.com/ceph/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7192 sha1: 7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 sleep_before_teardown: 0 suite: fs:functional suite_branch: wip-batrick-testing-20231103.180916 suite_path: /home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph.git suite_sha1: 702f9e6492477037e018f68dfdf636a30c24f329 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi077.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC98IxozWDvPWbpBYgi+MMJpRUYiX+TS5qo5Pw+bfEfcVidm/tPYmNTHzJEhNIYYLj++5c1qhc780ISibsXj09I= smithi122.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPanZufxhlJo6tdzQLKbEysIIY5d1iHXfpINj3rEYe3uU12EsjWl4G+TqFTz+sNIrfSqYYrpwthLc8urbPu38fE= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - exec: mon.a: - ceph config set mgr mgr/crash/warn_recent_interval 0 - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_snapshots teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 6899cd26fceddb2fec83dc1a1349394b28c8998e timestamp: 2023-11-03_18:12:33 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3084822 2023-11-04T01:22:52.959 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa; will attempt to use it 2023-11-04T01:22:52.960 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks 2023-11-04T01:22:52.961 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-04T01:22:52.962 INFO:teuthology.task.internal:Checking packages... 2023-11-04T01:22:52.993 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4' 2023-11-04T01:22:52.994 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-04T01:22:52.994 INFO:teuthology.packaging:ref: None 2023-11-04T01:22:52.995 INFO:teuthology.packaging:tag: None 2023-11-04T01:22:52.995 INFO:teuthology.packaging:branch: main 2023-11-04T01:22:52.995 INFO:teuthology.packaging:sha1: 7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 2023-11-04T01:22:52.996 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2023-11-04T01:22:53.309 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7052.g7188d8cd 2023-11-04T01:22:53.309 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-04T01:22:53.320 INFO:teuthology.task.internal:no buildpackages task found 2023-11-04T01:22:53.321 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-04T01:22:53.360 INFO:teuthology.task.internal:Saving configuration 2023-11-04T01:22:53.378 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-04T01:22:53.406 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-04T01:22:53.429 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi077.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445917', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 01:04:35.009027', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC98IxozWDvPWbpBYgi+MMJpRUYiX+TS5qo5Pw+bfEfcVidm/tPYmNTHzJEhNIYYLj++5c1qhc780ISibsXj09I='} 2023-11-04T01:22:53.448 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi122.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445917', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 01:04:35.007367', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPanZufxhlJo6tdzQLKbEysIIY5d1iHXfpINj3rEYe3uU12EsjWl4G+TqFTz+sNIrfSqYYrpwthLc8urbPu38fE='} 2023-11-04T01:22:53.449 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-04T01:22:53.467 INFO:teuthology.task.internal:roles: ubuntu@smithi077.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-04T01:22:53.467 INFO:teuthology.task.internal:roles: ubuntu@smithi122.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-04T01:22:53.467 INFO:teuthology.run_tasks:Running task console_log... 2023-11-04T01:22:53.588 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc354a0fb80>, signals=[15]) 2023-11-04T01:22:53.589 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-04T01:22:53.608 INFO:teuthology.task.internal:Opening connections... 2023-11-04T01:22:53.609 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi077.front.sepia.ceph.com 2023-11-04T01:22:53.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:22:53.697 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi122.front.sepia.ceph.com 2023-11-04T01:22:53.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:22:53.822 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-04T01:22:53.832 DEBUG:teuthology.orchestra.run.smithi077:> uname -m 2023-11-04T01:22:53.850 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64 2023-11-04T01:22:53.851 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2023-11-04T01:22:53.909 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="CentOS Stream" 2023-11-04T01:22:53.909 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="9" 2023-11-04T01:22:53.910 INFO:teuthology.orchestra.run.smithi077.stdout:ID="centos" 2023-11-04T01:22:53.910 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="rhel fedora" 2023-11-04T01:22:53.911 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="9" 2023-11-04T01:22:53.911 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el9" 2023-11-04T01:22:53.911 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-04T01:22:53.912 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31" 2023-11-04T01:22:53.912 INFO:teuthology.orchestra.run.smithi077.stdout:LOGO="fedora-logo-icon" 2023-11-04T01:22:53.912 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-04T01:22:53.912 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://centos.org/" 2023-11-04T01:22:53.913 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-04T01:22:53.913 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-04T01:22:53.913 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-04T01:22:53.915 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2023-11-04T01:22:53.939 DEBUG:teuthology.orchestra.run.smithi122:> uname -m 2023-11-04T01:22:53.968 INFO:teuthology.orchestra.run.smithi122.stdout:x86_64 2023-11-04T01:22:53.969 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release 2023-11-04T01:22:54.025 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="CentOS Stream" 2023-11-04T01:22:54.026 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="9" 2023-11-04T01:22:54.026 INFO:teuthology.orchestra.run.smithi122.stdout:ID="centos" 2023-11-04T01:22:54.026 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE="rhel fedora" 2023-11-04T01:22:54.026 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="9" 2023-11-04T01:22:54.027 INFO:teuthology.orchestra.run.smithi122.stdout:PLATFORM_ID="platform:el9" 2023-11-04T01:22:54.027 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-04T01:22:54.027 INFO:teuthology.orchestra.run.smithi122.stdout:ANSI_COLOR="0;31" 2023-11-04T01:22:54.027 INFO:teuthology.orchestra.run.smithi122.stdout:LOGO="fedora-logo-icon" 2023-11-04T01:22:54.028 INFO:teuthology.orchestra.run.smithi122.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-04T01:22:54.028 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://centos.org/" 2023-11-04T01:22:54.028 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-04T01:22:54.028 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-04T01:22:54.028 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-04T01:22:54.029 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2023-11-04T01:22:54.048 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-04T01:22:54.072 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-04T01:22:54.123 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-04T01:22:54.123 DEBUG:teuthology.orchestra.run.smithi077:> test '!' -e /home/ubuntu/cephtest 2023-11-04T01:22:54.130 DEBUG:teuthology.orchestra.run.smithi122:> test '!' -e /home/ubuntu/cephtest 2023-11-04T01:22:54.147 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-04T01:22:54.173 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-04T01:22:54.173 DEBUG:teuthology.orchestra.run.smithi077:> test -z $(ls -A /var/lib/ceph) 2023-11-04T01:22:54.189 DEBUG:teuthology.orchestra.run.smithi122:> test -z $(ls -A /var/lib/ceph) 2023-11-04T01:22:54.290 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-04T01:22:54.345 INFO:teuthology.run_tasks:Running task kernel... 2023-11-04T01:22:54.369 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-11-04T01:22:54.370 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-11-04T01:22:54.375 DEBUG:teuthology.orchestra.run.smithi077:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-04T01:22:54.376 DEBUG:teuthology.orchestra.run.smithi122:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-04T01:22:54.391 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:22:54.392 DEBUG:teuthology.orchestra.run.smithi122:> uname -r 2023-11-04T01:22:54.393 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:22:54.394 DEBUG:teuthology.orchestra.run.smithi077:> uname -r 2023-11-04T01:22:54.451 INFO:teuthology.orchestra.run.smithi122.stdout:5.14.0-361.el9.x86_64 2023-11-04T01:22:54.451 INFO:teuthology.task.kernel:Running kernel on smithi122: 5.14.0-361.el9.x86_64 2023-11-04T01:22:54.452 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum install -y kernel 2023-11-04T01:22:54.453 INFO:teuthology.orchestra.run.smithi077.stdout:5.14.0-361.el9.x86_64 2023-11-04T01:22:54.453 INFO:teuthology.task.kernel:Running kernel on smithi077: 5.14.0-361.el9.x86_64 2023-11-04T01:22:54.454 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum install -y kernel 2023-11-04T01:22:56.554 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS-9 - AppStream 14 MB/s | 6.3 MB 00:00 2023-11-04T01:22:56.615 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS-9 - AppStream 16 MB/s | 6.3 MB 00:00 2023-11-04T01:22:57.854 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS-9 - BaseOS 7.4 MB/s | 2.0 MB 00:00 2023-11-04T01:22:57.932 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS-9 - BaseOS 6.9 MB/s | 2.0 MB 00:00 2023-11-04T01:22:58.645 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 7.9 MB 00:00 2023-11-04T01:23:13.663 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - BaseOS 524 kB/s | 7.9 MB 00:15 2023-11-04T01:23:18.297 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - AppStream 5.0 MB/s | 18 MB 00:03 2023-11-04T01:23:23.484 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 5.8 MB 00:01 2023-11-04T01:23:24.982 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 15 kB 00:00 2023-11-04T01:23:27.501 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - AppStream 659 kB/s | 18 MB 00:27 2023-11-04T01:23:42.710 INFO:teuthology.orchestra.run.smithi077.stdout:Extra Packages for Enterprise Linux 1.1 MB/s | 19 MB 00:17 2023-11-04T01:23:43.893 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - CRB 454 kB/s | 5.8 MB 00:13 2023-11-04T01:23:45.327 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 15 kB 00:00 2023-11-04T01:23:47.224 INFO:teuthology.orchestra.run.smithi077.stdout:lab-extras 20 kB/s | 1.7 kB 00:00 2023-11-04T01:23:47.415 INFO:teuthology.orchestra.run.smithi122.stdout:Extra Packages for Enterprise Linux 9.8 MB/s | 19 MB 00:01 2023-11-04T01:23:49.281 INFO:teuthology.orchestra.run.smithi077.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-11-04T01:23:49.281 INFO:teuthology.orchestra.run.smithi077.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-11-04T01:23:49.362 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2023-11-04T01:23:49.372 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2023-11-04T01:23:49.373 INFO:teuthology.orchestra.run.smithi077.stdout: Package Architecture Version Repository Size 2023-11-04T01:23:49.373 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2023-11-04T01:23:49.373 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2023-11-04T01:23:49.373 INFO:teuthology.orchestra.run.smithi077.stdout: kernel x86_64 5.14.0-378.el9 baseos 5.3 M 2023-11-04T01:23:49.373 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2023-11-04T01:23:49.374 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-core x86_64 5.14.0-378.el9 baseos 20 M 2023-11-04T01:23:49.374 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-modules x86_64 5.14.0-378.el9 baseos 38 M 2023-11-04T01:23:49.374 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-modules-core x86_64 5.14.0-378.el9 baseos 32 M 2023-11-04T01:23:49.374 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:23:49.375 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2023-11-04T01:23:49.375 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2023-11-04T01:23:49.375 INFO:teuthology.orchestra.run.smithi077.stdout:Install 4 Packages 2023-11-04T01:23:49.375 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:23:49.376 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 95 M 2023-11-04T01:23:49.376 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 120 M 2023-11-04T01:23:49.376 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2023-11-04T01:23:51.617 INFO:teuthology.orchestra.run.smithi077.stdout:(1/4): kernel-5.14.0-378.el9.x86_64.rpm 2.6 MB/s | 5.3 MB 00:02 2023-11-04T01:23:51.946 INFO:teuthology.orchestra.run.smithi122.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2023-11-04T01:23:54.028 INFO:teuthology.orchestra.run.smithi122.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-11-04T01:23:54.028 INFO:teuthology.orchestra.run.smithi122.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-11-04T01:23:54.124 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2023-11-04T01:23:54.130 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2023-11-04T01:23:54.130 INFO:teuthology.orchestra.run.smithi122.stdout: Package Architecture Version Repository Size 2023-11-04T01:23:54.130 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2023-11-04T01:23:54.130 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2023-11-04T01:23:54.131 INFO:teuthology.orchestra.run.smithi122.stdout: kernel x86_64 5.14.0-378.el9 baseos 5.3 M 2023-11-04T01:23:54.131 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2023-11-04T01:23:54.131 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-core x86_64 5.14.0-378.el9 baseos 20 M 2023-11-04T01:23:54.131 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-modules x86_64 5.14.0-378.el9 baseos 38 M 2023-11-04T01:23:54.132 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-modules-core x86_64 5.14.0-378.el9 baseos 32 M 2023-11-04T01:23:54.132 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:23:54.132 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2023-11-04T01:23:54.132 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2023-11-04T01:23:54.132 INFO:teuthology.orchestra.run.smithi122.stdout:Install 4 Packages 2023-11-04T01:23:54.133 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:23:54.133 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 95 M 2023-11-04T01:23:54.133 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 120 M 2023-11-04T01:23:54.134 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2023-11-04T01:24:00.555 INFO:teuthology.orchestra.run.smithi122.stdout:(1/4): kernel-5.14.0-378.el9.x86_64.rpm 870 kB/s | 5.3 MB 00:06 2023-11-04T01:24:08.232 INFO:teuthology.orchestra.run.smithi077.stdout:(2/4): kernel-core-5.14.0-378.el9.x86_64.rpm 1.1 MB/s | 20 MB 00:18 2023-11-04T01:24:10.346 INFO:teuthology.orchestra.run.smithi122.stdout:(2/4): kernel-core-5.14.0-378.el9.x86_64.rpm 1.2 MB/s | 20 MB 00:16 2023-11-04T01:24:12.782 INFO:teuthology.orchestra.run.smithi077.stdout:(3/4): kernel-modules-5.14.0-378.el9.x86_64.rpm 1.6 MB/s | 38 MB 00:23 2023-11-04T01:24:13.524 INFO:teuthology.orchestra.run.smithi077.stdout:(4/4): kernel-modules-core-5.14.0-378.el9.x86_6 1.5 MB/s | 32 MB 00:21 2023-11-04T01:24:13.524 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2023-11-04T01:24:13.525 INFO:teuthology.orchestra.run.smithi077.stdout:Total 3.9 MB/s | 95 MB 00:24 2023-11-04T01:24:14.363 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2023-11-04T01:24:14.731 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2023-11-04T01:24:14.731 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2023-11-04T01:24:16.040 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2023-11-04T01:24:16.041 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2023-11-04T01:24:18.667 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2023-11-04T01:24:19.388 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : kernel-modules-core-5.14.0-378.el9.x86_64 1/4 2023-11-04T01:24:19.525 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-04T01:24:22.316 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-04T01:24:22.528 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-04T01:24:27.098 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-04T01:24:27.210 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : kernel-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:24:31.813 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:24:33.211 INFO:teuthology.orchestra.run.smithi122.stdout:(3/4): kernel-modules-core-5.14.0-378.el9.x86_6 1.0 MB/s | 32 MB 00:32 2023-11-04T01:24:34.028 INFO:teuthology.orchestra.run.smithi122.stdout:(4/4): kernel-modules-5.14.0-378.el9.x86_64.rpm 967 kB/s | 38 MB 00:39 2023-11-04T01:24:34.028 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2023-11-04T01:24:34.029 INFO:teuthology.orchestra.run.smithi122.stdout:Total 2.4 MB/s | 95 MB 00:39 2023-11-04T01:24:34.872 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2023-11-04T01:24:35.263 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2023-11-04T01:24:35.263 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2023-11-04T01:24:36.537 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2023-11-04T01:24:36.537 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2023-11-04T01:24:39.430 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2023-11-04T01:24:40.053 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : kernel-modules-core-5.14.0-378.el9.x86_64 1/4 2023-11-04T01:24:40.181 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-04T01:24:42.917 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-04T01:24:43.129 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-04T01:24:47.747 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-04T01:24:47.861 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : kernel-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:24:52.483 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:25:00.734 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:25:00.776 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:25:01.229 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:25:01.229 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-5.14.0-378.el9.x86_64 1/4 2023-11-04T01:25:01.229 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-04T01:25:01.229 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-04T01:25:01.621 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:25:01.621 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:25:01.621 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2023-11-04T01:25:01.621 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-5.14.0-378.el9.x86_64 2023-11-04T01:25:01.622 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-core-5.14.0-378.el9.x86_64 2023-11-04T01:25:01.622 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-modules-5.14.0-378.el9.x86_64 2023-11-04T01:25:01.622 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-modules-core-5.14.0-378.el9.x86_64 2023-11-04T01:25:01.622 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:25:01.623 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2023-11-04T01:25:02.114 DEBUG:teuthology.orchestra.run.smithi077:> rpm -q kernel | sort -rV | head -n 1 2023-11-04T01:25:02.252 INFO:teuthology.orchestra.run.smithi077.stdout:kernel-5.14.0-378.el9.x86_64 2023-11-04T01:25:02.253 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-11-04T01:25:02.253 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-378.el9.x86_64 2023-11-04T01:25:02.254 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-04T01:25:02.254 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-04T01:25:02.254 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-11-04T01:25:02.254 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi077.front.sepia.ceph.com, path=None, version=distro) 2023-11-04T01:25:02.255 DEBUG:teuthology.orchestra.run.smithi077:> rpm -q kernel | sort -rV | head -n 1 2023-11-04T01:25:02.370 INFO:teuthology.orchestra.run.smithi077.stdout:kernel-5.14.0-378.el9.x86_64 2023-11-04T01:25:02.371 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-11-04T01:25:02.371 DEBUG:teuthology.orchestra.run.smithi077:> sudo rpm -qi grub2-tools 2023-11-04T01:25:02.409 INFO:teuthology.orchestra.run.smithi077.stdout:Name : grub2-tools 2023-11-04T01:25:02.410 INFO:teuthology.orchestra.run.smithi077.stdout:Epoch : 1 2023-11-04T01:25:02.410 INFO:teuthology.orchestra.run.smithi077.stdout:Version : 2.06 2023-11-04T01:25:02.410 INFO:teuthology.orchestra.run.smithi077.stdout:Release : 68.el9 2023-11-04T01:25:02.410 INFO:teuthology.orchestra.run.smithi077.stdout:Architecture: x86_64 2023-11-04T01:25:02.411 INFO:teuthology.orchestra.run.smithi077.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-04T01:25:02.411 INFO:teuthology.orchestra.run.smithi077.stdout:Group : Unspecified 2023-11-04T01:25:02.411 INFO:teuthology.orchestra.run.smithi077.stdout:Size : 8264254 2023-11-04T01:25:02.411 INFO:teuthology.orchestra.run.smithi077.stdout:License : GPLv3+ 2023-11-04T01:25:02.411 INFO:teuthology.orchestra.run.smithi077.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-04T01:25:02.412 INFO:teuthology.orchestra.run.smithi077.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-04T01:25:02.412 INFO:teuthology.orchestra.run.smithi077.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-04T01:25:02.412 INFO:teuthology.orchestra.run.smithi077.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-04T01:25:02.412 INFO:teuthology.orchestra.run.smithi077.stdout:Packager : builder@centos.org 2023-11-04T01:25:02.412 INFO:teuthology.orchestra.run.smithi077.stdout:Vendor : CentOS 2023-11-04T01:25:02.413 INFO:teuthology.orchestra.run.smithi077.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-04T01:25:02.413 INFO:teuthology.orchestra.run.smithi077.stdout:Summary : Support tools for GRUB. 2023-11-04T01:25:02.413 INFO:teuthology.orchestra.run.smithi077.stdout:Description : 2023-11-04T01:25:02.413 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:25:02.413 INFO:teuthology.orchestra.run.smithi077.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-04T01:25:02.414 INFO:teuthology.orchestra.run.smithi077.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-04T01:25:02.414 INFO:teuthology.orchestra.run.smithi077.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-04T01:25:02.414 INFO:teuthology.orchestra.run.smithi077.stdout:hardware devices. 2023-11-04T01:25:02.414 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:25:02.414 INFO:teuthology.orchestra.run.smithi077.stdout:This subpackage provides tools for support of all platforms. 2023-11-04T01:25:02.415 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-04T01:25:02.416 INFO:teuthology.task.kernel:Updating grub on smithi077 to boot 5.14.0-378.el9.x86_64 2023-11-04T01:25:02.416 DEBUG:teuthology.orchestra.run.smithi077:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-04T01:25:03.062 INFO:teuthology.orchestra.run.smithi077.stderr:Generating grub configuration file ... 2023-11-04T01:25:04.465 INFO:teuthology.orchestra.run.smithi077.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-04T01:25:04.485 INFO:teuthology.orchestra.run.smithi077.stderr:done 2023-11-04T01:25:04.486 DEBUG:teuthology.orchestra.run.smithi077:> mktemp 2023-11-04T01:25:04.527 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/tmp.fef7VdTA8B 2023-11-04T01:25:04.527 DEBUG:teuthology.orchestra.run.smithi077:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.fef7VdTA8B 2023-11-04T01:25:04.596 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0666 /tmp/tmp.fef7VdTA8B 2023-11-04T01:25:04.748 DEBUG:teuthology.orchestra.remote:smithi077:/tmp/tmp.fef7VdTA8B is 6KB 2023-11-04T01:25:04.798 DEBUG:teuthology.orchestra.run.smithi077:> rm -fr /tmp/tmp.fef7VdTA8B 2023-11-04T01:25:04.812 DEBUG:teuthology.orchestra.run.smithi077:> sudo /bin/ls /boot/loader/entries || true 2023-11-04T01:25:04.876 INFO:teuthology.orchestra.run.smithi077.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-04T01:25:04.876 INFO:teuthology.orchestra.run.smithi077.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-04T01:25:04.877 INFO:teuthology.orchestra.run.smithi077.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-04T01:25:04.877 INFO:teuthology.orchestra.run.smithi077.stdout:15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64.conf 2023-11-04T01:25:04.878 DEBUG:teuthology.orchestra.run.smithi077:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64 2023-11-04T01:25:05.031 DEBUG:teuthology.orchestra.run.smithi077:> sudo shutdown -r now 2023-11-04T01:25:21.316 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:25:21.359 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:25:21.789 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:25:21.790 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : kernel-5.14.0-378.el9.x86_64 1/4 2023-11-04T01:25:21.790 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-04T01:25:21.790 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-04T01:25:22.191 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-11-04T01:25:22.192 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:25:22.192 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2023-11-04T01:25:22.192 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-5.14.0-378.el9.x86_64 2023-11-04T01:25:22.192 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-core-5.14.0-378.el9.x86_64 2023-11-04T01:25:22.193 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-modules-5.14.0-378.el9.x86_64 2023-11-04T01:25:22.193 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-modules-core-5.14.0-378.el9.x86_64 2023-11-04T01:25:22.193 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:25:22.193 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2023-11-04T01:25:22.716 DEBUG:teuthology.orchestra.run.smithi122:> rpm -q kernel | sort -rV | head -n 1 2023-11-04T01:25:22.863 INFO:teuthology.orchestra.run.smithi122.stdout:kernel-5.14.0-378.el9.x86_64 2023-11-04T01:25:22.864 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-11-04T01:25:22.864 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-378.el9.x86_64 2023-11-04T01:25:22.864 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-04T01:25:22.865 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-04T01:25:22.865 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-11-04T01:25:22.865 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi122.front.sepia.ceph.com, path=None, version=distro) 2023-11-04T01:25:22.865 DEBUG:teuthology.orchestra.run.smithi122:> rpm -q kernel | sort -rV | head -n 1 2023-11-04T01:25:22.981 INFO:teuthology.orchestra.run.smithi122.stdout:kernel-5.14.0-378.el9.x86_64 2023-11-04T01:25:22.982 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-11-04T01:25:22.982 DEBUG:teuthology.orchestra.run.smithi122:> sudo rpm -qi grub2-tools 2023-11-04T01:25:23.027 INFO:teuthology.orchestra.run.smithi122.stdout:Name : grub2-tools 2023-11-04T01:25:23.027 INFO:teuthology.orchestra.run.smithi122.stdout:Epoch : 1 2023-11-04T01:25:23.027 INFO:teuthology.orchestra.run.smithi122.stdout:Version : 2.06 2023-11-04T01:25:23.027 INFO:teuthology.orchestra.run.smithi122.stdout:Release : 68.el9 2023-11-04T01:25:23.028 INFO:teuthology.orchestra.run.smithi122.stdout:Architecture: x86_64 2023-11-04T01:25:23.028 INFO:teuthology.orchestra.run.smithi122.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-04T01:25:23.028 INFO:teuthology.orchestra.run.smithi122.stdout:Group : Unspecified 2023-11-04T01:25:23.028 INFO:teuthology.orchestra.run.smithi122.stdout:Size : 8264254 2023-11-04T01:25:23.029 INFO:teuthology.orchestra.run.smithi122.stdout:License : GPLv3+ 2023-11-04T01:25:23.029 INFO:teuthology.orchestra.run.smithi122.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-04T01:25:23.029 INFO:teuthology.orchestra.run.smithi122.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-04T01:25:23.029 INFO:teuthology.orchestra.run.smithi122.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-04T01:25:23.030 INFO:teuthology.orchestra.run.smithi122.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-04T01:25:23.030 INFO:teuthology.orchestra.run.smithi122.stdout:Packager : builder@centos.org 2023-11-04T01:25:23.030 INFO:teuthology.orchestra.run.smithi122.stdout:Vendor : CentOS 2023-11-04T01:25:23.030 INFO:teuthology.orchestra.run.smithi122.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-04T01:25:23.031 INFO:teuthology.orchestra.run.smithi122.stdout:Summary : Support tools for GRUB. 2023-11-04T01:25:23.031 INFO:teuthology.orchestra.run.smithi122.stdout:Description : 2023-11-04T01:25:23.031 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:25:23.031 INFO:teuthology.orchestra.run.smithi122.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-04T01:25:23.031 INFO:teuthology.orchestra.run.smithi122.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-04T01:25:23.032 INFO:teuthology.orchestra.run.smithi122.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-04T01:25:23.032 INFO:teuthology.orchestra.run.smithi122.stdout:hardware devices. 2023-11-04T01:25:23.032 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:25:23.032 INFO:teuthology.orchestra.run.smithi122.stdout:This subpackage provides tools for support of all platforms. 2023-11-04T01:25:23.033 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-04T01:25:23.033 INFO:teuthology.task.kernel:Updating grub on smithi122 to boot 5.14.0-378.el9.x86_64 2023-11-04T01:25:23.033 DEBUG:teuthology.orchestra.run.smithi122:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-04T01:25:23.609 INFO:teuthology.orchestra.run.smithi122.stderr:Generating grub configuration file ... 2023-11-04T01:25:24.927 INFO:teuthology.orchestra.run.smithi122.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-04T01:25:24.964 INFO:teuthology.orchestra.run.smithi122.stderr:done 2023-11-04T01:25:24.967 DEBUG:teuthology.orchestra.run.smithi122:> mktemp 2023-11-04T01:25:24.981 INFO:teuthology.orchestra.run.smithi122.stdout:/tmp/tmp.tHy0aauSlb 2023-11-04T01:25:24.982 DEBUG:teuthology.orchestra.run.smithi122:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.tHy0aauSlb 2023-11-04T01:25:25.051 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0666 /tmp/tmp.tHy0aauSlb 2023-11-04T01:25:25.196 DEBUG:teuthology.orchestra.remote:smithi122:/tmp/tmp.tHy0aauSlb is 6KB 2023-11-04T01:25:25.244 DEBUG:teuthology.orchestra.run.smithi122:> rm -fr /tmp/tmp.tHy0aauSlb 2023-11-04T01:25:25.258 DEBUG:teuthology.orchestra.run.smithi122:> sudo /bin/ls /boot/loader/entries || true 2023-11-04T01:25:25.322 INFO:teuthology.orchestra.run.smithi122.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-04T01:25:25.323 INFO:teuthology.orchestra.run.smithi122.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-04T01:25:25.323 INFO:teuthology.orchestra.run.smithi122.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-04T01:25:25.323 INFO:teuthology.orchestra.run.smithi122.stdout:15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64.conf 2023-11-04T01:25:25.324 DEBUG:teuthology.orchestra.run.smithi122:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64 2023-11-04T01:25:25.474 DEBUG:teuthology.orchestra.run.smithi122:> sudo shutdown -r now 2023-11-04T01:25:35.043 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-11-04T01:25:35.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-11-04T01:25:35.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:25:55.494 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-11-04T01:25:55.495 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2023-11-04T01:25:55.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:26:13.883 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-11-04T01:26:22.893 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2023-11-04T01:26:22.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:26:25.946 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-11-04T01:26:35.054 DEBUG:teuthology.orchestra.remote:timed out 2023-11-04T01:26:37.950 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2023-11-04T01:26:37.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:26:44.062 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-11-04T01:26:44.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:26:45.497 DEBUG:teuthology.orchestra.run.smithi077:> true 2023-11-04T01:26:45.935 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-11-04T01:26:45.936 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-378.el9.x86_64"... 2023-11-04T01:26:45.936 DEBUG:teuthology.orchestra.run.smithi077:> uname -r 2023-11-04T01:26:45.950 INFO:teuthology.orchestra.run.smithi077.stdout:5.14.0-378.el9.x86_64 2023-11-04T01:26:45.951 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-378.el9.x86_64 vs 5.14.0-378.el9.x86_64 2023-11-04T01:26:45.951 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-04T01:26:45.951 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-04T01:26:46.953 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-04T01:26:46.953 DEBUG:teuthology.orchestra.run.smithi077:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-04T01:26:47.038 INFO:teuthology.orchestra.run.smithi077.stdout:ttyS1 2023-11-04T01:26:47.071 DEBUG:teuthology.parallel:result is None 2023-11-04T01:26:56.378 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-11-04T01:27:11.380 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2023-11-04T01:27:11.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:27:11.715 DEBUG:teuthology.orchestra.run.smithi122:> true 2023-11-04T01:27:12.195 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com' 2023-11-04T01:27:12.195 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-378.el9.x86_64"... 2023-11-04T01:27:12.195 DEBUG:teuthology.orchestra.run.smithi122:> uname -r 2023-11-04T01:27:12.221 INFO:teuthology.orchestra.run.smithi122.stdout:5.14.0-378.el9.x86_64 2023-11-04T01:27:12.221 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-378.el9.x86_64 vs 5.14.0-378.el9.x86_64 2023-11-04T01:27:12.222 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-04T01:27:12.222 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-04T01:27:13.227 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-11-04T01:27:13.227 DEBUG:teuthology.orchestra.run.smithi122:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-04T01:27:13.295 INFO:teuthology.orchestra.run.smithi122.stdout:ttyS1 2023-11-04T01:27:13.356 DEBUG:teuthology.parallel:result is None 2023-11-04T01:27:13.357 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-04T01:27:13.364 INFO:teuthology.task.internal:Creating test directory... 2023-11-04T01:27:13.364 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-04T01:27:13.373 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-04T01:27:13.390 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-04T01:27:13.424 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-04T01:27:13.484 INFO:teuthology.task.internal:Creating archive directory... 2023-11-04T01:27:13.484 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-04T01:27:13.498 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-04T01:27:13.526 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-04T01:27:13.536 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-04T01:27:13.537 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-04T01:27:13.562 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-04T01:27:13.592 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:27:13.600 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:27:13.608 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:27:13.613 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:27:13.615 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-04T01:27:13.622 INFO:teuthology.task.internal:Configuring sudo... 2023-11-04T01:27:13.622 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-04T01:27:13.657 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-04T01:27:13.687 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-04T01:27:13.712 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-04T01:27:13.712 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-04T01:27:13.732 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-04T01:27:13.747 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-04T01:27:13.840 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-04T01:27:13.875 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-04T01:27:13.967 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-04T01:27:14.001 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:27:14.001 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-04T01:27:14.069 DEBUG:teuthology.orchestra.run.smithi122:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-04T01:27:14.112 DEBUG:teuthology.orchestra.run.smithi122:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-04T01:27:14.170 DEBUG:teuthology.orchestra.run.smithi122:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-04T01:27:14.255 DEBUG:teuthology.orchestra.run.smithi122:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-04T01:27:14.298 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:27:14.298 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-04T01:27:14.368 DEBUG:teuthology.orchestra.run.smithi077:> sudo service rsyslog restart 2023-11-04T01:27:14.374 DEBUG:teuthology.orchestra.run.smithi122:> sudo service rsyslog restart 2023-11-04T01:27:14.423 INFO:teuthology.orchestra.run.smithi077.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-04T01:27:14.461 INFO:teuthology.orchestra.run.smithi122.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-04T01:27:14.963 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-04T01:27:14.972 INFO:teuthology.task.internal:Starting timer... 2023-11-04T01:27:14.972 INFO:teuthology.run_tasks:Running task pcp... 2023-11-04T01:27:15.021 INFO:teuthology.run_tasks:Running task selinux... 2023-11-04T01:27:15.073 DEBUG:teuthology.orchestra.run.smithi077:> sudo service auditd rotate 2023-11-04T01:27:15.140 INFO:teuthology.orchestra.run.smithi077.stdout:Rotating logs: 2023-11-04T01:27:15.142 DEBUG:teuthology.orchestra.run.smithi122:> sudo service auditd rotate 2023-11-04T01:27:15.206 INFO:teuthology.orchestra.run.smithi122.stdout:Rotating logs: 2023-11-04T01:27:15.208 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-04T01:27:15.209 DEBUG:teuthology.orchestra.run.smithi077:> /usr/sbin/getenforce 2023-11-04T01:27:15.241 INFO:teuthology.orchestra.run.smithi077.stdout:Permissive 2023-11-04T01:27:15.242 DEBUG:teuthology.orchestra.run.smithi122:> /usr/sbin/getenforce 2023-11-04T01:27:15.275 INFO:teuthology.orchestra.run.smithi122.stdout:Permissive 2023-11-04T01:27:15.276 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi077.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi122.front.sepia.ceph.com': 'permissive'} 2023-11-04T01:27:15.276 DEBUG:teuthology.orchestra.run.smithi077:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-04T01:27:15.327 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:27:15.328 DEBUG:teuthology.orchestra.run.smithi122:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-04T01:27:15.357 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:27:15.357 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-04T01:27:15.358 DEBUG:teuthology.orchestra.run.smithi077:> sudo /usr/sbin/setenforce permissive 2023-11-04T01:27:15.401 DEBUG:teuthology.orchestra.run.smithi122:> sudo /usr/sbin/setenforce permissive 2023-11-04T01:27:15.444 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-04T01:27:15.455 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-04T01:27:15.456 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-04T01:27:15.574 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-04T01:27:15.576 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi077.front.sepia.ceph.com,smithi122.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-04T01:36:52.947 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi077.front.sepia.ceph.com'), Remote(name='ubuntu@smithi122.front.sepia.ceph.com')] 2023-11-04T01:36:52.948 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-11-04T01:36:52.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:36:53.033 DEBUG:teuthology.orchestra.run.smithi077:> true 2023-11-04T01:36:53.104 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-11-04T01:36:53.105 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2023-11-04T01:36:53.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:36:53.188 DEBUG:teuthology.orchestra.run.smithi122:> true 2023-11-04T01:36:53.258 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com' 2023-11-04T01:36:53.258 INFO:teuthology.run_tasks:Running task clock... 2023-11-04T01:36:53.274 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-04T01:36:53.275 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-04T01:36:53.275 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-04T01:36:53.281 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-04T01:36:53.281 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-04T01:36:53.307 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-04T01:36:53.324 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-04T01:36:53.330 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-04T01:36:53.347 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-04T01:36:53.352 INFO:teuthology.orchestra.run.smithi077.stderr:sudo: ntpd: command not found 2023-11-04T01:36:53.366 INFO:teuthology.orchestra.run.smithi077.stdout:506 Cannot talk to daemon 2023-11-04T01:36:53.377 INFO:teuthology.orchestra.run.smithi122.stderr:sudo: ntpd: command not found 2023-11-04T01:36:53.383 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-04T01:36:53.390 INFO:teuthology.orchestra.run.smithi122.stdout:506 Cannot talk to daemon 2023-11-04T01:36:53.398 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-04T01:36:53.407 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-04T01:36:53.423 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-04T01:36:53.441 INFO:teuthology.orchestra.run.smithi077.stderr:bash: line 1: ntpq: command not found 2023-11-04T01:36:53.445 INFO:teuthology.orchestra.run.smithi077.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-04T01:36:53.445 INFO:teuthology.orchestra.run.smithi077.stdout:=============================================================================== 2023-11-04T01:36:53.445 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:36:53.445 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:36:53.445 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:36:53.446 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:36:53.466 INFO:teuthology.orchestra.run.smithi122.stderr:bash: line 1: ntpq: command not found 2023-11-04T01:36:53.469 INFO:teuthology.orchestra.run.smithi122.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-04T01:36:53.469 INFO:teuthology.orchestra.run.smithi122.stdout:=============================================================================== 2023-11-04T01:36:53.469 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:36:53.470 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:36:53.470 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:36:53.470 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:36:53.471 INFO:teuthology.run_tasks:Running task install... 2023-11-04T01:36:53.480 DEBUG:teuthology.task.install:project ceph 2023-11-04T01:36:53.481 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4'}} 2023-11-04T01:36:53.481 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4'} 2023-11-04T01:36:53.482 INFO:teuthology.task.install:Using flavor: default 2023-11-04T01:36:53.487 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-04T01:36:53.488 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-04T01:36:53.489 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4', 'tag': None, 'wait_for_package': False} 2023-11-04T01:36:53.489 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 2023-11-04T01:36:53.491 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4', 'tag': None, 'wait_for_package': False} 2023-11-04T01:36:53.492 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 2023-11-04T01:36:53.807 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/9/flavors/default/ 2023-11-04T01:36:53.807 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7035.g7532011a 2023-11-04T01:36:53.812 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/9/flavors/default/ 2023-11-04T01:36:53.812 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7035.g7532011a 2023-11-04T01:36:54.207 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-04T01:36:54.208 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:36:54.208 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-04T01:36:54.216 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-04T01:36:54.216 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:36:54.217 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-04T01:36:54.237 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-04T01:36:54.238 DEBUG:teuthology.orchestra.run.smithi077:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-04T01:36:54.248 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-04T01:36:54.249 DEBUG:teuthology.orchestra.run.smithi122:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-04T01:36:54.307 DEBUG:teuthology.orchestra.run.smithi077:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-04T01:36:54.319 DEBUG:teuthology.orchestra.run.smithi122:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-04T01:36:54.388 DEBUG:teuthology.orchestra.run.smithi077:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-04T01:36:54.400 DEBUG:teuthology.orchestra.run.smithi122:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-04T01:36:54.455 INFO:teuthology.orchestra.run.smithi077.stdout:check_obsoletes = 1 2023-11-04T01:36:54.456 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum clean all 2023-11-04T01:36:54.468 INFO:teuthology.orchestra.run.smithi122.stdout:check_obsoletes = 1 2023-11-04T01:36:54.469 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum clean all 2023-11-04T01:36:54.700 INFO:teuthology.orchestra.run.smithi077.stdout:72 files removed 2023-11-04T01:36:54.709 INFO:teuthology.orchestra.run.smithi122.stdout:72 files removed 2023-11-04T01:36:54.730 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-04T01:36:54.735 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-04T01:36:55.755 INFO:teuthology.orchestra.run.smithi122.stdout:ceph packages for x86_64 111 kB/s | 78 kB 00:00 2023-11-04T01:36:55.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph packages for x86_64 90 kB/s | 78 kB 00:00 2023-11-04T01:36:56.589 INFO:teuthology.orchestra.run.smithi122.stdout:ceph noarch packages 12 kB/s | 9.4 kB 00:00 2023-11-04T01:36:56.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph noarch packages 13 kB/s | 9.4 kB 00:00 2023-11-04T01:36:57.416 INFO:teuthology.orchestra.run.smithi122.stdout:ceph source packages 2.4 kB/s | 1.9 kB 00:00 2023-11-04T01:36:57.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph source packages 2.3 kB/s | 1.9 kB 00:00 2023-11-04T01:36:57.817 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS-9 - AppStream 17 MB/s | 6.3 MB 00:00 2023-11-04T01:36:57.913 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS-9 - AppStream 17 MB/s | 6.3 MB 00:00 2023-11-04T01:36:59.125 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS-9 - BaseOS 7.3 MB/s | 2.0 MB 00:00 2023-11-04T01:36:59.222 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS-9 - BaseOS 7.2 MB/s | 2.0 MB 00:00 2023-11-04T01:37:00.504 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - BaseOS 8.2 MB/s | 7.9 MB 00:00 2023-11-04T01:37:00.608 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - BaseOS 6.8 MB/s | 7.9 MB 00:01 2023-11-04T01:37:04.617 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - AppStream 6.0 MB/s | 18 MB 00:02 2023-11-04T01:37:06.755 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - AppStream 3.4 MB/s | 18 MB 00:05 2023-11-04T01:37:08.926 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - CRB 5.7 MB/s | 5.8 MB 00:01 2023-11-04T01:37:10.261 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - Extras packages 57 kB/s | 15 kB 00:00 2023-11-04T01:37:10.506 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - CRB 12 MB/s | 5.8 MB 00:00 2023-11-04T01:37:12.050 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 15 kB 00:00 2023-11-04T01:37:15.406 INFO:teuthology.orchestra.run.smithi122.stdout:Extra Packages for Enterprise Linux 3.8 MB/s | 19 MB 00:05 2023-11-04T01:37:17.386 INFO:teuthology.orchestra.run.smithi077.stdout:Extra Packages for Enterprise Linux 3.7 MB/s | 19 MB 00:05 2023-11-04T01:37:19.953 INFO:teuthology.orchestra.run.smithi122.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2023-11-04T01:37:21.916 INFO:teuthology.orchestra.run.smithi077.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2023-11-04T01:37:22.269 INFO:teuthology.orchestra.run.smithi122.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-04T01:37:22.269 INFO:teuthology.orchestra.run.smithi122.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-04T01:37:22.282 INFO:teuthology.orchestra.run.smithi122.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-11-04T01:37:22.283 INFO:teuthology.orchestra.run.smithi122.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-11-04T01:37:22.283 INFO:teuthology.orchestra.run.smithi122.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-11-04T01:37:22.283 INFO:teuthology.orchestra.run.smithi122.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-11-04T01:37:22.285 INFO:teuthology.orchestra.run.smithi122.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-11-04T01:37:22.287 INFO:teuthology.orchestra.run.smithi122.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-11-04T01:37:22.288 INFO:teuthology.orchestra.run.smithi122.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-11-04T01:37:22.357 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2023-11-04T01:37:22.374 INFO:teuthology.orchestra.run.smithi122.stdout:============================================================================================ 2023-11-04T01:37:22.374 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2023-11-04T01:37:22.374 INFO:teuthology.orchestra.run.smithi122.stdout:============================================================================================ 2023-11-04T01:37:22.374 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2023-11-04T01:37:22.375 INFO:teuthology.orchestra.run.smithi122.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-11-04T01:37:22.375 INFO:teuthology.orchestra.run.smithi122.stdout: ceph x86_64 2:18.0.0-7035.g7532011a.el9 ceph 6.5 k 2023-11-04T01:37:22.375 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-base x86_64 2:18.0.0-7035.g7532011a.el9 ceph 5.2 M 2023-11-04T01:37:22.375 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-fuse x86_64 2:18.0.0-7035.g7532011a.el9 ceph 859 k 2023-11-04T01:37:22.375 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7035.g7532011a.el9 ceph 140 k 2023-11-04T01:37:22.376 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr x86_64 2:18.0.0-7035.g7532011a.el9 ceph 1.5 M 2023-11-04T01:37:22.376 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 132 k 2023-11-04T01:37:22.376 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 1.8 M 2023-11-04T01:37:22.376 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 7.4 M 2023-11-04T01:37:22.377 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-rook noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 48 k 2023-11-04T01:37:22.377 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-radosgw x86_64 2:18.0.0-7035.g7532011a.el9 ceph 8.7 M 2023-11-04T01:37:22.377 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-test x86_64 2:18.0.0-7035.g7532011a.el9 ceph 41 M 2023-11-04T01:37:22.377 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-volume noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 262 k 2023-11-04T01:37:22.377 INFO:teuthology.orchestra.run.smithi122.stdout: cephadm noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 270 k 2023-11-04T01:37:22.378 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-mirror x86_64 2:18.0.0-7035.g7532011a.el9 ceph 217 k 2023-11-04T01:37:22.378 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-top noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 18 k 2023-11-04T01:37:22.378 INFO:teuthology.orchestra.run.smithi122.stdout: elfutils-libelf-devel x86_64 0.189-3.el9 appstream 22 k 2023-11-04T01:37:22.378 INFO:teuthology.orchestra.run.smithi122.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-11-04T01:37:22.378 INFO:teuthology.orchestra.run.smithi122.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-11-04T01:37:22.379 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs-devel x86_64 2:18.0.0-7035.g7532011a.el9 ceph 31 k 2023-11-04T01:37:22.379 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs2 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 718 k 2023-11-04T01:37:22.379 INFO:teuthology.orchestra.run.smithi122.stdout: librados-devel x86_64 2:18.0.0-7035.g7532011a.el9 ceph 126 k 2023-11-04T01:37:22.379 INFO:teuthology.orchestra.run.smithi122.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-11-04T01:37:22.380 INFO:teuthology.orchestra.run.smithi122.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2023-11-04T01:37:22.380 INFO:teuthology.orchestra.run.smithi122.stdout: openssl-devel x86_64 1:3.0.7-24.el9 appstream 4.1 M 2023-11-04T01:37:22.380 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-11-04T01:37:22.380 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-11-04T01:37:22.380 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-11-04T01:37:22.380 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cephfs x86_64 2:18.0.0-7035.g7532011a.el9 ceph 162 k 2023-11-04T01:37:22.381 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rados x86_64 2:18.0.0-7035.g7532011a.el9 ceph 320 k 2023-11-04T01:37:22.381 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rbd x86_64 2:18.0.0-7035.g7532011a.el9 ceph 299 k 2023-11-04T01:37:22.381 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rgw x86_64 2:18.0.0-7035.g7532011a.el9 ceph 99 k 2023-11-04T01:37:22.381 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-fuse x86_64 2:18.0.0-7035.g7532011a.el9 ceph 84 k 2023-11-04T01:37:22.381 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-mirror x86_64 2:18.0.0-7035.g7532011a.el9 ceph 3.0 M 2023-11-04T01:37:22.382 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-nbd x86_64 2:18.0.0-7035.g7532011a.el9 ceph 169 k 2023-11-04T01:37:22.382 INFO:teuthology.orchestra.run.smithi122.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 appstream 86 k 2023-11-04T01:37:22.382 INFO:teuthology.orchestra.run.smithi122.stdout:Upgrading: 2023-11-04T01:37:22.382 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager x86_64 1:1.45.5-1.el9 CentOS-BaseOS 2.2 M 2023-11-04T01:37:22.382 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-libnm x86_64 1:1.45.5-1.el9 CentOS-BaseOS 1.8 M 2023-11-04T01:37:22.383 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-team x86_64 1:1.45.5-1.el9 CentOS-BaseOS 42 k 2023-11-04T01:37:22.383 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-tui x86_64 1:1.45.5-1.el9 CentOS-BaseOS 245 k 2023-11-04T01:37:22.383 INFO:teuthology.orchestra.run.smithi122.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-11-04T01:37:22.383 INFO:teuthology.orchestra.run.smithi122.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-11-04T01:37:22.383 INFO:teuthology.orchestra.run.smithi122.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-11-04T01:37:22.384 INFO:teuthology.orchestra.run.smithi122.stdout: librados2 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 3.3 M 2023-11-04T01:37:22.384 INFO:teuthology.orchestra.run.smithi122.stdout: librbd1 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 3.0 M 2023-11-04T01:37:22.384 INFO:teuthology.orchestra.run.smithi122.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-11-04T01:37:22.384 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2023-11-04T01:37:22.384 INFO:teuthology.orchestra.run.smithi122.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2023-11-04T01:37:22.385 INFO:teuthology.orchestra.run.smithi122.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-04T01:37:22.385 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-common x86_64 2:18.0.0-7035.g7532011a.el9 ceph 19 M 2023-11-04T01:37:22.385 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 23 k 2023-11-04T01:37:22.385 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mds x86_64 2:18.0.0-7035.g7532011a.el9 ceph 2.1 M 2023-11-04T01:37:22.385 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 243 k 2023-11-04T01:37:22.386 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mon x86_64 2:18.0.0-7035.g7532011a.el9 ceph 4.4 M 2023-11-04T01:37:22.386 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-osd x86_64 2:18.0.0-7035.g7532011a.el9 ceph 18 M 2023-11-04T01:37:22.386 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 15 k 2023-11-04T01:37:22.386 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-selinux x86_64 2:18.0.0-7035.g7532011a.el9 ceph 24 k 2023-11-04T01:37:22.386 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-04T01:37:22.387 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-04T01:37:22.387 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-04T01:37:22.387 INFO:teuthology.orchestra.run.smithi122.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-04T01:37:22.387 INFO:teuthology.orchestra.run.smithi122.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-04T01:37:22.387 INFO:teuthology.orchestra.run.smithi122.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-11-04T01:37:22.388 INFO:teuthology.orchestra.run.smithi122.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-04T01:37:22.388 INFO:teuthology.orchestra.run.smithi122.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-04T01:37:22.388 INFO:teuthology.orchestra.run.smithi122.stdout: libcephsqlite x86_64 2:18.0.0-7035.g7532011a.el9 ceph 163 k 2023-11-04T01:37:22.388 INFO:teuthology.orchestra.run.smithi122.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-04T01:37:22.388 INFO:teuthology.orchestra.run.smithi122.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-04T01:37:22.388 INFO:teuthology.orchestra.run.smithi122.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-04T01:37:22.389 INFO:teuthology.orchestra.run.smithi122.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-04T01:37:22.389 INFO:teuthology.orchestra.run.smithi122.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-11-04T01:37:22.389 INFO:teuthology.orchestra.run.smithi122.stdout: libradosstriper1 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 476 k 2023-11-04T01:37:22.389 INFO:teuthology.orchestra.run.smithi122.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-04T01:37:22.389 INFO:teuthology.orchestra.run.smithi122.stdout: librgw2 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 4.8 M 2023-11-04T01:37:22.390 INFO:teuthology.orchestra.run.smithi122.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-04T01:37:22.390 INFO:teuthology.orchestra.run.smithi122.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-11-04T01:37:22.390 INFO:teuthology.orchestra.run.smithi122.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-04T01:37:22.390 INFO:teuthology.orchestra.run.smithi122.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-04T01:37:22.391 INFO:teuthology.orchestra.run.smithi122.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-04T01:37:22.391 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-04T01:37:22.391 INFO:teuthology.orchestra.run.smithi122.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-04T01:37:22.391 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-11-04T01:37:22.393 INFO:teuthology.orchestra.run.smithi122.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-04T01:37:22.393 INFO:teuthology.orchestra.run.smithi122.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-04T01:37:22.393 INFO:teuthology.orchestra.run.smithi122.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-04T01:37:22.393 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-04T01:37:22.394 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-argparse x86_64 2:18.0.0-7035.g7532011a.el9 ceph 45 k 2023-11-04T01:37:22.394 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-common x86_64 2:18.0.0-7035.g7532011a.el9 ceph 127 k 2023-11-04T01:37:22.394 INFO:teuthology.orchestra.run.smithi122.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-04T01:37:22.394 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-04T01:37:22.395 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-04T01:37:22.395 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-04T01:37:22.395 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-11-04T01:37:22.395 INFO:teuthology.orchestra.run.smithi122.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-11-04T01:37:22.395 INFO:teuthology.orchestra.run.smithi122.stdout: python3-google-auth noarch 1:2.23.3-1.el9 epel 197 k 2023-11-04T01:37:22.396 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-04T01:37:22.396 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-04T01:37:22.396 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-04T01:37:22.396 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-04T01:37:22.397 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-04T01:37:22.397 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-04T01:37:22.397 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-04T01:37:22.398 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-04T01:37:22.398 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-04T01:37:22.398 INFO:teuthology.orchestra.run.smithi122.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-04T01:37:22.398 INFO:teuthology.orchestra.run.smithi122.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-04T01:37:22.398 INFO:teuthology.orchestra.run.smithi122.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-04T01:37:22.399 INFO:teuthology.orchestra.run.smithi122.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-04T01:37:22.399 INFO:teuthology.orchestra.run.smithi122.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-04T01:37:22.400 INFO:teuthology.orchestra.run.smithi122.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-04T01:37:22.400 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-04T01:37:22.400 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-04T01:37:22.400 INFO:teuthology.orchestra.run.smithi122.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-04T01:37:22.401 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-04T01:37:22.401 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-04T01:37:22.401 INFO:teuthology.orchestra.run.smithi122.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-04T01:37:22.401 INFO:teuthology.orchestra.run.smithi122.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-04T01:37:22.401 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-04T01:37:22.402 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-04T01:37:22.402 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-04T01:37:22.402 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-04T01:37:22.402 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-11-04T01:37:22.403 INFO:teuthology.orchestra.run.smithi122.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-04T01:37:22.403 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-04T01:37:22.403 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-04T01:37:22.403 INFO:teuthology.orchestra.run.smithi122.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-04T01:37:22.404 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-04T01:37:22.404 INFO:teuthology.orchestra.run.smithi122.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-04T01:37:22.404 INFO:teuthology.orchestra.run.smithi122.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-04T01:37:22.404 INFO:teuthology.orchestra.run.smithi122.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-04T01:37:22.404 INFO:teuthology.orchestra.run.smithi122.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-04T01:37:22.405 INFO:teuthology.orchestra.run.smithi122.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-04T01:37:22.405 INFO:teuthology.orchestra.run.smithi122.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-04T01:37:22.405 INFO:teuthology.orchestra.run.smithi122.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-04T01:37:22.405 INFO:teuthology.orchestra.run.smithi122.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-04T01:37:22.405 INFO:teuthology.orchestra.run.smithi122.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-04T01:37:22.406 INFO:teuthology.orchestra.run.smithi122.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-04T01:37:22.406 INFO:teuthology.orchestra.run.smithi122.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-04T01:37:22.406 INFO:teuthology.orchestra.run.smithi122.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-04T01:37:22.406 INFO:teuthology.orchestra.run.smithi122.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-11-04T01:37:22.406 INFO:teuthology.orchestra.run.smithi122.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-04T01:37:22.407 INFO:teuthology.orchestra.run.smithi122.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2023-11-04T01:37:22.407 INFO:teuthology.orchestra.run.smithi122.stdout:Installing weak dependencies: 2023-11-04T01:37:22.408 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-04T01:37:22.408 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:37:22.409 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2023-11-04T01:37:22.409 INFO:teuthology.orchestra.run.smithi122.stdout:============================================================================================ 2023-11-04T01:37:22.409 INFO:teuthology.orchestra.run.smithi122.stdout:Install 132 Packages 2023-11-04T01:37:22.409 INFO:teuthology.orchestra.run.smithi122.stdout:Upgrade 10 Packages 2023-11-04T01:37:22.410 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:37:22.410 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 200 M 2023-11-04T01:37:22.410 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2023-11-04T01:37:23.113 INFO:teuthology.orchestra.run.smithi122.stdout:(1/142): ceph-18.0.0-7035.g7532011a.el9.x86_64. 16 kB/s | 6.5 kB 00:00 2023-11-04T01:37:24.271 INFO:teuthology.orchestra.run.smithi077.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-04T01:37:24.272 INFO:teuthology.orchestra.run.smithi122.stdout:(2/142): ceph-fuse-18.0.0-7035.g7532011a.el9.x8 742 kB/s | 859 kB 00:01 2023-11-04T01:37:24.272 INFO:teuthology.orchestra.run.smithi077.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-04T01:37:24.284 INFO:teuthology.orchestra.run.smithi077.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-11-04T01:37:24.285 INFO:teuthology.orchestra.run.smithi077.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-11-04T01:37:24.286 INFO:teuthology.orchestra.run.smithi077.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-11-04T01:37:24.287 INFO:teuthology.orchestra.run.smithi077.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-11-04T01:37:24.289 INFO:teuthology.orchestra.run.smithi077.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-11-04T01:37:24.292 INFO:teuthology.orchestra.run.smithi077.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-11-04T01:37:24.293 INFO:teuthology.orchestra.run.smithi077.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-11-04T01:37:24.361 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2023-11-04T01:37:24.382 INFO:teuthology.orchestra.run.smithi077.stdout:============================================================================================ 2023-11-04T01:37:24.382 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2023-11-04T01:37:24.382 INFO:teuthology.orchestra.run.smithi077.stdout:============================================================================================ 2023-11-04T01:37:24.383 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2023-11-04T01:37:24.383 INFO:teuthology.orchestra.run.smithi077.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-11-04T01:37:24.383 INFO:teuthology.orchestra.run.smithi077.stdout: ceph x86_64 2:18.0.0-7035.g7532011a.el9 ceph 6.5 k 2023-11-04T01:37:24.383 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-base x86_64 2:18.0.0-7035.g7532011a.el9 ceph 5.2 M 2023-11-04T01:37:24.384 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-fuse x86_64 2:18.0.0-7035.g7532011a.el9 ceph 859 k 2023-11-04T01:37:24.384 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7035.g7532011a.el9 ceph 140 k 2023-11-04T01:37:24.384 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr x86_64 2:18.0.0-7035.g7532011a.el9 ceph 1.5 M 2023-11-04T01:37:24.384 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 132 k 2023-11-04T01:37:24.384 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 1.8 M 2023-11-04T01:37:24.385 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 7.4 M 2023-11-04T01:37:24.385 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-rook noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 48 k 2023-11-04T01:37:24.385 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-radosgw x86_64 2:18.0.0-7035.g7532011a.el9 ceph 8.7 M 2023-11-04T01:37:24.385 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-test x86_64 2:18.0.0-7035.g7532011a.el9 ceph 41 M 2023-11-04T01:37:24.385 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-volume noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 262 k 2023-11-04T01:37:24.386 INFO:teuthology.orchestra.run.smithi077.stdout: cephadm noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 270 k 2023-11-04T01:37:24.386 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-mirror x86_64 2:18.0.0-7035.g7532011a.el9 ceph 217 k 2023-11-04T01:37:24.386 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-top noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 18 k 2023-11-04T01:37:24.386 INFO:teuthology.orchestra.run.smithi077.stdout: elfutils-libelf-devel x86_64 0.189-3.el9 appstream 22 k 2023-11-04T01:37:24.386 INFO:teuthology.orchestra.run.smithi077.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-11-04T01:37:24.387 INFO:teuthology.orchestra.run.smithi077.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-11-04T01:37:24.387 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs-devel x86_64 2:18.0.0-7035.g7532011a.el9 ceph 31 k 2023-11-04T01:37:24.387 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs2 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 718 k 2023-11-04T01:37:24.387 INFO:teuthology.orchestra.run.smithi077.stdout: librados-devel x86_64 2:18.0.0-7035.g7532011a.el9 ceph 126 k 2023-11-04T01:37:24.387 INFO:teuthology.orchestra.run.smithi077.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-11-04T01:37:24.388 INFO:teuthology.orchestra.run.smithi077.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2023-11-04T01:37:24.388 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-devel x86_64 1:3.0.7-24.el9 appstream 4.1 M 2023-11-04T01:37:24.388 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-11-04T01:37:24.388 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-11-04T01:37:24.389 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-11-04T01:37:24.389 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cephfs x86_64 2:18.0.0-7035.g7532011a.el9 ceph 162 k 2023-11-04T01:37:24.389 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rados x86_64 2:18.0.0-7035.g7532011a.el9 ceph 320 k 2023-11-04T01:37:24.389 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rbd x86_64 2:18.0.0-7035.g7532011a.el9 ceph 299 k 2023-11-04T01:37:24.389 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rgw x86_64 2:18.0.0-7035.g7532011a.el9 ceph 99 k 2023-11-04T01:37:24.389 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-fuse x86_64 2:18.0.0-7035.g7532011a.el9 ceph 84 k 2023-11-04T01:37:24.390 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-mirror x86_64 2:18.0.0-7035.g7532011a.el9 ceph 3.0 M 2023-11-04T01:37:24.390 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-nbd x86_64 2:18.0.0-7035.g7532011a.el9 ceph 169 k 2023-11-04T01:37:24.390 INFO:teuthology.orchestra.run.smithi077.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 appstream 86 k 2023-11-04T01:37:24.390 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrading: 2023-11-04T01:37:24.391 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager x86_64 1:1.45.5-1.el9 CentOS-BaseOS 2.2 M 2023-11-04T01:37:24.391 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-libnm x86_64 1:1.45.5-1.el9 CentOS-BaseOS 1.8 M 2023-11-04T01:37:24.391 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-team x86_64 1:1.45.5-1.el9 CentOS-BaseOS 42 k 2023-11-04T01:37:24.391 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-tui x86_64 1:1.45.5-1.el9 CentOS-BaseOS 245 k 2023-11-04T01:37:24.391 INFO:teuthology.orchestra.run.smithi077.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-11-04T01:37:24.392 INFO:teuthology.orchestra.run.smithi077.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-11-04T01:37:24.392 INFO:teuthology.orchestra.run.smithi077.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-11-04T01:37:24.392 INFO:teuthology.orchestra.run.smithi077.stdout: librados2 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 3.3 M 2023-11-04T01:37:24.392 INFO:teuthology.orchestra.run.smithi077.stdout: librbd1 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 3.0 M 2023-11-04T01:37:24.393 INFO:teuthology.orchestra.run.smithi077.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-11-04T01:37:24.393 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2023-11-04T01:37:24.393 INFO:teuthology.orchestra.run.smithi077.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2023-11-04T01:37:24.393 INFO:teuthology.orchestra.run.smithi077.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-04T01:37:24.394 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-common x86_64 2:18.0.0-7035.g7532011a.el9 ceph 19 M 2023-11-04T01:37:24.394 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 23 k 2023-11-04T01:37:24.394 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mds x86_64 2:18.0.0-7035.g7532011a.el9 ceph 2.1 M 2023-11-04T01:37:24.394 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 243 k 2023-11-04T01:37:24.395 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mon x86_64 2:18.0.0-7035.g7532011a.el9 ceph 4.4 M 2023-11-04T01:37:24.395 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-osd x86_64 2:18.0.0-7035.g7532011a.el9 ceph 18 M 2023-11-04T01:37:24.395 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7035.g7532011a.el9 ceph-noarch 15 k 2023-11-04T01:37:24.396 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-selinux x86_64 2:18.0.0-7035.g7532011a.el9 ceph 24 k 2023-11-04T01:37:24.396 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-04T01:37:24.397 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-04T01:37:24.397 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-04T01:37:24.397 INFO:teuthology.orchestra.run.smithi077.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-04T01:37:24.398 INFO:teuthology.orchestra.run.smithi077.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-04T01:37:24.398 INFO:teuthology.orchestra.run.smithi077.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-11-04T01:37:24.398 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-04T01:37:24.398 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-04T01:37:24.398 INFO:teuthology.orchestra.run.smithi077.stdout: libcephsqlite x86_64 2:18.0.0-7035.g7532011a.el9 ceph 163 k 2023-11-04T01:37:24.399 INFO:teuthology.orchestra.run.smithi077.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-04T01:37:24.399 INFO:teuthology.orchestra.run.smithi077.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-04T01:37:24.399 INFO:teuthology.orchestra.run.smithi077.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-04T01:37:24.399 INFO:teuthology.orchestra.run.smithi077.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-04T01:37:24.399 INFO:teuthology.orchestra.run.smithi077.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-11-04T01:37:24.400 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 476 k 2023-11-04T01:37:24.400 INFO:teuthology.orchestra.run.smithi077.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-04T01:37:24.400 INFO:teuthology.orchestra.run.smithi077.stdout: librgw2 x86_64 2:18.0.0-7035.g7532011a.el9 ceph 4.8 M 2023-11-04T01:37:24.400 INFO:teuthology.orchestra.run.smithi077.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-04T01:37:24.400 INFO:teuthology.orchestra.run.smithi077.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-11-04T01:37:24.401 INFO:teuthology.orchestra.run.smithi077.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-04T01:37:24.401 INFO:teuthology.orchestra.run.smithi077.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-04T01:37:24.401 INFO:teuthology.orchestra.run.smithi077.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-04T01:37:24.401 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-04T01:37:24.402 INFO:teuthology.orchestra.run.smithi077.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-04T01:37:24.402 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-11-04T01:37:24.402 INFO:teuthology.orchestra.run.smithi077.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-04T01:37:24.402 INFO:teuthology.orchestra.run.smithi077.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-04T01:37:24.402 INFO:teuthology.orchestra.run.smithi077.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-04T01:37:24.403 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-04T01:37:24.403 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-argparse x86_64 2:18.0.0-7035.g7532011a.el9 ceph 45 k 2023-11-04T01:37:24.403 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-common x86_64 2:18.0.0-7035.g7532011a.el9 ceph 127 k 2023-11-04T01:37:24.403 INFO:teuthology.orchestra.run.smithi077.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-04T01:37:24.404 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-04T01:37:24.404 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-04T01:37:24.404 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-04T01:37:24.404 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-11-04T01:37:24.404 INFO:teuthology.orchestra.run.smithi077.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-11-04T01:37:24.405 INFO:teuthology.orchestra.run.smithi077.stdout: python3-google-auth noarch 1:2.23.3-1.el9 epel 197 k 2023-11-04T01:37:24.405 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-04T01:37:24.405 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-04T01:37:24.405 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-04T01:37:24.405 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-04T01:37:24.406 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-04T01:37:24.406 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-04T01:37:24.406 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-04T01:37:24.406 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-04T01:37:24.407 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-04T01:37:24.407 INFO:teuthology.orchestra.run.smithi077.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-04T01:37:24.407 INFO:teuthology.orchestra.run.smithi077.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-04T01:37:24.407 INFO:teuthology.orchestra.run.smithi077.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-04T01:37:24.408 INFO:teuthology.orchestra.run.smithi077.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-04T01:37:24.408 INFO:teuthology.orchestra.run.smithi077.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-04T01:37:24.408 INFO:teuthology.orchestra.run.smithi077.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-04T01:37:24.408 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-04T01:37:24.408 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-04T01:37:24.409 INFO:teuthology.orchestra.run.smithi077.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-04T01:37:24.409 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-04T01:37:24.409 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-04T01:37:24.409 INFO:teuthology.orchestra.run.smithi077.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-04T01:37:24.410 INFO:teuthology.orchestra.run.smithi077.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-04T01:37:24.410 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-04T01:37:24.410 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-04T01:37:24.410 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-04T01:37:24.410 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-04T01:37:24.410 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-11-04T01:37:24.411 INFO:teuthology.orchestra.run.smithi077.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-04T01:37:24.411 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-04T01:37:24.411 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-04T01:37:24.411 INFO:teuthology.orchestra.run.smithi077.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-04T01:37:24.411 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-04T01:37:24.412 INFO:teuthology.orchestra.run.smithi077.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-04T01:37:24.412 INFO:teuthology.orchestra.run.smithi077.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-04T01:37:24.412 INFO:teuthology.orchestra.run.smithi077.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-04T01:37:24.412 INFO:teuthology.orchestra.run.smithi077.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-04T01:37:24.412 INFO:teuthology.orchestra.run.smithi077.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-04T01:37:24.413 INFO:teuthology.orchestra.run.smithi077.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-04T01:37:24.413 INFO:teuthology.orchestra.run.smithi077.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-04T01:37:24.413 INFO:teuthology.orchestra.run.smithi077.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-04T01:37:24.413 INFO:teuthology.orchestra.run.smithi077.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-04T01:37:24.413 INFO:teuthology.orchestra.run.smithi077.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-04T01:37:24.414 INFO:teuthology.orchestra.run.smithi077.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-04T01:37:24.414 INFO:teuthology.orchestra.run.smithi077.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-04T01:37:24.414 INFO:teuthology.orchestra.run.smithi077.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-11-04T01:37:24.414 INFO:teuthology.orchestra.run.smithi077.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-04T01:37:24.414 INFO:teuthology.orchestra.run.smithi077.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2023-11-04T01:37:24.415 INFO:teuthology.orchestra.run.smithi077.stdout:Installing weak dependencies: 2023-11-04T01:37:24.415 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-04T01:37:24.415 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:37:24.415 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2023-11-04T01:37:24.415 INFO:teuthology.orchestra.run.smithi077.stdout:============================================================================================ 2023-11-04T01:37:24.416 INFO:teuthology.orchestra.run.smithi077.stdout:Install 132 Packages 2023-11-04T01:37:24.416 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrade 10 Packages 2023-11-04T01:37:24.416 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:37:24.417 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 200 M 2023-11-04T01:37:24.417 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2023-11-04T01:37:24.455 INFO:teuthology.orchestra.run.smithi122.stdout:(3/142): ceph-immutable-object-cache-18.0.0-703 768 kB/s | 140 kB 00:00 2023-11-04T01:37:25.384 INFO:teuthology.orchestra.run.smithi077.stdout:(1/142): ceph-18.0.0-7035.g7532011a.el9.x86_64. 15 kB/s | 6.5 kB 00:00 2023-11-04T01:37:25.838 INFO:teuthology.orchestra.run.smithi122.stdout:(4/142): ceph-mds-18.0.0-7035.g7532011a.el9.x86 1.5 MB/s | 2.1 MB 00:01 2023-11-04T01:37:26.222 INFO:teuthology.orchestra.run.smithi122.stdout:(5/142): ceph-base-18.0.0-7035.g7532011a.el9.x8 1.5 MB/s | 5.2 MB 00:03 2023-11-04T01:37:26.681 INFO:teuthology.orchestra.run.smithi122.stdout:(6/142): ceph-mgr-18.0.0-7035.g7532011a.el9.x86 1.7 MB/s | 1.5 MB 00:00 2023-11-04T01:37:27.137 INFO:teuthology.orchestra.run.smithi077.stdout:(2/142): ceph-base-18.0.0-7035.g7532011a.el9.x8 2.4 MB/s | 5.2 MB 00:02 2023-11-04T01:37:27.167 INFO:teuthology.orchestra.run.smithi077.stdout:(3/142): ceph-fuse-18.0.0-7035.g7532011a.el9.x8 482 kB/s | 859 kB 00:01 2023-11-04T01:37:27.426 INFO:teuthology.orchestra.run.smithi077.stdout:(4/142): ceph-immutable-object-cache-18.0.0-703 487 kB/s | 140 kB 00:00 2023-11-04T01:37:27.860 INFO:teuthology.orchestra.run.smithi077.stdout:(5/142): ceph-mds-18.0.0-7035.g7532011a.el9.x86 3.0 MB/s | 2.1 MB 00:00 2023-11-04T01:37:29.260 INFO:teuthology.orchestra.run.smithi077.stdout:(6/142): ceph-mon-18.0.0-7035.g7532011a.el9.x86 3.1 MB/s | 4.4 MB 00:01 2023-11-04T01:37:29.389 INFO:teuthology.orchestra.run.smithi122.stdout:(7/142): ceph-mon-18.0.0-7035.g7532011a.el9.x86 1.4 MB/s | 4.4 MB 00:03 2023-11-04T01:37:29.818 INFO:teuthology.orchestra.run.smithi077.stdout:(7/142): ceph-mgr-18.0.0-7035.g7532011a.el9.x86 626 kB/s | 1.5 MB 00:02 2023-11-04T01:37:32.868 INFO:teuthology.orchestra.run.smithi077.stdout:(8/142): ceph-common-18.0.0-7035.g7532011a.el9. 2.4 MB/s | 19 MB 00:07 2023-11-04T01:37:32.977 INFO:teuthology.orchestra.run.smithi077.stdout:(9/142): ceph-selinux-18.0.0-7035.g7532011a.el9 223 kB/s | 24 kB 00:00 2023-11-04T01:37:33.397 INFO:teuthology.orchestra.run.smithi122.stdout:(8/142): ceph-common-18.0.0-7035.g7532011a.el9. 1.8 MB/s | 19 MB 00:10 2023-11-04T01:37:33.597 INFO:teuthology.orchestra.run.smithi122.stdout:(9/142): ceph-osd-18.0.0-7035.g7532011a.el9.x86 2.6 MB/s | 18 MB 00:06 2023-11-04T01:37:33.614 INFO:teuthology.orchestra.run.smithi122.stdout:(10/142): ceph-selinux-18.0.0-7035.g7532011a.el 111 kB/s | 24 kB 00:00 2023-11-04T01:37:33.839 INFO:teuthology.orchestra.run.smithi122.stdout:(11/142): cephfs-mirror-18.0.0-7035.g7532011a.e 964 kB/s | 217 kB 00:00 2023-11-04T01:37:33.915 INFO:teuthology.orchestra.run.smithi122.stdout:(12/142): libcephfs-devel-18.0.0-7035.g7532011a 414 kB/s | 31 kB 00:00 2023-11-04T01:37:34.399 INFO:teuthology.orchestra.run.smithi122.stdout:(13/142): libcephfs2-18.0.0-7035.g7532011a.el9. 1.5 MB/s | 718 kB 00:00 2023-11-04T01:37:34.574 INFO:teuthology.orchestra.run.smithi122.stdout:(14/142): libcephsqlite-18.0.0-7035.g7532011a.e 931 kB/s | 163 kB 00:00 2023-11-04T01:37:34.724 INFO:teuthology.orchestra.run.smithi122.stdout:(15/142): librados-devel-18.0.0-7035.g7532011a. 844 kB/s | 126 kB 00:00 2023-11-04T01:37:35.108 INFO:teuthology.orchestra.run.smithi122.stdout:(16/142): libradosstriper1-18.0.0-7035.g7532011 1.2 MB/s | 476 kB 00:00 2023-11-04T01:37:35.527 INFO:teuthology.orchestra.run.smithi077.stdout:(10/142): ceph-osd-18.0.0-7035.g7532011a.el9.x8 2.8 MB/s | 18 MB 00:06 2023-11-04T01:37:35.710 INFO:teuthology.orchestra.run.smithi077.stdout:(11/142): cephfs-mirror-18.0.0-7035.g7532011a.e 1.2 MB/s | 217 kB 00:00 2023-11-04T01:37:35.802 INFO:teuthology.orchestra.run.smithi077.stdout:(12/142): libcephfs-devel-18.0.0-7035.g7532011a 339 kB/s | 31 kB 00:00 2023-11-04T01:37:35.991 INFO:teuthology.orchestra.run.smithi122.stdout:(17/142): ceph-radosgw-18.0.0-7035.g7532011a.el 1.3 MB/s | 8.7 MB 00:06 2023-11-04T01:37:36.086 INFO:teuthology.orchestra.run.smithi077.stdout:(13/142): libcephfs2-18.0.0-7035.g7532011a.el9. 2.5 MB/s | 718 kB 00:00 2023-11-04T01:37:36.091 INFO:teuthology.orchestra.run.smithi122.stdout:(18/142): python3-ceph-argparse-18.0.0-7035.g75 453 kB/s | 45 kB 00:00 2023-11-04T01:37:36.178 INFO:teuthology.orchestra.run.smithi077.stdout:(14/142): libcephsqlite-18.0.0-7035.g7532011a.e 1.7 MB/s | 163 kB 00:00 2023-11-04T01:37:36.200 INFO:teuthology.orchestra.run.smithi122.stdout:(19/142): python3-ceph-common-18.0.0-7035.g7532 1.1 MB/s | 127 kB 00:00 2023-11-04T01:37:36.278 INFO:teuthology.orchestra.run.smithi077.stdout:(15/142): librados-devel-18.0.0-7035.g7532011a. 1.2 MB/s | 126 kB 00:00 2023-11-04T01:37:36.409 INFO:teuthology.orchestra.run.smithi122.stdout:(20/142): python3-cephfs-18.0.0-7035.g7532011a. 778 kB/s | 162 kB 00:00 2023-11-04T01:37:36.537 INFO:teuthology.orchestra.run.smithi077.stdout:(16/142): libradosstriper1-18.0.0-7035.g7532011 1.8 MB/s | 476 kB 00:00 2023-11-04T01:37:36.709 INFO:teuthology.orchestra.run.smithi122.stdout:(21/142): python3-rados-18.0.0-7035.g7532011a.e 1.0 MB/s | 320 kB 00:00 2023-11-04T01:37:37.009 INFO:teuthology.orchestra.run.smithi122.stdout:(22/142): python3-rbd-18.0.0-7035.g7532011a.el9 997 kB/s | 299 kB 00:00 2023-11-04T01:37:37.118 INFO:teuthology.orchestra.run.smithi122.stdout:(23/142): python3-rgw-18.0.0-7035.g7532011a.el9 919 kB/s | 99 kB 00:00 2023-11-04T01:37:37.235 INFO:teuthology.orchestra.run.smithi122.stdout:(24/142): rbd-fuse-18.0.0-7035.g7532011a.el9.x8 722 kB/s | 84 kB 00:00 2023-11-04T01:37:38.595 INFO:teuthology.orchestra.run.smithi077.stdout:(17/142): librgw2-18.0.0-7035.g7532011a.el9.x86 2.3 MB/s | 4.8 MB 00:02 2023-11-04T01:37:39.003 INFO:teuthology.orchestra.run.smithi077.stdout:(18/142): python3-ceph-argparse-18.0.0-7035.g75 111 kB/s | 45 kB 00:00 2023-11-04T01:37:39.354 INFO:teuthology.orchestra.run.smithi077.stdout:(19/142): python3-ceph-common-18.0.0-7035.g7532 362 kB/s | 127 kB 00:00 2023-11-04T01:37:39.612 INFO:teuthology.orchestra.run.smithi077.stdout:(20/142): python3-cephfs-18.0.0-7035.g7532011a. 627 kB/s | 162 kB 00:00 2023-11-04T01:37:39.902 INFO:teuthology.orchestra.run.smithi122.stdout:(25/142): rbd-mirror-18.0.0-7035.g7532011a.el9. 1.1 MB/s | 3.0 MB 00:02 2023-11-04T01:37:40.171 INFO:teuthology.orchestra.run.smithi077.stdout:(21/142): python3-rados-18.0.0-7035.g7532011a.e 573 kB/s | 320 kB 00:00 2023-11-04T01:37:40.226 INFO:teuthology.orchestra.run.smithi122.stdout:(26/142): librgw2-18.0.0-7035.g7532011a.el9.x86 959 kB/s | 4.8 MB 00:05 2023-11-04T01:37:40.318 INFO:teuthology.orchestra.run.smithi122.stdout:(27/142): ceph-grafana-dashboards-18.0.0-7035.g 253 kB/s | 23 kB 00:00 2023-11-04T01:37:40.735 INFO:teuthology.orchestra.run.smithi122.stdout:(28/142): rbd-nbd-18.0.0-7035.g7532011a.el9.x86 203 kB/s | 169 kB 00:00 2023-11-04T01:37:40.761 INFO:teuthology.orchestra.run.smithi122.stdout:(29/142): ceph-mgr-cephadm-18.0.0-7035.g7532011 299 kB/s | 132 kB 00:00 2023-11-04T01:37:40.780 INFO:teuthology.orchestra.run.smithi077.stdout:(22/142): ceph-radosgw-18.0.0-7035.g7532011a.el 813 kB/s | 8.7 MB 00:10 2023-11-04T01:37:40.830 INFO:teuthology.orchestra.run.smithi077.stdout:(23/142): python3-rbd-18.0.0-7035.g7532011a.el9 454 kB/s | 299 kB 00:00 2023-11-04T01:37:41.005 INFO:teuthology.orchestra.run.smithi077.stdout:(24/142): rbd-fuse-18.0.0-7035.g7532011a.el9.x8 481 kB/s | 84 kB 00:00 2023-11-04T01:37:41.280 INFO:teuthology.orchestra.run.smithi077.stdout:(25/142): python3-rgw-18.0.0-7035.g7532011a.el9 199 kB/s | 99 kB 00:00 2023-11-04T01:37:42.180 INFO:teuthology.orchestra.run.smithi077.stdout:(26/142): rbd-nbd-18.0.0-7035.g7532011a.el9.x86 188 kB/s | 169 kB 00:00 2023-11-04T01:37:42.372 INFO:teuthology.orchestra.run.smithi077.stdout:(27/142): ceph-grafana-dashboards-18.0.0-7035.g 121 kB/s | 23 kB 00:00 2023-11-04T01:37:42.956 INFO:teuthology.orchestra.run.smithi077.stdout:(28/142): ceph-mgr-cephadm-18.0.0-7035.g7532011 227 kB/s | 132 kB 00:00 2023-11-04T01:37:43.488 INFO:teuthology.orchestra.run.smithi122.stdout:(30/142): ceph-mgr-dashboard-18.0.0-7035.g75320 655 kB/s | 1.8 MB 00:02 2023-11-04T01:37:43.878 INFO:teuthology.orchestra.run.smithi122.stdout:(31/142): ceph-mgr-modules-core-18.0.0-7035.g75 620 kB/s | 243 kB 00:00 2023-11-04T01:37:43.986 INFO:teuthology.orchestra.run.smithi122.stdout:(32/142): ceph-mgr-rook-18.0.0-7035.g7532011a.e 441 kB/s | 48 kB 00:00 2023-11-04T01:37:44.103 INFO:teuthology.orchestra.run.smithi122.stdout:(33/142): ceph-prometheus-alerts-18.0.0-7035.g7 130 kB/s | 15 kB 00:00 2023-11-04T01:37:44.503 INFO:teuthology.orchestra.run.smithi122.stdout:(34/142): ceph-volume-18.0.0-7035.g7532011a.el9 656 kB/s | 262 kB 00:00 2023-11-04T01:37:44.895 INFO:teuthology.orchestra.run.smithi122.stdout:(35/142): cephadm-18.0.0-7035.g7532011a.el9.noa 690 kB/s | 270 kB 00:00 2023-11-04T01:37:45.020 INFO:teuthology.orchestra.run.smithi122.stdout:(36/142): cephfs-top-18.0.0-7035.g7532011a.el9. 146 kB/s | 18 kB 00:00 2023-11-04T01:37:45.156 INFO:teuthology.orchestra.run.smithi077.stdout:(29/142): rbd-mirror-18.0.0-7035.g7532011a.el9. 742 kB/s | 3.0 MB 00:04 2023-11-04T01:37:45.166 INFO:teuthology.orchestra.run.smithi122.stdout:(37/142): bison-3.7.4-5.el9.x86_64.rpm 6.2 MB/s | 920 kB 00:00 2023-11-04T01:37:45.213 INFO:teuthology.orchestra.run.smithi122.stdout:(38/142): boost-program-options-1.75.0-8.el9.x8 2.3 MB/s | 106 kB 00:00 2023-11-04T01:37:45.246 INFO:teuthology.orchestra.run.smithi122.stdout:(39/142): flex-2.6.4-9.el9.x86_64.rpm 9.0 MB/s | 307 kB 00:00 2023-11-04T01:37:45.280 INFO:teuthology.orchestra.run.smithi122.stdout:(40/142): flexiblas-3.0.4-8.el9.x86_64.rpm 956 kB/s | 32 kB 00:00 2023-11-04T01:37:45.356 INFO:teuthology.orchestra.run.smithi122.stdout:(41/142): flexiblas-netlib-3.0.4-8.el9.x86_64.r 40 MB/s | 3.0 MB 00:00 2023-11-04T01:37:45.389 INFO:teuthology.orchestra.run.smithi122.stdout:(42/142): flexiblas-openblas-openmp-3.0.4-8.el9 516 kB/s | 17 kB 00:00 2023-11-04T01:37:45.425 INFO:teuthology.orchestra.run.smithi122.stdout:(43/142): libaio-devel-0.3.111-13.el9.x86_64.rp 303 kB/s | 10 kB 00:00 2023-11-04T01:37:45.456 INFO:teuthology.orchestra.run.smithi122.stdout:(44/142): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.7 MB/s | 159 kB 00:00 2023-11-04T01:37:45.490 INFO:teuthology.orchestra.run.smithi122.stdout:(45/142): librdkafka-1.6.1-102.el9.x86_64.rpm 19 MB/s | 661 kB 00:00 2023-11-04T01:37:45.540 INFO:teuthology.orchestra.run.smithi122.stdout:(46/142): libtool-2.4.6-45.el9.x86_64.rpm 11 MB/s | 578 kB 00:00 2023-11-04T01:37:45.574 INFO:teuthology.orchestra.run.smithi122.stdout:(47/142): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2023-11-04T01:37:45.607 INFO:teuthology.orchestra.run.smithi122.stdout:(48/142): lttng-ust-2.12.0-6.el9.x86_64.rpm 8.3 MB/s | 282 kB 00:00 2023-11-04T01:37:45.644 INFO:teuthology.orchestra.run.smithi122.stdout:(49/142): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.8 MB/s | 217 kB 00:00 2023-11-04T01:37:45.678 INFO:teuthology.orchestra.run.smithi122.stdout:(50/142): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2023-11-04T01:37:45.762 INFO:teuthology.orchestra.run.smithi122.stdout:(51/142): openblas-openmp-0.3.21-2.el9.x86_64.r 57 MB/s | 4.7 MB 00:00 2023-11-04T01:37:45.812 INFO:teuthology.orchestra.run.smithi122.stdout:(52/142): postgresql-13.11-1.el9.x86_64.rpm 30 MB/s | 1.5 MB 00:00 2023-11-04T01:37:45.863 INFO:teuthology.orchestra.run.smithi122.stdout:(53/142): postgresql-contrib-13.11-1.el9.x86_64 16 MB/s | 811 kB 00:00 2023-11-04T01:37:45.896 INFO:teuthology.orchestra.run.smithi122.stdout:(54/142): postgresql-private-libs-13.11-1.el9.x 3.9 MB/s | 134 kB 00:00 2023-11-04T01:37:45.988 INFO:teuthology.orchestra.run.smithi122.stdout:(55/142): postgresql-server-13.11-1.el9.x86_64. 62 MB/s | 5.7 MB 00:00 2023-11-04T01:37:46.080 INFO:teuthology.orchestra.run.smithi122.stdout:(56/142): python3-babel-2.9.1-2.el9.noarch.rpm 63 MB/s | 5.8 MB 00:00 2023-11-04T01:37:46.114 INFO:teuthology.orchestra.run.smithi122.stdout:(57/142): python3-devel-3.9.17-2.el9.x86_64.rpm 6.1 MB/s | 205 kB 00:00 2023-11-04T01:37:46.147 INFO:teuthology.orchestra.run.smithi122.stdout:(58/142): python3-jinja2-2.11.3-4.el9.noarch.rp 6.7 MB/s | 228 kB 00:00 2023-11-04T01:37:46.231 INFO:teuthology.orchestra.run.smithi122.stdout:(59/142): python3-jsonpatch-1.21-16.el9.noarch. 292 kB/s | 24 kB 00:00 2023-11-04T01:37:46.265 INFO:teuthology.orchestra.run.smithi122.stdout:(60/142): python3-jsonpointer-2.0-4.el9.noarch. 541 kB/s | 18 kB 00:00 2023-11-04T01:37:46.298 INFO:teuthology.orchestra.run.smithi122.stdout:(61/142): python3-mako-1.1.4-6.el9.noarch.rpm 4.3 MB/s | 144 kB 00:00 2023-11-04T01:37:46.334 INFO:teuthology.orchestra.run.smithi122.stdout:(62/142): python3-markupsafe-1.1.1-12.el9.x86_6 947 kB/s | 32 kB 00:00 2023-11-04T01:37:46.415 INFO:teuthology.orchestra.run.smithi122.stdout:(63/142): python3-numpy-1.20.1-5.el9.x86_64.rpm 57 MB/s | 4.8 MB 00:00 2023-11-04T01:37:46.449 INFO:teuthology.orchestra.run.smithi122.stdout:(64/142): python3-numpy-f2py-1.20.1-5.el9.x86_6 6.4 MB/s | 217 kB 00:00 2023-11-04T01:37:46.483 INFO:teuthology.orchestra.run.smithi122.stdout:(65/142): python3-oauthlib-3.1.1-5.el9.noarch.r 5.1 MB/s | 174 kB 00:00 2023-11-04T01:37:46.516 INFO:teuthology.orchestra.run.smithi122.stdout:(66/142): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 41 kB 00:00 2023-11-04T01:37:46.550 INFO:teuthology.orchestra.run.smithi122.stdout:(67/142): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.9 MB/s | 132 kB 00:00 2023-11-04T01:37:46.583 INFO:teuthology.orchestra.run.smithi122.stdout:(68/142): python3-pyasn1-modules-0.4.8-6.el9.no 6.2 MB/s | 211 kB 00:00 2023-11-04T01:37:46.617 INFO:teuthology.orchestra.run.smithi122.stdout:(69/142): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 43 kB 00:00 2023-11-04T01:37:46.818 INFO:teuthology.orchestra.run.smithi122.stdout:(70/142): python3-scipy-1.6.2-8.el9.x86_64.rpm 78 MB/s | 16 MB 00:00 2023-11-04T01:37:46.843 INFO:teuthology.orchestra.run.smithi122.stdout:(71/142): python3-toml-0.10.2-6.el9.noarch.rpm 1.5 MB/s | 39 kB 00:00 2023-11-04T01:37:46.876 INFO:teuthology.orchestra.run.smithi122.stdout:(72/142): socat-1.7.4.1-5.el9.x86_64.rpm 8.8 MB/s | 300 kB 00:00 2023-11-04T01:37:46.902 INFO:teuthology.orchestra.run.smithi122.stdout:(73/142): uuid-1.6.2-55.el9.x86_64.rpm 2.2 MB/s | 56 kB 00:00 2023-11-04T01:37:46.927 INFO:teuthology.orchestra.run.smithi122.stdout:(74/142): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.5 MB/s | 63 kB 00:00 2023-11-04T01:37:46.961 INFO:teuthology.orchestra.run.smithi122.stdout:(75/142): fuse-2.9.9-15.el9.x86_64.rpm 2.3 MB/s | 79 kB 00:00 2023-11-04T01:37:47.011 INFO:teuthology.orchestra.run.smithi122.stdout:(76/142): libgfortran-11.4.1-2.3.el9.x86_64.rpm 16 MB/s | 803 kB 00:00 2023-11-04T01:37:47.045 INFO:teuthology.orchestra.run.smithi122.stdout:(77/142): libquadmath-11.4.1-2.3.el9.x86_64.rpm 5.7 MB/s | 195 kB 00:00 2023-11-04T01:37:47.078 INFO:teuthology.orchestra.run.smithi122.stdout:(78/142): python3-cffi-1.14.5-5.el9.x86_64.rpm 7.1 MB/s | 241 kB 00:00 2023-11-04T01:37:47.103 INFO:teuthology.orchestra.run.smithi122.stdout:(79/142): python3-ply-3.11-14.el9.noarch.rpm 4.0 MB/s | 103 kB 00:00 2023-11-04T01:37:47.137 INFO:teuthology.orchestra.run.smithi122.stdout:(80/142): python3-pycparser-2.20-6.el9.noarch.r 3.7 MB/s | 124 kB 00:00 2023-11-04T01:37:47.171 INFO:teuthology.orchestra.run.smithi122.stdout:(81/142): python3-requests-2.25.1-7.el9.noarch. 3.3 MB/s | 113 kB 00:00 2023-11-04T01:37:47.205 INFO:teuthology.orchestra.run.smithi122.stdout:(82/142): python3-urllib3-1.26.5-4.el9.noarch.r 5.5 MB/s | 187 kB 00:00 2023-11-04T01:37:47.421 INFO:teuthology.orchestra.run.smithi122.stdout:(83/142): python3-cryptography-36.0.1-4.el9.x86 5.7 MB/s | 1.2 MB 00:00 2023-11-04T01:37:47.596 INFO:teuthology.orchestra.run.smithi122.stdout:(84/142): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2023-11-04T01:37:47.638 INFO:teuthology.orchestra.run.smithi122.stdout:(85/142): elfutils-libelf-devel-0.189-3.el9.x86 537 kB/s | 22 kB 00:00 2023-11-04T01:37:47.681 INFO:teuthology.orchestra.run.smithi122.stdout:(86/142): jq-1.6-15.el9.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-11-04T01:37:47.722 INFO:teuthology.orchestra.run.smithi122.stdout:(87/142): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2023-11-04T01:37:47.806 INFO:teuthology.orchestra.run.smithi077.stdout:(30/142): ceph-mgr-dashboard-18.0.0-7035.g75320 371 kB/s | 1.8 MB 00:04 2023-11-04T01:37:47.981 INFO:teuthology.orchestra.run.smithi122.stdout:(88/142): libuuid-devel-2.37.4-15.el9.x86_64.rp 99 kB/s | 26 kB 00:00 2023-11-04T01:37:48.173 INFO:teuthology.orchestra.run.smithi122.stdout:(89/142): openssl-devel-3.0.7-24.el9.x86_64.rpm 22 MB/s | 4.1 MB 00:00 2023-11-04T01:37:48.215 INFO:teuthology.orchestra.run.smithi122.stdout:(90/142): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2023-11-04T01:37:48.257 INFO:teuthology.orchestra.run.smithi122.stdout:(91/142): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 2.0 MB/s | 86 kB 00:00 2023-11-04T01:37:48.299 INFO:teuthology.orchestra.run.smithi122.stdout:(92/142): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2023-11-04T01:37:48.373 INFO:teuthology.orchestra.run.smithi077.stdout:(31/142): ceph-mgr-modules-core-18.0.0-7035.g75 428 kB/s | 243 kB 00:00 2023-11-04T01:37:48.473 INFO:teuthology.orchestra.run.smithi077.stdout:(32/142): ceph-mgr-rook-18.0.0-7035.g7532011a.e 477 kB/s | 48 kB 00:00 2023-11-04T01:37:48.582 INFO:teuthology.orchestra.run.smithi077.stdout:(33/142): ceph-prometheus-alerts-18.0.0-7035.g7 139 kB/s | 15 kB 00:00 2023-11-04T01:37:49.182 INFO:teuthology.orchestra.run.smithi077.stdout:(34/142): ceph-volume-18.0.0-7035.g7532011a.el9 437 kB/s | 262 kB 00:00 2023-11-04T01:37:49.382 INFO:teuthology.orchestra.run.smithi122.stdout:(93/142): gperftools-libs-2.9.1-2.el9.x86_64.rp 285 kB/s | 309 kB 00:01 2023-11-04T01:37:49.799 INFO:teuthology.orchestra.run.smithi077.stdout:(35/142): cephadm-18.0.0-7035.g7532011a.el9.noa 439 kB/s | 270 kB 00:00 2023-11-04T01:37:49.916 INFO:teuthology.orchestra.run.smithi077.stdout:(36/142): cephfs-top-18.0.0-7035.g7532011a.el9. 156 kB/s | 18 kB 00:00 2023-11-04T01:37:50.066 INFO:teuthology.orchestra.run.smithi077.stdout:(37/142): bison-3.7.4-5.el9.x86_64.rpm 6.0 MB/s | 920 kB 00:00 2023-11-04T01:37:50.100 INFO:teuthology.orchestra.run.smithi077.stdout:(38/142): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 106 kB 00:00 2023-11-04T01:37:50.133 INFO:teuthology.orchestra.run.smithi077.stdout:(39/142): flex-2.6.4-9.el9.x86_64.rpm 9.0 MB/s | 307 kB 00:00 2023-11-04T01:37:50.168 INFO:teuthology.orchestra.run.smithi077.stdout:(40/142): flexiblas-3.0.4-8.el9.x86_64.rpm 945 kB/s | 32 kB 00:00 2023-11-04T01:37:50.251 INFO:teuthology.orchestra.run.smithi077.stdout:(41/142): flexiblas-netlib-3.0.4-8.el9.x86_64.r 36 MB/s | 3.0 MB 00:00 2023-11-04T01:37:50.293 INFO:teuthology.orchestra.run.smithi077.stdout:(42/142): flexiblas-openblas-openmp-3.0.4-8.el9 413 kB/s | 17 kB 00:00 2023-11-04T01:37:50.326 INFO:teuthology.orchestra.run.smithi077.stdout:(43/142): libaio-devel-0.3.111-13.el9.x86_64.rp 302 kB/s | 10 kB 00:00 2023-11-04T01:37:50.360 INFO:teuthology.orchestra.run.smithi077.stdout:(44/142): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.7 MB/s | 159 kB 00:00 2023-11-04T01:37:50.410 INFO:teuthology.orchestra.run.smithi077.stdout:(45/142): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2023-11-04T01:37:50.452 INFO:teuthology.orchestra.run.smithi077.stdout:(46/142): libtool-2.4.6-45.el9.x86_64.rpm 14 MB/s | 578 kB 00:00 2023-11-04T01:37:50.477 INFO:teuthology.orchestra.run.smithi077.stdout:(47/142): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.8 MB/s | 46 kB 00:00 2023-11-04T01:37:50.511 INFO:teuthology.orchestra.run.smithi077.stdout:(48/142): lttng-ust-2.12.0-6.el9.x86_64.rpm 8.3 MB/s | 282 kB 00:00 2023-11-04T01:37:50.545 INFO:teuthology.orchestra.run.smithi077.stdout:(49/142): oniguruma-6.9.6-1.el9.5.x86_64.rpm 6.4 MB/s | 217 kB 00:00 2023-11-04T01:37:50.570 INFO:teuthology.orchestra.run.smithi077.stdout:(50/142): openblas-0.3.21-2.el9.x86_64.rpm 1.3 MB/s | 34 kB 00:00 2023-11-04T01:37:50.654 INFO:teuthology.orchestra.run.smithi077.stdout:(51/142): openblas-openmp-0.3.21-2.el9.x86_64.r 57 MB/s | 4.7 MB 00:00 2023-11-04T01:37:50.704 INFO:teuthology.orchestra.run.smithi077.stdout:(52/142): postgresql-13.11-1.el9.x86_64.rpm 31 MB/s | 1.5 MB 00:00 2023-11-04T01:37:50.746 INFO:teuthology.orchestra.run.smithi077.stdout:(53/142): postgresql-contrib-13.11-1.el9.x86_64 19 MB/s | 811 kB 00:00 2023-11-04T01:37:50.779 INFO:teuthology.orchestra.run.smithi077.stdout:(54/142): postgresql-private-libs-13.11-1.el9.x 3.9 MB/s | 134 kB 00:00 2023-11-04T01:37:50.971 INFO:teuthology.orchestra.run.smithi077.stdout:(55/142): postgresql-server-13.11-1.el9.x86_64. 30 MB/s | 5.7 MB 00:00 2023-11-04T01:37:51.063 INFO:teuthology.orchestra.run.smithi077.stdout:(56/142): python3-babel-2.9.1-2.el9.noarch.rpm 63 MB/s | 5.8 MB 00:00 2023-11-04T01:37:51.097 INFO:teuthology.orchestra.run.smithi077.stdout:(57/142): python3-devel-3.9.17-2.el9.x86_64.rpm 6.1 MB/s | 205 kB 00:00 2023-11-04T01:37:51.131 INFO:teuthology.orchestra.run.smithi077.stdout:(58/142): python3-jinja2-2.11.3-4.el9.noarch.rp 6.7 MB/s | 228 kB 00:00 2023-11-04T01:37:51.165 INFO:teuthology.orchestra.run.smithi077.stdout:(59/142): python3-jsonpatch-1.21-16.el9.noarch. 736 kB/s | 24 kB 00:00 2023-11-04T01:37:51.198 INFO:teuthology.orchestra.run.smithi077.stdout:(60/142): python3-jsonpointer-2.0-4.el9.noarch. 545 kB/s | 18 kB 00:00 2023-11-04T01:37:51.231 INFO:teuthology.orchestra.run.smithi077.stdout:(61/142): python3-mako-1.1.4-6.el9.noarch.rpm 4.2 MB/s | 144 kB 00:00 2023-11-04T01:37:51.265 INFO:teuthology.orchestra.run.smithi077.stdout:(62/142): python3-markupsafe-1.1.1-12.el9.x86_6 948 kB/s | 32 kB 00:00 2023-11-04T01:37:51.357 INFO:teuthology.orchestra.run.smithi077.stdout:(63/142): python3-numpy-1.20.1-5.el9.x86_64.rpm 52 MB/s | 4.8 MB 00:00 2023-11-04T01:37:51.391 INFO:teuthology.orchestra.run.smithi077.stdout:(64/142): python3-numpy-f2py-1.20.1-5.el9.x86_6 6.4 MB/s | 217 kB 00:00 2023-11-04T01:37:51.424 INFO:teuthology.orchestra.run.smithi077.stdout:(65/142): python3-oauthlib-3.1.1-5.el9.noarch.r 5.1 MB/s | 174 kB 00:00 2023-11-04T01:37:51.458 INFO:teuthology.orchestra.run.smithi077.stdout:(66/142): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 41 kB 00:00 2023-11-04T01:37:51.508 INFO:teuthology.orchestra.run.smithi077.stdout:(67/142): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2023-11-04T01:37:51.542 INFO:teuthology.orchestra.run.smithi077.stdout:(68/142): python3-pyasn1-modules-0.4.8-6.el9.no 6.2 MB/s | 211 kB 00:00 2023-11-04T01:37:51.576 INFO:teuthology.orchestra.run.smithi077.stdout:(69/142): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 43 kB 00:00 2023-11-04T01:37:51.784 INFO:teuthology.orchestra.run.smithi077.stdout:(70/142): python3-scipy-1.6.2-8.el9.x86_64.rpm 75 MB/s | 16 MB 00:00 2023-11-04T01:37:51.818 INFO:teuthology.orchestra.run.smithi077.stdout:(71/142): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2023-11-04T01:37:51.851 INFO:teuthology.orchestra.run.smithi077.stdout:(72/142): socat-1.7.4.1-5.el9.x86_64.rpm 8.8 MB/s | 300 kB 00:00 2023-11-04T01:37:51.885 INFO:teuthology.orchestra.run.smithi077.stdout:(73/142): uuid-1.6.2-55.el9.x86_64.rpm 1.7 MB/s | 56 kB 00:00 2023-11-04T01:37:51.918 INFO:teuthology.orchestra.run.smithi077.stdout:(74/142): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2023-11-04T01:37:51.944 INFO:teuthology.orchestra.run.smithi077.stdout:(75/142): fuse-2.9.9-15.el9.x86_64.rpm 3.1 MB/s | 79 kB 00:00 2023-11-04T01:37:51.986 INFO:teuthology.orchestra.run.smithi077.stdout:(76/142): libgfortran-11.4.1-2.3.el9.x86_64.rpm 19 MB/s | 803 kB 00:00 2023-11-04T01:37:52.019 INFO:teuthology.orchestra.run.smithi077.stdout:(77/142): libquadmath-11.4.1-2.3.el9.x86_64.rpm 5.7 MB/s | 195 kB 00:00 2023-11-04T01:37:52.053 INFO:teuthology.orchestra.run.smithi077.stdout:(78/142): python3-cffi-1.14.5-5.el9.x86_64.rpm 7.1 MB/s | 241 kB 00:00 2023-11-04T01:37:52.087 INFO:teuthology.orchestra.run.smithi077.stdout:(79/142): python3-ply-3.11-14.el9.noarch.rpm 3.0 MB/s | 103 kB 00:00 2023-11-04T01:37:52.120 INFO:teuthology.orchestra.run.smithi077.stdout:(80/142): python3-pycparser-2.20-6.el9.noarch.r 3.6 MB/s | 124 kB 00:00 2023-11-04T01:37:52.154 INFO:teuthology.orchestra.run.smithi077.stdout:(81/142): python3-requests-2.25.1-7.el9.noarch. 3.3 MB/s | 113 kB 00:00 2023-11-04T01:37:52.187 INFO:teuthology.orchestra.run.smithi077.stdout:(82/142): python3-urllib3-1.26.5-4.el9.noarch.r 5.5 MB/s | 187 kB 00:00 2023-11-04T01:37:52.671 INFO:teuthology.orchestra.run.smithi077.stdout:(83/142): python3-cryptography-36.0.1-4.el9.x86 2.5 MB/s | 1.2 MB 00:00 2023-11-04T01:37:53.404 INFO:teuthology.orchestra.run.smithi077.stdout:(84/142): automake-1.16.2-8.el9.noarch.rpm 940 kB/s | 689 kB 00:00 2023-11-04T01:37:53.496 INFO:teuthology.orchestra.run.smithi077.stdout:(85/142): elfutils-libelf-devel-0.189-3.el9.x86 243 kB/s | 22 kB 00:00 2023-11-04T01:37:53.629 INFO:teuthology.orchestra.run.smithi077.stdout:(86/142): jq-1.6-15.el9.x86_64.rpm 1.4 MB/s | 187 kB 00:00 2023-11-04T01:37:53.746 INFO:teuthology.orchestra.run.smithi077.stdout:(87/142): librabbitmq-0.11.0-7.el9.x86_64.rpm 388 kB/s | 45 kB 00:00 2023-11-04T01:37:53.847 INFO:teuthology.orchestra.run.smithi077.stdout:(88/142): libuuid-devel-2.37.4-15.el9.x86_64.rp 255 kB/s | 26 kB 00:00 2023-11-04T01:37:54.397 INFO:teuthology.orchestra.run.smithi077.stdout:(89/142): openssl-devel-3.0.7-24.el9.x86_64.rpm 7.5 MB/s | 4.1 MB 00:00 2023-11-04T01:37:54.506 INFO:teuthology.orchestra.run.smithi077.stdout:(90/142): python3-pytz-2021.1-5.el9.noarch.rpm 472 kB/s | 51 kB 00:00 2023-11-04T01:37:54.574 INFO:teuthology.orchestra.run.smithi122.stdout:(94/142): ceph-mgr-diskprediction-local-18.0.0- 548 kB/s | 7.4 MB 00:13 2023-11-04T01:37:54.648 INFO:teuthology.orchestra.run.smithi077.stdout:(91/142): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 608 kB/s | 86 kB 00:00 2023-11-04T01:37:54.764 INFO:teuthology.orchestra.run.smithi077.stdout:(92/142): zlib-devel-1.2.11-40.el9.x86_64.rpm 387 kB/s | 45 kB 00:00 2023-11-04T01:37:54.848 INFO:teuthology.orchestra.run.smithi077.stdout:(93/142): gperftools-libs-2.9.1-2.el9.x86_64.rp 3.6 MB/s | 309 kB 00:00 2023-11-04T01:37:54.941 INFO:teuthology.orchestra.run.smithi122.stdout:(95/142): libarrow-doc-9.0.0-9.el9.noarch.rpm 66 kB/s | 24 kB 00:00 2023-11-04T01:37:54.957 INFO:teuthology.orchestra.run.smithi077.stdout:(94/142): libarrow-9.0.0-9.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2023-11-04T01:37:54.991 INFO:teuthology.orchestra.run.smithi077.stdout:(95/142): libarrow-doc-9.0.0-9.el9.noarch.rpm 733 kB/s | 24 kB 00:00 2023-11-04T01:37:55.024 INFO:teuthology.orchestra.run.smithi077.stdout:(96/142): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2023-11-04T01:37:55.049 INFO:teuthology.orchestra.run.smithi077.stdout:(97/142): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2023-11-04T01:37:55.091 INFO:teuthology.orchestra.run.smithi077.stdout:(98/142): parquet-libs-9.0.0-9.el9.x86_64.rpm 20 MB/s | 837 kB 00:00 2023-11-04T01:37:55.142 INFO:teuthology.orchestra.run.smithi077.stdout:(99/142): python3-asyncssh-2.13.2-3.el9.noarch. 11 MB/s | 548 kB 00:00 2023-11-04T01:37:55.175 INFO:teuthology.orchestra.run.smithi122.stdout:(96/142): liboath-2.6.7-2.el9.x86_64.rpm 208 kB/s | 49 kB 00:00 2023-11-04T01:37:55.183 INFO:teuthology.orchestra.run.smithi077.stdout:(100/142): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2023-11-04T01:37:55.234 INFO:teuthology.orchestra.run.smithi077.stdout:(101/142): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2023-11-04T01:37:55.285 INFO:teuthology.orchestra.run.smithi077.stdout:(102/142): python3-certifi-2021.10.8-2.el9.noar 298 kB/s | 15 kB 00:00 2023-11-04T01:37:55.318 INFO:teuthology.orchestra.run.smithi077.stdout:(103/142): python3-cheroot-8.6.0-4.el9.noarch.r 5.1 MB/s | 172 kB 00:00 2023-11-04T01:37:55.360 INFO:teuthology.orchestra.run.smithi077.stdout:(104/142): python3-cherrypy-18.6.1-2.el9.noarch 8.4 MB/s | 358 kB 00:00 2023-11-04T01:37:55.402 INFO:teuthology.orchestra.run.smithi077.stdout:(105/142): python3-google-auth-2.23.3-1.el9.noa 4.6 MB/s | 197 kB 00:00 2023-11-04T01:37:55.435 INFO:teuthology.orchestra.run.smithi122.stdout:(97/142): libunwind-1.6.2-1.el9.x86_64.rpm 260 kB/s | 67 kB 00:00 2023-11-04T01:37:55.452 INFO:teuthology.orchestra.run.smithi077.stdout:(106/142): python3-jaraco-8.2.1-3.el9.noarch.rp 214 kB/s | 11 kB 00:00 2023-11-04T01:37:55.486 INFO:teuthology.orchestra.run.smithi077.stdout:(107/142): python3-jaraco-classes-3.2.1-5.el9.n 532 kB/s | 18 kB 00:00 2023-11-04T01:37:55.519 INFO:teuthology.orchestra.run.smithi077.stdout:(108/142): python3-jaraco-collections-3.0.0-8.e 698 kB/s | 23 kB 00:00 2023-11-04T01:37:55.553 INFO:teuthology.orchestra.run.smithi077.stdout:(109/142): python3-jaraco-functools-3.5.0-2.el9 583 kB/s | 19 kB 00:00 2023-11-04T01:37:55.586 INFO:teuthology.orchestra.run.smithi077.stdout:(110/142): python3-jaraco-text-3.2.0-6.el9.noar 594 kB/s | 20 kB 00:00 2023-11-04T01:37:55.637 INFO:teuthology.orchestra.run.smithi077.stdout:(111/142): python3-jwt+crypto-2.4.0-1.el9.noarc 181 kB/s | 9.0 kB 00:00 2023-11-04T01:37:55.671 INFO:teuthology.orchestra.run.smithi077.stdout:(112/142): python3-jwt-2.4.0-1.el9.noarch.rpm 1.2 MB/s | 41 kB 00:00 2023-11-04T01:37:55.737 INFO:teuthology.orchestra.run.smithi077.stdout:(113/142): python3-kubernetes-26.1.0-2.el9.noar 15 MB/s | 1.0 MB 00:00 2023-11-04T01:37:55.779 INFO:teuthology.orchestra.run.smithi077.stdout:(114/142): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2023-11-04T01:37:55.821 INFO:teuthology.orchestra.run.smithi077.stdout:(115/142): python3-more-itertools-8.12.0-2.el9. 1.8 MB/s | 79 kB 00:00 2023-11-04T01:37:55.855 INFO:teuthology.orchestra.run.smithi077.stdout:(116/142): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2023-11-04T01:37:55.905 INFO:teuthology.orchestra.run.smithi077.stdout:(117/142): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2023-11-04T01:37:55.956 INFO:teuthology.orchestra.run.smithi077.stdout:(118/142): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2023-11-04T01:37:55.989 INFO:teuthology.orchestra.run.smithi077.stdout:(119/142): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.6 MB/s | 90 kB 00:00 2023-11-04T01:37:56.040 INFO:teuthology.orchestra.run.smithi077.stdout:(120/142): python3-repoze-lru-0.7-16.el9.noarch 617 kB/s | 31 kB 00:00 2023-11-04T01:37:56.081 INFO:teuthology.orchestra.run.smithi077.stdout:(121/142): python3-routes-2.5.1-5.el9.noarch.rp 4.5 MB/s | 188 kB 00:00 2023-11-04T01:37:56.110 INFO:teuthology.orchestra.run.smithi122.stdout:(98/142): libarrow-9.0.0-9.el9.x86_64.rpm 672 kB/s | 4.4 MB 00:06 2023-11-04T01:37:56.123 INFO:teuthology.orchestra.run.smithi077.stdout:(122/142): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2023-11-04T01:37:56.165 INFO:teuthology.orchestra.run.smithi077.stdout:(123/142): python3-tempora-5.0.0-2.el9.noarch.r 860 kB/s | 36 kB 00:00 2023-11-04T01:37:56.219 INFO:teuthology.orchestra.run.smithi077.stdout:(124/142): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2023-11-04T01:37:56.249 INFO:teuthology.orchestra.run.smithi077.stdout:(125/142): python3-webob-1.8.7-6.el9.noarch.rpm 6.7 MB/s | 230 kB 00:00 2023-11-04T01:37:56.299 INFO:teuthology.orchestra.run.smithi077.stdout:(126/142): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2023-11-04T01:37:56.341 INFO:teuthology.orchestra.run.smithi077.stdout:(127/142): python3-werkzeug-2.0.3-3.el9.1.noarc 10 MB/s | 427 kB 00:00 2023-11-04T01:37:56.375 INFO:teuthology.orchestra.run.smithi077.stdout:(128/142): python3-zc-lockfile-2.0-10.el9.noarc 599 kB/s | 20 kB 00:00 2023-11-04T01:37:56.409 INFO:teuthology.orchestra.run.smithi077.stdout:(129/142): re2-20211101-3.el9.x86_64.rpm 5.6 MB/s | 192 kB 00:00 2023-11-04T01:37:56.468 INFO:teuthology.orchestra.run.smithi077.stdout:(130/142): thrift-0.15.0-2.el9.x86_64.rpm 27 MB/s | 1.6 MB 00:00 2023-11-04T01:37:56.801 INFO:teuthology.orchestra.run.smithi122.stdout:(99/142): parquet-libs-9.0.0-9.el9.x86_64.rpm 613 kB/s | 837 kB 00:01 2023-11-04T01:37:56.901 INFO:teuthology.orchestra.run.smithi077.stdout:(131/142): ceph-mgr-diskprediction-local-18.0.0 645 kB/s | 7.4 MB 00:11 2023-11-04T01:37:56.935 INFO:teuthology.orchestra.run.smithi122.stdout:(100/142): python3-bcrypt-3.2.2-1.el9.x86_64.rp 326 kB/s | 43 kB 00:00 2023-11-04T01:37:57.077 INFO:teuthology.orchestra.run.smithi122.stdout:(101/142): python3-cachetools-4.2.4-1.el9.noarc 227 kB/s | 32 kB 00:00 2023-11-04T01:37:57.202 INFO:teuthology.orchestra.run.smithi122.stdout:(102/142): python3-certifi-2021.10.8-2.el9.noar 120 kB/s | 15 kB 00:00 2023-11-04T01:37:57.328 INFO:teuthology.orchestra.run.smithi122.stdout:(103/142): python3-asyncssh-2.13.2-3.el9.noarch 450 kB/s | 548 kB 00:01 2023-11-04T01:37:57.528 INFO:teuthology.orchestra.run.smithi122.stdout:(104/142): python3-cheroot-8.6.0-4.el9.noarch.r 528 kB/s | 172 kB 00:00 2023-11-04T01:37:57.862 INFO:teuthology.orchestra.run.smithi122.stdout:(105/142): python3-google-auth-2.23.3-1.el9.noa 591 kB/s | 197 kB 00:00 2023-11-04T01:37:57.987 INFO:teuthology.orchestra.run.smithi122.stdout:(106/142): python3-jaraco-8.2.1-3.el9.noarch.rp 85 kB/s | 11 kB 00:00 2023-11-04T01:37:58.029 INFO:teuthology.orchestra.run.smithi122.stdout:(107/142): python3-cherrypy-18.6.1-2.el9.noarch 511 kB/s | 358 kB 00:00 2023-11-04T01:37:58.121 INFO:teuthology.orchestra.run.smithi122.stdout:(108/142): python3-jaraco-classes-3.2.1-5.el9.n 132 kB/s | 18 kB 00:00 2023-11-04T01:37:58.171 INFO:teuthology.orchestra.run.smithi122.stdout:(109/142): python3-jaraco-collections-3.0.0-8.e 163 kB/s | 23 kB 00:00 2023-11-04T01:37:58.238 INFO:teuthology.orchestra.run.smithi122.stdout:(110/142): python3-jaraco-functools-3.5.0-2.el9 166 kB/s | 19 kB 00:00 2023-11-04T01:37:58.297 INFO:teuthology.orchestra.run.smithi122.stdout:(111/142): python3-jaraco-text-3.2.0-6.el9.noar 157 kB/s | 20 kB 00:00 2023-11-04T01:37:58.372 INFO:teuthology.orchestra.run.smithi122.stdout:(112/142): python3-jwt+crypto-2.4.0-1.el9.noarc 68 kB/s | 9.0 kB 00:00 2023-11-04T01:37:58.422 INFO:teuthology.orchestra.run.smithi122.stdout:(113/142): python3-jwt-2.4.0-1.el9.noarch.rpm 327 kB/s | 41 kB 00:00 2023-11-04T01:37:58.547 INFO:teuthology.orchestra.run.smithi122.stdout:(114/142): python3-logutils-0.3.5-21.el9.noarch 370 kB/s | 46 kB 00:00 2023-11-04T01:37:58.764 INFO:teuthology.orchestra.run.smithi122.stdout:(115/142): python3-more-itertools-8.12.0-2.el9. 364 kB/s | 79 kB 00:00 2023-11-04T01:37:58.898 INFO:teuthology.orchestra.run.smithi122.stdout:(116/142): python3-natsort-7.1.1-5.el9.noarch.r 433 kB/s | 58 kB 00:00 2023-11-04T01:37:59.590 INFO:teuthology.orchestra.run.smithi122.stdout:(117/142): ceph-test-18.0.0-7035.g7532011a.el9. 1.6 MB/s | 41 MB 00:25 2023-11-04T01:37:59.615 INFO:teuthology.orchestra.run.smithi122.stdout:(118/142): python3-pecan-1.4.2-3.el9.noarch.rpm 380 kB/s | 272 kB 00:00 2023-11-04T01:37:59.840 INFO:teuthology.orchestra.run.smithi122.stdout:(119/142): python3-pyOpenSSL-21.0.0-1.el9.noarc 400 kB/s | 90 kB 00:00 2023-11-04T01:37:59.890 INFO:teuthology.orchestra.run.smithi122.stdout:(120/142): python3-portend-3.1.0-2.el9.noarch.r 55 kB/s | 16 kB 00:00 2023-11-04T01:37:59.949 INFO:teuthology.orchestra.run.smithi122.stdout:(121/142): python3-kubernetes-26.1.0-2.el9.noar 663 kB/s | 1.0 MB 00:01 2023-11-04T01:38:00.085 INFO:teuthology.orchestra.run.smithi122.stdout:(122/142): python3-repoze-lru-0.7-16.el9.noarch 126 kB/s | 31 kB 00:00 2023-11-04T01:38:00.109 INFO:teuthology.orchestra.run.smithi122.stdout:(123/142): python3-rsa-4.9-2.el9.noarch.rpm 373 kB/s | 59 kB 00:00 2023-11-04T01:38:00.200 INFO:teuthology.orchestra.run.smithi122.stdout:(124/142): python3-tempora-5.0.0-2.el9.noarch.r 312 kB/s | 36 kB 00:00 2023-11-04T01:38:00.234 INFO:teuthology.orchestra.run.smithi122.stdout:(125/142): python3-typing-extensions-4.4.0-2.el 407 kB/s | 51 kB 00:00 2023-11-04T01:38:00.469 INFO:teuthology.orchestra.run.smithi122.stdout:(126/142): python3-websocket-client-1.2.3-2.el9 381 kB/s | 90 kB 00:00 2023-11-04T01:38:00.538 INFO:teuthology.orchestra.run.smithi122.stdout:(127/142): python3-routes-2.5.1-5.el9.noarch.rp 292 kB/s | 188 kB 00:00 2023-11-04T01:38:00.587 INFO:teuthology.orchestra.run.smithi122.stdout:(128/142): python3-webob-1.8.7-6.el9.noarch.rpm 594 kB/s | 230 kB 00:00 2023-11-04T01:38:00.653 INFO:teuthology.orchestra.run.smithi122.stdout:(129/142): python3-zc-lockfile-2.0-10.el9.noarc 171 kB/s | 20 kB 00:00 2023-11-04T01:38:00.784 INFO:teuthology.orchestra.run.smithi077.stdout:(132/142): librbd1-18.0.0-7035.g7532011a.el9.x8 796 kB/s | 3.0 MB 00:03 2023-11-04T01:38:00.818 INFO:teuthology.orchestra.run.smithi077.stdout:(133/142): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2023-11-04T01:38:00.877 INFO:teuthology.orchestra.run.smithi077.stdout:(134/142): NetworkManager-1.45.5-1.el9.x86_64.r 38 MB/s | 2.2 MB 00:00 2023-11-04T01:38:00.879 INFO:teuthology.orchestra.run.smithi122.stdout:(130/142): re2-20211101-3.el9.x86_64.rpm 657 kB/s | 192 kB 00:00 2023-11-04T01:38:00.927 INFO:teuthology.orchestra.run.smithi077.stdout:(135/142): NetworkManager-libnm-1.45.5-1.el9.x8 36 MB/s | 1.8 MB 00:00 2023-11-04T01:38:00.961 INFO:teuthology.orchestra.run.smithi077.stdout:(136/142): NetworkManager-team-1.45.5-1.el9.x86 1.2 MB/s | 42 kB 00:00 2023-11-04T01:38:01.011 INFO:teuthology.orchestra.run.smithi077.stdout:(137/142): librados2-18.0.0-7035.g7532011a.el9. 747 kB/s | 3.3 MB 00:04 2023-11-04T01:38:01.029 INFO:teuthology.orchestra.run.smithi122.stdout:(131/142): python3-werkzeug-2.0.3-3.el9.1.noarc 764 kB/s | 427 kB 00:00 2023-11-04T01:38:01.036 INFO:teuthology.orchestra.run.smithi077.stdout:(138/142): NetworkManager-tui-1.45.5-1.el9.x86_ 3.2 MB/s | 245 kB 00:00 2023-11-04T01:38:01.061 INFO:teuthology.orchestra.run.smithi077.stdout:(139/142): acl-2.3.1-4.el9.x86_64.rpm 1.4 MB/s | 69 kB 00:00 2023-11-04T01:38:01.087 INFO:teuthology.orchestra.run.smithi077.stdout:(140/142): libacl-2.3.1-4.el9.x86_64.rpm 437 kB/s | 22 kB 00:00 2023-11-04T01:38:01.129 INFO:teuthology.orchestra.run.smithi077.stdout:(141/142): xfsdump-3.1.12-4.el9.x86_64.rpm 4.7 MB/s | 321 kB 00:00 2023-11-04T01:38:04.037 INFO:teuthology.orchestra.run.smithi122.stdout:(132/142): librados2-18.0.0-7035.g7532011a.el9. 1.0 MB/s | 3.3 MB 00:03 2023-11-04T01:38:04.087 INFO:teuthology.orchestra.run.smithi122.stdout:(133/142): thrift-0.15.0-2.el9.x86_64.rpm 472 kB/s | 1.6 MB 00:03 2023-11-04T01:38:04.112 INFO:teuthology.orchestra.run.smithi077.stdout:(142/142): ceph-test-18.0.0-7035.g7532011a.el9. 1.3 MB/s | 41 MB 00:31 2023-11-04T01:38:04.113 INFO:teuthology.orchestra.run.smithi122.stdout:(134/142): libacl-devel-2.3.1-4.el9.x86_64.rpm 900 kB/s | 68 kB 00:00 2023-11-04T01:38:04.117 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2023-11-04T01:38:04.117 INFO:teuthology.orchestra.run.smithi077.stdout:Total 5.0 MB/s | 200 MB 00:39 2023-11-04T01:38:04.163 INFO:teuthology.orchestra.run.smithi122.stdout:(135/142): NetworkManager-1.45.5-1.el9.x86_64.r 30 MB/s | 2.2 MB 00:00 2023-11-04T01:38:04.205 INFO:teuthology.orchestra.run.smithi122.stdout:(136/142): NetworkManager-libnm-1.45.5-1.el9.x8 20 MB/s | 1.8 MB 00:00 2023-11-04T01:38:04.222 INFO:teuthology.orchestra.run.smithi122.stdout:(137/142): NetworkManager-team-1.45.5-1.el9.x86 749 kB/s | 42 kB 00:00 2023-11-04T01:38:04.247 INFO:teuthology.orchestra.run.smithi122.stdout:(138/142): NetworkManager-tui-1.45.5-1.el9.x86_ 5.7 MB/s | 245 kB 00:00 2023-11-04T01:38:04.262 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2023-11-04T01:38:04.274 INFO:teuthology.orchestra.run.smithi122.stdout:(139/142): acl-2.3.1-4.el9.x86_64.rpm 1.4 MB/s | 69 kB 00:00 2023-11-04T01:38:04.298 INFO:teuthology.orchestra.run.smithi122.stdout:(140/142): libacl-2.3.1-4.el9.x86_64.rpm 438 kB/s | 22 kB 00:00 2023-11-04T01:38:04.323 INFO:teuthology.orchestra.run.smithi122.stdout:(141/142): xfsdump-3.1.12-4.el9.x86_64.rpm 6.3 MB/s | 321 kB 00:00 2023-11-04T01:38:04.387 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2023-11-04T01:38:04.388 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2023-11-04T01:38:04.526 INFO:teuthology.orchestra.run.smithi122.stdout:(142/142): librbd1-18.0.0-7035.g7532011a.el9.x8 885 kB/s | 3.0 MB 00:03 2023-11-04T01:38:04.527 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2023-11-04T01:38:04.528 INFO:teuthology.orchestra.run.smithi122.stdout:Total 4.7 MB/s | 200 MB 00:42 2023-11-04T01:38:04.659 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2023-11-04T01:38:04.782 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2023-11-04T01:38:04.783 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2023-11-04T01:38:06.260 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2023-11-04T01:38:06.261 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2023-11-04T01:38:06.551 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2023-11-04T01:38:06.551 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2023-11-04T01:38:11.807 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2023-11-04T01:38:11.872 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2023-11-04T01:38:11.897 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2023-11-04T01:38:11.924 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2023-11-04T01:38:11.987 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/152 2023-11-04T01:38:12.032 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2023-11-04T01:38:12.100 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2023-11-04T01:38:12.126 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2023-11-04T01:38:12.152 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2023-11-04T01:38:12.206 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/152 2023-11-04T01:38:12.306 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 5/152 2023-11-04T01:38:12.374 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : librados2-2:18.0.0-7035.g7532011a.el9.x86_64 6/152 2023-11-04T01:38:12.493 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados2-2:18.0.0-7035.g7532011a.el9.x86_64 6/152 2023-11-04T01:38:12.516 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephfs2-2:18.0.0-7035.g7532011a.el9.x86_64 7/152 2023-11-04T01:38:12.526 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 5/152 2023-11-04T01:38:12.586 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : librados2-2:18.0.0-7035.g7532011a.el9.x86_64 6/152 2023-11-04T01:38:12.608 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcephfs2-2:18.0.0-7035.g7532011a.el9.x86_64 7/152 2023-11-04T01:38:12.662 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rados-2:18.0.0-7035.g7532011a.el9.x86_64 8/152 2023-11-04T01:38:12.693 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/152 2023-11-04T01:38:12.705 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librados2-2:18.0.0-7035.g7532011a.el9.x86_64 6/152 2023-11-04T01:38:12.729 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephfs2-2:18.0.0-7035.g7532011a.el9.x86_64 7/152 2023-11-04T01:38:12.812 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libcephfs2-2:18.0.0-7035.g7532011a.el9.x86_64 7/152 2023-11-04T01:38:12.857 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 10/152 2023-11-04T01:38:12.864 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rados-2:18.0.0-7035.g7532011a.el9.x86_64 8/152 2023-11-04T01:38:12.898 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/152 2023-11-04T01:38:12.916 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-13.11-1.el9.x86_64 11/152 2023-11-04T01:38:12.967 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephsqlite-2:18.0.0-7035.g7532011a.el9.x86_64 12/152 2023-11-04T01:38:13.053 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 10/152 2023-11-04T01:38:13.055 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7035.g7532011a.el9.x86_64 12/152 2023-11-04T01:38:13.080 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libradosstriper1-2:18.0.0-7035.g7532011a.el9.x86 13/152 2023-11-04T01:38:13.113 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : postgresql-13.11-1.el9.x86_64 11/152 2023-11-04T01:38:13.125 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7035.g7532011a.el9.x86 13/152 2023-11-04T01:38:13.141 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephsqlite-2:18.0.0-7035.g7532011a.el9.x86_64 12/152 2023-11-04T01:38:13.233 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7035.g7532011a.el9.x86_64 12/152 2023-11-04T01:38:13.259 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libradosstriper1-2:18.0.0-7035.g7532011a.el9.x86 13/152 2023-11-04T01:38:13.312 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7035.g7532011a.el9.x86 13/152 2023-11-04T01:38:13.314 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 14/152 2023-11-04T01:38:13.426 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : NetworkManager-libnm-1:1.45.5-1.el9.x86_64 15/152 2023-11-04T01:38:13.486 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.5-1.el9.x86_64 15/152 2023-11-04T01:38:13.494 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 14/152 2023-11-04T01:38:13.600 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-1:1.45.5-1.el9.x86_64 16/152 2023-11-04T01:38:13.613 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : NetworkManager-libnm-1:1.45.5-1.el9.x86_64 15/152 2023-11-04T01:38:13.654 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : NetworkManager-1:1.45.5-1.el9.x86_64 16/152 2023-11-04T01:38:13.657 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.5-1.el9.x86_64 15/152 2023-11-04T01:38:13.754 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: NetworkManager-1:1.45.5-1.el9.x86_64 16/152 2023-11-04T01:38:13.800 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : NetworkManager-1:1.45.5-1.el9.x86_64 16/152 2023-11-04T01:38:13.915 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-1:1.45.5-1.el9.x86_64 16/152 2023-11-04T01:38:13.950 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/152 2023-11-04T01:38:13.984 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2023-11-04T01:38:14.054 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2023-11-04T01:38:14.060 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: NetworkManager-1:1.45.5-1.el9.x86_64 16/152 2023-11-04T01:38:14.096 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/152 2023-11-04T01:38:14.107 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 20/152 2023-11-04T01:38:14.129 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2023-11-04T01:38:14.136 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 21/152 2023-11-04T01:38:14.182 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 22/152 2023-11-04T01:38:14.206 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2023-11-04T01:38:14.255 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 23/152 2023-11-04T01:38:14.260 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 20/152 2023-11-04T01:38:14.291 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 21/152 2023-11-04T01:38:14.297 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/152 2023-11-04T01:38:14.331 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/152 2023-11-04T01:38:14.335 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 22/152 2023-11-04T01:38:14.401 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/152 2023-11-04T01:38:14.405 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 23/152 2023-11-04T01:38:14.436 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ceph-common-2:18.0.0-7035.g7532011a.el9. 27/152 2023-11-04T01:38:14.449 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/152 2023-11-04T01:38:14.476 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/152 2023-11-04T01:38:14.479 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ceph-argparse-2:18.0.0-7035.g7532011a.el 28/152 2023-11-04T01:38:14.544 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/152 2023-11-04T01:38:14.555 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cephfs-2:18.0.0-7035.g7532011a.el9.x86_6 29/152 2023-11-04T01:38:14.582 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-ceph-common-2:18.0.0-7035.g7532011a.el9. 27/152 2023-11-04T01:38:14.616 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-ceph-argparse-2:18.0.0-7035.g7532011a.el 28/152 2023-11-04T01:38:14.688 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cephfs-2:18.0.0-7035.g7532011a.el9.x86_6 29/152 2023-11-04T01:38:14.689 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/152 2023-11-04T01:38:14.741 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/152 2023-11-04T01:38:14.823 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/152 2023-11-04T01:38:14.877 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/152 2023-11-04T01:38:15.273 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/152 2023-11-04T01:38:15.352 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/152 2023-11-04T01:38:15.390 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 34/152 2023-11-04T01:38:15.398 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/152 2023-11-04T01:38:15.428 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librados-devel-2:18.0.0-7035.g7532011a.el9.x86_6 35/152 2023-11-04T01:38:15.458 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/152 2023-11-04T01:38:15.480 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/152 2023-11-04T01:38:15.519 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 34/152 2023-11-04T01:38:15.556 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librados-devel-2:18.0.0-7035.g7532011a.el9.x86_6 35/152 2023-11-04T01:38:15.564 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : re2-1:20211101-3.el9.x86_64 37/152 2023-11-04T01:38:15.586 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/152 2023-11-04T01:38:15.604 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 38/152 2023-11-04T01:38:15.660 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 39/152 2023-11-04T01:38:15.694 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : re2-1:20211101-3.el9.x86_64 37/152 2023-11-04T01:38:15.724 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 38/152 2023-11-04T01:38:15.734 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 40/152 2023-11-04T01:38:15.770 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 39/152 2023-11-04T01:38:15.770 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 41/152 2023-11-04T01:38:15.807 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 42/152 2023-11-04T01:38:15.842 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 40/152 2023-11-04T01:38:15.855 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 43/152 2023-11-04T01:38:15.875 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 41/152 2023-11-04T01:38:15.899 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 44/152 2023-11-04T01:38:15.911 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 42/152 2023-11-04T01:38:15.942 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 45/152 2023-11-04T01:38:15.958 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 43/152 2023-11-04T01:38:16.012 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 44/152 2023-11-04T01:38:16.053 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 45/152 2023-11-04T01:38:16.077 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 46/152 2023-11-04T01:38:16.126 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 47/152 2023-11-04T01:38:16.167 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 48/152 2023-11-04T01:38:16.188 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 46/152 2023-11-04T01:38:16.230 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 47/152 2023-11-04T01:38:16.263 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 49/152 2023-11-04T01:38:16.279 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 48/152 2023-11-04T01:38:16.302 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-google-auth-1:2.23.3-1.el9.noarch 50/152 2023-11-04T01:38:16.342 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 51/152 2023-11-04T01:38:16.374 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 49/152 2023-11-04T01:38:16.375 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 52/152 2023-11-04T01:38:16.401 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 53/152 2023-11-04T01:38:16.414 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-google-auth-1:2.23.3-1.el9.noarch 50/152 2023-11-04T01:38:16.420 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 54/152 2023-11-04T01:38:16.454 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 51/152 2023-11-04T01:38:16.487 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 52/152 2023-11-04T01:38:16.502 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 55/152 2023-11-04T01:38:16.514 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 53/152 2023-11-04T01:38:16.542 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 54/152 2023-11-04T01:38:16.554 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : automake-1.16.2-8.el9.noarch 56/152 2023-11-04T01:38:16.611 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ply-3.11-14.el9.noarch 57/152 2023-11-04T01:38:16.629 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 55/152 2023-11-04T01:38:16.666 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : automake-1.16.2-8.el9.noarch 56/152 2023-11-04T01:38:16.668 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 58/152 2023-11-04T01:38:16.715 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-ply-3.11-14.el9.noarch 57/152 2023-11-04T01:38:16.771 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 58/152 2023-11-04T01:38:16.866 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 59/152 2023-11-04T01:38:16.934 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 60/152 2023-11-04T01:38:16.965 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 59/152 2023-11-04T01:38:17.013 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 60/152 2023-11-04T01:38:17.074 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 61/152 2023-11-04T01:38:17.127 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 62/152 2023-11-04T01:38:17.152 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 61/152 2023-11-04T01:38:17.156 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 63/152 2023-11-04T01:38:17.191 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 64/152 2023-11-04T01:38:17.198 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 62/152 2023-11-04T01:38:17.227 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 63/152 2023-11-04T01:38:17.230 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 65/152 2023-11-04T01:38:17.262 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 64/152 2023-11-04T01:38:17.263 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : fuse-2.9.9-15.el9.x86_64 66/152 2023-11-04T01:38:17.294 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 65/152 2023-11-04T01:38:17.297 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 67/152 2023-11-04T01:38:17.328 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : fuse-2.9.9-15.el9.x86_64 66/152 2023-11-04T01:38:17.342 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : uuid-1.6.2-55.el9.x86_64 68/152 2023-11-04T01:38:17.361 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 67/152 2023-11-04T01:38:17.377 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 69/152 2023-11-04T01:38:17.406 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 70/152 2023-11-04T01:38:17.411 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : uuid-1.6.2-55.el9.x86_64 68/152 2023-11-04T01:38:17.484 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 71/152 2023-11-04T01:38:17.517 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 72/152 2023-11-04T01:38:17.550 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/152 2023-11-04T01:38:17.591 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/152 2023-11-04T01:38:17.626 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/152 2023-11-04T01:38:17.627 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 69/152 2023-11-04T01:38:17.717 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/152 2023-11-04T01:38:17.753 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 77/152 2023-11-04T01:38:17.812 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 70/152 2023-11-04T01:38:17.857 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 78/152 2023-11-04T01:38:17.889 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 71/152 2023-11-04T01:38:17.913 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 79/152 2023-11-04T01:38:17.922 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 72/152 2023-11-04T01:38:17.955 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/152 2023-11-04T01:38:17.988 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/152 2023-11-04T01:38:18.023 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/152 2023-11-04T01:38:18.113 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/152 2023-11-04T01:38:18.151 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 77/152 2023-11-04T01:38:18.254 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 78/152 2023-11-04T01:38:18.302 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 79/152 2023-11-04T01:38:18.662 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/152 2023-11-04T01:38:18.801 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 81/152 2023-11-04T01:38:18.842 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 82/152 2023-11-04T01:38:18.943 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 83/152 2023-11-04T01:38:18.976 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 84/152 2023-11-04T01:38:19.038 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/152 2023-11-04T01:38:19.090 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 81/152 2023-11-04T01:38:19.123 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 82/152 2023-11-04T01:38:19.152 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openblas-0.3.21-2.el9.x86_64 85/152 2023-11-04T01:38:19.174 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 86/152 2023-11-04T01:38:19.225 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 83/152 2023-11-04T01:38:19.251 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 87/152 2023-11-04T01:38:19.259 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 84/152 2023-11-04T01:38:19.436 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : openblas-0.3.21-2.el9.x86_64 85/152 2023-11-04T01:38:19.474 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 86/152 2023-11-04T01:38:19.551 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 87/152 2023-11-04T01:38:19.926 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 88/152 2023-11-04T01:38:20.048 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 89/152 2023-11-04T01:38:20.216 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 88/152 2023-11-04T01:38:20.320 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 89/152 2023-11-04T01:38:21.324 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 90/152 2023-11-04T01:38:21.398 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 91/152 2023-11-04T01:38:21.429 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 92/152 2023-11-04T01:38:21.460 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : jq-1.6-15.el9.x86_64 93/152 2023-11-04T01:38:21.488 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2023-11-04T01:38:21.583 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 90/152 2023-11-04T01:38:21.666 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 91/152 2023-11-04T01:38:21.697 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 92/152 2023-11-04T01:38:21.728 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : jq-1.6-15.el9.x86_64 93/152 2023-11-04T01:38:21.755 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2023-11-04T01:38:21.786 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 95/152 2023-11-04T01:38:21.817 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : librbd1-2:18.0.0-7035.g7532011a.el9.x86_64 96/152 2023-11-04T01:38:21.892 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librbd1-2:18.0.0-7035.g7532011a.el9.x86_64 96/152 2023-11-04T01:38:21.922 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rbd-2:18.0.0-7035.g7532011a.el9.x86_64 97/152 2023-11-04T01:38:21.958 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 98/152 2023-11-04T01:38:22.058 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 95/152 2023-11-04T01:38:22.085 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : librbd1-2:18.0.0-7035.g7532011a.el9.x86_64 96/152 2023-11-04T01:38:22.159 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librbd1-2:18.0.0-7035.g7532011a.el9.x86_64 96/152 2023-11-04T01:38:22.189 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rbd-2:18.0.0-7035.g7532011a.el9.x86_64 97/152 2023-11-04T01:38:22.226 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 98/152 2023-11-04T01:38:22.387 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 99/152 2023-11-04T01:38:22.420 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librgw2-2:18.0.0-7035.g7532011a.el9.x86_64 100/152 2023-11-04T01:38:22.475 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librgw2-2:18.0.0-7035.g7532011a.el9.x86_64 100/152 2023-11-04T01:38:22.505 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rgw-2:18.0.0-7035.g7532011a.el9.x86_64 101/152 2023-11-04T01:38:22.655 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 99/152 2023-11-04T01:38:22.688 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librgw2-2:18.0.0-7035.g7532011a.el9.x86_64 100/152 2023-11-04T01:38:22.759 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librgw2-2:18.0.0-7035.g7532011a.el9.x86_64 100/152 2023-11-04T01:38:22.781 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rgw-2:18.0.0-7035.g7532011a.el9.x86_64 101/152 2023-11-04T01:38:24.633 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 102/152 2023-11-04T01:38:24.669 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 102/152 2023-11-04T01:38:24.969 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 102/152 2023-11-04T01:38:25.006 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 102/152 2023-11-04T01:38:25.204 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 102/152 2023-11-04T01:38:25.239 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-base-2:18.0.0-7035.g7532011a.el9.x86_64 103/152 2023-11-04T01:38:25.326 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-base-2:18.0.0-7035.g7532011a.el9.x86_64 103/152 2023-11-04T01:38:25.327 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-04T01:38:25.327 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-04T01:38:25.327 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:38:25.365 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-selinux-2:18.0.0-7035.g7532011a.el9.x86_64 104/152 2023-11-04T01:38:25.553 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 102/152 2023-11-04T01:38:25.599 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-base-2:18.0.0-7035.g7532011a.el9.x86_64 103/152 2023-11-04T01:38:25.684 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-base-2:18.0.0-7035.g7532011a.el9.x86_64 103/152 2023-11-04T01:38:25.685 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-04T01:38:25.685 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-04T01:38:25.685 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:38:25.717 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-selinux-2:18.0.0-7035.g7532011a.el9.x86_64 104/152 2023-11-04T01:38:36.712 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7035.g7532011a.el9.x86_64 104/152 2023-11-04T01:38:36.713 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /sys 2023-11-04T01:38:36.713 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /proc 2023-11-04T01:38:36.713 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /mnt 2023-11-04T01:38:36.713 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /var/tmp 2023-11-04T01:38:36.714 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /home 2023-11-04T01:38:36.714 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /root 2023-11-04T01:38:36.714 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /tmp 2023-11-04T01:38:36.714 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:38:36.875 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-volume-2:18.0.0-7035.g7532011a.el9.noarch 105/152 2023-11-04T01:38:36.890 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-volume-2:18.0.0-7035.g7532011a.el9.noarch 105/152 2023-11-04T01:38:36.890 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:38:36.890 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-04T01:38:36.891 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:38:37.351 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7035.g7532011a.el9.x86_64 104/152 2023-11-04T01:38:37.352 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /sys 2023-11-04T01:38:37.352 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /proc 2023-11-04T01:38:37.352 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /mnt 2023-11-04T01:38:37.353 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /var/tmp 2023-11-04T01:38:37.353 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /home 2023-11-04T01:38:37.353 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /root 2023-11-04T01:38:37.353 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /tmp 2023-11-04T01:38:37.353 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:38:37.511 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-volume-2:18.0.0-7035.g7532011a.el9.noarch 105/152 2023-11-04T01:38:37.526 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-volume-2:18.0.0-7035.g7532011a.el9.noarch 105/152 2023-11-04T01:38:37.527 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:38:37.527 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-04T01:38:37.527 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:38:38.460 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-osd-2:18.0.0-7035.g7532011a.el9.x86_64 106/152 2023-11-04T01:38:38.485 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-osd-2:18.0.0-7035.g7532011a.el9.x86_64 106/152 2023-11-04T01:38:38.485 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:38:38.486 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-04T01:38:38.486 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-04T01:38:38.486 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-04T01:38:38.486 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:38:38.703 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mds-2:18.0.0-7035.g7532011a.el9.x86_64 107/152 2023-11-04T01:38:38.725 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mds-2:18.0.0-7035.g7532011a.el9.x86_64 107/152 2023-11-04T01:38:38.726 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:38:38.726 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-04T01:38:38.726 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-04T01:38:38.726 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-04T01:38:38.727 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:38:39.106 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-osd-2:18.0.0-7035.g7532011a.el9.x86_64 106/152 2023-11-04T01:38:39.132 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-osd-2:18.0.0-7035.g7532011a.el9.x86_64 106/152 2023-11-04T01:38:39.132 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:38:39.132 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-04T01:38:39.133 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-04T01:38:39.133 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-04T01:38:39.133 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:38:39.171 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mon-2:18.0.0-7035.g7532011a.el9.x86_64 108/152 2023-11-04T01:38:39.194 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mon-2:18.0.0-7035.g7532011a.el9.x86_64 108/152 2023-11-04T01:38:39.194 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:38:39.194 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-04T01:38:39.195 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-04T01:38:39.195 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-04T01:38:39.195 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:38:39.340 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mds-2:18.0.0-7035.g7532011a.el9.x86_64 107/152 2023-11-04T01:38:39.362 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mds-2:18.0.0-7035.g7532011a.el9.x86_64 107/152 2023-11-04T01:38:39.363 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:38:39.363 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-04T01:38:39.363 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-04T01:38:39.363 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-04T01:38:39.364 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:38:39.680 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: cephadm-2:18.0.0-7035.g7532011a.el9.noarch 109/152 2023-11-04T01:38:39.712 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephadm-2:18.0.0-7035.g7532011a.el9.noarch 109/152 2023-11-04T01:38:39.732 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7035.g7532011a.e 110/152 2023-11-04T01:38:39.787 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7035.g7532011a. 111/152 2023-11-04T01:38:39.799 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mon-2:18.0.0-7035.g7532011a.el9.x86_64 108/152 2023-11-04T01:38:39.809 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el9.noa 112/152 2023-11-04T01:38:39.821 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mon-2:18.0.0-7035.g7532011a.el9.x86_64 108/152 2023-11-04T01:38:39.821 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:38:39.821 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-04T01:38:39.822 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-04T01:38:39.822 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-04T01:38:39.822 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:38:40.034 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el9.noa 112/152 2023-11-04T01:38:40.068 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el9.n 113/152 2023-11-04T01:38:40.189 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: cephadm-2:18.0.0-7035.g7532011a.el9.noarch 109/152 2023-11-04T01:38:40.215 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : cephadm-2:18.0.0-7035.g7532011a.el9.noarch 109/152 2023-11-04T01:38:40.243 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7035.g7532011a.e 110/152 2023-11-04T01:38:40.306 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7035.g7532011a. 111/152 2023-11-04T01:38:40.338 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el9.noa 112/152 2023-11-04T01:38:40.561 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el9.noa 112/152 2023-11-04T01:38:40.589 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el9.n 113/152 2023-11-04T01:38:41.034 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el9.n 113/152 2023-11-04T01:38:41.061 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7035.g753 114/152 2023-11-04T01:38:41.161 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7035.g753 114/152 2023-11-04T01:38:41.309 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7035.g7532011a.el 115/152 2023-11-04T01:38:41.346 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-2:18.0.0-7035.g7532011a.el9.x86_64 116/152 2023-11-04T01:38:41.370 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7035.g7532011a.el9.x86_64 116/152 2023-11-04T01:38:41.370 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:38:41.370 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-04T01:38:41.370 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-04T01:38:41.371 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-04T01:38:41.371 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:38:41.413 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-rook-2:18.0.0-7035.g7532011a.el9.noarch 117/152 2023-11-04T01:38:41.424 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7035.g7532011a.el9.noarch 117/152 2023-11-04T01:38:41.562 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el9.n 113/152 2023-11-04T01:38:41.590 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7035.g753 114/152 2023-11-04T01:38:41.689 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7035.g753 114/152 2023-11-04T01:38:41.838 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7035.g7532011a.el 115/152 2023-11-04T01:38:41.866 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-2:18.0.0-7035.g7532011a.el9.x86_64 116/152 2023-11-04T01:38:41.889 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7035.g7532011a.el9.x86_64 116/152 2023-11-04T01:38:41.889 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:38:41.889 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-04T01:38:41.890 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-04T01:38:41.890 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-04T01:38:41.890 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:38:41.933 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-rook-2:18.0.0-7035.g7532011a.el9.noarch 117/152 2023-11-04T01:38:41.944 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7035.g7532011a.el9.noarch 117/152 2023-11-04T01:38:42.206 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-2:18.0.0-7035.g7532011a.el9.x86_64 118/152 2023-11-04T01:38:42.239 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-radosgw-2:18.0.0-7035.g7532011a.el9.x86_64 119/152 2023-11-04T01:38:42.262 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7035.g7532011a.el9.x86_64 119/152 2023-11-04T01:38:42.262 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:38:42.263 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-04T01:38:42.263 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-04T01:38:42.263 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-04T01:38:42.263 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:38:42.307 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7035.g75320 120/152 2023-11-04T01:38:42.329 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7035.g75320 120/152 2023-11-04T01:38:42.329 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:38:42.329 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-04T01:38:42.329 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:38:42.374 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephfs-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 121/152 2023-11-04T01:38:42.396 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 121/152 2023-11-04T01:38:42.397 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:38:42.397 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-11-04T01:38:42.397 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-04T01:38:42.397 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-04T01:38:42.397 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:38:42.707 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 122/152 2023-11-04T01:38:42.727 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-2:18.0.0-7035.g7532011a.el9.x86_64 118/152 2023-11-04T01:38:42.730 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 122/152 2023-11-04T01:38:42.730 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:38:42.730 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-04T01:38:42.730 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-04T01:38:42.731 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-04T01:38:42.731 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:38:42.743 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-radosgw-2:18.0.0-7035.g7532011a.el9.x86_64 119/152 2023-11-04T01:38:42.764 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7035.g7532011a.el9.x86_64 119/152 2023-11-04T01:38:42.765 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:38:42.765 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-04T01:38:42.765 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-04T01:38:42.765 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-04T01:38:42.766 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:38:42.802 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7035.g75320 120/152 2023-11-04T01:38:42.823 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7035.g75320 120/152 2023-11-04T01:38:42.824 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:38:42.824 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-04T01:38:42.824 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:38:42.869 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : cephfs-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 121/152 2023-11-04T01:38:42.891 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 121/152 2023-11-04T01:38:42.892 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:38:42.892 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-11-04T01:38:42.892 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-04T01:38:42.892 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-04T01:38:42.892 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:38:43.186 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 122/152 2023-11-04T01:38:43.208 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 122/152 2023-11-04T01:38:43.208 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T01:38:43.209 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-04T01:38:43.209 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-04T01:38:43.209 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-04T01:38:43.209 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:38:46.552 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-test-2:18.0.0-7035.g7532011a.el9.x86_64 123/152 2023-11-04T01:38:46.602 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 124/152 2023-11-04T01:38:46.632 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-nbd-2:18.0.0-7035.g7532011a.el9.x86_64 125/152 2023-11-04T01:38:46.819 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : elfutils-libelf-devel-0.189-3.el9.x86_64 126/152 2023-11-04T01:38:46.939 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 127/152 2023-11-04T01:38:46.998 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 128/152 2023-11-04T01:38:47.014 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-test-2:18.0.0-7035.g7532011a.el9.x86_64 123/152 2023-11-04T01:38:47.041 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libtool-2.4.6-45.el9.x86_64 129/152 2023-11-04T01:38:47.064 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 124/152 2023-11-04T01:38:47.073 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 130/152 2023-11-04T01:38:47.094 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-nbd-2:18.0.0-7035.g7532011a.el9.x86_64 125/152 2023-11-04T01:38:47.096 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephfs-devel-2:18.0.0-7035.g7532011a.el9.x86_ 131/152 2023-11-04T01:38:47.126 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : NetworkManager-team-1:1.45.5-1.el9.x86_64 132/152 2023-11-04T01:38:47.195 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : NetworkManager-tui-1:1.45.5-1.el9.x86_64 133/152 2023-11-04T01:38:47.263 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 134/152 2023-11-04T01:38:47.268 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : elfutils-libelf-devel-0.189-3.el9.x86_64 126/152 2023-11-04T01:38:47.299 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 135/152 2023-11-04T01:38:47.376 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 127/152 2023-11-04T01:38:47.431 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 128/152 2023-11-04T01:38:47.470 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libtool-2.4.6-45.el9.x86_64 129/152 2023-11-04T01:38:47.503 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 130/152 2023-11-04T01:38:47.526 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephfs-devel-2:18.0.0-7035.g7532011a.el9.x86_ 131/152 2023-11-04T01:38:47.555 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : NetworkManager-team-1:1.45.5-1.el9.x86_64 132/152 2023-11-04T01:38:47.618 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : NetworkManager-tui-1:1.45.5-1.el9.x86_64 133/152 2023-11-04T01:38:47.682 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 134/152 2023-11-04T01:38:47.712 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 135/152 2023-11-04T01:38:47.912 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 136/152 2023-11-04T01:38:47.956 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 136/152 2023-11-04T01:38:47.975 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 136/152 2023-11-04T01:38:48.023 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephfs-top-2:18.0.0-7035.g7532011a.el9.noarch 137/152 2023-11-04T01:38:48.238 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 136/152 2023-11-04T01:38:48.278 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 136/152 2023-11-04T01:38:48.298 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 136/152 2023-11-04T01:38:48.342 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : cephfs-top-2:18.0.0-7035.g7532011a.el9.noarch 137/152 2023-11-04T01:38:48.873 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 138/152 2023-11-04T01:38:48.961 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 139/152 2023-11-04T01:38:49.002 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 140/152 2023-11-04T01:38:49.090 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flex-2.6.4-9.el9.x86_64 141/152 2023-11-04T01:38:49.123 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : bison-3.7.4-5.el9.x86_64 142/152 2023-11-04T01:38:49.149 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 143/152 2023-11-04T01:38:49.149 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 144/152 2023-11-04T01:38:49.167 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 138/152 2023-11-04T01:38:49.216 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 144/152 2023-11-04T01:38:49.258 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 145/152 2023-11-04T01:38:49.258 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 139/152 2023-11-04T01:38:49.283 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 146/152 2023-11-04T01:38:49.298 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 140/152 2023-11-04T01:38:49.316 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 147/152 2023-11-04T01:38:49.324 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 148/152 2023-11-04T01:38:49.324 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 148/152 2023-11-04T01:38:49.378 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flex-2.6.4-9.el9.x86_64 141/152 2023-11-04T01:38:49.411 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : bison-3.7.4-5.el9.x86_64 142/152 2023-11-04T01:38:49.437 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 143/152 2023-11-04T01:38:49.438 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 144/152 2023-11-04T01:38:49.502 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 148/152 2023-11-04T01:38:49.503 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 149/152 2023-11-04T01:38:49.521 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 144/152 2023-11-04T01:38:49.546 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 145/152 2023-11-04T01:38:49.571 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 146/152 2023-11-04T01:38:49.585 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 149/152 2023-11-04T01:38:49.596 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 147/152 2023-11-04T01:38:49.603 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 148/152 2023-11-04T01:38:49.603 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 148/152 2023-11-04T01:38:49.610 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 150/152 2023-11-04T01:38:49.611 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 151/152 2023-11-04T01:38:49.695 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 151/152 2023-11-04T01:38:49.761 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 152/152 2023-11-04T01:38:49.785 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 148/152 2023-11-04T01:38:49.785 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 149/152 2023-11-04T01:38:49.851 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 149/152 2023-11-04T01:38:49.876 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 150/152 2023-11-04T01:38:49.876 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 151/152 2023-11-04T01:38:49.961 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 151/152 2023-11-04T01:38:50.025 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 152/152 2023-11-04T01:38:54.230 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 152/152 2023-11-04T01:38:54.230 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-2:18.0.0-7035.g7532011a.el9.x86_64 1/152 2023-11-04T01:38:54.230 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-base-2:18.0.0-7035.g7532011a.el9.x86_64 2/152 2023-11-04T01:38:54.230 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 3/152 2023-11-04T01:38:54.231 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 4/152 2023-11-04T01:38:54.231 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7035.g75320 5/152 2023-11-04T01:38:54.231 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mds-2:18.0.0-7035.g7532011a.el9.x86_64 6/152 2023-11-04T01:38:54.231 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-2:18.0.0-7035.g7532011a.el9.x86_64 7/152 2023-11-04T01:38:54.231 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mon-2:18.0.0-7035.g7532011a.el9.x86_64 8/152 2023-11-04T01:38:54.232 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-osd-2:18.0.0-7035.g7532011a.el9.x86_64 9/152 2023-11-04T01:38:54.232 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-radosgw-2:18.0.0-7035.g7532011a.el9.x86_64 10/152 2023-11-04T01:38:54.232 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-selinux-2:18.0.0-7035.g7532011a.el9.x86_64 11/152 2023-11-04T01:38:54.232 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-test-2:18.0.0-7035.g7532011a.el9.x86_64 12/152 2023-11-04T01:38:54.232 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephfs-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 13/152 2023-11-04T01:38:54.233 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephfs-devel-2:18.0.0-7035.g7532011a.el9.x86_ 14/152 2023-11-04T01:38:54.233 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephfs2-2:18.0.0-7035.g7532011a.el9.x86_64 15/152 2023-11-04T01:38:54.233 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephsqlite-2:18.0.0-7035.g7532011a.el9.x86_64 16/152 2023-11-04T01:38:54.233 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados-devel-2:18.0.0-7035.g7532011a.el9.x86_6 17/152 2023-11-04T01:38:54.233 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libradosstriper1-2:18.0.0-7035.g7532011a.el9.x86 18/152 2023-11-04T01:38:54.234 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librgw2-2:18.0.0-7035.g7532011a.el9.x86_64 19/152 2023-11-04T01:38:54.234 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7035.g7532011a.el 20/152 2023-11-04T01:38:54.234 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ceph-common-2:18.0.0-7035.g7532011a.el9. 21/152 2023-11-04T01:38:54.234 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cephfs-2:18.0.0-7035.g7532011a.el9.x86_6 22/152 2023-11-04T01:38:54.235 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rados-2:18.0.0-7035.g7532011a.el9.x86_64 23/152 2023-11-04T01:38:54.235 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rbd-2:18.0.0-7035.g7532011a.el9.x86_64 24/152 2023-11-04T01:38:54.235 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rgw-2:18.0.0-7035.g7532011a.el9.x86_64 25/152 2023-11-04T01:38:54.235 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 26/152 2023-11-04T01:38:54.236 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 27/152 2023-11-04T01:38:54.236 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-nbd-2:18.0.0-7035.g7532011a.el9.x86_64 28/152 2023-11-04T01:38:54.236 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7035.g7532011a. 29/152 2023-11-04T01:38:54.236 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el9.noa 30/152 2023-11-04T01:38:54.236 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el9.n 31/152 2023-11-04T01:38:54.236 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7035.g753 32/152 2023-11-04T01:38:54.237 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7035.g7532011a.el 33/152 2023-11-04T01:38:54.237 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7035.g7532011a.el9.noarch 34/152 2023-11-04T01:38:54.247 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7035.g7532011a.e 35/152 2023-11-04T01:38:54.247 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-volume-2:18.0.0-7035.g7532011a.el9.noarch 36/152 2023-11-04T01:38:54.248 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephadm-2:18.0.0-7035.g7532011a.el9.noarch 37/152 2023-11-04T01:38:54.248 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephfs-top-2:18.0.0-7035.g7532011a.el9.noarch 38/152 2023-11-04T01:38:54.248 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : bison-3.7.4-5.el9.x86_64 39/152 2023-11-04T01:38:54.248 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 40/152 2023-11-04T01:38:54.248 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flex-2.6.4-9.el9.x86_64 41/152 2023-11-04T01:38:54.249 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 42/152 2023-11-04T01:38:54.249 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 43/152 2023-11-04T01:38:54.249 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 44/152 2023-11-04T01:38:54.249 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 45/152 2023-11-04T01:38:54.249 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 46/152 2023-11-04T01:38:54.250 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 47/152 2023-11-04T01:38:54.250 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 48/152 2023-11-04T01:38:54.250 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 49/152 2023-11-04T01:38:54.250 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 50/152 2023-11-04T01:38:54.250 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 51/152 2023-11-04T01:38:54.251 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 52/152 2023-11-04T01:38:54.251 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 53/152 2023-11-04T01:38:54.251 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-13.11-1.el9.x86_64 54/152 2023-11-04T01:38:54.251 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 55/152 2023-11-04T01:38:54.251 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 56/152 2023-11-04T01:38:54.251 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 57/152 2023-11-04T01:38:54.252 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 58/152 2023-11-04T01:38:54.252 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 59/152 2023-11-04T01:38:54.252 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 60/152 2023-11-04T01:38:54.252 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/152 2023-11-04T01:38:54.252 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/152 2023-11-04T01:38:54.253 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/152 2023-11-04T01:38:54.253 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/152 2023-11-04T01:38:54.253 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/152 2023-11-04T01:38:54.253 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/152 2023-11-04T01:38:54.253 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/152 2023-11-04T01:38:54.253 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 68/152 2023-11-04T01:38:54.254 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 69/152 2023-11-04T01:38:54.254 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 70/152 2023-11-04T01:38:54.254 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 71/152 2023-11-04T01:38:54.254 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 72/152 2023-11-04T01:38:54.255 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 73/152 2023-11-04T01:38:54.255 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 74/152 2023-11-04T01:38:54.255 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 75/152 2023-11-04T01:38:54.255 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 76/152 2023-11-04T01:38:54.255 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 77/152 2023-11-04T01:38:54.255 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 78/152 2023-11-04T01:38:54.256 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 79/152 2023-11-04T01:38:54.256 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 80/152 2023-11-04T01:38:54.256 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ply-3.11-14.el9.noarch 81/152 2023-11-04T01:38:54.256 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 82/152 2023-11-04T01:38:54.256 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 83/152 2023-11-04T01:38:54.257 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 84/152 2023-11-04T01:38:54.257 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 85/152 2023-11-04T01:38:54.257 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : automake-1.16.2-8.el9.noarch 86/152 2023-11-04T01:38:54.257 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : elfutils-libelf-devel-0.189-3.el9.x86_64 87/152 2023-11-04T01:38:54.257 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : jq-1.6-15.el9.x86_64 88/152 2023-11-04T01:38:54.257 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 89/152 2023-11-04T01:38:54.258 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 90/152 2023-11-04T01:38:54.258 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 91/152 2023-11-04T01:38:54.258 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/152 2023-11-04T01:38:54.258 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 93/152 2023-11-04T01:38:54.258 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 94/152 2023-11-04T01:38:54.259 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 95/152 2023-11-04T01:38:54.259 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 96/152 2023-11-04T01:38:54.259 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 97/152 2023-11-04T01:38:54.259 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/152 2023-11-04T01:38:54.260 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/152 2023-11-04T01:38:54.260 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 100/152 2023-11-04T01:38:54.260 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 101/152 2023-11-04T01:38:54.260 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/152 2023-11-04T01:38:54.260 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/152 2023-11-04T01:38:54.261 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 104/152 2023-11-04T01:38:54.261 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/152 2023-11-04T01:38:54.261 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/152 2023-11-04T01:38:54.261 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-google-auth-1:2.23.3-1.el9.noarch 107/152 2023-11-04T01:38:54.261 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/152 2023-11-04T01:38:54.262 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/152 2023-11-04T01:38:54.262 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/152 2023-11-04T01:38:54.262 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/152 2023-11-04T01:38:54.262 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/152 2023-11-04T01:38:54.262 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 113/152 2023-11-04T01:38:54.263 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 114/152 2023-11-04T01:38:54.263 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/152 2023-11-04T01:38:54.263 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/152 2023-11-04T01:38:54.263 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/152 2023-11-04T01:38:54.263 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/152 2023-11-04T01:38:54.264 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/152 2023-11-04T01:38:54.264 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/152 2023-11-04T01:38:54.264 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/152 2023-11-04T01:38:54.264 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/152 2023-11-04T01:38:54.264 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/152 2023-11-04T01:38:54.265 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/152 2023-11-04T01:38:54.265 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/152 2023-11-04T01:38:54.265 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/152 2023-11-04T01:38:54.265 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/152 2023-11-04T01:38:54.265 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/152 2023-11-04T01:38:54.266 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/152 2023-11-04T01:38:54.266 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/152 2023-11-04T01:38:54.266 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/152 2023-11-04T01:38:54.266 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/152 2023-11-04T01:38:54.266 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados2-2:18.0.0-7035.g7532011a.el9.x86_64 133/152 2023-11-04T01:38:54.266 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/152 2023-11-04T01:38:54.267 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librbd1-2:18.0.0-7035.g7532011a.el9.x86_64 135/152 2023-11-04T01:38:54.267 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/152 2023-11-04T01:38:54.267 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 137/152 2023-11-04T01:38:54.267 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 138/152 2023-11-04T01:38:54.267 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-1:1.45.5-1.el9.x86_64 139/152 2023-11-04T01:38:54.268 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 140/152 2023-11-04T01:38:54.268 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-libnm-1:1.45.5-1.el9.x86_64 141/152 2023-11-04T01:38:54.268 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 142/152 2023-11-04T01:38:54.268 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-team-1:1.45.5-1.el9.x86_64 143/152 2023-11-04T01:38:54.268 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 144/152 2023-11-04T01:38:54.269 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-tui-1:1.45.5-1.el9.x86_64 145/152 2023-11-04T01:38:54.269 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/152 2023-11-04T01:38:54.269 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : acl-2.3.1-4.el9.x86_64 147/152 2023-11-04T01:38:54.269 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : acl-2.3.1-3.el9.x86_64 148/152 2023-11-04T01:38:54.269 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 149/152 2023-11-04T01:38:54.269 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 150/152 2023-11-04T01:38:54.270 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 151/152 2023-11-04T01:38:54.617 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 152/152 2023-11-04T01:38:54.617 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-2:18.0.0-7035.g7532011a.el9.x86_64 1/152 2023-11-04T01:38:54.618 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-base-2:18.0.0-7035.g7532011a.el9.x86_64 2/152 2023-11-04T01:38:54.618 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 3/152 2023-11-04T01:38:54.618 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 4/152 2023-11-04T01:38:54.618 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7035.g75320 5/152 2023-11-04T01:38:54.619 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mds-2:18.0.0-7035.g7532011a.el9.x86_64 6/152 2023-11-04T01:38:54.619 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-2:18.0.0-7035.g7532011a.el9.x86_64 7/152 2023-11-04T01:38:54.619 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mon-2:18.0.0-7035.g7532011a.el9.x86_64 8/152 2023-11-04T01:38:54.619 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-osd-2:18.0.0-7035.g7532011a.el9.x86_64 9/152 2023-11-04T01:38:54.619 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-radosgw-2:18.0.0-7035.g7532011a.el9.x86_64 10/152 2023-11-04T01:38:54.620 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-selinux-2:18.0.0-7035.g7532011a.el9.x86_64 11/152 2023-11-04T01:38:54.620 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-test-2:18.0.0-7035.g7532011a.el9.x86_64 12/152 2023-11-04T01:38:54.620 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : cephfs-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 13/152 2023-11-04T01:38:54.620 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephfs-devel-2:18.0.0-7035.g7532011a.el9.x86_ 14/152 2023-11-04T01:38:54.620 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephfs2-2:18.0.0-7035.g7532011a.el9.x86_64 15/152 2023-11-04T01:38:54.621 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephsqlite-2:18.0.0-7035.g7532011a.el9.x86_64 16/152 2023-11-04T01:38:54.621 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados-devel-2:18.0.0-7035.g7532011a.el9.x86_6 17/152 2023-11-04T01:38:54.621 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libradosstriper1-2:18.0.0-7035.g7532011a.el9.x86 18/152 2023-11-04T01:38:54.621 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librgw2-2:18.0.0-7035.g7532011a.el9.x86_64 19/152 2023-11-04T01:38:54.621 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7035.g7532011a.el 20/152 2023-11-04T01:38:54.621 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-ceph-common-2:18.0.0-7035.g7532011a.el9. 21/152 2023-11-04T01:38:54.622 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cephfs-2:18.0.0-7035.g7532011a.el9.x86_6 22/152 2023-11-04T01:38:54.622 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rados-2:18.0.0-7035.g7532011a.el9.x86_64 23/152 2023-11-04T01:38:54.622 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rbd-2:18.0.0-7035.g7532011a.el9.x86_64 24/152 2023-11-04T01:38:54.622 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rgw-2:18.0.0-7035.g7532011a.el9.x86_64 25/152 2023-11-04T01:38:54.623 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 26/152 2023-11-04T01:38:54.623 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 27/152 2023-11-04T01:38:54.633 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-nbd-2:18.0.0-7035.g7532011a.el9.x86_64 28/152 2023-11-04T01:38:54.634 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7035.g7532011a. 29/152 2023-11-04T01:38:54.634 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el9.noa 30/152 2023-11-04T01:38:54.634 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el9.n 31/152 2023-11-04T01:38:54.634 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7035.g753 32/152 2023-11-04T01:38:54.635 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7035.g7532011a.el 33/152 2023-11-04T01:38:54.635 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7035.g7532011a.el9.noarch 34/152 2023-11-04T01:38:54.635 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7035.g7532011a.e 35/152 2023-11-04T01:38:54.635 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-volume-2:18.0.0-7035.g7532011a.el9.noarch 36/152 2023-11-04T01:38:54.635 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : cephadm-2:18.0.0-7035.g7532011a.el9.noarch 37/152 2023-11-04T01:38:54.636 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : cephfs-top-2:18.0.0-7035.g7532011a.el9.noarch 38/152 2023-11-04T01:38:54.636 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : bison-3.7.4-5.el9.x86_64 39/152 2023-11-04T01:38:54.636 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 40/152 2023-11-04T01:38:54.636 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flex-2.6.4-9.el9.x86_64 41/152 2023-11-04T01:38:54.636 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 42/152 2023-11-04T01:38:54.636 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 43/152 2023-11-04T01:38:54.637 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 44/152 2023-11-04T01:38:54.637 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 45/152 2023-11-04T01:38:54.637 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 46/152 2023-11-04T01:38:54.637 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 47/152 2023-11-04T01:38:54.638 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 48/152 2023-11-04T01:38:54.638 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 49/152 2023-11-04T01:38:54.638 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 50/152 2023-11-04T01:38:54.639 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 51/152 2023-11-04T01:38:54.639 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 52/152 2023-11-04T01:38:54.639 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 53/152 2023-11-04T01:38:54.639 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : postgresql-13.11-1.el9.x86_64 54/152 2023-11-04T01:38:54.640 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 55/152 2023-11-04T01:38:54.640 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 56/152 2023-11-04T01:38:54.640 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 57/152 2023-11-04T01:38:54.640 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 58/152 2023-11-04T01:38:54.640 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 59/152 2023-11-04T01:38:54.641 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 60/152 2023-11-04T01:38:54.641 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/152 2023-11-04T01:38:54.641 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/152 2023-11-04T01:38:54.641 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/152 2023-11-04T01:38:54.641 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/152 2023-11-04T01:38:54.642 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/152 2023-11-04T01:38:54.642 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/152 2023-11-04T01:38:54.642 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/152 2023-11-04T01:38:54.642 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 68/152 2023-11-04T01:38:54.643 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 69/152 2023-11-04T01:38:54.643 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 70/152 2023-11-04T01:38:54.643 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 71/152 2023-11-04T01:38:54.643 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 72/152 2023-11-04T01:38:54.643 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 73/152 2023-11-04T01:38:54.643 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 74/152 2023-11-04T01:38:54.644 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 75/152 2023-11-04T01:38:54.644 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 76/152 2023-11-04T01:38:54.644 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 77/152 2023-11-04T01:38:54.644 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 78/152 2023-11-04T01:38:54.645 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 79/152 2023-11-04T01:38:54.645 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 80/152 2023-11-04T01:38:54.645 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-ply-3.11-14.el9.noarch 81/152 2023-11-04T01:38:54.645 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 82/152 2023-11-04T01:38:54.645 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 83/152 2023-11-04T01:38:54.646 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 84/152 2023-11-04T01:38:54.646 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 85/152 2023-11-04T01:38:54.646 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : automake-1.16.2-8.el9.noarch 86/152 2023-11-04T01:38:54.646 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : elfutils-libelf-devel-0.189-3.el9.x86_64 87/152 2023-11-04T01:38:54.647 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : jq-1.6-15.el9.x86_64 88/152 2023-11-04T01:38:54.647 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 89/152 2023-11-04T01:38:54.647 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 90/152 2023-11-04T01:38:54.647 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 91/152 2023-11-04T01:38:54.648 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/152 2023-11-04T01:38:54.648 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 93/152 2023-11-04T01:38:54.648 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 94/152 2023-11-04T01:38:54.648 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 95/152 2023-11-04T01:38:54.648 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 96/152 2023-11-04T01:38:54.649 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 97/152 2023-11-04T01:38:54.649 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/152 2023-11-04T01:38:54.649 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/152 2023-11-04T01:38:54.649 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 100/152 2023-11-04T01:38:54.650 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 101/152 2023-11-04T01:38:54.650 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/152 2023-11-04T01:38:54.650 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/152 2023-11-04T01:38:54.650 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 104/152 2023-11-04T01:38:54.650 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/152 2023-11-04T01:38:54.651 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/152 2023-11-04T01:38:54.651 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-google-auth-1:2.23.3-1.el9.noarch 107/152 2023-11-04T01:38:54.651 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/152 2023-11-04T01:38:54.651 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/152 2023-11-04T01:38:54.651 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/152 2023-11-04T01:38:54.652 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/152 2023-11-04T01:38:54.652 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/152 2023-11-04T01:38:54.652 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 113/152 2023-11-04T01:38:54.652 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 114/152 2023-11-04T01:38:54.653 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/152 2023-11-04T01:38:54.653 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/152 2023-11-04T01:38:54.653 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/152 2023-11-04T01:38:54.653 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/152 2023-11-04T01:38:54.653 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/152 2023-11-04T01:38:54.654 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/152 2023-11-04T01:38:54.654 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/152 2023-11-04T01:38:54.654 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/152 2023-11-04T01:38:54.654 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/152 2023-11-04T01:38:54.655 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/152 2023-11-04T01:38:54.655 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/152 2023-11-04T01:38:54.655 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/152 2023-11-04T01:38:54.655 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/152 2023-11-04T01:38:54.655 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/152 2023-11-04T01:38:54.656 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/152 2023-11-04T01:38:54.656 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/152 2023-11-04T01:38:54.656 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/152 2023-11-04T01:38:54.656 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/152 2023-11-04T01:38:54.657 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados2-2:18.0.0-7035.g7532011a.el9.x86_64 133/152 2023-11-04T01:38:54.657 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/152 2023-11-04T01:38:54.657 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librbd1-2:18.0.0-7035.g7532011a.el9.x86_64 135/152 2023-11-04T01:38:54.657 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/152 2023-11-04T01:38:54.657 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 137/152 2023-11-04T01:38:54.658 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 138/152 2023-11-04T01:38:54.658 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-1:1.45.5-1.el9.x86_64 139/152 2023-11-04T01:38:54.658 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 140/152 2023-11-04T01:38:54.658 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-libnm-1:1.45.5-1.el9.x86_64 141/152 2023-11-04T01:38:54.658 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 142/152 2023-11-04T01:38:54.659 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-team-1:1.45.5-1.el9.x86_64 143/152 2023-11-04T01:38:54.659 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 144/152 2023-11-04T01:38:54.659 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-tui-1:1.45.5-1.el9.x86_64 145/152 2023-11-04T01:38:54.659 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/152 2023-11-04T01:38:54.659 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : acl-2.3.1-4.el9.x86_64 147/152 2023-11-04T01:38:54.660 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : acl-2.3.1-3.el9.x86_64 148/152 2023-11-04T01:38:54.660 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 149/152 2023-11-04T01:38:54.660 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 150/152 2023-11-04T01:38:54.660 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 151/152 2023-11-04T01:38:56.879 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 152/152 2023-11-04T01:38:56.879 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:38:56.880 INFO:teuthology.orchestra.run.smithi077.stdout:Upgraded: 2023-11-04T01:38:56.880 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-1:1.45.5-1.el9.x86_64 2023-11-04T01:38:56.880 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-libnm-1:1.45.5-1.el9.x86_64 2023-11-04T01:38:56.880 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-team-1:1.45.5-1.el9.x86_64 2023-11-04T01:38:56.880 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-tui-1:1.45.5-1.el9.x86_64 2023-11-04T01:38:56.881 INFO:teuthology.orchestra.run.smithi077.stdout: acl-2.3.1-4.el9.x86_64 2023-11-04T01:38:56.881 INFO:teuthology.orchestra.run.smithi077.stdout: libacl-2.3.1-4.el9.x86_64 2023-11-04T01:38:56.881 INFO:teuthology.orchestra.run.smithi077.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-11-04T01:38:56.881 INFO:teuthology.orchestra.run.smithi077.stdout: librados2-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:56.881 INFO:teuthology.orchestra.run.smithi077.stdout: librbd1-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:56.882 INFO:teuthology.orchestra.run.smithi077.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-11-04T01:38:56.882 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2023-11-04T01:38:56.882 INFO:teuthology.orchestra.run.smithi077.stdout: automake-1.16.2-8.el9.noarch 2023-11-04T01:38:56.882 INFO:teuthology.orchestra.run.smithi077.stdout: bison-3.7.4-5.el9.x86_64 2023-11-04T01:38:56.882 INFO:teuthology.orchestra.run.smithi077.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-04T01:38:56.883 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:56.883 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-base-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:56.883 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:56.883 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:56.883 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-grafana-dashboards-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:38:56.884 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-immutable-object-cache-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:56.884 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mds-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:56.884 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:56.884 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:38:56.884 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:38:56.885 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:38:56.885 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-modules-core-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:38:56.885 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-rook-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:38:56.885 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mon-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:56.886 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-osd-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:56.886 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-prometheus-alerts-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:38:56.886 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-radosgw-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:56.886 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-selinux-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:56.887 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-test-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:56.887 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-volume-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:38:56.887 INFO:teuthology.orchestra.run.smithi077.stdout: cephadm-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:38:56.887 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:56.887 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-top-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:38:56.888 INFO:teuthology.orchestra.run.smithi077.stdout: elfutils-libelf-devel-0.189-3.el9.x86_64 2023-11-04T01:38:56.888 INFO:teuthology.orchestra.run.smithi077.stdout: flex-2.6.4-9.el9.x86_64 2023-11-04T01:38:56.888 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-04T01:38:56.888 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-04T01:38:56.889 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-04T01:38:56.889 INFO:teuthology.orchestra.run.smithi077.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-04T01:38:56.889 INFO:teuthology.orchestra.run.smithi077.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-04T01:38:56.889 INFO:teuthology.orchestra.run.smithi077.stdout: jq-1.6-15.el9.x86_64 2023-11-04T01:38:56.889 INFO:teuthology.orchestra.run.smithi077.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-11-04T01:38:56.889 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-04T01:38:56.890 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-04T01:38:56.890 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs-devel-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:56.890 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs2-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:56.890 INFO:teuthology.orchestra.run.smithi077.stdout: libcephsqlite-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:56.890 INFO:teuthology.orchestra.run.smithi077.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-04T01:38:56.891 INFO:teuthology.orchestra.run.smithi077.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-04T01:38:56.891 INFO:teuthology.orchestra.run.smithi077.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-04T01:38:56.891 INFO:teuthology.orchestra.run.smithi077.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-04T01:38:56.891 INFO:teuthology.orchestra.run.smithi077.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-04T01:38:56.891 INFO:teuthology.orchestra.run.smithi077.stdout: librados-devel-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:56.892 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:56.892 INFO:teuthology.orchestra.run.smithi077.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-04T01:38:56.892 INFO:teuthology.orchestra.run.smithi077.stdout: librgw2-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:56.892 INFO:teuthology.orchestra.run.smithi077.stdout: libtool-2.4.6-45.el9.x86_64 2023-11-04T01:38:56.892 INFO:teuthology.orchestra.run.smithi077.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-04T01:38:56.893 INFO:teuthology.orchestra.run.smithi077.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-11-04T01:38:56.893 INFO:teuthology.orchestra.run.smithi077.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-11-04T01:38:56.893 INFO:teuthology.orchestra.run.smithi077.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-04T01:38:56.893 INFO:teuthology.orchestra.run.smithi077.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-04T01:38:56.893 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-04T01:38:56.894 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-04T01:38:56.894 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-11-04T01:38:56.894 INFO:teuthology.orchestra.run.smithi077.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-04T01:38:56.894 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-13.11-1.el9.x86_64 2023-11-04T01:38:56.895 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-11-04T01:38:56.895 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-11-04T01:38:56.895 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-server-13.11-1.el9.x86_64 2023-11-04T01:38:56.895 INFO:teuthology.orchestra.run.smithi077.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-04T01:38:56.895 INFO:teuthology.orchestra.run.smithi077.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-04T01:38:56.896 INFO:teuthology.orchestra.run.smithi077.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-04T01:38:56.896 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-04T01:38:56.896 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-argparse-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:56.896 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:56.896 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cephfs-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:56.897 INFO:teuthology.orchestra.run.smithi077.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-04T01:38:56.897 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-04T01:38:56.897 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-04T01:38:56.897 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-04T01:38:56.897 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-04T01:38:56.898 INFO:teuthology.orchestra.run.smithi077.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-04T01:38:56.898 INFO:teuthology.orchestra.run.smithi077.stdout: python3-google-auth-1:2.23.3-1.el9.noarch 2023-11-04T01:38:56.898 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-04T01:38:56.898 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-04T01:38:56.898 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-04T01:38:56.899 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-04T01:38:56.899 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-04T01:38:56.899 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-04T01:38:56.899 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-04T01:38:56.899 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-04T01:38:56.900 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-04T01:38:56.900 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-04T01:38:56.900 INFO:teuthology.orchestra.run.smithi077.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-04T01:38:56.900 INFO:teuthology.orchestra.run.smithi077.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-04T01:38:56.900 INFO:teuthology.orchestra.run.smithi077.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-04T01:38:56.900 INFO:teuthology.orchestra.run.smithi077.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-04T01:38:56.901 INFO:teuthology.orchestra.run.smithi077.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-04T01:38:56.901 INFO:teuthology.orchestra.run.smithi077.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-04T01:38:56.901 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-04T01:38:56.901 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-04T01:38:56.901 INFO:teuthology.orchestra.run.smithi077.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-04T01:38:56.902 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-04T01:38:56.902 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ply-3.11-14.el9.noarch 2023-11-04T01:38:56.902 INFO:teuthology.orchestra.run.smithi077.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-04T01:38:56.902 INFO:teuthology.orchestra.run.smithi077.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-04T01:38:56.902 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-04T01:38:56.903 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-04T01:38:56.903 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-04T01:38:56.903 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-04T01:38:56.903 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-04T01:38:56.903 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rados-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:56.904 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rbd-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:56.904 INFO:teuthology.orchestra.run.smithi077.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-04T01:38:56.904 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-04T01:38:56.904 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-04T01:38:56.904 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rgw-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:56.905 INFO:teuthology.orchestra.run.smithi077.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-04T01:38:56.905 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-04T01:38:56.905 INFO:teuthology.orchestra.run.smithi077.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-04T01:38:56.905 INFO:teuthology.orchestra.run.smithi077.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-04T01:38:56.905 INFO:teuthology.orchestra.run.smithi077.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-04T01:38:56.906 INFO:teuthology.orchestra.run.smithi077.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-04T01:38:56.906 INFO:teuthology.orchestra.run.smithi077.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-04T01:38:56.906 INFO:teuthology.orchestra.run.smithi077.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-04T01:38:56.906 INFO:teuthology.orchestra.run.smithi077.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-04T01:38:56.906 INFO:teuthology.orchestra.run.smithi077.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-04T01:38:56.907 INFO:teuthology.orchestra.run.smithi077.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-04T01:38:56.908 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:56.908 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:56.908 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-nbd-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:56.908 INFO:teuthology.orchestra.run.smithi077.stdout: re2-1:20211101-3.el9.x86_64 2023-11-04T01:38:56.909 INFO:teuthology.orchestra.run.smithi077.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-04T01:38:56.910 INFO:teuthology.orchestra.run.smithi077.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-04T01:38:56.910 INFO:teuthology.orchestra.run.smithi077.stdout: uuid-1.6.2-55.el9.x86_64 2023-11-04T01:38:56.910 INFO:teuthology.orchestra.run.smithi077.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-11-04T01:38:56.910 INFO:teuthology.orchestra.run.smithi077.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-04T01:38:56.911 INFO:teuthology.orchestra.run.smithi077.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-04T01:38:56.912 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:38:56.912 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2023-11-04T01:38:57.282 DEBUG:teuthology.parallel:result is None 2023-11-04T01:38:57.316 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 152/152 2023-11-04T01:38:57.316 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:38:57.317 INFO:teuthology.orchestra.run.smithi122.stdout:Upgraded: 2023-11-04T01:38:57.317 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-1:1.45.5-1.el9.x86_64 2023-11-04T01:38:57.317 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-libnm-1:1.45.5-1.el9.x86_64 2023-11-04T01:38:57.317 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-team-1:1.45.5-1.el9.x86_64 2023-11-04T01:38:57.317 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-tui-1:1.45.5-1.el9.x86_64 2023-11-04T01:38:57.318 INFO:teuthology.orchestra.run.smithi122.stdout: acl-2.3.1-4.el9.x86_64 2023-11-04T01:38:57.318 INFO:teuthology.orchestra.run.smithi122.stdout: libacl-2.3.1-4.el9.x86_64 2023-11-04T01:38:57.318 INFO:teuthology.orchestra.run.smithi122.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-11-04T01:38:57.318 INFO:teuthology.orchestra.run.smithi122.stdout: librados2-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:57.318 INFO:teuthology.orchestra.run.smithi122.stdout: librbd1-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:57.319 INFO:teuthology.orchestra.run.smithi122.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-11-04T01:38:57.319 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2023-11-04T01:38:57.319 INFO:teuthology.orchestra.run.smithi122.stdout: automake-1.16.2-8.el9.noarch 2023-11-04T01:38:57.319 INFO:teuthology.orchestra.run.smithi122.stdout: bison-3.7.4-5.el9.x86_64 2023-11-04T01:38:57.319 INFO:teuthology.orchestra.run.smithi122.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-04T01:38:57.320 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:57.320 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-base-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:57.320 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:57.320 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:57.320 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-grafana-dashboards-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:38:57.321 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-immutable-object-cache-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:57.321 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mds-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:57.321 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:57.321 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-cephadm-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:38:57.321 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-dashboard-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:38:57.322 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:38:57.322 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-modules-core-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:38:57.322 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-rook-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:38:57.322 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mon-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:57.322 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-osd-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:57.323 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-prometheus-alerts-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:38:57.323 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-radosgw-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:57.323 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-selinux-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:57.323 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-test-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:57.323 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-volume-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:38:57.324 INFO:teuthology.orchestra.run.smithi122.stdout: cephadm-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:38:57.324 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:57.324 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-top-2:18.0.0-7035.g7532011a.el9.noarch 2023-11-04T01:38:57.324 INFO:teuthology.orchestra.run.smithi122.stdout: elfutils-libelf-devel-0.189-3.el9.x86_64 2023-11-04T01:38:57.324 INFO:teuthology.orchestra.run.smithi122.stdout: flex-2.6.4-9.el9.x86_64 2023-11-04T01:38:57.325 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-04T01:38:57.325 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-04T01:38:57.325 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-04T01:38:57.325 INFO:teuthology.orchestra.run.smithi122.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-04T01:38:57.325 INFO:teuthology.orchestra.run.smithi122.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-04T01:38:57.326 INFO:teuthology.orchestra.run.smithi122.stdout: jq-1.6-15.el9.x86_64 2023-11-04T01:38:57.326 INFO:teuthology.orchestra.run.smithi122.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-11-04T01:38:57.326 INFO:teuthology.orchestra.run.smithi122.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-04T01:38:57.326 INFO:teuthology.orchestra.run.smithi122.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-04T01:38:57.326 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs-devel-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:57.327 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs2-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:57.327 INFO:teuthology.orchestra.run.smithi122.stdout: libcephsqlite-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:57.327 INFO:teuthology.orchestra.run.smithi122.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-04T01:38:57.327 INFO:teuthology.orchestra.run.smithi122.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-04T01:38:57.327 INFO:teuthology.orchestra.run.smithi122.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-04T01:38:57.328 INFO:teuthology.orchestra.run.smithi122.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-04T01:38:57.328 INFO:teuthology.orchestra.run.smithi122.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-04T01:38:57.328 INFO:teuthology.orchestra.run.smithi122.stdout: librados-devel-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:57.328 INFO:teuthology.orchestra.run.smithi122.stdout: libradosstriper1-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:57.328 INFO:teuthology.orchestra.run.smithi122.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-04T01:38:57.329 INFO:teuthology.orchestra.run.smithi122.stdout: librgw2-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:57.329 INFO:teuthology.orchestra.run.smithi122.stdout: libtool-2.4.6-45.el9.x86_64 2023-11-04T01:38:57.329 INFO:teuthology.orchestra.run.smithi122.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-04T01:38:57.329 INFO:teuthology.orchestra.run.smithi122.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-11-04T01:38:57.329 INFO:teuthology.orchestra.run.smithi122.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-11-04T01:38:57.330 INFO:teuthology.orchestra.run.smithi122.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-04T01:38:57.330 INFO:teuthology.orchestra.run.smithi122.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-04T01:38:57.330 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-04T01:38:57.330 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-04T01:38:57.330 INFO:teuthology.orchestra.run.smithi122.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-11-04T01:38:57.331 INFO:teuthology.orchestra.run.smithi122.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-04T01:38:57.331 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-13.11-1.el9.x86_64 2023-11-04T01:38:57.331 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-11-04T01:38:57.331 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-11-04T01:38:57.331 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-server-13.11-1.el9.x86_64 2023-11-04T01:38:57.332 INFO:teuthology.orchestra.run.smithi122.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-04T01:38:57.332 INFO:teuthology.orchestra.run.smithi122.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-04T01:38:57.332 INFO:teuthology.orchestra.run.smithi122.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-04T01:38:57.332 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-04T01:38:57.332 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-argparse-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:57.333 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-common-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:57.333 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cephfs-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:57.333 INFO:teuthology.orchestra.run.smithi122.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-04T01:38:57.333 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-04T01:38:57.333 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-04T01:38:57.334 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-04T01:38:57.334 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-04T01:38:57.334 INFO:teuthology.orchestra.run.smithi122.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-04T01:38:57.334 INFO:teuthology.orchestra.run.smithi122.stdout: python3-google-auth-1:2.23.3-1.el9.noarch 2023-11-04T01:38:57.334 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-04T01:38:57.335 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-04T01:38:57.335 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-04T01:38:57.335 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-04T01:38:57.335 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-04T01:38:57.335 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-04T01:38:57.336 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-04T01:38:57.336 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-04T01:38:57.336 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-04T01:38:57.336 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-04T01:38:57.336 INFO:teuthology.orchestra.run.smithi122.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-04T01:38:57.337 INFO:teuthology.orchestra.run.smithi122.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-04T01:38:57.337 INFO:teuthology.orchestra.run.smithi122.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-04T01:38:57.337 INFO:teuthology.orchestra.run.smithi122.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-04T01:38:57.337 INFO:teuthology.orchestra.run.smithi122.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-04T01:38:57.337 INFO:teuthology.orchestra.run.smithi122.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-04T01:38:57.338 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-04T01:38:57.338 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-04T01:38:57.338 INFO:teuthology.orchestra.run.smithi122.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-04T01:38:57.338 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-04T01:38:57.339 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ply-3.11-14.el9.noarch 2023-11-04T01:38:57.339 INFO:teuthology.orchestra.run.smithi122.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-04T01:38:57.339 INFO:teuthology.orchestra.run.smithi122.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-04T01:38:57.339 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-04T01:38:57.339 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-04T01:38:57.340 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-04T01:38:57.340 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-04T01:38:57.340 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-04T01:38:57.340 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rados-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:57.340 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rbd-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:57.341 INFO:teuthology.orchestra.run.smithi122.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-04T01:38:57.341 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-04T01:38:57.341 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-04T01:38:57.341 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rgw-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:57.342 INFO:teuthology.orchestra.run.smithi122.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-04T01:38:57.342 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-04T01:38:57.342 INFO:teuthology.orchestra.run.smithi122.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-04T01:38:57.342 INFO:teuthology.orchestra.run.smithi122.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-04T01:38:57.342 INFO:teuthology.orchestra.run.smithi122.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-04T01:38:57.343 INFO:teuthology.orchestra.run.smithi122.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-04T01:38:57.343 INFO:teuthology.orchestra.run.smithi122.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-04T01:38:57.343 INFO:teuthology.orchestra.run.smithi122.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-04T01:38:57.343 INFO:teuthology.orchestra.run.smithi122.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-04T01:38:57.343 INFO:teuthology.orchestra.run.smithi122.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-04T01:38:57.344 INFO:teuthology.orchestra.run.smithi122.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-04T01:38:57.344 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-fuse-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:57.344 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-mirror-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:57.344 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-nbd-2:18.0.0-7035.g7532011a.el9.x86_64 2023-11-04T01:38:57.344 INFO:teuthology.orchestra.run.smithi122.stdout: re2-1:20211101-3.el9.x86_64 2023-11-04T01:38:57.345 INFO:teuthology.orchestra.run.smithi122.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-04T01:38:57.345 INFO:teuthology.orchestra.run.smithi122.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-04T01:38:57.345 INFO:teuthology.orchestra.run.smithi122.stdout: uuid-1.6.2-55.el9.x86_64 2023-11-04T01:38:57.345 INFO:teuthology.orchestra.run.smithi122.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-11-04T01:38:57.346 INFO:teuthology.orchestra.run.smithi122.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-04T01:38:57.346 INFO:teuthology.orchestra.run.smithi122.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-04T01:38:57.346 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:38:57.347 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2023-11-04T01:38:57.764 DEBUG:teuthology.parallel:result is None 2023-11-04T01:38:57.765 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 2023-11-04T01:38:57.903 DEBUG:teuthology.orchestra.run.smithi077:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-04T01:38:57.924 INFO:teuthology.orchestra.run.smithi077.stdout:18.0.0-7035.g7532011a.el9 2023-11-04T01:38:57.925 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7035.g7532011a.el9 2023-11-04T01:38:57.925 INFO:teuthology.task.install:The correct ceph version 18.0.0-7035.g7532011a is installed. 2023-11-04T01:38:57.926 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 2023-11-04T01:38:58.143 DEBUG:teuthology.orchestra.run.smithi122:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-04T01:38:58.166 INFO:teuthology.orchestra.run.smithi122.stdout:18.0.0-7035.g7532011a.el9 2023-11-04T01:38:58.167 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7035.g7532011a.el9 2023-11-04T01:38:58.167 INFO:teuthology.task.install:The correct ceph version 18.0.0-7035.g7532011a is installed. 2023-11-04T01:38:58.167 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-04T01:38:58.168 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:38:58.168 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-04T01:38:58.197 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:38:58.198 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-04T01:38:58.236 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-04T01:38:58.237 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:38:58.237 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/daemon-helper 2023-11-04T01:38:58.265 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-04T01:38:58.332 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:38:58.332 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/daemon-helper 2023-11-04T01:38:58.359 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-04T01:38:58.426 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-04T01:38:58.426 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:38:58.427 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-04T01:38:58.453 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-04T01:38:58.520 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:38:58.521 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-04T01:38:58.547 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-04T01:38:58.614 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-04T01:38:58.614 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:38:58.615 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/stdin-killer 2023-11-04T01:38:58.642 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-04T01:38:58.709 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:38:58.709 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/stdin-killer 2023-11-04T01:38:58.735 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-04T01:38:58.802 INFO:teuthology.run_tasks:Running task ceph... 2023-11-04T01:38:58.870 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-04T01:38:58.871 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 777 /var/log/ceph 2023-11-04T01:38:58.873 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 777 /var/log/ceph 2023-11-04T01:38:58.900 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-04T01:38:58.901 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-04T01:38:58.941 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-04T01:38:58.967 INFO:tasks.ceph:Creating extra log directories... 2023-11-04T01:38:58.968 DEBUG:teuthology.orchestra.run.smithi077:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-04T01:38:59.008 DEBUG:teuthology.orchestra.run.smithi122:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-04T01:38:59.040 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-04T01:38:59.041 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-04T01:38:59.041 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-04T01:38:59.042 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:38:59.042 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-04T01:38:59.087 DEBUG:teuthology.orchestra.run.smithi077:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-04T01:38:59.201 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-04T01:38:59.228 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:38:59.229 DEBUG:teuthology.orchestra.run.smithi122:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-04T01:38:59.243 DEBUG:teuthology.orchestra.run.smithi122:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-04T01:38:59.363 DEBUG:teuthology.orchestra.run.smithi122:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-04T01:38:59.395 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-04T01:38:59.396 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'RECENT_CRASH'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-04T01:38:59.396 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445917', 'branch': 'main', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7445917', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'RECENT_CRASH'], 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'dry_run': True}, 'install': {'ceph': {'flavor': 'default', 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-batrick-testing-20231103.180916', 'sha1': '702f9e6492477037e018f68dfdf636a30c24f329'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 50, 'repo': 'https://github.com/ceph/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7192, 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4', 'sleep_before_teardown': 0, 'suite': 'fs:functional', 'suite_branch': 'wip-batrick-testing-20231103.180916', 'suite_path': '/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/batrick/ceph.git', 'suite_sha1': '702f9e6492477037e018f68dfdf636a30c24f329', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi077.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC98IxozWDvPWbpBYgi+MMJpRUYiX+TS5qo5Pw+bfEfcVidm/tPYmNTHzJEhNIYYLj++5c1qhc780ISibsXj09I=', 'smithi122.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPanZufxhlJo6tdzQLKbEysIIY5d1iHXfpINj3rEYe3uU12EsjWl4G+TqFTz+sNIrfSqYYrpwthLc8urbPu38fE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'RECENT_CRASH'], 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'exec': {'mon.a': ['ceph config set mgr mgr/crash/warn_recent_interval 0']}}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_snapshots']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '6899cd26fceddb2fec83dc1a1349394b28c8998e', 'timestamp': '2023-11-03_18:12:33', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3084822'} 2023-11-04T01:38:59.398 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-04T01:38:59.401 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-04T01:38:59.444 DEBUG:teuthology.orchestra.run.smithi077:> sudo install -d -m0777 -- /var/run/ceph 2023-11-04T01:38:59.455 DEBUG:teuthology.orchestra.run.smithi122:> sudo install -d -m0777 -- /var/run/ceph 2023-11-04T01:38:59.510 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:38:59.511 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/scratch_devs of=/dev/stdout 2023-11-04T01:38:59.534 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-04T01:38:59.535 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_1 2023-11-04T01:38:59.589 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-04T01:38:59.589 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:38:59.589 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 663 Links: 1 2023-11-04T01:38:59.589 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:38:59.590 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T01:38:59.590 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2023-11-04 01:38:50.098667451 +0000 2023-11-04T01:38:59.590 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2023-11-04 01:36:25.352417834 +0000 2023-11-04T01:38:59.590 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2023-11-04 01:36:25.352417834 +0000 2023-11-04T01:38:59.591 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2023-11-04 01:36:25.352417834 +0000 2023-11-04T01:38:59.591 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-04T01:38:59.653 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-04T01:38:59.654 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-04T01:38:59.654 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000204775 s, 2.5 MB/s 2023-11-04T01:38:59.655 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-04T01:38:59.711 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_2 2023-11-04T01:38:59.765 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-04T01:38:59.766 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:38:59.766 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 681 Links: 1 2023-11-04T01:38:59.766 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:38:59.766 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T01:38:59.767 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2023-11-04 01:38:50.099667429 +0000 2023-11-04T01:38:59.767 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2023-11-04 01:36:25.940404807 +0000 2023-11-04T01:38:59.767 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2023-11-04 01:36:25.940404807 +0000 2023-11-04T01:38:59.767 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2023-11-04 01:36:25.940404807 +0000 2023-11-04T01:38:59.768 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-04T01:38:59.830 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-04T01:38:59.830 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-04T01:38:59.830 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000193735 s, 2.6 MB/s 2023-11-04T01:38:59.831 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-04T01:38:59.887 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_3 2023-11-04T01:38:59.941 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-04T01:38:59.941 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:38:59.941 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 701 Links: 1 2023-11-04T01:38:59.942 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:38:59.942 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T01:38:59.942 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2023-11-04 01:38:50.099667429 +0000 2023-11-04T01:38:59.942 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2023-11-04 01:36:26.507392247 +0000 2023-11-04T01:38:59.942 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2023-11-04 01:36:26.507392247 +0000 2023-11-04T01:38:59.943 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2023-11-04 01:36:26.507392247 +0000 2023-11-04T01:38:59.943 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-04T01:39:00.006 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-04T01:39:00.007 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-04T01:39:00.007 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.0001828 s, 2.8 MB/s 2023-11-04T01:39:00.008 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-04T01:39:00.063 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_4 2023-11-04T01:39:00.118 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-04T01:39:00.118 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:39:00.118 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 719 Links: 1 2023-11-04T01:39:00.119 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:39:00.119 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T01:39:00.119 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2023-11-04 01:38:50.100667407 +0000 2023-11-04T01:39:00.119 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2023-11-04 01:36:27.116378755 +0000 2023-11-04T01:39:00.119 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2023-11-04 01:36:27.116378755 +0000 2023-11-04T01:39:00.120 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2023-11-04 01:36:27.116378755 +0000 2023-11-04T01:39:00.120 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-04T01:39:00.183 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-11-04T01:39:00.184 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-11-04T01:39:00.184 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000182516 s, 2.8 MB/s 2023-11-04T01:39:00.185 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-04T01:39:00.240 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-04T01:39:00.241 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:39:00.241 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/scratch_devs of=/dev/stdout 2023-11-04T01:39:00.257 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-04T01:39:00.258 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_1 2023-11-04T01:39:00.313 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-04T01:39:00.313 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:39:00.313 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 663 Links: 1 2023-11-04T01:39:00.314 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:39:00.314 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T01:39:00.314 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2023-11-04 01:38:50.374800561 +0000 2023-11-04T01:39:00.314 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2023-11-04 01:36:25.364804309 +0000 2023-11-04T01:39:00.314 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2023-11-04 01:36:25.364804309 +0000 2023-11-04T01:39:00.315 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2023-11-04 01:36:25.364804309 +0000 2023-11-04T01:39:00.315 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-04T01:39:00.379 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2023-11-04T01:39:00.380 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2023-11-04T01:39:00.380 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000191435 s, 2.7 MB/s 2023-11-04T01:39:00.381 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-04T01:39:00.438 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_2 2023-11-04T01:39:00.493 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-04T01:39:00.493 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:39:00.493 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 681 Links: 1 2023-11-04T01:39:00.493 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:39:00.494 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T01:39:00.494 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2023-11-04 01:38:50.374800561 +0000 2023-11-04T01:39:00.494 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2023-11-04 01:36:25.957789791 +0000 2023-11-04T01:39:00.494 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2023-11-04 01:36:25.957789791 +0000 2023-11-04T01:39:00.495 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2023-11-04 01:36:25.957789791 +0000 2023-11-04T01:39:00.495 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-04T01:39:00.558 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2023-11-04T01:39:00.559 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2023-11-04T01:39:00.559 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.00018368 s, 2.8 MB/s 2023-11-04T01:39:00.560 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-04T01:39:00.616 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_3 2023-11-04T01:39:00.670 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-04T01:39:00.670 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:39:00.670 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 703 Links: 1 2023-11-04T01:39:00.671 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:39:00.671 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T01:39:00.671 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2023-11-04 01:38:50.374800561 +0000 2023-11-04T01:39:00.671 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2023-11-04 01:36:26.517776081 +0000 2023-11-04T01:39:00.671 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2023-11-04 01:36:26.517776081 +0000 2023-11-04T01:39:00.672 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2023-11-04 01:36:26.517776081 +0000 2023-11-04T01:39:00.672 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-04T01:39:00.734 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2023-11-04T01:39:00.735 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2023-11-04T01:39:00.735 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.00016272 s, 3.1 MB/s 2023-11-04T01:39:00.736 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-04T01:39:00.792 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_4 2023-11-04T01:39:00.846 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-04T01:39:00.846 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:39:00.847 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 722 Links: 1 2023-11-04T01:39:00.847 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:39:00.847 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T01:39:00.847 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2023-11-04 01:38:50.375800537 +0000 2023-11-04T01:39:00.848 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2023-11-04 01:36:27.116761417 +0000 2023-11-04T01:39:00.848 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2023-11-04 01:36:27.116761417 +0000 2023-11-04T01:39:00.848 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2023-11-04 01:36:27.116761417 +0000 2023-11-04T01:39:00.848 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-04T01:39:00.912 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2023-11-04T01:39:00.912 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2023-11-04T01:39:00.913 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000189932 s, 2.7 MB/s 2023-11-04T01:39:00.914 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-04T01:39:00.968 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-04T01:39:00.969 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi077.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi122.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-04T01:39:00.969 INFO:tasks.ceph:Generating config... 2023-11-04T01:39:00.971 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-04T01:39:00.971 INFO:tasks.ceph:[client] debug client = 20 2023-11-04T01:39:00.971 INFO:tasks.ceph:[client] debug ms = 1 2023-11-04T01:39:00.971 INFO:tasks.ceph:[client] pid file = 2023-11-04T01:39:00.972 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-04T01:39:00.972 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-04T01:39:00.972 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-04T01:39:00.973 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-04T01:39:00.973 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-04T01:39:00.973 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-04T01:39:00.973 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-04T01:39:00.974 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-04T01:39:00.974 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-04T01:39:00.974 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-04T01:39:00.974 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-04T01:39:00.975 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-04T01:39:00.975 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-04T01:39:00.975 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-04T01:39:00.975 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-04T01:39:00.976 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-04T01:39:00.976 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-04T01:39:00.976 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-04T01:39:00.976 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-04T01:39:00.977 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-04T01:39:00.977 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-11-04T01:39:00.977 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-11-04T01:39:00.977 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-04T01:39:00.978 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-04T01:39:00.978 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-11-04T01:39:00.978 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-04T01:39:00.978 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-04T01:39:00.979 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-04T01:39:00.979 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-04T01:39:00.979 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-04T01:39:00.979 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-04T01:39:00.980 INFO:tasks.ceph:Setting up mon.a... 2023-11-04T01:39:00.980 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-04T01:39:01.029 INFO:teuthology.orchestra.run.smithi077.stdout:creating /etc/ceph/ceph.keyring 2023-11-04T01:39:01.032 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-04T01:39:01.079 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-04T01:39:01.106 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.77'), ('mon.b', '172.21.15.122'), ('mon.c', '[v2:172.21.15.122:3301,v1:172.21.15.122:6790]')] 2023-11-04T01:39:01.106 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.77,172.21.15.122,[v2:172.21.15.122:3301,v1:172.21.15.122:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-04T01:39:01.107 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:39:01.108 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-04T01:39:01.161 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.77 --add b 172.21.15.122 --addv c '[v2:172.21.15.122:3301,v1:172.21.15.122:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:39:01.245 INFO:teuthology.orchestra.run.smithi077.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:39:01.245 INFO:teuthology.orchestra.run.smithi077.stdout:monmaptool: generated fsid 0c22c75d-0169-41ef-b663-6ac1c5b0f71f 2023-11-04T01:39:01.246 INFO:teuthology.orchestra.run.smithi077.stdout:setting min_mon_release = pacific 2023-11-04T01:39:01.246 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 0 2023-11-04T01:39:01.246 INFO:teuthology.orchestra.run.smithi077.stdout:fsid 0c22c75d-0169-41ef-b663-6ac1c5b0f71f 2023-11-04T01:39:01.246 INFO:teuthology.orchestra.run.smithi077.stdout:last_changed 2023-11-04T01:39:01.244585+0000 2023-11-04T01:39:01.246 INFO:teuthology.orchestra.run.smithi077.stdout:created 2023-11-04T01:39:01.244585+0000 2023-11-04T01:39:01.247 INFO:teuthology.orchestra.run.smithi077.stdout:min_mon_release 16 (pacific) 2023-11-04T01:39:01.247 INFO:teuthology.orchestra.run.smithi077.stdout:election_strategy: 1 2023-11-04T01:39:01.247 INFO:teuthology.orchestra.run.smithi077.stdout:0: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.a 2023-11-04T01:39:01.247 INFO:teuthology.orchestra.run.smithi077.stdout:1: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.b 2023-11-04T01:39:01.247 INFO:teuthology.orchestra.run.smithi077.stdout:2: [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] mon.c 2023-11-04T01:39:01.248 INFO:teuthology.orchestra.run.smithi077.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-04T01:39:01.249 DEBUG:teuthology.orchestra.run.smithi077:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-04T01:39:01.304 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 0c22c75d-0169-41ef-b663-6ac1c5b0f71f... 2023-11-04T01:39:01.305 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-04T01:39:01.347 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-04T01:39:01.393 INFO:teuthology.orchestra.run.smithi077.stdout:[global] 2023-11-04T01:39:01.394 INFO:teuthology.orchestra.run.smithi077.stdout: chdir = "" 2023-11-04T01:39:01.394 INFO:teuthology.orchestra.run.smithi077.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-04T01:39:01.394 INFO:teuthology.orchestra.run.smithi077.stdout: auth supported = cephx 2023-11-04T01:39:01.394 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:39:01.395 INFO:teuthology.orchestra.run.smithi077.stdout: filestore xattr use omap = true 2023-11-04T01:39:01.395 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:39:01.395 INFO:teuthology.orchestra.run.smithi077.stdout: mon clock drift allowed = 1.000 2023-11-04T01:39:01.395 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:39:01.395 INFO:teuthology.orchestra.run.smithi077.stdout: osd crush chooseleaf type = 0 2023-11-04T01:39:01.395 INFO:teuthology.orchestra.run.smithi077.stdout: auth debug = true 2023-11-04T01:39:01.396 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:39:01.396 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on old message = true 2023-11-04T01:39:01.396 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on bug = true 2023-11-04T01:39:01.396 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:39:01.396 INFO:teuthology.orchestra.run.smithi077.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-04T01:39:01.397 INFO:teuthology.orchestra.run.smithi077.stdout: mon pg warn max object skew = 0 2023-11-04T01:39:01.397 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:39:01.397 INFO:teuthology.orchestra.run.smithi077.stdout: # disable pg_autoscaler by default for new pools 2023-11-04T01:39:01.397 INFO:teuthology.orchestra.run.smithi077.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-04T01:39:01.398 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:39:01.398 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default size = 2 2023-11-04T01:39:01.398 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:39:01.398 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow primary affinity = true 2023-11-04T01:39:01.398 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow pg remap = true 2023-11-04T01:39:01.399 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on legacy crush tunables = false 2023-11-04T01:39:01.399 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on crush straw calc version zero = false 2023-11-04T01:39:01.399 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on no sortbitwise = false 2023-11-04T01:39:01.399 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on osd down out interval zero = false 2023-11-04T01:39:01.399 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on too few osds = false 2023-11-04T01:39:01.400 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-04T01:39:01.400 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-04T01:39:01.400 INFO:teuthology.orchestra.run.smithi077.stdout: mon_allow_pool_size_one = true 2023-11-04T01:39:01.400 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:39:01.400 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-04T01:39:01.400 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:39:01.401 INFO:teuthology.orchestra.run.smithi077.stdout: osd default data pool replay window = 5 2023-11-04T01:39:01.401 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:39:01.401 INFO:teuthology.orchestra.run.smithi077.stdout: mon allow pool delete = true 2023-11-04T01:39:01.401 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:39:01.401 INFO:teuthology.orchestra.run.smithi077.stdout: mon cluster log file level = debug 2023-11-04T01:39:01.402 INFO:teuthology.orchestra.run.smithi077.stdout: debug asserts on shutdown = true 2023-11-04T01:39:01.402 INFO:teuthology.orchestra.run.smithi077.stdout: mon health detail to clog = false 2023-11-04T01:39:01.402 INFO:teuthology.orchestra.run.smithi077.stdout: mon host = "172.21.15.77,172.21.15.122,[v2:172.21.15.122:3301,v1:172.21.15.122:6790]" 2023-11-04T01:39:01.402 INFO:teuthology.orchestra.run.smithi077.stdout: fsid = 0c22c75d-0169-41ef-b663-6ac1c5b0f71f 2023-11-04T01:39:01.402 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:39:01.403 INFO:teuthology.orchestra.run.smithi077.stdout:[osd] 2023-11-04T01:39:01.403 INFO:teuthology.orchestra.run.smithi077.stdout: osd journal size = 100 2023-11-04T01:39:01.403 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:39:01.403 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub load threshold = 5.0 2023-11-04T01:39:01.403 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub max interval = 600 2023-11-04T01:39:01.403 INFO:teuthology.orchestra.run.smithi077.stdout: osd mclock profile = high_recovery_ops 2023-11-04T01:39:01.404 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:39:01.404 INFO:teuthology.orchestra.run.smithi077.stdout: osd recover clone overlap = true 2023-11-04T01:39:01.404 INFO:teuthology.orchestra.run.smithi077.stdout: osd recovery max chunk = 1048576 2023-11-04T01:39:01.404 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:39:01.404 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug shutdown = true 2023-11-04T01:39:01.405 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug op order = true 2023-11-04T01:39:01.405 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug verify stray on activate = true 2023-11-04T01:39:01.405 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug trim objects = true 2023-11-04T01:39:01.405 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:39:01.405 INFO:teuthology.orchestra.run.smithi077.stdout: osd open classes on start = true 2023-11-04T01:39:01.406 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug pg log writeout = true 2023-11-04T01:39:01.406 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:39:01.406 INFO:teuthology.orchestra.run.smithi077.stdout: osd deep scrub update digest min age = 30 2023-11-04T01:39:01.406 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:39:01.406 INFO:teuthology.orchestra.run.smithi077.stdout: osd map max advance = 10 2023-11-04T01:39:01.406 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:39:01.407 INFO:teuthology.orchestra.run.smithi077.stdout: journal zero on create = true 2023-11-04T01:39:01.407 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:39:01.407 INFO:teuthology.orchestra.run.smithi077.stdout: filestore ondisk finisher threads = 3 2023-11-04T01:39:01.407 INFO:teuthology.orchestra.run.smithi077.stdout: filestore apply finisher threads = 3 2023-11-04T01:39:01.407 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:39:01.408 INFO:teuthology.orchestra.run.smithi077.stdout: bdev debug aio = true 2023-11-04T01:39:01.408 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug misdirected ops = true 2023-11-04T01:39:01.408 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore block size = 96636764160 2023-11-04T01:39:01.408 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore fsck on mount = True 2023-11-04T01:39:01.408 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluefs = 20 2023-11-04T01:39:01.409 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluestore = 20 2023-11-04T01:39:01.409 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2023-11-04T01:39:01.409 INFO:teuthology.orchestra.run.smithi077.stdout: debug osd = 20 2023-11-04T01:39:01.409 INFO:teuthology.orchestra.run.smithi077.stdout: debug rocksdb = 10 2023-11-04T01:39:01.409 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd backfillfull_ratio = 0.85 2023-11-04T01:39:01.410 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd full ratio = 0.9 2023-11-04T01:39:01.410 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd nearfull ratio = 0.8 2023-11-04T01:39:01.410 INFO:teuthology.orchestra.run.smithi077.stdout: osd failsafe full ratio = 0.95 2023-11-04T01:39:01.410 INFO:teuthology.orchestra.run.smithi077.stdout: osd objectstore = bluestore 2023-11-04T01:39:01.411 INFO:teuthology.orchestra.run.smithi077.stdout: osd op complaint time = 180 2023-11-04T01:39:01.411 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:39:01.411 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr] 2023-11-04T01:39:01.411 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2023-11-04T01:39:01.412 INFO:teuthology.orchestra.run.smithi077.stdout: debug mgr = 20 2023-11-04T01:39:01.412 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2023-11-04T01:39:01.412 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2023-11-04T01:39:01.412 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:39:01.413 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:39:01.413 INFO:teuthology.orchestra.run.smithi077.stdout: mgr/telemetry/nag = false 2023-11-04T01:39:01.413 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:39:01.413 INFO:teuthology.orchestra.run.smithi077.stdout:[mon] 2023-11-04T01:39:01.413 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2023-11-04T01:39:01.414 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2023-11-04T01:39:01.414 INFO:teuthology.orchestra.run.smithi077.stdout: debug paxos = 20 2023-11-04T01:39:01.414 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2023-11-04T01:39:01.414 INFO:teuthology.orchestra.run.smithi077.stdout: mon data avail warn = 5 2023-11-04T01:39:01.414 INFO:teuthology.orchestra.run.smithi077.stdout: mon mgr mkfs grace = 240 2023-11-04T01:39:01.415 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:39:01.415 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd reporter subtree level = osd 2023-11-04T01:39:01.415 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd prime pg temp = true 2023-11-04T01:39:01.415 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:39:01.415 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:39:01.416 INFO:teuthology.orchestra.run.smithi077.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-04T01:39:01.416 INFO:teuthology.orchestra.run.smithi077.stdout: auth mon ticket ttl = 660 # 11m 2023-11-04T01:39:01.416 INFO:teuthology.orchestra.run.smithi077.stdout: auth service ticket ttl = 240 # 4m 2023-11-04T01:39:01.416 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:39:01.416 INFO:teuthology.orchestra.run.smithi077.stdout: # don't complain about insecure global_id in the test suite 2023-11-04T01:39:01.417 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-04T01:39:01.417 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-04T01:39:01.417 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:39:01.417 INFO:teuthology.orchestra.run.smithi077.stdout: # 1m isn't quite enough 2023-11-04T01:39:01.417 INFO:teuthology.orchestra.run.smithi077.stdout: mon_down_mkfs_grace = 2m 2023-11-04T01:39:01.417 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:39:01.418 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_filestore_osds = false 2023-11-04T01:39:01.418 INFO:teuthology.orchestra.run.smithi077.stdout: mon op complaint time = 120 2023-11-04T01:39:01.418 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:39:01.418 INFO:teuthology.orchestra.run.smithi077.stdout:[client] 2023-11-04T01:39:01.418 INFO:teuthology.orchestra.run.smithi077.stdout: rgw cache enabled = true 2023-11-04T01:39:01.419 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable ops log = true 2023-11-04T01:39:01.419 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable usage log = true 2023-11-04T01:39:01.419 INFO:teuthology.orchestra.run.smithi077.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-04T01:39:01.419 INFO:teuthology.orchestra.run.smithi077.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-04T01:39:01.420 INFO:teuthology.orchestra.run.smithi077.stdout: client mount timeout = 600 2023-11-04T01:39:01.420 INFO:teuthology.orchestra.run.smithi077.stdout: debug client = 20 2023-11-04T01:39:01.420 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2023-11-04T01:39:01.420 INFO:teuthology.orchestra.run.smithi077.stdout: pid file = "" 2023-11-04T01:39:01.420 INFO:teuthology.orchestra.run.smithi077.stdout: rados mon op timeout = 900 2023-11-04T01:39:01.421 INFO:teuthology.orchestra.run.smithi077.stdout: rados osd op timeout = 900 2023-11-04T01:39:01.421 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.a] 2023-11-04T01:39:01.421 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.b] 2023-11-04T01:39:01.421 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.c] 2023-11-04T01:39:01.421 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.a] 2023-11-04T01:39:01.421 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.c] 2023-11-04T01:39:01.422 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.b] 2023-11-04T01:39:01.422 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.d] 2023-11-04T01:39:01.422 INFO:teuthology.orchestra.run.smithi077.stdout:[mds] 2023-11-04T01:39:01.422 INFO:teuthology.orchestra.run.smithi077.stdout: debug mds = 20 2023-11-04T01:39:01.422 INFO:teuthology.orchestra.run.smithi077.stdout: debug mds balancer = 20 2023-11-04T01:39:01.423 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2023-11-04T01:39:01.423 INFO:teuthology.orchestra.run.smithi077.stdout: mds debug frag = True 2023-11-04T01:39:01.423 INFO:teuthology.orchestra.run.smithi077.stdout: mds debug scatterstat = True 2023-11-04T01:39:01.423 INFO:teuthology.orchestra.run.smithi077.stdout: mds op complaint time = 180 2023-11-04T01:39:01.423 INFO:teuthology.orchestra.run.smithi077.stdout: mds verify scatter = True 2023-11-04T01:39:01.424 INFO:teuthology.orchestra.run.smithi077.stdout: osd op complaint time = 180 2023-11-04T01:39:01.424 INFO:teuthology.orchestra.run.smithi077.stdout: rados mon op timeout = 900 2023-11-04T01:39:01.424 INFO:teuthology.orchestra.run.smithi077.stdout: rados osd op timeout = 900 2023-11-04T01:39:01.425 INFO:teuthology.orchestra.run.smithi122.stdout:[global] 2023-11-04T01:39:01.426 INFO:teuthology.orchestra.run.smithi122.stdout: chdir = "" 2023-11-04T01:39:01.426 INFO:teuthology.orchestra.run.smithi122.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-04T01:39:01.426 INFO:teuthology.orchestra.run.smithi122.stdout: auth supported = cephx 2023-11-04T01:39:01.426 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:39:01.427 INFO:teuthology.orchestra.run.smithi122.stdout: filestore xattr use omap = true 2023-11-04T01:39:01.427 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:39:01.427 INFO:teuthology.orchestra.run.smithi122.stdout: mon clock drift allowed = 1.000 2023-11-04T01:39:01.427 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:39:01.427 INFO:teuthology.orchestra.run.smithi122.stdout: osd crush chooseleaf type = 0 2023-11-04T01:39:01.428 INFO:teuthology.orchestra.run.smithi122.stdout: auth debug = true 2023-11-04T01:39:01.428 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:39:01.428 INFO:teuthology.orchestra.run.smithi122.stdout: ms die on old message = true 2023-11-04T01:39:01.428 INFO:teuthology.orchestra.run.smithi122.stdout: ms die on bug = true 2023-11-04T01:39:01.428 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:39:01.428 INFO:teuthology.orchestra.run.smithi122.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-04T01:39:01.429 INFO:teuthology.orchestra.run.smithi122.stdout: mon pg warn max object skew = 0 2023-11-04T01:39:01.429 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:39:01.429 INFO:teuthology.orchestra.run.smithi122.stdout: # disable pg_autoscaler by default for new pools 2023-11-04T01:39:01.429 INFO:teuthology.orchestra.run.smithi122.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-04T01:39:01.429 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:39:01.430 INFO:teuthology.orchestra.run.smithi122.stdout: osd pool default size = 2 2023-11-04T01:39:01.430 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:39:01.430 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd allow primary affinity = true 2023-11-04T01:39:01.430 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd allow pg remap = true 2023-11-04T01:39:01.430 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on legacy crush tunables = false 2023-11-04T01:39:01.431 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on crush straw calc version zero = false 2023-11-04T01:39:01.431 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on no sortbitwise = false 2023-11-04T01:39:01.431 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on osd down out interval zero = false 2023-11-04T01:39:01.431 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on too few osds = false 2023-11-04T01:39:01.431 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-04T01:39:01.432 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-04T01:39:01.432 INFO:teuthology.orchestra.run.smithi122.stdout: mon_allow_pool_size_one = true 2023-11-04T01:39:01.432 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:39:01.432 INFO:teuthology.orchestra.run.smithi122.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-04T01:39:01.432 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:39:01.432 INFO:teuthology.orchestra.run.smithi122.stdout: osd default data pool replay window = 5 2023-11-04T01:39:01.433 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:39:01.433 INFO:teuthology.orchestra.run.smithi122.stdout: mon allow pool delete = true 2023-11-04T01:39:01.433 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:39:01.433 INFO:teuthology.orchestra.run.smithi122.stdout: mon cluster log file level = debug 2023-11-04T01:39:01.433 INFO:teuthology.orchestra.run.smithi122.stdout: debug asserts on shutdown = true 2023-11-04T01:39:01.434 INFO:teuthology.orchestra.run.smithi122.stdout: mon health detail to clog = false 2023-11-04T01:39:01.434 INFO:teuthology.orchestra.run.smithi122.stdout: mon host = "172.21.15.77,172.21.15.122,[v2:172.21.15.122:3301,v1:172.21.15.122:6790]" 2023-11-04T01:39:01.434 INFO:teuthology.orchestra.run.smithi122.stdout: fsid = 0c22c75d-0169-41ef-b663-6ac1c5b0f71f 2023-11-04T01:39:01.434 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:39:01.434 INFO:teuthology.orchestra.run.smithi122.stdout:[osd] 2023-11-04T01:39:01.435 INFO:teuthology.orchestra.run.smithi122.stdout: osd journal size = 100 2023-11-04T01:39:01.435 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:39:01.435 INFO:teuthology.orchestra.run.smithi122.stdout: osd scrub load threshold = 5.0 2023-11-04T01:39:01.435 INFO:teuthology.orchestra.run.smithi122.stdout: osd scrub max interval = 600 2023-11-04T01:39:01.435 INFO:teuthology.orchestra.run.smithi122.stdout: osd mclock profile = high_recovery_ops 2023-11-04T01:39:01.436 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:39:01.436 INFO:teuthology.orchestra.run.smithi122.stdout: osd recover clone overlap = true 2023-11-04T01:39:01.436 INFO:teuthology.orchestra.run.smithi122.stdout: osd recovery max chunk = 1048576 2023-11-04T01:39:01.436 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:39:01.436 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug shutdown = true 2023-11-04T01:39:01.436 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug op order = true 2023-11-04T01:39:01.437 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug verify stray on activate = true 2023-11-04T01:39:01.437 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug trim objects = true 2023-11-04T01:39:01.437 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:39:01.437 INFO:teuthology.orchestra.run.smithi122.stdout: osd open classes on start = true 2023-11-04T01:39:01.437 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug pg log writeout = true 2023-11-04T01:39:01.438 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:39:01.438 INFO:teuthology.orchestra.run.smithi122.stdout: osd deep scrub update digest min age = 30 2023-11-04T01:39:01.438 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:39:01.438 INFO:teuthology.orchestra.run.smithi122.stdout: osd map max advance = 10 2023-11-04T01:39:01.439 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:39:01.439 INFO:teuthology.orchestra.run.smithi122.stdout: journal zero on create = true 2023-11-04T01:39:01.439 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:39:01.439 INFO:teuthology.orchestra.run.smithi122.stdout: filestore ondisk finisher threads = 3 2023-11-04T01:39:01.439 INFO:teuthology.orchestra.run.smithi122.stdout: filestore apply finisher threads = 3 2023-11-04T01:39:01.439 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:39:01.440 INFO:teuthology.orchestra.run.smithi122.stdout: bdev debug aio = true 2023-11-04T01:39:01.440 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug misdirected ops = true 2023-11-04T01:39:01.440 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore block size = 96636764160 2023-11-04T01:39:01.440 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore fsck on mount = True 2023-11-04T01:39:01.440 INFO:teuthology.orchestra.run.smithi122.stdout: debug bluefs = 20 2023-11-04T01:39:01.441 INFO:teuthology.orchestra.run.smithi122.stdout: debug bluestore = 20 2023-11-04T01:39:01.441 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2023-11-04T01:39:01.441 INFO:teuthology.orchestra.run.smithi122.stdout: debug osd = 20 2023-11-04T01:39:01.441 INFO:teuthology.orchestra.run.smithi122.stdout: debug rocksdb = 10 2023-11-04T01:39:01.441 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd backfillfull_ratio = 0.85 2023-11-04T01:39:01.442 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd full ratio = 0.9 2023-11-04T01:39:01.442 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd nearfull ratio = 0.8 2023-11-04T01:39:01.442 INFO:teuthology.orchestra.run.smithi122.stdout: osd failsafe full ratio = 0.95 2023-11-04T01:39:01.442 INFO:teuthology.orchestra.run.smithi122.stdout: osd objectstore = bluestore 2023-11-04T01:39:01.442 INFO:teuthology.orchestra.run.smithi122.stdout: osd op complaint time = 180 2023-11-04T01:39:01.442 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:39:01.443 INFO:teuthology.orchestra.run.smithi122.stdout:[mgr] 2023-11-04T01:39:01.443 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2023-11-04T01:39:01.443 INFO:teuthology.orchestra.run.smithi122.stdout: debug mgr = 20 2023-11-04T01:39:01.443 INFO:teuthology.orchestra.run.smithi122.stdout: debug mon = 20 2023-11-04T01:39:01.443 INFO:teuthology.orchestra.run.smithi122.stdout: debug auth = 20 2023-11-04T01:39:01.444 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:39:01.444 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:39:01.444 INFO:teuthology.orchestra.run.smithi122.stdout: mgr/telemetry/nag = false 2023-11-04T01:39:01.444 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:39:01.444 INFO:teuthology.orchestra.run.smithi122.stdout:[mon] 2023-11-04T01:39:01.444 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2023-11-04T01:39:01.445 INFO:teuthology.orchestra.run.smithi122.stdout: debug mon = 20 2023-11-04T01:39:01.445 INFO:teuthology.orchestra.run.smithi122.stdout: debug paxos = 20 2023-11-04T01:39:01.445 INFO:teuthology.orchestra.run.smithi122.stdout: debug auth = 20 2023-11-04T01:39:01.445 INFO:teuthology.orchestra.run.smithi122.stdout: mon data avail warn = 5 2023-11-04T01:39:01.445 INFO:teuthology.orchestra.run.smithi122.stdout: mon mgr mkfs grace = 240 2023-11-04T01:39:01.446 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:39:01.446 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd reporter subtree level = osd 2023-11-04T01:39:01.446 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd prime pg temp = true 2023-11-04T01:39:01.446 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:39:01.446 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:39:01.447 INFO:teuthology.orchestra.run.smithi122.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-04T01:39:01.447 INFO:teuthology.orchestra.run.smithi122.stdout: auth mon ticket ttl = 660 # 11m 2023-11-04T01:39:01.447 INFO:teuthology.orchestra.run.smithi122.stdout: auth service ticket ttl = 240 # 4m 2023-11-04T01:39:01.447 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:39:01.447 INFO:teuthology.orchestra.run.smithi122.stdout: # don't complain about insecure global_id in the test suite 2023-11-04T01:39:01.447 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-04T01:39:01.448 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-04T01:39:01.448 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:39:01.448 INFO:teuthology.orchestra.run.smithi122.stdout: # 1m isn't quite enough 2023-11-04T01:39:01.449 INFO:teuthology.orchestra.run.smithi122.stdout: mon_down_mkfs_grace = 2m 2023-11-04T01:39:01.449 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:39:01.449 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_filestore_osds = false 2023-11-04T01:39:01.449 INFO:teuthology.orchestra.run.smithi122.stdout: mon op complaint time = 120 2023-11-04T01:39:01.449 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:39:01.450 INFO:teuthology.orchestra.run.smithi122.stdout:[client] 2023-11-04T01:39:01.450 INFO:teuthology.orchestra.run.smithi122.stdout: rgw cache enabled = true 2023-11-04T01:39:01.450 INFO:teuthology.orchestra.run.smithi122.stdout: rgw enable ops log = true 2023-11-04T01:39:01.450 INFO:teuthology.orchestra.run.smithi122.stdout: rgw enable usage log = true 2023-11-04T01:39:01.450 INFO:teuthology.orchestra.run.smithi122.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-04T01:39:01.450 INFO:teuthology.orchestra.run.smithi122.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-04T01:39:01.451 INFO:teuthology.orchestra.run.smithi122.stdout: client mount timeout = 600 2023-11-04T01:39:01.451 INFO:teuthology.orchestra.run.smithi122.stdout: debug client = 20 2023-11-04T01:39:01.451 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2023-11-04T01:39:01.451 INFO:teuthology.orchestra.run.smithi122.stdout: pid file = "" 2023-11-04T01:39:01.451 INFO:teuthology.orchestra.run.smithi122.stdout: rados mon op timeout = 900 2023-11-04T01:39:01.452 INFO:teuthology.orchestra.run.smithi122.stdout: rados osd op timeout = 900 2023-11-04T01:39:01.452 INFO:teuthology.orchestra.run.smithi122.stdout:[mon.a] 2023-11-04T01:39:01.452 INFO:teuthology.orchestra.run.smithi122.stdout:[mon.b] 2023-11-04T01:39:01.452 INFO:teuthology.orchestra.run.smithi122.stdout:[mon.c] 2023-11-04T01:39:01.452 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.a] 2023-11-04T01:39:01.452 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.c] 2023-11-04T01:39:01.453 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.b] 2023-11-04T01:39:01.453 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.d] 2023-11-04T01:39:01.453 INFO:teuthology.orchestra.run.smithi122.stdout:[mds] 2023-11-04T01:39:01.453 INFO:teuthology.orchestra.run.smithi122.stdout: debug mds = 20 2023-11-04T01:39:01.453 INFO:teuthology.orchestra.run.smithi122.stdout: debug mds balancer = 20 2023-11-04T01:39:01.454 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2023-11-04T01:39:01.454 INFO:teuthology.orchestra.run.smithi122.stdout: mds debug frag = True 2023-11-04T01:39:01.454 INFO:teuthology.orchestra.run.smithi122.stdout: mds debug scatterstat = True 2023-11-04T01:39:01.454 INFO:teuthology.orchestra.run.smithi122.stdout: mds op complaint time = 180 2023-11-04T01:39:01.454 INFO:teuthology.orchestra.run.smithi122.stdout: mds verify scatter = True 2023-11-04T01:39:01.455 INFO:teuthology.orchestra.run.smithi122.stdout: osd op complaint time = 180 2023-11-04T01:39:01.455 INFO:teuthology.orchestra.run.smithi122.stdout: rados mon op timeout = 900 2023-11-04T01:39:01.455 INFO:teuthology.orchestra.run.smithi122.stdout: rados osd op timeout = 900 2023-11-04T01:39:01.455 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-04T01:39:01.456 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-04T01:39:01.511 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-04T01:39:01.511 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:39:01.512 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-04T01:39:01.526 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:39:01.527 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-04T01:39:01.581 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi077.front.sepia.ceph.com 2023-11-04T01:39:01.581 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:39:01.582 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-04T01:39:01.582 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-04T01:39:01.660 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:39:01.660 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:39:01.715 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi122.front.sepia.ceph.com 2023-11-04T01:39:01.716 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:39:01.716 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-04T01:39:01.717 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-04T01:39:01.756 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:39:01.756 DEBUG:teuthology.orchestra.run.smithi122:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:39:01.810 INFO:tasks.ceph:Setting up mon nodes... 2023-11-04T01:39:01.811 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-04T01:39:01.811 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-04T01:39:01.865 INFO:teuthology.orchestra.run.smithi077.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-04T01:39:01.868 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-04T01:39:01.928 INFO:teuthology.orchestra.run.smithi122.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-04T01:39:01.930 INFO:tasks.ceph:Setting up mds nodes... 2023-11-04T01:39:01.931 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-04T01:39:01.985 INFO:teuthology.orchestra.run.smithi077.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-04T01:39:01.987 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-04T01:39:02.014 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-04T01:39:02.111 INFO:teuthology.orchestra.run.smithi077.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-04T01:39:02.111 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-04T01:39:02.139 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-04T01:39:02.193 INFO:teuthology.orchestra.run.smithi122.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-04T01:39:02.196 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-04T01:39:02.222 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-04T01:39:02.316 INFO:teuthology.orchestra.run.smithi122.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-04T01:39:02.319 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-04T01:39:02.346 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-04T01:39:02.347 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-04T01:39:02.390 INFO:teuthology.orchestra.run.smithi077.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-04T01:39:02.405 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-04T01:39:02.485 INFO:teuthology.orchestra.run.smithi077.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-04T01:39:02.500 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-04T01:39:02.542 INFO:teuthology.orchestra.run.smithi122.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-04T01:39:02.556 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-04T01:39:02.638 INFO:teuthology.orchestra.run.smithi122.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-04T01:39:02.653 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-04T01:39:02.653 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi077.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi122.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-04T01:39:02.654 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-04T01:39:02.681 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-04T01:39:02.681 INFO:tasks.ceph:role: osd.0 2023-11-04T01:39:02.682 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi077.front.sepia.ceph.com 2023-11-04T01:39:02.682 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-04T01:39:02.755 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:39:02.755 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:39:02.755 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:39:02.755 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-04T01:39:02.756 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:39:02.756 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:39:02.756 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:39:02.756 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-04T01:39:02.756 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:39:02.757 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:39:03.259 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2023-11-04T01:39:03.261 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2023-11-04T01:39:03.262 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-04T01:39:03.414 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-04T01:39:03.447 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-04T01:39:03.514 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-04T01:39:03.515 INFO:tasks.ceph:role: osd.1 2023-11-04T01:39:03.515 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi077.front.sepia.ceph.com 2023-11-04T01:39:03.515 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-04T01:39:03.588 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:39:03.589 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:39:03.589 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:39:03.589 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-04T01:39:03.589 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:39:03.589 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:39:03.590 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:39:03.590 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-04T01:39:03.590 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:39:03.590 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:39:04.028 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2023-11-04T01:39:04.030 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2023-11-04T01:39:04.031 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-04T01:39:04.118 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-04T01:39:04.150 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-04T01:39:04.217 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-04T01:39:04.218 INFO:tasks.ceph:role: osd.2 2023-11-04T01:39:04.218 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi077.front.sepia.ceph.com 2023-11-04T01:39:04.219 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-04T01:39:04.291 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:39:04.292 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:39:04.292 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:39:04.292 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-04T01:39:04.292 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:39:04.292 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:39:04.293 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:39:04.293 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-04T01:39:04.293 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:39:04.293 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:39:04.781 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2023-11-04T01:39:04.783 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2023-11-04T01:39:04.783 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-04T01:39:04.908 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-04T01:39:04.941 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-04T01:39:05.009 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-04T01:39:05.009 INFO:tasks.ceph:role: osd.3 2023-11-04T01:39:05.010 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi077.front.sepia.ceph.com 2023-11-04T01:39:05.010 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-04T01:39:05.084 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:39:05.085 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:39:05.085 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:39:05.085 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-04T01:39:05.085 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:39:05.086 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:39:05.086 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:39:05.086 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-04T01:39:05.086 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:39:05.086 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:39:05.586 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2023-11-04T01:39:05.588 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2023-11-04T01:39:05.589 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-04T01:39:05.725 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-04T01:39:05.761 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:39:05.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:05.869+0000 7f89982f8500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-04T01:39:05.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:05.869+0000 7f89982f8500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-04T01:39:05.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:05.869+0000 7f89982f8500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-04T01:39:05.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:05.869+0000 7f89982f8500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-04T01:39:05.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:05.869+0000 7f89982f8500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-04T01:39:05.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:05.870+0000 7f89982f8500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-04T01:39:08.724 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-04T01:39:08.756 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:39:08.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:08.845+0000 7fdaef016500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-04T01:39:08.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:08.846+0000 7fdaef016500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-04T01:39:08.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:08.846+0000 7fdaef016500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-04T01:39:08.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:08.846+0000 7fdaef016500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-04T01:39:08.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:08.846+0000 7fdaef016500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-04T01:39:08.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:08.846+0000 7fdaef016500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-04T01:39:11.700 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-04T01:39:11.732 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:39:11.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:11.820+0000 7f5c7682a500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-04T01:39:11.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:11.821+0000 7f5c7682a500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-04T01:39:11.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:11.821+0000 7f5c7682a500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-04T01:39:11.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:11.821+0000 7f5c7682a500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-04T01:39:11.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:11.821+0000 7f5c7682a500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-04T01:39:11.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:11.821+0000 7f5c7682a500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-04T01:39:14.670 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-04T01:39:14.701 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:39:14.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:14.789+0000 7efdf5520500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-04T01:39:14.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:14.790+0000 7efdf5520500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-04T01:39:14.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:14.790+0000 7efdf5520500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-04T01:39:14.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:14.790+0000 7efdf5520500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-04T01:39:14.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:14.790+0000 7efdf5520500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-04T01:39:14.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:14.790+0000 7efdf5520500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-04T01:39:17.647 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-04T01:39:17.676 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-04T01:39:17.708 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-04T01:39:17.708 INFO:tasks.ceph:role: osd.4 2023-11-04T01:39:17.709 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi122.front.sepia.ceph.com 2023-11-04T01:39:17.709 DEBUG:teuthology.orchestra.run.smithi122:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-04T01:39:17.787 INFO:teuthology.orchestra.run.smithi122.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:39:17.787 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:39:17.787 INFO:teuthology.orchestra.run.smithi122.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:39:17.787 INFO:teuthology.orchestra.run.smithi122.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-04T01:39:17.788 INFO:teuthology.orchestra.run.smithi122.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:39:17.788 INFO:teuthology.orchestra.run.smithi122.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:39:17.788 INFO:teuthology.orchestra.run.smithi122.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:39:17.788 INFO:teuthology.orchestra.run.smithi122.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-04T01:39:17.788 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:39:17.789 INFO:teuthology.orchestra.run.smithi122.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:39:18.295 INFO:teuthology.orchestra.run.smithi122.stdout:Discarding blocks...Done. 2023-11-04T01:39:18.297 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi122.front.sepia.ceph.com -o noatime 2023-11-04T01:39:18.298 DEBUG:teuthology.orchestra.run.smithi122:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-04T01:39:18.436 DEBUG:teuthology.orchestra.run.smithi122:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-04T01:39:18.476 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-04T01:39:18.548 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-04T01:39:18.549 INFO:tasks.ceph:role: osd.5 2023-11-04T01:39:18.549 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi122.front.sepia.ceph.com 2023-11-04T01:39:18.549 DEBUG:teuthology.orchestra.run.smithi122:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-04T01:39:18.628 INFO:teuthology.orchestra.run.smithi122.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:39:18.628 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:39:18.629 INFO:teuthology.orchestra.run.smithi122.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:39:18.629 INFO:teuthology.orchestra.run.smithi122.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-04T01:39:18.629 INFO:teuthology.orchestra.run.smithi122.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:39:18.629 INFO:teuthology.orchestra.run.smithi122.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:39:18.630 INFO:teuthology.orchestra.run.smithi122.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:39:18.630 INFO:teuthology.orchestra.run.smithi122.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-04T01:39:18.630 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:39:18.630 INFO:teuthology.orchestra.run.smithi122.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:39:19.094 INFO:teuthology.orchestra.run.smithi122.stdout:Discarding blocks...Done. 2023-11-04T01:39:19.096 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi122.front.sepia.ceph.com -o noatime 2023-11-04T01:39:19.096 DEBUG:teuthology.orchestra.run.smithi122:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-04T01:39:19.189 DEBUG:teuthology.orchestra.run.smithi122:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-04T01:39:19.224 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-04T01:39:19.291 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-04T01:39:19.292 INFO:tasks.ceph:role: osd.6 2023-11-04T01:39:19.292 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi122.front.sepia.ceph.com 2023-11-04T01:39:19.293 DEBUG:teuthology.orchestra.run.smithi122:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-04T01:39:19.367 INFO:teuthology.orchestra.run.smithi122.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:39:19.367 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:39:19.367 INFO:teuthology.orchestra.run.smithi122.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:39:19.368 INFO:teuthology.orchestra.run.smithi122.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-04T01:39:19.368 INFO:teuthology.orchestra.run.smithi122.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:39:19.368 INFO:teuthology.orchestra.run.smithi122.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:39:19.368 INFO:teuthology.orchestra.run.smithi122.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:39:19.368 INFO:teuthology.orchestra.run.smithi122.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-04T01:39:19.369 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:39:19.369 INFO:teuthology.orchestra.run.smithi122.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:39:19.844 INFO:teuthology.orchestra.run.smithi122.stdout:Discarding blocks...Done. 2023-11-04T01:39:19.847 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi122.front.sepia.ceph.com -o noatime 2023-11-04T01:39:19.847 DEBUG:teuthology.orchestra.run.smithi122:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-04T01:39:19.995 DEBUG:teuthology.orchestra.run.smithi122:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-04T01:39:20.032 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-04T01:39:20.105 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-04T01:39:20.105 INFO:tasks.ceph:role: osd.7 2023-11-04T01:39:20.105 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi122.front.sepia.ceph.com 2023-11-04T01:39:20.106 DEBUG:teuthology.orchestra.run.smithi122:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-04T01:39:20.184 INFO:teuthology.orchestra.run.smithi122.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:39:20.184 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:39:20.184 INFO:teuthology.orchestra.run.smithi122.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:39:20.185 INFO:teuthology.orchestra.run.smithi122.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-04T01:39:20.185 INFO:teuthology.orchestra.run.smithi122.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:39:20.185 INFO:teuthology.orchestra.run.smithi122.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:39:20.185 INFO:teuthology.orchestra.run.smithi122.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:39:20.185 INFO:teuthology.orchestra.run.smithi122.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-04T01:39:20.186 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:39:20.186 INFO:teuthology.orchestra.run.smithi122.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:39:20.660 INFO:teuthology.orchestra.run.smithi122.stdout:Discarding blocks...Done. 2023-11-04T01:39:20.662 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi122.front.sepia.ceph.com -o noatime 2023-11-04T01:39:20.663 DEBUG:teuthology.orchestra.run.smithi122:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-04T01:39:20.810 DEBUG:teuthology.orchestra.run.smithi122:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-04T01:39:20.848 DEBUG:teuthology.orchestra.run.smithi122:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:39:20.956 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:20.955+0000 7f3e57a10500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-04T01:39:20.956 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:20.955+0000 7f3e57a10500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-04T01:39:20.957 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:20.955+0000 7f3e57a10500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-04T01:39:20.957 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:20.955+0000 7f3e57a10500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-04T01:39:20.957 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:20.955+0000 7f3e57a10500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-04T01:39:20.957 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:20.956+0000 7f3e57a10500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-04T01:39:23.801 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-04T01:39:23.831 DEBUG:teuthology.orchestra.run.smithi122:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:39:23.918 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:23.915+0000 7f4fd10b6500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-04T01:39:23.918 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:23.916+0000 7f4fd10b6500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-04T01:39:23.918 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:23.916+0000 7f4fd10b6500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-04T01:39:23.918 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:23.916+0000 7f4fd10b6500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-04T01:39:23.919 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:23.916+0000 7f4fd10b6500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-04T01:39:23.919 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:23.916+0000 7f4fd10b6500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-04T01:39:26.770 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-04T01:39:26.802 DEBUG:teuthology.orchestra.run.smithi122:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:39:26.898 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:26.894+0000 7ff79e610500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-04T01:39:26.899 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:26.894+0000 7ff79e610500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-04T01:39:26.899 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:26.894+0000 7ff79e610500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-04T01:39:26.899 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:26.894+0000 7ff79e610500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-04T01:39:26.899 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:26.894+0000 7ff79e610500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-04T01:39:26.899 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:26.894+0000 7ff79e610500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-04T01:39:29.399 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:39:29.403 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:39:29.750 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-04T01:39:29.783 DEBUG:teuthology.orchestra.run.smithi122:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:39:29.877 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:29.875+0000 7f6763dbe500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-04T01:39:29.878 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:29.875+0000 7f6763dbe500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-04T01:39:29.878 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:29.875+0000 7f6763dbe500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-04T01:39:29.878 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:29.875+0000 7f6763dbe500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-04T01:39:29.878 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:29.875+0000 7f6763dbe500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-04T01:39:29.879 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:29.876+0000 7f6763dbe500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-04T01:39:32.732 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-04T01:39:32.764 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-04T01:39:32.764 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:39:32.765 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-04T01:39:32.796 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:39:32.796 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-04T01:39:32.866 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:39:32.866 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-04T01:39:32.935 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:39:32.935 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-04T01:39:33.004 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:39:33.004 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-04T01:39:33.073 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:39:33.074 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-04T01:39:33.140 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:39:33.141 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-04T01:39:33.208 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:39:33.208 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-04T01:39:33.239 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:39:33.240 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-04T01:39:33.309 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:39:33.310 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-04T01:39:33.379 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:39:33.380 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-04T01:39:33.450 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:39:33.450 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-04T01:39:33.518 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:39:33.519 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-04T01:39:33.586 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:39:33.587 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-04T01:39:33.654 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:39:33.654 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-04T01:39:33.673 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:39:33.674 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-04T01:39:33.730 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:39:33.730 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-04T01:39:33.746 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:39:33.746 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-04T01:39:33.800 INFO:tasks.ceph:Adding keys to all mons... 2023-11-04T01:39:33.801 DEBUG:teuthology.orchestra.run.smithi077:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-04T01:39:33.803 DEBUG:teuthology.orchestra.run.smithi122:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-04T01:39:33.844 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr.y] 2023-11-04T01:39:33.844 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQC1oEVlXDKNMxAAVhq0CA3RveLfU4A6oIO4jQ== 2023-11-04T01:39:33.844 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.a] 2023-11-04T01:39:33.844 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQC1oEVl/r6uOhAA9u5Hcsr4T+QfSgBmS6M2Cw== 2023-11-04T01:39:33.845 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.c] 2023-11-04T01:39:33.845 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQC2oEVlvLxtBhAAuxQpEPrSlVc/YBdqJJn7iA== 2023-11-04T01:39:33.845 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.0] 2023-11-04T01:39:33.845 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQC5oEVl4pfcMxAATPwL4pgDM0ywnmsufp74lw== 2023-11-04T01:39:33.846 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.1] 2023-11-04T01:39:33.846 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQC8oEVl+qN4MhAAXZweqA2M4vvc4B04adonzQ== 2023-11-04T01:39:33.846 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.2] 2023-11-04T01:39:33.846 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQC/oEVlRuD4MBAAQPQL0SzC7Cj9bzR/Cj+maA== 2023-11-04T01:39:33.846 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.3] 2023-11-04T01:39:33.847 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDCoEVlDO4fLxAASTTEpVp1dzEEci56OfSEMA== 2023-11-04T01:39:33.847 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr.x] 2023-11-04T01:39:33.847 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQC1oEVlvoNGNxAAB5/uyqV4Pf/HdyGcr8rVdw== 2023-11-04T01:39:33.847 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.b] 2023-11-04T01:39:33.847 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQC2oEVlOr56CxAAxOke25BrKTy0Vozn/aPYVw== 2023-11-04T01:39:33.848 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.d] 2023-11-04T01:39:33.848 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQC2oEVlB3PUEhAA0GaPLq/SwHPPHriYNnan9w== 2023-11-04T01:39:33.848 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.4] 2023-11-04T01:39:33.848 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDIoEVlQGrxOBAACkSdOwyqhcMBPhXbpdXFKw== 2023-11-04T01:39:33.848 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.5] 2023-11-04T01:39:33.849 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDLoEVlTrCoNhAAoLM/rpHPTO6H6eXr8so/pA== 2023-11-04T01:39:33.849 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.6] 2023-11-04T01:39:33.849 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDOoEVlb81bNRAAp8gIPrPxc9T8yp9Z8JJm8g== 2023-11-04T01:39:33.849 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.7] 2023-11-04T01:39:33.849 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDRoEVl2aM/NBAAbi6ZxsZ51qe78O1oaSpF8Q== 2023-11-04T01:39:33.850 INFO:teuthology.orchestra.run.smithi077.stdout:[client.0] 2023-11-04T01:39:33.850 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQC2oEVlChU2FxAAt1/aJZOrufjVZhraPqv1Gw== 2023-11-04T01:39:33.850 INFO:teuthology.orchestra.run.smithi077.stdout:[client.2] 2023-11-04T01:39:33.850 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQC2oEVliWLuHBAA7ElluXYK9/XvMXk4S1njJw== 2023-11-04T01:39:33.850 INFO:teuthology.orchestra.run.smithi077.stdout:[client.1] 2023-11-04T01:39:33.851 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQC2oEVlVY9FIBAAUiGoYvAgEDfoAKIJ9e/SOg== 2023-11-04T01:39:33.851 INFO:teuthology.orchestra.run.smithi077.stdout:[client.3] 2023-11-04T01:39:33.851 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQC2oEVlQ3QIJhAA5Fq/oI3qpJseGhwXV66eMA== 2023-11-04T01:39:33.866 INFO:teuthology.orchestra.run.smithi122.stdout:[mgr.y] 2023-11-04T01:39:33.866 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQC1oEVlXDKNMxAAVhq0CA3RveLfU4A6oIO4jQ== 2023-11-04T01:39:33.866 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.a] 2023-11-04T01:39:33.867 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQC1oEVl/r6uOhAA9u5Hcsr4T+QfSgBmS6M2Cw== 2023-11-04T01:39:33.867 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.c] 2023-11-04T01:39:33.867 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQC2oEVlvLxtBhAAuxQpEPrSlVc/YBdqJJn7iA== 2023-11-04T01:39:33.867 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.0] 2023-11-04T01:39:33.867 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQC5oEVl4pfcMxAATPwL4pgDM0ywnmsufp74lw== 2023-11-04T01:39:33.868 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.1] 2023-11-04T01:39:33.868 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQC8oEVl+qN4MhAAXZweqA2M4vvc4B04adonzQ== 2023-11-04T01:39:33.868 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.2] 2023-11-04T01:39:33.868 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQC/oEVlRuD4MBAAQPQL0SzC7Cj9bzR/Cj+maA== 2023-11-04T01:39:33.868 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.3] 2023-11-04T01:39:33.869 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQDCoEVlDO4fLxAASTTEpVp1dzEEci56OfSEMA== 2023-11-04T01:39:33.869 INFO:teuthology.orchestra.run.smithi122.stdout:[mgr.x] 2023-11-04T01:39:33.869 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQC1oEVlvoNGNxAAB5/uyqV4Pf/HdyGcr8rVdw== 2023-11-04T01:39:33.869 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.b] 2023-11-04T01:39:33.869 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQC2oEVlOr56CxAAxOke25BrKTy0Vozn/aPYVw== 2023-11-04T01:39:33.870 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.d] 2023-11-04T01:39:33.870 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQC2oEVlB3PUEhAA0GaPLq/SwHPPHriYNnan9w== 2023-11-04T01:39:33.870 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.4] 2023-11-04T01:39:33.871 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQDIoEVlQGrxOBAACkSdOwyqhcMBPhXbpdXFKw== 2023-11-04T01:39:33.871 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.5] 2023-11-04T01:39:33.871 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQDLoEVlTrCoNhAAoLM/rpHPTO6H6eXr8so/pA== 2023-11-04T01:39:33.871 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.6] 2023-11-04T01:39:33.871 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQDOoEVlb81bNRAAp8gIPrPxc9T8yp9Z8JJm8g== 2023-11-04T01:39:33.872 INFO:teuthology.orchestra.run.smithi122.stdout:[osd.7] 2023-11-04T01:39:33.872 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQDRoEVl2aM/NBAAbi6ZxsZ51qe78O1oaSpF8Q== 2023-11-04T01:39:33.872 INFO:teuthology.orchestra.run.smithi122.stdout:[client.0] 2023-11-04T01:39:33.872 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQC2oEVlChU2FxAAt1/aJZOrufjVZhraPqv1Gw== 2023-11-04T01:39:33.872 INFO:teuthology.orchestra.run.smithi122.stdout:[client.2] 2023-11-04T01:39:33.872 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQC2oEVliWLuHBAA7ElluXYK9/XvMXk4S1njJw== 2023-11-04T01:39:33.873 INFO:teuthology.orchestra.run.smithi122.stdout:[client.1] 2023-11-04T01:39:33.873 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQC2oEVlVY9FIBAAUiGoYvAgEDfoAKIJ9e/SOg== 2023-11-04T01:39:33.873 INFO:teuthology.orchestra.run.smithi122.stdout:[client.3] 2023-11-04T01:39:33.873 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQC2oEVlQ3QIJhAA5Fq/oI3qpJseGhwXV66eMA== 2023-11-04T01:39:33.874 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-04T01:39:33.895 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-04T01:39:33.966 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:39:33.969 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:39:34.023 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:39:34.025 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:39:34.079 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:39:34.081 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:39:34.132 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:39:34.135 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:39:34.187 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:39:34.190 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:39:34.242 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:39:34.245 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:39:34.296 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-04T01:39:34.298 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-04T01:39:34.350 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:39:34.353 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:39:34.407 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:39:34.410 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:39:34.464 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:39:34.467 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:39:34.518 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:39:34.521 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:39:34.573 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:39:34.575 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:39:34.626 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:39:34.629 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:39:34.680 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:39:34.683 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:39:34.737 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:39:34.740 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:39:34.795 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:39:34.797 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:39:34.852 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:39:34.855 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:39:34.910 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-04T01:39:34.911 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-04T01:39:34.937 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-04T01:39:35.033 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-04T01:39:35.060 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-04T01:39:35.086 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-04T01:39:35.184 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-04T01:39:35.211 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-04T01:39:35.277 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-04T01:39:35.374 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-04T01:39:35.400 DEBUG:teuthology.orchestra.run.smithi077:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:39:35.403 DEBUG:teuthology.orchestra.run.smithi122:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:39:35.455 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-04T01:39:35.456 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-04T01:39:35.456 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-04T01:39:35.459 INFO:tasks.ceph.mon.a:Started 2023-11-04T01:39:35.459 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-04T01:39:35.459 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-04T01:39:35.497 INFO:tasks.ceph.mon.b:Started 2023-11-04T01:39:35.497 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-04T01:39:35.498 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-04T01:39:35.500 INFO:tasks.ceph.mon.c:Started 2023-11-04T01:39:35.500 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-04T01:39:35.500 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-04T01:39:35.501 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-04T01:39:35.503 INFO:tasks.ceph.mgr.y:Started 2023-11-04T01:39:35.503 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-04T01:39:35.504 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-04T01:39:35.505 INFO:tasks.ceph.mgr.x:Started 2023-11-04T01:39:35.506 INFO:tasks.ceph:Setting crush tunables to default 2023-11-04T01:39:35.506 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd crush tunables default 2023-11-04T01:39:35.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:35.605+0000 7ff4b9ac2640 1 Processor -- start 2023-11-04T01:39:35.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:35.605+0000 7ff4b9ac2640 1 -- start start 2023-11-04T01:39:35.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:35.605+0000 7ff4b9ac2640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff4b4153e60 0x7ff4b415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:35.606+0000 7ff4b9ac2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff4b40cd6d0 0x7ff4b4161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:35.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:35.606+0000 7ff4b9ac2640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b40cde60 con 0x7ff4b40b4880 2023-11-04T01:39:35.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:35.606+0000 7ff4b9ac2640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b4160f90 con 0x7ff4b40cd6d0 2023-11-04T01:39:35.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:35.606+0000 7ff4b9ac2640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b415e400 con 0x7ff4b4153e60 2023-11-04T01:39:35.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:35.606+0000 7ff4b2ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff4b40cd6d0 0x7ff4b4161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:35.606+0000 7ff4b3fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ff4b40b4880 0x7ff4b406b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57392/0 (socket says 172.21.15.77:57392) 2023-11-04T01:39:35.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:35.606+0000 7ff4b3fff640 1 -- 172.21.15.77:0/3427832598 learned_addr learned my addr 172.21.15.77:0/3427832598 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:39:35.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:35.606+0000 7ff4b2ffd640 1 -- 172.21.15.77:0/3427832598 >> v2:172.21.15.77:3300/0 conn(0x7ff4b40cd6d0 msgr2=0x7ff4b4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-04T01:39:35.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:35.606+0000 7ff4b2ffd640 1 -- 172.21.15.77:0/3427832598 >> v2:172.21.15.77:3300/0 conn(0x7ff4b40cd6d0 msgr2=0x7ff4b4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:39:35.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:35.606+0000 7ff4b2ffd640 1 --2- 172.21.15.77:0/3427832598 >> v2:172.21.15.77:3300/0 conn(0x7ff4b40cd6d0 0x7ff4b4161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:39:35.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:35.606+0000 7ff4b37fe640 1 --2- 172.21.15.77:0/3427832598 >> v2:172.21.15.122:3300/0 conn(0x7ff4b4153e60 0x7ff4b415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:35.606+0000 7ff4b2ffd640 1 --2- 172.21.15.77:0/3427832598 >> v2:172.21.15.77:3300/0 conn(0x7ff4b40cd6d0 0x7ff4b4161420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:39:35.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:35.606+0000 7ff4b37fe640 1 -- 172.21.15.77:0/3427832598 >> v2:172.21.15.122:3300/0 conn(0x7ff4b4153e60 msgr2=0x7ff4b415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-04T01:39:35.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:35.606+0000 7ff4b37fe640 1 -- 172.21.15.77:0/3427832598 >> v2:172.21.15.122:3300/0 conn(0x7ff4b4153e60 msgr2=0x7ff4b415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:39:35.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:35.606+0000 7ff4b37fe640 1 --2- 172.21.15.77:0/3427832598 >> v2:172.21.15.122:3300/0 conn(0x7ff4b4153e60 0x7ff4b415dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:39:35.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:35.606+0000 7ff4b37fe640 1 --2- 172.21.15.77:0/3427832598 >> v2:172.21.15.122:3300/0 conn(0x7ff4b4153e60 0x7ff4b415dec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:39:35.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:35.807+0000 7ff4b2ffd640 1 --2- 172.21.15.77:0/3427832598 >> v2:172.21.15.77:3300/0 conn(0x7ff4b40cd6d0 0x7ff4b4161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:35.807+0000 7ff4b2ffd640 1 -- 172.21.15.77:0/3427832598 >> v2:172.21.15.77:3300/0 conn(0x7ff4b40cd6d0 msgr2=0x7ff4b4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-04T01:39:35.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:35.807+0000 7ff4b2ffd640 1 -- 172.21.15.77:0/3427832598 >> v2:172.21.15.77:3300/0 conn(0x7ff4b40cd6d0 msgr2=0x7ff4b4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:39:35.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:35.807+0000 7ff4b2ffd640 1 --2- 172.21.15.77:0/3427832598 >> v2:172.21.15.77:3300/0 conn(0x7ff4b40cd6d0 0x7ff4b4161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:39:35.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:35.807+0000 7ff4b2ffd640 1 --2- 172.21.15.77:0/3427832598 >> v2:172.21.15.77:3300/0 conn(0x7ff4b40cd6d0 0x7ff4b4161420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:39:35.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:35.807+0000 7ff4b37fe640 1 --2- 172.21.15.77:0/3427832598 >> v2:172.21.15.122:3300/0 conn(0x7ff4b4153e60 0x7ff4b415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:35.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:35.807+0000 7ff4b37fe640 1 -- 172.21.15.77:0/3427832598 >> v2:172.21.15.122:3300/0 conn(0x7ff4b4153e60 msgr2=0x7ff4b415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-04T01:39:35.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:35.807+0000 7ff4b37fe640 1 -- 172.21.15.77:0/3427832598 >> v2:172.21.15.122:3300/0 conn(0x7ff4b4153e60 msgr2=0x7ff4b415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:39:35.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:35.807+0000 7ff4b37fe640 1 --2- 172.21.15.77:0/3427832598 >> v2:172.21.15.122:3300/0 conn(0x7ff4b4153e60 0x7ff4b415dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:39:35.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:35.807+0000 7ff4b37fe640 1 --2- 172.21.15.77:0/3427832598 >> v2:172.21.15.122:3300/0 conn(0x7ff4b4153e60 0x7ff4b415dec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:39:36.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:36.208+0000 7ff4b2ffd640 1 --2- 172.21.15.77:0/3427832598 >> v2:172.21.15.77:3300/0 conn(0x7ff4b40cd6d0 0x7ff4b4161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:36.208+0000 7ff4b2ffd640 1 -- 172.21.15.77:0/3427832598 >> v2:172.21.15.77:3300/0 conn(0x7ff4b40cd6d0 msgr2=0x7ff4b4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-04T01:39:36.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:36.208+0000 7ff4b2ffd640 1 -- 172.21.15.77:0/3427832598 >> v2:172.21.15.77:3300/0 conn(0x7ff4b40cd6d0 msgr2=0x7ff4b4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:39:36.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:36.208+0000 7ff4b2ffd640 1 --2- 172.21.15.77:0/3427832598 >> v2:172.21.15.77:3300/0 conn(0x7ff4b40cd6d0 0x7ff4b4161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:39:36.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:36.208+0000 7ff4b2ffd640 1 --2- 172.21.15.77:0/3427832598 >> v2:172.21.15.77:3300/0 conn(0x7ff4b40cd6d0 0x7ff4b4161420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:39:36.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:36.208+0000 7ff4b37fe640 1 --2- 172.21.15.77:0/3427832598 >> v2:172.21.15.122:3300/0 conn(0x7ff4b4153e60 0x7ff4b415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:36.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:36.208+0000 7ff4b37fe640 1 -- 172.21.15.77:0/3427832598 >> v2:172.21.15.122:3300/0 conn(0x7ff4b4153e60 msgr2=0x7ff4b415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-04T01:39:36.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:36.208+0000 7ff4b37fe640 1 -- 172.21.15.77:0/3427832598 >> v2:172.21.15.122:3300/0 conn(0x7ff4b4153e60 msgr2=0x7ff4b415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:39:36.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:36.208+0000 7ff4b37fe640 1 --2- 172.21.15.77:0/3427832598 >> v2:172.21.15.122:3300/0 conn(0x7ff4b4153e60 0x7ff4b415dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:39:36.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:36.208+0000 7ff4b37fe640 1 --2- 172.21.15.77:0/3427832598 >> v2:172.21.15.122:3300/0 conn(0x7ff4b4153e60 0x7ff4b415dec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:39:37.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:37.009+0000 7ff4b2ffd640 1 --2- 172.21.15.77:0/3427832598 >> v2:172.21.15.77:3300/0 conn(0x7ff4b40cd6d0 0x7ff4b4161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:37.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:37.009+0000 7ff4b2ffd640 1 -- 172.21.15.77:0/3427832598 >> v2:172.21.15.77:3300/0 conn(0x7ff4b40cd6d0 msgr2=0x7ff4b4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-04T01:39:37.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:37.009+0000 7ff4b2ffd640 1 -- 172.21.15.77:0/3427832598 >> v2:172.21.15.77:3300/0 conn(0x7ff4b40cd6d0 msgr2=0x7ff4b4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:39:37.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:37.009+0000 7ff4b2ffd640 1 --2- 172.21.15.77:0/3427832598 >> v2:172.21.15.77:3300/0 conn(0x7ff4b40cd6d0 0x7ff4b4161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:39:37.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:37.009+0000 7ff4b2ffd640 1 --2- 172.21.15.77:0/3427832598 >> v2:172.21.15.77:3300/0 conn(0x7ff4b40cd6d0 0x7ff4b4161420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:39:37.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:37.009+0000 7ff4b37fe640 1 --2- 172.21.15.77:0/3427832598 >> v2:172.21.15.122:3300/0 conn(0x7ff4b4153e60 0x7ff4b415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:37.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:37.009+0000 7ff4b37fe640 1 -- 172.21.15.77:0/3427832598 >> v2:172.21.15.122:3300/0 conn(0x7ff4b4153e60 msgr2=0x7ff4b415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-04T01:39:37.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:37.009+0000 7ff4b37fe640 1 -- 172.21.15.77:0/3427832598 >> v2:172.21.15.122:3300/0 conn(0x7ff4b4153e60 msgr2=0x7ff4b415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:39:37.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:37.009+0000 7ff4b37fe640 1 --2- 172.21.15.77:0/3427832598 >> v2:172.21.15.122:3300/0 conn(0x7ff4b4153e60 0x7ff4b415dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:39:37.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:37.009+0000 7ff4b37fe640 1 --2- 172.21.15.77:0/3427832598 >> v2:172.21.15.122:3300/0 conn(0x7ff4b4153e60 0x7ff4b415dec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:39:38.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:38.606+0000 7ff4b17fa640 1 -- 172.21.15.77:0/3427832598 >> v2:172.21.15.122:3300/0 conn(0x7ff4b4153e60 msgr2=0x7ff4b415dec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:39:38.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:38.606+0000 7ff4b17fa640 1 --2- 172.21.15.77:0/3427832598 >> v2:172.21.15.122:3300/0 conn(0x7ff4b4153e60 0x7ff4b415dec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:38.606+0000 7ff4b17fa640 1 -- 172.21.15.77:0/3427832598 >> v2:172.21.15.77:3300/0 conn(0x7ff4b40cd6d0 msgr2=0x7ff4b4161420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:39:38.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:38.606+0000 7ff4b17fa640 1 --2- 172.21.15.77:0/3427832598 >> v2:172.21.15.77:3300/0 conn(0x7ff4b40cd6d0 0x7ff4b4161420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:38.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:38.606+0000 7ff4b17fa640 1 -- 172.21.15.77:0/3427832598 >> v1:172.21.15.77:6789/0 conn(0x7ff4b40b4880 legacy=0x7ff4b406b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:38.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:38.606+0000 7ff4b17fa640 1 --2- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4a0003690 0x7ff4a0005ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:38.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:38.606+0000 7ff4b17fa640 1 -- 172.21.15.77:0/3427832598 --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b4161960 con 0x7ff4a0006150 2023-11-04T01:39:38.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:38.606+0000 7ff4b17fa640 1 -- 172.21.15.77:0/3427832598 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b4160f90 con 0x7ff4a0003690 2023-11-04T01:39:38.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:38.606+0000 7ff4b37fe640 1 --2- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4a0003690 0x7ff4a0005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:38.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:38.606+0000 7ff4b37fe640 1 -- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4a0003690 msgr2=0x7ff4a0005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-04T01:39:38.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:38.606+0000 7ff4b37fe640 1 -- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4a0003690 msgr2=0x7ff4a0005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:39:38.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:38.606+0000 7ff4b37fe640 1 --2- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4a0003690 0x7ff4a0005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:39:38.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:38.606+0000 7ff4b37fe640 1 --2- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4a0003690 0x7ff4a0005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:39:38.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:38.807+0000 7ff4b37fe640 1 --2- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4a0003690 0x7ff4a0005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:38.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:38.807+0000 7ff4b37fe640 1 -- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4a0003690 msgr2=0x7ff4a0005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-04T01:39:38.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:38.807+0000 7ff4b37fe640 1 -- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4a0003690 msgr2=0x7ff4a0005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:39:38.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:38.807+0000 7ff4b37fe640 1 --2- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4a0003690 0x7ff4a0005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:39:38.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:38.807+0000 7ff4b37fe640 1 --2- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4a0003690 0x7ff4a0005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:39:39.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:39.208+0000 7ff4b37fe640 1 --2- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4a0003690 0x7ff4a0005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:39.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:39.208+0000 7ff4b37fe640 1 -- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4a0003690 msgr2=0x7ff4a0005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-04T01:39:39.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:39.208+0000 7ff4b37fe640 1 -- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4a0003690 msgr2=0x7ff4a0005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:39:39.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:39.208+0000 7ff4b37fe640 1 --2- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4a0003690 0x7ff4a0005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:39:39.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:39.208+0000 7ff4b37fe640 1 --2- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4a0003690 0x7ff4a0005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:39:40.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.009+0000 7ff4b37fe640 1 --2- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4a0003690 0x7ff4a0005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:40.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.010+0000 7ff4b37fe640 1 -- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4a0003690 msgr2=0x7ff4a0005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-04T01:39:40.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.010+0000 7ff4b37fe640 1 -- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4a0003690 msgr2=0x7ff4a0005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:39:40.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.010+0000 7ff4b37fe640 1 --2- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4a0003690 0x7ff4a0005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:39:40.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.010+0000 7ff4b37fe640 1 --2- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4a0003690 0x7ff4a0005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:39:40.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.809+0000 7ff4b27fc640 1 -- 172.21.15.77:0/3427832598 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3250823415 0 0) 0x7ff4b4161960 con 0x7ff4a0006150 2023-11-04T01:39:40.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.809+0000 7ff4b27fc640 1 -- 172.21.15.77:0/3427832598 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff49c003520 con 0x7ff4a0006150 2023-11-04T01:39:40.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.809+0000 7ff4b27fc640 1 -- 172.21.15.77:0/3427832598 <== mon.1 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4274482521 0 0) 0x7ff49c003520 con 0x7ff4a0006150 2023-11-04T01:39:40.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.809+0000 7ff4b27fc640 1 -- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4a0003690 msgr2=0x7ff4a0005ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:39:40.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.809+0000 7ff4b27fc640 1 --2- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4a0003690 0x7ff4a0005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.809+0000 7ff4b27fc640 1 -- 172.21.15.77:0/3427832598 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a000b000 con 0x7ff4a0006150 2023-11-04T01:39:40.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.809+0000 7ff4b27fc640 1 -- 172.21.15.77:0/3427832598 <== mon.1 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7ff4a800d580 con 0x7ff4a0006150 2023-11-04T01:39:40.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.809+0000 7ff4b27fc640 1 -- 172.21.15.77:0/3427832598 >> v1:172.21.15.122:6789/0 conn(0x7ff4a0006150 legacy=0x7ff4a0008610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:40.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.809+0000 7ff4b3fff640 1 -- 172.21.15.77:0/3427832598 reap_dead start 2023-11-04T01:39:40.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.809+0000 7ff4b27fc640 1 --2- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff49c003970 0x7ff49c003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:40.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.809+0000 7ff4b27fc640 1 --2- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff49c0047c0 0x7ff49c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:40.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.809+0000 7ff4b27fc640 1 --2- 172.21.15.77:0/3427832598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff49c005250 0x7ff49c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:40.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.809+0000 7ff4b27fc640 1 -- 172.21.15.77:0/3427832598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b4160f90 con 0x7ff49c005250 2023-11-04T01:39:40.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.809+0000 7ff4b27fc640 1 -- 172.21.15.77:0/3427832598 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c00c1a0 con 0x7ff49c0047c0 2023-11-04T01:39:40.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.810+0000 7ff4b27fc640 1 -- 172.21.15.77:0/3427832598 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c00c360 con 0x7ff49c003970 2023-11-04T01:39:40.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.810+0000 7ff4b3fff640 1 --2- 172.21.15.77:0/3427832598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff49c005250 0x7ff49c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:40.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.810+0000 7ff4b2ffd640 1 --2- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff49c0047c0 0x7ff49c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:40.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.810+0000 7ff4b37fe640 1 --2- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff49c003970 0x7ff49c003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:40.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.810+0000 7ff4b37fe640 1 -- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff49c003970 msgr2=0x7ff49c003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-04T01:39:40.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.810+0000 7ff4b37fe640 1 -- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff49c003970 msgr2=0x7ff49c003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:39:40.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.810+0000 7ff4b37fe640 1 --2- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff49c003970 0x7ff49c003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:39:40.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.810+0000 7ff4b37fe640 1 --2- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff49c003970 0x7ff49c003d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:39:40.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.810+0000 7ff4b3fff640 1 -- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff49c003970 msgr2=0x7ff49c003d70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:39:40.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.810+0000 7ff4b3fff640 1 --2- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff49c003970 0x7ff49c003d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.810+0000 7ff4b3fff640 1 -- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff49c0047c0 msgr2=0x7ff49c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:40.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.810+0000 7ff4b3fff640 1 --2- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff49c0047c0 0x7ff49c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.810+0000 7ff4b3fff640 1 -- 172.21.15.77:0/3427832598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49c003520 con 0x7ff49c005250 2023-11-04T01:39:40.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.810+0000 7ff4b2ffd640 1 --2- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff49c0047c0 0x7ff49c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:40.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.811+0000 7ff4b3fff640 1 --2- 172.21.15.77:0/3427832598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff49c005250 0x7ff49c00b980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff4b406c930 tx=0x7ff49c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ee559d9eb473a6b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:40.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.811+0000 7ff4b27fc640 1 -- 172.21.15.77:0/3427832598 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac02d620 con 0x7ff49c005250 2023-11-04T01:39:40.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.811+0000 7ff4b27fc640 1 -- 172.21.15.77:0/3427832598 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac02d780 con 0x7ff49c005250 2023-11-04T01:39:40.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.811+0000 7ff4b27fc640 1 -- 172.21.15.77:0/3427832598 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac02db30 con 0x7ff49c005250 2023-11-04T01:39:40.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.812+0000 7ff4b9ac2640 1 -- 172.21.15.77:0/3427832598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff49c005250 msgr2=0x7ff49c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:40.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.812+0000 7ff4b9ac2640 1 --2- 172.21.15.77:0/3427832598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff49c005250 0x7ff49c00b980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff4b406c930 tx=0x7ff49c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.812+0000 7ff4b9ac2640 1 -- 172.21.15.77:0/3427832598 shutdown_connections 2023-11-04T01:39:40.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.812+0000 7ff4b9ac2640 1 --2- 172.21.15.77:0/3427832598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff49c005250 0x7ff49c00b980 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.812+0000 7ff4b9ac2640 1 --2- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff49c0047c0 0x7ff49c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.812+0000 7ff4b9ac2640 1 --2- 172.21.15.77:0/3427832598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff49c003970 0x7ff49c003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.812+0000 7ff4b9ac2640 1 -- 172.21.15.77:0/3427832598 >> 172.21.15.77:0/3427832598 conn(0x7ff4b40cf880 msgr2=0x7ff4b40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:40.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.812+0000 7ff4b9ac2640 1 -- 172.21.15.77:0/3427832598 shutdown_connections 2023-11-04T01:39:40.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.812+0000 7ff4b9ac2640 1 -- 172.21.15.77:0/3427832598 wait complete. 2023-11-04T01:39:40.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.814+0000 7ff4b9ac2640 1 Processor -- start 2023-11-04T01:39:40.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.815+0000 7ff4b9ac2640 1 -- start start 2023-11-04T01:39:40.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.816+0000 7ff4b9ac2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff49c003970 0x7ff4b40cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:40.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.816+0000 7ff4b9ac2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff49c0047c0 0x7ff4b40c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:40.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.816+0000 7ff4b9ac2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff49c005250 0x7ff4b40ca630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:40.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.816+0000 7ff4b9ac2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b41f22e0 con 0x7ff49c003970 2023-11-04T01:39:40.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.816+0000 7ff4b9ac2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b40ca410 con 0x7ff49c0047c0 2023-11-04T01:39:40.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.816+0000 7ff4b9ac2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b40ccbd0 con 0x7ff49c005250 2023-11-04T01:39:40.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.816+0000 7ff4b37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff49c003970 0x7ff4b40cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:40.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.816+0000 7ff4b37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff49c003970 0x7ff4b40cc5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41572/0 (socket says 172.21.15.77:41572) 2023-11-04T01:39:40.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.816+0000 7ff4b37fe640 1 -- 172.21.15.77:0/1283304525 learned_addr learned my addr 172.21.15.77:0/1283304525 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:39:40.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.816+0000 7ff4b3fff640 1 --2- 172.21.15.77:0/1283304525 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff49c005250 0x7ff4b40ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:40.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.816+0000 7ff4b2ffd640 1 --2- 172.21.15.77:0/1283304525 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff49c0047c0 0x7ff4b40c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:40.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.816+0000 7ff4b3fff640 1 -- 172.21.15.77:0/1283304525 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff49c005250 msgr2=0x7ff4b40ca630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-11-04T01:39:40.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.816+0000 7ff4b3fff640 1 -- 172.21.15.77:0/1283304525 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff49c005250 msgr2=0x7ff4b40ca630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-04T01:39:40.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.816+0000 7ff4b3fff640 1 --2- 172.21.15.77:0/1283304525 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff49c005250 0x7ff4b40ca630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:39:40.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.816+0000 7ff4b3fff640 1 --2- 172.21.15.77:0/1283304525 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff49c005250 0x7ff4b40ca630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:39:40.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.816+0000 7ff4b37fe640 1 -- 172.21.15.77:0/1283304525 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff49c005250 msgr2=0x7ff4b40ca630 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-04T01:39:40.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.816+0000 7ff4b37fe640 1 --2- 172.21.15.77:0/1283304525 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff49c005250 0x7ff4b40ca630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.816+0000 7ff4b37fe640 1 -- 172.21.15.77:0/1283304525 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff49c0047c0 msgr2=0x7ff4b40c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:40.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.816+0000 7ff4b37fe640 1 --2- 172.21.15.77:0/1283304525 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff49c0047c0 0x7ff4b40c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.816+0000 7ff4b37fe640 1 -- 172.21.15.77:0/1283304525 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b40cceb0 con 0x7ff49c003970 2023-11-04T01:39:40.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.817+0000 7ff4b37fe640 1 --2- 172.21.15.77:0/1283304525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff49c003970 0x7ff4b40cc5f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4017a60 tx=0x7ff4a4017f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:40.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.817+0000 7ff49bfff640 1 -- 172.21.15.77:0/1283304525 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a401f070 con 0x7ff49c003970 2023-11-04T01:39:40.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.817+0000 7ff49bfff640 1 -- 172.21.15.77:0/1283304525 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a401a2e0 con 0x7ff49c003970 2023-11-04T01:39:40.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.817+0000 7ff4b9ac2640 1 -- 172.21.15.77:0/1283304525 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b41553c0 con 0x7ff49c003970 2023-11-04T01:39:40.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.817+0000 7ff49bfff640 1 -- 172.21.15.77:0/1283304525 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a40169b0 con 0x7ff49c003970 2023-11-04T01:39:40.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.817+0000 7ff4b9ac2640 1 -- 172.21.15.77:0/1283304525 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b40cd190 con 0x7ff49c003970 2023-11-04T01:39:40.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.817+0000 7ff49bfff640 1 -- 172.21.15.77:0/1283304525 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff4a4016b10 con 0x7ff49c003970 2023-11-04T01:39:40.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.817+0000 7ff49bfff640 1 -- 172.21.15.77:0/1283304525 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff4a402d780 con 0x7ff49c003970 2023-11-04T01:39:40.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.818+0000 7ff4b9ac2640 1 -- 172.21.15.77:0/1283304525 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b4074290 con 0x7ff49c003970 2023-11-04T01:39:40.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.820+0000 7ff49bfff640 1 -- 172.21.15.77:0/1283304525 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7ff4a4018ca0 con 0x7ff49c003970 2023-11-04T01:39:40.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.885+0000 7ff4b9ac2640 1 -- 172.21.15.77:0/1283304525 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff4b40d0b80 con 0x7ff49c003970 2023-11-04T01:39:40.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.886+0000 7ff49bfff640 1 -- 172.21.15.77:0/1283304525 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff4a4018e40 con 0x7ff49c003970 2023-11-04T01:39:40.888 INFO:teuthology.orchestra.run.smithi077.stderr:adjusted tunables profile to default 2023-11-04T01:39:40.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.887+0000 7ff4b9ac2640 1 -- 172.21.15.77:0/1283304525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff49c003970 msgr2=0x7ff4b40cc5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:40.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.887+0000 7ff4b9ac2640 1 --2- 172.21.15.77:0/1283304525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff49c003970 0x7ff4b40cc5f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4017a60 tx=0x7ff4a4017f20 comp rx=0 tx=0).stop 2023-11-04T01:39:40.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.887+0000 7ff4b9ac2640 1 -- 172.21.15.77:0/1283304525 shutdown_connections 2023-11-04T01:39:40.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.887+0000 7ff4b9ac2640 1 --2- 172.21.15.77:0/1283304525 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff49c005250 0x7ff4b40ca630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.887+0000 7ff4b9ac2640 1 --2- 172.21.15.77:0/1283304525 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff49c0047c0 0x7ff4b40c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.887+0000 7ff4b9ac2640 1 --2- 172.21.15.77:0/1283304525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff49c003970 0x7ff4b40cc5f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:40.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.887+0000 7ff4b9ac2640 1 -- 172.21.15.77:0/1283304525 >> 172.21.15.77:0/1283304525 conn(0x7ff4b40cf880 msgr2=0x7ff4b40d10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:40.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.887+0000 7ff4b9ac2640 1 -- 172.21.15.77:0/1283304525 shutdown_connections 2023-11-04T01:39:40.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:40.887+0000 7ff4b9ac2640 1 -- 172.21.15.77:0/1283304525 wait complete. 2023-11-04T01:39:40.900 INFO:tasks.ceph:check_enable_crimson: False 2023-11-04T01:39:40.901 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-04T01:39:40.901 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:39:40.901 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-04T01:39:40.929 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:39:40.929 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-04T01:39:40.996 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:39:40.996 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-04T01:39:41.063 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:39:41.063 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-04T01:39:41.130 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:39:41.130 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-04T01:39:41.162 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:39:41.162 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-04T01:39:41.231 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:39:41.231 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-04T01:39:41.300 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:39:41.300 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-04T01:39:41.368 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd new 5517da9d-7a6c-4828-b78b-ec771446406c 0 2023-11-04T01:39:41.508 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.506+0000 7f18a72d4640 1 Processor -- start 2023-11-04T01:39:41.508 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.506+0000 7f18a72d4640 1 -- start start 2023-11-04T01:39:41.512 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.507+0000 7f18a72d4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f18a01605b0 0x7f18a00ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:41.513 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.507+0000 7f18a72d4640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f18a00b1a40 0x7f18a006a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:41.513 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.507+0000 7f18a72d4640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a0160990 con 0x7f18a00ca560 2023-11-04T01:39:41.513 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.507+0000 7f18a72d4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18a00cc7c0 con 0x7f18a01605b0 2023-11-04T01:39:41.513 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.507+0000 7f18a72d4640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a00cd750 con 0x7f18a00b1a40 2023-11-04T01:39:41.513 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.507+0000 7f18a486f640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f18a00b1a40 0x7f18a006a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:41.514 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.507+0000 7f18a5871640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f18a00ca560 0x7f18a0160be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:52938/0 (socket says 172.21.15.122:52938) 2023-11-04T01:39:41.514 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.507+0000 7f18a5871640 1 -- 172.21.15.122:0/346167498 learned_addr learned my addr 172.21.15.122:0/346167498 (peer_addr_for_me v1:172.21.15.122:0/0) 2023-11-04T01:39:41.514 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.507+0000 7f18a486f640 1 -- 172.21.15.122:0/346167498 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f18a00b1a40 msgr2=0x7f18a006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-04T01:39:41.515 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.507+0000 7f18a486f640 1 -- 172.21.15.122:0/346167498 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f18a00b1a40 msgr2=0x7f18a006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:39:41.515 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.507+0000 7f18a486f640 1 --2- 172.21.15.122:0/346167498 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f18a00b1a40 0x7f18a006a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:39:41.515 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.507+0000 7f18a486f640 1 --2- 172.21.15.122:0/346167498 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f18a00b1a40 0x7f18a006a120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:39:41.515 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.507+0000 7f1897fff640 1 -- 172.21.15.122:0/346167498 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2387580456 0 0) 0x7f18a0160990 con 0x7f18a00ca560 2023-11-04T01:39:41.515 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.507+0000 7f1897fff640 1 -- 172.21.15.122:0/346167498 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f188c003520 con 0x7f18a00ca560 2023-11-04T01:39:41.516 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.507+0000 7f18a5070640 1 --2- 172.21.15.122:0/346167498 >> v2:172.21.15.77:3300/0 conn(0x7f18a01605b0 0x7f18a00ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:41.516 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.508+0000 7f1897fff640 1 -- 172.21.15.122:0/346167498 <== mon.1 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2343605318 0 0) 0x7f188c003520 con 0x7f18a00ca560 2023-11-04T01:39:41.516 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.508+0000 7f1897fff640 1 -- 172.21.15.122:0/346167498 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f18a00b1a40 msgr2=0x7f18a006a120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:39:41.516 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.508+0000 7f1897fff640 1 --2- 172.21.15.122:0/346167498 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f18a00b1a40 0x7f18a006a120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.517 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.508+0000 7f1897fff640 1 -- 172.21.15.122:0/346167498 >> v2:172.21.15.77:3300/0 conn(0x7f18a01605b0 msgr2=0x7f18a00ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:41.517 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.508+0000 7f1897fff640 1 --2- 172.21.15.122:0/346167498 >> v2:172.21.15.77:3300/0 conn(0x7f18a01605b0 0x7f18a00ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.517 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.508+0000 7f1897fff640 1 -- 172.21.15.122:0/346167498 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a00cc4e0 con 0x7f18a00ca560 2023-11-04T01:39:41.517 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.508+0000 7f1897fff640 1 -- 172.21.15.122:0/346167498 <== mon.1 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f18980019f0 con 0x7f18a00ca560 2023-11-04T01:39:41.517 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.508+0000 7f1897fff640 1 -- 172.21.15.122:0/346167498 >> v1:172.21.15.122:6789/0 conn(0x7f18a00ca560 legacy=0x7f18a0160be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:41.518 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.508+0000 7f1897fff640 1 --2- 172.21.15.122:0/346167498 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f188c003970 0x7f188c003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:41.518 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.508+0000 7f1897fff640 1 --2- 172.21.15.122:0/346167498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f188c0042d0 0x7f188c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:41.518 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.508+0000 7f1897fff640 1 --2- 172.21.15.122:0/346167498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f188c004f60 0x7f188c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:41.518 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.508+0000 7f1897fff640 1 -- 172.21.15.122:0/346167498 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a00cc7c0 con 0x7f188c004f60 2023-11-04T01:39:41.518 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.508+0000 7f1897fff640 1 -- 172.21.15.122:0/346167498 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a00cd750 con 0x7f188c0042d0 2023-11-04T01:39:41.519 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.508+0000 7f1897fff640 1 -- 172.21.15.122:0/346167498 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188c00bef0 con 0x7f188c003970 2023-11-04T01:39:41.519 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.508+0000 7f18a486f640 1 --2- 172.21.15.122:0/346167498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f188c0042d0 0x7f188c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:41.519 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.508+0000 7f18a5070640 1 --2- 172.21.15.122:0/346167498 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f188c003970 0x7f188c003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:41.519 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.508+0000 7f18a5871640 1 --2- 172.21.15.122:0/346167498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f188c004f60 0x7f188c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:41.519 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.508+0000 7f18a5070640 1 -- 172.21.15.122:0/346167498 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f188c003970 msgr2=0x7f188c003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-04T01:39:41.520 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.508+0000 7f18a5070640 1 -- 172.21.15.122:0/346167498 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f188c003970 msgr2=0x7f188c003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:39:41.520 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.508+0000 7f18a5070640 1 --2- 172.21.15.122:0/346167498 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f188c003970 0x7f188c003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:39:41.520 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.508+0000 7f18a5070640 1 --2- 172.21.15.122:0/346167498 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f188c003970 0x7f188c003d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:39:41.520 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.508+0000 7f18a486f640 1 -- 172.21.15.122:0/346167498 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f188c003970 msgr2=0x7f188c003d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:39:41.520 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.508+0000 7f18a486f640 1 --2- 172.21.15.122:0/346167498 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f188c003970 0x7f188c003d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.521 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.508+0000 7f18a486f640 1 -- 172.21.15.122:0/346167498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f188c004f60 msgr2=0x7f188c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:41.521 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.508+0000 7f18a486f640 1 --2- 172.21.15.122:0/346167498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f188c004f60 0x7f188c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.521 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.508+0000 7f18a486f640 1 -- 172.21.15.122:0/346167498 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188c003520 con 0x7f188c0042d0 2023-11-04T01:39:41.521 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.508+0000 7f18a5871640 1 --2- 172.21.15.122:0/346167498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f188c004f60 0x7f188c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:41.521 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.509+0000 7f18a486f640 1 --2- 172.21.15.122:0/346167498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f188c0042d0 0x7f188c0047c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f189000b9e0 tx=0x7f188c0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e58503cce9687c2d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:41.522 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.509+0000 7f1897fff640 1 -- 172.21.15.122:0/346167498 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1890032620 con 0x7f188c0042d0 2023-11-04T01:39:41.522 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.509+0000 7f1897fff640 1 -- 172.21.15.122:0/346167498 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1890032780 con 0x7f188c0042d0 2023-11-04T01:39:41.522 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.509+0000 7f1897fff640 1 -- 172.21.15.122:0/346167498 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1890032b30 con 0x7f188c0042d0 2023-11-04T01:39:41.522 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.509+0000 7f18a72d4640 1 -- 172.21.15.122:0/346167498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f188c0042d0 msgr2=0x7f188c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:41.522 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.509+0000 7f18a72d4640 1 --2- 172.21.15.122:0/346167498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f188c0042d0 0x7f188c0047c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f189000b9e0 tx=0x7f188c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.523 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.509+0000 7f18a5871640 1 -- 172.21.15.122:0/346167498 reap_dead start 2023-11-04T01:39:41.523 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.509+0000 7f18a72d4640 1 -- 172.21.15.122:0/346167498 shutdown_connections 2023-11-04T01:39:41.523 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.509+0000 7f18a72d4640 1 -- 172.21.15.122:0/346167498 >> 172.21.15.122:0/346167498 conn(0x7f18a0071820 msgr2=0x7f18a0071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:41.523 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.509+0000 7f18a72d4640 1 -- 172.21.15.122:0/346167498 shutdown_connections 2023-11-04T01:39:41.523 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.510+0000 7f18a72d4640 1 -- 172.21.15.122:0/346167498 wait complete. 2023-11-04T01:39:41.524 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.511+0000 7f18a72d4640 1 Processor -- start 2023-11-04T01:39:41.524 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.511+0000 7f18a72d4640 1 -- start start 2023-11-04T01:39:41.526 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.511+0000 7f18a72d4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f188c0042d0 0x7f18a01e6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:41.527 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.511+0000 7f18a72d4640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f18a0154210 0x7f18a0154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:41.527 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.511+0000 7f18a72d4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18a015ca00 0x7f18a015ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:41.527 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.511+0000 7f18a72d4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a015d6c0 con 0x7f18a015ca00 2023-11-04T01:39:41.527 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.511+0000 7f18a72d4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a01598a0 con 0x7f188c0042d0 2023-11-04T01:39:41.528 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.511+0000 7f18a72d4640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a0154bd0 con 0x7f18a0154210 2023-11-04T01:39:41.528 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.511+0000 7f18a486f640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f18a0154210 0x7f18a0154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:41.528 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.511+0000 7f18a5070640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f188c0042d0 0x7f18a01e6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:41.528 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.511+0000 7f18a5070640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f188c0042d0 0x7f18a01e6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37686/0 (socket says 172.21.15.122:37686) 2023-11-04T01:39:41.528 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.511+0000 7f18a486f640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f18a0154210 0x7f18a0154690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.122:46032/0 (socket says 172.21.15.122:46032) 2023-11-04T01:39:41.529 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.511+0000 7f18a5070640 1 -- 172.21.15.122:0/2995179603 learned_addr learned my addr 172.21.15.122:0/2995179603 (peer_addr_for_me v2:172.21.15.122:0/0) 2023-11-04T01:39:41.529 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.512+0000 7f18a486f640 1 -- 172.21.15.122:0/2995179603 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f18a0154210 msgr2=0x7f18a0154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-11-04T01:39:41.529 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.512+0000 7f18a486f640 1 -- 172.21.15.122:0/2995179603 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f18a0154210 msgr2=0x7f18a0154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-04T01:39:41.529 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.512+0000 7f18a486f640 1 --2- 172.21.15.122:0/2995179603 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f18a0154210 0x7f18a0154690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:39:41.529 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.512+0000 7f18a486f640 1 --2- 172.21.15.122:0/2995179603 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f18a0154210 0x7f18a0154690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:39:41.530 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.512+0000 7f18a5871640 1 --2- 172.21.15.122:0/2995179603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18a015ca00 0x7f18a015ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:41.530 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.512+0000 7f18a5070640 1 -- 172.21.15.122:0/2995179603 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f18a0154210 msgr2=0x7f18a0154690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-04T01:39:41.530 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.512+0000 7f18a5070640 1 --2- 172.21.15.122:0/2995179603 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f18a0154210 0x7f18a0154690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.530 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.512+0000 7f18a5070640 1 -- 172.21.15.122:0/2995179603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18a015ca00 msgr2=0x7f18a015ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:41.530 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.512+0000 7f18a5070640 1 --2- 172.21.15.122:0/2995179603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18a015ca00 0x7f18a015ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.531 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.512+0000 7f18a5070640 1 -- 172.21.15.122:0/2995179603 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a015a8b0 con 0x7f188c0042d0 2023-11-04T01:39:41.531 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.512+0000 7f18a5871640 1 --2- 172.21.15.122:0/2995179603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18a015ca00 0x7f18a015ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:41.531 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.512+0000 7f18a5070640 1 --2- 172.21.15.122:0/2995179603 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f188c0042d0 0x7f18a01e6c40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f189c011650 tx=0x7f189c011b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:41.531 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.512+0000 7f1895ffb640 1 -- 172.21.15.122:0/2995179603 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189c00f9c0 con 0x7f188c0042d0 2023-11-04T01:39:41.531 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.512+0000 7f1895ffb640 1 -- 172.21.15.122:0/2995179603 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189c00fb20 con 0x7f188c0042d0 2023-11-04T01:39:41.532 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.512+0000 7f18a72d4640 1 -- 172.21.15.122:0/2995179603 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a0159af0 con 0x7f188c0042d0 2023-11-04T01:39:41.532 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.512+0000 7f1895ffb640 1 -- 172.21.15.122:0/2995179603 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189c00feb0 con 0x7f188c0042d0 2023-11-04T01:39:41.532 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.512+0000 7f18a72d4640 1 -- 172.21.15.122:0/2995179603 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a015a0b0 con 0x7f188c0042d0 2023-11-04T01:39:41.532 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.512+0000 7f1895ffb640 1 -- 172.21.15.122:0/2995179603 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f189c005990 con 0x7f188c0042d0 2023-11-04T01:39:41.532 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.512+0000 7f1895ffb640 1 -- 172.21.15.122:0/2995179603 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f189c0157a0 con 0x7f188c0042d0 2023-11-04T01:39:41.532 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.513+0000 7f18a72d4640 1 -- 172.21.15.122:0/2995179603 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a00672a0 con 0x7f188c0042d0 2023-11-04T01:39:41.533 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.515+0000 7f1895ffb640 1 -- 172.21.15.122:0/2995179603 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f189c0066e0 con 0x7f188c0042d0 2023-11-04T01:39:41.587 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.586+0000 7f18a72d4640 1 -- 172.21.15.122:0/2995179603 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5517da9d-7a6c-4828-b78b-ec771446406c", "id": 0} v 0) v1 -- 0x7f18a0074290 con 0x7f188c0042d0 2023-11-04T01:39:41.592 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.591+0000 7f1895ffb640 1 -- 172.21.15.122:0/2995179603 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5517da9d-7a6c-4828-b78b-ec771446406c", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f189c005dd0 con 0x7f188c0042d0 2023-11-04T01:39:41.593 INFO:teuthology.orchestra.run.smithi122.stdout:0 2023-11-04T01:39:41.594 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.591+0000 7f18a72d4640 1 -- 172.21.15.122:0/2995179603 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f188c0042d0 msgr2=0x7f18a01e6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:41.594 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.591+0000 7f18a72d4640 1 --2- 172.21.15.122:0/2995179603 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f188c0042d0 0x7f18a01e6c40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f189c011650 tx=0x7f189c011b10 comp rx=0 tx=0).stop 2023-11-04T01:39:41.594 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.592+0000 7f18a72d4640 1 -- 172.21.15.122:0/2995179603 shutdown_connections 2023-11-04T01:39:41.595 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.592+0000 7f18a72d4640 1 --2- 172.21.15.122:0/2995179603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18a015ca00 0x7f18a015ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.595 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.592+0000 7f18a72d4640 1 --2- 172.21.15.122:0/2995179603 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f18a0154210 0x7f18a0154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.595 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.592+0000 7f18a72d4640 1 --2- 172.21.15.122:0/2995179603 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f188c0042d0 0x7f18a01e6c40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.595 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.592+0000 7f18a72d4640 1 -- 172.21.15.122:0/2995179603 >> 172.21.15.122:0/2995179603 conn(0x7f18a0071820 msgr2=0x7f18a00b08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:41.595 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.592+0000 7f18a72d4640 1 -- 172.21.15.122:0/2995179603 shutdown_connections 2023-11-04T01:39:41.596 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.592+0000 7f18a72d4640 1 -- 172.21.15.122:0/2995179603 wait complete. 2023-11-04T01:39:41.604 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd new a44d5169-1315-4e8c-aab9-ef4c8b89ecb3 1 2023-11-04T01:39:41.703 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.701+0000 7fa8e6475640 1 Processor -- start 2023-11-04T01:39:41.703 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.701+0000 7fa8e6475640 1 -- start start 2023-11-04T01:39:41.705 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.702+0000 7fa8e6475640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa8e0159c40 0x7fa8e015e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:41.705 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.702+0000 7fa8e6475640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa8e0070f80 0x7fa8e00713b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:41.705 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.702+0000 7fa8e6475640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8e00718f0 con 0x7fa8e00ceb30 2023-11-04T01:39:41.705 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.702+0000 7fa8e6475640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8e00ce710 con 0x7fa8e0159c40 2023-11-04T01:39:41.706 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.702+0000 7fa8e6475640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8e00cb410 con 0x7fa8e0070f80 2023-11-04T01:39:41.706 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.702+0000 7fa8e4a12640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa8e0070f80 0x7fa8e00713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:41.706 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.703+0000 7fa8e4a12640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa8e0070f80 0x7fa8e00713b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37698/0 (socket says 172.21.15.122:37698) 2023-11-04T01:39:41.706 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.703+0000 7fa8e4a12640 1 -- 172.21.15.122:0/1580079980 learned_addr learned my addr 172.21.15.122:0/1580079980 (peer_addr_for_me v2:172.21.15.122:0/0) 2023-11-04T01:39:41.706 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.703+0000 7fa8dffff640 1 --2- 172.21.15.122:0/1580079980 >> v2:172.21.15.77:3300/0 conn(0x7fa8e0159c40 0x7fa8e015e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:41.707 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.703+0000 7fa8e4a12640 1 -- 172.21.15.122:0/1580079980 >> v2:172.21.15.77:3300/0 conn(0x7fa8e0159c40 msgr2=0x7fa8e015e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:41.707 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.703+0000 7fa8e4a12640 1 --2- 172.21.15.122:0/1580079980 >> v2:172.21.15.77:3300/0 conn(0x7fa8e0159c40 0x7fa8e015e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.707 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.703+0000 7fa8e4a12640 1 -- 172.21.15.122:0/1580079980 >> v1:172.21.15.77:6789/0 conn(0x7fa8e00ceb30 legacy=0x7fa8e00cad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:41.707 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.703+0000 7fa8e4a12640 1 -- 172.21.15.122:0/1580079980 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e00cb5f0 con 0x7fa8e0070f80 2023-11-04T01:39:41.711 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.704+0000 7fa8e4a12640 1 --2- 172.21.15.122:0/1580079980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8e0070f80 0x7fa8e00713b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0070f10 tx=0x7fa8d802e180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6f1c7eabb3425d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:41.711 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.704+0000 7fa8deffd640 1 -- 172.21.15.122:0/1580079980 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d800b0d0 con 0x7fa8e0070f80 2023-11-04T01:39:41.711 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.704+0000 7fa8deffd640 1 -- 172.21.15.122:0/1580079980 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d800b230 con 0x7fa8e0070f80 2023-11-04T01:39:41.711 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.704+0000 7fa8deffd640 1 -- 172.21.15.122:0/1580079980 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d8009600 con 0x7fa8e0070f80 2023-11-04T01:39:41.712 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.705+0000 7fa8e6475640 1 -- 172.21.15.122:0/1580079980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8e0070f80 msgr2=0x7fa8e00713b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:41.712 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.705+0000 7fa8e6475640 1 --2- 172.21.15.122:0/1580079980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8e0070f80 0x7fa8e00713b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0070f10 tx=0x7fa8d802e180 comp rx=0 tx=0).stop 2023-11-04T01:39:41.712 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.705+0000 7fa8e6475640 1 -- 172.21.15.122:0/1580079980 shutdown_connections 2023-11-04T01:39:41.712 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.705+0000 7fa8e6475640 1 --2- 172.21.15.122:0/1580079980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8e0070f80 0x7fa8e00713b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.712 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.705+0000 7fa8e6475640 1 --2- 172.21.15.122:0/1580079980 >> v2:172.21.15.77:3300/0 conn(0x7fa8e0159c40 0x7fa8e015e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.713 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.705+0000 7fa8e6475640 1 -- 172.21.15.122:0/1580079980 >> 172.21.15.122:0/1580079980 conn(0x7fa8e00cf140 msgr2=0x7fa8e00cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:41.713 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.705+0000 7fa8e6475640 1 -- 172.21.15.122:0/1580079980 shutdown_connections 2023-11-04T01:39:41.713 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.705+0000 7fa8e6475640 1 -- 172.21.15.122:0/1580079980 wait complete. 2023-11-04T01:39:41.713 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.706+0000 7fa8e6475640 1 Processor -- start 2023-11-04T01:39:41.713 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.706+0000 7fa8e6475640 1 -- start start 2023-11-04T01:39:41.714 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.707+0000 7fa8e6475640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8e0070f80 0x7fa8e00adec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:41.714 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.707+0000 7fa8e6475640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8e00ceb30 0x7fa8e01505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:41.714 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.707+0000 7fa8e6475640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa8e0159c40 0x7fa8e00ae6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:41.714 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.707+0000 7fa8e6475640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e015c7e0 con 0x7fa8e00ceb30 2023-11-04T01:39:41.714 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.707+0000 7fa8e6475640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e00ac7e0 con 0x7fa8e0070f80 2023-11-04T01:39:41.715 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.707+0000 7fa8e6475640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e00ae400 con 0x7fa8e0159c40 2023-11-04T01:39:41.715 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.707+0000 7fa8dffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8e0070f80 0x7fa8e00adec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:41.715 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.707+0000 7fa8dffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8e0070f80 0x7fa8e00adec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37702/0 (socket says 172.21.15.122:37702) 2023-11-04T01:39:41.715 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.707+0000 7fa8dffff640 1 -- 172.21.15.122:0/3872658520 learned_addr learned my addr 172.21.15.122:0/3872658520 (peer_addr_for_me v2:172.21.15.122:0/0) 2023-11-04T01:39:41.715 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.707+0000 7fa8e4a12640 1 --2- 172.21.15.122:0/3872658520 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa8e0159c40 0x7fa8e00ae6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:41.716 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.707+0000 7fa8df7fe640 1 --2- 172.21.15.122:0/3872658520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8e00ceb30 0x7fa8e01505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:41.716 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.707+0000 7fa8e4a12640 1 -- 172.21.15.122:0/3872658520 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa8e0159c40 msgr2=0x7fa8e00ae6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-11-04T01:39:41.716 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.707+0000 7fa8e4a12640 1 -- 172.21.15.122:0/3872658520 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa8e0159c40 msgr2=0x7fa8e00ae6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-04T01:39:41.716 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.707+0000 7fa8e4a12640 1 --2- 172.21.15.122:0/3872658520 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa8e0159c40 0x7fa8e00ae6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:39:41.716 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.707+0000 7fa8e4a12640 1 --2- 172.21.15.122:0/3872658520 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa8e0159c40 0x7fa8e00ae6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:39:41.717 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.707+0000 7fa8dffff640 1 -- 172.21.15.122:0/3872658520 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa8e0159c40 msgr2=0x7fa8e00ae6d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-04T01:39:41.717 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.707+0000 7fa8dffff640 1 --2- 172.21.15.122:0/3872658520 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa8e0159c40 0x7fa8e00ae6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.717 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.707+0000 7fa8dffff640 1 -- 172.21.15.122:0/3872658520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8e00ceb30 msgr2=0x7fa8e01505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:41.717 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.707+0000 7fa8dffff640 1 --2- 172.21.15.122:0/3872658520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8e00ceb30 0x7fa8e01505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.717 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.707+0000 7fa8dffff640 1 -- 172.21.15.122:0/3872658520 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d800bd40 con 0x7fa8e0070f80 2023-11-04T01:39:41.717 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.707+0000 7fa8df7fe640 1 --2- 172.21.15.122:0/3872658520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8e00ceb30 0x7fa8e01505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:41.718 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.707+0000 7fa8dffff640 1 --2- 172.21.15.122:0/3872658520 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8e0070f80 0x7fa8e00adec0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa8d400e9b0 tx=0x7fa8d400ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:41.718 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.707+0000 7fa8dcff9640 1 -- 172.21.15.122:0/3872658520 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d4009670 con 0x7fa8e0070f80 2023-11-04T01:39:41.718 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.707+0000 7fa8dcff9640 1 -- 172.21.15.122:0/3872658520 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d400c9a0 con 0x7fa8e0070f80 2023-11-04T01:39:41.718 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.708+0000 7fa8e6475640 1 -- 172.21.15.122:0/3872658520 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e00abc60 con 0x7fa8e0070f80 2023-11-04T01:39:41.719 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.708+0000 7fa8dcff9640 1 -- 172.21.15.122:0/3872658520 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d400cd50 con 0x7fa8e0070f80 2023-11-04T01:39:41.719 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.708+0000 7fa8e6475640 1 -- 172.21.15.122:0/3872658520 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e00ac220 con 0x7fa8e0070f80 2023-11-04T01:39:41.719 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.708+0000 7fa8dcff9640 1 -- 172.21.15.122:0/3872658520 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa8d4005c90 con 0x7fa8e0070f80 2023-11-04T01:39:41.719 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.708+0000 7fa8dcff9640 1 -- 172.21.15.122:0/3872658520 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fa8d4013820 con 0x7fa8e0070f80 2023-11-04T01:39:41.719 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.708+0000 7fa8e6475640 1 -- 172.21.15.122:0/3872658520 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8e00674e0 con 0x7fa8e0070f80 2023-11-04T01:39:41.720 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.710+0000 7fa8dcff9640 1 -- 172.21.15.122:0/3872658520 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fa8d4021060 con 0x7fa8e0070f80 2023-11-04T01:39:41.783 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.781+0000 7fa8e6475640 1 -- 172.21.15.122:0/3872658520 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a44d5169-1315-4e8c-aab9-ef4c8b89ecb3", "id": 1} v 0) v1 -- 0x7fa8e00c38d0 con 0x7fa8e0070f80 2023-11-04T01:39:41.790 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.789+0000 7fa8dcff9640 1 -- 172.21.15.122:0/3872658520 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a44d5169-1315-4e8c-aab9-ef4c8b89ecb3", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa8d4017070 con 0x7fa8e0070f80 2023-11-04T01:39:41.791 INFO:teuthology.orchestra.run.smithi122.stdout:1 2023-11-04T01:39:41.792 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.790+0000 7fa8e6475640 1 -- 172.21.15.122:0/3872658520 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8e0070f80 msgr2=0x7fa8e00adec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:41.792 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.790+0000 7fa8e6475640 1 --2- 172.21.15.122:0/3872658520 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8e0070f80 0x7fa8e00adec0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa8d400e9b0 tx=0x7fa8d400ee70 comp rx=0 tx=0).stop 2023-11-04T01:39:41.792 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.790+0000 7fa8e6475640 1 -- 172.21.15.122:0/3872658520 shutdown_connections 2023-11-04T01:39:41.792 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.790+0000 7fa8e6475640 1 --2- 172.21.15.122:0/3872658520 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa8e0159c40 0x7fa8e00ae6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.793 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.790+0000 7fa8e6475640 1 --2- 172.21.15.122:0/3872658520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8e00ceb30 0x7fa8e01505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.793 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.790+0000 7fa8e6475640 1 --2- 172.21.15.122:0/3872658520 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa8e0070f80 0x7fa8e00adec0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.793 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.790+0000 7fa8e6475640 1 -- 172.21.15.122:0/3872658520 >> 172.21.15.122:0/3872658520 conn(0x7fa8e00cf140 msgr2=0x7fa8e00ccfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:41.793 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.790+0000 7fa8e6475640 1 -- 172.21.15.122:0/3872658520 shutdown_connections 2023-11-04T01:39:41.793 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.790+0000 7fa8e6475640 1 -- 172.21.15.122:0/3872658520 wait complete. 2023-11-04T01:39:41.802 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd new 0fa83dc2-4041-4dc3-83cf-f2bcae58b642 2 2023-11-04T01:39:41.902 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.900+0000 7f55d90c2640 1 Processor -- start 2023-11-04T01:39:41.902 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.900+0000 7f55d90c2640 1 -- start start 2023-11-04T01:39:41.906 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.900+0000 7f55d90c2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f55d415e590 0x7f55d40ae770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:41.906 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.900+0000 7f55d90c2640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55d40ca620 con 0x7f55d406a830 2023-11-04T01:39:41.906 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.900+0000 7f55d90c2640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55d40ca060 con 0x7f55d415e1b0 2023-11-04T01:39:41.906 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.900+0000 7f55d90c2640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55d406e7e0 con 0x7f55d415e590 2023-11-04T01:39:41.907 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.901+0000 7f55d2d9d640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f55d415e1b0 0x7f55d406a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:52964/0 (socket says 172.21.15.122:52964) 2023-11-04T01:39:41.907 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.901+0000 7f55d2d9d640 1 -- 172.21.15.122:0/3346396381 learned_addr learned my addr 172.21.15.122:0/3346396381 (peer_addr_for_me v1:172.21.15.122:0/0) 2023-11-04T01:39:41.907 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.901+0000 7f55d359e640 1 --2- 172.21.15.122:0/3346396381 >> v2:172.21.15.77:3300/0 conn(0x7f55d415e590 0x7f55d40ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:41.907 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.901+0000 7f55d1d9b640 1 -- 172.21.15.122:0/3346396381 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3570894763 0 0) 0x7f55d40ca060 con 0x7f55d415e1b0 2023-11-04T01:39:41.907 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.901+0000 7f55d1d9b640 1 -- 172.21.15.122:0/3346396381 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55bc003520 con 0x7f55d415e1b0 2023-11-04T01:39:41.907 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.901+0000 7f55d1d9b640 1 -- 172.21.15.122:0/3346396381 <== mon.1 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3443827133 0 0) 0x7f55bc003520 con 0x7f55d415e1b0 2023-11-04T01:39:41.908 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.901+0000 7f55d1d9b640 1 -- 172.21.15.122:0/3346396381 >> v2:172.21.15.77:3300/0 conn(0x7f55d415e590 msgr2=0x7f55d40ae770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:41.908 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.901+0000 7f55d1d9b640 1 --2- 172.21.15.122:0/3346396381 >> v2:172.21.15.77:3300/0 conn(0x7f55d415e590 0x7f55d40ae770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.908 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.901+0000 7f55d1d9b640 1 -- 172.21.15.122:0/3346396381 >> v1:172.21.15.77:6789/0 conn(0x7f55d406a830 legacy=0x7f55d40b2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:41.908 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.901+0000 7f55d1d9b640 1 -- 172.21.15.122:0/3346396381 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d40ca340 con 0x7f55d415e1b0 2023-11-04T01:39:41.908 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.901+0000 7f55d1d9b640 1 -- 172.21.15.122:0/3346396381 <== mon.1 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f55c4001670 con 0x7f55d415e1b0 2023-11-04T01:39:41.909 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.901+0000 7f55d359e640 1 --2- 172.21.15.122:0/3346396381 >> v2:172.21.15.77:3300/0 conn(0x7f55d415e590 0x7f55d40ae770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:41.909 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.901+0000 7f55d1d9b640 1 -- 172.21.15.122:0/3346396381 >> v1:172.21.15.122:6789/0 conn(0x7f55d415e1b0 legacy=0x7f55d406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:41.909 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.901+0000 7f55d1d9b640 1 --2- 172.21.15.122:0/3346396381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55bc003970 0x7f55bc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:41.909 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.901+0000 7f55d1d9b640 1 --2- 172.21.15.122:0/3346396381 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55bc0047c0 0x7f55bc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:41.909 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.901+0000 7f55d1d9b640 1 --2- 172.21.15.122:0/3346396381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55bc005180 0x7f55bc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:41.910 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.901+0000 7f55d1d9b640 1 -- 172.21.15.122:0/3346396381 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d406e7e0 con 0x7f55bc003970 2023-11-04T01:39:41.910 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.901+0000 7f55d1d9b640 1 -- 172.21.15.122:0/3346396381 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55bc00c120 con 0x7f55bc005180 2023-11-04T01:39:41.910 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.901+0000 7f55d1d9b640 1 -- 172.21.15.122:0/3346396381 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55bc00c2e0 con 0x7f55bc0047c0 2023-11-04T01:39:41.910 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.901+0000 7f55d359e640 1 --2- 172.21.15.122:0/3346396381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55bc005180 0x7f55bc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:41.910 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.901+0000 7f55d2d9d640 1 --2- 172.21.15.122:0/3346396381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55bc003970 0x7f55bc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:41.911 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.901+0000 7f55d259c640 1 --2- 172.21.15.122:0/3346396381 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55bc0047c0 0x7f55bc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:41.911 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.901+0000 7f55d359e640 1 -- 172.21.15.122:0/3346396381 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55bc0047c0 msgr2=0x7f55bc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:41.911 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.901+0000 7f55d359e640 1 --2- 172.21.15.122:0/3346396381 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55bc0047c0 0x7f55bc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.911 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.901+0000 7f55d359e640 1 -- 172.21.15.122:0/3346396381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55bc003970 msgr2=0x7f55bc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:41.911 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.902+0000 7f55d359e640 1 --2- 172.21.15.122:0/3346396381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55bc003970 0x7f55bc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.911 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.902+0000 7f55d359e640 1 -- 172.21.15.122:0/3346396381 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55bc003520 con 0x7f55bc005180 2023-11-04T01:39:41.912 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.902+0000 7f55d2d9d640 1 --2- 172.21.15.122:0/3346396381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55bc003970 0x7f55bc003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:41.912 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.902+0000 7f55d359e640 1 -- 172.21.15.122:0/3346396381 reap_dead start 2023-11-04T01:39:41.912 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.902+0000 7f55d359e640 1 --2- 172.21.15.122:0/3346396381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55bc005180 0x7f55bc00b980 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f55cc00e350 tx=0x7f55bc0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3798d916c94641fa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:41.912 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.902+0000 7f55d1d9b640 1 -- 172.21.15.122:0/3346396381 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc02ce00 con 0x7f55bc005180 2023-11-04T01:39:41.912 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.902+0000 7f55d1d9b640 1 -- 172.21.15.122:0/3346396381 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55cc00f040 con 0x7f55bc005180 2023-11-04T01:39:41.913 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.902+0000 7f55d1d9b640 1 -- 172.21.15.122:0/3346396381 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc034680 con 0x7f55bc005180 2023-11-04T01:39:41.913 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.903+0000 7f55d90c2640 1 -- 172.21.15.122:0/3346396381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55bc005180 msgr2=0x7f55bc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:41.913 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.903+0000 7f55d90c2640 1 --2- 172.21.15.122:0/3346396381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55bc005180 0x7f55bc00b980 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f55cc00e350 tx=0x7f55bc0057f0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.913 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.903+0000 7f55d90c2640 1 -- 172.21.15.122:0/3346396381 shutdown_connections 2023-11-04T01:39:41.913 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.903+0000 7f55d90c2640 1 --2- 172.21.15.122:0/3346396381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55bc005180 0x7f55bc00b980 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.913 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.903+0000 7f55d90c2640 1 -- 172.21.15.122:0/3346396381 >> 172.21.15.122:0/3346396381 conn(0x7f55d406d800 msgr2=0x7f55d406dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:41.914 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.903+0000 7f55d90c2640 1 -- 172.21.15.122:0/3346396381 shutdown_connections 2023-11-04T01:39:41.914 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.903+0000 7f55d90c2640 1 -- 172.21.15.122:0/3346396381 wait complete. 2023-11-04T01:39:41.916 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.904+0000 7f55d90c2640 1 Processor -- start 2023-11-04T01:39:41.917 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.905+0000 7f55d90c2640 1 -- start start 2023-11-04T01:39:41.917 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.905+0000 7f55d90c2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55bc005180 0x7f55d40c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:41.917 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.905+0000 7f55d90c2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55d40c8070 0x7f55d41f3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:41.917 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.905+0000 7f55d90c2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55d41f4410 0x7f55d41efe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:41.917 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.905+0000 7f55d90c2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d40cb060 con 0x7f55d41f4410 2023-11-04T01:39:41.917 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.905+0000 7f55d90c2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d40c9400 con 0x7f55bc005180 2023-11-04T01:39:41.918 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.905+0000 7f55d90c2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55d40c87f0 con 0x7f55d40c8070 2023-11-04T01:39:41.918 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.905+0000 7f55d2d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55bc005180 0x7f55d40c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:41.918 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.905+0000 7f55d259c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55d40c8070 0x7f55d41f3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:41.918 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.905+0000 7f55d2d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55bc005180 0x7f55d40c7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37710/0 (socket says 172.21.15.122:37710) 2023-11-04T01:39:41.919 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.905+0000 7f55d2d9d640 1 -- 172.21.15.122:0/2938962189 learned_addr learned my addr 172.21.15.122:0/2938962189 (peer_addr_for_me v2:172.21.15.122:0/0) 2023-11-04T01:39:41.919 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.905+0000 7f55d259c640 1 -- 172.21.15.122:0/2938962189 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55d40c8070 msgr2=0x7f55d41f3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-11-04T01:39:41.919 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.905+0000 7f55d259c640 1 -- 172.21.15.122:0/2938962189 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55d40c8070 msgr2=0x7f55d41f3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-04T01:39:41.919 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.905+0000 7f55d259c640 1 --2- 172.21.15.122:0/2938962189 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55d40c8070 0x7f55d41f3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:39:41.919 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.906+0000 7f55d259c640 1 --2- 172.21.15.122:0/2938962189 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55d40c8070 0x7f55d41f3ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:39:41.919 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.906+0000 7f55d359e640 1 --2- 172.21.15.122:0/2938962189 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55d41f4410 0x7f55d41efe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:41.920 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.906+0000 7f55d2d9d640 1 -- 172.21.15.122:0/2938962189 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55d40c8070 msgr2=0x7f55d41f3ed0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-04T01:39:41.920 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.906+0000 7f55d2d9d640 1 --2- 172.21.15.122:0/2938962189 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55d40c8070 0x7f55d41f3ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.920 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.906+0000 7f55d2d9d640 1 -- 172.21.15.122:0/2938962189 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55d41f4410 msgr2=0x7f55d41efe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:41.920 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.906+0000 7f55d2d9d640 1 --2- 172.21.15.122:0/2938962189 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55d41f4410 0x7f55d41efe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.920 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.906+0000 7f55d2d9d640 1 -- 172.21.15.122:0/2938962189 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d40c8ad0 con 0x7f55bc005180 2023-11-04T01:39:41.921 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.906+0000 7f55d2d9d640 1 --2- 172.21.15.122:0/2938962189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55bc005180 0x7f55d40c7b30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f55c4001e40 tx=0x7f55c4007790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:41.921 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.906+0000 7f55bb7fe640 1 -- 172.21.15.122:0/2938962189 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c400fb70 con 0x7f55bc005180 2023-11-04T01:39:41.921 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.906+0000 7f55bb7fe640 1 -- 172.21.15.122:0/2938962189 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c400fcd0 con 0x7f55bc005180 2023-11-04T01:39:41.921 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.906+0000 7f55d90c2640 1 -- 172.21.15.122:0/2938962189 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55d40c8db0 con 0x7f55bc005180 2023-11-04T01:39:41.921 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.906+0000 7f55bb7fe640 1 -- 172.21.15.122:0/2938962189 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c40133f0 con 0x7f55bc005180 2023-11-04T01:39:41.922 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.906+0000 7f55d90c2640 1 -- 172.21.15.122:0/2938962189 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55d40c84f0 con 0x7f55bc005180 2023-11-04T01:39:41.922 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.906+0000 7f55bb7fe640 1 -- 172.21.15.122:0/2938962189 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f55c4013850 con 0x7f55bc005180 2023-11-04T01:39:41.922 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.906+0000 7f55bb7fe640 1 -- 172.21.15.122:0/2938962189 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f55c401d460 con 0x7f55bc005180 2023-11-04T01:39:41.922 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.907+0000 7f55d90c2640 1 -- 172.21.15.122:0/2938962189 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55d40b26f0 con 0x7f55bc005180 2023-11-04T01:39:41.922 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.909+0000 7f55bb7fe640 1 -- 172.21.15.122:0/2938962189 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f55c4013bb0 con 0x7f55bc005180 2023-11-04T01:39:41.980 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.978+0000 7f55d90c2640 1 -- 172.21.15.122:0/2938962189 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0fa83dc2-4041-4dc3-83cf-f2bcae58b642", "id": 2} v 0) v1 -- 0x7f55d40b2140 con 0x7f55bc005180 2023-11-04T01:39:41.985 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.983+0000 7f55bb7fe640 1 -- 172.21.15.122:0/2938962189 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0fa83dc2-4041-4dc3-83cf-f2bcae58b642", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f55c402c0b0 con 0x7f55bc005180 2023-11-04T01:39:41.986 INFO:teuthology.orchestra.run.smithi122.stdout:2 2023-11-04T01:39:41.987 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.984+0000 7f55d90c2640 1 -- 172.21.15.122:0/2938962189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55bc005180 msgr2=0x7f55d40c7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:41.987 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.984+0000 7f55d90c2640 1 --2- 172.21.15.122:0/2938962189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55bc005180 0x7f55d40c7b30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f55c4001e40 tx=0x7f55c4007790 comp rx=0 tx=0).stop 2023-11-04T01:39:41.987 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.984+0000 7f55d90c2640 1 -- 172.21.15.122:0/2938962189 shutdown_connections 2023-11-04T01:39:41.987 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.984+0000 7f55d90c2640 1 --2- 172.21.15.122:0/2938962189 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55d41f4410 0x7f55d41efe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.987 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.984+0000 7f55d90c2640 1 --2- 172.21.15.122:0/2938962189 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55d40c8070 0x7f55d41f3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.988 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.984+0000 7f55d90c2640 1 --2- 172.21.15.122:0/2938962189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55bc005180 0x7f55d40c7b30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:41.988 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.984+0000 7f55d90c2640 1 -- 172.21.15.122:0/2938962189 >> 172.21.15.122:0/2938962189 conn(0x7f55d406d800 msgr2=0x7f55d40b08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:41.988 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.984+0000 7f55d90c2640 1 -- 172.21.15.122:0/2938962189 shutdown_connections 2023-11-04T01:39:41.988 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:41.984+0000 7f55d90c2640 1 -- 172.21.15.122:0/2938962189 wait complete. 2023-11-04T01:39:41.996 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd new 3f092780-1321-45bf-a394-423bf2e3fb08 3 2023-11-04T01:39:42.043 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-04T01:39:42.041+0000 7fe521e56040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-04T01:39:42.051 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-11-04T01:39:42.049+0000 7fd6e0c0d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-04T01:39:42.094 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-04T01:39:42.093+0000 7fe521e56040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-04T01:39:42.096 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.094+0000 7f46031d7640 1 Processor -- start 2023-11-04T01:39:42.096 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.094+0000 7f46031d7640 1 -- start start 2023-11-04T01:39:42.098 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.095+0000 7f46031d7640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f45fc06cd70 0x7f45fc06d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.099 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.095+0000 7f46031d7640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f45fc1615d0 0x7f45fc0cd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.099 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.095+0000 7f46031d7640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45fc06d690 con 0x7f45fc0cdc60 2023-11-04T01:39:42.099 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.095+0000 7f46031d7640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45fc15d6f0 con 0x7f45fc1615d0 2023-11-04T01:39:42.099 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.095+0000 7f46031d7640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc15d9d0 con 0x7f45fc06cd70 2023-11-04T01:39:42.100 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.095+0000 7f4600f73640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f45fc06cd70 0x7f45fc06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.100 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.095+0000 7f45fbfff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f45fc1615d0 0x7f45fc0cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.100 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.095+0000 7f4601774640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f45fc0cdc60 0x7f45fc070f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:52974/0 (socket says 172.21.15.122:52974) 2023-11-04T01:39:42.100 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.095+0000 7f4601774640 1 -- 172.21.15.122:0/3906448849 learned_addr learned my addr 172.21.15.122:0/3906448849 (peer_addr_for_me v1:172.21.15.122:0/0) 2023-11-04T01:39:42.100 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.095+0000 7f45fbfff640 1 --2- 172.21.15.122:0/3906448849 >> v2:172.21.15.122:3300/0 conn(0x7f45fc1615d0 0x7f45fc0cd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37714/0 (socket says 172.21.15.122:37714) 2023-11-04T01:39:42.101 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.095+0000 7f4600f73640 1 --2- 172.21.15.122:0/3906448849 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f45fc06cd70 0x7f45fc06d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.122:46096/0 (socket says 172.21.15.122:46096) 2023-11-04T01:39:42.101 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.095+0000 7f4600f73640 1 -- 172.21.15.122:0/3906448849 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f45fc06cd70 msgr2=0x7f45fc06d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-04T01:39:42.101 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.095+0000 7f4600f73640 1 -- 172.21.15.122:0/3906448849 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f45fc06cd70 msgr2=0x7f45fc06d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:39:42.101 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.095+0000 7f4600f73640 1 --2- 172.21.15.122:0/3906448849 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f45fc06cd70 0x7f45fc06d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:39:42.101 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.095+0000 7f4600f73640 1 --2- 172.21.15.122:0/3906448849 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f45fc06cd70 0x7f45fc06d150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:39:42.102 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.095+0000 7f45fbfff640 1 -- 172.21.15.122:0/3906448849 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f45fc06cd70 msgr2=0x7f45fc06d150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:39:42.102 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.095+0000 7f45fbfff640 1 --2- 172.21.15.122:0/3906448849 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f45fc06cd70 0x7f45fc06d150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.102 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.095+0000 7f45fbfff640 1 -- 172.21.15.122:0/3906448849 >> v1:172.21.15.122:6789/0 conn(0x7f45fc0cdc60 legacy=0x7f45fc070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.102 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.095+0000 7f45fbfff640 1 -- 172.21.15.122:0/3906448849 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45fc15dcb0 con 0x7f45fc1615d0 2023-11-04T01:39:42.102 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.095+0000 7f45fb7fe640 1 -- 172.21.15.122:0/3906448849 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1429539166 0 0) 0x7f45fc06d690 con 0x7f45fc0cdc60 2023-11-04T01:39:42.103 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.096+0000 7f45fbfff640 1 --2- 172.21.15.122:0/3906448849 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45fc1615d0 0x7f45fc0cd720 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f45e80097a0 tx=0x7f45e802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15346c6c74a33444 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:42.103 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.096+0000 7f45fb7fe640 1 -- 172.21.15.122:0/3906448849 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e802e070 con 0x7f45fc1615d0 2023-11-04T01:39:42.103 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.096+0000 7f45fb7fe640 1 -- 172.21.15.122:0/3906448849 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e80315a0 con 0x7f45fc1615d0 2023-11-04T01:39:42.103 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.096+0000 7f45fb7fe640 1 -- 172.21.15.122:0/3906448849 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e8031930 con 0x7f45fc1615d0 2023-11-04T01:39:42.103 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.097+0000 7f46031d7640 1 -- 172.21.15.122:0/3906448849 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45fc1615d0 msgr2=0x7f45fc0cd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.104 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.097+0000 7f46031d7640 1 --2- 172.21.15.122:0/3906448849 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45fc1615d0 0x7f45fc0cd720 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f45e80097a0 tx=0x7f45e802b840 comp rx=0 tx=0).stop 2023-11-04T01:39:42.104 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.097+0000 7f46031d7640 1 -- 172.21.15.122:0/3906448849 shutdown_connections 2023-11-04T01:39:42.104 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.097+0000 7f46031d7640 1 --2- 172.21.15.122:0/3906448849 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45fc1615d0 0x7f45fc0cd720 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.104 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.097+0000 7f46031d7640 1 --2- 172.21.15.122:0/3906448849 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f45fc06cd70 0x7f45fc06d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.104 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.097+0000 7f46031d7640 1 -- 172.21.15.122:0/3906448849 >> 172.21.15.122:0/3906448849 conn(0x7f45fc0cf140 msgr2=0x7f45fc0cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:42.104 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.097+0000 7f46031d7640 1 -- 172.21.15.122:0/3906448849 shutdown_connections 2023-11-04T01:39:42.105 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.097+0000 7f46031d7640 1 -- 172.21.15.122:0/3906448849 wait complete. 2023-11-04T01:39:42.107 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.098+0000 7f46031d7640 1 Processor -- start 2023-11-04T01:39:42.107 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.098+0000 7f46031d7640 1 -- start start 2023-11-04T01:39:42.108 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.099+0000 7f46031d7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45fc06cd70 0x7f45fc0ac800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.108 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.099+0000 7f46031d7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45fc0cdc60 0x7f45fc0aff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.108 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.099+0000 7f46031d7640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f45fc1615d0 0x7f45fc1585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.108 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.099+0000 7f46031d7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc0b0470 con 0x7f45fc06cd70 2023-11-04T01:39:42.108 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.099+0000 7f46031d7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc0ace90 con 0x7f45fc0cdc60 2023-11-04T01:39:42.109 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.099+0000 7f46031d7640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc0ad170 con 0x7f45fc1615d0 2023-11-04T01:39:42.109 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.099+0000 7f45fbfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45fc0cdc60 0x7f45fc0aff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.109 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.099+0000 7f4601774640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f45fc1615d0 0x7f45fc1585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.109 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.099+0000 7f45fbfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45fc0cdc60 0x7f45fc0aff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37724/0 (socket says 172.21.15.122:37724) 2023-11-04T01:39:42.109 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.099+0000 7f45fbfff640 1 -- 172.21.15.122:0/1928063323 learned_addr learned my addr 172.21.15.122:0/1928063323 (peer_addr_for_me v2:172.21.15.122:0/0) 2023-11-04T01:39:42.110 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.099+0000 7f4601774640 1 -- 172.21.15.122:0/1928063323 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f45fc1615d0 msgr2=0x7f45fc1585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-11-04T01:39:42.110 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.099+0000 7f4601774640 1 -- 172.21.15.122:0/1928063323 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f45fc1615d0 msgr2=0x7f45fc1585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-04T01:39:42.110 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.099+0000 7f4601774640 1 --2- 172.21.15.122:0/1928063323 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f45fc1615d0 0x7f45fc1585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:39:42.110 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.099+0000 7f4600f73640 1 --2- 172.21.15.122:0/1928063323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45fc06cd70 0x7f45fc0ac800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.111 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.099+0000 7f4601774640 1 --2- 172.21.15.122:0/1928063323 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f45fc1615d0 0x7f45fc1585e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:39:42.111 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.099+0000 7f45fbfff640 1 -- 172.21.15.122:0/1928063323 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f45fc1615d0 msgr2=0x7f45fc1585e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-04T01:39:42.111 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.099+0000 7f45fbfff640 1 --2- 172.21.15.122:0/1928063323 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f45fc1615d0 0x7f45fc1585e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.111 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.099+0000 7f45fbfff640 1 -- 172.21.15.122:0/1928063323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45fc06cd70 msgr2=0x7f45fc0ac800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.111 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.099+0000 7f45fbfff640 1 --2- 172.21.15.122:0/1928063323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45fc06cd70 0x7f45fc0ac800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.112 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.099+0000 7f45fbfff640 1 -- 172.21.15.122:0/1928063323 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e8009400 con 0x7f45fc0cdc60 2023-11-04T01:39:42.112 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.099+0000 7f45fbfff640 1 --2- 172.21.15.122:0/1928063323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45fc0cdc60 0x7f45fc0aff30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f45e8034040 tx=0x7f45e80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:42.112 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.099+0000 7f45f97fa640 1 -- 172.21.15.122:0/1928063323 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e8032840 con 0x7f45fc0cdc60 2023-11-04T01:39:42.112 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.099+0000 7f45f97fa640 1 -- 172.21.15.122:0/1928063323 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e80329a0 con 0x7f45fc0cdc60 2023-11-04T01:39:42.112 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.099+0000 7f45f97fa640 1 -- 172.21.15.122:0/1928063323 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e8032d50 con 0x7f45fc0cdc60 2023-11-04T01:39:42.112 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.099+0000 7f46031d7640 1 -- 172.21.15.122:0/1928063323 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45fc0ad450 con 0x7f45fc0cdc60 2023-11-04T01:39:42.113 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.099+0000 7f46031d7640 1 -- 172.21.15.122:0/1928063323 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45fc0ada10 con 0x7f45fc0cdc60 2023-11-04T01:39:42.113 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.100+0000 7f45f97fa640 1 -- 172.21.15.122:0/1928063323 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f45e8005c90 con 0x7f45fc0cdc60 2023-11-04T01:39:42.113 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.100+0000 7f45f97fa640 1 -- 172.21.15.122:0/1928063323 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f45e803b3f0 con 0x7f45fc0cdc60 2023-11-04T01:39:42.113 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.100+0000 7f46031d7640 1 -- 172.21.15.122:0/1928063323 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45fc0cb9c0 con 0x7f45fc0cdc60 2023-11-04T01:39:42.113 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.102+0000 7f45f97fa640 1 -- 172.21.15.122:0/1928063323 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f45e8063b40 con 0x7f45fc0cdc60 2023-11-04T01:39:42.114 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-11-04T01:39:42.103+0000 7fd6e0c0d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-04T01:39:42.173 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.172+0000 7f46031d7640 1 -- 172.21.15.122:0/1928063323 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3f092780-1321-45bf-a394-423bf2e3fb08", "id": 3} v 0) v1 -- 0x7f45fc0adc00 con 0x7f45fc0cdc60 2023-11-04T01:39:42.178 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.177+0000 7f45f97fa640 1 -- 172.21.15.122:0/1928063323 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3f092780-1321-45bf-a394-423bf2e3fb08", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f45e8052070 con 0x7f45fc0cdc60 2023-11-04T01:39:42.179 INFO:teuthology.orchestra.run.smithi122.stdout:3 2023-11-04T01:39:42.180 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.178+0000 7f46031d7640 1 -- 172.21.15.122:0/1928063323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45fc0cdc60 msgr2=0x7f45fc0aff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.180 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.178+0000 7f46031d7640 1 --2- 172.21.15.122:0/1928063323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45fc0cdc60 0x7f45fc0aff30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f45e8034040 tx=0x7f45e80046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.181 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.178+0000 7f46031d7640 1 -- 172.21.15.122:0/1928063323 shutdown_connections 2023-11-04T01:39:42.181 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.178+0000 7f46031d7640 1 --2- 172.21.15.122:0/1928063323 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f45fc1615d0 0x7f45fc1585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.181 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.178+0000 7f46031d7640 1 --2- 172.21.15.122:0/1928063323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f45fc0cdc60 0x7f45fc0aff30 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.181 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.178+0000 7f46031d7640 1 --2- 172.21.15.122:0/1928063323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45fc06cd70 0x7f45fc0ac800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.181 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.178+0000 7f46031d7640 1 -- 172.21.15.122:0/1928063323 >> 172.21.15.122:0/1928063323 conn(0x7f45fc0cf140 msgr2=0x7f45fc160be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:42.182 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.178+0000 7f46031d7640 1 -- 172.21.15.122:0/1928063323 shutdown_connections 2023-11-04T01:39:42.182 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.178+0000 7f46031d7640 1 -- 172.21.15.122:0/1928063323 wait complete. 2023-11-04T01:39:42.190 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd new a4c96f1d-c6f4-4d50-a607-b7c1fb291c33 4 2023-11-04T01:39:42.288 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.286+0000 7fb57a8d4640 1 Processor -- start 2023-11-04T01:39:42.289 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.286+0000 7fb57a8d4640 1 -- start start 2023-11-04T01:39:42.291 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.286+0000 7fb57a8d4640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb57415cfd0 0x7fb57406c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.292 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.286+0000 7fb57a8d4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb5740cd570 0x7fb5740cd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.292 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.286+0000 7fb57a8d4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5740cdf20 con 0x7fb5740cf180 2023-11-04T01:39:42.292 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.286+0000 7fb57a8d4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb57415d3b0 con 0x7fb5740cd570 2023-11-04T01:39:42.292 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.286+0000 7fb57a8d4640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5740cea20 con 0x7fb57415cfd0 2023-11-04T01:39:42.292 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.287+0000 7fb573fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb57415cfd0 0x7fb57406c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.293 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.287+0000 7fb573fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb57415cfd0 0x7fb57406c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37726/0 (socket says 172.21.15.122:37726) 2023-11-04T01:39:42.293 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.287+0000 7fb573fff640 1 -- 172.21.15.122:0/3438966710 learned_addr learned my addr 172.21.15.122:0/3438966710 (peer_addr_for_me v2:172.21.15.122:0/0) 2023-11-04T01:39:42.293 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.287+0000 7fb578e71640 1 --2- 172.21.15.122:0/3438966710 >> v2:172.21.15.77:3300/0 conn(0x7fb5740cd570 0x7fb5740cd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.293 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.287+0000 7fb573fff640 1 -- 172.21.15.122:0/3438966710 >> v2:172.21.15.77:3300/0 conn(0x7fb5740cd570 msgr2=0x7fb5740cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:42.293 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.287+0000 7fb573fff640 1 --2- 172.21.15.122:0/3438966710 >> v2:172.21.15.77:3300/0 conn(0x7fb5740cd570 0x7fb5740cd9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.294 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.287+0000 7fb573fff640 1 -- 172.21.15.122:0/3438966710 >> v1:172.21.15.77:6789/0 conn(0x7fb5740cf180 legacy=0x7fb574161440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.294 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.287+0000 7fb573fff640 1 -- 172.21.15.122:0/3438966710 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5740cf610 con 0x7fb57415cfd0 2023-11-04T01:39:42.294 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.288+0000 7fb573fff640 1 --2- 172.21.15.122:0/3438966710 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb57415cfd0 0x7fb57406c0a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb5740d1ca0 tx=0x7fb56402b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5bfee89008e7a58 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:42.294 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.288+0000 7fb572ffd640 1 -- 172.21.15.122:0/3438966710 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb564031870 con 0x7fb57415cfd0 2023-11-04T01:39:42.295 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.288+0000 7fb572ffd640 1 -- 172.21.15.122:0/3438966710 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5640319d0 con 0x7fb57415cfd0 2023-11-04T01:39:42.295 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.288+0000 7fb572ffd640 1 -- 172.21.15.122:0/3438966710 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb564031d60 con 0x7fb57415cfd0 2023-11-04T01:39:42.295 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.288+0000 7fb57a8d4640 1 -- 172.21.15.122:0/3438966710 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb57415cfd0 msgr2=0x7fb57406c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.295 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.288+0000 7fb57a8d4640 1 --2- 172.21.15.122:0/3438966710 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb57415cfd0 0x7fb57406c0a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb5740d1ca0 tx=0x7fb56402b910 comp rx=0 tx=0).stop 2023-11-04T01:39:42.295 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.288+0000 7fb57a8d4640 1 -- 172.21.15.122:0/3438966710 shutdown_connections 2023-11-04T01:39:42.296 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.288+0000 7fb57a8d4640 1 --2- 172.21.15.122:0/3438966710 >> v2:172.21.15.77:3300/0 conn(0x7fb5740cd570 0x7fb5740cd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.296 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.288+0000 7fb57a8d4640 1 --2- 172.21.15.122:0/3438966710 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb57415cfd0 0x7fb57406c0a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.296 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.288+0000 7fb57a8d4640 1 -- 172.21.15.122:0/3438966710 >> 172.21.15.122:0/3438966710 conn(0x7fb57406ea20 msgr2=0x7fb57406ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:42.296 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.288+0000 7fb57a8d4640 1 -- 172.21.15.122:0/3438966710 shutdown_connections 2023-11-04T01:39:42.296 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.288+0000 7fb57a8d4640 1 -- 172.21.15.122:0/3438966710 wait complete. 2023-11-04T01:39:42.297 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.289+0000 7fb57a8d4640 1 Processor -- start 2023-11-04T01:39:42.297 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.290+0000 7fb57a8d4640 1 -- start start 2023-11-04T01:39:42.299 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.290+0000 7fb57a8d4640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb5740cd570 0x7fb5740b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.299 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.290+0000 7fb57a8d4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb57415cfd0 0x7fb57414e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.300 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.290+0000 7fb57a8d4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5740ac2f0 0x7fb5740cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.300 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.290+0000 7fb57a8d4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5740ab950 con 0x7fb57415cfd0 2023-11-04T01:39:42.300 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.290+0000 7fb57a8d4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57414e5e0 con 0x7fb5740ac2f0 2023-11-04T01:39:42.300 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.290+0000 7fb57a8d4640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5740abba0 con 0x7fb5740cd570 2023-11-04T01:39:42.300 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.290+0000 7fb578e71640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5740ac2f0 0x7fb5740cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.301 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.290+0000 7fb573fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb5740cd570 0x7fb5740b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.301 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.290+0000 7fb578e71640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5740ac2f0 0x7fb5740cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37738/0 (socket says 172.21.15.122:37738) 2023-11-04T01:39:42.301 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.290+0000 7fb578e71640 1 -- 172.21.15.122:0/1895585582 learned_addr learned my addr 172.21.15.122:0/1895585582 (peer_addr_for_me v2:172.21.15.122:0/0) 2023-11-04T01:39:42.301 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.290+0000 7fb5737fe640 1 --2- 172.21.15.122:0/1895585582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb57415cfd0 0x7fb57414e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.301 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.291+0000 7fb573fff640 1 -- 172.21.15.122:0/1895585582 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb5740cd570 msgr2=0x7fb5740b60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-11-04T01:39:42.302 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.291+0000 7fb573fff640 1 -- 172.21.15.122:0/1895585582 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb5740cd570 msgr2=0x7fb5740b60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-04T01:39:42.302 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.291+0000 7fb573fff640 1 --2- 172.21.15.122:0/1895585582 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb5740cd570 0x7fb5740b60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:39:42.302 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.291+0000 7fb573fff640 1 --2- 172.21.15.122:0/1895585582 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb5740cd570 0x7fb5740b60b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:39:42.302 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.291+0000 7fb578e71640 1 -- 172.21.15.122:0/1895585582 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb5740cd570 msgr2=0x7fb5740b60b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-04T01:39:42.302 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.291+0000 7fb578e71640 1 --2- 172.21.15.122:0/1895585582 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb5740cd570 0x7fb5740b60b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.303 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.291+0000 7fb578e71640 1 -- 172.21.15.122:0/1895585582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb57415cfd0 msgr2=0x7fb57414e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.303 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.291+0000 7fb578e71640 1 --2- 172.21.15.122:0/1895585582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb57415cfd0 0x7fb57414e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.303 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.291+0000 7fb578e71640 1 -- 172.21.15.122:0/1895585582 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5640094d0 con 0x7fb5740ac2f0 2023-11-04T01:39:42.303 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.291+0000 7fb5737fe640 1 --2- 172.21.15.122:0/1895585582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb57415cfd0 0x7fb57414e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:42.303 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.291+0000 7fb578e71640 1 --2- 172.21.15.122:0/1895585582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5740ac2f0 0x7fb5740cc7f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb56c00efc0 tx=0x7fb56c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:42.303 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.291+0000 7fb570ff9640 1 -- 172.21.15.122:0/1895585582 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c009ba0 con 0x7fb5740ac2f0 2023-11-04T01:39:42.304 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.291+0000 7fb570ff9640 1 -- 172.21.15.122:0/1895585582 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56c00f040 con 0x7fb5740ac2f0 2023-11-04T01:39:42.304 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.291+0000 7fb57a8d4640 1 -- 172.21.15.122:0/1895585582 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5740abe80 con 0x7fb5740ac2f0 2023-11-04T01:39:42.304 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.291+0000 7fb570ff9640 1 -- 172.21.15.122:0/1895585582 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c0146c0 con 0x7fb5740ac2f0 2023-11-04T01:39:42.304 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.291+0000 7fb57a8d4640 1 -- 172.21.15.122:0/1895585582 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5740c9b30 con 0x7fb5740ac2f0 2023-11-04T01:39:42.304 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.291+0000 7fb570ff9640 1 -- 172.21.15.122:0/1895585582 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb56c014b20 con 0x7fb5740ac2f0 2023-11-04T01:39:42.305 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.291+0000 7fb570ff9640 1 -- 172.21.15.122:0/1895585582 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fb56c01dc20 con 0x7fb5740ac2f0 2023-11-04T01:39:42.305 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.292+0000 7fb57a8d4640 1 -- 172.21.15.122:0/1895585582 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb57406b300 con 0x7fb5740ac2f0 2023-11-04T01:39:42.305 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.294+0000 7fb570ff9640 1 -- 172.21.15.122:0/1895585582 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fb56c03bb40 con 0x7fb5740ac2f0 2023-11-04T01:39:42.366 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.364+0000 7fb57a8d4640 1 -- 172.21.15.122:0/1895585582 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a4c96f1d-c6f4-4d50-a607-b7c1fb291c33", "id": 4} v 0) v1 -- 0x7fb57406ca30 con 0x7fb5740ac2f0 2023-11-04T01:39:42.369 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.367+0000 7fb570ff9640 1 -- 172.21.15.122:0/1895585582 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a4c96f1d-c6f4-4d50-a607-b7c1fb291c33", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb56c02a070 con 0x7fb5740ac2f0 2023-11-04T01:39:42.369 INFO:teuthology.orchestra.run.smithi122.stdout:4 2023-11-04T01:39:42.371 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.368+0000 7fb57a8d4640 1 -- 172.21.15.122:0/1895585582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5740ac2f0 msgr2=0x7fb5740cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.371 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.368+0000 7fb57a8d4640 1 --2- 172.21.15.122:0/1895585582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5740ac2f0 0x7fb5740cc7f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb56c00efc0 tx=0x7fb56c00c490 comp rx=0 tx=0).stop 2023-11-04T01:39:42.371 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.368+0000 7fb57a8d4640 1 -- 172.21.15.122:0/1895585582 shutdown_connections 2023-11-04T01:39:42.371 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.368+0000 7fb57a8d4640 1 --2- 172.21.15.122:0/1895585582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5740ac2f0 0x7fb5740cc7f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.371 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.368+0000 7fb57a8d4640 1 --2- 172.21.15.122:0/1895585582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb57415cfd0 0x7fb57414e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.372 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.368+0000 7fb57a8d4640 1 --2- 172.21.15.122:0/1895585582 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb5740cd570 0x7fb5740b60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.372 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.368+0000 7fb57a8d4640 1 -- 172.21.15.122:0/1895585582 >> 172.21.15.122:0/1895585582 conn(0x7fb57406ea20 msgr2=0x7fb57415c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:42.372 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.368+0000 7fb57a8d4640 1 -- 172.21.15.122:0/1895585582 shutdown_connections 2023-11-04T01:39:42.372 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.368+0000 7fb57a8d4640 1 -- 172.21.15.122:0/1895585582 wait complete. 2023-11-04T01:39:42.380 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd new 90bc798b-138e-4fdf-9d41-96033624e5c6 5 2023-11-04T01:39:42.479 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.477+0000 7fe8850da640 1 Processor -- start 2023-11-04T01:39:42.480 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.477+0000 7fe8850da640 1 -- start start 2023-11-04T01:39:42.482 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.478+0000 7fe8850da640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe88015af20 0x7fe8800b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.482 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.478+0000 7fe8850da640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe8800b64c0 0x7fe8800cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.482 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.478+0000 7fe8850da640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8800d01f0 con 0x7fe8800cd3b0 2023-11-04T01:39:42.483 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.478+0000 7fe8850da640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8800b6a40 con 0x7fe8800b64c0 2023-11-04T01:39:42.483 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.478+0000 7fe8850da640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8800d04b0 con 0x7fe88015af20 2023-11-04T01:39:42.483 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.478+0000 7fe87ed9d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe88015af20 0x7fe8800b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.483 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.478+0000 7fe87e59c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe8800b64c0 0x7fe8800cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.484 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.478+0000 7fe87ed9d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe88015af20 0x7fe8800b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.122:46136/0 (socket says 172.21.15.122:46136) 2023-11-04T01:39:42.484 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.478+0000 7fe87ed9d640 1 -- 172.21.15.122:0/1492903366 learned_addr learned my addr 172.21.15.122:0/1492903366 (peer_addr_for_me v2:172.21.15.122:0/0) 2023-11-04T01:39:42.484 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.478+0000 7fe87ed9d640 1 -- 172.21.15.122:0/1492903366 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe88015af20 msgr2=0x7fe8800b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-04T01:39:42.484 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.478+0000 7fe87ed9d640 1 -- 172.21.15.122:0/1492903366 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe88015af20 msgr2=0x7fe8800b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:39:42.485 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.478+0000 7fe87ed9d640 1 --2- 172.21.15.122:0/1492903366 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe88015af20 0x7fe8800b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:39:42.485 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.478+0000 7fe87ed9d640 1 --2- 172.21.15.122:0/1492903366 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe88015af20 0x7fe8800b3cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:39:42.485 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.478+0000 7fe87e59c640 1 -- 172.21.15.122:0/1492903366 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe88015af20 msgr2=0x7fe8800b3cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:39:42.485 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.478+0000 7fe87e59c640 1 --2- 172.21.15.122:0/1492903366 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe88015af20 0x7fe8800b3cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.485 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.479+0000 7fe87e59c640 1 -- 172.21.15.122:0/1492903366 >> v1:172.21.15.122:6789/0 conn(0x7fe8800cd3b0 legacy=0x7fe8800b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.486 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.479+0000 7fe87e59c640 1 -- 172.21.15.122:0/1492903366 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8800d0790 con 0x7fe8800b64c0 2023-11-04T01:39:42.486 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.479+0000 7fe87dd9b640 1 -- 172.21.15.122:0/1492903366 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1216215644 0 0) 0x7fe8800d01f0 con 0x7fe8800cd3b0 2023-11-04T01:39:42.486 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.479+0000 7fe87e59c640 1 --2- 172.21.15.122:0/1492903366 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8800b64c0 0x7fe8800cbc70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe8700097a0 tx=0x7fe87002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2724f8383bb513a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:42.487 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.479+0000 7fe87dd9b640 1 -- 172.21.15.122:0/1492903366 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe870031830 con 0x7fe8800b64c0 2023-11-04T01:39:42.487 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.479+0000 7fe87dd9b640 1 -- 172.21.15.122:0/1492903366 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe870031990 con 0x7fe8800b64c0 2023-11-04T01:39:42.487 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.479+0000 7fe87dd9b640 1 -- 172.21.15.122:0/1492903366 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe870031d20 con 0x7fe8800b64c0 2023-11-04T01:39:42.487 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.480+0000 7fe8850da640 1 -- 172.21.15.122:0/1492903366 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8800b64c0 msgr2=0x7fe8800cbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.488 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.480+0000 7fe8850da640 1 --2- 172.21.15.122:0/1492903366 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8800b64c0 0x7fe8800cbc70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe8700097a0 tx=0x7fe87002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.488 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.480+0000 7fe8850da640 1 -- 172.21.15.122:0/1492903366 shutdown_connections 2023-11-04T01:39:42.488 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.480+0000 7fe8850da640 1 --2- 172.21.15.122:0/1492903366 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8800b64c0 0x7fe8800cbc70 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.488 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.480+0000 7fe8850da640 1 --2- 172.21.15.122:0/1492903366 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe88015af20 0x7fe8800b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.489 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.480+0000 7fe8850da640 1 -- 172.21.15.122:0/1492903366 >> 172.21.15.122:0/1492903366 conn(0x7fe88006ea20 msgr2=0x7fe88006ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:42.489 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.480+0000 7fe8850da640 1 -- 172.21.15.122:0/1492903366 shutdown_connections 2023-11-04T01:39:42.489 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.480+0000 7fe8850da640 1 -- 172.21.15.122:0/1492903366 wait complete. 2023-11-04T01:39:42.493 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.481+0000 7fe8850da640 1 Processor -- start 2023-11-04T01:39:42.493 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.482+0000 7fe8850da640 1 -- start start 2023-11-04T01:39:42.493 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.482+0000 7fe8850da640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8800b64c0 0x7fe8800c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.493 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.482+0000 7fe8850da640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe8800cd3b0 0x7fe8800c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.493 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.482+0000 7fe8850da640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe88015af20 0x7fe880152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.494 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.482+0000 7fe8850da640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88015dd10 con 0x7fe8800b64c0 2023-11-04T01:39:42.494 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.482+0000 7fe8850da640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8800b05d0 con 0x7fe88015af20 2023-11-04T01:39:42.494 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.482+0000 7fe8850da640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8800b1430 con 0x7fe8800cd3b0 2023-11-04T01:39:42.495 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.482+0000 7fe87e59c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe8800cd3b0 0x7fe8800c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.495 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.482+0000 7fe87e59c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe8800cd3b0 0x7fe8800c98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.122:46146/0 (socket says 172.21.15.122:46146) 2023-11-04T01:39:42.495 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.482+0000 7fe87e59c640 1 -- 172.21.15.122:0/2505488392 learned_addr learned my addr 172.21.15.122:0/2505488392 (peer_addr_for_me v2:172.21.15.122:0/0) 2023-11-04T01:39:42.495 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.482+0000 7fe87f59e640 1 --2- 172.21.15.122:0/2505488392 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe88015af20 0x7fe880152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.495 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.482+0000 7fe87e59c640 1 -- 172.21.15.122:0/2505488392 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe8800cd3b0 msgr2=0x7fe8800c98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-11-04T01:39:42.496 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.482+0000 7fe87e59c640 1 -- 172.21.15.122:0/2505488392 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe8800cd3b0 msgr2=0x7fe8800c98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-04T01:39:42.496 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.482+0000 7fe87e59c640 1 --2- 172.21.15.122:0/2505488392 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe8800cd3b0 0x7fe8800c98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:39:42.496 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.482+0000 7fe87ed9d640 1 --2- 172.21.15.122:0/2505488392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8800b64c0 0x7fe8800c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.496 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.482+0000 7fe87e59c640 1 --2- 172.21.15.122:0/2505488392 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe8800cd3b0 0x7fe8800c98e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:39:42.496 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.483+0000 7fe87f59e640 1 -- 172.21.15.122:0/2505488392 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe8800cd3b0 msgr2=0x7fe8800c98e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-04T01:39:42.497 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.483+0000 7fe87f59e640 1 --2- 172.21.15.122:0/2505488392 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe8800cd3b0 0x7fe8800c98e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.497 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.483+0000 7fe87f59e640 1 -- 172.21.15.122:0/2505488392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8800b64c0 msgr2=0x7fe8800c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.497 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.483+0000 7fe87f59e640 1 --2- 172.21.15.122:0/2505488392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8800b64c0 0x7fe8800c93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.497 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.483+0000 7fe87f59e640 1 -- 172.21.15.122:0/2505488392 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe870009400 con 0x7fe88015af20 2023-11-04T01:39:42.497 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.483+0000 7fe87f59e640 1 --2- 172.21.15.122:0/2505488392 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe88015af20 0x7fe880152c90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe878001560 tx=0x7fe87800cbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:42.498 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.483+0000 7fe8677fe640 1 -- 172.21.15.122:0/2505488392 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe878003da0 con 0x7fe88015af20 2023-11-04T01:39:42.498 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.483+0000 7fe8677fe640 1 -- 172.21.15.122:0/2505488392 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87800ce30 con 0x7fe88015af20 2023-11-04T01:39:42.498 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.483+0000 7fe8850da640 1 -- 172.21.15.122:0/2505488392 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8800b0820 con 0x7fe88015af20 2023-11-04T01:39:42.498 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.483+0000 7fe8677fe640 1 -- 172.21.15.122:0/2505488392 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8780052b0 con 0x7fe88015af20 2023-11-04T01:39:42.498 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.483+0000 7fe8850da640 1 -- 172.21.15.122:0/2505488392 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8800b0de0 con 0x7fe88015af20 2023-11-04T01:39:42.499 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.483+0000 7fe8677fe640 1 -- 172.21.15.122:0/2505488392 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe87800a610 con 0x7fe88015af20 2023-11-04T01:39:42.499 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.483+0000 7fe8677fe640 1 -- 172.21.15.122:0/2505488392 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fe878012980 con 0x7fe88015af20 2023-11-04T01:39:42.499 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.484+0000 7fe8850da640 1 -- 172.21.15.122:0/2505488392 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe88015a410 con 0x7fe88015af20 2023-11-04T01:39:42.499 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.486+0000 7fe8677fe640 1 -- 172.21.15.122:0/2505488392 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fe878017070 con 0x7fe88015af20 2023-11-04T01:39:42.558 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.556+0000 7fe8850da640 1 -- 172.21.15.122:0/2505488392 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd new", "uuid": "90bc798b-138e-4fdf-9d41-96033624e5c6", "id": 5} v 0) v1 -- 0x7fe88015a0a0 con 0x7fe88015af20 2023-11-04T01:39:42.563 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.561+0000 7fe8677fe640 1 -- 172.21.15.122:0/2505488392 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "90bc798b-138e-4fdf-9d41-96033624e5c6", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe87800aaf0 con 0x7fe88015af20 2023-11-04T01:39:42.563 INFO:teuthology.orchestra.run.smithi122.stdout:5 2023-11-04T01:39:42.564 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.562+0000 7fe8850da640 1 -- 172.21.15.122:0/2505488392 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe88015af20 msgr2=0x7fe880152c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.564 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.562+0000 7fe8850da640 1 --2- 172.21.15.122:0/2505488392 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe88015af20 0x7fe880152c90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe878001560 tx=0x7fe87800cbe0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.565 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.562+0000 7fe8850da640 1 -- 172.21.15.122:0/2505488392 shutdown_connections 2023-11-04T01:39:42.565 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.562+0000 7fe8850da640 1 --2- 172.21.15.122:0/2505488392 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe88015af20 0x7fe880152c90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.565 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.562+0000 7fe8850da640 1 --2- 172.21.15.122:0/2505488392 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe8800cd3b0 0x7fe8800c98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.565 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.562+0000 7fe8850da640 1 --2- 172.21.15.122:0/2505488392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8800b64c0 0x7fe8800c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.565 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.562+0000 7fe8850da640 1 -- 172.21.15.122:0/2505488392 >> 172.21.15.122:0/2505488392 conn(0x7fe88006ea20 msgr2=0x7fe8800cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:42.566 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.562+0000 7fe8850da640 1 -- 172.21.15.122:0/2505488392 shutdown_connections 2023-11-04T01:39:42.566 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.562+0000 7fe8850da640 1 -- 172.21.15.122:0/2505488392 wait complete. 2023-11-04T01:39:42.574 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd new 389bd9eb-d184-4cef-b0b3-d394fc66d6ba 6 2023-11-04T01:39:42.631 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-04T01:39:42.630+0000 7fe521e56040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-04T01:39:42.659 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-11-04T01:39:42.657+0000 7fd6e0c0d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-04T01:39:42.673 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.671+0000 7f97ce6c2640 1 Processor -- start 2023-11-04T01:39:42.674 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.672+0000 7f97ce6c2640 1 -- start start 2023-11-04T01:39:42.675 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.672+0000 7f97ce6c2640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f97c8071f90 0x7f97c80b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.675 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.672+0000 7f97ce6c2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f97c815add0 0x7f97c80cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.676 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.672+0000 7f97ce6c2640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97c80b1cc0 con 0x7f97c8072370 2023-11-04T01:39:42.676 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.672+0000 7f97ce6c2640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c80b1fa0 con 0x7f97c815add0 2023-11-04T01:39:42.676 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.672+0000 7f97ce6c2640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c815a0e0 con 0x7f97c8071f90 2023-11-04T01:39:42.676 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.672+0000 7f97c7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f97c8071f90 0x7f97c80b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.676 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.672+0000 7f97ccc5f640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f97c8072370 0x7f97c80cf200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:52990/0 (socket says 172.21.15.122:52990) 2023-11-04T01:39:42.677 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.672+0000 7f97ccc5f640 1 -- 172.21.15.122:0/103555819 learned_addr learned my addr 172.21.15.122:0/103555819 (peer_addr_for_me v1:172.21.15.122:0/0) 2023-11-04T01:39:42.677 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.673+0000 7f97c77fe640 1 --2- 172.21.15.122:0/103555819 >> v2:172.21.15.77:3300/0 conn(0x7f97c815add0 0x7f97c80cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.677 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.673+0000 7f97c7fff640 1 -- 172.21.15.122:0/103555819 >> v2:172.21.15.77:3300/0 conn(0x7f97c815add0 msgr2=0x7f97c80cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:42.677 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.673+0000 7f97c7fff640 1 --2- 172.21.15.122:0/103555819 >> v2:172.21.15.77:3300/0 conn(0x7f97c815add0 0x7f97c80cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.677 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.673+0000 7f97c7fff640 1 -- 172.21.15.122:0/103555819 >> v1:172.21.15.122:6789/0 conn(0x7f97c8072370 legacy=0x7f97c80cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.678 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.673+0000 7f97c6ffd640 1 -- 172.21.15.122:0/103555819 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2664668108 0 0) 0x7f97c80b1cc0 con 0x7f97c8072370 2023-11-04T01:39:42.678 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.673+0000 7f97c7fff640 1 -- 172.21.15.122:0/103555819 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c815a2f0 con 0x7f97c8071f90 2023-11-04T01:39:42.682 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.674+0000 7f97c7fff640 1 --2- 172.21.15.122:0/103555819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97c8071f90 0x7f97c80b1490 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f97c80cec90 tx=0x7f97b802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f4218a15bb83216 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:42.682 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.674+0000 7f97c6ffd640 1 -- 172.21.15.122:0/103555819 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b8031830 con 0x7f97c8071f90 2023-11-04T01:39:42.682 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.674+0000 7f97c6ffd640 1 -- 172.21.15.122:0/103555819 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b8031990 con 0x7f97c8071f90 2023-11-04T01:39:42.682 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.674+0000 7f97c6ffd640 1 -- 172.21.15.122:0/103555819 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b8031d20 con 0x7f97c8071f90 2023-11-04T01:39:42.683 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.675+0000 7f97ce6c2640 1 -- 172.21.15.122:0/103555819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97c8071f90 msgr2=0x7f97c80b1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.683 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.675+0000 7f97ce6c2640 1 --2- 172.21.15.122:0/103555819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97c8071f90 0x7f97c80b1490 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f97c80cec90 tx=0x7f97b802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.683 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.675+0000 7f97ce6c2640 1 -- 172.21.15.122:0/103555819 shutdown_connections 2023-11-04T01:39:42.683 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.675+0000 7f97ce6c2640 1 --2- 172.21.15.122:0/103555819 >> v2:172.21.15.77:3300/0 conn(0x7f97c815add0 0x7f97c80cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.683 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.675+0000 7f97ce6c2640 1 --2- 172.21.15.122:0/103555819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97c8071f90 0x7f97c80b1490 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.684 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.675+0000 7f97ce6c2640 1 -- 172.21.15.122:0/103555819 >> 172.21.15.122:0/103555819 conn(0x7f97c806d800 msgr2=0x7f97c806dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:42.684 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.675+0000 7f97ce6c2640 1 -- 172.21.15.122:0/103555819 shutdown_connections 2023-11-04T01:39:42.684 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.675+0000 7f97ce6c2640 1 -- 172.21.15.122:0/103555819 wait complete. 2023-11-04T01:39:42.684 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.676+0000 7f97ce6c2640 1 Processor -- start 2023-11-04T01:39:42.684 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.676+0000 7f97ce6c2640 1 -- start start 2023-11-04T01:39:42.685 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.677+0000 7f97ce6c2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97c8071f90 0x7f97c80b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.685 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.677+0000 7f97ce6c2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97c8072370 0x7f97c80c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.685 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.677+0000 7f97ce6c2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97c815add0 0x7f97c80c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.685 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.677+0000 7f97ce6c2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c80c9740 con 0x7f97c8072370 2023-11-04T01:39:42.685 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.677+0000 7f97ce6c2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c814d2e0 con 0x7f97c815add0 2023-11-04T01:39:42.686 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.677+0000 7f97ce6c2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c80b4980 con 0x7f97c8071f90 2023-11-04T01:39:42.686 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.677+0000 7f97c7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97c8071f90 0x7f97c80b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.686 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.677+0000 7f97ccc5f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97c815add0 0x7f97c80c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.686 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.677+0000 7f97c7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97c8071f90 0x7f97c80b4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.122:46150/0 (socket says 172.21.15.122:46150) 2023-11-04T01:39:42.686 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.677+0000 7f97c7fff640 1 -- 172.21.15.122:0/959997378 learned_addr learned my addr 172.21.15.122:0/959997378 (peer_addr_for_me v2:172.21.15.122:0/0) 2023-11-04T01:39:42.687 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.677+0000 7f97c77fe640 1 --2- 172.21.15.122:0/959997378 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97c8072370 0x7f97c80c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.687 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.677+0000 7f97c7fff640 1 -- 172.21.15.122:0/959997378 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97c8071f90 msgr2=0x7f97c80b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-11-04T01:39:42.687 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.677+0000 7f97c7fff640 1 -- 172.21.15.122:0/959997378 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97c8071f90 msgr2=0x7f97c80b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-04T01:39:42.687 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.677+0000 7f97c7fff640 1 --2- 172.21.15.122:0/959997378 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97c8071f90 0x7f97c80b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:39:42.687 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.677+0000 7f97c7fff640 1 --2- 172.21.15.122:0/959997378 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97c8071f90 0x7f97c80b4310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:39:42.688 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.677+0000 7f97ccc5f640 1 -- 172.21.15.122:0/959997378 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97c8071f90 msgr2=0x7f97c80b4310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-04T01:39:42.688 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.677+0000 7f97ccc5f640 1 --2- 172.21.15.122:0/959997378 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97c8071f90 0x7f97c80b4310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.689 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.677+0000 7f97ccc5f640 1 -- 172.21.15.122:0/959997378 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97c8072370 msgr2=0x7f97c80c9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.690 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.677+0000 7f97ccc5f640 1 --2- 172.21.15.122:0/959997378 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97c8072370 0x7f97c80c9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.690 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.677+0000 7f97ccc5f640 1 -- 172.21.15.122:0/959997378 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b8009400 con 0x7f97c815add0 2023-11-04T01:39:42.690 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.677+0000 7f97c77fe640 1 --2- 172.21.15.122:0/959997378 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97c8072370 0x7f97c80c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:39:42.690 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.677+0000 7f97ccc5f640 1 --2- 172.21.15.122:0/959997378 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97c815add0 0x7f97c80c8660 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f97c0001560 tx=0x7f97c000cbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:42.690 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.678+0000 7f97c4ff9640 1 -- 172.21.15.122:0/959997378 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c000ce30 con 0x7f97c815add0 2023-11-04T01:39:42.691 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.678+0000 7f97c4ff9640 1 -- 172.21.15.122:0/959997378 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c000a640 con 0x7f97c815add0 2023-11-04T01:39:42.691 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.678+0000 7f97c4ff9640 1 -- 172.21.15.122:0/959997378 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c000aa10 con 0x7f97c815add0 2023-11-04T01:39:42.691 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.678+0000 7f97ce6c2640 1 -- 172.21.15.122:0/959997378 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97c814ca40 con 0x7f97c815add0 2023-11-04T01:39:42.691 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.678+0000 7f97ce6c2640 1 -- 172.21.15.122:0/959997378 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97c814d000 con 0x7f97c815add0 2023-11-04T01:39:42.691 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.678+0000 7f97c4ff9640 1 -- 172.21.15.122:0/959997378 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f97c00070d0 con 0x7f97c815add0 2023-11-04T01:39:42.692 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.678+0000 7f97c4ff9640 1 -- 172.21.15.122:0/959997378 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f97c00129f0 con 0x7f97c815add0 2023-11-04T01:39:42.692 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.679+0000 7f97ce6c2640 1 -- 172.21.15.122:0/959997378 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97c80b2170 con 0x7f97c815add0 2023-11-04T01:39:42.692 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-04T01:39:42.682+0000 7fe521e56040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-04T01:39:42.693 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.681+0000 7f97c4ff9640 1 -- 172.21.15.122:0/959997378 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f97c0018070 con 0x7f97c815add0 2023-11-04T01:39:42.725 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-11-04T01:39:42.723+0000 7fd6e0c0d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-04T01:39:42.728 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-04T01:39:42.726+0000 7fe521e56040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-04T01:39:42.766 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.764+0000 7f97ce6c2640 1 -- 172.21.15.122:0/959997378 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd new", "uuid": "389bd9eb-d184-4cef-b0b3-d394fc66d6ba", "id": 6} v 0) v1 -- 0x7f97c80718d0 con 0x7f97c815add0 2023-11-04T01:39:42.770 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-11-04T01:39:42.768+0000 7fd6e0c0d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-04T01:39:42.771 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.769+0000 7f97c4ff9640 1 -- 172.21.15.122:0/959997378 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "389bd9eb-d184-4cef-b0b3-d394fc66d6ba", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f97c0012400 con 0x7f97c815add0 2023-11-04T01:39:42.771 INFO:teuthology.orchestra.run.smithi122.stdout:6 2023-11-04T01:39:42.772 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.770+0000 7f97ce6c2640 1 -- 172.21.15.122:0/959997378 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97c815add0 msgr2=0x7f97c80c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.772 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.770+0000 7f97ce6c2640 1 --2- 172.21.15.122:0/959997378 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97c815add0 0x7f97c80c8660 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f97c0001560 tx=0x7f97c000cbe0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.772 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.770+0000 7f97ce6c2640 1 -- 172.21.15.122:0/959997378 shutdown_connections 2023-11-04T01:39:42.773 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.770+0000 7f97ce6c2640 1 --2- 172.21.15.122:0/959997378 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97c815add0 0x7f97c80c8660 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.773 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.770+0000 7f97ce6c2640 1 --2- 172.21.15.122:0/959997378 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97c8072370 0x7f97c80c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.773 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.770+0000 7f97ce6c2640 1 --2- 172.21.15.122:0/959997378 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97c8071f90 0x7f97c80b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.773 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.770+0000 7f97ce6c2640 1 -- 172.21.15.122:0/959997378 >> 172.21.15.122:0/959997378 conn(0x7f97c806d800 msgr2=0x7f97c80cdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:42.773 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.770+0000 7f97ce6c2640 1 -- 172.21.15.122:0/959997378 shutdown_connections 2023-11-04T01:39:42.774 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.770+0000 7f97ce6c2640 1 -- 172.21.15.122:0/959997378 wait complete. 2023-11-04T01:39:42.781 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-04T01:39:42.780+0000 7fe521e56040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-04T01:39:42.782 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd new 10dc21d5-f4a9-45fe-aef7-86edd176ff05 7 2023-11-04T01:39:42.825 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-04T01:39:42.823+0000 7fe521e56040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-04T01:39:42.828 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-11-04T01:39:42.827+0000 7fd6e0c0d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-04T01:39:42.872 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-11-04T01:39:42.870+0000 7fd6e0c0d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-04T01:39:42.881 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.879+0000 7fc2f9621640 1 Processor -- start 2023-11-04T01:39:42.882 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.879+0000 7fc2f9621640 1 -- start start 2023-11-04T01:39:42.884 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.880+0000 7fc2f9621640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc2f4159c40 0x7fc2f415e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.884 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.880+0000 7fc2f9621640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc2f40ceb30 0x7fc2f40cad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.885 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.880+0000 7fc2f9621640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f40cb5f0 con 0x7fc2f4070f80 2023-11-04T01:39:42.885 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.880+0000 7fc2f9621640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f40ce710 con 0x7fc2f4159c40 2023-11-04T01:39:42.885 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.880+0000 7fc2f9621640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f40cefe0 con 0x7fc2f40ceb30 2023-11-04T01:39:42.885 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.880+0000 7fc2f27fc640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc2f40ceb30 0x7fc2f40cad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.886 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.880+0000 7fc2f37fe640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fc2f4070f80 0x7fc2f40ccd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.122:53002/0 (socket says 172.21.15.122:53002) 2023-11-04T01:39:42.886 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.880+0000 7fc2f27fc640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc2f40ceb30 0x7fc2f40cad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37788/0 (socket says 172.21.15.122:37788) 2023-11-04T01:39:42.886 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.880+0000 7fc2f37fe640 1 -- 172.21.15.122:0/4091640491 learned_addr learned my addr 172.21.15.122:0/4091640491 (peer_addr_for_me v1:172.21.15.122:0/0) 2023-11-04T01:39:42.886 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.880+0000 7fc2f2ffd640 1 --2- 172.21.15.122:0/4091640491 >> v2:172.21.15.77:3300/0 conn(0x7fc2f4159c40 0x7fc2f415e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.887 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.880+0000 7fc2f27fc640 1 -- 172.21.15.122:0/4091640491 >> v2:172.21.15.77:3300/0 conn(0x7fc2f4159c40 msgr2=0x7fc2f415e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:42.887 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.880+0000 7fc2f27fc640 1 --2- 172.21.15.122:0/4091640491 >> v2:172.21.15.77:3300/0 conn(0x7fc2f4159c40 0x7fc2f415e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.887 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.880+0000 7fc2f27fc640 1 -- 172.21.15.122:0/4091640491 >> v1:172.21.15.122:6789/0 conn(0x7fc2f4070f80 legacy=0x7fc2f40ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.887 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.880+0000 7fc2f1ffb640 1 -- 172.21.15.122:0/4091640491 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3074642753 0 0) 0x7fc2f40cb5f0 con 0x7fc2f4070f80 2023-11-04T01:39:42.887 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.880+0000 7fc2f27fc640 1 -- 172.21.15.122:0/4091640491 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f40cb8d0 con 0x7fc2f40ceb30 2023-11-04T01:39:42.888 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.881+0000 7fc2f27fc640 1 --2- 172.21.15.122:0/4091640491 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2f40ceb30 0x7fc2f40cad00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4071d60 tx=0x7fc2e402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43547c7e3221c215 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:42.888 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.882+0000 7fc2f1ffb640 1 -- 172.21.15.122:0/4091640491 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4031830 con 0x7fc2f40ceb30 2023-11-04T01:39:42.888 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.882+0000 7fc2f1ffb640 1 -- 172.21.15.122:0/4091640491 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e4031990 con 0x7fc2f40ceb30 2023-11-04T01:39:42.888 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.882+0000 7fc2f1ffb640 1 -- 172.21.15.122:0/4091640491 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4031d20 con 0x7fc2f40ceb30 2023-11-04T01:39:42.888 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.882+0000 7fc2f9621640 1 -- 172.21.15.122:0/4091640491 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2f40ceb30 msgr2=0x7fc2f40cad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.889 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.882+0000 7fc2f9621640 1 --2- 172.21.15.122:0/4091640491 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2f40ceb30 0x7fc2f40cad00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4071d60 tx=0x7fc2e402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.889 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.882+0000 7fc2f9621640 1 -- 172.21.15.122:0/4091640491 shutdown_connections 2023-11-04T01:39:42.889 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.882+0000 7fc2f9621640 1 --2- 172.21.15.122:0/4091640491 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2f40ceb30 0x7fc2f40cad00 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.889 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.882+0000 7fc2f9621640 1 --2- 172.21.15.122:0/4091640491 >> v2:172.21.15.77:3300/0 conn(0x7fc2f4159c40 0x7fc2f415e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.889 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.882+0000 7fc2f9621640 1 -- 172.21.15.122:0/4091640491 >> 172.21.15.122:0/4091640491 conn(0x7fc2f40cf140 msgr2=0x7fc2f40cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:42.890 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.882+0000 7fc2f9621640 1 -- 172.21.15.122:0/4091640491 shutdown_connections 2023-11-04T01:39:42.890 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.882+0000 7fc2f9621640 1 -- 172.21.15.122:0/4091640491 wait complete. 2023-11-04T01:39:42.893 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.884+0000 7fc2f9621640 1 Processor -- start 2023-11-04T01:39:42.893 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.884+0000 7fc2f9621640 1 -- start start 2023-11-04T01:39:42.893 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.884+0000 7fc2f9621640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2f4070f80 0x7fc2f414fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.893 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.884+0000 7fc2f9621640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc2f40ceb30 0x7fc2f415d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.894 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.884+0000 7fc2f9621640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2f4159c40 0x7fc2f415dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:42.894 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.884+0000 7fc2f9621640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f40c5aa0 con 0x7fc2f4070f80 2023-11-04T01:39:42.894 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.884+0000 7fc2f9621640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f415b6f0 con 0x7fc2f4159c40 2023-11-04T01:39:42.894 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.884+0000 7fc2f9621640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f415b9d0 con 0x7fc2f40ceb30 2023-11-04T01:39:42.894 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.884+0000 7fc2f37fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2f4159c40 0x7fc2f415dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.895 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.884+0000 7fc2f27fc640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc2f40ceb30 0x7fc2f415d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.895 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.884+0000 7fc2f27fc640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc2f40ceb30 0x7fc2f415d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.122:46162/0 (socket says 172.21.15.122:46162) 2023-11-04T01:39:42.895 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.884+0000 7fc2f2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2f4070f80 0x7fc2f414fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:42.895 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.884+0000 7fc2f27fc640 1 -- 172.21.15.122:0/2176264284 learned_addr learned my addr 172.21.15.122:0/2176264284 (peer_addr_for_me v2:172.21.15.122:0/0) 2023-11-04T01:39:42.895 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.884+0000 7fc2f37fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2f4159c40 0x7fc2f415dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37790/0 (socket says 172.21.15.122:37790) 2023-11-04T01:39:42.896 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.885+0000 7fc2f27fc640 1 -- 172.21.15.122:0/2176264284 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc2f40ceb30 msgr2=0x7fc2f415d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-11-04T01:39:42.896 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.885+0000 7fc2f27fc640 1 -- 172.21.15.122:0/2176264284 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc2f40ceb30 msgr2=0x7fc2f415d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-04T01:39:42.896 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.885+0000 7fc2f27fc640 1 --2- 172.21.15.122:0/2176264284 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc2f40ceb30 0x7fc2f415d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:39:42.896 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.885+0000 7fc2f27fc640 1 --2- 172.21.15.122:0/2176264284 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc2f40ceb30 0x7fc2f415d740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:39:42.896 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.885+0000 7fc2f2ffd640 1 -- 172.21.15.122:0/2176264284 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc2f40ceb30 msgr2=0x7fc2f415d740 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-04T01:39:42.897 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.885+0000 7fc2f2ffd640 1 --2- 172.21.15.122:0/2176264284 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc2f40ceb30 0x7fc2f415d740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.897 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.885+0000 7fc2f2ffd640 1 -- 172.21.15.122:0/2176264284 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2f4159c40 msgr2=0x7fc2f415dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.897 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.885+0000 7fc2f2ffd640 1 --2- 172.21.15.122:0/2176264284 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2f4159c40 0x7fc2f415dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.897 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.885+0000 7fc2f2ffd640 1 -- 172.21.15.122:0/2176264284 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e4009400 con 0x7fc2f4070f80 2023-11-04T01:39:42.897 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.885+0000 7fc2f2ffd640 1 --2- 172.21.15.122:0/2176264284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2f4070f80 0x7fc2f414fec0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc2e800e870 tx=0x7fc2e800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:42.898 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.885+0000 7fc2db7fe640 1 -- 172.21.15.122:0/2176264284 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e800c940 con 0x7fc2f4070f80 2023-11-04T01:39:42.898 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.885+0000 7fc2db7fe640 1 -- 172.21.15.122:0/2176264284 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e800cac0 con 0x7fc2f4070f80 2023-11-04T01:39:42.898 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.885+0000 7fc2f9621640 1 -- 172.21.15.122:0/2176264284 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f415bcb0 con 0x7fc2f4070f80 2023-11-04T01:39:42.898 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.885+0000 7fc2db7fe640 1 -- 172.21.15.122:0/2176264284 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e800ce70 con 0x7fc2f4070f80 2023-11-04T01:39:42.898 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.885+0000 7fc2f9621640 1 -- 172.21.15.122:0/2176264284 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f415c4b0 con 0x7fc2f4070f80 2023-11-04T01:39:42.899 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.885+0000 7fc2db7fe640 1 -- 172.21.15.122:0/2176264284 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc2e8004320 con 0x7fc2f4070f80 2023-11-04T01:39:42.899 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.885+0000 7fc2db7fe640 1 -- 172.21.15.122:0/2176264284 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fc2e8005ff0 con 0x7fc2f4070f80 2023-11-04T01:39:42.899 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.886+0000 7fc2f9621640 1 -- 172.21.15.122:0/2176264284 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f415c1d0 con 0x7fc2f4070f80 2023-11-04T01:39:42.899 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.888+0000 7fc2db7fe640 1 -- 172.21.15.122:0/2176264284 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fc2f415c1d0 con 0x7fc2f4070f80 2023-11-04T01:39:42.926 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-04T01:39:42.924+0000 7fe521e56040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-04T01:39:42.959 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.958+0000 7fc2f9621640 1 -- 172.21.15.122:0/2176264284 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd new", "uuid": "10dc21d5-f4a9-45fe-aef7-86edd176ff05", "id": 7} v 0) v1 -- 0x7fc2f415c6a0 con 0x7fc2f4070f80 2023-11-04T01:39:42.961 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.959+0000 7fc2db7fe640 1 -- 172.21.15.122:0/2176264284 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "10dc21d5-f4a9-45fe-aef7-86edd176ff05", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc2e8021060 con 0x7fc2f4070f80 2023-11-04T01:39:42.961 INFO:teuthology.orchestra.run.smithi122.stdout:7 2023-11-04T01:39:42.963 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.960+0000 7fc2f9621640 1 -- 172.21.15.122:0/2176264284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2f4070f80 msgr2=0x7fc2f414fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:42.963 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.960+0000 7fc2f9621640 1 --2- 172.21.15.122:0/2176264284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2f4070f80 0x7fc2f414fec0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc2e800e870 tx=0x7fc2e800ed30 comp rx=0 tx=0).stop 2023-11-04T01:39:42.963 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.960+0000 7fc2f9621640 1 -- 172.21.15.122:0/2176264284 shutdown_connections 2023-11-04T01:39:42.963 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.960+0000 7fc2f9621640 1 --2- 172.21.15.122:0/2176264284 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2f4159c40 0x7fc2f415dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.964 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.960+0000 7fc2f9621640 1 --2- 172.21.15.122:0/2176264284 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc2f40ceb30 0x7fc2f415d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.964 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.960+0000 7fc2f9621640 1 --2- 172.21.15.122:0/2176264284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2f4070f80 0x7fc2f414fec0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:42.964 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.960+0000 7fc2f9621640 1 -- 172.21.15.122:0/2176264284 >> 172.21.15.122:0/2176264284 conn(0x7fc2f40cf140 msgr2=0x7fc2f40b0350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:42.964 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.960+0000 7fc2f9621640 1 -- 172.21.15.122:0/2176264284 shutdown_connections 2023-11-04T01:39:42.965 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:39:42.960+0000 7fc2f9621640 1 -- 172.21.15.122:0/2176264284 wait complete. 2023-11-04T01:39:42.972 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-04T01:39:42.972 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-04T01:39:42.975 INFO:tasks.ceph.osd.0:Started 2023-11-04T01:39:42.975 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-04T01:39:42.975 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-04T01:39:42.976 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-11-04T01:39:42.974+0000 7fd6e0c0d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-04T01:39:42.978 INFO:tasks.ceph.osd.1:Started 2023-11-04T01:39:42.978 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-04T01:39:42.978 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-04T01:39:42.980 INFO:tasks.ceph.osd.2:Started 2023-11-04T01:39:42.981 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-04T01:39:42.981 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-04T01:39:42.983 INFO:tasks.ceph.osd.3:Started 2023-11-04T01:39:42.984 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-04T01:39:42.984 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-04T01:39:42.988 INFO:tasks.ceph.osd.4:Started 2023-11-04T01:39:42.989 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-04T01:39:42.989 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-04T01:39:42.991 INFO:tasks.ceph.osd.5:Started 2023-11-04T01:39:42.992 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-04T01:39:42.992 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-04T01:39:42.994 INFO:tasks.ceph.osd.6:Started 2023-11-04T01:39:42.994 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-04T01:39:42.995 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-04T01:39:42.997 INFO:tasks.ceph.osd.7:Started 2023-11-04T01:39:42.997 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:43.003 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-04T01:39:43.002+0000 7fe521e56040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-04T01:39:43.060 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-11-04T01:39:43.058+0000 7fd6e0c0d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-04T01:39:43.076 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-04T01:39:43.075+0000 7fe521e56040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-04T01:39:43.111 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-11-04T01:39:43.109+0000 7fd6e0c0d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-04T01:39:43.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.124+0000 7f82f4b7c640 1 Processor -- start 2023-11-04T01:39:43.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.124+0000 7f82f4b7c640 1 -- start start 2023-11-04T01:39:43.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.125+0000 7f82f4b7c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82f006a830 0x7f82f00b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.125+0000 7f82f4b7c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f82f00b18b0 0x7f82f015e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.125+0000 7f82f4b7c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82f015e6e0 con 0x7f82f00cce10 2023-11-04T01:39:43.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.125+0000 7f82f4b7c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f015dd10 con 0x7f82f00b18b0 2023-11-04T01:39:43.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.125+0000 7f82f4b7c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f015d720 con 0x7f82f006a830 2023-11-04T01:39:43.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.125+0000 7f82e7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82f006a830 0x7f82f00b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.125+0000 7f82e7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82f006a830 0x7f82f00b1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:44670/0 (socket says 172.21.15.77:44670) 2023-11-04T01:39:43.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.125+0000 7f82e7fff640 1 -- 172.21.15.77:0/111959499 learned_addr learned my addr 172.21.15.77:0/111959499 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:39:43.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.125+0000 7f82eed9d640 1 --2- 172.21.15.77:0/111959499 >> v2:172.21.15.122:3300/0 conn(0x7f82f00b18b0 0x7f82f015e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.125+0000 7f82e7fff640 1 -- 172.21.15.77:0/111959499 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82f006a830 msgr2=0x7f82f00b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-04T01:39:43.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.125+0000 7f82e7fff640 1 -- 172.21.15.77:0/111959499 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82f006a830 msgr2=0x7f82f00b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:39:43.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.125+0000 7f82e7fff640 1 --2- 172.21.15.77:0/111959499 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82f006a830 0x7f82f00b1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:39:43.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.125+0000 7f82e7fff640 1 --2- 172.21.15.77:0/111959499 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82f006a830 0x7f82f00b1fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:39:43.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.125+0000 7f82edd9b640 1 -- 172.21.15.77:0/111959499 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1710095107 0 0) 0x7f82e0001110 con 0x7f82f00cce10 2023-11-04T01:39:43.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.125+0000 7f82edd9b640 1 -- 172.21.15.77:0/111959499 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82dc003520 con 0x7f82f00cce10 2023-11-04T01:39:43.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.125+0000 7f82eed9d640 1 -- 172.21.15.77:0/111959499 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82f006a830 msgr2=0x7f82f00b1fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:39:43.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.125+0000 7f82eed9d640 1 --2- 172.21.15.77:0/111959499 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82f006a830 0x7f82f00b1fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.125+0000 7f82eed9d640 1 -- 172.21.15.77:0/111959499 >> v1:172.21.15.122:6789/0 conn(0x7f82f00cce10 legacy=0x7f82f006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.126+0000 7f82eed9d640 1 -- 172.21.15.77:0/111959499 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f006fe00 con 0x7f82f00b18b0 2023-11-04T01:39:43.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.126+0000 7f82eed9d640 1 --2- 172.21.15.77:0/111959499 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82f00b18b0 0x7f82f015e1a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009d90 tx=0x7f82e802bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f6f7931e13e62d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:43.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.126+0000 7f82edd9b640 1 -- 172.21.15.77:0/111959499 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e802cb30 con 0x7f82f00b18b0 2023-11-04T01:39:43.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.126+0000 7f82edd9b640 1 -- 172.21.15.77:0/111959499 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e802cc90 con 0x7f82f00b18b0 2023-11-04T01:39:43.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.126+0000 7f82edd9b640 1 -- 172.21.15.77:0/111959499 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e8034440 con 0x7f82f00b18b0 2023-11-04T01:39:43.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.127+0000 7f82f4b7c640 1 -- 172.21.15.77:0/111959499 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82f00b18b0 msgr2=0x7f82f015e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.127+0000 7f82f4b7c640 1 --2- 172.21.15.77:0/111959499 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82f00b18b0 0x7f82f015e1a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009d90 tx=0x7f82e802bd80 comp rx=0 tx=0).stop 2023-11-04T01:39:43.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.127+0000 7f82f4b7c640 1 -- 172.21.15.77:0/111959499 shutdown_connections 2023-11-04T01:39:43.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.127+0000 7f82f4b7c640 1 --2- 172.21.15.77:0/111959499 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82f00b18b0 0x7f82f015e1a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.127+0000 7f82f4b7c640 1 --2- 172.21.15.77:0/111959499 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82f006a830 0x7f82f00b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.127+0000 7f82f4b7c640 1 -- 172.21.15.77:0/111959499 >> 172.21.15.77:0/111959499 conn(0x7f82f006d8b0 msgr2=0x7f82f006dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:43.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.127+0000 7f82f4b7c640 1 -- 172.21.15.77:0/111959499 shutdown_connections 2023-11-04T01:39:43.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.127+0000 7f82f4b7c640 1 -- 172.21.15.77:0/111959499 wait complete. 2023-11-04T01:39:43.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.128+0000 7f82f4b7c640 1 Processor -- start 2023-11-04T01:39:43.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.128+0000 7f82f4b7c640 1 -- start start 2023-11-04T01:39:43.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.129+0000 7f82f4b7c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82f006a830 0x7f82f00b3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.129+0000 7f82f4b7c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82f00b18b0 0x7f82f015c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.129+0000 7f82f4b7c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82f00cce10 0x7f82f00b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:43.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.129+0000 7f82f4b7c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f00b26c0 con 0x7f82f00cce10 2023-11-04T01:39:43.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.129+0000 7f82f4b7c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f00b29a0 con 0x7f82f006a830 2023-11-04T01:39:43.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.129+0000 7f82f4b7c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f00b2c80 con 0x7f82f00b18b0 2023-11-04T01:39:43.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.129+0000 7f82eed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82f00cce10 0x7f82f00b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.129+0000 7f82eed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82f00cce10 0x7f82f00b1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41624/0 (socket says 172.21.15.77:41624) 2023-11-04T01:39:43.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.129+0000 7f82eed9d640 1 -- 172.21.15.77:0/1152474781 learned_addr learned my addr 172.21.15.77:0/1152474781 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:39:43.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.130+0000 7f82e7fff640 1 --2- 172.21.15.77:0/1152474781 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82f00b18b0 0x7f82f015c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.130+0000 7f82ee59c640 1 --2- 172.21.15.77:0/1152474781 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82f006a830 0x7f82f00b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:43.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.130+0000 7f82e7fff640 1 -- 172.21.15.77:0/1152474781 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82f00b18b0 msgr2=0x7f82f015c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-11-04T01:39:43.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.130+0000 7f82e7fff640 1 -- 172.21.15.77:0/1152474781 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82f00b18b0 msgr2=0x7f82f015c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-04T01:39:43.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.130+0000 7f82e7fff640 1 --2- 172.21.15.77:0/1152474781 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82f00b18b0 0x7f82f015c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:39:43.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.130+0000 7f82e7fff640 1 --2- 172.21.15.77:0/1152474781 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82f00b18b0 0x7f82f015c240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:39:43.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.130+0000 7f82eed9d640 1 -- 172.21.15.77:0/1152474781 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82f00b18b0 msgr2=0x7f82f015c240 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-04T01:39:43.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.130+0000 7f82eed9d640 1 --2- 172.21.15.77:0/1152474781 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82f00b18b0 0x7f82f015c240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.130+0000 7f82eed9d640 1 -- 172.21.15.77:0/1152474781 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82f006a830 msgr2=0x7f82f00b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.130+0000 7f82eed9d640 1 --2- 172.21.15.77:0/1152474781 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82f006a830 0x7f82f00b3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.130+0000 7f82eed9d640 1 -- 172.21.15.77:0/1152474781 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e8009a70 con 0x7f82f00cce10 2023-11-04T01:39:43.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.130+0000 7f82eed9d640 1 --2- 172.21.15.77:0/1152474781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82f00cce10 0x7f82f00b1fc0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009d90 tx=0x7f82e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:43.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.130+0000 7f82e6ffd640 1 -- 172.21.15.77:0/1152474781 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e8009450 con 0x7f82f00cce10 2023-11-04T01:39:43.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.130+0000 7f82e6ffd640 1 -- 172.21.15.77:0/1152474781 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e8040450 con 0x7f82f00cce10 2023-11-04T01:39:43.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.130+0000 7f82f4b7c640 1 -- 172.21.15.77:0/1152474781 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f00b2f60 con 0x7f82f00cce10 2023-11-04T01:39:43.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.130+0000 7f82e6ffd640 1 -- 172.21.15.77:0/1152474781 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e8040800 con 0x7f82f00cce10 2023-11-04T01:39:43.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.130+0000 7f82f4b7c640 1 -- 172.21.15.77:0/1152474781 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f0152c10 con 0x7f82f00cce10 2023-11-04T01:39:43.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.130+0000 7f82e6ffd640 1 -- 172.21.15.77:0/1152474781 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f82e8040c60 con 0x7f82f00cce10 2023-11-04T01:39:43.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.130+0000 7f82e6ffd640 1 -- 172.21.15.77:0/1152474781 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f82e8049cf0 con 0x7f82f00cce10 2023-11-04T01:39:43.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.131+0000 7f82f4b7c640 1 -- 172.21.15.77:0/1152474781 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f015c040 con 0x7f82f00cce10 2023-11-04T01:39:43.145 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-04T01:39:43.131+0000 7fe521e56040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-04T01:39:43.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.133+0000 7f82e6ffd640 1 -- 172.21.15.77:0/1152474781 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f82e8044020 con 0x7f82f00cce10 2023-11-04T01:39:43.163 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-11-04T01:39:43.162+0000 7fd6e0c0d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-04T01:39:43.181 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-04T01:39:43.180+0000 7fe521e56040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-04T01:39:43.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.193+0000 7f82f4b7c640 1 -- 172.21.15.77:0/1152474781 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82f00b59a0 con 0x7f82f00cce10 2023-11-04T01:39:43.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.193+0000 7f82e6ffd640 1 -- 172.21.15.77:0/1152474781 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f82e8039070 con 0x7f82f00cce10 2023-11-04T01:39:43.195 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:39:43.196 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":10,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:39:42.959637+0000","last_up_change":"0.000000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:43.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.194+0000 7f82f4b7c640 1 -- 172.21.15.77:0/1152474781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82f00cce10 msgr2=0x7f82f00b1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:43.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.194+0000 7f82f4b7c640 1 --2- 172.21.15.77:0/1152474781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82f00cce10 0x7f82f00b1fc0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009d90 tx=0x7f82e8004a40 comp rx=0 tx=0).stop 2023-11-04T01:39:43.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.194+0000 7f82f4b7c640 1 -- 172.21.15.77:0/1152474781 shutdown_connections 2023-11-04T01:39:43.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.194+0000 7f82f4b7c640 1 --2- 172.21.15.77:0/1152474781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82f00cce10 0x7f82f00b1fc0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.194+0000 7f82f4b7c640 1 --2- 172.21.15.77:0/1152474781 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f82f00b18b0 0x7f82f015c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.194+0000 7f82f4b7c640 1 --2- 172.21.15.77:0/1152474781 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82f006a830 0x7f82f00b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:43.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.194+0000 7f82f4b7c640 1 -- 172.21.15.77:0/1152474781 >> 172.21.15.77:0/1152474781 conn(0x7f82f006d8b0 msgr2=0x7f82f00b0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:43.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.194+0000 7f82f4b7c640 1 -- 172.21.15.77:0/1152474781 shutdown_connections 2023-11-04T01:39:43.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:43.194+0000 7f82f4b7c640 1 -- 172.21.15.77:0/1152474781 wait complete. 2023-11-04T01:39:43.206 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-04T01:39:43.207 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-04T01:39:43.209 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-11-04T01:39:43.207+0000 7fd6e0c0d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-04T01:39:43.562 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-04T01:39:43.561+0000 7fe521e56040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-04T01:39:43.583 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-11-04T01:39:43.581+0000 7fd6e0c0d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-04T01:39:43.595 INFO:tasks.ceph.osd.4.smithi122.stderr:2023-11-04T01:39:43.593+0000 7f3e97810500 -1 Falling back to public interface 2023-11-04T01:39:43.596 INFO:tasks.ceph.osd.5.smithi122.stderr:2023-11-04T01:39:43.594+0000 7f5b3bcaf500 -1 Falling back to public interface 2023-11-04T01:39:43.599 INFO:tasks.ceph.osd.1.smithi077.stderr:2023-11-04T01:39:43.598+0000 7fec5882a500 -1 Falling back to public interface 2023-11-04T01:39:43.602 INFO:tasks.ceph.osd.0.smithi077.stderr:2023-11-04T01:39:43.600+0000 7f014a81a500 -1 Falling back to public interface 2023-11-04T01:39:43.603 INFO:tasks.ceph.osd.2.smithi077.stderr:2023-11-04T01:39:43.601+0000 7fa7c9f8d500 -1 Falling back to public interface 2023-11-04T01:39:43.611 INFO:tasks.ceph.osd.6.smithi122.stderr:2023-11-04T01:39:43.609+0000 7f17d28b6500 -1 Falling back to public interface 2023-11-04T01:39:43.615 INFO:tasks.ceph.osd.3.smithi077.stderr:2023-11-04T01:39:43.613+0000 7fa50da1f500 -1 Falling back to public interface 2023-11-04T01:39:43.620 INFO:tasks.ceph.osd.7.smithi122.stderr:2023-11-04T01:39:43.618+0000 7f0f05a1f500 -1 Falling back to public interface 2023-11-04T01:39:43.701 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-04T01:39:43.700+0000 7fe521e56040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-04T01:39:43.718 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-11-04T01:39:43.717+0000 7fd6e0c0d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-04T01:39:43.832 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-04T01:39:43.831+0000 7fe521e56040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-04T01:39:43.837 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-11-04T01:39:43.835+0000 7fd6e0c0d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-04T01:39:43.879 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-04T01:39:43.877+0000 7fe521e56040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-04T01:39:43.883 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-11-04T01:39:43.881+0000 7fd6e0c0d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-04T01:39:43.976 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-04T01:39:43.974+0000 7fe521e56040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-04T01:39:43.980 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-11-04T01:39:43.978+0000 7fd6e0c0d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-04T01:39:44.014 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:44.072 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-04T01:39:44.071+0000 7fe521e56040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-04T01:39:44.073 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-11-04T01:39:44.071+0000 7fd6e0c0d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-04T01:39:44.103 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.102+0000 7f3c38261640 1 Processor -- start 2023-11-04T01:39:44.104 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.102+0000 7f3c38261640 1 -- start start 2023-11-04T01:39:44.106 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.102+0000 7f3c38261640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3c3015cd70 0x7f3c300ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:44.106 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.103+0000 7f3c38261640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3c3015d150 0x7f3c300b2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:44.106 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.103+0000 7f3c38261640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c3006bc40 con 0x7f3c300cf1d0 2023-11-04T01:39:44.106 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.103+0000 7f3c38261640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c300ced70 con 0x7f3c3015d150 2023-11-04T01:39:44.107 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.103+0000 7f3c38261640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c300cf790 con 0x7f3c3015cd70 2023-11-04T01:39:44.107 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.103+0000 7f3c367fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f3c300cf1d0 0x7f3c30160b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:37754/0 (socket says 172.21.15.77:37754) 2023-11-04T01:39:44.107 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.103+0000 7f3c367fe640 1 -- 172.21.15.77:0/4282824 learned_addr learned my addr 172.21.15.77:0/4282824 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:39:44.107 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.103+0000 7f3c35ffd640 1 --2- 172.21.15.77:0/4282824 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3c3015cd70 0x7f3c300ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:44.108 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.103+0000 7f3c357fc640 1 --2- 172.21.15.77:0/4282824 >> v2:172.21.15.122:3300/0 conn(0x7f3c3015d150 0x7f3c300b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:44.108 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.103+0000 7f3c35ffd640 1 -- 172.21.15.77:0/4282824 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3c3015cd70 msgr2=0x7f3c300ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-04T01:39:44.108 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.103+0000 7f3c35ffd640 1 -- 172.21.15.77:0/4282824 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3c3015cd70 msgr2=0x7f3c300ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:39:44.108 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.103+0000 7f3c35ffd640 1 --2- 172.21.15.77:0/4282824 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3c3015cd70 0x7f3c300ce830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:39:44.108 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.103+0000 7f3c35ffd640 1 --2- 172.21.15.77:0/4282824 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3c3015cd70 0x7f3c300ce830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:39:44.109 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.103+0000 7f3c34ffb640 1 -- 172.21.15.77:0/4282824 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2534236340 0 0) 0x7f3c3006bc40 con 0x7f3c300cf1d0 2023-11-04T01:39:44.109 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.103+0000 7f3c34ffb640 1 -- 172.21.15.77:0/4282824 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c1c003520 con 0x7f3c300cf1d0 2023-11-04T01:39:44.109 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.103+0000 7f3c357fc640 1 -- 172.21.15.77:0/4282824 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3c3015cd70 msgr2=0x7f3c300ce830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:39:44.109 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.103+0000 7f3c357fc640 1 --2- 172.21.15.77:0/4282824 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3c3015cd70 0x7f3c300ce830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:44.109 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.103+0000 7f3c357fc640 1 -- 172.21.15.77:0/4282824 >> v1:172.21.15.77:6789/0 conn(0x7f3c300cf1d0 legacy=0x7f3c30160b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:44.110 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.103+0000 7f3c34ffb640 1 -- 172.21.15.77:0/4282824 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 453441315 0 0) 0x7f3c1c003520 con 0x7f3c300cf1d0 2023-11-04T01:39:44.110 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.103+0000 7f3c357fc640 1 -- 172.21.15.77:0/4282824 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3006be90 con 0x7f3c3015d150 2023-11-04T01:39:44.110 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.104+0000 7f3c357fc640 1 --2- 172.21.15.77:0/4282824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c3015d150 0x7f3c300b2670 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3c200097a0 tx=0x7f3c2002b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1fdd7be78ca300b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:44.110 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.104+0000 7f3c34ffb640 1 -- 172.21.15.77:0/4282824 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c280019f0 con 0x7f3c3015d150 2023-11-04T01:39:44.110 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.104+0000 7f3c34ffb640 1 -- 172.21.15.77:0/4282824 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2002e050 con 0x7f3c3015d150 2023-11-04T01:39:44.111 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.104+0000 7f3c34ffb640 1 -- 172.21.15.77:0/4282824 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c20030730 con 0x7f3c3015d150 2023-11-04T01:39:44.116 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.105+0000 7f3c38261640 1 -- 172.21.15.77:0/4282824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c3015d150 msgr2=0x7f3c300b2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:44.116 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.105+0000 7f3c38261640 1 --2- 172.21.15.77:0/4282824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c3015d150 0x7f3c300b2670 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3c200097a0 tx=0x7f3c2002b790 comp rx=0 tx=0).stop 2023-11-04T01:39:44.116 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.105+0000 7f3c38261640 1 -- 172.21.15.77:0/4282824 shutdown_connections 2023-11-04T01:39:44.116 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.105+0000 7f3c38261640 1 --2- 172.21.15.77:0/4282824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c3015d150 0x7f3c300b2670 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:44.117 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.105+0000 7f3c38261640 1 --2- 172.21.15.77:0/4282824 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3c3015cd70 0x7f3c300ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:44.117 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.105+0000 7f3c38261640 1 -- 172.21.15.77:0/4282824 >> 172.21.15.77:0/4282824 conn(0x7f3c3006ea40 msgr2=0x7f3c3006ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:44.117 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.105+0000 7f3c38261640 1 -- 172.21.15.77:0/4282824 shutdown_connections 2023-11-04T01:39:44.117 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.105+0000 7f3c38261640 1 -- 172.21.15.77:0/4282824 wait complete. 2023-11-04T01:39:44.117 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.106+0000 7f3c38261640 1 Processor -- start 2023-11-04T01:39:44.118 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.106+0000 7f3c38261640 1 -- start start 2023-11-04T01:39:44.118 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.107+0000 7f3c38261640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c300cf1d0 0x7f3c30151e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:44.118 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.107+0000 7f3c38261640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3c3015cd70 0x7f3c30151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:44.118 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.107+0000 7f3c38261640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c3015d150 0x7f3c300ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:44.118 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.107+0000 7f3c38261640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c300c9e80 con 0x7f3c3015d150 2023-11-04T01:39:44.119 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.107+0000 7f3c38261640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c300c9200 con 0x7f3c300cf1d0 2023-11-04T01:39:44.119 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.107+0000 7f3c38261640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c300c94e0 con 0x7f3c3015cd70 2023-11-04T01:39:44.119 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.107+0000 7f3c367fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c3015d150 0x7f3c300ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:44.119 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.107+0000 7f3c367fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c3015d150 0x7f3c300ca2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41626/0 (socket says 172.21.15.77:41626) 2023-11-04T01:39:44.119 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.107+0000 7f3c367fe640 1 -- 172.21.15.77:0/1735116810 learned_addr learned my addr 172.21.15.77:0/1735116810 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:39:44.120 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.107+0000 7f3c35ffd640 1 --2- 172.21.15.77:0/1735116810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c300cf1d0 0x7f3c30151e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:44.120 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.107+0000 7f3c357fc640 1 --2- 172.21.15.77:0/1735116810 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3c3015cd70 0x7f3c30151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:44.120 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.107+0000 7f3c357fc640 1 -- 172.21.15.77:0/1735116810 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3c3015cd70 msgr2=0x7f3c30151650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-11-04T01:39:44.120 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.107+0000 7f3c357fc640 1 -- 172.21.15.77:0/1735116810 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3c3015cd70 msgr2=0x7f3c30151650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-04T01:39:44.120 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.107+0000 7f3c357fc640 1 --2- 172.21.15.77:0/1735116810 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3c3015cd70 0x7f3c30151650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:39:44.121 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.107+0000 7f3c357fc640 1 --2- 172.21.15.77:0/1735116810 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3c3015cd70 0x7f3c30151650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:39:44.121 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.107+0000 7f3c367fe640 1 -- 172.21.15.77:0/1735116810 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3c3015cd70 msgr2=0x7f3c30151650 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-04T01:39:44.121 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.107+0000 7f3c367fe640 1 --2- 172.21.15.77:0/1735116810 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3c3015cd70 0x7f3c30151650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:44.121 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.107+0000 7f3c367fe640 1 -- 172.21.15.77:0/1735116810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c300cf1d0 msgr2=0x7f3c30151e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:44.121 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.107+0000 7f3c367fe640 1 --2- 172.21.15.77:0/1735116810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c300cf1d0 0x7f3c30151e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:44.121 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.107+0000 7f3c367fe640 1 -- 172.21.15.77:0/1735116810 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c20009400 con 0x7f3c3015d150 2023-11-04T01:39:44.122 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.107+0000 7f3c367fe640 1 --2- 172.21.15.77:0/1735116810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c3015d150 0x7f3c300ca2a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3c28001890 tx=0x7f3c2800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:44.122 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.107+0000 7f3c267fc640 1 -- 172.21.15.77:0/1735116810 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c28012400 con 0x7f3c3015d150 2023-11-04T01:39:44.122 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.107+0000 7f3c267fc640 1 -- 172.21.15.77:0/1735116810 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c28012560 con 0x7f3c3015d150 2023-11-04T01:39:44.122 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.107+0000 7f3c38261640 1 -- 172.21.15.77:0/1735116810 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c300c97c0 con 0x7f3c3015d150 2023-11-04T01:39:44.122 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.107+0000 7f3c267fc640 1 -- 172.21.15.77:0/1735116810 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c28012910 con 0x7f3c3015d150 2023-11-04T01:39:44.123 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.108+0000 7f3c38261640 1 -- 172.21.15.77:0/1735116810 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c30151b90 con 0x7f3c3015d150 2023-11-04T01:39:44.123 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.108+0000 7f3c267fc640 1 -- 172.21.15.77:0/1735116810 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3c2801b400 con 0x7f3c3015d150 2023-11-04T01:39:44.123 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.108+0000 7f3c267fc640 1 -- 172.21.15.77:0/1735116810 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f3c28012d70 con 0x7f3c3015d150 2023-11-04T01:39:44.123 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.108+0000 7f3c38261640 1 -- 172.21.15.77:0/1735116810 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c300c9fc0 con 0x7f3c3015d150 2023-11-04T01:39:44.123 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.110+0000 7f3c267fc640 1 -- 172.21.15.77:0/1735116810 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f3c300c9fc0 con 0x7f3c3015d150 2023-11-04T01:39:44.172 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.171+0000 7f3c38261640 1 -- 172.21.15.77:0/1735116810 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c3004e490 con 0x7f3c3015d150 2023-11-04T01:39:44.173 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.171+0000 7f3c267fc640 1 -- 172.21.15.77:0/1735116810 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f3c2801b8e0 con 0x7f3c3015d150 2023-11-04T01:39:44.174 INFO:teuthology.misc.health.smithi077.stdout: 2023-11-04T01:39:44.174 INFO:teuthology.misc.health.smithi077.stdout:{"epoch":10,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:39:42.959637+0000","last_up_change":"0.000000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:44.175 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.172+0000 7f3c38261640 1 -- 172.21.15.77:0/1735116810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c3015d150 msgr2=0x7f3c300ca2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:44.175 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.172+0000 7f3c38261640 1 --2- 172.21.15.77:0/1735116810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c3015d150 0x7f3c300ca2a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3c28001890 tx=0x7f3c2800a430 comp rx=0 tx=0).stop 2023-11-04T01:39:44.175 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.172+0000 7f3c38261640 1 -- 172.21.15.77:0/1735116810 shutdown_connections 2023-11-04T01:39:44.176 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.172+0000 7f3c38261640 1 --2- 172.21.15.77:0/1735116810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c3015d150 0x7f3c300ca2a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:44.176 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.172+0000 7f3c38261640 1 --2- 172.21.15.77:0/1735116810 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3c3015cd70 0x7f3c30151650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:44.176 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.172+0000 7f3c38261640 1 --2- 172.21.15.77:0/1735116810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c300cf1d0 0x7f3c30151e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:44.176 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.172+0000 7f3c38261640 1 -- 172.21.15.77:0/1735116810 >> 172.21.15.77:0/1735116810 conn(0x7f3c3006ea40 msgr2=0x7f3c300b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:44.176 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.172+0000 7f3c38261640 1 -- 172.21.15.77:0/1735116810 shutdown_connections 2023-11-04T01:39:44.177 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:44.172+0000 7f3c38261640 1 -- 172.21.15.77:0/1735116810 wait complete. 2023-11-04T01:39:44.183 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-04T01:39:44.214 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-11-04T01:39:44.212+0000 7fd6e0c0d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-04T01:39:44.218 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-04T01:39:44.217+0000 7fe521e56040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-04T01:39:44.255 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-11-04T01:39:44.253+0000 7fd6e0c0d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-04T01:39:44.260 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-04T01:39:44.259+0000 7fe521e56040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-04T01:39:44.392 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-11-04T01:39:44.390+0000 7fd6e0c0d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-04T01:39:44.398 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-04T01:39:44.397+0000 7fe521e56040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-04T01:39:45.181 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-11-04T01:39:45.179+0000 7fd6e0c0d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-04T01:39:45.198 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-04T01:39:45.196+0000 7fe521e56040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-04T01:39:45.449 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-11-04T01:39:45.447+0000 7fd6e0c0d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-04T01:39:45.466 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-04T01:39:45.465+0000 7fe521e56040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-04T01:39:45.499 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-11-04T01:39:45.498+0000 7fd6e0c0d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-04T01:39:45.518 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-04T01:39:45.517+0000 7fe521e56040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-04T01:39:45.602 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-11-04T01:39:45.600+0000 7fd6e0c0d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-04T01:39:45.620 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-11-04T01:39:45.618+0000 7fe521e56040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-04T01:39:46.626 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-11-04T01:39:46.624+0000 7fd681c95640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-04T01:39:46.627 INFO:tasks.ceph.mgr.x.smithi122.stderr:2023-11-04T01:39:46.624+0000 7fd681c95640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-04T01:39:47.068 INFO:tasks.ceph.osd.5.smithi122.stderr:2023-11-04T01:39:47.066+0000 7f5b3bcaf500 -1 osd.5 0 log_to_monitors true 2023-11-04T01:39:47.084 INFO:tasks.ceph.osd.0.smithi077.stderr:2023-11-04T01:39:47.082+0000 7f014a81a500 -1 osd.0 0 log_to_monitors true 2023-11-04T01:39:47.110 INFO:tasks.ceph.osd.6.smithi122.stderr:2023-11-04T01:39:47.108+0000 7f17d28b6500 -1 osd.6 0 log_to_monitors true 2023-11-04T01:39:47.113 INFO:tasks.ceph.osd.4.smithi122.stderr:2023-11-04T01:39:47.111+0000 7f3e97810500 -1 osd.4 0 log_to_monitors true 2023-11-04T01:39:47.119 INFO:tasks.ceph.osd.1.smithi077.stderr:2023-11-04T01:39:47.118+0000 7fec5882a500 -1 osd.1 0 log_to_monitors true 2023-11-04T01:39:47.130 INFO:tasks.ceph.osd.2.smithi077.stderr:2023-11-04T01:39:47.128+0000 7fa7c9f8d500 -1 osd.2 0 log_to_monitors true 2023-11-04T01:39:47.150 INFO:tasks.ceph.osd.3.smithi077.stderr:2023-11-04T01:39:47.149+0000 7fa50da1f500 -1 osd.3 0 log_to_monitors true 2023-11-04T01:39:47.151 INFO:tasks.ceph.osd.7.smithi122.stderr:2023-11-04T01:39:47.149+0000 7f0f05a1f500 -1 osd.7 0 log_to_monitors true 2023-11-04T01:39:50.621 INFO:tasks.ceph.osd.5.smithi122.stderr:2023-11-04T01:39:50.619+0000 7f5b38451640 -1 osd.5 0 waiting for initial osdmap 2023-11-04T01:39:50.633 INFO:tasks.ceph.osd.5.smithi122.stderr:2023-11-04T01:39:50.631+0000 7f5b2fa64640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:39:50.704 INFO:tasks.ceph.osd.3.smithi077.stderr:2023-11-04T01:39:50.702+0000 7fa509361640 -1 osd.3 0 waiting for initial osdmap 2023-11-04T01:39:50.714 INFO:tasks.ceph.osd.4.smithi122.stderr:2023-11-04T01:39:50.711+0000 7f3e9328f640 -1 osd.4 0 waiting for initial osdmap 2023-11-04T01:39:50.721 INFO:tasks.ceph.osd.4.smithi122.stderr:2023-11-04T01:39:50.720+0000 7f3e8b0b6640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:39:50.729 INFO:tasks.ceph.osd.3.smithi077.stderr:2023-11-04T01:39:50.728+0000 7fa501188640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:39:50.730 INFO:tasks.ceph.osd.2.smithi077.stderr:2023-11-04T01:39:50.727+0000 7fa7c5f1d640 -1 osd.2 0 waiting for initial osdmap 2023-11-04T01:39:50.738 INFO:tasks.ceph.osd.6.smithi122.stderr:2023-11-04T01:39:50.736+0000 7f17cf05a640 -1 osd.6 0 waiting for initial osdmap 2023-11-04T01:39:50.741 INFO:tasks.ceph.osd.2.smithi077.stderr:2023-11-04T01:39:50.740+0000 7fa7bdd44640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:39:50.749 INFO:tasks.ceph.osd.1.smithi077.stderr:2023-11-04T01:39:50.746+0000 7fec53e5c640 -1 osd.1 0 waiting for initial osdmap 2023-11-04T01:39:50.758 INFO:tasks.ceph.osd.7.smithi122.stderr:2023-11-04T01:39:50.756+0000 7f0f012ed640 -1 osd.7 0 waiting for initial osdmap 2023-11-04T01:39:50.761 INFO:tasks.ceph.osd.6.smithi122.stderr:2023-11-04T01:39:50.759+0000 7f17c666d640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:39:50.764 INFO:tasks.ceph.osd.1.smithi077.stderr:2023-11-04T01:39:50.763+0000 7fec4bc83640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:39:50.777 INFO:tasks.ceph.osd.7.smithi122.stderr:2023-11-04T01:39:50.776+0000 7f0ef9114640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:39:50.811 INFO:tasks.ceph.osd.0.smithi077.stderr:2023-11-04T01:39:50.809+0000 7f014627d640 -1 osd.0 0 waiting for initial osdmap 2023-11-04T01:39:50.826 INFO:tasks.ceph.osd.0.smithi077.stderr:2023-11-04T01:39:50.824+0000 7f013e0a4640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:39:50.989 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:51.077 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.075+0000 7f157aa6f640 1 Processor -- start 2023-11-04T01:39:51.078 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.076+0000 7f157aa6f640 1 -- start start 2023-11-04T01:39:51.081 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.076+0000 7f157aa6f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f157415d030 0x7f1574071a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.081 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.076+0000 7f157aa6f640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f15740c28c0 0x7f157406da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.081 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.076+0000 7f157aa6f640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f157406ae20 con 0x7f15740abef0 2023-11-04T01:39:51.081 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.076+0000 7f157aa6f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f157406d5a0 con 0x7f157415d030 2023-11-04T01:39:51.081 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.076+0000 7f157aa6f640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f157406a2a0 con 0x7f15740c28c0 2023-11-04T01:39:51.082 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.076+0000 7f157880b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f157415d030 0x7f1574071a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.082 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.076+0000 7f157880b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f157415d030 0x7f1574071a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36890/0 (socket says 172.21.15.77:36890) 2023-11-04T01:39:51.082 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.076+0000 7f157880b640 1 -- 172.21.15.77:0/785216273 learned_addr learned my addr 172.21.15.77:0/785216273 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:39:51.082 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.077+0000 7f157900c640 1 --2- 172.21.15.77:0/785216273 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f15740c28c0 0x7f157406da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.083 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.077+0000 7f157880b640 1 -- 172.21.15.77:0/785216273 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f15740c28c0 msgr2=0x7f157406da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:51.083 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.077+0000 7f157880b640 1 --2- 172.21.15.77:0/785216273 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f15740c28c0 0x7f157406da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.083 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.077+0000 7f157880b640 1 -- 172.21.15.77:0/785216273 >> v1:172.21.15.122:6789/0 conn(0x7f15740abef0 legacy=0x7f15740b0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:51.083 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.077+0000 7f157880b640 1 -- 172.21.15.77:0/785216273 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157406a580 con 0x7f157415d030 2023-11-04T01:39:51.083 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.077+0000 7f157880b640 1 --2- 172.21.15.77:0/785216273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f157415d030 0x7f1574071a40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1568009850 tx=0x7f156802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9313e46931a423c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:51.084 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.078+0000 7f15737fe640 1 -- 172.21.15.77:0/785216273 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1568004230 con 0x7f157415d030 2023-11-04T01:39:51.084 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.078+0000 7f15737fe640 1 -- 172.21.15.77:0/785216273 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1568004390 con 0x7f157415d030 2023-11-04T01:39:51.084 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.078+0000 7f15737fe640 1 -- 172.21.15.77:0/785216273 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1568003810 con 0x7f157415d030 2023-11-04T01:39:51.084 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.078+0000 7f157aa6f640 1 -- 172.21.15.77:0/785216273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f157415d030 msgr2=0x7f1574071a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.084 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.078+0000 7f157aa6f640 1 --2- 172.21.15.77:0/785216273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f157415d030 0x7f1574071a40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1568009850 tx=0x7f156802b960 comp rx=0 tx=0).stop 2023-11-04T01:39:51.085 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.078+0000 7f157aa6f640 1 -- 172.21.15.77:0/785216273 shutdown_connections 2023-11-04T01:39:51.085 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.078+0000 7f157aa6f640 1 --2- 172.21.15.77:0/785216273 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f15740c28c0 0x7f157406da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.085 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.078+0000 7f157aa6f640 1 --2- 172.21.15.77:0/785216273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f157415d030 0x7f1574071a40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.085 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.078+0000 7f157aa6f640 1 -- 172.21.15.77:0/785216273 >> 172.21.15.77:0/785216273 conn(0x7f15740cbc40 msgr2=0x7f15740cc050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:51.085 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.078+0000 7f157aa6f640 1 -- 172.21.15.77:0/785216273 shutdown_connections 2023-11-04T01:39:51.086 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.078+0000 7f157aa6f640 1 -- 172.21.15.77:0/785216273 wait complete. 2023-11-04T01:39:51.086 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.079+0000 7f157aa6f640 1 Processor -- start 2023-11-04T01:39:51.086 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.079+0000 7f157aa6f640 1 -- start start 2023-11-04T01:39:51.093 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.080+0000 7f157aa6f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15740abef0 0x7f15740aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.093 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.080+0000 7f157aa6f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15740c28c0 0x7f157415f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.093 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.080+0000 7f157aa6f640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f157415d030 0x7f15740cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.094 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.080+0000 7f157aa6f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157415dfc0 con 0x7f15740c28c0 2023-11-04T01:39:51.094 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.080+0000 7f157aa6f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157415d620 con 0x7f15740abef0 2023-11-04T01:39:51.094 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.080+0000 7f157aa6f640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f157415d900 con 0x7f157415d030 2023-11-04T01:39:51.094 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.080+0000 7f1573fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15740c28c0 0x7f157415f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.095 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.080+0000 7f1573fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15740c28c0 0x7f157415f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36906/0 (socket says 172.21.15.77:36906) 2023-11-04T01:39:51.095 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.080+0000 7f1573fff640 1 -- 172.21.15.77:0/2951659717 learned_addr learned my addr 172.21.15.77:0/2951659717 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:39:51.095 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.080+0000 7f157880b640 1 --2- 172.21.15.77:0/2951659717 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15740abef0 0x7f15740aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.095 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.080+0000 7f157900c640 1 --2- 172.21.15.77:0/2951659717 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f157415d030 0x7f15740cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.095 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.080+0000 7f1573fff640 1 -- 172.21.15.77:0/2951659717 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f157415d030 msgr2=0x7f15740cddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.096 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.080+0000 7f1573fff640 1 --2- 172.21.15.77:0/2951659717 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f157415d030 0x7f15740cddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.096 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.080+0000 7f1573fff640 1 -- 172.21.15.77:0/2951659717 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15740abef0 msgr2=0x7f15740aeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.096 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.080+0000 7f1573fff640 1 --2- 172.21.15.77:0/2951659717 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15740abef0 0x7f15740aeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.096 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.080+0000 7f1573fff640 1 -- 172.21.15.77:0/2951659717 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1568009460 con 0x7f15740c28c0 2023-11-04T01:39:51.096 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.081+0000 7f157900c640 1 --2- 172.21.15.77:0/2951659717 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f157415d030 0x7f15740cddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:51.097 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.081+0000 7f1573fff640 1 --2- 172.21.15.77:0/2951659717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15740c28c0 0x7f157415f3c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f156000c3a0 tx=0x7f156000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:51.097 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.081+0000 7f15717fa640 1 -- 172.21.15.77:0/2951659717 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15600052d0 con 0x7f15740c28c0 2023-11-04T01:39:51.097 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.081+0000 7f15717fa640 1 -- 172.21.15.77:0/2951659717 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1560005450 con 0x7f15740c28c0 2023-11-04T01:39:51.097 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.081+0000 7f157aa6f640 1 -- 172.21.15.77:0/2951659717 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f157415dbe0 con 0x7f15740c28c0 2023-11-04T01:39:51.097 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.081+0000 7f15717fa640 1 -- 172.21.15.77:0/2951659717 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1560003880 con 0x7f15740c28c0 2023-11-04T01:39:51.098 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.081+0000 7f157aa6f640 1 -- 172.21.15.77:0/2951659717 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f157415f900 con 0x7f15740c28c0 2023-11-04T01:39:51.098 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.082+0000 7f157aa6f640 1 -- 172.21.15.77:0/2951659717 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f157415e100 con 0x7f15740c28c0 2023-11-04T01:39:51.098 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.082+0000 7f15717fa640 1 -- 172.21.15.77:0/2951659717 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f15600039e0 con 0x7f15740c28c0 2023-11-04T01:39:51.098 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.082+0000 7f15717fa640 1 --2- 172.21.15.77:0/2951659717 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f155806ade0 0x7f155806d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:51.099 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.083+0000 7f15717fa640 1 -- 172.21.15.77:0/2951659717 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f1560087c10 con 0x7f15740c28c0 2023-11-04T01:39:51.099 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.083+0000 7f157880b640 1 --2- 172.21.15.77:0/2951659717 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f155806ade0 0x7f155806d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:51.099 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.083+0000 7f157880b640 1 --2- 172.21.15.77:0/2951659717 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f155806ade0 0x7f155806d2a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1568035000 tx=0x7f1568008030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:51.099 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.087+0000 7f15717fa640 1 -- 172.21.15.77:0/2951659717 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f157415e100 con 0x7f15740c28c0 2023-11-04T01:39:51.257 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.255+0000 7f157aa6f640 1 -- 172.21.15.77:0/2951659717 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f157415e100 con 0x7f15740c28c0 2023-11-04T01:39:51.258 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.256+0000 7f15717fa640 1 -- 172.21.15.77:0/2951659717 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f157415e100 con 0x7f15740c28c0 2023-11-04T01:39:51.258 INFO:teuthology.misc.health.smithi077.stdout: 2023-11-04T01:39:51.258 INFO:teuthology.misc.health.smithi077.stdout:{"epoch":12,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:39:48.620407+0000","last_up_change":"0.000000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:51.260 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.258+0000 7f157aa6f640 1 -- 172.21.15.77:0/2951659717 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f155806ade0 msgr2=0x7f155806d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.260 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.258+0000 7f157aa6f640 1 --2- 172.21.15.77:0/2951659717 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f155806ade0 0x7f155806d2a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1568035000 tx=0x7f1568008030 comp rx=0 tx=0).stop 2023-11-04T01:39:51.260 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.258+0000 7f157aa6f640 1 -- 172.21.15.77:0/2951659717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15740c28c0 msgr2=0x7f157415f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:51.260 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.258+0000 7f157aa6f640 1 --2- 172.21.15.77:0/2951659717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15740c28c0 0x7f157415f3c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f156000c3a0 tx=0x7f156000c860 comp rx=0 tx=0).stop 2023-11-04T01:39:51.260 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.258+0000 7f157aa6f640 1 -- 172.21.15.77:0/2951659717 shutdown_connections 2023-11-04T01:39:51.261 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.258+0000 7f157aa6f640 1 --2- 172.21.15.77:0/2951659717 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f155806ade0 0x7f155806d2a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.261 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.258+0000 7f157aa6f640 1 --2- 172.21.15.77:0/2951659717 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f157415d030 0x7f15740cddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.261 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.258+0000 7f157aa6f640 1 --2- 172.21.15.77:0/2951659717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15740c28c0 0x7f157415f3c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.261 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.258+0000 7f157aa6f640 1 --2- 172.21.15.77:0/2951659717 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15740abef0 0x7f15740aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:51.261 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.258+0000 7f157aa6f640 1 -- 172.21.15.77:0/2951659717 >> 172.21.15.77:0/2951659717 conn(0x7f15740cbc40 msgr2=0x7f157406e630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:51.262 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.258+0000 7f157aa6f640 1 -- 172.21.15.77:0/2951659717 shutdown_connections 2023-11-04T01:39:51.262 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:51.258+0000 7f157aa6f640 1 -- 172.21.15.77:0/2951659717 wait complete. 2023-11-04T01:39:51.269 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-04T01:39:58.075 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:58.175 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.173+0000 7f1a24a26640 1 Processor -- start 2023-11-04T01:39:58.175 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.173+0000 7f1a24a26640 1 -- start start 2023-11-04T01:39:58.177 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.174+0000 7f1a24a26640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1a2015cdd0 0x7f1a2015de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.178 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.174+0000 7f1a24a26640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1a2015d1b0 0x7f1a200cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.178 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.174+0000 7f1a24a26640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a2015da00 con 0x7f1a200b8890 2023-11-04T01:39:58.178 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.174+0000 7f1a24a26640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a201619a0 con 0x7f1a2015d1b0 2023-11-04T01:39:58.178 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.174+0000 7f1a24a26640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a20161180 con 0x7f1a2015cdd0 2023-11-04T01:39:58.178 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.174+0000 7f1a1ed9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1a2015d1b0 0x7f1a200cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.179 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.175+0000 7f1a1ed9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1a2015d1b0 0x7f1a200cdbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37390/0 (socket says 172.21.15.77:37390) 2023-11-04T01:39:58.179 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.175+0000 7f1a1ed9d640 1 -- 172.21.15.77:0/3711747798 learned_addr learned my addr 172.21.15.77:0/3711747798 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:39:58.179 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.175+0000 7f1a1e59c640 1 --2- 172.21.15.77:0/3711747798 >> v2:172.21.15.122:3300/0 conn(0x7f1a2015cdd0 0x7f1a2015de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.179 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.175+0000 7f1a1ed9d640 1 -- 172.21.15.77:0/3711747798 >> v2:172.21.15.122:3300/0 conn(0x7f1a2015cdd0 msgr2=0x7f1a2015de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:58.179 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.175+0000 7f1a1ed9d640 1 --2- 172.21.15.77:0/3711747798 >> v2:172.21.15.122:3300/0 conn(0x7f1a2015cdd0 0x7f1a2015de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.180 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.175+0000 7f1a1ed9d640 1 -- 172.21.15.77:0/3711747798 >> v1:172.21.15.122:6789/0 conn(0x7f1a200b8890 legacy=0x7f1a20160a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:58.180 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.175+0000 7f1a1ed9d640 1 -- 172.21.15.77:0/3711747798 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2015e3d0 con 0x7f1a2015d1b0 2023-11-04T01:39:58.180 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.175+0000 7f1a1e59c640 1 --2- 172.21.15.77:0/3711747798 >> v2:172.21.15.122:3300/0 conn(0x7f1a2015cdd0 0x7f1a2015de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:58.180 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.175+0000 7f1a1ed9d640 1 --2- 172.21.15.77:0/3711747798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a2015d1b0 0x7f1a200cdbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1a200d09a0 tx=0x7f1a1802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c89ab8c7296441a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:58.180 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.176+0000 7f1a1d59a640 1 -- 172.21.15.77:0/3711747798 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1802ca80 con 0x7f1a2015d1b0 2023-11-04T01:39:58.181 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.176+0000 7f1a1d59a640 1 -- 172.21.15.77:0/3711747798 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1802cbe0 con 0x7f1a2015d1b0 2023-11-04T01:39:58.181 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.176+0000 7f1a1d59a640 1 -- 172.21.15.77:0/3711747798 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a180343f0 con 0x7f1a2015d1b0 2023-11-04T01:39:58.184 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.176+0000 7f1a24a26640 1 -- 172.21.15.77:0/3711747798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a2015d1b0 msgr2=0x7f1a200cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.184 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.176+0000 7f1a24a26640 1 --2- 172.21.15.77:0/3711747798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a2015d1b0 0x7f1a200cdbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1a200d09a0 tx=0x7f1a1802bee0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.184 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.176+0000 7f1a24a26640 1 -- 172.21.15.77:0/3711747798 shutdown_connections 2023-11-04T01:39:58.185 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.176+0000 7f1a24a26640 1 --2- 172.21.15.77:0/3711747798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a2015d1b0 0x7f1a200cdbf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.185 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.176+0000 7f1a24a26640 1 --2- 172.21.15.77:0/3711747798 >> v2:172.21.15.122:3300/0 conn(0x7f1a2015cdd0 0x7f1a2015de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.185 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.176+0000 7f1a24a26640 1 -- 172.21.15.77:0/3711747798 >> 172.21.15.77:0/3711747798 conn(0x7f1a200cf8a0 msgr2=0x7f1a200cfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:58.185 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.176+0000 7f1a24a26640 1 -- 172.21.15.77:0/3711747798 shutdown_connections 2023-11-04T01:39:58.185 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.176+0000 7f1a24a26640 1 -- 172.21.15.77:0/3711747798 wait complete. 2023-11-04T01:39:58.186 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.178+0000 7f1a24a26640 1 Processor -- start 2023-11-04T01:39:58.186 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.178+0000 7f1a24a26640 1 -- start start 2023-11-04T01:39:58.186 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.178+0000 7f1a24a26640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a200b8890 0x7f1a2015bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.186 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.179+0000 7f1a24a26640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a2015cdd0 0x7f1a20158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.186 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.179+0000 7f1a24a26640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a2015d1b0 0x7f1a200b6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.187 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.179+0000 7f1a24a26640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a20159070 con 0x7f1a2015cdd0 2023-11-04T01:39:58.187 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.179+0000 7f1a24a26640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a20148330 con 0x7f1a2015d1b0 2023-11-04T01:39:58.187 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.179+0000 7f1a24a26640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a201592d0 con 0x7f1a200b8890 2023-11-04T01:39:58.187 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.179+0000 7f1a1dd9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a2015cdd0 0x7f1a20158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.188 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.179+0000 7f1a1dd9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a2015cdd0 0x7f1a20158b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37398/0 (socket says 172.21.15.77:37398) 2023-11-04T01:39:58.188 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.179+0000 7f1a1dd9b640 1 -- 172.21.15.77:0/1079833311 learned_addr learned my addr 172.21.15.77:0/1079833311 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:39:58.188 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.179+0000 7f1a1e59c640 1 --2- 172.21.15.77:0/1079833311 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a200b8890 0x7f1a2015bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.188 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.179+0000 7f1a1ed9d640 1 --2- 172.21.15.77:0/1079833311 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a2015d1b0 0x7f1a200b6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.188 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.179+0000 7f1a1dd9b640 1 -- 172.21.15.77:0/1079833311 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a200b8890 msgr2=0x7f1a2015bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.189 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.179+0000 7f1a1dd9b640 1 --2- 172.21.15.77:0/1079833311 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a200b8890 0x7f1a2015bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.189 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.179+0000 7f1a1dd9b640 1 -- 172.21.15.77:0/1079833311 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a2015d1b0 msgr2=0x7f1a200b6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.189 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.179+0000 7f1a1dd9b640 1 --2- 172.21.15.77:0/1079833311 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a2015d1b0 0x7f1a200b6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.189 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.179+0000 7f1a1dd9b640 1 -- 172.21.15.77:0/1079833311 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a18009b30 con 0x7f1a2015cdd0 2023-11-04T01:39:58.189 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.179+0000 7f1a1dd9b640 1 --2- 172.21.15.77:0/1079833311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a2015cdd0 0x7f1a20158b30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1a1000c3f0 tx=0x7f1a1000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:58.190 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.179+0000 7f1a0effd640 1 -- 172.21.15.77:0/1079833311 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a100054e0 con 0x7f1a2015cdd0 2023-11-04T01:39:58.190 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.179+0000 7f1a0effd640 1 -- 172.21.15.77:0/1079833311 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a10003640 con 0x7f1a2015cdd0 2023-11-04T01:39:58.190 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.179+0000 7f1a24a26640 1 -- 172.21.15.77:0/1079833311 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a201595b0 con 0x7f1a2015cdd0 2023-11-04T01:39:58.190 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.179+0000 7f1a0effd640 1 -- 172.21.15.77:0/1079833311 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a100039f0 con 0x7f1a2015cdd0 2023-11-04T01:39:58.190 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.179+0000 7f1a24a26640 1 -- 172.21.15.77:0/1079833311 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a201485d0 con 0x7f1a2015cdd0 2023-11-04T01:39:58.191 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.180+0000 7f1a24a26640 1 -- 172.21.15.77:0/1079833311 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a2004e490 con 0x7f1a2015cdd0 2023-11-04T01:39:58.191 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.181+0000 7f1a0effd640 1 -- 172.21.15.77:0/1079833311 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1a10003b50 con 0x7f1a2015cdd0 2023-11-04T01:39:58.191 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.181+0000 7f1a0effd640 1 --2- 172.21.15.77:0/1079833311 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1a0006ae70 0x7f1a0006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.191 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.181+0000 7f1a0effd640 1 -- 172.21.15.77:0/1079833311 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1a100887b0 con 0x7f1a2015cdd0 2023-11-04T01:39:58.191 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.181+0000 7f1a1e59c640 1 --2- 172.21.15.77:0/1079833311 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1a0006ae70 0x7f1a0006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.191 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.182+0000 7f1a1e59c640 1 --2- 172.21.15.77:0/1079833311 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1a0006ae70 0x7f1a0006d330 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1a14008850 tx=0x7f1a14008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:58.192 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.186+0000 7f1a0effd640 1 -- 172.21.15.77:0/1079833311 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1a10053c60 con 0x7f1a2015cdd0 2023-11-04T01:39:58.354 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.353+0000 7f1a24a26640 1 -- 172.21.15.77:0/1079833311 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a200d1c40 con 0x7f1a2015cdd0 2023-11-04T01:39:58.355 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.354+0000 7f1a0effd640 1 -- 172.21.15.77:0/1079833311 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12838 (secure 0 0 0) 0x7f1a10017090 con 0x7f1a2015cdd0 2023-11-04T01:39:58.355 INFO:teuthology.misc.health.smithi077.stdout: 2023-11-04T01:39:58.356 INFO:teuthology.misc.health.smithi077.stdout:{"epoch":16,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:39:54.643163+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:58.357 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.355+0000 7f1a24a26640 1 -- 172.21.15.77:0/1079833311 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1a0006ae70 msgr2=0x7f1a0006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.357 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.355+0000 7f1a24a26640 1 --2- 172.21.15.77:0/1079833311 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1a0006ae70 0x7f1a0006d330 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1a14008850 tx=0x7f1a14008040 comp rx=0 tx=0).stop 2023-11-04T01:39:58.358 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.355+0000 7f1a24a26640 1 -- 172.21.15.77:0/1079833311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a2015cdd0 msgr2=0x7f1a20158b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.358 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.355+0000 7f1a24a26640 1 --2- 172.21.15.77:0/1079833311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a2015cdd0 0x7f1a20158b30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1a1000c3f0 tx=0x7f1a1000c8b0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.358 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.355+0000 7f1a24a26640 1 -- 172.21.15.77:0/1079833311 shutdown_connections 2023-11-04T01:39:58.358 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.355+0000 7f1a24a26640 1 --2- 172.21.15.77:0/1079833311 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1a0006ae70 0x7f1a0006d330 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.359 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.356+0000 7f1a24a26640 1 --2- 172.21.15.77:0/1079833311 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a2015d1b0 0x7f1a200b6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.359 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.356+0000 7f1a24a26640 1 --2- 172.21.15.77:0/1079833311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a2015cdd0 0x7f1a20158b30 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.359 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.356+0000 7f1a24a26640 1 --2- 172.21.15.77:0/1079833311 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a200b8890 0x7f1a2015bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.359 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.356+0000 7f1a24a26640 1 -- 172.21.15.77:0/1079833311 >> 172.21.15.77:0/1079833311 conn(0x7f1a200cf8a0 msgr2=0x7f1a200d1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:58.359 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.356+0000 7f1a24a26640 1 -- 172.21.15.77:0/1079833311 shutdown_connections 2023-11-04T01:39:58.360 INFO:teuthology.misc.health.smithi077.stderr:2023-11-04T01:39:58.356+0000 7f1a24a26640 1 -- 172.21.15.77:0/1079833311 wait complete. 2023-11-04T01:39:58.367 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-04T01:39:58.367 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-04T01:39:58.368 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:39:58.368 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:39:58.370 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:39:58.371 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:39:58.371 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:39:58.373 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:39:58.373 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:39:58.374 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:39:58.377 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:39:58.377 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:39:58.377 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:39:58.380 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:39:58.380 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-04T01:39:58.381 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:39:58.445 INFO:tasks.ceph.mds.c.smithi077.stdout:starting mds.c at 2023-11-04T01:39:58.446 INFO:tasks.ceph.mds.a.smithi077.stdout:starting mds.a at 2023-11-04T01:39:58.466 INFO:tasks.ceph.mds.d.smithi122.stdout:starting mds.d at 2023-11-04T01:39:58.467 INFO:tasks.ceph.mds.b.smithi122.stdout:starting mds.b at 2023-11-04T01:39:58.467 INFO:tasks.ceph.mds.b.smithi122.stderr:2023-11-04T01:39:58.466+0000 7f0b852b6640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-11-04T01:39:58.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.484+0000 7ff4b1c07640 1 Processor -- start 2023-11-04T01:39:58.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.484+0000 7ff4b1c07640 1 -- start start 2023-11-04T01:39:58.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.485+0000 7ff4b1c07640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff4ac0b2870 0x7ff4ac06ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.485+0000 7ff4b1c07640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff4ac0b2c50 0x7ff4ac161570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.485+0000 7ff4b1c07640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4ac0cca60 0x7ff4ac0cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.485+0000 7ff4b1c07640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4ac06ccd0 con 0x7ff4ac0b2870 2023-11-04T01:39:58.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.485+0000 7ff4b1c07640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4ac161ab0 con 0x7ff4ac0b2c50 2023-11-04T01:39:58.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.485+0000 7ff4b1c07640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac06c050 con 0x7ff4ac0cca60 2023-11-04T01:39:58.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.485+0000 7ff4ab7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff4ac0b2870 0x7ff4ac06ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.485+0000 7ff4ab7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff4ac0b2870 0x7ff4ac06ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37438/0 (socket says 172.21.15.77:37438) 2023-11-04T01:39:58.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.485+0000 7ff4ab7fe640 1 -- 172.21.15.77:0/1650924794 learned_addr learned my addr 172.21.15.77:0/1650924794 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:39:58.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.485+0000 7ff4ab7fe640 1 -- 172.21.15.77:0/1650924794 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4ac0cca60 msgr2=0x7ff4ac0cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:58.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.485+0000 7ff4abfff640 1 --2- 172.21.15.77:0/1650924794 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4ac0cca60 0x7ff4ac0cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.486+0000 7ff4aaffd640 1 --2- 172.21.15.77:0/1650924794 >> v2:172.21.15.122:3300/0 conn(0x7ff4ac0b2c50 0x7ff4ac161570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.486+0000 7ff4ab7fe640 1 --2- 172.21.15.77:0/1650924794 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4ac0cca60 0x7ff4ac0cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.486+0000 7ff4ab7fe640 1 -- 172.21.15.77:0/1650924794 >> v2:172.21.15.122:3300/0 conn(0x7ff4ac0b2c50 msgr2=0x7ff4ac161570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:58.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.486+0000 7ff4ab7fe640 1 --2- 172.21.15.77:0/1650924794 >> v2:172.21.15.122:3300/0 conn(0x7ff4ac0b2c50 0x7ff4ac161570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.486+0000 7ff4ab7fe640 1 -- 172.21.15.77:0/1650924794 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ac06c330 con 0x7ff4ac0b2870 2023-11-04T01:39:58.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.486+0000 7ff4abfff640 1 --2- 172.21.15.77:0/1650924794 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4ac0cca60 0x7ff4ac0cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:58.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.486+0000 7ff4aaffd640 1 --2- 172.21.15.77:0/1650924794 >> v2:172.21.15.122:3300/0 conn(0x7ff4ac0b2c50 0x7ff4ac161570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:39:58.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.486+0000 7ff4ab7fe640 1 --2- 172.21.15.77:0/1650924794 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4ac0b2870 0x7ff4ac06ba00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac0b32e0 tx=0x7ff49c02b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf32875f9fe41310 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:58.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.486+0000 7ff4aa7fc640 1 -- 172.21.15.77:0/1650924794 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49c004030 con 0x7ff4ac0b2870 2023-11-04T01:39:58.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.486+0000 7ff4aa7fc640 1 -- 172.21.15.77:0/1650924794 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49c004190 con 0x7ff4ac0b2870 2023-11-04T01:39:58.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.487+0000 7ff4aa7fc640 1 -- 172.21.15.77:0/1650924794 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49c003610 con 0x7ff4ac0b2870 2023-11-04T01:39:58.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.487+0000 7ff4b1c07640 1 -- 172.21.15.77:0/1650924794 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4ac0b2870 msgr2=0x7ff4ac06ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.487+0000 7ff4b1c07640 1 --2- 172.21.15.77:0/1650924794 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4ac0b2870 0x7ff4ac06ba00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac0b32e0 tx=0x7ff49c02b7c0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.487+0000 7ff4b1c07640 1 -- 172.21.15.77:0/1650924794 shutdown_connections 2023-11-04T01:39:58.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.487+0000 7ff4b1c07640 1 --2- 172.21.15.77:0/1650924794 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4ac0cca60 0x7ff4ac0cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.487+0000 7ff4b1c07640 1 --2- 172.21.15.77:0/1650924794 >> v2:172.21.15.122:3300/0 conn(0x7ff4ac0b2c50 0x7ff4ac161570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.487+0000 7ff4b1c07640 1 --2- 172.21.15.77:0/1650924794 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4ac0b2870 0x7ff4ac06ba00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.487+0000 7ff4b1c07640 1 -- 172.21.15.77:0/1650924794 >> 172.21.15.77:0/1650924794 conn(0x7ff4ac0cd600 msgr2=0x7ff4ac0cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:58.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.487+0000 7ff4b1c07640 1 -- 172.21.15.77:0/1650924794 shutdown_connections 2023-11-04T01:39:58.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.487+0000 7ff4b1c07640 1 -- 172.21.15.77:0/1650924794 wait complete. 2023-11-04T01:39:58.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.488+0000 7ff4b1c07640 1 Processor -- start 2023-11-04T01:39:58.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.488+0000 7ff4b1c07640 1 -- start start 2023-11-04T01:39:58.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.489+0000 7ff4b1c07640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4ac0b2870 0x7ff4ac1f67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.489+0000 7ff4b1c07640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4ac0b2c50 0x7ff4ac1f1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.489+0000 7ff4b1c07640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4ac0cca60 0x7ff4ac0ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.489+0000 7ff4b1c07640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac0b5ed0 con 0x7ff4ac0b2c50 2023-11-04T01:39:58.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.489+0000 7ff4b1c07640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac1f6ce0 con 0x7ff4ac0b2870 2023-11-04T01:39:58.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.489+0000 7ff4b1c07640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac0b52c0 con 0x7ff4ac0cca60 2023-11-04T01:39:58.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.489+0000 7ff4aaffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4ac0b2c50 0x7ff4ac1f1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.489+0000 7ff4aaffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4ac0b2c50 0x7ff4ac1f1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37452/0 (socket says 172.21.15.77:37452) 2023-11-04T01:39:58.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.489+0000 7ff4aaffd640 1 -- 172.21.15.77:0/2864927099 learned_addr learned my addr 172.21.15.77:0/2864927099 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:39:58.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.489+0000 7ff4ab7fe640 1 --2- 172.21.15.77:0/2864927099 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4ac0b2870 0x7ff4ac1f67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.489+0000 7ff4abfff640 1 --2- 172.21.15.77:0/2864927099 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4ac0cca60 0x7ff4ac0ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.489+0000 7ff4aaffd640 1 -- 172.21.15.77:0/2864927099 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4ac0cca60 msgr2=0x7ff4ac0ae6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.489+0000 7ff4aaffd640 1 --2- 172.21.15.77:0/2864927099 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4ac0cca60 0x7ff4ac0ae6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.489+0000 7ff4aaffd640 1 -- 172.21.15.77:0/2864927099 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4ac0b2870 msgr2=0x7ff4ac1f67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.489+0000 7ff4aaffd640 1 --2- 172.21.15.77:0/2864927099 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4ac0b2870 0x7ff4ac1f67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.489+0000 7ff4aaffd640 1 -- 172.21.15.77:0/2864927099 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49c009460 con 0x7ff4ac0b2c50 2023-11-04T01:39:58.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.490+0000 7ff4aaffd640 1 --2- 172.21.15.77:0/2864927099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4ac0b2c50 0x7ff4ac1f1ff0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff4a000c820 tx=0x7ff4a000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:58.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.490+0000 7ff493fff640 1 -- 172.21.15.77:0/2864927099 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a0007a30 con 0x7ff4ac0b2c50 2023-11-04T01:39:58.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.490+0000 7ff493fff640 1 -- 172.21.15.77:0/2864927099 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a0007b90 con 0x7ff4ac0b2c50 2023-11-04T01:39:58.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.490+0000 7ff4b1c07640 1 -- 172.21.15.77:0/2864927099 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4ac0b55a0 con 0x7ff4ac0b2c50 2023-11-04T01:39:58.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.490+0000 7ff493fff640 1 -- 172.21.15.77:0/2864927099 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a000ce10 con 0x7ff4ac0b2c50 2023-11-04T01:39:58.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.490+0000 7ff4b1c07640 1 -- 172.21.15.77:0/2864927099 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4ac0b5b60 con 0x7ff4ac0b2c50 2023-11-04T01:39:58.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.491+0000 7ff4b1c07640 1 -- 172.21.15.77:0/2864927099 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4ac0674e0 con 0x7ff4ac0b2c50 2023-11-04T01:39:58.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.491+0000 7ff493fff640 1 -- 172.21.15.77:0/2864927099 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff4a00113f0 con 0x7ff4ac0b2c50 2023-11-04T01:39:58.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.491+0000 7ff493fff640 1 --2- 172.21.15.77:0/2864927099 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff49806ae70 0x7ff49806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.491+0000 7ff493fff640 1 -- 172.21.15.77:0/2864927099 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff4a0089390 con 0x7ff4ac0b2c50 2023-11-04T01:39:58.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.492+0000 7ff4ab7fe640 1 --2- 172.21.15.77:0/2864927099 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff49806ae70 0x7ff49806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.492+0000 7ff4ab7fe640 1 --2- 172.21.15.77:0/2864927099 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff49806ae70 0x7ff49806d330 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff49c035000 tx=0x7ff49c030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:58.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.496+0000 7ff493fff640 1 -- 172.21.15.77:0/2864927099 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff4a00547c0 con 0x7ff4ac0b2c50 2023-11-04T01:39:58.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.665+0000 7ff4b1c07640 1 -- 172.21.15.77:0/2864927099 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4ac0b23e0 con 0x7ff4ac0b2c50 2023-11-04T01:39:58.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.667+0000 7ff493fff640 1 -- 172.21.15.77:0/2864927099 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12838 (secure 0 0 0) 0x7ff4a0057de0 con 0x7ff4ac0b2c50 2023-11-04T01:39:58.668 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:39:58.669 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":16,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:39:54.643163+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:39:58.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.669+0000 7ff4b1c07640 1 -- 172.21.15.77:0/2864927099 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff49806ae70 msgr2=0x7ff49806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.669+0000 7ff4b1c07640 1 --2- 172.21.15.77:0/2864927099 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff49806ae70 0x7ff49806d330 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff49c035000 tx=0x7ff49c030000 comp rx=0 tx=0).stop 2023-11-04T01:39:58.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.669+0000 7ff4b1c07640 1 -- 172.21.15.77:0/2864927099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4ac0b2c50 msgr2=0x7ff4ac1f1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.669+0000 7ff4b1c07640 1 --2- 172.21.15.77:0/2864927099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4ac0b2c50 0x7ff4ac1f1ff0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff4a000c820 tx=0x7ff4a000cce0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.669+0000 7ff4b1c07640 1 -- 172.21.15.77:0/2864927099 shutdown_connections 2023-11-04T01:39:58.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.669+0000 7ff4b1c07640 1 --2- 172.21.15.77:0/2864927099 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff49806ae70 0x7ff49806d330 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.669+0000 7ff4b1c07640 1 --2- 172.21.15.77:0/2864927099 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4ac0cca60 0x7ff4ac0ae6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.669+0000 7ff4b1c07640 1 --2- 172.21.15.77:0/2864927099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4ac0b2c50 0x7ff4ac1f1ff0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.669+0000 7ff4b1c07640 1 --2- 172.21.15.77:0/2864927099 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4ac0b2870 0x7ff4ac1f67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.669+0000 7ff4b1c07640 1 -- 172.21.15.77:0/2864927099 >> 172.21.15.77:0/2864927099 conn(0x7ff4ac0cd600 msgr2=0x7ff4ac0c6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:58.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.669+0000 7ff4b1c07640 1 -- 172.21.15.77:0/2864927099 shutdown_connections 2023-11-04T01:39:58.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.669+0000 7ff4b1c07640 1 -- 172.21.15.77:0/2864927099 wait complete. 2023-11-04T01:39:58.681 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:39:58.682 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:39:58.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.783+0000 7f33f1d4c640 1 Processor -- start 2023-11-04T01:39:58.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.783+0000 7f33f1d4c640 1 -- start start 2023-11-04T01:39:58.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.784+0000 7f33f1d4c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f33ec15e430 0x7f33ec0cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.784+0000 7f33f1d4c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f33ec0cf160 0x7f33ec0cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.784+0000 7f33f1d4c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33ec0d0280 con 0x7f33ec0d0710 2023-11-04T01:39:58.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.784+0000 7f33f1d4c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33ec0cf670 con 0x7f33ec0cf160 2023-11-04T01:39:58.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.784+0000 7f33f1d4c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33ec0cf950 con 0x7f33ec15e430 2023-11-04T01:39:58.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.784+0000 7f33eaffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f33ec0cf160 0x7f33ec0cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.784+0000 7f33eaffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f33ec0cf160 0x7f33ec0cd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37458/0 (socket says 172.21.15.77:37458) 2023-11-04T01:39:58.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.784+0000 7f33eaffd640 1 -- 172.21.15.77:0/237826446 learned_addr learned my addr 172.21.15.77:0/237826446 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:39:58.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.784+0000 7f33eaffd640 1 -- 172.21.15.77:0/237826446 >> v2:172.21.15.122:3300/0 conn(0x7f33ec15e430 msgr2=0x7f33ec0cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:58.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.784+0000 7f33eaffd640 1 --2- 172.21.15.77:0/237826446 >> v2:172.21.15.122:3300/0 conn(0x7f33ec15e430 0x7f33ec0cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.784+0000 7f33eaffd640 1 -- 172.21.15.77:0/237826446 >> v1:172.21.15.122:6789/0 conn(0x7f33ec0d0710 legacy=0x7f33ec0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:58.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.784+0000 7f33eaffd640 1 -- 172.21.15.77:0/237826446 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ec0cfc30 con 0x7f33ec0cf160 2023-11-04T01:39:58.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.785+0000 7f33eaffd640 1 --2- 172.21.15.77:0/237826446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33ec0cf160 0x7f33ec0cd510 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f33ec06e5b0 tx=0x7f33dc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3288435cd5dcc704 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:58.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.785+0000 7f33ea7fc640 1 -- 172.21.15.77:0/237826446 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc031870 con 0x7f33ec0cf160 2023-11-04T01:39:58.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.785+0000 7f33ea7fc640 1 -- 172.21.15.77:0/237826446 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33dc0319d0 con 0x7f33ec0cf160 2023-11-04T01:39:58.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.785+0000 7f33ea7fc640 1 -- 172.21.15.77:0/237826446 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc031d60 con 0x7f33ec0cf160 2023-11-04T01:39:58.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.785+0000 7f33f1d4c640 1 -- 172.21.15.77:0/237826446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33ec0cf160 msgr2=0x7f33ec0cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.785+0000 7f33f1d4c640 1 --2- 172.21.15.77:0/237826446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33ec0cf160 0x7f33ec0cd510 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f33ec06e5b0 tx=0x7f33dc02b910 comp rx=0 tx=0).stop 2023-11-04T01:39:58.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.785+0000 7f33f1d4c640 1 -- 172.21.15.77:0/237826446 shutdown_connections 2023-11-04T01:39:58.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.785+0000 7f33f1d4c640 1 --2- 172.21.15.77:0/237826446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33ec0cf160 0x7f33ec0cd510 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.785+0000 7f33f1d4c640 1 --2- 172.21.15.77:0/237826446 >> v2:172.21.15.122:3300/0 conn(0x7f33ec15e430 0x7f33ec0cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.785+0000 7f33f1d4c640 1 -- 172.21.15.77:0/237826446 >> 172.21.15.77:0/237826446 conn(0x7f33ec06ea20 msgr2=0x7f33ec06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:58.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.785+0000 7f33f1d4c640 1 -- 172.21.15.77:0/237826446 shutdown_connections 2023-11-04T01:39:58.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.785+0000 7f33f1d4c640 1 -- 172.21.15.77:0/237826446 wait complete. 2023-11-04T01:39:58.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.786+0000 7f33f1d4c640 1 Processor -- start 2023-11-04T01:39:58.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.787+0000 7f33f1d4c640 1 -- start start 2023-11-04T01:39:58.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.787+0000 7f33f1d4c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33ec0cf160 0x7f33ec149730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.787+0000 7f33f1d4c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33ec0d0710 0x7f33ec0c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.787+0000 7f33f1d4c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f33ec15e430 0x7f33ec0b28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.787+0000 7f33f1d4c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec0c9740 con 0x7f33ec0d0710 2023-11-04T01:39:58.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.787+0000 7f33f1d4c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec0c9a20 con 0x7f33ec0cf160 2023-11-04T01:39:58.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.787+0000 7f33f1d4c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec14a170 con 0x7f33ec15e430 2023-11-04T01:39:58.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.787+0000 7f33eaffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33ec0d0710 0x7f33ec0c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.788+0000 7f33eaffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33ec0d0710 0x7f33ec0c8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37472/0 (socket says 172.21.15.77:37472) 2023-11-04T01:39:58.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.788+0000 7f33eaffd640 1 -- 172.21.15.77:0/3914213601 learned_addr learned my addr 172.21.15.77:0/3914213601 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:39:58.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.788+0000 7f33eb7fe640 1 --2- 172.21.15.77:0/3914213601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33ec0cf160 0x7f33ec149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.788+0000 7f33eaffd640 1 -- 172.21.15.77:0/3914213601 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f33ec15e430 msgr2=0x7f33ec0b28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.788+0000 7f33ebfff640 1 --2- 172.21.15.77:0/3914213601 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f33ec15e430 0x7f33ec0b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.788+0000 7f33eaffd640 1 --2- 172.21.15.77:0/3914213601 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f33ec15e430 0x7f33ec0b28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.788+0000 7f33eaffd640 1 -- 172.21.15.77:0/3914213601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33ec0cf160 msgr2=0x7f33ec149730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.788+0000 7f33eaffd640 1 --2- 172.21.15.77:0/3914213601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33ec0cf160 0x7f33ec149730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.788+0000 7f33eaffd640 1 -- 172.21.15.77:0/3914213601 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33dc0094d0 con 0x7f33ec0d0710 2023-11-04T01:39:58.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.788+0000 7f33eaffd640 1 --2- 172.21.15.77:0/3914213601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33ec0d0710 0x7f33ec0c8cc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f33dc000c00 tx=0x7f33dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:58.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.788+0000 7f33d3fff640 1 -- 172.21.15.77:0/3914213601 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc03ad10 con 0x7f33ec0d0710 2023-11-04T01:39:58.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.788+0000 7f33d3fff640 1 -- 172.21.15.77:0/3914213601 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33dc03ae70 con 0x7f33ec0d0710 2023-11-04T01:39:58.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.788+0000 7f33f1d4c640 1 -- 172.21.15.77:0/3914213601 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33ec14a450 con 0x7f33ec0d0710 2023-11-04T01:39:58.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.788+0000 7f33d3fff640 1 -- 172.21.15.77:0/3914213601 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc044610 con 0x7f33ec0d0710 2023-11-04T01:39:58.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.788+0000 7f33f1d4c640 1 -- 172.21.15.77:0/3914213601 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33ec0ca9b0 con 0x7f33ec0d0710 2023-11-04T01:39:58.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.789+0000 7f33f1d4c640 1 -- 172.21.15.77:0/3914213601 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33ec14a690 con 0x7f33ec0d0710 2023-11-04T01:39:58.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.790+0000 7f33d3fff640 1 -- 172.21.15.77:0/3914213601 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f33dc04d450 con 0x7f33ec0d0710 2023-11-04T01:39:58.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.790+0000 7f33d3fff640 1 --2- 172.21.15.77:0/3914213601 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f33d806ae70 0x7f33d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:58.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.790+0000 7f33d3fff640 1 -- 172.21.15.77:0/3914213601 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f33dc02d040 con 0x7f33ec0d0710 2023-11-04T01:39:58.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.790+0000 7f33eb7fe640 1 --2- 172.21.15.77:0/3914213601 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f33d806ae70 0x7f33d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:58.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.791+0000 7f33eb7fe640 1 --2- 172.21.15.77:0/3914213601 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f33d806ae70 0x7f33d806d330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f33e0009890 tx=0x7f33e0008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:58.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.794+0000 7f33d3fff640 1 -- 172.21.15.77:0/3914213601 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f33ec14a690 con 0x7f33ec0d0710 2023-11-04T01:39:58.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.959+0000 7f33f1d4c640 1 -- 172.21.15.77:0/3914213601 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f33ec14a690 con 0x7f33ec0d0710 2023-11-04T01:39:58.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.959+0000 7f33d3fff640 1 -- 172.21.15.77:0/3914213601 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f33ec14a690 con 0x7f33ec0d0710 2023-11-04T01:39:58.962 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:39:58.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.961+0000 7f33f1d4c640 1 -- 172.21.15.77:0/3914213601 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f33d806ae70 msgr2=0x7f33d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.961+0000 7f33f1d4c640 1 --2- 172.21.15.77:0/3914213601 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f33d806ae70 0x7f33d806d330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f33e0009890 tx=0x7f33e0008040 comp rx=0 tx=0).stop 2023-11-04T01:39:58.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.961+0000 7f33f1d4c640 1 -- 172.21.15.77:0/3914213601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33ec0d0710 msgr2=0x7f33ec0c8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:58.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.961+0000 7f33f1d4c640 1 --2- 172.21.15.77:0/3914213601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33ec0d0710 0x7f33ec0c8cc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f33dc000c00 tx=0x7f33dc0046c0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.961+0000 7f33f1d4c640 1 -- 172.21.15.77:0/3914213601 shutdown_connections 2023-11-04T01:39:58.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.961+0000 7f33f1d4c640 1 --2- 172.21.15.77:0/3914213601 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f33d806ae70 0x7f33d806d330 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.961+0000 7f33f1d4c640 1 --2- 172.21.15.77:0/3914213601 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f33ec15e430 0x7f33ec0b28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.961+0000 7f33f1d4c640 1 --2- 172.21.15.77:0/3914213601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33ec0d0710 0x7f33ec0c8cc0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.961+0000 7f33f1d4c640 1 --2- 172.21.15.77:0/3914213601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33ec0cf160 0x7f33ec149730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:58.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.961+0000 7f33f1d4c640 1 -- 172.21.15.77:0/3914213601 >> 172.21.15.77:0/3914213601 conn(0x7f33ec06ea20 msgr2=0x7f33ec0b3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:58.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.961+0000 7f33f1d4c640 1 -- 172.21.15.77:0/3914213601 shutdown_connections 2023-11-04T01:39:58.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:58.961+0000 7f33f1d4c640 1 -- 172.21.15.77:0/3914213601 wait complete. 2023-11-04T01:39:58.974 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:39:59.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.071+0000 7f3513d55640 1 Processor -- start 2023-11-04T01:39:59.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.071+0000 7f3513d55640 1 -- start start 2023-11-04T01:39:59.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.072+0000 7f3513d55640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f350c06a830 0x7f350c0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:59.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.072+0000 7f3513d55640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f350c06eba0 0x7f350c0ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:59.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.072+0000 7f3513d55640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f350c06d310 con 0x7f350c15ab70 2023-11-04T01:39:59.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.072+0000 7f3513d55640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f350c0cba70 con 0x7f350c06eba0 2023-11-04T01:39:59.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.072+0000 7f3513d55640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f350c161c50 con 0x7f350c06a830 2023-11-04T01:39:59.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.072+0000 7f35122f2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f350c06eba0 0x7f350c0ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:59.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.072+0000 7f35122f2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f350c06eba0 0x7f350c0ae5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37482/0 (socket says 172.21.15.77:37482) 2023-11-04T01:39:59.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.072+0000 7f35122f2640 1 -- 172.21.15.77:0/2615729745 learned_addr learned my addr 172.21.15.77:0/2615729745 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:39:59.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.072+0000 7f35112f0640 1 --2- 172.21.15.77:0/2615729745 >> v2:172.21.15.122:3300/0 conn(0x7f350c06a830 0x7f350c0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:59.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.072+0000 7f35122f2640 1 -- 172.21.15.77:0/2615729745 >> v2:172.21.15.122:3300/0 conn(0x7f350c06a830 msgr2=0x7f350c0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:39:59.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.072+0000 7f35122f2640 1 --2- 172.21.15.77:0/2615729745 >> v2:172.21.15.122:3300/0 conn(0x7f350c06a830 0x7f350c0cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.072+0000 7f35122f2640 1 -- 172.21.15.77:0/2615729745 >> v1:172.21.15.122:6789/0 conn(0x7f350c15ab70 legacy=0x7f350c06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:59.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.072+0000 7f35122f2640 1 -- 172.21.15.77:0/2615729745 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350c15d860 con 0x7f350c06eba0 2023-11-04T01:39:59.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.072+0000 7f35112f0640 1 --2- 172.21.15.77:0/2615729745 >> v2:172.21.15.122:3300/0 conn(0x7f350c06a830 0x7f350c0cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:39:59.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.073+0000 7f35122f2640 1 --2- 172.21.15.77:0/2615729745 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f350c06eba0 0x7f350c0ae5e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f350c0726b0 tx=0x7f350402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f131748b86f2dc5d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:59.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.073+0000 7f3510aef640 1 -- 172.21.15.77:0/2615729745 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350402ca80 con 0x7f350c06eba0 2023-11-04T01:39:59.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.073+0000 7f3510aef640 1 -- 172.21.15.77:0/2615729745 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350402cbe0 con 0x7f350c06eba0 2023-11-04T01:39:59.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.073+0000 7f3510aef640 1 -- 172.21.15.77:0/2615729745 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35040343f0 con 0x7f350c06eba0 2023-11-04T01:39:59.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.074+0000 7f3513d55640 1 -- 172.21.15.77:0/2615729745 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f350c06eba0 msgr2=0x7f350c0ae5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:59.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.074+0000 7f3513d55640 1 --2- 172.21.15.77:0/2615729745 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f350c06eba0 0x7f350c0ae5e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f350c0726b0 tx=0x7f350402bee0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.074+0000 7f3513d55640 1 -- 172.21.15.77:0/2615729745 shutdown_connections 2023-11-04T01:39:59.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.074+0000 7f3513d55640 1 --2- 172.21.15.77:0/2615729745 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f350c06eba0 0x7f350c0ae5e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.074+0000 7f3513d55640 1 --2- 172.21.15.77:0/2615729745 >> v2:172.21.15.122:3300/0 conn(0x7f350c06a830 0x7f350c0cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.074+0000 7f3513d55640 1 -- 172.21.15.77:0/2615729745 >> 172.21.15.77:0/2615729745 conn(0x7f350c098d40 msgr2=0x7f350c0cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:59.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.074+0000 7f3513d55640 1 -- 172.21.15.77:0/2615729745 shutdown_connections 2023-11-04T01:39:59.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.074+0000 7f3513d55640 1 -- 172.21.15.77:0/2615729745 wait complete. 2023-11-04T01:39:59.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.075+0000 7f3513d55640 1 Processor -- start 2023-11-04T01:39:59.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.075+0000 7f3513d55640 1 -- start start 2023-11-04T01:39:59.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.076+0000 7f3513d55640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f350c06a830 0x7f350c156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:59.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.076+0000 7f3513d55640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f350c06eba0 0x7f350c1f2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:59.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.076+0000 7f3513d55640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f350c15ab70 0x7f350c0b2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:59.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.076+0000 7f3513d55640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350c0c4910 con 0x7f350c15ab70 2023-11-04T01:39:59.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.076+0000 7f3513d55640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350c1f30a0 con 0x7f350c06a830 2023-11-04T01:39:59.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.076+0000 7f3513d55640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f350c1f3380 con 0x7f350c06eba0 2023-11-04T01:39:59.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.076+0000 7f35122f2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f350c15ab70 0x7f350c0b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:59.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.076+0000 7f35122f2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f350c15ab70 0x7f350c0b2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37484/0 (socket says 172.21.15.77:37484) 2023-11-04T01:39:59.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.076+0000 7f35122f2640 1 -- 172.21.15.77:0/1028733023 learned_addr learned my addr 172.21.15.77:0/1028733023 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:39:59.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.076+0000 7f35112f0640 1 --2- 172.21.15.77:0/1028733023 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f350c06eba0 0x7f350c1f2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:59.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.076+0000 7f35122f2640 1 -- 172.21.15.77:0/1028733023 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f350c06eba0 msgr2=0x7f350c1f2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:59.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.076+0000 7f35122f2640 1 --2- 172.21.15.77:0/1028733023 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f350c06eba0 0x7f350c1f2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.076+0000 7f35122f2640 1 -- 172.21.15.77:0/1028733023 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f350c06a830 msgr2=0x7f350c156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:59.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.076+0000 7f35122f2640 1 --2- 172.21.15.77:0/1028733023 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f350c06a830 0x7f350c156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.076+0000 7f35122f2640 1 -- 172.21.15.77:0/1028733023 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3504009b30 con 0x7f350c15ab70 2023-11-04T01:39:59.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.076+0000 7f35122f2640 1 --2- 172.21.15.77:0/1028733023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f350c15ab70 0x7f350c0b2690 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3504036040 tx=0x7f3504004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:59.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.076+0000 7f35027fc640 1 -- 172.21.15.77:0/1028733023 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3504009510 con 0x7f350c15ab70 2023-11-04T01:39:59.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.076+0000 7f35027fc640 1 -- 172.21.15.77:0/1028733023 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350403e450 con 0x7f350c15ab70 2023-11-04T01:39:59.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.076+0000 7f35027fc640 1 -- 172.21.15.77:0/1028733023 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350403e800 con 0x7f350c15ab70 2023-11-04T01:39:59.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.076+0000 7f3513d55640 1 -- 172.21.15.77:0/1028733023 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f350c0c4bd0 con 0x7f350c15ab70 2023-11-04T01:39:59.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.076+0000 7f3513d55640 1 -- 172.21.15.77:0/1028733023 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f350c1f2b90 con 0x7f350c15ab70 2023-11-04T01:39:59.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.077+0000 7f3513d55640 1 -- 172.21.15.77:0/1028733023 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f350c0c4df0 con 0x7f350c15ab70 2023-11-04T01:39:59.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.078+0000 7f35027fc640 1 -- 172.21.15.77:0/1028733023 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f350402cd50 con 0x7f350c15ab70 2023-11-04T01:39:59.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.078+0000 7f35027fc640 1 --2- 172.21.15.77:0/1028733023 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f34f006ae70 0x7f34f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:39:59.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.078+0000 7f35027fc640 1 -- 172.21.15.77:0/1028733023 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f35040abe00 con 0x7f350c15ab70 2023-11-04T01:39:59.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.078+0000 7f3511af1640 1 --2- 172.21.15.77:0/1028733023 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f34f006ae70 0x7f34f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:39:59.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.079+0000 7f3511af1640 1 --2- 172.21.15.77:0/1028733023 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f34f006ae70 0x7f34f006d330 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3508007fd0 tx=0x7f35080079a0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:39:59.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.082+0000 7f35027fc640 1 -- 172.21.15.77:0/1028733023 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3504077200 con 0x7f350c15ab70 2023-11-04T01:39:59.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.286+0000 7f3513d55640 1 -- 172.21.15.77:0/1028733023 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f350c074290 con 0x7f350c15ab70 2023-11-04T01:39:59.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.287+0000 7f35027fc640 1 -- 172.21.15.77:0/1028733023 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f3504043540 con 0x7f350c15ab70 2023-11-04T01:39:59.289 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:39:59.289 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2709973073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2709973073},{"type":"v1","addr":"172.21.15.77:6835","nonce":2709973073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-04T01:39:59.290 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 2 2023-11-04T01:39:59.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.289+0000 7f3513d55640 1 -- 172.21.15.77:0/1028733023 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f34f006ae70 msgr2=0x7f34f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:59.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.289+0000 7f3513d55640 1 --2- 172.21.15.77:0/1028733023 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f34f006ae70 0x7f34f006d330 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3508007fd0 tx=0x7f35080079a0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.289+0000 7f3513d55640 1 -- 172.21.15.77:0/1028733023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f350c15ab70 msgr2=0x7f350c0b2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:39:59.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.289+0000 7f3513d55640 1 --2- 172.21.15.77:0/1028733023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f350c15ab70 0x7f350c0b2690 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3504036040 tx=0x7f3504004a40 comp rx=0 tx=0).stop 2023-11-04T01:39:59.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.289+0000 7f3513d55640 1 -- 172.21.15.77:0/1028733023 shutdown_connections 2023-11-04T01:39:59.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.289+0000 7f3513d55640 1 --2- 172.21.15.77:0/1028733023 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f34f006ae70 0x7f34f006d330 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.289+0000 7f3513d55640 1 --2- 172.21.15.77:0/1028733023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f350c15ab70 0x7f350c0b2690 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.289+0000 7f3513d55640 1 --2- 172.21.15.77:0/1028733023 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f350c06eba0 0x7f350c1f2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.289+0000 7f3513d55640 1 --2- 172.21.15.77:0/1028733023 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f350c06a830 0x7f350c156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:39:59.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.289+0000 7f3513d55640 1 -- 172.21.15.77:0/1028733023 >> 172.21.15.77:0/1028733023 conn(0x7f350c098d40 msgr2=0x7f350c06e380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:39:59.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.289+0000 7f3513d55640 1 -- 172.21.15.77:0/1028733023 shutdown_connections 2023-11-04T01:39:59.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:39:59.289+0000 7f3513d55640 1 -- 172.21.15.77:0/1028733023 wait complete. 2023-11-04T01:39:59.485 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:39:59.487 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:40:01.301 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:01.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.412+0000 7f2345c39640 1 Processor -- start 2023-11-04T01:40:01.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.412+0000 7f2345c39640 1 -- start start 2023-11-04T01:40:01.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.413+0000 7f2345c39640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2340159da0 0x7f23400b5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.413+0000 7f2345c39640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f23400b5780 0x7f23400cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.413+0000 7f2345c39640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23400cf740 con 0x7f23400cc970 2023-11-04T01:40:01.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.413+0000 7f2345c39640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23400cce00 con 0x7f23400b5780 2023-11-04T01:40:01.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.413+0000 7f2345c39640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23400cd690 con 0x7f2340159da0 2023-11-04T01:40:01.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.413+0000 7f233effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f23400b5780 0x7f23400cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.414+0000 7f233ffff640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f23400cc970 0x7f23400b14a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:57442/0 (socket says 172.21.15.77:57442) 2023-11-04T01:40:01.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.414+0000 7f233f7fe640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2340159da0 0x7f23400b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.414+0000 7f233ffff640 1 -- 172.21.15.77:0/4088967585 learned_addr learned my addr 172.21.15.77:0/4088967585 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:01.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.414+0000 7f233effd640 1 -- 172.21.15.77:0/4088967585 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2340159da0 msgr2=0x7f23400b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:01.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.414+0000 7f233effd640 1 --2- 172.21.15.77:0/4088967585 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2340159da0 0x7f23400b5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.414+0000 7f233effd640 1 -- 172.21.15.77:0/4088967585 >> v1:172.21.15.122:6789/0 conn(0x7f23400cc970 legacy=0x7f23400b14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:01.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.414+0000 7f233e7fc640 1 -- 172.21.15.77:0/4088967585 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1409964991 0 0) 0x7f23400cf740 con 0x7f23400cc970 2023-11-04T01:40:01.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.414+0000 7f233effd640 1 -- 172.21.15.77:0/4088967585 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23400cd970 con 0x7f23400b5780 2023-11-04T01:40:01.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.414+0000 7f233f7fe640 1 --2- 172.21.15.77:0/4088967585 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2340159da0 0x7f23400b5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:01.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.415+0000 7f233effd640 1 --2- 172.21.15.77:0/4088967585 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23400b5780 0x7f23400cc430 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f23340097a0 tx=0x7f233402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17aaac712d94473d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:01.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.415+0000 7f233e7fc640 1 -- 172.21.15.77:0/4088967585 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2334031830 con 0x7f23400b5780 2023-11-04T01:40:01.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.415+0000 7f233e7fc640 1 -- 172.21.15.77:0/4088967585 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2334031990 con 0x7f23400b5780 2023-11-04T01:40:01.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.415+0000 7f233e7fc640 1 -- 172.21.15.77:0/4088967585 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2334031d20 con 0x7f23400b5780 2023-11-04T01:40:01.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.415+0000 7f2345c39640 1 -- 172.21.15.77:0/4088967585 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23400b5780 msgr2=0x7f23400cc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:01.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.415+0000 7f2345c39640 1 --2- 172.21.15.77:0/4088967585 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23400b5780 0x7f23400cc430 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f23340097a0 tx=0x7f233402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.415+0000 7f2345c39640 1 -- 172.21.15.77:0/4088967585 shutdown_connections 2023-11-04T01:40:01.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.415+0000 7f2345c39640 1 --2- 172.21.15.77:0/4088967585 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23400b5780 0x7f23400cc430 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.415+0000 7f2345c39640 1 --2- 172.21.15.77:0/4088967585 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2340159da0 0x7f23400b5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.415+0000 7f2345c39640 1 -- 172.21.15.77:0/4088967585 >> 172.21.15.77:0/4088967585 conn(0x7f234006d8b0 msgr2=0x7f234006dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:01.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.415+0000 7f2345c39640 1 -- 172.21.15.77:0/4088967585 shutdown_connections 2023-11-04T01:40:01.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.415+0000 7f2345c39640 1 -- 172.21.15.77:0/4088967585 wait complete. 2023-11-04T01:40:01.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.417+0000 7f2345c39640 1 Processor -- start 2023-11-04T01:40:01.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.417+0000 7f2345c39640 1 -- start start 2023-11-04T01:40:01.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.418+0000 7f2345c39640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f23400b5780 0x7f23400a7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.418+0000 7f2345c39640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23400cc970 0x7f234014bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.418+0000 7f2345c39640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2340159da0 0x7f234014c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.418+0000 7f2345c39640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2340149c80 con 0x7f23400cc970 2023-11-04T01:40:01.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.418+0000 7f2345c39640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2340149ed0 con 0x7f2340159da0 2023-11-04T01:40:01.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.418+0000 7f2345c39640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f234014a1b0 con 0x7f23400b5780 2023-11-04T01:40:01.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.418+0000 7f233effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23400cc970 0x7f234014bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.418+0000 7f233effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23400cc970 0x7f234014bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37496/0 (socket says 172.21.15.77:37496) 2023-11-04T01:40:01.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.418+0000 7f233effd640 1 -- 172.21.15.77:0/996710169 learned_addr learned my addr 172.21.15.77:0/996710169 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:01.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.418+0000 7f233f7fe640 1 --2- 172.21.15.77:0/996710169 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f23400b5780 0x7f23400a7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.418+0000 7f233ffff640 1 --2- 172.21.15.77:0/996710169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2340159da0 0x7f234014c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.418+0000 7f233effd640 1 -- 172.21.15.77:0/996710169 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f23400b5780 msgr2=0x7f23400a7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:01.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.418+0000 7f233effd640 1 --2- 172.21.15.77:0/996710169 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f23400b5780 0x7f23400a7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.418+0000 7f233effd640 1 -- 172.21.15.77:0/996710169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2340159da0 msgr2=0x7f234014c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:01.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.418+0000 7f233effd640 1 --2- 172.21.15.77:0/996710169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2340159da0 0x7f234014c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.418+0000 7f233effd640 1 -- 172.21.15.77:0/996710169 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2330009400 con 0x7f23400cc970 2023-11-04T01:40:01.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.418+0000 7f233f7fe640 1 --2- 172.21.15.77:0/996710169 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f23400b5780 0x7f23400a7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:01.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.418+0000 7f233ffff640 1 --2- 172.21.15.77:0/996710169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2340159da0 0x7f234014c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:01.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.418+0000 7f233effd640 1 --2- 172.21.15.77:0/996710169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23400cc970 0x7f234014bd10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2334000c00 tx=0x7f23340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:01.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.418+0000 7f2327fff640 1 -- 172.21.15.77:0/996710169 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2334004230 con 0x7f23400cc970 2023-11-04T01:40:01.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.418+0000 7f2327fff640 1 -- 172.21.15.77:0/996710169 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23340043b0 con 0x7f23400cc970 2023-11-04T01:40:01.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.418+0000 7f2327fff640 1 -- 172.21.15.77:0/996710169 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2334004520 con 0x7f23400cc970 2023-11-04T01:40:01.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.418+0000 7f2345c39640 1 -- 172.21.15.77:0/996710169 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2334009400 con 0x7f23400cc970 2023-11-04T01:40:01.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.418+0000 7f2345c39640 1 -- 172.21.15.77:0/996710169 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f234014a770 con 0x7f23400cc970 2023-11-04T01:40:01.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.419+0000 7f2345c39640 1 -- 172.21.15.77:0/996710169 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23400674e0 con 0x7f23400cc970 2023-11-04T01:40:01.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.420+0000 7f2327fff640 1 -- 172.21.15.77:0/996710169 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f233403a870 con 0x7f23400cc970 2023-11-04T01:40:01.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.420+0000 7f2327fff640 1 --2- 172.21.15.77:0/996710169 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f232c06aea0 0x7f232c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.420+0000 7f2327fff640 1 -- 172.21.15.77:0/996710169 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f23340ab350 con 0x7f23400cc970 2023-11-04T01:40:01.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.420+0000 7f233f7fe640 1 --2- 172.21.15.77:0/996710169 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f232c06aea0 0x7f232c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.421+0000 7f233f7fe640 1 --2- 172.21.15.77:0/996710169 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f232c06aea0 0x7f232c06d360 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2330009c50 tx=0x7f2330008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:01.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.425+0000 7f2327fff640 1 -- 172.21.15.77:0/996710169 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f23340767e0 con 0x7f23400cc970 2023-11-04T01:40:01.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.624+0000 7f2345c39640 1 -- 172.21.15.77:0/996710169 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f234014a930 con 0x7f23400cc970 2023-11-04T01:40:01.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.624+0000 7f2327fff640 1 -- 172.21.15.77:0/996710169 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3698 (secure 0 0 0) 0x7f2334079e00 con 0x7f23400cc970 2023-11-04T01:40:01.627 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:01.627 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/2867268857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2867268857},{"type":"v1","addr":"172.21.15.77:6834","nonce":2867268857}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2709973073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2709973073},{"type":"v1","addr":"172.21.15.77:6835","nonce":2709973073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/396299424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":396299424},{"type":"v1","addr":"172.21.15.122:6837","nonce":396299424}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":34166,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2444318089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2444318089},{"type":"v1","addr":"172.21.15.122:6836","nonce":2444318089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-04T01:40:01.627 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 3 2023-11-04T01:40:01.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.626+0000 7f2345c39640 1 -- 172.21.15.77:0/996710169 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f232c06aea0 msgr2=0x7f232c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:01.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.626+0000 7f2345c39640 1 --2- 172.21.15.77:0/996710169 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f232c06aea0 0x7f232c06d360 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2330009c50 tx=0x7f2330008040 comp rx=0 tx=0).stop 2023-11-04T01:40:01.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.626+0000 7f2345c39640 1 -- 172.21.15.77:0/996710169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23400cc970 msgr2=0x7f234014bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:01.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.626+0000 7f2345c39640 1 --2- 172.21.15.77:0/996710169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23400cc970 0x7f234014bd10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2334000c00 tx=0x7f23340046c0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.626+0000 7f2345c39640 1 -- 172.21.15.77:0/996710169 shutdown_connections 2023-11-04T01:40:01.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.626+0000 7f2345c39640 1 --2- 172.21.15.77:0/996710169 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f232c06aea0 0x7f232c06d360 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.626+0000 7f2345c39640 1 --2- 172.21.15.77:0/996710169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2340159da0 0x7f234014c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.626+0000 7f2345c39640 1 --2- 172.21.15.77:0/996710169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23400cc970 0x7f234014bd10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.626+0000 7f2345c39640 1 --2- 172.21.15.77:0/996710169 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f23400b5780 0x7f23400a7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.626+0000 7f2345c39640 1 -- 172.21.15.77:0/996710169 >> 172.21.15.77:0/996710169 conn(0x7f234006d8b0 msgr2=0x7f23400cfa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:01.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.627+0000 7f2345c39640 1 -- 172.21.15.77:0/996710169 shutdown_connections 2023-11-04T01:40:01.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.627+0000 7f2345c39640 1 -- 172.21.15.77:0/996710169 wait complete. 2023-11-04T01:40:01.639 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:01.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.738+0000 7f95ae190640 1 Processor -- start 2023-11-04T01:40:01.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.738+0000 7f95ae190640 1 -- start start 2023-11-04T01:40:01.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.739+0000 7f95ae190640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f95a80af060 0x7f95a80b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.739+0000 7f95ae190640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95a80b1590 con 0x7f95a806ef40 2023-11-04T01:40:01.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.739+0000 7f95ae190640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95a806a8e0 con 0x7f95a80aec80 2023-11-04T01:40:01.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.739+0000 7f95ae190640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a8155a40 con 0x7f95a80af060 2023-11-04T01:40:01.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.739+0000 7f95a7fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f95a806ef40 0x7f95a80cb7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41240/0 (socket says 172.21.15.77:41240) 2023-11-04T01:40:01.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.739+0000 7f95a7fff640 1 -- 172.21.15.77:0/2899095106 learned_addr learned my addr 172.21.15.77:0/2899095106 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:01.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.739+0000 7f95a6ffd640 1 --2- 172.21.15.77:0/2899095106 >> v2:172.21.15.122:3300/0 conn(0x7f95a80af060 0x7f95a80b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.739+0000 7f95a67fc640 1 -- 172.21.15.77:0/2899095106 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1951077093 0 0) 0x7f95a80b1590 con 0x7f95a806ef40 2023-11-04T01:40:01.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.739+0000 7f95a67fc640 1 -- 172.21.15.77:0/2899095106 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9590003520 con 0x7f95a806ef40 2023-11-04T01:40:01.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.739+0000 7f95a67fc640 1 -- 172.21.15.77:0/2899095106 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4289286365 0 0) 0x7f9590003520 con 0x7f95a806ef40 2023-11-04T01:40:01.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.739+0000 7f95a67fc640 1 -- 172.21.15.77:0/2899095106 >> v2:172.21.15.122:3300/0 conn(0x7f95a80af060 msgr2=0x7f95a80b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:01.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.739+0000 7f95a67fc640 1 --2- 172.21.15.77:0/2899095106 >> v2:172.21.15.122:3300/0 conn(0x7f95a80af060 0x7f95a80b1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.739+0000 7f95a67fc640 1 -- 172.21.15.77:0/2899095106 >> v1:172.21.15.122:6789/0 conn(0x7f95a80aec80 legacy=0x7f95a806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:01.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.739+0000 7f95a67fc640 1 -- 172.21.15.77:0/2899095106 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a80b1800 con 0x7f95a806ef40 2023-11-04T01:40:01.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.739+0000 7f95a67fc640 1 -- 172.21.15.77:0/2899095106 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f95a00019f0 con 0x7f95a806ef40 2023-11-04T01:40:01.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.740+0000 7f95a67fc640 1 -- 172.21.15.77:0/2899095106 >> v1:172.21.15.77:6789/0 conn(0x7f95a806ef40 legacy=0x7f95a80cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:01.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.740+0000 7f95a67fc640 1 --2- 172.21.15.77:0/2899095106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9590003970 0x7f9590003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.740+0000 7f95a67fc640 1 --2- 172.21.15.77:0/2899095106 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f95900047c0 0x7f9590004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.740+0000 7f95a67fc640 1 --2- 172.21.15.77:0/2899095106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9590005180 0x7f959000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.740+0000 7f95a67fc640 1 -- 172.21.15.77:0/2899095106 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a8155a40 con 0x7f9590005180 2023-11-04T01:40:01.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.740+0000 7f95a67fc640 1 -- 172.21.15.77:0/2899095106 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959000c020 con 0x7f9590003970 2023-11-04T01:40:01.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.740+0000 7f95a67fc640 1 -- 172.21.15.77:0/2899095106 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959000c1e0 con 0x7f95900047c0 2023-11-04T01:40:01.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.740+0000 7f95a7fff640 1 --2- 172.21.15.77:0/2899095106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9590005180 0x7f959000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.740+0000 7f95a77fe640 1 --2- 172.21.15.77:0/2899095106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9590003970 0x7f9590003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.740+0000 7f95a6ffd640 1 --2- 172.21.15.77:0/2899095106 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f95900047c0 0x7f9590004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.740+0000 7f95a7fff640 1 -- 172.21.15.77:0/2899095106 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f95900047c0 msgr2=0x7f9590004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:01.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.740+0000 7f95a7fff640 1 --2- 172.21.15.77:0/2899095106 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f95900047c0 0x7f9590004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.740+0000 7f95a7fff640 1 -- 172.21.15.77:0/2899095106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9590003970 msgr2=0x7f9590003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:01.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.740+0000 7f95a7fff640 1 --2- 172.21.15.77:0/2899095106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9590003970 0x7f9590003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.740+0000 7f95a7fff640 1 -- 172.21.15.77:0/2899095106 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9590003520 con 0x7f9590005180 2023-11-04T01:40:01.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.741+0000 7f95a7fff640 1 -- 172.21.15.77:0/2899095106 reap_dead start 2023-11-04T01:40:01.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.741+0000 7f95a7fff640 1 --2- 172.21.15.77:0/2899095106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9590005180 0x7f959000b980 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f95a00013d0 tx=0x7f95900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d37551492885437e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:01.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.741+0000 7f95a67fc640 1 -- 172.21.15.77:0/2899095106 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a0034630 con 0x7f9590005180 2023-11-04T01:40:01.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.741+0000 7f95a67fc640 1 -- 172.21.15.77:0/2899095106 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a002f070 con 0x7f9590005180 2023-11-04T01:40:01.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.741+0000 7f95a67fc640 1 -- 172.21.15.77:0/2899095106 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a00349d0 con 0x7f9590005180 2023-11-04T01:40:01.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.741+0000 7f95ae190640 1 -- 172.21.15.77:0/2899095106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9590005180 msgr2=0x7f959000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:01.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.741+0000 7f95ae190640 1 --2- 172.21.15.77:0/2899095106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9590005180 0x7f959000b980 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f95a00013d0 tx=0x7f95900057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.741+0000 7f95ae190640 1 -- 172.21.15.77:0/2899095106 shutdown_connections 2023-11-04T01:40:01.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.741+0000 7f95ae190640 1 --2- 172.21.15.77:0/2899095106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9590005180 0x7f959000b980 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.741+0000 7f95ae190640 1 -- 172.21.15.77:0/2899095106 >> 172.21.15.77:0/2899095106 conn(0x7f95a8098d40 msgr2=0x7f95a80cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:01.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.741+0000 7f95ae190640 1 -- 172.21.15.77:0/2899095106 shutdown_connections 2023-11-04T01:40:01.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.741+0000 7f95ae190640 1 -- 172.21.15.77:0/2899095106 wait complete. 2023-11-04T01:40:01.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.742+0000 7f95ae190640 1 Processor -- start 2023-11-04T01:40:01.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.743+0000 7f95ae190640 1 -- start start 2023-11-04T01:40:01.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.743+0000 7f95ae190640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9590005180 0x7f95a814d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.743+0000 7f95ae190640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f95a81f3d20 0x7f95a81f41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.743+0000 7f95ae190640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95a80b0560 0x7f95a80b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.743+0000 7f95ae190640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a80c7660 con 0x7f9590005180 2023-11-04T01:40:01.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.743+0000 7f95ae190640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a80b0f20 con 0x7f95a80b0560 2023-11-04T01:40:01.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.743+0000 7f95ae190640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a81f47e0 con 0x7f95a81f3d20 2023-11-04T01:40:01.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.743+0000 7f95a77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9590005180 0x7f95a814d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.743+0000 7f95a77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9590005180 0x7f95a814d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37524/0 (socket says 172.21.15.77:37524) 2023-11-04T01:40:01.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.743+0000 7f95a77fe640 1 -- 172.21.15.77:0/3384241266 learned_addr learned my addr 172.21.15.77:0/3384241266 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:01.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.744+0000 7f95a6ffd640 1 --2- 172.21.15.77:0/3384241266 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f95a81f3d20 0x7f95a81f41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.744+0000 7f95a7fff640 1 --2- 172.21.15.77:0/3384241266 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95a80b0560 0x7f95a80b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.744+0000 7f95a77fe640 1 -- 172.21.15.77:0/3384241266 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f95a81f3d20 msgr2=0x7f95a81f41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:01.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.744+0000 7f95a77fe640 1 --2- 172.21.15.77:0/3384241266 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f95a81f3d20 0x7f95a81f41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.744+0000 7f95a77fe640 1 -- 172.21.15.77:0/3384241266 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95a80b0560 msgr2=0x7f95a80b09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:01.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.744+0000 7f95a77fe640 1 --2- 172.21.15.77:0/3384241266 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95a80b0560 0x7f95a80b09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.744+0000 7f95a77fe640 1 -- 172.21.15.77:0/3384241266 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a81f4ac0 con 0x7f9590005180 2023-11-04T01:40:01.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.744+0000 7f95a7fff640 1 --2- 172.21.15.77:0/3384241266 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95a80b0560 0x7f95a80b09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:01.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.744+0000 7f95a77fe640 1 --2- 172.21.15.77:0/3384241266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9590005180 0x7f95a814d070 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9598001f00 tx=0x7f959800fa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:01.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.744+0000 7f958ffff640 1 -- 172.21.15.77:0/3384241266 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9598005320 con 0x7f9590005180 2023-11-04T01:40:01.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.744+0000 7f958ffff640 1 -- 172.21.15.77:0/3384241266 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9598005480 con 0x7f9590005180 2023-11-04T01:40:01.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.744+0000 7f958ffff640 1 -- 172.21.15.77:0/3384241266 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9598006a40 con 0x7f9590005180 2023-11-04T01:40:01.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.744+0000 7f95ae190640 1 -- 172.21.15.77:0/3384241266 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95a80c7870 con 0x7f9590005180 2023-11-04T01:40:01.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.744+0000 7f95ae190640 1 -- 172.21.15.77:0/3384241266 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a814d5b0 con 0x7f9590005180 2023-11-04T01:40:01.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.745+0000 7f95ae190640 1 -- 172.21.15.77:0/3384241266 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a81f4cb0 con 0x7f9590005180 2023-11-04T01:40:01.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.745+0000 7f958ffff640 1 -- 172.21.15.77:0/3384241266 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9598006ba0 con 0x7f9590005180 2023-11-04T01:40:01.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.746+0000 7f958ffff640 1 --2- 172.21.15.77:0/3384241266 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f959406aea0 0x7f959406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:01.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.746+0000 7f958ffff640 1 -- 172.21.15.77:0/3384241266 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9598088740 con 0x7f9590005180 2023-11-04T01:40:01.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.746+0000 7f95a6ffd640 1 --2- 172.21.15.77:0/3384241266 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f959406aea0 0x7f959406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:01.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.746+0000 7f95a6ffd640 1 --2- 172.21.15.77:0/3384241266 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f959406aea0 0x7f959406d360 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f95a806ecc0 tx=0x7f959c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:01.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.750+0000 7f958ffff640 1 -- 172.21.15.77:0/3384241266 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f95a81f4cb0 con 0x7f9590005180 2023-11-04T01:40:01.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.918+0000 7f95ae190640 1 -- 172.21.15.77:0/3384241266 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95a81f4c50 con 0x7f9590005180 2023-11-04T01:40:01.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.919+0000 7f958ffff640 1 -- 172.21.15.77:0/3384241266 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12838 (secure 0 0 0) 0x7f9598053c80 con 0x7f9590005180 2023-11-04T01:40:01.921 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:01.921 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":16,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:39:54.643163+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:01.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.920+0000 7f95ae190640 1 -- 172.21.15.77:0/3384241266 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f959406aea0 msgr2=0x7f959406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:01.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.920+0000 7f95ae190640 1 --2- 172.21.15.77:0/3384241266 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f959406aea0 0x7f959406d360 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f95a806ecc0 tx=0x7f959c008040 comp rx=0 tx=0).stop 2023-11-04T01:40:01.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.920+0000 7f95ae190640 1 -- 172.21.15.77:0/3384241266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9590005180 msgr2=0x7f95a814d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:01.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.920+0000 7f95ae190640 1 --2- 172.21.15.77:0/3384241266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9590005180 0x7f95a814d070 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9598001f00 tx=0x7f959800fa50 comp rx=0 tx=0).stop 2023-11-04T01:40:01.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.921+0000 7f95ae190640 1 -- 172.21.15.77:0/3384241266 shutdown_connections 2023-11-04T01:40:01.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.921+0000 7f95ae190640 1 --2- 172.21.15.77:0/3384241266 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f959406aea0 0x7f959406d360 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.921+0000 7f95ae190640 1 --2- 172.21.15.77:0/3384241266 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95a80b0560 0x7f95a80b09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.921+0000 7f95ae190640 1 --2- 172.21.15.77:0/3384241266 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f95a81f3d20 0x7f95a81f41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.921+0000 7f95ae190640 1 --2- 172.21.15.77:0/3384241266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9590005180 0x7f95a814d070 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:01.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.921+0000 7f95ae190640 1 -- 172.21.15.77:0/3384241266 >> 172.21.15.77:0/3384241266 conn(0x7f95a8098d40 msgr2=0x7f95a80ccd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:01.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.921+0000 7f95ae190640 1 -- 172.21.15.77:0/3384241266 shutdown_connections 2023-11-04T01:40:01.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:01.921+0000 7f95ae190640 1 -- 172.21.15.77:0/3384241266 wait complete. 2023-11-04T01:40:01.933 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:40:01.933 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:40:02.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.035+0000 7f60ea3a9640 1 Processor -- start 2023-11-04T01:40:02.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.035+0000 7f60ea3a9640 1 -- start start 2023-11-04T01:40:02.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.035+0000 7f60ea3a9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f60e4160430 0x7f60e40b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.035+0000 7f60ea3a9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f60e40b2b60 0x7f60e406bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.035+0000 7f60ea3a9640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e40b2fc0 con 0x7f60e406c1d0 2023-11-04T01:40:02.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.035+0000 7f60ea3a9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e40cb580 con 0x7f60e4160430 2023-11-04T01:40:02.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.035+0000 7f60ea3a9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e406ca40 con 0x7f60e40b2b60 2023-11-04T01:40:02.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.036+0000 7f60e3fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f60e4160430 0x7f60e40b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:02.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.036+0000 7f60e3fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f60e4160430 0x7f60e40b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37540/0 (socket says 172.21.15.77:37540) 2023-11-04T01:40:02.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.036+0000 7f60e3fff640 1 -- 172.21.15.77:0/3691119195 learned_addr learned my addr 172.21.15.77:0/3691119195 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:02.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.036+0000 7f60e37fe640 1 --2- 172.21.15.77:0/3691119195 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f60e40b2b60 0x7f60e406bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:02.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.036+0000 7f60e3fff640 1 -- 172.21.15.77:0/3691119195 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f60e40b2b60 msgr2=0x7f60e406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:02.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.036+0000 7f60e3fff640 1 --2- 172.21.15.77:0/3691119195 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f60e40b2b60 0x7f60e406bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.036+0000 7f60e3fff640 1 -- 172.21.15.77:0/3691119195 >> v1:172.21.15.122:6789/0 conn(0x7f60e406c1d0 legacy=0x7f60e4160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:02.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.036+0000 7f60e3fff640 1 -- 172.21.15.77:0/3691119195 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e406cd20 con 0x7f60e4160430 2023-11-04T01:40:02.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.036+0000 7f60e37fe640 1 --2- 172.21.15.77:0/3691119195 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f60e40b2b60 0x7f60e406bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:02.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.037+0000 7f60e3fff640 1 --2- 172.21.15.77:0/3691119195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60e4160430 0x7f60e40b2620 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f60d4009870 tx=0x7f60d402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f712139fab4aaab server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:02.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.037+0000 7f60e2ffd640 1 -- 172.21.15.77:0/3691119195 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d4030840 con 0x7f60e4160430 2023-11-04T01:40:02.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.037+0000 7f60e2ffd640 1 -- 172.21.15.77:0/3691119195 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d40309a0 con 0x7f60e4160430 2023-11-04T01:40:02.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.037+0000 7f60e2ffd640 1 -- 172.21.15.77:0/3691119195 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d4030d30 con 0x7f60e4160430 2023-11-04T01:40:02.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.037+0000 7f60ea3a9640 1 -- 172.21.15.77:0/3691119195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60e4160430 msgr2=0x7f60e40b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:02.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.037+0000 7f60ea3a9640 1 --2- 172.21.15.77:0/3691119195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60e4160430 0x7f60e40b2620 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f60d4009870 tx=0x7f60d402b980 comp rx=0 tx=0).stop 2023-11-04T01:40:02.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.037+0000 7f60ea3a9640 1 -- 172.21.15.77:0/3691119195 shutdown_connections 2023-11-04T01:40:02.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.037+0000 7f60ea3a9640 1 --2- 172.21.15.77:0/3691119195 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f60e40b2b60 0x7f60e406bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.037+0000 7f60ea3a9640 1 --2- 172.21.15.77:0/3691119195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60e4160430 0x7f60e40b2620 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.037+0000 7f60ea3a9640 1 -- 172.21.15.77:0/3691119195 >> 172.21.15.77:0/3691119195 conn(0x7f60e406ea20 msgr2=0x7f60e406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:02.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.037+0000 7f60ea3a9640 1 -- 172.21.15.77:0/3691119195 shutdown_connections 2023-11-04T01:40:02.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.037+0000 7f60ea3a9640 1 -- 172.21.15.77:0/3691119195 wait complete. 2023-11-04T01:40:02.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.038+0000 7f60ea3a9640 1 Processor -- start 2023-11-04T01:40:02.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.039+0000 7f60ea3a9640 1 -- start start 2023-11-04T01:40:02.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.039+0000 7f60ea3a9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60e406c1d0 0x7f60e41f3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.039+0000 7f60ea3a9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f60e40b2b60 0x7f60e41f0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.039+0000 7f60ea3a9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60e4160430 0x7f60e41f3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.039+0000 7f60ea3a9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e415c320 con 0x7f60e4160430 2023-11-04T01:40:02.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.039+0000 7f60ea3a9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e41f4210 con 0x7f60e406c1d0 2023-11-04T01:40:02.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.039+0000 7f60ea3a9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e41f0560 con 0x7f60e40b2b60 2023-11-04T01:40:02.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.039+0000 7f60e8946640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60e4160430 0x7f60e41f3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:02.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.039+0000 7f60e8946640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60e4160430 0x7f60e41f3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37552/0 (socket says 172.21.15.77:37552) 2023-11-04T01:40:02.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.039+0000 7f60e8946640 1 -- 172.21.15.77:0/1092127565 learned_addr learned my addr 172.21.15.77:0/1092127565 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:02.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.040+0000 7f60e3fff640 1 --2- 172.21.15.77:0/1092127565 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60e406c1d0 0x7f60e41f3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:02.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.040+0000 7f60e37fe640 1 --2- 172.21.15.77:0/1092127565 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f60e40b2b60 0x7f60e41f0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:02.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.040+0000 7f60e8946640 1 -- 172.21.15.77:0/1092127565 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f60e40b2b60 msgr2=0x7f60e41f0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:02.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.040+0000 7f60e8946640 1 --2- 172.21.15.77:0/1092127565 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f60e40b2b60 0x7f60e41f0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.040+0000 7f60e8946640 1 -- 172.21.15.77:0/1092127565 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60e406c1d0 msgr2=0x7f60e41f3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:02.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.040+0000 7f60e8946640 1 --2- 172.21.15.77:0/1092127565 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60e406c1d0 0x7f60e41f3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.040+0000 7f60e8946640 1 -- 172.21.15.77:0/1092127565 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d40094d0 con 0x7f60e4160430 2023-11-04T01:40:02.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.040+0000 7f60e3fff640 1 --2- 172.21.15.77:0/1092127565 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60e406c1d0 0x7f60e41f3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:02.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.040+0000 7f60e37fe640 1 --2- 172.21.15.77:0/1092127565 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f60e40b2b60 0x7f60e41f0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:02.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.040+0000 7f60e8946640 1 --2- 172.21.15.77:0/1092127565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60e4160430 0x7f60e41f3590 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f60dc00c7d0 tx=0x7f60dc00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:02.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.040+0000 7f60e0ff9640 1 -- 172.21.15.77:0/1092127565 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc003b70 con 0x7f60e4160430 2023-11-04T01:40:02.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.040+0000 7f60e0ff9640 1 -- 172.21.15.77:0/1092127565 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60dc003cf0 con 0x7f60e4160430 2023-11-04T01:40:02.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.040+0000 7f60ea3a9640 1 -- 172.21.15.77:0/1092127565 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e41f3ad0 con 0x7f60e4160430 2023-11-04T01:40:02.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.040+0000 7f60e0ff9640 1 -- 172.21.15.77:0/1092127565 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc00aa90 con 0x7f60e4160430 2023-11-04T01:40:02.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.040+0000 7f60ea3a9640 1 -- 172.21.15.77:0/1092127565 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e40b4100 con 0x7f60e4160430 2023-11-04T01:40:02.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.041+0000 7f60ea3a9640 1 -- 172.21.15.77:0/1092127565 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e4074290 con 0x7f60e4160430 2023-11-04T01:40:02.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.041+0000 7f60e0ff9640 1 -- 172.21.15.77:0/1092127565 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f60dc00abf0 con 0x7f60e4160430 2023-11-04T01:40:02.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.042+0000 7f60e0ff9640 1 --2- 172.21.15.77:0/1092127565 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f60d006ae70 0x7f60d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.042+0000 7f60e0ff9640 1 -- 172.21.15.77:0/1092127565 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f60dc0891a0 con 0x7f60e4160430 2023-11-04T01:40:02.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.042+0000 7f60e3fff640 1 --2- 172.21.15.77:0/1092127565 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f60d006ae70 0x7f60d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:02.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.042+0000 7f60e3fff640 1 --2- 172.21.15.77:0/1092127565 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f60d006ae70 0x7f60d006d330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f60d4036000 tx=0x7f60d403b040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:02.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.046+0000 7f60e0ff9640 1 -- 172.21.15.77:0/1092127565 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f60dc054510 con 0x7f60e4160430 2023-11-04T01:40:02.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.211+0000 7f60ea3a9640 1 -- 172.21.15.77:0/1092127565 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f60e40b6b20 con 0x7f60e4160430 2023-11-04T01:40:02.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.212+0000 7f60e0ff9640 1 -- 172.21.15.77:0/1092127565 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f60dc003e60 con 0x7f60e4160430 2023-11-04T01:40:02.214 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:40:02.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.213+0000 7f60ea3a9640 1 -- 172.21.15.77:0/1092127565 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f60d006ae70 msgr2=0x7f60d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:02.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.213+0000 7f60ea3a9640 1 --2- 172.21.15.77:0/1092127565 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f60d006ae70 0x7f60d006d330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f60d4036000 tx=0x7f60d403b040 comp rx=0 tx=0).stop 2023-11-04T01:40:02.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.213+0000 7f60ea3a9640 1 -- 172.21.15.77:0/1092127565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60e4160430 msgr2=0x7f60e41f3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:02.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.213+0000 7f60ea3a9640 1 --2- 172.21.15.77:0/1092127565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60e4160430 0x7f60e41f3590 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f60dc00c7d0 tx=0x7f60dc00cc90 comp rx=0 tx=0).stop 2023-11-04T01:40:02.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.214+0000 7f60ea3a9640 1 -- 172.21.15.77:0/1092127565 shutdown_connections 2023-11-04T01:40:02.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.214+0000 7f60ea3a9640 1 --2- 172.21.15.77:0/1092127565 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f60d006ae70 0x7f60d006d330 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.214+0000 7f60ea3a9640 1 --2- 172.21.15.77:0/1092127565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60e4160430 0x7f60e41f3590 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.214+0000 7f60ea3a9640 1 --2- 172.21.15.77:0/1092127565 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f60e40b2b60 0x7f60e41f0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.214+0000 7f60ea3a9640 1 --2- 172.21.15.77:0/1092127565 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60e406c1d0 0x7f60e41f3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.214+0000 7f60ea3a9640 1 -- 172.21.15.77:0/1092127565 >> 172.21.15.77:0/1092127565 conn(0x7f60e406ea20 msgr2=0x7f60e40cfc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:02.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.214+0000 7f60ea3a9640 1 -- 172.21.15.77:0/1092127565 shutdown_connections 2023-11-04T01:40:02.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.214+0000 7f60ea3a9640 1 -- 172.21.15.77:0/1092127565 wait complete. 2023-11-04T01:40:02.226 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T01:40:02.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.322+0000 7f8063f1d640 1 Processor -- start 2023-11-04T01:40:02.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.322+0000 7f8063f1d640 1 -- start start 2023-11-04T01:40:02.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.323+0000 7f8063f1d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f805c0cda60 0x7f805c0ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.323+0000 7f8063f1d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f805c0b0cd0 0x7f805c070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.323+0000 7f8063f1d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f805c0cc990 con 0x7f805c0cace0 2023-11-04T01:40:02.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.323+0000 7f8063f1d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f805c0ccc70 con 0x7f805c0cda60 2023-11-04T01:40:02.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.323+0000 7f8063f1d640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f805c0c9ce0 con 0x7f805c0b0cd0 2023-11-04T01:40:02.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.323+0000 7f8061cb9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f805c0cda60 0x7f805c0ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:02.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.323+0000 7f80624ba640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f805c0cace0 0x7f805c06c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41248/0 (socket says 172.21.15.77:41248) 2023-11-04T01:40:02.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.323+0000 7f80624ba640 1 -- 172.21.15.77:0/2946888301 learned_addr learned my addr 172.21.15.77:0/2946888301 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:02.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.324+0000 7f80614b8640 1 --2- 172.21.15.77:0/2946888301 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f805c0b0cd0 0x7f805c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:02.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.324+0000 7f8061cb9640 1 -- 172.21.15.77:0/2946888301 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f805c0b0cd0 msgr2=0x7f805c070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:02.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.324+0000 7f8061cb9640 1 --2- 172.21.15.77:0/2946888301 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f805c0b0cd0 0x7f805c070630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.324+0000 7f8060cb7640 1 -- 172.21.15.77:0/2946888301 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1804361973 0 0) 0x7f805c0cc990 con 0x7f805c0cace0 2023-11-04T01:40:02.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.324+0000 7f8061cb9640 1 -- 172.21.15.77:0/2946888301 >> v1:172.21.15.77:6789/0 conn(0x7f805c0cace0 legacy=0x7f805c06c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:02.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.324+0000 7f8061cb9640 1 -- 172.21.15.77:0/2946888301 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f805c0c9fc0 con 0x7f805c0cda60 2023-11-04T01:40:02.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.324+0000 7f80614b8640 1 --2- 172.21.15.77:0/2946888301 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f805c0b0cd0 0x7f805c070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:02.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.324+0000 7f8061cb9640 1 --2- 172.21.15.77:0/2946888301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f805c0cda60 0x7f805c0ca7a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8058009d90 tx=0x7f805802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f23d2cf853b5f3f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:02.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.324+0000 7f8060cb7640 1 -- 172.21.15.77:0/2946888301 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f805802cc50 con 0x7f805c0cda60 2023-11-04T01:40:02.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.324+0000 7f8060cb7640 1 -- 172.21.15.77:0/2946888301 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f805802cdb0 con 0x7f805c0cda60 2023-11-04T01:40:02.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.324+0000 7f8060cb7640 1 -- 172.21.15.77:0/2946888301 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8058034660 con 0x7f805c0cda60 2023-11-04T01:40:02.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.325+0000 7f8063f1d640 1 -- 172.21.15.77:0/2946888301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f805c0cda60 msgr2=0x7f805c0ca7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:02.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.325+0000 7f8063f1d640 1 --2- 172.21.15.77:0/2946888301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f805c0cda60 0x7f805c0ca7a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8058009d90 tx=0x7f805802bea0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.325+0000 7f8063f1d640 1 -- 172.21.15.77:0/2946888301 shutdown_connections 2023-11-04T01:40:02.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.325+0000 7f8063f1d640 1 --2- 172.21.15.77:0/2946888301 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f805c0b0cd0 0x7f805c070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.325+0000 7f8063f1d640 1 --2- 172.21.15.77:0/2946888301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f805c0cda60 0x7f805c0ca7a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.325+0000 7f8063f1d640 1 -- 172.21.15.77:0/2946888301 >> 172.21.15.77:0/2946888301 conn(0x7f805c0ce950 msgr2=0x7f805c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:02.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.325+0000 7f8063f1d640 1 -- 172.21.15.77:0/2946888301 shutdown_connections 2023-11-04T01:40:02.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.325+0000 7f8063f1d640 1 -- 172.21.15.77:0/2946888301 wait complete. 2023-11-04T01:40:02.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.326+0000 7f8063f1d640 1 Processor -- start 2023-11-04T01:40:02.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.326+0000 7f8063f1d640 1 -- start start 2023-11-04T01:40:02.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.327+0000 7f8063f1d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f805c0b0cd0 0x7f805c149da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.327+0000 7f8063f1d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f805c0cace0 0x7f805c1e4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.327+0000 7f8063f1d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f805c0cda60 0x7f805c0ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.327+0000 7f8063f1d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805c1e69c0 con 0x7f805c0b0cd0 2023-11-04T01:40:02.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.327+0000 7f8063f1d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805c14a2e0 con 0x7f805c0cace0 2023-11-04T01:40:02.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.327+0000 7f8063f1d640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f805c1e6e50 con 0x7f805c0cda60 2023-11-04T01:40:02.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.327+0000 7f8061cb9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f805c0b0cd0 0x7f805c149da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:02.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.327+0000 7f8061cb9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f805c0b0cd0 0x7f805c149da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37570/0 (socket says 172.21.15.77:37570) 2023-11-04T01:40:02.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.327+0000 7f8061cb9640 1 -- 172.21.15.77:0/2373047784 learned_addr learned my addr 172.21.15.77:0/2373047784 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:02.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.327+0000 7f80624ba640 1 --2- 172.21.15.77:0/2373047784 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f805c0cda60 0x7f805c0ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:02.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.327+0000 7f80614b8640 1 --2- 172.21.15.77:0/2373047784 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f805c0cace0 0x7f805c1e4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:02.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.327+0000 7f8061cb9640 1 -- 172.21.15.77:0/2373047784 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f805c0cda60 msgr2=0x7f805c0ae4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:02.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.327+0000 7f8061cb9640 1 --2- 172.21.15.77:0/2373047784 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f805c0cda60 0x7f805c0ae4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.327+0000 7f8061cb9640 1 -- 172.21.15.77:0/2373047784 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f805c0cace0 msgr2=0x7f805c1e4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:02.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.327+0000 7f8061cb9640 1 --2- 172.21.15.77:0/2373047784 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f805c0cace0 0x7f805c1e4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.327+0000 7f8061cb9640 1 -- 172.21.15.77:0/2373047784 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8058009a70 con 0x7f805c0b0cd0 2023-11-04T01:40:02.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.327+0000 7f80624ba640 1 --2- 172.21.15.77:0/2373047784 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f805c0cda60 0x7f805c0ae4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:02.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.327+0000 7f80614b8640 1 --2- 172.21.15.77:0/2373047784 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f805c0cace0 0x7f805c1e4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:02.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.328+0000 7f8061cb9640 1 --2- 172.21.15.77:0/2373047784 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f805c0b0cd0 0x7f805c149da0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8058037040 tx=0x7f8058004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:02.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.328+0000 7f80527fc640 1 -- 172.21.15.77:0/2373047784 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8058040650 con 0x7f805c0b0cd0 2023-11-04T01:40:02.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.328+0000 7f80527fc640 1 -- 172.21.15.77:0/2373047784 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80580407b0 con 0x7f805c0b0cd0 2023-11-04T01:40:02.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.328+0000 7f8063f1d640 1 -- 172.21.15.77:0/2373047784 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f805c1e5db0 con 0x7f805c0b0cd0 2023-11-04T01:40:02.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.328+0000 7f80527fc640 1 -- 172.21.15.77:0/2373047784 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8058040ba0 con 0x7f805c0b0cd0 2023-11-04T01:40:02.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.328+0000 7f8063f1d640 1 -- 172.21.15.77:0/2373047784 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f805c1e6370 con 0x7f805c0b0cd0 2023-11-04T01:40:02.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.329+0000 7f8063f1d640 1 -- 172.21.15.77:0/2373047784 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f805c074290 con 0x7f805c0b0cd0 2023-11-04T01:40:02.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.329+0000 7f80527fc640 1 -- 172.21.15.77:0/2373047784 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8058040d00 con 0x7f805c0b0cd0 2023-11-04T01:40:02.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.329+0000 7f80527fc640 1 --2- 172.21.15.77:0/2373047784 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f804006ae70 0x7f804006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.330+0000 7f80527fc640 1 -- 172.21.15.77:0/2373047784 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f80580ac110 con 0x7f805c0b0cd0 2023-11-04T01:40:02.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.330+0000 7f80614b8640 1 --2- 172.21.15.77:0/2373047784 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f804006ae70 0x7f804006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:02.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.330+0000 7f80614b8640 1 --2- 172.21.15.77:0/2373047784 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f804006ae70 0x7f804006d330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f804c006fd0 tx=0x7f804c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:02.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.334+0000 7f80527fc640 1 -- 172.21.15.77:0/2373047784 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8058077510 con 0x7f805c0b0cd0 2023-11-04T01:40:02.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.500+0000 7f8063f1d640 1 -- 172.21.15.77:0/2373047784 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f805c0b48d0 con 0x7f805c0b0cd0 2023-11-04T01:40:02.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.501+0000 7f80527fc640 1 -- 172.21.15.77:0/2373047784 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f805807ab30 con 0x7f805c0b0cd0 2023-11-04T01:40:02.503 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:02.503 INFO:teuthology.orchestra.run.smithi077.stdout:[ 2023-11-04T01:40:02.504 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:40:02.504 INFO:teuthology.orchestra.run.smithi077.stdout: "poolnum": 1, 2023-11-04T01:40:02.504 INFO:teuthology.orchestra.run.smithi077.stdout: "poolname": ".mgr" 2023-11-04T01:40:02.504 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:40:02.505 INFO:teuthology.orchestra.run.smithi077.stdout:] 2023-11-04T01:40:02.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.502+0000 7f8063f1d640 1 -- 172.21.15.77:0/2373047784 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f804006ae70 msgr2=0x7f804006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:02.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.502+0000 7f8063f1d640 1 --2- 172.21.15.77:0/2373047784 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f804006ae70 0x7f804006d330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f804c006fd0 tx=0x7f804c008040 comp rx=0 tx=0).stop 2023-11-04T01:40:02.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.502+0000 7f8063f1d640 1 -- 172.21.15.77:0/2373047784 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f805c0b0cd0 msgr2=0x7f805c149da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:02.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.502+0000 7f8063f1d640 1 --2- 172.21.15.77:0/2373047784 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f805c0b0cd0 0x7f805c149da0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8058037040 tx=0x7f8058004a40 comp rx=0 tx=0).stop 2023-11-04T01:40:02.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.503+0000 7f8063f1d640 1 -- 172.21.15.77:0/2373047784 shutdown_connections 2023-11-04T01:40:02.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.503+0000 7f8063f1d640 1 --2- 172.21.15.77:0/2373047784 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f804006ae70 0x7f804006d330 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.503+0000 7f8063f1d640 1 --2- 172.21.15.77:0/2373047784 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f805c0cda60 0x7f805c0ae4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.503+0000 7f8063f1d640 1 --2- 172.21.15.77:0/2373047784 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f805c0cace0 0x7f805c1e4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.503+0000 7f8063f1d640 1 --2- 172.21.15.77:0/2373047784 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f805c0b0cd0 0x7f805c149da0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.503+0000 7f8063f1d640 1 -- 172.21.15.77:0/2373047784 >> 172.21.15.77:0/2373047784 conn(0x7f805c0ce950 msgr2=0x7f805c06d320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:02.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.503+0000 7f8063f1d640 1 -- 172.21.15.77:0/2373047784 shutdown_connections 2023-11-04T01:40:02.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.503+0000 7f8063f1d640 1 -- 172.21.15.77:0/2373047784 wait complete. 2023-11-04T01:40:02.515 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T01:40:02.515 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T01:40:02.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.616+0000 7f9f954bb640 1 Processor -- start 2023-11-04T01:40:02.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.616+0000 7f9f954bb640 1 -- start start 2023-11-04T01:40:02.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.617+0000 7f9f954bb640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9f900cd9f0 0x7f9f900cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.617+0000 7f9f954bb640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9f9015d4b0 0x7f9f9015d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.617+0000 7f9f954bb640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f900b47e0 0x7f9f900b4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.617+0000 7f9f954bb640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f9015e4d0 con 0x7f9f900cd9f0 2023-11-04T01:40:02.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.617+0000 7f9f954bb640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f900d1320 con 0x7f9f9015d4b0 2023-11-04T01:40:02.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.617+0000 7f9f954bb640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f900ce310 con 0x7f9f900b47e0 2023-11-04T01:40:02.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.617+0000 7f9f8effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9f900cd9f0 0x7f9f900cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:02.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.617+0000 7f9f8effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9f900cd9f0 0x7f9f900cddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37582/0 (socket says 172.21.15.77:37582) 2023-11-04T01:40:02.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.617+0000 7f9f8effd640 1 -- 172.21.15.77:0/2103311186 learned_addr learned my addr 172.21.15.77:0/2103311186 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:02.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.617+0000 7f9f8effd640 1 -- 172.21.15.77:0/2103311186 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f900b47e0 msgr2=0x7f9f900b4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:02.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.617+0000 7f9f8effd640 1 --2- 172.21.15.77:0/2103311186 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f900b47e0 0x7f9f900b4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.617+0000 7f9f8effd640 1 -- 172.21.15.77:0/2103311186 >> v2:172.21.15.122:3300/0 conn(0x7f9f9015d4b0 msgr2=0x7f9f9015d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:02.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.617+0000 7f9f8effd640 1 --2- 172.21.15.77:0/2103311186 >> v2:172.21.15.122:3300/0 conn(0x7f9f9015d4b0 0x7f9f9015d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.617+0000 7f9f8effd640 1 -- 172.21.15.77:0/2103311186 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9015df10 con 0x7f9f900cd9f0 2023-11-04T01:40:02.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.618+0000 7f9f8effd640 1 --2- 172.21.15.77:0/2103311186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f900cd9f0 0x7f9f900cddd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9f900cf320 tx=0x7f9f8002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9024e16d8a06918d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:02.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.618+0000 7f9f8dffb640 1 -- 172.21.15.77:0/2103311186 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f80030860 con 0x7f9f900cd9f0 2023-11-04T01:40:02.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.618+0000 7f9f8dffb640 1 -- 172.21.15.77:0/2103311186 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f800309c0 con 0x7f9f900cd9f0 2023-11-04T01:40:02.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.618+0000 7f9f8dffb640 1 -- 172.21.15.77:0/2103311186 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f80030d50 con 0x7f9f900cd9f0 2023-11-04T01:40:02.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.618+0000 7f9f954bb640 1 -- 172.21.15.77:0/2103311186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f900cd9f0 msgr2=0x7f9f900cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:02.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.618+0000 7f9f954bb640 1 --2- 172.21.15.77:0/2103311186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f900cd9f0 0x7f9f900cddd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9f900cf320 tx=0x7f9f8002b9a0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.618+0000 7f9f954bb640 1 -- 172.21.15.77:0/2103311186 shutdown_connections 2023-11-04T01:40:02.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.618+0000 7f9f954bb640 1 --2- 172.21.15.77:0/2103311186 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f900b47e0 0x7f9f900b4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.618+0000 7f9f954bb640 1 --2- 172.21.15.77:0/2103311186 >> v2:172.21.15.122:3300/0 conn(0x7f9f9015d4b0 0x7f9f9015d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.618+0000 7f9f954bb640 1 --2- 172.21.15.77:0/2103311186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f900cd9f0 0x7f9f900cddd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.618+0000 7f9f954bb640 1 -- 172.21.15.77:0/2103311186 >> 172.21.15.77:0/2103311186 conn(0x7f9f90071c40 msgr2=0x7f9f90072050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:02.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.618+0000 7f9f954bb640 1 -- 172.21.15.77:0/2103311186 shutdown_connections 2023-11-04T01:40:02.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.618+0000 7f9f954bb640 1 -- 172.21.15.77:0/2103311186 wait complete. 2023-11-04T01:40:02.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.620+0000 7f9f954bb640 1 Processor -- start 2023-11-04T01:40:02.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.620+0000 7f9f954bb640 1 -- start start 2023-11-04T01:40:02.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.620+0000 7f9f954bb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f900b47e0 0x7f9f9014e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.620+0000 7f9f954bb640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f900cd9f0 0x7f9f900cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.620+0000 7f9f954bb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f9015d4b0 0x7f9f900cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.620+0000 7f9f954bb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f900cc310 con 0x7f9f900b47e0 2023-11-04T01:40:02.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.620+0000 7f9f954bb640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9014e6f0 con 0x7f9f9015d4b0 2023-11-04T01:40:02.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.620+0000 7f9f954bb640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f900c69e0 con 0x7f9f900cd9f0 2023-11-04T01:40:02.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.621+0000 7f9f8effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f900b47e0 0x7f9f9014e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:02.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.621+0000 7f9f8effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f900b47e0 0x7f9f9014e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37588/0 (socket says 172.21.15.77:37588) 2023-11-04T01:40:02.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.621+0000 7f9f8effd640 1 -- 172.21.15.77:0/2329397430 learned_addr learned my addr 172.21.15.77:0/2329397430 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:02.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.621+0000 7f9f8effd640 1 -- 172.21.15.77:0/2329397430 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f900cd9f0 msgr2=0x7f9f900cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:02.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.621+0000 7f9f8effd640 1 --2- 172.21.15.77:0/2329397430 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f900cd9f0 0x7f9f900cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.621+0000 7f9f8effd640 1 -- 172.21.15.77:0/2329397430 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f9015d4b0 msgr2=0x7f9f900cbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:02.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.621+0000 7f9f8effd640 1 --2- 172.21.15.77:0/2329397430 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f9015d4b0 0x7f9f900cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:02.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.621+0000 7f9f8effd640 1 -- 172.21.15.77:0/2329397430 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f800094d0 con 0x7f9f900b47e0 2023-11-04T01:40:02.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.621+0000 7f9f8effd640 1 --2- 172.21.15.77:0/2329397430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f900b47e0 0x7f9f9014e1b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9f80000c00 tx=0x7f9f80004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:02.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.621+0000 7f9f777fe640 1 -- 172.21.15.77:0/2329397430 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f80039b40 con 0x7f9f900b47e0 2023-11-04T01:40:02.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.621+0000 7f9f777fe640 1 -- 172.21.15.77:0/2329397430 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f80039ca0 con 0x7f9f900b47e0 2023-11-04T01:40:02.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.621+0000 7f9f954bb640 1 -- 172.21.15.77:0/2329397430 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f90160020 con 0x7f9f900b47e0 2023-11-04T01:40:02.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.621+0000 7f9f777fe640 1 -- 172.21.15.77:0/2329397430 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f80043630 con 0x7f9f900b47e0 2023-11-04T01:40:02.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.621+0000 7f9f954bb640 1 -- 172.21.15.77:0/2329397430 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f900c6f60 con 0x7f9f900b47e0 2023-11-04T01:40:02.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.622+0000 7f9f954bb640 1 -- 172.21.15.77:0/2329397430 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f900c7150 con 0x7f9f900b47e0 2023-11-04T01:40:02.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.623+0000 7f9f777fe640 1 -- 172.21.15.77:0/2329397430 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9f8002f3b0 con 0x7f9f900b47e0 2023-11-04T01:40:02.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.623+0000 7f9f777fe640 1 --2- 172.21.15.77:0/2329397430 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9f7c06ae70 0x7f9f7c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:02.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.623+0000 7f9f777fe640 1 -- 172.21.15.77:0/2329397430 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9f800ab730 con 0x7f9f900b47e0 2023-11-04T01:40:02.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.623+0000 7f9f8e7fc640 1 --2- 172.21.15.77:0/2329397430 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9f7c06ae70 0x7f9f7c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:02.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.623+0000 7f9f8e7fc640 1 --2- 172.21.15.77:0/2329397430 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9f7c06ae70 0x7f9f7c06d330 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9f900c9820 tx=0x7f9f84006bf0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:02.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.627+0000 7f9f777fe640 1 -- 172.21.15.77:0/2329397430 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9f80076ab0 con 0x7f9f900b47e0 2023-11-04T01:40:02.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:02.793+0000 7f9f954bb640 1 -- 172.21.15.77:0/2329397430 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9f9004e490 con 0x7f9f900b47e0 2023-11-04T01:40:03.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.682+0000 7f9f777fe640 1 -- 172.21.15.77:0/2329397430 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9f8007a0d0 con 0x7f9f900b47e0 2023-11-04T01:40:03.684 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_metadata' created 2023-11-04T01:40:03.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.684+0000 7f9f954bb640 1 -- 172.21.15.77:0/2329397430 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9f7c06ae70 msgr2=0x7f9f7c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.684+0000 7f9f954bb640 1 --2- 172.21.15.77:0/2329397430 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9f7c06ae70 0x7f9f7c06d330 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9f900c9820 tx=0x7f9f84006bf0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.684+0000 7f9f954bb640 1 -- 172.21.15.77:0/2329397430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f900b47e0 msgr2=0x7f9f9014e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.684+0000 7f9f954bb640 1 --2- 172.21.15.77:0/2329397430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f900b47e0 0x7f9f9014e1b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9f80000c00 tx=0x7f9f80004730 comp rx=0 tx=0).stop 2023-11-04T01:40:03.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.684+0000 7f9f954bb640 1 -- 172.21.15.77:0/2329397430 shutdown_connections 2023-11-04T01:40:03.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.684+0000 7f9f954bb640 1 --2- 172.21.15.77:0/2329397430 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9f7c06ae70 0x7f9f7c06d330 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.684+0000 7f9f954bb640 1 --2- 172.21.15.77:0/2329397430 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f9015d4b0 0x7f9f900cbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.684+0000 7f9f954bb640 1 --2- 172.21.15.77:0/2329397430 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f900cd9f0 0x7f9f900cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.684+0000 7f9f954bb640 1 --2- 172.21.15.77:0/2329397430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f900b47e0 0x7f9f9014e1b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.684+0000 7f9f954bb640 1 -- 172.21.15.77:0/2329397430 >> 172.21.15.77:0/2329397430 conn(0x7f9f90071c40 msgr2=0x7f9f9015c440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:03.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.684+0000 7f9f954bb640 1 -- 172.21.15.77:0/2329397430 shutdown_connections 2023-11-04T01:40:03.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.684+0000 7f9f954bb640 1 -- 172.21.15.77:0/2329397430 wait complete. 2023-11-04T01:40:03.701 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-11-04T01:40:03.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.806+0000 7f63c3dcc640 1 Processor -- start 2023-11-04T01:40:03.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.807+0000 7f63c3dcc640 1 -- start start 2023-11-04T01:40:03.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.807+0000 7f63c3dcc640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f63bc15cfd0 0x7f63bc06c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.807+0000 7f63c3dcc640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63bc0cea20 con 0x7f63bc0cf180 2023-11-04T01:40:03.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.807+0000 7f63c3dcc640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63bc0cf610 con 0x7f63bc0cd570 2023-11-04T01:40:03.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.807+0000 7f63c3dcc640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63bc15d3b0 con 0x7f63bc15cfd0 2023-11-04T01:40:03.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.807+0000 7f63c1367640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f63bc0cf180 0x7f63bc161440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41264/0 (socket says 172.21.15.77:41264) 2023-11-04T01:40:03.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.807+0000 7f63c1367640 1 -- 172.21.15.77:0/2786450900 learned_addr learned my addr 172.21.15.77:0/2786450900 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:03.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.808+0000 7f63c0b66640 1 -- 172.21.15.77:0/2786450900 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 191513947 0 0) 0x7f63bc0cea20 con 0x7f63bc0cf180 2023-11-04T01:40:03.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.808+0000 7f63c0b66640 1 -- 172.21.15.77:0/2786450900 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63a8003520 con 0x7f63bc0cf180 2023-11-04T01:40:03.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.808+0000 7f63c1b68640 1 --2- 172.21.15.77:0/2786450900 >> v2:172.21.15.122:3300/0 conn(0x7f63bc15cfd0 0x7f63bc06c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.808+0000 7f63c0b66640 1 -- 172.21.15.77:0/2786450900 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4227379257 0 0) 0x7f63a8003520 con 0x7f63bc0cf180 2023-11-04T01:40:03.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.808+0000 7f63c0b66640 1 -- 172.21.15.77:0/2786450900 >> v2:172.21.15.122:3300/0 conn(0x7f63bc15cfd0 msgr2=0x7f63bc06c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:03.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.808+0000 7f63c0b66640 1 --2- 172.21.15.77:0/2786450900 >> v2:172.21.15.122:3300/0 conn(0x7f63bc15cfd0 0x7f63bc06c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.808+0000 7f63c0b66640 1 -- 172.21.15.77:0/2786450900 >> v1:172.21.15.122:6789/0 conn(0x7f63bc0cd570 legacy=0x7f63bc0cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.808+0000 7f63c0b66640 1 -- 172.21.15.77:0/2786450900 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63bc0cf8f0 con 0x7f63bc0cf180 2023-11-04T01:40:03.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.808+0000 7f63c0b66640 1 -- 172.21.15.77:0/2786450900 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f63ac001670 con 0x7f63bc0cf180 2023-11-04T01:40:03.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.808+0000 7f63c0b66640 1 -- 172.21.15.77:0/2786450900 >> v1:172.21.15.77:6789/0 conn(0x7f63bc0cf180 legacy=0x7f63bc161440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.808+0000 7f63c0b66640 1 --2- 172.21.15.77:0/2786450900 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63a8003970 0x7f63a8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.808+0000 7f63c0b66640 1 --2- 172.21.15.77:0/2786450900 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f63a80047c0 0x7f63a8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.808+0000 7f63c0b66640 1 --2- 172.21.15.77:0/2786450900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63a8005180 0x7f63a800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.808+0000 7f63c0b66640 1 -- 172.21.15.77:0/2786450900 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63bc15d3b0 con 0x7f63a8003970 2023-11-04T01:40:03.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.808+0000 7f63c0b66640 1 -- 172.21.15.77:0/2786450900 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a800c120 con 0x7f63a8005180 2023-11-04T01:40:03.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.808+0000 7f63c0b66640 1 -- 172.21.15.77:0/2786450900 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a800c2e0 con 0x7f63a80047c0 2023-11-04T01:40:03.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.808+0000 7f63c1b68640 1 --2- 172.21.15.77:0/2786450900 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63a8003970 0x7f63a8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.808+0000 7f63c1367640 1 --2- 172.21.15.77:0/2786450900 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f63a80047c0 0x7f63a8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.808+0000 7f63c2369640 1 --2- 172.21.15.77:0/2786450900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63a8005180 0x7f63a800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.808+0000 7f63c1b68640 1 -- 172.21.15.77:0/2786450900 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f63a80047c0 msgr2=0x7f63a8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:03.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.808+0000 7f63c1b68640 1 --2- 172.21.15.77:0/2786450900 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f63a80047c0 0x7f63a8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.808+0000 7f63c1b68640 1 -- 172.21.15.77:0/2786450900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63a8005180 msgr2=0x7f63a800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:03.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.808+0000 7f63c1b68640 1 --2- 172.21.15.77:0/2786450900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63a8005180 0x7f63a800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.808+0000 7f63c1b68640 1 -- 172.21.15.77:0/2786450900 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a8003520 con 0x7f63a8003970 2023-11-04T01:40:03.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.808+0000 7f63c2369640 1 --2- 172.21.15.77:0/2786450900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63a8005180 0x7f63a800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:03.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.808+0000 7f63c1367640 1 --2- 172.21.15.77:0/2786450900 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f63a80047c0 0x7f63a8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:03.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.808+0000 7f63c2369640 1 -- 172.21.15.77:0/2786450900 reap_dead start 2023-11-04T01:40:03.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.809+0000 7f63c1b68640 1 --2- 172.21.15.77:0/2786450900 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63a8003970 0x7f63a8003d90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f63b8009fc0 tx=0x7f63a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45220503e4678b05 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:03.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.809+0000 7f63c0b66640 1 -- 172.21.15.77:0/2786450900 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b802cc20 con 0x7f63a8003970 2023-11-04T01:40:03.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.809+0000 7f63c0b66640 1 -- 172.21.15.77:0/2786450900 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b800f040 con 0x7f63a8003970 2023-11-04T01:40:03.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.809+0000 7f63c0b66640 1 -- 172.21.15.77:0/2786450900 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b8034440 con 0x7f63a8003970 2023-11-04T01:40:03.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.810+0000 7f63c3dcc640 1 -- 172.21.15.77:0/2786450900 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63a8003970 msgr2=0x7f63a8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.810+0000 7f63c3dcc640 1 --2- 172.21.15.77:0/2786450900 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63a8003970 0x7f63a8003d90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f63b8009fc0 tx=0x7f63a80057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.810+0000 7f63c3dcc640 1 -- 172.21.15.77:0/2786450900 shutdown_connections 2023-11-04T01:40:03.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.810+0000 7f63c3dcc640 1 --2- 172.21.15.77:0/2786450900 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63a8003970 0x7f63a8003d90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.810+0000 7f63c3dcc640 1 -- 172.21.15.77:0/2786450900 >> 172.21.15.77:0/2786450900 conn(0x7f63bc06ea20 msgr2=0x7f63bc06ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:03.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.810+0000 7f63c3dcc640 1 -- 172.21.15.77:0/2786450900 shutdown_connections 2023-11-04T01:40:03.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.810+0000 7f63c3dcc640 1 -- 172.21.15.77:0/2786450900 wait complete. 2023-11-04T01:40:03.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.811+0000 7f63c3dcc640 1 Processor -- start 2023-11-04T01:40:03.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.811+0000 7f63c3dcc640 1 -- start start 2023-11-04T01:40:03.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.812+0000 7f63c3dcc640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f63a8003970 0x7f63bc0b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.812+0000 7f63c3dcc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63bc0ca780 0x7f63bc15a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.812+0000 7f63c3dcc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63bc160b50 0x7f63bc160fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.812+0000 7f63c3dcc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63bc0b54d0 con 0x7f63bc0ca780 2023-11-04T01:40:03.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.812+0000 7f63c3dcc640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63bc161510 con 0x7f63bc160b50 2023-11-04T01:40:03.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.812+0000 7f63c3dcc640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63bc0b4950 con 0x7f63a8003970 2023-11-04T01:40:03.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.812+0000 7f63c1367640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63bc0ca780 0x7f63bc15a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.812+0000 7f63c1367640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63bc0ca780 0x7f63bc15a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37592/0 (socket says 172.21.15.77:37592) 2023-11-04T01:40:03.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.812+0000 7f63c1367640 1 -- 172.21.15.77:0/1966052853 learned_addr learned my addr 172.21.15.77:0/1966052853 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:03.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.812+0000 7f63c1367640 1 -- 172.21.15.77:0/1966052853 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f63a8003970 msgr2=0x7f63bc0b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.812+0000 7f63c1367640 1 --2- 172.21.15.77:0/1966052853 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f63a8003970 0x7f63bc0b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.812+0000 7f63c1367640 1 -- 172.21.15.77:0/1966052853 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63bc160b50 msgr2=0x7f63bc160fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:03.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.812+0000 7f63c1367640 1 --2- 172.21.15.77:0/1966052853 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63bc160b50 0x7f63bc160fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:03.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.812+0000 7f63c1367640 1 -- 172.21.15.77:0/1966052853 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63bc0b4c30 con 0x7f63bc0ca780 2023-11-04T01:40:03.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.812+0000 7f63c1367640 1 --2- 172.21.15.77:0/1966052853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63bc0ca780 0x7f63bc15a040 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f63ac00e780 tx=0x7f63ac00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:03.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.812+0000 7f63b27fc640 1 -- 172.21.15.77:0/1966052853 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac00c660 con 0x7f63bc0ca780 2023-11-04T01:40:03.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.812+0000 7f63b27fc640 1 -- 172.21.15.77:0/1966052853 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63ac00c7c0 con 0x7f63bc0ca780 2023-11-04T01:40:03.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.812+0000 7f63c3dcc640 1 -- 172.21.15.77:0/1966052853 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63bc0b4f10 con 0x7f63bc0ca780 2023-11-04T01:40:03.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.812+0000 7f63b27fc640 1 -- 172.21.15.77:0/1966052853 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac00cb30 con 0x7f63bc0ca780 2023-11-04T01:40:03.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.812+0000 7f63c3dcc640 1 -- 172.21.15.77:0/1966052853 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63bc0c4810 con 0x7f63bc0ca780 2023-11-04T01:40:03.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.813+0000 7f63c3dcc640 1 -- 172.21.15.77:0/1966052853 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63bc06d3c0 con 0x7f63bc0ca780 2023-11-04T01:40:03.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.814+0000 7f63b27fc640 1 -- 172.21.15.77:0/1966052853 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f63ac00cc90 con 0x7f63bc0ca780 2023-11-04T01:40:03.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.814+0000 7f63b27fc640 1 --2- 172.21.15.77:0/1966052853 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f63a006ae70 0x7f63a006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:03.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.814+0000 7f63b27fc640 1 -- 172.21.15.77:0/1966052853 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f63ac089330 con 0x7f63bc0ca780 2023-11-04T01:40:03.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.814+0000 7f63c1b68640 1 --2- 172.21.15.77:0/1966052853 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f63a006ae70 0x7f63a006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:03.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.815+0000 7f63c1b68640 1 --2- 172.21.15.77:0/1966052853 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f63a006ae70 0x7f63a006d330 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f63b8036000 tx=0x7f63b802e070 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:03.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.818+0000 7f63b27fc640 1 -- 172.21.15.77:0/1966052853 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f63ac0545c0 con 0x7f63bc0ca780 2023-11-04T01:40:03.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:03.986+0000 7f63c3dcc640 1 -- 172.21.15.77:0/1966052853 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f63bc06b300 con 0x7f63bc0ca780 2023-11-04T01:40:04.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.684+0000 7f63b27fc640 1 -- 172.21.15.77:0/1966052853 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7f63ac087e60 con 0x7f63bc0ca780 2023-11-04T01:40:04.686 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data' created 2023-11-04T01:40:04.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.687+0000 7f63c3dcc640 1 -- 172.21.15.77:0/1966052853 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f63a006ae70 msgr2=0x7f63a006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:04.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.687+0000 7f63c3dcc640 1 --2- 172.21.15.77:0/1966052853 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f63a006ae70 0x7f63a006d330 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f63b8036000 tx=0x7f63b802e070 comp rx=0 tx=0).stop 2023-11-04T01:40:04.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.687+0000 7f63c3dcc640 1 -- 172.21.15.77:0/1966052853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63bc0ca780 msgr2=0x7f63bc15a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:04.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.687+0000 7f63c3dcc640 1 --2- 172.21.15.77:0/1966052853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63bc0ca780 0x7f63bc15a040 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f63ac00e780 tx=0x7f63ac00eb80 comp rx=0 tx=0).stop 2023-11-04T01:40:04.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.687+0000 7f63c3dcc640 1 -- 172.21.15.77:0/1966052853 shutdown_connections 2023-11-04T01:40:04.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.687+0000 7f63c3dcc640 1 --2- 172.21.15.77:0/1966052853 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f63a006ae70 0x7f63a006d330 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:04.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.687+0000 7f63c3dcc640 1 --2- 172.21.15.77:0/1966052853 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63bc160b50 0x7f63bc160fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:04.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.687+0000 7f63c3dcc640 1 --2- 172.21.15.77:0/1966052853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63bc0ca780 0x7f63bc15a040 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:04.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.687+0000 7f63c3dcc640 1 --2- 172.21.15.77:0/1966052853 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f63a8003970 0x7f63bc0b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:04.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.687+0000 7f63c3dcc640 1 -- 172.21.15.77:0/1966052853 >> 172.21.15.77:0/1966052853 conn(0x7f63bc06ea20 msgr2=0x7f63bc15ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:04.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.687+0000 7f63c3dcc640 1 -- 172.21.15.77:0/1966052853 shutdown_connections 2023-11-04T01:40:04.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.687+0000 7f63c3dcc640 1 -- 172.21.15.77:0/1966052853 wait complete. 2023-11-04T01:40:04.713 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T01:40:04.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.815+0000 7f53e692c640 1 Processor -- start 2023-11-04T01:40:04.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.815+0000 7f53e692c640 1 -- start start 2023-11-04T01:40:04.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.816+0000 7f53e692c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f53e00b64c0 0x7f53e00b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:04.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.816+0000 7f53e692c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e00d01f0 con 0x7f53e015af20 2023-11-04T01:40:04.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.816+0000 7f53e692c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e00b6a40 con 0x7f53e00cd3b0 2023-11-04T01:40:04.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.816+0000 7f53e692c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53e00cc380 con 0x7f53e00b64c0 2023-11-04T01:40:04.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.816+0000 7f53df7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f53e00b64c0 0x7f53e00b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:04.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.816+0000 7f53dffff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f53e015af20 0x7f53e00cbc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41266/0 (socket says 172.21.15.77:41266) 2023-11-04T01:40:04.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.816+0000 7f53df7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f53e00b64c0 0x7f53e00b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37600/0 (socket says 172.21.15.77:37600) 2023-11-04T01:40:04.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.816+0000 7f53dffff640 1 -- 172.21.15.77:0/2970150592 learned_addr learned my addr 172.21.15.77:0/2970150592 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:04.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.817+0000 7f53df7fe640 1 -- 172.21.15.77:0/2970150592 >> v1:172.21.15.122:6789/0 conn(0x7f53e00cd3b0 legacy=0x7f53e00cec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:04.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.817+0000 7f53df7fe640 1 -- 172.21.15.77:0/2970150592 >> v1:172.21.15.77:6789/0 conn(0x7f53e015af20 legacy=0x7f53e00cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:04.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.817+0000 7f53df7fe640 1 -- 172.21.15.77:0/2970150592 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e00d04b0 con 0x7f53e00b64c0 2023-11-04T01:40:04.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.817+0000 7f53deffd640 1 -- 172.21.15.77:0/2970150592 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1158439718 0 0) 0x7f53e00d01f0 con 0x7f53e015af20 2023-11-04T01:40:04.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.817+0000 7f53df7fe640 1 --2- 172.21.15.77:0/2970150592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53e00b64c0 0x7f53e00b3cd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f53d40097a0 tx=0x7f53d402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ee43221b3a0525b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:04.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.817+0000 7f53deffd640 1 -- 172.21.15.77:0/2970150592 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d4031830 con 0x7f53e00b64c0 2023-11-04T01:40:04.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.818+0000 7f53deffd640 1 -- 172.21.15.77:0/2970150592 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d4031990 con 0x7f53e00b64c0 2023-11-04T01:40:04.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.818+0000 7f53deffd640 1 -- 172.21.15.77:0/2970150592 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d4031d20 con 0x7f53e00b64c0 2023-11-04T01:40:04.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.818+0000 7f53e692c640 1 -- 172.21.15.77:0/2970150592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53e00b64c0 msgr2=0x7f53e00b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:04.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.818+0000 7f53e692c640 1 --2- 172.21.15.77:0/2970150592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53e00b64c0 0x7f53e00b3cd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f53d40097a0 tx=0x7f53d402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:04.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.818+0000 7f53e692c640 1 -- 172.21.15.77:0/2970150592 shutdown_connections 2023-11-04T01:40:04.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.818+0000 7f53e692c640 1 --2- 172.21.15.77:0/2970150592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53e00b64c0 0x7f53e00b3cd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:04.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.818+0000 7f53e692c640 1 -- 172.21.15.77:0/2970150592 >> 172.21.15.77:0/2970150592 conn(0x7f53e006ea20 msgr2=0x7f53e006ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:04.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.818+0000 7f53e692c640 1 -- 172.21.15.77:0/2970150592 shutdown_connections 2023-11-04T01:40:04.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.818+0000 7f53e692c640 1 -- 172.21.15.77:0/2970150592 wait complete. 2023-11-04T01:40:04.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.819+0000 7f53e692c640 1 Processor -- start 2023-11-04T01:40:04.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.819+0000 7f53e692c640 1 -- start start 2023-11-04T01:40:04.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.820+0000 7f53e692c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53e00b64c0 0x7f53e01f2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:04.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.820+0000 7f53e692c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53e00cd3b0 0x7f53e00c5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:04.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.820+0000 7f53e692c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53e015af20 0x7f53e0156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:04.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.820+0000 7f53e692c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e01f3a50 con 0x7f53e00cd3b0 2023-11-04T01:40:04.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.820+0000 7f53e692c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e01f3490 con 0x7f53e00b64c0 2023-11-04T01:40:04.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.820+0000 7f53e692c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e01f3770 con 0x7f53e015af20 2023-11-04T01:40:04.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.820+0000 7f53df7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53e00cd3b0 0x7f53e00c5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:04.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.820+0000 7f53df7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53e00cd3b0 0x7f53e00c5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37608/0 (socket says 172.21.15.77:37608) 2023-11-04T01:40:04.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.820+0000 7f53df7fe640 1 -- 172.21.15.77:0/1651656975 learned_addr learned my addr 172.21.15.77:0/1651656975 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:04.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.820+0000 7f53df7fe640 1 -- 172.21.15.77:0/1651656975 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53e015af20 msgr2=0x7f53e0156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:04.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.820+0000 7f53df7fe640 1 --2- 172.21.15.77:0/1651656975 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53e015af20 0x7f53e0156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:04.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.820+0000 7f53df7fe640 1 -- 172.21.15.77:0/1651656975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53e00b64c0 msgr2=0x7f53e01f2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:04.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.820+0000 7f53df7fe640 1 --2- 172.21.15.77:0/1651656975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53e00b64c0 0x7f53e01f2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:04.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.820+0000 7f53df7fe640 1 -- 172.21.15.77:0/1651656975 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d4009400 con 0x7f53e00cd3b0 2023-11-04T01:40:04.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.821+0000 7f53df7fe640 1 --2- 172.21.15.77:0/1651656975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53e00cd3b0 0x7f53e00c5000 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f53d40098c0 tx=0x7f53d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:04.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.821+0000 7f53dcff9640 1 -- 172.21.15.77:0/1651656975 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d403ba70 con 0x7f53e00cd3b0 2023-11-04T01:40:04.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.821+0000 7f53dcff9640 1 -- 172.21.15.77:0/1651656975 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d403bbf0 con 0x7f53e00cd3b0 2023-11-04T01:40:04.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.821+0000 7f53e692c640 1 -- 172.21.15.77:0/1651656975 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e00c4800 con 0x7f53e00cd3b0 2023-11-04T01:40:04.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.821+0000 7f53dcff9640 1 -- 172.21.15.77:0/1651656975 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d40453f0 con 0x7f53e00cd3b0 2023-11-04T01:40:04.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.821+0000 7f53e692c640 1 -- 172.21.15.77:0/1651656975 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e01f3080 con 0x7f53e00cd3b0 2023-11-04T01:40:04.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.822+0000 7f53e692c640 1 -- 172.21.15.77:0/1651656975 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53e00c4d20 con 0x7f53e00cd3b0 2023-11-04T01:40:04.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.822+0000 7f53dcff9640 1 -- 172.21.15.77:0/1651656975 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f53d404e450 con 0x7f53e00cd3b0 2023-11-04T01:40:04.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.823+0000 7f53dcff9640 1 --2- 172.21.15.77:0/1651656975 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f53cc06ae70 0x7f53cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:04.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.823+0000 7f53dcff9640 1 -- 172.21.15.77:0/1651656975 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f53d40ab7a0 con 0x7f53e00cd3b0 2023-11-04T01:40:04.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.823+0000 7f53dffff640 1 --2- 172.21.15.77:0/1651656975 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f53cc06ae70 0x7f53cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:04.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.823+0000 7f53dffff640 1 --2- 172.21.15.77:0/1651656975 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f53cc06ae70 0x7f53cc06d330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f53d0007fd0 tx=0x7f53d0007960 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:04.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:04.827+0000 7f53dcff9640 1 -- 172.21.15.77:0/1651656975 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f53e00c4d20 con 0x7f53e00cd3b0 2023-11-04T01:40:05.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.030+0000 7f53e692c640 1 -- 172.21.15.77:0/1651656975 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f53e00c4d20 con 0x7f53e00cd3b0 2023-11-04T01:40:05.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.692+0000 7f53dcff9640 1 -- 172.21.15.77:0/1651656975 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f53e00c4d20 con 0x7f53e00cd3b0 2023-11-04T01:40:05.695 INFO:teuthology.orchestra.run.smithi077.stderr:new fs with metadata pool 2 and data pool 3 2023-11-04T01:40:05.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.694+0000 7f53e692c640 1 -- 172.21.15.77:0/1651656975 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f53cc06ae70 msgr2=0x7f53cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:05.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.694+0000 7f53e692c640 1 --2- 172.21.15.77:0/1651656975 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f53cc06ae70 0x7f53cc06d330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f53d0007fd0 tx=0x7f53d0007960 comp rx=0 tx=0).stop 2023-11-04T01:40:05.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.694+0000 7f53e692c640 1 -- 172.21.15.77:0/1651656975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53e00cd3b0 msgr2=0x7f53e00c5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:05.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.694+0000 7f53e692c640 1 --2- 172.21.15.77:0/1651656975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53e00cd3b0 0x7f53e00c5000 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f53d40098c0 tx=0x7f53d40046c0 comp rx=0 tx=0).stop 2023-11-04T01:40:05.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.694+0000 7f53e692c640 1 -- 172.21.15.77:0/1651656975 shutdown_connections 2023-11-04T01:40:05.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.694+0000 7f53e692c640 1 --2- 172.21.15.77:0/1651656975 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f53cc06ae70 0x7f53cc06d330 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:05.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.694+0000 7f53e692c640 1 --2- 172.21.15.77:0/1651656975 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53e015af20 0x7f53e0156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:05.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.694+0000 7f53e692c640 1 --2- 172.21.15.77:0/1651656975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53e00cd3b0 0x7f53e00c5000 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:05.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.694+0000 7f53e692c640 1 --2- 172.21.15.77:0/1651656975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53e00b64c0 0x7f53e01f2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:05.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.694+0000 7f53e692c640 1 -- 172.21.15.77:0/1651656975 >> 172.21.15.77:0/1651656975 conn(0x7f53e006ea20 msgr2=0x7f53e00c9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:05.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.694+0000 7f53e692c640 1 -- 172.21.15.77:0/1651656975 shutdown_connections 2023-11-04T01:40:05.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.694+0000 7f53e692c640 1 -- 172.21.15.77:0/1651656975 wait complete. 2023-11-04T01:40:05.712 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-11-04T01:40:05.713 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-11-04T01:40:05.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.818+0000 7faf9b34c640 1 Processor -- start 2023-11-04T01:40:05.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.818+0000 7faf9b34c640 1 -- start start 2023-11-04T01:40:05.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.819+0000 7faf9b34c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7faf940cd9f0 0x7faf940cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:05.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.819+0000 7faf9b34c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7faf9415d4b0 0x7faf9415d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:05.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.819+0000 7faf9b34c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faf940b47e0 0x7faf940b4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:05.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.819+0000 7faf9b34c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf9415e4d0 con 0x7faf9415d4b0 2023-11-04T01:40:05.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.819+0000 7faf9b34c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf940d1320 con 0x7faf940cd9f0 2023-11-04T01:40:05.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.819+0000 7faf9b34c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf940ce310 con 0x7faf940b47e0 2023-11-04T01:40:05.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.819+0000 7faf988e7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7faf9415d4b0 0x7faf9415d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:05.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.819+0000 7faf988e7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7faf9415d4b0 0x7faf9415d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37622/0 (socket says 172.21.15.77:37622) 2023-11-04T01:40:05.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.819+0000 7faf988e7640 1 -- 172.21.15.77:0/3033087003 learned_addr learned my addr 172.21.15.77:0/3033087003 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:05.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.819+0000 7faf998e9640 1 --2- 172.21.15.77:0/3033087003 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faf940b47e0 0x7faf940b4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:05.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.819+0000 7faf990e8640 1 --2- 172.21.15.77:0/3033087003 >> v2:172.21.15.122:3300/0 conn(0x7faf940cd9f0 0x7faf940cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:05.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.820+0000 7faf988e7640 1 -- 172.21.15.77:0/3033087003 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faf940b47e0 msgr2=0x7faf940b4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:05.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.820+0000 7faf988e7640 1 --2- 172.21.15.77:0/3033087003 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faf940b47e0 0x7faf940b4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:05.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.820+0000 7faf988e7640 1 -- 172.21.15.77:0/3033087003 >> v2:172.21.15.122:3300/0 conn(0x7faf940cd9f0 msgr2=0x7faf940cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:05.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.820+0000 7faf988e7640 1 --2- 172.21.15.77:0/3033087003 >> v2:172.21.15.122:3300/0 conn(0x7faf940cd9f0 0x7faf940cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:05.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.820+0000 7faf988e7640 1 -- 172.21.15.77:0/3033087003 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf9415df10 con 0x7faf9415d4b0 2023-11-04T01:40:05.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.820+0000 7faf988e7640 1 --2- 172.21.15.77:0/3033087003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf9415d4b0 0x7faf9415d910 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faf940cd520 tx=0x7faf8402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9775c11c09dd8cff server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:05.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.820+0000 7faf8bfff640 1 -- 172.21.15.77:0/3033087003 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf84030860 con 0x7faf9415d4b0 2023-11-04T01:40:05.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.820+0000 7faf8bfff640 1 -- 172.21.15.77:0/3033087003 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf840309c0 con 0x7faf9415d4b0 2023-11-04T01:40:05.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.820+0000 7faf8bfff640 1 -- 172.21.15.77:0/3033087003 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf84030d50 con 0x7faf9415d4b0 2023-11-04T01:40:05.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.821+0000 7faf9b34c640 1 -- 172.21.15.77:0/3033087003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf9415d4b0 msgr2=0x7faf9415d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:05.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.821+0000 7faf9b34c640 1 --2- 172.21.15.77:0/3033087003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf9415d4b0 0x7faf9415d910 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faf940cd520 tx=0x7faf8402b9a0 comp rx=0 tx=0).stop 2023-11-04T01:40:05.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.821+0000 7faf9b34c640 1 -- 172.21.15.77:0/3033087003 shutdown_connections 2023-11-04T01:40:05.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.821+0000 7faf9b34c640 1 --2- 172.21.15.77:0/3033087003 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faf940b47e0 0x7faf940b4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:05.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.821+0000 7faf9b34c640 1 --2- 172.21.15.77:0/3033087003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf9415d4b0 0x7faf9415d910 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:05.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.821+0000 7faf9b34c640 1 --2- 172.21.15.77:0/3033087003 >> v2:172.21.15.122:3300/0 conn(0x7faf940cd9f0 0x7faf940cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:05.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.821+0000 7faf9b34c640 1 -- 172.21.15.77:0/3033087003 >> 172.21.15.77:0/3033087003 conn(0x7faf94071c40 msgr2=0x7faf94072050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:05.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.821+0000 7faf9b34c640 1 -- 172.21.15.77:0/3033087003 shutdown_connections 2023-11-04T01:40:05.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.821+0000 7faf9b34c640 1 -- 172.21.15.77:0/3033087003 wait complete. 2023-11-04T01:40:05.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.822+0000 7faf9b34c640 1 Processor -- start 2023-11-04T01:40:05.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.822+0000 7faf9b34c640 1 -- start start 2023-11-04T01:40:05.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.823+0000 7faf9b34c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faf940b47e0 0x7faf9415fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:05.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.823+0000 7faf9b34c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faf940cd9f0 0x7faf941475a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:05.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.823+0000 7faf9b34c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf9415d4b0 0x7faf940c6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:05.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.823+0000 7faf9b34c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9415ff90 con 0x7faf9415d4b0 2023-11-04T01:40:05.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.823+0000 7faf9b34c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9415e9b0 con 0x7faf940b47e0 2023-11-04T01:40:05.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.823+0000 7faf9b34c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf9415ec90 con 0x7faf940cd9f0 2023-11-04T01:40:05.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.823+0000 7faf998e9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf9415d4b0 0x7faf940c6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:05.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.823+0000 7faf998e9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf9415d4b0 0x7faf940c6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37626/0 (socket says 172.21.15.77:37626) 2023-11-04T01:40:05.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.823+0000 7faf998e9640 1 -- 172.21.15.77:0/3065655865 learned_addr learned my addr 172.21.15.77:0/3065655865 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:05.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.823+0000 7faf990e8640 1 --2- 172.21.15.77:0/3065655865 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faf940b47e0 0x7faf9415fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:05.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.823+0000 7faf988e7640 1 --2- 172.21.15.77:0/3065655865 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faf940cd9f0 0x7faf941475a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:05.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.823+0000 7faf998e9640 1 -- 172.21.15.77:0/3065655865 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faf940cd9f0 msgr2=0x7faf941475a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:05.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.823+0000 7faf998e9640 1 --2- 172.21.15.77:0/3065655865 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faf940cd9f0 0x7faf941475a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:05.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.823+0000 7faf998e9640 1 -- 172.21.15.77:0/3065655865 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faf940b47e0 msgr2=0x7faf9415fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:05.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.823+0000 7faf998e9640 1 --2- 172.21.15.77:0/3065655865 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faf940b47e0 0x7faf9415fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:05.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.823+0000 7faf998e9640 1 -- 172.21.15.77:0/3065655865 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf840094d0 con 0x7faf9415d4b0 2023-11-04T01:40:05.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.823+0000 7faf988e7640 1 --2- 172.21.15.77:0/3065655865 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faf940cd9f0 0x7faf941475a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:05.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.824+0000 7faf998e9640 1 --2- 172.21.15.77:0/3065655865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf9415d4b0 0x7faf940c6950 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7faf8c00e7f0 tx=0x7faf8c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:05.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.824+0000 7faf89ffb640 1 -- 172.21.15.77:0/3065655865 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c009490 con 0x7faf9415d4b0 2023-11-04T01:40:05.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.824+0000 7faf89ffb640 1 -- 172.21.15.77:0/3065655865 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8c00c730 con 0x7faf9415d4b0 2023-11-04T01:40:05.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.824+0000 7faf9b34c640 1 -- 172.21.15.77:0/3065655865 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf9415ef70 con 0x7faf9415d4b0 2023-11-04T01:40:05.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.824+0000 7faf89ffb640 1 -- 172.21.15.77:0/3065655865 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c00cac0 con 0x7faf9415d4b0 2023-11-04T01:40:05.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.824+0000 7faf9b34c640 1 -- 172.21.15.77:0/3065655865 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf9415f530 con 0x7faf9415d4b0 2023-11-04T01:40:05.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.825+0000 7faf9b34c640 1 -- 172.21.15.77:0/3065655865 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf9404e490 con 0x7faf9415d4b0 2023-11-04T01:40:05.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.825+0000 7faf89ffb640 1 -- 172.21.15.77:0/3065655865 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faf8c00cc20 con 0x7faf9415d4b0 2023-11-04T01:40:05.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.826+0000 7faf89ffb640 1 --2- 172.21.15.77:0/3065655865 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7faf7806ae70 0x7faf7806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:05.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.826+0000 7faf89ffb640 1 -- 172.21.15.77:0/3065655865 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf8c089630 con 0x7faf9415d4b0 2023-11-04T01:40:05.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.826+0000 7faf990e8640 1 --2- 172.21.15.77:0/3065655865 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7faf7806ae70 0x7faf7806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:05.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.826+0000 7faf990e8640 1 --2- 172.21.15.77:0/3065655865 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7faf7806ae70 0x7faf7806d330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faf900073f0 tx=0x7faf9000b040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:05.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:05.830+0000 7faf89ffb640 1 -- 172.21.15.77:0/3065655865 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faf8c0546e0 con 0x7faf9415d4b0 2023-11-04T01:40:06.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.005+0000 7faf9b34c640 1 -- 172.21.15.77:0/3065655865 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7faf940d2b40 con 0x7faf9415d4b0 2023-11-04T01:40:06.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.551+0000 7faf89ffb640 1 -- 172.21.15.77:0/3065655865 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7faf8c057d00 con 0x7faf9415d4b0 2023-11-04T01:40:06.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.553+0000 7faf9b34c640 1 -- 172.21.15.77:0/3065655865 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7faf7806ae70 msgr2=0x7faf7806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:06.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.553+0000 7faf9b34c640 1 --2- 172.21.15.77:0/3065655865 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7faf7806ae70 0x7faf7806d330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faf900073f0 tx=0x7faf9000b040 comp rx=0 tx=0).stop 2023-11-04T01:40:06.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.553+0000 7faf9b34c640 1 -- 172.21.15.77:0/3065655865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf9415d4b0 msgr2=0x7faf940c6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:06.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.553+0000 7faf9b34c640 1 --2- 172.21.15.77:0/3065655865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf9415d4b0 0x7faf940c6950 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7faf8c00e7f0 tx=0x7faf8c00ecb0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.553+0000 7faf9b34c640 1 -- 172.21.15.77:0/3065655865 shutdown_connections 2023-11-04T01:40:06.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.553+0000 7faf9b34c640 1 --2- 172.21.15.77:0/3065655865 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7faf7806ae70 0x7faf7806d330 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.553+0000 7faf9b34c640 1 --2- 172.21.15.77:0/3065655865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf9415d4b0 0x7faf940c6950 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.553+0000 7faf9b34c640 1 --2- 172.21.15.77:0/3065655865 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faf940cd9f0 0x7faf941475a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.553+0000 7faf9b34c640 1 --2- 172.21.15.77:0/3065655865 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faf940b47e0 0x7faf9415fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.553+0000 7faf9b34c640 1 -- 172.21.15.77:0/3065655865 >> 172.21.15.77:0/3065655865 conn(0x7faf94071c40 msgr2=0x7faf940b7930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:06.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.553+0000 7faf9b34c640 1 -- 172.21.15.77:0/3065655865 shutdown_connections 2023-11-04T01:40:06.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.553+0000 7faf9b34c640 1 -- 172.21.15.77:0/3065655865 wait complete. 2023-11-04T01:40:06.568 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T01:40:06.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.673+0000 7ff943a51640 1 Processor -- start 2023-11-04T01:40:06.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.673+0000 7ff943a51640 1 -- start start 2023-11-04T01:40:06.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.674+0000 7ff943a51640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff93c06b600 0x7ff93c0cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:06.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.674+0000 7ff943a51640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff93c0cdab0 0x7ff93c0cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:06.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.674+0000 7ff943a51640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff93c0ccaa0 con 0x7ff93c15cfb0 2023-11-04T01:40:06.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.674+0000 7ff943a51640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff93c0ce9a0 con 0x7ff93c0cdab0 2023-11-04T01:40:06.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.674+0000 7ff943a51640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c0cdf40 con 0x7ff93c06b600 2023-11-04T01:40:06.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.674+0000 7ff941fee640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff93c0cdab0 0x7ff93c0cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:06.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.674+0000 7ff941fee640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff93c0cdab0 0x7ff93c0cedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37636/0 (socket says 172.21.15.77:37636) 2023-11-04T01:40:06.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.674+0000 7ff941fee640 1 -- 172.21.15.77:0/1798905509 learned_addr learned my addr 172.21.15.77:0/1798905509 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:06.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.674+0000 7ff941fee640 1 -- 172.21.15.77:0/1798905509 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff93c06b600 msgr2=0x7ff93c0cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:06.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.674+0000 7ff941fee640 1 --2- 172.21.15.77:0/1798905509 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff93c06b600 0x7ff93c0cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.674+0000 7ff941fee640 1 -- 172.21.15.77:0/1798905509 >> v1:172.21.15.122:6789/0 conn(0x7ff93c15cfb0 legacy=0x7ff93c0cb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:06.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.675+0000 7ff941fee640 1 -- 172.21.15.77:0/1798905509 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93c06ba40 con 0x7ff93c0cdab0 2023-11-04T01:40:06.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.675+0000 7ff941fee640 1 --2- 172.21.15.77:0/1798905509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff93c0cdab0 0x7ff93c0cedc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff934009e50 tx=0x7ff93402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9931d662c9562cc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:06.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.675+0000 7ff933fff640 1 -- 172.21.15.77:0/1798905509 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93402ca70 con 0x7ff93c0cdab0 2023-11-04T01:40:06.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.675+0000 7ff933fff640 1 -- 172.21.15.77:0/1798905509 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93402cbd0 con 0x7ff93c0cdab0 2023-11-04T01:40:06.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.675+0000 7ff933fff640 1 -- 172.21.15.77:0/1798905509 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9340343f0 con 0x7ff93c0cdab0 2023-11-04T01:40:06.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.676+0000 7ff943a51640 1 -- 172.21.15.77:0/1798905509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff93c0cdab0 msgr2=0x7ff93c0cedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:06.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.676+0000 7ff943a51640 1 --2- 172.21.15.77:0/1798905509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff93c0cdab0 0x7ff93c0cedc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff934009e50 tx=0x7ff93402bed0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.676+0000 7ff943a51640 1 -- 172.21.15.77:0/1798905509 shutdown_connections 2023-11-04T01:40:06.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.676+0000 7ff943a51640 1 --2- 172.21.15.77:0/1798905509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff93c0cdab0 0x7ff93c0cedc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.676+0000 7ff943a51640 1 --2- 172.21.15.77:0/1798905509 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff93c06b600 0x7ff93c0cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.676+0000 7ff943a51640 1 -- 172.21.15.77:0/1798905509 >> 172.21.15.77:0/1798905509 conn(0x7ff93c06ea90 msgr2=0x7ff93c06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:06.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.676+0000 7ff943a51640 1 -- 172.21.15.77:0/1798905509 shutdown_connections 2023-11-04T01:40:06.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.676+0000 7ff943a51640 1 -- 172.21.15.77:0/1798905509 wait complete. 2023-11-04T01:40:06.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.677+0000 7ff943a51640 1 Processor -- start 2023-11-04T01:40:06.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.677+0000 7ff943a51640 1 -- start start 2023-11-04T01:40:06.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.678+0000 7ff943a51640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff93c06b600 0x7ff93c0b22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:06.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.678+0000 7ff943a51640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff93c0cdab0 0x7ff93c0b0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:06.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.678+0000 7ff943a51640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff93c15cfb0 0x7ff93c0b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:06.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.678+0000 7ff943a51640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c0b0b40 con 0x7ff93c0cdab0 2023-11-04T01:40:06.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.678+0000 7ff943a51640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c0b1610 con 0x7ff93c15cfb0 2023-11-04T01:40:06.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.678+0000 7ff943a51640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c0b0d70 con 0x7ff93c06b600 2023-11-04T01:40:06.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.678+0000 7ff940fec640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff93c0cdab0 0x7ff93c0b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:06.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.678+0000 7ff940fec640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff93c0cdab0 0x7ff93c0b0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37648/0 (socket says 172.21.15.77:37648) 2023-11-04T01:40:06.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.678+0000 7ff940fec640 1 -- 172.21.15.77:0/938725210 learned_addr learned my addr 172.21.15.77:0/938725210 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:06.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.678+0000 7ff941fee640 1 --2- 172.21.15.77:0/938725210 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff93c15cfb0 0x7ff93c0b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:06.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.678+0000 7ff940fec640 1 -- 172.21.15.77:0/938725210 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff93c06b600 msgr2=0x7ff93c0b22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:06.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.678+0000 7ff9417ed640 1 --2- 172.21.15.77:0/938725210 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff93c06b600 0x7ff93c0b22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:06.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.678+0000 7ff940fec640 1 --2- 172.21.15.77:0/938725210 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff93c06b600 0x7ff93c0b22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.678+0000 7ff940fec640 1 -- 172.21.15.77:0/938725210 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff93c15cfb0 msgr2=0x7ff93c0b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:06.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.678+0000 7ff940fec640 1 --2- 172.21.15.77:0/938725210 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff93c15cfb0 0x7ff93c0b2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:06.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.678+0000 7ff940fec640 1 -- 172.21.15.77:0/938725210 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff934009b30 con 0x7ff93c0cdab0 2023-11-04T01:40:06.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.678+0000 7ff941fee640 1 --2- 172.21.15.77:0/938725210 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff93c15cfb0 0x7ff93c0b2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:06.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.678+0000 7ff940fec640 1 --2- 172.21.15.77:0/938725210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff93c0cdab0 0x7ff93c0b0600 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff92c00b410 tx=0x7ff92c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:06.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.679+0000 7ff931ffb640 1 -- 172.21.15.77:0/938725210 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c011830 con 0x7ff93c0cdab0 2023-11-04T01:40:06.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.679+0000 7ff931ffb640 1 -- 172.21.15.77:0/938725210 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92c0119b0 con 0x7ff93c0cdab0 2023-11-04T01:40:06.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.679+0000 7ff931ffb640 1 -- 172.21.15.77:0/938725210 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c011d60 con 0x7ff93c0cdab0 2023-11-04T01:40:06.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.679+0000 7ff943a51640 1 -- 172.21.15.77:0/938725210 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff93c0b1050 con 0x7ff93c0cdab0 2023-11-04T01:40:06.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.679+0000 7ff943a51640 1 -- 172.21.15.77:0/938725210 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff93c0c4750 con 0x7ff93c0cdab0 2023-11-04T01:40:06.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.680+0000 7ff943a51640 1 -- 172.21.15.77:0/938725210 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff93c0c4970 con 0x7ff93c0cdab0 2023-11-04T01:40:06.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.680+0000 7ff931ffb640 1 -- 172.21.15.77:0/938725210 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff92c01a400 con 0x7ff93c0cdab0 2023-11-04T01:40:06.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.680+0000 7ff931ffb640 1 --2- 172.21.15.77:0/938725210 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff92006aea0 0x7ff92006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:06.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.681+0000 7ff931ffb640 1 -- 172.21.15.77:0/938725210 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5935+0+0 (secure 0 0 0) 0x7ff92c089850 con 0x7ff93c0cdab0 2023-11-04T01:40:06.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.681+0000 7ff9417ed640 1 --2- 172.21.15.77:0/938725210 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff92006aea0 0x7ff92006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:06.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.681+0000 7ff9417ed640 1 --2- 172.21.15.77:0/938725210 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff92006aea0 0x7ff92006d360 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff938003d90 tx=0x7ff938009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:06.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.685+0000 7ff931ffb640 1 -- 172.21.15.77:0/938725210 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff92c054820 con 0x7ff93c0cdab0 2023-11-04T01:40:06.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:06.854+0000 7ff943a51640 1 -- 172.21.15.77:0/938725210 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff93c074290 con 0x7ff93c0cdab0 2023-11-04T01:40:08.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.718+0000 7ff931ffb640 1 -- 172.21.15.77:0/938725210 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7ff92c015020 con 0x7ff93c0cdab0 2023-11-04T01:40:08.721 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data_ec' created 2023-11-04T01:40:08.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.721+0000 7ff943a51640 1 -- 172.21.15.77:0/938725210 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff92006aea0 msgr2=0x7ff92006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:08.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.721+0000 7ff943a51640 1 --2- 172.21.15.77:0/938725210 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff92006aea0 0x7ff92006d360 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff938003d90 tx=0x7ff938009040 comp rx=0 tx=0).stop 2023-11-04T01:40:08.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.721+0000 7ff943a51640 1 -- 172.21.15.77:0/938725210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff93c0cdab0 msgr2=0x7ff93c0b0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:08.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.721+0000 7ff943a51640 1 --2- 172.21.15.77:0/938725210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff93c0cdab0 0x7ff93c0b0600 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff92c00b410 tx=0x7ff92c00b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:08.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.722+0000 7ff943a51640 1 -- 172.21.15.77:0/938725210 shutdown_connections 2023-11-04T01:40:08.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.722+0000 7ff943a51640 1 --2- 172.21.15.77:0/938725210 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff92006aea0 0x7ff92006d360 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:08.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.722+0000 7ff943a51640 1 --2- 172.21.15.77:0/938725210 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff93c15cfb0 0x7ff93c0b2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:08.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.722+0000 7ff943a51640 1 --2- 172.21.15.77:0/938725210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff93c0cdab0 0x7ff93c0b0600 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:08.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.722+0000 7ff943a51640 1 --2- 172.21.15.77:0/938725210 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff93c06b600 0x7ff93c0b22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:08.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.722+0000 7ff943a51640 1 -- 172.21.15.77:0/938725210 >> 172.21.15.77:0/938725210 conn(0x7ff93c06ea90 msgr2=0x7ff93c0c96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:08.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.722+0000 7ff943a51640 1 -- 172.21.15.77:0/938725210 shutdown_connections 2023-11-04T01:40:08.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.722+0000 7ff943a51640 1 -- 172.21.15.77:0/938725210 wait complete. 2023-11-04T01:40:08.744 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-11-04T01:40:08.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.850+0000 7f1dedb0f640 1 Processor -- start 2023-11-04T01:40:08.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.850+0000 7f1dedb0f640 1 -- start start 2023-11-04T01:40:08.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.851+0000 7f1dedb0f640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1de815d1b0 0x7f1de80ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:08.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.851+0000 7f1dedb0f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1de80cecf0 0x7f1de80cd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:08.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.851+0000 7f1dedb0f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de8161870 con 0x7f1de80cb680 2023-11-04T01:40:08.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.851+0000 7f1dedb0f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de8160c60 con 0x7f1de80cecf0 2023-11-04T01:40:08.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.851+0000 7f1dedb0f640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de8160f40 con 0x7f1de815d1b0 2023-11-04T01:40:08.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.851+0000 7f1de6ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1de80cecf0 0x7f1de80cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:08.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.851+0000 7f1de7fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f1de80cb680 0x7f1de80b2660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:51980/0 (socket says 172.21.15.77:51980) 2023-11-04T01:40:08.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.851+0000 7f1de7fff640 1 -- 172.21.15.77:0/1232972040 learned_addr learned my addr 172.21.15.77:0/1232972040 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:08.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.851+0000 7f1de6ffd640 1 -- 172.21.15.77:0/1232972040 >> v2:172.21.15.122:3300/0 conn(0x7f1de815d1b0 msgr2=0x7f1de80ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:08.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.851+0000 7f1de6ffd640 1 --2- 172.21.15.77:0/1232972040 >> v2:172.21.15.122:3300/0 conn(0x7f1de815d1b0 0x7f1de80ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:08.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.851+0000 7f1de6ffd640 1 -- 172.21.15.77:0/1232972040 >> v1:172.21.15.77:6789/0 conn(0x7f1de80cb680 legacy=0x7f1de80b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:08.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.851+0000 7f1de6ffd640 1 -- 172.21.15.77:0/1232972040 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de8161220 con 0x7f1de80cecf0 2023-11-04T01:40:08.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.851+0000 7f1de67fc640 1 -- 172.21.15.77:0/1232972040 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3275680096 0 0) 0x7f1de8161870 con 0x7f1de80cb680 2023-11-04T01:40:08.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.852+0000 7f1de6ffd640 1 --2- 172.21.15.77:0/1232972040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1de80cecf0 0x7f1de80cd540 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1de80b3700 tx=0x7f1ddc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af349d5e91bf99b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:08.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.852+0000 7f1de67fc640 1 -- 172.21.15.77:0/1232972040 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc031830 con 0x7f1de80cecf0 2023-11-04T01:40:08.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.852+0000 7f1de67fc640 1 -- 172.21.15.77:0/1232972040 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ddc031990 con 0x7f1de80cecf0 2023-11-04T01:40:08.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.852+0000 7f1de67fc640 1 -- 172.21.15.77:0/1232972040 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc031d20 con 0x7f1de80cecf0 2023-11-04T01:40:08.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.852+0000 7f1dedb0f640 1 -- 172.21.15.77:0/1232972040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1de80cecf0 msgr2=0x7f1de80cd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:08.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.852+0000 7f1dedb0f640 1 --2- 172.21.15.77:0/1232972040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1de80cecf0 0x7f1de80cd540 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1de80b3700 tx=0x7f1ddc02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:08.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.853+0000 7f1dedb0f640 1 -- 172.21.15.77:0/1232972040 shutdown_connections 2023-11-04T01:40:08.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.853+0000 7f1dedb0f640 1 --2- 172.21.15.77:0/1232972040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1de80cecf0 0x7f1de80cd540 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:08.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.853+0000 7f1dedb0f640 1 --2- 172.21.15.77:0/1232972040 >> v2:172.21.15.122:3300/0 conn(0x7f1de815d1b0 0x7f1de80ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:08.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.853+0000 7f1dedb0f640 1 -- 172.21.15.77:0/1232972040 >> 172.21.15.77:0/1232972040 conn(0x7f1de806ea20 msgr2=0x7f1de806ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:08.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.853+0000 7f1dedb0f640 1 -- 172.21.15.77:0/1232972040 shutdown_connections 2023-11-04T01:40:08.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.853+0000 7f1dedb0f640 1 -- 172.21.15.77:0/1232972040 wait complete. 2023-11-04T01:40:08.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.854+0000 7f1dedb0f640 1 Processor -- start 2023-11-04T01:40:08.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.854+0000 7f1dedb0f640 1 -- start start 2023-11-04T01:40:08.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.855+0000 7f1dedb0f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1de80cb680 0x7f1de8150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:08.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.855+0000 7f1dedb0f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1de80cecf0 0x7f1de80c5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:08.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.855+0000 7f1dedb0f640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1de815d1b0 0x7f1de80c4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:08.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.855+0000 7f1dedb0f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de8151420 con 0x7f1de80cb680 2023-11-04T01:40:08.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.855+0000 7f1dedb0f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de80c6180 con 0x7f1de80cecf0 2023-11-04T01:40:08.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.855+0000 7f1dedb0f640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de80c6460 con 0x7f1de815d1b0 2023-11-04T01:40:08.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.855+0000 7f1de77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1de80cb680 0x7f1de8150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:08.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.855+0000 7f1de77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1de80cb680 0x7f1de8150ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45890/0 (socket says 172.21.15.77:45890) 2023-11-04T01:40:08.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.855+0000 7f1de77fe640 1 -- 172.21.15.77:0/493940250 learned_addr learned my addr 172.21.15.77:0/493940250 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:08.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.855+0000 7f1de77fe640 1 -- 172.21.15.77:0/493940250 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1de815d1b0 msgr2=0x7f1de80c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:08.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.855+0000 7f1de77fe640 1 --2- 172.21.15.77:0/493940250 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1de815d1b0 0x7f1de80c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:08.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.855+0000 7f1de77fe640 1 -- 172.21.15.77:0/493940250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1de80cecf0 msgr2=0x7f1de80c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:08.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.855+0000 7f1de77fe640 1 --2- 172.21.15.77:0/493940250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1de80cecf0 0x7f1de80c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:08.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.855+0000 7f1de77fe640 1 -- 172.21.15.77:0/493940250 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ddc009400 con 0x7f1de80cb680 2023-11-04T01:40:08.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.855+0000 7f1de77fe640 1 --2- 172.21.15.77:0/493940250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1de80cb680 0x7f1de8150ee0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1dd800b410 tx=0x7f1dd800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:08.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.855+0000 7f1dcffff640 1 -- 172.21.15.77:0/493940250 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8011830 con 0x7f1de80cb680 2023-11-04T01:40:08.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.855+0000 7f1dcffff640 1 -- 172.21.15.77:0/493940250 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd80119b0 con 0x7f1de80cb680 2023-11-04T01:40:08.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.855+0000 7f1dedb0f640 1 -- 172.21.15.77:0/493940250 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de80c6740 con 0x7f1de80cb680 2023-11-04T01:40:08.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.855+0000 7f1dcffff640 1 -- 172.21.15.77:0/493940250 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8011d60 con 0x7f1de80cb680 2023-11-04T01:40:08.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.855+0000 7f1dedb0f640 1 -- 172.21.15.77:0/493940250 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de80c6d00 con 0x7f1de80cb680 2023-11-04T01:40:08.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.856+0000 7f1dedb0f640 1 -- 172.21.15.77:0/493940250 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de804e490 con 0x7f1de80cb680 2023-11-04T01:40:08.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.857+0000 7f1dcffff640 1 -- 172.21.15.77:0/493940250 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1dd801a400 con 0x7f1de80cb680 2023-11-04T01:40:08.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.857+0000 7f1dcffff640 1 --2- 172.21.15.77:0/493940250 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1dd406ae70 0x7f1dd406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:08.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.857+0000 7f1dcffff640 1 -- 172.21.15.77:0/493940250 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f1dd8089ac0 con 0x7f1de80cb680 2023-11-04T01:40:08.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.857+0000 7f1de6ffd640 1 --2- 172.21.15.77:0/493940250 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1dd406ae70 0x7f1dd406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:08.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.858+0000 7f1de6ffd640 1 --2- 172.21.15.77:0/493940250 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1dd406ae70 0x7f1dd406d330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc036000 tx=0x7f1ddc030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:08.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:08.861+0000 7f1dcffff640 1 -- 172.21.15.77:0/493940250 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1dd8054810 con 0x7f1de80cb680 2023-11-04T01:40:09.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.026+0000 7f1dedb0f640 1 -- 172.21.15.77:0/493940250 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f1de80c6ef0 con 0x7f1de80cb680 2023-11-04T01:40:09.459 INFO:tasks.ceph.mds.d.smithi122.stderr:2023-11-04T01:40:09.457+0000 7f7872258640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:40:09.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.722+0000 7f1dcffff640 1 -- 172.21.15.77:0/493940250 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1dd8089e60 con 0x7f1de80cb680 2023-11-04T01:40:09.726 INFO:teuthology.orchestra.run.smithi077.stderr:set pool 4 allow_ec_overwrites to true 2023-11-04T01:40:09.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.726+0000 7f1dedb0f640 1 -- 172.21.15.77:0/493940250 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1dd406ae70 msgr2=0x7f1dd406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.726+0000 7f1dedb0f640 1 --2- 172.21.15.77:0/493940250 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1dd406ae70 0x7f1dd406d330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc036000 tx=0x7f1ddc030000 comp rx=0 tx=0).stop 2023-11-04T01:40:09.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.726+0000 7f1dedb0f640 1 -- 172.21.15.77:0/493940250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1de80cb680 msgr2=0x7f1de8150ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.726+0000 7f1dedb0f640 1 --2- 172.21.15.77:0/493940250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1de80cb680 0x7f1de8150ee0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1dd800b410 tx=0x7f1dd800b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.726+0000 7f1dedb0f640 1 -- 172.21.15.77:0/493940250 shutdown_connections 2023-11-04T01:40:09.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.726+0000 7f1dedb0f640 1 --2- 172.21.15.77:0/493940250 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1dd406ae70 0x7f1dd406d330 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.726+0000 7f1dedb0f640 1 --2- 172.21.15.77:0/493940250 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1de815d1b0 0x7f1de80c4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.726+0000 7f1dedb0f640 1 --2- 172.21.15.77:0/493940250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1de80cecf0 0x7f1de80c5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.726+0000 7f1dedb0f640 1 --2- 172.21.15.77:0/493940250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1de80cb680 0x7f1de8150ee0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.726+0000 7f1dedb0f640 1 -- 172.21.15.77:0/493940250 >> 172.21.15.77:0/493940250 conn(0x7f1de806ea20 msgr2=0x7f1de80cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:09.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.727+0000 7f1dedb0f640 1 -- 172.21.15.77:0/493940250 shutdown_connections 2023-11-04T01:40:09.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.727+0000 7f1dedb0f640 1 -- 172.21.15.77:0/493940250 wait complete. 2023-11-04T01:40:09.838 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-11-04T01:40:09.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.937+0000 7f6f9fc00640 1 Processor -- start 2023-11-04T01:40:09.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.938+0000 7f6f9fc00640 1 -- start start 2023-11-04T01:40:09.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.939+0000 7f6f9fc00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6f980c4ff0 0x7f6f980cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.939+0000 7f6f9fc00640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f980adac0 0x7f6f980adf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.939+0000 7f6f9fc00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f9815aff0 con 0x7f6f98159c00 2023-11-04T01:40:09.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.939+0000 7f6f9fc00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f980ae460 con 0x7f6f980c4ff0 2023-11-04T01:40:09.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.939+0000 7f6f9fc00640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9815a3e0 con 0x7f6f980adac0 2023-11-04T01:40:09.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.939+0000 7f6f9d19b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6f980c4ff0 0x7f6f980cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.939+0000 7f6f9e19d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f980adac0 0x7f6f980adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.939+0000 7f6f9d99c640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f6f98159c00 0x7f6f980c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:59806/0 (socket says 172.21.15.77:59806) 2023-11-04T01:40:09.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.939+0000 7f6f9d99c640 1 -- 172.21.15.77:0/2440729702 learned_addr learned my addr 172.21.15.77:0/2440729702 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:09.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.939+0000 7f6f9e19d640 1 -- 172.21.15.77:0/2440729702 >> v2:172.21.15.122:3300/0 conn(0x7f6f980c4ff0 msgr2=0x7f6f980cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:09.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.939+0000 7f6f9e19d640 1 --2- 172.21.15.77:0/2440729702 >> v2:172.21.15.122:3300/0 conn(0x7f6f980c4ff0 0x7f6f980cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.939+0000 7f6f9e19d640 1 -- 172.21.15.77:0/2440729702 >> v1:172.21.15.122:6789/0 conn(0x7f6f98159c00 legacy=0x7f6f980c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.939+0000 7f6f9e19d640 1 -- 172.21.15.77:0/2440729702 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9815a6c0 con 0x7f6f980adac0 2023-11-04T01:40:09.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.939+0000 7f6f9d19b640 1 --2- 172.21.15.77:0/2440729702 >> v2:172.21.15.122:3300/0 conn(0x7f6f980c4ff0 0x7f6f980cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:09.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.940+0000 7f6f9e19d640 1 --2- 172.21.15.77:0/2440729702 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f980adac0 0x7f6f980adf20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6f90009d90 tx=0x7f6f9002bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3552e4d1550e130e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:09.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.940+0000 7f6f9c99a640 1 -- 172.21.15.77:0/2440729702 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9002cc50 con 0x7f6f980adac0 2023-11-04T01:40:09.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.940+0000 7f6f9c99a640 1 -- 172.21.15.77:0/2440729702 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9002cdb0 con 0x7f6f980adac0 2023-11-04T01:40:09.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.940+0000 7f6f9c99a640 1 -- 172.21.15.77:0/2440729702 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f90034660 con 0x7f6f980adac0 2023-11-04T01:40:09.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.941+0000 7f6f9fc00640 1 -- 172.21.15.77:0/2440729702 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f980adac0 msgr2=0x7f6f980adf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.941+0000 7f6f9fc00640 1 --2- 172.21.15.77:0/2440729702 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f980adac0 0x7f6f980adf20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6f90009d90 tx=0x7f6f9002bea0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.941+0000 7f6f9fc00640 1 -- 172.21.15.77:0/2440729702 shutdown_connections 2023-11-04T01:40:09.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.941+0000 7f6f9fc00640 1 --2- 172.21.15.77:0/2440729702 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f980adac0 0x7f6f980adf20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.941+0000 7f6f9fc00640 1 --2- 172.21.15.77:0/2440729702 >> v2:172.21.15.122:3300/0 conn(0x7f6f980c4ff0 0x7f6f980cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.941+0000 7f6f9fc00640 1 -- 172.21.15.77:0/2440729702 >> 172.21.15.77:0/2440729702 conn(0x7f6f980ce950 msgr2=0x7f6f980ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:09.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.941+0000 7f6f9fc00640 1 -- 172.21.15.77:0/2440729702 shutdown_connections 2023-11-04T01:40:09.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.941+0000 7f6f9fc00640 1 -- 172.21.15.77:0/2440729702 wait complete. 2023-11-04T01:40:09.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.942+0000 7f6f9fc00640 1 Processor -- start 2023-11-04T01:40:09.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.942+0000 7f6f9fc00640 1 -- start start 2023-11-04T01:40:09.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.943+0000 7f6f9fc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f980adac0 0x7f6f981564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.943+0000 7f6f9fc00640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f980c4ff0 0x7f6f98155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.943+0000 7f6f9fc00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f98159c00 0x7f6f98146380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.943+0000 7f6f9fc00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9814e7d0 con 0x7f6f980adac0 2023-11-04T01:40:09.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.943+0000 7f6f9fc00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f981f0790 con 0x7f6f98159c00 2023-11-04T01:40:09.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.943+0000 7f6f9fc00640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f98156b30 con 0x7f6f980c4ff0 2023-11-04T01:40:09.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.943+0000 7f6f9d99c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f980adac0 0x7f6f981564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.943+0000 7f6f9d99c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f980adac0 0x7f6f981564c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45900/0 (socket says 172.21.15.77:45900) 2023-11-04T01:40:09.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.943+0000 7f6f9d99c640 1 -- 172.21.15.77:0/723842662 learned_addr learned my addr 172.21.15.77:0/723842662 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:09.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.943+0000 7f6f9d19b640 1 --2- 172.21.15.77:0/723842662 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f980c4ff0 0x7f6f98155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.943+0000 7f6f9e19d640 1 --2- 172.21.15.77:0/723842662 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f98159c00 0x7f6f98146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.943+0000 7f6f9d99c640 1 -- 172.21.15.77:0/723842662 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f980c4ff0 msgr2=0x7f6f98155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.943+0000 7f6f9d99c640 1 --2- 172.21.15.77:0/723842662 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f980c4ff0 0x7f6f98155920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.943+0000 7f6f9d99c640 1 -- 172.21.15.77:0/723842662 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f98159c00 msgr2=0x7f6f98146380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:09.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.943+0000 7f6f9d99c640 1 --2- 172.21.15.77:0/723842662 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f98159c00 0x7f6f98146380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:09.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.943+0000 7f6f9d99c640 1 -- 172.21.15.77:0/723842662 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f88009400 con 0x7f6f980adac0 2023-11-04T01:40:09.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.943+0000 7f6f9e19d640 1 --2- 172.21.15.77:0/723842662 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f98159c00 0x7f6f98146380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:09.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.943+0000 7f6f9d99c640 1 --2- 172.21.15.77:0/723842662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f980adac0 0x7f6f981564c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6f9400c480 tx=0x7f6f9400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:09.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.943+0000 7f6f8e7fc640 1 -- 172.21.15.77:0/723842662 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f94005ce0 con 0x7f6f980adac0 2023-11-04T01:40:09.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.944+0000 7f6f8e7fc640 1 -- 172.21.15.77:0/723842662 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f94005e40 con 0x7f6f980adac0 2023-11-04T01:40:09.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.944+0000 7f6f9fc00640 1 -- 172.21.15.77:0/723842662 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f90009a70 con 0x7f6f980adac0 2023-11-04T01:40:09.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.944+0000 7f6f8e7fc640 1 -- 172.21.15.77:0/723842662 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f940072f0 con 0x7f6f980adac0 2023-11-04T01:40:09.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.944+0000 7f6f9fc00640 1 -- 172.21.15.77:0/723842662 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f98150850 con 0x7f6f980adac0 2023-11-04T01:40:09.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.945+0000 7f6f9fc00640 1 -- 172.21.15.77:0/723842662 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f98074290 con 0x7f6f980adac0 2023-11-04T01:40:09.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.945+0000 7f6f8e7fc640 1 -- 172.21.15.77:0/723842662 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6f94007450 con 0x7f6f980adac0 2023-11-04T01:40:09.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.945+0000 7f6f8e7fc640 1 --2- 172.21.15.77:0/723842662 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6f7c06ae70 0x7f6f7c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:09.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.945+0000 7f6f8e7fc640 1 -- 172.21.15.77:0/723842662 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f6f94088d00 con 0x7f6f980adac0 2023-11-04T01:40:09.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.946+0000 7f6f9d19b640 1 --2- 172.21.15.77:0/723842662 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6f7c06ae70 0x7f6f7c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:09.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.946+0000 7f6f9d19b640 1 --2- 172.21.15.77:0/723842662 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6f7c06ae70 0x7f6f7c06d330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6f980b4770 tx=0x7f6f88008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:09.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:09.950+0000 7f6f8e7fc640 1 -- 172.21.15.77:0/723842662 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6f94053c20 con 0x7f6f980adac0 2023-11-04T01:40:10.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.151+0000 7f6f9fc00640 1 -- 172.21.15.77:0/723842662 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f6f980ca360 con 0x7f6f980adac0 2023-11-04T01:40:10.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.724+0000 7f6f8e7fc640 1 -- 172.21.15.77:0/723842662 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f6f94017020 con 0x7f6f980adac0 2023-11-04T01:40:10.727 INFO:teuthology.orchestra.run.smithi077.stderr:added data pool 4 to fsmap 2023-11-04T01:40:10.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.726+0000 7f6f9fc00640 1 -- 172.21.15.77:0/723842662 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6f7c06ae70 msgr2=0x7f6f7c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:10.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.726+0000 7f6f9fc00640 1 --2- 172.21.15.77:0/723842662 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6f7c06ae70 0x7f6f7c06d330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6f980b4770 tx=0x7f6f88008040 comp rx=0 tx=0).stop 2023-11-04T01:40:10.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.726+0000 7f6f9fc00640 1 -- 172.21.15.77:0/723842662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f980adac0 msgr2=0x7f6f981564c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:10.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.726+0000 7f6f9fc00640 1 --2- 172.21.15.77:0/723842662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f980adac0 0x7f6f981564c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6f9400c480 tx=0x7f6f9400c940 comp rx=0 tx=0).stop 2023-11-04T01:40:10.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.726+0000 7f6f9fc00640 1 -- 172.21.15.77:0/723842662 shutdown_connections 2023-11-04T01:40:10.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.726+0000 7f6f9fc00640 1 --2- 172.21.15.77:0/723842662 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6f7c06ae70 0x7f6f7c06d330 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.726+0000 7f6f9fc00640 1 --2- 172.21.15.77:0/723842662 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f98159c00 0x7f6f98146380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.726+0000 7f6f9fc00640 1 --2- 172.21.15.77:0/723842662 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f980c4ff0 0x7f6f98155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.726+0000 7f6f9fc00640 1 --2- 172.21.15.77:0/723842662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f980adac0 0x7f6f981564c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.726+0000 7f6f9fc00640 1 -- 172.21.15.77:0/723842662 >> 172.21.15.77:0/723842662 conn(0x7f6f980ce950 msgr2=0x7f6f980c4070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:10.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.726+0000 7f6f9fc00640 1 -- 172.21.15.77:0/723842662 shutdown_connections 2023-11-04T01:40:10.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.726+0000 7f6f9fc00640 1 -- 172.21.15.77:0/723842662 wait complete. 2023-11-04T01:40:10.741 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:10.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.840+0000 7fa762b39640 1 Processor -- start 2023-11-04T01:40:10.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.840+0000 7fa762b39640 1 -- start start 2023-11-04T01:40:10.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.841+0000 7fa762b39640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa75c0cda30 0x7fa75c165ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:10.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.841+0000 7fa762b39640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa75c0cc450 con 0x7fa75c15bfb0 2023-11-04T01:40:10.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.841+0000 7fa762b39640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa75c15f400 con 0x7fa75c15ae40 2023-11-04T01:40:10.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.841+0000 7fa762b39640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa75c15b220 con 0x7fa75c0cda30 2023-11-04T01:40:10.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.841+0000 7fa75bfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fa75c15bfb0 0x7fa75c0cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:51982/0 (socket says 172.21.15.77:51982) 2023-11-04T01:40:10.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.841+0000 7fa75bfff640 1 -- 172.21.15.77:0/1394692286 learned_addr learned my addr 172.21.15.77:0/1394692286 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:10.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.841+0000 7fa7610d6640 1 --2- 172.21.15.77:0/1394692286 >> v2:172.21.15.77:3300/0 conn(0x7fa75c0cda30 0x7fa75c165ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:10.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.841+0000 7fa75b7fe640 1 -- 172.21.15.77:0/1394692286 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4047576256 0 0) 0x7fa750001110 con 0x7fa75c15bfb0 2023-11-04T01:40:10.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.841+0000 7fa75b7fe640 1 -- 172.21.15.77:0/1394692286 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa744003520 con 0x7fa75c15bfb0 2023-11-04T01:40:10.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.841+0000 7fa7610d6640 1 -- 172.21.15.77:0/1394692286 >> v1:172.21.15.122:6789/0 conn(0x7fa75c15ae40 legacy=0x7fa75c0cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:10.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.841+0000 7fa7610d6640 1 -- 172.21.15.77:0/1394692286 >> v1:172.21.15.77:6789/0 conn(0x7fa75c15bfb0 legacy=0x7fa75c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:10.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.841+0000 7fa7610d6640 1 -- 172.21.15.77:0/1394692286 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75c15f890 con 0x7fa75c0cda30 2023-11-04T01:40:10.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.842+0000 7fa7610d6640 1 --2- 172.21.15.77:0/1394692286 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa75c0cda30 0x7fa75c165ce0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa754009d90 tx=0x7fa75402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d14832b4727210 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:10.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.842+0000 7fa75b7fe640 1 -- 172.21.15.77:0/1394692286 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75402cd00 con 0x7fa75c0cda30 2023-11-04T01:40:10.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.842+0000 7fa75b7fe640 1 -- 172.21.15.77:0/1394692286 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75402ce60 con 0x7fa75c0cda30 2023-11-04T01:40:10.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.842+0000 7fa75b7fe640 1 -- 172.21.15.77:0/1394692286 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa754034660 con 0x7fa75c0cda30 2023-11-04T01:40:10.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.843+0000 7fa762b39640 1 -- 172.21.15.77:0/1394692286 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa75c0cda30 msgr2=0x7fa75c165ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:10.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.843+0000 7fa762b39640 1 --2- 172.21.15.77:0/1394692286 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa75c0cda30 0x7fa75c165ce0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa754009d90 tx=0x7fa75402bf50 comp rx=0 tx=0).stop 2023-11-04T01:40:10.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.843+0000 7fa762b39640 1 -- 172.21.15.77:0/1394692286 shutdown_connections 2023-11-04T01:40:10.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.843+0000 7fa762b39640 1 --2- 172.21.15.77:0/1394692286 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa75c0cda30 0x7fa75c165ce0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.843+0000 7fa762b39640 1 -- 172.21.15.77:0/1394692286 >> 172.21.15.77:0/1394692286 conn(0x7fa75c06ea90 msgr2=0x7fa75c06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:10.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.843+0000 7fa762b39640 1 -- 172.21.15.77:0/1394692286 shutdown_connections 2023-11-04T01:40:10.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.843+0000 7fa762b39640 1 -- 172.21.15.77:0/1394692286 wait complete. 2023-11-04T01:40:10.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.844+0000 7fa762b39640 1 Processor -- start 2023-11-04T01:40:10.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.844+0000 7fa762b39640 1 -- start start 2023-11-04T01:40:10.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.845+0000 7fa762b39640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa75c0cda30 0x7fa75c0c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:10.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.845+0000 7fa762b39640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa75c15ae40 0x7fa75c0c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:10.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.845+0000 7fa762b39640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa75c15bfb0 0x7fa75c0ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:10.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.845+0000 7fa762b39640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c0c60a0 con 0x7fa75c0cda30 2023-11-04T01:40:10.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.845+0000 7fa762b39640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c0cab20 con 0x7fa75c15bfb0 2023-11-04T01:40:10.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.845+0000 7fa762b39640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c0c8a20 con 0x7fa75c15ae40 2023-11-04T01:40:10.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.845+0000 7fa7608d5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa75c0cda30 0x7fa75c0c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:10.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.845+0000 7fa7608d5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa75c0cda30 0x7fa75c0c8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45916/0 (socket says 172.21.15.77:45916) 2023-11-04T01:40:10.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.845+0000 7fa7608d5640 1 -- 172.21.15.77:0/1263679950 learned_addr learned my addr 172.21.15.77:0/1263679950 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:10.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.845+0000 7fa7610d6640 1 --2- 172.21.15.77:0/1263679950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa75c15bfb0 0x7fa75c0ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:10.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.845+0000 7fa75bfff640 1 --2- 172.21.15.77:0/1263679950 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa75c15ae40 0x7fa75c0c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:10.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.845+0000 7fa7608d5640 1 -- 172.21.15.77:0/1263679950 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa75c15ae40 msgr2=0x7fa75c0c5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:10.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.845+0000 7fa7608d5640 1 --2- 172.21.15.77:0/1263679950 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa75c15ae40 0x7fa75c0c5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.845+0000 7fa7608d5640 1 -- 172.21.15.77:0/1263679950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa75c15bfb0 msgr2=0x7fa75c0ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:10.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.845+0000 7fa7608d5640 1 --2- 172.21.15.77:0/1263679950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa75c15bfb0 0x7fa75c0ca5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:10.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.845+0000 7fa7608d5640 1 -- 172.21.15.77:0/1263679950 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa754009a70 con 0x7fa75c0cda30 2023-11-04T01:40:10.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.845+0000 7fa7610d6640 1 --2- 172.21.15.77:0/1263679950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa75c15bfb0 0x7fa75c0ca5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:10.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.845+0000 7fa7608d5640 1 --2- 172.21.15.77:0/1263679950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa75c0cda30 0x7fa75c0c8eb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa74c00c450 tx=0x7fa74c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:10.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.845+0000 7fa7597fa640 1 -- 172.21.15.77:0/1263679950 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c0052d0 con 0x7fa75c0cda30 2023-11-04T01:40:10.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.845+0000 7fa7597fa640 1 -- 172.21.15.77:0/1263679950 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74c005430 con 0x7fa75c0cda30 2023-11-04T01:40:10.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.845+0000 7fa762b39640 1 -- 172.21.15.77:0/1263679950 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa75c0c7e10 con 0x7fa75c0cda30 2023-11-04T01:40:10.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.845+0000 7fa7597fa640 1 -- 172.21.15.77:0/1263679950 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c012870 con 0x7fa75c0cda30 2023-11-04T01:40:10.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.845+0000 7fa762b39640 1 -- 172.21.15.77:0/1263679950 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa75c0c83d0 con 0x7fa75c0cda30 2023-11-04T01:40:10.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.846+0000 7fa762b39640 1 -- 172.21.15.77:0/1263679950 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa75c0ce2d0 con 0x7fa75c0cda30 2023-11-04T01:40:10.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.847+0000 7fa7597fa640 1 -- 172.21.15.77:0/1263679950 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa74c0129d0 con 0x7fa75c0cda30 2023-11-04T01:40:10.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.847+0000 7fa7597fa640 1 --2- 172.21.15.77:0/1263679950 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa74806ae70 0x7fa74806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:10.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.847+0000 7fa7597fa640 1 -- 172.21.15.77:0/1263679950 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa74c089440 con 0x7fa75c0cda30 2023-11-04T01:40:10.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.847+0000 7fa75bfff640 1 --2- 172.21.15.77:0/1263679950 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa74806ae70 0x7fa74806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:10.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.848+0000 7fa75bfff640 1 --2- 172.21.15.77:0/1263679950 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa74806ae70 0x7fa74806d330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0cace0 tx=0x7fa750009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:10.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:10.852+0000 7fa7597fa640 1 -- 172.21.15.77:0/1263679950 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa74c054200 con 0x7fa75c0cda30 2023-11-04T01:40:11.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.052+0000 7fa762b39640 1 -- 172.21.15.77:0/1263679950 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa75c0b6910 con 0x7fa75c0cda30 2023-11-04T01:40:11.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.052+0000 7fa7597fa640 1 -- 172.21.15.77:0/1263679950 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4915 (secure 0 0 0) 0x7fa74c057820 con 0x7fa75c0cda30 2023-11-04T01:40:11.055 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:11.056 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/2867268857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2867268857},{"type":"v1","addr":"172.21.15.77:6834","nonce":2867268857}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2709973073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2709973073},{"type":"v1","addr":"172.21.15.77:6835","nonce":2709973073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/396299424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":396299424},{"type":"v1","addr":"172.21.15.122:6837","nonce":396299424}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:40:05.031856+0000","modified":"2023-11-04T01:40:10.154106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34166},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34166":{"gid":34166,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6836/2444318089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2444318089},{"type":"v1","addr":"172.21.15.122:6836","nonce":2444318089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-11-04T01:40:11.057 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 7 2023-11-04T01:40:11.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.054+0000 7fa762b39640 1 -- 172.21.15.77:0/1263679950 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa74806ae70 msgr2=0x7fa74806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.054+0000 7fa762b39640 1 --2- 172.21.15.77:0/1263679950 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa74806ae70 0x7fa74806d330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0cace0 tx=0x7fa750009040 comp rx=0 tx=0).stop 2023-11-04T01:40:11.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.054+0000 7fa762b39640 1 -- 172.21.15.77:0/1263679950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa75c0cda30 msgr2=0x7fa75c0c8eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.054+0000 7fa762b39640 1 --2- 172.21.15.77:0/1263679950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa75c0cda30 0x7fa75c0c8eb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa74c00c450 tx=0x7fa74c00c910 comp rx=0 tx=0).stop 2023-11-04T01:40:11.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.054+0000 7fa762b39640 1 -- 172.21.15.77:0/1263679950 shutdown_connections 2023-11-04T01:40:11.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.054+0000 7fa762b39640 1 --2- 172.21.15.77:0/1263679950 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa74806ae70 0x7fa74806d330 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.054+0000 7fa762b39640 1 --2- 172.21.15.77:0/1263679950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa75c15bfb0 0x7fa75c0ca5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.054+0000 7fa762b39640 1 --2- 172.21.15.77:0/1263679950 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa75c15ae40 0x7fa75c0c5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.054+0000 7fa762b39640 1 --2- 172.21.15.77:0/1263679950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa75c0cda30 0x7fa75c0c8eb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.054+0000 7fa762b39640 1 -- 172.21.15.77:0/1263679950 >> 172.21.15.77:0/1263679950 conn(0x7fa75c06ea90 msgr2=0x7fa75c0b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:11.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.054+0000 7fa762b39640 1 -- 172.21.15.77:0/1263679950 shutdown_connections 2023-11-04T01:40:11.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.054+0000 7fa762b39640 1 -- 172.21.15.77:0/1263679950 wait complete. 2023-11-04T01:40:11.067 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:11.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.164+0000 7f1fed7d5640 1 Processor -- start 2023-11-04T01:40:11.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.164+0000 7f1fed7d5640 1 -- start start 2023-11-04T01:40:11.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.165+0000 7f1fed7d5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1fe815ac70 0x7f1fe80d0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.165+0000 7f1fed7d5640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1fe80b2d10 0x7f1fe80b4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.165+0000 7f1fed7d5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fe80b3c10 con 0x7f1fe80cec10 2023-11-04T01:40:11.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.165+0000 7f1fed7d5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe80cf180 con 0x7f1fe815ac70 2023-11-04T01:40:11.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.165+0000 7f1fed7d5640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe80cf460 con 0x7f1fe80b2d10 2023-11-04T01:40:11.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.165+0000 7f1fe6ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1fe815ac70 0x7f1fe80d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.165+0000 7f1fe67fc640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f1fe80cec10 0x7f1fe80b2600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:51996/0 (socket says 172.21.15.77:51996) 2023-11-04T01:40:11.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.165+0000 7f1fe67fc640 1 -- 172.21.15.77:0/1559370811 learned_addr learned my addr 172.21.15.77:0/1559370811 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:11.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.166+0000 7f1fe6ffd640 1 -- 172.21.15.77:0/1559370811 >> v2:172.21.15.122:3300/0 conn(0x7f1fe80b2d10 msgr2=0x7f1fe80b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:11.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.166+0000 7f1fe6ffd640 1 --2- 172.21.15.77:0/1559370811 >> v2:172.21.15.122:3300/0 conn(0x7f1fe80b2d10 0x7f1fe80b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.166+0000 7f1fe6ffd640 1 -- 172.21.15.77:0/1559370811 >> v1:172.21.15.77:6789/0 conn(0x7f1fe80cec10 legacy=0x7f1fe80b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.166+0000 7f1fe6ffd640 1 -- 172.21.15.77:0/1559370811 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe80cf740 con 0x7f1fe815ac70 2023-11-04T01:40:11.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.166+0000 7f1fe5ffb640 1 -- 172.21.15.77:0/1559370811 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1474688691 0 0) 0x7f1fe80b3c10 con 0x7f1fe80cec10 2023-11-04T01:40:11.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.166+0000 7f1fe6ffd640 1 --2- 172.21.15.77:0/1559370811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1fe815ac70 0x7f1fe80d0330 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1fe806e550 tx=0x7f1fd802bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4601675ef483a08 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:11.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.166+0000 7f1fe5ffb640 1 -- 172.21.15.77:0/1559370811 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd802ccb0 con 0x7f1fe815ac70 2023-11-04T01:40:11.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.167+0000 7f1fe5ffb640 1 -- 172.21.15.77:0/1559370811 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd802ce10 con 0x7f1fe815ac70 2023-11-04T01:40:11.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.167+0000 7f1fe5ffb640 1 -- 172.21.15.77:0/1559370811 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8034660 con 0x7f1fe815ac70 2023-11-04T01:40:11.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.167+0000 7f1fed7d5640 1 -- 172.21.15.77:0/1559370811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1fe815ac70 msgr2=0x7f1fe80d0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.167+0000 7f1fed7d5640 1 --2- 172.21.15.77:0/1559370811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1fe815ac70 0x7f1fe80d0330 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1fe806e550 tx=0x7f1fd802bf00 comp rx=0 tx=0).stop 2023-11-04T01:40:11.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.167+0000 7f1fed7d5640 1 -- 172.21.15.77:0/1559370811 shutdown_connections 2023-11-04T01:40:11.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.167+0000 7f1fed7d5640 1 --2- 172.21.15.77:0/1559370811 >> v2:172.21.15.122:3300/0 conn(0x7f1fe80b2d10 0x7f1fe80b4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.167+0000 7f1fed7d5640 1 --2- 172.21.15.77:0/1559370811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1fe815ac70 0x7f1fe80d0330 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.167+0000 7f1fed7d5640 1 -- 172.21.15.77:0/1559370811 >> 172.21.15.77:0/1559370811 conn(0x7f1fe80cd600 msgr2=0x7f1fe80cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:11.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.167+0000 7f1fed7d5640 1 -- 172.21.15.77:0/1559370811 shutdown_connections 2023-11-04T01:40:11.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.167+0000 7f1fed7d5640 1 -- 172.21.15.77:0/1559370811 wait complete. 2023-11-04T01:40:11.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.168+0000 7f1fed7d5640 1 Processor -- start 2023-11-04T01:40:11.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.168+0000 7f1fed7d5640 1 -- start start 2023-11-04T01:40:11.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.169+0000 7f1fed7d5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1fe80b2d10 0x7f1fe815cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.169+0000 7f1fed7d5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1fe80cec10 0x7f1fe8155180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.169+0000 7f1fed7d5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1fe815ac70 0x7f1fe8150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.169+0000 7f1fed7d5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe81556c0 con 0x7f1fe80b2d10 2023-11-04T01:40:11.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.169+0000 7f1fed7d5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe8155960 con 0x7f1fe815ac70 2023-11-04T01:40:11.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.169+0000 7f1fed7d5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe8155c40 con 0x7f1fe80cec10 2023-11-04T01:40:11.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.169+0000 7f1fe6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1fe80b2d10 0x7f1fe815cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.169+0000 7f1fe6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1fe80b2d10 0x7f1fe815cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45934/0 (socket says 172.21.15.77:45934) 2023-11-04T01:40:11.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.169+0000 7f1fe6ffd640 1 -- 172.21.15.77:0/3293280705 learned_addr learned my addr 172.21.15.77:0/3293280705 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:11.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.169+0000 7f1fe77fe640 1 --2- 172.21.15.77:0/3293280705 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1fe815ac70 0x7f1fe8150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.169+0000 7f1fe67fc640 1 --2- 172.21.15.77:0/3293280705 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1fe80cec10 0x7f1fe8155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.169+0000 7f1fe6ffd640 1 -- 172.21.15.77:0/3293280705 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1fe80cec10 msgr2=0x7f1fe8155180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.169+0000 7f1fe6ffd640 1 --2- 172.21.15.77:0/3293280705 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1fe80cec10 0x7f1fe8155180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.169+0000 7f1fe6ffd640 1 -- 172.21.15.77:0/3293280705 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1fe815ac70 msgr2=0x7f1fe8150ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.169+0000 7f1fe6ffd640 1 --2- 172.21.15.77:0/3293280705 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1fe815ac70 0x7f1fe8150ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.169+0000 7f1fe6ffd640 1 -- 172.21.15.77:0/3293280705 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd8009a70 con 0x7f1fe80b2d10 2023-11-04T01:40:11.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.170+0000 7f1fe6ffd640 1 --2- 172.21.15.77:0/3293280705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1fe80b2d10 0x7f1fe815cf70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8037040 tx=0x7f1fd8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:11.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.170+0000 7f1fcf7fe640 1 -- 172.21.15.77:0/3293280705 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd803e610 con 0x7f1fe80b2d10 2023-11-04T01:40:11.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.170+0000 7f1fcf7fe640 1 -- 172.21.15.77:0/3293280705 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd803e770 con 0x7f1fe80b2d10 2023-11-04T01:40:11.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.170+0000 7f1fcf7fe640 1 -- 172.21.15.77:0/3293280705 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd803eb20 con 0x7f1fe80b2d10 2023-11-04T01:40:11.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.170+0000 7f1fed7d5640 1 -- 172.21.15.77:0/3293280705 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe8155f20 con 0x7f1fe80b2d10 2023-11-04T01:40:11.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.170+0000 7f1fed7d5640 1 -- 172.21.15.77:0/3293280705 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe81564e0 con 0x7f1fe80b2d10 2023-11-04T01:40:11.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.171+0000 7f1fed7d5640 1 -- 172.21.15.77:0/3293280705 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fe80d07f0 con 0x7f1fe80b2d10 2023-11-04T01:40:11.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.171+0000 7f1fcf7fe640 1 -- 172.21.15.77:0/3293280705 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1fd803b050 con 0x7f1fe80b2d10 2023-11-04T01:40:11.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.172+0000 7f1fcf7fe640 1 --2- 172.21.15.77:0/3293280705 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1fd406aea0 0x7f1fd406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.172+0000 7f1fcf7fe640 1 -- 172.21.15.77:0/3293280705 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1fd80ac0f0 con 0x7f1fe80b2d10 2023-11-04T01:40:11.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.172+0000 7f1fe67fc640 1 --2- 172.21.15.77:0/3293280705 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1fd406aea0 0x7f1fd406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.172+0000 7f1fe67fc640 1 --2- 172.21.15.77:0/3293280705 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1fd406aea0 0x7f1fd406d360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1fe815e2e0 tx=0x7f1fdc009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:11.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.176+0000 7f1fcf7fe640 1 -- 172.21.15.77:0/3293280705 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1fd8076e20 con 0x7f1fe80b2d10 2023-11-04T01:40:11.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.345+0000 7f1fed7d5640 1 -- 172.21.15.77:0/3293280705 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1fe80b6b00 con 0x7f1fe80b2d10 2023-11-04T01:40:11.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.347+0000 7f1fcf7fe640 1 -- 172.21.15.77:0/3293280705 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f1fd8039090 con 0x7f1fe80b2d10 2023-11-04T01:40:11.350 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:11.350 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":24,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:40:10.153949+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:40:02.810971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:40:04.003979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:40:07.734355+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:11.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.348+0000 7f1fed7d5640 1 -- 172.21.15.77:0/3293280705 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1fd406aea0 msgr2=0x7f1fd406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.348+0000 7f1fed7d5640 1 --2- 172.21.15.77:0/3293280705 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1fd406aea0 0x7f1fd406d360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1fe815e2e0 tx=0x7f1fdc009040 comp rx=0 tx=0).stop 2023-11-04T01:40:11.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.348+0000 7f1fed7d5640 1 -- 172.21.15.77:0/3293280705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1fe80b2d10 msgr2=0x7f1fe815cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.348+0000 7f1fed7d5640 1 --2- 172.21.15.77:0/3293280705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1fe80b2d10 0x7f1fe815cf70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8037040 tx=0x7f1fd8004a40 comp rx=0 tx=0).stop 2023-11-04T01:40:11.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.348+0000 7f1fed7d5640 1 -- 172.21.15.77:0/3293280705 shutdown_connections 2023-11-04T01:40:11.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.348+0000 7f1fed7d5640 1 --2- 172.21.15.77:0/3293280705 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1fd406aea0 0x7f1fd406d360 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.348+0000 7f1fed7d5640 1 --2- 172.21.15.77:0/3293280705 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1fe815ac70 0x7f1fe8150ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.348+0000 7f1fed7d5640 1 --2- 172.21.15.77:0/3293280705 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1fe80cec10 0x7f1fe8155180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.348+0000 7f1fed7d5640 1 --2- 172.21.15.77:0/3293280705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1fe80b2d10 0x7f1fe815cf70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.348+0000 7f1fed7d5640 1 -- 172.21.15.77:0/3293280705 >> 172.21.15.77:0/3293280705 conn(0x7f1fe80cd600 msgr2=0x7f1fe80cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:11.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.349+0000 7f1fed7d5640 1 -- 172.21.15.77:0/3293280705 shutdown_connections 2023-11-04T01:40:11.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.349+0000 7f1fed7d5640 1 -- 172.21.15.77:0/3293280705 wait complete. 2023-11-04T01:40:11.362 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:11.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.459+0000 7f48fb924640 1 Processor -- start 2023-11-04T01:40:11.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.459+0000 7f48fb924640 1 -- start start 2023-11-04T01:40:11.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.460+0000 7f48fb924640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f48f40cde60 0x7f48f415d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.460+0000 7f48fb924640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48f415e000 con 0x7f48f415daa0 2023-11-04T01:40:11.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.460+0000 7f48fb924640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48f415e2e0 con 0x7f48f40ce240 2023-11-04T01:40:11.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.460+0000 7f48fb924640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48f415e5c0 con 0x7f48f40cde60 2023-11-04T01:40:11.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.460+0000 7f48f8ebf640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f48f415daa0 0x7f48f4157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52002/0 (socket says 172.21.15.77:52002) 2023-11-04T01:40:11.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.460+0000 7f48f8ebf640 1 -- 172.21.15.77:0/3153383988 learned_addr learned my addr 172.21.15.77:0/3153383988 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:11.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.460+0000 7f48f96c0640 1 --2- 172.21.15.77:0/3153383988 >> v2:172.21.15.122:3300/0 conn(0x7f48f40cde60 0x7f48f415d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.460+0000 7f48f3fff640 1 -- 172.21.15.77:0/3153383988 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 521348262 0 0) 0x7f48f415e000 con 0x7f48f415daa0 2023-11-04T01:40:11.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.460+0000 7f48f3fff640 1 -- 172.21.15.77:0/3153383988 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48dc003520 con 0x7f48f415daa0 2023-11-04T01:40:11.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.460+0000 7f48f3fff640 1 -- 172.21.15.77:0/3153383988 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2626415055 0 0) 0x7f48dc003520 con 0x7f48f415daa0 2023-11-04T01:40:11.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.460+0000 7f48f3fff640 1 -- 172.21.15.77:0/3153383988 >> v2:172.21.15.122:3300/0 conn(0x7f48f40cde60 msgr2=0x7f48f415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:11.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.460+0000 7f48f3fff640 1 --2- 172.21.15.77:0/3153383988 >> v2:172.21.15.122:3300/0 conn(0x7f48f40cde60 0x7f48f415d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.460+0000 7f48f3fff640 1 -- 172.21.15.77:0/3153383988 >> v1:172.21.15.122:6789/0 conn(0x7f48f40ce240 legacy=0x7f48f40d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.460+0000 7f48f3fff640 1 -- 172.21.15.77:0/3153383988 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f40d1120 con 0x7f48f415daa0 2023-11-04T01:40:11.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.460+0000 7f48f3fff640 1 -- 172.21.15.77:0/3153383988 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f48e8001670 con 0x7f48f415daa0 2023-11-04T01:40:11.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.460+0000 7f48f3fff640 1 -- 172.21.15.77:0/3153383988 >> v1:172.21.15.77:6789/0 conn(0x7f48f415daa0 legacy=0x7f48f4157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.460+0000 7f48f3fff640 1 --2- 172.21.15.77:0/3153383988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48dc003970 0x7f48dc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.460+0000 7f48f3fff640 1 --2- 172.21.15.77:0/3153383988 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48dc0047c0 0x7f48dc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.460+0000 7f48f3fff640 1 --2- 172.21.15.77:0/3153383988 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f48dc005180 0x7f48dc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.460+0000 7f48f3fff640 1 -- 172.21.15.77:0/3153383988 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f415e5c0 con 0x7f48dc003970 2023-11-04T01:40:11.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.460+0000 7f48f3fff640 1 -- 172.21.15.77:0/3153383988 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc00c020 con 0x7f48dc0047c0 2023-11-04T01:40:11.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.460+0000 7f48f3fff640 1 -- 172.21.15.77:0/3153383988 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc00c1e0 con 0x7f48dc005180 2023-11-04T01:40:11.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.460+0000 7f48f96c0640 1 --2- 172.21.15.77:0/3153383988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48dc003970 0x7f48dc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.460+0000 7f48f8ebf640 1 --2- 172.21.15.77:0/3153383988 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48dc0047c0 0x7f48dc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.461+0000 7f48f9ec1640 1 --2- 172.21.15.77:0/3153383988 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f48dc005180 0x7f48dc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.461+0000 7f48f96c0640 1 -- 172.21.15.77:0/3153383988 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f48dc005180 msgr2=0x7f48dc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:11.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.461+0000 7f48f96c0640 1 --2- 172.21.15.77:0/3153383988 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f48dc005180 0x7f48dc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.461+0000 7f48f96c0640 1 -- 172.21.15.77:0/3153383988 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48dc0047c0 msgr2=0x7f48dc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:11.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.461+0000 7f48f96c0640 1 --2- 172.21.15.77:0/3153383988 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48dc0047c0 0x7f48dc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.461+0000 7f48f96c0640 1 -- 172.21.15.77:0/3153383988 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48dc003520 con 0x7f48dc003970 2023-11-04T01:40:11.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.461+0000 7f48f9ec1640 1 -- 172.21.15.77:0/3153383988 reap_dead start 2023-11-04T01:40:11.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.461+0000 7f48f96c0640 1 --2- 172.21.15.77:0/3153383988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48dc003970 0x7f48dc003d90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f48ec009fc0 tx=0x7f48dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f3fa9c1bc45ca32 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:11.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.461+0000 7f48f3fff640 1 -- 172.21.15.77:0/3153383988 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ec02cc20 con 0x7f48dc003970 2023-11-04T01:40:11.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.461+0000 7f48f3fff640 1 -- 172.21.15.77:0/3153383988 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ec00f040 con 0x7f48dc003970 2023-11-04T01:40:11.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.461+0000 7f48f3fff640 1 -- 172.21.15.77:0/3153383988 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ec034440 con 0x7f48dc003970 2023-11-04T01:40:11.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.462+0000 7f48fb924640 1 -- 172.21.15.77:0/3153383988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48dc003970 msgr2=0x7f48dc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.462+0000 7f48fb924640 1 --2- 172.21.15.77:0/3153383988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48dc003970 0x7f48dc003d90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f48ec009fc0 tx=0x7f48dc0057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.462+0000 7f48fb924640 1 -- 172.21.15.77:0/3153383988 shutdown_connections 2023-11-04T01:40:11.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.462+0000 7f48fb924640 1 --2- 172.21.15.77:0/3153383988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48dc003970 0x7f48dc003d90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.462+0000 7f48fb924640 1 -- 172.21.15.77:0/3153383988 >> 172.21.15.77:0/3153383988 conn(0x7f48f4071f30 msgr2=0x7f48f40cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:11.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.462+0000 7f48fb924640 1 -- 172.21.15.77:0/3153383988 shutdown_connections 2023-11-04T01:40:11.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.462+0000 7f48fb924640 1 -- 172.21.15.77:0/3153383988 wait complete. 2023-11-04T01:40:11.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.463+0000 7f48fb924640 1 Processor -- start 2023-11-04T01:40:11.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.463+0000 7f48fb924640 1 -- start start 2023-11-04T01:40:11.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.464+0000 7f48fb924640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48dc003970 0x7f48f41f2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.464+0000 7f48fb924640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f48f40b8530 0x7f48f4159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.464+0000 7f48fb924640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48f41523b0 0x7f48f4157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.464+0000 7f48fb924640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f41f45c0 con 0x7f48dc003970 2023-11-04T01:40:11.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.464+0000 7f48fb924640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f41f39b0 con 0x7f48f41523b0 2023-11-04T01:40:11.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.464+0000 7f48fb924640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f41f3c90 con 0x7f48f40b8530 2023-11-04T01:40:11.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.464+0000 7f48f96c0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48dc003970 0x7f48f41f2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.464+0000 7f48f96c0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48dc003970 0x7f48f41f2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45960/0 (socket says 172.21.15.77:45960) 2023-11-04T01:40:11.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.464+0000 7f48f96c0640 1 -- 172.21.15.77:0/2555795296 learned_addr learned my addr 172.21.15.77:0/2555795296 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:11.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.464+0000 7f48f9ec1640 1 --2- 172.21.15.77:0/2555795296 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48f41523b0 0x7f48f4157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.464+0000 7f48f8ebf640 1 --2- 172.21.15.77:0/2555795296 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f48f40b8530 0x7f48f4159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.464+0000 7f48f96c0640 1 -- 172.21.15.77:0/2555795296 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f48f40b8530 msgr2=0x7f48f4159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.464+0000 7f48f96c0640 1 --2- 172.21.15.77:0/2555795296 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f48f40b8530 0x7f48f4159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.464+0000 7f48f96c0640 1 -- 172.21.15.77:0/2555795296 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48f41523b0 msgr2=0x7f48f4157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.464+0000 7f48f96c0640 1 --2- 172.21.15.77:0/2555795296 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48f41523b0 0x7f48f4157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.464+0000 7f48f96c0640 1 -- 172.21.15.77:0/2555795296 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f41f3f70 con 0x7f48dc003970 2023-11-04T01:40:11.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.464+0000 7f48f96c0640 1 --2- 172.21.15.77:0/2555795296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48dc003970 0x7f48f41f2470 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f48ec00e230 tx=0x7f48ec009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:11.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.464+0000 7f48f1ffb640 1 -- 172.21.15.77:0/2555795296 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ec02ce80 con 0x7f48dc003970 2023-11-04T01:40:11.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.465+0000 7f48f1ffb640 1 -- 172.21.15.77:0/2555795296 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ec034c50 con 0x7f48dc003970 2023-11-04T01:40:11.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.465+0000 7f48fb924640 1 -- 172.21.15.77:0/2555795296 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f41f4250 con 0x7f48dc003970 2023-11-04T01:40:11.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.465+0000 7f48f1ffb640 1 -- 172.21.15.77:0/2555795296 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ec003990 con 0x7f48dc003970 2023-11-04T01:40:11.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.465+0000 7f48fb924640 1 -- 172.21.15.77:0/2555795296 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f41f35b0 con 0x7f48dc003970 2023-11-04T01:40:11.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.466+0000 7f48fb924640 1 -- 172.21.15.77:0/2555795296 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48f41f43e0 con 0x7f48dc003970 2023-11-04T01:40:11.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.466+0000 7f48f1ffb640 1 -- 172.21.15.77:0/2555795296 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f48ec040450 con 0x7f48dc003970 2023-11-04T01:40:11.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.467+0000 7f48f1ffb640 1 --2- 172.21.15.77:0/2555795296 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f48e006aea0 0x7f48e006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.467+0000 7f48f1ffb640 1 -- 172.21.15.77:0/2555795296 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f48ec0abee0 con 0x7f48dc003970 2023-11-04T01:40:11.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.467+0000 7f48f8ebf640 1 --2- 172.21.15.77:0/2555795296 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f48e006aea0 0x7f48e006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.467+0000 7f48f8ebf640 1 --2- 172.21.15.77:0/2555795296 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f48e006aea0 0x7f48e006d360 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f48f40c7010 tx=0x7f48e8001c00 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:11.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.471+0000 7f48f1ffb640 1 -- 172.21.15.77:0/2555795296 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f48ec076f00 con 0x7f48dc003970 2023-11-04T01:40:11.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.638+0000 7f48fb924640 1 -- 172.21.15.77:0/2555795296 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48f4074290 con 0x7f48dc003970 2023-11-04T01:40:11.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.639+0000 7f48f1ffb640 1 -- 172.21.15.77:0/2555795296 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f48ec07a520 con 0x7f48dc003970 2023-11-04T01:40:11.642 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:11.642 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":24,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:40:10.153949+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:40:02.810971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:40:04.003979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:40:07.734355+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:11.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.641+0000 7f48fb924640 1 -- 172.21.15.77:0/2555795296 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f48e006aea0 msgr2=0x7f48e006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.641+0000 7f48fb924640 1 --2- 172.21.15.77:0/2555795296 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f48e006aea0 0x7f48e006d360 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f48f40c7010 tx=0x7f48e8001c00 comp rx=0 tx=0).stop 2023-11-04T01:40:11.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.641+0000 7f48fb924640 1 -- 172.21.15.77:0/2555795296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48dc003970 msgr2=0x7f48f41f2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.641+0000 7f48fb924640 1 --2- 172.21.15.77:0/2555795296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48dc003970 0x7f48f41f2470 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f48ec00e230 tx=0x7f48ec009750 comp rx=0 tx=0).stop 2023-11-04T01:40:11.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.641+0000 7f48fb924640 1 -- 172.21.15.77:0/2555795296 shutdown_connections 2023-11-04T01:40:11.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.641+0000 7f48fb924640 1 --2- 172.21.15.77:0/2555795296 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f48e006aea0 0x7f48e006d360 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.641+0000 7f48fb924640 1 --2- 172.21.15.77:0/2555795296 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48f41523b0 0x7f48f4157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.641+0000 7f48fb924640 1 --2- 172.21.15.77:0/2555795296 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f48f40b8530 0x7f48f4159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.641+0000 7f48fb924640 1 --2- 172.21.15.77:0/2555795296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48dc003970 0x7f48f41f2470 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.641+0000 7f48fb924640 1 -- 172.21.15.77:0/2555795296 >> 172.21.15.77:0/2555795296 conn(0x7f48f4071f30 msgr2=0x7f48f40c7110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:11.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.641+0000 7f48fb924640 1 -- 172.21.15.77:0/2555795296 shutdown_connections 2023-11-04T01:40:11.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.641+0000 7f48fb924640 1 -- 172.21.15.77:0/2555795296 wait complete. 2023-11-04T01:40:11.669 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:11.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.767+0000 7f5729997640 1 Processor -- start 2023-11-04T01:40:11.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.768+0000 7f5729997640 1 -- start start 2023-11-04T01:40:11.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.768+0000 7f5729997640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f57240cce10 0x7f57240b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.768+0000 7f5729997640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f57240b18b0 0x7f572415e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.768+0000 7f5729997640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f572406a120 0x7f572406a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.768+0000 7f5729997640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f572406ab10 con 0x7f57240b18b0 2023-11-04T01:40:11.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.768+0000 7f5729997640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f572415e6e0 con 0x7f57240cce10 2023-11-04T01:40:11.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.768+0000 7f5729997640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572415dd10 con 0x7f572406a120 2023-11-04T01:40:11.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.768+0000 7f571bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f57240b18b0 0x7f572415e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.769+0000 7f571bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f57240b18b0 0x7f572415e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45974/0 (socket says 172.21.15.77:45974) 2023-11-04T01:40:11.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.769+0000 7f57237fe640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f572406a120 0x7f572406a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.769+0000 7f571bfff640 1 -- 172.21.15.77:0/2490150917 learned_addr learned my addr 172.21.15.77:0/2490150917 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:11.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.769+0000 7f5722ffd640 1 --2- 172.21.15.77:0/2490150917 >> v2:172.21.15.122:3300/0 conn(0x7f57240cce10 0x7f57240b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.769+0000 7f571bfff640 1 -- 172.21.15.77:0/2490150917 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f572406a120 msgr2=0x7f572406a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:11.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.769+0000 7f571bfff640 1 --2- 172.21.15.77:0/2490150917 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f572406a120 0x7f572406a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.769+0000 7f571bfff640 1 -- 172.21.15.77:0/2490150917 >> v2:172.21.15.122:3300/0 conn(0x7f57240cce10 msgr2=0x7f57240b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:11.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.769+0000 7f571bfff640 1 --2- 172.21.15.77:0/2490150917 >> v2:172.21.15.122:3300/0 conn(0x7f57240cce10 0x7f57240b1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.769+0000 7f571bfff640 1 -- 172.21.15.77:0/2490150917 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572415d720 con 0x7f57240b18b0 2023-11-04T01:40:11.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.770+0000 7f571bfff640 1 --2- 172.21.15.77:0/2490150917 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57240b18b0 0x7f572415e1a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f57240d0ad0 tx=0x7f570c02b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d422b26b1378911 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:11.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.770+0000 7f57227fc640 1 -- 172.21.15.77:0/2490150917 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c031740 con 0x7f57240b18b0 2023-11-04T01:40:11.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.770+0000 7f57227fc640 1 -- 172.21.15.77:0/2490150917 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f570c0318a0 con 0x7f57240b18b0 2023-11-04T01:40:11.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.770+0000 7f57227fc640 1 -- 172.21.15.77:0/2490150917 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c031c30 con 0x7f57240b18b0 2023-11-04T01:40:11.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.770+0000 7f5729997640 1 -- 172.21.15.77:0/2490150917 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57240b18b0 msgr2=0x7f572415e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.770+0000 7f5729997640 1 --2- 172.21.15.77:0/2490150917 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57240b18b0 0x7f572415e1a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f57240d0ad0 tx=0x7f570c02b7e0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.770+0000 7f5729997640 1 -- 172.21.15.77:0/2490150917 shutdown_connections 2023-11-04T01:40:11.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.770+0000 7f5729997640 1 --2- 172.21.15.77:0/2490150917 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f572406a120 0x7f572406a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.770+0000 7f5729997640 1 --2- 172.21.15.77:0/2490150917 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57240b18b0 0x7f572415e1a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.770+0000 7f5729997640 1 --2- 172.21.15.77:0/2490150917 >> v2:172.21.15.122:3300/0 conn(0x7f57240cce10 0x7f57240b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.770+0000 7f5729997640 1 -- 172.21.15.77:0/2490150917 >> 172.21.15.77:0/2490150917 conn(0x7f572406d8b0 msgr2=0x7f572406dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:11.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.770+0000 7f5729997640 1 -- 172.21.15.77:0/2490150917 shutdown_connections 2023-11-04T01:40:11.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.770+0000 7f5729997640 1 -- 172.21.15.77:0/2490150917 wait complete. 2023-11-04T01:40:11.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.771+0000 7f5729997640 1 Processor -- start 2023-11-04T01:40:11.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.772+0000 7f5729997640 1 -- start start 2023-11-04T01:40:11.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.772+0000 7f5729997640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f572406a120 0x7f572414f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.772+0000 7f5729997640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f57240b18b0 0x7f57240c34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.772+0000 7f5729997640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57240cce10 0x7f57241f2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.772+0000 7f5729997640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57240c4690 con 0x7f57240cce10 2023-11-04T01:40:11.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.772+0000 7f5729997640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57240c3df0 con 0x7f572406a120 2023-11-04T01:40:11.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.772+0000 7f5729997640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57240c40d0 con 0x7f57240b18b0 2023-11-04T01:40:11.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.772+0000 7f57237fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57240cce10 0x7f57241f2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.772+0000 7f57237fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57240cce10 0x7f57241f2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45984/0 (socket says 172.21.15.77:45984) 2023-11-04T01:40:11.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.772+0000 7f57237fe640 1 -- 172.21.15.77:0/3526992581 learned_addr learned my addr 172.21.15.77:0/3526992581 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:11.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.773+0000 7f57237fe640 1 -- 172.21.15.77:0/3526992581 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f57240b18b0 msgr2=0x7f57240c34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.773+0000 7f571bfff640 1 --2- 172.21.15.77:0/3526992581 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f57240b18b0 0x7f57240c34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.773+0000 7f57237fe640 1 --2- 172.21.15.77:0/3526992581 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f57240b18b0 0x7f57240c34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.773+0000 7f57237fe640 1 -- 172.21.15.77:0/3526992581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f572406a120 msgr2=0x7f572414f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.773+0000 7f5722ffd640 1 --2- 172.21.15.77:0/3526992581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f572406a120 0x7f572414f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.773+0000 7f57237fe640 1 --2- 172.21.15.77:0/3526992581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f572406a120 0x7f572414f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.773+0000 7f57237fe640 1 -- 172.21.15.77:0/3526992581 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f570c0094d0 con 0x7f57240cce10 2023-11-04T01:40:11.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.773+0000 7f5722ffd640 1 --2- 172.21.15.77:0/3526992581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f572406a120 0x7f572414f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:11.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.773+0000 7f57237fe640 1 --2- 172.21.15.77:0/3526992581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57240cce10 0x7f57241f2020 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f571c00eed0 tx=0x7f571c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:11.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.773+0000 7f5720ff9640 1 -- 172.21.15.77:0/3526992581 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c010040 con 0x7f57240cce10 2023-11-04T01:40:11.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.773+0000 7f5720ff9640 1 -- 172.21.15.77:0/3526992581 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571c00bd20 con 0x7f57240cce10 2023-11-04T01:40:11.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.773+0000 7f5729997640 1 -- 172.21.15.77:0/3526992581 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57240c43b0 con 0x7f57240cce10 2023-11-04T01:40:11.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.773+0000 7f5720ff9640 1 -- 172.21.15.77:0/3526992581 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c014640 con 0x7f57240cce10 2023-11-04T01:40:11.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.773+0000 7f5729997640 1 -- 172.21.15.77:0/3526992581 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57240c3a30 con 0x7f57240cce10 2023-11-04T01:40:11.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.774+0000 7f5729997640 1 -- 172.21.15.77:0/3526992581 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57240674e0 con 0x7f57240cce10 2023-11-04T01:40:11.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.774+0000 7f5720ff9640 1 -- 172.21.15.77:0/3526992581 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f571c0147a0 con 0x7f57240cce10 2023-11-04T01:40:11.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.775+0000 7f5720ff9640 1 --2- 172.21.15.77:0/3526992581 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f570406ae70 0x7f570406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:11.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.775+0000 7f5720ff9640 1 -- 172.21.15.77:0/3526992581 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f571c089f90 con 0x7f57240cce10 2023-11-04T01:40:11.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.775+0000 7f5722ffd640 1 --2- 172.21.15.77:0/3526992581 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f570406ae70 0x7f570406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:11.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.775+0000 7f5722ffd640 1 --2- 172.21.15.77:0/3526992581 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f570406ae70 0x7f570406d330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5714009ac0 tx=0x7f5714008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:11.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.780+0000 7f5720ff9640 1 -- 172.21.15.77:0/3526992581 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f571c0bcca0 con 0x7f57240cce10 2023-11-04T01:40:11.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.978+0000 7f5729997640 1 -- 172.21.15.77:0/3526992581 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57240b59a0 con 0x7f57240cce10 2023-11-04T01:40:11.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.979+0000 7f5720ff9640 1 -- 172.21.15.77:0/3526992581 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f571c018020 con 0x7f57240cce10 2023-11-04T01:40:11.983 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:11.983 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/2867268857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2867268857},{"type":"v1","addr":"172.21.15.77:6834","nonce":2867268857}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2709973073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2709973073},{"type":"v1","addr":"172.21.15.77:6835","nonce":2709973073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/396299424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":396299424},{"type":"v1","addr":"172.21.15.122:6837","nonce":396299424}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:40:05.031856+0000","modified":"2023-11-04T01:40:10.154106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34166},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34166":{"gid":34166,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6836/2444318089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2444318089},{"type":"v1","addr":"172.21.15.122:6836","nonce":2444318089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-11-04T01:40:11.984 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 7 2023-11-04T01:40:11.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.981+0000 7f5729997640 1 -- 172.21.15.77:0/3526992581 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f570406ae70 msgr2=0x7f570406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.981+0000 7f5729997640 1 --2- 172.21.15.77:0/3526992581 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f570406ae70 0x7f570406d330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5714009ac0 tx=0x7f5714008040 comp rx=0 tx=0).stop 2023-11-04T01:40:11.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.981+0000 7f5729997640 1 -- 172.21.15.77:0/3526992581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57240cce10 msgr2=0x7f57241f2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:11.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.981+0000 7f5729997640 1 --2- 172.21.15.77:0/3526992581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57240cce10 0x7f57241f2020 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f571c00eed0 tx=0x7f571c00b480 comp rx=0 tx=0).stop 2023-11-04T01:40:11.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.981+0000 7f5729997640 1 -- 172.21.15.77:0/3526992581 shutdown_connections 2023-11-04T01:40:11.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.981+0000 7f5729997640 1 --2- 172.21.15.77:0/3526992581 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f570406ae70 0x7f570406d330 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.981+0000 7f5729997640 1 --2- 172.21.15.77:0/3526992581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57240cce10 0x7f57241f2020 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.981+0000 7f5729997640 1 --2- 172.21.15.77:0/3526992581 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f57240b18b0 0x7f57240c34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.981+0000 7f5729997640 1 --2- 172.21.15.77:0/3526992581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f572406a120 0x7f572414f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:11.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.981+0000 7f5729997640 1 -- 172.21.15.77:0/3526992581 >> 172.21.15.77:0/3526992581 conn(0x7f572406d8b0 msgr2=0x7f572415fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:11.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.981+0000 7f5729997640 1 -- 172.21.15.77:0/3526992581 shutdown_connections 2023-11-04T01:40:11.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:11.981+0000 7f5729997640 1 -- 172.21.15.77:0/3526992581 wait complete. 2023-11-04T01:40:11.994 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:12.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.091+0000 7fd8efd65640 1 Processor -- start 2023-11-04T01:40:12.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.091+0000 7fd8efd65640 1 -- start start 2023-11-04T01:40:12.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.091+0000 7fd8efd65640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd8e80cc430 0x7fd8e80cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.091+0000 7fd8efd65640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd8e80ce730 0x7fd8e80cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.092+0000 7fd8efd65640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8e80ccdb0 con 0x7fd8e8159da0 2023-11-04T01:40:12.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.092+0000 7fd8efd65640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8e80cd690 con 0x7fd8e80cc430 2023-11-04T01:40:12.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.092+0000 7fd8efd65640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e80cd970 con 0x7fd8e80ce730 2023-11-04T01:40:12.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.092+0000 7fd8ed300640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd8e80cc430 0x7fd8e80cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.092+0000 7fd8ed300640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd8e80cc430 0x7fd8e80cc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46000/0 (socket says 172.21.15.77:46000) 2023-11-04T01:40:12.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.092+0000 7fd8ed300640 1 -- 172.21.15.77:0/1174520064 learned_addr learned my addr 172.21.15.77:0/1174520064 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:12.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.092+0000 7fd8ed300640 1 -- 172.21.15.77:0/1174520064 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd8e80ce730 msgr2=0x7fd8e80cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:12.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.092+0000 7fd8ed300640 1 --2- 172.21.15.77:0/1174520064 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd8e80ce730 0x7fd8e80cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.092+0000 7fd8ed300640 1 -- 172.21.15.77:0/1174520064 >> v1:172.21.15.122:6789/0 conn(0x7fd8e8159da0 legacy=0x7fd8e80b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:12.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.092+0000 7fd8ed300640 1 -- 172.21.15.77:0/1174520064 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e80cdc50 con 0x7fd8e80cc430 2023-11-04T01:40:12.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.093+0000 7fd8ed300640 1 --2- 172.21.15.77:0/1174520064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8e80cc430 0x7fd8e80cc870 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4009870 tx=0x7fd8e402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d4d3a165d0eaa7d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:12.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.093+0000 7fd8ecaff640 1 -- 172.21.15.77:0/1174520064 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4031640 con 0x7fd8e80cc430 2023-11-04T01:40:12.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.093+0000 7fd8ecaff640 1 -- 172.21.15.77:0/1174520064 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e40317a0 con 0x7fd8e80cc430 2023-11-04T01:40:12.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.093+0000 7fd8ecaff640 1 -- 172.21.15.77:0/1174520064 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4031b30 con 0x7fd8e80cc430 2023-11-04T01:40:12.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.093+0000 7fd8efd65640 1 -- 172.21.15.77:0/1174520064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8e80cc430 msgr2=0x7fd8e80cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.093+0000 7fd8efd65640 1 --2- 172.21.15.77:0/1174520064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8e80cc430 0x7fd8e80cc870 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4009870 tx=0x7fd8e402b8f0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.093+0000 7fd8efd65640 1 -- 172.21.15.77:0/1174520064 shutdown_connections 2023-11-04T01:40:12.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.093+0000 7fd8efd65640 1 --2- 172.21.15.77:0/1174520064 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd8e80ce730 0x7fd8e80cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.093+0000 7fd8efd65640 1 --2- 172.21.15.77:0/1174520064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8e80cc430 0x7fd8e80cc870 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.093+0000 7fd8efd65640 1 -- 172.21.15.77:0/1174520064 >> 172.21.15.77:0/1174520064 conn(0x7fd8e806d8b0 msgr2=0x7fd8e806dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:12.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.093+0000 7fd8efd65640 1 -- 172.21.15.77:0/1174520064 shutdown_connections 2023-11-04T01:40:12.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.093+0000 7fd8efd65640 1 -- 172.21.15.77:0/1174520064 wait complete. 2023-11-04T01:40:12.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.094+0000 7fd8efd65640 1 Processor -- start 2023-11-04T01:40:12.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.095+0000 7fd8efd65640 1 -- start start 2023-11-04T01:40:12.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.095+0000 7fd8efd65640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd8e80cc430 0x7fd8e8149d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.095+0000 7fd8efd65640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8e80ce730 0x7fd8e815b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.095+0000 7fd8efd65640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd8e8159da0 0x7fd8e815b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.095+0000 7fd8efd65640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e814e020 con 0x7fd8e80ce730 2023-11-04T01:40:12.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.095+0000 7fd8efd65640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e814e2c0 con 0x7fd8e80cc430 2023-11-04T01:40:12.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.095+0000 7fd8efd65640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e814e5a0 con 0x7fd8e8159da0 2023-11-04T01:40:12.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.095+0000 7fd8ed300640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8e80ce730 0x7fd8e815b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.095+0000 7fd8ed300640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8e80ce730 0x7fd8e815b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46008/0 (socket says 172.21.15.77:46008) 2023-11-04T01:40:12.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.095+0000 7fd8ed300640 1 -- 172.21.15.77:0/3335051663 learned_addr learned my addr 172.21.15.77:0/3335051663 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:12.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.096+0000 7fd8edb01640 1 --2- 172.21.15.77:0/3335051663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd8e80cc430 0x7fd8e8149d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.096+0000 7fd8ed300640 1 -- 172.21.15.77:0/3335051663 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd8e8159da0 msgr2=0x7fd8e815b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.096+0000 7fd8ee302640 1 --2- 172.21.15.77:0/3335051663 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd8e8159da0 0x7fd8e815b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.096+0000 7fd8ed300640 1 --2- 172.21.15.77:0/3335051663 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd8e8159da0 0x7fd8e815b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.096+0000 7fd8ed300640 1 -- 172.21.15.77:0/3335051663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd8e80cc430 msgr2=0x7fd8e8149d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.096+0000 7fd8ed300640 1 --2- 172.21.15.77:0/3335051663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd8e80cc430 0x7fd8e8149d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.096+0000 7fd8ed300640 1 -- 172.21.15.77:0/3335051663 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e40094d0 con 0x7fd8e80ce730 2023-11-04T01:40:12.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.096+0000 7fd8edb01640 1 --2- 172.21.15.77:0/3335051663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd8e80cc430 0x7fd8e8149d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:12.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.096+0000 7fd8ed300640 1 --2- 172.21.15.77:0/3335051663 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8e80ce730 0x7fd8e815b300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4009870 tx=0x7fd8e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:12.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.096+0000 7fd8de7fc640 1 -- 172.21.15.77:0/3335051663 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e403ac60 con 0x7fd8e80ce730 2023-11-04T01:40:12.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.096+0000 7fd8de7fc640 1 -- 172.21.15.77:0/3335051663 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e403adc0 con 0x7fd8e80ce730 2023-11-04T01:40:12.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.096+0000 7fd8de7fc640 1 -- 172.21.15.77:0/3335051663 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4044630 con 0x7fd8e80ce730 2023-11-04T01:40:12.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.096+0000 7fd8efd65640 1 -- 172.21.15.77:0/3335051663 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e814e880 con 0x7fd8e80ce730 2023-11-04T01:40:12.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.096+0000 7fd8efd65640 1 -- 172.21.15.77:0/3335051663 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e814a270 con 0x7fd8e80ce730 2023-11-04T01:40:12.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.097+0000 7fd8efd65640 1 -- 172.21.15.77:0/3335051663 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8e814eda0 con 0x7fd8e80ce730 2023-11-04T01:40:12.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.097+0000 7fd8de7fc640 1 -- 172.21.15.77:0/3335051663 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd8e402f050 con 0x7fd8e80ce730 2023-11-04T01:40:12.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.098+0000 7fd8de7fc640 1 --2- 172.21.15.77:0/3335051663 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd8cc06ae70 0x7fd8cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.098+0000 7fd8de7fc640 1 -- 172.21.15.77:0/3335051663 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd8e40ab880 con 0x7fd8e80ce730 2023-11-04T01:40:12.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.098+0000 7fd8edb01640 1 --2- 172.21.15.77:0/3335051663 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd8cc06ae70 0x7fd8cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.098+0000 7fd8edb01640 1 --2- 172.21.15.77:0/3335051663 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd8cc06ae70 0x7fd8cc06d330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd8d800a810 tx=0x7fd8d8008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:12.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.102+0000 7fd8de7fc640 1 -- 172.21.15.77:0/3335051663 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd8e814eda0 con 0x7fd8e80ce730 2023-11-04T01:40:12.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.269+0000 7fd8efd65640 1 -- 172.21.15.77:0/3335051663 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8e814eda0 con 0x7fd8e80ce730 2023-11-04T01:40:12.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.270+0000 7fd8de7fc640 1 -- 172.21.15.77:0/3335051663 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18334 (secure 0 0 0) 0x7fd8e814eda0 con 0x7fd8e80ce730 2023-11-04T01:40:12.273 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:12.273 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":24,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:40:10.153949+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:40:02.810971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:40:04.003979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:40:07.734355+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:12.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.272+0000 7fd8efd65640 1 -- 172.21.15.77:0/3335051663 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd8cc06ae70 msgr2=0x7fd8cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.272+0000 7fd8efd65640 1 --2- 172.21.15.77:0/3335051663 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd8cc06ae70 0x7fd8cc06d330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd8d800a810 tx=0x7fd8d8008040 comp rx=0 tx=0).stop 2023-11-04T01:40:12.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.272+0000 7fd8efd65640 1 -- 172.21.15.77:0/3335051663 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8e80ce730 msgr2=0x7fd8e815b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.272+0000 7fd8efd65640 1 --2- 172.21.15.77:0/3335051663 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8e80ce730 0x7fd8e815b300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4009870 tx=0x7fd8e40046c0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.272+0000 7fd8efd65640 1 -- 172.21.15.77:0/3335051663 shutdown_connections 2023-11-04T01:40:12.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.272+0000 7fd8efd65640 1 --2- 172.21.15.77:0/3335051663 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd8cc06ae70 0x7fd8cc06d330 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.272+0000 7fd8efd65640 1 --2- 172.21.15.77:0/3335051663 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd8e8159da0 0x7fd8e815b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.272+0000 7fd8efd65640 1 --2- 172.21.15.77:0/3335051663 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8e80ce730 0x7fd8e815b300 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.272+0000 7fd8efd65640 1 --2- 172.21.15.77:0/3335051663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd8e80cc430 0x7fd8e8149d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.272+0000 7fd8efd65640 1 -- 172.21.15.77:0/3335051663 >> 172.21.15.77:0/3335051663 conn(0x7fd8e806d8b0 msgr2=0x7fd8e8159070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:12.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.272+0000 7fd8efd65640 1 -- 172.21.15.77:0/3335051663 shutdown_connections 2023-11-04T01:40:12.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.272+0000 7fd8efd65640 1 -- 172.21.15.77:0/3335051663 wait complete. 2023-11-04T01:40:12.690 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:40:05.031856+0000', 'modified': '2023-11-04T01:40:10.154106+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 34166}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_34166': {'gid': 34166, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.122:6836/2444318089', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6834', 'nonce': 2444318089}, {'type': 'v1', 'addr': '172.21.15.122:6836', 'nonce': 2444318089}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-11-04T01:40:12.690 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:40:12.691 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-04T01:40:12.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.793+0000 7fedbf8af640 1 Processor -- start 2023-11-04T01:40:12.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.793+0000 7fedbf8af640 1 -- start start 2023-11-04T01:40:12.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.793+0000 7fedbf8af640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fedb815ad30 0x7fedb80adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.794+0000 7fedbf8af640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb80c3900 con 0x7fedb80ad730 2023-11-04T01:40:12.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.794+0000 7fedbf8af640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb80c3be0 con 0x7fedb8070e20 2023-11-04T01:40:12.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.794+0000 7fedbf8af640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb80ae260 con 0x7fedb815ad30 2023-11-04T01:40:12.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.794+0000 7fedbce4a640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fedb80ad730 0x7fedb8070710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52012/0 (socket says 172.21.15.77:52012) 2023-11-04T01:40:12.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.794+0000 7fedbce4a640 1 -- 172.21.15.77:0/2701525262 learned_addr learned my addr 172.21.15.77:0/2701525262 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:12.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.794+0000 7fedabfff640 1 -- 172.21.15.77:0/2701525262 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3336063542 0 0) 0x7fedb80c3900 con 0x7fedb80ad730 2023-11-04T01:40:12.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.794+0000 7fedabfff640 1 -- 172.21.15.77:0/2701525262 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feda4003520 con 0x7fedb80ad730 2023-11-04T01:40:12.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.794+0000 7fedbd64b640 1 --2- 172.21.15.77:0/2701525262 >> v2:172.21.15.122:3300/0 conn(0x7fedb815ad30 0x7fedb80adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.794+0000 7fedabfff640 1 -- 172.21.15.77:0/2701525262 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3678312572 0 0) 0x7feda4003520 con 0x7fedb80ad730 2023-11-04T01:40:12.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.794+0000 7fedabfff640 1 -- 172.21.15.77:0/2701525262 >> v2:172.21.15.122:3300/0 conn(0x7fedb815ad30 msgr2=0x7fedb80adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:12.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.794+0000 7fedabfff640 1 --2- 172.21.15.77:0/2701525262 >> v2:172.21.15.122:3300/0 conn(0x7fedb815ad30 0x7fedb80adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.794+0000 7fedabfff640 1 -- 172.21.15.77:0/2701525262 >> v1:172.21.15.122:6789/0 conn(0x7fedb8070e20 legacy=0x7fedb815e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.794+0000 7fedabfff640 1 -- 172.21.15.77:0/2701525262 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb80c3ec0 con 0x7fedb80ad730 2023-11-04T01:40:12.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.794+0000 7fedabfff640 1 -- 172.21.15.77:0/2701525262 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7fedb4001670 con 0x7fedb80ad730 2023-11-04T01:40:12.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.794+0000 7fedabfff640 1 -- 172.21.15.77:0/2701525262 >> v1:172.21.15.77:6789/0 conn(0x7fedb80ad730 legacy=0x7fedb8070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.794+0000 7fedabfff640 1 --2- 172.21.15.77:0/2701525262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda4003970 0x7feda4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.794+0000 7fedabfff640 1 --2- 172.21.15.77:0/2701525262 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feda40047c0 0x7feda4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.794+0000 7fedabfff640 1 --2- 172.21.15.77:0/2701525262 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feda4005180 0x7feda400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.794+0000 7fedabfff640 1 -- 172.21.15.77:0/2701525262 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb80ae260 con 0x7feda4003970 2023-11-04T01:40:12.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.794+0000 7fedabfff640 1 -- 172.21.15.77:0/2701525262 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda400c120 con 0x7feda4005180 2023-11-04T01:40:12.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.794+0000 7fedabfff640 1 -- 172.21.15.77:0/2701525262 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda400c2e0 con 0x7feda40047c0 2023-11-04T01:40:12.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.794+0000 7fedbd64b640 1 --2- 172.21.15.77:0/2701525262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda4003970 0x7feda4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.794+0000 7fedbce4a640 1 --2- 172.21.15.77:0/2701525262 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feda40047c0 0x7feda4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.794+0000 7fedbde4c640 1 --2- 172.21.15.77:0/2701525262 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feda4005180 0x7feda400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.795+0000 7fedbd64b640 1 -- 172.21.15.77:0/2701525262 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feda40047c0 msgr2=0x7feda4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:12.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.795+0000 7fedbd64b640 1 --2- 172.21.15.77:0/2701525262 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feda40047c0 0x7feda4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.795+0000 7fedbd64b640 1 -- 172.21.15.77:0/2701525262 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feda4005180 msgr2=0x7feda400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:12.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.795+0000 7fedbd64b640 1 --2- 172.21.15.77:0/2701525262 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feda4005180 0x7feda400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.795+0000 7fedbd64b640 1 -- 172.21.15.77:0/2701525262 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda4003520 con 0x7feda4003970 2023-11-04T01:40:12.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.795+0000 7fedbce4a640 1 --2- 172.21.15.77:0/2701525262 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feda40047c0 0x7feda4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:12.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.795+0000 7fedbde4c640 1 --2- 172.21.15.77:0/2701525262 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feda4005180 0x7feda400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:12.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.795+0000 7fedbde4c640 1 -- 172.21.15.77:0/2701525262 reap_dead start 2023-11-04T01:40:12.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.795+0000 7fedbd64b640 1 --2- 172.21.15.77:0/2701525262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda4003970 0x7feda4003d90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fedac009ac0 tx=0x7feda40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05e1b90a352b1f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:12.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.795+0000 7fedabfff640 1 -- 172.21.15.77:0/2701525262 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac02c6b0 con 0x7feda4003970 2023-11-04T01:40:12.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.795+0000 7fedabfff640 1 -- 172.21.15.77:0/2701525262 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedac02c810 con 0x7feda4003970 2023-11-04T01:40:12.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.795+0000 7fedabfff640 1 -- 172.21.15.77:0/2701525262 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac02cba0 con 0x7feda4003970 2023-11-04T01:40:12.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.796+0000 7fedbf8af640 1 -- 172.21.15.77:0/2701525262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda4003970 msgr2=0x7feda4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.796+0000 7fedbf8af640 1 --2- 172.21.15.77:0/2701525262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda4003970 0x7feda4003d90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fedac009ac0 tx=0x7feda40057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.796+0000 7fedbf8af640 1 -- 172.21.15.77:0/2701525262 shutdown_connections 2023-11-04T01:40:12.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.796+0000 7fedbf8af640 1 --2- 172.21.15.77:0/2701525262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda4003970 0x7feda4003d90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.796+0000 7fedbf8af640 1 -- 172.21.15.77:0/2701525262 >> 172.21.15.77:0/2701525262 conn(0x7fedb80ce950 msgr2=0x7fedb80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:12.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.796+0000 7fedbf8af640 1 -- 172.21.15.77:0/2701525262 shutdown_connections 2023-11-04T01:40:12.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.796+0000 7fedbf8af640 1 -- 172.21.15.77:0/2701525262 wait complete. 2023-11-04T01:40:12.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.797+0000 7fedbf8af640 1 Processor -- start 2023-11-04T01:40:12.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.797+0000 7fedbf8af640 1 -- start start 2023-11-04T01:40:12.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.798+0000 7fedbf8af640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda4003970 0x7fedb80ce030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.798+0000 7fedbf8af640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fedb81494b0 0x7fedb814e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.798+0000 7fedbf8af640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fedb814ef00 0x7fedb80b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.798+0000 7fedbf8af640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb80ce570 con 0x7feda4003970 2023-11-04T01:40:12.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.798+0000 7fedbf8af640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb80ccf90 con 0x7fedb814ef00 2023-11-04T01:40:12.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.798+0000 7fedbf8af640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb80cd270 con 0x7fedb81494b0 2023-11-04T01:40:12.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.798+0000 7fedbd64b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda4003970 0x7fedb80ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.798+0000 7fedbd64b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda4003970 0x7fedb80ce030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46026/0 (socket says 172.21.15.77:46026) 2023-11-04T01:40:12.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.798+0000 7fedbd64b640 1 -- 172.21.15.77:0/3602300151 learned_addr learned my addr 172.21.15.77:0/3602300151 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:12.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.798+0000 7fedbce4a640 1 --2- 172.21.15.77:0/3602300151 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fedb81494b0 0x7fedb814e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.798+0000 7fedbde4c640 1 --2- 172.21.15.77:0/3602300151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fedb814ef00 0x7fedb80b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.798+0000 7fedbd64b640 1 -- 172.21.15.77:0/3602300151 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fedb81494b0 msgr2=0x7fedb814e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.798+0000 7fedbd64b640 1 --2- 172.21.15.77:0/3602300151 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fedb81494b0 0x7fedb814e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.798+0000 7fedbd64b640 1 -- 172.21.15.77:0/3602300151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fedb814ef00 msgr2=0x7fedb80b39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.798+0000 7fedbd64b640 1 --2- 172.21.15.77:0/3602300151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fedb814ef00 0x7fedb80b39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.798+0000 7fedbd64b640 1 -- 172.21.15.77:0/3602300151 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb80cd550 con 0x7feda4003970 2023-11-04T01:40:12.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.798+0000 7fedbde4c640 1 --2- 172.21.15.77:0/3602300151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fedb814ef00 0x7fedb80b39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:12.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.798+0000 7fedbd64b640 1 --2- 172.21.15.77:0/3602300151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda4003970 0x7fedb80ce030 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fedac02c250 tx=0x7fedac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:12.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.799+0000 7feda9ffb640 1 -- 172.21.15.77:0/3602300151 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac003810 con 0x7feda4003970 2023-11-04T01:40:12.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.799+0000 7feda9ffb640 1 -- 172.21.15.77:0/3602300151 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedac003970 con 0x7feda4003970 2023-11-04T01:40:12.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.799+0000 7fedbf8af640 1 -- 172.21.15.77:0/3602300151 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb80cd830 con 0x7feda4003970 2023-11-04T01:40:12.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.799+0000 7feda9ffb640 1 -- 172.21.15.77:0/3602300151 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac003d00 con 0x7feda4003970 2023-11-04T01:40:12.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.799+0000 7fedbf8af640 1 -- 172.21.15.77:0/3602300151 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb80ccbf0 con 0x7feda4003970 2023-11-04T01:40:12.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.800+0000 7feda9ffb640 1 -- 172.21.15.77:0/3602300151 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fedac047450 con 0x7feda4003970 2023-11-04T01:40:12.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.801+0000 7feda9ffb640 1 --2- 172.21.15.77:0/3602300151 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fed9c06ae70 0x7fed9c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.801+0000 7feda9ffb640 1 -- 172.21.15.77:0/3602300151 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fedac0abac0 con 0x7feda4003970 2023-11-04T01:40:12.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.801+0000 7fedbce4a640 1 --2- 172.21.15.77:0/3602300151 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fed9c06ae70 0x7fed9c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.801+0000 7fedbce4a640 1 --2- 172.21.15.77:0/3602300151 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fed9c06ae70 0x7fed9c06d330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fedb80c51f0 tx=0x7fedb4007040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:12.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.801+0000 7fedc243f740 1 Processor -- start 2023-11-04T01:40:12.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.802+0000 7fedc243f740 1 -- start start 2023-11-04T01:40:12.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.802+0000 7fedc243f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56139de32850 0x56139de05750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.802+0000 7fedc243f740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x56139de32c30 0x56139de355e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.802+0000 7fedc243f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139de05c90 0x56139de35b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.802+0000 7fedc243f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x56139dd16740 con 0x56139de32850 2023-11-04T01:40:12.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.802+0000 7fedc243f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x56139dd788d0 con 0x56139de05c90 2023-11-04T01:40:12.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.802+0000 7fedc243f740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x56139dd75fc0 con 0x56139de32c30 2023-11-04T01:40:12.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.802+0000 7fedbd64b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56139de32850 0x56139de05750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.802+0000 7fedbd64b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56139de32850 0x56139de05750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46032/0 (socket says 172.21.15.77:46032) 2023-11-04T01:40:12.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.802+0000 7fedbd64b640 1 -- 172.21.15.77:0/2390938214 learned_addr learned my addr 172.21.15.77:0/2390938214 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:12.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.802+0000 7fedbde4c640 1 --2- 172.21.15.77:0/2390938214 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139de05c90 0x56139de35b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.802+0000 7fedbce4a640 1 --2- 172.21.15.77:0/2390938214 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x56139de32c30 0x56139de355e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.803+0000 7fedbd64b640 1 -- 172.21.15.77:0/2390938214 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x56139de32c30 msgr2=0x56139de355e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:12.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.803+0000 7fedbd64b640 1 --2- 172.21.15.77:0/2390938214 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x56139de32c30 0x56139de355e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.803+0000 7fedbd64b640 1 -- 172.21.15.77:0/2390938214 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139de05c90 msgr2=0x56139de35b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:12.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.803+0000 7fedbd64b640 1 --2- 172.21.15.77:0/2390938214 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139de05c90 0x56139de35b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.803+0000 7fedbd64b640 1 -- 172.21.15.77:0/2390938214 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56139dd34ca0 con 0x56139de32850 2023-11-04T01:40:12.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.803+0000 7fedbce4a640 1 --2- 172.21.15.77:0/2390938214 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x56139de32c30 0x56139de355e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:12.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.803+0000 7fedbd64b640 1 --2- 172.21.15.77:0/2390938214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56139de32850 0x56139de05750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fedac0a9d90 tx=0x7fedac07a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=953e659a120ad97 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:12.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.803+0000 7feda2ffd640 1 -- 172.21.15.77:0/2390938214 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac07e720 con 0x56139de32850 2023-11-04T01:40:12.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.803+0000 7feda2ffd640 1 -- 172.21.15.77:0/2390938214 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedac0828d0 con 0x56139de32850 2023-11-04T01:40:12.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.803+0000 7feda2ffd640 1 -- 172.21.15.77:0/2390938214 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac009690 con 0x56139de32850 2023-11-04T01:40:12.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.803+0000 7fedc243f740 1 -- 172.21.15.77:0/2390938214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56139de32850 msgr2=0x56139de05750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.803+0000 7fedc243f740 1 --2- 172.21.15.77:0/2390938214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56139de32850 0x56139de05750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fedac0a9d90 tx=0x7fedac07a2c0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.803+0000 7fedc243f740 1 -- 172.21.15.77:0/2390938214 shutdown_connections 2023-11-04T01:40:12.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.803+0000 7fedc243f740 1 --2- 172.21.15.77:0/2390938214 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139de05c90 0x56139de35b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.803+0000 7fedc243f740 1 --2- 172.21.15.77:0/2390938214 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x56139de32c30 0x56139de355e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.803+0000 7fedc243f740 1 --2- 172.21.15.77:0/2390938214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56139de32850 0x56139de05750 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.803+0000 7fedc243f740 1 -- 172.21.15.77:0/2390938214 >> 172.21.15.77:0/2390938214 conn(0x56139de07a60 msgr2=0x56139de505e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:12.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.803+0000 7fedc243f740 1 -- 172.21.15.77:0/2390938214 shutdown_connections 2023-11-04T01:40:12.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.803+0000 7fedc243f740 1 -- 172.21.15.77:0/2390938214 wait complete. 2023-11-04T01:40:12.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.804+0000 7fedc243f740 1 -- start start 2023-11-04T01:40:12.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.804+0000 7fedc243f740 1 Processor -- start 2023-11-04T01:40:12.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.805+0000 7fedc243f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56139de32850 0x56139de23c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.805+0000 7fedc243f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139de32c30 0x56139de499b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.805+0000 7fedc243f740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x56139de4ac10 0x56139de243b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.805+0000 7fedc243f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x56139dd718b0 con 0x56139de32850 2023-11-04T01:40:12.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.805+0000 7fedc243f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x56139dd2bc80 con 0x56139de32c30 2023-11-04T01:40:12.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.805+0000 7fedc243f740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x56139dd2b920 con 0x56139de4ac10 2023-11-04T01:40:12.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.805+0000 7fedc243f740 10 client.0 _ll_register_callbacks cb 0x56139da83ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:40:12.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.805+0000 7fedbd64b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56139de32850 0x56139de23c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.805+0000 7fedbd64b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56139de32850 0x56139de23c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46034/0 (socket says 172.21.15.77:46034) 2023-11-04T01:40:12.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.805+0000 7fedbd64b640 1 -- 172.21.15.77:0/4078849773 learned_addr learned my addr 172.21.15.77:0/4078849773 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:12.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.805+0000 7fedbde4c640 1 --2- 172.21.15.77:0/4078849773 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x56139de4ac10 0x56139de243b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.805+0000 7fedbce4a640 1 --2- 172.21.15.77:0/4078849773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139de32c30 0x56139de499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.805+0000 7fedbd64b640 1 -- 172.21.15.77:0/4078849773 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x56139de4ac10 msgr2=0x56139de243b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:12.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.805+0000 7fedbd64b640 1 --2- 172.21.15.77:0/4078849773 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x56139de4ac10 0x56139de243b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.805+0000 7fedbd64b640 1 -- 172.21.15.77:0/4078849773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139de32c30 msgr2=0x56139de499b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:12.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.805+0000 7fedbd64b640 1 --2- 172.21.15.77:0/4078849773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139de32c30 0x56139de499b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.805+0000 7fedbd64b640 1 -- 172.21.15.77:0/4078849773 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb80ccbf0 con 0x56139de32850 2023-11-04T01:40:12.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.805+0000 7fedbce4a640 1 --2- 172.21.15.77:0/4078849773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139de32c30 0x56139de499b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:12.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.805+0000 7fedbd64b640 1 --2- 172.21.15.77:0/4078849773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56139de32850 0x56139de23c10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fedac000c00 tx=0x7fedac009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f48e450b7e98f49 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:12.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.805+0000 7fed97fff640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:40:12.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.805+0000 7fed97fff640 1 -- 172.21.15.77:0/4078849773 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac07a8e0 con 0x56139de32850 2023-11-04T01:40:12.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.806+0000 7fedc243f740 1 -- 172.21.15.77:0/4078849773 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56139dd1dbf0 con 0x56139de32850 2023-11-04T01:40:12.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.806+0000 7fed97fff640 1 -- 172.21.15.77:0/4078849773 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fedac07aa40 con 0x56139de32850 2023-11-04T01:40:12.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.806+0000 7fed97fff640 1 -- 172.21.15.77:0/4078849773 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fedac079b70 con 0x56139de32850 2023-11-04T01:40:12.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.806+0000 7fedc243f740 10 client.4416 fetch_fsmap learned FSMap version 7 2023-11-04T01:40:12.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.806+0000 7fedc243f740 1 -- 172.21.15.77:0/4078849773 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x56139dd6ff30 con 0x56139de32850 2023-11-04T01:40:12.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.806+0000 7fed97fff640 1 -- 172.21.15.77:0/4078849773 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56139dd1dbf0 con 0x56139de32850 2023-11-04T01:40:12.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.806+0000 7fed97fff640 1 -- 172.21.15.77:0/4078849773 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fedac09b030 con 0x56139de32850 2023-11-04T01:40:12.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.806+0000 7fedc243f740 10 client.4416 fetch_fsmap finished waiting for FSMap version 7 2023-11-04T01:40:12.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.806+0000 7fedc243f740 10 client.4416 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:40:12.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.806+0000 7fedc243f740 20 client.4416 populate_metadata read hostname 'smithi077' 2023-11-04T01:40:12.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.806+0000 7fedc243f740 1 --2- 172.21.15.77:0/4078849773 >> [v2:172.21.15.122:6834/2444318089,v1:172.21.15.122:6836/2444318089] conn(0x56139de38c70 0x56139de6db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.806+0000 7fedc243f740 4 client.4416 mds_command: new command op to 34166 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:40:12.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.806+0000 7fedc243f740 1 -- 172.21.15.77:0/4078849773 --> [v2:172.21.15.122:6834/2444318089,v1:172.21.15.122:6836/2444318089] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56139dd6a890 con 0x56139de38c70 2023-11-04T01:40:12.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.806+0000 7fedbce4a640 1 --2- 172.21.15.77:0/4078849773 >> [v2:172.21.15.122:6834/2444318089,v1:172.21.15.122:6836/2444318089] conn(0x56139de38c70 0x56139de6db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.807+0000 7fed97fff640 10 client.4416 ms_handle_connect on v2:172.21.15.122:6834/2444318089 2023-11-04T01:40:12.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.807+0000 7fedbce4a640 1 --2- 172.21.15.77:0/4078849773 >> [v2:172.21.15.122:6834/2444318089,v1:172.21.15.122:6836/2444318089] conn(0x56139de38c70 0x56139de6db80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8adb4bf0db42a0a4 server_cookie=8bf652a8018237ac in_seq=0 out_seq=0 2023-11-04T01:40:12.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.807+0000 7fed97fff640 1 -- 172.21.15.77:0/4078849773 <== mds.0 v2:172.21.15.122:6834/2444318089 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56139dd6a890 con 0x56139de38c70 2023-11-04T01:40:12.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.807+0000 7fed97fff640 10 client.4416 handle_command_reply: tid=0 2023-11-04T01:40:12.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.807+0000 7fedc243f740 1 client.4416 shutdown 2023-11-04T01:40:12.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.807+0000 7fedc243f740 1 -- 172.21.15.77:0/4078849773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56139de32850 msgr2=0x56139de23c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.807+0000 7fedc243f740 1 --2- 172.21.15.77:0/4078849773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56139de32850 0x56139de23c10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fedac000c00 tx=0x7fedac009190 comp rx=0 tx=0).stop 2023-11-04T01:40:12.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.807+0000 7fedc243f740 1 -- 172.21.15.77:0/4078849773 shutdown_connections 2023-11-04T01:40:12.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.807+0000 7fedc243f740 1 --2- 172.21.15.77:0/4078849773 >> [v2:172.21.15.122:6834/2444318089,v1:172.21.15.122:6836/2444318089] conn(0x56139de38c70 0x56139de6db80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.807+0000 7fedc243f740 1 --2- 172.21.15.77:0/4078849773 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x56139de4ac10 0x56139de243b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.807+0000 7fedc243f740 1 --2- 172.21.15.77:0/4078849773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139de32c30 0x56139de499b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.807+0000 7fedc243f740 1 --2- 172.21.15.77:0/4078849773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56139de32850 0x56139de23c10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.807+0000 7fed97fff640 0 client.4416 ms_handle_reset on v2:172.21.15.122:6834/2444318089 2023-11-04T01:40:12.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.807+0000 7fedc243f740 1 -- 172.21.15.77:0/4078849773 >> 172.21.15.77:0/4078849773 conn(0x56139de05c90 msgr2=0x56139de09810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:12.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.807+0000 7fedc243f740 1 -- 172.21.15.77:0/4078849773 shutdown_connections 2023-11-04T01:40:12.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.807+0000 7fedc243f740 1 -- 172.21.15.77:0/4078849773 wait complete. 2023-11-04T01:40:12.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.808+0000 7fedc243f740 20 client.4416 trim_cache size 0 max 16384 2023-11-04T01:40:12.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.823+0000 7fedc243f740 1 Processor -- start 2023-11-04T01:40:12.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.823+0000 7fedc243f740 1 -- start start 2023-11-04T01:40:12.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.824+0000 7fedc243f740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x56139de32850 0x56139de23040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.824+0000 7fedc243f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56139de32c30 0x56139de00db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.824+0000 7fedc243f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139de38c70 0x56139de228c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.824+0000 7fedc243f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x56139de0a350 con 0x56139de32c30 2023-11-04T01:40:12.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.824+0000 7fedc243f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x56139dcf1280 con 0x56139de38c70 2023-11-04T01:40:12.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.824+0000 7fedc243f740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x56139dd70a50 con 0x56139de32850 2023-11-04T01:40:12.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.824+0000 7fedbce4a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56139de32c30 0x56139de00db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.824+0000 7fedbce4a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56139de32c30 0x56139de00db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46044/0 (socket says 172.21.15.77:46044) 2023-11-04T01:40:12.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.824+0000 7fedbce4a640 1 -- 172.21.15.77:0/3486581199 learned_addr learned my addr 172.21.15.77:0/3486581199 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:12.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.824+0000 7fedbd64b640 1 --2- 172.21.15.77:0/3486581199 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x56139de32850 0x56139de23040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.824+0000 7fedbde4c640 1 --2- 172.21.15.77:0/3486581199 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139de38c70 0x56139de228c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.824+0000 7fedbce4a640 1 -- 172.21.15.77:0/3486581199 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x56139de32850 msgr2=0x56139de23040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:12.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.824+0000 7fedbce4a640 1 --2- 172.21.15.77:0/3486581199 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x56139de32850 0x56139de23040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.824+0000 7fedbce4a640 1 -- 172.21.15.77:0/3486581199 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139de38c70 msgr2=0x56139de228c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:12.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.824+0000 7fedbce4a640 1 --2- 172.21.15.77:0/3486581199 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139de38c70 0x56139de228c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.824+0000 7fedbce4a640 1 -- 172.21.15.77:0/3486581199 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56139de51650 con 0x56139de32c30 2023-11-04T01:40:12.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.824+0000 7fedbd64b640 1 --2- 172.21.15.77:0/3486581199 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x56139de32850 0x56139de23040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:12.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.824+0000 7fedbde4c640 1 --2- 172.21.15.77:0/3486581199 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139de38c70 0x56139de228c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:12.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.824+0000 7fedbce4a640 1 --2- 172.21.15.77:0/3486581199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56139de32c30 0x56139de00db0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fedb4011a70 tx=0x7fedb4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e23f43e9c6137c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:12.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.824+0000 7feda37fe640 1 -- 172.21.15.77:0/3486581199 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb4028ea0 con 0x56139de32c30 2023-11-04T01:40:12.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.824+0000 7feda37fe640 1 -- 172.21.15.77:0/3486581199 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb4028150 con 0x56139de32c30 2023-11-04T01:40:12.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.824+0000 7feda37fe640 1 -- 172.21.15.77:0/3486581199 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb40284c0 con 0x56139de32c30 2023-11-04T01:40:12.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.825+0000 7fedc243f740 1 -- 172.21.15.77:0/3486581199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56139de32c30 msgr2=0x56139de00db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.825+0000 7fedc243f740 1 --2- 172.21.15.77:0/3486581199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56139de32c30 0x56139de00db0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fedb4011a70 tx=0x7fedb4014000 comp rx=0 tx=0).stop 2023-11-04T01:40:12.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.825+0000 7fedc243f740 1 -- 172.21.15.77:0/3486581199 shutdown_connections 2023-11-04T01:40:12.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.825+0000 7fedc243f740 1 --2- 172.21.15.77:0/3486581199 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139de38c70 0x56139de228c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.825+0000 7fedc243f740 1 --2- 172.21.15.77:0/3486581199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56139de32c30 0x56139de00db0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.825+0000 7fedc243f740 1 --2- 172.21.15.77:0/3486581199 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x56139de32850 0x56139de23040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.825+0000 7fedc243f740 1 -- 172.21.15.77:0/3486581199 >> 172.21.15.77:0/3486581199 conn(0x56139de05c90 msgr2=0x56139de35a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:12.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.825+0000 7fedc243f740 1 -- 172.21.15.77:0/3486581199 shutdown_connections 2023-11-04T01:40:12.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.825+0000 7fedc243f740 1 -- 172.21.15.77:0/3486581199 wait complete. 2023-11-04T01:40:12.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.825+0000 7fedc243f740 1 -- start start 2023-11-04T01:40:12.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.825+0000 7fedc243f740 1 Processor -- start 2023-11-04T01:40:12.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.826+0000 7fedc243f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56139de32850 0x56139debab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.826+0000 7fedc243f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139de32c30 0x56139de4ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.826+0000 7fedc243f740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x56139de38c70 0x56139debe870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.826+0000 7fedc243f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x56139debb590 con 0x56139de32850 2023-11-04T01:40:12.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.826+0000 7fedc243f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x56139de35ed0 con 0x56139de32c30 2023-11-04T01:40:12.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.826+0000 7fedc243f740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x56139debe100 con 0x56139de38c70 2023-11-04T01:40:12.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.826+0000 7fedc243f740 10 client.0 _ll_register_callbacks cb 0x7fedac009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:40:12.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.826+0000 7fedbd64b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56139de32850 0x56139debab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.826+0000 7fedbd64b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56139de32850 0x56139debab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46054/0 (socket says 172.21.15.77:46054) 2023-11-04T01:40:12.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.826+0000 7fedbd64b640 1 -- 172.21.15.77:0/1971135980 learned_addr learned my addr 172.21.15.77:0/1971135980 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:12.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.826+0000 7fedbde4c640 1 --2- 172.21.15.77:0/1971135980 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x56139de38c70 0x56139debe870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.826+0000 7fedbce4a640 1 --2- 172.21.15.77:0/1971135980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139de32c30 0x56139de4ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.827+0000 7fedbd64b640 1 -- 172.21.15.77:0/1971135980 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x56139de38c70 msgr2=0x56139debe870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:12.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.827+0000 7fedbd64b640 1 --2- 172.21.15.77:0/1971135980 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x56139de38c70 0x56139debe870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.827+0000 7fedbd64b640 1 -- 172.21.15.77:0/1971135980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139de32c30 msgr2=0x56139de4ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:12.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.827+0000 7fedbd64b640 1 --2- 172.21.15.77:0/1971135980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139de32c30 0x56139de4ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.827+0000 7fedbd64b640 1 -- 172.21.15.77:0/1971135980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb400f040 con 0x56139de32850 2023-11-04T01:40:12.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.827+0000 7fedbce4a640 1 --2- 172.21.15.77:0/1971135980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139de32c30 0x56139de4ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:12.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.827+0000 7fedbd64b640 1 --2- 172.21.15.77:0/1971135980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56139de32850 0x56139debab80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fedac0823a0 tx=0x7fedac049000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb987ddde2ba521 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:12.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.827+0000 7fed97fff640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:40:12.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.827+0000 7fed97fff640 1 -- 172.21.15.77:0/1971135980 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac079d80 con 0x56139de32850 2023-11-04T01:40:12.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.827+0000 7fed97fff640 1 -- 172.21.15.77:0/1971135980 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fedac07a680 con 0x56139de32850 2023-11-04T01:40:12.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.827+0000 7fedc243f740 1 -- 172.21.15.77:0/1971135980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fedac0828d0 con 0x56139de32850 2023-11-04T01:40:12.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.827+0000 7fed97fff640 1 -- 172.21.15.77:0/1971135980 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fedac07a1c0 con 0x56139de32850 2023-11-04T01:40:12.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.827+0000 7fedc243f740 10 client.4422 fetch_fsmap learned FSMap version 7 2023-11-04T01:40:12.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.827+0000 7fedc243f740 1 -- 172.21.15.77:0/1971135980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x56139dd0dd10 con 0x56139de32850 2023-11-04T01:40:12.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.827+0000 7fed97fff640 1 -- 172.21.15.77:0/1971135980 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedac0828d0 con 0x56139de32850 2023-11-04T01:40:12.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.827+0000 7fed97fff640 1 -- 172.21.15.77:0/1971135980 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fedac09b070 con 0x56139de32850 2023-11-04T01:40:12.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.827+0000 7fedc243f740 10 client.4422 fetch_fsmap finished waiting for FSMap version 7 2023-11-04T01:40:12.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.827+0000 7fedc243f740 10 client.4422 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:40:12.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.827+0000 7fedc243f740 20 client.4422 populate_metadata read hostname 'smithi077' 2023-11-04T01:40:12.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.827+0000 7fedc243f740 1 --2- 172.21.15.77:0/1971135980 >> [v2:172.21.15.122:6834/2444318089,v1:172.21.15.122:6836/2444318089] conn(0x56139de4ac10 0x56139deb4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.827+0000 7fedc243f740 4 client.4422 mds_command: new command op to 34166 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:40:12.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.827+0000 7fedc243f740 1 -- 172.21.15.77:0/1971135980 --> [v2:172.21.15.122:6834/2444318089,v1:172.21.15.122:6836/2444318089] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56139dd6a5b0 con 0x56139de4ac10 2023-11-04T01:40:12.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.827+0000 7fedbce4a640 1 --2- 172.21.15.77:0/1971135980 >> [v2:172.21.15.122:6834/2444318089,v1:172.21.15.122:6836/2444318089] conn(0x56139de4ac10 0x56139deb4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.828+0000 7fed97fff640 10 client.4422 ms_handle_connect on v2:172.21.15.122:6834/2444318089 2023-11-04T01:40:12.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.828+0000 7fedbce4a640 1 --2- 172.21.15.77:0/1971135980 >> [v2:172.21.15.122:6834/2444318089,v1:172.21.15.122:6836/2444318089] conn(0x56139de4ac10 0x56139deb4670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4bf6b1633254531 server_cookie=53934c7408b4d1db in_seq=0 out_seq=0 2023-11-04T01:40:12.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.828+0000 7fed97fff640 1 -- 172.21.15.77:0/1971135980 <== mds.0 v2:172.21.15.122:6834/2444318089 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x56139dd6a5b0 con 0x56139de4ac10 2023-11-04T01:40:12.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.828+0000 7fed97fff640 10 client.4422 handle_command_reply: tid=0 2023-11-04T01:40:12.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.828+0000 7fedc243f740 1 client.4422 shutdown 2023-11-04T01:40:12.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.828+0000 7fedc243f740 1 -- 172.21.15.77:0/1971135980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56139de32850 msgr2=0x56139debab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.828+0000 7fedc243f740 1 --2- 172.21.15.77:0/1971135980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56139de32850 0x56139debab80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fedac0823a0 tx=0x7fedac049000 comp rx=0 tx=0).stop 2023-11-04T01:40:12.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.828+0000 7fedc243f740 1 -- 172.21.15.77:0/1971135980 shutdown_connections 2023-11-04T01:40:12.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.828+0000 7fedc243f740 1 --2- 172.21.15.77:0/1971135980 >> [v2:172.21.15.122:6834/2444318089,v1:172.21.15.122:6836/2444318089] conn(0x56139de4ac10 0x56139deb4670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.828+0000 7fedc243f740 1 --2- 172.21.15.77:0/1971135980 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x56139de38c70 0x56139debe870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.828+0000 7fed97fff640 0 client.4422 ms_handle_reset on v2:172.21.15.122:6834/2444318089 2023-11-04T01:40:12.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.828+0000 7fedc243f740 1 --2- 172.21.15.77:0/1971135980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56139de32c30 0x56139de4ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.828+0000 7fedc243f740 1 --2- 172.21.15.77:0/1971135980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56139de32850 0x56139debab80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.828+0000 7fedc243f740 1 -- 172.21.15.77:0/1971135980 >> 172.21.15.77:0/1971135980 conn(0x56139de05c90 msgr2=0x56139de00c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:12.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.828+0000 7fedc243f740 1 -- 172.21.15.77:0/1971135980 shutdown_connections 2023-11-04T01:40:12.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.828+0000 7fedc243f740 1 -- 172.21.15.77:0/1971135980 wait complete. 2023-11-04T01:40:12.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.828+0000 7fedc243f740 20 client.4422 trim_cache size 0 max 16384 2023-11-04T01:40:12.869 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-04T01:40:12.869 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "0c22c75d-0169-41ef-b663-6ac1c5b0f71f", 2023-11-04T01:40:12.869 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 0, 2023-11-04T01:40:12.869 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 34166, 2023-11-04T01:40:12.870 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2023-11-04T01:40:12.870 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2023-11-04T01:40:12.870 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2023-11-04T01:40:12.870 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 7.1341905780000001, 2023-11-04T01:40:12.870 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 7, 2023-11-04T01:40:12.871 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 24, 2023-11-04T01:40:12.871 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 24, 2023-11-04T01:40:12.871 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 14.361978043000001 2023-11-04T01:40:12.871 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-04T01:40:12.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.829+0000 7fedbf8af640 1 -- 172.21.15.77:0/3602300151 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fed9c06ae70 msgr2=0x7fed9c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.829+0000 7fedbf8af640 1 --2- 172.21.15.77:0/3602300151 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fed9c06ae70 0x7fed9c06d330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fedb80c51f0 tx=0x7fedb4007040 comp rx=0 tx=0).stop 2023-11-04T01:40:12.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.829+0000 7fedbf8af640 1 -- 172.21.15.77:0/3602300151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda4003970 msgr2=0x7fedb80ce030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.829+0000 7fedbf8af640 1 --2- 172.21.15.77:0/3602300151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda4003970 0x7fedb80ce030 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fedac02c250 tx=0x7fedac004730 comp rx=0 tx=0).stop 2023-11-04T01:40:12.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.829+0000 7fedbf8af640 1 -- 172.21.15.77:0/3602300151 shutdown_connections 2023-11-04T01:40:12.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.829+0000 7fedbf8af640 1 --2- 172.21.15.77:0/3602300151 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fed9c06ae70 0x7fed9c06d330 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.829+0000 7fedbf8af640 1 --2- 172.21.15.77:0/3602300151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fedb814ef00 0x7fedb80b39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.829+0000 7fedbf8af640 1 --2- 172.21.15.77:0/3602300151 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fedb81494b0 0x7fedb814e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.829+0000 7fedbf8af640 1 --2- 172.21.15.77:0/3602300151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda4003970 0x7fedb80ce030 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.829+0000 7fedbf8af640 1 -- 172.21.15.77:0/3602300151 >> 172.21.15.77:0/3602300151 conn(0x7fedb80ce950 msgr2=0x7fedb80c8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:12.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.829+0000 7fedbf8af640 1 -- 172.21.15.77:0/3602300151 shutdown_connections 2023-11-04T01:40:12.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.829+0000 7fedbf8af640 1 -- 172.21.15.77:0/3602300151 wait complete. 2023-11-04T01:40:12.876 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-04T01:40:12.877 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-11-04T01:40:12.877 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:40:12.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.974+0000 7f172b5f5640 1 Processor -- start 2023-11-04T01:40:12.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.974+0000 7f172b5f5640 1 -- start start 2023-11-04T01:40:12.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.975+0000 7f172b5f5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f172415ce60 0x7f172406b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.975+0000 7f172b5f5640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f17240cf160 0x7f17240cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.975+0000 7f172b5f5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17241615d0 con 0x7f172406bd30 2023-11-04T01:40:12.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.975+0000 7f172b5f5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17240cbde0 con 0x7f172415ce60 2023-11-04T01:40:12.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.975+0000 7f172b5f5640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17240cfb30 con 0x7f17240cf160 2023-11-04T01:40:12.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.975+0000 7f1729391640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f172415ce60 0x7f172406b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.975+0000 7f1728b90640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f172406bd30 0x7f1724160b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52014/0 (socket says 172.21.15.77:52014) 2023-11-04T01:40:12.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.975+0000 7f1728b90640 1 -- 172.21.15.77:0/1215734584 learned_addr learned my addr 172.21.15.77:0/1215734584 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:12.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.975+0000 7f1729391640 1 -- 172.21.15.77:0/1215734584 >> v2:172.21.15.122:3300/0 conn(0x7f17240cf160 msgr2=0x7f17240cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:12.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.975+0000 7f1729391640 1 --2- 172.21.15.77:0/1215734584 >> v2:172.21.15.122:3300/0 conn(0x7f17240cf160 0x7f17240cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.975+0000 7f1729391640 1 -- 172.21.15.77:0/1215734584 >> v1:172.21.15.77:6789/0 conn(0x7f172406bd30 legacy=0x7f1724160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.975+0000 7f1729391640 1 -- 172.21.15.77:0/1215734584 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17241618b0 con 0x7f172415ce60 2023-11-04T01:40:12.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.975+0000 7f171bfff640 1 -- 172.21.15.77:0/1215734584 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1165821050 0 0) 0x7f17241615d0 con 0x7f172406bd30 2023-11-04T01:40:12.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.976+0000 7f1729391640 1 --2- 172.21.15.77:0/1215734584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f172415ce60 0x7f172406b7f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f172406f7a0 tx=0x7f172002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48fe88535990207 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:12.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.976+0000 7f171bfff640 1 -- 172.21.15.77:0/1215734584 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1720031830 con 0x7f172415ce60 2023-11-04T01:40:12.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.976+0000 7f171bfff640 1 -- 172.21.15.77:0/1215734584 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1720031990 con 0x7f172415ce60 2023-11-04T01:40:12.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.976+0000 7f171bfff640 1 -- 172.21.15.77:0/1215734584 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1720031d20 con 0x7f172415ce60 2023-11-04T01:40:12.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.976+0000 7f172b5f5640 1 -- 172.21.15.77:0/1215734584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f172415ce60 msgr2=0x7f172406b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.976+0000 7f172b5f5640 1 --2- 172.21.15.77:0/1215734584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f172415ce60 0x7f172406b7f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f172406f7a0 tx=0x7f172002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.976+0000 7f172b5f5640 1 -- 172.21.15.77:0/1215734584 shutdown_connections 2023-11-04T01:40:12.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.976+0000 7f172b5f5640 1 --2- 172.21.15.77:0/1215734584 >> v2:172.21.15.122:3300/0 conn(0x7f17240cf160 0x7f17240cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.976+0000 7f172b5f5640 1 --2- 172.21.15.77:0/1215734584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f172415ce60 0x7f172406b7f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.976+0000 7f172b5f5640 1 -- 172.21.15.77:0/1215734584 >> 172.21.15.77:0/1215734584 conn(0x7f172406ea90 msgr2=0x7f172406ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:12.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.977+0000 7f172b5f5640 1 -- 172.21.15.77:0/1215734584 shutdown_connections 2023-11-04T01:40:12.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.977+0000 7f172b5f5640 1 -- 172.21.15.77:0/1215734584 wait complete. 2023-11-04T01:40:12.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.978+0000 7f172b5f5640 1 Processor -- start 2023-11-04T01:40:12.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.978+0000 7f172b5f5640 1 -- start start 2023-11-04T01:40:12.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.978+0000 7f172b5f5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f17240cf160 0x7f172415a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.978+0000 7f172b5f5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f172415ce60 0x7f17240b2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.978+0000 7f172b5f5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17240c84f0 0x7f17240c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.978+0000 7f172b5f5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1724156b70 con 0x7f172415ce60 2023-11-04T01:40:12.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.978+0000 7f172b5f5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172415ddd0 con 0x7f17240c84f0 2023-11-04T01:40:12.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.978+0000 7f172b5f5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f172415e0b0 con 0x7f17240cf160 2023-11-04T01:40:12.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.978+0000 7f1728b90640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f172415ce60 0x7f17240b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.979+0000 7f1728b90640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f172415ce60 0x7f17240b2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46078/0 (socket says 172.21.15.77:46078) 2023-11-04T01:40:12.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.979+0000 7f1728b90640 1 -- 172.21.15.77:0/2773173133 learned_addr learned my addr 172.21.15.77:0/2773173133 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:12.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.979+0000 7f1729391640 1 --2- 172.21.15.77:0/2773173133 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f17240cf160 0x7f172415a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.979+0000 7f1729b92640 1 --2- 172.21.15.77:0/2773173133 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17240c84f0 0x7f17240c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.979+0000 7f1728b90640 1 -- 172.21.15.77:0/2773173133 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f17240cf160 msgr2=0x7f172415a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.979+0000 7f1728b90640 1 --2- 172.21.15.77:0/2773173133 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f17240cf160 0x7f172415a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.979+0000 7f1728b90640 1 -- 172.21.15.77:0/2773173133 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17240c84f0 msgr2=0x7f17240c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:12.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.979+0000 7f1728b90640 1 --2- 172.21.15.77:0/2773173133 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17240c84f0 0x7f17240c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:12.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.979+0000 7f1728b90640 1 -- 172.21.15.77:0/2773173133 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1720009400 con 0x7f172415ce60 2023-11-04T01:40:12.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.979+0000 7f1729391640 1 --2- 172.21.15.77:0/2773173133 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f17240cf160 0x7f172415a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:12.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.979+0000 7f1728b90640 1 --2- 172.21.15.77:0/2773173133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f172415ce60 0x7f17240b2290 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f171400c430 tx=0x7f171400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:12.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.979+0000 7f1719ffb640 1 -- 172.21.15.77:0/2773173133 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17140074e0 con 0x7f172415ce60 2023-11-04T01:40:12.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.979+0000 7f1719ffb640 1 -- 172.21.15.77:0/2773173133 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1714007660 con 0x7f172415ce60 2023-11-04T01:40:12.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.979+0000 7f172b5f5640 1 -- 172.21.15.77:0/2773173133 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f172415e390 con 0x7f172415ce60 2023-11-04T01:40:12.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.979+0000 7f1719ffb640 1 -- 172.21.15.77:0/2773173133 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1714004a20 con 0x7f172415ce60 2023-11-04T01:40:12.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.979+0000 7f172b5f5640 1 -- 172.21.15.77:0/2773173133 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f172415e950 con 0x7f172415ce60 2023-11-04T01:40:12.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.980+0000 7f172b5f5640 1 -- 172.21.15.77:0/2773173133 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f172415eb70 con 0x7f172415ce60 2023-11-04T01:40:12.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.980+0000 7f1719ffb640 1 -- 172.21.15.77:0/2773173133 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1714004b80 con 0x7f172415ce60 2023-11-04T01:40:12.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.981+0000 7f1719ffb640 1 --2- 172.21.15.77:0/2773173133 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f170806ae70 0x7f170806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:12.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.981+0000 7f1719ffb640 1 -- 172.21.15.77:0/2773173133 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1714089710 con 0x7f172415ce60 2023-11-04T01:40:12.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.981+0000 7f1729391640 1 --2- 172.21.15.77:0/2773173133 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f170806ae70 0x7f170806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:12.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.981+0000 7f1729391640 1 --2- 172.21.15.77:0/2773173133 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f170806ae70 0x7f170806d330 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1720036000 tx=0x7f172003c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:12.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:12.985+0000 7f1719ffb640 1 -- 172.21.15.77:0/2773173133 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f17140544d0 con 0x7f172415ce60 2023-11-04T01:40:13.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:13.185+0000 7f172b5f5640 1 -- 172.21.15.77:0/2773173133 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1724074290 con 0x7f172415ce60 2023-11-04T01:40:13.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:13.186+0000 7f1719ffb640 1 -- 172.21.15.77:0/2773173133 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f1714057af0 con 0x7f172415ce60 2023-11-04T01:40:13.188 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-04T01:40:13.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:13.187+0000 7f172b5f5640 1 -- 172.21.15.77:0/2773173133 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f170806ae70 msgr2=0x7f170806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:13.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:13.187+0000 7f172b5f5640 1 --2- 172.21.15.77:0/2773173133 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f170806ae70 0x7f170806d330 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1720036000 tx=0x7f172003c040 comp rx=0 tx=0).stop 2023-11-04T01:40:13.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:13.187+0000 7f172b5f5640 1 -- 172.21.15.77:0/2773173133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f172415ce60 msgr2=0x7f17240b2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:13.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:13.187+0000 7f172b5f5640 1 --2- 172.21.15.77:0/2773173133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f172415ce60 0x7f17240b2290 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f171400c430 tx=0x7f171400c8f0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:13.187+0000 7f172b5f5640 1 -- 172.21.15.77:0/2773173133 shutdown_connections 2023-11-04T01:40:13.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:13.187+0000 7f172b5f5640 1 --2- 172.21.15.77:0/2773173133 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f170806ae70 0x7f170806d330 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:13.187+0000 7f172b5f5640 1 --2- 172.21.15.77:0/2773173133 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17240c84f0 0x7f17240c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:13.187+0000 7f172b5f5640 1 --2- 172.21.15.77:0/2773173133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f172415ce60 0x7f17240b2290 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:13.187+0000 7f172b5f5640 1 --2- 172.21.15.77:0/2773173133 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f17240cf160 0x7f172415a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:13.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:13.188+0000 7f172b5f5640 1 -- 172.21.15.77:0/2773173133 >> 172.21.15.77:0/2773173133 conn(0x7f172406ea90 msgr2=0x7f172415a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:13.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:13.188+0000 7f172b5f5640 1 -- 172.21.15.77:0/2773173133 shutdown_connections 2023-11-04T01:40:13.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:13.188+0000 7f172b5f5640 1 -- 172.21.15.77:0/2773173133 wait complete. 2023-11-04T01:40:13.200 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-04T01:40:13.200 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:40:13.200 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2023-11-04T01:40:13.201 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-11-04T01:40:13.201 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-11-04T01:40:13.201 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-04T01:40:13.201 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:40:13.202 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:40:13.202 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-11-04T01:40:13.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:13.203 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2023-11-04T01:40:13.218 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:40:13.218 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:40:13.219 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:40:13.219 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:13.219 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2023-11-04T01:40:13.219 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:13.220 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:40:13.220 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:13.220 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f0 2023-11-04T01:40:13.220 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:40:13.220 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:13.221 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f1 2023-11-04T01:40:13.221 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:40:13.221 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:13.221 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:40:13.221 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:13.222 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:40:13.222 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 42393sec preferred_lft 42393sec 2023-11-04T01:40:13.223 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::ec4:7aff:fe8f:d3d3/64 scope link 2023-11-04T01:40:13.223 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:13.223 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-04T01:40:13.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:13.224 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-11-04T01:40:13.224 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-11-04T01:40:13.225 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add name ceph-brx type bridge 2023-11-04T01:40:13.225 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip addr flush dev ceph-brx 2023-11-04T01:40:13.225 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set ceph-brx up 2023-11-04T01:40:13.226 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-04T01:40:13.226 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-11-04T01:40:13.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:13.391 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:40:13.418 INFO:teuthology.orchestra.run.smithi077.stdout:1 2023-11-04T01:40:13.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:13.419 DEBUG:teuthology.orchestra.run.smithi077:> route 2023-11-04T01:40:13.485 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2023-11-04T01:40:13.486 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:40:13.486 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:40:13.486 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:40:13.486 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:40:13.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:13.487 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-11-04T01:40:13.488 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-11-04T01:40:13.488 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:40:13.488 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:40:13.489 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:40:13.489 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-11-04T01:40:13.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:13.725 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2023-11-04T01:40:13.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:13.741 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list-id 2023-11-04T01:40:13.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:13.796 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-11-04T01:40:13.796 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-11-04T01:40:13.797 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-04T01:40:13.797 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-11-04T01:40:13.797 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-11-04T01:40:13.879 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-11-04T01:40:13.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:13.880 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-11-04T01:40:13.881 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-11-04T01:40:13.881 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-11-04T01:40:13.881 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-04T01:40:13.882 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-11-04T01:40:13.882 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-11-04T01:40:13.883 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-11-04T01:40:13.883 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-11-04T01:40:14.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:14.025 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-11-04T01:40:14.025 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-11-04T01:40:14.026 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 up 2023-11-04T01:40:14.026 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set dev brx.0 master ceph-brx 2023-11-04T01:40:14.026 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-11-04T01:40:14.068 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-11-04T01:40:14.069 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:40:14.069 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-11-04T01:40:14.123 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-11-04T01:40:14.123 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:40:14.124 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-11-04T01:40:14.178 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:40:14.235 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2023-11-04T01:40:14.236 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2023-11-04T01:40:14.236 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2023-11-04T01:40:14.236 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2023-11-04T01:40:14.236 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2023-11-04T01:40:14.237 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2023-11-04T01:40:14.237 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2023-11-04T01:40:14.237 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2023-11-04T01:40:14.237 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2023-11-04T01:40:14.237 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2023-11-04T01:40:14.238 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2023-11-04T01:40:14.238 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2023-11-04T01:40:14.238 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:40:14.238 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2023-11-04T01:40:14.238 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2023-11-04T01:40:14.239 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2023-11-04T01:40:14.239 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2023-11-04T01:40:14.239 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2023-11-04T01:40:14.239 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2023-11-04T01:40:14.239 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:40:14.240 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:40:14.240 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:40:14.240 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:40:14.240 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2023-11-04T01:40:14.240 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2023-11-04T01:40:14.241 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:40:14.241 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:40:14.241 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:40:14.241 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:40:14.241 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2023-11-04T01:40:14.242 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-04T01:40:14.242 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-04T01:40:14.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:14.243 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-11-04T01:40:14.290 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:40:14.291 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-11-04T01:40:14.333 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:40:14.348 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2023-11-04T01:40:14.348 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2023-11-04T01:40:14.349 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2023-11-04T01:40:14.349 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2023-11-04T01:40:14.349 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2023-11-04T01:40:14.349 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2023-11-04T01:40:14.349 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2023-11-04T01:40:14.350 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2023-11-04T01:40:14.350 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2023-11-04T01:40:14.350 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2023-11-04T01:40:14.350 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2023-11-04T01:40:14.350 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2023-11-04T01:40:14.351 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:40:14.351 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2023-11-04T01:40:14.351 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2023-11-04T01:40:14.351 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2023-11-04T01:40:14.351 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2023-11-04T01:40:14.352 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2023-11-04T01:40:14.352 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2023-11-04T01:40:14.352 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:40:14.352 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:40:14.352 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:40:14.353 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:40:14.353 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2023-11-04T01:40:14.353 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2023-11-04T01:40:14.353 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:40:14.354 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:40:14.354 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:40:14.354 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:40:14.354 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2023-11-04T01:40:14.354 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-04T01:40:14.355 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-04T01:40:14.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:14.356 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-11-04T01:40:14.429 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi077.stderr:2023-11-04T01:40:14.427+0000 7f9abb437480 -1 init, newargv = 0x55dcb1a49800 newargc=15 2023-11-04T01:40:14.430 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi077.stderr:ceph-fuse[125433]: starting ceph client 2023-11-04T01:40:14.435 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi077.stderr:ceph-fuse[125433]: starting fuse 2023-11-04T01:40:15.505 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:40:15.525 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2023-11-04T01:40:15.525 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2023-11-04T01:40:15.525 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2023-11-04T01:40:15.525 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2023-11-04T01:40:15.525 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2023-11-04T01:40:15.526 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2023-11-04T01:40:15.526 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2023-11-04T01:40:15.526 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2023-11-04T01:40:15.526 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2023-11-04T01:40:15.527 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2023-11-04T01:40:15.527 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2023-11-04T01:40:15.527 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2023-11-04T01:40:15.527 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:40:15.527 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2023-11-04T01:40:15.528 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2023-11-04T01:40:15.528 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2023-11-04T01:40:15.528 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2023-11-04T01:40:15.528 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2023-11-04T01:40:15.528 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2023-11-04T01:40:15.529 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:40:15.529 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:40:15.529 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:40:15.529 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:40:15.529 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2023-11-04T01:40:15.529 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2023-11-04T01:40:15.530 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:40:15.530 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:40:15.530 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:40:15.530 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:40:15.530 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2023-11-04T01:40:15.531 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-04T01:40:15.531 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-04T01:40:15.531 INFO:teuthology.orchestra.run.smithi077.stdout:/home/ubuntu/cephtest/mnt.admin 2023-11-04T01:40:15.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:15.532 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-11-04T01:40:15.582 INFO:teuthology.orchestra.run.smithi077.stdout:42 2023-11-04T01:40:15.583 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-11-04T01:40:15.583 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:40:15.584 DEBUG:teuthology.orchestra.run.smithi077:> import glob 2023-11-04T01:40:15.584 DEBUG:teuthology.orchestra.run.smithi077:> import re 2023-11-04T01:40:15.584 DEBUG:teuthology.orchestra.run.smithi077:> import os 2023-11-04T01:40:15.585 DEBUG:teuthology.orchestra.run.smithi077:> import subprocess 2023-11-04T01:40:15.585 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:40:15.585 DEBUG:teuthology.orchestra.run.smithi077:> def _find_admin_socket(client_name): 2023-11-04T01:40:15.586 DEBUG:teuthology.orchestra.run.smithi077:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-11-04T01:40:15.586 DEBUG:teuthology.orchestra.run.smithi077:> files = glob.glob(asok_path) 2023-11-04T01:40:15.587 DEBUG:teuthology.orchestra.run.smithi077:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-11-04T01:40:15.587 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:40:15.587 DEBUG:teuthology.orchestra.run.smithi077:> # Given a non-glob path, it better be there 2023-11-04T01:40:15.588 DEBUG:teuthology.orchestra.run.smithi077:> if "*" not in asok_path: 2023-11-04T01:40:15.588 DEBUG:teuthology.orchestra.run.smithi077:> assert(len(files) == 1) 2023-11-04T01:40:15.588 DEBUG:teuthology.orchestra.run.smithi077:> return files[0] 2023-11-04T01:40:15.589 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:40:15.589 DEBUG:teuthology.orchestra.run.smithi077:> for f in files: 2023-11-04T01:40:15.590 DEBUG:teuthology.orchestra.run.smithi077:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:40:15.590 DEBUG:teuthology.orchestra.run.smithi077:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:40:15.590 DEBUG:teuthology.orchestra.run.smithi077:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:40:15.591 DEBUG:teuthology.orchestra.run.smithi077:> contents = proc_f.read() 2023-11-04T01:40:15.591 DEBUG:teuthology.orchestra.run.smithi077:> if mountpoint in contents: 2023-11-04T01:40:15.591 DEBUG:teuthology.orchestra.run.smithi077:> return f 2023-11-04T01:40:15.592 DEBUG:teuthology.orchestra.run.smithi077:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:40:15.592 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:40:15.592 DEBUG:teuthology.orchestra.run.smithi077:> print(_find_admin_socket("client.admin")) 2023-11-04T01:40:15.593 DEBUG:teuthology.orchestra.run.smithi077:> ' 2023-11-04T01:40:15.708 INFO:teuthology.orchestra.run.smithi077.stdout:/var/run/ceph/ceph-client.admin.125433.asok 2023-11-04T01:40:15.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:15.719 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.125433.asok 2023-11-04T01:40:15.719 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:40:15.720 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.admin.125433.asok status 2023-11-04T01:40:15.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:15.889 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-04T01:40:15.890 INFO:teuthology.orchestra.run.smithi077.stdout: "metadata": { 2023-11-04T01:40:15.890 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:40:15.890 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:40:15.890 INFO:teuthology.orchestra.run.smithi077.stdout: "entity_id": "admin", 2023-11-04T01:40:15.890 INFO:teuthology.orchestra.run.smithi077.stdout: "hostname": "smithi077", 2023-11-04T01:40:15.891 INFO:teuthology.orchestra.run.smithi077.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-11-04T01:40:15.891 INFO:teuthology.orchestra.run.smithi077.stdout: "pid": "125433", 2023-11-04T01:40:15.891 INFO:teuthology.orchestra.run.smithi077.stdout: "root": "/" 2023-11-04T01:40:15.891 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:40:15.891 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_count": 0, 2023-11-04T01:40:15.892 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_pinned_count": 0, 2023-11-04T01:40:15.892 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 4434, 2023-11-04T01:40:15.892 INFO:teuthology.orchestra.run.smithi077.stdout: "inst": { 2023-11-04T01:40:15.892 INFO:teuthology.orchestra.run.smithi077.stdout: "name": { 2023-11-04T01:40:15.892 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "client", 2023-11-04T01:40:15.892 INFO:teuthology.orchestra.run.smithi077.stdout: "num": 4434 2023-11-04T01:40:15.893 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:40:15.893 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2023-11-04T01:40:15.893 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2023-11-04T01:40:15.893 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:40:15.893 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2607776262 2023-11-04T01:40:15.894 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:40:15.894 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:40:15.894 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2023-11-04T01:40:15.894 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2023-11-04T01:40:15.895 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:40:15.895 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2607776262 2023-11-04T01:40:15.895 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:40:15.895 INFO:teuthology.orchestra.run.smithi077.stdout: "inst_str": "client.4434 192.168.0.1:0/2607776262", 2023-11-04T01:40:15.895 INFO:teuthology.orchestra.run.smithi077.stdout: "addr_str": "192.168.0.1:0/2607776262", 2023-11-04T01:40:15.895 INFO:teuthology.orchestra.run.smithi077.stdout: "inode_count": 1, 2023-11-04T01:40:15.896 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_epoch": 7, 2023-11-04T01:40:15.896 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch": 24, 2023-11-04T01:40:15.896 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:40:15.896 INFO:teuthology.orchestra.run.smithi077.stdout: "blocklisted": false, 2023-11-04T01:40:15.896 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs" 2023-11-04T01:40:15.897 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-04T01:40:15.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:15.903 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:40:15.904 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:40:15.904 DEBUG:teuthology.orchestra.run.smithi077:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-11-04T01:40:15.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:15.963 INFO:teuthology.orchestra.run.smithi077.stdout:fuseblk 2023-11-04T01:40:15.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:15.969 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-11-04T01:40:15.970 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:40:15.970 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-11-04T01:40:16.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:16.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:16.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:16.037 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-11-04T01:40:16.075 INFO:teuthology.orchestra.run.smithi077.stdout:# file: . 2023-11-04T01:40:16.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-11-04T01:40:16.076 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:16.076 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:40:16.076 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:40:16.131 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:16.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.269+0000 7f8af83fc640 1 Processor -- start 2023-11-04T01:40:16.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.269+0000 7f8af83fc640 1 -- start start 2023-11-04T01:40:16.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.270+0000 7f8af83fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8af0159c70 0x7f8af00ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:16.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.270+0000 7f8af83fc640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8af006db20 0x7f8af00b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:16.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.270+0000 7f8af83fc640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8af00b0910 0x7f8af015d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:16.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.270+0000 7f8af83fc640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af00b49b0 con 0x7f8af0159c70 2023-11-04T01:40:16.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.270+0000 7f8af83fc640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af00b0da0 con 0x7f8af006db20 2023-11-04T01:40:16.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.270+0000 7f8af83fc640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af00b4110 con 0x7f8af00b0910 2023-11-04T01:40:16.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.270+0000 7f8af6198640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8af0159c70 0x7f8af00ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:16.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.270+0000 7f8af6198640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8af0159c70 0x7f8af00ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46082/0 (socket says 172.21.15.77:46082) 2023-11-04T01:40:16.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.270+0000 7f8af6198640 1 -- 172.21.15.77:0/2881747618 learned_addr learned my addr 172.21.15.77:0/2881747618 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:16.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.270+0000 7f8af5997640 1 --2- 172.21.15.77:0/2881747618 >> v2:172.21.15.122:3300/0 conn(0x7f8af006db20 0x7f8af00b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:16.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.270+0000 7f8af6999640 1 --2- 172.21.15.77:0/2881747618 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8af00b0910 0x7f8af015d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:16.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.270+0000 7f8af6198640 1 -- 172.21.15.77:0/2881747618 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8af00b0910 msgr2=0x7f8af015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:16.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.270+0000 7f8af6198640 1 --2- 172.21.15.77:0/2881747618 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8af00b0910 0x7f8af015d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:16.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.270+0000 7f8af6198640 1 -- 172.21.15.77:0/2881747618 >> v2:172.21.15.122:3300/0 conn(0x7f8af006db20 msgr2=0x7f8af00b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:16.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.270+0000 7f8af6198640 1 --2- 172.21.15.77:0/2881747618 >> v2:172.21.15.122:3300/0 conn(0x7f8af006db20 0x7f8af00b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:16.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.270+0000 7f8af6198640 1 -- 172.21.15.77:0/2881747618 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af00b43f0 con 0x7f8af0159c70 2023-11-04T01:40:16.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.270+0000 7f8af6999640 1 --2- 172.21.15.77:0/2881747618 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8af00b0910 0x7f8af015d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:16.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.271+0000 7f8af6198640 1 --2- 172.21.15.77:0/2881747618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8af0159c70 0x7f8af00ce370 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8af00cf800 tx=0x7f8aec02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=341a1cef6c5ba479 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:16.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.271+0000 7f8af5196640 1 -- 172.21.15.77:0/2881747618 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aec031870 con 0x7f8af0159c70 2023-11-04T01:40:16.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.271+0000 7f8af5196640 1 -- 172.21.15.77:0/2881747618 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aec0319d0 con 0x7f8af0159c70 2023-11-04T01:40:16.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.271+0000 7f8af5196640 1 -- 172.21.15.77:0/2881747618 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aec031d60 con 0x7f8af0159c70 2023-11-04T01:40:16.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.272+0000 7f8af83fc640 1 -- 172.21.15.77:0/2881747618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8af0159c70 msgr2=0x7f8af00ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:16.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.272+0000 7f8af83fc640 1 --2- 172.21.15.77:0/2881747618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8af0159c70 0x7f8af00ce370 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8af00cf800 tx=0x7f8aec02b910 comp rx=0 tx=0).stop 2023-11-04T01:40:16.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.272+0000 7f8af83fc640 1 -- 172.21.15.77:0/2881747618 shutdown_connections 2023-11-04T01:40:16.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.272+0000 7f8af83fc640 1 --2- 172.21.15.77:0/2881747618 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8af00b0910 0x7f8af015d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:16.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.272+0000 7f8af83fc640 1 --2- 172.21.15.77:0/2881747618 >> v2:172.21.15.122:3300/0 conn(0x7f8af006db20 0x7f8af00b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:16.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.272+0000 7f8af83fc640 1 --2- 172.21.15.77:0/2881747618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8af0159c70 0x7f8af00ce370 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:16.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.272+0000 7f8af83fc640 1 -- 172.21.15.77:0/2881747618 >> 172.21.15.77:0/2881747618 conn(0x7f8af00ce950 msgr2=0x7f8af00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:16.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.272+0000 7f8af83fc640 1 -- 172.21.15.77:0/2881747618 shutdown_connections 2023-11-04T01:40:16.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.272+0000 7f8af83fc640 1 -- 172.21.15.77:0/2881747618 wait complete. 2023-11-04T01:40:16.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.273+0000 7f8af83fc640 1 Processor -- start 2023-11-04T01:40:16.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.273+0000 7f8af83fc640 1 -- start start 2023-11-04T01:40:16.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.274+0000 7f8af83fc640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8af006db20 0x7f8af00a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:16.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.274+0000 7f8af83fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8af00b0910 0x7f8af00ac930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:16.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.274+0000 7f8af83fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8af0159c70 0x7f8af014f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:16.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.274+0000 7f8af83fc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af00a74d0 con 0x7f8af0159c70 2023-11-04T01:40:16.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.274+0000 7f8af83fc640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af00a8050 con 0x7f8af00b0910 2023-11-04T01:40:16.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.274+0000 7f8af83fc640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af00a7720 con 0x7f8af006db20 2023-11-04T01:40:16.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.274+0000 7f8af6999640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8af0159c70 0x7f8af014f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:16.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.274+0000 7f8af6999640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8af0159c70 0x7f8af014f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46086/0 (socket says 172.21.15.77:46086) 2023-11-04T01:40:16.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.274+0000 7f8af6999640 1 -- 172.21.15.77:0/2350253949 learned_addr learned my addr 172.21.15.77:0/2350253949 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:16.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.274+0000 7f8af5997640 1 --2- 172.21.15.77:0/2350253949 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8af00b0910 0x7f8af00ac930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:16.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.274+0000 7f8af6198640 1 --2- 172.21.15.77:0/2350253949 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8af006db20 0x7f8af00a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:16.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.274+0000 7f8af6999640 1 -- 172.21.15.77:0/2350253949 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8af006db20 msgr2=0x7f8af00a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:16.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.274+0000 7f8af6999640 1 --2- 172.21.15.77:0/2350253949 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8af006db20 0x7f8af00a9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:16.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.274+0000 7f8af6999640 1 -- 172.21.15.77:0/2350253949 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8af00b0910 msgr2=0x7f8af00ac930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:16.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.274+0000 7f8af6999640 1 --2- 172.21.15.77:0/2350253949 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8af00b0910 0x7f8af00ac930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:16.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.274+0000 7f8af6999640 1 -- 172.21.15.77:0/2350253949 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aec0094d0 con 0x7f8af0159c70 2023-11-04T01:40:16.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.274+0000 7f8af5997640 1 --2- 172.21.15.77:0/2350253949 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8af00b0910 0x7f8af00ac930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:16.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.274+0000 7f8af6999640 1 --2- 172.21.15.77:0/2350253949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8af0159c70 0x7f8af014f340 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800cf20 tx=0x7f8ae800a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:16.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.274+0000 7f8ae6ffd640 1 -- 172.21.15.77:0/2350253949 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae800d840 con 0x7f8af0159c70 2023-11-04T01:40:16.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.274+0000 7f8ae6ffd640 1 -- 172.21.15.77:0/2350253949 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae800d9a0 con 0x7f8af0159c70 2023-11-04T01:40:16.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.274+0000 7f8ae6ffd640 1 -- 172.21.15.77:0/2350253949 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae800dd50 con 0x7f8af0159c70 2023-11-04T01:40:16.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.274+0000 7f8af83fc640 1 -- 172.21.15.77:0/2350253949 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af00a7a00 con 0x7f8af0159c70 2023-11-04T01:40:16.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.275+0000 7f8af83fc640 1 -- 172.21.15.77:0/2350253949 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af00ace70 con 0x7f8af0159c70 2023-11-04T01:40:16.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.275+0000 7f8af83fc640 1 -- 172.21.15.77:0/2350253949 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af0074290 con 0x7f8af0159c70 2023-11-04T01:40:16.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.276+0000 7f8ae6ffd640 1 -- 172.21.15.77:0/2350253949 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8ae801e3b0 con 0x7f8af0159c70 2023-11-04T01:40:16.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.276+0000 7f8ae6ffd640 1 --2- 172.21.15.77:0/2350253949 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8ad406ae70 0x7f8ad406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:16.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.276+0000 7f8ae6ffd640 1 -- 172.21.15.77:0/2350253949 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8ae808a3d0 con 0x7f8af0159c70 2023-11-04T01:40:16.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.276+0000 7f8af6198640 1 --2- 172.21.15.77:0/2350253949 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8ad406ae70 0x7f8ad406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:16.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.277+0000 7f8af6198640 1 --2- 172.21.15.77:0/2350253949 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8ad406ae70 0x7f8ad406d330 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8aec036000 tx=0x7f8aec03c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:16.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.280+0000 7f8ae6ffd640 1 -- 172.21.15.77:0/2350253949 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8ae8055190 con 0x7f8af0159c70 2023-11-04T01:40:16.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.447+0000 7f8af83fc640 1 -- 172.21.15.77:0/2350253949 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8af00a8190 con 0x7f8af0159c70 2023-11-04T01:40:16.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.448+0000 7f8ae6ffd640 1 -- 172.21.15.77:0/2350253949 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f8ae80587b0 con 0x7f8af0159c70 2023-11-04T01:40:16.450 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:16.450 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":24,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:40:10.153949+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:40:02.810971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:40:04.003979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:40:07.734355+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:16.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.450+0000 7f8af83fc640 1 -- 172.21.15.77:0/2350253949 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8ad406ae70 msgr2=0x7f8ad406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:16.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.450+0000 7f8af83fc640 1 --2- 172.21.15.77:0/2350253949 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8ad406ae70 0x7f8ad406d330 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8aec036000 tx=0x7f8aec03c040 comp rx=0 tx=0).stop 2023-11-04T01:40:16.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.450+0000 7f8af83fc640 1 -- 172.21.15.77:0/2350253949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8af0159c70 msgr2=0x7f8af014f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:16.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.450+0000 7f8af83fc640 1 --2- 172.21.15.77:0/2350253949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8af0159c70 0x7f8af014f340 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800cf20 tx=0x7f8ae800a7d0 comp rx=0 tx=0).stop 2023-11-04T01:40:16.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.450+0000 7f8af83fc640 1 -- 172.21.15.77:0/2350253949 shutdown_connections 2023-11-04T01:40:16.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.450+0000 7f8af83fc640 1 --2- 172.21.15.77:0/2350253949 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8ad406ae70 0x7f8ad406d330 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:16.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.450+0000 7f8af83fc640 1 --2- 172.21.15.77:0/2350253949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8af0159c70 0x7f8af014f340 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:16.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.450+0000 7f8af83fc640 1 --2- 172.21.15.77:0/2350253949 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8af00b0910 0x7f8af00ac930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:16.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.450+0000 7f8af83fc640 1 --2- 172.21.15.77:0/2350253949 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8af006db20 0x7f8af00a9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:16.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.450+0000 7f8af83fc640 1 -- 172.21.15.77:0/2350253949 >> 172.21.15.77:0/2350253949 conn(0x7f8af00ce950 msgr2=0x7f8af006c200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:16.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.450+0000 7f8af83fc640 1 -- 172.21.15.77:0/2350253949 shutdown_connections 2023-11-04T01:40:16.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.450+0000 7f8af83fc640 1 -- 172.21.15.77:0/2350253949 wait complete. 2023-11-04T01:40:16.462 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:40:02.810971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:40:04.003979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:40:07.734355+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:40:16.463 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:40:16.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.563+0000 7f51cf675640 1 Processor -- start 2023-11-04T01:40:16.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.564+0000 7f51cf675640 1 -- start start 2023-11-04T01:40:16.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.564+0000 7f51cf675640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f51c8153e60 0x7f51c815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:16.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.564+0000 7f51cf675640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f51c80b4880 0x7f51c80b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:16.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.564+0000 7f51cf675640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c80cde60 con 0x7f51c80cd6d0 2023-11-04T01:40:16.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.564+0000 7f51cf675640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c8160f90 con 0x7f51c8153e60 2023-11-04T01:40:16.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.564+0000 7f51cf675640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c80b5200 con 0x7f51c80b4880 2023-11-04T01:40:16.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.565+0000 7f51cd411640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f51c8153e60 0x7f51c815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:16.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.565+0000 7f51ccc10640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f51c80cd6d0 0x7f51c8161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52028/0 (socket says 172.21.15.77:52028) 2023-11-04T01:40:16.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.565+0000 7f51ccc10640 1 -- 172.21.15.77:0/1027517112 learned_addr learned my addr 172.21.15.77:0/1027517112 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:16.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.565+0000 7f51cd411640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f51c8153e60 0x7f51c815dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46098/0 (socket says 172.21.15.77:46098) 2023-11-04T01:40:16.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.565+0000 7f51cdc12640 1 --2- 172.21.15.77:0/1027517112 >> v2:172.21.15.122:3300/0 conn(0x7f51c80b4880 0x7f51c80b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:16.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.565+0000 7f51cd411640 1 -- 172.21.15.77:0/1027517112 >> v2:172.21.15.122:3300/0 conn(0x7f51c80b4880 msgr2=0x7f51c80b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:16.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.565+0000 7f51cd411640 1 --2- 172.21.15.77:0/1027517112 >> v2:172.21.15.122:3300/0 conn(0x7f51c80b4880 0x7f51c80b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:16.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.565+0000 7f51cd411640 1 -- 172.21.15.77:0/1027517112 >> v1:172.21.15.77:6789/0 conn(0x7f51c80cd6d0 legacy=0x7f51c8161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:16.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.565+0000 7f51bffff640 1 -- 172.21.15.77:0/1027517112 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1547604664 0 0) 0x7f51c80cde60 con 0x7f51c80cd6d0 2023-11-04T01:40:16.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.565+0000 7f51cd411640 1 -- 172.21.15.77:0/1027517112 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c815e400 con 0x7f51c8153e60 2023-11-04T01:40:16.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.566+0000 7f51cd411640 1 --2- 172.21.15.77:0/1027517112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51c8153e60 0x7f51c815dec0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f51c80b8f40 tx=0x7f51c402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e6519f305a9be9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:16.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.566+0000 7f51bffff640 1 -- 172.21.15.77:0/1027517112 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c402cc80 con 0x7f51c8153e60 2023-11-04T01:40:16.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.566+0000 7f51bffff640 1 -- 172.21.15.77:0/1027517112 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c402cde0 con 0x7f51c8153e60 2023-11-04T01:40:16.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.566+0000 7f51bffff640 1 -- 172.21.15.77:0/1027517112 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c4034660 con 0x7f51c8153e60 2023-11-04T01:40:16.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.566+0000 7f51cf675640 1 -- 172.21.15.77:0/1027517112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51c8153e60 msgr2=0x7f51c815dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:16.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.566+0000 7f51cf675640 1 --2- 172.21.15.77:0/1027517112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51c8153e60 0x7f51c815dec0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f51c80b8f40 tx=0x7f51c402bed0 comp rx=0 tx=0).stop 2023-11-04T01:40:16.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.566+0000 7f51cf675640 1 -- 172.21.15.77:0/1027517112 shutdown_connections 2023-11-04T01:40:16.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.566+0000 7f51cf675640 1 --2- 172.21.15.77:0/1027517112 >> v2:172.21.15.122:3300/0 conn(0x7f51c80b4880 0x7f51c80b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:16.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.566+0000 7f51cf675640 1 --2- 172.21.15.77:0/1027517112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51c8153e60 0x7f51c815dec0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:16.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.566+0000 7f51cf675640 1 -- 172.21.15.77:0/1027517112 >> 172.21.15.77:0/1027517112 conn(0x7f51c80cf880 msgr2=0x7f51c80cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:16.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.566+0000 7f51cf675640 1 -- 172.21.15.77:0/1027517112 shutdown_connections 2023-11-04T01:40:16.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.566+0000 7f51cf675640 1 -- 172.21.15.77:0/1027517112 wait complete. 2023-11-04T01:40:16.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.567+0000 7f51cf675640 1 Processor -- start 2023-11-04T01:40:16.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.568+0000 7f51cf675640 1 -- start start 2023-11-04T01:40:16.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.568+0000 7f51cf675640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51c80b4880 0x7f51c80cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:16.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.568+0000 7f51cf675640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51c80cd6d0 0x7f51c8153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:16.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.568+0000 7f51cf675640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f51c8153e60 0x7f51c81f29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:16.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.568+0000 7f51cf675640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c80ca400 con 0x7f51c80cd6d0 2023-11-04T01:40:16.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.568+0000 7f51cf675640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c80ca6e0 con 0x7f51c80b4880 2023-11-04T01:40:16.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.568+0000 7f51cf675640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c80ca9c0 con 0x7f51c8153e60 2023-11-04T01:40:16.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.568+0000 7f51ccc10640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51c80cd6d0 0x7f51c8153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:16.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.568+0000 7f51ccc10640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51c80cd6d0 0x7f51c8153070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46104/0 (socket says 172.21.15.77:46104) 2023-11-04T01:40:16.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.568+0000 7f51ccc10640 1 -- 172.21.15.77:0/3641366551 learned_addr learned my addr 172.21.15.77:0/3641366551 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:16.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.568+0000 7f51cd411640 1 --2- 172.21.15.77:0/3641366551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51c80b4880 0x7f51c80cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:16.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.569+0000 7f51cdc12640 1 --2- 172.21.15.77:0/3641366551 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f51c8153e60 0x7f51c81f29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:16.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.569+0000 7f51ccc10640 1 -- 172.21.15.77:0/3641366551 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f51c8153e60 msgr2=0x7f51c81f29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:16.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.569+0000 7f51ccc10640 1 --2- 172.21.15.77:0/3641366551 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f51c8153e60 0x7f51c81f29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:16.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.569+0000 7f51ccc10640 1 -- 172.21.15.77:0/3641366551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51c80b4880 msgr2=0x7f51c80cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:16.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.569+0000 7f51ccc10640 1 --2- 172.21.15.77:0/3641366551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51c80b4880 0x7f51c80cbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:16.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.569+0000 7f51ccc10640 1 -- 172.21.15.77:0/3641366551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c4009a70 con 0x7f51c80cd6d0 2023-11-04T01:40:16.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.569+0000 7f51cdc12640 1 --2- 172.21.15.77:0/3641366551 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f51c8153e60 0x7f51c81f29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:16.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.569+0000 7f51ccc10640 1 --2- 172.21.15.77:0/3641366551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51c80cd6d0 0x7f51c8153070 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f51b800c4b0 tx=0x7f51b800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:16.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.569+0000 7f51bdffb640 1 -- 172.21.15.77:0/3641366551 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b80074e0 con 0x7f51c80cd6d0 2023-11-04T01:40:16.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.569+0000 7f51bdffb640 1 -- 172.21.15.77:0/3641366551 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b8007660 con 0x7f51c80cd6d0 2023-11-04T01:40:16.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.569+0000 7f51cf675640 1 -- 172.21.15.77:0/3641366551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c80caca0 con 0x7f51c80cd6d0 2023-11-04T01:40:16.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.569+0000 7f51bdffb640 1 -- 172.21.15.77:0/3641366551 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b8004a20 con 0x7f51c80cd6d0 2023-11-04T01:40:16.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.569+0000 7f51cf675640 1 -- 172.21.15.77:0/3641366551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c80cc400 con 0x7f51c80cd6d0 2023-11-04T01:40:16.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.570+0000 7f51cf675640 1 -- 172.21.15.77:0/3641366551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c81f62a0 con 0x7f51c80cd6d0 2023-11-04T01:40:16.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.570+0000 7f51bdffb640 1 -- 172.21.15.77:0/3641366551 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f51b8004b80 con 0x7f51c80cd6d0 2023-11-04T01:40:16.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.571+0000 7f51bdffb640 1 --2- 172.21.15.77:0/3641366551 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f51ac06ae70 0x7f51ac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:16.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.571+0000 7f51bdffb640 1 -- 172.21.15.77:0/3641366551 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f51b8088e20 con 0x7f51c80cd6d0 2023-11-04T01:40:16.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.571+0000 7f51cd411640 1 --2- 172.21.15.77:0/3641366551 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f51ac06ae70 0x7f51ac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:16.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.571+0000 7f51cd411640 1 --2- 172.21.15.77:0/3641366551 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f51ac06ae70 0x7f51ac06d330 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f51c4036000 tx=0x7f51c4030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:16.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.575+0000 7f51bdffb640 1 -- 172.21.15.77:0/3641366551 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f51c81f62a0 con 0x7f51c80cd6d0 2023-11-04T01:40:16.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.741+0000 7f51cf675640 1 -- 172.21.15.77:0/3641366551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f51c81f62a0 con 0x7f51c80cd6d0 2023-11-04T01:40:16.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.741+0000 7f51bdffb640 1 -- 172.21.15.77:0/3641366551 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f51c81f62a0 con 0x7f51c80cd6d0 2023-11-04T01:40:16.744 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:40:16.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.743+0000 7f51cf675640 1 -- 172.21.15.77:0/3641366551 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f51ac06ae70 msgr2=0x7f51ac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:16.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.743+0000 7f51cf675640 1 --2- 172.21.15.77:0/3641366551 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f51ac06ae70 0x7f51ac06d330 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f51c4036000 tx=0x7f51c4030000 comp rx=0 tx=0).stop 2023-11-04T01:40:16.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.743+0000 7f51cf675640 1 -- 172.21.15.77:0/3641366551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51c80cd6d0 msgr2=0x7f51c8153070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:16.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.743+0000 7f51cf675640 1 --2- 172.21.15.77:0/3641366551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51c80cd6d0 0x7f51c8153070 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f51b800c4b0 tx=0x7f51b800c970 comp rx=0 tx=0).stop 2023-11-04T01:40:16.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.744+0000 7f51cf675640 1 -- 172.21.15.77:0/3641366551 shutdown_connections 2023-11-04T01:40:16.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.744+0000 7f51cf675640 1 --2- 172.21.15.77:0/3641366551 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f51ac06ae70 0x7f51ac06d330 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:16.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.744+0000 7f51cf675640 1 --2- 172.21.15.77:0/3641366551 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f51c8153e60 0x7f51c81f29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:16.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.744+0000 7f51cf675640 1 --2- 172.21.15.77:0/3641366551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51c80cd6d0 0x7f51c8153070 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:16.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.744+0000 7f51cf675640 1 --2- 172.21.15.77:0/3641366551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51c80b4880 0x7f51c80cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:16.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.744+0000 7f51cf675640 1 -- 172.21.15.77:0/3641366551 >> 172.21.15.77:0/3641366551 conn(0x7f51c80cf880 msgr2=0x7f51c815fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:16.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.744+0000 7f51cf675640 1 -- 172.21.15.77:0/3641366551 shutdown_connections 2023-11-04T01:40:16.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.744+0000 7f51cf675640 1 -- 172.21.15.77:0/3641366551 wait complete. 2023-11-04T01:40:16.756 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:40:16.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.857+0000 7fc7bc644640 1 Processor -- start 2023-11-04T01:40:16.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.857+0000 7fc7bc644640 1 -- start start 2023-11-04T01:40:16.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.858+0000 7fc7bc644640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc7b4153e60 0x7fc7b415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:16.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.858+0000 7fc7bc644640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc7b40b4880 0x7fc7b40b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:16.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.858+0000 7fc7bc644640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b40cde60 con 0x7fc7b40cd6d0 2023-11-04T01:40:16.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.858+0000 7fc7bc644640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b4160f90 con 0x7fc7b4153e60 2023-11-04T01:40:16.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.858+0000 7fc7bc644640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b40b5200 con 0x7fc7b40b4880 2023-11-04T01:40:16.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.858+0000 7fc7b9bdf640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc7b40cd6d0 0x7fc7b4161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52038/0 (socket says 172.21.15.77:52038) 2023-11-04T01:40:16.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.858+0000 7fc7b9bdf640 1 -- 172.21.15.77:0/3418772687 learned_addr learned my addr 172.21.15.77:0/3418772687 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:16.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.858+0000 7fc7babe1640 1 --2- 172.21.15.77:0/3418772687 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc7b40b4880 0x7fc7b40b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:16.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.858+0000 7fc7ba3e0640 1 --2- 172.21.15.77:0/3418772687 >> v2:172.21.15.122:3300/0 conn(0x7fc7b4153e60 0x7fc7b415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:16.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.858+0000 7fc7b93de640 1 -- 172.21.15.77:0/3418772687 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 160848829 0 0) 0x7fc7b40cde60 con 0x7fc7b40cd6d0 2023-11-04T01:40:16.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.858+0000 7fc7b93de640 1 -- 172.21.15.77:0/3418772687 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7a0003520 con 0x7fc7b40cd6d0 2023-11-04T01:40:16.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.858+0000 7fc7b93de640 1 -- 172.21.15.77:0/3418772687 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3125082658 0 0) 0x7fc7a0003520 con 0x7fc7b40cd6d0 2023-11-04T01:40:16.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.858+0000 7fc7b93de640 1 -- 172.21.15.77:0/3418772687 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc7b40b4880 msgr2=0x7fc7b40b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:16.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.858+0000 7fc7b93de640 1 --2- 172.21.15.77:0/3418772687 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc7b40b4880 0x7fc7b40b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:16.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.858+0000 7fc7b93de640 1 -- 172.21.15.77:0/3418772687 >> v2:172.21.15.122:3300/0 conn(0x7fc7b4153e60 msgr2=0x7fc7b415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:16.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.858+0000 7fc7b93de640 1 --2- 172.21.15.77:0/3418772687 >> v2:172.21.15.122:3300/0 conn(0x7fc7b4153e60 0x7fc7b415dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:16.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.858+0000 7fc7b93de640 1 -- 172.21.15.77:0/3418772687 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b415e400 con 0x7fc7b40cd6d0 2023-11-04T01:40:16.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.858+0000 7fc7b93de640 1 -- 172.21.15.77:0/3418772687 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7fc7a4001670 con 0x7fc7b40cd6d0 2023-11-04T01:40:16.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.858+0000 7fc7b93de640 1 -- 172.21.15.77:0/3418772687 >> v1:172.21.15.77:6789/0 conn(0x7fc7b40cd6d0 legacy=0x7fc7b4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:16.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.858+0000 7fc7b93de640 1 --2- 172.21.15.77:0/3418772687 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc7b40b4880 0x7fc7a0003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:16.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.858+0000 7fc7b93de640 1 --2- 172.21.15.77:0/3418772687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7a0003ef0 0x7fc7a00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:16.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.858+0000 7fc7b93de640 1 --2- 172.21.15.77:0/3418772687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7a0004d00 0x7fc7a0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:16.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.858+0000 7fc7b93de640 1 -- 172.21.15.77:0/3418772687 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b4160f90 con 0x7fc7a0003ef0 2023-11-04T01:40:16.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.858+0000 7fc7b93de640 1 -- 172.21.15.77:0/3418772687 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b40b5200 con 0x7fc7a0004d00 2023-11-04T01:40:16.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.858+0000 7fc7b93de640 1 -- 172.21.15.77:0/3418772687 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a000b980 con 0x7fc7b40b4880 2023-11-04T01:40:16.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.858+0000 7fc7b9bdf640 1 --2- 172.21.15.77:0/3418772687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7a0003ef0 0x7fc7a00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:16.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.858+0000 7fc7ba3e0640 1 --2- 172.21.15.77:0/3418772687 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc7b40b4880 0x7fc7a0003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:16.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.858+0000 7fc7babe1640 1 --2- 172.21.15.77:0/3418772687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7a0004d00 0x7fc7a0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:16.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.859+0000 7fc7b9bdf640 1 -- 172.21.15.77:0/3418772687 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc7b40b4880 msgr2=0x7fc7a0003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:16.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.859+0000 7fc7b9bdf640 1 --2- 172.21.15.77:0/3418772687 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc7b40b4880 0x7fc7a0003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:16.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.859+0000 7fc7b9bdf640 1 -- 172.21.15.77:0/3418772687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7a0004d00 msgr2=0x7fc7a0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:16.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.859+0000 7fc7b9bdf640 1 --2- 172.21.15.77:0/3418772687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7a0004d00 0x7fc7a0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:16.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.859+0000 7fc7b9bdf640 1 -- 172.21.15.77:0/3418772687 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a0003520 con 0x7fc7a0003ef0 2023-11-04T01:40:16.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.859+0000 7fc7b9bdf640 1 --2- 172.21.15.77:0/3418772687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7a0003ef0 0x7fc7a00047c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc7a400c210 tx=0x7fc7a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a4a70879146871 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:16.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.859+0000 7fc7b93de640 1 -- 172.21.15.77:0/3418772687 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4005ad0 con 0x7fc7a0003ef0 2023-11-04T01:40:16.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.859+0000 7fc7b93de640 1 -- 172.21.15.77:0/3418772687 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a4005c50 con 0x7fc7a0003ef0 2023-11-04T01:40:16.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.859+0000 7fc7b93de640 1 -- 172.21.15.77:0/3418772687 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a402c880 con 0x7fc7a0003ef0 2023-11-04T01:40:16.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.860+0000 7fc7bc644640 1 -- 172.21.15.77:0/3418772687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7a0003ef0 msgr2=0x7fc7a00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:16.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.860+0000 7fc7bc644640 1 --2- 172.21.15.77:0/3418772687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7a0003ef0 0x7fc7a00047c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc7a400c210 tx=0x7fc7a00057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:16.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.860+0000 7fc7babe1640 1 -- 172.21.15.77:0/3418772687 reap_dead start 2023-11-04T01:40:16.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.860+0000 7fc7bc644640 1 -- 172.21.15.77:0/3418772687 shutdown_connections 2023-11-04T01:40:16.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.860+0000 7fc7bc644640 1 -- 172.21.15.77:0/3418772687 >> 172.21.15.77:0/3418772687 conn(0x7fc7b40cf880 msgr2=0x7fc7b40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:16.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.860+0000 7fc7bc644640 1 -- 172.21.15.77:0/3418772687 shutdown_connections 2023-11-04T01:40:16.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.860+0000 7fc7bc644640 1 -- 172.21.15.77:0/3418772687 wait complete. 2023-11-04T01:40:16.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.861+0000 7fc7bc644640 1 Processor -- start 2023-11-04T01:40:16.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.861+0000 7fc7bc644640 1 -- start start 2023-11-04T01:40:16.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.862+0000 7fc7bc644640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7a0003ef0 0x7fc7b4154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:16.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.862+0000 7fc7bc644640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7b4154f60 0x7fc7b40cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:16.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.862+0000 7fc7bc644640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc7b40c8b00 0x7fc7b40c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:16.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.862+0000 7fc7bc644640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b40c94c0 con 0x7fc7b4154f60 2023-11-04T01:40:16.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.862+0000 7fc7bc644640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b40ccba0 con 0x7fc7a0003ef0 2023-11-04T01:40:16.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.862+0000 7fc7bc644640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b41f34d0 con 0x7fc7b40c8b00 2023-11-04T01:40:16.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.862+0000 7fc7b9bdf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7b4154f60 0x7fc7b40cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:16.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.862+0000 7fc7b9bdf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7b4154f60 0x7fc7b40cbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46118/0 (socket says 172.21.15.77:46118) 2023-11-04T01:40:16.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.862+0000 7fc7b9bdf640 1 -- 172.21.15.77:0/2921771634 learned_addr learned my addr 172.21.15.77:0/2921771634 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:16.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.862+0000 7fc7ba3e0640 1 --2- 172.21.15.77:0/2921771634 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7a0003ef0 0x7fc7b4154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:16.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.862+0000 7fc7babe1640 1 --2- 172.21.15.77:0/2921771634 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc7b40c8b00 0x7fc7b40c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:16.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.862+0000 7fc7b9bdf640 1 -- 172.21.15.77:0/2921771634 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc7b40c8b00 msgr2=0x7fc7b40c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:16.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.862+0000 7fc7b9bdf640 1 --2- 172.21.15.77:0/2921771634 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc7b40c8b00 0x7fc7b40c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:16.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.862+0000 7fc7b9bdf640 1 -- 172.21.15.77:0/2921771634 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7a0003ef0 msgr2=0x7fc7b4154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:16.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.862+0000 7fc7b9bdf640 1 --2- 172.21.15.77:0/2921771634 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7a0003ef0 0x7fc7b4154240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:16.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.862+0000 7fc7b9bdf640 1 -- 172.21.15.77:0/2921771634 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b41f2950 con 0x7fc7b4154f60 2023-11-04T01:40:16.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.862+0000 7fc7ba3e0640 1 --2- 172.21.15.77:0/2921771634 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7a0003ef0 0x7fc7b4154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:16.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.863+0000 7fc7b9bdf640 1 --2- 172.21.15.77:0/2921771634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7b4154f60 0x7fc7b40cbeb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc7a400c210 tx=0x7fc7b41610d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:16.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.863+0000 7fc7aaffd640 1 -- 172.21.15.77:0/2921771634 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a403c040 con 0x7fc7b4154f60 2023-11-04T01:40:16.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.863+0000 7fc7aaffd640 1 -- 172.21.15.77:0/2921771634 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a402dd20 con 0x7fc7b4154f60 2023-11-04T01:40:16.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.863+0000 7fc7bc644640 1 -- 172.21.15.77:0/2921771634 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b41f2c30 con 0x7fc7b4154f60 2023-11-04T01:40:16.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.863+0000 7fc7aaffd640 1 -- 172.21.15.77:0/2921771634 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4007290 con 0x7fc7b4154f60 2023-11-04T01:40:16.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.863+0000 7fc7bc644640 1 -- 172.21.15.77:0/2921771634 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b41f31f0 con 0x7fc7b4154f60 2023-11-04T01:40:16.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.864+0000 7fc7bc644640 1 -- 172.21.15.77:0/2921771634 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b4074290 con 0x7fc7b4154f60 2023-11-04T01:40:16.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.864+0000 7fc7aaffd640 1 -- 172.21.15.77:0/2921771634 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc7a4032070 con 0x7fc7b4154f60 2023-11-04T01:40:16.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.865+0000 7fc7aaffd640 1 --2- 172.21.15.77:0/2921771634 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc79806aea0 0x7fc79806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:16.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.865+0000 7fc7aaffd640 1 -- 172.21.15.77:0/2921771634 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc7a40aa9b0 con 0x7fc7b4154f60 2023-11-04T01:40:16.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.865+0000 7fc7ba3e0640 1 --2- 172.21.15.77:0/2921771634 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc79806aea0 0x7fc79806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:16.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.865+0000 7fc7ba3e0640 1 --2- 172.21.15.77:0/2921771634 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc79806aea0 0x7fc79806d360 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0009bc0 tx=0x7fc7b0008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:16.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:16.869+0000 7fc7aaffd640 1 -- 172.21.15.77:0/2921771634 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc7a4075800 con 0x7fc7b4154f60 2023-11-04T01:40:17.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.033+0000 7fc7bc644640 1 -- 172.21.15.77:0/2921771634 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc7b40d0b80 con 0x7fc7b4154f60 2023-11-04T01:40:17.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.033+0000 7fc7aaffd640 1 -- 172.21.15.77:0/2921771634 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc7a4078e20 con 0x7fc7b4154f60 2023-11-04T01:40:17.035 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:40:17.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.035+0000 7fc7bc644640 1 -- 172.21.15.77:0/2921771634 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc79806aea0 msgr2=0x7fc79806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:17.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.035+0000 7fc7bc644640 1 --2- 172.21.15.77:0/2921771634 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc79806aea0 0x7fc79806d360 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0009bc0 tx=0x7fc7b0008040 comp rx=0 tx=0).stop 2023-11-04T01:40:17.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.035+0000 7fc7bc644640 1 -- 172.21.15.77:0/2921771634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7b4154f60 msgr2=0x7fc7b40cbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:17.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.035+0000 7fc7bc644640 1 --2- 172.21.15.77:0/2921771634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7b4154f60 0x7fc7b40cbeb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc7a400c210 tx=0x7fc7b41610d0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.035+0000 7fc7bc644640 1 -- 172.21.15.77:0/2921771634 shutdown_connections 2023-11-04T01:40:17.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.035+0000 7fc7bc644640 1 --2- 172.21.15.77:0/2921771634 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc79806aea0 0x7fc79806d360 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.035+0000 7fc7bc644640 1 --2- 172.21.15.77:0/2921771634 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc7b40c8b00 0x7fc7b40c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.035+0000 7fc7bc644640 1 --2- 172.21.15.77:0/2921771634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7b4154f60 0x7fc7b40cbeb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.035+0000 7fc7bc644640 1 --2- 172.21.15.77:0/2921771634 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7a0003ef0 0x7fc7b4154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.035+0000 7fc7bc644640 1 -- 172.21.15.77:0/2921771634 >> 172.21.15.77:0/2921771634 conn(0x7fc7b40cf880 msgr2=0x7fc7b40b7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:17.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.035+0000 7fc7bc644640 1 -- 172.21.15.77:0/2921771634 shutdown_connections 2023-11-04T01:40:17.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.035+0000 7fc7bc644640 1 -- 172.21.15.77:0/2921771634 wait complete. 2023-11-04T01:40:17.047 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:40:17.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.148+0000 7fa3b9a4f640 1 Processor -- start 2023-11-04T01:40:17.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.148+0000 7fa3b9a4f640 1 -- start start 2023-11-04T01:40:17.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.149+0000 7fa3b9a4f640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa3b4153e60 0x7fa3b415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:17.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.149+0000 7fa3b9a4f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b40cde60 con 0x7fa3b40b4880 2023-11-04T01:40:17.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.149+0000 7fa3b9a4f640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b4160f90 con 0x7fa3b40cd6d0 2023-11-04T01:40:17.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.149+0000 7fa3b9a4f640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b415e400 con 0x7fa3b4153e60 2023-11-04T01:40:17.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.149+0000 7fa3b37fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fa3b40b4880 0x7fa3b40d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52048/0 (socket says 172.21.15.77:52048) 2023-11-04T01:40:17.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.149+0000 7fa3b37fe640 1 -- 172.21.15.77:0/1987630996 learned_addr learned my addr 172.21.15.77:0/1987630996 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:17.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.149+0000 7fa3b2ffd640 1 --2- 172.21.15.77:0/1987630996 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa3b4153e60 0x7fa3b415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:17.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.149+0000 7fa3b1ffb640 1 -- 172.21.15.77:0/1987630996 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 476716479 0 0) 0x7fa3b40cde60 con 0x7fa3b40b4880 2023-11-04T01:40:17.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.149+0000 7fa3b1ffb640 1 -- 172.21.15.77:0/1987630996 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa39c003520 con 0x7fa3b40b4880 2023-11-04T01:40:17.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.149+0000 7fa3b2ffd640 1 -- 172.21.15.77:0/1987630996 >> v1:172.21.15.122:6789/0 conn(0x7fa3b40cd6d0 legacy=0x7fa3b4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:17.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.149+0000 7fa3b2ffd640 1 -- 172.21.15.77:0/1987630996 >> v1:172.21.15.77:6789/0 conn(0x7fa3b40b4880 legacy=0x7fa3b40d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:17.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.149+0000 7fa3b1ffb640 1 -- 172.21.15.77:0/1987630996 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1015517180 0 0) 0x7fa3b4160f90 con 0x7fa3b40cd6d0 2023-11-04T01:40:17.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.149+0000 7fa3b2ffd640 1 -- 172.21.15.77:0/1987630996 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b40ce090 con 0x7fa3b4153e60 2023-11-04T01:40:17.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.150+0000 7fa3b2ffd640 1 --2- 172.21.15.77:0/1987630996 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa3b4153e60 0x7fa3b415dec0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa3a40097d0 tx=0x7fa3a402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26dc94009b7fb4ce server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:17.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.150+0000 7fa3b1ffb640 1 -- 172.21.15.77:0/1987630996 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4031890 con 0x7fa3b4153e60 2023-11-04T01:40:17.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.150+0000 7fa3b1ffb640 1 -- 172.21.15.77:0/1987630996 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a40319f0 con 0x7fa3b4153e60 2023-11-04T01:40:17.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.150+0000 7fa3b1ffb640 1 -- 172.21.15.77:0/1987630996 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4031d60 con 0x7fa3b4153e60 2023-11-04T01:40:17.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.151+0000 7fa3b9a4f640 1 -- 172.21.15.77:0/1987630996 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa3b4153e60 msgr2=0x7fa3b415dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:17.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.151+0000 7fa3b9a4f640 1 --2- 172.21.15.77:0/1987630996 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa3b4153e60 0x7fa3b415dec0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa3a40097d0 tx=0x7fa3a402b930 comp rx=0 tx=0).stop 2023-11-04T01:40:17.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.151+0000 7fa3b9a4f640 1 -- 172.21.15.77:0/1987630996 shutdown_connections 2023-11-04T01:40:17.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.151+0000 7fa3b9a4f640 1 --2- 172.21.15.77:0/1987630996 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa3b4153e60 0x7fa3b415dec0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.151+0000 7fa3b9a4f640 1 -- 172.21.15.77:0/1987630996 >> 172.21.15.77:0/1987630996 conn(0x7fa3b40cf880 msgr2=0x7fa3b40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:17.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.151+0000 7fa3b9a4f640 1 -- 172.21.15.77:0/1987630996 shutdown_connections 2023-11-04T01:40:17.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.151+0000 7fa3b9a4f640 1 -- 172.21.15.77:0/1987630996 wait complete. 2023-11-04T01:40:17.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.152+0000 7fa3b9a4f640 1 Processor -- start 2023-11-04T01:40:17.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.152+0000 7fa3b9a4f640 1 -- start start 2023-11-04T01:40:17.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.153+0000 7fa3b9a4f640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa3b40b4880 0x7fa3b41460b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:17.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.153+0000 7fa3b9a4f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3b40cd6d0 0x7fa3b40c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:17.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.153+0000 7fa3b9a4f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3b4153e60 0x7fa3b415f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:17.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.153+0000 7fa3b9a4f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b40ca670 con 0x7fa3b40cd6d0 2023-11-04T01:40:17.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.153+0000 7fa3b9a4f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b4151d80 con 0x7fa3b4153e60 2023-11-04T01:40:17.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.153+0000 7fa3b9a4f640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b4152060 con 0x7fa3b40b4880 2023-11-04T01:40:17.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.153+0000 7fa3b27fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3b40cd6d0 0x7fa3b40c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:17.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.153+0000 7fa3b27fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3b40cd6d0 0x7fa3b40c8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46122/0 (socket says 172.21.15.77:46122) 2023-11-04T01:40:17.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.153+0000 7fa3b27fc640 1 -- 172.21.15.77:0/1821447420 learned_addr learned my addr 172.21.15.77:0/1821447420 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:17.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.153+0000 7fa3b37fe640 1 --2- 172.21.15.77:0/1821447420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3b4153e60 0x7fa3b415f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:17.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.153+0000 7fa3b2ffd640 1 --2- 172.21.15.77:0/1821447420 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa3b40b4880 0x7fa3b41460b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:17.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.153+0000 7fa3b27fc640 1 -- 172.21.15.77:0/1821447420 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa3b40b4880 msgr2=0x7fa3b41460b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:17.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.153+0000 7fa3b27fc640 1 --2- 172.21.15.77:0/1821447420 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa3b40b4880 0x7fa3b41460b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.153+0000 7fa3b27fc640 1 -- 172.21.15.77:0/1821447420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3b4153e60 msgr2=0x7fa3b415f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:17.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.153+0000 7fa3b27fc640 1 --2- 172.21.15.77:0/1821447420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3b4153e60 0x7fa3b415f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.153+0000 7fa3b27fc640 1 -- 172.21.15.77:0/1821447420 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a4009400 con 0x7fa3b40cd6d0 2023-11-04T01:40:17.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.153+0000 7fa3b27fc640 1 --2- 172.21.15.77:0/1821447420 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3b40cd6d0 0x7fa3b40c8d00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa3a800c520 tx=0x7fa3a800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:17.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.153+0000 7fa39bfff640 1 -- 172.21.15.77:0/1821447420 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a80035f0 con 0x7fa3b40cd6d0 2023-11-04T01:40:17.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.153+0000 7fa39bfff640 1 -- 172.21.15.77:0/1821447420 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a8003770 con 0x7fa3b40cd6d0 2023-11-04T01:40:17.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.153+0000 7fa3b9a4f640 1 -- 172.21.15.77:0/1821447420 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b4152340 con 0x7fa3b40cd6d0 2023-11-04T01:40:17.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.153+0000 7fa39bfff640 1 -- 172.21.15.77:0/1821447420 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a8003b20 con 0x7fa3b40cd6d0 2023-11-04T01:40:17.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.153+0000 7fa3b9a4f640 1 -- 172.21.15.77:0/1821447420 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b41465f0 con 0x7fa3b40cd6d0 2023-11-04T01:40:17.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.154+0000 7fa3b9a4f640 1 -- 172.21.15.77:0/1821447420 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b4152860 con 0x7fa3b40cd6d0 2023-11-04T01:40:17.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.155+0000 7fa39bfff640 1 -- 172.21.15.77:0/1821447420 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa3a8003c80 con 0x7fa3b40cd6d0 2023-11-04T01:40:17.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.155+0000 7fa39bfff640 1 --2- 172.21.15.77:0/1821447420 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa3a006ae70 0x7fa3a006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:17.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.155+0000 7fa39bfff640 1 -- 172.21.15.77:0/1821447420 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa3a8088eb0 con 0x7fa3b40cd6d0 2023-11-04T01:40:17.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.155+0000 7fa3b2ffd640 1 --2- 172.21.15.77:0/1821447420 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa3a006ae70 0x7fa3a006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:17.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.156+0000 7fa3b2ffd640 1 --2- 172.21.15.77:0/1821447420 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa3a006ae70 0x7fa3a006d330 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4036000 tx=0x7fa3a403c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:17.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.159+0000 7fa39bfff640 1 -- 172.21.15.77:0/1821447420 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa3a8053d30 con 0x7fa3b40cd6d0 2023-11-04T01:40:17.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.323+0000 7fa3b9a4f640 1 -- 172.21.15.77:0/1821447420 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa3b4074290 con 0x7fa3b40cd6d0 2023-11-04T01:40:17.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.324+0000 7fa39bfff640 1 -- 172.21.15.77:0/1821447420 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa3a80170a0 con 0x7fa3b40cd6d0 2023-11-04T01:40:17.326 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-04T01:40:17.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.325+0000 7fa3b9a4f640 1 -- 172.21.15.77:0/1821447420 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa3a006ae70 msgr2=0x7fa3a006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:17.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.325+0000 7fa3b9a4f640 1 --2- 172.21.15.77:0/1821447420 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa3a006ae70 0x7fa3a006d330 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4036000 tx=0x7fa3a403c040 comp rx=0 tx=0).stop 2023-11-04T01:40:17.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.325+0000 7fa3b9a4f640 1 -- 172.21.15.77:0/1821447420 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3b40cd6d0 msgr2=0x7fa3b40c8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:17.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.325+0000 7fa3b9a4f640 1 --2- 172.21.15.77:0/1821447420 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3b40cd6d0 0x7fa3b40c8d00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa3a800c520 tx=0x7fa3a800c9e0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.326+0000 7fa3b9a4f640 1 -- 172.21.15.77:0/1821447420 shutdown_connections 2023-11-04T01:40:17.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.326+0000 7fa3b9a4f640 1 --2- 172.21.15.77:0/1821447420 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa3a006ae70 0x7fa3a006d330 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.326+0000 7fa3b9a4f640 1 --2- 172.21.15.77:0/1821447420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3b4153e60 0x7fa3b415f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.326+0000 7fa3b9a4f640 1 --2- 172.21.15.77:0/1821447420 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3b40cd6d0 0x7fa3b40c8d00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.326+0000 7fa3b9a4f640 1 --2- 172.21.15.77:0/1821447420 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa3b40b4880 0x7fa3b41460b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.326+0000 7fa3b9a4f640 1 -- 172.21.15.77:0/1821447420 >> 172.21.15.77:0/1821447420 conn(0x7fa3b40cf880 msgr2=0x7fa3b40b5540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:17.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.326+0000 7fa3b9a4f640 1 -- 172.21.15.77:0/1821447420 shutdown_connections 2023-11-04T01:40:17.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.326+0000 7fa3b9a4f640 1 -- 172.21.15.77:0/1821447420 wait complete. 2023-11-04T01:40:17.338 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:40:17.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.438+0000 7f6a27256640 1 Processor -- start 2023-11-04T01:40:17.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.438+0000 7f6a27256640 1 -- start start 2023-11-04T01:40:17.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.439+0000 7f6a27256640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a20153e60 0x7f6a2015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:17.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.439+0000 7f6a27256640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6a200cd6d0 0x7f6a20161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:17.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.439+0000 7f6a27256640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a200cde60 con 0x7f6a200b4880 2023-11-04T01:40:17.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.439+0000 7f6a27256640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a20160f90 con 0x7f6a200cd6d0 2023-11-04T01:40:17.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.439+0000 7f6a27256640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2015e400 con 0x7f6a20153e60 2023-11-04T01:40:17.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.439+0000 7f6a1ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6a200cd6d0 0x7f6a20161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:17.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.439+0000 7f6a257f3640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6a200b4880 0x7f6a2006b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52510/0 (socket says 172.21.15.77:52510) 2023-11-04T01:40:17.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.439+0000 7f6a257f3640 1 -- 172.21.15.77:0/431006119 learned_addr learned my addr 172.21.15.77:0/431006119 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:17.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.439+0000 7f6a24ff2640 1 --2- 172.21.15.77:0/431006119 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a20153e60 0x7f6a2015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:17.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.439+0000 7f6a1ffff640 1 -- 172.21.15.77:0/431006119 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a20153e60 msgr2=0x7f6a2015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:17.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.439+0000 7f6a1ffff640 1 --2- 172.21.15.77:0/431006119 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a20153e60 0x7f6a2015dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.439+0000 7f6a1ffff640 1 -- 172.21.15.77:0/431006119 >> v1:172.21.15.77:6789/0 conn(0x7f6a200b4880 legacy=0x7f6a2006b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:17.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.439+0000 7f6a1ffff640 1 -- 172.21.15.77:0/431006119 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a20161960 con 0x7f6a200cd6d0 2023-11-04T01:40:17.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.439+0000 7f6a1f7fe640 1 -- 172.21.15.77:0/431006119 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1981609344 0 0) 0x7f6a200cde60 con 0x7f6a200b4880 2023-11-04T01:40:17.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.440+0000 7f6a1ffff640 1 --2- 172.21.15.77:0/431006119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a200cd6d0 0x7f6a20161420 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6a140097a0 tx=0x7f6a1402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=388356158b049ffb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:17.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.440+0000 7f6a1f7fe640 1 -- 172.21.15.77:0/431006119 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a14031830 con 0x7f6a200cd6d0 2023-11-04T01:40:17.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.440+0000 7f6a1f7fe640 1 -- 172.21.15.77:0/431006119 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a14031990 con 0x7f6a200cd6d0 2023-11-04T01:40:17.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.440+0000 7f6a1f7fe640 1 -- 172.21.15.77:0/431006119 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a14031d20 con 0x7f6a200cd6d0 2023-11-04T01:40:17.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.441+0000 7f6a27256640 1 -- 172.21.15.77:0/431006119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a200cd6d0 msgr2=0x7f6a20161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:17.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.441+0000 7f6a27256640 1 --2- 172.21.15.77:0/431006119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a200cd6d0 0x7f6a20161420 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6a140097a0 tx=0x7f6a1402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.441+0000 7f6a27256640 1 -- 172.21.15.77:0/431006119 shutdown_connections 2023-11-04T01:40:17.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.441+0000 7f6a27256640 1 --2- 172.21.15.77:0/431006119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a200cd6d0 0x7f6a20161420 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.441+0000 7f6a27256640 1 --2- 172.21.15.77:0/431006119 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a20153e60 0x7f6a2015dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.441+0000 7f6a27256640 1 -- 172.21.15.77:0/431006119 >> 172.21.15.77:0/431006119 conn(0x7f6a200cf880 msgr2=0x7f6a200cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:17.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.441+0000 7f6a27256640 1 -- 172.21.15.77:0/431006119 shutdown_connections 2023-11-04T01:40:17.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.441+0000 7f6a27256640 1 -- 172.21.15.77:0/431006119 wait complete. 2023-11-04T01:40:17.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.442+0000 7f6a27256640 1 Processor -- start 2023-11-04T01:40:17.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.442+0000 7f6a27256640 1 -- start start 2023-11-04T01:40:17.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.443+0000 7f6a27256640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a200b4880 0x7f6a20156340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:17.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.443+0000 7f6a27256640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a200cd6d0 0x7f6a20156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:17.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.443+0000 7f6a27256640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a20153e60 0x7f6a2015a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:17.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.443+0000 7f6a27256640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a201462d0 con 0x7f6a20153e60 2023-11-04T01:40:17.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.443+0000 7f6a27256640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a200c9280 con 0x7f6a200b4880 2023-11-04T01:40:17.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.443+0000 7f6a27256640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a200c8cc0 con 0x7f6a200cd6d0 2023-11-04T01:40:17.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.443+0000 7f6a257f3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a20153e60 0x7f6a2015a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:17.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.443+0000 7f6a257f3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a20153e60 0x7f6a2015a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56478/0 (socket says 172.21.15.77:56478) 2023-11-04T01:40:17.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.443+0000 7f6a257f3640 1 -- 172.21.15.77:0/1367945422 learned_addr learned my addr 172.21.15.77:0/1367945422 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:17.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.443+0000 7f6a1ffff640 1 --2- 172.21.15.77:0/1367945422 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a200cd6d0 0x7f6a20156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:17.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.443+0000 7f6a24ff2640 1 --2- 172.21.15.77:0/1367945422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a200b4880 0x7f6a20156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:17.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.443+0000 7f6a257f3640 1 -- 172.21.15.77:0/1367945422 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a200cd6d0 msgr2=0x7f6a20156d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:17.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.443+0000 7f6a257f3640 1 --2- 172.21.15.77:0/1367945422 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a200cd6d0 0x7f6a20156d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.443+0000 7f6a257f3640 1 -- 172.21.15.77:0/1367945422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a200b4880 msgr2=0x7f6a20156340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:17.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.443+0000 7f6a257f3640 1 --2- 172.21.15.77:0/1367945422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a200b4880 0x7f6a20156340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.443+0000 7f6a257f3640 1 -- 172.21.15.77:0/1367945422 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a14009400 con 0x7f6a20153e60 2023-11-04T01:40:17.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.443+0000 7f6a257f3640 1 --2- 172.21.15.77:0/1367945422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a20153e60 0x7f6a2015a3f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6a1800c7e0 tx=0x7f6a1800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:17.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.444+0000 7f6a1d7fa640 1 -- 172.21.15.77:0/1367945422 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1800a640 con 0x7f6a20153e60 2023-11-04T01:40:17.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.444+0000 7f6a1d7fa640 1 -- 172.21.15.77:0/1367945422 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1800a7c0 con 0x7f6a20153e60 2023-11-04T01:40:17.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.444+0000 7f6a27256640 1 -- 172.21.15.77:0/1367945422 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a200c8fa0 con 0x7f6a20153e60 2023-11-04T01:40:17.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.444+0000 7f6a1d7fa640 1 -- 172.21.15.77:0/1367945422 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1800ab70 con 0x7f6a20153e60 2023-11-04T01:40:17.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.444+0000 7f6a27256640 1 -- 172.21.15.77:0/1367945422 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a20156880 con 0x7f6a20153e60 2023-11-04T01:40:17.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.445+0000 7f6a27256640 1 -- 172.21.15.77:0/1367945422 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a20156a70 con 0x7f6a20153e60 2023-11-04T01:40:17.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.445+0000 7f6a1d7fa640 1 -- 172.21.15.77:0/1367945422 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6a1800acd0 con 0x7f6a20153e60 2023-11-04T01:40:17.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.445+0000 7f6a1d7fa640 1 --2- 172.21.15.77:0/1367945422 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6a0c06aea0 0x7f6a0c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:17.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.445+0000 7f6a1d7fa640 1 -- 172.21.15.77:0/1367945422 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6a18088c40 con 0x7f6a20153e60 2023-11-04T01:40:17.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.446+0000 7f6a24ff2640 1 --2- 172.21.15.77:0/1367945422 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6a0c06aea0 0x7f6a0c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:17.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.446+0000 7f6a24ff2640 1 --2- 172.21.15.77:0/1367945422 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6a0c06aea0 0x7f6a0c06d360 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6a1000aa20 tx=0x7f6a10008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:17.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.450+0000 7f6a1d7fa640 1 -- 172.21.15.77:0/1367945422 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6a18053b40 con 0x7f6a20153e60 2023-11-04T01:40:17.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.618+0000 7f6a27256640 1 -- 172.21.15.77:0/1367945422 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6a200d0b80 con 0x7f6a20153e60 2023-11-04T01:40:17.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.618+0000 7f6a1d7fa640 1 -- 172.21.15.77:0/1367945422 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6a18018020 con 0x7f6a20153e60 2023-11-04T01:40:17.620 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:40:17.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.620+0000 7f6a27256640 1 -- 172.21.15.77:0/1367945422 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6a0c06aea0 msgr2=0x7f6a0c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:17.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.620+0000 7f6a27256640 1 --2- 172.21.15.77:0/1367945422 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6a0c06aea0 0x7f6a0c06d360 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6a1000aa20 tx=0x7f6a10008040 comp rx=0 tx=0).stop 2023-11-04T01:40:17.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.620+0000 7f6a27256640 1 -- 172.21.15.77:0/1367945422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a20153e60 msgr2=0x7f6a2015a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:17.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.620+0000 7f6a27256640 1 --2- 172.21.15.77:0/1367945422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a20153e60 0x7f6a2015a3f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6a1800c7e0 tx=0x7f6a1800cca0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.620+0000 7f6a27256640 1 -- 172.21.15.77:0/1367945422 shutdown_connections 2023-11-04T01:40:17.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.620+0000 7f6a27256640 1 --2- 172.21.15.77:0/1367945422 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6a0c06aea0 0x7f6a0c06d360 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.620+0000 7f6a27256640 1 --2- 172.21.15.77:0/1367945422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a20153e60 0x7f6a2015a3f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.620+0000 7f6a27256640 1 --2- 172.21.15.77:0/1367945422 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a200cd6d0 0x7f6a20156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.620+0000 7f6a27256640 1 --2- 172.21.15.77:0/1367945422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a200b4880 0x7f6a20156340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.620+0000 7f6a27256640 1 -- 172.21.15.77:0/1367945422 >> 172.21.15.77:0/1367945422 conn(0x7f6a200cf880 msgr2=0x7f6a2015e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:17.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.620+0000 7f6a27256640 1 -- 172.21.15.77:0/1367945422 shutdown_connections 2023-11-04T01:40:17.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.620+0000 7f6a27256640 1 -- 172.21.15.77:0/1367945422 wait complete. 2023-11-04T01:40:17.632 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:40:17.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.731+0000 7f2640ad4640 1 Processor -- start 2023-11-04T01:40:17.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.731+0000 7f2640ad4640 1 -- start start 2023-11-04T01:40:17.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.732+0000 7f2640ad4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f263c153e60 0x7f263c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:17.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.732+0000 7f2640ad4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c0cde60 con 0x7f263c0b4880 2023-11-04T01:40:17.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.732+0000 7f2640ad4640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c160f90 con 0x7f263c0cd6d0 2023-11-04T01:40:17.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.732+0000 7f2640ad4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c15e400 con 0x7f263c153e60 2023-11-04T01:40:17.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.732+0000 7f263a59c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f263c153e60 0x7f263c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:17.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.732+0000 7f263ad9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f263c0b4880 0x7f263c0d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52520/0 (socket says 172.21.15.77:52520) 2023-11-04T01:40:17.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.732+0000 7f263ad9d640 1 -- 172.21.15.77:0/341735231 learned_addr learned my addr 172.21.15.77:0/341735231 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:17.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.733+0000 7f263a59c640 1 -- 172.21.15.77:0/341735231 >> v1:172.21.15.122:6789/0 conn(0x7f263c0cd6d0 legacy=0x7f263c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:17.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.733+0000 7f263a59c640 1 -- 172.21.15.77:0/341735231 >> v1:172.21.15.77:6789/0 conn(0x7f263c0b4880 legacy=0x7f263c0d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:17.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.733+0000 7f263959a640 1 -- 172.21.15.77:0/341735231 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1166467222 0 0) 0x7f263c0cde60 con 0x7f263c0b4880 2023-11-04T01:40:17.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.733+0000 7f263a59c640 1 -- 172.21.15.77:0/341735231 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f263c0ce090 con 0x7f263c153e60 2023-11-04T01:40:17.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.733+0000 7f263a59c640 1 --2- 172.21.15.77:0/341735231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f263c153e60 0x7f263c15dec0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f262c009d90 tx=0x7f262c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7e47771112eb40 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:17.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.734+0000 7f263959a640 1 -- 172.21.15.77:0/341735231 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c02cd00 con 0x7f263c153e60 2023-11-04T01:40:17.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.734+0000 7f263959a640 1 -- 172.21.15.77:0/341735231 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262c02ce60 con 0x7f263c153e60 2023-11-04T01:40:17.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.734+0000 7f263959a640 1 -- 172.21.15.77:0/341735231 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c034660 con 0x7f263c153e60 2023-11-04T01:40:17.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.734+0000 7f2640ad4640 1 -- 172.21.15.77:0/341735231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f263c153e60 msgr2=0x7f263c15dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:17.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.734+0000 7f2640ad4640 1 --2- 172.21.15.77:0/341735231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f263c153e60 0x7f263c15dec0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f262c009d90 tx=0x7f262c02bf50 comp rx=0 tx=0).stop 2023-11-04T01:40:17.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.734+0000 7f2640ad4640 1 -- 172.21.15.77:0/341735231 shutdown_connections 2023-11-04T01:40:17.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.734+0000 7f2640ad4640 1 --2- 172.21.15.77:0/341735231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f263c153e60 0x7f263c15dec0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.734+0000 7f2640ad4640 1 -- 172.21.15.77:0/341735231 >> 172.21.15.77:0/341735231 conn(0x7f263c0cf880 msgr2=0x7f263c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:17.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.734+0000 7f2640ad4640 1 -- 172.21.15.77:0/341735231 shutdown_connections 2023-11-04T01:40:17.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.734+0000 7f2640ad4640 1 -- 172.21.15.77:0/341735231 wait complete. 2023-11-04T01:40:17.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.735+0000 7f2640ad4640 1 Processor -- start 2023-11-04T01:40:17.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.735+0000 7f2640ad4640 1 -- start start 2023-11-04T01:40:17.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.736+0000 7f2640ad4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f263c0b4880 0x7f263c0ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:17.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.736+0000 7f2640ad4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f263c0cd6d0 0x7f263c0cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:17.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.736+0000 7f2640ad4640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f263c153e60 0x7f263c1f5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:17.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.736+0000 7f2640ad4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263c0ca370 con 0x7f263c0cd6d0 2023-11-04T01:40:17.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.736+0000 7f2640ad4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263c1f6be0 con 0x7f263c0b4880 2023-11-04T01:40:17.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.736+0000 7f2640ad4640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f263c1f6620 con 0x7f263c153e60 2023-11-04T01:40:17.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.736+0000 7f2639d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f263c0cd6d0 0x7f263c0cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:17.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.736+0000 7f2639d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f263c0cd6d0 0x7f263c0cc8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56506/0 (socket says 172.21.15.77:56506) 2023-11-04T01:40:17.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.736+0000 7f2639d9b640 1 -- 172.21.15.77:0/1747919545 learned_addr learned my addr 172.21.15.77:0/1747919545 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:17.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.736+0000 7f263ad9d640 1 --2- 172.21.15.77:0/1747919545 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f263c153e60 0x7f263c1f5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:17.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.736+0000 7f263a59c640 1 --2- 172.21.15.77:0/1747919545 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f263c0b4880 0x7f263c0ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:17.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.737+0000 7f2639d9b640 1 -- 172.21.15.77:0/1747919545 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f263c153e60 msgr2=0x7f263c1f5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:17.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.737+0000 7f2639d9b640 1 --2- 172.21.15.77:0/1747919545 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f263c153e60 0x7f263c1f5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.737+0000 7f2639d9b640 1 -- 172.21.15.77:0/1747919545 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f263c0b4880 msgr2=0x7f263c0ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:17.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.737+0000 7f2639d9b640 1 --2- 172.21.15.77:0/1747919545 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f263c0b4880 0x7f263c0ca800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.737+0000 7f2639d9b640 1 -- 172.21.15.77:0/1747919545 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262c009a70 con 0x7f263c0cd6d0 2023-11-04T01:40:17.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.737+0000 7f263a59c640 1 --2- 172.21.15.77:0/1747919545 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f263c0b4880 0x7f263c0ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:17.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.737+0000 7f2639d9b640 1 --2- 172.21.15.77:0/1747919545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f263c0cd6d0 0x7f263c0cc8c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f263000c400 tx=0x7f263000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:17.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.737+0000 7f262affd640 1 -- 172.21.15.77:0/1747919545 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26300052d0 con 0x7f263c0cd6d0 2023-11-04T01:40:17.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.737+0000 7f262affd640 1 -- 172.21.15.77:0/1747919545 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2630005430 con 0x7f263c0cd6d0 2023-11-04T01:40:17.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.737+0000 7f2640ad4640 1 -- 172.21.15.77:0/1747919545 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f263c1f6900 con 0x7f263c0cd6d0 2023-11-04T01:40:17.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.737+0000 7f262affd640 1 -- 172.21.15.77:0/1747919545 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2630003830 con 0x7f263c0cd6d0 2023-11-04T01:40:17.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.737+0000 7f2640ad4640 1 -- 172.21.15.77:0/1747919545 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f263c0cad40 con 0x7f263c0cd6d0 2023-11-04T01:40:17.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.738+0000 7f2640ad4640 1 -- 172.21.15.77:0/1747919545 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f263c0ca520 con 0x7f263c0cd6d0 2023-11-04T01:40:17.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.738+0000 7f262affd640 1 -- 172.21.15.77:0/1747919545 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2630003990 con 0x7f263c0cd6d0 2023-11-04T01:40:17.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.739+0000 7f262affd640 1 --2- 172.21.15.77:0/1747919545 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f261c06aea0 0x7f261c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:17.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.739+0000 7f262affd640 1 -- 172.21.15.77:0/1747919545 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2630088d50 con 0x7f263c0cd6d0 2023-11-04T01:40:17.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.739+0000 7f263a59c640 1 --2- 172.21.15.77:0/1747919545 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f261c06aea0 0x7f261c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:17.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.739+0000 7f263a59c640 1 --2- 172.21.15.77:0/1747919545 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f261c06aea0 0x7f261c06d360 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f262c036000 tx=0x7f262c030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:17.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.743+0000 7f262affd640 1 -- 172.21.15.77:0/1747919545 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f263c0ca520 con 0x7f263c0cd6d0 2023-11-04T01:40:17.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.923+0000 7f2640ad4640 1 -- 172.21.15.77:0/1747919545 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f263c074290 con 0x7f263c0cd6d0 2023-11-04T01:40:17.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.923+0000 7f262affd640 1 -- 172.21.15.77:0/1747919545 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f263008c030 con 0x7f263c0cd6d0 2023-11-04T01:40:17.925 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-11-04T01:40:17.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.925+0000 7f2640ad4640 1 -- 172.21.15.77:0/1747919545 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f261c06aea0 msgr2=0x7f261c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:17.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.925+0000 7f2640ad4640 1 --2- 172.21.15.77:0/1747919545 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f261c06aea0 0x7f261c06d360 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f262c036000 tx=0x7f262c030000 comp rx=0 tx=0).stop 2023-11-04T01:40:17.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.925+0000 7f2640ad4640 1 -- 172.21.15.77:0/1747919545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f263c0cd6d0 msgr2=0x7f263c0cc8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:17.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.925+0000 7f2640ad4640 1 --2- 172.21.15.77:0/1747919545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f263c0cd6d0 0x7f263c0cc8c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f263000c400 tx=0x7f263000c8c0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.925+0000 7f2640ad4640 1 -- 172.21.15.77:0/1747919545 shutdown_connections 2023-11-04T01:40:17.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.925+0000 7f2640ad4640 1 --2- 172.21.15.77:0/1747919545 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f261c06aea0 0x7f261c06d360 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.925+0000 7f2640ad4640 1 --2- 172.21.15.77:0/1747919545 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f263c153e60 0x7f263c1f5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.925+0000 7f2640ad4640 1 --2- 172.21.15.77:0/1747919545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f263c0cd6d0 0x7f263c0cc8c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.925+0000 7f2640ad4640 1 --2- 172.21.15.77:0/1747919545 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f263c0b4880 0x7f263c0ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:17.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.925+0000 7f2640ad4640 1 -- 172.21.15.77:0/1747919545 >> 172.21.15.77:0/1747919545 conn(0x7f263c0cf880 msgr2=0x7f263c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:17.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.925+0000 7f2640ad4640 1 -- 172.21.15.77:0/1747919545 shutdown_connections 2023-11-04T01:40:17.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:17.925+0000 7f2640ad4640 1 -- 172.21.15.77:0/1747919545 wait complete. 2023-11-04T01:40:17.937 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:40:17.937 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:40:17.953 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:18.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.091+0000 7f1a3d373640 1 Processor -- start 2023-11-04T01:40:18.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.091+0000 7f1a3d373640 1 -- start start 2023-11-04T01:40:18.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.092+0000 7f1a3d373640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1a380cde60 0x7f1a3815d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.092+0000 7f1a3d373640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a3815daa0 0x7f1a38157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.092+0000 7f1a3d373640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1a380ce240 0x7f1a38157540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.092+0000 7f1a3d373640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a3815e5c0 con 0x7f1a380cde60 2023-11-04T01:40:18.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.092+0000 7f1a3d373640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a38157a80 con 0x7f1a380ce240 2023-11-04T01:40:18.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.092+0000 7f1a3d373640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3815e000 con 0x7f1a3815daa0 2023-11-04T01:40:18.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.092+0000 7f1a36ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1a380cde60 0x7f1a3815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.092+0000 7f1a36ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1a380cde60 0x7f1a3815d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56514/0 (socket says 172.21.15.77:56514) 2023-11-04T01:40:18.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.092+0000 7f1a36ffd640 1 -- 172.21.15.77:0/3123341004 learned_addr learned my addr 172.21.15.77:0/3123341004 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:18.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.092+0000 7f1a377fe640 1 --2- 172.21.15.77:0/3123341004 >> v2:172.21.15.122:3300/0 conn(0x7f1a380ce240 0x7f1a38157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.092+0000 7f1a367fc640 1 --2- 172.21.15.77:0/3123341004 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a3815daa0 0x7f1a38157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.092+0000 7f1a36ffd640 1 -- 172.21.15.77:0/3123341004 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a3815daa0 msgr2=0x7f1a38157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:18.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.092+0000 7f1a36ffd640 1 --2- 172.21.15.77:0/3123341004 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a3815daa0 0x7f1a38157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.092+0000 7f1a36ffd640 1 -- 172.21.15.77:0/3123341004 >> v2:172.21.15.122:3300/0 conn(0x7f1a380ce240 msgr2=0x7f1a38157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:18.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.092+0000 7f1a36ffd640 1 --2- 172.21.15.77:0/3123341004 >> v2:172.21.15.122:3300/0 conn(0x7f1a380ce240 0x7f1a38157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.092+0000 7f1a36ffd640 1 -- 172.21.15.77:0/3123341004 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a3815e2e0 con 0x7f1a380cde60 2023-11-04T01:40:18.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.092+0000 7f1a377fe640 1 --2- 172.21.15.77:0/3123341004 >> v2:172.21.15.122:3300/0 conn(0x7f1a380ce240 0x7f1a38157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:18.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.092+0000 7f1a367fc640 1 --2- 172.21.15.77:0/3123341004 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a3815daa0 0x7f1a38157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:18.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.093+0000 7f1a36ffd640 1 --2- 172.21.15.77:0/3123341004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a380cde60 0x7f1a3815d560 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1a3815df30 tx=0x7f1a2802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=608475d22e962ff3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:18.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.093+0000 7f1a35ffb640 1 -- 172.21.15.77:0/3123341004 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2802ca70 con 0x7f1a380cde60 2023-11-04T01:40:18.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.093+0000 7f1a35ffb640 1 -- 172.21.15.77:0/3123341004 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2802cbd0 con 0x7f1a380cde60 2023-11-04T01:40:18.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.093+0000 7f1a35ffb640 1 -- 172.21.15.77:0/3123341004 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a280343f0 con 0x7f1a380cde60 2023-11-04T01:40:18.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.094+0000 7f1a3d373640 1 -- 172.21.15.77:0/3123341004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a380cde60 msgr2=0x7f1a3815d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.094+0000 7f1a3d373640 1 --2- 172.21.15.77:0/3123341004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a380cde60 0x7f1a3815d560 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1a3815df30 tx=0x7f1a2802bed0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.094+0000 7f1a3d373640 1 -- 172.21.15.77:0/3123341004 shutdown_connections 2023-11-04T01:40:18.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.094+0000 7f1a3d373640 1 --2- 172.21.15.77:0/3123341004 >> v2:172.21.15.122:3300/0 conn(0x7f1a380ce240 0x7f1a38157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.094+0000 7f1a3d373640 1 --2- 172.21.15.77:0/3123341004 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a3815daa0 0x7f1a38157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.094+0000 7f1a3d373640 1 --2- 172.21.15.77:0/3123341004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a380cde60 0x7f1a3815d560 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.094+0000 7f1a3d373640 1 -- 172.21.15.77:0/3123341004 >> 172.21.15.77:0/3123341004 conn(0x7f1a38071f30 msgr2=0x7f1a380cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:18.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.094+0000 7f1a3d373640 1 -- 172.21.15.77:0/3123341004 shutdown_connections 2023-11-04T01:40:18.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.094+0000 7f1a3d373640 1 -- 172.21.15.77:0/3123341004 wait complete. 2023-11-04T01:40:18.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.095+0000 7f1a3d373640 1 Processor -- start 2023-11-04T01:40:18.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.095+0000 7f1a3d373640 1 -- start start 2023-11-04T01:40:18.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.096+0000 7f1a3d373640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a380cde60 0x7f1a3815c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.096+0000 7f1a3d373640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a380ce240 0x7f1a380cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.096+0000 7f1a3d373640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a3815daa0 0x7f1a38157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.096+0000 7f1a3d373640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a381f2570 con 0x7f1a380ce240 2023-11-04T01:40:18.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.096+0000 7f1a3d373640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3815a450 con 0x7f1a3815daa0 2023-11-04T01:40:18.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.096+0000 7f1a3d373640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3815a730 con 0x7f1a380cde60 2023-11-04T01:40:18.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.096+0000 7f1a367fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a380ce240 0x7f1a380cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.096+0000 7f1a367fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a380ce240 0x7f1a380cc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56528/0 (socket says 172.21.15.77:56528) 2023-11-04T01:40:18.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.096+0000 7f1a367fc640 1 -- 172.21.15.77:0/827989385 learned_addr learned my addr 172.21.15.77:0/827989385 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:18.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.096+0000 7f1a36ffd640 1 --2- 172.21.15.77:0/827989385 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a380cde60 0x7f1a3815c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.096+0000 7f1a377fe640 1 --2- 172.21.15.77:0/827989385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a3815daa0 0x7f1a38157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.096+0000 7f1a367fc640 1 -- 172.21.15.77:0/827989385 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a380cde60 msgr2=0x7f1a3815c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.096+0000 7f1a367fc640 1 --2- 172.21.15.77:0/827989385 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a380cde60 0x7f1a3815c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.096+0000 7f1a367fc640 1 -- 172.21.15.77:0/827989385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a3815daa0 msgr2=0x7f1a38157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.096+0000 7f1a367fc640 1 --2- 172.21.15.77:0/827989385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a3815daa0 0x7f1a38157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.096+0000 7f1a367fc640 1 -- 172.21.15.77:0/827989385 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a28009b30 con 0x7f1a380ce240 2023-11-04T01:40:18.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.096+0000 7f1a367fc640 1 --2- 172.21.15.77:0/827989385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a380ce240 0x7f1a380cc8d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c00c7f0 tx=0x7f1a2c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:18.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.097+0000 7f1a1f7fe640 1 -- 172.21.15.77:0/827989385 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c007820 con 0x7f1a380ce240 2023-11-04T01:40:18.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.097+0000 7f1a1f7fe640 1 -- 172.21.15.77:0/827989385 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2c007980 con 0x7f1a380ce240 2023-11-04T01:40:18.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.097+0000 7f1a3d373640 1 -- 172.21.15.77:0/827989385 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a3815aa10 con 0x7f1a380ce240 2023-11-04T01:40:18.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.097+0000 7f1a1f7fe640 1 -- 172.21.15.77:0/827989385 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c007cf0 con 0x7f1a380ce240 2023-11-04T01:40:18.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.097+0000 7f1a3d373640 1 -- 172.21.15.77:0/827989385 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a3815c6a0 con 0x7f1a380ce240 2023-11-04T01:40:18.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.098+0000 7f1a3d373640 1 -- 172.21.15.77:0/827989385 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a381f2710 con 0x7f1a380ce240 2023-11-04T01:40:18.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.098+0000 7f1a1f7fe640 1 -- 172.21.15.77:0/827989385 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1a2c0113f0 con 0x7f1a380ce240 2023-11-04T01:40:18.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.098+0000 7f1a1f7fe640 1 --2- 172.21.15.77:0/827989385 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1a2406ae70 0x7f1a2406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.098+0000 7f1a1f7fe640 1 -- 172.21.15.77:0/827989385 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1a2c089960 con 0x7f1a380ce240 2023-11-04T01:40:18.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.098+0000 7f1a36ffd640 1 --2- 172.21.15.77:0/827989385 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1a2406ae70 0x7f1a2406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.099+0000 7f1a36ffd640 1 --2- 172.21.15.77:0/827989385 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1a2406ae70 0x7f1a2406d330 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1a28035000 tx=0x7f1a28030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:18.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.103+0000 7f1a1f7fe640 1 -- 172.21.15.77:0/827989385 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1a2c0547d0 con 0x7f1a380ce240 2023-11-04T01:40:18.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.269+0000 7f1a3d373640 1 -- 172.21.15.77:0/827989385 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a38074290 con 0x7f1a380ce240 2023-11-04T01:40:18.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.271+0000 7f1a1f7fe640 1 -- 172.21.15.77:0/827989385 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f1a2c057df0 con 0x7f1a380ce240 2023-11-04T01:40:18.273 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:18.273 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":24,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:40:10.153949+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:40:02.810971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:40:04.003979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:40:07.734355+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:18.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.272+0000 7f1a3d373640 1 -- 172.21.15.77:0/827989385 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1a2406ae70 msgr2=0x7f1a2406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.272+0000 7f1a3d373640 1 --2- 172.21.15.77:0/827989385 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1a2406ae70 0x7f1a2406d330 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1a28035000 tx=0x7f1a28030000 comp rx=0 tx=0).stop 2023-11-04T01:40:18.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.272+0000 7f1a3d373640 1 -- 172.21.15.77:0/827989385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a380ce240 msgr2=0x7f1a380cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.272+0000 7f1a3d373640 1 --2- 172.21.15.77:0/827989385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a380ce240 0x7f1a380cc8d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c00c7f0 tx=0x7f1a2c00ccb0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.273+0000 7f1a3d373640 1 -- 172.21.15.77:0/827989385 shutdown_connections 2023-11-04T01:40:18.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.273+0000 7f1a3d373640 1 --2- 172.21.15.77:0/827989385 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1a2406ae70 0x7f1a2406d330 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.273+0000 7f1a3d373640 1 --2- 172.21.15.77:0/827989385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a3815daa0 0x7f1a38157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.273+0000 7f1a3d373640 1 --2- 172.21.15.77:0/827989385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a380ce240 0x7f1a380cc8d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.273+0000 7f1a3d373640 1 --2- 172.21.15.77:0/827989385 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a380cde60 0x7f1a3815c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.273+0000 7f1a3d373640 1 -- 172.21.15.77:0/827989385 >> 172.21.15.77:0/827989385 conn(0x7f1a38071f30 msgr2=0x7f1a38156dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:18.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.273+0000 7f1a3d373640 1 -- 172.21.15.77:0/827989385 shutdown_connections 2023-11-04T01:40:18.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.273+0000 7f1a3d373640 1 -- 172.21.15.77:0/827989385 wait complete. 2023-11-04T01:40:18.285 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:40:02.810971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:40:04.003979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:40:07.734355+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:40:18.286 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:40:18.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.386+0000 7ffbb3b3c640 1 Processor -- start 2023-11-04T01:40:18.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.386+0000 7ffbb3b3c640 1 -- start start 2023-11-04T01:40:18.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.387+0000 7ffbb3b3c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ffbac0b2d30 0x7ffbac06bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.387+0000 7ffbb3b3c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbac06ca40 con 0x7ffbac06c1d0 2023-11-04T01:40:18.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.387+0000 7ffbb3b3c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbac06cd20 con 0x7ffbac160430 2023-11-04T01:40:18.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.387+0000 7ffbb3b3c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbac0cb580 con 0x7ffbac0b2d30 2023-11-04T01:40:18.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.387+0000 7ffbb10d7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ffbac0b2d30 0x7ffbac06bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.387+0000 7ffbb20d9640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ffbac06c1d0 0x7ffbac0cbcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52532/0 (socket says 172.21.15.77:52532) 2023-11-04T01:40:18.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.387+0000 7ffbb20d9640 1 -- 172.21.15.77:0/3199886188 learned_addr learned my addr 172.21.15.77:0/3199886188 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:18.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.388+0000 7ffbb10d7640 1 -- 172.21.15.77:0/3199886188 >> v1:172.21.15.122:6789/0 conn(0x7ffbac160430 legacy=0x7ffbac0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:18.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.388+0000 7ffbb10d7640 1 -- 172.21.15.77:0/3199886188 >> v1:172.21.15.77:6789/0 conn(0x7ffbac06c1d0 legacy=0x7ffbac0cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.388+0000 7ffbb10d7640 1 -- 172.21.15.77:0/3199886188 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbac06d000 con 0x7ffbac0b2d30 2023-11-04T01:40:18.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.388+0000 7ffbb08d6640 1 -- 172.21.15.77:0/3199886188 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2108839800 0 0) 0x7ffbac06ca40 con 0x7ffbac06c1d0 2023-11-04T01:40:18.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.388+0000 7ffbb10d7640 1 --2- 172.21.15.77:0/3199886188 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbac0b2d30 0x7ffbac06bc90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c0097d0 tx=0x7ffb9c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3315aa205a528698 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:18.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.388+0000 7ffbb08d6640 1 -- 172.21.15.77:0/3199886188 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c031830 con 0x7ffbac0b2d30 2023-11-04T01:40:18.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.388+0000 7ffbb08d6640 1 -- 172.21.15.77:0/3199886188 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb9c031990 con 0x7ffbac0b2d30 2023-11-04T01:40:18.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.388+0000 7ffbb08d6640 1 -- 172.21.15.77:0/3199886188 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c031d20 con 0x7ffbac0b2d30 2023-11-04T01:40:18.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.389+0000 7ffbb3b3c640 1 -- 172.21.15.77:0/3199886188 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbac0b2d30 msgr2=0x7ffbac06bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.389+0000 7ffbb3b3c640 1 --2- 172.21.15.77:0/3199886188 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbac0b2d30 0x7ffbac06bc90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c0097d0 tx=0x7ffb9c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.389+0000 7ffbb3b3c640 1 -- 172.21.15.77:0/3199886188 shutdown_connections 2023-11-04T01:40:18.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.389+0000 7ffbb3b3c640 1 --2- 172.21.15.77:0/3199886188 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbac0b2d30 0x7ffbac06bc90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.389+0000 7ffbb3b3c640 1 -- 172.21.15.77:0/3199886188 >> 172.21.15.77:0/3199886188 conn(0x7ffbac06ea20 msgr2=0x7ffbac06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:18.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.389+0000 7ffbb3b3c640 1 -- 172.21.15.77:0/3199886188 shutdown_connections 2023-11-04T01:40:18.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.389+0000 7ffbb3b3c640 1 -- 172.21.15.77:0/3199886188 wait complete. 2023-11-04T01:40:18.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.390+0000 7ffbb3b3c640 1 Processor -- start 2023-11-04T01:40:18.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.390+0000 7ffbb3b3c640 1 -- start start 2023-11-04T01:40:18.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.391+0000 7ffbb3b3c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffbac06c1d0 0x7ffbac0c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.391+0000 7ffbb3b3c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbac0b2d30 0x7ffbac14f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.391+0000 7ffbb3b3c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffbac160430 0x7ffbac0b4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.391+0000 7ffbb3b3c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac14f5d0 con 0x7ffbac0b2d30 2023-11-04T01:40:18.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.391+0000 7ffbb3b3c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac1f3dc0 con 0x7ffbac06c1d0 2023-11-04T01:40:18.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.391+0000 7ffbb3b3c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac1f40a0 con 0x7ffbac160430 2023-11-04T01:40:18.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.391+0000 7ffbb10d7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbac0b2d30 0x7ffbac14f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.391+0000 7ffbb10d7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbac0b2d30 0x7ffbac14f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56544/0 (socket says 172.21.15.77:56544) 2023-11-04T01:40:18.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.391+0000 7ffbb10d7640 1 -- 172.21.15.77:0/4255220628 learned_addr learned my addr 172.21.15.77:0/4255220628 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:18.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.391+0000 7ffbb18d8640 1 --2- 172.21.15.77:0/4255220628 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffbac06c1d0 0x7ffbac0c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.391+0000 7ffbb20d9640 1 --2- 172.21.15.77:0/4255220628 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffbac160430 0x7ffbac0b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.391+0000 7ffbb10d7640 1 -- 172.21.15.77:0/4255220628 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffbac160430 msgr2=0x7ffbac0b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.391+0000 7ffbb10d7640 1 --2- 172.21.15.77:0/4255220628 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffbac160430 0x7ffbac0b4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.391+0000 7ffbb10d7640 1 -- 172.21.15.77:0/4255220628 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffbac06c1d0 msgr2=0x7ffbac0c7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.391+0000 7ffbb10d7640 1 --2- 172.21.15.77:0/4255220628 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffbac06c1d0 0x7ffbac0c7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.391+0000 7ffbb10d7640 1 -- 172.21.15.77:0/4255220628 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb9c009400 con 0x7ffbac0b2d30 2023-11-04T01:40:18.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.391+0000 7ffbb20d9640 1 --2- 172.21.15.77:0/4255220628 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffbac160430 0x7ffbac0b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:18.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.392+0000 7ffbb10d7640 1 --2- 172.21.15.77:0/4255220628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbac0b2d30 0x7ffbac14f090 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c0098f0 tx=0x7ffb9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:18.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.392+0000 7ffba27fc640 1 -- 172.21.15.77:0/4255220628 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c03ba70 con 0x7ffbac0b2d30 2023-11-04T01:40:18.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.392+0000 7ffba27fc640 1 -- 172.21.15.77:0/4255220628 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb9c03bbd0 con 0x7ffbac0b2d30 2023-11-04T01:40:18.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.392+0000 7ffbb3b3c640 1 -- 172.21.15.77:0/4255220628 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbac1f4380 con 0x7ffbac0b2d30 2023-11-04T01:40:18.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.392+0000 7ffba27fc640 1 -- 172.21.15.77:0/4255220628 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c0453f0 con 0x7ffbac0b2d30 2023-11-04T01:40:18.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.392+0000 7ffbb3b3c640 1 -- 172.21.15.77:0/4255220628 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbac1f4940 con 0x7ffbac0b2d30 2023-11-04T01:40:18.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.393+0000 7ffbb3b3c640 1 -- 172.21.15.77:0/4255220628 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbac1f4b30 con 0x7ffbac0b2d30 2023-11-04T01:40:18.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.393+0000 7ffba27fc640 1 -- 172.21.15.77:0/4255220628 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffb9c04e450 con 0x7ffbac0b2d30 2023-11-04T01:40:18.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.394+0000 7ffba27fc640 1 --2- 172.21.15.77:0/4255220628 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ffb9006ae70 0x7ffb9006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.394+0000 7ffba27fc640 1 -- 172.21.15.77:0/4255220628 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffb9c0abbc0 con 0x7ffbac0b2d30 2023-11-04T01:40:18.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.394+0000 7ffbb18d8640 1 --2- 172.21.15.77:0/4255220628 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ffb9006ae70 0x7ffb9006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.394+0000 7ffbb18d8640 1 --2- 172.21.15.77:0/4255220628 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ffb9006ae70 0x7ffb9006d330 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffba800b450 tx=0x7ffba800d040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:18.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.398+0000 7ffba27fc640 1 -- 172.21.15.77:0/4255220628 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffb9c076980 con 0x7ffbac0b2d30 2023-11-04T01:40:18.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.567+0000 7ffbb3b3c640 1 -- 172.21.15.77:0/4255220628 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffbac074290 con 0x7ffbac0b2d30 2023-11-04T01:40:18.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.567+0000 7ffba27fc640 1 -- 172.21.15.77:0/4255220628 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffb9c079fa0 con 0x7ffbac0b2d30 2023-11-04T01:40:18.569 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:40:18.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.569+0000 7ffbb3b3c640 1 -- 172.21.15.77:0/4255220628 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ffb9006ae70 msgr2=0x7ffb9006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.569+0000 7ffbb3b3c640 1 --2- 172.21.15.77:0/4255220628 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ffb9006ae70 0x7ffb9006d330 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffba800b450 tx=0x7ffba800d040 comp rx=0 tx=0).stop 2023-11-04T01:40:18.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.569+0000 7ffbb3b3c640 1 -- 172.21.15.77:0/4255220628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbac0b2d30 msgr2=0x7ffbac14f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.569+0000 7ffbb3b3c640 1 --2- 172.21.15.77:0/4255220628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbac0b2d30 0x7ffbac14f090 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c0098f0 tx=0x7ffb9c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.569+0000 7ffbb3b3c640 1 -- 172.21.15.77:0/4255220628 shutdown_connections 2023-11-04T01:40:18.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.569+0000 7ffbb3b3c640 1 --2- 172.21.15.77:0/4255220628 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ffb9006ae70 0x7ffb9006d330 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.569+0000 7ffbb3b3c640 1 --2- 172.21.15.77:0/4255220628 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffbac160430 0x7ffbac0b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.569+0000 7ffbb3b3c640 1 --2- 172.21.15.77:0/4255220628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbac0b2d30 0x7ffbac14f090 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.569+0000 7ffbb3b3c640 1 --2- 172.21.15.77:0/4255220628 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffbac06c1d0 0x7ffbac0c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.569+0000 7ffbb3b3c640 1 -- 172.21.15.77:0/4255220628 >> 172.21.15.77:0/4255220628 conn(0x7ffbac06ea20 msgr2=0x7ffbac0cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:18.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.569+0000 7ffbb3b3c640 1 -- 172.21.15.77:0/4255220628 shutdown_connections 2023-11-04T01:40:18.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.569+0000 7ffbb3b3c640 1 -- 172.21.15.77:0/4255220628 wait complete. 2023-11-04T01:40:18.581 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:40:18.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.682+0000 7fd108339640 1 Processor -- start 2023-11-04T01:40:18.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.682+0000 7fd108339640 1 -- start start 2023-11-04T01:40:18.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.683+0000 7fd108339640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd100160430 0x7fd1000b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.683+0000 7fd108339640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd1000b2b60 0x7fd10006bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.683+0000 7fd108339640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1000b2fc0 con 0x7fd10006c1d0 2023-11-04T01:40:18.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.683+0000 7fd108339640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1000cb580 con 0x7fd1000b2b60 2023-11-04T01:40:18.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.683+0000 7fd108339640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd10006ca40 con 0x7fd100160430 2023-11-04T01:40:18.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.683+0000 7fd1058d4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd1000b2b60 0x7fd10006bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.683+0000 7fd1068d6640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd10006c1d0 0x7fd100160b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52548/0 (socket says 172.21.15.77:52548) 2023-11-04T01:40:18.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.683+0000 7fd1068d6640 1 -- 172.21.15.77:0/3805797766 learned_addr learned my addr 172.21.15.77:0/3805797766 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:18.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.683+0000 7fd1060d5640 1 --2- 172.21.15.77:0/3805797766 >> v2:172.21.15.122:3300/0 conn(0x7fd100160430 0x7fd1000b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.683+0000 7fd1058d4640 1 -- 172.21.15.77:0/3805797766 >> v2:172.21.15.122:3300/0 conn(0x7fd100160430 msgr2=0x7fd1000b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:18.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.683+0000 7fd1058d4640 1 --2- 172.21.15.77:0/3805797766 >> v2:172.21.15.122:3300/0 conn(0x7fd100160430 0x7fd1000b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.683+0000 7fd1058d4640 1 -- 172.21.15.77:0/3805797766 >> v1:172.21.15.77:6789/0 conn(0x7fd10006c1d0 legacy=0x7fd100160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.683+0000 7fd1050d3640 1 -- 172.21.15.77:0/3805797766 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 44751030 0 0) 0x7fd1000b2fc0 con 0x7fd10006c1d0 2023-11-04T01:40:18.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.683+0000 7fd1058d4640 1 -- 172.21.15.77:0/3805797766 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd10006cd20 con 0x7fd1000b2b60 2023-11-04T01:40:18.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.684+0000 7fd1058d4640 1 --2- 172.21.15.77:0/3805797766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1000b2b60 0x7fd10006bc90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd10006f6d0 tx=0x7fd0f002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f0f21d598c72d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:18.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.684+0000 7fd1050d3640 1 -- 172.21.15.77:0/3805797766 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0031830 con 0x7fd1000b2b60 2023-11-04T01:40:18.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.684+0000 7fd1050d3640 1 -- 172.21.15.77:0/3805797766 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f0031990 con 0x7fd1000b2b60 2023-11-04T01:40:18.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.684+0000 7fd1050d3640 1 -- 172.21.15.77:0/3805797766 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0031d20 con 0x7fd1000b2b60 2023-11-04T01:40:18.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.685+0000 7fd108339640 1 -- 172.21.15.77:0/3805797766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1000b2b60 msgr2=0x7fd10006bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.685+0000 7fd108339640 1 --2- 172.21.15.77:0/3805797766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1000b2b60 0x7fd10006bc90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd10006f6d0 tx=0x7fd0f002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.685+0000 7fd108339640 1 -- 172.21.15.77:0/3805797766 shutdown_connections 2023-11-04T01:40:18.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.685+0000 7fd108339640 1 --2- 172.21.15.77:0/3805797766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1000b2b60 0x7fd10006bc90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.685+0000 7fd108339640 1 --2- 172.21.15.77:0/3805797766 >> v2:172.21.15.122:3300/0 conn(0x7fd100160430 0x7fd1000b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.685+0000 7fd108339640 1 -- 172.21.15.77:0/3805797766 >> 172.21.15.77:0/3805797766 conn(0x7fd10006ea20 msgr2=0x7fd10006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:18.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.685+0000 7fd108339640 1 -- 172.21.15.77:0/3805797766 shutdown_connections 2023-11-04T01:40:18.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.685+0000 7fd108339640 1 -- 172.21.15.77:0/3805797766 wait complete. 2023-11-04T01:40:18.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.686+0000 7fd108339640 1 Processor -- start 2023-11-04T01:40:18.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.686+0000 7fd108339640 1 -- start start 2023-11-04T01:40:18.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.687+0000 7fd108339640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd10006c1d0 0x7fd10014f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.687+0000 7fd108339640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1000b2b60 0x7fd1000ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.687+0000 7fd108339640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd100160430 0x7fd1000b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.687+0000 7fd108339640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1000cd850 con 0x7fd1000b2b60 2023-11-04T01:40:18.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.687+0000 7fd108339640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1000c8f60 con 0x7fd100160430 2023-11-04T01:40:18.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.687+0000 7fd108339640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1000cd570 con 0x7fd10006c1d0 2023-11-04T01:40:18.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.687+0000 7fd1058d4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1000b2b60 0x7fd1000ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.687+0000 7fd1058d4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1000b2b60 0x7fd1000ccc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56560/0 (socket says 172.21.15.77:56560) 2023-11-04T01:40:18.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.687+0000 7fd1058d4640 1 -- 172.21.15.77:0/4076633535 learned_addr learned my addr 172.21.15.77:0/4076633535 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:18.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.687+0000 7fd1068d6640 1 --2- 172.21.15.77:0/4076633535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd100160430 0x7fd1000b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.687+0000 7fd1060d5640 1 --2- 172.21.15.77:0/4076633535 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd10006c1d0 0x7fd10014f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.687+0000 7fd1058d4640 1 -- 172.21.15.77:0/4076633535 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd10006c1d0 msgr2=0x7fd10014f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.687+0000 7fd1058d4640 1 --2- 172.21.15.77:0/4076633535 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd10006c1d0 0x7fd10014f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.687+0000 7fd1058d4640 1 -- 172.21.15.77:0/4076633535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd100160430 msgr2=0x7fd1000b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.687+0000 7fd1058d4640 1 --2- 172.21.15.77:0/4076633535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd100160430 0x7fd1000b41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.687+0000 7fd1058d4640 1 -- 172.21.15.77:0/4076633535 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f0009400 con 0x7fd1000b2b60 2023-11-04T01:40:18.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.687+0000 7fd1060d5640 1 --2- 172.21.15.77:0/4076633535 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd10006c1d0 0x7fd10014f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:18.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.687+0000 7fd1058d4640 1 --2- 172.21.15.77:0/4076633535 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1000b2b60 0x7fd1000ccc00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0000c00 tx=0x7fd0f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:18.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.687+0000 7fd0f6ffd640 1 -- 172.21.15.77:0/4076633535 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0004230 con 0x7fd1000b2b60 2023-11-04T01:40:18.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.687+0000 7fd0f6ffd640 1 -- 172.21.15.77:0/4076633535 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f0004390 con 0x7fd1000b2b60 2023-11-04T01:40:18.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.687+0000 7fd108339640 1 -- 172.21.15.77:0/4076633535 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1000c9200 con 0x7fd1000b2b60 2023-11-04T01:40:18.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.687+0000 7fd0f6ffd640 1 -- 172.21.15.77:0/4076633535 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f003a920 con 0x7fd1000b2b60 2023-11-04T01:40:18.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.688+0000 7fd108339640 1 -- 172.21.15.77:0/4076633535 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd100150230 con 0x7fd1000b2b60 2023-11-04T01:40:18.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.688+0000 7fd108339640 1 -- 172.21.15.77:0/4076633535 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1000c9720 con 0x7fd1000b2b60 2023-11-04T01:40:18.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.689+0000 7fd0f6ffd640 1 -- 172.21.15.77:0/4076633535 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd0f003aa80 con 0x7fd1000b2b60 2023-11-04T01:40:18.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.689+0000 7fd0f6ffd640 1 --2- 172.21.15.77:0/4076633535 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd0e406ae70 0x7fd0e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.689+0000 7fd0f6ffd640 1 -- 172.21.15.77:0/4076633535 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd0f00abfe0 con 0x7fd1000b2b60 2023-11-04T01:40:18.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.689+0000 7fd1060d5640 1 --2- 172.21.15.77:0/4076633535 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd0e406ae70 0x7fd0e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.690+0000 7fd1060d5640 1 --2- 172.21.15.77:0/4076633535 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd0e406ae70 0x7fd0e406d330 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc00b820 tx=0x7fd0fc008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:18.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.693+0000 7fd0f6ffd640 1 -- 172.21.15.77:0/4076633535 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd1000c9720 con 0x7fd1000b2b60 2023-11-04T01:40:18.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.858+0000 7fd108339640 1 -- 172.21.15.77:0/4076633535 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd1000c9720 con 0x7fd1000b2b60 2023-11-04T01:40:18.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.859+0000 7fd0f6ffd640 1 -- 172.21.15.77:0/4076633535 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd0f0035020 con 0x7fd1000b2b60 2023-11-04T01:40:18.861 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:40:18.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.860+0000 7fd108339640 1 -- 172.21.15.77:0/4076633535 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd0e406ae70 msgr2=0x7fd0e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.860+0000 7fd108339640 1 --2- 172.21.15.77:0/4076633535 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd0e406ae70 0x7fd0e406d330 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc00b820 tx=0x7fd0fc008040 comp rx=0 tx=0).stop 2023-11-04T01:40:18.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.860+0000 7fd108339640 1 -- 172.21.15.77:0/4076633535 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1000b2b60 msgr2=0x7fd1000ccc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.860+0000 7fd108339640 1 --2- 172.21.15.77:0/4076633535 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1000b2b60 0x7fd1000ccc00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0000c00 tx=0x7fd0f00046c0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.861+0000 7fd108339640 1 -- 172.21.15.77:0/4076633535 shutdown_connections 2023-11-04T01:40:18.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.861+0000 7fd108339640 1 --2- 172.21.15.77:0/4076633535 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd0e406ae70 0x7fd0e406d330 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.861+0000 7fd108339640 1 --2- 172.21.15.77:0/4076633535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd100160430 0x7fd1000b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.861+0000 7fd108339640 1 --2- 172.21.15.77:0/4076633535 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1000b2b60 0x7fd1000ccc00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.861+0000 7fd108339640 1 --2- 172.21.15.77:0/4076633535 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd10006c1d0 0x7fd10014f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.861+0000 7fd108339640 1 -- 172.21.15.77:0/4076633535 >> 172.21.15.77:0/4076633535 conn(0x7fd10006ea20 msgr2=0x7fd1000b0190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:18.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.861+0000 7fd108339640 1 -- 172.21.15.77:0/4076633535 shutdown_connections 2023-11-04T01:40:18.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.861+0000 7fd108339640 1 -- 172.21.15.77:0/4076633535 wait complete. 2023-11-04T01:40:18.873 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:40:18.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.973+0000 7f339f844640 1 Processor -- start 2023-11-04T01:40:18.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.974+0000 7f339f844640 1 -- start start 2023-11-04T01:40:18.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.974+0000 7f339f844640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f339806a830 0x7f33980ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.974+0000 7f339f844640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3398160990 con 0x7f33981605b0 2023-11-04T01:40:18.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.974+0000 7f339f844640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33980cc7c0 con 0x7f33980b1a40 2023-11-04T01:40:18.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.974+0000 7f339f844640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33980cd750 con 0x7f339806a830 2023-11-04T01:40:18.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.975+0000 7f339d5e0640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f33981605b0 0x7f339806a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52550/0 (socket says 172.21.15.77:52550) 2023-11-04T01:40:18.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.975+0000 7f339d5e0640 1 -- 172.21.15.77:0/2105448475 learned_addr learned my addr 172.21.15.77:0/2105448475 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:18.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.975+0000 7f339dde1640 1 --2- 172.21.15.77:0/2105448475 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f339806a830 0x7f33980ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.975+0000 7f338ffff640 1 -- 172.21.15.77:0/2105448475 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1250334604 0 0) 0x7f3398160990 con 0x7f33981605b0 2023-11-04T01:40:18.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.975+0000 7f338ffff640 1 -- 172.21.15.77:0/2105448475 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3384003520 con 0x7f33981605b0 2023-11-04T01:40:18.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.975+0000 7f338ffff640 1 -- 172.21.15.77:0/2105448475 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2874346273 0 0) 0x7f33980cc7c0 con 0x7f33980b1a40 2023-11-04T01:40:18.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.975+0000 7f338ffff640 1 -- 172.21.15.77:0/2105448475 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3398160990 con 0x7f33980b1a40 2023-11-04T01:40:18.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.975+0000 7f338ffff640 1 -- 172.21.15.77:0/2105448475 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2175865846 0 0) 0x7f3384003520 con 0x7f33981605b0 2023-11-04T01:40:18.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.975+0000 7f338ffff640 1 -- 172.21.15.77:0/2105448475 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f339806a830 msgr2=0x7f33980ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:18.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.975+0000 7f338ffff640 1 --2- 172.21.15.77:0/2105448475 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f339806a830 0x7f33980ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.975+0000 7f338ffff640 1 -- 172.21.15.77:0/2105448475 >> v1:172.21.15.122:6789/0 conn(0x7f33980b1a40 legacy=0x7f33980cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.975+0000 7f338ffff640 1 -- 172.21.15.77:0/2105448475 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33980cc4e0 con 0x7f33981605b0 2023-11-04T01:40:18.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.975+0000 7f338ffff640 1 -- 172.21.15.77:0/2105448475 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f3394001970 con 0x7f33981605b0 2023-11-04T01:40:18.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.975+0000 7f339dde1640 1 --2- 172.21.15.77:0/2105448475 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f339806a830 0x7f33980ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:18.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.975+0000 7f338ffff640 1 -- 172.21.15.77:0/2105448475 >> v1:172.21.15.77:6789/0 conn(0x7f33981605b0 legacy=0x7f339806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.975+0000 7f338ffff640 1 --2- 172.21.15.77:0/2105448475 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f339806a830 0x7f3384003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.975+0000 7f338ffff640 1 --2- 172.21.15.77:0/2105448475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33840040c0 0x7f33840047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.975+0000 7f338ffff640 1 --2- 172.21.15.77:0/2105448475 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3384004d00 0x7f3384005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.975+0000 7f338ffff640 1 -- 172.21.15.77:0/2105448475 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33980cd750 con 0x7f33840040c0 2023-11-04T01:40:18.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.975+0000 7f338ffff640 1 -- 172.21.15.77:0/2105448475 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338400bbc0 con 0x7f3384004d00 2023-11-04T01:40:18.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.975+0000 7f338ffff640 1 -- 172.21.15.77:0/2105448475 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f338400bd80 con 0x7f339806a830 2023-11-04T01:40:18.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.975+0000 7f339cddf640 1 --2- 172.21.15.77:0/2105448475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33840040c0 0x7f33840047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.975+0000 7f339d5e0640 1 --2- 172.21.15.77:0/2105448475 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f339806a830 0x7f3384003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.975+0000 7f339dde1640 1 --2- 172.21.15.77:0/2105448475 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3384004d00 0x7f3384005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.976+0000 7f339cddf640 1 -- 172.21.15.77:0/2105448475 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f339806a830 msgr2=0x7f3384003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:18.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.976+0000 7f339cddf640 1 --2- 172.21.15.77:0/2105448475 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f339806a830 0x7f3384003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.976+0000 7f339cddf640 1 -- 172.21.15.77:0/2105448475 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3384004d00 msgr2=0x7f3384005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:18.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.976+0000 7f339cddf640 1 --2- 172.21.15.77:0/2105448475 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3384004d00 0x7f3384005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.976+0000 7f339cddf640 1 -- 172.21.15.77:0/2105448475 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3390009400 con 0x7f33840040c0 2023-11-04T01:40:18.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.976+0000 7f339cddf640 1 --2- 172.21.15.77:0/2105448475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33840040c0 0x7f33840047c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f33880018d0 tx=0x7f33840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c3d19e4ce06f3b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:18.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.976+0000 7f338ffff640 1 -- 172.21.15.77:0/2105448475 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33880052d0 con 0x7f33840040c0 2023-11-04T01:40:18.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.976+0000 7f338ffff640 1 -- 172.21.15.77:0/2105448475 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3388005430 con 0x7f33840040c0 2023-11-04T01:40:18.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.976+0000 7f338ffff640 1 -- 172.21.15.77:0/2105448475 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3388003810 con 0x7f33840040c0 2023-11-04T01:40:18.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.977+0000 7f339f844640 1 -- 172.21.15.77:0/2105448475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33840040c0 msgr2=0x7f33840047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.977+0000 7f339f844640 1 --2- 172.21.15.77:0/2105448475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33840040c0 0x7f33840047c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f33880018d0 tx=0x7f33840057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.977+0000 7f339dde1640 1 -- 172.21.15.77:0/2105448475 reap_dead start 2023-11-04T01:40:18.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.977+0000 7f339f844640 1 -- 172.21.15.77:0/2105448475 shutdown_connections 2023-11-04T01:40:18.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.977+0000 7f339f844640 1 -- 172.21.15.77:0/2105448475 >> 172.21.15.77:0/2105448475 conn(0x7f3398071820 msgr2=0x7f3398071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:18.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.977+0000 7f339f844640 1 -- 172.21.15.77:0/2105448475 shutdown_connections 2023-11-04T01:40:18.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.977+0000 7f339f844640 1 -- 172.21.15.77:0/2105448475 wait complete. 2023-11-04T01:40:18.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.978+0000 7f339f844640 1 Processor -- start 2023-11-04T01:40:18.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.978+0000 7f339f844640 1 -- start start 2023-11-04T01:40:18.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.979+0000 7f339f844640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f33840040c0 0x7f3398158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.979+0000 7f339f844640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33980c52c0 0x7f33980cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.979+0000 7f339f844640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33980c5740 0x7f33980cfe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.979+0000 7f339f844640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33980c3690 con 0x7f33980c52c0 2023-11-04T01:40:18.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.979+0000 7f339f844640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33980c3930 con 0x7f33980c5740 2023-11-04T01:40:18.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.979+0000 7f339f844640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33980c3c10 con 0x7f33840040c0 2023-11-04T01:40:18.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.979+0000 7f339cddf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33980c52c0 0x7f33980cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.979+0000 7f339cddf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33980c52c0 0x7f33980cf8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56564/0 (socket says 172.21.15.77:56564) 2023-11-04T01:40:18.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.979+0000 7f339cddf640 1 -- 172.21.15.77:0/12364826 learned_addr learned my addr 172.21.15.77:0/12364826 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:18.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.979+0000 7f339d5e0640 1 --2- 172.21.15.77:0/12364826 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f33840040c0 0x7f3398158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.979+0000 7f339dde1640 1 --2- 172.21.15.77:0/12364826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33980c5740 0x7f33980cfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.979+0000 7f339cddf640 1 -- 172.21.15.77:0/12364826 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f33840040c0 msgr2=0x7f3398158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.979+0000 7f339cddf640 1 --2- 172.21.15.77:0/12364826 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f33840040c0 0x7f3398158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.979+0000 7f339cddf640 1 -- 172.21.15.77:0/12364826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33980c5740 msgr2=0x7f33980cfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:18.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.979+0000 7f339cddf640 1 --2- 172.21.15.77:0/12364826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33980c5740 0x7f33980cfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:18.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.979+0000 7f339cddf640 1 -- 172.21.15.77:0/12364826 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33980c3ef0 con 0x7f33980c52c0 2023-11-04T01:40:18.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.980+0000 7f339cddf640 1 --2- 172.21.15.77:0/12364826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33980c52c0 0x7f33980cf8f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3388005040 tx=0x7f33880012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:18.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.980+0000 7f338dffb640 1 -- 172.21.15.77:0/12364826 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3388007450 con 0x7f33980c52c0 2023-11-04T01:40:18.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.980+0000 7f338dffb640 1 -- 172.21.15.77:0/12364826 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33880075b0 con 0x7f33980c52c0 2023-11-04T01:40:18.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.980+0000 7f338dffb640 1 -- 172.21.15.77:0/12364826 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3388007720 con 0x7f33980c52c0 2023-11-04T01:40:18.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.980+0000 7f339f844640 1 -- 172.21.15.77:0/12364826 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33980c41d0 con 0x7f33980c52c0 2023-11-04T01:40:18.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.980+0000 7f339f844640 1 -- 172.21.15.77:0/12364826 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33980c5f40 con 0x7f33980c52c0 2023-11-04T01:40:18.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.981+0000 7f339f844640 1 -- 172.21.15.77:0/12364826 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33980672a0 con 0x7f33980c52c0 2023-11-04T01:40:18.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.981+0000 7f338dffb640 1 -- 172.21.15.77:0/12364826 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f33880037f0 con 0x7f33980c52c0 2023-11-04T01:40:18.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.982+0000 7f338dffb640 1 --2- 172.21.15.77:0/12364826 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f337c06aea0 0x7f337c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:18.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.982+0000 7f338dffb640 1 -- 172.21.15.77:0/12364826 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f33880ab6e0 con 0x7f33980c52c0 2023-11-04T01:40:18.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.982+0000 7f339d5e0640 1 --2- 172.21.15.77:0/12364826 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f337c06aea0 0x7f337c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:18.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.982+0000 7f339d5e0640 1 --2- 172.21.15.77:0/12364826 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f337c06aea0 0x7f337c06d360 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3394004d00 tx=0x7f3394006040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:18.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:18.986+0000 7f338dffb640 1 -- 172.21.15.77:0/12364826 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f33880765e0 con 0x7f33980c52c0 2023-11-04T01:40:19.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.151+0000 7f339f844640 1 -- 172.21.15.77:0/12364826 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f33980c6130 con 0x7f33980c52c0 2023-11-04T01:40:19.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.152+0000 7f338dffb640 1 -- 172.21.15.77:0/12364826 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f338804b020 con 0x7f33980c52c0 2023-11-04T01:40:19.154 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-04T01:40:19.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.153+0000 7f339f844640 1 -- 172.21.15.77:0/12364826 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f337c06aea0 msgr2=0x7f337c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:19.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.153+0000 7f339f844640 1 --2- 172.21.15.77:0/12364826 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f337c06aea0 0x7f337c06d360 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3394004d00 tx=0x7f3394006040 comp rx=0 tx=0).stop 2023-11-04T01:40:19.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.154+0000 7f339f844640 1 -- 172.21.15.77:0/12364826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33980c52c0 msgr2=0x7f33980cf8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:19.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.154+0000 7f339f844640 1 --2- 172.21.15.77:0/12364826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33980c52c0 0x7f33980cf8f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3388005040 tx=0x7f33880012d0 comp rx=0 tx=0).stop 2023-11-04T01:40:19.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.154+0000 7f339f844640 1 -- 172.21.15.77:0/12364826 shutdown_connections 2023-11-04T01:40:19.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.154+0000 7f339f844640 1 --2- 172.21.15.77:0/12364826 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f337c06aea0 0x7f337c06d360 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:19.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.154+0000 7f339f844640 1 --2- 172.21.15.77:0/12364826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33980c5740 0x7f33980cfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:19.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.154+0000 7f339f844640 1 --2- 172.21.15.77:0/12364826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33980c52c0 0x7f33980cf8f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:19.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.154+0000 7f339f844640 1 --2- 172.21.15.77:0/12364826 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f33840040c0 0x7f3398158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:19.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.154+0000 7f339f844640 1 -- 172.21.15.77:0/12364826 >> 172.21.15.77:0/12364826 conn(0x7f3398071820 msgr2=0x7f33980afdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:19.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.154+0000 7f339f844640 1 -- 172.21.15.77:0/12364826 shutdown_connections 2023-11-04T01:40:19.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.154+0000 7f339f844640 1 -- 172.21.15.77:0/12364826 wait complete. 2023-11-04T01:40:19.166 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:40:19.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.266+0000 7f518df25640 1 Processor -- start 2023-11-04T01:40:19.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.266+0000 7f518df25640 1 -- start start 2023-11-04T01:40:19.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.267+0000 7f518df25640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5188070ff0 0x7f51880cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:19.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.267+0000 7f518df25640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f518815d1b0 0x7f51880713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:19.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.267+0000 7f518df25640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51880c9bf0 con 0x7f5188066000 2023-11-04T01:40:19.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.267+0000 7f518df25640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51880cd890 con 0x7f5188070ff0 2023-11-04T01:40:19.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.267+0000 7f518df25640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5188071910 con 0x7f518815d1b0 2023-11-04T01:40:19.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.267+0000 7f51877fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5188070ff0 0x7f51880cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:19.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.267+0000 7f5186ffd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f518815d1b0 0x7f51880713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:19.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.267+0000 7f5187fff640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f5188066000 0x7f5188160af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:55590/0 (socket says 172.21.15.77:55590) 2023-11-04T01:40:19.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.267+0000 7f51877fe640 1 --2- 172.21.15.77:0/2799875930 >> v2:172.21.15.122:3300/0 conn(0x7f5188070ff0 0x7f51880cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:40268/0 (socket says 172.21.15.77:40268) 2023-11-04T01:40:19.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.267+0000 7f5187fff640 1 -- 172.21.15.77:0/2799875930 learned_addr learned my addr 172.21.15.77:0/2799875930 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:19.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.268+0000 7f5186ffd640 1 -- 172.21.15.77:0/2799875930 >> v2:172.21.15.122:3300/0 conn(0x7f5188070ff0 msgr2=0x7f51880cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:19.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.268+0000 7f5186ffd640 1 --2- 172.21.15.77:0/2799875930 >> v2:172.21.15.122:3300/0 conn(0x7f5188070ff0 0x7f51880cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:19.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.268+0000 7f5186ffd640 1 -- 172.21.15.77:0/2799875930 >> v1:172.21.15.122:6789/0 conn(0x7f5188066000 legacy=0x7f5188160af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:19.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.268+0000 7f5186ffd640 1 -- 172.21.15.77:0/2799875930 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51880cdb30 con 0x7f518815d1b0 2023-11-04T01:40:19.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.268+0000 7f51877fe640 1 --2- 172.21.15.77:0/2799875930 >> v2:172.21.15.122:3300/0 conn(0x7f5188070ff0 0x7f51880cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:19.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.268+0000 7f5186ffd640 1 --2- 172.21.15.77:0/2799875930 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f518815d1b0 0x7f51880713d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f517c0097a0 tx=0x7f517c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba7f78c4a3a88470 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:19.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.269+0000 7f51867fc640 1 -- 172.21.15.77:0/2799875930 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517c031830 con 0x7f518815d1b0 2023-11-04T01:40:19.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.269+0000 7f51867fc640 1 -- 172.21.15.77:0/2799875930 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517c031990 con 0x7f518815d1b0 2023-11-04T01:40:19.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.269+0000 7f51867fc640 1 -- 172.21.15.77:0/2799875930 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517c031d20 con 0x7f518815d1b0 2023-11-04T01:40:19.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.269+0000 7f518df25640 1 -- 172.21.15.77:0/2799875930 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f518815d1b0 msgr2=0x7f51880713d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:19.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.269+0000 7f518df25640 1 --2- 172.21.15.77:0/2799875930 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f518815d1b0 0x7f51880713d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f517c0097a0 tx=0x7f517c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:19.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.269+0000 7f518df25640 1 -- 172.21.15.77:0/2799875930 shutdown_connections 2023-11-04T01:40:19.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.269+0000 7f518df25640 1 --2- 172.21.15.77:0/2799875930 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f518815d1b0 0x7f51880713d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:19.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.269+0000 7f518df25640 1 --2- 172.21.15.77:0/2799875930 >> v2:172.21.15.122:3300/0 conn(0x7f5188070ff0 0x7f51880cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:19.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.269+0000 7f518df25640 1 -- 172.21.15.77:0/2799875930 >> 172.21.15.77:0/2799875930 conn(0x7f51880cbc90 msgr2=0x7f51880cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:19.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.269+0000 7f518df25640 1 -- 172.21.15.77:0/2799875930 shutdown_connections 2023-11-04T01:40:19.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.269+0000 7f518df25640 1 -- 172.21.15.77:0/2799875930 wait complete. 2023-11-04T01:40:19.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.270+0000 7f518df25640 1 Processor -- start 2023-11-04T01:40:19.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.270+0000 7f518df25640 1 -- start start 2023-11-04T01:40:19.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.271+0000 7f518df25640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5188066000 0x7f51880b2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:19.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.271+0000 7f518df25640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5188070ff0 0x7f5188152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:19.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.271+0000 7f518df25640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f518815d1b0 0x7f5188153150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:19.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.271+0000 7f518df25640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518815e6e0 con 0x7f5188066000 2023-11-04T01:40:19.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.271+0000 7f518df25640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51880b2aa0 con 0x7f5188070ff0 2023-11-04T01:40:19.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.271+0000 7f518df25640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51881f2a60 con 0x7f518815d1b0 2023-11-04T01:40:19.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.271+0000 7f51877fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5188066000 0x7f51880b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:19.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.271+0000 7f51877fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5188066000 0x7f51880b2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56580/0 (socket says 172.21.15.77:56580) 2023-11-04T01:40:19.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.271+0000 7f51877fe640 1 -- 172.21.15.77:0/1369482708 learned_addr learned my addr 172.21.15.77:0/1369482708 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:19.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.272+0000 7f5186ffd640 1 --2- 172.21.15.77:0/1369482708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5188070ff0 0x7f5188152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:19.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.272+0000 7f5187fff640 1 --2- 172.21.15.77:0/1369482708 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f518815d1b0 0x7f5188153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:19.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.272+0000 7f51877fe640 1 -- 172.21.15.77:0/1369482708 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f518815d1b0 msgr2=0x7f5188153150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:19.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.272+0000 7f51877fe640 1 --2- 172.21.15.77:0/1369482708 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f518815d1b0 0x7f5188153150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:19.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.272+0000 7f51877fe640 1 -- 172.21.15.77:0/1369482708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5188070ff0 msgr2=0x7f5188152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:19.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.272+0000 7f51877fe640 1 --2- 172.21.15.77:0/1369482708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5188070ff0 0x7f5188152c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:19.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.272+0000 7f51877fe640 1 -- 172.21.15.77:0/1369482708 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5178009400 con 0x7f5188066000 2023-11-04T01:40:19.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.272+0000 7f51877fe640 1 --2- 172.21.15.77:0/1369482708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5188066000 0x7f51880b2560 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f517800e960 tx=0x7f517800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:19.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.272+0000 7f516ffff640 1 -- 172.21.15.77:0/1369482708 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517800ca00 con 0x7f5188066000 2023-11-04T01:40:19.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.272+0000 7f516ffff640 1 -- 172.21.15.77:0/1369482708 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517800cb60 con 0x7f5188066000 2023-11-04T01:40:19.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.272+0000 7f516ffff640 1 -- 172.21.15.77:0/1369482708 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5178013470 con 0x7f5188066000 2023-11-04T01:40:19.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.272+0000 7f518df25640 1 -- 172.21.15.77:0/1369482708 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f517c009400 con 0x7f5188066000 2023-11-04T01:40:19.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.272+0000 7f518df25640 1 -- 172.21.15.77:0/1369482708 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f518815dd40 con 0x7f5188066000 2023-11-04T01:40:19.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.273+0000 7f518df25640 1 -- 172.21.15.77:0/1369482708 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5188074290 con 0x7f5188066000 2023-11-04T01:40:19.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.273+0000 7f516ffff640 1 -- 172.21.15.77:0/1369482708 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f51780135d0 con 0x7f5188066000 2023-11-04T01:40:19.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.274+0000 7f516ffff640 1 --2- 172.21.15.77:0/1369482708 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f517406ae70 0x7f517406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:19.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.274+0000 7f516ffff640 1 -- 172.21.15.77:0/1369482708 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5178089b10 con 0x7f5188066000 2023-11-04T01:40:19.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.274+0000 7f5186ffd640 1 --2- 172.21.15.77:0/1369482708 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f517406ae70 0x7f517406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:19.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.274+0000 7f5186ffd640 1 --2- 172.21.15.77:0/1369482708 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f517406ae70 0x7f517406d330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f517c036000 tx=0x7f517c03c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:19.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.278+0000 7f516ffff640 1 -- 172.21.15.77:0/1369482708 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5178054960 con 0x7f5188066000 2023-11-04T01:40:19.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.442+0000 7f518df25640 1 -- 172.21.15.77:0/1369482708 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f51880cc110 con 0x7f5188066000 2023-11-04T01:40:19.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.442+0000 7f516ffff640 1 -- 172.21.15.77:0/1369482708 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f51780170a0 con 0x7f5188066000 2023-11-04T01:40:19.444 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:40:19.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.444+0000 7f518df25640 1 -- 172.21.15.77:0/1369482708 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f517406ae70 msgr2=0x7f517406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:19.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.444+0000 7f518df25640 1 --2- 172.21.15.77:0/1369482708 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f517406ae70 0x7f517406d330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f517c036000 tx=0x7f517c03c040 comp rx=0 tx=0).stop 2023-11-04T01:40:19.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.444+0000 7f518df25640 1 -- 172.21.15.77:0/1369482708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5188066000 msgr2=0x7f51880b2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:19.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.444+0000 7f518df25640 1 --2- 172.21.15.77:0/1369482708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5188066000 0x7f51880b2560 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f517800e960 tx=0x7f517800ee20 comp rx=0 tx=0).stop 2023-11-04T01:40:19.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.444+0000 7f518df25640 1 -- 172.21.15.77:0/1369482708 shutdown_connections 2023-11-04T01:40:19.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.444+0000 7f518df25640 1 --2- 172.21.15.77:0/1369482708 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f517406ae70 0x7f517406d330 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:19.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.444+0000 7f518df25640 1 --2- 172.21.15.77:0/1369482708 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f518815d1b0 0x7f5188153150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:19.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.444+0000 7f518df25640 1 --2- 172.21.15.77:0/1369482708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5188070ff0 0x7f5188152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:19.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.444+0000 7f518df25640 1 --2- 172.21.15.77:0/1369482708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5188066000 0x7f51880b2560 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:19.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.444+0000 7f518df25640 1 -- 172.21.15.77:0/1369482708 >> 172.21.15.77:0/1369482708 conn(0x7f51880cbc90 msgr2=0x7f51880ca5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:19.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.444+0000 7f518df25640 1 -- 172.21.15.77:0/1369482708 shutdown_connections 2023-11-04T01:40:19.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.444+0000 7f518df25640 1 -- 172.21.15.77:0/1369482708 wait complete. 2023-11-04T01:40:19.457 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:40:19.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.555+0000 7f11d55ee640 1 Processor -- start 2023-11-04T01:40:19.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.555+0000 7f11d55ee640 1 -- start start 2023-11-04T01:40:19.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.556+0000 7f11d55ee640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f11d00cd6d0 0x7f11d0161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:19.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.556+0000 7f11d55ee640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11d00cde60 con 0x7f11d0153e60 2023-11-04T01:40:19.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.556+0000 7f11d55ee640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11d0160f90 con 0x7f11d00b4880 2023-11-04T01:40:19.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.556+0000 7f11d55ee640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d0161960 con 0x7f11d00cd6d0 2023-11-04T01:40:19.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.556+0000 7f11ceffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f11d0153e60 0x7f11d015dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52562/0 (socket says 172.21.15.77:52562) 2023-11-04T01:40:19.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.556+0000 7f11ceffd640 1 -- 172.21.15.77:0/3633216042 learned_addr learned my addr 172.21.15.77:0/3633216042 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:19.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.556+0000 7f11c7fff640 1 --2- 172.21.15.77:0/3633216042 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f11d00cd6d0 0x7f11d0161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:19.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.556+0000 7f11ce7fc640 1 -- 172.21.15.77:0/3633216042 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1021180553 0 0) 0x7f11d00cde60 con 0x7f11d0153e60 2023-11-04T01:40:19.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.556+0000 7f11ce7fc640 1 -- 172.21.15.77:0/3633216042 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11bc003520 con 0x7f11d0153e60 2023-11-04T01:40:19.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.556+0000 7f11ce7fc640 1 -- 172.21.15.77:0/3633216042 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2656234648 0 0) 0x7f11bc003520 con 0x7f11d0153e60 2023-11-04T01:40:19.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.556+0000 7f11ce7fc640 1 -- 172.21.15.77:0/3633216042 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f11d00cd6d0 msgr2=0x7f11d0161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:19.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.556+0000 7f11ce7fc640 1 --2- 172.21.15.77:0/3633216042 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f11d00cd6d0 0x7f11d0161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:19.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.556+0000 7f11ce7fc640 1 -- 172.21.15.77:0/3633216042 >> v1:172.21.15.122:6789/0 conn(0x7f11d00b4880 legacy=0x7f11d00b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:19.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.556+0000 7f11ce7fc640 1 -- 172.21.15.77:0/3633216042 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d00ce090 con 0x7f11d0153e60 2023-11-04T01:40:19.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.556+0000 7f11ce7fc640 1 -- 172.21.15.77:0/3633216042 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f11c0001670 con 0x7f11d0153e60 2023-11-04T01:40:19.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.556+0000 7f11ce7fc640 1 -- 172.21.15.77:0/3633216042 >> v1:172.21.15.77:6789/0 conn(0x7f11d0153e60 legacy=0x7f11d015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:19.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.556+0000 7f11ce7fc640 1 --2- 172.21.15.77:0/3633216042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11bc0039a0 0x7f11bc003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:19.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.556+0000 7f11ce7fc640 1 --2- 172.21.15.77:0/3633216042 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f11d00cd6d0 0x7f11bc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:19.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.556+0000 7f11ce7fc640 1 --2- 172.21.15.77:0/3633216042 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11bc004d00 0x7f11bc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:19.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.556+0000 7f11ce7fc640 1 -- 172.21.15.77:0/3633216042 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d0161960 con 0x7f11bc0039a0 2023-11-04T01:40:19.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.556+0000 7f11ce7fc640 1 -- 172.21.15.77:0/3633216042 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc00b9b0 con 0x7f11bc004d00 2023-11-04T01:40:19.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.556+0000 7f11ce7fc640 1 -- 172.21.15.77:0/3633216042 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc00bb70 con 0x7f11d00cd6d0 2023-11-04T01:40:19.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.556+0000 7f11ceffd640 1 --2- 172.21.15.77:0/3633216042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11bc0039a0 0x7f11bc003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:19.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.557+0000 7f11c7fff640 1 --2- 172.21.15.77:0/3633216042 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f11d00cd6d0 0x7f11bc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:19.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.557+0000 7f11cf7fe640 1 --2- 172.21.15.77:0/3633216042 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11bc004d00 0x7f11bc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:19.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.557+0000 7f11ceffd640 1 -- 172.21.15.77:0/3633216042 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f11d00cd6d0 msgr2=0x7f11bc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:19.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.557+0000 7f11ceffd640 1 --2- 172.21.15.77:0/3633216042 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f11d00cd6d0 0x7f11bc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:19.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.557+0000 7f11ceffd640 1 -- 172.21.15.77:0/3633216042 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11bc004d00 msgr2=0x7f11bc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:19.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.557+0000 7f11ceffd640 1 --2- 172.21.15.77:0/3633216042 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11bc004d00 0x7f11bc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:19.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.557+0000 7f11ceffd640 1 -- 172.21.15.77:0/3633216042 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11bc003520 con 0x7f11bc0039a0 2023-11-04T01:40:19.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.557+0000 7f11cf7fe640 1 --2- 172.21.15.77:0/3633216042 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11bc004d00 0x7f11bc005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:19.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.557+0000 7f11ceffd640 1 --2- 172.21.15.77:0/3633216042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11bc0039a0 0x7f11bc003d80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f11c000c240 tx=0x7f11bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a8eb18a121a42f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:19.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.558+0000 7f11ce7fc640 1 -- 172.21.15.77:0/3633216042 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c0005ad0 con 0x7f11bc0039a0 2023-11-04T01:40:19.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.558+0000 7f11ce7fc640 1 -- 172.21.15.77:0/3633216042 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c0005c30 con 0x7f11bc0039a0 2023-11-04T01:40:19.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.558+0000 7f11ce7fc640 1 -- 172.21.15.77:0/3633216042 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c002c810 con 0x7f11bc0039a0 2023-11-04T01:40:19.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.558+0000 7f11d55ee640 1 -- 172.21.15.77:0/3633216042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11bc0039a0 msgr2=0x7f11bc003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:19.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.558+0000 7f11d55ee640 1 --2- 172.21.15.77:0/3633216042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11bc0039a0 0x7f11bc003d80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f11c000c240 tx=0x7f11bc0057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:19.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.558+0000 7f11cf7fe640 1 -- 172.21.15.77:0/3633216042 reap_dead start 2023-11-04T01:40:19.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.558+0000 7f11d55ee640 1 -- 172.21.15.77:0/3633216042 shutdown_connections 2023-11-04T01:40:19.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.558+0000 7f11d55ee640 1 -- 172.21.15.77:0/3633216042 >> 172.21.15.77:0/3633216042 conn(0x7f11d00cf880 msgr2=0x7f11d00cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:19.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.559+0000 7f11d55ee640 1 -- 172.21.15.77:0/3633216042 shutdown_connections 2023-11-04T01:40:19.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.559+0000 7f11d55ee640 1 -- 172.21.15.77:0/3633216042 wait complete. 2023-11-04T01:40:19.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.560+0000 7f11d55ee640 1 Processor -- start 2023-11-04T01:40:19.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.560+0000 7f11d55ee640 1 -- start start 2023-11-04T01:40:19.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.560+0000 7f11d55ee640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11bc0039a0 0x7f11d00c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:19.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.561+0000 7f11d55ee640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f11d00cbae0 0x7f11d0156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:19.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.561+0000 7f11d55ee640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11d00cbf60 0x7f11d01574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:19.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.561+0000 7f11d55ee640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d00c9f70 con 0x7f11d00cbf60 2023-11-04T01:40:19.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.561+0000 7f11d55ee640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d00ca250 con 0x7f11bc0039a0 2023-11-04T01:40:19.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.561+0000 7f11d55ee640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d00ca530 con 0x7f11d00cbae0 2023-11-04T01:40:19.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.561+0000 7f11cf7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11d00cbf60 0x7f11d01574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:19.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.561+0000 7f11cf7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11d00cbf60 0x7f11d01574e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56598/0 (socket says 172.21.15.77:56598) 2023-11-04T01:40:19.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.561+0000 7f11cf7fe640 1 -- 172.21.15.77:0/4240702095 learned_addr learned my addr 172.21.15.77:0/4240702095 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:19.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.561+0000 7f11ceffd640 1 --2- 172.21.15.77:0/4240702095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11bc0039a0 0x7f11d00c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:19.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.561+0000 7f11c7fff640 1 --2- 172.21.15.77:0/4240702095 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f11d00cbae0 0x7f11d0156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:19.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.561+0000 7f11cf7fe640 1 -- 172.21.15.77:0/4240702095 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f11d00cbae0 msgr2=0x7f11d0156fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:19.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.561+0000 7f11cf7fe640 1 --2- 172.21.15.77:0/4240702095 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f11d00cbae0 0x7f11d0156fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:19.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.561+0000 7f11cf7fe640 1 -- 172.21.15.77:0/4240702095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11bc0039a0 msgr2=0x7f11d00c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:19.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.561+0000 7f11cf7fe640 1 --2- 172.21.15.77:0/4240702095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11bc0039a0 0x7f11d00c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:19.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.561+0000 7f11cf7fe640 1 -- 172.21.15.77:0/4240702095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d00ca810 con 0x7f11d00cbf60 2023-11-04T01:40:19.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.561+0000 7f11cf7fe640 1 --2- 172.21.15.77:0/4240702095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11d00cbf60 0x7f11d01574e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f11d006c8b0 tx=0x7f11c800eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:19.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.561+0000 7f11c77fe640 1 -- 172.21.15.77:0/4240702095 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c8003970 con 0x7f11d00cbf60 2023-11-04T01:40:19.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.561+0000 7f11c77fe640 1 -- 172.21.15.77:0/4240702095 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c8003ad0 con 0x7f11d00cbf60 2023-11-04T01:40:19.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.561+0000 7f11d55ee640 1 -- 172.21.15.77:0/4240702095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d00caaf0 con 0x7f11d00cbf60 2023-11-04T01:40:19.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.561+0000 7f11c77fe640 1 -- 172.21.15.77:0/4240702095 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c8003e80 con 0x7f11d00cbf60 2023-11-04T01:40:19.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.561+0000 7f11d55ee640 1 -- 172.21.15.77:0/4240702095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d00c9540 con 0x7f11d00cbf60 2023-11-04T01:40:19.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.562+0000 7f11d55ee640 1 -- 172.21.15.77:0/4240702095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d00cad10 con 0x7f11d00cbf60 2023-11-04T01:40:19.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.563+0000 7f11c77fe640 1 -- 172.21.15.77:0/4240702095 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f11c80050d0 con 0x7f11d00cbf60 2023-11-04T01:40:19.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.563+0000 7f11c77fe640 1 --2- 172.21.15.77:0/4240702095 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f11b006ae70 0x7f11b006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:19.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.563+0000 7f11c77fe640 1 -- 172.21.15.77:0/4240702095 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f11c8089500 con 0x7f11d00cbf60 2023-11-04T01:40:19.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.563+0000 7f11ceffd640 1 --2- 172.21.15.77:0/4240702095 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f11b006ae70 0x7f11b006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:19.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.564+0000 7f11ceffd640 1 --2- 172.21.15.77:0/4240702095 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f11b006ae70 0x7f11b006d330 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f11c0034000 tx=0x7f11c0009030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:19.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.567+0000 7f11c77fe640 1 -- 172.21.15.77:0/4240702095 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f11c8057d50 con 0x7f11d00cbf60 2023-11-04T01:40:19.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.745+0000 7f11d55ee640 1 -- 172.21.15.77:0/4240702095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f11d00c9540 con 0x7f11d00cbf60 2023-11-04T01:40:19.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.746+0000 7f11c77fe640 1 -- 172.21.15.77:0/4240702095 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f11d00c9540 con 0x7f11d00cbf60 2023-11-04T01:40:19.748 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-11-04T01:40:19.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.748+0000 7f11d55ee640 1 -- 172.21.15.77:0/4240702095 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f11b006ae70 msgr2=0x7f11b006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:19.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.748+0000 7f11d55ee640 1 --2- 172.21.15.77:0/4240702095 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f11b006ae70 0x7f11b006d330 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f11c0034000 tx=0x7f11c0009030 comp rx=0 tx=0).stop 2023-11-04T01:40:19.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.748+0000 7f11d55ee640 1 -- 172.21.15.77:0/4240702095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11d00cbf60 msgr2=0x7f11d01574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:19.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.748+0000 7f11d55ee640 1 --2- 172.21.15.77:0/4240702095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11d00cbf60 0x7f11d01574e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f11d006c8b0 tx=0x7f11c800eb40 comp rx=0 tx=0).stop 2023-11-04T01:40:19.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.748+0000 7f11d55ee640 1 -- 172.21.15.77:0/4240702095 shutdown_connections 2023-11-04T01:40:19.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.748+0000 7f11d55ee640 1 --2- 172.21.15.77:0/4240702095 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f11b006ae70 0x7f11b006d330 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:19.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.748+0000 7f11d55ee640 1 --2- 172.21.15.77:0/4240702095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11d00cbf60 0x7f11d01574e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:19.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.748+0000 7f11d55ee640 1 --2- 172.21.15.77:0/4240702095 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f11d00cbae0 0x7f11d0156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:19.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.748+0000 7f11d55ee640 1 --2- 172.21.15.77:0/4240702095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11bc0039a0 0x7f11d00c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:19.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.748+0000 7f11d55ee640 1 -- 172.21.15.77:0/4240702095 >> 172.21.15.77:0/4240702095 conn(0x7f11d00cf880 msgr2=0x7f11d015fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:19.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.748+0000 7f11d55ee640 1 -- 172.21.15.77:0/4240702095 shutdown_connections 2023-11-04T01:40:19.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19.748+0000 7f11d55ee640 1 -- 172.21.15.77:0/4240702095 wait complete. 2023-11-04T01:40:19.760 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi077.front.sepia.ceph.com... 2023-11-04T01:40:19.760 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:40:19.761 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-11-04T01:40:19.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:19.819 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi077.stderr:ceph-fuse[125433]: fuse finished with error 0 and tester_r 0 2023-11-04T01:40:19.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:19.824 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi077.stderr:2023-11-04T01:40:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:19.827 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:40:19.832 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2023-11-04T01:40:19.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:19.833 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-11-04T01:40:19.896 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:20.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.034+0000 7f8d01de7640 1 Processor -- start 2023-11-04T01:40:20.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.034+0000 7f8d01de7640 1 -- start start 2023-11-04T01:40:20.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.035+0000 7f8d01de7640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8cfc15cdf0 0x7f8cfc0b85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.035+0000 7f8d01de7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8cfc0b4f20 0x7f8cfc0b7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.035+0000 7f8d01de7640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cfc0b62c0 con 0x7f8cfc0b8b10 2023-11-04T01:40:20.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.035+0000 7f8d01de7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cfc0b65a0 con 0x7f8cfc0b4f20 2023-11-04T01:40:20.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.035+0000 7f8d01de7640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cfc0b6880 con 0x7f8cfc15cdf0 2023-11-04T01:40:20.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.035+0000 7f8cfbfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8cfc0b4f20 0x7f8cfc0b7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.035+0000 7f8cfbfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8cfc0b4f20 0x7f8cfc0b7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56606/0 (socket says 172.21.15.77:56606) 2023-11-04T01:40:20.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.035+0000 7f8cfbfff640 1 -- 172.21.15.77:0/4271307147 learned_addr learned my addr 172.21.15.77:0/4271307147 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:20.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.036+0000 7f8cfb7fe640 1 --2- 172.21.15.77:0/4271307147 >> v2:172.21.15.122:3300/0 conn(0x7f8cfc15cdf0 0x7f8cfc0b85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.036+0000 7f8cfbfff640 1 -- 172.21.15.77:0/4271307147 >> v2:172.21.15.122:3300/0 conn(0x7f8cfc15cdf0 msgr2=0x7f8cfc0b85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:20.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.036+0000 7f8cfbfff640 1 --2- 172.21.15.77:0/4271307147 >> v2:172.21.15.122:3300/0 conn(0x7f8cfc15cdf0 0x7f8cfc0b85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.036+0000 7f8cfbfff640 1 -- 172.21.15.77:0/4271307147 >> v1:172.21.15.122:6789/0 conn(0x7f8cfc0b8b10 legacy=0x7f8cfc0b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:20.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.036+0000 7f8cfbfff640 1 -- 172.21.15.77:0/4271307147 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cfc0b6b60 con 0x7f8cfc0b4f20 2023-11-04T01:40:20.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.036+0000 7f8cfb7fe640 1 --2- 172.21.15.77:0/4271307147 >> v2:172.21.15.122:3300/0 conn(0x7f8cfc15cdf0 0x7f8cfc0b85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:20.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.036+0000 7f8cfbfff640 1 --2- 172.21.15.77:0/4271307147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cfc0b4f20 0x7f8cfc0b7360 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc06c710 tx=0x7f8cf402c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98a55206b8c5b325 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:20.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.037+0000 7f8cfa7fc640 1 -- 172.21.15.77:0/4271307147 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf402cbb0 con 0x7f8cfc0b4f20 2023-11-04T01:40:20.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.037+0000 7f8cfa7fc640 1 -- 172.21.15.77:0/4271307147 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf402cd10 con 0x7f8cfc0b4f20 2023-11-04T01:40:20.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.037+0000 7f8cfa7fc640 1 -- 172.21.15.77:0/4271307147 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4034610 con 0x7f8cfc0b4f20 2023-11-04T01:40:20.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.037+0000 7f8d01de7640 1 -- 172.21.15.77:0/4271307147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cfc0b4f20 msgr2=0x7f8cfc0b7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:20.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.037+0000 7f8d01de7640 1 --2- 172.21.15.77:0/4271307147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cfc0b4f20 0x7f8cfc0b7360 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc06c710 tx=0x7f8cf402c010 comp rx=0 tx=0).stop 2023-11-04T01:40:20.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.037+0000 7f8d01de7640 1 -- 172.21.15.77:0/4271307147 shutdown_connections 2023-11-04T01:40:20.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.037+0000 7f8d01de7640 1 --2- 172.21.15.77:0/4271307147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cfc0b4f20 0x7f8cfc0b7360 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.037+0000 7f8d01de7640 1 --2- 172.21.15.77:0/4271307147 >> v2:172.21.15.122:3300/0 conn(0x7f8cfc15cdf0 0x7f8cfc0b85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.037+0000 7f8d01de7640 1 -- 172.21.15.77:0/4271307147 >> 172.21.15.77:0/4271307147 conn(0x7f8cfc071c70 msgr2=0x7f8cfc072080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:20.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.037+0000 7f8d01de7640 1 -- 172.21.15.77:0/4271307147 shutdown_connections 2023-11-04T01:40:20.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.037+0000 7f8d01de7640 1 -- 172.21.15.77:0/4271307147 wait complete. 2023-11-04T01:40:20.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.038+0000 7f8d01de7640 1 Processor -- start 2023-11-04T01:40:20.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.039+0000 7f8d01de7640 1 -- start start 2023-11-04T01:40:20.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.039+0000 7f8d01de7640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8cfc0b4f20 0x7f8cfc153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.039+0000 7f8d01de7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cfc0b8b10 0x7f8cfc0cd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.039+0000 7f8d01de7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8cfc15cdf0 0x7f8cfc0cd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.039+0000 7f8d01de7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc0c6710 con 0x7f8cfc0b8b10 2023-11-04T01:40:20.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.039+0000 7f8d01de7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc0cca30 con 0x7f8cfc15cdf0 2023-11-04T01:40:20.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.039+0000 7f8d01de7640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc1f68b0 con 0x7f8cfc0b4f20 2023-11-04T01:40:20.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.039+0000 7f8cfaffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cfc0b8b10 0x7f8cfc0cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.039+0000 7f8cfaffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cfc0b8b10 0x7f8cfc0cd330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56620/0 (socket says 172.21.15.77:56620) 2023-11-04T01:40:20.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.039+0000 7f8cfaffd640 1 -- 172.21.15.77:0/1532542901 learned_addr learned my addr 172.21.15.77:0/1532542901 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:20.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.039+0000 7f8cfbfff640 1 --2- 172.21.15.77:0/1532542901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8cfc15cdf0 0x7f8cfc0cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.039+0000 7f8cfb7fe640 1 --2- 172.21.15.77:0/1532542901 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8cfc0b4f20 0x7f8cfc153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.040+0000 7f8cfaffd640 1 -- 172.21.15.77:0/1532542901 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8cfc0b4f20 msgr2=0x7f8cfc153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:20.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.040+0000 7f8cfaffd640 1 --2- 172.21.15.77:0/1532542901 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8cfc0b4f20 0x7f8cfc153180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.040+0000 7f8cfaffd640 1 -- 172.21.15.77:0/1532542901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8cfc15cdf0 msgr2=0x7f8cfc0cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:20.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.040+0000 7f8cfaffd640 1 --2- 172.21.15.77:0/1532542901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8cfc15cdf0 0x7f8cfc0cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.040+0000 7f8cfaffd640 1 -- 172.21.15.77:0/1532542901 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf4009b30 con 0x7f8cfc0b8b10 2023-11-04T01:40:20.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.040+0000 7f8cfaffd640 1 --2- 172.21.15.77:0/1532542901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cfc0b8b10 0x7f8cfc0cd330 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8cf000c480 tx=0x7f8cf000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:20.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.040+0000 7f8ce3fff640 1 -- 172.21.15.77:0/1532542901 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf00052d0 con 0x7f8cfc0b8b10 2023-11-04T01:40:20.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.040+0000 7f8ce3fff640 1 -- 172.21.15.77:0/1532542901 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf0005430 con 0x7f8cfc0b8b10 2023-11-04T01:40:20.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.040+0000 7f8d01de7640 1 -- 172.21.15.77:0/1532542901 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cfc1f6b90 con 0x7f8cfc0b8b10 2023-11-04T01:40:20.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.040+0000 7f8ce3fff640 1 -- 172.21.15.77:0/1532542901 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0012870 con 0x7f8cfc0b8b10 2023-11-04T01:40:20.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.040+0000 7f8d01de7640 1 -- 172.21.15.77:0/1532542901 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cfc15e660 con 0x7f8cfc0b8b10 2023-11-04T01:40:20.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.041+0000 7f8d01de7640 1 -- 172.21.15.77:0/1532542901 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cfc067c50 con 0x7f8cfc0b8b10 2023-11-04T01:40:20.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.041+0000 7f8ce3fff640 1 -- 172.21.15.77:0/1532542901 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8cf00129d0 con 0x7f8cfc0b8b10 2023-11-04T01:40:20.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.042+0000 7f8ce3fff640 1 --2- 172.21.15.77:0/1532542901 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8ce806aea0 0x7f8ce806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.042+0000 7f8ce3fff640 1 -- 172.21.15.77:0/1532542901 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8cf0089290 con 0x7f8cfc0b8b10 2023-11-04T01:40:20.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.042+0000 7f8cfb7fe640 1 --2- 172.21.15.77:0/1532542901 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8ce806aea0 0x7f8ce806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.042+0000 7f8cfb7fe640 1 --2- 172.21.15.77:0/1532542901 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8ce806aea0 0x7f8ce806d360 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8cec006fd0 tx=0x7f8cec008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:20.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.046+0000 7f8ce3fff640 1 -- 172.21.15.77:0/1532542901 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8cf0054190 con 0x7f8cfc0b8b10 2023-11-04T01:40:20.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.213+0000 7f8d01de7640 1 -- 172.21.15.77:0/1532542901 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8cfc0674e0 con 0x7f8cfc0b8b10 2023-11-04T01:40:20.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.215+0000 7f8ce3fff640 1 -- 172.21.15.77:0/1532542901 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f8cf00577b0 con 0x7f8cfc0b8b10 2023-11-04T01:40:20.217 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:20.217 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":24,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:40:10.153949+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:40:02.810971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:40:04.003979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:40:07.734355+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:20.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.216+0000 7f8d01de7640 1 -- 172.21.15.77:0/1532542901 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8ce806aea0 msgr2=0x7f8ce806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:20.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.216+0000 7f8d01de7640 1 --2- 172.21.15.77:0/1532542901 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8ce806aea0 0x7f8ce806d360 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8cec006fd0 tx=0x7f8cec008040 comp rx=0 tx=0).stop 2023-11-04T01:40:20.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.216+0000 7f8d01de7640 1 -- 172.21.15.77:0/1532542901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cfc0b8b10 msgr2=0x7f8cfc0cd330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:20.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.216+0000 7f8d01de7640 1 --2- 172.21.15.77:0/1532542901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cfc0b8b10 0x7f8cfc0cd330 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8cf000c480 tx=0x7f8cf000c940 comp rx=0 tx=0).stop 2023-11-04T01:40:20.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.217+0000 7f8d01de7640 1 -- 172.21.15.77:0/1532542901 shutdown_connections 2023-11-04T01:40:20.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.217+0000 7f8d01de7640 1 --2- 172.21.15.77:0/1532542901 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8ce806aea0 0x7f8ce806d360 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.217+0000 7f8d01de7640 1 --2- 172.21.15.77:0/1532542901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8cfc15cdf0 0x7f8cfc0cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.217+0000 7f8d01de7640 1 --2- 172.21.15.77:0/1532542901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cfc0b8b10 0x7f8cfc0cd330 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.217+0000 7f8d01de7640 1 --2- 172.21.15.77:0/1532542901 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8cfc0b4f20 0x7f8cfc153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.217+0000 7f8d01de7640 1 -- 172.21.15.77:0/1532542901 >> 172.21.15.77:0/1532542901 conn(0x7f8cfc071c70 msgr2=0x7f8cfc15ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:20.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.217+0000 7f8d01de7640 1 -- 172.21.15.77:0/1532542901 shutdown_connections 2023-11-04T01:40:20.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.217+0000 7f8d01de7640 1 -- 172.21.15.77:0/1532542901 wait complete. 2023-11-04T01:40:20.229 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:20.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.327+0000 7f15feda9640 1 Processor -- start 2023-11-04T01:40:20.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.327+0000 7f15feda9640 1 -- start start 2023-11-04T01:40:20.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.327+0000 7f15feda9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f15f815aa60 0x7f15f80c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.327+0000 7f15feda9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f15f815ae40 0x7f15f80c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.327+0000 7f15feda9640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f80ca7a0 con 0x7f15f806db70 2023-11-04T01:40:20.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.327+0000 7f15feda9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f806ab30 con 0x7f15f815ae40 2023-11-04T01:40:20.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.327+0000 7f15feda9640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f806ae10 con 0x7f15f815aa60 2023-11-04T01:40:20.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.328+0000 7f15fd346640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f15f815ae40 0x7f15f80c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.328+0000 7f15fd346640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f15f815ae40 0x7f15f80c9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56622/0 (socket says 172.21.15.77:56622) 2023-11-04T01:40:20.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.328+0000 7f15fd346640 1 -- 172.21.15.77:0/373413978 learned_addr learned my addr 172.21.15.77:0/373413978 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:20.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.328+0000 7f15fcb45640 1 --2- 172.21.15.77:0/373413978 >> v2:172.21.15.122:3300/0 conn(0x7f15f815aa60 0x7f15f80c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.328+0000 7f15fd346640 1 -- 172.21.15.77:0/373413978 >> v2:172.21.15.122:3300/0 conn(0x7f15f815aa60 msgr2=0x7f15f80c98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:20.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.328+0000 7f15fd346640 1 --2- 172.21.15.77:0/373413978 >> v2:172.21.15.122:3300/0 conn(0x7f15f815aa60 0x7f15f80c98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.328+0000 7f15fd346640 1 -- 172.21.15.77:0/373413978 >> v1:172.21.15.122:6789/0 conn(0x7f15f806db70 legacy=0x7f15f80c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:20.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.328+0000 7f15fd346640 1 -- 172.21.15.77:0/373413978 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f806b0f0 con 0x7f15f815ae40 2023-11-04T01:40:20.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.329+0000 7f15fd346640 1 --2- 172.21.15.77:0/373413978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15f815ae40 0x7f15f80c9e00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f15f806db00 tx=0x7f15f002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf099817c1a0345 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:20.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.329+0000 7f15f77fe640 1 -- 172.21.15.77:0/373413978 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f002cb20 con 0x7f15f815ae40 2023-11-04T01:40:20.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.329+0000 7f15f77fe640 1 -- 172.21.15.77:0/373413978 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f002cc80 con 0x7f15f815ae40 2023-11-04T01:40:20.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.329+0000 7f15f77fe640 1 -- 172.21.15.77:0/373413978 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f00343f0 con 0x7f15f815ae40 2023-11-04T01:40:20.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.329+0000 7f15feda9640 1 -- 172.21.15.77:0/373413978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15f815ae40 msgr2=0x7f15f80c9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:20.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.329+0000 7f15feda9640 1 --2- 172.21.15.77:0/373413978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15f815ae40 0x7f15f80c9e00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f15f806db00 tx=0x7f15f002bf80 comp rx=0 tx=0).stop 2023-11-04T01:40:20.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.329+0000 7f15feda9640 1 -- 172.21.15.77:0/373413978 shutdown_connections 2023-11-04T01:40:20.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.329+0000 7f15feda9640 1 --2- 172.21.15.77:0/373413978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15f815ae40 0x7f15f80c9e00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.329+0000 7f15feda9640 1 --2- 172.21.15.77:0/373413978 >> v2:172.21.15.122:3300/0 conn(0x7f15f815aa60 0x7f15f80c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.329+0000 7f15feda9640 1 -- 172.21.15.77:0/373413978 >> 172.21.15.77:0/373413978 conn(0x7f15f806cef0 msgr2=0x7f15f806d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:20.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.329+0000 7f15feda9640 1 -- 172.21.15.77:0/373413978 shutdown_connections 2023-11-04T01:40:20.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.329+0000 7f15feda9640 1 -- 172.21.15.77:0/373413978 wait complete. 2023-11-04T01:40:20.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.331+0000 7f15feda9640 1 Processor -- start 2023-11-04T01:40:20.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.331+0000 7f15feda9640 1 -- start start 2023-11-04T01:40:20.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.331+0000 7f15feda9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f15f806db70 0x7f15f8151410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.331+0000 7f15feda9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15f815aa60 0x7f15f815d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.331+0000 7f15feda9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15f815ae40 0x7f15f8152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.331+0000 7f15feda9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f815e180 con 0x7f15f815ae40 2023-11-04T01:40:20.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.331+0000 7f15feda9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f8151950 con 0x7f15f815aa60 2023-11-04T01:40:20.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.331+0000 7f15feda9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f815b480 con 0x7f15f806db70 2023-11-04T01:40:20.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.332+0000 7f15fd346640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15f815ae40 0x7f15f8152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.332+0000 7f15fd346640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15f815ae40 0x7f15f8152950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56624/0 (socket says 172.21.15.77:56624) 2023-11-04T01:40:20.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.332+0000 7f15fd346640 1 -- 172.21.15.77:0/1294429771 learned_addr learned my addr 172.21.15.77:0/1294429771 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:20.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.332+0000 7f15fcb45640 1 --2- 172.21.15.77:0/1294429771 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f15f806db70 0x7f15f8151410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.332+0000 7f15f7fff640 1 --2- 172.21.15.77:0/1294429771 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15f815aa60 0x7f15f815d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.332+0000 7f15fd346640 1 -- 172.21.15.77:0/1294429771 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f15f806db70 msgr2=0x7f15f8151410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:20.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.332+0000 7f15fd346640 1 --2- 172.21.15.77:0/1294429771 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f15f806db70 0x7f15f8151410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.332+0000 7f15fd346640 1 -- 172.21.15.77:0/1294429771 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15f815aa60 msgr2=0x7f15f815d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:20.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.332+0000 7f15fd346640 1 --2- 172.21.15.77:0/1294429771 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15f815aa60 0x7f15f815d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.332+0000 7f15fd346640 1 -- 172.21.15.77:0/1294429771 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f0009b30 con 0x7f15f815ae40 2023-11-04T01:40:20.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.332+0000 7f15fd346640 1 --2- 172.21.15.77:0/1294429771 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15f815ae40 0x7f15f8152950 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f15f0036040 tx=0x7f15f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:20.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.332+0000 7f15f57fa640 1 -- 172.21.15.77:0/1294429771 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f0009510 con 0x7f15f815ae40 2023-11-04T01:40:20.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.332+0000 7f15f57fa640 1 -- 172.21.15.77:0/1294429771 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f0007e50 con 0x7f15f815ae40 2023-11-04T01:40:20.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.332+0000 7f15f57fa640 1 -- 172.21.15.77:0/1294429771 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f003e670 con 0x7f15f815ae40 2023-11-04T01:40:20.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.332+0000 7f15feda9640 1 -- 172.21.15.77:0/1294429771 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f815b760 con 0x7f15f815ae40 2023-11-04T01:40:20.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.332+0000 7f15feda9640 1 -- 172.21.15.77:0/1294429771 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f815bd20 con 0x7f15f815ae40 2023-11-04T01:40:20.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.333+0000 7f15feda9640 1 -- 172.21.15.77:0/1294429771 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f806f940 con 0x7f15f815ae40 2023-11-04T01:40:20.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.334+0000 7f15f57fa640 1 -- 172.21.15.77:0/1294429771 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f15f003e7d0 con 0x7f15f815ae40 2023-11-04T01:40:20.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.334+0000 7f15f57fa640 1 --2- 172.21.15.77:0/1294429771 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f15d806ae70 0x7f15d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.334+0000 7f15f57fa640 1 -- 172.21.15.77:0/1294429771 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f15f00ac760 con 0x7f15f815ae40 2023-11-04T01:40:20.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.334+0000 7f15fcb45640 1 --2- 172.21.15.77:0/1294429771 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f15d806ae70 0x7f15d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.334+0000 7f15fcb45640 1 --2- 172.21.15.77:0/1294429771 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f15d806ae70 0x7f15d806d330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f15e800aac0 tx=0x7f15e8008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:20.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.338+0000 7f15f57fa640 1 -- 172.21.15.77:0/1294429771 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f15f00775d0 con 0x7f15f815ae40 2023-11-04T01:40:20.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.504+0000 7f15feda9640 1 -- 172.21.15.77:0/1294429771 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15f8074290 con 0x7f15f815ae40 2023-11-04T01:40:20.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.505+0000 7f15f57fa640 1 -- 172.21.15.77:0/1294429771 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f15f007abf0 con 0x7f15f815ae40 2023-11-04T01:40:20.507 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:20.507 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":24,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:40:10.153949+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:40:02.810971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:40:04.003979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:40:07.734355+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:20.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.507+0000 7f15feda9640 1 -- 172.21.15.77:0/1294429771 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f15d806ae70 msgr2=0x7f15d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:20.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.507+0000 7f15feda9640 1 --2- 172.21.15.77:0/1294429771 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f15d806ae70 0x7f15d806d330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f15e800aac0 tx=0x7f15e8008040 comp rx=0 tx=0).stop 2023-11-04T01:40:20.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.507+0000 7f15feda9640 1 -- 172.21.15.77:0/1294429771 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15f815ae40 msgr2=0x7f15f8152950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:20.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.507+0000 7f15feda9640 1 --2- 172.21.15.77:0/1294429771 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15f815ae40 0x7f15f8152950 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f15f0036040 tx=0x7f15f0004a40 comp rx=0 tx=0).stop 2023-11-04T01:40:20.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.507+0000 7f15feda9640 1 -- 172.21.15.77:0/1294429771 shutdown_connections 2023-11-04T01:40:20.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.507+0000 7f15feda9640 1 --2- 172.21.15.77:0/1294429771 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f15d806ae70 0x7f15d806d330 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.507+0000 7f15feda9640 1 --2- 172.21.15.77:0/1294429771 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15f815ae40 0x7f15f8152950 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.507+0000 7f15feda9640 1 --2- 172.21.15.77:0/1294429771 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15f815aa60 0x7f15f815d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.507+0000 7f15feda9640 1 --2- 172.21.15.77:0/1294429771 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f15f806db70 0x7f15f8151410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.507+0000 7f15feda9640 1 -- 172.21.15.77:0/1294429771 >> 172.21.15.77:0/1294429771 conn(0x7f15f806cef0 msgr2=0x7f15f80c8380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:20.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.507+0000 7f15feda9640 1 -- 172.21.15.77:0/1294429771 shutdown_connections 2023-11-04T01:40:20.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.507+0000 7f15feda9640 1 -- 172.21.15.77:0/1294429771 wait complete. 2023-11-04T01:40:20.519 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T01:40:20.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.621+0000 7fbde5716640 1 Processor -- start 2023-11-04T01:40:20.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.621+0000 7fbde5716640 1 -- start start 2023-11-04T01:40:20.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.622+0000 7fbde5716640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbde00cd6d0 0x7fbde0161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.622+0000 7fbde5716640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbde00cde60 con 0x7fbde0153e60 2023-11-04T01:40:20.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.622+0000 7fbde5716640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbde0160f90 con 0x7fbde00b4880 2023-11-04T01:40:20.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.622+0000 7fbde5716640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbde0161960 con 0x7fbde00cd6d0 2023-11-04T01:40:20.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.622+0000 7fbddeffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fbde0153e60 0x7fbde015dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52566/0 (socket says 172.21.15.77:52566) 2023-11-04T01:40:20.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.622+0000 7fbddeffd640 1 -- 172.21.15.77:0/3475546267 learned_addr learned my addr 172.21.15.77:0/3475546267 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:20.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.622+0000 7fbdde7fc640 1 --2- 172.21.15.77:0/3475546267 >> v2:172.21.15.77:3300/0 conn(0x7fbde00cd6d0 0x7fbde0161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.622+0000 7fbdde7fc640 1 -- 172.21.15.77:0/3475546267 >> v1:172.21.15.122:6789/0 conn(0x7fbde00b4880 legacy=0x7fbde00d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:20.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.622+0000 7fbdde7fc640 1 -- 172.21.15.77:0/3475546267 >> v1:172.21.15.77:6789/0 conn(0x7fbde0153e60 legacy=0x7fbde015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:20.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.622+0000 7fbdde7fc640 1 -- 172.21.15.77:0/3475546267 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde00ce090 con 0x7fbde00cd6d0 2023-11-04T01:40:20.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.622+0000 7fbdddffb640 1 -- 172.21.15.77:0/3475546267 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3072795535 0 0) 0x7fbde00cde60 con 0x7fbde0153e60 2023-11-04T01:40:20.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.623+0000 7fbdde7fc640 1 --2- 172.21.15.77:0/3475546267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbde00cd6d0 0x7fbde0161420 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40097a0 tx=0x7fbdd402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7aaeea98f8c8315 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:20.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.623+0000 7fbdddffb640 1 -- 172.21.15.77:0/3475546267 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd4031830 con 0x7fbde00cd6d0 2023-11-04T01:40:20.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.623+0000 7fbdddffb640 1 -- 172.21.15.77:0/3475546267 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd4031990 con 0x7fbde00cd6d0 2023-11-04T01:40:20.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.623+0000 7fbdddffb640 1 -- 172.21.15.77:0/3475546267 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd4031d20 con 0x7fbde00cd6d0 2023-11-04T01:40:20.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.624+0000 7fbde5716640 1 -- 172.21.15.77:0/3475546267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbde00cd6d0 msgr2=0x7fbde0161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:20.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.624+0000 7fbde5716640 1 --2- 172.21.15.77:0/3475546267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbde00cd6d0 0x7fbde0161420 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40097a0 tx=0x7fbdd402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.624+0000 7fbde5716640 1 -- 172.21.15.77:0/3475546267 shutdown_connections 2023-11-04T01:40:20.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.624+0000 7fbde5716640 1 --2- 172.21.15.77:0/3475546267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbde00cd6d0 0x7fbde0161420 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.624+0000 7fbde5716640 1 -- 172.21.15.77:0/3475546267 >> 172.21.15.77:0/3475546267 conn(0x7fbde00cf880 msgr2=0x7fbde00cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:20.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.624+0000 7fbde5716640 1 -- 172.21.15.77:0/3475546267 shutdown_connections 2023-11-04T01:40:20.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.624+0000 7fbde5716640 1 -- 172.21.15.77:0/3475546267 wait complete. 2023-11-04T01:40:20.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.625+0000 7fbde5716640 1 Processor -- start 2023-11-04T01:40:20.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.625+0000 7fbde5716640 1 -- start start 2023-11-04T01:40:20.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.626+0000 7fbde5716640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbde00b4880 0x7fbde0152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.626+0000 7fbde5716640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbde00cd6d0 0x7fbde0150d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.626+0000 7fbde5716640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbde0153e60 0x7fbde00c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.626+0000 7fbde5716640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde0150bb0 con 0x7fbde00cd6d0 2023-11-04T01:40:20.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.626+0000 7fbde5716640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde00c79a0 con 0x7fbde0153e60 2023-11-04T01:40:20.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.626+0000 7fbde5716640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbde00c7c80 con 0x7fbde00b4880 2023-11-04T01:40:20.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.626+0000 7fbdde7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbde00cd6d0 0x7fbde0150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.626+0000 7fbdde7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbde00cd6d0 0x7fbde0150d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56632/0 (socket says 172.21.15.77:56632) 2023-11-04T01:40:20.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.626+0000 7fbdde7fc640 1 -- 172.21.15.77:0/3320439539 learned_addr learned my addr 172.21.15.77:0/3320439539 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:20.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.626+0000 7fbdde7fc640 1 -- 172.21.15.77:0/3320439539 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbde00b4880 msgr2=0x7fbde0152d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:20.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.626+0000 7fbddf7fe640 1 --2- 172.21.15.77:0/3320439539 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbde0153e60 0x7fbde00c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.626+0000 7fbdde7fc640 1 --2- 172.21.15.77:0/3320439539 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbde00b4880 0x7fbde0152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.626+0000 7fbdde7fc640 1 -- 172.21.15.77:0/3320439539 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbde0153e60 msgr2=0x7fbde00c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:20.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.626+0000 7fbdde7fc640 1 --2- 172.21.15.77:0/3320439539 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbde0153e60 0x7fbde00c8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:20.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.626+0000 7fbdde7fc640 1 -- 172.21.15.77:0/3320439539 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd4009400 con 0x7fbde00cd6d0 2023-11-04T01:40:20.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.626+0000 7fbdde7fc640 1 --2- 172.21.15.77:0/3320439539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbde00cd6d0 0x7fbde0150d70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40098c0 tx=0x7fbdd40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:20.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.626+0000 7fbdc77fe640 1 -- 172.21.15.77:0/3320439539 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd403ba70 con 0x7fbde00cd6d0 2023-11-04T01:40:20.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.627+0000 7fbdc77fe640 1 -- 172.21.15.77:0/3320439539 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd403bbf0 con 0x7fbde00cd6d0 2023-11-04T01:40:20.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.627+0000 7fbdc77fe640 1 -- 172.21.15.77:0/3320439539 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd40453f0 con 0x7fbde00cd6d0 2023-11-04T01:40:20.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.627+0000 7fbde5716640 1 -- 172.21.15.77:0/3320439539 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbde00c7f60 con 0x7fbde00cd6d0 2023-11-04T01:40:20.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.627+0000 7fbde5716640 1 -- 172.21.15.77:0/3320439539 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbde00c8520 con 0x7fbde00cd6d0 2023-11-04T01:40:20.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.628+0000 7fbde5716640 1 -- 172.21.15.77:0/3320439539 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbde00cf0f0 con 0x7fbde00cd6d0 2023-11-04T01:40:20.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.628+0000 7fbdc77fe640 1 -- 172.21.15.77:0/3320439539 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbdd404e450 con 0x7fbde00cd6d0 2023-11-04T01:40:20.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.628+0000 7fbdc77fe640 1 --2- 172.21.15.77:0/3320439539 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbdcc06aea0 0x7fbdcc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:20.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.628+0000 7fbdc77fe640 1 -- 172.21.15.77:0/3320439539 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbdd40abae0 con 0x7fbde00cd6d0 2023-11-04T01:40:20.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.628+0000 7fbddeffd640 1 --2- 172.21.15.77:0/3320439539 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbdcc06aea0 0x7fbdcc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:20.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.629+0000 7fbddeffd640 1 --2- 172.21.15.77:0/3320439539 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbdcc06aea0 0x7fbdcc06d360 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0007fd0 tx=0x7fbdd0007960 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:20.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.632+0000 7fbdc77fe640 1 -- 172.21.15.77:0/3320439539 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbdd4076a50 con 0x7fbde00cd6d0 2023-11-04T01:40:20.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:20.838+0000 7fbde5716640 1 -- 172.21.15.77:0/3320439539 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbde0074290 con 0x7fbde00cd6d0 2023-11-04T01:40:21.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.566+0000 7fbdc77fe640 1 -- 172.21.15.77:0/3320439539 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbdd407a070 con 0x7fbde00cd6d0 2023-11-04T01:40:21.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.569+0000 7fbde5716640 1 -- 172.21.15.77:0/3320439539 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbdcc06aea0 msgr2=0x7fbdcc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:21.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.569+0000 7fbde5716640 1 --2- 172.21.15.77:0/3320439539 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbdcc06aea0 0x7fbdcc06d360 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0007fd0 tx=0x7fbdd0007960 comp rx=0 tx=0).stop 2023-11-04T01:40:21.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.569+0000 7fbde5716640 1 -- 172.21.15.77:0/3320439539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbde00cd6d0 msgr2=0x7fbde0150d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:21.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.569+0000 7fbde5716640 1 --2- 172.21.15.77:0/3320439539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbde00cd6d0 0x7fbde0150d70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40098c0 tx=0x7fbdd40046c0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.569+0000 7fbde5716640 1 -- 172.21.15.77:0/3320439539 shutdown_connections 2023-11-04T01:40:21.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.569+0000 7fbde5716640 1 --2- 172.21.15.77:0/3320439539 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbdcc06aea0 0x7fbdcc06d360 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.569+0000 7fbde5716640 1 --2- 172.21.15.77:0/3320439539 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbde0153e60 0x7fbde00c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.569+0000 7fbde5716640 1 --2- 172.21.15.77:0/3320439539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbde00cd6d0 0x7fbde0150d70 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.569+0000 7fbde5716640 1 --2- 172.21.15.77:0/3320439539 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbde00b4880 0x7fbde0152d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.569+0000 7fbde5716640 1 -- 172.21.15.77:0/3320439539 >> 172.21.15.77:0/3320439539 conn(0x7fbde00cf880 msgr2=0x7fbde00b7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:21.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.569+0000 7fbde5716640 1 -- 172.21.15.77:0/3320439539 shutdown_connections 2023-11-04T01:40:21.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.569+0000 7fbde5716640 1 -- 172.21.15.77:0/3320439539 wait complete. 2023-11-04T01:40:21.585 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-11-04T01:40:21.585 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T01:40:21.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.691+0000 7f7288516640 1 Processor -- start 2023-11-04T01:40:21.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.691+0000 7f7288516640 1 -- start start 2023-11-04T01:40:21.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.692+0000 7f7288516640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f72800cd6d0 0x7f7280161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.692+0000 7f7288516640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f72800b4880 0x7f72800b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.692+0000 7f7288516640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72800cde60 con 0x7f7280153e60 2023-11-04T01:40:21.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.692+0000 7f7288516640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7280160f90 con 0x7f72800cd6d0 2023-11-04T01:40:21.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.692+0000 7f7288516640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7280161960 con 0x7f72800b4880 2023-11-04T01:40:21.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.692+0000 7f72862b2640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f7280153e60 0x7f728015dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52568/0 (socket says 172.21.15.77:52568) 2023-11-04T01:40:21.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.692+0000 7f72862b2640 1 -- 172.21.15.77:0/3947759418 learned_addr learned my addr 172.21.15.77:0/3947759418 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:21.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.692+0000 7f7285ab1640 1 --2- 172.21.15.77:0/3947759418 >> v2:172.21.15.122:3300/0 conn(0x7f72800cd6d0 0x7f7280161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.692+0000 7f7286ab3640 1 --2- 172.21.15.77:0/3947759418 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f72800b4880 0x7f72800b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.692+0000 7f72852b0640 1 -- 172.21.15.77:0/3947759418 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2534657520 0 0) 0x7f72800cde60 con 0x7f7280153e60 2023-11-04T01:40:21.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.692+0000 7f72852b0640 1 -- 172.21.15.77:0/3947759418 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f726c003520 con 0x7f7280153e60 2023-11-04T01:40:21.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.693+0000 7f7286ab3640 1 -- 172.21.15.77:0/3947759418 >> v2:172.21.15.122:3300/0 conn(0x7f72800cd6d0 msgr2=0x7f7280161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:21.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.693+0000 7f72852b0640 1 -- 172.21.15.77:0/3947759418 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1439976594 0 0) 0x7f726c003520 con 0x7f7280153e60 2023-11-04T01:40:21.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.693+0000 7f7286ab3640 1 --2- 172.21.15.77:0/3947759418 >> v2:172.21.15.122:3300/0 conn(0x7f72800cd6d0 0x7f7280161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.693+0000 7f7286ab3640 1 -- 172.21.15.77:0/3947759418 >> v1:172.21.15.77:6789/0 conn(0x7f7280153e60 legacy=0x7f728015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:21.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.693+0000 7f7286ab3640 1 -- 172.21.15.77:0/3947759418 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72800b5220 con 0x7f72800b4880 2023-11-04T01:40:21.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.693+0000 7f7285ab1640 1 --2- 172.21.15.77:0/3947759418 >> v2:172.21.15.122:3300/0 conn(0x7f72800cd6d0 0x7f7280161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:21.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.693+0000 7f7286ab3640 1 --2- 172.21.15.77:0/3947759418 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f72800b4880 0x7f72800b4ce0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7278009d90 tx=0x7f727802bd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5a940525eda3b00 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:21.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.694+0000 7f72852b0640 1 -- 172.21.15.77:0/3947759418 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c001670 con 0x7f72800b4880 2023-11-04T01:40:21.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.694+0000 7f72852b0640 1 -- 172.21.15.77:0/3947759418 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727802c8a0 con 0x7f72800b4880 2023-11-04T01:40:21.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.694+0000 7f72852b0640 1 -- 172.21.15.77:0/3947759418 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727802cc10 con 0x7f72800b4880 2023-11-04T01:40:21.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.694+0000 7f7288516640 1 -- 172.21.15.77:0/3947759418 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f72800b4880 msgr2=0x7f72800b4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:21.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.694+0000 7f7288516640 1 --2- 172.21.15.77:0/3947759418 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f72800b4880 0x7f72800b4ce0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7278009d90 tx=0x7f727802bd70 comp rx=0 tx=0).stop 2023-11-04T01:40:21.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.694+0000 7f7288516640 1 -- 172.21.15.77:0/3947759418 shutdown_connections 2023-11-04T01:40:21.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.694+0000 7f7288516640 1 --2- 172.21.15.77:0/3947759418 >> v2:172.21.15.122:3300/0 conn(0x7f72800cd6d0 0x7f7280161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.694+0000 7f7288516640 1 --2- 172.21.15.77:0/3947759418 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f72800b4880 0x7f72800b4ce0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.694+0000 7f7288516640 1 -- 172.21.15.77:0/3947759418 >> 172.21.15.77:0/3947759418 conn(0x7f72800cf880 msgr2=0x7f72800cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:21.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.694+0000 7f7288516640 1 -- 172.21.15.77:0/3947759418 shutdown_connections 2023-11-04T01:40:21.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.694+0000 7f7288516640 1 -- 172.21.15.77:0/3947759418 wait complete. 2023-11-04T01:40:21.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.695+0000 7f7288516640 1 Processor -- start 2023-11-04T01:40:21.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.695+0000 7f7288516640 1 -- start start 2023-11-04T01:40:21.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.696+0000 7f7288516640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f72800b4880 0x7f72801f2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.696+0000 7f7288516640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72800cd6d0 0x7f7280154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.696+0000 7f7288516640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7280153e60 0x7f72800b7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.696+0000 7f7288516640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72801557c0 con 0x7f72800cd6d0 2023-11-04T01:40:21.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.696+0000 7f7288516640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7280150bb0 con 0x7f7280153e60 2023-11-04T01:40:21.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.696+0000 7f7288516640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72800ccc50 con 0x7f72800b4880 2023-11-04T01:40:21.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.696+0000 7f7285ab1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72800cd6d0 0x7f7280154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.696+0000 7f7285ab1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72800cd6d0 0x7f7280154240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56646/0 (socket says 172.21.15.77:56646) 2023-11-04T01:40:21.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.696+0000 7f7285ab1640 1 -- 172.21.15.77:0/4169391640 learned_addr learned my addr 172.21.15.77:0/4169391640 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:21.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.696+0000 7f7286ab3640 1 --2- 172.21.15.77:0/4169391640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7280153e60 0x7f72800b7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.696+0000 7f72862b2640 1 --2- 172.21.15.77:0/4169391640 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f72800b4880 0x7f72801f2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.696+0000 7f7285ab1640 1 -- 172.21.15.77:0/4169391640 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f72800b4880 msgr2=0x7f72801f2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:21.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.696+0000 7f7285ab1640 1 --2- 172.21.15.77:0/4169391640 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f72800b4880 0x7f72801f2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.696+0000 7f7285ab1640 1 -- 172.21.15.77:0/4169391640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7280153e60 msgr2=0x7f72800b7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:21.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.696+0000 7f7285ab1640 1 --2- 172.21.15.77:0/4169391640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7280153e60 0x7f72800b7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:21.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.696+0000 7f7285ab1640 1 -- 172.21.15.77:0/4169391640 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7270009400 con 0x7f72800cd6d0 2023-11-04T01:40:21.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.696+0000 7f7286ab3640 1 --2- 172.21.15.77:0/4169391640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7280153e60 0x7f72800b7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:21.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.697+0000 7f7285ab1640 1 --2- 172.21.15.77:0/4169391640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72800cd6d0 0x7f7280154240 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f727000ec10 tx=0x7f727000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:21.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.697+0000 7f7276ffd640 1 -- 172.21.15.77:0/4169391640 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7270009760 con 0x7f72800cd6d0 2023-11-04T01:40:21.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.697+0000 7f7276ffd640 1 -- 172.21.15.77:0/4169391640 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727000cc30 con 0x7f72800cd6d0 2023-11-04T01:40:21.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.697+0000 7f7288516640 1 -- 172.21.15.77:0/4169391640 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7278009a70 con 0x7f72800cd6d0 2023-11-04T01:40:21.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.697+0000 7f7276ffd640 1 -- 172.21.15.77:0/4169391640 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7270013470 con 0x7f72800cd6d0 2023-11-04T01:40:21.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.697+0000 7f7288516640 1 -- 172.21.15.77:0/4169391640 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72800cb5e0 con 0x7f72800cd6d0 2023-11-04T01:40:21.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.698+0000 7f7288516640 1 -- 172.21.15.77:0/4169391640 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7280074290 con 0x7f72800cd6d0 2023-11-04T01:40:21.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.698+0000 7f7276ffd640 1 -- 172.21.15.77:0/4169391640 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f72700135d0 con 0x7f72800cd6d0 2023-11-04T01:40:21.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.699+0000 7f7276ffd640 1 --2- 172.21.15.77:0/4169391640 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f726406aea0 0x7f726406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:21.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.699+0000 7f7276ffd640 1 -- 172.21.15.77:0/4169391640 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7270089b90 con 0x7f72800cd6d0 2023-11-04T01:40:21.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.699+0000 7f72862b2640 1 --2- 172.21.15.77:0/4169391640 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f726406aea0 0x7f726406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:21.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.699+0000 7f72862b2640 1 --2- 172.21.15.77:0/4169391640 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f726406aea0 0x7f726406d360 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f727c007a00 tx=0x7f727c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:21.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.703+0000 7f7276ffd640 1 -- 172.21.15.77:0/4169391640 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7270054950 con 0x7f72800cd6d0 2023-11-04T01:40:21.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:21.905+0000 7f7288516640 1 -- 172.21.15.77:0/4169391640 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7280153810 con 0x7f72800cd6d0 2023-11-04T01:40:22.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.575+0000 7f7276ffd640 1 -- 172.21.15.77:0/4169391640 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f72700170c0 con 0x7f72800cd6d0 2023-11-04T01:40:22.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.577+0000 7f7288516640 1 -- 172.21.15.77:0/4169391640 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f726406aea0 msgr2=0x7f726406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:22.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.577+0000 7f7288516640 1 --2- 172.21.15.77:0/4169391640 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f726406aea0 0x7f726406d360 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f727c007a00 tx=0x7f727c009040 comp rx=0 tx=0).stop 2023-11-04T01:40:22.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.577+0000 7f7288516640 1 -- 172.21.15.77:0/4169391640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72800cd6d0 msgr2=0x7f7280154240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:22.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.577+0000 7f7288516640 1 --2- 172.21.15.77:0/4169391640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72800cd6d0 0x7f7280154240 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f727000ec10 tx=0x7f727000c520 comp rx=0 tx=0).stop 2023-11-04T01:40:22.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.577+0000 7f7288516640 1 -- 172.21.15.77:0/4169391640 shutdown_connections 2023-11-04T01:40:22.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.577+0000 7f7288516640 1 --2- 172.21.15.77:0/4169391640 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f726406aea0 0x7f726406d360 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:22.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.577+0000 7f7288516640 1 --2- 172.21.15.77:0/4169391640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7280153e60 0x7f72800b7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:22.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.577+0000 7f7288516640 1 --2- 172.21.15.77:0/4169391640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72800cd6d0 0x7f7280154240 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:22.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.577+0000 7f7288516640 1 --2- 172.21.15.77:0/4169391640 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f72800b4880 0x7f72801f2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:22.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.577+0000 7f7288516640 1 -- 172.21.15.77:0/4169391640 >> 172.21.15.77:0/4169391640 conn(0x7f72800cf880 msgr2=0x7f728015afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:22.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.577+0000 7f7288516640 1 -- 172.21.15.77:0/4169391640 shutdown_connections 2023-11-04T01:40:22.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.577+0000 7f7288516640 1 -- 172.21.15.77:0/4169391640 wait complete. 2023-11-04T01:40:22.591 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T01:40:22.591 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:22.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.692+0000 7f59c2664640 1 Processor -- start 2023-11-04T01:40:22.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.692+0000 7f59c2664640 1 -- start start 2023-11-04T01:40:22.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.693+0000 7f59c2664640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f59bc15ce60 0x7f59bc06b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:22.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.693+0000 7f59c2664640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59bc1615d0 con 0x7f59bc06bd30 2023-11-04T01:40:22.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.693+0000 7f59c2664640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59bc1618b0 con 0x7f59bc0cf160 2023-11-04T01:40:22.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.693+0000 7f59c2664640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59bc0cbde0 con 0x7f59bc15ce60 2023-11-04T01:40:22.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.693+0000 7f59bbfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f59bc15ce60 0x7f59bc06b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:22.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.693+0000 7f59bbfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f59bc15ce60 0x7f59bc06b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56662/0 (socket says 172.21.15.77:56662) 2023-11-04T01:40:22.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.693+0000 7f59bbfff640 1 -- 172.21.15.77:0/3395302710 learned_addr learned my addr 172.21.15.77:0/3395302710 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:22.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.693+0000 7f59bb7fe640 1 --1- 172.21.15.77:0/3395302710 >> v1:172.21.15.77:6789/0 conn(0x7f59bc06bd30 0x7f59bc160b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52580/0 (socket says 172.21.15.77:52580) 2023-11-04T01:40:22.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.694+0000 7f59bbfff640 1 -- 172.21.15.77:0/3395302710 >> v1:172.21.15.122:6789/0 conn(0x7f59bc0cf160 legacy=0x7f59bc0cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:22.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.694+0000 7f59bbfff640 1 -- 172.21.15.77:0/3395302710 >> v1:172.21.15.77:6789/0 conn(0x7f59bc06bd30 legacy=0x7f59bc160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:22.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.694+0000 7f59bbfff640 1 -- 172.21.15.77:0/3395302710 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59bc0cba00 con 0x7f59bc15ce60 2023-11-04T01:40:22.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.694+0000 7f59baffd640 1 -- 172.21.15.77:0/3395302710 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4017214924 0 0) 0x7f59bc1615d0 con 0x7f59bc06bd30 2023-11-04T01:40:22.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.694+0000 7f59bbfff640 1 --2- 172.21.15.77:0/3395302710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59bc15ce60 0x7f59bc06b7f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f59ac009870 tx=0x7f59ac02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d738e77c5a42b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:22.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.695+0000 7f59baffd640 1 -- 172.21.15.77:0/3395302710 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac02f840 con 0x7f59bc15ce60 2023-11-04T01:40:22.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.695+0000 7f59baffd640 1 -- 172.21.15.77:0/3395302710 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59ac02f9a0 con 0x7f59bc15ce60 2023-11-04T01:40:22.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.695+0000 7f59baffd640 1 -- 172.21.15.77:0/3395302710 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac02fd30 con 0x7f59bc15ce60 2023-11-04T01:40:22.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.695+0000 7f59c2664640 1 -- 172.21.15.77:0/3395302710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59bc15ce60 msgr2=0x7f59bc06b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:22.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.695+0000 7f59c2664640 1 --2- 172.21.15.77:0/3395302710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59bc15ce60 0x7f59bc06b7f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f59ac009870 tx=0x7f59ac02ba20 comp rx=0 tx=0).stop 2023-11-04T01:40:22.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.695+0000 7f59c2664640 1 -- 172.21.15.77:0/3395302710 shutdown_connections 2023-11-04T01:40:22.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.695+0000 7f59c2664640 1 --2- 172.21.15.77:0/3395302710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59bc15ce60 0x7f59bc06b7f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:22.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.695+0000 7f59c2664640 1 -- 172.21.15.77:0/3395302710 >> 172.21.15.77:0/3395302710 conn(0x7f59bc06ea90 msgr2=0x7f59bc06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:22.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.695+0000 7f59c2664640 1 -- 172.21.15.77:0/3395302710 shutdown_connections 2023-11-04T01:40:22.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.695+0000 7f59c2664640 1 -- 172.21.15.77:0/3395302710 wait complete. 2023-11-04T01:40:22.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.696+0000 7f59c2664640 1 Processor -- start 2023-11-04T01:40:22.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.696+0000 7f59c2664640 1 -- start start 2023-11-04T01:40:22.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.697+0000 7f59c2664640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f59bc0cf160 0x7f59bc0c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:22.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.697+0000 7f59c2664640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59bc15ce60 0x7f59bc14bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:22.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.697+0000 7f59c2664640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f59bc1593f0 0x7f59bc14c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:22.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.697+0000 7f59c2664640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc15f380 con 0x7f59bc15ce60 2023-11-04T01:40:22.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.697+0000 7f59c2664640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc15eb30 con 0x7f59bc1593f0 2023-11-04T01:40:22.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.697+0000 7f59c2664640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc0c9130 con 0x7f59bc0cf160 2023-11-04T01:40:22.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.697+0000 7f59bb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59bc15ce60 0x7f59bc14bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:22.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.697+0000 7f59bb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59bc15ce60 0x7f59bc14bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56670/0 (socket says 172.21.15.77:56670) 2023-11-04T01:40:22.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.697+0000 7f59bb7fe640 1 -- 172.21.15.77:0/202672832 learned_addr learned my addr 172.21.15.77:0/202672832 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:22.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.697+0000 7f59bbfff640 1 --2- 172.21.15.77:0/202672832 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f59bc0cf160 0x7f59bc0c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:22.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.697+0000 7f59c0c01640 1 --2- 172.21.15.77:0/202672832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f59bc1593f0 0x7f59bc14c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:22.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.698+0000 7f59bb7fe640 1 -- 172.21.15.77:0/202672832 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f59bc0cf160 msgr2=0x7f59bc0c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:22.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.698+0000 7f59bb7fe640 1 --2- 172.21.15.77:0/202672832 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f59bc0cf160 0x7f59bc0c8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:22.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.698+0000 7f59bb7fe640 1 -- 172.21.15.77:0/202672832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f59bc1593f0 msgr2=0x7f59bc14c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:22.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.698+0000 7f59bb7fe640 1 --2- 172.21.15.77:0/202672832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f59bc1593f0 0x7f59bc14c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:22.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.698+0000 7f59bb7fe640 1 -- 172.21.15.77:0/202672832 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ac0094d0 con 0x7f59bc15ce60 2023-11-04T01:40:22.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.698+0000 7f59c0c01640 1 --2- 172.21.15.77:0/202672832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f59bc1593f0 0x7f59bc14c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:22.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.698+0000 7f59bb7fe640 1 --2- 172.21.15.77:0/202672832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59bc15ce60 0x7f59bc14bf80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f59b000c3f0 tx=0x7f59b000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:22.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.698+0000 7f59b8ff9640 1 -- 172.21.15.77:0/202672832 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b00074e0 con 0x7f59bc15ce60 2023-11-04T01:40:22.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.698+0000 7f59b8ff9640 1 -- 172.21.15.77:0/202672832 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b0007640 con 0x7f59bc15ce60 2023-11-04T01:40:22.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.698+0000 7f59c2664640 1 -- 172.21.15.77:0/202672832 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59bc15ece0 con 0x7f59bc15ce60 2023-11-04T01:40:22.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.698+0000 7f59b8ff9640 1 -- 172.21.15.77:0/202672832 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b0004a20 con 0x7f59bc15ce60 2023-11-04T01:40:22.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.698+0000 7f59c2664640 1 -- 172.21.15.77:0/202672832 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59bc0c9640 con 0x7f59bc15ce60 2023-11-04T01:40:22.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.699+0000 7f59c2664640 1 -- 172.21.15.77:0/202672832 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59bc15f4c0 con 0x7f59bc15ce60 2023-11-04T01:40:22.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.699+0000 7f59b8ff9640 1 -- 172.21.15.77:0/202672832 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f59b0004b80 con 0x7f59bc15ce60 2023-11-04T01:40:22.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.700+0000 7f59b8ff9640 1 --2- 172.21.15.77:0/202672832 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f59a806ae70 0x7f59a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:22.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.700+0000 7f59b8ff9640 1 -- 172.21.15.77:0/202672832 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f59b00896a0 con 0x7f59bc15ce60 2023-11-04T01:40:22.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.700+0000 7f59bbfff640 1 --2- 172.21.15.77:0/202672832 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f59a806ae70 0x7f59a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:22.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.700+0000 7f59bbfff640 1 --2- 172.21.15.77:0/202672832 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f59a806ae70 0x7f59a806d330 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f59ac036000 tx=0x7f59ac008030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:22.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.704+0000 7f59b8ff9640 1 -- 172.21.15.77:0/202672832 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f59bc15f4c0 con 0x7f59bc15ce60 2023-11-04T01:40:22.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.906+0000 7f59c2664640 1 -- 172.21.15.77:0/202672832 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59bc15f4c0 con 0x7f59bc15ce60 2023-11-04T01:40:22.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.907+0000 7f59b8ff9640 1 -- 172.21.15.77:0/202672832 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f59bc15f4c0 con 0x7f59bc15ce60 2023-11-04T01:40:22.909 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:22.909 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/2867268857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2867268857},{"type":"v1","addr":"172.21.15.77:6834","nonce":2867268857}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2709973073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2709973073},{"type":"v1","addr":"172.21.15.77:6835","nonce":2709973073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/396299424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":396299424},{"type":"v1","addr":"172.21.15.122:6837","nonce":396299424}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:40:05.031856+0000","modified":"2023-11-04T01:40:21.906922+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34166},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34166":{"gid":34166,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6836/2444318089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2444318089},{"type":"v1","addr":"172.21.15.122:6836","nonce":2444318089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:40:22.910 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 9 2023-11-04T01:40:22.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.908+0000 7f59c2664640 1 -- 172.21.15.77:0/202672832 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f59a806ae70 msgr2=0x7f59a806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:22.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.908+0000 7f59c2664640 1 --2- 172.21.15.77:0/202672832 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f59a806ae70 0x7f59a806d330 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f59ac036000 tx=0x7f59ac008030 comp rx=0 tx=0).stop 2023-11-04T01:40:22.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.908+0000 7f59c2664640 1 -- 172.21.15.77:0/202672832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59bc15ce60 msgr2=0x7f59bc14bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:22.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.908+0000 7f59c2664640 1 --2- 172.21.15.77:0/202672832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59bc15ce60 0x7f59bc14bf80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f59b000c3f0 tx=0x7f59b000c8b0 comp rx=0 tx=0).stop 2023-11-04T01:40:22.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.908+0000 7f59c2664640 1 -- 172.21.15.77:0/202672832 shutdown_connections 2023-11-04T01:40:22.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.908+0000 7f59c2664640 1 --2- 172.21.15.77:0/202672832 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f59a806ae70 0x7f59a806d330 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:22.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.908+0000 7f59c2664640 1 --2- 172.21.15.77:0/202672832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f59bc1593f0 0x7f59bc14c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:22.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.908+0000 7f59c2664640 1 --2- 172.21.15.77:0/202672832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59bc15ce60 0x7f59bc14bf80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:22.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.908+0000 7f59c2664640 1 --2- 172.21.15.77:0/202672832 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f59bc0cf160 0x7f59bc0c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:22.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.909+0000 7f59c2664640 1 -- 172.21.15.77:0/202672832 >> 172.21.15.77:0/202672832 conn(0x7f59bc06ea90 msgr2=0x7f59bc0c5690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:22.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.909+0000 7f59c2664640 1 -- 172.21.15.77:0/202672832 shutdown_connections 2023-11-04T01:40:22.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:22.909+0000 7f59c2664640 1 -- 172.21.15.77:0/202672832 wait complete. 2023-11-04T01:40:22.921 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:23.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.018+0000 7f3571bc9640 1 Processor -- start 2023-11-04T01:40:23.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.018+0000 7f3571bc9640 1 -- start start 2023-11-04T01:40:23.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.019+0000 7f3571bc9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f356c15ae40 0x7f356c15bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:23.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.019+0000 7f3571bc9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f356c0cbc00 0x7f356c0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:23.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.019+0000 7f3571bc9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f356c0cc450 con 0x7f356c0cd860 2023-11-04T01:40:23.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.019+0000 7f3571bc9640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f356c15f400 con 0x7f356c0cbc00 2023-11-04T01:40:23.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.019+0000 7f3571bc9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356c15b220 con 0x7f356c15ae40 2023-11-04T01:40:23.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.019+0000 7f356bfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f356c0cd860 0x7f356c0b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52582/0 (socket says 172.21.15.77:52582) 2023-11-04T01:40:23.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.019+0000 7f356bfff640 1 -- 172.21.15.77:0/1181578575 learned_addr learned my addr 172.21.15.77:0/1181578575 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:23.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.020+0000 7f3563fff640 1 --2- 172.21.15.77:0/1181578575 >> v2:172.21.15.122:3300/0 conn(0x7f356c0cbc00 0x7f356c0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:23.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.020+0000 7f356affd640 1 -- 172.21.15.77:0/1181578575 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 634122758 0 0) 0x7f3564001490 con 0x7f356c0cd860 2023-11-04T01:40:23.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.020+0000 7f356b7fe640 1 --2- 172.21.15.77:0/1181578575 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f356c15ae40 0x7f356c15bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:23.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.020+0000 7f356affd640 1 -- 172.21.15.77:0/1181578575 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3558003520 con 0x7f356c0cd860 2023-11-04T01:40:23.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.020+0000 7f356affd640 1 -- 172.21.15.77:0/1181578575 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3482210809 0 0) 0x7f3558003520 con 0x7f356c0cd860 2023-11-04T01:40:23.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.020+0000 7f356affd640 1 -- 172.21.15.77:0/1181578575 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f356c15ae40 msgr2=0x7f356c15bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:23.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.020+0000 7f356affd640 1 --2- 172.21.15.77:0/1181578575 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f356c15ae40 0x7f356c15bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.020+0000 7f356affd640 1 -- 172.21.15.77:0/1181578575 >> v2:172.21.15.122:3300/0 conn(0x7f356c0cbc00 msgr2=0x7f356c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:23.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.020+0000 7f356affd640 1 --2- 172.21.15.77:0/1181578575 >> v2:172.21.15.122:3300/0 conn(0x7f356c0cbc00 0x7f356c0cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.020+0000 7f356affd640 1 -- 172.21.15.77:0/1181578575 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356c15f890 con 0x7f356c0cd860 2023-11-04T01:40:23.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.020+0000 7f356affd640 1 -- 172.21.15.77:0/1181578575 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f3564001b80 con 0x7f356c0cd860 2023-11-04T01:40:23.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.020+0000 7f356b7fe640 1 --2- 172.21.15.77:0/1181578575 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f356c15ae40 0x7f356c15bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:23.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.020+0000 7f356affd640 1 -- 172.21.15.77:0/1181578575 >> v1:172.21.15.77:6789/0 conn(0x7f356c0cd860 legacy=0x7f356c0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:23.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.020+0000 7f356affd640 1 --2- 172.21.15.77:0/1181578575 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f356c15ae40 0x7f3558003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:23.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.020+0000 7f356affd640 1 --2- 172.21.15.77:0/1181578575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3558003eb0 0x7f35580047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:23.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.020+0000 7f356affd640 1 --2- 172.21.15.77:0/1181578575 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3558004d00 0x7f3558005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:23.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.020+0000 7f356affd640 1 -- 172.21.15.77:0/1181578575 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356c15f400 con 0x7f3558004d00 2023-11-04T01:40:23.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.020+0000 7f356affd640 1 -- 172.21.15.77:0/1181578575 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356c15b220 con 0x7f3558003eb0 2023-11-04T01:40:23.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.020+0000 7f356affd640 1 -- 172.21.15.77:0/1181578575 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f355800b9b0 con 0x7f356c15ae40 2023-11-04T01:40:23.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.020+0000 7f356bfff640 1 --2- 172.21.15.77:0/1181578575 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3558004d00 0x7f3558005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:23.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.020+0000 7f3563fff640 1 --2- 172.21.15.77:0/1181578575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3558003eb0 0x7f35580047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:23.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.020+0000 7f356b7fe640 1 --2- 172.21.15.77:0/1181578575 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f356c15ae40 0x7f3558003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:23.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.020+0000 7f356bfff640 1 -- 172.21.15.77:0/1181578575 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f356c15ae40 msgr2=0x7f3558003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:23.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.020+0000 7f356bfff640 1 --2- 172.21.15.77:0/1181578575 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f356c15ae40 0x7f3558003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.020+0000 7f356bfff640 1 -- 172.21.15.77:0/1181578575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3558003eb0 msgr2=0x7f35580047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:23.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.020+0000 7f356bfff640 1 --2- 172.21.15.77:0/1181578575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3558003eb0 0x7f35580047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.020+0000 7f356bfff640 1 -- 172.21.15.77:0/1181578575 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3558003520 con 0x7f3558004d00 2023-11-04T01:40:23.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.021+0000 7f356bfff640 1 --2- 172.21.15.77:0/1181578575 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3558004d00 0x7f3558005180 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f356400a840 tx=0x7f35580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed96881ab52cad00 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:23.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.021+0000 7f356affd640 1 -- 172.21.15.77:0/1181578575 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3564034630 con 0x7f3558004d00 2023-11-04T01:40:23.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.021+0000 7f356affd640 1 -- 172.21.15.77:0/1181578575 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356402f070 con 0x7f3558004d00 2023-11-04T01:40:23.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.021+0000 7f356affd640 1 -- 172.21.15.77:0/1181578575 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3564034a30 con 0x7f3558004d00 2023-11-04T01:40:23.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.022+0000 7f3571bc9640 1 -- 172.21.15.77:0/1181578575 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3558004d00 msgr2=0x7f3558005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:23.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.022+0000 7f3571bc9640 1 --2- 172.21.15.77:0/1181578575 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3558004d00 0x7f3558005180 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f356400a840 tx=0x7f35580057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.022+0000 7f356bfff640 1 -- 172.21.15.77:0/1181578575 reap_dead start 2023-11-04T01:40:23.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.022+0000 7f3571bc9640 1 -- 172.21.15.77:0/1181578575 shutdown_connections 2023-11-04T01:40:23.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.022+0000 7f3571bc9640 1 -- 172.21.15.77:0/1181578575 >> 172.21.15.77:0/1181578575 conn(0x7f356c06ea90 msgr2=0x7f356c06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:23.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.022+0000 7f3571bc9640 1 -- 172.21.15.77:0/1181578575 shutdown_connections 2023-11-04T01:40:23.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.022+0000 7f3571bc9640 1 -- 172.21.15.77:0/1181578575 wait complete. 2023-11-04T01:40:23.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.023+0000 7f3571bc9640 1 Processor -- start 2023-11-04T01:40:23.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.023+0000 7f3571bc9640 1 -- start start 2023-11-04T01:40:23.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.024+0000 7f3571bc9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3558004d00 0x7f356c0c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:23.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.024+0000 7f3571bc9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f356c0ca910 0x7f356c152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:23.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.024+0000 7f3571bc9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f356c1f6c00 0x7f356c1f2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:23.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.024+0000 7f3571bc9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356c06c930 con 0x7f356c1f6c00 2023-11-04T01:40:23.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.024+0000 7f3571bc9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356c0c74d0 con 0x7f3558004d00 2023-11-04T01:40:23.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.024+0000 7f3571bc9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356c0c71f0 con 0x7f356c0ca910 2023-11-04T01:40:23.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.024+0000 7f356bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f356c1f6c00 0x7f356c1f2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:23.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.024+0000 7f356bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f356c1f6c00 0x7f356c1f2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56700/0 (socket says 172.21.15.77:56700) 2023-11-04T01:40:23.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.024+0000 7f356bfff640 1 -- 172.21.15.77:0/3280374479 learned_addr learned my addr 172.21.15.77:0/3280374479 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:23.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.024+0000 7f3563fff640 1 --2- 172.21.15.77:0/3280374479 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f356c0ca910 0x7f356c152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:23.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.024+0000 7f356b7fe640 1 --2- 172.21.15.77:0/3280374479 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3558004d00 0x7f356c0c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:23.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.024+0000 7f356bfff640 1 -- 172.21.15.77:0/3280374479 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f356c0ca910 msgr2=0x7f356c152a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:23.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.024+0000 7f356bfff640 1 --2- 172.21.15.77:0/3280374479 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f356c0ca910 0x7f356c152a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.024+0000 7f356bfff640 1 -- 172.21.15.77:0/3280374479 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3558004d00 msgr2=0x7f356c0c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:23.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.024+0000 7f356bfff640 1 --2- 172.21.15.77:0/3280374479 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3558004d00 0x7f356c0c6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.024+0000 7f356bfff640 1 -- 172.21.15.77:0/3280374479 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356c06c2e0 con 0x7f356c1f6c00 2023-11-04T01:40:23.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.024+0000 7f356b7fe640 1 --2- 172.21.15.77:0/3280374479 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3558004d00 0x7f356c0c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:23.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.024+0000 7f356bfff640 1 --2- 172.21.15.77:0/3280374479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f356c1f6c00 0x7f356c1f2870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f356402cb80 tx=0x7f356c15f540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:23.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.024+0000 7f3568ff9640 1 -- 172.21.15.77:0/3280374479 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3564034840 con 0x7f356c1f6c00 2023-11-04T01:40:23.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.024+0000 7f3568ff9640 1 -- 172.21.15.77:0/3280374479 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35640349a0 con 0x7f356c1f6c00 2023-11-04T01:40:23.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.024+0000 7f3571bc9640 1 -- 172.21.15.77:0/3280374479 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f356c06c5c0 con 0x7f356c1f6c00 2023-11-04T01:40:23.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.025+0000 7f3568ff9640 1 -- 172.21.15.77:0/3280374479 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3564034d10 con 0x7f356c1f6c00 2023-11-04T01:40:23.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.025+0000 7f3571bc9640 1 -- 172.21.15.77:0/3280374479 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f356c1f7090 con 0x7f356c1f6c00 2023-11-04T01:40:23.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.025+0000 7f3571bc9640 1 -- 172.21.15.77:0/3280374479 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f356c0ce2d0 con 0x7f356c1f6c00 2023-11-04T01:40:23.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.026+0000 7f3568ff9640 1 -- 172.21.15.77:0/3280374479 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3564031030 con 0x7f356c1f6c00 2023-11-04T01:40:23.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.026+0000 7f3568ff9640 1 --2- 172.21.15.77:0/3280374479 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f354c06ae70 0x7f354c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:23.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.026+0000 7f3568ff9640 1 -- 172.21.15.77:0/3280374479 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f35640abc30 con 0x7f356c1f6c00 2023-11-04T01:40:23.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.026+0000 7f356b7fe640 1 --2- 172.21.15.77:0/3280374479 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f354c06ae70 0x7f354c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:23.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.027+0000 7f356b7fe640 1 --2- 172.21.15.77:0/3280374479 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f354c06ae70 0x7f354c06d330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f356c0c8890 tx=0x7f355c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:23.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.031+0000 7f3568ff9640 1 -- 172.21.15.77:0/3280374479 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f35640769f0 con 0x7f356c1f6c00 2023-11-04T01:40:23.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.197+0000 7f3571bc9640 1 -- 172.21.15.77:0/3280374479 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f356c0ce2d0 con 0x7f356c1f6c00 2023-11-04T01:40:23.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.198+0000 7f3568ff9640 1 -- 172.21.15.77:0/3280374479 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f356407a010 con 0x7f356c1f6c00 2023-11-04T01:40:23.200 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:23.201 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":24,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:40:10.153949+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:40:02.810971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:40:04.003979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:40:07.734355+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:23.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.200+0000 7f3571bc9640 1 -- 172.21.15.77:0/3280374479 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f354c06ae70 msgr2=0x7f354c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:23.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.200+0000 7f3571bc9640 1 --2- 172.21.15.77:0/3280374479 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f354c06ae70 0x7f354c06d330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f356c0c8890 tx=0x7f355c008040 comp rx=0 tx=0).stop 2023-11-04T01:40:23.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.200+0000 7f3571bc9640 1 -- 172.21.15.77:0/3280374479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f356c1f6c00 msgr2=0x7f356c1f2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:23.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.200+0000 7f3571bc9640 1 --2- 172.21.15.77:0/3280374479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f356c1f6c00 0x7f356c1f2870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f356402cb80 tx=0x7f356c15f540 comp rx=0 tx=0).stop 2023-11-04T01:40:23.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.200+0000 7f3571bc9640 1 -- 172.21.15.77:0/3280374479 shutdown_connections 2023-11-04T01:40:23.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.200+0000 7f3571bc9640 1 --2- 172.21.15.77:0/3280374479 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f354c06ae70 0x7f354c06d330 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.200+0000 7f3571bc9640 1 --2- 172.21.15.77:0/3280374479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f356c1f6c00 0x7f356c1f2870 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.200+0000 7f3571bc9640 1 --2- 172.21.15.77:0/3280374479 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f356c0ca910 0x7f356c152a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.200+0000 7f3571bc9640 1 --2- 172.21.15.77:0/3280374479 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3558004d00 0x7f356c0c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.200+0000 7f3571bc9640 1 -- 172.21.15.77:0/3280374479 >> 172.21.15.77:0/3280374479 conn(0x7f356c06ea90 msgr2=0x7f356c15d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:23.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.200+0000 7f3571bc9640 1 -- 172.21.15.77:0/3280374479 shutdown_connections 2023-11-04T01:40:23.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.200+0000 7f3571bc9640 1 -- 172.21.15.77:0/3280374479 wait complete. 2023-11-04T01:40:23.213 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T01:40:23.213 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:40:23.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.310+0000 7f2c332e7640 1 Processor -- start 2023-11-04T01:40:23.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.311+0000 7f2c332e7640 1 -- start start 2023-11-04T01:40:23.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.311+0000 7f2c332e7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2c2c0cd170 0x7f2c2c06ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:23.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.311+0000 7f2c332e7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c2c06c050 con 0x7f2c2c0b2870 2023-11-04T01:40:23.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.311+0000 7f2c332e7640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c2c06c330 con 0x7f2c2c0b2c50 2023-11-04T01:40:23.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.311+0000 7f2c332e7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c2c06ccd0 con 0x7f2c2c0cd170 2023-11-04T01:40:23.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.312+0000 7f2c30882640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2c2c0cd170 0x7f2c2c06ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:23.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.312+0000 7f2c30882640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2c2c0cd170 0x7f2c2c06ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56702/0 (socket says 172.21.15.77:56702) 2023-11-04T01:40:23.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.312+0000 7f2c31083640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f2c2c0b2870 0x7f2c2c0cca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52586/0 (socket says 172.21.15.77:52586) 2023-11-04T01:40:23.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.312+0000 7f2c30882640 1 -- 172.21.15.77:0/2327368502 learned_addr learned my addr 172.21.15.77:0/2327368502 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:23.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.312+0000 7f2c30882640 1 -- 172.21.15.77:0/2327368502 >> v1:172.21.15.122:6789/0 conn(0x7f2c2c0b2c50 legacy=0x7f2c2c15c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:23.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.312+0000 7f2c30882640 1 -- 172.21.15.77:0/2327368502 >> v1:172.21.15.77:6789/0 conn(0x7f2c2c0b2870 legacy=0x7f2c2c0cca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:23.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.312+0000 7f2c23fff640 1 -- 172.21.15.77:0/2327368502 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 398545209 0 0) 0x7f2c2c06c050 con 0x7f2c2c0b2870 2023-11-04T01:40:23.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.312+0000 7f2c30882640 1 -- 172.21.15.77:0/2327368502 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c2c06c610 con 0x7f2c2c0cd170 2023-11-04T01:40:23.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.313+0000 7f2c30882640 1 --2- 172.21.15.77:0/2327368502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c2c0cd170 0x7f2c2c06ba00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2c28009870 tx=0x7f2c2802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=266d55b18e754486 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:23.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.313+0000 7f2c23fff640 1 -- 172.21.15.77:0/2327368502 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c280317e0 con 0x7f2c2c0cd170 2023-11-04T01:40:23.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.313+0000 7f2c23fff640 1 -- 172.21.15.77:0/2327368502 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c28031940 con 0x7f2c2c0cd170 2023-11-04T01:40:23.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.313+0000 7f2c23fff640 1 -- 172.21.15.77:0/2327368502 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c28031cd0 con 0x7f2c2c0cd170 2023-11-04T01:40:23.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.313+0000 7f2c332e7640 1 -- 172.21.15.77:0/2327368502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c2c0cd170 msgr2=0x7f2c2c06ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:23.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.313+0000 7f2c332e7640 1 --2- 172.21.15.77:0/2327368502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c2c0cd170 0x7f2c2c06ba00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2c28009870 tx=0x7f2c2802b880 comp rx=0 tx=0).stop 2023-11-04T01:40:23.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.313+0000 7f2c332e7640 1 -- 172.21.15.77:0/2327368502 shutdown_connections 2023-11-04T01:40:23.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.313+0000 7f2c332e7640 1 --2- 172.21.15.77:0/2327368502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c2c0cd170 0x7f2c2c06ba00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.313+0000 7f2c332e7640 1 -- 172.21.15.77:0/2327368502 >> 172.21.15.77:0/2327368502 conn(0x7f2c2c0cd600 msgr2=0x7f2c2c0cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:23.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.313+0000 7f2c332e7640 1 -- 172.21.15.77:0/2327368502 shutdown_connections 2023-11-04T01:40:23.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.313+0000 7f2c332e7640 1 -- 172.21.15.77:0/2327368502 wait complete. 2023-11-04T01:40:23.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.314+0000 7f2c332e7640 1 Processor -- start 2023-11-04T01:40:23.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.314+0000 7f2c332e7640 1 -- start start 2023-11-04T01:40:23.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.315+0000 7f2c332e7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c2c0b2870 0x7f2c2c157a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:23.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.315+0000 7f2c332e7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c2c0b2c50 0x7f2c2c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:23.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.315+0000 7f2c332e7640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2c2c0cd170 0x7f2c2c0b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:23.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.315+0000 7f2c332e7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c157f50 con 0x7f2c2c0b2870 2023-11-04T01:40:23.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.315+0000 7f2c332e7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c0c8eb0 con 0x7f2c2c0b2c50 2023-11-04T01:40:23.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.315+0000 7f2c332e7640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c0c9190 con 0x7f2c2c0cd170 2023-11-04T01:40:23.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.315+0000 7f2c31083640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c2c0b2870 0x7f2c2c157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:23.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.315+0000 7f2c31083640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c2c0b2870 0x7f2c2c157a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56706/0 (socket says 172.21.15.77:56706) 2023-11-04T01:40:23.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.315+0000 7f2c31083640 1 -- 172.21.15.77:0/1140409562 learned_addr learned my addr 172.21.15.77:0/1140409562 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:23.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.315+0000 7f2c31083640 1 -- 172.21.15.77:0/1140409562 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2c2c0cd170 msgr2=0x7f2c2c0b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:23.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.315+0000 7f2c30882640 1 --2- 172.21.15.77:0/1140409562 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c2c0b2c50 0x7f2c2c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:23.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.315+0000 7f2c31884640 1 --2- 172.21.15.77:0/1140409562 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2c2c0cd170 0x7f2c2c0b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:23.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.315+0000 7f2c31083640 1 --2- 172.21.15.77:0/1140409562 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2c2c0cd170 0x7f2c2c0b52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.315+0000 7f2c31083640 1 -- 172.21.15.77:0/1140409562 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c2c0b2c50 msgr2=0x7f2c2c0b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:23.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.315+0000 7f2c31083640 1 --2- 172.21.15.77:0/1140409562 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c2c0b2c50 0x7f2c2c0b4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.316+0000 7f2c31083640 1 -- 172.21.15.77:0/1140409562 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c280094d0 con 0x7f2c2c0b2870 2023-11-04T01:40:23.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.316+0000 7f2c31083640 1 --2- 172.21.15.77:0/1140409562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c2c0b2870 0x7f2c2c157a10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c00c410 tx=0x7f2c1c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:23.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.316+0000 7f2c21ffb640 1 -- 172.21.15.77:0/1140409562 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c0074e0 con 0x7f2c2c0b2870 2023-11-04T01:40:23.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.316+0000 7f2c21ffb640 1 -- 172.21.15.77:0/1140409562 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1c007640 con 0x7f2c2c0b2870 2023-11-04T01:40:23.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.316+0000 7f2c332e7640 1 -- 172.21.15.77:0/1140409562 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c2c0c9470 con 0x7f2c2c0b2870 2023-11-04T01:40:23.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.316+0000 7f2c21ffb640 1 -- 172.21.15.77:0/1140409562 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c0059e0 con 0x7f2c2c0b2870 2023-11-04T01:40:23.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.316+0000 7f2c332e7640 1 -- 172.21.15.77:0/1140409562 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c2c0abb00 con 0x7f2c2c0b2870 2023-11-04T01:40:23.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.317+0000 7f2c332e7640 1 -- 172.21.15.77:0/1140409562 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c2c0cdf10 con 0x7f2c2c0b2870 2023-11-04T01:40:23.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.317+0000 7f2c21ffb640 1 -- 172.21.15.77:0/1140409562 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2c1c005b40 con 0x7f2c2c0b2870 2023-11-04T01:40:23.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.318+0000 7f2c21ffb640 1 --2- 172.21.15.77:0/1140409562 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2c1006ae70 0x7f2c1006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:23.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.318+0000 7f2c21ffb640 1 -- 172.21.15.77:0/1140409562 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2c1c088fb0 con 0x7f2c2c0b2870 2023-11-04T01:40:23.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.318+0000 7f2c30882640 1 --2- 172.21.15.77:0/1140409562 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2c1006ae70 0x7f2c1006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:23.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.318+0000 7f2c30882640 1 --2- 172.21.15.77:0/1140409562 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2c1006ae70 0x7f2c1006d330 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2c28036000 tx=0x7f2c2803d040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:23.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.322+0000 7f2c21ffb640 1 -- 172.21.15.77:0/1140409562 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2c1c053cd0 con 0x7f2c2c0b2870 2023-11-04T01:40:23.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.488+0000 7f2c332e7640 1 -- 172.21.15.77:0/1140409562 --> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2c2c06c8f0 con 0x7f2c1006ae70 2023-11-04T01:40:23.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.497+0000 7f2c21ffb640 1 -- 172.21.15.77:0/1140409562 <== mgr.4123 v2:172.21.15.122:6832/2275325762 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345313 (secure 0 0 0) 0x7f2c28031c80 con 0x7f2c1006ae70 2023-11-04T01:40:23.504 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:23.506 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-04T01:40:23.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.501+0000 7f2c332e7640 1 -- 172.21.15.77:0/1140409562 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2c1006ae70 msgr2=0x7f2c1006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:23.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.501+0000 7f2c332e7640 1 --2- 172.21.15.77:0/1140409562 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2c1006ae70 0x7f2c1006d330 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2c28036000 tx=0x7f2c2803d040 comp rx=0 tx=0).stop 2023-11-04T01:40:23.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.501+0000 7f2c332e7640 1 -- 172.21.15.77:0/1140409562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c2c0b2870 msgr2=0x7f2c2c157a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:23.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.501+0000 7f2c332e7640 1 --2- 172.21.15.77:0/1140409562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c2c0b2870 0x7f2c2c157a10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c00c410 tx=0x7f2c1c00c8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.501+0000 7f2c332e7640 1 -- 172.21.15.77:0/1140409562 shutdown_connections 2023-11-04T01:40:23.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.501+0000 7f2c332e7640 1 --2- 172.21.15.77:0/1140409562 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2c1006ae70 0x7f2c1006d330 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.501+0000 7f2c332e7640 1 --2- 172.21.15.77:0/1140409562 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2c2c0cd170 0x7f2c2c0b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.501+0000 7f2c332e7640 1 --2- 172.21.15.77:0/1140409562 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c2c0b2c50 0x7f2c2c0b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.501+0000 7f2c332e7640 1 --2- 172.21.15.77:0/1140409562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c2c0b2870 0x7f2c2c157a10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.501+0000 7f2c332e7640 1 -- 172.21.15.77:0/1140409562 >> 172.21.15.77:0/1140409562 conn(0x7f2c2c0cd600 msgr2=0x7f2c2c15f750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:23.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.501+0000 7f2c332e7640 1 -- 172.21.15.77:0/1140409562 shutdown_connections 2023-11-04T01:40:23.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.501+0000 7f2c332e7640 1 -- 172.21.15.77:0/1140409562 wait complete. 2023-11-04T01:40:23.513 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-11-04T01:40:21.629344+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219360,"kb_used_data":3204,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755360,"statfs":{"total":773094113280,"available":772869488640,"internally_reserved":0,"allocated":3280896,"data_stored":1985411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.081960"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734371+0000","last_change":"2023-11-04T01:40:04.705196+0000","last_active":"2023-11-04T01:40:09.734371+0000","last_peered":"2023-11-04T01:40:09.734371+0000","last_clean":"2023-11-04T01:40:09.734371+0000","last_became_active":"2023-11-04T01:40:04.704925+0000","last_became_peered":"2023-11-04T01:40:04.704925+0000","last_unstale":"2023-11-04T01:40:09.734371+0000","last_undegraded":"2023-11-04T01:40:09.734371+0000","last_fullsized":"2023-11-04T01:40:09.734371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:23.661606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727344+0000","last_change":"2023-11-04T01:40:05.561233+0000","last_active":"2023-11-04T01:40:09.727344+0000","last_peered":"2023-11-04T01:40:09.727344+0000","last_clean":"2023-11-04T01:40:09.727344+0000","last_became_active":"2023-11-04T01:40:05.560936+0000","last_became_peered":"2023-11-04T01:40:05.560936+0000","last_unstale":"2023-11-04T01:40:09.727344+0000","last_undegraded":"2023-11-04T01:40:09.727344+0000","last_fullsized":"2023-11-04T01:40:09.727344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:32:27.484390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.550542+0000","last_change":"2023-11-04T01:40:09.743799+0000","last_active":"2023-11-04T01:40:10.550542+0000","last_peered":"2023-11-04T01:40:10.550542+0000","last_clean":"2023-11-04T01:40:10.550542+0000","last_became_active":"2023-11-04T01:40:09.743430+0000","last_became_peered":"2023-11-04T01:40:09.743430+0000","last_unstale":"2023-11-04T01:40:10.550542+0000","last_undegraded":"2023-11-04T01:40:10.550542+0000","last_fullsized":"2023-11-04T01:40:10.550542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:23:03.976941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727438+0000","last_change":"2023-11-04T01:40:04.697166+0000","last_active":"2023-11-04T01:40:09.727438+0000","last_peered":"2023-11-04T01:40:09.727438+0000","last_clean":"2023-11-04T01:40:09.727438+0000","last_became_active":"2023-11-04T01:40:04.696343+0000","last_became_peered":"2023-11-04T01:40:04.696343+0000","last_unstale":"2023-11-04T01:40:09.727438+0000","last_undegraded":"2023-11-04T01:40:09.727438+0000","last_fullsized":"2023-11-04T01:40:09.727438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:45:56.544854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734207+0000","last_change":"2023-11-04T01:40:05.578729+0000","last_active":"2023-11-04T01:40:09.734207+0000","last_peered":"2023-11-04T01:40:09.734207+0000","last_clean":"2023-11-04T01:40:09.734207+0000","last_became_active":"2023-11-04T01:40:05.578510+0000","last_became_peered":"2023-11-04T01:40:05.578510+0000","last_unstale":"2023-11-04T01:40:09.734207+0000","last_undegraded":"2023-11-04T01:40:09.734207+0000","last_fullsized":"2023-11-04T01:40:09.734207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:51:09.123583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255835+0000","last_change":"2023-11-04T01:40:09.748639+0000","last_active":"2023-11-04T01:40:11.255835+0000","last_peered":"2023-11-04T01:40:11.255835+0000","last_clean":"2023-11-04T01:40:11.255835+0000","last_became_active":"2023-11-04T01:40:09.748054+0000","last_became_peered":"2023-11-04T01:40:09.748054+0000","last_unstale":"2023-11-04T01:40:11.255835+0000","last_undegraded":"2023-11-04T01:40:11.255835+0000","last_fullsized":"2023-11-04T01:40:11.255835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:06.213744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731930+0000","last_change":"2023-11-04T01:40:04.704898+0000","last_active":"2023-11-04T01:40:09.731930+0000","last_peered":"2023-11-04T01:40:09.731930+0000","last_clean":"2023-11-04T01:40:09.731930+0000","last_became_active":"2023-11-04T01:40:04.704598+0000","last_became_peered":"2023-11-04T01:40:04.704598+0000","last_unstale":"2023-11-04T01:40:09.731930+0000","last_undegraded":"2023-11-04T01:40:09.731930+0000","last_fullsized":"2023-11-04T01:40:09.731930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:01.176323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729590+0000","last_change":"2023-11-04T01:40:05.578543+0000","last_active":"2023-11-04T01:40:09.729590+0000","last_peered":"2023-11-04T01:40:09.729590+0000","last_clean":"2023-11-04T01:40:09.729590+0000","last_became_active":"2023-11-04T01:40:05.576858+0000","last_became_peered":"2023-11-04T01:40:05.576858+0000","last_unstale":"2023-11-04T01:40:09.729590+0000","last_undegraded":"2023-11-04T01:40:09.729590+0000","last_fullsized":"2023-11-04T01:40:09.729590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:09:53.332106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256523+0000","last_change":"2023-11-04T01:40:09.749533+0000","last_active":"2023-11-04T01:40:11.256523+0000","last_peered":"2023-11-04T01:40:11.256523+0000","last_clean":"2023-11-04T01:40:11.256523+0000","last_became_active":"2023-11-04T01:40:09.749065+0000","last_became_peered":"2023-11-04T01:40:09.749065+0000","last_unstale":"2023-11-04T01:40:11.256523+0000","last_undegraded":"2023-11-04T01:40:11.256523+0000","last_fullsized":"2023-11-04T01:40:11.256523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:09:57.363528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731575+0000","last_change":"2023-11-04T01:40:04.703516+0000","last_active":"2023-11-04T01:40:09.731575+0000","last_peered":"2023-11-04T01:40:09.731575+0000","last_clean":"2023-11-04T01:40:09.731575+0000","last_became_active":"2023-11-04T01:40:04.703201+0000","last_became_peered":"2023-11-04T01:40:04.703201+0000","last_unstale":"2023-11-04T01:40:09.731575+0000","last_undegraded":"2023-11-04T01:40:09.731575+0000","last_fullsized":"2023-11-04T01:40:09.731575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:25:20.986535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729248+0000","last_change":"2023-11-04T01:40:05.577332+0000","last_active":"2023-11-04T01:40:09.729248+0000","last_peered":"2023-11-04T01:40:09.729248+0000","last_clean":"2023-11-04T01:40:09.729248+0000","last_became_active":"2023-11-04T01:40:05.577054+0000","last_became_peered":"2023-11-04T01:40:05.577054+0000","last_unstale":"2023-11-04T01:40:09.729248+0000","last_undegraded":"2023-11-04T01:40:09.729248+0000","last_fullsized":"2023-11-04T01:40:09.729248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:35:55.027288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256082+0000","last_change":"2023-11-04T01:40:09.746388+0000","last_active":"2023-11-04T01:40:11.256082+0000","last_peered":"2023-11-04T01:40:11.256082+0000","last_clean":"2023-11-04T01:40:11.256082+0000","last_became_active":"2023-11-04T01:40:09.745966+0000","last_became_peered":"2023-11-04T01:40:09.745966+0000","last_unstale":"2023-11-04T01:40:11.256082+0000","last_undegraded":"2023-11-04T01:40:11.256082+0000","last_fullsized":"2023-11-04T01:40:11.256082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:35:59.058711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734112+0000","last_change":"2023-11-04T01:40:05.565842+0000","last_active":"2023-11-04T01:40:09.734112+0000","last_peered":"2023-11-04T01:40:09.734112+0000","last_clean":"2023-11-04T01:40:09.734112+0000","last_became_active":"2023-11-04T01:40:05.565387+0000","last_became_peered":"2023-11-04T01:40:05.565387+0000","last_unstale":"2023-11-04T01:40:09.734112+0000","last_undegraded":"2023-11-04T01:40:09.734112+0000","last_fullsized":"2023-11-04T01:40:09.734112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:44:56.709670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731731+0000","last_change":"2023-11-04T01:40:04.702605+0000","last_active":"2023-11-04T01:40:09.731731+0000","last_peered":"2023-11-04T01:40:09.731731+0000","last_clean":"2023-11-04T01:40:09.731731+0000","last_became_active":"2023-11-04T01:40:04.702242+0000","last_became_peered":"2023-11-04T01:40:04.702242+0000","last_unstale":"2023-11-04T01:40:09.731731+0000","last_undegraded":"2023-11-04T01:40:09.731731+0000","last_fullsized":"2023-11-04T01:40:09.731731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:55:42.496852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256505+0000","last_change":"2023-11-04T01:40:09.748671+0000","last_active":"2023-11-04T01:40:11.256505+0000","last_peered":"2023-11-04T01:40:11.256505+0000","last_clean":"2023-11-04T01:40:11.256505+0000","last_became_active":"2023-11-04T01:40:09.748007+0000","last_became_peered":"2023-11-04T01:40:09.748007+0000","last_unstale":"2023-11-04T01:40:11.256505+0000","last_undegraded":"2023-11-04T01:40:11.256505+0000","last_fullsized":"2023-11-04T01:40:11.256505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:45:21.829187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727707+0000","last_change":"2023-11-04T01:40:05.566650+0000","last_active":"2023-11-04T01:40:09.727707+0000","last_peered":"2023-11-04T01:40:09.727707+0000","last_clean":"2023-11-04T01:40:09.727707+0000","last_became_active":"2023-11-04T01:40:05.566369+0000","last_became_peered":"2023-11-04T01:40:05.566369+0000","last_unstale":"2023-11-04T01:40:09.727707+0000","last_undegraded":"2023-11-04T01:40:09.727707+0000","last_fullsized":"2023-11-04T01:40:09.727707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:17.862444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.735570+0000","last_change":"2023-11-04T01:40:04.699761+0000","last_active":"2023-11-04T01:40:09.735570+0000","last_peered":"2023-11-04T01:40:09.735570+0000","last_clean":"2023-11-04T01:40:09.735570+0000","last_became_active":"2023-11-04T01:40:04.699489+0000","last_became_peered":"2023-11-04T01:40:04.699489+0000","last_unstale":"2023-11-04T01:40:09.735570+0000","last_undegraded":"2023-11-04T01:40:09.735570+0000","last_fullsized":"2023-11-04T01:40:09.735570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:45:56.544854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256468+0000","last_change":"2023-11-04T01:40:09.754113+0000","last_active":"2023-11-04T01:40:11.256468+0000","last_peered":"2023-11-04T01:40:11.256468+0000","last_clean":"2023-11-04T01:40:11.256468+0000","last_became_active":"2023-11-04T01:40:09.753689+0000","last_became_peered":"2023-11-04T01:40:09.753689+0000","last_unstale":"2023-11-04T01:40:11.256468+0000","last_undegraded":"2023-11-04T01:40:11.256468+0000","last_fullsized":"2023-11-04T01:40:11.256468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:49:00.940390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727962+0000","last_change":"2023-11-04T01:40:05.559848+0000","last_active":"2023-11-04T01:40:09.727962+0000","last_peered":"2023-11-04T01:40:09.727962+0000","last_clean":"2023-11-04T01:40:09.727962+0000","last_became_active":"2023-11-04T01:40:05.559384+0000","last_became_peered":"2023-11-04T01:40:05.559384+0000","last_unstale":"2023-11-04T01:40:09.727962+0000","last_undegraded":"2023-11-04T01:40:09.727962+0000","last_fullsized":"2023-11-04T01:40:09.727962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:44:56.709670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.733604+0000","last_change":"2023-11-04T01:40:04.704585+0000","last_active":"2023-11-04T01:40:09.733604+0000","last_peered":"2023-11-04T01:40:09.733604+0000","last_clean":"2023-11-04T01:40:09.733604+0000","last_became_active":"2023-11-04T01:40:04.704325+0000","last_became_peered":"2023-11-04T01:40:04.704325+0000","last_unstale":"2023-11-04T01:40:09.733604+0000","last_undegraded":"2023-11-04T01:40:09.733604+0000","last_fullsized":"2023-11-04T01:40:09.733604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:23.661606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256533+0000","last_change":"2023-11-04T01:40:09.748343+0000","last_active":"2023-11-04T01:40:11.256533+0000","last_peered":"2023-11-04T01:40:11.256533+0000","last_clean":"2023-11-04T01:40:11.256533+0000","last_became_active":"2023-11-04T01:40:09.747762+0000","last_became_peered":"2023-11-04T01:40:09.747762+0000","last_unstale":"2023-11-04T01:40:11.256533+0000","last_undegraded":"2023-11-04T01:40:11.256533+0000","last_fullsized":"2023-11-04T01:40:11.256533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:47.091874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.737227+0000","last_change":"2023-11-04T01:40:05.562694+0000","last_active":"2023-11-04T01:40:09.737227+0000","last_peered":"2023-11-04T01:40:09.737227+0000","last_clean":"2023-11-04T01:40:09.737227+0000","last_became_active":"2023-11-04T01:40:05.562431+0000","last_became_peered":"2023-11-04T01:40:05.562431+0000","last_unstale":"2023-11-04T01:40:09.737227+0000","last_undegraded":"2023-11-04T01:40:09.737227+0000","last_fullsized":"2023-11-04T01:40:09.737227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:12:08.762760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731277+0000","last_change":"2023-11-04T01:40:04.706712+0000","last_active":"2023-11-04T01:40:09.731277+0000","last_peered":"2023-11-04T01:40:09.731277+0000","last_clean":"2023-11-04T01:40:09.731277+0000","last_became_active":"2023-11-04T01:40:04.706369+0000","last_became_peered":"2023-11-04T01:40:04.706369+0000","last_unstale":"2023-11-04T01:40:09.731277+0000","last_undegraded":"2023-11-04T01:40:09.731277+0000","last_fullsized":"2023-11-04T01:40:09.731277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:23.661606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256269+0000","last_change":"2023-11-04T01:40:09.752971+0000","last_active":"2023-11-04T01:40:11.256269+0000","last_peered":"2023-11-04T01:40:11.256269+0000","last_clean":"2023-11-04T01:40:11.256269+0000","last_became_active":"2023-11-04T01:40:09.752569+0000","last_became_peered":"2023-11-04T01:40:09.752569+0000","last_unstale":"2023-11-04T01:40:11.256269+0000","last_undegraded":"2023-11-04T01:40:11.256269+0000","last_fullsized":"2023-11-04T01:40:11.256269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:32:31.515813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.733414+0000","last_change":"2023-11-04T01:40:05.559419+0000","last_active":"2023-11-04T01:40:09.733414+0000","last_peered":"2023-11-04T01:40:09.733414+0000","last_clean":"2023-11-04T01:40:09.733414+0000","last_became_active":"2023-11-04T01:40:05.559176+0000","last_became_peered":"2023-11-04T01:40:05.559176+0000","last_unstale":"2023-11-04T01:40:09.733414+0000","last_undegraded":"2023-11-04T01:40:09.733414+0000","last_fullsized":"2023-11-04T01:40:09.733414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:44:56.709670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.735151+0000","last_change":"2023-11-04T01:40:04.706199+0000","last_active":"2023-11-04T01:40:09.735151+0000","last_peered":"2023-11-04T01:40:09.735151+0000","last_clean":"2023-11-04T01:40:09.735151+0000","last_became_active":"2023-11-04T01:40:04.705913+0000","last_became_peered":"2023-11-04T01:40:04.705913+0000","last_unstale":"2023-11-04T01:40:09.735151+0000","last_undegraded":"2023-11-04T01:40:09.735151+0000","last_fullsized":"2023-11-04T01:40:09.735151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:14:24.322290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256061+0000","last_change":"2023-11-04T01:40:09.744921+0000","last_active":"2023-11-04T01:40:11.256061+0000","last_peered":"2023-11-04T01:40:11.256061+0000","last_clean":"2023-11-04T01:40:11.256061+0000","last_became_active":"2023-11-04T01:40:09.744502+0000","last_became_peered":"2023-11-04T01:40:09.744502+0000","last_unstale":"2023-11-04T01:40:11.256061+0000","last_undegraded":"2023-11-04T01:40:11.256061+0000","last_fullsized":"2023-11-04T01:40:11.256061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:46:22.983063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.728110+0000","last_change":"2023-11-04T01:40:05.559760+0000","last_active":"2023-11-04T01:40:09.728110+0000","last_peered":"2023-11-04T01:40:09.728110+0000","last_clean":"2023-11-04T01:40:09.728110+0000","last_became_active":"2023-11-04T01:40:05.559446+0000","last_became_peered":"2023-11-04T01:40:05.559446+0000","last_unstale":"2023-11-04T01:40:09.728110+0000","last_undegraded":"2023-11-04T01:40:09.728110+0000","last_fullsized":"2023-11-04T01:40:09.728110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:56.908968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734467+0000","last_change":"2023-11-04T01:40:04.708172+0000","last_active":"2023-11-04T01:40:09.734467+0000","last_peered":"2023-11-04T01:40:09.734467+0000","last_clean":"2023-11-04T01:40:09.734467+0000","last_became_active":"2023-11-04T01:40:04.707882+0000","last_became_peered":"2023-11-04T01:40:04.707882+0000","last_unstale":"2023-11-04T01:40:09.734467+0000","last_undegraded":"2023-11-04T01:40:09.734467+0000","last_fullsized":"2023-11-04T01:40:09.734467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:01.195966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.550470+0000","last_change":"2023-11-04T01:40:09.749232+0000","last_active":"2023-11-04T01:40:10.550470+0000","last_peered":"2023-11-04T01:40:10.550470+0000","last_clean":"2023-11-04T01:40:10.550470+0000","last_became_active":"2023-11-04T01:40:09.748638+0000","last_became_peered":"2023-11-04T01:40:09.748638+0000","last_unstale":"2023-11-04T01:40:10.550470+0000","last_undegraded":"2023-11-04T01:40:10.550470+0000","last_fullsized":"2023-11-04T01:40:10.550470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:58.518860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734540+0000","last_change":"2023-11-04T01:40:05.562143+0000","last_active":"2023-11-04T01:40:09.734540+0000","last_peered":"2023-11-04T01:40:09.734540+0000","last_clean":"2023-11-04T01:40:09.734540+0000","last_became_active":"2023-11-04T01:40:05.561862+0000","last_became_peered":"2023-11-04T01:40:05.561862+0000","last_unstale":"2023-11-04T01:40:09.734540+0000","last_undegraded":"2023-11-04T01:40:09.734540+0000","last_fullsized":"2023-11-04T01:40:09.734540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:09:40.586446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732147+0000","last_change":"2023-11-04T01:40:04.710881+0000","last_active":"2023-11-04T01:40:09.732147+0000","last_peered":"2023-11-04T01:40:09.732147+0000","last_clean":"2023-11-04T01:40:09.732147+0000","last_became_active":"2023-11-04T01:40:04.710601+0000","last_became_peered":"2023-11-04T01:40:04.710601+0000","last_unstale":"2023-11-04T01:40:09.732147+0000","last_undegraded":"2023-11-04T01:40:09.732147+0000","last_fullsized":"2023-11-04T01:40:09.732147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:46:17.945642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255709+0000","last_change":"2023-11-04T01:40:09.749485+0000","last_active":"2023-11-04T01:40:11.255709+0000","last_peered":"2023-11-04T01:40:11.255709+0000","last_clean":"2023-11-04T01:40:11.255709+0000","last_became_active":"2023-11-04T01:40:09.748804+0000","last_became_peered":"2023-11-04T01:40:09.748804+0000","last_unstale":"2023-11-04T01:40:11.255709+0000","last_undegraded":"2023-11-04T01:40:11.255709+0000","last_fullsized":"2023-11-04T01:40:11.255709+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:19.049388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729332+0000","last_change":"2023-11-04T01:40:05.571329+0000","last_active":"2023-11-04T01:40:09.729332+0000","last_peered":"2023-11-04T01:40:09.729332+0000","last_clean":"2023-11-04T01:40:09.729332+0000","last_became_active":"2023-11-04T01:40:05.571077+0000","last_became_peered":"2023-11-04T01:40:05.571077+0000","last_unstale":"2023-11-04T01:40:09.729332+0000","last_undegraded":"2023-11-04T01:40:09.729332+0000","last_fullsized":"2023-11-04T01:40:09.729332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:56.908968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734615+0000","last_change":"2023-11-04T01:40:04.710975+0000","last_active":"2023-11-04T01:40:09.734615+0000","last_peered":"2023-11-04T01:40:09.734615+0000","last_clean":"2023-11-04T01:40:09.734615+0000","last_became_active":"2023-11-04T01:40:04.710643+0000","last_became_peered":"2023-11-04T01:40:04.710643+0000","last_unstale":"2023-11-04T01:40:09.734615+0000","last_undegraded":"2023-11-04T01:40:09.734615+0000","last_fullsized":"2023-11-04T01:40:09.734615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:55:42.496852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255585+0000","last_change":"2023-11-04T01:40:09.745566+0000","last_active":"2023-11-04T01:40:11.255585+0000","last_peered":"2023-11-04T01:40:11.255585+0000","last_clean":"2023-11-04T01:40:11.255585+0000","last_became_active":"2023-11-04T01:40:09.745232+0000","last_became_peered":"2023-11-04T01:40:09.745232+0000","last_unstale":"2023-11-04T01:40:11.255585+0000","last_undegraded":"2023-11-04T01:40:11.255585+0000","last_fullsized":"2023-11-04T01:40:11.255585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:18:59.903542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734765+0000","last_change":"2023-11-04T01:40:05.566450+0000","last_active":"2023-11-04T01:40:09.734765+0000","last_peered":"2023-11-04T01:40:09.734765+0000","last_clean":"2023-11-04T01:40:09.734765+0000","last_became_active":"2023-11-04T01:40:05.565477+0000","last_became_peered":"2023-11-04T01:40:05.565477+0000","last_unstale":"2023-11-04T01:40:09.734765+0000","last_undegraded":"2023-11-04T01:40:09.734765+0000","last_fullsized":"2023-11-04T01:40:09.734765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:45:02.590707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.730048+0000","last_change":"2023-11-04T01:40:04.707185+0000","last_active":"2023-11-04T01:40:09.730048+0000","last_peered":"2023-11-04T01:40:09.730048+0000","last_clean":"2023-11-04T01:40:09.730048+0000","last_became_active":"2023-11-04T01:40:04.706814+0000","last_became_peered":"2023-11-04T01:40:04.706814+0000","last_unstale":"2023-11-04T01:40:09.730048+0000","last_undegraded":"2023-11-04T01:40:09.730048+0000","last_fullsized":"2023-11-04T01:40:09.730048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:51:08.117585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256134+0000","last_change":"2023-11-04T01:40:09.751263+0000","last_active":"2023-11-04T01:40:11.256134+0000","last_peered":"2023-11-04T01:40:11.256134+0000","last_clean":"2023-11-04T01:40:11.256134+0000","last_became_active":"2023-11-04T01:40:09.750948+0000","last_became_peered":"2023-11-04T01:40:09.750948+0000","last_unstale":"2023-11-04T01:40:11.256134+0000","last_undegraded":"2023-11-04T01:40:11.256134+0000","last_fullsized":"2023-11-04T01:40:11.256134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:14:21.977139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.736252+0000","last_change":"2023-11-04T01:40:05.562139+0000","last_active":"2023-11-04T01:40:09.736252+0000","last_peered":"2023-11-04T01:40:09.736252+0000","last_clean":"2023-11-04T01:40:09.736252+0000","last_became_active":"2023-11-04T01:40:05.561872+0000","last_became_peered":"2023-11-04T01:40:05.561872+0000","last_unstale":"2023-11-04T01:40:09.736252+0000","last_undegraded":"2023-11-04T01:40:09.736252+0000","last_fullsized":"2023-11-04T01:40:09.736252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:44:56.709670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.736987+0000","last_change":"2023-11-04T01:40:04.697746+0000","last_active":"2023-11-04T01:40:09.736987+0000","last_peered":"2023-11-04T01:40:09.736987+0000","last_clean":"2023-11-04T01:40:09.736987+0000","last_became_active":"2023-11-04T01:40:04.697469+0000","last_became_peered":"2023-11-04T01:40:04.697469+0000","last_unstale":"2023-11-04T01:40:09.736987+0000","last_undegraded":"2023-11-04T01:40:09.736987+0000","last_fullsized":"2023-11-04T01:40:09.736987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:12:07.756761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256639+0000","last_change":"2023-11-04T01:40:09.746485+0000","last_active":"2023-11-04T01:40:11.256639+0000","last_peered":"2023-11-04T01:40:11.256639+0000","last_clean":"2023-11-04T01:40:11.256639+0000","last_became_active":"2023-11-04T01:40:09.746134+0000","last_became_peered":"2023-11-04T01:40:09.746134+0000","last_unstale":"2023-11-04T01:40:11.256639+0000","last_undegraded":"2023-11-04T01:40:11.256639+0000","last_fullsized":"2023-11-04T01:40:11.256639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:25.883087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731984+0000","last_change":"2023-11-04T01:40:05.560837+0000","last_active":"2023-11-04T01:40:09.731984+0000","last_peered":"2023-11-04T01:40:09.731984+0000","last_clean":"2023-11-04T01:40:09.731984+0000","last_became_active":"2023-11-04T01:40:05.560083+0000","last_became_peered":"2023-11-04T01:40:05.560083+0000","last_unstale":"2023-11-04T01:40:09.731984+0000","last_undegraded":"2023-11-04T01:40:09.731984+0000","last_fullsized":"2023-11-04T01:40:09.731984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:45:57.550853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731654+0000","last_change":"2023-11-04T01:40:04.704308+0000","last_active":"2023-11-04T01:40:09.731654+0000","last_peered":"2023-11-04T01:40:09.731654+0000","last_clean":"2023-11-04T01:40:09.731654+0000","last_became_active":"2023-11-04T01:40:04.703783+0000","last_became_peered":"2023-11-04T01:40:04.703783+0000","last_unstale":"2023-11-04T01:40:09.731654+0000","last_undegraded":"2023-11-04T01:40:09.731654+0000","last_fullsized":"2023-11-04T01:40:09.731654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:35.223156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255849+0000","last_change":"2023-11-04T01:40:09.748878+0000","last_active":"2023-11-04T01:40:11.255849+0000","last_peered":"2023-11-04T01:40:11.255849+0000","last_clean":"2023-11-04T01:40:11.255849+0000","last_became_active":"2023-11-04T01:40:09.748399+0000","last_became_peered":"2023-11-04T01:40:09.748399+0000","last_unstale":"2023-11-04T01:40:11.255849+0000","last_undegraded":"2023-11-04T01:40:11.255849+0000","last_fullsized":"2023-11-04T01:40:11.255849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:14:21.977139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727379+0000","last_change":"2023-11-04T01:40:05.579730+0000","last_active":"2023-11-04T01:40:09.727379+0000","last_peered":"2023-11-04T01:40:09.727379+0000","last_clean":"2023-11-04T01:40:09.727379+0000","last_became_active":"2023-11-04T01:40:05.579457+0000","last_became_peered":"2023-11-04T01:40:05.579457+0000","last_unstale":"2023-11-04T01:40:09.727379+0000","last_undegraded":"2023-11-04T01:40:09.727379+0000","last_fullsized":"2023-11-04T01:40:09.727379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:09:40.586446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.728766+0000","last_change":"2023-11-04T01:40:04.707059+0000","last_active":"2023-11-04T01:40:09.728766+0000","last_peered":"2023-11-04T01:40:09.728766+0000","last_clean":"2023-11-04T01:40:09.728766+0000","last_became_active":"2023-11-04T01:40:04.706619+0000","last_became_peered":"2023-11-04T01:40:04.706619+0000","last_unstale":"2023-11-04T01:40:09.728766+0000","last_undegraded":"2023-11-04T01:40:09.728766+0000","last_fullsized":"2023-11-04T01:40:09.728766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:44:55.703672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731611+0000","last_change":"2023-11-04T01:39:54.204460+0000","last_active":"2023-11-04T01:40:09.731611+0000","last_peered":"2023-11-04T01:40:09.731611+0000","last_clean":"2023-11-04T01:40:09.731611+0000","last_became_active":"2023-11-04T01:39:54.203352+0000","last_became_peered":"2023-11-04T01:39:54.203352+0000","last_unstale":"2023-11-04T01:40:09.731611+0000","last_undegraded":"2023-11-04T01:40:09.731611+0000","last_fullsized":"2023-11-04T01:40:09.731611+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:52.627032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:52.627032+0000","last_clean_scrub_stamp":"2023-11-04T01:39:52.627032+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:17:18.474768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.550355+0000","last_change":"2023-11-04T01:40:09.744111+0000","last_active":"2023-11-04T01:40:10.550355+0000","last_peered":"2023-11-04T01:40:10.550355+0000","last_clean":"2023-11-04T01:40:10.550355+0000","last_became_active":"2023-11-04T01:40:09.743657+0000","last_became_peered":"2023-11-04T01:40:09.743657+0000","last_unstale":"2023-11-04T01:40:10.550355+0000","last_undegraded":"2023-11-04T01:40:10.550355+0000","last_fullsized":"2023-11-04T01:40:10.550355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:18:59.903542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731749+0000","last_change":"2023-11-04T01:40:05.577079+0000","last_active":"2023-11-04T01:40:09.731749+0000","last_peered":"2023-11-04T01:40:09.731749+0000","last_clean":"2023-11-04T01:40:09.731749+0000","last_became_active":"2023-11-04T01:40:05.576722+0000","last_became_peered":"2023-11-04T01:40:05.576722+0000","last_unstale":"2023-11-04T01:40:09.731749+0000","last_undegraded":"2023-11-04T01:40:09.731749+0000","last_fullsized":"2023-11-04T01:40:09.731749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:18:55.872119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.739610+0000","last_change":"2023-11-04T01:40:04.708618+0000","last_active":"2023-11-04T01:40:09.739610+0000","last_peered":"2023-11-04T01:40:09.739610+0000","last_clean":"2023-11-04T01:40:09.739610+0000","last_became_active":"2023-11-04T01:40:04.708294+0000","last_became_peered":"2023-11-04T01:40:04.708294+0000","last_unstale":"2023-11-04T01:40:09.739610+0000","last_undegraded":"2023-11-04T01:40:09.739610+0000","last_fullsized":"2023-11-04T01:40:09.739610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:58:25.853829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.549398+0000","last_change":"2023-11-04T01:40:09.743960+0000","last_active":"2023-11-04T01:40:10.549398+0000","last_peered":"2023-11-04T01:40:10.549398+0000","last_clean":"2023-11-04T01:40:10.549398+0000","last_became_active":"2023-11-04T01:40:09.743539+0000","last_became_peered":"2023-11-04T01:40:09.743539+0000","last_unstale":"2023-11-04T01:40:10.549398+0000","last_undegraded":"2023-11-04T01:40:10.549398+0000","last_fullsized":"2023-11-04T01:40:10.549398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:45:21.829187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729678+0000","last_change":"2023-11-04T01:40:05.571294+0000","last_active":"2023-11-04T01:40:09.729678+0000","last_peered":"2023-11-04T01:40:09.729678+0000","last_clean":"2023-11-04T01:40:09.729678+0000","last_became_active":"2023-11-04T01:40:05.570961+0000","last_became_peered":"2023-11-04T01:40:05.570961+0000","last_unstale":"2023-11-04T01:40:09.729678+0000","last_undegraded":"2023-11-04T01:40:09.729678+0000","last_fullsized":"2023-11-04T01:40:09.729678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:14:17.945716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734901+0000","last_change":"2023-11-04T01:40:04.700593+0000","last_active":"2023-11-04T01:40:09.734901+0000","last_peered":"2023-11-04T01:40:09.734901+0000","last_clean":"2023-11-04T01:40:09.734901+0000","last_became_active":"2023-11-04T01:40:04.700051+0000","last_became_peered":"2023-11-04T01:40:04.700051+0000","last_unstale":"2023-11-04T01:40:09.734901+0000","last_undegraded":"2023-11-04T01:40:09.734901+0000","last_fullsized":"2023-11-04T01:40:09.734901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:14:24.322290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255865+0000","last_change":"2023-11-04T01:40:09.749244+0000","last_active":"2023-11-04T01:40:11.255865+0000","last_peered":"2023-11-04T01:40:11.255865+0000","last_clean":"2023-11-04T01:40:11.255865+0000","last_became_active":"2023-11-04T01:40:09.748229+0000","last_became_peered":"2023-11-04T01:40:09.748229+0000","last_unstale":"2023-11-04T01:40:11.255865+0000","last_undegraded":"2023-11-04T01:40:11.255865+0000","last_fullsized":"2023-11-04T01:40:11.255865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:47.091874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732531+0000","last_change":"2023-11-04T01:40:05.564770+0000","last_active":"2023-11-04T01:40:09.732531+0000","last_peered":"2023-11-04T01:40:09.732531+0000","last_clean":"2023-11-04T01:40:09.732531+0000","last_became_active":"2023-11-04T01:40:05.564483+0000","last_became_peered":"2023-11-04T01:40:05.564483+0000","last_unstale":"2023-11-04T01:40:09.732531+0000","last_undegraded":"2023-11-04T01:40:09.732531+0000","last_fullsized":"2023-11-04T01:40:09.732531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:54.487437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.737108+0000","last_change":"2023-11-04T01:40:04.698832+0000","last_active":"2023-11-04T01:40:09.737108+0000","last_peered":"2023-11-04T01:40:09.737108+0000","last_clean":"2023-11-04T01:40:09.737108+0000","last_became_active":"2023-11-04T01:40:04.698498+0000","last_became_peered":"2023-11-04T01:40:04.698498+0000","last_unstale":"2023-11-04T01:40:09.737108+0000","last_undegraded":"2023-11-04T01:40:09.737108+0000","last_fullsized":"2023-11-04T01:40:09.737108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:02:39.769313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255109+0000","last_change":"2023-11-04T01:40:09.744405+0000","last_active":"2023-11-04T01:40:11.255109+0000","last_peered":"2023-11-04T01:40:11.255109+0000","last_clean":"2023-11-04T01:40:11.255109+0000","last_became_active":"2023-11-04T01:40:09.743992+0000","last_became_peered":"2023-11-04T01:40:09.743992+0000","last_unstale":"2023-11-04T01:40:11.255109+0000","last_undegraded":"2023-11-04T01:40:11.255109+0000","last_fullsized":"2023-11-04T01:40:11.255109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:23:03.976941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732033+0000","last_change":"2023-11-04T01:40:05.565058+0000","last_active":"2023-11-04T01:40:09.732033+0000","last_peered":"2023-11-04T01:40:09.732033+0000","last_clean":"2023-11-04T01:40:09.732033+0000","last_became_active":"2023-11-04T01:40:05.564784+0000","last_became_peered":"2023-11-04T01:40:05.564784+0000","last_unstale":"2023-11-04T01:40:09.732033+0000","last_undegraded":"2023-11-04T01:40:09.732033+0000","last_fullsized":"2023-11-04T01:40:09.732033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:15.017965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732789+0000","last_change":"2023-11-04T01:40:04.699612+0000","last_active":"2023-11-04T01:40:09.732789+0000","last_peered":"2023-11-04T01:40:09.732789+0000","last_clean":"2023-11-04T01:40:09.732789+0000","last_became_active":"2023-11-04T01:40:04.697978+0000","last_became_peered":"2023-11-04T01:40:04.697978+0000","last_unstale":"2023-11-04T01:40:09.732789+0000","last_undegraded":"2023-11-04T01:40:09.732789+0000","last_fullsized":"2023-11-04T01:40:09.732789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:11:00.897268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255902+0000","last_change":"2023-11-04T01:40:09.753878+0000","last_active":"2023-11-04T01:40:11.255902+0000","last_peered":"2023-11-04T01:40:11.255902+0000","last_clean":"2023-11-04T01:40:11.255902+0000","last_became_active":"2023-11-04T01:40:09.753521+0000","last_became_peered":"2023-11-04T01:40:09.753521+0000","last_unstale":"2023-11-04T01:40:11.255902+0000","last_undegraded":"2023-11-04T01:40:11.255902+0000","last_fullsized":"2023-11-04T01:40:11.255902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:21.893866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731429+0000","last_change":"2023-11-04T01:40:05.561139+0000","last_active":"2023-11-04T01:40:09.731429+0000","last_peered":"2023-11-04T01:40:09.731429+0000","last_clean":"2023-11-04T01:40:09.731429+0000","last_became_active":"2023-11-04T01:40:05.560824+0000","last_became_peered":"2023-11-04T01:40:05.560824+0000","last_unstale":"2023-11-04T01:40:09.731429+0000","last_undegraded":"2023-11-04T01:40:09.731429+0000","last_fullsized":"2023-11-04T01:40:09.731429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:32:27.484390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.736542+0000","last_change":"2023-11-04T01:40:04.704879+0000","last_active":"2023-11-04T01:40:09.736542+0000","last_peered":"2023-11-04T01:40:09.736542+0000","last_clean":"2023-11-04T01:40:09.736542+0000","last_became_active":"2023-11-04T01:40:04.704561+0000","last_became_peered":"2023-11-04T01:40:04.704561+0000","last_unstale":"2023-11-04T01:40:09.736542+0000","last_undegraded":"2023-11-04T01:40:09.736542+0000","last_fullsized":"2023-11-04T01:40:09.736542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:35.223156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256043+0000","last_change":"2023-11-04T01:40:09.743050+0000","last_active":"2023-11-04T01:40:11.256043+0000","last_peered":"2023-11-04T01:40:11.256043+0000","last_clean":"2023-11-04T01:40:11.256043+0000","last_became_active":"2023-11-04T01:40:09.742685+0000","last_became_peered":"2023-11-04T01:40:09.742685+0000","last_unstale":"2023-11-04T01:40:11.256043+0000","last_undegraded":"2023-11-04T01:40:11.256043+0000","last_fullsized":"2023-11-04T01:40:11.256043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:25.883087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.737349+0000","last_change":"2023-11-04T01:40:05.566982+0000","last_active":"2023-11-04T01:40:09.737349+0000","last_peered":"2023-11-04T01:40:09.737349+0000","last_clean":"2023-11-04T01:40:09.737349+0000","last_became_active":"2023-11-04T01:40:05.566400+0000","last_became_peered":"2023-11-04T01:40:05.566400+0000","last_unstale":"2023-11-04T01:40:09.737349+0000","last_undegraded":"2023-11-04T01:40:09.737349+0000","last_fullsized":"2023-11-04T01:40:09.737349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:24.555185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.738136+0000","last_change":"2023-11-04T01:40:04.702671+0000","last_active":"2023-11-04T01:40:09.738136+0000","last_peered":"2023-11-04T01:40:09.738136+0000","last_clean":"2023-11-04T01:40:09.738136+0000","last_became_active":"2023-11-04T01:40:04.702403+0000","last_became_peered":"2023-11-04T01:40:04.702403+0000","last_unstale":"2023-11-04T01:40:09.738136+0000","last_undegraded":"2023-11-04T01:40:09.738136+0000","last_fullsized":"2023-11-04T01:40:09.738136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:23.661606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.551245+0000","last_change":"2023-11-04T01:40:09.750337+0000","last_active":"2023-11-04T01:40:10.551245+0000","last_peered":"2023-11-04T01:40:10.551245+0000","last_clean":"2023-11-04T01:40:10.551245+0000","last_became_active":"2023-11-04T01:40:09.748314+0000","last_became_peered":"2023-11-04T01:40:09.748314+0000","last_unstale":"2023-11-04T01:40:10.551245+0000","last_undegraded":"2023-11-04T01:40:10.551245+0000","last_fullsized":"2023-11-04T01:40:10.551245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:59:19.908042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731576+0000","last_change":"2023-11-04T01:40:05.568489+0000","last_active":"2023-11-04T01:40:09.731576+0000","last_peered":"2023-11-04T01:40:09.731576+0000","last_clean":"2023-11-04T01:40:09.731576+0000","last_became_active":"2023-11-04T01:40:05.568169+0000","last_became_peered":"2023-11-04T01:40:05.568169+0000","last_unstale":"2023-11-04T01:40:09.731576+0000","last_undegraded":"2023-11-04T01:40:09.731576+0000","last_fullsized":"2023-11-04T01:40:09.731576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:45:17.797764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729951+0000","last_change":"2023-11-04T01:40:04.707560+0000","last_active":"2023-11-04T01:40:09.729951+0000","last_peered":"2023-11-04T01:40:09.729951+0000","last_clean":"2023-11-04T01:40:09.729951+0000","last_became_active":"2023-11-04T01:40:04.707230+0000","last_became_peered":"2023-11-04T01:40:04.707230+0000","last_unstale":"2023-11-04T01:40:09.729951+0000","last_undegraded":"2023-11-04T01:40:09.729951+0000","last_fullsized":"2023-11-04T01:40:09.729951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:23.549186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.551075+0000","last_change":"2023-11-04T01:40:09.750047+0000","last_active":"2023-11-04T01:40:10.551075+0000","last_peered":"2023-11-04T01:40:10.551075+0000","last_clean":"2023-11-04T01:40:10.551075+0000","last_became_active":"2023-11-04T01:40:09.749057+0000","last_became_peered":"2023-11-04T01:40:09.749057+0000","last_unstale":"2023-11-04T01:40:10.551075+0000","last_undegraded":"2023-11-04T01:40:10.551075+0000","last_fullsized":"2023-11-04T01:40:10.551075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:22:24.152135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732097+0000","last_change":"2023-11-04T01:40:05.558257+0000","last_active":"2023-11-04T01:40:09.732097+0000","last_peered":"2023-11-04T01:40:09.732097+0000","last_clean":"2023-11-04T01:40:09.732097+0000","last_became_active":"2023-11-04T01:40:05.557891+0000","last_became_peered":"2023-11-04T01:40:05.557891+0000","last_unstale":"2023-11-04T01:40:09.732097+0000","last_undegraded":"2023-11-04T01:40:09.732097+0000","last_fullsized":"2023-11-04T01:40:09.732097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:24.555185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732974+0000","last_change":"2023-11-04T01:40:04.698298+0000","last_active":"2023-11-04T01:40:09.732974+0000","last_peered":"2023-11-04T01:40:09.732974+0000","last_clean":"2023-11-04T01:40:09.732974+0000","last_became_active":"2023-11-04T01:40:04.697835+0000","last_became_peered":"2023-11-04T01:40:04.697835+0000","last_unstale":"2023-11-04T01:40:09.732974+0000","last_undegraded":"2023-11-04T01:40:09.732974+0000","last_fullsized":"2023-11-04T01:40:09.732974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:35.223156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255855+0000","last_change":"2023-11-04T01:40:09.742018+0000","last_active":"2023-11-04T01:40:11.255855+0000","last_peered":"2023-11-04T01:40:11.255855+0000","last_clean":"2023-11-04T01:40:11.255855+0000","last_became_active":"2023-11-04T01:40:09.741656+0000","last_became_peered":"2023-11-04T01:40:09.741656+0000","last_unstale":"2023-11-04T01:40:11.255855+0000","last_undegraded":"2023-11-04T01:40:11.255855+0000","last_fullsized":"2023-11-04T01:40:11.255855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:59:48.059889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731464+0000","last_change":"2023-11-04T01:40:05.561050+0000","last_active":"2023-11-04T01:40:09.731464+0000","last_peered":"2023-11-04T01:40:09.731464+0000","last_clean":"2023-11-04T01:40:09.731464+0000","last_became_active":"2023-11-04T01:40:05.560752+0000","last_became_peered":"2023-11-04T01:40:05.560752+0000","last_unstale":"2023-11-04T01:40:09.731464+0000","last_undegraded":"2023-11-04T01:40:09.731464+0000","last_fullsized":"2023-11-04T01:40:09.731464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:56.908968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:14.433786+0000","last_change":"2023-11-04T01:40:04.700840+0000","last_active":"2023-11-04T01:40:14.433786+0000","last_peered":"2023-11-04T01:40:14.433786+0000","last_clean":"2023-11-04T01:40:14.433786+0000","last_became_active":"2023-11-04T01:40:04.700524+0000","last_became_peered":"2023-11-04T01:40:04.700524+0000","last_unstale":"2023-11-04T01:40:14.433786+0000","last_undegraded":"2023-11-04T01:40:14.433786+0000","last_fullsized":"2023-11-04T01:40:14.433786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:45:56.544854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255711+0000","last_change":"2023-11-04T01:40:09.747985+0000","last_active":"2023-11-04T01:40:11.255711+0000","last_peered":"2023-11-04T01:40:11.255711+0000","last_clean":"2023-11-04T01:40:11.255711+0000","last_became_active":"2023-11-04T01:40:09.747607+0000","last_became_peered":"2023-11-04T01:40:09.747607+0000","last_unstale":"2023-11-04T01:40:11.255711+0000","last_undegraded":"2023-11-04T01:40:11.255711+0000","last_fullsized":"2023-11-04T01:40:11.255711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:19.049388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.737830+0000","last_change":"2023-11-04T01:40:05.560889+0000","last_active":"2023-11-04T01:40:09.737830+0000","last_peered":"2023-11-04T01:40:09.737830+0000","last_clean":"2023-11-04T01:40:09.737830+0000","last_became_active":"2023-11-04T01:40:05.560631+0000","last_became_peered":"2023-11-04T01:40:05.560631+0000","last_unstale":"2023-11-04T01:40:09.737830+0000","last_undegraded":"2023-11-04T01:40:09.737830+0000","last_fullsized":"2023-11-04T01:40:09.737830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:02:40.775312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734805+0000","last_change":"2023-11-04T01:40:04.708390+0000","last_active":"2023-11-04T01:40:09.734805+0000","last_peered":"2023-11-04T01:40:09.734805+0000","last_clean":"2023-11-04T01:40:09.734805+0000","last_became_active":"2023-11-04T01:40:04.708142+0000","last_became_peered":"2023-11-04T01:40:04.708142+0000","last_unstale":"2023-11-04T01:40:09.734805+0000","last_undegraded":"2023-11-04T01:40:09.734805+0000","last_fullsized":"2023-11-04T01:40:09.734805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:15:03.573413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256687+0000","last_change":"2023-11-04T01:40:09.748503+0000","last_active":"2023-11-04T01:40:11.256687+0000","last_peered":"2023-11-04T01:40:11.256687+0000","last_clean":"2023-11-04T01:40:11.256687+0000","last_became_active":"2023-11-04T01:40:09.748074+0000","last_became_peered":"2023-11-04T01:40:09.748074+0000","last_unstale":"2023-11-04T01:40:11.256687+0000","last_undegraded":"2023-11-04T01:40:11.256687+0000","last_fullsized":"2023-11-04T01:40:11.256687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:18:59.903542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734280+0000","last_change":"2023-11-04T01:40:05.578830+0000","last_active":"2023-11-04T01:40:09.734280+0000","last_peered":"2023-11-04T01:40:09.734280+0000","last_clean":"2023-11-04T01:40:09.734280+0000","last_became_active":"2023-11-04T01:40:05.578600+0000","last_became_peered":"2023-11-04T01:40:05.578600+0000","last_unstale":"2023-11-04T01:40:09.734280+0000","last_undegraded":"2023-11-04T01:40:09.734280+0000","last_fullsized":"2023-11-04T01:40:09.734280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:17.862444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729084+0000","last_change":"2023-11-04T01:40:04.712885+0000","last_active":"2023-11-04T01:40:09.729084+0000","last_peered":"2023-11-04T01:40:09.729084+0000","last_clean":"2023-11-04T01:40:09.729084+0000","last_became_active":"2023-11-04T01:40:04.712596+0000","last_became_peered":"2023-11-04T01:40:04.712596+0000","last_unstale":"2023-11-04T01:40:09.729084+0000","last_undegraded":"2023-11-04T01:40:09.729084+0000","last_fullsized":"2023-11-04T01:40:09.729084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:01.195966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.550952+0000","last_change":"2023-11-04T01:40:09.749818+0000","last_active":"2023-11-04T01:40:10.550952+0000","last_peered":"2023-11-04T01:40:10.550952+0000","last_clean":"2023-11-04T01:40:10.550952+0000","last_became_active":"2023-11-04T01:40:09.749447+0000","last_became_peered":"2023-11-04T01:40:09.749447+0000","last_unstale":"2023-11-04T01:40:10.550952+0000","last_undegraded":"2023-11-04T01:40:10.550952+0000","last_fullsized":"2023-11-04T01:40:10.550952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:14:02.598554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729015+0000","last_change":"2023-11-04T01:40:05.576921+0000","last_active":"2023-11-04T01:40:09.729015+0000","last_peered":"2023-11-04T01:40:09.729015+0000","last_clean":"2023-11-04T01:40:09.729015+0000","last_became_active":"2023-11-04T01:40:05.576105+0000","last_became_peered":"2023-11-04T01:40:05.576105+0000","last_unstale":"2023-11-04T01:40:09.729015+0000","last_undegraded":"2023-11-04T01:40:09.729015+0000","last_fullsized":"2023-11-04T01:40:09.729015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:32:27.484390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.735071+0000","last_change":"2023-11-04T01:40:04.708447+0000","last_active":"2023-11-04T01:40:09.735071+0000","last_peered":"2023-11-04T01:40:09.735071+0000","last_clean":"2023-11-04T01:40:09.735071+0000","last_became_active":"2023-11-04T01:40:04.708148+0000","last_became_peered":"2023-11-04T01:40:04.708148+0000","last_unstale":"2023-11-04T01:40:09.735071+0000","last_undegraded":"2023-11-04T01:40:09.735071+0000","last_fullsized":"2023-11-04T01:40:09.735071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:15:03.573413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.550821+0000","last_change":"2023-11-04T01:40:09.750214+0000","last_active":"2023-11-04T01:40:10.550821+0000","last_peered":"2023-11-04T01:40:10.550821+0000","last_clean":"2023-11-04T01:40:10.550821+0000","last_became_active":"2023-11-04T01:40:09.746156+0000","last_became_peered":"2023-11-04T01:40:09.746156+0000","last_unstale":"2023-11-04T01:40:10.550821+0000","last_undegraded":"2023-11-04T01:40:10.550821+0000","last_fullsized":"2023-11-04T01:40:10.550821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:59:48.059889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255702+0000","last_change":"2023-11-04T01:40:09.749952+0000","last_active":"2023-11-04T01:40:11.255702+0000","last_peered":"2023-11-04T01:40:11.255702+0000","last_clean":"2023-11-04T01:40:11.255702+0000","last_became_active":"2023-11-04T01:40:09.749363+0000","last_became_peered":"2023-11-04T01:40:09.749363+0000","last_unstale":"2023-11-04T01:40:11.255702+0000","last_undegraded":"2023-11-04T01:40:11.255702+0000","last_fullsized":"2023-11-04T01:40:11.255702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:18:59.903542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.733435+0000","last_change":"2023-11-04T01:40:05.560460+0000","last_active":"2023-11-04T01:40:09.733435+0000","last_peered":"2023-11-04T01:40:09.733435+0000","last_clean":"2023-11-04T01:40:09.733435+0000","last_became_active":"2023-11-04T01:40:05.560165+0000","last_became_peered":"2023-11-04T01:40:05.560165+0000","last_unstale":"2023-11-04T01:40:09.733435+0000","last_undegraded":"2023-11-04T01:40:09.733435+0000","last_fullsized":"2023-11-04T01:40:09.733435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:24.555185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.728844+0000","last_change":"2023-11-04T01:40:04.708233+0000","last_active":"2023-11-04T01:40:09.728844+0000","last_peered":"2023-11-04T01:40:09.728844+0000","last_clean":"2023-11-04T01:40:09.728844+0000","last_became_active":"2023-11-04T01:40:04.707913+0000","last_became_peered":"2023-11-04T01:40:04.707913+0000","last_unstale":"2023-11-04T01:40:09.728844+0000","last_undegraded":"2023-11-04T01:40:09.728844+0000","last_fullsized":"2023-11-04T01:40:09.728844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:14:24.322290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.549797+0000","last_change":"2023-11-04T01:40:09.743651+0000","last_active":"2023-11-04T01:40:10.549797+0000","last_peered":"2023-11-04T01:40:10.549797+0000","last_clean":"2023-11-04T01:40:10.549797+0000","last_became_active":"2023-11-04T01:40:09.743132+0000","last_became_peered":"2023-11-04T01:40:09.743132+0000","last_unstale":"2023-11-04T01:40:10.549797+0000","last_undegraded":"2023-11-04T01:40:10.549797+0000","last_fullsized":"2023-11-04T01:40:10.549797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:09:57.363528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727847+0000","last_change":"2023-11-04T01:40:05.568979+0000","last_active":"2023-11-04T01:40:09.727847+0000","last_peered":"2023-11-04T01:40:09.727847+0000","last_clean":"2023-11-04T01:40:09.727847+0000","last_became_active":"2023-11-04T01:40:05.568692+0000","last_became_peered":"2023-11-04T01:40:05.568692+0000","last_unstale":"2023-11-04T01:40:09.727847+0000","last_undegraded":"2023-11-04T01:40:09.727847+0000","last_fullsized":"2023-11-04T01:40:09.727847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:24.555185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727941+0000","last_change":"2023-11-04T01:40:04.703998+0000","last_active":"2023-11-04T01:40:09.727941+0000","last_peered":"2023-11-04T01:40:09.727941+0000","last_clean":"2023-11-04T01:40:09.727941+0000","last_became_active":"2023-11-04T01:40:04.703732+0000","last_became_peered":"2023-11-04T01:40:04.703732+0000","last_unstale":"2023-11-04T01:40:09.727941+0000","last_undegraded":"2023-11-04T01:40:09.727941+0000","last_fullsized":"2023-11-04T01:40:09.727941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:15:03.573413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734226+0000","last_change":"2023-11-04T01:40:04.705664+0000","last_active":"2023-11-04T01:40:09.734226+0000","last_peered":"2023-11-04T01:40:09.734226+0000","last_clean":"2023-11-04T01:40:09.734226+0000","last_became_active":"2023-11-04T01:40:04.705126+0000","last_became_peered":"2023-11-04T01:40:04.705126+0000","last_unstale":"2023-11-04T01:40:09.734226+0000","last_undegraded":"2023-11-04T01:40:09.734226+0000","last_fullsized":"2023-11-04T01:40:09.734226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:55:42.496852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732896+0000","last_change":"2023-11-04T01:40:05.560706+0000","last_active":"2023-11-04T01:40:09.732896+0000","last_peered":"2023-11-04T01:40:09.732896+0000","last_clean":"2023-11-04T01:40:09.732896+0000","last_became_active":"2023-11-04T01:40:05.560192+0000","last_became_peered":"2023-11-04T01:40:05.560192+0000","last_unstale":"2023-11-04T01:40:09.732896+0000","last_undegraded":"2023-11-04T01:40:09.732896+0000","last_fullsized":"2023-11-04T01:40:09.732896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:02.182321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255328+0000","last_change":"2023-11-04T01:40:09.754009+0000","last_active":"2023-11-04T01:40:11.255328+0000","last_peered":"2023-11-04T01:40:11.255328+0000","last_clean":"2023-11-04T01:40:11.255328+0000","last_became_active":"2023-11-04T01:40:09.753444+0000","last_became_peered":"2023-11-04T01:40:09.753444+0000","last_unstale":"2023-11-04T01:40:11.255328+0000","last_undegraded":"2023-11-04T01:40:11.255328+0000","last_fullsized":"2023-11-04T01:40:11.255328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:01.582276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727803+0000","last_change":"2023-11-04T01:40:04.701551+0000","last_active":"2023-11-04T01:40:09.727803+0000","last_peered":"2023-11-04T01:40:09.727803+0000","last_clean":"2023-11-04T01:40:09.727803+0000","last_became_active":"2023-11-04T01:40:04.701340+0000","last_became_peered":"2023-11-04T01:40:04.701340+0000","last_unstale":"2023-11-04T01:40:09.727803+0000","last_undegraded":"2023-11-04T01:40:09.727803+0000","last_fullsized":"2023-11-04T01:40:09.727803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:45:01.584709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.736946+0000","last_change":"2023-11-04T01:40:05.564231+0000","last_active":"2023-11-04T01:40:09.736946+0000","last_peered":"2023-11-04T01:40:09.736946+0000","last_clean":"2023-11-04T01:40:09.736946+0000","last_became_active":"2023-11-04T01:40:05.563931+0000","last_became_peered":"2023-11-04T01:40:05.563931+0000","last_unstale":"2023-11-04T01:40:09.736946+0000","last_undegraded":"2023-11-04T01:40:09.736946+0000","last_fullsized":"2023-11-04T01:40:09.736946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:25:21.992534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.551057+0000","last_change":"2023-11-04T01:40:09.744711+0000","last_active":"2023-11-04T01:40:10.551057+0000","last_peered":"2023-11-04T01:40:10.551057+0000","last_clean":"2023-11-04T01:40:10.551057+0000","last_became_active":"2023-11-04T01:40:09.744338+0000","last_became_peered":"2023-11-04T01:40:09.744338+0000","last_unstale":"2023-11-04T01:40:10.551057+0000","last_undegraded":"2023-11-04T01:40:10.551057+0000","last_fullsized":"2023-11-04T01:40:10.551057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:49:35.523050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.737269+0000","last_change":"2023-11-04T01:40:05.567145+0000","last_active":"2023-11-04T01:40:09.737269+0000","last_peered":"2023-11-04T01:40:09.737269+0000","last_clean":"2023-11-04T01:40:09.737269+0000","last_became_active":"2023-11-04T01:40:05.566731+0000","last_became_peered":"2023-11-04T01:40:05.566731+0000","last_unstale":"2023-11-04T01:40:09.737269+0000","last_undegraded":"2023-11-04T01:40:09.737269+0000","last_fullsized":"2023-11-04T01:40:09.737269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:51:09.123583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.736001+0000","last_change":"2023-11-04T01:40:05.579375+0000","last_active":"2023-11-04T01:40:09.736001+0000","last_peered":"2023-11-04T01:40:09.736001+0000","last_clean":"2023-11-04T01:40:09.736001+0000","last_became_active":"2023-11-04T01:40:05.579083+0000","last_became_peered":"2023-11-04T01:40:05.579083+0000","last_unstale":"2023-11-04T01:40:09.736001+0000","last_undegraded":"2023-11-04T01:40:09.736001+0000","last_fullsized":"2023-11-04T01:40:09.736001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:25:21.992534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729856+0000","last_change":"2023-11-04T01:40:05.577656+0000","last_active":"2023-11-04T01:40:09.729856+0000","last_peered":"2023-11-04T01:40:09.729856+0000","last_clean":"2023-11-04T01:40:09.729856+0000","last_became_active":"2023-11-04T01:40:05.577375+0000","last_became_peered":"2023-11-04T01:40:05.577375+0000","last_unstale":"2023-11-04T01:40:09.729856+0000","last_undegraded":"2023-11-04T01:40:09.729856+0000","last_fullsized":"2023-11-04T01:40:09.729856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:46:18.951640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732817+0000","last_change":"2023-11-04T01:40:05.562307+0000","last_active":"2023-11-04T01:40:09.732817+0000","last_peered":"2023-11-04T01:40:09.732817+0000","last_clean":"2023-11-04T01:40:09.732817+0000","last_became_active":"2023-11-04T01:40:05.562060+0000","last_became_peered":"2023-11-04T01:40:05.562060+0000","last_unstale":"2023-11-04T01:40:09.732817+0000","last_undegraded":"2023-11-04T01:40:09.732817+0000","last_fullsized":"2023-11-04T01:40:09.732817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:09:40.586446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.728326+0000","last_change":"2023-11-04T01:40:05.565815+0000","last_active":"2023-11-04T01:40:09.728326+0000","last_peered":"2023-11-04T01:40:09.728326+0000","last_clean":"2023-11-04T01:40:09.728326+0000","last_became_active":"2023-11-04T01:40:05.565356+0000","last_became_peered":"2023-11-04T01:40:05.565356+0000","last_unstale":"2023-11-04T01:40:09.728326+0000","last_undegraded":"2023-11-04T01:40:09.728326+0000","last_fullsized":"2023-11-04T01:40:09.728326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:46:18.951640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734702+0000","last_change":"2023-11-04T01:40:05.560477+0000","last_active":"2023-11-04T01:40:09.734702+0000","last_peered":"2023-11-04T01:40:09.734702+0000","last_clean":"2023-11-04T01:40:09.734702+0000","last_became_active":"2023-11-04T01:40:05.560213+0000","last_became_peered":"2023-11-04T01:40:05.560213+0000","last_unstale":"2023-11-04T01:40:09.734702+0000","last_undegraded":"2023-11-04T01:40:09.734702+0000","last_fullsized":"2023-11-04T01:40:09.734702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:02.182321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.735601+0000","last_change":"2023-11-04T01:40:05.562260+0000","last_active":"2023-11-04T01:40:09.735601+0000","last_peered":"2023-11-04T01:40:09.735601+0000","last_clean":"2023-11-04T01:40:09.735601+0000","last_became_active":"2023-11-04T01:40:05.561788+0000","last_became_peered":"2023-11-04T01:40:05.561788+0000","last_unstale":"2023-11-04T01:40:09.735601+0000","last_undegraded":"2023-11-04T01:40:09.735601+0000","last_fullsized":"2023-11-04T01:40:09.735601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:46:18.951640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.728083+0000","last_change":"2023-11-04T01:40:05.565701+0000","last_active":"2023-11-04T01:40:09.728083+0000","last_peered":"2023-11-04T01:40:09.728083+0000","last_clean":"2023-11-04T01:40:09.728083+0000","last_became_active":"2023-11-04T01:40:05.565414+0000","last_became_peered":"2023-11-04T01:40:05.565414+0000","last_unstale":"2023-11-04T01:40:09.728083+0000","last_undegraded":"2023-11-04T01:40:09.728083+0000","last_fullsized":"2023-11-04T01:40:09.728083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:35:55.027288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.728758+0000","last_change":"2023-11-04T01:40:05.578120+0000","last_active":"2023-11-04T01:40:09.728758+0000","last_peered":"2023-11-04T01:40:09.728758+0000","last_clean":"2023-11-04T01:40:09.728758+0000","last_became_active":"2023-11-04T01:40:05.576353+0000","last_became_peered":"2023-11-04T01:40:05.576353+0000","last_unstale":"2023-11-04T01:40:09.728758+0000","last_undegraded":"2023-11-04T01:40:09.728758+0000","last_fullsized":"2023-11-04T01:40:09.728758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:43.060452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727831+0000","last_change":"2023-11-04T01:40:05.565797+0000","last_active":"2023-11-04T01:40:09.727831+0000","last_peered":"2023-11-04T01:40:09.727831+0000","last_clean":"2023-11-04T01:40:09.727831+0000","last_became_active":"2023-11-04T01:40:05.565341+0000","last_became_peered":"2023-11-04T01:40:05.565341+0000","last_unstale":"2023-11-04T01:40:09.727831+0000","last_undegraded":"2023-11-04T01:40:09.727831+0000","last_fullsized":"2023-11-04T01:40:09.727831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:51:09.123583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.730213+0000","last_change":"2023-11-04T01:40:05.576354+0000","last_active":"2023-11-04T01:40:09.730213+0000","last_peered":"2023-11-04T01:40:09.730213+0000","last_clean":"2023-11-04T01:40:09.730213+0000","last_became_active":"2023-11-04T01:40:05.576041+0000","last_became_peered":"2023-11-04T01:40:05.576041+0000","last_unstale":"2023-11-04T01:40:09.730213+0000","last_undegraded":"2023-11-04T01:40:09.730213+0000","last_fullsized":"2023-11-04T01:40:09.730213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:17.862444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732728+0000","last_change":"2023-11-04T01:40:05.558627+0000","last_active":"2023-11-04T01:40:09.732728+0000","last_peered":"2023-11-04T01:40:09.732728+0000","last_clean":"2023-11-04T01:40:09.732728+0000","last_became_active":"2023-11-04T01:40:05.558323+0000","last_became_peered":"2023-11-04T01:40:05.558323+0000","last_unstale":"2023-11-04T01:40:09.732728+0000","last_undegraded":"2023-11-04T01:40:09.732728+0000","last_fullsized":"2023-11-04T01:40:09.732728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:02.201965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.735029+0000","last_change":"2023-11-04T01:40:05.565842+0000","last_active":"2023-11-04T01:40:09.735029+0000","last_peered":"2023-11-04T01:40:09.735029+0000","last_clean":"2023-11-04T01:40:09.735029+0000","last_became_active":"2023-11-04T01:40:05.565557+0000","last_became_peered":"2023-11-04T01:40:05.565557+0000","last_unstale":"2023-11-04T01:40:09.735029+0000","last_undegraded":"2023-11-04T01:40:09.735029+0000","last_fullsized":"2023-11-04T01:40:09.735029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:02.182321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732064+0000","last_change":"2023-11-04T01:40:05.557783+0000","last_active":"2023-11-04T01:40:09.732064+0000","last_peered":"2023-11-04T01:40:09.732064+0000","last_clean":"2023-11-04T01:40:09.732064+0000","last_became_active":"2023-11-04T01:40:05.557468+0000","last_became_peered":"2023-11-04T01:40:05.557468+0000","last_unstale":"2023-11-04T01:40:09.732064+0000","last_undegraded":"2023-11-04T01:40:09.732064+0000","last_fullsized":"2023-11-04T01:40:09.732064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:21.851664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.737029+0000","last_change":"2023-11-04T01:40:05.559446+0000","last_active":"2023-11-04T01:40:09.737029+0000","last_peered":"2023-11-04T01:40:09.737029+0000","last_clean":"2023-11-04T01:40:09.737029+0000","last_became_active":"2023-11-04T01:40:05.559182+0000","last_became_peered":"2023-11-04T01:40:05.559182+0000","last_unstale":"2023-11-04T01:40:09.737029+0000","last_undegraded":"2023-11-04T01:40:09.737029+0000","last_fullsized":"2023-11-04T01:40:09.737029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:45:02.590707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.730805+0000","last_change":"2023-11-04T01:40:05.577084+0000","last_active":"2023-11-04T01:40:09.730805+0000","last_peered":"2023-11-04T01:40:09.730805+0000","last_clean":"2023-11-04T01:40:09.730805+0000","last_became_active":"2023-11-04T01:40:05.576079+0000","last_became_peered":"2023-11-04T01:40:05.576079+0000","last_unstale":"2023-11-04T01:40:09.730805+0000","last_undegraded":"2023-11-04T01:40:09.730805+0000","last_fullsized":"2023-11-04T01:40:09.730805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:18:55.872119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.728665+0000","last_change":"2023-11-04T01:40:05.577325+0000","last_active":"2023-11-04T01:40:09.728665+0000","last_peered":"2023-11-04T01:40:09.728665+0000","last_clean":"2023-11-04T01:40:09.728665+0000","last_became_active":"2023-11-04T01:40:05.576140+0000","last_became_peered":"2023-11-04T01:40:05.576140+0000","last_unstale":"2023-11-04T01:40:09.728665+0000","last_undegraded":"2023-11-04T01:40:09.728665+0000","last_fullsized":"2023-11-04T01:40:09.728665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:15.017965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.733522+0000","last_change":"2023-11-04T01:40:05.564247+0000","last_active":"2023-11-04T01:40:09.733522+0000","last_peered":"2023-11-04T01:40:09.733522+0000","last_clean":"2023-11-04T01:40:09.733522+0000","last_became_active":"2023-11-04T01:40:05.563816+0000","last_became_peered":"2023-11-04T01:40:05.563816+0000","last_unstale":"2023-11-04T01:40:09.733522+0000","last_undegraded":"2023-11-04T01:40:09.733522+0000","last_fullsized":"2023-11-04T01:40:09.733522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:51:09.123583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732014+0000","last_change":"2023-11-04T01:40:05.556907+0000","last_active":"2023-11-04T01:40:09.732014+0000","last_peered":"2023-11-04T01:40:09.732014+0000","last_clean":"2023-11-04T01:40:09.732014+0000","last_became_active":"2023-11-04T01:40:05.556614+0000","last_became_peered":"2023-11-04T01:40:05.556614+0000","last_unstale":"2023-11-04T01:40:09.732014+0000","last_undegraded":"2023-11-04T01:40:09.732014+0000","last_fullsized":"2023-11-04T01:40:09.732014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:15:04.579412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727610+0000","last_change":"2023-11-04T01:40:05.561125+0000","last_active":"2023-11-04T01:40:09.727610+0000","last_peered":"2023-11-04T01:40:09.727610+0000","last_clean":"2023-11-04T01:40:09.727610+0000","last_became_active":"2023-11-04T01:40:05.560864+0000","last_became_peered":"2023-11-04T01:40:05.560864+0000","last_unstale":"2023-11-04T01:40:09.727610+0000","last_undegraded":"2023-11-04T01:40:09.727610+0000","last_fullsized":"2023-11-04T01:40:09.727610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:02.182321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.737747+0000","last_change":"2023-11-04T01:40:05.568756+0000","last_active":"2023-11-04T01:40:09.737747+0000","last_peered":"2023-11-04T01:40:09.737747+0000","last_clean":"2023-11-04T01:40:09.737747+0000","last_became_active":"2023-11-04T01:40:05.568238+0000","last_became_peered":"2023-11-04T01:40:05.568238+0000","last_unstale":"2023-11-04T01:40:09.737747+0000","last_undegraded":"2023-11-04T01:40:09.737747+0000","last_fullsized":"2023-11-04T01:40:09.737747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:36.229155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734018+0000","last_change":"2023-11-04T01:40:05.580104+0000","last_active":"2023-11-04T01:40:09.734018+0000","last_peered":"2023-11-04T01:40:09.734018+0000","last_clean":"2023-11-04T01:40:09.734018+0000","last_became_active":"2023-11-04T01:40:05.579830+0000","last_became_peered":"2023-11-04T01:40:05.579830+0000","last_unstale":"2023-11-04T01:40:09.734018+0000","last_undegraded":"2023-11-04T01:40:09.734018+0000","last_fullsized":"2023-11-04T01:40:09.734018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:09:40.586446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.735529+0000","last_change":"2023-11-04T01:40:05.577828+0000","last_active":"2023-11-04T01:40:09.735529+0000","last_peered":"2023-11-04T01:40:09.735529+0000","last_clean":"2023-11-04T01:40:09.735529+0000","last_became_active":"2023-11-04T01:40:05.577524+0000","last_became_peered":"2023-11-04T01:40:05.577524+0000","last_unstale":"2023-11-04T01:40:09.735529+0000","last_undegraded":"2023-11-04T01:40:09.735529+0000","last_fullsized":"2023-11-04T01:40:09.735529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:17.862444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732444+0000","last_change":"2023-11-04T01:40:05.578036+0000","last_active":"2023-11-04T01:40:09.732444+0000","last_peered":"2023-11-04T01:40:09.732444+0000","last_clean":"2023-11-04T01:40:09.732444+0000","last_became_active":"2023-11-04T01:40:05.577711+0000","last_became_peered":"2023-11-04T01:40:05.577711+0000","last_unstale":"2023-11-04T01:40:09.732444+0000","last_undegraded":"2023-11-04T01:40:09.732444+0000","last_fullsized":"2023-11-04T01:40:09.732444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:43.060452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727075+0000","last_change":"2023-11-04T01:40:05.576720+0000","last_active":"2023-11-04T01:40:09.727075+0000","last_peered":"2023-11-04T01:40:09.727075+0000","last_clean":"2023-11-04T01:40:09.727075+0000","last_became_active":"2023-11-04T01:40:05.576465+0000","last_became_peered":"2023-11-04T01:40:05.576465+0000","last_unstale":"2023-11-04T01:40:09.727075+0000","last_undegraded":"2023-11-04T01:40:09.727075+0000","last_fullsized":"2023-11-04T01:40:09.727075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:02.201965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731346+0000","last_change":"2023-11-04T01:40:05.561827+0000","last_active":"2023-11-04T01:40:09.731346+0000","last_peered":"2023-11-04T01:40:09.731346+0000","last_clean":"2023-11-04T01:40:09.731346+0000","last_became_active":"2023-11-04T01:40:05.560891+0000","last_became_peered":"2023-11-04T01:40:05.560891+0000","last_unstale":"2023-11-04T01:40:09.731346+0000","last_undegraded":"2023-11-04T01:40:09.731346+0000","last_fullsized":"2023-11-04T01:40:09.731346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:35:55.027288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729758+0000","last_change":"2023-11-04T01:40:05.577149+0000","last_active":"2023-11-04T01:40:09.729758+0000","last_peered":"2023-11-04T01:40:09.729758+0000","last_clean":"2023-11-04T01:40:09.729758+0000","last_became_active":"2023-11-04T01:40:05.576800+0000","last_became_peered":"2023-11-04T01:40:05.576800+0000","last_unstale":"2023-11-04T01:40:09.729758+0000","last_undegraded":"2023-11-04T01:40:09.729758+0000","last_fullsized":"2023-11-04T01:40:09.729758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:02.182321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731574+0000","last_change":"2023-11-04T01:40:05.557217+0000","last_active":"2023-11-04T01:40:09.731574+0000","last_peered":"2023-11-04T01:40:09.731574+0000","last_clean":"2023-11-04T01:40:09.731574+0000","last_became_active":"2023-11-04T01:40:05.556849+0000","last_became_peered":"2023-11-04T01:40:05.556849+0000","last_unstale":"2023-11-04T01:40:09.731574+0000","last_undegraded":"2023-11-04T01:40:09.731574+0000","last_fullsized":"2023-11-04T01:40:09.731574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:09:53.332106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729505+0000","last_change":"2023-11-04T01:40:05.579108+0000","last_active":"2023-11-04T01:40:09.729505+0000","last_peered":"2023-11-04T01:40:09.729505+0000","last_clean":"2023-11-04T01:40:09.729505+0000","last_became_active":"2023-11-04T01:40:05.578820+0000","last_became_peered":"2023-11-04T01:40:05.578820+0000","last_unstale":"2023-11-04T01:40:09.729505+0000","last_undegraded":"2023-11-04T01:40:09.729505+0000","last_fullsized":"2023-11-04T01:40:09.729505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:45:17.797764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.733836+0000","last_change":"2023-11-04T01:40:05.560589+0000","last_active":"2023-11-04T01:40:09.733836+0000","last_peered":"2023-11-04T01:40:09.733836+0000","last_clean":"2023-11-04T01:40:09.733836+0000","last_became_active":"2023-11-04T01:40:05.559671+0000","last_became_peered":"2023-11-04T01:40:05.559671+0000","last_unstale":"2023-11-04T01:40:09.733836+0000","last_undegraded":"2023-11-04T01:40:09.733836+0000","last_fullsized":"2023-11-04T01:40:09.733836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:14:25.328288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734422+0000","last_change":"2023-11-04T01:40:05.564381+0000","last_active":"2023-11-04T01:40:09.734422+0000","last_peered":"2023-11-04T01:40:09.734422+0000","last_clean":"2023-11-04T01:40:09.734422+0000","last_became_active":"2023-11-04T01:40:05.564046+0000","last_became_peered":"2023-11-04T01:40:05.564046+0000","last_unstale":"2023-11-04T01:40:09.734422+0000","last_undegraded":"2023-11-04T01:40:09.734422+0000","last_fullsized":"2023-11-04T01:40:09.734422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:17.862444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732359+0000","last_change":"2023-11-04T01:40:05.561850+0000","last_active":"2023-11-04T01:40:09.732359+0000","last_peered":"2023-11-04T01:40:09.732359+0000","last_clean":"2023-11-04T01:40:09.732359+0000","last_became_active":"2023-11-04T01:40:05.561463+0000","last_became_peered":"2023-11-04T01:40:05.561463+0000","last_unstale":"2023-11-04T01:40:09.732359+0000","last_undegraded":"2023-11-04T01:40:09.732359+0000","last_fullsized":"2023-11-04T01:40:09.732359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:14:17.945716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]}]},{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":101853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":99918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":99792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":99952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":689779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:40:23.521 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:40:23.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.650+0000 7f52705ce640 1 Processor -- start 2023-11-04T01:40:23.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.650+0000 7f52705ce640 1 -- start start 2023-11-04T01:40:23.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.651+0000 7f52705ce640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f526815ae40 0x7f526815bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:23.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.651+0000 7f52705ce640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f52680cbc00 0x7f52680cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:23.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.651+0000 7f52705ce640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52680cc450 con 0x7f52680cd860 2023-11-04T01:40:23.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.651+0000 7f52705ce640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f526815f400 con 0x7f52680cbc00 2023-11-04T01:40:23.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.651+0000 7f52705ce640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f526815b220 con 0x7f526815ae40 2023-11-04T01:40:23.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.652+0000 7f526db69640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f52680cbc00 0x7f52680cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:23.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.652+0000 7f526db69640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f52680cbc00 0x7f52680cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56710/0 (socket says 172.21.15.77:56710) 2023-11-04T01:40:23.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.652+0000 7f526db69640 1 -- 172.21.15.77:0/4151417838 learned_addr learned my addr 172.21.15.77:0/4151417838 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:23.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.652+0000 7f526e36a640 1 --2- 172.21.15.77:0/4151417838 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f526815ae40 0x7f526815bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:23.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.652+0000 7f526db69640 1 -- 172.21.15.77:0/4151417838 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f526815ae40 msgr2=0x7f526815bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:23.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.652+0000 7f526db69640 1 --2- 172.21.15.77:0/4151417838 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f526815ae40 0x7f526815bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.652+0000 7f526db69640 1 -- 172.21.15.77:0/4151417838 >> v1:172.21.15.122:6789/0 conn(0x7f52680cd860 legacy=0x7f52680b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:23.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.652+0000 7f526db69640 1 -- 172.21.15.77:0/4151417838 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526815f890 con 0x7f52680cbc00 2023-11-04T01:40:23.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.653+0000 7f526db69640 1 --2- 172.21.15.77:0/4151417838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52680cbc00 0x7f52680cd320 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5258009870 tx=0x7f525802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5996a7fdfdd4ef server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:23.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.653+0000 7f526d368640 1 -- 172.21.15.77:0/4151417838 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5258030840 con 0x7f52680cbc00 2023-11-04T01:40:23.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.653+0000 7f526d368640 1 -- 172.21.15.77:0/4151417838 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52580309a0 con 0x7f52680cbc00 2023-11-04T01:40:23.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.653+0000 7f526d368640 1 -- 172.21.15.77:0/4151417838 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5258030d30 con 0x7f52680cbc00 2023-11-04T01:40:23.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.653+0000 7f52705ce640 1 -- 172.21.15.77:0/4151417838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52680cbc00 msgr2=0x7f52680cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:23.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.653+0000 7f52705ce640 1 --2- 172.21.15.77:0/4151417838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52680cbc00 0x7f52680cd320 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5258009870 tx=0x7f525802b980 comp rx=0 tx=0).stop 2023-11-04T01:40:23.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.653+0000 7f52705ce640 1 -- 172.21.15.77:0/4151417838 shutdown_connections 2023-11-04T01:40:23.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.653+0000 7f52705ce640 1 --2- 172.21.15.77:0/4151417838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52680cbc00 0x7f52680cd320 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.653+0000 7f52705ce640 1 --2- 172.21.15.77:0/4151417838 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f526815ae40 0x7f526815bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.653+0000 7f52705ce640 1 -- 172.21.15.77:0/4151417838 >> 172.21.15.77:0/4151417838 conn(0x7f526806ea90 msgr2=0x7f526806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:23.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.653+0000 7f52705ce640 1 -- 172.21.15.77:0/4151417838 shutdown_connections 2023-11-04T01:40:23.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.653+0000 7f52705ce640 1 -- 172.21.15.77:0/4151417838 wait complete. 2023-11-04T01:40:23.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.654+0000 7f52705ce640 1 Processor -- start 2023-11-04T01:40:23.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.655+0000 7f52705ce640 1 -- start start 2023-11-04T01:40:23.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.655+0000 7f52705ce640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f52680cbc00 0x7f526806c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:23.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.655+0000 7f52705ce640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52680cd860 0x7f52680c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:23.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.655+0000 7f52705ce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f526815ae40 0x7f52680ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:23.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.655+0000 7f52705ce640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52680c7e10 con 0x7f526815ae40 2023-11-04T01:40:23.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.655+0000 7f52705ce640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52680c80f0 con 0x7f52680cd860 2023-11-04T01:40:23.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.655+0000 7f52705ce640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52680c83d0 con 0x7f52680cbc00 2023-11-04T01:40:23.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.655+0000 7f526eb6b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f526815ae40 0x7f52680ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:23.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.655+0000 7f526eb6b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f526815ae40 0x7f52680ca2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56718/0 (socket says 172.21.15.77:56718) 2023-11-04T01:40:23.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.655+0000 7f526eb6b640 1 -- 172.21.15.77:0/1678005690 learned_addr learned my addr 172.21.15.77:0/1678005690 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:23.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.655+0000 7f526e36a640 1 --2- 172.21.15.77:0/1678005690 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f52680cbc00 0x7f526806c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:23.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.655+0000 7f526db69640 1 --2- 172.21.15.77:0/1678005690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52680cd860 0x7f52680c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:23.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.656+0000 7f526eb6b640 1 -- 172.21.15.77:0/1678005690 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f52680cbc00 msgr2=0x7f526806c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:23.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.656+0000 7f526eb6b640 1 --2- 172.21.15.77:0/1678005690 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f52680cbc00 0x7f526806c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.656+0000 7f526eb6b640 1 -- 172.21.15.77:0/1678005690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52680cd860 msgr2=0x7f52680c6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:23.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.656+0000 7f526eb6b640 1 --2- 172.21.15.77:0/1678005690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52680cd860 0x7f52680c6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.656+0000 7f526eb6b640 1 -- 172.21.15.77:0/1678005690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52580094d0 con 0x7f526815ae40 2023-11-04T01:40:23.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.656+0000 7f526eb6b640 1 --2- 172.21.15.77:0/1678005690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f526815ae40 0x7f52680ca2b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f526000c7a0 tx=0x7f526000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:23.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.656+0000 7f525effd640 1 -- 172.21.15.77:0/1678005690 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5260003b70 con 0x7f526815ae40 2023-11-04T01:40:23.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.656+0000 7f525effd640 1 -- 172.21.15.77:0/1678005690 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5260003cf0 con 0x7f526815ae40 2023-11-04T01:40:23.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.656+0000 7f52705ce640 1 -- 172.21.15.77:0/1678005690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52680c9d90 con 0x7f526815ae40 2023-11-04T01:40:23.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.656+0000 7f525effd640 1 -- 172.21.15.77:0/1678005690 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5260003ea0 con 0x7f526815ae40 2023-11-04T01:40:23.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.656+0000 7f52705ce640 1 -- 172.21.15.77:0/1678005690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5268156000 con 0x7f526815ae40 2023-11-04T01:40:23.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.657+0000 7f52705ce640 1 -- 172.21.15.77:0/1678005690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52680ce2d0 con 0x7f526815ae40 2023-11-04T01:40:23.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.657+0000 7f525effd640 1 -- 172.21.15.77:0/1678005690 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f526000aa90 con 0x7f526815ae40 2023-11-04T01:40:23.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.658+0000 7f525effd640 1 --2- 172.21.15.77:0/1678005690 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f524c06aea0 0x7f524c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:23.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.658+0000 7f525effd640 1 -- 172.21.15.77:0/1678005690 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5260089410 con 0x7f526815ae40 2023-11-04T01:40:23.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.658+0000 7f526e36a640 1 --2- 172.21.15.77:0/1678005690 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f524c06aea0 0x7f524c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:23.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.658+0000 7f526e36a640 1 --2- 172.21.15.77:0/1678005690 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f524c06aea0 0x7f524c06d360 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5264006fd0 tx=0x7f5264008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:23.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.662+0000 7f525effd640 1 -- 172.21.15.77:0/1678005690 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5260054280 con 0x7f526815ae40 2023-11-04T01:40:23.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.823+0000 7f52705ce640 1 -- 172.21.15.77:0/1678005690 --> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f526815ead0 con 0x7f524c06aea0 2023-11-04T01:40:23.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.832+0000 7f525effd640 1 -- 172.21.15.77:0/1678005690 <== mgr.4123 v2:172.21.15.122:6832/2275325762 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345285 (secure 0 0 0) 0x7f5264010990 con 0x7f524c06aea0 2023-11-04T01:40:23.837 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:23.839 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-04T01:40:23.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.835+0000 7f52705ce640 1 -- 172.21.15.77:0/1678005690 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f524c06aea0 msgr2=0x7f524c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:23.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.835+0000 7f52705ce640 1 --2- 172.21.15.77:0/1678005690 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f524c06aea0 0x7f524c06d360 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5264006fd0 tx=0x7f5264008040 comp rx=0 tx=0).stop 2023-11-04T01:40:23.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.835+0000 7f52705ce640 1 -- 172.21.15.77:0/1678005690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f526815ae40 msgr2=0x7f52680ca2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:23.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.835+0000 7f52705ce640 1 --2- 172.21.15.77:0/1678005690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f526815ae40 0x7f52680ca2b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f526000c7a0 tx=0x7f526000cc60 comp rx=0 tx=0).stop 2023-11-04T01:40:23.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.835+0000 7f52705ce640 1 -- 172.21.15.77:0/1678005690 shutdown_connections 2023-11-04T01:40:23.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.835+0000 7f52705ce640 1 --2- 172.21.15.77:0/1678005690 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f524c06aea0 0x7f524c06d360 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.835+0000 7f52705ce640 1 --2- 172.21.15.77:0/1678005690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f526815ae40 0x7f52680ca2b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.835+0000 7f52705ce640 1 --2- 172.21.15.77:0/1678005690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52680cd860 0x7f52680c6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.835+0000 7f52705ce640 1 --2- 172.21.15.77:0/1678005690 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f52680cbc00 0x7f526806c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.835+0000 7f52705ce640 1 -- 172.21.15.77:0/1678005690 >> 172.21.15.77:0/1678005690 conn(0x7f526806ea90 msgr2=0x7f5268159440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:23.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.835+0000 7f52705ce640 1 -- 172.21.15.77:0/1678005690 shutdown_connections 2023-11-04T01:40:23.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.836+0000 7f52705ce640 1 -- 172.21.15.77:0/1678005690 wait complete. 2023-11-04T01:40:23.848 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2023-11-04T01:40:23.629941+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219356,"kb_used_data":3204,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755364,"statfs":{"total":773094113280,"available":772869492736,"internally_reserved":0,"allocated":3280896,"data_stored":1987333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003622"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734371+0000","last_change":"2023-11-04T01:40:04.705196+0000","last_active":"2023-11-04T01:40:09.734371+0000","last_peered":"2023-11-04T01:40:09.734371+0000","last_clean":"2023-11-04T01:40:09.734371+0000","last_became_active":"2023-11-04T01:40:04.704925+0000","last_became_peered":"2023-11-04T01:40:04.704925+0000","last_unstale":"2023-11-04T01:40:09.734371+0000","last_undegraded":"2023-11-04T01:40:09.734371+0000","last_fullsized":"2023-11-04T01:40:09.734371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:23.661606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727344+0000","last_change":"2023-11-04T01:40:05.561233+0000","last_active":"2023-11-04T01:40:09.727344+0000","last_peered":"2023-11-04T01:40:09.727344+0000","last_clean":"2023-11-04T01:40:09.727344+0000","last_became_active":"2023-11-04T01:40:05.560936+0000","last_became_peered":"2023-11-04T01:40:05.560936+0000","last_unstale":"2023-11-04T01:40:09.727344+0000","last_undegraded":"2023-11-04T01:40:09.727344+0000","last_fullsized":"2023-11-04T01:40:09.727344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:32:27.484390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.550542+0000","last_change":"2023-11-04T01:40:09.743799+0000","last_active":"2023-11-04T01:40:10.550542+0000","last_peered":"2023-11-04T01:40:10.550542+0000","last_clean":"2023-11-04T01:40:10.550542+0000","last_became_active":"2023-11-04T01:40:09.743430+0000","last_became_peered":"2023-11-04T01:40:09.743430+0000","last_unstale":"2023-11-04T01:40:10.550542+0000","last_undegraded":"2023-11-04T01:40:10.550542+0000","last_fullsized":"2023-11-04T01:40:10.550542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:23:03.976941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727438+0000","last_change":"2023-11-04T01:40:04.697166+0000","last_active":"2023-11-04T01:40:09.727438+0000","last_peered":"2023-11-04T01:40:09.727438+0000","last_clean":"2023-11-04T01:40:09.727438+0000","last_became_active":"2023-11-04T01:40:04.696343+0000","last_became_peered":"2023-11-04T01:40:04.696343+0000","last_unstale":"2023-11-04T01:40:09.727438+0000","last_undegraded":"2023-11-04T01:40:09.727438+0000","last_fullsized":"2023-11-04T01:40:09.727438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:45:56.544854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734207+0000","last_change":"2023-11-04T01:40:05.578729+0000","last_active":"2023-11-04T01:40:09.734207+0000","last_peered":"2023-11-04T01:40:09.734207+0000","last_clean":"2023-11-04T01:40:09.734207+0000","last_became_active":"2023-11-04T01:40:05.578510+0000","last_became_peered":"2023-11-04T01:40:05.578510+0000","last_unstale":"2023-11-04T01:40:09.734207+0000","last_undegraded":"2023-11-04T01:40:09.734207+0000","last_fullsized":"2023-11-04T01:40:09.734207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:51:09.123583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255835+0000","last_change":"2023-11-04T01:40:09.748639+0000","last_active":"2023-11-04T01:40:11.255835+0000","last_peered":"2023-11-04T01:40:11.255835+0000","last_clean":"2023-11-04T01:40:11.255835+0000","last_became_active":"2023-11-04T01:40:09.748054+0000","last_became_peered":"2023-11-04T01:40:09.748054+0000","last_unstale":"2023-11-04T01:40:11.255835+0000","last_undegraded":"2023-11-04T01:40:11.255835+0000","last_fullsized":"2023-11-04T01:40:11.255835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:06.213744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731930+0000","last_change":"2023-11-04T01:40:04.704898+0000","last_active":"2023-11-04T01:40:09.731930+0000","last_peered":"2023-11-04T01:40:09.731930+0000","last_clean":"2023-11-04T01:40:09.731930+0000","last_became_active":"2023-11-04T01:40:04.704598+0000","last_became_peered":"2023-11-04T01:40:04.704598+0000","last_unstale":"2023-11-04T01:40:09.731930+0000","last_undegraded":"2023-11-04T01:40:09.731930+0000","last_fullsized":"2023-11-04T01:40:09.731930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:01.176323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729590+0000","last_change":"2023-11-04T01:40:05.578543+0000","last_active":"2023-11-04T01:40:09.729590+0000","last_peered":"2023-11-04T01:40:09.729590+0000","last_clean":"2023-11-04T01:40:09.729590+0000","last_became_active":"2023-11-04T01:40:05.576858+0000","last_became_peered":"2023-11-04T01:40:05.576858+0000","last_unstale":"2023-11-04T01:40:09.729590+0000","last_undegraded":"2023-11-04T01:40:09.729590+0000","last_fullsized":"2023-11-04T01:40:09.729590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:09:53.332106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256523+0000","last_change":"2023-11-04T01:40:09.749533+0000","last_active":"2023-11-04T01:40:11.256523+0000","last_peered":"2023-11-04T01:40:11.256523+0000","last_clean":"2023-11-04T01:40:11.256523+0000","last_became_active":"2023-11-04T01:40:09.749065+0000","last_became_peered":"2023-11-04T01:40:09.749065+0000","last_unstale":"2023-11-04T01:40:11.256523+0000","last_undegraded":"2023-11-04T01:40:11.256523+0000","last_fullsized":"2023-11-04T01:40:11.256523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:09:57.363528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731575+0000","last_change":"2023-11-04T01:40:04.703516+0000","last_active":"2023-11-04T01:40:09.731575+0000","last_peered":"2023-11-04T01:40:09.731575+0000","last_clean":"2023-11-04T01:40:09.731575+0000","last_became_active":"2023-11-04T01:40:04.703201+0000","last_became_peered":"2023-11-04T01:40:04.703201+0000","last_unstale":"2023-11-04T01:40:09.731575+0000","last_undegraded":"2023-11-04T01:40:09.731575+0000","last_fullsized":"2023-11-04T01:40:09.731575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:25:20.986535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729248+0000","last_change":"2023-11-04T01:40:05.577332+0000","last_active":"2023-11-04T01:40:09.729248+0000","last_peered":"2023-11-04T01:40:09.729248+0000","last_clean":"2023-11-04T01:40:09.729248+0000","last_became_active":"2023-11-04T01:40:05.577054+0000","last_became_peered":"2023-11-04T01:40:05.577054+0000","last_unstale":"2023-11-04T01:40:09.729248+0000","last_undegraded":"2023-11-04T01:40:09.729248+0000","last_fullsized":"2023-11-04T01:40:09.729248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:35:55.027288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256082+0000","last_change":"2023-11-04T01:40:09.746388+0000","last_active":"2023-11-04T01:40:11.256082+0000","last_peered":"2023-11-04T01:40:11.256082+0000","last_clean":"2023-11-04T01:40:11.256082+0000","last_became_active":"2023-11-04T01:40:09.745966+0000","last_became_peered":"2023-11-04T01:40:09.745966+0000","last_unstale":"2023-11-04T01:40:11.256082+0000","last_undegraded":"2023-11-04T01:40:11.256082+0000","last_fullsized":"2023-11-04T01:40:11.256082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:35:59.058711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734112+0000","last_change":"2023-11-04T01:40:05.565842+0000","last_active":"2023-11-04T01:40:09.734112+0000","last_peered":"2023-11-04T01:40:09.734112+0000","last_clean":"2023-11-04T01:40:09.734112+0000","last_became_active":"2023-11-04T01:40:05.565387+0000","last_became_peered":"2023-11-04T01:40:05.565387+0000","last_unstale":"2023-11-04T01:40:09.734112+0000","last_undegraded":"2023-11-04T01:40:09.734112+0000","last_fullsized":"2023-11-04T01:40:09.734112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:44:56.709670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731731+0000","last_change":"2023-11-04T01:40:04.702605+0000","last_active":"2023-11-04T01:40:09.731731+0000","last_peered":"2023-11-04T01:40:09.731731+0000","last_clean":"2023-11-04T01:40:09.731731+0000","last_became_active":"2023-11-04T01:40:04.702242+0000","last_became_peered":"2023-11-04T01:40:04.702242+0000","last_unstale":"2023-11-04T01:40:09.731731+0000","last_undegraded":"2023-11-04T01:40:09.731731+0000","last_fullsized":"2023-11-04T01:40:09.731731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:55:42.496852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256505+0000","last_change":"2023-11-04T01:40:09.748671+0000","last_active":"2023-11-04T01:40:11.256505+0000","last_peered":"2023-11-04T01:40:11.256505+0000","last_clean":"2023-11-04T01:40:11.256505+0000","last_became_active":"2023-11-04T01:40:09.748007+0000","last_became_peered":"2023-11-04T01:40:09.748007+0000","last_unstale":"2023-11-04T01:40:11.256505+0000","last_undegraded":"2023-11-04T01:40:11.256505+0000","last_fullsized":"2023-11-04T01:40:11.256505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:45:21.829187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727707+0000","last_change":"2023-11-04T01:40:05.566650+0000","last_active":"2023-11-04T01:40:09.727707+0000","last_peered":"2023-11-04T01:40:09.727707+0000","last_clean":"2023-11-04T01:40:09.727707+0000","last_became_active":"2023-11-04T01:40:05.566369+0000","last_became_peered":"2023-11-04T01:40:05.566369+0000","last_unstale":"2023-11-04T01:40:09.727707+0000","last_undegraded":"2023-11-04T01:40:09.727707+0000","last_fullsized":"2023-11-04T01:40:09.727707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:17.862444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.735570+0000","last_change":"2023-11-04T01:40:04.699761+0000","last_active":"2023-11-04T01:40:09.735570+0000","last_peered":"2023-11-04T01:40:09.735570+0000","last_clean":"2023-11-04T01:40:09.735570+0000","last_became_active":"2023-11-04T01:40:04.699489+0000","last_became_peered":"2023-11-04T01:40:04.699489+0000","last_unstale":"2023-11-04T01:40:09.735570+0000","last_undegraded":"2023-11-04T01:40:09.735570+0000","last_fullsized":"2023-11-04T01:40:09.735570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:45:56.544854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256468+0000","last_change":"2023-11-04T01:40:09.754113+0000","last_active":"2023-11-04T01:40:11.256468+0000","last_peered":"2023-11-04T01:40:11.256468+0000","last_clean":"2023-11-04T01:40:11.256468+0000","last_became_active":"2023-11-04T01:40:09.753689+0000","last_became_peered":"2023-11-04T01:40:09.753689+0000","last_unstale":"2023-11-04T01:40:11.256468+0000","last_undegraded":"2023-11-04T01:40:11.256468+0000","last_fullsized":"2023-11-04T01:40:11.256468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:49:00.940390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727962+0000","last_change":"2023-11-04T01:40:05.559848+0000","last_active":"2023-11-04T01:40:09.727962+0000","last_peered":"2023-11-04T01:40:09.727962+0000","last_clean":"2023-11-04T01:40:09.727962+0000","last_became_active":"2023-11-04T01:40:05.559384+0000","last_became_peered":"2023-11-04T01:40:05.559384+0000","last_unstale":"2023-11-04T01:40:09.727962+0000","last_undegraded":"2023-11-04T01:40:09.727962+0000","last_fullsized":"2023-11-04T01:40:09.727962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:44:56.709670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.733604+0000","last_change":"2023-11-04T01:40:04.704585+0000","last_active":"2023-11-04T01:40:09.733604+0000","last_peered":"2023-11-04T01:40:09.733604+0000","last_clean":"2023-11-04T01:40:09.733604+0000","last_became_active":"2023-11-04T01:40:04.704325+0000","last_became_peered":"2023-11-04T01:40:04.704325+0000","last_unstale":"2023-11-04T01:40:09.733604+0000","last_undegraded":"2023-11-04T01:40:09.733604+0000","last_fullsized":"2023-11-04T01:40:09.733604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:23.661606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256533+0000","last_change":"2023-11-04T01:40:09.748343+0000","last_active":"2023-11-04T01:40:11.256533+0000","last_peered":"2023-11-04T01:40:11.256533+0000","last_clean":"2023-11-04T01:40:11.256533+0000","last_became_active":"2023-11-04T01:40:09.747762+0000","last_became_peered":"2023-11-04T01:40:09.747762+0000","last_unstale":"2023-11-04T01:40:11.256533+0000","last_undegraded":"2023-11-04T01:40:11.256533+0000","last_fullsized":"2023-11-04T01:40:11.256533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:47.091874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.737227+0000","last_change":"2023-11-04T01:40:05.562694+0000","last_active":"2023-11-04T01:40:09.737227+0000","last_peered":"2023-11-04T01:40:09.737227+0000","last_clean":"2023-11-04T01:40:09.737227+0000","last_became_active":"2023-11-04T01:40:05.562431+0000","last_became_peered":"2023-11-04T01:40:05.562431+0000","last_unstale":"2023-11-04T01:40:09.737227+0000","last_undegraded":"2023-11-04T01:40:09.737227+0000","last_fullsized":"2023-11-04T01:40:09.737227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:12:08.762760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731277+0000","last_change":"2023-11-04T01:40:04.706712+0000","last_active":"2023-11-04T01:40:09.731277+0000","last_peered":"2023-11-04T01:40:09.731277+0000","last_clean":"2023-11-04T01:40:09.731277+0000","last_became_active":"2023-11-04T01:40:04.706369+0000","last_became_peered":"2023-11-04T01:40:04.706369+0000","last_unstale":"2023-11-04T01:40:09.731277+0000","last_undegraded":"2023-11-04T01:40:09.731277+0000","last_fullsized":"2023-11-04T01:40:09.731277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:23.661606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256269+0000","last_change":"2023-11-04T01:40:09.752971+0000","last_active":"2023-11-04T01:40:11.256269+0000","last_peered":"2023-11-04T01:40:11.256269+0000","last_clean":"2023-11-04T01:40:11.256269+0000","last_became_active":"2023-11-04T01:40:09.752569+0000","last_became_peered":"2023-11-04T01:40:09.752569+0000","last_unstale":"2023-11-04T01:40:11.256269+0000","last_undegraded":"2023-11-04T01:40:11.256269+0000","last_fullsized":"2023-11-04T01:40:11.256269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:32:31.515813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.733414+0000","last_change":"2023-11-04T01:40:05.559419+0000","last_active":"2023-11-04T01:40:09.733414+0000","last_peered":"2023-11-04T01:40:09.733414+0000","last_clean":"2023-11-04T01:40:09.733414+0000","last_became_active":"2023-11-04T01:40:05.559176+0000","last_became_peered":"2023-11-04T01:40:05.559176+0000","last_unstale":"2023-11-04T01:40:09.733414+0000","last_undegraded":"2023-11-04T01:40:09.733414+0000","last_fullsized":"2023-11-04T01:40:09.733414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:44:56.709670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.735151+0000","last_change":"2023-11-04T01:40:04.706199+0000","last_active":"2023-11-04T01:40:09.735151+0000","last_peered":"2023-11-04T01:40:09.735151+0000","last_clean":"2023-11-04T01:40:09.735151+0000","last_became_active":"2023-11-04T01:40:04.705913+0000","last_became_peered":"2023-11-04T01:40:04.705913+0000","last_unstale":"2023-11-04T01:40:09.735151+0000","last_undegraded":"2023-11-04T01:40:09.735151+0000","last_fullsized":"2023-11-04T01:40:09.735151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:14:24.322290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256061+0000","last_change":"2023-11-04T01:40:09.744921+0000","last_active":"2023-11-04T01:40:11.256061+0000","last_peered":"2023-11-04T01:40:11.256061+0000","last_clean":"2023-11-04T01:40:11.256061+0000","last_became_active":"2023-11-04T01:40:09.744502+0000","last_became_peered":"2023-11-04T01:40:09.744502+0000","last_unstale":"2023-11-04T01:40:11.256061+0000","last_undegraded":"2023-11-04T01:40:11.256061+0000","last_fullsized":"2023-11-04T01:40:11.256061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:46:22.983063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.728110+0000","last_change":"2023-11-04T01:40:05.559760+0000","last_active":"2023-11-04T01:40:09.728110+0000","last_peered":"2023-11-04T01:40:09.728110+0000","last_clean":"2023-11-04T01:40:09.728110+0000","last_became_active":"2023-11-04T01:40:05.559446+0000","last_became_peered":"2023-11-04T01:40:05.559446+0000","last_unstale":"2023-11-04T01:40:09.728110+0000","last_undegraded":"2023-11-04T01:40:09.728110+0000","last_fullsized":"2023-11-04T01:40:09.728110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:56.908968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734467+0000","last_change":"2023-11-04T01:40:04.708172+0000","last_active":"2023-11-04T01:40:09.734467+0000","last_peered":"2023-11-04T01:40:09.734467+0000","last_clean":"2023-11-04T01:40:09.734467+0000","last_became_active":"2023-11-04T01:40:04.707882+0000","last_became_peered":"2023-11-04T01:40:04.707882+0000","last_unstale":"2023-11-04T01:40:09.734467+0000","last_undegraded":"2023-11-04T01:40:09.734467+0000","last_fullsized":"2023-11-04T01:40:09.734467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:01.195966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.550470+0000","last_change":"2023-11-04T01:40:09.749232+0000","last_active":"2023-11-04T01:40:10.550470+0000","last_peered":"2023-11-04T01:40:10.550470+0000","last_clean":"2023-11-04T01:40:10.550470+0000","last_became_active":"2023-11-04T01:40:09.748638+0000","last_became_peered":"2023-11-04T01:40:09.748638+0000","last_unstale":"2023-11-04T01:40:10.550470+0000","last_undegraded":"2023-11-04T01:40:10.550470+0000","last_fullsized":"2023-11-04T01:40:10.550470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:58.518860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734540+0000","last_change":"2023-11-04T01:40:05.562143+0000","last_active":"2023-11-04T01:40:09.734540+0000","last_peered":"2023-11-04T01:40:09.734540+0000","last_clean":"2023-11-04T01:40:09.734540+0000","last_became_active":"2023-11-04T01:40:05.561862+0000","last_became_peered":"2023-11-04T01:40:05.561862+0000","last_unstale":"2023-11-04T01:40:09.734540+0000","last_undegraded":"2023-11-04T01:40:09.734540+0000","last_fullsized":"2023-11-04T01:40:09.734540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:09:40.586446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732147+0000","last_change":"2023-11-04T01:40:04.710881+0000","last_active":"2023-11-04T01:40:09.732147+0000","last_peered":"2023-11-04T01:40:09.732147+0000","last_clean":"2023-11-04T01:40:09.732147+0000","last_became_active":"2023-11-04T01:40:04.710601+0000","last_became_peered":"2023-11-04T01:40:04.710601+0000","last_unstale":"2023-11-04T01:40:09.732147+0000","last_undegraded":"2023-11-04T01:40:09.732147+0000","last_fullsized":"2023-11-04T01:40:09.732147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:46:17.945642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255709+0000","last_change":"2023-11-04T01:40:09.749485+0000","last_active":"2023-11-04T01:40:11.255709+0000","last_peered":"2023-11-04T01:40:11.255709+0000","last_clean":"2023-11-04T01:40:11.255709+0000","last_became_active":"2023-11-04T01:40:09.748804+0000","last_became_peered":"2023-11-04T01:40:09.748804+0000","last_unstale":"2023-11-04T01:40:11.255709+0000","last_undegraded":"2023-11-04T01:40:11.255709+0000","last_fullsized":"2023-11-04T01:40:11.255709+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:19.049388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729332+0000","last_change":"2023-11-04T01:40:05.571329+0000","last_active":"2023-11-04T01:40:09.729332+0000","last_peered":"2023-11-04T01:40:09.729332+0000","last_clean":"2023-11-04T01:40:09.729332+0000","last_became_active":"2023-11-04T01:40:05.571077+0000","last_became_peered":"2023-11-04T01:40:05.571077+0000","last_unstale":"2023-11-04T01:40:09.729332+0000","last_undegraded":"2023-11-04T01:40:09.729332+0000","last_fullsized":"2023-11-04T01:40:09.729332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:56.908968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734615+0000","last_change":"2023-11-04T01:40:04.710975+0000","last_active":"2023-11-04T01:40:09.734615+0000","last_peered":"2023-11-04T01:40:09.734615+0000","last_clean":"2023-11-04T01:40:09.734615+0000","last_became_active":"2023-11-04T01:40:04.710643+0000","last_became_peered":"2023-11-04T01:40:04.710643+0000","last_unstale":"2023-11-04T01:40:09.734615+0000","last_undegraded":"2023-11-04T01:40:09.734615+0000","last_fullsized":"2023-11-04T01:40:09.734615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:55:42.496852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255585+0000","last_change":"2023-11-04T01:40:09.745566+0000","last_active":"2023-11-04T01:40:11.255585+0000","last_peered":"2023-11-04T01:40:11.255585+0000","last_clean":"2023-11-04T01:40:11.255585+0000","last_became_active":"2023-11-04T01:40:09.745232+0000","last_became_peered":"2023-11-04T01:40:09.745232+0000","last_unstale":"2023-11-04T01:40:11.255585+0000","last_undegraded":"2023-11-04T01:40:11.255585+0000","last_fullsized":"2023-11-04T01:40:11.255585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:18:59.903542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734765+0000","last_change":"2023-11-04T01:40:05.566450+0000","last_active":"2023-11-04T01:40:09.734765+0000","last_peered":"2023-11-04T01:40:09.734765+0000","last_clean":"2023-11-04T01:40:09.734765+0000","last_became_active":"2023-11-04T01:40:05.565477+0000","last_became_peered":"2023-11-04T01:40:05.565477+0000","last_unstale":"2023-11-04T01:40:09.734765+0000","last_undegraded":"2023-11-04T01:40:09.734765+0000","last_fullsized":"2023-11-04T01:40:09.734765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:45:02.590707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.730048+0000","last_change":"2023-11-04T01:40:04.707185+0000","last_active":"2023-11-04T01:40:09.730048+0000","last_peered":"2023-11-04T01:40:09.730048+0000","last_clean":"2023-11-04T01:40:09.730048+0000","last_became_active":"2023-11-04T01:40:04.706814+0000","last_became_peered":"2023-11-04T01:40:04.706814+0000","last_unstale":"2023-11-04T01:40:09.730048+0000","last_undegraded":"2023-11-04T01:40:09.730048+0000","last_fullsized":"2023-11-04T01:40:09.730048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:51:08.117585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256134+0000","last_change":"2023-11-04T01:40:09.751263+0000","last_active":"2023-11-04T01:40:11.256134+0000","last_peered":"2023-11-04T01:40:11.256134+0000","last_clean":"2023-11-04T01:40:11.256134+0000","last_became_active":"2023-11-04T01:40:09.750948+0000","last_became_peered":"2023-11-04T01:40:09.750948+0000","last_unstale":"2023-11-04T01:40:11.256134+0000","last_undegraded":"2023-11-04T01:40:11.256134+0000","last_fullsized":"2023-11-04T01:40:11.256134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:14:21.977139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.736252+0000","last_change":"2023-11-04T01:40:05.562139+0000","last_active":"2023-11-04T01:40:09.736252+0000","last_peered":"2023-11-04T01:40:09.736252+0000","last_clean":"2023-11-04T01:40:09.736252+0000","last_became_active":"2023-11-04T01:40:05.561872+0000","last_became_peered":"2023-11-04T01:40:05.561872+0000","last_unstale":"2023-11-04T01:40:09.736252+0000","last_undegraded":"2023-11-04T01:40:09.736252+0000","last_fullsized":"2023-11-04T01:40:09.736252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:44:56.709670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.736987+0000","last_change":"2023-11-04T01:40:04.697746+0000","last_active":"2023-11-04T01:40:09.736987+0000","last_peered":"2023-11-04T01:40:09.736987+0000","last_clean":"2023-11-04T01:40:09.736987+0000","last_became_active":"2023-11-04T01:40:04.697469+0000","last_became_peered":"2023-11-04T01:40:04.697469+0000","last_unstale":"2023-11-04T01:40:09.736987+0000","last_undegraded":"2023-11-04T01:40:09.736987+0000","last_fullsized":"2023-11-04T01:40:09.736987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:12:07.756761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256639+0000","last_change":"2023-11-04T01:40:09.746485+0000","last_active":"2023-11-04T01:40:11.256639+0000","last_peered":"2023-11-04T01:40:11.256639+0000","last_clean":"2023-11-04T01:40:11.256639+0000","last_became_active":"2023-11-04T01:40:09.746134+0000","last_became_peered":"2023-11-04T01:40:09.746134+0000","last_unstale":"2023-11-04T01:40:11.256639+0000","last_undegraded":"2023-11-04T01:40:11.256639+0000","last_fullsized":"2023-11-04T01:40:11.256639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:25.883087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731984+0000","last_change":"2023-11-04T01:40:05.560837+0000","last_active":"2023-11-04T01:40:09.731984+0000","last_peered":"2023-11-04T01:40:09.731984+0000","last_clean":"2023-11-04T01:40:09.731984+0000","last_became_active":"2023-11-04T01:40:05.560083+0000","last_became_peered":"2023-11-04T01:40:05.560083+0000","last_unstale":"2023-11-04T01:40:09.731984+0000","last_undegraded":"2023-11-04T01:40:09.731984+0000","last_fullsized":"2023-11-04T01:40:09.731984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:45:57.550853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731654+0000","last_change":"2023-11-04T01:40:04.704308+0000","last_active":"2023-11-04T01:40:09.731654+0000","last_peered":"2023-11-04T01:40:09.731654+0000","last_clean":"2023-11-04T01:40:09.731654+0000","last_became_active":"2023-11-04T01:40:04.703783+0000","last_became_peered":"2023-11-04T01:40:04.703783+0000","last_unstale":"2023-11-04T01:40:09.731654+0000","last_undegraded":"2023-11-04T01:40:09.731654+0000","last_fullsized":"2023-11-04T01:40:09.731654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:35.223156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255849+0000","last_change":"2023-11-04T01:40:09.748878+0000","last_active":"2023-11-04T01:40:11.255849+0000","last_peered":"2023-11-04T01:40:11.255849+0000","last_clean":"2023-11-04T01:40:11.255849+0000","last_became_active":"2023-11-04T01:40:09.748399+0000","last_became_peered":"2023-11-04T01:40:09.748399+0000","last_unstale":"2023-11-04T01:40:11.255849+0000","last_undegraded":"2023-11-04T01:40:11.255849+0000","last_fullsized":"2023-11-04T01:40:11.255849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:14:21.977139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727379+0000","last_change":"2023-11-04T01:40:05.579730+0000","last_active":"2023-11-04T01:40:09.727379+0000","last_peered":"2023-11-04T01:40:09.727379+0000","last_clean":"2023-11-04T01:40:09.727379+0000","last_became_active":"2023-11-04T01:40:05.579457+0000","last_became_peered":"2023-11-04T01:40:05.579457+0000","last_unstale":"2023-11-04T01:40:09.727379+0000","last_undegraded":"2023-11-04T01:40:09.727379+0000","last_fullsized":"2023-11-04T01:40:09.727379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:09:40.586446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.728766+0000","last_change":"2023-11-04T01:40:04.707059+0000","last_active":"2023-11-04T01:40:09.728766+0000","last_peered":"2023-11-04T01:40:09.728766+0000","last_clean":"2023-11-04T01:40:09.728766+0000","last_became_active":"2023-11-04T01:40:04.706619+0000","last_became_peered":"2023-11-04T01:40:04.706619+0000","last_unstale":"2023-11-04T01:40:09.728766+0000","last_undegraded":"2023-11-04T01:40:09.728766+0000","last_fullsized":"2023-11-04T01:40:09.728766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:44:55.703672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731611+0000","last_change":"2023-11-04T01:39:54.204460+0000","last_active":"2023-11-04T01:40:09.731611+0000","last_peered":"2023-11-04T01:40:09.731611+0000","last_clean":"2023-11-04T01:40:09.731611+0000","last_became_active":"2023-11-04T01:39:54.203352+0000","last_became_peered":"2023-11-04T01:39:54.203352+0000","last_unstale":"2023-11-04T01:40:09.731611+0000","last_undegraded":"2023-11-04T01:40:09.731611+0000","last_fullsized":"2023-11-04T01:40:09.731611+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:52.627032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:52.627032+0000","last_clean_scrub_stamp":"2023-11-04T01:39:52.627032+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:17:18.474768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.550355+0000","last_change":"2023-11-04T01:40:09.744111+0000","last_active":"2023-11-04T01:40:10.550355+0000","last_peered":"2023-11-04T01:40:10.550355+0000","last_clean":"2023-11-04T01:40:10.550355+0000","last_became_active":"2023-11-04T01:40:09.743657+0000","last_became_peered":"2023-11-04T01:40:09.743657+0000","last_unstale":"2023-11-04T01:40:10.550355+0000","last_undegraded":"2023-11-04T01:40:10.550355+0000","last_fullsized":"2023-11-04T01:40:10.550355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:18:59.903542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731749+0000","last_change":"2023-11-04T01:40:05.577079+0000","last_active":"2023-11-04T01:40:09.731749+0000","last_peered":"2023-11-04T01:40:09.731749+0000","last_clean":"2023-11-04T01:40:09.731749+0000","last_became_active":"2023-11-04T01:40:05.576722+0000","last_became_peered":"2023-11-04T01:40:05.576722+0000","last_unstale":"2023-11-04T01:40:09.731749+0000","last_undegraded":"2023-11-04T01:40:09.731749+0000","last_fullsized":"2023-11-04T01:40:09.731749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:18:55.872119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.739610+0000","last_change":"2023-11-04T01:40:04.708618+0000","last_active":"2023-11-04T01:40:09.739610+0000","last_peered":"2023-11-04T01:40:09.739610+0000","last_clean":"2023-11-04T01:40:09.739610+0000","last_became_active":"2023-11-04T01:40:04.708294+0000","last_became_peered":"2023-11-04T01:40:04.708294+0000","last_unstale":"2023-11-04T01:40:09.739610+0000","last_undegraded":"2023-11-04T01:40:09.739610+0000","last_fullsized":"2023-11-04T01:40:09.739610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:58:25.853829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.549398+0000","last_change":"2023-11-04T01:40:09.743960+0000","last_active":"2023-11-04T01:40:10.549398+0000","last_peered":"2023-11-04T01:40:10.549398+0000","last_clean":"2023-11-04T01:40:10.549398+0000","last_became_active":"2023-11-04T01:40:09.743539+0000","last_became_peered":"2023-11-04T01:40:09.743539+0000","last_unstale":"2023-11-04T01:40:10.549398+0000","last_undegraded":"2023-11-04T01:40:10.549398+0000","last_fullsized":"2023-11-04T01:40:10.549398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:45:21.829187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729678+0000","last_change":"2023-11-04T01:40:05.571294+0000","last_active":"2023-11-04T01:40:09.729678+0000","last_peered":"2023-11-04T01:40:09.729678+0000","last_clean":"2023-11-04T01:40:09.729678+0000","last_became_active":"2023-11-04T01:40:05.570961+0000","last_became_peered":"2023-11-04T01:40:05.570961+0000","last_unstale":"2023-11-04T01:40:09.729678+0000","last_undegraded":"2023-11-04T01:40:09.729678+0000","last_fullsized":"2023-11-04T01:40:09.729678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:14:17.945716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734901+0000","last_change":"2023-11-04T01:40:04.700593+0000","last_active":"2023-11-04T01:40:09.734901+0000","last_peered":"2023-11-04T01:40:09.734901+0000","last_clean":"2023-11-04T01:40:09.734901+0000","last_became_active":"2023-11-04T01:40:04.700051+0000","last_became_peered":"2023-11-04T01:40:04.700051+0000","last_unstale":"2023-11-04T01:40:09.734901+0000","last_undegraded":"2023-11-04T01:40:09.734901+0000","last_fullsized":"2023-11-04T01:40:09.734901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:14:24.322290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255865+0000","last_change":"2023-11-04T01:40:09.749244+0000","last_active":"2023-11-04T01:40:11.255865+0000","last_peered":"2023-11-04T01:40:11.255865+0000","last_clean":"2023-11-04T01:40:11.255865+0000","last_became_active":"2023-11-04T01:40:09.748229+0000","last_became_peered":"2023-11-04T01:40:09.748229+0000","last_unstale":"2023-11-04T01:40:11.255865+0000","last_undegraded":"2023-11-04T01:40:11.255865+0000","last_fullsized":"2023-11-04T01:40:11.255865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:47.091874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732531+0000","last_change":"2023-11-04T01:40:05.564770+0000","last_active":"2023-11-04T01:40:09.732531+0000","last_peered":"2023-11-04T01:40:09.732531+0000","last_clean":"2023-11-04T01:40:09.732531+0000","last_became_active":"2023-11-04T01:40:05.564483+0000","last_became_peered":"2023-11-04T01:40:05.564483+0000","last_unstale":"2023-11-04T01:40:09.732531+0000","last_undegraded":"2023-11-04T01:40:09.732531+0000","last_fullsized":"2023-11-04T01:40:09.732531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:54.487437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.737108+0000","last_change":"2023-11-04T01:40:04.698832+0000","last_active":"2023-11-04T01:40:09.737108+0000","last_peered":"2023-11-04T01:40:09.737108+0000","last_clean":"2023-11-04T01:40:09.737108+0000","last_became_active":"2023-11-04T01:40:04.698498+0000","last_became_peered":"2023-11-04T01:40:04.698498+0000","last_unstale":"2023-11-04T01:40:09.737108+0000","last_undegraded":"2023-11-04T01:40:09.737108+0000","last_fullsized":"2023-11-04T01:40:09.737108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:02:39.769313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255109+0000","last_change":"2023-11-04T01:40:09.744405+0000","last_active":"2023-11-04T01:40:11.255109+0000","last_peered":"2023-11-04T01:40:11.255109+0000","last_clean":"2023-11-04T01:40:11.255109+0000","last_became_active":"2023-11-04T01:40:09.743992+0000","last_became_peered":"2023-11-04T01:40:09.743992+0000","last_unstale":"2023-11-04T01:40:11.255109+0000","last_undegraded":"2023-11-04T01:40:11.255109+0000","last_fullsized":"2023-11-04T01:40:11.255109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:23:03.976941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732033+0000","last_change":"2023-11-04T01:40:05.565058+0000","last_active":"2023-11-04T01:40:09.732033+0000","last_peered":"2023-11-04T01:40:09.732033+0000","last_clean":"2023-11-04T01:40:09.732033+0000","last_became_active":"2023-11-04T01:40:05.564784+0000","last_became_peered":"2023-11-04T01:40:05.564784+0000","last_unstale":"2023-11-04T01:40:09.732033+0000","last_undegraded":"2023-11-04T01:40:09.732033+0000","last_fullsized":"2023-11-04T01:40:09.732033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:15.017965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732789+0000","last_change":"2023-11-04T01:40:04.699612+0000","last_active":"2023-11-04T01:40:09.732789+0000","last_peered":"2023-11-04T01:40:09.732789+0000","last_clean":"2023-11-04T01:40:09.732789+0000","last_became_active":"2023-11-04T01:40:04.697978+0000","last_became_peered":"2023-11-04T01:40:04.697978+0000","last_unstale":"2023-11-04T01:40:09.732789+0000","last_undegraded":"2023-11-04T01:40:09.732789+0000","last_fullsized":"2023-11-04T01:40:09.732789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:11:00.897268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255902+0000","last_change":"2023-11-04T01:40:09.753878+0000","last_active":"2023-11-04T01:40:11.255902+0000","last_peered":"2023-11-04T01:40:11.255902+0000","last_clean":"2023-11-04T01:40:11.255902+0000","last_became_active":"2023-11-04T01:40:09.753521+0000","last_became_peered":"2023-11-04T01:40:09.753521+0000","last_unstale":"2023-11-04T01:40:11.255902+0000","last_undegraded":"2023-11-04T01:40:11.255902+0000","last_fullsized":"2023-11-04T01:40:11.255902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:21.893866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731429+0000","last_change":"2023-11-04T01:40:05.561139+0000","last_active":"2023-11-04T01:40:09.731429+0000","last_peered":"2023-11-04T01:40:09.731429+0000","last_clean":"2023-11-04T01:40:09.731429+0000","last_became_active":"2023-11-04T01:40:05.560824+0000","last_became_peered":"2023-11-04T01:40:05.560824+0000","last_unstale":"2023-11-04T01:40:09.731429+0000","last_undegraded":"2023-11-04T01:40:09.731429+0000","last_fullsized":"2023-11-04T01:40:09.731429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:32:27.484390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.736542+0000","last_change":"2023-11-04T01:40:04.704879+0000","last_active":"2023-11-04T01:40:09.736542+0000","last_peered":"2023-11-04T01:40:09.736542+0000","last_clean":"2023-11-04T01:40:09.736542+0000","last_became_active":"2023-11-04T01:40:04.704561+0000","last_became_peered":"2023-11-04T01:40:04.704561+0000","last_unstale":"2023-11-04T01:40:09.736542+0000","last_undegraded":"2023-11-04T01:40:09.736542+0000","last_fullsized":"2023-11-04T01:40:09.736542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:35.223156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256043+0000","last_change":"2023-11-04T01:40:09.743050+0000","last_active":"2023-11-04T01:40:11.256043+0000","last_peered":"2023-11-04T01:40:11.256043+0000","last_clean":"2023-11-04T01:40:11.256043+0000","last_became_active":"2023-11-04T01:40:09.742685+0000","last_became_peered":"2023-11-04T01:40:09.742685+0000","last_unstale":"2023-11-04T01:40:11.256043+0000","last_undegraded":"2023-11-04T01:40:11.256043+0000","last_fullsized":"2023-11-04T01:40:11.256043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:25.883087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.737349+0000","last_change":"2023-11-04T01:40:05.566982+0000","last_active":"2023-11-04T01:40:09.737349+0000","last_peered":"2023-11-04T01:40:09.737349+0000","last_clean":"2023-11-04T01:40:09.737349+0000","last_became_active":"2023-11-04T01:40:05.566400+0000","last_became_peered":"2023-11-04T01:40:05.566400+0000","last_unstale":"2023-11-04T01:40:09.737349+0000","last_undegraded":"2023-11-04T01:40:09.737349+0000","last_fullsized":"2023-11-04T01:40:09.737349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:24.555185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.738136+0000","last_change":"2023-11-04T01:40:04.702671+0000","last_active":"2023-11-04T01:40:09.738136+0000","last_peered":"2023-11-04T01:40:09.738136+0000","last_clean":"2023-11-04T01:40:09.738136+0000","last_became_active":"2023-11-04T01:40:04.702403+0000","last_became_peered":"2023-11-04T01:40:04.702403+0000","last_unstale":"2023-11-04T01:40:09.738136+0000","last_undegraded":"2023-11-04T01:40:09.738136+0000","last_fullsized":"2023-11-04T01:40:09.738136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:23.661606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.551245+0000","last_change":"2023-11-04T01:40:09.750337+0000","last_active":"2023-11-04T01:40:10.551245+0000","last_peered":"2023-11-04T01:40:10.551245+0000","last_clean":"2023-11-04T01:40:10.551245+0000","last_became_active":"2023-11-04T01:40:09.748314+0000","last_became_peered":"2023-11-04T01:40:09.748314+0000","last_unstale":"2023-11-04T01:40:10.551245+0000","last_undegraded":"2023-11-04T01:40:10.551245+0000","last_fullsized":"2023-11-04T01:40:10.551245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:59:19.908042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731576+0000","last_change":"2023-11-04T01:40:05.568489+0000","last_active":"2023-11-04T01:40:09.731576+0000","last_peered":"2023-11-04T01:40:09.731576+0000","last_clean":"2023-11-04T01:40:09.731576+0000","last_became_active":"2023-11-04T01:40:05.568169+0000","last_became_peered":"2023-11-04T01:40:05.568169+0000","last_unstale":"2023-11-04T01:40:09.731576+0000","last_undegraded":"2023-11-04T01:40:09.731576+0000","last_fullsized":"2023-11-04T01:40:09.731576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:45:17.797764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729951+0000","last_change":"2023-11-04T01:40:04.707560+0000","last_active":"2023-11-04T01:40:09.729951+0000","last_peered":"2023-11-04T01:40:09.729951+0000","last_clean":"2023-11-04T01:40:09.729951+0000","last_became_active":"2023-11-04T01:40:04.707230+0000","last_became_peered":"2023-11-04T01:40:04.707230+0000","last_unstale":"2023-11-04T01:40:09.729951+0000","last_undegraded":"2023-11-04T01:40:09.729951+0000","last_fullsized":"2023-11-04T01:40:09.729951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:23.549186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.551075+0000","last_change":"2023-11-04T01:40:09.750047+0000","last_active":"2023-11-04T01:40:10.551075+0000","last_peered":"2023-11-04T01:40:10.551075+0000","last_clean":"2023-11-04T01:40:10.551075+0000","last_became_active":"2023-11-04T01:40:09.749057+0000","last_became_peered":"2023-11-04T01:40:09.749057+0000","last_unstale":"2023-11-04T01:40:10.551075+0000","last_undegraded":"2023-11-04T01:40:10.551075+0000","last_fullsized":"2023-11-04T01:40:10.551075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:22:24.152135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732097+0000","last_change":"2023-11-04T01:40:05.558257+0000","last_active":"2023-11-04T01:40:09.732097+0000","last_peered":"2023-11-04T01:40:09.732097+0000","last_clean":"2023-11-04T01:40:09.732097+0000","last_became_active":"2023-11-04T01:40:05.557891+0000","last_became_peered":"2023-11-04T01:40:05.557891+0000","last_unstale":"2023-11-04T01:40:09.732097+0000","last_undegraded":"2023-11-04T01:40:09.732097+0000","last_fullsized":"2023-11-04T01:40:09.732097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:24.555185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732974+0000","last_change":"2023-11-04T01:40:04.698298+0000","last_active":"2023-11-04T01:40:09.732974+0000","last_peered":"2023-11-04T01:40:09.732974+0000","last_clean":"2023-11-04T01:40:09.732974+0000","last_became_active":"2023-11-04T01:40:04.697835+0000","last_became_peered":"2023-11-04T01:40:04.697835+0000","last_unstale":"2023-11-04T01:40:09.732974+0000","last_undegraded":"2023-11-04T01:40:09.732974+0000","last_fullsized":"2023-11-04T01:40:09.732974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:35.223156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255855+0000","last_change":"2023-11-04T01:40:09.742018+0000","last_active":"2023-11-04T01:40:11.255855+0000","last_peered":"2023-11-04T01:40:11.255855+0000","last_clean":"2023-11-04T01:40:11.255855+0000","last_became_active":"2023-11-04T01:40:09.741656+0000","last_became_peered":"2023-11-04T01:40:09.741656+0000","last_unstale":"2023-11-04T01:40:11.255855+0000","last_undegraded":"2023-11-04T01:40:11.255855+0000","last_fullsized":"2023-11-04T01:40:11.255855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:59:48.059889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731464+0000","last_change":"2023-11-04T01:40:05.561050+0000","last_active":"2023-11-04T01:40:09.731464+0000","last_peered":"2023-11-04T01:40:09.731464+0000","last_clean":"2023-11-04T01:40:09.731464+0000","last_became_active":"2023-11-04T01:40:05.560752+0000","last_became_peered":"2023-11-04T01:40:05.560752+0000","last_unstale":"2023-11-04T01:40:09.731464+0000","last_undegraded":"2023-11-04T01:40:09.731464+0000","last_fullsized":"2023-11-04T01:40:09.731464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:56.908968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:16.072010+0000","last_change":"2023-11-04T01:40:04.700840+0000","last_active":"2023-11-04T01:40:16.072010+0000","last_peered":"2023-11-04T01:40:16.072010+0000","last_clean":"2023-11-04T01:40:16.072010+0000","last_became_active":"2023-11-04T01:40:04.700524+0000","last_became_peered":"2023-11-04T01:40:04.700524+0000","last_unstale":"2023-11-04T01:40:16.072010+0000","last_undegraded":"2023-11-04T01:40:16.072010+0000","last_fullsized":"2023-11-04T01:40:16.072010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:45:56.544854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255711+0000","last_change":"2023-11-04T01:40:09.747985+0000","last_active":"2023-11-04T01:40:11.255711+0000","last_peered":"2023-11-04T01:40:11.255711+0000","last_clean":"2023-11-04T01:40:11.255711+0000","last_became_active":"2023-11-04T01:40:09.747607+0000","last_became_peered":"2023-11-04T01:40:09.747607+0000","last_unstale":"2023-11-04T01:40:11.255711+0000","last_undegraded":"2023-11-04T01:40:11.255711+0000","last_fullsized":"2023-11-04T01:40:11.255711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:19.049388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.737830+0000","last_change":"2023-11-04T01:40:05.560889+0000","last_active":"2023-11-04T01:40:09.737830+0000","last_peered":"2023-11-04T01:40:09.737830+0000","last_clean":"2023-11-04T01:40:09.737830+0000","last_became_active":"2023-11-04T01:40:05.560631+0000","last_became_peered":"2023-11-04T01:40:05.560631+0000","last_unstale":"2023-11-04T01:40:09.737830+0000","last_undegraded":"2023-11-04T01:40:09.737830+0000","last_fullsized":"2023-11-04T01:40:09.737830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:02:40.775312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734805+0000","last_change":"2023-11-04T01:40:04.708390+0000","last_active":"2023-11-04T01:40:09.734805+0000","last_peered":"2023-11-04T01:40:09.734805+0000","last_clean":"2023-11-04T01:40:09.734805+0000","last_became_active":"2023-11-04T01:40:04.708142+0000","last_became_peered":"2023-11-04T01:40:04.708142+0000","last_unstale":"2023-11-04T01:40:09.734805+0000","last_undegraded":"2023-11-04T01:40:09.734805+0000","last_fullsized":"2023-11-04T01:40:09.734805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:15:03.573413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256687+0000","last_change":"2023-11-04T01:40:09.748503+0000","last_active":"2023-11-04T01:40:11.256687+0000","last_peered":"2023-11-04T01:40:11.256687+0000","last_clean":"2023-11-04T01:40:11.256687+0000","last_became_active":"2023-11-04T01:40:09.748074+0000","last_became_peered":"2023-11-04T01:40:09.748074+0000","last_unstale":"2023-11-04T01:40:11.256687+0000","last_undegraded":"2023-11-04T01:40:11.256687+0000","last_fullsized":"2023-11-04T01:40:11.256687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:18:59.903542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734280+0000","last_change":"2023-11-04T01:40:05.578830+0000","last_active":"2023-11-04T01:40:09.734280+0000","last_peered":"2023-11-04T01:40:09.734280+0000","last_clean":"2023-11-04T01:40:09.734280+0000","last_became_active":"2023-11-04T01:40:05.578600+0000","last_became_peered":"2023-11-04T01:40:05.578600+0000","last_unstale":"2023-11-04T01:40:09.734280+0000","last_undegraded":"2023-11-04T01:40:09.734280+0000","last_fullsized":"2023-11-04T01:40:09.734280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:17.862444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729084+0000","last_change":"2023-11-04T01:40:04.712885+0000","last_active":"2023-11-04T01:40:09.729084+0000","last_peered":"2023-11-04T01:40:09.729084+0000","last_clean":"2023-11-04T01:40:09.729084+0000","last_became_active":"2023-11-04T01:40:04.712596+0000","last_became_peered":"2023-11-04T01:40:04.712596+0000","last_unstale":"2023-11-04T01:40:09.729084+0000","last_undegraded":"2023-11-04T01:40:09.729084+0000","last_fullsized":"2023-11-04T01:40:09.729084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:01.195966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.550952+0000","last_change":"2023-11-04T01:40:09.749818+0000","last_active":"2023-11-04T01:40:10.550952+0000","last_peered":"2023-11-04T01:40:10.550952+0000","last_clean":"2023-11-04T01:40:10.550952+0000","last_became_active":"2023-11-04T01:40:09.749447+0000","last_became_peered":"2023-11-04T01:40:09.749447+0000","last_unstale":"2023-11-04T01:40:10.550952+0000","last_undegraded":"2023-11-04T01:40:10.550952+0000","last_fullsized":"2023-11-04T01:40:10.550952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:14:02.598554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729015+0000","last_change":"2023-11-04T01:40:05.576921+0000","last_active":"2023-11-04T01:40:09.729015+0000","last_peered":"2023-11-04T01:40:09.729015+0000","last_clean":"2023-11-04T01:40:09.729015+0000","last_became_active":"2023-11-04T01:40:05.576105+0000","last_became_peered":"2023-11-04T01:40:05.576105+0000","last_unstale":"2023-11-04T01:40:09.729015+0000","last_undegraded":"2023-11-04T01:40:09.729015+0000","last_fullsized":"2023-11-04T01:40:09.729015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:32:27.484390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.735071+0000","last_change":"2023-11-04T01:40:04.708447+0000","last_active":"2023-11-04T01:40:09.735071+0000","last_peered":"2023-11-04T01:40:09.735071+0000","last_clean":"2023-11-04T01:40:09.735071+0000","last_became_active":"2023-11-04T01:40:04.708148+0000","last_became_peered":"2023-11-04T01:40:04.708148+0000","last_unstale":"2023-11-04T01:40:09.735071+0000","last_undegraded":"2023-11-04T01:40:09.735071+0000","last_fullsized":"2023-11-04T01:40:09.735071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:15:03.573413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.550821+0000","last_change":"2023-11-04T01:40:09.750214+0000","last_active":"2023-11-04T01:40:10.550821+0000","last_peered":"2023-11-04T01:40:10.550821+0000","last_clean":"2023-11-04T01:40:10.550821+0000","last_became_active":"2023-11-04T01:40:09.746156+0000","last_became_peered":"2023-11-04T01:40:09.746156+0000","last_unstale":"2023-11-04T01:40:10.550821+0000","last_undegraded":"2023-11-04T01:40:10.550821+0000","last_fullsized":"2023-11-04T01:40:10.550821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:59:48.059889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255702+0000","last_change":"2023-11-04T01:40:09.749952+0000","last_active":"2023-11-04T01:40:11.255702+0000","last_peered":"2023-11-04T01:40:11.255702+0000","last_clean":"2023-11-04T01:40:11.255702+0000","last_became_active":"2023-11-04T01:40:09.749363+0000","last_became_peered":"2023-11-04T01:40:09.749363+0000","last_unstale":"2023-11-04T01:40:11.255702+0000","last_undegraded":"2023-11-04T01:40:11.255702+0000","last_fullsized":"2023-11-04T01:40:11.255702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:18:59.903542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.733435+0000","last_change":"2023-11-04T01:40:05.560460+0000","last_active":"2023-11-04T01:40:09.733435+0000","last_peered":"2023-11-04T01:40:09.733435+0000","last_clean":"2023-11-04T01:40:09.733435+0000","last_became_active":"2023-11-04T01:40:05.560165+0000","last_became_peered":"2023-11-04T01:40:05.560165+0000","last_unstale":"2023-11-04T01:40:09.733435+0000","last_undegraded":"2023-11-04T01:40:09.733435+0000","last_fullsized":"2023-11-04T01:40:09.733435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:24.555185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.728844+0000","last_change":"2023-11-04T01:40:04.708233+0000","last_active":"2023-11-04T01:40:09.728844+0000","last_peered":"2023-11-04T01:40:09.728844+0000","last_clean":"2023-11-04T01:40:09.728844+0000","last_became_active":"2023-11-04T01:40:04.707913+0000","last_became_peered":"2023-11-04T01:40:04.707913+0000","last_unstale":"2023-11-04T01:40:09.728844+0000","last_undegraded":"2023-11-04T01:40:09.728844+0000","last_fullsized":"2023-11-04T01:40:09.728844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:14:24.322290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.549797+0000","last_change":"2023-11-04T01:40:09.743651+0000","last_active":"2023-11-04T01:40:10.549797+0000","last_peered":"2023-11-04T01:40:10.549797+0000","last_clean":"2023-11-04T01:40:10.549797+0000","last_became_active":"2023-11-04T01:40:09.743132+0000","last_became_peered":"2023-11-04T01:40:09.743132+0000","last_unstale":"2023-11-04T01:40:10.549797+0000","last_undegraded":"2023-11-04T01:40:10.549797+0000","last_fullsized":"2023-11-04T01:40:10.549797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:09:57.363528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727847+0000","last_change":"2023-11-04T01:40:05.568979+0000","last_active":"2023-11-04T01:40:09.727847+0000","last_peered":"2023-11-04T01:40:09.727847+0000","last_clean":"2023-11-04T01:40:09.727847+0000","last_became_active":"2023-11-04T01:40:05.568692+0000","last_became_peered":"2023-11-04T01:40:05.568692+0000","last_unstale":"2023-11-04T01:40:09.727847+0000","last_undegraded":"2023-11-04T01:40:09.727847+0000","last_fullsized":"2023-11-04T01:40:09.727847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:24.555185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727941+0000","last_change":"2023-11-04T01:40:04.703998+0000","last_active":"2023-11-04T01:40:09.727941+0000","last_peered":"2023-11-04T01:40:09.727941+0000","last_clean":"2023-11-04T01:40:09.727941+0000","last_became_active":"2023-11-04T01:40:04.703732+0000","last_became_peered":"2023-11-04T01:40:04.703732+0000","last_unstale":"2023-11-04T01:40:09.727941+0000","last_undegraded":"2023-11-04T01:40:09.727941+0000","last_fullsized":"2023-11-04T01:40:09.727941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:15:03.573413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734226+0000","last_change":"2023-11-04T01:40:04.705664+0000","last_active":"2023-11-04T01:40:09.734226+0000","last_peered":"2023-11-04T01:40:09.734226+0000","last_clean":"2023-11-04T01:40:09.734226+0000","last_became_active":"2023-11-04T01:40:04.705126+0000","last_became_peered":"2023-11-04T01:40:04.705126+0000","last_unstale":"2023-11-04T01:40:09.734226+0000","last_undegraded":"2023-11-04T01:40:09.734226+0000","last_fullsized":"2023-11-04T01:40:09.734226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:55:42.496852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732896+0000","last_change":"2023-11-04T01:40:05.560706+0000","last_active":"2023-11-04T01:40:09.732896+0000","last_peered":"2023-11-04T01:40:09.732896+0000","last_clean":"2023-11-04T01:40:09.732896+0000","last_became_active":"2023-11-04T01:40:05.560192+0000","last_became_peered":"2023-11-04T01:40:05.560192+0000","last_unstale":"2023-11-04T01:40:09.732896+0000","last_undegraded":"2023-11-04T01:40:09.732896+0000","last_fullsized":"2023-11-04T01:40:09.732896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:02.182321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255328+0000","last_change":"2023-11-04T01:40:09.754009+0000","last_active":"2023-11-04T01:40:11.255328+0000","last_peered":"2023-11-04T01:40:11.255328+0000","last_clean":"2023-11-04T01:40:11.255328+0000","last_became_active":"2023-11-04T01:40:09.753444+0000","last_became_peered":"2023-11-04T01:40:09.753444+0000","last_unstale":"2023-11-04T01:40:11.255328+0000","last_undegraded":"2023-11-04T01:40:11.255328+0000","last_fullsized":"2023-11-04T01:40:11.255328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:01.582276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727803+0000","last_change":"2023-11-04T01:40:04.701551+0000","last_active":"2023-11-04T01:40:09.727803+0000","last_peered":"2023-11-04T01:40:09.727803+0000","last_clean":"2023-11-04T01:40:09.727803+0000","last_became_active":"2023-11-04T01:40:04.701340+0000","last_became_peered":"2023-11-04T01:40:04.701340+0000","last_unstale":"2023-11-04T01:40:09.727803+0000","last_undegraded":"2023-11-04T01:40:09.727803+0000","last_fullsized":"2023-11-04T01:40:09.727803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:45:01.584709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.736946+0000","last_change":"2023-11-04T01:40:05.564231+0000","last_active":"2023-11-04T01:40:09.736946+0000","last_peered":"2023-11-04T01:40:09.736946+0000","last_clean":"2023-11-04T01:40:09.736946+0000","last_became_active":"2023-11-04T01:40:05.563931+0000","last_became_peered":"2023-11-04T01:40:05.563931+0000","last_unstale":"2023-11-04T01:40:09.736946+0000","last_undegraded":"2023-11-04T01:40:09.736946+0000","last_fullsized":"2023-11-04T01:40:09.736946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:25:21.992534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.551057+0000","last_change":"2023-11-04T01:40:09.744711+0000","last_active":"2023-11-04T01:40:10.551057+0000","last_peered":"2023-11-04T01:40:10.551057+0000","last_clean":"2023-11-04T01:40:10.551057+0000","last_became_active":"2023-11-04T01:40:09.744338+0000","last_became_peered":"2023-11-04T01:40:09.744338+0000","last_unstale":"2023-11-04T01:40:10.551057+0000","last_undegraded":"2023-11-04T01:40:10.551057+0000","last_fullsized":"2023-11-04T01:40:10.551057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:49:35.523050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.737269+0000","last_change":"2023-11-04T01:40:05.567145+0000","last_active":"2023-11-04T01:40:09.737269+0000","last_peered":"2023-11-04T01:40:09.737269+0000","last_clean":"2023-11-04T01:40:09.737269+0000","last_became_active":"2023-11-04T01:40:05.566731+0000","last_became_peered":"2023-11-04T01:40:05.566731+0000","last_unstale":"2023-11-04T01:40:09.737269+0000","last_undegraded":"2023-11-04T01:40:09.737269+0000","last_fullsized":"2023-11-04T01:40:09.737269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:51:09.123583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.736001+0000","last_change":"2023-11-04T01:40:05.579375+0000","last_active":"2023-11-04T01:40:09.736001+0000","last_peered":"2023-11-04T01:40:09.736001+0000","last_clean":"2023-11-04T01:40:09.736001+0000","last_became_active":"2023-11-04T01:40:05.579083+0000","last_became_peered":"2023-11-04T01:40:05.579083+0000","last_unstale":"2023-11-04T01:40:09.736001+0000","last_undegraded":"2023-11-04T01:40:09.736001+0000","last_fullsized":"2023-11-04T01:40:09.736001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:25:21.992534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729856+0000","last_change":"2023-11-04T01:40:05.577656+0000","last_active":"2023-11-04T01:40:09.729856+0000","last_peered":"2023-11-04T01:40:09.729856+0000","last_clean":"2023-11-04T01:40:09.729856+0000","last_became_active":"2023-11-04T01:40:05.577375+0000","last_became_peered":"2023-11-04T01:40:05.577375+0000","last_unstale":"2023-11-04T01:40:09.729856+0000","last_undegraded":"2023-11-04T01:40:09.729856+0000","last_fullsized":"2023-11-04T01:40:09.729856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:46:18.951640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732817+0000","last_change":"2023-11-04T01:40:05.562307+0000","last_active":"2023-11-04T01:40:09.732817+0000","last_peered":"2023-11-04T01:40:09.732817+0000","last_clean":"2023-11-04T01:40:09.732817+0000","last_became_active":"2023-11-04T01:40:05.562060+0000","last_became_peered":"2023-11-04T01:40:05.562060+0000","last_unstale":"2023-11-04T01:40:09.732817+0000","last_undegraded":"2023-11-04T01:40:09.732817+0000","last_fullsized":"2023-11-04T01:40:09.732817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:09:40.586446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.728326+0000","last_change":"2023-11-04T01:40:05.565815+0000","last_active":"2023-11-04T01:40:09.728326+0000","last_peered":"2023-11-04T01:40:09.728326+0000","last_clean":"2023-11-04T01:40:09.728326+0000","last_became_active":"2023-11-04T01:40:05.565356+0000","last_became_peered":"2023-11-04T01:40:05.565356+0000","last_unstale":"2023-11-04T01:40:09.728326+0000","last_undegraded":"2023-11-04T01:40:09.728326+0000","last_fullsized":"2023-11-04T01:40:09.728326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:46:18.951640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734702+0000","last_change":"2023-11-04T01:40:05.560477+0000","last_active":"2023-11-04T01:40:09.734702+0000","last_peered":"2023-11-04T01:40:09.734702+0000","last_clean":"2023-11-04T01:40:09.734702+0000","last_became_active":"2023-11-04T01:40:05.560213+0000","last_became_peered":"2023-11-04T01:40:05.560213+0000","last_unstale":"2023-11-04T01:40:09.734702+0000","last_undegraded":"2023-11-04T01:40:09.734702+0000","last_fullsized":"2023-11-04T01:40:09.734702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:02.182321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.735601+0000","last_change":"2023-11-04T01:40:05.562260+0000","last_active":"2023-11-04T01:40:09.735601+0000","last_peered":"2023-11-04T01:40:09.735601+0000","last_clean":"2023-11-04T01:40:09.735601+0000","last_became_active":"2023-11-04T01:40:05.561788+0000","last_became_peered":"2023-11-04T01:40:05.561788+0000","last_unstale":"2023-11-04T01:40:09.735601+0000","last_undegraded":"2023-11-04T01:40:09.735601+0000","last_fullsized":"2023-11-04T01:40:09.735601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:46:18.951640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.728083+0000","last_change":"2023-11-04T01:40:05.565701+0000","last_active":"2023-11-04T01:40:09.728083+0000","last_peered":"2023-11-04T01:40:09.728083+0000","last_clean":"2023-11-04T01:40:09.728083+0000","last_became_active":"2023-11-04T01:40:05.565414+0000","last_became_peered":"2023-11-04T01:40:05.565414+0000","last_unstale":"2023-11-04T01:40:09.728083+0000","last_undegraded":"2023-11-04T01:40:09.728083+0000","last_fullsized":"2023-11-04T01:40:09.728083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:35:55.027288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.728758+0000","last_change":"2023-11-04T01:40:05.578120+0000","last_active":"2023-11-04T01:40:09.728758+0000","last_peered":"2023-11-04T01:40:09.728758+0000","last_clean":"2023-11-04T01:40:09.728758+0000","last_became_active":"2023-11-04T01:40:05.576353+0000","last_became_peered":"2023-11-04T01:40:05.576353+0000","last_unstale":"2023-11-04T01:40:09.728758+0000","last_undegraded":"2023-11-04T01:40:09.728758+0000","last_fullsized":"2023-11-04T01:40:09.728758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:43.060452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727831+0000","last_change":"2023-11-04T01:40:05.565797+0000","last_active":"2023-11-04T01:40:09.727831+0000","last_peered":"2023-11-04T01:40:09.727831+0000","last_clean":"2023-11-04T01:40:09.727831+0000","last_became_active":"2023-11-04T01:40:05.565341+0000","last_became_peered":"2023-11-04T01:40:05.565341+0000","last_unstale":"2023-11-04T01:40:09.727831+0000","last_undegraded":"2023-11-04T01:40:09.727831+0000","last_fullsized":"2023-11-04T01:40:09.727831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:51:09.123583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.730213+0000","last_change":"2023-11-04T01:40:05.576354+0000","last_active":"2023-11-04T01:40:09.730213+0000","last_peered":"2023-11-04T01:40:09.730213+0000","last_clean":"2023-11-04T01:40:09.730213+0000","last_became_active":"2023-11-04T01:40:05.576041+0000","last_became_peered":"2023-11-04T01:40:05.576041+0000","last_unstale":"2023-11-04T01:40:09.730213+0000","last_undegraded":"2023-11-04T01:40:09.730213+0000","last_fullsized":"2023-11-04T01:40:09.730213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:17.862444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732728+0000","last_change":"2023-11-04T01:40:05.558627+0000","last_active":"2023-11-04T01:40:09.732728+0000","last_peered":"2023-11-04T01:40:09.732728+0000","last_clean":"2023-11-04T01:40:09.732728+0000","last_became_active":"2023-11-04T01:40:05.558323+0000","last_became_peered":"2023-11-04T01:40:05.558323+0000","last_unstale":"2023-11-04T01:40:09.732728+0000","last_undegraded":"2023-11-04T01:40:09.732728+0000","last_fullsized":"2023-11-04T01:40:09.732728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:02.201965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.735029+0000","last_change":"2023-11-04T01:40:05.565842+0000","last_active":"2023-11-04T01:40:09.735029+0000","last_peered":"2023-11-04T01:40:09.735029+0000","last_clean":"2023-11-04T01:40:09.735029+0000","last_became_active":"2023-11-04T01:40:05.565557+0000","last_became_peered":"2023-11-04T01:40:05.565557+0000","last_unstale":"2023-11-04T01:40:09.735029+0000","last_undegraded":"2023-11-04T01:40:09.735029+0000","last_fullsized":"2023-11-04T01:40:09.735029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:02.182321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732064+0000","last_change":"2023-11-04T01:40:05.557783+0000","last_active":"2023-11-04T01:40:09.732064+0000","last_peered":"2023-11-04T01:40:09.732064+0000","last_clean":"2023-11-04T01:40:09.732064+0000","last_became_active":"2023-11-04T01:40:05.557468+0000","last_became_peered":"2023-11-04T01:40:05.557468+0000","last_unstale":"2023-11-04T01:40:09.732064+0000","last_undegraded":"2023-11-04T01:40:09.732064+0000","last_fullsized":"2023-11-04T01:40:09.732064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:21.851664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.737029+0000","last_change":"2023-11-04T01:40:05.559446+0000","last_active":"2023-11-04T01:40:09.737029+0000","last_peered":"2023-11-04T01:40:09.737029+0000","last_clean":"2023-11-04T01:40:09.737029+0000","last_became_active":"2023-11-04T01:40:05.559182+0000","last_became_peered":"2023-11-04T01:40:05.559182+0000","last_unstale":"2023-11-04T01:40:09.737029+0000","last_undegraded":"2023-11-04T01:40:09.737029+0000","last_fullsized":"2023-11-04T01:40:09.737029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:45:02.590707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.730805+0000","last_change":"2023-11-04T01:40:05.577084+0000","last_active":"2023-11-04T01:40:09.730805+0000","last_peered":"2023-11-04T01:40:09.730805+0000","last_clean":"2023-11-04T01:40:09.730805+0000","last_became_active":"2023-11-04T01:40:05.576079+0000","last_became_peered":"2023-11-04T01:40:05.576079+0000","last_unstale":"2023-11-04T01:40:09.730805+0000","last_undegraded":"2023-11-04T01:40:09.730805+0000","last_fullsized":"2023-11-04T01:40:09.730805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:18:55.872119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.728665+0000","last_change":"2023-11-04T01:40:05.577325+0000","last_active":"2023-11-04T01:40:09.728665+0000","last_peered":"2023-11-04T01:40:09.728665+0000","last_clean":"2023-11-04T01:40:09.728665+0000","last_became_active":"2023-11-04T01:40:05.576140+0000","last_became_peered":"2023-11-04T01:40:05.576140+0000","last_unstale":"2023-11-04T01:40:09.728665+0000","last_undegraded":"2023-11-04T01:40:09.728665+0000","last_fullsized":"2023-11-04T01:40:09.728665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:15.017965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.733522+0000","last_change":"2023-11-04T01:40:05.564247+0000","last_active":"2023-11-04T01:40:09.733522+0000","last_peered":"2023-11-04T01:40:09.733522+0000","last_clean":"2023-11-04T01:40:09.733522+0000","last_became_active":"2023-11-04T01:40:05.563816+0000","last_became_peered":"2023-11-04T01:40:05.563816+0000","last_unstale":"2023-11-04T01:40:09.733522+0000","last_undegraded":"2023-11-04T01:40:09.733522+0000","last_fullsized":"2023-11-04T01:40:09.733522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:51:09.123583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732014+0000","last_change":"2023-11-04T01:40:05.556907+0000","last_active":"2023-11-04T01:40:09.732014+0000","last_peered":"2023-11-04T01:40:09.732014+0000","last_clean":"2023-11-04T01:40:09.732014+0000","last_became_active":"2023-11-04T01:40:05.556614+0000","last_became_peered":"2023-11-04T01:40:05.556614+0000","last_unstale":"2023-11-04T01:40:09.732014+0000","last_undegraded":"2023-11-04T01:40:09.732014+0000","last_fullsized":"2023-11-04T01:40:09.732014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:15:04.579412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727610+0000","last_change":"2023-11-04T01:40:05.561125+0000","last_active":"2023-11-04T01:40:09.727610+0000","last_peered":"2023-11-04T01:40:09.727610+0000","last_clean":"2023-11-04T01:40:09.727610+0000","last_became_active":"2023-11-04T01:40:05.560864+0000","last_became_peered":"2023-11-04T01:40:05.560864+0000","last_unstale":"2023-11-04T01:40:09.727610+0000","last_undegraded":"2023-11-04T01:40:09.727610+0000","last_fullsized":"2023-11-04T01:40:09.727610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:02.182321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.737747+0000","last_change":"2023-11-04T01:40:05.568756+0000","last_active":"2023-11-04T01:40:09.737747+0000","last_peered":"2023-11-04T01:40:09.737747+0000","last_clean":"2023-11-04T01:40:09.737747+0000","last_became_active":"2023-11-04T01:40:05.568238+0000","last_became_peered":"2023-11-04T01:40:05.568238+0000","last_unstale":"2023-11-04T01:40:09.737747+0000","last_undegraded":"2023-11-04T01:40:09.737747+0000","last_fullsized":"2023-11-04T01:40:09.737747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:36.229155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734018+0000","last_change":"2023-11-04T01:40:05.580104+0000","last_active":"2023-11-04T01:40:09.734018+0000","last_peered":"2023-11-04T01:40:09.734018+0000","last_clean":"2023-11-04T01:40:09.734018+0000","last_became_active":"2023-11-04T01:40:05.579830+0000","last_became_peered":"2023-11-04T01:40:05.579830+0000","last_unstale":"2023-11-04T01:40:09.734018+0000","last_undegraded":"2023-11-04T01:40:09.734018+0000","last_fullsized":"2023-11-04T01:40:09.734018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:09:40.586446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.735529+0000","last_change":"2023-11-04T01:40:05.577828+0000","last_active":"2023-11-04T01:40:09.735529+0000","last_peered":"2023-11-04T01:40:09.735529+0000","last_clean":"2023-11-04T01:40:09.735529+0000","last_became_active":"2023-11-04T01:40:05.577524+0000","last_became_peered":"2023-11-04T01:40:05.577524+0000","last_unstale":"2023-11-04T01:40:09.735529+0000","last_undegraded":"2023-11-04T01:40:09.735529+0000","last_fullsized":"2023-11-04T01:40:09.735529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:17.862444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732444+0000","last_change":"2023-11-04T01:40:05.578036+0000","last_active":"2023-11-04T01:40:09.732444+0000","last_peered":"2023-11-04T01:40:09.732444+0000","last_clean":"2023-11-04T01:40:09.732444+0000","last_became_active":"2023-11-04T01:40:05.577711+0000","last_became_peered":"2023-11-04T01:40:05.577711+0000","last_unstale":"2023-11-04T01:40:09.732444+0000","last_undegraded":"2023-11-04T01:40:09.732444+0000","last_fullsized":"2023-11-04T01:40:09.732444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:43.060452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727075+0000","last_change":"2023-11-04T01:40:05.576720+0000","last_active":"2023-11-04T01:40:09.727075+0000","last_peered":"2023-11-04T01:40:09.727075+0000","last_clean":"2023-11-04T01:40:09.727075+0000","last_became_active":"2023-11-04T01:40:05.576465+0000","last_became_peered":"2023-11-04T01:40:05.576465+0000","last_unstale":"2023-11-04T01:40:09.727075+0000","last_undegraded":"2023-11-04T01:40:09.727075+0000","last_fullsized":"2023-11-04T01:40:09.727075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:02.201965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731346+0000","last_change":"2023-11-04T01:40:05.561827+0000","last_active":"2023-11-04T01:40:09.731346+0000","last_peered":"2023-11-04T01:40:09.731346+0000","last_clean":"2023-11-04T01:40:09.731346+0000","last_became_active":"2023-11-04T01:40:05.560891+0000","last_became_peered":"2023-11-04T01:40:05.560891+0000","last_unstale":"2023-11-04T01:40:09.731346+0000","last_undegraded":"2023-11-04T01:40:09.731346+0000","last_fullsized":"2023-11-04T01:40:09.731346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:35:55.027288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729758+0000","last_change":"2023-11-04T01:40:05.577149+0000","last_active":"2023-11-04T01:40:09.729758+0000","last_peered":"2023-11-04T01:40:09.729758+0000","last_clean":"2023-11-04T01:40:09.729758+0000","last_became_active":"2023-11-04T01:40:05.576800+0000","last_became_peered":"2023-11-04T01:40:05.576800+0000","last_unstale":"2023-11-04T01:40:09.729758+0000","last_undegraded":"2023-11-04T01:40:09.729758+0000","last_fullsized":"2023-11-04T01:40:09.729758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:02.182321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731574+0000","last_change":"2023-11-04T01:40:05.557217+0000","last_active":"2023-11-04T01:40:09.731574+0000","last_peered":"2023-11-04T01:40:09.731574+0000","last_clean":"2023-11-04T01:40:09.731574+0000","last_became_active":"2023-11-04T01:40:05.556849+0000","last_became_peered":"2023-11-04T01:40:05.556849+0000","last_unstale":"2023-11-04T01:40:09.731574+0000","last_undegraded":"2023-11-04T01:40:09.731574+0000","last_fullsized":"2023-11-04T01:40:09.731574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:09:53.332106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729505+0000","last_change":"2023-11-04T01:40:05.579108+0000","last_active":"2023-11-04T01:40:09.729505+0000","last_peered":"2023-11-04T01:40:09.729505+0000","last_clean":"2023-11-04T01:40:09.729505+0000","last_became_active":"2023-11-04T01:40:05.578820+0000","last_became_peered":"2023-11-04T01:40:05.578820+0000","last_unstale":"2023-11-04T01:40:09.729505+0000","last_undegraded":"2023-11-04T01:40:09.729505+0000","last_fullsized":"2023-11-04T01:40:09.729505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:45:17.797764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.733836+0000","last_change":"2023-11-04T01:40:05.560589+0000","last_active":"2023-11-04T01:40:09.733836+0000","last_peered":"2023-11-04T01:40:09.733836+0000","last_clean":"2023-11-04T01:40:09.733836+0000","last_became_active":"2023-11-04T01:40:05.559671+0000","last_became_peered":"2023-11-04T01:40:05.559671+0000","last_unstale":"2023-11-04T01:40:09.733836+0000","last_undegraded":"2023-11-04T01:40:09.733836+0000","last_fullsized":"2023-11-04T01:40:09.733836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:14:25.328288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734422+0000","last_change":"2023-11-04T01:40:05.564381+0000","last_active":"2023-11-04T01:40:09.734422+0000","last_peered":"2023-11-04T01:40:09.734422+0000","last_clean":"2023-11-04T01:40:09.734422+0000","last_became_active":"2023-11-04T01:40:05.564046+0000","last_became_peered":"2023-11-04T01:40:05.564046+0000","last_unstale":"2023-11-04T01:40:09.734422+0000","last_undegraded":"2023-11-04T01:40:09.734422+0000","last_fullsized":"2023-11-04T01:40:09.734422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:17.862444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732359+0000","last_change":"2023-11-04T01:40:05.561850+0000","last_active":"2023-11-04T01:40:09.732359+0000","last_peered":"2023-11-04T01:40:09.732359+0000","last_clean":"2023-11-04T01:40:09.732359+0000","last_became_active":"2023-11-04T01:40:05.561463+0000","last_became_peered":"2023-11-04T01:40:05.561463+0000","last_unstale":"2023-11-04T01:40:09.732359+0000","last_undegraded":"2023-11-04T01:40:09.732359+0000","last_fullsized":"2023-11-04T01:40:09.732359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:14:17.945716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":99918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":99792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":99952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":689779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.222}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:40:23.855 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T01:40:23.855 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-04T01:40:23.855 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-04T01:40:23.856 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-04T01:40:23.856 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-04T01:40:23.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.986+0000 7f6319a0e640 1 Processor -- start 2023-11-04T01:40:23.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.986+0000 7f6319a0e640 1 -- start start 2023-11-04T01:40:23.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.987+0000 7f6319a0e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f63140cf870 0x7f6314160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:23.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.987+0000 7f6319a0e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f631406bf00 con 0x7f631415ce60 2023-11-04T01:40:23.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.987+0000 7f6319a0e640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63141615d0 con 0x7f6314160b10 2023-11-04T01:40:23.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.987+0000 7f6319a0e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63140cbde0 con 0x7f63140cf870 2023-11-04T01:40:23.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.987+0000 7f6312ffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f631415ce60 0x7f631406b7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52590/0 (socket says 172.21.15.77:52590) 2023-11-04T01:40:23.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.987+0000 7f6312ffd640 1 -- 172.21.15.77:0/571345372 learned_addr learned my addr 172.21.15.77:0/571345372 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:23.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.987+0000 7f63137fe640 1 --2- 172.21.15.77:0/571345372 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f63140cf870 0x7f6314160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:23.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.987+0000 7f6311ffb640 1 -- 172.21.15.77:0/571345372 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302557414 0 0) 0x7f631406bf00 con 0x7f631415ce60 2023-11-04T01:40:23.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.987+0000 7f6311ffb640 1 -- 172.21.15.77:0/571345372 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62fc003520 con 0x7f631415ce60 2023-11-04T01:40:23.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.988+0000 7f6311ffb640 1 -- 172.21.15.77:0/571345372 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 929952994 0 0) 0x7f62fc003520 con 0x7f631415ce60 2023-11-04T01:40:23.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.988+0000 7f6311ffb640 1 -- 172.21.15.77:0/571345372 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f63140cf870 msgr2=0x7f6314160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:23.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.988+0000 7f6311ffb640 1 --2- 172.21.15.77:0/571345372 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f63140cf870 0x7f6314160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.988+0000 7f6311ffb640 1 -- 172.21.15.77:0/571345372 >> v1:172.21.15.122:6789/0 conn(0x7f6314160b10 legacy=0x7f63140cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:23.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.988+0000 7f6311ffb640 1 -- 172.21.15.77:0/571345372 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63141618b0 con 0x7f631415ce60 2023-11-04T01:40:23.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.988+0000 7f6311ffb640 1 -- 172.21.15.77:0/571345372 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f63040019f0 con 0x7f631415ce60 2023-11-04T01:40:23.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.988+0000 7f6311ffb640 1 -- 172.21.15.77:0/571345372 >> v1:172.21.15.77:6789/0 conn(0x7f631415ce60 legacy=0x7f631406b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:23.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.988+0000 7f6311ffb640 1 --2- 172.21.15.77:0/571345372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62fc0039a0 0x7f62fc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:23.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.988+0000 7f6311ffb640 1 --2- 172.21.15.77:0/571345372 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f63140cf870 0x7f62fc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:23.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.988+0000 7f6311ffb640 1 --2- 172.21.15.77:0/571345372 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f62fc004d00 0x7f62fc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:23.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.988+0000 7f6311ffb640 1 -- 172.21.15.77:0/571345372 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63140cbde0 con 0x7f62fc0039a0 2023-11-04T01:40:23.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.988+0000 7f6311ffb640 1 -- 172.21.15.77:0/571345372 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc00ba60 con 0x7f62fc004d00 2023-11-04T01:40:23.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.988+0000 7f6311ffb640 1 -- 172.21.15.77:0/571345372 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc00bc20 con 0x7f63140cf870 2023-11-04T01:40:23.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.988+0000 7f6312ffd640 1 --2- 172.21.15.77:0/571345372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62fc0039a0 0x7f62fc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:23.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.988+0000 7f63127fc640 1 --2- 172.21.15.77:0/571345372 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f63140cf870 0x7f62fc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:23.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.988+0000 7f63137fe640 1 --2- 172.21.15.77:0/571345372 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f62fc004d00 0x7f62fc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:23.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.988+0000 7f6312ffd640 1 -- 172.21.15.77:0/571345372 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f63140cf870 msgr2=0x7f62fc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:23.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.988+0000 7f6312ffd640 1 --2- 172.21.15.77:0/571345372 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f63140cf870 0x7f62fc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.988+0000 7f6312ffd640 1 -- 172.21.15.77:0/571345372 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f62fc004d00 msgr2=0x7f62fc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:23.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.988+0000 7f6312ffd640 1 --2- 172.21.15.77:0/571345372 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f62fc004d00 0x7f62fc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:23.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.988+0000 7f6312ffd640 1 -- 172.21.15.77:0/571345372 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62fc003520 con 0x7f62fc0039a0 2023-11-04T01:40:23.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.988+0000 7f63127fc640 1 --2- 172.21.15.77:0/571345372 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f63140cf870 0x7f62fc0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:23.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.988+0000 7f63137fe640 1 --2- 172.21.15.77:0/571345372 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f62fc004d00 0x7f62fc005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:23.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.989+0000 7f6312ffd640 1 --2- 172.21.15.77:0/571345372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62fc0039a0 0x7f62fc003dc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f630400a800 tx=0x7f62fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89305a72664514dd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:23.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.989+0000 7f6311ffb640 1 -- 172.21.15.77:0/571345372 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63040072d0 con 0x7f62fc0039a0 2023-11-04T01:40:23.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.989+0000 7f6311ffb640 1 -- 172.21.15.77:0/571345372 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630402f070 con 0x7f62fc0039a0 2023-11-04T01:40:23.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.989+0000 7f6311ffb640 1 -- 172.21.15.77:0/571345372 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6304007690 con 0x7f62fc0039a0 2023-11-04T01:40:23.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.989+0000 7f6319a0e640 1 -- 172.21.15.77:0/571345372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62fc0039a0 msgr2=0x7f62fc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:24.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.989+0000 7f6319a0e640 1 --2- 172.21.15.77:0/571345372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62fc0039a0 0x7f62fc003dc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f630400a800 tx=0x7f62fc0057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.989+0000 7f63137fe640 1 -- 172.21.15.77:0/571345372 reap_dead start 2023-11-04T01:40:24.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.989+0000 7f6319a0e640 1 -- 172.21.15.77:0/571345372 shutdown_connections 2023-11-04T01:40:24.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.989+0000 7f6319a0e640 1 -- 172.21.15.77:0/571345372 >> 172.21.15.77:0/571345372 conn(0x7f631406ea90 msgr2=0x7f631406ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:24.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.989+0000 7f6319a0e640 1 -- 172.21.15.77:0/571345372 shutdown_connections 2023-11-04T01:40:24.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.989+0000 7f6319a0e640 1 -- 172.21.15.77:0/571345372 wait complete. 2023-11-04T01:40:24.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.991+0000 7f6319a0e640 1 Processor -- start 2023-11-04T01:40:24.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.991+0000 7f6319a0e640 1 -- start start 2023-11-04T01:40:24.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.991+0000 7f6319a0e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f62fc0039a0 0x7f63141f69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:24.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.991+0000 7f6319a0e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f631414ec70 0x7f63140b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:24.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.991+0000 7f6319a0e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f631414dfc0 0x7f631414e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:24.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.991+0000 7f6319a0e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63141f6f00 con 0x7f631414dfc0 2023-11-04T01:40:24.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.991+0000 7f6319a0e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631414e990 con 0x7f631414ec70 2023-11-04T01:40:24.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.991+0000 7f6319a0e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f631415d240 con 0x7f62fc0039a0 2023-11-04T01:40:24.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.992+0000 7f63137fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f631414dfc0 0x7f631414e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:24.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.992+0000 7f63137fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f631414dfc0 0x7f631414e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56734/0 (socket says 172.21.15.77:56734) 2023-11-04T01:40:24.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.992+0000 7f63137fe640 1 -- 172.21.15.77:0/2301741542 learned_addr learned my addr 172.21.15.77:0/2301741542 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:24.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.992+0000 7f6312ffd640 1 --2- 172.21.15.77:0/2301741542 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f62fc0039a0 0x7f63141f69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:24.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.992+0000 7f63127fc640 1 --2- 172.21.15.77:0/2301741542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f631414ec70 0x7f63140b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:24.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.992+0000 7f63137fe640 1 -- 172.21.15.77:0/2301741542 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f62fc0039a0 msgr2=0x7f63141f69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:24.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.992+0000 7f63137fe640 1 --2- 172.21.15.77:0/2301741542 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f62fc0039a0 0x7f63141f69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.992+0000 7f63137fe640 1 -- 172.21.15.77:0/2301741542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f631414ec70 msgr2=0x7f63140b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:24.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.992+0000 7f63137fe640 1 --2- 172.21.15.77:0/2301741542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f631414ec70 0x7f63140b4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.992+0000 7f63137fe640 1 -- 172.21.15.77:0/2301741542 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631415d490 con 0x7f631414dfc0 2023-11-04T01:40:24.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.992+0000 7f6312ffd640 1 --2- 172.21.15.77:0/2301741542 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f62fc0039a0 0x7f63141f69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:24.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.992+0000 7f63127fc640 1 --2- 172.21.15.77:0/2301741542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f631414ec70 0x7f63140b4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:24.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.992+0000 7f63137fe640 1 --2- 172.21.15.77:0/2301741542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f631414dfc0 0x7f631414e450 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f63140cb1a0 tx=0x7f630c011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:24.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.992+0000 7f62fbfff640 1 -- 172.21.15.77:0/2301741542 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630c004440 con 0x7f631414dfc0 2023-11-04T01:40:24.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.992+0000 7f62fbfff640 1 -- 172.21.15.77:0/2301741542 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630c003610 con 0x7f631414dfc0 2023-11-04T01:40:24.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.992+0000 7f62fbfff640 1 -- 172.21.15.77:0/2301741542 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630c0039a0 con 0x7f631414dfc0 2023-11-04T01:40:24.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.992+0000 7f6319a0e640 1 -- 172.21.15.77:0/2301741542 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f631415d770 con 0x7f631414dfc0 2023-11-04T01:40:24.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.992+0000 7f6319a0e640 1 -- 172.21.15.77:0/2301741542 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f631415dd30 con 0x7f631414dfc0 2023-11-04T01:40:24.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.993+0000 7f6319a0e640 1 -- 172.21.15.77:0/2301741542 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6314074290 con 0x7f631414dfc0 2023-11-04T01:40:24.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.994+0000 7f62fbfff640 1 -- 172.21.15.77:0/2301741542 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f630c003b00 con 0x7f631414dfc0 2023-11-04T01:40:24.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.994+0000 7f62fbfff640 1 --2- 172.21.15.77:0/2301741542 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f630006ae70 0x7f630006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:24.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.994+0000 7f62fbfff640 1 -- 172.21.15.77:0/2301741542 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f630c089900 con 0x7f631414dfc0 2023-11-04T01:40:24.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.994+0000 7f6312ffd640 1 --2- 172.21.15.77:0/2301741542 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f630006ae70 0x7f630006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:24.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.995+0000 7f6312ffd640 1 --2- 172.21.15.77:0/2301741542 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f630006ae70 0x7f630006d330 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6304034000 tx=0x7f6304007000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:24.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:23.998+0000 7f62fbfff640 1 -- 172.21.15.77:0/2301741542 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f630c0546c0 con 0x7f631414dfc0 2023-11-04T01:40:24.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.210+0000 7f6319a0e640 1 -- 172.21.15.77:0/2301741542 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f631406b3e0 con 0x7f631414dfc0 2023-11-04T01:40:24.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.213+0000 7f62fbfff640 1 -- 172.21.15.77:0/2301741542 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171039 (secure 0 0 0) 0x7f630c003db0 con 0x7f631414dfc0 2023-11-04T01:40:24.217 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:24.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.216+0000 7f6319a0e640 1 -- 172.21.15.77:0/2301741542 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f630006ae70 msgr2=0x7f630006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:24.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.216+0000 7f6319a0e640 1 --2- 172.21.15.77:0/2301741542 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f630006ae70 0x7f630006d330 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6304034000 tx=0x7f6304007000 comp rx=0 tx=0).stop 2023-11-04T01:40:24.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.216+0000 7f6319a0e640 1 -- 172.21.15.77:0/2301741542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f631414dfc0 msgr2=0x7f631414e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:24.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.216+0000 7f6319a0e640 1 --2- 172.21.15.77:0/2301741542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f631414dfc0 0x7f631414e450 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f63140cb1a0 tx=0x7f630c011920 comp rx=0 tx=0).stop 2023-11-04T01:40:24.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.216+0000 7f6319a0e640 1 -- 172.21.15.77:0/2301741542 shutdown_connections 2023-11-04T01:40:24.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.216+0000 7f6319a0e640 1 --2- 172.21.15.77:0/2301741542 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f630006ae70 0x7f630006d330 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.216+0000 7f6319a0e640 1 --2- 172.21.15.77:0/2301741542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f631414dfc0 0x7f631414e450 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.216+0000 7f6319a0e640 1 --2- 172.21.15.77:0/2301741542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f631414ec70 0x7f63140b4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.216+0000 7f6319a0e640 1 --2- 172.21.15.77:0/2301741542 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f62fc0039a0 0x7f63141f69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.216+0000 7f6319a0e640 1 -- 172.21.15.77:0/2301741542 >> 172.21.15.77:0/2301741542 conn(0x7f631406ea90 msgr2=0x7f631406c120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:24.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.216+0000 7f6319a0e640 1 -- 172.21.15.77:0/2301741542 shutdown_connections 2023-11-04T01:40:24.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.216+0000 7f6319a0e640 1 -- 172.21.15.77:0/2301741542 wait complete. 2023-11-04T01:40:24.228 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":5,"active_gid":4123,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2275325762},{"type":"v1","addr":"172.21.15.122:6833","nonce":2275325762}]},"active_addr":"172.21.15.122:6833/2275325762","active_change":"2023-11-04T01:39:45.614718+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4113,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:v0.0.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:v0.0.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.122:0","nonce":1175549782}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.122:0","nonce":3035325435}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.122:0","nonce":2789506159}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.122:0","nonce":2319097426}]}]} 2023-11-04T01:40:24.232 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-04T01:40:24.232 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-04T01:40:24.233 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:24.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.330+0000 7f31633a9640 1 Processor -- start 2023-11-04T01:40:24.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.330+0000 7f31633a9640 1 -- start start 2023-11-04T01:40:24.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.331+0000 7f31633a9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f315c15ce60 0x7f315c06b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:24.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.331+0000 7f31633a9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f315c06bd30 0x7f315c160b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:24.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.331+0000 7f31633a9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f315c161050 0x7f315c0cf160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:24.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.331+0000 7f31633a9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f315c0cbde0 con 0x7f315c15ce60 2023-11-04T01:40:24.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.331+0000 7f31633a9640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f315c1615d0 con 0x7f315c06bd30 2023-11-04T01:40:24.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.331+0000 7f31633a9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f315c1618b0 con 0x7f315c161050 2023-11-04T01:40:24.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.331+0000 7f3161145640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f315c15ce60 0x7f315c06b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:24.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.331+0000 7f3161145640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f315c15ce60 0x7f315c06b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56748/0 (socket says 172.21.15.77:56748) 2023-11-04T01:40:24.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.331+0000 7f3161145640 1 -- 172.21.15.77:0/731745350 learned_addr learned my addr 172.21.15.77:0/731745350 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:24.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.332+0000 7f3161946640 1 --2- 172.21.15.77:0/731745350 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f315c161050 0x7f315c0cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:24.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.332+0000 7f3160944640 1 --2- 172.21.15.77:0/731745350 >> v2:172.21.15.122:3300/0 conn(0x7f315c06bd30 0x7f315c160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:24.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.332+0000 7f3161145640 1 -- 172.21.15.77:0/731745350 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f315c161050 msgr2=0x7f315c0cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:24.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.332+0000 7f3161145640 1 --2- 172.21.15.77:0/731745350 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f315c161050 0x7f315c0cf160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.332+0000 7f3161145640 1 -- 172.21.15.77:0/731745350 >> v2:172.21.15.122:3300/0 conn(0x7f315c06bd30 msgr2=0x7f315c160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:24.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.332+0000 7f3161145640 1 --2- 172.21.15.77:0/731745350 >> v2:172.21.15.122:3300/0 conn(0x7f315c06bd30 0x7f315c160b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.332+0000 7f3161145640 1 -- 172.21.15.77:0/731745350 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315c0cba00 con 0x7f315c15ce60 2023-11-04T01:40:24.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.332+0000 7f3161145640 1 --2- 172.21.15.77:0/731745350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f315c15ce60 0x7f315c06b7f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f315c072590 tx=0x7f315402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c09d692bba54ff23 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:24.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.332+0000 7f315bfff640 1 -- 172.21.15.77:0/731745350 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315402ca70 con 0x7f315c15ce60 2023-11-04T01:40:24.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.333+0000 7f315bfff640 1 -- 172.21.15.77:0/731745350 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315402cbd0 con 0x7f315c15ce60 2023-11-04T01:40:24.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.333+0000 7f315bfff640 1 -- 172.21.15.77:0/731745350 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31540343f0 con 0x7f315c15ce60 2023-11-04T01:40:24.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.333+0000 7f31633a9640 1 -- 172.21.15.77:0/731745350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f315c15ce60 msgr2=0x7f315c06b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:24.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.333+0000 7f31633a9640 1 --2- 172.21.15.77:0/731745350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f315c15ce60 0x7f315c06b7f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f315c072590 tx=0x7f315402bed0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.333+0000 7f31633a9640 1 -- 172.21.15.77:0/731745350 shutdown_connections 2023-11-04T01:40:24.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.333+0000 7f31633a9640 1 --2- 172.21.15.77:0/731745350 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f315c161050 0x7f315c0cf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.333+0000 7f31633a9640 1 --2- 172.21.15.77:0/731745350 >> v2:172.21.15.122:3300/0 conn(0x7f315c06bd30 0x7f315c160b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.333+0000 7f31633a9640 1 --2- 172.21.15.77:0/731745350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f315c15ce60 0x7f315c06b7f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.333+0000 7f31633a9640 1 -- 172.21.15.77:0/731745350 >> 172.21.15.77:0/731745350 conn(0x7f315c06ea90 msgr2=0x7f315c06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:24.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.333+0000 7f31633a9640 1 -- 172.21.15.77:0/731745350 shutdown_connections 2023-11-04T01:40:24.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.333+0000 7f31633a9640 1 -- 172.21.15.77:0/731745350 wait complete. 2023-11-04T01:40:24.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.334+0000 7f31633a9640 1 Processor -- start 2023-11-04T01:40:24.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.334+0000 7f31633a9640 1 -- start start 2023-11-04T01:40:24.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.335+0000 7f31633a9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f315c15ce60 0x7f315c1f22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:24.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.335+0000 7f31633a9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f315c161050 0x7f315c15f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:24.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.335+0000 7f31633a9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f315c1f34d0 0x7f315c0cc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:24.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.335+0000 7f31633a9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315c0c96c0 con 0x7f315c15ce60 2023-11-04T01:40:24.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.335+0000 7f31633a9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315c0c8df0 con 0x7f315c1f34d0 2023-11-04T01:40:24.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.335+0000 7f31633a9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f315c158960 con 0x7f315c161050 2023-11-04T01:40:24.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.335+0000 7f3161145640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f315c15ce60 0x7f315c1f22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:24.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.335+0000 7f3161145640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f315c15ce60 0x7f315c1f22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56752/0 (socket says 172.21.15.77:56752) 2023-11-04T01:40:24.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.335+0000 7f3161145640 1 -- 172.21.15.77:0/2310549868 learned_addr learned my addr 172.21.15.77:0/2310549868 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:24.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.335+0000 7f3160944640 1 --2- 172.21.15.77:0/2310549868 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f315c161050 0x7f315c15f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:24.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.335+0000 7f3161946640 1 --2- 172.21.15.77:0/2310549868 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f315c1f34d0 0x7f315c0cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:24.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.335+0000 7f3161145640 1 -- 172.21.15.77:0/2310549868 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f315c161050 msgr2=0x7f315c15f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:24.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.335+0000 7f3161145640 1 --2- 172.21.15.77:0/2310549868 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f315c161050 0x7f315c15f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.335+0000 7f3161145640 1 -- 172.21.15.77:0/2310549868 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f315c1f34d0 msgr2=0x7f315c0cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:24.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.335+0000 7f3161145640 1 --2- 172.21.15.77:0/2310549868 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f315c1f34d0 0x7f315c0cc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.335+0000 7f3161145640 1 -- 172.21.15.77:0/2310549868 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3154009b30 con 0x7f315c15ce60 2023-11-04T01:40:24.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.335+0000 7f3160944640 1 --2- 172.21.15.77:0/2310549868 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f315c161050 0x7f315c15f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:24.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.335+0000 7f3161145640 1 --2- 172.21.15.77:0/2310549868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f315c15ce60 0x7f315c1f22b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3154036040 tx=0x7f3154004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:24.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.336+0000 7f3159ffb640 1 -- 172.21.15.77:0/2310549868 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3154009510 con 0x7f315c15ce60 2023-11-04T01:40:24.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.336+0000 7f3159ffb640 1 -- 172.21.15.77:0/2310549868 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315403e450 con 0x7f315c15ce60 2023-11-04T01:40:24.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.336+0000 7f31633a9640 1 -- 172.21.15.77:0/2310549868 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f315c160230 con 0x7f315c15ce60 2023-11-04T01:40:24.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.336+0000 7f3159ffb640 1 -- 172.21.15.77:0/2310549868 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315403e800 con 0x7f315c15ce60 2023-11-04T01:40:24.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.336+0000 7f31633a9640 1 -- 172.21.15.77:0/2310549868 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f315c0c92e0 con 0x7f315c15ce60 2023-11-04T01:40:24.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.337+0000 7f31633a9640 1 -- 172.21.15.77:0/2310549868 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f315c074290 con 0x7f315c15ce60 2023-11-04T01:40:24.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.337+0000 7f3159ffb640 1 -- 172.21.15.77:0/2310549868 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f315403e960 con 0x7f315c15ce60 2023-11-04T01:40:24.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.337+0000 7f3159ffb640 1 --2- 172.21.15.77:0/2310549868 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f314806ae70 0x7f314806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:24.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.338+0000 7f3159ffb640 1 -- 172.21.15.77:0/2310549868 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f31540ac750 con 0x7f315c15ce60 2023-11-04T01:40:24.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.338+0000 7f3160944640 1 --2- 172.21.15.77:0/2310549868 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f314806ae70 0x7f314806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:24.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.338+0000 7f3160944640 1 --2- 172.21.15.77:0/2310549868 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f314806ae70 0x7f314806d330 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f315c15d8c0 tx=0x7f3150008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:24.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.342+0000 7f3159ffb640 1 -- 172.21.15.77:0/2310549868 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3154077490 con 0x7f315c15ce60 2023-11-04T01:40:24.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.508+0000 7f31633a9640 1 -- 172.21.15.77:0/2310549868 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f315c06b3e0 con 0x7f315c15ce60 2023-11-04T01:40:24.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.509+0000 7f3159ffb640 1 -- 172.21.15.77:0/2310549868 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f315407aab0 con 0x7f315c15ce60 2023-11-04T01:40:24.511 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:24.511 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":24,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:40:10.153949+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:40:02.810971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:40:04.003979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:40:07.734355+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:24.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.511+0000 7f31633a9640 1 -- 172.21.15.77:0/2310549868 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f314806ae70 msgr2=0x7f314806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:24.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.511+0000 7f31633a9640 1 --2- 172.21.15.77:0/2310549868 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f314806ae70 0x7f314806d330 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f315c15d8c0 tx=0x7f3150008040 comp rx=0 tx=0).stop 2023-11-04T01:40:24.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.511+0000 7f31633a9640 1 -- 172.21.15.77:0/2310549868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f315c15ce60 msgr2=0x7f315c1f22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:24.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.511+0000 7f31633a9640 1 --2- 172.21.15.77:0/2310549868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f315c15ce60 0x7f315c1f22b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3154036040 tx=0x7f3154004a40 comp rx=0 tx=0).stop 2023-11-04T01:40:24.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.511+0000 7f31633a9640 1 -- 172.21.15.77:0/2310549868 shutdown_connections 2023-11-04T01:40:24.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.511+0000 7f31633a9640 1 --2- 172.21.15.77:0/2310549868 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f314806ae70 0x7f314806d330 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.511+0000 7f31633a9640 1 --2- 172.21.15.77:0/2310549868 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f315c1f34d0 0x7f315c0cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.511+0000 7f31633a9640 1 --2- 172.21.15.77:0/2310549868 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f315c161050 0x7f315c15f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.511+0000 7f31633a9640 1 --2- 172.21.15.77:0/2310549868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f315c15ce60 0x7f315c1f22b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.511+0000 7f31633a9640 1 -- 172.21.15.77:0/2310549868 >> 172.21.15.77:0/2310549868 conn(0x7f315c06ea90 msgr2=0x7f315c15be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:24.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.511+0000 7f31633a9640 1 -- 172.21.15.77:0/2310549868 shutdown_connections 2023-11-04T01:40:24.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.511+0000 7f31633a9640 1 -- 172.21.15.77:0/2310549868 wait complete. 2023-11-04T01:40:24.524 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-04T01:40:24.524 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:24.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.623+0000 7f5d5b0fc640 1 Processor -- start 2023-11-04T01:40:24.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.623+0000 7f5d5b0fc640 1 -- start start 2023-11-04T01:40:24.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.624+0000 7f5d5b0fc640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5d5415bfb0 0x7f5d540cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:24.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.624+0000 7f5d5b0fc640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d540cc450 con 0x7f5d5415ae40 2023-11-04T01:40:24.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.624+0000 7f5d5b0fc640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d5415f400 con 0x7f5d540cd860 2023-11-04T01:40:24.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.624+0000 7f5d5b0fc640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5415b220 con 0x7f5d5415bfb0 2023-11-04T01:40:24.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.624+0000 7f5d58e98640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f5d5415ae40 0x7f5d540cbc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52592/0 (socket says 172.21.15.77:52592) 2023-11-04T01:40:24.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.624+0000 7f5d58e98640 1 -- 172.21.15.77:0/2091651986 learned_addr learned my addr 172.21.15.77:0/2091651986 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:24.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.624+0000 7f5d537fe640 1 -- 172.21.15.77:0/2091651986 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4252502086 0 0) 0x7f5d48001110 con 0x7f5d5415ae40 2023-11-04T01:40:24.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.624+0000 7f5d53fff640 1 --2- 172.21.15.77:0/2091651986 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5d5415bfb0 0x7f5d540cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:24.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.624+0000 7f5d537fe640 1 -- 172.21.15.77:0/2091651986 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d44003520 con 0x7f5d5415ae40 2023-11-04T01:40:24.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.624+0000 7f5d537fe640 1 -- 172.21.15.77:0/2091651986 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1030837442 0 0) 0x7f5d44003520 con 0x7f5d5415ae40 2023-11-04T01:40:24.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.624+0000 7f5d537fe640 1 -- 172.21.15.77:0/2091651986 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5d5415bfb0 msgr2=0x7f5d540cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:24.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.624+0000 7f5d537fe640 1 --2- 172.21.15.77:0/2091651986 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5d5415bfb0 0x7f5d540cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.624+0000 7f5d537fe640 1 -- 172.21.15.77:0/2091651986 >> v1:172.21.15.122:6789/0 conn(0x7f5d540cd860 legacy=0x7f5d540ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:24.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.624+0000 7f5d537fe640 1 -- 172.21.15.77:0/2091651986 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5415f890 con 0x7f5d5415ae40 2023-11-04T01:40:24.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.624+0000 7f5d537fe640 1 -- 172.21.15.77:0/2091651986 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f5d48001800 con 0x7f5d5415ae40 2023-11-04T01:40:24.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.624+0000 7f5d537fe640 1 -- 172.21.15.77:0/2091651986 >> v1:172.21.15.77:6789/0 conn(0x7f5d5415ae40 legacy=0x7f5d540cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:24.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.624+0000 7f5d537fe640 1 --2- 172.21.15.77:0/2091651986 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d440039a0 0x7f5d44003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:24.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.624+0000 7f5d537fe640 1 --2- 172.21.15.77:0/2091651986 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5d5415bfb0 0x7f5d440047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:24.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.624+0000 7f5d537fe640 1 --2- 172.21.15.77:0/2091651986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d44004d00 0x7f5d44005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:24.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.624+0000 7f5d537fe640 1 -- 172.21.15.77:0/2091651986 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5415b220 con 0x7f5d44004d00 2023-11-04T01:40:24.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.624+0000 7f5d537fe640 1 -- 172.21.15.77:0/2091651986 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4400ba60 con 0x7f5d440039a0 2023-11-04T01:40:24.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.624+0000 7f5d537fe640 1 -- 172.21.15.77:0/2091651986 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4400bc20 con 0x7f5d5415bfb0 2023-11-04T01:40:24.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.625+0000 7f5d59699640 1 --2- 172.21.15.77:0/2091651986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d44004d00 0x7f5d44005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:24.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.625+0000 7f5d58e98640 1 --2- 172.21.15.77:0/2091651986 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d440039a0 0x7f5d44003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:24.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.625+0000 7f5d53fff640 1 --2- 172.21.15.77:0/2091651986 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5d5415bfb0 0x7f5d440047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:24.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.625+0000 7f5d59699640 1 -- 172.21.15.77:0/2091651986 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5d5415bfb0 msgr2=0x7f5d440047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:24.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.625+0000 7f5d59699640 1 --2- 172.21.15.77:0/2091651986 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5d5415bfb0 0x7f5d440047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.625+0000 7f5d59699640 1 -- 172.21.15.77:0/2091651986 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d440039a0 msgr2=0x7f5d44003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:24.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.625+0000 7f5d59699640 1 --2- 172.21.15.77:0/2091651986 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d440039a0 0x7f5d44003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.625+0000 7f5d59699640 1 -- 172.21.15.77:0/2091651986 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d44003520 con 0x7f5d44004d00 2023-11-04T01:40:24.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.626+0000 7f5d59699640 1 --2- 172.21.15.77:0/2091651986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d44004d00 0x7f5d44005180 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c001e20 tx=0x7f5d440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a998859112728a11 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:24.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.626+0000 7f5d537fe640 1 -- 172.21.15.77:0/2091651986 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c003b70 con 0x7f5d44004d00 2023-11-04T01:40:24.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.626+0000 7f5d537fe640 1 -- 172.21.15.77:0/2091651986 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4c003cd0 con 0x7f5d44004d00 2023-11-04T01:40:24.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.626+0000 7f5d537fe640 1 -- 172.21.15.77:0/2091651986 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c005310 con 0x7f5d44004d00 2023-11-04T01:40:24.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.626+0000 7f5d5b0fc640 1 -- 172.21.15.77:0/2091651986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d44004d00 msgr2=0x7f5d44005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:24.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.626+0000 7f5d5b0fc640 1 --2- 172.21.15.77:0/2091651986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d44004d00 0x7f5d44005180 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c001e20 tx=0x7f5d440057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.626+0000 7f5d59699640 1 -- 172.21.15.77:0/2091651986 reap_dead start 2023-11-04T01:40:24.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.626+0000 7f5d5b0fc640 1 -- 172.21.15.77:0/2091651986 shutdown_connections 2023-11-04T01:40:24.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.626+0000 7f5d5b0fc640 1 -- 172.21.15.77:0/2091651986 >> 172.21.15.77:0/2091651986 conn(0x7f5d5406ea90 msgr2=0x7f5d5406ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:24.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.626+0000 7f5d5b0fc640 1 -- 172.21.15.77:0/2091651986 shutdown_connections 2023-11-04T01:40:24.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.626+0000 7f5d5b0fc640 1 -- 172.21.15.77:0/2091651986 wait complete. 2023-11-04T01:40:24.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.627+0000 7f5d5b0fc640 1 Processor -- start 2023-11-04T01:40:24.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.627+0000 7f5d5b0fc640 1 -- start start 2023-11-04T01:40:24.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.628+0000 7f5d5b0fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d54157660 0x7f5d541f4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:24.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.628+0000 7f5d5b0fc640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5d541e6590 0x7f5d540c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:24.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.628+0000 7f5d5b0fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d540ca1c0 0x7f5d541e4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:24.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.628+0000 7f5d5b0fc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d540ca640 con 0x7f5d54157660 2023-11-04T01:40:24.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.628+0000 7f5d5b0fc640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d541e6a10 con 0x7f5d540ca1c0 2023-11-04T01:40:24.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.628+0000 7f5d5b0fc640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d540c45f0 con 0x7f5d541e6590 2023-11-04T01:40:24.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.628+0000 7f5d58e98640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d54157660 0x7f5d541f4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:24.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.628+0000 7f5d58e98640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d54157660 0x7f5d541f4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56772/0 (socket says 172.21.15.77:56772) 2023-11-04T01:40:24.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.628+0000 7f5d58e98640 1 -- 172.21.15.77:0/478752748 learned_addr learned my addr 172.21.15.77:0/478752748 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:24.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.629+0000 7f5d58e98640 1 -- 172.21.15.77:0/478752748 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5d541e6590 msgr2=0x7f5d540c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:24.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.629+0000 7f5d58e98640 1 --2- 172.21.15.77:0/478752748 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5d541e6590 0x7f5d540c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.629+0000 7f5d59699640 1 --2- 172.21.15.77:0/478752748 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d540ca1c0 0x7f5d541e4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:24.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.629+0000 7f5d58e98640 1 -- 172.21.15.77:0/478752748 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d540ca1c0 msgr2=0x7f5d541e4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:24.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.629+0000 7f5d58e98640 1 --2- 172.21.15.77:0/478752748 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d540ca1c0 0x7f5d541e4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.629+0000 7f5d58e98640 1 -- 172.21.15.77:0/478752748 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d540c48d0 con 0x7f5d54157660 2023-11-04T01:40:24.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.629+0000 7f5d58e98640 1 --2- 172.21.15.77:0/478752748 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d54157660 0x7f5d541f4e70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5d48007310 tx=0x7f5d480077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:24.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.629+0000 7f5d517fa640 1 -- 172.21.15.77:0/478752748 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4800f960 con 0x7f5d54157660 2023-11-04T01:40:24.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.629+0000 7f5d517fa640 1 -- 172.21.15.77:0/478752748 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4800fac0 con 0x7f5d54157660 2023-11-04T01:40:24.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.629+0000 7f5d5b0fc640 1 -- 172.21.15.77:0/478752748 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d540c4bb0 con 0x7f5d54157660 2023-11-04T01:40:24.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.629+0000 7f5d517fa640 1 -- 172.21.15.77:0/478752748 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4800fe70 con 0x7f5d54157660 2023-11-04T01:40:24.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.629+0000 7f5d5b0fc640 1 -- 172.21.15.77:0/478752748 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d54157a40 con 0x7f5d54157660 2023-11-04T01:40:24.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.630+0000 7f5d5b0fc640 1 -- 172.21.15.77:0/478752748 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d540ce2d0 con 0x7f5d54157660 2023-11-04T01:40:24.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.630+0000 7f5d517fa640 1 -- 172.21.15.77:0/478752748 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5d4801d460 con 0x7f5d54157660 2023-11-04T01:40:24.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.631+0000 7f5d517fa640 1 --2- 172.21.15.77:0/478752748 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5d3806ae70 0x7f5d3806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:24.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.631+0000 7f5d517fa640 1 -- 172.21.15.77:0/478752748 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5d480898b0 con 0x7f5d54157660 2023-11-04T01:40:24.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.631+0000 7f5d53fff640 1 --2- 172.21.15.77:0/478752748 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5d3806ae70 0x7f5d3806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:24.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.631+0000 7f5d53fff640 1 --2- 172.21.15.77:0/478752748 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5d3806ae70 0x7f5d3806d330 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5d541e7480 tx=0x7f5d400095d0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:24.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.635+0000 7f5d517fa640 1 -- 172.21.15.77:0/478752748 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5d480547b0 con 0x7f5d54157660 2023-11-04T01:40:24.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.818+0000 7f5d5b0fc640 1 -- 172.21.15.77:0/478752748 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d540c50d0 con 0x7f5d54157660 2023-11-04T01:40:24.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.819+0000 7f5d517fa640 1 -- 172.21.15.77:0/478752748 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f5d540c50d0 con 0x7f5d54157660 2023-11-04T01:40:24.821 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:24.822 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":24,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:40:10.153949+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:40:02.810971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:40:04.003979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:40:07.734355+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:24.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.821+0000 7f5d5b0fc640 1 -- 172.21.15.77:0/478752748 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5d3806ae70 msgr2=0x7f5d3806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:24.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.821+0000 7f5d5b0fc640 1 --2- 172.21.15.77:0/478752748 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5d3806ae70 0x7f5d3806d330 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5d541e7480 tx=0x7f5d400095d0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.821+0000 7f5d5b0fc640 1 -- 172.21.15.77:0/478752748 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d54157660 msgr2=0x7f5d541f4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:24.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.821+0000 7f5d5b0fc640 1 --2- 172.21.15.77:0/478752748 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d54157660 0x7f5d541f4e70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5d48007310 tx=0x7f5d480077d0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.821+0000 7f5d5b0fc640 1 -- 172.21.15.77:0/478752748 shutdown_connections 2023-11-04T01:40:24.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.821+0000 7f5d5b0fc640 1 --2- 172.21.15.77:0/478752748 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5d3806ae70 0x7f5d3806d330 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.821+0000 7f5d5b0fc640 1 --2- 172.21.15.77:0/478752748 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d540ca1c0 0x7f5d541e4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.821+0000 7f5d5b0fc640 1 --2- 172.21.15.77:0/478752748 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5d541e6590 0x7f5d540c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.821+0000 7f5d5b0fc640 1 --2- 172.21.15.77:0/478752748 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d54157660 0x7f5d541f4e70 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:24.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.821+0000 7f5d5b0fc640 1 -- 172.21.15.77:0/478752748 >> 172.21.15.77:0/478752748 conn(0x7f5d5406ea90 msgr2=0x7f5d540b3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:24.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.821+0000 7f5d5b0fc640 1 -- 172.21.15.77:0/478752748 shutdown_connections 2023-11-04T01:40:24.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:24.822+0000 7f5d5b0fc640 1 -- 172.21.15.77:0/478752748 wait complete. 2023-11-04T01:40:24.834 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-04T01:40:24.835 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-04T01:40:24.836 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-04T01:40:24.836 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-04T01:40:24.837 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-04T01:40:24.837 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-04T01:40:24.838 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-04T01:40:24.839 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-04T01:40:25.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.002+0000 7f9e94125640 1 Processor -- start 2023-11-04T01:40:25.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.003+0000 7f9e94125640 1 -- start start 2023-11-04T01:40:25.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.004+0000 7f9e94125640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9e8c0cb190 0x7f9e8c0cded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.004+0000 7f9e94125640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9e8c06c560 0x7f9e8c0ce630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.004+0000 7f9e94125640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e8c0cd170 con 0x7f9e8c0b23e0 2023-11-04T01:40:25.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.004+0000 7f9e94125640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e8c0cf6a0 con 0x7f9e8c0cb190 2023-11-04T01:40:25.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.004+0000 7f9e94125640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c0cf0e0 con 0x7f9e8c06c560 2023-11-04T01:40:25.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.004+0000 7f9e91ec1640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f9e8c0b23e0 0x7f9e8c0b27c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52604/0 (socket says 172.21.15.77:52604) 2023-11-04T01:40:25.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.004+0000 7f9e91ec1640 1 -- 172.21.15.77:0/984538942 learned_addr learned my addr 172.21.15.77:0/984538942 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:25.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.004+0000 7f9e926c2640 1 --2- 172.21.15.77:0/984538942 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9e8c06c560 0x7f9e8c0ce630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.004+0000 7f9e926c2640 1 -- 172.21.15.77:0/984538942 >> v2:172.21.15.122:3300/0 conn(0x7f9e8c0cb190 msgr2=0x7f9e8c0cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.004+0000 7f9e90ebf640 1 -- 172.21.15.77:0/984538942 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438302905 0 0) 0x7f9e8c0cd170 con 0x7f9e8c0b23e0 2023-11-04T01:40:25.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.004+0000 7f9e926c2640 1 --2- 172.21.15.77:0/984538942 >> v2:172.21.15.122:3300/0 conn(0x7f9e8c0cb190 0x7f9e8c0cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.004+0000 7f9e926c2640 1 -- 172.21.15.77:0/984538942 >> v1:172.21.15.77:6789/0 conn(0x7f9e8c0b23e0 legacy=0x7f9e8c0b27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.004+0000 7f9e926c2640 1 -- 172.21.15.77:0/984538942 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8c0cf3c0 con 0x7f9e8c06c560 2023-11-04T01:40:25.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.005+0000 7f9e926c2640 1 --2- 172.21.15.77:0/984538942 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9e8c06c560 0x7f9e8c0ce630 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9e84009d90 tx=0x7f9e8402bec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85dd1a4e5661d966 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.005+0000 7f9e90ebf640 1 -- 172.21.15.77:0/984538942 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8402cc70 con 0x7f9e8c06c560 2023-11-04T01:40:25.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.006+0000 7f9e90ebf640 1 -- 172.21.15.77:0/984538942 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e8402cdd0 con 0x7f9e8c06c560 2023-11-04T01:40:25.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.006+0000 7f9e90ebf640 1 -- 172.21.15.77:0/984538942 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e84034660 con 0x7f9e8c06c560 2023-11-04T01:40:25.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.006+0000 7f0a2bfff640 1 Processor -- start 2023-11-04T01:40:25.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.006+0000 7f0a2bfff640 1 -- start start 2023-11-04T01:40:25.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.006+0000 7fdccbe1f640 1 Processor -- start 2023-11-04T01:40:25.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.006+0000 7fdccbe1f640 1 -- start start 2023-11-04T01:40:25.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.006+0000 7f9e94125640 1 -- 172.21.15.77:0/984538942 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9e8c06c560 msgr2=0x7f9e8c0ce630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.006+0000 7f9e94125640 1 --2- 172.21.15.77:0/984538942 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9e8c06c560 0x7f9e8c0ce630 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9e84009d90 tx=0x7f9e8402bec0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.007+0000 7f9e94125640 1 -- 172.21.15.77:0/984538942 shutdown_connections 2023-11-04T01:40:25.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.007+0000 7f9e94125640 1 --2- 172.21.15.77:0/984538942 >> v2:172.21.15.122:3300/0 conn(0x7f9e8c0cb190 0x7f9e8c0cded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.007+0000 7f9e94125640 1 --2- 172.21.15.77:0/984538942 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9e8c06c560 0x7f9e8c0ce630 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.007+0000 7f9e94125640 1 -- 172.21.15.77:0/984538942 >> 172.21.15.77:0/984538942 conn(0x7f9e8c0cd3e0 msgr2=0x7f9e8c0cd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.007+0000 7f9e94125640 1 -- 172.21.15.77:0/984538942 shutdown_connections 2023-11-04T01:40:25.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.007+0000 7f9e94125640 1 -- 172.21.15.77:0/984538942 wait complete. 2023-11-04T01:40:25.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.007+0000 7f3303978640 1 Processor -- start 2023-11-04T01:40:25.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.008+0000 7f0a2bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0a24009430 0x7f0a240eab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.007+0000 7fa413bc9640 1 Processor -- start 2023-11-04T01:40:25.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.008+0000 7f0a2bfff640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a240e03f0 con 0x7f0a2403bad0 2023-11-04T01:40:25.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.008+0000 7f3303978640 1 -- start start 2023-11-04T01:40:25.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.008+0000 7f0a2bfff640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a240544e0 con 0x7f0a240e0010 2023-11-04T01:40:25.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.008+0000 7f0a2bfff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a24055430 con 0x7f0a24009430 2023-11-04T01:40:25.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.008+0000 7fdccbe1f640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdcc4141e20 0x7fdcc40ca530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.008+0000 7fdccbe1f640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fdcc4142480 0x7fdcc40caa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.008+0000 7fdc4d89e640 1 Processor -- start 2023-11-04T01:40:25.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.008+0000 7f2756363640 1 Processor -- start 2023-11-04T01:40:25.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.008+0000 7fdccbe1f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdcc40cafb0 0x7fdcc40c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.008+0000 7fdcc93ba640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fdcc4142480 0x7fdcc40caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.008+0000 7fa413bc9640 1 -- start start 2023-11-04T01:40:25.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.009+0000 7fdcc93ba640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fdcc4142480 0x7fdcc40caa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:40500/0 (socket says 172.21.15.77:40500) 2023-11-04T01:40:25.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.009+0000 7fdcc93ba640 1 -- 172.21.15.77:0/3307032062 learned_addr learned my addr 172.21.15.77:0/3307032062 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:25.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.008+0000 7f0a2affd640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f0a240e0010 0x7f0a24053dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:55660/0 (socket says 172.21.15.77:55660) 2023-11-04T01:40:25.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.008+0000 7f0a2affd640 1 -- 172.21.15.77:0/1448313099 learned_addr learned my addr 172.21.15.77:0/1448313099 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:25.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.009+0000 7fdcca3bc640 1 --2- 172.21.15.77:0/3307032062 >> v2:172.21.15.77:3300/0 conn(0x7fdcc40cafb0 0x7fdcc40c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.009+0000 7f3303978640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f32fc0c1900 0x7f32fc0cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.009+0000 7f3303978640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32fc0b0710 0x7f32fc0cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.009+0000 7f0a2b7fe640 1 --2- 172.21.15.77:0/1448313099 >> v2:172.21.15.77:3300/0 conn(0x7f0a24009430 0x7f0a240eab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.009+0000 7f3303978640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32fc0cc840 con 0x7f32fc0cae60 2023-11-04T01:40:25.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.009+0000 7f3303978640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32fc0cbe90 con 0x7f32fc0c1900 2023-11-04T01:40:25.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.009+0000 7f3303978640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc0cb8d0 con 0x7f32fc0b0710 2023-11-04T01:40:25.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.009+0000 7f9e94125640 1 Processor -- start 2023-11-04T01:40:25.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.009+0000 7fdccbe1f640 1 -- 172.21.15.77:0/3307032062 --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcc40cc960 con 0x7fdcc40cafb0 2023-11-04T01:40:25.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.009+0000 7f3300f13640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f32fc0cae60 0x7f32fc0b0000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52626/0 (socket says 172.21.15.77:52626) 2023-11-04T01:40:25.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.009+0000 7fdccbe1f640 1 -- 172.21.15.77:0/3307032062 --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcc40ccc40 con 0x7fdcc4142480 2023-11-04T01:40:25.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.008+0000 7fdcc9bbb640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdcc4141e20 0x7fdcc40ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.009+0000 7fdccbe1f640 1 -- 172.21.15.77:0/3307032062 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc40ccf20 con 0x7fdcc4141e20 2023-11-04T01:40:25.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.009+0000 7f3300f13640 1 -- 172.21.15.77:0/2872171103 learned_addr learned my addr 172.21.15.77:0/2872171103 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:25.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.009+0000 7fa413bc9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa40c06fa40 0x7fa40c0cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.009+0000 7fa413bc9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa40c0cdc80 0x7fa40c0c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.009+0000 7fa413bc9640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa40c0cbf90 con 0x7fa40c0cbbb0 2023-11-04T01:40:25.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.009+0000 7fa413bc9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa40c071640 con 0x7fa40c06fa40 2023-11-04T01:40:25.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.009+0000 7fa413bc9640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa40c1616c0 con 0x7fa40c0cdc80 2023-11-04T01:40:25.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.009+0000 7f3301714640 1 --2- 172.21.15.77:0/2872171103 >> v2:172.21.15.122:3300/0 conn(0x7f32fc0c1900 0x7f32fc0cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.008+0000 7fdc4d89e640 1 -- start start 2023-11-04T01:40:25.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.009+0000 7fdc4d89e640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fdc4806cbe0 0x7fdc481637b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.010+0000 7fdc4d89e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc4815efa0 con 0x7fdc4815ebc0 2023-11-04T01:40:25.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.010+0000 7fdc4d89e640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc48162020 con 0x7fdc4806c780 2023-11-04T01:40:25.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.010+0000 7fdc4d89e640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc48162300 con 0x7fdc4806cbe0 2023-11-04T01:40:25.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.010+0000 7fa412166640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa40c0cdc80 0x7fa40c0c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.010+0000 7fa412166640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa40c0cdc80 0x7fa40c0c9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:40526/0 (socket says 172.21.15.77:40526) 2023-11-04T01:40:25.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.010+0000 7fa412166640 1 -- 172.21.15.77:0/2415921511 learned_addr learned my addr 172.21.15.77:0/2415921511 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:25.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.010+0000 7fdc4c89c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fdc4815ebc0 0x7fdc48161560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52632/0 (socket says 172.21.15.77:52632) 2023-11-04T01:40:25.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.010+0000 7fdc4c89c640 1 -- 172.21.15.77:0/2257592773 learned_addr learned my addr 172.21.15.77:0/2257592773 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:25.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.009+0000 7f9e94125640 1 -- start start 2023-11-04T01:40:25.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.010+0000 7fdc4d09d640 1 --2- 172.21.15.77:0/2257592773 >> v2:172.21.15.122:3300/0 conn(0x7fdc4806cbe0 0x7fdc481637b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.010+0000 7f3301f15640 1 --2- 172.21.15.77:0/2872171103 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32fc0b0710 0x7f32fc0cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.008+0000 7f2756363640 1 -- start start 2023-11-04T01:40:25.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.010+0000 7f2756363640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f27480e75f0 0x7f274803a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.010+0000 7f2756363640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2748034530 0x7f274803a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.010+0000 7f2756363640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2748053070 con 0x7f274803ad90 2023-11-04T01:40:25.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.010+0000 7f2756363640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27480ec1c0 con 0x7f2748034530 2023-11-04T01:40:25.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.010+0000 7f2756363640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2748034a30 con 0x7f27480e75f0 2023-11-04T01:40:25.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.010+0000 7fdcc9bbb640 1 -- 172.21.15.77:0/3307032062 >> v2:172.21.15.122:3300/0 conn(0x7fdcc4142480 msgr2=0x7fdcc40caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.010+0000 7fdcc9bbb640 1 --2- 172.21.15.77:0/3307032062 >> v2:172.21.15.122:3300/0 conn(0x7fdcc4142480 0x7fdcc40caa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.009+0000 7f0a2b7fe640 1 -- 172.21.15.77:0/1448313099 >> v1:172.21.15.122:6789/0 conn(0x7f0a240e0010 legacy=0x7f0a24053dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.009+0000 7f0a2b7fe640 1 -- 172.21.15.77:0/1448313099 >> v1:172.21.15.77:6789/0 conn(0x7f0a2403bad0 legacy=0x7f0a24007d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.009+0000 7f0a2b7fe640 1 -- 172.21.15.77:0/1448313099 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a240547b0 con 0x7f0a24009430 2023-11-04T01:40:25.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.010+0000 7f3301714640 1 -- 172.21.15.77:0/2872171103 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32fc0b0710 msgr2=0x7f32fc0cb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.010+0000 7f3301714640 1 --2- 172.21.15.77:0/2872171103 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32fc0b0710 0x7f32fc0cb2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.010+0000 7f3301714640 1 -- 172.21.15.77:0/2872171103 >> v1:172.21.15.77:6789/0 conn(0x7f32fc0cae60 legacy=0x7f32fc0b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.010+0000 7f3301714640 1 -- 172.21.15.77:0/2872171103 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32fc0cbbb0 con 0x7f32fc0c1900 2023-11-04T01:40:25.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.010+0000 7fa412166640 1 -- 172.21.15.77:0/2415921511 >> v2:172.21.15.77:3300/0 conn(0x7fa40c06fa40 msgr2=0x7fa40c0cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.010+0000 7fa412166640 1 --2- 172.21.15.77:0/2415921511 >> v2:172.21.15.77:3300/0 conn(0x7fa40c06fa40 0x7fa40c0cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.010+0000 7fa412166640 1 -- 172.21.15.77:0/2415921511 >> v1:172.21.15.122:6789/0 conn(0x7fa40c0cbbb0 legacy=0x7fa40c06f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.010+0000 7fdcc9bbb640 1 -- 172.21.15.77:0/3307032062 >> v2:172.21.15.77:3300/0 conn(0x7fdcc40cafb0 msgr2=0x7fdcc40c3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.010+0000 7fa412166640 1 -- 172.21.15.77:0/2415921511 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa40c071890 con 0x7fa40c0cdc80 2023-11-04T01:40:25.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.010+0000 7fdcc9bbb640 1 --2- 172.21.15.77:0/3307032062 >> v2:172.21.15.77:3300/0 conn(0x7fdcc40cafb0 0x7fdcc40c3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.010+0000 7fdcc9bbb640 1 -- 172.21.15.77:0/3307032062 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc40cd200 con 0x7fdcc4141e20 2023-11-04T01:40:25.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.011+0000 7f9e94125640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e8c06c560 0x7f9e8c157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.011+0000 7f2754b60640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2748034530 0x7f274803a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.011+0000 7f2754b60640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2748034530 0x7f274803a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56798/0 (socket says 172.21.15.77:56798) 2023-11-04T01:40:25.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.011+0000 7f2754b60640 1 -- 172.21.15.77:0/1112235803 learned_addr learned my addr 172.21.15.77:0/1112235803 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:25.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.011+0000 7f9e94125640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e8c0b23e0 0x7f9e8c0ca670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.011+0000 7fdc477fe640 1 -- 172.21.15.77:0/2257592773 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 618967576 0 0) 0x7fdc48162020 con 0x7fdc4806c780 2023-11-04T01:40:25.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.011+0000 7fdc477fe640 1 -- 172.21.15.77:0/2257592773 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc30003520 con 0x7fdc4806c780 2023-11-04T01:40:25.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.011+0000 7f2755361640 1 --2- 172.21.15.77:0/1112235803 >> v2:172.21.15.122:3300/0 conn(0x7f27480e75f0 0x7f274803a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.011+0000 7f0a2b7fe640 1 --2- 172.21.15.77:0/1448313099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a24009430 0x7f0a240eab40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c074540 tx=0x7f0a2c0a8040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=409617cff9935953 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.011+0000 7f2755361640 1 -- 172.21.15.77:0/1112235803 >> v2:172.21.15.77:3300/0 conn(0x7f2748034530 msgr2=0x7f274803a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.011+0000 7f2755361640 1 --2- 172.21.15.77:0/1112235803 >> v2:172.21.15.77:3300/0 conn(0x7f2748034530 0x7f274803a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.011+0000 7fdcc9bbb640 1 --2- 172.21.15.77:0/3307032062 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdcc4141e20 0x7fdcc40ca530 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdcc406fb60 tx=0x7fdcc002fbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a31ab21d4edf07e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.011+0000 7f9e91ec1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e8c06c560 0x7f9e8c157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.011+0000 7fdcc8bb9640 1 -- 172.21.15.77:0/3307032062 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc0030970 con 0x7fdcc4141e20 2023-11-04T01:40:25.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.011+0000 7f9e91ec1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e8c06c560 0x7f9e8c157d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:40554/0 (socket says 172.21.15.77:40554) 2023-11-04T01:40:25.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.011+0000 7f9e916c0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e8c0b23e0 0x7f9e8c0ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.011+0000 7fdc477fe640 1 -- 172.21.15.77:0/2257592773 <== mon.1 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2549447002 0 0) 0x7fdc30003520 con 0x7fdc4806c780 2023-11-04T01:40:25.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.011+0000 7fdc477fe640 1 -- 172.21.15.77:0/2257592773 >> v2:172.21.15.122:3300/0 conn(0x7fdc4806cbe0 msgr2=0x7fdc481637b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.011+0000 7fdc477fe640 1 --2- 172.21.15.77:0/2257592773 >> v2:172.21.15.122:3300/0 conn(0x7fdc4806cbe0 0x7fdc481637b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.011+0000 7fdc477fe640 1 -- 172.21.15.77:0/2257592773 >> v1:172.21.15.77:6789/0 conn(0x7fdc4815ebc0 legacy=0x7fdc48161560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.011+0000 7fdc477fe640 1 -- 172.21.15.77:0/2257592773 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc481628a0 con 0x7fdc4806c780 2023-11-04T01:40:25.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.012+0000 7fdc477fe640 1 -- 172.21.15.77:0/2257592773 <== mon.1 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7fdc38001670 con 0x7fdc4806c780 2023-11-04T01:40:25.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.012+0000 7fdc477fe640 1 -- 172.21.15.77:0/2257592773 >> v1:172.21.15.122:6789/0 conn(0x7fdc4806c780 legacy=0x7fdc481630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.012+0000 7fdc477fe640 1 --2- 172.21.15.77:0/2257592773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc30003970 0x7fdc30003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.012+0000 7fdc477fe640 1 --2- 172.21.15.77:0/2257592773 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc300047c0 0x7fdc30004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.012+0000 7fdc477fe640 1 --2- 172.21.15.77:0/2257592773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc30005180 0x7fdc3000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.012+0000 7fdc477fe640 1 -- 172.21.15.77:0/2257592773 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc48162300 con 0x7fdc30003970 2023-11-04T01:40:25.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.012+0000 7fdc477fe640 1 -- 172.21.15.77:0/2257592773 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3000bfd0 con 0x7fdc30005180 2023-11-04T01:40:25.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.012+0000 7fdc477fe640 1 -- 172.21.15.77:0/2257592773 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3000c190 con 0x7fdc300047c0 2023-11-04T01:40:25.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.012+0000 7f3301714640 1 --2- 172.21.15.77:0/2872171103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32fc0c1900 0x7f32fc0cd000 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f32f80097a0 tx=0x7f32f802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a71d38f242a553b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.011+0000 7f9e91ec1640 1 -- 172.21.15.77:0/417105483 learned_addr learned my addr 172.21.15.77:0/417105483 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:25.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.012+0000 7fdcc8bb9640 1 -- 172.21.15.77:0/3307032062 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc0030ad0 con 0x7fdcc4141e20 2023-11-04T01:40:25.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.012+0000 7fdcc8bb9640 1 -- 172.21.15.77:0/3307032062 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc0030e60 con 0x7fdcc4141e20 2023-11-04T01:40:25.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.011+0000 7f9e94125640 1 --2- 172.21.15.77:0/417105483 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9e8c0cb190 0x7f9e8c0c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.012+0000 7fa412166640 1 --2- 172.21.15.77:0/2415921511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa40c0cdc80 0x7fa40c0c9f60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa40c0b5920 tx=0x7fa3fc02b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb4d8093ad3668a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.011+0000 7f9e94125640 1 -- 172.21.15.77:0/417105483 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c0c95d0 con 0x7f9e8c0b23e0 2023-11-04T01:40:25.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.012+0000 7f9e94125640 1 -- 172.21.15.77:0/417105483 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c0c98b0 con 0x7f9e8c06c560 2023-11-04T01:40:25.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.012+0000 7f32f3fff640 1 -- 172.21.15.77:0/2872171103 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f8030610 con 0x7f32fc0c1900 2023-11-04T01:40:25.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.012+0000 7f32f3fff640 1 -- 172.21.15.77:0/2872171103 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f8030770 con 0x7f32fc0c1900 2023-11-04T01:40:25.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.011+0000 7f2755361640 1 -- 172.21.15.77:0/1112235803 >> v1:172.21.15.77:6789/0 conn(0x7f274803ad90 legacy=0x7f2748006920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.011+0000 7f2755361640 1 -- 172.21.15.77:0/1112235803 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274804fb90 con 0x7f27480e75f0 2023-11-04T01:40:25.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.012+0000 7f9e94125640 1 -- 172.21.15.77:0/417105483 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c0c9b90 con 0x7f9e8c0cb190 2023-11-04T01:40:25.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.012+0000 7f32f3fff640 1 -- 172.21.15.77:0/2872171103 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f8030610 con 0x7f32fc0c1900 2023-11-04T01:40:25.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.012+0000 7f9e926c2640 1 --2- 172.21.15.77:0/417105483 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9e8c0cb190 0x7f9e8c0c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.012+0000 7f0a29ffb640 1 -- 172.21.15.77:0/1448313099 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c072390 con 0x7f0a24009430 2023-11-04T01:40:25.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.012+0000 7f0a29ffb640 1 -- 172.21.15.77:0/1448313099 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2c0a89e0 con 0x7f0a24009430 2023-11-04T01:40:25.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.012+0000 7f0a29ffb640 1 -- 172.21.15.77:0/1448313099 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c0a8e10 con 0x7f0a24009430 2023-11-04T01:40:25.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.013+0000 7fdccbe1f640 1 -- 172.21.15.77:0/3307032062 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdcc4141e20 msgr2=0x7fdcc40ca530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.013+0000 7fdccbe1f640 1 --2- 172.21.15.77:0/3307032062 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdcc4141e20 0x7fdcc40ca530 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdcc406fb60 tx=0x7fdcc002fbc0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.012+0000 7fdc4c89c640 1 --2- 172.21.15.77:0/2257592773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc30003970 0x7fdc30003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.012+0000 7fdc4d09d640 1 --2- 172.21.15.77:0/2257592773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc30005180 0x7fdc3000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.013+0000 7fdc4d09d640 1 -- 172.21.15.77:0/2257592773 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc300047c0 msgr2=0x7fdc30004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.013+0000 7fdc47fff640 1 --2- 172.21.15.77:0/2257592773 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc300047c0 0x7fdc30004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.013+0000 7fdc4d09d640 1 --2- 172.21.15.77:0/2257592773 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc300047c0 0x7fdc30004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.013+0000 7fdc4d09d640 1 -- 172.21.15.77:0/2257592773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc30003970 msgr2=0x7fdc30003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.013+0000 7fdc4d09d640 1 --2- 172.21.15.77:0/2257592773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc30003970 0x7fdc30003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.013+0000 7fdc4d09d640 1 -- 172.21.15.77:0/2257592773 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc481628a0 con 0x7fdc30005180 2023-11-04T01:40:25.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.012+0000 7f2755361640 1 --2- 172.21.15.77:0/1112235803 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27480e75f0 0x7f274803a310 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f274800c700 tx=0x7f274c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e3525c5adb306f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.013+0000 7f2747fff640 1 -- 172.21.15.77:0/1112235803 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c02e070 con 0x7f27480e75f0 2023-11-04T01:40:25.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.013+0000 7f2747fff640 1 -- 172.21.15.77:0/1112235803 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274c0315a0 con 0x7f27480e75f0 2023-11-04T01:40:25.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.012+0000 7f9e91ec1640 1 -- 172.21.15.77:0/417105483 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9e8c0cb190 msgr2=0x7f9e8c0c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.013+0000 7f9e91ec1640 1 --2- 172.21.15.77:0/417105483 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9e8c0cb190 0x7f9e8c0c8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.013+0000 7f9e91ec1640 1 -- 172.21.15.77:0/417105483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e8c0b23e0 msgr2=0x7f9e8c0ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.013+0000 7f9e91ec1640 1 --2- 172.21.15.77:0/417105483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e8c0b23e0 0x7f9e8c0ca670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.013+0000 7f9e91ec1640 1 -- 172.21.15.77:0/417105483 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e84009a70 con 0x7f9e8c06c560 2023-11-04T01:40:25.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.013+0000 7f9e916c0640 1 --2- 172.21.15.77:0/417105483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e8c0b23e0 0x7f9e8c0ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:25.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.013+0000 7fa410963640 1 -- 172.21.15.77:0/2415921511 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc031870 con 0x7fa40c0cdc80 2023-11-04T01:40:25.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.013+0000 7f3303978640 1 -- 172.21.15.77:0/2872171103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32fc0c1900 msgr2=0x7f32fc0cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.013+0000 7f3303978640 1 --2- 172.21.15.77:0/2872171103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32fc0c1900 0x7f32fc0cd000 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f32f80097a0 tx=0x7f32f802b960 comp rx=0 tx=0).stop 2023-11-04T01:40:25.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.013+0000 7fa410963640 1 -- 172.21.15.77:0/2415921511 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3fc0319d0 con 0x7fa40c0cdc80 2023-11-04T01:40:25.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.013+0000 7f3303978640 1 -- 172.21.15.77:0/2872171103 shutdown_connections 2023-11-04T01:40:25.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.013+0000 7fdc47fff640 1 --2- 172.21.15.77:0/2257592773 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc300047c0 0x7fdc30004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:25.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.013+0000 7f3303978640 1 --2- 172.21.15.77:0/2872171103 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32fc0b0710 0x7f32fc0cb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.013+0000 7f3303978640 1 --2- 172.21.15.77:0/2872171103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32fc0c1900 0x7f32fc0cd000 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.013+0000 7f3303978640 1 -- 172.21.15.77:0/2872171103 >> 172.21.15.77:0/2872171103 conn(0x7f32fc06c4c0 msgr2=0x7f32fc06c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.013+0000 7fdccbe1f640 1 -- 172.21.15.77:0/3307032062 shutdown_connections 2023-11-04T01:40:25.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.013+0000 7f0a2bfff640 1 -- 172.21.15.77:0/1448313099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a24009430 msgr2=0x7f0a240eab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.013+0000 7f0a2bfff640 1 --2- 172.21.15.77:0/1448313099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a24009430 0x7f0a240eab40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c074540 tx=0x7f0a2c0a8040 comp rx=0 tx=0).stop 2023-11-04T01:40:25.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.013+0000 7fdccbe1f640 1 --2- 172.21.15.77:0/3307032062 >> v2:172.21.15.77:3300/0 conn(0x7fdcc40cafb0 0x7fdcc40c3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.013+0000 7fdccbe1f640 1 --2- 172.21.15.77:0/3307032062 >> v2:172.21.15.122:3300/0 conn(0x7fdcc4142480 0x7fdcc40caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.013+0000 7fdccbe1f640 1 --2- 172.21.15.77:0/3307032062 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdcc4141e20 0x7fdcc40ca530 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.013+0000 7fdccbe1f640 1 -- 172.21.15.77:0/3307032062 >> 172.21.15.77:0/3307032062 conn(0x7fdcc406a120 msgr2=0x7fdcc406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.013+0000 7f0a2bfff640 1 -- 172.21.15.77:0/1448313099 shutdown_connections 2023-11-04T01:40:25.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.013+0000 7f0a2bfff640 1 --2- 172.21.15.77:0/1448313099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a24009430 0x7f0a240eab40 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.013+0000 7f0a2bfff640 1 -- 172.21.15.77:0/1448313099 >> 172.21.15.77:0/1448313099 conn(0x7f0a24055d20 msgr2=0x7f0a24056130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.013+0000 7f2747fff640 1 -- 172.21.15.77:0/1112235803 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c031930 con 0x7f27480e75f0 2023-11-04T01:40:25.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.014+0000 7f3303978640 1 -- 172.21.15.77:0/2872171103 shutdown_connections 2023-11-04T01:40:25.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.014+0000 7f3303978640 1 -- 172.21.15.77:0/2872171103 wait complete. 2023-11-04T01:40:25.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.014+0000 7f0a2bfff640 1 -- 172.21.15.77:0/1448313099 shutdown_connections 2023-11-04T01:40:25.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.014+0000 7fdc4d09d640 1 -- 172.21.15.77:0/2257592773 reap_dead start 2023-11-04T01:40:25.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.014+0000 7f0a2bfff640 1 -- 172.21.15.77:0/1448313099 wait complete. 2023-11-04T01:40:25.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.014+0000 7f2756363640 1 -- 172.21.15.77:0/1112235803 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27480e75f0 msgr2=0x7f274803a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.014+0000 7f2756363640 1 --2- 172.21.15.77:0/1112235803 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27480e75f0 0x7f274803a310 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f274800c700 tx=0x7f274c02b840 comp rx=0 tx=0).stop 2023-11-04T01:40:25.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.014+0000 7f2756363640 1 -- 172.21.15.77:0/1112235803 shutdown_connections 2023-11-04T01:40:25.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.014+0000 7f2756363640 1 --2- 172.21.15.77:0/1112235803 >> v2:172.21.15.77:3300/0 conn(0x7f2748034530 0x7f274803a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.014+0000 7f2756363640 1 --2- 172.21.15.77:0/1112235803 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f27480e75f0 0x7f274803a310 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.014+0000 7f2756363640 1 -- 172.21.15.77:0/1112235803 >> 172.21.15.77:0/1112235803 conn(0x7f274800a990 msgr2=0x7f274800ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.014+0000 7f9e91ec1640 1 --2- 172.21.15.77:0/417105483 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e8c06c560 0x7f9e8c157d40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9e8800c4d0 tx=0x7f9e8800c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.014+0000 7fdc4d09d640 1 --2- 172.21.15.77:0/2257592773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc30005180 0x7fdc3000b980 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdc40009fc0 tx=0x7fdc300057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=217fd54299155262 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.014+0000 7fa413bc9640 1 -- 172.21.15.77:0/2415921511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa40c0cdc80 msgr2=0x7fa40c0c9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.014+0000 7fa413bc9640 1 --2- 172.21.15.77:0/2415921511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa40c0cdc80 0x7fa40c0c9f60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa40c0b5920 tx=0x7fa3fc02b910 comp rx=0 tx=0).stop 2023-11-04T01:40:25.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.014+0000 7f2756363640 1 -- 172.21.15.77:0/1112235803 shutdown_connections 2023-11-04T01:40:25.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.014+0000 7fa413bc9640 1 -- 172.21.15.77:0/2415921511 shutdown_connections 2023-11-04T01:40:25.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.014+0000 7fa413bc9640 1 --2- 172.21.15.77:0/2415921511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa40c0cdc80 0x7fa40c0c9f60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.014+0000 7fa413bc9640 1 --2- 172.21.15.77:0/2415921511 >> v2:172.21.15.77:3300/0 conn(0x7fa40c06fa40 0x7fa40c0cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.014+0000 7fa413bc9640 1 -- 172.21.15.77:0/2415921511 >> 172.21.15.77:0/2415921511 conn(0x7fa40c0cc250 msgr2=0x7fa40c0cc660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.014+0000 7f9e827fc640 1 -- 172.21.15.77:0/417105483 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e880074e0 con 0x7f9e8c06c560 2023-11-04T01:40:25.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.014+0000 7f9e827fc640 1 -- 172.21.15.77:0/417105483 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e88007640 con 0x7f9e8c06c560 2023-11-04T01:40:25.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.014+0000 7f9e94125640 1 -- 172.21.15.77:0/417105483 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e8c0c9e70 con 0x7f9e8c06c560 2023-11-04T01:40:25.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.014+0000 7fdc477fe640 1 -- 172.21.15.77:0/2257592773 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4002cc40 con 0x7fdc30005180 2023-11-04T01:40:25.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.014+0000 7fdc477fe640 1 -- 172.21.15.77:0/2257592773 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4000f040 con 0x7fdc30005180 2023-11-04T01:40:25.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.014+0000 7fdc477fe640 1 -- 172.21.15.77:0/2257592773 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc40003990 con 0x7fdc30005180 2023-11-04T01:40:25.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.014+0000 7f9e827fc640 1 -- 172.21.15.77:0/417105483 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e880049e0 con 0x7f9e8c06c560 2023-11-04T01:40:25.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.014+0000 7f9e94125640 1 -- 172.21.15.77:0/417105483 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e8c0c8980 con 0x7f9e8c06c560 2023-11-04T01:40:25.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.014+0000 7fa413bc9640 1 -- 172.21.15.77:0/2415921511 shutdown_connections 2023-11-04T01:40:25.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.014+0000 7fdccbe1f640 1 -- 172.21.15.77:0/3307032062 shutdown_connections 2023-11-04T01:40:25.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.015+0000 7fdccbe1f640 1 -- 172.21.15.77:0/3307032062 wait complete. 2023-11-04T01:40:25.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.015+0000 7fdc4d89e640 1 -- 172.21.15.77:0/2257592773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc30005180 msgr2=0x7fdc3000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.015+0000 7fdc4d89e640 1 --2- 172.21.15.77:0/2257592773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc30005180 0x7fdc3000b980 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdc40009fc0 tx=0x7fdc300057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.015+0000 7f0a2bfff640 1 Processor -- start 2023-11-04T01:40:25.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.015+0000 7fa413bc9640 1 -- 172.21.15.77:0/2415921511 wait complete. 2023-11-04T01:40:25.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.015+0000 7f2756363640 1 -- 172.21.15.77:0/1112235803 wait complete. 2023-11-04T01:40:25.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.015+0000 7fdc4d89e640 1 -- 172.21.15.77:0/2257592773 shutdown_connections 2023-11-04T01:40:25.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.015+0000 7fdc4d89e640 1 --2- 172.21.15.77:0/2257592773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc30005180 0x7fdc3000b980 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.015+0000 7fdc4d89e640 1 -- 172.21.15.77:0/2257592773 >> 172.21.15.77:0/2257592773 conn(0x7fdc4806a300 msgr2=0x7fdc4806a710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.015+0000 7f3303978640 1 Processor -- start 2023-11-04T01:40:25.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.015+0000 7f3303978640 1 -- start start 2023-11-04T01:40:25.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.015+0000 7fdc4d89e640 1 -- 172.21.15.77:0/2257592773 shutdown_connections 2023-11-04T01:40:25.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.015+0000 7fdc4d89e640 1 -- 172.21.15.77:0/2257592773 wait complete. 2023-11-04T01:40:25.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.015+0000 7f0a2bfff640 1 -- start start 2023-11-04T01:40:25.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.016+0000 7f3303978640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32fc0b0710 0x7f32fc1f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.016+0000 7f3303978640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32fc0c1900 0x7f32fc0b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.016+0000 7f3303978640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32fc0cae60 0x7f32fc0c0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.016+0000 7f3303978640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc0b2830 con 0x7f32fc0b0710 2023-11-04T01:40:25.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.016+0000 7f3303978640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc0b1c20 con 0x7f32fc0cae60 2023-11-04T01:40:25.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.016+0000 7f3303978640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc0b1f00 con 0x7f32fc0c1900 2023-11-04T01:40:25.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.016+0000 7f2756363640 1 Processor -- start 2023-11-04T01:40:25.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.016+0000 7f3301714640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32fc0b0710 0x7f32fc1f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.017+0000 7f3301714640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32fc0b0710 0x7f32fc1f62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56824/0 (socket says 172.21.15.77:56824) 2023-11-04T01:40:25.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.017+0000 7f3301714640 1 -- 172.21.15.77:0/890696767 learned_addr learned my addr 172.21.15.77:0/890696767 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:25.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.017+0000 7f9e827fc640 1 -- 172.21.15.77:0/417105483 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9e88004b40 con 0x7f9e8c06c560 2023-11-04T01:40:25.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.017+0000 7f3300f13640 1 --2- 172.21.15.77:0/890696767 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32fc0c1900 0x7f32fc0b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.017+0000 7f3301f15640 1 --2- 172.21.15.77:0/890696767 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32fc0cae60 0x7f32fc0c0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.017+0000 7fdccbe1f640 1 Processor -- start 2023-11-04T01:40:25.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.017+0000 7f3d9cb9e640 1 Processor -- start 2023-11-04T01:40:25.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.017+0000 7fdccbe1f640 1 -- start start 2023-11-04T01:40:25.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.017+0000 7f0a2bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a24009430 0x7f0a240d4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.017+0000 7fa413bc9640 1 Processor -- start 2023-11-04T01:40:25.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.017+0000 7fa413bc9640 1 -- start start 2023-11-04T01:40:25.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.017+0000 7f2756363640 1 -- start start 2023-11-04T01:40:25.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.017+0000 7f0a2bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a240e0010 0x7f0a240d9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.017+0000 7f0a2bfff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0a240070c0 0x7f0a24007570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.017+0000 7f0a2affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a24009430 0x7f0a240d4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.017+0000 7f0a2affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a24009430 0x7f0a240d4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56832/0 (socket says 172.21.15.77:56832) 2023-11-04T01:40:25.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.017+0000 7f0a2a7fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a240e0010 0x7f0a240d9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.017+0000 7f3d9cb9e640 1 -- start start 2023-11-04T01:40:25.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.018+0000 7f9e827fc640 1 --2- 172.21.15.77:0/417105483 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9e7006af40 0x7f9e7006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.018+0000 7f0a2b7fe640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0a240070c0 0x7f0a24007570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.018+0000 7f0a2b7fe640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0a240070c0 0x7f0a24007570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:53442/0 (socket says 172.21.15.77:53442) 2023-11-04T01:40:25.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.018+0000 7f0a2a7fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a240e0010 0x7f0a240d9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:40588/0 (socket says 172.21.15.77:40588) 2023-11-04T01:40:25.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.018+0000 7f9e916c0640 1 --2- 172.21.15.77:0/417105483 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9e7006af40 0x7f9e7006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.018+0000 7f0a2bfff640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a24007ab0 con 0x7f0a24009430 2023-11-04T01:40:25.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.018+0000 7f9e827fc640 1 -- 172.21.15.77:0/417105483 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9e880896a0 con 0x7f9e8c06c560 2023-11-04T01:40:25.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.018+0000 7f0a2bfff640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a240d8170 con 0x7f0a240e0010 2023-11-04T01:40:25.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.018+0000 7f0a2bfff640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a240d8450 con 0x7f0a240070c0 2023-11-04T01:40:25.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.017+0000 7f3301714640 1 -- 172.21.15.77:0/890696767 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32fc0c1900 msgr2=0x7f32fc0b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.017+0000 7f3301714640 1 --2- 172.21.15.77:0/890696767 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32fc0c1900 0x7f32fc0b11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.017+0000 7f3301714640 1 -- 172.21.15.77:0/890696767 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32fc0cae60 msgr2=0x7f32fc0c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.017+0000 7f3301714640 1 --2- 172.21.15.77:0/890696767 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32fc0cae60 0x7f32fc0c0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.017+0000 7f3301714640 1 -- 172.21.15.77:0/890696767 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f8009400 con 0x7f32fc0b0710 2023-11-04T01:40:25.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.017+0000 7f3301714640 1 --2- 172.21.15.77:0/890696767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32fc0b0710 0x7f32fc1f62d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f32f8000c00 tx=0x7f32f8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.018+0000 7f32f1ffb640 1 -- 172.21.15.77:0/890696767 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f803e040 con 0x7f32fc0b0710 2023-11-04T01:40:25.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.018+0000 7f32f1ffb640 1 -- 172.21.15.77:0/890696767 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f8030e10 con 0x7f32fc0b0710 2023-11-04T01:40:25.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.018+0000 7f32f1ffb640 1 -- 172.21.15.77:0/890696767 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f8030610 con 0x7f32fc0b0710 2023-11-04T01:40:25.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.018+0000 7f3303978640 1 -- 172.21.15.77:0/890696767 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32fc0b21e0 con 0x7f32fc0b0710 2023-11-04T01:40:25.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.018+0000 7f3303978640 1 -- 172.21.15.77:0/890696767 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32fc164570 con 0x7f32fc0b0710 2023-11-04T01:40:25.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.018+0000 7fdccbe1f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdcc40cafb0 0x7fdcc413c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.018+0000 7fdc4d89e640 1 Processor -- start 2023-11-04T01:40:25.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.018+0000 7fdccbe1f640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdcc4141e20 0x7fdcc40b4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.018+0000 7f3d9cb9e640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3d9815ccc0 0x7f3d980b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.018+0000 7f3d9cb9e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3d9815d0a0 0x7f3d980b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.018+0000 7f3d9cb9e640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d98160df0 con 0x7f3d980cd680 2023-11-04T01:40:25.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.018+0000 7f3d9cb9e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d980ce260 con 0x7f3d9815d0a0 2023-11-04T01:40:25.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.018+0000 7f3d9cb9e640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d980ce540 con 0x7f3d9815ccc0 2023-11-04T01:40:25.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.018+0000 7fdccbe1f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcc4142480 0x7fdcc41ee4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.018+0000 7fdcc9bbb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdcc40cafb0 0x7fdcc413c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.018+0000 7fdcc9bbb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdcc40cafb0 0x7fdcc413c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:40600/0 (socket says 172.21.15.77:40600) 2023-11-04T01:40:25.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.018+0000 7fa413bc9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa40c06fa40 0x7fa40c0b4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.018+0000 7fa413bc9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa40c0cbbb0 0x7fa40c15fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.019+0000 7fdcc9bbb640 1 -- 172.21.15.77:0/2492717160 learned_addr learned my addr 172.21.15.77:0/2492717160 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:25.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.018+0000 7f2756363640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2748034530 0x7f27480497e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.019+0000 7fdccbe1f640 1 -- 172.21.15.77:0/2492717160 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc40b4000 con 0x7fdcc4142480 2023-11-04T01:40:25.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.018+0000 7f2756363640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f274803ad90 0x7f27480480f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.018+0000 7f2756363640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27480e75f0 0x7f27480c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.018+0000 7f2756363640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2748048630 con 0x7f27480e75f0 2023-11-04T01:40:25.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.018+0000 7f2756363640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2748049350 con 0x7f274803ad90 2023-11-04T01:40:25.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.018+0000 7f2756363640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27480e67a0 con 0x7f2748034530 2023-11-04T01:40:25.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.019+0000 7f2755361640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2748034530 0x7f27480497e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.019+0000 7f2755361640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2748034530 0x7f27480497e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:53456/0 (socket says 172.21.15.77:53456) 2023-11-04T01:40:25.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.019+0000 7fdccbe1f640 1 -- 172.21.15.77:0/2492717160 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc41eef00 con 0x7fdcc40cafb0 2023-11-04T01:40:25.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.019+0000 7f2755361640 1 -- 172.21.15.77:0/2133373080 learned_addr learned my addr 172.21.15.77:0/2133373080 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:25.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.019+0000 7f2755b62640 1 --2- 172.21.15.77:0/2133373080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27480e75f0 0x7f27480c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.019+0000 7f9e916c0640 1 --2- 172.21.15.77:0/417105483 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9e7006af40 0x7f9e7006d400 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c158d30 tx=0x7f9e7c009110 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.019+0000 7fdccbe1f640 1 -- 172.21.15.77:0/2492717160 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc41ef1e0 con 0x7fdcc4141e20 2023-11-04T01:40:25.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.018+0000 7fa413bc9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa40c0cdc80 0x7fa40c0c0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.019+0000 7fdcca3bc640 1 --2- 172.21.15.77:0/2492717160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcc4142480 0x7fdcc41ee4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.019+0000 7fa413bc9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c0b4580 con 0x7fa40c0cbbb0 2023-11-04T01:40:25.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.019+0000 7f9e94125640 1 --2- 172.21.15.77:0/417105483 >> [v2:172.21.15.122:6816/2755171866,v1:172.21.15.122:6817/2755171866] conn(0x7f9e8c0c90f0 0x7f9e8c0b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.019+0000 7fa413bc9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c0c8350 con 0x7fa40c0cdc80 2023-11-04T01:40:25.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.019+0000 7f9e94125640 1 -- 172.21.15.77:0/417105483 --> [v2:172.21.15.122:6816/2755171866,v1:172.21.15.122:6817/2755171866] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9e8c06bde0 con 0x7f9e8c0c90f0 2023-11-04T01:40:25.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.019+0000 7fa413bc9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c0c7a20 con 0x7fa40c06fa40 2023-11-04T01:40:25.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.019+0000 7fa411965640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa40c06fa40 0x7fa40c0b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.019+0000 7fa411965640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa40c06fa40 0x7fa40c0b4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:53460/0 (socket says 172.21.15.77:53460) 2023-11-04T01:40:25.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.019+0000 7fa411965640 1 -- 172.21.15.77:0/345773408 learned_addr learned my addr 172.21.15.77:0/345773408 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:25.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.019+0000 7fdcc93ba640 1 --2- 172.21.15.77:0/2492717160 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdcc4141e20 0x7fdcc40b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.019+0000 7fa411164640 1 --2- 172.21.15.77:0/345773408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa40c0cbbb0 0x7fa40c15fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.019+0000 7f3d9659c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3d9815ccc0 0x7f3d980b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.019+0000 7f0a2affd640 1 -- 172.21.15.77:0/591739385 learned_addr learned my addr 172.21.15.77:0/591739385 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:25.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.019+0000 7f9e926c2640 1 --2- 172.21.15.77:0/417105483 >> [v2:172.21.15.122:6816/2755171866,v1:172.21.15.122:6817/2755171866] conn(0x7f9e8c0c90f0 0x7f9e8c0b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.019+0000 7fdcc9bbb640 1 -- 172.21.15.77:0/2492717160 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdcc4141e20 msgr2=0x7fdcc40b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.019+0000 7fdcc9bbb640 1 --2- 172.21.15.77:0/2492717160 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdcc4141e20 0x7fdcc40b4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.019+0000 7fdcc9bbb640 1 -- 172.21.15.77:0/2492717160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcc4142480 msgr2=0x7fdcc41ee4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.019+0000 7fdcc9bbb640 1 --2- 172.21.15.77:0/2492717160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcc4142480 0x7fdcc41ee4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.019+0000 7fdcc9bbb640 1 -- 172.21.15.77:0/2492717160 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc0009400 con 0x7fdcc40cafb0 2023-11-04T01:40:25.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.019+0000 7f3303978640 1 -- 172.21.15.77:0/890696767 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f32fc0ccae0 con 0x7f32fc0b0710 2023-11-04T01:40:25.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.019+0000 7f3d95d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3d9815d0a0 0x7f3d980b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.019+0000 7f3d9659c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3d9815ccc0 0x7f3d980b48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:40608/0 (socket says 172.21.15.77:40608) 2023-11-04T01:40:25.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.019+0000 7f3d9659c640 1 -- 172.21.15.77:0/235225063 learned_addr learned my addr 172.21.15.77:0/235225063 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:25.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.018+0000 7fdc4d89e640 1 -- start start 2023-11-04T01:40:25.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7fa411965640 1 -- 172.21.15.77:0/345773408 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa40c0cdc80 msgr2=0x7fa40c0c0620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-04T01:40:25.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7fdcc9bbb640 1 --2- 172.21.15.77:0/2492717160 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdcc40cafb0 0x7fdcc413c430 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0000c00 tx=0x7fdcc00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7fa411965640 1 --2- 172.21.15.77:0/345773408 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa40c0cdc80 0x7fa40c0c0620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7f3d9659c640 1 -- 172.21.15.77:0/235225063 >> v2:172.21.15.77:3300/0 conn(0x7f3d9815d0a0 msgr2=0x7f3d980b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7f3d9659c640 1 --2- 172.21.15.77:0/235225063 >> v2:172.21.15.77:3300/0 conn(0x7f3d9815d0a0 0x7f3d980b4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7f3d9659c640 1 -- 172.21.15.77:0/235225063 >> v1:172.21.15.122:6789/0 conn(0x7f3d980cd680 legacy=0x7f3d980cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7f3d9659c640 1 -- 172.21.15.77:0/235225063 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d980d1050 con 0x7f3d9815ccc0 2023-11-04T01:40:25.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7f0a2b7fe640 1 -- 172.21.15.77:0/591739385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a240e0010 msgr2=0x7f0a240d9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7f0a2b7fe640 1 --2- 172.21.15.77:0/591739385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a240e0010 0x7f0a240d9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7f0a2b7fe640 1 -- 172.21.15.77:0/591739385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a24009430 msgr2=0x7f0a240d4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7f0a2b7fe640 1 --2- 172.21.15.77:0/591739385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a24009430 0x7f0a240d4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7fa411965640 1 -- 172.21.15.77:0/345773408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa40c0cbbb0 msgr2=0x7fa40c15fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7fa411965640 1 --2- 172.21.15.77:0/345773408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa40c0cbbb0 0x7fa40c15fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7fa411965640 1 -- 172.21.15.77:0/345773408 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3fc0094d0 con 0x7fa40c06fa40 2023-11-04T01:40:25.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7f0a2b7fe640 1 -- 172.21.15.77:0/591739385 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a2c04f380 con 0x7f0a240070c0 2023-11-04T01:40:25.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.019+0000 7f2754b60640 1 --2- 172.21.15.77:0/2133373080 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f274803ad90 0x7f27480480f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7f2755361640 1 -- 172.21.15.77:0/2133373080 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f274803ad90 msgr2=0x7f27480480f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7f2755361640 1 --2- 172.21.15.77:0/2133373080 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f274803ad90 0x7f27480480f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7f2755361640 1 -- 172.21.15.77:0/2133373080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27480e75f0 msgr2=0x7f27480c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7f2755361640 1 --2- 172.21.15.77:0/2133373080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27480e75f0 0x7f27480c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7f2755361640 1 -- 172.21.15.77:0/2133373080 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274c009400 con 0x7f2748034530 2023-11-04T01:40:25.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7fdc4d89e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc30005180 0x7fdc481f7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7f2754b60640 1 --2- 172.21.15.77:0/2133373080 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f274803ad90 0x7f27480480f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:25.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7fdc4d89e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc48153900 0x7fdc4815afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7fdcba7fc640 1 -- 172.21.15.77:0/2492717160 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc0043640 con 0x7fdcc40cafb0 2023-11-04T01:40:25.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7fdc4d89e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc48153d80 0x7fdc48159500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7fdcba7fc640 1 -- 172.21.15.77:0/2492717160 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc00437a0 con 0x7fdcc40cafb0 2023-11-04T01:40:25.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7f0a2b7fe640 1 --2- 172.21.15.77:0/591739385 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0a240070c0 0x7f0a24007570 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c074190 tx=0x7f0a2c069f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7fdcba7fc640 1 -- 172.21.15.77:0/2492717160 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc0043b50 con 0x7fdcc40cafb0 2023-11-04T01:40:25.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7fa411965640 1 --2- 172.21.15.77:0/345773408 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa40c06fa40 0x7fa40c0b4040 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa40400c7c0 tx=0x7fa40400cc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7fdc4d89e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc481590e0 con 0x7fdc48153d80 2023-11-04T01:40:25.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7fdc4d89e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc48158ab0 con 0x7fdc30005180 2023-11-04T01:40:25.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7fdc4d89e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc481f75b0 con 0x7fdc48153900 2023-11-04T01:40:25.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7f0a13fff640 1 -- 172.21.15.77:0/591739385 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c0b4070 con 0x7f0a240070c0 2023-11-04T01:40:25.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7f0a13fff640 1 -- 172.21.15.77:0/591739385 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2c060e40 con 0x7f0a240070c0 2023-11-04T01:40:25.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7f0a13fff640 1 -- 172.21.15.77:0/591739385 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c061780 con 0x7f0a240070c0 2023-11-04T01:40:25.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7fdccbe1f640 1 -- 172.21.15.77:0/2492717160 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc40b3c20 con 0x7fdcc40cafb0 2023-11-04T01:40:25.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7f0a2bfff640 1 -- 172.21.15.77:0/591739385 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a240d8730 con 0x7f0a240070c0 2023-11-04T01:40:25.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7fdc4c89c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc30005180 0x7fdc481f7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.021+0000 7f0a2bfff640 1 -- 172.21.15.77:0/591739385 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a240d8cf0 con 0x7f0a240070c0 2023-11-04T01:40:25.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7fdc47fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc48153900 0x7fdc4815afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7fdc47fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc48153900 0x7fdc4815afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:53480/0 (socket says 172.21.15.77:53480) 2023-11-04T01:40:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7fdc47fff640 1 -- 172.21.15.77:0/223201582 learned_addr learned my addr 172.21.15.77:0/223201582 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7fdc4d09d640 1 --2- 172.21.15.77:0/223201582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc48153d80 0x7fdc48159500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.021+0000 7f9e926c2640 1 --2- 172.21.15.77:0/417105483 >> [v2:172.21.15.122:6816/2755171866,v1:172.21.15.122:6817/2755171866] conn(0x7f9e8c0c90f0 0x7f9e8c0b15c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.021+0000 7fdc47fff640 1 -- 172.21.15.77:0/223201582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc30005180 msgr2=0x7fdc481f7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.021+0000 7fdc47fff640 1 --2- 172.21.15.77:0/223201582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc30005180 0x7fdc481f7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.021+0000 7fdc47fff640 1 -- 172.21.15.77:0/223201582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc48153d80 msgr2=0x7fdc48159500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.021+0000 7fdc47fff640 1 --2- 172.21.15.77:0/223201582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc48153d80 0x7fdc48159500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.021+0000 7f2755361640 1 --2- 172.21.15.77:0/2133373080 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2748034530 0x7f27480497e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f274c000c00 tx=0x7f274c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.021+0000 7f3d9659c640 1 --2- 172.21.15.77:0/235225063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d9815ccc0 0x7f3d980b48a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3d980668f0 tx=0x7f3d8c02b9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee23c803a5b561eb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.021+0000 7fdc47fff640 1 -- 172.21.15.77:0/223201582 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4815a370 con 0x7fdc48153900 2023-11-04T01:40:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.021+0000 7fdc4d09d640 1 --2- 172.21.15.77:0/223201582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc48153d80 0x7fdc48159500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:25.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.021+0000 7fa4027fc640 1 -- 172.21.15.77:0/345773408 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40400aa50 con 0x7fa40c06fa40 2023-11-04T01:40:25.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.021+0000 7f2745ffb640 1 -- 172.21.15.77:0/2133373080 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c032840 con 0x7f2748034530 2023-11-04T01:40:25.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.021+0000 7fa4027fc640 1 -- 172.21.15.77:0/345773408 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa40400abb0 con 0x7fa40c06fa40 2023-11-04T01:40:25.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.021+0000 7fa4027fc640 1 -- 172.21.15.77:0/345773408 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa404012420 con 0x7fa40c06fa40 2023-11-04T01:40:25.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.021+0000 7f32f1ffb640 1 -- 172.21.15.77:0/890696767 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f32f804d3b0 con 0x7f32fc0b0710 2023-11-04T01:40:25.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.021+0000 7fa413bc9640 1 -- 172.21.15.77:0/345773408 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa40c0c7d00 con 0x7fa40c06fa40 2023-11-04T01:40:25.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.020+0000 7fdccbe1f640 1 -- 172.21.15.77:0/2492717160 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc413c970 con 0x7fdcc40cafb0 2023-11-04T01:40:25.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.021+0000 7f2756363640 1 -- 172.21.15.77:0/2133373080 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f274804bd50 con 0x7f2748034530 2023-11-04T01:40:25.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.022+0000 7fa413bc9640 1 -- 172.21.15.77:0/345773408 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa40c0b47b0 con 0x7fa40c06fa40 2023-11-04T01:40:25.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.021+0000 7fdccbe1f640 1 -- 172.21.15.77:0/2492717160 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdcc40cb4b0 con 0x7fdcc40cafb0 2023-11-04T01:40:25.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.022+0000 7f2745ffb640 1 -- 172.21.15.77:0/2133373080 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274c0329a0 con 0x7f2748034530 2023-11-04T01:40:25.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.022+0000 7f2745ffb640 1 -- 172.21.15.77:0/2133373080 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c032d10 con 0x7f2748034530 2023-11-04T01:40:25.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.022+0000 7f0a11ffb640 1 -- 172.21.15.77:0/591739385 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0a24054d70 con 0x7f0a240070c0 2023-11-04T01:40:25.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.022+0000 7f2756363640 1 -- 172.21.15.77:0/2133373080 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f274804ba70 con 0x7f2748034530 2023-11-04T01:40:25.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.022+0000 7f9e827fc640 1 -- 172.21.15.77:0/417105483 <== osd.6 v2:172.21.15.122:6816/2755171866 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f9e840344c0 con 0x7f9e8c0c90f0 2023-11-04T01:40:25.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.022+0000 7f32f1ffb640 1 --2- 172.21.15.77:0/890696767 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f32e006af40 0x7f32e006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.022+0000 7f32f1ffb640 1 -- 172.21.15.77:0/890696767 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f32f80ac1a0 con 0x7f32fc0b0710 2023-11-04T01:40:25.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.022+0000 7f32f1ffb640 1 --2- 172.21.15.77:0/890696767 >> [v2:172.21.15.77:6808/2904971997,v1:172.21.15.77:6809/2904971997] conn(0x7f32e0074580 0x7f32e00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.022+0000 7f32f1ffb640 1 -- 172.21.15.77:0/890696767 --> [v2:172.21.15.77:6808/2904971997,v1:172.21.15.77:6809/2904971997] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f32e0077090 con 0x7f32e0074580 2023-11-04T01:40:25.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.022+0000 7f32f1ffb640 1 -- 172.21.15.77:0/890696767 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32f80ac550 con 0x7f32fc0b0710 2023-11-04T01:40:25.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.023+0000 7f3300f13640 1 --2- 172.21.15.77:0/890696767 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f32e006af40 0x7f32e006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.023+0000 7f3301f15640 1 --2- 172.21.15.77:0/890696767 >> [v2:172.21.15.77:6808/2904971997,v1:172.21.15.77:6809/2904971997] conn(0x7f32e0074580 0x7f32e00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.023+0000 7f3301f15640 1 --2- 172.21.15.77:0/890696767 >> [v2:172.21.15.77:6808/2904971997,v1:172.21.15.77:6809/2904971997] conn(0x7f32e0074580 0x7f32e00769c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.023+0000 7f3d9559a640 1 -- 172.21.15.77:0/235225063 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c030870 con 0x7f3d9815ccc0 2023-11-04T01:40:25.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.023+0000 7f3d9559a640 1 -- 172.21.15.77:0/235225063 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8c0309d0 con 0x7f3d9815ccc0 2023-11-04T01:40:25.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.023+0000 7f3d9559a640 1 -- 172.21.15.77:0/235225063 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c030d60 con 0x7f3d9815ccc0 2023-11-04T01:40:25.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.022+0000 7fdc47fff640 1 --2- 172.21.15.77:0/223201582 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc48153900 0x7fdc4815afe0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdc3800d930 tx=0x7fdc3800ddf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.023+0000 7fdc457fa640 1 -- 172.21.15.77:0/223201582 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc38005480 con 0x7fdc48153900 2023-11-04T01:40:25.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.023+0000 7fdc457fa640 1 -- 172.21.15.77:0/223201582 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3800b6b0 con 0x7fdc48153900 2023-11-04T01:40:25.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.023+0000 7fdc457fa640 1 -- 172.21.15.77:0/223201582 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3800ba40 con 0x7fdc48153900 2023-11-04T01:40:25.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.023+0000 7fdc4d89e640 1 -- 172.21.15.77:0/223201582 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc4815a650 con 0x7fdc48153900 2023-11-04T01:40:25.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.023+0000 7fdc4d89e640 1 -- 172.21.15.77:0/223201582 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc4815a080 con 0x7fdc48153900 2023-11-04T01:40:25.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.024+0000 7fdc4d89e640 1 -- 172.21.15.77:0/223201582 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdc4806d010 con 0x7fdc48153900 2023-11-04T01:40:25.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.024+0000 7f0a13fff640 1 -- 172.21.15.77:0/591739385 <== mon.2 v2:172.21.15.122:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0a2c0618e0 con 0x7f0a240070c0 2023-11-04T01:40:25.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.023+0000 7f2756363640 1 -- 172.21.15.77:0/2133373080 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2748050150 con 0x7f2748034530 2023-11-04T01:40:25.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.023+0000 7fa413bc9640 1 -- 172.21.15.77:0/345773408 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa40c0cb760 con 0x7fa40c06fa40 2023-11-04T01:40:25.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.024+0000 7f2745ffb640 1 -- 172.21.15.77:0/2133373080 <== mon.2 v2:172.21.15.122:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f274c03b3f0 con 0x7f2748034530 2023-11-04T01:40:25.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.023+0000 7fdcba7fc640 1 -- 172.21.15.77:0/2492717160 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdcc003f040 con 0x7fdcc40cafb0 2023-11-04T01:40:25.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.024+0000 7f3300f13640 1 --2- 172.21.15.77:0/890696767 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f32e006af40 0x7f32e006d400 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f32fc0721a0 tx=0x7f32ec007e80 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.023+0000 7fdcba7fc640 1 --2- 172.21.15.77:0/2492717160 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdca806aef0 0x7fdca806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.023+0000 7fdcba7fc640 1 -- 172.21.15.77:0/2492717160 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdcc00b0290 con 0x7fdcc40cafb0 2023-11-04T01:40:25.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.023+0000 7fdcba7fc640 1 --2- 172.21.15.77:0/2492717160 >> [v2:172.21.15.77:6800/4106490517,v1:172.21.15.77:6801/4106490517] conn(0x7fdca8074530 0x7fdca8076970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.023+0000 7fdcba7fc640 1 -- 172.21.15.77:0/2492717160 --> [v2:172.21.15.77:6800/4106490517,v1:172.21.15.77:6801/4106490517] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdca8077040 con 0x7fdca8074530 2023-11-04T01:40:25.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.023+0000 7fdcba7fc640 1 -- 172.21.15.77:0/2492717160 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdcc00b0600 con 0x7fdcc40cafb0 2023-11-04T01:40:25.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.024+0000 7fdcca3bc640 1 --2- 172.21.15.77:0/2492717160 >> [v2:172.21.15.77:6800/4106490517,v1:172.21.15.77:6801/4106490517] conn(0x7fdca8074530 0x7fdca8076970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.024+0000 7f2745ffb640 1 --2- 172.21.15.77:0/2133373080 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f273406af70 0x7f273406d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.025+0000 7f32f1ffb640 1 -- 172.21.15.77:0/890696767 <== osd.0 v2:172.21.15.77:6808/2904971997 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f32e0077090 con 0x7f32e0074580 2023-11-04T01:40:25.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.024+0000 7f0a13fff640 1 --2- 172.21.15.77:0/591739385 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0a1806ae70 0x7f0a1806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.024+0000 7f0a13fff640 1 -- 172.21.15.77:0/591739385 <== mon.2 v2:172.21.15.122:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0a2c125560 con 0x7f0a240070c0 2023-11-04T01:40:25.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.024+0000 7f0a13fff640 1 --2- 172.21.15.77:0/591739385 >> [v2:172.21.15.122:6800/917968549,v1:172.21.15.122:6801/917968549] conn(0x7f0a180744b0 0x7f0a180768f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.024+0000 7f0a13fff640 1 -- 172.21.15.77:0/591739385 --> [v2:172.21.15.122:6800/917968549,v1:172.21.15.122:6801/917968549] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0a18076fc0 con 0x7f0a180744b0 2023-11-04T01:40:25.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.024+0000 7f0a13fff640 1 -- 172.21.15.77:0/591739385 <== mon.2 v2:172.21.15.122:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a2c125910 con 0x7f0a240070c0 2023-11-04T01:40:25.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.025+0000 7fa4027fc640 1 -- 172.21.15.77:0/345773408 <== mon.2 v2:172.21.15.122:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa404012580 con 0x7fa40c06fa40 2023-11-04T01:40:25.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.025+0000 7f0a2affd640 1 --2- 172.21.15.77:0/591739385 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0a1806ae70 0x7f0a1806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.025+0000 7f2754b60640 1 --2- 172.21.15.77:0/2133373080 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f273406af70 0x7f273406d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.025+0000 7f2745ffb640 1 -- 172.21.15.77:0/2133373080 <== mon.2 v2:172.21.15.122:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f274c0ab800 con 0x7f2748034530 2023-11-04T01:40:25.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.025+0000 7f2745ffb640 1 --2- 172.21.15.77:0/2133373080 >> [v2:172.21.15.122:6808/1398878302,v1:172.21.15.122:6809/1398878302] conn(0x7f27340745b0 0x7f27340769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.025+0000 7f2745ffb640 1 -- 172.21.15.77:0/2133373080 --> [v2:172.21.15.122:6808/1398878302,v1:172.21.15.122:6809/1398878302] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f27340770c0 con 0x7f27340745b0 2023-11-04T01:40:25.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.025+0000 7f2745ffb640 1 -- 172.21.15.77:0/2133373080 <== mon.2 v2:172.21.15.122:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f274c0abbb0 con 0x7f2748034530 2023-11-04T01:40:25.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.025+0000 7f3d9cb9e640 1 -- 172.21.15.77:0/235225063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d9815ccc0 msgr2=0x7f3d980b48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.025+0000 7fa4027fc640 1 --2- 172.21.15.77:0/345773408 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa3f006af40 0x7fa3f006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.025+0000 7fa4027fc640 1 -- 172.21.15.77:0/345773408 <== mon.2 v2:172.21.15.122:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa404089800 con 0x7fa40c06fa40 2023-11-04T01:40:25.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.025+0000 7f2754b60640 1 --2- 172.21.15.77:0/2133373080 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f273406af70 0x7f273406d430 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f27500739c0 tx=0x7f2750066e40 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.025+0000 7fdc457fa640 1 -- 172.21.15.77:0/223201582 <== mon.2 v2:172.21.15.122:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdc3800bba0 con 0x7fdc48153900 2023-11-04T01:40:25.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.025+0000 7f3d9cb9e640 1 --2- 172.21.15.77:0/235225063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d9815ccc0 0x7f3d980b48a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3d980668f0 tx=0x7f3d8c02b9b0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.026+0000 7fa4027fc640 1 --2- 172.21.15.77:0/345773408 >> [v2:172.21.15.122:6824/110375226,v1:172.21.15.122:6825/110375226] conn(0x7fa3f0074500 0x7fa3f0076940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.026+0000 7fa4027fc640 1 -- 172.21.15.77:0/345773408 --> [v2:172.21.15.122:6824/110375226,v1:172.21.15.122:6825/110375226] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa3f0077010 con 0x7fa3f0074500 2023-11-04T01:40:25.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.026+0000 7f3d9cb9e640 1 -- 172.21.15.77:0/235225063 shutdown_connections 2023-11-04T01:40:25.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.026+0000 7f3d9cb9e640 1 --2- 172.21.15.77:0/235225063 >> v2:172.21.15.77:3300/0 conn(0x7f3d9815d0a0 0x7f3d980b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.026+0000 7f3d9cb9e640 1 --2- 172.21.15.77:0/235225063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d9815ccc0 0x7f3d980b48a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.025+0000 7fdcca3bc640 1 --2- 172.21.15.77:0/2492717160 >> [v2:172.21.15.77:6800/4106490517,v1:172.21.15.77:6801/4106490517] conn(0x7fdca8074530 0x7fdca8076970 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.025+0000 7fdcc93ba640 1 --2- 172.21.15.77:0/2492717160 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdca806aef0 0x7fdca806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.026+0000 7fdcba7fc640 1 -- 172.21.15.77:0/2492717160 <== osd.1 v2:172.21.15.77:6800/4106490517 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7fdca8077040 con 0x7fdca8074530 2023-11-04T01:40:25.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.026+0000 7f3d9cb9e640 1 -- 172.21.15.77:0/235225063 >> 172.21.15.77:0/235225063 conn(0x7f3d980cf8a0 msgr2=0x7f3d980cfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.026+0000 7fa4027fc640 1 -- 172.21.15.77:0/345773408 <== mon.2 v2:172.21.15.122:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa404054630 con 0x7fa40c06fa40 2023-11-04T01:40:25.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.026+0000 7f2755b62640 1 --2- 172.21.15.77:0/2133373080 >> [v2:172.21.15.122:6808/1398878302,v1:172.21.15.122:6809/1398878302] conn(0x7f27340745b0 0x7f27340769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.026+0000 7fdcc93ba640 1 --2- 172.21.15.77:0/2492717160 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdca806aef0 0x7fdca806d3b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4009fd0 tx=0x7fdcb4008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.026+0000 7fa411164640 1 --2- 172.21.15.77:0/345773408 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa3f006af40 0x7fa3f006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.026+0000 7f3d9cb9e640 1 -- 172.21.15.77:0/235225063 shutdown_connections 2023-11-04T01:40:25.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.026+0000 7fa412166640 1 --2- 172.21.15.77:0/345773408 >> [v2:172.21.15.122:6824/110375226,v1:172.21.15.122:6825/110375226] conn(0x7fa3f0074500 0x7fa3f0076940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.026+0000 7f0a2a7fc640 1 --2- 172.21.15.77:0/591739385 >> [v2:172.21.15.122:6800/917968549,v1:172.21.15.122:6801/917968549] conn(0x7f0a180744b0 0x7f0a180768f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.026+0000 7fdc457fa640 1 --2- 172.21.15.77:0/223201582 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdc3406aef0 0x7fdc3406d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.026+0000 7f3d9cb9e640 1 -- 172.21.15.77:0/235225063 wait complete. 2023-11-04T01:40:25.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.026+0000 7fdc457fa640 1 -- 172.21.15.77:0/223201582 <== mon.2 v2:172.21.15.122:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdc38089cf0 con 0x7fdc48153900 2023-11-04T01:40:25.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.026+0000 7fdc4c89c640 1 --2- 172.21.15.77:0/223201582 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdc3406aef0 0x7fdc3406d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.026+0000 7f2755b62640 1 --2- 172.21.15.77:0/2133373080 >> [v2:172.21.15.122:6808/1398878302,v1:172.21.15.122:6809/1398878302] conn(0x7f27340745b0 0x7f27340769f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.026+0000 7fdc457fa640 1 --2- 172.21.15.77:0/223201582 >> [v2:172.21.15.77:6824/3229620085,v1:172.21.15.77:6825/3229620085] conn(0x7fdc34074530 0x7fdc34076970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.026+0000 7f0a2affd640 1 --2- 172.21.15.77:0/591739385 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0a1806ae70 0x7f0a1806d330 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c004e40 tx=0x7f0a1c007f10 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.026+0000 7fdc457fa640 1 -- 172.21.15.77:0/223201582 --> [v2:172.21.15.77:6824/3229620085,v1:172.21.15.77:6825/3229620085] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdc34077040 con 0x7fdc34074530 2023-11-04T01:40:25.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.027+0000 7f0a2a7fc640 1 --2- 172.21.15.77:0/591739385 >> [v2:172.21.15.122:6800/917968549,v1:172.21.15.122:6801/917968549] conn(0x7f0a180744b0 0x7f0a180768f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.026+0000 7fdc457fa640 1 -- 172.21.15.77:0/223201582 <== mon.2 v2:172.21.15.122:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc38089fe0 con 0x7fdc48153900 2023-11-04T01:40:25.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.027+0000 7fdc4d09d640 1 --2- 172.21.15.77:0/223201582 >> [v2:172.21.15.77:6824/3229620085,v1:172.21.15.77:6825/3229620085] conn(0x7fdc34074530 0x7fdc34076970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.027+0000 7fa412166640 1 --2- 172.21.15.77:0/345773408 >> [v2:172.21.15.122:6824/110375226,v1:172.21.15.122:6825/110375226] conn(0x7fa3f0074500 0x7fa3f0076940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.027+0000 7fdc4c89c640 1 --2- 172.21.15.77:0/223201582 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdc3406aef0 0x7fdc3406d3b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c007fd0 tx=0x7fdc3c007d10 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.027+0000 7fa411164640 1 --2- 172.21.15.77:0/345773408 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa3f006af40 0x7fa3f006d400 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa40c1fa0d0 tx=0x7fa408008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.027+0000 7f2745ffb640 1 -- 172.21.15.77:0/2133373080 <== osd.5 v2:172.21.15.122:6808/1398878302 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f27340770c0 con 0x7f27340745b0 2023-11-04T01:40:25.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.028+0000 7fdc4d09d640 1 --2- 172.21.15.77:0/223201582 >> [v2:172.21.15.77:6824/3229620085,v1:172.21.15.77:6825/3229620085] conn(0x7fdc34074530 0x7fdc34076970 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.028+0000 7f0a13fff640 1 -- 172.21.15.77:0/591739385 <== osd.4 v2:172.21.15.122:6800/917968549 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f0a18076fc0 con 0x7f0a180744b0 2023-11-04T01:40:25.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.028+0000 7fa4027fc640 1 -- 172.21.15.77:0/345773408 <== osd.7 v2:172.21.15.122:6824/110375226 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7fa3f0077010 con 0x7fa3f0074500 2023-11-04T01:40:25.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.029+0000 7fdc457fa640 1 -- 172.21.15.77:0/223201582 <== osd.3 v2:172.21.15.77:6824/3229620085 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7fdc34077040 con 0x7fdc34074530 2023-11-04T01:40:25.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.028+0000 7f3d9cb9e640 1 Processor -- start 2023-11-04T01:40:25.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.028+0000 7f3d9cb9e640 1 -- start start 2023-11-04T01:40:25.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.029+0000 7f3d9cb9e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d980cd680 0x7f3d980cb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.029+0000 7f3d9cb9e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d9815d0a0 0x7f3d980c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.029+0000 7f3d9cb9e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3d980cb8b0 0x7f3d981509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.029+0000 7f3d9cb9e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d980ca2d0 con 0x7f3d9815d0a0 2023-11-04T01:40:25.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.029+0000 7f3d9cb9e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d980ca5b0 con 0x7f3d980cd680 2023-11-04T01:40:25.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.029+0000 7f3d9cb9e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d980ca890 con 0x7f3d980cb8b0 2023-11-04T01:40:25.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.030+0000 7f3d96d9d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3d980cb8b0 0x7f3d981509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.030+0000 7f3d96d9d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3d980cb8b0 0x7f3d981509b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:53496/0 (socket says 172.21.15.77:53496) 2023-11-04T01:40:25.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.030+0000 7f3d96d9d640 1 -- 172.21.15.77:0/688863965 learned_addr learned my addr 172.21.15.77:0/688863965 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:25.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.030+0000 7f3d9659c640 1 --2- 172.21.15.77:0/688863965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d980cd680 0x7f3d980cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.030+0000 7f3d96d9d640 1 -- 172.21.15.77:0/688863965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d980cd680 msgr2=0x7f3d980cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.030+0000 7f3d96d9d640 1 --2- 172.21.15.77:0/688863965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d980cd680 0x7f3d980cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.030+0000 7f3d96d9d640 1 -- 172.21.15.77:0/688863965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d9815d0a0 msgr2=0x7f3d980c81c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-04T01:40:25.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.030+0000 7f3d95d9b640 1 --2- 172.21.15.77:0/688863965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d9815d0a0 0x7f3d980c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.031+0000 7f3d96d9d640 1 --2- 172.21.15.77:0/688863965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d9815d0a0 0x7f3d980c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.031+0000 7f3d96d9d640 1 -- 172.21.15.77:0/688863965 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8c0094d0 con 0x7f3d980cb8b0 2023-11-04T01:40:25.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.031+0000 7f3d95d9b640 1 --2- 172.21.15.77:0/688863965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d9815d0a0 0x7f3d980c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:25.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.031+0000 7f3d96d9d640 1 --2- 172.21.15.77:0/688863965 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3d980cb8b0 0x7f3d981509b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3d8800c3c0 tx=0x7f3d8800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.031+0000 7f3d86ffd640 1 -- 172.21.15.77:0/688863965 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d880052d0 con 0x7f3d980cb8b0 2023-11-04T01:40:25.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.031+0000 7f3d86ffd640 1 -- 172.21.15.77:0/688863965 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d88005430 con 0x7f3d980cb8b0 2023-11-04T01:40:25.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.032+0000 7f3d86ffd640 1 -- 172.21.15.77:0/688863965 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d88007240 con 0x7f3d980cb8b0 2023-11-04T01:40:25.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.032+0000 7f3d9cb9e640 1 -- 172.21.15.77:0/688863965 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d980cab70 con 0x7f3d980cb8b0 2023-11-04T01:40:25.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.032+0000 7f3d9cb9e640 1 -- 172.21.15.77:0/688863965 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d980c9ef0 con 0x7f3d980cb8b0 2023-11-04T01:40:25.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.034+0000 7f3d9cb9e640 1 -- 172.21.15.77:0/688863965 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3d980ca720 con 0x7f3d980cb8b0 2023-11-04T01:40:25.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.035+0000 7f3d86ffd640 1 -- 172.21.15.77:0/688863965 <== mon.2 v2:172.21.15.122:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3d880073a0 con 0x7f3d980cb8b0 2023-11-04T01:40:25.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.036+0000 7f3d86ffd640 1 --2- 172.21.15.77:0/688863965 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3d7806af70 0x7f3d7806d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.036+0000 7f3d86ffd640 1 -- 172.21.15.77:0/688863965 <== mon.2 v2:172.21.15.122:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3d88088a60 con 0x7f3d980cb8b0 2023-11-04T01:40:25.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.036+0000 7f3d86ffd640 1 --2- 172.21.15.77:0/688863965 >> [v2:172.21.15.77:6814/3962772574,v1:172.21.15.77:6816/3962772574] conn(0x7f3d780743c0 0x7f3d78076800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.036+0000 7f3d86ffd640 1 -- 172.21.15.77:0/688863965 --> [v2:172.21.15.77:6814/3962772574,v1:172.21.15.77:6816/3962772574] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3d78076ed0 con 0x7f3d780743c0 2023-11-04T01:40:25.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.037+0000 7f3d95d9b640 1 --2- 172.21.15.77:0/688863965 >> [v2:172.21.15.77:6814/3962772574,v1:172.21.15.77:6816/3962772574] conn(0x7f3d780743c0 0x7f3d78076800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.037+0000 7f3d9659c640 1 --2- 172.21.15.77:0/688863965 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3d7806af70 0x7f3d7806d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.037+0000 7f3d86ffd640 1 -- 172.21.15.77:0/688863965 <== mon.2 v2:172.21.15.122:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d88053820 con 0x7f3d980cb8b0 2023-11-04T01:40:25.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.037+0000 7f3d95d9b640 1 --2- 172.21.15.77:0/688863965 >> [v2:172.21.15.77:6814/3962772574,v1:172.21.15.77:6816/3962772574] conn(0x7f3d780743c0 0x7f3d78076800 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.037+0000 7f3d9659c640 1 --2- 172.21.15.77:0/688863965 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3d7806af70 0x7f3d7806d430 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c036000 tx=0x7f3d8c008030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.038+0000 7f3d86ffd640 1 -- 172.21.15.77:0/688863965 <== osd.2 v2:172.21.15.77:6814/3962772574 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f3d78076ed0 con 0x7f3d780743c0 2023-11-04T01:40:25.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.054+0000 7f9e94125640 1 -- 172.21.15.77:0/417105483 --> [v2:172.21.15.122:6816/2755171866,v1:172.21.15.122:6817/2755171866] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9e8c0ceb70 con 0x7f9e8c0c90f0 2023-11-04T01:40:25.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.055+0000 7f9e827fc640 1 -- 172.21.15.77:0/417105483 <== osd.6 v2:172.21.15.122:6816/2755171866 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9e84034630 con 0x7f9e8c0c90f0 2023-11-04T01:40:25.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.056+0000 7f9e6ffff640 1 -- 172.21.15.77:0/417105483 >> [v2:172.21.15.122:6816/2755171866,v1:172.21.15.122:6817/2755171866] conn(0x7f9e8c0c90f0 msgr2=0x7f9e8c0b15c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.056+0000 7f9e6ffff640 1 --2- 172.21.15.77:0/417105483 >> [v2:172.21.15.122:6816/2755171866,v1:172.21.15.122:6817/2755171866] conn(0x7f9e8c0c90f0 0x7f9e8c0b15c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.056+0000 7f9e6ffff640 1 -- 172.21.15.77:0/417105483 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9e7006af40 msgr2=0x7f9e7006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.056+0000 7f9e6ffff640 1 --2- 172.21.15.77:0/417105483 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9e7006af40 0x7f9e7006d400 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c158d30 tx=0x7f9e7c009110 comp rx=0 tx=0).stop 2023-11-04T01:40:25.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.056+0000 7f9e6ffff640 1 -- 172.21.15.77:0/417105483 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e8c06c560 msgr2=0x7f9e8c157d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.056+0000 7f9e6ffff640 1 --2- 172.21.15.77:0/417105483 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e8c06c560 0x7f9e8c157d40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9e8800c4d0 tx=0x7f9e8800c8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.056+0000 7f9e926c2640 1 -- 172.21.15.77:0/417105483 reap_dead start 2023-11-04T01:40:25.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.056+0000 7f3303978640 1 -- 172.21.15.77:0/890696767 --> [v2:172.21.15.77:6808/2904971997,v1:172.21.15.77:6809/2904971997] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f32fc0b2970 con 0x7f32e0074580 2023-11-04T01:40:25.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.056+0000 7f9e6ffff640 1 -- 172.21.15.77:0/417105483 shutdown_connections 2023-11-04T01:40:25.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.056+0000 7f9e6ffff640 1 -- 172.21.15.77:0/417105483 >> 172.21.15.77:0/417105483 conn(0x7f9e8c0cd3e0 msgr2=0x7f9e8c0b03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.056+0000 7fdccbe1f640 1 -- 172.21.15.77:0/2492717160 --> [v2:172.21.15.77:6800/4106490517,v1:172.21.15.77:6801/4106490517] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdcc4142200 con 0x7fdca8074530 2023-11-04T01:40:25.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.056+0000 7f9e6ffff640 1 -- 172.21.15.77:0/417105483 shutdown_connections 2023-11-04T01:40:25.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.057+0000 7f9e6ffff640 1 -- 172.21.15.77:0/417105483 wait complete. 2023-11-04T01:40:25.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.057+0000 7f32f1ffb640 1 -- 172.21.15.77:0/890696767 <== osd.0 v2:172.21.15.77:6808/2904971997 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f32f4009bd0 con 0x7f32e0074580 2023-11-04T01:40:25.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.057+0000 7fdcba7fc640 1 -- 172.21.15.77:0/2492717160 <== osd.1 v2:172.21.15.77:6800/4106490517 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdcbc012040 con 0x7fdca8074530 2023-11-04T01:40:25.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.058+0000 7fdccbe1f640 1 -- 172.21.15.77:0/2492717160 >> [v2:172.21.15.77:6800/4106490517,v1:172.21.15.77:6801/4106490517] conn(0x7fdca8074530 msgr2=0x7fdca8076970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.058+0000 7fdccbe1f640 1 --2- 172.21.15.77:0/2492717160 >> [v2:172.21.15.77:6800/4106490517,v1:172.21.15.77:6801/4106490517] conn(0x7fdca8074530 0x7fdca8076970 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.058+0000 7f0a11ffb640 1 -- 172.21.15.77:0/591739385 --> [v2:172.21.15.122:6800/917968549,v1:172.21.15.122:6801/917968549] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0a240d85c0 con 0x7f0a180744b0 2023-11-04T01:40:25.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.058+0000 7fdccbe1f640 1 -- 172.21.15.77:0/2492717160 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdca806aef0 msgr2=0x7fdca806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.058+0000 7fdccbe1f640 1 --2- 172.21.15.77:0/2492717160 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdca806aef0 0x7fdca806d3b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4009fd0 tx=0x7fdcb4008040 comp rx=0 tx=0).stop 2023-11-04T01:40:25.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.058+0000 7fdccbe1f640 1 -- 172.21.15.77:0/2492717160 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdcc40cafb0 msgr2=0x7fdcc413c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.058+0000 7fdccbe1f640 1 --2- 172.21.15.77:0/2492717160 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdcc40cafb0 0x7fdcc413c430 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0000c00 tx=0x7fdcc00046c0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.058+0000 7fdcca3bc640 1 -- 172.21.15.77:0/2492717160 reap_dead start 2023-11-04T01:40:25.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.058+0000 7fdccbe1f640 1 -- 172.21.15.77:0/2492717160 shutdown_connections 2023-11-04T01:40:25.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.058+0000 7fdccbe1f640 1 -- 172.21.15.77:0/2492717160 >> 172.21.15.77:0/2492717160 conn(0x7fdcc406a120 msgr2=0x7fdcc413eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.058+0000 7f3303978640 1 -- 172.21.15.77:0/890696767 >> [v2:172.21.15.77:6808/2904971997,v1:172.21.15.77:6809/2904971997] conn(0x7f32e0074580 msgr2=0x7f32e00769c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.058+0000 7f3303978640 1 --2- 172.21.15.77:0/890696767 >> [v2:172.21.15.77:6808/2904971997,v1:172.21.15.77:6809/2904971997] conn(0x7f32e0074580 0x7f32e00769c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.058+0000 7fdccbe1f640 1 -- 172.21.15.77:0/2492717160 shutdown_connections 2023-11-04T01:40:25.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.059+0000 7fdccbe1f640 1 -- 172.21.15.77:0/2492717160 wait complete. 2023-11-04T01:40:25.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.059+0000 7f3303978640 1 -- 172.21.15.77:0/890696767 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f32e006af40 msgr2=0x7f32e006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.059+0000 7f3303978640 1 --2- 172.21.15.77:0/890696767 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f32e006af40 0x7f32e006d400 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f32fc0721a0 tx=0x7f32ec007e80 comp rx=0 tx=0).stop 2023-11-04T01:40:25.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.059+0000 7f0a13fff640 1 -- 172.21.15.77:0/591739385 <== osd.4 v2:172.21.15.122:6800/917968549 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0a240d85c0 con 0x7f0a180744b0 2023-11-04T01:40:25.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.059+0000 7f3303978640 1 -- 172.21.15.77:0/890696767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32fc0b0710 msgr2=0x7f32fc1f62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.059+0000 7f3303978640 1 --2- 172.21.15.77:0/890696767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32fc0b0710 0x7f32fc1f62d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f32f8000c00 tx=0x7f32f8004730 comp rx=0 tx=0).stop 2023-11-04T01:40:25.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.059+0000 7f3301f15640 1 -- 172.21.15.77:0/890696767 reap_dead start 2023-11-04T01:40:25.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.059+0000 7f3303978640 1 -- 172.21.15.77:0/890696767 shutdown_connections 2023-11-04T01:40:25.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.059+0000 7f2756363640 1 -- 172.21.15.77:0/2133373080 --> [v2:172.21.15.122:6808/1398878302,v1:172.21.15.122:6809/1398878302] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f274804fe70 con 0x7f27340745b0 2023-11-04T01:40:25.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.059+0000 7f3303978640 1 -- 172.21.15.77:0/890696767 >> 172.21.15.77:0/890696767 conn(0x7f32fc06c4c0 msgr2=0x7f32fc0af580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.059+0000 7f0a11ffb640 1 -- 172.21.15.77:0/591739385 >> [v2:172.21.15.122:6800/917968549,v1:172.21.15.122:6801/917968549] conn(0x7f0a180744b0 msgr2=0x7f0a180768f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.059+0000 7f0a11ffb640 1 --2- 172.21.15.77:0/591739385 >> [v2:172.21.15.122:6800/917968549,v1:172.21.15.122:6801/917968549] conn(0x7f0a180744b0 0x7f0a180768f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.059+0000 7f0a11ffb640 1 -- 172.21.15.77:0/591739385 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0a1806ae70 msgr2=0x7f0a1806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.059+0000 7f0a11ffb640 1 --2- 172.21.15.77:0/591739385 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0a1806ae70 0x7f0a1806d330 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c004e40 tx=0x7f0a1c007f10 comp rx=0 tx=0).stop 2023-11-04T01:40:25.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.059+0000 7f0a11ffb640 1 -- 172.21.15.77:0/591739385 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0a240070c0 msgr2=0x7f0a24007570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.059+0000 7f0a11ffb640 1 --2- 172.21.15.77:0/591739385 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0a240070c0 0x7f0a24007570 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c074190 tx=0x7f0a2c069f20 comp rx=0 tx=0).stop 2023-11-04T01:40:25.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.059+0000 7f0a2b7fe640 1 -- 172.21.15.77:0/591739385 reap_dead start 2023-11-04T01:40:25.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.060+0000 7f0a11ffb640 1 -- 172.21.15.77:0/591739385 shutdown_connections 2023-11-04T01:40:25.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.060+0000 7f0a11ffb640 1 -- 172.21.15.77:0/591739385 >> 172.21.15.77:0/591739385 conn(0x7f0a24055d20 msgr2=0x7f0a2403a240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.060+0000 7fdc4d89e640 1 -- 172.21.15.77:0/223201582 --> [v2:172.21.15.77:6824/3229620085,v1:172.21.15.77:6825/3229620085] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdc48162b80 con 0x7fdc34074530 2023-11-04T01:40:25.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.060+0000 7f3303978640 1 -- 172.21.15.77:0/890696767 shutdown_connections 2023-11-04T01:40:25.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.060+0000 7f2745ffb640 1 -- 172.21.15.77:0/2133373080 <== osd.5 v2:172.21.15.122:6808/1398878302 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2740001180 con 0x7f27340745b0 2023-11-04T01:40:25.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.060+0000 7f3303978640 1 -- 172.21.15.77:0/890696767 wait complete. 2023-11-04T01:40:25.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.060+0000 7f0a11ffb640 1 -- 172.21.15.77:0/591739385 shutdown_connections 2023-11-04T01:40:25.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.060+0000 7f0a11ffb640 1 -- 172.21.15.77:0/591739385 wait complete. 2023-11-04T01:40:25.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.060+0000 7fa413bc9640 1 -- 172.21.15.77:0/345773408 --> [v2:172.21.15.122:6824/110375226,v1:172.21.15.122:6825/110375226] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa40c071e50 con 0x7fa3f0074500 2023-11-04T01:40:25.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.060+0000 7f2756363640 1 -- 172.21.15.77:0/2133373080 >> [v2:172.21.15.122:6808/1398878302,v1:172.21.15.122:6809/1398878302] conn(0x7f27340745b0 msgr2=0x7f27340769f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.060+0000 7f2756363640 1 --2- 172.21.15.77:0/2133373080 >> [v2:172.21.15.122:6808/1398878302,v1:172.21.15.122:6809/1398878302] conn(0x7f27340745b0 0x7f27340769f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.060+0000 7fdc457fa640 1 -- 172.21.15.77:0/223201582 <== osd.3 v2:172.21.15.77:6824/3229620085 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdc34077040 con 0x7fdc34074530 2023-11-04T01:40:25.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.060+0000 7f2756363640 1 -- 172.21.15.77:0/2133373080 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f273406af70 msgr2=0x7f273406d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.061+0000 7f2756363640 1 --2- 172.21.15.77:0/2133373080 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f273406af70 0x7f273406d430 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f27500739c0 tx=0x7f2750066e40 comp rx=0 tx=0).stop 2023-11-04T01:40:25.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.061+0000 7f2756363640 1 -- 172.21.15.77:0/2133373080 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2748034530 msgr2=0x7f27480497e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.061+0000 7f2756363640 1 --2- 172.21.15.77:0/2133373080 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2748034530 0x7f27480497e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f274c000c00 tx=0x7f274c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.061+0000 7f2755b62640 1 -- 172.21.15.77:0/2133373080 reap_dead start 2023-11-04T01:40:25.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.061+0000 7f2756363640 1 -- 172.21.15.77:0/2133373080 shutdown_connections 2023-11-04T01:40:25.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.061+0000 7f2756363640 1 -- 172.21.15.77:0/2133373080 >> 172.21.15.77:0/2133373080 conn(0x7f274800a990 msgr2=0x7f2748053500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.061+0000 7fa4027fc640 1 -- 172.21.15.77:0/345773408 <== osd.7 v2:172.21.15.122:6824/110375226 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa3fc031670 con 0x7fa3f0074500 2023-11-04T01:40:25.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.061+0000 7f2756363640 1 -- 172.21.15.77:0/2133373080 shutdown_connections 2023-11-04T01:40:25.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.061+0000 7f2756363640 1 -- 172.21.15.77:0/2133373080 wait complete. 2023-11-04T01:40:25.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.061+0000 7fdc4d89e640 1 -- 172.21.15.77:0/223201582 >> [v2:172.21.15.77:6824/3229620085,v1:172.21.15.77:6825/3229620085] conn(0x7fdc34074530 msgr2=0x7fdc34076970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.061+0000 7fdc4d89e640 1 --2- 172.21.15.77:0/223201582 >> [v2:172.21.15.77:6824/3229620085,v1:172.21.15.77:6825/3229620085] conn(0x7fdc34074530 0x7fdc34076970 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.061+0000 7fdc4d89e640 1 -- 172.21.15.77:0/223201582 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdc3406aef0 msgr2=0x7fdc3406d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.061+0000 7fdc4d89e640 1 --2- 172.21.15.77:0/223201582 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdc3406aef0 0x7fdc3406d3b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c007fd0 tx=0x7fdc3c007d10 comp rx=0 tx=0).stop 2023-11-04T01:40:25.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.061+0000 7fdc4d89e640 1 -- 172.21.15.77:0/223201582 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc48153900 msgr2=0x7fdc4815afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.061+0000 7fdc4d89e640 1 --2- 172.21.15.77:0/223201582 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc48153900 0x7fdc4815afe0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdc3800d930 tx=0x7fdc3800ddf0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.061+0000 7fdc4d09d640 1 -- 172.21.15.77:0/223201582 reap_dead start 2023-11-04T01:40:25.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.061+0000 7fdc4d89e640 1 -- 172.21.15.77:0/223201582 shutdown_connections 2023-11-04T01:40:25.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.061+0000 7fdc4d89e640 1 -- 172.21.15.77:0/223201582 >> 172.21.15.77:0/223201582 conn(0x7fdc4806a300 msgr2=0x7fdc480cbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.061+0000 7fdc4d89e640 1 -- 172.21.15.77:0/223201582 shutdown_connections 2023-11-04T01:40:25.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.062+0000 7fdc4d89e640 1 -- 172.21.15.77:0/223201582 wait complete. 2023-11-04T01:40:25.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.062+0000 7fa413bc9640 1 -- 172.21.15.77:0/345773408 >> [v2:172.21.15.122:6824/110375226,v1:172.21.15.122:6825/110375226] conn(0x7fa3f0074500 msgr2=0x7fa3f0076940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.062+0000 7fa413bc9640 1 --2- 172.21.15.77:0/345773408 >> [v2:172.21.15.122:6824/110375226,v1:172.21.15.122:6825/110375226] conn(0x7fa3f0074500 0x7fa3f0076940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.063+0000 7fa413bc9640 1 -- 172.21.15.77:0/345773408 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa3f006af40 msgr2=0x7fa3f006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.063+0000 7fa413bc9640 1 --2- 172.21.15.77:0/345773408 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa3f006af40 0x7fa3f006d400 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa40c1fa0d0 tx=0x7fa408008040 comp rx=0 tx=0).stop 2023-11-04T01:40:25.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.063+0000 7fa413bc9640 1 -- 172.21.15.77:0/345773408 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa40c06fa40 msgr2=0x7fa40c0b4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.063+0000 7fa413bc9640 1 --2- 172.21.15.77:0/345773408 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa40c06fa40 0x7fa40c0b4040 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa40400c7c0 tx=0x7fa40400cc80 comp rx=0 tx=0).stop 2023-11-04T01:40:25.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.063+0000 7fa412166640 1 -- 172.21.15.77:0/345773408 reap_dead start 2023-11-04T01:40:25.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.063+0000 7fa413bc9640 1 -- 172.21.15.77:0/345773408 shutdown_connections 2023-11-04T01:40:25.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.063+0000 7fa413bc9640 1 -- 172.21.15.77:0/345773408 >> 172.21.15.77:0/345773408 conn(0x7fa40c0cc250 msgr2=0x7fa40c0c3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.063+0000 7fa413bc9640 1 -- 172.21.15.77:0/345773408 shutdown_connections 2023-11-04T01:40:25.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.064+0000 7fa413bc9640 1 -- 172.21.15.77:0/345773408 wait complete. 2023-11-04T01:40:25.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.067+0000 7f3d9cb9e640 1 -- 172.21.15.77:0/688863965 --> [v2:172.21.15.77:6814/3962772574,v1:172.21.15.77:6816/3962772574] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3d980d1610 con 0x7f3d780743c0 2023-11-04T01:40:25.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.068+0000 7f3d86ffd640 1 -- 172.21.15.77:0/688863965 <== osd.2 v2:172.21.15.77:6814/3962772574 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3d90007ac0 con 0x7f3d780743c0 2023-11-04T01:40:25.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.069+0000 7f3d9cb9e640 1 -- 172.21.15.77:0/688863965 >> [v2:172.21.15.77:6814/3962772574,v1:172.21.15.77:6816/3962772574] conn(0x7f3d780743c0 msgr2=0x7f3d78076800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.069+0000 7f3d9cb9e640 1 --2- 172.21.15.77:0/688863965 >> [v2:172.21.15.77:6814/3962772574,v1:172.21.15.77:6816/3962772574] conn(0x7f3d780743c0 0x7f3d78076800 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.072+0000 7f3d9cb9e640 1 -- 172.21.15.77:0/688863965 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3d7806af70 msgr2=0x7f3d7806d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.072+0000 7f3d9cb9e640 1 --2- 172.21.15.77:0/688863965 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3d7806af70 0x7f3d7806d430 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c036000 tx=0x7f3d8c008030 comp rx=0 tx=0).stop 2023-11-04T01:40:25.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.072+0000 7f3d9cb9e640 1 -- 172.21.15.77:0/688863965 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3d980cb8b0 msgr2=0x7f3d981509b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.072+0000 7f3d9cb9e640 1 --2- 172.21.15.77:0/688863965 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3d980cb8b0 0x7f3d981509b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3d8800c3c0 tx=0x7f3d8800c880 comp rx=0 tx=0).stop 2023-11-04T01:40:25.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.072+0000 7f3d96d9d640 1 -- 172.21.15.77:0/688863965 reap_dead start 2023-11-04T01:40:25.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.072+0000 7f3d9cb9e640 1 -- 172.21.15.77:0/688863965 shutdown_connections 2023-11-04T01:40:25.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.072+0000 7f3d9cb9e640 1 -- 172.21.15.77:0/688863965 >> 172.21.15.77:0/688863965 conn(0x7f3d980cf8a0 msgr2=0x7f3d980b7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.073+0000 7f3d9cb9e640 1 -- 172.21.15.77:0/688863965 shutdown_connections 2023-11-04T01:40:25.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.073+0000 7f3d9cb9e640 1 -- 172.21.15.77:0/688863965 wait complete. 2023-11-04T01:40:25.216 INFO:teuthology.orchestra.run.smithi077.stdout:55834574856 2023-11-04T01:40:25.216 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-04T01:40:25.217 INFO:teuthology.orchestra.run.smithi077.stdout:55834574858 2023-11-04T01:40:25.218 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-04T01:40:25.219 INFO:teuthology.orchestra.run.smithi077.stdout:55834574857 2023-11-04T01:40:25.219 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-04T01:40:25.220 INFO:teuthology.orchestra.run.smithi077.stdout:55834574857 2023-11-04T01:40:25.220 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-04T01:40:25.221 INFO:teuthology.orchestra.run.smithi077.stdout:55834574858 2023-11-04T01:40:25.222 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-04T01:40:25.223 INFO:teuthology.orchestra.run.smithi077.stdout:55834574858 2023-11-04T01:40:25.223 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-04T01:40:25.224 INFO:teuthology.orchestra.run.smithi077.stdout:55834574856 2023-11-04T01:40:25.224 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-04T01:40:25.225 INFO:teuthology.orchestra.run.smithi077.stdout:55834574857 2023-11-04T01:40:25.226 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-04T01:40:25.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.421+0000 7ffa69c9e640 1 Processor -- start 2023-11-04T01:40:25.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.421+0000 7ffa69c9e640 1 -- start start 2023-11-04T01:40:25.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.423+0000 7ffa69c9e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffa64158ad0 0x7ffa640c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.423+0000 7ffa69c9e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa6415d3c0 con 0x7ffa64158eb0 2023-11-04T01:40:25.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.423+0000 7ffa69c9e640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa6415d6a0 con 0x7ffa640ce6c0 2023-11-04T01:40:25.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.423+0000 7ffa69c9e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa640c90b0 con 0x7ffa64158ad0 2023-11-04T01:40:25.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.423+0000 7ffa63fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ffa64158eb0 0x7ffa6415c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52654/0 (socket says 172.21.15.77:52654) 2023-11-04T01:40:25.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.423+0000 7ffa63fff640 1 -- 172.21.15.77:0/278111570 learned_addr learned my addr 172.21.15.77:0/278111570 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:25.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.423+0000 7ffa68c9c640 1 --2- 172.21.15.77:0/278111570 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffa64158ad0 0x7ffa640c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.424+0000 7ffa68c9c640 1 -- 172.21.15.77:0/278111570 >> v1:172.21.15.122:6789/0 conn(0x7ffa640ce6c0 legacy=0x7ffa6406c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.424+0000 7ffa68c9c640 1 -- 172.21.15.77:0/278111570 >> v1:172.21.15.77:6789/0 conn(0x7ffa64158eb0 legacy=0x7ffa6415c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.424+0000 7ffa68c9c640 1 -- 172.21.15.77:0/278111570 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa640c92c0 con 0x7ffa64158ad0 2023-11-04T01:40:25.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.424+0000 7f452aff5640 1 Processor -- start 2023-11-04T01:40:25.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.424+0000 7fd0f9426640 1 Processor -- start 2023-11-04T01:40:25.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.424+0000 7fd0f9426640 1 -- start start 2023-11-04T01:40:25.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.424+0000 7f452aff5640 1 -- start start 2023-11-04T01:40:25.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.425+0000 7ffa68c9c640 1 --2- 172.21.15.77:0/278111570 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffa64158ad0 0x7ffa640c9ac0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ffa5400ba70 tx=0x7ffa5402dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c46bea5b0021a946 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.425+0000 7f4c5e6a2640 1 Processor -- start 2023-11-04T01:40:25.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.425+0000 7f4c5e6a2640 1 -- start start 2023-11-04T01:40:25.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.425+0000 7fd0f9426640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd0ec0df360 0x7fd0ec053090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.425+0000 7fd0f9426640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0ec03a8c0 0x7fd0ec037fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.426+0000 7fd0f9426640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0ec053990 con 0x7fd0ec054a30 2023-11-04T01:40:25.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.426+0000 7fd0f9426640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0ec0df740 con 0x7fd0ec0df360 2023-11-04T01:40:25.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.426+0000 7fd0f9426640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec053c70 con 0x7fd0ec03a8c0 2023-11-04T01:40:25.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.426+0000 7f452aff5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4524164760 0x7f45240c4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.426+0000 7f452aff5640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4524070710 0x7f4524070b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.426+0000 7f336940e640 1 Processor -- start 2023-11-04T01:40:25.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.426+0000 7ffa637fe640 1 -- 172.21.15.77:0/278111570 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5402e9c0 con 0x7ffa64158ad0 2023-11-04T01:40:25.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.426+0000 7ffa637fe640 1 -- 172.21.15.77:0/278111570 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa54032070 con 0x7ffa64158ad0 2023-11-04T01:40:25.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.426+0000 7ffa637fe640 1 -- 172.21.15.77:0/278111570 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5402ed40 con 0x7ffa64158ad0 2023-11-04T01:40:25.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.426+0000 7f452aff5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4524071080 con 0x7f45240cc520 2023-11-04T01:40:25.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.426+0000 7f452aff5640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4524164b40 con 0x7f4524070710 2023-11-04T01:40:25.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.426+0000 7f452aff5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45240ccc90 con 0x7f4524164760 2023-11-04T01:40:25.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.426+0000 7f4528d91640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4524164760 0x7f45240c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.426+0000 7f4529592640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4524070710 0x7f4524070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.426+0000 7f4529592640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4524070710 0x7f4524070b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:40640/0 (socket says 172.21.15.77:40640) 2023-11-04T01:40:25.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.426+0000 7f4529592640 1 -- 172.21.15.77:0/2534809159 learned_addr learned my addr 172.21.15.77:0/2534809159 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:25.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.427+0000 7f4c5e6a2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4c580c4690 0x7f4c580cc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.427+0000 7f4c5e6a2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4c58070710 0x7f4c58070b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.427+0000 7f4c5e6a2640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c580c4b20 con 0x7f4c58164760 2023-11-04T01:40:25.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.426+0000 7f1373e7c640 1 Processor -- start 2023-11-04T01:40:25.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.427+0000 7f4c5e6a2640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c58164b40 con 0x7f4c580c4690 2023-11-04T01:40:25.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.427+0000 7f4c5e6a2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c58071080 con 0x7f4c58070710 2023-11-04T01:40:25.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.427+0000 7ffa69c9e640 1 -- 172.21.15.77:0/278111570 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffa64158ad0 msgr2=0x7ffa640c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.427+0000 7ffa69c9e640 1 --2- 172.21.15.77:0/278111570 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffa64158ad0 0x7ffa640c9ac0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ffa5400ba70 tx=0x7ffa5402dc90 comp rx=0 tx=0).stop 2023-11-04T01:40:25.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.427+0000 7ffa69c9e640 1 -- 172.21.15.77:0/278111570 shutdown_connections 2023-11-04T01:40:25.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.427+0000 7ffa69c9e640 1 --2- 172.21.15.77:0/278111570 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffa64158ad0 0x7ffa640c9ac0 secure :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ffa5400ba70 tx=0x7ffa5402dc90 comp rx=0 tx=0).stop 2023-11-04T01:40:25.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.427+0000 7ffa69c9e640 1 -- 172.21.15.77:0/278111570 >> 172.21.15.77:0/278111570 conn(0x7ffa6406a120 msgr2=0x7ffa6406a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.427+0000 7f2d4496c640 1 Processor -- start 2023-11-04T01:40:25.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.426+0000 7f4529592640 1 -- 172.21.15.77:0/2534809159 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4524164760 msgr2=0x7f45240c4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.426+0000 7f4529592640 1 --2- 172.21.15.77:0/2534809159 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4524164760 0x7f45240c4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.426+0000 7f4529592640 1 -- 172.21.15.77:0/2534809159 >> v1:172.21.15.77:6789/0 conn(0x7f45240cc520 legacy=0x7f45240b1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.426+0000 7f4529592640 1 -- 172.21.15.77:0/2534809159 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45240ccf70 con 0x7f4524070710 2023-11-04T01:40:25.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.427+0000 7f4c577fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4c580c4690 0x7f4c580cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.427+0000 7f1373e7c640 1 -- start start 2023-11-04T01:40:25.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.427+0000 7f4c577fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4c580c4690 0x7f4c580cc520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56918/0 (socket says 172.21.15.77:56918) 2023-11-04T01:40:25.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.427+0000 7f4c577fe640 1 -- 172.21.15.77:0/1972789239 learned_addr learned my addr 172.21.15.77:0/1972789239 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:25.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.428+0000 7f200607c640 1 Processor -- start 2023-11-04T01:40:25.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.427+0000 7f4c5cc3f640 1 --2- 172.21.15.77:0/1972789239 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4c58070710 0x7f4c58070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.426+0000 7f336940e640 1 -- start start 2023-11-04T01:40:25.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.427+0000 7f336940e640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3364159060 0x7f33640cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.427+0000 7f336940e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f336415a070 0x7f33640ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.427+0000 7f336940e640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33640cb1e0 con 0x7f3364158c80 2023-11-04T01:40:25.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.427+0000 7f336940e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33640cad00 con 0x7f336415a070 2023-11-04T01:40:25.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.427+0000 7f336940e640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33641595d0 con 0x7f3364159060 2023-11-04T01:40:25.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.428+0000 7f33627fc640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3364159060 0x7f33640cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.428+0000 7f33627fc640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3364159060 0x7f33640cddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:40648/0 (socket says 172.21.15.77:40648) 2023-11-04T01:40:25.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.428+0000 7f33627fc640 1 -- 172.21.15.77:0/3904543029 learned_addr learned my addr 172.21.15.77:0/3904543029 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:25.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.428+0000 7f3362ffd640 1 --1- 172.21.15.77:0/3904543029 >> v1:172.21.15.122:6789/0 conn(0x7f3364158c80 0x7f33640ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:55704/0 (socket says 172.21.15.77:55704) 2023-11-04T01:40:25.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.428+0000 7f33637fe640 1 --2- 172.21.15.77:0/3904543029 >> v2:172.21.15.77:3300/0 conn(0x7f336415a070 0x7f33640ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.428+0000 7f4529592640 1 --2- 172.21.15.77:0/2534809159 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4524070710 0x7f4524070b40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f45240b4a40 tx=0x7f451c02be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5c062259bd8eaac server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.428+0000 7f33627fc640 1 -- 172.21.15.77:0/3904543029 >> v2:172.21.15.77:3300/0 conn(0x7f336415a070 msgr2=0x7f33640ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.428+0000 7f4c56ffd640 1 -- 172.21.15.77:0/1972789239 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 419778545 0 0) 0x7f4c580c4b20 con 0x7f4c58164760 2023-11-04T01:40:25.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.426+0000 7fd0f2ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd0ec0df360 0x7fd0ec053090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.426+0000 7fd0f27fc640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0ec03a8c0 0x7fd0ec037fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.428+0000 7f1373e7c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f136c072030 0x7f136c0b1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.428+0000 7f1373e7c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f136c0b1640 0x7f136c15d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.428+0000 7f1373e7c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136c0b5400 con 0x7f136c159800 2023-11-04T01:40:25.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.426+0000 7fd0f27fc640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0ec03a8c0 0x7fd0ec037fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:53510/0 (socket says 172.21.15.77:53510) 2023-11-04T01:40:25.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.426+0000 7fd0f27fc640 1 -- 172.21.15.77:0/4286315 learned_addr learned my addr 172.21.15.77:0/4286315 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:25.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.427+0000 7fd0f2ffd640 1 -- 172.21.15.77:0/4286315 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0ec03a8c0 msgr2=0x7fd0ec037fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.427+0000 7fd0f2ffd640 1 --2- 172.21.15.77:0/4286315 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0ec03a8c0 0x7fd0ec037fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.428+0000 7f4c56ffd640 1 -- 172.21.15.77:0/1972789239 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c40003520 con 0x7f4c58164760 2023-11-04T01:40:25.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.428+0000 7f1373e7c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136c0b1ad0 con 0x7f136c072030 2023-11-04T01:40:25.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.428+0000 7f1373e7c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136c0cb4e0 con 0x7f136c0b1640 2023-11-04T01:40:25.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.428+0000 7f1371c18640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f136c159800 0x7f136c0cadd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52666/0 (socket says 172.21.15.77:52666) 2023-11-04T01:40:25.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.427+0000 7fd0f2ffd640 1 -- 172.21.15.77:0/4286315 >> v1:172.21.15.122:6789/0 conn(0x7fd0ec054a30 legacy=0x7fd0ec0384f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-04T01:40:25.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.427+0000 7fd0f2ffd640 1 -- 172.21.15.77:0/4286315 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ec053f50 con 0x7fd0ec0df360 2023-11-04T01:40:25.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.428+0000 7f1371c18640 1 -- 172.21.15.77:0/1317986066 learned_addr learned my addr 172.21.15.77:0/1317986066 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:25.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.428+0000 7f4c577fe640 1 -- 172.21.15.77:0/1972789239 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4c58070710 msgr2=0x7f4c58070b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.428+0000 7f4c577fe640 1 --2- 172.21.15.77:0/1972789239 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4c58070710 0x7f4c58070b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.428+0000 7f4c577fe640 1 -- 172.21.15.77:0/1972789239 >> v1:172.21.15.122:6789/0 conn(0x7f4c58164760 legacy=0x7f4c580b1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.428+0000 7f4c577fe640 1 -- 172.21.15.77:0/1972789239 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c580cca60 con 0x7f4c580c4690 2023-11-04T01:40:25.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.429+0000 7f4c5cc3f640 1 --2- 172.21.15.77:0/1972789239 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4c58070710 0x7f4c58070b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:25.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.427+0000 7f2d4496c640 1 -- start start 2023-11-04T01:40:25.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.429+0000 7f2d4496c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2d380eb5f0 0x7f2d38006f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.429+0000 7f2d4496c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d38050230 con 0x7f2d380e77a0 2023-11-04T01:40:25.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.429+0000 7f2d4496c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d38006370 con 0x7f2d380eb1b0 2023-11-04T01:40:25.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.428+0000 7f1371417640 1 --2- 172.21.15.77:0/1317986066 >> v2:172.21.15.77:3300/0 conn(0x7f136c072030 0x7f136c0b1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.428+0000 7f1372419640 1 --2- 172.21.15.77:0/1317986066 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f136c0b1640 0x7f136c15d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.429+0000 7f1370c16640 1 -- 172.21.15.77:0/1317986066 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2959404504 0 0) 0x7f136c0b5400 con 0x7f136c159800 2023-11-04T01:40:25.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.428+0000 7fd0f2ffd640 1 --2- 172.21.15.77:0/4286315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0ec0df360 0x7fd0ec053090 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4000b60 tx=0x7fd0f40ae630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ef36fe364adaaa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.429+0000 7f2d4496c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d3804fc70 con 0x7f2d380eb5f0 2023-11-04T01:40:25.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.429+0000 7f1370c16640 1 -- 172.21.15.77:0/1317986066 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1358003520 con 0x7f136c159800 2023-11-04T01:40:25.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.429+0000 7f45237fe640 1 -- 172.21.15.77:0/2534809159 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451c02c9c0 con 0x7f4524070710 2023-11-04T01:40:25.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.429+0000 7f45237fe640 1 -- 172.21.15.77:0/2534809159 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451c02cb20 con 0x7f4524070710 2023-11-04T01:40:25.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.429+0000 7f45237fe640 1 -- 172.21.15.77:0/2534809159 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451c0343f0 con 0x7f4524070710 2023-11-04T01:40:25.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.429+0000 7f2d3f7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f2d380e77a0 0x7f2d3804f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52678/0 (socket says 172.21.15.77:52678) 2023-11-04T01:40:25.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.429+0000 7f2d3f7fe640 1 -- 172.21.15.77:0/785781981 learned_addr learned my addr 172.21.15.77:0/785781981 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:25.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.429+0000 7fd0f1ffb640 1 -- 172.21.15.77:0/4286315 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f40b5660 con 0x7fd0ec0df360 2023-11-04T01:40:25.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.429+0000 7fd0f1ffb640 1 -- 172.21.15.77:0/4286315 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f40b1050 con 0x7fd0ec0df360 2023-11-04T01:40:25.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.429+0000 7fd0f1ffb640 1 -- 172.21.15.77:0/4286315 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f40b5a80 con 0x7fd0ec0df360 2023-11-04T01:40:25.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.428+0000 7f3361ffb640 1 -- 172.21.15.77:0/3904543029 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1613394784 0 0) 0x7f33640cb1e0 con 0x7f3364158c80 2023-11-04T01:40:25.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.428+0000 7f33627fc640 1 --2- 172.21.15.77:0/3904543029 >> v2:172.21.15.77:3300/0 conn(0x7f336415a070 0x7f33640ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.429+0000 7f2d3ffff640 1 --2- 172.21.15.77:0/785781981 >> v2:172.21.15.122:3300/0 conn(0x7f2d380eb5f0 0x7f2d38006f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.428+0000 7f33627fc640 1 -- 172.21.15.77:0/3904543029 >> v1:172.21.15.122:6789/0 conn(0x7f3364158c80 legacy=0x7f33640ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.428+0000 7f33627fc640 1 -- 172.21.15.77:0/3904543029 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33640caf00 con 0x7f3364159060 2023-11-04T01:40:25.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.428+0000 7f200607c640 1 -- start start 2023-11-04T01:40:25.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.429+0000 7f200607c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2000164760 0x7f20000c4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.429+0000 7f200607c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20000cc520 0x7f20000b1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.429+0000 7f1370c16640 1 -- 172.21.15.77:0/1317986066 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2177323023 0 0) 0x7f1358003520 con 0x7f136c159800 2023-11-04T01:40:25.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.429+0000 7f1371417640 1 -- 172.21.15.77:0/1317986066 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f136c0b1640 msgr2=0x7f136c15d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.429+0000 7f1371417640 1 --2- 172.21.15.77:0/1317986066 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f136c0b1640 0x7f136c15d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.429+0000 7f200607c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f20000b1da0 0x7f2000070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.429+0000 7f200607c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2000164b40 con 0x7f2000164760 2023-11-04T01:40:25.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.429+0000 7f200607c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20000ccc90 con 0x7f20000b1da0 2023-11-04T01:40:25.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.429+0000 7f200607c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20000ccf70 con 0x7f20000cc520 2023-11-04T01:40:25.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.429+0000 7f1fff7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2000164760 0x7f20000c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.429+0000 7f1fff7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2000164760 0x7f20000c4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56960/0 (socket says 172.21.15.77:56960) 2023-11-04T01:40:25.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.429+0000 7f1fff7fe640 1 -- 172.21.15.77:0/973234377 learned_addr learned my addr 172.21.15.77:0/973234377 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:25.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.428+0000 7ffa69c9e640 1 -- 172.21.15.77:0/278111570 shutdown_connections 2023-11-04T01:40:25.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.429+0000 7f4c577fe640 1 --2- 172.21.15.77:0/1972789239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c580c4690 0x7f4c580cc520 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4c50009e50 tx=0x7f4c5002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46b6f0580ddfd092 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.429+0000 7f2d3e7fc640 1 -- 172.21.15.77:0/785781981 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1644517718 0 0) 0x7f2d38050230 con 0x7f2d380e77a0 2023-11-04T01:40:25.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.429+0000 7f2d3e7fc640 1 -- 172.21.15.77:0/785781981 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d30003520 con 0x7f2d380e77a0 2023-11-04T01:40:25.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.429+0000 7ffa69c9e640 1 -- 172.21.15.77:0/278111570 wait complete. 2023-11-04T01:40:25.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.430+0000 7f452aff5640 1 -- 172.21.15.77:0/2534809159 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4524070710 msgr2=0x7f4524070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.430+0000 7f452aff5640 1 --2- 172.21.15.77:0/2534809159 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4524070710 0x7f4524070b40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f45240b4a40 tx=0x7f451c02be20 comp rx=0 tx=0).stop 2023-11-04T01:40:25.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.429+0000 7f1371417640 1 -- 172.21.15.77:0/1317986066 >> v1:172.21.15.77:6789/0 conn(0x7f136c159800 legacy=0x7f136c0cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.429+0000 7f1371417640 1 -- 172.21.15.77:0/1317986066 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136c06f350 con 0x7f136c072030 2023-11-04T01:40:25.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.429+0000 7f1372419640 1 --2- 172.21.15.77:0/1317986066 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f136c0b1640 0x7f136c15d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:25.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.430+0000 7f2d3e7fc640 1 -- 172.21.15.77:0/785781981 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 608896298 0 0) 0x7f2d30003520 con 0x7f2d380e77a0 2023-11-04T01:40:25.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.430+0000 7f2d3e7fc640 1 -- 172.21.15.77:0/785781981 >> v2:172.21.15.122:3300/0 conn(0x7f2d380eb5f0 msgr2=0x7f2d38006f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.430+0000 7f2d3e7fc640 1 --2- 172.21.15.77:0/785781981 >> v2:172.21.15.122:3300/0 conn(0x7f2d380eb5f0 0x7f2d38006f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.430+0000 7f2d3e7fc640 1 -- 172.21.15.77:0/785781981 >> v1:172.21.15.122:6789/0 conn(0x7f2d380eb1b0 legacy=0x7f2d38006800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.430+0000 7f2d3e7fc640 1 -- 172.21.15.77:0/785781981 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3804ff50 con 0x7f2d380e77a0 2023-11-04T01:40:25.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.430+0000 7f452aff5640 1 -- 172.21.15.77:0/2534809159 shutdown_connections 2023-11-04T01:40:25.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.430+0000 7f4c56ffd640 1 -- 172.21.15.77:0/1972789239 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5002ca80 con 0x7f4c580c4690 2023-11-04T01:40:25.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.430+0000 7f452aff5640 1 --2- 172.21.15.77:0/2534809159 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4524070710 0x7f4524070b40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.430+0000 7f452aff5640 1 --2- 172.21.15.77:0/2534809159 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4524164760 0x7f45240c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.430+0000 7f452aff5640 1 -- 172.21.15.77:0/2534809159 >> 172.21.15.77:0/2534809159 conn(0x7f45240ce950 msgr2=0x7f45240ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.430+0000 7f2d3e7fc640 1 -- 172.21.15.77:0/785781981 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f2d34001670 con 0x7f2d380e77a0 2023-11-04T01:40:25.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.430+0000 7f2d3e7fc640 1 -- 172.21.15.77:0/785781981 >> v1:172.21.15.77:6789/0 conn(0x7f2d380e77a0 legacy=0x7f2d3804f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.430+0000 7f2d3e7fc640 1 --2- 172.21.15.77:0/785781981 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2d30003970 0x7f2d30003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.430+0000 7f4c56ffd640 1 -- 172.21.15.77:0/1972789239 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5002cbe0 con 0x7f4c580c4690 2023-11-04T01:40:25.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.430+0000 7f2d3e7fc640 1 --2- 172.21.15.77:0/785781981 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2d300047c0 0x7f2d30004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.430+0000 7f2d3e7fc640 1 --2- 172.21.15.77:0/785781981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d30005180 0x7f2d3000b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.430+0000 7f2d3e7fc640 1 -- 172.21.15.77:0/785781981 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3804fc70 con 0x7f2d30005180 2023-11-04T01:40:25.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.430+0000 7f2d3e7fc640 1 -- 172.21.15.77:0/785781981 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3000bff0 con 0x7f2d30003970 2023-11-04T01:40:25.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.430+0000 7f2d3e7fc640 1 -- 172.21.15.77:0/785781981 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3000c1b0 con 0x7f2d300047c0 2023-11-04T01:40:25.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.430+0000 7f4c56ffd640 1 -- 172.21.15.77:0/1972789239 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c500343f0 con 0x7f4c580c4690 2023-11-04T01:40:25.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.430+0000 7f2d3effd640 1 --2- 172.21.15.77:0/785781981 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2d300047c0 0x7f2d30004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.430+0000 7f2d3ffff640 1 --2- 172.21.15.77:0/785781981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d30005180 0x7f2d3000b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.430+0000 7f2d3f7fe640 1 --2- 172.21.15.77:0/785781981 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2d30003970 0x7f2d30003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.429+0000 7f33637fe640 1 --2- 172.21.15.77:0/3904543029 >> v2:172.21.15.77:3300/0 conn(0x7f336415a070 0x7f33640ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:25.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.430+0000 7f1371417640 1 --2- 172.21.15.77:0/1317986066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f136c072030 0x7f136c0b1100 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f135c009a00 tx=0x7f135c02b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6691d3a84577d804 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.431+0000 7f452aff5640 1 -- 172.21.15.77:0/2534809159 shutdown_connections 2023-11-04T01:40:25.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.430+0000 7f1fff7fe640 1 -- 172.21.15.77:0/973234377 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20000cc520 msgr2=0x7f20000b1860 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-04T01:40:25.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.430+0000 7f1fff7fe640 1 --2- 172.21.15.77:0/973234377 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20000cc520 0x7f20000b1860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.430+0000 7f1fff7fe640 1 -- 172.21.15.77:0/973234377 >> v2:172.21.15.122:3300/0 conn(0x7f20000b1da0 msgr2=0x7f2000070710 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-04T01:40:25.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.430+0000 7f1fff7fe640 1 --2- 172.21.15.77:0/973234377 >> v2:172.21.15.122:3300/0 conn(0x7f20000b1da0 0x7f2000070710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.430+0000 7f1fff7fe640 1 -- 172.21.15.77:0/973234377 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20000cd250 con 0x7f2000164760 2023-11-04T01:40:25.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.431+0000 7f33627fc640 1 --2- 172.21.15.77:0/3904543029 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3364159060 0x7f33640cddb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f336406b060 tx=0x7f335c02e5c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cef50e14390db28e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.430+0000 7fd0f9426640 1 -- 172.21.15.77:0/4286315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0ec0df360 msgr2=0x7fd0ec053090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.430+0000 7fd0f9426640 1 --2- 172.21.15.77:0/4286315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0ec0df360 0x7fd0ec053090 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4000b60 tx=0x7fd0f40ae630 comp rx=0 tx=0).stop 2023-11-04T01:40:25.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.431+0000 7ffa69c9e640 1 Processor -- start 2023-11-04T01:40:25.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.431+0000 7ffa69c9e640 1 -- start start 2023-11-04T01:40:25.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.431+0000 7f4c5e6a2640 1 -- 172.21.15.77:0/1972789239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c580c4690 msgr2=0x7f4c580cc520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.431+0000 7f4c5e6a2640 1 --2- 172.21.15.77:0/1972789239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c580c4690 0x7f4c580cc520 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4c50009e50 tx=0x7f4c5002bee0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.431+0000 7f4c5e6a2640 1 -- 172.21.15.77:0/1972789239 shutdown_connections 2023-11-04T01:40:25.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.431+0000 7f4c5e6a2640 1 --2- 172.21.15.77:0/1972789239 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4c58070710 0x7f4c58070b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.431+0000 7f4c5e6a2640 1 --2- 172.21.15.77:0/1972789239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c580c4690 0x7f4c580cc520 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.431+0000 7f4c5e6a2640 1 -- 172.21.15.77:0/1972789239 >> 172.21.15.77:0/1972789239 conn(0x7f4c580ce950 msgr2=0x7f4c580ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.431+0000 7f4c5e6a2640 1 -- 172.21.15.77:0/1972789239 shutdown_connections 2023-11-04T01:40:25.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.431+0000 7f4c5e6a2640 1 -- 172.21.15.77:0/1972789239 wait complete. 2023-11-04T01:40:25.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.431+0000 7f2d3ffff640 1 -- 172.21.15.77:0/785781981 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2d300047c0 msgr2=0x7f2d30004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.431+0000 7f2d3ffff640 1 --2- 172.21.15.77:0/785781981 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2d300047c0 0x7f2d30004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.431+0000 7f2d3ffff640 1 -- 172.21.15.77:0/785781981 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2d30003970 msgr2=0x7f2d30003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:25.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.431+0000 7f2d3ffff640 1 --2- 172.21.15.77:0/785781981 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2d30003970 0x7f2d30003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.431+0000 7f2d3ffff640 1 -- 172.21.15.77:0/785781981 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d30003520 con 0x7f2d30005180 2023-11-04T01:40:25.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.431+0000 7f2d3effd640 1 --2- 172.21.15.77:0/785781981 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2d300047c0 0x7f2d30004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:25.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.431+0000 7f2d3f7fe640 1 --2- 172.21.15.77:0/785781981 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2d30003970 0x7f2d30003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:25.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.431+0000 7f1370c16640 1 -- 172.21.15.77:0/1317986066 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1368001670 con 0x7f136c072030 2023-11-04T01:40:25.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.431+0000 7f1370c16640 1 -- 172.21.15.77:0/1317986066 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135c030420 con 0x7f136c072030 2023-11-04T01:40:25.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.431+0000 7f1370c16640 1 -- 172.21.15.77:0/1317986066 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c0307b0 con 0x7f136c072030 2023-11-04T01:40:25.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.431+0000 7fd0f9426640 1 -- 172.21.15.77:0/4286315 shutdown_connections 2023-11-04T01:40:25.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.431+0000 7fd0f9426640 1 --2- 172.21.15.77:0/4286315 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0ec03a8c0 0x7fd0ec037fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.431+0000 7fd0f9426640 1 --2- 172.21.15.77:0/4286315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0ec0df360 0x7fd0ec053090 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.431+0000 7fd0f9426640 1 -- 172.21.15.77:0/4286315 >> 172.21.15.77:0/4286315 conn(0x7fd0ec00a440 msgr2=0x7fd0ec00a850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.431+0000 7fd0f9426640 1 -- 172.21.15.77:0/4286315 shutdown_connections 2023-11-04T01:40:25.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.431+0000 7fd0f9426640 1 -- 172.21.15.77:0/4286315 wait complete. 2023-11-04T01:40:25.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.431+0000 7f1fff7fe640 1 --2- 172.21.15.77:0/973234377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2000164760 0x7f20000c4690 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f20000706a0 tx=0x7f1ff002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c378be2f4a4ed65 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.432+0000 7f1373e7c640 1 -- 172.21.15.77:0/1317986066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f136c072030 msgr2=0x7f136c0b1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.432+0000 7f1373e7c640 1 --2- 172.21.15.77:0/1317986066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f136c072030 0x7f136c0b1100 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f135c009a00 tx=0x7f135c02b9f0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.432+0000 7f1ffe7fc640 1 -- 172.21.15.77:0/973234377 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff002e070 con 0x7f2000164760 2023-11-04T01:40:25.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.432+0000 7f1ffe7fc640 1 -- 172.21.15.77:0/973234377 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff00315a0 con 0x7f2000164760 2023-11-04T01:40:25.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.432+0000 7f1ffe7fc640 1 -- 172.21.15.77:0/973234377 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0031930 con 0x7f2000164760 2023-11-04T01:40:25.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.432+0000 7f1373e7c640 1 -- 172.21.15.77:0/1317986066 shutdown_connections 2023-11-04T01:40:25.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.432+0000 7f1373e7c640 1 --2- 172.21.15.77:0/1317986066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f136c072030 0x7f136c0b1100 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.432+0000 7f1373e7c640 1 --2- 172.21.15.77:0/1317986066 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f136c0b1640 0x7f136c15d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.432+0000 7f1373e7c640 1 -- 172.21.15.77:0/1317986066 >> 172.21.15.77:0/1317986066 conn(0x7f136c0cc100 msgr2=0x7f136c0cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.432+0000 7f2d3ffff640 1 -- 172.21.15.77:0/785781981 reap_dead start 2023-11-04T01:40:25.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.432+0000 7f2d3ffff640 1 --2- 172.21.15.77:0/785781981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d30005180 0x7f2d3000b8f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c009aa0 tx=0x7f2d300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e669d69443698143 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.432+0000 7ffa69c9e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa640ce6c0 0x7ffa640c3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.431+0000 7f452aff5640 1 -- 172.21.15.77:0/2534809159 wait complete. 2023-11-04T01:40:25.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.432+0000 7f452aff5640 1 Processor -- start 2023-11-04T01:40:25.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.432+0000 7ffa69c9e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffa64158eb0 0x7ffa641f7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.432+0000 7ffa69c9e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffa640c7810 0x7ffa640c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.433+0000 7ffa69c9e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa641f8470 con 0x7ffa640ce6c0 2023-11-04T01:40:25.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.433+0000 7ffa69c9e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa640c81e0 con 0x7ffa640c7810 2023-11-04T01:40:25.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.433+0000 7ffa69c9e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa640c4e80 con 0x7ffa64158eb0 2023-11-04T01:40:25.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.433+0000 7f3361ffb640 1 -- 172.21.15.77:0/3904543029 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c035600 con 0x7f3364159060 2023-11-04T01:40:25.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.433+0000 7ffa6949d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffa640c7810 0x7ffa640c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.433+0000 7ffa68c9c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa640ce6c0 0x7ffa640c3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.433+0000 7f3361ffb640 1 -- 172.21.15.77:0/3904543029 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335c031050 con 0x7f3364159060 2023-11-04T01:40:25.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.433+0000 7f3361ffb640 1 -- 172.21.15.77:0/3904543029 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c0359c0 con 0x7f3364159060 2023-11-04T01:40:25.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.433+0000 7ffa6949d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffa640c7810 0x7ffa640c7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:40682/0 (socket says 172.21.15.77:40682) 2023-11-04T01:40:25.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.433+0000 7ffa6949d640 1 -- 172.21.15.77:0/4031990801 learned_addr learned my addr 172.21.15.77:0/4031990801 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:25.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.433+0000 7ffa63fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffa64158eb0 0x7ffa641f7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.433+0000 7f452aff5640 1 -- start start 2023-11-04T01:40:25.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.433+0000 7f200607c640 1 -- 172.21.15.77:0/973234377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2000164760 msgr2=0x7f20000c4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.433+0000 7f200607c640 1 --2- 172.21.15.77:0/973234377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2000164760 0x7f20000c4690 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f20000706a0 tx=0x7f1ff002b840 comp rx=0 tx=0).stop 2023-11-04T01:40:25.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.432+0000 7f1373e7c640 1 -- 172.21.15.77:0/1317986066 shutdown_connections 2023-11-04T01:40:25.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.432+0000 7f1373e7c640 1 -- 172.21.15.77:0/1317986066 wait complete. 2023-11-04T01:40:25.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.433+0000 7fd0f9426640 1 Processor -- start 2023-11-04T01:40:25.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.433+0000 7f2d3e7fc640 1 -- 172.21.15.77:0/785781981 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c02c710 con 0x7f2d30005180 2023-11-04T01:40:25.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.433+0000 7f2d3e7fc640 1 -- 172.21.15.77:0/785781981 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2c02c870 con 0x7f2d30005180 2023-11-04T01:40:25.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.433+0000 7ffa63fff640 1 -- 172.21.15.77:0/4031990801 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffa640c7810 msgr2=0x7ffa640c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.433+0000 7f2d3e7fc640 1 -- 172.21.15.77:0/785781981 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c02cc20 con 0x7f2d30005180 2023-11-04T01:40:25.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.433+0000 7ffa63fff640 1 --2- 172.21.15.77:0/4031990801 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffa640c7810 0x7ffa640c7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.433+0000 7ffa63fff640 1 -- 172.21.15.77:0/4031990801 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa640ce6c0 msgr2=0x7ffa640c3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.433+0000 7ffa63fff640 1 --2- 172.21.15.77:0/4031990801 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa640ce6c0 0x7ffa640c3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.433+0000 7ffa63fff640 1 -- 172.21.15.77:0/4031990801 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5400b6a0 con 0x7ffa64158eb0 2023-11-04T01:40:25.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.434+0000 7ffa68c9c640 1 --2- 172.21.15.77:0/4031990801 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa640ce6c0 0x7ffa640c3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:25.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.434+0000 7f4c5e6a2640 1 Processor -- start 2023-11-04T01:40:25.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.434+0000 7f200607c640 1 -- 172.21.15.77:0/973234377 shutdown_connections 2023-11-04T01:40:25.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.434+0000 7f200607c640 1 --2- 172.21.15.77:0/973234377 >> v2:172.21.15.122:3300/0 conn(0x7f20000b1da0 0x7f2000070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.434+0000 7f200607c640 1 --2- 172.21.15.77:0/973234377 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20000cc520 0x7f20000b1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.434+0000 7f200607c640 1 --2- 172.21.15.77:0/973234377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2000164760 0x7f20000c4690 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.434+0000 7f200607c640 1 -- 172.21.15.77:0/973234377 >> 172.21.15.77:0/973234377 conn(0x7f20000ce950 msgr2=0x7f20000ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.434+0000 7f1373e7c640 1 Processor -- start 2023-11-04T01:40:25.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.434+0000 7f200607c640 1 -- 172.21.15.77:0/973234377 shutdown_connections 2023-11-04T01:40:25.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.434+0000 7f200607c640 1 -- 172.21.15.77:0/973234377 wait complete. 2023-11-04T01:40:25.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.434+0000 7f1373e7c640 1 -- start start 2023-11-04T01:40:25.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.434+0000 7ffa63fff640 1 --2- 172.21.15.77:0/4031990801 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffa64158eb0 0x7ffa641f7f30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c00c8e0 tx=0x7ffa5c00cda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7ffa617fa640 1 -- 172.21.15.77:0/4031990801 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c00a5e0 con 0x7ffa64158eb0 2023-11-04T01:40:25.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.434+0000 7f452aff5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4524070710 0x7f45240ae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.434+0000 7f452aff5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45240cc520 0x7f452415dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.434+0000 7f452aff5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4524164760 0x7f45241eaa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.434+0000 7f4523fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45240cc520 0x7f452415dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7f4528d91640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4524070710 0x7f45240ae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7f4528d91640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4524070710 0x7f45240ae5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:53576/0 (socket says 172.21.15.77:53576) 2023-11-04T01:40:25.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7f4523fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45240cc520 0x7f452415dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56984/0 (socket says 172.21.15.77:56984) 2023-11-04T01:40:25.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7f4528d91640 1 -- 172.21.15.77:0/1526091435 learned_addr learned my addr 172.21.15.77:0/1526091435 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:25.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7f4529592640 1 --2- 172.21.15.77:0/1526091435 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4524164760 0x7f45241eaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7f452aff5640 1 -- 172.21.15.77:0/1526091435 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45240ae190 con 0x7f45240cc520 2023-11-04T01:40:25.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7f452aff5640 1 -- 172.21.15.77:0/1526091435 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45240c8830 con 0x7f4524164760 2023-11-04T01:40:25.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7f452aff5640 1 -- 172.21.15.77:0/1526091435 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45240aeaf0 con 0x7f4524070710 2023-11-04T01:40:25.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.434+0000 7f4c5e6a2640 1 -- start start 2023-11-04T01:40:25.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.434+0000 7f2d4496c640 1 -- 172.21.15.77:0/785781981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d30005180 msgr2=0x7f2d3000b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.434+0000 7f2d4496c640 1 --2- 172.21.15.77:0/785781981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d30005180 0x7f2d3000b8f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c009aa0 tx=0x7f2d300057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.434+0000 7f2d4496c640 1 -- 172.21.15.77:0/785781981 shutdown_connections 2023-11-04T01:40:25.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.434+0000 7f2d4496c640 1 --2- 172.21.15.77:0/785781981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d30005180 0x7f2d3000b8f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.434+0000 7f2d4496c640 1 -- 172.21.15.77:0/785781981 >> 172.21.15.77:0/785781981 conn(0x7f2d38054b00 msgr2=0x7f2d38054ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7f2d4496c640 1 -- 172.21.15.77:0/785781981 shutdown_connections 2023-11-04T01:40:25.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.434+0000 7f336940e640 1 -- 172.21.15.77:0/3904543029 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3364159060 msgr2=0x7f33640cddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.434+0000 7f336940e640 1 --2- 172.21.15.77:0/3904543029 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3364159060 0x7f33640cddb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f336406b060 tx=0x7f335c02e5c0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7f336940e640 1 -- 172.21.15.77:0/3904543029 shutdown_connections 2023-11-04T01:40:25.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7f336940e640 1 --2- 172.21.15.77:0/3904543029 >> v2:172.21.15.77:3300/0 conn(0x7f336415a070 0x7f33640ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7f336940e640 1 --2- 172.21.15.77:0/3904543029 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3364159060 0x7f33640cddb0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7f336940e640 1 -- 172.21.15.77:0/3904543029 >> 172.21.15.77:0/3904543029 conn(0x7f336406a120 msgr2=0x7f336406a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.433+0000 7fd0f9426640 1 -- start start 2023-11-04T01:40:25.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7fd0f9426640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0ec03a8c0 0x7fd0ec0d3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7fd0f9426640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0ec054a30 0x7fd0ec0daa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7ffa617fa640 1 -- 172.21.15.77:0/4031990801 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5c00a760 con 0x7ffa64158eb0 2023-11-04T01:40:25.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7ffa617fa640 1 -- 172.21.15.77:0/4031990801 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c00ab10 con 0x7ffa64158eb0 2023-11-04T01:40:25.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7ffa69c9e640 1 -- 172.21.15.77:0/4031990801 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa640c4270 con 0x7ffa64158eb0 2023-11-04T01:40:25.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7f2d4496c640 1 -- 172.21.15.77:0/785781981 wait complete. 2023-11-04T01:40:25.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7fd0f9426640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0ec0df360 0x7fd0ec0ced10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7fd0f9426640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec0dafc0 con 0x7fd0ec054a30 2023-11-04T01:40:25.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7f1373e7c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f136c072030 0x7f136c1f7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7fd0f27fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0ec054a30 0x7fd0ec0daa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7fd0f2ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0ec03a8c0 0x7fd0ec0d3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7fd0f27fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0ec054a30 0x7fd0ec0daa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56998/0 (socket says 172.21.15.77:56998) 2023-11-04T01:40:25.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7f1373e7c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f136c0b1640 0x7f136c1f8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7ffa69c9e640 1 -- 172.21.15.77:0/4031990801 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa640c4830 con 0x7ffa64158eb0 2023-11-04T01:40:25.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7fd0f27fc640 1 -- 172.21.15.77:0/3480529517 learned_addr learned my addr 172.21.15.77:0/3480529517 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:25.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7fd0f9426640 1 -- 172.21.15.77:0/3480529517 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec0d6210 con 0x7fd0ec03a8c0 2023-11-04T01:40:25.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7fd0f9426640 1 -- 172.21.15.77:0/3480529517 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec0d3c40 con 0x7fd0ec0df360 2023-11-04T01:40:25.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7fd0f37fe640 1 --2- 172.21.15.77:0/3480529517 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0ec0df360 0x7fd0ec0ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7f1371c18640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f136c072030 0x7f136c1f7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7f1371c18640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f136c072030 0x7f136c1f7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:40710/0 (socket says 172.21.15.77:40710) 2023-11-04T01:40:25.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7f1371c18640 1 -- 172.21.15.77:0/1105658587 learned_addr learned my addr 172.21.15.77:0/1105658587 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:25.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7f1373e7c640 1 --2- 172.21.15.77:0/1105658587 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f136c159800 0x7f136c14c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7f1371417640 1 --2- 172.21.15.77:0/1105658587 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f136c0b1640 0x7f136c1f8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.435+0000 7f1373e7c640 1 -- 172.21.15.77:0/1105658587 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136c0c86e0 con 0x7f136c159800 2023-11-04T01:40:25.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.436+0000 7f1373e7c640 1 -- 172.21.15.77:0/1105658587 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136c1f8760 con 0x7f136c072030 2023-11-04T01:40:25.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.436+0000 7f1373e7c640 1 -- 172.21.15.77:0/1105658587 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136c0c7d80 con 0x7f136c0b1640 2023-11-04T01:40:25.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.436+0000 7f1372419640 1 --2- 172.21.15.77:0/1105658587 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f136c159800 0x7f136c14c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.436+0000 7f4c5e6a2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4c58070710 0x7f4c58150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.436+0000 7fd0f27fc640 1 -- 172.21.15.77:0/3480529517 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0ec0df360 msgr2=0x7fd0ec0ced10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.436+0000 7f4c5e6a2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c580c4690 0x7f4c580c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.436+0000 7fd0f27fc640 1 --2- 172.21.15.77:0/3480529517 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0ec0df360 0x7fd0ec0ced10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.436+0000 7fd0f27fc640 1 -- 172.21.15.77:0/3480529517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0ec03a8c0 msgr2=0x7fd0ec0d3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.436+0000 7fd0f27fc640 1 --2- 172.21.15.77:0/3480529517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0ec03a8c0 0x7fd0ec0d3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.436+0000 7fd0f27fc640 1 -- 172.21.15.77:0/3480529517 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f4072740 con 0x7fd0ec054a30 2023-11-04T01:40:25.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.436+0000 7f200607c640 1 Processor -- start 2023-11-04T01:40:25.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.436+0000 7fd0f27fc640 1 --2- 172.21.15.77:0/3480529517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0ec054a30 0x7fd0ec0daa80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4007fd0 tx=0x7fd0e400c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.436+0000 7f336940e640 1 -- 172.21.15.77:0/3904543029 shutdown_connections 2023-11-04T01:40:25.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.436+0000 7f336940e640 1 -- 172.21.15.77:0/3904543029 wait complete. 2023-11-04T01:40:25.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.436+0000 7f200607c640 1 -- start start 2023-11-04T01:40:25.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.436+0000 7f1372419640 1 -- 172.21.15.77:0/1105658587 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f136c0b1640 msgr2=0x7f136c1f8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.436+0000 7f1372419640 1 --2- 172.21.15.77:0/1105658587 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f136c0b1640 0x7f136c1f8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.436+0000 7f1372419640 1 -- 172.21.15.77:0/1105658587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f136c072030 msgr2=0x7f136c1f7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.436+0000 7f1372419640 1 --2- 172.21.15.77:0/1105658587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f136c072030 0x7f136c1f7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.436+0000 7f1372419640 1 -- 172.21.15.77:0/1105658587 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1364009950 con 0x7f136c159800 2023-11-04T01:40:25.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.437+0000 7f2d4496c640 1 Processor -- start 2023-11-04T01:40:25.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.437+0000 7f4529592640 1 -- 172.21.15.77:0/1526091435 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4524070710 msgr2=0x7f45240ae5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.437+0000 7f4529592640 1 --2- 172.21.15.77:0/1526091435 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4524070710 0x7f45240ae5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.437+0000 7f2d4496c640 1 -- start start 2023-11-04T01:40:25.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.437+0000 7f4529592640 1 -- 172.21.15.77:0/1526091435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45240cc520 msgr2=0x7f452415dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.437+0000 7f4529592640 1 --2- 172.21.15.77:0/1526091435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45240cc520 0x7f452415dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.437+0000 7f4529592640 1 -- 172.21.15.77:0/1526091435 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f451c009b30 con 0x7f4524164760 2023-11-04T01:40:25.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.437+0000 7f4523fff640 1 --2- 172.21.15.77:0/1526091435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45240cc520 0x7f452415dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:25.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.437+0000 7f1372419640 1 --2- 172.21.15.77:0/1105658587 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f136c159800 0x7f136c14c6a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f136400c6c0 tx=0x7f136400cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.437+0000 7fd0db7fe640 1 -- 172.21.15.77:0/3480529517 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e400a020 con 0x7fd0ec054a30 2023-11-04T01:40:25.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.437+0000 7f13627fc640 1 -- 172.21.15.77:0/1105658587 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136400cec0 con 0x7f136c159800 2023-11-04T01:40:25.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.437+0000 7fd0f9426640 1 -- 172.21.15.77:0/3480529517 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0ec0d64b0 con 0x7fd0ec054a30 2023-11-04T01:40:25.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.437+0000 7fd0f9426640 1 -- 172.21.15.77:0/3480529517 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0ec0d6a70 con 0x7fd0ec054a30 2023-11-04T01:40:25.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.438+0000 7f200607c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20000b1da0 0x7f2000151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.438+0000 7f200607c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20000cc520 0x7f20000ada30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.438+0000 7f200607c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2000164760 0x7f2000162590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.438+0000 7f1ffeffd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20000cc520 0x7f20000ada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.438+0000 7f1ffeffd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20000cc520 0x7f20000ada30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:53622/0 (socket says 172.21.15.77:53622) 2023-11-04T01:40:25.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.438+0000 7f1ffeffd640 1 -- 172.21.15.77:0/412832646 learned_addr learned my addr 172.21.15.77:0/412832646 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:25.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.438+0000 7f200607c640 1 -- 172.21.15.77:0/412832646 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f200015c990 con 0x7f20000b1da0 2023-11-04T01:40:25.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.438+0000 7f1ffffff640 1 --2- 172.21.15.77:0/412832646 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2000164760 0x7f2000162590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.438+0000 7f200607c640 1 -- 172.21.15.77:0/412832646 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20000ae540 con 0x7f2000164760 2023-11-04T01:40:25.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.438+0000 7f200607c640 1 -- 172.21.15.77:0/412832646 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20000ae820 con 0x7f20000cc520 2023-11-04T01:40:25.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.437+0000 7ffa617fa640 1 -- 172.21.15.77:0/4031990801 <== mon.2 v2:172.21.15.122:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffa5c00ac70 con 0x7ffa64158eb0 2023-11-04T01:40:25.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.437+0000 7ffa69c9e640 1 -- 172.21.15.77:0/4031990801 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa640c5030 con 0x7ffa64158eb0 2023-11-04T01:40:25.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.438+0000 7ffa617fa640 1 --2- 172.21.15.77:0/4031990801 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ffa5006af40 0x7ffa5006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.438+0000 7ffa617fa640 1 -- 172.21.15.77:0/4031990801 <== mon.2 v2:172.21.15.122:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffa5c089470 con 0x7ffa64158eb0 2023-11-04T01:40:25.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.438+0000 7ffa68c9c640 1 --2- 172.21.15.77:0/4031990801 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ffa5006af40 0x7ffa5006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.438+0000 7f4529592640 1 --2- 172.21.15.77:0/1526091435 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4524164760 0x7f45241eaa60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f451c032000 tx=0x7f451c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.438+0000 7f45217fa640 1 -- 172.21.15.77:0/1526091435 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451c03e450 con 0x7f4524164760 2023-11-04T01:40:25.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.438+0000 7f45217fa640 1 -- 172.21.15.77:0/1526091435 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451c03e5b0 con 0x7f4524164760 2023-11-04T01:40:25.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.438+0000 7f45217fa640 1 -- 172.21.15.77:0/1526091435 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451c03e960 con 0x7f4524164760 2023-11-04T01:40:25.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.439+0000 7f2d4496c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2d30005180 0x7f2d380ea840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.437+0000 7fd0db7fe640 1 -- 172.21.15.77:0/3480529517 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e400a180 con 0x7fd0ec054a30 2023-11-04T01:40:25.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.437+0000 7fd0db7fe640 1 -- 172.21.15.77:0/3480529517 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e400cd30 con 0x7fd0ec054a30 2023-11-04T01:40:25.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.437+0000 7f13627fc640 1 -- 172.21.15.77:0/1105658587 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136400b9b0 con 0x7f136c159800 2023-11-04T01:40:25.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.439+0000 7f2d4496c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2d380e4d40 0x7f2d380e62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.439+0000 7f1fff7fe640 1 --2- 172.21.15.77:0/412832646 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20000b1da0 0x7f2000151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.439+0000 7f2d4496c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d380e6800 0x7f2d380e7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.439+0000 7f1371417640 1 --2- 172.21.15.77:0/1105658587 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f136c0b1640 0x7f136c1f8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:25.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.439+0000 7f13627fc640 1 -- 172.21.15.77:0/1105658587 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136400bd60 con 0x7f136c159800 2023-11-04T01:40:25.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.439+0000 7f1373e7c640 1 -- 172.21.15.77:0/1105658587 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f135c009400 con 0x7f136c159800 2023-11-04T01:40:25.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.439+0000 7f1ffffff640 1 -- 172.21.15.77:0/412832646 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20000cc520 msgr2=0x7f20000ada30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.439+0000 7f1ffffff640 1 --2- 172.21.15.77:0/412832646 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20000cc520 0x7f20000ada30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.439+0000 7f1ffffff640 1 -- 172.21.15.77:0/412832646 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20000b1da0 msgr2=0x7f2000151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.439+0000 7f1ffffff640 1 --2- 172.21.15.77:0/412832646 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20000b1da0 0x7f2000151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.439+0000 7f1ffffff640 1 -- 172.21.15.77:0/412832646 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff00094d0 con 0x7f2000164760 2023-11-04T01:40:25.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.439+0000 7f2d3effd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2d380e4d40 0x7f2d380e62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.438+0000 7f336940e640 1 Processor -- start 2023-11-04T01:40:25.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.438+0000 7f336940e640 1 -- start start 2023-11-04T01:40:25.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.439+0000 7f452aff5640 1 -- 172.21.15.77:0/1526091435 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45242002b0 con 0x7f4524164760 2023-11-04T01:40:25.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.439+0000 7f2d3effd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2d380e4d40 0x7f2d380e62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:40726/0 (socket says 172.21.15.77:40726) 2023-11-04T01:40:25.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.439+0000 7f2d3effd640 1 -- 172.21.15.77:0/502775506 learned_addr learned my addr 172.21.15.77:0/502775506 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:25.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.439+0000 7f1ffffff640 1 --2- 172.21.15.77:0/412832646 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2000164760 0x7f2000162590 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1ff800be20 tx=0x7f1ff800bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.439+0000 7f452aff5640 1 -- 172.21.15.77:0/1526091435 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45240adad0 con 0x7f4524164760 2023-11-04T01:40:25.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.439+0000 7f2d3f7fe640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2d30005180 0x7f2d380ea840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.439+0000 7f2d3ffff640 1 --2- 172.21.15.77:0/502775506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d380e6800 0x7f2d380e7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.440+0000 7f2d4496c640 1 -- 172.21.15.77:0/502775506 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d380e5e30 con 0x7f2d380e6800 2023-11-04T01:40:25.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.440+0000 7ffa68c9c640 1 --2- 172.21.15.77:0/4031990801 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ffa5006af40 0x7ffa5006d400 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffa54039000 tx=0x7ffa54034000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.436+0000 7f4c5e6a2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c58164760 0x7f4c580b3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.436+0000 7f4c5e6a2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c581512f0 con 0x7f4c580c4690 2023-11-04T01:40:25.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.437+0000 7f4c577fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c580c4690 0x7f4c580c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.437+0000 7f4c577fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c580c4690 0x7f4c580c5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57016/0 (socket says 172.21.15.77:57016) 2023-11-04T01:40:25.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.437+0000 7f4c577fe640 1 -- 172.21.15.77:0/3725068575 learned_addr learned my addr 172.21.15.77:0/3725068575 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:25.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.437+0000 7f4c5e6a2640 1 -- 172.21.15.77:0/3725068575 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c580ae270 con 0x7f4c58164760 2023-11-04T01:40:25.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.437+0000 7f4c5e6a2640 1 -- 172.21.15.77:0/3725068575 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c58160e50 con 0x7f4c58070710 2023-11-04T01:40:25.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.437+0000 7f4c577fe640 1 -- 172.21.15.77:0/3725068575 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4c58070710 msgr2=0x7f4c58150db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.440+0000 7f2d4496c640 1 -- 172.21.15.77:0/502775506 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d380ead80 con 0x7f2d380e4d40 2023-11-04T01:40:25.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.440+0000 7f2d4496c640 1 -- 172.21.15.77:0/502775506 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d380e5220 con 0x7f2d30005180 2023-11-04T01:40:25.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.440+0000 7f1373e7c640 1 -- 172.21.15.77:0/1105658587 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f136c0c8300 con 0x7f136c159800 2023-11-04T01:40:25.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.440+0000 7fd0f9426640 1 -- 172.21.15.77:0/3480529517 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0d4005250 con 0x7fd0ec054a30 2023-11-04T01:40:25.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.436+0000 7f4c57fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4c58070710 0x7f4c58150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.440+0000 7f1fff7fe640 1 --2- 172.21.15.77:0/412832646 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20000b1da0 0x7f2000151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:25.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.440+0000 7f1fe7fff640 1 -- 172.21.15.77:0/412832646 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff800ce70 con 0x7f2000164760 2023-11-04T01:40:25.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.440+0000 7f4c5cc3f640 1 --2- 172.21.15.77:0/3725068575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c58164760 0x7f4c580b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.440+0000 7f336940e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3364158c80 0x7f33641515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.440+0000 7fd0db7fe640 1 -- 172.21.15.77:0/3480529517 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd0e4016430 con 0x7fd0ec054a30 2023-11-04T01:40:25.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.440+0000 7f1fe7fff640 1 -- 172.21.15.77:0/412832646 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff8014440 con 0x7f2000164760 2023-11-04T01:40:25.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.440+0000 7f1fe7fff640 1 -- 172.21.15.77:0/412832646 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff8014810 con 0x7f2000164760 2023-11-04T01:40:25.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.440+0000 7f336940e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3364159060 0x7f33640c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.440+0000 7f4c577fe640 1 --2- 172.21.15.77:0/3725068575 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4c58070710 0x7f4c58150db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.440+0000 7f4c577fe640 1 -- 172.21.15.77:0/3725068575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c58164760 msgr2=0x7f4c580b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.440+0000 7f4c577fe640 1 --2- 172.21.15.77:0/3725068575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c58164760 0x7f4c580b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.440+0000 7f4c577fe640 1 -- 172.21.15.77:0/3725068575 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c50009b30 con 0x7f4c580c4690 2023-11-04T01:40:25.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.440+0000 7f4c57fff640 1 --2- 172.21.15.77:0/3725068575 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4c58070710 0x7f4c58150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:25.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.440+0000 7f4c5cc3f640 1 --2- 172.21.15.77:0/3725068575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c58164760 0x7f4c580b3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:25.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.440+0000 7f336940e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f336415a070 0x7f33640c4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.440+0000 7f336940e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33640c7430 con 0x7f3364159060 2023-11-04T01:40:25.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.440+0000 7f336940e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3364157050 con 0x7f336415a070 2023-11-04T01:40:25.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.440+0000 7f336940e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33640c6e70 con 0x7f3364158c80 2023-11-04T01:40:25.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.440+0000 7f3362ffd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3364158c80 0x7f33641515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.440+0000 7f33637fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f336415a070 0x7f33640c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.440+0000 7f3362ffd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3364158c80 0x7f33641515a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:53634/0 (socket says 172.21.15.77:53634) 2023-11-04T01:40:25.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.440+0000 7f3362ffd640 1 -- 172.21.15.77:0/3069816450 learned_addr learned my addr 172.21.15.77:0/3069816450 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:25.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.440+0000 7fd0db7fe640 1 --2- 172.21.15.77:0/3480529517 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd0e006af40 0x7fd0e006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.441+0000 7fd0db7fe640 1 -- 172.21.15.77:0/3480529517 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd0e4089890 con 0x7fd0ec054a30 2023-11-04T01:40:25.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.441+0000 7fd0f2ffd640 1 --2- 172.21.15.77:0/3480529517 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd0e006af40 0x7fd0e006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.441+0000 7f33627fc640 1 --2- 172.21.15.77:0/3069816450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3364159060 0x7f33640c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.441+0000 7f33637fe640 1 -- 172.21.15.77:0/3069816450 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3364158c80 msgr2=0x7f33641515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.440+0000 7f200607c640 1 -- 172.21.15.77:0/412832646 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f200015c5b0 con 0x7f2000164760 2023-11-04T01:40:25.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.440+0000 7f200607c640 1 -- 172.21.15.77:0/412832646 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20000aeb00 con 0x7f2000164760 2023-11-04T01:40:25.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.441+0000 7f33637fe640 1 --2- 172.21.15.77:0/3069816450 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3364158c80 0x7f33641515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.441+0000 7f33637fe640 1 -- 172.21.15.77:0/3069816450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3364159060 msgr2=0x7f33640c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.441+0000 7f33637fe640 1 --2- 172.21.15.77:0/3069816450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3364159060 0x7f33640c40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.441+0000 7f33637fe640 1 -- 172.21.15.77:0/3069816450 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335c009830 con 0x7f336415a070 2023-11-04T01:40:25.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.441+0000 7f452aff5640 1 -- 172.21.15.77:0/1526091435 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45240ae2d0 con 0x7f4524164760 2023-11-04T01:40:25.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.441+0000 7f4c577fe640 1 --2- 172.21.15.77:0/3725068575 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c580c4690 0x7f4c580c5a20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4c50036040 tx=0x7f4c50004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.441+0000 7f1373e7c640 1 -- 172.21.15.77:0/1105658587 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f136c0c8820 con 0x7f136c159800 2023-11-04T01:40:25.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.441+0000 7f3362ffd640 1 --2- 172.21.15.77:0/3069816450 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3364158c80 0x7f33641515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:25.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.441+0000 7f33627fc640 1 --2- 172.21.15.77:0/3069816450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3364159060 0x7f33640c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:25.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.441+0000 7f33637fe640 1 --2- 172.21.15.77:0/3069816450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f336415a070 0x7f33640c4620 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f335400c5c0 tx=0x7f335400ca80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.441+0000 7f334b7fe640 1 -- 172.21.15.77:0/3069816450 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3354011800 con 0x7f336415a070 2023-11-04T01:40:25.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.442+0000 7f334b7fe640 1 -- 172.21.15.77:0/3069816450 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3354011960 con 0x7f336415a070 2023-11-04T01:40:25.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.442+0000 7f334b7fe640 1 -- 172.21.15.77:0/3069816450 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3354011d50 con 0x7f336415a070 2023-11-04T01:40:25.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.442+0000 7f13627fc640 1 -- 172.21.15.77:0/1105658587 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f136401f3b0 con 0x7f136c159800 2023-11-04T01:40:25.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.442+0000 7f2d3ffff640 1 -- 172.21.15.77:0/502775506 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2d30005180 msgr2=0x7f2d380ea840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.442+0000 7f200607c640 1 -- 172.21.15.77:0/412832646 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f200015cad0 con 0x7f2000164760 2023-11-04T01:40:25.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.442+0000 7f2d3ffff640 1 --2- 172.21.15.77:0/502775506 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2d30005180 0x7f2d380ea840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.442+0000 7f2d3ffff640 1 -- 172.21.15.77:0/502775506 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2d380e4d40 msgr2=0x7f2d380e62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.442+0000 7f2d3ffff640 1 --2- 172.21.15.77:0/502775506 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2d380e4d40 0x7f2d380e62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.442+0000 7f2d3ffff640 1 -- 172.21.15.77:0/502775506 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d380e5500 con 0x7f2d380e6800 2023-11-04T01:40:25.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.442+0000 7fd0f2ffd640 1 --2- 172.21.15.77:0/3480529517 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd0e006af40 0x7fd0e006d400 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec008b10 tx=0x7fd0f40b2000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.442+0000 7f336940e640 1 -- 172.21.15.77:0/3069816450 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33640c7150 con 0x7f336415a070 2023-11-04T01:40:25.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.442+0000 7f336940e640 1 -- 172.21.15.77:0/3069816450 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33641ef5c0 con 0x7f336415a070 2023-11-04T01:40:25.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.442+0000 7f45217fa640 1 -- 172.21.15.77:0/1526091435 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f451c03eac0 con 0x7f4524164760 2023-11-04T01:40:25.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.442+0000 7f13627fc640 1 --2- 172.21.15.77:0/1105658587 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f135006aec0 0x7f135006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.442+0000 7f13627fc640 1 -- 172.21.15.77:0/1105658587 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f136408a3c0 con 0x7f136c159800 2023-11-04T01:40:25.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.442+0000 7f45217fa640 1 --2- 172.21.15.77:0/1526091435 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f451006ae70 0x7f451006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.443+0000 7f2d3ffff640 1 --2- 172.21.15.77:0/502775506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d380e6800 0x7f2d380e7f00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2d3800df80 tx=0x7f2d2c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.443+0000 7f45217fa640 1 -- 172.21.15.77:0/1526091435 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f451c0ac5f0 con 0x7f4524164760 2023-11-04T01:40:25.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.443+0000 7f4528d91640 1 --2- 172.21.15.77:0/1526091435 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f451006ae70 0x7f451006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.443+0000 7f1371c18640 1 --2- 172.21.15.77:0/1105658587 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f135006aec0 0x7f135006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.443+0000 7f1fe7fff640 1 -- 172.21.15.77:0/412832646 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1ff8014970 con 0x7f2000164760 2023-11-04T01:40:25.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.443+0000 7f336940e640 1 -- 172.21.15.77:0/3069816450 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3364156b40 con 0x7f336415a070 2023-11-04T01:40:25.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.443+0000 7f1371c18640 1 --2- 172.21.15.77:0/1105658587 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f135006aec0 0x7f135006d380 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1368000f60 tx=0x7f1368009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.443+0000 7f4528d91640 1 --2- 172.21.15.77:0/1526091435 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f451006ae70 0x7f451006d330 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4514006fd0 tx=0x7f4514008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.443+0000 7f1fe7fff640 1 --2- 172.21.15.77:0/412832646 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1fec06ae70 0x7f1fec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.443+0000 7f1fe7fff640 1 -- 172.21.15.77:0/412832646 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1ff8089a80 con 0x7f2000164760 2023-11-04T01:40:25.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.444+0000 7f1fff7fe640 1 --2- 172.21.15.77:0/412832646 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1fec06ae70 0x7f1fec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.443+0000 7f334b7fe640 1 -- 172.21.15.77:0/3069816450 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3354022350 con 0x7f336415a070 2023-11-04T01:40:25.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.444+0000 7f334b7fe640 1 --2- 172.21.15.77:0/3069816450 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f335006ae70 0x7f335006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.444+0000 7f334b7fe640 1 -- 172.21.15.77:0/3069816450 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3354089990 con 0x7f336415a070 2023-11-04T01:40:25.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.444+0000 7ffa617fa640 1 -- 172.21.15.77:0/4031990801 <== mon.2 v2:172.21.15.122:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffa640c5030 con 0x7ffa64158eb0 2023-11-04T01:40:25.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.444+0000 7f3362ffd640 1 --2- 172.21.15.77:0/3069816450 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f335006ae70 0x7f335006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.444+0000 7f1fff7fe640 1 --2- 172.21.15.77:0/412832646 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1fec06ae70 0x7f1fec06d330 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0036000 tx=0x7f1ff003d040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.444+0000 7f3362ffd640 1 --2- 172.21.15.77:0/3069816450 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f335006ae70 0x7f335006d330 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3358007c40 tx=0x7f3358007b90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.447+0000 7f4c54ff9640 1 -- 172.21.15.77:0/3725068575 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c50004040 con 0x7f4c580c4690 2023-11-04T01:40:25.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.447+0000 7f2d2bfff640 1 -- 172.21.15.77:0/502775506 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c034850 con 0x7f2d380e6800 2023-11-04T01:40:25.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.447+0000 7f4c5e6a2640 1 -- 172.21.15.77:0/3725068575 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c580ae510 con 0x7f4c580c4690 2023-11-04T01:40:25.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.447+0000 7fd0db7fe640 1 -- 172.21.15.77:0/3480529517 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd0e4054720 con 0x7fd0ec054a30 2023-11-04T01:40:25.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.447+0000 7f4c5e6a2640 1 -- 172.21.15.77:0/3725068575 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c58161130 con 0x7f4c580c4690 2023-11-04T01:40:25.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.447+0000 7f2d4496c640 1 -- 172.21.15.77:0/502775506 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d380e57e0 con 0x7f2d380e6800 2023-11-04T01:40:25.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.447+0000 7f2d4496c640 1 -- 172.21.15.77:0/502775506 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d380d5bf0 con 0x7f2d380e6800 2023-11-04T01:40:25.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.448+0000 7f1fe7fff640 1 -- 172.21.15.77:0/412832646 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1ff80549d0 con 0x7f2000164760 2023-11-04T01:40:25.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.448+0000 7f2d4496c640 1 -- 172.21.15.77:0/502775506 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d380e5fa0 con 0x7f2d380e6800 2023-11-04T01:40:25.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.448+0000 7f4c5e6a2640 1 -- 172.21.15.77:0/3725068575 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c580ae9d0 con 0x7f4c580c4690 2023-11-04T01:40:25.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.452+0000 7f45217fa640 1 -- 172.21.15.77:0/1526091435 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f451c0774c0 con 0x7f4524164760 2023-11-04T01:40:25.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.454+0000 7f4c54ff9640 1 -- 172.21.15.77:0/3725068575 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c500041a0 con 0x7f4c580c4690 2023-11-04T01:40:25.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.454+0000 7f4c54ff9640 1 -- 172.21.15.77:0/3725068575 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c50004510 con 0x7f4c580c4690 2023-11-04T01:40:25.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.455+0000 7f2d2bfff640 1 -- 172.21.15.77:0/502775506 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2c0349b0 con 0x7f2d380e6800 2023-11-04T01:40:25.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.455+0000 7f2d2bfff640 1 -- 172.21.15.77:0/502775506 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c034d20 con 0x7f2d380e6800 2023-11-04T01:40:25.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.456+0000 7f13627fc640 1 -- 172.21.15.77:0/1105658587 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f136c0c8820 con 0x7f136c159800 2023-11-04T01:40:25.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.456+0000 7f4c54ff9640 1 -- 172.21.15.77:0/3725068575 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4c50004670 con 0x7f4c580c4690 2023-11-04T01:40:25.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.457+0000 7f334b7fe640 1 -- 172.21.15.77:0/3069816450 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3364156b40 con 0x7f336415a070 2023-11-04T01:40:25.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.457+0000 7f4c54ff9640 1 --2- 172.21.15.77:0/3725068575 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4c4406ae70 0x7f4c4406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.457+0000 7f4c57fff640 1 --2- 172.21.15.77:0/3725068575 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4c4406ae70 0x7f4c4406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.457+0000 7f2d2bfff640 1 -- 172.21.15.77:0/502775506 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2d2c03b070 con 0x7f2d380e6800 2023-11-04T01:40:25.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.458+0000 7f4c54ff9640 1 -- 172.21.15.77:0/3725068575 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4c500473b0 con 0x7f4c580c4690 2023-11-04T01:40:25.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.458+0000 7f4c57fff640 1 --2- 172.21.15.77:0/3725068575 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4c4406ae70 0x7f4c4406d330 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c0011e0 tx=0x7f4c4c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.458+0000 7f2d2bfff640 1 --2- 172.21.15.77:0/502775506 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2d2406ae70 0x7f2d2406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:25.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.458+0000 7f2d2bfff640 1 -- 172.21.15.77:0/502775506 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2d2c0aa750 con 0x7f2d380e6800 2023-11-04T01:40:25.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.458+0000 7f2d3f7fe640 1 --2- 172.21.15.77:0/502775506 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2d2406ae70 0x7f2d2406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:25.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.459+0000 7f2d3f7fe640 1 --2- 172.21.15.77:0/502775506 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2d2406ae70 0x7f2d2406d330 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2d34000c00 tx=0x7f2d340078f0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:25.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.466+0000 7f4c54ff9640 1 -- 172.21.15.77:0/3725068575 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4c500775e0 con 0x7f4c580c4690 2023-11-04T01:40:25.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.474+0000 7f2d2bfff640 1 -- 172.21.15.77:0/502775506 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2d2c075750 con 0x7f2d380e6800 2023-11-04T01:40:25.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.833+0000 7fd0f9426640 1 -- 172.21.15.77:0/3480529517 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd0d4005500 con 0x7fd0ec054a30 2023-11-04T01:40:25.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.834+0000 7fd0db7fe640 1 -- 172.21.15.77:0/3480529517 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd0e4057d40 con 0x7fd0ec054a30 2023-11-04T01:40:25.836 INFO:teuthology.orchestra.run.smithi077.stdout:55834574856 2023-11-04T01:40:25.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.838+0000 7fd0d97fa640 1 -- 172.21.15.77:0/3480529517 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd0e006af40 msgr2=0x7fd0e006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.838+0000 7fd0d97fa640 1 --2- 172.21.15.77:0/3480529517 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd0e006af40 0x7fd0e006d400 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec008b10 tx=0x7fd0f40b2000 comp rx=0 tx=0).stop 2023-11-04T01:40:25.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.838+0000 7fd0d97fa640 1 -- 172.21.15.77:0/3480529517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0ec054a30 msgr2=0x7fd0ec0daa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.838+0000 7fd0d97fa640 1 --2- 172.21.15.77:0/3480529517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0ec054a30 0x7fd0ec0daa80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4007fd0 tx=0x7fd0e400c420 comp rx=0 tx=0).stop 2023-11-04T01:40:25.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.838+0000 7fd0d97fa640 1 -- 172.21.15.77:0/3480529517 shutdown_connections 2023-11-04T01:40:25.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.838+0000 7fd0d97fa640 1 --2- 172.21.15.77:0/3480529517 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd0e006af40 0x7fd0e006d400 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.838+0000 7fd0d97fa640 1 --2- 172.21.15.77:0/3480529517 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0ec0df360 0x7fd0ec0ced10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.838+0000 7fd0d97fa640 1 --2- 172.21.15.77:0/3480529517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0ec054a30 0x7fd0ec0daa80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.839+0000 7fd0d97fa640 1 --2- 172.21.15.77:0/3480529517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0ec03a8c0 0x7fd0ec0d3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.839+0000 7fd0d97fa640 1 -- 172.21.15.77:0/3480529517 >> 172.21.15.77:0/3480529517 conn(0x7fd0ec00a440 msgr2=0x7fd0ec0df8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.839+0000 7fd0d97fa640 1 -- 172.21.15.77:0/3480529517 shutdown_connections 2023-11-04T01:40:25.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.839+0000 7fd0d97fa640 1 -- 172.21.15.77:0/3480529517 wait complete. 2023-11-04T01:40:25.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.841+0000 7ffa69c9e640 1 -- 172.21.15.77:0/4031990801 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ffa640c5030 con 0x7ffa64158eb0 2023-11-04T01:40:25.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.842+0000 7ffa617fa640 1 -- 172.21.15.77:0/4031990801 <== mon.2 v2:172.21.15.122:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffa640c5030 con 0x7ffa64158eb0 2023-11-04T01:40:25.844 INFO:teuthology.orchestra.run.smithi077.stdout:55834574855 2023-11-04T01:40:25.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.845+0000 7ffa4affd640 1 -- 172.21.15.77:0/4031990801 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ffa5006af40 msgr2=0x7ffa5006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.845+0000 7ffa4affd640 1 --2- 172.21.15.77:0/4031990801 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ffa5006af40 0x7ffa5006d400 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffa54039000 tx=0x7ffa54034000 comp rx=0 tx=0).stop 2023-11-04T01:40:25.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.845+0000 7ffa4affd640 1 -- 172.21.15.77:0/4031990801 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffa64158eb0 msgr2=0x7ffa641f7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.845+0000 7ffa4affd640 1 --2- 172.21.15.77:0/4031990801 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffa64158eb0 0x7ffa641f7f30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c00c8e0 tx=0x7ffa5c00cda0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.845+0000 7ffa4affd640 1 -- 172.21.15.77:0/4031990801 shutdown_connections 2023-11-04T01:40:25.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.846+0000 7ffa4affd640 1 --2- 172.21.15.77:0/4031990801 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ffa5006af40 0x7ffa5006d400 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.846+0000 7ffa4affd640 1 --2- 172.21.15.77:0/4031990801 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffa640c7810 0x7ffa640c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.846+0000 7ffa4affd640 1 --2- 172.21.15.77:0/4031990801 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffa64158eb0 0x7ffa641f7f30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.846+0000 7ffa4affd640 1 --2- 172.21.15.77:0/4031990801 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa640ce6c0 0x7ffa640c3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.846+0000 7ffa4affd640 1 -- 172.21.15.77:0/4031990801 >> 172.21.15.77:0/4031990801 conn(0x7ffa6406a120 msgr2=0x7ffa640b1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.846+0000 7ffa4affd640 1 -- 172.21.15.77:0/4031990801 shutdown_connections 2023-11-04T01:40:25.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.846+0000 7ffa4affd640 1 -- 172.21.15.77:0/4031990801 wait complete. 2023-11-04T01:40:25.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.848+0000 7f200607c640 1 -- 172.21.15.77:0/412832646 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f200015cad0 con 0x7f2000164760 2023-11-04T01:40:25.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.848+0000 7f452aff5640 1 -- 172.21.15.77:0/1526091435 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4524074290 con 0x7f4524164760 2023-11-04T01:40:25.854 INFO:teuthology.orchestra.run.smithi077.stdout:55834574857 2023-11-04T01:40:25.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.851+0000 7f1fe7fff640 1 -- 172.21.15.77:0/412832646 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f200015cad0 con 0x7f2000164760 2023-11-04T01:40:25.855 INFO:teuthology.orchestra.run.smithi077.stdout:55834574856 2023-11-04T01:40:25.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.849+0000 7f45217fa640 1 -- 172.21.15.77:0/1526091435 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f451c07aae0 con 0x7f4524164760 2023-11-04T01:40:25.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.853+0000 7f452aff5640 1 -- 172.21.15.77:0/1526091435 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f451006ae70 msgr2=0x7f451006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.853+0000 7f452aff5640 1 --2- 172.21.15.77:0/1526091435 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f451006ae70 0x7f451006d330 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4514006fd0 tx=0x7f4514008040 comp rx=0 tx=0).stop 2023-11-04T01:40:25.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.853+0000 7f452aff5640 1 -- 172.21.15.77:0/1526091435 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4524164760 msgr2=0x7f45241eaa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.853+0000 7f452aff5640 1 --2- 172.21.15.77:0/1526091435 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4524164760 0x7f45241eaa60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f451c032000 tx=0x7f451c004a40 comp rx=0 tx=0).stop 2023-11-04T01:40:25.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.853+0000 7f452aff5640 1 -- 172.21.15.77:0/1526091435 shutdown_connections 2023-11-04T01:40:25.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.853+0000 7f452aff5640 1 --2- 172.21.15.77:0/1526091435 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f451006ae70 0x7f451006d330 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.853+0000 7f452aff5640 1 --2- 172.21.15.77:0/1526091435 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4524164760 0x7f45241eaa60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.853+0000 7f452aff5640 1 --2- 172.21.15.77:0/1526091435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45240cc520 0x7f452415dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.853+0000 7f452aff5640 1 --2- 172.21.15.77:0/1526091435 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4524070710 0x7f45240ae5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.853+0000 7f452aff5640 1 -- 172.21.15.77:0/1526091435 >> 172.21.15.77:0/1526091435 conn(0x7f45240ce950 msgr2=0x7f452406d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.853+0000 7f452aff5640 1 -- 172.21.15.77:0/1526091435 shutdown_connections 2023-11-04T01:40:25.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.853+0000 7f452aff5640 1 -- 172.21.15.77:0/1526091435 wait complete. 2023-11-04T01:40:25.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.854+0000 7f200607c640 1 -- 172.21.15.77:0/412832646 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1fec06ae70 msgr2=0x7f1fec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.854+0000 7f200607c640 1 --2- 172.21.15.77:0/412832646 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1fec06ae70 0x7f1fec06d330 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0036000 tx=0x7f1ff003d040 comp rx=0 tx=0).stop 2023-11-04T01:40:25.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.855+0000 7f200607c640 1 -- 172.21.15.77:0/412832646 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2000164760 msgr2=0x7f2000162590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.855+0000 7f200607c640 1 --2- 172.21.15.77:0/412832646 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2000164760 0x7f2000162590 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1ff800be20 tx=0x7f1ff800bf10 comp rx=0 tx=0).stop 2023-11-04T01:40:25.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.855+0000 7f200607c640 1 -- 172.21.15.77:0/412832646 shutdown_connections 2023-11-04T01:40:25.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.855+0000 7f200607c640 1 --2- 172.21.15.77:0/412832646 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1fec06ae70 0x7f1fec06d330 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.855+0000 7f200607c640 1 --2- 172.21.15.77:0/412832646 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2000164760 0x7f2000162590 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.855+0000 7f200607c640 1 --2- 172.21.15.77:0/412832646 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20000cc520 0x7f20000ada30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.855+0000 7f200607c640 1 --2- 172.21.15.77:0/412832646 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20000b1da0 0x7f2000151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.855+0000 7f200607c640 1 -- 172.21.15.77:0/412832646 >> 172.21.15.77:0/412832646 conn(0x7f20000ce950 msgr2=0x7f20000cdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.2 2023-11-04T01:40:25.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.856+0000 7f200607c640 1 -- 172.21.15.77:0/412832646 shutdown_connections 2023-11-04T01:40:25.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.856+0000 7f200607c640 1 -- 172.21.15.77:0/412832646 wait complete. 2023-11-04T01:40:25.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.857+0000 7f1373e7c640 1 -- 172.21.15.77:0/1105658587 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f136c0c8820 con 0x7f136c159800 2023-11-04T01:40:25.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.858+0000 7f13627fc640 1 -- 172.21.15.77:0/1105658587 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f136c0c8820 con 0x7f136c159800 2023-11-04T01:40:25.865 INFO:teuthology.orchestra.run.smithi077.stdout:55834574857 2023-11-04T01:40:25.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.861+0000 7f1373e7c640 1 -- 172.21.15.77:0/1105658587 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f135006aec0 msgr2=0x7f135006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.861+0000 7f1373e7c640 1 --2- 172.21.15.77:0/1105658587 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f135006aec0 0x7f135006d380 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1368000f60 tx=0x7f1368009040 comp rx=0 tx=0).stop 2023-11-04T01:40:25.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.861+0000 7f1373e7c640 1 -- 172.21.15.77:0/1105658587 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f136c159800 msgr2=0x7f136c14c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.861+0000 7f1373e7c640 1 --2- 172.21.15.77:0/1105658587 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f136c159800 0x7f136c14c6a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f136400c6c0 tx=0x7f136400cb80 comp rx=0 tx=0).stop 2023-11-04T01:40:25.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.861+0000 7f1373e7c640 1 -- 172.21.15.77:0/1105658587 shutdown_connections 2023-11-04T01:40:25.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.861+0000 7f1373e7c640 1 --2- 172.21.15.77:0/1105658587 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f135006aec0 0x7f135006d380 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.861+0000 7f1373e7c640 1 --2- 172.21.15.77:0/1105658587 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f136c159800 0x7f136c14c6a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.861+0000 7f1373e7c640 1 --2- 172.21.15.77:0/1105658587 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f136c0b1640 0x7f136c1f8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.861+0000 7f1373e7c640 1 --2- 172.21.15.77:0/1105658587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f136c072030 0x7f136c1f7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.861+0000 7f1373e7c640 1 -- 172.21.15.77:0/1105658587 >> 172.21.15.77:0/1105658587 conn(0x7f136c0cc100 msgr2=0x7f136c14e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.861+0000 7f1373e7c640 1 -- 172.21.15.77:0/1105658587 shutdown_connections 2023-11-04T01:40:25.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.861+0000 7f1373e7c640 1 -- 172.21.15.77:0/1105658587 wait complete. 2023-11-04T01:40:25.868 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.6 2023-11-04T01:40:25.871 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.0 2023-11-04T01:40:25.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.869+0000 7f336940e640 1 -- 172.21.15.77:0/3069816450 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f3364156b40 con 0x7f336415a070 2023-11-04T01:40:25.872 INFO:teuthology.orchestra.run.smithi077.stdout:55834574855 2023-11-04T01:40:25.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.870+0000 7f334b7fe640 1 -- 172.21.15.77:0/3069816450 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3364156b40 con 0x7f336415a070 2023-11-04T01:40:25.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.872+0000 7f4c5e6a2640 1 -- 172.21.15.77:0/3725068575 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4c58074290 con 0x7f4c580c4690 2023-11-04T01:40:25.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.872+0000 7f4c54ff9640 1 -- 172.21.15.77:0/3725068575 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4c50043090 con 0x7f4c580c4690 2023-11-04T01:40:25.874 INFO:teuthology.orchestra.run.smithi077.stdout:55834574856 2023-11-04T01:40:25.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.873+0000 7f336940e640 1 -- 172.21.15.77:0/3069816450 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f335006ae70 msgr2=0x7f335006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.873+0000 7f336940e640 1 --2- 172.21.15.77:0/3069816450 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f335006ae70 0x7f335006d330 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3358007c40 tx=0x7f3358007b90 comp rx=0 tx=0).stop 2023-11-04T01:40:25.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.873+0000 7f336940e640 1 -- 172.21.15.77:0/3069816450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f336415a070 msgr2=0x7f33640c4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.873+0000 7f336940e640 1 --2- 172.21.15.77:0/3069816450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f336415a070 0x7f33640c4620 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f335400c5c0 tx=0x7f335400ca80 comp rx=0 tx=0).stop 2023-11-04T01:40:25.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.873+0000 7f336940e640 1 -- 172.21.15.77:0/3069816450 shutdown_connections 2023-11-04T01:40:25.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.873+0000 7f336940e640 1 --2- 172.21.15.77:0/3069816450 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f335006ae70 0x7f335006d330 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.873+0000 7f336940e640 1 --2- 172.21.15.77:0/3069816450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f336415a070 0x7f33640c4620 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.873+0000 7f336940e640 1 --2- 172.21.15.77:0/3069816450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3364159060 0x7f33640c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.873+0000 7f336940e640 1 --2- 172.21.15.77:0/3069816450 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3364158c80 0x7f33641515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.873+0000 7f336940e640 1 -- 172.21.15.77:0/3069816450 >> 172.21.15.77:0/3069816450 conn(0x7f336406a120 msgr2=0x7f33641524d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.873+0000 7f336940e640 1 -- 172.21.15.77:0/3069816450 shutdown_connections 2023-11-04T01:40:25.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.873+0000 7f336940e640 1 -- 172.21.15.77:0/3069816450 wait complete. 2023-11-04T01:40:25.878 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.1 2023-11-04T01:40:25.879 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.4 2023-11-04T01:40:25.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.875+0000 7f4c5e6a2640 1 -- 172.21.15.77:0/3725068575 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4c4406ae70 msgr2=0x7f4c4406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.875+0000 7f4c5e6a2640 1 --2- 172.21.15.77:0/3725068575 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4c4406ae70 0x7f4c4406d330 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c0011e0 tx=0x7f4c4c009040 comp rx=0 tx=0).stop 2023-11-04T01:40:25.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.875+0000 7f4c5e6a2640 1 -- 172.21.15.77:0/3725068575 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c580c4690 msgr2=0x7f4c580c5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.875+0000 7f4c5e6a2640 1 --2- 172.21.15.77:0/3725068575 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c580c4690 0x7f4c580c5a20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4c50036040 tx=0x7f4c50004a40 comp rx=0 tx=0).stop 2023-11-04T01:40:25.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.875+0000 7f4c5e6a2640 1 -- 172.21.15.77:0/3725068575 shutdown_connections 2023-11-04T01:40:25.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.875+0000 7f4c5e6a2640 1 --2- 172.21.15.77:0/3725068575 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4c4406ae70 0x7f4c4406d330 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.875+0000 7f4c5e6a2640 1 --2- 172.21.15.77:0/3725068575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c58164760 0x7f4c580b3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.875+0000 7f4c5e6a2640 1 --2- 172.21.15.77:0/3725068575 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c580c4690 0x7f4c580c5a20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.875+0000 7f4c5e6a2640 1 --2- 172.21.15.77:0/3725068575 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4c58070710 0x7f4c58150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.875+0000 7f4c5e6a2640 1 -- 172.21.15.77:0/3725068575 >> 172.21.15.77:0/3725068575 conn(0x7f4c580ce950 msgr2=0x7f4c5815ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.875+0000 7f4c5e6a2640 1 -- 172.21.15.77:0/3725068575 shutdown_connections 2023-11-04T01:40:25.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.875+0000 7f4c5e6a2640 1 -- 172.21.15.77:0/3725068575 wait complete. 2023-11-04T01:40:25.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.882+0000 7f2d4496c640 1 -- 172.21.15.77:0/502775506 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f2d38005340 con 0x7f2d380e6800 2023-11-04T01:40:25.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.883+0000 7f2d2bfff640 1 -- 172.21.15.77:0/502775506 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2d2c039090 con 0x7f2d380e6800 2023-11-04T01:40:25.886 INFO:teuthology.orchestra.run.smithi077.stdout:55834574857 2023-11-04T01:40:25.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.886+0000 7f2d4496c640 1 -- 172.21.15.77:0/502775506 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2d2406ae70 msgr2=0x7f2d2406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.886+0000 7f2d4496c640 1 --2- 172.21.15.77:0/502775506 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2d2406ae70 0x7f2d2406d330 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2d34000c00 tx=0x7f2d340078f0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.886+0000 7f2d4496c640 1 -- 172.21.15.77:0/502775506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d380e6800 msgr2=0x7f2d380e7f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:25.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.886+0000 7f2d4496c640 1 --2- 172.21.15.77:0/502775506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d380e6800 0x7f2d380e7f00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2d3800df80 tx=0x7f2d2c004730 comp rx=0 tx=0).stop 2023-11-04T01:40:25.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.886+0000 7f2d4496c640 1 -- 172.21.15.77:0/502775506 shutdown_connections 2023-11-04T01:40:25.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.886+0000 7f2d4496c640 1 --2- 172.21.15.77:0/502775506 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2d2406ae70 0x7f2d2406d330 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.886+0000 7f2d4496c640 1 --2- 172.21.15.77:0/502775506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d380e6800 0x7f2d380e7f00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.886+0000 7f2d4496c640 1 --2- 172.21.15.77:0/502775506 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2d380e4d40 0x7f2d380e62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.886+0000 7f2d4496c640 1 --2- 172.21.15.77:0/502775506 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2d30005180 0x7f2d380ea840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:25.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.886+0000 7f2d4496c640 1 -- 172.21.15.77:0/502775506 >> 172.21.15.77:0/502775506 conn(0x7f2d38054b00 msgr2=0x7f2d38054ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:25.890 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.3 2023-11-04T01:40:25.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.886+0000 7f2d4496c640 1 -- 172.21.15.77:0/502775506 shutdown_connections 2023-11-04T01:40:25.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:25.886+0000 7f2d4496c640 1 -- 172.21.15.77:0/502775506 wait complete. 2023-11-04T01:40:25.892 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.7 2023-11-04T01:40:25.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.5 2023-11-04T01:40:26.863 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-04T01:40:26.870 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-04T01:40:26.871 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-04T01:40:26.879 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-04T01:40:26.880 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-04T01:40:26.892 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-04T01:40:26.892 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-04T01:40:26.899 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-04T01:40:27.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.026+0000 7f16affd7640 1 Processor -- start 2023-11-04T01:40:27.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.026+0000 7f16affd7640 1 -- start start 2023-11-04T01:40:27.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.027+0000 7f16affd7640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f16a806d480 0x7f16a806b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.027+0000 7f16affd7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a806b170 con 0x7f16a815ce30 2023-11-04T01:40:27.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.027+0000 7f16affd7640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a81596a0 con 0x7f16a81592c0 2023-11-04T01:40:27.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.027+0000 7f16affd7640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a815de20 con 0x7f16a806d480 2023-11-04T01:40:27.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.028+0000 7f16ae574640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f16a815ce30 0x7f16a815d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52692/0 (socket says 172.21.15.77:52692) 2023-11-04T01:40:27.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.028+0000 7f16ae574640 1 -- 172.21.15.77:0/4144697397 learned_addr learned my addr 172.21.15.77:0/4144697397 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:27.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.028+0000 7f16ad572640 1 --2- 172.21.15.77:0/4144697397 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f16a806d480 0x7f16a806b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.028+0000 7f16ad572640 1 -- 172.21.15.77:0/4144697397 >> v1:172.21.15.122:6789/0 conn(0x7f16a81592c0 legacy=0x7f16a806cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:27.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.028+0000 7f16ad572640 1 -- 172.21.15.77:0/4144697397 >> v1:172.21.15.77:6789/0 conn(0x7f16a815ce30 legacy=0x7f16a815d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.028+0000 7f16ad572640 1 -- 172.21.15.77:0/4144697397 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a815db40 con 0x7f16a806d480 2023-11-04T01:40:27.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.030+0000 7f16ad572640 1 --2- 172.21.15.77:0/4144697397 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f16a806d480 0x7f16a806b600 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f16a400bad0 tx=0x7f16a402feb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae7564f0809acac server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.030+0000 7f16acd71640 1 -- 172.21.15.77:0/4144697397 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a4030be0 con 0x7f16a806d480 2023-11-04T01:40:27.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.030+0000 7f16acd71640 1 -- 172.21.15.77:0/4144697397 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a4034070 con 0x7f16a806d480 2023-11-04T01:40:27.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.031+0000 7f16affd7640 1 -- 172.21.15.77:0/4144697397 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f16a806d480 msgr2=0x7f16a806b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.031+0000 7f16affd7640 1 --2- 172.21.15.77:0/4144697397 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f16a806d480 0x7f16a806b600 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f16a400bad0 tx=0x7f16a402feb0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.032+0000 7f16affd7640 1 -- 172.21.15.77:0/4144697397 shutdown_connections 2023-11-04T01:40:27.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.032+0000 7f16affd7640 1 --2- 172.21.15.77:0/4144697397 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f16a806d480 0x7f16a806b600 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.032+0000 7f16affd7640 1 -- 172.21.15.77:0/4144697397 >> 172.21.15.77:0/4144697397 conn(0x7f16a80cf140 msgr2=0x7f16a80cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:27.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.032+0000 7f16affd7640 1 -- 172.21.15.77:0/4144697397 shutdown_connections 2023-11-04T01:40:27.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.032+0000 7f16affd7640 1 -- 172.21.15.77:0/4144697397 wait complete. 2023-11-04T01:40:27.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.034+0000 7f16affd7640 1 Processor -- start 2023-11-04T01:40:27.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.034+0000 7f16affd7640 1 -- start start 2023-11-04T01:40:27.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.035+0000 7f16affd7640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f16a806d480 0x7f16a80b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.035+0000 7f16affd7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f16a81592c0 0x7f16a80c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.035+0000 7f16affd7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16a815ce30 0x7f16a8089310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.035+0000 7f16affd7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a815ab40 con 0x7f16a815ce30 2023-11-04T01:40:27.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.035+0000 7f16affd7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a80c38b0 con 0x7f16a81592c0 2023-11-04T01:40:27.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.035+0000 7f16affd7640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a80c3b90 con 0x7f16a806d480 2023-11-04T01:40:27.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.035+0000 7f16add73640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f16a806d480 0x7f16a80b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.035+0000 7f16add73640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f16a806d480 0x7f16a80b41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:53666/0 (socket says 172.21.15.77:53666) 2023-11-04T01:40:27.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.036+0000 7f16add73640 1 -- 172.21.15.77:0/2400006740 learned_addr learned my addr 172.21.15.77:0/2400006740 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:27.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.036+0000 7f16ad572640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f16a81592c0 0x7f16a80c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.036+0000 7f16ae574640 1 --2- 172.21.15.77:0/2400006740 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16a815ce30 0x7f16a8089310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.036+0000 7f16ae574640 1 -- 172.21.15.77:0/2400006740 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f16a806d480 msgr2=0x7f16a80b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.036+0000 7f16ae574640 1 --2- 172.21.15.77:0/2400006740 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f16a806d480 0x7f16a80b41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.036+0000 7f16ae574640 1 -- 172.21.15.77:0/2400006740 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f16a81592c0 msgr2=0x7f16a80c2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.036+0000 7f16ae574640 1 --2- 172.21.15.77:0/2400006740 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f16a81592c0 0x7f16a80c2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.036+0000 7f16ae574640 1 -- 172.21.15.77:0/2400006740 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a400b6a0 con 0x7f16a815ce30 2023-11-04T01:40:27.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.036+0000 7f16ae574640 1 --2- 172.21.15.77:0/2400006740 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16a815ce30 0x7f16a8089310 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f16a0012f80 tx=0x7f16a00144e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.038+0000 7f169e7fc640 1 -- 172.21.15.77:0/2400006740 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a0004b60 con 0x7f16a815ce30 2023-11-04T01:40:27.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.038+0000 7f16affd7640 1 -- 172.21.15.77:0/2400006740 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a80c3e70 con 0x7f16a815ce30 2023-11-04T01:40:27.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.038+0000 7f16affd7640 1 -- 172.21.15.77:0/2400006740 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a80b4700 con 0x7f16a815ce30 2023-11-04T01:40:27.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.042+0000 7f169e7fc640 1 -- 172.21.15.77:0/2400006740 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a0004cc0 con 0x7f16a815ce30 2023-11-04T01:40:27.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.043+0000 7f169e7fc640 1 -- 172.21.15.77:0/2400006740 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a00122b0 con 0x7f16a815ce30 2023-11-04T01:40:27.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.043+0000 7f169e7fc640 1 -- 172.21.15.77:0/2400006740 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f16a00124d0 con 0x7f16a815ce30 2023-11-04T01:40:27.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.044+0000 7f169e7fc640 1 --2- 172.21.15.77:0/2400006740 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f168c06afc0 0x7f168c06d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.044+0000 7f169e7fc640 1 -- 172.21.15.77:0/2400006740 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f16a009a310 con 0x7f16a815ce30 2023-11-04T01:40:27.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.044+0000 7f16add73640 1 --2- 172.21.15.77:0/2400006740 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f168c06afc0 0x7f168c06d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.045+0000 7f16affd7640 1 -- 172.21.15.77:0/2400006740 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1690005250 con 0x7f16a815ce30 2023-11-04T01:40:27.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.054+0000 7f169e7fc640 1 -- 172.21.15.77:0/2400006740 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f16a00651f0 con 0x7f16a815ce30 2023-11-04T01:40:27.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.062+0000 7f16add73640 1 --2- 172.21.15.77:0/2400006740 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f168c06afc0 0x7f168c06d480 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1698005020 tx=0x7f1698007ef0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.079+0000 7fcbd309a640 1 Processor -- start 2023-11-04T01:40:27.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.079+0000 7f51826a2640 1 Processor -- start 2023-11-04T01:40:27.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.079+0000 7fcbd309a640 1 -- start start 2023-11-04T01:40:27.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.079+0000 7f51826a2640 1 -- start start 2023-11-04T01:40:27.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.081+0000 7f51826a2640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f517c0adfd0 0x7f517c0afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.081+0000 7f51826a2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f517c0b0030 0x7f517c0c91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.081+0000 7f51826a2640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f517c0b13f0 con 0x7f517c158c50 2023-11-04T01:40:27.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.081+0000 7f51826a2640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f517c0b0870 con 0x7f517c0adfd0 2023-11-04T01:40:27.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.081+0000 7f51826a2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f517c0b0b50 con 0x7f517c0b0030 2023-11-04T01:40:27.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.081+0000 7f517bfff640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f517c158c50 0x7f517c0ad8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:55734/0 (socket says 172.21.15.77:55734) 2023-11-04T01:40:27.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.081+0000 7f517bfff640 1 -- 172.21.15.77:0/4133043108 learned_addr learned my addr 172.21.15.77:0/4133043108 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:27.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.081+0000 7fcbd309a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcbcc0afc40 0x7fcbcc0b1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.081+0000 7fcbd309a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbcc0b3f40 con 0x7fcbcc15ae00 2023-11-04T01:40:27.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.081+0000 7fcbd309a640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbcc0710a0 con 0x7fcbcc0cb120 2023-11-04T01:40:27.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.081+0000 7fcbd309a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbcc071380 con 0x7fcbcc0afc40 2023-11-04T01:40:27.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.081+0000 7fcbd2098640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fcbcc0cb120 0x7fcbcc0cb500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:55730/0 (socket says 172.21.15.77:55730) 2023-11-04T01:40:27.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.081+0000 7fcbd2098640 1 -- 172.21.15.77:0/2583701122 learned_addr learned my addr 172.21.15.77:0/2583701122 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:27.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.081+0000 7fcbd2899640 1 --2- 172.21.15.77:0/2583701122 >> v2:172.21.15.77:3300/0 conn(0x7fcbcc0afc40 0x7fcbcc0b1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.081+0000 7fcbd1096640 1 -- 172.21.15.77:0/2583701122 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 244198054 0 0) 0x7fcbcc0710a0 con 0x7fcbcc0cb120 2023-11-04T01:40:27.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.081+0000 7fcbd1096640 1 -- 172.21.15.77:0/2583701122 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbb8003520 con 0x7fcbcc0cb120 2023-11-04T01:40:27.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.082+0000 7fcbd2899640 1 -- 172.21.15.77:0/2583701122 >> v1:172.21.15.122:6789/0 conn(0x7fcbcc0cb120 legacy=0x7fcbcc0cb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.082+0000 7fcbd2899640 1 -- 172.21.15.77:0/2583701122 >> v1:172.21.15.77:6789/0 conn(0x7fcbcc15ae00 legacy=0x7fcbcc06c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.082+0000 7fcbd1096640 1 -- 172.21.15.77:0/2583701122 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3974613299 0 0) 0x7fcbcc0b3f40 con 0x7fcbcc15ae00 2023-11-04T01:40:27.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.082+0000 7fcbd2899640 1 -- 172.21.15.77:0/2583701122 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbcc0b3bd0 con 0x7fcbcc0afc40 2023-11-04T01:40:27.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.082+0000 7ff78eb1d640 1 Processor -- start 2023-11-04T01:40:27.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.081+0000 7fd91dae1640 1 Processor -- start 2023-11-04T01:40:27.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.081+0000 7fd91dae1640 1 -- start start 2023-11-04T01:40:27.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.082+0000 7fd91dae1640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd91815add0 0x7fd9180cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.082+0000 7fd91dae1640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9180b1cc0 con 0x7fd918071f90 2023-11-04T01:40:27.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.082+0000 7fd91dae1640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd91815a2f0 con 0x7fd918072370 2023-11-04T01:40:27.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.082+0000 7fd91dae1640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9180b1fa0 con 0x7fd91815add0 2023-11-04T01:40:27.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.082+0000 7fd9177fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd918071f90 0x7fd9180b1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52714/0 (socket says 172.21.15.77:52714) 2023-11-04T01:40:27.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.082+0000 7fd9177fe640 1 -- 172.21.15.77:0/293935498 learned_addr learned my addr 172.21.15.77:0/293935498 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:27.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.082+0000 7fd916ffd640 1 --2- 172.21.15.77:0/293935498 >> v2:172.21.15.77:3300/0 conn(0x7fd91815add0 0x7fd9180cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.082+0000 7f517affd640 1 -- 172.21.15.77:0/4133043108 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1605909408 0 0) 0x7f517c0b13f0 con 0x7f517c158c50 2023-11-04T01:40:27.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.082+0000 7f517affd640 1 -- 172.21.15.77:0/4133043108 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5164003520 con 0x7f517c158c50 2023-11-04T01:40:27.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.082+0000 7f517b7fe640 1 --2- 172.21.15.77:0/4133043108 >> v2:172.21.15.122:3300/0 conn(0x7f517c0adfd0 0x7f517c0afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.083+0000 7f5180c3f640 1 --2- 172.21.15.77:0/4133043108 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f517c0b0030 0x7f517c0c91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.083+0000 7f517affd640 1 -- 172.21.15.77:0/4133043108 <== mon.1 v1:172.21.15.122:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2764658202 0 0) 0x7f5164003520 con 0x7f517c158c50 2023-11-04T01:40:27.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.083+0000 7f517affd640 1 -- 172.21.15.77:0/4133043108 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f517c0b0030 msgr2=0x7f517c0c91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:27.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.083+0000 7f517affd640 1 --2- 172.21.15.77:0/4133043108 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f517c0b0030 0x7f517c0c91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.083+0000 7f517affd640 1 -- 172.21.15.77:0/4133043108 >> v2:172.21.15.122:3300/0 conn(0x7f517c0adfd0 msgr2=0x7f517c0afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:27.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.083+0000 7f517affd640 1 --2- 172.21.15.77:0/4133043108 >> v2:172.21.15.122:3300/0 conn(0x7f517c0adfd0 0x7f517c0afaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.083+0000 7f517affd640 1 -- 172.21.15.77:0/4133043108 --> v1:172.21.15.122:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517c0b0e30 con 0x7f517c158c50 2023-11-04T01:40:27.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.083+0000 7f517affd640 1 -- 172.21.15.77:0/4133043108 <== mon.1 v1:172.21.15.122:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f51740019f0 con 0x7f517c158c50 2023-11-04T01:40:27.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.083+0000 7f517affd640 1 -- 172.21.15.77:0/4133043108 >> v1:172.21.15.122:6789/0 conn(0x7f517c158c50 legacy=0x7f517c0ad8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.082+0000 7ff78eb1d640 1 -- start start 2023-11-04T01:40:27.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.083+0000 7ff78eb1d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff788161310 0x7ff7880b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.083+0000 7ff78eb1d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff7880b48a0 0x7ff7880b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.083+0000 7ff78eb1d640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7880b5230 con 0x7ff7880d2900 2023-11-04T01:40:27.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.083+0000 7ff78eb1d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7880d0a90 con 0x7ff7880b48a0 2023-11-04T01:40:27.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.083+0000 7ff78eb1d640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7881657e0 con 0x7ff788161310 2023-11-04T01:40:27.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.083+0000 7f517affd640 1 --2- 172.21.15.77:0/4133043108 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5164003970 0x7f5164003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.083+0000 7ff78d0ba640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff7880b48a0 0x7ff7880b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.083+0000 7ff78d0ba640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff7880b48a0 0x7ff7880b4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57088/0 (socket says 172.21.15.77:57088) 2023-11-04T01:40:27.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.083+0000 7ff78d0ba640 1 -- 172.21.15.77:0/971231428 learned_addr learned my addr 172.21.15.77:0/971231428 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:27.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.083+0000 7f517affd640 1 --2- 172.21.15.77:0/4133043108 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5164004360 0x7f5164004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.083+0000 7f517affd640 1 --2- 172.21.15.77:0/4133043108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5164004f50 0x7f516400fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.083+0000 7f517affd640 1 -- 172.21.15.77:0/4133043108 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517c0b0870 con 0x7f5164004360 2023-11-04T01:40:27.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.083+0000 7f517affd640 1 -- 172.21.15.77:0/4133043108 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517c0b0b50 con 0x7f5164004f50 2023-11-04T01:40:27.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.083+0000 7f517affd640 1 -- 172.21.15.77:0/4133043108 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5164010300 con 0x7f5164003970 2023-11-04T01:40:27.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.083+0000 7f517bfff640 1 --2- 172.21.15.77:0/4133043108 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5164003970 0x7f5164003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.084+0000 7f5180c3f640 1 --2- 172.21.15.77:0/4133043108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5164004f50 0x7f516400fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.084+0000 7f517b7fe640 1 --2- 172.21.15.77:0/4133043108 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5164004360 0x7f5164004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.083+0000 7fcbd2899640 1 --2- 172.21.15.77:0/2583701122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbcc0afc40 0x7fcbcc0b1fd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc0097a0 tx=0x7fcbbc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e7ec0b20d7ef47 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.084+0000 7fcbd1096640 1 -- 172.21.15.77:0/2583701122 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc030610 con 0x7fcbcc0afc40 2023-11-04T01:40:27.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.084+0000 7fcbd1096640 1 -- 172.21.15.77:0/2583701122 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbbc030770 con 0x7fcbcc0afc40 2023-11-04T01:40:27.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.084+0000 7fcbd1096640 1 -- 172.21.15.77:0/2583701122 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc030b00 con 0x7fcbcc0afc40 2023-11-04T01:40:27.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.084+0000 7f517bfff640 1 -- 172.21.15.77:0/4133043108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5164004f50 msgr2=0x7f516400fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:27.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.084+0000 7f517bfff640 1 --2- 172.21.15.77:0/4133043108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5164004f50 0x7f516400fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.084+0000 7f517bfff640 1 -- 172.21.15.77:0/4133043108 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5164004360 msgr2=0x7f5164004840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:27.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.084+0000 7f517bfff640 1 --2- 172.21.15.77:0/4133043108 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5164004360 0x7f5164004840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.084+0000 7f517bfff640 1 -- 172.21.15.77:0/4133043108 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517c0b0e30 con 0x7f5164003970 2023-11-04T01:40:27.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.083+0000 7fd916ffd640 1 -- 172.21.15.77:0/293935498 >> v1:172.21.15.122:6789/0 conn(0x7fd918072370 legacy=0x7fd9180cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.083+0000 7fd916ffd640 1 -- 172.21.15.77:0/293935498 >> v1:172.21.15.77:6789/0 conn(0x7fd918071f90 legacy=0x7fd9180b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.083+0000 7fd916ffd640 1 -- 172.21.15.77:0/293935498 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91815a5d0 con 0x7fd91815add0 2023-11-04T01:40:27.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.084+0000 7fd916ffd640 1 --2- 172.21.15.77:0/293935498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd91815add0 0x7fd9180cecc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd9080097a0 tx=0x7fd90802d810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ccff8a6c05bf63 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.084+0000 7f546618a640 1 Processor -- start 2023-11-04T01:40:27.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.084+0000 7f546618a640 1 -- start start 2023-11-04T01:40:27.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.084+0000 7fd9167fc640 1 -- 172.21.15.77:0/293935498 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9080336f0 con 0x7fd91815add0 2023-11-04T01:40:27.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.084+0000 7fd9167fc640 1 -- 172.21.15.77:0/293935498 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd908033850 con 0x7fd91815add0 2023-11-04T01:40:27.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.085+0000 7fcbd309a640 1 -- 172.21.15.77:0/2583701122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbcc0afc40 msgr2=0x7fcbcc0b1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.085+0000 7fcbd309a640 1 --2- 172.21.15.77:0/2583701122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbcc0afc40 0x7fcbcc0b1fd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc0097a0 tx=0x7fcbbc02b960 comp rx=0 tx=0).stop 2023-11-04T01:40:27.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.084+0000 7ff78d0ba640 1 -- 172.21.15.77:0/971231428 >> v2:172.21.15.122:3300/0 conn(0x7ff788161310 msgr2=0x7ff7880b5c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:40:27.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.084+0000 7ff78d0ba640 1 --2- 172.21.15.77:0/971231428 >> v2:172.21.15.122:3300/0 conn(0x7ff788161310 0x7ff7880b5c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.084+0000 7ff78d0ba640 1 -- 172.21.15.77:0/971231428 >> v1:172.21.15.122:6789/0 conn(0x7ff7880d2900 legacy=0x7ff788164f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.084+0000 7ff78d0ba640 1 -- 172.21.15.77:0/971231428 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff788165ac0 con 0x7ff7880b48a0 2023-11-04T01:40:27.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.085+0000 7f517bfff640 1 --2- 172.21.15.77:0/4133043108 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5164003970 0x7f5164003d90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f51740158f0 tx=0x7f51640057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8c7b2b83a32b99 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.085+0000 7fcbd309a640 1 -- 172.21.15.77:0/2583701122 shutdown_connections 2023-11-04T01:40:27.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.085+0000 7fcbd309a640 1 --2- 172.21.15.77:0/2583701122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbcc0afc40 0x7fcbcc0b1fd0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.085+0000 7fcbd309a640 1 -- 172.21.15.77:0/2583701122 >> 172.21.15.77:0/2583701122 conn(0x7fcbcc06a120 msgr2=0x7fcbcc06a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:27.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.085+0000 7fd9167fc640 1 -- 172.21.15.77:0/293935498 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd908033be0 con 0x7fd91815add0 2023-11-04T01:40:27.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.085+0000 7fcbd309a640 1 -- 172.21.15.77:0/2583701122 shutdown_connections 2023-11-04T01:40:27.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.085+0000 7fcbd309a640 1 -- 172.21.15.77:0/2583701122 wait complete. 2023-11-04T01:40:27.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.085+0000 7ff78d0ba640 1 --2- 172.21.15.77:0/971231428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7880b48a0 0x7ff7880b4cf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff7880cf800 tx=0x7ff78002bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be1e44e07213cfb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.085+0000 7fd91dae1640 1 -- 172.21.15.77:0/293935498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd91815add0 msgr2=0x7fd9180cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.085+0000 7fd91dae1640 1 --2- 172.21.15.77:0/293935498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd91815add0 0x7fd9180cecc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd9080097a0 tx=0x7fd90802d810 comp rx=0 tx=0).stop 2023-11-04T01:40:27.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.086+0000 7f546618a640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54600ccc00 0x7f546015acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.086+0000 7ff7877fe640 1 -- 172.21.15.77:0/971231428 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78002cb50 con 0x7ff7880b48a0 2023-11-04T01:40:27.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.085+0000 7f517affd640 1 -- 172.21.15.77:0/4133043108 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5174008270 con 0x7f5164003970 2023-11-04T01:40:27.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.085+0000 7f517affd640 1 -- 172.21.15.77:0/4133043108 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51740364f0 con 0x7f5164003970 2023-11-04T01:40:27.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.085+0000 7f517affd640 1 -- 172.21.15.77:0/4133043108 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51740368e0 con 0x7f5164003970 2023-11-04T01:40:27.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.086+0000 7ff7877fe640 1 -- 172.21.15.77:0/971231428 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78002ccb0 con 0x7ff7880b48a0 2023-11-04T01:40:27.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.086+0000 7ff7877fe640 1 -- 172.21.15.77:0/971231428 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff780034610 con 0x7ff7880b48a0 2023-11-04T01:40:27.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.086+0000 7f546618a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f546015b760 con 0x7f546015b230 2023-11-04T01:40:27.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.086+0000 7f545effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54600ccc00 0x7f546015acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.086+0000 7f545effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54600ccc00 0x7f546015acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:53706/0 (socket says 172.21.15.77:53706) 2023-11-04T01:40:27.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.086+0000 7f545effd640 1 -- 172.21.15.77:0/444782635 learned_addr learned my addr 172.21.15.77:0/444782635 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:27.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.086+0000 7f546618a640 1 -- 172.21.15.77:0/444782635 --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f546015ba40 con 0x7f54600cb600 2023-11-04T01:40:27.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.086+0000 7f99a24ea640 1 Processor -- start 2023-11-04T01:40:27.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.086+0000 7f546618a640 1 -- 172.21.15.77:0/444782635 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f546015c000 con 0x7f54600ccc00 2023-11-04T01:40:27.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.086+0000 7f51826a2640 1 -- 172.21.15.77:0/4133043108 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5164003970 msgr2=0x7f5164003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.086+0000 7fd91dae1640 1 -- 172.21.15.77:0/293935498 shutdown_connections 2023-11-04T01:40:27.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.086+0000 7fd91dae1640 1 --2- 172.21.15.77:0/293935498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd91815add0 0x7fd9180cecc0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.086+0000 7fd91dae1640 1 -- 172.21.15.77:0/293935498 >> 172.21.15.77:0/293935498 conn(0x7fd91806d800 msgr2=0x7fd91806dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:27.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.086+0000 7f51826a2640 1 --2- 172.21.15.77:0/4133043108 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5164003970 0x7f5164003d90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f51740158f0 tx=0x7f51640057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.086+0000 7fd91dae1640 1 -- 172.21.15.77:0/293935498 shutdown_connections 2023-11-04T01:40:27.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.086+0000 7fd91dae1640 1 -- 172.21.15.77:0/293935498 wait complete. 2023-11-04T01:40:27.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.087+0000 7f545effd640 1 -- 172.21.15.77:0/444782635 >> v1:172.21.15.122:6789/0 conn(0x7f54600cb600 legacy=0x7f54600cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.086+0000 7f99a24ea640 1 -- start start 2023-11-04T01:40:27.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.087+0000 7ff78eb1d640 1 -- 172.21.15.77:0/971231428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7880b48a0 msgr2=0x7ff7880b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.087+0000 7ff78eb1d640 1 --2- 172.21.15.77:0/971231428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7880b48a0 0x7ff7880b4cf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff7880cf800 tx=0x7ff78002bfb0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.087+0000 7ff78eb1d640 1 -- 172.21.15.77:0/971231428 shutdown_connections 2023-11-04T01:40:27.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.087+0000 7ff78eb1d640 1 --2- 172.21.15.77:0/971231428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7880b48a0 0x7ff7880b4cf0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.087+0000 7ff78eb1d640 1 --2- 172.21.15.77:0/971231428 >> v2:172.21.15.122:3300/0 conn(0x7ff788161310 0x7ff7880b5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.087+0000 7ff78eb1d640 1 -- 172.21.15.77:0/971231428 >> 172.21.15.77:0/971231428 conn(0x7ff7880cf8a0 msgr2=0x7ff7880cfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:27.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.087+0000 7f545effd640 1 -- 172.21.15.77:0/444782635 >> v1:172.21.15.77:6789/0 conn(0x7f546015b230 legacy=0x7f54600af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.087+0000 7ff78eb1d640 1 -- 172.21.15.77:0/971231428 shutdown_connections 2023-11-04T01:40:27.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.087+0000 7ff78eb1d640 1 -- 172.21.15.77:0/971231428 wait complete. 2023-11-04T01:40:27.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.085+0000 7f9ffca10640 1 Processor -- start 2023-11-04T01:40:27.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.085+0000 7f9ffca10640 1 -- start start 2023-11-04T01:40:27.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.086+0000 7f9ffca10640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9ff8089750 0x7f9ff816de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.086+0000 7f9ffca10640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff80ccbe0 con 0x7f9ff80892f0 2023-11-04T01:40:27.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.087+0000 7f545effd640 1 -- 172.21.15.77:0/444782635 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f546015bd20 con 0x7f54600ccc00 2023-11-04T01:40:27.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.088+0000 7f99a24ea640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f99940e77a0 0x7f999404f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.088+0000 7f99a24ea640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f99940eb1b0 0x7f99940eb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.088+0000 7f545effd640 1 --2- 172.21.15.77:0/444782635 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54600ccc00 0x7f546015acf0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f54540098a0 tx=0x7f545402b620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=348cc441391ef8a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.088+0000 7f545e7fc640 1 -- 172.21.15.77:0/444782635 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5454030710 con 0x7f54600ccc00 2023-11-04T01:40:27.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.088+0000 7f99a24ea640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9994050230 con 0x7f9994052ed0 2023-11-04T01:40:27.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.088+0000 7f99a24ea640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9994006370 con 0x7f99940e77a0 2023-11-04T01:40:27.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.088+0000 7f99a24ea640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99940ebb30 con 0x7f99940eb1b0 2023-11-04T01:40:27.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.088+0000 7f99a14e8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f99940e77a0 0x7f999404f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.088+0000 7f99a14e8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f99940e77a0 0x7f999404f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57098/0 (socket says 172.21.15.77:57098) 2023-11-04T01:40:27.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.088+0000 7f99a14e8640 1 -- 172.21.15.77:0/2718802790 learned_addr learned my addr 172.21.15.77:0/2718802790 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:27.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.088+0000 7f99a0ce7640 1 --2- 172.21.15.77:0/2718802790 >> v2:172.21.15.122:3300/0 conn(0x7f99940eb1b0 0x7f99940eb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.088+0000 7f545e7fc640 1 -- 172.21.15.77:0/444782635 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545402e050 con 0x7f54600ccc00 2023-11-04T01:40:27.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.088+0000 7f545e7fc640 1 -- 172.21.15.77:0/444782635 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5454030a90 con 0x7f54600ccc00 2023-11-04T01:40:27.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.088+0000 7f9993fff640 1 -- 172.21.15.77:0/2718802790 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1891153632 0 0) 0x7f9994050230 con 0x7f9994052ed0 2023-11-04T01:40:27.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.089+0000 7ff78eb1d640 1 Processor -- start 2023-11-04T01:40:27.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.089+0000 7ff78eb1d640 1 -- start start 2023-11-04T01:40:27.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.086+0000 7f9ffca10640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff80caec0 con 0x7f9ff8169ae0 2023-11-04T01:40:27.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.086+0000 7f9ffca10640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff80af610 con 0x7f9ff8089750 2023-11-04T01:40:27.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.086+0000 7f9ff6d9d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9ff8089750 0x7f9ff816de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.086+0000 7f9ff6d9d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9ff8089750 0x7f9ff816de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:40770/0 (socket says 172.21.15.77:40770) 2023-11-04T01:40:27.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.086+0000 7f9ff6d9d640 1 -- 172.21.15.77:0/2504198713 learned_addr learned my addr 172.21.15.77:0/2504198713 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:27.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.087+0000 7f9ff559a640 1 -- 172.21.15.77:0/2504198713 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 184121370 0 0) 0x7f9ff80caec0 con 0x7f9ff8169ae0 2023-11-04T01:40:27.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.087+0000 7f9ff559a640 1 -- 172.21.15.77:0/2504198713 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fe0003500 con 0x7f9ff8169ae0 2023-11-04T01:40:27.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.087+0000 7f9ff559a640 1 -- 172.21.15.77:0/2504198713 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1157404770 0 0) 0x7f9ff80ccbe0 con 0x7f9ff80892f0 2023-11-04T01:40:27.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.087+0000 7f9ff559a640 1 -- 172.21.15.77:0/2504198713 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ff80caec0 con 0x7f9ff80892f0 2023-11-04T01:40:27.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.087+0000 7f9ff559a640 1 -- 172.21.15.77:0/2504198713 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 957926849 0 0) 0x7f9ff80caec0 con 0x7f9ff80892f0 2023-11-04T01:40:27.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.087+0000 7f9ff559a640 1 -- 172.21.15.77:0/2504198713 >> v2:172.21.15.122:3300/0 conn(0x7f9ff8089750 msgr2=0x7f9ff816de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:27.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.087+0000 7f9ff559a640 1 --2- 172.21.15.77:0/2504198713 >> v2:172.21.15.122:3300/0 conn(0x7f9ff8089750 0x7f9ff816de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.087+0000 7f9ff559a640 1 -- 172.21.15.77:0/2504198713 >> v1:172.21.15.122:6789/0 conn(0x7f9ff8169ae0 legacy=0x7f9ff80ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.087+0000 7f9ff559a640 1 -- 172.21.15.77:0/2504198713 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff80cb350 con 0x7f9ff80892f0 2023-11-04T01:40:27.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.088+0000 7f9ff559a640 1 -- 172.21.15.77:0/2504198713 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f9fec0015a0 con 0x7f9ff80892f0 2023-11-04T01:40:27.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.088+0000 7f9ff559a640 1 -- 172.21.15.77:0/2504198713 >> v1:172.21.15.77:6789/0 conn(0x7f9ff80892f0 legacy=0x7f9ff816d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.088+0000 7f9ff559a640 1 --2- 172.21.15.77:0/2504198713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fe0003cd0 0x7f9fe00040b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.088+0000 7f9ff559a640 1 --2- 172.21.15.77:0/2504198713 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fe00046b0 0x7f9fe0008e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.088+0000 7f9ff559a640 1 --2- 172.21.15.77:0/2504198713 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9fe0009340 0x7f9fe000b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.089+0000 7f5180c3f640 1 -- 172.21.15.77:0/4133043108 reap_dead start 2023-11-04T01:40:27.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.089+0000 7f51826a2640 1 -- 172.21.15.77:0/4133043108 shutdown_connections 2023-11-04T01:40:27.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.089+0000 7f51826a2640 1 -- 172.21.15.77:0/4133043108 >> 172.21.15.77:0/4133043108 conn(0x7f517c06c7a0 msgr2=0x7f517c06cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:27.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.089+0000 7f9ff659c640 1 --2- 172.21.15.77:0/2504198713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fe0003cd0 0x7f9fe00040b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.089+0000 7f9ff559a640 1 -- 172.21.15.77:0/2504198713 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff80af610 con 0x7f9fe0003cd0 2023-11-04T01:40:27.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.089+0000 7f9ff559a640 1 -- 172.21.15.77:0/2504198713 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe000c020 con 0x7f9fe00046b0 2023-11-04T01:40:27.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.089+0000 7f9ff559a640 1 -- 172.21.15.77:0/2504198713 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe000c1e0 con 0x7f9fe0009340 2023-11-04T01:40:27.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.089+0000 7f9ff6d9d640 1 --2- 172.21.15.77:0/2504198713 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9fe0009340 0x7f9fe000b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.089+0000 7f546618a640 1 -- 172.21.15.77:0/444782635 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54600ccc00 msgr2=0x7f546015acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.089+0000 7f546618a640 1 --2- 172.21.15.77:0/444782635 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54600ccc00 0x7f546015acf0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f54540098a0 tx=0x7f545402b620 comp rx=0 tx=0).stop 2023-11-04T01:40:27.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.089+0000 7f546618a640 1 -- 172.21.15.77:0/444782635 shutdown_connections 2023-11-04T01:40:27.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.089+0000 7f546618a640 1 --2- 172.21.15.77:0/444782635 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54600ccc00 0x7f546015acf0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.089+0000 7f546618a640 1 -- 172.21.15.77:0/444782635 >> 172.21.15.77:0/444782635 conn(0x7f5460098bb0 msgr2=0x7f54600cf810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:27.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.089+0000 7f9ff659c640 1 -- 172.21.15.77:0/2504198713 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9fe0009340 msgr2=0x7f9fe000b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:27.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.089+0000 7f9ff659c640 1 --2- 172.21.15.77:0/2504198713 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9fe0009340 0x7f9fe000b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.089+0000 7f9ff659c640 1 -- 172.21.15.77:0/2504198713 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fe00046b0 msgr2=0x7f9fe0008e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:27.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.089+0000 7f9ff659c640 1 --2- 172.21.15.77:0/2504198713 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fe00046b0 0x7f9fe0008e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.089+0000 7f9ff659c640 1 -- 172.21.15.77:0/2504198713 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff80caec0 con 0x7f9fe0003cd0 2023-11-04T01:40:27.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7f546618a640 1 -- 172.21.15.77:0/444782635 shutdown_connections 2023-11-04T01:40:27.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.088+0000 7f99a0ce7640 1 -- 172.21.15.77:0/2718802790 >> v2:172.21.15.77:3300/0 conn(0x7f99940e77a0 msgr2=0x7f999404f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:27.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.088+0000 7f99a0ce7640 1 --2- 172.21.15.77:0/2718802790 >> v2:172.21.15.77:3300/0 conn(0x7f99940e77a0 0x7f999404f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.088+0000 7f99a0ce7640 1 -- 172.21.15.77:0/2718802790 >> v1:172.21.15.122:6789/0 conn(0x7f9994052ed0 legacy=0x7f9994053360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.088+0000 7f99a0ce7640 1 -- 172.21.15.77:0/2718802790 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9994007810 con 0x7f99940eb1b0 2023-11-04T01:40:27.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.089+0000 7f99a14e8640 1 --2- 172.21.15.77:0/2718802790 >> v2:172.21.15.77:3300/0 conn(0x7f99940e77a0 0x7f999404f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:27.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7f546618a640 1 -- 172.21.15.77:0/444782635 wait complete. 2023-11-04T01:40:27.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.088+0000 7fd91dae1640 1 Processor -- start 2023-11-04T01:40:27.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.089+0000 7fd91dae1640 1 -- start start 2023-11-04T01:40:27.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7f51826a2640 1 -- 172.21.15.77:0/4133043108 shutdown_connections 2023-11-04T01:40:27.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7fd91dae1640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd918071f90 0x7fd9180b1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7f99a0ce7640 1 --2- 172.21.15.77:0/2718802790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99940eb1b0 0x7f99940eb5f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f999c000b60 tx=0x7f999c0a6160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93ed9190542b688d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7ff78eb1d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7880b48a0 0x7ff788162280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.088+0000 7fcbd309a640 1 Processor -- start 2023-11-04T01:40:27.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.089+0000 7fcbd309a640 1 -- start start 2023-11-04T01:40:27.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7fcbd309a640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcbcc0afc40 0x7fcbcc157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7fcbd309a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbcc0cb120 0x7fcbcc0c6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7fcbd2098640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcbcc0afc40 0x7fcbcc157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7fcbd2098640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcbcc0afc40 0x7fcbcc157790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:53720/0 (socket says 172.21.15.77:53720) 2023-11-04T01:40:27.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7fcbd309a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbcc15ae00 0x7fcbcc14d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7fcbd2098640 1 -- 172.21.15.77:0/1025773238 learned_addr learned my addr 172.21.15.77:0/1025773238 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:27.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7fcbd1897640 1 --2- 172.21.15.77:0/1025773238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbcc0cb120 0x7fcbcc0c6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7ff78eb1d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff7880d2900 0x7ff7880cb760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7fd91dae1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd918072370 0x7fd91814aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7fcbd309a640 1 -- 172.21.15.77:0/1025773238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc0c7a20 con 0x7fcbcc0cb120 2023-11-04T01:40:27.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7fcbd309a640 1 -- 172.21.15.77:0/1025773238 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc0c6040 con 0x7fcbcc15ae00 2023-11-04T01:40:27.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7fd91dae1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd91815add0 0x7fd9180c3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7ff78eb1d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff788161310 0x7ff7881601b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7fcbd309a640 1 -- 172.21.15.77:0/1025773238 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc0c5a10 con 0x7fcbcc0afc40 2023-11-04T01:40:27.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7fd9177fe640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd918071f90 0x7fd9180b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7fcbd2899640 1 --2- 172.21.15.77:0/1025773238 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbcc15ae00 0x7fcbcc14d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7f9993fff640 1 -- 172.21.15.77:0/2718802790 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c0a6dc0 con 0x7f99940eb1b0 2023-11-04T01:40:27.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7ff78eb1d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7881443a0 con 0x7ff788161310 2023-11-04T01:40:27.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7ff78eb1d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff788144680 con 0x7ff7880b48a0 2023-11-04T01:40:27.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7ff78eb1d640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff788144960 con 0x7ff7880d2900 2023-11-04T01:40:27.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7f9993fff640 1 -- 172.21.15.77:0/2718802790 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999c0ae440 con 0x7f99940eb1b0 2023-11-04T01:40:27.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7ff78d0ba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff788161310 0x7ff7881601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7ff78c8b9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7880b48a0 0x7ff788162280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7fd9177fe640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd918071f90 0x7fd9180b1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:53732/0 (socket says 172.21.15.77:53732) 2023-11-04T01:40:27.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7fd916ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd918072370 0x7fd91814aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7fd916ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd918072370 0x7fd91814aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:40818/0 (socket says 172.21.15.77:40818) 2023-11-04T01:40:27.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7ff78d0ba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff788161310 0x7ff7881601b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57122/0 (socket says 172.21.15.77:57122) 2023-11-04T01:40:27.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7ff78d0ba640 1 -- 172.21.15.77:0/2843862980 learned_addr learned my addr 172.21.15.77:0/2843862980 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:27.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7f9993fff640 1 -- 172.21.15.77:0/2718802790 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c0ae870 con 0x7f99940eb1b0 2023-11-04T01:40:27.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7fd9177fe640 1 -- 172.21.15.77:0/689033252 learned_addr learned my addr 172.21.15.77:0/689033252 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:27.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.091+0000 7fd91dae1640 1 -- 172.21.15.77:0/689033252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9180c6450 con 0x7fd91815add0 2023-11-04T01:40:27.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.091+0000 7fd91dae1640 1 -- 172.21.15.77:0/689033252 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9180b0460 con 0x7fd918072370 2023-11-04T01:40:27.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.091+0000 7fd917fff640 1 --2- 172.21.15.77:0/689033252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd91815add0 0x7fd9180c3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.091+0000 7fd91dae1640 1 -- 172.21.15.77:0/689033252 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9180b0740 con 0x7fd918071f90 2023-11-04T01:40:27.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.091+0000 7ff78d0ba640 1 -- 172.21.15.77:0/2843862980 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff7880d2900 msgr2=0x7ff7880cb760 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-04T01:40:27.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.091+0000 7ff78d0ba640 1 --2- 172.21.15.77:0/2843862980 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff7880d2900 0x7ff7880cb760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.091+0000 7ff78d0ba640 1 -- 172.21.15.77:0/2843862980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7880b48a0 msgr2=0x7ff788162280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.091+0000 7ff78d0ba640 1 --2- 172.21.15.77:0/2843862980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7880b48a0 0x7ff788162280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.091+0000 7ff78d0ba640 1 -- 172.21.15.77:0/2843862980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff780009b30 con 0x7ff788161310 2023-11-04T01:40:27.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.091+0000 7fcbd2098640 1 -- 172.21.15.77:0/1025773238 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbcc15ae00 msgr2=0x7fcbcc14d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.091+0000 7fcbd2098640 1 --2- 172.21.15.77:0/1025773238 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbcc15ae00 0x7fcbcc14d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.091+0000 7fcbd2098640 1 -- 172.21.15.77:0/1025773238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbcc0cb120 msgr2=0x7fcbcc0c6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.091+0000 7fcbd2098640 1 --2- 172.21.15.77:0/1025773238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbcc0cb120 0x7fcbcc0c6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.091+0000 7fcbd2098640 1 -- 172.21.15.77:0/1025773238 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbbc009400 con 0x7fcbcc0afc40 2023-11-04T01:40:27.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.091+0000 7fcbd2098640 1 --2- 172.21.15.77:0/1025773238 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcbcc0afc40 0x7fcbcc157790 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcbc800c410 tx=0x7fcbc800c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.091+0000 7ff78c8b9640 1 --2- 172.21.15.77:0/2843862980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7880b48a0 0x7ff788162280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:27.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.091+0000 7f51826a2640 1 -- 172.21.15.77:0/4133043108 wait complete. 2023-11-04T01:40:27.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.091+0000 7fcbc2ffd640 1 -- 172.21.15.77:0/1025773238 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc8005ce0 con 0x7fcbcc0afc40 2023-11-04T01:40:27.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.091+0000 7fcbd309a640 1 -- 172.21.15.77:0/1025773238 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbcc0c7f10 con 0x7fcbcc0afc40 2023-11-04T01:40:27.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.091+0000 7fcbd309a640 1 -- 172.21.15.77:0/1025773238 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbcc0c8470 con 0x7fcbcc0afc40 2023-11-04T01:40:27.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.091+0000 7fcbc2ffd640 1 -- 172.21.15.77:0/1025773238 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc8005e40 con 0x7fcbcc0afc40 2023-11-04T01:40:27.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.092+0000 7fd916ffd640 1 -- 172.21.15.77:0/689033252 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd918071f90 msgr2=0x7fd9180b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.092+0000 7fd916ffd640 1 --2- 172.21.15.77:0/689033252 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd918071f90 0x7fd9180b1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.092+0000 7fd916ffd640 1 -- 172.21.15.77:0/689033252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd91815add0 msgr2=0x7fd9180c3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.092+0000 7fd916ffd640 1 --2- 172.21.15.77:0/689033252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd91815add0 0x7fd9180c3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.092+0000 7fd916ffd640 1 -- 172.21.15.77:0/689033252 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd908009400 con 0x7fd918072370 2023-11-04T01:40:27.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.092+0000 7fd917fff640 1 --2- 172.21.15.77:0/689033252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd91815add0 0x7fd9180c3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:27.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.090+0000 7f9ff6d9d640 1 -- 172.21.15.77:0/2504198713 reap_dead start 2023-11-04T01:40:27.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.091+0000 7f99a24ea640 1 -- 172.21.15.77:0/2718802790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99940eb1b0 msgr2=0x7f99940eb5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.091+0000 7f99a24ea640 1 --2- 172.21.15.77:0/2718802790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99940eb1b0 0x7f99940eb5f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f999c000b60 tx=0x7f999c0a6160 comp rx=0 tx=0).stop 2023-11-04T01:40:27.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.091+0000 7f99a24ea640 1 -- 172.21.15.77:0/2718802790 shutdown_connections 2023-11-04T01:40:27.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.091+0000 7f99a24ea640 1 --2- 172.21.15.77:0/2718802790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99940eb1b0 0x7f99940eb5f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.091+0000 7f99a24ea640 1 --2- 172.21.15.77:0/2718802790 >> v2:172.21.15.77:3300/0 conn(0x7f99940e77a0 0x7f999404f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.091+0000 7f99a24ea640 1 -- 172.21.15.77:0/2718802790 >> 172.21.15.77:0/2718802790 conn(0x7f9994054b00 msgr2=0x7f9994054ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:27.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.091+0000 7ff78d0ba640 1 --2- 172.21.15.77:0/2843862980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff788161310 0x7ff7881601b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff780036040 tx=0x7ff780004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.092+0000 7ff7857fa640 1 -- 172.21.15.77:0/2843862980 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78003e450 con 0x7ff788161310 2023-11-04T01:40:27.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.092+0000 7ff7857fa640 1 -- 172.21.15.77:0/2843862980 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78003e5b0 con 0x7ff788161310 2023-11-04T01:40:27.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.092+0000 7f99a24ea640 1 -- 172.21.15.77:0/2718802790 shutdown_connections 2023-11-04T01:40:27.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.092+0000 7f546618a640 1 Processor -- start 2023-11-04T01:40:27.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.092+0000 7ff78eb1d640 1 -- 172.21.15.77:0/2843862980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff788144c40 con 0x7ff788161310 2023-11-04T01:40:27.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.092+0000 7f99a24ea640 1 -- 172.21.15.77:0/2718802790 wait complete. 2023-11-04T01:40:27.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.092+0000 7f546618a640 1 -- start start 2023-11-04T01:40:27.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.092+0000 7f9ff659c640 1 --2- 172.21.15.77:0/2504198713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fe0003cd0 0x7f9fe00040b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8001900 tx=0x7f9fe0004d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef661aaf732f4cee server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.092+0000 7fcbc2ffd640 1 -- 172.21.15.77:0/1025773238 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc80072f0 con 0x7fcbcc0afc40 2023-11-04T01:40:27.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.093+0000 7fcbd309a640 1 -- 172.21.15.77:0/1025773238 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbcc0c6180 con 0x7fcbcc0afc40 2023-11-04T01:40:27.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.093+0000 7f51826a2640 1 Processor -- start 2023-11-04T01:40:27.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.093+0000 7ff78eb1d640 1 -- 172.21.15.77:0/2843862980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7881627c0 con 0x7ff788161310 2023-11-04T01:40:27.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.093+0000 7ff7857fa640 1 -- 172.21.15.77:0/2843862980 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78003e940 con 0x7ff788161310 2023-11-04T01:40:27.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.094+0000 7f546618a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54600cb600 0x7f54600c8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.094+0000 7f546618a640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54600ccc00 0x7f54600c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.093+0000 7f51826a2640 1 -- start start 2023-11-04T01:40:27.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.094+0000 7f99a24ea640 1 Processor -- start 2023-11-04T01:40:27.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.094+0000 7f99a24ea640 1 -- start start 2023-11-04T01:40:27.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.094+0000 7fcbc2ffd640 1 -- 172.21.15.77:0/1025773238 <== mon.2 v2:172.21.15.122:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcbc8007550 con 0x7fcbcc0afc40 2023-11-04T01:40:27.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.094+0000 7fcbc2ffd640 1 --2- 172.21.15.77:0/1025773238 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcbb006af40 0x7fcbb006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.094+0000 7f545f7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54600cb600 0x7f54600c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.094+0000 7f545f7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54600cb600 0x7f54600c8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:40834/0 (socket says 172.21.15.77:40834) 2023-11-04T01:40:27.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.094+0000 7f545effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54600ccc00 0x7f54600c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.094+0000 7f545effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54600ccc00 0x7f54600c5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:53742/0 (socket says 172.21.15.77:53742) 2023-11-04T01:40:27.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.094+0000 7f545effd640 1 -- 172.21.15.77:0/3682333632 learned_addr learned my addr 172.21.15.77:0/3682333632 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:27.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.094+0000 7f546618a640 1 --2- 172.21.15.77:0/3682333632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f546015b230 0x7f546015c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.094+0000 7fcbc2ffd640 1 -- 172.21.15.77:0/1025773238 <== mon.2 v2:172.21.15.122:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcbc8088e50 con 0x7fcbcc0afc40 2023-11-04T01:40:27.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.094+0000 7fd916ffd640 1 --2- 172.21.15.77:0/689033252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd918072370 0x7fd91814aa10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd908035000 tx=0x7fd9080046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.094+0000 7fcbd1897640 1 --2- 172.21.15.77:0/1025773238 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcbb006af40 0x7fcbb006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.094+0000 7f545ffff640 1 --2- 172.21.15.77:0/3682333632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f546015b230 0x7f546015c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.094+0000 7fd8fffff640 1 -- 172.21.15.77:0/689033252 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd908036890 con 0x7fd918072370 2023-11-04T01:40:27.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.094+0000 7fd8fffff640 1 -- 172.21.15.77:0/689033252 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd908033f00 con 0x7fd918072370 2023-11-04T01:40:27.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.095+0000 7fd8fffff640 1 -- 172.21.15.77:0/689033252 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd908036c70 con 0x7fd918072370 2023-11-04T01:40:27.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.095+0000 7f546618a640 1 -- 172.21.15.77:0/3682333632 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5460154940 con 0x7f546015b230 2023-11-04T01:40:27.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.095+0000 7f546618a640 1 -- 172.21.15.77:0/3682333632 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54600c8860 con 0x7f54600cb600 2023-11-04T01:40:27.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.095+0000 7f546618a640 1 -- 172.21.15.77:0/3682333632 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5460155690 con 0x7f54600ccc00 2023-11-04T01:40:27.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.095+0000 7f9ff559a640 1 -- 172.21.15.77:0/2504198713 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe80052d0 con 0x7f9fe0003cd0 2023-11-04T01:40:27.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.095+0000 7f9ff559a640 1 -- 172.21.15.77:0/2504198713 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe8005450 con 0x7f9fe0003cd0 2023-11-04T01:40:27.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.095+0000 7fd91dae1640 1 -- 172.21.15.77:0/689033252 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9180b0a20 con 0x7fd918072370 2023-11-04T01:40:27.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.094+0000 7ff78eb1d640 1 -- 172.21.15.77:0/2843862980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff768005250 con 0x7ff788161310 2023-11-04T01:40:27.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.095+0000 7ff7857fa640 1 -- 172.21.15.77:0/2843862980 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff78003eaa0 con 0x7ff788161310 2023-11-04T01:40:27.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.095+0000 7f9ff559a640 1 -- 172.21.15.77:0/2504198713 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe8003830 con 0x7f9fe0003cd0 2023-11-04T01:40:27.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.095+0000 7fd91dae1640 1 -- 172.21.15.77:0/689033252 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9180b1760 con 0x7fd918072370 2023-11-04T01:40:27.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.095+0000 7f99a24ea640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9994052ed0 0x7f99940d71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.095+0000 7fcbd1897640 1 --2- 172.21.15.77:0/1025773238 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcbb006af40 0x7fcbb006d400 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc15a250 tx=0x7fcbc4009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.095+0000 7f51826a2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f517c14f250 0x7f517c1ff210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.095+0000 7f99a24ea640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f99940e77a0 0x7f99940e8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.095+0000 7f99a24ea640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99940eb1b0 0x7f999404d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.095+0000 7f99a24ea640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99940e9630 con 0x7f99940eb1b0 2023-11-04T01:40:27.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.095+0000 7f99a24ea640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99940e4cb0 con 0x7f9994052ed0 2023-11-04T01:40:27.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.095+0000 7f99a24ea640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99940e1970 con 0x7f99940e77a0 2023-11-04T01:40:27.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.095+0000 7f9ffca10640 1 -- 172.21.15.77:0/2504198713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fe0003cd0 msgr2=0x7f9fe00040b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.095+0000 7f9ffca10640 1 --2- 172.21.15.77:0/2504198713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fe0003cd0 0x7f9fe00040b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8001900 tx=0x7f9fe0004d50 comp rx=0 tx=0).stop 2023-11-04T01:40:27.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.096+0000 7f545effd640 1 -- 172.21.15.77:0/3682333632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54600cb600 msgr2=0x7f54600c8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.096+0000 7f545effd640 1 --2- 172.21.15.77:0/3682333632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54600cb600 0x7f54600c8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.096+0000 7f545effd640 1 -- 172.21.15.77:0/3682333632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f546015b230 msgr2=0x7f546015c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.096+0000 7f545effd640 1 --2- 172.21.15.77:0/3682333632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f546015b230 0x7f546015c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.095+0000 7f51826a2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f517c14f630 0x7f517c15abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.096+0000 7f545effd640 1 -- 172.21.15.77:0/3682333632 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54540094d0 con 0x7f54600ccc00 2023-11-04T01:40:27.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.096+0000 7f545f7fe640 1 --2- 172.21.15.77:0/3682333632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54600cb600 0x7f54600c8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:27.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.096+0000 7f51826a2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f517c15b0f0 0x7f517c071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.096+0000 7f51826a2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517c1ffab0 con 0x7f517c14f250 2023-11-04T01:40:27.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.096+0000 7f517bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f517c14f250 0x7f517c1ff210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.096+0000 7f517bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f517c14f250 0x7f517c1ff210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57158/0 (socket says 172.21.15.77:57158) 2023-11-04T01:40:27.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.096+0000 7f517bfff640 1 -- 172.21.15.77:0/2623063089 learned_addr learned my addr 172.21.15.77:0/2623063089 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:27.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.096+0000 7f51826a2640 1 -- 172.21.15.77:0/2623063089 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517c1ffd90 con 0x7f517c15b0f0 2023-11-04T01:40:27.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.096+0000 7f51826a2640 1 -- 172.21.15.77:0/2623063089 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f517c200070 con 0x7f517c14f630 2023-11-04T01:40:27.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.096+0000 7f545ffff640 1 --2- 172.21.15.77:0/3682333632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f546015b230 0x7f546015c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:27.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.096+0000 7f99a1ce9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99940eb1b0 0x7f999404d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.096+0000 7f99a1ce9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99940eb1b0 0x7f999404d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57166/0 (socket says 172.21.15.77:57166) 2023-11-04T01:40:27.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.096+0000 7f99a1ce9640 1 -- 172.21.15.77:0/3985491921 learned_addr learned my addr 172.21.15.77:0/3985491921 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:27.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.096+0000 7f99a14e8640 1 --2- 172.21.15.77:0/3985491921 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9994052ed0 0x7f99940d71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.096+0000 7f517b7fe640 1 --2- 172.21.15.77:0/2623063089 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f517c14f630 0x7f517c15abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.096+0000 7f545effd640 1 --2- 172.21.15.77:0/3682333632 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54600ccc00 0x7f54600c5be0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f54540097f0 tx=0x7f54540046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.096+0000 7f5180c3f640 1 --2- 172.21.15.77:0/2623063089 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f517c15b0f0 0x7f517c071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.096+0000 7f517bfff640 1 -- 172.21.15.77:0/2623063089 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f517c14f630 msgr2=0x7f517c15abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.096+0000 7f517bfff640 1 --2- 172.21.15.77:0/2623063089 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f517c14f630 0x7f517c15abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.096+0000 7f517bfff640 1 -- 172.21.15.77:0/2623063089 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f517c15b0f0 msgr2=0x7f517c071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.096+0000 7f517bfff640 1 --2- 172.21.15.77:0/2623063089 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f517c15b0f0 0x7f517c071c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.096+0000 7f517bfff640 1 -- 172.21.15.77:0/2623063089 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517c15a3b0 con 0x7f517c14f250 2023-11-04T01:40:27.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.096+0000 7f99a1ce9640 1 -- 172.21.15.77:0/3985491921 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f99940e77a0 msgr2=0x7f99940e8f30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-04T01:40:27.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.096+0000 7f99a1ce9640 1 --2- 172.21.15.77:0/3985491921 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f99940e77a0 0x7f99940e8f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.096+0000 7f99a1ce9640 1 -- 172.21.15.77:0/3985491921 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9994052ed0 msgr2=0x7f99940d71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.096+0000 7f99a1ce9640 1 --2- 172.21.15.77:0/3985491921 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9994052ed0 0x7f99940d71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.096+0000 7f99a1ce9640 1 -- 172.21.15.77:0/3985491921 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99980094d0 con 0x7f99940eb1b0 2023-11-04T01:40:27.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.097+0000 7f517bfff640 1 --2- 172.21.15.77:0/2623063089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f517c14f250 0x7f517c1ff210 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5174000f80 tx=0x7f5174001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.097+0000 7f9ffca10640 1 -- 172.21.15.77:0/2504198713 shutdown_connections 2023-11-04T01:40:27.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.097+0000 7f9ffca10640 1 --2- 172.21.15.77:0/2504198713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fe0003cd0 0x7f9fe00040b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.097+0000 7f9ffca10640 1 -- 172.21.15.77:0/2504198713 >> 172.21.15.77:0/2504198713 conn(0x7f9ff806c7a0 msgr2=0x7f9ff806cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:27.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.097+0000 7f99a1ce9640 1 --2- 172.21.15.77:0/3985491921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99940eb1b0 0x7f999404d3e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f998c00c390 tx=0x7f998c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.097+0000 7fd91dae1640 1 -- 172.21.15.77:0/689033252 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9180cb0d0 con 0x7fd918072370 2023-11-04T01:40:27.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.097+0000 7f9ffca10640 1 -- 172.21.15.77:0/2504198713 shutdown_connections 2023-11-04T01:40:27.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.097+0000 7f9ffca10640 1 -- 172.21.15.77:0/2504198713 wait complete. 2023-11-04T01:40:27.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.097+0000 7ff7857fa640 1 --2- 172.21.15.77:0/2843862980 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff76c06af40 0x7ff76c06d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.097+0000 7ff7857fa640 1 -- 172.21.15.77:0/2843862980 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff7800ac6c0 con 0x7ff788161310 2023-11-04T01:40:27.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.097+0000 7ff78c8b9640 1 --2- 172.21.15.77:0/2843862980 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff76c06af40 0x7ff76c06d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.097+0000 7fd8fffff640 1 -- 172.21.15.77:0/689033252 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd90803d040 con 0x7fd918072370 2023-11-04T01:40:27.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.098+0000 7ff78c8b9640 1 --2- 172.21.15.77:0/2843862980 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff76c06af40 0x7ff76c06d400 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff7881467e0 tx=0x7ff7740090e0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.098+0000 7fd8fffff640 1 --2- 172.21.15.77:0/689033252 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd90406aec0 0x7fd90406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.098+0000 7fd8fffff640 1 -- 172.21.15.77:0/689033252 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd9080ab860 con 0x7fd918072370 2023-11-04T01:40:27.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.098+0000 7fd9177fe640 1 --2- 172.21.15.77:0/689033252 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd90406aec0 0x7fd90406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.098+0000 7fd9177fe640 1 --2- 172.21.15.77:0/689033252 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd90406aec0 0x7fd90406d380 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd90c005f40 tx=0x7fd90c000f10 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.098+0000 7f9ffca10640 1 Processor -- start 2023-11-04T01:40:27.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.098+0000 7f9ffca10640 1 -- start start 2023-11-04T01:40:27.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.099+0000 7f5447fff640 1 -- 172.21.15.77:0/3682333632 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5454032c40 con 0x7f54600ccc00 2023-11-04T01:40:27.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.099+0000 7f5447fff640 1 -- 172.21.15.77:0/3682333632 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5454032dc0 con 0x7f54600ccc00 2023-11-04T01:40:27.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.099+0000 7f546618a640 1 -- 172.21.15.77:0/3682333632 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5460153cc0 con 0x7f54600ccc00 2023-11-04T01:40:27.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.099+0000 7fcbc2ffd640 1 -- 172.21.15.77:0/1025773238 <== mon.2 v2:172.21.15.122:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcbcc0c6180 con 0x7fcbcc0afc40 2023-11-04T01:40:27.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.099+0000 7f546618a640 1 -- 172.21.15.77:0/3682333632 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5460154280 con 0x7f54600ccc00 2023-11-04T01:40:27.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.099+0000 7f5447fff640 1 -- 172.21.15.77:0/3682333632 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545403b640 con 0x7f54600ccc00 2023-11-04T01:40:27.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.099+0000 7f9ffca10640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fe0003cd0 0x7f9ff8165ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.099+0000 7f9ffca10640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ff8162540 0x7f9ff8088b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.099+0000 7f9ffca10640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9ff8167860 0x7f9ff8167ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.099+0000 7f9ffca10640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff81692f0 con 0x7f9ff8162540 2023-11-04T01:40:27.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.099+0000 7f9ffca10640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff8168530 con 0x7f9fe0003cd0 2023-11-04T01:40:27.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.099+0000 7f9ffca10640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff8168810 con 0x7f9ff8167860 2023-11-04T01:40:27.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.099+0000 7f9ff6d9d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9ff8167860 0x7f9ff8167ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.100+0000 7f9ff659c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fe0003cd0 0x7f9ff8165ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.100+0000 7f9ff6d9d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9ff8167860 0x7f9ff8167ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:53766/0 (socket says 172.21.15.77:53766) 2023-11-04T01:40:27.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.100+0000 7f9ff6d9d640 1 -- 172.21.15.77:0/2715731560 learned_addr learned my addr 172.21.15.77:0/2715731560 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:27.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.100+0000 7f9ff5d9b640 1 --2- 172.21.15.77:0/2715731560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ff8162540 0x7f9ff8088b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.100+0000 7f9ff659c640 1 -- 172.21.15.77:0/2715731560 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9ff8167860 msgr2=0x7f9ff8167ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.100+0000 7f9ff659c640 1 --2- 172.21.15.77:0/2715731560 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9ff8167860 0x7f9ff8167ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.100+0000 7f9ff659c640 1 -- 172.21.15.77:0/2715731560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ff8162540 msgr2=0x7f9ff8088b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.100+0000 7f9ff659c640 1 --2- 172.21.15.77:0/2715731560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ff8162540 0x7f9ff8088b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.100+0000 7f9ff659c640 1 -- 172.21.15.77:0/2715731560 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff8168af0 con 0x7f9fe0003cd0 2023-11-04T01:40:27.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.100+0000 7f9ff659c640 1 --2- 172.21.15.77:0/2715731560 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fe0003cd0 0x7f9ff8165ca0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8004000 tx=0x7f9fe80012d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.101+0000 7f546618a640 1 -- 172.21.15.77:0/3682333632 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5460154a80 con 0x7f54600ccc00 2023-11-04T01:40:27.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.101+0000 7f5447fff640 1 -- 172.21.15.77:0/3682333632 <== mon.2 v2:172.21.15.122:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5454039040 con 0x7f54600ccc00 2023-11-04T01:40:27.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.101+0000 7f5447fff640 1 --2- 172.21.15.77:0/3682333632 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f544c06aec0 0x7f544c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.102+0000 7f5447fff640 1 -- 172.21.15.77:0/3682333632 <== mon.2 v2:172.21.15.122:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f54540ab3e0 con 0x7f54600ccc00 2023-11-04T01:40:27.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.102+0000 7f545f7fe640 1 --2- 172.21.15.77:0/3682333632 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f544c06aec0 0x7f544c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.102+0000 7f545f7fe640 1 --2- 172.21.15.77:0/3682333632 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f544c06aec0 0x7f544c06d380 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5458007fd0 tx=0x7f5458009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.102+0000 7f9fe6ffd640 1 -- 172.21.15.77:0/2715731560 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe8007230 con 0x7f9fe0003cd0 2023-11-04T01:40:27.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.103+0000 7f9fe6ffd640 1 -- 172.21.15.77:0/2715731560 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe80052e0 con 0x7f9fe0003cd0 2023-11-04T01:40:27.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.103+0000 7f9fe6ffd640 1 -- 172.21.15.77:0/2715731560 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe8007590 con 0x7f9fe0003cd0 2023-11-04T01:40:27.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.103+0000 7fd8fffff640 1 -- 172.21.15.77:0/689033252 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd9080766b0 con 0x7fd918072370 2023-11-04T01:40:27.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.103+0000 7f9ffca10640 1 -- 172.21.15.77:0/2715731560 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff8168dd0 con 0x7f9fe0003cd0 2023-11-04T01:40:27.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.103+0000 7f9ffca10640 1 -- 172.21.15.77:0/2715731560 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff8168220 con 0x7f9fe0003cd0 2023-11-04T01:40:27.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.104+0000 7f9ffca10640 1 -- 172.21.15.77:0/2715731560 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff804ece0 con 0x7f9fe0003cd0 2023-11-04T01:40:27.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.104+0000 7f9fe6ffd640 1 -- 172.21.15.77:0/2715731560 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9fe80067d0 con 0x7f9fe0003cd0 2023-11-04T01:40:27.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.105+0000 7f5178ff9640 1 -- 172.21.15.77:0/2623063089 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5174001f90 con 0x7f517c14f250 2023-11-04T01:40:27.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.105+0000 7ff7857fa640 1 -- 172.21.15.77:0/2843862980 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff7800774f0 con 0x7ff788161310 2023-11-04T01:40:27.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.105+0000 7f5178ff9640 1 -- 172.21.15.77:0/2623063089 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517400e070 con 0x7f517c14f250 2023-11-04T01:40:27.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.105+0000 7f5178ff9640 1 -- 172.21.15.77:0/2623063089 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5174036660 con 0x7f517c14f250 2023-11-04T01:40:27.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.105+0000 7f51826a2640 1 -- 172.21.15.77:0/2623063089 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f517c15a690 con 0x7f517c14f250 2023-11-04T01:40:27.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.105+0000 7f9fe6ffd640 1 --2- 172.21.15.77:0/2715731560 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9fd806ae70 0x7f9fd806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.105+0000 7f9fe6ffd640 1 -- 172.21.15.77:0/2715731560 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9fe80aac30 con 0x7f9fe0003cd0 2023-11-04T01:40:27.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.105+0000 7f9991ffb640 1 -- 172.21.15.77:0/3985491921 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998c0035f0 con 0x7f99940eb1b0 2023-11-04T01:40:27.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.105+0000 7f9991ffb640 1 -- 172.21.15.77:0/3985491921 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f998c003750 con 0x7f99940eb1b0 2023-11-04T01:40:27.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.105+0000 7f99a24ea640 1 -- 172.21.15.77:0/3985491921 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f999c04ea00 con 0x7f99940eb1b0 2023-11-04T01:40:27.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.105+0000 7f9991ffb640 1 -- 172.21.15.77:0/3985491921 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998c003b00 con 0x7f99940eb1b0 2023-11-04T01:40:27.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.105+0000 7f51826a2640 1 -- 172.21.15.77:0/2623063089 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f517c0b3150 con 0x7f517c14f250 2023-11-04T01:40:27.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.105+0000 7f9ff5d9b640 1 --2- 172.21.15.77:0/2715731560 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9fd806ae70 0x7f9fd806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.106+0000 7f9ff5d9b640 1 --2- 172.21.15.77:0/2715731560 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9fd806ae70 0x7f9fd806d330 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9fec001eb0 tx=0x7f9fec009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.106+0000 7f5447fff640 1 -- 172.21.15.77:0/3682333632 <== mon.2 v2:172.21.15.122:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5460154a80 con 0x7f54600ccc00 2023-11-04T01:40:27.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.105+0000 7f99a24ea640 1 -- 172.21.15.77:0/3985491921 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99940e4660 con 0x7f99940eb1b0 2023-11-04T01:40:27.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.108+0000 7f99a24ea640 1 -- 172.21.15.77:0/3985491921 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9994005340 con 0x7f99940eb1b0 2023-11-04T01:40:27.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.108+0000 7f51826a2640 1 -- 172.21.15.77:0/2623063089 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f515c005250 con 0x7f517c14f250 2023-11-04T01:40:27.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.109+0000 7f9991ffb640 1 -- 172.21.15.77:0/3985491921 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f998c003c60 con 0x7f99940eb1b0 2023-11-04T01:40:27.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.108+0000 7f5178ff9640 1 -- 172.21.15.77:0/2623063089 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f51740367c0 con 0x7f517c14f250 2023-11-04T01:40:27.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.109+0000 7f5178ff9640 1 --2- 172.21.15.77:0/2623063089 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f516806ae70 0x7f516806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.109+0000 7f5178ff9640 1 -- 172.21.15.77:0/2623063089 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f51740abd30 con 0x7f517c14f250 2023-11-04T01:40:27.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.110+0000 7f517b7fe640 1 --2- 172.21.15.77:0/2623063089 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f516806ae70 0x7f516806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.110+0000 7f9fe6ffd640 1 -- 172.21.15.77:0/2715731560 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9fe8075a20 con 0x7f9fe0003cd0 2023-11-04T01:40:27.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.109+0000 7f9991ffb640 1 --2- 172.21.15.77:0/3985491921 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f998006af40 0x7f998006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.110+0000 7f9991ffb640 1 -- 172.21.15.77:0/3985491921 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f998c088e90 con 0x7f99940eb1b0 2023-11-04T01:40:27.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.111+0000 7f99a14e8640 1 --2- 172.21.15.77:0/3985491921 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f998006af40 0x7f998006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.111+0000 7f517b7fe640 1 --2- 172.21.15.77:0/2623063089 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f516806ae70 0x7f516806d330 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f517c153800 tx=0x7f516c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.111+0000 7f99a14e8640 1 --2- 172.21.15.77:0/3985491921 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f998006af40 0x7f998006d400 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9998006ca0 tx=0x7f9998009240 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.118+0000 7f9991ffb640 1 -- 172.21.15.77:0/3985491921 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f998c053ce0 con 0x7f99940eb1b0 2023-11-04T01:40:27.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.127+0000 7f5178ff9640 1 -- 172.21.15.77:0/2623063089 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5174076a50 con 0x7f517c14f250 2023-11-04T01:40:27.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.433+0000 7f16affd7640 1 -- 172.21.15.77:0/2400006740 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1690005500 con 0x7f16a815ce30 2023-11-04T01:40:27.438 INFO:teuthology.orchestra.run.smithi077.stdout:55834574857 2023-11-04T01:40:27.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.434+0000 7f169e7fc640 1 -- 172.21.15.77:0/2400006740 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f16a0068810 con 0x7f16a815ce30 2023-11-04T01:40:27.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.437+0000 7f168bfff640 1 -- 172.21.15.77:0/2400006740 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f168c06afc0 msgr2=0x7f168c06d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.437+0000 7f168bfff640 1 --2- 172.21.15.77:0/2400006740 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f168c06afc0 0x7f168c06d480 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1698005020 tx=0x7f1698007ef0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.437+0000 7f168bfff640 1 -- 172.21.15.77:0/2400006740 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16a815ce30 msgr2=0x7f16a8089310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.437+0000 7f168bfff640 1 --2- 172.21.15.77:0/2400006740 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16a815ce30 0x7f16a8089310 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f16a0012f80 tx=0x7f16a00144e0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.438+0000 7f168bfff640 1 -- 172.21.15.77:0/2400006740 shutdown_connections 2023-11-04T01:40:27.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.438+0000 7f168bfff640 1 --2- 172.21.15.77:0/2400006740 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f168c06afc0 0x7f168c06d480 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.438+0000 7f168bfff640 1 --2- 172.21.15.77:0/2400006740 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16a815ce30 0x7f16a8089310 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.438+0000 7f168bfff640 1 --2- 172.21.15.77:0/2400006740 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f16a81592c0 0x7f16a80c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.438+0000 7f168bfff640 1 --2- 172.21.15.77:0/2400006740 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f16a806d480 0x7f16a80b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.438+0000 7f168bfff640 1 -- 172.21.15.77:0/2400006740 >> 172.21.15.77:0/2400006740 conn(0x7f16a80cf140 msgr2=0x7f16a815d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:27.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.438+0000 7f168bfff640 1 -- 172.21.15.77:0/2400006740 shutdown_connections 2023-11-04T01:40:27.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.438+0000 7f168bfff640 1 -- 172.21.15.77:0/2400006740 wait complete. 2023-11-04T01:40:27.456 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.2 2023-11-04T01:40:27.456 DEBUG:teuthology.parallel:result is None 2023-11-04T01:40:27.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.480+0000 7f51826a2640 1 -- 172.21.15.77:0/2623063089 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f515c005500 con 0x7f517c14f250 2023-11-04T01:40:27.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.480+0000 7f5178ff9640 1 -- 172.21.15.77:0/2623063089 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f517407a070 con 0x7f517c14f250 2023-11-04T01:40:27.482 INFO:teuthology.orchestra.run.smithi077.stdout:55834574858 2023-11-04T01:40:27.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.482+0000 7f51826a2640 1 -- 172.21.15.77:0/2623063089 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f516806ae70 msgr2=0x7f516806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.482+0000 7f51826a2640 1 --2- 172.21.15.77:0/2623063089 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f516806ae70 0x7f516806d330 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f517c153800 tx=0x7f516c008040 comp rx=0 tx=0).stop 2023-11-04T01:40:27.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.482+0000 7f51826a2640 1 -- 172.21.15.77:0/2623063089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f517c14f250 msgr2=0x7f517c1ff210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.482+0000 7f51826a2640 1 --2- 172.21.15.77:0/2623063089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f517c14f250 0x7f517c1ff210 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5174000f80 tx=0x7f5174001cb0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.482+0000 7f51826a2640 1 -- 172.21.15.77:0/2623063089 shutdown_connections 2023-11-04T01:40:27.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.482+0000 7f51826a2640 1 --2- 172.21.15.77:0/2623063089 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f516806ae70 0x7f516806d330 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.482+0000 7f51826a2640 1 --2- 172.21.15.77:0/2623063089 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f517c15b0f0 0x7f517c071c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.482+0000 7f51826a2640 1 --2- 172.21.15.77:0/2623063089 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f517c14f630 0x7f517c15abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.482+0000 7f51826a2640 1 --2- 172.21.15.77:0/2623063089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f517c14f250 0x7f517c1ff210 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.482+0000 7f51826a2640 1 -- 172.21.15.77:0/2623063089 >> 172.21.15.77:0/2623063089 conn(0x7f517c06c7a0 msgr2=0x7f517c150200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:27.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.482+0000 7f51826a2640 1 -- 172.21.15.77:0/2623063089 shutdown_connections 2023-11-04T01:40:27.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.482+0000 7f51826a2640 1 -- 172.21.15.77:0/2623063089 wait complete. 2023-11-04T01:40:27.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2023-11-04T01:40:27.495 DEBUG:teuthology.parallel:result is None 2023-11-04T01:40:27.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.495+0000 7f546618a640 1 -- 172.21.15.77:0/3682333632 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f5460154a80 con 0x7f54600ccc00 2023-11-04T01:40:27.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.496+0000 7f5447fff640 1 -- 172.21.15.77:0/3682333632 <== mon.2 v2:172.21.15.122:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5460154a80 con 0x7f54600ccc00 2023-11-04T01:40:27.497 INFO:teuthology.orchestra.run.smithi077.stdout:55834574858 2023-11-04T01:40:27.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.498+0000 7f546618a640 1 -- 172.21.15.77:0/3682333632 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f544c06aec0 msgr2=0x7f544c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.498+0000 7f546618a640 1 --2- 172.21.15.77:0/3682333632 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f544c06aec0 0x7f544c06d380 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5458007fd0 tx=0x7f5458009040 comp rx=0 tx=0).stop 2023-11-04T01:40:27.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.498+0000 7f546618a640 1 -- 172.21.15.77:0/3682333632 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54600ccc00 msgr2=0x7f54600c5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.498+0000 7f546618a640 1 --2- 172.21.15.77:0/3682333632 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54600ccc00 0x7f54600c5be0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f54540097f0 tx=0x7f54540046c0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.498+0000 7f546618a640 1 -- 172.21.15.77:0/3682333632 shutdown_connections 2023-11-04T01:40:27.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.498+0000 7f546618a640 1 --2- 172.21.15.77:0/3682333632 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f544c06aec0 0x7f544c06d380 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.498+0000 7f546618a640 1 --2- 172.21.15.77:0/3682333632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f546015b230 0x7f546015c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.498+0000 7f546618a640 1 --2- 172.21.15.77:0/3682333632 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54600ccc00 0x7f54600c5be0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.498+0000 7f546618a640 1 --2- 172.21.15.77:0/3682333632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54600cb600 0x7f54600c8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.498+0000 7f546618a640 1 -- 172.21.15.77:0/3682333632 >> 172.21.15.77:0/3682333632 conn(0x7f5460098bb0 msgr2=0x7f5460159f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:27.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.498+0000 7f546618a640 1 -- 172.21.15.77:0/3682333632 shutdown_connections 2023-11-04T01:40:27.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.498+0000 7f546618a640 1 -- 172.21.15.77:0/3682333632 wait complete. 2023-11-04T01:40:27.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.500+0000 7fcbd309a640 1 -- 172.21.15.77:0/1025773238 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcbcc04ece0 con 0x7fcbcc0afc40 2023-11-04T01:40:27.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.501+0000 7fcbc2ffd640 1 -- 172.21.15.77:0/1025773238 <== mon.2 v2:172.21.15.122:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcbc8017090 con 0x7fcbcc0afc40 2023-11-04T01:40:27.505 INFO:teuthology.orchestra.run.smithi077.stdout:55834574857 2023-11-04T01:40:27.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.504+0000 7fcbd309a640 1 -- 172.21.15.77:0/1025773238 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcbb006af40 msgr2=0x7fcbb006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.504+0000 7fcbd309a640 1 --2- 172.21.15.77:0/1025773238 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcbb006af40 0x7fcbb006d400 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc15a250 tx=0x7fcbc4009040 comp rx=0 tx=0).stop 2023-11-04T01:40:27.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.504+0000 7fcbd309a640 1 -- 172.21.15.77:0/1025773238 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcbcc0afc40 msgr2=0x7fcbcc157790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.504+0000 7fcbd309a640 1 --2- 172.21.15.77:0/1025773238 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcbcc0afc40 0x7fcbcc157790 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcbc800c410 tx=0x7fcbc800c8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.504+0000 7fcbd309a640 1 -- 172.21.15.77:0/1025773238 shutdown_connections 2023-11-04T01:40:27.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.504+0000 7fcbd309a640 1 --2- 172.21.15.77:0/1025773238 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcbb006af40 0x7fcbb006d400 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.504+0000 7fcbd309a640 1 --2- 172.21.15.77:0/1025773238 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbcc15ae00 0x7fcbcc14d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.504+0000 7fcbd309a640 1 --2- 172.21.15.77:0/1025773238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbcc0cb120 0x7fcbcc0c6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.504+0000 7fcbd309a640 1 --2- 172.21.15.77:0/1025773238 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcbcc0afc40 0x7fcbcc157790 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.504+0000 7fcbd309a640 1 -- 172.21.15.77:0/1025773238 >> 172.21.15.77:0/1025773238 conn(0x7fcbcc06a120 msgr2=0x7fcbcc157080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:27.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.504+0000 7fcbd309a640 1 -- 172.21.15.77:0/1025773238 shutdown_connections 2023-11-04T01:40:27.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.504+0000 7fcbd309a640 1 -- 172.21.15.77:0/1025773238 wait complete. 2023-11-04T01:40:27.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.504+0000 7f99a24ea640 1 -- 172.21.15.77:0/3985491921 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f99940527a0 con 0x7f99940eb1b0 2023-11-04T01:40:27.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.505+0000 7f9991ffb640 1 -- 172.21.15.77:0/3985491921 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f998c017020 con 0x7f99940eb1b0 2023-11-04T01:40:27.510 INFO:teuthology.orchestra.run.smithi077.stdout:55834574856 2023-11-04T01:40:27.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.505+0000 7fd91dae1640 1 -- 172.21.15.77:0/689033252 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fd9180b05a0 con 0x7fd918072370 2023-11-04T01:40:27.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.506+0000 7fd8fffff640 1 -- 172.21.15.77:0/689033252 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd9180b05a0 con 0x7fd918072370 2023-11-04T01:40:27.511 INFO:teuthology.orchestra.run.smithi077.stdout:55834574856 2023-11-04T01:40:27.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.507+0000 7f99a24ea640 1 -- 172.21.15.77:0/3985491921 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f998006af40 msgr2=0x7f998006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.507+0000 7f99a24ea640 1 --2- 172.21.15.77:0/3985491921 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f998006af40 0x7f998006d400 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9998006ca0 tx=0x7f9998009240 comp rx=0 tx=0).stop 2023-11-04T01:40:27.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.508+0000 7f99a24ea640 1 -- 172.21.15.77:0/3985491921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99940eb1b0 msgr2=0x7f999404d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.508+0000 7f99a24ea640 1 --2- 172.21.15.77:0/3985491921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99940eb1b0 0x7f999404d3e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f998c00c390 tx=0x7f998c00c850 comp rx=0 tx=0).stop 2023-11-04T01:40:27.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.508+0000 7f99a24ea640 1 -- 172.21.15.77:0/3985491921 shutdown_connections 2023-11-04T01:40:27.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.508+0000 7f99a24ea640 1 --2- 172.21.15.77:0/3985491921 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f998006af40 0x7f998006d400 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.508+0000 7f99a24ea640 1 --2- 172.21.15.77:0/3985491921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99940eb1b0 0x7f999404d3e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.508+0000 7f99a24ea640 1 --2- 172.21.15.77:0/3985491921 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f99940e77a0 0x7f99940e8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.508+0000 7f99a24ea640 1 --2- 172.21.15.77:0/3985491921 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9994052ed0 0x7f99940d71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.508+0000 7f99a24ea640 1 -- 172.21.15.77:0/3985491921 >> 172.21.15.77:0/3985491921 conn(0x7f9994054b00 msgr2=0x7f9994054ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:27.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.508+0000 7f99a24ea640 1 -- 172.21.15.77:0/3985491921 shutdown_connections 2023-11-04T01:40:27.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.508+0000 7f99a24ea640 1 -- 172.21.15.77:0/3985491921 wait complete. 2023-11-04T01:40:27.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.509+0000 7fd91dae1640 1 -- 172.21.15.77:0/689033252 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd90406aec0 msgr2=0x7fd90406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.509+0000 7fd91dae1640 1 --2- 172.21.15.77:0/689033252 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd90406aec0 0x7fd90406d380 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd90c005f40 tx=0x7fd90c000f10 comp rx=0 tx=0).stop 2023-11-04T01:40:27.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.509+0000 7fd91dae1640 1 -- 172.21.15.77:0/689033252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd918072370 msgr2=0x7fd91814aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.509+0000 7fd91dae1640 1 --2- 172.21.15.77:0/689033252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd918072370 0x7fd91814aa10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd908035000 tx=0x7fd9080046c0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.509+0000 7fd91dae1640 1 -- 172.21.15.77:0/689033252 shutdown_connections 2023-11-04T01:40:27.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.509+0000 7fd91dae1640 1 --2- 172.21.15.77:0/689033252 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd90406aec0 0x7fd90406d380 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.509+0000 7fd91dae1640 1 --2- 172.21.15.77:0/689033252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd91815add0 0x7fd9180c3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.509+0000 7fd91dae1640 1 --2- 172.21.15.77:0/689033252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd918072370 0x7fd91814aa10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.509+0000 7fd91dae1640 1 --2- 172.21.15.77:0/689033252 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd918071f90 0x7fd9180b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.509+0000 7fd91dae1640 1 -- 172.21.15.77:0/689033252 >> 172.21.15.77:0/689033252 conn(0x7fd91806d800 msgr2=0x7fd91806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:27.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.510+0000 7fd91dae1640 1 -- 172.21.15.77:0/689033252 shutdown_connections 2023-11-04T01:40:27.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.510+0000 7fd91dae1640 1 -- 172.21.15.77:0/689033252 wait complete. 2023-11-04T01:40:27.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2023-11-04T01:40:27.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.510+0000 7ff78eb1d640 1 -- 172.21.15.77:0/2843862980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff768005500 con 0x7ff788161310 2023-11-04T01:40:27.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.511+0000 7ff7857fa640 1 -- 172.21.15.77:0/2843862980 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff78007ab10 con 0x7ff788161310 2023-11-04T01:40:27.522 DEBUG:teuthology.parallel:result is None 2023-11-04T01:40:27.522 INFO:teuthology.orchestra.run.smithi077.stdout:55834574858 2023-11-04T01:40:27.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.512+0000 7f9ffca10640 1 -- 172.21.15.77:0/2715731560 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9ff8168670 con 0x7f9fe0003cd0 2023-11-04T01:40:27.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.513+0000 7f9fe6ffd640 1 -- 172.21.15.77:0/2715731560 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9ff8168670 con 0x7f9fe0003cd0 2023-11-04T01:40:27.524 INFO:teuthology.orchestra.run.smithi077.stdout:55834574857 2023-11-04T01:40:27.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.513+0000 7ff78eb1d640 1 -- 172.21.15.77:0/2843862980 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff76c06af40 msgr2=0x7ff76c06d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.513+0000 7ff78eb1d640 1 --2- 172.21.15.77:0/2843862980 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff76c06af40 0x7ff76c06d400 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff7881467e0 tx=0x7ff7740090e0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.513+0000 7ff78eb1d640 1 -- 172.21.15.77:0/2843862980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff788161310 msgr2=0x7ff7881601b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.513+0000 7ff78eb1d640 1 --2- 172.21.15.77:0/2843862980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff788161310 0x7ff7881601b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff780036040 tx=0x7ff780004a40 comp rx=0 tx=0).stop 2023-11-04T01:40:27.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.514+0000 7ff78eb1d640 1 -- 172.21.15.77:0/2843862980 shutdown_connections 2023-11-04T01:40:27.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.514+0000 7ff78eb1d640 1 --2- 172.21.15.77:0/2843862980 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff76c06af40 0x7ff76c06d400 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.514+0000 7ff78eb1d640 1 --2- 172.21.15.77:0/2843862980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff788161310 0x7ff7881601b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.514+0000 7ff78eb1d640 1 --2- 172.21.15.77:0/2843862980 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff7880d2900 0x7ff7880cb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.514+0000 7ff78eb1d640 1 --2- 172.21.15.77:0/2843862980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7880b48a0 0x7ff788162280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.514+0000 7ff78eb1d640 1 -- 172.21.15.77:0/2843862980 >> 172.21.15.77:0/2843862980 conn(0x7ff7880cf8a0 msgr2=0x7ff7880cfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:27.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.514+0000 7ff78eb1d640 1 -- 172.21.15.77:0/2843862980 shutdown_connections 2023-11-04T01:40:27.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.514+0000 7ff78eb1d640 1 -- 172.21.15.77:0/2843862980 wait complete. 2023-11-04T01:40:27.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.517+0000 7f9ffca10640 1 -- 172.21.15.77:0/2715731560 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9fd806ae70 msgr2=0x7f9fd806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.517+0000 7f9ffca10640 1 --2- 172.21.15.77:0/2715731560 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9fd806ae70 0x7f9fd806d330 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9fec001eb0 tx=0x7f9fec009040 comp rx=0 tx=0).stop 2023-11-04T01:40:27.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.517+0000 7f9ffca10640 1 -- 172.21.15.77:0/2715731560 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fe0003cd0 msgr2=0x7f9ff8165ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.517+0000 7f9ffca10640 1 --2- 172.21.15.77:0/2715731560 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fe0003cd0 0x7f9ff8165ca0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8004000 tx=0x7f9fe80012d0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.517+0000 7f9ffca10640 1 -- 172.21.15.77:0/2715731560 shutdown_connections 2023-11-04T01:40:27.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.517+0000 7f9ffca10640 1 --2- 172.21.15.77:0/2715731560 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9fd806ae70 0x7f9fd806d330 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.517+0000 7f9ffca10640 1 --2- 172.21.15.77:0/2715731560 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9ff8167860 0x7f9ff8167ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.517+0000 7f9ffca10640 1 --2- 172.21.15.77:0/2715731560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ff8162540 0x7f9ff8088b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.517+0000 7f9ffca10640 1 --2- 172.21.15.77:0/2715731560 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fe0003cd0 0x7f9ff8165ca0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.517+0000 7f9ffca10640 1 -- 172.21.15.77:0/2715731560 >> 172.21.15.77:0/2715731560 conn(0x7f9ff806c7a0 msgr2=0x7f9ff80cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:27.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.517+0000 7f9ffca10640 1 -- 172.21.15.77:0/2715731560 shutdown_connections 2023-11-04T01:40:27.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.517+0000 7f9ffca10640 1 -- 172.21.15.77:0/2715731560 wait complete. 2023-11-04T01:40:27.534 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2023-11-04T01:40:27.535 DEBUG:teuthology.parallel:result is None 2023-11-04T01:40:27.536 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.7 2023-11-04T01:40:27.536 DEBUG:teuthology.parallel:result is None 2023-11-04T01:40:27.537 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.6 2023-11-04T01:40:27.538 DEBUG:teuthology.parallel:result is None 2023-11-04T01:40:27.538 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.1 2023-11-04T01:40:27.539 DEBUG:teuthology.parallel:result is None 2023-11-04T01:40:27.540 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.3 2023-11-04T01:40:27.540 DEBUG:teuthology.parallel:result is None 2023-11-04T01:40:27.540 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-04T01:40:27.541 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:40:27.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.673+0000 7ff3ea5b0640 1 Processor -- start 2023-11-04T01:40:27.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.674+0000 7ff3ea5b0640 1 -- start start 2023-11-04T01:40:27.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.674+0000 7ff3ea5b0640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff3e415d250 0x7ff3e40c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.674+0000 7ff3ea5b0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff3e40c9d70 0x7ff3e40ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.674+0000 7ff3ea5b0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3e406a120 con 0x7ff3e415ce70 2023-11-04T01:40:27.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.674+0000 7ff3ea5b0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3e40cdc10 con 0x7ff3e40c9d70 2023-11-04T01:40:27.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.674+0000 7ff3ea5b0640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3e406a370 con 0x7ff3e415d250 2023-11-04T01:40:27.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.674+0000 7ff3e8b4d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff3e40c9d70 0x7ff3e40ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.674+0000 7ff3e8b4d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff3e40c9d70 0x7ff3e40ccdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53038/0 (socket says 172.21.15.77:53038) 2023-11-04T01:40:27.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.674+0000 7ff3e3fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ff3e415ce70 0x7ff3e406d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:60922/0 (socket says 172.21.15.77:60922) 2023-11-04T01:40:27.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.674+0000 7ff3e8b4d640 1 -- 172.21.15.77:0/253694826 learned_addr learned my addr 172.21.15.77:0/253694826 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:27.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.675+0000 7ff3e37fe640 1 --2- 172.21.15.77:0/253694826 >> v2:172.21.15.122:3300/0 conn(0x7ff3e415d250 0x7ff3e40c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.675+0000 7ff3e8b4d640 1 -- 172.21.15.77:0/253694826 >> v2:172.21.15.122:3300/0 conn(0x7ff3e415d250 msgr2=0x7ff3e40c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:27.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.675+0000 7ff3e8b4d640 1 --2- 172.21.15.77:0/253694826 >> v2:172.21.15.122:3300/0 conn(0x7ff3e415d250 0x7ff3e40c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.675+0000 7ff3e8b4d640 1 -- 172.21.15.77:0/253694826 >> v1:172.21.15.77:6789/0 conn(0x7ff3e415ce70 legacy=0x7ff3e406d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.675+0000 7ff3e8b4d640 1 -- 172.21.15.77:0/253694826 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e406a650 con 0x7ff3e40c9d70 2023-11-04T01:40:27.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.675+0000 7ff3e2ffd640 1 -- 172.21.15.77:0/253694826 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1998661291 0 0) 0x7ff3e406a120 con 0x7ff3e415ce70 2023-11-04T01:40:27.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.675+0000 7ff3e8b4d640 1 --2- 172.21.15.77:0/253694826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3e40c9d70 0x7ff3e40ccdb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff3e40d02c0 tx=0x7ff3dc02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8921cab9eeb183c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.676+0000 7ff3e2ffd640 1 -- 172.21.15.77:0/253694826 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc02cb20 con 0x7ff3e40c9d70 2023-11-04T01:40:27.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.676+0000 7ff3e2ffd640 1 -- 172.21.15.77:0/253694826 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3dc02cc80 con 0x7ff3e40c9d70 2023-11-04T01:40:27.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.676+0000 7ff3e2ffd640 1 -- 172.21.15.77:0/253694826 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc0343f0 con 0x7ff3e40c9d70 2023-11-04T01:40:27.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.676+0000 7ff3ea5b0640 1 -- 172.21.15.77:0/253694826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3e40c9d70 msgr2=0x7ff3e40ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.676+0000 7ff3ea5b0640 1 --2- 172.21.15.77:0/253694826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3e40c9d70 0x7ff3e40ccdb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff3e40d02c0 tx=0x7ff3dc02bf80 comp rx=0 tx=0).stop 2023-11-04T01:40:27.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.676+0000 7ff3ea5b0640 1 -- 172.21.15.77:0/253694826 shutdown_connections 2023-11-04T01:40:27.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.676+0000 7ff3ea5b0640 1 --2- 172.21.15.77:0/253694826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3e40c9d70 0x7ff3e40ccdb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.676+0000 7ff3ea5b0640 1 --2- 172.21.15.77:0/253694826 >> v2:172.21.15.122:3300/0 conn(0x7ff3e415d250 0x7ff3e40c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.676+0000 7ff3ea5b0640 1 -- 172.21.15.77:0/253694826 >> 172.21.15.77:0/253694826 conn(0x7ff3e40b0cd0 msgr2=0x7ff3e40b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:27.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.676+0000 7ff3ea5b0640 1 -- 172.21.15.77:0/253694826 shutdown_connections 2023-11-04T01:40:27.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.676+0000 7ff3ea5b0640 1 -- 172.21.15.77:0/253694826 wait complete. 2023-11-04T01:40:27.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.677+0000 7ff3ea5b0640 1 Processor -- start 2023-11-04T01:40:27.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.677+0000 7ff3ea5b0640 1 -- start start 2023-11-04T01:40:27.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.678+0000 7ff3ea5b0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3e415ce70 0x7ff3e414e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.678+0000 7ff3ea5b0640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff3e415d250 0x7ff3e41e7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.678+0000 7ff3ea5b0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3e40aff40 0x7ff3e40b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.678+0000 7ff3ea5b0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e41f67d0 con 0x7ff3e40aff40 2023-11-04T01:40:27.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.678+0000 7ff3ea5b0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e40b0930 con 0x7ff3e415ce70 2023-11-04T01:40:27.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.678+0000 7ff3ea5b0640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e415aa90 con 0x7ff3e415d250 2023-11-04T01:40:27.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.678+0000 7ff3e8b4d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3e40aff40 0x7ff3e40b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.678+0000 7ff3e8b4d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3e40aff40 0x7ff3e40b03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53044/0 (socket says 172.21.15.77:53044) 2023-11-04T01:40:27.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.678+0000 7ff3e8b4d640 1 -- 172.21.15.77:0/1715572778 learned_addr learned my addr 172.21.15.77:0/1715572778 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:27.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.678+0000 7ff3e3fff640 1 --2- 172.21.15.77:0/1715572778 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3e415ce70 0x7ff3e414e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.678+0000 7ff3e37fe640 1 --2- 172.21.15.77:0/1715572778 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff3e415d250 0x7ff3e41e7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.679+0000 7ff3e8b4d640 1 -- 172.21.15.77:0/1715572778 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff3e415d250 msgr2=0x7ff3e41e7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.679+0000 7ff3e8b4d640 1 --2- 172.21.15.77:0/1715572778 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff3e415d250 0x7ff3e41e7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.679+0000 7ff3e8b4d640 1 -- 172.21.15.77:0/1715572778 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3e415ce70 msgr2=0x7ff3e414e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.679+0000 7ff3e8b4d640 1 --2- 172.21.15.77:0/1715572778 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3e415ce70 0x7ff3e414e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.679+0000 7ff3e8b4d640 1 -- 172.21.15.77:0/1715572778 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3dc009b30 con 0x7ff3e40aff40 2023-11-04T01:40:27.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.679+0000 7ff3e8b4d640 1 --2- 172.21.15.77:0/1715572778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3e40aff40 0x7ff3e40b03f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc009f40 tx=0x7ff3dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.679+0000 7ff3e0ff9640 1 -- 172.21.15.77:0/1715572778 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc007e70 con 0x7ff3e40aff40 2023-11-04T01:40:27.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.679+0000 7ff3e0ff9640 1 -- 172.21.15.77:0/1715572778 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3dc009510 con 0x7ff3e40aff40 2023-11-04T01:40:27.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.679+0000 7ff3ea5b0640 1 -- 172.21.15.77:0/1715572778 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3e41f5870 con 0x7ff3e40aff40 2023-11-04T01:40:27.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.679+0000 7ff3e0ff9640 1 -- 172.21.15.77:0/1715572778 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc03e690 con 0x7ff3e40aff40 2023-11-04T01:40:27.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.679+0000 7ff3ea5b0640 1 -- 172.21.15.77:0/1715572778 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3e41f5e30 con 0x7ff3e40aff40 2023-11-04T01:40:27.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.680+0000 7ff3ea5b0640 1 -- 172.21.15.77:0/1715572778 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3e40c62b0 con 0x7ff3e40aff40 2023-11-04T01:40:27.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.680+0000 7ff3e0ff9640 1 -- 172.21.15.77:0/1715572778 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff3dc03e7f0 con 0x7ff3e40aff40 2023-11-04T01:40:27.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.680+0000 7ff3e0ff9640 1 --2- 172.21.15.77:0/1715572778 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff3d006ae70 0x7ff3d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:27.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.681+0000 7ff3e0ff9640 1 -- 172.21.15.77:0/1715572778 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff3dc0ac420 con 0x7ff3e40aff40 2023-11-04T01:40:27.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.681+0000 7ff3e3fff640 1 --2- 172.21.15.77:0/1715572778 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff3d006ae70 0x7ff3d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:27.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.681+0000 7ff3e3fff640 1 --2- 172.21.15.77:0/1715572778 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff3d006ae70 0x7ff3d006d330 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8000f60 tx=0x7ff3d8007b50 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:27.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.685+0000 7ff3e0ff9640 1 -- 172.21.15.77:0/1715572778 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff3dc077270 con 0x7ff3e40aff40 2023-11-04T01:40:27.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.849+0000 7ff3ea5b0640 1 -- 172.21.15.77:0/1715572778 --> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff3e406ac10 con 0x7ff3d006ae70 2023-11-04T01:40:27.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.858+0000 7ff3e0ff9640 1 -- 172.21.15.77:0/1715572778 <== mgr.4123 v2:172.21.15.122:6832/2275325762 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345242 (secure 0 0 0) 0x7ff3d8007170 con 0x7ff3d006ae70 2023-11-04T01:40:27.863 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:27.865 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-04T01:40:27.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.861+0000 7ff3ea5b0640 1 -- 172.21.15.77:0/1715572778 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff3d006ae70 msgr2=0x7ff3d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.861+0000 7ff3ea5b0640 1 --2- 172.21.15.77:0/1715572778 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff3d006ae70 0x7ff3d006d330 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8000f60 tx=0x7ff3d8007b50 comp rx=0 tx=0).stop 2023-11-04T01:40:27.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.861+0000 7ff3ea5b0640 1 -- 172.21.15.77:0/1715572778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3e40aff40 msgr2=0x7ff3e40b03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:27.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.861+0000 7ff3ea5b0640 1 --2- 172.21.15.77:0/1715572778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3e40aff40 0x7ff3e40b03f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc009f40 tx=0x7ff3dc004a40 comp rx=0 tx=0).stop 2023-11-04T01:40:27.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.861+0000 7ff3ea5b0640 1 -- 172.21.15.77:0/1715572778 shutdown_connections 2023-11-04T01:40:27.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.861+0000 7ff3ea5b0640 1 --2- 172.21.15.77:0/1715572778 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff3d006ae70 0x7ff3d006d330 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.861+0000 7ff3ea5b0640 1 --2- 172.21.15.77:0/1715572778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3e40aff40 0x7ff3e40b03f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.861+0000 7ff3ea5b0640 1 --2- 172.21.15.77:0/1715572778 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff3e415d250 0x7ff3e41e7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.861+0000 7ff3ea5b0640 1 --2- 172.21.15.77:0/1715572778 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3e415ce70 0x7ff3e414e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:27.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.861+0000 7ff3ea5b0640 1 -- 172.21.15.77:0/1715572778 >> 172.21.15.77:0/1715572778 conn(0x7ff3e40b0cd0 msgr2=0x7ff3e415c640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:27.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.861+0000 7ff3ea5b0640 1 -- 172.21.15.77:0/1715572778 shutdown_connections 2023-11-04T01:40:27.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:27.861+0000 7ff3ea5b0640 1 -- 172.21.15.77:0/1715572778 wait complete. 2023-11-04T01:40:27.874 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-11-04T01:40:27.631411+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219356,"kb_used_data":3204,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755364,"statfs":{"total":773094113280,"available":772869492736,"internally_reserved":0,"allocated":3280896,"data_stored":1987333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003991"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734371+0000","last_change":"2023-11-04T01:40:04.705196+0000","last_active":"2023-11-04T01:40:09.734371+0000","last_peered":"2023-11-04T01:40:09.734371+0000","last_clean":"2023-11-04T01:40:09.734371+0000","last_became_active":"2023-11-04T01:40:04.704925+0000","last_became_peered":"2023-11-04T01:40:04.704925+0000","last_unstale":"2023-11-04T01:40:09.734371+0000","last_undegraded":"2023-11-04T01:40:09.734371+0000","last_fullsized":"2023-11-04T01:40:09.734371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:23.661606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727344+0000","last_change":"2023-11-04T01:40:05.561233+0000","last_active":"2023-11-04T01:40:09.727344+0000","last_peered":"2023-11-04T01:40:09.727344+0000","last_clean":"2023-11-04T01:40:09.727344+0000","last_became_active":"2023-11-04T01:40:05.560936+0000","last_became_peered":"2023-11-04T01:40:05.560936+0000","last_unstale":"2023-11-04T01:40:09.727344+0000","last_undegraded":"2023-11-04T01:40:09.727344+0000","last_fullsized":"2023-11-04T01:40:09.727344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:32:27.484390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.550542+0000","last_change":"2023-11-04T01:40:09.743799+0000","last_active":"2023-11-04T01:40:10.550542+0000","last_peered":"2023-11-04T01:40:10.550542+0000","last_clean":"2023-11-04T01:40:10.550542+0000","last_became_active":"2023-11-04T01:40:09.743430+0000","last_became_peered":"2023-11-04T01:40:09.743430+0000","last_unstale":"2023-11-04T01:40:10.550542+0000","last_undegraded":"2023-11-04T01:40:10.550542+0000","last_fullsized":"2023-11-04T01:40:10.550542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:23:03.976941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727438+0000","last_change":"2023-11-04T01:40:04.697166+0000","last_active":"2023-11-04T01:40:09.727438+0000","last_peered":"2023-11-04T01:40:09.727438+0000","last_clean":"2023-11-04T01:40:09.727438+0000","last_became_active":"2023-11-04T01:40:04.696343+0000","last_became_peered":"2023-11-04T01:40:04.696343+0000","last_unstale":"2023-11-04T01:40:09.727438+0000","last_undegraded":"2023-11-04T01:40:09.727438+0000","last_fullsized":"2023-11-04T01:40:09.727438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:45:56.544854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734207+0000","last_change":"2023-11-04T01:40:05.578729+0000","last_active":"2023-11-04T01:40:09.734207+0000","last_peered":"2023-11-04T01:40:09.734207+0000","last_clean":"2023-11-04T01:40:09.734207+0000","last_became_active":"2023-11-04T01:40:05.578510+0000","last_became_peered":"2023-11-04T01:40:05.578510+0000","last_unstale":"2023-11-04T01:40:09.734207+0000","last_undegraded":"2023-11-04T01:40:09.734207+0000","last_fullsized":"2023-11-04T01:40:09.734207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:51:09.123583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255835+0000","last_change":"2023-11-04T01:40:09.748639+0000","last_active":"2023-11-04T01:40:11.255835+0000","last_peered":"2023-11-04T01:40:11.255835+0000","last_clean":"2023-11-04T01:40:11.255835+0000","last_became_active":"2023-11-04T01:40:09.748054+0000","last_became_peered":"2023-11-04T01:40:09.748054+0000","last_unstale":"2023-11-04T01:40:11.255835+0000","last_undegraded":"2023-11-04T01:40:11.255835+0000","last_fullsized":"2023-11-04T01:40:11.255835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:06.213744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731930+0000","last_change":"2023-11-04T01:40:04.704898+0000","last_active":"2023-11-04T01:40:09.731930+0000","last_peered":"2023-11-04T01:40:09.731930+0000","last_clean":"2023-11-04T01:40:09.731930+0000","last_became_active":"2023-11-04T01:40:04.704598+0000","last_became_peered":"2023-11-04T01:40:04.704598+0000","last_unstale":"2023-11-04T01:40:09.731930+0000","last_undegraded":"2023-11-04T01:40:09.731930+0000","last_fullsized":"2023-11-04T01:40:09.731930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:01.176323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729590+0000","last_change":"2023-11-04T01:40:05.578543+0000","last_active":"2023-11-04T01:40:09.729590+0000","last_peered":"2023-11-04T01:40:09.729590+0000","last_clean":"2023-11-04T01:40:09.729590+0000","last_became_active":"2023-11-04T01:40:05.576858+0000","last_became_peered":"2023-11-04T01:40:05.576858+0000","last_unstale":"2023-11-04T01:40:09.729590+0000","last_undegraded":"2023-11-04T01:40:09.729590+0000","last_fullsized":"2023-11-04T01:40:09.729590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:09:53.332106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256523+0000","last_change":"2023-11-04T01:40:09.749533+0000","last_active":"2023-11-04T01:40:11.256523+0000","last_peered":"2023-11-04T01:40:11.256523+0000","last_clean":"2023-11-04T01:40:11.256523+0000","last_became_active":"2023-11-04T01:40:09.749065+0000","last_became_peered":"2023-11-04T01:40:09.749065+0000","last_unstale":"2023-11-04T01:40:11.256523+0000","last_undegraded":"2023-11-04T01:40:11.256523+0000","last_fullsized":"2023-11-04T01:40:11.256523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:09:57.363528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731575+0000","last_change":"2023-11-04T01:40:04.703516+0000","last_active":"2023-11-04T01:40:09.731575+0000","last_peered":"2023-11-04T01:40:09.731575+0000","last_clean":"2023-11-04T01:40:09.731575+0000","last_became_active":"2023-11-04T01:40:04.703201+0000","last_became_peered":"2023-11-04T01:40:04.703201+0000","last_unstale":"2023-11-04T01:40:09.731575+0000","last_undegraded":"2023-11-04T01:40:09.731575+0000","last_fullsized":"2023-11-04T01:40:09.731575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:25:20.986535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729248+0000","last_change":"2023-11-04T01:40:05.577332+0000","last_active":"2023-11-04T01:40:09.729248+0000","last_peered":"2023-11-04T01:40:09.729248+0000","last_clean":"2023-11-04T01:40:09.729248+0000","last_became_active":"2023-11-04T01:40:05.577054+0000","last_became_peered":"2023-11-04T01:40:05.577054+0000","last_unstale":"2023-11-04T01:40:09.729248+0000","last_undegraded":"2023-11-04T01:40:09.729248+0000","last_fullsized":"2023-11-04T01:40:09.729248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:35:55.027288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256082+0000","last_change":"2023-11-04T01:40:09.746388+0000","last_active":"2023-11-04T01:40:11.256082+0000","last_peered":"2023-11-04T01:40:11.256082+0000","last_clean":"2023-11-04T01:40:11.256082+0000","last_became_active":"2023-11-04T01:40:09.745966+0000","last_became_peered":"2023-11-04T01:40:09.745966+0000","last_unstale":"2023-11-04T01:40:11.256082+0000","last_undegraded":"2023-11-04T01:40:11.256082+0000","last_fullsized":"2023-11-04T01:40:11.256082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:35:59.058711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734112+0000","last_change":"2023-11-04T01:40:05.565842+0000","last_active":"2023-11-04T01:40:09.734112+0000","last_peered":"2023-11-04T01:40:09.734112+0000","last_clean":"2023-11-04T01:40:09.734112+0000","last_became_active":"2023-11-04T01:40:05.565387+0000","last_became_peered":"2023-11-04T01:40:05.565387+0000","last_unstale":"2023-11-04T01:40:09.734112+0000","last_undegraded":"2023-11-04T01:40:09.734112+0000","last_fullsized":"2023-11-04T01:40:09.734112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:44:56.709670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731731+0000","last_change":"2023-11-04T01:40:04.702605+0000","last_active":"2023-11-04T01:40:09.731731+0000","last_peered":"2023-11-04T01:40:09.731731+0000","last_clean":"2023-11-04T01:40:09.731731+0000","last_became_active":"2023-11-04T01:40:04.702242+0000","last_became_peered":"2023-11-04T01:40:04.702242+0000","last_unstale":"2023-11-04T01:40:09.731731+0000","last_undegraded":"2023-11-04T01:40:09.731731+0000","last_fullsized":"2023-11-04T01:40:09.731731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:55:42.496852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256505+0000","last_change":"2023-11-04T01:40:09.748671+0000","last_active":"2023-11-04T01:40:11.256505+0000","last_peered":"2023-11-04T01:40:11.256505+0000","last_clean":"2023-11-04T01:40:11.256505+0000","last_became_active":"2023-11-04T01:40:09.748007+0000","last_became_peered":"2023-11-04T01:40:09.748007+0000","last_unstale":"2023-11-04T01:40:11.256505+0000","last_undegraded":"2023-11-04T01:40:11.256505+0000","last_fullsized":"2023-11-04T01:40:11.256505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:45:21.829187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727707+0000","last_change":"2023-11-04T01:40:05.566650+0000","last_active":"2023-11-04T01:40:09.727707+0000","last_peered":"2023-11-04T01:40:09.727707+0000","last_clean":"2023-11-04T01:40:09.727707+0000","last_became_active":"2023-11-04T01:40:05.566369+0000","last_became_peered":"2023-11-04T01:40:05.566369+0000","last_unstale":"2023-11-04T01:40:09.727707+0000","last_undegraded":"2023-11-04T01:40:09.727707+0000","last_fullsized":"2023-11-04T01:40:09.727707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:17.862444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.735570+0000","last_change":"2023-11-04T01:40:04.699761+0000","last_active":"2023-11-04T01:40:09.735570+0000","last_peered":"2023-11-04T01:40:09.735570+0000","last_clean":"2023-11-04T01:40:09.735570+0000","last_became_active":"2023-11-04T01:40:04.699489+0000","last_became_peered":"2023-11-04T01:40:04.699489+0000","last_unstale":"2023-11-04T01:40:09.735570+0000","last_undegraded":"2023-11-04T01:40:09.735570+0000","last_fullsized":"2023-11-04T01:40:09.735570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:45:56.544854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256468+0000","last_change":"2023-11-04T01:40:09.754113+0000","last_active":"2023-11-04T01:40:11.256468+0000","last_peered":"2023-11-04T01:40:11.256468+0000","last_clean":"2023-11-04T01:40:11.256468+0000","last_became_active":"2023-11-04T01:40:09.753689+0000","last_became_peered":"2023-11-04T01:40:09.753689+0000","last_unstale":"2023-11-04T01:40:11.256468+0000","last_undegraded":"2023-11-04T01:40:11.256468+0000","last_fullsized":"2023-11-04T01:40:11.256468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:49:00.940390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727962+0000","last_change":"2023-11-04T01:40:05.559848+0000","last_active":"2023-11-04T01:40:09.727962+0000","last_peered":"2023-11-04T01:40:09.727962+0000","last_clean":"2023-11-04T01:40:09.727962+0000","last_became_active":"2023-11-04T01:40:05.559384+0000","last_became_peered":"2023-11-04T01:40:05.559384+0000","last_unstale":"2023-11-04T01:40:09.727962+0000","last_undegraded":"2023-11-04T01:40:09.727962+0000","last_fullsized":"2023-11-04T01:40:09.727962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:44:56.709670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.733604+0000","last_change":"2023-11-04T01:40:04.704585+0000","last_active":"2023-11-04T01:40:09.733604+0000","last_peered":"2023-11-04T01:40:09.733604+0000","last_clean":"2023-11-04T01:40:09.733604+0000","last_became_active":"2023-11-04T01:40:04.704325+0000","last_became_peered":"2023-11-04T01:40:04.704325+0000","last_unstale":"2023-11-04T01:40:09.733604+0000","last_undegraded":"2023-11-04T01:40:09.733604+0000","last_fullsized":"2023-11-04T01:40:09.733604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:23.661606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256533+0000","last_change":"2023-11-04T01:40:09.748343+0000","last_active":"2023-11-04T01:40:11.256533+0000","last_peered":"2023-11-04T01:40:11.256533+0000","last_clean":"2023-11-04T01:40:11.256533+0000","last_became_active":"2023-11-04T01:40:09.747762+0000","last_became_peered":"2023-11-04T01:40:09.747762+0000","last_unstale":"2023-11-04T01:40:11.256533+0000","last_undegraded":"2023-11-04T01:40:11.256533+0000","last_fullsized":"2023-11-04T01:40:11.256533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:47.091874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.737227+0000","last_change":"2023-11-04T01:40:05.562694+0000","last_active":"2023-11-04T01:40:09.737227+0000","last_peered":"2023-11-04T01:40:09.737227+0000","last_clean":"2023-11-04T01:40:09.737227+0000","last_became_active":"2023-11-04T01:40:05.562431+0000","last_became_peered":"2023-11-04T01:40:05.562431+0000","last_unstale":"2023-11-04T01:40:09.737227+0000","last_undegraded":"2023-11-04T01:40:09.737227+0000","last_fullsized":"2023-11-04T01:40:09.737227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:12:08.762760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731277+0000","last_change":"2023-11-04T01:40:04.706712+0000","last_active":"2023-11-04T01:40:09.731277+0000","last_peered":"2023-11-04T01:40:09.731277+0000","last_clean":"2023-11-04T01:40:09.731277+0000","last_became_active":"2023-11-04T01:40:04.706369+0000","last_became_peered":"2023-11-04T01:40:04.706369+0000","last_unstale":"2023-11-04T01:40:09.731277+0000","last_undegraded":"2023-11-04T01:40:09.731277+0000","last_fullsized":"2023-11-04T01:40:09.731277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:23.661606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256269+0000","last_change":"2023-11-04T01:40:09.752971+0000","last_active":"2023-11-04T01:40:11.256269+0000","last_peered":"2023-11-04T01:40:11.256269+0000","last_clean":"2023-11-04T01:40:11.256269+0000","last_became_active":"2023-11-04T01:40:09.752569+0000","last_became_peered":"2023-11-04T01:40:09.752569+0000","last_unstale":"2023-11-04T01:40:11.256269+0000","last_undegraded":"2023-11-04T01:40:11.256269+0000","last_fullsized":"2023-11-04T01:40:11.256269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:32:31.515813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.733414+0000","last_change":"2023-11-04T01:40:05.559419+0000","last_active":"2023-11-04T01:40:09.733414+0000","last_peered":"2023-11-04T01:40:09.733414+0000","last_clean":"2023-11-04T01:40:09.733414+0000","last_became_active":"2023-11-04T01:40:05.559176+0000","last_became_peered":"2023-11-04T01:40:05.559176+0000","last_unstale":"2023-11-04T01:40:09.733414+0000","last_undegraded":"2023-11-04T01:40:09.733414+0000","last_fullsized":"2023-11-04T01:40:09.733414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:44:56.709670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.735151+0000","last_change":"2023-11-04T01:40:04.706199+0000","last_active":"2023-11-04T01:40:09.735151+0000","last_peered":"2023-11-04T01:40:09.735151+0000","last_clean":"2023-11-04T01:40:09.735151+0000","last_became_active":"2023-11-04T01:40:04.705913+0000","last_became_peered":"2023-11-04T01:40:04.705913+0000","last_unstale":"2023-11-04T01:40:09.735151+0000","last_undegraded":"2023-11-04T01:40:09.735151+0000","last_fullsized":"2023-11-04T01:40:09.735151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:14:24.322290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256061+0000","last_change":"2023-11-04T01:40:09.744921+0000","last_active":"2023-11-04T01:40:11.256061+0000","last_peered":"2023-11-04T01:40:11.256061+0000","last_clean":"2023-11-04T01:40:11.256061+0000","last_became_active":"2023-11-04T01:40:09.744502+0000","last_became_peered":"2023-11-04T01:40:09.744502+0000","last_unstale":"2023-11-04T01:40:11.256061+0000","last_undegraded":"2023-11-04T01:40:11.256061+0000","last_fullsized":"2023-11-04T01:40:11.256061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:46:22.983063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.728110+0000","last_change":"2023-11-04T01:40:05.559760+0000","last_active":"2023-11-04T01:40:09.728110+0000","last_peered":"2023-11-04T01:40:09.728110+0000","last_clean":"2023-11-04T01:40:09.728110+0000","last_became_active":"2023-11-04T01:40:05.559446+0000","last_became_peered":"2023-11-04T01:40:05.559446+0000","last_unstale":"2023-11-04T01:40:09.728110+0000","last_undegraded":"2023-11-04T01:40:09.728110+0000","last_fullsized":"2023-11-04T01:40:09.728110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:56.908968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734467+0000","last_change":"2023-11-04T01:40:04.708172+0000","last_active":"2023-11-04T01:40:09.734467+0000","last_peered":"2023-11-04T01:40:09.734467+0000","last_clean":"2023-11-04T01:40:09.734467+0000","last_became_active":"2023-11-04T01:40:04.707882+0000","last_became_peered":"2023-11-04T01:40:04.707882+0000","last_unstale":"2023-11-04T01:40:09.734467+0000","last_undegraded":"2023-11-04T01:40:09.734467+0000","last_fullsized":"2023-11-04T01:40:09.734467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:01.195966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.550470+0000","last_change":"2023-11-04T01:40:09.749232+0000","last_active":"2023-11-04T01:40:10.550470+0000","last_peered":"2023-11-04T01:40:10.550470+0000","last_clean":"2023-11-04T01:40:10.550470+0000","last_became_active":"2023-11-04T01:40:09.748638+0000","last_became_peered":"2023-11-04T01:40:09.748638+0000","last_unstale":"2023-11-04T01:40:10.550470+0000","last_undegraded":"2023-11-04T01:40:10.550470+0000","last_fullsized":"2023-11-04T01:40:10.550470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:58.518860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734540+0000","last_change":"2023-11-04T01:40:05.562143+0000","last_active":"2023-11-04T01:40:09.734540+0000","last_peered":"2023-11-04T01:40:09.734540+0000","last_clean":"2023-11-04T01:40:09.734540+0000","last_became_active":"2023-11-04T01:40:05.561862+0000","last_became_peered":"2023-11-04T01:40:05.561862+0000","last_unstale":"2023-11-04T01:40:09.734540+0000","last_undegraded":"2023-11-04T01:40:09.734540+0000","last_fullsized":"2023-11-04T01:40:09.734540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:09:40.586446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732147+0000","last_change":"2023-11-04T01:40:04.710881+0000","last_active":"2023-11-04T01:40:09.732147+0000","last_peered":"2023-11-04T01:40:09.732147+0000","last_clean":"2023-11-04T01:40:09.732147+0000","last_became_active":"2023-11-04T01:40:04.710601+0000","last_became_peered":"2023-11-04T01:40:04.710601+0000","last_unstale":"2023-11-04T01:40:09.732147+0000","last_undegraded":"2023-11-04T01:40:09.732147+0000","last_fullsized":"2023-11-04T01:40:09.732147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:46:17.945642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255709+0000","last_change":"2023-11-04T01:40:09.749485+0000","last_active":"2023-11-04T01:40:11.255709+0000","last_peered":"2023-11-04T01:40:11.255709+0000","last_clean":"2023-11-04T01:40:11.255709+0000","last_became_active":"2023-11-04T01:40:09.748804+0000","last_became_peered":"2023-11-04T01:40:09.748804+0000","last_unstale":"2023-11-04T01:40:11.255709+0000","last_undegraded":"2023-11-04T01:40:11.255709+0000","last_fullsized":"2023-11-04T01:40:11.255709+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:19.049388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729332+0000","last_change":"2023-11-04T01:40:05.571329+0000","last_active":"2023-11-04T01:40:09.729332+0000","last_peered":"2023-11-04T01:40:09.729332+0000","last_clean":"2023-11-04T01:40:09.729332+0000","last_became_active":"2023-11-04T01:40:05.571077+0000","last_became_peered":"2023-11-04T01:40:05.571077+0000","last_unstale":"2023-11-04T01:40:09.729332+0000","last_undegraded":"2023-11-04T01:40:09.729332+0000","last_fullsized":"2023-11-04T01:40:09.729332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:56.908968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734615+0000","last_change":"2023-11-04T01:40:04.710975+0000","last_active":"2023-11-04T01:40:09.734615+0000","last_peered":"2023-11-04T01:40:09.734615+0000","last_clean":"2023-11-04T01:40:09.734615+0000","last_became_active":"2023-11-04T01:40:04.710643+0000","last_became_peered":"2023-11-04T01:40:04.710643+0000","last_unstale":"2023-11-04T01:40:09.734615+0000","last_undegraded":"2023-11-04T01:40:09.734615+0000","last_fullsized":"2023-11-04T01:40:09.734615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:55:42.496852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255585+0000","last_change":"2023-11-04T01:40:09.745566+0000","last_active":"2023-11-04T01:40:11.255585+0000","last_peered":"2023-11-04T01:40:11.255585+0000","last_clean":"2023-11-04T01:40:11.255585+0000","last_became_active":"2023-11-04T01:40:09.745232+0000","last_became_peered":"2023-11-04T01:40:09.745232+0000","last_unstale":"2023-11-04T01:40:11.255585+0000","last_undegraded":"2023-11-04T01:40:11.255585+0000","last_fullsized":"2023-11-04T01:40:11.255585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:18:59.903542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734765+0000","last_change":"2023-11-04T01:40:05.566450+0000","last_active":"2023-11-04T01:40:09.734765+0000","last_peered":"2023-11-04T01:40:09.734765+0000","last_clean":"2023-11-04T01:40:09.734765+0000","last_became_active":"2023-11-04T01:40:05.565477+0000","last_became_peered":"2023-11-04T01:40:05.565477+0000","last_unstale":"2023-11-04T01:40:09.734765+0000","last_undegraded":"2023-11-04T01:40:09.734765+0000","last_fullsized":"2023-11-04T01:40:09.734765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:45:02.590707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.730048+0000","last_change":"2023-11-04T01:40:04.707185+0000","last_active":"2023-11-04T01:40:09.730048+0000","last_peered":"2023-11-04T01:40:09.730048+0000","last_clean":"2023-11-04T01:40:09.730048+0000","last_became_active":"2023-11-04T01:40:04.706814+0000","last_became_peered":"2023-11-04T01:40:04.706814+0000","last_unstale":"2023-11-04T01:40:09.730048+0000","last_undegraded":"2023-11-04T01:40:09.730048+0000","last_fullsized":"2023-11-04T01:40:09.730048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:51:08.117585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256134+0000","last_change":"2023-11-04T01:40:09.751263+0000","last_active":"2023-11-04T01:40:11.256134+0000","last_peered":"2023-11-04T01:40:11.256134+0000","last_clean":"2023-11-04T01:40:11.256134+0000","last_became_active":"2023-11-04T01:40:09.750948+0000","last_became_peered":"2023-11-04T01:40:09.750948+0000","last_unstale":"2023-11-04T01:40:11.256134+0000","last_undegraded":"2023-11-04T01:40:11.256134+0000","last_fullsized":"2023-11-04T01:40:11.256134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:14:21.977139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.736252+0000","last_change":"2023-11-04T01:40:05.562139+0000","last_active":"2023-11-04T01:40:09.736252+0000","last_peered":"2023-11-04T01:40:09.736252+0000","last_clean":"2023-11-04T01:40:09.736252+0000","last_became_active":"2023-11-04T01:40:05.561872+0000","last_became_peered":"2023-11-04T01:40:05.561872+0000","last_unstale":"2023-11-04T01:40:09.736252+0000","last_undegraded":"2023-11-04T01:40:09.736252+0000","last_fullsized":"2023-11-04T01:40:09.736252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:44:56.709670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.736987+0000","last_change":"2023-11-04T01:40:04.697746+0000","last_active":"2023-11-04T01:40:09.736987+0000","last_peered":"2023-11-04T01:40:09.736987+0000","last_clean":"2023-11-04T01:40:09.736987+0000","last_became_active":"2023-11-04T01:40:04.697469+0000","last_became_peered":"2023-11-04T01:40:04.697469+0000","last_unstale":"2023-11-04T01:40:09.736987+0000","last_undegraded":"2023-11-04T01:40:09.736987+0000","last_fullsized":"2023-11-04T01:40:09.736987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:12:07.756761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256639+0000","last_change":"2023-11-04T01:40:09.746485+0000","last_active":"2023-11-04T01:40:11.256639+0000","last_peered":"2023-11-04T01:40:11.256639+0000","last_clean":"2023-11-04T01:40:11.256639+0000","last_became_active":"2023-11-04T01:40:09.746134+0000","last_became_peered":"2023-11-04T01:40:09.746134+0000","last_unstale":"2023-11-04T01:40:11.256639+0000","last_undegraded":"2023-11-04T01:40:11.256639+0000","last_fullsized":"2023-11-04T01:40:11.256639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:25.883087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731984+0000","last_change":"2023-11-04T01:40:05.560837+0000","last_active":"2023-11-04T01:40:09.731984+0000","last_peered":"2023-11-04T01:40:09.731984+0000","last_clean":"2023-11-04T01:40:09.731984+0000","last_became_active":"2023-11-04T01:40:05.560083+0000","last_became_peered":"2023-11-04T01:40:05.560083+0000","last_unstale":"2023-11-04T01:40:09.731984+0000","last_undegraded":"2023-11-04T01:40:09.731984+0000","last_fullsized":"2023-11-04T01:40:09.731984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:45:57.550853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731654+0000","last_change":"2023-11-04T01:40:04.704308+0000","last_active":"2023-11-04T01:40:09.731654+0000","last_peered":"2023-11-04T01:40:09.731654+0000","last_clean":"2023-11-04T01:40:09.731654+0000","last_became_active":"2023-11-04T01:40:04.703783+0000","last_became_peered":"2023-11-04T01:40:04.703783+0000","last_unstale":"2023-11-04T01:40:09.731654+0000","last_undegraded":"2023-11-04T01:40:09.731654+0000","last_fullsized":"2023-11-04T01:40:09.731654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:35.223156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255849+0000","last_change":"2023-11-04T01:40:09.748878+0000","last_active":"2023-11-04T01:40:11.255849+0000","last_peered":"2023-11-04T01:40:11.255849+0000","last_clean":"2023-11-04T01:40:11.255849+0000","last_became_active":"2023-11-04T01:40:09.748399+0000","last_became_peered":"2023-11-04T01:40:09.748399+0000","last_unstale":"2023-11-04T01:40:11.255849+0000","last_undegraded":"2023-11-04T01:40:11.255849+0000","last_fullsized":"2023-11-04T01:40:11.255849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:14:21.977139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727379+0000","last_change":"2023-11-04T01:40:05.579730+0000","last_active":"2023-11-04T01:40:09.727379+0000","last_peered":"2023-11-04T01:40:09.727379+0000","last_clean":"2023-11-04T01:40:09.727379+0000","last_became_active":"2023-11-04T01:40:05.579457+0000","last_became_peered":"2023-11-04T01:40:05.579457+0000","last_unstale":"2023-11-04T01:40:09.727379+0000","last_undegraded":"2023-11-04T01:40:09.727379+0000","last_fullsized":"2023-11-04T01:40:09.727379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:09:40.586446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.728766+0000","last_change":"2023-11-04T01:40:04.707059+0000","last_active":"2023-11-04T01:40:09.728766+0000","last_peered":"2023-11-04T01:40:09.728766+0000","last_clean":"2023-11-04T01:40:09.728766+0000","last_became_active":"2023-11-04T01:40:04.706619+0000","last_became_peered":"2023-11-04T01:40:04.706619+0000","last_unstale":"2023-11-04T01:40:09.728766+0000","last_undegraded":"2023-11-04T01:40:09.728766+0000","last_fullsized":"2023-11-04T01:40:09.728766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:44:55.703672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731611+0000","last_change":"2023-11-04T01:39:54.204460+0000","last_active":"2023-11-04T01:40:09.731611+0000","last_peered":"2023-11-04T01:40:09.731611+0000","last_clean":"2023-11-04T01:40:09.731611+0000","last_became_active":"2023-11-04T01:39:54.203352+0000","last_became_peered":"2023-11-04T01:39:54.203352+0000","last_unstale":"2023-11-04T01:40:09.731611+0000","last_undegraded":"2023-11-04T01:40:09.731611+0000","last_fullsized":"2023-11-04T01:40:09.731611+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:52.627032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:52.627032+0000","last_clean_scrub_stamp":"2023-11-04T01:39:52.627032+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:17:18.474768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.550355+0000","last_change":"2023-11-04T01:40:09.744111+0000","last_active":"2023-11-04T01:40:10.550355+0000","last_peered":"2023-11-04T01:40:10.550355+0000","last_clean":"2023-11-04T01:40:10.550355+0000","last_became_active":"2023-11-04T01:40:09.743657+0000","last_became_peered":"2023-11-04T01:40:09.743657+0000","last_unstale":"2023-11-04T01:40:10.550355+0000","last_undegraded":"2023-11-04T01:40:10.550355+0000","last_fullsized":"2023-11-04T01:40:10.550355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:18:59.903542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731749+0000","last_change":"2023-11-04T01:40:05.577079+0000","last_active":"2023-11-04T01:40:09.731749+0000","last_peered":"2023-11-04T01:40:09.731749+0000","last_clean":"2023-11-04T01:40:09.731749+0000","last_became_active":"2023-11-04T01:40:05.576722+0000","last_became_peered":"2023-11-04T01:40:05.576722+0000","last_unstale":"2023-11-04T01:40:09.731749+0000","last_undegraded":"2023-11-04T01:40:09.731749+0000","last_fullsized":"2023-11-04T01:40:09.731749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:18:55.872119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.739610+0000","last_change":"2023-11-04T01:40:04.708618+0000","last_active":"2023-11-04T01:40:09.739610+0000","last_peered":"2023-11-04T01:40:09.739610+0000","last_clean":"2023-11-04T01:40:09.739610+0000","last_became_active":"2023-11-04T01:40:04.708294+0000","last_became_peered":"2023-11-04T01:40:04.708294+0000","last_unstale":"2023-11-04T01:40:09.739610+0000","last_undegraded":"2023-11-04T01:40:09.739610+0000","last_fullsized":"2023-11-04T01:40:09.739610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:58:25.853829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.549398+0000","last_change":"2023-11-04T01:40:09.743960+0000","last_active":"2023-11-04T01:40:10.549398+0000","last_peered":"2023-11-04T01:40:10.549398+0000","last_clean":"2023-11-04T01:40:10.549398+0000","last_became_active":"2023-11-04T01:40:09.743539+0000","last_became_peered":"2023-11-04T01:40:09.743539+0000","last_unstale":"2023-11-04T01:40:10.549398+0000","last_undegraded":"2023-11-04T01:40:10.549398+0000","last_fullsized":"2023-11-04T01:40:10.549398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:45:21.829187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729678+0000","last_change":"2023-11-04T01:40:05.571294+0000","last_active":"2023-11-04T01:40:09.729678+0000","last_peered":"2023-11-04T01:40:09.729678+0000","last_clean":"2023-11-04T01:40:09.729678+0000","last_became_active":"2023-11-04T01:40:05.570961+0000","last_became_peered":"2023-11-04T01:40:05.570961+0000","last_unstale":"2023-11-04T01:40:09.729678+0000","last_undegraded":"2023-11-04T01:40:09.729678+0000","last_fullsized":"2023-11-04T01:40:09.729678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:14:17.945716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734901+0000","last_change":"2023-11-04T01:40:04.700593+0000","last_active":"2023-11-04T01:40:09.734901+0000","last_peered":"2023-11-04T01:40:09.734901+0000","last_clean":"2023-11-04T01:40:09.734901+0000","last_became_active":"2023-11-04T01:40:04.700051+0000","last_became_peered":"2023-11-04T01:40:04.700051+0000","last_unstale":"2023-11-04T01:40:09.734901+0000","last_undegraded":"2023-11-04T01:40:09.734901+0000","last_fullsized":"2023-11-04T01:40:09.734901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:14:24.322290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255865+0000","last_change":"2023-11-04T01:40:09.749244+0000","last_active":"2023-11-04T01:40:11.255865+0000","last_peered":"2023-11-04T01:40:11.255865+0000","last_clean":"2023-11-04T01:40:11.255865+0000","last_became_active":"2023-11-04T01:40:09.748229+0000","last_became_peered":"2023-11-04T01:40:09.748229+0000","last_unstale":"2023-11-04T01:40:11.255865+0000","last_undegraded":"2023-11-04T01:40:11.255865+0000","last_fullsized":"2023-11-04T01:40:11.255865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:47.091874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732531+0000","last_change":"2023-11-04T01:40:05.564770+0000","last_active":"2023-11-04T01:40:09.732531+0000","last_peered":"2023-11-04T01:40:09.732531+0000","last_clean":"2023-11-04T01:40:09.732531+0000","last_became_active":"2023-11-04T01:40:05.564483+0000","last_became_peered":"2023-11-04T01:40:05.564483+0000","last_unstale":"2023-11-04T01:40:09.732531+0000","last_undegraded":"2023-11-04T01:40:09.732531+0000","last_fullsized":"2023-11-04T01:40:09.732531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:54.487437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.737108+0000","last_change":"2023-11-04T01:40:04.698832+0000","last_active":"2023-11-04T01:40:09.737108+0000","last_peered":"2023-11-04T01:40:09.737108+0000","last_clean":"2023-11-04T01:40:09.737108+0000","last_became_active":"2023-11-04T01:40:04.698498+0000","last_became_peered":"2023-11-04T01:40:04.698498+0000","last_unstale":"2023-11-04T01:40:09.737108+0000","last_undegraded":"2023-11-04T01:40:09.737108+0000","last_fullsized":"2023-11-04T01:40:09.737108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:02:39.769313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255109+0000","last_change":"2023-11-04T01:40:09.744405+0000","last_active":"2023-11-04T01:40:11.255109+0000","last_peered":"2023-11-04T01:40:11.255109+0000","last_clean":"2023-11-04T01:40:11.255109+0000","last_became_active":"2023-11-04T01:40:09.743992+0000","last_became_peered":"2023-11-04T01:40:09.743992+0000","last_unstale":"2023-11-04T01:40:11.255109+0000","last_undegraded":"2023-11-04T01:40:11.255109+0000","last_fullsized":"2023-11-04T01:40:11.255109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:23:03.976941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732033+0000","last_change":"2023-11-04T01:40:05.565058+0000","last_active":"2023-11-04T01:40:09.732033+0000","last_peered":"2023-11-04T01:40:09.732033+0000","last_clean":"2023-11-04T01:40:09.732033+0000","last_became_active":"2023-11-04T01:40:05.564784+0000","last_became_peered":"2023-11-04T01:40:05.564784+0000","last_unstale":"2023-11-04T01:40:09.732033+0000","last_undegraded":"2023-11-04T01:40:09.732033+0000","last_fullsized":"2023-11-04T01:40:09.732033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:15.017965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732789+0000","last_change":"2023-11-04T01:40:04.699612+0000","last_active":"2023-11-04T01:40:09.732789+0000","last_peered":"2023-11-04T01:40:09.732789+0000","last_clean":"2023-11-04T01:40:09.732789+0000","last_became_active":"2023-11-04T01:40:04.697978+0000","last_became_peered":"2023-11-04T01:40:04.697978+0000","last_unstale":"2023-11-04T01:40:09.732789+0000","last_undegraded":"2023-11-04T01:40:09.732789+0000","last_fullsized":"2023-11-04T01:40:09.732789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:11:00.897268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255902+0000","last_change":"2023-11-04T01:40:09.753878+0000","last_active":"2023-11-04T01:40:11.255902+0000","last_peered":"2023-11-04T01:40:11.255902+0000","last_clean":"2023-11-04T01:40:11.255902+0000","last_became_active":"2023-11-04T01:40:09.753521+0000","last_became_peered":"2023-11-04T01:40:09.753521+0000","last_unstale":"2023-11-04T01:40:11.255902+0000","last_undegraded":"2023-11-04T01:40:11.255902+0000","last_fullsized":"2023-11-04T01:40:11.255902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:21.893866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731429+0000","last_change":"2023-11-04T01:40:05.561139+0000","last_active":"2023-11-04T01:40:09.731429+0000","last_peered":"2023-11-04T01:40:09.731429+0000","last_clean":"2023-11-04T01:40:09.731429+0000","last_became_active":"2023-11-04T01:40:05.560824+0000","last_became_peered":"2023-11-04T01:40:05.560824+0000","last_unstale":"2023-11-04T01:40:09.731429+0000","last_undegraded":"2023-11-04T01:40:09.731429+0000","last_fullsized":"2023-11-04T01:40:09.731429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:32:27.484390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.736542+0000","last_change":"2023-11-04T01:40:04.704879+0000","last_active":"2023-11-04T01:40:09.736542+0000","last_peered":"2023-11-04T01:40:09.736542+0000","last_clean":"2023-11-04T01:40:09.736542+0000","last_became_active":"2023-11-04T01:40:04.704561+0000","last_became_peered":"2023-11-04T01:40:04.704561+0000","last_unstale":"2023-11-04T01:40:09.736542+0000","last_undegraded":"2023-11-04T01:40:09.736542+0000","last_fullsized":"2023-11-04T01:40:09.736542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:35.223156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256043+0000","last_change":"2023-11-04T01:40:09.743050+0000","last_active":"2023-11-04T01:40:11.256043+0000","last_peered":"2023-11-04T01:40:11.256043+0000","last_clean":"2023-11-04T01:40:11.256043+0000","last_became_active":"2023-11-04T01:40:09.742685+0000","last_became_peered":"2023-11-04T01:40:09.742685+0000","last_unstale":"2023-11-04T01:40:11.256043+0000","last_undegraded":"2023-11-04T01:40:11.256043+0000","last_fullsized":"2023-11-04T01:40:11.256043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:25.883087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.737349+0000","last_change":"2023-11-04T01:40:05.566982+0000","last_active":"2023-11-04T01:40:09.737349+0000","last_peered":"2023-11-04T01:40:09.737349+0000","last_clean":"2023-11-04T01:40:09.737349+0000","last_became_active":"2023-11-04T01:40:05.566400+0000","last_became_peered":"2023-11-04T01:40:05.566400+0000","last_unstale":"2023-11-04T01:40:09.737349+0000","last_undegraded":"2023-11-04T01:40:09.737349+0000","last_fullsized":"2023-11-04T01:40:09.737349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:24.555185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.738136+0000","last_change":"2023-11-04T01:40:04.702671+0000","last_active":"2023-11-04T01:40:09.738136+0000","last_peered":"2023-11-04T01:40:09.738136+0000","last_clean":"2023-11-04T01:40:09.738136+0000","last_became_active":"2023-11-04T01:40:04.702403+0000","last_became_peered":"2023-11-04T01:40:04.702403+0000","last_unstale":"2023-11-04T01:40:09.738136+0000","last_undegraded":"2023-11-04T01:40:09.738136+0000","last_fullsized":"2023-11-04T01:40:09.738136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:23.661606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.551245+0000","last_change":"2023-11-04T01:40:09.750337+0000","last_active":"2023-11-04T01:40:10.551245+0000","last_peered":"2023-11-04T01:40:10.551245+0000","last_clean":"2023-11-04T01:40:10.551245+0000","last_became_active":"2023-11-04T01:40:09.748314+0000","last_became_peered":"2023-11-04T01:40:09.748314+0000","last_unstale":"2023-11-04T01:40:10.551245+0000","last_undegraded":"2023-11-04T01:40:10.551245+0000","last_fullsized":"2023-11-04T01:40:10.551245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:59:19.908042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731576+0000","last_change":"2023-11-04T01:40:05.568489+0000","last_active":"2023-11-04T01:40:09.731576+0000","last_peered":"2023-11-04T01:40:09.731576+0000","last_clean":"2023-11-04T01:40:09.731576+0000","last_became_active":"2023-11-04T01:40:05.568169+0000","last_became_peered":"2023-11-04T01:40:05.568169+0000","last_unstale":"2023-11-04T01:40:09.731576+0000","last_undegraded":"2023-11-04T01:40:09.731576+0000","last_fullsized":"2023-11-04T01:40:09.731576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:45:17.797764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729951+0000","last_change":"2023-11-04T01:40:04.707560+0000","last_active":"2023-11-04T01:40:09.729951+0000","last_peered":"2023-11-04T01:40:09.729951+0000","last_clean":"2023-11-04T01:40:09.729951+0000","last_became_active":"2023-11-04T01:40:04.707230+0000","last_became_peered":"2023-11-04T01:40:04.707230+0000","last_unstale":"2023-11-04T01:40:09.729951+0000","last_undegraded":"2023-11-04T01:40:09.729951+0000","last_fullsized":"2023-11-04T01:40:09.729951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:23.549186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.551075+0000","last_change":"2023-11-04T01:40:09.750047+0000","last_active":"2023-11-04T01:40:10.551075+0000","last_peered":"2023-11-04T01:40:10.551075+0000","last_clean":"2023-11-04T01:40:10.551075+0000","last_became_active":"2023-11-04T01:40:09.749057+0000","last_became_peered":"2023-11-04T01:40:09.749057+0000","last_unstale":"2023-11-04T01:40:10.551075+0000","last_undegraded":"2023-11-04T01:40:10.551075+0000","last_fullsized":"2023-11-04T01:40:10.551075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:22:24.152135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732097+0000","last_change":"2023-11-04T01:40:05.558257+0000","last_active":"2023-11-04T01:40:09.732097+0000","last_peered":"2023-11-04T01:40:09.732097+0000","last_clean":"2023-11-04T01:40:09.732097+0000","last_became_active":"2023-11-04T01:40:05.557891+0000","last_became_peered":"2023-11-04T01:40:05.557891+0000","last_unstale":"2023-11-04T01:40:09.732097+0000","last_undegraded":"2023-11-04T01:40:09.732097+0000","last_fullsized":"2023-11-04T01:40:09.732097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:24.555185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732974+0000","last_change":"2023-11-04T01:40:04.698298+0000","last_active":"2023-11-04T01:40:09.732974+0000","last_peered":"2023-11-04T01:40:09.732974+0000","last_clean":"2023-11-04T01:40:09.732974+0000","last_became_active":"2023-11-04T01:40:04.697835+0000","last_became_peered":"2023-11-04T01:40:04.697835+0000","last_unstale":"2023-11-04T01:40:09.732974+0000","last_undegraded":"2023-11-04T01:40:09.732974+0000","last_fullsized":"2023-11-04T01:40:09.732974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:35.223156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255855+0000","last_change":"2023-11-04T01:40:09.742018+0000","last_active":"2023-11-04T01:40:11.255855+0000","last_peered":"2023-11-04T01:40:11.255855+0000","last_clean":"2023-11-04T01:40:11.255855+0000","last_became_active":"2023-11-04T01:40:09.741656+0000","last_became_peered":"2023-11-04T01:40:09.741656+0000","last_unstale":"2023-11-04T01:40:11.255855+0000","last_undegraded":"2023-11-04T01:40:11.255855+0000","last_fullsized":"2023-11-04T01:40:11.255855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:59:48.059889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731464+0000","last_change":"2023-11-04T01:40:05.561050+0000","last_active":"2023-11-04T01:40:09.731464+0000","last_peered":"2023-11-04T01:40:09.731464+0000","last_clean":"2023-11-04T01:40:09.731464+0000","last_became_active":"2023-11-04T01:40:05.560752+0000","last_became_peered":"2023-11-04T01:40:05.560752+0000","last_unstale":"2023-11-04T01:40:09.731464+0000","last_undegraded":"2023-11-04T01:40:09.731464+0000","last_fullsized":"2023-11-04T01:40:09.731464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:56.908968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:16.072010+0000","last_change":"2023-11-04T01:40:04.700840+0000","last_active":"2023-11-04T01:40:16.072010+0000","last_peered":"2023-11-04T01:40:16.072010+0000","last_clean":"2023-11-04T01:40:16.072010+0000","last_became_active":"2023-11-04T01:40:04.700524+0000","last_became_peered":"2023-11-04T01:40:04.700524+0000","last_unstale":"2023-11-04T01:40:16.072010+0000","last_undegraded":"2023-11-04T01:40:16.072010+0000","last_fullsized":"2023-11-04T01:40:16.072010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:45:56.544854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255711+0000","last_change":"2023-11-04T01:40:09.747985+0000","last_active":"2023-11-04T01:40:11.255711+0000","last_peered":"2023-11-04T01:40:11.255711+0000","last_clean":"2023-11-04T01:40:11.255711+0000","last_became_active":"2023-11-04T01:40:09.747607+0000","last_became_peered":"2023-11-04T01:40:09.747607+0000","last_unstale":"2023-11-04T01:40:11.255711+0000","last_undegraded":"2023-11-04T01:40:11.255711+0000","last_fullsized":"2023-11-04T01:40:11.255711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:19.049388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.737830+0000","last_change":"2023-11-04T01:40:05.560889+0000","last_active":"2023-11-04T01:40:09.737830+0000","last_peered":"2023-11-04T01:40:09.737830+0000","last_clean":"2023-11-04T01:40:09.737830+0000","last_became_active":"2023-11-04T01:40:05.560631+0000","last_became_peered":"2023-11-04T01:40:05.560631+0000","last_unstale":"2023-11-04T01:40:09.737830+0000","last_undegraded":"2023-11-04T01:40:09.737830+0000","last_fullsized":"2023-11-04T01:40:09.737830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:02:40.775312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734805+0000","last_change":"2023-11-04T01:40:04.708390+0000","last_active":"2023-11-04T01:40:09.734805+0000","last_peered":"2023-11-04T01:40:09.734805+0000","last_clean":"2023-11-04T01:40:09.734805+0000","last_became_active":"2023-11-04T01:40:04.708142+0000","last_became_peered":"2023-11-04T01:40:04.708142+0000","last_unstale":"2023-11-04T01:40:09.734805+0000","last_undegraded":"2023-11-04T01:40:09.734805+0000","last_fullsized":"2023-11-04T01:40:09.734805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:15:03.573413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256687+0000","last_change":"2023-11-04T01:40:09.748503+0000","last_active":"2023-11-04T01:40:11.256687+0000","last_peered":"2023-11-04T01:40:11.256687+0000","last_clean":"2023-11-04T01:40:11.256687+0000","last_became_active":"2023-11-04T01:40:09.748074+0000","last_became_peered":"2023-11-04T01:40:09.748074+0000","last_unstale":"2023-11-04T01:40:11.256687+0000","last_undegraded":"2023-11-04T01:40:11.256687+0000","last_fullsized":"2023-11-04T01:40:11.256687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:18:59.903542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734280+0000","last_change":"2023-11-04T01:40:05.578830+0000","last_active":"2023-11-04T01:40:09.734280+0000","last_peered":"2023-11-04T01:40:09.734280+0000","last_clean":"2023-11-04T01:40:09.734280+0000","last_became_active":"2023-11-04T01:40:05.578600+0000","last_became_peered":"2023-11-04T01:40:05.578600+0000","last_unstale":"2023-11-04T01:40:09.734280+0000","last_undegraded":"2023-11-04T01:40:09.734280+0000","last_fullsized":"2023-11-04T01:40:09.734280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:17.862444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729084+0000","last_change":"2023-11-04T01:40:04.712885+0000","last_active":"2023-11-04T01:40:09.729084+0000","last_peered":"2023-11-04T01:40:09.729084+0000","last_clean":"2023-11-04T01:40:09.729084+0000","last_became_active":"2023-11-04T01:40:04.712596+0000","last_became_peered":"2023-11-04T01:40:04.712596+0000","last_unstale":"2023-11-04T01:40:09.729084+0000","last_undegraded":"2023-11-04T01:40:09.729084+0000","last_fullsized":"2023-11-04T01:40:09.729084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:01.195966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.550952+0000","last_change":"2023-11-04T01:40:09.749818+0000","last_active":"2023-11-04T01:40:10.550952+0000","last_peered":"2023-11-04T01:40:10.550952+0000","last_clean":"2023-11-04T01:40:10.550952+0000","last_became_active":"2023-11-04T01:40:09.749447+0000","last_became_peered":"2023-11-04T01:40:09.749447+0000","last_unstale":"2023-11-04T01:40:10.550952+0000","last_undegraded":"2023-11-04T01:40:10.550952+0000","last_fullsized":"2023-11-04T01:40:10.550952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:14:02.598554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729015+0000","last_change":"2023-11-04T01:40:05.576921+0000","last_active":"2023-11-04T01:40:09.729015+0000","last_peered":"2023-11-04T01:40:09.729015+0000","last_clean":"2023-11-04T01:40:09.729015+0000","last_became_active":"2023-11-04T01:40:05.576105+0000","last_became_peered":"2023-11-04T01:40:05.576105+0000","last_unstale":"2023-11-04T01:40:09.729015+0000","last_undegraded":"2023-11-04T01:40:09.729015+0000","last_fullsized":"2023-11-04T01:40:09.729015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:32:27.484390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.735071+0000","last_change":"2023-11-04T01:40:04.708447+0000","last_active":"2023-11-04T01:40:09.735071+0000","last_peered":"2023-11-04T01:40:09.735071+0000","last_clean":"2023-11-04T01:40:09.735071+0000","last_became_active":"2023-11-04T01:40:04.708148+0000","last_became_peered":"2023-11-04T01:40:04.708148+0000","last_unstale":"2023-11-04T01:40:09.735071+0000","last_undegraded":"2023-11-04T01:40:09.735071+0000","last_fullsized":"2023-11-04T01:40:09.735071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:15:03.573413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.550821+0000","last_change":"2023-11-04T01:40:09.750214+0000","last_active":"2023-11-04T01:40:10.550821+0000","last_peered":"2023-11-04T01:40:10.550821+0000","last_clean":"2023-11-04T01:40:10.550821+0000","last_became_active":"2023-11-04T01:40:09.746156+0000","last_became_peered":"2023-11-04T01:40:09.746156+0000","last_unstale":"2023-11-04T01:40:10.550821+0000","last_undegraded":"2023-11-04T01:40:10.550821+0000","last_fullsized":"2023-11-04T01:40:10.550821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:59:48.059889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255702+0000","last_change":"2023-11-04T01:40:09.749952+0000","last_active":"2023-11-04T01:40:11.255702+0000","last_peered":"2023-11-04T01:40:11.255702+0000","last_clean":"2023-11-04T01:40:11.255702+0000","last_became_active":"2023-11-04T01:40:09.749363+0000","last_became_peered":"2023-11-04T01:40:09.749363+0000","last_unstale":"2023-11-04T01:40:11.255702+0000","last_undegraded":"2023-11-04T01:40:11.255702+0000","last_fullsized":"2023-11-04T01:40:11.255702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:18:59.903542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.733435+0000","last_change":"2023-11-04T01:40:05.560460+0000","last_active":"2023-11-04T01:40:09.733435+0000","last_peered":"2023-11-04T01:40:09.733435+0000","last_clean":"2023-11-04T01:40:09.733435+0000","last_became_active":"2023-11-04T01:40:05.560165+0000","last_became_peered":"2023-11-04T01:40:05.560165+0000","last_unstale":"2023-11-04T01:40:09.733435+0000","last_undegraded":"2023-11-04T01:40:09.733435+0000","last_fullsized":"2023-11-04T01:40:09.733435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:24.555185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.728844+0000","last_change":"2023-11-04T01:40:04.708233+0000","last_active":"2023-11-04T01:40:09.728844+0000","last_peered":"2023-11-04T01:40:09.728844+0000","last_clean":"2023-11-04T01:40:09.728844+0000","last_became_active":"2023-11-04T01:40:04.707913+0000","last_became_peered":"2023-11-04T01:40:04.707913+0000","last_unstale":"2023-11-04T01:40:09.728844+0000","last_undegraded":"2023-11-04T01:40:09.728844+0000","last_fullsized":"2023-11-04T01:40:09.728844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:14:24.322290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.549797+0000","last_change":"2023-11-04T01:40:09.743651+0000","last_active":"2023-11-04T01:40:10.549797+0000","last_peered":"2023-11-04T01:40:10.549797+0000","last_clean":"2023-11-04T01:40:10.549797+0000","last_became_active":"2023-11-04T01:40:09.743132+0000","last_became_peered":"2023-11-04T01:40:09.743132+0000","last_unstale":"2023-11-04T01:40:10.549797+0000","last_undegraded":"2023-11-04T01:40:10.549797+0000","last_fullsized":"2023-11-04T01:40:10.549797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:09:57.363528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727847+0000","last_change":"2023-11-04T01:40:05.568979+0000","last_active":"2023-11-04T01:40:09.727847+0000","last_peered":"2023-11-04T01:40:09.727847+0000","last_clean":"2023-11-04T01:40:09.727847+0000","last_became_active":"2023-11-04T01:40:05.568692+0000","last_became_peered":"2023-11-04T01:40:05.568692+0000","last_unstale":"2023-11-04T01:40:09.727847+0000","last_undegraded":"2023-11-04T01:40:09.727847+0000","last_fullsized":"2023-11-04T01:40:09.727847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:24.555185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727941+0000","last_change":"2023-11-04T01:40:04.703998+0000","last_active":"2023-11-04T01:40:09.727941+0000","last_peered":"2023-11-04T01:40:09.727941+0000","last_clean":"2023-11-04T01:40:09.727941+0000","last_became_active":"2023-11-04T01:40:04.703732+0000","last_became_peered":"2023-11-04T01:40:04.703732+0000","last_unstale":"2023-11-04T01:40:09.727941+0000","last_undegraded":"2023-11-04T01:40:09.727941+0000","last_fullsized":"2023-11-04T01:40:09.727941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:15:03.573413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734226+0000","last_change":"2023-11-04T01:40:04.705664+0000","last_active":"2023-11-04T01:40:09.734226+0000","last_peered":"2023-11-04T01:40:09.734226+0000","last_clean":"2023-11-04T01:40:09.734226+0000","last_became_active":"2023-11-04T01:40:04.705126+0000","last_became_peered":"2023-11-04T01:40:04.705126+0000","last_unstale":"2023-11-04T01:40:09.734226+0000","last_undegraded":"2023-11-04T01:40:09.734226+0000","last_fullsized":"2023-11-04T01:40:09.734226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:55:42.496852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732896+0000","last_change":"2023-11-04T01:40:05.560706+0000","last_active":"2023-11-04T01:40:09.732896+0000","last_peered":"2023-11-04T01:40:09.732896+0000","last_clean":"2023-11-04T01:40:09.732896+0000","last_became_active":"2023-11-04T01:40:05.560192+0000","last_became_peered":"2023-11-04T01:40:05.560192+0000","last_unstale":"2023-11-04T01:40:09.732896+0000","last_undegraded":"2023-11-04T01:40:09.732896+0000","last_fullsized":"2023-11-04T01:40:09.732896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:02.182321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255328+0000","last_change":"2023-11-04T01:40:09.754009+0000","last_active":"2023-11-04T01:40:11.255328+0000","last_peered":"2023-11-04T01:40:11.255328+0000","last_clean":"2023-11-04T01:40:11.255328+0000","last_became_active":"2023-11-04T01:40:09.753444+0000","last_became_peered":"2023-11-04T01:40:09.753444+0000","last_unstale":"2023-11-04T01:40:11.255328+0000","last_undegraded":"2023-11-04T01:40:11.255328+0000","last_fullsized":"2023-11-04T01:40:11.255328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:01.582276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727803+0000","last_change":"2023-11-04T01:40:04.701551+0000","last_active":"2023-11-04T01:40:09.727803+0000","last_peered":"2023-11-04T01:40:09.727803+0000","last_clean":"2023-11-04T01:40:09.727803+0000","last_became_active":"2023-11-04T01:40:04.701340+0000","last_became_peered":"2023-11-04T01:40:04.701340+0000","last_unstale":"2023-11-04T01:40:09.727803+0000","last_undegraded":"2023-11-04T01:40:09.727803+0000","last_fullsized":"2023-11-04T01:40:09.727803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:45:01.584709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.736946+0000","last_change":"2023-11-04T01:40:05.564231+0000","last_active":"2023-11-04T01:40:09.736946+0000","last_peered":"2023-11-04T01:40:09.736946+0000","last_clean":"2023-11-04T01:40:09.736946+0000","last_became_active":"2023-11-04T01:40:05.563931+0000","last_became_peered":"2023-11-04T01:40:05.563931+0000","last_unstale":"2023-11-04T01:40:09.736946+0000","last_undegraded":"2023-11-04T01:40:09.736946+0000","last_fullsized":"2023-11-04T01:40:09.736946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:25:21.992534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.551057+0000","last_change":"2023-11-04T01:40:09.744711+0000","last_active":"2023-11-04T01:40:10.551057+0000","last_peered":"2023-11-04T01:40:10.551057+0000","last_clean":"2023-11-04T01:40:10.551057+0000","last_became_active":"2023-11-04T01:40:09.744338+0000","last_became_peered":"2023-11-04T01:40:09.744338+0000","last_unstale":"2023-11-04T01:40:10.551057+0000","last_undegraded":"2023-11-04T01:40:10.551057+0000","last_fullsized":"2023-11-04T01:40:10.551057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:49:35.523050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.737269+0000","last_change":"2023-11-04T01:40:05.567145+0000","last_active":"2023-11-04T01:40:09.737269+0000","last_peered":"2023-11-04T01:40:09.737269+0000","last_clean":"2023-11-04T01:40:09.737269+0000","last_became_active":"2023-11-04T01:40:05.566731+0000","last_became_peered":"2023-11-04T01:40:05.566731+0000","last_unstale":"2023-11-04T01:40:09.737269+0000","last_undegraded":"2023-11-04T01:40:09.737269+0000","last_fullsized":"2023-11-04T01:40:09.737269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:51:09.123583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.736001+0000","last_change":"2023-11-04T01:40:05.579375+0000","last_active":"2023-11-04T01:40:09.736001+0000","last_peered":"2023-11-04T01:40:09.736001+0000","last_clean":"2023-11-04T01:40:09.736001+0000","last_became_active":"2023-11-04T01:40:05.579083+0000","last_became_peered":"2023-11-04T01:40:05.579083+0000","last_unstale":"2023-11-04T01:40:09.736001+0000","last_undegraded":"2023-11-04T01:40:09.736001+0000","last_fullsized":"2023-11-04T01:40:09.736001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:25:21.992534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729856+0000","last_change":"2023-11-04T01:40:05.577656+0000","last_active":"2023-11-04T01:40:09.729856+0000","last_peered":"2023-11-04T01:40:09.729856+0000","last_clean":"2023-11-04T01:40:09.729856+0000","last_became_active":"2023-11-04T01:40:05.577375+0000","last_became_peered":"2023-11-04T01:40:05.577375+0000","last_unstale":"2023-11-04T01:40:09.729856+0000","last_undegraded":"2023-11-04T01:40:09.729856+0000","last_fullsized":"2023-11-04T01:40:09.729856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:46:18.951640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732817+0000","last_change":"2023-11-04T01:40:05.562307+0000","last_active":"2023-11-04T01:40:09.732817+0000","last_peered":"2023-11-04T01:40:09.732817+0000","last_clean":"2023-11-04T01:40:09.732817+0000","last_became_active":"2023-11-04T01:40:05.562060+0000","last_became_peered":"2023-11-04T01:40:05.562060+0000","last_unstale":"2023-11-04T01:40:09.732817+0000","last_undegraded":"2023-11-04T01:40:09.732817+0000","last_fullsized":"2023-11-04T01:40:09.732817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:09:40.586446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.728326+0000","last_change":"2023-11-04T01:40:05.565815+0000","last_active":"2023-11-04T01:40:09.728326+0000","last_peered":"2023-11-04T01:40:09.728326+0000","last_clean":"2023-11-04T01:40:09.728326+0000","last_became_active":"2023-11-04T01:40:05.565356+0000","last_became_peered":"2023-11-04T01:40:05.565356+0000","last_unstale":"2023-11-04T01:40:09.728326+0000","last_undegraded":"2023-11-04T01:40:09.728326+0000","last_fullsized":"2023-11-04T01:40:09.728326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:46:18.951640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734702+0000","last_change":"2023-11-04T01:40:05.560477+0000","last_active":"2023-11-04T01:40:09.734702+0000","last_peered":"2023-11-04T01:40:09.734702+0000","last_clean":"2023-11-04T01:40:09.734702+0000","last_became_active":"2023-11-04T01:40:05.560213+0000","last_became_peered":"2023-11-04T01:40:05.560213+0000","last_unstale":"2023-11-04T01:40:09.734702+0000","last_undegraded":"2023-11-04T01:40:09.734702+0000","last_fullsized":"2023-11-04T01:40:09.734702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:02.182321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.735601+0000","last_change":"2023-11-04T01:40:05.562260+0000","last_active":"2023-11-04T01:40:09.735601+0000","last_peered":"2023-11-04T01:40:09.735601+0000","last_clean":"2023-11-04T01:40:09.735601+0000","last_became_active":"2023-11-04T01:40:05.561788+0000","last_became_peered":"2023-11-04T01:40:05.561788+0000","last_unstale":"2023-11-04T01:40:09.735601+0000","last_undegraded":"2023-11-04T01:40:09.735601+0000","last_fullsized":"2023-11-04T01:40:09.735601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:46:18.951640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.728083+0000","last_change":"2023-11-04T01:40:05.565701+0000","last_active":"2023-11-04T01:40:09.728083+0000","last_peered":"2023-11-04T01:40:09.728083+0000","last_clean":"2023-11-04T01:40:09.728083+0000","last_became_active":"2023-11-04T01:40:05.565414+0000","last_became_peered":"2023-11-04T01:40:05.565414+0000","last_unstale":"2023-11-04T01:40:09.728083+0000","last_undegraded":"2023-11-04T01:40:09.728083+0000","last_fullsized":"2023-11-04T01:40:09.728083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:35:55.027288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.728758+0000","last_change":"2023-11-04T01:40:05.578120+0000","last_active":"2023-11-04T01:40:09.728758+0000","last_peered":"2023-11-04T01:40:09.728758+0000","last_clean":"2023-11-04T01:40:09.728758+0000","last_became_active":"2023-11-04T01:40:05.576353+0000","last_became_peered":"2023-11-04T01:40:05.576353+0000","last_unstale":"2023-11-04T01:40:09.728758+0000","last_undegraded":"2023-11-04T01:40:09.728758+0000","last_fullsized":"2023-11-04T01:40:09.728758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:43.060452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727831+0000","last_change":"2023-11-04T01:40:05.565797+0000","last_active":"2023-11-04T01:40:09.727831+0000","last_peered":"2023-11-04T01:40:09.727831+0000","last_clean":"2023-11-04T01:40:09.727831+0000","last_became_active":"2023-11-04T01:40:05.565341+0000","last_became_peered":"2023-11-04T01:40:05.565341+0000","last_unstale":"2023-11-04T01:40:09.727831+0000","last_undegraded":"2023-11-04T01:40:09.727831+0000","last_fullsized":"2023-11-04T01:40:09.727831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:51:09.123583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.730213+0000","last_change":"2023-11-04T01:40:05.576354+0000","last_active":"2023-11-04T01:40:09.730213+0000","last_peered":"2023-11-04T01:40:09.730213+0000","last_clean":"2023-11-04T01:40:09.730213+0000","last_became_active":"2023-11-04T01:40:05.576041+0000","last_became_peered":"2023-11-04T01:40:05.576041+0000","last_unstale":"2023-11-04T01:40:09.730213+0000","last_undegraded":"2023-11-04T01:40:09.730213+0000","last_fullsized":"2023-11-04T01:40:09.730213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:17.862444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732728+0000","last_change":"2023-11-04T01:40:05.558627+0000","last_active":"2023-11-04T01:40:09.732728+0000","last_peered":"2023-11-04T01:40:09.732728+0000","last_clean":"2023-11-04T01:40:09.732728+0000","last_became_active":"2023-11-04T01:40:05.558323+0000","last_became_peered":"2023-11-04T01:40:05.558323+0000","last_unstale":"2023-11-04T01:40:09.732728+0000","last_undegraded":"2023-11-04T01:40:09.732728+0000","last_fullsized":"2023-11-04T01:40:09.732728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:02.201965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.735029+0000","last_change":"2023-11-04T01:40:05.565842+0000","last_active":"2023-11-04T01:40:09.735029+0000","last_peered":"2023-11-04T01:40:09.735029+0000","last_clean":"2023-11-04T01:40:09.735029+0000","last_became_active":"2023-11-04T01:40:05.565557+0000","last_became_peered":"2023-11-04T01:40:05.565557+0000","last_unstale":"2023-11-04T01:40:09.735029+0000","last_undegraded":"2023-11-04T01:40:09.735029+0000","last_fullsized":"2023-11-04T01:40:09.735029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:02.182321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732064+0000","last_change":"2023-11-04T01:40:05.557783+0000","last_active":"2023-11-04T01:40:09.732064+0000","last_peered":"2023-11-04T01:40:09.732064+0000","last_clean":"2023-11-04T01:40:09.732064+0000","last_became_active":"2023-11-04T01:40:05.557468+0000","last_became_peered":"2023-11-04T01:40:05.557468+0000","last_unstale":"2023-11-04T01:40:09.732064+0000","last_undegraded":"2023-11-04T01:40:09.732064+0000","last_fullsized":"2023-11-04T01:40:09.732064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:21.851664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.737029+0000","last_change":"2023-11-04T01:40:05.559446+0000","last_active":"2023-11-04T01:40:09.737029+0000","last_peered":"2023-11-04T01:40:09.737029+0000","last_clean":"2023-11-04T01:40:09.737029+0000","last_became_active":"2023-11-04T01:40:05.559182+0000","last_became_peered":"2023-11-04T01:40:05.559182+0000","last_unstale":"2023-11-04T01:40:09.737029+0000","last_undegraded":"2023-11-04T01:40:09.737029+0000","last_fullsized":"2023-11-04T01:40:09.737029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:45:02.590707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.730805+0000","last_change":"2023-11-04T01:40:05.577084+0000","last_active":"2023-11-04T01:40:09.730805+0000","last_peered":"2023-11-04T01:40:09.730805+0000","last_clean":"2023-11-04T01:40:09.730805+0000","last_became_active":"2023-11-04T01:40:05.576079+0000","last_became_peered":"2023-11-04T01:40:05.576079+0000","last_unstale":"2023-11-04T01:40:09.730805+0000","last_undegraded":"2023-11-04T01:40:09.730805+0000","last_fullsized":"2023-11-04T01:40:09.730805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:18:55.872119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.728665+0000","last_change":"2023-11-04T01:40:05.577325+0000","last_active":"2023-11-04T01:40:09.728665+0000","last_peered":"2023-11-04T01:40:09.728665+0000","last_clean":"2023-11-04T01:40:09.728665+0000","last_became_active":"2023-11-04T01:40:05.576140+0000","last_became_peered":"2023-11-04T01:40:05.576140+0000","last_unstale":"2023-11-04T01:40:09.728665+0000","last_undegraded":"2023-11-04T01:40:09.728665+0000","last_fullsized":"2023-11-04T01:40:09.728665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:15.017965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.733522+0000","last_change":"2023-11-04T01:40:05.564247+0000","last_active":"2023-11-04T01:40:09.733522+0000","last_peered":"2023-11-04T01:40:09.733522+0000","last_clean":"2023-11-04T01:40:09.733522+0000","last_became_active":"2023-11-04T01:40:05.563816+0000","last_became_peered":"2023-11-04T01:40:05.563816+0000","last_unstale":"2023-11-04T01:40:09.733522+0000","last_undegraded":"2023-11-04T01:40:09.733522+0000","last_fullsized":"2023-11-04T01:40:09.733522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:51:09.123583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732014+0000","last_change":"2023-11-04T01:40:05.556907+0000","last_active":"2023-11-04T01:40:09.732014+0000","last_peered":"2023-11-04T01:40:09.732014+0000","last_clean":"2023-11-04T01:40:09.732014+0000","last_became_active":"2023-11-04T01:40:05.556614+0000","last_became_peered":"2023-11-04T01:40:05.556614+0000","last_unstale":"2023-11-04T01:40:09.732014+0000","last_undegraded":"2023-11-04T01:40:09.732014+0000","last_fullsized":"2023-11-04T01:40:09.732014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:15:04.579412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727610+0000","last_change":"2023-11-04T01:40:05.561125+0000","last_active":"2023-11-04T01:40:09.727610+0000","last_peered":"2023-11-04T01:40:09.727610+0000","last_clean":"2023-11-04T01:40:09.727610+0000","last_became_active":"2023-11-04T01:40:05.560864+0000","last_became_peered":"2023-11-04T01:40:05.560864+0000","last_unstale":"2023-11-04T01:40:09.727610+0000","last_undegraded":"2023-11-04T01:40:09.727610+0000","last_fullsized":"2023-11-04T01:40:09.727610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:02.182321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.737747+0000","last_change":"2023-11-04T01:40:05.568756+0000","last_active":"2023-11-04T01:40:09.737747+0000","last_peered":"2023-11-04T01:40:09.737747+0000","last_clean":"2023-11-04T01:40:09.737747+0000","last_became_active":"2023-11-04T01:40:05.568238+0000","last_became_peered":"2023-11-04T01:40:05.568238+0000","last_unstale":"2023-11-04T01:40:09.737747+0000","last_undegraded":"2023-11-04T01:40:09.737747+0000","last_fullsized":"2023-11-04T01:40:09.737747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:36.229155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734018+0000","last_change":"2023-11-04T01:40:05.580104+0000","last_active":"2023-11-04T01:40:09.734018+0000","last_peered":"2023-11-04T01:40:09.734018+0000","last_clean":"2023-11-04T01:40:09.734018+0000","last_became_active":"2023-11-04T01:40:05.579830+0000","last_became_peered":"2023-11-04T01:40:05.579830+0000","last_unstale":"2023-11-04T01:40:09.734018+0000","last_undegraded":"2023-11-04T01:40:09.734018+0000","last_fullsized":"2023-11-04T01:40:09.734018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:09:40.586446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.735529+0000","last_change":"2023-11-04T01:40:05.577828+0000","last_active":"2023-11-04T01:40:09.735529+0000","last_peered":"2023-11-04T01:40:09.735529+0000","last_clean":"2023-11-04T01:40:09.735529+0000","last_became_active":"2023-11-04T01:40:05.577524+0000","last_became_peered":"2023-11-04T01:40:05.577524+0000","last_unstale":"2023-11-04T01:40:09.735529+0000","last_undegraded":"2023-11-04T01:40:09.735529+0000","last_fullsized":"2023-11-04T01:40:09.735529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:17.862444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732444+0000","last_change":"2023-11-04T01:40:05.578036+0000","last_active":"2023-11-04T01:40:09.732444+0000","last_peered":"2023-11-04T01:40:09.732444+0000","last_clean":"2023-11-04T01:40:09.732444+0000","last_became_active":"2023-11-04T01:40:05.577711+0000","last_became_peered":"2023-11-04T01:40:05.577711+0000","last_unstale":"2023-11-04T01:40:09.732444+0000","last_undegraded":"2023-11-04T01:40:09.732444+0000","last_fullsized":"2023-11-04T01:40:09.732444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:43.060452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727075+0000","last_change":"2023-11-04T01:40:05.576720+0000","last_active":"2023-11-04T01:40:09.727075+0000","last_peered":"2023-11-04T01:40:09.727075+0000","last_clean":"2023-11-04T01:40:09.727075+0000","last_became_active":"2023-11-04T01:40:05.576465+0000","last_became_peered":"2023-11-04T01:40:05.576465+0000","last_unstale":"2023-11-04T01:40:09.727075+0000","last_undegraded":"2023-11-04T01:40:09.727075+0000","last_fullsized":"2023-11-04T01:40:09.727075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:02.201965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731346+0000","last_change":"2023-11-04T01:40:05.561827+0000","last_active":"2023-11-04T01:40:09.731346+0000","last_peered":"2023-11-04T01:40:09.731346+0000","last_clean":"2023-11-04T01:40:09.731346+0000","last_became_active":"2023-11-04T01:40:05.560891+0000","last_became_peered":"2023-11-04T01:40:05.560891+0000","last_unstale":"2023-11-04T01:40:09.731346+0000","last_undegraded":"2023-11-04T01:40:09.731346+0000","last_fullsized":"2023-11-04T01:40:09.731346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:35:55.027288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729758+0000","last_change":"2023-11-04T01:40:05.577149+0000","last_active":"2023-11-04T01:40:09.729758+0000","last_peered":"2023-11-04T01:40:09.729758+0000","last_clean":"2023-11-04T01:40:09.729758+0000","last_became_active":"2023-11-04T01:40:05.576800+0000","last_became_peered":"2023-11-04T01:40:05.576800+0000","last_unstale":"2023-11-04T01:40:09.729758+0000","last_undegraded":"2023-11-04T01:40:09.729758+0000","last_fullsized":"2023-11-04T01:40:09.729758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:02.182321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731574+0000","last_change":"2023-11-04T01:40:05.557217+0000","last_active":"2023-11-04T01:40:09.731574+0000","last_peered":"2023-11-04T01:40:09.731574+0000","last_clean":"2023-11-04T01:40:09.731574+0000","last_became_active":"2023-11-04T01:40:05.556849+0000","last_became_peered":"2023-11-04T01:40:05.556849+0000","last_unstale":"2023-11-04T01:40:09.731574+0000","last_undegraded":"2023-11-04T01:40:09.731574+0000","last_fullsized":"2023-11-04T01:40:09.731574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:09:53.332106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729505+0000","last_change":"2023-11-04T01:40:05.579108+0000","last_active":"2023-11-04T01:40:09.729505+0000","last_peered":"2023-11-04T01:40:09.729505+0000","last_clean":"2023-11-04T01:40:09.729505+0000","last_became_active":"2023-11-04T01:40:05.578820+0000","last_became_peered":"2023-11-04T01:40:05.578820+0000","last_unstale":"2023-11-04T01:40:09.729505+0000","last_undegraded":"2023-11-04T01:40:09.729505+0000","last_fullsized":"2023-11-04T01:40:09.729505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:45:17.797764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.733836+0000","last_change":"2023-11-04T01:40:05.560589+0000","last_active":"2023-11-04T01:40:09.733836+0000","last_peered":"2023-11-04T01:40:09.733836+0000","last_clean":"2023-11-04T01:40:09.733836+0000","last_became_active":"2023-11-04T01:40:05.559671+0000","last_became_peered":"2023-11-04T01:40:05.559671+0000","last_unstale":"2023-11-04T01:40:09.733836+0000","last_undegraded":"2023-11-04T01:40:09.733836+0000","last_fullsized":"2023-11-04T01:40:09.733836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:14:25.328288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734422+0000","last_change":"2023-11-04T01:40:05.564381+0000","last_active":"2023-11-04T01:40:09.734422+0000","last_peered":"2023-11-04T01:40:09.734422+0000","last_clean":"2023-11-04T01:40:09.734422+0000","last_became_active":"2023-11-04T01:40:05.564046+0000","last_became_peered":"2023-11-04T01:40:05.564046+0000","last_unstale":"2023-11-04T01:40:09.734422+0000","last_undegraded":"2023-11-04T01:40:09.734422+0000","last_fullsized":"2023-11-04T01:40:09.734422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:17.862444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732359+0000","last_change":"2023-11-04T01:40:05.561850+0000","last_active":"2023-11-04T01:40:09.732359+0000","last_peered":"2023-11-04T01:40:09.732359+0000","last_clean":"2023-11-04T01:40:09.732359+0000","last_became_active":"2023-11-04T01:40:05.561463+0000","last_became_peered":"2023-11-04T01:40:05.561463+0000","last_unstale":"2023-11-04T01:40:09.732359+0000","last_undegraded":"2023-11-04T01:40:09.732359+0000","last_fullsized":"2023-11-04T01:40:09.732359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:14:17.945716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]},{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":99918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":99792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":99952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":689779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:40:27.881 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:40:28.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.012+0000 7fe3675dc640 1 Processor -- start 2023-11-04T01:40:28.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.013+0000 7fe3675dc640 1 -- start start 2023-11-04T01:40:28.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.013+0000 7fe3675dc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe3600b2d10 0x7fe3600cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.013+0000 7fe3675dc640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe36006b910 con 0x7fe36006cc50 2023-11-04T01:40:28.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.013+0000 7fe3675dc640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe36006bbb0 con 0x7fe36015ce40 2023-11-04T01:40:28.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.013+0000 7fe3675dc640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe36006be90 con 0x7fe3600b2d10 2023-11-04T01:40:28.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.013+0000 7fe365b79640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe3600b2d10 0x7fe3600cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.013+0000 7fe364b77640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe36006cc50 0x7fe3600b2600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:60926/0 (socket says 172.21.15.77:60926) 2023-11-04T01:40:28.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.013+0000 7fe364b77640 1 -- 172.21.15.77:0/997113253 learned_addr learned my addr 172.21.15.77:0/997113253 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:28.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.014+0000 7fe365b79640 1 -- 172.21.15.77:0/997113253 >> v1:172.21.15.122:6789/0 conn(0x7fe36015ce40 legacy=0x7fe360161460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:28.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.014+0000 7fe365b79640 1 -- 172.21.15.77:0/997113253 >> v1:172.21.15.77:6789/0 conn(0x7fe36006cc50 legacy=0x7fe3600b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.014+0000 7fe365b79640 1 -- 172.21.15.77:0/997113253 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36006c170 con 0x7fe3600b2d10 2023-11-04T01:40:28.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.014+0000 7fe365b79640 1 --2- 172.21.15.77:0/997113253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3600b2d10 0x7fe3600cb560 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe3580097a0 tx=0x7fe35802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=664d038cfb15def0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:28.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.015+0000 7fe357fff640 1 -- 172.21.15.77:0/997113253 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe358031830 con 0x7fe3600b2d10 2023-11-04T01:40:28.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.015+0000 7fe357fff640 1 -- 172.21.15.77:0/997113253 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe358031990 con 0x7fe3600b2d10 2023-11-04T01:40:28.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.015+0000 7fe357fff640 1 -- 172.21.15.77:0/997113253 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe358031d20 con 0x7fe3600b2d10 2023-11-04T01:40:28.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.015+0000 7fe3675dc640 1 -- 172.21.15.77:0/997113253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3600b2d10 msgr2=0x7fe3600cb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.015+0000 7fe3675dc640 1 --2- 172.21.15.77:0/997113253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3600b2d10 0x7fe3600cb560 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe3580097a0 tx=0x7fe35802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.015+0000 7fe3675dc640 1 -- 172.21.15.77:0/997113253 shutdown_connections 2023-11-04T01:40:28.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.015+0000 7fe3675dc640 1 --2- 172.21.15.77:0/997113253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3600b2d10 0x7fe3600cb560 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.015+0000 7fe3675dc640 1 -- 172.21.15.77:0/997113253 >> 172.21.15.77:0/997113253 conn(0x7fe3600cd600 msgr2=0x7fe3600cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:28.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.015+0000 7fe3675dc640 1 -- 172.21.15.77:0/997113253 shutdown_connections 2023-11-04T01:40:28.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.015+0000 7fe3675dc640 1 -- 172.21.15.77:0/997113253 wait complete. 2023-11-04T01:40:28.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.016+0000 7fe3675dc640 1 Processor -- start 2023-11-04T01:40:28.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.016+0000 7fe3675dc640 1 -- start start 2023-11-04T01:40:28.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.017+0000 7fe3675dc640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe36006cc50 0x7fe360157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.017+0000 7fe3675dc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3600b2d10 0x7fe3600b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.017+0000 7fe3675dc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe36015ce40 0x7fe3600b15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.017+0000 7fe3675dc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe360157870 con 0x7fe3600b2d10 2023-11-04T01:40:28.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.017+0000 7fe3675dc640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3601f3140 con 0x7fe36015ce40 2023-11-04T01:40:28.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.017+0000 7fe3675dc640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3601f3420 con 0x7fe36006cc50 2023-11-04T01:40:28.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.017+0000 7fe364b77640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3600b2d10 0x7fe3600b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.017+0000 7fe364b77640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3600b2d10 0x7fe3600b10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53054/0 (socket says 172.21.15.77:53054) 2023-11-04T01:40:28.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.017+0000 7fe364b77640 1 -- 172.21.15.77:0/463155480 learned_addr learned my addr 172.21.15.77:0/463155480 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:28.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.017+0000 7fe365378640 1 --2- 172.21.15.77:0/463155480 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe36006cc50 0x7fe360157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.017+0000 7fe365b79640 1 --2- 172.21.15.77:0/463155480 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe36015ce40 0x7fe3600b15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.017+0000 7fe364b77640 1 -- 172.21.15.77:0/463155480 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe36006cc50 msgr2=0x7fe360157330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.017+0000 7fe364b77640 1 --2- 172.21.15.77:0/463155480 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe36006cc50 0x7fe360157330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.017+0000 7fe364b77640 1 -- 172.21.15.77:0/463155480 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe36015ce40 msgr2=0x7fe3600b15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.017+0000 7fe364b77640 1 --2- 172.21.15.77:0/463155480 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe36015ce40 0x7fe3600b15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.017+0000 7fe364b77640 1 -- 172.21.15.77:0/463155480 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe358009400 con 0x7fe3600b2d10 2023-11-04T01:40:28.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.017+0000 7fe365378640 1 --2- 172.21.15.77:0/463155480 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe36006cc50 0x7fe360157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:28.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.017+0000 7fe365b79640 1 --2- 172.21.15.77:0/463155480 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe36015ce40 0x7fe3600b15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:28.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.018+0000 7fe364b77640 1 --2- 172.21.15.77:0/463155480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3600b2d10 0x7fe3600b10b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe35000c4a0 tx=0x7fe35000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:28.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.018+0000 7fe355ffb640 1 -- 172.21.15.77:0/463155480 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe350005ce0 con 0x7fe3600b2d10 2023-11-04T01:40:28.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.018+0000 7fe355ffb640 1 -- 172.21.15.77:0/463155480 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe350005e40 con 0x7fe3600b2d10 2023-11-04T01:40:28.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.018+0000 7fe3675dc640 1 -- 172.21.15.77:0/463155480 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3601f3700 con 0x7fe3600b2d10 2023-11-04T01:40:28.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.018+0000 7fe355ffb640 1 -- 172.21.15.77:0/463155480 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe350007270 con 0x7fe3600b2d10 2023-11-04T01:40:28.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.018+0000 7fe3675dc640 1 -- 172.21.15.77:0/463155480 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3601f2e30 con 0x7fe3600b2d10 2023-11-04T01:40:28.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.019+0000 7fe3675dc640 1 -- 172.21.15.77:0/463155480 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3600b6b00 con 0x7fe3600b2d10 2023-11-04T01:40:28.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.019+0000 7fe355ffb640 1 -- 172.21.15.77:0/463155480 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe350007490 con 0x7fe3600b2d10 2023-11-04T01:40:28.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.020+0000 7fe355ffb640 1 --2- 172.21.15.77:0/463155480 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe34406ae70 0x7fe34406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.020+0000 7fe355ffb640 1 -- 172.21.15.77:0/463155480 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe350088d10 con 0x7fe3600b2d10 2023-11-04T01:40:28.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.020+0000 7fe365378640 1 --2- 172.21.15.77:0/463155480 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe34406ae70 0x7fe34406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.020+0000 7fe365378640 1 --2- 172.21.15.77:0/463155480 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe34406ae70 0x7fe34406d330 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe35c007e90 tx=0x7fe35c0073a0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:28.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.024+0000 7fe355ffb640 1 -- 172.21.15.77:0/463155480 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe350053b80 con 0x7fe3600b2d10 2023-11-04T01:40:28.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.185+0000 7fe3675dc640 1 -- 172.21.15.77:0/463155480 --> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe3601f32b0 con 0x7fe34406ae70 2023-11-04T01:40:28.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.194+0000 7fe355ffb640 1 -- 172.21.15.77:0/463155480 <== mgr.4123 v2:172.21.15.122:6832/2275325762 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345242 (secure 0 0 0) 0x7fe3601f32b0 con 0x7fe34406ae70 2023-11-04T01:40:28.199 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:28.201 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-04T01:40:28.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.197+0000 7fe3675dc640 1 -- 172.21.15.77:0/463155480 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe34406ae70 msgr2=0x7fe34406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.197+0000 7fe3675dc640 1 --2- 172.21.15.77:0/463155480 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe34406ae70 0x7fe34406d330 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe35c007e90 tx=0x7fe35c0073a0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.197+0000 7fe3675dc640 1 -- 172.21.15.77:0/463155480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3600b2d10 msgr2=0x7fe3600b10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.197+0000 7fe3675dc640 1 --2- 172.21.15.77:0/463155480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3600b2d10 0x7fe3600b10b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe35000c4a0 tx=0x7fe35000c960 comp rx=0 tx=0).stop 2023-11-04T01:40:28.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.197+0000 7fe3675dc640 1 -- 172.21.15.77:0/463155480 shutdown_connections 2023-11-04T01:40:28.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.197+0000 7fe3675dc640 1 --2- 172.21.15.77:0/463155480 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe34406ae70 0x7fe34406d330 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.197+0000 7fe3675dc640 1 --2- 172.21.15.77:0/463155480 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe36015ce40 0x7fe3600b15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.197+0000 7fe3675dc640 1 --2- 172.21.15.77:0/463155480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3600b2d10 0x7fe3600b10b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.197+0000 7fe3675dc640 1 --2- 172.21.15.77:0/463155480 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe36006cc50 0x7fe360157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.197+0000 7fe3675dc640 1 -- 172.21.15.77:0/463155480 >> 172.21.15.77:0/463155480 conn(0x7fe3600cd600 msgr2=0x7fe3601e7800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:28.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.197+0000 7fe3675dc640 1 -- 172.21.15.77:0/463155480 shutdown_connections 2023-11-04T01:40:28.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.197+0000 7fe3675dc640 1 -- 172.21.15.77:0/463155480 wait complete. 2023-11-04T01:40:28.209 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-11-04T01:40:27.631411+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219356,"kb_used_data":3204,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755364,"statfs":{"total":773094113280,"available":772869492736,"internally_reserved":0,"allocated":3280896,"data_stored":1987333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003991"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734371+0000","last_change":"2023-11-04T01:40:04.705196+0000","last_active":"2023-11-04T01:40:09.734371+0000","last_peered":"2023-11-04T01:40:09.734371+0000","last_clean":"2023-11-04T01:40:09.734371+0000","last_became_active":"2023-11-04T01:40:04.704925+0000","last_became_peered":"2023-11-04T01:40:04.704925+0000","last_unstale":"2023-11-04T01:40:09.734371+0000","last_undegraded":"2023-11-04T01:40:09.734371+0000","last_fullsized":"2023-11-04T01:40:09.734371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:23.661606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727344+0000","last_change":"2023-11-04T01:40:05.561233+0000","last_active":"2023-11-04T01:40:09.727344+0000","last_peered":"2023-11-04T01:40:09.727344+0000","last_clean":"2023-11-04T01:40:09.727344+0000","last_became_active":"2023-11-04T01:40:05.560936+0000","last_became_peered":"2023-11-04T01:40:05.560936+0000","last_unstale":"2023-11-04T01:40:09.727344+0000","last_undegraded":"2023-11-04T01:40:09.727344+0000","last_fullsized":"2023-11-04T01:40:09.727344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:32:27.484390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.550542+0000","last_change":"2023-11-04T01:40:09.743799+0000","last_active":"2023-11-04T01:40:10.550542+0000","last_peered":"2023-11-04T01:40:10.550542+0000","last_clean":"2023-11-04T01:40:10.550542+0000","last_became_active":"2023-11-04T01:40:09.743430+0000","last_became_peered":"2023-11-04T01:40:09.743430+0000","last_unstale":"2023-11-04T01:40:10.550542+0000","last_undegraded":"2023-11-04T01:40:10.550542+0000","last_fullsized":"2023-11-04T01:40:10.550542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:23:03.976941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727438+0000","last_change":"2023-11-04T01:40:04.697166+0000","last_active":"2023-11-04T01:40:09.727438+0000","last_peered":"2023-11-04T01:40:09.727438+0000","last_clean":"2023-11-04T01:40:09.727438+0000","last_became_active":"2023-11-04T01:40:04.696343+0000","last_became_peered":"2023-11-04T01:40:04.696343+0000","last_unstale":"2023-11-04T01:40:09.727438+0000","last_undegraded":"2023-11-04T01:40:09.727438+0000","last_fullsized":"2023-11-04T01:40:09.727438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:45:56.544854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734207+0000","last_change":"2023-11-04T01:40:05.578729+0000","last_active":"2023-11-04T01:40:09.734207+0000","last_peered":"2023-11-04T01:40:09.734207+0000","last_clean":"2023-11-04T01:40:09.734207+0000","last_became_active":"2023-11-04T01:40:05.578510+0000","last_became_peered":"2023-11-04T01:40:05.578510+0000","last_unstale":"2023-11-04T01:40:09.734207+0000","last_undegraded":"2023-11-04T01:40:09.734207+0000","last_fullsized":"2023-11-04T01:40:09.734207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:51:09.123583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255835+0000","last_change":"2023-11-04T01:40:09.748639+0000","last_active":"2023-11-04T01:40:11.255835+0000","last_peered":"2023-11-04T01:40:11.255835+0000","last_clean":"2023-11-04T01:40:11.255835+0000","last_became_active":"2023-11-04T01:40:09.748054+0000","last_became_peered":"2023-11-04T01:40:09.748054+0000","last_unstale":"2023-11-04T01:40:11.255835+0000","last_undegraded":"2023-11-04T01:40:11.255835+0000","last_fullsized":"2023-11-04T01:40:11.255835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:06.213744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731930+0000","last_change":"2023-11-04T01:40:04.704898+0000","last_active":"2023-11-04T01:40:09.731930+0000","last_peered":"2023-11-04T01:40:09.731930+0000","last_clean":"2023-11-04T01:40:09.731930+0000","last_became_active":"2023-11-04T01:40:04.704598+0000","last_became_peered":"2023-11-04T01:40:04.704598+0000","last_unstale":"2023-11-04T01:40:09.731930+0000","last_undegraded":"2023-11-04T01:40:09.731930+0000","last_fullsized":"2023-11-04T01:40:09.731930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:01.176323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729590+0000","last_change":"2023-11-04T01:40:05.578543+0000","last_active":"2023-11-04T01:40:09.729590+0000","last_peered":"2023-11-04T01:40:09.729590+0000","last_clean":"2023-11-04T01:40:09.729590+0000","last_became_active":"2023-11-04T01:40:05.576858+0000","last_became_peered":"2023-11-04T01:40:05.576858+0000","last_unstale":"2023-11-04T01:40:09.729590+0000","last_undegraded":"2023-11-04T01:40:09.729590+0000","last_fullsized":"2023-11-04T01:40:09.729590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:09:53.332106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256523+0000","last_change":"2023-11-04T01:40:09.749533+0000","last_active":"2023-11-04T01:40:11.256523+0000","last_peered":"2023-11-04T01:40:11.256523+0000","last_clean":"2023-11-04T01:40:11.256523+0000","last_became_active":"2023-11-04T01:40:09.749065+0000","last_became_peered":"2023-11-04T01:40:09.749065+0000","last_unstale":"2023-11-04T01:40:11.256523+0000","last_undegraded":"2023-11-04T01:40:11.256523+0000","last_fullsized":"2023-11-04T01:40:11.256523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:09:57.363528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731575+0000","last_change":"2023-11-04T01:40:04.703516+0000","last_active":"2023-11-04T01:40:09.731575+0000","last_peered":"2023-11-04T01:40:09.731575+0000","last_clean":"2023-11-04T01:40:09.731575+0000","last_became_active":"2023-11-04T01:40:04.703201+0000","last_became_peered":"2023-11-04T01:40:04.703201+0000","last_unstale":"2023-11-04T01:40:09.731575+0000","last_undegraded":"2023-11-04T01:40:09.731575+0000","last_fullsized":"2023-11-04T01:40:09.731575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:25:20.986535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729248+0000","last_change":"2023-11-04T01:40:05.577332+0000","last_active":"2023-11-04T01:40:09.729248+0000","last_peered":"2023-11-04T01:40:09.729248+0000","last_clean":"2023-11-04T01:40:09.729248+0000","last_became_active":"2023-11-04T01:40:05.577054+0000","last_became_peered":"2023-11-04T01:40:05.577054+0000","last_unstale":"2023-11-04T01:40:09.729248+0000","last_undegraded":"2023-11-04T01:40:09.729248+0000","last_fullsized":"2023-11-04T01:40:09.729248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:35:55.027288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256082+0000","last_change":"2023-11-04T01:40:09.746388+0000","last_active":"2023-11-04T01:40:11.256082+0000","last_peered":"2023-11-04T01:40:11.256082+0000","last_clean":"2023-11-04T01:40:11.256082+0000","last_became_active":"2023-11-04T01:40:09.745966+0000","last_became_peered":"2023-11-04T01:40:09.745966+0000","last_unstale":"2023-11-04T01:40:11.256082+0000","last_undegraded":"2023-11-04T01:40:11.256082+0000","last_fullsized":"2023-11-04T01:40:11.256082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:35:59.058711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734112+0000","last_change":"2023-11-04T01:40:05.565842+0000","last_active":"2023-11-04T01:40:09.734112+0000","last_peered":"2023-11-04T01:40:09.734112+0000","last_clean":"2023-11-04T01:40:09.734112+0000","last_became_active":"2023-11-04T01:40:05.565387+0000","last_became_peered":"2023-11-04T01:40:05.565387+0000","last_unstale":"2023-11-04T01:40:09.734112+0000","last_undegraded":"2023-11-04T01:40:09.734112+0000","last_fullsized":"2023-11-04T01:40:09.734112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:44:56.709670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731731+0000","last_change":"2023-11-04T01:40:04.702605+0000","last_active":"2023-11-04T01:40:09.731731+0000","last_peered":"2023-11-04T01:40:09.731731+0000","last_clean":"2023-11-04T01:40:09.731731+0000","last_became_active":"2023-11-04T01:40:04.702242+0000","last_became_peered":"2023-11-04T01:40:04.702242+0000","last_unstale":"2023-11-04T01:40:09.731731+0000","last_undegraded":"2023-11-04T01:40:09.731731+0000","last_fullsized":"2023-11-04T01:40:09.731731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:55:42.496852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256505+0000","last_change":"2023-11-04T01:40:09.748671+0000","last_active":"2023-11-04T01:40:11.256505+0000","last_peered":"2023-11-04T01:40:11.256505+0000","last_clean":"2023-11-04T01:40:11.256505+0000","last_became_active":"2023-11-04T01:40:09.748007+0000","last_became_peered":"2023-11-04T01:40:09.748007+0000","last_unstale":"2023-11-04T01:40:11.256505+0000","last_undegraded":"2023-11-04T01:40:11.256505+0000","last_fullsized":"2023-11-04T01:40:11.256505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:45:21.829187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727707+0000","last_change":"2023-11-04T01:40:05.566650+0000","last_active":"2023-11-04T01:40:09.727707+0000","last_peered":"2023-11-04T01:40:09.727707+0000","last_clean":"2023-11-04T01:40:09.727707+0000","last_became_active":"2023-11-04T01:40:05.566369+0000","last_became_peered":"2023-11-04T01:40:05.566369+0000","last_unstale":"2023-11-04T01:40:09.727707+0000","last_undegraded":"2023-11-04T01:40:09.727707+0000","last_fullsized":"2023-11-04T01:40:09.727707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:17.862444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.735570+0000","last_change":"2023-11-04T01:40:04.699761+0000","last_active":"2023-11-04T01:40:09.735570+0000","last_peered":"2023-11-04T01:40:09.735570+0000","last_clean":"2023-11-04T01:40:09.735570+0000","last_became_active":"2023-11-04T01:40:04.699489+0000","last_became_peered":"2023-11-04T01:40:04.699489+0000","last_unstale":"2023-11-04T01:40:09.735570+0000","last_undegraded":"2023-11-04T01:40:09.735570+0000","last_fullsized":"2023-11-04T01:40:09.735570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:45:56.544854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256468+0000","last_change":"2023-11-04T01:40:09.754113+0000","last_active":"2023-11-04T01:40:11.256468+0000","last_peered":"2023-11-04T01:40:11.256468+0000","last_clean":"2023-11-04T01:40:11.256468+0000","last_became_active":"2023-11-04T01:40:09.753689+0000","last_became_peered":"2023-11-04T01:40:09.753689+0000","last_unstale":"2023-11-04T01:40:11.256468+0000","last_undegraded":"2023-11-04T01:40:11.256468+0000","last_fullsized":"2023-11-04T01:40:11.256468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:49:00.940390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727962+0000","last_change":"2023-11-04T01:40:05.559848+0000","last_active":"2023-11-04T01:40:09.727962+0000","last_peered":"2023-11-04T01:40:09.727962+0000","last_clean":"2023-11-04T01:40:09.727962+0000","last_became_active":"2023-11-04T01:40:05.559384+0000","last_became_peered":"2023-11-04T01:40:05.559384+0000","last_unstale":"2023-11-04T01:40:09.727962+0000","last_undegraded":"2023-11-04T01:40:09.727962+0000","last_fullsized":"2023-11-04T01:40:09.727962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:44:56.709670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.733604+0000","last_change":"2023-11-04T01:40:04.704585+0000","last_active":"2023-11-04T01:40:09.733604+0000","last_peered":"2023-11-04T01:40:09.733604+0000","last_clean":"2023-11-04T01:40:09.733604+0000","last_became_active":"2023-11-04T01:40:04.704325+0000","last_became_peered":"2023-11-04T01:40:04.704325+0000","last_unstale":"2023-11-04T01:40:09.733604+0000","last_undegraded":"2023-11-04T01:40:09.733604+0000","last_fullsized":"2023-11-04T01:40:09.733604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:23.661606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256533+0000","last_change":"2023-11-04T01:40:09.748343+0000","last_active":"2023-11-04T01:40:11.256533+0000","last_peered":"2023-11-04T01:40:11.256533+0000","last_clean":"2023-11-04T01:40:11.256533+0000","last_became_active":"2023-11-04T01:40:09.747762+0000","last_became_peered":"2023-11-04T01:40:09.747762+0000","last_unstale":"2023-11-04T01:40:11.256533+0000","last_undegraded":"2023-11-04T01:40:11.256533+0000","last_fullsized":"2023-11-04T01:40:11.256533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:47.091874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.737227+0000","last_change":"2023-11-04T01:40:05.562694+0000","last_active":"2023-11-04T01:40:09.737227+0000","last_peered":"2023-11-04T01:40:09.737227+0000","last_clean":"2023-11-04T01:40:09.737227+0000","last_became_active":"2023-11-04T01:40:05.562431+0000","last_became_peered":"2023-11-04T01:40:05.562431+0000","last_unstale":"2023-11-04T01:40:09.737227+0000","last_undegraded":"2023-11-04T01:40:09.737227+0000","last_fullsized":"2023-11-04T01:40:09.737227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:12:08.762760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731277+0000","last_change":"2023-11-04T01:40:04.706712+0000","last_active":"2023-11-04T01:40:09.731277+0000","last_peered":"2023-11-04T01:40:09.731277+0000","last_clean":"2023-11-04T01:40:09.731277+0000","last_became_active":"2023-11-04T01:40:04.706369+0000","last_became_peered":"2023-11-04T01:40:04.706369+0000","last_unstale":"2023-11-04T01:40:09.731277+0000","last_undegraded":"2023-11-04T01:40:09.731277+0000","last_fullsized":"2023-11-04T01:40:09.731277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:23.661606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256269+0000","last_change":"2023-11-04T01:40:09.752971+0000","last_active":"2023-11-04T01:40:11.256269+0000","last_peered":"2023-11-04T01:40:11.256269+0000","last_clean":"2023-11-04T01:40:11.256269+0000","last_became_active":"2023-11-04T01:40:09.752569+0000","last_became_peered":"2023-11-04T01:40:09.752569+0000","last_unstale":"2023-11-04T01:40:11.256269+0000","last_undegraded":"2023-11-04T01:40:11.256269+0000","last_fullsized":"2023-11-04T01:40:11.256269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:32:31.515813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.733414+0000","last_change":"2023-11-04T01:40:05.559419+0000","last_active":"2023-11-04T01:40:09.733414+0000","last_peered":"2023-11-04T01:40:09.733414+0000","last_clean":"2023-11-04T01:40:09.733414+0000","last_became_active":"2023-11-04T01:40:05.559176+0000","last_became_peered":"2023-11-04T01:40:05.559176+0000","last_unstale":"2023-11-04T01:40:09.733414+0000","last_undegraded":"2023-11-04T01:40:09.733414+0000","last_fullsized":"2023-11-04T01:40:09.733414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:44:56.709670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.735151+0000","last_change":"2023-11-04T01:40:04.706199+0000","last_active":"2023-11-04T01:40:09.735151+0000","last_peered":"2023-11-04T01:40:09.735151+0000","last_clean":"2023-11-04T01:40:09.735151+0000","last_became_active":"2023-11-04T01:40:04.705913+0000","last_became_peered":"2023-11-04T01:40:04.705913+0000","last_unstale":"2023-11-04T01:40:09.735151+0000","last_undegraded":"2023-11-04T01:40:09.735151+0000","last_fullsized":"2023-11-04T01:40:09.735151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:14:24.322290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256061+0000","last_change":"2023-11-04T01:40:09.744921+0000","last_active":"2023-11-04T01:40:11.256061+0000","last_peered":"2023-11-04T01:40:11.256061+0000","last_clean":"2023-11-04T01:40:11.256061+0000","last_became_active":"2023-11-04T01:40:09.744502+0000","last_became_peered":"2023-11-04T01:40:09.744502+0000","last_unstale":"2023-11-04T01:40:11.256061+0000","last_undegraded":"2023-11-04T01:40:11.256061+0000","last_fullsized":"2023-11-04T01:40:11.256061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:46:22.983063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.728110+0000","last_change":"2023-11-04T01:40:05.559760+0000","last_active":"2023-11-04T01:40:09.728110+0000","last_peered":"2023-11-04T01:40:09.728110+0000","last_clean":"2023-11-04T01:40:09.728110+0000","last_became_active":"2023-11-04T01:40:05.559446+0000","last_became_peered":"2023-11-04T01:40:05.559446+0000","last_unstale":"2023-11-04T01:40:09.728110+0000","last_undegraded":"2023-11-04T01:40:09.728110+0000","last_fullsized":"2023-11-04T01:40:09.728110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:56.908968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734467+0000","last_change":"2023-11-04T01:40:04.708172+0000","last_active":"2023-11-04T01:40:09.734467+0000","last_peered":"2023-11-04T01:40:09.734467+0000","last_clean":"2023-11-04T01:40:09.734467+0000","last_became_active":"2023-11-04T01:40:04.707882+0000","last_became_peered":"2023-11-04T01:40:04.707882+0000","last_unstale":"2023-11-04T01:40:09.734467+0000","last_undegraded":"2023-11-04T01:40:09.734467+0000","last_fullsized":"2023-11-04T01:40:09.734467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:01.195966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.550470+0000","last_change":"2023-11-04T01:40:09.749232+0000","last_active":"2023-11-04T01:40:10.550470+0000","last_peered":"2023-11-04T01:40:10.550470+0000","last_clean":"2023-11-04T01:40:10.550470+0000","last_became_active":"2023-11-04T01:40:09.748638+0000","last_became_peered":"2023-11-04T01:40:09.748638+0000","last_unstale":"2023-11-04T01:40:10.550470+0000","last_undegraded":"2023-11-04T01:40:10.550470+0000","last_fullsized":"2023-11-04T01:40:10.550470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:58.518860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734540+0000","last_change":"2023-11-04T01:40:05.562143+0000","last_active":"2023-11-04T01:40:09.734540+0000","last_peered":"2023-11-04T01:40:09.734540+0000","last_clean":"2023-11-04T01:40:09.734540+0000","last_became_active":"2023-11-04T01:40:05.561862+0000","last_became_peered":"2023-11-04T01:40:05.561862+0000","last_unstale":"2023-11-04T01:40:09.734540+0000","last_undegraded":"2023-11-04T01:40:09.734540+0000","last_fullsized":"2023-11-04T01:40:09.734540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:09:40.586446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732147+0000","last_change":"2023-11-04T01:40:04.710881+0000","last_active":"2023-11-04T01:40:09.732147+0000","last_peered":"2023-11-04T01:40:09.732147+0000","last_clean":"2023-11-04T01:40:09.732147+0000","last_became_active":"2023-11-04T01:40:04.710601+0000","last_became_peered":"2023-11-04T01:40:04.710601+0000","last_unstale":"2023-11-04T01:40:09.732147+0000","last_undegraded":"2023-11-04T01:40:09.732147+0000","last_fullsized":"2023-11-04T01:40:09.732147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:46:17.945642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255709+0000","last_change":"2023-11-04T01:40:09.749485+0000","last_active":"2023-11-04T01:40:11.255709+0000","last_peered":"2023-11-04T01:40:11.255709+0000","last_clean":"2023-11-04T01:40:11.255709+0000","last_became_active":"2023-11-04T01:40:09.748804+0000","last_became_peered":"2023-11-04T01:40:09.748804+0000","last_unstale":"2023-11-04T01:40:11.255709+0000","last_undegraded":"2023-11-04T01:40:11.255709+0000","last_fullsized":"2023-11-04T01:40:11.255709+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:19.049388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729332+0000","last_change":"2023-11-04T01:40:05.571329+0000","last_active":"2023-11-04T01:40:09.729332+0000","last_peered":"2023-11-04T01:40:09.729332+0000","last_clean":"2023-11-04T01:40:09.729332+0000","last_became_active":"2023-11-04T01:40:05.571077+0000","last_became_peered":"2023-11-04T01:40:05.571077+0000","last_unstale":"2023-11-04T01:40:09.729332+0000","last_undegraded":"2023-11-04T01:40:09.729332+0000","last_fullsized":"2023-11-04T01:40:09.729332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:56.908968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734615+0000","last_change":"2023-11-04T01:40:04.710975+0000","last_active":"2023-11-04T01:40:09.734615+0000","last_peered":"2023-11-04T01:40:09.734615+0000","last_clean":"2023-11-04T01:40:09.734615+0000","last_became_active":"2023-11-04T01:40:04.710643+0000","last_became_peered":"2023-11-04T01:40:04.710643+0000","last_unstale":"2023-11-04T01:40:09.734615+0000","last_undegraded":"2023-11-04T01:40:09.734615+0000","last_fullsized":"2023-11-04T01:40:09.734615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:55:42.496852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255585+0000","last_change":"2023-11-04T01:40:09.745566+0000","last_active":"2023-11-04T01:40:11.255585+0000","last_peered":"2023-11-04T01:40:11.255585+0000","last_clean":"2023-11-04T01:40:11.255585+0000","last_became_active":"2023-11-04T01:40:09.745232+0000","last_became_peered":"2023-11-04T01:40:09.745232+0000","last_unstale":"2023-11-04T01:40:11.255585+0000","last_undegraded":"2023-11-04T01:40:11.255585+0000","last_fullsized":"2023-11-04T01:40:11.255585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:18:59.903542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734765+0000","last_change":"2023-11-04T01:40:05.566450+0000","last_active":"2023-11-04T01:40:09.734765+0000","last_peered":"2023-11-04T01:40:09.734765+0000","last_clean":"2023-11-04T01:40:09.734765+0000","last_became_active":"2023-11-04T01:40:05.565477+0000","last_became_peered":"2023-11-04T01:40:05.565477+0000","last_unstale":"2023-11-04T01:40:09.734765+0000","last_undegraded":"2023-11-04T01:40:09.734765+0000","last_fullsized":"2023-11-04T01:40:09.734765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:45:02.590707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.730048+0000","last_change":"2023-11-04T01:40:04.707185+0000","last_active":"2023-11-04T01:40:09.730048+0000","last_peered":"2023-11-04T01:40:09.730048+0000","last_clean":"2023-11-04T01:40:09.730048+0000","last_became_active":"2023-11-04T01:40:04.706814+0000","last_became_peered":"2023-11-04T01:40:04.706814+0000","last_unstale":"2023-11-04T01:40:09.730048+0000","last_undegraded":"2023-11-04T01:40:09.730048+0000","last_fullsized":"2023-11-04T01:40:09.730048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:51:08.117585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256134+0000","last_change":"2023-11-04T01:40:09.751263+0000","last_active":"2023-11-04T01:40:11.256134+0000","last_peered":"2023-11-04T01:40:11.256134+0000","last_clean":"2023-11-04T01:40:11.256134+0000","last_became_active":"2023-11-04T01:40:09.750948+0000","last_became_peered":"2023-11-04T01:40:09.750948+0000","last_unstale":"2023-11-04T01:40:11.256134+0000","last_undegraded":"2023-11-04T01:40:11.256134+0000","last_fullsized":"2023-11-04T01:40:11.256134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:14:21.977139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.736252+0000","last_change":"2023-11-04T01:40:05.562139+0000","last_active":"2023-11-04T01:40:09.736252+0000","last_peered":"2023-11-04T01:40:09.736252+0000","last_clean":"2023-11-04T01:40:09.736252+0000","last_became_active":"2023-11-04T01:40:05.561872+0000","last_became_peered":"2023-11-04T01:40:05.561872+0000","last_unstale":"2023-11-04T01:40:09.736252+0000","last_undegraded":"2023-11-04T01:40:09.736252+0000","last_fullsized":"2023-11-04T01:40:09.736252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:44:56.709670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.736987+0000","last_change":"2023-11-04T01:40:04.697746+0000","last_active":"2023-11-04T01:40:09.736987+0000","last_peered":"2023-11-04T01:40:09.736987+0000","last_clean":"2023-11-04T01:40:09.736987+0000","last_became_active":"2023-11-04T01:40:04.697469+0000","last_became_peered":"2023-11-04T01:40:04.697469+0000","last_unstale":"2023-11-04T01:40:09.736987+0000","last_undegraded":"2023-11-04T01:40:09.736987+0000","last_fullsized":"2023-11-04T01:40:09.736987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:12:07.756761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256639+0000","last_change":"2023-11-04T01:40:09.746485+0000","last_active":"2023-11-04T01:40:11.256639+0000","last_peered":"2023-11-04T01:40:11.256639+0000","last_clean":"2023-11-04T01:40:11.256639+0000","last_became_active":"2023-11-04T01:40:09.746134+0000","last_became_peered":"2023-11-04T01:40:09.746134+0000","last_unstale":"2023-11-04T01:40:11.256639+0000","last_undegraded":"2023-11-04T01:40:11.256639+0000","last_fullsized":"2023-11-04T01:40:11.256639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:25.883087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731984+0000","last_change":"2023-11-04T01:40:05.560837+0000","last_active":"2023-11-04T01:40:09.731984+0000","last_peered":"2023-11-04T01:40:09.731984+0000","last_clean":"2023-11-04T01:40:09.731984+0000","last_became_active":"2023-11-04T01:40:05.560083+0000","last_became_peered":"2023-11-04T01:40:05.560083+0000","last_unstale":"2023-11-04T01:40:09.731984+0000","last_undegraded":"2023-11-04T01:40:09.731984+0000","last_fullsized":"2023-11-04T01:40:09.731984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:45:57.550853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731654+0000","last_change":"2023-11-04T01:40:04.704308+0000","last_active":"2023-11-04T01:40:09.731654+0000","last_peered":"2023-11-04T01:40:09.731654+0000","last_clean":"2023-11-04T01:40:09.731654+0000","last_became_active":"2023-11-04T01:40:04.703783+0000","last_became_peered":"2023-11-04T01:40:04.703783+0000","last_unstale":"2023-11-04T01:40:09.731654+0000","last_undegraded":"2023-11-04T01:40:09.731654+0000","last_fullsized":"2023-11-04T01:40:09.731654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:35.223156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255849+0000","last_change":"2023-11-04T01:40:09.748878+0000","last_active":"2023-11-04T01:40:11.255849+0000","last_peered":"2023-11-04T01:40:11.255849+0000","last_clean":"2023-11-04T01:40:11.255849+0000","last_became_active":"2023-11-04T01:40:09.748399+0000","last_became_peered":"2023-11-04T01:40:09.748399+0000","last_unstale":"2023-11-04T01:40:11.255849+0000","last_undegraded":"2023-11-04T01:40:11.255849+0000","last_fullsized":"2023-11-04T01:40:11.255849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:14:21.977139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727379+0000","last_change":"2023-11-04T01:40:05.579730+0000","last_active":"2023-11-04T01:40:09.727379+0000","last_peered":"2023-11-04T01:40:09.727379+0000","last_clean":"2023-11-04T01:40:09.727379+0000","last_became_active":"2023-11-04T01:40:05.579457+0000","last_became_peered":"2023-11-04T01:40:05.579457+0000","last_unstale":"2023-11-04T01:40:09.727379+0000","last_undegraded":"2023-11-04T01:40:09.727379+0000","last_fullsized":"2023-11-04T01:40:09.727379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:09:40.586446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.728766+0000","last_change":"2023-11-04T01:40:04.707059+0000","last_active":"2023-11-04T01:40:09.728766+0000","last_peered":"2023-11-04T01:40:09.728766+0000","last_clean":"2023-11-04T01:40:09.728766+0000","last_became_active":"2023-11-04T01:40:04.706619+0000","last_became_peered":"2023-11-04T01:40:04.706619+0000","last_unstale":"2023-11-04T01:40:09.728766+0000","last_undegraded":"2023-11-04T01:40:09.728766+0000","last_fullsized":"2023-11-04T01:40:09.728766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:44:55.703672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731611+0000","last_change":"2023-11-04T01:39:54.204460+0000","last_active":"2023-11-04T01:40:09.731611+0000","last_peered":"2023-11-04T01:40:09.731611+0000","last_clean":"2023-11-04T01:40:09.731611+0000","last_became_active":"2023-11-04T01:39:54.203352+0000","last_became_peered":"2023-11-04T01:39:54.203352+0000","last_unstale":"2023-11-04T01:40:09.731611+0000","last_undegraded":"2023-11-04T01:40:09.731611+0000","last_fullsized":"2023-11-04T01:40:09.731611+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:52.627032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:52.627032+0000","last_clean_scrub_stamp":"2023-11-04T01:39:52.627032+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:17:18.474768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.550355+0000","last_change":"2023-11-04T01:40:09.744111+0000","last_active":"2023-11-04T01:40:10.550355+0000","last_peered":"2023-11-04T01:40:10.550355+0000","last_clean":"2023-11-04T01:40:10.550355+0000","last_became_active":"2023-11-04T01:40:09.743657+0000","last_became_peered":"2023-11-04T01:40:09.743657+0000","last_unstale":"2023-11-04T01:40:10.550355+0000","last_undegraded":"2023-11-04T01:40:10.550355+0000","last_fullsized":"2023-11-04T01:40:10.550355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:18:59.903542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731749+0000","last_change":"2023-11-04T01:40:05.577079+0000","last_active":"2023-11-04T01:40:09.731749+0000","last_peered":"2023-11-04T01:40:09.731749+0000","last_clean":"2023-11-04T01:40:09.731749+0000","last_became_active":"2023-11-04T01:40:05.576722+0000","last_became_peered":"2023-11-04T01:40:05.576722+0000","last_unstale":"2023-11-04T01:40:09.731749+0000","last_undegraded":"2023-11-04T01:40:09.731749+0000","last_fullsized":"2023-11-04T01:40:09.731749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:18:55.872119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.739610+0000","last_change":"2023-11-04T01:40:04.708618+0000","last_active":"2023-11-04T01:40:09.739610+0000","last_peered":"2023-11-04T01:40:09.739610+0000","last_clean":"2023-11-04T01:40:09.739610+0000","last_became_active":"2023-11-04T01:40:04.708294+0000","last_became_peered":"2023-11-04T01:40:04.708294+0000","last_unstale":"2023-11-04T01:40:09.739610+0000","last_undegraded":"2023-11-04T01:40:09.739610+0000","last_fullsized":"2023-11-04T01:40:09.739610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:58:25.853829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.549398+0000","last_change":"2023-11-04T01:40:09.743960+0000","last_active":"2023-11-04T01:40:10.549398+0000","last_peered":"2023-11-04T01:40:10.549398+0000","last_clean":"2023-11-04T01:40:10.549398+0000","last_became_active":"2023-11-04T01:40:09.743539+0000","last_became_peered":"2023-11-04T01:40:09.743539+0000","last_unstale":"2023-11-04T01:40:10.549398+0000","last_undegraded":"2023-11-04T01:40:10.549398+0000","last_fullsized":"2023-11-04T01:40:10.549398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:45:21.829187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729678+0000","last_change":"2023-11-04T01:40:05.571294+0000","last_active":"2023-11-04T01:40:09.729678+0000","last_peered":"2023-11-04T01:40:09.729678+0000","last_clean":"2023-11-04T01:40:09.729678+0000","last_became_active":"2023-11-04T01:40:05.570961+0000","last_became_peered":"2023-11-04T01:40:05.570961+0000","last_unstale":"2023-11-04T01:40:09.729678+0000","last_undegraded":"2023-11-04T01:40:09.729678+0000","last_fullsized":"2023-11-04T01:40:09.729678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:14:17.945716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734901+0000","last_change":"2023-11-04T01:40:04.700593+0000","last_active":"2023-11-04T01:40:09.734901+0000","last_peered":"2023-11-04T01:40:09.734901+0000","last_clean":"2023-11-04T01:40:09.734901+0000","last_became_active":"2023-11-04T01:40:04.700051+0000","last_became_peered":"2023-11-04T01:40:04.700051+0000","last_unstale":"2023-11-04T01:40:09.734901+0000","last_undegraded":"2023-11-04T01:40:09.734901+0000","last_fullsized":"2023-11-04T01:40:09.734901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:14:24.322290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255865+0000","last_change":"2023-11-04T01:40:09.749244+0000","last_active":"2023-11-04T01:40:11.255865+0000","last_peered":"2023-11-04T01:40:11.255865+0000","last_clean":"2023-11-04T01:40:11.255865+0000","last_became_active":"2023-11-04T01:40:09.748229+0000","last_became_peered":"2023-11-04T01:40:09.748229+0000","last_unstale":"2023-11-04T01:40:11.255865+0000","last_undegraded":"2023-11-04T01:40:11.255865+0000","last_fullsized":"2023-11-04T01:40:11.255865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:47.091874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732531+0000","last_change":"2023-11-04T01:40:05.564770+0000","last_active":"2023-11-04T01:40:09.732531+0000","last_peered":"2023-11-04T01:40:09.732531+0000","last_clean":"2023-11-04T01:40:09.732531+0000","last_became_active":"2023-11-04T01:40:05.564483+0000","last_became_peered":"2023-11-04T01:40:05.564483+0000","last_unstale":"2023-11-04T01:40:09.732531+0000","last_undegraded":"2023-11-04T01:40:09.732531+0000","last_fullsized":"2023-11-04T01:40:09.732531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:41:54.487437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.737108+0000","last_change":"2023-11-04T01:40:04.698832+0000","last_active":"2023-11-04T01:40:09.737108+0000","last_peered":"2023-11-04T01:40:09.737108+0000","last_clean":"2023-11-04T01:40:09.737108+0000","last_became_active":"2023-11-04T01:40:04.698498+0000","last_became_peered":"2023-11-04T01:40:04.698498+0000","last_unstale":"2023-11-04T01:40:09.737108+0000","last_undegraded":"2023-11-04T01:40:09.737108+0000","last_fullsized":"2023-11-04T01:40:09.737108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:02:39.769313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255109+0000","last_change":"2023-11-04T01:40:09.744405+0000","last_active":"2023-11-04T01:40:11.255109+0000","last_peered":"2023-11-04T01:40:11.255109+0000","last_clean":"2023-11-04T01:40:11.255109+0000","last_became_active":"2023-11-04T01:40:09.743992+0000","last_became_peered":"2023-11-04T01:40:09.743992+0000","last_unstale":"2023-11-04T01:40:11.255109+0000","last_undegraded":"2023-11-04T01:40:11.255109+0000","last_fullsized":"2023-11-04T01:40:11.255109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:23:03.976941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732033+0000","last_change":"2023-11-04T01:40:05.565058+0000","last_active":"2023-11-04T01:40:09.732033+0000","last_peered":"2023-11-04T01:40:09.732033+0000","last_clean":"2023-11-04T01:40:09.732033+0000","last_became_active":"2023-11-04T01:40:05.564784+0000","last_became_peered":"2023-11-04T01:40:05.564784+0000","last_unstale":"2023-11-04T01:40:09.732033+0000","last_undegraded":"2023-11-04T01:40:09.732033+0000","last_fullsized":"2023-11-04T01:40:09.732033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:15.017965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732789+0000","last_change":"2023-11-04T01:40:04.699612+0000","last_active":"2023-11-04T01:40:09.732789+0000","last_peered":"2023-11-04T01:40:09.732789+0000","last_clean":"2023-11-04T01:40:09.732789+0000","last_became_active":"2023-11-04T01:40:04.697978+0000","last_became_peered":"2023-11-04T01:40:04.697978+0000","last_unstale":"2023-11-04T01:40:09.732789+0000","last_undegraded":"2023-11-04T01:40:09.732789+0000","last_fullsized":"2023-11-04T01:40:09.732789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:11:00.897268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255902+0000","last_change":"2023-11-04T01:40:09.753878+0000","last_active":"2023-11-04T01:40:11.255902+0000","last_peered":"2023-11-04T01:40:11.255902+0000","last_clean":"2023-11-04T01:40:11.255902+0000","last_became_active":"2023-11-04T01:40:09.753521+0000","last_became_peered":"2023-11-04T01:40:09.753521+0000","last_unstale":"2023-11-04T01:40:11.255902+0000","last_undegraded":"2023-11-04T01:40:11.255902+0000","last_fullsized":"2023-11-04T01:40:11.255902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:21.893866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731429+0000","last_change":"2023-11-04T01:40:05.561139+0000","last_active":"2023-11-04T01:40:09.731429+0000","last_peered":"2023-11-04T01:40:09.731429+0000","last_clean":"2023-11-04T01:40:09.731429+0000","last_became_active":"2023-11-04T01:40:05.560824+0000","last_became_peered":"2023-11-04T01:40:05.560824+0000","last_unstale":"2023-11-04T01:40:09.731429+0000","last_undegraded":"2023-11-04T01:40:09.731429+0000","last_fullsized":"2023-11-04T01:40:09.731429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:32:27.484390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.736542+0000","last_change":"2023-11-04T01:40:04.704879+0000","last_active":"2023-11-04T01:40:09.736542+0000","last_peered":"2023-11-04T01:40:09.736542+0000","last_clean":"2023-11-04T01:40:09.736542+0000","last_became_active":"2023-11-04T01:40:04.704561+0000","last_became_peered":"2023-11-04T01:40:04.704561+0000","last_unstale":"2023-11-04T01:40:09.736542+0000","last_undegraded":"2023-11-04T01:40:09.736542+0000","last_fullsized":"2023-11-04T01:40:09.736542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:35.223156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256043+0000","last_change":"2023-11-04T01:40:09.743050+0000","last_active":"2023-11-04T01:40:11.256043+0000","last_peered":"2023-11-04T01:40:11.256043+0000","last_clean":"2023-11-04T01:40:11.256043+0000","last_became_active":"2023-11-04T01:40:09.742685+0000","last_became_peered":"2023-11-04T01:40:09.742685+0000","last_unstale":"2023-11-04T01:40:11.256043+0000","last_undegraded":"2023-11-04T01:40:11.256043+0000","last_fullsized":"2023-11-04T01:40:11.256043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:25.883087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.737349+0000","last_change":"2023-11-04T01:40:05.566982+0000","last_active":"2023-11-04T01:40:09.737349+0000","last_peered":"2023-11-04T01:40:09.737349+0000","last_clean":"2023-11-04T01:40:09.737349+0000","last_became_active":"2023-11-04T01:40:05.566400+0000","last_became_peered":"2023-11-04T01:40:05.566400+0000","last_unstale":"2023-11-04T01:40:09.737349+0000","last_undegraded":"2023-11-04T01:40:09.737349+0000","last_fullsized":"2023-11-04T01:40:09.737349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:24.555185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.738136+0000","last_change":"2023-11-04T01:40:04.702671+0000","last_active":"2023-11-04T01:40:09.738136+0000","last_peered":"2023-11-04T01:40:09.738136+0000","last_clean":"2023-11-04T01:40:09.738136+0000","last_became_active":"2023-11-04T01:40:04.702403+0000","last_became_peered":"2023-11-04T01:40:04.702403+0000","last_unstale":"2023-11-04T01:40:09.738136+0000","last_undegraded":"2023-11-04T01:40:09.738136+0000","last_fullsized":"2023-11-04T01:40:09.738136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:23.661606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.551245+0000","last_change":"2023-11-04T01:40:09.750337+0000","last_active":"2023-11-04T01:40:10.551245+0000","last_peered":"2023-11-04T01:40:10.551245+0000","last_clean":"2023-11-04T01:40:10.551245+0000","last_became_active":"2023-11-04T01:40:09.748314+0000","last_became_peered":"2023-11-04T01:40:09.748314+0000","last_unstale":"2023-11-04T01:40:10.551245+0000","last_undegraded":"2023-11-04T01:40:10.551245+0000","last_fullsized":"2023-11-04T01:40:10.551245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:59:19.908042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731576+0000","last_change":"2023-11-04T01:40:05.568489+0000","last_active":"2023-11-04T01:40:09.731576+0000","last_peered":"2023-11-04T01:40:09.731576+0000","last_clean":"2023-11-04T01:40:09.731576+0000","last_became_active":"2023-11-04T01:40:05.568169+0000","last_became_peered":"2023-11-04T01:40:05.568169+0000","last_unstale":"2023-11-04T01:40:09.731576+0000","last_undegraded":"2023-11-04T01:40:09.731576+0000","last_fullsized":"2023-11-04T01:40:09.731576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:45:17.797764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729951+0000","last_change":"2023-11-04T01:40:04.707560+0000","last_active":"2023-11-04T01:40:09.729951+0000","last_peered":"2023-11-04T01:40:09.729951+0000","last_clean":"2023-11-04T01:40:09.729951+0000","last_became_active":"2023-11-04T01:40:04.707230+0000","last_became_peered":"2023-11-04T01:40:04.707230+0000","last_unstale":"2023-11-04T01:40:09.729951+0000","last_undegraded":"2023-11-04T01:40:09.729951+0000","last_fullsized":"2023-11-04T01:40:09.729951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:23.549186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.551075+0000","last_change":"2023-11-04T01:40:09.750047+0000","last_active":"2023-11-04T01:40:10.551075+0000","last_peered":"2023-11-04T01:40:10.551075+0000","last_clean":"2023-11-04T01:40:10.551075+0000","last_became_active":"2023-11-04T01:40:09.749057+0000","last_became_peered":"2023-11-04T01:40:09.749057+0000","last_unstale":"2023-11-04T01:40:10.551075+0000","last_undegraded":"2023-11-04T01:40:10.551075+0000","last_fullsized":"2023-11-04T01:40:10.551075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:22:24.152135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732097+0000","last_change":"2023-11-04T01:40:05.558257+0000","last_active":"2023-11-04T01:40:09.732097+0000","last_peered":"2023-11-04T01:40:09.732097+0000","last_clean":"2023-11-04T01:40:09.732097+0000","last_became_active":"2023-11-04T01:40:05.557891+0000","last_became_peered":"2023-11-04T01:40:05.557891+0000","last_unstale":"2023-11-04T01:40:09.732097+0000","last_undegraded":"2023-11-04T01:40:09.732097+0000","last_fullsized":"2023-11-04T01:40:09.732097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:24.555185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732974+0000","last_change":"2023-11-04T01:40:04.698298+0000","last_active":"2023-11-04T01:40:09.732974+0000","last_peered":"2023-11-04T01:40:09.732974+0000","last_clean":"2023-11-04T01:40:09.732974+0000","last_became_active":"2023-11-04T01:40:04.697835+0000","last_became_peered":"2023-11-04T01:40:04.697835+0000","last_unstale":"2023-11-04T01:40:09.732974+0000","last_undegraded":"2023-11-04T01:40:09.732974+0000","last_fullsized":"2023-11-04T01:40:09.732974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:35.223156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255855+0000","last_change":"2023-11-04T01:40:09.742018+0000","last_active":"2023-11-04T01:40:11.255855+0000","last_peered":"2023-11-04T01:40:11.255855+0000","last_clean":"2023-11-04T01:40:11.255855+0000","last_became_active":"2023-11-04T01:40:09.741656+0000","last_became_peered":"2023-11-04T01:40:09.741656+0000","last_unstale":"2023-11-04T01:40:11.255855+0000","last_undegraded":"2023-11-04T01:40:11.255855+0000","last_fullsized":"2023-11-04T01:40:11.255855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:59:48.059889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731464+0000","last_change":"2023-11-04T01:40:05.561050+0000","last_active":"2023-11-04T01:40:09.731464+0000","last_peered":"2023-11-04T01:40:09.731464+0000","last_clean":"2023-11-04T01:40:09.731464+0000","last_became_active":"2023-11-04T01:40:05.560752+0000","last_became_peered":"2023-11-04T01:40:05.560752+0000","last_unstale":"2023-11-04T01:40:09.731464+0000","last_undegraded":"2023-11-04T01:40:09.731464+0000","last_fullsized":"2023-11-04T01:40:09.731464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:56.908968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:16.072010+0000","last_change":"2023-11-04T01:40:04.700840+0000","last_active":"2023-11-04T01:40:16.072010+0000","last_peered":"2023-11-04T01:40:16.072010+0000","last_clean":"2023-11-04T01:40:16.072010+0000","last_became_active":"2023-11-04T01:40:04.700524+0000","last_became_peered":"2023-11-04T01:40:04.700524+0000","last_unstale":"2023-11-04T01:40:16.072010+0000","last_undegraded":"2023-11-04T01:40:16.072010+0000","last_fullsized":"2023-11-04T01:40:16.072010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:45:56.544854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255711+0000","last_change":"2023-11-04T01:40:09.747985+0000","last_active":"2023-11-04T01:40:11.255711+0000","last_peered":"2023-11-04T01:40:11.255711+0000","last_clean":"2023-11-04T01:40:11.255711+0000","last_became_active":"2023-11-04T01:40:09.747607+0000","last_became_peered":"2023-11-04T01:40:09.747607+0000","last_unstale":"2023-11-04T01:40:11.255711+0000","last_undegraded":"2023-11-04T01:40:11.255711+0000","last_fullsized":"2023-11-04T01:40:11.255711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:19.049388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.737830+0000","last_change":"2023-11-04T01:40:05.560889+0000","last_active":"2023-11-04T01:40:09.737830+0000","last_peered":"2023-11-04T01:40:09.737830+0000","last_clean":"2023-11-04T01:40:09.737830+0000","last_became_active":"2023-11-04T01:40:05.560631+0000","last_became_peered":"2023-11-04T01:40:05.560631+0000","last_unstale":"2023-11-04T01:40:09.737830+0000","last_undegraded":"2023-11-04T01:40:09.737830+0000","last_fullsized":"2023-11-04T01:40:09.737830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:02:40.775312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734805+0000","last_change":"2023-11-04T01:40:04.708390+0000","last_active":"2023-11-04T01:40:09.734805+0000","last_peered":"2023-11-04T01:40:09.734805+0000","last_clean":"2023-11-04T01:40:09.734805+0000","last_became_active":"2023-11-04T01:40:04.708142+0000","last_became_peered":"2023-11-04T01:40:04.708142+0000","last_unstale":"2023-11-04T01:40:09.734805+0000","last_undegraded":"2023-11-04T01:40:09.734805+0000","last_fullsized":"2023-11-04T01:40:09.734805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:15:03.573413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.256687+0000","last_change":"2023-11-04T01:40:09.748503+0000","last_active":"2023-11-04T01:40:11.256687+0000","last_peered":"2023-11-04T01:40:11.256687+0000","last_clean":"2023-11-04T01:40:11.256687+0000","last_became_active":"2023-11-04T01:40:09.748074+0000","last_became_peered":"2023-11-04T01:40:09.748074+0000","last_unstale":"2023-11-04T01:40:11.256687+0000","last_undegraded":"2023-11-04T01:40:11.256687+0000","last_fullsized":"2023-11-04T01:40:11.256687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:18:59.903542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734280+0000","last_change":"2023-11-04T01:40:05.578830+0000","last_active":"2023-11-04T01:40:09.734280+0000","last_peered":"2023-11-04T01:40:09.734280+0000","last_clean":"2023-11-04T01:40:09.734280+0000","last_became_active":"2023-11-04T01:40:05.578600+0000","last_became_peered":"2023-11-04T01:40:05.578600+0000","last_unstale":"2023-11-04T01:40:09.734280+0000","last_undegraded":"2023-11-04T01:40:09.734280+0000","last_fullsized":"2023-11-04T01:40:09.734280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:17.862444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729084+0000","last_change":"2023-11-04T01:40:04.712885+0000","last_active":"2023-11-04T01:40:09.729084+0000","last_peered":"2023-11-04T01:40:09.729084+0000","last_clean":"2023-11-04T01:40:09.729084+0000","last_became_active":"2023-11-04T01:40:04.712596+0000","last_became_peered":"2023-11-04T01:40:04.712596+0000","last_unstale":"2023-11-04T01:40:09.729084+0000","last_undegraded":"2023-11-04T01:40:09.729084+0000","last_fullsized":"2023-11-04T01:40:09.729084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:01.195966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.550952+0000","last_change":"2023-11-04T01:40:09.749818+0000","last_active":"2023-11-04T01:40:10.550952+0000","last_peered":"2023-11-04T01:40:10.550952+0000","last_clean":"2023-11-04T01:40:10.550952+0000","last_became_active":"2023-11-04T01:40:09.749447+0000","last_became_peered":"2023-11-04T01:40:09.749447+0000","last_unstale":"2023-11-04T01:40:10.550952+0000","last_undegraded":"2023-11-04T01:40:10.550952+0000","last_fullsized":"2023-11-04T01:40:10.550952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:14:02.598554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729015+0000","last_change":"2023-11-04T01:40:05.576921+0000","last_active":"2023-11-04T01:40:09.729015+0000","last_peered":"2023-11-04T01:40:09.729015+0000","last_clean":"2023-11-04T01:40:09.729015+0000","last_became_active":"2023-11-04T01:40:05.576105+0000","last_became_peered":"2023-11-04T01:40:05.576105+0000","last_unstale":"2023-11-04T01:40:09.729015+0000","last_undegraded":"2023-11-04T01:40:09.729015+0000","last_fullsized":"2023-11-04T01:40:09.729015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:32:27.484390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.735071+0000","last_change":"2023-11-04T01:40:04.708447+0000","last_active":"2023-11-04T01:40:09.735071+0000","last_peered":"2023-11-04T01:40:09.735071+0000","last_clean":"2023-11-04T01:40:09.735071+0000","last_became_active":"2023-11-04T01:40:04.708148+0000","last_became_peered":"2023-11-04T01:40:04.708148+0000","last_unstale":"2023-11-04T01:40:09.735071+0000","last_undegraded":"2023-11-04T01:40:09.735071+0000","last_fullsized":"2023-11-04T01:40:09.735071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:15:03.573413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.550821+0000","last_change":"2023-11-04T01:40:09.750214+0000","last_active":"2023-11-04T01:40:10.550821+0000","last_peered":"2023-11-04T01:40:10.550821+0000","last_clean":"2023-11-04T01:40:10.550821+0000","last_became_active":"2023-11-04T01:40:09.746156+0000","last_became_peered":"2023-11-04T01:40:09.746156+0000","last_unstale":"2023-11-04T01:40:10.550821+0000","last_undegraded":"2023-11-04T01:40:10.550821+0000","last_fullsized":"2023-11-04T01:40:10.550821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:59:48.059889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255702+0000","last_change":"2023-11-04T01:40:09.749952+0000","last_active":"2023-11-04T01:40:11.255702+0000","last_peered":"2023-11-04T01:40:11.255702+0000","last_clean":"2023-11-04T01:40:11.255702+0000","last_became_active":"2023-11-04T01:40:09.749363+0000","last_became_peered":"2023-11-04T01:40:09.749363+0000","last_unstale":"2023-11-04T01:40:11.255702+0000","last_undegraded":"2023-11-04T01:40:11.255702+0000","last_fullsized":"2023-11-04T01:40:11.255702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:18:59.903542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.733435+0000","last_change":"2023-11-04T01:40:05.560460+0000","last_active":"2023-11-04T01:40:09.733435+0000","last_peered":"2023-11-04T01:40:09.733435+0000","last_clean":"2023-11-04T01:40:09.733435+0000","last_became_active":"2023-11-04T01:40:05.560165+0000","last_became_peered":"2023-11-04T01:40:05.560165+0000","last_unstale":"2023-11-04T01:40:09.733435+0000","last_undegraded":"2023-11-04T01:40:09.733435+0000","last_fullsized":"2023-11-04T01:40:09.733435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:24.555185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.728844+0000","last_change":"2023-11-04T01:40:04.708233+0000","last_active":"2023-11-04T01:40:09.728844+0000","last_peered":"2023-11-04T01:40:09.728844+0000","last_clean":"2023-11-04T01:40:09.728844+0000","last_became_active":"2023-11-04T01:40:04.707913+0000","last_became_peered":"2023-11-04T01:40:04.707913+0000","last_unstale":"2023-11-04T01:40:09.728844+0000","last_undegraded":"2023-11-04T01:40:09.728844+0000","last_fullsized":"2023-11-04T01:40:09.728844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:14:24.322290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.549797+0000","last_change":"2023-11-04T01:40:09.743651+0000","last_active":"2023-11-04T01:40:10.549797+0000","last_peered":"2023-11-04T01:40:10.549797+0000","last_clean":"2023-11-04T01:40:10.549797+0000","last_became_active":"2023-11-04T01:40:09.743132+0000","last_became_peered":"2023-11-04T01:40:09.743132+0000","last_unstale":"2023-11-04T01:40:10.549797+0000","last_undegraded":"2023-11-04T01:40:10.549797+0000","last_fullsized":"2023-11-04T01:40:10.549797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:09:57.363528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727847+0000","last_change":"2023-11-04T01:40:05.568979+0000","last_active":"2023-11-04T01:40:09.727847+0000","last_peered":"2023-11-04T01:40:09.727847+0000","last_clean":"2023-11-04T01:40:09.727847+0000","last_became_active":"2023-11-04T01:40:05.568692+0000","last_became_peered":"2023-11-04T01:40:05.568692+0000","last_unstale":"2023-11-04T01:40:09.727847+0000","last_undegraded":"2023-11-04T01:40:09.727847+0000","last_fullsized":"2023-11-04T01:40:09.727847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:24.555185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727941+0000","last_change":"2023-11-04T01:40:04.703998+0000","last_active":"2023-11-04T01:40:09.727941+0000","last_peered":"2023-11-04T01:40:09.727941+0000","last_clean":"2023-11-04T01:40:09.727941+0000","last_became_active":"2023-11-04T01:40:04.703732+0000","last_became_peered":"2023-11-04T01:40:04.703732+0000","last_unstale":"2023-11-04T01:40:09.727941+0000","last_undegraded":"2023-11-04T01:40:09.727941+0000","last_fullsized":"2023-11-04T01:40:09.727941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:15:03.573413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734226+0000","last_change":"2023-11-04T01:40:04.705664+0000","last_active":"2023-11-04T01:40:09.734226+0000","last_peered":"2023-11-04T01:40:09.734226+0000","last_clean":"2023-11-04T01:40:09.734226+0000","last_became_active":"2023-11-04T01:40:04.705126+0000","last_became_peered":"2023-11-04T01:40:04.705126+0000","last_unstale":"2023-11-04T01:40:09.734226+0000","last_undegraded":"2023-11-04T01:40:09.734226+0000","last_fullsized":"2023-11-04T01:40:09.734226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:55:42.496852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732896+0000","last_change":"2023-11-04T01:40:05.560706+0000","last_active":"2023-11-04T01:40:09.732896+0000","last_peered":"2023-11-04T01:40:09.732896+0000","last_clean":"2023-11-04T01:40:09.732896+0000","last_became_active":"2023-11-04T01:40:05.560192+0000","last_became_peered":"2023-11-04T01:40:05.560192+0000","last_unstale":"2023-11-04T01:40:09.732896+0000","last_undegraded":"2023-11-04T01:40:09.732896+0000","last_fullsized":"2023-11-04T01:40:09.732896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:02.182321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:11.255328+0000","last_change":"2023-11-04T01:40:09.754009+0000","last_active":"2023-11-04T01:40:11.255328+0000","last_peered":"2023-11-04T01:40:11.255328+0000","last_clean":"2023-11-04T01:40:11.255328+0000","last_became_active":"2023-11-04T01:40:09.753444+0000","last_became_peered":"2023-11-04T01:40:09.753444+0000","last_unstale":"2023-11-04T01:40:11.255328+0000","last_undegraded":"2023-11-04T01:40:11.255328+0000","last_fullsized":"2023-11-04T01:40:11.255328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:01.582276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727803+0000","last_change":"2023-11-04T01:40:04.701551+0000","last_active":"2023-11-04T01:40:09.727803+0000","last_peered":"2023-11-04T01:40:09.727803+0000","last_clean":"2023-11-04T01:40:09.727803+0000","last_became_active":"2023-11-04T01:40:04.701340+0000","last_became_peered":"2023-11-04T01:40:04.701340+0000","last_unstale":"2023-11-04T01:40:09.727803+0000","last_undegraded":"2023-11-04T01:40:09.727803+0000","last_fullsized":"2023-11-04T01:40:09.727803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:03.677047+0000","last_clean_scrub_stamp":"2023-11-04T01:40:03.677047+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:45:01.584709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.736946+0000","last_change":"2023-11-04T01:40:05.564231+0000","last_active":"2023-11-04T01:40:09.736946+0000","last_peered":"2023-11-04T01:40:09.736946+0000","last_clean":"2023-11-04T01:40:09.736946+0000","last_became_active":"2023-11-04T01:40:05.563931+0000","last_became_peered":"2023-11-04T01:40:05.563931+0000","last_unstale":"2023-11-04T01:40:09.736946+0000","last_undegraded":"2023-11-04T01:40:09.736946+0000","last_fullsized":"2023-11-04T01:40:09.736946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:25:21.992534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-04T01:40:10.551057+0000","last_change":"2023-11-04T01:40:09.744711+0000","last_active":"2023-11-04T01:40:10.551057+0000","last_peered":"2023-11-04T01:40:10.551057+0000","last_clean":"2023-11-04T01:40:10.551057+0000","last_became_active":"2023-11-04T01:40:09.744338+0000","last_became_peered":"2023-11-04T01:40:09.744338+0000","last_unstale":"2023-11-04T01:40:10.551057+0000","last_undegraded":"2023-11-04T01:40:10.551057+0000","last_fullsized":"2023-11-04T01:40:10.551057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:08.714468+0000","last_clean_scrub_stamp":"2023-11-04T01:40:08.714468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:49:35.523050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.737269+0000","last_change":"2023-11-04T01:40:05.567145+0000","last_active":"2023-11-04T01:40:09.737269+0000","last_peered":"2023-11-04T01:40:09.737269+0000","last_clean":"2023-11-04T01:40:09.737269+0000","last_became_active":"2023-11-04T01:40:05.566731+0000","last_became_peered":"2023-11-04T01:40:05.566731+0000","last_unstale":"2023-11-04T01:40:09.737269+0000","last_undegraded":"2023-11-04T01:40:09.737269+0000","last_fullsized":"2023-11-04T01:40:09.737269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:51:09.123583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.736001+0000","last_change":"2023-11-04T01:40:05.579375+0000","last_active":"2023-11-04T01:40:09.736001+0000","last_peered":"2023-11-04T01:40:09.736001+0000","last_clean":"2023-11-04T01:40:09.736001+0000","last_became_active":"2023-11-04T01:40:05.579083+0000","last_became_peered":"2023-11-04T01:40:05.579083+0000","last_unstale":"2023-11-04T01:40:09.736001+0000","last_undegraded":"2023-11-04T01:40:09.736001+0000","last_fullsized":"2023-11-04T01:40:09.736001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:25:21.992534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729856+0000","last_change":"2023-11-04T01:40:05.577656+0000","last_active":"2023-11-04T01:40:09.729856+0000","last_peered":"2023-11-04T01:40:09.729856+0000","last_clean":"2023-11-04T01:40:09.729856+0000","last_became_active":"2023-11-04T01:40:05.577375+0000","last_became_peered":"2023-11-04T01:40:05.577375+0000","last_unstale":"2023-11-04T01:40:09.729856+0000","last_undegraded":"2023-11-04T01:40:09.729856+0000","last_fullsized":"2023-11-04T01:40:09.729856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:46:18.951640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732817+0000","last_change":"2023-11-04T01:40:05.562307+0000","last_active":"2023-11-04T01:40:09.732817+0000","last_peered":"2023-11-04T01:40:09.732817+0000","last_clean":"2023-11-04T01:40:09.732817+0000","last_became_active":"2023-11-04T01:40:05.562060+0000","last_became_peered":"2023-11-04T01:40:05.562060+0000","last_unstale":"2023-11-04T01:40:09.732817+0000","last_undegraded":"2023-11-04T01:40:09.732817+0000","last_fullsized":"2023-11-04T01:40:09.732817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:09:40.586446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.728326+0000","last_change":"2023-11-04T01:40:05.565815+0000","last_active":"2023-11-04T01:40:09.728326+0000","last_peered":"2023-11-04T01:40:09.728326+0000","last_clean":"2023-11-04T01:40:09.728326+0000","last_became_active":"2023-11-04T01:40:05.565356+0000","last_became_peered":"2023-11-04T01:40:05.565356+0000","last_unstale":"2023-11-04T01:40:09.728326+0000","last_undegraded":"2023-11-04T01:40:09.728326+0000","last_fullsized":"2023-11-04T01:40:09.728326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:46:18.951640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734702+0000","last_change":"2023-11-04T01:40:05.560477+0000","last_active":"2023-11-04T01:40:09.734702+0000","last_peered":"2023-11-04T01:40:09.734702+0000","last_clean":"2023-11-04T01:40:09.734702+0000","last_became_active":"2023-11-04T01:40:05.560213+0000","last_became_peered":"2023-11-04T01:40:05.560213+0000","last_unstale":"2023-11-04T01:40:09.734702+0000","last_undegraded":"2023-11-04T01:40:09.734702+0000","last_fullsized":"2023-11-04T01:40:09.734702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:02.182321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.735601+0000","last_change":"2023-11-04T01:40:05.562260+0000","last_active":"2023-11-04T01:40:09.735601+0000","last_peered":"2023-11-04T01:40:09.735601+0000","last_clean":"2023-11-04T01:40:09.735601+0000","last_became_active":"2023-11-04T01:40:05.561788+0000","last_became_peered":"2023-11-04T01:40:05.561788+0000","last_unstale":"2023-11-04T01:40:09.735601+0000","last_undegraded":"2023-11-04T01:40:09.735601+0000","last_fullsized":"2023-11-04T01:40:09.735601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:46:18.951640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.728083+0000","last_change":"2023-11-04T01:40:05.565701+0000","last_active":"2023-11-04T01:40:09.728083+0000","last_peered":"2023-11-04T01:40:09.728083+0000","last_clean":"2023-11-04T01:40:09.728083+0000","last_became_active":"2023-11-04T01:40:05.565414+0000","last_became_peered":"2023-11-04T01:40:05.565414+0000","last_unstale":"2023-11-04T01:40:09.728083+0000","last_undegraded":"2023-11-04T01:40:09.728083+0000","last_fullsized":"2023-11-04T01:40:09.728083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:35:55.027288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.728758+0000","last_change":"2023-11-04T01:40:05.578120+0000","last_active":"2023-11-04T01:40:09.728758+0000","last_peered":"2023-11-04T01:40:09.728758+0000","last_clean":"2023-11-04T01:40:09.728758+0000","last_became_active":"2023-11-04T01:40:05.576353+0000","last_became_peered":"2023-11-04T01:40:05.576353+0000","last_unstale":"2023-11-04T01:40:09.728758+0000","last_undegraded":"2023-11-04T01:40:09.728758+0000","last_fullsized":"2023-11-04T01:40:09.728758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:43.060452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727831+0000","last_change":"2023-11-04T01:40:05.565797+0000","last_active":"2023-11-04T01:40:09.727831+0000","last_peered":"2023-11-04T01:40:09.727831+0000","last_clean":"2023-11-04T01:40:09.727831+0000","last_became_active":"2023-11-04T01:40:05.565341+0000","last_became_peered":"2023-11-04T01:40:05.565341+0000","last_unstale":"2023-11-04T01:40:09.727831+0000","last_undegraded":"2023-11-04T01:40:09.727831+0000","last_fullsized":"2023-11-04T01:40:09.727831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:51:09.123583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.730213+0000","last_change":"2023-11-04T01:40:05.576354+0000","last_active":"2023-11-04T01:40:09.730213+0000","last_peered":"2023-11-04T01:40:09.730213+0000","last_clean":"2023-11-04T01:40:09.730213+0000","last_became_active":"2023-11-04T01:40:05.576041+0000","last_became_peered":"2023-11-04T01:40:05.576041+0000","last_unstale":"2023-11-04T01:40:09.730213+0000","last_undegraded":"2023-11-04T01:40:09.730213+0000","last_fullsized":"2023-11-04T01:40:09.730213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:17.862444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732728+0000","last_change":"2023-11-04T01:40:05.558627+0000","last_active":"2023-11-04T01:40:09.732728+0000","last_peered":"2023-11-04T01:40:09.732728+0000","last_clean":"2023-11-04T01:40:09.732728+0000","last_became_active":"2023-11-04T01:40:05.558323+0000","last_became_peered":"2023-11-04T01:40:05.558323+0000","last_unstale":"2023-11-04T01:40:09.732728+0000","last_undegraded":"2023-11-04T01:40:09.732728+0000","last_fullsized":"2023-11-04T01:40:09.732728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:02.201965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.735029+0000","last_change":"2023-11-04T01:40:05.565842+0000","last_active":"2023-11-04T01:40:09.735029+0000","last_peered":"2023-11-04T01:40:09.735029+0000","last_clean":"2023-11-04T01:40:09.735029+0000","last_became_active":"2023-11-04T01:40:05.565557+0000","last_became_peered":"2023-11-04T01:40:05.565557+0000","last_unstale":"2023-11-04T01:40:09.735029+0000","last_undegraded":"2023-11-04T01:40:09.735029+0000","last_fullsized":"2023-11-04T01:40:09.735029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:02.182321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732064+0000","last_change":"2023-11-04T01:40:05.557783+0000","last_active":"2023-11-04T01:40:09.732064+0000","last_peered":"2023-11-04T01:40:09.732064+0000","last_clean":"2023-11-04T01:40:09.732064+0000","last_became_active":"2023-11-04T01:40:05.557468+0000","last_became_peered":"2023-11-04T01:40:05.557468+0000","last_unstale":"2023-11-04T01:40:09.732064+0000","last_undegraded":"2023-11-04T01:40:09.732064+0000","last_fullsized":"2023-11-04T01:40:09.732064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:21.851664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.737029+0000","last_change":"2023-11-04T01:40:05.559446+0000","last_active":"2023-11-04T01:40:09.737029+0000","last_peered":"2023-11-04T01:40:09.737029+0000","last_clean":"2023-11-04T01:40:09.737029+0000","last_became_active":"2023-11-04T01:40:05.559182+0000","last_became_peered":"2023-11-04T01:40:05.559182+0000","last_unstale":"2023-11-04T01:40:09.737029+0000","last_undegraded":"2023-11-04T01:40:09.737029+0000","last_fullsized":"2023-11-04T01:40:09.737029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:45:02.590707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.730805+0000","last_change":"2023-11-04T01:40:05.577084+0000","last_active":"2023-11-04T01:40:09.730805+0000","last_peered":"2023-11-04T01:40:09.730805+0000","last_clean":"2023-11-04T01:40:09.730805+0000","last_became_active":"2023-11-04T01:40:05.576079+0000","last_became_peered":"2023-11-04T01:40:05.576079+0000","last_unstale":"2023-11-04T01:40:09.730805+0000","last_undegraded":"2023-11-04T01:40:09.730805+0000","last_fullsized":"2023-11-04T01:40:09.730805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:18:55.872119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.728665+0000","last_change":"2023-11-04T01:40:05.577325+0000","last_active":"2023-11-04T01:40:09.728665+0000","last_peered":"2023-11-04T01:40:09.728665+0000","last_clean":"2023-11-04T01:40:09.728665+0000","last_became_active":"2023-11-04T01:40:05.576140+0000","last_became_peered":"2023-11-04T01:40:05.576140+0000","last_unstale":"2023-11-04T01:40:09.728665+0000","last_undegraded":"2023-11-04T01:40:09.728665+0000","last_fullsized":"2023-11-04T01:40:09.728665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:15.017965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.733522+0000","last_change":"2023-11-04T01:40:05.564247+0000","last_active":"2023-11-04T01:40:09.733522+0000","last_peered":"2023-11-04T01:40:09.733522+0000","last_clean":"2023-11-04T01:40:09.733522+0000","last_became_active":"2023-11-04T01:40:05.563816+0000","last_became_peered":"2023-11-04T01:40:05.563816+0000","last_unstale":"2023-11-04T01:40:09.733522+0000","last_undegraded":"2023-11-04T01:40:09.733522+0000","last_fullsized":"2023-11-04T01:40:09.733522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:51:09.123583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732014+0000","last_change":"2023-11-04T01:40:05.556907+0000","last_active":"2023-11-04T01:40:09.732014+0000","last_peered":"2023-11-04T01:40:09.732014+0000","last_clean":"2023-11-04T01:40:09.732014+0000","last_became_active":"2023-11-04T01:40:05.556614+0000","last_became_peered":"2023-11-04T01:40:05.556614+0000","last_unstale":"2023-11-04T01:40:09.732014+0000","last_undegraded":"2023-11-04T01:40:09.732014+0000","last_fullsized":"2023-11-04T01:40:09.732014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:15:04.579412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727610+0000","last_change":"2023-11-04T01:40:05.561125+0000","last_active":"2023-11-04T01:40:09.727610+0000","last_peered":"2023-11-04T01:40:09.727610+0000","last_clean":"2023-11-04T01:40:09.727610+0000","last_became_active":"2023-11-04T01:40:05.560864+0000","last_became_peered":"2023-11-04T01:40:05.560864+0000","last_unstale":"2023-11-04T01:40:09.727610+0000","last_undegraded":"2023-11-04T01:40:09.727610+0000","last_fullsized":"2023-11-04T01:40:09.727610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:02.182321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.737747+0000","last_change":"2023-11-04T01:40:05.568756+0000","last_active":"2023-11-04T01:40:09.737747+0000","last_peered":"2023-11-04T01:40:09.737747+0000","last_clean":"2023-11-04T01:40:09.737747+0000","last_became_active":"2023-11-04T01:40:05.568238+0000","last_became_peered":"2023-11-04T01:40:05.568238+0000","last_unstale":"2023-11-04T01:40:09.737747+0000","last_undegraded":"2023-11-04T01:40:09.737747+0000","last_fullsized":"2023-11-04T01:40:09.737747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:36.229155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734018+0000","last_change":"2023-11-04T01:40:05.580104+0000","last_active":"2023-11-04T01:40:09.734018+0000","last_peered":"2023-11-04T01:40:09.734018+0000","last_clean":"2023-11-04T01:40:09.734018+0000","last_became_active":"2023-11-04T01:40:05.579830+0000","last_became_peered":"2023-11-04T01:40:05.579830+0000","last_unstale":"2023-11-04T01:40:09.734018+0000","last_undegraded":"2023-11-04T01:40:09.734018+0000","last_fullsized":"2023-11-04T01:40:09.734018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:09:40.586446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.735529+0000","last_change":"2023-11-04T01:40:05.577828+0000","last_active":"2023-11-04T01:40:09.735529+0000","last_peered":"2023-11-04T01:40:09.735529+0000","last_clean":"2023-11-04T01:40:09.735529+0000","last_became_active":"2023-11-04T01:40:05.577524+0000","last_became_peered":"2023-11-04T01:40:05.577524+0000","last_unstale":"2023-11-04T01:40:09.735529+0000","last_undegraded":"2023-11-04T01:40:09.735529+0000","last_fullsized":"2023-11-04T01:40:09.735529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:17.862444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732444+0000","last_change":"2023-11-04T01:40:05.578036+0000","last_active":"2023-11-04T01:40:09.732444+0000","last_peered":"2023-11-04T01:40:09.732444+0000","last_clean":"2023-11-04T01:40:09.732444+0000","last_became_active":"2023-11-04T01:40:05.577711+0000","last_became_peered":"2023-11-04T01:40:05.577711+0000","last_unstale":"2023-11-04T01:40:09.732444+0000","last_undegraded":"2023-11-04T01:40:09.732444+0000","last_fullsized":"2023-11-04T01:40:09.732444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:43.060452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.727075+0000","last_change":"2023-11-04T01:40:05.576720+0000","last_active":"2023-11-04T01:40:09.727075+0000","last_peered":"2023-11-04T01:40:09.727075+0000","last_clean":"2023-11-04T01:40:09.727075+0000","last_became_active":"2023-11-04T01:40:05.576465+0000","last_became_peered":"2023-11-04T01:40:05.576465+0000","last_unstale":"2023-11-04T01:40:09.727075+0000","last_undegraded":"2023-11-04T01:40:09.727075+0000","last_fullsized":"2023-11-04T01:40:09.727075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:02.201965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731346+0000","last_change":"2023-11-04T01:40:05.561827+0000","last_active":"2023-11-04T01:40:09.731346+0000","last_peered":"2023-11-04T01:40:09.731346+0000","last_clean":"2023-11-04T01:40:09.731346+0000","last_became_active":"2023-11-04T01:40:05.560891+0000","last_became_peered":"2023-11-04T01:40:05.560891+0000","last_unstale":"2023-11-04T01:40:09.731346+0000","last_undegraded":"2023-11-04T01:40:09.731346+0000","last_fullsized":"2023-11-04T01:40:09.731346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:35:55.027288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729758+0000","last_change":"2023-11-04T01:40:05.577149+0000","last_active":"2023-11-04T01:40:09.729758+0000","last_peered":"2023-11-04T01:40:09.729758+0000","last_clean":"2023-11-04T01:40:09.729758+0000","last_became_active":"2023-11-04T01:40:05.576800+0000","last_became_peered":"2023-11-04T01:40:05.576800+0000","last_unstale":"2023-11-04T01:40:09.729758+0000","last_undegraded":"2023-11-04T01:40:09.729758+0000","last_fullsized":"2023-11-04T01:40:09.729758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:08:02.182321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.731574+0000","last_change":"2023-11-04T01:40:05.557217+0000","last_active":"2023-11-04T01:40:09.731574+0000","last_peered":"2023-11-04T01:40:09.731574+0000","last_clean":"2023-11-04T01:40:09.731574+0000","last_became_active":"2023-11-04T01:40:05.556849+0000","last_became_peered":"2023-11-04T01:40:05.556849+0000","last_unstale":"2023-11-04T01:40:09.731574+0000","last_undegraded":"2023-11-04T01:40:09.731574+0000","last_fullsized":"2023-11-04T01:40:09.731574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:09:53.332106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.729505+0000","last_change":"2023-11-04T01:40:05.579108+0000","last_active":"2023-11-04T01:40:09.729505+0000","last_peered":"2023-11-04T01:40:09.729505+0000","last_clean":"2023-11-04T01:40:09.729505+0000","last_became_active":"2023-11-04T01:40:05.578820+0000","last_became_peered":"2023-11-04T01:40:05.578820+0000","last_unstale":"2023-11-04T01:40:09.729505+0000","last_undegraded":"2023-11-04T01:40:09.729505+0000","last_fullsized":"2023-11-04T01:40:09.729505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:45:17.797764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.733836+0000","last_change":"2023-11-04T01:40:05.560589+0000","last_active":"2023-11-04T01:40:09.733836+0000","last_peered":"2023-11-04T01:40:09.733836+0000","last_clean":"2023-11-04T01:40:09.733836+0000","last_became_active":"2023-11-04T01:40:05.559671+0000","last_became_peered":"2023-11-04T01:40:05.559671+0000","last_unstale":"2023-11-04T01:40:09.733836+0000","last_undegraded":"2023-11-04T01:40:09.733836+0000","last_fullsized":"2023-11-04T01:40:09.733836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:14:25.328288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.734422+0000","last_change":"2023-11-04T01:40:05.564381+0000","last_active":"2023-11-04T01:40:09.734422+0000","last_peered":"2023-11-04T01:40:09.734422+0000","last_clean":"2023-11-04T01:40:09.734422+0000","last_became_active":"2023-11-04T01:40:05.564046+0000","last_became_peered":"2023-11-04T01:40:05.564046+0000","last_unstale":"2023-11-04T01:40:09.734422+0000","last_undegraded":"2023-11-04T01:40:09.734422+0000","last_fullsized":"2023-11-04T01:40:09.734422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:55:17.862444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-04T01:40:09.732359+0000","last_change":"2023-11-04T01:40:05.561850+0000","last_active":"2023-11-04T01:40:09.732359+0000","last_peered":"2023-11-04T01:40:09.732359+0000","last_clean":"2023-11-04T01:40:09.732359+0000","last_became_active":"2023-11-04T01:40:05.561463+0000","last_became_peered":"2023-11-04T01:40:05.561463+0000","last_unstale":"2023-11-04T01:40:09.732359+0000","last_undegraded":"2023-11-04T01:40:09.732359+0000","last_fullsized":"2023-11-04T01:40:09.732359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:40:04.683046+0000","last_clean_scrub_stamp":"2023-11-04T01:40:04.683046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:14:17.945716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]},{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":99918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":99792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":99952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":689779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:40:28.216 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-04T01:40:28.216 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-04T01:40:28.216 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-04T01:40:28.217 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-04T01:40:28.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.346+0000 7f32cc1c5640 1 Processor -- start 2023-11-04T01:40:28.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.346+0000 7f32cc1c5640 1 -- start start 2023-11-04T01:40:28.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.347+0000 7f32cc1c5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32c415ce60 0x7f32c406b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.347+0000 7f32cc1c5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f32c40cf160 0x7f32c40cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.347+0000 7f32cc1c5640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32c41615d0 con 0x7f32c406bd30 2023-11-04T01:40:28.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.347+0000 7f32cc1c5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32c40cbde0 con 0x7f32c40cf160 2023-11-04T01:40:28.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.347+0000 7f32cc1c5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c40cfb50 con 0x7f32c415ce60 2023-11-04T01:40:28.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.347+0000 7f32ca762640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f32c40cf160 0x7f32c40cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.347+0000 7f32ca762640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f32c40cf160 0x7f32c40cf610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53064/0 (socket says 172.21.15.77:53064) 2023-11-04T01:40:28.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.347+0000 7f32ca762640 1 -- 172.21.15.77:0/3234666063 learned_addr learned my addr 172.21.15.77:0/3234666063 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:28.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.347+0000 7f32c9f61640 1 --2- 172.21.15.77:0/3234666063 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32c415ce60 0x7f32c406b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.348+0000 7f32ca762640 1 -- 172.21.15.77:0/3234666063 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32c415ce60 msgr2=0x7f32c406b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:28.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.348+0000 7f32ca762640 1 --2- 172.21.15.77:0/3234666063 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32c415ce60 0x7f32c406b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.348+0000 7f32ca762640 1 -- 172.21.15.77:0/3234666063 >> v1:172.21.15.122:6789/0 conn(0x7f32c406bd30 legacy=0x7f32c4160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.348+0000 7f32ca762640 1 -- 172.21.15.77:0/3234666063 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c41618b0 con 0x7f32c40cf160 2023-11-04T01:40:28.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.348+0000 7f32c9f61640 1 --2- 172.21.15.77:0/3234666063 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32c415ce60 0x7f32c406b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:28.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.348+0000 7f32ca762640 1 --2- 172.21.15.77:0/3234666063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32c40cf160 0x7f32c40cf610 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f32bc009870 tx=0x7f32bc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d6a68a1344eac13 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:28.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.348+0000 7f32c8f5f640 1 -- 172.21.15.77:0/3234666063 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32bc030840 con 0x7f32c40cf160 2023-11-04T01:40:28.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.349+0000 7f32c8f5f640 1 -- 172.21.15.77:0/3234666063 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32bc0309a0 con 0x7f32c40cf160 2023-11-04T01:40:28.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.349+0000 7f32c8f5f640 1 -- 172.21.15.77:0/3234666063 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32bc030d30 con 0x7f32c40cf160 2023-11-04T01:40:28.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.349+0000 7f32cc1c5640 1 -- 172.21.15.77:0/3234666063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32c40cf160 msgr2=0x7f32c40cf610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.349+0000 7f32cc1c5640 1 --2- 172.21.15.77:0/3234666063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32c40cf160 0x7f32c40cf610 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f32bc009870 tx=0x7f32bc02b980 comp rx=0 tx=0).stop 2023-11-04T01:40:28.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.349+0000 7f32cc1c5640 1 -- 172.21.15.77:0/3234666063 shutdown_connections 2023-11-04T01:40:28.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.349+0000 7f32cc1c5640 1 --2- 172.21.15.77:0/3234666063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32c40cf160 0x7f32c40cf610 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.349+0000 7f32cc1c5640 1 --2- 172.21.15.77:0/3234666063 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32c415ce60 0x7f32c406b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.349+0000 7f32cc1c5640 1 -- 172.21.15.77:0/3234666063 >> 172.21.15.77:0/3234666063 conn(0x7f32c406ea90 msgr2=0x7f32c406ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:28.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.349+0000 7f32cc1c5640 1 -- 172.21.15.77:0/3234666063 shutdown_connections 2023-11-04T01:40:28.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.349+0000 7f32cc1c5640 1 -- 172.21.15.77:0/3234666063 wait complete. 2023-11-04T01:40:28.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.350+0000 7f32cc1c5640 1 Processor -- start 2023-11-04T01:40:28.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.350+0000 7f32cc1c5640 1 -- start start 2023-11-04T01:40:28.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.351+0000 7f32cc1c5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32c40cf160 0x7f32c415a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.351+0000 7f32cc1c5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32c415ce60 0x7f32c40c9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.351+0000 7f32cc1c5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32c40c65e0 0x7f32c40c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.351+0000 7f32cc1c5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c40c6fb0 con 0x7f32c40c65e0 2023-11-04T01:40:28.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.351+0000 7f32cc1c5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c415fd50 con 0x7f32c40cf160 2023-11-04T01:40:28.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.351+0000 7f32cc1c5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c415a660 con 0x7f32c415ce60 2023-11-04T01:40:28.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.351+0000 7f32ca762640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32c40c65e0 0x7f32c40c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.351+0000 7f32ca762640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32c40c65e0 0x7f32c40c6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53080/0 (socket says 172.21.15.77:53080) 2023-11-04T01:40:28.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.351+0000 7f32ca762640 1 -- 172.21.15.77:0/2023360976 learned_addr learned my addr 172.21.15.77:0/2023360976 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:28.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.351+0000 7f32c9f61640 1 --2- 172.21.15.77:0/2023360976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32c40cf160 0x7f32c415a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.351+0000 7f32c9760640 1 --2- 172.21.15.77:0/2023360976 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32c415ce60 0x7f32c40c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.351+0000 7f32ca762640 1 -- 172.21.15.77:0/2023360976 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32c415ce60 msgr2=0x7f32c40c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.351+0000 7f32ca762640 1 --2- 172.21.15.77:0/2023360976 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32c415ce60 0x7f32c40c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.351+0000 7f32ca762640 1 -- 172.21.15.77:0/2023360976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32c40cf160 msgr2=0x7f32c415a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.351+0000 7f32ca762640 1 --2- 172.21.15.77:0/2023360976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32c40cf160 0x7f32c415a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.351+0000 7f32ca762640 1 -- 172.21.15.77:0/2023360976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32bc0094d0 con 0x7f32c40c65e0 2023-11-04T01:40:28.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.352+0000 7f32ca762640 1 --2- 172.21.15.77:0/2023360976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32c40c65e0 0x7f32c40c6a70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f32bc02b9c0 tx=0x7f32bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:28.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.352+0000 7f32ba7fc640 1 -- 172.21.15.77:0/2023360976 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32bc039c90 con 0x7f32c40c65e0 2023-11-04T01:40:28.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.352+0000 7f32ba7fc640 1 -- 172.21.15.77:0/2023360976 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32bc039e10 con 0x7f32c40c65e0 2023-11-04T01:40:28.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.352+0000 7f32cc1c5640 1 -- 172.21.15.77:0/2023360976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c415f140 con 0x7f32c40c65e0 2023-11-04T01:40:28.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.352+0000 7f32ba7fc640 1 -- 172.21.15.77:0/2023360976 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32bc0446c0 con 0x7f32c40c65e0 2023-11-04T01:40:28.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.352+0000 7f32cc1c5640 1 -- 172.21.15.77:0/2023360976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c415f700 con 0x7f32c40c65e0 2023-11-04T01:40:28.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.353+0000 7f32cc1c5640 1 -- 172.21.15.77:0/2023360976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c415fe90 con 0x7f32c40c65e0 2023-11-04T01:40:28.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.353+0000 7f32ba7fc640 1 -- 172.21.15.77:0/2023360976 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f32bc04d3b0 con 0x7f32c40c65e0 2023-11-04T01:40:28.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.353+0000 7f32ba7fc640 1 --2- 172.21.15.77:0/2023360976 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f32a806aea0 0x7f32a806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.354+0000 7f32ba7fc640 1 -- 172.21.15.77:0/2023360976 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f32bc03e070 con 0x7f32c40c65e0 2023-11-04T01:40:28.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.354+0000 7f32c9f61640 1 --2- 172.21.15.77:0/2023360976 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f32a806aea0 0x7f32a806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.354+0000 7f32c9f61640 1 --2- 172.21.15.77:0/2023360976 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f32a806aea0 0x7f32a806d360 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f32c0009fd0 tx=0x7f32c00097f0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:28.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.358+0000 7f32ba7fc640 1 -- 172.21.15.77:0/2023360976 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f32c415fe90 con 0x7f32c40c65e0 2023-11-04T01:40:28.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.557+0000 7f32cc1c5640 1 -- 172.21.15.77:0/2023360976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f32c415fe90 con 0x7f32c40c65e0 2023-11-04T01:40:28.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.557+0000 7f32ba7fc640 1 -- 172.21.15.77:0/2023360976 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f32c415fe90 con 0x7f32c40c65e0 2023-11-04T01:40:28.560 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:28.560 INFO:teuthology.orchestra.run.smithi077.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-04T01:40:28.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.559+0000 7f32cc1c5640 1 -- 172.21.15.77:0/2023360976 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f32a806aea0 msgr2=0x7f32a806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.559+0000 7f32cc1c5640 1 --2- 172.21.15.77:0/2023360976 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f32a806aea0 0x7f32a806d360 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f32c0009fd0 tx=0x7f32c00097f0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.559+0000 7f32cc1c5640 1 -- 172.21.15.77:0/2023360976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32c40c65e0 msgr2=0x7f32c40c6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.559+0000 7f32cc1c5640 1 --2- 172.21.15.77:0/2023360976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32c40c65e0 0x7f32c40c6a70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f32bc02b9c0 tx=0x7f32bc004730 comp rx=0 tx=0).stop 2023-11-04T01:40:28.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.559+0000 7f32cc1c5640 1 -- 172.21.15.77:0/2023360976 shutdown_connections 2023-11-04T01:40:28.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.559+0000 7f32cc1c5640 1 --2- 172.21.15.77:0/2023360976 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f32a806aea0 0x7f32a806d360 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.559+0000 7f32cc1c5640 1 --2- 172.21.15.77:0/2023360976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32c40c65e0 0x7f32c40c6a70 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.559+0000 7f32cc1c5640 1 --2- 172.21.15.77:0/2023360976 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32c415ce60 0x7f32c40c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.559+0000 7f32cc1c5640 1 --2- 172.21.15.77:0/2023360976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32c40cf160 0x7f32c415a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.559+0000 7f32cc1c5640 1 -- 172.21.15.77:0/2023360976 >> 172.21.15.77:0/2023360976 conn(0x7f32c406ea90 msgr2=0x7f32c40ccab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:28.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.559+0000 7f32cc1c5640 1 -- 172.21.15.77:0/2023360976 shutdown_connections 2023-11-04T01:40:28.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.559+0000 7f32cc1c5640 1 -- 172.21.15.77:0/2023360976 wait complete. 2023-11-04T01:40:28.572 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-04T01:40:28.572 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:28.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.670+0000 7fba34e0e640 1 Processor -- start 2023-11-04T01:40:28.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.670+0000 7fba34e0e640 1 -- start start 2023-11-04T01:40:28.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.671+0000 7fba34e0e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fba300aec80 0x7fba300b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.671+0000 7fba34e0e640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fba300af060 0x7fba3006a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.671+0000 7fba34e0e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fba3006ef40 0x7fba300cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.671+0000 7fba34e0e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba30155a40 con 0x7fba3006ef40 2023-11-04T01:40:28.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.671+0000 7fba34e0e640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba300b1590 con 0x7fba300af060 2023-11-04T01:40:28.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.671+0000 7fba34e0e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba3006a660 con 0x7fba300aec80 2023-11-04T01:40:28.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.671+0000 7fba2ed9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fba3006ef40 0x7fba300cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.671+0000 7fba2ed9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fba3006ef40 0x7fba300cb7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53092/0 (socket says 172.21.15.77:53092) 2023-11-04T01:40:28.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.671+0000 7fba2ed9d640 1 -- 172.21.15.77:0/2346471795 learned_addr learned my addr 172.21.15.77:0/2346471795 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:28.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.672+0000 7fba2dd9b640 1 --2- 172.21.15.77:0/2346471795 >> v2:172.21.15.122:3300/0 conn(0x7fba300af060 0x7fba3006a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.672+0000 7fba2e59c640 1 --2- 172.21.15.77:0/2346471795 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fba300aec80 0x7fba300b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.672+0000 7fba2ed9d640 1 -- 172.21.15.77:0/2346471795 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fba300aec80 msgr2=0x7fba300b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:28.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.672+0000 7fba2ed9d640 1 --2- 172.21.15.77:0/2346471795 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fba300aec80 0x7fba300b1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.672+0000 7fba2ed9d640 1 -- 172.21.15.77:0/2346471795 >> v2:172.21.15.122:3300/0 conn(0x7fba300af060 msgr2=0x7fba3006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:28.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.672+0000 7fba2ed9d640 1 --2- 172.21.15.77:0/2346471795 >> v2:172.21.15.122:3300/0 conn(0x7fba300af060 0x7fba3006a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.672+0000 7fba2ed9d640 1 -- 172.21.15.77:0/2346471795 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba3006a8e0 con 0x7fba3006ef40 2023-11-04T01:40:28.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.672+0000 7fba2dd9b640 1 --2- 172.21.15.77:0/2346471795 >> v2:172.21.15.122:3300/0 conn(0x7fba300af060 0x7fba3006a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:28.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.672+0000 7fba2ed9d640 1 --2- 172.21.15.77:0/2346471795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba3006ef40 0x7fba300cb7a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fba300cf930 tx=0x7fba2802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5a2a7379c9873a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:28.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.673+0000 7fba2d59a640 1 -- 172.21.15.77:0/2346471795 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba28031870 con 0x7fba3006ef40 2023-11-04T01:40:28.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.673+0000 7fba2d59a640 1 -- 172.21.15.77:0/2346471795 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba280319d0 con 0x7fba3006ef40 2023-11-04T01:40:28.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.673+0000 7fba2d59a640 1 -- 172.21.15.77:0/2346471795 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba28031d60 con 0x7fba3006ef40 2023-11-04T01:40:28.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.673+0000 7fba34e0e640 1 -- 172.21.15.77:0/2346471795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba3006ef40 msgr2=0x7fba300cb7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.673+0000 7fba34e0e640 1 --2- 172.21.15.77:0/2346471795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba3006ef40 0x7fba300cb7a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fba300cf930 tx=0x7fba2802b910 comp rx=0 tx=0).stop 2023-11-04T01:40:28.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.673+0000 7fba34e0e640 1 -- 172.21.15.77:0/2346471795 shutdown_connections 2023-11-04T01:40:28.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.673+0000 7fba34e0e640 1 --2- 172.21.15.77:0/2346471795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba3006ef40 0x7fba300cb7a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.673+0000 7fba34e0e640 1 --2- 172.21.15.77:0/2346471795 >> v2:172.21.15.122:3300/0 conn(0x7fba300af060 0x7fba3006a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.673+0000 7fba34e0e640 1 --2- 172.21.15.77:0/2346471795 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fba300aec80 0x7fba300b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.673+0000 7fba34e0e640 1 -- 172.21.15.77:0/2346471795 >> 172.21.15.77:0/2346471795 conn(0x7fba30098d40 msgr2=0x7fba300cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:28.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.673+0000 7fba34e0e640 1 -- 172.21.15.77:0/2346471795 shutdown_connections 2023-11-04T01:40:28.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.673+0000 7fba34e0e640 1 -- 172.21.15.77:0/2346471795 wait complete. 2023-11-04T01:40:28.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.674+0000 7fba34e0e640 1 Processor -- start 2023-11-04T01:40:28.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.675+0000 7fba34e0e640 1 -- start start 2023-11-04T01:40:28.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.675+0000 7fba34e0e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba3006ef40 0x7fba300cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.675+0000 7fba34e0e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fba300aec80 0x7fba3015a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.675+0000 7fba34e0e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba300af060 0x7fba300c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.675+0000 7fba34e0e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba300b3e70 con 0x7fba300af060 2023-11-04T01:40:28.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.675+0000 7fba34e0e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba300cdb20 con 0x7fba3006ef40 2023-11-04T01:40:28.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.675+0000 7fba34e0e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba300cde00 con 0x7fba300aec80 2023-11-04T01:40:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.675+0000 7fba2ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba300af060 0x7fba300c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.675+0000 7fba2ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba300af060 0x7fba300c7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53098/0 (socket says 172.21.15.77:53098) 2023-11-04T01:40:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.675+0000 7fba2ed9d640 1 -- 172.21.15.77:0/3040229101 learned_addr learned my addr 172.21.15.77:0/3040229101 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.675+0000 7fba2dd9b640 1 --2- 172.21.15.77:0/3040229101 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fba300aec80 0x7fba3015a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.675+0000 7fba2e59c640 1 --2- 172.21.15.77:0/3040229101 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba3006ef40 0x7fba300cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.676+0000 7fba2ed9d640 1 -- 172.21.15.77:0/3040229101 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fba300aec80 msgr2=0x7fba3015a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.676+0000 7fba2ed9d640 1 --2- 172.21.15.77:0/3040229101 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fba300aec80 0x7fba3015a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.676+0000 7fba2ed9d640 1 -- 172.21.15.77:0/3040229101 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba3006ef40 msgr2=0x7fba300cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.676+0000 7fba2ed9d640 1 --2- 172.21.15.77:0/3040229101 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba3006ef40 0x7fba300cefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.676+0000 7fba2ed9d640 1 -- 172.21.15.77:0/3040229101 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba280094d0 con 0x7fba300af060 2023-11-04T01:40:28.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.676+0000 7fba2e59c640 1 --2- 172.21.15.77:0/3040229101 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba3006ef40 0x7fba300cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:28.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.676+0000 7fba2ed9d640 1 --2- 172.21.15.77:0/3040229101 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba300af060 0x7fba300c7b00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fba280090b0 tx=0x7fba280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:28.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.676+0000 7fba1effd640 1 -- 172.21.15.77:0/3040229101 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2803ac60 con 0x7fba300af060 2023-11-04T01:40:28.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.676+0000 7fba1effd640 1 -- 172.21.15.77:0/3040229101 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2803adc0 con 0x7fba300af060 2023-11-04T01:40:28.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.676+0000 7fba1effd640 1 -- 172.21.15.77:0/3040229101 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba28044630 con 0x7fba300af060 2023-11-04T01:40:28.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.676+0000 7fba34e0e640 1 -- 172.21.15.77:0/3040229101 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba300ce0e0 con 0x7fba300af060 2023-11-04T01:40:28.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.676+0000 7fba34e0e640 1 -- 172.21.15.77:0/3040229101 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba300cf500 con 0x7fba300af060 2023-11-04T01:40:28.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.677+0000 7fba34e0e640 1 -- 172.21.15.77:0/3040229101 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba300ce600 con 0x7fba300af060 2023-11-04T01:40:28.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.677+0000 7fba1effd640 1 -- 172.21.15.77:0/3040229101 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fba2804d450 con 0x7fba300af060 2023-11-04T01:40:28.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.678+0000 7fba1effd640 1 --2- 172.21.15.77:0/3040229101 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fba1006ae70 0x7fba1006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.678+0000 7fba1effd640 1 -- 172.21.15.77:0/3040229101 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fba2802d040 con 0x7fba300af060 2023-11-04T01:40:28.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.678+0000 7fba2e59c640 1 --2- 172.21.15.77:0/3040229101 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fba1006ae70 0x7fba1006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.678+0000 7fba2e59c640 1 --2- 172.21.15.77:0/3040229101 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fba1006ae70 0x7fba1006d330 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fba20009af0 tx=0x7fba200039f0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:28.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.682+0000 7fba1effd640 1 -- 172.21.15.77:0/3040229101 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fba300ce600 con 0x7fba300af060 2023-11-04T01:40:28.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.851+0000 7fba34e0e640 1 -- 172.21.15.77:0/3040229101 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba300ce600 con 0x7fba300af060 2023-11-04T01:40:28.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.852+0000 7fba1effd640 1 -- 172.21.15.77:0/3040229101 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18334 (secure 0 0 0) 0x7fba300ce600 con 0x7fba300af060 2023-11-04T01:40:28.854 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:28.855 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":24,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:40:10.153949+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:40:02.810971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:40:04.003979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:40:07.734355+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:28.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.854+0000 7fba34e0e640 1 -- 172.21.15.77:0/3040229101 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fba1006ae70 msgr2=0x7fba1006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.854+0000 7fba34e0e640 1 --2- 172.21.15.77:0/3040229101 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fba1006ae70 0x7fba1006d330 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fba20009af0 tx=0x7fba200039f0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.854+0000 7fba34e0e640 1 -- 172.21.15.77:0/3040229101 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba300af060 msgr2=0x7fba300c7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.854+0000 7fba34e0e640 1 --2- 172.21.15.77:0/3040229101 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba300af060 0x7fba300c7b00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fba280090b0 tx=0x7fba280046c0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.854+0000 7fba34e0e640 1 -- 172.21.15.77:0/3040229101 shutdown_connections 2023-11-04T01:40:28.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.854+0000 7fba34e0e640 1 --2- 172.21.15.77:0/3040229101 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fba1006ae70 0x7fba1006d330 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.854+0000 7fba34e0e640 1 --2- 172.21.15.77:0/3040229101 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba300af060 0x7fba300c7b00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.854+0000 7fba34e0e640 1 --2- 172.21.15.77:0/3040229101 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fba300aec80 0x7fba3015a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.854+0000 7fba34e0e640 1 --2- 172.21.15.77:0/3040229101 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba3006ef40 0x7fba300cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.854+0000 7fba34e0e640 1 -- 172.21.15.77:0/3040229101 >> 172.21.15.77:0/3040229101 conn(0x7fba30098d40 msgr2=0x7fba30152d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:28.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.854+0000 7fba34e0e640 1 -- 172.21.15.77:0/3040229101 shutdown_connections 2023-11-04T01:40:28.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.854+0000 7fba34e0e640 1 -- 172.21.15.77:0/3040229101 wait complete. 2023-11-04T01:40:28.867 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:40:02.810971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:40:04.003979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:40:07.734355+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:40:28.868 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:40:28.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.968+0000 7fe27d1d7640 1 Processor -- start 2023-11-04T01:40:28.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.968+0000 7fe27d1d7640 1 -- start start 2023-11-04T01:40:28.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.969+0000 7fe27d1d7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe278159c00 0x7fe2780cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.969+0000 7fe27d1d7640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe2780ae1d0 0x7fe2780c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.969+0000 7fe27d1d7640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe27815aff0 con 0x7fe2780c48e0 2023-11-04T01:40:28.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.969+0000 7fe27d1d7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2780c52d0 con 0x7fe278159c00 2023-11-04T01:40:28.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.969+0000 7fe27d1d7640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe27815a3e0 con 0x7fe2780ae1d0 2023-11-04T01:40:28.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.969+0000 7fe276d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe278159c00 0x7fe2780cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.969+0000 7fe276d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe278159c00 0x7fe2780cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53106/0 (socket says 172.21.15.77:53106) 2023-11-04T01:40:28.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.969+0000 7fe276d9d640 1 -- 172.21.15.77:0/1848605113 learned_addr learned my addr 172.21.15.77:0/1848605113 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:28.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.969+0000 7fe27759e640 1 --2- 172.21.15.77:0/1848605113 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe2780ae1d0 0x7fe2780c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.969+0000 7fe276d9d640 1 -- 172.21.15.77:0/1848605113 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe2780ae1d0 msgr2=0x7fe2780c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:28.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.969+0000 7fe276d9d640 1 --2- 172.21.15.77:0/1848605113 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe2780ae1d0 0x7fe2780c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.969+0000 7fe276d9d640 1 -- 172.21.15.77:0/1848605113 >> v1:172.21.15.122:6789/0 conn(0x7fe2780c48e0 legacy=0x7fe2780adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:28.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.969+0000 7fe276d9d640 1 -- 172.21.15.77:0/1848605113 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe27815a6c0 con 0x7fe278159c00 2023-11-04T01:40:28.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.970+0000 7fe276d9d640 1 --2- 172.21.15.77:0/1848605113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe278159c00 0x7fe2780cc890 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe268009e50 tx=0x7fe26802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd5e4607fb2ca31 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:28.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.970+0000 7fe275d9b640 1 -- 172.21.15.77:0/1848605113 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26802c9e0 con 0x7fe278159c00 2023-11-04T01:40:28.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.970+0000 7fe275d9b640 1 -- 172.21.15.77:0/1848605113 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26802cb40 con 0x7fe278159c00 2023-11-04T01:40:28.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.970+0000 7fe275d9b640 1 -- 172.21.15.77:0/1848605113 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2680343f0 con 0x7fe278159c00 2023-11-04T01:40:28.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.971+0000 7fe27d1d7640 1 -- 172.21.15.77:0/1848605113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe278159c00 msgr2=0x7fe2780cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.971+0000 7fe27d1d7640 1 --2- 172.21.15.77:0/1848605113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe278159c00 0x7fe2780cc890 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe268009e50 tx=0x7fe26802be40 comp rx=0 tx=0).stop 2023-11-04T01:40:28.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.971+0000 7fe27d1d7640 1 -- 172.21.15.77:0/1848605113 shutdown_connections 2023-11-04T01:40:28.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.971+0000 7fe27d1d7640 1 --2- 172.21.15.77:0/1848605113 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe2780ae1d0 0x7fe2780c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.971+0000 7fe27d1d7640 1 --2- 172.21.15.77:0/1848605113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe278159c00 0x7fe2780cc890 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.971+0000 7fe27d1d7640 1 -- 172.21.15.77:0/1848605113 >> 172.21.15.77:0/1848605113 conn(0x7fe2780ce950 msgr2=0x7fe2780ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:28.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.971+0000 7fe27d1d7640 1 -- 172.21.15.77:0/1848605113 shutdown_connections 2023-11-04T01:40:28.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.971+0000 7fe27d1d7640 1 -- 172.21.15.77:0/1848605113 wait complete. 2023-11-04T01:40:28.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.972+0000 7fe27d1d7640 1 Processor -- start 2023-11-04T01:40:28.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.972+0000 7fe27d1d7640 1 -- start start 2023-11-04T01:40:28.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.973+0000 7fe27d1d7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2780ae1d0 0x7fe27814c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.973+0000 7fe27d1d7640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe2780c48e0 0x7fe27814e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.973+0000 7fe27d1d7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe278159c00 0x7fe2781f3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.973+0000 7fe27d1d7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27814eea0 con 0x7fe2780ae1d0 2023-11-04T01:40:28.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.973+0000 7fe27d1d7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27814f180 con 0x7fe278159c00 2023-11-04T01:40:28.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.973+0000 7fe27d1d7640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe27814f460 con 0x7fe2780c48e0 2023-11-04T01:40:28.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.973+0000 7fe276d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2780ae1d0 0x7fe27814c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.973+0000 7fe276d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2780ae1d0 0x7fe27814c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53110/0 (socket says 172.21.15.77:53110) 2023-11-04T01:40:28.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.973+0000 7fe276d9d640 1 -- 172.21.15.77:0/3565423271 learned_addr learned my addr 172.21.15.77:0/3565423271 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:28.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.973+0000 7fe27759e640 1 --2- 172.21.15.77:0/3565423271 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe278159c00 0x7fe2781f3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.973+0000 7fe27659c640 1 --2- 172.21.15.77:0/3565423271 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe2780c48e0 0x7fe27814e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.973+0000 7fe276d9d640 1 -- 172.21.15.77:0/3565423271 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe2780c48e0 msgr2=0x7fe27814e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.973+0000 7fe276d9d640 1 --2- 172.21.15.77:0/3565423271 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe2780c48e0 0x7fe27814e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.973+0000 7fe276d9d640 1 -- 172.21.15.77:0/3565423271 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe278159c00 msgr2=0x7fe2781f3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:28.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.973+0000 7fe276d9d640 1 --2- 172.21.15.77:0/3565423271 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe278159c00 0x7fe2781f3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:28.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.973+0000 7fe276d9d640 1 -- 172.21.15.77:0/3565423271 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe268009b30 con 0x7fe2780ae1d0 2023-11-04T01:40:28.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.974+0000 7fe276d9d640 1 --2- 172.21.15.77:0/3565423271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2780ae1d0 0x7fe27814c6e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe268009e50 tx=0x7fe268004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:28.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.974+0000 7fe25f7fe640 1 -- 172.21.15.77:0/3565423271 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe268009510 con 0x7fe2780ae1d0 2023-11-04T01:40:28.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.974+0000 7fe25f7fe640 1 -- 172.21.15.77:0/3565423271 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26803e450 con 0x7fe2780ae1d0 2023-11-04T01:40:28.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.974+0000 7fe27d1d7640 1 -- 172.21.15.77:0/3565423271 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe278157720 con 0x7fe2780ae1d0 2023-11-04T01:40:28.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.974+0000 7fe25f7fe640 1 -- 172.21.15.77:0/3565423271 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26803e800 con 0x7fe2780ae1d0 2023-11-04T01:40:28.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.974+0000 7fe27d1d7640 1 -- 172.21.15.77:0/3565423271 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe278157340 con 0x7fe2780ae1d0 2023-11-04T01:40:28.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.975+0000 7fe27d1d7640 1 -- 172.21.15.77:0/3565423271 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe278157530 con 0x7fe2780ae1d0 2023-11-04T01:40:28.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.975+0000 7fe25f7fe640 1 -- 172.21.15.77:0/3565423271 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe26803e960 con 0x7fe2780ae1d0 2023-11-04T01:40:28.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.976+0000 7fe25f7fe640 1 --2- 172.21.15.77:0/3565423271 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe26406aea0 0x7fe26406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:28.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.976+0000 7fe25f7fe640 1 -- 172.21.15.77:0/3565423271 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe2680ac300 con 0x7fe2780ae1d0 2023-11-04T01:40:28.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.976+0000 7fe27659c640 1 --2- 172.21.15.77:0/3565423271 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe26406aea0 0x7fe26406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:28.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.976+0000 7fe27659c640 1 --2- 172.21.15.77:0/3565423271 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe26406aea0 0x7fe26406d360 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe2781500e0 tx=0x7fe26c007e30 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:28.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:28.980+0000 7fe25f7fe640 1 -- 172.21.15.77:0/3565423271 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe268077180 con 0x7fe2780ae1d0 2023-11-04T01:40:29.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.146+0000 7fe27d1d7640 1 -- 172.21.15.77:0/3565423271 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe27814efe0 con 0x7fe2780ae1d0 2023-11-04T01:40:29.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.147+0000 7fe25f7fe640 1 -- 172.21.15.77:0/3565423271 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe27814efe0 con 0x7fe2780ae1d0 2023-11-04T01:40:29.149 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:40:29.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.148+0000 7fe27d1d7640 1 -- 172.21.15.77:0/3565423271 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe26406aea0 msgr2=0x7fe26406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.148+0000 7fe27d1d7640 1 --2- 172.21.15.77:0/3565423271 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe26406aea0 0x7fe26406d360 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe2781500e0 tx=0x7fe26c007e30 comp rx=0 tx=0).stop 2023-11-04T01:40:29.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.148+0000 7fe27d1d7640 1 -- 172.21.15.77:0/3565423271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2780ae1d0 msgr2=0x7fe27814c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.148+0000 7fe27d1d7640 1 --2- 172.21.15.77:0/3565423271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2780ae1d0 0x7fe27814c6e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe268009e50 tx=0x7fe268004a40 comp rx=0 tx=0).stop 2023-11-04T01:40:29.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.148+0000 7fe27d1d7640 1 -- 172.21.15.77:0/3565423271 shutdown_connections 2023-11-04T01:40:29.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.148+0000 7fe27d1d7640 1 --2- 172.21.15.77:0/3565423271 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe26406aea0 0x7fe26406d360 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.148+0000 7fe27d1d7640 1 --2- 172.21.15.77:0/3565423271 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe278159c00 0x7fe2781f3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.148+0000 7fe27d1d7640 1 --2- 172.21.15.77:0/3565423271 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe2780c48e0 0x7fe27814e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.148+0000 7fe27d1d7640 1 --2- 172.21.15.77:0/3565423271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2780ae1d0 0x7fe27814c6e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.148+0000 7fe27d1d7640 1 -- 172.21.15.77:0/3565423271 >> 172.21.15.77:0/3565423271 conn(0x7fe2780ce950 msgr2=0x7fe27806cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:29.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.148+0000 7fe27d1d7640 1 -- 172.21.15.77:0/3565423271 shutdown_connections 2023-11-04T01:40:29.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.149+0000 7fe27d1d7640 1 -- 172.21.15.77:0/3565423271 wait complete. 2023-11-04T01:40:29.161 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:40:29.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.261+0000 7facef656640 1 Processor -- start 2023-11-04T01:40:29.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.261+0000 7facef656640 1 -- start start 2023-11-04T01:40:29.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.262+0000 7facef656640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7face8159c00 0x7face80cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.262+0000 7facef656640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7face80ae1d0 0x7face80c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.262+0000 7facef656640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face815aff0 con 0x7face80c48e0 2023-11-04T01:40:29.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.262+0000 7facef656640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7face80c52a0 con 0x7face80ae1d0 2023-11-04T01:40:29.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.262+0000 7facef656640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face815a3e0 con 0x7face8159c00 2023-11-04T01:40:29.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.262+0000 7facedbf3640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7face80ae1d0 0x7face80c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:29.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.262+0000 7faced3f2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7face8159c00 0x7face80cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:29.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.262+0000 7facecbf1640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7face80c48e0 0x7face80adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:46760/0 (socket says 172.21.15.77:46760) 2023-11-04T01:40:29.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.262+0000 7facecbf1640 1 -- 172.21.15.77:0/3269698643 learned_addr learned my addr 172.21.15.77:0/3269698643 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:29.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.263+0000 7facdffff640 1 -- 172.21.15.77:0/3269698643 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 699991483 0 0) 0x7face815aff0 con 0x7face80c48e0 2023-11-04T01:40:29.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.263+0000 7facdffff640 1 -- 172.21.15.77:0/3269698643 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facd4003520 con 0x7face80c48e0 2023-11-04T01:40:29.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.263+0000 7faced3f2640 1 -- 172.21.15.77:0/3269698643 >> v2:172.21.15.122:3300/0 conn(0x7face80ae1d0 msgr2=0x7face80c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:29.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.263+0000 7faced3f2640 1 --2- 172.21.15.77:0/3269698643 >> v2:172.21.15.122:3300/0 conn(0x7face80ae1d0 0x7face80c4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.263+0000 7faced3f2640 1 -- 172.21.15.77:0/3269698643 >> v1:172.21.15.122:6789/0 conn(0x7face80c48e0 legacy=0x7face80adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.263+0000 7faced3f2640 1 -- 172.21.15.77:0/3269698643 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face815a6c0 con 0x7face8159c00 2023-11-04T01:40:29.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.263+0000 7facedbf3640 1 --2- 172.21.15.77:0/3269698643 >> v2:172.21.15.122:3300/0 conn(0x7face80ae1d0 0x7face80c4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:29.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.264+0000 7faced3f2640 1 --2- 172.21.15.77:0/3269698643 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7face8159c00 0x7face80cc890 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7face40097a0 tx=0x7face402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=547fea3961d67e65 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:29.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.264+0000 7facdffff640 1 -- 172.21.15.77:0/3269698643 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face4031830 con 0x7face8159c00 2023-11-04T01:40:29.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.264+0000 7facdffff640 1 -- 172.21.15.77:0/3269698643 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face4031990 con 0x7face8159c00 2023-11-04T01:40:29.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.264+0000 7facdffff640 1 -- 172.21.15.77:0/3269698643 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face4031d00 con 0x7face8159c00 2023-11-04T01:40:29.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.264+0000 7facef656640 1 -- 172.21.15.77:0/3269698643 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7face8159c00 msgr2=0x7face80cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.264+0000 7facef656640 1 --2- 172.21.15.77:0/3269698643 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7face8159c00 0x7face80cc890 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7face40097a0 tx=0x7face402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.264+0000 7facef656640 1 -- 172.21.15.77:0/3269698643 shutdown_connections 2023-11-04T01:40:29.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.264+0000 7facef656640 1 --2- 172.21.15.77:0/3269698643 >> v2:172.21.15.122:3300/0 conn(0x7face80ae1d0 0x7face80c4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.264+0000 7facef656640 1 --2- 172.21.15.77:0/3269698643 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7face8159c00 0x7face80cc890 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.264+0000 7facef656640 1 -- 172.21.15.77:0/3269698643 >> 172.21.15.77:0/3269698643 conn(0x7face80ce950 msgr2=0x7face80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:29.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.264+0000 7facef656640 1 -- 172.21.15.77:0/3269698643 shutdown_connections 2023-11-04T01:40:29.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.264+0000 7facef656640 1 -- 172.21.15.77:0/3269698643 wait complete. 2023-11-04T01:40:29.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.266+0000 7facef656640 1 Processor -- start 2023-11-04T01:40:29.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.266+0000 7facef656640 1 -- start start 2023-11-04T01:40:29.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.266+0000 7facef656640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7face80ae1d0 0x7face813b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.266+0000 7facef656640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7face80c48e0 0x7face80ac1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.266+0000 7facef656640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7face8159c00 0x7face815be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.266+0000 7facef656640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face814e430 con 0x7face8159c00 2023-11-04T01:40:29.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.266+0000 7facef656640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face813b6b0 con 0x7face80c48e0 2023-11-04T01:40:29.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.266+0000 7facef656640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face80ac720 con 0x7face80ae1d0 2023-11-04T01:40:29.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.266+0000 7facedbf3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7face8159c00 0x7face815be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:29.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.266+0000 7facedbf3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7face8159c00 0x7face815be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53126/0 (socket says 172.21.15.77:53126) 2023-11-04T01:40:29.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.266+0000 7facedbf3640 1 -- 172.21.15.77:0/2879751782 learned_addr learned my addr 172.21.15.77:0/2879751782 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:29.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.267+0000 7facecbf1640 1 --2- 172.21.15.77:0/2879751782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7face80c48e0 0x7face80ac1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:29.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.267+0000 7faced3f2640 1 --2- 172.21.15.77:0/2879751782 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7face80ae1d0 0x7face813b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:29.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.267+0000 7facedbf3640 1 -- 172.21.15.77:0/2879751782 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7face80ae1d0 msgr2=0x7face813b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.267+0000 7facedbf3640 1 --2- 172.21.15.77:0/2879751782 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7face80ae1d0 0x7face813b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.267+0000 7facedbf3640 1 -- 172.21.15.77:0/2879751782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7face80c48e0 msgr2=0x7face80ac1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.267+0000 7facedbf3640 1 --2- 172.21.15.77:0/2879751782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7face80c48e0 0x7face80ac1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.267+0000 7facedbf3640 1 -- 172.21.15.77:0/2879751782 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face0009a70 con 0x7face8159c00 2023-11-04T01:40:29.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.267+0000 7facedbf3640 1 --2- 172.21.15.77:0/2879751782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7face8159c00 0x7face815be20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7face000efc0 tx=0x7face0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:29.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.267+0000 7facddffb640 1 -- 172.21.15.77:0/2879751782 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face0009d70 con 0x7face8159c00 2023-11-04T01:40:29.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.267+0000 7facddffb640 1 -- 172.21.15.77:0/2879751782 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face000f040 con 0x7face8159c00 2023-11-04T01:40:29.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.267+0000 7facddffb640 1 -- 172.21.15.77:0/2879751782 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face0003990 con 0x7face8159c00 2023-11-04T01:40:29.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.267+0000 7facef656640 1 -- 172.21.15.77:0/2879751782 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face4009400 con 0x7face8159c00 2023-11-04T01:40:29.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.267+0000 7facef656640 1 -- 172.21.15.77:0/2879751782 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face80accc0 con 0x7face8159c00 2023-11-04T01:40:29.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.268+0000 7facef656640 1 -- 172.21.15.77:0/2879751782 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7face814e5a0 con 0x7face8159c00 2023-11-04T01:40:29.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.269+0000 7facddffb640 1 -- 172.21.15.77:0/2879751782 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7face00144a0 con 0x7face8159c00 2023-11-04T01:40:29.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.269+0000 7facddffb640 1 --2- 172.21.15.77:0/2879751782 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7faccc06ae70 0x7faccc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.269+0000 7facddffb640 1 -- 172.21.15.77:0/2879751782 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7face008a670 con 0x7face8159c00 2023-11-04T01:40:29.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.269+0000 7faced3f2640 1 --2- 172.21.15.77:0/2879751782 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7faccc06ae70 0x7faccc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:29.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.270+0000 7faced3f2640 1 --2- 172.21.15.77:0/2879751782 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7faccc06ae70 0x7faccc06d330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7face4036000 tx=0x7face403c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:29.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.273+0000 7facddffb640 1 -- 172.21.15.77:0/2879751782 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7face00553b0 con 0x7face8159c00 2023-11-04T01:40:29.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.439+0000 7facef656640 1 -- 172.21.15.77:0/2879751782 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7face8074290 con 0x7face8159c00 2023-11-04T01:40:29.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.439+0000 7facddffb640 1 -- 172.21.15.77:0/2879751782 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7face00589d0 con 0x7face8159c00 2023-11-04T01:40:29.442 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:40:29.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.441+0000 7facef656640 1 -- 172.21.15.77:0/2879751782 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7faccc06ae70 msgr2=0x7faccc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.441+0000 7facef656640 1 --2- 172.21.15.77:0/2879751782 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7faccc06ae70 0x7faccc06d330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7face4036000 tx=0x7face403c040 comp rx=0 tx=0).stop 2023-11-04T01:40:29.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.441+0000 7facef656640 1 -- 172.21.15.77:0/2879751782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7face8159c00 msgr2=0x7face815be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.441+0000 7facef656640 1 --2- 172.21.15.77:0/2879751782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7face8159c00 0x7face815be20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7face000efc0 tx=0x7face0009f90 comp rx=0 tx=0).stop 2023-11-04T01:40:29.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.441+0000 7facef656640 1 -- 172.21.15.77:0/2879751782 shutdown_connections 2023-11-04T01:40:29.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.441+0000 7facef656640 1 --2- 172.21.15.77:0/2879751782 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7faccc06ae70 0x7faccc06d330 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.441+0000 7facef656640 1 --2- 172.21.15.77:0/2879751782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7face8159c00 0x7face815be20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.441+0000 7facef656640 1 --2- 172.21.15.77:0/2879751782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7face80c48e0 0x7face80ac1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.441+0000 7facef656640 1 --2- 172.21.15.77:0/2879751782 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7face80ae1d0 0x7face813b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.441+0000 7facef656640 1 -- 172.21.15.77:0/2879751782 >> 172.21.15.77:0/2879751782 conn(0x7face80ce950 msgr2=0x7face814cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:29.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.441+0000 7facef656640 1 -- 172.21.15.77:0/2879751782 shutdown_connections 2023-11-04T01:40:29.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.441+0000 7facef656640 1 -- 172.21.15.77:0/2879751782 wait complete. 2023-11-04T01:40:29.454 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:40:29.554 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:40:29.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.554+0000 7f2e95856640 1 Processor -- start 2023-11-04T01:40:29.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.554+0000 7f2e95856640 1 -- start start 2023-11-04T01:40:29.557 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:40:29.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.555+0000 7f2e95856640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2e9015ccc0 0x7f2e900b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.555+0000 7f2e95856640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2e9015d0a0 0x7f2e900b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.555+0000 7f2e95856640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e90160df0 con 0x7f2e900cd680 2023-11-04T01:40:29.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.555+0000 7f2e95856640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e900ce260 con 0x7f2e9015ccc0 2023-11-04T01:40:29.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.555+0000 7f2e95856640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e900ce540 con 0x7f2e9015d0a0 2023-11-04T01:40:29.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.556+0000 7f2e8effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2e9015ccc0 0x7f2e900b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:29.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.556+0000 7f2e8effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2e9015ccc0 0x7f2e900b48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53134/0 (socket says 172.21.15.77:53134) 2023-11-04T01:40:29.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.556+0000 7f2e8effd640 1 -- 172.21.15.77:0/878840501 learned_addr learned my addr 172.21.15.77:0/878840501 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:29.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.556+0000 7f2e8e7fc640 1 --2- 172.21.15.77:0/878840501 >> v2:172.21.15.122:3300/0 conn(0x7f2e9015d0a0 0x7f2e900b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:29.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.556+0000 7f2e8effd640 1 -- 172.21.15.77:0/878840501 >> v2:172.21.15.122:3300/0 conn(0x7f2e9015d0a0 msgr2=0x7f2e900b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:29.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.556+0000 7f2e8effd640 1 --2- 172.21.15.77:0/878840501 >> v2:172.21.15.122:3300/0 conn(0x7f2e9015d0a0 0x7f2e900b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.556+0000 7f2e8effd640 1 -- 172.21.15.77:0/878840501 >> v1:172.21.15.122:6789/0 conn(0x7f2e900cd680 legacy=0x7f2e900cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.556+0000 7f2e8effd640 1 -- 172.21.15.77:0/878840501 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e900d1050 con 0x7f2e9015ccc0 2023-11-04T01:40:29.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.556+0000 7f2e8e7fc640 1 --2- 172.21.15.77:0/878840501 >> v2:172.21.15.122:3300/0 conn(0x7f2e9015d0a0 0x7f2e900b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:29.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.557+0000 7f2e8effd640 1 --2- 172.21.15.77:0/878840501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e9015ccc0 0x7f2e900b48a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2e9015d510 tx=0x7f2e8802bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef6d899c4318a478 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:29.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.557+0000 7f2e8dffb640 1 -- 172.21.15.77:0/878840501 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8802cb10 con 0x7f2e9015ccc0 2023-11-04T01:40:29.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.557+0000 7f2e8dffb640 1 -- 172.21.15.77:0/878840501 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8802cc70 con 0x7f2e9015ccc0 2023-11-04T01:40:29.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.557+0000 7f2e8dffb640 1 -- 172.21.15.77:0/878840501 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e880343f0 con 0x7f2e9015ccc0 2023-11-04T01:40:29.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.558+0000 7f2e95856640 1 -- 172.21.15.77:0/878840501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e9015ccc0 msgr2=0x7f2e900b48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.558+0000 7f2e95856640 1 --2- 172.21.15.77:0/878840501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e9015ccc0 0x7f2e900b48a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2e9015d510 tx=0x7f2e8802bf70 comp rx=0 tx=0).stop 2023-11-04T01:40:29.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.558+0000 7f2e95856640 1 -- 172.21.15.77:0/878840501 shutdown_connections 2023-11-04T01:40:29.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.558+0000 7f2e95856640 1 --2- 172.21.15.77:0/878840501 >> v2:172.21.15.122:3300/0 conn(0x7f2e9015d0a0 0x7f2e900b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.558+0000 7f2e95856640 1 --2- 172.21.15.77:0/878840501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e9015ccc0 0x7f2e900b48a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.558+0000 7f2e95856640 1 -- 172.21.15.77:0/878840501 >> 172.21.15.77:0/878840501 conn(0x7f2e900cf8a0 msgr2=0x7f2e900cfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:29.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.558+0000 7f2e95856640 1 -- 172.21.15.77:0/878840501 shutdown_connections 2023-11-04T01:40:29.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.558+0000 7f2e95856640 1 -- 172.21.15.77:0/878840501 wait complete. 2023-11-04T01:40:29.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.559+0000 7f2e95856640 1 Processor -- start 2023-11-04T01:40:29.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.559+0000 7f2e95856640 1 -- start start 2023-11-04T01:40:29.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.560+0000 7f2e95856640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e900cd680 0x7f2e90148210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.560+0000 7f2e95856640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e9015ccc0 0x7f2e900c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.560+0000 7f2e95856640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e9015d0a0 0x7f2e900cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.560+0000 7f2e95856640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e900cafc0 con 0x7f2e9015d0a0 2023-11-04T01:40:29.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.560+0000 7f2e95856640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e90148750 con 0x7f2e9015ccc0 2023-11-04T01:40:29.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.560+0000 7f2e95856640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e900ca3b0 con 0x7f2e900cd680 2023-11-04T01:40:29.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.560+0000 7f2e8f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e9015d0a0 0x7f2e900cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:29.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.560+0000 7f2e8effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e900cd680 0x7f2e90148210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:29.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.560+0000 7f2e8e7fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e9015ccc0 0x7f2e900c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:29.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.560+0000 7f2e8f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e9015d0a0 0x7f2e900cb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53148/0 (socket says 172.21.15.77:53148) 2023-11-04T01:40:29.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.560+0000 7f2e8f7fe640 1 -- 172.21.15.77:0/3017083059 learned_addr learned my addr 172.21.15.77:0/3017083059 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:29.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.561+0000 7f2e8f7fe640 1 -- 172.21.15.77:0/3017083059 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e900cd680 msgr2=0x7f2e90148210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.561+0000 7f2e8f7fe640 1 --2- 172.21.15.77:0/3017083059 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e900cd680 0x7f2e90148210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.561+0000 7f2e8f7fe640 1 -- 172.21.15.77:0/3017083059 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e9015ccc0 msgr2=0x7f2e900c90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.561+0000 7f2e8f7fe640 1 --2- 172.21.15.77:0/3017083059 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e9015ccc0 0x7f2e900c90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.561+0000 7f2e8f7fe640 1 -- 172.21.15.77:0/3017083059 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e88009b30 con 0x7f2e9015d0a0 2023-11-04T01:40:29.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.561+0000 7f2e8f7fe640 1 --2- 172.21.15.77:0/3017083059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e9015d0a0 0x7f2e900cb8a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2e80001eb0 tx=0x7f2e8000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:29.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.561+0000 7f2e87fff640 1 -- 172.21.15.77:0/3017083059 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e800052d0 con 0x7f2e9015d0a0 2023-11-04T01:40:29.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.561+0000 7f2e87fff640 1 -- 172.21.15.77:0/3017083059 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e80005430 con 0x7f2e9015d0a0 2023-11-04T01:40:29.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.561+0000 7f2e87fff640 1 -- 172.21.15.77:0/3017083059 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e80003810 con 0x7f2e9015d0a0 2023-11-04T01:40:29.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.561+0000 7f2e95856640 1 -- 172.21.15.77:0/3017083059 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e900ca690 con 0x7f2e9015d0a0 2023-11-04T01:40:29.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.561+0000 7f2e95856640 1 -- 172.21.15.77:0/3017083059 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e900cac50 con 0x7f2e9015d0a0 2023-11-04T01:40:29.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.562+0000 7f2e95856640 1 -- 172.21.15.77:0/3017083059 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e900c6580 con 0x7f2e9015d0a0 2023-11-04T01:40:29.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.563+0000 7f2e87fff640 1 -- 172.21.15.77:0/3017083059 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2e80003970 con 0x7f2e9015d0a0 2023-11-04T01:40:29.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.563+0000 7f2e87fff640 1 --2- 172.21.15.77:0/3017083059 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2e7006ae70 0x7f2e7006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.563+0000 7f2e87fff640 1 -- 172.21.15.77:0/3017083059 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2e80088bd0 con 0x7f2e9015d0a0 2023-11-04T01:40:29.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.563+0000 7f2e8effd640 1 --2- 172.21.15.77:0/3017083059 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2e7006ae70 0x7f2e7006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:29.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.564+0000 7f2e8effd640 1 --2- 172.21.15.77:0/3017083059 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2e7006ae70 0x7f2e7006d330 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2e88035000 tx=0x7f2e88030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:29.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.568+0000 7f2e87fff640 1 -- 172.21.15.77:0/3017083059 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2e80053ad0 con 0x7f2e9015d0a0 2023-11-04T01:40:29.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.742+0000 7f2e95856640 1 -- 172.21.15.77:0/3017083059 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2e90160df0 con 0x7f2e9015d0a0 2023-11-04T01:40:29.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.742+0000 7f2e87fff640 1 -- 172.21.15.77:0/3017083059 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2e90160df0 con 0x7f2e9015d0a0 2023-11-04T01:40:29.744 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-04T01:40:29.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.744+0000 7f2e95856640 1 -- 172.21.15.77:0/3017083059 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2e7006ae70 msgr2=0x7f2e7006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.744+0000 7f2e95856640 1 --2- 172.21.15.77:0/3017083059 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2e7006ae70 0x7f2e7006d330 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2e88035000 tx=0x7f2e88030000 comp rx=0 tx=0).stop 2023-11-04T01:40:29.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.744+0000 7f2e95856640 1 -- 172.21.15.77:0/3017083059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e9015d0a0 msgr2=0x7f2e900cb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.744+0000 7f2e95856640 1 --2- 172.21.15.77:0/3017083059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e9015d0a0 0x7f2e900cb8a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2e80001eb0 tx=0x7f2e8000c890 comp rx=0 tx=0).stop 2023-11-04T01:40:29.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.744+0000 7f2e95856640 1 -- 172.21.15.77:0/3017083059 shutdown_connections 2023-11-04T01:40:29.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.744+0000 7f2e95856640 1 --2- 172.21.15.77:0/3017083059 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2e7006ae70 0x7f2e7006d330 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.744+0000 7f2e95856640 1 --2- 172.21.15.77:0/3017083059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e9015d0a0 0x7f2e900cb8a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.744+0000 7f2e95856640 1 --2- 172.21.15.77:0/3017083059 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e9015ccc0 0x7f2e900c90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.744+0000 7f2e95856640 1 --2- 172.21.15.77:0/3017083059 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e900cd680 0x7f2e90148210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.744+0000 7f2e95856640 1 -- 172.21.15.77:0/3017083059 >> 172.21.15.77:0/3017083059 conn(0x7f2e900cf8a0 msgr2=0x7f2e900d2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:29.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.744+0000 7f2e95856640 1 -- 172.21.15.77:0/3017083059 shutdown_connections 2023-11-04T01:40:29.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.744+0000 7f2e95856640 1 -- 172.21.15.77:0/3017083059 wait complete. 2023-11-04T01:40:29.757 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:40:29.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.858+0000 7f4684c6f640 1 Processor -- start 2023-11-04T01:40:29.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.858+0000 7f4684c6f640 1 -- start start 2023-11-04T01:40:29.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.859+0000 7f4684c6f640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f46800b2d30 0x7f468006bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.859+0000 7f4684c6f640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f468006c1d0 0x7f46800cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.859+0000 7f4684c6f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f468006ca40 con 0x7f4680160430 2023-11-04T01:40:29.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.859+0000 7f4684c6f640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46800cb580 con 0x7f46800b2d30 2023-11-04T01:40:29.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.859+0000 7f4684c6f640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f468006cd20 con 0x7f468006c1d0 2023-11-04T01:40:29.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.859+0000 7f467e59c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f4680160430 0x7f46800b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:60938/0 (socket says 172.21.15.77:60938) 2023-11-04T01:40:29.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.859+0000 7f467e59c640 1 -- 172.21.15.77:0/4036596548 learned_addr learned my addr 172.21.15.77:0/4036596548 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:29.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.860+0000 7f467d59a640 1 -- 172.21.15.77:0/4036596548 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1379654446 0 0) 0x7f468006ca40 con 0x7f4680160430 2023-11-04T01:40:29.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.860+0000 7f467dd9b640 1 --2- 172.21.15.77:0/4036596548 >> v2:172.21.15.122:3300/0 conn(0x7f46800b2d30 0x7f468006bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:29.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.860+0000 7f467d59a640 1 -- 172.21.15.77:0/4036596548 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4668003520 con 0x7f4680160430 2023-11-04T01:40:29.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.860+0000 7f467ed9d640 1 --2- 172.21.15.77:0/4036596548 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f468006c1d0 0x7f46800cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:29.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.860+0000 7f467d59a640 1 -- 172.21.15.77:0/4036596548 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2085660193 0 0) 0x7f4668003520 con 0x7f4680160430 2023-11-04T01:40:29.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.860+0000 7f467d59a640 1 -- 172.21.15.77:0/4036596548 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f468006c1d0 msgr2=0x7f46800cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:29.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.860+0000 7f467d59a640 1 --2- 172.21.15.77:0/4036596548 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f468006c1d0 0x7f46800cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.860+0000 7f467d59a640 1 -- 172.21.15.77:0/4036596548 >> v2:172.21.15.122:3300/0 conn(0x7f46800b2d30 msgr2=0x7f468006bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:29.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.860+0000 7f467d59a640 1 --2- 172.21.15.77:0/4036596548 >> v2:172.21.15.122:3300/0 conn(0x7f46800b2d30 0x7f468006bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.860+0000 7f467d59a640 1 -- 172.21.15.77:0/4036596548 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468006d000 con 0x7f4680160430 2023-11-04T01:40:29.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.860+0000 7f467d59a640 1 -- 172.21.15.77:0/4036596548 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f46700019f0 con 0x7f4680160430 2023-11-04T01:40:29.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.860+0000 7f467d59a640 1 -- 172.21.15.77:0/4036596548 >> v1:172.21.15.77:6789/0 conn(0x7f4680160430 legacy=0x7f46800b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.860+0000 7f467d59a640 1 --2- 172.21.15.77:0/4036596548 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f468006c1d0 0x7f4668003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.860+0000 7f467d59a640 1 --2- 172.21.15.77:0/4036596548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4668003ef0 0x7f46680047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.860+0000 7f467d59a640 1 --2- 172.21.15.77:0/4036596548 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4668004d00 0x7f4668005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.860+0000 7f467d59a640 1 -- 172.21.15.77:0/4036596548 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46800cb580 con 0x7f4668003ef0 2023-11-04T01:40:29.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.860+0000 7f467d59a640 1 -- 172.21.15.77:0/4036596548 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468006cd20 con 0x7f4668004d00 2023-11-04T01:40:29.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.860+0000 7f467d59a640 1 -- 172.21.15.77:0/4036596548 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f466800b980 con 0x7f468006c1d0 2023-11-04T01:40:29.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.860+0000 7f467dd9b640 1 --2- 172.21.15.77:0/4036596548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4668003ef0 0x7f46680047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:29.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.860+0000 7f467e59c640 1 --2- 172.21.15.77:0/4036596548 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f468006c1d0 0x7f4668003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:29.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.860+0000 7f467ed9d640 1 --2- 172.21.15.77:0/4036596548 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4668004d00 0x7f4668005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:29.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.860+0000 7f467dd9b640 1 -- 172.21.15.77:0/4036596548 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f468006c1d0 msgr2=0x7f4668003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:29.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.860+0000 7f467dd9b640 1 --2- 172.21.15.77:0/4036596548 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f468006c1d0 0x7f4668003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.860+0000 7f467dd9b640 1 -- 172.21.15.77:0/4036596548 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4668004d00 msgr2=0x7f4668005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:29.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.860+0000 7f467dd9b640 1 --2- 172.21.15.77:0/4036596548 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4668004d00 0x7f4668005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.860+0000 7f467dd9b640 1 -- 172.21.15.77:0/4036596548 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4668003520 con 0x7f4668003ef0 2023-11-04T01:40:29.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.861+0000 7f467dd9b640 1 --2- 172.21.15.77:0/4036596548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4668003ef0 0x7f46680047c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4674009ac0 tx=0x7f46680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae4c5619725013a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:29.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.861+0000 7f467d59a640 1 -- 172.21.15.77:0/4036596548 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467402c6d0 con 0x7f4668003ef0 2023-11-04T01:40:29.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.861+0000 7f467d59a640 1 -- 172.21.15.77:0/4036596548 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467402c830 con 0x7f4668003ef0 2023-11-04T01:40:29.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.861+0000 7f467d59a640 1 -- 172.21.15.77:0/4036596548 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467402cbc0 con 0x7f4668003ef0 2023-11-04T01:40:29.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.862+0000 7f4684c6f640 1 -- 172.21.15.77:0/4036596548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4668003ef0 msgr2=0x7f46680047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.862+0000 7f4684c6f640 1 --2- 172.21.15.77:0/4036596548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4668003ef0 0x7f46680047c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4674009ac0 tx=0x7f46680057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.862+0000 7f467ed9d640 1 -- 172.21.15.77:0/4036596548 reap_dead start 2023-11-04T01:40:29.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.862+0000 7f4684c6f640 1 -- 172.21.15.77:0/4036596548 shutdown_connections 2023-11-04T01:40:29.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.862+0000 7f4684c6f640 1 -- 172.21.15.77:0/4036596548 >> 172.21.15.77:0/4036596548 conn(0x7f468006ea20 msgr2=0x7f468006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:29.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.862+0000 7f4684c6f640 1 -- 172.21.15.77:0/4036596548 shutdown_connections 2023-11-04T01:40:29.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.862+0000 7f4684c6f640 1 -- 172.21.15.77:0/4036596548 wait complete. 2023-11-04T01:40:29.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.863+0000 7f4684c6f640 1 Processor -- start 2023-11-04T01:40:29.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.863+0000 7f4684c6f640 1 -- start start 2023-11-04T01:40:29.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.864+0000 7f4684c6f640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4668003ef0 0x7f4680154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.864+0000 7f4684c6f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4680158280 0x7f46800b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.864+0000 7f4684c6f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46801562d0 0x7f4680156750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.864+0000 7f4684c6f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4680153bb0 con 0x7f4680158280 2023-11-04T01:40:29.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.864+0000 7f4684c6f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4680152d50 con 0x7f46801562d0 2023-11-04T01:40:29.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.864+0000 7f4684c6f640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4680152fa0 con 0x7f4668003ef0 2023-11-04T01:40:29.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.864+0000 7f467dd9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4680158280 0x7f46800b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:29.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.864+0000 7f467dd9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4680158280 0x7f46800b2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53166/0 (socket says 172.21.15.77:53166) 2023-11-04T01:40:29.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.864+0000 7f467dd9b640 1 -- 172.21.15.77:0/382373062 learned_addr learned my addr 172.21.15.77:0/382373062 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:29.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.864+0000 7f467e59c640 1 --2- 172.21.15.77:0/382373062 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4668003ef0 0x7f4680154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:29.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.864+0000 7f467ed9d640 1 --2- 172.21.15.77:0/382373062 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46801562d0 0x7f4680156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:29.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.864+0000 7f467dd9b640 1 -- 172.21.15.77:0/382373062 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4668003ef0 msgr2=0x7f4680154040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.864+0000 7f467dd9b640 1 --2- 172.21.15.77:0/382373062 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4668003ef0 0x7f4680154040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.864+0000 7f467dd9b640 1 -- 172.21.15.77:0/382373062 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46801562d0 msgr2=0x7f4680156750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:29.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.864+0000 7f467dd9b640 1 --2- 172.21.15.77:0/382373062 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46801562d0 0x7f4680156750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:29.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.864+0000 7f467dd9b640 1 -- 172.21.15.77:0/382373062 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4680153280 con 0x7f4680158280 2023-11-04T01:40:29.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.864+0000 7f467dd9b640 1 --2- 172.21.15.77:0/382373062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4680158280 0x7f46800b2080 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f467402c2d0 tx=0x7f4674004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:29.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.865+0000 7f466effd640 1 -- 172.21.15.77:0/382373062 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4674003810 con 0x7f4680158280 2023-11-04T01:40:29.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.865+0000 7f466effd640 1 -- 172.21.15.77:0/382373062 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4674003970 con 0x7f4680158280 2023-11-04T01:40:29.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.865+0000 7f4684c6f640 1 -- 172.21.15.77:0/382373062 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4680153560 con 0x7f4680158280 2023-11-04T01:40:29.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.865+0000 7f466effd640 1 -- 172.21.15.77:0/382373062 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4674003ce0 con 0x7f4680158280 2023-11-04T01:40:29.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.865+0000 7f4684c6f640 1 -- 172.21.15.77:0/382373062 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46801586e0 con 0x7f4680158280 2023-11-04T01:40:29.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.866+0000 7f4684c6f640 1 -- 172.21.15.77:0/382373062 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f468006d400 con 0x7f4680158280 2023-11-04T01:40:29.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.866+0000 7f466effd640 1 -- 172.21.15.77:0/382373062 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4674040660 con 0x7f4680158280 2023-11-04T01:40:29.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.866+0000 7f466effd640 1 --2- 172.21.15.77:0/382373062 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f466006aea0 0x7f466006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:29.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.866+0000 7f466effd640 1 -- 172.21.15.77:0/382373062 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f46740ab910 con 0x7f4680158280 2023-11-04T01:40:29.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.866+0000 7f467e59c640 1 --2- 172.21.15.77:0/382373062 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f466006aea0 0x7f466006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:29.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.867+0000 7f467e59c640 1 --2- 172.21.15.77:0/382373062 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f466006aea0 0x7f466006d360 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f46700013d0 tx=0x7f4670006040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:29.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:29.870+0000 7f466effd640 1 -- 172.21.15.77:0/382373062 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4674076700 con 0x7f4680158280 2023-11-04T01:40:30.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.035+0000 7f4684c6f640 1 -- 172.21.15.77:0/382373062 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f468006f9b0 con 0x7f4680158280 2023-11-04T01:40:30.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.036+0000 7f466effd640 1 -- 172.21.15.77:0/382373062 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f46740044e0 con 0x7f4680158280 2023-11-04T01:40:30.038 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:40:30.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.038+0000 7f4684c6f640 1 -- 172.21.15.77:0/382373062 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f466006aea0 msgr2=0x7f466006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.038+0000 7f4684c6f640 1 --2- 172.21.15.77:0/382373062 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f466006aea0 0x7f466006d360 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f46700013d0 tx=0x7f4670006040 comp rx=0 tx=0).stop 2023-11-04T01:40:30.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.038+0000 7f4684c6f640 1 -- 172.21.15.77:0/382373062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4680158280 msgr2=0x7f46800b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.038+0000 7f4684c6f640 1 --2- 172.21.15.77:0/382373062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4680158280 0x7f46800b2080 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f467402c2d0 tx=0x7f4674004730 comp rx=0 tx=0).stop 2023-11-04T01:40:30.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.038+0000 7f4684c6f640 1 -- 172.21.15.77:0/382373062 shutdown_connections 2023-11-04T01:40:30.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.038+0000 7f4684c6f640 1 --2- 172.21.15.77:0/382373062 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f466006aea0 0x7f466006d360 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.038+0000 7f4684c6f640 1 --2- 172.21.15.77:0/382373062 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46801562d0 0x7f4680156750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.038+0000 7f4684c6f640 1 --2- 172.21.15.77:0/382373062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4680158280 0x7f46800b2080 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.038+0000 7f4684c6f640 1 --2- 172.21.15.77:0/382373062 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4668003ef0 0x7f4680154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.038+0000 7f4684c6f640 1 -- 172.21.15.77:0/382373062 >> 172.21.15.77:0/382373062 conn(0x7f468006ea20 msgr2=0x7f46800cc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:30.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.038+0000 7f4684c6f640 1 -- 172.21.15.77:0/382373062 shutdown_connections 2023-11-04T01:40:30.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.038+0000 7f4684c6f640 1 -- 172.21.15.77:0/382373062 wait complete. 2023-11-04T01:40:30.050 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:30.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.148+0000 7f8613ae5640 1 Processor -- start 2023-11-04T01:40:30.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.149+0000 7f8613ae5640 1 -- start start 2023-11-04T01:40:30.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.149+0000 7f8613ae5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f860c0cce10 0x7f860c0b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.149+0000 7f8613ae5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f860c06a830 0x7f860c15e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.149+0000 7f8613ae5640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f860c15e6e0 con 0x7f860c0b18b0 2023-11-04T01:40:30.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.149+0000 7f8613ae5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f860c15dd10 con 0x7f860c0cce10 2023-11-04T01:40:30.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.149+0000 7f8613ae5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860c15d720 con 0x7f860c06a830 2023-11-04T01:40:30.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.149+0000 7f8611881640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f860c0cce10 0x7f860c0b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.150+0000 7f8611881640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f860c0cce10 0x7f860c0b1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53170/0 (socket says 172.21.15.77:53170) 2023-11-04T01:40:30.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.150+0000 7f8611881640 1 -- 172.21.15.77:0/3704296004 learned_addr learned my addr 172.21.15.77:0/3704296004 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:30.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.150+0000 7f8612082640 1 --2- 172.21.15.77:0/3704296004 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f860c06a830 0x7f860c15e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.150+0000 7f8611881640 1 -- 172.21.15.77:0/3704296004 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f860c06a830 msgr2=0x7f860c15e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:30.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.150+0000 7f8611881640 1 --2- 172.21.15.77:0/3704296004 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f860c06a830 0x7f860c15e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.150+0000 7f8611881640 1 -- 172.21.15.77:0/3704296004 >> v1:172.21.15.122:6789/0 conn(0x7f860c0b18b0 legacy=0x7f860c06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:30.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.150+0000 7f8611881640 1 -- 172.21.15.77:0/3704296004 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860c06fe00 con 0x7f860c0cce10 2023-11-04T01:40:30.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.150+0000 7f8612082640 1 --2- 172.21.15.77:0/3704296004 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f860c06a830 0x7f860c15e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:30.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.151+0000 7f8611881640 1 --2- 172.21.15.77:0/3704296004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f860c0cce10 0x7f860c0b1fc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8608009e50 tx=0x7f860802bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93431e2469d5c6a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:30.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.151+0000 7f861087f640 1 -- 172.21.15.77:0/3704296004 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860802c950 con 0x7f860c0cce10 2023-11-04T01:40:30.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.151+0000 7f861087f640 1 -- 172.21.15.77:0/3704296004 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860802cab0 con 0x7f860c0cce10 2023-11-04T01:40:30.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.151+0000 7f861087f640 1 -- 172.21.15.77:0/3704296004 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860802ce40 con 0x7f860c0cce10 2023-11-04T01:40:30.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.151+0000 7f8613ae5640 1 -- 172.21.15.77:0/3704296004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f860c0cce10 msgr2=0x7f860c0b1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.151+0000 7f8613ae5640 1 --2- 172.21.15.77:0/3704296004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f860c0cce10 0x7f860c0b1fc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8608009e50 tx=0x7f860802bdb0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.151+0000 7f8613ae5640 1 -- 172.21.15.77:0/3704296004 shutdown_connections 2023-11-04T01:40:30.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.151+0000 7f8613ae5640 1 --2- 172.21.15.77:0/3704296004 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f860c06a830 0x7f860c15e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.151+0000 7f8613ae5640 1 --2- 172.21.15.77:0/3704296004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f860c0cce10 0x7f860c0b1fc0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.151+0000 7f8613ae5640 1 -- 172.21.15.77:0/3704296004 >> 172.21.15.77:0/3704296004 conn(0x7f860c06d8b0 msgr2=0x7f860c06dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:30.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.151+0000 7f8613ae5640 1 -- 172.21.15.77:0/3704296004 shutdown_connections 2023-11-04T01:40:30.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.151+0000 7f8613ae5640 1 -- 172.21.15.77:0/3704296004 wait complete. 2023-11-04T01:40:30.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.152+0000 7f8613ae5640 1 Processor -- start 2023-11-04T01:40:30.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.153+0000 7f8613ae5640 1 -- start start 2023-11-04T01:40:30.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.153+0000 7f8613ae5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f860c06a830 0x7f860c0aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.153+0000 7f8613ae5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f860c0b18b0 0x7f860c0c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.153+0000 7f8613ae5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f860c0cce10 0x7f860c0c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.153+0000 7f8613ae5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c0af0c0 con 0x7f860c0cce10 2023-11-04T01:40:30.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.153+0000 7f8613ae5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c0b2310 con 0x7f860c0b18b0 2023-11-04T01:40:30.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.153+0000 7f8613ae5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860c0b3ce0 con 0x7f860c06a830 2023-11-04T01:40:30.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.153+0000 7f8612082640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f860c0cce10 0x7f860c0c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.153+0000 7f8612082640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f860c0cce10 0x7f860c0c81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53172/0 (socket says 172.21.15.77:53172) 2023-11-04T01:40:30.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.153+0000 7f8612082640 1 -- 172.21.15.77:0/3312457600 learned_addr learned my addr 172.21.15.77:0/3312457600 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:30.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.153+0000 7f8611080640 1 --2- 172.21.15.77:0/3312457600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f860c0b18b0 0x7f860c0c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.154+0000 7f8611881640 1 --2- 172.21.15.77:0/3312457600 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f860c06a830 0x7f860c0aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.154+0000 7f8612082640 1 -- 172.21.15.77:0/3312457600 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f860c06a830 msgr2=0x7f860c0aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.154+0000 7f8612082640 1 --2- 172.21.15.77:0/3312457600 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f860c06a830 0x7f860c0aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.154+0000 7f8612082640 1 -- 172.21.15.77:0/3312457600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f860c0b18b0 msgr2=0x7f860c0c7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.154+0000 7f8612082640 1 --2- 172.21.15.77:0/3312457600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f860c0b18b0 0x7f860c0c7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.154+0000 7f8612082640 1 -- 172.21.15.77:0/3312457600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8608009b30 con 0x7f860c0cce10 2023-11-04T01:40:30.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.154+0000 7f8612082640 1 --2- 172.21.15.77:0/3312457600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f860c0cce10 0x7f860c0c81b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f860400c590 tx=0x7f860400ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:30.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.154+0000 7f86027fc640 1 -- 172.21.15.77:0/3312457600 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8604011800 con 0x7f860c0cce10 2023-11-04T01:40:30.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.154+0000 7f86027fc640 1 -- 172.21.15.77:0/3312457600 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8604011980 con 0x7f860c0cce10 2023-11-04T01:40:30.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.154+0000 7f8613ae5640 1 -- 172.21.15.77:0/3312457600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f860c0b3fc0 con 0x7f860c0cce10 2023-11-04T01:40:30.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.154+0000 7f86027fc640 1 -- 172.21.15.77:0/3312457600 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8604011d30 con 0x7f860c0cce10 2023-11-04T01:40:30.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.154+0000 7f8613ae5640 1 -- 172.21.15.77:0/3312457600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f860c0b1fc0 con 0x7f860c0cce10 2023-11-04T01:40:30.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.155+0000 7f8613ae5640 1 -- 172.21.15.77:0/3312457600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f860c0b44e0 con 0x7f860c0cce10 2023-11-04T01:40:30.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.155+0000 7f86027fc640 1 -- 172.21.15.77:0/3312457600 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8604022350 con 0x7f860c0cce10 2023-11-04T01:40:30.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.156+0000 7f86027fc640 1 --2- 172.21.15.77:0/3312457600 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f85f006ae70 0x7f85f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.156+0000 7f86027fc640 1 -- 172.21.15.77:0/3312457600 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f86040899b0 con 0x7f860c0cce10 2023-11-04T01:40:30.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.156+0000 7f8611881640 1 --2- 172.21.15.77:0/3312457600 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f85f006ae70 0x7f85f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.156+0000 7f8611881640 1 --2- 172.21.15.77:0/3312457600 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f85f006ae70 0x7f85f006d330 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8608035000 tx=0x7f8608030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:30.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.160+0000 7f86027fc640 1 -- 172.21.15.77:0/3312457600 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f86040546e0 con 0x7f860c0cce10 2023-11-04T01:40:30.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.360+0000 7f8613ae5640 1 -- 172.21.15.77:0/3312457600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f860c0674e0 con 0x7f860c0cce10 2023-11-04T01:40:30.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.360+0000 7f86027fc640 1 -- 172.21.15.77:0/3312457600 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f860401f020 con 0x7f860c0cce10 2023-11-04T01:40:30.363 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:30.363 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/2867268857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2867268857},{"type":"v1","addr":"172.21.15.77:6834","nonce":2867268857}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2709973073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2709973073},{"type":"v1","addr":"172.21.15.77:6835","nonce":2709973073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/396299424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":396299424},{"type":"v1","addr":"172.21.15.122:6837","nonce":396299424}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:40:05.031856+0000","modified":"2023-11-04T01:40:21.906922+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34166},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34166":{"gid":34166,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6836/2444318089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2444318089},{"type":"v1","addr":"172.21.15.122:6836","nonce":2444318089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:40:30.363 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 9 2023-11-04T01:40:30.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.362+0000 7f8613ae5640 1 -- 172.21.15.77:0/3312457600 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f85f006ae70 msgr2=0x7f85f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.362+0000 7f8613ae5640 1 --2- 172.21.15.77:0/3312457600 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f85f006ae70 0x7f85f006d330 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8608035000 tx=0x7f8608030000 comp rx=0 tx=0).stop 2023-11-04T01:40:30.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.362+0000 7f8613ae5640 1 -- 172.21.15.77:0/3312457600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f860c0cce10 msgr2=0x7f860c0c81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.362+0000 7f8613ae5640 1 --2- 172.21.15.77:0/3312457600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f860c0cce10 0x7f860c0c81b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f860400c590 tx=0x7f860400ca50 comp rx=0 tx=0).stop 2023-11-04T01:40:30.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.362+0000 7f8613ae5640 1 -- 172.21.15.77:0/3312457600 shutdown_connections 2023-11-04T01:40:30.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.362+0000 7f8613ae5640 1 --2- 172.21.15.77:0/3312457600 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f85f006ae70 0x7f85f006d330 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.362+0000 7f8613ae5640 1 --2- 172.21.15.77:0/3312457600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f860c0cce10 0x7f860c0c81b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.362+0000 7f8613ae5640 1 --2- 172.21.15.77:0/3312457600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f860c0b18b0 0x7f860c0c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.362+0000 7f8613ae5640 1 --2- 172.21.15.77:0/3312457600 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f860c06a830 0x7f860c0aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.362+0000 7f8613ae5640 1 -- 172.21.15.77:0/3312457600 >> 172.21.15.77:0/3312457600 conn(0x7f860c06d8b0 msgr2=0x7f860c0b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:30.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.362+0000 7f8613ae5640 1 -- 172.21.15.77:0/3312457600 shutdown_connections 2023-11-04T01:40:30.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.362+0000 7f8613ae5640 1 -- 172.21.15.77:0/3312457600 wait complete. 2023-11-04T01:40:30.375 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:30.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.473+0000 7f9ed4df5640 1 Processor -- start 2023-11-04T01:40:30.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.473+0000 7f9ed4df5640 1 -- start start 2023-11-04T01:40:30.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.474+0000 7f9ed4df5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9ed0159c70 0x7f9ed00ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.474+0000 7f9ed4df5640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9ed006db20 0x7f9ed00b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.474+0000 7f9ed4df5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9ed00b0910 0x7f9ed015d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.474+0000 7f9ed4df5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed00b49b0 con 0x7f9ed0159c70 2023-11-04T01:40:30.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.474+0000 7f9ed4df5640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed00b0da0 con 0x7f9ed006db20 2023-11-04T01:40:30.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.474+0000 7f9ed4df5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed00b4110 con 0x7f9ed00b0910 2023-11-04T01:40:30.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.474+0000 7f9ece59c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9ed0159c70 0x7f9ed00ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.474+0000 7f9ece59c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9ed0159c70 0x7f9ed00ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53178/0 (socket says 172.21.15.77:53178) 2023-11-04T01:40:30.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.474+0000 7f9ece59c640 1 -- 172.21.15.77:0/463350494 learned_addr learned my addr 172.21.15.77:0/463350494 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:30.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.474+0000 7f9eced9d640 1 --2- 172.21.15.77:0/463350494 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9ed00b0910 0x7f9ed015d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.474+0000 7f9ec7fff640 1 --2- 172.21.15.77:0/463350494 >> v2:172.21.15.122:3300/0 conn(0x7f9ed006db20 0x7f9ed00b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.474+0000 7f9ece59c640 1 -- 172.21.15.77:0/463350494 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9ed00b0910 msgr2=0x7f9ed015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:30.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.474+0000 7f9ece59c640 1 --2- 172.21.15.77:0/463350494 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9ed00b0910 0x7f9ed015d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.474+0000 7f9ece59c640 1 -- 172.21.15.77:0/463350494 >> v2:172.21.15.122:3300/0 conn(0x7f9ed006db20 msgr2=0x7f9ed00b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:30.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.474+0000 7f9ece59c640 1 --2- 172.21.15.77:0/463350494 >> v2:172.21.15.122:3300/0 conn(0x7f9ed006db20 0x7f9ed00b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.474+0000 7f9ece59c640 1 -- 172.21.15.77:0/463350494 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed00b43f0 con 0x7f9ed0159c70 2023-11-04T01:40:30.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.475+0000 7f9ece59c640 1 --2- 172.21.15.77:0/463350494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ed0159c70 0x7f9ed00ce370 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9ed00cf800 tx=0x7f9ec002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ea27e75c1d7733 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:30.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.475+0000 7f9ecdd9b640 1 -- 172.21.15.77:0/463350494 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec0031870 con 0x7f9ed0159c70 2023-11-04T01:40:30.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.475+0000 7f9ecdd9b640 1 -- 172.21.15.77:0/463350494 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec00319d0 con 0x7f9ed0159c70 2023-11-04T01:40:30.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.475+0000 7f9ecdd9b640 1 -- 172.21.15.77:0/463350494 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec0031d60 con 0x7f9ed0159c70 2023-11-04T01:40:30.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.475+0000 7f9ed4df5640 1 -- 172.21.15.77:0/463350494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ed0159c70 msgr2=0x7f9ed00ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.475+0000 7f9ed4df5640 1 --2- 172.21.15.77:0/463350494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ed0159c70 0x7f9ed00ce370 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9ed00cf800 tx=0x7f9ec002b910 comp rx=0 tx=0).stop 2023-11-04T01:40:30.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.476+0000 7f9ed4df5640 1 -- 172.21.15.77:0/463350494 shutdown_connections 2023-11-04T01:40:30.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.476+0000 7f9ed4df5640 1 --2- 172.21.15.77:0/463350494 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9ed00b0910 0x7f9ed015d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.476+0000 7f9ed4df5640 1 --2- 172.21.15.77:0/463350494 >> v2:172.21.15.122:3300/0 conn(0x7f9ed006db20 0x7f9ed00b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.476+0000 7f9ed4df5640 1 --2- 172.21.15.77:0/463350494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ed0159c70 0x7f9ed00ce370 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.476+0000 7f9ed4df5640 1 -- 172.21.15.77:0/463350494 >> 172.21.15.77:0/463350494 conn(0x7f9ed00ce950 msgr2=0x7f9ed00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:30.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.476+0000 7f9ed4df5640 1 -- 172.21.15.77:0/463350494 shutdown_connections 2023-11-04T01:40:30.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.476+0000 7f9ed4df5640 1 -- 172.21.15.77:0/463350494 wait complete. 2023-11-04T01:40:30.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.477+0000 7f9ed4df5640 1 Processor -- start 2023-11-04T01:40:30.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.477+0000 7f9ed4df5640 1 -- start start 2023-11-04T01:40:30.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.478+0000 7f9ed4df5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ed006db20 0x7f9ed00b2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.478+0000 7f9ed4df5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9ed00b0910 0x7f9ed00b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.478+0000 7f9ed4df5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ed0159c70 0x7f9ed0152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.478+0000 7f9ed4df5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed01e7270 con 0x7f9ed0159c70 2023-11-04T01:40:30.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.478+0000 7f9ed4df5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed00b1fb0 con 0x7f9ed006db20 2023-11-04T01:40:30.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.478+0000 7f9ed4df5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed00b3300 con 0x7f9ed00b0910 2023-11-04T01:40:30.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.478+0000 7f9eced9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ed0159c70 0x7f9ed0152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.478+0000 7f9eced9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ed0159c70 0x7f9ed0152a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53190/0 (socket says 172.21.15.77:53190) 2023-11-04T01:40:30.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.478+0000 7f9eced9d640 1 -- 172.21.15.77:0/3810636457 learned_addr learned my addr 172.21.15.77:0/3810636457 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:30.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.478+0000 7f9ece59c640 1 --2- 172.21.15.77:0/3810636457 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ed006db20 0x7f9ed00b2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.478+0000 7f9ec7fff640 1 --2- 172.21.15.77:0/3810636457 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9ed00b0910 0x7f9ed00b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.478+0000 7f9eced9d640 1 -- 172.21.15.77:0/3810636457 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9ed00b0910 msgr2=0x7f9ed00b23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.478+0000 7f9eced9d640 1 --2- 172.21.15.77:0/3810636457 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9ed00b0910 0x7f9ed00b23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.478+0000 7f9eced9d640 1 -- 172.21.15.77:0/3810636457 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ed006db20 msgr2=0x7f9ed00b2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.478+0000 7f9eced9d640 1 --2- 172.21.15.77:0/3810636457 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ed006db20 0x7f9ed00b2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.478+0000 7f9eced9d640 1 -- 172.21.15.77:0/3810636457 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec00094d0 con 0x7f9ed0159c70 2023-11-04T01:40:30.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.478+0000 7f9ece59c640 1 --2- 172.21.15.77:0/3810636457 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ed006db20 0x7f9ed00b2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:30.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.478+0000 7f9eced9d640 1 --2- 172.21.15.77:0/3810636457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ed0159c70 0x7f9ed0152a50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9ec800efc0 tx=0x7f9ec800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:30.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.478+0000 7f9ec6ffd640 1 -- 172.21.15.77:0/3810636457 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec8014480 con 0x7f9ed0159c70 2023-11-04T01:40:30.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.478+0000 7f9ec6ffd640 1 -- 172.21.15.77:0/3810636457 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec800f040 con 0x7f9ed0159c70 2023-11-04T01:40:30.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.478+0000 7f9ec6ffd640 1 -- 172.21.15.77:0/3810636457 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec8014820 con 0x7f9ed0159c70 2023-11-04T01:40:30.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.478+0000 7f9ed4df5640 1 -- 172.21.15.77:0/3810636457 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ed00b3510 con 0x7f9ed0159c70 2023-11-04T01:40:30.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.478+0000 7f9ed4df5640 1 -- 172.21.15.77:0/3810636457 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed00b18f0 con 0x7f9ed0159c70 2023-11-04T01:40:30.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.479+0000 7f9ed4df5640 1 -- 172.21.15.77:0/3810636457 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ed00b20f0 con 0x7f9ed0159c70 2023-11-04T01:40:30.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.480+0000 7f9ec6ffd640 1 -- 172.21.15.77:0/3810636457 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9ec8014980 con 0x7f9ed0159c70 2023-11-04T01:40:30.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.480+0000 7f9ec6ffd640 1 --2- 172.21.15.77:0/3810636457 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9eb006ae70 0x7f9eb006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.480+0000 7f9ec6ffd640 1 -- 172.21.15.77:0/3810636457 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9ec808a710 con 0x7f9ed0159c70 2023-11-04T01:40:30.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.480+0000 7f9ece59c640 1 --2- 172.21.15.77:0/3810636457 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9eb006ae70 0x7f9eb006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.481+0000 7f9ece59c640 1 --2- 172.21.15.77:0/3810636457 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9eb006ae70 0x7f9eb006d330 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0036000 tx=0x7f9ec003c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:30.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.484+0000 7f9ec6ffd640 1 -- 172.21.15.77:0/3810636457 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9ed00b20f0 con 0x7f9ed0159c70 2023-11-04T01:40:30.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.653+0000 7f9ed4df5640 1 -- 172.21.15.77:0/3810636457 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ed00b20f0 con 0x7f9ed0159c70 2023-11-04T01:40:30.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.654+0000 7f9ec6ffd640 1 -- 172.21.15.77:0/3810636457 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f9ed00b20f0 con 0x7f9ed0159c70 2023-11-04T01:40:30.656 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:30.656 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":24,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:40:10.153949+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:40:02.810971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:40:04.003979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:40:07.734355+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:30.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.656+0000 7f9ed4df5640 1 -- 172.21.15.77:0/3810636457 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9eb006ae70 msgr2=0x7f9eb006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.656+0000 7f9ed4df5640 1 --2- 172.21.15.77:0/3810636457 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9eb006ae70 0x7f9eb006d330 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0036000 tx=0x7f9ec003c040 comp rx=0 tx=0).stop 2023-11-04T01:40:30.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.656+0000 7f9ed4df5640 1 -- 172.21.15.77:0/3810636457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ed0159c70 msgr2=0x7f9ed0152a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.656+0000 7f9ed4df5640 1 --2- 172.21.15.77:0/3810636457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ed0159c70 0x7f9ed0152a50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9ec800efc0 tx=0x7f9ec800c490 comp rx=0 tx=0).stop 2023-11-04T01:40:30.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.656+0000 7f9ed4df5640 1 -- 172.21.15.77:0/3810636457 shutdown_connections 2023-11-04T01:40:30.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.656+0000 7f9ed4df5640 1 --2- 172.21.15.77:0/3810636457 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9eb006ae70 0x7f9eb006d330 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.656+0000 7f9ed4df5640 1 --2- 172.21.15.77:0/3810636457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ed0159c70 0x7f9ed0152a50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.656+0000 7f9ed4df5640 1 --2- 172.21.15.77:0/3810636457 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9ed00b0910 0x7f9ed00b23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.656+0000 7f9ed4df5640 1 --2- 172.21.15.77:0/3810636457 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ed006db20 0x7f9ed00b2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.656+0000 7f9ed4df5640 1 -- 172.21.15.77:0/3810636457 >> 172.21.15.77:0/3810636457 conn(0x7f9ed00ce950 msgr2=0x7f9ed015a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:30.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.656+0000 7f9ed4df5640 1 -- 172.21.15.77:0/3810636457 shutdown_connections 2023-11-04T01:40:30.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.656+0000 7f9ed4df5640 1 -- 172.21.15.77:0/3810636457 wait complete. 2023-11-04T01:40:30.668 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:40:02.810971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:40:04.003979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:40:07.734355+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:40:30.669 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:40:30.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.770+0000 7fd2de44f640 1 Processor -- start 2023-11-04T01:40:30.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.770+0000 7fd2de44f640 1 -- start start 2023-11-04T01:40:30.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.771+0000 7fd2de44f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd2d8153e60 0x7fd2d815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.771+0000 7fd2de44f640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd2d80cd6d0 0x7fd2d8161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.771+0000 7fd2de44f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d80cde60 con 0x7fd2d80b4880 2023-11-04T01:40:30.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.771+0000 7fd2de44f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d8160f90 con 0x7fd2d8153e60 2023-11-04T01:40:30.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.771+0000 7fd2de44f640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d815e400 con 0x7fd2d80cd6d0 2023-11-04T01:40:30.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.771+0000 7fd2d7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd2d8153e60 0x7fd2d815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.771+0000 7fd2dc9ec640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd2d80b4880 0x7fd2d80b4ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:60952/0 (socket says 172.21.15.77:60952) 2023-11-04T01:40:30.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.771+0000 7fd2dc9ec640 1 -- 172.21.15.77:0/1987099558 learned_addr learned my addr 172.21.15.77:0/1987099558 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:30.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.772+0000 7fd2d77fe640 1 --2- 172.21.15.77:0/1987099558 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd2d80cd6d0 0x7fd2d8161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.772+0000 7fd2d7fff640 1 -- 172.21.15.77:0/1987099558 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd2d80cd6d0 msgr2=0x7fd2d8161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:30.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.772+0000 7fd2d7fff640 1 --2- 172.21.15.77:0/1987099558 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd2d80cd6d0 0x7fd2d8161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.772+0000 7fd2d7fff640 1 -- 172.21.15.77:0/1987099558 >> v1:172.21.15.77:6789/0 conn(0x7fd2d80b4880 legacy=0x7fd2d80b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.772+0000 7fd2d7fff640 1 -- 172.21.15.77:0/1987099558 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d8161960 con 0x7fd2d8153e60 2023-11-04T01:40:30.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.772+0000 7fd2d6ffd640 1 -- 172.21.15.77:0/1987099558 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1030340871 0 0) 0x7fd2d80cde60 con 0x7fd2d80b4880 2023-11-04T01:40:30.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.772+0000 7fd2d77fe640 1 --2- 172.21.15.77:0/1987099558 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd2d80cd6d0 0x7fd2d8161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:30.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.772+0000 7fd2d7fff640 1 --2- 172.21.15.77:0/1987099558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2d8153e60 0x7fd2d815dec0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd2c80097a0 tx=0x7fd2c802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ec20e74d195513 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:30.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.772+0000 7fd2d6ffd640 1 -- 172.21.15.77:0/1987099558 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8031830 con 0x7fd2d8153e60 2023-11-04T01:40:30.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.773+0000 7fd2d6ffd640 1 -- 172.21.15.77:0/1987099558 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c8031990 con 0x7fd2d8153e60 2023-11-04T01:40:30.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.773+0000 7fd2d6ffd640 1 -- 172.21.15.77:0/1987099558 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8031d20 con 0x7fd2d8153e60 2023-11-04T01:40:30.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.773+0000 7fd2de44f640 1 -- 172.21.15.77:0/1987099558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2d8153e60 msgr2=0x7fd2d815dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.773+0000 7fd2de44f640 1 --2- 172.21.15.77:0/1987099558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2d8153e60 0x7fd2d815dec0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd2c80097a0 tx=0x7fd2c802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.773+0000 7fd2de44f640 1 -- 172.21.15.77:0/1987099558 shutdown_connections 2023-11-04T01:40:30.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.773+0000 7fd2de44f640 1 --2- 172.21.15.77:0/1987099558 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd2d80cd6d0 0x7fd2d8161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.773+0000 7fd2de44f640 1 --2- 172.21.15.77:0/1987099558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2d8153e60 0x7fd2d815dec0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.773+0000 7fd2de44f640 1 -- 172.21.15.77:0/1987099558 >> 172.21.15.77:0/1987099558 conn(0x7fd2d80cf880 msgr2=0x7fd2d80cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:30.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.773+0000 7fd2de44f640 1 -- 172.21.15.77:0/1987099558 shutdown_connections 2023-11-04T01:40:30.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.773+0000 7fd2de44f640 1 -- 172.21.15.77:0/1987099558 wait complete. 2023-11-04T01:40:30.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.774+0000 7fd2de44f640 1 Processor -- start 2023-11-04T01:40:30.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.774+0000 7fd2de44f640 1 -- start start 2023-11-04T01:40:30.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.775+0000 7fd2de44f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2d80b4880 0x7fd2d8150270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.775+0000 7fd2de44f640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd2d80cd6d0 0x7fd2d80cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.775+0000 7fd2de44f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2d8153e60 0x7fd2d80ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.775+0000 7fd2de44f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d80cac70 con 0x7fd2d80b4880 2023-11-04T01:40:30.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.775+0000 7fd2de44f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d80caf50 con 0x7fd2d8153e60 2023-11-04T01:40:30.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.775+0000 7fd2de44f640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d80cb230 con 0x7fd2d80cd6d0 2023-11-04T01:40:30.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.775+0000 7fd2d7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2d80b4880 0x7fd2d8150270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.775+0000 7fd2d7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2d80b4880 0x7fd2d8150270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53210/0 (socket says 172.21.15.77:53210) 2023-11-04T01:40:30.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.775+0000 7fd2d7fff640 1 -- 172.21.15.77:0/906492115 learned_addr learned my addr 172.21.15.77:0/906492115 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:30.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.775+0000 7fd2d77fe640 1 --2- 172.21.15.77:0/906492115 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd2d80cd6d0 0x7fd2d80cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.775+0000 7fd2dc9ec640 1 --2- 172.21.15.77:0/906492115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2d8153e60 0x7fd2d80ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.776+0000 7fd2d7fff640 1 -- 172.21.15.77:0/906492115 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd2d80cd6d0 msgr2=0x7fd2d80cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.776+0000 7fd2d7fff640 1 --2- 172.21.15.77:0/906492115 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd2d80cd6d0 0x7fd2d80cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.776+0000 7fd2d7fff640 1 -- 172.21.15.77:0/906492115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2d8153e60 msgr2=0x7fd2d80ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.776+0000 7fd2d7fff640 1 --2- 172.21.15.77:0/906492115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2d8153e60 0x7fd2d80ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.776+0000 7fd2d7fff640 1 -- 172.21.15.77:0/906492115 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c8009400 con 0x7fd2d80b4880 2023-11-04T01:40:30.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.776+0000 7fd2d7fff640 1 --2- 172.21.15.77:0/906492115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2d80b4880 0x7fd2d8150270 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8034040 tx=0x7fd2c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:30.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.776+0000 7fd2d4ff9640 1 -- 172.21.15.77:0/906492115 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c803aa60 con 0x7fd2d80b4880 2023-11-04T01:40:30.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.776+0000 7fd2d4ff9640 1 -- 172.21.15.77:0/906492115 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c803abe0 con 0x7fd2d80b4880 2023-11-04T01:40:30.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.776+0000 7fd2de44f640 1 -- 172.21.15.77:0/906492115 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d80cb510 con 0x7fd2d80b4880 2023-11-04T01:40:30.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.776+0000 7fd2d4ff9640 1 -- 172.21.15.77:0/906492115 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8044400 con 0x7fd2d80b4880 2023-11-04T01:40:30.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.776+0000 7fd2de44f640 1 -- 172.21.15.77:0/906492115 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d81507b0 con 0x7fd2d80b4880 2023-11-04T01:40:30.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.777+0000 7fd2de44f640 1 -- 172.21.15.77:0/906492115 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d80cba30 con 0x7fd2d80b4880 2023-11-04T01:40:30.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.777+0000 7fd2d4ff9640 1 -- 172.21.15.77:0/906492115 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd2c804d440 con 0x7fd2d80b4880 2023-11-04T01:40:30.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.778+0000 7fd2d4ff9640 1 --2- 172.21.15.77:0/906492115 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd2c406ae70 0x7fd2c406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:30.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.778+0000 7fd2d4ff9640 1 -- 172.21.15.77:0/906492115 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd2c80abb30 con 0x7fd2d80b4880 2023-11-04T01:40:30.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.778+0000 7fd2d77fe640 1 --2- 172.21.15.77:0/906492115 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd2c406ae70 0x7fd2c406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:30.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.779+0000 7fd2d77fe640 1 --2- 172.21.15.77:0/906492115 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd2c406ae70 0x7fd2c406d330 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd2d80cc920 tx=0x7fd2cc008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:30.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.782+0000 7fd2d4ff9640 1 -- 172.21.15.77:0/906492115 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd2d80cba30 con 0x7fd2d80b4880 2023-11-04T01:40:30.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.946+0000 7fd2de44f640 1 -- 172.21.15.77:0/906492115 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd2d80cba30 con 0x7fd2d80b4880 2023-11-04T01:40:30.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.947+0000 7fd2d4ff9640 1 -- 172.21.15.77:0/906492115 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd2c8035020 con 0x7fd2d80b4880 2023-11-04T01:40:30.949 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:40:30.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.949+0000 7fd2de44f640 1 -- 172.21.15.77:0/906492115 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd2c406ae70 msgr2=0x7fd2c406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.949+0000 7fd2de44f640 1 --2- 172.21.15.77:0/906492115 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd2c406ae70 0x7fd2c406d330 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd2d80cc920 tx=0x7fd2cc008040 comp rx=0 tx=0).stop 2023-11-04T01:40:30.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.949+0000 7fd2de44f640 1 -- 172.21.15.77:0/906492115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2d80b4880 msgr2=0x7fd2d8150270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:30.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.949+0000 7fd2de44f640 1 --2- 172.21.15.77:0/906492115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2d80b4880 0x7fd2d8150270 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8034040 tx=0x7fd2c80046c0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.949+0000 7fd2de44f640 1 -- 172.21.15.77:0/906492115 shutdown_connections 2023-11-04T01:40:30.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.949+0000 7fd2de44f640 1 --2- 172.21.15.77:0/906492115 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd2c406ae70 0x7fd2c406d330 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.949+0000 7fd2de44f640 1 --2- 172.21.15.77:0/906492115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2d8153e60 0x7fd2d80ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.949+0000 7fd2de44f640 1 --2- 172.21.15.77:0/906492115 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd2d80cd6d0 0x7fd2d80cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.949+0000 7fd2de44f640 1 --2- 172.21.15.77:0/906492115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2d80b4880 0x7fd2d8150270 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:30.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.949+0000 7fd2de44f640 1 -- 172.21.15.77:0/906492115 >> 172.21.15.77:0/906492115 conn(0x7fd2d80cf880 msgr2=0x7fd2d80d2420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:30.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.949+0000 7fd2de44f640 1 -- 172.21.15.77:0/906492115 shutdown_connections 2023-11-04T01:40:30.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:30.949+0000 7fd2de44f640 1 -- 172.21.15.77:0/906492115 wait complete. 2023-11-04T01:40:30.961 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:40:31.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.062+0000 7f050df3c640 1 Processor -- start 2023-11-04T01:40:31.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.062+0000 7f050df3c640 1 -- start start 2023-11-04T01:40:31.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.062+0000 7f050df3c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f05080cd6d0 0x7f0508161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.062+0000 7f050df3c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05080cde60 con 0x7f05080b4880 2023-11-04T01:40:31.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.063+0000 7f050df3c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0508160f90 con 0x7f0508153e60 2023-11-04T01:40:31.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.063+0000 7f050df3c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0508161960 con 0x7f05080cd6d0 2023-11-04T01:40:31.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.063+0000 7f0507fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f05080b4880 0x7f05080d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:60958/0 (socket says 172.21.15.77:60958) 2023-11-04T01:40:31.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.063+0000 7f0507fff640 1 -- 172.21.15.77:0/489858744 learned_addr learned my addr 172.21.15.77:0/489858744 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:31.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.063+0000 7f0506ffd640 1 --2- 172.21.15.77:0/489858744 >> v2:172.21.15.122:3300/0 conn(0x7f05080cd6d0 0x7f0508161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.063+0000 7f05067fc640 1 -- 172.21.15.77:0/489858744 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2850248385 0 0) 0x7f05080cde60 con 0x7f05080b4880 2023-11-04T01:40:31.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.063+0000 7f05067fc640 1 -- 172.21.15.77:0/489858744 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04f0003520 con 0x7f05080b4880 2023-11-04T01:40:31.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.063+0000 7f05067fc640 1 -- 172.21.15.77:0/489858744 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 371015025 0 0) 0x7f04f0003520 con 0x7f05080b4880 2023-11-04T01:40:31.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.063+0000 7f05067fc640 1 -- 172.21.15.77:0/489858744 >> v2:172.21.15.122:3300/0 conn(0x7f05080cd6d0 msgr2=0x7f0508161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:31.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.063+0000 7f05067fc640 1 --2- 172.21.15.77:0/489858744 >> v2:172.21.15.122:3300/0 conn(0x7f05080cd6d0 0x7f0508161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.063+0000 7f05067fc640 1 -- 172.21.15.77:0/489858744 >> v1:172.21.15.122:6789/0 conn(0x7f0508153e60 legacy=0x7f050815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.063+0000 7f05067fc640 1 -- 172.21.15.77:0/489858744 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05080ce090 con 0x7f05080b4880 2023-11-04T01:40:31.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.063+0000 7f05067fc640 1 -- 172.21.15.77:0/489858744 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f05000019f0 con 0x7f05080b4880 2023-11-04T01:40:31.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.063+0000 7f05067fc640 1 -- 172.21.15.77:0/489858744 >> v1:172.21.15.77:6789/0 conn(0x7f05080b4880 legacy=0x7f05080d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.063+0000 7f05067fc640 1 --2- 172.21.15.77:0/489858744 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04f0003970 0x7f04f0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.063+0000 7f05067fc640 1 --2- 172.21.15.77:0/489858744 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f00047c0 0x7f04f0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.063+0000 7f05067fc640 1 --2- 172.21.15.77:0/489858744 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04f0005180 0x7f04f000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.063+0000 7f05067fc640 1 -- 172.21.15.77:0/489858744 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0508161960 con 0x7f04f00047c0 2023-11-04T01:40:31.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.063+0000 7f05067fc640 1 -- 172.21.15.77:0/489858744 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f000c020 con 0x7f04f0005180 2023-11-04T01:40:31.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.063+0000 7f05067fc640 1 -- 172.21.15.77:0/489858744 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f000c1e0 con 0x7f04f0003970 2023-11-04T01:40:31.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.063+0000 7f0506ffd640 1 --2- 172.21.15.77:0/489858744 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f00047c0 0x7f04f0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.063+0000 7f05077fe640 1 --2- 172.21.15.77:0/489858744 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04f0003970 0x7f04f0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.064+0000 7f0507fff640 1 --2- 172.21.15.77:0/489858744 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04f0005180 0x7f04f000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.064+0000 7f0506ffd640 1 -- 172.21.15.77:0/489858744 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04f0003970 msgr2=0x7f04f0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:31.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.064+0000 7f0506ffd640 1 --2- 172.21.15.77:0/489858744 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04f0003970 0x7f04f0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.064+0000 7f0506ffd640 1 -- 172.21.15.77:0/489858744 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04f0005180 msgr2=0x7f04f000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:31.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.064+0000 7f0506ffd640 1 --2- 172.21.15.77:0/489858744 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04f0005180 0x7f04f000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.064+0000 7f0506ffd640 1 -- 172.21.15.77:0/489858744 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f0003520 con 0x7f04f00047c0 2023-11-04T01:40:31.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.064+0000 7f0507fff640 1 -- 172.21.15.77:0/489858744 reap_dead start 2023-11-04T01:40:31.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.064+0000 7f0506ffd640 1 --2- 172.21.15.77:0/489858744 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f00047c0 0x7f04f0004c40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f04fc009ac0 tx=0x7f04f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40c11ec58a933e9c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:31.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.065+0000 7f05067fc640 1 -- 172.21.15.77:0/489858744 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc02c6b0 con 0x7f04f00047c0 2023-11-04T01:40:31.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.065+0000 7f05067fc640 1 -- 172.21.15.77:0/489858744 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04fc02c810 con 0x7f04f00047c0 2023-11-04T01:40:31.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.065+0000 7f05067fc640 1 -- 172.21.15.77:0/489858744 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc02cba0 con 0x7f04f00047c0 2023-11-04T01:40:31.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.065+0000 7f050df3c640 1 -- 172.21.15.77:0/489858744 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f00047c0 msgr2=0x7f04f0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.065+0000 7f050df3c640 1 --2- 172.21.15.77:0/489858744 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f00047c0 0x7f04f0004c40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f04fc009ac0 tx=0x7f04f00057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.065+0000 7f050df3c640 1 -- 172.21.15.77:0/489858744 shutdown_connections 2023-11-04T01:40:31.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.065+0000 7f050df3c640 1 --2- 172.21.15.77:0/489858744 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f00047c0 0x7f04f0004c40 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.065+0000 7f050df3c640 1 -- 172.21.15.77:0/489858744 >> 172.21.15.77:0/489858744 conn(0x7f05080cf880 msgr2=0x7f05080cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:31.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.065+0000 7f050df3c640 1 -- 172.21.15.77:0/489858744 shutdown_connections 2023-11-04T01:40:31.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.065+0000 7f050df3c640 1 -- 172.21.15.77:0/489858744 wait complete. 2023-11-04T01:40:31.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.066+0000 7f050df3c640 1 Processor -- start 2023-11-04T01:40:31.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.066+0000 7f050df3c640 1 -- start start 2023-11-04T01:40:31.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.067+0000 7f050df3c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04f00047c0 0x7f05080c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.067+0000 7f050df3c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05080ccb10 0x7f05081f2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.067+0000 7f050df3c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f05080cb8e0 0x7f05081f2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.067+0000 7f050df3c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0508150d10 con 0x7f05080ccb10 2023-11-04T01:40:31.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.067+0000 7f050df3c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05080ca840 con 0x7f04f00047c0 2023-11-04T01:40:31.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.067+0000 7f050df3c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05080cab20 con 0x7f05080cb8e0 2023-11-04T01:40:31.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.067+0000 7f0506ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05080ccb10 0x7f05081f2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.067+0000 7f0506ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05080ccb10 0x7f05081f2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53218/0 (socket says 172.21.15.77:53218) 2023-11-04T01:40:31.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.067+0000 7f0506ffd640 1 -- 172.21.15.77:0/670332066 learned_addr learned my addr 172.21.15.77:0/670332066 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:31.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.067+0000 7f05077fe640 1 --2- 172.21.15.77:0/670332066 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04f00047c0 0x7f05080c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.067+0000 7f0507fff640 1 --2- 172.21.15.77:0/670332066 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f05080cb8e0 0x7f05081f2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.067+0000 7f0506ffd640 1 -- 172.21.15.77:0/670332066 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f05080cb8e0 msgr2=0x7f05081f2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.067+0000 7f0506ffd640 1 --2- 172.21.15.77:0/670332066 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f05080cb8e0 0x7f05081f2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.068+0000 7f0506ffd640 1 -- 172.21.15.77:0/670332066 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04f00047c0 msgr2=0x7f05080c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.068+0000 7f0506ffd640 1 --2- 172.21.15.77:0/670332066 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04f00047c0 0x7f05080c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.068+0000 7f0506ffd640 1 -- 172.21.15.77:0/670332066 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05080cae00 con 0x7f05080ccb10 2023-11-04T01:40:31.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.068+0000 7f05077fe640 1 --2- 172.21.15.77:0/670332066 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04f00047c0 0x7f05080c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:31.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.068+0000 7f0506ffd640 1 --2- 172.21.15.77:0/670332066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05080ccb10 0x7f05081f2450 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f04fc009ac0 tx=0x7f04fc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:31.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.068+0000 7f04effff640 1 -- 172.21.15.77:0/670332066 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc003810 con 0x7f05080ccb10 2023-11-04T01:40:31.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.068+0000 7f04effff640 1 -- 172.21.15.77:0/670332066 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04fc003970 con 0x7f05080ccb10 2023-11-04T01:40:31.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.068+0000 7f050df3c640 1 -- 172.21.15.77:0/670332066 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05080cb0e0 con 0x7f05080ccb10 2023-11-04T01:40:31.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.068+0000 7f04effff640 1 -- 172.21.15.77:0/670332066 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc003d00 con 0x7f05080ccb10 2023-11-04T01:40:31.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.068+0000 7f050df3c640 1 -- 172.21.15.77:0/670332066 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05080ca410 con 0x7f05080ccb10 2023-11-04T01:40:31.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.069+0000 7f050df3c640 1 -- 172.21.15.77:0/670332066 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05080ca5a0 con 0x7f05080ccb10 2023-11-04T01:40:31.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.069+0000 7f04effff640 1 -- 172.21.15.77:0/670332066 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f04fc040450 con 0x7f05080ccb10 2023-11-04T01:40:31.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.070+0000 7f04effff640 1 --2- 172.21.15.77:0/670332066 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f04f406ae70 0x7f04f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.070+0000 7f04effff640 1 -- 172.21.15.77:0/670332066 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f04fc0ab8e0 con 0x7f05080ccb10 2023-11-04T01:40:31.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.070+0000 7f05077fe640 1 --2- 172.21.15.77:0/670332066 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f04f406ae70 0x7f04f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.070+0000 7f05077fe640 1 --2- 172.21.15.77:0/670332066 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f04f406ae70 0x7f04f406d330 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f04f8000c00 tx=0x7f04f8009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:31.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.074+0000 7f04effff640 1 -- 172.21.15.77:0/670332066 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f04fc0766a0 con 0x7f05080ccb10 2023-11-04T01:40:31.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.239+0000 7f050df3c640 1 -- 172.21.15.77:0/670332066 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0508074290 con 0x7f05080ccb10 2023-11-04T01:40:31.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.239+0000 7f04effff640 1 -- 172.21.15.77:0/670332066 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f04fc003e60 con 0x7f05080ccb10 2023-11-04T01:40:31.241 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:40:31.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.241+0000 7f050df3c640 1 -- 172.21.15.77:0/670332066 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f04f406ae70 msgr2=0x7f04f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.241+0000 7f050df3c640 1 --2- 172.21.15.77:0/670332066 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f04f406ae70 0x7f04f406d330 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f04f8000c00 tx=0x7f04f8009040 comp rx=0 tx=0).stop 2023-11-04T01:40:31.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.241+0000 7f050df3c640 1 -- 172.21.15.77:0/670332066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05080ccb10 msgr2=0x7f05081f2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.241+0000 7f050df3c640 1 --2- 172.21.15.77:0/670332066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05080ccb10 0x7f05081f2450 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f04fc009ac0 tx=0x7f04fc004730 comp rx=0 tx=0).stop 2023-11-04T01:40:31.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.241+0000 7f050df3c640 1 -- 172.21.15.77:0/670332066 shutdown_connections 2023-11-04T01:40:31.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.241+0000 7f050df3c640 1 --2- 172.21.15.77:0/670332066 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f04f406ae70 0x7f04f406d330 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.241+0000 7f050df3c640 1 --2- 172.21.15.77:0/670332066 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f05080cb8e0 0x7f05081f2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.241+0000 7f050df3c640 1 --2- 172.21.15.77:0/670332066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05080ccb10 0x7f05081f2450 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.241+0000 7f050df3c640 1 --2- 172.21.15.77:0/670332066 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04f00047c0 0x7f05080c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.241+0000 7f050df3c640 1 -- 172.21.15.77:0/670332066 >> 172.21.15.77:0/670332066 conn(0x7f05080cf880 msgr2=0x7f05080cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:31.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.241+0000 7f050df3c640 1 -- 172.21.15.77:0/670332066 shutdown_connections 2023-11-04T01:40:31.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.241+0000 7f050df3c640 1 -- 172.21.15.77:0/670332066 wait complete. 2023-11-04T01:40:31.254 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:40:31.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.355+0000 7efe64e5d640 1 Processor -- start 2023-11-04T01:40:31.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.355+0000 7efe64e5d640 1 -- start start 2023-11-04T01:40:31.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.356+0000 7efe64e5d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efe60159c00 0x7efe600cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.356+0000 7efe64e5d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efe600ae1d0 0x7efe600c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.356+0000 7efe64e5d640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe6015aff0 con 0x7efe600c48e0 2023-11-04T01:40:31.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.356+0000 7efe64e5d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe600c52d0 con 0x7efe60159c00 2023-11-04T01:40:31.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.356+0000 7efe64e5d640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe6015a3e0 con 0x7efe600ae1d0 2023-11-04T01:40:31.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.356+0000 7efe5e59c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efe60159c00 0x7efe600cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.356+0000 7efe5e59c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efe60159c00 0x7efe600cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53224/0 (socket says 172.21.15.77:53224) 2023-11-04T01:40:31.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.356+0000 7efe5e59c640 1 -- 172.21.15.77:0/1990194633 learned_addr learned my addr 172.21.15.77:0/1990194633 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:31.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.356+0000 7efe5ed9d640 1 --2- 172.21.15.77:0/1990194633 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efe600ae1d0 0x7efe600c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.356+0000 7efe5e59c640 1 -- 172.21.15.77:0/1990194633 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efe600ae1d0 msgr2=0x7efe600c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:31.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.356+0000 7efe5e59c640 1 --2- 172.21.15.77:0/1990194633 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efe600ae1d0 0x7efe600c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.356+0000 7efe5e59c640 1 -- 172.21.15.77:0/1990194633 >> v1:172.21.15.122:6789/0 conn(0x7efe600c48e0 legacy=0x7efe600adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.356+0000 7efe5e59c640 1 -- 172.21.15.77:0/1990194633 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe6015a6c0 con 0x7efe60159c00 2023-11-04T01:40:31.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.357+0000 7efe5e59c640 1 --2- 172.21.15.77:0/1990194633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe60159c00 0x7efe600cc890 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efe5000bb10 tx=0x7efe5002e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5464040e12fdb335 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:31.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.357+0000 7efe5dd9b640 1 -- 172.21.15.77:0/1990194633 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5002ee70 con 0x7efe60159c00 2023-11-04T01:40:31.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.357+0000 7efe5dd9b640 1 -- 172.21.15.77:0/1990194633 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe50036440 con 0x7efe60159c00 2023-11-04T01:40:31.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.357+0000 7efe5dd9b640 1 -- 172.21.15.77:0/1990194633 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe500367d0 con 0x7efe60159c00 2023-11-04T01:40:31.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.357+0000 7efe64e5d640 1 -- 172.21.15.77:0/1990194633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe60159c00 msgr2=0x7efe600cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.357+0000 7efe64e5d640 1 --2- 172.21.15.77:0/1990194633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe60159c00 0x7efe600cc890 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efe5000bb10 tx=0x7efe5002e0c0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.357+0000 7efe64e5d640 1 -- 172.21.15.77:0/1990194633 shutdown_connections 2023-11-04T01:40:31.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.357+0000 7efe64e5d640 1 --2- 172.21.15.77:0/1990194633 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efe600ae1d0 0x7efe600c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.357+0000 7efe64e5d640 1 --2- 172.21.15.77:0/1990194633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe60159c00 0x7efe600cc890 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.357+0000 7efe64e5d640 1 -- 172.21.15.77:0/1990194633 >> 172.21.15.77:0/1990194633 conn(0x7efe600ce950 msgr2=0x7efe600ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:31.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.357+0000 7efe64e5d640 1 -- 172.21.15.77:0/1990194633 shutdown_connections 2023-11-04T01:40:31.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.357+0000 7efe64e5d640 1 -- 172.21.15.77:0/1990194633 wait complete. 2023-11-04T01:40:31.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.359+0000 7efe64e5d640 1 Processor -- start 2023-11-04T01:40:31.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.359+0000 7efe64e5d640 1 -- start start 2023-11-04T01:40:31.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.360+0000 7efe64e5d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe600ae1d0 0x7efe6014eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.360+0000 7efe64e5d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe600c48e0 0x7efe60158e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.360+0000 7efe64e5d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efe60159c00 0x7efe600c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.360+0000 7efe64e5d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6014f0e0 con 0x7efe600c48e0 2023-11-04T01:40:31.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.360+0000 7efe64e5d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe600c5a20 con 0x7efe600ae1d0 2023-11-04T01:40:31.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.360+0000 7efe64e5d640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe600c8730 con 0x7efe60159c00 2023-11-04T01:40:31.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.360+0000 7efe55d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe600c48e0 0x7efe60158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.360+0000 7efe55d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe600c48e0 0x7efe60158e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53232/0 (socket says 172.21.15.77:53232) 2023-11-04T01:40:31.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.360+0000 7efe55d9b640 1 -- 172.21.15.77:0/2931656582 learned_addr learned my addr 172.21.15.77:0/2931656582 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:31.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.360+0000 7efe5e59c640 1 --2- 172.21.15.77:0/2931656582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe600ae1d0 0x7efe6014eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.360+0000 7efe5ed9d640 1 --2- 172.21.15.77:0/2931656582 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efe60159c00 0x7efe600c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.360+0000 7efe55d9b640 1 -- 172.21.15.77:0/2931656582 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efe60159c00 msgr2=0x7efe600c7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.360+0000 7efe55d9b640 1 --2- 172.21.15.77:0/2931656582 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efe60159c00 0x7efe600c7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.360+0000 7efe55d9b640 1 -- 172.21.15.77:0/2931656582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe600ae1d0 msgr2=0x7efe6014eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.360+0000 7efe55d9b640 1 --2- 172.21.15.77:0/2931656582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe600ae1d0 0x7efe6014eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.360+0000 7efe55d9b640 1 -- 172.21.15.77:0/2931656582 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe5000b770 con 0x7efe600c48e0 2023-11-04T01:40:31.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.360+0000 7efe5ed9d640 1 --2- 172.21.15.77:0/2931656582 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efe60159c00 0x7efe600c7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:31.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.360+0000 7efe55d9b640 1 --2- 172.21.15.77:0/2931656582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe600c48e0 0x7efe60158e70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efe4800c400 tx=0x7efe4800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:31.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.360+0000 7efe577fe640 1 -- 172.21.15.77:0/2931656582 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe480052d0 con 0x7efe600c48e0 2023-11-04T01:40:31.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.360+0000 7efe577fe640 1 -- 172.21.15.77:0/2931656582 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe48005450 con 0x7efe600c48e0 2023-11-04T01:40:31.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.360+0000 7efe64e5d640 1 -- 172.21.15.77:0/2931656582 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe600c5cc0 con 0x7efe600c48e0 2023-11-04T01:40:31.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.360+0000 7efe577fe640 1 -- 172.21.15.77:0/2931656582 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe48007260 con 0x7efe600c48e0 2023-11-04T01:40:31.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.360+0000 7efe64e5d640 1 -- 172.21.15.77:0/2931656582 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe600c6280 con 0x7efe600c48e0 2023-11-04T01:40:31.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.361+0000 7efe64e5d640 1 -- 172.21.15.77:0/2931656582 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe60074290 con 0x7efe600c48e0 2023-11-04T01:40:31.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.362+0000 7efe577fe640 1 -- 172.21.15.77:0/2931656582 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efe480073c0 con 0x7efe600c48e0 2023-11-04T01:40:31.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.362+0000 7efe577fe640 1 --2- 172.21.15.77:0/2931656582 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efe4006ae70 0x7efe4006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.362+0000 7efe577fe640 1 -- 172.21.15.77:0/2931656582 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efe48088ca0 con 0x7efe600c48e0 2023-11-04T01:40:31.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.362+0000 7efe5e59c640 1 --2- 172.21.15.77:0/2931656582 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efe4006ae70 0x7efe4006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.363+0000 7efe5e59c640 1 --2- 172.21.15.77:0/2931656582 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efe4006ae70 0x7efe4006d330 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efe50038000 tx=0x7efe50032000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:31.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.366+0000 7efe577fe640 1 -- 172.21.15.77:0/2931656582 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efe48053af0 con 0x7efe600c48e0 2023-11-04T01:40:31.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.532+0000 7efe64e5d640 1 -- 172.21.15.77:0/2931656582 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efe600b4850 con 0x7efe600c48e0 2023-11-04T01:40:31.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.532+0000 7efe577fe640 1 -- 172.21.15.77:0/2931656582 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7efe48057110 con 0x7efe600c48e0 2023-11-04T01:40:31.534 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-04T01:40:31.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.534+0000 7efe64e5d640 1 -- 172.21.15.77:0/2931656582 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efe4006ae70 msgr2=0x7efe4006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.534+0000 7efe64e5d640 1 --2- 172.21.15.77:0/2931656582 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efe4006ae70 0x7efe4006d330 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efe50038000 tx=0x7efe50032000 comp rx=0 tx=0).stop 2023-11-04T01:40:31.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.534+0000 7efe64e5d640 1 -- 172.21.15.77:0/2931656582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe600c48e0 msgr2=0x7efe60158e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.534+0000 7efe64e5d640 1 --2- 172.21.15.77:0/2931656582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe600c48e0 0x7efe60158e70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efe4800c400 tx=0x7efe4800c8c0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.534+0000 7efe64e5d640 1 -- 172.21.15.77:0/2931656582 shutdown_connections 2023-11-04T01:40:31.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.534+0000 7efe64e5d640 1 --2- 172.21.15.77:0/2931656582 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efe4006ae70 0x7efe4006d330 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.534+0000 7efe64e5d640 1 --2- 172.21.15.77:0/2931656582 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efe60159c00 0x7efe600c7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.534+0000 7efe64e5d640 1 --2- 172.21.15.77:0/2931656582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe600c48e0 0x7efe60158e70 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.534+0000 7efe64e5d640 1 --2- 172.21.15.77:0/2931656582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe600ae1d0 0x7efe6014eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.534+0000 7efe64e5d640 1 -- 172.21.15.77:0/2931656582 >> 172.21.15.77:0/2931656582 conn(0x7efe600ce950 msgr2=0x7efe600cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:31.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.534+0000 7efe64e5d640 1 -- 172.21.15.77:0/2931656582 shutdown_connections 2023-11-04T01:40:31.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.534+0000 7efe64e5d640 1 -- 172.21.15.77:0/2931656582 wait complete. 2023-11-04T01:40:31.548 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:40:31.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.649+0000 7f1283565640 1 Processor -- start 2023-11-04T01:40:31.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.650+0000 7f1283565640 1 -- start start 2023-11-04T01:40:31.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.650+0000 7f1283565640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f127c0b2d30 0x7f127c06bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.650+0000 7f1283565640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f127c06ca40 con 0x7f127c160430 2023-11-04T01:40:31.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.650+0000 7f1283565640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f127c06cd20 con 0x7f127c06c1d0 2023-11-04T01:40:31.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.650+0000 7f1283565640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f127c0cb580 con 0x7f127c0b2d30 2023-11-04T01:40:31.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.651+0000 7f1280b00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f127c0b2d30 0x7f127c06bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.651+0000 7f1281301640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f127c160430 0x7f127c0b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:60964/0 (socket says 172.21.15.77:60964) 2023-11-04T01:40:31.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.651+0000 7f1281301640 1 -- 172.21.15.77:0/143646542 learned_addr learned my addr 172.21.15.77:0/143646542 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:31.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.651+0000 7f1280b00640 1 -- 172.21.15.77:0/143646542 >> v1:172.21.15.122:6789/0 conn(0x7f127c06c1d0 legacy=0x7f127c0cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:31.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.651+0000 7f1280b00640 1 -- 172.21.15.77:0/143646542 >> v1:172.21.15.77:6789/0 conn(0x7f127c160430 legacy=0x7f127c0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.651+0000 7f1280b00640 1 -- 172.21.15.77:0/143646542 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f127c06d000 con 0x7f127c0b2d30 2023-11-04T01:40:31.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.651+0000 7f1273fff640 1 -- 172.21.15.77:0/143646542 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1403506492 0 0) 0x7f127c06ca40 con 0x7f127c160430 2023-11-04T01:40:31.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.652+0000 7f1280b00640 1 --2- 172.21.15.77:0/143646542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f127c0b2d30 0x7f127c06bc90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f126c0097d0 tx=0x7f126c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d13fcfba23c1a0e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:31.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.652+0000 7f1273fff640 1 -- 172.21.15.77:0/143646542 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c031830 con 0x7f127c0b2d30 2023-11-04T01:40:31.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.652+0000 7f1273fff640 1 -- 172.21.15.77:0/143646542 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126c031990 con 0x7f127c0b2d30 2023-11-04T01:40:31.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.652+0000 7f1273fff640 1 -- 172.21.15.77:0/143646542 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c031d20 con 0x7f127c0b2d30 2023-11-04T01:40:31.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.652+0000 7f1283565640 1 -- 172.21.15.77:0/143646542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f127c0b2d30 msgr2=0x7f127c06bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.652+0000 7f1283565640 1 --2- 172.21.15.77:0/143646542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f127c0b2d30 0x7f127c06bc90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f126c0097d0 tx=0x7f126c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.652+0000 7f1283565640 1 -- 172.21.15.77:0/143646542 shutdown_connections 2023-11-04T01:40:31.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.652+0000 7f1283565640 1 --2- 172.21.15.77:0/143646542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f127c0b2d30 0x7f127c06bc90 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.652+0000 7f1283565640 1 -- 172.21.15.77:0/143646542 >> 172.21.15.77:0/143646542 conn(0x7f127c06ea20 msgr2=0x7f127c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:31.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.652+0000 7f1283565640 1 -- 172.21.15.77:0/143646542 shutdown_connections 2023-11-04T01:40:31.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.652+0000 7f1283565640 1 -- 172.21.15.77:0/143646542 wait complete. 2023-11-04T01:40:31.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.654+0000 7f1283565640 1 Processor -- start 2023-11-04T01:40:31.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.654+0000 7f1283565640 1 -- start start 2023-11-04T01:40:31.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.654+0000 7f1283565640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f127c06c1d0 0x7f127c1525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.654+0000 7f1283565640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f127c0b2d30 0x7f127c0ca430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.654+0000 7f1283565640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f127c160430 0x7f127c15ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.654+0000 7f1283565640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127c0c4b30 con 0x7f127c06c1d0 2023-11-04T01:40:31.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.654+0000 7f1283565640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127c0c4e10 con 0x7f127c160430 2023-11-04T01:40:31.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.654+0000 7f1283565640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f127c0c50f0 con 0x7f127c0b2d30 2023-11-04T01:40:31.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.654+0000 7f1281301640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f127c06c1d0 0x7f127c1525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.654+0000 7f1281301640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f127c06c1d0 0x7f127c1525a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53250/0 (socket says 172.21.15.77:53250) 2023-11-04T01:40:31.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.654+0000 7f1281301640 1 -- 172.21.15.77:0/1776491223 learned_addr learned my addr 172.21.15.77:0/1776491223 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:31.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.655+0000 7f1280b00640 1 --2- 172.21.15.77:0/1776491223 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f127c0b2d30 0x7f127c0ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.655+0000 7f1281301640 1 -- 172.21.15.77:0/1776491223 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f127c0b2d30 msgr2=0x7f127c0ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.655+0000 7f1281301640 1 --2- 172.21.15.77:0/1776491223 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f127c0b2d30 0x7f127c0ca430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.655+0000 7f1281b02640 1 --2- 172.21.15.77:0/1776491223 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f127c160430 0x7f127c15ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.655+0000 7f1281301640 1 -- 172.21.15.77:0/1776491223 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f127c160430 msgr2=0x7f127c15ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.655+0000 7f1281301640 1 --2- 172.21.15.77:0/1776491223 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f127c160430 0x7f127c15ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.655+0000 7f1281301640 1 -- 172.21.15.77:0/1776491223 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126c009400 con 0x7f127c06c1d0 2023-11-04T01:40:31.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.655+0000 7f1280b00640 1 --2- 172.21.15.77:0/1776491223 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f127c0b2d30 0x7f127c0ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:31.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.655+0000 7f1281301640 1 --2- 172.21.15.77:0/1776491223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f127c06c1d0 0x7f127c1525a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f127800c430 tx=0x7f127800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:31.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.655+0000 7f1271ffb640 1 -- 172.21.15.77:0/1776491223 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12780074e0 con 0x7f127c06c1d0 2023-11-04T01:40:31.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.655+0000 7f1271ffb640 1 -- 172.21.15.77:0/1776491223 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1278007660 con 0x7f127c06c1d0 2023-11-04T01:40:31.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.655+0000 7f1283565640 1 -- 172.21.15.77:0/1776491223 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f127c0c53d0 con 0x7f127c06c1d0 2023-11-04T01:40:31.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.655+0000 7f1271ffb640 1 -- 172.21.15.77:0/1776491223 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1278004a20 con 0x7f127c06c1d0 2023-11-04T01:40:31.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.655+0000 7f1283565640 1 -- 172.21.15.77:0/1776491223 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f127c0ca970 con 0x7f127c06c1d0 2023-11-04T01:40:31.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.656+0000 7f1283565640 1 -- 172.21.15.77:0/1776491223 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f127c0c58f0 con 0x7f127c06c1d0 2023-11-04T01:40:31.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.657+0000 7f1271ffb640 1 -- 172.21.15.77:0/1776491223 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1278004b80 con 0x7f127c06c1d0 2023-11-04T01:40:31.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.657+0000 7f1271ffb640 1 --2- 172.21.15.77:0/1776491223 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f126006aea0 0x7f126006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.657+0000 7f1271ffb640 1 -- 172.21.15.77:0/1776491223 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1278089770 con 0x7f127c06c1d0 2023-11-04T01:40:31.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.657+0000 7f1280b00640 1 --2- 172.21.15.77:0/1776491223 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f126006aea0 0x7f126006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.658+0000 7f1280b00640 1 --2- 172.21.15.77:0/1776491223 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f126006aea0 0x7f126006d360 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f126c036000 tx=0x7f126c008030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:31.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.661+0000 7f1271ffb640 1 -- 172.21.15.77:0/1776491223 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f127c0c58f0 con 0x7f127c06c1d0 2023-11-04T01:40:31.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.825+0000 7f1283565640 1 -- 172.21.15.77:0/1776491223 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f127c0c58f0 con 0x7f127c06c1d0 2023-11-04T01:40:31.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.825+0000 7f1271ffb640 1 -- 172.21.15.77:0/1776491223 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f127c0c58f0 con 0x7f127c06c1d0 2023-11-04T01:40:31.829 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:40:31.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.827+0000 7f1283565640 1 -- 172.21.15.77:0/1776491223 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f126006aea0 msgr2=0x7f126006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.827+0000 7f1283565640 1 --2- 172.21.15.77:0/1776491223 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f126006aea0 0x7f126006d360 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f126c036000 tx=0x7f126c008030 comp rx=0 tx=0).stop 2023-11-04T01:40:31.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.827+0000 7f1283565640 1 -- 172.21.15.77:0/1776491223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f127c06c1d0 msgr2=0x7f127c1525a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.827+0000 7f1283565640 1 --2- 172.21.15.77:0/1776491223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f127c06c1d0 0x7f127c1525a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f127800c430 tx=0x7f127800c8f0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.827+0000 7f1283565640 1 -- 172.21.15.77:0/1776491223 shutdown_connections 2023-11-04T01:40:31.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.827+0000 7f1283565640 1 --2- 172.21.15.77:0/1776491223 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f126006aea0 0x7f126006d360 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.827+0000 7f1283565640 1 --2- 172.21.15.77:0/1776491223 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f127c160430 0x7f127c15ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.827+0000 7f1283565640 1 --2- 172.21.15.77:0/1776491223 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f127c0b2d30 0x7f127c0ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.827+0000 7f1283565640 1 --2- 172.21.15.77:0/1776491223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f127c06c1d0 0x7f127c1525a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.827+0000 7f1283565640 1 -- 172.21.15.77:0/1776491223 >> 172.21.15.77:0/1776491223 conn(0x7f127c06ea20 msgr2=0x7f127c0cc670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:31.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.827+0000 7f1283565640 1 -- 172.21.15.77:0/1776491223 shutdown_connections 2023-11-04T01:40:31.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.827+0000 7f1283565640 1 -- 172.21.15.77:0/1776491223 wait complete. 2023-11-04T01:40:31.840 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:31.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.938+0000 7f919eee0640 1 Processor -- start 2023-11-04T01:40:31.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.938+0000 7f919eee0640 1 -- start start 2023-11-04T01:40:31.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.939+0000 7f919eee0640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f919815ad80 0x7f91980abe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.939+0000 7f919eee0640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f91980c9a40 0x7f91980c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.939+0000 7f919eee0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f919806b720 con 0x7f919806a1b0 2023-11-04T01:40:31.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.939+0000 7f919eee0640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91980ca410 con 0x7f919815ad80 2023-11-04T01:40:31.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.939+0000 7f919eee0640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f919806cf60 con 0x7f91980c9a40 2023-11-04T01:40:31.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.939+0000 7f9197fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f919806a1b0 0x7f919806b010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:60974/0 (socket says 172.21.15.77:60974) 2023-11-04T01:40:31.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.939+0000 7f9197fff640 1 -- 172.21.15.77:0/3951057059 learned_addr learned my addr 172.21.15.77:0/3951057059 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:31.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.939+0000 7f919cc7c640 1 --2- 172.21.15.77:0/3951057059 >> v2:172.21.15.122:3300/0 conn(0x7f919815ad80 0x7f91980abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.939+0000 7f919d47d640 1 --2- 172.21.15.77:0/3951057059 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f91980c9a40 0x7f91980c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.939+0000 7f91977fe640 1 -- 172.21.15.77:0/3951057059 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 770887445 0 0) 0x7f919806b720 con 0x7f919806a1b0 2023-11-04T01:40:31.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.939+0000 7f91977fe640 1 -- 172.21.15.77:0/3951057059 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9180003520 con 0x7f919806a1b0 2023-11-04T01:40:31.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.940+0000 7f91977fe640 1 -- 172.21.15.77:0/3951057059 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1809319914 0 0) 0x7f9180003520 con 0x7f919806a1b0 2023-11-04T01:40:31.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.940+0000 7f91977fe640 1 -- 172.21.15.77:0/3951057059 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f91980c9a40 msgr2=0x7f91980c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:31.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.940+0000 7f91977fe640 1 --2- 172.21.15.77:0/3951057059 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f91980c9a40 0x7f91980c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.940+0000 7f91977fe640 1 -- 172.21.15.77:0/3951057059 >> v2:172.21.15.122:3300/0 conn(0x7f919815ad80 msgr2=0x7f91980abe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:31.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.940+0000 7f91977fe640 1 --2- 172.21.15.77:0/3951057059 >> v2:172.21.15.122:3300/0 conn(0x7f919815ad80 0x7f91980abe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.940+0000 7f91977fe640 1 -- 172.21.15.77:0/3951057059 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91980ac390 con 0x7f919806a1b0 2023-11-04T01:40:31.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.940+0000 7f919cc7c640 1 --2- 172.21.15.77:0/3951057059 >> v2:172.21.15.122:3300/0 conn(0x7f919815ad80 0x7f91980abe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:31.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.940+0000 7f91977fe640 1 -- 172.21.15.77:0/3951057059 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f918c001670 con 0x7f919806a1b0 2023-11-04T01:40:31.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.940+0000 7f91977fe640 1 -- 172.21.15.77:0/3951057059 >> v1:172.21.15.77:6789/0 conn(0x7f919806a1b0 legacy=0x7f919806b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.940+0000 7f91977fe640 1 --2- 172.21.15.77:0/3951057059 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f91980c9a40 0x7f9180003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.940+0000 7f91977fe640 1 --2- 172.21.15.77:0/3951057059 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9180003ef0 0x7f91800047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.940+0000 7f91977fe640 1 --2- 172.21.15.77:0/3951057059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9180004d00 0x7f9180005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.940+0000 7f91977fe640 1 -- 172.21.15.77:0/3951057059 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91980ca410 con 0x7f9180004d00 2023-11-04T01:40:31.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.940+0000 7f91977fe640 1 -- 172.21.15.77:0/3951057059 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919806cf60 con 0x7f9180003ef0 2023-11-04T01:40:31.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.940+0000 7f91977fe640 1 -- 172.21.15.77:0/3951057059 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f918000b980 con 0x7f91980c9a40 2023-11-04T01:40:31.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.940+0000 7f919d47d640 1 --2- 172.21.15.77:0/3951057059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9180004d00 0x7f9180005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.940+0000 7f9197fff640 1 --2- 172.21.15.77:0/3951057059 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9180003ef0 0x7f91800047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.940+0000 7f919cc7c640 1 --2- 172.21.15.77:0/3951057059 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f91980c9a40 0x7f9180003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.940+0000 7f919d47d640 1 -- 172.21.15.77:0/3951057059 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f91980c9a40 msgr2=0x7f9180003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:31.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.940+0000 7f919d47d640 1 --2- 172.21.15.77:0/3951057059 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f91980c9a40 0x7f9180003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.940+0000 7f919d47d640 1 -- 172.21.15.77:0/3951057059 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9180003ef0 msgr2=0x7f91800047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:31.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.940+0000 7f919d47d640 1 --2- 172.21.15.77:0/3951057059 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9180003ef0 0x7f91800047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.940+0000 7f919d47d640 1 -- 172.21.15.77:0/3951057059 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9180003520 con 0x7f9180004d00 2023-11-04T01:40:31.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.941+0000 7f919d47d640 1 --2- 172.21.15.77:0/3951057059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9180004d00 0x7f9180005180 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9190009fc0 tx=0x7f91800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c860d1db7783eb6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:31.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.941+0000 7f91977fe640 1 -- 172.21.15.77:0/3951057059 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919002cc00 con 0x7f9180004d00 2023-11-04T01:40:31.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.941+0000 7f91977fe640 1 -- 172.21.15.77:0/3951057059 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919000f040 con 0x7f9180004d00 2023-11-04T01:40:31.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.941+0000 7f91977fe640 1 -- 172.21.15.77:0/3951057059 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9190034440 con 0x7f9180004d00 2023-11-04T01:40:31.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.941+0000 7f919eee0640 1 -- 172.21.15.77:0/3951057059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9180004d00 msgr2=0x7f9180005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.942+0000 7f919eee0640 1 --2- 172.21.15.77:0/3951057059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9180004d00 0x7f9180005180 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9190009fc0 tx=0x7f91800057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.942+0000 7f919d47d640 1 -- 172.21.15.77:0/3951057059 reap_dead start 2023-11-04T01:40:31.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.942+0000 7f919eee0640 1 -- 172.21.15.77:0/3951057059 shutdown_connections 2023-11-04T01:40:31.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.942+0000 7f919eee0640 1 -- 172.21.15.77:0/3951057059 >> 172.21.15.77:0/3951057059 conn(0x7f91980b0cd0 msgr2=0x7f91980b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:31.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.942+0000 7f919eee0640 1 -- 172.21.15.77:0/3951057059 shutdown_connections 2023-11-04T01:40:31.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.942+0000 7f919eee0640 1 -- 172.21.15.77:0/3951057059 wait complete. 2023-11-04T01:40:31.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.943+0000 7f919eee0640 1 Processor -- start 2023-11-04T01:40:31.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.943+0000 7f919eee0640 1 -- start start 2023-11-04T01:40:31.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.944+0000 7f919eee0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91980c5770 0x7f91980c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.944+0000 7f919eee0640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f91980c5b50 0x7f91980c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.944+0000 7f919eee0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91981f0770 0x7f9198149fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.944+0000 7f919eee0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91980c7690 con 0x7f91981f0770 2023-11-04T01:40:31.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.944+0000 7f919eee0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919814f190 con 0x7f91980c5770 2023-11-04T01:40:31.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.944+0000 7f919eee0640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91980c6e20 con 0x7f91980c5b50 2023-11-04T01:40:31.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.944+0000 7f919d47d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91981f0770 0x7f9198149fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.944+0000 7f919d47d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91981f0770 0x7f9198149fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53264/0 (socket says 172.21.15.77:53264) 2023-11-04T01:40:31.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.944+0000 7f919d47d640 1 -- 172.21.15.77:0/68317540 learned_addr learned my addr 172.21.15.77:0/68317540 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:31.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.944+0000 7f9197fff640 1 --2- 172.21.15.77:0/68317540 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f91980c5b50 0x7f91980c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.944+0000 7f919cc7c640 1 --2- 172.21.15.77:0/68317540 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91980c5770 0x7f91980c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.944+0000 7f919d47d640 1 -- 172.21.15.77:0/68317540 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f91980c5b50 msgr2=0x7f91980c67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.944+0000 7f919d47d640 1 --2- 172.21.15.77:0/68317540 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f91980c5b50 0x7f91980c67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.944+0000 7f919d47d640 1 -- 172.21.15.77:0/68317540 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91980c5770 msgr2=0x7f91980c62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:31.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.944+0000 7f919d47d640 1 --2- 172.21.15.77:0/68317540 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91980c5770 0x7f91980c62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:31.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.944+0000 7f919d47d640 1 -- 172.21.15.77:0/68317540 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91980c7100 con 0x7f91981f0770 2023-11-04T01:40:31.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.944+0000 7f919cc7c640 1 --2- 172.21.15.77:0/68317540 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91980c5770 0x7f91980c62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:31.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.944+0000 7f9197fff640 1 --2- 172.21.15.77:0/68317540 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f91980c5b50 0x7f91980c67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:31.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.944+0000 7f919d47d640 1 --2- 172.21.15.77:0/68317540 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91981f0770 0x7f9198149fa0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9190037040 tx=0x7f9190009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:31.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.944+0000 7f91957fa640 1 -- 172.21.15.77:0/68317540 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9190043070 con 0x7f91981f0770 2023-11-04T01:40:31.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.944+0000 7f91957fa640 1 -- 172.21.15.77:0/68317540 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9190034ad0 con 0x7f91981f0770 2023-11-04T01:40:31.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.944+0000 7f919eee0640 1 -- 172.21.15.77:0/68317540 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91980c78e0 con 0x7f91981f0770 2023-11-04T01:40:31.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.944+0000 7f91957fa640 1 -- 172.21.15.77:0/68317540 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919002cea0 con 0x7f91981f0770 2023-11-04T01:40:31.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.944+0000 7f919eee0640 1 -- 172.21.15.77:0/68317540 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f919814a4e0 con 0x7f91981f0770 2023-11-04T01:40:31.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.945+0000 7f919eee0640 1 -- 172.21.15.77:0/68317540 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91980c7e00 con 0x7f91981f0770 2023-11-04T01:40:31.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.946+0000 7f91957fa640 1 -- 172.21.15.77:0/68317540 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f919003e440 con 0x7f91981f0770 2023-11-04T01:40:31.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.946+0000 7f91957fa640 1 --2- 172.21.15.77:0/68317540 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f918406aea0 0x7f918406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:31.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.946+0000 7f91957fa640 1 -- 172.21.15.77:0/68317540 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f91900ab190 con 0x7f91981f0770 2023-11-04T01:40:31.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.946+0000 7f919cc7c640 1 --2- 172.21.15.77:0/68317540 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f918406aea0 0x7f918406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:31.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.947+0000 7f919cc7c640 1 --2- 172.21.15.77:0/68317540 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f918406aea0 0x7f918406d360 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9188009cc0 tx=0x7f9188008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:31.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:31.950+0000 7f91957fa640 1 -- 172.21.15.77:0/68317540 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f91980c7e00 con 0x7f91981f0770 2023-11-04T01:40:32.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.149+0000 7f919eee0640 1 -- 172.21.15.77:0/68317540 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91980c7e00 con 0x7f91981f0770 2023-11-04T01:40:32.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.150+0000 7f91957fa640 1 -- 172.21.15.77:0/68317540 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f91980c7e00 con 0x7f91981f0770 2023-11-04T01:40:32.152 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:32.152 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/2867268857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2867268857},{"type":"v1","addr":"172.21.15.77:6834","nonce":2867268857}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2709973073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2709973073},{"type":"v1","addr":"172.21.15.77:6835","nonce":2709973073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/396299424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":396299424},{"type":"v1","addr":"172.21.15.122:6837","nonce":396299424}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:40:05.031856+0000","modified":"2023-11-04T01:40:21.906922+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34166},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34166":{"gid":34166,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6836/2444318089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2444318089},{"type":"v1","addr":"172.21.15.122:6836","nonce":2444318089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:40:32.153 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 9 2023-11-04T01:40:32.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.152+0000 7f919eee0640 1 -- 172.21.15.77:0/68317540 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f918406aea0 msgr2=0x7f918406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.152+0000 7f919eee0640 1 --2- 172.21.15.77:0/68317540 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f918406aea0 0x7f918406d360 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9188009cc0 tx=0x7f9188008040 comp rx=0 tx=0).stop 2023-11-04T01:40:32.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.152+0000 7f919eee0640 1 -- 172.21.15.77:0/68317540 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91981f0770 msgr2=0x7f9198149fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.152+0000 7f919eee0640 1 --2- 172.21.15.77:0/68317540 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91981f0770 0x7f9198149fa0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9190037040 tx=0x7f9190009750 comp rx=0 tx=0).stop 2023-11-04T01:40:32.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.152+0000 7f919eee0640 1 -- 172.21.15.77:0/68317540 shutdown_connections 2023-11-04T01:40:32.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.152+0000 7f919eee0640 1 --2- 172.21.15.77:0/68317540 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f918406aea0 0x7f918406d360 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.152+0000 7f919eee0640 1 --2- 172.21.15.77:0/68317540 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91981f0770 0x7f9198149fa0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.152+0000 7f919eee0640 1 --2- 172.21.15.77:0/68317540 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f91980c5b50 0x7f91980c67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.152+0000 7f919eee0640 1 --2- 172.21.15.77:0/68317540 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91980c5770 0x7f91980c62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.152+0000 7f919eee0640 1 -- 172.21.15.77:0/68317540 >> 172.21.15.77:0/68317540 conn(0x7f91980b0cd0 msgr2=0x7f91980ad2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:32.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.152+0000 7f919eee0640 1 -- 172.21.15.77:0/68317540 shutdown_connections 2023-11-04T01:40:32.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.152+0000 7f919eee0640 1 -- 172.21.15.77:0/68317540 wait complete. 2023-11-04T01:40:32.164 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:32.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.263+0000 7fc0f70a2640 1 Processor -- start 2023-11-04T01:40:32.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.263+0000 7fc0f70a2640 1 -- start start 2023-11-04T01:40:32.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.264+0000 7fc0f70a2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc0f015ce70 0x7fc0f006d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.264+0000 7fc0f70a2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc0f015d250 0x7fc0f00c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.264+0000 7fc0f70a2640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0f006a120 con 0x7fc0f00c9d70 2023-11-04T01:40:32.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.264+0000 7fc0f70a2640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0f00cdc10 con 0x7fc0f015d250 2023-11-04T01:40:32.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.264+0000 7fc0f70a2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f006def0 con 0x7fc0f015ce70 2023-11-04T01:40:32.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.264+0000 7fc0effff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc0f015d250 0x7fc0f00c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.264+0000 7fc0f563f640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc0f00c9d70 0x7fc0f00ccdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:60986/0 (socket says 172.21.15.77:60986) 2023-11-04T01:40:32.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.264+0000 7fc0f563f640 1 -- 172.21.15.77:0/4030297852 learned_addr learned my addr 172.21.15.77:0/4030297852 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:32.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.264+0000 7fc0f4e3e640 1 --2- 172.21.15.77:0/4030297852 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc0f015ce70 0x7fc0f006d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.264+0000 7fc0effff640 1 -- 172.21.15.77:0/4030297852 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc0f015ce70 msgr2=0x7fc0f006d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:32.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.264+0000 7fc0effff640 1 --2- 172.21.15.77:0/4030297852 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc0f015ce70 0x7fc0f006d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.264+0000 7fc0effff640 1 -- 172.21.15.77:0/4030297852 >> v1:172.21.15.77:6789/0 conn(0x7fc0f00c9d70 legacy=0x7fc0f00ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.264+0000 7fc0effff640 1 -- 172.21.15.77:0/4030297852 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f006a370 con 0x7fc0f015d250 2023-11-04T01:40:32.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.264+0000 7fc0ef7fe640 1 -- 172.21.15.77:0/4030297852 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1436150425 0 0) 0x7fc0f006a120 con 0x7fc0f00c9d70 2023-11-04T01:40:32.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.265+0000 7fc0effff640 1 --2- 172.21.15.77:0/4030297852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f015d250 0x7fc0f00c9830 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc0e00097a0 tx=0x7fc0e002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4ae161d4fa6438d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:32.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.265+0000 7fc0ef7fe640 1 -- 172.21.15.77:0/4030297852 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e0031830 con 0x7fc0f015d250 2023-11-04T01:40:32.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.265+0000 7fc0ef7fe640 1 -- 172.21.15.77:0/4030297852 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e0031990 con 0x7fc0f015d250 2023-11-04T01:40:32.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.265+0000 7fc0ef7fe640 1 -- 172.21.15.77:0/4030297852 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e0031d20 con 0x7fc0f015d250 2023-11-04T01:40:32.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.266+0000 7fc0f70a2640 1 -- 172.21.15.77:0/4030297852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f015d250 msgr2=0x7fc0f00c9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.266+0000 7fc0f70a2640 1 --2- 172.21.15.77:0/4030297852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f015d250 0x7fc0f00c9830 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc0e00097a0 tx=0x7fc0e002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.266+0000 7fc0f70a2640 1 -- 172.21.15.77:0/4030297852 shutdown_connections 2023-11-04T01:40:32.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.266+0000 7fc0f70a2640 1 --2- 172.21.15.77:0/4030297852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f015d250 0x7fc0f00c9830 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.266+0000 7fc0f70a2640 1 --2- 172.21.15.77:0/4030297852 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc0f015ce70 0x7fc0f006d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.266+0000 7fc0f70a2640 1 -- 172.21.15.77:0/4030297852 >> 172.21.15.77:0/4030297852 conn(0x7fc0f00b0cd0 msgr2=0x7fc0f00b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:32.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.266+0000 7fc0f70a2640 1 -- 172.21.15.77:0/4030297852 shutdown_connections 2023-11-04T01:40:32.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.266+0000 7fc0f70a2640 1 -- 172.21.15.77:0/4030297852 wait complete. 2023-11-04T01:40:32.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.267+0000 7fc0f70a2640 1 Processor -- start 2023-11-04T01:40:32.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.267+0000 7fc0f70a2640 1 -- start start 2023-11-04T01:40:32.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.268+0000 7fc0f70a2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0f015ce70 0x7fc0f0159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.268+0000 7fc0f70a2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc0f015d250 0x7fc0f01e2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.268+0000 7fc0f70a2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f015a4a0 0x7fc0f01e29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.268+0000 7fc0f70a2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f015a320 con 0x7fc0f015a4a0 2023-11-04T01:40:32.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.268+0000 7fc0f70a2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f00b02b0 con 0x7fc0f015ce70 2023-11-04T01:40:32.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.268+0000 7fc0f70a2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f00af9a0 con 0x7fc0f015d250 2023-11-04T01:40:32.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.268+0000 7fc0f563f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f015a4a0 0x7fc0f01e29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.268+0000 7fc0f563f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f015a4a0 0x7fc0f01e29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53286/0 (socket says 172.21.15.77:53286) 2023-11-04T01:40:32.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.268+0000 7fc0f563f640 1 -- 172.21.15.77:0/2056361118 learned_addr learned my addr 172.21.15.77:0/2056361118 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:32.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.268+0000 7fc0effff640 1 --2- 172.21.15.77:0/2056361118 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc0f015d250 0x7fc0f01e2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.268+0000 7fc0f4e3e640 1 --2- 172.21.15.77:0/2056361118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0f015ce70 0x7fc0f0159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.268+0000 7fc0f563f640 1 -- 172.21.15.77:0/2056361118 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc0f015d250 msgr2=0x7fc0f01e2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.268+0000 7fc0f563f640 1 --2- 172.21.15.77:0/2056361118 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc0f015d250 0x7fc0f01e2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.268+0000 7fc0f563f640 1 -- 172.21.15.77:0/2056361118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0f015ce70 msgr2=0x7fc0f0159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.268+0000 7fc0f563f640 1 --2- 172.21.15.77:0/2056361118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0f015ce70 0x7fc0f0159de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.268+0000 7fc0f563f640 1 -- 172.21.15.77:0/2056361118 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e0009400 con 0x7fc0f015a4a0 2023-11-04T01:40:32.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.268+0000 7fc0f563f640 1 --2- 172.21.15.77:0/2056361118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f015a4a0 0x7fc0f01e29c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc0d800c450 tx=0x7fc0d800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:32.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.268+0000 7fc0ed7fa640 1 -- 172.21.15.77:0/2056361118 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d80074e0 con 0x7fc0f015a4a0 2023-11-04T01:40:32.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.269+0000 7fc0ed7fa640 1 -- 172.21.15.77:0/2056361118 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d8007660 con 0x7fc0f015a4a0 2023-11-04T01:40:32.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.269+0000 7fc0f70a2640 1 -- 172.21.15.77:0/2056361118 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f00c6f90 con 0x7fc0f015a4a0 2023-11-04T01:40:32.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.269+0000 7fc0ed7fa640 1 -- 172.21.15.77:0/2056361118 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d8004a20 con 0x7fc0f015a4a0 2023-11-04T01:40:32.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.269+0000 7fc0f70a2640 1 -- 172.21.15.77:0/2056361118 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f00aff40 con 0x7fc0f015a4a0 2023-11-04T01:40:32.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.269+0000 7fc0f70a2640 1 -- 172.21.15.77:0/2056361118 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0f006abf0 con 0x7fc0f015a4a0 2023-11-04T01:40:32.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.270+0000 7fc0ed7fa640 1 -- 172.21.15.77:0/2056361118 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc0d8004b80 con 0x7fc0f015a4a0 2023-11-04T01:40:32.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.270+0000 7fc0ed7fa640 1 --2- 172.21.15.77:0/2056361118 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc0d006aea0 0x7fc0d006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.270+0000 7fc0ed7fa640 1 -- 172.21.15.77:0/2056361118 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc0d8089550 con 0x7fc0f015a4a0 2023-11-04T01:40:32.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.270+0000 7fc0f4e3e640 1 --2- 172.21.15.77:0/2056361118 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc0d006aea0 0x7fc0d006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.271+0000 7fc0f4e3e640 1 --2- 172.21.15.77:0/2056361118 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc0d006aea0 0x7fc0d006d360 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc0e800f510 tx=0x7fc0e80077b0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:32.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.274+0000 7fc0ed7fa640 1 -- 172.21.15.77:0/2056361118 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc0f006abf0 con 0x7fc0f015a4a0 2023-11-04T01:40:32.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.441+0000 7fc0f70a2640 1 -- 172.21.15.77:0/2056361118 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0f006abf0 con 0x7fc0f015a4a0 2023-11-04T01:40:32.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.442+0000 7fc0ed7fa640 1 -- 172.21.15.77:0/2056361118 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18334 (secure 0 0 0) 0x7fc0f006abf0 con 0x7fc0f015a4a0 2023-11-04T01:40:32.444 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:32.444 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":24,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:40:10.153949+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:40:02.810971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:40:04.003979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:40:07.734355+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:32.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.444+0000 7fc0f70a2640 1 -- 172.21.15.77:0/2056361118 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc0d006aea0 msgr2=0x7fc0d006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.444+0000 7fc0f70a2640 1 --2- 172.21.15.77:0/2056361118 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc0d006aea0 0x7fc0d006d360 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc0e800f510 tx=0x7fc0e80077b0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.444+0000 7fc0f70a2640 1 -- 172.21.15.77:0/2056361118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f015a4a0 msgr2=0x7fc0f01e29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.444+0000 7fc0f70a2640 1 --2- 172.21.15.77:0/2056361118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f015a4a0 0x7fc0f01e29c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc0d800c450 tx=0x7fc0d800c910 comp rx=0 tx=0).stop 2023-11-04T01:40:32.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.444+0000 7fc0f70a2640 1 -- 172.21.15.77:0/2056361118 shutdown_connections 2023-11-04T01:40:32.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.444+0000 7fc0f70a2640 1 --2- 172.21.15.77:0/2056361118 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc0d006aea0 0x7fc0d006d360 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.444+0000 7fc0f70a2640 1 --2- 172.21.15.77:0/2056361118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0f015a4a0 0x7fc0f01e29c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.444+0000 7fc0f70a2640 1 --2- 172.21.15.77:0/2056361118 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc0f015d250 0x7fc0f01e2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.444+0000 7fc0f70a2640 1 --2- 172.21.15.77:0/2056361118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0f015ce70 0x7fc0f0159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.444+0000 7fc0f70a2640 1 -- 172.21.15.77:0/2056361118 >> 172.21.15.77:0/2056361118 conn(0x7fc0f00b0cd0 msgr2=0x7fc0f00ccd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:32.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.444+0000 7fc0f70a2640 1 -- 172.21.15.77:0/2056361118 shutdown_connections 2023-11-04T01:40:32.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.444+0000 7fc0f70a2640 1 -- 172.21.15.77:0/2056361118 wait complete. 2023-11-04T01:40:32.457 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:40:32.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.555+0000 7f5005e87640 1 Processor -- start 2023-11-04T01:40:32.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.556+0000 7f5005e87640 1 -- start start 2023-11-04T01:40:32.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.556+0000 7f5005e87640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f50000cde60 0x7f500015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.556+0000 7f5005e87640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f500015daa0 0x7f5000157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.556+0000 7f5005e87640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f50000ce240 0x7f5000157540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.556+0000 7f5005e87640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f500015e5c0 con 0x7f50000ce240 2023-11-04T01:40:32.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.556+0000 7f5005e87640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5000157a80 con 0x7f500015daa0 2023-11-04T01:40:32.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.556+0000 7f5005e87640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f500015e000 con 0x7f50000cde60 2023-11-04T01:40:32.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.556+0000 7f4ffffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f50000ce240 0x7f5000157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.557+0000 7f4ffffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f50000ce240 0x7f5000157540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53290/0 (socket says 172.21.15.77:53290) 2023-11-04T01:40:32.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.557+0000 7f4ffffff640 1 -- 172.21.15.77:0/1690925774 learned_addr learned my addr 172.21.15.77:0/1690925774 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:32.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.557+0000 7f4fff7fe640 1 --2- 172.21.15.77:0/1690925774 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f50000cde60 0x7f500015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.557+0000 7f4ff6ffd640 1 --2- 172.21.15.77:0/1690925774 >> v2:172.21.15.122:3300/0 conn(0x7f500015daa0 0x7f5000157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.557+0000 7f4ffffff640 1 -- 172.21.15.77:0/1690925774 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f50000cde60 msgr2=0x7f500015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:32.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.557+0000 7f4ffffff640 1 --2- 172.21.15.77:0/1690925774 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f50000cde60 0x7f500015d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.557+0000 7f4ffffff640 1 -- 172.21.15.77:0/1690925774 >> v2:172.21.15.122:3300/0 conn(0x7f500015daa0 msgr2=0x7f5000157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:32.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.557+0000 7f4ffffff640 1 --2- 172.21.15.77:0/1690925774 >> v2:172.21.15.122:3300/0 conn(0x7f500015daa0 0x7f5000157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.557+0000 7f4ffffff640 1 -- 172.21.15.77:0/1690925774 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500015e2e0 con 0x7f50000ce240 2023-11-04T01:40:32.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.557+0000 7f4ffffff640 1 --2- 172.21.15.77:0/1690925774 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50000ce240 0x7f5000157540 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f500006c7c0 tx=0x7f4ff802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4703494635734fac server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:32.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.558+0000 7f4ffeffd640 1 -- 172.21.15.77:0/1690925774 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff802ca70 con 0x7f50000ce240 2023-11-04T01:40:32.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.558+0000 7f4ffeffd640 1 -- 172.21.15.77:0/1690925774 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff802cbd0 con 0x7f50000ce240 2023-11-04T01:40:32.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.558+0000 7f4ffeffd640 1 -- 172.21.15.77:0/1690925774 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff80343f0 con 0x7f50000ce240 2023-11-04T01:40:32.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.558+0000 7f5005e87640 1 -- 172.21.15.77:0/1690925774 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50000ce240 msgr2=0x7f5000157540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.558+0000 7f5005e87640 1 --2- 172.21.15.77:0/1690925774 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50000ce240 0x7f5000157540 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f500006c7c0 tx=0x7f4ff802bed0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.558+0000 7f5005e87640 1 -- 172.21.15.77:0/1690925774 shutdown_connections 2023-11-04T01:40:32.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.558+0000 7f5005e87640 1 --2- 172.21.15.77:0/1690925774 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50000ce240 0x7f5000157540 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.558+0000 7f5005e87640 1 --2- 172.21.15.77:0/1690925774 >> v2:172.21.15.122:3300/0 conn(0x7f500015daa0 0x7f5000157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.558+0000 7f5005e87640 1 --2- 172.21.15.77:0/1690925774 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f50000cde60 0x7f500015d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.558+0000 7f5005e87640 1 -- 172.21.15.77:0/1690925774 >> 172.21.15.77:0/1690925774 conn(0x7f5000071f30 msgr2=0x7f50000cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:32.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.558+0000 7f5005e87640 1 -- 172.21.15.77:0/1690925774 shutdown_connections 2023-11-04T01:40:32.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.558+0000 7f5005e87640 1 -- 172.21.15.77:0/1690925774 wait complete. 2023-11-04T01:40:32.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.559+0000 7f5005e87640 1 Processor -- start 2023-11-04T01:40:32.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.560+0000 7f5005e87640 1 -- start start 2023-11-04T01:40:32.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.560+0000 7f5005e87640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f50000cde60 0x7f500015a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.560+0000 7f5005e87640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f50000ce240 0x7f50001f5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.560+0000 7f5005e87640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f500015daa0 0x7f50000cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.560+0000 7f5005e87640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50000c7b90 con 0x7f500015daa0 2023-11-04T01:40:32.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.560+0000 7f5005e87640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50000c7e70 con 0x7f50000ce240 2023-11-04T01:40:32.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.560+0000 7f5005e87640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50000c8150 con 0x7f50000cde60 2023-11-04T01:40:32.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.560+0000 7f4ffffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f500015daa0 0x7f50000cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.560+0000 7f4ffffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f500015daa0 0x7f50000cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53300/0 (socket says 172.21.15.77:53300) 2023-11-04T01:40:32.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.560+0000 7f4ffffff640 1 -- 172.21.15.77:0/1058987182 learned_addr learned my addr 172.21.15.77:0/1058987182 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:32.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.561+0000 7f4ffffff640 1 -- 172.21.15.77:0/1058987182 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f50000cde60 msgr2=0x7f500015a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.561+0000 7f4ffffff640 1 --2- 172.21.15.77:0/1058987182 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f50000cde60 0x7f500015a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.561+0000 7f4ffffff640 1 -- 172.21.15.77:0/1058987182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f50000ce240 msgr2=0x7f50001f5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.561+0000 7f4ffffff640 1 --2- 172.21.15.77:0/1058987182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f50000ce240 0x7f50001f5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.561+0000 7f4ffffff640 1 -- 172.21.15.77:0/1058987182 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff8009b30 con 0x7f500015daa0 2023-11-04T01:40:32.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.561+0000 7f4ffffff640 1 --2- 172.21.15.77:0/1058987182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f500015daa0 0x7f50000cb4e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8009f40 tx=0x7f4ff8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:32.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.561+0000 7f4ffcff9640 1 -- 172.21.15.77:0/1058987182 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff803e450 con 0x7f500015daa0 2023-11-04T01:40:32.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.561+0000 7f4ffcff9640 1 -- 172.21.15.77:0/1058987182 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff803e5b0 con 0x7f500015daa0 2023-11-04T01:40:32.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.561+0000 7f5005e87640 1 -- 172.21.15.77:0/1058987182 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50000c8430 con 0x7f500015daa0 2023-11-04T01:40:32.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.561+0000 7f4ffcff9640 1 -- 172.21.15.77:0/1058987182 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff803e960 con 0x7f500015daa0 2023-11-04T01:40:32.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.561+0000 7f5005e87640 1 -- 172.21.15.77:0/1058987182 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f500015ad60 con 0x7f500015daa0 2023-11-04T01:40:32.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.562+0000 7f5005e87640 1 -- 172.21.15.77:0/1058987182 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50000c88f0 con 0x7f500015daa0 2023-11-04T01:40:32.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.562+0000 7f4ffcff9640 1 -- 172.21.15.77:0/1058987182 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4ff803eac0 con 0x7f500015daa0 2023-11-04T01:40:32.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.563+0000 7f4ffcff9640 1 --2- 172.21.15.77:0/1058987182 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4fe006ae70 0x7f4fe006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:32.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.563+0000 7f4ffcff9640 1 -- 172.21.15.77:0/1058987182 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4ff80ac940 con 0x7f500015daa0 2023-11-04T01:40:32.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.563+0000 7f4fff7fe640 1 --2- 172.21.15.77:0/1058987182 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4fe006ae70 0x7f4fe006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:32.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.563+0000 7f4fff7fe640 1 --2- 172.21.15.77:0/1058987182 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4fe006ae70 0x7f4fe006d330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0006b10 tx=0x7f4ff0008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:32.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.567+0000 7f4ffcff9640 1 -- 172.21.15.77:0/1058987182 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4ff80778b0 con 0x7f500015daa0 2023-11-04T01:40:32.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.770+0000 7f5005e87640 1 -- 172.21.15.77:0/1058987182 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5000074290 con 0x7f500015daa0 2023-11-04T01:40:32.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.771+0000 7f4ffcff9640 1 -- 172.21.15.77:0/1058987182 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f4ff807aed0 con 0x7f500015daa0 2023-11-04T01:40:32.773 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:32.774 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/2867268857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2867268857},{"type":"v1","addr":"172.21.15.77:6834","nonce":2867268857}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2709973073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2709973073},{"type":"v1","addr":"172.21.15.77:6835","nonce":2709973073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/396299424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":396299424},{"type":"v1","addr":"172.21.15.122:6837","nonce":396299424}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:40:05.031856+0000","modified":"2023-11-04T01:40:21.906922+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34166},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34166":{"gid":34166,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6836/2444318089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2444318089},{"type":"v1","addr":"172.21.15.122:6836","nonce":2444318089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:40:32.774 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 9 2023-11-04T01:40:32.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.773+0000 7f5005e87640 1 -- 172.21.15.77:0/1058987182 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4fe006ae70 msgr2=0x7f4fe006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.773+0000 7f5005e87640 1 --2- 172.21.15.77:0/1058987182 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4fe006ae70 0x7f4fe006d330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0006b10 tx=0x7f4ff0008040 comp rx=0 tx=0).stop 2023-11-04T01:40:32.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.773+0000 7f5005e87640 1 -- 172.21.15.77:0/1058987182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f500015daa0 msgr2=0x7f50000cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:32.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.773+0000 7f5005e87640 1 --2- 172.21.15.77:0/1058987182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f500015daa0 0x7f50000cb4e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8009f40 tx=0x7f4ff8004a40 comp rx=0 tx=0).stop 2023-11-04T01:40:32.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.773+0000 7f5005e87640 1 -- 172.21.15.77:0/1058987182 shutdown_connections 2023-11-04T01:40:32.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.773+0000 7f5005e87640 1 --2- 172.21.15.77:0/1058987182 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4fe006ae70 0x7f4fe006d330 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.773+0000 7f5005e87640 1 --2- 172.21.15.77:0/1058987182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f500015daa0 0x7f50000cb4e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.773+0000 7f5005e87640 1 --2- 172.21.15.77:0/1058987182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f50000ce240 0x7f50001f5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.773+0000 7f5005e87640 1 --2- 172.21.15.77:0/1058987182 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f50000cde60 0x7f500015a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:32.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.773+0000 7f5005e87640 1 -- 172.21.15.77:0/1058987182 >> 172.21.15.77:0/1058987182 conn(0x7f5000071f30 msgr2=0x7f50000d1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:32.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.773+0000 7f5005e87640 1 -- 172.21.15.77:0/1058987182 shutdown_connections 2023-11-04T01:40:32.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:32.773+0000 7f5005e87640 1 -- 172.21.15.77:0/1058987182 wait complete. 2023-11-04T01:40:33.188 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:40:05.031856+0000', 'modified': '2023-11-04T01:40:21.906922+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 34166}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_34166': {'gid': 34166, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.122:6836/2444318089', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6834', 'nonce': 2444318089}, {'type': 'v1', 'addr': '172.21.15.122:6836', 'nonce': 2444318089}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:40:33.188 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:40:33.189 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-04T01:40:33.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.289+0000 7fea245d0640 1 Processor -- start 2023-11-04T01:40:33.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.289+0000 7fea245d0640 1 -- start start 2023-11-04T01:40:33.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.290+0000 7fea245d0640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fea1c159c00 0x7fea1c0cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.290+0000 7fea245d0640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fea1c0ae1d0 0x7fea1c0c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.290+0000 7fea245d0640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea1c15aff0 con 0x7fea1c0c48e0 2023-11-04T01:40:33.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.290+0000 7fea245d0640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea1c0c52a0 con 0x7fea1c0ae1d0 2023-11-04T01:40:33.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.290+0000 7fea245d0640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c15a3e0 con 0x7fea1c159c00 2023-11-04T01:40:33.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.290+0000 7fea22b6d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fea1c0ae1d0 0x7fea1c0c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.290+0000 7fea2236c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fea1c159c00 0x7fea1c0cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.290+0000 7fea21b6b640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fea1c0c48e0 0x7fea1c0adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:46822/0 (socket says 172.21.15.77:46822) 2023-11-04T01:40:33.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.290+0000 7fea21b6b640 1 -- 172.21.15.77:0/3475319136 learned_addr learned my addr 172.21.15.77:0/3475319136 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:33.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.291+0000 7fea22b6d640 1 -- 172.21.15.77:0/3475319136 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fea1c159c00 msgr2=0x7fea1c0cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:33.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.291+0000 7fea22b6d640 1 --2- 172.21.15.77:0/3475319136 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fea1c159c00 0x7fea1c0cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.291+0000 7fea22b6d640 1 -- 172.21.15.77:0/3475319136 >> v1:172.21.15.122:6789/0 conn(0x7fea1c0c48e0 legacy=0x7fea1c0adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:33.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.291+0000 7fea22b6d640 1 -- 172.21.15.77:0/3475319136 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1c15a6c0 con 0x7fea1c0ae1d0 2023-11-04T01:40:33.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.291+0000 7fea22b6d640 1 --2- 172.21.15.77:0/3475319136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea1c0ae1d0 0x7fea1c0c4d60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fea140097a0 tx=0x7fea1402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72389eac7d91e0c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:33.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.292+0000 7fea2136a640 1 -- 172.21.15.77:0/3475319136 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea14031830 con 0x7fea1c0ae1d0 2023-11-04T01:40:33.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.292+0000 7fea2136a640 1 -- 172.21.15.77:0/3475319136 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea14031990 con 0x7fea1c0ae1d0 2023-11-04T01:40:33.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.292+0000 7fea2136a640 1 -- 172.21.15.77:0/3475319136 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea14031d20 con 0x7fea1c0ae1d0 2023-11-04T01:40:33.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.292+0000 7fea245d0640 1 -- 172.21.15.77:0/3475319136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea1c0ae1d0 msgr2=0x7fea1c0c4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:33.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.292+0000 7fea245d0640 1 --2- 172.21.15.77:0/3475319136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea1c0ae1d0 0x7fea1c0c4d60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fea140097a0 tx=0x7fea1402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.292+0000 7fea245d0640 1 -- 172.21.15.77:0/3475319136 shutdown_connections 2023-11-04T01:40:33.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.292+0000 7fea245d0640 1 --2- 172.21.15.77:0/3475319136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea1c0ae1d0 0x7fea1c0c4d60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.292+0000 7fea245d0640 1 --2- 172.21.15.77:0/3475319136 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fea1c159c00 0x7fea1c0cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.292+0000 7fea245d0640 1 -- 172.21.15.77:0/3475319136 >> 172.21.15.77:0/3475319136 conn(0x7fea1c0ce950 msgr2=0x7fea1c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:33.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.292+0000 7fea245d0640 1 -- 172.21.15.77:0/3475319136 shutdown_connections 2023-11-04T01:40:33.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.292+0000 7fea245d0640 1 -- 172.21.15.77:0/3475319136 wait complete. 2023-11-04T01:40:33.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.293+0000 7fea245d0640 1 Processor -- start 2023-11-04T01:40:33.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.293+0000 7fea245d0640 1 -- start start 2023-11-04T01:40:33.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.294+0000 7fea245d0640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fea1c0ae1d0 0x7fea1c13e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.294+0000 7fea245d0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea1c0c48e0 0x7fea1c1f41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.294+0000 7fea245d0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea1c159c00 0x7fea1c0c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.294+0000 7fea245d0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c1f1110 con 0x7fea1c159c00 2023-11-04T01:40:33.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.294+0000 7fea245d0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c1f0500 con 0x7fea1c0c48e0 2023-11-04T01:40:33.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.294+0000 7fea245d0640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c1f07e0 con 0x7fea1c0ae1d0 2023-11-04T01:40:33.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.294+0000 7fea22b6d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea1c159c00 0x7fea1c0c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.294+0000 7fea22b6d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea1c159c00 0x7fea1c0c7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53304/0 (socket says 172.21.15.77:53304) 2023-11-04T01:40:33.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.294+0000 7fea22b6d640 1 -- 172.21.15.77:0/855040681 learned_addr learned my addr 172.21.15.77:0/855040681 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:33.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.294+0000 7fea2236c640 1 --2- 172.21.15.77:0/855040681 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fea1c0ae1d0 0x7fea1c13e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.294+0000 7fea21b6b640 1 --2- 172.21.15.77:0/855040681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea1c0c48e0 0x7fea1c1f41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.295+0000 7fea22b6d640 1 -- 172.21.15.77:0/855040681 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fea1c0ae1d0 msgr2=0x7fea1c13e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:33.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.295+0000 7fea22b6d640 1 --2- 172.21.15.77:0/855040681 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fea1c0ae1d0 0x7fea1c13e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.295+0000 7fea22b6d640 1 -- 172.21.15.77:0/855040681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea1c0c48e0 msgr2=0x7fea1c1f41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:33.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.295+0000 7fea22b6d640 1 --2- 172.21.15.77:0/855040681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea1c0c48e0 0x7fea1c1f41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.295+0000 7fea22b6d640 1 -- 172.21.15.77:0/855040681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea14009400 con 0x7fea1c159c00 2023-11-04T01:40:33.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.295+0000 7fea2236c640 1 --2- 172.21.15.77:0/855040681 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fea1c0ae1d0 0x7fea1c13e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:33.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.295+0000 7fea22b6d640 1 --2- 172.21.15.77:0/855040681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea1c159c00 0x7fea1c0c7e60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fea14034040 tx=0x7fea140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:33.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.295+0000 7fea12ffd640 1 -- 172.21.15.77:0/855040681 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1403a830 con 0x7fea1c159c00 2023-11-04T01:40:33.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.295+0000 7fea12ffd640 1 -- 172.21.15.77:0/855040681 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1403a9b0 con 0x7fea1c159c00 2023-11-04T01:40:33.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.295+0000 7fea245d0640 1 -- 172.21.15.77:0/855040681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1c1f0ac0 con 0x7fea1c159c00 2023-11-04T01:40:33.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.295+0000 7fea12ffd640 1 -- 172.21.15.77:0/855040681 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1403ad60 con 0x7fea1c159c00 2023-11-04T01:40:33.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.295+0000 7fea245d0640 1 -- 172.21.15.77:0/855040681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea1c13e780 con 0x7fea1c159c00 2023-11-04T01:40:33.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.296+0000 7fea12ffd640 1 -- 172.21.15.77:0/855040681 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fea1404d450 con 0x7fea1c159c00 2023-11-04T01:40:33.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.297+0000 7fea12ffd640 1 --2- 172.21.15.77:0/855040681 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fea0006ae70 0x7fea0006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.297+0000 7fea12ffd640 1 -- 172.21.15.77:0/855040681 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fea140ab950 con 0x7fea1c159c00 2023-11-04T01:40:33.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.297+0000 7fea2236c640 1 --2- 172.21.15.77:0/855040681 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fea0006ae70 0x7fea0006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.297+0000 7fea2236c640 1 --2- 172.21.15.77:0/855040681 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fea0006ae70 0x7fea0006d330 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fea18007520 tx=0x7fea1800b040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:33.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.298+0000 7fea27165740 1 Processor -- start 2023-11-04T01:40:33.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.298+0000 7fea27165740 1 -- start start 2023-11-04T01:40:33.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.298+0000 7fea27165740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5606f7113850 0x5606f70e6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.298+0000 7fea27165740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606f7113c30 0x5606f71165e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.298+0000 7fea27165740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5606f70e6c90 0x5606f7116b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.298+0000 7fea27165740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606f6ff7740 con 0x5606f7113c30 2023-11-04T01:40:33.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.298+0000 7fea27165740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606f70598d0 con 0x5606f7113850 2023-11-04T01:40:33.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.298+0000 7fea27165740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606f7056fc0 con 0x5606f70e6c90 2023-11-04T01:40:33.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.299+0000 7fea21b6b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606f7113c30 0x5606f71165e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.299+0000 7fea21b6b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606f7113c30 0x5606f71165e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53318/0 (socket says 172.21.15.77:53318) 2023-11-04T01:40:33.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.299+0000 7fea21b6b640 1 -- 172.21.15.77:0/258816923 learned_addr learned my addr 172.21.15.77:0/258816923 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:33.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.299+0000 7fea22b6d640 1 --2- 172.21.15.77:0/258816923 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5606f70e6c90 0x5606f7116b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.299+0000 7fea2236c640 1 --2- 172.21.15.77:0/258816923 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5606f7113850 0x5606f70e6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.299+0000 7fea21b6b640 1 -- 172.21.15.77:0/258816923 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5606f70e6c90 msgr2=0x5606f7116b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:33.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.299+0000 7fea21b6b640 1 --2- 172.21.15.77:0/258816923 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5606f70e6c90 0x5606f7116b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.299+0000 7fea21b6b640 1 -- 172.21.15.77:0/258816923 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5606f7113850 msgr2=0x5606f70e6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:33.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.299+0000 7fea21b6b640 1 --2- 172.21.15.77:0/258816923 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5606f7113850 0x5606f70e6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.299+0000 7fea21b6b640 1 -- 172.21.15.77:0/258816923 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606f7015ca0 con 0x5606f7113c30 2023-11-04T01:40:33.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.299+0000 7fea22b6d640 1 --2- 172.21.15.77:0/258816923 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5606f70e6c90 0x5606f7116b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:33.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.299+0000 7fea2236c640 1 --2- 172.21.15.77:0/258816923 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5606f7113850 0x5606f70e6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:33.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.299+0000 7fea21b6b640 1 --2- 172.21.15.77:0/258816923 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606f7113c30 0x5606f71165e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fea0c0015e0 tx=0x7fea0c001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f86f25b8b073287 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:33.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.299+0000 7fe9fffff640 1 -- 172.21.15.77:0/258816923 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c001cf0 con 0x5606f7113c30 2023-11-04T01:40:33.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.299+0000 7fe9fffff640 1 -- 172.21.15.77:0/258816923 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0c005ac0 con 0x5606f7113c30 2023-11-04T01:40:33.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.299+0000 7fe9fffff640 1 -- 172.21.15.77:0/258816923 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c005e30 con 0x5606f7113c30 2023-11-04T01:40:33.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.300+0000 7fea27165740 1 -- 172.21.15.77:0/258816923 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606f7113c30 msgr2=0x5606f71165e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:33.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.300+0000 7fea27165740 1 --2- 172.21.15.77:0/258816923 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606f7113c30 0x5606f71165e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fea0c0015e0 tx=0x7fea0c001aa0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.300+0000 7fea27165740 1 -- 172.21.15.77:0/258816923 shutdown_connections 2023-11-04T01:40:33.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.300+0000 7fea27165740 1 --2- 172.21.15.77:0/258816923 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5606f70e6c90 0x5606f7116b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.300+0000 7fea27165740 1 --2- 172.21.15.77:0/258816923 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606f7113c30 0x5606f71165e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.300+0000 7fea27165740 1 --2- 172.21.15.77:0/258816923 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5606f7113850 0x5606f70e6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.300+0000 7fea27165740 1 -- 172.21.15.77:0/258816923 >> 172.21.15.77:0/258816923 conn(0x5606f70e8a60 msgr2=0x5606f71315e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:33.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.300+0000 7fea27165740 1 -- 172.21.15.77:0/258816923 shutdown_connections 2023-11-04T01:40:33.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.300+0000 7fea27165740 1 -- 172.21.15.77:0/258816923 wait complete. 2023-11-04T01:40:33.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.300+0000 7fea27165740 1 -- start start 2023-11-04T01:40:33.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.301+0000 7fea27165740 1 Processor -- start 2023-11-04T01:40:33.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.301+0000 7fea27165740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5606f7113850 0x5606f712b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.301+0000 7fea27165740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5606f7113c30 0x5606f7144940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.301+0000 7fea27165740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606f7141320 0x5606f7144e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.301+0000 7fea27165740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606f70528b0 con 0x5606f7141320 2023-11-04T01:40:33.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.301+0000 7fea27165740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606f700cc80 con 0x5606f7113850 2023-11-04T01:40:33.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.301+0000 7fea27165740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606f700c920 con 0x5606f7113c30 2023-11-04T01:40:33.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.301+0000 7fea27165740 10 client.0 _ll_register_callbacks cb 0x5606f6d64ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:40:33.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.302+0000 7fea22b6d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606f7141320 0x5606f7144e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.302+0000 7fea22b6d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606f7141320 0x5606f7144e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53326/0 (socket says 172.21.15.77:53326) 2023-11-04T01:40:33.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.302+0000 7fea22b6d640 1 -- 172.21.15.77:0/4159437220 learned_addr learned my addr 172.21.15.77:0/4159437220 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:33.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.302+0000 7fea2236c640 1 --2- 172.21.15.77:0/4159437220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5606f7113850 0x5606f712b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.302+0000 7fea21b6b640 1 --2- 172.21.15.77:0/4159437220 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5606f7113c30 0x5606f7144940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.302+0000 7fea22b6d640 1 -- 172.21.15.77:0/4159437220 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5606f7113c30 msgr2=0x5606f7144940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:33.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.302+0000 7fea22b6d640 1 --2- 172.21.15.77:0/4159437220 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5606f7113c30 0x5606f7144940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.302+0000 7fea22b6d640 1 -- 172.21.15.77:0/4159437220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5606f7113850 msgr2=0x5606f712b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:33.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.302+0000 7fea22b6d640 1 --2- 172.21.15.77:0/4159437220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5606f7113850 0x5606f712b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.302+0000 7fea22b6d640 1 -- 172.21.15.77:0/4159437220 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea0c00f040 con 0x5606f7141320 2023-11-04T01:40:33.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.302+0000 7fea22b6d640 1 --2- 172.21.15.77:0/4159437220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606f7141320 0x5606f7144e80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fea140a9b90 tx=0x7fea1407ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81a7b510cc2418ce server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:33.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.302+0000 7fe9fd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:40:33.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.302+0000 7fe9fd7fa640 1 -- 172.21.15.77:0/4159437220 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea14095070 con 0x5606f7141320 2023-11-04T01:40:33.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.302+0000 7fe9fd7fa640 1 -- 172.21.15.77:0/4159437220 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fea14082770 con 0x5606f7141320 2023-11-04T01:40:33.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.302+0000 7fea27165740 1 -- 172.21.15.77:0/4159437220 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5606f6ffebf0 con 0x5606f7141320 2023-11-04T01:40:33.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.302+0000 7fe9fd7fa640 1 -- 172.21.15.77:0/4159437220 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea14076b80 con 0x5606f7141320 2023-11-04T01:40:33.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.302+0000 7fea27165740 10 client.4851 fetch_fsmap learned FSMap version 9 2023-11-04T01:40:33.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.302+0000 7fea27165740 1 -- 172.21.15.77:0/4159437220 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x5606f7050f30 con 0x5606f7141320 2023-11-04T01:40:33.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.302+0000 7fe9fd7fa640 1 -- 172.21.15.77:0/4159437220 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5606f6ffebf0 con 0x5606f7141320 2023-11-04T01:40:33.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.302+0000 7fe9fd7fa640 1 -- 172.21.15.77:0/4159437220 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fea1407a6d0 con 0x5606f7141320 2023-11-04T01:40:33.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.302+0000 7fea27165740 10 client.4851 fetch_fsmap finished waiting for FSMap version 9 2023-11-04T01:40:33.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.302+0000 7fea27165740 10 client.4851 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:40:33.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.303+0000 7fea27165740 20 client.4851 populate_metadata read hostname 'smithi077' 2023-11-04T01:40:33.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.303+0000 7fea27165740 1 --2- 172.21.15.77:0/4159437220 >> [v2:172.21.15.122:6834/2444318089,v1:172.21.15.122:6836/2444318089] conn(0x5606f7107690 0x5606f7107a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.303+0000 7fea27165740 4 client.4851 mds_command: new command op to 34166 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:40:33.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.303+0000 7fea27165740 1 -- 172.21.15.77:0/4159437220 --> [v2:172.21.15.122:6834/2444318089,v1:172.21.15.122:6836/2444318089] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5606f704b890 con 0x5606f7107690 2023-11-04T01:40:33.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.303+0000 7fea2236c640 1 --2- 172.21.15.77:0/4159437220 >> [v2:172.21.15.122:6834/2444318089,v1:172.21.15.122:6836/2444318089] conn(0x5606f7107690 0x5606f7107a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.303+0000 7fe9fd7fa640 10 client.4851 ms_handle_connect on v2:172.21.15.122:6834/2444318089 2023-11-04T01:40:33.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.303+0000 7fea2236c640 1 --2- 172.21.15.77:0/4159437220 >> [v2:172.21.15.122:6834/2444318089,v1:172.21.15.122:6836/2444318089] conn(0x5606f7107690 0x5606f7107a70 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b62bb73a07686cd1 server_cookie=bf40eaa580d955b5 in_seq=0 out_seq=0 2023-11-04T01:40:33.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.304+0000 7fe9fd7fa640 1 -- 172.21.15.77:0/4159437220 <== mds.0 v2:172.21.15.122:6834/2444318089 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5606f704b890 con 0x5606f7107690 2023-11-04T01:40:33.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.304+0000 7fe9fd7fa640 10 client.4851 handle_command_reply: tid=0 2023-11-04T01:40:33.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.304+0000 7fea27165740 1 client.4851 shutdown 2023-11-04T01:40:33.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.304+0000 7fea27165740 1 -- 172.21.15.77:0/4159437220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606f7141320 msgr2=0x5606f7144e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:33.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.304+0000 7fea27165740 1 --2- 172.21.15.77:0/4159437220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606f7141320 0x5606f7144e80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fea140a9b90 tx=0x7fea1407ab70 comp rx=0 tx=0).stop 2023-11-04T01:40:33.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.304+0000 7fea27165740 1 -- 172.21.15.77:0/4159437220 shutdown_connections 2023-11-04T01:40:33.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.304+0000 7fea27165740 1 --2- 172.21.15.77:0/4159437220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606f7141320 0x5606f7144e80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.304+0000 7fea27165740 1 --2- 172.21.15.77:0/4159437220 >> [v2:172.21.15.122:6834/2444318089,v1:172.21.15.122:6836/2444318089] conn(0x5606f7107690 0x5606f7107a70 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.304+0000 7fea27165740 1 --2- 172.21.15.77:0/4159437220 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5606f7113c30 0x5606f7144940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.304+0000 7fea27165740 1 --2- 172.21.15.77:0/4159437220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5606f7113850 0x5606f712b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.304+0000 7fe9fd7fa640 0 client.4851 ms_handle_reset on v2:172.21.15.122:6834/2444318089 2023-11-04T01:40:33.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.304+0000 7fea27165740 1 -- 172.21.15.77:0/4159437220 >> 172.21.15.77:0/4159437220 conn(0x5606f70e6c90 msgr2=0x5606f70ea6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:33.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.304+0000 7fea27165740 1 -- 172.21.15.77:0/4159437220 shutdown_connections 2023-11-04T01:40:33.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.304+0000 7fea27165740 1 -- 172.21.15.77:0/4159437220 wait complete. 2023-11-04T01:40:33.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.304+0000 7fea27165740 20 client.4851 trim_cache size 0 max 16384 2023-11-04T01:40:33.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.320+0000 7fea27165740 1 Processor -- start 2023-11-04T01:40:33.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.320+0000 7fea27165740 1 -- start start 2023-11-04T01:40:33.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.320+0000 7fea27165740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5606f7113850 0x5606f70edab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.320+0000 7fea27165740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5606f7113c30 0x5606f7116770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.320+0000 7fea27165740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606f7141320 0x5606f71197d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.320+0000 7fea27165740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606f6fd2280 con 0x5606f7141320 2023-11-04T01:40:33.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.320+0000 7fea27165740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606f70eb330 con 0x5606f7113850 2023-11-04T01:40:33.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.320+0000 7fea27165740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606f70e5f00 con 0x5606f7113c30 2023-11-04T01:40:33.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.320+0000 7fea22b6d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606f7141320 0x5606f71197d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.320+0000 7fea22b6d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606f7141320 0x5606f71197d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53338/0 (socket says 172.21.15.77:53338) 2023-11-04T01:40:33.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.320+0000 7fea22b6d640 1 -- 172.21.15.77:0/3604397005 learned_addr learned my addr 172.21.15.77:0/3604397005 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:33.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.321+0000 7fea2236c640 1 --2- 172.21.15.77:0/3604397005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5606f7113850 0x5606f70edab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.321+0000 7fea22b6d640 1 -- 172.21.15.77:0/3604397005 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5606f7113c30 msgr2=0x5606f7116770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:33.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.321+0000 7fea22b6d640 1 --2- 172.21.15.77:0/3604397005 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5606f7113c30 0x5606f7116770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.321+0000 7fea22b6d640 1 -- 172.21.15.77:0/3604397005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5606f7113850 msgr2=0x5606f70edab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:33.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.321+0000 7fea22b6d640 1 --2- 172.21.15.77:0/3604397005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5606f7113850 0x5606f70edab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.321+0000 7fea22b6d640 1 -- 172.21.15.77:0/3604397005 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606f6feed10 con 0x5606f7141320 2023-11-04T01:40:33.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.321+0000 7fea2236c640 1 --2- 172.21.15.77:0/3604397005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5606f7113850 0x5606f70edab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:33.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.321+0000 7fea22b6d640 1 --2- 172.21.15.77:0/3604397005 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606f7141320 0x5606f71197d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fea14076970 tx=0x7fea1407d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e445d491b7f9a2d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:33.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.321+0000 7fea10ff9640 1 -- 172.21.15.77:0/3604397005 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea14095070 con 0x5606f7141320 2023-11-04T01:40:33.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.321+0000 7fea10ff9640 1 -- 172.21.15.77:0/3604397005 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea14082770 con 0x5606f7141320 2023-11-04T01:40:33.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.321+0000 7fea10ff9640 1 -- 172.21.15.77:0/3604397005 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea140799b0 con 0x5606f7141320 2023-11-04T01:40:33.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.321+0000 7fea27165740 1 -- 172.21.15.77:0/3604397005 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606f7141320 msgr2=0x5606f71197d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:33.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.321+0000 7fea27165740 1 --2- 172.21.15.77:0/3604397005 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606f7141320 0x5606f71197d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fea14076970 tx=0x7fea1407d000 comp rx=0 tx=0).stop 2023-11-04T01:40:33.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.321+0000 7fea27165740 1 -- 172.21.15.77:0/3604397005 shutdown_connections 2023-11-04T01:40:33.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.321+0000 7fea27165740 1 --2- 172.21.15.77:0/3604397005 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606f7141320 0x5606f71197d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.322+0000 7fea27165740 1 --2- 172.21.15.77:0/3604397005 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5606f7113c30 0x5606f7116770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.322+0000 7fea27165740 1 --2- 172.21.15.77:0/3604397005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5606f7113850 0x5606f70edab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.322+0000 7fea27165740 1 -- 172.21.15.77:0/3604397005 >> 172.21.15.77:0/3604397005 conn(0x5606f70e6c90 msgr2=0x5606f70ea6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:33.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.322+0000 7fea27165740 1 -- 172.21.15.77:0/3604397005 shutdown_connections 2023-11-04T01:40:33.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.322+0000 7fea27165740 1 -- 172.21.15.77:0/3604397005 wait complete. 2023-11-04T01:40:33.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.322+0000 7fea27165740 1 -- start start 2023-11-04T01:40:33.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.322+0000 7fea27165740 1 Processor -- start 2023-11-04T01:40:33.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.323+0000 7fea27165740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5606f7113850 0x5606f719fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.323+0000 7fea27165740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606f7113c30 0x5606f7112640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.323+0000 7fea27165740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5606f7141320 0x5606f71a0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.323+0000 7fea27165740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606f715ddc0 con 0x5606f7113c30 2023-11-04T01:40:33.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.323+0000 7fea27165740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606f7106c20 con 0x5606f7113850 2023-11-04T01:40:33.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.323+0000 7fea27165740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606f71a1bd0 con 0x5606f7141320 2023-11-04T01:40:33.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.323+0000 7fea27165740 10 client.0 _ll_register_callbacks cb 0x7fea0c007f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:40:33.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.323+0000 7fea21b6b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606f7113c30 0x5606f7112640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.323+0000 7fea21b6b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606f7113c30 0x5606f7112640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53346/0 (socket says 172.21.15.77:53346) 2023-11-04T01:40:33.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.323+0000 7fea21b6b640 1 -- 172.21.15.77:0/1654909195 learned_addr learned my addr 172.21.15.77:0/1654909195 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:33.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.323+0000 7fea2236c640 1 --2- 172.21.15.77:0/1654909195 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5606f7113850 0x5606f719fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.323+0000 7fea22b6d640 1 --2- 172.21.15.77:0/1654909195 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5606f7141320 0x5606f71a0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.323+0000 7fea21b6b640 1 -- 172.21.15.77:0/1654909195 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5606f7141320 msgr2=0x5606f71a0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:33.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.323+0000 7fea21b6b640 1 --2- 172.21.15.77:0/1654909195 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5606f7141320 0x5606f71a0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.323+0000 7fea21b6b640 1 -- 172.21.15.77:0/1654909195 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5606f7113850 msgr2=0x5606f719fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:33.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.323+0000 7fea21b6b640 1 --2- 172.21.15.77:0/1654909195 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5606f7113850 0x5606f719fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.323+0000 7fea21b6b640 1 -- 172.21.15.77:0/1654909195 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5606f7050f30 con 0x5606f7113c30 2023-11-04T01:40:33.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.324+0000 7fea21b6b640 1 --2- 172.21.15.77:0/1654909195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606f7113c30 0x5606f7112640 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fea0c017040 tx=0x7fea0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8de2ed1722edaabb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:33.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.324+0000 7fe9fd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:40:33.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.324+0000 7fe9fd7fa640 1 -- 172.21.15.77:0/1654909195 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c0072e0 con 0x5606f7113c30 2023-11-04T01:40:33.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.324+0000 7fe9fd7fa640 1 -- 172.21.15.77:0/1654909195 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fea0c007440 con 0x5606f7113c30 2023-11-04T01:40:33.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.324+0000 7fea27165740 1 -- 172.21.15.77:0/1654909195 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fea0c005ac0 con 0x5606f7113c30 2023-11-04T01:40:33.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.324+0000 7fe9fd7fa640 1 -- 172.21.15.77:0/1654909195 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea0c007600 con 0x5606f7113c30 2023-11-04T01:40:33.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.324+0000 7fea27165740 10 client.4857 fetch_fsmap learned FSMap version 9 2023-11-04T01:40:33.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.324+0000 7fea27165740 1 -- 172.21.15.77:0/1654909195 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x5606f7014500 con 0x5606f7113c30 2023-11-04T01:40:33.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.324+0000 7fe9fd7fa640 1 -- 172.21.15.77:0/1654909195 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0c005ac0 con 0x5606f7113c30 2023-11-04T01:40:33.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.324+0000 7fe9fd7fa640 1 -- 172.21.15.77:0/1654909195 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fea0c00e740 con 0x5606f7113c30 2023-11-04T01:40:33.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.324+0000 7fea27165740 10 client.4857 fetch_fsmap finished waiting for FSMap version 9 2023-11-04T01:40:33.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.324+0000 7fea27165740 10 client.4857 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:40:33.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.324+0000 7fea27165740 20 client.4857 populate_metadata read hostname 'smithi077' 2023-11-04T01:40:33.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.324+0000 7fea27165740 1 --2- 172.21.15.77:0/1654909195 >> [v2:172.21.15.122:6834/2444318089,v1:172.21.15.122:6836/2444318089] conn(0x5606f7126f70 0x5606f7127350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.324+0000 7fea27165740 4 client.4857 mds_command: new command op to 34166 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:40:33.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.324+0000 7fea27165740 1 -- 172.21.15.77:0/1654909195 --> [v2:172.21.15.122:6834/2444318089,v1:172.21.15.122:6836/2444318089] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5606f704b5b0 con 0x5606f7126f70 2023-11-04T01:40:33.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.324+0000 7fea2236c640 1 --2- 172.21.15.77:0/1654909195 >> [v2:172.21.15.122:6834/2444318089,v1:172.21.15.122:6836/2444318089] conn(0x5606f7126f70 0x5606f7127350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.325+0000 7fe9fd7fa640 10 client.4857 ms_handle_connect on v2:172.21.15.122:6834/2444318089 2023-11-04T01:40:33.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.325+0000 7fea2236c640 1 --2- 172.21.15.77:0/1654909195 >> [v2:172.21.15.122:6834/2444318089,v1:172.21.15.122:6836/2444318089] conn(0x5606f7126f70 0x5606f7127350 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c78945eaec78d418 server_cookie=9b5e6cbbbaf20d42 in_seq=0 out_seq=0 2023-11-04T01:40:33.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.325+0000 7fe9fd7fa640 1 -- 172.21.15.77:0/1654909195 <== mds.0 v2:172.21.15.122:6834/2444318089 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5606f704b5b0 con 0x5606f7126f70 2023-11-04T01:40:33.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.325+0000 7fe9fd7fa640 10 client.4857 handle_command_reply: tid=0 2023-11-04T01:40:33.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.325+0000 7fea27165740 1 client.4857 shutdown 2023-11-04T01:40:33.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.325+0000 7fea27165740 1 -- 172.21.15.77:0/1654909195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606f7113c30 msgr2=0x5606f7112640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:33.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.325+0000 7fea27165740 1 --2- 172.21.15.77:0/1654909195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606f7113c30 0x5606f7112640 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fea0c017040 tx=0x7fea0c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.325+0000 7fea27165740 1 -- 172.21.15.77:0/1654909195 shutdown_connections 2023-11-04T01:40:33.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.325+0000 7fea27165740 1 --2- 172.21.15.77:0/1654909195 >> [v2:172.21.15.122:6834/2444318089,v1:172.21.15.122:6836/2444318089] conn(0x5606f7126f70 0x5606f7127350 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.325+0000 7fea27165740 1 --2- 172.21.15.77:0/1654909195 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5606f7141320 0x5606f71a0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.325+0000 7fe9fd7fa640 0 client.4857 ms_handle_reset on v2:172.21.15.122:6834/2444318089 2023-11-04T01:40:33.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.325+0000 7fea27165740 1 --2- 172.21.15.77:0/1654909195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5606f7113c30 0x5606f7112640 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.325+0000 7fea27165740 1 --2- 172.21.15.77:0/1654909195 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5606f7113850 0x5606f719fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.325+0000 7fea27165740 1 -- 172.21.15.77:0/1654909195 >> 172.21.15.77:0/1654909195 conn(0x5606f70e6c90 msgr2=0x5606f71197d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:33.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.325+0000 7fea27165740 1 -- 172.21.15.77:0/1654909195 shutdown_connections 2023-11-04T01:40:33.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.325+0000 7fea27165740 1 -- 172.21.15.77:0/1654909195 wait complete. 2023-11-04T01:40:33.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.325+0000 7fea27165740 20 client.4857 trim_cache size 0 max 16384 2023-11-04T01:40:33.354 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-04T01:40:33.354 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "0c22c75d-0169-41ef-b663-6ac1c5b0f71f", 2023-11-04T01:40:33.354 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 0, 2023-11-04T01:40:33.354 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 34166, 2023-11-04T01:40:33.355 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2023-11-04T01:40:33.355 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2023-11-04T01:40:33.355 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2023-11-04T01:40:33.355 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 27.631056752999999, 2023-11-04T01:40:33.355 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 9, 2023-11-04T01:40:33.355 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 24, 2023-11-04T01:40:33.356 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 24, 2023-11-04T01:40:33.356 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 34.858841589999997 2023-11-04T01:40:33.356 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-04T01:40:33.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.326+0000 7fea245d0640 1 -- 172.21.15.77:0/855040681 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fea0006ae70 msgr2=0x7fea0006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:33.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.326+0000 7fea245d0640 1 --2- 172.21.15.77:0/855040681 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fea0006ae70 0x7fea0006d330 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fea18007520 tx=0x7fea1800b040 comp rx=0 tx=0).stop 2023-11-04T01:40:33.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.326+0000 7fea245d0640 1 -- 172.21.15.77:0/855040681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea1c159c00 msgr2=0x7fea1c0c7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:33.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.326+0000 7fea245d0640 1 --2- 172.21.15.77:0/855040681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea1c159c00 0x7fea1c0c7e60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fea14034040 tx=0x7fea140046c0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.326+0000 7fea245d0640 1 -- 172.21.15.77:0/855040681 shutdown_connections 2023-11-04T01:40:33.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.326+0000 7fea245d0640 1 --2- 172.21.15.77:0/855040681 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fea0006ae70 0x7fea0006d330 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.326+0000 7fea245d0640 1 --2- 172.21.15.77:0/855040681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea1c159c00 0x7fea1c0c7e60 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.326+0000 7fea245d0640 1 --2- 172.21.15.77:0/855040681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fea1c0c48e0 0x7fea1c1f41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.326+0000 7fea245d0640 1 --2- 172.21.15.77:0/855040681 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fea1c0ae1d0 0x7fea1c13e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.326+0000 7fea245d0640 1 -- 172.21.15.77:0/855040681 >> 172.21.15.77:0/855040681 conn(0x7fea1c0ce950 msgr2=0x7fea1c06dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:33.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.326+0000 7fea245d0640 1 -- 172.21.15.77:0/855040681 shutdown_connections 2023-11-04T01:40:33.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.326+0000 7fea245d0640 1 -- 172.21.15.77:0/855040681 wait complete. 2023-11-04T01:40:33.360 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-11-04T01:40:33.372 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-11-04T01:40:33.372 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-04T01:40:33.372 INFO:tasks.ceph_fuse:client.0 config is {} 2023-11-04T01:40:33.373 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-04T01:40:33.373 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:40:33.373 INFO:tasks.ceph_fuse:client.2 config is {} 2023-11-04T01:40:33.373 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-04T01:40:33.374 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-04T01:40:33.374 INFO:tasks.ceph_fuse:client.1 config is {} 2023-11-04T01:40:33.374 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-04T01:40:33.374 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-04T01:40:33.375 INFO:tasks.ceph_fuse:client.3 config is {} 2023-11-04T01:40:33.375 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-04T01:40:33.375 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-04T01:40:33.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:33.376 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2023-11-04T01:40:33.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-11-04T01:40:33.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:33.392 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-04T01:40:33.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:33.458 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link delete ceph-brx 2023-11-04T01:40:33.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:33.559 DEBUG:teuthology.orchestra.run.smithi122:> ip netns list 2023-11-04T01:40:33.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:33.578 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link delete ceph-brx 2023-11-04T01:40:33.652 INFO:teuthology.orchestra.run.smithi122.stderr:Cannot find device "ceph-brx" 2023-11-04T01:40:33.653 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:40:33.654 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-11-04T01:40:33.654 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:40:33.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.755+0000 7f8b62075640 1 Processor -- start 2023-11-04T01:40:33.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.755+0000 7f8b62075640 1 -- start start 2023-11-04T01:40:33.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.756+0000 7f8b62075640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b5c0b0ae0 0x7f8b5c0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.756+0000 7f8b62075640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b5c0b4110 con 0x7f8b5c159c70 2023-11-04T01:40:33.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.756+0000 7f8b62075640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b5c0b43f0 con 0x7f8b5c06db20 2023-11-04T01:40:33.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.756+0000 7f8b62075640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c0b49b0 con 0x7f8b5c0b0ae0 2023-11-04T01:40:33.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.756+0000 7f8b5b7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f8b5c159c70 0x7f8b5c0b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:60990/0 (socket says 172.21.15.77:60990) 2023-11-04T01:40:33.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.756+0000 7f8b5b7fe640 1 -- 172.21.15.77:0/885079158 learned_addr learned my addr 172.21.15.77:0/885079158 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:33.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.756+0000 7f8b5affd640 1 --2- 172.21.15.77:0/885079158 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b5c0b0ae0 0x7f8b5c0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.756+0000 7f8b5a7fc640 1 -- 172.21.15.77:0/885079158 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 619245382 0 0) 0x7f8b5c0b4110 con 0x7f8b5c159c70 2023-11-04T01:40:33.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.756+0000 7f8b5a7fc640 1 -- 172.21.15.77:0/885079158 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b44003520 con 0x7f8b5c159c70 2023-11-04T01:40:33.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.756+0000 7f8b5a7fc640 1 -- 172.21.15.77:0/885079158 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3074531026 0 0) 0x7f8b5c0b43f0 con 0x7f8b5c06db20 2023-11-04T01:40:33.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.756+0000 7f8b5a7fc640 1 -- 172.21.15.77:0/885079158 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b5c0b4110 con 0x7f8b5c06db20 2023-11-04T01:40:33.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.756+0000 7f8b5affd640 1 -- 172.21.15.77:0/885079158 >> v1:172.21.15.122:6789/0 conn(0x7f8b5c06db20 legacy=0x7f8b5c15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:33.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.756+0000 7f8b5affd640 1 -- 172.21.15.77:0/885079158 >> v1:172.21.15.77:6789/0 conn(0x7f8b5c159c70 legacy=0x7f8b5c0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:33.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.756+0000 7f8b5affd640 1 -- 172.21.15.77:0/885079158 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b5c0b46d0 con 0x7f8b5c0b0ae0 2023-11-04T01:40:33.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.757+0000 7f8b5affd640 1 --2- 172.21.15.77:0/885079158 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b5c0b0ae0 0x7f8b5c0ce370 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c0097d0 tx=0x7f8b4c02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f242b32a2910e58 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:33.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.757+0000 7f8b5a7fc640 1 -- 172.21.15.77:0/885079158 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c031890 con 0x7f8b5c0b0ae0 2023-11-04T01:40:33.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.757+0000 7f8b5a7fc640 1 -- 172.21.15.77:0/885079158 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4c0319f0 con 0x7f8b5c0b0ae0 2023-11-04T01:40:33.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.757+0000 7f8b5a7fc640 1 -- 172.21.15.77:0/885079158 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c031d60 con 0x7f8b5c0b0ae0 2023-11-04T01:40:33.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.758+0000 7f8b62075640 1 -- 172.21.15.77:0/885079158 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b5c0b0ae0 msgr2=0x7f8b5c0ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:33.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.758+0000 7f8b62075640 1 --2- 172.21.15.77:0/885079158 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b5c0b0ae0 0x7f8b5c0ce370 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c0097d0 tx=0x7f8b4c02b930 comp rx=0 tx=0).stop 2023-11-04T01:40:33.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.758+0000 7f8b62075640 1 -- 172.21.15.77:0/885079158 shutdown_connections 2023-11-04T01:40:33.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.758+0000 7f8b62075640 1 --2- 172.21.15.77:0/885079158 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b5c0b0ae0 0x7f8b5c0ce370 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.758+0000 7f8b62075640 1 -- 172.21.15.77:0/885079158 >> 172.21.15.77:0/885079158 conn(0x7f8b5c0ce950 msgr2=0x7f8b5c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:33.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.758+0000 7f8b62075640 1 -- 172.21.15.77:0/885079158 shutdown_connections 2023-11-04T01:40:33.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.758+0000 7f8b62075640 1 -- 172.21.15.77:0/885079158 wait complete. 2023-11-04T01:40:33.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.759+0000 7f8b62075640 1 Processor -- start 2023-11-04T01:40:33.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.759+0000 7f8b62075640 1 -- start start 2023-11-04T01:40:33.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.760+0000 7f8b62075640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b5c06db20 0x7f8b5c0a89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.760+0000 7f8b62075640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b5c0b0ae0 0x7f8b5c0c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.760+0000 7f8b62075640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b5c159c70 0x7f8b5c1f1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.760+0000 7f8b62075640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c0c7440 con 0x7f8b5c0b0ae0 2023-11-04T01:40:33.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.760+0000 7f8b62075640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c0c67c0 con 0x7f8b5c06db20 2023-11-04T01:40:33.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.760+0000 7f8b62075640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c0c6aa0 con 0x7f8b5c159c70 2023-11-04T01:40:33.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.760+0000 7f8b5affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b5c0b0ae0 0x7f8b5c0c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.760+0000 7f8b5affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b5c0b0ae0 0x7f8b5c0c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53354/0 (socket says 172.21.15.77:53354) 2023-11-04T01:40:33.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.760+0000 7f8b5affd640 1 -- 172.21.15.77:0/127692526 learned_addr learned my addr 172.21.15.77:0/127692526 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:33.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.760+0000 7f8b5b7fe640 1 --2- 172.21.15.77:0/127692526 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b5c06db20 0x7f8b5c0a89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.760+0000 7f8b5bfff640 1 --2- 172.21.15.77:0/127692526 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b5c159c70 0x7f8b5c1f1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.760+0000 7f8b5affd640 1 -- 172.21.15.77:0/127692526 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b5c159c70 msgr2=0x7f8b5c1f1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:33.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.760+0000 7f8b5affd640 1 --2- 172.21.15.77:0/127692526 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b5c159c70 0x7f8b5c1f1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.760+0000 7f8b5affd640 1 -- 172.21.15.77:0/127692526 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b5c06db20 msgr2=0x7f8b5c0a89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:33.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.760+0000 7f8b5affd640 1 --2- 172.21.15.77:0/127692526 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b5c06db20 0x7f8b5c0a89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.760+0000 7f8b5affd640 1 -- 172.21.15.77:0/127692526 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4c009400 con 0x7f8b5c0b0ae0 2023-11-04T01:40:33.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.760+0000 7f8b5affd640 1 --2- 172.21.15.77:0/127692526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b5c0b0ae0 0x7f8b5c0c7cf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c000c00 tx=0x7f8b4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:33.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.761+0000 7f8b43fff640 1 -- 172.21.15.77:0/127692526 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c03bbf0 con 0x7f8b5c0b0ae0 2023-11-04T01:40:33.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.761+0000 7f8b43fff640 1 -- 172.21.15.77:0/127692526 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4c03bd50 con 0x7f8b5c0b0ae0 2023-11-04T01:40:33.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.761+0000 7f8b62075640 1 -- 172.21.15.77:0/127692526 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b5c0c6d80 con 0x7f8b5c0b0ae0 2023-11-04T01:40:33.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.761+0000 7f8b43fff640 1 -- 172.21.15.77:0/127692526 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c045630 con 0x7f8b5c0b0ae0 2023-11-04T01:40:33.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.761+0000 7f8b62075640 1 -- 172.21.15.77:0/127692526 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b5c0c63a0 con 0x7f8b5c0b0ae0 2023-11-04T01:40:33.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.762+0000 7f8b62075640 1 -- 172.21.15.77:0/127692526 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b5c0c6590 con 0x7f8b5c0b0ae0 2023-11-04T01:40:33.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.762+0000 7f8b43fff640 1 -- 172.21.15.77:0/127692526 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8b4c04e430 con 0x7f8b5c0b0ae0 2023-11-04T01:40:33.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.762+0000 7f8b43fff640 1 --2- 172.21.15.77:0/127692526 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8b4806aea0 0x7f8b4806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:33.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.762+0000 7f8b43fff640 1 -- 172.21.15.77:0/127692526 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8b4c0abe60 con 0x7f8b5c0b0ae0 2023-11-04T01:40:33.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.763+0000 7f8b5b7fe640 1 --2- 172.21.15.77:0/127692526 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8b4806aea0 0x7f8b4806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:33.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.763+0000 7f8b5b7fe640 1 --2- 172.21.15.77:0/127692526 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8b4806aea0 0x7f8b4806d360 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8b50000f60 tx=0x7f8b50007d70 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:33.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.766+0000 7f8b43fff640 1 -- 172.21.15.77:0/127692526 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8b4c076bc0 con 0x7f8b5c0b0ae0 2023-11-04T01:40:33.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.970+0000 7f8b62075640 1 -- 172.21.15.77:0/127692526 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8b5c074290 con 0x7f8b5c0b0ae0 2023-11-04T01:40:33.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.971+0000 7f8b43fff640 1 -- 172.21.15.77:0/127692526 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f8b4c07a1e0 con 0x7f8b5c0b0ae0 2023-11-04T01:40:33.973 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-04T01:40:33.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.973+0000 7f8b62075640 1 -- 172.21.15.77:0/127692526 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8b4806aea0 msgr2=0x7f8b4806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:33.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.973+0000 7f8b62075640 1 --2- 172.21.15.77:0/127692526 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8b4806aea0 0x7f8b4806d360 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8b50000f60 tx=0x7f8b50007d70 comp rx=0 tx=0).stop 2023-11-04T01:40:33.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.973+0000 7f8b62075640 1 -- 172.21.15.77:0/127692526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b5c0b0ae0 msgr2=0x7f8b5c0c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:33.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.973+0000 7f8b62075640 1 --2- 172.21.15.77:0/127692526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b5c0b0ae0 0x7f8b5c0c7cf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c000c00 tx=0x7f8b4c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.973+0000 7f8b62075640 1 -- 172.21.15.77:0/127692526 shutdown_connections 2023-11-04T01:40:33.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.973+0000 7f8b62075640 1 --2- 172.21.15.77:0/127692526 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8b4806aea0 0x7f8b4806d360 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.973+0000 7f8b62075640 1 --2- 172.21.15.77:0/127692526 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b5c159c70 0x7f8b5c1f1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.973+0000 7f8b62075640 1 --2- 172.21.15.77:0/127692526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b5c0b0ae0 0x7f8b5c0c7cf0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.973+0000 7f8b62075640 1 --2- 172.21.15.77:0/127692526 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b5c06db20 0x7f8b5c0a89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:33.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.973+0000 7f8b62075640 1 -- 172.21.15.77:0/127692526 >> 172.21.15.77:0/127692526 conn(0x7f8b5c0ce950 msgr2=0x7f8b5c15d510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:33.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.973+0000 7f8b62075640 1 -- 172.21.15.77:0/127692526 shutdown_connections 2023-11-04T01:40:33.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:33.973+0000 7f8b62075640 1 -- 172.21.15.77:0/127692526 wait complete. 2023-11-04T01:40:33.985 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:40:33.985 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:40:33.986 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2023-11-04T01:40:33.986 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:40:33.986 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:40:33.986 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:40:33.987 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:40:33.987 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:40:33.987 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:40:33.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:33.988 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2023-11-04T01:40:34.003 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:40:34.003 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:40:34.003 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:40:34.003 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:34.003 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2023-11-04T01:40:34.004 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:34.004 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:40:34.004 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:34.004 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f0 2023-11-04T01:40:34.004 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:40:34.004 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:34.005 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f1 2023-11-04T01:40:34.005 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:40:34.005 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:34.005 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:40:34.005 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:34.006 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:40:34.006 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 42372sec preferred_lft 42372sec 2023-11-04T01:40:34.006 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::ec4:7aff:fe8f:d3d3/64 scope link 2023-11-04T01:40:34.006 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:34.007 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-04T01:40:34.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:34.007 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-11-04T01:40:34.007 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-11-04T01:40:34.008 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add name ceph-brx type bridge 2023-11-04T01:40:34.008 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip addr flush dev ceph-brx 2023-11-04T01:40:34.008 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set ceph-brx up 2023-11-04T01:40:34.009 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-04T01:40:34.009 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-11-04T01:40:34.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:34.112 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:40:34.137 INFO:teuthology.orchestra.run.smithi077.stdout:1 2023-11-04T01:40:34.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:34.139 DEBUG:teuthology.orchestra.run.smithi077:> route 2023-11-04T01:40:34.194 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2023-11-04T01:40:34.194 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:40:34.195 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:40:34.195 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:40:34.195 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:40:34.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:34.196 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-11-04T01:40:34.196 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-11-04T01:40:34.196 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:40:34.197 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:40:34.197 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:40:34.197 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-11-04T01:40:34.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:34.294 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2023-11-04T01:40:34.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:34.309 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list-id 2023-11-04T01:40:34.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:34.364 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-11-04T01:40:34.365 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-11-04T01:40:34.365 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:40:34.365 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-04T01:40:34.366 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-11-04T01:40:34.446 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-04T01:40:34.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:34.447 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-11-04T01:40:34.447 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-11-04T01:40:34.447 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-04T01:40:34.447 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-04T01:40:34.448 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-04T01:40:34.448 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-04T01:40:34.448 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-04T01:40:34.449 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-11-04T01:40:34.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:34.569 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-11-04T01:40:34.569 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-11-04T01:40:34.570 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 up 2023-11-04T01:40:34.570 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set dev brx.0 master ceph-brx 2023-11-04T01:40:34.570 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-11-04T01:40:34.612 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:40:34.612 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:40:34.613 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:40:34.670 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:40:34.671 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:40:34.671 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:40:34.725 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:40:34.781 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2023-11-04T01:40:34.781 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2023-11-04T01:40:34.781 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2023-11-04T01:40:34.781 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2023-11-04T01:40:34.782 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2023-11-04T01:40:34.782 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2023-11-04T01:40:34.782 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2023-11-04T01:40:34.782 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2023-11-04T01:40:34.782 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2023-11-04T01:40:34.783 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2023-11-04T01:40:34.783 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2023-11-04T01:40:34.783 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2023-11-04T01:40:34.783 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:40:34.783 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2023-11-04T01:40:34.784 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2023-11-04T01:40:34.784 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2023-11-04T01:40:34.784 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2023-11-04T01:40:34.784 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2023-11-04T01:40:34.784 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2023-11-04T01:40:34.785 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:40:34.785 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:40:34.785 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:40:34.785 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:40:34.785 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2023-11-04T01:40:34.786 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2023-11-04T01:40:34.786 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:40:34.786 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:40:34.787 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:40:34.787 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:40:34.787 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2023-11-04T01:40:34.788 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:40:34.788 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:40:34.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:34.789 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-11-04T01:40:34.836 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:40:34.836 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:40:34.879 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:40:34.893 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2023-11-04T01:40:34.894 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2023-11-04T01:40:34.894 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2023-11-04T01:40:34.894 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2023-11-04T01:40:34.895 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2023-11-04T01:40:34.895 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2023-11-04T01:40:34.895 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2023-11-04T01:40:34.895 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2023-11-04T01:40:34.895 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2023-11-04T01:40:34.896 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2023-11-04T01:40:34.896 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2023-11-04T01:40:34.896 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2023-11-04T01:40:34.896 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:40:34.896 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2023-11-04T01:40:34.897 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2023-11-04T01:40:34.897 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2023-11-04T01:40:34.897 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2023-11-04T01:40:34.897 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2023-11-04T01:40:34.897 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2023-11-04T01:40:34.898 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:40:34.898 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:40:34.898 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:40:34.898 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:40:34.898 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2023-11-04T01:40:34.899 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2023-11-04T01:40:34.899 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:40:34.899 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:40:34.899 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:40:34.899 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:40:34.900 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2023-11-04T01:40:34.900 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:40:34.900 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:40:34.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:34.901 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-11-04T01:40:34.968 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:2023-11-04T01:40:34.967+0000 7fe76740c480 -1 init, newargv = 0x562b67688040 newargc=15 2023-11-04T01:40:34.969 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[128901]: starting ceph client 2023-11-04T01:40:34.973 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[128901]: starting fuse 2023-11-04T01:40:36.050 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:40:36.070 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2023-11-04T01:40:36.070 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2023-11-04T01:40:36.071 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2023-11-04T01:40:36.071 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2023-11-04T01:40:36.071 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2023-11-04T01:40:36.071 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2023-11-04T01:40:36.071 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2023-11-04T01:40:36.072 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2023-11-04T01:40:36.072 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2023-11-04T01:40:36.072 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2023-11-04T01:40:36.072 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2023-11-04T01:40:36.072 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2023-11-04T01:40:36.073 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:40:36.073 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2023-11-04T01:40:36.073 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2023-11-04T01:40:36.073 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2023-11-04T01:40:36.073 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2023-11-04T01:40:36.073 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2023-11-04T01:40:36.074 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2023-11-04T01:40:36.074 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:40:36.074 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:40:36.074 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:40:36.075 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:40:36.075 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2023-11-04T01:40:36.075 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2023-11-04T01:40:36.075 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:40:36.075 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:40:36.075 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:40:36.076 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:40:36.076 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2023-11-04T01:40:36.076 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:40:36.076 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:40:36.076 INFO:teuthology.orchestra.run.smithi077.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:40:36.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:36.077 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-11-04T01:40:36.128 INFO:teuthology.orchestra.run.smithi077.stdout:42 2023-11-04T01:40:36.128 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-11-04T01:40:36.129 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:40:36.129 DEBUG:teuthology.orchestra.run.smithi077:> import glob 2023-11-04T01:40:36.130 DEBUG:teuthology.orchestra.run.smithi077:> import re 2023-11-04T01:40:36.130 DEBUG:teuthology.orchestra.run.smithi077:> import os 2023-11-04T01:40:36.130 DEBUG:teuthology.orchestra.run.smithi077:> import subprocess 2023-11-04T01:40:36.130 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:40:36.131 DEBUG:teuthology.orchestra.run.smithi077:> def _find_admin_socket(client_name): 2023-11-04T01:40:36.131 DEBUG:teuthology.orchestra.run.smithi077:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:40:36.131 DEBUG:teuthology.orchestra.run.smithi077:> files = glob.glob(asok_path) 2023-11-04T01:40:36.132 DEBUG:teuthology.orchestra.run.smithi077:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:40:36.132 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:40:36.132 DEBUG:teuthology.orchestra.run.smithi077:> # Given a non-glob path, it better be there 2023-11-04T01:40:36.133 DEBUG:teuthology.orchestra.run.smithi077:> if "*" not in asok_path: 2023-11-04T01:40:36.133 DEBUG:teuthology.orchestra.run.smithi077:> assert(len(files) == 1) 2023-11-04T01:40:36.133 DEBUG:teuthology.orchestra.run.smithi077:> return files[0] 2023-11-04T01:40:36.134 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:40:36.134 DEBUG:teuthology.orchestra.run.smithi077:> for f in files: 2023-11-04T01:40:36.134 DEBUG:teuthology.orchestra.run.smithi077:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:40:36.134 DEBUG:teuthology.orchestra.run.smithi077:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:40:36.135 DEBUG:teuthology.orchestra.run.smithi077:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:40:36.135 DEBUG:teuthology.orchestra.run.smithi077:> contents = proc_f.read() 2023-11-04T01:40:36.135 DEBUG:teuthology.orchestra.run.smithi077:> if mountpoint in contents: 2023-11-04T01:40:36.136 DEBUG:teuthology.orchestra.run.smithi077:> return f 2023-11-04T01:40:36.136 DEBUG:teuthology.orchestra.run.smithi077:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:40:36.136 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:40:36.137 DEBUG:teuthology.orchestra.run.smithi077:> print(_find_admin_socket("client.0")) 2023-11-04T01:40:36.137 DEBUG:teuthology.orchestra.run.smithi077:> ' 2023-11-04T01:40:36.258 INFO:teuthology.orchestra.run.smithi077.stdout:/var/run/ceph/ceph-client.0.128901.asok 2023-11-04T01:40:36.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:36.269 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.128901.asok 2023-11-04T01:40:36.269 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:40:36.270 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.128901.asok status 2023-11-04T01:40:36.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:36.439 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-04T01:40:36.439 INFO:teuthology.orchestra.run.smithi077.stdout: "metadata": { 2023-11-04T01:40:36.439 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:40:36.439 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:40:36.440 INFO:teuthology.orchestra.run.smithi077.stdout: "entity_id": "0", 2023-11-04T01:40:36.440 INFO:teuthology.orchestra.run.smithi077.stdout: "hostname": "smithi077", 2023-11-04T01:40:36.440 INFO:teuthology.orchestra.run.smithi077.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:40:36.440 INFO:teuthology.orchestra.run.smithi077.stdout: "pid": "128901", 2023-11-04T01:40:36.440 INFO:teuthology.orchestra.run.smithi077.stdout: "root": "/" 2023-11-04T01:40:36.441 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:40:36.441 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_count": 0, 2023-11-04T01:40:36.441 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_pinned_count": 0, 2023-11-04T01:40:36.441 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 4869, 2023-11-04T01:40:36.441 INFO:teuthology.orchestra.run.smithi077.stdout: "inst": { 2023-11-04T01:40:36.442 INFO:teuthology.orchestra.run.smithi077.stdout: "name": { 2023-11-04T01:40:36.442 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "client", 2023-11-04T01:40:36.442 INFO:teuthology.orchestra.run.smithi077.stdout: "num": 4869 2023-11-04T01:40:36.442 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:40:36.442 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2023-11-04T01:40:36.442 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2023-11-04T01:40:36.443 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:40:36.443 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1412680967 2023-11-04T01:40:36.443 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:40:36.443 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:40:36.444 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2023-11-04T01:40:36.444 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2023-11-04T01:40:36.444 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:40:36.444 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1412680967 2023-11-04T01:40:36.444 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:40:36.444 INFO:teuthology.orchestra.run.smithi077.stdout: "inst_str": "client.4869 192.168.0.1:0/1412680967", 2023-11-04T01:40:36.445 INFO:teuthology.orchestra.run.smithi077.stdout: "addr_str": "192.168.0.1:0/1412680967", 2023-11-04T01:40:36.445 INFO:teuthology.orchestra.run.smithi077.stdout: "inode_count": 1, 2023-11-04T01:40:36.445 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_epoch": 9, 2023-11-04T01:40:36.445 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch": 24, 2023-11-04T01:40:36.445 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:40:36.446 INFO:teuthology.orchestra.run.smithi077.stdout: "blocklisted": false, 2023-11-04T01:40:36.446 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs" 2023-11-04T01:40:36.446 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-04T01:40:36.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:36.455 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:40:36.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.553+0000 7f1ec5c1a640 1 Processor -- start 2023-11-04T01:40:36.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.553+0000 7f1ec5c1a640 1 -- start start 2023-11-04T01:40:36.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.554+0000 7f1ec5c1a640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ec015d250 0x7f1ec00c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:36.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.554+0000 7f1ec5c1a640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1ec00c9d70 0x7f1ec00ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:36.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.554+0000 7f1ec5c1a640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ec006a120 con 0x7f1ec015ce70 2023-11-04T01:40:36.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.554+0000 7f1ec5c1a640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ec00cdc10 con 0x7f1ec00c9d70 2023-11-04T01:40:36.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.554+0000 7f1ec5c1a640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec006a370 con 0x7f1ec015d250 2023-11-04T01:40:36.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.554+0000 7f1ebffff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1ec00c9d70 0x7f1ec00ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:36.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.554+0000 7f1ebeffd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ec015d250 0x7f1ec00c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:36.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.554+0000 7f1ebf7fe640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f1ec015ce70 0x7f1ec006d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:46844/0 (socket says 172.21.15.77:46844) 2023-11-04T01:40:36.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.554+0000 7f1ebffff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1ec00c9d70 0x7f1ec00ccdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:33824/0 (socket says 172.21.15.77:33824) 2023-11-04T01:40:36.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.554+0000 7f1ebf7fe640 1 -- 172.21.15.77:0/1884343153 learned_addr learned my addr 172.21.15.77:0/1884343153 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:36.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.554+0000 7f1ebeffd640 1 -- 172.21.15.77:0/1884343153 >> v2:172.21.15.122:3300/0 conn(0x7f1ec00c9d70 msgr2=0x7f1ec00ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:36.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.554+0000 7f1ebeffd640 1 --2- 172.21.15.77:0/1884343153 >> v2:172.21.15.122:3300/0 conn(0x7f1ec00c9d70 0x7f1ec00ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.554+0000 7f1ebeffd640 1 -- 172.21.15.77:0/1884343153 >> v1:172.21.15.122:6789/0 conn(0x7f1ec015ce70 legacy=0x7f1ec006d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:36.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.554+0000 7f1ebeffd640 1 -- 172.21.15.77:0/1884343153 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec006a650 con 0x7f1ec015d250 2023-11-04T01:40:36.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.555+0000 7f1ebeffd640 1 --2- 172.21.15.77:0/1884343153 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ec015d250 0x7f1ec00c9830 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40097a0 tx=0x7f1eb402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa2a7a838cfc8741 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:36.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.555+0000 7f1ebe7fc640 1 -- 172.21.15.77:0/1884343153 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb4031830 con 0x7f1ec015d250 2023-11-04T01:40:36.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.555+0000 7f1ebe7fc640 1 -- 172.21.15.77:0/1884343153 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb4031990 con 0x7f1ec015d250 2023-11-04T01:40:36.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.555+0000 7f1ebe7fc640 1 -- 172.21.15.77:0/1884343153 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb4031d20 con 0x7f1ec015d250 2023-11-04T01:40:36.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.556+0000 7f1ec5c1a640 1 -- 172.21.15.77:0/1884343153 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ec015d250 msgr2=0x7f1ec00c9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:36.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.556+0000 7f1ec5c1a640 1 --2- 172.21.15.77:0/1884343153 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ec015d250 0x7f1ec00c9830 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40097a0 tx=0x7f1eb402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.556+0000 7f1ec5c1a640 1 -- 172.21.15.77:0/1884343153 shutdown_connections 2023-11-04T01:40:36.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.556+0000 7f1ec5c1a640 1 --2- 172.21.15.77:0/1884343153 >> v2:172.21.15.122:3300/0 conn(0x7f1ec00c9d70 0x7f1ec00ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.556+0000 7f1ec5c1a640 1 --2- 172.21.15.77:0/1884343153 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ec015d250 0x7f1ec00c9830 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.556+0000 7f1ec5c1a640 1 -- 172.21.15.77:0/1884343153 >> 172.21.15.77:0/1884343153 conn(0x7f1ec00b0cd0 msgr2=0x7f1ec00b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:36.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.556+0000 7f1ec5c1a640 1 -- 172.21.15.77:0/1884343153 shutdown_connections 2023-11-04T01:40:36.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.556+0000 7f1ec5c1a640 1 -- 172.21.15.77:0/1884343153 wait complete. 2023-11-04T01:40:36.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.557+0000 7f1ec5c1a640 1 Processor -- start 2023-11-04T01:40:36.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.557+0000 7f1ec5c1a640 1 -- start start 2023-11-04T01:40:36.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.558+0000 7f1ec5c1a640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ec015ce70 0x7f1ec014e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:36.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.558+0000 7f1ec5c1a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ec015d250 0x7f1ec01e2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:36.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.558+0000 7f1ec5c1a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ec01e28a0 0x7f1ec00af010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:36.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.558+0000 7f1ec5c1a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec01e2db0 con 0x7f1ec01e28a0 2023-11-04T01:40:36.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.558+0000 7f1ec5c1a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec01e3090 con 0x7f1ec015d250 2023-11-04T01:40:36.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.558+0000 7f1ec5c1a640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec01e3370 con 0x7f1ec015ce70 2023-11-04T01:40:36.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.558+0000 7f1ebffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ec01e28a0 0x7f1ec00af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:36.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.558+0000 7f1ebffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ec01e28a0 0x7f1ec00af010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53368/0 (socket says 172.21.15.77:53368) 2023-11-04T01:40:36.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.558+0000 7f1ebffff640 1 -- 172.21.15.77:0/1963852248 learned_addr learned my addr 172.21.15.77:0/1963852248 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:36.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.558+0000 7f1ebeffd640 1 --2- 172.21.15.77:0/1963852248 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ec015d250 0x7f1ec01e2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:36.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.558+0000 7f1ebf7fe640 1 --2- 172.21.15.77:0/1963852248 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ec015ce70 0x7f1ec014e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:36.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.558+0000 7f1ebffff640 1 -- 172.21.15.77:0/1963852248 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ec015ce70 msgr2=0x7f1ec014e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:36.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.558+0000 7f1ebffff640 1 --2- 172.21.15.77:0/1963852248 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ec015ce70 0x7f1ec014e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.558+0000 7f1ebffff640 1 -- 172.21.15.77:0/1963852248 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ec015d250 msgr2=0x7f1ec01e2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:36.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.558+0000 7f1ebffff640 1 --2- 172.21.15.77:0/1963852248 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ec015d250 0x7f1ec01e2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.558+0000 7f1ebffff640 1 -- 172.21.15.77:0/1963852248 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb4009400 con 0x7f1ec01e28a0 2023-11-04T01:40:36.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.559+0000 7f1ebffff640 1 --2- 172.21.15.77:0/1963852248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ec01e28a0 0x7f1ec00af010 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1eb800efc0 tx=0x7f1eb800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:36.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.559+0000 7f1ea7fff640 1 -- 172.21.15.77:0/1963852248 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8014480 con 0x7f1ec01e28a0 2023-11-04T01:40:36.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.559+0000 7f1ea7fff640 1 -- 172.21.15.77:0/1963852248 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb800f040 con 0x7f1ec01e28a0 2023-11-04T01:40:36.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.559+0000 7f1ea7fff640 1 -- 172.21.15.77:0/1963852248 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8014820 con 0x7f1ec01e28a0 2023-11-04T01:40:36.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.559+0000 7f1ec5c1a640 1 -- 172.21.15.77:0/1963852248 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ec01e3650 con 0x7f1ec01e28a0 2023-11-04T01:40:36.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.559+0000 7f1ec5c1a640 1 -- 172.21.15.77:0/1963852248 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ec015b800 con 0x7f1ec01e28a0 2023-11-04T01:40:36.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.560+0000 7f1ec5c1a640 1 -- 172.21.15.77:0/1963852248 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ec0074290 con 0x7f1ec01e28a0 2023-11-04T01:40:36.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.560+0000 7f1ea7fff640 1 -- 172.21.15.77:0/1963852248 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1eb8014980 con 0x7f1ec01e28a0 2023-11-04T01:40:36.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.561+0000 7f1ea7fff640 1 --2- 172.21.15.77:0/1963852248 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1eac06ae70 0x7f1eac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:36.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.561+0000 7f1ea7fff640 1 -- 172.21.15.77:0/1963852248 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1eb808a360 con 0x7f1ec01e28a0 2023-11-04T01:40:36.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.561+0000 7f1ebf7fe640 1 --2- 172.21.15.77:0/1963852248 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1eac06ae70 0x7f1eac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:36.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.561+0000 7f1ebf7fe640 1 --2- 172.21.15.77:0/1963852248 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1eac06ae70 0x7f1eac06d330 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0005880 tx=0x7f1eb0009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:36.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.565+0000 7f1ea7fff640 1 -- 172.21.15.77:0/1963852248 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1eb80551d0 con 0x7f1ec01e28a0 2023-11-04T01:40:36.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.771+0000 7f1ec5c1a640 1 -- 172.21.15.77:0/1963852248 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1ec006e420 con 0x7f1ec01e28a0 2023-11-04T01:40:36.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.771+0000 7f1ea7fff640 1 -- 172.21.15.77:0/1963852248 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f1eb80587f0 con 0x7f1ec01e28a0 2023-11-04T01:40:36.773 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-04T01:40:36.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.773+0000 7f1ec5c1a640 1 -- 172.21.15.77:0/1963852248 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1eac06ae70 msgr2=0x7f1eac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:36.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.773+0000 7f1ec5c1a640 1 --2- 172.21.15.77:0/1963852248 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1eac06ae70 0x7f1eac06d330 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0005880 tx=0x7f1eb0009040 comp rx=0 tx=0).stop 2023-11-04T01:40:36.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.773+0000 7f1ec5c1a640 1 -- 172.21.15.77:0/1963852248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ec01e28a0 msgr2=0x7f1ec00af010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:36.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.773+0000 7f1ec5c1a640 1 --2- 172.21.15.77:0/1963852248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ec01e28a0 0x7f1ec00af010 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1eb800efc0 tx=0x7f1eb800c490 comp rx=0 tx=0).stop 2023-11-04T01:40:36.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.773+0000 7f1ec5c1a640 1 -- 172.21.15.77:0/1963852248 shutdown_connections 2023-11-04T01:40:36.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.773+0000 7f1ec5c1a640 1 --2- 172.21.15.77:0/1963852248 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1eac06ae70 0x7f1eac06d330 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.773+0000 7f1ec5c1a640 1 --2- 172.21.15.77:0/1963852248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ec01e28a0 0x7f1ec00af010 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.773+0000 7f1ec5c1a640 1 --2- 172.21.15.77:0/1963852248 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ec015d250 0x7f1ec01e2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.773+0000 7f1ec5c1a640 1 --2- 172.21.15.77:0/1963852248 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ec015ce70 0x7f1ec014e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:36.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.773+0000 7f1ec5c1a640 1 -- 172.21.15.77:0/1963852248 >> 172.21.15.77:0/1963852248 conn(0x7f1ec00b0cd0 msgr2=0x7f1ec00ad1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:36.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.773+0000 7f1ec5c1a640 1 -- 172.21.15.77:0/1963852248 shutdown_connections 2023-11-04T01:40:36.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:36.773+0000 7f1ec5c1a640 1 -- 172.21.15.77:0/1963852248 wait complete. 2023-11-04T01:40:36.785 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:40:36.785 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:40:36.786 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2023-11-04T01:40:36.786 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-04T01:40:36.786 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-04T01:40:36.787 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:40:36.787 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:40:36.787 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:40:36.787 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-04T01:40:36.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:36.788 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2023-11-04T01:40:36.803 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:40:36.804 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:40:36.804 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:40:36.804 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:36.804 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2023-11-04T01:40:36.804 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:36.805 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:40:36.805 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:36.805 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f0 2023-11-04T01:40:36.805 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:40:36.805 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:36.806 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f1 2023-11-04T01:40:36.806 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:40:36.806 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:36.806 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:40:36.806 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:36.807 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:40:36.807 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 42369sec preferred_lft 42369sec 2023-11-04T01:40:36.807 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::ec4:7aff:fe8f:d3d3/64 scope link 2023-11-04T01:40:36.807 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:36.807 INFO:teuthology.orchestra.run.smithi077.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:40:36.808 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 06:3a:02:11:c4:57 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:36.808 INFO:teuthology.orchestra.run.smithi077.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:40:36.808 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:36.808 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::8039:1aff:fee2:109f/64 scope link 2023-11-04T01:40:36.809 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:36.809 INFO:teuthology.orchestra.run.smithi077.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:40:36.809 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 06:3a:02:11:c4:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:40:36.809 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::43a:2ff:fe11:c457/64 scope link 2023-11-04T01:40:36.809 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:36.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:36.811 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:40:36.869 INFO:teuthology.orchestra.run.smithi077.stdout:1 2023-11-04T01:40:36.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:36.871 DEBUG:teuthology.orchestra.run.smithi077:> route 2023-11-04T01:40:36.926 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2023-11-04T01:40:36.926 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:40:36.926 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:40:36.926 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:40:36.927 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:40:36.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:36.927 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-11-04T01:40:36.928 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-11-04T01:40:36.928 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:40:36.928 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:40:36.929 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:40:36.929 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-11-04T01:40:37.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:37.022 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2023-11-04T01:40:37.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:40:37.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:37.038 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list-id 2023-11-04T01:40:37.093 INFO:teuthology.orchestra.run.smithi077.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-04T01:40:37.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:37.094 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-11-04T01:40:37.094 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-11-04T01:40:37.095 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:40:37.095 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-04T01:40:37.095 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-11-04T01:40:37.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:37.175 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-04T01:40:37.242 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:40:37.242 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:40:37.242 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:40:37.242 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:37.243 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2023-11-04T01:40:37.243 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:37.243 INFO:teuthology.orchestra.run.smithi077.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:40:37.243 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether a2:a7:8a:04:4d:30 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-04T01:40:37.243 INFO:teuthology.orchestra.run.smithi077.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-04T01:40:37.244 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:37.244 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::a0a7:8aff:fe04:4d30/64 scope link 2023-11-04T01:40:37.244 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:37.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:37.247 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-04T01:40:37.312 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:40:37.312 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:40:37.312 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:40:37.313 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:37.313 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2023-11-04T01:40:37.313 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:37.313 INFO:teuthology.orchestra.run.smithi077.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:40:37.314 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether a2:a7:8a:04:4d:30 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-04T01:40:37.314 INFO:teuthology.orchestra.run.smithi077.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-04T01:40:37.314 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:37.314 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::a0a7:8aff:fe04:4d30/64 scope link 2023-11-04T01:40:37.314 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:37.316 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-04T01:40:37.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:37.316 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-11-04T01:40:37.317 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-11-04T01:40:37.317 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-04T01:40:37.317 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-04T01:40:37.318 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-04T01:40:37.318 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-04T01:40:37.318 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-04T01:40:37.319 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-11-04T01:40:37.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:37.440 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-11-04T01:40:37.441 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-11-04T01:40:37.442 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.1 up 2023-11-04T01:40:37.442 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set dev brx.1 master ceph-brx 2023-11-04T01:40:37.443 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-11-04T01:40:37.484 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-11-04T01:40:37.485 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:40:37.485 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-04T01:40:37.539 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-04T01:40:37.539 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:40:37.540 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-04T01:40:37.595 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:40:37.650 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2023-11-04T01:40:37.651 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2023-11-04T01:40:37.651 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2023-11-04T01:40:37.651 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2023-11-04T01:40:37.651 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2023-11-04T01:40:37.652 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2023-11-04T01:40:37.652 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2023-11-04T01:40:37.652 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2023-11-04T01:40:37.652 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2023-11-04T01:40:37.652 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2023-11-04T01:40:37.653 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2023-11-04T01:40:37.653 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2023-11-04T01:40:37.653 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:40:37.653 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2023-11-04T01:40:37.653 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2023-11-04T01:40:37.654 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2023-11-04T01:40:37.654 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2023-11-04T01:40:37.654 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2023-11-04T01:40:37.654 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2023-11-04T01:40:37.655 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:40:37.655 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:40:37.655 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:40:37.655 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:40:37.655 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2023-11-04T01:40:37.656 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2023-11-04T01:40:37.656 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:40:37.656 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:40:37.656 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:40:37.656 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:40:37.656 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2023-11-04T01:40:37.657 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:40:37.657 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:40:37.657 INFO:teuthology.orchestra.run.smithi077.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:40:37.657 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:40:37.657 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:40:37.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:37.658 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-11-04T01:40:37.705 INFO:teuthology.orchestra.run.smithi077.stdout:42 2023-11-04T01:40:37.705 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [42] 2023-11-04T01:40:37.706 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-11-04T01:40:37.748 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:40:37.763 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2023-11-04T01:40:37.763 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2023-11-04T01:40:37.763 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2023-11-04T01:40:37.764 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2023-11-04T01:40:37.764 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2023-11-04T01:40:37.764 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2023-11-04T01:40:37.764 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2023-11-04T01:40:37.765 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2023-11-04T01:40:37.765 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2023-11-04T01:40:37.765 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2023-11-04T01:40:37.765 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2023-11-04T01:40:37.766 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2023-11-04T01:40:37.766 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:40:37.766 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2023-11-04T01:40:37.766 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2023-11-04T01:40:37.767 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2023-11-04T01:40:37.767 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2023-11-04T01:40:37.767 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2023-11-04T01:40:37.767 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2023-11-04T01:40:37.767 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:40:37.767 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:40:37.768 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:40:37.768 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:40:37.768 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2023-11-04T01:40:37.768 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2023-11-04T01:40:37.768 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:40:37.769 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:40:37.769 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:40:37.769 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:40:37.769 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2023-11-04T01:40:37.770 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:40:37.770 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:40:37.770 INFO:teuthology.orchestra.run.smithi077.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:40:37.770 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:40:37.771 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:40:37.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:37.771 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-11-04T01:40:37.819 INFO:teuthology.orchestra.run.smithi077.stdout:42 2023-11-04T01:40:37.838 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi077.stderr:2023-11-04T01:40:37.837+0000 7fb644645480 -1 init, newargv = 0x556290fecb40 newargc=15 2023-11-04T01:40:37.839 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi077.stderr:ceph-fuse[129394]: starting ceph client 2023-11-04T01:40:37.843 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi077.stderr:ceph-fuse[129394]: starting fuse 2023-11-04T01:40:38.922 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:40:38.942 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2023-11-04T01:40:38.943 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2023-11-04T01:40:38.943 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2023-11-04T01:40:38.943 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2023-11-04T01:40:38.943 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2023-11-04T01:40:38.943 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2023-11-04T01:40:38.944 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2023-11-04T01:40:38.944 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2023-11-04T01:40:38.944 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2023-11-04T01:40:38.944 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2023-11-04T01:40:38.944 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2023-11-04T01:40:38.945 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2023-11-04T01:40:38.945 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:40:38.945 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2023-11-04T01:40:38.945 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2023-11-04T01:40:38.945 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2023-11-04T01:40:38.945 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2023-11-04T01:40:38.946 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2023-11-04T01:40:38.946 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2023-11-04T01:40:38.946 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:40:38.946 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:40:38.946 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:40:38.947 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:40:38.947 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2023-11-04T01:40:38.947 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2023-11-04T01:40:38.947 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:40:38.947 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:40:38.948 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:40:38.948 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:40:38.948 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2023-11-04T01:40:38.948 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:40:38.949 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:40:38.949 INFO:teuthology.orchestra.run.smithi077.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:40:38.949 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:40:38.949 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:40:38.949 INFO:teuthology.orchestra.run.smithi077.stdout:/home/ubuntu/cephtest/mnt.2 2023-11-04T01:40:38.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:38.950 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-11-04T01:40:38.999 INFO:teuthology.orchestra.run.smithi077.stdout:42 2023-11-04T01:40:39.000 INFO:teuthology.orchestra.run.smithi077.stdout:44 2023-11-04T01:40:39.000 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42, 44] 2023-11-04T01:40:39.001 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:40:39.001 DEBUG:teuthology.orchestra.run.smithi077:> import glob 2023-11-04T01:40:39.001 DEBUG:teuthology.orchestra.run.smithi077:> import re 2023-11-04T01:40:39.001 DEBUG:teuthology.orchestra.run.smithi077:> import os 2023-11-04T01:40:39.002 DEBUG:teuthology.orchestra.run.smithi077:> import subprocess 2023-11-04T01:40:39.002 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:40:39.002 DEBUG:teuthology.orchestra.run.smithi077:> def _find_admin_socket(client_name): 2023-11-04T01:40:39.003 DEBUG:teuthology.orchestra.run.smithi077:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-11-04T01:40:39.003 DEBUG:teuthology.orchestra.run.smithi077:> files = glob.glob(asok_path) 2023-11-04T01:40:39.003 DEBUG:teuthology.orchestra.run.smithi077:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-11-04T01:40:39.004 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:40:39.004 DEBUG:teuthology.orchestra.run.smithi077:> # Given a non-glob path, it better be there 2023-11-04T01:40:39.004 DEBUG:teuthology.orchestra.run.smithi077:> if "*" not in asok_path: 2023-11-04T01:40:39.004 DEBUG:teuthology.orchestra.run.smithi077:> assert(len(files) == 1) 2023-11-04T01:40:39.005 DEBUG:teuthology.orchestra.run.smithi077:> return files[0] 2023-11-04T01:40:39.005 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:40:39.005 DEBUG:teuthology.orchestra.run.smithi077:> for f in files: 2023-11-04T01:40:39.006 DEBUG:teuthology.orchestra.run.smithi077:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:40:39.006 DEBUG:teuthology.orchestra.run.smithi077:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:40:39.006 DEBUG:teuthology.orchestra.run.smithi077:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:40:39.006 DEBUG:teuthology.orchestra.run.smithi077:> contents = proc_f.read() 2023-11-04T01:40:39.007 DEBUG:teuthology.orchestra.run.smithi077:> if mountpoint in contents: 2023-11-04T01:40:39.007 DEBUG:teuthology.orchestra.run.smithi077:> return f 2023-11-04T01:40:39.007 DEBUG:teuthology.orchestra.run.smithi077:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:40:39.008 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:40:39.008 DEBUG:teuthology.orchestra.run.smithi077:> print(_find_admin_socket("client.2")) 2023-11-04T01:40:39.008 DEBUG:teuthology.orchestra.run.smithi077:> ' 2023-11-04T01:40:39.126 INFO:teuthology.orchestra.run.smithi077.stdout:/var/run/ceph/ceph-client.2.129394.asok 2023-11-04T01:40:39.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:39.137 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.129394.asok 2023-11-04T01:40:39.138 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:40:39.138 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.2.129394.asok status 2023-11-04T01:40:39.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:39.307 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-04T01:40:39.307 INFO:teuthology.orchestra.run.smithi077.stdout: "metadata": { 2023-11-04T01:40:39.307 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:40:39.308 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:40:39.308 INFO:teuthology.orchestra.run.smithi077.stdout: "entity_id": "2", 2023-11-04T01:40:39.308 INFO:teuthology.orchestra.run.smithi077.stdout: "hostname": "smithi077", 2023-11-04T01:40:39.308 INFO:teuthology.orchestra.run.smithi077.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-11-04T01:40:39.308 INFO:teuthology.orchestra.run.smithi077.stdout: "pid": "129394", 2023-11-04T01:40:39.309 INFO:teuthology.orchestra.run.smithi077.stdout: "root": "/" 2023-11-04T01:40:39.309 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:40:39.309 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_count": 0, 2023-11-04T01:40:39.309 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_pinned_count": 0, 2023-11-04T01:40:39.309 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 4878, 2023-11-04T01:40:39.309 INFO:teuthology.orchestra.run.smithi077.stdout: "inst": { 2023-11-04T01:40:39.310 INFO:teuthology.orchestra.run.smithi077.stdout: "name": { 2023-11-04T01:40:39.310 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "client", 2023-11-04T01:40:39.310 INFO:teuthology.orchestra.run.smithi077.stdout: "num": 4878 2023-11-04T01:40:39.310 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:40:39.310 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2023-11-04T01:40:39.311 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2023-11-04T01:40:39.311 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.2:0", 2023-11-04T01:40:39.311 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1671647987 2023-11-04T01:40:39.311 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:40:39.311 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:40:39.312 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2023-11-04T01:40:39.312 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2023-11-04T01:40:39.312 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.2:0", 2023-11-04T01:40:39.312 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1671647987 2023-11-04T01:40:39.312 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:40:39.313 INFO:teuthology.orchestra.run.smithi077.stdout: "inst_str": "client.4878 192.168.0.2:0/1671647987", 2023-11-04T01:40:39.313 INFO:teuthology.orchestra.run.smithi077.stdout: "addr_str": "192.168.0.2:0/1671647987", 2023-11-04T01:40:39.313 INFO:teuthology.orchestra.run.smithi077.stdout: "inode_count": 1, 2023-11-04T01:40:39.313 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_epoch": 9, 2023-11-04T01:40:39.313 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch": 24, 2023-11-04T01:40:39.313 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:40:39.314 INFO:teuthology.orchestra.run.smithi077.stdout: "blocklisted": false, 2023-11-04T01:40:39.314 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs" 2023-11-04T01:40:39.314 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-04T01:40:39.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:39.321 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:40:39.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.417+0000 7f30aae34640 1 Processor -- start 2023-11-04T01:40:39.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.417+0000 7f30aae34640 1 -- start start 2023-11-04T01:40:39.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.418+0000 7f30aae34640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f30a4159c70 0x7f30a40ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.418+0000 7f30aae34640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f30a406db20 0x7f30a40b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.418+0000 7f30aae34640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f30a40b0910 0x7f30a415d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.418+0000 7f30aae34640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a40b49b0 con 0x7f30a406db20 2023-11-04T01:40:39.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.418+0000 7f30aae34640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a40b0da0 con 0x7f30a40b0910 2023-11-04T01:40:39.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.418+0000 7f30aae34640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a40b4110 con 0x7f30a4159c70 2023-11-04T01:40:39.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.418+0000 7f30a3fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f30a406db20 0x7f30a40b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.418+0000 7f30a3fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f30a406db20 0x7f30a40b03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48668/0 (socket says 172.21.15.77:48668) 2023-11-04T01:40:39.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.418+0000 7f30a3fff640 1 -- 172.21.15.77:0/142149173 learned_addr learned my addr 172.21.15.77:0/142149173 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:39.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.418+0000 7f30a8bd0640 1 --2- 172.21.15.77:0/142149173 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f30a4159c70 0x7f30a40ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.418+0000 7f30a93d1640 1 --2- 172.21.15.77:0/142149173 >> v2:172.21.15.122:3300/0 conn(0x7f30a40b0910 0x7f30a415d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.419+0000 7f30a3fff640 1 -- 172.21.15.77:0/142149173 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f30a4159c70 msgr2=0x7f30a40ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:39.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.419+0000 7f30a3fff640 1 --2- 172.21.15.77:0/142149173 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f30a4159c70 0x7f30a40ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.419+0000 7f30a3fff640 1 -- 172.21.15.77:0/142149173 >> v2:172.21.15.122:3300/0 conn(0x7f30a40b0910 msgr2=0x7f30a415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:39.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.419+0000 7f30a3fff640 1 --2- 172.21.15.77:0/142149173 >> v2:172.21.15.122:3300/0 conn(0x7f30a40b0910 0x7f30a415d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.419+0000 7f30a3fff640 1 -- 172.21.15.77:0/142149173 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a40b43f0 con 0x7f30a406db20 2023-11-04T01:40:39.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.419+0000 7f30a3fff640 1 --2- 172.21.15.77:0/142149173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30a406db20 0x7f30a40b03d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f30a40ca130 tx=0x7f309002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a14ddc65784c16d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:39.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.419+0000 7f30a37fe640 1 -- 172.21.15.77:0/142149173 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3090031870 con 0x7f30a406db20 2023-11-04T01:40:39.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.419+0000 7f30a37fe640 1 -- 172.21.15.77:0/142149173 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30900319d0 con 0x7f30a406db20 2023-11-04T01:40:39.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.419+0000 7f30a37fe640 1 -- 172.21.15.77:0/142149173 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3090031d60 con 0x7f30a406db20 2023-11-04T01:40:39.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.420+0000 7f30aae34640 1 -- 172.21.15.77:0/142149173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30a406db20 msgr2=0x7f30a40b03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.420+0000 7f30aae34640 1 --2- 172.21.15.77:0/142149173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30a406db20 0x7f30a40b03d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f30a40ca130 tx=0x7f309002b910 comp rx=0 tx=0).stop 2023-11-04T01:40:39.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.420+0000 7f30aae34640 1 -- 172.21.15.77:0/142149173 shutdown_connections 2023-11-04T01:40:39.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.420+0000 7f30aae34640 1 --2- 172.21.15.77:0/142149173 >> v2:172.21.15.122:3300/0 conn(0x7f30a40b0910 0x7f30a415d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.420+0000 7f30aae34640 1 --2- 172.21.15.77:0/142149173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30a406db20 0x7f30a40b03d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.420+0000 7f30aae34640 1 --2- 172.21.15.77:0/142149173 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f30a4159c70 0x7f30a40ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.420+0000 7f30aae34640 1 -- 172.21.15.77:0/142149173 >> 172.21.15.77:0/142149173 conn(0x7f30a40ce950 msgr2=0x7f30a40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:39.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.420+0000 7f30aae34640 1 -- 172.21.15.77:0/142149173 shutdown_connections 2023-11-04T01:40:39.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.420+0000 7f30aae34640 1 -- 172.21.15.77:0/142149173 wait complete. 2023-11-04T01:40:39.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.421+0000 7f30aae34640 1 Processor -- start 2023-11-04T01:40:39.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.421+0000 7f30aae34640 1 -- start start 2023-11-04T01:40:39.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.422+0000 7f30aae34640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30a406db20 0x7f30a414b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.422+0000 7f30aae34640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f30a40b0910 0x7f30a4151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.422+0000 7f30aae34640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30a4159c70 0x7f30a4070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.422+0000 7f30aae34640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a415d150 con 0x7f30a406db20 2023-11-04T01:40:39.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.422+0000 7f30aae34640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a4151c20 con 0x7f30a4159c70 2023-11-04T01:40:39.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.422+0000 7f30aae34640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a415a180 con 0x7f30a40b0910 2023-11-04T01:40:39.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.422+0000 7f30a8bd0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30a406db20 0x7f30a414b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.422+0000 7f30a8bd0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30a406db20 0x7f30a414b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48672/0 (socket says 172.21.15.77:48672) 2023-11-04T01:40:39.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.422+0000 7f30a8bd0640 1 -- 172.21.15.77:0/1855371375 learned_addr learned my addr 172.21.15.77:0/1855371375 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:39.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.422+0000 7f30a93d1640 1 --2- 172.21.15.77:0/1855371375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30a4159c70 0x7f30a4070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.422+0000 7f30a3fff640 1 --2- 172.21.15.77:0/1855371375 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f30a40b0910 0x7f30a4151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.422+0000 7f30a8bd0640 1 -- 172.21.15.77:0/1855371375 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f30a40b0910 msgr2=0x7f30a4151140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.422+0000 7f30a8bd0640 1 --2- 172.21.15.77:0/1855371375 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f30a40b0910 0x7f30a4151140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.422+0000 7f30a8bd0640 1 -- 172.21.15.77:0/1855371375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30a4159c70 msgr2=0x7f30a4070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.422+0000 7f30a8bd0640 1 --2- 172.21.15.77:0/1855371375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30a4159c70 0x7f30a4070710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.422+0000 7f30a8bd0640 1 -- 172.21.15.77:0/1855371375 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30900094d0 con 0x7f30a406db20 2023-11-04T01:40:39.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.422+0000 7f30a93d1640 1 --2- 172.21.15.77:0/1855371375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30a4159c70 0x7f30a4070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:39.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.423+0000 7f30a8bd0640 1 --2- 172.21.15.77:0/1855371375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30a406db20 0x7f30a414b740 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f309800d830 tx=0x7f309800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:39.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.423+0000 7f30a17fa640 1 -- 172.21.15.77:0/1855371375 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309800b6c0 con 0x7f30a406db20 2023-11-04T01:40:39.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.423+0000 7f30a17fa640 1 -- 172.21.15.77:0/1855371375 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309800b820 con 0x7f30a406db20 2023-11-04T01:40:39.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.423+0000 7f30a17fa640 1 -- 172.21.15.77:0/1855371375 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309800bbb0 con 0x7f30a406db20 2023-11-04T01:40:39.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.423+0000 7f30aae34640 1 -- 172.21.15.77:0/1855371375 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30a415a460 con 0x7f30a406db20 2023-11-04T01:40:39.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.423+0000 7f30aae34640 1 -- 172.21.15.77:0/1855371375 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a415aa20 con 0x7f30a406db20 2023-11-04T01:40:39.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.424+0000 7f30aae34640 1 -- 172.21.15.77:0/1855371375 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30a415abb0 con 0x7f30a406db20 2023-11-04T01:40:39.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.424+0000 7f30a17fa640 1 -- 172.21.15.77:0/1855371375 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f309801e460 con 0x7f30a406db20 2023-11-04T01:40:39.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.424+0000 7f30a17fa640 1 --2- 172.21.15.77:0/1855371375 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f308806ae70 0x7f308806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:39.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.424+0000 7f30a17fa640 1 -- 172.21.15.77:0/1855371375 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3098089ff0 con 0x7f30a406db20 2023-11-04T01:40:39.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.425+0000 7f30a3fff640 1 --2- 172.21.15.77:0/1855371375 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f308806ae70 0x7f308806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:39.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.425+0000 7f30a3fff640 1 --2- 172.21.15.77:0/1855371375 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f308806ae70 0x7f308806d330 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3090036000 tx=0x7f309003c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:39.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.428+0000 7f30a17fa640 1 -- 172.21.15.77:0/1855371375 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3098054e40 con 0x7f30a406db20 2023-11-04T01:40:39.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.628+0000 7f30aae34640 1 -- 172.21.15.77:0/1855371375 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f30a4074290 con 0x7f30a406db20 2023-11-04T01:40:39.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.628+0000 7f30a17fa640 1 -- 172.21.15.77:0/1855371375 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f3098058460 con 0x7f30a406db20 2023-11-04T01:40:39.631 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-04T01:40:39.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.630+0000 7f30aae34640 1 -- 172.21.15.77:0/1855371375 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f308806ae70 msgr2=0x7f308806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.630+0000 7f30aae34640 1 --2- 172.21.15.77:0/1855371375 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f308806ae70 0x7f308806d330 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3090036000 tx=0x7f309003c040 comp rx=0 tx=0).stop 2023-11-04T01:40:39.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.630+0000 7f30aae34640 1 -- 172.21.15.77:0/1855371375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30a406db20 msgr2=0x7f30a414b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:39.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.630+0000 7f30aae34640 1 --2- 172.21.15.77:0/1855371375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30a406db20 0x7f30a414b740 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f309800d830 tx=0x7f309800dcf0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.631+0000 7f30aae34640 1 -- 172.21.15.77:0/1855371375 shutdown_connections 2023-11-04T01:40:39.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.631+0000 7f30aae34640 1 --2- 172.21.15.77:0/1855371375 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f308806ae70 0x7f308806d330 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.631+0000 7f30aae34640 1 --2- 172.21.15.77:0/1855371375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30a4159c70 0x7f30a4070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.631+0000 7f30aae34640 1 --2- 172.21.15.77:0/1855371375 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f30a40b0910 0x7f30a4151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.631+0000 7f30aae34640 1 --2- 172.21.15.77:0/1855371375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30a406db20 0x7f30a414b740 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:39.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.631+0000 7f30aae34640 1 -- 172.21.15.77:0/1855371375 >> 172.21.15.77:0/1855371375 conn(0x7f30a40ce950 msgr2=0x7f30a4157ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:39.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.631+0000 7f30aae34640 1 -- 172.21.15.77:0/1855371375 shutdown_connections 2023-11-04T01:40:39.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:39.631+0000 7f30aae34640 1 -- 172.21.15.77:0/1855371375 wait complete. 2023-11-04T01:40:39.643 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:40:39.643 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:40:39.644 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi122.front.sepia.ceph.com 2023-11-04T01:40:39.644 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-04T01:40:39.644 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-04T01:40:39.644 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:40:39.644 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:40:39.645 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:40:39.645 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-04T01:40:39.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:39.646 DEBUG:teuthology.orchestra.run.smithi122:> ip addr 2023-11-04T01:40:39.665 INFO:teuthology.orchestra.run.smithi122.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:40:39.665 INFO:teuthology.orchestra.run.smithi122.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:40:39.666 INFO:teuthology.orchestra.run.smithi122.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:40:39.666 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:39.666 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 ::1/128 scope host 2023-11-04T01:40:39.666 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:39.667 INFO:teuthology.orchestra.run.smithi122.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:40:39.667 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:d8:d9:e4 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:39.667 INFO:teuthology.orchestra.run.smithi122.stdout: altname enp7s0f0 2023-11-04T01:40:39.667 INFO:teuthology.orchestra.run.smithi122.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:40:39.667 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:d8:d9:e5 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:39.668 INFO:teuthology.orchestra.run.smithi122.stdout: altname enp7s0f1 2023-11-04T01:40:39.668 INFO:teuthology.orchestra.run.smithi122.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:40:39.668 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:8f:d5:14 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:39.668 INFO:teuthology.orchestra.run.smithi122.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:40:39.669 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:8f:d5:15 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:39.669 INFO:teuthology.orchestra.run.smithi122.stdout: inet 172.21.15.122/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:40:39.669 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft 42385sec preferred_lft 42385sec 2023-11-04T01:40:39.669 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::ec4:7aff:fe8f:d515/64 scope link 2023-11-04T01:40:39.669 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:39.670 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-04T01:40:39.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:39.670 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec bash -c ' 2023-11-04T01:40:39.671 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2023-11-04T01:40:39.671 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link add name ceph-brx type bridge 2023-11-04T01:40:39.671 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip addr flush dev ceph-brx 2023-11-04T01:40:39.672 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link set ceph-brx up 2023-11-04T01:40:39.672 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-04T01:40:39.672 DEBUG:teuthology.orchestra.run.smithi122:> ') 2023-11-04T01:40:39.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:39.871 DEBUG:teuthology.orchestra.run.smithi122:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:40:39.899 INFO:teuthology.orchestra.run.smithi122.stdout:1 2023-11-04T01:40:39.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:39.901 DEBUG:teuthology.orchestra.run.smithi122:> route 2023-11-04T01:40:39.975 INFO:teuthology.orchestra.run.smithi122.stdout:Kernel IP routing table 2023-11-04T01:40:39.976 INFO:teuthology.orchestra.run.smithi122.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:40:39.976 INFO:teuthology.orchestra.run.smithi122.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:40:39.976 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:40:39.976 INFO:teuthology.orchestra.run.smithi122.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:40:39.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:39.977 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec bash -c ' 2023-11-04T01:40:39.977 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2023-11-04T01:40:39.978 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:40:39.978 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:40:39.979 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:40:39.979 DEBUG:teuthology.orchestra.run.smithi122:> ') 2023-11-04T01:40:40.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:40.248 DEBUG:teuthology.orchestra.run.smithi122:> ip netns list 2023-11-04T01:40:40.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:40.263 DEBUG:teuthology.orchestra.run.smithi122:> ip netns list-id 2023-11-04T01:40:40.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:40.318 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec bash -c ' 2023-11-04T01:40:40.318 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2023-11-04T01:40:40.318 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:40:40.319 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-04T01:40:40.319 DEBUG:teuthology.orchestra.run.smithi122:> ') 2023-11-04T01:40:40.402 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-04T01:40:40.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:40.403 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec bash -c ' 2023-11-04T01:40:40.403 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2023-11-04T01:40:40.403 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-04T01:40:40.404 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-04T01:40:40.404 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-04T01:40:40.404 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-04T01:40:40.405 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-04T01:40:40.405 DEBUG:teuthology.orchestra.run.smithi122:> ') 2023-11-04T01:40:40.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:40.539 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec bash -c ' 2023-11-04T01:40:40.539 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2023-11-04T01:40:40.540 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link set brx.0 up 2023-11-04T01:40:40.540 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link set dev brx.0 master ceph-brx 2023-11-04T01:40:40.540 DEBUG:teuthology.orchestra.run.smithi122:> ') 2023-11-04T01:40:40.585 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-11-04T01:40:40.585 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:40:40.586 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-04T01:40:40.599 INFO:teuthology.orchestra.run.smithi122.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-04T01:40:40.600 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:40:40.600 DEBUG:teuthology.orchestra.run.smithi122:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-04T01:40:40.659 DEBUG:teuthology.orchestra.run.smithi122:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:40:40.715 INFO:teuthology.orchestra.run.smithi122.stdout:/proc 2023-11-04T01:40:40.715 INFO:teuthology.orchestra.run.smithi122.stdout:/sys 2023-11-04T01:40:40.716 INFO:teuthology.orchestra.run.smithi122.stdout:/dev 2023-11-04T01:40:40.716 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/security 2023-11-04T01:40:40.716 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/shm 2023-11-04T01:40:40.716 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/pts 2023-11-04T01:40:40.716 INFO:teuthology.orchestra.run.smithi122.stdout:/run 2023-11-04T01:40:40.717 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/cgroup 2023-11-04T01:40:40.717 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/pstore 2023-11-04T01:40:40.717 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/bpf 2023-11-04T01:40:40.717 INFO:teuthology.orchestra.run.smithi122.stdout:/ 2023-11-04T01:40:40.717 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/selinux 2023-11-04T01:40:40.718 INFO:teuthology.orchestra.run.smithi122.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:40:40.718 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/mqueue 2023-11-04T01:40:40.718 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/hugepages 2023-11-04T01:40:40.718 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/debug 2023-11-04T01:40:40.719 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/tracing 2023-11-04T01:40:40.719 INFO:teuthology.orchestra.run.smithi122.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:40:40.719 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/fuse/connections 2023-11-04T01:40:40.719 INFO:teuthology.orchestra.run.smithi122.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:40:40.719 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/config 2023-11-04T01:40:40.720 INFO:teuthology.orchestra.run.smithi122.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:40:40.720 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:40:40.720 INFO:teuthology.orchestra.run.smithi122.stdout:/run/user/1000 2023-11-04T01:40:40.720 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph 2023-11-04T01:40:40.721 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-4 2023-11-04T01:40:40.721 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-5 2023-11-04T01:40:40.721 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-6 2023-11-04T01:40:40.721 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-7 2023-11-04T01:40:40.722 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns 2023-11-04T01:40:40.722 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:40:40.722 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:40:40.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:40.723 DEBUG:teuthology.orchestra.run.smithi122:> ls /sys/fs/fuse/connections 2023-11-04T01:40:40.770 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:40:40.770 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-11-04T01:40:40.812 DEBUG:teuthology.orchestra.run.smithi122:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:40:40.827 INFO:teuthology.orchestra.run.smithi122.stdout:/proc 2023-11-04T01:40:40.827 INFO:teuthology.orchestra.run.smithi122.stdout:/sys 2023-11-04T01:40:40.827 INFO:teuthology.orchestra.run.smithi122.stdout:/dev 2023-11-04T01:40:40.828 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/security 2023-11-04T01:40:40.828 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/shm 2023-11-04T01:40:40.828 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/pts 2023-11-04T01:40:40.828 INFO:teuthology.orchestra.run.smithi122.stdout:/run 2023-11-04T01:40:40.828 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/cgroup 2023-11-04T01:40:40.829 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/pstore 2023-11-04T01:40:40.829 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/bpf 2023-11-04T01:40:40.829 INFO:teuthology.orchestra.run.smithi122.stdout:/ 2023-11-04T01:40:40.829 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/selinux 2023-11-04T01:40:40.829 INFO:teuthology.orchestra.run.smithi122.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:40:40.829 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/mqueue 2023-11-04T01:40:40.830 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/hugepages 2023-11-04T01:40:40.830 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/debug 2023-11-04T01:40:40.830 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/tracing 2023-11-04T01:40:40.830 INFO:teuthology.orchestra.run.smithi122.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:40:40.830 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/fuse/connections 2023-11-04T01:40:40.831 INFO:teuthology.orchestra.run.smithi122.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:40:40.831 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/config 2023-11-04T01:40:40.831 INFO:teuthology.orchestra.run.smithi122.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:40:40.833 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:40:40.833 INFO:teuthology.orchestra.run.smithi122.stdout:/run/user/1000 2023-11-04T01:40:40.833 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph 2023-11-04T01:40:40.833 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-4 2023-11-04T01:40:40.833 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-5 2023-11-04T01:40:40.834 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-6 2023-11-04T01:40:40.834 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-7 2023-11-04T01:40:40.834 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns 2023-11-04T01:40:40.834 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:40:40.834 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:40:40.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:40.835 DEBUG:teuthology.orchestra.run.smithi122:> ls /sys/fs/fuse/connections 2023-11-04T01:40:40.921 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi122.stderr:2023-11-04T01:40:40.920+0000 7f2a7600f480 -1 init, newargv = 0x558c2450dbe0 newargc=15 2023-11-04T01:40:40.922 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi122.stderr:ceph-fuse[94109]: starting ceph client 2023-11-04T01:40:40.926 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi122.stderr:ceph-fuse[94109]: starting fuse 2023-11-04T01:40:41.983 DEBUG:teuthology.orchestra.run.smithi122:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:40:42.000 INFO:teuthology.orchestra.run.smithi122.stdout:/proc 2023-11-04T01:40:42.001 INFO:teuthology.orchestra.run.smithi122.stdout:/sys 2023-11-04T01:40:42.001 INFO:teuthology.orchestra.run.smithi122.stdout:/dev 2023-11-04T01:40:42.001 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/security 2023-11-04T01:40:42.001 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/shm 2023-11-04T01:40:42.002 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/pts 2023-11-04T01:40:42.002 INFO:teuthology.orchestra.run.smithi122.stdout:/run 2023-11-04T01:40:42.002 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/cgroup 2023-11-04T01:40:42.002 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/pstore 2023-11-04T01:40:42.002 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/bpf 2023-11-04T01:40:42.003 INFO:teuthology.orchestra.run.smithi122.stdout:/ 2023-11-04T01:40:42.003 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/selinux 2023-11-04T01:40:42.003 INFO:teuthology.orchestra.run.smithi122.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:40:42.003 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/mqueue 2023-11-04T01:40:42.003 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/hugepages 2023-11-04T01:40:42.004 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/debug 2023-11-04T01:40:42.004 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/tracing 2023-11-04T01:40:42.004 INFO:teuthology.orchestra.run.smithi122.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:40:42.004 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/fuse/connections 2023-11-04T01:40:42.004 INFO:teuthology.orchestra.run.smithi122.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:40:42.005 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/config 2023-11-04T01:40:42.005 INFO:teuthology.orchestra.run.smithi122.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:40:42.005 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:40:42.005 INFO:teuthology.orchestra.run.smithi122.stdout:/run/user/1000 2023-11-04T01:40:42.005 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph 2023-11-04T01:40:42.006 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-4 2023-11-04T01:40:42.006 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-5 2023-11-04T01:40:42.006 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-6 2023-11-04T01:40:42.006 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-7 2023-11-04T01:40:42.007 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns 2023-11-04T01:40:42.007 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:40:42.007 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:40:42.007 INFO:teuthology.orchestra.run.smithi122.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-04T01:40:42.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:42.008 DEBUG:teuthology.orchestra.run.smithi122:> ls /sys/fs/fuse/connections 2023-11-04T01:40:42.056 INFO:teuthology.orchestra.run.smithi122.stdout:41 2023-11-04T01:40:42.056 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-04T01:40:42.057 DEBUG:teuthology.orchestra.run.smithi122:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:40:42.057 DEBUG:teuthology.orchestra.run.smithi122:> import glob 2023-11-04T01:40:42.057 DEBUG:teuthology.orchestra.run.smithi122:> import re 2023-11-04T01:40:42.058 DEBUG:teuthology.orchestra.run.smithi122:> import os 2023-11-04T01:40:42.058 DEBUG:teuthology.orchestra.run.smithi122:> import subprocess 2023-11-04T01:40:42.058 DEBUG:teuthology.orchestra.run.smithi122:> 2023-11-04T01:40:42.059 DEBUG:teuthology.orchestra.run.smithi122:> def _find_admin_socket(client_name): 2023-11-04T01:40:42.059 DEBUG:teuthology.orchestra.run.smithi122:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-11-04T01:40:42.059 DEBUG:teuthology.orchestra.run.smithi122:> files = glob.glob(asok_path) 2023-11-04T01:40:42.059 DEBUG:teuthology.orchestra.run.smithi122:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-11-04T01:40:42.060 DEBUG:teuthology.orchestra.run.smithi122:> 2023-11-04T01:40:42.060 DEBUG:teuthology.orchestra.run.smithi122:> # Given a non-glob path, it better be there 2023-11-04T01:40:42.060 DEBUG:teuthology.orchestra.run.smithi122:> if "*" not in asok_path: 2023-11-04T01:40:42.061 DEBUG:teuthology.orchestra.run.smithi122:> assert(len(files) == 1) 2023-11-04T01:40:42.061 DEBUG:teuthology.orchestra.run.smithi122:> return files[0] 2023-11-04T01:40:42.061 DEBUG:teuthology.orchestra.run.smithi122:> 2023-11-04T01:40:42.062 DEBUG:teuthology.orchestra.run.smithi122:> for f in files: 2023-11-04T01:40:42.062 DEBUG:teuthology.orchestra.run.smithi122:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:40:42.062 DEBUG:teuthology.orchestra.run.smithi122:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:40:42.062 DEBUG:teuthology.orchestra.run.smithi122:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:40:42.063 DEBUG:teuthology.orchestra.run.smithi122:> contents = proc_f.read() 2023-11-04T01:40:42.063 DEBUG:teuthology.orchestra.run.smithi122:> if mountpoint in contents: 2023-11-04T01:40:42.063 DEBUG:teuthology.orchestra.run.smithi122:> return f 2023-11-04T01:40:42.064 DEBUG:teuthology.orchestra.run.smithi122:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:40:42.064 DEBUG:teuthology.orchestra.run.smithi122:> 2023-11-04T01:40:42.064 DEBUG:teuthology.orchestra.run.smithi122:> print(_find_admin_socket("client.1")) 2023-11-04T01:40:42.065 DEBUG:teuthology.orchestra.run.smithi122:> ' 2023-11-04T01:40:42.178 INFO:teuthology.orchestra.run.smithi122.stdout:/var/run/ceph/ceph-client.1.94109.asok 2023-11-04T01:40:42.181 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:40:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:42.188 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.94109.asok 2023-11-04T01:40:42.189 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:40:42.189 DEBUG:teuthology.orchestra.run.smithi122:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.1.94109.asok status 2023-11-04T01:40:42.286 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:40:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:42.354 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2023-11-04T01:40:42.354 INFO:teuthology.orchestra.run.smithi122.stdout: "metadata": { 2023-11-04T01:40:42.355 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:40:42.355 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:40:42.355 INFO:teuthology.orchestra.run.smithi122.stdout: "entity_id": "1", 2023-11-04T01:40:42.355 INFO:teuthology.orchestra.run.smithi122.stdout: "hostname": "smithi122", 2023-11-04T01:40:42.355 INFO:teuthology.orchestra.run.smithi122.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-11-04T01:40:42.356 INFO:teuthology.orchestra.run.smithi122.stdout: "pid": "94109", 2023-11-04T01:40:42.356 INFO:teuthology.orchestra.run.smithi122.stdout: "root": "/" 2023-11-04T01:40:42.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2023-11-04T01:40:42.356 INFO:teuthology.orchestra.run.smithi122.stdout: "dentry_count": 0, 2023-11-04T01:40:42.357 INFO:teuthology.orchestra.run.smithi122.stdout: "dentry_pinned_count": 0, 2023-11-04T01:40:42.357 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 4759, 2023-11-04T01:40:42.357 INFO:teuthology.orchestra.run.smithi122.stdout: "inst": { 2023-11-04T01:40:42.357 INFO:teuthology.orchestra.run.smithi122.stdout: "name": { 2023-11-04T01:40:42.357 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "client", 2023-11-04T01:40:42.357 INFO:teuthology.orchestra.run.smithi122.stdout: "num": 4759 2023-11-04T01:40:42.358 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2023-11-04T01:40:42.358 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": { 2023-11-04T01:40:42.358 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2023-11-04T01:40:42.358 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:40:42.358 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 4049252968 2023-11-04T01:40:42.359 INFO:teuthology.orchestra.run.smithi122.stdout: } 2023-11-04T01:40:42.359 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2023-11-04T01:40:42.359 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": { 2023-11-04T01:40:42.359 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2023-11-04T01:40:42.359 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:40:42.360 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 4049252968 2023-11-04T01:40:42.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2023-11-04T01:40:42.360 INFO:teuthology.orchestra.run.smithi122.stdout: "inst_str": "client.4759 192.168.0.1:0/4049252968", 2023-11-04T01:40:42.360 INFO:teuthology.orchestra.run.smithi122.stdout: "addr_str": "192.168.0.1:0/4049252968", 2023-11-04T01:40:42.360 INFO:teuthology.orchestra.run.smithi122.stdout: "inode_count": 1, 2023-11-04T01:40:42.361 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_epoch": 9, 2023-11-04T01:40:42.361 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_epoch": 24, 2023-11-04T01:40:42.361 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:40:42.361 INFO:teuthology.orchestra.run.smithi122.stdout: "blocklisted": false, 2023-11-04T01:40:42.361 INFO:teuthology.orchestra.run.smithi122.stdout: "fs_name": "cephfs" 2023-11-04T01:40:42.362 INFO:teuthology.orchestra.run.smithi122.stdout:} 2023-11-04T01:40:42.362 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:40:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:42.368 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:40:42.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.477+0000 7f4185f9e640 1 Processor -- start 2023-11-04T01:40:42.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.478+0000 7f4185f9e640 1 -- start start 2023-11-04T01:40:42.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.478+0000 7f4185f9e640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f41800b42c0 0x7f41800c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:42.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.478+0000 7f4185f9e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41800c9c40 0x7f41800b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:42.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.478+0000 7f4185f9e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41800ca090 con 0x7f418015ad80 2023-11-04T01:40:42.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.478+0000 7f4185f9e640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f418006cfa0 con 0x7f41800b42c0 2023-11-04T01:40:42.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.478+0000 7f4185f9e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418006d280 con 0x7f41800c9c40 2023-11-04T01:40:42.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.479+0000 7f417f7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f418015ad80 0x7f418006c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:39870/0 (socket says 172.21.15.77:39870) 2023-11-04T01:40:42.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.479+0000 7f417f7fe640 1 -- 172.21.15.77:0/3745979399 learned_addr learned my addr 172.21.15.77:0/3745979399 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:42.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.479+0000 7f417effd640 1 --2- 172.21.15.77:0/3745979399 >> v2:172.21.15.122:3300/0 conn(0x7f41800b42c0 0x7f41800c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:42.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.479+0000 7f417ffff640 1 --2- 172.21.15.77:0/3745979399 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41800c9c40 0x7f41800b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:42.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.479+0000 7f417e7fc640 1 -- 172.21.15.77:0/3745979399 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 890151826 0 0) 0x7f4170001110 con 0x7f418015ad80 2023-11-04T01:40:42.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.479+0000 7f417e7fc640 1 -- 172.21.15.77:0/3745979399 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4168003520 con 0x7f418015ad80 2023-11-04T01:40:42.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.479+0000 7f417e7fc640 1 -- 172.21.15.77:0/3745979399 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2854398908 0 0) 0x7f4168003520 con 0x7f418015ad80 2023-11-04T01:40:42.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.479+0000 7f417e7fc640 1 -- 172.21.15.77:0/3745979399 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41800c9c40 msgr2=0x7f41800b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:42.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.479+0000 7f417e7fc640 1 --2- 172.21.15.77:0/3745979399 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41800c9c40 0x7f41800b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.479+0000 7f417e7fc640 1 -- 172.21.15.77:0/3745979399 >> v2:172.21.15.122:3300/0 conn(0x7f41800b42c0 msgr2=0x7f41800c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:42.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.479+0000 7f417e7fc640 1 --2- 172.21.15.77:0/3745979399 >> v2:172.21.15.122:3300/0 conn(0x7f41800b42c0 0x7f41800c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.479+0000 7f417e7fc640 1 -- 172.21.15.77:0/3745979399 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418006d560 con 0x7f418015ad80 2023-11-04T01:40:42.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.479+0000 7f417e7fc640 1 -- 172.21.15.77:0/3745979399 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f4170001800 con 0x7f418015ad80 2023-11-04T01:40:42.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.479+0000 7f417e7fc640 1 -- 172.21.15.77:0/3745979399 >> v1:172.21.15.77:6789/0 conn(0x7f418015ad80 legacy=0x7f418006c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:42.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.479+0000 7f417e7fc640 1 --2- 172.21.15.77:0/3745979399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4168003970 0x7f4168003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:42.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.479+0000 7f417e7fc640 1 --2- 172.21.15.77:0/3745979399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41680047c0 0x7f4168004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:42.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.479+0000 7f417e7fc640 1 --2- 172.21.15.77:0/3745979399 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41800c9c40 0x7f4168005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:42.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.479+0000 7f417e7fc640 1 -- 172.21.15.77:0/3745979399 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418006cfa0 con 0x7f4168003970 2023-11-04T01:40:42.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.479+0000 7f417e7fc640 1 -- 172.21.15.77:0/3745979399 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418006d280 con 0x7f41680047c0 2023-11-04T01:40:42.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.479+0000 7f417e7fc640 1 -- 172.21.15.77:0/3745979399 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f416800b980 con 0x7f41800c9c40 2023-11-04T01:40:42.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.479+0000 7f417f7fe640 1 --2- 172.21.15.77:0/3745979399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4168003970 0x7f4168003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:42.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.479+0000 7f417effd640 1 --2- 172.21.15.77:0/3745979399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41680047c0 0x7f4168004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:42.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.479+0000 7f417ffff640 1 --2- 172.21.15.77:0/3745979399 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41800c9c40 0x7f4168005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:42.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.480+0000 7f417f7fe640 1 -- 172.21.15.77:0/3745979399 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41800c9c40 msgr2=0x7f4168005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:42.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.480+0000 7f417f7fe640 1 --2- 172.21.15.77:0/3745979399 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41800c9c40 0x7f4168005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.480+0000 7f417f7fe640 1 -- 172.21.15.77:0/3745979399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41680047c0 msgr2=0x7f4168004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:42.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.480+0000 7f417f7fe640 1 --2- 172.21.15.77:0/3745979399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41680047c0 0x7f4168004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.480+0000 7f417f7fe640 1 -- 172.21.15.77:0/3745979399 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4168003520 con 0x7f4168003970 2023-11-04T01:40:42.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.480+0000 7f417effd640 1 --2- 172.21.15.77:0/3745979399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41680047c0 0x7f4168004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:42.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.480+0000 7f417f7fe640 1 --2- 172.21.15.77:0/3745979399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4168003970 0x7f4168003d90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f417000c210 tx=0x7f41680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=333d06c38a1ab6de server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:42.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.480+0000 7f417e7fc640 1 -- 172.21.15.77:0/3745979399 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4170005ad0 con 0x7f4168003970 2023-11-04T01:40:42.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.481+0000 7f417e7fc640 1 -- 172.21.15.77:0/3745979399 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4170005c30 con 0x7f4168003970 2023-11-04T01:40:42.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.481+0000 7f417e7fc640 1 -- 172.21.15.77:0/3745979399 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417002c8d0 con 0x7f4168003970 2023-11-04T01:40:42.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.481+0000 7f4185f9e640 1 -- 172.21.15.77:0/3745979399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4168003970 msgr2=0x7f4168003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:42.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.481+0000 7f4185f9e640 1 --2- 172.21.15.77:0/3745979399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4168003970 0x7f4168003d90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f417000c210 tx=0x7f41680057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.481+0000 7f417ffff640 1 -- 172.21.15.77:0/3745979399 reap_dead start 2023-11-04T01:40:42.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.481+0000 7f4185f9e640 1 -- 172.21.15.77:0/3745979399 shutdown_connections 2023-11-04T01:40:42.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.481+0000 7f4185f9e640 1 -- 172.21.15.77:0/3745979399 >> 172.21.15.77:0/3745979399 conn(0x7f41800ce950 msgr2=0x7f41800ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:42.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.481+0000 7f4185f9e640 1 -- 172.21.15.77:0/3745979399 shutdown_connections 2023-11-04T01:40:42.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.481+0000 7f4185f9e640 1 -- 172.21.15.77:0/3745979399 wait complete. 2023-11-04T01:40:42.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.482+0000 7f4185f9e640 1 Processor -- start 2023-11-04T01:40:42.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.483+0000 7f4185f9e640 1 -- start start 2023-11-04T01:40:42.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.483+0000 7f4185f9e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4168003970 0x7f418014ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:42.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.483+0000 7f4185f9e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f418015c1b0 0x7f41800c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:42.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.483+0000 7f4185f9e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f418015c630 0x7f41800c7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:42.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.483+0000 7f4185f9e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41800ac3e0 con 0x7f4168003970 2023-11-04T01:40:42.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.483+0000 7f4185f9e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41800c8110 con 0x7f418015c630 2023-11-04T01:40:42.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.483+0000 7f4185f9e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41800ce200 con 0x7f418015c1b0 2023-11-04T01:40:42.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.483+0000 7f417f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4168003970 0x7f418014ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:42.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.483+0000 7f417f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4168003970 0x7f418014ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48682/0 (socket says 172.21.15.77:48682) 2023-11-04T01:40:42.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.483+0000 7f417f7fe640 1 -- 172.21.15.77:0/3115002274 learned_addr learned my addr 172.21.15.77:0/3115002274 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:42.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.483+0000 7f417ffff640 1 --2- 172.21.15.77:0/3115002274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f418015c630 0x7f41800c7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:42.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.484+0000 7f417effd640 1 --2- 172.21.15.77:0/3115002274 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f418015c1b0 0x7f41800c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:42.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.484+0000 7f417f7fe640 1 -- 172.21.15.77:0/3115002274 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f418015c1b0 msgr2=0x7f41800c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:42.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.484+0000 7f417f7fe640 1 --2- 172.21.15.77:0/3115002274 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f418015c1b0 0x7f41800c75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.484+0000 7f417f7fe640 1 -- 172.21.15.77:0/3115002274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f418015c630 msgr2=0x7f41800c7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:42.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.484+0000 7f417f7fe640 1 --2- 172.21.15.77:0/3115002274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f418015c630 0x7f41800c7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.484+0000 7f417f7fe640 1 -- 172.21.15.77:0/3115002274 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41800aba80 con 0x7f4168003970 2023-11-04T01:40:42.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.484+0000 7f417f7fe640 1 --2- 172.21.15.77:0/3115002274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4168003970 0x7f418014ff90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f417002c540 tx=0x7f4170000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:42.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.484+0000 7f4167fff640 1 -- 172.21.15.77:0/3115002274 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417002cce0 con 0x7f4168003970 2023-11-04T01:40:42.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.484+0000 7f4167fff640 1 -- 172.21.15.77:0/3115002274 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417002ce40 con 0x7f4168003970 2023-11-04T01:40:42.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.484+0000 7f4185f9e640 1 -- 172.21.15.77:0/3115002274 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41800abd20 con 0x7f4168003970 2023-11-04T01:40:42.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.484+0000 7f4167fff640 1 -- 172.21.15.77:0/3115002274 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41700072b0 con 0x7f4168003970 2023-11-04T01:40:42.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.484+0000 7f4185f9e640 1 -- 172.21.15.77:0/3115002274 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41800ccf40 con 0x7f4168003970 2023-11-04T01:40:42.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.485+0000 7f4185f9e640 1 -- 172.21.15.77:0/3115002274 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41800ac650 con 0x7f4168003970 2023-11-04T01:40:42.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.486+0000 7f4167fff640 1 -- 172.21.15.77:0/3115002274 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4170032070 con 0x7f4168003970 2023-11-04T01:40:42.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.486+0000 7f4167fff640 1 --2- 172.21.15.77:0/3115002274 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f416c06aea0 0x7f416c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:42.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.486+0000 7f4167fff640 1 -- 172.21.15.77:0/3115002274 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f417003c040 con 0x7f4168003970 2023-11-04T01:40:42.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.486+0000 7f417effd640 1 --2- 172.21.15.77:0/3115002274 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f416c06aea0 0x7f416c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:42.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.487+0000 7f417effd640 1 --2- 172.21.15.77:0/3115002274 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f416c06aea0 0x7f416c06d360 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f41800b0b60 tx=0x7f4174009190 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:42.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.490+0000 7f4167fff640 1 -- 172.21.15.77:0/3115002274 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4170075aa0 con 0x7f4168003970 2023-11-04T01:40:42.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.692+0000 7f4185f9e640 1 -- 172.21.15.77:0/3115002274 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f41800ca090 con 0x7f4168003970 2023-11-04T01:40:42.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.692+0000 7f4167fff640 1 -- 172.21.15.77:0/3115002274 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f41800ca090 con 0x7f4168003970 2023-11-04T01:40:42.694 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-04T01:40:42.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.694+0000 7f4185f9e640 1 -- 172.21.15.77:0/3115002274 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f416c06aea0 msgr2=0x7f416c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:42.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.694+0000 7f4185f9e640 1 --2- 172.21.15.77:0/3115002274 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f416c06aea0 0x7f416c06d360 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f41800b0b60 tx=0x7f4174009190 comp rx=0 tx=0).stop 2023-11-04T01:40:42.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.694+0000 7f4185f9e640 1 -- 172.21.15.77:0/3115002274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4168003970 msgr2=0x7f418014ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:42.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.694+0000 7f4185f9e640 1 --2- 172.21.15.77:0/3115002274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4168003970 0x7f418014ff90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f417002c540 tx=0x7f4170000fe0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.694+0000 7f4185f9e640 1 -- 172.21.15.77:0/3115002274 shutdown_connections 2023-11-04T01:40:42.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.694+0000 7f4185f9e640 1 --2- 172.21.15.77:0/3115002274 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f416c06aea0 0x7f416c06d360 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.694+0000 7f4185f9e640 1 --2- 172.21.15.77:0/3115002274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f418015c630 0x7f41800c7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.694+0000 7f4185f9e640 1 --2- 172.21.15.77:0/3115002274 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f418015c1b0 0x7f41800c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.694+0000 7f4185f9e640 1 --2- 172.21.15.77:0/3115002274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4168003970 0x7f418014ff90 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:42.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.694+0000 7f4185f9e640 1 -- 172.21.15.77:0/3115002274 >> 172.21.15.77:0/3115002274 conn(0x7f41800ce950 msgr2=0x7f41800ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:42.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.694+0000 7f4185f9e640 1 -- 172.21.15.77:0/3115002274 shutdown_connections 2023-11-04T01:40:42.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:42.694+0000 7f4185f9e640 1 -- 172.21.15.77:0/3115002274 wait complete. 2023-11-04T01:40:42.706 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:40:42.707 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:40:42.707 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi122.front.sepia.ceph.com 2023-11-04T01:40:42.707 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-04T01:40:42.707 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-04T01:40:42.708 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:40:42.708 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:40:42.708 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:40:42.708 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-04T01:40:42.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:42.709 DEBUG:teuthology.orchestra.run.smithi122:> ip addr 2023-11-04T01:40:42.725 INFO:teuthology.orchestra.run.smithi122.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:40:42.725 INFO:teuthology.orchestra.run.smithi122.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:40:42.725 INFO:teuthology.orchestra.run.smithi122.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:40:42.725 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:42.726 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 ::1/128 scope host 2023-11-04T01:40:42.726 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:42.726 INFO:teuthology.orchestra.run.smithi122.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:40:42.726 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:d8:d9:e4 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:42.726 INFO:teuthology.orchestra.run.smithi122.stdout: altname enp7s0f0 2023-11-04T01:40:42.727 INFO:teuthology.orchestra.run.smithi122.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:40:42.727 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:d8:d9:e5 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:42.727 INFO:teuthology.orchestra.run.smithi122.stdout: altname enp7s0f1 2023-11-04T01:40:42.727 INFO:teuthology.orchestra.run.smithi122.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:40:42.727 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:8f:d5:14 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:42.727 INFO:teuthology.orchestra.run.smithi122.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:40:42.728 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:8f:d5:15 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:42.728 INFO:teuthology.orchestra.run.smithi122.stdout: inet 172.21.15.122/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:40:42.728 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft 42381sec preferred_lft 42381sec 2023-11-04T01:40:42.728 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::ec4:7aff:fe8f:d515/64 scope link 2023-11-04T01:40:42.728 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:42.729 INFO:teuthology.orchestra.run.smithi122.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:40:42.729 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 26:78:23:cb:4b:48 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:40:42.729 INFO:teuthology.orchestra.run.smithi122.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:40:42.729 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:42.729 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::dc02:9bff:fef2:e469/64 scope link 2023-11-04T01:40:42.730 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:42.730 INFO:teuthology.orchestra.run.smithi122.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:40:42.730 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 26:78:23:cb:4b:48 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:40:42.730 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::2478:23ff:fecb:4b48/64 scope link 2023-11-04T01:40:42.730 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:42.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:42.731 DEBUG:teuthology.orchestra.run.smithi122:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:40:42.790 INFO:teuthology.orchestra.run.smithi122.stdout:1 2023-11-04T01:40:42.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:42.792 DEBUG:teuthology.orchestra.run.smithi122:> route 2023-11-04T01:40:42.847 INFO:teuthology.orchestra.run.smithi122.stdout:Kernel IP routing table 2023-11-04T01:40:42.847 INFO:teuthology.orchestra.run.smithi122.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:40:42.848 INFO:teuthology.orchestra.run.smithi122.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:40:42.848 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:40:42.848 INFO:teuthology.orchestra.run.smithi122.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:40:42.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:42.849 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec bash -c ' 2023-11-04T01:40:42.849 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2023-11-04T01:40:42.849 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:40:42.850 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:40:42.850 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:40:42.850 DEBUG:teuthology.orchestra.run.smithi122:> ') 2023-11-04T01:40:42.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:42.943 DEBUG:teuthology.orchestra.run.smithi122:> ip netns list 2023-11-04T01:40:42.958 INFO:teuthology.orchestra.run.smithi122.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-04T01:40:42.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:42.959 DEBUG:teuthology.orchestra.run.smithi122:> ip netns list-id 2023-11-04T01:40:43.013 INFO:teuthology.orchestra.run.smithi122.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-04T01:40:43.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:43.014 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec bash -c ' 2023-11-04T01:40:43.014 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2023-11-04T01:40:43.015 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:40:43.015 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-04T01:40:43.015 DEBUG:teuthology.orchestra.run.smithi122:> ') 2023-11-04T01:40:43.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:43.095 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-04T01:40:43.162 INFO:teuthology.orchestra.run.smithi122.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:40:43.162 INFO:teuthology.orchestra.run.smithi122.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:40:43.162 INFO:teuthology.orchestra.run.smithi122.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:40:43.163 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:43.163 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 ::1/128 scope host 2023-11-04T01:40:43.163 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:43.163 INFO:teuthology.orchestra.run.smithi122.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:40:43.163 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 8e:52:f7:0d:53:9a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-04T01:40:43.164 INFO:teuthology.orchestra.run.smithi122.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-04T01:40:43.164 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:43.164 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::8c52:f7ff:fe0d:539a/64 scope link 2023-11-04T01:40:43.164 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:43.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:43.166 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-04T01:40:43.232 INFO:teuthology.orchestra.run.smithi122.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:40:43.232 INFO:teuthology.orchestra.run.smithi122.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:40:43.232 INFO:teuthology.orchestra.run.smithi122.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:40:43.232 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:43.233 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 ::1/128 scope host 2023-11-04T01:40:43.233 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:43.233 INFO:teuthology.orchestra.run.smithi122.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:40:43.233 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 8e:52:f7:0d:53:9a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-04T01:40:43.233 INFO:teuthology.orchestra.run.smithi122.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-04T01:40:43.234 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:43.234 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::8c52:f7ff:fe0d:539a/64 scope link 2023-11-04T01:40:43.234 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:40:43.235 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-04T01:40:43.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:43.236 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec bash -c ' 2023-11-04T01:40:43.236 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2023-11-04T01:40:43.236 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-04T01:40:43.237 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-04T01:40:43.237 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-04T01:40:43.237 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-04T01:40:43.238 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-04T01:40:43.238 DEBUG:teuthology.orchestra.run.smithi122:> ') 2023-11-04T01:40:43.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:43.359 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec bash -c ' 2023-11-04T01:40:43.360 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2023-11-04T01:40:43.360 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link set brx.1 up 2023-11-04T01:40:43.360 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link set dev brx.1 master ceph-brx 2023-11-04T01:40:43.361 DEBUG:teuthology.orchestra.run.smithi122:> ') 2023-11-04T01:40:43.402 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-11-04T01:40:43.402 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:40:43.403 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-04T01:40:43.457 INFO:teuthology.orchestra.run.smithi122.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-04T01:40:43.458 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:40:43.459 DEBUG:teuthology.orchestra.run.smithi122:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-04T01:40:43.512 DEBUG:teuthology.orchestra.run.smithi122:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:40:43.567 INFO:teuthology.orchestra.run.smithi122.stdout:/proc 2023-11-04T01:40:43.567 INFO:teuthology.orchestra.run.smithi122.stdout:/sys 2023-11-04T01:40:43.568 INFO:teuthology.orchestra.run.smithi122.stdout:/dev 2023-11-04T01:40:43.568 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/security 2023-11-04T01:40:43.568 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/shm 2023-11-04T01:40:43.568 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/pts 2023-11-04T01:40:43.568 INFO:teuthology.orchestra.run.smithi122.stdout:/run 2023-11-04T01:40:43.569 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/cgroup 2023-11-04T01:40:43.569 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/pstore 2023-11-04T01:40:43.569 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/bpf 2023-11-04T01:40:43.569 INFO:teuthology.orchestra.run.smithi122.stdout:/ 2023-11-04T01:40:43.570 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/selinux 2023-11-04T01:40:43.570 INFO:teuthology.orchestra.run.smithi122.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:40:43.570 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/mqueue 2023-11-04T01:40:43.570 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/hugepages 2023-11-04T01:40:43.570 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/debug 2023-11-04T01:40:43.571 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/tracing 2023-11-04T01:40:43.571 INFO:teuthology.orchestra.run.smithi122.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:40:43.571 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/fuse/connections 2023-11-04T01:40:43.571 INFO:teuthology.orchestra.run.smithi122.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:40:43.571 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/config 2023-11-04T01:40:43.572 INFO:teuthology.orchestra.run.smithi122.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:40:43.572 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:40:43.572 INFO:teuthology.orchestra.run.smithi122.stdout:/run/user/1000 2023-11-04T01:40:43.572 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph 2023-11-04T01:40:43.573 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-4 2023-11-04T01:40:43.573 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-5 2023-11-04T01:40:43.573 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-6 2023-11-04T01:40:43.573 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-7 2023-11-04T01:40:43.573 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns 2023-11-04T01:40:43.573 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:40:43.574 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:40:43.574 INFO:teuthology.orchestra.run.smithi122.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-04T01:40:43.574 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:40:43.574 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:40:43.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:43.575 DEBUG:teuthology.orchestra.run.smithi122:> ls /sys/fs/fuse/connections 2023-11-04T01:40:43.622 INFO:teuthology.orchestra.run.smithi122.stdout:41 2023-11-04T01:40:43.623 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2023-11-04T01:40:43.623 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-11-04T01:40:43.665 DEBUG:teuthology.orchestra.run.smithi122:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:40:43.681 INFO:teuthology.orchestra.run.smithi122.stdout:/proc 2023-11-04T01:40:43.681 INFO:teuthology.orchestra.run.smithi122.stdout:/sys 2023-11-04T01:40:43.682 INFO:teuthology.orchestra.run.smithi122.stdout:/dev 2023-11-04T01:40:43.682 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/security 2023-11-04T01:40:43.682 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/shm 2023-11-04T01:40:43.682 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/pts 2023-11-04T01:40:43.682 INFO:teuthology.orchestra.run.smithi122.stdout:/run 2023-11-04T01:40:43.683 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/cgroup 2023-11-04T01:40:43.683 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/pstore 2023-11-04T01:40:43.683 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/bpf 2023-11-04T01:40:43.683 INFO:teuthology.orchestra.run.smithi122.stdout:/ 2023-11-04T01:40:43.684 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/selinux 2023-11-04T01:40:43.684 INFO:teuthology.orchestra.run.smithi122.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:40:43.684 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/mqueue 2023-11-04T01:40:43.684 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/hugepages 2023-11-04T01:40:43.685 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/debug 2023-11-04T01:40:43.685 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/tracing 2023-11-04T01:40:43.685 INFO:teuthology.orchestra.run.smithi122.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:40:43.685 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/fuse/connections 2023-11-04T01:40:43.685 INFO:teuthology.orchestra.run.smithi122.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:40:43.686 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/config 2023-11-04T01:40:43.686 INFO:teuthology.orchestra.run.smithi122.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:40:43.686 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:40:43.686 INFO:teuthology.orchestra.run.smithi122.stdout:/run/user/1000 2023-11-04T01:40:43.686 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph 2023-11-04T01:40:43.687 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-4 2023-11-04T01:40:43.687 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-5 2023-11-04T01:40:43.687 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-6 2023-11-04T01:40:43.687 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-7 2023-11-04T01:40:43.687 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns 2023-11-04T01:40:43.688 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:40:43.688 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:40:43.688 INFO:teuthology.orchestra.run.smithi122.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-04T01:40:43.688 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:40:43.688 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:40:43.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:43.689 DEBUG:teuthology.orchestra.run.smithi122:> ls /sys/fs/fuse/connections 2023-11-04T01:40:43.737 INFO:teuthology.orchestra.run.smithi122.stdout:41 2023-11-04T01:40:43.755 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi122.stderr:2023-11-04T01:40:43.754+0000 7f2d9ae6a480 -1 init, newargv = 0x557b0ca66020 newargc=15 2023-11-04T01:40:43.756 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi122.stderr:ceph-fuse[94561]: starting ceph client 2023-11-04T01:40:43.759 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi122.stderr:ceph-fuse[94561]: starting fuse 2023-11-04T01:40:44.839 DEBUG:teuthology.orchestra.run.smithi122:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:40:44.859 INFO:teuthology.orchestra.run.smithi122.stdout:/proc 2023-11-04T01:40:44.859 INFO:teuthology.orchestra.run.smithi122.stdout:/sys 2023-11-04T01:40:44.859 INFO:teuthology.orchestra.run.smithi122.stdout:/dev 2023-11-04T01:40:44.859 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/security 2023-11-04T01:40:44.860 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/shm 2023-11-04T01:40:44.860 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/pts 2023-11-04T01:40:44.860 INFO:teuthology.orchestra.run.smithi122.stdout:/run 2023-11-04T01:40:44.860 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/cgroup 2023-11-04T01:40:44.860 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/pstore 2023-11-04T01:40:44.861 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/bpf 2023-11-04T01:40:44.861 INFO:teuthology.orchestra.run.smithi122.stdout:/ 2023-11-04T01:40:44.861 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/selinux 2023-11-04T01:40:44.861 INFO:teuthology.orchestra.run.smithi122.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:40:44.861 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/mqueue 2023-11-04T01:40:44.861 INFO:teuthology.orchestra.run.smithi122.stdout:/dev/hugepages 2023-11-04T01:40:44.862 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/debug 2023-11-04T01:40:44.862 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/tracing 2023-11-04T01:40:44.862 INFO:teuthology.orchestra.run.smithi122.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:40:44.862 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/fs/fuse/connections 2023-11-04T01:40:44.862 INFO:teuthology.orchestra.run.smithi122.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:40:44.863 INFO:teuthology.orchestra.run.smithi122.stdout:/sys/kernel/config 2023-11-04T01:40:44.863 INFO:teuthology.orchestra.run.smithi122.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:40:44.863 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:40:44.863 INFO:teuthology.orchestra.run.smithi122.stdout:/run/user/1000 2023-11-04T01:40:44.863 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph 2023-11-04T01:40:44.863 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-4 2023-11-04T01:40:44.864 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-5 2023-11-04T01:40:44.864 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-6 2023-11-04T01:40:44.864 INFO:teuthology.orchestra.run.smithi122.stdout:/var/lib/ceph/osd/ceph-7 2023-11-04T01:40:44.864 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns 2023-11-04T01:40:44.864 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:40:44.864 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:40:44.865 INFO:teuthology.orchestra.run.smithi122.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-04T01:40:44.865 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:40:44.865 INFO:teuthology.orchestra.run.smithi122.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:40:44.865 INFO:teuthology.orchestra.run.smithi122.stdout:/home/ubuntu/cephtest/mnt.3 2023-11-04T01:40:44.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:44.866 DEBUG:teuthology.orchestra.run.smithi122:> ls /sys/fs/fuse/connections 2023-11-04T01:40:44.916 INFO:teuthology.orchestra.run.smithi122.stdout:41 2023-11-04T01:40:44.916 INFO:teuthology.orchestra.run.smithi122.stdout:44 2023-11-04T01:40:44.917 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2023-11-04T01:40:44.917 DEBUG:teuthology.orchestra.run.smithi122:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:40:44.918 DEBUG:teuthology.orchestra.run.smithi122:> import glob 2023-11-04T01:40:44.918 DEBUG:teuthology.orchestra.run.smithi122:> import re 2023-11-04T01:40:44.918 DEBUG:teuthology.orchestra.run.smithi122:> import os 2023-11-04T01:40:44.918 DEBUG:teuthology.orchestra.run.smithi122:> import subprocess 2023-11-04T01:40:44.919 DEBUG:teuthology.orchestra.run.smithi122:> 2023-11-04T01:40:44.919 DEBUG:teuthology.orchestra.run.smithi122:> def _find_admin_socket(client_name): 2023-11-04T01:40:44.919 DEBUG:teuthology.orchestra.run.smithi122:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-11-04T01:40:44.920 DEBUG:teuthology.orchestra.run.smithi122:> files = glob.glob(asok_path) 2023-11-04T01:40:44.920 DEBUG:teuthology.orchestra.run.smithi122:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-11-04T01:40:44.920 DEBUG:teuthology.orchestra.run.smithi122:> 2023-11-04T01:40:44.921 DEBUG:teuthology.orchestra.run.smithi122:> # Given a non-glob path, it better be there 2023-11-04T01:40:44.921 DEBUG:teuthology.orchestra.run.smithi122:> if "*" not in asok_path: 2023-11-04T01:40:44.921 DEBUG:teuthology.orchestra.run.smithi122:> assert(len(files) == 1) 2023-11-04T01:40:44.921 DEBUG:teuthology.orchestra.run.smithi122:> return files[0] 2023-11-04T01:40:44.922 DEBUG:teuthology.orchestra.run.smithi122:> 2023-11-04T01:40:44.923 DEBUG:teuthology.orchestra.run.smithi122:> for f in files: 2023-11-04T01:40:44.923 DEBUG:teuthology.orchestra.run.smithi122:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:40:44.924 DEBUG:teuthology.orchestra.run.smithi122:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:40:44.924 DEBUG:teuthology.orchestra.run.smithi122:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:40:44.924 DEBUG:teuthology.orchestra.run.smithi122:> contents = proc_f.read() 2023-11-04T01:40:44.925 DEBUG:teuthology.orchestra.run.smithi122:> if mountpoint in contents: 2023-11-04T01:40:44.925 DEBUG:teuthology.orchestra.run.smithi122:> return f 2023-11-04T01:40:44.926 DEBUG:teuthology.orchestra.run.smithi122:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:40:44.926 DEBUG:teuthology.orchestra.run.smithi122:> 2023-11-04T01:40:44.926 DEBUG:teuthology.orchestra.run.smithi122:> print(_find_admin_socket("client.3")) 2023-11-04T01:40:44.927 DEBUG:teuthology.orchestra.run.smithi122:> ' 2023-11-04T01:40:45.043 INFO:teuthology.orchestra.run.smithi122.stdout:/var/run/ceph/ceph-client.3.94561.asok 2023-11-04T01:40:45.047 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:40:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:45.054 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.94561.asok 2023-11-04T01:40:45.054 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:40:45.055 DEBUG:teuthology.orchestra.run.smithi122:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.3.94561.asok status 2023-11-04T01:40:45.153 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:40:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:45.222 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2023-11-04T01:40:45.222 INFO:teuthology.orchestra.run.smithi122.stdout: "metadata": { 2023-11-04T01:40:45.223 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:40:45.223 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:40:45.224 INFO:teuthology.orchestra.run.smithi122.stdout: "entity_id": "3", 2023-11-04T01:40:45.224 INFO:teuthology.orchestra.run.smithi122.stdout: "hostname": "smithi122", 2023-11-04T01:40:45.224 INFO:teuthology.orchestra.run.smithi122.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-11-04T01:40:45.225 INFO:teuthology.orchestra.run.smithi122.stdout: "pid": "94561", 2023-11-04T01:40:45.225 INFO:teuthology.orchestra.run.smithi122.stdout: "root": "/" 2023-11-04T01:40:45.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2023-11-04T01:40:45.226 INFO:teuthology.orchestra.run.smithi122.stdout: "dentry_count": 0, 2023-11-04T01:40:45.226 INFO:teuthology.orchestra.run.smithi122.stdout: "dentry_pinned_count": 0, 2023-11-04T01:40:45.226 INFO:teuthology.orchestra.run.smithi122.stdout: "id": 4771, 2023-11-04T01:40:45.227 INFO:teuthology.orchestra.run.smithi122.stdout: "inst": { 2023-11-04T01:40:45.227 INFO:teuthology.orchestra.run.smithi122.stdout: "name": { 2023-11-04T01:40:45.227 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "client", 2023-11-04T01:40:45.227 INFO:teuthology.orchestra.run.smithi122.stdout: "num": 4771 2023-11-04T01:40:45.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2023-11-04T01:40:45.228 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": { 2023-11-04T01:40:45.228 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2023-11-04T01:40:45.229 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "192.168.0.2:0", 2023-11-04T01:40:45.229 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3511427111 2023-11-04T01:40:45.229 INFO:teuthology.orchestra.run.smithi122.stdout: } 2023-11-04T01:40:45.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2023-11-04T01:40:45.230 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": { 2023-11-04T01:40:45.230 INFO:teuthology.orchestra.run.smithi122.stdout: "type": "v1", 2023-11-04T01:40:45.230 INFO:teuthology.orchestra.run.smithi122.stdout: "addr": "192.168.0.2:0", 2023-11-04T01:40:45.231 INFO:teuthology.orchestra.run.smithi122.stdout: "nonce": 3511427111 2023-11-04T01:40:45.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2023-11-04T01:40:45.231 INFO:teuthology.orchestra.run.smithi122.stdout: "inst_str": "client.4771 192.168.0.2:0/3511427111", 2023-11-04T01:40:45.231 INFO:teuthology.orchestra.run.smithi122.stdout: "addr_str": "192.168.0.2:0/3511427111", 2023-11-04T01:40:45.231 INFO:teuthology.orchestra.run.smithi122.stdout: "inode_count": 1, 2023-11-04T01:40:45.232 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_epoch": 9, 2023-11-04T01:40:45.232 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_epoch": 24, 2023-11-04T01:40:45.232 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:40:45.232 INFO:teuthology.orchestra.run.smithi122.stdout: "blocklisted": false, 2023-11-04T01:40:45.232 INFO:teuthology.orchestra.run.smithi122.stdout: "fs_name": "cephfs" 2023-11-04T01:40:45.233 INFO:teuthology.orchestra.run.smithi122.stdout:} 2023-11-04T01:40:45.233 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:40:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:45.236 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:40:45.236 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:40:45.237 DEBUG:teuthology.orchestra.run.smithi077:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:40:45.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:45.305 INFO:teuthology.orchestra.run.smithi077.stdout:fuseblk 2023-11-04T01:40:45.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:45.312 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:40:45.313 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:40:45.313 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:40:45.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:45.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:45.381 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:40:45.382 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:40:45.382 DEBUG:teuthology.orchestra.run.smithi077:> ' -- /home/ubuntu/cephtest/mnt.2 2023-11-04T01:40:45.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:45.445 INFO:teuthology.orchestra.run.smithi077.stdout:fuseblk 2023-11-04T01:40:45.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:45.451 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-11-04T01:40:45.452 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:40:45.453 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-04T01:40:45.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:45.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:45.517 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:40:45.518 DEBUG:teuthology.orchestra.run.smithi122:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:40:45.518 DEBUG:teuthology.orchestra.run.smithi122:> ' -- /home/ubuntu/cephtest/mnt.1 2023-11-04T01:40:45.580 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:40:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:45.581 INFO:teuthology.orchestra.run.smithi122.stdout:fuseblk 2023-11-04T01:40:45.581 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:40:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:45.587 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-11-04T01:40:45.588 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:40:45.588 DEBUG:teuthology.orchestra.run.smithi122:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-04T01:40:45.646 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:40:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:45.647 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:40:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:45.653 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:40:45.653 DEBUG:teuthology.orchestra.run.smithi122:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:40:45.654 DEBUG:teuthology.orchestra.run.smithi122:> ' -- /home/ubuntu/cephtest/mnt.3 2023-11-04T01:40:45.711 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:40:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:45.712 INFO:teuthology.orchestra.run.smithi122.stdout:fuseblk 2023-11-04T01:40:45.712 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:40:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:45.718 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-11-04T01:40:45.719 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:40:45.719 DEBUG:teuthology.orchestra.run.smithi122:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-04T01:40:45.777 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:40:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:45.778 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:40:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:45.784 INFO:teuthology.run_tasks:Running task exec... 2023-11-04T01:40:45.795 INFO:teuthology.task.exec:Executing custom commands... 2023-11-04T01:40:45.795 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi077.front.sepia.ceph.com 2023-11-04T01:40:45.796 DEBUG:teuthology.orchestra.run.smithi077:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/crash/warn_recent_interval 0' 2023-11-04T01:40:45.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.897+0000 7fc0041a9640 1 Processor -- start 2023-11-04T01:40:45.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.897+0000 7fc0041a9640 1 -- start start 2023-11-04T01:40:45.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.898+0000 7fc0041a9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbffc15d4b0 0x7fbffc070ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.898+0000 7fc0041a9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fbffc0c55d0 0x7fbffc0c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.898+0000 7fc0041a9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbffc06b450 con 0x7fbffc15d0d0 2023-11-04T01:40:45.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.898+0000 7fc0041a9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbffc0ccca0 con 0x7fbffc15d4b0 2023-11-04T01:40:45.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.898+0000 7fc0041a9640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbffc0ce480 con 0x7fbffc0c55d0 2023-11-04T01:40:45.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.898+0000 7fc001744640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbffc15d4b0 0x7fbffc070ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.898+0000 7fc001744640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbffc15d4b0 0x7fbffc070ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48692/0 (socket says 172.21.15.77:48692) 2023-11-04T01:40:45.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.898+0000 7fc001f45640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fbffc15d0d0 0x7fbffc0cc590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:39872/0 (socket says 172.21.15.77:39872) 2023-11-04T01:40:45.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.898+0000 7fc001744640 1 -- 172.21.15.77:0/4198855760 learned_addr learned my addr 172.21.15.77:0/4198855760 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:45.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.898+0000 7fc002746640 1 --2- 172.21.15.77:0/4198855760 >> v2:172.21.15.122:3300/0 conn(0x7fbffc0c55d0 0x7fbffc0c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.898+0000 7fc001744640 1 -- 172.21.15.77:0/4198855760 >> v2:172.21.15.122:3300/0 conn(0x7fbffc0c55d0 msgr2=0x7fbffc0c9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:45.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.898+0000 7fc001744640 1 --2- 172.21.15.77:0/4198855760 >> v2:172.21.15.122:3300/0 conn(0x7fbffc0c55d0 0x7fbffc0c9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.898+0000 7fc001744640 1 -- 172.21.15.77:0/4198855760 >> v1:172.21.15.77:6789/0 conn(0x7fbffc15d0d0 legacy=0x7fbffc0cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:45.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.898+0000 7fc001744640 1 -- 172.21.15.77:0/4198855760 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbffc06b6f0 con 0x7fbffc15d4b0 2023-11-04T01:40:45.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.898+0000 7fc000f43640 1 -- 172.21.15.77:0/4198855760 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679461421 0 0) 0x7fbffc06b450 con 0x7fbffc15d0d0 2023-11-04T01:40:45.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.899+0000 7fc001744640 1 --2- 172.21.15.77:0/4198855760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbffc15d4b0 0x7fbffc070ef0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbffc071460 tx=0x7fbfec02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1581766d77069bdd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:45.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.899+0000 7fc000f43640 1 -- 172.21.15.77:0/4198855760 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec030860 con 0x7fbffc15d4b0 2023-11-04T01:40:45.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.899+0000 7fc000f43640 1 -- 172.21.15.77:0/4198855760 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfec0309c0 con 0x7fbffc15d4b0 2023-11-04T01:40:45.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.899+0000 7fc000f43640 1 -- 172.21.15.77:0/4198855760 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec030d50 con 0x7fbffc15d4b0 2023-11-04T01:40:45.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.900+0000 7fc0041a9640 1 -- 172.21.15.77:0/4198855760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbffc15d4b0 msgr2=0x7fbffc070ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:45.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.900+0000 7fc0041a9640 1 --2- 172.21.15.77:0/4198855760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbffc15d4b0 0x7fbffc070ef0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbffc071460 tx=0x7fbfec02b9a0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.900+0000 7fc0041a9640 1 -- 172.21.15.77:0/4198855760 shutdown_connections 2023-11-04T01:40:45.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.900+0000 7fc0041a9640 1 --2- 172.21.15.77:0/4198855760 >> v2:172.21.15.122:3300/0 conn(0x7fbffc0c55d0 0x7fbffc0c9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.900+0000 7fc0041a9640 1 --2- 172.21.15.77:0/4198855760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbffc15d4b0 0x7fbffc070ef0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.900+0000 7fc0041a9640 1 -- 172.21.15.77:0/4198855760 >> 172.21.15.77:0/4198855760 conn(0x7fbffc0ce9c0 msgr2=0x7fbffc0cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:45.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.900+0000 7fc0041a9640 1 -- 172.21.15.77:0/4198855760 shutdown_connections 2023-11-04T01:40:45.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.900+0000 7fc0041a9640 1 -- 172.21.15.77:0/4198855760 wait complete. 2023-11-04T01:40:45.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.901+0000 7fc0041a9640 1 Processor -- start 2023-11-04T01:40:45.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.901+0000 7fc0041a9640 1 -- start start 2023-11-04T01:40:45.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.902+0000 7fc0041a9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbffc0c55d0 0x7fbffc0c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.902+0000 7fc0041a9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbffc15d0d0 0x7fbffc06c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.902+0000 7fc0041a9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbffc15d4b0 0x7fbffc0b0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.902+0000 7fc0041a9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc0c66d0 con 0x7fbffc15d4b0 2023-11-04T01:40:45.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.902+0000 7fc0041a9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc150340 con 0x7fbffc15d0d0 2023-11-04T01:40:45.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.902+0000 7fc0041a9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc0b3530 con 0x7fbffc0c55d0 2023-11-04T01:40:45.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.902+0000 7fc002746640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbffc15d4b0 0x7fbffc0b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.902+0000 7fc002746640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbffc15d4b0 0x7fbffc0b0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48706/0 (socket says 172.21.15.77:48706) 2023-11-04T01:40:45.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.902+0000 7fc002746640 1 -- 172.21.15.77:0/109932435 learned_addr learned my addr 172.21.15.77:0/109932435 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:45.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.902+0000 7fc001744640 1 --2- 172.21.15.77:0/109932435 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbffc15d0d0 0x7fbffc06c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.902+0000 7fc002746640 1 -- 172.21.15.77:0/109932435 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbffc0c55d0 msgr2=0x7fbffc0c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:45.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.902+0000 7fc002746640 1 --2- 172.21.15.77:0/109932435 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbffc0c55d0 0x7fbffc0c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.902+0000 7fc002746640 1 -- 172.21.15.77:0/109932435 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbffc15d0d0 msgr2=0x7fbffc06c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:45.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.902+0000 7fc002746640 1 --2- 172.21.15.77:0/109932435 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbffc15d0d0 0x7fbffc06c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:45.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.902+0000 7fc002746640 1 -- 172.21.15.77:0/109932435 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfec0094d0 con 0x7fbffc15d4b0 2023-11-04T01:40:45.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.902+0000 7fc002746640 1 --2- 172.21.15.77:0/109932435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbffc15d4b0 0x7fbffc0b0110 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbff400cd60 tx=0x7fbff400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:45.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.902+0000 7fbff27fc640 1 -- 172.21.15.77:0/109932435 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff4003b90 con 0x7fbffc15d4b0 2023-11-04T01:40:45.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.902+0000 7fbff27fc640 1 -- 172.21.15.77:0/109932435 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff4003d10 con 0x7fbffc15d4b0 2023-11-04T01:40:45.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.902+0000 7fc0041a9640 1 -- 172.21.15.77:0/109932435 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbffc0b3d00 con 0x7fbffc15d4b0 2023-11-04T01:40:45.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.902+0000 7fbff27fc640 1 -- 172.21.15.77:0/109932435 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff4004260 con 0x7fbffc15d4b0 2023-11-04T01:40:45.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.903+0000 7fc0041a9640 1 -- 172.21.15.77:0/109932435 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbffc0b4670 con 0x7fbffc15d4b0 2023-11-04T01:40:45.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.903+0000 7fc0041a9640 1 -- 172.21.15.77:0/109932435 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbffc04ece0 con 0x7fbffc15d4b0 2023-11-04T01:40:45.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.904+0000 7fbff27fc640 1 -- 172.21.15.77:0/109932435 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbff40043c0 con 0x7fbffc15d4b0 2023-11-04T01:40:45.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.904+0000 7fbff27fc640 1 --2- 172.21.15.77:0/109932435 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbfe006ae70 0x7fbfe006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:45.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.904+0000 7fbff27fc640 1 -- 172.21.15.77:0/109932435 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbff4012070 con 0x7fbffc15d4b0 2023-11-04T01:40:45.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.904+0000 7fc001f45640 1 --2- 172.21.15.77:0/109932435 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbfe006ae70 0x7fbfe006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:45.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.905+0000 7fc001f45640 1 --2- 172.21.15.77:0/109932435 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbfe006ae70 0x7fbfe006d330 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbff8007fd0 tx=0x7fbff8007920 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:45.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:45.909+0000 7fbff27fc640 1 -- 172.21.15.77:0/109932435 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbff4055060 con 0x7fbffc15d4b0 2023-11-04T01:40:46.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.077+0000 7fc0041a9640 1 -- 172.21.15.77:0/109932435 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mgr/crash/warn_recent_interval}] v 0) v1 -- 0x7fbffc070b70 con 0x7fbffc15d4b0 2023-11-04T01:40:46.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.080+0000 7fbff27fc640 1 -- 172.21.15.77:0/109932435 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/crash/warn_recent_interval}]=0 v10)=0 v10) v1 ==== 128+0+0 (secure 0 0 0) 0x7fbff4058680 con 0x7fbffc15d4b0 2023-11-04T01:40:46.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.082+0000 7fc0041a9640 1 -- 172.21.15.77:0/109932435 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbfe006ae70 msgr2=0x7fbfe006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.082+0000 7fc0041a9640 1 --2- 172.21.15.77:0/109932435 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbfe006ae70 0x7fbfe006d330 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbff8007fd0 tx=0x7fbff8007920 comp rx=0 tx=0).stop 2023-11-04T01:40:46.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.082+0000 7fc0041a9640 1 -- 172.21.15.77:0/109932435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbffc15d4b0 msgr2=0x7fbffc0b0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.082+0000 7fc0041a9640 1 --2- 172.21.15.77:0/109932435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbffc15d4b0 0x7fbffc0b0110 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbff400cd60 tx=0x7fbff400a660 comp rx=0 tx=0).stop 2023-11-04T01:40:46.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.082+0000 7fc0041a9640 1 -- 172.21.15.77:0/109932435 shutdown_connections 2023-11-04T01:40:46.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.082+0000 7fc0041a9640 1 --2- 172.21.15.77:0/109932435 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbfe006ae70 0x7fbfe006d330 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.082+0000 7fc0041a9640 1 --2- 172.21.15.77:0/109932435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbffc15d4b0 0x7fbffc0b0110 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.082+0000 7fc0041a9640 1 --2- 172.21.15.77:0/109932435 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbffc15d0d0 0x7fbffc06c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.082+0000 7fc0041a9640 1 --2- 172.21.15.77:0/109932435 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbffc0c55d0 0x7fbffc0c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.082+0000 7fc0041a9640 1 -- 172.21.15.77:0/109932435 >> 172.21.15.77:0/109932435 conn(0x7fbffc0ce9c0 msgr2=0x7fbffc0cc570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:46.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.082+0000 7fc0041a9640 1 -- 172.21.15.77:0/109932435 shutdown_connections 2023-11-04T01:40:46.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.082+0000 7fc0041a9640 1 -- 172.21.15.77:0/109932435 wait complete. 2023-11-04T01:40:46.094 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-04T01:40:46.111 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:46.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.208+0000 7fb7fb5f5640 1 Processor -- start 2023-11-04T01:40:46.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.208+0000 7fb7fb5f5640 1 -- start start 2023-11-04T01:40:46.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.209+0000 7fb7fb5f5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7f4159c70 0x7fb7f40ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.209+0000 7fb7fb5f5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f40b4110 con 0x7fb7f40b0ae0 2023-11-04T01:40:46.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.209+0000 7fb7fb5f5640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f40b43f0 con 0x7fb7f406db20 2023-11-04T01:40:46.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.209+0000 7fb7fb5f5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f40b49b0 con 0x7fb7f4159c70 2023-11-04T01:40:46.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.209+0000 7fb7f9b92640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb7f40b0ae0 0x7fb7f415d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:39874/0 (socket says 172.21.15.77:39874) 2023-11-04T01:40:46.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.209+0000 7fb7f9b92640 1 -- 172.21.15.77:0/1448463455 learned_addr learned my addr 172.21.15.77:0/1448463455 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:46.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.209+0000 7fb7f9391640 1 --2- 172.21.15.77:0/1448463455 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7f4159c70 0x7fb7f40ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.209+0000 7fb7f3fff640 1 -- 172.21.15.77:0/1448463455 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3862222102 0 0) 0x7fb7f40b4110 con 0x7fb7f40b0ae0 2023-11-04T01:40:46.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.209+0000 7fb7f3fff640 1 -- 172.21.15.77:0/1448463455 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7dc005730 con 0x7fb7f40b0ae0 2023-11-04T01:40:46.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.209+0000 7fb7f3fff640 1 -- 172.21.15.77:0/1448463455 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 857957271 0 0) 0x7fb7f40b43f0 con 0x7fb7f406db20 2023-11-04T01:40:46.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.210+0000 7fb7f3fff640 1 -- 172.21.15.77:0/1448463455 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7f40b4110 con 0x7fb7f406db20 2023-11-04T01:40:46.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.210+0000 7fb7f9391640 1 -- 172.21.15.77:0/1448463455 >> v1:172.21.15.122:6789/0 conn(0x7fb7f406db20 legacy=0x7fb7f40b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.210+0000 7fb7f9391640 1 -- 172.21.15.77:0/1448463455 >> v1:172.21.15.77:6789/0 conn(0x7fb7f40b0ae0 legacy=0x7fb7f415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.210+0000 7fb7f9391640 1 -- 172.21.15.77:0/1448463455 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f40b46d0 con 0x7fb7f4159c70 2023-11-04T01:40:46.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.210+0000 7fb7f9391640 1 --2- 172.21.15.77:0/1448463455 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7f4159c70 0x7fb7f40ce370 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec0097d0 tx=0x7fb7ec02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4d3f22d3a3516ec server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:46.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.211+0000 7fb7f3fff640 1 -- 172.21.15.77:0/1448463455 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec031890 con 0x7fb7f4159c70 2023-11-04T01:40:46.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.211+0000 7fb7f3fff640 1 -- 172.21.15.77:0/1448463455 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ec0319f0 con 0x7fb7f4159c70 2023-11-04T01:40:46.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.211+0000 7fb7f3fff640 1 -- 172.21.15.77:0/1448463455 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec031d60 con 0x7fb7f4159c70 2023-11-04T01:40:46.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.211+0000 7fb7fb5f5640 1 -- 172.21.15.77:0/1448463455 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7f4159c70 msgr2=0x7fb7f40ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.211+0000 7fb7fb5f5640 1 --2- 172.21.15.77:0/1448463455 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7f4159c70 0x7fb7f40ce370 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec0097d0 tx=0x7fb7ec02b930 comp rx=0 tx=0).stop 2023-11-04T01:40:46.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.211+0000 7fb7fb5f5640 1 -- 172.21.15.77:0/1448463455 shutdown_connections 2023-11-04T01:40:46.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.211+0000 7fb7fb5f5640 1 --2- 172.21.15.77:0/1448463455 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7f4159c70 0x7fb7f40ce370 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.211+0000 7fb7fb5f5640 1 -- 172.21.15.77:0/1448463455 >> 172.21.15.77:0/1448463455 conn(0x7fb7f40ce950 msgr2=0x7fb7f40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:46.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.211+0000 7fb7fb5f5640 1 -- 172.21.15.77:0/1448463455 shutdown_connections 2023-11-04T01:40:46.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.211+0000 7fb7fb5f5640 1 -- 172.21.15.77:0/1448463455 wait complete. 2023-11-04T01:40:46.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.212+0000 7fb7fb5f5640 1 Processor -- start 2023-11-04T01:40:46.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.212+0000 7fb7fb5f5640 1 -- start start 2023-11-04T01:40:46.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.213+0000 7fb7fb5f5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7f406db20 0x7fb7f414dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.213+0000 7fb7fb5f5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7f40b0ae0 0x7fb7f40c4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.213+0000 7fb7fb5f5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb7f4159c70 0x7fb7f415b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.213+0000 7fb7fb5f5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f414f730 con 0x7fb7f40b0ae0 2023-11-04T01:40:46.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.213+0000 7fb7fb5f5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f415c1a0 con 0x7fb7f4159c70 2023-11-04T01:40:46.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.213+0000 7fb7fb5f5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f415c480 con 0x7fb7f406db20 2023-11-04T01:40:46.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.213+0000 7fb7f8b90640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7f40b0ae0 0x7fb7f40c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.213+0000 7fb7f8b90640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7f40b0ae0 0x7fb7f40c4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48714/0 (socket says 172.21.15.77:48714) 2023-11-04T01:40:46.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.213+0000 7fb7f8b90640 1 -- 172.21.15.77:0/673813280 learned_addr learned my addr 172.21.15.77:0/673813280 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:46.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.213+0000 7fb7f9b92640 1 --2- 172.21.15.77:0/673813280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb7f4159c70 0x7fb7f415b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.213+0000 7fb7f9391640 1 --2- 172.21.15.77:0/673813280 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7f406db20 0x7fb7f414dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.214+0000 7fb7f8b90640 1 -- 172.21.15.77:0/673813280 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7f406db20 msgr2=0x7fb7f414dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.214+0000 7fb7f8b90640 1 --2- 172.21.15.77:0/673813280 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7f406db20 0x7fb7f414dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.214+0000 7fb7f8b90640 1 -- 172.21.15.77:0/673813280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb7f4159c70 msgr2=0x7fb7f415b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.214+0000 7fb7f8b90640 1 --2- 172.21.15.77:0/673813280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb7f4159c70 0x7fb7f415b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.214+0000 7fb7f8b90640 1 -- 172.21.15.77:0/673813280 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ec009400 con 0x7fb7f40b0ae0 2023-11-04T01:40:46.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.214+0000 7fb7f8b90640 1 --2- 172.21.15.77:0/673813280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7f40b0ae0 0x7fb7f40c4880 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb7e800c500 tx=0x7fb7e800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:46.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.214+0000 7fb7f1ffb640 1 -- 172.21.15.77:0/673813280 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e80052d0 con 0x7fb7f40b0ae0 2023-11-04T01:40:46.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.214+0000 7fb7f1ffb640 1 -- 172.21.15.77:0/673813280 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e8005450 con 0x7fb7f40b0ae0 2023-11-04T01:40:46.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.214+0000 7fb7f1ffb640 1 -- 172.21.15.77:0/673813280 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8012870 con 0x7fb7f40b0ae0 2023-11-04T01:40:46.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.214+0000 7fb7fb5f5640 1 -- 172.21.15.77:0/673813280 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7f415c760 con 0x7fb7f40b0ae0 2023-11-04T01:40:46.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.214+0000 7fb7fb5f5640 1 -- 172.21.15.77:0/673813280 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f415be90 con 0x7fb7f40b0ae0 2023-11-04T01:40:46.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.215+0000 7fb7fb5f5640 1 -- 172.21.15.77:0/673813280 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f414f8a0 con 0x7fb7f40b0ae0 2023-11-04T01:40:46.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.215+0000 7fb7f1ffb640 1 -- 172.21.15.77:0/673813280 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb7e80129d0 con 0x7fb7f40b0ae0 2023-11-04T01:40:46.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.216+0000 7fb7f1ffb640 1 --2- 172.21.15.77:0/673813280 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb7e006aea0 0x7fb7e006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.216+0000 7fb7f1ffb640 1 -- 172.21.15.77:0/673813280 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb7e80893a0 con 0x7fb7f40b0ae0 2023-11-04T01:40:46.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.216+0000 7fb7f9391640 1 --2- 172.21.15.77:0/673813280 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb7e006aea0 0x7fb7e006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.216+0000 7fb7f9391640 1 --2- 172.21.15.77:0/673813280 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb7e006aea0 0x7fb7e006d360 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec036000 tx=0x7fb7ec03c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:46.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.220+0000 7fb7f1ffb640 1 -- 172.21.15.77:0/673813280 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb7e8054220 con 0x7fb7f40b0ae0 2023-11-04T01:40:46.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.386+0000 7fb7fb5f5640 1 -- 172.21.15.77:0/673813280 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7f4074290 con 0x7fb7f40b0ae0 2023-11-04T01:40:46.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.387+0000 7fb7f1ffb640 1 -- 172.21.15.77:0/673813280 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18334 (secure 0 0 0) 0x7fb7e8057840 con 0x7fb7f40b0ae0 2023-11-04T01:40:46.389 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:46.389 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":24,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:40:10.153949+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:40:02.810971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:40:04.003979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:40:07.734355+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:46.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.389+0000 7fb7fb5f5640 1 -- 172.21.15.77:0/673813280 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb7e006aea0 msgr2=0x7fb7e006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.389+0000 7fb7fb5f5640 1 --2- 172.21.15.77:0/673813280 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb7e006aea0 0x7fb7e006d360 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec036000 tx=0x7fb7ec03c040 comp rx=0 tx=0).stop 2023-11-04T01:40:46.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.389+0000 7fb7fb5f5640 1 -- 172.21.15.77:0/673813280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7f40b0ae0 msgr2=0x7fb7f40c4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.389+0000 7fb7fb5f5640 1 --2- 172.21.15.77:0/673813280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7f40b0ae0 0x7fb7f40c4880 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb7e800c500 tx=0x7fb7e800c9c0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.389+0000 7fb7fb5f5640 1 -- 172.21.15.77:0/673813280 shutdown_connections 2023-11-04T01:40:46.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.389+0000 7fb7fb5f5640 1 --2- 172.21.15.77:0/673813280 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb7e006aea0 0x7fb7e006d360 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.389+0000 7fb7fb5f5640 1 --2- 172.21.15.77:0/673813280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb7f4159c70 0x7fb7f415b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.389+0000 7fb7fb5f5640 1 --2- 172.21.15.77:0/673813280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7f40b0ae0 0x7fb7f40c4880 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.389+0000 7fb7fb5f5640 1 --2- 172.21.15.77:0/673813280 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7f406db20 0x7fb7f414dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.389+0000 7fb7fb5f5640 1 -- 172.21.15.77:0/673813280 >> 172.21.15.77:0/673813280 conn(0x7fb7f40ce950 msgr2=0x7fb7f406cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:46.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.389+0000 7fb7fb5f5640 1 -- 172.21.15.77:0/673813280 shutdown_connections 2023-11-04T01:40:46.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.389+0000 7fb7fb5f5640 1 -- 172.21.15.77:0/673813280 wait complete. 2023-11-04T01:40:46.401 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:40:02.810971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:40:04.003979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:40:07.734355+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:40:46.402 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:40:46.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.503+0000 7fad50687640 1 Processor -- start 2023-11-04T01:40:46.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.503+0000 7fad50687640 1 -- start start 2023-11-04T01:40:46.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.504+0000 7fad50687640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fad480cc520 0x7fad48070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.504+0000 7fad50687640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fad480cc9d0 0x7fad480714e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.504+0000 7fad50687640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad480c3860 con 0x7fad48153850 2023-11-04T01:40:46.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.504+0000 7fad50687640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad480c9250 con 0x7fad480cc520 2023-11-04T01:40:46.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.504+0000 7fad50687640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad48153c30 con 0x7fad480cc9d0 2023-11-04T01:40:46.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.504+0000 7fad4dc22640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fad480cc520 0x7fad48070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.504+0000 7fad4ec24640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fad480cc9d0 0x7fad480714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.504+0000 7fad4dc22640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fad480cc520 0x7fad48070fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:34490/0 (socket says 172.21.15.77:34490) 2023-11-04T01:40:46.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.504+0000 7fad4dc22640 1 -- 172.21.15.77:0/1129663870 learned_addr learned my addr 172.21.15.77:0/1129663870 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:46.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.504+0000 7fad4dc22640 1 -- 172.21.15.77:0/1129663870 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fad480cc9d0 msgr2=0x7fad480714e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:46.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.504+0000 7fad4dc22640 1 --2- 172.21.15.77:0/1129663870 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fad480cc9d0 0x7fad480714e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.504+0000 7fad4dc22640 1 -- 172.21.15.77:0/1129663870 >> v1:172.21.15.122:6789/0 conn(0x7fad48153850 legacy=0x7fad4815a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.504+0000 7fad4dc22640 1 -- 172.21.15.77:0/1129663870 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad480ce590 con 0x7fad480cc520 2023-11-04T01:40:46.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.504+0000 7fad4d421640 1 -- 172.21.15.77:0/1129663870 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2014265582 0 0) 0x7fad480c3860 con 0x7fad48153850 2023-11-04T01:40:46.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.505+0000 7fad4dc22640 1 --2- 172.21.15.77:0/1129663870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad480cc520 0x7fad48070fa0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fad3800bb10 tx=0x7fad3802e150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cdb7855a607374d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:46.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.505+0000 7fad4d421640 1 -- 172.21.15.77:0/1129663870 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad38036440 con 0x7fad480cc520 2023-11-04T01:40:46.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.505+0000 7fad4d421640 1 -- 172.21.15.77:0/1129663870 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad380365a0 con 0x7fad480cc520 2023-11-04T01:40:46.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.505+0000 7fad4d421640 1 -- 172.21.15.77:0/1129663870 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad38036930 con 0x7fad480cc520 2023-11-04T01:40:46.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.505+0000 7fad50687640 1 -- 172.21.15.77:0/1129663870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad480cc520 msgr2=0x7fad48070fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.506+0000 7fad50687640 1 --2- 172.21.15.77:0/1129663870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad480cc520 0x7fad48070fa0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fad3800bb10 tx=0x7fad3802e150 comp rx=0 tx=0).stop 2023-11-04T01:40:46.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.506+0000 7fad50687640 1 -- 172.21.15.77:0/1129663870 shutdown_connections 2023-11-04T01:40:46.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.506+0000 7fad50687640 1 --2- 172.21.15.77:0/1129663870 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fad480cc9d0 0x7fad480714e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.506+0000 7fad50687640 1 --2- 172.21.15.77:0/1129663870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad480cc520 0x7fad48070fa0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.506+0000 7fad50687640 1 -- 172.21.15.77:0/1129663870 >> 172.21.15.77:0/1129663870 conn(0x7fad480ce950 msgr2=0x7fad480ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:46.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.506+0000 7fad50687640 1 -- 172.21.15.77:0/1129663870 shutdown_connections 2023-11-04T01:40:46.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.506+0000 7fad50687640 1 -- 172.21.15.77:0/1129663870 wait complete. 2023-11-04T01:40:46.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.507+0000 7fad50687640 1 Processor -- start 2023-11-04T01:40:46.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.507+0000 7fad50687640 1 -- start start 2023-11-04T01:40:46.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.507+0000 7fad50687640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad480cc520 0x7fad480c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.507+0000 7fad50687640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fad480cc9d0 0x7fad481f1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.507+0000 7fad50687640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad48153850 0x7fad481f22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.507+0000 7fad50687640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad480c7920 con 0x7fad480cc520 2023-11-04T01:40:46.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.507+0000 7fad50687640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad480c6a70 con 0x7fad48153850 2023-11-04T01:40:46.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.507+0000 7fad50687640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad480c6d10 con 0x7fad480cc9d0 2023-11-04T01:40:46.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.508+0000 7fad4e423640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad480cc520 0x7fad480c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.508+0000 7fad4e423640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad480cc520 0x7fad480c7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48720/0 (socket says 172.21.15.77:48720) 2023-11-04T01:40:46.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.508+0000 7fad4e423640 1 -- 172.21.15.77:0/4192376605 learned_addr learned my addr 172.21.15.77:0/4192376605 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:46.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.508+0000 7fad4dc22640 1 --2- 172.21.15.77:0/4192376605 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fad480cc9d0 0x7fad481f1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.508+0000 7fad4ec24640 1 --2- 172.21.15.77:0/4192376605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad48153850 0x7fad481f22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.508+0000 7fad4e423640 1 -- 172.21.15.77:0/4192376605 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fad480cc9d0 msgr2=0x7fad481f1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.508+0000 7fad4e423640 1 --2- 172.21.15.77:0/4192376605 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fad480cc9d0 0x7fad481f1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.508+0000 7fad4e423640 1 -- 172.21.15.77:0/4192376605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad48153850 msgr2=0x7fad481f22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.508+0000 7fad4e423640 1 --2- 172.21.15.77:0/4192376605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad48153850 0x7fad481f22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.508+0000 7fad4e423640 1 -- 172.21.15.77:0/4192376605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3800b770 con 0x7fad480cc520 2023-11-04T01:40:46.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.508+0000 7fad4dc22640 1 --2- 172.21.15.77:0/4192376605 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fad480cc9d0 0x7fad481f1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:46.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.508+0000 7fad4e423640 1 --2- 172.21.15.77:0/4192376605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad480cc520 0x7fad480c7db0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fad4400c4b0 tx=0x7fad4400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:46.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.508+0000 7fad3effd640 1 -- 172.21.15.77:0/4192376605 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad44005480 con 0x7fad480cc520 2023-11-04T01:40:46.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.508+0000 7fad3effd640 1 -- 172.21.15.77:0/4192376605 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad440035f0 con 0x7fad480cc520 2023-11-04T01:40:46.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.508+0000 7fad3effd640 1 -- 172.21.15.77:0/4192376605 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad440039e0 con 0x7fad480cc520 2023-11-04T01:40:46.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.508+0000 7fad50687640 1 -- 172.21.15.77:0/4192376605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad480c6ff0 con 0x7fad480cc520 2023-11-04T01:40:46.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.508+0000 7fad50687640 1 -- 172.21.15.77:0/4192376605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad480c75b0 con 0x7fad480cc520 2023-11-04T01:40:46.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.509+0000 7fad50687640 1 -- 172.21.15.77:0/4192376605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad48074290 con 0x7fad480cc520 2023-11-04T01:40:46.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.510+0000 7fad3effd640 1 -- 172.21.15.77:0/4192376605 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fad44003b40 con 0x7fad480cc520 2023-11-04T01:40:46.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.510+0000 7fad3effd640 1 --2- 172.21.15.77:0/4192376605 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fad2c06ae70 0x7fad2c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.510+0000 7fad3effd640 1 -- 172.21.15.77:0/4192376605 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fad44088e40 con 0x7fad480cc520 2023-11-04T01:40:46.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.510+0000 7fad4dc22640 1 --2- 172.21.15.77:0/4192376605 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fad2c06ae70 0x7fad2c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.511+0000 7fad4dc22640 1 --2- 172.21.15.77:0/4192376605 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fad2c06ae70 0x7fad2c06d330 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fad38038000 tx=0x7fad38032000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:46.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.514+0000 7fad3effd640 1 -- 172.21.15.77:0/4192376605 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fad44053cb0 con 0x7fad480cc520 2023-11-04T01:40:46.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.687+0000 7fad50687640 1 -- 172.21.15.77:0/4192376605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fad480c3cf0 con 0x7fad480cc520 2023-11-04T01:40:46.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.687+0000 7fad3effd640 1 -- 172.21.15.77:0/4192376605 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fad44017070 con 0x7fad480cc520 2023-11-04T01:40:46.689 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:40:46.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.689+0000 7fad50687640 1 -- 172.21.15.77:0/4192376605 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fad2c06ae70 msgr2=0x7fad2c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.689+0000 7fad50687640 1 --2- 172.21.15.77:0/4192376605 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fad2c06ae70 0x7fad2c06d330 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fad38038000 tx=0x7fad38032000 comp rx=0 tx=0).stop 2023-11-04T01:40:46.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.689+0000 7fad50687640 1 -- 172.21.15.77:0/4192376605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad480cc520 msgr2=0x7fad480c7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.689+0000 7fad50687640 1 --2- 172.21.15.77:0/4192376605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad480cc520 0x7fad480c7db0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fad4400c4b0 tx=0x7fad4400c970 comp rx=0 tx=0).stop 2023-11-04T01:40:46.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.689+0000 7fad50687640 1 -- 172.21.15.77:0/4192376605 shutdown_connections 2023-11-04T01:40:46.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.689+0000 7fad50687640 1 --2- 172.21.15.77:0/4192376605 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fad2c06ae70 0x7fad2c06d330 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.689+0000 7fad50687640 1 --2- 172.21.15.77:0/4192376605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad48153850 0x7fad481f22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.689+0000 7fad50687640 1 --2- 172.21.15.77:0/4192376605 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fad480cc9d0 0x7fad481f1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.689+0000 7fad50687640 1 --2- 172.21.15.77:0/4192376605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad480cc520 0x7fad480c7db0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.689+0000 7fad50687640 1 -- 172.21.15.77:0/4192376605 >> 172.21.15.77:0/4192376605 conn(0x7fad480ce950 msgr2=0x7fad480c3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:46.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.689+0000 7fad50687640 1 -- 172.21.15.77:0/4192376605 shutdown_connections 2023-11-04T01:40:46.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.689+0000 7fad50687640 1 -- 172.21.15.77:0/4192376605 wait complete. 2023-11-04T01:40:46.701 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:40:46.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.802+0000 7fc66a31d640 1 Processor -- start 2023-11-04T01:40:46.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.802+0000 7fc66a31d640 1 -- start start 2023-11-04T01:40:46.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.803+0000 7fc66a31d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc664160430 0x7fc6640b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.803+0000 7fc66a31d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc6640b2b60 0x7fc66406bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.803+0000 7fc66a31d640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6640b2fc0 con 0x7fc66406c1d0 2023-11-04T01:40:46.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.803+0000 7fc66a31d640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6640cb580 con 0x7fc6640b2b60 2023-11-04T01:40:46.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.803+0000 7fc66a31d640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc66406ca40 con 0x7fc664160430 2023-11-04T01:40:46.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.803+0000 7fc6637fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc6640b2b60 0x7fc66406bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.803+0000 7fc663fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc664160430 0x7fc6640b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.803+0000 7fc6688ba640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fc66406c1d0 0x7fc664160b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:36866/0 (socket says 172.21.15.77:36866) 2023-11-04T01:40:46.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.803+0000 7fc6688ba640 1 -- 172.21.15.77:0/3515444278 learned_addr learned my addr 172.21.15.77:0/3515444278 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:46.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.804+0000 7fc662ffd640 1 -- 172.21.15.77:0/3515444278 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2539724606 0 0) 0x7fc6640b2fc0 con 0x7fc66406c1d0 2023-11-04T01:40:46.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.804+0000 7fc662ffd640 1 -- 172.21.15.77:0/3515444278 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc64c003520 con 0x7fc66406c1d0 2023-11-04T01:40:46.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.804+0000 7fc6637fe640 1 -- 172.21.15.77:0/3515444278 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc664160430 msgr2=0x7fc6640b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:46.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.804+0000 7fc6637fe640 1 --2- 172.21.15.77:0/3515444278 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc664160430 0x7fc6640b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.804+0000 7fc6637fe640 1 -- 172.21.15.77:0/3515444278 >> v1:172.21.15.122:6789/0 conn(0x7fc66406c1d0 legacy=0x7fc664160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.804+0000 7fc6637fe640 1 -- 172.21.15.77:0/3515444278 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc66406cd20 con 0x7fc6640b2b60 2023-11-04T01:40:46.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.804+0000 7fc663fff640 1 --2- 172.21.15.77:0/3515444278 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc664160430 0x7fc6640b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:46.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.804+0000 7fc6637fe640 1 --2- 172.21.15.77:0/3515444278 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc6640b2b60 0x7fc66406bc90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc6580097a0 tx=0x7fc65802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a1ac6055f13c32c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:46.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.805+0000 7fc662ffd640 1 -- 172.21.15.77:0/3515444278 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc658031830 con 0x7fc6640b2b60 2023-11-04T01:40:46.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.805+0000 7fc662ffd640 1 -- 172.21.15.77:0/3515444278 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc658031990 con 0x7fc6640b2b60 2023-11-04T01:40:46.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.805+0000 7fc662ffd640 1 -- 172.21.15.77:0/3515444278 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc658031d20 con 0x7fc6640b2b60 2023-11-04T01:40:46.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.805+0000 7fc66a31d640 1 -- 172.21.15.77:0/3515444278 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc6640b2b60 msgr2=0x7fc66406bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.805+0000 7fc66a31d640 1 --2- 172.21.15.77:0/3515444278 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc6640b2b60 0x7fc66406bc90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc6580097a0 tx=0x7fc65802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.805+0000 7fc66a31d640 1 -- 172.21.15.77:0/3515444278 shutdown_connections 2023-11-04T01:40:46.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.805+0000 7fc66a31d640 1 --2- 172.21.15.77:0/3515444278 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc6640b2b60 0x7fc66406bc90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.805+0000 7fc66a31d640 1 --2- 172.21.15.77:0/3515444278 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc664160430 0x7fc6640b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.805+0000 7fc66a31d640 1 -- 172.21.15.77:0/3515444278 >> 172.21.15.77:0/3515444278 conn(0x7fc66406ea20 msgr2=0x7fc66406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:46.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.805+0000 7fc66a31d640 1 -- 172.21.15.77:0/3515444278 shutdown_connections 2023-11-04T01:40:46.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.805+0000 7fc66a31d640 1 -- 172.21.15.77:0/3515444278 wait complete. 2023-11-04T01:40:46.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.806+0000 7fc66a31d640 1 Processor -- start 2023-11-04T01:40:46.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.807+0000 7fc66a31d640 1 -- start start 2023-11-04T01:40:46.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.807+0000 7fc66a31d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc66406c1d0 0x7fc66414c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.807+0000 7fc66a31d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6640b2b60 0x7fc6640c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.807+0000 7fc66a31d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc664160430 0x7fc6640ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.807+0000 7fc66a31d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6640c8570 con 0x7fc6640b2b60 2023-11-04T01:40:46.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.807+0000 7fc66a31d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6640c8850 con 0x7fc664160430 2023-11-04T01:40:46.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.807+0000 7fc66a31d640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6640c92c0 con 0x7fc66406c1d0 2023-11-04T01:40:46.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.807+0000 7fc6637fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6640b2b60 0x7fc6640c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.807+0000 7fc6637fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6640b2b60 0x7fc6640c7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48728/0 (socket says 172.21.15.77:48728) 2023-11-04T01:40:46.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.807+0000 7fc6637fe640 1 -- 172.21.15.77:0/142563152 learned_addr learned my addr 172.21.15.77:0/142563152 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:46.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.808+0000 7fc663fff640 1 --2- 172.21.15.77:0/142563152 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc66406c1d0 0x7fc66414c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.808+0000 7fc6688ba640 1 --2- 172.21.15.77:0/142563152 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc664160430 0x7fc6640ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.808+0000 7fc6637fe640 1 -- 172.21.15.77:0/142563152 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc66406c1d0 msgr2=0x7fc66414c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.808+0000 7fc6637fe640 1 --2- 172.21.15.77:0/142563152 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc66406c1d0 0x7fc66414c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.808+0000 7fc6637fe640 1 -- 172.21.15.77:0/142563152 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc664160430 msgr2=0x7fc6640ccc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.808+0000 7fc6637fe640 1 --2- 172.21.15.77:0/142563152 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc664160430 0x7fc6640ccc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.808+0000 7fc6637fe640 1 -- 172.21.15.77:0/142563152 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc654009400 con 0x7fc6640b2b60 2023-11-04T01:40:46.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.808+0000 7fc6637fe640 1 --2- 172.21.15.77:0/142563152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6640b2b60 0x7fc6640c7c70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc65802bee0 tx=0x7fc6580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:46.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.808+0000 7fc660ff9640 1 -- 172.21.15.77:0/142563152 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65803a630 con 0x7fc6640b2b60 2023-11-04T01:40:46.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.808+0000 7fc660ff9640 1 -- 172.21.15.77:0/142563152 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc65803a7b0 con 0x7fc6640b2b60 2023-11-04T01:40:46.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.808+0000 7fc66a31d640 1 -- 172.21.15.77:0/142563152 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc658009400 con 0x7fc6640b2b60 2023-11-04T01:40:46.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.808+0000 7fc660ff9640 1 -- 172.21.15.77:0/142563152 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65803ab60 con 0x7fc6640b2b60 2023-11-04T01:40:46.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.808+0000 7fc66a31d640 1 -- 172.21.15.77:0/142563152 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc66414c950 con 0x7fc6640b2b60 2023-11-04T01:40:46.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.809+0000 7fc66a31d640 1 -- 172.21.15.77:0/142563152 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6640c97e0 con 0x7fc6640b2b60 2023-11-04T01:40:46.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.809+0000 7fc660ff9640 1 -- 172.21.15.77:0/142563152 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc65803acc0 con 0x7fc6640b2b60 2023-11-04T01:40:46.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.810+0000 7fc660ff9640 1 --2- 172.21.15.77:0/142563152 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc65006aea0 0x7fc65006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:46.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.810+0000 7fc660ff9640 1 -- 172.21.15.77:0/142563152 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc6580ab350 con 0x7fc6640b2b60 2023-11-04T01:40:46.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.810+0000 7fc663fff640 1 --2- 172.21.15.77:0/142563152 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc65006aea0 0x7fc65006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:46.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.810+0000 7fc663fff640 1 --2- 172.21.15.77:0/142563152 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc65006aea0 0x7fc65006d360 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc6640b2940 tx=0x7fc654008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:46.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.814+0000 7fc660ff9640 1 -- 172.21.15.77:0/142563152 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc6640c97e0 con 0x7fc6640b2b60 2023-11-04T01:40:46.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.979+0000 7fc66a31d640 1 -- 172.21.15.77:0/142563152 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc6640c97e0 con 0x7fc6640b2b60 2023-11-04T01:40:46.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.980+0000 7fc660ff9640 1 -- 172.21.15.77:0/142563152 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc6640c97e0 con 0x7fc6640b2b60 2023-11-04T01:40:46.982 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:40:46.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.982+0000 7fc66a31d640 1 -- 172.21.15.77:0/142563152 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc65006aea0 msgr2=0x7fc65006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.982+0000 7fc66a31d640 1 --2- 172.21.15.77:0/142563152 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc65006aea0 0x7fc65006d360 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc6640b2940 tx=0x7fc654008040 comp rx=0 tx=0).stop 2023-11-04T01:40:46.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.982+0000 7fc66a31d640 1 -- 172.21.15.77:0/142563152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6640b2b60 msgr2=0x7fc6640c7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:46.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.982+0000 7fc66a31d640 1 --2- 172.21.15.77:0/142563152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6640b2b60 0x7fc6640c7c70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc65802bee0 tx=0x7fc6580046c0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.982+0000 7fc66a31d640 1 -- 172.21.15.77:0/142563152 shutdown_connections 2023-11-04T01:40:46.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.982+0000 7fc66a31d640 1 --2- 172.21.15.77:0/142563152 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc65006aea0 0x7fc65006d360 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.982+0000 7fc66a31d640 1 --2- 172.21.15.77:0/142563152 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc664160430 0x7fc6640ccc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.982+0000 7fc66a31d640 1 --2- 172.21.15.77:0/142563152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6640b2b60 0x7fc6640c7c70 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.982+0000 7fc66a31d640 1 --2- 172.21.15.77:0/142563152 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc66406c1d0 0x7fc66414c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:46.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.982+0000 7fc66a31d640 1 -- 172.21.15.77:0/142563152 >> 172.21.15.77:0/142563152 conn(0x7fc66406ea20 msgr2=0x7fc6640b0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:46.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.982+0000 7fc66a31d640 1 -- 172.21.15.77:0/142563152 shutdown_connections 2023-11-04T01:40:46.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:46.982+0000 7fc66a31d640 1 -- 172.21.15.77:0/142563152 wait complete. 2023-11-04T01:40:46.994 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:40:47.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.096+0000 7f3df0d0c640 1 Processor -- start 2023-11-04T01:40:47.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.096+0000 7f3df0d0c640 1 -- start start 2023-11-04T01:40:47.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.097+0000 7f3df0d0c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3dec15aa40 0x7f3dec15f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.097+0000 7f3df0d0c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3dec06b410 0x7f3dec06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.097+0000 7f3df0d0c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dec06d710 con 0x7f3dec06cd70 2023-11-04T01:40:47.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.097+0000 7f3df0d0c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dec0ca1a0 con 0x7f3dec06b410 2023-11-04T01:40:47.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.097+0000 7f3df0d0c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec15f690 con 0x7f3dec15aa40 2023-11-04T01:40:47.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.097+0000 7f3dead9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3dec06b410 0x7f3dec06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.097+0000 7f3dead9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3dec06b410 0x7f3dec06d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48732/0 (socket says 172.21.15.77:48732) 2023-11-04T01:40:47.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.097+0000 7f3dead9d640 1 -- 172.21.15.77:0/3144158131 learned_addr learned my addr 172.21.15.77:0/3144158131 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:47.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.098+0000 7f3dead9d640 1 -- 172.21.15.77:0/3144158131 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3dec15aa40 msgr2=0x7f3dec15f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:47.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.098+0000 7f3dea59c640 1 --2- 172.21.15.77:0/3144158131 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3dec15aa40 0x7f3dec15f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.098+0000 7f3dead9d640 1 --2- 172.21.15.77:0/3144158131 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3dec15aa40 0x7f3dec15f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.098+0000 7f3dead9d640 1 -- 172.21.15.77:0/3144158131 >> v1:172.21.15.122:6789/0 conn(0x7f3dec06cd70 legacy=0x7f3dec070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:47.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.098+0000 7f3dead9d640 1 -- 172.21.15.77:0/3144158131 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dec0ca440 con 0x7f3dec06b410 2023-11-04T01:40:47.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.098+0000 7f3dead9d640 1 --2- 172.21.15.77:0/3144158131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dec06b410 0x7f3dec06d1d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc009870 tx=0x7f3ddc02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=888b58eb46ca4c88 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.099+0000 7f3de959a640 1 -- 172.21.15.77:0/3144158131 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc0317c0 con 0x7f3dec06b410 2023-11-04T01:40:47.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.099+0000 7f3de959a640 1 -- 172.21.15.77:0/3144158131 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ddc031920 con 0x7f3dec06b410 2023-11-04T01:40:47.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.099+0000 7f3de959a640 1 -- 172.21.15.77:0/3144158131 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc031cb0 con 0x7f3dec06b410 2023-11-04T01:40:47.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.099+0000 7f3df0d0c640 1 -- 172.21.15.77:0/3144158131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dec06b410 msgr2=0x7f3dec06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.099+0000 7f3df0d0c640 1 --2- 172.21.15.77:0/3144158131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dec06b410 0x7f3dec06d1d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc009870 tx=0x7f3ddc02b860 comp rx=0 tx=0).stop 2023-11-04T01:40:47.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.099+0000 7f3df0d0c640 1 -- 172.21.15.77:0/3144158131 shutdown_connections 2023-11-04T01:40:47.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.099+0000 7f3df0d0c640 1 --2- 172.21.15.77:0/3144158131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dec06b410 0x7f3dec06d1d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.099+0000 7f3df0d0c640 1 --2- 172.21.15.77:0/3144158131 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3dec15aa40 0x7f3dec15f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.099+0000 7f3df0d0c640 1 -- 172.21.15.77:0/3144158131 >> 172.21.15.77:0/3144158131 conn(0x7f3dec0cf140 msgr2=0x7f3dec0cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:47.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.099+0000 7f3df0d0c640 1 -- 172.21.15.77:0/3144158131 shutdown_connections 2023-11-04T01:40:47.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.099+0000 7f3df0d0c640 1 -- 172.21.15.77:0/3144158131 wait complete. 2023-11-04T01:40:47.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.100+0000 7f3df0d0c640 1 Processor -- start 2023-11-04T01:40:47.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.100+0000 7f3df0d0c640 1 -- start start 2023-11-04T01:40:47.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.101+0000 7f3df0d0c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3dec06b410 0x7f3dec0c6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.101+0000 7f3df0d0c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dec06cd70 0x7f3dec155960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.101+0000 7f3df0d0c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3dec15aa40 0x7f3dec0c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.101+0000 7f3df0d0c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec0ad080 con 0x7f3dec06cd70 2023-11-04T01:40:47.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.101+0000 7f3df0d0c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec156320 con 0x7f3dec15aa40 2023-11-04T01:40:47.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.101+0000 7f3df0d0c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec0c8ef0 con 0x7f3dec06b410 2023-11-04T01:40:47.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.101+0000 7f3de9d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dec06cd70 0x7f3dec155960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.101+0000 7f3de9d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dec06cd70 0x7f3dec155960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48746/0 (socket says 172.21.15.77:48746) 2023-11-04T01:40:47.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.101+0000 7f3de9d9b640 1 -- 172.21.15.77:0/1900269098 learned_addr learned my addr 172.21.15.77:0/1900269098 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:47.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.102+0000 7f3dead9d640 1 --2- 172.21.15.77:0/1900269098 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3dec15aa40 0x7f3dec0c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.102+0000 7f3dea59c640 1 --2- 172.21.15.77:0/1900269098 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3dec06b410 0x7f3dec0c6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.102+0000 7f3de9d9b640 1 -- 172.21.15.77:0/1900269098 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3dec06b410 msgr2=0x7f3dec0c6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.102+0000 7f3de9d9b640 1 --2- 172.21.15.77:0/1900269098 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3dec06b410 0x7f3dec0c6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.102+0000 7f3de9d9b640 1 -- 172.21.15.77:0/1900269098 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3dec15aa40 msgr2=0x7f3dec0c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.102+0000 7f3de9d9b640 1 --2- 172.21.15.77:0/1900269098 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3dec15aa40 0x7f3dec0c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.102+0000 7f3de9d9b640 1 -- 172.21.15.77:0/1900269098 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ddc0094d0 con 0x7f3dec06cd70 2023-11-04T01:40:47.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.102+0000 7f3dead9d640 1 --2- 172.21.15.77:0/1900269098 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3dec15aa40 0x7f3dec0c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:47.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.102+0000 7f3dea59c640 1 --2- 172.21.15.77:0/1900269098 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3dec06b410 0x7f3dec0c6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:47.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.102+0000 7f3de9d9b640 1 --2- 172.21.15.77:0/1900269098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dec06cd70 0x7f3dec155960 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3de000c7f0 tx=0x7f3de000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.102+0000 7f3ddaffd640 1 -- 172.21.15.77:0/1900269098 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de000aa50 con 0x7f3dec06cd70 2023-11-04T01:40:47.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.102+0000 7f3ddaffd640 1 -- 172.21.15.77:0/1900269098 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de000abb0 con 0x7f3dec06cd70 2023-11-04T01:40:47.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.102+0000 7f3df0d0c640 1 -- 172.21.15.77:0/1900269098 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dec0ac400 con 0x7f3dec06cd70 2023-11-04T01:40:47.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.102+0000 7f3ddaffd640 1 -- 172.21.15.77:0/1900269098 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de0012420 con 0x7f3dec06cd70 2023-11-04T01:40:47.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.102+0000 7f3df0d0c640 1 -- 172.21.15.77:0/1900269098 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dec0ac9c0 con 0x7f3dec06cd70 2023-11-04T01:40:47.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.103+0000 7f3df0d0c640 1 -- 172.21.15.77:0/1900269098 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dec0ad1c0 con 0x7f3dec06cd70 2023-11-04T01:40:47.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.103+0000 7f3ddaffd640 1 -- 172.21.15.77:0/1900269098 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3de0012580 con 0x7f3dec06cd70 2023-11-04T01:40:47.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.104+0000 7f3ddaffd640 1 --2- 172.21.15.77:0/1900269098 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3dcc06aea0 0x7f3dcc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.104+0000 7f3ddaffd640 1 -- 172.21.15.77:0/1900269098 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3de00898d0 con 0x7f3dec06cd70 2023-11-04T01:40:47.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.104+0000 7f3dea59c640 1 --2- 172.21.15.77:0/1900269098 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3dcc06aea0 0x7f3dcc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.104+0000 7f3dea59c640 1 --2- 172.21.15.77:0/1900269098 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3dcc06aea0 0x7f3dcc06d360 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3de4008890 tx=0x7f3de4008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.108+0000 7f3ddaffd640 1 -- 172.21.15.77:0/1900269098 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3dec0ad1c0 con 0x7f3dec06cd70 2023-11-04T01:40:47.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.276+0000 7f3df0d0c640 1 -- 172.21.15.77:0/1900269098 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3dec0ad1c0 con 0x7f3dec06cd70 2023-11-04T01:40:47.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.276+0000 7f3ddaffd640 1 -- 172.21.15.77:0/1900269098 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3dec0ad1c0 con 0x7f3dec06cd70 2023-11-04T01:40:47.279 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-04T01:40:47.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.278+0000 7f3df0d0c640 1 -- 172.21.15.77:0/1900269098 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3dcc06aea0 msgr2=0x7f3dcc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.278+0000 7f3df0d0c640 1 --2- 172.21.15.77:0/1900269098 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3dcc06aea0 0x7f3dcc06d360 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3de4008890 tx=0x7f3de4008040 comp rx=0 tx=0).stop 2023-11-04T01:40:47.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.278+0000 7f3df0d0c640 1 -- 172.21.15.77:0/1900269098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dec06cd70 msgr2=0x7f3dec155960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.278+0000 7f3df0d0c640 1 --2- 172.21.15.77:0/1900269098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dec06cd70 0x7f3dec155960 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3de000c7f0 tx=0x7f3de000ccb0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.278+0000 7f3df0d0c640 1 -- 172.21.15.77:0/1900269098 shutdown_connections 2023-11-04T01:40:47.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.278+0000 7f3df0d0c640 1 --2- 172.21.15.77:0/1900269098 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3dcc06aea0 0x7f3dcc06d360 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.278+0000 7f3df0d0c640 1 --2- 172.21.15.77:0/1900269098 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3dec15aa40 0x7f3dec0c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.278+0000 7f3df0d0c640 1 --2- 172.21.15.77:0/1900269098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dec06cd70 0x7f3dec155960 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.278+0000 7f3df0d0c640 1 --2- 172.21.15.77:0/1900269098 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3dec06b410 0x7f3dec0c6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.278+0000 7f3df0d0c640 1 -- 172.21.15.77:0/1900269098 >> 172.21.15.77:0/1900269098 conn(0x7f3dec0cf140 msgr2=0x7f3dec0cbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:47.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.278+0000 7f3df0d0c640 1 -- 172.21.15.77:0/1900269098 shutdown_connections 2023-11-04T01:40:47.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.278+0000 7f3df0d0c640 1 -- 172.21.15.77:0/1900269098 wait complete. 2023-11-04T01:40:47.291 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:40:47.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.391+0000 7fb6d9b00640 1 Processor -- start 2023-11-04T01:40:47.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.391+0000 7fb6d9b00640 1 -- start start 2023-11-04T01:40:47.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.392+0000 7fb6d9b00640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb6d4160430 0x7fb6d40b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.392+0000 7fb6d9b00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb6d40b2b60 0x7fb6d406bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.392+0000 7fb6d9b00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb6d406c1d0 0x7fb6d4160b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.392+0000 7fb6d9b00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d40cb580 con 0x7fb6d40b2b60 2023-11-04T01:40:47.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.392+0000 7fb6d9b00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d40b2fc0 con 0x7fb6d406c1d0 2023-11-04T01:40:47.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.392+0000 7fb6d9b00640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d406ca40 con 0x7fb6d4160430 2023-11-04T01:40:47.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.392+0000 7fb6d2ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb6d40b2b60 0x7fb6d406bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.392+0000 7fb6d2ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb6d40b2b60 0x7fb6d406bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48752/0 (socket says 172.21.15.77:48752) 2023-11-04T01:40:47.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.392+0000 7fb6d2ffd640 1 -- 172.21.15.77:0/51598781 learned_addr learned my addr 172.21.15.77:0/51598781 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:47.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.392+0000 7fb6d3fff640 1 --2- 172.21.15.77:0/51598781 >> v2:172.21.15.122:3300/0 conn(0x7fb6d406c1d0 0x7fb6d4160b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.392+0000 7fb6d37fe640 1 --2- 172.21.15.77:0/51598781 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb6d4160430 0x7fb6d40b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.392+0000 7fb6d2ffd640 1 -- 172.21.15.77:0/51598781 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb6d4160430 msgr2=0x7fb6d40b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:47.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.392+0000 7fb6d2ffd640 1 --2- 172.21.15.77:0/51598781 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb6d4160430 0x7fb6d40b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.392+0000 7fb6d2ffd640 1 -- 172.21.15.77:0/51598781 >> v2:172.21.15.122:3300/0 conn(0x7fb6d406c1d0 msgr2=0x7fb6d4160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:47.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.392+0000 7fb6d2ffd640 1 --2- 172.21.15.77:0/51598781 >> v2:172.21.15.122:3300/0 conn(0x7fb6d406c1d0 0x7fb6d4160b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.392+0000 7fb6d2ffd640 1 -- 172.21.15.77:0/51598781 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d406cd20 con 0x7fb6d40b2b60 2023-11-04T01:40:47.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.393+0000 7fb6d2ffd640 1 --2- 172.21.15.77:0/51598781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6d40b2b60 0x7fb6d406bc90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb6d40ce900 tx=0x7fb6c802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9bd46b8cc0744f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.393+0000 7fb6d27fc640 1 -- 172.21.15.77:0/51598781 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c8031870 con 0x7fb6d40b2b60 2023-11-04T01:40:47.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.393+0000 7fb6d27fc640 1 -- 172.21.15.77:0/51598781 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c80319d0 con 0x7fb6d40b2b60 2023-11-04T01:40:47.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.393+0000 7fb6d27fc640 1 -- 172.21.15.77:0/51598781 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c8031d60 con 0x7fb6d40b2b60 2023-11-04T01:40:47.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.394+0000 7fb6d9b00640 1 -- 172.21.15.77:0/51598781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6d40b2b60 msgr2=0x7fb6d406bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.394+0000 7fb6d9b00640 1 --2- 172.21.15.77:0/51598781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6d40b2b60 0x7fb6d406bc90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb6d40ce900 tx=0x7fb6c802b910 comp rx=0 tx=0).stop 2023-11-04T01:40:47.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.394+0000 7fb6d9b00640 1 -- 172.21.15.77:0/51598781 shutdown_connections 2023-11-04T01:40:47.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.394+0000 7fb6d9b00640 1 --2- 172.21.15.77:0/51598781 >> v2:172.21.15.122:3300/0 conn(0x7fb6d406c1d0 0x7fb6d4160b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.394+0000 7fb6d9b00640 1 --2- 172.21.15.77:0/51598781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6d40b2b60 0x7fb6d406bc90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.394+0000 7fb6d9b00640 1 --2- 172.21.15.77:0/51598781 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb6d4160430 0x7fb6d40b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.394+0000 7fb6d9b00640 1 -- 172.21.15.77:0/51598781 >> 172.21.15.77:0/51598781 conn(0x7fb6d406ea20 msgr2=0x7fb6d406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:47.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.394+0000 7fb6d9b00640 1 -- 172.21.15.77:0/51598781 shutdown_connections 2023-11-04T01:40:47.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.394+0000 7fb6d9b00640 1 -- 172.21.15.77:0/51598781 wait complete. 2023-11-04T01:40:47.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.395+0000 7fb6d9b00640 1 Processor -- start 2023-11-04T01:40:47.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.395+0000 7fb6d9b00640 1 -- start start 2023-11-04T01:40:47.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.396+0000 7fb6d9b00640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb6d406c1d0 0x7fb6d40c51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.396+0000 7fb6d9b00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6d40b2b60 0x7fb6d41f2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.396+0000 7fb6d9b00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6d4160430 0x7fb6d415c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.396+0000 7fb6d9b00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d40c6400 con 0x7fb6d4160430 2023-11-04T01:40:47.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.396+0000 7fb6d9b00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d415cea0 con 0x7fb6d40b2b60 2023-11-04T01:40:47.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.396+0000 7fb6d9b00640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d40c5780 con 0x7fb6d406c1d0 2023-11-04T01:40:47.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.396+0000 7fb6d3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6d4160430 0x7fb6d415c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.396+0000 7fb6d3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6d4160430 0x7fb6d415c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48758/0 (socket says 172.21.15.77:48758) 2023-11-04T01:40:47.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.396+0000 7fb6d3fff640 1 -- 172.21.15.77:0/2069962608 learned_addr learned my addr 172.21.15.77:0/2069962608 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:47.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.396+0000 7fb6d37fe640 1 --2- 172.21.15.77:0/2069962608 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb6d406c1d0 0x7fb6d40c51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.396+0000 7fb6d2ffd640 1 --2- 172.21.15.77:0/2069962608 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6d40b2b60 0x7fb6d41f2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.396+0000 7fb6d3fff640 1 -- 172.21.15.77:0/2069962608 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb6d406c1d0 msgr2=0x7fb6d40c51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.396+0000 7fb6d3fff640 1 --2- 172.21.15.77:0/2069962608 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb6d406c1d0 0x7fb6d40c51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.396+0000 7fb6d3fff640 1 -- 172.21.15.77:0/2069962608 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6d40b2b60 msgr2=0x7fb6d41f2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.396+0000 7fb6d3fff640 1 --2- 172.21.15.77:0/2069962608 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6d40b2b60 0x7fb6d41f2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.396+0000 7fb6d3fff640 1 -- 172.21.15.77:0/2069962608 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c80094d0 con 0x7fb6d4160430 2023-11-04T01:40:47.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.396+0000 7fb6d37fe640 1 --2- 172.21.15.77:0/2069962608 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb6d406c1d0 0x7fb6d40c51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:47.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.396+0000 7fb6d2ffd640 1 --2- 172.21.15.77:0/2069962608 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6d40b2b60 0x7fb6d41f2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:47.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.396+0000 7fb6d3fff640 1 --2- 172.21.15.77:0/2069962608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6d4160430 0x7fb6d415c960 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc007e60 tx=0x7fb6cc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.396+0000 7fb6bbfff640 1 -- 172.21.15.77:0/2069962608 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc014620 con 0x7fb6d4160430 2023-11-04T01:40:47.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.396+0000 7fb6bbfff640 1 -- 172.21.15.77:0/2069962608 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6cc00ee90 con 0x7fb6d4160430 2023-11-04T01:40:47.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.396+0000 7fb6d9b00640 1 -- 172.21.15.77:0/2069962608 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d40c5a60 con 0x7fb6d4160430 2023-11-04T01:40:47.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.396+0000 7fb6bbfff640 1 -- 172.21.15.77:0/2069962608 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc0149e0 con 0x7fb6d4160430 2023-11-04T01:40:47.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.396+0000 7fb6d9b00640 1 -- 172.21.15.77:0/2069962608 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6d40c6020 con 0x7fb6d4160430 2023-11-04T01:40:47.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.397+0000 7fb6d9b00640 1 -- 172.21.15.77:0/2069962608 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6d4074290 con 0x7fb6d4160430 2023-11-04T01:40:47.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.398+0000 7fb6bbfff640 1 -- 172.21.15.77:0/2069962608 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb6cc014b40 con 0x7fb6d4160430 2023-11-04T01:40:47.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.398+0000 7fb6bbfff640 1 --2- 172.21.15.77:0/2069962608 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb6c006ae70 0x7fb6c006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.398+0000 7fb6bbfff640 1 -- 172.21.15.77:0/2069962608 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb6cc08a2a0 con 0x7fb6d4160430 2023-11-04T01:40:47.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.399+0000 7fb6d37fe640 1 --2- 172.21.15.77:0/2069962608 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb6c006ae70 0x7fb6c006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.399+0000 7fb6d37fe640 1 --2- 172.21.15.77:0/2069962608 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb6c006ae70 0x7fb6c006d330 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4006fd0 tx=0x7fb6c4008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.403+0000 7fb6bbfff640 1 -- 172.21.15.77:0/2069962608 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb6cc055020 con 0x7fb6d4160430 2023-11-04T01:40:47.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.568+0000 7fb6d9b00640 1 -- 172.21.15.77:0/2069962608 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb6d40b6b20 con 0x7fb6d4160430 2023-11-04T01:40:47.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.568+0000 7fb6bbfff640 1 -- 172.21.15.77:0/2069962608 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb6cc058640 con 0x7fb6d4160430 2023-11-04T01:40:47.570 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:40:47.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.570+0000 7fb6d9b00640 1 -- 172.21.15.77:0/2069962608 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb6c006ae70 msgr2=0x7fb6c006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.570+0000 7fb6d9b00640 1 --2- 172.21.15.77:0/2069962608 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb6c006ae70 0x7fb6c006d330 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4006fd0 tx=0x7fb6c4008040 comp rx=0 tx=0).stop 2023-11-04T01:40:47.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.570+0000 7fb6d9b00640 1 -- 172.21.15.77:0/2069962608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6d4160430 msgr2=0x7fb6d415c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.570+0000 7fb6d9b00640 1 --2- 172.21.15.77:0/2069962608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6d4160430 0x7fb6d415c960 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc007e60 tx=0x7fb6cc00e4b0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.570+0000 7fb6d9b00640 1 -- 172.21.15.77:0/2069962608 shutdown_connections 2023-11-04T01:40:47.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.570+0000 7fb6d9b00640 1 --2- 172.21.15.77:0/2069962608 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb6c006ae70 0x7fb6c006d330 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.570+0000 7fb6d9b00640 1 --2- 172.21.15.77:0/2069962608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6d4160430 0x7fb6d415c960 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.570+0000 7fb6d9b00640 1 --2- 172.21.15.77:0/2069962608 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6d40b2b60 0x7fb6d41f2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.570+0000 7fb6d9b00640 1 --2- 172.21.15.77:0/2069962608 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb6d406c1d0 0x7fb6d40c51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.570+0000 7fb6d9b00640 1 -- 172.21.15.77:0/2069962608 >> 172.21.15.77:0/2069962608 conn(0x7fb6d406ea20 msgr2=0x7fb6d40cbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:47.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.570+0000 7fb6d9b00640 1 -- 172.21.15.77:0/2069962608 shutdown_connections 2023-11-04T01:40:47.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.570+0000 7fb6d9b00640 1 -- 172.21.15.77:0/2069962608 wait complete. 2023-11-04T01:40:47.583 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:47.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.683+0000 7f42dd407640 1 Processor -- start 2023-11-04T01:40:47.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.683+0000 7f42dd407640 1 -- start start 2023-11-04T01:40:47.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.684+0000 7f42dd407640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f42d8159c70 0x7f42d80ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.684+0000 7f42dd407640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d80b4110 con 0x7f42d806db20 2023-11-04T01:40:47.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.684+0000 7f42dd407640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d80b43f0 con 0x7f42d80b0ae0 2023-11-04T01:40:47.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.684+0000 7f42dd407640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d80b49b0 con 0x7f42d8159c70 2023-11-04T01:40:47.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.684+0000 7f42d6ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f42d8159c70 0x7f42d80ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.684+0000 7f42cffff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f42d806db20 0x7f42d80b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36498/0 (socket says 172.21.15.77:36498) 2023-11-04T01:40:47.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.684+0000 7f42d6ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f42d8159c70 0x7f42d80ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48942/0 (socket says 172.21.15.77:48942) 2023-11-04T01:40:47.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.684+0000 7f42cffff640 1 -- 172.21.15.77:0/3978879568 learned_addr learned my addr 172.21.15.77:0/3978879568 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:47.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.684+0000 7f42d6ffd640 1 -- 172.21.15.77:0/3978879568 >> v1:172.21.15.122:6789/0 conn(0x7f42d80b0ae0 legacy=0x7f42d815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:47.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.684+0000 7f42d6ffd640 1 -- 172.21.15.77:0/3978879568 >> v1:172.21.15.77:6789/0 conn(0x7f42d806db20 legacy=0x7f42d80b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.684+0000 7f42d6ffd640 1 -- 172.21.15.77:0/3978879568 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d80b46d0 con 0x7f42d8159c70 2023-11-04T01:40:47.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.685+0000 7f42d6ffd640 1 --2- 172.21.15.77:0/3978879568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42d8159c70 0x7f42d80ce370 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f42c80097a0 tx=0x7f42c802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fb615b857c1199b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.685+0000 7f42d67fc640 1 -- 172.21.15.77:0/3978879568 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c8031830 con 0x7f42d8159c70 2023-11-04T01:40:47.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.685+0000 7f42d67fc640 1 -- 172.21.15.77:0/3978879568 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c8031990 con 0x7f42d8159c70 2023-11-04T01:40:47.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.685+0000 7f42d67fc640 1 -- 172.21.15.77:0/3978879568 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c8031d20 con 0x7f42d8159c70 2023-11-04T01:40:47.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.685+0000 7f42dd407640 1 -- 172.21.15.77:0/3978879568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42d8159c70 msgr2=0x7f42d80ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.686+0000 7f42dd407640 1 --2- 172.21.15.77:0/3978879568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42d8159c70 0x7f42d80ce370 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f42c80097a0 tx=0x7f42c802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.686+0000 7f42dd407640 1 -- 172.21.15.77:0/3978879568 shutdown_connections 2023-11-04T01:40:47.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.686+0000 7f42dd407640 1 --2- 172.21.15.77:0/3978879568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42d8159c70 0x7f42d80ce370 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.686+0000 7f42dd407640 1 -- 172.21.15.77:0/3978879568 >> 172.21.15.77:0/3978879568 conn(0x7f42d80ce950 msgr2=0x7f42d80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:47.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.686+0000 7f42dd407640 1 -- 172.21.15.77:0/3978879568 shutdown_connections 2023-11-04T01:40:47.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.686+0000 7f42dd407640 1 -- 172.21.15.77:0/3978879568 wait complete. 2023-11-04T01:40:47.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.687+0000 7f42dd407640 1 Processor -- start 2023-11-04T01:40:47.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.687+0000 7f42dd407640 1 -- start start 2023-11-04T01:40:47.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.687+0000 7f42dd407640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42d806db20 0x7f42d8152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.687+0000 7f42dd407640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42d80b0ae0 0x7f42d80c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.687+0000 7f42dd407640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42d8159c70 0x7f42d80c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.687+0000 7f42dd407640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d8150e80 con 0x7f42d806db20 2023-11-04T01:40:47.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.687+0000 7f42dd407640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d80c6ea0 con 0x7f42d8159c70 2023-11-04T01:40:47.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.687+0000 7f42dd407640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d8150830 con 0x7f42d80b0ae0 2023-11-04T01:40:47.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.688+0000 7f42d6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42d806db20 0x7f42d8152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.688+0000 7f42d6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42d806db20 0x7f42d8152520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48946/0 (socket says 172.21.15.77:48946) 2023-11-04T01:40:47.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.688+0000 7f42d6ffd640 1 -- 172.21.15.77:0/3574781518 learned_addr learned my addr 172.21.15.77:0/3574781518 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:47.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.688+0000 7f42d77fe640 1 --2- 172.21.15.77:0/3574781518 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42d8159c70 0x7f42d80c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.688+0000 7f42cffff640 1 --2- 172.21.15.77:0/3574781518 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42d80b0ae0 0x7f42d80c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.688+0000 7f42d6ffd640 1 -- 172.21.15.77:0/3574781518 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42d80b0ae0 msgr2=0x7f42d80c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.688+0000 7f42d6ffd640 1 --2- 172.21.15.77:0/3574781518 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42d80b0ae0 0x7f42d80c46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.688+0000 7f42d6ffd640 1 -- 172.21.15.77:0/3574781518 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42d8159c70 msgr2=0x7f42d80c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.688+0000 7f42d6ffd640 1 --2- 172.21.15.77:0/3574781518 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42d8159c70 0x7f42d80c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.688+0000 7f42d6ffd640 1 -- 172.21.15.77:0/3574781518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c8009400 con 0x7f42d806db20 2023-11-04T01:40:47.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.688+0000 7f42cffff640 1 --2- 172.21.15.77:0/3574781518 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42d80b0ae0 0x7f42d80c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:47.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.688+0000 7f42d6ffd640 1 --2- 172.21.15.77:0/3574781518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42d806db20 0x7f42d8152520 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f42c8000c00 tx=0x7f42c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.688+0000 7f42cf7fe640 1 -- 172.21.15.77:0/3574781518 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c803aa60 con 0x7f42d806db20 2023-11-04T01:40:47.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.688+0000 7f42cf7fe640 1 -- 172.21.15.77:0/3574781518 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c803abc0 con 0x7f42d806db20 2023-11-04T01:40:47.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.688+0000 7f42cf7fe640 1 -- 172.21.15.77:0/3574781518 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c80443f0 con 0x7f42d806db20 2023-11-04T01:40:47.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.688+0000 7f42dd407640 1 -- 172.21.15.77:0/3574781518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d8150b10 con 0x7f42d806db20 2023-11-04T01:40:47.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.688+0000 7f42dd407640 1 -- 172.21.15.77:0/3574781518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d80c4c30 con 0x7f42d806db20 2023-11-04T01:40:47.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.689+0000 7f42dd407640 1 -- 172.21.15.77:0/3574781518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d8074290 con 0x7f42d806db20 2023-11-04T01:40:47.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.690+0000 7f42cf7fe640 1 -- 172.21.15.77:0/3574781518 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f42c804d450 con 0x7f42d806db20 2023-11-04T01:40:47.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.690+0000 7f42cf7fe640 1 --2- 172.21.15.77:0/3574781518 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f42b806aea0 0x7f42b806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.690+0000 7f42cf7fe640 1 -- 172.21.15.77:0/3574781518 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f42c80abbb0 con 0x7f42d806db20 2023-11-04T01:40:47.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.690+0000 7f42cffff640 1 --2- 172.21.15.77:0/3574781518 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f42b806aea0 0x7f42b806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.691+0000 7f42cffff640 1 --2- 172.21.15.77:0/3574781518 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f42b806aea0 0x7f42b806d360 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f42d8152d10 tx=0x7f42c0009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.694+0000 7f42cf7fe640 1 -- 172.21.15.77:0/3574781518 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f42c80768a0 con 0x7f42d806db20 2023-11-04T01:40:47.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.868+0000 7f42dd407640 1 -- 172.21.15.77:0/3574781518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42d8150620 con 0x7f42d806db20 2023-11-04T01:40:47.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.869+0000 7f42cf7fe640 1 -- 172.21.15.77:0/3574781518 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18661 (secure 0 0 0) 0x7f42c8079ec0 con 0x7f42d806db20 2023-11-04T01:40:47.871 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:47.871 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":26,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:40:47.579547+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:40:02.810971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:40:04.003979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:40:07.734355+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:47.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.870+0000 7f42dd407640 1 -- 172.21.15.77:0/3574781518 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f42b806aea0 msgr2=0x7f42b806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.870+0000 7f42dd407640 1 --2- 172.21.15.77:0/3574781518 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f42b806aea0 0x7f42b806d360 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f42d8152d10 tx=0x7f42c0009040 comp rx=0 tx=0).stop 2023-11-04T01:40:47.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.870+0000 7f42dd407640 1 -- 172.21.15.77:0/3574781518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42d806db20 msgr2=0x7f42d8152520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.870+0000 7f42dd407640 1 --2- 172.21.15.77:0/3574781518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42d806db20 0x7f42d8152520 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f42c8000c00 tx=0x7f42c80046c0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.871+0000 7f42dd407640 1 -- 172.21.15.77:0/3574781518 shutdown_connections 2023-11-04T01:40:47.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.871+0000 7f42dd407640 1 --2- 172.21.15.77:0/3574781518 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f42b806aea0 0x7f42b806d360 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.871+0000 7f42dd407640 1 --2- 172.21.15.77:0/3574781518 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42d8159c70 0x7f42d80c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.871+0000 7f42dd407640 1 --2- 172.21.15.77:0/3574781518 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42d80b0ae0 0x7f42d80c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.871+0000 7f42dd407640 1 --2- 172.21.15.77:0/3574781518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42d806db20 0x7f42d8152520 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.871+0000 7f42dd407640 1 -- 172.21.15.77:0/3574781518 >> 172.21.15.77:0/3574781518 conn(0x7f42d80ce950 msgr2=0x7f42d815a050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:47.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.871+0000 7f42dd407640 1 -- 172.21.15.77:0/3574781518 shutdown_connections 2023-11-04T01:40:47.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.871+0000 7f42dd407640 1 -- 172.21.15.77:0/3574781518 wait complete. 2023-11-04T01:40:47.883 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:40:02.810971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:40:04.003979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:40:07.734355+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:40:47.884 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:40:47.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.985+0000 7ff972789640 1 Processor -- start 2023-11-04T01:40:47.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.985+0000 7ff972789640 1 -- start start 2023-11-04T01:40:47.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.986+0000 7ff972789640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff96c153850 0x7ff96c15a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.986+0000 7ff972789640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff96c0cc9d0 0x7ff96c0c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.986+0000 7ff972789640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff96c0c3860 con 0x7ff96c0cc520 2023-11-04T01:40:47.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.986+0000 7ff972789640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff96c0c9250 con 0x7ff96c153850 2023-11-04T01:40:47.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.986+0000 7ff972789640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff96c153c30 con 0x7ff96c0cc9d0 2023-11-04T01:40:47.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.986+0000 7ff96bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff96c153850 0x7ff96c15a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.986+0000 7ff96bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff96c153850 0x7ff96c15a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48960/0 (socket says 172.21.15.77:48960) 2023-11-04T01:40:47.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.986+0000 7ff96bfff640 1 -- 172.21.15.77:0/1587696707 learned_addr learned my addr 172.21.15.77:0/1587696707 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:47.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.986+0000 7ff970d26640 1 --2- 172.21.15.77:0/1587696707 >> v2:172.21.15.122:3300/0 conn(0x7ff96c0cc9d0 0x7ff96c0c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.986+0000 7ff96bfff640 1 -- 172.21.15.77:0/1587696707 >> v2:172.21.15.122:3300/0 conn(0x7ff96c0cc9d0 msgr2=0x7ff96c0c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:47.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.986+0000 7ff96bfff640 1 --2- 172.21.15.77:0/1587696707 >> v2:172.21.15.122:3300/0 conn(0x7ff96c0cc9d0 0x7ff96c0c3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.986+0000 7ff96bfff640 1 -- 172.21.15.77:0/1587696707 >> v1:172.21.15.122:6789/0 conn(0x7ff96c0cc520 legacy=0x7ff96c070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.986+0000 7ff96bfff640 1 -- 172.21.15.77:0/1587696707 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96c15a700 con 0x7ff96c153850 2023-11-04T01:40:47.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.987+0000 7ff96bfff640 1 --2- 172.21.15.77:0/1587696707 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff96c153850 0x7ff96c15a1c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff96c0ca7c0 tx=0x7ff95c02df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d49ead52aa0444 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:47.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.987+0000 7ff96affd640 1 -- 172.21.15.77:0/1587696707 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c02ed40 con 0x7ff96c153850 2023-11-04T01:40:47.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.987+0000 7ff96affd640 1 -- 172.21.15.77:0/1587696707 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95c036440 con 0x7ff96c153850 2023-11-04T01:40:47.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.987+0000 7ff96affd640 1 -- 172.21.15.77:0/1587696707 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c02eea0 con 0x7ff96c153850 2023-11-04T01:40:47.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.987+0000 7ff972789640 1 -- 172.21.15.77:0/1587696707 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff96c153850 msgr2=0x7ff96c15a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.987+0000 7ff972789640 1 --2- 172.21.15.77:0/1587696707 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff96c153850 0x7ff96c15a1c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff96c0ca7c0 tx=0x7ff95c02df90 comp rx=0 tx=0).stop 2023-11-04T01:40:47.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.988+0000 7ff972789640 1 -- 172.21.15.77:0/1587696707 shutdown_connections 2023-11-04T01:40:47.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.988+0000 7ff972789640 1 --2- 172.21.15.77:0/1587696707 >> v2:172.21.15.122:3300/0 conn(0x7ff96c0cc9d0 0x7ff96c0c3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.988+0000 7ff972789640 1 --2- 172.21.15.77:0/1587696707 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff96c153850 0x7ff96c15a1c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.988+0000 7ff972789640 1 -- 172.21.15.77:0/1587696707 >> 172.21.15.77:0/1587696707 conn(0x7ff96c0ce950 msgr2=0x7ff96c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:47.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.988+0000 7ff972789640 1 -- 172.21.15.77:0/1587696707 shutdown_connections 2023-11-04T01:40:47.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.988+0000 7ff972789640 1 -- 172.21.15.77:0/1587696707 wait complete. 2023-11-04T01:40:47.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.989+0000 7ff972789640 1 Processor -- start 2023-11-04T01:40:47.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.989+0000 7ff972789640 1 -- start start 2023-11-04T01:40:47.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.990+0000 7ff972789640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff96c0cc520 0x7ff96c1419f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.990+0000 7ff972789640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff96c0cc9d0 0x7ff96c14fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.990+0000 7ff972789640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff96c153850 0x7ff96c1410c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:47.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.990+0000 7ff972789640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c0b1a00 con 0x7ff96c0cc520 2023-11-04T01:40:47.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.990+0000 7ff972789640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c152220 con 0x7ff96c0cc9d0 2023-11-04T01:40:47.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.990+0000 7ff972789640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c152500 con 0x7ff96c153850 2023-11-04T01:40:47.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.990+0000 7ff96bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff96c0cc520 0x7ff96c1419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:47.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.990+0000 7ff96bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff96c0cc520 0x7ff96c1419f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48968/0 (socket says 172.21.15.77:48968) 2023-11-04T01:40:47.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.990+0000 7ff96bfff640 1 -- 172.21.15.77:0/659484364 learned_addr learned my addr 172.21.15.77:0/659484364 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:47.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.990+0000 7ff96bfff640 1 -- 172.21.15.77:0/659484364 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff96c153850 msgr2=0x7ff96c1410c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:47.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.990+0000 7ff96bfff640 1 --2- 172.21.15.77:0/659484364 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff96c153850 0x7ff96c1410c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:47.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.990+0000 7ff96bfff640 1 -- 172.21.15.77:0/659484364 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff96c0cc9d0 msgr2=0x7ff96c14fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.990+0000 7ff96bfff640 1 --2- 172.21.15.77:0/659484364 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff96c0cc9d0 0x7ff96c14fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.990+0000 7ff96bfff640 1 -- 172.21.15.77:0/659484364 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95c00a670 con 0x7ff96c0cc520 2023-11-04T01:40:48.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.990+0000 7ff96bfff640 1 --2- 172.21.15.77:0/659484364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff96c0cc520 0x7ff96c1419f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff95c02dfd0 tx=0x7ff95c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:48.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.990+0000 7ff968ff9640 1 -- 172.21.15.77:0/659484364 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c03f3f0 con 0x7ff96c0cc520 2023-11-04T01:40:48.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.990+0000 7ff968ff9640 1 -- 172.21.15.77:0/659484364 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95c03f550 con 0x7ff96c0cc520 2023-11-04T01:40:48.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.990+0000 7ff972789640 1 -- 172.21.15.77:0/659484364 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff96c1527e0 con 0x7ff96c0cc520 2023-11-04T01:40:48.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.990+0000 7ff968ff9640 1 -- 172.21.15.77:0/659484364 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c03f900 con 0x7ff96c0cc520 2023-11-04T01:40:48.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.990+0000 7ff972789640 1 -- 172.21.15.77:0/659484364 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff96c150170 con 0x7ff96c0cc520 2023-11-04T01:40:48.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.991+0000 7ff972789640 1 -- 172.21.15.77:0/659484364 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff96c074290 con 0x7ff96c0cc520 2023-11-04T01:40:48.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.992+0000 7ff968ff9640 1 -- 172.21.15.77:0/659484364 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff95c03d040 con 0x7ff96c0cc520 2023-11-04T01:40:48.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.992+0000 7ff968ff9640 1 --2- 172.21.15.77:0/659484364 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff95806ae70 0x7ff95806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.992+0000 7ff968ff9640 1 -- 172.21.15.77:0/659484364 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff95c0adc10 con 0x7ff96c0cc520 2023-11-04T01:40:48.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.992+0000 7ff96b7fe640 1 --2- 172.21.15.77:0/659484364 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff95806ae70 0x7ff95806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.993+0000 7ff96b7fe640 1 --2- 172.21.15.77:0/659484364 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff95806ae70 0x7ff95806d330 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff960000f60 tx=0x7ff9600079b0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:48.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:47.996+0000 7ff968ff9640 1 -- 172.21.15.77:0/659484364 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff95c078900 con 0x7ff96c0cc520 2023-11-04T01:40:48.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.160+0000 7ff972789640 1 -- 172.21.15.77:0/659484364 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff96c0c5010 con 0x7ff96c0cc520 2023-11-04T01:40:48.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.160+0000 7ff968ff9640 1 -- 172.21.15.77:0/659484364 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff95c07bf20 con 0x7ff96c0cc520 2023-11-04T01:40:48.162 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:40:48.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.162+0000 7ff972789640 1 -- 172.21.15.77:0/659484364 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff95806ae70 msgr2=0x7ff95806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.162+0000 7ff972789640 1 --2- 172.21.15.77:0/659484364 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff95806ae70 0x7ff95806d330 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff960000f60 tx=0x7ff9600079b0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.162+0000 7ff972789640 1 -- 172.21.15.77:0/659484364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff96c0cc520 msgr2=0x7ff96c1419f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.162+0000 7ff972789640 1 --2- 172.21.15.77:0/659484364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff96c0cc520 0x7ff96c1419f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff95c02dfd0 tx=0x7ff95c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.162+0000 7ff972789640 1 -- 172.21.15.77:0/659484364 shutdown_connections 2023-11-04T01:40:48.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.162+0000 7ff972789640 1 --2- 172.21.15.77:0/659484364 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff95806ae70 0x7ff95806d330 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.162+0000 7ff972789640 1 --2- 172.21.15.77:0/659484364 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff96c153850 0x7ff96c1410c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.162+0000 7ff972789640 1 --2- 172.21.15.77:0/659484364 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff96c0cc9d0 0x7ff96c14fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.162+0000 7ff972789640 1 --2- 172.21.15.77:0/659484364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff96c0cc520 0x7ff96c1419f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.162+0000 7ff972789640 1 -- 172.21.15.77:0/659484364 >> 172.21.15.77:0/659484364 conn(0x7ff96c0ce950 msgr2=0x7ff96c14f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:48.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.162+0000 7ff972789640 1 -- 172.21.15.77:0/659484364 shutdown_connections 2023-11-04T01:40:48.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.162+0000 7ff972789640 1 -- 172.21.15.77:0/659484364 wait complete. 2023-11-04T01:40:48.175 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:40:48.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.275+0000 7f3182e56640 1 Processor -- start 2023-11-04T01:40:48.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.275+0000 7f3182e56640 1 -- start start 2023-11-04T01:40:48.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.275+0000 7f3182e56640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f317c15d050 0x7f317c161440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.276+0000 7f3182e56640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f317c06b730 0x7f317c06e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.276+0000 7f3182e56640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f317c161980 con 0x7f317c06a120 2023-11-04T01:40:48.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.276+0000 7f3182e56640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f317c06f960 con 0x7f317c06b730 2023-11-04T01:40:48.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.276+0000 7f3182e56640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f317c0caad0 con 0x7f317c15d050 2023-11-04T01:40:48.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.276+0000 7f317bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f317c06b730 0x7f317c06e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.276+0000 7f31813f3640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f317c06a120 0x7f317c0cd030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36500/0 (socket says 172.21.15.77:36500) 2023-11-04T01:40:48.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.276+0000 7f317bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f317c06b730 0x7f317c06e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48974/0 (socket says 172.21.15.77:48974) 2023-11-04T01:40:48.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.276+0000 7f31813f3640 1 -- 172.21.15.77:0/618596595 learned_addr learned my addr 172.21.15.77:0/618596595 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:48.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.276+0000 7f3180bf2640 1 --2- 172.21.15.77:0/618596595 >> v2:172.21.15.122:3300/0 conn(0x7f317c15d050 0x7f317c161440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.276+0000 7f317bfff640 1 -- 172.21.15.77:0/618596595 >> v2:172.21.15.122:3300/0 conn(0x7f317c15d050 msgr2=0x7f317c161440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:48.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.276+0000 7f317bfff640 1 --2- 172.21.15.77:0/618596595 >> v2:172.21.15.122:3300/0 conn(0x7f317c15d050 0x7f317c161440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.276+0000 7f317bfff640 1 -- 172.21.15.77:0/618596595 >> v1:172.21.15.77:6789/0 conn(0x7f317c06a120 legacy=0x7f317c0cd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.276+0000 7f317bfff640 1 -- 172.21.15.77:0/618596595 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f317c06a690 con 0x7f317c06b730 2023-11-04T01:40:48.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.277+0000 7f317bfff640 1 --2- 172.21.15.77:0/618596595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f317c06b730 0x7f317c06e2b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f317c06e050 tx=0x7f316802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a0e0c28784a02a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:48.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.277+0000 7f317b7fe640 1 -- 172.21.15.77:0/618596595 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3168031830 con 0x7f317c06b730 2023-11-04T01:40:48.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.277+0000 7f317b7fe640 1 -- 172.21.15.77:0/618596595 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3168031990 con 0x7f317c06b730 2023-11-04T01:40:48.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.277+0000 7f317b7fe640 1 -- 172.21.15.77:0/618596595 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3168031d20 con 0x7f317c06b730 2023-11-04T01:40:48.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.277+0000 7f3182e56640 1 -- 172.21.15.77:0/618596595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f317c06b730 msgr2=0x7f317c06e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.277+0000 7f3182e56640 1 --2- 172.21.15.77:0/618596595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f317c06b730 0x7f317c06e2b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f317c06e050 tx=0x7f316802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.277+0000 7f3182e56640 1 -- 172.21.15.77:0/618596595 shutdown_connections 2023-11-04T01:40:48.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.277+0000 7f3182e56640 1 --2- 172.21.15.77:0/618596595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f317c06b730 0x7f317c06e2b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.277+0000 7f3182e56640 1 --2- 172.21.15.77:0/618596595 >> v2:172.21.15.122:3300/0 conn(0x7f317c15d050 0x7f317c161440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.277+0000 7f3182e56640 1 -- 172.21.15.77:0/618596595 >> 172.21.15.77:0/618596595 conn(0x7f317c06cd70 msgr2=0x7f317c06d180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:48.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.277+0000 7f3182e56640 1 -- 172.21.15.77:0/618596595 shutdown_connections 2023-11-04T01:40:48.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.277+0000 7f3182e56640 1 -- 172.21.15.77:0/618596595 wait complete. 2023-11-04T01:40:48.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.279+0000 7f3182e56640 1 Processor -- start 2023-11-04T01:40:48.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.279+0000 7f3182e56640 1 -- start start 2023-11-04T01:40:48.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.279+0000 7f3182e56640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f317c06a120 0x7f317c0c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.279+0000 7f3182e56640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f317c06b730 0x7f317c150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.279+0000 7f3182e56640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f317c15d050 0x7f317c0b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.279+0000 7f3182e56640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317c1530b0 con 0x7f317c06b730 2023-11-04T01:40:48.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.280+0000 7f3182e56640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317c0c9090 con 0x7f317c15d050 2023-11-04T01:40:48.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.280+0000 7f3182e56640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f317c1f66f0 con 0x7f317c06a120 2023-11-04T01:40:48.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.280+0000 7f317bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f317c06b730 0x7f317c150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.280+0000 7f317bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f317c06b730 0x7f317c150b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48984/0 (socket says 172.21.15.77:48984) 2023-11-04T01:40:48.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.280+0000 7f317bfff640 1 -- 172.21.15.77:0/1542151299 learned_addr learned my addr 172.21.15.77:0/1542151299 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:48.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.280+0000 7f3180bf2640 1 --2- 172.21.15.77:0/1542151299 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f317c06a120 0x7f317c0c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.280+0000 7f31813f3640 1 --2- 172.21.15.77:0/1542151299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f317c15d050 0x7f317c0b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.280+0000 7f317bfff640 1 -- 172.21.15.77:0/1542151299 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f317c06a120 msgr2=0x7f317c0c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.280+0000 7f317bfff640 1 --2- 172.21.15.77:0/1542151299 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f317c06a120 0x7f317c0c8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.280+0000 7f317bfff640 1 -- 172.21.15.77:0/1542151299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f317c15d050 msgr2=0x7f317c0b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.280+0000 7f317bfff640 1 --2- 172.21.15.77:0/1542151299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f317c15d050 0x7f317c0b2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.280+0000 7f317bfff640 1 -- 172.21.15.77:0/1542151299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3168009400 con 0x7f317c06b730 2023-11-04T01:40:48.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.280+0000 7f317bfff640 1 --2- 172.21.15.77:0/1542151299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f317c06b730 0x7f317c150b50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3168000c00 tx=0x7f31680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:48.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.280+0000 7f31797fa640 1 -- 172.21.15.77:0/1542151299 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316803aa60 con 0x7f317c06b730 2023-11-04T01:40:48.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.280+0000 7f31797fa640 1 -- 172.21.15.77:0/1542151299 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f316803abe0 con 0x7f317c06b730 2023-11-04T01:40:48.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.280+0000 7f3182e56640 1 -- 172.21.15.77:0/1542151299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f317c1f69d0 con 0x7f317c06b730 2023-11-04T01:40:48.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.280+0000 7f31797fa640 1 -- 172.21.15.77:0/1542151299 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31680443f0 con 0x7f317c06b730 2023-11-04T01:40:48.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.280+0000 7f3182e56640 1 -- 172.21.15.77:0/1542151299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f317c1f6f90 con 0x7f317c06b730 2023-11-04T01:40:48.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.281+0000 7f3182e56640 1 -- 172.21.15.77:0/1542151299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f317c074290 con 0x7f317c06b730 2023-11-04T01:40:48.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.281+0000 7f31797fa640 1 -- 172.21.15.77:0/1542151299 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f316804d450 con 0x7f317c06b730 2023-11-04T01:40:48.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.282+0000 7f31797fa640 1 --2- 172.21.15.77:0/1542151299 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f316006ae70 0x7f316006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.282+0000 7f31797fa640 1 -- 172.21.15.77:0/1542151299 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f31680abad0 con 0x7f317c06b730 2023-11-04T01:40:48.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.282+0000 7f3180bf2640 1 --2- 172.21.15.77:0/1542151299 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f316006ae70 0x7f316006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.283+0000 7f3180bf2640 1 --2- 172.21.15.77:0/1542151299 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f316006ae70 0x7f316006d330 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3170006fd0 tx=0x7f3170008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:48.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.286+0000 7f31797fa640 1 -- 172.21.15.77:0/1542151299 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3168076850 con 0x7f317c06b730 2023-11-04T01:40:48.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.450+0000 7f3182e56640 1 -- 172.21.15.77:0/1542151299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f317c15bf50 con 0x7f317c06b730 2023-11-04T01:40:48.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.451+0000 7f31797fa640 1 -- 172.21.15.77:0/1542151299 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3168035020 con 0x7f317c06b730 2023-11-04T01:40:48.453 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:40:48.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.453+0000 7f3182e56640 1 -- 172.21.15.77:0/1542151299 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f316006ae70 msgr2=0x7f316006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.453+0000 7f3182e56640 1 --2- 172.21.15.77:0/1542151299 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f316006ae70 0x7f316006d330 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3170006fd0 tx=0x7f3170008040 comp rx=0 tx=0).stop 2023-11-04T01:40:48.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.453+0000 7f3182e56640 1 -- 172.21.15.77:0/1542151299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f317c06b730 msgr2=0x7f317c150b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.453+0000 7f3182e56640 1 --2- 172.21.15.77:0/1542151299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f317c06b730 0x7f317c150b50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3168000c00 tx=0x7f31680046c0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.453+0000 7f3182e56640 1 -- 172.21.15.77:0/1542151299 shutdown_connections 2023-11-04T01:40:48.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.453+0000 7f3182e56640 1 --2- 172.21.15.77:0/1542151299 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f316006ae70 0x7f316006d330 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.453+0000 7f3182e56640 1 --2- 172.21.15.77:0/1542151299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f317c15d050 0x7f317c0b2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.453+0000 7f3182e56640 1 --2- 172.21.15.77:0/1542151299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f317c06b730 0x7f317c150b50 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.453+0000 7f3182e56640 1 --2- 172.21.15.77:0/1542151299 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f317c06a120 0x7f317c0c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.453+0000 7f3182e56640 1 -- 172.21.15.77:0/1542151299 >> 172.21.15.77:0/1542151299 conn(0x7f317c06cd70 msgr2=0x7f317c15b060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:48.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.453+0000 7f3182e56640 1 -- 172.21.15.77:0/1542151299 shutdown_connections 2023-11-04T01:40:48.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.453+0000 7f3182e56640 1 -- 172.21.15.77:0/1542151299 wait complete. 2023-11-04T01:40:48.465 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:40:48.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.566+0000 7f77aae7c640 1 Processor -- start 2023-11-04T01:40:48.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.566+0000 7f77aae7c640 1 -- start start 2023-11-04T01:40:48.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.567+0000 7f77aae7c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f77a40c4ff0 0x7f77a40cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.567+0000 7f77aae7c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77a415aff0 con 0x7f77a40adac0 2023-11-04T01:40:48.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.567+0000 7f77aae7c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77a415a3e0 con 0x7f77a4159c00 2023-11-04T01:40:48.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.567+0000 7f77aae7c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a415a6c0 con 0x7f77a40c4ff0 2023-11-04T01:40:48.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.567+0000 7f77a9419640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f77a40adac0 0x7f77a40adf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36510/0 (socket says 172.21.15.77:36510) 2023-11-04T01:40:48.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.567+0000 7f77a9419640 1 -- 172.21.15.77:0/1776114036 learned_addr learned my addr 172.21.15.77:0/1776114036 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:48.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.567+0000 7f77a3fff640 1 --2- 172.21.15.77:0/1776114036 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f77a40c4ff0 0x7f77a40cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.567+0000 7f77a37fe640 1 -- 172.21.15.77:0/1776114036 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 501864494 0 0) 0x7f77a415aff0 con 0x7f77a40adac0 2023-11-04T01:40:48.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.567+0000 7f77a37fe640 1 -- 172.21.15.77:0/1776114036 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7794003520 con 0x7f77a40adac0 2023-11-04T01:40:48.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.567+0000 7f77a37fe640 1 -- 172.21.15.77:0/1776114036 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1807815785 0 0) 0x7f7794003520 con 0x7f77a40adac0 2023-11-04T01:40:48.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.567+0000 7f77a37fe640 1 -- 172.21.15.77:0/1776114036 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f77a40c4ff0 msgr2=0x7f77a40cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:48.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.567+0000 7f77a37fe640 1 --2- 172.21.15.77:0/1776114036 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f77a40c4ff0 0x7f77a40cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.567+0000 7f77a37fe640 1 -- 172.21.15.77:0/1776114036 >> v1:172.21.15.122:6789/0 conn(0x7f77a4159c00 legacy=0x7f77a40c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.567+0000 7f77a37fe640 1 -- 172.21.15.77:0/1776114036 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a415a9a0 con 0x7f77a40adac0 2023-11-04T01:40:48.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.567+0000 7f77a37fe640 1 -- 172.21.15.77:0/1776114036 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f779c0019f0 con 0x7f77a40adac0 2023-11-04T01:40:48.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.567+0000 7f77a37fe640 1 -- 172.21.15.77:0/1776114036 >> v1:172.21.15.77:6789/0 conn(0x7f77a40adac0 legacy=0x7f77a40adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.567+0000 7f77a37fe640 1 --2- 172.21.15.77:0/1776114036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77940039a0 0x7f7794003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.567+0000 7f77a37fe640 1 --2- 172.21.15.77:0/1776114036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77940047c0 0x7f7794004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.567+0000 7f77a37fe640 1 --2- 172.21.15.77:0/1776114036 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f77a40c4ff0 0x7f7794005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.567+0000 7f77a37fe640 1 -- 172.21.15.77:0/1776114036 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a415a6c0 con 0x7f77940047c0 2023-11-04T01:40:48.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.567+0000 7f77a37fe640 1 -- 172.21.15.77:0/1776114036 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779400ba60 con 0x7f77940039a0 2023-11-04T01:40:48.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.567+0000 7f77a37fe640 1 -- 172.21.15.77:0/1776114036 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f779400bc20 con 0x7f77a40c4ff0 2023-11-04T01:40:48.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.568+0000 7f77a3fff640 1 --2- 172.21.15.77:0/1776114036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77940047c0 0x7f7794004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.568+0000 7f77a8c18640 1 --2- 172.21.15.77:0/1776114036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77940039a0 0x7f7794003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.568+0000 7f77a9419640 1 --2- 172.21.15.77:0/1776114036 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f77a40c4ff0 0x7f7794005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.568+0000 7f77a3fff640 1 -- 172.21.15.77:0/1776114036 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f77a40c4ff0 msgr2=0x7f7794005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:48.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.568+0000 7f77a3fff640 1 --2- 172.21.15.77:0/1776114036 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f77a40c4ff0 0x7f7794005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.568+0000 7f77a3fff640 1 -- 172.21.15.77:0/1776114036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77940039a0 msgr2=0x7f7794003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:48.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.568+0000 7f77a3fff640 1 --2- 172.21.15.77:0/1776114036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77940039a0 0x7f7794003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.568+0000 7f77a3fff640 1 -- 172.21.15.77:0/1776114036 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7794003520 con 0x7f77940047c0 2023-11-04T01:40:48.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.568+0000 7f77a3fff640 1 --2- 172.21.15.77:0/1776114036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77940047c0 0x7f7794004c40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7790009a90 tx=0x7f77940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a95e04b8152920 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:48.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.569+0000 7f77a37fe640 1 -- 172.21.15.77:0/1776114036 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779002c680 con 0x7f77940047c0 2023-11-04T01:40:48.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.569+0000 7f77a37fe640 1 -- 172.21.15.77:0/1776114036 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779002c7e0 con 0x7f77940047c0 2023-11-04T01:40:48.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.569+0000 7f77a37fe640 1 -- 172.21.15.77:0/1776114036 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779002cb90 con 0x7f77940047c0 2023-11-04T01:40:48.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.569+0000 7f77aae7c640 1 -- 172.21.15.77:0/1776114036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77940047c0 msgr2=0x7f7794004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.569+0000 7f77aae7c640 1 --2- 172.21.15.77:0/1776114036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77940047c0 0x7f7794004c40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7790009a90 tx=0x7f77940057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.569+0000 7f77a9419640 1 -- 172.21.15.77:0/1776114036 reap_dead start 2023-11-04T01:40:48.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.569+0000 7f77aae7c640 1 -- 172.21.15.77:0/1776114036 shutdown_connections 2023-11-04T01:40:48.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.569+0000 7f77aae7c640 1 -- 172.21.15.77:0/1776114036 >> 172.21.15.77:0/1776114036 conn(0x7f77a40ce950 msgr2=0x7f77a40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:48.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.569+0000 7f77aae7c640 1 -- 172.21.15.77:0/1776114036 shutdown_connections 2023-11-04T01:40:48.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.569+0000 7f77aae7c640 1 -- 172.21.15.77:0/1776114036 wait complete. 2023-11-04T01:40:48.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.570+0000 7f77aae7c640 1 Processor -- start 2023-11-04T01:40:48.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.570+0000 7f77aae7c640 1 -- start start 2023-11-04T01:40:48.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.571+0000 7f77aae7c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77940047c0 0x7f77a4155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.571+0000 7f77aae7c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f77a406c7f0 0x7f77a41461c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.571+0000 7f77aae7c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77a415b280 0x7f77a414ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.571+0000 7f77aae7c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a406cc80 con 0x7f77940047c0 2023-11-04T01:40:48.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.571+0000 7f77aae7c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a415d230 con 0x7f77a415b280 2023-11-04T01:40:48.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.571+0000 7f77aae7c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a415c9d0 con 0x7f77a406c7f0 2023-11-04T01:40:48.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.571+0000 7f77a8c18640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77940047c0 0x7f77a4155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.571+0000 7f77a8c18640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77940047c0 0x7f77a4155790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49002/0 (socket says 172.21.15.77:49002) 2023-11-04T01:40:48.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.571+0000 7f77a8c18640 1 -- 172.21.15.77:0/1870131043 learned_addr learned my addr 172.21.15.77:0/1870131043 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:48.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.571+0000 7f77a9419640 1 --2- 172.21.15.77:0/1870131043 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77a415b280 0x7f77a414ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.571+0000 7f77a3fff640 1 --2- 172.21.15.77:0/1870131043 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f77a406c7f0 0x7f77a41461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.572+0000 7f77a8c18640 1 -- 172.21.15.77:0/1870131043 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f77a406c7f0 msgr2=0x7f77a41461c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.572+0000 7f77a8c18640 1 --2- 172.21.15.77:0/1870131043 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f77a406c7f0 0x7f77a41461c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.572+0000 7f77a8c18640 1 -- 172.21.15.77:0/1870131043 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77a415b280 msgr2=0x7f77a414ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.572+0000 7f77a8c18640 1 --2- 172.21.15.77:0/1870131043 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77a415b280 0x7f77a414ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.572+0000 7f77a8c18640 1 -- 172.21.15.77:0/1870131043 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a414fa30 con 0x7f77940047c0 2023-11-04T01:40:48.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.572+0000 7f77a3fff640 1 --2- 172.21.15.77:0/1870131043 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f77a406c7f0 0x7f77a41461c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:48.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.572+0000 7f77a8c18640 1 --2- 172.21.15.77:0/1870131043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77940047c0 0x7f77a4155790 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f779800f620 tx=0x7f779800fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:48.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.572+0000 7f77a17fa640 1 -- 172.21.15.77:0/1870131043 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77980052e0 con 0x7f77940047c0 2023-11-04T01:40:48.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.572+0000 7f77a17fa640 1 -- 172.21.15.77:0/1870131043 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7798005440 con 0x7f77940047c0 2023-11-04T01:40:48.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.572+0000 7f77aae7c640 1 -- 172.21.15.77:0/1870131043 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a415cc70 con 0x7f77940047c0 2023-11-04T01:40:48.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.572+0000 7f77a17fa640 1 -- 172.21.15.77:0/1870131043 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7798003810 con 0x7f77940047c0 2023-11-04T01:40:48.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.572+0000 7f77aae7c640 1 -- 172.21.15.77:0/1870131043 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a4155cd0 con 0x7f77940047c0 2023-11-04T01:40:48.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.573+0000 7f77aae7c640 1 -- 172.21.15.77:0/1870131043 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a414f890 con 0x7f77940047c0 2023-11-04T01:40:48.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.573+0000 7f77a17fa640 1 -- 172.21.15.77:0/1870131043 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7798003970 con 0x7f77940047c0 2023-11-04T01:40:48.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.574+0000 7f77a17fa640 1 --2- 172.21.15.77:0/1870131043 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f778806ae70 0x7f778806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.574+0000 7f77a17fa640 1 -- 172.21.15.77:0/1870131043 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7798089860 con 0x7f77940047c0 2023-11-04T01:40:48.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.574+0000 7f77a3fff640 1 --2- 172.21.15.77:0/1870131043 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f778806ae70 0x7f778806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.574+0000 7f77a3fff640 1 --2- 172.21.15.77:0/1870131043 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f778806ae70 0x7f778806d330 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7790036000 tx=0x7f7790030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:48.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.578+0000 7f77a17fa640 1 -- 172.21.15.77:0/1870131043 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f77a414f890 con 0x7f77940047c0 2023-11-04T01:40:48.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.743+0000 7f77aae7c640 1 -- 172.21.15.77:0/1870131043 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f77a414f890 con 0x7f77940047c0 2023-11-04T01:40:48.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.743+0000 7f77a17fa640 1 -- 172.21.15.77:0/1870131043 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f77a414f890 con 0x7f77940047c0 2023-11-04T01:40:48.746 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-04T01:40:48.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.745+0000 7f77aae7c640 1 -- 172.21.15.77:0/1870131043 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f778806ae70 msgr2=0x7f778806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.745+0000 7f77aae7c640 1 --2- 172.21.15.77:0/1870131043 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f778806ae70 0x7f778806d330 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7790036000 tx=0x7f7790030000 comp rx=0 tx=0).stop 2023-11-04T01:40:48.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.745+0000 7f77aae7c640 1 -- 172.21.15.77:0/1870131043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77940047c0 msgr2=0x7f77a4155790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.745+0000 7f77aae7c640 1 --2- 172.21.15.77:0/1870131043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77940047c0 0x7f77a4155790 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f779800f620 tx=0x7f779800fae0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.745+0000 7f77aae7c640 1 -- 172.21.15.77:0/1870131043 shutdown_connections 2023-11-04T01:40:48.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.745+0000 7f77aae7c640 1 --2- 172.21.15.77:0/1870131043 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f778806ae70 0x7f778806d330 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.745+0000 7f77aae7c640 1 --2- 172.21.15.77:0/1870131043 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77a415b280 0x7f77a414ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.745+0000 7f77aae7c640 1 --2- 172.21.15.77:0/1870131043 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f77a406c7f0 0x7f77a41461c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.745+0000 7f77aae7c640 1 --2- 172.21.15.77:0/1870131043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77940047c0 0x7f77a4155790 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.745+0000 7f77aae7c640 1 -- 172.21.15.77:0/1870131043 >> 172.21.15.77:0/1870131043 conn(0x7f77a40ce950 msgr2=0x7f77a40c3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:48.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.746+0000 7f77aae7c640 1 -- 172.21.15.77:0/1870131043 shutdown_connections 2023-11-04T01:40:48.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.746+0000 7f77aae7c640 1 -- 172.21.15.77:0/1870131043 wait complete. 2023-11-04T01:40:48.758 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:40:48.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.860+0000 7f12b670c640 1 Processor -- start 2023-11-04T01:40:48.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.860+0000 7f12b670c640 1 -- start start 2023-11-04T01:40:48.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.861+0000 7f12b670c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f12b015ad30 0x7f12b00adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.861+0000 7f12b670c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f12b00ad730 0x7f12b0070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.861+0000 7f12b670c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12b00c3900 con 0x7f12b0070c50 2023-11-04T01:40:48.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.861+0000 7f12b670c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12b00ae260 con 0x7f12b015ad30 2023-11-04T01:40:48.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.861+0000 7f12b670c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b015f750 con 0x7f12b00ad730 2023-11-04T01:40:48.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.861+0000 7f12af7fe640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f12b00ad730 0x7f12b0070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.861+0000 7f12affff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f12b015ad30 0x7f12b00adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.861+0000 7f12b4ca9640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f12b0070c50 0x7f12b00c8fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:43614/0 (socket says 172.21.15.77:43614) 2023-11-04T01:40:48.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.861+0000 7f12b4ca9640 1 -- 172.21.15.77:0/817381145 learned_addr learned my addr 172.21.15.77:0/817381145 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:48.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.862+0000 7f12af7fe640 1 -- 172.21.15.77:0/817381145 >> v2:172.21.15.122:3300/0 conn(0x7f12b015ad30 msgr2=0x7f12b00adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:48.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.862+0000 7f12af7fe640 1 --2- 172.21.15.77:0/817381145 >> v2:172.21.15.122:3300/0 conn(0x7f12b015ad30 0x7f12b00adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.862+0000 7f12af7fe640 1 -- 172.21.15.77:0/817381145 >> v1:172.21.15.122:6789/0 conn(0x7f12b0070c50 legacy=0x7f12b00c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.862+0000 7f12af7fe640 1 -- 172.21.15.77:0/817381145 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b00c3be0 con 0x7f12b00ad730 2023-11-04T01:40:48.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.862+0000 7f12affff640 1 --2- 172.21.15.77:0/817381145 >> v2:172.21.15.122:3300/0 conn(0x7f12b015ad30 0x7f12b00adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:48.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.862+0000 7f12af7fe640 1 --2- 172.21.15.77:0/817381145 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f12b00ad730 0x7f12b0070710 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f12a40097d0 tx=0x7f12a402b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bafba2e0d1190507 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:48.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.863+0000 7f12aeffd640 1 -- 172.21.15.77:0/817381145 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a4031770 con 0x7f12b00ad730 2023-11-04T01:40:48.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.863+0000 7f12aeffd640 1 -- 172.21.15.77:0/817381145 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a40318d0 con 0x7f12b00ad730 2023-11-04T01:40:48.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.863+0000 7f12aeffd640 1 -- 172.21.15.77:0/817381145 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a4031c60 con 0x7f12b00ad730 2023-11-04T01:40:48.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.863+0000 7f12b670c640 1 -- 172.21.15.77:0/817381145 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f12b00ad730 msgr2=0x7f12b0070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.863+0000 7f12b670c640 1 --2- 172.21.15.77:0/817381145 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f12b00ad730 0x7f12b0070710 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f12a40097d0 tx=0x7f12a402b810 comp rx=0 tx=0).stop 2023-11-04T01:40:48.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.863+0000 7f12b670c640 1 -- 172.21.15.77:0/817381145 shutdown_connections 2023-11-04T01:40:48.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.863+0000 7f12b670c640 1 --2- 172.21.15.77:0/817381145 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f12b00ad730 0x7f12b0070710 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.863+0000 7f12b670c640 1 --2- 172.21.15.77:0/817381145 >> v2:172.21.15.122:3300/0 conn(0x7f12b015ad30 0x7f12b00adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.863+0000 7f12b670c640 1 -- 172.21.15.77:0/817381145 >> 172.21.15.77:0/817381145 conn(0x7f12b00ce950 msgr2=0x7f12b00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:48.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.863+0000 7f12b670c640 1 -- 172.21.15.77:0/817381145 shutdown_connections 2023-11-04T01:40:48.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.863+0000 7f12b670c640 1 -- 172.21.15.77:0/817381145 wait complete. 2023-11-04T01:40:48.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.864+0000 7f12b670c640 1 Processor -- start 2023-11-04T01:40:48.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.864+0000 7f12b670c640 1 -- start start 2023-11-04T01:40:48.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.865+0000 7f12b670c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f12b0070c50 0x7f12b00b12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.865+0000 7f12b670c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12b00ad730 0x7f12b0149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.865+0000 7f12b670c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12b015ad30 0x7f12b0157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.865+0000 7f12b670c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b015be70 con 0x7f12b015ad30 2023-11-04T01:40:48.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.865+0000 7f12b670c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b015c150 con 0x7f12b00ad730 2023-11-04T01:40:48.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.865+0000 7f12b670c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b015c430 con 0x7f12b0070c50 2023-11-04T01:40:48.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.865+0000 7f12b4ca9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12b015ad30 0x7f12b0157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.865+0000 7f12b4ca9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12b015ad30 0x7f12b0157540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49006/0 (socket says 172.21.15.77:49006) 2023-11-04T01:40:48.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.865+0000 7f12b4ca9640 1 -- 172.21.15.77:0/4107405063 learned_addr learned my addr 172.21.15.77:0/4107405063 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:48.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.866+0000 7f12af7fe640 1 --2- 172.21.15.77:0/4107405063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12b00ad730 0x7f12b0149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.866+0000 7f12affff640 1 --2- 172.21.15.77:0/4107405063 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f12b0070c50 0x7f12b00b12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.866+0000 7f12b4ca9640 1 -- 172.21.15.77:0/4107405063 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f12b0070c50 msgr2=0x7f12b00b12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.866+0000 7f12b4ca9640 1 --2- 172.21.15.77:0/4107405063 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f12b0070c50 0x7f12b00b12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.866+0000 7f12b4ca9640 1 -- 172.21.15.77:0/4107405063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12b00ad730 msgr2=0x7f12b0149180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:48.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.866+0000 7f12b4ca9640 1 --2- 172.21.15.77:0/4107405063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12b00ad730 0x7f12b0149180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:48.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.866+0000 7f12b4ca9640 1 -- 172.21.15.77:0/4107405063 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a0009400 con 0x7f12b015ad30 2023-11-04T01:40:48.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.866+0000 7f12b4ca9640 1 --2- 172.21.15.77:0/4107405063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12b015ad30 0x7f12b0157540 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f12a800cbc0 tx=0x7f12a800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:48.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.866+0000 7f12acff9640 1 -- 172.21.15.77:0/4107405063 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a800ad40 con 0x7f12b015ad30 2023-11-04T01:40:48.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.866+0000 7f12acff9640 1 -- 172.21.15.77:0/4107405063 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a8012400 con 0x7f12b015ad30 2023-11-04T01:40:48.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.866+0000 7f12acff9640 1 -- 172.21.15.77:0/4107405063 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a800aea0 con 0x7f12b015ad30 2023-11-04T01:40:48.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.866+0000 7f12b670c640 1 -- 172.21.15.77:0/4107405063 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a4009400 con 0x7f12b015ad30 2023-11-04T01:40:48.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.866+0000 7f12b670c640 1 -- 172.21.15.77:0/4107405063 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b015c9f0 con 0x7f12b015ad30 2023-11-04T01:40:48.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.867+0000 7f12b670c640 1 -- 172.21.15.77:0/4107405063 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12b015cbe0 con 0x7f12b015ad30 2023-11-04T01:40:48.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.867+0000 7f12acff9640 1 -- 172.21.15.77:0/4107405063 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f12a8007070 con 0x7f12b015ad30 2023-11-04T01:40:48.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.868+0000 7f12acff9640 1 --2- 172.21.15.77:0/4107405063 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f129c06aea0 0x7f129c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:48.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.868+0000 7f12acff9640 1 -- 172.21.15.77:0/4107405063 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f12a80897f0 con 0x7f12b015ad30 2023-11-04T01:40:48.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.868+0000 7f12affff640 1 --2- 172.21.15.77:0/4107405063 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f129c06aea0 0x7f129c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:48.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.869+0000 7f12affff640 1 --2- 172.21.15.77:0/4107405063 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f129c06aea0 0x7f129c06d360 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f12a0009ba0 tx=0x7f12a0008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:48.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:48.872+0000 7f12acff9640 1 -- 172.21.15.77:0/4107405063 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f12a8054590 con 0x7f12b015ad30 2023-11-04T01:40:49.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.041+0000 7f12b670c640 1 -- 172.21.15.77:0/4107405063 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f12b0074290 con 0x7f12b015ad30 2023-11-04T01:40:49.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.042+0000 7f12acff9640 1 -- 172.21.15.77:0/4107405063 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f12a80170a0 con 0x7f12b015ad30 2023-11-04T01:40:49.044 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:40:49.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.044+0000 7f12b670c640 1 -- 172.21.15.77:0/4107405063 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f129c06aea0 msgr2=0x7f129c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.044+0000 7f12b670c640 1 --2- 172.21.15.77:0/4107405063 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f129c06aea0 0x7f129c06d360 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f12a0009ba0 tx=0x7f12a0008040 comp rx=0 tx=0).stop 2023-11-04T01:40:49.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.044+0000 7f12b670c640 1 -- 172.21.15.77:0/4107405063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12b015ad30 msgr2=0x7f12b0157540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.044+0000 7f12b670c640 1 --2- 172.21.15.77:0/4107405063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12b015ad30 0x7f12b0157540 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f12a800cbc0 tx=0x7f12a800a430 comp rx=0 tx=0).stop 2023-11-04T01:40:49.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.044+0000 7f12b670c640 1 -- 172.21.15.77:0/4107405063 shutdown_connections 2023-11-04T01:40:49.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.044+0000 7f12b670c640 1 --2- 172.21.15.77:0/4107405063 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f129c06aea0 0x7f129c06d360 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.044+0000 7f12b670c640 1 --2- 172.21.15.77:0/4107405063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12b015ad30 0x7f12b0157540 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.044+0000 7f12b670c640 1 --2- 172.21.15.77:0/4107405063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12b00ad730 0x7f12b0149180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.044+0000 7f12b670c640 1 --2- 172.21.15.77:0/4107405063 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f12b0070c50 0x7f12b00b12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.044+0000 7f12b670c640 1 -- 172.21.15.77:0/4107405063 >> 172.21.15.77:0/4107405063 conn(0x7f12b00ce950 msgr2=0x7f12b00af5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:49.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.044+0000 7f12b670c640 1 -- 172.21.15.77:0/4107405063 shutdown_connections 2023-11-04T01:40:49.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.044+0000 7f12b670c640 1 -- 172.21.15.77:0/4107405063 wait complete. 2023-11-04T01:40:49.056 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:49.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.154+0000 7f15a3578640 1 Processor -- start 2023-11-04T01:40:49.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.154+0000 7f15a3578640 1 -- start start 2023-11-04T01:40:49.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.155+0000 7f15a3578640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f159c15aa30 0x7f159c0c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.155+0000 7f15a3578640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f159c0ca280 0x7f159c06c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.155+0000 7f15a3578640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f159c15bc30 con 0x7f159c06cc30 2023-11-04T01:40:49.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.155+0000 7f15a3578640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f159c06d080 con 0x7f159c15aa30 2023-11-04T01:40:49.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.155+0000 7f15a3578640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159c15bf10 con 0x7f159c0ca280 2023-11-04T01:40:49.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.155+0000 7f15a1b15640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f159c06cc30 0x7f159c0b07f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36522/0 (socket says 172.21.15.77:36522) 2023-11-04T01:40:49.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.155+0000 7f15a1b15640 1 -- 172.21.15.77:0/3577232103 learned_addr learned my addr 172.21.15.77:0/3577232103 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:49.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.156+0000 7f1593fff640 1 -- 172.21.15.77:0/3577232103 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 293862036 0 0) 0x7f159c15bc30 con 0x7f159c06cc30 2023-11-04T01:40:49.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.156+0000 7f15a1314640 1 --2- 172.21.15.77:0/3577232103 >> v2:172.21.15.122:3300/0 conn(0x7f159c15aa30 0x7f159c0c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.156+0000 7f1593fff640 1 -- 172.21.15.77:0/3577232103 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1588003520 con 0x7f159c06cc30 2023-11-04T01:40:49.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.156+0000 7f15a0b13640 1 --2- 172.21.15.77:0/3577232103 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f159c0ca280 0x7f159c06c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.156+0000 7f1593fff640 1 -- 172.21.15.77:0/3577232103 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1176111637 0 0) 0x7f1588003520 con 0x7f159c06cc30 2023-11-04T01:40:49.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.156+0000 7f1593fff640 1 -- 172.21.15.77:0/3577232103 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f159c0ca280 msgr2=0x7f159c06c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:49.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.156+0000 7f1593fff640 1 --2- 172.21.15.77:0/3577232103 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f159c0ca280 0x7f159c06c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.156+0000 7f1593fff640 1 -- 172.21.15.77:0/3577232103 >> v2:172.21.15.122:3300/0 conn(0x7f159c15aa30 msgr2=0x7f159c0c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:49.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.156+0000 7f1593fff640 1 --2- 172.21.15.77:0/3577232103 >> v2:172.21.15.122:3300/0 conn(0x7f159c15aa30 0x7f159c0c9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.156+0000 7f1593fff640 1 -- 172.21.15.77:0/3577232103 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159c0c9540 con 0x7f159c06cc30 2023-11-04T01:40:49.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.156+0000 7f1593fff640 1 -- 172.21.15.77:0/3577232103 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f1594001670 con 0x7f159c06cc30 2023-11-04T01:40:49.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.156+0000 7f1593fff640 1 -- 172.21.15.77:0/3577232103 >> v1:172.21.15.77:6789/0 conn(0x7f159c06cc30 legacy=0x7f159c0b07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.156+0000 7f1593fff640 1 --2- 172.21.15.77:0/3577232103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1588003970 0x7f1588003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.156+0000 7f1593fff640 1 --2- 172.21.15.77:0/3577232103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15880047c0 0x7f1588004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.156+0000 7f1593fff640 1 --2- 172.21.15.77:0/3577232103 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1588005180 0x7f158800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.156+0000 7f1593fff640 1 -- 172.21.15.77:0/3577232103 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159c06d080 con 0x7f15880047c0 2023-11-04T01:40:49.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.156+0000 7f1593fff640 1 -- 172.21.15.77:0/3577232103 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159c15bf10 con 0x7f1588003970 2023-11-04T01:40:49.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.156+0000 7f1593fff640 1 -- 172.21.15.77:0/3577232103 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1588004590 con 0x7f1588005180 2023-11-04T01:40:49.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.156+0000 7f15a0b13640 1 --2- 172.21.15.77:0/3577232103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15880047c0 0x7f1588004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.156+0000 7f15a1314640 1 --2- 172.21.15.77:0/3577232103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1588003970 0x7f1588003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.156+0000 7f15a1b15640 1 --2- 172.21.15.77:0/3577232103 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1588005180 0x7f158800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.156+0000 7f15a0b13640 1 -- 172.21.15.77:0/3577232103 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1588005180 msgr2=0x7f158800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:49.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.156+0000 7f15a0b13640 1 --2- 172.21.15.77:0/3577232103 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1588005180 0x7f158800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.156+0000 7f15a0b13640 1 -- 172.21.15.77:0/3577232103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1588003970 msgr2=0x7f1588003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:49.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.156+0000 7f15a0b13640 1 --2- 172.21.15.77:0/3577232103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1588003970 0x7f1588003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.156+0000 7f15a0b13640 1 -- 172.21.15.77:0/3577232103 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1588003520 con 0x7f15880047c0 2023-11-04T01:40:49.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.157+0000 7f15a0b13640 1 --2- 172.21.15.77:0/3577232103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15880047c0 0x7f1588004c40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f158c009ac0 tx=0x7f15880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d02b8c0c75590cb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:49.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.157+0000 7f1593fff640 1 -- 172.21.15.77:0/3577232103 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c02c6b0 con 0x7f15880047c0 2023-11-04T01:40:49.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.157+0000 7f1593fff640 1 -- 172.21.15.77:0/3577232103 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158c02c810 con 0x7f15880047c0 2023-11-04T01:40:49.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.157+0000 7f1593fff640 1 -- 172.21.15.77:0/3577232103 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c02cba0 con 0x7f15880047c0 2023-11-04T01:40:49.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.158+0000 7f15a3578640 1 -- 172.21.15.77:0/3577232103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15880047c0 msgr2=0x7f1588004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.158+0000 7f15a3578640 1 --2- 172.21.15.77:0/3577232103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15880047c0 0x7f1588004c40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f158c009ac0 tx=0x7f15880057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.158+0000 7f15a1b15640 1 -- 172.21.15.77:0/3577232103 reap_dead start 2023-11-04T01:40:49.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.158+0000 7f15a3578640 1 -- 172.21.15.77:0/3577232103 shutdown_connections 2023-11-04T01:40:49.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.158+0000 7f15a3578640 1 -- 172.21.15.77:0/3577232103 >> 172.21.15.77:0/3577232103 conn(0x7f159c0cb7f0 msgr2=0x7f159c0cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:49.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.158+0000 7f15a3578640 1 -- 172.21.15.77:0/3577232103 shutdown_connections 2023-11-04T01:40:49.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.158+0000 7f15a3578640 1 -- 172.21.15.77:0/3577232103 wait complete. 2023-11-04T01:40:49.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.159+0000 7f15a3578640 1 Processor -- start 2023-11-04T01:40:49.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.159+0000 7f15a3578640 1 -- start start 2023-11-04T01:40:49.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.160+0000 7f15a3578640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15880047c0 0x7f159c156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.160+0000 7f15a3578640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f159c0c8810 0x7f159c15ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.160+0000 7f15a3578640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f159c1f2eb0 0x7f159c15f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.160+0000 7f15a3578640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159c154110 con 0x7f159c1f2eb0 2023-11-04T01:40:49.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.160+0000 7f15a3578640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159c0c6e90 con 0x7f15880047c0 2023-11-04T01:40:49.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.160+0000 7f15a3578640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159c157320 con 0x7f159c0c8810 2023-11-04T01:40:49.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.160+0000 7f15a1b15640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f159c1f2eb0 0x7f159c15f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.160+0000 7f15a1b15640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f159c1f2eb0 0x7f159c15f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49022/0 (socket says 172.21.15.77:49022) 2023-11-04T01:40:49.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.160+0000 7f15a1b15640 1 -- 172.21.15.77:0/2668292769 learned_addr learned my addr 172.21.15.77:0/2668292769 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:49.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.160+0000 7f15a1314640 1 --2- 172.21.15.77:0/2668292769 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15880047c0 0x7f159c156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.160+0000 7f15a0b13640 1 --2- 172.21.15.77:0/2668292769 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f159c0c8810 0x7f159c15ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.160+0000 7f15a1b15640 1 -- 172.21.15.77:0/2668292769 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f159c0c8810 msgr2=0x7f159c15ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.160+0000 7f15a1b15640 1 --2- 172.21.15.77:0/2668292769 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f159c0c8810 0x7f159c15ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.160+0000 7f15a1b15640 1 -- 172.21.15.77:0/2668292769 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15880047c0 msgr2=0x7f159c156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.160+0000 7f15a1b15640 1 --2- 172.21.15.77:0/2668292769 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15880047c0 0x7f159c156c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.160+0000 7f15a1b15640 1 -- 172.21.15.77:0/2668292769 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159c157600 con 0x7f159c1f2eb0 2023-11-04T01:40:49.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.160+0000 7f15a0b13640 1 --2- 172.21.15.77:0/2668292769 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f159c0c8810 0x7f159c15ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:49.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.160+0000 7f15a1b15640 1 --2- 172.21.15.77:0/2668292769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f159c1f2eb0 0x7f159c15f1c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1594001cf0 tx=0x7f159400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:49.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.160+0000 7f1591ffb640 1 -- 172.21.15.77:0/2668292769 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159400eed0 con 0x7f159c1f2eb0 2023-11-04T01:40:49.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.160+0000 7f1591ffb640 1 -- 172.21.15.77:0/2668292769 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159400c610 con 0x7f159c1f2eb0 2023-11-04T01:40:49.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.160+0000 7f15a3578640 1 -- 172.21.15.77:0/2668292769 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f159c1578e0 con 0x7f159c1f2eb0 2023-11-04T01:40:49.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.160+0000 7f1591ffb640 1 -- 172.21.15.77:0/2668292769 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159400c9c0 con 0x7f159c1f2eb0 2023-11-04T01:40:49.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.161+0000 7f15a3578640 1 -- 172.21.15.77:0/2668292769 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f159c1f1340 con 0x7f159c1f2eb0 2023-11-04T01:40:49.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.161+0000 7f15a3578640 1 -- 172.21.15.77:0/2668292769 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f159c0c7390 con 0x7f159c1f2eb0 2023-11-04T01:40:49.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.162+0000 7f1591ffb640 1 -- 172.21.15.77:0/2668292769 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f159400cb20 con 0x7f159c1f2eb0 2023-11-04T01:40:49.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.162+0000 7f1591ffb640 1 --2- 172.21.15.77:0/2668292769 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f158006ae70 0x7f158006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.162+0000 7f1591ffb640 1 -- 172.21.15.77:0/2668292769 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f15940895e0 con 0x7f159c1f2eb0 2023-11-04T01:40:49.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.162+0000 7f15a1314640 1 --2- 172.21.15.77:0/2668292769 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f158006ae70 0x7f158006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.163+0000 7f15a1314640 1 --2- 172.21.15.77:0/2668292769 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f158006ae70 0x7f158006d330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f159c1542c0 tx=0x7f159800b040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:49.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.166+0000 7f1591ffb640 1 -- 172.21.15.77:0/2668292769 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f159c0c7390 con 0x7f159c1f2eb0 2023-11-04T01:40:49.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.334+0000 7f15a3578640 1 -- 172.21.15.77:0/2668292769 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f159c0c7390 con 0x7f159c1f2eb0 2023-11-04T01:40:49.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.335+0000 7f1591ffb640 1 -- 172.21.15.77:0/2668292769 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18661 (secure 0 0 0) 0x7f159c0c7390 con 0x7f159c1f2eb0 2023-11-04T01:40:49.337 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:49.338 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":26,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:40:47.579547+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:40:02.810971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:40:04.003979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:40:07.734355+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:49.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.337+0000 7f15a3578640 1 -- 172.21.15.77:0/2668292769 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f158006ae70 msgr2=0x7f158006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.337+0000 7f15a3578640 1 --2- 172.21.15.77:0/2668292769 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f158006ae70 0x7f158006d330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f159c1542c0 tx=0x7f159800b040 comp rx=0 tx=0).stop 2023-11-04T01:40:49.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.337+0000 7f15a3578640 1 -- 172.21.15.77:0/2668292769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f159c1f2eb0 msgr2=0x7f159c15f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.337+0000 7f15a3578640 1 --2- 172.21.15.77:0/2668292769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f159c1f2eb0 0x7f159c15f1c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1594001cf0 tx=0x7f159400eb90 comp rx=0 tx=0).stop 2023-11-04T01:40:49.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.337+0000 7f15a3578640 1 -- 172.21.15.77:0/2668292769 shutdown_connections 2023-11-04T01:40:49.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.337+0000 7f15a3578640 1 --2- 172.21.15.77:0/2668292769 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f158006ae70 0x7f158006d330 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.337+0000 7f15a3578640 1 --2- 172.21.15.77:0/2668292769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f159c1f2eb0 0x7f159c15f1c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.337+0000 7f15a3578640 1 --2- 172.21.15.77:0/2668292769 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f159c0c8810 0x7f159c15ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.337+0000 7f15a3578640 1 --2- 172.21.15.77:0/2668292769 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15880047c0 0x7f159c156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.337+0000 7f15a3578640 1 -- 172.21.15.77:0/2668292769 >> 172.21.15.77:0/2668292769 conn(0x7f159c0cb7f0 msgr2=0x7f159c15d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:49.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.337+0000 7f15a3578640 1 -- 172.21.15.77:0/2668292769 shutdown_connections 2023-11-04T01:40:49.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.337+0000 7f15a3578640 1 -- 172.21.15.77:0/2668292769 wait complete. 2023-11-04T01:40:49.350 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:40:02.810971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:40:04.003979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:40:07.734355+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:40:49.351 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:40:49.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.452+0000 7fd257d01640 1 Processor -- start 2023-11-04T01:40:49.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.452+0000 7fd257d01640 1 -- start start 2023-11-04T01:40:49.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.453+0000 7fd257d01640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd250070ff0 0x7fd2500cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.453+0000 7fd257d01640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd25015d1b0 0x7fd2500713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.453+0000 7fd257d01640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2500c9bf0 con 0x7fd250066000 2023-11-04T01:40:49.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.453+0000 7fd257d01640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2500cd890 con 0x7fd250070ff0 2023-11-04T01:40:49.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.453+0000 7fd257d01640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd250071910 con 0x7fd25015d1b0 2023-11-04T01:40:49.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.453+0000 7fd255a9d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd250070ff0 0x7fd2500cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.453+0000 7fd25529c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd25015d1b0 0x7fd2500713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.453+0000 7fd25629e640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fd250066000 0x7fd250160af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:43620/0 (socket says 172.21.15.77:43620) 2023-11-04T01:40:49.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.453+0000 7fd255a9d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd250070ff0 0x7fd2500cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:45140/0 (socket says 172.21.15.77:45140) 2023-11-04T01:40:49.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.453+0000 7fd25629e640 1 -- 172.21.15.77:0/579864374 learned_addr learned my addr 172.21.15.77:0/579864374 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:49.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.454+0000 7fd254a9b640 1 -- 172.21.15.77:0/579864374 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3678631863 0 0) 0x7fd2500c9bf0 con 0x7fd250066000 2023-11-04T01:40:49.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.454+0000 7fd254a9b640 1 -- 172.21.15.77:0/579864374 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd23c003520 con 0x7fd250066000 2023-11-04T01:40:49.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.454+0000 7fd25529c640 1 -- 172.21.15.77:0/579864374 >> v2:172.21.15.122:3300/0 conn(0x7fd250070ff0 msgr2=0x7fd2500cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:49.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.454+0000 7fd25529c640 1 --2- 172.21.15.77:0/579864374 >> v2:172.21.15.122:3300/0 conn(0x7fd250070ff0 0x7fd2500cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.454+0000 7fd25529c640 1 -- 172.21.15.77:0/579864374 >> v1:172.21.15.122:6789/0 conn(0x7fd250066000 legacy=0x7fd250160af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.454+0000 7fd25529c640 1 -- 172.21.15.77:0/579864374 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2500cdb30 con 0x7fd25015d1b0 2023-11-04T01:40:49.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.454+0000 7fd255a9d640 1 --2- 172.21.15.77:0/579864374 >> v2:172.21.15.122:3300/0 conn(0x7fd250070ff0 0x7fd2500cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:40:49.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.454+0000 7fd25529c640 1 --2- 172.21.15.77:0/579864374 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd25015d1b0 0x7fd2500713d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd2400097a0 tx=0x7fd24002b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=751e420cd68d7f23 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:49.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.455+0000 7fd254a9b640 1 -- 172.21.15.77:0/579864374 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24002d040 con 0x7fd25015d1b0 2023-11-04T01:40:49.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.455+0000 7fd254a9b640 1 -- 172.21.15.77:0/579864374 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd240031810 con 0x7fd25015d1b0 2023-11-04T01:40:49.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.455+0000 7fd254a9b640 1 -- 172.21.15.77:0/579864374 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd240031ba0 con 0x7fd25015d1b0 2023-11-04T01:40:49.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.455+0000 7fd257d01640 1 -- 172.21.15.77:0/579864374 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd25015d1b0 msgr2=0x7fd2500713d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.455+0000 7fd257d01640 1 --2- 172.21.15.77:0/579864374 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd25015d1b0 0x7fd2500713d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd2400097a0 tx=0x7fd24002b8b0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.455+0000 7fd257d01640 1 -- 172.21.15.77:0/579864374 shutdown_connections 2023-11-04T01:40:49.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.455+0000 7fd257d01640 1 --2- 172.21.15.77:0/579864374 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd25015d1b0 0x7fd2500713d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.455+0000 7fd257d01640 1 --2- 172.21.15.77:0/579864374 >> v2:172.21.15.122:3300/0 conn(0x7fd250070ff0 0x7fd2500cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.455+0000 7fd257d01640 1 -- 172.21.15.77:0/579864374 >> 172.21.15.77:0/579864374 conn(0x7fd2500cbc90 msgr2=0x7fd2500cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:49.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.455+0000 7fd257d01640 1 -- 172.21.15.77:0/579864374 shutdown_connections 2023-11-04T01:40:49.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.455+0000 7fd257d01640 1 -- 172.21.15.77:0/579864374 wait complete. 2023-11-04T01:40:49.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.456+0000 7fd257d01640 1 Processor -- start 2023-11-04T01:40:49.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.456+0000 7fd257d01640 1 -- start start 2023-11-04T01:40:49.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.457+0000 7fd257d01640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd250066000 0x7fd2500ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.457+0000 7fd257d01640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd250070ff0 0x7fd250161040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.457+0000 7fd257d01640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd25015d1b0 0x7fd250155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.457+0000 7fd257d01640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2500acd20 con 0x7fd25015d1b0 2023-11-04T01:40:49.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.457+0000 7fd257d01640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2500ac110 con 0x7fd250066000 2023-11-04T01:40:49.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.457+0000 7fd257d01640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2500ac3f0 con 0x7fd250070ff0 2023-11-04T01:40:49.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.457+0000 7fd25629e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd25015d1b0 0x7fd250155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.457+0000 7fd25629e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd25015d1b0 0x7fd250155e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49038/0 (socket says 172.21.15.77:49038) 2023-11-04T01:40:49.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.457+0000 7fd25629e640 1 -- 172.21.15.77:0/1314387375 learned_addr learned my addr 172.21.15.77:0/1314387375 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:49.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.457+0000 7fd255a9d640 1 --2- 172.21.15.77:0/1314387375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd250066000 0x7fd2500ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.457+0000 7fd25529c640 1 --2- 172.21.15.77:0/1314387375 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd250070ff0 0x7fd250161040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.458+0000 7fd25629e640 1 -- 172.21.15.77:0/1314387375 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd250070ff0 msgr2=0x7fd250161040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.458+0000 7fd25629e640 1 --2- 172.21.15.77:0/1314387375 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd250070ff0 0x7fd250161040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.458+0000 7fd25629e640 1 -- 172.21.15.77:0/1314387375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd250066000 msgr2=0x7fd2500ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.458+0000 7fd25629e640 1 --2- 172.21.15.77:0/1314387375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd250066000 0x7fd2500ab8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.458+0000 7fd25629e640 1 -- 172.21.15.77:0/1314387375 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24c009a70 con 0x7fd25015d1b0 2023-11-04T01:40:49.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.458+0000 7fd25629e640 1 --2- 172.21.15.77:0/1314387375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd25015d1b0 0x7fd250155e30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd24800c390 tx=0x7fd24800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:49.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.458+0000 7fd2467fc640 1 -- 172.21.15.77:0/1314387375 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd248005ce0 con 0x7fd25015d1b0 2023-11-04T01:40:49.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.458+0000 7fd2467fc640 1 -- 172.21.15.77:0/1314387375 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd248005e40 con 0x7fd25015d1b0 2023-11-04T01:40:49.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.458+0000 7fd257d01640 1 -- 172.21.15.77:0/1314387375 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd240009400 con 0x7fd25015d1b0 2023-11-04T01:40:49.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.458+0000 7fd2467fc640 1 -- 172.21.15.77:0/1314387375 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd248007310 con 0x7fd25015d1b0 2023-11-04T01:40:49.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.458+0000 7fd257d01640 1 -- 172.21.15.77:0/1314387375 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2500ac9b0 con 0x7fd25015d1b0 2023-11-04T01:40:49.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.459+0000 7fd257d01640 1 -- 172.21.15.77:0/1314387375 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2500b2e80 con 0x7fd25015d1b0 2023-11-04T01:40:49.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.459+0000 7fd2467fc640 1 -- 172.21.15.77:0/1314387375 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd248007470 con 0x7fd25015d1b0 2023-11-04T01:40:49.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.460+0000 7fd2467fc640 1 --2- 172.21.15.77:0/1314387375 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd23406ae70 0x7fd23406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.460+0000 7fd2467fc640 1 -- 172.21.15.77:0/1314387375 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd248088f40 con 0x7fd25015d1b0 2023-11-04T01:40:49.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.460+0000 7fd255a9d640 1 --2- 172.21.15.77:0/1314387375 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd23406ae70 0x7fd23406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.461+0000 7fd255a9d640 1 --2- 172.21.15.77:0/1314387375 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd23406ae70 0x7fd23406d330 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0114e0 tx=0x7fd24c00b040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:49.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.464+0000 7fd2467fc640 1 -- 172.21.15.77:0/1314387375 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd2500b2e80 con 0x7fd25015d1b0 2023-11-04T01:40:49.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.632+0000 7fd257d01640 1 -- 172.21.15.77:0/1314387375 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd2500b2e80 con 0x7fd25015d1b0 2023-11-04T01:40:49.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.632+0000 7fd2467fc640 1 -- 172.21.15.77:0/1314387375 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd2500b2e80 con 0x7fd25015d1b0 2023-11-04T01:40:49.634 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:40:49.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.634+0000 7fd257d01640 1 -- 172.21.15.77:0/1314387375 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd23406ae70 msgr2=0x7fd23406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.634+0000 7fd257d01640 1 --2- 172.21.15.77:0/1314387375 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd23406ae70 0x7fd23406d330 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0114e0 tx=0x7fd24c00b040 comp rx=0 tx=0).stop 2023-11-04T01:40:49.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.634+0000 7fd257d01640 1 -- 172.21.15.77:0/1314387375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd25015d1b0 msgr2=0x7fd250155e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.634+0000 7fd257d01640 1 --2- 172.21.15.77:0/1314387375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd25015d1b0 0x7fd250155e30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd24800c390 tx=0x7fd24800c850 comp rx=0 tx=0).stop 2023-11-04T01:40:49.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.634+0000 7fd257d01640 1 -- 172.21.15.77:0/1314387375 shutdown_connections 2023-11-04T01:40:49.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.634+0000 7fd257d01640 1 --2- 172.21.15.77:0/1314387375 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd23406ae70 0x7fd23406d330 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.634+0000 7fd257d01640 1 --2- 172.21.15.77:0/1314387375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd25015d1b0 0x7fd250155e30 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.634+0000 7fd257d01640 1 --2- 172.21.15.77:0/1314387375 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd250070ff0 0x7fd250161040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.634+0000 7fd257d01640 1 --2- 172.21.15.77:0/1314387375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd250066000 0x7fd2500ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.634+0000 7fd257d01640 1 -- 172.21.15.77:0/1314387375 >> 172.21.15.77:0/1314387375 conn(0x7fd2500cbc90 msgr2=0x7fd2500c9f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:49.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.634+0000 7fd257d01640 1 -- 172.21.15.77:0/1314387375 shutdown_connections 2023-11-04T01:40:49.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.634+0000 7fd257d01640 1 -- 172.21.15.77:0/1314387375 wait complete. 2023-11-04T01:40:49.647 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:40:49.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.749+0000 7f2984fe7640 1 Processor -- start 2023-11-04T01:40:49.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.749+0000 7f2984fe7640 1 -- start start 2023-11-04T01:40:49.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.750+0000 7f2984fe7640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f29800b4f90 0x7f29800b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.750+0000 7f2984fe7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29800b60a0 con 0x7f29800b5c50 2023-11-04T01:40:49.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.750+0000 7f2984fe7640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29801655f0 con 0x7f2980161150 2023-11-04T01:40:49.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.750+0000 7f2984fe7640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2980165e90 con 0x7f29800b4f90 2023-11-04T01:40:49.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.750+0000 7f297ed9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f29800b5c50 0x7f29800d1090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36538/0 (socket says 172.21.15.77:36538) 2023-11-04T01:40:49.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.750+0000 7f297ed9d640 1 -- 172.21.15.77:0/1209130652 learned_addr learned my addr 172.21.15.77:0/1209130652 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:49.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.750+0000 7f297dd9b640 1 --2- 172.21.15.77:0/1209130652 >> v2:172.21.15.122:3300/0 conn(0x7f29800b4f90 0x7f29800b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.750+0000 7f297d59a640 1 -- 172.21.15.77:0/1209130652 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1610902114 0 0) 0x7f29800b60a0 con 0x7f29800b5c50 2023-11-04T01:40:49.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.750+0000 7f297d59a640 1 -- 172.21.15.77:0/1209130652 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2968003520 con 0x7f29800b5c50 2023-11-04T01:40:49.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.750+0000 7f297dd9b640 1 -- 172.21.15.77:0/1209130652 >> v1:172.21.15.122:6789/0 conn(0x7f2980161150 legacy=0x7f29800b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.750+0000 7f297dd9b640 1 -- 172.21.15.77:0/1209130652 >> v1:172.21.15.77:6789/0 conn(0x7f29800b5c50 legacy=0x7f29800d1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.750+0000 7f297dd9b640 1 -- 172.21.15.77:0/1209130652 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29801658d0 con 0x7f29800b4f90 2023-11-04T01:40:49.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.751+0000 7f297dd9b640 1 --2- 172.21.15.77:0/1209130652 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29800b4f90 0x7f29800b2270 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f29740097a0 tx=0x7f297402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38c64f3ce3dfdc2b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:49.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.751+0000 7f297d59a640 1 -- 172.21.15.77:0/1209130652 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2974031830 con 0x7f29800b4f90 2023-11-04T01:40:49.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.751+0000 7f297d59a640 1 -- 172.21.15.77:0/1209130652 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2974031990 con 0x7f29800b4f90 2023-11-04T01:40:49.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.752+0000 7f297d59a640 1 -- 172.21.15.77:0/1209130652 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2974031d00 con 0x7f29800b4f90 2023-11-04T01:40:49.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.752+0000 7f2984fe7640 1 -- 172.21.15.77:0/1209130652 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29800b4f90 msgr2=0x7f29800b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.752+0000 7f2984fe7640 1 --2- 172.21.15.77:0/1209130652 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29800b4f90 0x7f29800b2270 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f29740097a0 tx=0x7f297402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.752+0000 7f2984fe7640 1 -- 172.21.15.77:0/1209130652 shutdown_connections 2023-11-04T01:40:49.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.752+0000 7f2984fe7640 1 --2- 172.21.15.77:0/1209130652 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29800b4f90 0x7f29800b2270 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.752+0000 7f2984fe7640 1 -- 172.21.15.77:0/1209130652 >> 172.21.15.77:0/1209130652 conn(0x7f29800cf880 msgr2=0x7f29800cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:49.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.752+0000 7f2984fe7640 1 -- 172.21.15.77:0/1209130652 shutdown_connections 2023-11-04T01:40:49.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.752+0000 7f2984fe7640 1 -- 172.21.15.77:0/1209130652 wait complete. 2023-11-04T01:40:49.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.754+0000 7f2984fe7640 1 Processor -- start 2023-11-04T01:40:49.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.754+0000 7f2984fe7640 1 -- start start 2023-11-04T01:40:49.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.754+0000 7f2984fe7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29800b4f90 0x7f29800cc540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.754+0000 7f2984fe7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29800b5c50 0x7f298015cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.754+0000 7f2984fe7640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2980161150 0x7f298015d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.754+0000 7f2984fe7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29800cacf0 con 0x7f29800b5c50 2023-11-04T01:40:49.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.754+0000 7f2984fe7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29800ca070 con 0x7f29800b4f90 2023-11-04T01:40:49.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.754+0000 7f2984fe7640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29800ca350 con 0x7f2980161150 2023-11-04T01:40:49.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.754+0000 7f297dd9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29800b5c50 0x7f298015cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.754+0000 7f297dd9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29800b5c50 0x7f298015cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49042/0 (socket says 172.21.15.77:49042) 2023-11-04T01:40:49.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.754+0000 7f297dd9b640 1 -- 172.21.15.77:0/267888447 learned_addr learned my addr 172.21.15.77:0/267888447 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:49.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.754+0000 7f297e59c640 1 --2- 172.21.15.77:0/267888447 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29800b4f90 0x7f29800cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.755+0000 7f297ed9d640 1 --2- 172.21.15.77:0/267888447 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2980161150 0x7f298015d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.755+0000 7f297dd9b640 1 -- 172.21.15.77:0/267888447 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2980161150 msgr2=0x7f298015d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.755+0000 7f297dd9b640 1 --2- 172.21.15.77:0/267888447 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2980161150 0x7f298015d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.755+0000 7f297dd9b640 1 -- 172.21.15.77:0/267888447 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29800b4f90 msgr2=0x7f29800cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.755+0000 7f297dd9b640 1 --2- 172.21.15.77:0/267888447 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29800b4f90 0x7f29800cc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.755+0000 7f297dd9b640 1 -- 172.21.15.77:0/267888447 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2974009400 con 0x7f29800b5c50 2023-11-04T01:40:49.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.755+0000 7f297ed9d640 1 --2- 172.21.15.77:0/267888447 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2980161150 0x7f298015d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:49.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.755+0000 7f297dd9b640 1 --2- 172.21.15.77:0/267888447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29800b5c50 0x7f298015cec0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2974000c00 tx=0x7f29740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:49.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.755+0000 7f296effd640 1 -- 172.21.15.77:0/267888447 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2974004230 con 0x7f29800b5c50 2023-11-04T01:40:49.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.755+0000 7f296effd640 1 -- 172.21.15.77:0/267888447 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2974004390 con 0x7f29800b5c50 2023-11-04T01:40:49.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.755+0000 7f2984fe7640 1 -- 172.21.15.77:0/267888447 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29800ca630 con 0x7f29800b5c50 2023-11-04T01:40:49.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.755+0000 7f296effd640 1 -- 172.21.15.77:0/267888447 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297403a860 con 0x7f29800b5c50 2023-11-04T01:40:49.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.755+0000 7f2984fe7640 1 -- 172.21.15.77:0/267888447 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29800cca80 con 0x7f29800b5c50 2023-11-04T01:40:49.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.756+0000 7f2984fe7640 1 -- 172.21.15.77:0/267888447 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29801566e0 con 0x7f29800b5c50 2023-11-04T01:40:49.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.756+0000 7f296effd640 1 -- 172.21.15.77:0/267888447 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f297403a9c0 con 0x7f29800b5c50 2023-11-04T01:40:49.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.757+0000 7f296effd640 1 --2- 172.21.15.77:0/267888447 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f296006ae70 0x7f296006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:49.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.757+0000 7f296effd640 1 -- 172.21.15.77:0/267888447 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f29740ac0a0 con 0x7f29800b5c50 2023-11-04T01:40:49.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.757+0000 7f297e59c640 1 --2- 172.21.15.77:0/267888447 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f296006ae70 0x7f296006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:49.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.757+0000 7f297e59c640 1 --2- 172.21.15.77:0/267888447 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f296006ae70 0x7f296006d330 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f29700016e0 tx=0x7f2970009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:49.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.761+0000 7f296effd640 1 -- 172.21.15.77:0/267888447 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2974076ec0 con 0x7f29800b5c50 2023-11-04T01:40:49.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.927+0000 7f2984fe7640 1 -- 172.21.15.77:0/267888447 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2980074290 con 0x7f29800b5c50 2023-11-04T01:40:49.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.927+0000 7f296effd640 1 -- 172.21.15.77:0/267888447 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f297407a4e0 con 0x7f29800b5c50 2023-11-04T01:40:49.929 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:40:49.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.929+0000 7f2984fe7640 1 -- 172.21.15.77:0/267888447 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f296006ae70 msgr2=0x7f296006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.929+0000 7f2984fe7640 1 --2- 172.21.15.77:0/267888447 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f296006ae70 0x7f296006d330 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f29700016e0 tx=0x7f2970009040 comp rx=0 tx=0).stop 2023-11-04T01:40:49.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.929+0000 7f2984fe7640 1 -- 172.21.15.77:0/267888447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29800b5c50 msgr2=0x7f298015cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:49.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.929+0000 7f2984fe7640 1 --2- 172.21.15.77:0/267888447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29800b5c50 0x7f298015cec0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2974000c00 tx=0x7f29740046c0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.929+0000 7f2984fe7640 1 -- 172.21.15.77:0/267888447 shutdown_connections 2023-11-04T01:40:49.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.929+0000 7f2984fe7640 1 --2- 172.21.15.77:0/267888447 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f296006ae70 0x7f296006d330 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.929+0000 7f2984fe7640 1 --2- 172.21.15.77:0/267888447 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2980161150 0x7f298015d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.929+0000 7f2984fe7640 1 --2- 172.21.15.77:0/267888447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29800b5c50 0x7f298015cec0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.929+0000 7f2984fe7640 1 --2- 172.21.15.77:0/267888447 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29800b4f90 0x7f29800cc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:49.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.929+0000 7f2984fe7640 1 -- 172.21.15.77:0/267888447 >> 172.21.15.77:0/267888447 conn(0x7f29800cf880 msgr2=0x7f29800b4840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:49.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.929+0000 7f2984fe7640 1 -- 172.21.15.77:0/267888447 shutdown_connections 2023-11-04T01:40:49.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:49.929+0000 7f2984fe7640 1 -- 172.21.15.77:0/267888447 wait complete. 2023-11-04T01:40:49.942 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:40:50.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.043+0000 7f1531421640 1 Processor -- start 2023-11-04T01:40:50.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.043+0000 7f1531421640 1 -- start start 2023-11-04T01:40:50.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.044+0000 7f1531421640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f152c153e60 0x7f152c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.044+0000 7f1531421640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f152c0cde60 con 0x7f152c0cd6d0 2023-11-04T01:40:50.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.044+0000 7f1531421640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f152c160f90 con 0x7f152c0b4880 2023-11-04T01:40:50.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.044+0000 7f1531421640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f152c15e400 con 0x7f152c153e60 2023-11-04T01:40:50.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.044+0000 7f152a7fc640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f152c0cd6d0 0x7f152c161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36540/0 (socket says 172.21.15.77:36540) 2023-11-04T01:40:50.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.044+0000 7f152a7fc640 1 -- 172.21.15.77:0/1462944246 learned_addr learned my addr 172.21.15.77:0/1462944246 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:50.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.044+0000 7f1529ffb640 1 -- 172.21.15.77:0/1462944246 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3253213496 0 0) 0x7f152c0cde60 con 0x7f152c0cd6d0 2023-11-04T01:40:50.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.044+0000 7f1529ffb640 1 -- 172.21.15.77:0/1462944246 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1514003520 con 0x7f152c0cd6d0 2023-11-04T01:40:50.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.044+0000 7f152affd640 1 --2- 172.21.15.77:0/1462944246 >> v2:172.21.15.122:3300/0 conn(0x7f152c153e60 0x7f152c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.044+0000 7f1529ffb640 1 -- 172.21.15.77:0/1462944246 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 284481438 0 0) 0x7f1514003520 con 0x7f152c0cd6d0 2023-11-04T01:40:50.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.044+0000 7f1529ffb640 1 -- 172.21.15.77:0/1462944246 >> v2:172.21.15.122:3300/0 conn(0x7f152c153e60 msgr2=0x7f152c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.044+0000 7f1529ffb640 1 --2- 172.21.15.77:0/1462944246 >> v2:172.21.15.122:3300/0 conn(0x7f152c153e60 0x7f152c15dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.044+0000 7f1529ffb640 1 -- 172.21.15.77:0/1462944246 >> v1:172.21.15.122:6789/0 conn(0x7f152c0b4880 legacy=0x7f152c0d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.044+0000 7f1529ffb640 1 -- 172.21.15.77:0/1462944246 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152c0ce090 con 0x7f152c0cd6d0 2023-11-04T01:40:50.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.044+0000 7f1529ffb640 1 -- 172.21.15.77:0/1462944246 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f1520001670 con 0x7f152c0cd6d0 2023-11-04T01:40:50.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.044+0000 7f1529ffb640 1 -- 172.21.15.77:0/1462944246 >> v1:172.21.15.77:6789/0 conn(0x7f152c0cd6d0 legacy=0x7f152c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.045+0000 7f1529ffb640 1 --2- 172.21.15.77:0/1462944246 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1514003970 0x7f1514003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.045+0000 7f1529ffb640 1 --2- 172.21.15.77:0/1462944246 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15140047c0 0x7f1514004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.045+0000 7f1529ffb640 1 --2- 172.21.15.77:0/1462944246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1514005180 0x7f151400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.045+0000 7f1529ffb640 1 -- 172.21.15.77:0/1462944246 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152c15e400 con 0x7f15140047c0 2023-11-04T01:40:50.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.045+0000 7f1529ffb640 1 -- 172.21.15.77:0/1462944246 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151400c020 con 0x7f1514005180 2023-11-04T01:40:50.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.045+0000 7f1529ffb640 1 -- 172.21.15.77:0/1462944246 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f151400c1e0 con 0x7f1514003970 2023-11-04T01:40:50.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.045+0000 7f152a7fc640 1 --2- 172.21.15.77:0/1462944246 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15140047c0 0x7f1514004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.045+0000 7f152affd640 1 --2- 172.21.15.77:0/1462944246 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1514003970 0x7f1514003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.045+0000 7f152b7fe640 1 --2- 172.21.15.77:0/1462944246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1514005180 0x7f151400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.045+0000 7f152a7fc640 1 -- 172.21.15.77:0/1462944246 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1514003970 msgr2=0x7f1514003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.045+0000 7f152a7fc640 1 --2- 172.21.15.77:0/1462944246 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1514003970 0x7f1514003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.045+0000 7f152a7fc640 1 -- 172.21.15.77:0/1462944246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1514005180 msgr2=0x7f151400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.045+0000 7f152a7fc640 1 --2- 172.21.15.77:0/1462944246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1514005180 0x7f151400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.045+0000 7f152a7fc640 1 -- 172.21.15.77:0/1462944246 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1514003520 con 0x7f15140047c0 2023-11-04T01:40:50.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.045+0000 7f152b7fe640 1 -- 172.21.15.77:0/1462944246 reap_dead start 2023-11-04T01:40:50.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.046+0000 7f152a7fc640 1 --2- 172.21.15.77:0/1462944246 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15140047c0 0x7f1514004c40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1520001050 tx=0x7f15140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf058031a87111a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.046+0000 7f1529ffb640 1 -- 172.21.15.77:0/1462944246 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1520005ad0 con 0x7f15140047c0 2023-11-04T01:40:50.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.046+0000 7f1529ffb640 1 -- 172.21.15.77:0/1462944246 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1520005c30 con 0x7f15140047c0 2023-11-04T01:40:50.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.046+0000 7f1529ffb640 1 -- 172.21.15.77:0/1462944246 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152002ca90 con 0x7f15140047c0 2023-11-04T01:40:50.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.046+0000 7f1531421640 1 -- 172.21.15.77:0/1462944246 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15140047c0 msgr2=0x7f1514004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.046+0000 7f1531421640 1 --2- 172.21.15.77:0/1462944246 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15140047c0 0x7f1514004c40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1520001050 tx=0x7f15140057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.046+0000 7f1531421640 1 -- 172.21.15.77:0/1462944246 shutdown_connections 2023-11-04T01:40:50.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.046+0000 7f1531421640 1 --2- 172.21.15.77:0/1462944246 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15140047c0 0x7f1514004c40 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.046+0000 7f1531421640 1 -- 172.21.15.77:0/1462944246 >> 172.21.15.77:0/1462944246 conn(0x7f152c0cf880 msgr2=0x7f152c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:50.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.046+0000 7f1531421640 1 -- 172.21.15.77:0/1462944246 shutdown_connections 2023-11-04T01:40:50.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.046+0000 7f1531421640 1 -- 172.21.15.77:0/1462944246 wait complete. 2023-11-04T01:40:50.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.048+0000 7f1531421640 1 Processor -- start 2023-11-04T01:40:50.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.048+0000 7f1531421640 1 -- start start 2023-11-04T01:40:50.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.048+0000 7f1531421640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15140047c0 0x7f152c0cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.048+0000 7f1531421640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f152c150830 0x7f152c0c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.048+0000 7f1531421640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f152c0c8770 0x7f152c1555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.048+0000 7f1531421640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152c0c8bf0 con 0x7f15140047c0 2023-11-04T01:40:50.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.048+0000 7f1531421640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152c156f80 con 0x7f152c150830 2023-11-04T01:40:50.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.048+0000 7f1531421640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f152c1574b0 con 0x7f152c0c8770 2023-11-04T01:40:50.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.048+0000 7f152affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15140047c0 0x7f152c0cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.048+0000 7f152affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15140047c0 0x7f152c0cc1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49066/0 (socket says 172.21.15.77:49066) 2023-11-04T01:40:50.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.048+0000 7f152affd640 1 -- 172.21.15.77:0/3809046385 learned_addr learned my addr 172.21.15.77:0/3809046385 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:50.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.049+0000 7f152a7fc640 1 --2- 172.21.15.77:0/3809046385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f152c150830 0x7f152c0c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.049+0000 7f152b7fe640 1 --2- 172.21.15.77:0/3809046385 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f152c0c8770 0x7f152c1555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.049+0000 7f152affd640 1 -- 172.21.15.77:0/3809046385 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f152c0c8770 msgr2=0x7f152c1555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.049+0000 7f152affd640 1 --2- 172.21.15.77:0/3809046385 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f152c0c8770 0x7f152c1555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.049+0000 7f152affd640 1 -- 172.21.15.77:0/3809046385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f152c150830 msgr2=0x7f152c0c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.049+0000 7f152affd640 1 --2- 172.21.15.77:0/3809046385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f152c150830 0x7f152c0c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.049+0000 7f152affd640 1 -- 172.21.15.77:0/3809046385 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152c0cc720 con 0x7f15140047c0 2023-11-04T01:40:50.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.049+0000 7f152a7fc640 1 --2- 172.21.15.77:0/3809046385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f152c150830 0x7f152c0c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:50.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.049+0000 7f152affd640 1 --2- 172.21.15.77:0/3809046385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15140047c0 0x7f152c0cc1e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f151c0116d0 tx=0x7f151c011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.049+0000 7f15137fe640 1 -- 172.21.15.77:0/3809046385 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c00f9c0 con 0x7f15140047c0 2023-11-04T01:40:50.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.049+0000 7f15137fe640 1 -- 172.21.15.77:0/3809046385 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151c00fb20 con 0x7f15140047c0 2023-11-04T01:40:50.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.049+0000 7f1531421640 1 -- 172.21.15.77:0/3809046385 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f152c1571d0 con 0x7f15140047c0 2023-11-04T01:40:50.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.049+0000 7f15137fe640 1 -- 172.21.15.77:0/3809046385 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c00fe90 con 0x7f15140047c0 2023-11-04T01:40:50.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.049+0000 7f1531421640 1 -- 172.21.15.77:0/3809046385 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f152c0c76c0 con 0x7f15140047c0 2023-11-04T01:40:50.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.050+0000 7f1531421640 1 -- 172.21.15.77:0/3809046385 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f152c074290 con 0x7f15140047c0 2023-11-04T01:40:50.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.050+0000 7f15137fe640 1 -- 172.21.15.77:0/3809046385 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f151c015460 con 0x7f15140047c0 2023-11-04T01:40:50.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.051+0000 7f15137fe640 1 --2- 172.21.15.77:0/3809046385 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f151806aea0 0x7f151806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.051+0000 7f15137fe640 1 -- 172.21.15.77:0/3809046385 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f151c08a2c0 con 0x7f15140047c0 2023-11-04T01:40:50.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.051+0000 7f152a7fc640 1 --2- 172.21.15.77:0/3809046385 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f151806aea0 0x7f151806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.051+0000 7f152a7fc640 1 --2- 172.21.15.77:0/3809046385 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f151806aea0 0x7f151806d360 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1520034000 tx=0x7f1520007000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.055+0000 7f15137fe640 1 -- 172.21.15.77:0/3809046385 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f151c054fb0 con 0x7f15140047c0 2023-11-04T01:40:50.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.221+0000 7f1531421640 1 -- 172.21.15.77:0/3809046385 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f152c1551c0 con 0x7f15140047c0 2023-11-04T01:40:50.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.221+0000 7f15137fe640 1 -- 172.21.15.77:0/3809046385 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f151c0585d0 con 0x7f15140047c0 2023-11-04T01:40:50.223 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-04T01:40:50.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.223+0000 7f1531421640 1 -- 172.21.15.77:0/3809046385 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f151806aea0 msgr2=0x7f151806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.223+0000 7f1531421640 1 --2- 172.21.15.77:0/3809046385 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f151806aea0 0x7f151806d360 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1520034000 tx=0x7f1520007000 comp rx=0 tx=0).stop 2023-11-04T01:40:50.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.223+0000 7f1531421640 1 -- 172.21.15.77:0/3809046385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15140047c0 msgr2=0x7f152c0cc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.223+0000 7f1531421640 1 --2- 172.21.15.77:0/3809046385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15140047c0 0x7f152c0cc1e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f151c0116d0 tx=0x7f151c011b90 comp rx=0 tx=0).stop 2023-11-04T01:40:50.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.223+0000 7f1531421640 1 -- 172.21.15.77:0/3809046385 shutdown_connections 2023-11-04T01:40:50.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.223+0000 7f1531421640 1 --2- 172.21.15.77:0/3809046385 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f151806aea0 0x7f151806d360 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.223+0000 7f1531421640 1 --2- 172.21.15.77:0/3809046385 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f152c0c8770 0x7f152c1555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.223+0000 7f1531421640 1 --2- 172.21.15.77:0/3809046385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f152c150830 0x7f152c0c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.223+0000 7f1531421640 1 --2- 172.21.15.77:0/3809046385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15140047c0 0x7f152c0cc1e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.223+0000 7f1531421640 1 -- 172.21.15.77:0/3809046385 >> 172.21.15.77:0/3809046385 conn(0x7f152c0cf880 msgr2=0x7f152c0d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:50.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.223+0000 7f1531421640 1 -- 172.21.15.77:0/3809046385 shutdown_connections 2023-11-04T01:40:50.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.223+0000 7f1531421640 1 -- 172.21.15.77:0/3809046385 wait complete. 2023-11-04T01:40:50.235 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:40:50.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.335+0000 7f80051d7640 1 Processor -- start 2023-11-04T01:40:50.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.335+0000 7f80051d7640 1 -- start start 2023-11-04T01:40:50.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.336+0000 7f80051d7640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8000160430 0x7f80000b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.336+0000 7f80051d7640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80000b2b60 0x7f800006bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.336+0000 7f80051d7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f800006c1d0 0x7f8000160b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.336+0000 7f80051d7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80000cb580 con 0x7f800006c1d0 2023-11-04T01:40:50.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.336+0000 7f80051d7640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80000b2fc0 con 0x7f8000160430 2023-11-04T01:40:50.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.336+0000 7f80051d7640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800006ca40 con 0x7f80000b2b60 2023-11-04T01:40:50.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.336+0000 7f7fff59e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f800006c1d0 0x7f8000160b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.336+0000 7f7fff59e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f800006c1d0 0x7f8000160b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49072/0 (socket says 172.21.15.77:49072) 2023-11-04T01:40:50.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.336+0000 7f7fff59e640 1 -- 172.21.15.77:0/604474399 learned_addr learned my addr 172.21.15.77:0/604474399 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:50.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.336+0000 7f7ffed9d640 1 --2- 172.21.15.77:0/604474399 >> v2:172.21.15.122:3300/0 conn(0x7f8000160430 0x7f80000b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.336+0000 7f7ffe59c640 1 --2- 172.21.15.77:0/604474399 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80000b2b60 0x7f800006bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.336+0000 7f7fff59e640 1 -- 172.21.15.77:0/604474399 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80000b2b60 msgr2=0x7f800006bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.336+0000 7f7fff59e640 1 --2- 172.21.15.77:0/604474399 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80000b2b60 0x7f800006bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.336+0000 7f7fff59e640 1 -- 172.21.15.77:0/604474399 >> v2:172.21.15.122:3300/0 conn(0x7f8000160430 msgr2=0x7f80000b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.336+0000 7f7fff59e640 1 --2- 172.21.15.77:0/604474399 >> v2:172.21.15.122:3300/0 conn(0x7f8000160430 0x7f80000b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.336+0000 7f7fff59e640 1 -- 172.21.15.77:0/604474399 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f800006cd20 con 0x7f800006c1d0 2023-11-04T01:40:50.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.336+0000 7f7ffe59c640 1 --2- 172.21.15.77:0/604474399 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80000b2b60 0x7f800006bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:50.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.337+0000 7f7fff59e640 1 --2- 172.21.15.77:0/604474399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f800006c1d0 0x7f8000160b20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f800006f6d0 tx=0x7f7ff802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=494ecb0982addf0a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.337+0000 7f7ffdd9b640 1 -- 172.21.15.77:0/604474399 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff8031870 con 0x7f800006c1d0 2023-11-04T01:40:50.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.337+0000 7f7ffdd9b640 1 -- 172.21.15.77:0/604474399 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff80319d0 con 0x7f800006c1d0 2023-11-04T01:40:50.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.337+0000 7f7ffdd9b640 1 -- 172.21.15.77:0/604474399 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff8031d60 con 0x7f800006c1d0 2023-11-04T01:40:50.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.338+0000 7f80051d7640 1 -- 172.21.15.77:0/604474399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f800006c1d0 msgr2=0x7f8000160b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.338+0000 7f80051d7640 1 --2- 172.21.15.77:0/604474399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f800006c1d0 0x7f8000160b20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f800006f6d0 tx=0x7f7ff802b910 comp rx=0 tx=0).stop 2023-11-04T01:40:50.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.338+0000 7f80051d7640 1 -- 172.21.15.77:0/604474399 shutdown_connections 2023-11-04T01:40:50.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.338+0000 7f80051d7640 1 --2- 172.21.15.77:0/604474399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f800006c1d0 0x7f8000160b20 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.338+0000 7f80051d7640 1 --2- 172.21.15.77:0/604474399 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80000b2b60 0x7f800006bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.338+0000 7f80051d7640 1 --2- 172.21.15.77:0/604474399 >> v2:172.21.15.122:3300/0 conn(0x7f8000160430 0x7f80000b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.338+0000 7f80051d7640 1 -- 172.21.15.77:0/604474399 >> 172.21.15.77:0/604474399 conn(0x7f800006ea20 msgr2=0x7f800006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:50.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.338+0000 7f80051d7640 1 -- 172.21.15.77:0/604474399 shutdown_connections 2023-11-04T01:40:50.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.338+0000 7f80051d7640 1 -- 172.21.15.77:0/604474399 wait complete. 2023-11-04T01:40:50.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.339+0000 7f80051d7640 1 Processor -- start 2023-11-04T01:40:50.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.339+0000 7f80051d7640 1 -- start start 2023-11-04T01:40:50.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.340+0000 7f80051d7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f800006c1d0 0x7f80001f36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.340+0000 7f80051d7640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80000b2b60 0x7f80001ecaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.340+0000 7f80051d7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8000160430 0x7f80000b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.340+0000 7f80051d7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80000b4c20 con 0x7f800006c1d0 2023-11-04T01:40:50.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.340+0000 7f80051d7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80001f3bf0 con 0x7f8000160430 2023-11-04T01:40:50.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.340+0000 7f80051d7640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80000b4010 con 0x7f80000b2b60 2023-11-04T01:40:50.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.340+0000 7f7ffed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f800006c1d0 0x7f80001f36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.340+0000 7f7ffed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f800006c1d0 0x7f80001f36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49078/0 (socket says 172.21.15.77:49078) 2023-11-04T01:40:50.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.340+0000 7f7ffed9d640 1 -- 172.21.15.77:0/3133158992 learned_addr learned my addr 172.21.15.77:0/3133158992 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:50.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.340+0000 7f7ffe59c640 1 --2- 172.21.15.77:0/3133158992 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80000b2b60 0x7f80001ecaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.340+0000 7f7fff59e640 1 --2- 172.21.15.77:0/3133158992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8000160430 0x7f80000b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.341+0000 7f7ffed9d640 1 -- 172.21.15.77:0/3133158992 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80000b2b60 msgr2=0x7f80001ecaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.341+0000 7f7ffed9d640 1 --2- 172.21.15.77:0/3133158992 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80000b2b60 0x7f80001ecaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.341+0000 7f7ffed9d640 1 -- 172.21.15.77:0/3133158992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8000160430 msgr2=0x7f80000b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.341+0000 7f7ffed9d640 1 --2- 172.21.15.77:0/3133158992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8000160430 0x7f80000b54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.341+0000 7f7ffed9d640 1 -- 172.21.15.77:0/3133158992 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff80094d0 con 0x7f800006c1d0 2023-11-04T01:40:50.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.341+0000 7f7ffed9d640 1 --2- 172.21.15.77:0/3133158992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f800006c1d0 0x7f80001f36b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0009d10 tx=0x7f7ff000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.341+0000 7f7fe77fe640 1 -- 172.21.15.77:0/3133158992 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff0009b80 con 0x7f800006c1d0 2023-11-04T01:40:50.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.341+0000 7f7fe77fe640 1 -- 172.21.15.77:0/3133158992 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff000f040 con 0x7f800006c1d0 2023-11-04T01:40:50.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.341+0000 7f80051d7640 1 -- 172.21.15.77:0/3133158992 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80000b42f0 con 0x7f800006c1d0 2023-11-04T01:40:50.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.341+0000 7f7fe77fe640 1 -- 172.21.15.77:0/3133158992 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff0014680 con 0x7f800006c1d0 2023-11-04T01:40:50.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.341+0000 7f80051d7640 1 -- 172.21.15.77:0/3133158992 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80000b48b0 con 0x7f800006c1d0 2023-11-04T01:40:50.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.342+0000 7f80051d7640 1 -- 172.21.15.77:0/3133158992 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8000074290 con 0x7f800006c1d0 2023-11-04T01:40:50.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.342+0000 7f7fe77fe640 1 -- 172.21.15.77:0/3133158992 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7ff00147e0 con 0x7f800006c1d0 2023-11-04T01:40:50.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.343+0000 7f7fe77fe640 1 --2- 172.21.15.77:0/3133158992 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7fec06ae70 0x7f7fec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.343+0000 7f7fe77fe640 1 -- 172.21.15.77:0/3133158992 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7ff008a450 con 0x7f800006c1d0 2023-11-04T01:40:50.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.343+0000 7f7ffe59c640 1 --2- 172.21.15.77:0/3133158992 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7fec06ae70 0x7f7fec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.343+0000 7f7ffe59c640 1 --2- 172.21.15.77:0/3133158992 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7fec06ae70 0x7f7fec06d330 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4006fd0 tx=0x7f7ff4008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.347+0000 7f7fe77fe640 1 -- 172.21.15.77:0/3133158992 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7ff00551d0 con 0x7f800006c1d0 2023-11-04T01:40:50.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.511+0000 7f80051d7640 1 -- 172.21.15.77:0/3133158992 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f80000b6b20 con 0x7f800006c1d0 2023-11-04T01:40:50.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.512+0000 7f7fe77fe640 1 -- 172.21.15.77:0/3133158992 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7ff00587f0 con 0x7f800006c1d0 2023-11-04T01:40:50.514 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:40:50.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.513+0000 7f80051d7640 1 -- 172.21.15.77:0/3133158992 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7fec06ae70 msgr2=0x7f7fec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.513+0000 7f80051d7640 1 --2- 172.21.15.77:0/3133158992 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7fec06ae70 0x7f7fec06d330 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4006fd0 tx=0x7f7ff4008040 comp rx=0 tx=0).stop 2023-11-04T01:40:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.513+0000 7f80051d7640 1 -- 172.21.15.77:0/3133158992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f800006c1d0 msgr2=0x7f80001f36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.513+0000 7f80051d7640 1 --2- 172.21.15.77:0/3133158992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f800006c1d0 0x7f80001f36b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0009d10 tx=0x7f7ff000c490 comp rx=0 tx=0).stop 2023-11-04T01:40:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.513+0000 7f80051d7640 1 -- 172.21.15.77:0/3133158992 shutdown_connections 2023-11-04T01:40:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.513+0000 7f80051d7640 1 --2- 172.21.15.77:0/3133158992 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7fec06ae70 0x7f7fec06d330 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.513+0000 7f80051d7640 1 --2- 172.21.15.77:0/3133158992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8000160430 0x7f80000b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.513+0000 7f80051d7640 1 --2- 172.21.15.77:0/3133158992 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80000b2b60 0x7f80001ecaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.513+0000 7f80051d7640 1 --2- 172.21.15.77:0/3133158992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f800006c1d0 0x7f80001f36b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.513+0000 7f80051d7640 1 -- 172.21.15.77:0/3133158992 >> 172.21.15.77:0/3133158992 conn(0x7f800006ea20 msgr2=0x7f80000b09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:50.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.513+0000 7f80051d7640 1 -- 172.21.15.77:0/3133158992 shutdown_connections 2023-11-04T01:40:50.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.513+0000 7f80051d7640 1 -- 172.21.15.77:0/3133158992 wait complete. 2023-11-04T01:40:50.526 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:50.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.624+0000 7efc526af640 1 Processor -- start 2023-11-04T01:40:50.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.624+0000 7efc526af640 1 -- start start 2023-11-04T01:40:50.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.625+0000 7efc526af640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc4c15ce60 0x7efc4c06b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.625+0000 7efc526af640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efc4c0cf160 0x7efc4c0cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.625+0000 7efc526af640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc4c1615d0 con 0x7efc4c06bd30 2023-11-04T01:40:50.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.625+0000 7efc526af640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc4c0cbde0 con 0x7efc4c0cf160 2023-11-04T01:40:50.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.625+0000 7efc526af640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc4c0cfb50 con 0x7efc4c15ce60 2023-11-04T01:40:50.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.625+0000 7efc50c4c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efc4c0cf160 0x7efc4c0cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.625+0000 7efc4b7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7efc4c06bd30 0x7efc4c160b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36554/0 (socket says 172.21.15.77:36554) 2023-11-04T01:40:50.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.625+0000 7efc4b7fe640 1 -- 172.21.15.77:0/2826730434 learned_addr learned my addr 172.21.15.77:0/2826730434 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:50.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.626+0000 7efc4bfff640 1 --2- 172.21.15.77:0/2826730434 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc4c15ce60 0x7efc4c06b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.626+0000 7efc50c4c640 1 -- 172.21.15.77:0/2826730434 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc4c15ce60 msgr2=0x7efc4c06b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.626+0000 7efc50c4c640 1 --2- 172.21.15.77:0/2826730434 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc4c15ce60 0x7efc4c06b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.626+0000 7efc50c4c640 1 -- 172.21.15.77:0/2826730434 >> v1:172.21.15.77:6789/0 conn(0x7efc4c06bd30 legacy=0x7efc4c160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.626+0000 7efc50c4c640 1 -- 172.21.15.77:0/2826730434 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4c1618b0 con 0x7efc4c0cf160 2023-11-04T01:40:50.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.626+0000 7efc50c4c640 1 --2- 172.21.15.77:0/2826730434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc4c0cf160 0x7efc4c0cf610 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7efc44009d90 tx=0x7efc4402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c69e2904d8b88505 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.626+0000 7efc4affd640 1 -- 172.21.15.77:0/2826730434 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4402cc50 con 0x7efc4c0cf160 2023-11-04T01:40:50.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.627+0000 7efc4affd640 1 -- 172.21.15.77:0/2826730434 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4402cdb0 con 0x7efc4c0cf160 2023-11-04T01:40:50.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.627+0000 7efc4affd640 1 -- 172.21.15.77:0/2826730434 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc44034660 con 0x7efc4c0cf160 2023-11-04T01:40:50.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.627+0000 7efc526af640 1 -- 172.21.15.77:0/2826730434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc4c0cf160 msgr2=0x7efc4c0cf610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.627+0000 7efc526af640 1 --2- 172.21.15.77:0/2826730434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc4c0cf160 0x7efc4c0cf610 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7efc44009d90 tx=0x7efc4402bea0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.627+0000 7efc526af640 1 -- 172.21.15.77:0/2826730434 shutdown_connections 2023-11-04T01:40:50.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.627+0000 7efc526af640 1 --2- 172.21.15.77:0/2826730434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc4c0cf160 0x7efc4c0cf610 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.627+0000 7efc526af640 1 --2- 172.21.15.77:0/2826730434 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc4c15ce60 0x7efc4c06b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.627+0000 7efc526af640 1 -- 172.21.15.77:0/2826730434 >> 172.21.15.77:0/2826730434 conn(0x7efc4c06ea90 msgr2=0x7efc4c06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:50.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.627+0000 7efc526af640 1 -- 172.21.15.77:0/2826730434 shutdown_connections 2023-11-04T01:40:50.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.627+0000 7efc526af640 1 -- 172.21.15.77:0/2826730434 wait complete. 2023-11-04T01:40:50.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.628+0000 7efc526af640 1 Processor -- start 2023-11-04T01:40:50.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.628+0000 7efc526af640 1 -- start start 2023-11-04T01:40:50.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.629+0000 7efc526af640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc4c0cf160 0x7efc4c156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.629+0000 7efc526af640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc4c15ce60 0x7efc4c1f6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.629+0000 7efc526af640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc4c0c93a0 0x7efc4c0b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.629+0000 7efc526af640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4c0c9c00 con 0x7efc4c15ce60 2023-11-04T01:40:50.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.629+0000 7efc526af640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4c156980 con 0x7efc4c0cf160 2023-11-04T01:40:50.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.629+0000 7efc526af640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc4c1f7000 con 0x7efc4c0c93a0 2023-11-04T01:40:50.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.629+0000 7efc4b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc4c15ce60 0x7efc4c1f6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.629+0000 7efc4b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc4c15ce60 0x7efc4c1f6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49092/0 (socket says 172.21.15.77:49092) 2023-11-04T01:40:50.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.629+0000 7efc4b7fe640 1 -- 172.21.15.77:0/3833307467 learned_addr learned my addr 172.21.15.77:0/3833307467 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:50.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.629+0000 7efc4b7fe640 1 -- 172.21.15.77:0/3833307467 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc4c0c93a0 msgr2=0x7efc4c0b57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.629+0000 7efc4b7fe640 1 --2- 172.21.15.77:0/3833307467 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc4c0c93a0 0x7efc4c0b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.629+0000 7efc4b7fe640 1 -- 172.21.15.77:0/3833307467 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc4c0cf160 msgr2=0x7efc4c156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.629+0000 7efc4b7fe640 1 --2- 172.21.15.77:0/3833307467 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc4c0cf160 0x7efc4c156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.629+0000 7efc4b7fe640 1 -- 172.21.15.77:0/3833307467 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc44009a70 con 0x7efc4c15ce60 2023-11-04T01:40:50.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.630+0000 7efc4b7fe640 1 --2- 172.21.15.77:0/3833307467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc4c15ce60 0x7efc4c1f6ac0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efc4000c500 tx=0x7efc4000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.630+0000 7efc48ff9640 1 -- 172.21.15.77:0/3833307467 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc40005ce0 con 0x7efc4c15ce60 2023-11-04T01:40:50.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.630+0000 7efc48ff9640 1 -- 172.21.15.77:0/3833307467 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc40005e40 con 0x7efc4c15ce60 2023-11-04T01:40:50.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.630+0000 7efc48ff9640 1 -- 172.21.15.77:0/3833307467 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc400072f0 con 0x7efc4c15ce60 2023-11-04T01:40:50.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.630+0000 7efc526af640 1 -- 172.21.15.77:0/3833307467 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc4c0c9920 con 0x7efc4c15ce60 2023-11-04T01:40:50.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.630+0000 7efc526af640 1 -- 172.21.15.77:0/3833307467 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc4c15d6c0 con 0x7efc4c15ce60 2023-11-04T01:40:50.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.631+0000 7efc526af640 1 -- 172.21.15.77:0/3833307467 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc4c15d240 con 0x7efc4c15ce60 2023-11-04T01:40:50.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.631+0000 7efc48ff9640 1 -- 172.21.15.77:0/3833307467 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efc40007450 con 0x7efc4c15ce60 2023-11-04T01:40:50.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.631+0000 7efc48ff9640 1 --2- 172.21.15.77:0/3833307467 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efc3806aea0 0x7efc3806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.632+0000 7efc48ff9640 1 -- 172.21.15.77:0/3833307467 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efc40088de0 con 0x7efc4c15ce60 2023-11-04T01:40:50.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.632+0000 7efc4bfff640 1 --2- 172.21.15.77:0/3833307467 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efc3806aea0 0x7efc3806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.632+0000 7efc4bfff640 1 --2- 172.21.15.77:0/3833307467 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efc3806aea0 0x7efc3806d360 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efc3c006fd0 tx=0x7efc3c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.636+0000 7efc48ff9640 1 -- 172.21.15.77:0/3833307467 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efc4c15d240 con 0x7efc4c15ce60 2023-11-04T01:40:50.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.804+0000 7efc526af640 1 -- 172.21.15.77:0/3833307467 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc4c15d240 con 0x7efc4c15ce60 2023-11-04T01:40:50.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.805+0000 7efc48ff9640 1 -- 172.21.15.77:0/3833307467 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18661 (secure 0 0 0) 0x7efc4c15d240 con 0x7efc4c15ce60 2023-11-04T01:40:50.808 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:50.808 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":26,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:40:47.579547+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:40:02.810971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:40:04.003979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:40:07.734355+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:50.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.807+0000 7efc526af640 1 -- 172.21.15.77:0/3833307467 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efc3806aea0 msgr2=0x7efc3806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.807+0000 7efc526af640 1 --2- 172.21.15.77:0/3833307467 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efc3806aea0 0x7efc3806d360 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efc3c006fd0 tx=0x7efc3c008040 comp rx=0 tx=0).stop 2023-11-04T01:40:50.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.807+0000 7efc526af640 1 -- 172.21.15.77:0/3833307467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc4c15ce60 msgr2=0x7efc4c1f6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.807+0000 7efc526af640 1 --2- 172.21.15.77:0/3833307467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc4c15ce60 0x7efc4c1f6ac0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efc4000c500 tx=0x7efc4000c9c0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.807+0000 7efc526af640 1 -- 172.21.15.77:0/3833307467 shutdown_connections 2023-11-04T01:40:50.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.807+0000 7efc526af640 1 --2- 172.21.15.77:0/3833307467 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efc3806aea0 0x7efc3806d360 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.807+0000 7efc526af640 1 --2- 172.21.15.77:0/3833307467 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc4c0c93a0 0x7efc4c0b57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.807+0000 7efc526af640 1 --2- 172.21.15.77:0/3833307467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc4c15ce60 0x7efc4c1f6ac0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.807+0000 7efc526af640 1 --2- 172.21.15.77:0/3833307467 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc4c0cf160 0x7efc4c156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.807+0000 7efc526af640 1 -- 172.21.15.77:0/3833307467 >> 172.21.15.77:0/3833307467 conn(0x7efc4c06ea90 msgr2=0x7efc4c15c000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:50.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.807+0000 7efc526af640 1 -- 172.21.15.77:0/3833307467 shutdown_connections 2023-11-04T01:40:50.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.807+0000 7efc526af640 1 -- 172.21.15.77:0/3833307467 wait complete. 2023-11-04T01:40:50.821 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:40:02.810971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:40:04.003979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:40:07.734355+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:40:50.822 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:40:50.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.921+0000 7ff146e10640 1 Processor -- start 2023-11-04T01:40:50.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.922+0000 7ff146e10640 1 -- start start 2023-11-04T01:40:50.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.922+0000 7ff146e10640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff1400b64c0 0x7ff1400b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.922+0000 7ff146e10640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff1400cd3b0 0x7ff1400cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.922+0000 7ff146e10640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1400d01f0 con 0x7ff14015af20 2023-11-04T01:40:50.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.922+0000 7ff146e10640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1400cc380 con 0x7ff1400b64c0 2023-11-04T01:40:50.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.922+0000 7ff146e10640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1400cdd80 con 0x7ff1400cd3b0 2023-11-04T01:40:50.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.922+0000 7ff13ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff1400b64c0 0x7ff1400b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.923+0000 7ff13ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff1400b64c0 0x7ff1400b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49102/0 (socket says 172.21.15.77:49102) 2023-11-04T01:40:50.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.923+0000 7ff144bac640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ff14015af20 0x7ff1400cbc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36562/0 (socket says 172.21.15.77:36562) 2023-11-04T01:40:50.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.923+0000 7ff13ffff640 1 -- 172.21.15.77:0/2816608247 learned_addr learned my addr 172.21.15.77:0/2816608247 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:50.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.923+0000 7ff1453ad640 1 --2- 172.21.15.77:0/2816608247 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff1400cd3b0 0x7ff1400cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.923+0000 7ff13ffff640 1 -- 172.21.15.77:0/2816608247 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff1400cd3b0 msgr2=0x7ff1400cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:50.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.923+0000 7ff13ffff640 1 --2- 172.21.15.77:0/2816608247 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff1400cd3b0 0x7ff1400cd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.923+0000 7ff13ffff640 1 -- 172.21.15.77:0/2816608247 >> v1:172.21.15.77:6789/0 conn(0x7ff14015af20 legacy=0x7ff1400cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.923+0000 7ff13ffff640 1 -- 172.21.15.77:0/2816608247 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1400b6a40 con 0x7ff1400b64c0 2023-11-04T01:40:50.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.923+0000 7ff13f7fe640 1 -- 172.21.15.77:0/2816608247 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 360201196 0 0) 0x7ff1400d01f0 con 0x7ff14015af20 2023-11-04T01:40:50.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.924+0000 7ff13ffff640 1 --2- 172.21.15.77:0/2816608247 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1400b64c0 0x7ff1400b3cd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff12c0098a0 tx=0x7ff12c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eaca80197e3b2d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.924+0000 7ff13f7fe640 1 -- 172.21.15.77:0/2816608247 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12c030840 con 0x7ff1400b64c0 2023-11-04T01:40:50.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.924+0000 7ff13f7fe640 1 -- 172.21.15.77:0/2816608247 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12c0309a0 con 0x7ff1400b64c0 2023-11-04T01:40:50.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.924+0000 7ff13f7fe640 1 -- 172.21.15.77:0/2816608247 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12c030d30 con 0x7ff1400b64c0 2023-11-04T01:40:50.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.924+0000 7ff146e10640 1 -- 172.21.15.77:0/2816608247 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1400b64c0 msgr2=0x7ff1400b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.924+0000 7ff146e10640 1 --2- 172.21.15.77:0/2816608247 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1400b64c0 0x7ff1400b3cd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff12c0098a0 tx=0x7ff12c02b980 comp rx=0 tx=0).stop 2023-11-04T01:40:50.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.924+0000 7ff146e10640 1 -- 172.21.15.77:0/2816608247 shutdown_connections 2023-11-04T01:40:50.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.924+0000 7ff146e10640 1 --2- 172.21.15.77:0/2816608247 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1400b64c0 0x7ff1400b3cd0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.924+0000 7ff146e10640 1 --2- 172.21.15.77:0/2816608247 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff1400cd3b0 0x7ff1400cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.924+0000 7ff146e10640 1 -- 172.21.15.77:0/2816608247 >> 172.21.15.77:0/2816608247 conn(0x7ff14006ea20 msgr2=0x7ff14006ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:50.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.924+0000 7ff146e10640 1 -- 172.21.15.77:0/2816608247 shutdown_connections 2023-11-04T01:40:50.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.924+0000 7ff146e10640 1 -- 172.21.15.77:0/2816608247 wait complete. 2023-11-04T01:40:50.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.925+0000 7ff146e10640 1 Processor -- start 2023-11-04T01:40:50.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.925+0000 7ff146e10640 1 -- start start 2023-11-04T01:40:50.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.926+0000 7ff146e10640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1400b64c0 0x7ff140152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.926+0000 7ff146e10640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1400cd3b0 0x7ff1401551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.926+0000 7ff146e10640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff14015af20 0x7ff1400b4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.926+0000 7ff146e10640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1401556f0 con 0x7ff1400b64c0 2023-11-04T01:40:50.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.926+0000 7ff146e10640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff140153120 con 0x7ff1400cd3b0 2023-11-04T01:40:50.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.926+0000 7ff146e10640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff140153400 con 0x7ff14015af20 2023-11-04T01:40:50.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.926+0000 7ff144bac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1400b64c0 0x7ff140152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.926+0000 7ff144bac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1400b64c0 0x7ff140152a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49116/0 (socket says 172.21.15.77:49116) 2023-11-04T01:40:50.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.926+0000 7ff144bac640 1 -- 172.21.15.77:0/3136211078 learned_addr learned my addr 172.21.15.77:0/3136211078 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:50.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.927+0000 7ff144bac640 1 -- 172.21.15.77:0/3136211078 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff14015af20 msgr2=0x7ff1400b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.927+0000 7ff144bac640 1 --2- 172.21.15.77:0/3136211078 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff14015af20 0x7ff1400b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.927+0000 7ff13ffff640 1 --2- 172.21.15.77:0/3136211078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1400cd3b0 0x7ff1401551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.927+0000 7ff144bac640 1 -- 172.21.15.77:0/3136211078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1400cd3b0 msgr2=0x7ff1401551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:50.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.927+0000 7ff144bac640 1 --2- 172.21.15.77:0/3136211078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1400cd3b0 0x7ff1401551b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:50.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.927+0000 7ff144bac640 1 -- 172.21.15.77:0/3136211078 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff12c0094d0 con 0x7ff1400b64c0 2023-11-04T01:40:50.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.927+0000 7ff144bac640 1 --2- 172.21.15.77:0/3136211078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1400b64c0 0x7ff140152a20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff13400c3b0 tx=0x7ff13400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.927+0000 7ff13d7fa640 1 -- 172.21.15.77:0/3136211078 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1340074e0 con 0x7ff1400b64c0 2023-11-04T01:40:50.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.927+0000 7ff13d7fa640 1 -- 172.21.15.77:0/3136211078 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff134007640 con 0x7ff1400b64c0 2023-11-04T01:40:50.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.927+0000 7ff13d7fa640 1 -- 172.21.15.77:0/3136211078 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff134004a20 con 0x7ff1400b64c0 2023-11-04T01:40:50.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.927+0000 7ff146e10640 1 -- 172.21.15.77:0/3136211078 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1401536e0 con 0x7ff1400b64c0 2023-11-04T01:40:50.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.927+0000 7ff146e10640 1 -- 172.21.15.77:0/3136211078 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff140153ca0 con 0x7ff1400b64c0 2023-11-04T01:40:50.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.928+0000 7ff146e10640 1 -- 172.21.15.77:0/3136211078 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff140153e90 con 0x7ff1400b64c0 2023-11-04T01:40:50.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.928+0000 7ff13d7fa640 1 -- 172.21.15.77:0/3136211078 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff134004b80 con 0x7ff1400b64c0 2023-11-04T01:40:50.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.929+0000 7ff13d7fa640 1 --2- 172.21.15.77:0/3136211078 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff12406ae70 0x7ff12406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:50.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.929+0000 7ff13d7fa640 1 -- 172.21.15.77:0/3136211078 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff134089810 con 0x7ff1400b64c0 2023-11-04T01:40:50.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.929+0000 7ff13ffff640 1 --2- 172.21.15.77:0/3136211078 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff12406ae70 0x7ff12406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:50.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.929+0000 7ff13ffff640 1 --2- 172.21.15.77:0/3136211078 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff12406ae70 0x7ff12406d330 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff12c036000 tx=0x7ff12c03b040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:50.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:50.933+0000 7ff13d7fa640 1 -- 172.21.15.77:0/3136211078 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff134054500 con 0x7ff1400b64c0 2023-11-04T01:40:51.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.098+0000 7ff146e10640 1 -- 172.21.15.77:0/3136211078 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff14014c660 con 0x7ff1400b64c0 2023-11-04T01:40:51.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.099+0000 7ff13d7fa640 1 -- 172.21.15.77:0/3136211078 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff134057b20 con 0x7ff1400b64c0 2023-11-04T01:40:51.102 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:40:51.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.101+0000 7ff146e10640 1 -- 172.21.15.77:0/3136211078 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff12406ae70 msgr2=0x7ff12406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.101+0000 7ff146e10640 1 --2- 172.21.15.77:0/3136211078 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff12406ae70 0x7ff12406d330 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff12c036000 tx=0x7ff12c03b040 comp rx=0 tx=0).stop 2023-11-04T01:40:51.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.101+0000 7ff146e10640 1 -- 172.21.15.77:0/3136211078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1400b64c0 msgr2=0x7ff140152a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.101+0000 7ff146e10640 1 --2- 172.21.15.77:0/3136211078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1400b64c0 0x7ff140152a20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff13400c3b0 tx=0x7ff13400c870 comp rx=0 tx=0).stop 2023-11-04T01:40:51.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.101+0000 7ff146e10640 1 -- 172.21.15.77:0/3136211078 shutdown_connections 2023-11-04T01:40:51.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.101+0000 7ff146e10640 1 --2- 172.21.15.77:0/3136211078 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff12406ae70 0x7ff12406d330 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.101+0000 7ff146e10640 1 --2- 172.21.15.77:0/3136211078 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff14015af20 0x7ff1400b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.101+0000 7ff146e10640 1 --2- 172.21.15.77:0/3136211078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1400cd3b0 0x7ff1401551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.101+0000 7ff146e10640 1 --2- 172.21.15.77:0/3136211078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1400b64c0 0x7ff140152a20 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.101+0000 7ff146e10640 1 -- 172.21.15.77:0/3136211078 >> 172.21.15.77:0/3136211078 conn(0x7ff14006ea20 msgr2=0x7ff1400cb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:51.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.101+0000 7ff146e10640 1 -- 172.21.15.77:0/3136211078 shutdown_connections 2023-11-04T01:40:51.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.101+0000 7ff146e10640 1 -- 172.21.15.77:0/3136211078 wait complete. 2023-11-04T01:40:51.119 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:40:51.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.218+0000 7f91722da640 1 Processor -- start 2023-11-04T01:40:51.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.218+0000 7f91722da640 1 -- start start 2023-11-04T01:40:51.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.219+0000 7f91722da640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f916c153850 0x7f916c15a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.219+0000 7f91722da640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f916c0cc9d0 0x7f916c0c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.219+0000 7f91722da640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f916c0c3860 con 0x7f916c0cc520 2023-11-04T01:40:51.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.219+0000 7f91722da640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f916c0c9250 con 0x7f916c0cc9d0 2023-11-04T01:40:51.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.219+0000 7f91722da640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f916c153c30 con 0x7f916c153850 2023-11-04T01:40:51.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.219+0000 7f9170877640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f916c0cc9d0 0x7f916c0c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.219+0000 7f9170877640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f916c0cc9d0 0x7f916c0c3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49130/0 (socket says 172.21.15.77:49130) 2023-11-04T01:40:51.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.219+0000 7f9170877640 1 -- 172.21.15.77:0/703075846 learned_addr learned my addr 172.21.15.77:0/703075846 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:51.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.219+0000 7f916bfff640 1 --2- 172.21.15.77:0/703075846 >> v2:172.21.15.122:3300/0 conn(0x7f916c153850 0x7f916c15a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.219+0000 7f9170877640 1 -- 172.21.15.77:0/703075846 >> v2:172.21.15.122:3300/0 conn(0x7f916c153850 msgr2=0x7f916c15a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:51.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.219+0000 7f9170877640 1 --2- 172.21.15.77:0/703075846 >> v2:172.21.15.122:3300/0 conn(0x7f916c153850 0x7f916c15a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.219+0000 7f9170877640 1 -- 172.21.15.77:0/703075846 >> v1:172.21.15.122:6789/0 conn(0x7f916c0cc520 legacy=0x7f916c070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.220+0000 7f9170877640 1 -- 172.21.15.77:0/703075846 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f916c15a700 con 0x7f916c0cc9d0 2023-11-04T01:40:51.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.220+0000 7f916bfff640 1 --2- 172.21.15.77:0/703075846 >> v2:172.21.15.122:3300/0 conn(0x7f916c153850 0x7f916c15a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:51.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.220+0000 7f9170877640 1 --2- 172.21.15.77:0/703075846 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f916c0cc9d0 0x7f916c0c3cf0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f916c0c5710 tx=0x7f916402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb7ee2768093dd73 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:51.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.220+0000 7f916affd640 1 -- 172.21.15.77:0/703075846 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916402cb20 con 0x7f916c0cc9d0 2023-11-04T01:40:51.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.220+0000 7f916affd640 1 -- 172.21.15.77:0/703075846 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916402cc80 con 0x7f916c0cc9d0 2023-11-04T01:40:51.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.220+0000 7f916affd640 1 -- 172.21.15.77:0/703075846 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91640343f0 con 0x7f916c0cc9d0 2023-11-04T01:40:51.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.221+0000 7f91722da640 1 -- 172.21.15.77:0/703075846 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f916c0cc9d0 msgr2=0x7f916c0c3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.221+0000 7f91722da640 1 --2- 172.21.15.77:0/703075846 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f916c0cc9d0 0x7f916c0c3cf0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f916c0c5710 tx=0x7f916402bf80 comp rx=0 tx=0).stop 2023-11-04T01:40:51.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.221+0000 7f91722da640 1 -- 172.21.15.77:0/703075846 shutdown_connections 2023-11-04T01:40:51.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.221+0000 7f91722da640 1 --2- 172.21.15.77:0/703075846 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f916c0cc9d0 0x7f916c0c3cf0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.221+0000 7f91722da640 1 --2- 172.21.15.77:0/703075846 >> v2:172.21.15.122:3300/0 conn(0x7f916c153850 0x7f916c15a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.221+0000 7f91722da640 1 -- 172.21.15.77:0/703075846 >> 172.21.15.77:0/703075846 conn(0x7f916c0ce950 msgr2=0x7f916c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:51.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.221+0000 7f91722da640 1 -- 172.21.15.77:0/703075846 shutdown_connections 2023-11-04T01:40:51.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.221+0000 7f91722da640 1 -- 172.21.15.77:0/703075846 wait complete. 2023-11-04T01:40:51.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.222+0000 7f91722da640 1 Processor -- start 2023-11-04T01:40:51.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.222+0000 7f91722da640 1 -- start start 2023-11-04T01:40:51.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.223+0000 7f91722da640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f916c0cc520 0x7f916c14d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.223+0000 7f91722da640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f916c0cc9d0 0x7f916c15b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.223+0000 7f91722da640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f916c153850 0x7f916c15b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.223+0000 7f91722da640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916c151280 con 0x7f916c153850 2023-11-04T01:40:51.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.223+0000 7f91722da640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916c14e600 con 0x7f916c0cc9d0 2023-11-04T01:40:51.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.223+0000 7f91722da640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f916c14ea20 con 0x7f916c0cc520 2023-11-04T01:40:51.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.223+0000 7f9170877640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f916c153850 0x7f916c15b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.223+0000 7f9170877640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f916c153850 0x7f916c15b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49136/0 (socket says 172.21.15.77:49136) 2023-11-04T01:40:51.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.223+0000 7f9170877640 1 -- 172.21.15.77:0/1877542791 learned_addr learned my addr 172.21.15.77:0/1877542791 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:51.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.223+0000 7f916b7fe640 1 --2- 172.21.15.77:0/1877542791 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f916c0cc9d0 0x7f916c15b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.223+0000 7f916bfff640 1 --2- 172.21.15.77:0/1877542791 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f916c0cc520 0x7f916c14d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.224+0000 7f9170877640 1 -- 172.21.15.77:0/1877542791 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f916c0cc520 msgr2=0x7f916c14d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.224+0000 7f9170877640 1 --2- 172.21.15.77:0/1877542791 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f916c0cc520 0x7f916c14d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.224+0000 7f9170877640 1 -- 172.21.15.77:0/1877542791 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f916c0cc9d0 msgr2=0x7f916c15b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.224+0000 7f9170877640 1 --2- 172.21.15.77:0/1877542791 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f916c0cc9d0 0x7f916c15b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.224+0000 7f9170877640 1 -- 172.21.15.77:0/1877542791 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9164009b30 con 0x7f916c153850 2023-11-04T01:40:51.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.224+0000 7f9170877640 1 --2- 172.21.15.77:0/1877542791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f916c153850 0x7f916c15b560 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f916402c590 tx=0x7f9164004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:51.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.224+0000 7f9168ff9640 1 -- 172.21.15.77:0/1877542791 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9164009510 con 0x7f916c153850 2023-11-04T01:40:51.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.224+0000 7f9168ff9640 1 -- 172.21.15.77:0/1877542791 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916403e450 con 0x7f916c153850 2023-11-04T01:40:51.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.224+0000 7f91722da640 1 -- 172.21.15.77:0/1877542791 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f916c14d6a0 con 0x7f916c153850 2023-11-04T01:40:51.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.224+0000 7f9168ff9640 1 -- 172.21.15.77:0/1877542791 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916403e800 con 0x7f916c153850 2023-11-04T01:40:51.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.224+0000 7f91722da640 1 -- 172.21.15.77:0/1877542791 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f916c14dc60 con 0x7f916c153850 2023-11-04T01:40:51.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.225+0000 7f91722da640 1 -- 172.21.15.77:0/1877542791 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f916c14e740 con 0x7f916c153850 2023-11-04T01:40:51.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.225+0000 7f9168ff9640 1 -- 172.21.15.77:0/1877542791 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f916403e960 con 0x7f916c153850 2023-11-04T01:40:51.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.226+0000 7f9168ff9640 1 --2- 172.21.15.77:0/1877542791 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f915806aea0 0x7f915806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.226+0000 7f9168ff9640 1 -- 172.21.15.77:0/1877542791 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f91640ac330 con 0x7f916c153850 2023-11-04T01:40:51.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.226+0000 7f916bfff640 1 --2- 172.21.15.77:0/1877542791 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f915806aea0 0x7f915806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.226+0000 7f916bfff640 1 --2- 172.21.15.77:0/1877542791 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f915806aea0 0x7f915806d360 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f915c006e80 tx=0x7f915c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:51.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.230+0000 7f9168ff9640 1 -- 172.21.15.77:0/1877542791 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f916c14e740 con 0x7f916c153850 2023-11-04T01:40:51.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.396+0000 7f91722da640 1 -- 172.21.15.77:0/1877542791 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f916c14e740 con 0x7f916c153850 2023-11-04T01:40:51.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.397+0000 7f9168ff9640 1 -- 172.21.15.77:0/1877542791 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f916c14e740 con 0x7f916c153850 2023-11-04T01:40:51.400 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:40:51.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.398+0000 7f91722da640 1 -- 172.21.15.77:0/1877542791 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f915806aea0 msgr2=0x7f915806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.398+0000 7f91722da640 1 --2- 172.21.15.77:0/1877542791 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f915806aea0 0x7f915806d360 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f915c006e80 tx=0x7f915c008040 comp rx=0 tx=0).stop 2023-11-04T01:40:51.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.398+0000 7f91722da640 1 -- 172.21.15.77:0/1877542791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f916c153850 msgr2=0x7f916c15b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.398+0000 7f91722da640 1 --2- 172.21.15.77:0/1877542791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f916c153850 0x7f916c15b560 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f916402c590 tx=0x7f9164004a40 comp rx=0 tx=0).stop 2023-11-04T01:40:51.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.398+0000 7f91722da640 1 -- 172.21.15.77:0/1877542791 shutdown_connections 2023-11-04T01:40:51.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.398+0000 7f91722da640 1 --2- 172.21.15.77:0/1877542791 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f915806aea0 0x7f915806d360 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.398+0000 7f91722da640 1 --2- 172.21.15.77:0/1877542791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f916c153850 0x7f916c15b560 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.398+0000 7f91722da640 1 --2- 172.21.15.77:0/1877542791 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f916c0cc9d0 0x7f916c15b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.398+0000 7f91722da640 1 --2- 172.21.15.77:0/1877542791 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f916c0cc520 0x7f916c14d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.398+0000 7f91722da640 1 -- 172.21.15.77:0/1877542791 >> 172.21.15.77:0/1877542791 conn(0x7f916c0ce950 msgr2=0x7f916c071340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:51.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.398+0000 7f91722da640 1 -- 172.21.15.77:0/1877542791 shutdown_connections 2023-11-04T01:40:51.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.398+0000 7f91722da640 1 -- 172.21.15.77:0/1877542791 wait complete. 2023-11-04T01:40:51.412 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:40:51.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.511+0000 7f5031fd7640 1 Processor -- start 2023-11-04T01:40:51.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.511+0000 7f5031fd7640 1 -- start start 2023-11-04T01:40:51.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.512+0000 7f5031fd7640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f502c153850 0x7f502c15a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.512+0000 7f5031fd7640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f502c0cc9d0 0x7f502c0c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.512+0000 7f5031fd7640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f502c0c3860 con 0x7f502c0cc520 2023-11-04T01:40:51.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.512+0000 7f5031fd7640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f502c0c9250 con 0x7f502c153850 2023-11-04T01:40:51.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.512+0000 7f5031fd7640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502c153c30 con 0x7f502c0cc9d0 2023-11-04T01:40:51.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.512+0000 7f502b7fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f502c153850 0x7f502c15a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.512+0000 7f502affd640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f502c0cc520 0x7f502c070fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:43660/0 (socket says 172.21.15.77:43660) 2023-11-04T01:40:51.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.512+0000 7f502bfff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f502c0cc9d0 0x7f502c0c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.512+0000 7f502affd640 1 -- 172.21.15.77:0/2688556308 learned_addr learned my addr 172.21.15.77:0/2688556308 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:51.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.512+0000 7f502b7fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f502c153850 0x7f502c15a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:45252/0 (socket says 172.21.15.77:45252) 2023-11-04T01:40:51.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.513+0000 7f502b7fe640 1 -- 172.21.15.77:0/2688556308 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f502c0cc9d0 msgr2=0x7f502c0c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:51.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.513+0000 7f502b7fe640 1 --2- 172.21.15.77:0/2688556308 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f502c0cc9d0 0x7f502c0c3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.513+0000 7f502b7fe640 1 -- 172.21.15.77:0/2688556308 >> v1:172.21.15.122:6789/0 conn(0x7f502c0cc520 legacy=0x7f502c070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.513+0000 7f502b7fe640 1 -- 172.21.15.77:0/2688556308 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502c15a700 con 0x7f502c153850 2023-11-04T01:40:51.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.513+0000 7f502b7fe640 1 --2- 172.21.15.77:0/2688556308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f502c153850 0x7f502c15a1c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f501c0097a0 tx=0x7f501c02c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb5ff63524be0de4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:51.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.514+0000 7f502a7fc640 1 -- 172.21.15.77:0/2688556308 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c030800 con 0x7f502c153850 2023-11-04T01:40:51.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.514+0000 7f502a7fc640 1 -- 172.21.15.77:0/2688556308 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501c030960 con 0x7f502c153850 2023-11-04T01:40:51.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.514+0000 7f502a7fc640 1 -- 172.21.15.77:0/2688556308 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c030cf0 con 0x7f502c153850 2023-11-04T01:40:51.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.514+0000 7f5031fd7640 1 -- 172.21.15.77:0/2688556308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f502c153850 msgr2=0x7f502c15a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.514+0000 7f5031fd7640 1 --2- 172.21.15.77:0/2688556308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f502c153850 0x7f502c15a1c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f501c0097a0 tx=0x7f501c02c9e0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.514+0000 7f5031fd7640 1 -- 172.21.15.77:0/2688556308 shutdown_connections 2023-11-04T01:40:51.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.514+0000 7f5031fd7640 1 --2- 172.21.15.77:0/2688556308 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f502c0cc9d0 0x7f502c0c3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.514+0000 7f5031fd7640 1 --2- 172.21.15.77:0/2688556308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f502c153850 0x7f502c15a1c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.514+0000 7f5031fd7640 1 -- 172.21.15.77:0/2688556308 >> 172.21.15.77:0/2688556308 conn(0x7f502c0ce950 msgr2=0x7f502c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:51.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.514+0000 7f5031fd7640 1 -- 172.21.15.77:0/2688556308 shutdown_connections 2023-11-04T01:40:51.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.514+0000 7f5031fd7640 1 -- 172.21.15.77:0/2688556308 wait complete. 2023-11-04T01:40:51.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.515+0000 7f5031fd7640 1 Processor -- start 2023-11-04T01:40:51.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.515+0000 7f5031fd7640 1 -- start start 2023-11-04T01:40:51.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.516+0000 7f5031fd7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f502c0cc520 0x7f502c14cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.516+0000 7f5031fd7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f502c0cc9d0 0x7f502c1f24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.516+0000 7f5031fd7640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f502c153850 0x7f502c0cce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.516+0000 7f5031fd7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502c0c8930 con 0x7f502c0cc9d0 2023-11-04T01:40:51.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.516+0000 7f5031fd7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502c14d320 con 0x7f502c0cc520 2023-11-04T01:40:51.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.516+0000 7f5031fd7640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502c0c6180 con 0x7f502c153850 2023-11-04T01:40:51.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.516+0000 7f502affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f502c0cc9d0 0x7f502c1f24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.516+0000 7f502affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f502c0cc9d0 0x7f502c1f24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49140/0 (socket says 172.21.15.77:49140) 2023-11-04T01:40:51.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.516+0000 7f502affd640 1 -- 172.21.15.77:0/1382158551 learned_addr learned my addr 172.21.15.77:0/1382158551 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:51.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.516+0000 7f502bfff640 1 --2- 172.21.15.77:0/1382158551 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f502c153850 0x7f502c0cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.516+0000 7f502b7fe640 1 --2- 172.21.15.77:0/1382158551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f502c0cc520 0x7f502c14cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.517+0000 7f502affd640 1 -- 172.21.15.77:0/1382158551 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f502c153850 msgr2=0x7f502c0cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.517+0000 7f502affd640 1 --2- 172.21.15.77:0/1382158551 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f502c153850 0x7f502c0cce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.517+0000 7f502affd640 1 -- 172.21.15.77:0/1382158551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f502c0cc520 msgr2=0x7f502c14cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.517+0000 7f502affd640 1 --2- 172.21.15.77:0/1382158551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f502c0cc520 0x7f502c14cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.517+0000 7f502affd640 1 -- 172.21.15.77:0/1382158551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f501c009400 con 0x7f502c0cc9d0 2023-11-04T01:40:51.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.517+0000 7f502affd640 1 --2- 172.21.15.77:0/1382158551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f502c0cc9d0 0x7f502c1f24b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f502000c4d0 tx=0x7f502000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:51.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.517+0000 7f5013fff640 1 -- 172.21.15.77:0/1382158551 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5020005ce0 con 0x7f502c0cc9d0 2023-11-04T01:40:51.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.517+0000 7f5013fff640 1 -- 172.21.15.77:0/1382158551 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5020005e40 con 0x7f502c0cc9d0 2023-11-04T01:40:51.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.517+0000 7f5013fff640 1 -- 172.21.15.77:0/1382158551 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5020007270 con 0x7f502c0cc9d0 2023-11-04T01:40:51.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.517+0000 7f5031fd7640 1 -- 172.21.15.77:0/1382158551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f502c0c6460 con 0x7f502c0cc9d0 2023-11-04T01:40:51.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.517+0000 7f5031fd7640 1 -- 172.21.15.77:0/1382158551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f502c1f1cb0 con 0x7f502c0cc9d0 2023-11-04T01:40:51.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.518+0000 7f5031fd7640 1 -- 172.21.15.77:0/1382158551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f502c074290 con 0x7f502c0cc9d0 2023-11-04T01:40:51.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.518+0000 7f5013fff640 1 -- 172.21.15.77:0/1382158551 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f50200073d0 con 0x7f502c0cc9d0 2023-11-04T01:40:51.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.519+0000 7f5013fff640 1 --2- 172.21.15.77:0/1382158551 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f501806ae70 0x7f501806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.519+0000 7f5013fff640 1 -- 172.21.15.77:0/1382158551 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5020088e40 con 0x7f502c0cc9d0 2023-11-04T01:40:51.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.519+0000 7f502b7fe640 1 --2- 172.21.15.77:0/1382158551 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f501806ae70 0x7f501806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.519+0000 7f502b7fe640 1 --2- 172.21.15.77:0/1382158551 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f501806ae70 0x7f501806d330 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f501c037000 tx=0x7f501c03a040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:51.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.523+0000 7f5013fff640 1 -- 172.21.15.77:0/1382158551 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5020053b60 con 0x7f502c0cc9d0 2023-11-04T01:40:51.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.689+0000 7f5031fd7640 1 -- 172.21.15.77:0/1382158551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f502c0c5010 con 0x7f502c0cc9d0 2023-11-04T01:40:51.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.689+0000 7f5013fff640 1 -- 172.21.15.77:0/1382158551 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5020057180 con 0x7f502c0cc9d0 2023-11-04T01:40:51.693 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-04T01:40:51.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.691+0000 7f5031fd7640 1 -- 172.21.15.77:0/1382158551 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f501806ae70 msgr2=0x7f501806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.691+0000 7f5031fd7640 1 --2- 172.21.15.77:0/1382158551 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f501806ae70 0x7f501806d330 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f501c037000 tx=0x7f501c03a040 comp rx=0 tx=0).stop 2023-11-04T01:40:51.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.691+0000 7f5031fd7640 1 -- 172.21.15.77:0/1382158551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f502c0cc9d0 msgr2=0x7f502c1f24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.691+0000 7f5031fd7640 1 --2- 172.21.15.77:0/1382158551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f502c0cc9d0 0x7f502c1f24b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f502000c4d0 tx=0x7f502000c990 comp rx=0 tx=0).stop 2023-11-04T01:40:51.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.691+0000 7f5031fd7640 1 -- 172.21.15.77:0/1382158551 shutdown_connections 2023-11-04T01:40:51.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.691+0000 7f5031fd7640 1 --2- 172.21.15.77:0/1382158551 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f501806ae70 0x7f501806d330 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.691+0000 7f5031fd7640 1 --2- 172.21.15.77:0/1382158551 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f502c153850 0x7f502c0cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.691+0000 7f5031fd7640 1 --2- 172.21.15.77:0/1382158551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f502c0cc9d0 0x7f502c1f24b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.691+0000 7f5031fd7640 1 --2- 172.21.15.77:0/1382158551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f502c0cc520 0x7f502c14cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.691+0000 7f5031fd7640 1 -- 172.21.15.77:0/1382158551 >> 172.21.15.77:0/1382158551 conn(0x7f502c0ce950 msgr2=0x7f502c152910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:51.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.691+0000 7f5031fd7640 1 -- 172.21.15.77:0/1382158551 shutdown_connections 2023-11-04T01:40:51.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.691+0000 7f5031fd7640 1 -- 172.21.15.77:0/1382158551 wait complete. 2023-11-04T01:40:51.705 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:40:51.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.804+0000 7f865110c640 1 Processor -- start 2023-11-04T01:40:51.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.804+0000 7f865110c640 1 -- start start 2023-11-04T01:40:51.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.805+0000 7f865110c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f864c160430 0x7f864c0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.805+0000 7f865110c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f864c06c3a0 0x7f864c0cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.805+0000 7f865110c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f864c0b2fc0 con 0x7f864c0b2b60 2023-11-04T01:40:51.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.805+0000 7f865110c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f864c0cb580 con 0x7f864c06c3a0 2023-11-04T01:40:51.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.805+0000 7f865110c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864c06ca40 con 0x7f864c160430 2023-11-04T01:40:51.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.805+0000 7f864b59e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f864c06c3a0 0x7f864c0cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.805+0000 7f864b59e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f864c06c3a0 0x7f864c0cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49148/0 (socket says 172.21.15.77:49148) 2023-11-04T01:40:51.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.805+0000 7f864b59e640 1 -- 172.21.15.77:0/1116485812 learned_addr learned my addr 172.21.15.77:0/1116485812 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:51.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.805+0000 7f864a59c640 1 --1- 172.21.15.77:0/1116485812 >> v1:172.21.15.77:6789/0 conn(0x7f864c0b2b60 0x7f864c06bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36572/0 (socket says 172.21.15.77:36572) 2023-11-04T01:40:51.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.805+0000 7f864ad9d640 1 --2- 172.21.15.77:0/1116485812 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f864c160430 0x7f864c0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.805+0000 7f864b59e640 1 -- 172.21.15.77:0/1116485812 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f864c160430 msgr2=0x7f864c0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:51.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.805+0000 7f864b59e640 1 --2- 172.21.15.77:0/1116485812 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f864c160430 0x7f864c0b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.805+0000 7f864b59e640 1 -- 172.21.15.77:0/1116485812 >> v1:172.21.15.77:6789/0 conn(0x7f864c0b2b60 legacy=0x7f864c06bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.805+0000 7f864b59e640 1 -- 172.21.15.77:0/1116485812 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864c06c810 con 0x7f864c06c3a0 2023-11-04T01:40:51.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.805+0000 7f8649d9b640 1 -- 172.21.15.77:0/1116485812 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 183436951 0 0) 0x7f864c0b2fc0 con 0x7f864c0b2b60 2023-11-04T01:40:51.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.806+0000 7f864b59e640 1 --2- 172.21.15.77:0/1116485812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f864c06c3a0 0x7f864c0cbcb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8644009870 tx=0x7f864402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47aeb82d20c19422 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:51.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.806+0000 7f8649d9b640 1 -- 172.21.15.77:0/1116485812 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8644030840 con 0x7f864c06c3a0 2023-11-04T01:40:51.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.806+0000 7f8649d9b640 1 -- 172.21.15.77:0/1116485812 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86440309a0 con 0x7f864c06c3a0 2023-11-04T01:40:51.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.806+0000 7f8649d9b640 1 -- 172.21.15.77:0/1116485812 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8644030d30 con 0x7f864c06c3a0 2023-11-04T01:40:51.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.807+0000 7f865110c640 1 -- 172.21.15.77:0/1116485812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f864c06c3a0 msgr2=0x7f864c0cbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.807+0000 7f865110c640 1 --2- 172.21.15.77:0/1116485812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f864c06c3a0 0x7f864c0cbcb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8644009870 tx=0x7f864402b980 comp rx=0 tx=0).stop 2023-11-04T01:40:51.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.807+0000 7f865110c640 1 -- 172.21.15.77:0/1116485812 shutdown_connections 2023-11-04T01:40:51.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.807+0000 7f865110c640 1 --2- 172.21.15.77:0/1116485812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f864c06c3a0 0x7f864c0cbcb0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.807+0000 7f865110c640 1 --2- 172.21.15.77:0/1116485812 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f864c160430 0x7f864c0b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.807+0000 7f865110c640 1 -- 172.21.15.77:0/1116485812 >> 172.21.15.77:0/1116485812 conn(0x7f864c06ea20 msgr2=0x7f864c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:51.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.807+0000 7f865110c640 1 -- 172.21.15.77:0/1116485812 shutdown_connections 2023-11-04T01:40:51.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.807+0000 7f865110c640 1 -- 172.21.15.77:0/1116485812 wait complete. 2023-11-04T01:40:51.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.808+0000 7f865110c640 1 Processor -- start 2023-11-04T01:40:51.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.808+0000 7f865110c640 1 -- start start 2023-11-04T01:40:51.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.809+0000 7f865110c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f864c06c3a0 0x7f864c0cce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.809+0000 7f865110c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f864c0b2b60 0x7f864c0b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.809+0000 7f865110c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f864c160430 0x7f864c0b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.809+0000 7f865110c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864c1f2970 con 0x7f864c0b2b60 2023-11-04T01:40:51.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.809+0000 7f865110c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864c1f37c0 con 0x7f864c160430 2023-11-04T01:40:51.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.809+0000 7f865110c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864c1f2bb0 con 0x7f864c06c3a0 2023-11-04T01:40:51.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.809+0000 7f864a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f864c0b2b60 0x7f864c0b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.809+0000 7f864a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f864c0b2b60 0x7f864c0b48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49156/0 (socket says 172.21.15.77:49156) 2023-11-04T01:40:51.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.809+0000 7f864a59c640 1 -- 172.21.15.77:0/410669000 learned_addr learned my addr 172.21.15.77:0/410669000 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:51.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.809+0000 7f864b59e640 1 --2- 172.21.15.77:0/410669000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f864c160430 0x7f864c0b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.809+0000 7f864ad9d640 1 --2- 172.21.15.77:0/410669000 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f864c06c3a0 0x7f864c0cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.809+0000 7f864a59c640 1 -- 172.21.15.77:0/410669000 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f864c06c3a0 msgr2=0x7f864c0cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.809+0000 7f864a59c640 1 --2- 172.21.15.77:0/410669000 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f864c06c3a0 0x7f864c0cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.809+0000 7f864a59c640 1 -- 172.21.15.77:0/410669000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f864c160430 msgr2=0x7f864c0b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.809+0000 7f864a59c640 1 --2- 172.21.15.77:0/410669000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f864c160430 0x7f864c0b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.809+0000 7f864a59c640 1 -- 172.21.15.77:0/410669000 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86440094d0 con 0x7f864c0b2b60 2023-11-04T01:40:51.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.810+0000 7f864a59c640 1 --2- 172.21.15.77:0/410669000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f864c0b2b60 0x7f864c0b48a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f864000c4d0 tx=0x7f864000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:51.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.810+0000 7f86337fe640 1 -- 172.21.15.77:0/410669000 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86400074e0 con 0x7f864c0b2b60 2023-11-04T01:40:51.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.810+0000 7f86337fe640 1 -- 172.21.15.77:0/410669000 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8640007660 con 0x7f864c0b2b60 2023-11-04T01:40:51.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.810+0000 7f865110c640 1 -- 172.21.15.77:0/410669000 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f864c1f2e90 con 0x7f864c0b2b60 2023-11-04T01:40:51.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.810+0000 7f86337fe640 1 -- 172.21.15.77:0/410669000 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8640004a20 con 0x7f864c0b2b60 2023-11-04T01:40:51.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.810+0000 7f865110c640 1 -- 172.21.15.77:0/410669000 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f864c1f3450 con 0x7f864c0b2b60 2023-11-04T01:40:51.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.811+0000 7f865110c640 1 -- 172.21.15.77:0/410669000 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f864c074290 con 0x7f864c0b2b60 2023-11-04T01:40:51.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.811+0000 7f86337fe640 1 -- 172.21.15.77:0/410669000 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8640004b80 con 0x7f864c0b2b60 2023-11-04T01:40:51.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.812+0000 7f86337fe640 1 --2- 172.21.15.77:0/410669000 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f863806ae70 0x7f863806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:51.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.812+0000 7f86337fe640 1 -- 172.21.15.77:0/410669000 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8640088eb0 con 0x7f864c0b2b60 2023-11-04T01:40:51.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.812+0000 7f864ad9d640 1 --2- 172.21.15.77:0/410669000 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f863806ae70 0x7f863806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:51.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.812+0000 7f864ad9d640 1 --2- 172.21.15.77:0/410669000 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f863806ae70 0x7f863806d330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f864c0cd930 tx=0x7f863c0039b0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:51.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.816+0000 7f86337fe640 1 -- 172.21.15.77:0/410669000 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8640053c30 con 0x7f864c0b2b60 2023-11-04T01:40:51.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.981+0000 7f865110c640 1 -- 172.21.15.77:0/410669000 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f864c1f3900 con 0x7f864c0b2b60 2023-11-04T01:40:51.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.981+0000 7f86337fe640 1 -- 172.21.15.77:0/410669000 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8640018020 con 0x7f864c0b2b60 2023-11-04T01:40:51.984 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:40:51.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.983+0000 7f865110c640 1 -- 172.21.15.77:0/410669000 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f863806ae70 msgr2=0x7f863806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.983+0000 7f865110c640 1 --2- 172.21.15.77:0/410669000 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f863806ae70 0x7f863806d330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f864c0cd930 tx=0x7f863c0039b0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.983+0000 7f865110c640 1 -- 172.21.15.77:0/410669000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f864c0b2b60 msgr2=0x7f864c0b48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:51.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.983+0000 7f865110c640 1 --2- 172.21.15.77:0/410669000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f864c0b2b60 0x7f864c0b48a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f864000c4d0 tx=0x7f864000c990 comp rx=0 tx=0).stop 2023-11-04T01:40:51.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.983+0000 7f865110c640 1 -- 172.21.15.77:0/410669000 shutdown_connections 2023-11-04T01:40:51.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.983+0000 7f865110c640 1 --2- 172.21.15.77:0/410669000 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f863806ae70 0x7f863806d330 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.983+0000 7f865110c640 1 --2- 172.21.15.77:0/410669000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f864c160430 0x7f864c0b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.983+0000 7f865110c640 1 --2- 172.21.15.77:0/410669000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f864c0b2b60 0x7f864c0b48a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.983+0000 7f865110c640 1 --2- 172.21.15.77:0/410669000 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f864c06c3a0 0x7f864c0cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:51.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.983+0000 7f865110c640 1 -- 172.21.15.77:0/410669000 >> 172.21.15.77:0/410669000 conn(0x7f864c06ea20 msgr2=0x7f864c0b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:51.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.983+0000 7f865110c640 1 -- 172.21.15.77:0/410669000 shutdown_connections 2023-11-04T01:40:51.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:51.983+0000 7f865110c640 1 -- 172.21.15.77:0/410669000 wait complete. 2023-11-04T01:40:52.009 INFO:tasks.cephfs_test_runner:Starting test: test_attaching_pools_with_snaps_to_fs_fails (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) Test that attempt to attach pool with snapshots to an fs fails 2023-11-04T01:40:52.010 INFO:tasks.cephfs_test_runner:test_attaching_pools_with_snaps_to_fs_fails (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) 2023-11-04T01:40:52.011 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:52.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.109+0000 7f194164f640 1 Processor -- start 2023-11-04T01:40:52.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.109+0000 7f194164f640 1 -- start start 2023-11-04T01:40:52.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.110+0000 7f194164f640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f193c15cfc0 0x7f193c0cc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:52.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.110+0000 7f194164f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f193c06cd50 0x7f193c0b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:52.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.110+0000 7f194164f640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f193c161730 0x7f193c0b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:52.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.110+0000 7f194164f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193c0c9a80 con 0x7f193c06cd50 2023-11-04T01:40:52.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.110+0000 7f194164f640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193c15d3a0 con 0x7f193c161730 2023-11-04T01:40:52.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.110+0000 7f194164f640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f193c0cd240 con 0x7f193c15cfc0 2023-11-04T01:40:52.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.110+0000 7f193a7fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f193c06cd50 0x7f193c0b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:52.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.110+0000 7f193a7fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f193c06cd50 0x7f193c0b07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49158/0 (socket says 172.21.15.77:49158) 2023-11-04T01:40:52.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.110+0000 7f193a7fc640 1 -- 172.21.15.77:0/2633899032 learned_addr learned my addr 172.21.15.77:0/2633899032 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:52.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.110+0000 7f193b7fe640 1 --2- 172.21.15.77:0/2633899032 >> v2:172.21.15.122:3300/0 conn(0x7f193c161730 0x7f193c0b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:52.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.110+0000 7f193affd640 1 --2- 172.21.15.77:0/2633899032 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f193c15cfc0 0x7f193c0cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:52.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.110+0000 7f193a7fc640 1 -- 172.21.15.77:0/2633899032 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f193c15cfc0 msgr2=0x7f193c0cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:52.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.110+0000 7f193a7fc640 1 --2- 172.21.15.77:0/2633899032 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f193c15cfc0 0x7f193c0cc940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.110+0000 7f193a7fc640 1 -- 172.21.15.77:0/2633899032 >> v2:172.21.15.122:3300/0 conn(0x7f193c161730 msgr2=0x7f193c0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:52.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.110+0000 7f193a7fc640 1 --2- 172.21.15.77:0/2633899032 >> v2:172.21.15.122:3300/0 conn(0x7f193c161730 0x7f193c0b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.110+0000 7f193a7fc640 1 -- 172.21.15.77:0/2633899032 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193c0cd520 con 0x7f193c06cd50 2023-11-04T01:40:52.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.110+0000 7f193b7fe640 1 --2- 172.21.15.77:0/2633899032 >> v2:172.21.15.122:3300/0 conn(0x7f193c161730 0x7f193c0b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:52.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.110+0000 7f193affd640 1 --2- 172.21.15.77:0/2633899032 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f193c15cfc0 0x7f193c0cc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:52.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.111+0000 7f193a7fc640 1 --2- 172.21.15.77:0/2633899032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f193c06cd50 0x7f193c0b07f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f193c0ced10 tx=0x7f193002b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42050d7bab5eaad server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:52.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.111+0000 7f1939ffb640 1 -- 172.21.15.77:0/2633899032 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19300317d0 con 0x7f193c06cd50 2023-11-04T01:40:52.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.111+0000 7f1939ffb640 1 -- 172.21.15.77:0/2633899032 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1930031930 con 0x7f193c06cd50 2023-11-04T01:40:52.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.111+0000 7f1939ffb640 1 -- 172.21.15.77:0/2633899032 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1930031cc0 con 0x7f193c06cd50 2023-11-04T01:40:52.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.112+0000 7f194164f640 1 -- 172.21.15.77:0/2633899032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f193c06cd50 msgr2=0x7f193c0b07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:52.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.112+0000 7f194164f640 1 --2- 172.21.15.77:0/2633899032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f193c06cd50 0x7f193c0b07f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f193c0ced10 tx=0x7f193002b870 comp rx=0 tx=0).stop 2023-11-04T01:40:52.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.112+0000 7f194164f640 1 -- 172.21.15.77:0/2633899032 shutdown_connections 2023-11-04T01:40:52.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.112+0000 7f194164f640 1 --2- 172.21.15.77:0/2633899032 >> v2:172.21.15.122:3300/0 conn(0x7f193c161730 0x7f193c0b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.112+0000 7f194164f640 1 --2- 172.21.15.77:0/2633899032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f193c06cd50 0x7f193c0b07f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.112+0000 7f194164f640 1 --2- 172.21.15.77:0/2633899032 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f193c15cfc0 0x7f193c0cc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.112+0000 7f194164f640 1 -- 172.21.15.77:0/2633899032 >> 172.21.15.77:0/2633899032 conn(0x7f193c0cb7f0 msgr2=0x7f193c0cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:52.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.112+0000 7f194164f640 1 -- 172.21.15.77:0/2633899032 shutdown_connections 2023-11-04T01:40:52.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.112+0000 7f194164f640 1 -- 172.21.15.77:0/2633899032 wait complete. 2023-11-04T01:40:52.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.113+0000 7f194164f640 1 Processor -- start 2023-11-04T01:40:52.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.113+0000 7f194164f640 1 -- start start 2023-11-04T01:40:52.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.114+0000 7f194164f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f193c06cd50 0x7f193c15fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:52.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.114+0000 7f194164f640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f193c15cfc0 0x7f193c0c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:52.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.114+0000 7f194164f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f193c161730 0x7f193c06d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:52.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.114+0000 7f194164f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c160410 con 0x7f193c161730 2023-11-04T01:40:52.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.114+0000 7f194164f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c1f6450 con 0x7f193c06cd50 2023-11-04T01:40:52.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.114+0000 7f194164f640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f193c1f6730 con 0x7f193c15cfc0 2023-11-04T01:40:52.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.114+0000 7f193b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f193c161730 0x7f193c06d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:52.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.114+0000 7f193b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f193c161730 0x7f193c06d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49164/0 (socket says 172.21.15.77:49164) 2023-11-04T01:40:52.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.114+0000 7f193b7fe640 1 -- 172.21.15.77:0/3085354542 learned_addr learned my addr 172.21.15.77:0/3085354542 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:52.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.114+0000 7f193a7fc640 1 --2- 172.21.15.77:0/3085354542 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f193c15cfc0 0x7f193c0c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:52.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.114+0000 7f193affd640 1 --2- 172.21.15.77:0/3085354542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f193c06cd50 0x7f193c15fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:52.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.114+0000 7f193b7fe640 1 -- 172.21.15.77:0/3085354542 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f193c15cfc0 msgr2=0x7f193c0c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:52.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.114+0000 7f193b7fe640 1 --2- 172.21.15.77:0/3085354542 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f193c15cfc0 0x7f193c0c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.114+0000 7f193b7fe640 1 -- 172.21.15.77:0/3085354542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f193c06cd50 msgr2=0x7f193c15fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:52.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.114+0000 7f193b7fe640 1 --2- 172.21.15.77:0/3085354542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f193c06cd50 0x7f193c15fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.114+0000 7f193b7fe640 1 -- 172.21.15.77:0/3085354542 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19300094d0 con 0x7f193c161730 2023-11-04T01:40:52.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.114+0000 7f193b7fe640 1 --2- 172.21.15.77:0/3085354542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f193c161730 0x7f193c06d3a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f193400c4f0 tx=0x7f193400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:52.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.115+0000 7f19237fe640 1 -- 172.21.15.77:0/3085354542 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1934004220 con 0x7f193c161730 2023-11-04T01:40:52.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.115+0000 7f19237fe640 1 -- 172.21.15.77:0/3085354542 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1934004380 con 0x7f193c161730 2023-11-04T01:40:52.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.115+0000 7f194164f640 1 -- 172.21.15.77:0/3085354542 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f193c1f6a10 con 0x7f193c161730 2023-11-04T01:40:52.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.115+0000 7f19237fe640 1 -- 172.21.15.77:0/3085354542 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1934003850 con 0x7f193c161730 2023-11-04T01:40:52.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.115+0000 7f194164f640 1 -- 172.21.15.77:0/3085354542 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f193c0afc50 con 0x7f193c161730 2023-11-04T01:40:52.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.116+0000 7f194164f640 1 -- 172.21.15.77:0/3085354542 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f193c074290 con 0x7f193c161730 2023-11-04T01:40:52.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.116+0000 7f19237fe640 1 -- 172.21.15.77:0/3085354542 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f19340039b0 con 0x7f193c161730 2023-11-04T01:40:52.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.116+0000 7f19237fe640 1 --2- 172.21.15.77:0/3085354542 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f192806ae70 0x7f192806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:52.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.116+0000 7f19237fe640 1 -- 172.21.15.77:0/3085354542 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1934089550 con 0x7f193c161730 2023-11-04T01:40:52.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.117+0000 7f193affd640 1 --2- 172.21.15.77:0/3085354542 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f192806ae70 0x7f192806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:52.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.117+0000 7f193affd640 1 --2- 172.21.15.77:0/3085354542 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f192806ae70 0x7f192806d330 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f193c0abc30 tx=0x7f192c0077c0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:52.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.120+0000 7f19237fe640 1 -- 172.21.15.77:0/3085354542 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f19340542f0 con 0x7f193c161730 2023-11-04T01:40:52.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.286+0000 7f194164f640 1 -- 172.21.15.77:0/3085354542 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f193c06e630 con 0x7f193c161730 2023-11-04T01:40:52.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.287+0000 7f19237fe640 1 -- 172.21.15.77:0/3085354542 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18661 (secure 0 0 0) 0x7f1934057910 con 0x7f193c161730 2023-11-04T01:40:52.290 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:52.291 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":26,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:40:47.579547+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:40:02.810971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:40:04.003979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:40:07.734355+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:52.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.289+0000 7f194164f640 1 -- 172.21.15.77:0/3085354542 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f192806ae70 msgr2=0x7f192806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:52.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.289+0000 7f194164f640 1 --2- 172.21.15.77:0/3085354542 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f192806ae70 0x7f192806d330 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f193c0abc30 tx=0x7f192c0077c0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.289+0000 7f194164f640 1 -- 172.21.15.77:0/3085354542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f193c161730 msgr2=0x7f193c06d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:52.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.289+0000 7f194164f640 1 --2- 172.21.15.77:0/3085354542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f193c161730 0x7f193c06d3a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f193400c4f0 tx=0x7f193400c9b0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.289+0000 7f194164f640 1 -- 172.21.15.77:0/3085354542 shutdown_connections 2023-11-04T01:40:52.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.289+0000 7f194164f640 1 --2- 172.21.15.77:0/3085354542 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f192806ae70 0x7f192806d330 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.289+0000 7f194164f640 1 --2- 172.21.15.77:0/3085354542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f193c161730 0x7f193c06d3a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.289+0000 7f194164f640 1 --2- 172.21.15.77:0/3085354542 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f193c15cfc0 0x7f193c0c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.289+0000 7f194164f640 1 --2- 172.21.15.77:0/3085354542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f193c06cd50 0x7f193c15fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.289+0000 7f194164f640 1 -- 172.21.15.77:0/3085354542 >> 172.21.15.77:0/3085354542 conn(0x7f193c0cb7f0 msgr2=0x7f193c0ac910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:52.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.289+0000 7f194164f640 1 -- 172.21.15.77:0/3085354542 shutdown_connections 2023-11-04T01:40:52.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.289+0000 7f194164f640 1 -- 172.21.15.77:0/3085354542 wait complete. 2023-11-04T01:40:52.303 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:40:02.810971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:40:04.003979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:40:07.734355+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:40:52.304 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:40:52.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.403+0000 7ff6109c9640 1 Processor -- start 2023-11-04T01:40:52.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.403+0000 7ff6109c9640 1 -- start start 2023-11-04T01:40:52.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.404+0000 7ff6109c9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff60c153850 0x7ff60c15a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:52.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.404+0000 7ff6109c9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff60c0cc520 0x7ff60c070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:52.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.404+0000 7ff6109c9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff60c0cc9a0 0x7ff60c0714e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:52.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.404+0000 7ff6109c9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff60c0c3860 con 0x7ff60c0cc9a0 2023-11-04T01:40:52.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.404+0000 7ff6109c9640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff60c0c9250 con 0x7ff60c0cc520 2023-11-04T01:40:52.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.404+0000 7ff6109c9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c153c30 con 0x7ff60c153850 2023-11-04T01:40:52.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.404+0000 7ff60ad9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff60c0cc9a0 0x7ff60c0714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:52.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.404+0000 7ff60ad9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff60c0cc9a0 0x7ff60c0714e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49176/0 (socket says 172.21.15.77:49176) 2023-11-04T01:40:52.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.404+0000 7ff60ad9d640 1 -- 172.21.15.77:0/4213509118 learned_addr learned my addr 172.21.15.77:0/4213509118 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:52.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.404+0000 7ff60a59c640 1 --2- 172.21.15.77:0/4213509118 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff60c153850 0x7ff60c15a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:52.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.404+0000 7ff609d9b640 1 --2- 172.21.15.77:0/4213509118 >> v2:172.21.15.122:3300/0 conn(0x7ff60c0cc520 0x7ff60c070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:52.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.404+0000 7ff60ad9d640 1 -- 172.21.15.77:0/4213509118 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff60c153850 msgr2=0x7ff60c15a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:52.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.405+0000 7ff60ad9d640 1 --2- 172.21.15.77:0/4213509118 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff60c153850 0x7ff60c15a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.405+0000 7ff60ad9d640 1 -- 172.21.15.77:0/4213509118 >> v2:172.21.15.122:3300/0 conn(0x7ff60c0cc520 msgr2=0x7ff60c070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:52.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.405+0000 7ff60ad9d640 1 --2- 172.21.15.77:0/4213509118 >> v2:172.21.15.122:3300/0 conn(0x7ff60c0cc520 0x7ff60c070fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.405+0000 7ff60ad9d640 1 -- 172.21.15.77:0/4213509118 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60c15a700 con 0x7ff60c0cc9a0 2023-11-04T01:40:52.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.405+0000 7ff609d9b640 1 --2- 172.21.15.77:0/4213509118 >> v2:172.21.15.122:3300/0 conn(0x7ff60c0cc520 0x7ff60c070fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:52.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.405+0000 7ff60ad9d640 1 --2- 172.21.15.77:0/4213509118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff60c0cc9a0 0x7ff60c0714e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff60c06bb00 tx=0x7ff60402cdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5edab2a254a2325e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:52.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.405+0000 7ff60959a640 1 -- 172.21.15.77:0/4213509118 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60402dba0 con 0x7ff60c0cc9a0 2023-11-04T01:40:52.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.405+0000 7ff60959a640 1 -- 172.21.15.77:0/4213509118 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60402dd00 con 0x7ff60c0cc9a0 2023-11-04T01:40:52.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.405+0000 7ff60959a640 1 -- 172.21.15.77:0/4213509118 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff604035660 con 0x7ff60c0cc9a0 2023-11-04T01:40:52.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.406+0000 7ff6109c9640 1 -- 172.21.15.77:0/4213509118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff60c0cc9a0 msgr2=0x7ff60c0714e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:52.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.406+0000 7ff6109c9640 1 --2- 172.21.15.77:0/4213509118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff60c0cc9a0 0x7ff60c0714e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff60c06bb00 tx=0x7ff60402cdf0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.406+0000 7ff6109c9640 1 -- 172.21.15.77:0/4213509118 shutdown_connections 2023-11-04T01:40:52.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.406+0000 7ff6109c9640 1 --2- 172.21.15.77:0/4213509118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff60c0cc9a0 0x7ff60c0714e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.406+0000 7ff6109c9640 1 --2- 172.21.15.77:0/4213509118 >> v2:172.21.15.122:3300/0 conn(0x7ff60c0cc520 0x7ff60c070fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.406+0000 7ff6109c9640 1 --2- 172.21.15.77:0/4213509118 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff60c153850 0x7ff60c15a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.406+0000 7ff6109c9640 1 -- 172.21.15.77:0/4213509118 >> 172.21.15.77:0/4213509118 conn(0x7ff60c0ce950 msgr2=0x7ff60c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:52.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.406+0000 7ff6109c9640 1 -- 172.21.15.77:0/4213509118 shutdown_connections 2023-11-04T01:40:52.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.406+0000 7ff6109c9640 1 -- 172.21.15.77:0/4213509118 wait complete. 2023-11-04T01:40:52.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.407+0000 7ff6109c9640 1 Processor -- start 2023-11-04T01:40:52.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.407+0000 7ff6109c9640 1 -- start start 2023-11-04T01:40:52.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.408+0000 7ff6109c9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff60c0cc520 0x7ff60c150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:52.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.408+0000 7ff6109c9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff60c0cc9a0 0x7ff60c0c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:52.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.408+0000 7ff6109c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff60c153850 0x7ff60c070610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:52.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.408+0000 7ff6109c9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c1507a0 con 0x7ff60c153850 2023-11-04T01:40:52.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.408+0000 7ff6109c9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c155910 con 0x7ff60c0cc9a0 2023-11-04T01:40:52.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.408+0000 7ff6109c9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c155bf0 con 0x7ff60c0cc520 2023-11-04T01:40:52.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.408+0000 7ff60ad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff60c153850 0x7ff60c070610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:52.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.408+0000 7ff60ad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff60c153850 0x7ff60c070610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49182/0 (socket says 172.21.15.77:49182) 2023-11-04T01:40:52.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.408+0000 7ff60ad9d640 1 -- 172.21.15.77:0/738778279 learned_addr learned my addr 172.21.15.77:0/738778279 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:52.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.408+0000 7ff60a59c640 1 --2- 172.21.15.77:0/738778279 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff60c0cc520 0x7ff60c150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:52.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.408+0000 7ff609d9b640 1 --2- 172.21.15.77:0/738778279 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff60c0cc9a0 0x7ff60c0c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:52.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.408+0000 7ff60ad9d640 1 -- 172.21.15.77:0/738778279 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff60c0cc520 msgr2=0x7ff60c150260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:52.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.408+0000 7ff60ad9d640 1 --2- 172.21.15.77:0/738778279 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff60c0cc520 0x7ff60c150260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.408+0000 7ff60ad9d640 1 -- 172.21.15.77:0/738778279 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff60c0cc9a0 msgr2=0x7ff60c0c61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:52.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.408+0000 7ff60ad9d640 1 --2- 172.21.15.77:0/738778279 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff60c0cc9a0 0x7ff60c0c61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.408+0000 7ff60ad9d640 1 -- 172.21.15.77:0/738778279 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60400a670 con 0x7ff60c153850 2023-11-04T01:40:52.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.409+0000 7ff60ad9d640 1 --2- 172.21.15.77:0/738778279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff60c153850 0x7ff60c070610 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff60402ce30 tx=0x7ff6040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:52.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.409+0000 7ff5faffd640 1 -- 172.21.15.77:0/738778279 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60403e630 con 0x7ff60c153850 2023-11-04T01:40:52.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.409+0000 7ff5faffd640 1 -- 172.21.15.77:0/738778279 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60403e7b0 con 0x7ff60c153850 2023-11-04T01:40:52.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.409+0000 7ff6109c9640 1 -- 172.21.15.77:0/738778279 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff60c155ed0 con 0x7ff60c153850 2023-11-04T01:40:52.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.409+0000 7ff5faffd640 1 -- 172.21.15.77:0/738778279 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60403eb60 con 0x7ff60c153850 2023-11-04T01:40:52.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.409+0000 7ff6109c9640 1 -- 172.21.15.77:0/738778279 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff60c156490 con 0x7ff60c153850 2023-11-04T01:40:52.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.410+0000 7ff6109c9640 1 -- 172.21.15.77:0/738778279 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff60c1566b0 con 0x7ff60c153850 2023-11-04T01:40:52.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.410+0000 7ff5faffd640 1 -- 172.21.15.77:0/738778279 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff60403c040 con 0x7ff60c153850 2023-11-04T01:40:52.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.410+0000 7ff5faffd640 1 --2- 172.21.15.77:0/738778279 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff5ec06ae70 0x7ff5ec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:52.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.411+0000 7ff5faffd640 1 -- 172.21.15.77:0/738778279 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff6040acdc0 con 0x7ff60c153850 2023-11-04T01:40:52.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.411+0000 7ff60a59c640 1 --2- 172.21.15.77:0/738778279 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff5ec06ae70 0x7ff5ec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:52.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.411+0000 7ff60a59c640 1 --2- 172.21.15.77:0/738778279 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff5ec06ae70 0x7ff5ec06d330 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0039e0 tx=0x7ff5fc009830 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:52.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.415+0000 7ff5faffd640 1 -- 172.21.15.77:0/738778279 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff604077ad0 con 0x7ff60c153850 2023-11-04T01:40:52.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.577+0000 7ff6109c9640 1 -- 172.21.15.77:0/738778279 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff60c0c5010 con 0x7ff60c153850 2023-11-04T01:40:52.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.578+0000 7ff5faffd640 1 -- 172.21.15.77:0/738778279 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff6040440a0 con 0x7ff60c153850 2023-11-04T01:40:52.581 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:40:52.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.579+0000 7ff6109c9640 1 -- 172.21.15.77:0/738778279 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff5ec06ae70 msgr2=0x7ff5ec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:52.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.579+0000 7ff6109c9640 1 --2- 172.21.15.77:0/738778279 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff5ec06ae70 0x7ff5ec06d330 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0039e0 tx=0x7ff5fc009830 comp rx=0 tx=0).stop 2023-11-04T01:40:52.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.579+0000 7ff6109c9640 1 -- 172.21.15.77:0/738778279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff60c153850 msgr2=0x7ff60c070610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:52.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.579+0000 7ff6109c9640 1 --2- 172.21.15.77:0/738778279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff60c153850 0x7ff60c070610 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff60402ce30 tx=0x7ff6040046c0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.579+0000 7ff6109c9640 1 -- 172.21.15.77:0/738778279 shutdown_connections 2023-11-04T01:40:52.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.579+0000 7ff6109c9640 1 --2- 172.21.15.77:0/738778279 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff5ec06ae70 0x7ff5ec06d330 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.579+0000 7ff6109c9640 1 --2- 172.21.15.77:0/738778279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff60c153850 0x7ff60c070610 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.579+0000 7ff6109c9640 1 --2- 172.21.15.77:0/738778279 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff60c0cc9a0 0x7ff60c0c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.579+0000 7ff6109c9640 1 --2- 172.21.15.77:0/738778279 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff60c0cc520 0x7ff60c150260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.579+0000 7ff6109c9640 1 -- 172.21.15.77:0/738778279 >> 172.21.15.77:0/738778279 conn(0x7ff60c0ce950 msgr2=0x7ff60c152980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:52.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.579+0000 7ff6109c9640 1 -- 172.21.15.77:0/738778279 shutdown_connections 2023-11-04T01:40:52.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.579+0000 7ff6109c9640 1 -- 172.21.15.77:0/738778279 wait complete. 2023-11-04T01:40:52.593 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:40:52.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.692+0000 7f5f01339640 1 Processor -- start 2023-11-04T01:40:52.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.692+0000 7f5f01339640 1 -- start start 2023-11-04T01:40:52.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.693+0000 7f5f01339640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5efc15cfd0 0x7f5efc06c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:52.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.693+0000 7f5f01339640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5efc0cf180 0x7f5efc161440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:52.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.693+0000 7f5f01339640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5efc0cd570 0x7f5efc0cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:52.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.693+0000 7f5f01339640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5efc15d3b0 con 0x7f5efc15cfd0 2023-11-04T01:40:52.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.693+0000 7f5f01339640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5efc0cdf00 con 0x7f5efc0cd570 2023-11-04T01:40:52.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.693+0000 7f5f01339640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc0cea20 con 0x7f5efc0cf180 2023-11-04T01:40:52.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.693+0000 7f5efaffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5efc15cfd0 0x7f5efc06c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:52.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.693+0000 7f5efaffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5efc15cfd0 0x7f5efc06c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49184/0 (socket says 172.21.15.77:49184) 2023-11-04T01:40:52.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.693+0000 7f5efaffd640 1 -- 172.21.15.77:0/1122597491 learned_addr learned my addr 172.21.15.77:0/1122597491 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:52.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.694+0000 7f5efa7fc640 1 --2- 172.21.15.77:0/1122597491 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5efc0cf180 0x7f5efc161440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:52.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.694+0000 7f5efb7fe640 1 --2- 172.21.15.77:0/1122597491 >> v2:172.21.15.122:3300/0 conn(0x7f5efc0cd570 0x7f5efc0cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:52.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.694+0000 7f5efaffd640 1 -- 172.21.15.77:0/1122597491 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5efc0cf180 msgr2=0x7f5efc161440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:52.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.694+0000 7f5efaffd640 1 --2- 172.21.15.77:0/1122597491 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5efc0cf180 0x7f5efc161440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.694+0000 7f5efaffd640 1 -- 172.21.15.77:0/1122597491 >> v2:172.21.15.122:3300/0 conn(0x7f5efc0cd570 msgr2=0x7f5efc0cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:52.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.694+0000 7f5efaffd640 1 --2- 172.21.15.77:0/1122597491 >> v2:172.21.15.122:3300/0 conn(0x7f5efc0cd570 0x7f5efc0cd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.694+0000 7f5efaffd640 1 -- 172.21.15.77:0/1122597491 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5efc161980 con 0x7f5efc15cfd0 2023-11-04T01:40:52.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.694+0000 7f5efa7fc640 1 --2- 172.21.15.77:0/1122597491 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5efc0cf180 0x7f5efc161440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:52.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.694+0000 7f5efb7fe640 1 --2- 172.21.15.77:0/1122597491 >> v2:172.21.15.122:3300/0 conn(0x7f5efc0cd570 0x7f5efc0cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:52.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.694+0000 7f5efaffd640 1 --2- 172.21.15.77:0/1122597491 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5efc15cfd0 0x7f5efc06c0a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5efc0cb180 tx=0x7f5eec02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=164edda3ce3755f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:52.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.695+0000 7f5ef9ffb640 1 -- 172.21.15.77:0/1122597491 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec02c9e0 con 0x7f5efc15cfd0 2023-11-04T01:40:52.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.695+0000 7f5ef9ffb640 1 -- 172.21.15.77:0/1122597491 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eec02cb40 con 0x7f5efc15cfd0 2023-11-04T01:40:52.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.695+0000 7f5ef9ffb640 1 -- 172.21.15.77:0/1122597491 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec0343f0 con 0x7f5efc15cfd0 2023-11-04T01:40:52.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.695+0000 7f5f01339640 1 -- 172.21.15.77:0/1122597491 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5efc15cfd0 msgr2=0x7f5efc06c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:52.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.695+0000 7f5f01339640 1 --2- 172.21.15.77:0/1122597491 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5efc15cfd0 0x7f5efc06c0a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5efc0cb180 tx=0x7f5eec02be40 comp rx=0 tx=0).stop 2023-11-04T01:40:52.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.695+0000 7f5f01339640 1 -- 172.21.15.77:0/1122597491 shutdown_connections 2023-11-04T01:40:52.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.695+0000 7f5f01339640 1 --2- 172.21.15.77:0/1122597491 >> v2:172.21.15.122:3300/0 conn(0x7f5efc0cd570 0x7f5efc0cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.695+0000 7f5f01339640 1 --2- 172.21.15.77:0/1122597491 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5efc0cf180 0x7f5efc161440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.695+0000 7f5f01339640 1 --2- 172.21.15.77:0/1122597491 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5efc15cfd0 0x7f5efc06c0a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.695+0000 7f5f01339640 1 -- 172.21.15.77:0/1122597491 >> 172.21.15.77:0/1122597491 conn(0x7f5efc06ea20 msgr2=0x7f5efc06ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:52.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.695+0000 7f5f01339640 1 -- 172.21.15.77:0/1122597491 shutdown_connections 2023-11-04T01:40:52.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.695+0000 7f5f01339640 1 -- 172.21.15.77:0/1122597491 wait complete. 2023-11-04T01:40:52.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.697+0000 7f5f01339640 1 Processor -- start 2023-11-04T01:40:52.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.697+0000 7f5f01339640 1 -- start start 2023-11-04T01:40:52.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.697+0000 7f5f01339640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5efc0cd570 0x7f5efc14cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:52.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.697+0000 7f5f01339640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5efc15cfd0 0x7f5efc0c6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:52.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.697+0000 7f5f01339640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5efc0c69a0 0x7f5efc159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:52.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.697+0000 7f5f01339640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc0c4a40 con 0x7f5efc0cd570 2023-11-04T01:40:52.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.697+0000 7f5f01339640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc0c4d20 con 0x7f5efc15cfd0 2023-11-04T01:40:52.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.697+0000 7f5f01339640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc0c5000 con 0x7f5efc0c69a0 2023-11-04T01:40:52.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.697+0000 7f5efaffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5efc0cd570 0x7f5efc14cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:52.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.697+0000 7f5efaffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5efc0cd570 0x7f5efc14cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49192/0 (socket says 172.21.15.77:49192) 2023-11-04T01:40:52.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.697+0000 7f5efaffd640 1 -- 172.21.15.77:0/2419753635 learned_addr learned my addr 172.21.15.77:0/2419753635 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:52.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.698+0000 7f5efb7fe640 1 --2- 172.21.15.77:0/2419753635 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5efc0c69a0 0x7f5efc159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:52.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.698+0000 7f5efa7fc640 1 --2- 172.21.15.77:0/2419753635 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5efc15cfd0 0x7f5efc0c6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:52.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.698+0000 7f5efaffd640 1 -- 172.21.15.77:0/2419753635 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5efc0c69a0 msgr2=0x7f5efc159300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:52.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.698+0000 7f5efaffd640 1 --2- 172.21.15.77:0/2419753635 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5efc0c69a0 0x7f5efc159300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.698+0000 7f5efaffd640 1 -- 172.21.15.77:0/2419753635 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5efc15cfd0 msgr2=0x7f5efc0c6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:52.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.698+0000 7f5efaffd640 1 --2- 172.21.15.77:0/2419753635 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5efc15cfd0 0x7f5efc0c6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.698+0000 7f5efaffd640 1 -- 172.21.15.77:0/2419753635 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eec009b30 con 0x7f5efc0cd570 2023-11-04T01:40:52.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.698+0000 7f5efb7fe640 1 --2- 172.21.15.77:0/2419753635 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5efc0c69a0 0x7f5efc159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:52.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.698+0000 7f5efaffd640 1 --2- 172.21.15.77:0/2419753635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5efc0cd570 0x7f5efc14cf90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5eec000f80 tx=0x7f5eec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:52.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.698+0000 7f5ee37fe640 1 -- 172.21.15.77:0/2419753635 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec03e450 con 0x7f5efc0cd570 2023-11-04T01:40:52.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.698+0000 7f5ee37fe640 1 -- 172.21.15.77:0/2419753635 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eec03e5f0 con 0x7f5efc0cd570 2023-11-04T01:40:52.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.698+0000 7f5f01339640 1 -- 172.21.15.77:0/2419753635 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5efc0c52e0 con 0x7f5efc0cd570 2023-11-04T01:40:52.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.698+0000 7f5ee37fe640 1 -- 172.21.15.77:0/2419753635 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec03e9a0 con 0x7f5efc0cd570 2023-11-04T01:40:52.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.698+0000 7f5f01339640 1 -- 172.21.15.77:0/2419753635 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5efc0c46d0 con 0x7f5efc0cd570 2023-11-04T01:40:52.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.699+0000 7f5f01339640 1 -- 172.21.15.77:0/2419753635 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5efc0c5800 con 0x7f5efc0cd570 2023-11-04T01:40:52.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.700+0000 7f5ee37fe640 1 -- 172.21.15.77:0/2419753635 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5eec03eb00 con 0x7f5efc0cd570 2023-11-04T01:40:52.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.700+0000 7f5ee37fe640 1 --2- 172.21.15.77:0/2419753635 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5ee806ae70 0x7f5ee806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:52.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.700+0000 7f5ee37fe640 1 -- 172.21.15.77:0/2419753635 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5eec0ac900 con 0x7f5efc0cd570 2023-11-04T01:40:52.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.700+0000 7f5efa7fc640 1 --2- 172.21.15.77:0/2419753635 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5ee806ae70 0x7f5ee806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:52.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.701+0000 7f5efa7fc640 1 --2- 172.21.15.77:0/2419753635 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5ee806ae70 0x7f5ee806d330 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5efc0b58c0 tx=0x7f5ef0008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:52.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.705+0000 7f5ee37fe640 1 -- 172.21.15.77:0/2419753635 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5efc0c5800 con 0x7f5efc0cd570 2023-11-04T01:40:52.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.872+0000 7f5f01339640 1 -- 172.21.15.77:0/2419753635 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5efc0c5800 con 0x7f5efc0cd570 2023-11-04T01:40:52.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.873+0000 7f5ee37fe640 1 -- 172.21.15.77:0/2419753635 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5efc0c5800 con 0x7f5efc0cd570 2023-11-04T01:40:52.876 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:40:52.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.874+0000 7f5f01339640 1 -- 172.21.15.77:0/2419753635 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5ee806ae70 msgr2=0x7f5ee806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:52.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.874+0000 7f5f01339640 1 --2- 172.21.15.77:0/2419753635 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5ee806ae70 0x7f5ee806d330 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5efc0b58c0 tx=0x7f5ef0008040 comp rx=0 tx=0).stop 2023-11-04T01:40:52.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.874+0000 7f5f01339640 1 -- 172.21.15.77:0/2419753635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5efc0cd570 msgr2=0x7f5efc14cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:52.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.874+0000 7f5f01339640 1 --2- 172.21.15.77:0/2419753635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5efc0cd570 0x7f5efc14cf90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5eec000f80 tx=0x7f5eec004a40 comp rx=0 tx=0).stop 2023-11-04T01:40:52.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.874+0000 7f5f01339640 1 -- 172.21.15.77:0/2419753635 shutdown_connections 2023-11-04T01:40:52.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.874+0000 7f5f01339640 1 --2- 172.21.15.77:0/2419753635 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5ee806ae70 0x7f5ee806d330 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.874+0000 7f5f01339640 1 --2- 172.21.15.77:0/2419753635 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5efc0c69a0 0x7f5efc159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.874+0000 7f5f01339640 1 --2- 172.21.15.77:0/2419753635 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5efc15cfd0 0x7f5efc0c6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.874+0000 7f5f01339640 1 --2- 172.21.15.77:0/2419753635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5efc0cd570 0x7f5efc14cf90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:52.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.874+0000 7f5f01339640 1 -- 172.21.15.77:0/2419753635 >> 172.21.15.77:0/2419753635 conn(0x7f5efc06ea20 msgr2=0x7f5efc15fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:52.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.875+0000 7f5f01339640 1 -- 172.21.15.77:0/2419753635 shutdown_connections 2023-11-04T01:40:52.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.875+0000 7f5f01339640 1 -- 172.21.15.77:0/2419753635 wait complete. 2023-11-04T01:40:52.888 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:40:52.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.989+0000 7f5bd619e640 1 Processor -- start 2023-11-04T01:40:52.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.989+0000 7f5bd619e640 1 -- start start 2023-11-04T01:40:52.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.990+0000 7f5bd619e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5bd0161540 0x7f5bd00cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:52.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.990+0000 7f5bd619e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bd00cfe50 con 0x7f5bd015ce60 2023-11-04T01:40:52.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.990+0000 7f5bd619e640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bd00cdc20 con 0x7f5bd00cfa20 2023-11-04T01:40:52.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.990+0000 7f5bd619e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bd00ce4c0 con 0x7f5bd0161540 2023-11-04T01:40:52.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.990+0000 7f5bd499b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5bd0161540 0x7f5bd00cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:52.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.990+0000 7f5bd519c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f5bd015ce60 0x7f5bd00b1d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36588/0 (socket says 172.21.15.77:36588) 2023-11-04T01:40:52.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.990+0000 7f5bd499b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5bd0161540 0x7f5bd00cf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49200/0 (socket says 172.21.15.77:49200) 2023-11-04T01:40:52.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.990+0000 7f5bd519c640 1 -- 172.21.15.77:0/4159194248 learned_addr learned my addr 172.21.15.77:0/4159194248 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:52.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.990+0000 7f5bd499b640 1 -- 172.21.15.77:0/4159194248 >> v1:172.21.15.122:6789/0 conn(0x7f5bd00cfa20 legacy=0x7f5bd00d14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:52.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.990+0000 7f5bd499b640 1 -- 172.21.15.77:0/4159194248 >> v1:172.21.15.77:6789/0 conn(0x7f5bd015ce60 legacy=0x7f5bd00b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:52.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.990+0000 7f5bd499b640 1 -- 172.21.15.77:0/4159194248 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd00cdf00 con 0x7f5bd0161540 2023-11-04T01:40:52.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.991+0000 7f5bd499b640 1 --2- 172.21.15.77:0/4159194248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bd0161540 0x7f5bd00cf4e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5bc00097a0 tx=0x7f5bc002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a85f419e6a1fcd37 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:52.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.991+0000 7f5bc7fff640 1 -- 172.21.15.77:0/4159194248 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc0031830 con 0x7f5bd0161540 2023-11-04T01:40:52.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.991+0000 7f5bc7fff640 1 -- 172.21.15.77:0/4159194248 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc0031990 con 0x7f5bd0161540 2023-11-04T01:40:52.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.991+0000 7f5bc7fff640 1 -- 172.21.15.77:0/4159194248 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc0031d20 con 0x7f5bd0161540 2023-11-04T01:40:53.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.991+0000 7f5bd619e640 1 -- 172.21.15.77:0/4159194248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bd0161540 msgr2=0x7f5bd00cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:53.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.991+0000 7f5bd619e640 1 --2- 172.21.15.77:0/4159194248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bd0161540 0x7f5bd00cf4e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5bc00097a0 tx=0x7f5bc002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:53.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.991+0000 7f5bd619e640 1 -- 172.21.15.77:0/4159194248 shutdown_connections 2023-11-04T01:40:53.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.991+0000 7f5bd619e640 1 --2- 172.21.15.77:0/4159194248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bd0161540 0x7f5bd00cf4e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:53.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.991+0000 7f5bd619e640 1 -- 172.21.15.77:0/4159194248 >> 172.21.15.77:0/4159194248 conn(0x7f5bd006b4c0 msgr2=0x7f5bd006b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:53.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.992+0000 7f5bd619e640 1 -- 172.21.15.77:0/4159194248 shutdown_connections 2023-11-04T01:40:53.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.992+0000 7f5bd619e640 1 -- 172.21.15.77:0/4159194248 wait complete. 2023-11-04T01:40:53.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.993+0000 7f5bd619e640 1 Processor -- start 2023-11-04T01:40:53.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.993+0000 7f5bd619e640 1 -- start start 2023-11-04T01:40:53.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.993+0000 7f5bd619e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5bd00cfa20 0x7f5bd01578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:53.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.994+0000 7f5bd619e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bd015ce60 0x7f5bd015dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:53.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.994+0000 7f5bd619e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5bd0161540 0x7f5bd01f2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:53.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.994+0000 7f5bd619e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd01f3130 con 0x7f5bd015ce60 2023-11-04T01:40:53.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.994+0000 7f5bd619e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd015f450 con 0x7f5bd0161540 2023-11-04T01:40:53.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.994+0000 7f5bd619e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd015f730 con 0x7f5bd00cfa20 2023-11-04T01:40:53.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.994+0000 7f5bd499b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bd015ce60 0x7f5bd015dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:53.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.994+0000 7f5bd499b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bd015ce60 0x7f5bd015dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49212/0 (socket says 172.21.15.77:49212) 2023-11-04T01:40:53.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.994+0000 7f5bd499b640 1 -- 172.21.15.77:0/1165077911 learned_addr learned my addr 172.21.15.77:0/1165077911 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:53.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.994+0000 7f5bd499b640 1 -- 172.21.15.77:0/1165077911 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5bd00cfa20 msgr2=0x7f5bd01578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:53.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.994+0000 7f5bd519c640 1 --2- 172.21.15.77:0/1165077911 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5bd00cfa20 0x7f5bd01578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:53.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.994+0000 7f5bd599d640 1 --2- 172.21.15.77:0/1165077911 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5bd0161540 0x7f5bd01f2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:53.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.994+0000 7f5bd499b640 1 --2- 172.21.15.77:0/1165077911 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5bd00cfa20 0x7f5bd01578f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:53.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.994+0000 7f5bd499b640 1 -- 172.21.15.77:0/1165077911 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5bd0161540 msgr2=0x7f5bd01f2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:53.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.994+0000 7f5bd499b640 1 --2- 172.21.15.77:0/1165077911 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5bd0161540 0x7f5bd01f2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:53.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.994+0000 7f5bd499b640 1 -- 172.21.15.77:0/1165077911 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc0009400 con 0x7f5bd015ce60 2023-11-04T01:40:53.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.994+0000 7f5bd599d640 1 --2- 172.21.15.77:0/1165077911 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5bd0161540 0x7f5bd01f2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:53.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.994+0000 7f5bd499b640 1 --2- 172.21.15.77:0/1165077911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bd015ce60 0x7f5bd015dc50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0000c00 tx=0x7f5bc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:53.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.994+0000 7f5bc5ffb640 1 -- 172.21.15.77:0/1165077911 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc003aa60 con 0x7f5bd015ce60 2023-11-04T01:40:53.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.994+0000 7f5bc5ffb640 1 -- 172.21.15.77:0/1165077911 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc003abc0 con 0x7f5bd015ce60 2023-11-04T01:40:53.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.994+0000 7f5bd619e640 1 -- 172.21.15.77:0/1165077911 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bd015fa10 con 0x7f5bd015ce60 2023-11-04T01:40:53.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.994+0000 7f5bc5ffb640 1 -- 172.21.15.77:0/1165077911 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc00443f0 con 0x7f5bd015ce60 2023-11-04T01:40:53.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.995+0000 7f5bd619e640 1 -- 172.21.15.77:0/1165077911 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bd015ffd0 con 0x7f5bd015ce60 2023-11-04T01:40:53.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.996+0000 7f5bd619e640 1 -- 172.21.15.77:0/1165077911 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bd004ece0 con 0x7f5bd015ce60 2023-11-04T01:40:53.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.996+0000 7f5bc5ffb640 1 -- 172.21.15.77:0/1165077911 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5bc004d450 con 0x7f5bd015ce60 2023-11-04T01:40:53.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.996+0000 7f5bc5ffb640 1 --2- 172.21.15.77:0/1165077911 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5bb406ae70 0x7f5bb406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:53.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.996+0000 7f5bc5ffb640 1 -- 172.21.15.77:0/1165077911 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5bc00abbe0 con 0x7f5bd015ce60 2023-11-04T01:40:53.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.996+0000 7f5bd519c640 1 --2- 172.21.15.77:0/1165077911 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5bb406ae70 0x7f5bb406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:53.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:52.997+0000 7f5bd519c640 1 --2- 172.21.15.77:0/1165077911 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5bb406ae70 0x7f5bb406d330 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc005880 tx=0x7f5bcc009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:53.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.000+0000 7f5bc5ffb640 1 -- 172.21.15.77:0/1165077911 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5bc00768d0 con 0x7f5bd015ce60 2023-11-04T01:40:53.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.167+0000 7f5bd619e640 1 -- 172.21.15.77:0/1165077911 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5bd00cda00 con 0x7f5bd015ce60 2023-11-04T01:40:53.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.168+0000 7f5bc5ffb640 1 -- 172.21.15.77:0/1165077911 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5bc00ab070 con 0x7f5bd015ce60 2023-11-04T01:40:53.171 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-04T01:40:53.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.169+0000 7f5bd619e640 1 -- 172.21.15.77:0/1165077911 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5bb406ae70 msgr2=0x7f5bb406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:53.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.169+0000 7f5bd619e640 1 --2- 172.21.15.77:0/1165077911 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5bb406ae70 0x7f5bb406d330 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc005880 tx=0x7f5bcc009040 comp rx=0 tx=0).stop 2023-11-04T01:40:53.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.169+0000 7f5bd619e640 1 -- 172.21.15.77:0/1165077911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bd015ce60 msgr2=0x7f5bd015dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:53.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.169+0000 7f5bd619e640 1 --2- 172.21.15.77:0/1165077911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bd015ce60 0x7f5bd015dc50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0000c00 tx=0x7f5bc00046c0 comp rx=0 tx=0).stop 2023-11-04T01:40:53.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.169+0000 7f5bd619e640 1 -- 172.21.15.77:0/1165077911 shutdown_connections 2023-11-04T01:40:53.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.170+0000 7f5bd619e640 1 --2- 172.21.15.77:0/1165077911 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5bb406ae70 0x7f5bb406d330 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:53.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.170+0000 7f5bd619e640 1 --2- 172.21.15.77:0/1165077911 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5bd0161540 0x7f5bd01f2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:53.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.170+0000 7f5bd619e640 1 --2- 172.21.15.77:0/1165077911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bd015ce60 0x7f5bd015dc50 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:53.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.170+0000 7f5bd619e640 1 --2- 172.21.15.77:0/1165077911 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5bd00cfa20 0x7f5bd01578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:53.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.170+0000 7f5bd619e640 1 -- 172.21.15.77:0/1165077911 >> 172.21.15.77:0/1165077911 conn(0x7f5bd006b4c0 msgr2=0x7f5bd00d14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:53.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.170+0000 7f5bd619e640 1 -- 172.21.15.77:0/1165077911 shutdown_connections 2023-11-04T01:40:53.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.170+0000 7f5bd619e640 1 -- 172.21.15.77:0/1165077911 wait complete. 2023-11-04T01:40:53.183 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:40:53.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.283+0000 7f81c581a640 1 Processor -- start 2023-11-04T01:40:53.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.283+0000 7f81c581a640 1 -- start start 2023-11-04T01:40:53.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.284+0000 7f81c581a640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f81c00cccc0 0x7f81c006c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:53.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.284+0000 7f81c581a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c006ca40 con 0x7f81c0160430 2023-11-04T01:40:53.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.284+0000 7f81c581a640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c006cd20 con 0x7f81c00b2d30 2023-11-04T01:40:53.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.284+0000 7f81c581a640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c00cb580 con 0x7f81c00cccc0 2023-11-04T01:40:53.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.284+0000 7f81beffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f81c0160430 0x7f81c00b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36600/0 (socket says 172.21.15.77:36600) 2023-11-04T01:40:53.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.284+0000 7f81beffd640 1 -- 172.21.15.77:0/1586924476 learned_addr learned my addr 172.21.15.77:0/1586924476 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:53.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.284+0000 7f81bf7fe640 1 --2- 172.21.15.77:0/1586924476 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f81c00cccc0 0x7f81c006c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:53.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.284+0000 7f81bdffb640 1 -- 172.21.15.77:0/1586924476 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1939684518 0 0) 0x7f81c006ca40 con 0x7f81c0160430 2023-11-04T01:40:53.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.284+0000 7f81bdffb640 1 -- 172.21.15.77:0/1586924476 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81a8003520 con 0x7f81c0160430 2023-11-04T01:40:53.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.285+0000 7f81bdffb640 1 -- 172.21.15.77:0/1586924476 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 798973809 0 0) 0x7f81c006cd20 con 0x7f81c00b2d30 2023-11-04T01:40:53.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.285+0000 7f81bdffb640 1 -- 172.21.15.77:0/1586924476 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81c006ca40 con 0x7f81c00b2d30 2023-11-04T01:40:53.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.285+0000 7f81bdffb640 1 -- 172.21.15.77:0/1586924476 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3351959351 0 0) 0x7f81a8003520 con 0x7f81c0160430 2023-11-04T01:40:53.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.285+0000 7f81bdffb640 1 -- 172.21.15.77:0/1586924476 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f81c00cccc0 msgr2=0x7f81c006c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:53.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.285+0000 7f81bdffb640 1 --2- 172.21.15.77:0/1586924476 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f81c00cccc0 0x7f81c006c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:53.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.285+0000 7f81bdffb640 1 -- 172.21.15.77:0/1586924476 >> v1:172.21.15.122:6789/0 conn(0x7f81c00b2d30 legacy=0x7f81c006bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:53.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.285+0000 7f81bdffb640 1 -- 172.21.15.77:0/1586924476 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c006d000 con 0x7f81c0160430 2023-11-04T01:40:53.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.285+0000 7f81bdffb640 1 -- 172.21.15.77:0/1586924476 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f81b00019f0 con 0x7f81c0160430 2023-11-04T01:40:53.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.285+0000 7f81bdffb640 1 -- 172.21.15.77:0/1586924476 >> v1:172.21.15.77:6789/0 conn(0x7f81c0160430 legacy=0x7f81c00b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:53.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.285+0000 7f81bdffb640 1 --2- 172.21.15.77:0/1586924476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81a8003b30 0x7f81a8003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:53.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.285+0000 7f81bdffb640 1 --2- 172.21.15.77:0/1586924476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81a80047c0 0x7f81a8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:53.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.285+0000 7f81bdffb640 1 --2- 172.21.15.77:0/1586924476 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f81c00cccc0 0x7f81a80051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:53.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.285+0000 7f81bdffb640 1 -- 172.21.15.77:0/1586924476 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c00cb580 con 0x7f81a8003b30 2023-11-04T01:40:53.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.285+0000 7f81bdffb640 1 -- 172.21.15.77:0/1586924476 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a800bb10 con 0x7f81a80047c0 2023-11-04T01:40:53.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.285+0000 7f81bdffb640 1 -- 172.21.15.77:0/1586924476 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a800bca0 con 0x7f81c00cccc0 2023-11-04T01:40:53.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.285+0000 7f81beffd640 1 --2- 172.21.15.77:0/1586924476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81a8003b30 0x7f81a8003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:53.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.285+0000 7f81bf7fe640 1 --2- 172.21.15.77:0/1586924476 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f81c00cccc0 0x7f81a80051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:53.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.285+0000 7f81be7fc640 1 --2- 172.21.15.77:0/1586924476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81a80047c0 0x7f81a8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:53.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.285+0000 7f81beffd640 1 -- 172.21.15.77:0/1586924476 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f81c00cccc0 msgr2=0x7f81a80051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:53.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.285+0000 7f81beffd640 1 --2- 172.21.15.77:0/1586924476 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f81c00cccc0 0x7f81a80051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:53.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.285+0000 7f81beffd640 1 -- 172.21.15.77:0/1586924476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81a80047c0 msgr2=0x7f81a8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:53.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.285+0000 7f81beffd640 1 --2- 172.21.15.77:0/1586924476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81a80047c0 0x7f81a8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:53.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.285+0000 7f81beffd640 1 -- 172.21.15.77:0/1586924476 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a8003520 con 0x7f81a8003b30 2023-11-04T01:40:53.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.285+0000 7f81be7fc640 1 --2- 172.21.15.77:0/1586924476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81a80047c0 0x7f81a8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:53.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.286+0000 7f81beffd640 1 --2- 172.21.15.77:0/1586924476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81a8003b30 0x7f81a8003f30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f81b000a730 tx=0x7f81a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2529305d51a83b4c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:53.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.286+0000 7f81bdffb640 1 -- 172.21.15.77:0/1586924476 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b0034630 con 0x7f81a8003b30 2023-11-04T01:40:53.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.286+0000 7f81bdffb640 1 -- 172.21.15.77:0/1586924476 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b002f070 con 0x7f81a8003b30 2023-11-04T01:40:53.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.286+0000 7f81bdffb640 1 -- 172.21.15.77:0/1586924476 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b00349f0 con 0x7f81a8003b30 2023-11-04T01:40:53.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.286+0000 7f81c581a640 1 -- 172.21.15.77:0/1586924476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81a8003b30 msgr2=0x7f81a8003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:53.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.286+0000 7f81c581a640 1 --2- 172.21.15.77:0/1586924476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81a8003b30 0x7f81a8003f30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f81b000a730 tx=0x7f81a80057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:53.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.286+0000 7f81bf7fe640 1 -- 172.21.15.77:0/1586924476 reap_dead start 2023-11-04T01:40:53.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.286+0000 7f81c581a640 1 -- 172.21.15.77:0/1586924476 shutdown_connections 2023-11-04T01:40:53.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.286+0000 7f81c581a640 1 -- 172.21.15.77:0/1586924476 >> 172.21.15.77:0/1586924476 conn(0x7f81c006ea20 msgr2=0x7f81c006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:53.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.286+0000 7f81c581a640 1 -- 172.21.15.77:0/1586924476 shutdown_connections 2023-11-04T01:40:53.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.286+0000 7f81c581a640 1 -- 172.21.15.77:0/1586924476 wait complete. 2023-11-04T01:40:53.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.288+0000 7f81c581a640 1 Processor -- start 2023-11-04T01:40:53.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.288+0000 7f81c581a640 1 -- start start 2023-11-04T01:40:53.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.288+0000 7f81c581a640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f81a8003b30 0x7f81c0149ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:53.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.288+0000 7f81c581a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81c0158cc0 0x7f81c0159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:53.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.288+0000 7f81c581a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81c00b0720 0x7f81c00b0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:53.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.288+0000 7f81c581a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c0159680 con 0x7f81c00b0720 2023-11-04T01:40:53.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.288+0000 7f81c581a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c01568c0 con 0x7f81c0158cc0 2023-11-04T01:40:53.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.288+0000 7f81c581a640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c01598a0 con 0x7f81a8003b30 2023-11-04T01:40:53.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.289+0000 7f81bf7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81c00b0720 0x7f81c00b0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:53.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.289+0000 7f81bf7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81c00b0720 0x7f81c00b0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49232/0 (socket says 172.21.15.77:49232) 2023-11-04T01:40:53.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.289+0000 7f81bf7fe640 1 -- 172.21.15.77:0/449119720 learned_addr learned my addr 172.21.15.77:0/449119720 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:53.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.289+0000 7f81be7fc640 1 --2- 172.21.15.77:0/449119720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81c0158cc0 0x7f81c0159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:53.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.289+0000 7f81beffd640 1 --2- 172.21.15.77:0/449119720 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f81a8003b30 0x7f81c0149ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:53.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.289+0000 7f81bf7fe640 1 -- 172.21.15.77:0/449119720 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f81a8003b30 msgr2=0x7f81c0149ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:53.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.289+0000 7f81bf7fe640 1 --2- 172.21.15.77:0/449119720 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f81a8003b30 0x7f81c0149ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:53.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.289+0000 7f81bf7fe640 1 -- 172.21.15.77:0/449119720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81c0158cc0 msgr2=0x7f81c0159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:53.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.289+0000 7f81bf7fe640 1 --2- 172.21.15.77:0/449119720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81c0158cc0 0x7f81c0159140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:53.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.289+0000 7f81bf7fe640 1 -- 172.21.15.77:0/449119720 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c0159b80 con 0x7f81c00b0720 2023-11-04T01:40:53.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.289+0000 7f81be7fc640 1 --2- 172.21.15.77:0/449119720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81c0158cc0 0x7f81c0159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:53.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.289+0000 7f81bf7fe640 1 --2- 172.21.15.77:0/449119720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81c00b0720 0x7f81c00b0ba0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f81c00ce700 tx=0x7f81b8011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:53.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.289+0000 7f81a7fff640 1 -- 172.21.15.77:0/449119720 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b8011ee0 con 0x7f81c00b0720 2023-11-04T01:40:53.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.289+0000 7f81a7fff640 1 -- 172.21.15.77:0/449119720 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b8004240 con 0x7f81c00b0720 2023-11-04T01:40:53.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.289+0000 7f81c581a640 1 -- 172.21.15.77:0/449119720 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c00afc40 con 0x7f81c00b0720 2023-11-04T01:40:53.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.289+0000 7f81a7fff640 1 -- 172.21.15.77:0/449119720 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b800f7a0 con 0x7f81c00b0720 2023-11-04T01:40:53.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.289+0000 7f81c581a640 1 -- 172.21.15.77:0/449119720 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c00b0200 con 0x7f81c00b0720 2023-11-04T01:40:53.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.290+0000 7f81c581a640 1 -- 172.21.15.77:0/449119720 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c00b0420 con 0x7f81c00b0720 2023-11-04T01:40:53.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.291+0000 7f81a7fff640 1 -- 172.21.15.77:0/449119720 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f81b800f900 con 0x7f81c00b0720 2023-11-04T01:40:53.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.291+0000 7f81a7fff640 1 --2- 172.21.15.77:0/449119720 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f81ac06ae70 0x7f81ac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:53.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.291+0000 7f81a7fff640 1 -- 172.21.15.77:0/449119720 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f81b8089bc0 con 0x7f81c00b0720 2023-11-04T01:40:53.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.291+0000 7f81beffd640 1 --2- 172.21.15.77:0/449119720 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f81ac06ae70 0x7f81ac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:53.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.292+0000 7f81beffd640 1 --2- 172.21.15.77:0/449119720 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f81ac06ae70 0x7f81ac06d330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f81b0034000 tx=0x7f81b002f000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:53.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.295+0000 7f81a7fff640 1 -- 172.21.15.77:0/449119720 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f81b80548b0 con 0x7f81c00b0720 2023-11-04T01:40:53.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.459+0000 7f81c581a640 1 -- 172.21.15.77:0/449119720 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f81c0074290 con 0x7f81c00b0720 2023-11-04T01:40:53.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.460+0000 7f81a7fff640 1 -- 172.21.15.77:0/449119720 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f81b8012330 con 0x7f81c00b0720 2023-11-04T01:40:53.463 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:40:53.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.461+0000 7f81c581a640 1 -- 172.21.15.77:0/449119720 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f81ac06ae70 msgr2=0x7f81ac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:53.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.461+0000 7f81c581a640 1 --2- 172.21.15.77:0/449119720 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f81ac06ae70 0x7f81ac06d330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f81b0034000 tx=0x7f81b002f000 comp rx=0 tx=0).stop 2023-11-04T01:40:53.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.461+0000 7f81c581a640 1 -- 172.21.15.77:0/449119720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81c00b0720 msgr2=0x7f81c00b0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:53.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.461+0000 7f81c581a640 1 --2- 172.21.15.77:0/449119720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81c00b0720 0x7f81c00b0ba0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f81c00ce700 tx=0x7f81b8011cf0 comp rx=0 tx=0).stop 2023-11-04T01:40:53.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.461+0000 7f81c581a640 1 -- 172.21.15.77:0/449119720 shutdown_connections 2023-11-04T01:40:53.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.461+0000 7f81c581a640 1 --2- 172.21.15.77:0/449119720 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f81ac06ae70 0x7f81ac06d330 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:53.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.461+0000 7f81c581a640 1 --2- 172.21.15.77:0/449119720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81c00b0720 0x7f81c00b0ba0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:53.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.461+0000 7f81c581a640 1 --2- 172.21.15.77:0/449119720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81c0158cc0 0x7f81c0159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:53.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.461+0000 7f81c581a640 1 --2- 172.21.15.77:0/449119720 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f81a8003b30 0x7f81c0149ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:53.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.461+0000 7f81c581a640 1 -- 172.21.15.77:0/449119720 >> 172.21.15.77:0/449119720 conn(0x7f81c006ea20 msgr2=0x7f81c00ce730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:53.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.462+0000 7f81c581a640 1 -- 172.21.15.77:0/449119720 shutdown_connections 2023-11-04T01:40:53.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.462+0000 7f81c581a640 1 -- 172.21.15.77:0/449119720 wait complete. 2023-11-04T01:40:53.475 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails' 2023-11-04T01:40:53.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.573+0000 7f03777d7640 1 Processor -- start 2023-11-04T01:40:53.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.573+0000 7f03777d7640 1 -- start start 2023-11-04T01:40:53.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.573+0000 7f03777d7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f037015ce60 0x7f037006b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:53.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.574+0000 7f03777d7640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f037006bd30 0x7f0370160b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:53.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.574+0000 7f03777d7640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03701615d0 con 0x7f0370161050 2023-11-04T01:40:53.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.574+0000 7f03777d7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03700cbde0 con 0x7f037015ce60 2023-11-04T01:40:53.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.574+0000 7f03777d7640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03701618b0 con 0x7f037006bd30 2023-11-04T01:40:53.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.574+0000 7f0375573640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f037015ce60 0x7f037006b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:53.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.574+0000 7f0375573640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f037015ce60 0x7f037006b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49234/0 (socket says 172.21.15.77:49234) 2023-11-04T01:40:53.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.574+0000 7f0375573640 1 -- 172.21.15.77:0/3076095220 learned_addr learned my addr 172.21.15.77:0/3076095220 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:53.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.574+0000 7f0375573640 1 -- 172.21.15.77:0/3076095220 >> v2:172.21.15.122:3300/0 conn(0x7f037006bd30 msgr2=0x7f0370160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:53.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.574+0000 7f0375573640 1 --2- 172.21.15.77:0/3076095220 >> v2:172.21.15.122:3300/0 conn(0x7f037006bd30 0x7f0370160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:53.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.574+0000 7f0375573640 1 -- 172.21.15.77:0/3076095220 >> v1:172.21.15.122:6789/0 conn(0x7f0370161050 legacy=0x7f03700cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:53.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.574+0000 7f0375573640 1 -- 172.21.15.77:0/3076095220 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03700cba00 con 0x7f037015ce60 2023-11-04T01:40:53.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.575+0000 7f0375573640 1 --2- 172.21.15.77:0/3076095220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f037015ce60 0x7f037006b7f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0370072590 tx=0x7f036c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2aa1b93514b89a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:53.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.575+0000 7f0367fff640 1 -- 172.21.15.77:0/3076095220 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c031870 con 0x7f037015ce60 2023-11-04T01:40:53.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.575+0000 7f0367fff640 1 -- 172.21.15.77:0/3076095220 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036c0319d0 con 0x7f037015ce60 2023-11-04T01:40:53.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.575+0000 7f0367fff640 1 -- 172.21.15.77:0/3076095220 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c031d60 con 0x7f037015ce60 2023-11-04T01:40:53.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.575+0000 7f03777d7640 1 -- 172.21.15.77:0/3076095220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f037015ce60 msgr2=0x7f037006b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:53.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.575+0000 7f03777d7640 1 --2- 172.21.15.77:0/3076095220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f037015ce60 0x7f037006b7f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0370072590 tx=0x7f036c02b910 comp rx=0 tx=0).stop 2023-11-04T01:40:53.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.575+0000 7f03777d7640 1 -- 172.21.15.77:0/3076095220 shutdown_connections 2023-11-04T01:40:53.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.575+0000 7f03777d7640 1 --2- 172.21.15.77:0/3076095220 >> v2:172.21.15.122:3300/0 conn(0x7f037006bd30 0x7f0370160b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:53.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.575+0000 7f03777d7640 1 --2- 172.21.15.77:0/3076095220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f037015ce60 0x7f037006b7f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:53.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.575+0000 7f03777d7640 1 -- 172.21.15.77:0/3076095220 >> 172.21.15.77:0/3076095220 conn(0x7f037006ea90 msgr2=0x7f037006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:53.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.576+0000 7f03777d7640 1 -- 172.21.15.77:0/3076095220 shutdown_connections 2023-11-04T01:40:53.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.576+0000 7f03777d7640 1 -- 172.21.15.77:0/3076095220 wait complete. 2023-11-04T01:40:53.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.577+0000 7f03777d7640 1 Processor -- start 2023-11-04T01:40:53.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.577+0000 7f03777d7640 1 -- start start 2023-11-04T01:40:53.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.577+0000 7f03777d7640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f037015ce60 0x7f0370148f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:53.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.577+0000 7f03777d7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0370161050 0x7f03700c5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:53.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.577+0000 7f03777d7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03700c5da0 0x7f03700c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:53.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.577+0000 7f03777d7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03700c6200 con 0x7f03700c5da0 2023-11-04T01:40:53.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.577+0000 7f03777d7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03700c9750 con 0x7f0370161050 2023-11-04T01:40:53.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.577+0000 7f03777d7640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03700c8bd0 con 0x7f037015ce60 2023-11-04T01:40:53.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.578+0000 7f0375d74640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03700c5da0 0x7f03700c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:53.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.578+0000 7f0375d74640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03700c5da0 0x7f03700c7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49238/0 (socket says 172.21.15.77:49238) 2023-11-04T01:40:53.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.578+0000 7f0375d74640 1 -- 172.21.15.77:0/3315469191 learned_addr learned my addr 172.21.15.77:0/3315469191 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:53.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.578+0000 7f0374d72640 1 --2- 172.21.15.77:0/3315469191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0370161050 0x7f03700c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:53.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.578+0000 7f0375573640 1 --2- 172.21.15.77:0/3315469191 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f037015ce60 0x7f0370148f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:53.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.578+0000 7f0375d74640 1 -- 172.21.15.77:0/3315469191 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f037015ce60 msgr2=0x7f0370148f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:53.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.578+0000 7f0375d74640 1 --2- 172.21.15.77:0/3315469191 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f037015ce60 0x7f0370148f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:53.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.578+0000 7f0375d74640 1 -- 172.21.15.77:0/3315469191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0370161050 msgr2=0x7f03700c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:53.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.578+0000 7f0375d74640 1 --2- 172.21.15.77:0/3315469191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0370161050 0x7f03700c5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:53.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.578+0000 7f0375d74640 1 -- 172.21.15.77:0/3315469191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f036c0094d0 con 0x7f03700c5da0 2023-11-04T01:40:53.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.578+0000 7f0375573640 1 --2- 172.21.15.77:0/3315469191 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f037015ce60 0x7f0370148f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:53.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.578+0000 7f0375d74640 1 --2- 172.21.15.77:0/3315469191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03700c5da0 0x7f03700c7ea0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f036800c780 tx=0x7f036800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:53.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.578+0000 7f0365ffb640 1 -- 172.21.15.77:0/3315469191 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0368003d80 con 0x7f03700c5da0 2023-11-04T01:40:53.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.578+0000 7f0365ffb640 1 -- 172.21.15.77:0/3315469191 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036800ce90 con 0x7f03700c5da0 2023-11-04T01:40:53.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.578+0000 7f03777d7640 1 -- 172.21.15.77:0/3315469191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03700c8eb0 con 0x7f03700c5da0 2023-11-04T01:40:53.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.578+0000 7f0365ffb640 1 -- 172.21.15.77:0/3315469191 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03680052b0 con 0x7f03700c5da0 2023-11-04T01:40:53.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.578+0000 7f03777d7640 1 -- 172.21.15.77:0/3315469191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03700c9470 con 0x7f03700c5da0 2023-11-04T01:40:53.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.580+0000 7f03777d7640 1 -- 172.21.15.77:0/3315469191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0370074290 con 0x7f03700c5da0 2023-11-04T01:40:53.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.580+0000 7f0365ffb640 1 -- 172.21.15.77:0/3315469191 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0368005410 con 0x7f03700c5da0 2023-11-04T01:40:53.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.580+0000 7f0365ffb640 1 --2- 172.21.15.77:0/3315469191 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f035406ae70 0x7f035406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:53.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.580+0000 7f0365ffb640 1 -- 172.21.15.77:0/3315469191 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0368088dd0 con 0x7f03700c5da0 2023-11-04T01:40:53.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.580+0000 7f0375573640 1 --2- 172.21.15.77:0/3315469191 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f035406ae70 0x7f035406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:53.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.581+0000 7f0375573640 1 --2- 172.21.15.77:0/3315469191 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f035406ae70 0x7f035406d330 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f036c036000 tx=0x7f036c03c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:53.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.584+0000 7f0365ffb640 1 -- 172.21.15.77:0/3315469191 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0368053b70 con 0x7f03700c5da0 2023-11-04T01:40:53.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:53.815+0000 7f03777d7640 1 -- 172.21.15.77:0/3315469191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails"]} v 0) v1 -- 0x7f037006b3e0 con 0x7f03700c5da0 2023-11-04T01:40:54.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.608+0000 7f0365ffb640 1 -- 172.21.15.77:0/3315469191 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails"]}]=0 v67) v1 ==== 176+0+0 (secure 0 0 0) 0x7f036808a0f0 con 0x7f03700c5da0 2023-11-04T01:40:54.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.611+0000 7f03777d7640 1 -- 172.21.15.77:0/3315469191 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f035406ae70 msgr2=0x7f035406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:54.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.611+0000 7f03777d7640 1 --2- 172.21.15.77:0/3315469191 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f035406ae70 0x7f035406d330 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f036c036000 tx=0x7f036c03c040 comp rx=0 tx=0).stop 2023-11-04T01:40:54.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.611+0000 7f03777d7640 1 -- 172.21.15.77:0/3315469191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03700c5da0 msgr2=0x7f03700c7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:54.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.611+0000 7f03777d7640 1 --2- 172.21.15.77:0/3315469191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03700c5da0 0x7f03700c7ea0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f036800c780 tx=0x7f036800cc40 comp rx=0 tx=0).stop 2023-11-04T01:40:54.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.611+0000 7f03777d7640 1 -- 172.21.15.77:0/3315469191 shutdown_connections 2023-11-04T01:40:54.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.611+0000 7f03777d7640 1 --2- 172.21.15.77:0/3315469191 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f035406ae70 0x7f035406d330 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:54.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.611+0000 7f03777d7640 1 --2- 172.21.15.77:0/3315469191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03700c5da0 0x7f03700c7ea0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:54.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.611+0000 7f03777d7640 1 --2- 172.21.15.77:0/3315469191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0370161050 0x7f03700c5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:54.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.611+0000 7f03777d7640 1 --2- 172.21.15.77:0/3315469191 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f037015ce60 0x7f0370148f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:54.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.611+0000 7f03777d7640 1 -- 172.21.15.77:0/3315469191 >> 172.21.15.77:0/3315469191 conn(0x7f037006ea90 msgr2=0x7f03700b2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:54.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.611+0000 7f03777d7640 1 -- 172.21.15.77:0/3315469191 shutdown_connections 2023-11-04T01:40:54.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.611+0000 7f03777d7640 1 -- 172.21.15.77:0/3315469191 wait complete. 2023-11-04T01:40:54.625 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-04T01:40:54.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.726+0000 7fedd5f5e640 1 Processor -- start 2023-11-04T01:40:54.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.726+0000 7fedd5f5e640 1 -- start start 2023-11-04T01:40:54.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.727+0000 7fedd5f5e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fedd0159c00 0x7fedd00cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:54.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.727+0000 7fedd5f5e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fedd00c48e0 0x7fedd00c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:54.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.727+0000 7fedd5f5e640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fedd00adac0 0x7fedd00adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:54.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.727+0000 7fedd5f5e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd00c52d0 con 0x7fedd0159c00 2023-11-04T01:40:54.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.727+0000 7fedd5f5e640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd015aff0 con 0x7fedd00adac0 2023-11-04T01:40:54.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.727+0000 7fedd5f5e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd00ae450 con 0x7fedd00c48e0 2023-11-04T01:40:54.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.727+0000 7fedcf7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fedd0159c00 0x7fedd00cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:54.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.727+0000 7fedcf7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fedd0159c00 0x7fedd00cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49254/0 (socket says 172.21.15.77:49254) 2023-11-04T01:40:54.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.727+0000 7fedcf7fe640 1 -- 172.21.15.77:0/330275720 learned_addr learned my addr 172.21.15.77:0/330275720 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:54.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.727+0000 7fedceffd640 1 --2- 172.21.15.77:0/330275720 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fedd00c48e0 0x7fedd00c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:54.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.727+0000 7fedcffff640 1 --2- 172.21.15.77:0/330275720 >> v2:172.21.15.122:3300/0 conn(0x7fedd00adac0 0x7fedd00adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:54.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.727+0000 7fedcf7fe640 1 -- 172.21.15.77:0/330275720 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fedd00c48e0 msgr2=0x7fedd00c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:54.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.727+0000 7fedcf7fe640 1 --2- 172.21.15.77:0/330275720 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fedd00c48e0 0x7fedd00c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:54.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.727+0000 7fedcf7fe640 1 -- 172.21.15.77:0/330275720 >> v2:172.21.15.122:3300/0 conn(0x7fedd00adac0 msgr2=0x7fedd00adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:54.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.727+0000 7fedcf7fe640 1 --2- 172.21.15.77:0/330275720 >> v2:172.21.15.122:3300/0 conn(0x7fedd00adac0 0x7fedd00adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:54.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.727+0000 7fedcf7fe640 1 -- 172.21.15.77:0/330275720 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd015a3e0 con 0x7fedd0159c00 2023-11-04T01:40:54.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.728+0000 7fedcf7fe640 1 --2- 172.21.15.77:0/330275720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedd0159c00 0x7fedd00cc890 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fedd00b4a40 tx=0x7fedc002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec1f900667d6b9b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:54.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.728+0000 7fedce7fc640 1 -- 172.21.15.77:0/330275720 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc0031870 con 0x7fedd0159c00 2023-11-04T01:40:54.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.728+0000 7fedce7fc640 1 -- 172.21.15.77:0/330275720 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc00319d0 con 0x7fedd0159c00 2023-11-04T01:40:54.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.728+0000 7fedce7fc640 1 -- 172.21.15.77:0/330275720 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc0031d60 con 0x7fedd0159c00 2023-11-04T01:40:54.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.729+0000 7fedd5f5e640 1 -- 172.21.15.77:0/330275720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedd0159c00 msgr2=0x7fedd00cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:54.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.729+0000 7fedd5f5e640 1 --2- 172.21.15.77:0/330275720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedd0159c00 0x7fedd00cc890 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fedd00b4a40 tx=0x7fedc002b910 comp rx=0 tx=0).stop 2023-11-04T01:40:54.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.729+0000 7fedd5f5e640 1 -- 172.21.15.77:0/330275720 shutdown_connections 2023-11-04T01:40:54.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.729+0000 7fedd5f5e640 1 --2- 172.21.15.77:0/330275720 >> v2:172.21.15.122:3300/0 conn(0x7fedd00adac0 0x7fedd00adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:54.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.729+0000 7fedd5f5e640 1 --2- 172.21.15.77:0/330275720 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fedd00c48e0 0x7fedd00c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:54.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.729+0000 7fedd5f5e640 1 --2- 172.21.15.77:0/330275720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedd0159c00 0x7fedd00cc890 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:54.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.729+0000 7fedd5f5e640 1 -- 172.21.15.77:0/330275720 >> 172.21.15.77:0/330275720 conn(0x7fedd00ce950 msgr2=0x7fedd00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:54.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.729+0000 7fedd5f5e640 1 -- 172.21.15.77:0/330275720 shutdown_connections 2023-11-04T01:40:54.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.729+0000 7fedd5f5e640 1 -- 172.21.15.77:0/330275720 wait complete. 2023-11-04T01:40:54.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.730+0000 7fedd5f5e640 1 Processor -- start 2023-11-04T01:40:54.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.730+0000 7fedd5f5e640 1 -- start start 2023-11-04T01:40:54.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.731+0000 7fedd5f5e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fedd00adac0 0x7fedd0140420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:54.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.731+0000 7fedd5f5e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedd00c48e0 0x7fedd00b3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:54.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.731+0000 7fedd5f5e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fedd0159c00 0x7fedd01536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:54.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.731+0000 7fedd5f5e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd01532c0 con 0x7fedd00c48e0 2023-11-04T01:40:54.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.731+0000 7fedd5f5e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd0140960 con 0x7fedd00adac0 2023-11-04T01:40:54.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.731+0000 7fedd5f5e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd0152640 con 0x7fedd0159c00 2023-11-04T01:40:54.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.731+0000 7fedceffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedd00c48e0 0x7fedd00b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:54.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.731+0000 7fedceffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedd00c48e0 0x7fedd00b3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49270/0 (socket says 172.21.15.77:49270) 2023-11-04T01:40:54.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.731+0000 7fedceffd640 1 -- 172.21.15.77:0/2674308780 learned_addr learned my addr 172.21.15.77:0/2674308780 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:54.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.731+0000 7fedcf7fe640 1 --2- 172.21.15.77:0/2674308780 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fedd00adac0 0x7fedd0140420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:54.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.731+0000 7fedcffff640 1 --2- 172.21.15.77:0/2674308780 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fedd0159c00 0x7fedd01536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:54.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.731+0000 7fedceffd640 1 -- 172.21.15.77:0/2674308780 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fedd0159c00 msgr2=0x7fedd01536e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:54.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.731+0000 7fedceffd640 1 --2- 172.21.15.77:0/2674308780 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fedd0159c00 0x7fedd01536e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:54.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.731+0000 7fedceffd640 1 -- 172.21.15.77:0/2674308780 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fedd00adac0 msgr2=0x7fedd0140420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:54.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.731+0000 7fedceffd640 1 --2- 172.21.15.77:0/2674308780 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fedd00adac0 0x7fedd0140420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:54.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.731+0000 7fedceffd640 1 -- 172.21.15.77:0/2674308780 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc00094d0 con 0x7fedd00c48e0 2023-11-04T01:40:54.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.731+0000 7fedceffd640 1 --2- 172.21.15.77:0/2674308780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedd00c48e0 0x7fedd00b3400 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fedc400d830 tx=0x7fedc400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:54.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.732+0000 7fedb7fff640 1 -- 172.21.15.77:0/2674308780 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc400b6c0 con 0x7fedd00c48e0 2023-11-04T01:40:54.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.732+0000 7fedb7fff640 1 -- 172.21.15.77:0/2674308780 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc400b820 con 0x7fedd00c48e0 2023-11-04T01:40:54.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.732+0000 7fedd5f5e640 1 -- 172.21.15.77:0/2674308780 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd0152920 con 0x7fedd00c48e0 2023-11-04T01:40:54.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.732+0000 7fedb7fff640 1 -- 172.21.15.77:0/2674308780 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc400bbb0 con 0x7fedd00c48e0 2023-11-04T01:40:54.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.732+0000 7fedd5f5e640 1 -- 172.21.15.77:0/2674308780 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd0152ee0 con 0x7fedd00c48e0 2023-11-04T01:40:54.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.733+0000 7fedd5f5e640 1 -- 172.21.15.77:0/2674308780 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedd0153400 con 0x7fedd00c48e0 2023-11-04T01:40:54.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.733+0000 7fedb7fff640 1 -- 172.21.15.77:0/2674308780 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fedc401e460 con 0x7fedd00c48e0 2023-11-04T01:40:54.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.733+0000 7fedb7fff640 1 --2- 172.21.15.77:0/2674308780 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fedbc06aea0 0x7fedbc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:54.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.734+0000 7fedb7fff640 1 -- 172.21.15.77:0/2674308780 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fedc4089fc0 con 0x7fedd00c48e0 2023-11-04T01:40:54.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.734+0000 7fedcf7fe640 1 --2- 172.21.15.77:0/2674308780 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fedbc06aea0 0x7fedbc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:54.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.734+0000 7fedcf7fe640 1 --2- 172.21.15.77:0/2674308780 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fedbc06aea0 0x7fedbc06d360 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fedc0036000 tx=0x7fedc003c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:54.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.738+0000 7fedb7fff640 1 -- 172.21.15.77:0/2674308780 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fedc40bcca0 con 0x7fedd00c48e0 2023-11-04T01:40:54.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.904+0000 7fedd5f5e640 1 -- 172.21.15.77:0/2674308780 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fedd0074290 con 0x7fedd00c48e0 2023-11-04T01:40:54.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.907+0000 7fedb7fff640 1 -- 172.21.15.77:0/2674308780 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v11)=0 v11) v1 ==== 122+0+0 (secure 0 0 0) 0x7fedd0153400 con 0x7fedd00c48e0 2023-11-04T01:40:54.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.909+0000 7fedd5f5e640 1 -- 172.21.15.77:0/2674308780 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fedbc06aea0 msgr2=0x7fedbc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:54.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.909+0000 7fedd5f5e640 1 --2- 172.21.15.77:0/2674308780 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fedbc06aea0 0x7fedbc06d360 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fedc0036000 tx=0x7fedc003c040 comp rx=0 tx=0).stop 2023-11-04T01:40:54.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.909+0000 7fedd5f5e640 1 -- 172.21.15.77:0/2674308780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedd00c48e0 msgr2=0x7fedd00b3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:54.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.909+0000 7fedd5f5e640 1 --2- 172.21.15.77:0/2674308780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedd00c48e0 0x7fedd00b3400 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fedc400d830 tx=0x7fedc400dcf0 comp rx=0 tx=0).stop 2023-11-04T01:40:54.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.909+0000 7fedd5f5e640 1 -- 172.21.15.77:0/2674308780 shutdown_connections 2023-11-04T01:40:54.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.909+0000 7fedd5f5e640 1 --2- 172.21.15.77:0/2674308780 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fedbc06aea0 0x7fedbc06d360 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:54.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.909+0000 7fedd5f5e640 1 --2- 172.21.15.77:0/2674308780 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fedd0159c00 0x7fedd01536e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:54.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.909+0000 7fedd5f5e640 1 --2- 172.21.15.77:0/2674308780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedd00c48e0 0x7fedd00b3400 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:54.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.909+0000 7fedd5f5e640 1 --2- 172.21.15.77:0/2674308780 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fedd00adac0 0x7fedd0140420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:54.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.909+0000 7fedd5f5e640 1 -- 172.21.15.77:0/2674308780 >> 172.21.15.77:0/2674308780 conn(0x7fedd00ce950 msgr2=0x7fedd006df40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:54.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.909+0000 7fedd5f5e640 1 -- 172.21.15.77:0/2674308780 shutdown_connections 2023-11-04T01:40:54.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:54.909+0000 7fedd5f5e640 1 -- 172.21.15.77:0/2674308780 wait complete. 2023-11-04T01:40:54.922 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:40:54.923 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:40:54.963 DEBUG:teuthology.orchestra.run.smithi122:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:40:55.014 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:40:55.015 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:40:55.015 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:40:55.030 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:40:55.031 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:40:55.085 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:55.127 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:2023-11-04T01:40:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:55.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.221+0000 7f6dfef9e640 1 Processor -- start 2023-11-04T01:40:55.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.221+0000 7f6dfef9e640 1 -- start start 2023-11-04T01:40:55.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.222+0000 7f6dfef9e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6df815d250 0x7f6df80c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:55.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.222+0000 7f6dfef9e640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6df80c9d70 0x7f6df80ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:55.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.222+0000 7f6dfef9e640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6df806a120 con 0x7f6df815ce70 2023-11-04T01:40:55.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.222+0000 7f6dfef9e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df80cdc10 con 0x7f6df815d250 2023-11-04T01:40:55.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.222+0000 7f6dfef9e640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df806a370 con 0x7f6df80c9d70 2023-11-04T01:40:55.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.222+0000 7f6df7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6df815d250 0x7f6df80c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:55.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.222+0000 7f6df7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6df815d250 0x7f6df80c9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49280/0 (socket says 172.21.15.77:49280) 2023-11-04T01:40:55.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.222+0000 7f6df7fff640 1 -- 172.21.15.77:0/5344083 learned_addr learned my addr 172.21.15.77:0/5344083 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:55.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.222+0000 7f6dfd53b640 1 --2- 172.21.15.77:0/5344083 >> v2:172.21.15.122:3300/0 conn(0x7f6df80c9d70 0x7f6df80ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:55.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.222+0000 7f6df7fff640 1 -- 172.21.15.77:0/5344083 >> v2:172.21.15.122:3300/0 conn(0x7f6df80c9d70 msgr2=0x7f6df80ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:55.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.222+0000 7f6df7fff640 1 --2- 172.21.15.77:0/5344083 >> v2:172.21.15.122:3300/0 conn(0x7f6df80c9d70 0x7f6df80ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:55.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.222+0000 7f6df7fff640 1 -- 172.21.15.77:0/5344083 >> v1:172.21.15.122:6789/0 conn(0x7f6df815ce70 legacy=0x7f6df806d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:55.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.223+0000 7f6df7fff640 1 -- 172.21.15.77:0/5344083 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df806a650 con 0x7f6df815d250 2023-11-04T01:40:55.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.223+0000 7f6dfd53b640 1 --2- 172.21.15.77:0/5344083 >> v2:172.21.15.122:3300/0 conn(0x7f6df80c9d70 0x7f6df80ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:55.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.223+0000 7f6df7fff640 1 --2- 172.21.15.77:0/5344083 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6df815d250 0x7f6df80c9830 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6df809cee0 tx=0x7f6dec02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a34996eddf5bd3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:55.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.223+0000 7f6df77fe640 1 -- 172.21.15.77:0/5344083 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dec031870 con 0x7f6df815d250 2023-11-04T01:40:55.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.223+0000 7f6df77fe640 1 -- 172.21.15.77:0/5344083 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dec0319d0 con 0x7f6df815d250 2023-11-04T01:40:55.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.223+0000 7f6df77fe640 1 -- 172.21.15.77:0/5344083 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dec031d60 con 0x7f6df815d250 2023-11-04T01:40:55.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.224+0000 7f6dfef9e640 1 -- 172.21.15.77:0/5344083 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6df815d250 msgr2=0x7f6df80c9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:55.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.224+0000 7f6dfef9e640 1 --2- 172.21.15.77:0/5344083 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6df815d250 0x7f6df80c9830 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6df809cee0 tx=0x7f6dec02b910 comp rx=0 tx=0).stop 2023-11-04T01:40:55.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.224+0000 7f6dfef9e640 1 -- 172.21.15.77:0/5344083 shutdown_connections 2023-11-04T01:40:55.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.224+0000 7f6dfef9e640 1 --2- 172.21.15.77:0/5344083 >> v2:172.21.15.122:3300/0 conn(0x7f6df80c9d70 0x7f6df80ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:55.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.224+0000 7f6dfef9e640 1 --2- 172.21.15.77:0/5344083 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6df815d250 0x7f6df80c9830 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:55.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.224+0000 7f6dfef9e640 1 -- 172.21.15.77:0/5344083 >> 172.21.15.77:0/5344083 conn(0x7f6df80b0cd0 msgr2=0x7f6df80b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:55.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.224+0000 7f6dfef9e640 1 -- 172.21.15.77:0/5344083 shutdown_connections 2023-11-04T01:40:55.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.224+0000 7f6dfef9e640 1 -- 172.21.15.77:0/5344083 wait complete. 2023-11-04T01:40:55.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.225+0000 7f6dfef9e640 1 Processor -- start 2023-11-04T01:40:55.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.225+0000 7f6dfef9e640 1 -- start start 2023-11-04T01:40:55.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.226+0000 7f6dfef9e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6df815ce70 0x7f6df815bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:55.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.226+0000 7f6dfef9e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6df815d250 0x7f6df81e63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:55.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.226+0000 7f6dfef9e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6df815c8d0 0x7f6df80c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:55.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.226+0000 7f6dfef9e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df81e2fa0 con 0x7f6df815d250 2023-11-04T01:40:55.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.226+0000 7f6dfef9e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df81e2400 con 0x7f6df815ce70 2023-11-04T01:40:55.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.226+0000 7f6dfef9e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df81e6900 con 0x7f6df815c8d0 2023-11-04T01:40:55.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.226+0000 7f6df7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6df815d250 0x7f6df81e63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:55.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.226+0000 7f6df7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6df815d250 0x7f6df81e63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49286/0 (socket says 172.21.15.77:49286) 2023-11-04T01:40:55.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.226+0000 7f6df7fff640 1 -- 172.21.15.77:0/2144861 learned_addr learned my addr 172.21.15.77:0/2144861 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:55.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.226+0000 7f6dfd53b640 1 --2- 172.21.15.77:0/2144861 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6df815c8d0 0x7f6df80c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:55.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.226+0000 7f6df7fff640 1 -- 172.21.15.77:0/2144861 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6df815c8d0 msgr2=0x7f6df80c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:55.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.226+0000 7f6dfcd3a640 1 --2- 172.21.15.77:0/2144861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6df815ce70 0x7f6df815bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:55.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.226+0000 7f6df7fff640 1 --2- 172.21.15.77:0/2144861 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6df815c8d0 0x7f6df80c89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:55.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.226+0000 7f6df7fff640 1 -- 172.21.15.77:0/2144861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6df815ce70 msgr2=0x7f6df815bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:55.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.226+0000 7f6df7fff640 1 --2- 172.21.15.77:0/2144861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6df815ce70 0x7f6df815bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:55.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.226+0000 7f6df7fff640 1 -- 172.21.15.77:0/2144861 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dec0094d0 con 0x7f6df815d250 2023-11-04T01:40:55.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.227+0000 7f6df7fff640 1 --2- 172.21.15.77:0/2144861 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6df815d250 0x7f6df81e63c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6dec02b950 tx=0x7f6dec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:55.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.227+0000 7f6df57fa640 1 -- 172.21.15.77:0/2144861 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dec031840 con 0x7f6df815d250 2023-11-04T01:40:55.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.227+0000 7f6df57fa640 1 -- 172.21.15.77:0/2144861 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dec0443f0 con 0x7f6df815d250 2023-11-04T01:40:55.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.227+0000 7f6df57fa640 1 -- 172.21.15.77:0/2144861 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dec0447a0 con 0x7f6df815d250 2023-11-04T01:40:55.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.227+0000 7f6dfef9e640 1 -- 172.21.15.77:0/2144861 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6df81e2670 con 0x7f6df815d250 2023-11-04T01:40:55.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.227+0000 7f6dfef9e640 1 -- 172.21.15.77:0/2144861 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6df81e2c30 con 0x7f6df815d250 2023-11-04T01:40:55.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.228+0000 7f6dfef9e640 1 -- 172.21.15.77:0/2144861 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6df8074290 con 0x7f6df815d250 2023-11-04T01:40:55.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.228+0000 7f6df57fa640 1 -- 172.21.15.77:0/2144861 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6dec044900 con 0x7f6df815d250 2023-11-04T01:40:55.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.229+0000 7f6df57fa640 1 --2- 172.21.15.77:0/2144861 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6de406ae70 0x7f6de406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:55.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.229+0000 7f6df57fa640 1 -- 172.21.15.77:0/2144861 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6dec02d040 con 0x7f6df815d250 2023-11-04T01:40:55.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.229+0000 7f6dfcd3a640 1 --2- 172.21.15.77:0/2144861 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6de406ae70 0x7f6de406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:55.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.229+0000 7f6dfcd3a640 1 --2- 172.21.15.77:0/2144861 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6de406ae70 0x7f6de406d330 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6df81e61b0 tx=0x7f6de8009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:55.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.233+0000 7f6df57fa640 1 -- 172.21.15.77:0/2144861 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6dec076fa0 con 0x7f6df815d250 2023-11-04T01:40:55.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.401+0000 7f6dfef9e640 1 -- 172.21.15.77:0/2144861 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6df8066170 con 0x7f6df815d250 2023-11-04T01:40:55.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.403+0000 7f6df57fa640 1 -- 172.21.15.77:0/2144861 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18661 (secure 0 0 0) 0x7f6dec07a5c0 con 0x7f6df815d250 2023-11-04T01:40:55.406 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:55.406 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":26,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:40:47.579547+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:40:02.810971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:40:04.003979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:40:07.734355+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:55.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.404+0000 7f6dfef9e640 1 -- 172.21.15.77:0/2144861 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6de406ae70 msgr2=0x7f6de406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:55.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.404+0000 7f6dfef9e640 1 --2- 172.21.15.77:0/2144861 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6de406ae70 0x7f6de406d330 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6df81e61b0 tx=0x7f6de8009040 comp rx=0 tx=0).stop 2023-11-04T01:40:55.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.404+0000 7f6dfef9e640 1 -- 172.21.15.77:0/2144861 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6df815d250 msgr2=0x7f6df81e63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:55.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.404+0000 7f6dfef9e640 1 --2- 172.21.15.77:0/2144861 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6df815d250 0x7f6df81e63c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6dec02b950 tx=0x7f6dec0046c0 comp rx=0 tx=0).stop 2023-11-04T01:40:55.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.405+0000 7f6dfef9e640 1 -- 172.21.15.77:0/2144861 shutdown_connections 2023-11-04T01:40:55.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.405+0000 7f6dfef9e640 1 --2- 172.21.15.77:0/2144861 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6de406ae70 0x7f6de406d330 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:55.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.405+0000 7f6dfef9e640 1 --2- 172.21.15.77:0/2144861 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6df815c8d0 0x7f6df80c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:55.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.405+0000 7f6dfef9e640 1 --2- 172.21.15.77:0/2144861 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6df815d250 0x7f6df81e63c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:55.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.405+0000 7f6dfef9e640 1 --2- 172.21.15.77:0/2144861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6df815ce70 0x7f6df815bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:55.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.405+0000 7f6dfef9e640 1 -- 172.21.15.77:0/2144861 >> 172.21.15.77:0/2144861 conn(0x7f6df80b0cd0 msgr2=0x7f6df80c1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:55.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.405+0000 7f6dfef9e640 1 -- 172.21.15.77:0/2144861 shutdown_connections 2023-11-04T01:40:55.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.405+0000 7f6dfef9e640 1 -- 172.21.15.77:0/2144861 wait complete. 2023-11-04T01:40:55.418 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:40:02.810971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:40:04.003979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:40:07.734355+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:40:55.419 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:40:55.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.519+0000 7f9cedd83640 1 Processor -- start 2023-11-04T01:40:55.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.519+0000 7f9cedd83640 1 -- start start 2023-11-04T01:40:55.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.520+0000 7f9cedd83640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9ce80cc520 0x7f9ce8070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:55.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.520+0000 7f9cedd83640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ce80c3860 con 0x7f9ce80cc9a0 2023-11-04T01:40:55.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.520+0000 7f9cedd83640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ce80c9250 con 0x7f9ce8153850 2023-11-04T01:40:55.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.520+0000 7f9cedd83640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce8070e20 con 0x7f9ce80cc520 2023-11-04T01:40:55.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.520+0000 7f9ce7fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f9ce80cc9a0 0x7f9ce8070710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36612/0 (socket says 172.21.15.77:36612) 2023-11-04T01:40:55.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.520+0000 7f9ce7fff640 1 -- 172.21.15.77:0/790097256 learned_addr learned my addr 172.21.15.77:0/790097256 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:55.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.520+0000 7f9ce6ffd640 1 --2- 172.21.15.77:0/790097256 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9ce80cc520 0x7f9ce8070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:55.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.520+0000 7f9ce67fc640 1 -- 172.21.15.77:0/790097256 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2999563426 0 0) 0x7f9ce80c3860 con 0x7f9ce80cc9a0 2023-11-04T01:40:55.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.520+0000 7f9ce67fc640 1 -- 172.21.15.77:0/790097256 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cd0003520 con 0x7f9ce80cc9a0 2023-11-04T01:40:55.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.521+0000 7f9ce67fc640 1 -- 172.21.15.77:0/790097256 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 656358617 0 0) 0x7f9ce80c9250 con 0x7f9ce8153850 2023-11-04T01:40:55.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.521+0000 7f9ce67fc640 1 -- 172.21.15.77:0/790097256 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ce80c3860 con 0x7f9ce8153850 2023-11-04T01:40:55.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.521+0000 7f9ce6ffd640 1 -- 172.21.15.77:0/790097256 >> v1:172.21.15.122:6789/0 conn(0x7f9ce8153850 legacy=0x7f9ce815a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:55.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.521+0000 7f9ce6ffd640 1 -- 172.21.15.77:0/790097256 >> v1:172.21.15.77:6789/0 conn(0x7f9ce80cc9a0 legacy=0x7f9ce8070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:55.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.521+0000 7f9ce6ffd640 1 -- 172.21.15.77:0/790097256 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce8153c30 con 0x7f9ce80cc520 2023-11-04T01:40:55.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.521+0000 7f9ce6ffd640 1 --2- 172.21.15.77:0/790097256 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9ce80cc520 0x7f9ce8070fa0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc0097d0 tx=0x7f9cdc02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abadea7b9f45b77d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:55.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.522+0000 7f9ce67fc640 1 -- 172.21.15.77:0/790097256 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc031890 con 0x7f9ce80cc520 2023-11-04T01:40:55.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.522+0000 7f9ce67fc640 1 -- 172.21.15.77:0/790097256 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cdc0319f0 con 0x7f9ce80cc520 2023-11-04T01:40:55.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.522+0000 7f9ce67fc640 1 -- 172.21.15.77:0/790097256 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc031d80 con 0x7f9ce80cc520 2023-11-04T01:40:55.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.522+0000 7f9cedd83640 1 -- 172.21.15.77:0/790097256 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9ce80cc520 msgr2=0x7f9ce8070fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:55.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.522+0000 7f9cedd83640 1 --2- 172.21.15.77:0/790097256 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9ce80cc520 0x7f9ce8070fa0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc0097d0 tx=0x7f9cdc02b930 comp rx=0 tx=0).stop 2023-11-04T01:40:55.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.522+0000 7f9cedd83640 1 -- 172.21.15.77:0/790097256 shutdown_connections 2023-11-04T01:40:55.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.522+0000 7f9cedd83640 1 --2- 172.21.15.77:0/790097256 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9ce80cc520 0x7f9ce8070fa0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:55.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.522+0000 7f9cedd83640 1 -- 172.21.15.77:0/790097256 >> 172.21.15.77:0/790097256 conn(0x7f9ce80ce950 msgr2=0x7f9ce80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:55.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.522+0000 7f9cedd83640 1 -- 172.21.15.77:0/790097256 shutdown_connections 2023-11-04T01:40:55.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.522+0000 7f9cedd83640 1 -- 172.21.15.77:0/790097256 wait complete. 2023-11-04T01:40:55.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.523+0000 7f9cedd83640 1 Processor -- start 2023-11-04T01:40:55.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.523+0000 7f9cedd83640 1 -- start start 2023-11-04T01:40:55.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.524+0000 7f9cedd83640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9ce80cc520 0x7f9ce80c7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:55.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.524+0000 7f9cedd83640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ce80cc9a0 0x7f9ce81435c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:55.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.524+0000 7f9cedd83640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ce8153850 0x7f9ce8159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:55.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.524+0000 7f9cedd83640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce8147180 con 0x7f9ce8153850 2023-11-04T01:40:55.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.524+0000 7f9cedd83640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce80c7e70 con 0x7f9ce80cc9a0 2023-11-04T01:40:55.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.524+0000 7f9cedd83640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce80c8150 con 0x7f9ce80cc520 2023-11-04T01:40:55.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.524+0000 7f9ce7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ce8153850 0x7f9ce8159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:55.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.524+0000 7f9ce7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ce8153850 0x7f9ce8159790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49292/0 (socket says 172.21.15.77:49292) 2023-11-04T01:40:55.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.524+0000 7f9ce7fff640 1 -- 172.21.15.77:0/3374019602 learned_addr learned my addr 172.21.15.77:0/3374019602 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:55.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.525+0000 7f9ce7fff640 1 -- 172.21.15.77:0/3374019602 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9ce80cc520 msgr2=0x7f9ce80c7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:55.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.525+0000 7f9ce7fff640 1 --2- 172.21.15.77:0/3374019602 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9ce80cc520 0x7f9ce80c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:55.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.525+0000 7f9ce7fff640 1 -- 172.21.15.77:0/3374019602 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ce80cc9a0 msgr2=0x7f9ce81435c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:55.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.525+0000 7f9ce6ffd640 1 --2- 172.21.15.77:0/3374019602 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ce80cc9a0 0x7f9ce81435c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:55.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.525+0000 7f9ce7fff640 1 --2- 172.21.15.77:0/3374019602 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ce80cc9a0 0x7f9ce81435c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:55.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.525+0000 7f9ce7fff640 1 -- 172.21.15.77:0/3374019602 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cdc009400 con 0x7f9ce8153850 2023-11-04T01:40:55.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.525+0000 7f9ce7fff640 1 --2- 172.21.15.77:0/3374019602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ce8153850 0x7f9ce8159790 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9ce000cbc0 tx=0x7f9ce000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:55.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.525+0000 7f9ccffff640 1 -- 172.21.15.77:0/3374019602 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce000aca0 con 0x7f9ce8153850 2023-11-04T01:40:55.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.525+0000 7f9ccffff640 1 -- 172.21.15.77:0/3374019602 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce000ae00 con 0x7f9ce8153850 2023-11-04T01:40:55.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.525+0000 7f9cedd83640 1 -- 172.21.15.77:0/3374019602 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ce80c8430 con 0x7f9ce8153850 2023-11-04T01:40:55.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.525+0000 7f9ccffff640 1 -- 172.21.15.77:0/3374019602 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce0012600 con 0x7f9ce8153850 2023-11-04T01:40:55.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.525+0000 7f9cedd83640 1 -- 172.21.15.77:0/3374019602 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ce8148d50 con 0x7f9ce8153850 2023-11-04T01:40:55.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.526+0000 7f9cedd83640 1 -- 172.21.15.77:0/3374019602 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ce8148fa0 con 0x7f9ce8153850 2023-11-04T01:40:55.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.526+0000 7f9ccffff640 1 -- 172.21.15.77:0/3374019602 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9ce0007070 con 0x7f9ce8153850 2023-11-04T01:40:55.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.527+0000 7f9ccffff640 1 --2- 172.21.15.77:0/3374019602 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9cd406ae70 0x7f9cd406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:55.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.527+0000 7f9ccffff640 1 -- 172.21.15.77:0/3374019602 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9ce0089880 con 0x7f9ce8153850 2023-11-04T01:40:55.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.527+0000 7f9ce77fe640 1 --2- 172.21.15.77:0/3374019602 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9cd406ae70 0x7f9cd406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:55.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.527+0000 7f9ce77fe640 1 --2- 172.21.15.77:0/3374019602 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9cd406ae70 0x7f9cd406d330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9cd80010e0 tx=0x7f9cd8007950 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:55.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.531+0000 7f9ccffff640 1 -- 172.21.15.77:0/3374019602 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9ce0054630 con 0x7f9ce8153850 2023-11-04T01:40:55.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.701+0000 7f9cedd83640 1 -- 172.21.15.77:0/3374019602 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9ce8074290 con 0x7f9ce8153850 2023-11-04T01:40:55.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.701+0000 7f9ccffff640 1 -- 172.21.15.77:0/3374019602 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9ce0017020 con 0x7f9ce8153850 2023-11-04T01:40:55.704 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:40:55.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.703+0000 7f9cedd83640 1 -- 172.21.15.77:0/3374019602 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9cd406ae70 msgr2=0x7f9cd406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:55.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.703+0000 7f9cedd83640 1 --2- 172.21.15.77:0/3374019602 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9cd406ae70 0x7f9cd406d330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9cd80010e0 tx=0x7f9cd8007950 comp rx=0 tx=0).stop 2023-11-04T01:40:55.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.703+0000 7f9cedd83640 1 -- 172.21.15.77:0/3374019602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ce8153850 msgr2=0x7f9ce8159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:55.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.703+0000 7f9cedd83640 1 --2- 172.21.15.77:0/3374019602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ce8153850 0x7f9ce8159790 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9ce000cbc0 tx=0x7f9ce000a060 comp rx=0 tx=0).stop 2023-11-04T01:40:55.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.703+0000 7f9cedd83640 1 -- 172.21.15.77:0/3374019602 shutdown_connections 2023-11-04T01:40:55.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.703+0000 7f9cedd83640 1 --2- 172.21.15.77:0/3374019602 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9cd406ae70 0x7f9cd406d330 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:55.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.703+0000 7f9cedd83640 1 --2- 172.21.15.77:0/3374019602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ce8153850 0x7f9ce8159790 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:55.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.703+0000 7f9cedd83640 1 --2- 172.21.15.77:0/3374019602 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ce80cc9a0 0x7f9ce81435c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:55.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.703+0000 7f9cedd83640 1 --2- 172.21.15.77:0/3374019602 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9ce80cc520 0x7f9ce80c7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:55.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.703+0000 7f9cedd83640 1 -- 172.21.15.77:0/3374019602 >> 172.21.15.77:0/3374019602 conn(0x7f9ce80ce950 msgr2=0x7f9ce815bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:55.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.703+0000 7f9cedd83640 1 -- 172.21.15.77:0/3374019602 shutdown_connections 2023-11-04T01:40:55.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.703+0000 7f9cedd83640 1 -- 172.21.15.77:0/3374019602 wait complete. 2023-11-04T01:40:55.717 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:40:55.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.816+0000 7f3b457b0640 1 Processor -- start 2023-11-04T01:40:55.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.817+0000 7f3b457b0640 1 -- start start 2023-11-04T01:40:55.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.817+0000 7f3b457b0640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3b40159c00 0x7f3b400cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:55.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.817+0000 7f3b457b0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3b400c48e0 0x7f3b400c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:55.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.817+0000 7f3b457b0640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b4015aff0 con 0x7f3b400adac0 2023-11-04T01:40:55.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.817+0000 7f3b457b0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b400c52a0 con 0x7f3b400c48e0 2023-11-04T01:40:55.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.817+0000 7f3b457b0640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4015a3e0 con 0x7f3b40159c00 2023-11-04T01:40:55.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.817+0000 7f3b3e7fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3b400c48e0 0x7f3b400c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:55.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.817+0000 7f3b3e7fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3b400c48e0 0x7f3b400c4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49300/0 (socket says 172.21.15.77:49300) 2023-11-04T01:40:55.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.817+0000 7f3b3e7fc640 1 -- 172.21.15.77:0/1777411377 learned_addr learned my addr 172.21.15.77:0/1777411377 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:55.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.818+0000 7f3b3e7fc640 1 -- 172.21.15.77:0/1777411377 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3b40159c00 msgr2=0x7f3b400cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:55.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.818+0000 7f3b3e7fc640 1 --2- 172.21.15.77:0/1777411377 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3b40159c00 0x7f3b400cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:55.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.818+0000 7f3b3e7fc640 1 -- 172.21.15.77:0/1777411377 >> v1:172.21.15.122:6789/0 conn(0x7f3b400adac0 legacy=0x7f3b400adef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:55.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.818+0000 7f3b3e7fc640 1 -- 172.21.15.77:0/1777411377 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4015a6c0 con 0x7f3b400c48e0 2023-11-04T01:40:55.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.818+0000 7f3b3e7fc640 1 --2- 172.21.15.77:0/1777411377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b400c48e0 0x7f3b400c4d60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3b34009870 tx=0x7f3b3402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5782fc665306c97e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:55.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.819+0000 7f3b3dffb640 1 -- 172.21.15.77:0/1777411377 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b34031640 con 0x7f3b400c48e0 2023-11-04T01:40:55.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.819+0000 7f3b3dffb640 1 -- 172.21.15.77:0/1777411377 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b340317a0 con 0x7f3b400c48e0 2023-11-04T01:40:55.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.819+0000 7f3b3dffb640 1 -- 172.21.15.77:0/1777411377 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b34031b30 con 0x7f3b400c48e0 2023-11-04T01:40:55.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.819+0000 7f3b457b0640 1 -- 172.21.15.77:0/1777411377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b400c48e0 msgr2=0x7f3b400c4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:55.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.819+0000 7f3b457b0640 1 --2- 172.21.15.77:0/1777411377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b400c48e0 0x7f3b400c4d60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3b34009870 tx=0x7f3b3402b8f0 comp rx=0 tx=0).stop 2023-11-04T01:40:55.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.819+0000 7f3b457b0640 1 -- 172.21.15.77:0/1777411377 shutdown_connections 2023-11-04T01:40:55.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.819+0000 7f3b457b0640 1 --2- 172.21.15.77:0/1777411377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b400c48e0 0x7f3b400c4d60 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:55.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.819+0000 7f3b457b0640 1 --2- 172.21.15.77:0/1777411377 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3b40159c00 0x7f3b400cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:55.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.819+0000 7f3b457b0640 1 -- 172.21.15.77:0/1777411377 >> 172.21.15.77:0/1777411377 conn(0x7f3b400ce950 msgr2=0x7f3b400ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:55.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.819+0000 7f3b457b0640 1 -- 172.21.15.77:0/1777411377 shutdown_connections 2023-11-04T01:40:55.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.819+0000 7f3b457b0640 1 -- 172.21.15.77:0/1777411377 wait complete. 2023-11-04T01:40:55.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.820+0000 7f3b457b0640 1 Processor -- start 2023-11-04T01:40:55.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.821+0000 7f3b457b0640 1 -- start start 2023-11-04T01:40:55.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.821+0000 7f3b457b0640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3b400adac0 0x7f3b400acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:55.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.821+0000 7f3b457b0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b400c48e0 0x7f3b400c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:55.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.821+0000 7f3b457b0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b40159c00 0x7f3b4014b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:55.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.821+0000 7f3b457b0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b40153000 con 0x7f3b40159c00 2023-11-04T01:40:55.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.821+0000 7f3b457b0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b40153210 con 0x7f3b400c48e0 2023-11-04T01:40:55.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.821+0000 7f3b457b0640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b401534f0 con 0x7f3b400adac0 2023-11-04T01:40:55.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.821+0000 7f3b3f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b40159c00 0x7f3b4014b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:55.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.821+0000 7f3b3f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b40159c00 0x7f3b4014b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49308/0 (socket says 172.21.15.77:49308) 2023-11-04T01:40:55.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.821+0000 7f3b3f7fe640 1 -- 172.21.15.77:0/2029570626 learned_addr learned my addr 172.21.15.77:0/2029570626 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:55.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.822+0000 7f3b3e7fc640 1 --2- 172.21.15.77:0/2029570626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b400c48e0 0x7f3b400c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:55.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.822+0000 7f3b3effd640 1 --2- 172.21.15.77:0/2029570626 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3b400adac0 0x7f3b400acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:55.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.822+0000 7f3b3f7fe640 1 -- 172.21.15.77:0/2029570626 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3b400adac0 msgr2=0x7f3b400acbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:55.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.822+0000 7f3b3f7fe640 1 --2- 172.21.15.77:0/2029570626 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3b400adac0 0x7f3b400acbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:55.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.822+0000 7f3b3f7fe640 1 -- 172.21.15.77:0/2029570626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b400c48e0 msgr2=0x7f3b400c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:55.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.822+0000 7f3b3f7fe640 1 --2- 172.21.15.77:0/2029570626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b400c48e0 0x7f3b400c7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:55.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.822+0000 7f3b3f7fe640 1 -- 172.21.15.77:0/2029570626 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b340094d0 con 0x7f3b40159c00 2023-11-04T01:40:55.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.822+0000 7f3b3e7fc640 1 --2- 172.21.15.77:0/2029570626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b400c48e0 0x7f3b400c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:55.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.822+0000 7f3b3effd640 1 --2- 172.21.15.77:0/2029570626 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3b400adac0 0x7f3b400acbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:55.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.822+0000 7f3b3f7fe640 1 --2- 172.21.15.77:0/2029570626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b40159c00 0x7f3b4014b2d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3b3800b490 tx=0x7f3b3800b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:55.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.822+0000 7f3b277fe640 1 -- 172.21.15.77:0/2029570626 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b38011830 con 0x7f3b40159c00 2023-11-04T01:40:55.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.822+0000 7f3b277fe640 1 -- 172.21.15.77:0/2029570626 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b380119b0 con 0x7f3b40159c00 2023-11-04T01:40:55.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.822+0000 7f3b457b0640 1 -- 172.21.15.77:0/2029570626 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b401537d0 con 0x7f3b40159c00 2023-11-04T01:40:55.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.822+0000 7f3b277fe640 1 -- 172.21.15.77:0/2029570626 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b38011d60 con 0x7f3b40159c00 2023-11-04T01:40:55.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.822+0000 7f3b457b0640 1 -- 172.21.15.77:0/2029570626 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b400ad130 con 0x7f3b40159c00 2023-11-04T01:40:55.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.823+0000 7f3b457b0640 1 -- 172.21.15.77:0/2029570626 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b40153cf0 con 0x7f3b40159c00 2023-11-04T01:40:55.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.823+0000 7f3b277fe640 1 -- 172.21.15.77:0/2029570626 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3b3801a400 con 0x7f3b40159c00 2023-11-04T01:40:55.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.824+0000 7f3b277fe640 1 --2- 172.21.15.77:0/2029570626 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3b2c06aea0 0x7f3b2c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:55.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.824+0000 7f3b277fe640 1 -- 172.21.15.77:0/2029570626 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3b380899a0 con 0x7f3b40159c00 2023-11-04T01:40:55.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.824+0000 7f3b3effd640 1 --2- 172.21.15.77:0/2029570626 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3b2c06aea0 0x7f3b2c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:55.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.824+0000 7f3b3effd640 1 --2- 172.21.15.77:0/2029570626 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3b2c06aea0 0x7f3b2c06d360 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3b30007eb0 tx=0x7f3b300073c0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:55.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.828+0000 7f3b277fe640 1 -- 172.21.15.77:0/2029570626 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3b40153cf0 con 0x7f3b40159c00 2023-11-04T01:40:55.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.993+0000 7f3b457b0640 1 -- 172.21.15.77:0/2029570626 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3b40153cf0 con 0x7f3b40159c00 2023-11-04T01:40:55.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.993+0000 7f3b277fe640 1 -- 172.21.15.77:0/2029570626 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3b38015020 con 0x7f3b40159c00 2023-11-04T01:40:55.997 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:40:55.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.995+0000 7f3b457b0640 1 -- 172.21.15.77:0/2029570626 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3b2c06aea0 msgr2=0x7f3b2c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:55.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.995+0000 7f3b457b0640 1 --2- 172.21.15.77:0/2029570626 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3b2c06aea0 0x7f3b2c06d360 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3b30007eb0 tx=0x7f3b300073c0 comp rx=0 tx=0).stop 2023-11-04T01:40:55.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.995+0000 7f3b457b0640 1 -- 172.21.15.77:0/2029570626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b40159c00 msgr2=0x7f3b4014b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:55.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.995+0000 7f3b457b0640 1 --2- 172.21.15.77:0/2029570626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b40159c00 0x7f3b4014b2d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3b3800b490 tx=0x7f3b3800b950 comp rx=0 tx=0).stop 2023-11-04T01:40:55.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.995+0000 7f3b457b0640 1 -- 172.21.15.77:0/2029570626 shutdown_connections 2023-11-04T01:40:55.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.995+0000 7f3b457b0640 1 --2- 172.21.15.77:0/2029570626 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3b2c06aea0 0x7f3b2c06d360 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:55.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.995+0000 7f3b457b0640 1 --2- 172.21.15.77:0/2029570626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b40159c00 0x7f3b4014b2d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:55.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.995+0000 7f3b457b0640 1 --2- 172.21.15.77:0/2029570626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3b400c48e0 0x7f3b400c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.995+0000 7f3b457b0640 1 --2- 172.21.15.77:0/2029570626 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3b400adac0 0x7f3b400acbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.995+0000 7f3b457b0640 1 -- 172.21.15.77:0/2029570626 >> 172.21.15.77:0/2029570626 conn(0x7f3b400ce950 msgr2=0x7f3b400cb340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:56.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.995+0000 7f3b457b0640 1 -- 172.21.15.77:0/2029570626 shutdown_connections 2023-11-04T01:40:56.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:55.995+0000 7f3b457b0640 1 -- 172.21.15.77:0/2029570626 wait complete. 2023-11-04T01:40:56.009 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:40:56.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.108+0000 7efc70739640 1 Processor -- start 2023-11-04T01:40:56.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.108+0000 7efc70739640 1 -- start start 2023-11-04T01:40:56.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.109+0000 7efc70739640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7efc6815d1b0 0x7efc680cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.109+0000 7efc70739640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc680c9bf0 con 0x7efc68070ff0 2023-11-04T01:40:56.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.109+0000 7efc70739640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc680cd890 con 0x7efc68066000 2023-11-04T01:40:56.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.109+0000 7efc70739640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc680cdb30 con 0x7efc6815d1b0 2023-11-04T01:40:56.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.109+0000 7efc6e4d5640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7efc68070ff0 0x7efc680713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36618/0 (socket says 172.21.15.77:36618) 2023-11-04T01:40:56.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.109+0000 7efc6e4d5640 1 -- 172.21.15.77:0/2193147423 learned_addr learned my addr 172.21.15.77:0/2193147423 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:56.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.109+0000 7efc6dcd4640 1 --2- 172.21.15.77:0/2193147423 >> v2:172.21.15.122:3300/0 conn(0x7efc6815d1b0 0x7efc680cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.109+0000 7efc6d4d3640 1 -- 172.21.15.77:0/2193147423 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2535810411 0 0) 0x7efc680c9bf0 con 0x7efc68070ff0 2023-11-04T01:40:56.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.109+0000 7efc6d4d3640 1 -- 172.21.15.77:0/2193147423 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc54003520 con 0x7efc68070ff0 2023-11-04T01:40:56.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.109+0000 7efc6d4d3640 1 -- 172.21.15.77:0/2193147423 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 243638575 0 0) 0x7efc54003520 con 0x7efc68070ff0 2023-11-04T01:40:56.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.109+0000 7efc6d4d3640 1 -- 172.21.15.77:0/2193147423 >> v2:172.21.15.122:3300/0 conn(0x7efc6815d1b0 msgr2=0x7efc680cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:56.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.109+0000 7efc6d4d3640 1 --2- 172.21.15.77:0/2193147423 >> v2:172.21.15.122:3300/0 conn(0x7efc6815d1b0 0x7efc680cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.109+0000 7efc6d4d3640 1 -- 172.21.15.77:0/2193147423 >> v1:172.21.15.122:6789/0 conn(0x7efc68066000 legacy=0x7efc6806a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.109+0000 7efc6d4d3640 1 -- 172.21.15.77:0/2193147423 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc680cde10 con 0x7efc68070ff0 2023-11-04T01:40:56.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.109+0000 7efc6d4d3640 1 -- 172.21.15.77:0/2193147423 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7efc58001670 con 0x7efc68070ff0 2023-11-04T01:40:56.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.109+0000 7efc6d4d3640 1 -- 172.21.15.77:0/2193147423 >> v1:172.21.15.77:6789/0 conn(0x7efc68070ff0 legacy=0x7efc680713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.109+0000 7efc6d4d3640 1 --2- 172.21.15.77:0/2193147423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc54003970 0x7efc54003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.109+0000 7efc6d4d3640 1 --2- 172.21.15.77:0/2193147423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc54004370 0x7efc54004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.109+0000 7efc6d4d3640 1 --2- 172.21.15.77:0/2193147423 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc54005040 0x7efc5400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.109+0000 7efc6d4d3640 1 -- 172.21.15.77:0/2193147423 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc680cdb30 con 0x7efc54004370 2023-11-04T01:40:56.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.109+0000 7efc6d4d3640 1 -- 172.21.15.77:0/2193147423 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5400bfa0 con 0x7efc54003970 2023-11-04T01:40:56.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.109+0000 7efc6d4d3640 1 -- 172.21.15.77:0/2193147423 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5400c160 con 0x7efc54005040 2023-11-04T01:40:56.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.110+0000 7efc6dcd4640 1 --2- 172.21.15.77:0/2193147423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc54004370 0x7efc54004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.110+0000 7efc6e4d5640 1 --2- 172.21.15.77:0/2193147423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc54003970 0x7efc54003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.110+0000 7efc6ecd6640 1 --2- 172.21.15.77:0/2193147423 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc54005040 0x7efc5400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.110+0000 7efc6dcd4640 1 -- 172.21.15.77:0/2193147423 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc54005040 msgr2=0x7efc5400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:56.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.110+0000 7efc6dcd4640 1 --2- 172.21.15.77:0/2193147423 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc54005040 0x7efc5400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.110+0000 7efc6dcd4640 1 -- 172.21.15.77:0/2193147423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc54003970 msgr2=0x7efc54003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:56.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.110+0000 7efc6dcd4640 1 --2- 172.21.15.77:0/2193147423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc54003970 0x7efc54003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.110+0000 7efc6dcd4640 1 -- 172.21.15.77:0/2193147423 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc54003520 con 0x7efc54004370 2023-11-04T01:40:56.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.110+0000 7efc6ecd6640 1 -- 172.21.15.77:0/2193147423 reap_dead start 2023-11-04T01:40:56.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.111+0000 7efc6dcd4640 1 --2- 172.21.15.77:0/2193147423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc54004370 0x7efc54004840 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7efc64009a90 tx=0x7efc540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104dd6ff8b8536bb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:56.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.111+0000 7efc6d4d3640 1 -- 172.21.15.77:0/2193147423 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6402c6b0 con 0x7efc54004370 2023-11-04T01:40:56.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.111+0000 7efc6d4d3640 1 -- 172.21.15.77:0/2193147423 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6402c810 con 0x7efc54004370 2023-11-04T01:40:56.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.111+0000 7efc6d4d3640 1 -- 172.21.15.77:0/2193147423 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6402cba0 con 0x7efc54004370 2023-11-04T01:40:56.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.111+0000 7efc70739640 1 -- 172.21.15.77:0/2193147423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc54004370 msgr2=0x7efc54004840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.111+0000 7efc70739640 1 --2- 172.21.15.77:0/2193147423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc54004370 0x7efc54004840 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7efc64009a90 tx=0x7efc540057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.111+0000 7efc70739640 1 -- 172.21.15.77:0/2193147423 shutdown_connections 2023-11-04T01:40:56.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.111+0000 7efc70739640 1 --2- 172.21.15.77:0/2193147423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc54004370 0x7efc54004840 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.111+0000 7efc70739640 1 -- 172.21.15.77:0/2193147423 >> 172.21.15.77:0/2193147423 conn(0x7efc680cbc90 msgr2=0x7efc680cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:56.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.111+0000 7efc70739640 1 -- 172.21.15.77:0/2193147423 shutdown_connections 2023-11-04T01:40:56.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.111+0000 7efc70739640 1 -- 172.21.15.77:0/2193147423 wait complete. 2023-11-04T01:40:56.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.112+0000 7efc70739640 1 Processor -- start 2023-11-04T01:40:56.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.112+0000 7efc70739640 1 -- start start 2023-11-04T01:40:56.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.113+0000 7efc70739640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc54004370 0x7efc681580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.113+0000 7efc70739640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc6815a170 0x7efc6815a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.113+0000 7efc70739640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc6815edb0 0x7efc6815f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.113+0000 7efc70739640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6815f770 con 0x7efc6815a170 2023-11-04T01:40:56.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.113+0000 7efc70739640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc68159440 con 0x7efc6815edb0 2023-11-04T01:40:56.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.113+0000 7efc70739640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc681f27e0 con 0x7efc54004370 2023-11-04T01:40:56.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.113+0000 7efc6dcd4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc6815a170 0x7efc6815a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.113+0000 7efc6dcd4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc6815a170 0x7efc6815a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49320/0 (socket says 172.21.15.77:49320) 2023-11-04T01:40:56.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.113+0000 7efc6dcd4640 1 -- 172.21.15.77:0/1810418900 learned_addr learned my addr 172.21.15.77:0/1810418900 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:56.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.113+0000 7efc6e4d5640 1 --2- 172.21.15.77:0/1810418900 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc54004370 0x7efc681580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.113+0000 7efc6ecd6640 1 --2- 172.21.15.77:0/1810418900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc6815edb0 0x7efc6815f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.113+0000 7efc6dcd4640 1 -- 172.21.15.77:0/1810418900 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc54004370 msgr2=0x7efc681580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.113+0000 7efc6dcd4640 1 --2- 172.21.15.77:0/1810418900 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc54004370 0x7efc681580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.113+0000 7efc6dcd4640 1 -- 172.21.15.77:0/1810418900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc6815edb0 msgr2=0x7efc6815f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.113+0000 7efc6dcd4640 1 --2- 172.21.15.77:0/1810418900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc6815edb0 0x7efc6815f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.113+0000 7efc6dcd4640 1 -- 172.21.15.77:0/1810418900 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc68158600 con 0x7efc6815a170 2023-11-04T01:40:56.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.113+0000 7efc6e4d5640 1 --2- 172.21.15.77:0/1810418900 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc54004370 0x7efc681580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:56.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.113+0000 7efc6ecd6640 1 --2- 172.21.15.77:0/1810418900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc6815edb0 0x7efc6815f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:56.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.114+0000 7efc6dcd4640 1 --2- 172.21.15.77:0/1810418900 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc6815a170 0x7efc6815a5f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7efc6402c250 tx=0x7efc64004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:56.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.114+0000 7efc5effd640 1 -- 172.21.15.77:0/1810418900 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc64003810 con 0x7efc6815a170 2023-11-04T01:40:56.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.114+0000 7efc5effd640 1 -- 172.21.15.77:0/1810418900 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc64003970 con 0x7efc6815a170 2023-11-04T01:40:56.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.114+0000 7efc70739640 1 -- 172.21.15.77:0/1810418900 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc680c8300 con 0x7efc6815a170 2023-11-04T01:40:56.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.114+0000 7efc5effd640 1 -- 172.21.15.77:0/1810418900 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc64003ce0 con 0x7efc6815a170 2023-11-04T01:40:56.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.114+0000 7efc70739640 1 -- 172.21.15.77:0/1810418900 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc68159970 con 0x7efc6815a170 2023-11-04T01:40:56.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.115+0000 7efc70739640 1 -- 172.21.15.77:0/1810418900 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc68074290 con 0x7efc6815a170 2023-11-04T01:40:56.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.115+0000 7efc5effd640 1 -- 172.21.15.77:0/1810418900 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efc64040450 con 0x7efc6815a170 2023-11-04T01:40:56.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.116+0000 7efc5effd640 1 --2- 172.21.15.77:0/1810418900 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efc4c06aea0 0x7efc4c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.116+0000 7efc5effd640 1 -- 172.21.15.77:0/1810418900 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efc640ab8d0 con 0x7efc6815a170 2023-11-04T01:40:56.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.116+0000 7efc6e4d5640 1 --2- 172.21.15.77:0/1810418900 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efc4c06aea0 0x7efc4c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.116+0000 7efc6e4d5640 1 --2- 172.21.15.77:0/1810418900 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efc4c06aea0 0x7efc4c06d360 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efc680687c0 tx=0x7efc58009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:56.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.120+0000 7efc5effd640 1 -- 172.21.15.77:0/1810418900 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efc640765c0 con 0x7efc6815a170 2023-11-04T01:40:56.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.283+0000 7efc70739640 1 -- 172.21.15.77:0/1810418900 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efc680b5190 con 0x7efc6815a170 2023-11-04T01:40:56.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.284+0000 7efc5effd640 1 -- 172.21.15.77:0/1810418900 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7efc640044e0 con 0x7efc6815a170 2023-11-04T01:40:56.287 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-04T01:40:56.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.286+0000 7efc70739640 1 -- 172.21.15.77:0/1810418900 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efc4c06aea0 msgr2=0x7efc4c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.286+0000 7efc70739640 1 --2- 172.21.15.77:0/1810418900 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efc4c06aea0 0x7efc4c06d360 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efc680687c0 tx=0x7efc58009040 comp rx=0 tx=0).stop 2023-11-04T01:40:56.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.286+0000 7efc70739640 1 -- 172.21.15.77:0/1810418900 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc6815a170 msgr2=0x7efc6815a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.286+0000 7efc70739640 1 --2- 172.21.15.77:0/1810418900 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc6815a170 0x7efc6815a5f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7efc6402c250 tx=0x7efc64004730 comp rx=0 tx=0).stop 2023-11-04T01:40:56.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.286+0000 7efc70739640 1 -- 172.21.15.77:0/1810418900 shutdown_connections 2023-11-04T01:40:56.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.286+0000 7efc70739640 1 --2- 172.21.15.77:0/1810418900 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efc4c06aea0 0x7efc4c06d360 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.286+0000 7efc70739640 1 --2- 172.21.15.77:0/1810418900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc6815edb0 0x7efc6815f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.286+0000 7efc70739640 1 --2- 172.21.15.77:0/1810418900 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc6815a170 0x7efc6815a5f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.286+0000 7efc70739640 1 --2- 172.21.15.77:0/1810418900 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc54004370 0x7efc681580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.286+0000 7efc70739640 1 -- 172.21.15.77:0/1810418900 >> 172.21.15.77:0/1810418900 conn(0x7efc680cbc90 msgr2=0x7efc68160830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:56.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.286+0000 7efc70739640 1 -- 172.21.15.77:0/1810418900 shutdown_connections 2023-11-04T01:40:56.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.286+0000 7efc70739640 1 -- 172.21.15.77:0/1810418900 wait complete. 2023-11-04T01:40:56.299 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:40:56.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.399+0000 7f4833bb6640 1 Processor -- start 2023-11-04T01:40:56.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.399+0000 7f4833bb6640 1 -- start start 2023-11-04T01:40:56.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.400+0000 7f4833bb6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f482c159c00 0x7f482c0cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.400+0000 7f4833bb6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f482c15aff0 con 0x7f482c0c48e0 2023-11-04T01:40:56.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.400+0000 7f4833bb6640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f482c15a3e0 con 0x7f482c0ae1d0 2023-11-04T01:40:56.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.400+0000 7f4833bb6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f482c15a6c0 con 0x7f482c159c00 2023-11-04T01:40:56.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.400+0000 7f4831952640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f482c159c00 0x7f482c0cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.400+0000 7f4831151640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f482c0c48e0 0x7f482c0adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36634/0 (socket says 172.21.15.77:36634) 2023-11-04T01:40:56.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.400+0000 7f4831151640 1 -- 172.21.15.77:0/54785398 learned_addr learned my addr 172.21.15.77:0/54785398 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:56.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.400+0000 7f4831952640 1 -- 172.21.15.77:0/54785398 >> v1:172.21.15.122:6789/0 conn(0x7f482c0ae1d0 legacy=0x7f482c0709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:56.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.400+0000 7f4830950640 1 -- 172.21.15.77:0/54785398 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2126082310 0 0) 0x7f482c15aff0 con 0x7f482c0c48e0 2023-11-04T01:40:56.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.400+0000 7f4831952640 1 -- 172.21.15.77:0/54785398 >> v1:172.21.15.77:6789/0 conn(0x7f482c0c48e0 legacy=0x7f482c0adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.400+0000 7f4831952640 1 -- 172.21.15.77:0/54785398 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482c15a9a0 con 0x7f482c159c00 2023-11-04T01:40:56.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.401+0000 7f4831952640 1 --2- 172.21.15.77:0/54785398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f482c159c00 0x7f482c0cc890 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f48280097a0 tx=0x7f482802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e5e1fb6d18c55a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:56.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.401+0000 7f4830950640 1 -- 172.21.15.77:0/54785398 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482802e070 con 0x7f482c159c00 2023-11-04T01:40:56.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.401+0000 7f4830950640 1 -- 172.21.15.77:0/54785398 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48280315a0 con 0x7f482c159c00 2023-11-04T01:40:56.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.401+0000 7f4830950640 1 -- 172.21.15.77:0/54785398 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4828031930 con 0x7f482c159c00 2023-11-04T01:40:56.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.401+0000 7f4833bb6640 1 -- 172.21.15.77:0/54785398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f482c159c00 msgr2=0x7f482c0cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.401+0000 7f4833bb6640 1 --2- 172.21.15.77:0/54785398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f482c159c00 0x7f482c0cc890 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f48280097a0 tx=0x7f482802b840 comp rx=0 tx=0).stop 2023-11-04T01:40:56.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.402+0000 7f4833bb6640 1 -- 172.21.15.77:0/54785398 shutdown_connections 2023-11-04T01:40:56.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.402+0000 7f4833bb6640 1 --2- 172.21.15.77:0/54785398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f482c159c00 0x7f482c0cc890 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.402+0000 7f4833bb6640 1 -- 172.21.15.77:0/54785398 >> 172.21.15.77:0/54785398 conn(0x7f482c0ce950 msgr2=0x7f482c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:56.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.402+0000 7f4833bb6640 1 -- 172.21.15.77:0/54785398 shutdown_connections 2023-11-04T01:40:56.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.402+0000 7f4833bb6640 1 -- 172.21.15.77:0/54785398 wait complete. 2023-11-04T01:40:56.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.403+0000 7f4833bb6640 1 Processor -- start 2023-11-04T01:40:56.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.403+0000 7f4833bb6640 1 -- start start 2023-11-04T01:40:56.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.403+0000 7f4833bb6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f482c0ae1d0 0x7f482c153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.403+0000 7f4833bb6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f482c0c48e0 0x7f482c0c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.403+0000 7f4833bb6640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f482c159c00 0x7f482c0c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.403+0000 7f4833bb6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482c14f790 con 0x7f482c0c48e0 2023-11-04T01:40:56.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.403+0000 7f4833bb6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482c14fb20 con 0x7f482c0ae1d0 2023-11-04T01:40:56.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.403+0000 7f4833bb6640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f482c1511c0 con 0x7f482c159c00 2023-11-04T01:40:56.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.404+0000 7f4831151640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f482c0c48e0 0x7f482c0c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.404+0000 7f4831151640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f482c0c48e0 0x7f482c0c7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49332/0 (socket says 172.21.15.77:49332) 2023-11-04T01:40:56.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.404+0000 7f4831151640 1 -- 172.21.15.77:0/1709745919 learned_addr learned my addr 172.21.15.77:0/1709745919 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:56.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.404+0000 7f4832153640 1 --2- 172.21.15.77:0/1709745919 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f482c159c00 0x7f482c0c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.404+0000 7f4831952640 1 --2- 172.21.15.77:0/1709745919 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f482c0ae1d0 0x7f482c153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.404+0000 7f4831151640 1 -- 172.21.15.77:0/1709745919 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f482c159c00 msgr2=0x7f482c0c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.404+0000 7f4831151640 1 --2- 172.21.15.77:0/1709745919 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f482c159c00 0x7f482c0c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.404+0000 7f4831151640 1 -- 172.21.15.77:0/1709745919 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f482c0ae1d0 msgr2=0x7f482c153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.404+0000 7f4831151640 1 --2- 172.21.15.77:0/1709745919 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f482c0ae1d0 0x7f482c153410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.404+0000 7f4831151640 1 -- 172.21.15.77:0/1709745919 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4828009400 con 0x7f482c0c48e0 2023-11-04T01:40:56.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.404+0000 7f4831151640 1 --2- 172.21.15.77:0/1709745919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f482c0c48e0 0x7f482c0c7df0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f481c00c4d0 tx=0x7f481c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:56.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.404+0000 7f48227fc640 1 -- 172.21.15.77:0/1709745919 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481c0074e0 con 0x7f482c0c48e0 2023-11-04T01:40:56.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.404+0000 7f48227fc640 1 -- 172.21.15.77:0/1709745919 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f481c007660 con 0x7f482c0c48e0 2023-11-04T01:40:56.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.404+0000 7f48227fc640 1 -- 172.21.15.77:0/1709745919 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481c004a20 con 0x7f482c0c48e0 2023-11-04T01:40:56.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.404+0000 7f4833bb6640 1 -- 172.21.15.77:0/1709745919 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f482c0b3460 con 0x7f482c0c48e0 2023-11-04T01:40:56.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.404+0000 7f4833bb6640 1 -- 172.21.15.77:0/1709745919 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f482c14fd30 con 0x7f482c0c48e0 2023-11-04T01:40:56.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.405+0000 7f4833bb6640 1 -- 172.21.15.77:0/1709745919 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f482c150f90 con 0x7f482c0c48e0 2023-11-04T01:40:56.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.406+0000 7f48227fc640 1 -- 172.21.15.77:0/1709745919 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f481c004b80 con 0x7f482c0c48e0 2023-11-04T01:40:56.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.406+0000 7f48227fc640 1 --2- 172.21.15.77:0/1709745919 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f481006ae70 0x7f481006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.406+0000 7f48227fc640 1 -- 172.21.15.77:0/1709745919 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f481c088ad0 con 0x7f482c0c48e0 2023-11-04T01:40:56.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.406+0000 7f4831952640 1 --2- 172.21.15.77:0/1709745919 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f481006ae70 0x7f481006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.407+0000 7f4831952640 1 --2- 172.21.15.77:0/1709745919 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f481006ae70 0x7f481006d330 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4828036000 tx=0x7f482803d040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:56.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.410+0000 7f48227fc640 1 -- 172.21.15.77:0/1709745919 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f481c053850 con 0x7f482c0c48e0 2023-11-04T01:40:56.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.575+0000 7f4833bb6640 1 -- 172.21.15.77:0/1709745919 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f482c151330 con 0x7f482c0c48e0 2023-11-04T01:40:56.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.575+0000 7f48227fc640 1 -- 172.21.15.77:0/1709745919 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f481c018020 con 0x7f482c0c48e0 2023-11-04T01:40:56.578 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:40:56.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.577+0000 7f4833bb6640 1 -- 172.21.15.77:0/1709745919 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f481006ae70 msgr2=0x7f481006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.577+0000 7f4833bb6640 1 --2- 172.21.15.77:0/1709745919 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f481006ae70 0x7f481006d330 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4828036000 tx=0x7f482803d040 comp rx=0 tx=0).stop 2023-11-04T01:40:56.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.577+0000 7f4833bb6640 1 -- 172.21.15.77:0/1709745919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f482c0c48e0 msgr2=0x7f482c0c7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.577+0000 7f4833bb6640 1 --2- 172.21.15.77:0/1709745919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f482c0c48e0 0x7f482c0c7df0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f481c00c4d0 tx=0x7f481c00c990 comp rx=0 tx=0).stop 2023-11-04T01:40:56.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.577+0000 7f4833bb6640 1 -- 172.21.15.77:0/1709745919 shutdown_connections 2023-11-04T01:40:56.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.577+0000 7f4833bb6640 1 --2- 172.21.15.77:0/1709745919 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f481006ae70 0x7f481006d330 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.577+0000 7f4833bb6640 1 --2- 172.21.15.77:0/1709745919 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f482c159c00 0x7f482c0c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.577+0000 7f4833bb6640 1 --2- 172.21.15.77:0/1709745919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f482c0c48e0 0x7f482c0c7df0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.577+0000 7f4833bb6640 1 --2- 172.21.15.77:0/1709745919 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f482c0ae1d0 0x7f482c153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.577+0000 7f4833bb6640 1 -- 172.21.15.77:0/1709745919 >> 172.21.15.77:0/1709745919 conn(0x7f482c0ce950 msgr2=0x7f482c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:56.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.577+0000 7f4833bb6640 1 -- 172.21.15.77:0/1709745919 shutdown_connections 2023-11-04T01:40:56.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.577+0000 7f4833bb6640 1 -- 172.21.15.77:0/1709745919 wait complete. 2023-11-04T01:40:56.590 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:40:56.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.688+0000 7f70be044640 1 Processor -- start 2023-11-04T01:40:56.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.688+0000 7f70be044640 1 -- start start 2023-11-04T01:40:56.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.689+0000 7f70be044640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70b80cd6d0 0x7f70b8161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.689+0000 7f70be044640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b80cde60 con 0x7f70b8153e60 2023-11-04T01:40:56.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.689+0000 7f70be044640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b8160f90 con 0x7f70b80b4880 2023-11-04T01:40:56.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.689+0000 7f70be044640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b8161960 con 0x7f70b80cd6d0 2023-11-04T01:40:56.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.689+0000 7f70b77fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f70b8153e60 0x7f70b815dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36644/0 (socket says 172.21.15.77:36644) 2023-11-04T01:40:56.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.689+0000 7f70b77fe640 1 -- 172.21.15.77:0/3397805038 learned_addr learned my addr 172.21.15.77:0/3397805038 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:56.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.690+0000 7f70aeffd640 1 --2- 172.21.15.77:0/3397805038 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70b80cd6d0 0x7f70b8161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.690+0000 7f70b6ffd640 1 -- 172.21.15.77:0/3397805038 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 207564245 0 0) 0x7f70b80cde60 con 0x7f70b8153e60 2023-11-04T01:40:56.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.690+0000 7f70b6ffd640 1 -- 172.21.15.77:0/3397805038 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70a4003520 con 0x7f70b8153e60 2023-11-04T01:40:56.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.690+0000 7f70b6ffd640 1 -- 172.21.15.77:0/3397805038 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3492656371 0 0) 0x7f70b8160f90 con 0x7f70b80b4880 2023-11-04T01:40:56.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.690+0000 7f70b6ffd640 1 -- 172.21.15.77:0/3397805038 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70b80cde60 con 0x7f70b80b4880 2023-11-04T01:40:56.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.690+0000 7f70b6ffd640 1 -- 172.21.15.77:0/3397805038 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2103678988 0 0) 0x7f70a4003520 con 0x7f70b8153e60 2023-11-04T01:40:56.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.690+0000 7f70b6ffd640 1 -- 172.21.15.77:0/3397805038 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70b80cd6d0 msgr2=0x7f70b8161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:56.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.690+0000 7f70b6ffd640 1 --2- 172.21.15.77:0/3397805038 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70b80cd6d0 0x7f70b8161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.690+0000 7f70b6ffd640 1 -- 172.21.15.77:0/3397805038 >> v1:172.21.15.122:6789/0 conn(0x7f70b80b4880 legacy=0x7f70b80b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.690+0000 7f70b6ffd640 1 -- 172.21.15.77:0/3397805038 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b80ce090 con 0x7f70b8153e60 2023-11-04T01:40:56.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.690+0000 7f70b6ffd640 1 -- 172.21.15.77:0/3397805038 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f70a8001670 con 0x7f70b8153e60 2023-11-04T01:40:56.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.690+0000 7f70b6ffd640 1 -- 172.21.15.77:0/3397805038 >> v1:172.21.15.77:6789/0 conn(0x7f70b8153e60 legacy=0x7f70b815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.690+0000 7f70b6ffd640 1 --2- 172.21.15.77:0/3397805038 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70a4003b30 0x7f70a4003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.690+0000 7f70b6ffd640 1 --2- 172.21.15.77:0/3397805038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70a40047c0 0x7f70a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.690+0000 7f70b6ffd640 1 --2- 172.21.15.77:0/3397805038 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70b80cd6d0 0x7f70a4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.690+0000 7f70b6ffd640 1 -- 172.21.15.77:0/3397805038 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b8161960 con 0x7f70a40047c0 2023-11-04T01:40:56.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.690+0000 7f70b6ffd640 1 -- 172.21.15.77:0/3397805038 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a400ba60 con 0x7f70a4003b30 2023-11-04T01:40:56.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.690+0000 7f70b6ffd640 1 -- 172.21.15.77:0/3397805038 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a400bc20 con 0x7f70b80cd6d0 2023-11-04T01:40:56.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.690+0000 7f70aeffd640 1 --2- 172.21.15.77:0/3397805038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70a40047c0 0x7f70a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.690+0000 7f70b77fe640 1 --2- 172.21.15.77:0/3397805038 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70a4003b30 0x7f70a4003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.690+0000 7f70b7fff640 1 --2- 172.21.15.77:0/3397805038 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70b80cd6d0 0x7f70a4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.690+0000 7f70aeffd640 1 -- 172.21.15.77:0/3397805038 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70b80cd6d0 msgr2=0x7f70a4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:56.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.690+0000 7f70aeffd640 1 --2- 172.21.15.77:0/3397805038 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70b80cd6d0 0x7f70a4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.690+0000 7f70aeffd640 1 -- 172.21.15.77:0/3397805038 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70a4003b30 msgr2=0x7f70a4003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:56.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.690+0000 7f70aeffd640 1 --2- 172.21.15.77:0/3397805038 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70a4003b30 0x7f70a4003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.690+0000 7f70aeffd640 1 -- 172.21.15.77:0/3397805038 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a4003520 con 0x7f70a40047c0 2023-11-04T01:40:56.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.691+0000 7f70aeffd640 1 --2- 172.21.15.77:0/3397805038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70a40047c0 0x7f70a4004c40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f70a0009ac0 tx=0x7f70a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f85a511b01a013b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:56.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.691+0000 7f70b6ffd640 1 -- 172.21.15.77:0/3397805038 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a002c6b0 con 0x7f70a40047c0 2023-11-04T01:40:56.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.691+0000 7f70b6ffd640 1 -- 172.21.15.77:0/3397805038 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a002c810 con 0x7f70a40047c0 2023-11-04T01:40:56.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.691+0000 7f70b6ffd640 1 -- 172.21.15.77:0/3397805038 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a002cba0 con 0x7f70a40047c0 2023-11-04T01:40:56.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.692+0000 7f70be044640 1 -- 172.21.15.77:0/3397805038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70a40047c0 msgr2=0x7f70a4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.692+0000 7f70be044640 1 --2- 172.21.15.77:0/3397805038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70a40047c0 0x7f70a4004c40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f70a0009ac0 tx=0x7f70a40057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.692+0000 7f70b7fff640 1 -- 172.21.15.77:0/3397805038 reap_dead start 2023-11-04T01:40:56.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.692+0000 7f70be044640 1 -- 172.21.15.77:0/3397805038 shutdown_connections 2023-11-04T01:40:56.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.692+0000 7f70be044640 1 -- 172.21.15.77:0/3397805038 >> 172.21.15.77:0/3397805038 conn(0x7f70b80cf880 msgr2=0x7f70b80cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:56.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.692+0000 7f70be044640 1 -- 172.21.15.77:0/3397805038 shutdown_connections 2023-11-04T01:40:56.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.692+0000 7f70be044640 1 -- 172.21.15.77:0/3397805038 wait complete. 2023-11-04T01:40:56.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.693+0000 7f70be044640 1 Processor -- start 2023-11-04T01:40:56.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.693+0000 7f70be044640 1 -- start start 2023-11-04T01:40:56.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.694+0000 7f70be044640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70a40047c0 0x7f70b80c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.694+0000 7f70be044640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70b8150500 0x7f70b80c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.694+0000 7f70be044640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70b80c8070 0x7f70b80cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.694+0000 7f70be044640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b815c790 con 0x7f70a40047c0 2023-11-04T01:40:56.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.694+0000 7f70be044640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b80c6a90 con 0x7f70b8150500 2023-11-04T01:40:56.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.694+0000 7f70be044640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b80c6d70 con 0x7f70b80c8070 2023-11-04T01:40:56.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.694+0000 7f70b77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70a40047c0 0x7f70b80c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.694+0000 7f70b77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70a40047c0 0x7f70b80c92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49354/0 (socket says 172.21.15.77:49354) 2023-11-04T01:40:56.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.694+0000 7f70b77fe640 1 -- 172.21.15.77:0/2586987358 learned_addr learned my addr 172.21.15.77:0/2586987358 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:56.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.694+0000 7f70aeffd640 1 --2- 172.21.15.77:0/2586987358 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70b8150500 0x7f70b80c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.694+0000 7f70b7fff640 1 --2- 172.21.15.77:0/2586987358 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70b80c8070 0x7f70b80cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.694+0000 7f70b77fe640 1 -- 172.21.15.77:0/2586987358 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70b80c8070 msgr2=0x7f70b80cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.694+0000 7f70b77fe640 1 --2- 172.21.15.77:0/2586987358 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70b80c8070 0x7f70b80cb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.694+0000 7f70b77fe640 1 -- 172.21.15.77:0/2586987358 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70b8150500 msgr2=0x7f70b80c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.694+0000 7f70b77fe640 1 --2- 172.21.15.77:0/2586987358 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70b8150500 0x7f70b80c7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.694+0000 7f70b77fe640 1 -- 172.21.15.77:0/2586987358 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b80c7050 con 0x7f70a40047c0 2023-11-04T01:40:56.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.694+0000 7f70b7fff640 1 --2- 172.21.15.77:0/2586987358 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70b80c8070 0x7f70b80cb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:56.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.694+0000 7f70b77fe640 1 --2- 172.21.15.77:0/2586987358 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70a40047c0 0x7f70b80c92c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f70a8007290 tx=0x7f70a8007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:56.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.694+0000 7f70b4ff9640 1 -- 172.21.15.77:0/2586987358 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a8001670 con 0x7f70a40047c0 2023-11-04T01:40:56.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.694+0000 7f70b4ff9640 1 -- 172.21.15.77:0/2586987358 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a800f9c0 con 0x7f70a40047c0 2023-11-04T01:40:56.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.694+0000 7f70be044640 1 -- 172.21.15.77:0/2586987358 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b80c7330 con 0x7f70a40047c0 2023-11-04T01:40:56.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.695+0000 7f70b4ff9640 1 -- 172.21.15.77:0/2586987358 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a800fd50 con 0x7f70a40047c0 2023-11-04T01:40:56.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.695+0000 7f70be044640 1 -- 172.21.15.77:0/2586987358 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b8150980 con 0x7f70a40047c0 2023-11-04T01:40:56.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.695+0000 7f70be044640 1 -- 172.21.15.77:0/2586987358 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b80c7850 con 0x7f70a40047c0 2023-11-04T01:40:56.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.696+0000 7f70b4ff9640 1 -- 172.21.15.77:0/2586987358 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f70a801d460 con 0x7f70a40047c0 2023-11-04T01:40:56.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.696+0000 7f70b4ff9640 1 --2- 172.21.15.77:0/2586987358 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f709806aea0 0x7f709806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:56.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.696+0000 7f70b4ff9640 1 -- 172.21.15.77:0/2586987358 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f70a80898f0 con 0x7f70a40047c0 2023-11-04T01:40:56.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.697+0000 7f70aeffd640 1 --2- 172.21.15.77:0/2586987358 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f709806aea0 0x7f709806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:56.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.697+0000 7f70aeffd640 1 --2- 172.21.15.77:0/2586987358 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f709806aea0 0x7f709806d360 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f70a0036000 tx=0x7f70a0030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:56.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.701+0000 7f70b4ff9640 1 -- 172.21.15.77:0/2586987358 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f70b80c7850 con 0x7f70a40047c0 2023-11-04T01:40:56.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.878+0000 7f70be044640 1 -- 172.21.15.77:0/2586987358 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f70b80c7850 con 0x7f70a40047c0 2023-11-04T01:40:56.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.878+0000 7f70b4ff9640 1 -- 172.21.15.77:0/2586987358 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f70b80c7850 con 0x7f70a40047c0 2023-11-04T01:40:56.882 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-11-04T01:40:56.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.880+0000 7f70be044640 1 -- 172.21.15.77:0/2586987358 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f709806aea0 msgr2=0x7f709806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.880+0000 7f70be044640 1 --2- 172.21.15.77:0/2586987358 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f709806aea0 0x7f709806d360 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f70a0036000 tx=0x7f70a0030000 comp rx=0 tx=0).stop 2023-11-04T01:40:56.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.880+0000 7f70be044640 1 -- 172.21.15.77:0/2586987358 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70a40047c0 msgr2=0x7f70b80c92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:56.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.880+0000 7f70be044640 1 --2- 172.21.15.77:0/2586987358 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70a40047c0 0x7f70b80c92c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f70a8007290 tx=0x7f70a8007750 comp rx=0 tx=0).stop 2023-11-04T01:40:56.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.880+0000 7f70be044640 1 -- 172.21.15.77:0/2586987358 shutdown_connections 2023-11-04T01:40:56.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.880+0000 7f70be044640 1 --2- 172.21.15.77:0/2586987358 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f709806aea0 0x7f709806d360 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.880+0000 7f70be044640 1 --2- 172.21.15.77:0/2586987358 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70b80c8070 0x7f70b80cb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.880+0000 7f70be044640 1 --2- 172.21.15.77:0/2586987358 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70b8150500 0x7f70b80c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.880+0000 7f70be044640 1 --2- 172.21.15.77:0/2586987358 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70a40047c0 0x7f70b80c92c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:56.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.880+0000 7f70be044640 1 -- 172.21.15.77:0/2586987358 >> 172.21.15.77:0/2586987358 conn(0x7f70b80cf880 msgr2=0x7f70b80cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:56.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.880+0000 7f70be044640 1 -- 172.21.15.77:0/2586987358 shutdown_connections 2023-11-04T01:40:56.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:56.880+0000 7f70be044640 1 -- 172.21.15.77:0/2586987358 wait complete. 2023-11-04T01:40:56.894 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:40:56.895 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:40:56.910 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:57.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.047+0000 7f6d79d1d640 1 Processor -- start 2023-11-04T01:40:57.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.047+0000 7f6d79d1d640 1 -- start start 2023-11-04T01:40:57.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.048+0000 7f6d79d1d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6d740ce370 0x7f6d7406db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.048+0000 7f6d79d1d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d7406e060 con 0x7f6d740b0ae0 2023-11-04T01:40:57.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.048+0000 7f6d79d1d640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d740b4110 con 0x7f6d74159c70 2023-11-04T01:40:57.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.048+0000 7f6d79d1d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d740b49b0 con 0x7f6d740ce370 2023-11-04T01:40:57.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.048+0000 7f6d73fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6d740ce370 0x7f6d7406db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.048+0000 7f6d72ffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6d740b0ae0 0x7f6d7415d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36654/0 (socket says 172.21.15.77:36654) 2023-11-04T01:40:57.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.048+0000 7f6d72ffd640 1 -- 172.21.15.77:0/1900489394 learned_addr learned my addr 172.21.15.77:0/1900489394 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:57.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.048+0000 7f6d73fff640 1 -- 172.21.15.77:0/1900489394 >> v1:172.21.15.122:6789/0 conn(0x7f6d74159c70 legacy=0x7f6d740b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:57.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.048+0000 7f6d73fff640 1 -- 172.21.15.77:0/1900489394 >> v1:172.21.15.77:6789/0 conn(0x7f6d740b0ae0 legacy=0x7f6d7415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.048+0000 7f6d73fff640 1 -- 172.21.15.77:0/1900489394 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d740b43f0 con 0x7f6d740ce370 2023-11-04T01:40:57.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.048+0000 7f6d727fc640 1 -- 172.21.15.77:0/1900489394 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 618121999 0 0) 0x7f6d7406e060 con 0x7f6d740b0ae0 2023-11-04T01:40:57.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.049+0000 7f6d73fff640 1 --2- 172.21.15.77:0/1900489394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d740ce370 0x7f6d7406db20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6d7406e1f0 tx=0x7f6d6c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=997363ab675dfb05 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:57.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.049+0000 7f6d727fc640 1 -- 172.21.15.77:0/1900489394 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c02cc50 con 0x7f6d740ce370 2023-11-04T01:40:57.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.049+0000 7f6d727fc640 1 -- 172.21.15.77:0/1900489394 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6c02cdb0 con 0x7f6d740ce370 2023-11-04T01:40:57.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.049+0000 7f6d727fc640 1 -- 172.21.15.77:0/1900489394 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c034660 con 0x7f6d740ce370 2023-11-04T01:40:57.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.050+0000 7f6d79d1d640 1 -- 172.21.15.77:0/1900489394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d740ce370 msgr2=0x7f6d7406db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.050+0000 7f6d79d1d640 1 --2- 172.21.15.77:0/1900489394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d740ce370 0x7f6d7406db20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6d7406e1f0 tx=0x7f6d6c02bea0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.050+0000 7f6d79d1d640 1 -- 172.21.15.77:0/1900489394 shutdown_connections 2023-11-04T01:40:57.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.050+0000 7f6d79d1d640 1 --2- 172.21.15.77:0/1900489394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d740ce370 0x7f6d7406db20 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.050+0000 7f6d79d1d640 1 -- 172.21.15.77:0/1900489394 >> 172.21.15.77:0/1900489394 conn(0x7f6d740ce950 msgr2=0x7f6d740ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:57.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.050+0000 7f6d79d1d640 1 -- 172.21.15.77:0/1900489394 shutdown_connections 2023-11-04T01:40:57.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.050+0000 7f6d79d1d640 1 -- 172.21.15.77:0/1900489394 wait complete. 2023-11-04T01:40:57.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.051+0000 7f6d79d1d640 1 Processor -- start 2023-11-04T01:40:57.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.051+0000 7f6d79d1d640 1 -- start start 2023-11-04T01:40:57.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.052+0000 7f6d79d1d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d740b0ae0 0x7f6d740b1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.052+0000 7f6d79d1d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6d740ce370 0x7f6d74070960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.052+0000 7f6d79d1d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6d74159c70 0x7f6d7414ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.052+0000 7f6d79d1d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d740ce7e0 con 0x7f6d740b0ae0 2023-11-04T01:40:57.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.052+0000 7f6d79d1d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d740b1da0 con 0x7f6d740ce370 2023-11-04T01:40:57.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.052+0000 7f6d79d1d640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d740b2080 con 0x7f6d74159c70 2023-11-04T01:40:57.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.052+0000 7f6d737fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d740b0ae0 0x7f6d740b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.052+0000 7f6d737fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d740b0ae0 0x7f6d740b1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49364/0 (socket says 172.21.15.77:49364) 2023-11-04T01:40:57.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.052+0000 7f6d737fe640 1 -- 172.21.15.77:0/1814269868 learned_addr learned my addr 172.21.15.77:0/1814269868 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:57.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.052+0000 7f6d737fe640 1 -- 172.21.15.77:0/1814269868 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6d74159c70 msgr2=0x7f6d7414ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.052+0000 7f6d737fe640 1 --2- 172.21.15.77:0/1814269868 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6d74159c70 0x7f6d7414ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.052+0000 7f6d737fe640 1 -- 172.21.15.77:0/1814269868 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6d740ce370 msgr2=0x7f6d74070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.052+0000 7f6d72ffd640 1 --2- 172.21.15.77:0/1814269868 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6d740ce370 0x7f6d74070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.052+0000 7f6d737fe640 1 --2- 172.21.15.77:0/1814269868 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6d740ce370 0x7f6d74070960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.052+0000 7f6d737fe640 1 -- 172.21.15.77:0/1814269868 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6c009a70 con 0x7f6d740b0ae0 2023-11-04T01:40:57.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.052+0000 7f6d72ffd640 1 --2- 172.21.15.77:0/1814269868 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6d740ce370 0x7f6d74070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:57.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.052+0000 7f6d737fe640 1 --2- 172.21.15.77:0/1814269868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d740b0ae0 0x7f6d740b1570 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6d6400b3f0 tx=0x7f6d6400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:57.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.053+0000 7f6d5bfff640 1 -- 172.21.15.77:0/1814269868 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d64011830 con 0x7f6d740b0ae0 2023-11-04T01:40:57.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.053+0000 7f6d5bfff640 1 -- 172.21.15.77:0/1814269868 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d64011990 con 0x7f6d740b0ae0 2023-11-04T01:40:57.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.053+0000 7f6d79d1d640 1 -- 172.21.15.77:0/1814269868 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d740b2360 con 0x7f6d740b0ae0 2023-11-04T01:40:57.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.053+0000 7f6d5bfff640 1 -- 172.21.15.77:0/1814269868 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d64011d40 con 0x7f6d740b0ae0 2023-11-04T01:40:57.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.053+0000 7f6d79d1d640 1 -- 172.21.15.77:0/1814269868 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d740b2920 con 0x7f6d740b0ae0 2023-11-04T01:40:57.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.054+0000 7f6d79d1d640 1 -- 172.21.15.77:0/1814269868 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d74074290 con 0x7f6d740b0ae0 2023-11-04T01:40:57.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.054+0000 7f6d5bfff640 1 -- 172.21.15.77:0/1814269868 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6d6401a400 con 0x7f6d740b0ae0 2023-11-04T01:40:57.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.054+0000 7f6d5bfff640 1 --2- 172.21.15.77:0/1814269868 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6d6006ae70 0x7f6d6006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.054+0000 7f6d5bfff640 1 -- 172.21.15.77:0/1814269868 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6d640897f0 con 0x7f6d740b0ae0 2023-11-04T01:40:57.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.055+0000 7f6d72ffd640 1 --2- 172.21.15.77:0/1814269868 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6d6006ae70 0x7f6d6006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.055+0000 7f6d72ffd640 1 --2- 172.21.15.77:0/1814269868 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6d6006ae70 0x7f6d6006d330 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6d741f5c20 tx=0x7f6d68009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:57.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.059+0000 7f6d5bfff640 1 -- 172.21.15.77:0/1814269868 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6d64054570 con 0x7f6d740b0ae0 2023-11-04T01:40:57.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.225+0000 7f6d79d1d640 1 -- 172.21.15.77:0/1814269868 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d7406d3f0 con 0x7f6d740b0ae0 2023-11-04T01:40:57.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.226+0000 7f6d5bfff640 1 -- 172.21.15.77:0/1814269868 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18661 (secure 0 0 0) 0x7f6d64057b90 con 0x7f6d740b0ae0 2023-11-04T01:40:57.230 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:57.231 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":26,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:40:47.579547+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:40:02.810971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:40:04.003979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:40:07.734355+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:57.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.229+0000 7f6d79d1d640 1 -- 172.21.15.77:0/1814269868 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6d6006ae70 msgr2=0x7f6d6006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.229+0000 7f6d79d1d640 1 --2- 172.21.15.77:0/1814269868 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6d6006ae70 0x7f6d6006d330 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6d741f5c20 tx=0x7f6d68009040 comp rx=0 tx=0).stop 2023-11-04T01:40:57.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.229+0000 7f6d79d1d640 1 -- 172.21.15.77:0/1814269868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d740b0ae0 msgr2=0x7f6d740b1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.229+0000 7f6d79d1d640 1 --2- 172.21.15.77:0/1814269868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d740b0ae0 0x7f6d740b1570 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6d6400b3f0 tx=0x7f6d6400b8b0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.229+0000 7f6d79d1d640 1 -- 172.21.15.77:0/1814269868 shutdown_connections 2023-11-04T01:40:57.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.229+0000 7f6d79d1d640 1 --2- 172.21.15.77:0/1814269868 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6d6006ae70 0x7f6d6006d330 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.229+0000 7f6d79d1d640 1 --2- 172.21.15.77:0/1814269868 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6d74159c70 0x7f6d7414ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.229+0000 7f6d79d1d640 1 --2- 172.21.15.77:0/1814269868 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6d740ce370 0x7f6d74070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.229+0000 7f6d79d1d640 1 --2- 172.21.15.77:0/1814269868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d740b0ae0 0x7f6d740b1570 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.229+0000 7f6d79d1d640 1 -- 172.21.15.77:0/1814269868 >> 172.21.15.77:0/1814269868 conn(0x7f6d740ce950 msgr2=0x7f6d74158320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:57.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.229+0000 7f6d79d1d640 1 -- 172.21.15.77:0/1814269868 shutdown_connections 2023-11-04T01:40:57.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.229+0000 7f6d79d1d640 1 -- 172.21.15.77:0/1814269868 wait complete. 2023-11-04T01:40:57.242 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:40:02.810971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:40:04.003979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:40:07.734355+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:40:57.243 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:40:57.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.342+0000 7f6839834640 1 Processor -- start 2023-11-04T01:40:57.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.342+0000 7f6839834640 1 -- start start 2023-11-04T01:40:57.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.343+0000 7f6839834640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f68340b4880 0x7f68340b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.343+0000 7f6839834640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68340cde60 con 0x7f68340cd6d0 2023-11-04T01:40:57.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.343+0000 7f6839834640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6834160f90 con 0x7f6834153e60 2023-11-04T01:40:57.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.343+0000 7f6839834640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68340b5200 con 0x7f68340b4880 2023-11-04T01:40:57.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.343+0000 7f68327fc640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f68340cd6d0 0x7f6834161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36664/0 (socket says 172.21.15.77:36664) 2023-11-04T01:40:57.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.343+0000 7f68327fc640 1 -- 172.21.15.77:0/1728291990 learned_addr learned my addr 172.21.15.77:0/1728291990 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:57.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.343+0000 7f68337fe640 1 --2- 172.21.15.77:0/1728291990 >> v2:172.21.15.122:3300/0 conn(0x7f68340b4880 0x7f68340b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.343+0000 7f6831ffb640 1 -- 172.21.15.77:0/1728291990 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2281772662 0 0) 0x7f68340cde60 con 0x7f68340cd6d0 2023-11-04T01:40:57.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.343+0000 7f6831ffb640 1 -- 172.21.15.77:0/1728291990 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6820003520 con 0x7f68340cd6d0 2023-11-04T01:40:57.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.343+0000 7f68337fe640 1 -- 172.21.15.77:0/1728291990 >> v1:172.21.15.122:6789/0 conn(0x7f6834153e60 legacy=0x7f683415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.343+0000 7f68337fe640 1 -- 172.21.15.77:0/1728291990 >> v1:172.21.15.77:6789/0 conn(0x7f68340cd6d0 legacy=0x7f6834161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.343+0000 7f6831ffb640 1 -- 172.21.15.77:0/1728291990 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 971900006 0 0) 0x7f6820003520 con 0x7f68340cd6d0 2023-11-04T01:40:57.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.343+0000 7f68337fe640 1 -- 172.21.15.77:0/1728291990 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68340ce090 con 0x7f68340b4880 2023-11-04T01:40:57.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.344+0000 7f68337fe640 1 --2- 172.21.15.77:0/1728291990 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68340b4880 0x7f68340b4cc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6824009d90 tx=0x7f682402be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=144d4ecc6dabc317 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:57.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.344+0000 7f6831ffb640 1 -- 172.21.15.77:0/1728291990 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c001670 con 0x7f68340b4880 2023-11-04T01:40:57.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.344+0000 7f6831ffb640 1 -- 172.21.15.77:0/1728291990 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682402c940 con 0x7f68340b4880 2023-11-04T01:40:57.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.344+0000 7f6831ffb640 1 -- 172.21.15.77:0/1728291990 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682402ccb0 con 0x7f68340b4880 2023-11-04T01:40:57.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.345+0000 7f6839834640 1 -- 172.21.15.77:0/1728291990 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68340b4880 msgr2=0x7f68340b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.345+0000 7f6839834640 1 --2- 172.21.15.77:0/1728291990 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68340b4880 0x7f68340b4cc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6824009d90 tx=0x7f682402be10 comp rx=0 tx=0).stop 2023-11-04T01:40:57.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.345+0000 7f6839834640 1 -- 172.21.15.77:0/1728291990 shutdown_connections 2023-11-04T01:40:57.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.345+0000 7f6839834640 1 --2- 172.21.15.77:0/1728291990 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68340b4880 0x7f68340b4cc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.345+0000 7f6839834640 1 -- 172.21.15.77:0/1728291990 >> 172.21.15.77:0/1728291990 conn(0x7f68340cf880 msgr2=0x7f68340cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:57.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.345+0000 7f6839834640 1 -- 172.21.15.77:0/1728291990 shutdown_connections 2023-11-04T01:40:57.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.345+0000 7f6839834640 1 -- 172.21.15.77:0/1728291990 wait complete. 2023-11-04T01:40:57.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.346+0000 7f6839834640 1 Processor -- start 2023-11-04T01:40:57.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.346+0000 7f6839834640 1 -- start start 2023-11-04T01:40:57.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.347+0000 7f6839834640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68340b4880 0x7f6834157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.347+0000 7f6839834640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f68340cd6d0 0x7f68341593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.347+0000 7f6839834640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6834153e60 0x7f6834159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.347+0000 7f6839834640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f683415ab90 con 0x7f6834153e60 2023-11-04T01:40:57.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.347+0000 7f6839834640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6834159f80 con 0x7f68340b4880 2023-11-04T01:40:57.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.347+0000 7f6839834640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f683415a260 con 0x7f68340cd6d0 2023-11-04T01:40:57.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.347+0000 7f68337fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6834153e60 0x7f6834159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.347+0000 7f68337fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6834153e60 0x7f6834159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49370/0 (socket says 172.21.15.77:49370) 2023-11-04T01:40:57.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.347+0000 7f68337fe640 1 -- 172.21.15.77:0/3520555925 learned_addr learned my addr 172.21.15.77:0/3520555925 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:57.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.347+0000 7f68327fc640 1 --2- 172.21.15.77:0/3520555925 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f68340cd6d0 0x7f68341593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.347+0000 7f6832ffd640 1 --2- 172.21.15.77:0/3520555925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68340b4880 0x7f6834157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.347+0000 7f68337fe640 1 -- 172.21.15.77:0/3520555925 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f68340cd6d0 msgr2=0x7f68341593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.347+0000 7f68337fe640 1 --2- 172.21.15.77:0/3520555925 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f68340cd6d0 0x7f68341593c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.347+0000 7f68337fe640 1 -- 172.21.15.77:0/3520555925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68340b4880 msgr2=0x7f6834157040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.347+0000 7f68337fe640 1 --2- 172.21.15.77:0/3520555925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68340b4880 0x7f6834157040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.347+0000 7f68337fe640 1 -- 172.21.15.77:0/3520555925 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6824009a70 con 0x7f6834153e60 2023-11-04T01:40:57.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.347+0000 7f68337fe640 1 --2- 172.21.15.77:0/3520555925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6834153e60 0x7f6834159900 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6824009eb0 tx=0x7f6824004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:57.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.348+0000 7f682bfff640 1 -- 172.21.15.77:0/3520555925 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6824009450 con 0x7f6834153e60 2023-11-04T01:40:57.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.348+0000 7f682bfff640 1 -- 172.21.15.77:0/3520555925 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6824034d00 con 0x7f6834153e60 2023-11-04T01:40:57.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.348+0000 7f6839834640 1 -- 172.21.15.77:0/3520555925 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f683415a540 con 0x7f6834153e60 2023-11-04T01:40:57.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.348+0000 7f682bfff640 1 -- 172.21.15.77:0/3520555925 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682403f660 con 0x7f6834153e60 2023-11-04T01:40:57.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.348+0000 7f6839834640 1 -- 172.21.15.77:0/3520555925 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6834157da0 con 0x7f6834153e60 2023-11-04T01:40:57.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.349+0000 7f6839834640 1 -- 172.21.15.77:0/3520555925 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f683415ad40 con 0x7f6834153e60 2023-11-04T01:40:57.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.349+0000 7f682bfff640 1 -- 172.21.15.77:0/3520555925 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f682403f7c0 con 0x7f6834153e60 2023-11-04T01:40:57.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.349+0000 7f682bfff640 1 --2- 172.21.15.77:0/3520555925 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f681406ae70 0x7f681406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.350+0000 7f682bfff640 1 -- 172.21.15.77:0/3520555925 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f68240ac020 con 0x7f6834153e60 2023-11-04T01:40:57.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.350+0000 7f6832ffd640 1 --2- 172.21.15.77:0/3520555925 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f681406ae70 0x7f681406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.350+0000 7f6832ffd640 1 --2- 172.21.15.77:0/3520555925 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f681406ae70 0x7f681406d330 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f682c000f60 tx=0x7f682c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:57.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.354+0000 7f682bfff640 1 -- 172.21.15.77:0/3520555925 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f683415ad40 con 0x7f6834153e60 2023-11-04T01:40:57.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.517+0000 7f6839834640 1 -- 172.21.15.77:0/3520555925 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6834157f30 con 0x7f6834153e60 2023-11-04T01:40:57.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.517+0000 7f682bfff640 1 -- 172.21.15.77:0/3520555925 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6824039020 con 0x7f6834153e60 2023-11-04T01:40:57.520 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:40:57.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.519+0000 7f6839834640 1 -- 172.21.15.77:0/3520555925 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f681406ae70 msgr2=0x7f681406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.519+0000 7f6839834640 1 --2- 172.21.15.77:0/3520555925 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f681406ae70 0x7f681406d330 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f682c000f60 tx=0x7f682c009040 comp rx=0 tx=0).stop 2023-11-04T01:40:57.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.519+0000 7f6839834640 1 -- 172.21.15.77:0/3520555925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6834153e60 msgr2=0x7f6834159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.519+0000 7f6839834640 1 --2- 172.21.15.77:0/3520555925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6834153e60 0x7f6834159900 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6824009eb0 tx=0x7f6824004a40 comp rx=0 tx=0).stop 2023-11-04T01:40:57.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.519+0000 7f6839834640 1 -- 172.21.15.77:0/3520555925 shutdown_connections 2023-11-04T01:40:57.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.519+0000 7f6839834640 1 --2- 172.21.15.77:0/3520555925 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f681406ae70 0x7f681406d330 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.519+0000 7f6839834640 1 --2- 172.21.15.77:0/3520555925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6834153e60 0x7f6834159900 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.519+0000 7f6839834640 1 --2- 172.21.15.77:0/3520555925 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f68340cd6d0 0x7f68341593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.519+0000 7f6839834640 1 --2- 172.21.15.77:0/3520555925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68340b4880 0x7f6834157040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.519+0000 7f6839834640 1 -- 172.21.15.77:0/3520555925 >> 172.21.15.77:0/3520555925 conn(0x7f68340cf880 msgr2=0x7f683415afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:57.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.519+0000 7f6839834640 1 -- 172.21.15.77:0/3520555925 shutdown_connections 2023-11-04T01:40:57.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.519+0000 7f6839834640 1 -- 172.21.15.77:0/3520555925 wait complete. 2023-11-04T01:40:57.532 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:40:57.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.632+0000 7f79fd40e640 1 Processor -- start 2023-11-04T01:40:57.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.632+0000 7f79fd40e640 1 -- start start 2023-11-04T01:40:57.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.633+0000 7f79fd40e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f79f80c4ff0 0x7f79f80cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.633+0000 7f79fd40e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f79f80adac0 0x7f79f80adf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.633+0000 7f79fd40e640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f815aff0 con 0x7f79f8159c00 2023-11-04T01:40:57.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.633+0000 7f79fd40e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f80ae460 con 0x7f79f80c4ff0 2023-11-04T01:40:57.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.633+0000 7f79fd40e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f815a3e0 con 0x7f79f80adac0 2023-11-04T01:40:57.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.633+0000 7f79f67fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f79f80c4ff0 0x7f79f80cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.633+0000 7f79f67fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f79f80c4ff0 0x7f79f80cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54610/0 (socket says 172.21.15.77:54610) 2023-11-04T01:40:57.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.633+0000 7f79f67fc640 1 -- 172.21.15.77:0/1093866337 learned_addr learned my addr 172.21.15.77:0/1093866337 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:57.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.634+0000 7f79f77fe640 1 --2- 172.21.15.77:0/1093866337 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f79f80adac0 0x7f79f80adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.634+0000 7f79f67fc640 1 -- 172.21.15.77:0/1093866337 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f79f80adac0 msgr2=0x7f79f80adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:57.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.634+0000 7f79f67fc640 1 --2- 172.21.15.77:0/1093866337 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f79f80adac0 0x7f79f80adf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.634+0000 7f79f67fc640 1 -- 172.21.15.77:0/1093866337 >> v1:172.21.15.122:6789/0 conn(0x7f79f8159c00 legacy=0x7f79f80c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:57.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.634+0000 7f79f67fc640 1 -- 172.21.15.77:0/1093866337 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f815a6c0 con 0x7f79f80c4ff0 2023-11-04T01:40:57.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.634+0000 7f79f67fc640 1 --2- 172.21.15.77:0/1093866337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79f80c4ff0 0x7f79f80cc890 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f79ec00bb10 tx=0x7f79ec02e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=236c7ed3424349a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:57.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.635+0000 7f79f5ffb640 1 -- 172.21.15.77:0/1093866337 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ec02ee70 con 0x7f79f80c4ff0 2023-11-04T01:40:57.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.635+0000 7f79f5ffb640 1 -- 172.21.15.77:0/1093866337 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ec036440 con 0x7f79f80c4ff0 2023-11-04T01:40:57.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.635+0000 7f79f5ffb640 1 -- 172.21.15.77:0/1093866337 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ec0367d0 con 0x7f79f80c4ff0 2023-11-04T01:40:57.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.635+0000 7f79fd40e640 1 -- 172.21.15.77:0/1093866337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79f80c4ff0 msgr2=0x7f79f80cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.635+0000 7f79fd40e640 1 --2- 172.21.15.77:0/1093866337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79f80c4ff0 0x7f79f80cc890 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f79ec00bb10 tx=0x7f79ec02e0c0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.635+0000 7f79fd40e640 1 -- 172.21.15.77:0/1093866337 shutdown_connections 2023-11-04T01:40:57.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.635+0000 7f79fd40e640 1 --2- 172.21.15.77:0/1093866337 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f79f80adac0 0x7f79f80adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.635+0000 7f79fd40e640 1 --2- 172.21.15.77:0/1093866337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79f80c4ff0 0x7f79f80cc890 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.635+0000 7f79fd40e640 1 -- 172.21.15.77:0/1093866337 >> 172.21.15.77:0/1093866337 conn(0x7f79f80ce950 msgr2=0x7f79f80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:57.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.635+0000 7f79fd40e640 1 -- 172.21.15.77:0/1093866337 shutdown_connections 2023-11-04T01:40:57.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.635+0000 7f79fd40e640 1 -- 172.21.15.77:0/1093866337 wait complete. 2023-11-04T01:40:57.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.637+0000 7f79fd40e640 1 Processor -- start 2023-11-04T01:40:57.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.637+0000 7f79fd40e640 1 -- start start 2023-11-04T01:40:57.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.637+0000 7f79fd40e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79f80adac0 0x7f79f80b3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.637+0000 7f79fd40e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f79f80c4ff0 0x7f79f80c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.637+0000 7f79fd40e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f79f8159c00 0x7f79f8144760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.637+0000 7f79fd40e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f80c6470 con 0x7f79f80adac0 2023-11-04T01:40:57.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.637+0000 7f79fd40e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f80b4370 con 0x7f79f80c4ff0 2023-11-04T01:40:57.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.637+0000 7f79fd40e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f80b3ad0 con 0x7f79f8159c00 2023-11-04T01:40:57.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.637+0000 7f79f6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79f80adac0 0x7f79f80b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.637+0000 7f79f6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79f80adac0 0x7f79f80b3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54620/0 (socket says 172.21.15.77:54620) 2023-11-04T01:40:57.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.637+0000 7f79f6ffd640 1 -- 172.21.15.77:0/2153749111 learned_addr learned my addr 172.21.15.77:0/2153749111 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:57.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.638+0000 7f79f67fc640 1 --2- 172.21.15.77:0/2153749111 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f79f80c4ff0 0x7f79f80c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.638+0000 7f79f77fe640 1 --2- 172.21.15.77:0/2153749111 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f79f8159c00 0x7f79f8144760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.638+0000 7f79f6ffd640 1 -- 172.21.15.77:0/2153749111 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f79f8159c00 msgr2=0x7f79f8144760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.638+0000 7f79f6ffd640 1 --2- 172.21.15.77:0/2153749111 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f79f8159c00 0x7f79f8144760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.638+0000 7f79f6ffd640 1 -- 172.21.15.77:0/2153749111 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f79f80c4ff0 msgr2=0x7f79f80c5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.638+0000 7f79f6ffd640 1 --2- 172.21.15.77:0/2153749111 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f79f80c4ff0 0x7f79f80c5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.638+0000 7f79f6ffd640 1 -- 172.21.15.77:0/2153749111 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ec00b770 con 0x7f79f80adac0 2023-11-04T01:40:57.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.638+0000 7f79f77fe640 1 --2- 172.21.15.77:0/2153749111 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f79f8159c00 0x7f79f8144760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:57.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.638+0000 7f79f6ffd640 1 --2- 172.21.15.77:0/2153749111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79f80adac0 0x7f79f80b3410 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f79e800ba50 tx=0x7f79e800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:57.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.638+0000 7f79df7fe640 1 -- 172.21.15.77:0/2153749111 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e800cbe0 con 0x7f79f80adac0 2023-11-04T01:40:57.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.638+0000 7f79df7fe640 1 -- 172.21.15.77:0/2153749111 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e800cd80 con 0x7f79f80adac0 2023-11-04T01:40:57.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.638+0000 7f79df7fe640 1 -- 172.21.15.77:0/2153749111 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e8014680 con 0x7f79f80adac0 2023-11-04T01:40:57.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.638+0000 7f79fd40e640 1 -- 172.21.15.77:0/2153749111 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f80b3db0 con 0x7f79f80adac0 2023-11-04T01:40:57.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.638+0000 7f79fd40e640 1 -- 172.21.15.77:0/2153749111 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f8157a40 con 0x7f79f80adac0 2023-11-04T01:40:57.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.639+0000 7f79fd40e640 1 -- 172.21.15.77:0/2153749111 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79f8074290 con 0x7f79f80adac0 2023-11-04T01:40:57.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.640+0000 7f79df7fe640 1 -- 172.21.15.77:0/2153749111 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f79e80147e0 con 0x7f79f80adac0 2023-11-04T01:40:57.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.640+0000 7f79df7fe640 1 --2- 172.21.15.77:0/2153749111 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f79e406ae70 0x7f79e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.640+0000 7f79df7fe640 1 -- 172.21.15.77:0/2153749111 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f79e8089830 con 0x7f79f80adac0 2023-11-04T01:40:57.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.640+0000 7f79f67fc640 1 --2- 172.21.15.77:0/2153749111 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f79e406ae70 0x7f79e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.641+0000 7f79f67fc640 1 --2- 172.21.15.77:0/2153749111 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f79e406ae70 0x7f79e406d330 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f79ec038000 tx=0x7f79ec008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:57.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.644+0000 7f79df7fe640 1 -- 172.21.15.77:0/2153749111 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f79e80545d0 con 0x7f79f80adac0 2023-11-04T01:40:57.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.814+0000 7f79fd40e640 1 -- 172.21.15.77:0/2153749111 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f79f80c3a20 con 0x7f79f80adac0 2023-11-04T01:40:57.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.814+0000 7f79df7fe640 1 -- 172.21.15.77:0/2153749111 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f79e8019020 con 0x7f79f80adac0 2023-11-04T01:40:57.816 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:40:57.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.816+0000 7f79fd40e640 1 -- 172.21.15.77:0/2153749111 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f79e406ae70 msgr2=0x7f79e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.816+0000 7f79fd40e640 1 --2- 172.21.15.77:0/2153749111 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f79e406ae70 0x7f79e406d330 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f79ec038000 tx=0x7f79ec008040 comp rx=0 tx=0).stop 2023-11-04T01:40:57.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.816+0000 7f79fd40e640 1 -- 172.21.15.77:0/2153749111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79f80adac0 msgr2=0x7f79f80b3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.816+0000 7f79fd40e640 1 --2- 172.21.15.77:0/2153749111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79f80adac0 0x7f79f80b3410 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f79e800ba50 tx=0x7f79e800bf10 comp rx=0 tx=0).stop 2023-11-04T01:40:57.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.816+0000 7f79fd40e640 1 -- 172.21.15.77:0/2153749111 shutdown_connections 2023-11-04T01:40:57.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.816+0000 7f79fd40e640 1 --2- 172.21.15.77:0/2153749111 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f79e406ae70 0x7f79e406d330 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.816+0000 7f79fd40e640 1 --2- 172.21.15.77:0/2153749111 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f79f8159c00 0x7f79f8144760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.816+0000 7f79fd40e640 1 --2- 172.21.15.77:0/2153749111 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f79f80c4ff0 0x7f79f80c5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.816+0000 7f79fd40e640 1 --2- 172.21.15.77:0/2153749111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79f80adac0 0x7f79f80b3410 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.816+0000 7f79fd40e640 1 -- 172.21.15.77:0/2153749111 >> 172.21.15.77:0/2153749111 conn(0x7f79f80ce950 msgr2=0x7f79f80c4470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:57.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.816+0000 7f79fd40e640 1 -- 172.21.15.77:0/2153749111 shutdown_connections 2023-11-04T01:40:57.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.816+0000 7f79fd40e640 1 -- 172.21.15.77:0/2153749111 wait complete. 2023-11-04T01:40:57.828 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:40:57.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.929+0000 7f70ebdd7640 1 Processor -- start 2023-11-04T01:40:57.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.929+0000 7f70ebdd7640 1 -- start start 2023-11-04T01:40:57.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.930+0000 7f70ebdd7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f70e40cd6d0 0x7f70e4161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.930+0000 7f70ebdd7640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f70e40b4880 0x7f70e40b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.930+0000 7f70ebdd7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e40cde60 con 0x7f70e4153e60 2023-11-04T01:40:57.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.930+0000 7f70ebdd7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e4160f90 con 0x7f70e40cd6d0 2023-11-04T01:40:57.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.930+0000 7f70ebdd7640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e4161960 con 0x7f70e40b4880 2023-11-04T01:40:57.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.930+0000 7f70e9b73640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f70e4153e60 0x7f70e415dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52626/0 (socket says 172.21.15.77:52626) 2023-11-04T01:40:57.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.930+0000 7f70e9b73640 1 -- 172.21.15.77:0/697308008 learned_addr learned my addr 172.21.15.77:0/697308008 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:57.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.930+0000 7f70e9372640 1 --2- 172.21.15.77:0/697308008 >> v2:172.21.15.77:3300/0 conn(0x7f70e40cd6d0 0x7f70e4161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.931+0000 7f70e9372640 1 -- 172.21.15.77:0/697308008 >> v2:172.21.15.122:3300/0 conn(0x7f70e40b4880 msgr2=0x7f70e40b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:57.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.931+0000 7f70e9372640 1 --2- 172.21.15.77:0/697308008 >> v2:172.21.15.122:3300/0 conn(0x7f70e40b4880 0x7f70e40b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.931+0000 7f70e9372640 1 -- 172.21.15.77:0/697308008 >> v1:172.21.15.77:6789/0 conn(0x7f70e4153e60 legacy=0x7f70e415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.931+0000 7f70e9372640 1 -- 172.21.15.77:0/697308008 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e40b5220 con 0x7f70e40cd6d0 2023-11-04T01:40:57.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.931+0000 7f70e8b71640 1 -- 172.21.15.77:0/697308008 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1483419929 0 0) 0x7f70e40cde60 con 0x7f70e4153e60 2023-11-04T01:40:57.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.931+0000 7f70e9372640 1 --2- 172.21.15.77:0/697308008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70e40cd6d0 0x7f70e4161420 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f70e40b8f40 tx=0x7f70d402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd76da5d161bc710 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:57.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.932+0000 7f70e8b71640 1 -- 172.21.15.77:0/697308008 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d4031830 con 0x7f70e40cd6d0 2023-11-04T01:40:57.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.932+0000 7f70e8b71640 1 -- 172.21.15.77:0/697308008 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d4031990 con 0x7f70e40cd6d0 2023-11-04T01:40:57.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.932+0000 7f70e8b71640 1 -- 172.21.15.77:0/697308008 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d4031d20 con 0x7f70e40cd6d0 2023-11-04T01:40:57.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.932+0000 7f70ebdd7640 1 -- 172.21.15.77:0/697308008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70e40cd6d0 msgr2=0x7f70e4161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.932+0000 7f70ebdd7640 1 --2- 172.21.15.77:0/697308008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70e40cd6d0 0x7f70e4161420 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f70e40b8f40 tx=0x7f70d402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.932+0000 7f70ebdd7640 1 -- 172.21.15.77:0/697308008 shutdown_connections 2023-11-04T01:40:57.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.932+0000 7f70ebdd7640 1 --2- 172.21.15.77:0/697308008 >> v2:172.21.15.122:3300/0 conn(0x7f70e40b4880 0x7f70e40b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.932+0000 7f70ebdd7640 1 --2- 172.21.15.77:0/697308008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70e40cd6d0 0x7f70e4161420 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.932+0000 7f70ebdd7640 1 -- 172.21.15.77:0/697308008 >> 172.21.15.77:0/697308008 conn(0x7f70e40cf880 msgr2=0x7f70e40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:57.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.932+0000 7f70ebdd7640 1 -- 172.21.15.77:0/697308008 shutdown_connections 2023-11-04T01:40:57.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.932+0000 7f70ebdd7640 1 -- 172.21.15.77:0/697308008 wait complete. 2023-11-04T01:40:57.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.933+0000 7f70ebdd7640 1 Processor -- start 2023-11-04T01:40:57.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.933+0000 7f70ebdd7640 1 -- start start 2023-11-04T01:40:57.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.934+0000 7f70ebdd7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70e40b4880 0x7f70e40d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.934+0000 7f70ebdd7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70e40cd6d0 0x7f70e40d12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.934+0000 7f70ebdd7640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70e4153e60 0x7f70e415a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.934+0000 7f70ebdd7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e4156f90 con 0x7f70e40b4880 2023-11-04T01:40:57.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.934+0000 7f70ebdd7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e41560b0 con 0x7f70e40cd6d0 2023-11-04T01:40:57.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.934+0000 7f70ebdd7640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e4156330 con 0x7f70e4153e60 2023-11-04T01:40:57.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.934+0000 7f70e9b73640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70e40b4880 0x7f70e40d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.934+0000 7f70e9b73640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70e40b4880 0x7f70e40d0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54640/0 (socket says 172.21.15.77:54640) 2023-11-04T01:40:57.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.934+0000 7f70e9b73640 1 -- 172.21.15.77:0/1264441539 learned_addr learned my addr 172.21.15.77:0/1264441539 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:57.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.934+0000 7f70e9372640 1 --2- 172.21.15.77:0/1264441539 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70e40cd6d0 0x7f70e40d12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.934+0000 7f70ea374640 1 --2- 172.21.15.77:0/1264441539 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70e4153e60 0x7f70e415a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.934+0000 7f70e9b73640 1 -- 172.21.15.77:0/1264441539 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70e4153e60 msgr2=0x7f70e415a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.934+0000 7f70e9b73640 1 --2- 172.21.15.77:0/1264441539 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70e4153e60 0x7f70e415a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.934+0000 7f70e9b73640 1 -- 172.21.15.77:0/1264441539 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70e40cd6d0 msgr2=0x7f70e40d12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:57.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.934+0000 7f70e9b73640 1 --2- 172.21.15.77:0/1264441539 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70e40cd6d0 0x7f70e40d12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:57.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.934+0000 7f70e9b73640 1 -- 172.21.15.77:0/1264441539 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d4009400 con 0x7f70e40b4880 2023-11-04T01:40:57.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.934+0000 7f70e9372640 1 --2- 172.21.15.77:0/1264441539 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70e40cd6d0 0x7f70e40d12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:57.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.935+0000 7f70e9b73640 1 --2- 172.21.15.77:0/1264441539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70e40b4880 0x7f70e40d0da0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f70e000c7c0 tx=0x7f70e000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:57.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.935+0000 7f70da7fc640 1 -- 172.21.15.77:0/1264441539 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e000a640 con 0x7f70e40b4880 2023-11-04T01:40:57.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.935+0000 7f70da7fc640 1 -- 172.21.15.77:0/1264441539 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e000a7c0 con 0x7f70e40b4880 2023-11-04T01:40:57.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.935+0000 7f70ebdd7640 1 -- 172.21.15.77:0/1264441539 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e41565f0 con 0x7f70e40b4880 2023-11-04T01:40:57.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.935+0000 7f70da7fc640 1 -- 172.21.15.77:0/1264441539 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e000ab70 con 0x7f70e40b4880 2023-11-04T01:40:57.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.935+0000 7f70ebdd7640 1 -- 172.21.15.77:0/1264441539 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e4156bb0 con 0x7f70e40b4880 2023-11-04T01:40:57.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.936+0000 7f70ebdd7640 1 -- 172.21.15.77:0/1264441539 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e4066920 con 0x7f70e40b4880 2023-11-04T01:40:57.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.936+0000 7f70da7fc640 1 -- 172.21.15.77:0/1264441539 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f70e000acd0 con 0x7f70e40b4880 2023-11-04T01:40:57.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.936+0000 7f70da7fc640 1 --2- 172.21.15.77:0/1264441539 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f70c806ae70 0x7f70c806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:57.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.937+0000 7f70da7fc640 1 -- 172.21.15.77:0/1264441539 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f70e0089180 con 0x7f70e40b4880 2023-11-04T01:40:57.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.937+0000 7f70e9372640 1 --2- 172.21.15.77:0/1264441539 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f70c806ae70 0x7f70c806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:57.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.937+0000 7f70e9372640 1 --2- 172.21.15.77:0/1264441539 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f70c806ae70 0x7f70c806d330 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f70d4036000 tx=0x7f70d4008030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:57.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:57.941+0000 7f70da7fc640 1 -- 172.21.15.77:0/1264441539 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f70e0053f00 con 0x7f70e40b4880 2023-11-04T01:40:58.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.109+0000 7f70ebdd7640 1 -- 172.21.15.77:0/1264441539 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f70e4074290 con 0x7f70e40b4880 2023-11-04T01:40:58.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.109+0000 7f70da7fc640 1 -- 172.21.15.77:0/1264441539 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f70e0057520 con 0x7f70e40b4880 2023-11-04T01:40:58.111 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-04T01:40:58.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.111+0000 7f70ebdd7640 1 -- 172.21.15.77:0/1264441539 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f70c806ae70 msgr2=0x7f70c806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:58.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.111+0000 7f70ebdd7640 1 --2- 172.21.15.77:0/1264441539 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f70c806ae70 0x7f70c806d330 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f70d4036000 tx=0x7f70d4008030 comp rx=0 tx=0).stop 2023-11-04T01:40:58.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.111+0000 7f70ebdd7640 1 -- 172.21.15.77:0/1264441539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70e40b4880 msgr2=0x7f70e40d0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:58.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.111+0000 7f70ebdd7640 1 --2- 172.21.15.77:0/1264441539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70e40b4880 0x7f70e40d0da0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f70e000c7c0 tx=0x7f70e000cc80 comp rx=0 tx=0).stop 2023-11-04T01:40:58.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.111+0000 7f70ebdd7640 1 -- 172.21.15.77:0/1264441539 shutdown_connections 2023-11-04T01:40:58.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.111+0000 7f70ebdd7640 1 --2- 172.21.15.77:0/1264441539 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f70c806ae70 0x7f70c806d330 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.111+0000 7f70ebdd7640 1 --2- 172.21.15.77:0/1264441539 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70e4153e60 0x7f70e415a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.111+0000 7f70ebdd7640 1 --2- 172.21.15.77:0/1264441539 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70e40cd6d0 0x7f70e40d12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.111+0000 7f70ebdd7640 1 --2- 172.21.15.77:0/1264441539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70e40b4880 0x7f70e40d0da0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.111+0000 7f70ebdd7640 1 -- 172.21.15.77:0/1264441539 >> 172.21.15.77:0/1264441539 conn(0x7f70e40cf880 msgr2=0x7f70e415fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:58.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.111+0000 7f70ebdd7640 1 -- 172.21.15.77:0/1264441539 shutdown_connections 2023-11-04T01:40:58.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.111+0000 7f70ebdd7640 1 -- 172.21.15.77:0/1264441539 wait complete. 2023-11-04T01:40:58.123 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:40:58.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.225+0000 7fd15efce640 1 Processor -- start 2023-11-04T01:40:58.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.225+0000 7fd15efce640 1 -- start start 2023-11-04T01:40:58.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.226+0000 7fd15efce640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd158070e20 0x7fd1580adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:58.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.226+0000 7fd15efce640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd1580ad730 0x7fd15815e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:58.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.226+0000 7fd15efce640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1580c3900 con 0x7fd15815ad30 2023-11-04T01:40:58.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.226+0000 7fd15efce640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1580ae260 con 0x7fd158070e20 2023-11-04T01:40:58.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.226+0000 7fd15efce640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1580c3be0 con 0x7fd1580ad730 2023-11-04T01:40:58.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.226+0000 7fd15cd6a640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd15815ad30 0x7fd158070710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52634/0 (socket says 172.21.15.77:52634) 2023-11-04T01:40:58.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.226+0000 7fd15cd6a640 1 -- 172.21.15.77:0/2098838910 learned_addr learned my addr 172.21.15.77:0/2098838910 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:58.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.226+0000 7fd15d56b640 1 --2- 172.21.15.77:0/2098838910 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd1580ad730 0x7fd15815e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:58.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.226+0000 7fd157fff640 1 --2- 172.21.15.77:0/2098838910 >> v2:172.21.15.122:3300/0 conn(0x7fd158070e20 0x7fd1580adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:58.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.226+0000 7fd1577fe640 1 -- 172.21.15.77:0/2098838910 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1071598054 0 0) 0x7fd1580c3900 con 0x7fd15815ad30 2023-11-04T01:40:58.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.226+0000 7fd1577fe640 1 -- 172.21.15.77:0/2098838910 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd148003520 con 0x7fd15815ad30 2023-11-04T01:40:58.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.226+0000 7fd1577fe640 1 -- 172.21.15.77:0/2098838910 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 787065822 0 0) 0x7fd148003520 con 0x7fd15815ad30 2023-11-04T01:40:58.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.226+0000 7fd1577fe640 1 -- 172.21.15.77:0/2098838910 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd1580ad730 msgr2=0x7fd15815e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:58.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.226+0000 7fd1577fe640 1 --2- 172.21.15.77:0/2098838910 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd1580ad730 0x7fd15815e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.226+0000 7fd1577fe640 1 -- 172.21.15.77:0/2098838910 >> v2:172.21.15.122:3300/0 conn(0x7fd158070e20 msgr2=0x7fd1580adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:58.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.226+0000 7fd1577fe640 1 --2- 172.21.15.77:0/2098838910 >> v2:172.21.15.122:3300/0 conn(0x7fd158070e20 0x7fd1580adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.226+0000 7fd1577fe640 1 -- 172.21.15.77:0/2098838910 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1580c3ec0 con 0x7fd15815ad30 2023-11-04T01:40:58.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.226+0000 7fd1577fe640 1 -- 172.21.15.77:0/2098838910 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7fd14c001670 con 0x7fd15815ad30 2023-11-04T01:40:58.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.226+0000 7fd1577fe640 1 -- 172.21.15.77:0/2098838910 >> v1:172.21.15.77:6789/0 conn(0x7fd15815ad30 legacy=0x7fd158070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:58.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.226+0000 7fd1577fe640 1 --2- 172.21.15.77:0/2098838910 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd1580ad730 0x7fd148003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:58.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.226+0000 7fd1577fe640 1 --2- 172.21.15.77:0/2098838910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd148003ef0 0x7fd1480047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:58.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.227+0000 7fd1577fe640 1 --2- 172.21.15.77:0/2098838910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd148004d00 0x7fd148005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:58.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.227+0000 7fd1577fe640 1 -- 172.21.15.77:0/2098838910 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1580ae260 con 0x7fd148004d00 2023-11-04T01:40:58.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.227+0000 7fd1577fe640 1 -- 172.21.15.77:0/2098838910 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1580c3be0 con 0x7fd148003ef0 2023-11-04T01:40:58.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.227+0000 7fd1577fe640 1 -- 172.21.15.77:0/2098838910 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd14800b9d0 con 0x7fd1580ad730 2023-11-04T01:40:58.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.227+0000 7fd15d56b640 1 --2- 172.21.15.77:0/2098838910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd148004d00 0x7fd148005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:58.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.227+0000 7fd15cd6a640 1 --2- 172.21.15.77:0/2098838910 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd1580ad730 0x7fd148003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:58.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.227+0000 7fd157fff640 1 --2- 172.21.15.77:0/2098838910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd148003ef0 0x7fd1480047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:58.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.227+0000 7fd15d56b640 1 -- 172.21.15.77:0/2098838910 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd1580ad730 msgr2=0x7fd148003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:58.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.227+0000 7fd15d56b640 1 --2- 172.21.15.77:0/2098838910 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd1580ad730 0x7fd148003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.227+0000 7fd15d56b640 1 -- 172.21.15.77:0/2098838910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd148003ef0 msgr2=0x7fd1480047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:58.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.227+0000 7fd15d56b640 1 --2- 172.21.15.77:0/2098838910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd148003ef0 0x7fd1480047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.227+0000 7fd15d56b640 1 -- 172.21.15.77:0/2098838910 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd148003520 con 0x7fd148004d00 2023-11-04T01:40:58.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.227+0000 7fd15cd6a640 1 --2- 172.21.15.77:0/2098838910 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd1580ad730 0x7fd148003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:58.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.228+0000 7fd15d56b640 1 --2- 172.21.15.77:0/2098838910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd148004d00 0x7fd148005180 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd15000e170 tx=0x7fd1480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e60e64695d8e7f77 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:58.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.228+0000 7fd1577fe640 1 -- 172.21.15.77:0/2098838910 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15002cbf0 con 0x7fd148004d00 2023-11-04T01:40:58.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.228+0000 7fd1577fe640 1 -- 172.21.15.77:0/2098838910 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd15000f040 con 0x7fd148004d00 2023-11-04T01:40:58.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.228+0000 7fd1577fe640 1 -- 172.21.15.77:0/2098838910 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd150034440 con 0x7fd148004d00 2023-11-04T01:40:58.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.228+0000 7fd15efce640 1 -- 172.21.15.77:0/2098838910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd148004d00 msgr2=0x7fd148005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:58.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.228+0000 7fd15efce640 1 --2- 172.21.15.77:0/2098838910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd148004d00 0x7fd148005180 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd15000e170 tx=0x7fd1480057f0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.228+0000 7fd15d56b640 1 -- 172.21.15.77:0/2098838910 reap_dead start 2023-11-04T01:40:58.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.228+0000 7fd15efce640 1 -- 172.21.15.77:0/2098838910 shutdown_connections 2023-11-04T01:40:58.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.228+0000 7fd15efce640 1 -- 172.21.15.77:0/2098838910 >> 172.21.15.77:0/2098838910 conn(0x7fd1580ce950 msgr2=0x7fd1580ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:58.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.228+0000 7fd15efce640 1 -- 172.21.15.77:0/2098838910 shutdown_connections 2023-11-04T01:40:58.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.228+0000 7fd15efce640 1 -- 172.21.15.77:0/2098838910 wait complete. 2023-11-04T01:40:58.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.229+0000 7fd15efce640 1 Processor -- start 2023-11-04T01:40:58.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.229+0000 7fd15efce640 1 -- start start 2023-11-04T01:40:58.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.230+0000 7fd15efce640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd148004d00 0x7fd15814c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:58.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.230+0000 7fd15efce640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1580aca10 0x7fd1580ace70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:58.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.230+0000 7fd15efce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1580b12b0 0x7fd1580b1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:58.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.230+0000 7fd15efce640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1580b1c70 con 0x7fd1580b12b0 2023-11-04T01:40:58.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.230+0000 7fd15efce640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1580ac580 con 0x7fd1580aca10 2023-11-04T01:40:58.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.230+0000 7fd15efce640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1580ab970 con 0x7fd148004d00 2023-11-04T01:40:58.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.230+0000 7fd15d56b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1580b12b0 0x7fd1580b1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:58.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.230+0000 7fd15d56b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1580b12b0 0x7fd1580b1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54656/0 (socket says 172.21.15.77:54656) 2023-11-04T01:40:58.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.230+0000 7fd15d56b640 1 -- 172.21.15.77:0/579754281 learned_addr learned my addr 172.21.15.77:0/579754281 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:58.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.231+0000 7fd15cd6a640 1 --2- 172.21.15.77:0/579754281 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd148004d00 0x7fd15814c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:58.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.231+0000 7fd157fff640 1 --2- 172.21.15.77:0/579754281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1580aca10 0x7fd1580ace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:58.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.231+0000 7fd15d56b640 1 -- 172.21.15.77:0/579754281 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd148004d00 msgr2=0x7fd15814c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:58.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.231+0000 7fd15d56b640 1 --2- 172.21.15.77:0/579754281 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd148004d00 0x7fd15814c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.231+0000 7fd15d56b640 1 -- 172.21.15.77:0/579754281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1580aca10 msgr2=0x7fd1580ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:58.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.231+0000 7fd15d56b640 1 --2- 172.21.15.77:0/579754281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1580aca10 0x7fd1580ace70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.231+0000 7fd15d56b640 1 -- 172.21.15.77:0/579754281 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1580abc50 con 0x7fd1580b12b0 2023-11-04T01:40:58.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.231+0000 7fd157fff640 1 --2- 172.21.15.77:0/579754281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1580aca10 0x7fd1580ace70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:58.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.231+0000 7fd15d56b640 1 --2- 172.21.15.77:0/579754281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1580b12b0 0x7fd1580b1730 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd15000e170 tx=0x7fd150009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:58.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.231+0000 7fd1557fa640 1 -- 172.21.15.77:0/579754281 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd150043070 con 0x7fd1580b12b0 2023-11-04T01:40:58.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.231+0000 7fd1557fa640 1 -- 172.21.15.77:0/579754281 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd150034ad0 con 0x7fd1580b12b0 2023-11-04T01:40:58.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.231+0000 7fd15efce640 1 -- 172.21.15.77:0/579754281 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1580abf30 con 0x7fd1580b12b0 2023-11-04T01:40:58.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.231+0000 7fd1557fa640 1 -- 172.21.15.77:0/579754281 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd150034e80 con 0x7fd1580b12b0 2023-11-04T01:40:58.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.231+0000 7fd15efce640 1 -- 172.21.15.77:0/579754281 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd15814ca90 con 0x7fd1580b12b0 2023-11-04T01:40:58.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.232+0000 7fd15efce640 1 -- 172.21.15.77:0/579754281 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd158074290 con 0x7fd1580b12b0 2023-11-04T01:40:58.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.232+0000 7fd1557fa640 1 -- 172.21.15.77:0/579754281 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd15003e440 con 0x7fd1580b12b0 2023-11-04T01:40:58.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.233+0000 7fd1557fa640 1 --2- 172.21.15.77:0/579754281 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd13c06ae70 0x7fd13c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:58.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.233+0000 7fd1557fa640 1 -- 172.21.15.77:0/579754281 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd1500ab690 con 0x7fd1580b12b0 2023-11-04T01:40:58.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.233+0000 7fd15cd6a640 1 --2- 172.21.15.77:0/579754281 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd13c06ae70 0x7fd13c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:58.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.233+0000 7fd15cd6a640 1 --2- 172.21.15.77:0/579754281 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd13c06ae70 0x7fd13c06d330 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd14c001050 tx=0x7fd14c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:58.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.237+0000 7fd1557fa640 1 -- 172.21.15.77:0/579754281 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd150076380 con 0x7fd1580b12b0 2023-11-04T01:40:58.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.402+0000 7fd15efce640 1 -- 172.21.15.77:0/579754281 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd1580ac6c0 con 0x7fd1580b12b0 2023-11-04T01:40:58.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.402+0000 7fd1557fa640 1 -- 172.21.15.77:0/579754281 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd1500799a0 con 0x7fd1580b12b0 2023-11-04T01:40:58.404 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:40:58.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.404+0000 7fd15efce640 1 -- 172.21.15.77:0/579754281 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd13c06ae70 msgr2=0x7fd13c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:58.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.404+0000 7fd15efce640 1 --2- 172.21.15.77:0/579754281 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd13c06ae70 0x7fd13c06d330 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd14c001050 tx=0x7fd14c009040 comp rx=0 tx=0).stop 2023-11-04T01:40:58.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.404+0000 7fd15efce640 1 -- 172.21.15.77:0/579754281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1580b12b0 msgr2=0x7fd1580b1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:58.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.404+0000 7fd15efce640 1 --2- 172.21.15.77:0/579754281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1580b12b0 0x7fd1580b1730 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd15000e170 tx=0x7fd150009750 comp rx=0 tx=0).stop 2023-11-04T01:40:58.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.404+0000 7fd15efce640 1 -- 172.21.15.77:0/579754281 shutdown_connections 2023-11-04T01:40:58.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.404+0000 7fd15efce640 1 --2- 172.21.15.77:0/579754281 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd13c06ae70 0x7fd13c06d330 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.404+0000 7fd15efce640 1 --2- 172.21.15.77:0/579754281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1580b12b0 0x7fd1580b1730 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.404+0000 7fd15efce640 1 --2- 172.21.15.77:0/579754281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1580aca10 0x7fd1580ace70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.404+0000 7fd15efce640 1 --2- 172.21.15.77:0/579754281 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd148004d00 0x7fd15814c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.404+0000 7fd15efce640 1 -- 172.21.15.77:0/579754281 >> 172.21.15.77:0/579754281 conn(0x7fd1580ce950 msgr2=0x7fd158072ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:58.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.404+0000 7fd15efce640 1 -- 172.21.15.77:0/579754281 shutdown_connections 2023-11-04T01:40:58.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.404+0000 7fd15efce640 1 -- 172.21.15.77:0/579754281 wait complete. 2023-11-04T01:40:58.417 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:40:58.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.515+0000 7f7bf3007640 1 Processor -- start 2023-11-04T01:40:58.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.515+0000 7f7bf3007640 1 -- start start 2023-11-04T01:40:58.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.516+0000 7f7bf3007640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7bec153850 0x7f7bec15a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:58.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.516+0000 7f7bf3007640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7bec0cc520 0x7f7bec070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:58.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.516+0000 7f7bf3007640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bec0c3860 con 0x7f7bec0cc9d0 2023-11-04T01:40:58.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.516+0000 7f7bf3007640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bec0c9250 con 0x7f7bec0cc520 2023-11-04T01:40:58.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.516+0000 7f7bf3007640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bec153c30 con 0x7f7bec153850 2023-11-04T01:40:58.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.516+0000 7f7bebfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7bec0cc520 0x7f7bec070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:58.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.516+0000 7f7bf15a4640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f7bec0cc9d0 0x7f7bec0c3cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52642/0 (socket says 172.21.15.77:52642) 2023-11-04T01:40:58.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.516+0000 7f7bf15a4640 1 -- 172.21.15.77:0/1468396605 learned_addr learned my addr 172.21.15.77:0/1468396605 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:58.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.516+0000 7f7bebfff640 1 --2- 172.21.15.77:0/1468396605 >> v2:172.21.15.77:3300/0 conn(0x7f7bec0cc520 0x7f7bec070fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54664/0 (socket says 172.21.15.77:54664) 2023-11-04T01:40:58.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.516+0000 7f7bf0da3640 1 --2- 172.21.15.77:0/1468396605 >> v2:172.21.15.122:3300/0 conn(0x7f7bec153850 0x7f7bec15a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:58.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.516+0000 7f7bebfff640 1 -- 172.21.15.77:0/1468396605 >> v2:172.21.15.122:3300/0 conn(0x7f7bec153850 msgr2=0x7f7bec15a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:58.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.516+0000 7f7bebfff640 1 --2- 172.21.15.77:0/1468396605 >> v2:172.21.15.122:3300/0 conn(0x7f7bec153850 0x7f7bec15a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.516+0000 7f7bebfff640 1 -- 172.21.15.77:0/1468396605 >> v1:172.21.15.77:6789/0 conn(0x7f7bec0cc9d0 legacy=0x7f7bec0c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:58.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.516+0000 7f7beb7fe640 1 -- 172.21.15.77:0/1468396605 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 221156035 0 0) 0x7f7bec0c3860 con 0x7f7bec0cc9d0 2023-11-04T01:40:58.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.516+0000 7f7bebfff640 1 -- 172.21.15.77:0/1468396605 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bec15a700 con 0x7f7bec0cc520 2023-11-04T01:40:58.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.516+0000 7f7bf0da3640 1 --2- 172.21.15.77:0/1468396605 >> v2:172.21.15.122:3300/0 conn(0x7f7bec153850 0x7f7bec15a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:58.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.517+0000 7f7bebfff640 1 --2- 172.21.15.77:0/1468396605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bec0cc520 0x7f7bec070fa0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7bec0c5710 tx=0x7f7bd802e0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8abeed8ecec2f08d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:58.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.517+0000 7f7beb7fe640 1 -- 172.21.15.77:0/1468396605 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd802ee50 con 0x7f7bec0cc520 2023-11-04T01:40:58.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.517+0000 7f7beb7fe640 1 -- 172.21.15.77:0/1468396605 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd8036440 con 0x7f7bec0cc520 2023-11-04T01:40:58.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.517+0000 7f7beb7fe640 1 -- 172.21.15.77:0/1468396605 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd80367d0 con 0x7f7bec0cc520 2023-11-04T01:40:58.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.517+0000 7f7bf3007640 1 -- 172.21.15.77:0/1468396605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bec0cc520 msgr2=0x7f7bec070fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:58.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.517+0000 7f7bf3007640 1 --2- 172.21.15.77:0/1468396605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bec0cc520 0x7f7bec070fa0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7bec0c5710 tx=0x7f7bd802e0a0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.518+0000 7f7bf3007640 1 -- 172.21.15.77:0/1468396605 shutdown_connections 2023-11-04T01:40:58.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.518+0000 7f7bf3007640 1 --2- 172.21.15.77:0/1468396605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bec0cc520 0x7f7bec070fa0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.518+0000 7f7bf3007640 1 --2- 172.21.15.77:0/1468396605 >> v2:172.21.15.122:3300/0 conn(0x7f7bec153850 0x7f7bec15a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.518+0000 7f7bf3007640 1 -- 172.21.15.77:0/1468396605 >> 172.21.15.77:0/1468396605 conn(0x7f7bec0ce950 msgr2=0x7f7bec0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:58.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.518+0000 7f7bf3007640 1 -- 172.21.15.77:0/1468396605 shutdown_connections 2023-11-04T01:40:58.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.518+0000 7f7bf3007640 1 -- 172.21.15.77:0/1468396605 wait complete. 2023-11-04T01:40:58.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.519+0000 7f7bf3007640 1 Processor -- start 2023-11-04T01:40:58.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.519+0000 7f7bf3007640 1 -- start start 2023-11-04T01:40:58.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.519+0000 7f7bf3007640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bec0cc520 0x7f7bec0c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:58.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.520+0000 7f7bf3007640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bec0cc9d0 0x7f7bec156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:58.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.520+0000 7f7bf3007640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7bec153850 0x7f7bec14edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:58.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.520+0000 7f7bf3007640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bec156cd0 con 0x7f7bec0cc520 2023-11-04T01:40:58.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.520+0000 7f7bf3007640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bec1549b0 con 0x7f7bec0cc9d0 2023-11-04T01:40:58.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.520+0000 7f7bf3007640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bec154f50 con 0x7f7bec153850 2023-11-04T01:40:58.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.520+0000 7f7bf0da3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bec0cc520 0x7f7bec0c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:58.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.520+0000 7f7bf0da3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bec0cc520 0x7f7bec0c73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54674/0 (socket says 172.21.15.77:54674) 2023-11-04T01:40:58.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.520+0000 7f7bf0da3640 1 -- 172.21.15.77:0/1211829264 learned_addr learned my addr 172.21.15.77:0/1211829264 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:58.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.520+0000 7f7bf0da3640 1 -- 172.21.15.77:0/1211829264 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7bec153850 msgr2=0x7f7bec14edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:58.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.520+0000 7f7bf0da3640 1 --2- 172.21.15.77:0/1211829264 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7bec153850 0x7f7bec14edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.520+0000 7f7bf0da3640 1 -- 172.21.15.77:0/1211829264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bec0cc9d0 msgr2=0x7f7bec156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:58.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.520+0000 7f7bf0da3640 1 --2- 172.21.15.77:0/1211829264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bec0cc9d0 0x7f7bec156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.520+0000 7f7bf0da3640 1 -- 172.21.15.77:0/1211829264 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd800b6a0 con 0x7f7bec0cc520 2023-11-04T01:40:58.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.520+0000 7f7bf0da3640 1 --2- 172.21.15.77:0/1211829264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bec0cc520 0x7f7bec0c73d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7be000c7f0 tx=0x7f7be000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:58.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.520+0000 7f7be97fa640 1 -- 172.21.15.77:0/1211829264 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be0007820 con 0x7f7bec0cc520 2023-11-04T01:40:58.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.520+0000 7f7be97fa640 1 -- 172.21.15.77:0/1211829264 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be0007980 con 0x7f7bec0cc520 2023-11-04T01:40:58.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.520+0000 7f7be97fa640 1 -- 172.21.15.77:0/1211829264 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be0007cf0 con 0x7f7bec0cc520 2023-11-04T01:40:58.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.520+0000 7f7bf3007640 1 -- 172.21.15.77:0/1211829264 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bec14f300 con 0x7f7bec0cc520 2023-11-04T01:40:58.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.520+0000 7f7bf3007640 1 -- 172.21.15.77:0/1211829264 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bec0c7d90 con 0x7f7bec0cc520 2023-11-04T01:40:58.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.521+0000 7f7bf3007640 1 -- 172.21.15.77:0/1211829264 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bec074290 con 0x7f7bec0cc520 2023-11-04T01:40:58.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.522+0000 7f7be97fa640 1 -- 172.21.15.77:0/1211829264 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7be00113f0 con 0x7f7bec0cc520 2023-11-04T01:40:58.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.522+0000 7f7be97fa640 1 --2- 172.21.15.77:0/1211829264 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7bd006ae70 0x7f7bd006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:58.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.522+0000 7f7be97fa640 1 -- 172.21.15.77:0/1211829264 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7be0089d30 con 0x7f7bec0cc520 2023-11-04T01:40:58.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.522+0000 7f7bebfff640 1 --2- 172.21.15.77:0/1211829264 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7bd006ae70 0x7f7bd006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:58.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.523+0000 7f7bebfff640 1 --2- 172.21.15.77:0/1211829264 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7bd006ae70 0x7f7bd006d330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8038000 tx=0x7f7bd8030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:58.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.526+0000 7f7be97fa640 1 -- 172.21.15.77:0/1211829264 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7be0054a00 con 0x7f7bec0cc520 2023-11-04T01:40:58.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.704+0000 7f7bf3007640 1 -- 172.21.15.77:0/1211829264 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7bec0c5010 con 0x7f7bec0cc520 2023-11-04T01:40:58.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.705+0000 7f7be97fa640 1 -- 172.21.15.77:0/1211829264 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7be001f080 con 0x7f7bec0cc520 2023-11-04T01:40:58.707 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-11-04T01:40:58.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.706+0000 7f7bf3007640 1 -- 172.21.15.77:0/1211829264 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7bd006ae70 msgr2=0x7f7bd006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:58.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.706+0000 7f7bf3007640 1 --2- 172.21.15.77:0/1211829264 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7bd006ae70 0x7f7bd006d330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8038000 tx=0x7f7bd8030000 comp rx=0 tx=0).stop 2023-11-04T01:40:58.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.706+0000 7f7bf3007640 1 -- 172.21.15.77:0/1211829264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bec0cc520 msgr2=0x7f7bec0c73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:58.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.706+0000 7f7bf3007640 1 --2- 172.21.15.77:0/1211829264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bec0cc520 0x7f7bec0c73d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7be000c7f0 tx=0x7f7be000ccb0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.706+0000 7f7bf3007640 1 -- 172.21.15.77:0/1211829264 shutdown_connections 2023-11-04T01:40:58.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.706+0000 7f7bf3007640 1 --2- 172.21.15.77:0/1211829264 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7bd006ae70 0x7f7bd006d330 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.706+0000 7f7bf3007640 1 --2- 172.21.15.77:0/1211829264 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7bec153850 0x7f7bec14edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.706+0000 7f7bf3007640 1 --2- 172.21.15.77:0/1211829264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bec0cc9d0 0x7f7bec156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.706+0000 7f7bf3007640 1 --2- 172.21.15.77:0/1211829264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bec0cc520 0x7f7bec0c73d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:58.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.706+0000 7f7bf3007640 1 -- 172.21.15.77:0/1211829264 >> 172.21.15.77:0/1211829264 conn(0x7f7bec0ce950 msgr2=0x7f7bec1526d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:58.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.707+0000 7f7bf3007640 1 -- 172.21.15.77:0/1211829264 shutdown_connections 2023-11-04T01:40:58.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58.707+0000 7f7bf3007640 1 -- 172.21.15.77:0/1211829264 wait complete. 2023-11-04T01:40:58.721 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi077.front.sepia.ceph.com... 2023-11-04T01:40:58.722 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:40:58.722 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T01:40:58.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:58.781 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[128901]: fuse finished with error 0 and tester_r 0 2023-11-04T01:40:58.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:58.786 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:2023-11-04T01:40:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:40:58.788 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:40:58.794 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2023-11-04T01:40:58.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:40:58.795 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:40:58.850 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:40:58.850 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:40:58.869 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:40:58.869 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:40:58.929 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:40:58.968 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi122.stderr:2023-11-04T01:40:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:40:59.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.027+0000 7f74f0690640 1 Processor -- start 2023-11-04T01:40:59.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.027+0000 7f74f0690640 1 -- start start 2023-11-04T01:40:59.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.028+0000 7f74f0690640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74e815ce40 0x7f74e8161460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.028+0000 7f74f0690640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f74e806cc50 0x7f74e80b2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.028+0000 7f74f0690640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74e80b2f70 con 0x7f74e80b2b40 2023-11-04T01:40:59.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.028+0000 7f74f0690640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74e806b910 con 0x7f74e806cc50 2023-11-04T01:40:59.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.028+0000 7f74f0690640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e81619a0 con 0x7f74e815ce40 2023-11-04T01:40:59.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.028+0000 7f74edc2b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f74e806cc50 0x7f74e80b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.028+0000 7f74edc2b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f74e806cc50 0x7f74e80b2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54678/0 (socket says 172.21.15.77:54678) 2023-11-04T01:40:59.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.028+0000 7f74edc2b640 1 -- 172.21.15.77:0/4093597554 learned_addr learned my addr 172.21.15.77:0/4093597554 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:59.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.028+0000 7f74ee42c640 1 --2- 172.21.15.77:0/4093597554 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74e815ce40 0x7f74e8161460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.028+0000 7f74edc2b640 1 -- 172.21.15.77:0/4093597554 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74e815ce40 msgr2=0x7f74e8161460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:59.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.028+0000 7f74edc2b640 1 --2- 172.21.15.77:0/4093597554 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74e815ce40 0x7f74e8161460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.028+0000 7f74edc2b640 1 -- 172.21.15.77:0/4093597554 >> v1:172.21.15.122:6789/0 conn(0x7f74e80b2b40 legacy=0x7f74e80cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:59.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.029+0000 7f74edc2b640 1 -- 172.21.15.77:0/4093597554 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e806bbb0 con 0x7f74e806cc50 2023-11-04T01:40:59.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.030+0000 7f74edc2b640 1 --2- 172.21.15.77:0/4093597554 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74e806cc50 0x7f74e80b2600 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f74e4009870 tx=0x7f74e402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1fa893286a43a08 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:59.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.030+0000 7f74ed42a640 1 -- 172.21.15.77:0/4093597554 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e4030840 con 0x7f74e806cc50 2023-11-04T01:40:59.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.030+0000 7f74ed42a640 1 -- 172.21.15.77:0/4093597554 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e40309a0 con 0x7f74e806cc50 2023-11-04T01:40:59.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.030+0000 7f74ed42a640 1 -- 172.21.15.77:0/4093597554 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e4030d30 con 0x7f74e806cc50 2023-11-04T01:40:59.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.030+0000 7f74f0690640 1 -- 172.21.15.77:0/4093597554 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74e806cc50 msgr2=0x7f74e80b2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.030+0000 7f74f0690640 1 --2- 172.21.15.77:0/4093597554 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74e806cc50 0x7f74e80b2600 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f74e4009870 tx=0x7f74e402b980 comp rx=0 tx=0).stop 2023-11-04T01:40:59.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.031+0000 7f74f0690640 1 -- 172.21.15.77:0/4093597554 shutdown_connections 2023-11-04T01:40:59.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.031+0000 7f74f0690640 1 --2- 172.21.15.77:0/4093597554 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74e806cc50 0x7f74e80b2600 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.031+0000 7f74f0690640 1 --2- 172.21.15.77:0/4093597554 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74e815ce40 0x7f74e8161460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.031+0000 7f74f0690640 1 -- 172.21.15.77:0/4093597554 >> 172.21.15.77:0/4093597554 conn(0x7f74e80cd600 msgr2=0x7f74e80cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:59.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.031+0000 7f74f0690640 1 -- 172.21.15.77:0/4093597554 shutdown_connections 2023-11-04T01:40:59.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.031+0000 7f74f0690640 1 -- 172.21.15.77:0/4093597554 wait complete. 2023-11-04T01:40:59.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.032+0000 7f74f0690640 1 Processor -- start 2023-11-04T01:40:59.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.032+0000 7f74f0690640 1 -- start start 2023-11-04T01:40:59.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.032+0000 7f74f0690640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74e806cc50 0x7f74e815fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.032+0000 7f74f0690640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74e80b2b40 0x7f74e80b5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.032+0000 7f74f0690640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74e815ce40 0x7f74e80c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.032+0000 7f74f0690640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e815e000 con 0x7f74e80b2b40 2023-11-04T01:40:59.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.032+0000 7f74f0690640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e80b6130 con 0x7f74e806cc50 2023-11-04T01:40:59.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.032+0000 7f74f0690640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e80b5b70 con 0x7f74e815ce40 2023-11-04T01:40:59.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.033+0000 7f74edc2b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74e80b2b40 0x7f74e80b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.033+0000 7f74edc2b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74e80b2b40 0x7f74e80b5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54682/0 (socket says 172.21.15.77:54682) 2023-11-04T01:40:59.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.033+0000 7f74edc2b640 1 -- 172.21.15.77:0/3564191641 learned_addr learned my addr 172.21.15.77:0/3564191641 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:59.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.033+0000 7f74edc2b640 1 -- 172.21.15.77:0/3564191641 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74e815ce40 msgr2=0x7f74e80c7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.033+0000 7f74edc2b640 1 --2- 172.21.15.77:0/3564191641 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74e815ce40 0x7f74e80c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.033+0000 7f74edc2b640 1 -- 172.21.15.77:0/3564191641 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74e806cc50 msgr2=0x7f74e815fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.033+0000 7f74edc2b640 1 --2- 172.21.15.77:0/3564191641 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74e806cc50 0x7f74e815fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.033+0000 7f74edc2b640 1 -- 172.21.15.77:0/3564191641 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e40094d0 con 0x7f74e80b2b40 2023-11-04T01:40:59.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.033+0000 7f74edc2b640 1 --2- 172.21.15.77:0/3564191641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74e80b2b40 0x7f74e80b5200 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f74e4000c00 tx=0x7f74e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:59.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.033+0000 7f74deffd640 1 -- 172.21.15.77:0/3564191641 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e4039a90 con 0x7f74e80b2b40 2023-11-04T01:40:59.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.033+0000 7f74deffd640 1 -- 172.21.15.77:0/3564191641 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e4039bf0 con 0x7f74e80b2b40 2023-11-04T01:40:59.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.033+0000 7f74f0690640 1 -- 172.21.15.77:0/3564191641 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e80b5e50 con 0x7f74e80b2b40 2023-11-04T01:40:59.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.033+0000 7f74deffd640 1 -- 172.21.15.77:0/3564191641 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e4043410 con 0x7f74e80b2b40 2023-11-04T01:40:59.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.033+0000 7f74f0690640 1 -- 172.21.15.77:0/3564191641 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e8160340 con 0x7f74e80b2b40 2023-11-04T01:40:59.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.034+0000 7f74f0690640 1 -- 172.21.15.77:0/3564191641 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74e80674e0 con 0x7f74e80b2b40 2023-11-04T01:40:59.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.035+0000 7f74deffd640 1 -- 172.21.15.77:0/3564191641 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f74e402f390 con 0x7f74e80b2b40 2023-11-04T01:40:59.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.035+0000 7f74deffd640 1 --2- 172.21.15.77:0/3564191641 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f74cc06ae70 0x7f74cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.035+0000 7f74deffd640 1 -- 172.21.15.77:0/3564191641 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f74e40abb80 con 0x7f74e80b2b40 2023-11-04T01:40:59.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.035+0000 7f74ee42c640 1 --2- 172.21.15.77:0/3564191641 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f74cc06ae70 0x7f74cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.036+0000 7f74ee42c640 1 --2- 172.21.15.77:0/3564191641 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f74cc06ae70 0x7f74cc06d330 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f74d8006e20 tx=0x7f74d8008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:59.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.039+0000 7f74deffd640 1 -- 172.21.15.77:0/3564191641 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f74e4076880 con 0x7f74e80b2b40 2023-11-04T01:40:59.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.212+0000 7f74f0690640 1 -- 172.21.15.77:0/3564191641 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74e815e140 con 0x7f74e80b2b40 2023-11-04T01:40:59.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.213+0000 7f74deffd640 1 -- 172.21.15.77:0/3564191641 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18661 (secure 0 0 0) 0x7f74e4079ea0 con 0x7f74e80b2b40 2023-11-04T01:40:59.215 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:40:59.215 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":26,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:40:47.579547+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:40:02.810971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:40:04.003979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:40:07.734355+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:40:59.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.215+0000 7f74f0690640 1 -- 172.21.15.77:0/3564191641 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f74cc06ae70 msgr2=0x7f74cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.215+0000 7f74f0690640 1 --2- 172.21.15.77:0/3564191641 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f74cc06ae70 0x7f74cc06d330 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f74d8006e20 tx=0x7f74d8008040 comp rx=0 tx=0).stop 2023-11-04T01:40:59.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.215+0000 7f74f0690640 1 -- 172.21.15.77:0/3564191641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74e80b2b40 msgr2=0x7f74e80b5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.215+0000 7f74f0690640 1 --2- 172.21.15.77:0/3564191641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74e80b2b40 0x7f74e80b5200 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f74e4000c00 tx=0x7f74e4004730 comp rx=0 tx=0).stop 2023-11-04T01:40:59.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.215+0000 7f74f0690640 1 -- 172.21.15.77:0/3564191641 shutdown_connections 2023-11-04T01:40:59.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.215+0000 7f74f0690640 1 --2- 172.21.15.77:0/3564191641 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f74cc06ae70 0x7f74cc06d330 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.215+0000 7f74f0690640 1 --2- 172.21.15.77:0/3564191641 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74e815ce40 0x7f74e80c7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.215+0000 7f74f0690640 1 --2- 172.21.15.77:0/3564191641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74e80b2b40 0x7f74e80b5200 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.215+0000 7f74f0690640 1 --2- 172.21.15.77:0/3564191641 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74e806cc50 0x7f74e815fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.215+0000 7f74f0690640 1 -- 172.21.15.77:0/3564191641 >> 172.21.15.77:0/3564191641 conn(0x7f74e80cd600 msgr2=0x7f74e80ce8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:59.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.215+0000 7f74f0690640 1 -- 172.21.15.77:0/3564191641 shutdown_connections 2023-11-04T01:40:59.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.215+0000 7f74f0690640 1 -- 172.21.15.77:0/3564191641 wait complete. 2023-11-04T01:40:59.227 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:40:02.810971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:40:04.003979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:40:07.734355+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:40:59.228 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:40:59.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.332+0000 7f7437864640 1 Processor -- start 2023-11-04T01:40:59.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.332+0000 7f7437864640 1 -- start start 2023-11-04T01:40:59.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.333+0000 7f7437864640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7430153850 0x7f743015a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.333+0000 7f7437864640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74300cc9d0 0x7f7430070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.333+0000 7f7437864640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74300c3860 con 0x7f74300cc520 2023-11-04T01:40:59.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.333+0000 7f7437864640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74300c9250 con 0x7f7430153850 2023-11-04T01:40:59.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.333+0000 7f7437864640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7430153c30 con 0x7f74300cc9d0 2023-11-04T01:40:59.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.333+0000 7f7435600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7430153850 0x7f743015a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.333+0000 7f7434dff640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f74300cc520 0x7f74300c3cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:58466/0 (socket says 172.21.15.77:58466) 2023-11-04T01:40:59.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.333+0000 7f7435600640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7430153850 0x7f743015a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:58372/0 (socket says 172.21.15.77:58372) 2023-11-04T01:40:59.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.333+0000 7f7434dff640 1 -- 172.21.15.77:0/3811635542 learned_addr learned my addr 172.21.15.77:0/3811635542 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:59.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.333+0000 7f7435e01640 1 --2- 172.21.15.77:0/3811635542 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74300cc9d0 0x7f7430070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.334+0000 7f7435600640 1 -- 172.21.15.77:0/3811635542 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74300cc9d0 msgr2=0x7f7430070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:59.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.334+0000 7f7435600640 1 --2- 172.21.15.77:0/3811635542 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74300cc9d0 0x7f7430070710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.334+0000 7f7435600640 1 -- 172.21.15.77:0/3811635542 >> v1:172.21.15.122:6789/0 conn(0x7f74300cc520 legacy=0x7f74300c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.334+0000 7f7435600640 1 -- 172.21.15.77:0/3811635542 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743015a700 con 0x7f7430153850 2023-11-04T01:40:59.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.335+0000 7f7435600640 1 --2- 172.21.15.77:0/3811635542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7430153850 0x7f743015a1c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f742c00ba40 tx=0x7f742c02e080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16e08d4f05389ef4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:59.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.335+0000 7f7427fff640 1 -- 172.21.15.77:0/3811635542 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c02ee30 con 0x7f7430153850 2023-11-04T01:40:59.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.335+0000 7f7427fff640 1 -- 172.21.15.77:0/3811635542 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742c036440 con 0x7f7430153850 2023-11-04T01:40:59.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.335+0000 7f7427fff640 1 -- 172.21.15.77:0/3811635542 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c0367d0 con 0x7f7430153850 2023-11-04T01:40:59.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.335+0000 7f7437864640 1 -- 172.21.15.77:0/3811635542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7430153850 msgr2=0x7f743015a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.335+0000 7f7437864640 1 --2- 172.21.15.77:0/3811635542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7430153850 0x7f743015a1c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f742c00ba40 tx=0x7f742c02e080 comp rx=0 tx=0).stop 2023-11-04T01:40:59.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.335+0000 7f7437864640 1 -- 172.21.15.77:0/3811635542 shutdown_connections 2023-11-04T01:40:59.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.335+0000 7f7437864640 1 --2- 172.21.15.77:0/3811635542 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74300cc9d0 0x7f7430070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.335+0000 7f7437864640 1 --2- 172.21.15.77:0/3811635542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7430153850 0x7f743015a1c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.335+0000 7f7437864640 1 -- 172.21.15.77:0/3811635542 >> 172.21.15.77:0/3811635542 conn(0x7f74300ce950 msgr2=0x7f74300ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:59.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.336+0000 7f7437864640 1 -- 172.21.15.77:0/3811635542 shutdown_connections 2023-11-04T01:40:59.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.336+0000 7f7437864640 1 -- 172.21.15.77:0/3811635542 wait complete. 2023-11-04T01:40:59.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.337+0000 7f7437864640 1 Processor -- start 2023-11-04T01:40:59.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.337+0000 7f7437864640 1 -- start start 2023-11-04T01:40:59.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.337+0000 7f7437864640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74300cc520 0x7f74300b1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.337+0000 7f7437864640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74300cc9d0 0x7f74301e3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.337+0000 7f7437864640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7430153850 0x7f74301e20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.337+0000 7f7437864640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74301e4bc0 con 0x7f74300cc520 2023-11-04T01:40:59.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.337+0000 7f7437864640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74300c71f0 con 0x7f7430153850 2023-11-04T01:40:59.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.337+0000 7f7437864640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74301e48e0 con 0x7f74300cc9d0 2023-11-04T01:40:59.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.338+0000 7f7435600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74300cc520 0x7f74300b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.338+0000 7f7435600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74300cc520 0x7f74300b1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54688/0 (socket says 172.21.15.77:54688) 2023-11-04T01:40:59.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.338+0000 7f7435600640 1 -- 172.21.15.77:0/3154374904 learned_addr learned my addr 172.21.15.77:0/3154374904 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:59.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.338+0000 7f7434dff640 1 --2- 172.21.15.77:0/3154374904 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74300cc9d0 0x7f74301e3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.338+0000 7f7435e01640 1 --2- 172.21.15.77:0/3154374904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7430153850 0x7f74301e20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.338+0000 7f7435600640 1 -- 172.21.15.77:0/3154374904 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74300cc9d0 msgr2=0x7f74301e3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.338+0000 7f7435600640 1 --2- 172.21.15.77:0/3154374904 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74300cc9d0 0x7f74301e3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.338+0000 7f7435600640 1 -- 172.21.15.77:0/3154374904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7430153850 msgr2=0x7f74301e20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.338+0000 7f7435600640 1 --2- 172.21.15.77:0/3154374904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7430153850 0x7f74301e20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.338+0000 7f7435600640 1 -- 172.21.15.77:0/3154374904 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f742c00b6a0 con 0x7f74300cc520 2023-11-04T01:40:59.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.338+0000 7f7435e01640 1 --2- 172.21.15.77:0/3154374904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7430153850 0x7f74301e20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:40:59.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.338+0000 7f7435600640 1 --2- 172.21.15.77:0/3154374904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74300cc520 0x7f74300b1530 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f742c02e690 tx=0x7f742c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:59.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.338+0000 7f7425ffb640 1 -- 172.21.15.77:0/3154374904 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c040820 con 0x7f74300cc520 2023-11-04T01:40:59.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.338+0000 7f7425ffb640 1 -- 172.21.15.77:0/3154374904 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742c040980 con 0x7f74300cc520 2023-11-04T01:40:59.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.338+0000 7f7425ffb640 1 -- 172.21.15.77:0/3154374904 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c040d30 con 0x7f74300cc520 2023-11-04T01:40:59.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.338+0000 7f7437864640 1 -- 172.21.15.77:0/3154374904 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74300c6ba0 con 0x7f74300cc520 2023-11-04T01:40:59.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.339+0000 7f7437864640 1 -- 172.21.15.77:0/3154374904 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74301e4460 con 0x7f74300cc520 2023-11-04T01:40:59.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.340+0000 7f7437864640 1 -- 172.21.15.77:0/3154374904 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7430074290 con 0x7f74300cc520 2023-11-04T01:40:59.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.340+0000 7f7425ffb640 1 -- 172.21.15.77:0/3154374904 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f742c03d050 con 0x7f74300cc520 2023-11-04T01:40:59.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.340+0000 7f7425ffb640 1 --2- 172.21.15.77:0/3154374904 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f741406ae70 0x7f741406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.340+0000 7f7425ffb640 1 -- 172.21.15.77:0/3154374904 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f742c0ae690 con 0x7f74300cc520 2023-11-04T01:40:59.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.341+0000 7f7434dff640 1 --2- 172.21.15.77:0/3154374904 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f741406ae70 0x7f741406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.341+0000 7f7434dff640 1 --2- 172.21.15.77:0/3154374904 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f741406ae70 0x7f741406d330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f74301e3d10 tx=0x7f7420009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:59.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.345+0000 7f7425ffb640 1 -- 172.21.15.77:0/3154374904 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f742c079410 con 0x7f74300cc520 2023-11-04T01:40:59.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.518+0000 7f7437864640 1 -- 172.21.15.77:0/3154374904 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f743015a3d0 con 0x7f74300cc520 2023-11-04T01:40:59.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.518+0000 7f7425ffb640 1 -- 172.21.15.77:0/3154374904 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f742c07ca30 con 0x7f74300cc520 2023-11-04T01:40:59.520 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:40:59.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.520+0000 7f7437864640 1 -- 172.21.15.77:0/3154374904 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f741406ae70 msgr2=0x7f741406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.520+0000 7f7437864640 1 --2- 172.21.15.77:0/3154374904 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f741406ae70 0x7f741406d330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f74301e3d10 tx=0x7f7420009040 comp rx=0 tx=0).stop 2023-11-04T01:40:59.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.520+0000 7f7437864640 1 -- 172.21.15.77:0/3154374904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74300cc520 msgr2=0x7f74300b1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.520+0000 7f7437864640 1 --2- 172.21.15.77:0/3154374904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74300cc520 0x7f74300b1530 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f742c02e690 tx=0x7f742c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.520+0000 7f7437864640 1 -- 172.21.15.77:0/3154374904 shutdown_connections 2023-11-04T01:40:59.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.520+0000 7f7437864640 1 --2- 172.21.15.77:0/3154374904 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f741406ae70 0x7f741406d330 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.520+0000 7f7437864640 1 --2- 172.21.15.77:0/3154374904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7430153850 0x7f74301e20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.520+0000 7f7437864640 1 --2- 172.21.15.77:0/3154374904 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74300cc9d0 0x7f74301e3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.520+0000 7f7437864640 1 --2- 172.21.15.77:0/3154374904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74300cc520 0x7f74300b1530 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.520+0000 7f7437864640 1 -- 172.21.15.77:0/3154374904 >> 172.21.15.77:0/3154374904 conn(0x7f74300ce950 msgr2=0x7f743006cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:59.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.520+0000 7f7437864640 1 -- 172.21.15.77:0/3154374904 shutdown_connections 2023-11-04T01:40:59.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.520+0000 7f7437864640 1 -- 172.21.15.77:0/3154374904 wait complete. 2023-11-04T01:40:59.533 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:40:59.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.638+0000 7f547dd9e640 1 Processor -- start 2023-11-04T01:40:59.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.638+0000 7f547dd9e640 1 -- start start 2023-11-04T01:40:59.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.639+0000 7f547dd9e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54780cb2e0 0x7f547806aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.639+0000 7f547dd9e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f547806b6b0 con 0x7f54780b2a00 2023-11-04T01:40:59.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.639+0000 7f547dd9e640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f547806b990 con 0x7f547815a990 2023-11-04T01:40:59.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.639+0000 7f547dd9e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f547806b4d0 con 0x7f54780cb2e0 2023-11-04T01:40:59.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.639+0000 7f547d59d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f54780b2a00 0x7f547806e140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52656/0 (socket says 172.21.15.77:52656) 2023-11-04T01:40:59.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.639+0000 7f547d59d640 1 -- 172.21.15.77:0/1790143089 learned_addr learned my addr 172.21.15.77:0/1790143089 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:40:59.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.639+0000 7f5477fff640 1 --2- 172.21.15.77:0/1790143089 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54780cb2e0 0x7f547806aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.639+0000 7f54777fe640 1 -- 172.21.15.77:0/1790143089 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1256643951 0 0) 0x7f547806b990 con 0x7f547815a990 2023-11-04T01:40:59.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.639+0000 7f54777fe640 1 -- 172.21.15.77:0/1790143089 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5468003520 con 0x7f547815a990 2023-11-04T01:40:59.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.639+0000 7f5477fff640 1 -- 172.21.15.77:0/1790143089 >> v1:172.21.15.122:6789/0 conn(0x7f547815a990 legacy=0x7f547815dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.639+0000 7f5477fff640 1 -- 172.21.15.77:0/1790143089 >> v1:172.21.15.77:6789/0 conn(0x7f54780b2a00 legacy=0x7f547806e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.639+0000 7f5477fff640 1 -- 172.21.15.77:0/1790143089 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f547806a1c0 con 0x7f54780cb2e0 2023-11-04T01:40:59.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.641+0000 7f5477fff640 1 --2- 172.21.15.77:0/1790143089 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54780cb2e0 0x7f547806aca0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f54640097d0 tx=0x7f546402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d89524d6ed024e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:59.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.641+0000 7f54777fe640 1 -- 172.21.15.77:0/1790143089 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5464031890 con 0x7f54780cb2e0 2023-11-04T01:40:59.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.641+0000 7f54777fe640 1 -- 172.21.15.77:0/1790143089 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54640319f0 con 0x7f54780cb2e0 2023-11-04T01:40:59.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.641+0000 7f54777fe640 1 -- 172.21.15.77:0/1790143089 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5464031d80 con 0x7f54780cb2e0 2023-11-04T01:40:59.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.641+0000 7f547dd9e640 1 -- 172.21.15.77:0/1790143089 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54780cb2e0 msgr2=0x7f547806aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.641+0000 7f547dd9e640 1 --2- 172.21.15.77:0/1790143089 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54780cb2e0 0x7f547806aca0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f54640097d0 tx=0x7f546402b930 comp rx=0 tx=0).stop 2023-11-04T01:40:59.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.641+0000 7f547dd9e640 1 -- 172.21.15.77:0/1790143089 shutdown_connections 2023-11-04T01:40:59.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.641+0000 7f547dd9e640 1 --2- 172.21.15.77:0/1790143089 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54780cb2e0 0x7f547806aca0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.641+0000 7f547dd9e640 1 -- 172.21.15.77:0/1790143089 >> 172.21.15.77:0/1790143089 conn(0x7f54780cf050 msgr2=0x7f54780cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:59.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.641+0000 7f547dd9e640 1 -- 172.21.15.77:0/1790143089 shutdown_connections 2023-11-04T01:40:59.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.641+0000 7f547dd9e640 1 -- 172.21.15.77:0/1790143089 wait complete. 2023-11-04T01:40:59.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.643+0000 7f547dd9e640 1 Processor -- start 2023-11-04T01:40:59.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.643+0000 7f547dd9e640 1 -- start start 2023-11-04T01:40:59.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.644+0000 7f547dd9e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54780b2a00 0x7f5478146f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.644+0000 7f547dd9e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54780cb2e0 0x7f54781f67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.644+0000 7f547dd9e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f547815a990 0x7f54780cde60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.644+0000 7f547dd9e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54781f6d20 con 0x7f54780b2a00 2023-11-04T01:40:59.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.644+0000 7f547dd9e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54780ccdc0 con 0x7f54780cb2e0 2023-11-04T01:40:59.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.644+0000 7f547dd9e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54780cd0a0 con 0x7f547815a990 2023-11-04T01:40:59.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.644+0000 7f547cd9c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54780b2a00 0x7f5478146f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.644+0000 7f547cd9c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54780b2a00 0x7f5478146f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54692/0 (socket says 172.21.15.77:54692) 2023-11-04T01:40:59.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.644+0000 7f547cd9c640 1 -- 172.21.15.77:0/1075277853 learned_addr learned my addr 172.21.15.77:0/1075277853 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:59.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.644+0000 7f5477fff640 1 --2- 172.21.15.77:0/1075277853 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54780cb2e0 0x7f54781f67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.644+0000 7f547d59d640 1 --2- 172.21.15.77:0/1075277853 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f547815a990 0x7f54780cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.644+0000 7f547cd9c640 1 -- 172.21.15.77:0/1075277853 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f547815a990 msgr2=0x7f54780cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.644+0000 7f547cd9c640 1 --2- 172.21.15.77:0/1075277853 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f547815a990 0x7f54780cde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.644+0000 7f547cd9c640 1 -- 172.21.15.77:0/1075277853 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54780cb2e0 msgr2=0x7f54781f67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.644+0000 7f547cd9c640 1 --2- 172.21.15.77:0/1075277853 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54780cb2e0 0x7f54781f67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.644+0000 7f547cd9c640 1 -- 172.21.15.77:0/1075277853 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5464009400 con 0x7f54780b2a00 2023-11-04T01:40:59.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.644+0000 7f5477fff640 1 --2- 172.21.15.77:0/1075277853 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54780cb2e0 0x7f54781f67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:59.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.644+0000 7f547cd9c640 1 --2- 172.21.15.77:0/1075277853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54780b2a00 0x7f5478146f10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f546c00c430 tx=0x7f546c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:59.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.644+0000 7f54757fa640 1 -- 172.21.15.77:0/1075277853 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c0052d0 con 0x7f54780b2a00 2023-11-04T01:40:59.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.644+0000 7f54757fa640 1 -- 172.21.15.77:0/1075277853 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546c005450 con 0x7f54780b2a00 2023-11-04T01:40:59.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.644+0000 7f547dd9e640 1 -- 172.21.15.77:0/1075277853 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54780cd380 con 0x7f54780b2a00 2023-11-04T01:40:59.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.644+0000 7f54757fa640 1 -- 172.21.15.77:0/1075277853 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c003830 con 0x7f54780b2a00 2023-11-04T01:40:59.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.644+0000 7f547dd9e640 1 -- 172.21.15.77:0/1075277853 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54780cd940 con 0x7f54780b2a00 2023-11-04T01:40:59.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.645+0000 7f547dd9e640 1 -- 172.21.15.77:0/1075277853 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f547804ece0 con 0x7f54780b2a00 2023-11-04T01:40:59.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.646+0000 7f54757fa640 1 -- 172.21.15.77:0/1075277853 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f546c003990 con 0x7f54780b2a00 2023-11-04T01:40:59.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.646+0000 7f54757fa640 1 --2- 172.21.15.77:0/1075277853 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f545c06ae70 0x7f545c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.646+0000 7f54757fa640 1 -- 172.21.15.77:0/1075277853 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f546c089050 con 0x7f54780b2a00 2023-11-04T01:40:59.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.647+0000 7f5477fff640 1 --2- 172.21.15.77:0/1075277853 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f545c06ae70 0x7f545c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.647+0000 7f5477fff640 1 --2- 172.21.15.77:0/1075277853 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f545c06ae70 0x7f545c06d330 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5464036000 tx=0x7f546403c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:59.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.650+0000 7f54757fa640 1 -- 172.21.15.77:0/1075277853 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f546c053d40 con 0x7f54780b2a00 2023-11-04T01:40:59.678 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:40:59.681 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:40:59.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.825+0000 7f547dd9e640 1 -- 172.21.15.77:0/1075277853 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5478066220 con 0x7f54780b2a00 2023-11-04T01:40:59.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.825+0000 7f54757fa640 1 -- 172.21.15.77:0/1075277853 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f546c057360 con 0x7f54780b2a00 2023-11-04T01:40:59.828 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:40:59.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.827+0000 7f547dd9e640 1 -- 172.21.15.77:0/1075277853 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f545c06ae70 msgr2=0x7f545c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.827+0000 7f547dd9e640 1 --2- 172.21.15.77:0/1075277853 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f545c06ae70 0x7f545c06d330 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5464036000 tx=0x7f546403c040 comp rx=0 tx=0).stop 2023-11-04T01:40:59.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.827+0000 7f547dd9e640 1 -- 172.21.15.77:0/1075277853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54780b2a00 msgr2=0x7f5478146f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.827+0000 7f547dd9e640 1 --2- 172.21.15.77:0/1075277853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54780b2a00 0x7f5478146f10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f546c00c430 tx=0x7f546c00c8f0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.827+0000 7f547dd9e640 1 -- 172.21.15.77:0/1075277853 shutdown_connections 2023-11-04T01:40:59.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.827+0000 7f547dd9e640 1 --2- 172.21.15.77:0/1075277853 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f545c06ae70 0x7f545c06d330 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.827+0000 7f547dd9e640 1 --2- 172.21.15.77:0/1075277853 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f547815a990 0x7f54780cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.827+0000 7f547dd9e640 1 --2- 172.21.15.77:0/1075277853 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54780cb2e0 0x7f54781f67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.827+0000 7f547dd9e640 1 --2- 172.21.15.77:0/1075277853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54780b2a00 0x7f5478146f10 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.827+0000 7f547dd9e640 1 -- 172.21.15.77:0/1075277853 >> 172.21.15.77:0/1075277853 conn(0x7f54780cf050 msgr2=0x7f54780ad770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:59.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.828+0000 7f547dd9e640 1 -- 172.21.15.77:0/1075277853 shutdown_connections 2023-11-04T01:40:59.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.828+0000 7f547dd9e640 1 -- 172.21.15.77:0/1075277853 wait complete. 2023-11-04T01:40:59.840 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:40:59.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.942+0000 7fab85894640 1 Processor -- start 2023-11-04T01:40:59.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.942+0000 7fab85894640 1 -- start start 2023-11-04T01:40:59.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.943+0000 7fab85894640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fab8015af20 0x7fab800b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.943+0000 7fab85894640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fab800b64c0 0x7fab800cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.943+0000 7fab85894640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab800d01f0 con 0x7fab800cd3b0 2023-11-04T01:40:59.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.943+0000 7fab85894640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab800b6a40 con 0x7fab800b64c0 2023-11-04T01:40:59.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.943+0000 7fab85894640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab800d04b0 con 0x7fab8015af20 2023-11-04T01:40:59.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.943+0000 7fab7e7fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fab800b64c0 0x7fab800cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.943+0000 7fab7e7fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fab800b64c0 0x7fab800cbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54702/0 (socket says 172.21.15.77:54702) 2023-11-04T01:40:59.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.943+0000 7fab7e7fc640 1 -- 172.21.15.77:0/2977059001 learned_addr learned my addr 172.21.15.77:0/2977059001 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:59.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.943+0000 7fab7effd640 1 --2- 172.21.15.77:0/2977059001 >> v2:172.21.15.122:3300/0 conn(0x7fab8015af20 0x7fab800b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.944+0000 7fab7e7fc640 1 -- 172.21.15.77:0/2977059001 >> v2:172.21.15.122:3300/0 conn(0x7fab8015af20 msgr2=0x7fab800b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:40:59.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.944+0000 7fab7e7fc640 1 --2- 172.21.15.77:0/2977059001 >> v2:172.21.15.122:3300/0 conn(0x7fab8015af20 0x7fab800b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.944+0000 7fab7e7fc640 1 -- 172.21.15.77:0/2977059001 >> v1:172.21.15.122:6789/0 conn(0x7fab800cd3b0 legacy=0x7fab800b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.944+0000 7fab7e7fc640 1 -- 172.21.15.77:0/2977059001 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab800d0790 con 0x7fab800b64c0 2023-11-04T01:40:59.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.944+0000 7fab7effd640 1 --2- 172.21.15.77:0/2977059001 >> v2:172.21.15.122:3300/0 conn(0x7fab8015af20 0x7fab800b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:40:59.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.944+0000 7fab7e7fc640 1 --2- 172.21.15.77:0/2977059001 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab800b64c0 0x7fab800cbc70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fab800b3760 tx=0x7fab7002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c145e18aa0a6d18 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:59.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.945+0000 7fab7dffb640 1 -- 172.21.15.77:0/2977059001 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab70030860 con 0x7fab800b64c0 2023-11-04T01:40:59.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.945+0000 7fab7dffb640 1 -- 172.21.15.77:0/2977059001 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab700309c0 con 0x7fab800b64c0 2023-11-04T01:40:59.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.945+0000 7fab7dffb640 1 -- 172.21.15.77:0/2977059001 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab70030d50 con 0x7fab800b64c0 2023-11-04T01:40:59.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.945+0000 7fab85894640 1 -- 172.21.15.77:0/2977059001 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab800b64c0 msgr2=0x7fab800cbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.945+0000 7fab85894640 1 --2- 172.21.15.77:0/2977059001 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab800b64c0 0x7fab800cbc70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fab800b3760 tx=0x7fab7002b9a0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.945+0000 7fab85894640 1 -- 172.21.15.77:0/2977059001 shutdown_connections 2023-11-04T01:40:59.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.945+0000 7fab85894640 1 --2- 172.21.15.77:0/2977059001 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab800b64c0 0x7fab800cbc70 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.945+0000 7fab85894640 1 --2- 172.21.15.77:0/2977059001 >> v2:172.21.15.122:3300/0 conn(0x7fab8015af20 0x7fab800b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.945+0000 7fab85894640 1 -- 172.21.15.77:0/2977059001 >> 172.21.15.77:0/2977059001 conn(0x7fab8006ea20 msgr2=0x7fab8006ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:40:59.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.945+0000 7fab85894640 1 -- 172.21.15.77:0/2977059001 shutdown_connections 2023-11-04T01:40:59.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.945+0000 7fab85894640 1 -- 172.21.15.77:0/2977059001 wait complete. 2023-11-04T01:40:59.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.946+0000 7fab85894640 1 Processor -- start 2023-11-04T01:40:59.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.947+0000 7fab85894640 1 -- start start 2023-11-04T01:40:59.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.947+0000 7fab85894640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fab800b64c0 0x7fab800ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.947+0000 7fab85894640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab800cd3b0 0x7fab801542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.947+0000 7fab85894640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab8015af20 0x7fab80154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.947+0000 7fab85894640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab80152a20 con 0x7fab800cd3b0 2023-11-04T01:40:59.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.947+0000 7fab85894640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab80153d10 con 0x7fab8015af20 2023-11-04T01:40:59.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.947+0000 7fab85894640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab80152c70 con 0x7fab800b64c0 2023-11-04T01:40:59.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.947+0000 7fab7e7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab800cd3b0 0x7fab801542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.947+0000 7fab7e7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab800cd3b0 0x7fab801542c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54710/0 (socket says 172.21.15.77:54710) 2023-11-04T01:40:59.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.947+0000 7fab7e7fc640 1 -- 172.21.15.77:0/1190873295 learned_addr learned my addr 172.21.15.77:0/1190873295 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:40:59.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.948+0000 7fab7effd640 1 --2- 172.21.15.77:0/1190873295 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fab800b64c0 0x7fab800ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.948+0000 7fab7f7fe640 1 --2- 172.21.15.77:0/1190873295 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab8015af20 0x7fab80154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.948+0000 7fab7e7fc640 1 -- 172.21.15.77:0/1190873295 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fab800b64c0 msgr2=0x7fab800ca0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.948+0000 7fab7e7fc640 1 --2- 172.21.15.77:0/1190873295 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fab800b64c0 0x7fab800ca0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.948+0000 7fab7e7fc640 1 -- 172.21.15.77:0/1190873295 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab8015af20 msgr2=0x7fab80154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:40:59.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.948+0000 7fab7e7fc640 1 --2- 172.21.15.77:0/1190873295 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab8015af20 0x7fab80154800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:40:59.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.948+0000 7fab7e7fc640 1 -- 172.21.15.77:0/1190873295 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab700094d0 con 0x7fab800cd3b0 2023-11-04T01:40:59.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.948+0000 7fab7e7fc640 1 --2- 172.21.15.77:0/1190873295 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab800cd3b0 0x7fab801542c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fab7002b9e0 tx=0x7fab70004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:59.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.948+0000 7fab67fff640 1 -- 172.21.15.77:0/1190873295 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab70039d60 con 0x7fab800cd3b0 2023-11-04T01:40:59.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.948+0000 7fab67fff640 1 -- 172.21.15.77:0/1190873295 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab70043400 con 0x7fab800cd3b0 2023-11-04T01:40:59.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.948+0000 7fab85894640 1 -- 172.21.15.77:0/1190873295 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab80152f50 con 0x7fab800cd3b0 2023-11-04T01:40:59.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.948+0000 7fab67fff640 1 -- 172.21.15.77:0/1190873295 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab700437b0 con 0x7fab800cd3b0 2023-11-04T01:40:59.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.948+0000 7fab85894640 1 -- 172.21.15.77:0/1190873295 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab80153510 con 0x7fab800cd3b0 2023-11-04T01:40:59.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.949+0000 7fab85894640 1 -- 172.21.15.77:0/1190873295 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab800b3910 con 0x7fab800cd3b0 2023-11-04T01:40:59.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.950+0000 7fab67fff640 1 -- 172.21.15.77:0/1190873295 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fab70043910 con 0x7fab800cd3b0 2023-11-04T01:40:59.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.950+0000 7fab67fff640 1 --2- 172.21.15.77:0/1190873295 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fab6c06ae70 0x7fab6c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:40:59.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.951+0000 7fab67fff640 1 -- 172.21.15.77:0/1190873295 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fab7003e070 con 0x7fab800cd3b0 2023-11-04T01:40:59.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.951+0000 7fab7effd640 1 --2- 172.21.15.77:0/1190873295 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fab6c06ae70 0x7fab6c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:40:59.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.951+0000 7fab7effd640 1 --2- 172.21.15.77:0/1190873295 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fab6c06ae70 0x7fab6c06d330 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fab74006fd0 tx=0x7fab74008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:40:59.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:40:59.955+0000 7fab67fff640 1 -- 172.21.15.77:0/1190873295 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fab70077a00 con 0x7fab800cd3b0 2023-11-04T01:41:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.129+0000 7fab85894640 1 -- 172.21.15.77:0/1190873295 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fab800674e0 con 0x7fab800cd3b0 2023-11-04T01:41:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.129+0000 7fab67fff640 1 -- 172.21.15.77:0/1190873295 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fab7007b020 con 0x7fab800cd3b0 2023-11-04T01:41:00.131 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-04T01:41:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.131+0000 7fab85894640 1 -- 172.21.15.77:0/1190873295 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fab6c06ae70 msgr2=0x7fab6c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.131+0000 7fab85894640 1 --2- 172.21.15.77:0/1190873295 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fab6c06ae70 0x7fab6c06d330 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fab74006fd0 tx=0x7fab74008040 comp rx=0 tx=0).stop 2023-11-04T01:41:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.131+0000 7fab85894640 1 -- 172.21.15.77:0/1190873295 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab800cd3b0 msgr2=0x7fab801542c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:00.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.131+0000 7fab85894640 1 --2- 172.21.15.77:0/1190873295 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab800cd3b0 0x7fab801542c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fab7002b9e0 tx=0x7fab70004730 comp rx=0 tx=0).stop 2023-11-04T01:41:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.131+0000 7fab85894640 1 -- 172.21.15.77:0/1190873295 shutdown_connections 2023-11-04T01:41:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.131+0000 7fab85894640 1 --2- 172.21.15.77:0/1190873295 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fab6c06ae70 0x7fab6c06d330 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.131+0000 7fab85894640 1 --2- 172.21.15.77:0/1190873295 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab8015af20 0x7fab80154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.131+0000 7fab85894640 1 --2- 172.21.15.77:0/1190873295 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab800cd3b0 0x7fab801542c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.131+0000 7fab85894640 1 --2- 172.21.15.77:0/1190873295 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fab800b64c0 0x7fab800ca0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.131+0000 7fab85894640 1 -- 172.21.15.77:0/1190873295 >> 172.21.15.77:0/1190873295 conn(0x7fab8006ea20 msgr2=0x7fab800b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.131+0000 7fab85894640 1 -- 172.21.15.77:0/1190873295 shutdown_connections 2023-11-04T01:41:00.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.131+0000 7fab85894640 1 -- 172.21.15.77:0/1190873295 wait complete. 2023-11-04T01:41:00.143 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:41:00.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.245+0000 7f907b718640 1 Processor -- start 2023-11-04T01:41:00.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.245+0000 7f907b718640 1 -- start start 2023-11-04T01:41:00.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.246+0000 7f907b718640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9074159c00 0x7f90740cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:00.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.246+0000 7f907b718640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f90740c48e0 0x7f90740c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:00.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.246+0000 7f907b718640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f90740adac0 0x7f90740adea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:00.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.246+0000 7f907b718640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90740c52d0 con 0x7f90740c48e0 2023-11-04T01:41:00.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.246+0000 7f907b718640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f907415aff0 con 0x7f9074159c00 2023-11-04T01:41:00.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.246+0000 7f907b718640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f907415a3e0 con 0x7f90740adac0 2023-11-04T01:41:00.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.246+0000 7f9078cb3640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f90740c48e0 0x7f90740c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:00.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.246+0000 7f9078cb3640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f90740c48e0 0x7f90740c4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54718/0 (socket says 172.21.15.77:54718) 2023-11-04T01:41:00.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.246+0000 7f9078cb3640 1 -- 172.21.15.77:0/2504762282 learned_addr learned my addr 172.21.15.77:0/2504762282 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:00.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.247+0000 7f9078cb3640 1 -- 172.21.15.77:0/2504762282 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f90740adac0 msgr2=0x7f90740adea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:00.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.247+0000 7f9078cb3640 1 --2- 172.21.15.77:0/2504762282 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f90740adac0 0x7f90740adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.247+0000 7f9078cb3640 1 -- 172.21.15.77:0/2504762282 >> v2:172.21.15.122:3300/0 conn(0x7f9074159c00 msgr2=0x7f90740cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:00.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.247+0000 7f9078cb3640 1 --2- 172.21.15.77:0/2504762282 >> v2:172.21.15.122:3300/0 conn(0x7f9074159c00 0x7f90740cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.247+0000 7f9078cb3640 1 -- 172.21.15.77:0/2504762282 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f907415a6c0 con 0x7f90740c48e0 2023-11-04T01:41:00.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.247+0000 7f9078cb3640 1 --2- 172.21.15.77:0/2504762282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90740c48e0 0x7f90740c4d90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f90740cc4d0 tx=0x7f907002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d70d7c1e106ca7c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:00.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.248+0000 7f906bfff640 1 -- 172.21.15.77:0/2504762282 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9070031870 con 0x7f90740c48e0 2023-11-04T01:41:00.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.248+0000 7f906bfff640 1 -- 172.21.15.77:0/2504762282 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90700319d0 con 0x7f90740c48e0 2023-11-04T01:41:00.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.248+0000 7f906bfff640 1 -- 172.21.15.77:0/2504762282 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9070031d60 con 0x7f90740c48e0 2023-11-04T01:41:00.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.248+0000 7f907b718640 1 -- 172.21.15.77:0/2504762282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90740c48e0 msgr2=0x7f90740c4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:00.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.248+0000 7f907b718640 1 --2- 172.21.15.77:0/2504762282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90740c48e0 0x7f90740c4d90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f90740cc4d0 tx=0x7f907002b910 comp rx=0 tx=0).stop 2023-11-04T01:41:00.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.248+0000 7f907b718640 1 -- 172.21.15.77:0/2504762282 shutdown_connections 2023-11-04T01:41:00.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.248+0000 7f907b718640 1 --2- 172.21.15.77:0/2504762282 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f90740adac0 0x7f90740adea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.248+0000 7f907b718640 1 --2- 172.21.15.77:0/2504762282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90740c48e0 0x7f90740c4d90 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.248+0000 7f907b718640 1 --2- 172.21.15.77:0/2504762282 >> v2:172.21.15.122:3300/0 conn(0x7f9074159c00 0x7f90740cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.248+0000 7f907b718640 1 -- 172.21.15.77:0/2504762282 >> 172.21.15.77:0/2504762282 conn(0x7f90740ce950 msgr2=0x7f90740ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:00.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.248+0000 7f907b718640 1 -- 172.21.15.77:0/2504762282 shutdown_connections 2023-11-04T01:41:00.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.248+0000 7f907b718640 1 -- 172.21.15.77:0/2504762282 wait complete. 2023-11-04T01:41:00.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.249+0000 7f907b718640 1 Processor -- start 2023-11-04T01:41:00.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.249+0000 7f907b718640 1 -- start start 2023-11-04T01:41:00.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.250+0000 7f907b718640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f90740adac0 0x7f9074152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:00.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.250+0000 7f907b718640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90740c48e0 0x7f90740ac270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:00.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.250+0000 7f907b718640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9074159c00 0x7f90741f27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:00.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.250+0000 7f907b718640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90741f3800 con 0x7f90740c48e0 2023-11-04T01:41:00.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.250+0000 7f907b718640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90740abde0 con 0x7f9074159c00 2023-11-04T01:41:00.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.250+0000 7f907b718640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9074152750 con 0x7f90740adac0 2023-11-04T01:41:00.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.250+0000 7f9078cb3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90740c48e0 0x7f90740ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:00.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.250+0000 7f9078cb3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90740c48e0 0x7f90740ac270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54726/0 (socket says 172.21.15.77:54726) 2023-11-04T01:41:00.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.250+0000 7f9078cb3640 1 -- 172.21.15.77:0/1243274369 learned_addr learned my addr 172.21.15.77:0/1243274369 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:00.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.250+0000 7f9079cb5640 1 --2- 172.21.15.77:0/1243274369 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9074159c00 0x7f90741f27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:00.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.250+0000 7f90794b4640 1 --2- 172.21.15.77:0/1243274369 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f90740adac0 0x7f9074152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:00.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.250+0000 7f9078cb3640 1 -- 172.21.15.77:0/1243274369 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f90740adac0 msgr2=0x7f9074152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:00.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.250+0000 7f9078cb3640 1 --2- 172.21.15.77:0/1243274369 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f90740adac0 0x7f9074152210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.250+0000 7f9078cb3640 1 -- 172.21.15.77:0/1243274369 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9074159c00 msgr2=0x7f90741f27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:00.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.250+0000 7f9078cb3640 1 --2- 172.21.15.77:0/1243274369 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9074159c00 0x7f90741f27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.250+0000 7f9078cb3640 1 -- 172.21.15.77:0/1243274369 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90700094d0 con 0x7f90740c48e0 2023-11-04T01:41:00.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.251+0000 7f9078cb3640 1 --2- 172.21.15.77:0/1243274369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90740c48e0 0x7f90740ac270 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f907002b950 tx=0x7f90700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:00.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.251+0000 7f9069ffb640 1 -- 172.21.15.77:0/1243274369 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907003ad10 con 0x7f90740c48e0 2023-11-04T01:41:00.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.251+0000 7f9069ffb640 1 -- 172.21.15.77:0/1243274369 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907003ae70 con 0x7f90740c48e0 2023-11-04T01:41:00.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.251+0000 7f907b718640 1 -- 172.21.15.77:0/1243274369 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90741f3240 con 0x7f90740c48e0 2023-11-04T01:41:00.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.251+0000 7f9069ffb640 1 -- 172.21.15.77:0/1243274369 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9070044610 con 0x7f90740c48e0 2023-11-04T01:41:00.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.251+0000 7f907b718640 1 -- 172.21.15.77:0/1243274369 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90740aba70 con 0x7f90740c48e0 2023-11-04T01:41:00.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.252+0000 7f907b718640 1 -- 172.21.15.77:0/1243274369 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90740ab8d0 con 0x7f90740c48e0 2023-11-04T01:41:00.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.252+0000 7f9069ffb640 1 -- 172.21.15.77:0/1243274369 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9070044770 con 0x7f90740c48e0 2023-11-04T01:41:00.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.253+0000 7f9069ffb640 1 --2- 172.21.15.77:0/1243274369 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f905806ae70 0x7f905806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:00.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.253+0000 7f9069ffb640 1 -- 172.21.15.77:0/1243274369 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f907002d040 con 0x7f90740c48e0 2023-11-04T01:41:00.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.253+0000 7f90794b4640 1 --2- 172.21.15.77:0/1243274369 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f905806ae70 0x7f905806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:00.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.254+0000 7f90794b4640 1 --2- 172.21.15.77:0/1243274369 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f905806ae70 0x7f905806d330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f90740b3be0 tx=0x7f9064008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:00.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.257+0000 7f9069ffb640 1 -- 172.21.15.77:0/1243274369 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f90740ab8d0 con 0x7f90740c48e0 2023-11-04T01:41:00.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.421+0000 7f907b718640 1 -- 172.21.15.77:0/1243274369 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f90740ab8d0 con 0x7f90740c48e0 2023-11-04T01:41:00.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.421+0000 7f9069ffb640 1 -- 172.21.15.77:0/1243274369 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f90740ab8d0 con 0x7f90740c48e0 2023-11-04T01:41:00.424 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:41:00.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.423+0000 7f907b718640 1 -- 172.21.15.77:0/1243274369 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f905806ae70 msgr2=0x7f905806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:00.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.423+0000 7f907b718640 1 --2- 172.21.15.77:0/1243274369 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f905806ae70 0x7f905806d330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f90740b3be0 tx=0x7f9064008040 comp rx=0 tx=0).stop 2023-11-04T01:41:00.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.423+0000 7f907b718640 1 -- 172.21.15.77:0/1243274369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90740c48e0 msgr2=0x7f90740ac270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:00.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.423+0000 7f907b718640 1 --2- 172.21.15.77:0/1243274369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90740c48e0 0x7f90740ac270 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f907002b950 tx=0x7f90700046c0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.423+0000 7f907b718640 1 -- 172.21.15.77:0/1243274369 shutdown_connections 2023-11-04T01:41:00.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.423+0000 7f907b718640 1 --2- 172.21.15.77:0/1243274369 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f905806ae70 0x7f905806d330 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.423+0000 7f907b718640 1 --2- 172.21.15.77:0/1243274369 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9074159c00 0x7f90741f27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.423+0000 7f907b718640 1 --2- 172.21.15.77:0/1243274369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90740c48e0 0x7f90740ac270 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.423+0000 7f907b718640 1 --2- 172.21.15.77:0/1243274369 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f90740adac0 0x7f9074152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.423+0000 7f907b718640 1 -- 172.21.15.77:0/1243274369 >> 172.21.15.77:0/1243274369 conn(0x7f90740ce950 msgr2=0x7f90740709f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:00.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.423+0000 7f907b718640 1 -- 172.21.15.77:0/1243274369 shutdown_connections 2023-11-04T01:41:00.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.423+0000 7f907b718640 1 -- 172.21.15.77:0/1243274369 wait complete. 2023-11-04T01:41:00.436 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:41:00.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.534+0000 7fc117500640 1 Processor -- start 2023-11-04T01:41:00.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.534+0000 7fc117500640 1 -- start start 2023-11-04T01:41:00.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.535+0000 7fc117500640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc110070e20 0x7fc1100adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:00.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.535+0000 7fc117500640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc1100ad730 0x7fc11015e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:00.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.535+0000 7fc117500640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1100c3900 con 0x7fc11015ad30 2023-11-04T01:41:00.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.535+0000 7fc117500640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1100ae260 con 0x7fc110070e20 2023-11-04T01:41:00.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.535+0000 7fc117500640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1100c3be0 con 0x7fc1100ad730 2023-11-04T01:41:00.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.535+0000 7fc114a9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc110070e20 0x7fc1100adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:00.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.535+0000 7fc11529c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc11015ad30 0x7fc110070710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52668/0 (socket says 172.21.15.77:52668) 2023-11-04T01:41:00.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.535+0000 7fc11529c640 1 -- 172.21.15.77:0/608145967 learned_addr learned my addr 172.21.15.77:0/608145967 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:00.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.535+0000 7fc115a9d640 1 --2- 172.21.15.77:0/608145967 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc1100ad730 0x7fc11015e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:00.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.535+0000 7fc114a9b640 1 -- 172.21.15.77:0/608145967 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc1100ad730 msgr2=0x7fc11015e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:00.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.535+0000 7fc114a9b640 1 --2- 172.21.15.77:0/608145967 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc1100ad730 0x7fc11015e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.535+0000 7fc114a9b640 1 -- 172.21.15.77:0/608145967 >> v1:172.21.15.77:6789/0 conn(0x7fc11015ad30 legacy=0x7fc110070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:00.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.535+0000 7fc114a9b640 1 -- 172.21.15.77:0/608145967 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1100c3ec0 con 0x7fc110070e20 2023-11-04T01:41:00.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.535+0000 7fc115a9d640 1 --2- 172.21.15.77:0/608145967 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc1100ad730 0x7fc11015e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:00.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.536+0000 7fc114a9b640 1 --2- 172.21.15.77:0/608145967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc110070e20 0x7fc1100adc80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc1000097a0 tx=0x7fc10002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef3b17906449627 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:00.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.536+0000 7fc107fff640 1 -- 172.21.15.77:0/608145967 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10002e070 con 0x7fc110070e20 2023-11-04T01:41:00.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.536+0000 7fc107fff640 1 -- 172.21.15.77:0/608145967 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1000315a0 con 0x7fc110070e20 2023-11-04T01:41:00.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.536+0000 7fc107fff640 1 -- 172.21.15.77:0/608145967 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc100031930 con 0x7fc110070e20 2023-11-04T01:41:00.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.537+0000 7fc117500640 1 -- 172.21.15.77:0/608145967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc110070e20 msgr2=0x7fc1100adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:00.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.537+0000 7fc117500640 1 --2- 172.21.15.77:0/608145967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc110070e20 0x7fc1100adc80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc1000097a0 tx=0x7fc10002b840 comp rx=0 tx=0).stop 2023-11-04T01:41:00.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.537+0000 7fc117500640 1 -- 172.21.15.77:0/608145967 shutdown_connections 2023-11-04T01:41:00.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.537+0000 7fc117500640 1 --2- 172.21.15.77:0/608145967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc110070e20 0x7fc1100adc80 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.537+0000 7fc117500640 1 --2- 172.21.15.77:0/608145967 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc1100ad730 0x7fc11015e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.537+0000 7fc117500640 1 -- 172.21.15.77:0/608145967 >> 172.21.15.77:0/608145967 conn(0x7fc1100ce950 msgr2=0x7fc1100ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:00.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.537+0000 7fc117500640 1 -- 172.21.15.77:0/608145967 shutdown_connections 2023-11-04T01:41:00.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.537+0000 7fc117500640 1 -- 172.21.15.77:0/608145967 wait complete. 2023-11-04T01:41:00.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.538+0000 7fc117500640 1 Processor -- start 2023-11-04T01:41:00.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.538+0000 7fc117500640 1 -- start start 2023-11-04T01:41:00.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.539+0000 7fc117500640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc110070e20 0x7fc1101488f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:00.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.539+0000 7fc117500640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1100ad730 0x7fc1100c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:00.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.539+0000 7fc117500640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc11015ad30 0x7fc1100c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:00.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.539+0000 7fc117500640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11015b4f0 con 0x7fc1100ad730 2023-11-04T01:41:00.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.539+0000 7fc117500640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1100b2950 con 0x7fc110070e20 2023-11-04T01:41:00.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.539+0000 7fc117500640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11015bce0 con 0x7fc11015ad30 2023-11-04T01:41:00.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.539+0000 7fc114a9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1100ad730 0x7fc1100c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:00.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.539+0000 7fc114a9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1100ad730 0x7fc1100c7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54750/0 (socket says 172.21.15.77:54750) 2023-11-04T01:41:00.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.539+0000 7fc114a9b640 1 -- 172.21.15.77:0/3920090538 learned_addr learned my addr 172.21.15.77:0/3920090538 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:00.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.539+0000 7fc115a9d640 1 --2- 172.21.15.77:0/3920090538 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc11015ad30 0x7fc1100c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:00.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.539+0000 7fc11529c640 1 --2- 172.21.15.77:0/3920090538 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc110070e20 0x7fc1101488f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:00.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.539+0000 7fc114a9b640 1 -- 172.21.15.77:0/3920090538 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc11015ad30 msgr2=0x7fc1100c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:00.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.539+0000 7fc114a9b640 1 --2- 172.21.15.77:0/3920090538 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc11015ad30 0x7fc1100c8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.539+0000 7fc114a9b640 1 -- 172.21.15.77:0/3920090538 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc110070e20 msgr2=0x7fc1101488f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:00.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.539+0000 7fc114a9b640 1 --2- 172.21.15.77:0/3920090538 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc110070e20 0x7fc1101488f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.539+0000 7fc114a9b640 1 -- 172.21.15.77:0/3920090538 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc100009400 con 0x7fc1100ad730 2023-11-04T01:41:00.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.539+0000 7fc114a9b640 1 --2- 172.21.15.77:0/3920090538 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1100ad730 0x7fc1100c7ed0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc1000098c0 tx=0x7fc1000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:00.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.540+0000 7fc105ffb640 1 -- 172.21.15.77:0/3920090538 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc100032900 con 0x7fc1100ad730 2023-11-04T01:41:00.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.540+0000 7fc105ffb640 1 -- 172.21.15.77:0/3920090538 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc100032a60 con 0x7fc1100ad730 2023-11-04T01:41:00.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.540+0000 7fc105ffb640 1 -- 172.21.15.77:0/3920090538 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc100032e10 con 0x7fc1100ad730 2023-11-04T01:41:00.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.540+0000 7fc117500640 1 -- 172.21.15.77:0/3920090538 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc11015bfc0 con 0x7fc1100ad730 2023-11-04T01:41:00.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.540+0000 7fc117500640 1 -- 172.21.15.77:0/3920090538 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1100b25e0 con 0x7fc1100ad730 2023-11-04T01:41:00.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.541+0000 7fc117500640 1 -- 172.21.15.77:0/3920090538 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc110074290 con 0x7fc1100ad730 2023-11-04T01:41:00.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.541+0000 7fc105ffb640 1 -- 172.21.15.77:0/3920090538 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc10004e430 con 0x7fc1100ad730 2023-11-04T01:41:00.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.541+0000 7fc105ffb640 1 --2- 172.21.15.77:0/3920090538 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc0f406ae70 0x7fc0f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:00.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.542+0000 7fc105ffb640 1 -- 172.21.15.77:0/3920090538 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc1000ab940 con 0x7fc1100ad730 2023-11-04T01:41:00.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.542+0000 7fc11529c640 1 --2- 172.21.15.77:0/3920090538 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc0f406ae70 0x7fc0f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:00.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.542+0000 7fc11529c640 1 --2- 172.21.15.77:0/3920090538 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc0f406ae70 0x7fc0f406d330 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc10c005c00 tx=0x7fc10c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:00.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.546+0000 7fc105ffb640 1 -- 172.21.15.77:0/3920090538 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc100076770 con 0x7fc1100ad730 2023-11-04T01:41:00.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.726+0000 7fc117500640 1 -- 172.21.15.77:0/3920090538 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc1100aeba0 con 0x7fc1100ad730 2023-11-04T01:41:00.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.726+0000 7fc105ffb640 1 -- 172.21.15.77:0/3920090538 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc100079d90 con 0x7fc1100ad730 2023-11-04T01:41:00.728 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-11-04T01:41:00.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.728+0000 7fc117500640 1 -- 172.21.15.77:0/3920090538 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc0f406ae70 msgr2=0x7fc0f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:00.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.728+0000 7fc117500640 1 --2- 172.21.15.77:0/3920090538 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc0f406ae70 0x7fc0f406d330 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc10c005c00 tx=0x7fc10c009040 comp rx=0 tx=0).stop 2023-11-04T01:41:00.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.728+0000 7fc117500640 1 -- 172.21.15.77:0/3920090538 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1100ad730 msgr2=0x7fc1100c7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:00.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.728+0000 7fc117500640 1 --2- 172.21.15.77:0/3920090538 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1100ad730 0x7fc1100c7ed0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc1000098c0 tx=0x7fc1000046c0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.728+0000 7fc117500640 1 -- 172.21.15.77:0/3920090538 shutdown_connections 2023-11-04T01:41:00.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.728+0000 7fc117500640 1 --2- 172.21.15.77:0/3920090538 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc0f406ae70 0x7fc0f406d330 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.728+0000 7fc117500640 1 --2- 172.21.15.77:0/3920090538 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc11015ad30 0x7fc1100c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.728+0000 7fc117500640 1 --2- 172.21.15.77:0/3920090538 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1100ad730 0x7fc1100c7ed0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.728+0000 7fc117500640 1 --2- 172.21.15.77:0/3920090538 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc110070e20 0x7fc1101488f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.728+0000 7fc117500640 1 -- 172.21.15.77:0/3920090538 >> 172.21.15.77:0/3920090538 conn(0x7fc1100ce950 msgr2=0x7fc11006d470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:00.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.728+0000 7fc117500640 1 -- 172.21.15.77:0/3920090538 shutdown_connections 2023-11-04T01:41:00.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.728+0000 7fc117500640 1 -- 172.21.15.77:0/3920090538 wait complete. 2023-11-04T01:41:00.740 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:41:00.740 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:41:00.756 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:00.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.855+0000 7fc36244b640 1 Processor -- start 2023-11-04T01:41:00.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.855+0000 7fc36244b640 1 -- start start 2023-11-04T01:41:00.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.856+0000 7fc36244b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc35c15cf30 0x7fc35c06cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:00.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.856+0000 7fc36244b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc35c0cce90 0x7fc35c070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:00.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.856+0000 7fc36244b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc35c0b07f0 0x7fc35c0b0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:00.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.856+0000 7fc36244b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc35c0c9e00 con 0x7fc35c15cf30 2023-11-04T01:41:00.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.856+0000 7fc36244b640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc35c0b11a0 con 0x7fc35c0cce90 2023-11-04T01:41:00.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.856+0000 7fc36244b640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c071500 con 0x7fc35c0b07f0 2023-11-04T01:41:00.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.856+0000 7fc35bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc35c15cf30 0x7fc35c06cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:00.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.856+0000 7fc35bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc35c15cf30 0x7fc35c06cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54754/0 (socket says 172.21.15.77:54754) 2023-11-04T01:41:00.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.856+0000 7fc35bfff640 1 -- 172.21.15.77:0/94983865 learned_addr learned my addr 172.21.15.77:0/94983865 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:00.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.856+0000 7fc3609e8640 1 --2- 172.21.15.77:0/94983865 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc35c0b07f0 0x7fc35c0b0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:00.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.856+0000 7fc35b7fe640 1 --2- 172.21.15.77:0/94983865 >> v2:172.21.15.122:3300/0 conn(0x7fc35c0cce90 0x7fc35c070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:00.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.857+0000 7fc35bfff640 1 -- 172.21.15.77:0/94983865 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc35c0b07f0 msgr2=0x7fc35c0b0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:00.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.857+0000 7fc35bfff640 1 --2- 172.21.15.77:0/94983865 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc35c0b07f0 0x7fc35c0b0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.857+0000 7fc35bfff640 1 -- 172.21.15.77:0/94983865 >> v2:172.21.15.122:3300/0 conn(0x7fc35c0cce90 msgr2=0x7fc35c070bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:00.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.857+0000 7fc35bfff640 1 --2- 172.21.15.77:0/94983865 >> v2:172.21.15.122:3300/0 conn(0x7fc35c0cce90 0x7fc35c070bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.857+0000 7fc35bfff640 1 -- 172.21.15.77:0/94983865 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35c0717e0 con 0x7fc35c15cf30 2023-11-04T01:41:00.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.857+0000 7fc35bfff640 1 --2- 172.21.15.77:0/94983865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc35c15cf30 0x7fc35c06cbb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc35c0cb760 tx=0x7fc34c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbcaca090e03cf6b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:00.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.858+0000 7fc35affd640 1 -- 172.21.15.77:0/94983865 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c0317e0 con 0x7fc35c15cf30 2023-11-04T01:41:00.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.858+0000 7fc35affd640 1 -- 172.21.15.77:0/94983865 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34c031940 con 0x7fc35c15cf30 2023-11-04T01:41:00.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.858+0000 7fc35affd640 1 -- 172.21.15.77:0/94983865 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c031cd0 con 0x7fc35c15cf30 2023-11-04T01:41:00.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.858+0000 7fc36244b640 1 -- 172.21.15.77:0/94983865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc35c15cf30 msgr2=0x7fc35c06cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:00.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.858+0000 7fc36244b640 1 --2- 172.21.15.77:0/94983865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc35c15cf30 0x7fc35c06cbb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc35c0cb760 tx=0x7fc34c02b880 comp rx=0 tx=0).stop 2023-11-04T01:41:00.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.858+0000 7fc36244b640 1 -- 172.21.15.77:0/94983865 shutdown_connections 2023-11-04T01:41:00.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.858+0000 7fc36244b640 1 --2- 172.21.15.77:0/94983865 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc35c0b07f0 0x7fc35c0b0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.858+0000 7fc36244b640 1 --2- 172.21.15.77:0/94983865 >> v2:172.21.15.122:3300/0 conn(0x7fc35c0cce90 0x7fc35c070bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.858+0000 7fc36244b640 1 --2- 172.21.15.77:0/94983865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc35c15cf30 0x7fc35c06cbb0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.858+0000 7fc36244b640 1 -- 172.21.15.77:0/94983865 >> 172.21.15.77:0/94983865 conn(0x7fc35c0cb7f0 msgr2=0x7fc35c0cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:00.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.858+0000 7fc36244b640 1 -- 172.21.15.77:0/94983865 shutdown_connections 2023-11-04T01:41:00.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.858+0000 7fc36244b640 1 -- 172.21.15.77:0/94983865 wait complete. 2023-11-04T01:41:00.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.859+0000 7fc36244b640 1 Processor -- start 2023-11-04T01:41:00.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.860+0000 7fc36244b640 1 -- start start 2023-11-04T01:41:00.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.860+0000 7fc36244b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc35c0b07f0 0x7fc35c0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:00.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.860+0000 7fc36244b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc35c0cce90 0x7fc35c15e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:00.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.860+0000 7fc36244b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc35c15cf30 0x7fc35c15e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:00.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.860+0000 7fc36244b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c15fbc0 con 0x7fc35c0cce90 2023-11-04T01:41:00.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.860+0000 7fc36244b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c06da10 con 0x7fc35c0b07f0 2023-11-04T01:41:00.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.860+0000 7fc36244b640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c15ef40 con 0x7fc35c15cf30 2023-11-04T01:41:00.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.860+0000 7fc35b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc35c0cce90 0x7fc35c15e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:00.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.860+0000 7fc35b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc35c0cce90 0x7fc35c15e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54762/0 (socket says 172.21.15.77:54762) 2023-11-04T01:41:00.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.860+0000 7fc35b7fe640 1 -- 172.21.15.77:0/1924229342 learned_addr learned my addr 172.21.15.77:0/1924229342 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:00.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.860+0000 7fc35bfff640 1 --2- 172.21.15.77:0/1924229342 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc35c0b07f0 0x7fc35c0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:00.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.860+0000 7fc3609e8640 1 --2- 172.21.15.77:0/1924229342 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc35c15cf30 0x7fc35c15e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:00.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.861+0000 7fc35b7fe640 1 -- 172.21.15.77:0/1924229342 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc35c15cf30 msgr2=0x7fc35c15e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:00.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.861+0000 7fc35b7fe640 1 --2- 172.21.15.77:0/1924229342 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc35c15cf30 0x7fc35c15e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.861+0000 7fc35b7fe640 1 -- 172.21.15.77:0/1924229342 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc35c0b07f0 msgr2=0x7fc35c0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:00.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.861+0000 7fc35b7fe640 1 --2- 172.21.15.77:0/1924229342 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc35c0b07f0 0x7fc35c0b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:00.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.861+0000 7fc35b7fe640 1 -- 172.21.15.77:0/1924229342 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc34c0094d0 con 0x7fc35c0cce90 2023-11-04T01:41:00.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.861+0000 7fc35b7fe640 1 --2- 172.21.15.77:0/1924229342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc35c0cce90 0x7fc35c15e360 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc35000e840 tx=0x7fc35000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:00.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.861+0000 7fc358ff9640 1 -- 172.21.15.77:0/1924229342 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3500094f0 con 0x7fc35c0cce90 2023-11-04T01:41:00.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.861+0000 7fc358ff9640 1 -- 172.21.15.77:0/1924229342 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35000c940 con 0x7fc35c0cce90 2023-11-04T01:41:00.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.861+0000 7fc358ff9640 1 -- 172.21.15.77:0/1924229342 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35000ccd0 con 0x7fc35c0cce90 2023-11-04T01:41:00.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.861+0000 7fc36244b640 1 -- 172.21.15.77:0/1924229342 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc35c15f220 con 0x7fc35c0cce90 2023-11-04T01:41:00.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.861+0000 7fc36244b640 1 -- 172.21.15.77:0/1924229342 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc35c15f7e0 con 0x7fc35c0cce90 2023-11-04T01:41:00.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.862+0000 7fc36244b640 1 -- 172.21.15.77:0/1924229342 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc35c06b0b0 con 0x7fc35c0cce90 2023-11-04T01:41:00.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.862+0000 7fc358ff9640 1 -- 172.21.15.77:0/1924229342 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc350013470 con 0x7fc35c0cce90 2023-11-04T01:41:00.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.863+0000 7fc358ff9640 1 --2- 172.21.15.77:0/1924229342 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc34806ae70 0x7fc34806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:00.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.863+0000 7fc358ff9640 1 -- 172.21.15.77:0/1924229342 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc350089990 con 0x7fc35c0cce90 2023-11-04T01:41:00.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.863+0000 7fc35bfff640 1 --2- 172.21.15.77:0/1924229342 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc34806ae70 0x7fc34806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:00.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.863+0000 7fc35bfff640 1 --2- 172.21.15.77:0/1924229342 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc34806ae70 0x7fc34806d330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc34c036000 tx=0x7fc34c03d040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:00.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:00.867+0000 7fc358ff9640 1 -- 172.21.15.77:0/1924229342 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc3500547c0 con 0x7fc35c0cce90 2023-11-04T01:41:01.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.032+0000 7fc36244b640 1 -- 172.21.15.77:0/1924229342 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc35c0b17a0 con 0x7fc35c0cce90 2023-11-04T01:41:01.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.034+0000 7fc358ff9640 1 -- 172.21.15.77:0/1924229342 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18661 (secure 0 0 0) 0x7fc350057de0 con 0x7fc35c0cce90 2023-11-04T01:41:01.043 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:01.043 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":26,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:40:47.579547+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:40:02.810971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:40:04.003979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:40:07.734355+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:01.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.035+0000 7fc36244b640 1 -- 172.21.15.77:0/1924229342 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc34806ae70 msgr2=0x7fc34806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:01.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.035+0000 7fc36244b640 1 --2- 172.21.15.77:0/1924229342 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc34806ae70 0x7fc34806d330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc34c036000 tx=0x7fc34c03d040 comp rx=0 tx=0).stop 2023-11-04T01:41:01.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.036+0000 7fc36244b640 1 -- 172.21.15.77:0/1924229342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc35c0cce90 msgr2=0x7fc35c15e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:01.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.036+0000 7fc36244b640 1 --2- 172.21.15.77:0/1924229342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc35c0cce90 0x7fc35c15e360 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc35000e840 tx=0x7fc35000ed00 comp rx=0 tx=0).stop 2023-11-04T01:41:01.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.036+0000 7fc36244b640 1 -- 172.21.15.77:0/1924229342 shutdown_connections 2023-11-04T01:41:01.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.036+0000 7fc36244b640 1 --2- 172.21.15.77:0/1924229342 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc34806ae70 0x7fc34806d330 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.036+0000 7fc36244b640 1 --2- 172.21.15.77:0/1924229342 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc35c15cf30 0x7fc35c15e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.036+0000 7fc36244b640 1 --2- 172.21.15.77:0/1924229342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc35c0cce90 0x7fc35c15e360 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.036+0000 7fc36244b640 1 --2- 172.21.15.77:0/1924229342 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc35c0b07f0 0x7fc35c0b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.036+0000 7fc36244b640 1 -- 172.21.15.77:0/1924229342 >> 172.21.15.77:0/1924229342 conn(0x7fc35c0cb7f0 msgr2=0x7fc35c0af3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:01.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.036+0000 7fc36244b640 1 -- 172.21.15.77:0/1924229342 shutdown_connections 2023-11-04T01:41:01.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.036+0000 7fc36244b640 1 -- 172.21.15.77:0/1924229342 wait complete. 2023-11-04T01:41:01.048 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:40:02.810971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:40:04.003979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:40:07.734355+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:41:01.049 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:41:01.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.150+0000 7f6307d68640 1 Processor -- start 2023-11-04T01:41:01.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.150+0000 7f6307d68640 1 -- start start 2023-11-04T01:41:01.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.151+0000 7f6307d68640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6300159d40 0x7f63000cdc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:01.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.151+0000 7f6307d68640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63000ca550 con 0x7f63000cf420 2023-11-04T01:41:01.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.151+0000 7f6307d68640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63000ce1b0 con 0x7f63000c87d0 2023-11-04T01:41:01.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.151+0000 7f6307d68640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63000caeb0 con 0x7f6300159d40 2023-11-04T01:41:01.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.151+0000 7f6306305640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f63000cf420 0x7f63000cc4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52678/0 (socket says 172.21.15.77:52678) 2023-11-04T01:41:01.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.151+0000 7f6306305640 1 -- 172.21.15.77:0/46572818 learned_addr learned my addr 172.21.15.77:0/46572818 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:01.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.151+0000 7f6305b04640 1 --2- 172.21.15.77:0/46572818 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6300159d40 0x7f63000cdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:01.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.151+0000 7f6304b02640 1 -- 172.21.15.77:0/46572818 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 393705380 0 0) 0x7f63000ca550 con 0x7f63000cf420 2023-11-04T01:41:01.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.151+0000 7f6304b02640 1 -- 172.21.15.77:0/46572818 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62ec003520 con 0x7f63000cf420 2023-11-04T01:41:01.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.151+0000 7f6304b02640 1 -- 172.21.15.77:0/46572818 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2490050114 0 0) 0x7f63000ce1b0 con 0x7f63000c87d0 2023-11-04T01:41:01.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.152+0000 7f6304b02640 1 -- 172.21.15.77:0/46572818 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63000ca550 con 0x7f63000c87d0 2023-11-04T01:41:01.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.152+0000 7f6305b04640 1 -- 172.21.15.77:0/46572818 >> v1:172.21.15.122:6789/0 conn(0x7f63000c87d0 legacy=0x7f63000ced10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:01.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.152+0000 7f6305b04640 1 -- 172.21.15.77:0/46572818 >> v1:172.21.15.77:6789/0 conn(0x7f63000cf420 legacy=0x7f63000cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:01.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.152+0000 7f6305b04640 1 -- 172.21.15.77:0/46572818 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63000ce450 con 0x7f6300159d40 2023-11-04T01:41:01.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.152+0000 7f6305b04640 1 --2- 172.21.15.77:0/46572818 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6300159d40 0x7f63000cdc70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f62fc0097d0 tx=0x7f62fc02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94164df2385d25 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:01.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.153+0000 7f6304b02640 1 -- 172.21.15.77:0/46572818 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc031800 con 0x7f6300159d40 2023-11-04T01:41:01.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.153+0000 7f6304b02640 1 -- 172.21.15.77:0/46572818 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62fc031960 con 0x7f6300159d40 2023-11-04T01:41:01.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.153+0000 7f6304b02640 1 -- 172.21.15.77:0/46572818 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc031cf0 con 0x7f6300159d40 2023-11-04T01:41:01.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.153+0000 7f6307d68640 1 -- 172.21.15.77:0/46572818 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6300159d40 msgr2=0x7f63000cdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:01.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.153+0000 7f6307d68640 1 --2- 172.21.15.77:0/46572818 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6300159d40 0x7f63000cdc70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f62fc0097d0 tx=0x7f62fc02b8a0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.153+0000 7f6307d68640 1 -- 172.21.15.77:0/46572818 shutdown_connections 2023-11-04T01:41:01.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.153+0000 7f6307d68640 1 --2- 172.21.15.77:0/46572818 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6300159d40 0x7f63000cdc70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.153+0000 7f6307d68640 1 -- 172.21.15.77:0/46572818 >> 172.21.15.77:0/46572818 conn(0x7f63000b1c50 msgr2=0x7f63000b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:01.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.153+0000 7f6307d68640 1 -- 172.21.15.77:0/46572818 shutdown_connections 2023-11-04T01:41:01.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.153+0000 7f6307d68640 1 -- 172.21.15.77:0/46572818 wait complete. 2023-11-04T01:41:01.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.154+0000 7f6307d68640 1 Processor -- start 2023-11-04T01:41:01.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.154+0000 7f6307d68640 1 -- start start 2023-11-04T01:41:01.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.155+0000 7f6307d68640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63000c87d0 0x7f63001f1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:01.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.155+0000 7f6307d68640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63000cf420 0x7f630015a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:01.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.155+0000 7f6307d68640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6300159d40 0x7f63000cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:01.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.155+0000 7f6307d68640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6300154770 con 0x7f63000c87d0 2023-11-04T01:41:01.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.155+0000 7f6307d68640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630015a7e0 con 0x7f63000cf420 2023-11-04T01:41:01.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.155+0000 7f6307d68640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f630015aa80 con 0x7f6300159d40 2023-11-04T01:41:01.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.155+0000 7f6305b04640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63000c87d0 0x7f63001f1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:01.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.155+0000 7f6305b04640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63000c87d0 0x7f63001f1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54774/0 (socket says 172.21.15.77:54774) 2023-11-04T01:41:01.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.155+0000 7f6305b04640 1 -- 172.21.15.77:0/2290440382 learned_addr learned my addr 172.21.15.77:0/2290440382 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:01.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.155+0000 7f6306305640 1 --2- 172.21.15.77:0/2290440382 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6300159d40 0x7f63000cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:01.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.155+0000 7f6305303640 1 --2- 172.21.15.77:0/2290440382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63000cf420 0x7f630015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:01.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.155+0000 7f6305b04640 1 -- 172.21.15.77:0/2290440382 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6300159d40 msgr2=0x7f63000cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:01.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.155+0000 7f6305b04640 1 --2- 172.21.15.77:0/2290440382 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6300159d40 0x7f63000cbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.155+0000 7f6305b04640 1 -- 172.21.15.77:0/2290440382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63000cf420 msgr2=0x7f630015a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:01.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.155+0000 7f6305b04640 1 --2- 172.21.15.77:0/2290440382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63000cf420 0x7f630015a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.156+0000 7f6305b04640 1 -- 172.21.15.77:0/2290440382 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62fc009400 con 0x7f63000c87d0 2023-11-04T01:41:01.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.156+0000 7f6305303640 1 --2- 172.21.15.77:0/2290440382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63000cf420 0x7f630015a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:41:01.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.156+0000 7f6305b04640 1 --2- 172.21.15.77:0/2290440382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63000c87d0 0x7f63001f1220 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f62fc034040 tx=0x7f62fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:01.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.156+0000 7f62f67fc640 1 -- 172.21.15.77:0/2290440382 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc03ac60 con 0x7f63000c87d0 2023-11-04T01:41:01.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.156+0000 7f62f67fc640 1 -- 172.21.15.77:0/2290440382 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62fc03ae00 con 0x7f63000c87d0 2023-11-04T01:41:01.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.156+0000 7f6307d68640 1 -- 172.21.15.77:0/2290440382 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f630015ad60 con 0x7f63000c87d0 2023-11-04T01:41:01.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.156+0000 7f62f67fc640 1 -- 172.21.15.77:0/2290440382 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc044630 con 0x7f63000c87d0 2023-11-04T01:41:01.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.156+0000 7f6307d68640 1 -- 172.21.15.77:0/2290440382 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f630015b320 con 0x7f63000c87d0 2023-11-04T01:41:01.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.157+0000 7f6307d68640 1 -- 172.21.15.77:0/2290440382 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6300074290 con 0x7f63000c87d0 2023-11-04T01:41:01.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.157+0000 7f62f67fc640 1 -- 172.21.15.77:0/2290440382 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f62fc04d450 con 0x7f63000c87d0 2023-11-04T01:41:01.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.158+0000 7f62f67fc640 1 --2- 172.21.15.77:0/2290440382 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f62e406aea0 0x7f62e406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:01.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.158+0000 7f62f67fc640 1 -- 172.21.15.77:0/2290440382 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f62fc02e070 con 0x7f63000c87d0 2023-11-04T01:41:01.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.158+0000 7f6305303640 1 --2- 172.21.15.77:0/2290440382 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f62e406aea0 0x7f62e406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:01.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.158+0000 7f6305303640 1 --2- 172.21.15.77:0/2290440382 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f62e406aea0 0x7f62e406d360 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f62f0007fd0 tx=0x7f62f0009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:01.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.162+0000 7f62f67fc640 1 -- 172.21.15.77:0/2290440382 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f62fc0767a0 con 0x7f63000c87d0 2023-11-04T01:41:01.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.326+0000 7f6307d68640 1 -- 172.21.15.77:0/2290440382 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f63000c9b30 con 0x7f63000c87d0 2023-11-04T01:41:01.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.326+0000 7f62f67fc640 1 -- 172.21.15.77:0/2290440382 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f62fc0350a0 con 0x7f63000c87d0 2023-11-04T01:41:01.329 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:41:01.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.328+0000 7f6307d68640 1 -- 172.21.15.77:0/2290440382 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f62e406aea0 msgr2=0x7f62e406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:01.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.328+0000 7f6307d68640 1 --2- 172.21.15.77:0/2290440382 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f62e406aea0 0x7f62e406d360 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f62f0007fd0 tx=0x7f62f0009040 comp rx=0 tx=0).stop 2023-11-04T01:41:01.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.328+0000 7f6307d68640 1 -- 172.21.15.77:0/2290440382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63000c87d0 msgr2=0x7f63001f1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:01.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.328+0000 7f6307d68640 1 --2- 172.21.15.77:0/2290440382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63000c87d0 0x7f63001f1220 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f62fc034040 tx=0x7f62fc0046c0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.328+0000 7f6307d68640 1 -- 172.21.15.77:0/2290440382 shutdown_connections 2023-11-04T01:41:01.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.328+0000 7f6307d68640 1 --2- 172.21.15.77:0/2290440382 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f62e406aea0 0x7f62e406d360 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.328+0000 7f6307d68640 1 --2- 172.21.15.77:0/2290440382 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6300159d40 0x7f63000cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.328+0000 7f6307d68640 1 --2- 172.21.15.77:0/2290440382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63000cf420 0x7f630015a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.329+0000 7f6307d68640 1 --2- 172.21.15.77:0/2290440382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63000c87d0 0x7f63001f1220 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.329+0000 7f6307d68640 1 -- 172.21.15.77:0/2290440382 >> 172.21.15.77:0/2290440382 conn(0x7f63000b1c50 msgr2=0x7f6300158f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:01.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.329+0000 7f6307d68640 1 -- 172.21.15.77:0/2290440382 shutdown_connections 2023-11-04T01:41:01.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.329+0000 7f6307d68640 1 -- 172.21.15.77:0/2290440382 wait complete. 2023-11-04T01:41:01.341 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:41:01.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.442+0000 7fcf8714c640 1 Processor -- start 2023-11-04T01:41:01.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.442+0000 7fcf8714c640 1 -- start start 2023-11-04T01:41:01.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.443+0000 7fcf8714c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcf800cc300 0x7fcf800b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:01.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.443+0000 7fcf8714c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf800caa20 con 0x7fcf8015e3f0 2023-11-04T01:41:01.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.443+0000 7fcf8714c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf800cb230 con 0x7fcf800ca0a0 2023-11-04T01:41:01.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.443+0000 7fcf8714c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf800b3300 con 0x7fcf800cc300 2023-11-04T01:41:01.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.443+0000 7fcf856e9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcf800cc300 0x7fcf800b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:01.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.443+0000 7fcf856e9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcf800cc300 0x7fcf800b1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54788/0 (socket says 172.21.15.77:54788) 2023-11-04T01:41:01.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.443+0000 7fcf84ee8640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fcf8015e3f0 0x7fcf800b2bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52694/0 (socket says 172.21.15.77:52694) 2023-11-04T01:41:01.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.443+0000 7fcf856e9640 1 -- 172.21.15.77:0/1838493714 learned_addr learned my addr 172.21.15.77:0/1838493714 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:01.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.443+0000 7fcf856e9640 1 -- 172.21.15.77:0/1838493714 >> v1:172.21.15.122:6789/0 conn(0x7fcf800ca0a0 legacy=0x7fcf800cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:01.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.443+0000 7fcf856e9640 1 -- 172.21.15.77:0/1838493714 >> v1:172.21.15.77:6789/0 conn(0x7fcf8015e3f0 legacy=0x7fcf800b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:01.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.443+0000 7fcf856e9640 1 -- 172.21.15.77:0/1838493714 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf800ca530 con 0x7fcf800cc300 2023-11-04T01:41:01.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.444+0000 7fcf856e9640 1 --2- 172.21.15.77:0/1838493714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf800cc300 0x7fcf800b1890 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009e50 tx=0x7fcf7802c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ab84cfd68ad4d05 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:01.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.444+0000 7fcf7f7fe640 1 -- 172.21.15.77:0/1838493714 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7802cbb0 con 0x7fcf800cc300 2023-11-04T01:41:01.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.444+0000 7fcf7f7fe640 1 -- 172.21.15.77:0/1838493714 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7802cd10 con 0x7fcf800cc300 2023-11-04T01:41:01.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.444+0000 7fcf7f7fe640 1 -- 172.21.15.77:0/1838493714 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf78034610 con 0x7fcf800cc300 2023-11-04T01:41:01.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.444+0000 7fcf8714c640 1 -- 172.21.15.77:0/1838493714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf800cc300 msgr2=0x7fcf800b1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:01.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.444+0000 7fcf8714c640 1 --2- 172.21.15.77:0/1838493714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf800cc300 0x7fcf800b1890 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009e50 tx=0x7fcf7802c010 comp rx=0 tx=0).stop 2023-11-04T01:41:01.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.445+0000 7fcf8714c640 1 -- 172.21.15.77:0/1838493714 shutdown_connections 2023-11-04T01:41:01.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.445+0000 7fcf8714c640 1 --2- 172.21.15.77:0/1838493714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf800cc300 0x7fcf800b1890 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.445+0000 7fcf8714c640 1 -- 172.21.15.77:0/1838493714 >> 172.21.15.77:0/1838493714 conn(0x7fcf80071820 msgr2=0x7fcf80071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:01.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.445+0000 7fcf8714c640 1 -- 172.21.15.77:0/1838493714 shutdown_connections 2023-11-04T01:41:01.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.445+0000 7fcf8714c640 1 -- 172.21.15.77:0/1838493714 wait complete. 2023-11-04T01:41:01.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.446+0000 7fcf8714c640 1 Processor -- start 2023-11-04T01:41:01.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.446+0000 7fcf8714c640 1 -- start start 2023-11-04T01:41:01.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.447+0000 7fcf8714c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcf800cc300 0x7fcf800c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:01.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.447+0000 7fcf8714c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf8015e3f0 0x7fcf80158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:01.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.447+0000 7fcf8714c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf80156be0 0x7fcf800c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:01.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.447+0000 7fcf8714c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf800c7470 con 0x7fcf80156be0 2023-11-04T01:41:01.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.447+0000 7fcf8714c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf800c7750 con 0x7fcf8015e3f0 2023-11-04T01:41:01.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.447+0000 7fcf8714c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf800c7a30 con 0x7fcf800cc300 2023-11-04T01:41:01.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.447+0000 7fcf856e9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf80156be0 0x7fcf800c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:01.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.447+0000 7fcf856e9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf80156be0 0x7fcf800c8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54790/0 (socket says 172.21.15.77:54790) 2023-11-04T01:41:01.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.447+0000 7fcf856e9640 1 -- 172.21.15.77:0/3980784649 learned_addr learned my addr 172.21.15.77:0/3980784649 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:01.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.447+0000 7fcf7ffff640 1 --2- 172.21.15.77:0/3980784649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf8015e3f0 0x7fcf80158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:01.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.447+0000 7fcf84ee8640 1 --2- 172.21.15.77:0/3980784649 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcf800cc300 0x7fcf800c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:01.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.447+0000 7fcf856e9640 1 -- 172.21.15.77:0/3980784649 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcf800cc300 msgr2=0x7fcf800c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:01.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.447+0000 7fcf856e9640 1 --2- 172.21.15.77:0/3980784649 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcf800cc300 0x7fcf800c6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.447+0000 7fcf856e9640 1 -- 172.21.15.77:0/3980784649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf8015e3f0 msgr2=0x7fcf80158b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:01.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.447+0000 7fcf856e9640 1 --2- 172.21.15.77:0/3980784649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf8015e3f0 0x7fcf80158b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.447+0000 7fcf856e9640 1 -- 172.21.15.77:0/3980784649 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf78009b30 con 0x7fcf80156be0 2023-11-04T01:41:01.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.447+0000 7fcf856e9640 1 --2- 172.21.15.77:0/3980784649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf80156be0 0x7fcf800c8510 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009e50 tx=0x7fcf78004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:01.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.447+0000 7fcf7d7fa640 1 -- 172.21.15.77:0/3980784649 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf78009510 con 0x7fcf80156be0 2023-11-04T01:41:01.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.447+0000 7fcf7d7fa640 1 -- 172.21.15.77:0/3980784649 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7803e450 con 0x7fcf80156be0 2023-11-04T01:41:01.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.447+0000 7fcf8714c640 1 -- 172.21.15.77:0/3980784649 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf800c7d10 con 0x7fcf80156be0 2023-11-04T01:41:01.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.447+0000 7fcf7d7fa640 1 -- 172.21.15.77:0/3980784649 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7803e800 con 0x7fcf80156be0 2023-11-04T01:41:01.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.447+0000 7fcf8714c640 1 -- 172.21.15.77:0/3980784649 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf800c7060 con 0x7fcf80156be0 2023-11-04T01:41:01.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.448+0000 7fcf8714c640 1 -- 172.21.15.77:0/3980784649 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf800c8230 con 0x7fcf80156be0 2023-11-04T01:41:01.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.449+0000 7fcf7d7fa640 1 -- 172.21.15.77:0/3980784649 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcf7803e960 con 0x7fcf80156be0 2023-11-04T01:41:01.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.449+0000 7fcf7d7fa640 1 --2- 172.21.15.77:0/3980784649 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcf6406ae70 0x7fcf6406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:01.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.449+0000 7fcf7d7fa640 1 -- 172.21.15.77:0/3980784649 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcf780ac740 con 0x7fcf80156be0 2023-11-04T01:41:01.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.449+0000 7fcf84ee8640 1 --2- 172.21.15.77:0/3980784649 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcf6406ae70 0x7fcf6406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:01.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.450+0000 7fcf84ee8640 1 --2- 172.21.15.77:0/3980784649 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcf6406ae70 0x7fcf6406d330 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcf74000f60 tx=0x7fcf74000ed0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:01.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.453+0000 7fcf7d7fa640 1 -- 172.21.15.77:0/3980784649 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcf800c8230 con 0x7fcf80156be0 2023-11-04T01:41:01.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.621+0000 7fcf8714c640 1 -- 172.21.15.77:0/3980784649 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcf800c8230 con 0x7fcf80156be0 2023-11-04T01:41:01.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.622+0000 7fcf7d7fa640 1 -- 172.21.15.77:0/3980784649 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcf800c8230 con 0x7fcf80156be0 2023-11-04T01:41:01.624 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:41:01.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.624+0000 7fcf8714c640 1 -- 172.21.15.77:0/3980784649 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcf6406ae70 msgr2=0x7fcf6406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:01.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.624+0000 7fcf8714c640 1 --2- 172.21.15.77:0/3980784649 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcf6406ae70 0x7fcf6406d330 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcf74000f60 tx=0x7fcf74000ed0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.624+0000 7fcf8714c640 1 -- 172.21.15.77:0/3980784649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf80156be0 msgr2=0x7fcf800c8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:01.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.624+0000 7fcf8714c640 1 --2- 172.21.15.77:0/3980784649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf80156be0 0x7fcf800c8510 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009e50 tx=0x7fcf78004a40 comp rx=0 tx=0).stop 2023-11-04T01:41:01.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.624+0000 7fcf8714c640 1 -- 172.21.15.77:0/3980784649 shutdown_connections 2023-11-04T01:41:01.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.624+0000 7fcf8714c640 1 --2- 172.21.15.77:0/3980784649 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcf6406ae70 0x7fcf6406d330 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.624+0000 7fcf8714c640 1 --2- 172.21.15.77:0/3980784649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf80156be0 0x7fcf800c8510 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.624+0000 7fcf8714c640 1 --2- 172.21.15.77:0/3980784649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf8015e3f0 0x7fcf80158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.624+0000 7fcf8714c640 1 --2- 172.21.15.77:0/3980784649 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcf800cc300 0x7fcf800c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.624+0000 7fcf8714c640 1 -- 172.21.15.77:0/3980784649 >> 172.21.15.77:0/3980784649 conn(0x7fcf80071820 msgr2=0x7fcf8006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:01.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.624+0000 7fcf8714c640 1 -- 172.21.15.77:0/3980784649 shutdown_connections 2023-11-04T01:41:01.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.624+0000 7fcf8714c640 1 -- 172.21.15.77:0/3980784649 wait complete. 2023-11-04T01:41:01.636 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:41:01.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.737+0000 7f0fcbe9b640 1 Processor -- start 2023-11-04T01:41:01.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.737+0000 7f0fcbe9b640 1 -- start start 2023-11-04T01:41:01.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.738+0000 7f0fcbe9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0fc415e430 0x7f0fc40cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:01.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.738+0000 7f0fcbe9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f0fc40cf160 0x7f0fc40cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:01.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.738+0000 7f0fcbe9b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0fc40d0710 0x7f0fc40cda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:01.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.738+0000 7f0fcbe9b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc40cdf90 con 0x7f0fc415e430 2023-11-04T01:41:01.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.738+0000 7f0fcbe9b640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc40d0280 con 0x7f0fc40cf160 2023-11-04T01:41:01.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.738+0000 7f0fcbe9b640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc40cf670 con 0x7f0fc40d0710 2023-11-04T01:41:01.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.738+0000 7f0fc9c37640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0fc415e430 0x7f0fc40cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:01.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.738+0000 7f0fc9c37640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0fc415e430 0x7f0fc40cec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54792/0 (socket says 172.21.15.77:54792) 2023-11-04T01:41:01.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.738+0000 7f0fc9c37640 1 -- 172.21.15.77:0/1755352275 learned_addr learned my addr 172.21.15.77:0/1755352275 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:01.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.738+0000 7f0fc9436640 1 --2- 172.21.15.77:0/1755352275 >> v2:172.21.15.122:3300/0 conn(0x7f0fc40cf160 0x7f0fc40cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:01.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.738+0000 7f0fca438640 1 --2- 172.21.15.77:0/1755352275 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0fc40d0710 0x7f0fc40cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:01.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.738+0000 7f0fc9c37640 1 -- 172.21.15.77:0/1755352275 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0fc40d0710 msgr2=0x7f0fc40cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:01.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.738+0000 7f0fc9c37640 1 --2- 172.21.15.77:0/1755352275 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0fc40d0710 0x7f0fc40cda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.738+0000 7f0fc9c37640 1 -- 172.21.15.77:0/1755352275 >> v2:172.21.15.122:3300/0 conn(0x7f0fc40cf160 msgr2=0x7f0fc40cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:01.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.738+0000 7f0fc9c37640 1 --2- 172.21.15.77:0/1755352275 >> v2:172.21.15.122:3300/0 conn(0x7f0fc40cf160 0x7f0fc40cd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.738+0000 7f0fc9c37640 1 -- 172.21.15.77:0/1755352275 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc40cf950 con 0x7f0fc415e430 2023-11-04T01:41:01.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.739+0000 7f0fc9c37640 1 --2- 172.21.15.77:0/1755352275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fc415e430 0x7f0fc40cec20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0fc40cb3c0 tx=0x7f0fc002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b84689735f14f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:01.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.739+0000 7f0fc8c35640 1 -- 172.21.15.77:0/1755352275 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc0031870 con 0x7f0fc415e430 2023-11-04T01:41:01.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.739+0000 7f0fc8c35640 1 -- 172.21.15.77:0/1755352275 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc00319d0 con 0x7f0fc415e430 2023-11-04T01:41:01.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.739+0000 7f0fc8c35640 1 -- 172.21.15.77:0/1755352275 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc0031d60 con 0x7f0fc415e430 2023-11-04T01:41:01.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.740+0000 7f0fcbe9b640 1 -- 172.21.15.77:0/1755352275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fc415e430 msgr2=0x7f0fc40cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:01.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.740+0000 7f0fcbe9b640 1 --2- 172.21.15.77:0/1755352275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fc415e430 0x7f0fc40cec20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0fc40cb3c0 tx=0x7f0fc002b910 comp rx=0 tx=0).stop 2023-11-04T01:41:01.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.740+0000 7f0fcbe9b640 1 -- 172.21.15.77:0/1755352275 shutdown_connections 2023-11-04T01:41:01.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.740+0000 7f0fcbe9b640 1 --2- 172.21.15.77:0/1755352275 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0fc40d0710 0x7f0fc40cda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.740+0000 7f0fcbe9b640 1 --2- 172.21.15.77:0/1755352275 >> v2:172.21.15.122:3300/0 conn(0x7f0fc40cf160 0x7f0fc40cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.740+0000 7f0fcbe9b640 1 --2- 172.21.15.77:0/1755352275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fc415e430 0x7f0fc40cec20 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.740+0000 7f0fcbe9b640 1 -- 172.21.15.77:0/1755352275 >> 172.21.15.77:0/1755352275 conn(0x7f0fc406ea20 msgr2=0x7f0fc406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:01.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.740+0000 7f0fcbe9b640 1 -- 172.21.15.77:0/1755352275 shutdown_connections 2023-11-04T01:41:01.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.740+0000 7f0fcbe9b640 1 -- 172.21.15.77:0/1755352275 wait complete. 2023-11-04T01:41:01.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.741+0000 7f0fcbe9b640 1 Processor -- start 2023-11-04T01:41:01.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.741+0000 7f0fcbe9b640 1 -- start start 2023-11-04T01:41:01.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.742+0000 7f0fcbe9b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0fc40cf160 0x7f0fc415c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:01.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.742+0000 7f0fcbe9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0fc40d0710 0x7f0fc414efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:01.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.742+0000 7f0fcbe9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fc415e430 0x7f0fc40c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:01.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.742+0000 7f0fcbe9b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc414f4f0 con 0x7f0fc415e430 2023-11-04T01:41:01.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.742+0000 7f0fcbe9b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc40c7c70 con 0x7f0fc40d0710 2023-11-04T01:41:01.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.742+0000 7f0fcbe9b640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc40c7ec0 con 0x7f0fc40cf160 2023-11-04T01:41:01.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.742+0000 7f0fca438640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fc415e430 0x7f0fc40c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:01.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.742+0000 7f0fca438640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fc415e430 0x7f0fc40c8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54806/0 (socket says 172.21.15.77:54806) 2023-11-04T01:41:01.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.742+0000 7f0fca438640 1 -- 172.21.15.77:0/1682612791 learned_addr learned my addr 172.21.15.77:0/1682612791 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:01.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.742+0000 7f0fc9436640 1 --2- 172.21.15.77:0/1682612791 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0fc40d0710 0x7f0fc414efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:01.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.742+0000 7f0fc9c37640 1 --2- 172.21.15.77:0/1682612791 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0fc40cf160 0x7f0fc415c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:01.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.742+0000 7f0fca438640 1 -- 172.21.15.77:0/1682612791 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0fc40cf160 msgr2=0x7f0fc415c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:01.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.742+0000 7f0fca438640 1 --2- 172.21.15.77:0/1682612791 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0fc40cf160 0x7f0fc415c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.742+0000 7f0fca438640 1 -- 172.21.15.77:0/1682612791 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0fc40d0710 msgr2=0x7f0fc414efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:01.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.742+0000 7f0fca438640 1 --2- 172.21.15.77:0/1682612791 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0fc40d0710 0x7f0fc414efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.742+0000 7f0fca438640 1 -- 172.21.15.77:0/1682612791 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc00094d0 con 0x7f0fc415e430 2023-11-04T01:41:01.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.742+0000 7f0fc9436640 1 --2- 172.21.15.77:0/1682612791 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0fc40d0710 0x7f0fc414efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:01.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.742+0000 7f0fc9c37640 1 --2- 172.21.15.77:0/1682612791 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0fc40cf160 0x7f0fc415c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:01.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.742+0000 7f0fca438640 1 --2- 172.21.15.77:0/1682612791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fc415e430 0x7f0fc40c8f60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc009fd0 tx=0x7f0fbc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:01.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.742+0000 7f0fba7fc640 1 -- 172.21.15.77:0/1682612791 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc014420 con 0x7f0fc415e430 2023-11-04T01:41:01.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.742+0000 7f0fba7fc640 1 -- 172.21.15.77:0/1682612791 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fbc014580 con 0x7f0fc415e430 2023-11-04T01:41:01.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.742+0000 7f0fcbe9b640 1 -- 172.21.15.77:0/1682612791 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc40c81a0 con 0x7f0fc415e430 2023-11-04T01:41:01.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.742+0000 7f0fba7fc640 1 -- 172.21.15.77:0/1682612791 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc014930 con 0x7f0fc415e430 2023-11-04T01:41:01.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.742+0000 7f0fcbe9b640 1 -- 172.21.15.77:0/1682612791 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc40c8760 con 0x7f0fc415e430 2023-11-04T01:41:01.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.743+0000 7f0fcbe9b640 1 -- 172.21.15.77:0/1682612791 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fc4074290 con 0x7f0fc415e430 2023-11-04T01:41:01.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.744+0000 7f0fba7fc640 1 -- 172.21.15.77:0/1682612791 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0fbc014a90 con 0x7f0fc415e430 2023-11-04T01:41:01.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.744+0000 7f0fba7fc640 1 --2- 172.21.15.77:0/1682612791 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0fa806ae70 0x7f0fa806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:01.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.744+0000 7f0fba7fc640 1 -- 172.21.15.77:0/1682612791 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0fbc08a2e0 con 0x7f0fc415e430 2023-11-04T01:41:01.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.744+0000 7f0fc9c37640 1 --2- 172.21.15.77:0/1682612791 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0fa806ae70 0x7f0fa806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:01.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.745+0000 7f0fc9c37640 1 --2- 172.21.15.77:0/1682612791 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0fa806ae70 0x7f0fa806d330 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0036000 tx=0x7f0fc003c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:01.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.748+0000 7f0fba7fc640 1 -- 172.21.15.77:0/1682612791 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0fbc054fd0 con 0x7f0fc415e430 2023-11-04T01:41:01.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.913+0000 7f0fcbe9b640 1 -- 172.21.15.77:0/1682612791 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0fc40cff10 con 0x7f0fc415e430 2023-11-04T01:41:01.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.913+0000 7f0fba7fc640 1 -- 172.21.15.77:0/1682612791 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0fbc0585f0 con 0x7f0fc415e430 2023-11-04T01:41:01.915 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-04T01:41:01.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.915+0000 7f0fcbe9b640 1 -- 172.21.15.77:0/1682612791 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0fa806ae70 msgr2=0x7f0fa806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:01.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.915+0000 7f0fcbe9b640 1 --2- 172.21.15.77:0/1682612791 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0fa806ae70 0x7f0fa806d330 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0036000 tx=0x7f0fc003c040 comp rx=0 tx=0).stop 2023-11-04T01:41:01.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.915+0000 7f0fcbe9b640 1 -- 172.21.15.77:0/1682612791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fc415e430 msgr2=0x7f0fc40c8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:01.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.915+0000 7f0fcbe9b640 1 --2- 172.21.15.77:0/1682612791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fc415e430 0x7f0fc40c8f60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc009fd0 tx=0x7f0fbc00e4b0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.915+0000 7f0fcbe9b640 1 -- 172.21.15.77:0/1682612791 shutdown_connections 2023-11-04T01:41:01.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.915+0000 7f0fcbe9b640 1 --2- 172.21.15.77:0/1682612791 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0fa806ae70 0x7f0fa806d330 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.915+0000 7f0fcbe9b640 1 --2- 172.21.15.77:0/1682612791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fc415e430 0x7f0fc40c8f60 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.915+0000 7f0fcbe9b640 1 --2- 172.21.15.77:0/1682612791 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0fc40d0710 0x7f0fc414efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.915+0000 7f0fcbe9b640 1 --2- 172.21.15.77:0/1682612791 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0fc40cf160 0x7f0fc415c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:01.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.915+0000 7f0fcbe9b640 1 -- 172.21.15.77:0/1682612791 >> 172.21.15.77:0/1682612791 conn(0x7f0fc406ea20 msgr2=0x7f0fc415cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:01.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.915+0000 7f0fcbe9b640 1 -- 172.21.15.77:0/1682612791 shutdown_connections 2023-11-04T01:41:01.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:01.915+0000 7f0fcbe9b640 1 -- 172.21.15.77:0/1682612791 wait complete. 2023-11-04T01:41:01.927 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:41:02.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.028+0000 7f2e8a16c640 1 Processor -- start 2023-11-04T01:41:02.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.028+0000 7f2e8a16c640 1 -- start start 2023-11-04T01:41:02.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.028+0000 7f2e8a16c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2e840cc9d0 0x7f2e840c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.028+0000 7f2e8a16c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e840c3860 con 0x7f2e84153850 2023-11-04T01:41:02.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.028+0000 7f2e8a16c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e840c9250 con 0x7f2e840cc520 2023-11-04T01:41:02.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.028+0000 7f2e8a16c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e84153c30 con 0x7f2e840cc9d0 2023-11-04T01:41:02.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.029+0000 7f2e83fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2e840cc9d0 0x7f2e840c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.029+0000 7f2e837fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f2e84153850 0x7f2e8415a1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52702/0 (socket says 172.21.15.77:52702) 2023-11-04T01:41:02.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.029+0000 7f2e837fe640 1 -- 172.21.15.77:0/1534905623 learned_addr learned my addr 172.21.15.77:0/1534905623 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:02.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.029+0000 7f2e83fff640 1 -- 172.21.15.77:0/1534905623 >> v1:172.21.15.122:6789/0 conn(0x7f2e840cc520 legacy=0x7f2e84070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:02.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.029+0000 7f2e83fff640 1 -- 172.21.15.77:0/1534905623 >> v1:172.21.15.77:6789/0 conn(0x7f2e84153850 legacy=0x7f2e8415a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.029+0000 7f2e827fc640 1 -- 172.21.15.77:0/1534905623 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2198142055 0 0) 0x7f2e840c3860 con 0x7f2e84153850 2023-11-04T01:41:02.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.029+0000 7f2e83fff640 1 -- 172.21.15.77:0/1534905623 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e840ce590 con 0x7f2e840cc9d0 2023-11-04T01:41:02.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.030+0000 7f2e83fff640 1 --2- 172.21.15.77:0/1534905623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e840cc9d0 0x7f2e840c3cf0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009d90 tx=0x7f2e7c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b157eee342cd501 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:02.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.030+0000 7f2e827fc640 1 -- 172.21.15.77:0/1534905623 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c02cc60 con 0x7f2e840cc9d0 2023-11-04T01:41:02.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.030+0000 7f2e827fc640 1 -- 172.21.15.77:0/1534905623 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e7c02cdc0 con 0x7f2e840cc9d0 2023-11-04T01:41:02.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.030+0000 7f2e827fc640 1 -- 172.21.15.77:0/1534905623 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c034660 con 0x7f2e840cc9d0 2023-11-04T01:41:02.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.030+0000 7f2e8a16c640 1 -- 172.21.15.77:0/1534905623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e840cc9d0 msgr2=0x7f2e840c3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.030+0000 7f2e8a16c640 1 --2- 172.21.15.77:0/1534905623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e840cc9d0 0x7f2e840c3cf0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009d90 tx=0x7f2e7c02beb0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.030+0000 7f2e8a16c640 1 -- 172.21.15.77:0/1534905623 shutdown_connections 2023-11-04T01:41:02.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.030+0000 7f2e8a16c640 1 --2- 172.21.15.77:0/1534905623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e840cc9d0 0x7f2e840c3cf0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.030+0000 7f2e8a16c640 1 -- 172.21.15.77:0/1534905623 >> 172.21.15.77:0/1534905623 conn(0x7f2e840ce950 msgr2=0x7f2e840ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:02.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.030+0000 7f2e8a16c640 1 -- 172.21.15.77:0/1534905623 shutdown_connections 2023-11-04T01:41:02.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.030+0000 7f2e8a16c640 1 -- 172.21.15.77:0/1534905623 wait complete. 2023-11-04T01:41:02.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.031+0000 7f2e8a16c640 1 Processor -- start 2023-11-04T01:41:02.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.032+0000 7f2e8a16c640 1 -- start start 2023-11-04T01:41:02.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.032+0000 7f2e8a16c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e840cc520 0x7f2e8415bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.032+0000 7f2e8a16c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e840cc9d0 0x7f2e8415c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.032+0000 7f2e8a16c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e84153850 0x7f2e84142490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.032+0000 7f2e8a16c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e840b18a0 con 0x7f2e84153850 2023-11-04T01:41:02.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.032+0000 7f2e8a16c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e84143370 con 0x7f2e840cc9d0 2023-11-04T01:41:02.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.032+0000 7f2e8a16c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e84143650 con 0x7f2e840cc520 2023-11-04T01:41:02.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.032+0000 7f2e83fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e84153850 0x7f2e84142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.032+0000 7f2e83fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e84153850 0x7f2e84142490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54836/0 (socket says 172.21.15.77:54836) 2023-11-04T01:41:02.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.032+0000 7f2e83fff640 1 -- 172.21.15.77:0/536505801 learned_addr learned my addr 172.21.15.77:0/536505801 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:02.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.033+0000 7f2e82ffd640 1 --2- 172.21.15.77:0/536505801 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e840cc9d0 0x7f2e8415c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.033+0000 7f2e837fe640 1 --2- 172.21.15.77:0/536505801 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e840cc520 0x7f2e8415bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.033+0000 7f2e83fff640 1 -- 172.21.15.77:0/536505801 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e840cc520 msgr2=0x7f2e8415bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.033+0000 7f2e83fff640 1 --2- 172.21.15.77:0/536505801 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e840cc520 0x7f2e8415bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.033+0000 7f2e83fff640 1 -- 172.21.15.77:0/536505801 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e840cc9d0 msgr2=0x7f2e8415c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.033+0000 7f2e83fff640 1 --2- 172.21.15.77:0/536505801 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e840cc9d0 0x7f2e8415c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.033+0000 7f2e83fff640 1 -- 172.21.15.77:0/536505801 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7c009a70 con 0x7f2e84153850 2023-11-04T01:41:02.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.033+0000 7f2e83fff640 1 --2- 172.21.15.77:0/536505801 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e84153850 0x7f2e84142490 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009d90 tx=0x7f2e7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:02.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.033+0000 7f2e6bfff640 1 -- 172.21.15.77:0/536505801 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c03e610 con 0x7f2e84153850 2023-11-04T01:41:02.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.033+0000 7f2e6bfff640 1 -- 172.21.15.77:0/536505801 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e7c03e790 con 0x7f2e84153850 2023-11-04T01:41:02.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.033+0000 7f2e8a16c640 1 -- 172.21.15.77:0/536505801 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e84143930 con 0x7f2e84153850 2023-11-04T01:41:02.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.033+0000 7f2e6bfff640 1 -- 172.21.15.77:0/536505801 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c03eb40 con 0x7f2e84153850 2023-11-04T01:41:02.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.033+0000 7f2e8a16c640 1 -- 172.21.15.77:0/536505801 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e840cbe30 con 0x7f2e84153850 2023-11-04T01:41:02.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.034+0000 7f2e8a16c640 1 -- 172.21.15.77:0/536505801 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e84074290 con 0x7f2e84153850 2023-11-04T01:41:02.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.034+0000 7f2e6bfff640 1 -- 172.21.15.77:0/536505801 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2e7c03b050 con 0x7f2e84153850 2023-11-04T01:41:02.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.035+0000 7f2e6bfff640 1 --2- 172.21.15.77:0/536505801 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2e7006aea0 0x7f2e7006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.035+0000 7f2e6bfff640 1 -- 172.21.15.77:0/536505801 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2e7c0abf70 con 0x7f2e84153850 2023-11-04T01:41:02.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.035+0000 7f2e837fe640 1 --2- 172.21.15.77:0/536505801 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2e7006aea0 0x7f2e7006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.035+0000 7f2e837fe640 1 --2- 172.21.15.77:0/536505801 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2e7006aea0 0x7f2e7006d360 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2e74007fd0 tx=0x7f2e74007de0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:02.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.039+0000 7f2e6bfff640 1 -- 172.21.15.77:0/536505801 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2e7c0deca0 con 0x7f2e84153850 2023-11-04T01:41:02.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.205+0000 7f2e8a16c640 1 -- 172.21.15.77:0/536505801 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2e84070d80 con 0x7f2e84153850 2023-11-04T01:41:02.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.206+0000 7f2e6bfff640 1 -- 172.21.15.77:0/536505801 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2e7c076d10 con 0x7f2e84153850 2023-11-04T01:41:02.208 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:41:02.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.207+0000 7f2e8a16c640 1 -- 172.21.15.77:0/536505801 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2e7006aea0 msgr2=0x7f2e7006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.208+0000 7f2e8a16c640 1 --2- 172.21.15.77:0/536505801 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2e7006aea0 0x7f2e7006d360 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2e74007fd0 tx=0x7f2e74007de0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.208+0000 7f2e8a16c640 1 -- 172.21.15.77:0/536505801 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e84153850 msgr2=0x7f2e84142490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.208+0000 7f2e8a16c640 1 --2- 172.21.15.77:0/536505801 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e84153850 0x7f2e84142490 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009d90 tx=0x7f2e7c004a40 comp rx=0 tx=0).stop 2023-11-04T01:41:02.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.208+0000 7f2e8a16c640 1 -- 172.21.15.77:0/536505801 shutdown_connections 2023-11-04T01:41:02.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.208+0000 7f2e8a16c640 1 --2- 172.21.15.77:0/536505801 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2e7006aea0 0x7f2e7006d360 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.208+0000 7f2e8a16c640 1 --2- 172.21.15.77:0/536505801 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e84153850 0x7f2e84142490 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.208+0000 7f2e8a16c640 1 --2- 172.21.15.77:0/536505801 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e840cc9d0 0x7f2e8415c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.208+0000 7f2e8a16c640 1 --2- 172.21.15.77:0/536505801 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e840cc520 0x7f2e8415bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.208+0000 7f2e8a16c640 1 -- 172.21.15.77:0/536505801 >> 172.21.15.77:0/536505801 conn(0x7f2e840ce950 msgr2=0x7f2e840c4580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:02.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.208+0000 7f2e8a16c640 1 -- 172.21.15.77:0/536505801 shutdown_connections 2023-11-04T01:41:02.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.208+0000 7f2e8a16c640 1 -- 172.21.15.77:0/536505801 wait complete. 2023-11-04T01:41:02.220 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:41:02.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.320+0000 7fc78706f640 1 Processor -- start 2023-11-04T01:41:02.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.320+0000 7fc78706f640 1 -- start start 2023-11-04T01:41:02.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.321+0000 7fc78706f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc7800cccc0 0x7fc78006c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.321+0000 7fc78706f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc78006ca40 con 0x7fc780160430 2023-11-04T01:41:02.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.321+0000 7fc78706f640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc78006cd20 con 0x7fc7800b2d30 2023-11-04T01:41:02.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.321+0000 7fc78706f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7800cb580 con 0x7fc7800cccc0 2023-11-04T01:41:02.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.321+0000 7fc78560c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc7800cccc0 0x7fc78006c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.321+0000 7fc784e0b640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc780160430 0x7fc7800b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52716/0 (socket says 172.21.15.77:52716) 2023-11-04T01:41:02.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.321+0000 7fc784e0b640 1 -- 172.21.15.77:0/3827366134 learned_addr learned my addr 172.21.15.77:0/3827366134 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:02.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.321+0000 7fc78560c640 1 -- 172.21.15.77:0/3827366134 >> v1:172.21.15.122:6789/0 conn(0x7fc7800b2d30 legacy=0x7fc78006bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:02.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.321+0000 7fc78560c640 1 -- 172.21.15.77:0/3827366134 >> v1:172.21.15.77:6789/0 conn(0x7fc780160430 legacy=0x7fc7800b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.321+0000 7fc78560c640 1 -- 172.21.15.77:0/3827366134 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78006d000 con 0x7fc7800cccc0 2023-11-04T01:41:02.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.321+0000 7fc77f7fe640 1 -- 172.21.15.77:0/3827366134 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3355318283 0 0) 0x7fc78006ca40 con 0x7fc780160430 2023-11-04T01:41:02.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.322+0000 7fc78560c640 1 --2- 172.21.15.77:0/3827366134 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7800cccc0 0x7fc78006c3a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc778009d90 tx=0x7fc77802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9067f7a2f20086d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:02.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.322+0000 7fc77f7fe640 1 -- 172.21.15.77:0/3827366134 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77802cc60 con 0x7fc7800cccc0 2023-11-04T01:41:02.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.322+0000 7fc77f7fe640 1 -- 172.21.15.77:0/3827366134 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77802cdc0 con 0x7fc7800cccc0 2023-11-04T01:41:02.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.322+0000 7fc77f7fe640 1 -- 172.21.15.77:0/3827366134 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc778034660 con 0x7fc7800cccc0 2023-11-04T01:41:02.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.323+0000 7fc78706f640 1 -- 172.21.15.77:0/3827366134 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7800cccc0 msgr2=0x7fc78006c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.323+0000 7fc78706f640 1 --2- 172.21.15.77:0/3827366134 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7800cccc0 0x7fc78006c3a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc778009d90 tx=0x7fc77802beb0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.323+0000 7fc78706f640 1 -- 172.21.15.77:0/3827366134 shutdown_connections 2023-11-04T01:41:02.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.323+0000 7fc78706f640 1 --2- 172.21.15.77:0/3827366134 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7800cccc0 0x7fc78006c3a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.323+0000 7fc78706f640 1 -- 172.21.15.77:0/3827366134 >> 172.21.15.77:0/3827366134 conn(0x7fc78006ea20 msgr2=0x7fc78006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:02.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.323+0000 7fc78706f640 1 -- 172.21.15.77:0/3827366134 shutdown_connections 2023-11-04T01:41:02.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.323+0000 7fc78706f640 1 -- 172.21.15.77:0/3827366134 wait complete. 2023-11-04T01:41:02.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.324+0000 7fc78706f640 1 Processor -- start 2023-11-04T01:41:02.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.324+0000 7fc78706f640 1 -- start start 2023-11-04T01:41:02.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.325+0000 7fc78706f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7800b2d30 0x7fc7800c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.325+0000 7fc78706f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7800cccc0 0x7fc78014d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.325+0000 7fc78706f640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc780160430 0x7fc7800ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.325+0000 7fc78706f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7800b06f0 con 0x7fc7800b2d30 2023-11-04T01:41:02.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.325+0000 7fc78706f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78014dc60 con 0x7fc7800cccc0 2023-11-04T01:41:02.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.325+0000 7fc78706f640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7800b0940 con 0x7fc780160430 2023-11-04T01:41:02.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.325+0000 7fc784e0b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7800b2d30 0x7fc7800c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.325+0000 7fc784e0b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7800b2d30 0x7fc7800c8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54850/0 (socket says 172.21.15.77:54850) 2023-11-04T01:41:02.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.325+0000 7fc784e0b640 1 -- 172.21.15.77:0/1706360754 learned_addr learned my addr 172.21.15.77:0/1706360754 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:02.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.325+0000 7fc77ffff640 1 --2- 172.21.15.77:0/1706360754 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7800cccc0 0x7fc78014d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.325+0000 7fc78560c640 1 --2- 172.21.15.77:0/1706360754 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc780160430 0x7fc7800ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.325+0000 7fc784e0b640 1 -- 172.21.15.77:0/1706360754 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc780160430 msgr2=0x7fc7800ca4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.325+0000 7fc784e0b640 1 --2- 172.21.15.77:0/1706360754 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc780160430 0x7fc7800ca4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.325+0000 7fc784e0b640 1 -- 172.21.15.77:0/1706360754 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7800cccc0 msgr2=0x7fc78014d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.325+0000 7fc784e0b640 1 --2- 172.21.15.77:0/1706360754 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7800cccc0 0x7fc78014d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.325+0000 7fc784e0b640 1 -- 172.21.15.77:0/1706360754 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc778009a70 con 0x7fc7800b2d30 2023-11-04T01:41:02.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.325+0000 7fc78560c640 1 --2- 172.21.15.77:0/1706360754 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc780160430 0x7fc7800ca4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:02.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.325+0000 7fc784e0b640 1 --2- 172.21.15.77:0/1706360754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7800b2d30 0x7fc7800c8ab0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc77000c430 tx=0x7fc77000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:02.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.326+0000 7fc77d7fa640 1 -- 172.21.15.77:0/1706360754 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7700074e0 con 0x7fc7800b2d30 2023-11-04T01:41:02.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.326+0000 7fc77d7fa640 1 -- 172.21.15.77:0/1706360754 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc770007660 con 0x7fc7800b2d30 2023-11-04T01:41:02.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.326+0000 7fc78706f640 1 -- 172.21.15.77:0/1706360754 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7800b0c20 con 0x7fc7800b2d30 2023-11-04T01:41:02.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.326+0000 7fc77d7fa640 1 -- 172.21.15.77:0/1706360754 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc770004a20 con 0x7fc7800b2d30 2023-11-04T01:41:02.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.326+0000 7fc78706f640 1 -- 172.21.15.77:0/1706360754 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7800b11e0 con 0x7fc7800b2d30 2023-11-04T01:41:02.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.327+0000 7fc78706f640 1 -- 172.21.15.77:0/1706360754 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7800b1400 con 0x7fc7800b2d30 2023-11-04T01:41:02.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.327+0000 7fc77d7fa640 1 -- 172.21.15.77:0/1706360754 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc770004b80 con 0x7fc7800b2d30 2023-11-04T01:41:02.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.327+0000 7fc77d7fa640 1 --2- 172.21.15.77:0/1706360754 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc76c06ae70 0x7fc76c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.328+0000 7fc77d7fa640 1 -- 172.21.15.77:0/1706360754 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc7700897b0 con 0x7fc7800b2d30 2023-11-04T01:41:02.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.328+0000 7fc77ffff640 1 --2- 172.21.15.77:0/1706360754 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc76c06ae70 0x7fc76c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.328+0000 7fc77ffff640 1 --2- 172.21.15.77:0/1706360754 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc76c06ae70 0x7fc76c06d330 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc7800b2540 tx=0x7fc774007e30 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:02.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.332+0000 7fc77d7fa640 1 -- 172.21.15.77:0/1706360754 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc7700544a0 con 0x7fc7800b2d30 2023-11-04T01:41:02.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.510+0000 7fc78706f640 1 -- 172.21.15.77:0/1706360754 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc780074290 con 0x7fc7800b2d30 2023-11-04T01:41:02.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.510+0000 7fc77d7fa640 1 -- 172.21.15.77:0/1706360754 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc770057ac0 con 0x7fc7800b2d30 2023-11-04T01:41:02.512 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-11-04T01:41:02.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.512+0000 7fc78706f640 1 -- 172.21.15.77:0/1706360754 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc76c06ae70 msgr2=0x7fc76c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.512+0000 7fc78706f640 1 --2- 172.21.15.77:0/1706360754 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc76c06ae70 0x7fc76c06d330 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc7800b2540 tx=0x7fc774007e30 comp rx=0 tx=0).stop 2023-11-04T01:41:02.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.512+0000 7fc78706f640 1 -- 172.21.15.77:0/1706360754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7800b2d30 msgr2=0x7fc7800c8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.512+0000 7fc78706f640 1 --2- 172.21.15.77:0/1706360754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7800b2d30 0x7fc7800c8ab0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc77000c430 tx=0x7fc77000c8f0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.512+0000 7fc78706f640 1 -- 172.21.15.77:0/1706360754 shutdown_connections 2023-11-04T01:41:02.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.512+0000 7fc78706f640 1 --2- 172.21.15.77:0/1706360754 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc76c06ae70 0x7fc76c06d330 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.512+0000 7fc78706f640 1 --2- 172.21.15.77:0/1706360754 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc780160430 0x7fc7800ca4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.512+0000 7fc78706f640 1 --2- 172.21.15.77:0/1706360754 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7800cccc0 0x7fc78014d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.512+0000 7fc78706f640 1 --2- 172.21.15.77:0/1706360754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7800b2d30 0x7fc7800c8ab0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.512+0000 7fc78706f640 1 -- 172.21.15.77:0/1706360754 >> 172.21.15.77:0/1706360754 conn(0x7fc78006ea20 msgr2=0x7fc78006c150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:02.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.512+0000 7fc78706f640 1 -- 172.21.15.77:0/1706360754 shutdown_connections 2023-11-04T01:41:02.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.512+0000 7fc78706f640 1 -- 172.21.15.77:0/1706360754 wait complete. 2023-11-04T01:41:02.524 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi122.front.sepia.ceph.com... 2023-11-04T01:41:02.524 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:41:02.525 DEBUG:teuthology.orchestra.run.smithi122:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.1 2023-11-04T01:41:02.593 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:41:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:41:02.593 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi122.stderr:ceph-fuse[94109]: fuse finished with error 0 and tester_r 0 2023-11-04T01:41:02.593 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:41:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:41:02.598 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi122.stderr:2023-11-04T01:41:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:41:02.601 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:41:02.606 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi122.front.sepia.ceph.com 2023-11-04T01:41:02.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:02.607 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:41:02.694 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:41:02.695 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:41:02.711 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:41:02.711 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:41:02.769 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:02.811 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi077.stderr:2023-11-04T01:41:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:41:02.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.906+0000 7f70614c9640 1 Processor -- start 2023-11-04T01:41:02.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.906+0000 7f70614c9640 1 -- start start 2023-11-04T01:41:02.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.907+0000 7f70614c9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f705c06a830 0x7f705c0b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.907+0000 7f70614c9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f705c0b1b80 con 0x7f705c0b14a0 2023-11-04T01:41:02.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.907+0000 7f70614c9640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f705c0b1e60 con 0x7f705c15e1c0 2023-11-04T01:41:02.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.907+0000 7f70614c9640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f705c0b2140 con 0x7f705c06a830 2023-11-04T01:41:02.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.907+0000 7f705b7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f705c0b14a0 0x7f705c0b32d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52718/0 (socket says 172.21.15.77:52718) 2023-11-04T01:41:02.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.907+0000 7f705b7fe640 1 -- 172.21.15.77:0/3858277074 learned_addr learned my addr 172.21.15.77:0/3858277074 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:02.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.907+0000 7f705a7fc640 1 --2- 172.21.15.77:0/3858277074 >> v2:172.21.15.122:3300/0 conn(0x7f705c06a830 0x7f705c0b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.907+0000 7f7059ffb640 1 -- 172.21.15.77:0/3858277074 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1824541430 0 0) 0x7f705c0b1b80 con 0x7f705c0b14a0 2023-11-04T01:41:02.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.907+0000 7f7059ffb640 1 -- 172.21.15.77:0/3858277074 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7044003520 con 0x7f705c0b14a0 2023-11-04T01:41:02.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.908+0000 7f7059ffb640 1 -- 172.21.15.77:0/3858277074 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2760386200 0 0) 0x7f7044003520 con 0x7f705c0b14a0 2023-11-04T01:41:02.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.908+0000 7f7059ffb640 1 -- 172.21.15.77:0/3858277074 >> v2:172.21.15.122:3300/0 conn(0x7f705c06a830 msgr2=0x7f705c0b2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:02.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.908+0000 7f7059ffb640 1 --2- 172.21.15.77:0/3858277074 >> v2:172.21.15.122:3300/0 conn(0x7f705c06a830 0x7f705c0b2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.908+0000 7f7059ffb640 1 -- 172.21.15.77:0/3858277074 >> v1:172.21.15.122:6789/0 conn(0x7f705c15e1c0 legacy=0x7f705c06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.908+0000 7f7059ffb640 1 -- 172.21.15.77:0/3858277074 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705c0ca990 con 0x7f705c0b14a0 2023-11-04T01:41:02.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.908+0000 7f7059ffb640 1 -- 172.21.15.77:0/3858277074 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f7054001670 con 0x7f705c0b14a0 2023-11-04T01:41:02.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.908+0000 7f7059ffb640 1 -- 172.21.15.77:0/3858277074 >> v1:172.21.15.77:6789/0 conn(0x7f705c0b14a0 legacy=0x7f705c0b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.908+0000 7f7059ffb640 1 --2- 172.21.15.77:0/3858277074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7044003970 0x7f7044003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.908+0000 7f7059ffb640 1 --2- 172.21.15.77:0/3858277074 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70440047c0 0x7f7044004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.908+0000 7f7059ffb640 1 --2- 172.21.15.77:0/3858277074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7044005180 0x7f704400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.908+0000 7f7059ffb640 1 -- 172.21.15.77:0/3858277074 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705c0b2140 con 0x7f7044003970 2023-11-04T01:41:02.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.908+0000 7f7059ffb640 1 -- 172.21.15.77:0/3858277074 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704400c020 con 0x7f7044005180 2023-11-04T01:41:02.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.908+0000 7f7059ffb640 1 -- 172.21.15.77:0/3858277074 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f704400c1e0 con 0x7f70440047c0 2023-11-04T01:41:02.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.908+0000 7f705affd640 1 --2- 172.21.15.77:0/3858277074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7044003970 0x7f7044003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.908+0000 7f705b7fe640 1 --2- 172.21.15.77:0/3858277074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7044005180 0x7f704400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.908+0000 7f705a7fc640 1 --2- 172.21.15.77:0/3858277074 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70440047c0 0x7f7044004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.908+0000 7f705affd640 1 -- 172.21.15.77:0/3858277074 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70440047c0 msgr2=0x7f7044004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:02.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.908+0000 7f705affd640 1 --2- 172.21.15.77:0/3858277074 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70440047c0 0x7f7044004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.908+0000 7f705affd640 1 -- 172.21.15.77:0/3858277074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7044005180 msgr2=0x7f704400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:02.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.908+0000 7f705affd640 1 --2- 172.21.15.77:0/3858277074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7044005180 0x7f704400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.908+0000 7f705affd640 1 -- 172.21.15.77:0/3858277074 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7044003520 con 0x7f7044003970 2023-11-04T01:41:02.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.908+0000 7f705b7fe640 1 -- 172.21.15.77:0/3858277074 reap_dead start 2023-11-04T01:41:02.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.909+0000 7f705affd640 1 --2- 172.21.15.77:0/3858277074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7044003970 0x7f7044003d90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f704c001e50 tx=0x7f70440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb0d04d03b3ce2d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:02.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.909+0000 7f7059ffb640 1 -- 172.21.15.77:0/3858277074 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704c003b70 con 0x7f7044003970 2023-11-04T01:41:02.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.909+0000 7f7059ffb640 1 -- 172.21.15.77:0/3858277074 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704c003cd0 con 0x7f7044003970 2023-11-04T01:41:02.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.909+0000 7f7059ffb640 1 -- 172.21.15.77:0/3858277074 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704c005310 con 0x7f7044003970 2023-11-04T01:41:02.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.909+0000 7f70614c9640 1 -- 172.21.15.77:0/3858277074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7044003970 msgr2=0x7f7044003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.909+0000 7f70614c9640 1 --2- 172.21.15.77:0/3858277074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7044003970 0x7f7044003d90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f704c001e50 tx=0x7f70440057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.909+0000 7f70614c9640 1 -- 172.21.15.77:0/3858277074 shutdown_connections 2023-11-04T01:41:02.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.909+0000 7f70614c9640 1 --2- 172.21.15.77:0/3858277074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7044003970 0x7f7044003d90 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.909+0000 7f70614c9640 1 -- 172.21.15.77:0/3858277074 >> 172.21.15.77:0/3858277074 conn(0x7f705c06d8b0 msgr2=0x7f705c06dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:02.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.910+0000 7f70614c9640 1 -- 172.21.15.77:0/3858277074 shutdown_connections 2023-11-04T01:41:02.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.910+0000 7f70614c9640 1 -- 172.21.15.77:0/3858277074 wait complete. 2023-11-04T01:41:02.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.911+0000 7f70614c9640 1 Processor -- start 2023-11-04T01:41:02.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.911+0000 7f70614c9640 1 -- start start 2023-11-04T01:41:02.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.912+0000 7f70614c9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7044003970 0x7f705c0c6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.912+0000 7f70614c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f705c0c3550 0x7f705c1512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.912+0000 7f70614c9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f705c0afe90 0x7f705c0b0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.912+0000 7f70614c9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705c1f0f40 con 0x7f705c0c3550 2023-11-04T01:41:02.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.912+0000 7f70614c9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705c0b0850 con 0x7f7044003970 2023-11-04T01:41:02.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.912+0000 7f70614c9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705c0c4ac0 con 0x7f705c0afe90 2023-11-04T01:41:02.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.912+0000 7f705a7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f705c0c3550 0x7f705c1512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.912+0000 7f705a7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f705c0c3550 0x7f705c1512f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54860/0 (socket says 172.21.15.77:54860) 2023-11-04T01:41:02.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.912+0000 7f705a7fc640 1 -- 172.21.15.77:0/2756080997 learned_addr learned my addr 172.21.15.77:0/2756080997 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:02.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.912+0000 7f705affd640 1 --2- 172.21.15.77:0/2756080997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7044003970 0x7f705c0c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.912+0000 7f705b7fe640 1 --2- 172.21.15.77:0/2756080997 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f705c0afe90 0x7f705c0b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.912+0000 7f705a7fc640 1 -- 172.21.15.77:0/2756080997 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f705c0afe90 msgr2=0x7f705c0b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.912+0000 7f705a7fc640 1 --2- 172.21.15.77:0/2756080997 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f705c0afe90 0x7f705c0b0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.912+0000 7f705a7fc640 1 -- 172.21.15.77:0/2756080997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7044003970 msgr2=0x7f705c0c6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:02.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.912+0000 7f705a7fc640 1 --2- 172.21.15.77:0/2756080997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7044003970 0x7f705c0c6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:02.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.912+0000 7f705a7fc640 1 -- 172.21.15.77:0/2756080997 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705c1f11c0 con 0x7f705c0c3550 2023-11-04T01:41:02.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.912+0000 7f705affd640 1 --2- 172.21.15.77:0/2756080997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7044003970 0x7f705c0c6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:02.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.912+0000 7f705b7fe640 1 --2- 172.21.15.77:0/2756080997 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f705c0afe90 0x7f705c0b0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:02.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.912+0000 7f705a7fc640 1 --2- 172.21.15.77:0/2756080997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f705c0c3550 0x7f705c1512f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7050011910 tx=0x7f7050011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:02.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.912+0000 7f70437fe640 1 -- 172.21.15.77:0/2756080997 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705000fa90 con 0x7f705c0c3550 2023-11-04T01:41:02.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.912+0000 7f70437fe640 1 -- 172.21.15.77:0/2756080997 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705000fbf0 con 0x7f705c0c3550 2023-11-04T01:41:02.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.912+0000 7f70437fe640 1 -- 172.21.15.77:0/2756080997 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7050014440 con 0x7f705c0c3550 2023-11-04T01:41:02.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.912+0000 7f70614c9640 1 -- 172.21.15.77:0/2756080997 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f705c1f0000 con 0x7f705c0c3550 2023-11-04T01:41:02.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.912+0000 7f70614c9640 1 -- 172.21.15.77:0/2756080997 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f705c1f05a0 con 0x7f705c0c3550 2023-11-04T01:41:02.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.913+0000 7f70614c9640 1 -- 172.21.15.77:0/2756080997 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f705c0b0af0 con 0x7f705c0c3550 2023-11-04T01:41:02.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.914+0000 7f70437fe640 1 -- 172.21.15.77:0/2756080997 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f70500145a0 con 0x7f705c0c3550 2023-11-04T01:41:02.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.914+0000 7f70437fe640 1 --2- 172.21.15.77:0/2756080997 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f704806ae70 0x7f704806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:02.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.914+0000 7f70437fe640 1 -- 172.21.15.77:0/2756080997 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f705008a010 con 0x7f705c0c3550 2023-11-04T01:41:02.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.914+0000 7f705affd640 1 --2- 172.21.15.77:0/2756080997 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f704806ae70 0x7f704806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:02.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.915+0000 7f705affd640 1 --2- 172.21.15.77:0/2756080997 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f704806ae70 0x7f704806d330 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f704c034000 tx=0x7f704c009030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:02.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:02.918+0000 7f70437fe640 1 -- 172.21.15.77:0/2756080997 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7050054e40 con 0x7f705c0c3550 2023-11-04T01:41:03.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.085+0000 7f70614c9640 1 -- 172.21.15.77:0/2756080997 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f705c0674e0 con 0x7f705c0c3550 2023-11-04T01:41:03.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.086+0000 7f70437fe640 1 -- 172.21.15.77:0/2756080997 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18661 (secure 0 0 0) 0x7f7050022090 con 0x7f705c0c3550 2023-11-04T01:41:03.088 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:03.089 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":26,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:40:47.579547+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:40:02.810971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:40:04.003979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:40:07.734355+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:03.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.088+0000 7f70614c9640 1 -- 172.21.15.77:0/2756080997 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f704806ae70 msgr2=0x7f704806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.088+0000 7f70614c9640 1 --2- 172.21.15.77:0/2756080997 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f704806ae70 0x7f704806d330 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f704c034000 tx=0x7f704c009030 comp rx=0 tx=0).stop 2023-11-04T01:41:03.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.088+0000 7f70614c9640 1 -- 172.21.15.77:0/2756080997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f705c0c3550 msgr2=0x7f705c1512f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.088+0000 7f70614c9640 1 --2- 172.21.15.77:0/2756080997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f705c0c3550 0x7f705c1512f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7050011910 tx=0x7f7050011dd0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.089+0000 7f70614c9640 1 -- 172.21.15.77:0/2756080997 shutdown_connections 2023-11-04T01:41:03.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.089+0000 7f70614c9640 1 --2- 172.21.15.77:0/2756080997 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f704806ae70 0x7f704806d330 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.089+0000 7f70614c9640 1 --2- 172.21.15.77:0/2756080997 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f705c0afe90 0x7f705c0b0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.089+0000 7f70614c9640 1 --2- 172.21.15.77:0/2756080997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f705c0c3550 0x7f705c1512f0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.089+0000 7f70614c9640 1 --2- 172.21.15.77:0/2756080997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7044003970 0x7f705c0c6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.089+0000 7f70614c9640 1 -- 172.21.15.77:0/2756080997 >> 172.21.15.77:0/2756080997 conn(0x7f705c06d8b0 msgr2=0x7f705c06a120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:03.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.089+0000 7f70614c9640 1 -- 172.21.15.77:0/2756080997 shutdown_connections 2023-11-04T01:41:03.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.089+0000 7f70614c9640 1 -- 172.21.15.77:0/2756080997 wait complete. 2023-11-04T01:41:03.101 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:40:02.810971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:40:04.003979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:40:07.734355+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:41:03.102 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:41:03.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.202+0000 7fe6ca207640 1 Processor -- start 2023-11-04T01:41:03.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.203+0000 7fe6ca207640 1 -- start start 2023-11-04T01:41:03.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.203+0000 7fe6ca207640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe6c4153e60 0x7fe6c415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.203+0000 7fe6ca207640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe6c40b4880 0x7fe6c40b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.203+0000 7fe6ca207640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6c40cde60 con 0x7fe6c40cd6d0 2023-11-04T01:41:03.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.203+0000 7fe6ca207640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6c4160f90 con 0x7fe6c40b4880 2023-11-04T01:41:03.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.203+0000 7fe6ca207640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6c40b5200 con 0x7fe6c4153e60 2023-11-04T01:41:03.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.203+0000 7fe6c3fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe6c40b4880 0x7fe6c40b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.203+0000 7fe6c2ffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe6c40cd6d0 0x7fe6c4161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52730/0 (socket says 172.21.15.77:52730) 2023-11-04T01:41:03.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.204+0000 7fe6c2ffd640 1 -- 172.21.15.77:0/1130568321 learned_addr learned my addr 172.21.15.77:0/1130568321 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:03.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.204+0000 7fe6c3fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe6c40b4880 0x7fe6c40b4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54876/0 (socket says 172.21.15.77:54876) 2023-11-04T01:41:03.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.204+0000 7fe6c37fe640 1 --2- 172.21.15.77:0/1130568321 >> v2:172.21.15.122:3300/0 conn(0x7fe6c4153e60 0x7fe6c415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.204+0000 7fe6c3fff640 1 -- 172.21.15.77:0/1130568321 >> v2:172.21.15.122:3300/0 conn(0x7fe6c4153e60 msgr2=0x7fe6c415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:03.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.204+0000 7fe6c3fff640 1 --2- 172.21.15.77:0/1130568321 >> v2:172.21.15.122:3300/0 conn(0x7fe6c4153e60 0x7fe6c415dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.204+0000 7fe6c3fff640 1 -- 172.21.15.77:0/1130568321 >> v1:172.21.15.77:6789/0 conn(0x7fe6c40cd6d0 legacy=0x7fe6c4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.204+0000 7fe6c3fff640 1 -- 172.21.15.77:0/1130568321 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c415e400 con 0x7fe6c40b4880 2023-11-04T01:41:03.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.204+0000 7fe6c27fc640 1 -- 172.21.15.77:0/1130568321 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2089251310 0 0) 0x7fe6c40cde60 con 0x7fe6c40cd6d0 2023-11-04T01:41:03.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.204+0000 7fe6c37fe640 1 --2- 172.21.15.77:0/1130568321 >> v2:172.21.15.122:3300/0 conn(0x7fe6c4153e60 0x7fe6c415dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:03.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.204+0000 7fe6c3fff640 1 --2- 172.21.15.77:0/1130568321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6c40b4880 0x7fe6c40b4cc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe6c408abe0 tx=0x7fe6bc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74f2eb781cb838e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:03.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.205+0000 7fe6c27fc640 1 -- 172.21.15.77:0/1130568321 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc02cc80 con 0x7fe6c40b4880 2023-11-04T01:41:03.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.205+0000 7fe6c27fc640 1 -- 172.21.15.77:0/1130568321 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6bc02cde0 con 0x7fe6c40b4880 2023-11-04T01:41:03.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.205+0000 7fe6c27fc640 1 -- 172.21.15.77:0/1130568321 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc034660 con 0x7fe6c40b4880 2023-11-04T01:41:03.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.205+0000 7fe6ca207640 1 -- 172.21.15.77:0/1130568321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6c40b4880 msgr2=0x7fe6c40b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.205+0000 7fe6ca207640 1 --2- 172.21.15.77:0/1130568321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6c40b4880 0x7fe6c40b4cc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe6c408abe0 tx=0x7fe6bc02bed0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.205+0000 7fe6ca207640 1 -- 172.21.15.77:0/1130568321 shutdown_connections 2023-11-04T01:41:03.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.205+0000 7fe6ca207640 1 --2- 172.21.15.77:0/1130568321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6c40b4880 0x7fe6c40b4cc0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.205+0000 7fe6ca207640 1 --2- 172.21.15.77:0/1130568321 >> v2:172.21.15.122:3300/0 conn(0x7fe6c4153e60 0x7fe6c415dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.205+0000 7fe6ca207640 1 -- 172.21.15.77:0/1130568321 >> 172.21.15.77:0/1130568321 conn(0x7fe6c40cf880 msgr2=0x7fe6c40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:03.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.205+0000 7fe6ca207640 1 -- 172.21.15.77:0/1130568321 shutdown_connections 2023-11-04T01:41:03.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.205+0000 7fe6ca207640 1 -- 172.21.15.77:0/1130568321 wait complete. 2023-11-04T01:41:03.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.206+0000 7fe6ca207640 1 Processor -- start 2023-11-04T01:41:03.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.207+0000 7fe6ca207640 1 -- start start 2023-11-04T01:41:03.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.207+0000 7fe6ca207640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe6c40b4880 0x7fe6c4145110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.207+0000 7fe6ca207640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6c40cd6d0 0x7fe6c41525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.207+0000 7fe6ca207640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe6c4153e60 0x7fe6c4156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.207+0000 7fe6ca207640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c4155890 con 0x7fe6c40cd6d0 2023-11-04T01:41:03.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.207+0000 7fe6ca207640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c4152b20 con 0x7fe6c4153e60 2023-11-04T01:41:03.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.207+0000 7fe6ca207640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c4155ac0 con 0x7fe6c40b4880 2023-11-04T01:41:03.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.207+0000 7fe6c2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6c40cd6d0 0x7fe6c41525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.207+0000 7fe6c2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6c40cd6d0 0x7fe6c41525e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54890/0 (socket says 172.21.15.77:54890) 2023-11-04T01:41:03.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.207+0000 7fe6c2ffd640 1 -- 172.21.15.77:0/3548190279 learned_addr learned my addr 172.21.15.77:0/3548190279 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:03.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.207+0000 7fe6c37fe640 1 --2- 172.21.15.77:0/3548190279 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe6c40b4880 0x7fe6c4145110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.207+0000 7fe6c3fff640 1 --2- 172.21.15.77:0/3548190279 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe6c4153e60 0x7fe6c4156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.208+0000 7fe6c2ffd640 1 -- 172.21.15.77:0/3548190279 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe6c40b4880 msgr2=0x7fe6c4145110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.208+0000 7fe6c2ffd640 1 --2- 172.21.15.77:0/3548190279 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe6c40b4880 0x7fe6c4145110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.208+0000 7fe6c2ffd640 1 -- 172.21.15.77:0/3548190279 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe6c4153e60 msgr2=0x7fe6c4156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.208+0000 7fe6c2ffd640 1 --2- 172.21.15.77:0/3548190279 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe6c4153e60 0x7fe6c4156b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.208+0000 7fe6c2ffd640 1 -- 172.21.15.77:0/3548190279 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6bc009a70 con 0x7fe6c40cd6d0 2023-11-04T01:41:03.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.208+0000 7fe6c2ffd640 1 --2- 172.21.15.77:0/3548190279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6c40cd6d0 0x7fe6c41525e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe6b400c4b0 tx=0x7fe6b400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:03.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.208+0000 7fe6abfff640 1 -- 172.21.15.77:0/3548190279 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b40074e0 con 0x7fe6c40cd6d0 2023-11-04T01:41:03.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.208+0000 7fe6abfff640 1 -- 172.21.15.77:0/3548190279 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b4007660 con 0x7fe6c40cd6d0 2023-11-04T01:41:03.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.208+0000 7fe6ca207640 1 -- 172.21.15.77:0/3548190279 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6c4155da0 con 0x7fe6c40cd6d0 2023-11-04T01:41:03.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.208+0000 7fe6abfff640 1 -- 172.21.15.77:0/3548190279 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b4004a20 con 0x7fe6c40cd6d0 2023-11-04T01:41:03.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.208+0000 7fe6ca207640 1 -- 172.21.15.77:0/3548190279 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6c4156360 con 0x7fe6c40cd6d0 2023-11-04T01:41:03.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.209+0000 7fe6ca207640 1 -- 172.21.15.77:0/3548190279 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6c40c5e10 con 0x7fe6c40cd6d0 2023-11-04T01:41:03.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.209+0000 7fe6abfff640 1 -- 172.21.15.77:0/3548190279 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe6b4004b80 con 0x7fe6c40cd6d0 2023-11-04T01:41:03.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.210+0000 7fe6abfff640 1 --2- 172.21.15.77:0/3548190279 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe6b006ae70 0x7fe6b006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.210+0000 7fe6abfff640 1 -- 172.21.15.77:0/3548190279 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe6b4088e00 con 0x7fe6c40cd6d0 2023-11-04T01:41:03.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.210+0000 7fe6c37fe640 1 --2- 172.21.15.77:0/3548190279 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe6b006ae70 0x7fe6b006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.210+0000 7fe6c37fe640 1 --2- 172.21.15.77:0/3548190279 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe6b006ae70 0x7fe6b006d330 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe6b800aac0 tx=0x7fe6b8008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:03.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.214+0000 7fe6abfff640 1 -- 172.21.15.77:0/3548190279 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe6b4053cf0 con 0x7fe6c40cd6d0 2023-11-04T01:41:03.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.377+0000 7fe6ca207640 1 -- 172.21.15.77:0/3548190279 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe6c4074290 con 0x7fe6c40cd6d0 2023-11-04T01:41:03.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.377+0000 7fe6abfff640 1 -- 172.21.15.77:0/3548190279 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe6b4018020 con 0x7fe6c40cd6d0 2023-11-04T01:41:03.379 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:41:03.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.379+0000 7fe6ca207640 1 -- 172.21.15.77:0/3548190279 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe6b006ae70 msgr2=0x7fe6b006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.379+0000 7fe6ca207640 1 --2- 172.21.15.77:0/3548190279 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe6b006ae70 0x7fe6b006d330 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe6b800aac0 tx=0x7fe6b8008040 comp rx=0 tx=0).stop 2023-11-04T01:41:03.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.379+0000 7fe6ca207640 1 -- 172.21.15.77:0/3548190279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6c40cd6d0 msgr2=0x7fe6c41525e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.379+0000 7fe6ca207640 1 --2- 172.21.15.77:0/3548190279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6c40cd6d0 0x7fe6c41525e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe6b400c4b0 tx=0x7fe6b400c970 comp rx=0 tx=0).stop 2023-11-04T01:41:03.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.379+0000 7fe6ca207640 1 -- 172.21.15.77:0/3548190279 shutdown_connections 2023-11-04T01:41:03.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.379+0000 7fe6ca207640 1 --2- 172.21.15.77:0/3548190279 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe6b006ae70 0x7fe6b006d330 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.379+0000 7fe6ca207640 1 --2- 172.21.15.77:0/3548190279 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe6c4153e60 0x7fe6c4156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.379+0000 7fe6ca207640 1 --2- 172.21.15.77:0/3548190279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6c40cd6d0 0x7fe6c41525e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.379+0000 7fe6ca207640 1 --2- 172.21.15.77:0/3548190279 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe6c40b4880 0x7fe6c4145110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.379+0000 7fe6ca207640 1 -- 172.21.15.77:0/3548190279 >> 172.21.15.77:0/3548190279 conn(0x7fe6c40cf880 msgr2=0x7fe6c415eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:03.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.379+0000 7fe6ca207640 1 -- 172.21.15.77:0/3548190279 shutdown_connections 2023-11-04T01:41:03.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.379+0000 7fe6ca207640 1 -- 172.21.15.77:0/3548190279 wait complete. 2023-11-04T01:41:03.391 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:41:03.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.491+0000 7f3918658640 1 Processor -- start 2023-11-04T01:41:03.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.491+0000 7f3918658640 1 -- start start 2023-11-04T01:41:03.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.492+0000 7f3918658640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f39100b4fb0 0x7f39100cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.492+0000 7f3918658640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f391015d0a0 0x7f39100cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.492+0000 7f3918658640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3910160df0 con 0x7f391015ccc0 2023-11-04T01:41:03.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.492+0000 7f3918658640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39100ce260 con 0x7f39100b4fb0 2023-11-04T01:41:03.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.492+0000 7f3918658640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39100ce540 con 0x7f391015d0a0 2023-11-04T01:41:03.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.492+0000 7f39163f4640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f391015ccc0 0x7f39100b48a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52744/0 (socket says 172.21.15.77:52744) 2023-11-04T01:41:03.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.492+0000 7f39163f4640 1 -- 172.21.15.77:0/900991245 learned_addr learned my addr 172.21.15.77:0/900991245 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:03.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.493+0000 7f3916bf5640 1 --2- 172.21.15.77:0/900991245 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f391015d0a0 0x7f39100cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.493+0000 7f3915bf3640 1 --2- 172.21.15.77:0/900991245 >> v2:172.21.15.122:3300/0 conn(0x7f39100b4fb0 0x7f39100cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.493+0000 7f39153f2640 1 -- 172.21.15.77:0/900991245 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3067388928 0 0) 0x7f390c001490 con 0x7f391015ccc0 2023-11-04T01:41:03.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.493+0000 7f39153f2640 1 -- 172.21.15.77:0/900991245 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38fc003520 con 0x7f391015ccc0 2023-11-04T01:41:03.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.493+0000 7f39153f2640 1 -- 172.21.15.77:0/900991245 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1619889128 0 0) 0x7f38fc003520 con 0x7f391015ccc0 2023-11-04T01:41:03.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.493+0000 7f39153f2640 1 -- 172.21.15.77:0/900991245 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f391015d0a0 msgr2=0x7f39100cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:03.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.493+0000 7f39153f2640 1 --2- 172.21.15.77:0/900991245 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f391015d0a0 0x7f39100cdbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.493+0000 7f39153f2640 1 -- 172.21.15.77:0/900991245 >> v2:172.21.15.122:3300/0 conn(0x7f39100b4fb0 msgr2=0x7f39100cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:03.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.493+0000 7f39153f2640 1 --2- 172.21.15.77:0/900991245 >> v2:172.21.15.122:3300/0 conn(0x7f39100b4fb0 0x7f39100cd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.493+0000 7f39153f2640 1 -- 172.21.15.77:0/900991245 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39100d1050 con 0x7f391015ccc0 2023-11-04T01:41:03.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.493+0000 7f39153f2640 1 -- 172.21.15.77:0/900991245 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f390c001b80 con 0x7f391015ccc0 2023-11-04T01:41:03.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.493+0000 7f3916bf5640 1 --2- 172.21.15.77:0/900991245 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f391015d0a0 0x7f39100cdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:41:03.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.493+0000 7f39153f2640 1 -- 172.21.15.77:0/900991245 >> v1:172.21.15.77:6789/0 conn(0x7f391015ccc0 legacy=0x7f39100b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.493+0000 7f39153f2640 1 --2- 172.21.15.77:0/900991245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38fc003970 0x7f38fc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.493+0000 7f39153f2640 1 --2- 172.21.15.77:0/900991245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38fc0047c0 0x7f38fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.493+0000 7f39153f2640 1 --2- 172.21.15.77:0/900991245 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f391015d0a0 0x7f38fc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.493+0000 7f39153f2640 1 -- 172.21.15.77:0/900991245 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39100ce260 con 0x7f38fc003970 2023-11-04T01:41:03.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.493+0000 7f39153f2640 1 -- 172.21.15.77:0/900991245 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39100ce540 con 0x7f38fc0047c0 2023-11-04T01:41:03.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.493+0000 7f39153f2640 1 -- 172.21.15.77:0/900991245 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38fc00b980 con 0x7f391015d0a0 2023-11-04T01:41:03.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.493+0000 7f39163f4640 1 --2- 172.21.15.77:0/900991245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38fc003970 0x7f38fc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.493+0000 7f3915bf3640 1 --2- 172.21.15.77:0/900991245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38fc0047c0 0x7f38fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.493+0000 7f3916bf5640 1 --2- 172.21.15.77:0/900991245 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f391015d0a0 0x7f38fc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.493+0000 7f39163f4640 1 -- 172.21.15.77:0/900991245 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f391015d0a0 msgr2=0x7f38fc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:03.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.493+0000 7f39163f4640 1 --2- 172.21.15.77:0/900991245 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f391015d0a0 0x7f38fc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.493+0000 7f39163f4640 1 -- 172.21.15.77:0/900991245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38fc0047c0 msgr2=0x7f38fc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:03.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.493+0000 7f39163f4640 1 --2- 172.21.15.77:0/900991245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38fc0047c0 0x7f38fc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.493+0000 7f39163f4640 1 -- 172.21.15.77:0/900991245 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3908009400 con 0x7f38fc003970 2023-11-04T01:41:03.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.493+0000 7f3915bf3640 1 --2- 172.21.15.77:0/900991245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38fc0047c0 0x7f38fc004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:03.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.493+0000 7f3916bf5640 1 --2- 172.21.15.77:0/900991245 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f391015d0a0 0x7f38fc005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:03.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.494+0000 7f39163f4640 1 --2- 172.21.15.77:0/900991245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38fc003970 0x7f38fc003d90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f390c00a830 tx=0x7f38fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=394462140bf553d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:03.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.494+0000 7f39153f2640 1 -- 172.21.15.77:0/900991245 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c034630 con 0x7f38fc003970 2023-11-04T01:41:03.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.494+0000 7f39153f2640 1 -- 172.21.15.77:0/900991245 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390c02f070 con 0x7f38fc003970 2023-11-04T01:41:03.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.494+0000 7f39153f2640 1 -- 172.21.15.77:0/900991245 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c034a10 con 0x7f38fc003970 2023-11-04T01:41:03.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.495+0000 7f3918658640 1 -- 172.21.15.77:0/900991245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38fc003970 msgr2=0x7f38fc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.495+0000 7f3918658640 1 --2- 172.21.15.77:0/900991245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38fc003970 0x7f38fc003d90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f390c00a830 tx=0x7f38fc0057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.495+0000 7f3916bf5640 1 -- 172.21.15.77:0/900991245 reap_dead start 2023-11-04T01:41:03.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.495+0000 7f3918658640 1 -- 172.21.15.77:0/900991245 shutdown_connections 2023-11-04T01:41:03.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.495+0000 7f3918658640 1 -- 172.21.15.77:0/900991245 >> 172.21.15.77:0/900991245 conn(0x7f39100cf8a0 msgr2=0x7f39100cfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:03.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.495+0000 7f3918658640 1 -- 172.21.15.77:0/900991245 shutdown_connections 2023-11-04T01:41:03.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.495+0000 7f3918658640 1 -- 172.21.15.77:0/900991245 wait complete. 2023-11-04T01:41:03.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.496+0000 7f3918658640 1 Processor -- start 2023-11-04T01:41:03.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.496+0000 7f3918658640 1 -- start start 2023-11-04T01:41:03.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.497+0000 7f3918658640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f38fc003970 0x7f3910150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.497+0000 7f3918658640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3910152d10 0x7f3910154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.497+0000 7f3918658640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3910151560 0x7f391015f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.497+0000 7f3918658640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3910153e90 con 0x7f3910151560 2023-11-04T01:41:03.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.497+0000 7f3918658640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3910153280 con 0x7f3910152d10 2023-11-04T01:41:03.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.497+0000 7f3918658640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3910153560 con 0x7f38fc003970 2023-11-04T01:41:03.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.497+0000 7f3916bf5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3910151560 0x7f391015f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.497+0000 7f3916bf5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3910151560 0x7f391015f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54898/0 (socket says 172.21.15.77:54898) 2023-11-04T01:41:03.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.497+0000 7f3916bf5640 1 -- 172.21.15.77:0/2144120022 learned_addr learned my addr 172.21.15.77:0/2144120022 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:03.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.497+0000 7f3916bf5640 1 -- 172.21.15.77:0/2144120022 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f38fc003970 msgr2=0x7f3910150850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.497+0000 7f3916bf5640 1 --2- 172.21.15.77:0/2144120022 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f38fc003970 0x7f3910150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.497+0000 7f3916bf5640 1 -- 172.21.15.77:0/2144120022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3910152d10 msgr2=0x7f3910154320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.497+0000 7f3916bf5640 1 --2- 172.21.15.77:0/2144120022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3910152d10 0x7f3910154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.497+0000 7f3916bf5640 1 -- 172.21.15.77:0/2144120022 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3910153840 con 0x7f3910151560 2023-11-04T01:41:03.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.497+0000 7f3916bf5640 1 --2- 172.21.15.77:0/2144120022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3910151560 0x7f391015f730 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f391015d510 tx=0x7f39080119f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:03.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.497+0000 7f3906ffd640 1 -- 172.21.15.77:0/2144120022 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3908004440 con 0x7f3910151560 2023-11-04T01:41:03.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.497+0000 7f3906ffd640 1 -- 172.21.15.77:0/2144120022 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3908003610 con 0x7f3910151560 2023-11-04T01:41:03.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.497+0000 7f3918658640 1 -- 172.21.15.77:0/2144120022 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3910153b20 con 0x7f3910151560 2023-11-04T01:41:03.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.497+0000 7f3906ffd640 1 -- 172.21.15.77:0/2144120022 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39080039c0 con 0x7f3910151560 2023-11-04T01:41:03.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.497+0000 7f3918658640 1 -- 172.21.15.77:0/2144120022 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3910151230 con 0x7f3910151560 2023-11-04T01:41:03.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.498+0000 7f3918658640 1 -- 172.21.15.77:0/2144120022 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3910153ce0 con 0x7f3910151560 2023-11-04T01:41:03.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.499+0000 7f3906ffd640 1 -- 172.21.15.77:0/2144120022 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3908003b20 con 0x7f3910151560 2023-11-04T01:41:03.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.499+0000 7f3906ffd640 1 --2- 172.21.15.77:0/2144120022 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f38f406aea0 0x7f38f406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.499+0000 7f3906ffd640 1 -- 172.21.15.77:0/2144120022 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f39080896e0 con 0x7f3910151560 2023-11-04T01:41:03.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.499+0000 7f39163f4640 1 --2- 172.21.15.77:0/2144120022 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f38f406aea0 0x7f38f406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.500+0000 7f39163f4640 1 --2- 172.21.15.77:0/2144120022 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f38f406aea0 0x7f38f406d360 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f390c034000 tx=0x7f390c007000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:03.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.503+0000 7f3906ffd640 1 -- 172.21.15.77:0/2144120022 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3908057ef0 con 0x7f3910151560 2023-11-04T01:41:03.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.669+0000 7f3918658640 1 -- 172.21.15.77:0/2144120022 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3910153fd0 con 0x7f3910151560 2023-11-04T01:41:03.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.669+0000 7f3906ffd640 1 -- 172.21.15.77:0/2144120022 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3908057a80 con 0x7f3910151560 2023-11-04T01:41:03.672 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:41:03.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.671+0000 7f3918658640 1 -- 172.21.15.77:0/2144120022 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f38f406aea0 msgr2=0x7f38f406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.671+0000 7f3918658640 1 --2- 172.21.15.77:0/2144120022 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f38f406aea0 0x7f38f406d360 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f390c034000 tx=0x7f390c007000 comp rx=0 tx=0).stop 2023-11-04T01:41:03.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.671+0000 7f3918658640 1 -- 172.21.15.77:0/2144120022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3910151560 msgr2=0x7f391015f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.671+0000 7f3918658640 1 --2- 172.21.15.77:0/2144120022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3910151560 0x7f391015f730 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f391015d510 tx=0x7f39080119f0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.671+0000 7f3918658640 1 -- 172.21.15.77:0/2144120022 shutdown_connections 2023-11-04T01:41:03.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.671+0000 7f3918658640 1 --2- 172.21.15.77:0/2144120022 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f38f406aea0 0x7f38f406d360 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.671+0000 7f3918658640 1 --2- 172.21.15.77:0/2144120022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3910151560 0x7f391015f730 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.671+0000 7f3918658640 1 --2- 172.21.15.77:0/2144120022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3910152d10 0x7f3910154320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.671+0000 7f3918658640 1 --2- 172.21.15.77:0/2144120022 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f38fc003970 0x7f3910150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.671+0000 7f3918658640 1 -- 172.21.15.77:0/2144120022 >> 172.21.15.77:0/2144120022 conn(0x7f39100cf8a0 msgr2=0x7f39100b7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:03.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.671+0000 7f3918658640 1 -- 172.21.15.77:0/2144120022 shutdown_connections 2023-11-04T01:41:03.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.671+0000 7f3918658640 1 -- 172.21.15.77:0/2144120022 wait complete. 2023-11-04T01:41:03.684 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:41:03.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.785+0000 7f3fa794c640 1 Processor -- start 2023-11-04T01:41:03.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.785+0000 7f3fa794c640 1 -- start start 2023-11-04T01:41:03.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.786+0000 7f3fa794c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3fa0070ff0 0x7f3fa00cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.786+0000 7f3fa794c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fa00c9bf0 con 0x7f3fa015d1b0 2023-11-04T01:41:03.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.786+0000 7f3fa794c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fa00cd890 con 0x7f3fa0066000 2023-11-04T01:41:03.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.786+0000 7f3fa794c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa00cdb30 con 0x7f3fa0070ff0 2023-11-04T01:41:03.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.786+0000 7f3fa4ee7640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f3fa015d1b0 0x7f3fa00713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52748/0 (socket says 172.21.15.77:52748) 2023-11-04T01:41:03.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.786+0000 7f3fa4ee7640 1 -- 172.21.15.77:0/368959709 learned_addr learned my addr 172.21.15.77:0/368959709 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:03.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.786+0000 7f3f97fff640 1 -- 172.21.15.77:0/368959709 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3116372627 0 0) 0x7f3fa00c9bf0 con 0x7f3fa015d1b0 2023-11-04T01:41:03.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.786+0000 7f3f97fff640 1 -- 172.21.15.77:0/368959709 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f8c003520 con 0x7f3fa015d1b0 2023-11-04T01:41:03.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.786+0000 7f3fa56e8640 1 --2- 172.21.15.77:0/368959709 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3fa0070ff0 0x7f3fa00cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.786+0000 7f3f97fff640 1 -- 172.21.15.77:0/368959709 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 601552904 0 0) 0x7f3f8c003520 con 0x7f3fa015d1b0 2023-11-04T01:41:03.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.786+0000 7f3f97fff640 1 -- 172.21.15.77:0/368959709 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3fa0070ff0 msgr2=0x7f3fa00cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:03.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.786+0000 7f3f97fff640 1 --2- 172.21.15.77:0/368959709 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3fa0070ff0 0x7f3fa00cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.786+0000 7f3f97fff640 1 -- 172.21.15.77:0/368959709 >> v1:172.21.15.122:6789/0 conn(0x7f3fa0066000 legacy=0x7f3fa006a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.786+0000 7f3f97fff640 1 -- 172.21.15.77:0/368959709 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa00cde10 con 0x7f3fa015d1b0 2023-11-04T01:41:03.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.786+0000 7f3f97fff640 1 -- 172.21.15.77:0/368959709 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f3f90001670 con 0x7f3fa015d1b0 2023-11-04T01:41:03.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.786+0000 7f3f97fff640 1 -- 172.21.15.77:0/368959709 >> v1:172.21.15.77:6789/0 conn(0x7f3fa015d1b0 legacy=0x7f3fa00713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.786+0000 7f3f97fff640 1 --2- 172.21.15.77:0/368959709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f8c0039a0 0x7f3f8c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.786+0000 7f3f97fff640 1 --2- 172.21.15.77:0/368959709 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3fa0070ff0 0x7f3f8c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.786+0000 7f3f97fff640 1 --2- 172.21.15.77:0/368959709 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f8c004d00 0x7f3f8c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.786+0000 7f3f97fff640 1 -- 172.21.15.77:0/368959709 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa00cdb30 con 0x7f3f8c0039a0 2023-11-04T01:41:03.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.786+0000 7f3f97fff640 1 -- 172.21.15.77:0/368959709 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c00ba30 con 0x7f3f8c004d00 2023-11-04T01:41:03.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.786+0000 7f3f97fff640 1 -- 172.21.15.77:0/368959709 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c00bbf0 con 0x7f3fa0070ff0 2023-11-04T01:41:03.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.786+0000 7f3fa56e8640 1 --2- 172.21.15.77:0/368959709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f8c0039a0 0x7f3f8c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.787+0000 7f3fa4ee7640 1 --2- 172.21.15.77:0/368959709 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3fa0070ff0 0x7f3f8c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.787+0000 7f3fa5ee9640 1 --2- 172.21.15.77:0/368959709 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f8c004d00 0x7f3f8c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.787+0000 7f3fa56e8640 1 -- 172.21.15.77:0/368959709 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3fa0070ff0 msgr2=0x7f3f8c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:03.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.787+0000 7f3fa56e8640 1 --2- 172.21.15.77:0/368959709 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3fa0070ff0 0x7f3f8c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.787+0000 7f3fa56e8640 1 -- 172.21.15.77:0/368959709 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f8c004d00 msgr2=0x7f3f8c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:03.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.787+0000 7f3fa56e8640 1 --2- 172.21.15.77:0/368959709 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f8c004d00 0x7f3f8c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.787+0000 7f3fa56e8640 1 -- 172.21.15.77:0/368959709 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f8c003520 con 0x7f3f8c0039a0 2023-11-04T01:41:03.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.787+0000 7f3fa4ee7640 1 --2- 172.21.15.77:0/368959709 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3fa0070ff0 0x7f3f8c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:03.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.787+0000 7f3fa56e8640 1 --2- 172.21.15.77:0/368959709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f8c0039a0 0x7f3f8c003dc0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c009a90 tx=0x7f3f8c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84812ea46837fc9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:03.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.787+0000 7f3f97fff640 1 -- 172.21.15.77:0/368959709 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c02c680 con 0x7f3f8c0039a0 2023-11-04T01:41:03.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.787+0000 7f3f97fff640 1 -- 172.21.15.77:0/368959709 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9c02c7e0 con 0x7f3f8c0039a0 2023-11-04T01:41:03.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.788+0000 7f3f97fff640 1 -- 172.21.15.77:0/368959709 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c02cb70 con 0x7f3f8c0039a0 2023-11-04T01:41:03.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.788+0000 7f3fa794c640 1 -- 172.21.15.77:0/368959709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f8c0039a0 msgr2=0x7f3f8c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.788+0000 7f3fa794c640 1 --2- 172.21.15.77:0/368959709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f8c0039a0 0x7f3f8c003dc0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c009a90 tx=0x7f3f8c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.788+0000 7f3fa5ee9640 1 -- 172.21.15.77:0/368959709 reap_dead start 2023-11-04T01:41:03.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.788+0000 7f3fa794c640 1 -- 172.21.15.77:0/368959709 shutdown_connections 2023-11-04T01:41:03.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.788+0000 7f3fa794c640 1 -- 172.21.15.77:0/368959709 >> 172.21.15.77:0/368959709 conn(0x7f3fa00cbc90 msgr2=0x7f3fa00cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:03.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.788+0000 7f3fa794c640 1 -- 172.21.15.77:0/368959709 shutdown_connections 2023-11-04T01:41:03.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.788+0000 7f3fa794c640 1 -- 172.21.15.77:0/368959709 wait complete. 2023-11-04T01:41:03.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.789+0000 7f3fa794c640 1 Processor -- start 2023-11-04T01:41:03.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.789+0000 7f3fa794c640 1 -- start start 2023-11-04T01:41:03.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.790+0000 7f3fa794c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3f8c0039a0 0x7f3fa00b4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.790+0000 7f3fa794c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3fa0155590 0x7f3fa00c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.790+0000 7f3fa794c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fa0141480 0x7f3fa0141900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.790+0000 7f3fa794c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa00c9130 con 0x7f3fa0141480 2023-11-04T01:41:03.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.790+0000 7f3fa794c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa00b3890 con 0x7f3fa0155590 2023-11-04T01:41:03.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.790+0000 7f3fa794c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa00c5840 con 0x7f3f8c0039a0 2023-11-04T01:41:03.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.790+0000 7f3fa5ee9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fa0141480 0x7f3fa0141900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.790+0000 7f3fa5ee9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fa0141480 0x7f3fa0141900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54918/0 (socket says 172.21.15.77:54918) 2023-11-04T01:41:03.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.790+0000 7f3fa5ee9640 1 -- 172.21.15.77:0/2758915323 learned_addr learned my addr 172.21.15.77:0/2758915323 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:03.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.790+0000 7f3fa56e8640 1 --2- 172.21.15.77:0/2758915323 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3f8c0039a0 0x7f3fa00b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.790+0000 7f3fa4ee7640 1 --2- 172.21.15.77:0/2758915323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3fa0155590 0x7f3fa00c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.790+0000 7f3fa5ee9640 1 -- 172.21.15.77:0/2758915323 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3f8c0039a0 msgr2=0x7f3fa00b4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.790+0000 7f3fa5ee9640 1 --2- 172.21.15.77:0/2758915323 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3f8c0039a0 0x7f3fa00b4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.790+0000 7f3fa5ee9640 1 -- 172.21.15.77:0/2758915323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3fa0155590 msgr2=0x7f3fa00c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.790+0000 7f3fa5ee9640 1 --2- 172.21.15.77:0/2758915323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3fa0155590 0x7f3fa00c8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.790+0000 7f3fa5ee9640 1 -- 172.21.15.77:0/2758915323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa00c5b20 con 0x7f3fa0141480 2023-11-04T01:41:03.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.790+0000 7f3fa5ee9640 1 --2- 172.21.15.77:0/2758915323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fa0141480 0x7f3fa0141900 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0071cd0 tx=0x7f3f9800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:03.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.791+0000 7f3f95ffb640 1 -- 172.21.15.77:0/2758915323 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9800eed0 con 0x7f3fa0141480 2023-11-04T01:41:03.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.791+0000 7f3f95ffb640 1 -- 172.21.15.77:0/2758915323 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f98003970 con 0x7f3fa0141480 2023-11-04T01:41:03.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.791+0000 7f3fa794c640 1 -- 172.21.15.77:0/2758915323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa00b3b50 con 0x7f3fa0141480 2023-11-04T01:41:03.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.791+0000 7f3f95ffb640 1 -- 172.21.15.77:0/2758915323 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f98003d20 con 0x7f3fa0141480 2023-11-04T01:41:03.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.791+0000 7f3fa794c640 1 -- 172.21.15.77:0/2758915323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa0141e40 con 0x7f3fa0141480 2023-11-04T01:41:03.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.792+0000 7f3fa794c640 1 -- 172.21.15.77:0/2758915323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa00b4070 con 0x7f3fa0141480 2023-11-04T01:41:03.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.792+0000 7f3f95ffb640 1 -- 172.21.15.77:0/2758915323 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3f980050d0 con 0x7f3fa0141480 2023-11-04T01:41:03.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.793+0000 7f3f95ffb640 1 --2- 172.21.15.77:0/2758915323 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3f8406ae70 0x7f3f8406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:03.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.793+0000 7f3f95ffb640 1 -- 172.21.15.77:0/2758915323 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3f980895e0 con 0x7f3fa0141480 2023-11-04T01:41:03.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.793+0000 7f3fa56e8640 1 --2- 172.21.15.77:0/2758915323 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3f8406ae70 0x7f3f8406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:03.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.793+0000 7f3fa56e8640 1 --2- 172.21.15.77:0/2758915323 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3f8406ae70 0x7f3f8406d330 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c036000 tx=0x7f3f9c030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:03.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.797+0000 7f3f95ffb640 1 -- 172.21.15.77:0/2758915323 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3fa00b4070 con 0x7f3fa0141480 2023-11-04T01:41:03.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.962+0000 7f3fa794c640 1 -- 172.21.15.77:0/2758915323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3fa00b4070 con 0x7f3fa0141480 2023-11-04T01:41:03.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.963+0000 7f3f95ffb640 1 -- 172.21.15.77:0/2758915323 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3fa00b4070 con 0x7f3fa0141480 2023-11-04T01:41:03.965 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-04T01:41:03.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.965+0000 7f3fa794c640 1 -- 172.21.15.77:0/2758915323 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3f8406ae70 msgr2=0x7f3f8406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.965+0000 7f3fa794c640 1 --2- 172.21.15.77:0/2758915323 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3f8406ae70 0x7f3f8406d330 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c036000 tx=0x7f3f9c030000 comp rx=0 tx=0).stop 2023-11-04T01:41:03.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.965+0000 7f3fa794c640 1 -- 172.21.15.77:0/2758915323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fa0141480 msgr2=0x7f3fa0141900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:03.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.965+0000 7f3fa794c640 1 --2- 172.21.15.77:0/2758915323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fa0141480 0x7f3fa0141900 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0071cd0 tx=0x7f3f9800eb90 comp rx=0 tx=0).stop 2023-11-04T01:41:03.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.965+0000 7f3fa794c640 1 -- 172.21.15.77:0/2758915323 shutdown_connections 2023-11-04T01:41:03.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.965+0000 7f3fa794c640 1 --2- 172.21.15.77:0/2758915323 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3f8406ae70 0x7f3f8406d330 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.965+0000 7f3fa794c640 1 --2- 172.21.15.77:0/2758915323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fa0141480 0x7f3fa0141900 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.965+0000 7f3fa794c640 1 --2- 172.21.15.77:0/2758915323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3fa0155590 0x7f3fa00c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.965+0000 7f3fa794c640 1 --2- 172.21.15.77:0/2758915323 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3f8c0039a0 0x7f3fa00b4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:03.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.965+0000 7f3fa794c640 1 -- 172.21.15.77:0/2758915323 >> 172.21.15.77:0/2758915323 conn(0x7f3fa00cbc90 msgr2=0x7f3fa00714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:03.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.965+0000 7f3fa794c640 1 -- 172.21.15.77:0/2758915323 shutdown_connections 2023-11-04T01:41:03.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:03.965+0000 7f3fa794c640 1 -- 172.21.15.77:0/2758915323 wait complete. 2023-11-04T01:41:03.977 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:41:04.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.079+0000 7fa0d4ae5640 1 Processor -- start 2023-11-04T01:41:04.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.079+0000 7fa0d4ae5640 1 -- start start 2023-11-04T01:41:04.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.080+0000 7fa0d4ae5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa0d01605b0 0x7fa0d00ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.080+0000 7fa0d4ae5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa0d00b1a40 0x7fa0d006a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.080+0000 7fa0d4ae5640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa0d00ca560 0x7fa0d006a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.080+0000 7fa0d4ae5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0d0160990 con 0x7fa0d01605b0 2023-11-04T01:41:04.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.080+0000 7fa0d4ae5640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0d00cc7c0 con 0x7fa0d00ca560 2023-11-04T01:41:04.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.080+0000 7fa0d4ae5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d00cd750 con 0x7fa0d00b1a40 2023-11-04T01:41:04.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.080+0000 7fa0ce59c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa0d01605b0 0x7fa0d00ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.080+0000 7fa0ce59c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa0d01605b0 0x7fa0d00ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54926/0 (socket says 172.21.15.77:54926) 2023-11-04T01:41:04.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.080+0000 7fa0ce59c640 1 -- 172.21.15.77:0/1966706862 learned_addr learned my addr 172.21.15.77:0/1966706862 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:04.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.080+0000 7fa0ce59c640 1 -- 172.21.15.77:0/1966706862 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa0d00b1a40 msgr2=0x7fa0d006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:04.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.080+0000 7fa0ce59c640 1 --2- 172.21.15.77:0/1966706862 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa0d00b1a40 0x7fa0d006a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.080+0000 7fa0ce59c640 1 -- 172.21.15.77:0/1966706862 >> v2:172.21.15.122:3300/0 conn(0x7fa0d00ca560 msgr2=0x7fa0d006a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:04.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.080+0000 7fa0ce59c640 1 --2- 172.21.15.77:0/1966706862 >> v2:172.21.15.122:3300/0 conn(0x7fa0d00ca560 0x7fa0d006a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.080+0000 7fa0ce59c640 1 -- 172.21.15.77:0/1966706862 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d00cc4e0 con 0x7fa0d01605b0 2023-11-04T01:41:04.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.081+0000 7fa0ce59c640 1 --2- 172.21.15.77:0/1966706862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0d01605b0 0x7fa0d00ccbc0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa0d00d0b00 tx=0x7fa0c002bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c29812cf1198b4ee server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:04.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.081+0000 7fa0cd59a640 1 -- 172.21.15.77:0/1966706862 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c002c950 con 0x7fa0d01605b0 2023-11-04T01:41:04.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.081+0000 7fa0cd59a640 1 -- 172.21.15.77:0/1966706862 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c002cab0 con 0x7fa0d01605b0 2023-11-04T01:41:04.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.081+0000 7fa0cd59a640 1 -- 172.21.15.77:0/1966706862 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c002ce40 con 0x7fa0d01605b0 2023-11-04T01:41:04.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.082+0000 7fa0d4ae5640 1 -- 172.21.15.77:0/1966706862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0d01605b0 msgr2=0x7fa0d00ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.082+0000 7fa0d4ae5640 1 --2- 172.21.15.77:0/1966706862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0d01605b0 0x7fa0d00ccbc0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa0d00d0b00 tx=0x7fa0c002bdb0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.082+0000 7fa0d4ae5640 1 -- 172.21.15.77:0/1966706862 shutdown_connections 2023-11-04T01:41:04.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.082+0000 7fa0d4ae5640 1 --2- 172.21.15.77:0/1966706862 >> v2:172.21.15.122:3300/0 conn(0x7fa0d00ca560 0x7fa0d006a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.082+0000 7fa0d4ae5640 1 --2- 172.21.15.77:0/1966706862 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa0d00b1a40 0x7fa0d006a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.082+0000 7fa0d4ae5640 1 --2- 172.21.15.77:0/1966706862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0d01605b0 0x7fa0d00ccbc0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.082+0000 7fa0d4ae5640 1 -- 172.21.15.77:0/1966706862 >> 172.21.15.77:0/1966706862 conn(0x7fa0d0071820 msgr2=0x7fa0d0071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:04.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.082+0000 7fa0d4ae5640 1 -- 172.21.15.77:0/1966706862 shutdown_connections 2023-11-04T01:41:04.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.082+0000 7fa0d4ae5640 1 -- 172.21.15.77:0/1966706862 wait complete. 2023-11-04T01:41:04.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.083+0000 7fa0d4ae5640 1 Processor -- start 2023-11-04T01:41:04.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.083+0000 7fa0d4ae5640 1 -- start start 2023-11-04T01:41:04.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.084+0000 7fa0d4ae5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0d00ca560 0x7fa0d00ae210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.084+0000 7fa0d4ae5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa0d01605b0 0x7fa0d00ac2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.084+0000 7fa0d4ae5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0d00b0780 0x7fa0d0158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.084+0000 7fa0d4ae5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d015c5b0 con 0x7fa0d00b0780 2023-11-04T01:41:04.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.084+0000 7fa0d4ae5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d015c800 con 0x7fa0d00ca560 2023-11-04T01:41:04.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.084+0000 7fa0d4ae5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d015cae0 con 0x7fa0d01605b0 2023-11-04T01:41:04.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.084+0000 7fa0ced9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0d00b0780 0x7fa0d0158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.084+0000 7fa0ced9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0d00b0780 0x7fa0d0158ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54942/0 (socket says 172.21.15.77:54942) 2023-11-04T01:41:04.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.084+0000 7fa0ced9d640 1 -- 172.21.15.77:0/3416777101 learned_addr learned my addr 172.21.15.77:0/3416777101 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:04.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.084+0000 7fa0cdd9b640 1 --2- 172.21.15.77:0/3416777101 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa0d01605b0 0x7fa0d00ac2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.084+0000 7fa0ce59c640 1 --2- 172.21.15.77:0/3416777101 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0d00ca560 0x7fa0d00ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.084+0000 7fa0ced9d640 1 -- 172.21.15.77:0/3416777101 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa0d01605b0 msgr2=0x7fa0d00ac2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.084+0000 7fa0ced9d640 1 --2- 172.21.15.77:0/3416777101 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa0d01605b0 0x7fa0d00ac2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.084+0000 7fa0ced9d640 1 -- 172.21.15.77:0/3416777101 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0d00ca560 msgr2=0x7fa0d00ae210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.084+0000 7fa0ced9d640 1 --2- 172.21.15.77:0/3416777101 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0d00ca560 0x7fa0d00ae210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.084+0000 7fa0ced9d640 1 -- 172.21.15.77:0/3416777101 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c0009b30 con 0x7fa0d00b0780 2023-11-04T01:41:04.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.084+0000 7fa0cdd9b640 1 --2- 172.21.15.77:0/3416777101 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa0d01605b0 0x7fa0d00ac2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:04.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.084+0000 7fa0ced9d640 1 --2- 172.21.15.77:0/3416777101 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0d00b0780 0x7fa0d0158ea0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa0c800b410 tx=0x7fa0c800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:04.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.085+0000 7fa0c6ffd640 1 -- 172.21.15.77:0/3416777101 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8011830 con 0x7fa0d00b0780 2023-11-04T01:41:04.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.085+0000 7fa0c6ffd640 1 -- 172.21.15.77:0/3416777101 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c80119b0 con 0x7fa0d00b0780 2023-11-04T01:41:04.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.085+0000 7fa0d4ae5640 1 -- 172.21.15.77:0/3416777101 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d015cdc0 con 0x7fa0d00b0780 2023-11-04T01:41:04.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.085+0000 7fa0c6ffd640 1 -- 172.21.15.77:0/3416777101 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8011d60 con 0x7fa0d00b0780 2023-11-04T01:41:04.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.085+0000 7fa0d4ae5640 1 -- 172.21.15.77:0/3416777101 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d00c6eb0 con 0x7fa0d00b0780 2023-11-04T01:41:04.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.086+0000 7fa0d4ae5640 1 -- 172.21.15.77:0/3416777101 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0d00672a0 con 0x7fa0d00b0780 2023-11-04T01:41:04.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.086+0000 7fa0c6ffd640 1 -- 172.21.15.77:0/3416777101 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa0c801a400 con 0x7fa0d00b0780 2023-11-04T01:41:04.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.086+0000 7fa0c6ffd640 1 --2- 172.21.15.77:0/3416777101 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa0b006ae70 0x7fa0b006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.087+0000 7fa0c6ffd640 1 -- 172.21.15.77:0/3416777101 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa0c8089a50 con 0x7fa0d00b0780 2023-11-04T01:41:04.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.087+0000 7fa0ce59c640 1 --2- 172.21.15.77:0/3416777101 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa0b006ae70 0x7fa0b006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.087+0000 7fa0ce59c640 1 --2- 172.21.15.77:0/3416777101 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa0b006ae70 0x7fa0b006d330 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0035000 tx=0x7fa0c0030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:04.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.091+0000 7fa0c6ffd640 1 -- 172.21.15.77:0/3416777101 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa0c80547d0 con 0x7fa0d00b0780 2023-11-04T01:41:04.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.255+0000 7fa0d4ae5640 1 -- 172.21.15.77:0/3416777101 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa0d015d2e0 con 0x7fa0d00b0780 2023-11-04T01:41:04.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.256+0000 7fa0c6ffd640 1 -- 172.21.15.77:0/3416777101 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa0d015d2e0 con 0x7fa0d00b0780 2023-11-04T01:41:04.258 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:41:04.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.258+0000 7fa0d4ae5640 1 -- 172.21.15.77:0/3416777101 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa0b006ae70 msgr2=0x7fa0b006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.258+0000 7fa0d4ae5640 1 --2- 172.21.15.77:0/3416777101 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa0b006ae70 0x7fa0b006d330 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0035000 tx=0x7fa0c0030000 comp rx=0 tx=0).stop 2023-11-04T01:41:04.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.258+0000 7fa0d4ae5640 1 -- 172.21.15.77:0/3416777101 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0d00b0780 msgr2=0x7fa0d0158ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.258+0000 7fa0d4ae5640 1 --2- 172.21.15.77:0/3416777101 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0d00b0780 0x7fa0d0158ea0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa0c800b410 tx=0x7fa0c800b8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.258+0000 7fa0d4ae5640 1 -- 172.21.15.77:0/3416777101 shutdown_connections 2023-11-04T01:41:04.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.258+0000 7fa0d4ae5640 1 --2- 172.21.15.77:0/3416777101 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa0b006ae70 0x7fa0b006d330 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.258+0000 7fa0d4ae5640 1 --2- 172.21.15.77:0/3416777101 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0d00b0780 0x7fa0d0158ea0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.258+0000 7fa0d4ae5640 1 --2- 172.21.15.77:0/3416777101 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa0d01605b0 0x7fa0d00ac2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.258+0000 7fa0d4ae5640 1 --2- 172.21.15.77:0/3416777101 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0d00ca560 0x7fa0d00ae210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.258+0000 7fa0d4ae5640 1 -- 172.21.15.77:0/3416777101 >> 172.21.15.77:0/3416777101 conn(0x7fa0d0071820 msgr2=0x7fa0d006a120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:04.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.258+0000 7fa0d4ae5640 1 -- 172.21.15.77:0/3416777101 shutdown_connections 2023-11-04T01:41:04.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.258+0000 7fa0d4ae5640 1 -- 172.21.15.77:0/3416777101 wait complete. 2023-11-04T01:41:04.270 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:41:04.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.368+0000 7f3a1d997640 1 Processor -- start 2023-11-04T01:41:04.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.368+0000 7f3a1d997640 1 -- start start 2023-11-04T01:41:04.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.369+0000 7f3a1d997640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3a18072370 0x7f3a180cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.369+0000 7f3a1d997640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a180b1cc0 con 0x7f3a18071f90 2023-11-04T01:41:04.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.369+0000 7f3a1d997640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a1815a2f0 con 0x7f3a1815add0 2023-11-04T01:41:04.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.369+0000 7f3a1d997640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a180b1fa0 con 0x7f3a18072370 2023-11-04T01:41:04.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.369+0000 7f3a16ffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f3a18071f90 0x7f3a180b1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52762/0 (socket says 172.21.15.77:52762) 2023-11-04T01:41:04.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.369+0000 7f3a16ffd640 1 -- 172.21.15.77:0/1041775767 learned_addr learned my addr 172.21.15.77:0/1041775767 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:04.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.369+0000 7f3a177fe640 1 --2- 172.21.15.77:0/1041775767 >> v2:172.21.15.77:3300/0 conn(0x7f3a18072370 0x7f3a180cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.370+0000 7f3a177fe640 1 -- 172.21.15.77:0/1041775767 >> v1:172.21.15.122:6789/0 conn(0x7f3a1815add0 legacy=0x7f3a180cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:04.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.370+0000 7f3a177fe640 1 -- 172.21.15.77:0/1041775767 >> v1:172.21.15.77:6789/0 conn(0x7f3a18071f90 legacy=0x7f3a180b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.370+0000 7f3a177fe640 1 -- 172.21.15.77:0/1041775767 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a1815a5d0 con 0x7f3a18072370 2023-11-04T01:41:04.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.370+0000 7f3a15ffb640 1 -- 172.21.15.77:0/1041775767 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2853557632 0 0) 0x7f3a180b1cc0 con 0x7f3a18071f90 2023-11-04T01:41:04.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.370+0000 7f3a177fe640 1 --2- 172.21.15.77:0/1041775767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a18072370 0x7f3a180cf3d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3a100097a0 tx=0x7f3a1002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=268c1a5c55fd5d6e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:04.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.370+0000 7f3a15ffb640 1 -- 172.21.15.77:0/1041775767 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a10031830 con 0x7f3a18072370 2023-11-04T01:41:04.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.370+0000 7f3a15ffb640 1 -- 172.21.15.77:0/1041775767 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a10031990 con 0x7f3a18072370 2023-11-04T01:41:04.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.370+0000 7f3a15ffb640 1 -- 172.21.15.77:0/1041775767 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a10031d20 con 0x7f3a18072370 2023-11-04T01:41:04.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.371+0000 7f3a1d997640 1 -- 172.21.15.77:0/1041775767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a18072370 msgr2=0x7f3a180cf3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.371+0000 7f3a1d997640 1 --2- 172.21.15.77:0/1041775767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a18072370 0x7f3a180cf3d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3a100097a0 tx=0x7f3a1002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.371+0000 7f3a1d997640 1 -- 172.21.15.77:0/1041775767 shutdown_connections 2023-11-04T01:41:04.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.371+0000 7f3a1d997640 1 --2- 172.21.15.77:0/1041775767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a18072370 0x7f3a180cf3d0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.371+0000 7f3a1d997640 1 -- 172.21.15.77:0/1041775767 >> 172.21.15.77:0/1041775767 conn(0x7f3a1806d800 msgr2=0x7f3a1806dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:04.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.371+0000 7f3a1d997640 1 -- 172.21.15.77:0/1041775767 shutdown_connections 2023-11-04T01:41:04.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.371+0000 7f3a1d997640 1 -- 172.21.15.77:0/1041775767 wait complete. 2023-11-04T01:41:04.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.372+0000 7f3a1d997640 1 Processor -- start 2023-11-04T01:41:04.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.372+0000 7f3a1d997640 1 -- start start 2023-11-04T01:41:04.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.373+0000 7f3a1d997640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a18071f90 0x7f3a180b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.373+0000 7f3a1d997640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a18072370 0x7f3a180c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.373+0000 7f3a1d997640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3a1815add0 0x7f3a180c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.373+0000 7f3a1d997640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a181f65e0 con 0x7f3a18071f90 2023-11-04T01:41:04.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.373+0000 7f3a1d997640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a180b1a10 con 0x7f3a18072370 2023-11-04T01:41:04.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.373+0000 7f3a1d997640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a180c90f0 con 0x7f3a1815add0 2023-11-04T01:41:04.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.373+0000 7f3a16ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a18071f90 0x7f3a180b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.373+0000 7f3a16ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a18071f90 0x7f3a180b14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54962/0 (socket says 172.21.15.77:54962) 2023-11-04T01:41:04.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.373+0000 7f3a16ffd640 1 -- 172.21.15.77:0/3318680285 learned_addr learned my addr 172.21.15.77:0/3318680285 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:04.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.373+0000 7f3a177fe640 1 --2- 172.21.15.77:0/3318680285 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3a1815add0 0x7f3a180c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.373+0000 7f3a167fc640 1 --2- 172.21.15.77:0/3318680285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a18072370 0x7f3a180c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.374+0000 7f3a16ffd640 1 -- 172.21.15.77:0/3318680285 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3a1815add0 msgr2=0x7f3a180c5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.374+0000 7f3a16ffd640 1 --2- 172.21.15.77:0/3318680285 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3a1815add0 0x7f3a180c5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.374+0000 7f3a16ffd640 1 -- 172.21.15.77:0/3318680285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a18072370 msgr2=0x7f3a180c8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.374+0000 7f3a16ffd640 1 --2- 172.21.15.77:0/3318680285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a18072370 0x7f3a180c8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.374+0000 7f3a16ffd640 1 -- 172.21.15.77:0/3318680285 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a10009400 con 0x7f3a18071f90 2023-11-04T01:41:04.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.374+0000 7f3a177fe640 1 --2- 172.21.15.77:0/3318680285 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3a1815add0 0x7f3a180c5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:04.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.374+0000 7f3a167fc640 1 --2- 172.21.15.77:0/3318680285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a18072370 0x7f3a180c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:04.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.374+0000 7f3a16ffd640 1 --2- 172.21.15.77:0/3318680285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a18071f90 0x7f3a180b14d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3a0800c7c0 tx=0x7f3a0800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:04.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.374+0000 7f39fffff640 1 -- 172.21.15.77:0/3318680285 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0800a640 con 0x7f3a18071f90 2023-11-04T01:41:04.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.374+0000 7f39fffff640 1 -- 172.21.15.77:0/3318680285 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0800a7c0 con 0x7f3a18071f90 2023-11-04T01:41:04.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.374+0000 7f3a1d997640 1 -- 172.21.15.77:0/3318680285 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a180c6270 con 0x7f3a18071f90 2023-11-04T01:41:04.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.374+0000 7f39fffff640 1 -- 172.21.15.77:0/3318680285 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0800ab70 con 0x7f3a18071f90 2023-11-04T01:41:04.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.374+0000 7f3a1d997640 1 -- 172.21.15.77:0/3318680285 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a180c9320 con 0x7f3a18071f90 2023-11-04T01:41:04.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.375+0000 7f3a1d997640 1 -- 172.21.15.77:0/3318680285 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a180cea70 con 0x7f3a18071f90 2023-11-04T01:41:04.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.375+0000 7f39fffff640 1 -- 172.21.15.77:0/3318680285 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3a0800acd0 con 0x7f3a18071f90 2023-11-04T01:41:04.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.376+0000 7f39fffff640 1 --2- 172.21.15.77:0/3318680285 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3a0406ae70 0x7f3a0406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.376+0000 7f39fffff640 1 -- 172.21.15.77:0/3318680285 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3a08089250 con 0x7f3a18071f90 2023-11-04T01:41:04.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.376+0000 7f3a167fc640 1 --2- 172.21.15.77:0/3318680285 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3a0406ae70 0x7f3a0406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.376+0000 7f3a167fc640 1 --2- 172.21.15.77:0/3318680285 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3a0406ae70 0x7f3a0406d330 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c007fd0 tx=0x7f3a0c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:04.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.380+0000 7f39fffff640 1 -- 172.21.15.77:0/3318680285 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3a08053f30 con 0x7f3a18071f90 2023-11-04T01:41:04.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.557+0000 7f3a1d997640 1 -- 172.21.15.77:0/3318680285 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3a180718d0 con 0x7f3a18071f90 2023-11-04T01:41:04.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.558+0000 7f39fffff640 1 -- 172.21.15.77:0/3318680285 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3a08057550 con 0x7f3a18071f90 2023-11-04T01:41:04.560 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-11-04T01:41:04.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.559+0000 7f3a1d997640 1 -- 172.21.15.77:0/3318680285 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3a0406ae70 msgr2=0x7f3a0406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.559+0000 7f3a1d997640 1 --2- 172.21.15.77:0/3318680285 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3a0406ae70 0x7f3a0406d330 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c007fd0 tx=0x7f3a0c009040 comp rx=0 tx=0).stop 2023-11-04T01:41:04.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.559+0000 7f3a1d997640 1 -- 172.21.15.77:0/3318680285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a18071f90 msgr2=0x7f3a180b14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.559+0000 7f3a1d997640 1 --2- 172.21.15.77:0/3318680285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a18071f90 0x7f3a180b14d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3a0800c7c0 tx=0x7f3a0800cc80 comp rx=0 tx=0).stop 2023-11-04T01:41:04.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.559+0000 7f3a1d997640 1 -- 172.21.15.77:0/3318680285 shutdown_connections 2023-11-04T01:41:04.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.559+0000 7f3a1d997640 1 --2- 172.21.15.77:0/3318680285 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3a0406ae70 0x7f3a0406d330 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.559+0000 7f3a1d997640 1 --2- 172.21.15.77:0/3318680285 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3a1815add0 0x7f3a180c5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.559+0000 7f3a1d997640 1 --2- 172.21.15.77:0/3318680285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a18072370 0x7f3a180c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.559+0000 7f3a1d997640 1 --2- 172.21.15.77:0/3318680285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a18071f90 0x7f3a180b14d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.559+0000 7f3a1d997640 1 -- 172.21.15.77:0/3318680285 >> 172.21.15.77:0/3318680285 conn(0x7f3a1806d800 msgr2=0x7f3a1815d440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:04.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.559+0000 7f3a1d997640 1 -- 172.21.15.77:0/3318680285 shutdown_connections 2023-11-04T01:41:04.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.560+0000 7f3a1d997640 1 -- 172.21.15.77:0/3318680285 wait complete. 2023-11-04T01:41:04.572 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:41:04.572 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:41:04.587 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:04.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.724+0000 7f2ff46db640 1 Processor -- start 2023-11-04T01:41:04.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.724+0000 7f2ff46db640 1 -- start start 2023-11-04T01:41:04.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.725+0000 7f2ff46db640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2fec159c70 0x7f2fec0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.725+0000 7f2ff46db640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2fec0b0ae0 0x7f2fec15d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.725+0000 7f2ff46db640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fec0b4110 con 0x7f2fec06db20 2023-11-04T01:41:04.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.725+0000 7f2ff46db640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fec0b49b0 con 0x7f2fec159c70 2023-11-04T01:41:04.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.725+0000 7f2ff46db640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec0b43f0 con 0x7f2fec0b0ae0 2023-11-04T01:41:04.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.726+0000 7f2ff2477640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2fec159c70 0x7f2fec0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.726+0000 7f2ff1c76640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f2fec06db20 0x7f2fec0b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52772/0 (socket says 172.21.15.77:52772) 2023-11-04T01:41:04.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.726+0000 7f2ff2477640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2fec159c70 0x7f2fec0ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54976/0 (socket says 172.21.15.77:54976) 2023-11-04T01:41:04.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.726+0000 7f2ff2477640 1 -- 172.21.15.77:0/1226661157 learned_addr learned my addr 172.21.15.77:0/1226661157 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:04.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.726+0000 7f2ff2c78640 1 --2- 172.21.15.77:0/1226661157 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2fec0b0ae0 0x7f2fec15d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.726+0000 7f2ff2477640 1 -- 172.21.15.77:0/1226661157 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2fec0b0ae0 msgr2=0x7f2fec15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:04.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.726+0000 7f2ff2477640 1 --2- 172.21.15.77:0/1226661157 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2fec0b0ae0 0x7f2fec15d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.726+0000 7f2ff2477640 1 -- 172.21.15.77:0/1226661157 >> v1:172.21.15.77:6789/0 conn(0x7f2fec06db20 legacy=0x7f2fec0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.726+0000 7f2ff2477640 1 -- 172.21.15.77:0/1226661157 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fec0b46d0 con 0x7f2fec159c70 2023-11-04T01:41:04.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.727+0000 7f2ff2477640 1 --2- 172.21.15.77:0/1226661157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fec159c70 0x7f2fec0ce370 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4009e50 tx=0x7f2fe402e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12563d986e732c0b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:04.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.727+0000 7f2ff1475640 1 -- 172.21.15.77:0/1226661157 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe402ed10 con 0x7f2fec159c70 2023-11-04T01:41:04.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.727+0000 7f2ff1475640 1 -- 172.21.15.77:0/1226661157 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe402ee70 con 0x7f2fec159c70 2023-11-04T01:41:04.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.727+0000 7f2ff1475640 1 -- 172.21.15.77:0/1226661157 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe40365f0 con 0x7f2fec159c70 2023-11-04T01:41:04.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.727+0000 7f2ff46db640 1 -- 172.21.15.77:0/1226661157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fec159c70 msgr2=0x7f2fec0ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.727+0000 7f2ff46db640 1 --2- 172.21.15.77:0/1226661157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fec159c70 0x7f2fec0ce370 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4009e50 tx=0x7f2fe402e170 comp rx=0 tx=0).stop 2023-11-04T01:41:04.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.727+0000 7f2ff46db640 1 -- 172.21.15.77:0/1226661157 shutdown_connections 2023-11-04T01:41:04.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.727+0000 7f2ff46db640 1 --2- 172.21.15.77:0/1226661157 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2fec0b0ae0 0x7f2fec15d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.727+0000 7f2ff46db640 1 --2- 172.21.15.77:0/1226661157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fec159c70 0x7f2fec0ce370 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.727+0000 7f2ff46db640 1 -- 172.21.15.77:0/1226661157 >> 172.21.15.77:0/1226661157 conn(0x7f2fec0ce950 msgr2=0x7f2fec0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:04.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.727+0000 7f2ff46db640 1 -- 172.21.15.77:0/1226661157 shutdown_connections 2023-11-04T01:41:04.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.727+0000 7f2ff46db640 1 -- 172.21.15.77:0/1226661157 wait complete. 2023-11-04T01:41:04.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.728+0000 7f2ff46db640 1 Processor -- start 2023-11-04T01:41:04.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.728+0000 7f2ff46db640 1 -- start start 2023-11-04T01:41:04.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.729+0000 7f2ff46db640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fec06db20 0x7f2fec1f14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.729+0000 7f2ff46db640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2fec0b0ae0 0x7f2fec15ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.729+0000 7f2ff46db640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fec159c70 0x7f2fec1e3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.729+0000 7f2ff46db640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec151b30 con 0x7f2fec06db20 2023-11-04T01:41:04.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.729+0000 7f2ff46db640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec15bff0 con 0x7f2fec159c70 2023-11-04T01:41:04.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.729+0000 7f2ff46db640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec15c2d0 con 0x7f2fec0b0ae0 2023-11-04T01:41:04.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.729+0000 7f2ff2477640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fec06db20 0x7f2fec1f14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.729+0000 7f2ff2477640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fec06db20 0x7f2fec1f14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54992/0 (socket says 172.21.15.77:54992) 2023-11-04T01:41:04.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.729+0000 7f2ff2477640 1 -- 172.21.15.77:0/1009059581 learned_addr learned my addr 172.21.15.77:0/1009059581 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:04.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.730+0000 7f2ff2c78640 1 --2- 172.21.15.77:0/1009059581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fec159c70 0x7f2fec1e3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.730+0000 7f2ff1c76640 1 --2- 172.21.15.77:0/1009059581 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2fec0b0ae0 0x7f2fec15ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.730+0000 7f2ff2477640 1 -- 172.21.15.77:0/1009059581 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2fec0b0ae0 msgr2=0x7f2fec15ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.730+0000 7f2ff2477640 1 --2- 172.21.15.77:0/1009059581 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2fec0b0ae0 0x7f2fec15ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.730+0000 7f2ff2477640 1 -- 172.21.15.77:0/1009059581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fec159c70 msgr2=0x7f2fec1e3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.730+0000 7f2ff2477640 1 --2- 172.21.15.77:0/1009059581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fec159c70 0x7f2fec1e3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.730+0000 7f2ff2477640 1 -- 172.21.15.77:0/1009059581 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe4009b30 con 0x7f2fec06db20 2023-11-04T01:41:04.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.730+0000 7f2ff2477640 1 --2- 172.21.15.77:0/1009059581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fec06db20 0x7f2fec1f14d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4038040 tx=0x7f2fe4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:04.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.730+0000 7f2fe2ffd640 1 -- 172.21.15.77:0/1009059581 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe4041640 con 0x7f2fec06db20 2023-11-04T01:41:04.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.730+0000 7f2fe2ffd640 1 -- 172.21.15.77:0/1009059581 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe40417a0 con 0x7f2fec06db20 2023-11-04T01:41:04.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.730+0000 7f2ff46db640 1 -- 172.21.15.77:0/1009059581 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fec15c5b0 con 0x7f2fec06db20 2023-11-04T01:41:04.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.730+0000 7f2fe2ffd640 1 -- 172.21.15.77:0/1009059581 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe4041b50 con 0x7f2fec06db20 2023-11-04T01:41:04.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.730+0000 7f2ff46db640 1 -- 172.21.15.77:0/1009059581 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fec15cb70 con 0x7f2fec06db20 2023-11-04T01:41:04.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.731+0000 7f2ff46db640 1 -- 172.21.15.77:0/1009059581 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fec074290 con 0x7f2fec06db20 2023-11-04T01:41:04.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.731+0000 7f2fe2ffd640 1 -- 172.21.15.77:0/1009059581 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2fe4041cb0 con 0x7f2fec06db20 2023-11-04T01:41:04.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.732+0000 7f2fe2ffd640 1 --2- 172.21.15.77:0/1009059581 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2fd006ae70 0x7f2fd006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:04.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.732+0000 7f2fe2ffd640 1 -- 172.21.15.77:0/1009059581 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2fe40ae1e0 con 0x7f2fec06db20 2023-11-04T01:41:04.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.732+0000 7f2ff1c76640 1 --2- 172.21.15.77:0/1009059581 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2fd006ae70 0x7f2fd006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:04.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.732+0000 7f2ff1c76640 1 --2- 172.21.15.77:0/1009059581 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2fd006ae70 0x7f2fd006d330 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc007fd0 tx=0x7f2fdc009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:04.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.736+0000 7f2fe2ffd640 1 -- 172.21.15.77:0/1009059581 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2fe4078ed0 con 0x7f2fec06db20 2023-11-04T01:41:04.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.903+0000 7f2ff46db640 1 -- 172.21.15.77:0/1009059581 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fec06d3f0 con 0x7f2fec06db20 2023-11-04T01:41:04.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.904+0000 7f2fe2ffd640 1 -- 172.21.15.77:0/1009059581 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18661 (secure 0 0 0) 0x7f2fe407c4f0 con 0x7f2fec06db20 2023-11-04T01:41:04.906 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:04.907 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":26,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:40:47.579547+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:40:02.810971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:40:04.003979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:40:07.734355+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:04.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.906+0000 7f2ff46db640 1 -- 172.21.15.77:0/1009059581 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2fd006ae70 msgr2=0x7f2fd006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.906+0000 7f2ff46db640 1 --2- 172.21.15.77:0/1009059581 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2fd006ae70 0x7f2fd006d330 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc007fd0 tx=0x7f2fdc009040 comp rx=0 tx=0).stop 2023-11-04T01:41:04.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.906+0000 7f2ff46db640 1 -- 172.21.15.77:0/1009059581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fec06db20 msgr2=0x7f2fec1f14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:04.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.906+0000 7f2ff46db640 1 --2- 172.21.15.77:0/1009059581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fec06db20 0x7f2fec1f14d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4038040 tx=0x7f2fe4004a40 comp rx=0 tx=0).stop 2023-11-04T01:41:04.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.906+0000 7f2ff46db640 1 -- 172.21.15.77:0/1009059581 shutdown_connections 2023-11-04T01:41:04.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.906+0000 7f2ff46db640 1 --2- 172.21.15.77:0/1009059581 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2fd006ae70 0x7f2fd006d330 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.906+0000 7f2ff46db640 1 --2- 172.21.15.77:0/1009059581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fec159c70 0x7f2fec1e3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.906+0000 7f2ff46db640 1 --2- 172.21.15.77:0/1009059581 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2fec0b0ae0 0x7f2fec15ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.906+0000 7f2ff46db640 1 --2- 172.21.15.77:0/1009059581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fec06db20 0x7f2fec1f14d0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:04.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.906+0000 7f2ff46db640 1 -- 172.21.15.77:0/1009059581 >> 172.21.15.77:0/1009059581 conn(0x7f2fec0ce950 msgr2=0x7f2fec070630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:04.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.906+0000 7f2ff46db640 1 -- 172.21.15.77:0/1009059581 shutdown_connections 2023-11-04T01:41:04.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:04.906+0000 7f2ff46db640 1 -- 172.21.15.77:0/1009059581 wait complete. 2023-11-04T01:41:04.919 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:40:02.810971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:40:04.003979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:40:07.734355+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:41:04.920 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:41:05.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.020+0000 7f6b68516640 1 Processor -- start 2023-11-04T01:41:05.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.020+0000 7f6b68516640 1 -- start start 2023-11-04T01:41:05.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.021+0000 7f6b68516640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6b6015ad30 0x7f6b600adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.021+0000 7f6b68516640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b600c3900 con 0x7f6b600ad730 2023-11-04T01:41:05.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.021+0000 7f6b68516640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b600c3be0 con 0x7f6b60070e20 2023-11-04T01:41:05.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.021+0000 7f6b68516640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b600ae260 con 0x7f6b6015ad30 2023-11-04T01:41:05.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.021+0000 7f6b662b2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6b6015ad30 0x7f6b600adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.021+0000 7f6b662b2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6b6015ad30 0x7f6b600adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54998/0 (socket says 172.21.15.77:54998) 2023-11-04T01:41:05.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.021+0000 7f6b65ab1640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6b600ad730 0x7f6b60070710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52774/0 (socket says 172.21.15.77:52774) 2023-11-04T01:41:05.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.021+0000 7f6b662b2640 1 -- 172.21.15.77:0/2440078823 learned_addr learned my addr 172.21.15.77:0/2440078823 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:05.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.021+0000 7f6b662b2640 1 -- 172.21.15.77:0/2440078823 >> v1:172.21.15.122:6789/0 conn(0x7f6b60070e20 legacy=0x7f6b6015e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:05.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.021+0000 7f6b662b2640 1 -- 172.21.15.77:0/2440078823 >> v1:172.21.15.77:6789/0 conn(0x7f6b600ad730 legacy=0x7f6b60070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.021+0000 7f6b662b2640 1 -- 172.21.15.77:0/2440078823 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b600c3ec0 con 0x7f6b6015ad30 2023-11-04T01:41:05.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.021+0000 7f6b652b0640 1 -- 172.21.15.77:0/2440078823 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 720914373 0 0) 0x7f6b600c3900 con 0x7f6b600ad730 2023-11-04T01:41:05.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.022+0000 7f6b662b2640 1 --2- 172.21.15.77:0/2440078823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b6015ad30 0x7f6b600adc80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c009870 tx=0x7f6b5c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e89214b0fad44edc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:05.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.022+0000 7f6b652b0640 1 -- 172.21.15.77:0/2440078823 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c031870 con 0x7f6b6015ad30 2023-11-04T01:41:05.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.022+0000 7f6b652b0640 1 -- 172.21.15.77:0/2440078823 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b5c0319d0 con 0x7f6b6015ad30 2023-11-04T01:41:05.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.022+0000 7f6b652b0640 1 -- 172.21.15.77:0/2440078823 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c031d60 con 0x7f6b6015ad30 2023-11-04T01:41:05.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.023+0000 7f6b68516640 1 -- 172.21.15.77:0/2440078823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b6015ad30 msgr2=0x7f6b600adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.023+0000 7f6b68516640 1 --2- 172.21.15.77:0/2440078823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b6015ad30 0x7f6b600adc80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c009870 tx=0x7f6b5c02b910 comp rx=0 tx=0).stop 2023-11-04T01:41:05.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.023+0000 7f6b68516640 1 -- 172.21.15.77:0/2440078823 shutdown_connections 2023-11-04T01:41:05.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.023+0000 7f6b68516640 1 --2- 172.21.15.77:0/2440078823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b6015ad30 0x7f6b600adc80 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.023+0000 7f6b68516640 1 -- 172.21.15.77:0/2440078823 >> 172.21.15.77:0/2440078823 conn(0x7f6b600ce950 msgr2=0x7f6b600ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:05.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.023+0000 7f6b68516640 1 -- 172.21.15.77:0/2440078823 shutdown_connections 2023-11-04T01:41:05.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.023+0000 7f6b68516640 1 -- 172.21.15.77:0/2440078823 wait complete. 2023-11-04T01:41:05.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.024+0000 7f6b68516640 1 Processor -- start 2023-11-04T01:41:05.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.024+0000 7f6b68516640 1 -- start start 2023-11-04T01:41:05.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.025+0000 7f6b68516640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6b60070e20 0x7f6b601575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.025+0000 7f6b68516640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b600ad730 0x7f6b60159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.025+0000 7f6b68516640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b6015ad30 0x7f6b600b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.025+0000 7f6b68516640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b600c70e0 con 0x7f6b600ad730 2023-11-04T01:41:05.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.025+0000 7f6b68516640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b60157cb0 con 0x7f6b6015ad30 2023-11-04T01:41:05.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.025+0000 7f6b68516640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b60157f90 con 0x7f6b60070e20 2023-11-04T01:41:05.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.025+0000 7f6b65ab1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b600ad730 0x7f6b60159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.025+0000 7f6b65ab1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b600ad730 0x7f6b60159720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55000/0 (socket says 172.21.15.77:55000) 2023-11-04T01:41:05.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.025+0000 7f6b65ab1640 1 -- 172.21.15.77:0/4128610139 learned_addr learned my addr 172.21.15.77:0/4128610139 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:05.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.025+0000 7f6b662b2640 1 --2- 172.21.15.77:0/4128610139 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6b60070e20 0x7f6b601575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.025+0000 7f6b66ab3640 1 --2- 172.21.15.77:0/4128610139 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b6015ad30 0x7f6b600b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.025+0000 7f6b65ab1640 1 -- 172.21.15.77:0/4128610139 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6b60070e20 msgr2=0x7f6b601575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.025+0000 7f6b65ab1640 1 --2- 172.21.15.77:0/4128610139 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6b60070e20 0x7f6b601575f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.025+0000 7f6b65ab1640 1 -- 172.21.15.77:0/4128610139 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b6015ad30 msgr2=0x7f6b600b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.025+0000 7f6b65ab1640 1 --2- 172.21.15.77:0/4128610139 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b6015ad30 0x7f6b600b09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.025+0000 7f6b65ab1640 1 -- 172.21.15.77:0/4128610139 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b5c0094d0 con 0x7f6b600ad730 2023-11-04T01:41:05.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.025+0000 7f6b66ab3640 1 --2- 172.21.15.77:0/4128610139 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b6015ad30 0x7f6b600b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:05.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.025+0000 7f6b65ab1640 1 --2- 172.21.15.77:0/4128610139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b600ad730 0x7f6b60159720 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6b5000c4d0 tx=0x7f6b5000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:05.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.025+0000 7f6b56ffd640 1 -- 172.21.15.77:0/4128610139 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b500074e0 con 0x7f6b600ad730 2023-11-04T01:41:05.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.025+0000 7f6b56ffd640 1 -- 172.21.15.77:0/4128610139 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b50007660 con 0x7f6b600ad730 2023-11-04T01:41:05.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.025+0000 7f6b68516640 1 -- 172.21.15.77:0/4128610139 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b60158270 con 0x7f6b600ad730 2023-11-04T01:41:05.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.025+0000 7f6b56ffd640 1 -- 172.21.15.77:0/4128610139 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b50004a20 con 0x7f6b600ad730 2023-11-04T01:41:05.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.025+0000 7f6b68516640 1 -- 172.21.15.77:0/4128610139 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b600b0f00 con 0x7f6b600ad730 2023-11-04T01:41:05.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.026+0000 7f6b68516640 1 -- 172.21.15.77:0/4128610139 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b600b1120 con 0x7f6b600ad730 2023-11-04T01:41:05.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.027+0000 7f6b56ffd640 1 -- 172.21.15.77:0/4128610139 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6b50004b80 con 0x7f6b600ad730 2023-11-04T01:41:05.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.027+0000 7f6b56ffd640 1 --2- 172.21.15.77:0/4128610139 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6b4406ae70 0x7f6b4406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.027+0000 7f6b56ffd640 1 -- 172.21.15.77:0/4128610139 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6b50088f10 con 0x7f6b600ad730 2023-11-04T01:41:05.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.027+0000 7f6b662b2640 1 --2- 172.21.15.77:0/4128610139 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6b4406ae70 0x7f6b4406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.028+0000 7f6b662b2640 1 --2- 172.21.15.77:0/4128610139 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6b4406ae70 0x7f6b4406d330 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c036000 tx=0x7f6b5c03c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:05.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.031+0000 7f6b56ffd640 1 -- 172.21.15.77:0/4128610139 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6b50053c00 con 0x7f6b600ad730 2023-11-04T01:41:05.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.196+0000 7f6b68516640 1 -- 172.21.15.77:0/4128610139 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6b600c7220 con 0x7f6b600ad730 2023-11-04T01:41:05.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.197+0000 7f6b56ffd640 1 -- 172.21.15.77:0/4128610139 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6b600c7220 con 0x7f6b600ad730 2023-11-04T01:41:05.199 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:41:05.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.199+0000 7f6b68516640 1 -- 172.21.15.77:0/4128610139 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6b4406ae70 msgr2=0x7f6b4406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.199+0000 7f6b68516640 1 --2- 172.21.15.77:0/4128610139 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6b4406ae70 0x7f6b4406d330 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c036000 tx=0x7f6b5c03c040 comp rx=0 tx=0).stop 2023-11-04T01:41:05.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.199+0000 7f6b68516640 1 -- 172.21.15.77:0/4128610139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b600ad730 msgr2=0x7f6b60159720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.199+0000 7f6b68516640 1 --2- 172.21.15.77:0/4128610139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b600ad730 0x7f6b60159720 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6b5000c4d0 tx=0x7f6b5000c990 comp rx=0 tx=0).stop 2023-11-04T01:41:05.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.199+0000 7f6b68516640 1 -- 172.21.15.77:0/4128610139 shutdown_connections 2023-11-04T01:41:05.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.199+0000 7f6b68516640 1 --2- 172.21.15.77:0/4128610139 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6b4406ae70 0x7f6b4406d330 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.199+0000 7f6b68516640 1 --2- 172.21.15.77:0/4128610139 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b6015ad30 0x7f6b600b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.199+0000 7f6b68516640 1 --2- 172.21.15.77:0/4128610139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b600ad730 0x7f6b60159720 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.199+0000 7f6b68516640 1 --2- 172.21.15.77:0/4128610139 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6b60070e20 0x7f6b601575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.199+0000 7f6b68516640 1 -- 172.21.15.77:0/4128610139 >> 172.21.15.77:0/4128610139 conn(0x7f6b600ce950 msgr2=0x7f6b600c9810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:05.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.199+0000 7f6b68516640 1 -- 172.21.15.77:0/4128610139 shutdown_connections 2023-11-04T01:41:05.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.199+0000 7f6b68516640 1 -- 172.21.15.77:0/4128610139 wait complete. 2023-11-04T01:41:05.211 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:41:05.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.313+0000 7fa3243d7640 1 Processor -- start 2023-11-04T01:41:05.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.313+0000 7fa3243d7640 1 -- start start 2023-11-04T01:41:05.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.314+0000 7fa3243d7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa31c0cc520 0x7fa31c070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.314+0000 7fa3243d7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa31c0c3860 con 0x7fa31c0cc9d0 2023-11-04T01:41:05.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.314+0000 7fa3243d7640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa31c0c9250 con 0x7fa31c153850 2023-11-04T01:41:05.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.314+0000 7fa3243d7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa31c153c30 con 0x7fa31c0cc520 2023-11-04T01:41:05.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.314+0000 7fa321972640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa31c0cc520 0x7fa31c070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.314+0000 7fa322974640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fa31c0cc9d0 0x7fa31c0c3cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52784/0 (socket says 172.21.15.77:52784) 2023-11-04T01:41:05.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.314+0000 7fa322974640 1 -- 172.21.15.77:0/1601585346 learned_addr learned my addr 172.21.15.77:0/1601585346 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:05.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.314+0000 7fa321972640 1 --2- 172.21.15.77:0/1601585346 >> v2:172.21.15.77:3300/0 conn(0x7fa31c0cc520 0x7fa31c070fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55008/0 (socket says 172.21.15.77:55008) 2023-11-04T01:41:05.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.314+0000 7fa321972640 1 -- 172.21.15.77:0/1601585346 >> v1:172.21.15.122:6789/0 conn(0x7fa31c153850 legacy=0x7fa31c15a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:05.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.314+0000 7fa321972640 1 -- 172.21.15.77:0/1601585346 >> v1:172.21.15.77:6789/0 conn(0x7fa31c0cc9d0 legacy=0x7fa31c0c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.314+0000 7fa321972640 1 -- 172.21.15.77:0/1601585346 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa31c0ce590 con 0x7fa31c0cc520 2023-11-04T01:41:05.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.315+0000 7fa321972640 1 --2- 172.21.15.77:0/1601585346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa31c0cc520 0x7fa31c070fa0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa30c0097a0 tx=0x7fa30c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=767c70b8eda90242 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:05.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.315+0000 7fa321171640 1 -- 172.21.15.77:0/1601585346 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c031830 con 0x7fa31c0cc520 2023-11-04T01:41:05.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.315+0000 7fa321171640 1 -- 172.21.15.77:0/1601585346 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30c031990 con 0x7fa31c0cc520 2023-11-04T01:41:05.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.315+0000 7fa321171640 1 -- 172.21.15.77:0/1601585346 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c031d20 con 0x7fa31c0cc520 2023-11-04T01:41:05.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.315+0000 7fa3243d7640 1 -- 172.21.15.77:0/1601585346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa31c0cc520 msgr2=0x7fa31c070fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.315+0000 7fa3243d7640 1 --2- 172.21.15.77:0/1601585346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa31c0cc520 0x7fa31c070fa0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa30c0097a0 tx=0x7fa30c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.316+0000 7fa3243d7640 1 -- 172.21.15.77:0/1601585346 shutdown_connections 2023-11-04T01:41:05.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.316+0000 7fa3243d7640 1 --2- 172.21.15.77:0/1601585346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa31c0cc520 0x7fa31c070fa0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.316+0000 7fa3243d7640 1 -- 172.21.15.77:0/1601585346 >> 172.21.15.77:0/1601585346 conn(0x7fa31c0ce950 msgr2=0x7fa31c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:05.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.316+0000 7fa3243d7640 1 -- 172.21.15.77:0/1601585346 shutdown_connections 2023-11-04T01:41:05.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.316+0000 7fa3243d7640 1 -- 172.21.15.77:0/1601585346 wait complete. 2023-11-04T01:41:05.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.317+0000 7fa3243d7640 1 Processor -- start 2023-11-04T01:41:05.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.317+0000 7fa3243d7640 1 -- start start 2023-11-04T01:41:05.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.317+0000 7fa3243d7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa31c0cc520 0x7fa31c0b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.317+0000 7fa3243d7640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa31c0cc9d0 0x7fa31c0c6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.317+0000 7fa3243d7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa31c153850 0x7fa31c0ad9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.317+0000 7fa3243d7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c0c77b0 con 0x7fa31c0cc520 2023-11-04T01:41:05.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.317+0000 7fa3243d7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c0c6b80 con 0x7fa31c153850 2023-11-04T01:41:05.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.317+0000 7fa3243d7640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c0adf00 con 0x7fa31c0cc9d0 2023-11-04T01:41:05.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.318+0000 7fa322173640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa31c0cc520 0x7fa31c0b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.318+0000 7fa322173640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa31c0cc520 0x7fa31c0b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55010/0 (socket says 172.21.15.77:55010) 2023-11-04T01:41:05.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.318+0000 7fa322173640 1 -- 172.21.15.77:0/3932301438 learned_addr learned my addr 172.21.15.77:0/3932301438 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:05.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.318+0000 7fa322173640 1 -- 172.21.15.77:0/3932301438 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa31c0cc9d0 msgr2=0x7fa31c0c6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.318+0000 7fa322173640 1 --2- 172.21.15.77:0/3932301438 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa31c0cc9d0 0x7fa31c0c6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.318+0000 7fa322173640 1 -- 172.21.15.77:0/3932301438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa31c153850 msgr2=0x7fa31c0ad9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.318+0000 7fa322974640 1 --2- 172.21.15.77:0/3932301438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa31c153850 0x7fa31c0ad9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.318+0000 7fa322173640 1 --2- 172.21.15.77:0/3932301438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa31c153850 0x7fa31c0ad9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.318+0000 7fa322173640 1 -- 172.21.15.77:0/3932301438 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30c009400 con 0x7fa31c0cc520 2023-11-04T01:41:05.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.318+0000 7fa322173640 1 --2- 172.21.15.77:0/3932301438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa31c0cc520 0x7fa31c0b20e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa31800b3f0 tx=0x7fa31800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:05.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.318+0000 7fa312ffd640 1 -- 172.21.15.77:0/3932301438 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa318011830 con 0x7fa31c0cc520 2023-11-04T01:41:05.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.318+0000 7fa312ffd640 1 -- 172.21.15.77:0/3932301438 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa318011990 con 0x7fa31c0cc520 2023-11-04T01:41:05.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.318+0000 7fa312ffd640 1 -- 172.21.15.77:0/3932301438 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa318011d40 con 0x7fa31c0cc520 2023-11-04T01:41:05.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.318+0000 7fa3243d7640 1 -- 172.21.15.77:0/3932301438 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa31c0b2700 con 0x7fa31c0cc520 2023-11-04T01:41:05.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.318+0000 7fa3243d7640 1 -- 172.21.15.77:0/3932301438 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa31c0b2cc0 con 0x7fa31c0cc520 2023-11-04T01:41:05.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.319+0000 7fa3243d7640 1 -- 172.21.15.77:0/3932301438 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa31c074290 con 0x7fa31c0cc520 2023-11-04T01:41:05.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.319+0000 7fa312ffd640 1 -- 172.21.15.77:0/3932301438 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa31801a400 con 0x7fa31c0cc520 2023-11-04T01:41:05.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.320+0000 7fa312ffd640 1 --2- 172.21.15.77:0/3932301438 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa30006ae70 0x7fa30006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.320+0000 7fa312ffd640 1 -- 172.21.15.77:0/3932301438 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa3180897b0 con 0x7fa31c0cc520 2023-11-04T01:41:05.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.320+0000 7fa321972640 1 --2- 172.21.15.77:0/3932301438 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa30006ae70 0x7fa30006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.321+0000 7fa321972640 1 --2- 172.21.15.77:0/3932301438 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa30006ae70 0x7fa30006d330 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa30c036000 tx=0x7fa30c030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:05.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.324+0000 7fa312ffd640 1 -- 172.21.15.77:0/3932301438 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa318054530 con 0x7fa31c0cc520 2023-11-04T01:41:05.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.487+0000 7fa3243d7640 1 -- 172.21.15.77:0/3932301438 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa31c0c5010 con 0x7fa31c0cc520 2023-11-04T01:41:05.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.488+0000 7fa312ffd640 1 -- 172.21.15.77:0/3932301438 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa318057b50 con 0x7fa31c0cc520 2023-11-04T01:41:05.490 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:41:05.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.489+0000 7fa3243d7640 1 -- 172.21.15.77:0/3932301438 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa30006ae70 msgr2=0x7fa30006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.489+0000 7fa3243d7640 1 --2- 172.21.15.77:0/3932301438 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa30006ae70 0x7fa30006d330 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa30c036000 tx=0x7fa30c030000 comp rx=0 tx=0).stop 2023-11-04T01:41:05.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.489+0000 7fa3243d7640 1 -- 172.21.15.77:0/3932301438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa31c0cc520 msgr2=0x7fa31c0b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.489+0000 7fa3243d7640 1 --2- 172.21.15.77:0/3932301438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa31c0cc520 0x7fa31c0b20e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa31800b3f0 tx=0x7fa31800b8b0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.489+0000 7fa3243d7640 1 -- 172.21.15.77:0/3932301438 shutdown_connections 2023-11-04T01:41:05.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.489+0000 7fa3243d7640 1 --2- 172.21.15.77:0/3932301438 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa30006ae70 0x7fa30006d330 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.489+0000 7fa3243d7640 1 --2- 172.21.15.77:0/3932301438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa31c153850 0x7fa31c0ad9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.489+0000 7fa3243d7640 1 --2- 172.21.15.77:0/3932301438 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa31c0cc9d0 0x7fa31c0c6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.489+0000 7fa3243d7640 1 --2- 172.21.15.77:0/3932301438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa31c0cc520 0x7fa31c0b20e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.489+0000 7fa3243d7640 1 -- 172.21.15.77:0/3932301438 >> 172.21.15.77:0/3932301438 conn(0x7fa31c0ce950 msgr2=0x7fa31c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:05.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.490+0000 7fa3243d7640 1 -- 172.21.15.77:0/3932301438 shutdown_connections 2023-11-04T01:41:05.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.490+0000 7fa3243d7640 1 -- 172.21.15.77:0/3932301438 wait complete. 2023-11-04T01:41:05.502 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:41:05.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.602+0000 7fd219db6640 1 Processor -- start 2023-11-04T01:41:05.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.603+0000 7fd219db6640 1 -- start start 2023-11-04T01:41:05.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.603+0000 7fd219db6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd2140b1a40 0x7fd2140ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.603+0000 7fd219db6640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd21406a830 0x7fd2140cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.603+0000 7fd219db6640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd214160990 con 0x7fd2141605b0 2023-11-04T01:41:05.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.603+0000 7fd219db6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2140cc7c0 con 0x7fd2140b1a40 2023-11-04T01:41:05.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.603+0000 7fd219db6640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2140cd750 con 0x7fd21406a830 2023-11-04T01:41:05.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.603+0000 7fd212ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd2140b1a40 0x7fd2140ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.604+0000 7fd212ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd2140b1a40 0x7fd2140ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55014/0 (socket says 172.21.15.77:55014) 2023-11-04T01:41:05.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.604+0000 7fd212ffd640 1 -- 172.21.15.77:0/1161862903 learned_addr learned my addr 172.21.15.77:0/1161862903 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:05.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.604+0000 7fd213fff640 1 --2- 172.21.15.77:0/1161862903 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd21406a830 0x7fd2140cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.604+0000 7fd212ffd640 1 -- 172.21.15.77:0/1161862903 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd21406a830 msgr2=0x7fd2140cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:05.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.604+0000 7fd212ffd640 1 --2- 172.21.15.77:0/1161862903 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd21406a830 0x7fd2140cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.604+0000 7fd212ffd640 1 -- 172.21.15.77:0/1161862903 >> v1:172.21.15.122:6789/0 conn(0x7fd2141605b0 legacy=0x7fd21406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.604+0000 7fd212ffd640 1 -- 172.21.15.77:0/1161862903 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2140cc4e0 con 0x7fd2140b1a40 2023-11-04T01:41:05.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.605+0000 7fd212ffd640 1 --2- 172.21.15.77:0/1161862903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2140b1a40 0x7fd2140ccbc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd208009870 tx=0x7fd20802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9292140a1e7d4ac7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:05.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.605+0000 7fd2127fc640 1 -- 172.21.15.77:0/1161862903 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2080317c0 con 0x7fd2140b1a40 2023-11-04T01:41:05.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.605+0000 7fd2127fc640 1 -- 172.21.15.77:0/1161862903 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd208031920 con 0x7fd2140b1a40 2023-11-04T01:41:05.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.605+0000 7fd2127fc640 1 -- 172.21.15.77:0/1161862903 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd208031cb0 con 0x7fd2140b1a40 2023-11-04T01:41:05.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.605+0000 7fd219db6640 1 -- 172.21.15.77:0/1161862903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2140b1a40 msgr2=0x7fd2140ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.605+0000 7fd219db6640 1 --2- 172.21.15.77:0/1161862903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2140b1a40 0x7fd2140ccbc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd208009870 tx=0x7fd20802b860 comp rx=0 tx=0).stop 2023-11-04T01:41:05.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.605+0000 7fd219db6640 1 -- 172.21.15.77:0/1161862903 shutdown_connections 2023-11-04T01:41:05.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.605+0000 7fd219db6640 1 --2- 172.21.15.77:0/1161862903 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd21406a830 0x7fd2140cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.605+0000 7fd219db6640 1 --2- 172.21.15.77:0/1161862903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2140b1a40 0x7fd2140ccbc0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.605+0000 7fd219db6640 1 -- 172.21.15.77:0/1161862903 >> 172.21.15.77:0/1161862903 conn(0x7fd214071820 msgr2=0x7fd214071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:05.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.605+0000 7fd219db6640 1 -- 172.21.15.77:0/1161862903 shutdown_connections 2023-11-04T01:41:05.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.605+0000 7fd219db6640 1 -- 172.21.15.77:0/1161862903 wait complete. 2023-11-04T01:41:05.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.606+0000 7fd219db6640 1 Processor -- start 2023-11-04T01:41:05.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.607+0000 7fd219db6640 1 -- start start 2023-11-04T01:41:05.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.607+0000 7fd219db6640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd21406a830 0x7fd2140c5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.607+0000 7fd219db6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2141605b0 0x7fd214150740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.607+0000 7fd219db6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2140c3560 0x7fd2140af550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.607+0000 7fd219db6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2140c60b0 con 0x7fd2141605b0 2023-11-04T01:41:05.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.607+0000 7fd219db6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2140b3c70 con 0x7fd2140c3560 2023-11-04T01:41:05.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.607+0000 7fd219db6640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2140b3f50 con 0x7fd21406a830 2023-11-04T01:41:05.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.607+0000 7fd212ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2141605b0 0x7fd214150740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.607+0000 7fd212ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2141605b0 0x7fd214150740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55022/0 (socket says 172.21.15.77:55022) 2023-11-04T01:41:05.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.607+0000 7fd212ffd640 1 -- 172.21.15.77:0/1265505949 learned_addr learned my addr 172.21.15.77:0/1265505949 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:05.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.608+0000 7fd212ffd640 1 -- 172.21.15.77:0/1265505949 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd21406a830 msgr2=0x7fd2140c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.608+0000 7fd212ffd640 1 --2- 172.21.15.77:0/1265505949 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd21406a830 0x7fd2140c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.608+0000 7fd212ffd640 1 -- 172.21.15.77:0/1265505949 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2140c3560 msgr2=0x7fd2140af550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.608+0000 7fd212ffd640 1 --2- 172.21.15.77:0/1265505949 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2140c3560 0x7fd2140af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.608+0000 7fd212ffd640 1 -- 172.21.15.77:0/1265505949 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2080094d0 con 0x7fd2141605b0 2023-11-04T01:41:05.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.608+0000 7fd212ffd640 1 --2- 172.21.15.77:0/1265505949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2141605b0 0x7fd214150740 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd208000c00 tx=0x7fd2080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:05.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.608+0000 7fd1fbfff640 1 -- 172.21.15.77:0/1265505949 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd208031f10 con 0x7fd2141605b0 2023-11-04T01:41:05.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.608+0000 7fd1fbfff640 1 -- 172.21.15.77:0/1265505949 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd208032860 con 0x7fd2141605b0 2023-11-04T01:41:05.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.608+0000 7fd219db6640 1 -- 172.21.15.77:0/1265505949 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2140b4230 con 0x7fd2141605b0 2023-11-04T01:41:05.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.608+0000 7fd1fbfff640 1 -- 172.21.15.77:0/1265505949 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd208032c10 con 0x7fd2141605b0 2023-11-04T01:41:05.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.608+0000 7fd219db6640 1 -- 172.21.15.77:0/1265505949 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2140c6390 con 0x7fd2141605b0 2023-11-04T01:41:05.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.609+0000 7fd219db6640 1 -- 172.21.15.77:0/1265505949 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2140672a0 con 0x7fd2141605b0 2023-11-04T01:41:05.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.609+0000 7fd1fbfff640 1 -- 172.21.15.77:0/1265505949 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd20804d3f0 con 0x7fd2141605b0 2023-11-04T01:41:05.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.610+0000 7fd1fbfff640 1 --2- 172.21.15.77:0/1265505949 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd20006ae70 0x7fd20006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.610+0000 7fd1fbfff640 1 -- 172.21.15.77:0/1265505949 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd2080ab610 con 0x7fd2141605b0 2023-11-04T01:41:05.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.610+0000 7fd2137fe640 1 --2- 172.21.15.77:0/1265505949 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd20006ae70 0x7fd20006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.610+0000 7fd2137fe640 1 --2- 172.21.15.77:0/1265505949 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd20006ae70 0x7fd20006d330 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd204000f60 tx=0x7fd2040079b0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:05.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.614+0000 7fd1fbfff640 1 -- 172.21.15.77:0/1265505949 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd208076440 con 0x7fd2141605b0 2023-11-04T01:41:05.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.784+0000 7fd219db6640 1 -- 172.21.15.77:0/1265505949 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd2140b4090 con 0x7fd2141605b0 2023-11-04T01:41:05.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.785+0000 7fd1fbfff640 1 -- 172.21.15.77:0/1265505949 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd2140b4090 con 0x7fd2141605b0 2023-11-04T01:41:05.787 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-04T01:41:05.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.787+0000 7fd219db6640 1 -- 172.21.15.77:0/1265505949 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd20006ae70 msgr2=0x7fd20006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.787+0000 7fd219db6640 1 --2- 172.21.15.77:0/1265505949 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd20006ae70 0x7fd20006d330 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd204000f60 tx=0x7fd2040079b0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.787+0000 7fd219db6640 1 -- 172.21.15.77:0/1265505949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2141605b0 msgr2=0x7fd214150740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.787+0000 7fd219db6640 1 --2- 172.21.15.77:0/1265505949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2141605b0 0x7fd214150740 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd208000c00 tx=0x7fd2080046c0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.787+0000 7fd219db6640 1 -- 172.21.15.77:0/1265505949 shutdown_connections 2023-11-04T01:41:05.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.787+0000 7fd219db6640 1 --2- 172.21.15.77:0/1265505949 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd20006ae70 0x7fd20006d330 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.787+0000 7fd219db6640 1 --2- 172.21.15.77:0/1265505949 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2140c3560 0x7fd2140af550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.787+0000 7fd219db6640 1 --2- 172.21.15.77:0/1265505949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2141605b0 0x7fd214150740 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.787+0000 7fd219db6640 1 --2- 172.21.15.77:0/1265505949 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd21406a830 0x7fd2140c5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.787+0000 7fd219db6640 1 -- 172.21.15.77:0/1265505949 >> 172.21.15.77:0/1265505949 conn(0x7fd214071820 msgr2=0x7fd2140b09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:05.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.787+0000 7fd219db6640 1 -- 172.21.15.77:0/1265505949 shutdown_connections 2023-11-04T01:41:05.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.787+0000 7fd219db6640 1 -- 172.21.15.77:0/1265505949 wait complete. 2023-11-04T01:41:05.799 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:41:05.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.899+0000 7f5b17610640 1 Processor -- start 2023-11-04T01:41:05.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.900+0000 7f5b17610640 1 -- start start 2023-11-04T01:41:05.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.900+0000 7f5b17610640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5b10153e60 0x7f5b1015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.900+0000 7f5b17610640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b100cde60 con 0x7f5b100b4880 2023-11-04T01:41:05.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.900+0000 7f5b17610640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b10160f90 con 0x7f5b100cd6d0 2023-11-04T01:41:05.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.900+0000 7f5b17610640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1015e400 con 0x7f5b10153e60 2023-11-04T01:41:05.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.901+0000 7f5b15bad640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f5b100b4880 0x7f5b100d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52790/0 (socket says 172.21.15.77:52790) 2023-11-04T01:41:05.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.901+0000 7f5b15bad640 1 -- 172.21.15.77:0/397808655 learned_addr learned my addr 172.21.15.77:0/397808655 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:05.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.901+0000 7f5b153ac640 1 --2- 172.21.15.77:0/397808655 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5b10153e60 0x7f5b1015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.901+0000 7f5b07fff640 1 -- 172.21.15.77:0/397808655 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4071422713 0 0) 0x7f5b100cde60 con 0x7f5b100b4880 2023-11-04T01:41:05.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.901+0000 7f5b07fff640 1 -- 172.21.15.77:0/397808655 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5afc003520 con 0x7f5b100b4880 2023-11-04T01:41:05.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.901+0000 7f5b07fff640 1 -- 172.21.15.77:0/397808655 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1124631089 0 0) 0x7f5afc003520 con 0x7f5b100b4880 2023-11-04T01:41:05.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.901+0000 7f5b07fff640 1 -- 172.21.15.77:0/397808655 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5b10153e60 msgr2=0x7f5b1015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:05.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.901+0000 7f5b07fff640 1 --2- 172.21.15.77:0/397808655 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5b10153e60 0x7f5b1015dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.901+0000 7f5b07fff640 1 -- 172.21.15.77:0/397808655 >> v1:172.21.15.122:6789/0 conn(0x7f5b100cd6d0 legacy=0x7f5b10161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.901+0000 7f5b07fff640 1 -- 172.21.15.77:0/397808655 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b100ce090 con 0x7f5b100b4880 2023-11-04T01:41:05.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.901+0000 7f5b07fff640 1 -- 172.21.15.77:0/397808655 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f5b0c0019f0 con 0x7f5b100b4880 2023-11-04T01:41:05.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.901+0000 7f5b07fff640 1 -- 172.21.15.77:0/397808655 >> v1:172.21.15.77:6789/0 conn(0x7f5b100b4880 legacy=0x7f5b100d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.901+0000 7f5b07fff640 1 --2- 172.21.15.77:0/397808655 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5afc0039a0 0x7f5afc003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.901+0000 7f5b07fff640 1 --2- 172.21.15.77:0/397808655 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5b10153e60 0x7f5afc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.901+0000 7f5b07fff640 1 --2- 172.21.15.77:0/397808655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5afc004d00 0x7f5afc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.901+0000 7f5b07fff640 1 -- 172.21.15.77:0/397808655 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1015e400 con 0x7f5afc004d00 2023-11-04T01:41:05.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.901+0000 7f5b07fff640 1 -- 172.21.15.77:0/397808655 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc00b980 con 0x7f5afc0039a0 2023-11-04T01:41:05.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.901+0000 7f5b07fff640 1 -- 172.21.15.77:0/397808655 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc00bb40 con 0x7f5b10153e60 2023-11-04T01:41:05.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.901+0000 7f5b15bad640 1 --2- 172.21.15.77:0/397808655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5afc004d00 0x7f5afc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.901+0000 7f5b153ac640 1 --2- 172.21.15.77:0/397808655 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5afc0039a0 0x7f5afc003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.901+0000 7f5b14bab640 1 --2- 172.21.15.77:0/397808655 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5b10153e60 0x7f5afc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.902+0000 7f5b15bad640 1 -- 172.21.15.77:0/397808655 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5b10153e60 msgr2=0x7f5afc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:05.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.902+0000 7f5b15bad640 1 --2- 172.21.15.77:0/397808655 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5b10153e60 0x7f5afc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.902+0000 7f5b15bad640 1 -- 172.21.15.77:0/397808655 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5afc0039a0 msgr2=0x7f5afc003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:05.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.902+0000 7f5b15bad640 1 --2- 172.21.15.77:0/397808655 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5afc0039a0 0x7f5afc003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.902+0000 7f5b15bad640 1 -- 172.21.15.77:0/397808655 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc003520 con 0x7f5afc004d00 2023-11-04T01:41:05.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.902+0000 7f5b15bad640 1 --2- 172.21.15.77:0/397808655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5afc004d00 0x7f5afc005180 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c00a7a0 tx=0x7f5afc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59575fd1894b494c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:05.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.902+0000 7f5b07fff640 1 -- 172.21.15.77:0/397808655 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c034630 con 0x7f5afc004d00 2023-11-04T01:41:05.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.902+0000 7f5b07fff640 1 -- 172.21.15.77:0/397808655 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0c02f070 con 0x7f5afc004d00 2023-11-04T01:41:05.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.902+0000 7f5b07fff640 1 -- 172.21.15.77:0/397808655 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c0349f0 con 0x7f5afc004d00 2023-11-04T01:41:05.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.903+0000 7f5b17610640 1 -- 172.21.15.77:0/397808655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5afc004d00 msgr2=0x7f5afc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.903+0000 7f5b17610640 1 --2- 172.21.15.77:0/397808655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5afc004d00 0x7f5afc005180 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c00a7a0 tx=0x7f5afc0057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.903+0000 7f5b15bad640 1 -- 172.21.15.77:0/397808655 reap_dead start 2023-11-04T01:41:05.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.903+0000 7f5b17610640 1 -- 172.21.15.77:0/397808655 shutdown_connections 2023-11-04T01:41:05.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.903+0000 7f5b17610640 1 -- 172.21.15.77:0/397808655 >> 172.21.15.77:0/397808655 conn(0x7f5b100cf880 msgr2=0x7f5b100cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:05.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.903+0000 7f5b17610640 1 -- 172.21.15.77:0/397808655 shutdown_connections 2023-11-04T01:41:05.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.903+0000 7f5b17610640 1 -- 172.21.15.77:0/397808655 wait complete. 2023-11-04T01:41:05.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.904+0000 7f5b17610640 1 Processor -- start 2023-11-04T01:41:05.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.904+0000 7f5b17610640 1 -- start start 2023-11-04T01:41:05.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.905+0000 7f5b17610640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5afc004d00 0x7f5b10150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.905+0000 7f5b17610640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b10156a10 0x7f5b10156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.905+0000 7f5b17610640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b10154840 0x7f5b10154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.905+0000 7f5b17610640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b101573d0 con 0x7f5b10154840 2023-11-04T01:41:05.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.905+0000 7f5b17610640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b10156130 con 0x7f5b10156a10 2023-11-04T01:41:05.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.905+0000 7f5b17610640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b101555b0 con 0x7f5afc004d00 2023-11-04T01:41:05.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.905+0000 7f5b15bad640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b10154840 0x7f5b10154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.905+0000 7f5b15bad640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b10154840 0x7f5b10154cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55046/0 (socket says 172.21.15.77:55046) 2023-11-04T01:41:05.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.905+0000 7f5b15bad640 1 -- 172.21.15.77:0/333335002 learned_addr learned my addr 172.21.15.77:0/333335002 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:05.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.905+0000 7f5b153ac640 1 --2- 172.21.15.77:0/333335002 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5afc004d00 0x7f5b10150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.905+0000 7f5b14bab640 1 --2- 172.21.15.77:0/333335002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b10156a10 0x7f5b10156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.905+0000 7f5b15bad640 1 -- 172.21.15.77:0/333335002 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5afc004d00 msgr2=0x7f5b10150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.905+0000 7f5b15bad640 1 --2- 172.21.15.77:0/333335002 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5afc004d00 0x7f5b10150400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.905+0000 7f5b15bad640 1 -- 172.21.15.77:0/333335002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b10156a10 msgr2=0x7f5b10156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:05.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.905+0000 7f5b15bad640 1 --2- 172.21.15.77:0/333335002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b10156a10 0x7f5b10156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:05.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.905+0000 7f5b15bad640 1 -- 172.21.15.77:0/333335002 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b10155890 con 0x7f5b10154840 2023-11-04T01:41:05.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.905+0000 7f5b15bad640 1 --2- 172.21.15.77:0/333335002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b10154840 0x7f5b10154cc0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c02cad0 tx=0x7f5b100d0690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:05.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.906+0000 7f5b05ffb640 1 -- 172.21.15.77:0/333335002 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c034640 con 0x7f5b10154840 2023-11-04T01:41:05.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.906+0000 7f5b05ffb640 1 -- 172.21.15.77:0/333335002 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0c0347a0 con 0x7f5b10154840 2023-11-04T01:41:05.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.906+0000 7f5b17610640 1 -- 172.21.15.77:0/333335002 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b10155b70 con 0x7f5b10154840 2023-11-04T01:41:05.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.906+0000 7f5b05ffb640 1 -- 172.21.15.77:0/333335002 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c034b10 con 0x7f5b10154840 2023-11-04T01:41:05.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.906+0000 7f5b17610640 1 -- 172.21.15.77:0/333335002 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b10155200 con 0x7f5b10154840 2023-11-04T01:41:05.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.907+0000 7f5b17610640 1 -- 172.21.15.77:0/333335002 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b10074290 con 0x7f5b10154840 2023-11-04T01:41:05.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.907+0000 7f5b05ffb640 1 -- 172.21.15.77:0/333335002 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5b0c031030 con 0x7f5b10154840 2023-11-04T01:41:05.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.908+0000 7f5b05ffb640 1 --2- 172.21.15.77:0/333335002 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5af406aea0 0x7f5af406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:05.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.908+0000 7f5b05ffb640 1 -- 172.21.15.77:0/333335002 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5b0c0aba80 con 0x7f5b10154840 2023-11-04T01:41:05.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.908+0000 7f5b153ac640 1 --2- 172.21.15.77:0/333335002 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5af406aea0 0x7f5af406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:05.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.908+0000 7f5b153ac640 1 --2- 172.21.15.77:0/333335002 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5af406aea0 0x7f5af406d360 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5b1015e3d0 tx=0x7f5b08009190 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:05.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:05.912+0000 7f5b05ffb640 1 -- 172.21.15.77:0/333335002 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5b0c076890 con 0x7f5b10154840 2023-11-04T01:41:06.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.076+0000 7f5b17610640 1 -- 172.21.15.77:0/333335002 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5b10074290 con 0x7f5b10154840 2023-11-04T01:41:06.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.077+0000 7f5b05ffb640 1 -- 172.21.15.77:0/333335002 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5b0c0011c0 con 0x7f5b10154840 2023-11-04T01:41:06.079 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:41:06.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.079+0000 7f5b17610640 1 -- 172.21.15.77:0/333335002 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5af406aea0 msgr2=0x7f5af406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.079+0000 7f5b17610640 1 --2- 172.21.15.77:0/333335002 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5af406aea0 0x7f5af406d360 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5b1015e3d0 tx=0x7f5b08009190 comp rx=0 tx=0).stop 2023-11-04T01:41:06.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.079+0000 7f5b17610640 1 -- 172.21.15.77:0/333335002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b10154840 msgr2=0x7f5b10154cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.079+0000 7f5b17610640 1 --2- 172.21.15.77:0/333335002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b10154840 0x7f5b10154cc0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c02cad0 tx=0x7f5b100d0690 comp rx=0 tx=0).stop 2023-11-04T01:41:06.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.079+0000 7f5b17610640 1 -- 172.21.15.77:0/333335002 shutdown_connections 2023-11-04T01:41:06.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.079+0000 7f5b17610640 1 --2- 172.21.15.77:0/333335002 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5af406aea0 0x7f5af406d360 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.079+0000 7f5b17610640 1 --2- 172.21.15.77:0/333335002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b10154840 0x7f5b10154cc0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.079+0000 7f5b17610640 1 --2- 172.21.15.77:0/333335002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b10156a10 0x7f5b10156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.079+0000 7f5b17610640 1 --2- 172.21.15.77:0/333335002 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5afc004d00 0x7f5b10150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.079+0000 7f5b17610640 1 -- 172.21.15.77:0/333335002 >> 172.21.15.77:0/333335002 conn(0x7f5b100cf880 msgr2=0x7f5b1015fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:06.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.079+0000 7f5b17610640 1 -- 172.21.15.77:0/333335002 shutdown_connections 2023-11-04T01:41:06.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.079+0000 7f5b17610640 1 -- 172.21.15.77:0/333335002 wait complete. 2023-11-04T01:41:06.091 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:41:06.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.191+0000 7f5372df5640 1 Processor -- start 2023-11-04T01:41:06.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.191+0000 7f5372df5640 1 -- start start 2023-11-04T01:41:06.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.191+0000 7f5372df5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f536c0c4ff0 0x7f536c0cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.191+0000 7f5372df5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f536c15aff0 con 0x7f536c159c00 2023-11-04T01:41:06.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.191+0000 7f5372df5640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f536c15a3e0 con 0x7f536c0adac0 2023-11-04T01:41:06.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.191+0000 7f5372df5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f536c15a6c0 con 0x7f536c0c4ff0 2023-11-04T01:41:06.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.191+0000 7f5370b91640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f536c159c00 0x7f536c0c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52794/0 (socket says 172.21.15.77:52794) 2023-11-04T01:41:06.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.192+0000 7f5370b91640 1 -- 172.21.15.77:0/4183667348 learned_addr learned my addr 172.21.15.77:0/4183667348 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:06.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.192+0000 7f536bfff640 1 --2- 172.21.15.77:0/4183667348 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f536c0c4ff0 0x7f536c0cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.192+0000 7f536b7fe640 1 -- 172.21.15.77:0/4183667348 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2403942755 0 0) 0x7f536c15aff0 con 0x7f536c159c00 2023-11-04T01:41:06.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.192+0000 7f536b7fe640 1 -- 172.21.15.77:0/4183667348 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5358003520 con 0x7f536c159c00 2023-11-04T01:41:06.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.192+0000 7f536b7fe640 1 -- 172.21.15.77:0/4183667348 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 153427022 0 0) 0x7f5358003520 con 0x7f536c159c00 2023-11-04T01:41:06.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.192+0000 7f536b7fe640 1 -- 172.21.15.77:0/4183667348 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f536c0c4ff0 msgr2=0x7f536c0cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:06.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.192+0000 7f536b7fe640 1 --2- 172.21.15.77:0/4183667348 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f536c0c4ff0 0x7f536c0cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.192+0000 7f536b7fe640 1 -- 172.21.15.77:0/4183667348 >> v1:172.21.15.122:6789/0 conn(0x7f536c0adac0 legacy=0x7f536c0adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.192+0000 7f536b7fe640 1 -- 172.21.15.77:0/4183667348 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f536c15a9a0 con 0x7f536c159c00 2023-11-04T01:41:06.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.192+0000 7f536b7fe640 1 -- 172.21.15.77:0/4183667348 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f53640019f0 con 0x7f536c159c00 2023-11-04T01:41:06.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.192+0000 7f536b7fe640 1 -- 172.21.15.77:0/4183667348 >> v1:172.21.15.77:6789/0 conn(0x7f536c159c00 legacy=0x7f536c0c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.192+0000 7f536b7fe640 1 --2- 172.21.15.77:0/4183667348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53580039a0 0x7f5358003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.192+0000 7f536b7fe640 1 --2- 172.21.15.77:0/4183667348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5358004350 0x7f5358004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.192+0000 7f536b7fe640 1 --2- 172.21.15.77:0/4183667348 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f536c0c4ff0 0x7f5358005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.192+0000 7f536b7fe640 1 -- 172.21.15.77:0/4183667348 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536c15a6c0 con 0x7f53580039a0 2023-11-04T01:41:06.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.192+0000 7f536b7fe640 1 -- 172.21.15.77:0/4183667348 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535800dbf0 con 0x7f5358004350 2023-11-04T01:41:06.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.192+0000 7f536b7fe640 1 -- 172.21.15.77:0/4183667348 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f535800ddb0 con 0x7f536c0c4ff0 2023-11-04T01:41:06.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.192+0000 7f5370b91640 1 --2- 172.21.15.77:0/4183667348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53580039a0 0x7f5358003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.192+0000 7f536bfff640 1 --2- 172.21.15.77:0/4183667348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5358004350 0x7f5358004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.192+0000 7f5371392640 1 --2- 172.21.15.77:0/4183667348 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f536c0c4ff0 0x7f5358005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.192+0000 7f5370b91640 1 -- 172.21.15.77:0/4183667348 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f536c0c4ff0 msgr2=0x7f5358005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:06.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.192+0000 7f5370b91640 1 --2- 172.21.15.77:0/4183667348 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f536c0c4ff0 0x7f5358005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.192+0000 7f5370b91640 1 -- 172.21.15.77:0/4183667348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5358004350 msgr2=0x7f5358004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:06.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.192+0000 7f5370b91640 1 --2- 172.21.15.77:0/4183667348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5358004350 0x7f5358004820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.192+0000 7f5370b91640 1 -- 172.21.15.77:0/4183667348 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5358003520 con 0x7f53580039a0 2023-11-04T01:41:06.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.193+0000 7f5370b91640 1 --2- 172.21.15.77:0/4183667348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53580039a0 0x7f5358003d80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f536400a810 tx=0x7f53580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc92555383f9c6f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:06.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.193+0000 7f536b7fe640 1 -- 172.21.15.77:0/4183667348 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5364034630 con 0x7f53580039a0 2023-11-04T01:41:06.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.193+0000 7f536b7fe640 1 -- 172.21.15.77:0/4183667348 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f536402f070 con 0x7f53580039a0 2023-11-04T01:41:06.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.193+0000 7f536b7fe640 1 -- 172.21.15.77:0/4183667348 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53640349d0 con 0x7f53580039a0 2023-11-04T01:41:06.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.194+0000 7f5372df5640 1 -- 172.21.15.77:0/4183667348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53580039a0 msgr2=0x7f5358003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.194+0000 7f5372df5640 1 --2- 172.21.15.77:0/4183667348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53580039a0 0x7f5358003d80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f536400a810 tx=0x7f53580057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.194+0000 7f5371392640 1 -- 172.21.15.77:0/4183667348 reap_dead start 2023-11-04T01:41:06.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.194+0000 7f5372df5640 1 -- 172.21.15.77:0/4183667348 shutdown_connections 2023-11-04T01:41:06.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.194+0000 7f5372df5640 1 -- 172.21.15.77:0/4183667348 >> 172.21.15.77:0/4183667348 conn(0x7f536c0ce950 msgr2=0x7f536c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:06.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.194+0000 7f5372df5640 1 -- 172.21.15.77:0/4183667348 shutdown_connections 2023-11-04T01:41:06.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.194+0000 7f5372df5640 1 -- 172.21.15.77:0/4183667348 wait complete. 2023-11-04T01:41:06.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.195+0000 7f5372df5640 1 Processor -- start 2023-11-04T01:41:06.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.195+0000 7f5372df5640 1 -- start start 2023-11-04T01:41:06.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.196+0000 7f5372df5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53580039a0 0x7f536c1477b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.196+0000 7f5372df5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f536c14f5a0 0x7f536c148f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.196+0000 7f5372df5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f536c14fa20 0x7f536c149490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.196+0000 7f5372df5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536c15c170 con 0x7f536c14fa20 2023-11-04T01:41:06.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.196+0000 7f5372df5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536c147cf0 con 0x7f536c14f5a0 2023-11-04T01:41:06.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.196+0000 7f5372df5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f536c15be90 con 0x7f53580039a0 2023-11-04T01:41:06.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.196+0000 7f5371392640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f536c14fa20 0x7f536c149490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.196+0000 7f5371392640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f536c14fa20 0x7f536c149490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55068/0 (socket says 172.21.15.77:55068) 2023-11-04T01:41:06.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.196+0000 7f5371392640 1 -- 172.21.15.77:0/3001189206 learned_addr learned my addr 172.21.15.77:0/3001189206 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:06.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.196+0000 7f536bfff640 1 --2- 172.21.15.77:0/3001189206 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f536c14f5a0 0x7f536c148f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.196+0000 7f5370b91640 1 --2- 172.21.15.77:0/3001189206 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53580039a0 0x7f536c1477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.196+0000 7f5371392640 1 -- 172.21.15.77:0/3001189206 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53580039a0 msgr2=0x7f536c1477b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.196+0000 7f5371392640 1 --2- 172.21.15.77:0/3001189206 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53580039a0 0x7f536c1477b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.196+0000 7f5371392640 1 -- 172.21.15.77:0/3001189206 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f536c14f5a0 msgr2=0x7f536c148f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.196+0000 7f5371392640 1 --2- 172.21.15.77:0/3001189206 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f536c14f5a0 0x7f536c148f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.196+0000 7f5371392640 1 -- 172.21.15.77:0/3001189206 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f536c0c5bc0 con 0x7f536c14fa20 2023-11-04T01:41:06.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.196+0000 7f5370b91640 1 --2- 172.21.15.77:0/3001189206 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53580039a0 0x7f536c1477b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:06.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.196+0000 7f5371392640 1 --2- 172.21.15.77:0/3001189206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f536c14fa20 0x7f536c149490 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f536c0cb070 tx=0x7f535c00fb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:06.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.197+0000 7f53697fa640 1 -- 172.21.15.77:0/3001189206 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c005030 con 0x7f536c14fa20 2023-11-04T01:41:06.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.197+0000 7f53697fa640 1 -- 172.21.15.77:0/3001189206 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535c0051b0 con 0x7f536c14fa20 2023-11-04T01:41:06.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.197+0000 7f5372df5640 1 -- 172.21.15.77:0/3001189206 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f536c0c5ea0 con 0x7f536c14fa20 2023-11-04T01:41:06.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.197+0000 7f53697fa640 1 -- 172.21.15.77:0/3001189206 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c007030 con 0x7f536c14fa20 2023-11-04T01:41:06.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.197+0000 7f5372df5640 1 -- 172.21.15.77:0/3001189206 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f536c0c66a0 con 0x7f536c14fa20 2023-11-04T01:41:06.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.197+0000 7f5372df5640 1 -- 172.21.15.77:0/3001189206 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f536c0c5a20 con 0x7f536c14fa20 2023-11-04T01:41:06.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.198+0000 7f53697fa640 1 -- 172.21.15.77:0/3001189206 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f535c007190 con 0x7f536c14fa20 2023-11-04T01:41:06.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.198+0000 7f53697fa640 1 --2- 172.21.15.77:0/3001189206 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f534c06ae70 0x7f534c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.198+0000 7f53697fa640 1 -- 172.21.15.77:0/3001189206 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f535c088830 con 0x7f536c14fa20 2023-11-04T01:41:06.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.199+0000 7f5370b91640 1 --2- 172.21.15.77:0/3001189206 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f534c06ae70 0x7f534c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.199+0000 7f5370b91640 1 --2- 172.21.15.77:0/3001189206 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f534c06ae70 0x7f534c06d330 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5364034000 tx=0x7f536402f000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:06.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.203+0000 7f53697fa640 1 -- 172.21.15.77:0/3001189206 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f536c0c5a20 con 0x7f536c14fa20 2023-11-04T01:41:06.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.380+0000 7f5372df5640 1 -- 172.21.15.77:0/3001189206 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f536c0c63c0 con 0x7f536c14fa20 2023-11-04T01:41:06.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.381+0000 7f53697fa640 1 -- 172.21.15.77:0/3001189206 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f536c0c63c0 con 0x7f536c14fa20 2023-11-04T01:41:06.383 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-11-04T01:41:06.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.383+0000 7f5372df5640 1 -- 172.21.15.77:0/3001189206 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f534c06ae70 msgr2=0x7f534c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.383+0000 7f5372df5640 1 --2- 172.21.15.77:0/3001189206 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f534c06ae70 0x7f534c06d330 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5364034000 tx=0x7f536402f000 comp rx=0 tx=0).stop 2023-11-04T01:41:06.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.383+0000 7f5372df5640 1 -- 172.21.15.77:0/3001189206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f536c14fa20 msgr2=0x7f536c149490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.383+0000 7f5372df5640 1 --2- 172.21.15.77:0/3001189206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f536c14fa20 0x7f536c149490 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f536c0cb070 tx=0x7f535c00fb40 comp rx=0 tx=0).stop 2023-11-04T01:41:06.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.383+0000 7f5372df5640 1 -- 172.21.15.77:0/3001189206 shutdown_connections 2023-11-04T01:41:06.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.383+0000 7f5372df5640 1 --2- 172.21.15.77:0/3001189206 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f534c06ae70 0x7f534c06d330 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.383+0000 7f5372df5640 1 --2- 172.21.15.77:0/3001189206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f536c14fa20 0x7f536c149490 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.383+0000 7f5372df5640 1 --2- 172.21.15.77:0/3001189206 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f536c14f5a0 0x7f536c148f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.383+0000 7f5372df5640 1 --2- 172.21.15.77:0/3001189206 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53580039a0 0x7f536c1477b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.383+0000 7f5372df5640 1 -- 172.21.15.77:0/3001189206 >> 172.21.15.77:0/3001189206 conn(0x7f536c0ce950 msgr2=0x7f536c154630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:06.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.383+0000 7f5372df5640 1 -- 172.21.15.77:0/3001189206 shutdown_connections 2023-11-04T01:41:06.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.383+0000 7f5372df5640 1 -- 172.21.15.77:0/3001189206 wait complete. 2023-11-04T01:41:06.395 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi077.front.sepia.ceph.com... 2023-11-04T01:41:06.395 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:41:06.396 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.2 2023-11-04T01:41:06.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:41:06.455 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi077.stderr:ceph-fuse[129394]: fuse finished with error 0 and tester_r 0 2023-11-04T01:41:06.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:41:06.459 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi077.stderr:2023-11-04T01:41:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:41:06.461 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:41:06.467 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2023-11-04T01:41:06.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:06.468 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:41:06.523 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:41:06.523 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:41:06.542 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:41:06.543 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:41:06.602 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:06.643 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi122.stderr:2023-11-04T01:41:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:41:06.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.701+0000 7f47fe207640 1 Processor -- start 2023-11-04T01:41:06.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.701+0000 7f47fe207640 1 -- start start 2023-11-04T01:41:06.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.702+0000 7f47fe207640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f47f815d250 0x7f47f80c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.702+0000 7f47fe207640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f47f80c9d70 0x7f47f80ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.702+0000 7f47fe207640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f806a120 con 0x7f47f815ce70 2023-11-04T01:41:06.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.702+0000 7f47fe207640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f80cdc10 con 0x7f47f80c9d70 2023-11-04T01:41:06.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.702+0000 7f47fe207640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f806a370 con 0x7f47f815d250 2023-11-04T01:41:06.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.702+0000 7f47f77fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f47f815ce70 0x7f47f806d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52798/0 (socket says 172.21.15.77:52798) 2023-11-04T01:41:06.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.702+0000 7f47f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f47f80c9d70 0x7f47f80ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.702+0000 7f47f77fe640 1 -- 172.21.15.77:0/2384029239 learned_addr learned my addr 172.21.15.77:0/2384029239 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:06.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.702+0000 7f47f7fff640 1 -- 172.21.15.77:0/2384029239 >> v2:172.21.15.122:3300/0 conn(0x7f47f815d250 msgr2=0x7f47f80c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:06.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.702+0000 7f47f7fff640 1 --2- 172.21.15.77:0/2384029239 >> v2:172.21.15.122:3300/0 conn(0x7f47f815d250 0x7f47f80c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.702+0000 7f47f7fff640 1 -- 172.21.15.77:0/2384029239 >> v1:172.21.15.77:6789/0 conn(0x7f47f815ce70 legacy=0x7f47f806d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.702+0000 7f47f7fff640 1 -- 172.21.15.77:0/2384029239 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f806a650 con 0x7f47f80c9d70 2023-11-04T01:41:06.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.702+0000 7f47f67fc640 1 -- 172.21.15.77:0/2384029239 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2445091014 0 0) 0x7f47f806a120 con 0x7f47f815ce70 2023-11-04T01:41:06.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.703+0000 7f47f7fff640 1 --2- 172.21.15.77:0/2384029239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47f80c9d70 0x7f47f80ccdb0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f47f80d02c0 tx=0x7f47f002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=413de9568a4e0006 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:06.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.703+0000 7f47f67fc640 1 -- 172.21.15.77:0/2384029239 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f002cc80 con 0x7f47f80c9d70 2023-11-04T01:41:06.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.703+0000 7f47f67fc640 1 -- 172.21.15.77:0/2384029239 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f002cde0 con 0x7f47f80c9d70 2023-11-04T01:41:06.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.703+0000 7f47f67fc640 1 -- 172.21.15.77:0/2384029239 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f0034660 con 0x7f47f80c9d70 2023-11-04T01:41:06.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.704+0000 7f47fe207640 1 -- 172.21.15.77:0/2384029239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47f80c9d70 msgr2=0x7f47f80ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.704+0000 7f47fe207640 1 --2- 172.21.15.77:0/2384029239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47f80c9d70 0x7f47f80ccdb0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f47f80d02c0 tx=0x7f47f002bed0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.704+0000 7f47fe207640 1 -- 172.21.15.77:0/2384029239 shutdown_connections 2023-11-04T01:41:06.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.704+0000 7f47fe207640 1 --2- 172.21.15.77:0/2384029239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47f80c9d70 0x7f47f80ccdb0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.704+0000 7f47fe207640 1 --2- 172.21.15.77:0/2384029239 >> v2:172.21.15.122:3300/0 conn(0x7f47f815d250 0x7f47f80c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.704+0000 7f47fe207640 1 -- 172.21.15.77:0/2384029239 >> 172.21.15.77:0/2384029239 conn(0x7f47f80b0cd0 msgr2=0x7f47f80b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:06.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.704+0000 7f47fe207640 1 -- 172.21.15.77:0/2384029239 shutdown_connections 2023-11-04T01:41:06.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.704+0000 7f47fe207640 1 -- 172.21.15.77:0/2384029239 wait complete. 2023-11-04T01:41:06.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.705+0000 7f47fe207640 1 Processor -- start 2023-11-04T01:41:06.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.705+0000 7f47fe207640 1 -- start start 2023-11-04T01:41:06.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.706+0000 7f47fe207640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f47f815ce70 0x7f47f8140060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.706+0000 7f47fe207640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47f815d250 0x7f47f81f23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.706+0000 7f47fe207640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47f81e47e0 0x7f47f81e4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.706+0000 7f47fe207640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f81e51a0 con 0x7f47f815d250 2023-11-04T01:41:06.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.706+0000 7f47fe207640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f81e7a00 con 0x7f47f81e47e0 2023-11-04T01:41:06.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.706+0000 7f47fe207640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f80c3a70 con 0x7f47f815ce70 2023-11-04T01:41:06.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.706+0000 7f47f6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47f815d250 0x7f47f81f23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.706+0000 7f47f6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47f815d250 0x7f47f81f23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55082/0 (socket says 172.21.15.77:55082) 2023-11-04T01:41:06.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.706+0000 7f47f6ffd640 1 -- 172.21.15.77:0/2651183642 learned_addr learned my addr 172.21.15.77:0/2651183642 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:06.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.706+0000 7f47f7fff640 1 --2- 172.21.15.77:0/2651183642 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47f81e47e0 0x7f47f81e4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.706+0000 7f47f77fe640 1 --2- 172.21.15.77:0/2651183642 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f47f815ce70 0x7f47f8140060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.706+0000 7f47f6ffd640 1 -- 172.21.15.77:0/2651183642 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f47f815ce70 msgr2=0x7f47f8140060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.706+0000 7f47f6ffd640 1 --2- 172.21.15.77:0/2651183642 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f47f815ce70 0x7f47f8140060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.706+0000 7f47f6ffd640 1 -- 172.21.15.77:0/2651183642 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47f81e47e0 msgr2=0x7f47f81e4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.706+0000 7f47f6ffd640 1 --2- 172.21.15.77:0/2651183642 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47f81e47e0 0x7f47f81e4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.706+0000 7f47f6ffd640 1 -- 172.21.15.77:0/2651183642 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f0009a70 con 0x7f47f815d250 2023-11-04T01:41:06.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.706+0000 7f47f7fff640 1 --2- 172.21.15.77:0/2651183642 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47f81e47e0 0x7f47f81e4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:06.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.706+0000 7f47f6ffd640 1 --2- 172.21.15.77:0/2651183642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47f815d250 0x7f47f81f23b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f47ec00b410 tx=0x7f47ec00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:06.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.706+0000 7f47dffff640 1 -- 172.21.15.77:0/2651183642 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec011830 con 0x7f47f815d250 2023-11-04T01:41:06.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.706+0000 7f47dffff640 1 -- 172.21.15.77:0/2651183642 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ec011990 con 0x7f47f815d250 2023-11-04T01:41:06.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.706+0000 7f47fe207640 1 -- 172.21.15.77:0/2651183642 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47f80c3d50 con 0x7f47f815d250 2023-11-04T01:41:06.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.706+0000 7f47dffff640 1 -- 172.21.15.77:0/2651183642 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec011d40 con 0x7f47f815d250 2023-11-04T01:41:06.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.706+0000 7f47fe207640 1 -- 172.21.15.77:0/2651183642 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f80c4310 con 0x7f47f815d250 2023-11-04T01:41:06.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.707+0000 7f47fe207640 1 -- 172.21.15.77:0/2651183642 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47f80c4530 con 0x7f47f815d250 2023-11-04T01:41:06.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.708+0000 7f47dffff640 1 -- 172.21.15.77:0/2651183642 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f47ec01a400 con 0x7f47f815d250 2023-11-04T01:41:06.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.708+0000 7f47dffff640 1 --2- 172.21.15.77:0/2651183642 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f47e406ae70 0x7f47e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:06.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.708+0000 7f47dffff640 1 -- 172.21.15.77:0/2651183642 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f47ec089b20 con 0x7f47f815d250 2023-11-04T01:41:06.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.708+0000 7f47f77fe640 1 --2- 172.21.15.77:0/2651183642 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f47e406ae70 0x7f47e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:06.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.709+0000 7f47f77fe640 1 --2- 172.21.15.77:0/2651183642 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f47e406ae70 0x7f47e406d330 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f47e8000f60 tx=0x7f47e8007b50 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:06.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.712+0000 7f47dffff640 1 -- 172.21.15.77:0/2651183642 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f47ec054810 con 0x7f47f815d250 2023-11-04T01:41:06.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.880+0000 7f47fe207640 1 -- 172.21.15.77:0/2651183642 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47f8074290 con 0x7f47f815d250 2023-11-04T01:41:06.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.881+0000 7f47dffff640 1 -- 172.21.15.77:0/2651183642 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18661 (secure 0 0 0) 0x7f47ec015020 con 0x7f47f815d250 2023-11-04T01:41:06.883 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:06.883 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":26,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:40:47.579547+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:40:02.810971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:40:04.003979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:40:07.734355+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:06.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.883+0000 7f47fe207640 1 -- 172.21.15.77:0/2651183642 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f47e406ae70 msgr2=0x7f47e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.883+0000 7f47fe207640 1 --2- 172.21.15.77:0/2651183642 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f47e406ae70 0x7f47e406d330 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f47e8000f60 tx=0x7f47e8007b50 comp rx=0 tx=0).stop 2023-11-04T01:41:06.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.883+0000 7f47fe207640 1 -- 172.21.15.77:0/2651183642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47f815d250 msgr2=0x7f47f81f23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:06.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.883+0000 7f47fe207640 1 --2- 172.21.15.77:0/2651183642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47f815d250 0x7f47f81f23b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f47ec00b410 tx=0x7f47ec00b8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.883+0000 7f47fe207640 1 -- 172.21.15.77:0/2651183642 shutdown_connections 2023-11-04T01:41:06.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.883+0000 7f47fe207640 1 --2- 172.21.15.77:0/2651183642 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f47e406ae70 0x7f47e406d330 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.883+0000 7f47fe207640 1 --2- 172.21.15.77:0/2651183642 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47f81e47e0 0x7f47f81e4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.883+0000 7f47fe207640 1 --2- 172.21.15.77:0/2651183642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47f815d250 0x7f47f81f23b0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.883+0000 7f47fe207640 1 --2- 172.21.15.77:0/2651183642 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f47f815ce70 0x7f47f8140060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:06.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.883+0000 7f47fe207640 1 -- 172.21.15.77:0/2651183642 >> 172.21.15.77:0/2651183642 conn(0x7f47f80b0cd0 msgr2=0x7f47f815c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:06.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.883+0000 7f47fe207640 1 -- 172.21.15.77:0/2651183642 shutdown_connections 2023-11-04T01:41:06.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.883+0000 7f47fe207640 1 -- 172.21.15.77:0/2651183642 wait complete. 2023-11-04T01:41:06.896 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:40:02.810971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:40:04.003979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:40:07.734355+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:41:06.897 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:41:07.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.998+0000 7f8217a7c640 1 Processor -- start 2023-11-04T01:41:07.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.998+0000 7f8217a7c640 1 -- start start 2023-11-04T01:41:07.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.999+0000 7f8217a7c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8210070e20 0x7f82100adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.999+0000 7f8217a7c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82100c3900 con 0x7f821015ad30 2023-11-04T01:41:07.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.999+0000 7f8217a7c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82100c3be0 con 0x7f82100ad730 2023-11-04T01:41:07.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.999+0000 7f8217a7c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82100ae260 con 0x7f8210070e20 2023-11-04T01:41:07.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.999+0000 7f8215017640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8210070e20 0x7f82100adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.999+0000 7f8215818640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f821015ad30 0x7f8210070710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52800/0 (socket says 172.21.15.77:52800) 2023-11-04T01:41:07.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:06.999+0000 7f8215818640 1 -- 172.21.15.77:0/1422154918 learned_addr learned my addr 172.21.15.77:0/1422154918 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:07.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.000+0000 7f8215017640 1 -- 172.21.15.77:0/1422154918 >> v1:172.21.15.122:6789/0 conn(0x7f82100ad730 legacy=0x7f821015e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:07.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.000+0000 7f8215017640 1 -- 172.21.15.77:0/1422154918 >> v1:172.21.15.77:6789/0 conn(0x7f821015ad30 legacy=0x7f8210070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:07.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.000+0000 7f8215017640 1 -- 172.21.15.77:0/1422154918 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82100c3ec0 con 0x7f8210070e20 2023-11-04T01:41:07.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.000+0000 7f8215017640 1 --2- 172.21.15.77:0/1422154918 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8210070e20 0x7f82100adc80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f82000097a0 tx=0x7f820002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d0611675eab5a9e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:07.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.000+0000 7f8214816640 1 -- 172.21.15.77:0/1422154918 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820002e070 con 0x7f8210070e20 2023-11-04T01:41:07.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.000+0000 7f8214816640 1 -- 172.21.15.77:0/1422154918 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82000315a0 con 0x7f8210070e20 2023-11-04T01:41:07.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.000+0000 7f8214816640 1 -- 172.21.15.77:0/1422154918 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8200031930 con 0x7f8210070e20 2023-11-04T01:41:07.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.001+0000 7f8217a7c640 1 -- 172.21.15.77:0/1422154918 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8210070e20 msgr2=0x7f82100adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:07.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.001+0000 7f8217a7c640 1 --2- 172.21.15.77:0/1422154918 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8210070e20 0x7f82100adc80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f82000097a0 tx=0x7f820002b840 comp rx=0 tx=0).stop 2023-11-04T01:41:07.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.001+0000 7f8217a7c640 1 -- 172.21.15.77:0/1422154918 shutdown_connections 2023-11-04T01:41:07.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.001+0000 7f8217a7c640 1 --2- 172.21.15.77:0/1422154918 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8210070e20 0x7f82100adc80 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.001+0000 7f8217a7c640 1 -- 172.21.15.77:0/1422154918 >> 172.21.15.77:0/1422154918 conn(0x7f82100ce950 msgr2=0x7f82100ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:07.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.001+0000 7f8217a7c640 1 -- 172.21.15.77:0/1422154918 shutdown_connections 2023-11-04T01:41:07.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.001+0000 7f8217a7c640 1 -- 172.21.15.77:0/1422154918 wait complete. 2023-11-04T01:41:07.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.002+0000 7f8217a7c640 1 Processor -- start 2023-11-04T01:41:07.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.002+0000 7f8217a7c640 1 -- start start 2023-11-04T01:41:07.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.003+0000 7f8217a7c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8210070e20 0x7f82100c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.003+0000 7f8217a7c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82100ad730 0x7f82101557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.003+0000 7f8217a7c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f821015ad30 0x7f82101f2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.003+0000 7f8217a7c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82100c8530 con 0x7f82100ad730 2023-11-04T01:41:07.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.003+0000 7f8217a7c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82100c7b60 con 0x7f8210070e20 2023-11-04T01:41:07.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.003+0000 7f8217a7c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82100c6f50 con 0x7f821015ad30 2023-11-04T01:41:07.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.003+0000 7f8215017640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82100ad730 0x7f82101557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.003+0000 7f8215017640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82100ad730 0x7f82101557b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55106/0 (socket says 172.21.15.77:55106) 2023-11-04T01:41:07.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.003+0000 7f8215017640 1 -- 172.21.15.77:0/2116434642 learned_addr learned my addr 172.21.15.77:0/2116434642 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:07.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.003+0000 7f8215818640 1 --2- 172.21.15.77:0/2116434642 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8210070e20 0x7f82100c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.003+0000 7f8216019640 1 --2- 172.21.15.77:0/2116434642 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f821015ad30 0x7f82101f2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.003+0000 7f8215017640 1 -- 172.21.15.77:0/2116434642 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f821015ad30 msgr2=0x7f82101f2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:07.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.003+0000 7f8215017640 1 --2- 172.21.15.77:0/2116434642 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f821015ad30 0x7f82101f2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.003+0000 7f8215017640 1 -- 172.21.15.77:0/2116434642 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8210070e20 msgr2=0x7f82100c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:07.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.003+0000 7f8215017640 1 --2- 172.21.15.77:0/2116434642 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8210070e20 0x7f82100c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.003+0000 7f8215017640 1 -- 172.21.15.77:0/2116434642 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8200009400 con 0x7f82100ad730 2023-11-04T01:41:07.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.004+0000 7f8215017640 1 --2- 172.21.15.77:0/2116434642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82100ad730 0x7f82101557b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f82000098c0 tx=0x7f82000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:07.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.004+0000 7f82067fc640 1 -- 172.21.15.77:0/2116434642 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8200032900 con 0x7f82100ad730 2023-11-04T01:41:07.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.004+0000 7f82067fc640 1 -- 172.21.15.77:0/2116434642 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8200032a80 con 0x7f82100ad730 2023-11-04T01:41:07.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.004+0000 7f8217a7c640 1 -- 172.21.15.77:0/2116434642 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82100c7230 con 0x7f82100ad730 2023-11-04T01:41:07.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.004+0000 7f82067fc640 1 -- 172.21.15.77:0/2116434642 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8200032e30 con 0x7f82100ad730 2023-11-04T01:41:07.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.004+0000 7f8217a7c640 1 -- 172.21.15.77:0/2116434642 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82100c77f0 con 0x7f82100ad730 2023-11-04T01:41:07.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.005+0000 7f8217a7c640 1 -- 172.21.15.77:0/2116434642 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82100c7cf0 con 0x7f82100ad730 2023-11-04T01:41:07.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.005+0000 7f82067fc640 1 -- 172.21.15.77:0/2116434642 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f820003b3f0 con 0x7f82100ad730 2023-11-04T01:41:07.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.005+0000 7f82067fc640 1 --2- 172.21.15.77:0/2116434642 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f81f406ae70 0x7f81f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.006+0000 7f82067fc640 1 -- 172.21.15.77:0/2116434642 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f82000aba70 con 0x7f82100ad730 2023-11-04T01:41:07.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.006+0000 7f8215818640 1 --2- 172.21.15.77:0/2116434642 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f81f406ae70 0x7f81f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.006+0000 7f8215818640 1 --2- 172.21.15.77:0/2116434642 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f81f406ae70 0x7f81f406d330 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f820c005c00 tx=0x7f820c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:07.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.010+0000 7f82067fc640 1 -- 172.21.15.77:0/2116434642 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8200076760 con 0x7f82100ad730 2023-11-04T01:41:07.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.174+0000 7f8217a7c640 1 -- 172.21.15.77:0/2116434642 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8210157c40 con 0x7f82100ad730 2023-11-04T01:41:07.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.174+0000 7f82067fc640 1 -- 172.21.15.77:0/2116434642 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8200079d80 con 0x7f82100ad730 2023-11-04T01:41:07.176 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:41:07.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.176+0000 7f8217a7c640 1 -- 172.21.15.77:0/2116434642 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f81f406ae70 msgr2=0x7f81f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:07.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.176+0000 7f8217a7c640 1 --2- 172.21.15.77:0/2116434642 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f81f406ae70 0x7f81f406d330 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f820c005c00 tx=0x7f820c009040 comp rx=0 tx=0).stop 2023-11-04T01:41:07.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.176+0000 7f8217a7c640 1 -- 172.21.15.77:0/2116434642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82100ad730 msgr2=0x7f82101557b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:07.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.176+0000 7f8217a7c640 1 --2- 172.21.15.77:0/2116434642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82100ad730 0x7f82101557b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f82000098c0 tx=0x7f82000046c0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.176+0000 7f8217a7c640 1 -- 172.21.15.77:0/2116434642 shutdown_connections 2023-11-04T01:41:07.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.176+0000 7f8217a7c640 1 --2- 172.21.15.77:0/2116434642 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f81f406ae70 0x7f81f406d330 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.176+0000 7f8217a7c640 1 --2- 172.21.15.77:0/2116434642 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f821015ad30 0x7f82101f2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.176+0000 7f8217a7c640 1 --2- 172.21.15.77:0/2116434642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82100ad730 0x7f82101557b0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.176+0000 7f8217a7c640 1 --2- 172.21.15.77:0/2116434642 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8210070e20 0x7f82100c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.176+0000 7f8217a7c640 1 -- 172.21.15.77:0/2116434642 >> 172.21.15.77:0/2116434642 conn(0x7f82100ce950 msgr2=0x7f82100ab8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:07.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.176+0000 7f8217a7c640 1 -- 172.21.15.77:0/2116434642 shutdown_connections 2023-11-04T01:41:07.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.176+0000 7f8217a7c640 1 -- 172.21.15.77:0/2116434642 wait complete. 2023-11-04T01:41:07.188 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:41:07.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.290+0000 7f30834ec640 1 Processor -- start 2023-11-04T01:41:07.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.290+0000 7f30834ec640 1 -- start start 2023-11-04T01:41:07.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.291+0000 7f30834ec640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f307c1605b0 0x7f307c0ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.291+0000 7f30834ec640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f307c06a830 0x7f307c0cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.291+0000 7f30834ec640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f307c160990 con 0x7f307c0b1a40 2023-11-04T01:41:07.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.291+0000 7f30834ec640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f307c0cc7c0 con 0x7f307c1605b0 2023-11-04T01:41:07.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.291+0000 7f30834ec640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f307c0cd750 con 0x7f307c06a830 2023-11-04T01:41:07.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.291+0000 7f3081288640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f307c1605b0 0x7f307c0ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.291+0000 7f3081288640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f307c1605b0 0x7f307c0ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55116/0 (socket says 172.21.15.77:55116) 2023-11-04T01:41:07.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.291+0000 7f3081288640 1 -- 172.21.15.77:0/1034151658 learned_addr learned my addr 172.21.15.77:0/1034151658 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:07.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.291+0000 7f3081288640 1 -- 172.21.15.77:0/1034151658 >> v2:172.21.15.122:3300/0 conn(0x7f307c06a830 msgr2=0x7f307c0cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:07.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.291+0000 7f3081a89640 1 --2- 172.21.15.77:0/1034151658 >> v2:172.21.15.122:3300/0 conn(0x7f307c06a830 0x7f307c0cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.291+0000 7f3081288640 1 --2- 172.21.15.77:0/1034151658 >> v2:172.21.15.122:3300/0 conn(0x7f307c06a830 0x7f307c0cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.291+0000 7f3081288640 1 -- 172.21.15.77:0/1034151658 >> v1:172.21.15.122:6789/0 conn(0x7f307c0b1a40 legacy=0x7f307c06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:07.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.291+0000 7f3081288640 1 -- 172.21.15.77:0/1034151658 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f307c0cc4e0 con 0x7f307c1605b0 2023-11-04T01:41:07.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.291+0000 7f3081a89640 1 --2- 172.21.15.77:0/1034151658 >> v2:172.21.15.122:3300/0 conn(0x7f307c06a830 0x7f307c0cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:07.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.292+0000 7f3081288640 1 --2- 172.21.15.77:0/1034151658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f307c1605b0 0x7f307c0ccbc0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f307c0c6aa0 tx=0x7f307802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab29cccbddea7b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:07.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.292+0000 7f3073fff640 1 -- 172.21.15.77:0/1034151658 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3078031750 con 0x7f307c1605b0 2023-11-04T01:41:07.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.292+0000 7f3073fff640 1 -- 172.21.15.77:0/1034151658 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30780318b0 con 0x7f307c1605b0 2023-11-04T01:41:07.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.292+0000 7f3073fff640 1 -- 172.21.15.77:0/1034151658 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3078031c40 con 0x7f307c1605b0 2023-11-04T01:41:07.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.293+0000 7f30834ec640 1 -- 172.21.15.77:0/1034151658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f307c1605b0 msgr2=0x7f307c0ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:07.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.293+0000 7f30834ec640 1 --2- 172.21.15.77:0/1034151658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f307c1605b0 0x7f307c0ccbc0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f307c0c6aa0 tx=0x7f307802b7f0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.293+0000 7f30834ec640 1 -- 172.21.15.77:0/1034151658 shutdown_connections 2023-11-04T01:41:07.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.293+0000 7f30834ec640 1 --2- 172.21.15.77:0/1034151658 >> v2:172.21.15.122:3300/0 conn(0x7f307c06a830 0x7f307c0cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.293+0000 7f30834ec640 1 --2- 172.21.15.77:0/1034151658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f307c1605b0 0x7f307c0ccbc0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.293+0000 7f30834ec640 1 -- 172.21.15.77:0/1034151658 >> 172.21.15.77:0/1034151658 conn(0x7f307c071820 msgr2=0x7f307c071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:07.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.293+0000 7f30834ec640 1 -- 172.21.15.77:0/1034151658 shutdown_connections 2023-11-04T01:41:07.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.293+0000 7f30834ec640 1 -- 172.21.15.77:0/1034151658 wait complete. 2023-11-04T01:41:07.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.294+0000 7f30834ec640 1 Processor -- start 2023-11-04T01:41:07.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.294+0000 7f30834ec640 1 -- start start 2023-11-04T01:41:07.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.294+0000 7f30834ec640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f307c06a830 0x7f307c15f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.294+0000 7f30834ec640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f307c1605b0 0x7f307c0b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.294+0000 7f30834ec640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f307c15b110 0x7f307c0adab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.294+0000 7f30834ec640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307c15fcb0 con 0x7f307c06a830 2023-11-04T01:41:07.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.294+0000 7f30834ec640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307c0c6bc0 con 0x7f307c1605b0 2023-11-04T01:41:07.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.295+0000 7f30834ec640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f307c0c6ea0 con 0x7f307c15b110 2023-11-04T01:41:07.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.295+0000 7f3081288640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f307c06a830 0x7f307c15f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.295+0000 7f3081288640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f307c06a830 0x7f307c15f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55126/0 (socket says 172.21.15.77:55126) 2023-11-04T01:41:07.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.295+0000 7f3081288640 1 -- 172.21.15.77:0/3167112859 learned_addr learned my addr 172.21.15.77:0/3167112859 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:07.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.295+0000 7f3081288640 1 -- 172.21.15.77:0/3167112859 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f307c15b110 msgr2=0x7f307c0adab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:07.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.295+0000 7f3081a89640 1 --2- 172.21.15.77:0/3167112859 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f307c15b110 0x7f307c0adab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.295+0000 7f3080a87640 1 --2- 172.21.15.77:0/3167112859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f307c1605b0 0x7f307c0b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.295+0000 7f3081288640 1 --2- 172.21.15.77:0/3167112859 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f307c15b110 0x7f307c0adab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.295+0000 7f3081288640 1 -- 172.21.15.77:0/3167112859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f307c1605b0 msgr2=0x7f307c0b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:07.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.295+0000 7f3081288640 1 --2- 172.21.15.77:0/3167112859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f307c1605b0 0x7f307c0b4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.295+0000 7f3081288640 1 -- 172.21.15.77:0/3167112859 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30780094d0 con 0x7f307c06a830 2023-11-04T01:41:07.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.295+0000 7f3080a87640 1 --2- 172.21.15.77:0/3167112859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f307c1605b0 0x7f307c0b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:07.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.295+0000 7f3081288640 1 --2- 172.21.15.77:0/3167112859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f307c06a830 0x7f307c15f6d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f3078000c00 tx=0x7f30780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:07.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.295+0000 7f3071ffb640 1 -- 172.21.15.77:0/3167112859 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3078033c80 con 0x7f307c06a830 2023-11-04T01:41:07.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.295+0000 7f3071ffb640 1 -- 172.21.15.77:0/3167112859 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3078033de0 con 0x7f307c06a830 2023-11-04T01:41:07.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.295+0000 7f30834ec640 1 -- 172.21.15.77:0/3167112859 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f307c0c7180 con 0x7f307c06a830 2023-11-04T01:41:07.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.295+0000 7f3071ffb640 1 -- 172.21.15.77:0/3167112859 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307803c640 con 0x7f307c06a830 2023-11-04T01:41:07.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.295+0000 7f30834ec640 1 -- 172.21.15.77:0/3167112859 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f307c15bd30 con 0x7f307c06a830 2023-11-04T01:41:07.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.296+0000 7f30834ec640 1 -- 172.21.15.77:0/3167112859 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f307c0672a0 con 0x7f307c06a830 2023-11-04T01:41:07.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.297+0000 7f3071ffb640 1 -- 172.21.15.77:0/3167112859 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f307803a040 con 0x7f307c06a830 2023-11-04T01:41:07.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.297+0000 7f3071ffb640 1 --2- 172.21.15.77:0/3167112859 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f306006aea0 0x7f306006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.297+0000 7f3071ffb640 1 -- 172.21.15.77:0/3167112859 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f30780ab6c0 con 0x7f307c06a830 2023-11-04T01:41:07.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.297+0000 7f3080a87640 1 --2- 172.21.15.77:0/3167112859 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f306006aea0 0x7f306006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.298+0000 7f3080a87640 1 --2- 172.21.15.77:0/3167112859 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f306006aea0 0x7f306006d360 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f307c0c3880 tx=0x7f306c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:07.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.301+0000 7f3071ffb640 1 -- 172.21.15.77:0/3167112859 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f30780763b0 con 0x7f307c06a830 2023-11-04T01:41:07.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.465+0000 7f30834ec640 1 -- 172.21.15.77:0/3167112859 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f307c074290 con 0x7f307c06a830 2023-11-04T01:41:07.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.465+0000 7f3071ffb640 1 -- 172.21.15.77:0/3167112859 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f30780799d0 con 0x7f307c06a830 2023-11-04T01:41:07.467 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:41:07.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.467+0000 7f30834ec640 1 -- 172.21.15.77:0/3167112859 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f306006aea0 msgr2=0x7f306006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:07.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.467+0000 7f30834ec640 1 --2- 172.21.15.77:0/3167112859 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f306006aea0 0x7f306006d360 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f307c0c3880 tx=0x7f306c008040 comp rx=0 tx=0).stop 2023-11-04T01:41:07.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.467+0000 7f30834ec640 1 -- 172.21.15.77:0/3167112859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f307c06a830 msgr2=0x7f307c15f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:07.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.467+0000 7f30834ec640 1 --2- 172.21.15.77:0/3167112859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f307c06a830 0x7f307c15f6d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f3078000c00 tx=0x7f30780046c0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.467+0000 7f30834ec640 1 -- 172.21.15.77:0/3167112859 shutdown_connections 2023-11-04T01:41:07.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.467+0000 7f30834ec640 1 --2- 172.21.15.77:0/3167112859 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f306006aea0 0x7f306006d360 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.467+0000 7f30834ec640 1 --2- 172.21.15.77:0/3167112859 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f307c15b110 0x7f307c0adab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.467+0000 7f30834ec640 1 --2- 172.21.15.77:0/3167112859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f307c1605b0 0x7f307c0b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.467+0000 7f30834ec640 1 --2- 172.21.15.77:0/3167112859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f307c06a830 0x7f307c15f6d0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.467+0000 7f30834ec640 1 -- 172.21.15.77:0/3167112859 >> 172.21.15.77:0/3167112859 conn(0x7f307c071820 msgr2=0x7f307c0af4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:07.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.467+0000 7f30834ec640 1 -- 172.21.15.77:0/3167112859 shutdown_connections 2023-11-04T01:41:07.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.467+0000 7f30834ec640 1 -- 172.21.15.77:0/3167112859 wait complete. 2023-11-04T01:41:07.479 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:41:07.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.580+0000 7f9c92705640 1 Processor -- start 2023-11-04T01:41:07.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.580+0000 7f9c92705640 1 -- start start 2023-11-04T01:41:07.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.581+0000 7f9c92705640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9c8c153e60 0x7f9c8c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.581+0000 7f9c92705640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9c8c0cd6d0 0x7f9c8c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.581+0000 7f9c92705640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c8c0cde60 con 0x7f9c8c0b4880 2023-11-04T01:41:07.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.581+0000 7f9c92705640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c8c160f90 con 0x7f9c8c153e60 2023-11-04T01:41:07.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.581+0000 7f9c92705640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c8c15e400 con 0x7f9c8c0cd6d0 2023-11-04T01:41:07.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.581+0000 7f9c8bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9c8c153e60 0x7f9c8c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.581+0000 7f9c90ca2640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f9c8c0b4880 0x7f9c8c06b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45308/0 (socket says 172.21.15.77:45308) 2023-11-04T01:41:07.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.581+0000 7f9c90ca2640 1 -- 172.21.15.77:0/2039346157 learned_addr learned my addr 172.21.15.77:0/2039346157 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:07.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.581+0000 7f9c8b7fe640 1 --2- 172.21.15.77:0/2039346157 >> v2:172.21.15.122:3300/0 conn(0x7f9c8c0cd6d0 0x7f9c8c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.581+0000 7f9c8bfff640 1 -- 172.21.15.77:0/2039346157 >> v2:172.21.15.122:3300/0 conn(0x7f9c8c0cd6d0 msgr2=0x7f9c8c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:07.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.581+0000 7f9c8bfff640 1 --2- 172.21.15.77:0/2039346157 >> v2:172.21.15.122:3300/0 conn(0x7f9c8c0cd6d0 0x7f9c8c161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.581+0000 7f9c8bfff640 1 -- 172.21.15.77:0/2039346157 >> v1:172.21.15.77:6789/0 conn(0x7f9c8c0b4880 legacy=0x7f9c8c06b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:07.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.581+0000 7f9c8affd640 1 -- 172.21.15.77:0/2039346157 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1687679305 0 0) 0x7f9c8c0cde60 con 0x7f9c8c0b4880 2023-11-04T01:41:07.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.581+0000 7f9c8bfff640 1 -- 172.21.15.77:0/2039346157 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c8c161960 con 0x7f9c8c153e60 2023-11-04T01:41:07.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.582+0000 7f9c8bfff640 1 --2- 172.21.15.77:0/2039346157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c8c153e60 0x7f9c8c15dec0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c0c9e80 tx=0x7f9c8002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a75ce700eb2b1d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:07.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.582+0000 7f9c8affd640 1 -- 172.21.15.77:0/2039346157 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c80031830 con 0x7f9c8c153e60 2023-11-04T01:41:07.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.582+0000 7f9c8affd640 1 -- 172.21.15.77:0/2039346157 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c80031990 con 0x7f9c8c153e60 2023-11-04T01:41:07.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.582+0000 7f9c8affd640 1 -- 172.21.15.77:0/2039346157 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c80031d20 con 0x7f9c8c153e60 2023-11-04T01:41:07.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.583+0000 7f9c92705640 1 -- 172.21.15.77:0/2039346157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c8c153e60 msgr2=0x7f9c8c15dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:07.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.583+0000 7f9c92705640 1 --2- 172.21.15.77:0/2039346157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c8c153e60 0x7f9c8c15dec0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c0c9e80 tx=0x7f9c8002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.583+0000 7f9c92705640 1 -- 172.21.15.77:0/2039346157 shutdown_connections 2023-11-04T01:41:07.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.583+0000 7f9c92705640 1 --2- 172.21.15.77:0/2039346157 >> v2:172.21.15.122:3300/0 conn(0x7f9c8c0cd6d0 0x7f9c8c161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.583+0000 7f9c92705640 1 --2- 172.21.15.77:0/2039346157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c8c153e60 0x7f9c8c15dec0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.583+0000 7f9c92705640 1 -- 172.21.15.77:0/2039346157 >> 172.21.15.77:0/2039346157 conn(0x7f9c8c0cf880 msgr2=0x7f9c8c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:07.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.583+0000 7f9c92705640 1 -- 172.21.15.77:0/2039346157 shutdown_connections 2023-11-04T01:41:07.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.583+0000 7f9c92705640 1 -- 172.21.15.77:0/2039346157 wait complete. 2023-11-04T01:41:07.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.584+0000 7f9c92705640 1 Processor -- start 2023-11-04T01:41:07.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.584+0000 7f9c92705640 1 -- start start 2023-11-04T01:41:07.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.585+0000 7f9c92705640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9c8c0b4880 0x7f9c8c14d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.585+0000 7f9c92705640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c8c0cd6d0 0x7f9c8c0b7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.585+0000 7f9c92705640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c8c153e60 0x7f9c8c0b7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.585+0000 7f9c92705640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c1f6cf0 con 0x7f9c8c0cd6d0 2023-11-04T01:41:07.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.585+0000 7f9c92705640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c0cc3a0 con 0x7f9c8c153e60 2023-11-04T01:41:07.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.585+0000 7f9c92705640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c1f6a10 con 0x7f9c8c0b4880 2023-11-04T01:41:07.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.585+0000 7f9c8b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c8c0cd6d0 0x7f9c8c0b7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.585+0000 7f9c8b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c8c0cd6d0 0x7f9c8c0b7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56972/0 (socket says 172.21.15.77:56972) 2023-11-04T01:41:07.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.585+0000 7f9c8b7fe640 1 -- 172.21.15.77:0/409016052 learned_addr learned my addr 172.21.15.77:0/409016052 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:07.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.585+0000 7f9c90ca2640 1 --2- 172.21.15.77:0/409016052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c8c153e60 0x7f9c8c0b7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.585+0000 7f9c8bfff640 1 --2- 172.21.15.77:0/409016052 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9c8c0b4880 0x7f9c8c14d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.585+0000 7f9c8b7fe640 1 -- 172.21.15.77:0/409016052 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9c8c0b4880 msgr2=0x7f9c8c14d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:07.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.585+0000 7f9c8b7fe640 1 --2- 172.21.15.77:0/409016052 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9c8c0b4880 0x7f9c8c14d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.585+0000 7f9c8b7fe640 1 -- 172.21.15.77:0/409016052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c8c153e60 msgr2=0x7f9c8c0b7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:07.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.585+0000 7f9c8b7fe640 1 --2- 172.21.15.77:0/409016052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c8c153e60 0x7f9c8c0b7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.585+0000 7f9c8b7fe640 1 -- 172.21.15.77:0/409016052 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c80009400 con 0x7f9c8c0cd6d0 2023-11-04T01:41:07.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.585+0000 7f9c90ca2640 1 --2- 172.21.15.77:0/409016052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c8c153e60 0x7f9c8c0b7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:07.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.585+0000 7f9c8bfff640 1 --2- 172.21.15.77:0/409016052 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9c8c0b4880 0x7f9c8c14d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:07.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.585+0000 7f9c8b7fe640 1 --2- 172.21.15.77:0/409016052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c8c0cd6d0 0x7f9c8c0b7020 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00e9b0 tx=0x7f9c7c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:07.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.586+0000 7f9c88ff9640 1 -- 172.21.15.77:0/409016052 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c009670 con 0x7f9c8c0cd6d0 2023-11-04T01:41:07.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.586+0000 7f9c88ff9640 1 -- 172.21.15.77:0/409016052 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7c00c9a0 con 0x7f9c8c0cd6d0 2023-11-04T01:41:07.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.586+0000 7f9c92705640 1 -- 172.21.15.77:0/409016052 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c8c14dcb0 con 0x7f9c8c0cd6d0 2023-11-04T01:41:07.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.586+0000 7f9c88ff9640 1 -- 172.21.15.77:0/409016052 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c00cd50 con 0x7f9c8c0cd6d0 2023-11-04T01:41:07.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.586+0000 7f9c92705640 1 -- 172.21.15.77:0/409016052 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c8c14e270 con 0x7f9c8c0cd6d0 2023-11-04T01:41:07.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.587+0000 7f9c92705640 1 -- 172.21.15.77:0/409016052 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c8c14db10 con 0x7f9c8c0cd6d0 2023-11-04T01:41:07.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.587+0000 7f9c88ff9640 1 -- 172.21.15.77:0/409016052 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9c7c013470 con 0x7f9c8c0cd6d0 2023-11-04T01:41:07.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.588+0000 7f9c88ff9640 1 --2- 172.21.15.77:0/409016052 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9c7806ae70 0x7f9c7806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.588+0000 7f9c88ff9640 1 -- 172.21.15.77:0/409016052 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9c7c089b50 con 0x7f9c8c0cd6d0 2023-11-04T01:41:07.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.588+0000 7f9c8bfff640 1 --2- 172.21.15.77:0/409016052 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9c7806ae70 0x7f9c7806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.588+0000 7f9c8bfff640 1 --2- 172.21.15.77:0/409016052 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9c7806ae70 0x7f9c7806d330 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9c80036000 tx=0x7f9c80008030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:07.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.592+0000 7f9c88ff9640 1 -- 172.21.15.77:0/409016052 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9c8c14db10 con 0x7f9c8c0cd6d0 2023-11-04T01:41:07.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.760+0000 7f9c92705640 1 -- 172.21.15.77:0/409016052 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9c8c14db10 con 0x7f9c8c0cd6d0 2023-11-04T01:41:07.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.761+0000 7f9c88ff9640 1 -- 172.21.15.77:0/409016052 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9c8c14db10 con 0x7f9c8c0cd6d0 2023-11-04T01:41:07.763 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-04T01:41:07.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.763+0000 7f9c92705640 1 -- 172.21.15.77:0/409016052 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9c7806ae70 msgr2=0x7f9c7806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:07.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.763+0000 7f9c92705640 1 --2- 172.21.15.77:0/409016052 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9c7806ae70 0x7f9c7806d330 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9c80036000 tx=0x7f9c80008030 comp rx=0 tx=0).stop 2023-11-04T01:41:07.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.763+0000 7f9c92705640 1 -- 172.21.15.77:0/409016052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c8c0cd6d0 msgr2=0x7f9c8c0b7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:07.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.763+0000 7f9c92705640 1 --2- 172.21.15.77:0/409016052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c8c0cd6d0 0x7f9c8c0b7020 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00e9b0 tx=0x7f9c7c00ee70 comp rx=0 tx=0).stop 2023-11-04T01:41:07.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.763+0000 7f9c92705640 1 -- 172.21.15.77:0/409016052 shutdown_connections 2023-11-04T01:41:07.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.763+0000 7f9c92705640 1 --2- 172.21.15.77:0/409016052 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9c7806ae70 0x7f9c7806d330 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.763+0000 7f9c92705640 1 --2- 172.21.15.77:0/409016052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c8c153e60 0x7f9c8c0b7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.763+0000 7f9c92705640 1 --2- 172.21.15.77:0/409016052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c8c0cd6d0 0x7f9c8c0b7020 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.763+0000 7f9c92705640 1 --2- 172.21.15.77:0/409016052 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9c8c0b4880 0x7f9c8c14d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.763+0000 7f9c92705640 1 -- 172.21.15.77:0/409016052 >> 172.21.15.77:0/409016052 conn(0x7f9c8c0cf880 msgr2=0x7f9c8c15fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:07.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.763+0000 7f9c92705640 1 -- 172.21.15.77:0/409016052 shutdown_connections 2023-11-04T01:41:07.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.763+0000 7f9c92705640 1 -- 172.21.15.77:0/409016052 wait complete. 2023-11-04T01:41:07.775 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:41:07.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.876+0000 7fcd66f3c640 1 Processor -- start 2023-11-04T01:41:07.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.876+0000 7fcd66f3c640 1 -- start start 2023-11-04T01:41:07.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.877+0000 7fcd66f3c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcd60153e60 0x7fcd6015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.877+0000 7fcd66f3c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fcd600cd6d0 0x7fcd60161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.877+0000 7fcd66f3c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcd600b4880 0x7fcd600b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.877+0000 7fcd66f3c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd600cde60 con 0x7fcd600b4880 2023-11-04T01:41:07.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.877+0000 7fcd66f3c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd60160f90 con 0x7fcd600cd6d0 2023-11-04T01:41:07.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.877+0000 7fcd66f3c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd600b5200 con 0x7fcd60153e60 2023-11-04T01:41:07.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.877+0000 7fcd654d9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcd600b4880 0x7fcd600b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.877+0000 7fcd654d9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcd600b4880 0x7fcd600b4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56978/0 (socket says 172.21.15.77:56978) 2023-11-04T01:41:07.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.878+0000 7fcd654d9640 1 -- 172.21.15.77:0/815352277 learned_addr learned my addr 172.21.15.77:0/815352277 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:07.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.878+0000 7fcd5ffff640 1 --2- 172.21.15.77:0/815352277 >> v2:172.21.15.122:3300/0 conn(0x7fcd600cd6d0 0x7fcd60161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.878+0000 7fcd64cd8640 1 --2- 172.21.15.77:0/815352277 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcd60153e60 0x7fcd6015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.878+0000 7fcd654d9640 1 -- 172.21.15.77:0/815352277 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcd60153e60 msgr2=0x7fcd6015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:07.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.878+0000 7fcd654d9640 1 --2- 172.21.15.77:0/815352277 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcd60153e60 0x7fcd6015dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.878+0000 7fcd654d9640 1 -- 172.21.15.77:0/815352277 >> v2:172.21.15.122:3300/0 conn(0x7fcd600cd6d0 msgr2=0x7fcd60161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:07.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.878+0000 7fcd654d9640 1 --2- 172.21.15.77:0/815352277 >> v2:172.21.15.122:3300/0 conn(0x7fcd600cd6d0 0x7fcd60161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.878+0000 7fcd654d9640 1 -- 172.21.15.77:0/815352277 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6015e400 con 0x7fcd600b4880 2023-11-04T01:41:07.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.878+0000 7fcd64cd8640 1 --2- 172.21.15.77:0/815352277 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcd60153e60 0x7fcd6015dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:07.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.878+0000 7fcd5ffff640 1 --2- 172.21.15.77:0/815352277 >> v2:172.21.15.122:3300/0 conn(0x7fcd600cd6d0 0x7fcd60161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:07.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.878+0000 7fcd654d9640 1 --2- 172.21.15.77:0/815352277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd600b4880 0x7fcd600b4cc0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fcd6006c930 tx=0x7fcd5802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8bba1be0a3e4de server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:07.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.879+0000 7fcd5f7fe640 1 -- 172.21.15.77:0/815352277 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5802ca70 con 0x7fcd600b4880 2023-11-04T01:41:07.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.879+0000 7fcd5f7fe640 1 -- 172.21.15.77:0/815352277 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5802cbd0 con 0x7fcd600b4880 2023-11-04T01:41:07.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.879+0000 7fcd5f7fe640 1 -- 172.21.15.77:0/815352277 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd580343f0 con 0x7fcd600b4880 2023-11-04T01:41:07.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.879+0000 7fcd66f3c640 1 -- 172.21.15.77:0/815352277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd600b4880 msgr2=0x7fcd600b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:07.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.879+0000 7fcd66f3c640 1 --2- 172.21.15.77:0/815352277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd600b4880 0x7fcd600b4cc0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fcd6006c930 tx=0x7fcd5802bed0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.879+0000 7fcd66f3c640 1 -- 172.21.15.77:0/815352277 shutdown_connections 2023-11-04T01:41:07.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.879+0000 7fcd66f3c640 1 --2- 172.21.15.77:0/815352277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd600b4880 0x7fcd600b4cc0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.879+0000 7fcd66f3c640 1 --2- 172.21.15.77:0/815352277 >> v2:172.21.15.122:3300/0 conn(0x7fcd600cd6d0 0x7fcd60161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.879+0000 7fcd66f3c640 1 --2- 172.21.15.77:0/815352277 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcd60153e60 0x7fcd6015dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.879+0000 7fcd66f3c640 1 -- 172.21.15.77:0/815352277 >> 172.21.15.77:0/815352277 conn(0x7fcd600cf880 msgr2=0x7fcd600cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:07.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.879+0000 7fcd66f3c640 1 -- 172.21.15.77:0/815352277 shutdown_connections 2023-11-04T01:41:07.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.879+0000 7fcd66f3c640 1 -- 172.21.15.77:0/815352277 wait complete. 2023-11-04T01:41:07.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.880+0000 7fcd66f3c640 1 Processor -- start 2023-11-04T01:41:07.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.880+0000 7fcd66f3c640 1 -- start start 2023-11-04T01:41:07.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.881+0000 7fcd66f3c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcd600b4880 0x7fcd600c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.881+0000 7fcd66f3c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd600cd6d0 0x7fcd600cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.881+0000 7fcd66f3c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd60153e60 0x7fcd600ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.881+0000 7fcd66f3c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd600cb870 con 0x7fcd600cd6d0 2023-11-04T01:41:07.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.881+0000 7fcd66f3c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd600ca7d0 con 0x7fcd60153e60 2023-11-04T01:41:07.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.881+0000 7fcd66f3c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd600caab0 con 0x7fcd600b4880 2023-11-04T01:41:07.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.881+0000 7fcd5ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd600cd6d0 0x7fcd600cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.881+0000 7fcd5ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd600cd6d0 0x7fcd600cc9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56988/0 (socket says 172.21.15.77:56988) 2023-11-04T01:41:07.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.881+0000 7fcd5ffff640 1 -- 172.21.15.77:0/449755369 learned_addr learned my addr 172.21.15.77:0/449755369 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:07.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.882+0000 7fcd64cd8640 1 --2- 172.21.15.77:0/449755369 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcd600b4880 0x7fcd600c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.882+0000 7fcd654d9640 1 --2- 172.21.15.77:0/449755369 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd60153e60 0x7fcd600ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.882+0000 7fcd5ffff640 1 -- 172.21.15.77:0/449755369 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcd600b4880 msgr2=0x7fcd600c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:07.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.882+0000 7fcd5ffff640 1 --2- 172.21.15.77:0/449755369 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcd600b4880 0x7fcd600c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.882+0000 7fcd5ffff640 1 -- 172.21.15.77:0/449755369 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd60153e60 msgr2=0x7fcd600ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:07.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.882+0000 7fcd5ffff640 1 --2- 172.21.15.77:0/449755369 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd60153e60 0x7fcd600ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:07.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.882+0000 7fcd5ffff640 1 -- 172.21.15.77:0/449755369 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd58009b30 con 0x7fcd600cd6d0 2023-11-04T01:41:07.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.882+0000 7fcd5ffff640 1 --2- 172.21.15.77:0/449755369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd600cd6d0 0x7fcd600cc9c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fcd5400c7f0 tx=0x7fcd5400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:07.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.882+0000 7fcd5d7fa640 1 -- 172.21.15.77:0/449755369 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd54004230 con 0x7fcd600cd6d0 2023-11-04T01:41:07.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.882+0000 7fcd5d7fa640 1 -- 172.21.15.77:0/449755369 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd540043b0 con 0x7fcd600cd6d0 2023-11-04T01:41:07.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.882+0000 7fcd66f3c640 1 -- 172.21.15.77:0/449755369 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd600cad90 con 0x7fcd600cd6d0 2023-11-04T01:41:07.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.882+0000 7fcd5d7fa640 1 -- 172.21.15.77:0/449755369 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd54004520 con 0x7fcd600cd6d0 2023-11-04T01:41:07.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.882+0000 7fcd66f3c640 1 -- 172.21.15.77:0/449755369 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd600cb350 con 0x7fcd600cd6d0 2023-11-04T01:41:07.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.883+0000 7fcd66f3c640 1 -- 172.21.15.77:0/449755369 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd60074290 con 0x7fcd600cd6d0 2023-11-04T01:41:07.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.884+0000 7fcd5d7fa640 1 -- 172.21.15.77:0/449755369 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcd54007860 con 0x7fcd600cd6d0 2023-11-04T01:41:07.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.884+0000 7fcd5d7fa640 1 --2- 172.21.15.77:0/449755369 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcd4c06ae70 0x7fcd4c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:07.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.884+0000 7fcd5d7fa640 1 -- 172.21.15.77:0/449755369 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcd540898c0 con 0x7fcd600cd6d0 2023-11-04T01:41:07.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.884+0000 7fcd64cd8640 1 --2- 172.21.15.77:0/449755369 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcd4c06ae70 0x7fcd4c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:07.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.885+0000 7fcd64cd8640 1 --2- 172.21.15.77:0/449755369 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcd4c06ae70 0x7fcd4c06d330 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcd60157b20 tx=0x7fcd50008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:07.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:07.888+0000 7fcd5d7fa640 1 -- 172.21.15.77:0/449755369 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcd540545d0 con 0x7fcd600cd6d0 2023-11-04T01:41:08.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.052+0000 7fcd66f3c640 1 -- 172.21.15.77:0/449755369 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fcd600d0b80 con 0x7fcd600cd6d0 2023-11-04T01:41:08.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.053+0000 7fcd5d7fa640 1 -- 172.21.15.77:0/449755369 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fcd5401e0a0 con 0x7fcd600cd6d0 2023-11-04T01:41:08.055 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:41:08.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.055+0000 7fcd66f3c640 1 -- 172.21.15.77:0/449755369 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcd4c06ae70 msgr2=0x7fcd4c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:08.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.055+0000 7fcd66f3c640 1 --2- 172.21.15.77:0/449755369 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcd4c06ae70 0x7fcd4c06d330 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcd60157b20 tx=0x7fcd50008040 comp rx=0 tx=0).stop 2023-11-04T01:41:08.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.055+0000 7fcd66f3c640 1 -- 172.21.15.77:0/449755369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd600cd6d0 msgr2=0x7fcd600cc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:08.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.055+0000 7fcd66f3c640 1 --2- 172.21.15.77:0/449755369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd600cd6d0 0x7fcd600cc9c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fcd5400c7f0 tx=0x7fcd5400ccb0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.055+0000 7fcd66f3c640 1 -- 172.21.15.77:0/449755369 shutdown_connections 2023-11-04T01:41:08.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.055+0000 7fcd66f3c640 1 --2- 172.21.15.77:0/449755369 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcd4c06ae70 0x7fcd4c06d330 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.055+0000 7fcd66f3c640 1 --2- 172.21.15.77:0/449755369 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd60153e60 0x7fcd600ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.055+0000 7fcd66f3c640 1 --2- 172.21.15.77:0/449755369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd600cd6d0 0x7fcd600cc9c0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.055+0000 7fcd66f3c640 1 --2- 172.21.15.77:0/449755369 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcd600b4880 0x7fcd600c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.055+0000 7fcd66f3c640 1 -- 172.21.15.77:0/449755369 >> 172.21.15.77:0/449755369 conn(0x7fcd600cf880 msgr2=0x7fcd6015fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:08.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.055+0000 7fcd66f3c640 1 -- 172.21.15.77:0/449755369 shutdown_connections 2023-11-04T01:41:08.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.055+0000 7fcd66f3c640 1 -- 172.21.15.77:0/449755369 wait complete. 2023-11-04T01:41:08.068 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:41:08.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.166+0000 7f0d46675640 1 Processor -- start 2023-11-04T01:41:08.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.166+0000 7f0d46675640 1 -- start start 2023-11-04T01:41:08.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.167+0000 7f0d46675640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0d400c4ff0 0x7f0d400cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:08.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.167+0000 7f0d46675640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d4015aff0 con 0x7f0d40159c00 2023-11-04T01:41:08.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.167+0000 7f0d46675640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d4015a3e0 con 0x7f0d400adac0 2023-11-04T01:41:08.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.167+0000 7f0d46675640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4015a6c0 con 0x7f0d400c4ff0 2023-11-04T01:41:08.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.167+0000 7f0d3ffff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f0d40159c00 0x7f0d400c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45316/0 (socket says 172.21.15.77:45316) 2023-11-04T01:41:08.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.167+0000 7f0d3ffff640 1 -- 172.21.15.77:0/1800125795 learned_addr learned my addr 172.21.15.77:0/1800125795 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:08.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.167+0000 7f0d3f7fe640 1 --2- 172.21.15.77:0/1800125795 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0d400c4ff0 0x7f0d400cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:08.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.167+0000 7f0d3effd640 1 -- 172.21.15.77:0/1800125795 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4072838004 0 0) 0x7f0d4015aff0 con 0x7f0d40159c00 2023-11-04T01:41:08.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.167+0000 7f0d3effd640 1 -- 172.21.15.77:0/1800125795 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d28003520 con 0x7f0d40159c00 2023-11-04T01:41:08.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.167+0000 7f0d3effd640 1 -- 172.21.15.77:0/1800125795 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3537810345 0 0) 0x7f0d28003520 con 0x7f0d40159c00 2023-11-04T01:41:08.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.167+0000 7f0d3effd640 1 -- 172.21.15.77:0/1800125795 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0d400c4ff0 msgr2=0x7f0d400cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:08.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.167+0000 7f0d3effd640 1 --2- 172.21.15.77:0/1800125795 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0d400c4ff0 0x7f0d400cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.167+0000 7f0d3effd640 1 -- 172.21.15.77:0/1800125795 >> v1:172.21.15.122:6789/0 conn(0x7f0d400adac0 legacy=0x7f0d400adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:08.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.168+0000 7f0d3effd640 1 -- 172.21.15.77:0/1800125795 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d4015a9a0 con 0x7f0d40159c00 2023-11-04T01:41:08.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.168+0000 7f0d3effd640 1 -- 172.21.15.77:0/1800125795 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f0d30001670 con 0x7f0d40159c00 2023-11-04T01:41:08.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.168+0000 7f0d3effd640 1 -- 172.21.15.77:0/1800125795 >> v1:172.21.15.77:6789/0 conn(0x7f0d40159c00 legacy=0x7f0d400c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:08.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.168+0000 7f0d3effd640 1 --2- 172.21.15.77:0/1800125795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d280039a0 0x7f0d28003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:08.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.168+0000 7f0d3effd640 1 --2- 172.21.15.77:0/1800125795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d28004350 0x7f0d28004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:08.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.168+0000 7f0d3effd640 1 --2- 172.21.15.77:0/1800125795 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0d400c4ff0 0x7f0d28005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:08.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.168+0000 7f0d3effd640 1 -- 172.21.15.77:0/1800125795 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4015a6c0 con 0x7f0d280039a0 2023-11-04T01:41:08.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.168+0000 7f0d3effd640 1 -- 172.21.15.77:0/1800125795 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2800b9e0 con 0x7f0d28004350 2023-11-04T01:41:08.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.168+0000 7f0d3effd640 1 -- 172.21.15.77:0/1800125795 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2800bba0 con 0x7f0d400c4ff0 2023-11-04T01:41:08.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.168+0000 7f0d3ffff640 1 --2- 172.21.15.77:0/1800125795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d280039a0 0x7f0d28003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:08.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.168+0000 7f0d3f7fe640 1 --2- 172.21.15.77:0/1800125795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d28004350 0x7f0d28004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:08.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.168+0000 7f0d44c12640 1 --2- 172.21.15.77:0/1800125795 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0d400c4ff0 0x7f0d28005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:08.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.168+0000 7f0d3ffff640 1 -- 172.21.15.77:0/1800125795 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0d400c4ff0 msgr2=0x7f0d28005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:08.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.168+0000 7f0d3ffff640 1 --2- 172.21.15.77:0/1800125795 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0d400c4ff0 0x7f0d28005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.168+0000 7f0d3ffff640 1 -- 172.21.15.77:0/1800125795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d28004350 msgr2=0x7f0d28004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:08.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.168+0000 7f0d3ffff640 1 --2- 172.21.15.77:0/1800125795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d28004350 0x7f0d28004820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.168+0000 7f0d3ffff640 1 -- 172.21.15.77:0/1800125795 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d28003520 con 0x7f0d280039a0 2023-11-04T01:41:08.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.169+0000 7f0d3ffff640 1 --2- 172.21.15.77:0/1800125795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d280039a0 0x7f0d28003d80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0d3000c210 tx=0x7f0d280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b26b0e47db43bd04 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:08.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.169+0000 7f0d3effd640 1 -- 172.21.15.77:0/1800125795 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d30005ad0 con 0x7f0d280039a0 2023-11-04T01:41:08.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.169+0000 7f0d3effd640 1 -- 172.21.15.77:0/1800125795 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d30005c30 con 0x7f0d280039a0 2023-11-04T01:41:08.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.169+0000 7f0d3effd640 1 -- 172.21.15.77:0/1800125795 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3002c870 con 0x7f0d280039a0 2023-11-04T01:41:08.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.169+0000 7f0d46675640 1 -- 172.21.15.77:0/1800125795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d280039a0 msgr2=0x7f0d28003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:08.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.169+0000 7f0d46675640 1 --2- 172.21.15.77:0/1800125795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d280039a0 0x7f0d28003d80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0d3000c210 tx=0x7f0d280057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.169+0000 7f0d44c12640 1 -- 172.21.15.77:0/1800125795 reap_dead start 2023-11-04T01:41:08.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.169+0000 7f0d46675640 1 -- 172.21.15.77:0/1800125795 shutdown_connections 2023-11-04T01:41:08.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.169+0000 7f0d46675640 1 -- 172.21.15.77:0/1800125795 >> 172.21.15.77:0/1800125795 conn(0x7f0d400ce950 msgr2=0x7f0d400ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:08.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.169+0000 7f0d46675640 1 -- 172.21.15.77:0/1800125795 shutdown_connections 2023-11-04T01:41:08.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.170+0000 7f0d46675640 1 -- 172.21.15.77:0/1800125795 wait complete. 2023-11-04T01:41:08.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.171+0000 7f0d46675640 1 Processor -- start 2023-11-04T01:41:08.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.171+0000 7f0d46675640 1 -- start start 2023-11-04T01:41:08.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.171+0000 7f0d46675640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d280039a0 0x7f0d4015b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:08.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.171+0000 7f0d46675640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0d4015cab0 0x7f0d4015bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:08.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.171+0000 7f0d46675640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d4015cf30 0x7f0d401f64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:08.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.171+0000 7f0d46675640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d401f60d0 con 0x7f0d280039a0 2023-11-04T01:41:08.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.171+0000 7f0d46675640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4014da60 con 0x7f0d4015cf30 2023-11-04T01:41:08.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.171+0000 7f0d46675640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4014dcb0 con 0x7f0d4015cab0 2023-11-04T01:41:08.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.172+0000 7f0d3ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d280039a0 0x7f0d4015b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:08.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.172+0000 7f0d3ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d280039a0 0x7f0d4015b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56996/0 (socket says 172.21.15.77:56996) 2023-11-04T01:41:08.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.172+0000 7f0d3ffff640 1 -- 172.21.15.77:0/4270240109 learned_addr learned my addr 172.21.15.77:0/4270240109 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:08.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.172+0000 7f0d44c12640 1 --2- 172.21.15.77:0/4270240109 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d4015cf30 0x7f0d401f64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:08.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.172+0000 7f0d3f7fe640 1 --2- 172.21.15.77:0/4270240109 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0d4015cab0 0x7f0d4015bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:08.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.172+0000 7f0d3ffff640 1 -- 172.21.15.77:0/4270240109 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0d4015cab0 msgr2=0x7f0d4015bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:08.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.172+0000 7f0d3ffff640 1 --2- 172.21.15.77:0/4270240109 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0d4015cab0 0x7f0d4015bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.172+0000 7f0d3ffff640 1 -- 172.21.15.77:0/4270240109 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d4015cf30 msgr2=0x7f0d401f64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:08.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.172+0000 7f0d3ffff640 1 --2- 172.21.15.77:0/4270240109 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d4015cf30 0x7f0d401f64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.172+0000 7f0d3ffff640 1 -- 172.21.15.77:0/4270240109 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d4014df90 con 0x7f0d280039a0 2023-11-04T01:41:08.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.172+0000 7f0d3ffff640 1 --2- 172.21.15.77:0/4270240109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d280039a0 0x7f0d4015b2c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0d3002c410 tx=0x7f0d4015af60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:08.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.172+0000 7f0d3cff9640 1 -- 172.21.15.77:0/4270240109 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d30039030 con 0x7f0d280039a0 2023-11-04T01:41:08.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.172+0000 7f0d3cff9640 1 -- 172.21.15.77:0/4270240109 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3002cc80 con 0x7f0d280039a0 2023-11-04T01:41:08.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.172+0000 7f0d46675640 1 -- 172.21.15.77:0/4270240109 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d4014e270 con 0x7f0d280039a0 2023-11-04T01:41:08.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.172+0000 7f0d3cff9640 1 -- 172.21.15.77:0/4270240109 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3003c040 con 0x7f0d280039a0 2023-11-04T01:41:08.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.172+0000 7f0d46675640 1 -- 172.21.15.77:0/4270240109 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d4014d300 con 0x7f0d280039a0 2023-11-04T01:41:08.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.173+0000 7f0d46675640 1 -- 172.21.15.77:0/4270240109 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d40074290 con 0x7f0d280039a0 2023-11-04T01:41:08.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.174+0000 7f0d3cff9640 1 -- 172.21.15.77:0/4270240109 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0d30032070 con 0x7f0d280039a0 2023-11-04T01:41:08.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.174+0000 7f0d3cff9640 1 --2- 172.21.15.77:0/4270240109 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0d2c06aea0 0x7f0d2c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:08.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.174+0000 7f0d3cff9640 1 -- 172.21.15.77:0/4270240109 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0d300aaca0 con 0x7f0d280039a0 2023-11-04T01:41:08.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.174+0000 7f0d3f7fe640 1 --2- 172.21.15.77:0/4270240109 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0d2c06aea0 0x7f0d2c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:08.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.175+0000 7f0d3f7fe640 1 --2- 172.21.15.77:0/4270240109 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0d2c06aea0 0x7f0d2c06d360 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0d400cfa50 tx=0x7f0d34008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:08.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.178+0000 7f0d3cff9640 1 -- 172.21.15.77:0/4270240109 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0d30075a20 con 0x7f0d280039a0 2023-11-04T01:41:08.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.357+0000 7f0d46675640 1 -- 172.21.15.77:0/4270240109 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0d400725c0 con 0x7f0d280039a0 2023-11-04T01:41:08.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.358+0000 7f0d3cff9640 1 -- 172.21.15.77:0/4270240109 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0d30079040 con 0x7f0d280039a0 2023-11-04T01:41:08.360 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-11-04T01:41:08.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.359+0000 7f0d46675640 1 -- 172.21.15.77:0/4270240109 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0d2c06aea0 msgr2=0x7f0d2c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:08.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.359+0000 7f0d46675640 1 --2- 172.21.15.77:0/4270240109 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0d2c06aea0 0x7f0d2c06d360 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0d400cfa50 tx=0x7f0d34008040 comp rx=0 tx=0).stop 2023-11-04T01:41:08.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.359+0000 7f0d46675640 1 -- 172.21.15.77:0/4270240109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d280039a0 msgr2=0x7f0d4015b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:08.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.359+0000 7f0d46675640 1 --2- 172.21.15.77:0/4270240109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d280039a0 0x7f0d4015b2c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0d3002c410 tx=0x7f0d4015af60 comp rx=0 tx=0).stop 2023-11-04T01:41:08.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.359+0000 7f0d46675640 1 -- 172.21.15.77:0/4270240109 shutdown_connections 2023-11-04T01:41:08.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.359+0000 7f0d46675640 1 --2- 172.21.15.77:0/4270240109 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0d2c06aea0 0x7f0d2c06d360 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.359+0000 7f0d46675640 1 --2- 172.21.15.77:0/4270240109 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d4015cf30 0x7f0d401f64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.359+0000 7f0d46675640 1 --2- 172.21.15.77:0/4270240109 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0d4015cab0 0x7f0d4015bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.360+0000 7f0d46675640 1 --2- 172.21.15.77:0/4270240109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d280039a0 0x7f0d4015b2c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.360+0000 7f0d46675640 1 -- 172.21.15.77:0/4270240109 >> 172.21.15.77:0/4270240109 conn(0x7f0d400ce950 msgr2=0x7f0d400ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:08.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.360+0000 7f0d46675640 1 -- 172.21.15.77:0/4270240109 shutdown_connections 2023-11-04T01:41:08.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.360+0000 7f0d46675640 1 -- 172.21.15.77:0/4270240109 wait complete. 2023-11-04T01:41:08.374 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:41:08.374 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:41:08.393 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:08.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.491+0000 7fc978cd4640 1 Processor -- start 2023-11-04T01:41:08.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.491+0000 7fc978cd4640 1 -- start start 2023-11-04T01:41:08.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.492+0000 7fc978cd4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc9740cbeb0 0x7fc9740b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:08.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.492+0000 7fc978cd4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9740b1590 con 0x7fc9740af060 2023-11-04T01:41:08.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.492+0000 7fc978cd4640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc97406a8e0 con 0x7fc9740aec80 2023-11-04T01:41:08.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.492+0000 7fc978cd4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc974155a40 con 0x7fc9740cbeb0 2023-11-04T01:41:08.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.492+0000 7fc972d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc9740cbeb0 0x7fc9740b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:08.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.492+0000 7fc96bfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc9740af060 0x7fc9740cb7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45322/0 (socket says 172.21.15.77:45322) 2023-11-04T01:41:08.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.492+0000 7fc96bfff640 1 -- 172.21.15.77:0/4104408932 learned_addr learned my addr 172.21.15.77:0/4104408932 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:08.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.492+0000 7fc972d9d640 1 -- 172.21.15.77:0/4104408932 >> v1:172.21.15.122:6789/0 conn(0x7fc9740aec80 legacy=0x7fc97406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:08.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.492+0000 7fc972d9d640 1 -- 172.21.15.77:0/4104408932 >> v1:172.21.15.77:6789/0 conn(0x7fc9740af060 legacy=0x7fc9740cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:08.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.492+0000 7fc972d9d640 1 -- 172.21.15.77:0/4104408932 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9740b1800 con 0x7fc9740cbeb0 2023-11-04T01:41:08.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.493+0000 7fc972d9d640 1 --2- 172.21.15.77:0/4104408932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9740cbeb0 0x7fc9740b1fe0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc96c009d90 tx=0x7fc96c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8dee5023fa1e92b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:08.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.493+0000 7fc971d9b640 1 -- 172.21.15.77:0/4104408932 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c02cc60 con 0x7fc9740cbeb0 2023-11-04T01:41:08.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.493+0000 7fc971d9b640 1 -- 172.21.15.77:0/4104408932 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96c02cdc0 con 0x7fc9740cbeb0 2023-11-04T01:41:08.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.493+0000 7fc971d9b640 1 -- 172.21.15.77:0/4104408932 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c034660 con 0x7fc9740cbeb0 2023-11-04T01:41:08.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.493+0000 7fc978cd4640 1 -- 172.21.15.77:0/4104408932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9740cbeb0 msgr2=0x7fc9740b1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:08.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.493+0000 7fc978cd4640 1 --2- 172.21.15.77:0/4104408932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9740cbeb0 0x7fc9740b1fe0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc96c009d90 tx=0x7fc96c02beb0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.493+0000 7fc978cd4640 1 -- 172.21.15.77:0/4104408932 shutdown_connections 2023-11-04T01:41:08.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.493+0000 7fc978cd4640 1 --2- 172.21.15.77:0/4104408932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9740cbeb0 0x7fc9740b1fe0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.493+0000 7fc978cd4640 1 -- 172.21.15.77:0/4104408932 >> 172.21.15.77:0/4104408932 conn(0x7fc974098d40 msgr2=0x7fc9740cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:08.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.494+0000 7fc978cd4640 1 -- 172.21.15.77:0/4104408932 shutdown_connections 2023-11-04T01:41:08.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.494+0000 7fc978cd4640 1 -- 172.21.15.77:0/4104408932 wait complete. 2023-11-04T01:41:08.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.495+0000 7fc978cd4640 1 Processor -- start 2023-11-04T01:41:08.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.495+0000 7fc978cd4640 1 -- start start 2023-11-04T01:41:08.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.495+0000 7fc978cd4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9740aec80 0x7fc9741eff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:08.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.495+0000 7fc978cd4640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc9740af060 0x7fc9740b5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:08.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.495+0000 7fc978cd4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9740cbeb0 0x7fc9740b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:08.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.495+0000 7fc978cd4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9740b35e0 con 0x7fc9740cbeb0 2023-11-04T01:41:08.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.495+0000 7fc978cd4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9740b3880 con 0x7fc9740aec80 2023-11-04T01:41:08.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.495+0000 7fc978cd4640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9740b3b60 con 0x7fc9740af060 2023-11-04T01:41:08.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.496+0000 7fc972d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9740cbeb0 0x7fc9740b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:08.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.496+0000 7fc972d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9740cbeb0 0x7fc9740b30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57012/0 (socket says 172.21.15.77:57012) 2023-11-04T01:41:08.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.496+0000 7fc972d9d640 1 -- 172.21.15.77:0/2565802670 learned_addr learned my addr 172.21.15.77:0/2565802670 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:08.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.496+0000 7fc97259c640 1 --2- 172.21.15.77:0/2565802670 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9740aec80 0x7fc9741eff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:08.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.496+0000 7fc96bfff640 1 --2- 172.21.15.77:0/2565802670 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc9740af060 0x7fc9740b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:08.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.496+0000 7fc972d9d640 1 -- 172.21.15.77:0/2565802670 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc9740af060 msgr2=0x7fc9740b5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:08.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.496+0000 7fc972d9d640 1 --2- 172.21.15.77:0/2565802670 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc9740af060 0x7fc9740b5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.496+0000 7fc972d9d640 1 -- 172.21.15.77:0/2565802670 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9740aec80 msgr2=0x7fc9741eff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:08.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.496+0000 7fc972d9d640 1 --2- 172.21.15.77:0/2565802670 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9740aec80 0x7fc9741eff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.496+0000 7fc972d9d640 1 -- 172.21.15.77:0/2565802670 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c009a70 con 0x7fc9740cbeb0 2023-11-04T01:41:08.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.496+0000 7fc972d9d640 1 --2- 172.21.15.77:0/2565802670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9740cbeb0 0x7fc9740b30a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc96c009d90 tx=0x7fc96c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:08.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.496+0000 7fc96affd640 1 -- 172.21.15.77:0/2565802670 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c040450 con 0x7fc9740cbeb0 2023-11-04T01:41:08.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.496+0000 7fc96affd640 1 -- 172.21.15.77:0/2565802670 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96c0405d0 con 0x7fc9740cbeb0 2023-11-04T01:41:08.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.496+0000 7fc978cd4640 1 -- 172.21.15.77:0/2565802670 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9740b3e40 con 0x7fc9740cbeb0 2023-11-04T01:41:08.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.496+0000 7fc96affd640 1 -- 172.21.15.77:0/2565802670 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c040980 con 0x7fc9740cbeb0 2023-11-04T01:41:08.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.496+0000 7fc978cd4640 1 -- 172.21.15.77:0/2565802670 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9741f0530 con 0x7fc9740cbeb0 2023-11-04T01:41:08.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.497+0000 7fc978cd4640 1 -- 172.21.15.77:0/2565802670 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc97406eec0 con 0x7fc9740cbeb0 2023-11-04T01:41:08.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.498+0000 7fc96affd640 1 -- 172.21.15.77:0/2565802670 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc96c040ae0 con 0x7fc9740cbeb0 2023-11-04T01:41:08.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.498+0000 7fc96affd640 1 --2- 172.21.15.77:0/2565802670 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc95406ae70 0x7fc95406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:08.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.498+0000 7fc96affd640 1 -- 172.21.15.77:0/2565802670 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc96c0ac470 con 0x7fc9740cbeb0 2023-11-04T01:41:08.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.498+0000 7fc97259c640 1 --2- 172.21.15.77:0/2565802670 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc95406ae70 0x7fc95406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:08.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.499+0000 7fc97259c640 1 --2- 172.21.15.77:0/2565802670 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc95406ae70 0x7fc95406d330 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc9740c6980 tx=0x7fc964009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:08.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.502+0000 7fc96affd640 1 -- 172.21.15.77:0/2565802670 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc96c0772b0 con 0x7fc9740cbeb0 2023-11-04T01:41:08.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.672+0000 7fc978cd4640 1 -- 172.21.15.77:0/2565802670 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc974074290 con 0x7fc9740cbeb0 2023-11-04T01:41:08.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.674+0000 7fc96affd640 1 -- 172.21.15.77:0/2565802670 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18661 (secure 0 0 0) 0x7fc96c07a8d0 con 0x7fc9740cbeb0 2023-11-04T01:41:08.676 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:08.676 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":26,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:40:47.579547+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:40:02.810971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:40:04.003979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:40:07.734355+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:08.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.675+0000 7fc978cd4640 1 -- 172.21.15.77:0/2565802670 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc95406ae70 msgr2=0x7fc95406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:08.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.675+0000 7fc978cd4640 1 --2- 172.21.15.77:0/2565802670 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc95406ae70 0x7fc95406d330 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc9740c6980 tx=0x7fc964009040 comp rx=0 tx=0).stop 2023-11-04T01:41:08.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.675+0000 7fc978cd4640 1 -- 172.21.15.77:0/2565802670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9740cbeb0 msgr2=0x7fc9740b30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:08.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.676+0000 7fc978cd4640 1 --2- 172.21.15.77:0/2565802670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9740cbeb0 0x7fc9740b30a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc96c009d90 tx=0x7fc96c004a40 comp rx=0 tx=0).stop 2023-11-04T01:41:08.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.676+0000 7fc978cd4640 1 -- 172.21.15.77:0/2565802670 shutdown_connections 2023-11-04T01:41:08.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.676+0000 7fc978cd4640 1 --2- 172.21.15.77:0/2565802670 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc95406ae70 0x7fc95406d330 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.676+0000 7fc978cd4640 1 --2- 172.21.15.77:0/2565802670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9740cbeb0 0x7fc9740b30a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.676+0000 7fc978cd4640 1 --2- 172.21.15.77:0/2565802670 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc9740af060 0x7fc9740b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.676+0000 7fc978cd4640 1 --2- 172.21.15.77:0/2565802670 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9740aec80 0x7fc9741eff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.676+0000 7fc978cd4640 1 -- 172.21.15.77:0/2565802670 >> 172.21.15.77:0/2565802670 conn(0x7fc974098d40 msgr2=0x7fc9740ac5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:08.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.676+0000 7fc978cd4640 1 -- 172.21.15.77:0/2565802670 shutdown_connections 2023-11-04T01:41:08.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.676+0000 7fc978cd4640 1 -- 172.21.15.77:0/2565802670 wait complete. 2023-11-04T01:41:08.688 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:40:02.810971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:40:04.003979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:40:07.734355+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:41:08.689 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:41:08.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.790+0000 7f071ab4c640 1 Processor -- start 2023-11-04T01:41:08.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.790+0000 7f071ab4c640 1 -- start start 2023-11-04T01:41:08.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.791+0000 7f071ab4c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f07140b2d30 0x7f071406bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:08.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.791+0000 7f071ab4c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f071406c1d0 0x7f07140cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:08.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.791+0000 7f071ab4c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f071406ca40 con 0x7f0714160430 2023-11-04T01:41:08.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.791+0000 7f071ab4c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07140cb580 con 0x7f071406c1d0 2023-11-04T01:41:08.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.791+0000 7f071ab4c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f071406cd20 con 0x7f07140b2d30 2023-11-04T01:41:08.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.791+0000 7f07190e9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f071406c1d0 0x7f07140cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:08.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.791+0000 7f07190e9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f071406c1d0 0x7f07140cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57028/0 (socket says 172.21.15.77:57028) 2023-11-04T01:41:08.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.791+0000 7f07190e9640 1 -- 172.21.15.77:0/3337410999 learned_addr learned my addr 172.21.15.77:0/3337410999 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:08.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.791+0000 7f0713fff640 1 --2- 172.21.15.77:0/3337410999 >> v2:172.21.15.122:3300/0 conn(0x7f07140b2d30 0x7f071406bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:08.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.791+0000 7f07190e9640 1 -- 172.21.15.77:0/3337410999 >> v2:172.21.15.122:3300/0 conn(0x7f07140b2d30 msgr2=0x7f071406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:08.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.791+0000 7f07190e9640 1 --2- 172.21.15.77:0/3337410999 >> v2:172.21.15.122:3300/0 conn(0x7f07140b2d30 0x7f071406bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.791+0000 7f07190e9640 1 -- 172.21.15.77:0/3337410999 >> v1:172.21.15.77:6789/0 conn(0x7f0714160430 legacy=0x7f07140b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:08.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.791+0000 7f07190e9640 1 -- 172.21.15.77:0/3337410999 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071406d000 con 0x7f071406c1d0 2023-11-04T01:41:08.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.791+0000 7f07137fe640 1 -- 172.21.15.77:0/3337410999 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3864857717 0 0) 0x7f071406ca40 con 0x7f0714160430 2023-11-04T01:41:08.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.791+0000 7f0713fff640 1 --2- 172.21.15.77:0/3337410999 >> v2:172.21.15.122:3300/0 conn(0x7f07140b2d30 0x7f071406bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:08.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.792+0000 7f07190e9640 1 --2- 172.21.15.77:0/3337410999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f071406c1d0 0x7f07140cbcb0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f070c009e50 tx=0x7f070c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32b8b8cb2ff60301 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:08.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.792+0000 7f07137fe640 1 -- 172.21.15.77:0/3337410999 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c02cb20 con 0x7f071406c1d0 2023-11-04T01:41:08.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.792+0000 7f07137fe640 1 -- 172.21.15.77:0/3337410999 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070c02cc80 con 0x7f071406c1d0 2023-11-04T01:41:08.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.792+0000 7f07137fe640 1 -- 172.21.15.77:0/3337410999 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c0343f0 con 0x7f071406c1d0 2023-11-04T01:41:08.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.792+0000 7f071ab4c640 1 -- 172.21.15.77:0/3337410999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f071406c1d0 msgr2=0x7f07140cbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:08.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.792+0000 7f071ab4c640 1 --2- 172.21.15.77:0/3337410999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f071406c1d0 0x7f07140cbcb0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f070c009e50 tx=0x7f070c02bf80 comp rx=0 tx=0).stop 2023-11-04T01:41:08.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.792+0000 7f071ab4c640 1 -- 172.21.15.77:0/3337410999 shutdown_connections 2023-11-04T01:41:08.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.792+0000 7f071ab4c640 1 --2- 172.21.15.77:0/3337410999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f071406c1d0 0x7f07140cbcb0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.792+0000 7f071ab4c640 1 --2- 172.21.15.77:0/3337410999 >> v2:172.21.15.122:3300/0 conn(0x7f07140b2d30 0x7f071406bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.792+0000 7f071ab4c640 1 -- 172.21.15.77:0/3337410999 >> 172.21.15.77:0/3337410999 conn(0x7f071406ea20 msgr2=0x7f071406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:08.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.793+0000 7f071ab4c640 1 -- 172.21.15.77:0/3337410999 shutdown_connections 2023-11-04T01:41:08.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.793+0000 7f071ab4c640 1 -- 172.21.15.77:0/3337410999 wait complete. 2023-11-04T01:41:08.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.794+0000 7f071ab4c640 1 Processor -- start 2023-11-04T01:41:08.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.794+0000 7f071ab4c640 1 -- start start 2023-11-04T01:41:08.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.794+0000 7f071ab4c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f071406c1d0 0x7f07140b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:08.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.794+0000 7f071ab4c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07140b2d30 0x7f0714155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:08.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.794+0000 7f071ab4c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0714160430 0x7f07140c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:08.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.794+0000 7f071ab4c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07140b5130 con 0x7f07140b2d30 2023-11-04T01:41:08.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.794+0000 7f071ab4c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07140b4840 con 0x7f0714160430 2023-11-04T01:41:08.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.794+0000 7f071ab4c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07140afc40 con 0x7f071406c1d0 2023-11-04T01:41:08.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.795+0000 7f0713fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07140b2d30 0x7f0714155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:08.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.795+0000 7f0713fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07140b2d30 0x7f0714155110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57038/0 (socket says 172.21.15.77:57038) 2023-11-04T01:41:08.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.795+0000 7f0713fff640 1 -- 172.21.15.77:0/3523139113 learned_addr learned my addr 172.21.15.77:0/3523139113 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:08.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.795+0000 7f07190e9640 1 --2- 172.21.15.77:0/3523139113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0714160430 0x7f07140c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:08.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.795+0000 7f07188e8640 1 --2- 172.21.15.77:0/3523139113 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f071406c1d0 0x7f07140b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:08.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.795+0000 7f0713fff640 1 -- 172.21.15.77:0/3523139113 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f071406c1d0 msgr2=0x7f07140b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:08.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.795+0000 7f0713fff640 1 --2- 172.21.15.77:0/3523139113 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f071406c1d0 0x7f07140b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.795+0000 7f0713fff640 1 -- 172.21.15.77:0/3523139113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0714160430 msgr2=0x7f07140c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:08.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.795+0000 7f0713fff640 1 --2- 172.21.15.77:0/3523139113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0714160430 0x7f07140c8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.795+0000 7f0713fff640 1 -- 172.21.15.77:0/3523139113 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f070c009b30 con 0x7f07140b2d30 2023-11-04T01:41:08.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.795+0000 7f07190e9640 1 --2- 172.21.15.77:0/3523139113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0714160430 0x7f07140c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:08.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.795+0000 7f07188e8640 1 --2- 172.21.15.77:0/3523139113 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f071406c1d0 0x7f07140b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:08.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.795+0000 7f0713fff640 1 --2- 172.21.15.77:0/3523139113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07140b2d30 0x7f0714155110 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f070000e7e0 tx=0x7f070000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:08.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.795+0000 7f07117fa640 1 -- 172.21.15.77:0/3523139113 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0700004030 con 0x7f07140b2d30 2023-11-04T01:41:08.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.795+0000 7f07117fa640 1 -- 172.21.15.77:0/3523139113 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0700004190 con 0x7f07140b2d30 2023-11-04T01:41:08.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.795+0000 7f071ab4c640 1 -- 172.21.15.77:0/3523139113 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07140aff20 con 0x7f07140b2d30 2023-11-04T01:41:08.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.795+0000 7f07117fa640 1 -- 172.21.15.77:0/3523139113 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0700004520 con 0x7f07140b2d30 2023-11-04T01:41:08.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.795+0000 7f071ab4c640 1 -- 172.21.15.77:0/3523139113 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07140b04e0 con 0x7f07140b2d30 2023-11-04T01:41:08.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.796+0000 7f071ab4c640 1 -- 172.21.15.77:0/3523139113 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0714074290 con 0x7f07140b2d30 2023-11-04T01:41:08.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.796+0000 7f07117fa640 1 -- 172.21.15.77:0/3523139113 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f070000c6d0 con 0x7f07140b2d30 2023-11-04T01:41:08.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.797+0000 7f07117fa640 1 --2- 172.21.15.77:0/3523139113 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f06f806ae70 0x7f06f806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:08.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.797+0000 7f07117fa640 1 -- 172.21.15.77:0/3523139113 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0700089730 con 0x7f07140b2d30 2023-11-04T01:41:08.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.797+0000 7f07188e8640 1 --2- 172.21.15.77:0/3523139113 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f06f806ae70 0x7f06f806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:08.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.798+0000 7f07188e8640 1 --2- 172.21.15.77:0/3523139113 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f06f806ae70 0x7f06f806d330 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0708000f60 tx=0x7f0708009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:08.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.801+0000 7f07117fa640 1 -- 172.21.15.77:0/3523139113 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0700054420 con 0x7f07140b2d30 2023-11-04T01:41:08.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.967+0000 7f071ab4c640 1 -- 172.21.15.77:0/3523139113 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f07140cb790 con 0x7f07140b2d30 2023-11-04T01:41:08.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.968+0000 7f07117fa640 1 -- 172.21.15.77:0/3523139113 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0700057a40 con 0x7f07140b2d30 2023-11-04T01:41:08.970 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:41:08.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.970+0000 7f071ab4c640 1 -- 172.21.15.77:0/3523139113 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f06f806ae70 msgr2=0x7f06f806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:08.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.970+0000 7f071ab4c640 1 --2- 172.21.15.77:0/3523139113 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f06f806ae70 0x7f06f806d330 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0708000f60 tx=0x7f0708009040 comp rx=0 tx=0).stop 2023-11-04T01:41:08.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.970+0000 7f071ab4c640 1 -- 172.21.15.77:0/3523139113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07140b2d30 msgr2=0x7f0714155110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:08.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.970+0000 7f071ab4c640 1 --2- 172.21.15.77:0/3523139113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07140b2d30 0x7f0714155110 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f070000e7e0 tx=0x7f070000eca0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.970+0000 7f071ab4c640 1 -- 172.21.15.77:0/3523139113 shutdown_connections 2023-11-04T01:41:08.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.970+0000 7f071ab4c640 1 --2- 172.21.15.77:0/3523139113 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f06f806ae70 0x7f06f806d330 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.970+0000 7f071ab4c640 1 --2- 172.21.15.77:0/3523139113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0714160430 0x7f07140c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.970+0000 7f071ab4c640 1 --2- 172.21.15.77:0/3523139113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07140b2d30 0x7f0714155110 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.970+0000 7f071ab4c640 1 --2- 172.21.15.77:0/3523139113 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f071406c1d0 0x7f07140b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:08.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.970+0000 7f071ab4c640 1 -- 172.21.15.77:0/3523139113 >> 172.21.15.77:0/3523139113 conn(0x7f071406ea20 msgr2=0x7f07140cd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:08.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.970+0000 7f071ab4c640 1 -- 172.21.15.77:0/3523139113 shutdown_connections 2023-11-04T01:41:08.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:08.970+0000 7f071ab4c640 1 -- 172.21.15.77:0/3523139113 wait complete. 2023-11-04T01:41:08.982 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:41:09.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.083+0000 7ff2d0ba9640 1 Processor -- start 2023-11-04T01:41:09.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.083+0000 7ff2d0ba9640 1 -- start start 2023-11-04T01:41:09.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.084+0000 7ff2d0ba9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff2cc1460c0 0x7ff2cc0b1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:09.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.084+0000 7ff2d0ba9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff2cc0c37d0 0x7ff2cc0c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:09.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.084+0000 7ff2d0ba9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2cc146950 con 0x7ff2cc070710 2023-11-04T01:41:09.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.084+0000 7ff2d0ba9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2cc1464a0 con 0x7ff2cc0c37d0 2023-11-04T01:41:09.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.084+0000 7ff2d0ba9640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2cc0c41a0 con 0x7ff2cc1460c0 2023-11-04T01:41:09.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.084+0000 7ff2c3fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff2cc0c37d0 0x7ff2cc0c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:09.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.084+0000 7ff2cad9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ff2cc070710 0x7ff2cc070b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45334/0 (socket says 172.21.15.77:45334) 2023-11-04T01:41:09.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.084+0000 7ff2cad9d640 1 -- 172.21.15.77:0/3139590843 learned_addr learned my addr 172.21.15.77:0/3139590843 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:09.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.084+0000 7ff2ca59c640 1 --2- 172.21.15.77:0/3139590843 >> v2:172.21.15.122:3300/0 conn(0x7ff2cc1460c0 0x7ff2cc0b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:09.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.084+0000 7ff2c3fff640 1 -- 172.21.15.77:0/3139590843 >> v2:172.21.15.122:3300/0 conn(0x7ff2cc1460c0 msgr2=0x7ff2cc0b1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:09.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.084+0000 7ff2c3fff640 1 --2- 172.21.15.77:0/3139590843 >> v2:172.21.15.122:3300/0 conn(0x7ff2cc1460c0 0x7ff2cc0b1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.084+0000 7ff2c3fff640 1 -- 172.21.15.77:0/3139590843 >> v1:172.21.15.77:6789/0 conn(0x7ff2cc070710 legacy=0x7ff2cc070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:09.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.084+0000 7ff2c3fff640 1 -- 172.21.15.77:0/3139590843 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2cc0cc5c0 con 0x7ff2cc0c37d0 2023-11-04T01:41:09.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.084+0000 7ff2c9d9b640 1 -- 172.21.15.77:0/3139590843 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1933898516 0 0) 0x7ff2cc146950 con 0x7ff2cc070710 2023-11-04T01:41:09.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.084+0000 7ff2ca59c640 1 --2- 172.21.15.77:0/3139590843 >> v2:172.21.15.122:3300/0 conn(0x7ff2cc1460c0 0x7ff2cc0b1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:09.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.085+0000 7ff2c3fff640 1 --2- 172.21.15.77:0/3139590843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2cc0c37d0 0x7ff2cc0c3c60 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc0c59d0 tx=0x7ff2b402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e16048a86b06b1e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:09.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.085+0000 7ff2c9d9b640 1 -- 172.21.15.77:0/3139590843 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4031830 con 0x7ff2cc0c37d0 2023-11-04T01:41:09.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.085+0000 7ff2c9d9b640 1 -- 172.21.15.77:0/3139590843 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b4031990 con 0x7ff2cc0c37d0 2023-11-04T01:41:09.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.085+0000 7ff2c9d9b640 1 -- 172.21.15.77:0/3139590843 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4031d20 con 0x7ff2cc0c37d0 2023-11-04T01:41:09.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.086+0000 7ff2d0ba9640 1 -- 172.21.15.77:0/3139590843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2cc0c37d0 msgr2=0x7ff2cc0c3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:09.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.086+0000 7ff2d0ba9640 1 --2- 172.21.15.77:0/3139590843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2cc0c37d0 0x7ff2cc0c3c60 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc0c59d0 tx=0x7ff2b402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.086+0000 7ff2d0ba9640 1 -- 172.21.15.77:0/3139590843 shutdown_connections 2023-11-04T01:41:09.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.086+0000 7ff2d0ba9640 1 --2- 172.21.15.77:0/3139590843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2cc0c37d0 0x7ff2cc0c3c60 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.086+0000 7ff2d0ba9640 1 --2- 172.21.15.77:0/3139590843 >> v2:172.21.15.122:3300/0 conn(0x7ff2cc1460c0 0x7ff2cc0b1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.086+0000 7ff2d0ba9640 1 -- 172.21.15.77:0/3139590843 >> 172.21.15.77:0/3139590843 conn(0x7ff2cc0ce950 msgr2=0x7ff2cc0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:09.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.086+0000 7ff2d0ba9640 1 -- 172.21.15.77:0/3139590843 shutdown_connections 2023-11-04T01:41:09.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.086+0000 7ff2d0ba9640 1 -- 172.21.15.77:0/3139590843 wait complete. 2023-11-04T01:41:09.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.087+0000 7ff2d0ba9640 1 Processor -- start 2023-11-04T01:41:09.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.087+0000 7ff2d0ba9640 1 -- start start 2023-11-04T01:41:09.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.088+0000 7ff2d0ba9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff2cc070710 0x7ff2cc137310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:09.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.088+0000 7ff2d0ba9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff2cc0c37d0 0x7ff2cc0c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:09.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.088+0000 7ff2d0ba9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2cc1460c0 0x7ff2cc0b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:09.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.088+0000 7ff2d0ba9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc0c5f20 con 0x7ff2cc1460c0 2023-11-04T01:41:09.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.088+0000 7ff2d0ba9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc0c6200 con 0x7ff2cc070710 2023-11-04T01:41:09.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.088+0000 7ff2d0ba9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc0c64e0 con 0x7ff2cc0c37d0 2023-11-04T01:41:09.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.088+0000 7ff2cad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2cc1460c0 0x7ff2cc0b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:09.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.088+0000 7ff2cad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2cc1460c0 0x7ff2cc0b3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57060/0 (socket says 172.21.15.77:57060) 2023-11-04T01:41:09.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.088+0000 7ff2cad9d640 1 -- 172.21.15.77:0/1948017799 learned_addr learned my addr 172.21.15.77:0/1948017799 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:09.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.088+0000 7ff2ca59c640 1 --2- 172.21.15.77:0/1948017799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff2cc070710 0x7ff2cc137310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:09.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.088+0000 7ff2c3fff640 1 --2- 172.21.15.77:0/1948017799 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff2cc0c37d0 0x7ff2cc0c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:09.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.088+0000 7ff2cad9d640 1 -- 172.21.15.77:0/1948017799 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff2cc0c37d0 msgr2=0x7ff2cc0c6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:09.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.088+0000 7ff2cad9d640 1 --2- 172.21.15.77:0/1948017799 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff2cc0c37d0 0x7ff2cc0c6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.088+0000 7ff2cad9d640 1 -- 172.21.15.77:0/1948017799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff2cc070710 msgr2=0x7ff2cc137310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:09.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.088+0000 7ff2cad9d640 1 --2- 172.21.15.77:0/1948017799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff2cc070710 0x7ff2cc137310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.088+0000 7ff2cad9d640 1 -- 172.21.15.77:0/1948017799 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b4009400 con 0x7ff2cc1460c0 2023-11-04T01:41:09.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.088+0000 7ff2cad9d640 1 --2- 172.21.15.77:0/1948017799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2cc1460c0 0x7ff2cc0b3b60 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400c7e0 tx=0x7ff2c400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:09.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.088+0000 7ff2c2ffd640 1 -- 172.21.15.77:0/1948017799 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c400a640 con 0x7ff2cc1460c0 2023-11-04T01:41:09.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.088+0000 7ff2c2ffd640 1 -- 172.21.15.77:0/1948017799 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c400a7c0 con 0x7ff2cc1460c0 2023-11-04T01:41:09.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.088+0000 7ff2d0ba9640 1 -- 172.21.15.77:0/1948017799 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2cc0c67c0 con 0x7ff2cc1460c0 2023-11-04T01:41:09.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.088+0000 7ff2c2ffd640 1 -- 172.21.15.77:0/1948017799 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c400ab70 con 0x7ff2cc1460c0 2023-11-04T01:41:09.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.088+0000 7ff2d0ba9640 1 -- 172.21.15.77:0/1948017799 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2cc0c7500 con 0x7ff2cc1460c0 2023-11-04T01:41:09.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.089+0000 7ff2d0ba9640 1 -- 172.21.15.77:0/1948017799 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2cc0c6ce0 con 0x7ff2cc1460c0 2023-11-04T01:41:09.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.090+0000 7ff2c2ffd640 1 -- 172.21.15.77:0/1948017799 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff2c400acd0 con 0x7ff2cc1460c0 2023-11-04T01:41:09.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.090+0000 7ff2c2ffd640 1 --2- 172.21.15.77:0/1948017799 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff2ac06ae70 0x7ff2ac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:09.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.090+0000 7ff2c2ffd640 1 -- 172.21.15.77:0/1948017799 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff2c4089260 con 0x7ff2cc1460c0 2023-11-04T01:41:09.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.090+0000 7ff2ca59c640 1 --2- 172.21.15.77:0/1948017799 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff2ac06ae70 0x7ff2ac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:09.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.091+0000 7ff2ca59c640 1 --2- 172.21.15.77:0/1948017799 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff2ac06ae70 0x7ff2ac06d330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc006fd0 tx=0x7ff2bc008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:09.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.094+0000 7ff2c2ffd640 1 -- 172.21.15.77:0/1948017799 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff2cc0c6ce0 con 0x7ff2cc1460c0 2023-11-04T01:41:09.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.259+0000 7ff2d0ba9640 1 -- 172.21.15.77:0/1948017799 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff2cc0c6ce0 con 0x7ff2cc1460c0 2023-11-04T01:41:09.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.260+0000 7ff2c2ffd640 1 -- 172.21.15.77:0/1948017799 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff2cc0c6ce0 con 0x7ff2cc1460c0 2023-11-04T01:41:09.263 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:41:09.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.262+0000 7ff2d0ba9640 1 -- 172.21.15.77:0/1948017799 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff2ac06ae70 msgr2=0x7ff2ac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:09.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.262+0000 7ff2d0ba9640 1 --2- 172.21.15.77:0/1948017799 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff2ac06ae70 0x7ff2ac06d330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc006fd0 tx=0x7ff2bc008040 comp rx=0 tx=0).stop 2023-11-04T01:41:09.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.262+0000 7ff2d0ba9640 1 -- 172.21.15.77:0/1948017799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2cc1460c0 msgr2=0x7ff2cc0b3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:09.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.262+0000 7ff2d0ba9640 1 --2- 172.21.15.77:0/1948017799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2cc1460c0 0x7ff2cc0b3b60 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400c7e0 tx=0x7ff2c400cca0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.262+0000 7ff2d0ba9640 1 -- 172.21.15.77:0/1948017799 shutdown_connections 2023-11-04T01:41:09.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.262+0000 7ff2d0ba9640 1 --2- 172.21.15.77:0/1948017799 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff2ac06ae70 0x7ff2ac06d330 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.262+0000 7ff2d0ba9640 1 --2- 172.21.15.77:0/1948017799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2cc1460c0 0x7ff2cc0b3b60 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.262+0000 7ff2d0ba9640 1 --2- 172.21.15.77:0/1948017799 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff2cc0c37d0 0x7ff2cc0c6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.262+0000 7ff2d0ba9640 1 --2- 172.21.15.77:0/1948017799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff2cc070710 0x7ff2cc137310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.262+0000 7ff2d0ba9640 1 -- 172.21.15.77:0/1948017799 >> 172.21.15.77:0/1948017799 conn(0x7ff2cc0ce950 msgr2=0x7ff2cc0ca220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:09.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.262+0000 7ff2d0ba9640 1 -- 172.21.15.77:0/1948017799 shutdown_connections 2023-11-04T01:41:09.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.262+0000 7ff2d0ba9640 1 -- 172.21.15.77:0/1948017799 wait complete. 2023-11-04T01:41:09.274 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:41:09.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.375+0000 7f6caf905640 1 Processor -- start 2023-11-04T01:41:09.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.375+0000 7f6caf905640 1 -- start start 2023-11-04T01:41:09.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.376+0000 7f6caf905640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6ca80ae1d0 0x7f6ca80cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:09.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.376+0000 7f6caf905640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca815aff0 con 0x7f6ca80c4ff0 2023-11-04T01:41:09.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.376+0000 7f6caf905640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca815a3e0 con 0x7f6ca8159c00 2023-11-04T01:41:09.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.376+0000 7f6caf905640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca815a6c0 con 0x7f6ca80ae1d0 2023-11-04T01:41:09.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.376+0000 7f6cacea0640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6ca80c4ff0 0x7f6ca80adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45340/0 (socket says 172.21.15.77:45340) 2023-11-04T01:41:09.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.376+0000 7f6cacea0640 1 -- 172.21.15.77:0/306989798 learned_addr learned my addr 172.21.15.77:0/306989798 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:09.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.376+0000 7f6cadea2640 1 --2- 172.21.15.77:0/306989798 >> v2:172.21.15.122:3300/0 conn(0x7f6ca80ae1d0 0x7f6ca80cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:09.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.376+0000 7f6c9ffff640 1 -- 172.21.15.77:0/306989798 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1492663788 0 0) 0x7f6ca815aff0 con 0x7f6ca80c4ff0 2023-11-04T01:41:09.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.376+0000 7f6c9ffff640 1 -- 172.21.15.77:0/306989798 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c94003520 con 0x7f6ca80c4ff0 2023-11-04T01:41:09.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.377+0000 7f6c9ffff640 1 -- 172.21.15.77:0/306989798 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1053622180 0 0) 0x7f6c94003520 con 0x7f6ca80c4ff0 2023-11-04T01:41:09.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.377+0000 7f6c9ffff640 1 -- 172.21.15.77:0/306989798 >> v2:172.21.15.122:3300/0 conn(0x7f6ca80ae1d0 msgr2=0x7f6ca80cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:09.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.377+0000 7f6c9ffff640 1 --2- 172.21.15.77:0/306989798 >> v2:172.21.15.122:3300/0 conn(0x7f6ca80ae1d0 0x7f6ca80cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.377+0000 7f6c9ffff640 1 -- 172.21.15.77:0/306989798 >> v1:172.21.15.122:6789/0 conn(0x7f6ca8159c00 legacy=0x7f6ca80c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:09.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.377+0000 7f6c9ffff640 1 -- 172.21.15.77:0/306989798 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca815a9a0 con 0x7f6ca80c4ff0 2023-11-04T01:41:09.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.377+0000 7f6c9ffff640 1 -- 172.21.15.77:0/306989798 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f6c98001670 con 0x7f6ca80c4ff0 2023-11-04T01:41:09.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.377+0000 7f6c9ffff640 1 -- 172.21.15.77:0/306989798 >> v1:172.21.15.77:6789/0 conn(0x7f6ca80c4ff0 legacy=0x7f6ca80adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:09.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.377+0000 7f6c9ffff640 1 --2- 172.21.15.77:0/306989798 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6c94003970 0x7f6c94003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:09.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.377+0000 7f6c9ffff640 1 --2- 172.21.15.77:0/306989798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c940047c0 0x7f6c94004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:09.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.377+0000 7f6c9ffff640 1 --2- 172.21.15.77:0/306989798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c94005180 0x7f6c9400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:09.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.377+0000 7f6c9ffff640 1 -- 172.21.15.77:0/306989798 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca815a6c0 con 0x7f6c940047c0 2023-11-04T01:41:09.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.377+0000 7f6c9ffff640 1 -- 172.21.15.77:0/306989798 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9400c020 con 0x7f6c94005180 2023-11-04T01:41:09.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.377+0000 7f6c9ffff640 1 -- 172.21.15.77:0/306989798 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9400c1e0 con 0x7f6c94003970 2023-11-04T01:41:09.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.377+0000 7f6cacea0640 1 --2- 172.21.15.77:0/306989798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c940047c0 0x7f6c94004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:09.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.377+0000 7f6cad6a1640 1 --2- 172.21.15.77:0/306989798 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6c94003970 0x7f6c94003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:09.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.377+0000 7f6cadea2640 1 --2- 172.21.15.77:0/306989798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c94005180 0x7f6c9400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:09.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.377+0000 7f6cacea0640 1 -- 172.21.15.77:0/306989798 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6c94003970 msgr2=0x7f6c94003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:09.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.377+0000 7f6cacea0640 1 --2- 172.21.15.77:0/306989798 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6c94003970 0x7f6c94003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.377+0000 7f6cacea0640 1 -- 172.21.15.77:0/306989798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c94005180 msgr2=0x7f6c9400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:09.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.377+0000 7f6cacea0640 1 --2- 172.21.15.77:0/306989798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c94005180 0x7f6c9400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.377+0000 7f6cacea0640 1 -- 172.21.15.77:0/306989798 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c94003520 con 0x7f6c940047c0 2023-11-04T01:41:09.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.377+0000 7f6cadea2640 1 -- 172.21.15.77:0/306989798 reap_dead start 2023-11-04T01:41:09.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.378+0000 7f6cacea0640 1 --2- 172.21.15.77:0/306989798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c940047c0 0x7f6c94004c40 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80b4a60 tx=0x7f6c940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c54aab543d4fa26 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:09.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.378+0000 7f6c9ffff640 1 -- 172.21.15.77:0/306989798 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98005ad0 con 0x7f6c940047c0 2023-11-04T01:41:09.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.378+0000 7f6c9ffff640 1 -- 172.21.15.77:0/306989798 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c98005c30 con 0x7f6c940047c0 2023-11-04T01:41:09.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.378+0000 7f6c9ffff640 1 -- 172.21.15.77:0/306989798 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9802c810 con 0x7f6c940047c0 2023-11-04T01:41:09.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.378+0000 7f6caf905640 1 -- 172.21.15.77:0/306989798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c940047c0 msgr2=0x7f6c94004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:09.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.378+0000 7f6caf905640 1 --2- 172.21.15.77:0/306989798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c940047c0 0x7f6c94004c40 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80b4a60 tx=0x7f6c940057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.378+0000 7f6caf905640 1 -- 172.21.15.77:0/306989798 shutdown_connections 2023-11-04T01:41:09.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.378+0000 7f6caf905640 1 --2- 172.21.15.77:0/306989798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c940047c0 0x7f6c94004c40 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.378+0000 7f6caf905640 1 -- 172.21.15.77:0/306989798 >> 172.21.15.77:0/306989798 conn(0x7f6ca80ce950 msgr2=0x7f6ca80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:09.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.378+0000 7f6caf905640 1 -- 172.21.15.77:0/306989798 shutdown_connections 2023-11-04T01:41:09.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.378+0000 7f6caf905640 1 -- 172.21.15.77:0/306989798 wait complete. 2023-11-04T01:41:09.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.380+0000 7f6caf905640 1 Processor -- start 2023-11-04T01:41:09.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.380+0000 7f6caf905640 1 -- start start 2023-11-04T01:41:09.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.380+0000 7f6caf905640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c940047c0 0x7f6ca8135c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:09.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.380+0000 7f6caf905640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6ca815b8c0 0x7f6ca815bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:09.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.380+0000 7f6caf905640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ca80c63f0 0x7f6ca80c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:09.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.380+0000 7f6caf905640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca80c6de0 con 0x7f6ca80c63f0 2023-11-04T01:41:09.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.380+0000 7f6caf905640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca81f0610 con 0x7f6c940047c0 2023-11-04T01:41:09.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.380+0000 7f6caf905640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca80c71c0 con 0x7f6ca815b8c0 2023-11-04T01:41:09.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.380+0000 7f6cadea2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ca80c63f0 0x7f6ca80c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:09.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.380+0000 7f6cadea2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ca80c63f0 0x7f6ca80c68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57066/0 (socket says 172.21.15.77:57066) 2023-11-04T01:41:09.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.381+0000 7f6cadea2640 1 -- 172.21.15.77:0/3543141128 learned_addr learned my addr 172.21.15.77:0/3543141128 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:09.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.381+0000 7f6cacea0640 1 --2- 172.21.15.77:0/3543141128 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6ca815b8c0 0x7f6ca815bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:09.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.381+0000 7f6cad6a1640 1 --2- 172.21.15.77:0/3543141128 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c940047c0 0x7f6ca8135c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:09.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.381+0000 7f6cadea2640 1 -- 172.21.15.77:0/3543141128 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6ca815b8c0 msgr2=0x7f6ca815bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:09.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.381+0000 7f6cadea2640 1 --2- 172.21.15.77:0/3543141128 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6ca815b8c0 0x7f6ca815bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.381+0000 7f6cadea2640 1 -- 172.21.15.77:0/3543141128 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c940047c0 msgr2=0x7f6ca8135c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:09.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.381+0000 7f6cadea2640 1 --2- 172.21.15.77:0/3543141128 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c940047c0 0x7f6ca8135c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.381+0000 7f6cadea2640 1 -- 172.21.15.77:0/3543141128 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca815c430 con 0x7f6ca80c63f0 2023-11-04T01:41:09.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.381+0000 7f6cadea2640 1 --2- 172.21.15.77:0/3543141128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ca80c63f0 0x7f6ca80c68a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80c8f30 tx=0x7f6ca0011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:09.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.381+0000 7f6c9dffb640 1 -- 172.21.15.77:0/3543141128 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca0004440 con 0x7f6ca80c63f0 2023-11-04T01:41:09.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.381+0000 7f6c9dffb640 1 -- 172.21.15.77:0/3543141128 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca0003610 con 0x7f6ca80c63f0 2023-11-04T01:41:09.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.381+0000 7f6caf905640 1 -- 172.21.15.77:0/3543141128 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca815c710 con 0x7f6ca80c63f0 2023-11-04T01:41:09.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.381+0000 7f6c9dffb640 1 -- 172.21.15.77:0/3543141128 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca00039c0 con 0x7f6ca80c63f0 2023-11-04T01:41:09.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.381+0000 7f6caf905640 1 -- 172.21.15.77:0/3543141128 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca815ccd0 con 0x7f6ca80c63f0 2023-11-04T01:41:09.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.382+0000 7f6caf905640 1 -- 172.21.15.77:0/3543141128 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca80c4dd0 con 0x7f6ca80c63f0 2023-11-04T01:41:09.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.383+0000 7f6c9dffb640 1 -- 172.21.15.77:0/3543141128 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6ca0003b20 con 0x7f6ca80c63f0 2023-11-04T01:41:09.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.383+0000 7f6c9dffb640 1 --2- 172.21.15.77:0/3543141128 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6c8c06aea0 0x7f6c8c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:09.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.383+0000 7f6c9dffb640 1 -- 172.21.15.77:0/3543141128 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6ca00895e0 con 0x7f6ca80c63f0 2023-11-04T01:41:09.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.383+0000 7f6cad6a1640 1 --2- 172.21.15.77:0/3543141128 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6c8c06aea0 0x7f6c8c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:09.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.384+0000 7f6cad6a1640 1 --2- 172.21.15.77:0/3543141128 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6c8c06aea0 0x7f6c8c06d360 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4000f80 tx=0x7f6ca4009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:09.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.387+0000 7f6c9dffb640 1 -- 172.21.15.77:0/3543141128 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6ca0054380 con 0x7f6ca80c63f0 2023-11-04T01:41:09.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.555+0000 7f6caf905640 1 -- 172.21.15.77:0/3543141128 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6ca80ced30 con 0x7f6ca80c63f0 2023-11-04T01:41:09.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.556+0000 7f6c9dffb640 1 -- 172.21.15.77:0/3543141128 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6ca00579a0 con 0x7f6ca80c63f0 2023-11-04T01:41:09.558 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-04T01:41:09.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.557+0000 7f6caf905640 1 -- 172.21.15.77:0/3543141128 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6c8c06aea0 msgr2=0x7f6c8c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:09.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.557+0000 7f6caf905640 1 --2- 172.21.15.77:0/3543141128 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6c8c06aea0 0x7f6c8c06d360 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4000f80 tx=0x7f6ca4009040 comp rx=0 tx=0).stop 2023-11-04T01:41:09.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.558+0000 7f6caf905640 1 -- 172.21.15.77:0/3543141128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ca80c63f0 msgr2=0x7f6ca80c68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:09.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.558+0000 7f6caf905640 1 --2- 172.21.15.77:0/3543141128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ca80c63f0 0x7f6ca80c68a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80c8f30 tx=0x7f6ca0011920 comp rx=0 tx=0).stop 2023-11-04T01:41:09.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.558+0000 7f6caf905640 1 -- 172.21.15.77:0/3543141128 shutdown_connections 2023-11-04T01:41:09.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.558+0000 7f6caf905640 1 --2- 172.21.15.77:0/3543141128 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6c8c06aea0 0x7f6c8c06d360 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.558+0000 7f6caf905640 1 --2- 172.21.15.77:0/3543141128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ca80c63f0 0x7f6ca80c68a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.558+0000 7f6caf905640 1 --2- 172.21.15.77:0/3543141128 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6ca815b8c0 0x7f6ca815bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.558+0000 7f6caf905640 1 --2- 172.21.15.77:0/3543141128 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c940047c0 0x7f6ca8135c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.558+0000 7f6caf905640 1 -- 172.21.15.77:0/3543141128 >> 172.21.15.77:0/3543141128 conn(0x7f6ca80ce950 msgr2=0x7f6ca80c37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:09.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.558+0000 7f6caf905640 1 -- 172.21.15.77:0/3543141128 shutdown_connections 2023-11-04T01:41:09.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.558+0000 7f6caf905640 1 -- 172.21.15.77:0/3543141128 wait complete. 2023-11-04T01:41:09.571 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:41:09.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.673+0000 7f668b864640 1 Processor -- start 2023-11-04T01:41:09.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.673+0000 7f668b864640 1 -- start start 2023-11-04T01:41:09.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.674+0000 7f668b864640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f668415ad30 0x7f66840adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:09.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.674+0000 7f668b864640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f66840ad730 0x7f6684070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:09.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.674+0000 7f668b864640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6684070c50 0x7f66840c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:09.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.674+0000 7f668b864640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66840ae260 con 0x7f66840ad730 2023-11-04T01:41:09.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.674+0000 7f668b864640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66840710e0 con 0x7f6684070c50 2023-11-04T01:41:09.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.674+0000 7f668b864640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66840c3900 con 0x7f668415ad30 2023-11-04T01:41:09.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.674+0000 7f6688dff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f66840ad730 0x7f6684070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:09.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.674+0000 7f6688dff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f66840ad730 0x7f6684070710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57068/0 (socket says 172.21.15.77:57068) 2023-11-04T01:41:09.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.674+0000 7f6688dff640 1 -- 172.21.15.77:0/3714126008 learned_addr learned my addr 172.21.15.77:0/3714126008 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:09.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.675+0000 7f6688dff640 1 -- 172.21.15.77:0/3714126008 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f668415ad30 msgr2=0x7f66840adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:09.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.675+0000 7f6688dff640 1 --2- 172.21.15.77:0/3714126008 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f668415ad30 0x7f66840adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.675+0000 7f6688dff640 1 -- 172.21.15.77:0/3714126008 >> v2:172.21.15.122:3300/0 conn(0x7f6684070c50 msgr2=0x7f66840c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:09.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.675+0000 7f6689e01640 1 --2- 172.21.15.77:0/3714126008 >> v2:172.21.15.122:3300/0 conn(0x7f6684070c50 0x7f66840c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:09.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.675+0000 7f6688dff640 1 --2- 172.21.15.77:0/3714126008 >> v2:172.21.15.122:3300/0 conn(0x7f6684070c50 0x7f66840c8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.675+0000 7f6688dff640 1 -- 172.21.15.77:0/3714126008 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66840c3be0 con 0x7f66840ad730 2023-11-04T01:41:09.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.675+0000 7f6688dff640 1 --2- 172.21.15.77:0/3714126008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66840ad730 0x7f6684070710 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6674009870 tx=0x7f667402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b77ec72cea99012 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:09.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.675+0000 7f667bfff640 1 -- 172.21.15.77:0/3714126008 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66740317c0 con 0x7f66840ad730 2023-11-04T01:41:09.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.675+0000 7f667bfff640 1 -- 172.21.15.77:0/3714126008 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6674031920 con 0x7f66840ad730 2023-11-04T01:41:09.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.676+0000 7f667bfff640 1 -- 172.21.15.77:0/3714126008 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6674031cb0 con 0x7f66840ad730 2023-11-04T01:41:09.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.676+0000 7f668b864640 1 -- 172.21.15.77:0/3714126008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66840ad730 msgr2=0x7f6684070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:09.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.676+0000 7f668b864640 1 --2- 172.21.15.77:0/3714126008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66840ad730 0x7f6684070710 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6674009870 tx=0x7f667402b860 comp rx=0 tx=0).stop 2023-11-04T01:41:09.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.676+0000 7f668b864640 1 -- 172.21.15.77:0/3714126008 shutdown_connections 2023-11-04T01:41:09.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.676+0000 7f668b864640 1 --2- 172.21.15.77:0/3714126008 >> v2:172.21.15.122:3300/0 conn(0x7f6684070c50 0x7f66840c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.676+0000 7f668b864640 1 --2- 172.21.15.77:0/3714126008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66840ad730 0x7f6684070710 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.676+0000 7f668b864640 1 --2- 172.21.15.77:0/3714126008 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f668415ad30 0x7f66840adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.676+0000 7f668b864640 1 -- 172.21.15.77:0/3714126008 >> 172.21.15.77:0/3714126008 conn(0x7f66840ce950 msgr2=0x7f66840ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:09.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.676+0000 7f668b864640 1 -- 172.21.15.77:0/3714126008 shutdown_connections 2023-11-04T01:41:09.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.676+0000 7f668b864640 1 -- 172.21.15.77:0/3714126008 wait complete. 2023-11-04T01:41:09.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.677+0000 7f668b864640 1 Processor -- start 2023-11-04T01:41:09.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.678+0000 7f668b864640 1 -- start start 2023-11-04T01:41:09.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.678+0000 7f668b864640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6684070c50 0x7f66841516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:09.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.678+0000 7f668b864640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f66840ad730 0x7f6684158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:09.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.678+0000 7f668b864640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f668415ad30 0x7f668415b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:09.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.678+0000 7f668b864640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6684158830 con 0x7f6684070c50 2023-11-04T01:41:09.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.678+0000 7f668b864640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668415c040 con 0x7f668415ad30 2023-11-04T01:41:09.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.678+0000 7f668b864640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f668415ba80 con 0x7f66840ad730 2023-11-04T01:41:09.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.678+0000 7f6689600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6684070c50 0x7f66841516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:09.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.678+0000 7f6689600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6684070c50 0x7f66841516c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57084/0 (socket says 172.21.15.77:57084) 2023-11-04T01:41:09.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.678+0000 7f6689600640 1 -- 172.21.15.77:0/1890920980 learned_addr learned my addr 172.21.15.77:0/1890920980 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:09.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.679+0000 7f6689600640 1 -- 172.21.15.77:0/1890920980 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f66840ad730 msgr2=0x7f6684158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:09.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.679+0000 7f6689600640 1 --2- 172.21.15.77:0/1890920980 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f66840ad730 0x7f6684158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.679+0000 7f6689e01640 1 --2- 172.21.15.77:0/1890920980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f668415ad30 0x7f668415b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:09.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.679+0000 7f6689600640 1 -- 172.21.15.77:0/1890920980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f668415ad30 msgr2=0x7f668415b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:09.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.679+0000 7f6689600640 1 --2- 172.21.15.77:0/1890920980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f668415ad30 0x7f668415b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.679+0000 7f6689600640 1 -- 172.21.15.77:0/1890920980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66740094d0 con 0x7f6684070c50 2023-11-04T01:41:09.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.679+0000 7f6689600640 1 --2- 172.21.15.77:0/1890920980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6684070c50 0x7f66841516c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f668000ba50 tx=0x7f668000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:09.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.679+0000 7f6679ffb640 1 -- 172.21.15.77:0/1890920980 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668000cbe0 con 0x7f6684070c50 2023-11-04T01:41:09.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.679+0000 7f6679ffb640 1 -- 172.21.15.77:0/1890920980 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668000cd60 con 0x7f6684070c50 2023-11-04T01:41:09.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.679+0000 7f668b864640 1 -- 172.21.15.77:0/1890920980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f668415bd60 con 0x7f6684070c50 2023-11-04T01:41:09.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.679+0000 7f6679ffb640 1 -- 172.21.15.77:0/1890920980 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6680014680 con 0x7f6684070c50 2023-11-04T01:41:09.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.679+0000 7f668b864640 1 -- 172.21.15.77:0/1890920980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6684159190 con 0x7f6684070c50 2023-11-04T01:41:09.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.680+0000 7f668b864640 1 -- 172.21.15.77:0/1890920980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6684158aa0 con 0x7f6684070c50 2023-11-04T01:41:09.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.681+0000 7f6679ffb640 1 -- 172.21.15.77:0/1890920980 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f668001d3b0 con 0x7f6684070c50 2023-11-04T01:41:09.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.681+0000 7f6679ffb640 1 --2- 172.21.15.77:0/1890920980 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f666806aea0 0x7f666806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:09.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.681+0000 7f6679ffb640 1 -- 172.21.15.77:0/1890920980 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f66800899a0 con 0x7f6684070c50 2023-11-04T01:41:09.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.681+0000 7f6688dff640 1 --2- 172.21.15.77:0/1890920980 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f666806aea0 0x7f666806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:09.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.682+0000 7f6688dff640 1 --2- 172.21.15.77:0/1890920980 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f666806aea0 0x7f666806d360 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6674036000 tx=0x7f6674030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:09.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.685+0000 7f6679ffb640 1 -- 172.21.15.77:0/1890920980 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f66800546a0 con 0x7f6684070c50 2023-11-04T01:41:09.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.859+0000 7f668b864640 1 -- 172.21.15.77:0/1890920980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6684074290 con 0x7f6684070c50 2023-11-04T01:41:09.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.859+0000 7f6679ffb640 1 -- 172.21.15.77:0/1890920980 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6680019020 con 0x7f6684070c50 2023-11-04T01:41:09.862 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:41:09.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.861+0000 7f668b864640 1 -- 172.21.15.77:0/1890920980 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f666806aea0 msgr2=0x7f666806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:09.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.861+0000 7f668b864640 1 --2- 172.21.15.77:0/1890920980 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f666806aea0 0x7f666806d360 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6674036000 tx=0x7f6674030000 comp rx=0 tx=0).stop 2023-11-04T01:41:09.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.861+0000 7f668b864640 1 -- 172.21.15.77:0/1890920980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6684070c50 msgr2=0x7f66841516c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:09.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.861+0000 7f668b864640 1 --2- 172.21.15.77:0/1890920980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6684070c50 0x7f66841516c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f668000ba50 tx=0x7f668000bf10 comp rx=0 tx=0).stop 2023-11-04T01:41:09.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.861+0000 7f668b864640 1 -- 172.21.15.77:0/1890920980 shutdown_connections 2023-11-04T01:41:09.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.861+0000 7f668b864640 1 --2- 172.21.15.77:0/1890920980 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f666806aea0 0x7f666806d360 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.861+0000 7f668b864640 1 --2- 172.21.15.77:0/1890920980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f668415ad30 0x7f668415b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.861+0000 7f668b864640 1 --2- 172.21.15.77:0/1890920980 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f66840ad730 0x7f6684158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.861+0000 7f668b864640 1 --2- 172.21.15.77:0/1890920980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6684070c50 0x7f66841516c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.861+0000 7f668b864640 1 -- 172.21.15.77:0/1890920980 >> 172.21.15.77:0/1890920980 conn(0x7f66840ce950 msgr2=0x7f66840ab8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:09.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.861+0000 7f668b864640 1 -- 172.21.15.77:0/1890920980 shutdown_connections 2023-11-04T01:41:09.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.861+0000 7f668b864640 1 -- 172.21.15.77:0/1890920980 wait complete. 2023-11-04T01:41:09.875 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:41:09.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.973+0000 7ff33fee5640 1 Processor -- start 2023-11-04T01:41:09.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.974+0000 7ff33fee5640 1 -- start start 2023-11-04T01:41:09.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.974+0000 7ff33fee5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff33815d1b0 0x7ff3380cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:09.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.974+0000 7ff33fee5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3380c9bf0 con 0x7ff338070ff0 2023-11-04T01:41:09.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.974+0000 7ff33fee5640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3380cd890 con 0x7ff338066000 2023-11-04T01:41:09.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.974+0000 7ff33fee5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3380cdb30 con 0x7ff33815d1b0 2023-11-04T01:41:09.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.974+0000 7ff33d480640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff33815d1b0 0x7ff3380cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:09.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.975+0000 7ff33d480640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff33815d1b0 0x7ff3380cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57092/0 (socket says 172.21.15.77:57092) 2023-11-04T01:41:09.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.975+0000 7ff33dc81640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ff338070ff0 0x7ff3380713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45352/0 (socket says 172.21.15.77:45352) 2023-11-04T01:41:09.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.975+0000 7ff33d480640 1 -- 172.21.15.77:0/4095407833 learned_addr learned my addr 172.21.15.77:0/4095407833 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:09.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.975+0000 7ff33d480640 1 -- 172.21.15.77:0/4095407833 >> v1:172.21.15.122:6789/0 conn(0x7ff338066000 legacy=0x7ff33806a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:09.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.975+0000 7ff33d480640 1 -- 172.21.15.77:0/4095407833 >> v1:172.21.15.77:6789/0 conn(0x7ff338070ff0 legacy=0x7ff3380713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:09.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.975+0000 7ff33d480640 1 -- 172.21.15.77:0/4095407833 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3380cde10 con 0x7ff33815d1b0 2023-11-04T01:41:09.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.975+0000 7ff33d480640 1 --2- 172.21.15.77:0/4095407833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff33815d1b0 0x7ff3380cb4e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff328009870 tx=0x7ff32802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afa5cd521e011110 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:09.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.976+0000 7ff33cc7f640 1 -- 172.21.15.77:0/4095407833 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff328030860 con 0x7ff33815d1b0 2023-11-04T01:41:09.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.976+0000 7ff33cc7f640 1 -- 172.21.15.77:0/4095407833 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3280309c0 con 0x7ff33815d1b0 2023-11-04T01:41:09.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.976+0000 7ff33cc7f640 1 -- 172.21.15.77:0/4095407833 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff328030d50 con 0x7ff33815d1b0 2023-11-04T01:41:09.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.976+0000 7ff33fee5640 1 -- 172.21.15.77:0/4095407833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff33815d1b0 msgr2=0x7ff3380cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:09.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.976+0000 7ff33fee5640 1 --2- 172.21.15.77:0/4095407833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff33815d1b0 0x7ff3380cb4e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff328009870 tx=0x7ff32802b9a0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.976+0000 7ff33fee5640 1 -- 172.21.15.77:0/4095407833 shutdown_connections 2023-11-04T01:41:09.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.976+0000 7ff33fee5640 1 --2- 172.21.15.77:0/4095407833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff33815d1b0 0x7ff3380cb4e0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.976+0000 7ff33fee5640 1 -- 172.21.15.77:0/4095407833 >> 172.21.15.77:0/4095407833 conn(0x7ff3380cbc90 msgr2=0x7ff3380cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:09.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.976+0000 7ff33fee5640 1 -- 172.21.15.77:0/4095407833 shutdown_connections 2023-11-04T01:41:09.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.976+0000 7ff33fee5640 1 -- 172.21.15.77:0/4095407833 wait complete. 2023-11-04T01:41:09.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.977+0000 7ff33fee5640 1 Processor -- start 2023-11-04T01:41:09.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.977+0000 7ff33fee5640 1 -- start start 2023-11-04T01:41:09.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.978+0000 7ff33fee5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff338066000 0x7ff3380b2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:09.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.978+0000 7ff33fee5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff338070ff0 0x7ff338151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:09.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.978+0000 7ff33fee5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff33815d1b0 0x7ff3381f2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:09.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.978+0000 7ff33fee5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3381f3330 con 0x7ff33815d1b0 2023-11-04T01:41:09.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.978+0000 7ff33fee5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3381f6130 con 0x7ff338066000 2023-11-04T01:41:09.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.978+0000 7ff33fee5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3380b2f20 con 0x7ff338070ff0 2023-11-04T01:41:09.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.978+0000 7ff33e482640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff33815d1b0 0x7ff3381f2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:09.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.978+0000 7ff33e482640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff33815d1b0 0x7ff3381f2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57108/0 (socket says 172.21.15.77:57108) 2023-11-04T01:41:09.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.978+0000 7ff33e482640 1 -- 172.21.15.77:0/1948222652 learned_addr learned my addr 172.21.15.77:0/1948222652 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:09.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.979+0000 7ff33e482640 1 -- 172.21.15.77:0/1948222652 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff338070ff0 msgr2=0x7ff338151280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:09.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.979+0000 7ff33d480640 1 --2- 172.21.15.77:0/1948222652 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff338070ff0 0x7ff338151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:09.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.979+0000 7ff33dc81640 1 --2- 172.21.15.77:0/1948222652 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff338066000 0x7ff3380b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:09.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.979+0000 7ff33e482640 1 --2- 172.21.15.77:0/1948222652 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff338070ff0 0x7ff338151280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.979+0000 7ff33e482640 1 -- 172.21.15.77:0/1948222652 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff338066000 msgr2=0x7ff3380b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:09.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.979+0000 7ff33e482640 1 --2- 172.21.15.77:0/1948222652 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff338066000 0x7ff3380b2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:09.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.979+0000 7ff33e482640 1 -- 172.21.15.77:0/1948222652 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3280094d0 con 0x7ff33815d1b0 2023-11-04T01:41:09.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.979+0000 7ff33e482640 1 --2- 172.21.15.77:0/1948222652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff33815d1b0 0x7ff3381f2df0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff33000b410 tx=0x7ff33000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:09.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.979+0000 7ff32e7fc640 1 -- 172.21.15.77:0/1948222652 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff330004020 con 0x7ff33815d1b0 2023-11-04T01:41:09.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.979+0000 7ff32e7fc640 1 -- 172.21.15.77:0/1948222652 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff330004180 con 0x7ff33815d1b0 2023-11-04T01:41:09.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.979+0000 7ff33fee5640 1 -- 172.21.15.77:0/1948222652 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3380b3200 con 0x7ff33815d1b0 2023-11-04T01:41:09.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.979+0000 7ff32e7fc640 1 -- 172.21.15.77:0/1948222652 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff330011630 con 0x7ff33815d1b0 2023-11-04T01:41:09.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.979+0000 7ff33fee5640 1 -- 172.21.15.77:0/1948222652 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3380b37c0 con 0x7ff33815d1b0 2023-11-04T01:41:09.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.980+0000 7ff33fee5640 1 -- 172.21.15.77:0/1948222652 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3380cb280 con 0x7ff33815d1b0 2023-11-04T01:41:09.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.980+0000 7ff32e7fc640 1 -- 172.21.15.77:0/1948222652 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff330011790 con 0x7ff33815d1b0 2023-11-04T01:41:09.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.981+0000 7ff32e7fc640 1 --2- 172.21.15.77:0/1948222652 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff31c06aec0 0x7ff31c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:09.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.981+0000 7ff32e7fc640 1 -- 172.21.15.77:0/1948222652 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff330089680 con 0x7ff33815d1b0 2023-11-04T01:41:09.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.981+0000 7ff33dc81640 1 --2- 172.21.15.77:0/1948222652 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff31c06aec0 0x7ff31c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:09.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.981+0000 7ff33dc81640 1 --2- 172.21.15.77:0/1948222652 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff31c06aec0 0x7ff31c06d380 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff3340012e0 tx=0x7ff334009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:09.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:09.985+0000 7ff32e7fc640 1 -- 172.21.15.77:0/1948222652 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff3300543c0 con 0x7ff33815d1b0 2023-11-04T01:41:10.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.162+0000 7ff33fee5640 1 -- 172.21.15.77:0/1948222652 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff338074290 con 0x7ff33815d1b0 2023-11-04T01:41:10.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.162+0000 7ff32e7fc640 1 -- 172.21.15.77:0/1948222652 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff3300579e0 con 0x7ff33815d1b0 2023-11-04T01:41:10.165 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-11-04T01:41:10.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.164+0000 7ff33fee5640 1 -- 172.21.15.77:0/1948222652 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff31c06aec0 msgr2=0x7ff31c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:10.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.164+0000 7ff33fee5640 1 --2- 172.21.15.77:0/1948222652 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff31c06aec0 0x7ff31c06d380 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff3340012e0 tx=0x7ff334009040 comp rx=0 tx=0).stop 2023-11-04T01:41:10.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.164+0000 7ff33fee5640 1 -- 172.21.15.77:0/1948222652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff33815d1b0 msgr2=0x7ff3381f2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:10.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.164+0000 7ff33fee5640 1 --2- 172.21.15.77:0/1948222652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff33815d1b0 0x7ff3381f2df0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff33000b410 tx=0x7ff33000b8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:10.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.164+0000 7ff33fee5640 1 -- 172.21.15.77:0/1948222652 shutdown_connections 2023-11-04T01:41:10.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.164+0000 7ff33fee5640 1 --2- 172.21.15.77:0/1948222652 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff31c06aec0 0x7ff31c06d380 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:10.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.164+0000 7ff33fee5640 1 --2- 172.21.15.77:0/1948222652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff33815d1b0 0x7ff3381f2df0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:10.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.164+0000 7ff33fee5640 1 --2- 172.21.15.77:0/1948222652 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff338070ff0 0x7ff338151280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:10.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.164+0000 7ff33fee5640 1 --2- 172.21.15.77:0/1948222652 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff338066000 0x7ff3380b2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:10.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.164+0000 7ff33fee5640 1 -- 172.21.15.77:0/1948222652 >> 172.21.15.77:0/1948222652 conn(0x7ff3380cbc90 msgr2=0x7ff3380c9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:10.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.164+0000 7ff33fee5640 1 -- 172.21.15.77:0/1948222652 shutdown_connections 2023-11-04T01:41:10.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.164+0000 7ff33fee5640 1 -- 172.21.15.77:0/1948222652 wait complete. 2023-11-04T01:41:10.177 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi122.front.sepia.ceph.com... 2023-11-04T01:41:10.177 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:41:10.178 DEBUG:teuthology.orchestra.run.smithi122:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.3 2023-11-04T01:41:10.249 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:41:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:41:10.250 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi122.stderr:ceph-fuse[94561]: fuse finished with error 0 and tester_r 0 2023-11-04T01:41:10.251 INFO:teuthology.orchestra.run.smithi122.stderr:2023-11-04T01:41:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:41:10.256 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi122.stderr:2023-11-04T01:41:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:41:10.260 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:41:10.266 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi122.front.sepia.ceph.com 2023-11-04T01:41:10.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:10.267 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:41:10.324 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-04T01:41:10.325 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:10.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.422+0000 7f1b51c6b640 1 Processor -- start 2023-11-04T01:41:10.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.422+0000 7f1b51c6b640 1 -- start start 2023-11-04T01:41:10.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.423+0000 7f1b51c6b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1b4c159c70 0x7f1b4c0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:10.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.423+0000 7f1b51c6b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b4c0b4110 con 0x7f1b4c06db20 2023-11-04T01:41:10.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.423+0000 7f1b51c6b640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b4c0b43f0 con 0x7f1b4c0b0ae0 2023-11-04T01:41:10.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.423+0000 7f1b51c6b640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b4c0b49b0 con 0x7f1b4c159c70 2023-11-04T01:41:10.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.423+0000 7f1b4affd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f1b4c06db20 0x7f1b4c0b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45368/0 (socket says 172.21.15.77:45368) 2023-11-04T01:41:10.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.423+0000 7f1b4affd640 1 -- 172.21.15.77:0/2708907836 learned_addr learned my addr 172.21.15.77:0/2708907836 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:10.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.423+0000 7f1b4b7fe640 1 --2- 172.21.15.77:0/2708907836 >> v2:172.21.15.122:3300/0 conn(0x7f1b4c159c70 0x7f1b4c0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:10.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.423+0000 7f1b4a7fc640 1 -- 172.21.15.77:0/2708907836 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 135779948 0 0) 0x7f1b4c0b4110 con 0x7f1b4c06db20 2023-11-04T01:41:10.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.423+0000 7f1b4a7fc640 1 -- 172.21.15.77:0/2708907836 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b34003520 con 0x7f1b4c06db20 2023-11-04T01:41:10.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.423+0000 7f1b4a7fc640 1 -- 172.21.15.77:0/2708907836 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2850461670 0 0) 0x7f1b34003520 con 0x7f1b4c06db20 2023-11-04T01:41:10.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.423+0000 7f1b4a7fc640 1 -- 172.21.15.77:0/2708907836 >> v2:172.21.15.122:3300/0 conn(0x7f1b4c159c70 msgr2=0x7f1b4c0ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:10.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.423+0000 7f1b4a7fc640 1 --2- 172.21.15.77:0/2708907836 >> v2:172.21.15.122:3300/0 conn(0x7f1b4c159c70 0x7f1b4c0ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:10.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.423+0000 7f1b4a7fc640 1 -- 172.21.15.77:0/2708907836 >> v1:172.21.15.122:6789/0 conn(0x7f1b4c0b0ae0 legacy=0x7f1b4c15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:10.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.424+0000 7f1b4a7fc640 1 -- 172.21.15.77:0/2708907836 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4c0b46d0 con 0x7f1b4c06db20 2023-11-04T01:41:10.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.424+0000 7f1b4a7fc640 1 -- 172.21.15.77:0/2708907836 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f1b40001670 con 0x7f1b4c06db20 2023-11-04T01:41:10.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.424+0000 7f1b4a7fc640 1 -- 172.21.15.77:0/2708907836 >> v1:172.21.15.77:6789/0 conn(0x7f1b4c06db20 legacy=0x7f1b4c0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:10.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.424+0000 7f1b4a7fc640 1 --2- 172.21.15.77:0/2708907836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b34003970 0x7f1b34003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:10.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.424+0000 7f1b4a7fc640 1 --2- 172.21.15.77:0/2708907836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b34004370 0x7f1b34004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:10.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.424+0000 7f1b4a7fc640 1 --2- 172.21.15.77:0/2708907836 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1b34005040 0x7f1b3400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:10.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.424+0000 7f1b4a7fc640 1 -- 172.21.15.77:0/2708907836 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c0b49b0 con 0x7f1b34004370 2023-11-04T01:41:10.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.424+0000 7f1b4a7fc640 1 -- 172.21.15.77:0/2708907836 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3400bfa0 con 0x7f1b34003970 2023-11-04T01:41:10.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.424+0000 7f1b4a7fc640 1 -- 172.21.15.77:0/2708907836 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3400c160 con 0x7f1b34005040 2023-11-04T01:41:10.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.424+0000 7f1b4affd640 1 --2- 172.21.15.77:0/2708907836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b34004370 0x7f1b34004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:10.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.424+0000 7f1b4b7fe640 1 --2- 172.21.15.77:0/2708907836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b34003970 0x7f1b34003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:10.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.424+0000 7f1b4bfff640 1 --2- 172.21.15.77:0/2708907836 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1b34005040 0x7f1b3400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:10.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.424+0000 7f1b4affd640 1 -- 172.21.15.77:0/2708907836 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1b34005040 msgr2=0x7f1b3400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:10.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.424+0000 7f1b4affd640 1 --2- 172.21.15.77:0/2708907836 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1b34005040 0x7f1b3400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:10.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.424+0000 7f1b4affd640 1 -- 172.21.15.77:0/2708907836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b34003970 msgr2=0x7f1b34003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:10.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.424+0000 7f1b4affd640 1 --2- 172.21.15.77:0/2708907836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b34003970 0x7f1b34003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:10.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.424+0000 7f1b4bfff640 1 -- 172.21.15.77:0/2708907836 reap_dead start 2023-11-04T01:41:10.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.424+0000 7f1b4affd640 1 -- 172.21.15.77:0/2708907836 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b34003520 con 0x7f1b34004370 2023-11-04T01:41:10.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.425+0000 7f1b4affd640 1 --2- 172.21.15.77:0/2708907836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b34004370 0x7f1b34004840 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1b4000c210 tx=0x7f1b340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e66ee31f5a4d14a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:10.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.425+0000 7f1b4a7fc640 1 -- 172.21.15.77:0/2708907836 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b40005ad0 con 0x7f1b34004370 2023-11-04T01:41:10.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.425+0000 7f1b4a7fc640 1 -- 172.21.15.77:0/2708907836 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b40005c50 con 0x7f1b34004370 2023-11-04T01:41:10.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.425+0000 7f1b4a7fc640 1 -- 172.21.15.77:0/2708907836 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4002c8d0 con 0x7f1b34004370 2023-11-04T01:41:10.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.425+0000 7f1b51c6b640 1 -- 172.21.15.77:0/2708907836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b34004370 msgr2=0x7f1b34004840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:10.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.425+0000 7f1b51c6b640 1 --2- 172.21.15.77:0/2708907836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b34004370 0x7f1b34004840 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1b4000c210 tx=0x7f1b340057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:10.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.425+0000 7f1b51c6b640 1 -- 172.21.15.77:0/2708907836 shutdown_connections 2023-11-04T01:41:10.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.425+0000 7f1b51c6b640 1 --2- 172.21.15.77:0/2708907836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b34004370 0x7f1b34004840 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:10.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.425+0000 7f1b51c6b640 1 -- 172.21.15.77:0/2708907836 >> 172.21.15.77:0/2708907836 conn(0x7f1b4c0ce950 msgr2=0x7f1b4c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:10.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.425+0000 7f1b51c6b640 1 -- 172.21.15.77:0/2708907836 shutdown_connections 2023-11-04T01:41:10.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.425+0000 7f1b51c6b640 1 -- 172.21.15.77:0/2708907836 wait complete. 2023-11-04T01:41:10.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.427+0000 7f1b51c6b640 1 Processor -- start 2023-11-04T01:41:10.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.427+0000 7f1b51c6b640 1 -- start start 2023-11-04T01:41:10.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.427+0000 7f1b51c6b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b34004370 0x7f1b4c1f2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:10.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.427+0000 7f1b51c6b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1b4c156f20 0x7f1b4c0aff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:10.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.427+0000 7f1b51c6b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b4c156a20 0x7f1b4c0cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:10.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.427+0000 7f1b51c6b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c0c8690 con 0x7f1b4c156a20 2023-11-04T01:41:10.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.427+0000 7f1b51c6b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c0b1610 con 0x7f1b34004370 2023-11-04T01:41:10.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.427+0000 7f1b51c6b640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c0b18f0 con 0x7f1b4c156f20 2023-11-04T01:41:10.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.428+0000 7f1b4bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b4c156a20 0x7f1b4c0cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:10.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.428+0000 7f1b4bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b4c156a20 0x7f1b4c0cb7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57116/0 (socket says 172.21.15.77:57116) 2023-11-04T01:41:10.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.428+0000 7f1b4bfff640 1 -- 172.21.15.77:0/1896980533 learned_addr learned my addr 172.21.15.77:0/1896980533 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:10.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.428+0000 7f1b4b7fe640 1 --2- 172.21.15.77:0/1896980533 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b34004370 0x7f1b4c1f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:10.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.428+0000 7f1b4affd640 1 --2- 172.21.15.77:0/1896980533 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1b4c156f20 0x7f1b4c0aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:10.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.428+0000 7f1b4bfff640 1 -- 172.21.15.77:0/1896980533 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1b4c156f20 msgr2=0x7f1b4c0aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:10.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.428+0000 7f1b4bfff640 1 --2- 172.21.15.77:0/1896980533 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1b4c156f20 0x7f1b4c0aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:10.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.428+0000 7f1b4bfff640 1 -- 172.21.15.77:0/1896980533 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b34004370 msgr2=0x7f1b4c1f2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:10.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.428+0000 7f1b4bfff640 1 --2- 172.21.15.77:0/1896980533 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b34004370 0x7f1b4c1f2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:10.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.428+0000 7f1b4bfff640 1 -- 172.21.15.77:0/1896980533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4c0b1bd0 con 0x7f1b4c156a20 2023-11-04T01:41:10.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.428+0000 7f1b4bfff640 1 --2- 172.21.15.77:0/1896980533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b4c156a20 0x7f1b4c0cb7a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c06d3c0 tx=0x7f1b4400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:10.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.428+0000 7f1b33fff640 1 -- 172.21.15.77:0/1896980533 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b44003970 con 0x7f1b4c156a20 2023-11-04T01:41:10.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.428+0000 7f1b33fff640 1 -- 172.21.15.77:0/1896980533 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b44003ad0 con 0x7f1b4c156a20 2023-11-04T01:41:10.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.428+0000 7f1b51c6b640 1 -- 172.21.15.77:0/1896980533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b4c0b1eb0 con 0x7f1b4c156a20 2023-11-04T01:41:10.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.428+0000 7f1b33fff640 1 -- 172.21.15.77:0/1896980533 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b44003e80 con 0x7f1b4c156a20 2023-11-04T01:41:10.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.428+0000 7f1b51c6b640 1 -- 172.21.15.77:0/1896980533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b4c1f2ac0 con 0x7f1b4c156a20 2023-11-04T01:41:10.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.429+0000 7f1b51c6b640 1 -- 172.21.15.77:0/1896980533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b4c074290 con 0x7f1b4c156a20 2023-11-04T01:41:10.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.430+0000 7f1b33fff640 1 -- 172.21.15.77:0/1896980533 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1b440050d0 con 0x7f1b4c156a20 2023-11-04T01:41:10.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.430+0000 7f1b33fff640 1 --2- 172.21.15.77:0/1896980533 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1b3806aea0 0x7f1b3806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:10.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.430+0000 7f1b33fff640 1 -- 172.21.15.77:0/1896980533 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1b44089960 con 0x7f1b4c156a20 2023-11-04T01:41:10.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.430+0000 7f1b4b7fe640 1 --2- 172.21.15.77:0/1896980533 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1b3806aea0 0x7f1b3806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:10.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.431+0000 7f1b4b7fe640 1 --2- 172.21.15.77:0/1896980533 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1b3806aea0 0x7f1b3806d360 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c009b00 tx=0x7f1b3c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:10.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.434+0000 7f1b33fff640 1 -- 172.21.15.77:0/1896980533 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1b440545c0 con 0x7f1b4c156a20 2023-11-04T01:41:10.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.636+0000 7f1b51c6b640 1 -- 172.21.15.77:0/1896980533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b4c157470 con 0x7f1b4c156a20 2023-11-04T01:41:10.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.637+0000 7f1b33fff640 1 -- 172.21.15.77:0/1896980533 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f1b44057be0 con 0x7f1b4c156a20 2023-11-04T01:41:10.639 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:10.639 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/2867268857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2867268857},{"type":"v1","addr":"172.21.15.77:6834","nonce":2867268857}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2709973073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2709973073},{"type":"v1","addr":"172.21.15.77:6835","nonce":2709973073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/396299424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":396299424},{"type":"v1","addr":"172.21.15.122:6837","nonce":396299424}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:40:05.031856+0000","modified":"2023-11-04T01:40:21.906922+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34166},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34166":{"gid":34166,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6836/2444318089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2444318089},{"type":"v1","addr":"172.21.15.122:6836","nonce":2444318089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:41:10.639 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 9 2023-11-04T01:41:10.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.638+0000 7f1b51c6b640 1 -- 172.21.15.77:0/1896980533 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1b3806aea0 msgr2=0x7f1b3806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:10.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.638+0000 7f1b51c6b640 1 --2- 172.21.15.77:0/1896980533 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1b3806aea0 0x7f1b3806d360 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c009b00 tx=0x7f1b3c008040 comp rx=0 tx=0).stop 2023-11-04T01:41:10.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.638+0000 7f1b51c6b640 1 -- 172.21.15.77:0/1896980533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b4c156a20 msgr2=0x7f1b4c0cb7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:10.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.638+0000 7f1b51c6b640 1 --2- 172.21.15.77:0/1896980533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b4c156a20 0x7f1b4c0cb7a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c06d3c0 tx=0x7f1b4400eb90 comp rx=0 tx=0).stop 2023-11-04T01:41:10.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.639+0000 7f1b51c6b640 1 -- 172.21.15.77:0/1896980533 shutdown_connections 2023-11-04T01:41:10.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.639+0000 7f1b51c6b640 1 --2- 172.21.15.77:0/1896980533 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1b3806aea0 0x7f1b3806d360 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:10.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.639+0000 7f1b51c6b640 1 --2- 172.21.15.77:0/1896980533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b4c156a20 0x7f1b4c0cb7a0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:10.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.639+0000 7f1b51c6b640 1 --2- 172.21.15.77:0/1896980533 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1b4c156f20 0x7f1b4c0aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:10.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.639+0000 7f1b51c6b640 1 --2- 172.21.15.77:0/1896980533 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b34004370 0x7f1b4c1f2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:10.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.639+0000 7f1b51c6b640 1 -- 172.21.15.77:0/1896980533 >> 172.21.15.77:0/1896980533 conn(0x7f1b4c0ce950 msgr2=0x7f1b4c06ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:10.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.639+0000 7f1b51c6b640 1 -- 172.21.15.77:0/1896980533 shutdown_connections 2023-11-04T01:41:10.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.639+0000 7f1b51c6b640 1 -- 172.21.15.77:0/1896980533 wait complete. 2023-11-04T01:41:10.651 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:10.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.750+0000 7f76a506f640 1 Processor -- start 2023-11-04T01:41:10.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.750+0000 7f76a506f640 1 -- start start 2023-11-04T01:41:10.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.751+0000 7f76a506f640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f76a00aec80 0x7f76a00b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:10.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.751+0000 7f76a506f640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f76a00af060 0x7f76a006a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:10.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.751+0000 7f76a506f640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76a00b1590 con 0x7f76a006ef40 2023-11-04T01:41:10.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.751+0000 7f76a506f640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a0155a40 con 0x7f76a00aec80 2023-11-04T01:41:10.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.751+0000 7f76a506f640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a006a660 con 0x7f76a00af060 2023-11-04T01:41:10.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.752+0000 7f769e59c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f76a00af060 0x7f76a006a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:10.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.752+0000 7f769ed9d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f76a00aec80 0x7f76a00b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:10.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.752+0000 7f769f59e640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f76a006ef40 0x7f76a00cb7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:51110/0 (socket says 172.21.15.77:51110) 2023-11-04T01:41:10.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.752+0000 7f769f59e640 1 -- 172.21.15.77:0/1972096156 learned_addr learned my addr 172.21.15.77:0/1972096156 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:10.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.752+0000 7f769dd9b640 1 -- 172.21.15.77:0/1972096156 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 205199924 0 0) 0x7f76a00b1590 con 0x7f76a006ef40 2023-11-04T01:41:10.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.752+0000 7f769dd9b640 1 -- 172.21.15.77:0/1972096156 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f768c003520 con 0x7f76a006ef40 2023-11-04T01:41:10.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.752+0000 7f769e59c640 1 -- 172.21.15.77:0/1972096156 >> v2:172.21.15.122:3300/0 conn(0x7f76a00aec80 msgr2=0x7f76a00b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:10.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.752+0000 7f769e59c640 1 --2- 172.21.15.77:0/1972096156 >> v2:172.21.15.122:3300/0 conn(0x7f76a00aec80 0x7f76a00b1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:10.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.752+0000 7f769e59c640 1 -- 172.21.15.77:0/1972096156 >> v1:172.21.15.122:6789/0 conn(0x7f76a006ef40 legacy=0x7f76a00cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:10.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.752+0000 7f769e59c640 1 -- 172.21.15.77:0/1972096156 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a006a8e0 con 0x7f76a00af060 2023-11-04T01:41:10.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.752+0000 7f769ed9d640 1 --2- 172.21.15.77:0/1972096156 >> v2:172.21.15.122:3300/0 conn(0x7f76a00aec80 0x7f76a00b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:41:10.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.753+0000 7f769e59c640 1 --2- 172.21.15.77:0/1972096156 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f76a00af060 0x7f76a006a120 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7688009790 tx=0x7f768802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=930b62d3d4df6fa8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:10.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.753+0000 7f769dd9b640 1 -- 172.21.15.77:0/1972096156 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7688031800 con 0x7f76a00af060 2023-11-04T01:41:10.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.753+0000 7f769dd9b640 1 -- 172.21.15.77:0/1972096156 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7688031960 con 0x7f76a00af060 2023-11-04T01:41:10.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.753+0000 7f769dd9b640 1 -- 172.21.15.77:0/1972096156 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7688031cd0 con 0x7f76a00af060 2023-11-04T01:41:10.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.754+0000 7f76a506f640 1 -- 172.21.15.77:0/1972096156 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f76a00af060 msgr2=0x7f76a006a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:10.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.754+0000 7f76a506f640 1 --2- 172.21.15.77:0/1972096156 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f76a00af060 0x7f76a006a120 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7688009790 tx=0x7f768802b8a0 comp rx=0 tx=0).stop 2023-11-04T01:41:10.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.754+0000 7f76a506f640 1 -- 172.21.15.77:0/1972096156 shutdown_connections 2023-11-04T01:41:10.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.754+0000 7f76a506f640 1 --2- 172.21.15.77:0/1972096156 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f76a00af060 0x7f76a006a120 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:10.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.754+0000 7f76a506f640 1 --2- 172.21.15.77:0/1972096156 >> v2:172.21.15.122:3300/0 conn(0x7f76a00aec80 0x7f76a00b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:10.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.754+0000 7f76a506f640 1 -- 172.21.15.77:0/1972096156 >> 172.21.15.77:0/1972096156 conn(0x7f76a0098d40 msgr2=0x7f76a00cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:10.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.754+0000 7f76a506f640 1 -- 172.21.15.77:0/1972096156 shutdown_connections 2023-11-04T01:41:10.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.754+0000 7f76a506f640 1 -- 172.21.15.77:0/1972096156 wait complete. 2023-11-04T01:41:10.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.755+0000 7f76a506f640 1 Processor -- start 2023-11-04T01:41:10.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.755+0000 7f76a506f640 1 -- start start 2023-11-04T01:41:10.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.756+0000 7f76a506f640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f76a006ef40 0x7f76a014ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:10.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.756+0000 7f76a506f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76a00aec80 0x7f76a015c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:10.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.756+0000 7f76a506f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76a00af060 0x7f76a00c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:10.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.756+0000 7f76a506f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a015d090 con 0x7f76a00af060 2023-11-04T01:41:10.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.756+0000 7f76a506f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a015d370 con 0x7f76a00aec80 2023-11-04T01:41:10.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.756+0000 7f76a506f640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a015d650 con 0x7f76a006ef40 2023-11-04T01:41:10.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.756+0000 7f769f59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76a00af060 0x7f76a00c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:10.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.756+0000 7f769f59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76a00af060 0x7f76a00c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57132/0 (socket says 172.21.15.77:57132) 2023-11-04T01:41:10.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.756+0000 7f769f59e640 1 -- 172.21.15.77:0/1713505747 learned_addr learned my addr 172.21.15.77:0/1713505747 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:10.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.756+0000 7f769e59c640 1 --2- 172.21.15.77:0/1713505747 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76a00aec80 0x7f76a015c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:10.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.756+0000 7f769ed9d640 1 --2- 172.21.15.77:0/1713505747 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f76a006ef40 0x7f76a014ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:10.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.757+0000 7f769f59e640 1 -- 172.21.15.77:0/1713505747 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f76a006ef40 msgr2=0x7f76a014ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:10.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.757+0000 7f769f59e640 1 --2- 172.21.15.77:0/1713505747 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f76a006ef40 0x7f76a014ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:10.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.757+0000 7f769f59e640 1 -- 172.21.15.77:0/1713505747 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76a00aec80 msgr2=0x7f76a015c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:10.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.757+0000 7f769f59e640 1 --2- 172.21.15.77:0/1713505747 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76a00aec80 0x7f76a015c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:10.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.757+0000 7f769f59e640 1 -- 172.21.15.77:0/1713505747 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76980093a0 con 0x7f76a00af060 2023-11-04T01:41:10.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.757+0000 7f769e59c640 1 --2- 172.21.15.77:0/1713505747 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76a00aec80 0x7f76a015c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:10.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.757+0000 7f769f59e640 1 --2- 172.21.15.77:0/1713505747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76a00af060 0x7f76a00c8190 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f769000caa0 tx=0x7f769000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:10.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.757+0000 7f76977fe640 1 -- 172.21.15.77:0/1713505747 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769000ac00 con 0x7f76a00af060 2023-11-04T01:41:10.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.757+0000 7f76977fe640 1 -- 172.21.15.77:0/1713505747 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769000ad60 con 0x7f76a00af060 2023-11-04T01:41:10.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.757+0000 7f76a506f640 1 -- 172.21.15.77:0/1713505747 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76880093a0 con 0x7f76a00af060 2023-11-04T01:41:10.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.757+0000 7f76977fe640 1 -- 172.21.15.77:0/1713505747 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7690012620 con 0x7f76a00af060 2023-11-04T01:41:10.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.757+0000 7f76a506f640 1 -- 172.21.15.77:0/1713505747 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a015dc10 con 0x7f76a00af060 2023-11-04T01:41:10.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.758+0000 7f76a506f640 1 -- 172.21.15.77:0/1713505747 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a015de00 con 0x7f76a00af060 2023-11-04T01:41:10.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.758+0000 7f76977fe640 1 -- 172.21.15.77:0/1713505747 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7690007070 con 0x7f76a00af060 2023-11-04T01:41:10.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.759+0000 7f76977fe640 1 --2- 172.21.15.77:0/1713505747 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f768006ae70 0x7f768006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:10.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.759+0000 7f76977fe640 1 -- 172.21.15.77:0/1713505747 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7690089a20 con 0x7f76a00af060 2023-11-04T01:41:10.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.759+0000 7f769ed9d640 1 --2- 172.21.15.77:0/1713505747 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f768006ae70 0x7f768006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:10.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.759+0000 7f769ed9d640 1 --2- 172.21.15.77:0/1713505747 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f768006ae70 0x7f768006d330 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7698009c20 tx=0x7f7698009110 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:10.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.763+0000 7f76977fe640 1 -- 172.21.15.77:0/1713505747 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f76900546b0 con 0x7f76a00af060 2023-11-04T01:41:10.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.930+0000 7f76a506f640 1 -- 172.21.15.77:0/1713505747 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76a0074290 con 0x7f76a00af060 2023-11-04T01:41:10.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.932+0000 7f76977fe640 1 -- 172.21.15.77:0/1713505747 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18661 (secure 0 0 0) 0x7f7690017090 con 0x7f76a00af060 2023-11-04T01:41:10.934 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:10.934 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":26,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:40:47.579547+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:40:02.810971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:40:04.003979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:40:07.734355+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:10.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.933+0000 7f76a506f640 1 -- 172.21.15.77:0/1713505747 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f768006ae70 msgr2=0x7f768006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:10.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.933+0000 7f76a506f640 1 --2- 172.21.15.77:0/1713505747 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f768006ae70 0x7f768006d330 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7698009c20 tx=0x7f7698009110 comp rx=0 tx=0).stop 2023-11-04T01:41:10.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.933+0000 7f76a506f640 1 -- 172.21.15.77:0/1713505747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76a00af060 msgr2=0x7f76a00c8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:10.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.933+0000 7f76a506f640 1 --2- 172.21.15.77:0/1713505747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76a00af060 0x7f76a00c8190 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f769000caa0 tx=0x7f769000cf60 comp rx=0 tx=0).stop 2023-11-04T01:41:10.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.933+0000 7f76a506f640 1 -- 172.21.15.77:0/1713505747 shutdown_connections 2023-11-04T01:41:10.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.933+0000 7f76a506f640 1 --2- 172.21.15.77:0/1713505747 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f768006ae70 0x7f768006d330 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:10.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.934+0000 7f76a506f640 1 --2- 172.21.15.77:0/1713505747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76a00af060 0x7f76a00c8190 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:10.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.934+0000 7f76a506f640 1 --2- 172.21.15.77:0/1713505747 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76a00aec80 0x7f76a015c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:10.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.934+0000 7f76a506f640 1 --2- 172.21.15.77:0/1713505747 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f76a006ef40 0x7f76a014ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:10.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.934+0000 7f76a506f640 1 -- 172.21.15.77:0/1713505747 >> 172.21.15.77:0/1713505747 conn(0x7f76a0098d40 msgr2=0x7f76a006e610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:10.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.934+0000 7f76a506f640 1 -- 172.21.15.77:0/1713505747 shutdown_connections 2023-11-04T01:41:10.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:10.934+0000 7f76a506f640 1 -- 172.21.15.77:0/1713505747 wait complete. 2023-11-04T01:41:10.946 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:40:02.810971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:40:04.003979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-04T01:40:07.734355+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-04T01:41:10.947 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:41:11.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.048+0000 7feda9590640 1 Processor -- start 2023-11-04T01:41:11.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.048+0000 7feda9590640 1 -- start start 2023-11-04T01:41:11.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.049+0000 7feda9590640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feda406a830 0x7feda40b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.049+0000 7feda9590640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7feda40722a0 0x7feda40ca380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.049+0000 7feda9590640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda40cdf80 con 0x7feda41603d0 2023-11-04T01:41:11.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.049+0000 7feda9590640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feda40b19d0 con 0x7feda40722a0 2023-11-04T01:41:11.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.049+0000 7feda9590640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda4072730 con 0x7feda406a830 2023-11-04T01:41:11.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.049+0000 7feda37fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7feda40722a0 0x7feda40ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.049+0000 7feda37fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7feda40722a0 0x7feda40ca380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57142/0 (socket says 172.21.15.77:57142) 2023-11-04T01:41:11.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.049+0000 7feda37fe640 1 -- 172.21.15.77:0/1158540237 learned_addr learned my addr 172.21.15.77:0/1158540237 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:11.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.050+0000 7feda37fe640 1 -- 172.21.15.77:0/1158540237 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feda406a830 msgr2=0x7feda40b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:11.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.050+0000 7feda37fe640 1 --2- 172.21.15.77:0/1158540237 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feda406a830 0x7feda40b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.050+0000 7feda37fe640 1 -- 172.21.15.77:0/1158540237 >> v1:172.21.15.122:6789/0 conn(0x7feda41603d0 legacy=0x7feda406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:11.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.050+0000 7feda37fe640 1 -- 172.21.15.77:0/1158540237 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda40ce6f0 con 0x7feda40722a0 2023-11-04T01:41:11.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.050+0000 7feda37fe640 1 --2- 172.21.15.77:0/1158540237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda40722a0 0x7feda40ca380 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fed9c009870 tx=0x7fed9c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6be256f60224d7e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:11.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.051+0000 7feda1ffb640 1 -- 172.21.15.77:0/1158540237 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c0317c0 con 0x7feda40722a0 2023-11-04T01:41:11.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.051+0000 7feda1ffb640 1 -- 172.21.15.77:0/1158540237 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9c031920 con 0x7feda40722a0 2023-11-04T01:41:11.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.051+0000 7feda1ffb640 1 -- 172.21.15.77:0/1158540237 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c031cb0 con 0x7feda40722a0 2023-11-04T01:41:11.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.051+0000 7feda9590640 1 -- 172.21.15.77:0/1158540237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda40722a0 msgr2=0x7feda40ca380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.051+0000 7feda9590640 1 --2- 172.21.15.77:0/1158540237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda40722a0 0x7feda40ca380 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fed9c009870 tx=0x7fed9c02b860 comp rx=0 tx=0).stop 2023-11-04T01:41:11.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.051+0000 7feda9590640 1 -- 172.21.15.77:0/1158540237 shutdown_connections 2023-11-04T01:41:11.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.051+0000 7feda9590640 1 --2- 172.21.15.77:0/1158540237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda40722a0 0x7feda40ca380 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.051+0000 7feda9590640 1 --2- 172.21.15.77:0/1158540237 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feda406a830 0x7feda40b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.051+0000 7feda9590640 1 -- 172.21.15.77:0/1158540237 >> 172.21.15.77:0/1158540237 conn(0x7feda406d800 msgr2=0x7feda406dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:11.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.051+0000 7feda9590640 1 -- 172.21.15.77:0/1158540237 shutdown_connections 2023-11-04T01:41:11.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.051+0000 7feda9590640 1 -- 172.21.15.77:0/1158540237 wait complete. 2023-11-04T01:41:11.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.052+0000 7feda9590640 1 Processor -- start 2023-11-04T01:41:11.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.053+0000 7feda9590640 1 -- start start 2023-11-04T01:41:11.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.053+0000 7feda9590640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feda406a830 0x7feda40c3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.053+0000 7feda9590640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda40722a0 0x7feda4152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.053+0000 7feda9590640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feda41603d0 0x7feda40b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.053+0000 7feda9590640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda415f1e0 con 0x7feda40722a0 2023-11-04T01:41:11.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.053+0000 7feda9590640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda415f4c0 con 0x7feda406a830 2023-11-04T01:41:11.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.053+0000 7feda9590640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda415f7a0 con 0x7feda41603d0 2023-11-04T01:41:11.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.053+0000 7feda27fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda40722a0 0x7feda4152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.053+0000 7feda27fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda40722a0 0x7feda4152060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57160/0 (socket says 172.21.15.77:57160) 2023-11-04T01:41:11.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.053+0000 7feda27fc640 1 -- 172.21.15.77:0/2692616487 learned_addr learned my addr 172.21.15.77:0/2692616487 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:11.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.054+0000 7feda2ffd640 1 --2- 172.21.15.77:0/2692616487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feda406a830 0x7feda40c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.054+0000 7feda37fe640 1 --2- 172.21.15.77:0/2692616487 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feda41603d0 0x7feda40b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.054+0000 7feda27fc640 1 -- 172.21.15.77:0/2692616487 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feda41603d0 msgr2=0x7feda40b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.054+0000 7feda27fc640 1 --2- 172.21.15.77:0/2692616487 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feda41603d0 0x7feda40b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.054+0000 7feda27fc640 1 -- 172.21.15.77:0/2692616487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feda406a830 msgr2=0x7feda40c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.054+0000 7feda27fc640 1 --2- 172.21.15.77:0/2692616487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feda406a830 0x7feda40c3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.054+0000 7feda27fc640 1 -- 172.21.15.77:0/2692616487 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9c0094d0 con 0x7feda40722a0 2023-11-04T01:41:11.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.054+0000 7feda2ffd640 1 --2- 172.21.15.77:0/2692616487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feda406a830 0x7feda40c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:11.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.054+0000 7feda37fe640 1 --2- 172.21.15.77:0/2692616487 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feda41603d0 0x7feda40b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:11.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.054+0000 7feda27fc640 1 --2- 172.21.15.77:0/2692616487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda40722a0 0x7feda4152060 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fed9800b4a0 tx=0x7fed9800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:11.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.054+0000 7fed8b7fe640 1 -- 172.21.15.77:0/2692616487 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed98010610 con 0x7feda40722a0 2023-11-04T01:41:11.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.054+0000 7fed8b7fe640 1 -- 172.21.15.77:0/2692616487 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed98010770 con 0x7feda40722a0 2023-11-04T01:41:11.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.054+0000 7feda9590640 1 -- 172.21.15.77:0/2692616487 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feda415fa80 con 0x7feda40722a0 2023-11-04T01:41:11.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.054+0000 7fed8b7fe640 1 -- 172.21.15.77:0/2692616487 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed98010b20 con 0x7feda40722a0 2023-11-04T01:41:11.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.054+0000 7feda9590640 1 -- 172.21.15.77:0/2692616487 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feda40c3b90 con 0x7feda40722a0 2023-11-04T01:41:11.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.055+0000 7feda9590640 1 -- 172.21.15.77:0/2692616487 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feda415c650 con 0x7feda40722a0 2023-11-04T01:41:11.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.055+0000 7fed8b7fe640 1 -- 172.21.15.77:0/2692616487 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fed98010c80 con 0x7feda40722a0 2023-11-04T01:41:11.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.056+0000 7fed8b7fe640 1 --2- 172.21.15.77:0/2692616487 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fed9006aea0 0x7fed9006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.056+0000 7fed8b7fe640 1 -- 172.21.15.77:0/2692616487 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fed98089630 con 0x7feda40722a0 2023-11-04T01:41:11.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.056+0000 7feda2ffd640 1 --2- 172.21.15.77:0/2692616487 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fed9006aea0 0x7fed9006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.057+0000 7feda2ffd640 1 --2- 172.21.15.77:0/2692616487 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fed9006aea0 0x7fed9006d360 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fed94007eb0 tx=0x7fed940073c0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:11.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.060+0000 7fed8b7fe640 1 -- 172.21.15.77:0/2692616487 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fed98054320 con 0x7feda40722a0 2023-11-04T01:41:11.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.224+0000 7feda9590640 1 -- 172.21.15.77:0/2692616487 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feda40b5990 con 0x7feda40722a0 2023-11-04T01:41:11.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.224+0000 7fed8b7fe640 1 -- 172.21.15.77:0/2692616487 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fed98057940 con 0x7feda40722a0 2023-11-04T01:41:11.226 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:41:11.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.226+0000 7feda9590640 1 -- 172.21.15.77:0/2692616487 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fed9006aea0 msgr2=0x7fed9006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.226+0000 7feda9590640 1 --2- 172.21.15.77:0/2692616487 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fed9006aea0 0x7fed9006d360 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fed94007eb0 tx=0x7fed940073c0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.226+0000 7feda9590640 1 -- 172.21.15.77:0/2692616487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda40722a0 msgr2=0x7feda4152060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.226+0000 7feda9590640 1 --2- 172.21.15.77:0/2692616487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda40722a0 0x7feda4152060 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fed9800b4a0 tx=0x7fed9800b960 comp rx=0 tx=0).stop 2023-11-04T01:41:11.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.226+0000 7feda9590640 1 -- 172.21.15.77:0/2692616487 shutdown_connections 2023-11-04T01:41:11.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.226+0000 7feda9590640 1 --2- 172.21.15.77:0/2692616487 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fed9006aea0 0x7fed9006d360 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.226+0000 7feda9590640 1 --2- 172.21.15.77:0/2692616487 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feda41603d0 0x7feda40b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.226+0000 7feda9590640 1 --2- 172.21.15.77:0/2692616487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda40722a0 0x7feda4152060 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.226+0000 7feda9590640 1 --2- 172.21.15.77:0/2692616487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feda406a830 0x7feda40c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.226+0000 7feda9590640 1 -- 172.21.15.77:0/2692616487 >> 172.21.15.77:0/2692616487 conn(0x7feda406d800 msgr2=0x7feda415b550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:11.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.226+0000 7feda9590640 1 -- 172.21.15.77:0/2692616487 shutdown_connections 2023-11-04T01:41:11.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.226+0000 7feda9590640 1 -- 172.21.15.77:0/2692616487 wait complete. 2023-11-04T01:41:11.238 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:41:11.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.341+0000 7f692d989640 1 Processor -- start 2023-11-04T01:41:11.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.341+0000 7f692d989640 1 -- start start 2023-11-04T01:41:11.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.342+0000 7f692d989640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f69280cdac0 0x7f69280b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.342+0000 7f692d989640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69280d01f0 con 0x7f69280b64c0 2023-11-04T01:41:11.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.342+0000 7f692d989640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69280b6a40 con 0x7f692815af20 2023-11-04T01:41:11.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.342+0000 7f692d989640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69280cc380 con 0x7f69280cdac0 2023-11-04T01:41:11.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.342+0000 7f69277fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f69280cdac0 0x7f69280b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.342+0000 7f69267fc640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f69280b64c0 0x7f69280cd3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45376/0 (socket says 172.21.15.77:45376) 2023-11-04T01:41:11.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.342+0000 7f69267fc640 1 -- 172.21.15.77:0/2472978812 learned_addr learned my addr 172.21.15.77:0/2472978812 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:11.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.343+0000 7f69277fe640 1 -- 172.21.15.77:0/2472978812 >> v1:172.21.15.122:6789/0 conn(0x7f692815af20 legacy=0x7f69280cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.343+0000 7f69277fe640 1 -- 172.21.15.77:0/2472978812 >> v1:172.21.15.77:6789/0 conn(0x7f69280b64c0 legacy=0x7f69280cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.343+0000 7f6925ffb640 1 -- 172.21.15.77:0/2472978812 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3321935550 0 0) 0x7f69280d01f0 con 0x7f69280b64c0 2023-11-04T01:41:11.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.343+0000 7f69277fe640 1 -- 172.21.15.77:0/2472978812 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69280d04b0 con 0x7f69280cdac0 2023-11-04T01:41:11.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.343+0000 7f69277fe640 1 --2- 172.21.15.77:0/2472978812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69280cdac0 0x7f69280b3cd0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f69200097a0 tx=0x7f692002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d76202346978ee18 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:11.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.343+0000 7f6925ffb640 1 -- 172.21.15.77:0/2472978812 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6920030610 con 0x7f69280cdac0 2023-11-04T01:41:11.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.343+0000 7f6925ffb640 1 -- 172.21.15.77:0/2472978812 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6920030770 con 0x7f69280cdac0 2023-11-04T01:41:11.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.343+0000 7f6925ffb640 1 -- 172.21.15.77:0/2472978812 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6920030b00 con 0x7f69280cdac0 2023-11-04T01:41:11.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.344+0000 7f692d989640 1 -- 172.21.15.77:0/2472978812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69280cdac0 msgr2=0x7f69280b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.344+0000 7f692d989640 1 --2- 172.21.15.77:0/2472978812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69280cdac0 0x7f69280b3cd0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f69200097a0 tx=0x7f692002b960 comp rx=0 tx=0).stop 2023-11-04T01:41:11.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.344+0000 7f692d989640 1 -- 172.21.15.77:0/2472978812 shutdown_connections 2023-11-04T01:41:11.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.344+0000 7f692d989640 1 --2- 172.21.15.77:0/2472978812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69280cdac0 0x7f69280b3cd0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.344+0000 7f692d989640 1 -- 172.21.15.77:0/2472978812 >> 172.21.15.77:0/2472978812 conn(0x7f692806ea20 msgr2=0x7f692806ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:11.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.344+0000 7f692d989640 1 -- 172.21.15.77:0/2472978812 shutdown_connections 2023-11-04T01:41:11.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.344+0000 7f692d989640 1 -- 172.21.15.77:0/2472978812 wait complete. 2023-11-04T01:41:11.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.345+0000 7f692d989640 1 Processor -- start 2023-11-04T01:41:11.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.345+0000 7f692d989640 1 -- start start 2023-11-04T01:41:11.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.346+0000 7f692d989640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69280b64c0 0x7f69281545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.346+0000 7f692d989640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f69280cdac0 0x7f6928147f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.346+0000 7f692d989640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f692815af20 0x7f69280cf150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.346+0000 7f692d989640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69280ca950 con 0x7f692815af20 2023-11-04T01:41:11.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.346+0000 7f692d989640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69280c9d40 con 0x7f69280b64c0 2023-11-04T01:41:11.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.346+0000 7f692d989640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69280ca020 con 0x7f69280cdac0 2023-11-04T01:41:11.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.346+0000 7f69277fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f692815af20 0x7f69280cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.346+0000 7f69277fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f692815af20 0x7f69280cf150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57188/0 (socket says 172.21.15.77:57188) 2023-11-04T01:41:11.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.346+0000 7f69277fe640 1 -- 172.21.15.77:0/3722691360 learned_addr learned my addr 172.21.15.77:0/3722691360 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:11.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.346+0000 7f6926ffd640 1 --2- 172.21.15.77:0/3722691360 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69280b64c0 0x7f69281545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.346+0000 7f69267fc640 1 --2- 172.21.15.77:0/3722691360 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f69280cdac0 0x7f6928147f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.346+0000 7f69277fe640 1 -- 172.21.15.77:0/3722691360 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f69280cdac0 msgr2=0x7f6928147f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.346+0000 7f69277fe640 1 --2- 172.21.15.77:0/3722691360 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f69280cdac0 0x7f6928147f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.346+0000 7f69277fe640 1 -- 172.21.15.77:0/3722691360 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69280b64c0 msgr2=0x7f69281545f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.346+0000 7f69277fe640 1 --2- 172.21.15.77:0/3722691360 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69280b64c0 0x7f69281545f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.346+0000 7f69277fe640 1 -- 172.21.15.77:0/3722691360 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6920009400 con 0x7f692815af20 2023-11-04T01:41:11.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.347+0000 7f69277fe640 1 --2- 172.21.15.77:0/3722691360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f692815af20 0x7f69280cf150 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f69200097a0 tx=0x7f69200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:11.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.347+0000 7f690ffff640 1 -- 172.21.15.77:0/3722691360 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6920039c10 con 0x7f692815af20 2023-11-04T01:41:11.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.347+0000 7f690ffff640 1 -- 172.21.15.77:0/3722691360 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692003f040 con 0x7f692815af20 2023-11-04T01:41:11.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.347+0000 7f690ffff640 1 -- 172.21.15.77:0/3722691360 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6920004030 con 0x7f692815af20 2023-11-04T01:41:11.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.347+0000 7f692d989640 1 -- 172.21.15.77:0/3722691360 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69280ca300 con 0x7f692815af20 2023-11-04T01:41:11.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.347+0000 7f692d989640 1 -- 172.21.15.77:0/3722691360 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6928154b30 con 0x7f692815af20 2023-11-04T01:41:11.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.348+0000 7f692d989640 1 -- 172.21.15.77:0/3722691360 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69280caac0 con 0x7f692815af20 2023-11-04T01:41:11.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.348+0000 7f690ffff640 1 -- 172.21.15.77:0/3722691360 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6920004190 con 0x7f692815af20 2023-11-04T01:41:11.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.348+0000 7f690ffff640 1 --2- 172.21.15.77:0/3722691360 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f691406ae70 0x7f691406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.349+0000 7f690ffff640 1 -- 172.21.15.77:0/3722691360 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f69200abac0 con 0x7f692815af20 2023-11-04T01:41:11.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.349+0000 7f6926ffd640 1 --2- 172.21.15.77:0/3722691360 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f691406ae70 0x7f691406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.349+0000 7f6926ffd640 1 --2- 172.21.15.77:0/3722691360 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f691406ae70 0x7f691406d330 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f69180012e0 tx=0x7f6918009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:11.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.353+0000 7f690ffff640 1 -- 172.21.15.77:0/3722691360 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f69200768d0 con 0x7f692815af20 2023-11-04T01:41:11.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.518+0000 7f692d989640 1 -- 172.21.15.77:0/3722691360 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f69280cec30 con 0x7f692815af20 2023-11-04T01:41:11.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.518+0000 7f690ffff640 1 -- 172.21.15.77:0/3722691360 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6920079ef0 con 0x7f692815af20 2023-11-04T01:41:11.521 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:41:11.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.520+0000 7f692d989640 1 -- 172.21.15.77:0/3722691360 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f691406ae70 msgr2=0x7f691406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.520+0000 7f692d989640 1 --2- 172.21.15.77:0/3722691360 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f691406ae70 0x7f691406d330 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f69180012e0 tx=0x7f6918009040 comp rx=0 tx=0).stop 2023-11-04T01:41:11.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.520+0000 7f692d989640 1 -- 172.21.15.77:0/3722691360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f692815af20 msgr2=0x7f69280cf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.520+0000 7f692d989640 1 --2- 172.21.15.77:0/3722691360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f692815af20 0x7f69280cf150 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f69200097a0 tx=0x7f69200046c0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.520+0000 7f692d989640 1 -- 172.21.15.77:0/3722691360 shutdown_connections 2023-11-04T01:41:11.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.520+0000 7f692d989640 1 --2- 172.21.15.77:0/3722691360 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f691406ae70 0x7f691406d330 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.520+0000 7f692d989640 1 --2- 172.21.15.77:0/3722691360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f692815af20 0x7f69280cf150 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.520+0000 7f692d989640 1 --2- 172.21.15.77:0/3722691360 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f69280cdac0 0x7f6928147f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.520+0000 7f692d989640 1 --2- 172.21.15.77:0/3722691360 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69280b64c0 0x7f69281545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.520+0000 7f692d989640 1 -- 172.21.15.77:0/3722691360 >> 172.21.15.77:0/3722691360 conn(0x7f692806ea20 msgr2=0x7f69280b5160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:11.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.520+0000 7f692d989640 1 -- 172.21.15.77:0/3722691360 shutdown_connections 2023-11-04T01:41:11.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.520+0000 7f692d989640 1 -- 172.21.15.77:0/3722691360 wait complete. 2023-11-04T01:41:11.533 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:41:11.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.634+0000 7fd17af05640 1 Processor -- start 2023-11-04T01:41:11.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.634+0000 7fd17af05640 1 -- start start 2023-11-04T01:41:11.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.635+0000 7fd17af05640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd17415b120 0x7fd17406b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.635+0000 7fd17af05640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd174065df0 con 0x7fd17415ad40 2023-11-04T01:41:11.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.635+0000 7fd17af05640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd174066040 con 0x7fd1740c9b60 2023-11-04T01:41:11.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.635+0000 7fd17af05640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd17406bc40 con 0x7fd17415b120 2023-11-04T01:41:11.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.635+0000 7fd178ca1640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd17415ad40 0x7fd17415f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45390/0 (socket says 172.21.15.77:45390) 2023-11-04T01:41:11.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.635+0000 7fd178ca1640 1 -- 172.21.15.77:0/766413754 learned_addr learned my addr 172.21.15.77:0/766413754 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:11.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.635+0000 7fd173fff640 1 --2- 172.21.15.77:0/766413754 >> v2:172.21.15.122:3300/0 conn(0x7fd17415b120 0x7fd17406b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.635+0000 7fd1737fe640 1 -- 172.21.15.77:0/766413754 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2629015118 0 0) 0x7fd174065df0 con 0x7fd17415ad40 2023-11-04T01:41:11.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.635+0000 7fd1737fe640 1 -- 172.21.15.77:0/766413754 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd164003520 con 0x7fd17415ad40 2023-11-04T01:41:11.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.635+0000 7fd173fff640 1 -- 172.21.15.77:0/766413754 >> v1:172.21.15.122:6789/0 conn(0x7fd1740c9b60 legacy=0x7fd174070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.635+0000 7fd173fff640 1 -- 172.21.15.77:0/766413754 >> v1:172.21.15.77:6789/0 conn(0x7fd17415ad40 legacy=0x7fd17415f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.635+0000 7fd173fff640 1 -- 172.21.15.77:0/766413754 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd174066320 con 0x7fd17415b120 2023-11-04T01:41:11.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.636+0000 7fd173fff640 1 --2- 172.21.15.77:0/766413754 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd17415b120 0x7fd17406b700 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd1600097a0 tx=0x7fd16002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f50f49a92920935b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:11.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.636+0000 7fd1737fe640 1 -- 172.21.15.77:0/766413754 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd160030610 con 0x7fd17415b120 2023-11-04T01:41:11.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.636+0000 7fd1737fe640 1 -- 172.21.15.77:0/766413754 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd160030770 con 0x7fd17415b120 2023-11-04T01:41:11.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.636+0000 7fd1737fe640 1 -- 172.21.15.77:0/766413754 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd160030b00 con 0x7fd17415b120 2023-11-04T01:41:11.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.637+0000 7fd17af05640 1 -- 172.21.15.77:0/766413754 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd17415b120 msgr2=0x7fd17406b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.637+0000 7fd17af05640 1 --2- 172.21.15.77:0/766413754 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd17415b120 0x7fd17406b700 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd1600097a0 tx=0x7fd16002b960 comp rx=0 tx=0).stop 2023-11-04T01:41:11.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.637+0000 7fd17af05640 1 -- 172.21.15.77:0/766413754 shutdown_connections 2023-11-04T01:41:11.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.637+0000 7fd17af05640 1 --2- 172.21.15.77:0/766413754 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd17415b120 0x7fd17406b700 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.637+0000 7fd17af05640 1 -- 172.21.15.77:0/766413754 >> 172.21.15.77:0/766413754 conn(0x7fd1740cbc90 msgr2=0x7fd1740cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:11.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.637+0000 7fd17af05640 1 -- 172.21.15.77:0/766413754 shutdown_connections 2023-11-04T01:41:11.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.637+0000 7fd17af05640 1 -- 172.21.15.77:0/766413754 wait complete. 2023-11-04T01:41:11.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.638+0000 7fd17af05640 1 Processor -- start 2023-11-04T01:41:11.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.638+0000 7fd17af05640 1 -- start start 2023-11-04T01:41:11.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.639+0000 7fd17af05640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1740c9b60 0x7fd174155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.639+0000 7fd17af05640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd17415ad40 0x7fd1740c2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.639+0000 7fd17af05640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd17415b120 0x7fd1740c7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.639+0000 7fd17af05640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1740a74d0 con 0x7fd17415b120 2023-11-04T01:41:11.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.639+0000 7fd17af05640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1740a7740 con 0x7fd1740c9b60 2023-11-04T01:41:11.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.639+0000 7fd17af05640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1740c35b0 con 0x7fd17415ad40 2023-11-04T01:41:11.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.639+0000 7fd1794a2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd17415b120 0x7fd1740c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.639+0000 7fd1794a2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd17415b120 0x7fd1740c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57194/0 (socket says 172.21.15.77:57194) 2023-11-04T01:41:11.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.639+0000 7fd1794a2640 1 -- 172.21.15.77:0/2130825629 learned_addr learned my addr 172.21.15.77:0/2130825629 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:11.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.639+0000 7fd178ca1640 1 --2- 172.21.15.77:0/2130825629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1740c9b60 0x7fd174155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.639+0000 7fd173fff640 1 --2- 172.21.15.77:0/2130825629 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd17415ad40 0x7fd1740c2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.639+0000 7fd1794a2640 1 -- 172.21.15.77:0/2130825629 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd17415ad40 msgr2=0x7fd1740c2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.639+0000 7fd1794a2640 1 --2- 172.21.15.77:0/2130825629 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd17415ad40 0x7fd1740c2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.639+0000 7fd1794a2640 1 -- 172.21.15.77:0/2130825629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1740c9b60 msgr2=0x7fd174155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.639+0000 7fd1794a2640 1 --2- 172.21.15.77:0/2130825629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1740c9b60 0x7fd174155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.639+0000 7fd1794a2640 1 -- 172.21.15.77:0/2130825629 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd160009400 con 0x7fd17415b120 2023-11-04T01:41:11.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.639+0000 7fd1794a2640 1 --2- 172.21.15.77:0/2130825629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd17415b120 0x7fd1740c7710 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd16c00c7d0 tx=0x7fd16c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:11.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.639+0000 7fd1717fa640 1 -- 172.21.15.77:0/2130825629 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16c003b70 con 0x7fd17415b120 2023-11-04T01:41:11.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.639+0000 7fd1717fa640 1 -- 172.21.15.77:0/2130825629 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd16c003cf0 con 0x7fd17415b120 2023-11-04T01:41:11.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.639+0000 7fd1717fa640 1 -- 172.21.15.77:0/2130825629 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16c00aa90 con 0x7fd17415b120 2023-11-04T01:41:11.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.640+0000 7fd17af05640 1 -- 172.21.15.77:0/2130825629 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1740c3890 con 0x7fd17415b120 2023-11-04T01:41:11.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.640+0000 7fd17af05640 1 -- 172.21.15.77:0/2130825629 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd174155fe0 con 0x7fd17415b120 2023-11-04T01:41:11.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.641+0000 7fd17af05640 1 -- 172.21.15.77:0/2130825629 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1740c3db0 con 0x7fd17415b120 2023-11-04T01:41:11.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.641+0000 7fd1717fa640 1 -- 172.21.15.77:0/2130825629 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd16c00abf0 con 0x7fd17415b120 2023-11-04T01:41:11.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.641+0000 7fd1717fa640 1 --2- 172.21.15.77:0/2130825629 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd15806ae70 0x7fd15806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.641+0000 7fd1717fa640 1 -- 172.21.15.77:0/2130825629 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd16c0896b0 con 0x7fd17415b120 2023-11-04T01:41:11.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.641+0000 7fd178ca1640 1 --2- 172.21.15.77:0/2130825629 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd15806ae70 0x7fd15806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.642+0000 7fd178ca1640 1 --2- 172.21.15.77:0/2130825629 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd15806ae70 0x7fd15806d330 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd1680011e0 tx=0x7fd168007d30 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:11.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.645+0000 7fd1717fa640 1 -- 172.21.15.77:0/2130825629 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd1740c3db0 con 0x7fd17415b120 2023-11-04T01:41:11.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.813+0000 7fd17af05640 1 -- 172.21.15.77:0/2130825629 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd1740c3db0 con 0x7fd17415b120 2023-11-04T01:41:11.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.814+0000 7fd1717fa640 1 -- 172.21.15.77:0/2130825629 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd16c003e60 con 0x7fd17415b120 2023-11-04T01:41:11.816 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-04T01:41:11.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.816+0000 7fd17af05640 1 -- 172.21.15.77:0/2130825629 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd15806ae70 msgr2=0x7fd15806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.816+0000 7fd17af05640 1 --2- 172.21.15.77:0/2130825629 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd15806ae70 0x7fd15806d330 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd1680011e0 tx=0x7fd168007d30 comp rx=0 tx=0).stop 2023-11-04T01:41:11.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.816+0000 7fd17af05640 1 -- 172.21.15.77:0/2130825629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd17415b120 msgr2=0x7fd1740c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.816+0000 7fd17af05640 1 --2- 172.21.15.77:0/2130825629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd17415b120 0x7fd1740c7710 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd16c00c7d0 tx=0x7fd16c00cc90 comp rx=0 tx=0).stop 2023-11-04T01:41:11.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.816+0000 7fd17af05640 1 -- 172.21.15.77:0/2130825629 shutdown_connections 2023-11-04T01:41:11.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.816+0000 7fd17af05640 1 --2- 172.21.15.77:0/2130825629 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd15806ae70 0x7fd15806d330 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.816+0000 7fd17af05640 1 --2- 172.21.15.77:0/2130825629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd17415b120 0x7fd1740c7710 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.816+0000 7fd17af05640 1 --2- 172.21.15.77:0/2130825629 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd17415ad40 0x7fd1740c2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.816+0000 7fd17af05640 1 --2- 172.21.15.77:0/2130825629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1740c9b60 0x7fd174155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.816+0000 7fd17af05640 1 -- 172.21.15.77:0/2130825629 >> 172.21.15.77:0/2130825629 conn(0x7fd1740cbc90 msgr2=0x7fd1741568d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:11.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.816+0000 7fd17af05640 1 -- 172.21.15.77:0/2130825629 shutdown_connections 2023-11-04T01:41:11.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.816+0000 7fd17af05640 1 -- 172.21.15.77:0/2130825629 wait complete. 2023-11-04T01:41:11.828 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-04T01:41:11.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.928+0000 7f1e979fc640 1 Processor -- start 2023-11-04T01:41:11.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.929+0000 7f1e979fc640 1 -- start start 2023-11-04T01:41:11.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.929+0000 7f1e979fc640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1e9015add0 0x7f1e900cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.929+0000 7f1e979fc640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1e90072370 0x7f1e900cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.929+0000 7f1e979fc640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e900b1cc0 con 0x7f1e90071f90 2023-11-04T01:41:11.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.929+0000 7f1e979fc640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e900b1fa0 con 0x7f1e9015add0 2023-11-04T01:41:11.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.929+0000 7f1e979fc640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9015a0e0 con 0x7f1e90072370 2023-11-04T01:41:11.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.930+0000 7f1e94f97640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1e9015add0 0x7f1e900cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.930+0000 7f1e95f99640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1e90072370 0x7f1e900cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.930+0000 7f1e95798640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f1e90071f90 0x7f1e900b1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:51156/0 (socket says 172.21.15.77:51156) 2023-11-04T01:41:11.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.930+0000 7f1e95798640 1 -- 172.21.15.77:0/352419083 learned_addr learned my addr 172.21.15.77:0/352419083 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:11.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.930+0000 7f1e94f97640 1 -- 172.21.15.77:0/352419083 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1e90072370 msgr2=0x7f1e900cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:11.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.930+0000 7f1e94f97640 1 --2- 172.21.15.77:0/352419083 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1e90072370 0x7f1e900cf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.930+0000 7f1e94f97640 1 -- 172.21.15.77:0/352419083 >> v1:172.21.15.122:6789/0 conn(0x7f1e90071f90 legacy=0x7f1e900b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.930+0000 7f1e94f97640 1 -- 172.21.15.77:0/352419083 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e9015a2f0 con 0x7f1e9015add0 2023-11-04T01:41:11.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.930+0000 7f1e87fff640 1 -- 172.21.15.77:0/352419083 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3670407881 0 0) 0x7f1e900b1cc0 con 0x7f1e90071f90 2023-11-04T01:41:11.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.931+0000 7f1e94f97640 1 --2- 172.21.15.77:0/352419083 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e9015add0 0x7f1e900cecc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1e800097a0 tx=0x7f1e8002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1b7dc0374bf2d97 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:11.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.931+0000 7f1e87fff640 1 -- 172.21.15.77:0/352419083 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e80031830 con 0x7f1e9015add0 2023-11-04T01:41:11.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.931+0000 7f1e87fff640 1 -- 172.21.15.77:0/352419083 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e80031990 con 0x7f1e9015add0 2023-11-04T01:41:11.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.931+0000 7f1e87fff640 1 -- 172.21.15.77:0/352419083 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e80031d20 con 0x7f1e9015add0 2023-11-04T01:41:11.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.931+0000 7f1e979fc640 1 -- 172.21.15.77:0/352419083 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e9015add0 msgr2=0x7f1e900cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.931+0000 7f1e979fc640 1 --2- 172.21.15.77:0/352419083 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e9015add0 0x7f1e900cecc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1e800097a0 tx=0x7f1e8002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.931+0000 7f1e979fc640 1 -- 172.21.15.77:0/352419083 shutdown_connections 2023-11-04T01:41:11.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.931+0000 7f1e979fc640 1 --2- 172.21.15.77:0/352419083 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1e90072370 0x7f1e900cf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.931+0000 7f1e979fc640 1 --2- 172.21.15.77:0/352419083 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e9015add0 0x7f1e900cecc0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.931+0000 7f1e979fc640 1 -- 172.21.15.77:0/352419083 >> 172.21.15.77:0/352419083 conn(0x7f1e9006d800 msgr2=0x7f1e9006dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:11.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.932+0000 7f1e979fc640 1 -- 172.21.15.77:0/352419083 shutdown_connections 2023-11-04T01:41:11.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.932+0000 7f1e979fc640 1 -- 172.21.15.77:0/352419083 wait complete. 2023-11-04T01:41:11.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.933+0000 7f1e979fc640 1 Processor -- start 2023-11-04T01:41:11.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.933+0000 7f1e979fc640 1 -- start start 2023-11-04T01:41:11.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.933+0000 7f1e979fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e90071f90 0x7f1e901502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.933+0000 7f1e979fc640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1e90072370 0x7f1e901f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.933+0000 7f1e979fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e9015add0 0x7f1e900c47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.933+0000 7f1e979fc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e901f7200 con 0x7f1e90071f90 2023-11-04T01:41:11.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.933+0000 7f1e979fc640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e900c6f80 con 0x7f1e9015add0 2023-11-04T01:41:11.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.933+0000 7f1e979fc640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e901f6c40 con 0x7f1e90072370 2023-11-04T01:41:11.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.933+0000 7f1e95798640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e90071f90 0x7f1e901502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.933+0000 7f1e95798640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e90071f90 0x7f1e901502d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57208/0 (socket says 172.21.15.77:57208) 2023-11-04T01:41:11.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.934+0000 7f1e95798640 1 -- 172.21.15.77:0/2580931615 learned_addr learned my addr 172.21.15.77:0/2580931615 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:11.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.934+0000 7f1e95f99640 1 --2- 172.21.15.77:0/2580931615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e9015add0 0x7f1e900c47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.934+0000 7f1e94f97640 1 --2- 172.21.15.77:0/2580931615 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1e90072370 0x7f1e901f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.934+0000 7f1e95798640 1 -- 172.21.15.77:0/2580931615 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1e90072370 msgr2=0x7f1e901f62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.934+0000 7f1e95798640 1 --2- 172.21.15.77:0/2580931615 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1e90072370 0x7f1e901f62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.934+0000 7f1e95798640 1 -- 172.21.15.77:0/2580931615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e9015add0 msgr2=0x7f1e900c47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:11.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.934+0000 7f1e95798640 1 --2- 172.21.15.77:0/2580931615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e9015add0 0x7f1e900c47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:11.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.934+0000 7f1e95798640 1 -- 172.21.15.77:0/2580931615 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e80009400 con 0x7f1e90071f90 2023-11-04T01:41:11.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.934+0000 7f1e95798640 1 --2- 172.21.15.77:0/2580931615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e90071f90 0x7f1e901502d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1e8800c4d0 tx=0x7f1e8800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:11.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.934+0000 7f1e85ffb640 1 -- 172.21.15.77:0/2580931615 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e880074e0 con 0x7f1e90071f90 2023-11-04T01:41:11.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.934+0000 7f1e85ffb640 1 -- 172.21.15.77:0/2580931615 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e88007660 con 0x7f1e90071f90 2023-11-04T01:41:11.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.934+0000 7f1e979fc640 1 -- 172.21.15.77:0/2580931615 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e901f6f20 con 0x7f1e90071f90 2023-11-04T01:41:11.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.934+0000 7f1e85ffb640 1 -- 172.21.15.77:0/2580931615 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e88004a20 con 0x7f1e90071f90 2023-11-04T01:41:11.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.934+0000 7f1e979fc640 1 -- 172.21.15.77:0/2580931615 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e901f6810 con 0x7f1e90071f90 2023-11-04T01:41:11.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.935+0000 7f1e979fc640 1 -- 172.21.15.77:0/2580931615 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e901f6a00 con 0x7f1e90071f90 2023-11-04T01:41:11.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.936+0000 7f1e85ffb640 1 -- 172.21.15.77:0/2580931615 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1e88004b80 con 0x7f1e90071f90 2023-11-04T01:41:11.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.936+0000 7f1e85ffb640 1 --2- 172.21.15.77:0/2580931615 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1e7406aea0 0x7f1e7406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:11.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.936+0000 7f1e85ffb640 1 -- 172.21.15.77:0/2580931615 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1e88088b10 con 0x7f1e90071f90 2023-11-04T01:41:11.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.936+0000 7f1e94f97640 1 --2- 172.21.15.77:0/2580931615 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1e7406aea0 0x7f1e7406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:11.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.937+0000 7f1e94f97640 1 --2- 172.21.15.77:0/2580931615 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1e7406aea0 0x7f1e7406d360 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1e80036000 tx=0x7f1e80008030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:11.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:11.940+0000 7f1e85ffb640 1 -- 172.21.15.77:0/2580931615 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1e901f6a00 con 0x7f1e90071f90 2023-11-04T01:41:12.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.107+0000 7f1e979fc640 1 -- 172.21.15.77:0/2580931615 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1e901f6a00 con 0x7f1e90071f90 2023-11-04T01:41:12.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.107+0000 7f1e85ffb640 1 -- 172.21.15.77:0/2580931615 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1e88018020 con 0x7f1e90071f90 2023-11-04T01:41:12.109 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:41:12.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.109+0000 7f1e979fc640 1 -- 172.21.15.77:0/2580931615 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1e7406aea0 msgr2=0x7f1e7406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.109+0000 7f1e979fc640 1 --2- 172.21.15.77:0/2580931615 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1e7406aea0 0x7f1e7406d360 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1e80036000 tx=0x7f1e80008030 comp rx=0 tx=0).stop 2023-11-04T01:41:12.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.109+0000 7f1e979fc640 1 -- 172.21.15.77:0/2580931615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e90071f90 msgr2=0x7f1e901502d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.109+0000 7f1e979fc640 1 --2- 172.21.15.77:0/2580931615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e90071f90 0x7f1e901502d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1e8800c4d0 tx=0x7f1e8800c990 comp rx=0 tx=0).stop 2023-11-04T01:41:12.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.109+0000 7f1e979fc640 1 -- 172.21.15.77:0/2580931615 shutdown_connections 2023-11-04T01:41:12.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.109+0000 7f1e979fc640 1 --2- 172.21.15.77:0/2580931615 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1e7406aea0 0x7f1e7406d360 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.109+0000 7f1e979fc640 1 --2- 172.21.15.77:0/2580931615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e9015add0 0x7f1e900c47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.109+0000 7f1e979fc640 1 --2- 172.21.15.77:0/2580931615 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1e90072370 0x7f1e901f62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.109+0000 7f1e979fc640 1 --2- 172.21.15.77:0/2580931615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e90071f90 0x7f1e901502d0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.110+0000 7f1e979fc640 1 -- 172.21.15.77:0/2580931615 >> 172.21.15.77:0/2580931615 conn(0x7f1e9006d800 msgr2=0x7f1e900cc670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:12.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.110+0000 7f1e979fc640 1 -- 172.21.15.77:0/2580931615 shutdown_connections 2023-11-04T01:41:12.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.110+0000 7f1e979fc640 1 -- 172.21.15.77:0/2580931615 wait complete. 2023-11-04T01:41:12.122 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:12.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.219+0000 7f97af290640 1 Processor -- start 2023-11-04T01:41:12.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.220+0000 7f97af290640 1 -- start start 2023-11-04T01:41:12.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.220+0000 7f97af290640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f97a80ce240 0x7f97a8157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.220+0000 7f97af290640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a815e000 con 0x7f97a80cde60 2023-11-04T01:41:12.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.220+0000 7f97af290640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a815e2e0 con 0x7f97a8157540 2023-11-04T01:41:12.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.220+0000 7f97af290640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97a815e5c0 con 0x7f97a80ce240 2023-11-04T01:41:12.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.220+0000 7f97ac82b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f97a80ce240 0x7f97a8157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.221+0000 7f97ad02c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f97a80cde60 0x7f97a815d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45406/0 (socket says 172.21.15.77:45406) 2023-11-04T01:41:12.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.221+0000 7f97ad02c640 1 -- 172.21.15.77:0/2933669410 learned_addr learned my addr 172.21.15.77:0/2933669410 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:12.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.221+0000 7f97ac82b640 1 -- 172.21.15.77:0/2933669410 >> v1:172.21.15.122:6789/0 conn(0x7f97a8157540 legacy=0x7f97a80d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.221+0000 7f97ac82b640 1 -- 172.21.15.77:0/2933669410 >> v1:172.21.15.77:6789/0 conn(0x7f97a80cde60 legacy=0x7f97a815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.221+0000 7f979ffff640 1 -- 172.21.15.77:0/2933669410 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4083858922 0 0) 0x7f97a815e000 con 0x7f97a80cde60 2023-11-04T01:41:12.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.221+0000 7f97ac82b640 1 -- 172.21.15.77:0/2933669410 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a80d1120 con 0x7f97a80ce240 2023-11-04T01:41:12.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.222+0000 7f97ac82b640 1 --2- 172.21.15.77:0/2933669410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97a80ce240 0x7f97a8157000 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f97980097a0 tx=0x7f979802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=929305f19a8cae33 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:12.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.222+0000 7f979ffff640 1 -- 172.21.15.77:0/2933669410 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9798030610 con 0x7f97a80ce240 2023-11-04T01:41:12.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.222+0000 7f979ffff640 1 -- 172.21.15.77:0/2933669410 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9798030770 con 0x7f97a80ce240 2023-11-04T01:41:12.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.222+0000 7f979ffff640 1 -- 172.21.15.77:0/2933669410 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9798030b00 con 0x7f97a80ce240 2023-11-04T01:41:12.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.222+0000 7f97af290640 1 -- 172.21.15.77:0/2933669410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97a80ce240 msgr2=0x7f97a8157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.222+0000 7f97af290640 1 --2- 172.21.15.77:0/2933669410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97a80ce240 0x7f97a8157000 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f97980097a0 tx=0x7f979802b960 comp rx=0 tx=0).stop 2023-11-04T01:41:12.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.222+0000 7f97af290640 1 -- 172.21.15.77:0/2933669410 shutdown_connections 2023-11-04T01:41:12.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.222+0000 7f97af290640 1 --2- 172.21.15.77:0/2933669410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97a80ce240 0x7f97a8157000 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.222+0000 7f97af290640 1 -- 172.21.15.77:0/2933669410 >> 172.21.15.77:0/2933669410 conn(0x7f97a8071f30 msgr2=0x7f97a80cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:12.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.222+0000 7f97af290640 1 -- 172.21.15.77:0/2933669410 shutdown_connections 2023-11-04T01:41:12.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.222+0000 7f97af290640 1 -- 172.21.15.77:0/2933669410 wait complete. 2023-11-04T01:41:12.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.223+0000 7f97af290640 1 Processor -- start 2023-11-04T01:41:12.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.223+0000 7f97af290640 1 -- start start 2023-11-04T01:41:12.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.224+0000 7f97af290640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97a80cde60 0x7f97a80cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.224+0000 7f97af290640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97a80ce240 0x7f97a814ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.224+0000 7f97af290640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97a8157540 0x7f97a814f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.224+0000 7f97af290640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a81f71a0 con 0x7f97a8157540 2023-11-04T01:41:12.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.224+0000 7f97af290640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a8159970 con 0x7f97a80ce240 2023-11-04T01:41:12.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.224+0000 7f97af290640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a8159c50 con 0x7f97a80cde60 2023-11-04T01:41:12.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.224+0000 7f97ad82d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97a8157540 0x7f97a814f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.224+0000 7f97ad82d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97a8157540 0x7f97a814f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57240/0 (socket says 172.21.15.77:57240) 2023-11-04T01:41:12.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.224+0000 7f97ad82d640 1 -- 172.21.15.77:0/3151487624 learned_addr learned my addr 172.21.15.77:0/3151487624 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:12.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.224+0000 7f97ad02c640 1 --2- 172.21.15.77:0/3151487624 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97a80cde60 0x7f97a80cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.224+0000 7f97ac82b640 1 --2- 172.21.15.77:0/3151487624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97a80ce240 0x7f97a814ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.225+0000 7f97ad82d640 1 -- 172.21.15.77:0/3151487624 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97a80cde60 msgr2=0x7f97a80cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.225+0000 7f97ad82d640 1 --2- 172.21.15.77:0/3151487624 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97a80cde60 0x7f97a80cbf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.225+0000 7f97ad82d640 1 -- 172.21.15.77:0/3151487624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97a80ce240 msgr2=0x7f97a814ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.225+0000 7f97ad82d640 1 --2- 172.21.15.77:0/3151487624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97a80ce240 0x7f97a814ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.225+0000 7f97ad82d640 1 -- 172.21.15.77:0/3151487624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9798009400 con 0x7f97a8157540 2023-11-04T01:41:12.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.225+0000 7f97ad02c640 1 --2- 172.21.15.77:0/3151487624 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97a80cde60 0x7f97a80cbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:12.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.225+0000 7f97ad82d640 1 --2- 172.21.15.77:0/3151487624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97a8157540 0x7f97a814f390 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f97a400c390 tx=0x7f97a400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:12.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.225+0000 7f979dffb640 1 -- 172.21.15.77:0/3151487624 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a40052d0 con 0x7f97a8157540 2023-11-04T01:41:12.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.225+0000 7f979dffb640 1 -- 172.21.15.77:0/3151487624 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a4005430 con 0x7f97a8157540 2023-11-04T01:41:12.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.225+0000 7f97af290640 1 -- 172.21.15.77:0/3151487624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97a8159f30 con 0x7f97a8157540 2023-11-04T01:41:12.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.225+0000 7f979dffb640 1 -- 172.21.15.77:0/3151487624 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a4003810 con 0x7f97a8157540 2023-11-04T01:41:12.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.225+0000 7f97af290640 1 -- 172.21.15.77:0/3151487624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a81f2d90 con 0x7f97a8157540 2023-11-04T01:41:12.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.226+0000 7f97af290640 1 -- 172.21.15.77:0/3151487624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97a815a450 con 0x7f97a8157540 2023-11-04T01:41:12.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.226+0000 7f979dffb640 1 -- 172.21.15.77:0/3151487624 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f97a4003970 con 0x7f97a8157540 2023-11-04T01:41:12.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.227+0000 7f979dffb640 1 --2- 172.21.15.77:0/3151487624 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f978c06ae70 0x7f978c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.227+0000 7f979dffb640 1 -- 172.21.15.77:0/3151487624 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f97a4088ef0 con 0x7f97a8157540 2023-11-04T01:41:12.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.227+0000 7f97ad02c640 1 --2- 172.21.15.77:0/3151487624 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f978c06ae70 0x7f978c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.227+0000 7f97ad02c640 1 --2- 172.21.15.77:0/3151487624 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f978c06ae70 0x7f978c06d330 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f97a0007fd0 tx=0x7f97a0005b70 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:12.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.231+0000 7f979dffb640 1 -- 172.21.15.77:0/3151487624 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f97a815a450 con 0x7f97a8157540 2023-11-04T01:41:12.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.430+0000 7f97af290640 1 -- 172.21.15.77:0/3151487624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f97a815a450 con 0x7f97a8157540 2023-11-04T01:41:12.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.430+0000 7f979dffb640 1 -- 172.21.15.77:0/3151487624 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f97a815a450 con 0x7f97a8157540 2023-11-04T01:41:12.433 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:12.433 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/2867268857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2867268857},{"type":"v1","addr":"172.21.15.77:6834","nonce":2867268857}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2709973073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2709973073},{"type":"v1","addr":"172.21.15.77:6835","nonce":2709973073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/396299424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":396299424},{"type":"v1","addr":"172.21.15.122:6837","nonce":396299424}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:40:05.031856+0000","modified":"2023-11-04T01:40:21.906922+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34166},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34166":{"gid":34166,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6836/2444318089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2444318089},{"type":"v1","addr":"172.21.15.122:6836","nonce":2444318089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:41:12.433 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 9 2023-11-04T01:41:12.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.432+0000 7f97af290640 1 -- 172.21.15.77:0/3151487624 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f978c06ae70 msgr2=0x7f978c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.432+0000 7f97af290640 1 --2- 172.21.15.77:0/3151487624 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f978c06ae70 0x7f978c06d330 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f97a0007fd0 tx=0x7f97a0005b70 comp rx=0 tx=0).stop 2023-11-04T01:41:12.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.432+0000 7f97af290640 1 -- 172.21.15.77:0/3151487624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97a8157540 msgr2=0x7f97a814f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.432+0000 7f97af290640 1 --2- 172.21.15.77:0/3151487624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97a8157540 0x7f97a814f390 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f97a400c390 tx=0x7f97a400c850 comp rx=0 tx=0).stop 2023-11-04T01:41:12.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.432+0000 7f97af290640 1 -- 172.21.15.77:0/3151487624 shutdown_connections 2023-11-04T01:41:12.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.432+0000 7f97af290640 1 --2- 172.21.15.77:0/3151487624 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f978c06ae70 0x7f978c06d330 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.432+0000 7f97af290640 1 --2- 172.21.15.77:0/3151487624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97a8157540 0x7f97a814f390 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.432+0000 7f97af290640 1 --2- 172.21.15.77:0/3151487624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97a80ce240 0x7f97a814ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.432+0000 7f97af290640 1 --2- 172.21.15.77:0/3151487624 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97a80cde60 0x7f97a80cbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.432+0000 7f97af290640 1 -- 172.21.15.77:0/3151487624 >> 172.21.15.77:0/3151487624 conn(0x7f97a8071f30 msgr2=0x7f97a80d22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:12.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.432+0000 7f97af290640 1 -- 172.21.15.77:0/3151487624 shutdown_connections 2023-11-04T01:41:12.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.432+0000 7f97af290640 1 -- 172.21.15.77:0/3151487624 wait complete. 2023-11-04T01:41:12.445 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:12.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.542+0000 7f5fdb2e5640 1 Processor -- start 2023-11-04T01:41:12.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.542+0000 7f5fdb2e5640 1 -- start start 2023-11-04T01:41:12.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.543+0000 7f5fdb2e5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5fd4159c70 0x7f5fd40ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.543+0000 7f5fdb2e5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fd40b4110 con 0x7f5fd40b0ae0 2023-11-04T01:41:12.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.543+0000 7f5fdb2e5640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fd40b43f0 con 0x7f5fd406db20 2023-11-04T01:41:12.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.543+0000 7f5fdb2e5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd40b49b0 con 0x7f5fd4159c70 2023-11-04T01:41:12.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.543+0000 7f5fd9882640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f5fd40b0ae0 0x7f5fd415d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45412/0 (socket says 172.21.15.77:45412) 2023-11-04T01:41:12.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.543+0000 7f5fd9882640 1 -- 172.21.15.77:0/4227986884 learned_addr learned my addr 172.21.15.77:0/4227986884 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:12.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.543+0000 7f5fcbfff640 1 -- 172.21.15.77:0/4227986884 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4237195435 0 0) 0x7f5fd40b4110 con 0x7f5fd40b0ae0 2023-11-04T01:41:12.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.543+0000 7f5fcbfff640 1 -- 172.21.15.77:0/4227986884 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fc0003520 con 0x7f5fd40b0ae0 2023-11-04T01:41:12.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.543+0000 7f5fd9081640 1 --2- 172.21.15.77:0/4227986884 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5fd4159c70 0x7f5fd40ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.544+0000 7f5fcbfff640 1 -- 172.21.15.77:0/4227986884 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2711421351 0 0) 0x7f5fc0003520 con 0x7f5fd40b0ae0 2023-11-04T01:41:12.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.544+0000 7f5fcbfff640 1 -- 172.21.15.77:0/4227986884 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5fd4159c70 msgr2=0x7f5fd40ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:12.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.544+0000 7f5fcbfff640 1 --2- 172.21.15.77:0/4227986884 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5fd4159c70 0x7f5fd40ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.544+0000 7f5fcbfff640 1 -- 172.21.15.77:0/4227986884 >> v1:172.21.15.122:6789/0 conn(0x7f5fd406db20 legacy=0x7f5fd40b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.544+0000 7f5fcbfff640 1 -- 172.21.15.77:0/4227986884 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd40b46d0 con 0x7f5fd40b0ae0 2023-11-04T01:41:12.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.544+0000 7f5fcbfff640 1 -- 172.21.15.77:0/4227986884 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f5fcc0019f0 con 0x7f5fd40b0ae0 2023-11-04T01:41:12.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.544+0000 7f5fcbfff640 1 -- 172.21.15.77:0/4227986884 >> v1:172.21.15.77:6789/0 conn(0x7f5fd40b0ae0 legacy=0x7f5fd415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.544+0000 7f5fcbfff640 1 --2- 172.21.15.77:0/4227986884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fc00039a0 0x7f5fc0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.544+0000 7f5fcbfff640 1 --2- 172.21.15.77:0/4227986884 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5fd4159c70 0x7f5fc00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.544+0000 7f5fcbfff640 1 --2- 172.21.15.77:0/4227986884 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5fc0004d00 0x7f5fc0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.544+0000 7f5fcbfff640 1 -- 172.21.15.77:0/4227986884 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd40b49b0 con 0x7f5fc00039a0 2023-11-04T01:41:12.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.544+0000 7f5fcbfff640 1 -- 172.21.15.77:0/4227986884 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc000dc40 con 0x7f5fc0004d00 2023-11-04T01:41:12.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.544+0000 7f5fcbfff640 1 -- 172.21.15.77:0/4227986884 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc000de00 con 0x7f5fd4159c70 2023-11-04T01:41:12.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.544+0000 7f5fd9081640 1 --2- 172.21.15.77:0/4227986884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fc00039a0 0x7f5fc0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.544+0000 7f5fd8880640 1 --2- 172.21.15.77:0/4227986884 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5fd4159c70 0x7f5fc00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.544+0000 7f5fd9882640 1 --2- 172.21.15.77:0/4227986884 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5fc0004d00 0x7f5fc0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.544+0000 7f5fd9081640 1 -- 172.21.15.77:0/4227986884 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5fd4159c70 msgr2=0x7f5fc00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:12.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.544+0000 7f5fd9081640 1 --2- 172.21.15.77:0/4227986884 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5fd4159c70 0x7f5fc00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.544+0000 7f5fd9081640 1 -- 172.21.15.77:0/4227986884 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5fc0004d00 msgr2=0x7f5fc0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:12.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.544+0000 7f5fd9081640 1 --2- 172.21.15.77:0/4227986884 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5fc0004d00 0x7f5fc0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.544+0000 7f5fd9081640 1 -- 172.21.15.77:0/4227986884 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc0003520 con 0x7f5fc00039a0 2023-11-04T01:41:12.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.544+0000 7f5fd9882640 1 --2- 172.21.15.77:0/4227986884 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5fc0004d00 0x7f5fc0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:12.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.545+0000 7f5fd9081640 1 --2- 172.21.15.77:0/4227986884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fc00039a0 0x7f5fc0003dc0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0009a90 tx=0x7f5fc00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1719b77b5653958c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:12.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.545+0000 7f5fcbfff640 1 -- 172.21.15.77:0/4227986884 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd002c680 con 0x7f5fc00039a0 2023-11-04T01:41:12.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.545+0000 7f5fcbfff640 1 -- 172.21.15.77:0/4227986884 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd002c7e0 con 0x7f5fc00039a0 2023-11-04T01:41:12.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.545+0000 7f5fcbfff640 1 -- 172.21.15.77:0/4227986884 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd002cb70 con 0x7f5fc00039a0 2023-11-04T01:41:12.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.545+0000 7f5fdb2e5640 1 -- 172.21.15.77:0/4227986884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fc00039a0 msgr2=0x7f5fc0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.545+0000 7f5fdb2e5640 1 --2- 172.21.15.77:0/4227986884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fc00039a0 0x7f5fc0003dc0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0009a90 tx=0x7f5fc00057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.545+0000 7f5fd9882640 1 -- 172.21.15.77:0/4227986884 reap_dead start 2023-11-04T01:41:12.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.545+0000 7f5fdb2e5640 1 -- 172.21.15.77:0/4227986884 shutdown_connections 2023-11-04T01:41:12.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.546+0000 7f5fdb2e5640 1 -- 172.21.15.77:0/4227986884 >> 172.21.15.77:0/4227986884 conn(0x7f5fd40ce950 msgr2=0x7f5fd40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:12.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.546+0000 7f5fdb2e5640 1 -- 172.21.15.77:0/4227986884 shutdown_connections 2023-11-04T01:41:12.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.546+0000 7f5fdb2e5640 1 -- 172.21.15.77:0/4227986884 wait complete. 2023-11-04T01:41:12.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.547+0000 7f5fdb2e5640 1 Processor -- start 2023-11-04T01:41:12.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.547+0000 7f5fdb2e5640 1 -- start start 2023-11-04T01:41:12.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.547+0000 7f5fdb2e5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fc00039a0 0x7f5fd40c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.547+0000 7f5fdb2e5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5fd41f3d40 0x7f5fd40c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.547+0000 7f5fdb2e5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5fd40c87b0 0x7f5fd41f6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.547+0000 7f5fdb2e5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd415b4c0 con 0x7f5fc00039a0 2023-11-04T01:41:12.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.547+0000 7f5fdb2e5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd41f41c0 con 0x7f5fd41f3d40 2023-11-04T01:41:12.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.547+0000 7f5fdb2e5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd40c8c60 con 0x7f5fd40c87b0 2023-11-04T01:41:12.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.548+0000 7f5fd9081640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fc00039a0 0x7f5fd40c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.548+0000 7f5fd9081640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fc00039a0 0x7f5fd40c69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57256/0 (socket says 172.21.15.77:57256) 2023-11-04T01:41:12.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.548+0000 7f5fd9081640 1 -- 172.21.15.77:0/3026955586 learned_addr learned my addr 172.21.15.77:0/3026955586 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:12.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.548+0000 7f5fd9882640 1 --2- 172.21.15.77:0/3026955586 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5fd40c87b0 0x7f5fd41f6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.548+0000 7f5fd9081640 1 -- 172.21.15.77:0/3026955586 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5fd40c87b0 msgr2=0x7f5fd41f6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.548+0000 7f5fd9081640 1 --2- 172.21.15.77:0/3026955586 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5fd40c87b0 0x7f5fd41f6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.548+0000 7f5fd8880640 1 --2- 172.21.15.77:0/3026955586 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5fd41f3d40 0x7f5fd40c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.548+0000 7f5fd9081640 1 -- 172.21.15.77:0/3026955586 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5fd41f3d40 msgr2=0x7f5fd40c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.548+0000 7f5fd9081640 1 --2- 172.21.15.77:0/3026955586 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5fd41f3d40 0x7f5fd40c8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.548+0000 7f5fd9081640 1 -- 172.21.15.77:0/3026955586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd41f6f50 con 0x7f5fc00039a0 2023-11-04T01:41:12.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.548+0000 7f5fd9882640 1 --2- 172.21.15.77:0/3026955586 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5fd40c87b0 0x7f5fd41f6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:12.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.548+0000 7f5fd9081640 1 --2- 172.21.15.77:0/3026955586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fc00039a0 0x7f5fd40c69c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5fd002c220 tx=0x7f5fd0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:12.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.548+0000 7f5fc9ffb640 1 -- 172.21.15.77:0/3026955586 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0003810 con 0x7f5fc00039a0 2023-11-04T01:41:12.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.548+0000 7f5fc9ffb640 1 -- 172.21.15.77:0/3026955586 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd0003970 con 0x7f5fc00039a0 2023-11-04T01:41:12.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.548+0000 7f5fdb2e5640 1 -- 172.21.15.77:0/3026955586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd415b710 con 0x7f5fc00039a0 2023-11-04T01:41:12.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.548+0000 7f5fc9ffb640 1 -- 172.21.15.77:0/3026955586 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0003ce0 con 0x7f5fc00039a0 2023-11-04T01:41:12.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.548+0000 7f5fdb2e5640 1 -- 172.21.15.77:0/3026955586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fd415bcd0 con 0x7f5fc00039a0 2023-11-04T01:41:12.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.549+0000 7f5fdb2e5640 1 -- 172.21.15.77:0/3026955586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fd4074290 con 0x7f5fc00039a0 2023-11-04T01:41:12.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.550+0000 7f5fc9ffb640 1 -- 172.21.15.77:0/3026955586 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5fd0034440 con 0x7f5fc00039a0 2023-11-04T01:41:12.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.550+0000 7f5fc9ffb640 1 --2- 172.21.15.77:0/3026955586 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5fb806ae70 0x7f5fb806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.550+0000 7f5fc9ffb640 1 -- 172.21.15.77:0/3026955586 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5fd00ab790 con 0x7f5fc00039a0 2023-11-04T01:41:12.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.550+0000 7f5fd8880640 1 --2- 172.21.15.77:0/3026955586 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5fb806ae70 0x7f5fb806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.551+0000 7f5fd8880640 1 --2- 172.21.15.77:0/3026955586 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5fb806ae70 0x7f5fb806d330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5fd41e2d80 tx=0x7f5fc4009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:12.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.554+0000 7f5fc9ffb640 1 -- 172.21.15.77:0/3026955586 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5fd00766e0 con 0x7f5fc00039a0 2023-11-04T01:41:12.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.722+0000 7f5fdb2e5640 1 -- 172.21.15.77:0/3026955586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5fd41552d0 con 0x7f5fc00039a0 2023-11-04T01:41:12.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.723+0000 7f5fc9ffb640 1 -- 172.21.15.77:0/3026955586 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18661 (secure 0 0 0) 0x7f5fd00044e0 con 0x7f5fc00039a0 2023-11-04T01:41:12.725 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:12.726 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":26,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:40:47.579547+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:40:02.810971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:40:04.003979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:40:07.734355+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:12.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.725+0000 7f5fdb2e5640 1 -- 172.21.15.77:0/3026955586 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5fb806ae70 msgr2=0x7f5fb806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.725+0000 7f5fdb2e5640 1 --2- 172.21.15.77:0/3026955586 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5fb806ae70 0x7f5fb806d330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5fd41e2d80 tx=0x7f5fc4009040 comp rx=0 tx=0).stop 2023-11-04T01:41:12.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.725+0000 7f5fdb2e5640 1 -- 172.21.15.77:0/3026955586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fc00039a0 msgr2=0x7f5fd40c69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.725+0000 7f5fdb2e5640 1 --2- 172.21.15.77:0/3026955586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fc00039a0 0x7f5fd40c69c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5fd002c220 tx=0x7f5fd0004730 comp rx=0 tx=0).stop 2023-11-04T01:41:12.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.725+0000 7f5fdb2e5640 1 -- 172.21.15.77:0/3026955586 shutdown_connections 2023-11-04T01:41:12.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.725+0000 7f5fdb2e5640 1 --2- 172.21.15.77:0/3026955586 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5fb806ae70 0x7f5fb806d330 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.725+0000 7f5fdb2e5640 1 --2- 172.21.15.77:0/3026955586 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5fd40c87b0 0x7f5fd41f6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.725+0000 7f5fdb2e5640 1 --2- 172.21.15.77:0/3026955586 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5fd41f3d40 0x7f5fd40c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.725+0000 7f5fdb2e5640 1 --2- 172.21.15.77:0/3026955586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fc00039a0 0x7f5fd40c69c0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.725+0000 7f5fdb2e5640 1 -- 172.21.15.77:0/3026955586 >> 172.21.15.77:0/3026955586 conn(0x7f5fd40ce950 msgr2=0x7f5fd40b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:12.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.726+0000 7f5fdb2e5640 1 -- 172.21.15.77:0/3026955586 shutdown_connections 2023-11-04T01:41:12.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.726+0000 7f5fdb2e5640 1 -- 172.21.15.77:0/3026955586 wait complete. 2023-11-04T01:41:12.738 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-04T01:41:12.739 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:12.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.837+0000 7fd40df61640 1 Processor -- start 2023-11-04T01:41:12.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.837+0000 7fd40df61640 1 -- start start 2023-11-04T01:41:12.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.838+0000 7fd40df61640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd4080b0cd0 0x7fd408070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.838+0000 7fd40df61640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd4080cde40 0x7fd408070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.838+0000 7fd40df61640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4080cc990 con 0x7fd4080cda60 2023-11-04T01:41:12.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.838+0000 7fd40df61640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4080ccc70 con 0x7fd4080b0cd0 2023-11-04T01:41:12.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.838+0000 7fd40df61640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4080c9ce0 con 0x7fd4080cde40 2023-11-04T01:41:12.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.838+0000 7fd407fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd4080cde40 0x7fd408070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.838+0000 7fd406ffd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd4080b0cd0 0x7fd408070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.838+0000 7fd407fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd4080cde40 0x7fd408070b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:60332/0 (socket says 172.21.15.77:60332) 2023-11-04T01:41:12.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.838+0000 7fd407fff640 1 -- 172.21.15.77:0/1601956732 learned_addr learned my addr 172.21.15.77:0/1601956732 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:12.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.839+0000 7fd406ffd640 1 -- 172.21.15.77:0/1601956732 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd4080cde40 msgr2=0x7fd408070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:12.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.839+0000 7fd406ffd640 1 --2- 172.21.15.77:0/1601956732 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd4080cde40 0x7fd408070b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.839+0000 7fd406ffd640 1 -- 172.21.15.77:0/1601956732 >> v1:172.21.15.122:6789/0 conn(0x7fd4080cda60 legacy=0x7fd4080ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.839+0000 7fd406ffd640 1 -- 172.21.15.77:0/1601956732 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4080c9fc0 con 0x7fd4080b0cd0 2023-11-04T01:41:12.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.839+0000 7fd407fff640 1 --2- 172.21.15.77:0/1601956732 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd4080cde40 0x7fd408070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:41:12.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.839+0000 7fd406ffd640 1 --2- 172.21.15.77:0/1601956732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4080b0cd0 0x7fd408070630 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc00a940 tx=0x7fd3fc02cd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec1d4b4dbe04313b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:12.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.840+0000 7fd4067fc640 1 -- 172.21.15.77:0/1601956732 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc02db30 con 0x7fd4080b0cd0 2023-11-04T01:41:12.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.840+0000 7fd4067fc640 1 -- 172.21.15.77:0/1601956732 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3fc02dc90 con 0x7fd4080b0cd0 2023-11-04T01:41:12.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.840+0000 7fd4067fc640 1 -- 172.21.15.77:0/1601956732 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc035440 con 0x7fd4080b0cd0 2023-11-04T01:41:12.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.840+0000 7fd40df61640 1 -- 172.21.15.77:0/1601956732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4080b0cd0 msgr2=0x7fd408070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.840+0000 7fd40df61640 1 --2- 172.21.15.77:0/1601956732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4080b0cd0 0x7fd408070630 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc00a940 tx=0x7fd3fc02cd80 comp rx=0 tx=0).stop 2023-11-04T01:41:12.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.840+0000 7fd40df61640 1 -- 172.21.15.77:0/1601956732 shutdown_connections 2023-11-04T01:41:12.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.840+0000 7fd40df61640 1 --2- 172.21.15.77:0/1601956732 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd4080cde40 0x7fd408070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.840+0000 7fd40df61640 1 --2- 172.21.15.77:0/1601956732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4080b0cd0 0x7fd408070630 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.840+0000 7fd40df61640 1 -- 172.21.15.77:0/1601956732 >> 172.21.15.77:0/1601956732 conn(0x7fd4080ce950 msgr2=0x7fd4080ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:12.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.840+0000 7fd40df61640 1 -- 172.21.15.77:0/1601956732 shutdown_connections 2023-11-04T01:41:12.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.840+0000 7fd40df61640 1 -- 172.21.15.77:0/1601956732 wait complete. 2023-11-04T01:41:12.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.841+0000 7fd40df61640 1 Processor -- start 2023-11-04T01:41:12.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.841+0000 7fd40df61640 1 -- start start 2023-11-04T01:41:12.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.842+0000 7fd40df61640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd4080b0cd0 0x7fd408156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.842+0000 7fd40df61640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4080cda60 0x7fd4080a8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.842+0000 7fd40df61640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4080cde40 0x7fd4080b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.842+0000 7fd40df61640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4080c6b50 con 0x7fd4080cda60 2023-11-04T01:41:12.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.842+0000 7fd40df61640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4080c5ac0 con 0x7fd4080cde40 2023-11-04T01:41:12.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.842+0000 7fd40df61640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4080c5da0 con 0x7fd4080b0cd0 2023-11-04T01:41:12.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.842+0000 7fd406ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4080cda60 0x7fd4080a8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.842+0000 7fd406ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4080cda60 0x7fd4080a8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57270/0 (socket says 172.21.15.77:57270) 2023-11-04T01:41:12.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.842+0000 7fd406ffd640 1 -- 172.21.15.77:0/1723341255 learned_addr learned my addr 172.21.15.77:0/1723341255 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:12.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.843+0000 7fd407fff640 1 --2- 172.21.15.77:0/1723341255 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4080cde40 0x7fd4080b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.843+0000 7fd4077fe640 1 --2- 172.21.15.77:0/1723341255 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd4080b0cd0 0x7fd408156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.843+0000 7fd406ffd640 1 -- 172.21.15.77:0/1723341255 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd4080b0cd0 msgr2=0x7fd408156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.843+0000 7fd406ffd640 1 --2- 172.21.15.77:0/1723341255 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd4080b0cd0 0x7fd408156d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.843+0000 7fd406ffd640 1 -- 172.21.15.77:0/1723341255 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4080cde40 msgr2=0x7fd4080b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:12.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.843+0000 7fd406ffd640 1 --2- 172.21.15.77:0/1723341255 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4080cde40 0x7fd4080b35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:12.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.843+0000 7fd406ffd640 1 -- 172.21.15.77:0/1723341255 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd400009b30 con 0x7fd4080cda60 2023-11-04T01:41:12.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.843+0000 7fd406ffd640 1 --2- 172.21.15.77:0/1723341255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4080cda60 0x7fd4080a8440 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc000c00 tx=0x7fd3fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:12.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.843+0000 7fd3effff640 1 -- 172.21.15.77:0/1723341255 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc03e410 con 0x7fd4080cda60 2023-11-04T01:41:12.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.843+0000 7fd3effff640 1 -- 172.21.15.77:0/1723341255 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3fc03e570 con 0x7fd4080cda60 2023-11-04T01:41:12.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.843+0000 7fd40df61640 1 -- 172.21.15.77:0/1723341255 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3fc00a5a0 con 0x7fd4080cda60 2023-11-04T01:41:12.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.843+0000 7fd3effff640 1 -- 172.21.15.77:0/1723341255 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc03e920 con 0x7fd4080cda60 2023-11-04T01:41:12.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.843+0000 7fd40df61640 1 -- 172.21.15.77:0/1723341255 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4080c6360 con 0x7fd4080cda60 2023-11-04T01:41:12.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.844+0000 7fd40df61640 1 -- 172.21.15.77:0/1723341255 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4080cc470 con 0x7fd4080cda60 2023-11-04T01:41:12.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.844+0000 7fd3effff640 1 -- 172.21.15.77:0/1723341255 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd3fc03c040 con 0x7fd4080cda60 2023-11-04T01:41:12.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.845+0000 7fd3effff640 1 --2- 172.21.15.77:0/1723341255 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd3f406ae70 0x7fd3f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:12.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.845+0000 7fd3effff640 1 -- 172.21.15.77:0/1723341255 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd3fc0ab950 con 0x7fd4080cda60 2023-11-04T01:41:12.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.845+0000 7fd4077fe640 1 --2- 172.21.15.77:0/1723341255 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd3f406ae70 0x7fd3f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:12.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.845+0000 7fd4077fe640 1 --2- 172.21.15.77:0/1723341255 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd3f406ae70 0x7fd3f406d330 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8000f60 tx=0x7fd3f8009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:12.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:12.849+0000 7fd3effff640 1 -- 172.21.15.77:0/1723341255 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd4080cc470 con 0x7fd4080cda60 2023-11-04T01:41:13.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.050+0000 7fd40df61640 1 -- 172.21.15.77:0/1723341255 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd4080cc470 con 0x7fd4080cda60 2023-11-04T01:41:13.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.050+0000 7fd3effff640 1 -- 172.21.15.77:0/1723341255 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4915 (secure 0 0 0) 0x7fd4080cc470 con 0x7fd4080cda60 2023-11-04T01:41:13.052 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:13.053 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/2867268857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2867268857},{"type":"v1","addr":"172.21.15.77:6834","nonce":2867268857}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2709973073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2709973073},{"type":"v1","addr":"172.21.15.77:6835","nonce":2709973073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/396299424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":396299424},{"type":"v1","addr":"172.21.15.122:6837","nonce":396299424}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:40:05.031856+0000","modified":"2023-11-04T01:40:21.906922+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34166},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34166":{"gid":34166,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6836/2444318089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2444318089},{"type":"v1","addr":"172.21.15.122:6836","nonce":2444318089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:41:13.054 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 9 2023-11-04T01:41:13.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.052+0000 7fd40df61640 1 -- 172.21.15.77:0/1723341255 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd3f406ae70 msgr2=0x7fd3f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.052+0000 7fd40df61640 1 --2- 172.21.15.77:0/1723341255 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd3f406ae70 0x7fd3f406d330 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8000f60 tx=0x7fd3f8009040 comp rx=0 tx=0).stop 2023-11-04T01:41:13.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.052+0000 7fd40df61640 1 -- 172.21.15.77:0/1723341255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4080cda60 msgr2=0x7fd4080a8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.052+0000 7fd40df61640 1 --2- 172.21.15.77:0/1723341255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4080cda60 0x7fd4080a8440 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc000c00 tx=0x7fd3fc0046c0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.052+0000 7fd40df61640 1 -- 172.21.15.77:0/1723341255 shutdown_connections 2023-11-04T01:41:13.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.052+0000 7fd40df61640 1 --2- 172.21.15.77:0/1723341255 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd3f406ae70 0x7fd3f406d330 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.052+0000 7fd40df61640 1 --2- 172.21.15.77:0/1723341255 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd4080cde40 0x7fd4080b35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.052+0000 7fd40df61640 1 --2- 172.21.15.77:0/1723341255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4080cda60 0x7fd4080a8440 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.052+0000 7fd40df61640 1 --2- 172.21.15.77:0/1723341255 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd4080b0cd0 0x7fd408156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.052+0000 7fd40df61640 1 -- 172.21.15.77:0/1723341255 >> 172.21.15.77:0/1723341255 conn(0x7fd4080ce950 msgr2=0x7fd4081599d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:13.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.052+0000 7fd40df61640 1 -- 172.21.15.77:0/1723341255 shutdown_connections 2023-11-04T01:41:13.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.052+0000 7fd40df61640 1 -- 172.21.15.77:0/1723341255 wait complete. 2023-11-04T01:41:13.064 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:13.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.162+0000 7f96969ce640 1 Processor -- start 2023-11-04T01:41:13.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.162+0000 7f96969ce640 1 -- start start 2023-11-04T01:41:13.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.163+0000 7f96969ce640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f96900cda60 0x7f96900ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.163+0000 7f96969ce640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f96900b0cd0 0x7f9690070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.163+0000 7f96969ce640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96900cc990 con 0x7f96900cace0 2023-11-04T01:41:13.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.163+0000 7f96969ce640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96900ccc70 con 0x7f96900cda60 2023-11-04T01:41:13.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.163+0000 7f96969ce640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96900c9ce0 con 0x7f96900b0cd0 2023-11-04T01:41:13.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.164+0000 7f968f7fe640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f96900b0cd0 0x7f9690070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.164+0000 7f968ffff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f96900cda60 0x7f96900ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.164+0000 7f9694f6b640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f96900cace0 0x7f969006c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:51184/0 (socket says 172.21.15.77:51184) 2023-11-04T01:41:13.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.164+0000 7f9694f6b640 1 -- 172.21.15.77:0/2747531402 learned_addr learned my addr 172.21.15.77:0/2747531402 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:13.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.164+0000 7f968effd640 1 -- 172.21.15.77:0/2747531402 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1997827377 0 0) 0x7f96900cc990 con 0x7f96900cace0 2023-11-04T01:41:13.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.164+0000 7f968effd640 1 -- 172.21.15.77:0/2747531402 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9678003520 con 0x7f96900cace0 2023-11-04T01:41:13.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.164+0000 7f968f7fe640 1 -- 172.21.15.77:0/2747531402 >> v2:172.21.15.122:3300/0 conn(0x7f96900cda60 msgr2=0x7f96900ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:13.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.164+0000 7f968f7fe640 1 --2- 172.21.15.77:0/2747531402 >> v2:172.21.15.122:3300/0 conn(0x7f96900cda60 0x7f96900ca7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.164+0000 7f968f7fe640 1 -- 172.21.15.77:0/2747531402 >> v1:172.21.15.122:6789/0 conn(0x7f96900cace0 legacy=0x7f969006c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.164+0000 7f968f7fe640 1 -- 172.21.15.77:0/2747531402 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96900c9fc0 con 0x7f96900b0cd0 2023-11-04T01:41:13.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.164+0000 7f968ffff640 1 --2- 172.21.15.77:0/2747531402 >> v2:172.21.15.122:3300/0 conn(0x7f96900cda60 0x7f96900ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:41:13.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.165+0000 7f968f7fe640 1 --2- 172.21.15.77:0/2747531402 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f96900b0cd0 0x7f9690070630 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f96840097a0 tx=0x7f968402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b054c3d058b9e00 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:13.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.165+0000 7f968effd640 1 -- 172.21.15.77:0/2747531402 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9684031830 con 0x7f96900b0cd0 2023-11-04T01:41:13.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.165+0000 7f968effd640 1 -- 172.21.15.77:0/2747531402 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9684031990 con 0x7f96900b0cd0 2023-11-04T01:41:13.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.165+0000 7f968effd640 1 -- 172.21.15.77:0/2747531402 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9684031d20 con 0x7f96900b0cd0 2023-11-04T01:41:13.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.165+0000 7f96969ce640 1 -- 172.21.15.77:0/2747531402 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f96900b0cd0 msgr2=0x7f9690070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.165+0000 7f96969ce640 1 --2- 172.21.15.77:0/2747531402 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f96900b0cd0 0x7f9690070630 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f96840097a0 tx=0x7f968402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.165+0000 7f96969ce640 1 -- 172.21.15.77:0/2747531402 shutdown_connections 2023-11-04T01:41:13.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.165+0000 7f96969ce640 1 --2- 172.21.15.77:0/2747531402 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f96900b0cd0 0x7f9690070630 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.165+0000 7f96969ce640 1 --2- 172.21.15.77:0/2747531402 >> v2:172.21.15.122:3300/0 conn(0x7f96900cda60 0x7f96900ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.165+0000 7f96969ce640 1 -- 172.21.15.77:0/2747531402 >> 172.21.15.77:0/2747531402 conn(0x7f96900ce950 msgr2=0x7f96900ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:13.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.165+0000 7f96969ce640 1 -- 172.21.15.77:0/2747531402 shutdown_connections 2023-11-04T01:41:13.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.165+0000 7f96969ce640 1 -- 172.21.15.77:0/2747531402 wait complete. 2023-11-04T01:41:13.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.167+0000 7f96969ce640 1 Processor -- start 2023-11-04T01:41:13.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.167+0000 7f96969ce640 1 -- start start 2023-11-04T01:41:13.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.167+0000 7f96969ce640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f96900b0cd0 0x7f9690158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.167+0000 7f96969ce640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96900cace0 0x7f969015baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.168+0000 7f96969ce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96900cda60 0x7f969015bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.168+0000 7f96969ce640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96900c5990 con 0x7f96900cda60 2023-11-04T01:41:13.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.168+0000 7f96969ce640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9690159440 con 0x7f96900cace0 2023-11-04T01:41:13.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.168+0000 7f96969ce640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96900c5ba0 con 0x7f96900b0cd0 2023-11-04T01:41:13.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.168+0000 7f9694f6b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96900cda60 0x7f969015bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.168+0000 7f9694f6b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96900cda60 0x7f969015bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57272/0 (socket says 172.21.15.77:57272) 2023-11-04T01:41:13.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.168+0000 7f9694f6b640 1 -- 172.21.15.77:0/1965165576 learned_addr learned my addr 172.21.15.77:0/1965165576 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:13.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.168+0000 7f968ffff640 1 --2- 172.21.15.77:0/1965165576 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f96900b0cd0 0x7f9690158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.168+0000 7f968f7fe640 1 --2- 172.21.15.77:0/1965165576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96900cace0 0x7f969015baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.168+0000 7f9694f6b640 1 -- 172.21.15.77:0/1965165576 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f96900b0cd0 msgr2=0x7f9690158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.168+0000 7f9694f6b640 1 --2- 172.21.15.77:0/1965165576 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f96900b0cd0 0x7f9690158f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.168+0000 7f9694f6b640 1 -- 172.21.15.77:0/1965165576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96900cace0 msgr2=0x7f969015baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.168+0000 7f9694f6b640 1 --2- 172.21.15.77:0/1965165576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96900cace0 0x7f969015baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.168+0000 7f9694f6b640 1 -- 172.21.15.77:0/1965165576 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9680009400 con 0x7f96900cda60 2023-11-04T01:41:13.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.168+0000 7f968ffff640 1 --2- 172.21.15.77:0/1965165576 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f96900b0cd0 0x7f9690158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:13.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.168+0000 7f9694f6b640 1 --2- 172.21.15.77:0/1965165576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96900cda60 0x7f969015bfe0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f968800cbb0 tx=0x7f968800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:13.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.168+0000 7f968cff9640 1 -- 172.21.15.77:0/1965165576 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968800ad40 con 0x7f96900cda60 2023-11-04T01:41:13.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.168+0000 7f968cff9640 1 -- 172.21.15.77:0/1965165576 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9688012400 con 0x7f96900cda60 2023-11-04T01:41:13.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.168+0000 7f96969ce640 1 -- 172.21.15.77:0/1965165576 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9684009400 con 0x7f96900cda60 2023-11-04T01:41:13.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.168+0000 7f968cff9640 1 -- 172.21.15.77:0/1965165576 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968800aea0 con 0x7f96900cda60 2023-11-04T01:41:13.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.168+0000 7f96969ce640 1 -- 172.21.15.77:0/1965165576 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96900c6160 con 0x7f96900cda60 2023-11-04T01:41:13.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.169+0000 7f96969ce640 1 -- 172.21.15.77:0/1965165576 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9690066b00 con 0x7f96900cda60 2023-11-04T01:41:13.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.170+0000 7f968cff9640 1 -- 172.21.15.77:0/1965165576 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9688007070 con 0x7f96900cda60 2023-11-04T01:41:13.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.170+0000 7f968cff9640 1 --2- 172.21.15.77:0/1965165576 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f967c06ae70 0x7f967c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.170+0000 7f968cff9640 1 -- 172.21.15.77:0/1965165576 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f96880898e0 con 0x7f96900cda60 2023-11-04T01:41:13.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.170+0000 7f968ffff640 1 --2- 172.21.15.77:0/1965165576 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f967c06ae70 0x7f967c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.171+0000 7f968ffff640 1 --2- 172.21.15.77:0/1965165576 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f967c06ae70 0x7f967c06d330 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9680009c80 tx=0x7f9680008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:13.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.174+0000 7f968cff9640 1 -- 172.21.15.77:0/1965165576 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9688054680 con 0x7f96900cda60 2023-11-04T01:41:13.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.374+0000 7f96969ce640 1 -- 172.21.15.77:0/1965165576 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96900ced30 con 0x7f96900cda60 2023-11-04T01:41:13.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.374+0000 7f968cff9640 1 -- 172.21.15.77:0/1965165576 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f9688017090 con 0x7f96900cda60 2023-11-04T01:41:13.376 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:13.377 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/2867268857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":2867268857},{"type":"v1","addr":"172.21.15.77:6834","nonce":2867268857}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2709973073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2709973073},{"type":"v1","addr":"172.21.15.77:6835","nonce":2709973073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/396299424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":396299424},{"type":"v1","addr":"172.21.15.122:6837","nonce":396299424}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:40:05.031856+0000","modified":"2023-11-04T01:40:21.906922+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34166},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34166":{"gid":34166,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6836/2444318089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2444318089},{"type":"v1","addr":"172.21.15.122:6836","nonce":2444318089}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:41:13.377 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 9 2023-11-04T01:41:13.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.376+0000 7f96969ce640 1 -- 172.21.15.77:0/1965165576 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f967c06ae70 msgr2=0x7f967c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.376+0000 7f96969ce640 1 --2- 172.21.15.77:0/1965165576 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f967c06ae70 0x7f967c06d330 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9680009c80 tx=0x7f9680008040 comp rx=0 tx=0).stop 2023-11-04T01:41:13.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.376+0000 7f96969ce640 1 -- 172.21.15.77:0/1965165576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96900cda60 msgr2=0x7f969015bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.376+0000 7f96969ce640 1 --2- 172.21.15.77:0/1965165576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96900cda60 0x7f969015bfe0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f968800cbb0 tx=0x7f968800a430 comp rx=0 tx=0).stop 2023-11-04T01:41:13.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.376+0000 7f96969ce640 1 -- 172.21.15.77:0/1965165576 shutdown_connections 2023-11-04T01:41:13.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.376+0000 7f96969ce640 1 --2- 172.21.15.77:0/1965165576 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f967c06ae70 0x7f967c06d330 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.376+0000 7f96969ce640 1 --2- 172.21.15.77:0/1965165576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96900cda60 0x7f969015bfe0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.376+0000 7f96969ce640 1 --2- 172.21.15.77:0/1965165576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96900cace0 0x7f969015baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.376+0000 7f96969ce640 1 --2- 172.21.15.77:0/1965165576 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f96900b0cd0 0x7f9690158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.376+0000 7f96969ce640 1 -- 172.21.15.77:0/1965165576 >> 172.21.15.77:0/1965165576 conn(0x7f96900ce950 msgr2=0x7f969006c200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:13.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.376+0000 7f96969ce640 1 -- 172.21.15.77:0/1965165576 shutdown_connections 2023-11-04T01:41:13.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.376+0000 7f96969ce640 1 -- 172.21.15.77:0/1965165576 wait complete. 2023-11-04T01:41:13.389 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:13.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.487+0000 7f994d2c2640 1 Processor -- start 2023-11-04T01:41:13.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.487+0000 7f994d2c2640 1 -- start start 2023-11-04T01:41:13.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.488+0000 7f994d2c2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f994815ac70 0x7f99480d0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.488+0000 7f994d2c2640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f99480b2d10 0x7f99480b4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.488+0000 7f994d2c2640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99480b3c10 con 0x7f99480cec10 2023-11-04T01:41:13.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.488+0000 7f994d2c2640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99480cf180 con 0x7f99480b2d10 2023-11-04T01:41:13.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.488+0000 7f994d2c2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99480cf460 con 0x7f994815ac70 2023-11-04T01:41:13.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.489+0000 7f9946ffd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f994815ac70 0x7f99480d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.489+0000 7f99477fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f99480b2d10 0x7f99480b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.489+0000 7f9946ffd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f994815ac70 0x7f99480d0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:60368/0 (socket says 172.21.15.77:60368) 2023-11-04T01:41:13.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.489+0000 7f9946ffd640 1 -- 172.21.15.77:0/3081617140 learned_addr learned my addr 172.21.15.77:0/3081617140 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:13.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.489+0000 7f99477fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f99480b2d10 0x7f99480b4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:54928/0 (socket says 172.21.15.77:54928) 2023-11-04T01:41:13.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.489+0000 7f99467fc640 1 --1- 172.21.15.77:0/3081617140 >> v1:172.21.15.122:6789/0 conn(0x7f99480cec10 0x7f99480b2600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:51192/0 (socket says 172.21.15.77:51192) 2023-11-04T01:41:13.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.489+0000 7f9946ffd640 1 -- 172.21.15.77:0/3081617140 >> v2:172.21.15.122:3300/0 conn(0x7f99480b2d10 msgr2=0x7f99480b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:13.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.489+0000 7f9946ffd640 1 --2- 172.21.15.77:0/3081617140 >> v2:172.21.15.122:3300/0 conn(0x7f99480b2d10 0x7f99480b4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.489+0000 7f9946ffd640 1 -- 172.21.15.77:0/3081617140 >> v1:172.21.15.122:6789/0 conn(0x7f99480cec10 legacy=0x7f99480b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.489+0000 7f9946ffd640 1 -- 172.21.15.77:0/3081617140 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99480cf740 con 0x7f994815ac70 2023-11-04T01:41:13.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.490+0000 7f9946ffd640 1 --2- 172.21.15.77:0/3081617140 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f994815ac70 0x7f99480d0330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9938009ea0 tx=0x7f993802bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c22c6662593d15fd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:13.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.490+0000 7f9945ffb640 1 -- 172.21.15.77:0/3081617140 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993802cb40 con 0x7f994815ac70 2023-11-04T01:41:13.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.490+0000 7f9945ffb640 1 -- 172.21.15.77:0/3081617140 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993802cca0 con 0x7f994815ac70 2023-11-04T01:41:13.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.490+0000 7f9945ffb640 1 -- 172.21.15.77:0/3081617140 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9938034610 con 0x7f994815ac70 2023-11-04T01:41:13.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.490+0000 7f994d2c2640 1 -- 172.21.15.77:0/3081617140 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f994815ac70 msgr2=0x7f99480d0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.490+0000 7f994d2c2640 1 --2- 172.21.15.77:0/3081617140 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f994815ac70 0x7f99480d0330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9938009ea0 tx=0x7f993802bfa0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.490+0000 7f994d2c2640 1 -- 172.21.15.77:0/3081617140 shutdown_connections 2023-11-04T01:41:13.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.490+0000 7f994d2c2640 1 --2- 172.21.15.77:0/3081617140 >> v2:172.21.15.122:3300/0 conn(0x7f99480b2d10 0x7f99480b4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.490+0000 7f994d2c2640 1 --2- 172.21.15.77:0/3081617140 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f994815ac70 0x7f99480d0330 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.490+0000 7f994d2c2640 1 -- 172.21.15.77:0/3081617140 >> 172.21.15.77:0/3081617140 conn(0x7f99480cd600 msgr2=0x7f99480cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:13.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.490+0000 7f994d2c2640 1 -- 172.21.15.77:0/3081617140 shutdown_connections 2023-11-04T01:41:13.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.490+0000 7f994d2c2640 1 -- 172.21.15.77:0/3081617140 wait complete. 2023-11-04T01:41:13.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.492+0000 7f994d2c2640 1 Processor -- start 2023-11-04T01:41:13.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.492+0000 7f994d2c2640 1 -- start start 2023-11-04T01:41:13.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.492+0000 7f994d2c2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99480b2d10 0x7f994815cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.492+0000 7f994d2c2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99480cec10 0x7f99480c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.492+0000 7f994d2c2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f994815ac70 0x7f99480c6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.492+0000 7f994d2c2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994815dbe0 con 0x7f99480cec10 2023-11-04T01:41:13.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.492+0000 7f994d2c2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9948152530 con 0x7f99480b2d10 2023-11-04T01:41:13.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.492+0000 7f994d2c2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f994815d620 con 0x7f994815ac70 2023-11-04T01:41:13.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.492+0000 7f99467fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99480cec10 0x7f99480c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.492+0000 7f99467fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99480cec10 0x7f99480c6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57274/0 (socket says 172.21.15.77:57274) 2023-11-04T01:41:13.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.492+0000 7f99467fc640 1 -- 172.21.15.77:0/3521397038 learned_addr learned my addr 172.21.15.77:0/3521397038 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:13.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.493+0000 7f9946ffd640 1 --2- 172.21.15.77:0/3521397038 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99480b2d10 0x7f994815cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.493+0000 7f99477fe640 1 --2- 172.21.15.77:0/3521397038 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f994815ac70 0x7f99480c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.493+0000 7f99467fc640 1 -- 172.21.15.77:0/3521397038 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f994815ac70 msgr2=0x7f99480c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.493+0000 7f99467fc640 1 --2- 172.21.15.77:0/3521397038 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f994815ac70 0x7f99480c6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.493+0000 7f99467fc640 1 -- 172.21.15.77:0/3521397038 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99480b2d10 msgr2=0x7f994815cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.493+0000 7f99467fc640 1 --2- 172.21.15.77:0/3521397038 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99480b2d10 0x7f994815cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.493+0000 7f99467fc640 1 -- 172.21.15.77:0/3521397038 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9938009b30 con 0x7f99480cec10 2023-11-04T01:41:13.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.493+0000 7f99467fc640 1 --2- 172.21.15.77:0/3521397038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99480cec10 0x7f99480c6d40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f993c00c4d0 tx=0x7f993c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:13.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.493+0000 7f992f7fe640 1 -- 172.21.15.77:0/3521397038 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c007480 con 0x7f99480cec10 2023-11-04T01:41:13.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.493+0000 7f992f7fe640 1 -- 172.21.15.77:0/3521397038 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993c0075e0 con 0x7f99480cec10 2023-11-04T01:41:13.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.493+0000 7f994d2c2640 1 -- 172.21.15.77:0/3521397038 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f994815d900 con 0x7f99480cec10 2023-11-04T01:41:13.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.493+0000 7f992f7fe640 1 -- 172.21.15.77:0/3521397038 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c0049e0 con 0x7f99480cec10 2023-11-04T01:41:13.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.493+0000 7f994d2c2640 1 -- 172.21.15.77:0/3521397038 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99480c5b20 con 0x7f99480cec10 2023-11-04T01:41:13.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.494+0000 7f994d2c2640 1 -- 172.21.15.77:0/3521397038 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99480c5d40 con 0x7f99480cec10 2023-11-04T01:41:13.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.495+0000 7f992f7fe640 1 -- 172.21.15.77:0/3521397038 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f993c004b40 con 0x7f99480cec10 2023-11-04T01:41:13.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.495+0000 7f992f7fe640 1 --2- 172.21.15.77:0/3521397038 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f993406ae70 0x7f993406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.495+0000 7f992f7fe640 1 -- 172.21.15.77:0/3521397038 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f993c0889f0 con 0x7f99480cec10 2023-11-04T01:41:13.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.495+0000 7f9946ffd640 1 --2- 172.21.15.77:0/3521397038 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f993406ae70 0x7f993406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.496+0000 7f9946ffd640 1 --2- 172.21.15.77:0/3521397038 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f993406ae70 0x7f993406d330 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9938035000 tx=0x7f9938030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:13.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.499+0000 7f992f7fe640 1 -- 172.21.15.77:0/3521397038 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f993c053820 con 0x7f99480cec10 2023-11-04T01:41:13.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.666+0000 7f994d2c2640 1 -- 172.21.15.77:0/3521397038 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99480b6b00 con 0x7f99480cec10 2023-11-04T01:41:13.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.667+0000 7f992f7fe640 1 -- 172.21.15.77:0/3521397038 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18661 (secure 0 0 0) 0x7f993c018020 con 0x7f99480cec10 2023-11-04T01:41:13.669 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:13.669 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":26,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:40:47.579547+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:40:02.810971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:40:04.003979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-04T01:40:07.734355+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:13.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.668+0000 7f994d2c2640 1 -- 172.21.15.77:0/3521397038 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f993406ae70 msgr2=0x7f993406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.668+0000 7f994d2c2640 1 --2- 172.21.15.77:0/3521397038 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f993406ae70 0x7f993406d330 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9938035000 tx=0x7f9938030000 comp rx=0 tx=0).stop 2023-11-04T01:41:13.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.669+0000 7f994d2c2640 1 -- 172.21.15.77:0/3521397038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99480cec10 msgr2=0x7f99480c6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.669+0000 7f994d2c2640 1 --2- 172.21.15.77:0/3521397038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99480cec10 0x7f99480c6d40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f993c00c4d0 tx=0x7f993c00c990 comp rx=0 tx=0).stop 2023-11-04T01:41:13.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.669+0000 7f994d2c2640 1 -- 172.21.15.77:0/3521397038 shutdown_connections 2023-11-04T01:41:13.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.669+0000 7f994d2c2640 1 --2- 172.21.15.77:0/3521397038 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f993406ae70 0x7f993406d330 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.669+0000 7f994d2c2640 1 --2- 172.21.15.77:0/3521397038 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f994815ac70 0x7f99480c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.669+0000 7f994d2c2640 1 --2- 172.21.15.77:0/3521397038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99480cec10 0x7f99480c6d40 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.669+0000 7f994d2c2640 1 --2- 172.21.15.77:0/3521397038 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99480b2d10 0x7f994815cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.669+0000 7f994d2c2640 1 -- 172.21.15.77:0/3521397038 >> 172.21.15.77:0/3521397038 conn(0x7f99480cd600 msgr2=0x7f99480cd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:13.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.669+0000 7f994d2c2640 1 -- 172.21.15.77:0/3521397038 shutdown_connections 2023-11-04T01:41:13.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.669+0000 7f994d2c2640 1 -- 172.21.15.77:0/3521397038 wait complete. 2023-11-04T01:41:13.682 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-04T01:41:13.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.784+0000 7fc9d4bf5640 1 Processor -- start 2023-11-04T01:41:13.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.784+0000 7fc9d4bf5640 1 -- start start 2023-11-04T01:41:13.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.785+0000 7fc9d4bf5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc9d0159c00 0x7fc9d00cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.785+0000 7fc9d4bf5640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc9d00ae1d0 0x7fc9d00c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.785+0000 7fc9d4bf5640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d015aff0 con 0x7fc9d00c48e0 2023-11-04T01:41:13.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.785+0000 7fc9d4bf5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d00c52d0 con 0x7fc9d0159c00 2023-11-04T01:41:13.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.785+0000 7fc9d4bf5640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d015a3e0 con 0x7fc9d00ae1d0 2023-11-04T01:41:13.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.785+0000 7fc9ce59c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc9d0159c00 0x7fc9d00cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.785+0000 7fc9ce59c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc9d0159c00 0x7fc9d00cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57278/0 (socket says 172.21.15.77:57278) 2023-11-04T01:41:13.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.785+0000 7fc9ce59c640 1 -- 172.21.15.77:0/85198776 learned_addr learned my addr 172.21.15.77:0/85198776 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:13.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.785+0000 7fc9ced9d640 1 --2- 172.21.15.77:0/85198776 >> v2:172.21.15.122:3300/0 conn(0x7fc9d00ae1d0 0x7fc9d00c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.785+0000 7fc9ce59c640 1 -- 172.21.15.77:0/85198776 >> v2:172.21.15.122:3300/0 conn(0x7fc9d00ae1d0 msgr2=0x7fc9d00c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:13.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.785+0000 7fc9ce59c640 1 --2- 172.21.15.77:0/85198776 >> v2:172.21.15.122:3300/0 conn(0x7fc9d00ae1d0 0x7fc9d00c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.785+0000 7fc9ce59c640 1 -- 172.21.15.77:0/85198776 >> v1:172.21.15.122:6789/0 conn(0x7fc9d00c48e0 legacy=0x7fc9d00adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:13.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.785+0000 7fc9ce59c640 1 -- 172.21.15.77:0/85198776 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d015a6c0 con 0x7fc9d0159c00 2023-11-04T01:41:13.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.786+0000 7fc9ce59c640 1 --2- 172.21.15.77:0/85198776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9d0159c00 0x7fc9d00cc890 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc9d00ce800 tx=0x7fc9c002e060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a4f885b4dd793a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:13.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.786+0000 7fc9cd59a640 1 -- 172.21.15.77:0/85198776 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c002ea00 con 0x7fc9d0159c00 2023-11-04T01:41:13.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.786+0000 7fc9cd59a640 1 -- 172.21.15.77:0/85198776 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c002eb60 con 0x7fc9d0159c00 2023-11-04T01:41:13.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.786+0000 7fc9cd59a640 1 -- 172.21.15.77:0/85198776 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0009600 con 0x7fc9d0159c00 2023-11-04T01:41:13.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.787+0000 7fc9d4bf5640 1 -- 172.21.15.77:0/85198776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9d0159c00 msgr2=0x7fc9d00cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.787+0000 7fc9d4bf5640 1 --2- 172.21.15.77:0/85198776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9d0159c00 0x7fc9d00cc890 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc9d00ce800 tx=0x7fc9c002e060 comp rx=0 tx=0).stop 2023-11-04T01:41:13.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.787+0000 7fc9d4bf5640 1 -- 172.21.15.77:0/85198776 shutdown_connections 2023-11-04T01:41:13.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.787+0000 7fc9d4bf5640 1 --2- 172.21.15.77:0/85198776 >> v2:172.21.15.122:3300/0 conn(0x7fc9d00ae1d0 0x7fc9d00c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.787+0000 7fc9d4bf5640 1 --2- 172.21.15.77:0/85198776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9d0159c00 0x7fc9d00cc890 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.787+0000 7fc9d4bf5640 1 -- 172.21.15.77:0/85198776 >> 172.21.15.77:0/85198776 conn(0x7fc9d00ce950 msgr2=0x7fc9d00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:13.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.787+0000 7fc9d4bf5640 1 -- 172.21.15.77:0/85198776 shutdown_connections 2023-11-04T01:41:13.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.787+0000 7fc9d4bf5640 1 -- 172.21.15.77:0/85198776 wait complete. 2023-11-04T01:41:13.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.788+0000 7fc9d4bf5640 1 Processor -- start 2023-11-04T01:41:13.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.788+0000 7fc9d4bf5640 1 -- start start 2023-11-04T01:41:13.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.789+0000 7fc9d4bf5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc9d00ae1d0 0x7fc9d01eedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.789+0000 7fc9d4bf5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9d00c48e0 0x7fc9d01edb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.789+0000 7fc9d4bf5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9d0159c00 0x7fc9d014ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.789+0000 7fc9d4bf5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d01ef300 con 0x7fc9d0159c00 2023-11-04T01:41:13.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.789+0000 7fc9d4bf5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d014c180 con 0x7fc9d00c48e0 2023-11-04T01:41:13.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.789+0000 7fc9d4bf5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d014b140 con 0x7fc9d00ae1d0 2023-11-04T01:41:13.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.789+0000 7fc9ced9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9d0159c00 0x7fc9d014ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.789+0000 7fc9ced9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9d0159c00 0x7fc9d014ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57286/0 (socket says 172.21.15.77:57286) 2023-11-04T01:41:13.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.789+0000 7fc9ced9d640 1 -- 172.21.15.77:0/3705511152 learned_addr learned my addr 172.21.15.77:0/3705511152 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:13.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.789+0000 7fc9ce59c640 1 --2- 172.21.15.77:0/3705511152 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc9d00ae1d0 0x7fc9d01eedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.789+0000 7fc9cdd9b640 1 --2- 172.21.15.77:0/3705511152 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9d00c48e0 0x7fc9d01edb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.789+0000 7fc9ced9d640 1 -- 172.21.15.77:0/3705511152 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc9d00ae1d0 msgr2=0x7fc9d01eedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.789+0000 7fc9ced9d640 1 --2- 172.21.15.77:0/3705511152 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc9d00ae1d0 0x7fc9d01eedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.789+0000 7fc9ced9d640 1 -- 172.21.15.77:0/3705511152 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9d00c48e0 msgr2=0x7fc9d01edb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:13.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.789+0000 7fc9ced9d640 1 --2- 172.21.15.77:0/3705511152 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9d00c48e0 0x7fc9d01edb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:13.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.789+0000 7fc9ced9d640 1 -- 172.21.15.77:0/3705511152 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c000bd40 con 0x7fc9d0159c00 2023-11-04T01:41:13.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.790+0000 7fc9ced9d640 1 --2- 172.21.15.77:0/3705511152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9d0159c00 0x7fc9d014ceb0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc9c800d800 tx=0x7fc9c800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:13.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.790+0000 7fc9beffd640 1 -- 172.21.15.77:0/3705511152 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c800b6c0 con 0x7fc9d0159c00 2023-11-04T01:41:13.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.790+0000 7fc9beffd640 1 -- 172.21.15.77:0/3705511152 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c800b840 con 0x7fc9d0159c00 2023-11-04T01:41:13.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.790+0000 7fc9d4bf5640 1 -- 172.21.15.77:0/3705511152 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d014b3e0 con 0x7fc9d0159c00 2023-11-04T01:41:13.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.790+0000 7fc9beffd640 1 -- 172.21.15.77:0/3705511152 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c800bbf0 con 0x7fc9d0159c00 2023-11-04T01:41:13.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.790+0000 7fc9d4bf5640 1 -- 172.21.15.77:0/3705511152 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d014b9a0 con 0x7fc9d0159c00 2023-11-04T01:41:13.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.791+0000 7fc9d4bf5640 1 -- 172.21.15.77:0/3705511152 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9d0074290 con 0x7fc9d0159c00 2023-11-04T01:41:13.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.791+0000 7fc9beffd640 1 -- 172.21.15.77:0/3705511152 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc9c800bd50 con 0x7fc9d0159c00 2023-11-04T01:41:13.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.792+0000 7fc9beffd640 1 --2- 172.21.15.77:0/3705511152 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc9b006ae70 0x7fc9b006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:13.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.792+0000 7fc9beffd640 1 -- 172.21.15.77:0/3705511152 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc9c8089e00 con 0x7fc9d0159c00 2023-11-04T01:41:13.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.792+0000 7fc9ce59c640 1 --2- 172.21.15.77:0/3705511152 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc9b006ae70 0x7fc9b006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:13.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.792+0000 7fc9ce59c640 1 --2- 172.21.15.77:0/3705511152 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc9b006ae70 0x7fc9b006d330 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0037000 tx=0x7fc9c0032000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:13.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.796+0000 7fc9beffd640 1 -- 172.21.15.77:0/3705511152 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc9c8054ba0 con 0x7fc9d0159c00 2023-11-04T01:41:13.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:13.997+0000 7fc9d4bf5640 1 -- 172.21.15.77:0/3705511152 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc9d015d1b0 con 0x7fc9d0159c00 2023-11-04T01:41:13.999 INFO:tasks.ceph.mon.a.smithi077.stderr:2023-11-04T01:41:13.998+0000 7f1217737640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-04T01:41:14.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.000+0000 7fc9beffd640 1 -- 172.21.15.77:0/3705511152 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc9c80581c0 con 0x7fc9d0159c00 2023-11-04T01:41:14.001 INFO:teuthology.orchestra.run.smithi077.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-04T01:41:14.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.002+0000 7fc9d4bf5640 1 -- 172.21.15.77:0/3705511152 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc9b006ae70 msgr2=0x7fc9b006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.002+0000 7fc9d4bf5640 1 --2- 172.21.15.77:0/3705511152 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc9b006ae70 0x7fc9b006d330 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0037000 tx=0x7fc9c0032000 comp rx=0 tx=0).stop 2023-11-04T01:41:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.002+0000 7fc9d4bf5640 1 -- 172.21.15.77:0/3705511152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9d0159c00 msgr2=0x7fc9d014ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.002+0000 7fc9d4bf5640 1 --2- 172.21.15.77:0/3705511152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9d0159c00 0x7fc9d014ceb0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc9c800d800 tx=0x7fc9c800dcc0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.002+0000 7fc9d4bf5640 1 -- 172.21.15.77:0/3705511152 shutdown_connections 2023-11-04T01:41:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.002+0000 7fc9d4bf5640 1 --2- 172.21.15.77:0/3705511152 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc9b006ae70 0x7fc9b006d330 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.002+0000 7fc9d4bf5640 1 --2- 172.21.15.77:0/3705511152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9d0159c00 0x7fc9d014ceb0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.002+0000 7fc9d4bf5640 1 --2- 172.21.15.77:0/3705511152 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9d00c48e0 0x7fc9d01edb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.002+0000 7fc9d4bf5640 1 --2- 172.21.15.77:0/3705511152 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc9d00ae1d0 0x7fc9d01eedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.002+0000 7fc9d4bf5640 1 -- 172.21.15.77:0/3705511152 >> 172.21.15.77:0/3705511152 conn(0x7fc9d00ce950 msgr2=0x7fc9d00cd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:14.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.003+0000 7fc9d4bf5640 1 -- 172.21.15.77:0/3705511152 shutdown_connections 2023-11-04T01:41:14.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.003+0000 7fc9d4bf5640 1 -- 172.21.15.77:0/3705511152 wait complete. 2023-11-04T01:41:14.007 INFO:tasks.ceph.mds.d.smithi122.stderr: -4561> 2023-11-04T01:40:09.457+0000 7f7872258640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:41:14.015 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-04T01:41:14.038 INFO:tasks.ceph.mds.d.smithi122.stdout:starting mds.d at 2023-11-04T01:41:14.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.115+0000 7fccae39e640 1 Processor -- start 2023-11-04T01:41:14.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.116+0000 7fccae39e640 1 -- start start 2023-11-04T01:41:14.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.116+0000 7fccae39e640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fcca815acb0 0x7fcca80ce990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.116+0000 7fccae39e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcca80cb900 0x7fcca80d0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.116+0000 7fccae39e640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca80b6350 con 0x7fcca80b2320 2023-11-04T01:41:14.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.116+0000 7fccae39e640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca815b090 con 0x7fcca815acb0 2023-11-04T01:41:14.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.116+0000 7fccae39e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca80d0550 con 0x7fcca80cb900 2023-11-04T01:41:14.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.117+0000 7fccad39c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fcca815acb0 0x7fcca80ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.117+0000 7fccacb9b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcca80cb900 0x7fcca80d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.117+0000 7fccadb9d640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fcca80b2320 0x7fcca80b37f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:51218/0 (socket says 172.21.15.77:51218) 2023-11-04T01:41:14.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.117+0000 7fccad39c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fcca815acb0 0x7fcca80ce990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:54950/0 (socket says 172.21.15.77:54950) 2023-11-04T01:41:14.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.117+0000 7fccadb9d640 1 -- 172.21.15.77:0/1889370365 learned_addr learned my addr 172.21.15.77:0/1889370365 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:14.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.117+0000 7fccad39c640 1 -- 172.21.15.77:0/1889370365 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcca80cb900 msgr2=0x7fcca80d0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:14.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.117+0000 7fccad39c640 1 --2- 172.21.15.77:0/1889370365 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcca80cb900 0x7fcca80d0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.117+0000 7fccad39c640 1 -- 172.21.15.77:0/1889370365 >> v1:172.21.15.122:6789/0 conn(0x7fcca80b2320 legacy=0x7fcca80b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.117+0000 7fccad39c640 1 -- 172.21.15.77:0/1889370365 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca80cfb80 con 0x7fcca815acb0 2023-11-04T01:41:14.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.118+0000 7fccad39c640 1 --2- 172.21.15.77:0/1889370365 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcca815acb0 0x7fcca80ce990 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcca0009dc0 tx=0x7fcca002be90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac270444ba790713 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:14.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.118+0000 7fcc9ffff640 1 -- 172.21.15.77:0/1889370365 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca002cc40 con 0x7fcca815acb0 2023-11-04T01:41:14.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.118+0000 7fcc9ffff640 1 -- 172.21.15.77:0/1889370365 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca002cda0 con 0x7fcca815acb0 2023-11-04T01:41:14.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.118+0000 7fcc9ffff640 1 -- 172.21.15.77:0/1889370365 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca0034660 con 0x7fcca815acb0 2023-11-04T01:41:14.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.118+0000 7fccae39e640 1 -- 172.21.15.77:0/1889370365 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcca815acb0 msgr2=0x7fcca80ce990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.118+0000 7fccae39e640 1 --2- 172.21.15.77:0/1889370365 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcca815acb0 0x7fcca80ce990 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcca0009dc0 tx=0x7fcca002be90 comp rx=0 tx=0).stop 2023-11-04T01:41:14.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.118+0000 7fccae39e640 1 -- 172.21.15.77:0/1889370365 shutdown_connections 2023-11-04T01:41:14.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.118+0000 7fccae39e640 1 --2- 172.21.15.77:0/1889370365 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcca80cb900 0x7fcca80d0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.119+0000 7fccae39e640 1 --2- 172.21.15.77:0/1889370365 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcca815acb0 0x7fcca80ce990 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.119+0000 7fccae39e640 1 -- 172.21.15.77:0/1889370365 >> 172.21.15.77:0/1889370365 conn(0x7fcca80cd320 msgr2=0x7fcca80cd730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:14.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.119+0000 7fccae39e640 1 -- 172.21.15.77:0/1889370365 shutdown_connections 2023-11-04T01:41:14.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.119+0000 7fccae39e640 1 -- 172.21.15.77:0/1889370365 wait complete. 2023-11-04T01:41:14.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.120+0000 7fccae39e640 1 Processor -- start 2023-11-04T01:41:14.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.120+0000 7fccae39e640 1 -- start start 2023-11-04T01:41:14.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.121+0000 7fccae39e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcca80b2320 0x7fcca80c5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.121+0000 7fccae39e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcca80cb900 0x7fcca814eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.121+0000 7fccae39e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcca815acb0 0x7fcca80c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.121+0000 7fccae39e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca80c5470 con 0x7fcca80b2320 2023-11-04T01:41:14.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.121+0000 7fccae39e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca814e880 con 0x7fcca815acb0 2023-11-04T01:41:14.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.121+0000 7fccae39e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca80c5e40 con 0x7fcca80cb900 2023-11-04T01:41:14.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.121+0000 7fccad39c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcca80b2320 0x7fcca80c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.121+0000 7fccad39c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcca80b2320 0x7fcca80c5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57298/0 (socket says 172.21.15.77:57298) 2023-11-04T01:41:14.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.121+0000 7fccad39c640 1 -- 172.21.15.77:0/3745076936 learned_addr learned my addr 172.21.15.77:0/3745076936 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:14.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.121+0000 7fccacb9b640 1 --2- 172.21.15.77:0/3745076936 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcca80cb900 0x7fcca814eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.121+0000 7fccadb9d640 1 --2- 172.21.15.77:0/3745076936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcca815acb0 0x7fcca80c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.121+0000 7fccad39c640 1 -- 172.21.15.77:0/3745076936 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcca80cb900 msgr2=0x7fcca814eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.121+0000 7fccad39c640 1 --2- 172.21.15.77:0/3745076936 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcca80cb900 0x7fcca814eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.121+0000 7fccad39c640 1 -- 172.21.15.77:0/3745076936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcca815acb0 msgr2=0x7fcca80c93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:14.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.121+0000 7fccad39c640 1 --2- 172.21.15.77:0/3745076936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcca815acb0 0x7fcca80c93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:14.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.121+0000 7fccad39c640 1 -- 172.21.15.77:0/3745076936 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca0009a70 con 0x7fcca80b2320 2023-11-04T01:41:14.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.121+0000 7fccacb9b640 1 --2- 172.21.15.77:0/3745076936 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcca80cb900 0x7fcca814eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:14.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.121+0000 7fccad39c640 1 --2- 172.21.15.77:0/3745076936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcca80b2320 0x7fcca80c5900 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fcca0009ee0 tx=0x7fcca0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:14.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.121+0000 7fcc9dffb640 1 -- 172.21.15.77:0/3745076936 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca003e610 con 0x7fcca80b2320 2023-11-04T01:41:14.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.121+0000 7fcc9dffb640 1 -- 172.21.15.77:0/3745076936 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca003e770 con 0x7fcca80b2320 2023-11-04T01:41:14.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.121+0000 7fccae39e640 1 -- 172.21.15.77:0/3745076936 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca80c4860 con 0x7fcca80b2320 2023-11-04T01:41:14.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.121+0000 7fcc9dffb640 1 -- 172.21.15.77:0/3745076936 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca003eb00 con 0x7fcca80b2320 2023-11-04T01:41:14.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.122+0000 7fccae39e640 1 -- 172.21.15.77:0/3745076936 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca80c4e20 con 0x7fcca80b2320 2023-11-04T01:41:14.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.122+0000 7fccae39e640 1 -- 172.21.15.77:0/3745076936 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca8066b30 con 0x7fcca80b2320 2023-11-04T01:41:14.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.123+0000 7fcc9dffb640 1 -- 172.21.15.77:0/3745076936 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcca003b050 con 0x7fcca80b2320 2023-11-04T01:41:14.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.123+0000 7fcc9dffb640 1 --2- 172.21.15.77:0/3745076936 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcc8c06ae70 0x7fcc8c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:14.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.123+0000 7fcc9dffb640 1 -- 172.21.15.77:0/3745076936 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fcca00abc70 con 0x7fcca80b2320 2023-11-04T01:41:14.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.124+0000 7fccacb9b640 1 --2- 172.21.15.77:0/3745076936 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcc8c06ae70 0x7fcc8c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:14.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.124+0000 7fccacb9b640 1 --2- 172.21.15.77:0/3745076936 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcc8c06ae70 0x7fcc8c06d330 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcca81592f0 tx=0x7fcc98008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:14.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.127+0000 7fcc9dffb640 1 -- 172.21.15.77:0/3745076936 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcca0076910 con 0x7fcca80b2320 2023-11-04T01:41:14.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:14.331+0000 7fccae39e640 1 -- 172.21.15.77:0/3745076936 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcca804ece0 con 0x7fcca80b2320 2023-11-04T01:41:15.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.001+0000 7fcc9dffb640 1 -- 172.21.15.77:0/3745076936 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcca004d0a0 con 0x7fcca80b2320 2023-11-04T01:41:15.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.004+0000 7fccae39e640 1 -- 172.21.15.77:0/3745076936 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcc8c06ae70 msgr2=0x7fcc8c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.004+0000 7fccae39e640 1 --2- 172.21.15.77:0/3745076936 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcc8c06ae70 0x7fcc8c06d330 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcca81592f0 tx=0x7fcc98008040 comp rx=0 tx=0).stop 2023-11-04T01:41:15.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.004+0000 7fccae39e640 1 -- 172.21.15.77:0/3745076936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcca80b2320 msgr2=0x7fcca80c5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.004+0000 7fccae39e640 1 --2- 172.21.15.77:0/3745076936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcca80b2320 0x7fcca80c5900 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fcca0009ee0 tx=0x7fcca0004a40 comp rx=0 tx=0).stop 2023-11-04T01:41:15.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.004+0000 7fccae39e640 1 -- 172.21.15.77:0/3745076936 shutdown_connections 2023-11-04T01:41:15.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.004+0000 7fccae39e640 1 --2- 172.21.15.77:0/3745076936 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcc8c06ae70 0x7fcc8c06d330 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.004+0000 7fccae39e640 1 --2- 172.21.15.77:0/3745076936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcca815acb0 0x7fcca80c93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.004+0000 7fccae39e640 1 --2- 172.21.15.77:0/3745076936 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcca80cb900 0x7fcca814eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.004+0000 7fccae39e640 1 --2- 172.21.15.77:0/3745076936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcca80b2320 0x7fcca80c5900 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.004+0000 7fccae39e640 1 -- 172.21.15.77:0/3745076936 >> 172.21.15.77:0/3745076936 conn(0x7fcca80cd320 msgr2=0x7fcca8159f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:15.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.004+0000 7fccae39e640 1 -- 172.21.15.77:0/3745076936 shutdown_connections 2023-11-04T01:41:15.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.004+0000 7fccae39e640 1 -- 172.21.15.77:0/3745076936 wait complete. 2023-11-04T01:41:15.020 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-04T01:41:15.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.128+0000 7f174e2d4640 1 Processor -- start 2023-11-04T01:41:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.128+0000 7f174e2d4640 1 -- start start 2023-11-04T01:41:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.129+0000 7f174e2d4640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f17480cd9f0 0x7f17480cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.129+0000 7f174e2d4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f174815d4b0 0x7f174815d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.129+0000 7f174e2d4640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f17480b47e0 0x7f17480b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.129+0000 7f174e2d4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f174815e4d0 con 0x7f174815d4b0 2023-11-04T01:41:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.129+0000 7f174e2d4640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17480d1320 con 0x7f17480b47e0 2023-11-04T01:41:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.129+0000 7f174e2d4640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17480ce310 con 0x7f17480cd9f0 2023-11-04T01:41:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.129+0000 7f17477fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f174815d4b0 0x7f174815d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.129+0000 7f17477fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f174815d4b0 0x7f174815d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57314/0 (socket says 172.21.15.77:57314) 2023-11-04T01:41:15.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.129+0000 7f17477fe640 1 -- 172.21.15.77:0/2932302300 learned_addr learned my addr 172.21.15.77:0/2932302300 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.130+0000 7f174c871640 1 --2- 172.21.15.77:0/2932302300 >> v2:172.21.15.122:3300/0 conn(0x7f17480b47e0 0x7f17480b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.130+0000 7f1747fff640 1 --2- 172.21.15.77:0/2932302300 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f17480cd9f0 0x7f17480cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.130+0000 7f17477fe640 1 -- 172.21.15.77:0/2932302300 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f17480cd9f0 msgr2=0x7f17480cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.130+0000 7f17477fe640 1 --2- 172.21.15.77:0/2932302300 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f17480cd9f0 0x7f17480cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.130+0000 7f17477fe640 1 -- 172.21.15.77:0/2932302300 >> v2:172.21.15.122:3300/0 conn(0x7f17480b47e0 msgr2=0x7f17480b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:15.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.130+0000 7f17477fe640 1 --2- 172.21.15.77:0/2932302300 >> v2:172.21.15.122:3300/0 conn(0x7f17480b47e0 0x7f17480b4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.130+0000 7f17477fe640 1 -- 172.21.15.77:0/2932302300 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174815df10 con 0x7f174815d4b0 2023-11-04T01:41:15.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.130+0000 7f1747fff640 1 --2- 172.21.15.77:0/2932302300 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f17480cd9f0 0x7f17480cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:15.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.130+0000 7f17477fe640 1 --2- 172.21.15.77:0/2932302300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f174815d4b0 0x7f174815d910 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f17480cd670 tx=0x7f173c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33411d0d22b0c4a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:15.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.130+0000 7f1746ffd640 1 -- 172.21.15.77:0/2932302300 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173c030860 con 0x7f174815d4b0 2023-11-04T01:41:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.131+0000 7f1746ffd640 1 -- 172.21.15.77:0/2932302300 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f173c0309c0 con 0x7f174815d4b0 2023-11-04T01:41:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.131+0000 7f1746ffd640 1 -- 172.21.15.77:0/2932302300 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173c030d50 con 0x7f174815d4b0 2023-11-04T01:41:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.131+0000 7f174e2d4640 1 -- 172.21.15.77:0/2932302300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f174815d4b0 msgr2=0x7f174815d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.131+0000 7f174e2d4640 1 --2- 172.21.15.77:0/2932302300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f174815d4b0 0x7f174815d910 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f17480cd670 tx=0x7f173c02b9a0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.131+0000 7f174e2d4640 1 -- 172.21.15.77:0/2932302300 shutdown_connections 2023-11-04T01:41:15.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.131+0000 7f174e2d4640 1 --2- 172.21.15.77:0/2932302300 >> v2:172.21.15.122:3300/0 conn(0x7f17480b47e0 0x7f17480b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.131+0000 7f174e2d4640 1 --2- 172.21.15.77:0/2932302300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f174815d4b0 0x7f174815d910 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.131+0000 7f174e2d4640 1 --2- 172.21.15.77:0/2932302300 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f17480cd9f0 0x7f17480cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.131+0000 7f174e2d4640 1 -- 172.21.15.77:0/2932302300 >> 172.21.15.77:0/2932302300 conn(0x7f1748071c40 msgr2=0x7f1748072050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:15.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.131+0000 7f174e2d4640 1 -- 172.21.15.77:0/2932302300 shutdown_connections 2023-11-04T01:41:15.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.131+0000 7f174e2d4640 1 -- 172.21.15.77:0/2932302300 wait complete. 2023-11-04T01:41:15.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.132+0000 7f174e2d4640 1 Processor -- start 2023-11-04T01:41:15.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.132+0000 7f174e2d4640 1 -- start start 2023-11-04T01:41:15.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.133+0000 7f174e2d4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17480b47e0 0x7f17481f64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.133+0000 7f174e2d4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17480cd9f0 0x7f17481571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.133+0000 7f174e2d4640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f174815d4b0 0x7f17480c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.133+0000 7f174e2d4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17481f6a00 con 0x7f17480cd9f0 2023-11-04T01:41:15.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.133+0000 7f174e2d4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17480c6c60 con 0x7f17480b47e0 2023-11-04T01:41:15.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.133+0000 7f174e2d4640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17480c6f40 con 0x7f174815d4b0 2023-11-04T01:41:15.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.133+0000 7f17477fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17480cd9f0 0x7f17481571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.133+0000 7f17477fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17480cd9f0 0x7f17481571b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57326/0 (socket says 172.21.15.77:57326) 2023-11-04T01:41:15.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.133+0000 7f17477fe640 1 -- 172.21.15.77:0/223497341 learned_addr learned my addr 172.21.15.77:0/223497341 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:15.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.134+0000 7f17477fe640 1 -- 172.21.15.77:0/223497341 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f174815d4b0 msgr2=0x7f17480c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.134+0000 7f174c871640 1 --2- 172.21.15.77:0/223497341 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f174815d4b0 0x7f17480c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.134+0000 7f1747fff640 1 --2- 172.21.15.77:0/223497341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17480b47e0 0x7f17481f64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.134+0000 7f17477fe640 1 --2- 172.21.15.77:0/223497341 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f174815d4b0 0x7f17480c87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.134+0000 7f17477fe640 1 -- 172.21.15.77:0/223497341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17480b47e0 msgr2=0x7f17481f64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:15.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.134+0000 7f17477fe640 1 --2- 172.21.15.77:0/223497341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17480b47e0 0x7f17481f64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:15.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.134+0000 7f17477fe640 1 -- 172.21.15.77:0/223497341 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173c0094d0 con 0x7f17480cd9f0 2023-11-04T01:41:15.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.134+0000 7f17477fe640 1 --2- 172.21.15.77:0/223497341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17480cd9f0 0x7f17481571b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f173c02b9e0 tx=0x7f173c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:15.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.134+0000 7f1744ff9640 1 -- 172.21.15.77:0/223497341 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173c039b60 con 0x7f17480cd9f0 2023-11-04T01:41:15.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.134+0000 7f1744ff9640 1 -- 172.21.15.77:0/223497341 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f173c039ce0 con 0x7f17480cd9f0 2023-11-04T01:41:15.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.134+0000 7f174e2d4640 1 -- 172.21.15.77:0/223497341 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17480c7220 con 0x7f17480cd9f0 2023-11-04T01:41:15.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.134+0000 7f1744ff9640 1 -- 172.21.15.77:0/223497341 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173c043650 con 0x7f17480cd9f0 2023-11-04T01:41:15.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.134+0000 7f174e2d4640 1 -- 172.21.15.77:0/223497341 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17480c77e0 con 0x7f17480cd9f0 2023-11-04T01:41:15.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.135+0000 7f174e2d4640 1 -- 172.21.15.77:0/223497341 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17480d0f50 con 0x7f17480cd9f0 2023-11-04T01:41:15.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.135+0000 7f1744ff9640 1 -- 172.21.15.77:0/223497341 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f173c04c3b0 con 0x7f17480cd9f0 2023-11-04T01:41:15.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.136+0000 7f1744ff9640 1 --2- 172.21.15.77:0/223497341 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f173406ae70 0x7f173406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:15.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.136+0000 7f1744ff9640 1 -- 172.21.15.77:0/223497341 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f173c0abe00 con 0x7f17480cd9f0 2023-11-04T01:41:15.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.136+0000 7f1747fff640 1 --2- 172.21.15.77:0/223497341 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f173406ae70 0x7f173406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:15.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.137+0000 7f1747fff640 1 --2- 172.21.15.77:0/223497341 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f173406ae70 0x7f173406d330 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f173800b840 tx=0x7f1738008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:15.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.140+0000 7f1744ff9640 1 -- 172.21.15.77:0/223497341 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f173c076b00 con 0x7f17480cd9f0 2023-11-04T01:41:15.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:15.307+0000 7f174e2d4640 1 -- 172.21.15.77:0/223497341 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f174804e490 con 0x7f17480cd9f0 2023-11-04T01:41:16.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.003+0000 7f1744ff9640 1 -- 172.21.15.77:0/223497341 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7f173c0480d0 con 0x7f17480cd9f0 2023-11-04T01:41:16.005 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_metadata' removed 2023-11-04T01:41:16.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.006+0000 7f174e2d4640 1 -- 172.21.15.77:0/223497341 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f173406ae70 msgr2=0x7f173406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.006+0000 7f174e2d4640 1 --2- 172.21.15.77:0/223497341 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f173406ae70 0x7f173406d330 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f173800b840 tx=0x7f1738008040 comp rx=0 tx=0).stop 2023-11-04T01:41:16.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.006+0000 7f174e2d4640 1 -- 172.21.15.77:0/223497341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17480cd9f0 msgr2=0x7f17481571b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.006+0000 7f174e2d4640 1 --2- 172.21.15.77:0/223497341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17480cd9f0 0x7f17481571b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f173c02b9e0 tx=0x7f173c004730 comp rx=0 tx=0).stop 2023-11-04T01:41:16.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.006+0000 7f174e2d4640 1 -- 172.21.15.77:0/223497341 shutdown_connections 2023-11-04T01:41:16.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.006+0000 7f174e2d4640 1 --2- 172.21.15.77:0/223497341 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f173406ae70 0x7f173406d330 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.006+0000 7f174e2d4640 1 --2- 172.21.15.77:0/223497341 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f174815d4b0 0x7f17480c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.006+0000 7f174e2d4640 1 --2- 172.21.15.77:0/223497341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17480cd9f0 0x7f17481571b0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.006+0000 7f174e2d4640 1 --2- 172.21.15.77:0/223497341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17480b47e0 0x7f17481f64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.006+0000 7f174e2d4640 1 -- 172.21.15.77:0/223497341 >> 172.21.15.77:0/223497341 conn(0x7f1748071c40 msgr2=0x7f174815b430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:16.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.007+0000 7f174e2d4640 1 -- 172.21.15.77:0/223497341 shutdown_connections 2023-11-04T01:41:16.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.007+0000 7f174e2d4640 1 -- 172.21.15.77:0/223497341 wait complete. 2023-11-04T01:41:16.023 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-04T01:41:16.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.134+0000 7f4e2fcb4640 1 Processor -- start 2023-11-04T01:41:16.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.134+0000 7f4e2fcb4640 1 -- start start 2023-11-04T01:41:16.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.135+0000 7f4e2fcb4640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4e28169590 0x7f4e2816b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.135+0000 7f4e2fcb4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e280c9a20 con 0x7f4e280c4bb0 2023-11-04T01:41:16.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.135+0000 7f4e2fcb4640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e280c96f0 con 0x7f4e28164980 2023-11-04T01:41:16.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.135+0000 7f4e2fcb4640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e280c50e0 con 0x7f4e28169590 2023-11-04T01:41:16.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.136+0000 7f4e2d24f640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f4e280c4bb0 0x7f4e28167e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45418/0 (socket says 172.21.15.77:45418) 2023-11-04T01:41:16.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.136+0000 7f4e2d24f640 1 -- 172.21.15.77:0/113143250 learned_addr learned my addr 172.21.15.77:0/113143250 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:16.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.136+0000 7f4e2e251640 1 --2- 172.21.15.77:0/113143250 >> v2:172.21.15.122:3300/0 conn(0x7f4e28169590 0x7f4e2816b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.136+0000 7f4e2e251640 1 -- 172.21.15.77:0/113143250 >> v1:172.21.15.122:6789/0 conn(0x7f4e28164980 legacy=0x7f4e280cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.136+0000 7f4e2e251640 1 -- 172.21.15.77:0/113143250 >> v1:172.21.15.77:6789/0 conn(0x7f4e280c4bb0 legacy=0x7f4e28167e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.136+0000 7f4e2e251640 1 -- 172.21.15.77:0/113143250 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e280c53c0 con 0x7f4e28169590 2023-11-04T01:41:16.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.137+0000 7f4e2e251640 1 --2- 172.21.15.77:0/113143250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e28169590 0x7f4e2816b980 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4e20009d90 tx=0x7f4e2002bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=615529bd36fb73b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:16.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.138+0000 7f4e2ca4e640 1 -- 172.21.15.77:0/113143250 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2002cab0 con 0x7f4e28169590 2023-11-04T01:41:16.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.138+0000 7f4e2ca4e640 1 -- 172.21.15.77:0/113143250 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2002cc10 con 0x7f4e28169590 2023-11-04T01:41:16.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.138+0000 7f4e2ca4e640 1 -- 172.21.15.77:0/113143250 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e20034440 con 0x7f4e28169590 2023-11-04T01:41:16.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.138+0000 7f4e2fcb4640 1 -- 172.21.15.77:0/113143250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e28169590 msgr2=0x7f4e2816b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.138+0000 7f4e2fcb4640 1 --2- 172.21.15.77:0/113143250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e28169590 0x7f4e2816b980 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4e20009d90 tx=0x7f4e2002bd80 comp rx=0 tx=0).stop 2023-11-04T01:41:16.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.138+0000 7f4e2fcb4640 1 -- 172.21.15.77:0/113143250 shutdown_connections 2023-11-04T01:41:16.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.138+0000 7f4e2fcb4640 1 --2- 172.21.15.77:0/113143250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e28169590 0x7f4e2816b980 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.138+0000 7f4e2fcb4640 1 -- 172.21.15.77:0/113143250 >> 172.21.15.77:0/113143250 conn(0x7f4e280b05d0 msgr2=0x7f4e280b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:16.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.139+0000 7f4e2fcb4640 1 -- 172.21.15.77:0/113143250 shutdown_connections 2023-11-04T01:41:16.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.139+0000 7f4e2fcb4640 1 -- 172.21.15.77:0/113143250 wait complete. 2023-11-04T01:41:16.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.140+0000 7f4e2fcb4640 1 Processor -- start 2023-11-04T01:41:16.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.140+0000 7f4e2fcb4640 1 -- start start 2023-11-04T01:41:16.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.140+0000 7f4e2fcb4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e280c4bb0 0x7f4e2813ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.140+0000 7f4e2fcb4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e28164980 0x7f4e28157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.140+0000 7f4e2fcb4640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4e28169590 0x7f4e28158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.140+0000 7f4e2fcb4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e28159980 con 0x7f4e280c4bb0 2023-11-04T01:41:16.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.140+0000 7f4e2fcb4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e28152f40 con 0x7f4e28164980 2023-11-04T01:41:16.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.140+0000 7f4e2fcb4640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e281588e0 con 0x7f4e28169590 2023-11-04T01:41:16.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.141+0000 7f4e2da50640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e280c4bb0 0x7f4e2813ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.141+0000 7f4e2da50640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e280c4bb0 0x7f4e2813ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57330/0 (socket says 172.21.15.77:57330) 2023-11-04T01:41:16.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.141+0000 7f4e2da50640 1 -- 172.21.15.77:0/1154768515 learned_addr learned my addr 172.21.15.77:0/1154768515 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:16.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.141+0000 7f4e2d24f640 1 --2- 172.21.15.77:0/1154768515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e28164980 0x7f4e28157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.141+0000 7f4e2e251640 1 --2- 172.21.15.77:0/1154768515 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4e28169590 0x7f4e28158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.141+0000 7f4e2da50640 1 -- 172.21.15.77:0/1154768515 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4e28169590 msgr2=0x7f4e28158260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.141+0000 7f4e2da50640 1 --2- 172.21.15.77:0/1154768515 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4e28169590 0x7f4e28158260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.141+0000 7f4e2da50640 1 -- 172.21.15.77:0/1154768515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e28164980 msgr2=0x7f4e28157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:16.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.141+0000 7f4e2da50640 1 --2- 172.21.15.77:0/1154768515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e28164980 0x7f4e28157d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:16.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.141+0000 7f4e2da50640 1 -- 172.21.15.77:0/1154768515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e20009a70 con 0x7f4e280c4bb0 2023-11-04T01:41:16.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.141+0000 7f4e2da50640 1 --2- 172.21.15.77:0/1154768515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e280c4bb0 0x7f4e2813ef20 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4e2400c450 tx=0x7f4e2400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:16.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.141+0000 7f4e1e7fc640 1 -- 172.21.15.77:0/1154768515 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e240052d0 con 0x7f4e280c4bb0 2023-11-04T01:41:16.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.141+0000 7f4e1e7fc640 1 -- 172.21.15.77:0/1154768515 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e24005430 con 0x7f4e280c4bb0 2023-11-04T01:41:16.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.141+0000 7f4e2fcb4640 1 -- 172.21.15.77:0/1154768515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e28158bc0 con 0x7f4e280c4bb0 2023-11-04T01:41:16.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.141+0000 7f4e1e7fc640 1 -- 172.21.15.77:0/1154768515 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e24012870 con 0x7f4e280c4bb0 2023-11-04T01:41:16.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.141+0000 7f4e2fcb4640 1 -- 172.21.15.77:0/1154768515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e28159180 con 0x7f4e280c4bb0 2023-11-04T01:41:16.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.142+0000 7f4e2fcb4640 1 -- 172.21.15.77:0/1154768515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e2804e490 con 0x7f4e280c4bb0 2023-11-04T01:41:16.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.143+0000 7f4e1e7fc640 1 -- 172.21.15.77:0/1154768515 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4e240129d0 con 0x7f4e280c4bb0 2023-11-04T01:41:16.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.143+0000 7f4e1e7fc640 1 --2- 172.21.15.77:0/1154768515 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4e0c06ae70 0x7f4e0c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:16.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.143+0000 7f4e1e7fc640 1 -- 172.21.15.77:0/1154768515 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6311+0+0 (secure 0 0 0) 0x7f4e240891f0 con 0x7f4e280c4bb0 2023-11-04T01:41:16.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.143+0000 7f4e2d24f640 1 --2- 172.21.15.77:0/1154768515 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4e0c06ae70 0x7f4e0c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:16.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.144+0000 7f4e2d24f640 1 --2- 172.21.15.77:0/1154768515 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4e0c06ae70 0x7f4e0c06d330 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4e281fa1a0 tx=0x7f4e18007e00 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:16.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.147+0000 7f4e1e7fc640 1 -- 172.21.15.77:0/1154768515 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4e240540f0 con 0x7f4e280c4bb0 2023-11-04T01:41:16.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:16.314+0000 7f4e2fcb4640 1 -- 172.21.15.77:0/1154768515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4e280c9ee0 con 0x7f4e280c4bb0 2023-11-04T01:41:17.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.013+0000 7f4e1e7fc640 1 -- 172.21.15.77:0/1154768515 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4e24057710 con 0x7f4e280c4bb0 2023-11-04T01:41:17.016 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data' removed 2023-11-04T01:41:17.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.017+0000 7f4e2fcb4640 1 -- 172.21.15.77:0/1154768515 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4e0c06ae70 msgr2=0x7f4e0c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:17.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.017+0000 7f4e2fcb4640 1 --2- 172.21.15.77:0/1154768515 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4e0c06ae70 0x7f4e0c06d330 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4e281fa1a0 tx=0x7f4e18007e00 comp rx=0 tx=0).stop 2023-11-04T01:41:17.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.017+0000 7f4e2fcb4640 1 -- 172.21.15.77:0/1154768515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e280c4bb0 msgr2=0x7f4e2813ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:17.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.017+0000 7f4e2fcb4640 1 --2- 172.21.15.77:0/1154768515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e280c4bb0 0x7f4e2813ef20 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4e2400c450 tx=0x7f4e2400c910 comp rx=0 tx=0).stop 2023-11-04T01:41:17.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.018+0000 7f4e2fcb4640 1 -- 172.21.15.77:0/1154768515 shutdown_connections 2023-11-04T01:41:17.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.018+0000 7f4e2fcb4640 1 --2- 172.21.15.77:0/1154768515 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4e0c06ae70 0x7f4e0c06d330 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.018+0000 7f4e2fcb4640 1 --2- 172.21.15.77:0/1154768515 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4e28169590 0x7f4e28158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.018+0000 7f4e2fcb4640 1 --2- 172.21.15.77:0/1154768515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e28164980 0x7f4e28157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.018+0000 7f4e2fcb4640 1 --2- 172.21.15.77:0/1154768515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e280c4bb0 0x7f4e2813ef20 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.018+0000 7f4e2fcb4640 1 -- 172.21.15.77:0/1154768515 >> 172.21.15.77:0/1154768515 conn(0x7f4e280b05d0 msgr2=0x7f4e280b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:17.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.018+0000 7f4e2fcb4640 1 -- 172.21.15.77:0/1154768515 shutdown_connections 2023-11-04T01:41:17.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.018+0000 7f4e2fcb4640 1 -- 172.21.15.77:0/1154768515 wait complete. 2023-11-04T01:41:17.035 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-11-04T01:41:17.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.138+0000 7fa20bd05640 1 Processor -- start 2023-11-04T01:41:17.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.139+0000 7fa20bd05640 1 -- start start 2023-11-04T01:41:17.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.139+0000 7fa20bd05640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa2040cd9f0 0x7fa2040cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:17.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.139+0000 7fa20bd05640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa20415d4b0 0x7fa20415d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:17.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.139+0000 7fa20bd05640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2040d1320 con 0x7fa2040b47e0 2023-11-04T01:41:17.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.139+0000 7fa20bd05640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa20415e4d0 con 0x7fa20415d4b0 2023-11-04T01:41:17.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.139+0000 7fa20bd05640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2040ce310 con 0x7fa2040cd9f0 2023-11-04T01:41:17.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.140+0000 7fa2092a0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa20415d4b0 0x7fa20415d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:17.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.140+0000 7fa2092a0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa20415d4b0 0x7fa20415d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57338/0 (socket says 172.21.15.77:57338) 2023-11-04T01:41:17.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.140+0000 7fa2092a0640 1 -- 172.21.15.77:0/958341361 learned_addr learned my addr 172.21.15.77:0/958341361 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:17.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.140+0000 7fa209aa1640 1 --2- 172.21.15.77:0/958341361 >> v2:172.21.15.122:3300/0 conn(0x7fa2040cd9f0 0x7fa2040cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:17.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.140+0000 7fa2092a0640 1 -- 172.21.15.77:0/958341361 >> v2:172.21.15.122:3300/0 conn(0x7fa2040cd9f0 msgr2=0x7fa2040cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:17.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.140+0000 7fa2092a0640 1 --2- 172.21.15.77:0/958341361 >> v2:172.21.15.122:3300/0 conn(0x7fa2040cd9f0 0x7fa2040cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.140+0000 7fa2092a0640 1 -- 172.21.15.77:0/958341361 >> v1:172.21.15.122:6789/0 conn(0x7fa2040b47e0 legacy=0x7fa2040b4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:17.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.140+0000 7fa2092a0640 1 -- 172.21.15.77:0/958341361 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20415df10 con 0x7fa20415d4b0 2023-11-04T01:41:17.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.141+0000 7fa2092a0640 1 --2- 172.21.15.77:0/958341361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa20415d4b0 0x7fa20415d910 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4009870 tx=0x7fa1f402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1b35af9e569a1db server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:17.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.141+0000 7fa208a9f640 1 -- 172.21.15.77:0/958341361 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f402f840 con 0x7fa20415d4b0 2023-11-04T01:41:17.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.141+0000 7fa208a9f640 1 -- 172.21.15.77:0/958341361 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f402f9a0 con 0x7fa20415d4b0 2023-11-04T01:41:17.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.141+0000 7fa208a9f640 1 -- 172.21.15.77:0/958341361 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f402fd30 con 0x7fa20415d4b0 2023-11-04T01:41:17.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.141+0000 7fa20bd05640 1 -- 172.21.15.77:0/958341361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa20415d4b0 msgr2=0x7fa20415d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:17.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.141+0000 7fa20bd05640 1 --2- 172.21.15.77:0/958341361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa20415d4b0 0x7fa20415d910 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4009870 tx=0x7fa1f402ba20 comp rx=0 tx=0).stop 2023-11-04T01:41:17.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.141+0000 7fa20bd05640 1 -- 172.21.15.77:0/958341361 shutdown_connections 2023-11-04T01:41:17.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.141+0000 7fa20bd05640 1 --2- 172.21.15.77:0/958341361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa20415d4b0 0x7fa20415d910 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.141+0000 7fa20bd05640 1 --2- 172.21.15.77:0/958341361 >> v2:172.21.15.122:3300/0 conn(0x7fa2040cd9f0 0x7fa2040cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.141+0000 7fa20bd05640 1 -- 172.21.15.77:0/958341361 >> 172.21.15.77:0/958341361 conn(0x7fa204071c40 msgr2=0x7fa204072050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:17.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.141+0000 7fa20bd05640 1 -- 172.21.15.77:0/958341361 shutdown_connections 2023-11-04T01:41:17.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.142+0000 7fa20bd05640 1 -- 172.21.15.77:0/958341361 wait complete. 2023-11-04T01:41:17.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.143+0000 7fa20bd05640 1 Processor -- start 2023-11-04T01:41:17.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.143+0000 7fa20bd05640 1 -- start start 2023-11-04T01:41:17.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.143+0000 7fa20bd05640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2040b47e0 0x7fa204157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:17.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.143+0000 7fa20bd05640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa2040cd9f0 0x7fa2040ab500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:17.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.143+0000 7fa20bd05640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa20415d4b0 0x7fa2040cc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:17.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.143+0000 7fa20bd05640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa204157860 con 0x7fa20415d4b0 2023-11-04T01:41:17.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.143+0000 7fa20bd05640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2040aba40 con 0x7fa2040b47e0 2023-11-04T01:41:17.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.143+0000 7fa20bd05640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2040aa460 con 0x7fa2040cd9f0 2023-11-04T01:41:17.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.143+0000 7fa20a2a2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa20415d4b0 0x7fa2040cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:17.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.143+0000 7fa20a2a2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa20415d4b0 0x7fa2040cc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57346/0 (socket says 172.21.15.77:57346) 2023-11-04T01:41:17.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.144+0000 7fa20a2a2640 1 -- 172.21.15.77:0/109057280 learned_addr learned my addr 172.21.15.77:0/109057280 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:17.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.144+0000 7fa209aa1640 1 --2- 172.21.15.77:0/109057280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2040b47e0 0x7fa204157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:17.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.144+0000 7fa2092a0640 1 --2- 172.21.15.77:0/109057280 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa2040cd9f0 0x7fa2040ab500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:17.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.144+0000 7fa20a2a2640 1 -- 172.21.15.77:0/109057280 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa2040cd9f0 msgr2=0x7fa2040ab500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:17.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.144+0000 7fa20a2a2640 1 --2- 172.21.15.77:0/109057280 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa2040cd9f0 0x7fa2040ab500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.144+0000 7fa20a2a2640 1 -- 172.21.15.77:0/109057280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2040b47e0 msgr2=0x7fa204157320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:17.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.144+0000 7fa20a2a2640 1 --2- 172.21.15.77:0/109057280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2040b47e0 0x7fa204157320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:17.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.144+0000 7fa20a2a2640 1 -- 172.21.15.77:0/109057280 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f40094d0 con 0x7fa20415d4b0 2023-11-04T01:41:17.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.144+0000 7fa20a2a2640 1 --2- 172.21.15.77:0/109057280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa20415d4b0 0x7fa2040cc220 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00c6b0 tx=0x7fa1fc00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:17.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.144+0000 7fa1fa7fc640 1 -- 172.21.15.77:0/109057280 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc003b70 con 0x7fa20415d4b0 2023-11-04T01:41:17.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.144+0000 7fa1fa7fc640 1 -- 172.21.15.77:0/109057280 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1fc003cf0 con 0x7fa20415d4b0 2023-11-04T01:41:17.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.144+0000 7fa20bd05640 1 -- 172.21.15.77:0/109057280 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2040aa740 con 0x7fa20415d4b0 2023-11-04T01:41:17.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.144+0000 7fa1fa7fc640 1 -- 172.21.15.77:0/109057280 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc003ea0 con 0x7fa20415d4b0 2023-11-04T01:41:17.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.144+0000 7fa20bd05640 1 -- 172.21.15.77:0/109057280 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2040aad00 con 0x7fa20415d4b0 2023-11-04T01:41:17.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.145+0000 7fa20bd05640 1 -- 172.21.15.77:0/109057280 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2040d0f60 con 0x7fa20415d4b0 2023-11-04T01:41:17.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.145+0000 7fa1fa7fc640 1 -- 172.21.15.77:0/109057280 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa1fc005310 con 0x7fa20415d4b0 2023-11-04T01:41:17.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.146+0000 7fa1fa7fc640 1 --2- 172.21.15.77:0/109057280 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa1e806ae70 0x7fa1e806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:17.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.146+0000 7fa1fa7fc640 1 -- 172.21.15.77:0/109057280 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5781+0+0 (secure 0 0 0) 0x7fa1fc0892c0 con 0x7fa20415d4b0 2023-11-04T01:41:17.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.146+0000 7fa209aa1640 1 --2- 172.21.15.77:0/109057280 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa1e806ae70 0x7fa1e806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:17.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.146+0000 7fa209aa1640 1 --2- 172.21.15.77:0/109057280 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa1e806ae70 0x7fa1e806d330 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa2040c8dc0 tx=0x7fa200008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:17.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.150+0000 7fa1fa7fc640 1 -- 172.21.15.77:0/109057280 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa1fc0543d0 con 0x7fa20415d4b0 2023-11-04T01:41:17.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:17.317+0000 7fa20bd05640 1 -- 172.21.15.77:0/109057280 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa20404e490 con 0x7fa20415d4b0 2023-11-04T01:41:18.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.018+0000 7fa1fa7fc640 1 -- 172.21.15.77:0/109057280 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) v1 ==== 178+0+0 (secure 0 0 0) 0x7fa1fc0579f0 con 0x7fa20415d4b0 2023-11-04T01:41:18.020 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data_ec' removed 2023-11-04T01:41:18.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.022+0000 7fa20bd05640 1 -- 172.21.15.77:0/109057280 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa1e806ae70 msgr2=0x7fa1e806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:18.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.022+0000 7fa20bd05640 1 --2- 172.21.15.77:0/109057280 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa1e806ae70 0x7fa1e806d330 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa2040c8dc0 tx=0x7fa200008040 comp rx=0 tx=0).stop 2023-11-04T01:41:18.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.022+0000 7fa20bd05640 1 -- 172.21.15.77:0/109057280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa20415d4b0 msgr2=0x7fa2040cc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:18.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.022+0000 7fa20bd05640 1 --2- 172.21.15.77:0/109057280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa20415d4b0 0x7fa2040cc220 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00c6b0 tx=0x7fa1fc00cb70 comp rx=0 tx=0).stop 2023-11-04T01:41:18.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.022+0000 7fa20bd05640 1 -- 172.21.15.77:0/109057280 shutdown_connections 2023-11-04T01:41:18.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.022+0000 7fa20bd05640 1 --2- 172.21.15.77:0/109057280 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa1e806ae70 0x7fa1e806d330 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.022+0000 7fa20bd05640 1 --2- 172.21.15.77:0/109057280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa20415d4b0 0x7fa2040cc220 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.022+0000 7fa20bd05640 1 --2- 172.21.15.77:0/109057280 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa2040cd9f0 0x7fa2040ab500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.022+0000 7fa20bd05640 1 --2- 172.21.15.77:0/109057280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2040b47e0 0x7fa204157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.022+0000 7fa20bd05640 1 -- 172.21.15.77:0/109057280 >> 172.21.15.77:0/109057280 conn(0x7fa204071c40 msgr2=0x7fa20415c270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:18.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.022+0000 7fa20bd05640 1 -- 172.21.15.77:0/109057280 shutdown_connections 2023-11-04T01:41:18.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.023+0000 7fa20bd05640 1 -- 172.21.15.77:0/109057280 wait complete. 2023-11-04T01:41:18.037 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:41:18.037 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:41:18.038 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:41:18.038 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:41:18.039 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:41:18.039 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:41:18.039 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:41:18.040 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:41:18.040 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:41:18.040 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:41:18.041 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:41:18.041 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:41:18.041 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:41:18.042 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:41:18.042 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:41:18.043 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:41:18.050 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:41:18.050 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:41:18.051 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:41:18.051 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:41:18.053 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:41:18.053 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:41:18.054 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:41:18.055 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:41:18.093 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:41:18.093 DEBUG:teuthology.parallel:result is None 2023-11-04T01:41:18.094 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:41:18.095 DEBUG:teuthology.parallel:result is None 2023-11-04T01:41:18.097 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:41:18.098 DEBUG:teuthology.parallel:result is None 2023-11-04T01:41:18.099 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:41:18.100 DEBUG:teuthology.parallel:result is None 2023-11-04T01:41:18.101 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-04T01:41:18.172 INFO:tasks.ceph.mds.a.smithi077.stdout:starting mds.a at 2023-11-04T01:41:18.172 INFO:tasks.ceph.mds.c.smithi077.stdout:starting mds.c at 2023-11-04T01:41:18.179 INFO:tasks.ceph.mds.b.smithi122.stdout:starting mds.b at 2023-11-04T01:41:18.179 INFO:tasks.ceph.mds.d.smithi122.stdout:starting mds.d at 2023-11-04T01:41:18.180 INFO:tasks.ceph.mds.d.smithi122.stderr:2023-11-04T01:41:18.178+0000 7f9f37d46640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-11-04T01:41:18.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.208+0000 7f63dac51640 1 Processor -- start 2023-11-04T01:41:18.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.208+0000 7f63dac51640 1 -- start start 2023-11-04T01:41:18.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.209+0000 7f63dac51640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f63d4153e60 0x7f63d415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:18.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.209+0000 7f63dac51640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63d40cde60 con 0x7f63d40b4880 2023-11-04T01:41:18.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.209+0000 7f63dac51640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63d4160f90 con 0x7f63d40cd6d0 2023-11-04T01:41:18.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.209+0000 7f63d91ee640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f63d40b4880 0x7f63d40d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44220/0 (socket says 172.21.15.77:44220) 2023-11-04T01:41:18.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.209+0000 7f63d91ee640 1 -- 172.21.15.77:0/2385726885 learned_addr learned my addr 172.21.15.77:0/2385726885 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:18.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.209+0000 7f63dac51640 1 -- 172.21.15.77:0/2385726885 --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d415e400 con 0x7f63d4153e60 2023-11-04T01:41:18.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.209+0000 7f63d89ed640 1 --2- 172.21.15.77:0/2385726885 >> v2:172.21.15.122:3300/0 conn(0x7f63d4153e60 0x7f63d415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:18.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.209+0000 7f63d37fe640 1 -- 172.21.15.77:0/2385726885 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1956884996 0 0) 0x7f63d40cde60 con 0x7f63d40b4880 2023-11-04T01:41:18.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.209+0000 7f63d37fe640 1 -- 172.21.15.77:0/2385726885 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63c4003520 con 0x7f63d40b4880 2023-11-04T01:41:18.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.210+0000 7f63d37fe640 1 -- 172.21.15.77:0/2385726885 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3165039398 0 0) 0x7f63d4160f90 con 0x7f63d40cd6d0 2023-11-04T01:41:18.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.210+0000 7f63d37fe640 1 -- 172.21.15.77:0/2385726885 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63d40cde60 con 0x7f63d40cd6d0 2023-11-04T01:41:18.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.210+0000 7f63d37fe640 1 -- 172.21.15.77:0/2385726885 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1568227254 0 0) 0x7f63c4003520 con 0x7f63d40b4880 2023-11-04T01:41:18.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.210+0000 7f63d89ed640 1 -- 172.21.15.77:0/2385726885 >> v1:172.21.15.122:6789/0 conn(0x7f63d40cd6d0 legacy=0x7f63d4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:18.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.210+0000 7f63d89ed640 1 -- 172.21.15.77:0/2385726885 >> v1:172.21.15.77:6789/0 conn(0x7f63d40b4880 legacy=0x7f63d40d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:18.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.210+0000 7f63d89ed640 1 -- 172.21.15.77:0/2385726885 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d40ce090 con 0x7f63d4153e60 2023-11-04T01:41:18.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.210+0000 7f63d89ed640 1 --2- 172.21.15.77:0/2385726885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63d4153e60 0x7f63d415dec0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f63c80097a0 tx=0x7f63c802b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f309a9e632e3c26 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:18.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.211+0000 7f63d37fe640 1 -- 172.21.15.77:0/2385726885 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c802f050 con 0x7f63d4153e60 2023-11-04T01:41:18.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.211+0000 7f63d37fe640 1 -- 172.21.15.77:0/2385726885 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c8031500 con 0x7f63d4153e60 2023-11-04T01:41:18.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.211+0000 7f63d37fe640 1 -- 172.21.15.77:0/2385726885 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc0019f0 con 0x7f63d4153e60 2023-11-04T01:41:18.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.211+0000 7f63dac51640 1 -- 172.21.15.77:0/2385726885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63d4153e60 msgr2=0x7f63d415dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:18.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.211+0000 7f63dac51640 1 --2- 172.21.15.77:0/2385726885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63d4153e60 0x7f63d415dec0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f63c80097a0 tx=0x7f63c802b820 comp rx=0 tx=0).stop 2023-11-04T01:41:18.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.211+0000 7f63dac51640 1 -- 172.21.15.77:0/2385726885 shutdown_connections 2023-11-04T01:41:18.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.211+0000 7f63dac51640 1 --2- 172.21.15.77:0/2385726885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63d4153e60 0x7f63d415dec0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.211+0000 7f63dac51640 1 -- 172.21.15.77:0/2385726885 >> 172.21.15.77:0/2385726885 conn(0x7f63d40cf880 msgr2=0x7f63d40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:18.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.211+0000 7f63dac51640 1 -- 172.21.15.77:0/2385726885 shutdown_connections 2023-11-04T01:41:18.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.211+0000 7f63dac51640 1 -- 172.21.15.77:0/2385726885 wait complete. 2023-11-04T01:41:18.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.213+0000 7f63dac51640 1 Processor -- start 2023-11-04T01:41:18.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.213+0000 7f63dac51640 1 -- start start 2023-11-04T01:41:18.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.214+0000 7f63dac51640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63d40b4880 0x7f63d40cc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:18.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.214+0000 7f63dac51640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63d40cd6d0 0x7f63d4155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:18.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.214+0000 7f63dac51640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f63d4153e60 0x7f63d4152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:18.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.214+0000 7f63dac51640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d4154d00 con 0x7f63d40cd6d0 2023-11-04T01:41:18.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.214+0000 7f63dac51640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d40cce40 con 0x7f63d40b4880 2023-11-04T01:41:18.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.214+0000 7f63dac51640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d4152c50 con 0x7f63d4153e60 2023-11-04T01:41:18.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.214+0000 7f63d3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63d40cd6d0 0x7f63d4155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:18.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.214+0000 7f63d3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63d40cd6d0 0x7f63d4155120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40270/0 (socket says 172.21.15.77:40270) 2023-11-04T01:41:18.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.214+0000 7f63d3fff640 1 -- 172.21.15.77:0/211671755 learned_addr learned my addr 172.21.15.77:0/211671755 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:18.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.214+0000 7f63d89ed640 1 --2- 172.21.15.77:0/211671755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63d40b4880 0x7f63d40cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:18.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.214+0000 7f63d91ee640 1 --2- 172.21.15.77:0/211671755 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f63d4153e60 0x7f63d4152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:18.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.214+0000 7f63d3fff640 1 -- 172.21.15.77:0/211671755 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f63d4153e60 msgr2=0x7f63d4152220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:18.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.214+0000 7f63d3fff640 1 --2- 172.21.15.77:0/211671755 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f63d4153e60 0x7f63d4152220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.214+0000 7f63d3fff640 1 -- 172.21.15.77:0/211671755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63d40b4880 msgr2=0x7f63d40cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:18.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.214+0000 7f63d3fff640 1 --2- 172.21.15.77:0/211671755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63d40b4880 0x7f63d40cc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:18.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.214+0000 7f63d3fff640 1 -- 172.21.15.77:0/211671755 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c8009400 con 0x7f63d40cd6d0 2023-11-04T01:41:18.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.214+0000 7f63d91ee640 1 --2- 172.21.15.77:0/211671755 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f63d4153e60 0x7f63d4152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:18.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.214+0000 7f63d3fff640 1 --2- 172.21.15.77:0/211671755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63d40cd6d0 0x7f63d4155120 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f63c000c450 tx=0x7f63c000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:18.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.214+0000 7f63d17fa640 1 -- 172.21.15.77:0/211671755 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c00052d0 con 0x7f63d40cd6d0 2023-11-04T01:41:18.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.214+0000 7f63d17fa640 1 -- 172.21.15.77:0/211671755 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c0005430 con 0x7f63d40cd6d0 2023-11-04T01:41:18.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.214+0000 7f63dac51640 1 -- 172.21.15.77:0/211671755 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d4155660 con 0x7f63d40cd6d0 2023-11-04T01:41:18.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.214+0000 7f63d17fa640 1 -- 172.21.15.77:0/211671755 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c0012870 con 0x7f63d40cd6d0 2023-11-04T01:41:18.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.214+0000 7f63dac51640 1 -- 172.21.15.77:0/211671755 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d40cbee0 con 0x7f63d40cd6d0 2023-11-04T01:41:18.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.215+0000 7f63dac51640 1 -- 172.21.15.77:0/211671755 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63d4161400 con 0x7f63d40cd6d0 2023-11-04T01:41:18.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.216+0000 7f63d17fa640 1 -- 172.21.15.77:0/211671755 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f63c00129d0 con 0x7f63d40cd6d0 2023-11-04T01:41:18.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.216+0000 7f63d17fa640 1 --2- 172.21.15.77:0/211671755 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f63b806ae70 0x7f63b806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:18.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.216+0000 7f63d17fa640 1 -- 172.21.15.77:0/211671755 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f63c0088e80 con 0x7f63d40cd6d0 2023-11-04T01:41:18.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.216+0000 7f63d89ed640 1 --2- 172.21.15.77:0/211671755 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f63b806ae70 0x7f63b806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:18.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.217+0000 7f63d89ed640 1 --2- 172.21.15.77:0/211671755 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f63b806ae70 0x7f63b806d330 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f63c8035000 tx=0x7f63c8008030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:18.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.220+0000 7f63d17fa640 1 -- 172.21.15.77:0/211671755 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f63c0054240 con 0x7f63d40cd6d0 2023-11-04T01:41:18.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:18.397+0000 7f63dac51640 1 -- 172.21.15.77:0/211671755 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f63d4074290 con 0x7f63d40cd6d0 2023-11-04T01:41:19.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.033+0000 7f63d17fa640 1 -- 172.21.15.77:0/211671755 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) v1 ==== 97+0+0 (secure 0 0 0) 0x7f63c0057860 con 0x7f63d40cd6d0 2023-11-04T01:41:19.035 INFO:teuthology.orchestra.run.smithi077.stderr: removed all blocklist entries 2023-11-04T01:41:19.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.035+0000 7f63dac51640 1 -- 172.21.15.77:0/211671755 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f63b806ae70 msgr2=0x7f63b806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.035+0000 7f63dac51640 1 --2- 172.21.15.77:0/211671755 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f63b806ae70 0x7f63b806d330 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f63c8035000 tx=0x7f63c8008030 comp rx=0 tx=0).stop 2023-11-04T01:41:19.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.035+0000 7f63dac51640 1 -- 172.21.15.77:0/211671755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63d40cd6d0 msgr2=0x7f63d4155120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.035+0000 7f63dac51640 1 --2- 172.21.15.77:0/211671755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63d40cd6d0 0x7f63d4155120 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f63c000c450 tx=0x7f63c000c910 comp rx=0 tx=0).stop 2023-11-04T01:41:19.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.035+0000 7f63dac51640 1 -- 172.21.15.77:0/211671755 shutdown_connections 2023-11-04T01:41:19.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.035+0000 7f63dac51640 1 --2- 172.21.15.77:0/211671755 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f63b806ae70 0x7f63b806d330 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.035+0000 7f63dac51640 1 --2- 172.21.15.77:0/211671755 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f63d4153e60 0x7f63d4152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.035+0000 7f63dac51640 1 --2- 172.21.15.77:0/211671755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63d40cd6d0 0x7f63d4155120 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.035+0000 7f63dac51640 1 --2- 172.21.15.77:0/211671755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63d40b4880 0x7f63d40cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.035+0000 7f63dac51640 1 -- 172.21.15.77:0/211671755 >> 172.21.15.77:0/211671755 conn(0x7f63d40cf880 msgr2=0x7f63d40d24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:19.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.035+0000 7f63dac51640 1 -- 172.21.15.77:0/211671755 shutdown_connections 2023-11-04T01:41:19.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.035+0000 7f63dac51640 1 -- 172.21.15.77:0/211671755 wait complete. 2023-11-04T01:41:19.049 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-04T01:41:19.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.147+0000 7f241491d640 1 Processor -- start 2023-11-04T01:41:19.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.147+0000 7f241491d640 1 -- start start 2023-11-04T01:41:19.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.148+0000 7f241491d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f24100cce90 0x7f2410070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.148+0000 7f241491d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2410071500 con 0x7f24100b07f0 2023-11-04T01:41:19.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.148+0000 7f241491d640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24100717e0 con 0x7f241015cf30 2023-11-04T01:41:19.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.148+0000 7f241491d640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24100c9e00 con 0x7f24100cce90 2023-11-04T01:41:19.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.148+0000 7f240ed9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f24100b07f0 0x7f24100ca220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44230/0 (socket says 172.21.15.77:44230) 2023-11-04T01:41:19.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.148+0000 7f240ed9d640 1 -- 172.21.15.77:0/2016056827 learned_addr learned my addr 172.21.15.77:0/2016056827 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:19.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.148+0000 7f240dd9b640 1 --2- 172.21.15.77:0/2016056827 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f24100cce90 0x7f2410070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.148+0000 7f240d59a640 1 -- 172.21.15.77:0/2016056827 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 576491180 0 0) 0x7f2410071500 con 0x7f24100b07f0 2023-11-04T01:41:19.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.148+0000 7f240d59a640 1 -- 172.21.15.77:0/2016056827 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23f8003520 con 0x7f24100b07f0 2023-11-04T01:41:19.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.149+0000 7f240d59a640 1 -- 172.21.15.77:0/2016056827 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2971884015 0 0) 0x7f23f8003520 con 0x7f24100b07f0 2023-11-04T01:41:19.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.149+0000 7f240d59a640 1 -- 172.21.15.77:0/2016056827 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f24100cce90 msgr2=0x7f2410070bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:19.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.149+0000 7f240d59a640 1 --2- 172.21.15.77:0/2016056827 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f24100cce90 0x7f2410070bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.149+0000 7f240d59a640 1 -- 172.21.15.77:0/2016056827 >> v1:172.21.15.122:6789/0 conn(0x7f241015cf30 legacy=0x7f241006cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.149+0000 7f240d59a640 1 -- 172.21.15.77:0/2016056827 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2410071ac0 con 0x7f24100b07f0 2023-11-04T01:41:19.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.149+0000 7f240d59a640 1 -- 172.21.15.77:0/2016056827 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f24080019f0 con 0x7f24100b07f0 2023-11-04T01:41:19.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.149+0000 7f240d59a640 1 -- 172.21.15.77:0/2016056827 >> v1:172.21.15.77:6789/0 conn(0x7f24100b07f0 legacy=0x7f24100ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.149+0000 7f240d59a640 1 --2- 172.21.15.77:0/2016056827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23f80039a0 0x7f23f8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.149+0000 7f240d59a640 1 --2- 172.21.15.77:0/2016056827 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23f80047c0 0x7f23f8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.149+0000 7f240d59a640 1 --2- 172.21.15.77:0/2016056827 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f24100cce90 0x7f23f80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.149+0000 7f240d59a640 1 -- 172.21.15.77:0/2016056827 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24100c9e00 con 0x7f23f80039a0 2023-11-04T01:41:19.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.149+0000 7f240d59a640 1 -- 172.21.15.77:0/2016056827 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f800bae0 con 0x7f23f80047c0 2023-11-04T01:41:19.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.149+0000 7f240d59a640 1 -- 172.21.15.77:0/2016056827 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f800bca0 con 0x7f24100cce90 2023-11-04T01:41:19.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.149+0000 7f240e59c640 1 --2- 172.21.15.77:0/2016056827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23f80039a0 0x7f23f8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.149+0000 7f240dd9b640 1 --2- 172.21.15.77:0/2016056827 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23f80047c0 0x7f23f8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.149+0000 7f240ed9d640 1 --2- 172.21.15.77:0/2016056827 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f24100cce90 0x7f23f80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.149+0000 7f240e59c640 1 -- 172.21.15.77:0/2016056827 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f24100cce90 msgr2=0x7f23f80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:19.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.149+0000 7f240e59c640 1 --2- 172.21.15.77:0/2016056827 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f24100cce90 0x7f23f80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.149+0000 7f240e59c640 1 -- 172.21.15.77:0/2016056827 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23f80047c0 msgr2=0x7f23f8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:19.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.149+0000 7f240e59c640 1 --2- 172.21.15.77:0/2016056827 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23f80047c0 0x7f23f8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.149+0000 7f240e59c640 1 -- 172.21.15.77:0/2016056827 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f8003520 con 0x7f23f80039a0 2023-11-04T01:41:19.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.149+0000 7f240ed9d640 1 --2- 172.21.15.77:0/2016056827 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f24100cce90 0x7f23f80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:19.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.150+0000 7f240e59c640 1 --2- 172.21.15.77:0/2016056827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23f80039a0 0x7f23f8003dc0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2400001750 tx=0x7f23f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa08beb9a060970 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:19.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.150+0000 7f240d59a640 1 -- 172.21.15.77:0/2016056827 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24000052d0 con 0x7f23f80039a0 2023-11-04T01:41:19.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.150+0000 7f240d59a640 1 -- 172.21.15.77:0/2016056827 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240002e050 con 0x7f23f80039a0 2023-11-04T01:41:19.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.150+0000 7f240d59a640 1 -- 172.21.15.77:0/2016056827 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24000035f0 con 0x7f23f80039a0 2023-11-04T01:41:19.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.150+0000 7f241491d640 1 -- 172.21.15.77:0/2016056827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23f80039a0 msgr2=0x7f23f8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.150+0000 7f241491d640 1 --2- 172.21.15.77:0/2016056827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23f80039a0 0x7f23f8003dc0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2400001750 tx=0x7f23f80057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.150+0000 7f240ed9d640 1 -- 172.21.15.77:0/2016056827 reap_dead start 2023-11-04T01:41:19.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.151+0000 7f241491d640 1 -- 172.21.15.77:0/2016056827 shutdown_connections 2023-11-04T01:41:19.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.151+0000 7f241491d640 1 -- 172.21.15.77:0/2016056827 >> 172.21.15.77:0/2016056827 conn(0x7f24100cb7f0 msgr2=0x7f24100cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:19.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.151+0000 7f241491d640 1 -- 172.21.15.77:0/2016056827 shutdown_connections 2023-11-04T01:41:19.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.151+0000 7f241491d640 1 -- 172.21.15.77:0/2016056827 wait complete. 2023-11-04T01:41:19.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.152+0000 7f241491d640 1 Processor -- start 2023-11-04T01:41:19.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.152+0000 7f241491d640 1 -- start start 2023-11-04T01:41:19.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.153+0000 7f241491d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23f80039a0 0x7f24100b1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.153+0000 7f241491d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2410150f00 0x7f24100b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.153+0000 7f241491d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f24100b4440 0x7f24100aced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.153+0000 7f241491d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241015f400 con 0x7f2410150f00 2023-11-04T01:41:19.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.153+0000 7f241491d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241015eaa0 con 0x7f23f80039a0 2023-11-04T01:41:19.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.153+0000 7f241491d640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f241015ed40 con 0x7f24100b4440 2023-11-04T01:41:19.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.153+0000 7f240dd9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2410150f00 0x7f24100b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.153+0000 7f240dd9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2410150f00 0x7f24100b3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40286/0 (socket says 172.21.15.77:40286) 2023-11-04T01:41:19.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.153+0000 7f240dd9b640 1 -- 172.21.15.77:0/2232511356 learned_addr learned my addr 172.21.15.77:0/2232511356 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:19.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.153+0000 7f240ed9d640 1 --2- 172.21.15.77:0/2232511356 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f24100b4440 0x7f24100aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.153+0000 7f240e59c640 1 --2- 172.21.15.77:0/2232511356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23f80039a0 0x7f24100b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.153+0000 7f240dd9b640 1 -- 172.21.15.77:0/2232511356 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f24100b4440 msgr2=0x7f24100aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.153+0000 7f240dd9b640 1 --2- 172.21.15.77:0/2232511356 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f24100b4440 0x7f24100aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.153+0000 7f240dd9b640 1 -- 172.21.15.77:0/2232511356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23f80039a0 msgr2=0x7f24100b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.153+0000 7f240dd9b640 1 --2- 172.21.15.77:0/2232511356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23f80039a0 0x7f24100b1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.153+0000 7f240dd9b640 1 -- 172.21.15.77:0/2232511356 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f241015d490 con 0x7f2410150f00 2023-11-04T01:41:19.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.153+0000 7f240dd9b640 1 --2- 172.21.15.77:0/2232511356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2410150f00 0x7f24100b3f00 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f24040119a0 tx=0x7f2404011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:19.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.153+0000 7f23feffd640 1 -- 172.21.15.77:0/2232511356 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240400faf0 con 0x7f2410150f00 2023-11-04T01:41:19.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.153+0000 7f23feffd640 1 -- 172.21.15.77:0/2232511356 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240400fc50 con 0x7f2410150f00 2023-11-04T01:41:19.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.153+0000 7f241491d640 1 -- 172.21.15.77:0/2232511356 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f241015f020 con 0x7f2410150f00 2023-11-04T01:41:19.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.153+0000 7f23feffd640 1 -- 172.21.15.77:0/2232511356 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2404014440 con 0x7f2410150f00 2023-11-04T01:41:19.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.153+0000 7f241491d640 1 -- 172.21.15.77:0/2232511356 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2410151380 con 0x7f2410150f00 2023-11-04T01:41:19.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.154+0000 7f241491d640 1 -- 172.21.15.77:0/2232511356 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f241015f1b0 con 0x7f2410150f00 2023-11-04T01:41:19.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.155+0000 7f23feffd640 1 -- 172.21.15.77:0/2232511356 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f24040145a0 con 0x7f2410150f00 2023-11-04T01:41:19.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.155+0000 7f23feffd640 1 --2- 172.21.15.77:0/2232511356 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f23f006ae70 0x7f23f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.155+0000 7f23feffd640 1 -- 172.21.15.77:0/2232511356 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f2404089be0 con 0x7f2410150f00 2023-11-04T01:41:19.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.155+0000 7f240e59c640 1 --2- 172.21.15.77:0/2232511356 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f23f006ae70 0x7f23f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.156+0000 7f240e59c640 1 --2- 172.21.15.77:0/2232511356 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f23f006ae70 0x7f23f006d330 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2400033000 tx=0x7f2400009030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:19.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.159+0000 7f23feffd640 1 -- 172.21.15.77:0/2232511356 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2404054f30 con 0x7f2410150f00 2023-11-04T01:41:19.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.392+0000 7f241491d640 1 -- 172.21.15.77:0/2232511356 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2410074290 con 0x7f2410150f00 2023-11-04T01:41:19.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.392+0000 7f23feffd640 1 -- 172.21.15.77:0/2232511356 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v5) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f2404058550 con 0x7f2410150f00 2023-11-04T01:41:19.394 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:19.395 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-04T01:41:19.395 INFO:teuthology.orchestra.run.smithi077.stdout: "auth_dump": [ 2023-11-04T01:41:19.395 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:19.395 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.a", 2023-11-04T01:41:19.395 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC1oEVl/r6uOhAA9u5Hcsr4T+QfSgBmS6M2Cw==", 2023-11-04T01:41:19.396 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:19.396 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:41:19.396 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-04T01:41:19.396 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-04T01:41:19.396 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:41:19.397 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:19.397 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:19.397 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:19.397 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.b", 2023-11-04T01:41:19.397 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC2oEVlOr56CxAAxOke25BrKTy0Vozn/aPYVw==", 2023-11-04T01:41:19.398 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:19.398 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:41:19.398 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-04T01:41:19.398 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-04T01:41:19.399 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:41:19.399 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:19.399 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:19.399 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:19.399 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.c", 2023-11-04T01:41:19.400 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC2oEVlvLxtBhAAuxQpEPrSlVc/YBdqJJn7iA==", 2023-11-04T01:41:19.400 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:19.400 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:41:19.400 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-04T01:41:19.400 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-04T01:41:19.401 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:41:19.401 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:19.401 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:19.401 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:19.401 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.d", 2023-11-04T01:41:19.402 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC2oEVlB3PUEhAA0GaPLq/SwHPPHriYNnan9w==", 2023-11-04T01:41:19.402 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:19.402 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:41:19.402 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-04T01:41:19.402 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-04T01:41:19.403 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:41:19.403 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:19.403 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:19.403 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:19.403 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.0", 2023-11-04T01:41:19.404 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC5oEVl4pfcMxAATPwL4pgDM0ywnmsufp74lw==", 2023-11-04T01:41:19.404 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:19.404 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:41:19.404 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:41:19.404 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:41:19.405 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:19.405 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:19.405 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:19.405 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.1", 2023-11-04T01:41:19.405 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC8oEVl+qN4MhAAXZweqA2M4vvc4B04adonzQ==", 2023-11-04T01:41:19.406 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:19.406 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:41:19.406 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:41:19.406 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:41:19.406 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:19.407 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:19.407 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:19.407 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.2", 2023-11-04T01:41:19.407 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC/oEVlRuD4MBAAQPQL0SzC7Cj9bzR/Cj+maA==", 2023-11-04T01:41:19.407 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:19.408 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:41:19.408 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:41:19.408 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:41:19.408 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:19.408 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:19.409 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:19.409 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.3", 2023-11-04T01:41:19.409 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDCoEVlDO4fLxAASTTEpVp1dzEEci56OfSEMA==", 2023-11-04T01:41:19.409 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:19.409 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:41:19.410 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:41:19.410 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:41:19.410 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:19.410 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:19.410 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:19.411 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.4", 2023-11-04T01:41:19.411 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDIoEVlQGrxOBAACkSdOwyqhcMBPhXbpdXFKw==", 2023-11-04T01:41:19.411 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:19.411 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:41:19.411 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:41:19.412 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:41:19.412 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:19.412 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:19.412 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:19.412 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.5", 2023-11-04T01:41:19.413 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDLoEVlTrCoNhAAoLM/rpHPTO6H6eXr8so/pA==", 2023-11-04T01:41:19.413 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:19.413 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:41:19.413 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:41:19.413 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:41:19.413 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:19.414 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:19.414 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:19.414 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.6", 2023-11-04T01:41:19.414 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDOoEVlb81bNRAAp8gIPrPxc9T8yp9Z8JJm8g==", 2023-11-04T01:41:19.414 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:19.415 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:41:19.415 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:41:19.415 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:41:19.415 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:19.415 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:19.416 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:19.416 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.7", 2023-11-04T01:41:19.416 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDRoEVl2aM/NBAAbi6ZxsZ51qe78O1oaSpF8Q==", 2023-11-04T01:41:19.416 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:19.416 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:41:19.417 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:41:19.417 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:41:19.417 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:19.417 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:19.417 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:19.417 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.0", 2023-11-04T01:41:19.418 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC2oEVlChU2FxAAt1/aJZOrufjVZhraPqv1Gw==", 2023-11-04T01:41:19.418 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:19.418 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:41:19.418 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-11-04T01:41:19.418 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-11-04T01:41:19.419 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-11-04T01:41:19.419 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:19.419 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:19.419 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:19.419 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.1", 2023-11-04T01:41:19.420 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC2oEVlVY9FIBAAUiGoYvAgEDfoAKIJ9e/SOg==", 2023-11-04T01:41:19.420 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:19.420 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:41:19.420 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-11-04T01:41:19.420 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-11-04T01:41:19.421 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-11-04T01:41:19.421 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:19.421 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:19.421 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:19.421 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.2", 2023-11-04T01:41:19.421 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC2oEVliWLuHBAA7ElluXYK9/XvMXk4S1njJw==", 2023-11-04T01:41:19.422 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:19.422 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:41:19.422 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-11-04T01:41:19.422 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-11-04T01:41:19.422 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-11-04T01:41:19.423 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:19.423 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:19.423 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:19.423 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.3", 2023-11-04T01:41:19.423 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC2oEVlQ3QIJhAA5Fq/oI3qpJseGhwXV66eMA==", 2023-11-04T01:41:19.424 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:19.424 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:41:19.424 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-11-04T01:41:19.424 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-11-04T01:41:19.424 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-11-04T01:41:19.425 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:19.425 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:19.425 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:19.425 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.admin", 2023-11-04T01:41:19.425 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC1oEVlhrFGHhAA5nkKwuaaUv+zDDAG4XaBRQ==", 2023-11-04T01:41:19.425 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:19.426 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow *", 2023-11-04T01:41:19.426 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-04T01:41:19.426 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-04T01:41:19.426 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:41:19.427 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:19.427 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:19.427 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:19.427 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.bootstrap-mds", 2023-11-04T01:41:19.427 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDcoEVlSA44LxAAt7x9quKkJH6IBgv9sD/bjA==", 2023-11-04T01:41:19.428 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:19.428 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile bootstrap-mds" 2023-11-04T01:41:19.428 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:19.428 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:19.428 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:19.428 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.bootstrap-mgr", 2023-11-04T01:41:19.429 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDcoEVlWxc4LxAAi8e9GACBxxuqXAj/Mpmsig==", 2023-11-04T01:41:19.429 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:19.429 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-04T01:41:19.429 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:19.430 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:19.430 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:19.431 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.bootstrap-osd", 2023-11-04T01:41:19.431 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDcoEVl8B04LxAA4Tpe5pdjeWyQvri1eh4U7g==", 2023-11-04T01:41:19.431 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:19.431 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile bootstrap-osd" 2023-11-04T01:41:19.431 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:19.432 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:19.432 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:19.432 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.bootstrap-rbd", 2023-11-04T01:41:19.432 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDcoEVlfCk4LxAAvx2/3wWnLMuqkkBFazivDQ==", 2023-11-04T01:41:19.432 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:19.433 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-04T01:41:19.433 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:19.433 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:19.433 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:19.433 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-04T01:41:19.434 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDcoEVlqDI4LxAAmBrMZJUVmIr9TyisqclxBA==", 2023-11-04T01:41:19.434 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:19.434 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-04T01:41:19.434 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:19.434 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:19.434 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:19.435 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.bootstrap-rgw", 2023-11-04T01:41:19.435 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDcoEVlfDk4LxAA2+Bqp7M/E/d79SRSIs8duA==", 2023-11-04T01:41:19.435 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:19.435 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-04T01:41:19.435 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:19.437 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:19.437 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:19.437 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mgr.x", 2023-11-04T01:41:19.438 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC1oEVlvoNGNxAAB5/uyqV4Pf/HdyGcr8rVdw==", 2023-11-04T01:41:19.438 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:19.438 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow *", 2023-11-04T01:41:19.438 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile mgr", 2023-11-04T01:41:19.438 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:41:19.439 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:19.439 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:19.439 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:19.439 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mgr.y", 2023-11-04T01:41:19.439 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC1oEVlXDKNMxAAVhq0CA3RveLfU4A6oIO4jQ==", 2023-11-04T01:41:19.440 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:19.440 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow *", 2023-11-04T01:41:19.440 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile mgr", 2023-11-04T01:41:19.440 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:41:19.440 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:19.441 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:19.441 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2023-11-04T01:41:19.441 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-04T01:41:19.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.394+0000 7f241491d640 1 -- 172.21.15.77:0/2232511356 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f23f006ae70 msgr2=0x7f23f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.394+0000 7f241491d640 1 --2- 172.21.15.77:0/2232511356 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f23f006ae70 0x7f23f006d330 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2400033000 tx=0x7f2400009030 comp rx=0 tx=0).stop 2023-11-04T01:41:19.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.394+0000 7f241491d640 1 -- 172.21.15.77:0/2232511356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2410150f00 msgr2=0x7f24100b3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.394+0000 7f241491d640 1 --2- 172.21.15.77:0/2232511356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2410150f00 0x7f24100b3f00 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f24040119a0 tx=0x7f2404011e60 comp rx=0 tx=0).stop 2023-11-04T01:41:19.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.394+0000 7f241491d640 1 -- 172.21.15.77:0/2232511356 shutdown_connections 2023-11-04T01:41:19.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.394+0000 7f241491d640 1 --2- 172.21.15.77:0/2232511356 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f23f006ae70 0x7f23f006d330 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.394+0000 7f241491d640 1 --2- 172.21.15.77:0/2232511356 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f24100b4440 0x7f24100aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.394+0000 7f241491d640 1 --2- 172.21.15.77:0/2232511356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2410150f00 0x7f24100b3f00 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.394+0000 7f241491d640 1 --2- 172.21.15.77:0/2232511356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23f80039a0 0x7f24100b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.394+0000 7f241491d640 1 -- 172.21.15.77:0/2232511356 >> 172.21.15.77:0/2232511356 conn(0x7f24100cb7f0 msgr2=0x7f241006cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:19.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.394+0000 7f241491d640 1 -- 172.21.15.77:0/2232511356 shutdown_connections 2023-11-04T01:41:19.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.394+0000 7f241491d640 1 -- 172.21.15.77:0/2232511356 wait complete. 2023-11-04T01:41:19.445 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-04T01:41:19.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.544+0000 7f97faa0e640 1 Processor -- start 2023-11-04T01:41:19.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.544+0000 7f97faa0e640 1 -- start start 2023-11-04T01:41:19.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.545+0000 7f97faa0e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f97f415e430 0x7f97f40cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.545+0000 7f97faa0e640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f97f40cf160 0x7f97f40cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.545+0000 7f97faa0e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97f40d0280 con 0x7f97f40d0710 2023-11-04T01:41:19.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.545+0000 7f97faa0e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f40cf670 con 0x7f97f415e430 2023-11-04T01:41:19.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.545+0000 7f97faa0e640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f40cf950 con 0x7f97f40cf160 2023-11-04T01:41:19.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.545+0000 7f97f3fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f97f415e430 0x7f97f40cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.545+0000 7f97f8fab640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f97f40d0710 0x7f97f40b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44246/0 (socket says 172.21.15.77:44246) 2023-11-04T01:41:19.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.545+0000 7f97f3fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f97f415e430 0x7f97f40cec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40294/0 (socket says 172.21.15.77:40294) 2023-11-04T01:41:19.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.545+0000 7f97f8fab640 1 -- 172.21.15.77:0/3926044292 learned_addr learned my addr 172.21.15.77:0/3926044292 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:19.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.545+0000 7f97f37fe640 1 --2- 172.21.15.77:0/3926044292 >> v2:172.21.15.122:3300/0 conn(0x7f97f40cf160 0x7f97f40cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.546+0000 7f97f3fff640 1 -- 172.21.15.77:0/3926044292 >> v2:172.21.15.122:3300/0 conn(0x7f97f40cf160 msgr2=0x7f97f40cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:19.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.546+0000 7f97f3fff640 1 --2- 172.21.15.77:0/3926044292 >> v2:172.21.15.122:3300/0 conn(0x7f97f40cf160 0x7f97f40cd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.546+0000 7f97f3fff640 1 -- 172.21.15.77:0/3926044292 >> v1:172.21.15.77:6789/0 conn(0x7f97f40d0710 legacy=0x7f97f40b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.546+0000 7f97f3fff640 1 -- 172.21.15.77:0/3926044292 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f40cfc30 con 0x7f97f415e430 2023-11-04T01:41:19.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.546+0000 7f97f2ffd640 1 -- 172.21.15.77:0/3926044292 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2820992718 0 0) 0x7f97f40d0280 con 0x7f97f40d0710 2023-11-04T01:41:19.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.546+0000 7f97f3fff640 1 --2- 172.21.15.77:0/3926044292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97f415e430 0x7f97f40cec20 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f97f40cb3c0 tx=0x7f97e402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=600611435c97f11b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:19.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.547+0000 7f97f2ffd640 1 -- 172.21.15.77:0/3926044292 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e4031830 con 0x7f97f415e430 2023-11-04T01:41:19.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.547+0000 7f97f2ffd640 1 -- 172.21.15.77:0/3926044292 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e4031990 con 0x7f97f415e430 2023-11-04T01:41:19.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.547+0000 7f97f2ffd640 1 -- 172.21.15.77:0/3926044292 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e4031d20 con 0x7f97f415e430 2023-11-04T01:41:19.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.547+0000 7f97faa0e640 1 -- 172.21.15.77:0/3926044292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97f415e430 msgr2=0x7f97f40cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.547+0000 7f97faa0e640 1 --2- 172.21.15.77:0/3926044292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97f415e430 0x7f97f40cec20 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f97f40cb3c0 tx=0x7f97e402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.547+0000 7f97faa0e640 1 -- 172.21.15.77:0/3926044292 shutdown_connections 2023-11-04T01:41:19.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.547+0000 7f97faa0e640 1 --2- 172.21.15.77:0/3926044292 >> v2:172.21.15.122:3300/0 conn(0x7f97f40cf160 0x7f97f40cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.547+0000 7f97faa0e640 1 --2- 172.21.15.77:0/3926044292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97f415e430 0x7f97f40cec20 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.547+0000 7f97faa0e640 1 -- 172.21.15.77:0/3926044292 >> 172.21.15.77:0/3926044292 conn(0x7f97f406ea20 msgr2=0x7f97f406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:19.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.547+0000 7f97faa0e640 1 -- 172.21.15.77:0/3926044292 shutdown_connections 2023-11-04T01:41:19.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.547+0000 7f97faa0e640 1 -- 172.21.15.77:0/3926044292 wait complete. 2023-11-04T01:41:19.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.548+0000 7f97faa0e640 1 Processor -- start 2023-11-04T01:41:19.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.548+0000 7f97faa0e640 1 -- start start 2023-11-04T01:41:19.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.549+0000 7f97faa0e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97f40cf160 0x7f97f40aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.549+0000 7f97faa0e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97f40d0710 0x7f97f40d0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.549+0000 7f97faa0e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97f415e430 0x7f97f40d10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.549+0000 7f97faa0e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f40af3e0 con 0x7f97f415e430 2023-11-04T01:41:19.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.549+0000 7f97faa0e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f41f1250 con 0x7f97f40d0710 2023-11-04T01:41:19.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.549+0000 7f97faa0e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f414a860 con 0x7f97f40cf160 2023-11-04T01:41:19.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.549+0000 7f97f8fab640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97f415e430 0x7f97f40d10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.549+0000 7f97f8fab640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97f415e430 0x7f97f40d10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40306/0 (socket says 172.21.15.77:40306) 2023-11-04T01:41:19.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.549+0000 7f97f8fab640 1 -- 172.21.15.77:0/542335535 learned_addr learned my addr 172.21.15.77:0/542335535 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:19.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.549+0000 7f97f37fe640 1 --2- 172.21.15.77:0/542335535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97f40d0710 0x7f97f40d0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.549+0000 7f97f3fff640 1 --2- 172.21.15.77:0/542335535 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97f40cf160 0x7f97f40aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.549+0000 7f97f8fab640 1 -- 172.21.15.77:0/542335535 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97f40cf160 msgr2=0x7f97f40aeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.549+0000 7f97f8fab640 1 --2- 172.21.15.77:0/542335535 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97f40cf160 0x7f97f40aeea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.549+0000 7f97f8fab640 1 -- 172.21.15.77:0/542335535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97f40d0710 msgr2=0x7f97f40d0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.549+0000 7f97f8fab640 1 --2- 172.21.15.77:0/542335535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97f40d0710 0x7f97f40d0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.550+0000 7f97f8fab640 1 -- 172.21.15.77:0/542335535 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e4009400 con 0x7f97f415e430 2023-11-04T01:41:19.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.550+0000 7f97f8fab640 1 --2- 172.21.15.77:0/542335535 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97f415e430 0x7f97f40d10e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f97ec001560 tx=0x7f97ec00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:19.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.550+0000 7f97f0ff9640 1 -- 172.21.15.77:0/542335535 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ec00a640 con 0x7f97f415e430 2023-11-04T01:41:19.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.550+0000 7f97f0ff9640 1 -- 172.21.15.77:0/542335535 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97ec00a7a0 con 0x7f97f415e430 2023-11-04T01:41:19.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.550+0000 7f97faa0e640 1 -- 172.21.15.77:0/542335535 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f414ab40 con 0x7f97f415e430 2023-11-04T01:41:19.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.550+0000 7f97f0ff9640 1 -- 172.21.15.77:0/542335535 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ec00ab30 con 0x7f97f415e430 2023-11-04T01:41:19.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.550+0000 7f97faa0e640 1 -- 172.21.15.77:0/542335535 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f414b100 con 0x7f97f415e430 2023-11-04T01:41:19.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.551+0000 7f97faa0e640 1 -- 172.21.15.77:0/542335535 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f414b320 con 0x7f97f415e430 2023-11-04T01:41:19.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.551+0000 7f97f0ff9640 1 -- 172.21.15.77:0/542335535 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f97ec00ac90 con 0x7f97f415e430 2023-11-04T01:41:19.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.552+0000 7f97f0ff9640 1 --2- 172.21.15.77:0/542335535 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f97e006ae70 0x7f97e006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.552+0000 7f97f0ff9640 1 -- 172.21.15.77:0/542335535 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f97ec088bf0 con 0x7f97f415e430 2023-11-04T01:41:19.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.552+0000 7f97f3fff640 1 --2- 172.21.15.77:0/542335535 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f97e006ae70 0x7f97e006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.552+0000 7f97f3fff640 1 --2- 172.21.15.77:0/542335535 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f97e006ae70 0x7f97e006d330 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f97e4036000 tx=0x7f97e403c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:19.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.556+0000 7f97f0ff9640 1 -- 172.21.15.77:0/542335535 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f97ec053f60 con 0x7f97f415e430 2023-11-04T01:41:19.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.787+0000 7f97faa0e640 1 -- 172.21.15.77:0/542335535 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f97f4074290 con 0x7f97f415e430 2023-11-04T01:41:19.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.789+0000 7f97f0ff9640 1 -- 172.21.15.77:0/542335535 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f97ec018020 con 0x7f97f415e430 2023-11-04T01:41:19.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.791+0000 7f97faa0e640 1 -- 172.21.15.77:0/542335535 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f97e006ae70 msgr2=0x7f97e006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.791+0000 7f97faa0e640 1 --2- 172.21.15.77:0/542335535 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f97e006ae70 0x7f97e006d330 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f97e4036000 tx=0x7f97e403c040 comp rx=0 tx=0).stop 2023-11-04T01:41:19.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.791+0000 7f97faa0e640 1 -- 172.21.15.77:0/542335535 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97f415e430 msgr2=0x7f97f40d10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.791+0000 7f97faa0e640 1 --2- 172.21.15.77:0/542335535 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97f415e430 0x7f97f40d10e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f97ec001560 tx=0x7f97ec00cc70 comp rx=0 tx=0).stop 2023-11-04T01:41:19.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.791+0000 7f97faa0e640 1 -- 172.21.15.77:0/542335535 shutdown_connections 2023-11-04T01:41:19.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.791+0000 7f97faa0e640 1 --2- 172.21.15.77:0/542335535 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f97e006ae70 0x7f97e006d330 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.791+0000 7f97faa0e640 1 --2- 172.21.15.77:0/542335535 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97f415e430 0x7f97f40d10e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.791+0000 7f97faa0e640 1 --2- 172.21.15.77:0/542335535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97f40d0710 0x7f97f40d0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.791+0000 7f97faa0e640 1 --2- 172.21.15.77:0/542335535 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97f40cf160 0x7f97f40aeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.791+0000 7f97faa0e640 1 -- 172.21.15.77:0/542335535 >> 172.21.15.77:0/542335535 conn(0x7f97f406ea20 msgr2=0x7f97f40b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:19.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.791+0000 7f97faa0e640 1 -- 172.21.15.77:0/542335535 shutdown_connections 2023-11-04T01:41:19.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.791+0000 7f97faa0e640 1 -- 172.21.15.77:0/542335535 wait complete. 2023-11-04T01:41:19.803 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-04T01:41:19.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.902+0000 7f99c7f55640 1 Processor -- start 2023-11-04T01:41:19.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.902+0000 7f99c7f55640 1 -- start start 2023-11-04T01:41:19.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.903+0000 7f99c7f55640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f99c00d0710 0x7f99c00cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.903+0000 7f99c7f55640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99c00d0280 con 0x7f99c00cda50 2023-11-04T01:41:19.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.903+0000 7f99c7f55640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99c00cf670 con 0x7f99c015e430 2023-11-04T01:41:19.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.903+0000 7f99c7f55640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99c00cf950 con 0x7f99c00d0710 2023-11-04T01:41:19.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.903+0000 7f99c64f2640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f99c00cda50 0x7f99c00b3d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44248/0 (socket says 172.21.15.77:44248) 2023-11-04T01:41:19.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.903+0000 7f99c64f2640 1 -- 172.21.15.77:0/2224021450 learned_addr learned my addr 172.21.15.77:0/2224021450 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:19.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.904+0000 7f99c54f0640 1 --2- 172.21.15.77:0/2224021450 >> v2:172.21.15.122:3300/0 conn(0x7f99c00d0710 0x7f99c00cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.904+0000 7f99c4cef640 1 -- 172.21.15.77:0/2224021450 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2839526783 0 0) 0x7f99c00d0280 con 0x7f99c00cda50 2023-11-04T01:41:19.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.904+0000 7f99c4cef640 1 -- 172.21.15.77:0/2224021450 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99ac003520 con 0x7f99c00cda50 2023-11-04T01:41:19.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.904+0000 7f99c4cef640 1 -- 172.21.15.77:0/2224021450 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 635504839 0 0) 0x7f99ac003520 con 0x7f99c00cda50 2023-11-04T01:41:19.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.904+0000 7f99c4cef640 1 -- 172.21.15.77:0/2224021450 >> v2:172.21.15.122:3300/0 conn(0x7f99c00d0710 msgr2=0x7f99c00cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:19.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.904+0000 7f99c4cef640 1 --2- 172.21.15.77:0/2224021450 >> v2:172.21.15.122:3300/0 conn(0x7f99c00d0710 0x7f99c00cd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.904+0000 7f99c4cef640 1 -- 172.21.15.77:0/2224021450 >> v1:172.21.15.122:6789/0 conn(0x7f99c015e430 legacy=0x7f99c00cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.904+0000 7f99c4cef640 1 -- 172.21.15.77:0/2224021450 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c00cfc30 con 0x7f99c00cda50 2023-11-04T01:41:19.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.904+0000 7f99c4cef640 1 -- 172.21.15.77:0/2224021450 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f99b8001670 con 0x7f99c00cda50 2023-11-04T01:41:19.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.904+0000 7f99c4cef640 1 -- 172.21.15.77:0/2224021450 >> v1:172.21.15.77:6789/0 conn(0x7f99c00cda50 legacy=0x7f99c00b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.904+0000 7f99c4cef640 1 --2- 172.21.15.77:0/2224021450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99ac003970 0x7f99ac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.904+0000 7f99c4cef640 1 --2- 172.21.15.77:0/2224021450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99ac0047c0 0x7f99ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.904+0000 7f99c4cef640 1 --2- 172.21.15.77:0/2224021450 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f99ac005180 0x7f99ac00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.904+0000 7f99c4cef640 1 -- 172.21.15.77:0/2224021450 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c00cf950 con 0x7f99ac003970 2023-11-04T01:41:19.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.904+0000 7f99c4cef640 1 -- 172.21.15.77:0/2224021450 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac00c020 con 0x7f99ac0047c0 2023-11-04T01:41:19.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.904+0000 7f99c4cef640 1 -- 172.21.15.77:0/2224021450 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac00c1e0 con 0x7f99ac005180 2023-11-04T01:41:19.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.904+0000 7f99c5cf1640 1 --2- 172.21.15.77:0/2224021450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99ac003970 0x7f99ac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.904+0000 7f99c54f0640 1 --2- 172.21.15.77:0/2224021450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99ac0047c0 0x7f99ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.904+0000 7f99c64f2640 1 --2- 172.21.15.77:0/2224021450 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f99ac005180 0x7f99ac00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.904+0000 7f99c5cf1640 1 -- 172.21.15.77:0/2224021450 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f99ac005180 msgr2=0x7f99ac00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:19.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.904+0000 7f99c5cf1640 1 --2- 172.21.15.77:0/2224021450 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f99ac005180 0x7f99ac00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.904+0000 7f99c5cf1640 1 -- 172.21.15.77:0/2224021450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99ac0047c0 msgr2=0x7f99ac004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:19.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.904+0000 7f99c5cf1640 1 --2- 172.21.15.77:0/2224021450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99ac0047c0 0x7f99ac004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.904+0000 7f99c5cf1640 1 -- 172.21.15.77:0/2224021450 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ac003520 con 0x7f99ac003970 2023-11-04T01:41:19.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.904+0000 7f99c64f2640 1 -- 172.21.15.77:0/2224021450 reap_dead start 2023-11-04T01:41:19.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.904+0000 7f99c54f0640 1 --2- 172.21.15.77:0/2224021450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99ac0047c0 0x7f99ac004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:19.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.905+0000 7f99c5cf1640 1 --2- 172.21.15.77:0/2224021450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99ac003970 0x7f99ac003d90 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f99bc001e50 tx=0x7f99ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=118ce42f2b7e563d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:19.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.905+0000 7f99c4cef640 1 -- 172.21.15.77:0/2224021450 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc003b70 con 0x7f99ac003970 2023-11-04T01:41:19.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.905+0000 7f99c4cef640 1 -- 172.21.15.77:0/2224021450 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99bc003cd0 con 0x7f99ac003970 2023-11-04T01:41:19.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.905+0000 7f99c4cef640 1 -- 172.21.15.77:0/2224021450 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc005310 con 0x7f99ac003970 2023-11-04T01:41:19.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.906+0000 7f99c7f55640 1 -- 172.21.15.77:0/2224021450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99ac003970 msgr2=0x7f99ac003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.906+0000 7f99c7f55640 1 --2- 172.21.15.77:0/2224021450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99ac003970 0x7f99ac003d90 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f99bc001e50 tx=0x7f99ac0057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.906+0000 7f99c7f55640 1 -- 172.21.15.77:0/2224021450 shutdown_connections 2023-11-04T01:41:19.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.906+0000 7f99c7f55640 1 --2- 172.21.15.77:0/2224021450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99ac003970 0x7f99ac003d90 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.906+0000 7f99c7f55640 1 -- 172.21.15.77:0/2224021450 >> 172.21.15.77:0/2224021450 conn(0x7f99c006ea20 msgr2=0x7f99c006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:19.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.906+0000 7f99c7f55640 1 -- 172.21.15.77:0/2224021450 shutdown_connections 2023-11-04T01:41:19.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.906+0000 7f99c7f55640 1 -- 172.21.15.77:0/2224021450 wait complete. 2023-11-04T01:41:19.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.907+0000 7f99c7f55640 1 Processor -- start 2023-11-04T01:41:19.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.907+0000 7f99c7f55640 1 -- start start 2023-11-04T01:41:19.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.908+0000 7f99c7f55640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99ac003970 0x7f99c0151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.908+0000 7f99c7f55640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99c00b2470 0x7f99c00b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.908+0000 7f99c7f55640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f99c00b4d30 0x7f99c00b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.908+0000 7f99c7f55640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c00b56f0 con 0x7f99c00b2470 2023-11-04T01:41:19.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.908+0000 7f99c7f55640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c006d1a0 con 0x7f99ac003970 2023-11-04T01:41:19.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.908+0000 7f99c7f55640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c00b2ff0 con 0x7f99c00b4d30 2023-11-04T01:41:19.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.908+0000 7f99c54f0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99c00b2470 0x7f99c00b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.908+0000 7f99c54f0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99c00b2470 0x7f99c00b28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40324/0 (socket says 172.21.15.77:40324) 2023-11-04T01:41:19.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.908+0000 7f99c54f0640 1 -- 172.21.15.77:0/4261158261 learned_addr learned my addr 172.21.15.77:0/4261158261 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:19.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.908+0000 7f99c54f0640 1 -- 172.21.15.77:0/4261158261 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f99c00b4d30 msgr2=0x7f99c00b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.908+0000 7f99c54f0640 1 --2- 172.21.15.77:0/4261158261 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f99c00b4d30 0x7f99c00b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.908+0000 7f99c54f0640 1 -- 172.21.15.77:0/4261158261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99ac003970 msgr2=0x7f99c0151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:19.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.908+0000 7f99c54f0640 1 --2- 172.21.15.77:0/4261158261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99ac003970 0x7f99c0151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:19.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.908+0000 7f99c54f0640 1 -- 172.21.15.77:0/4261158261 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c00b32d0 con 0x7f99c00b2470 2023-11-04T01:41:19.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.908+0000 7f99c54f0640 1 --2- 172.21.15.77:0/4261158261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99c00b2470 0x7f99c00b28f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f99b00114e0 tx=0x7f99b00119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:19.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.908+0000 7f99b67fc640 1 -- 172.21.15.77:0/4261158261 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b0015870 con 0x7f99c00b2470 2023-11-04T01:41:19.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.908+0000 7f99b67fc640 1 -- 172.21.15.77:0/4261158261 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b00159d0 con 0x7f99c00b2470 2023-11-04T01:41:19.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.908+0000 7f99c7f55640 1 -- 172.21.15.77:0/4261158261 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99c00c7d10 con 0x7f99c00b2470 2023-11-04T01:41:19.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.908+0000 7f99b67fc640 1 -- 172.21.15.77:0/4261158261 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b0015d80 con 0x7f99c00b2470 2023-11-04T01:41:19.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.908+0000 7f99c7f55640 1 -- 172.21.15.77:0/4261158261 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c00c82d0 con 0x7f99c00b2470 2023-11-04T01:41:19.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.909+0000 7f99c7f55640 1 -- 172.21.15.77:0/4261158261 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99c0074290 con 0x7f99c00b2470 2023-11-04T01:41:19.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.910+0000 7f99b67fc640 1 -- 172.21.15.77:0/4261158261 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f99b001d400 con 0x7f99c00b2470 2023-11-04T01:41:19.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.910+0000 7f99b67fc640 1 --2- 172.21.15.77:0/4261158261 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f99a406ae70 0x7f99a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:19.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.910+0000 7f99b67fc640 1 -- 172.21.15.77:0/4261158261 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f99b0089ad0 con 0x7f99c00b2470 2023-11-04T01:41:19.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.911+0000 7f99c5cf1640 1 --2- 172.21.15.77:0/4261158261 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f99a406ae70 0x7f99a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:19.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.911+0000 7f99c5cf1640 1 --2- 172.21.15.77:0/4261158261 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f99a406ae70 0x7f99a406d330 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f99bc034000 tx=0x7f99bc030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:19.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:19.914+0000 7f99b67fc640 1 -- 172.21.15.77:0/4261158261 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f99b0054d90 con 0x7f99c00b2470 2023-11-04T01:41:20.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.144+0000 7f99c7f55640 1 -- 172.21.15.77:0/4261158261 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f99c00c7930 con 0x7f99c00b2470 2023-11-04T01:41:20.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.146+0000 7f99b67fc640 1 -- 172.21.15.77:0/4261158261 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f99b00220a0 con 0x7f99c00b2470 2023-11-04T01:41:20.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.148+0000 7f99c7f55640 1 -- 172.21.15.77:0/4261158261 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f99a406ae70 msgr2=0x7f99a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:20.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.148+0000 7f99c7f55640 1 --2- 172.21.15.77:0/4261158261 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f99a406ae70 0x7f99a406d330 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f99bc034000 tx=0x7f99bc030000 comp rx=0 tx=0).stop 2023-11-04T01:41:20.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.148+0000 7f99c7f55640 1 -- 172.21.15.77:0/4261158261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99c00b2470 msgr2=0x7f99c00b28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:20.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.148+0000 7f99c7f55640 1 --2- 172.21.15.77:0/4261158261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99c00b2470 0x7f99c00b28f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f99b00114e0 tx=0x7f99b00119a0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.148+0000 7f99c7f55640 1 -- 172.21.15.77:0/4261158261 shutdown_connections 2023-11-04T01:41:20.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.148+0000 7f99c7f55640 1 --2- 172.21.15.77:0/4261158261 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f99a406ae70 0x7f99a406d330 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.148+0000 7f99c7f55640 1 --2- 172.21.15.77:0/4261158261 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f99c00b4d30 0x7f99c00b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.148+0000 7f99c7f55640 1 --2- 172.21.15.77:0/4261158261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99c00b2470 0x7f99c00b28f0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.148+0000 7f99c7f55640 1 --2- 172.21.15.77:0/4261158261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99ac003970 0x7f99c0151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.148+0000 7f99c7f55640 1 -- 172.21.15.77:0/4261158261 >> 172.21.15.77:0/4261158261 conn(0x7f99c006ea20 msgr2=0x7f99c00ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:20.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.148+0000 7f99c7f55640 1 -- 172.21.15.77:0/4261158261 shutdown_connections 2023-11-04T01:41:20.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.148+0000 7f99c7f55640 1 -- 172.21.15.77:0/4261158261 wait complete. 2023-11-04T01:41:20.160 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-04T01:41:20.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.260+0000 7f397a85d640 1 Processor -- start 2023-11-04T01:41:20.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.260+0000 7f397a85d640 1 -- start start 2023-11-04T01:41:20.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.261+0000 7f397a85d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f397415d1b0 0x7f39740cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:20.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.261+0000 7f397a85d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3974066000 0x7f397406a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:20.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.261+0000 7f397a85d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39740c9bf0 con 0x7f3974070ff0 2023-11-04T01:41:20.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.261+0000 7f397a85d640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39740cd890 con 0x7f397415d1b0 2023-11-04T01:41:20.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.261+0000 7f397a85d640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39740cdb30 con 0x7f3974066000 2023-11-04T01:41:20.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.261+0000 7f3973fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f3974070ff0 0x7f39740713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44258/0 (socket says 172.21.15.77:44258) 2023-11-04T01:41:20.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.261+0000 7f3973fff640 1 -- 172.21.15.77:0/394566130 learned_addr learned my addr 172.21.15.77:0/394566130 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:20.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.262+0000 7f3972ffd640 1 -- 172.21.15.77:0/394566130 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 562237225 0 0) 0x7f39740c9bf0 con 0x7f3974070ff0 2023-11-04T01:41:20.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.262+0000 7f3972ffd640 1 -- 172.21.15.77:0/394566130 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f395c003520 con 0x7f3974070ff0 2023-11-04T01:41:20.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.262+0000 7f3978dfa640 1 --2- 172.21.15.77:0/394566130 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3974066000 0x7f397406a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:20.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.262+0000 7f39737fe640 1 --2- 172.21.15.77:0/394566130 >> v2:172.21.15.122:3300/0 conn(0x7f397415d1b0 0x7f39740cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:20.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.262+0000 7f3972ffd640 1 -- 172.21.15.77:0/394566130 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2118971764 0 0) 0x7f395c003520 con 0x7f3974070ff0 2023-11-04T01:41:20.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.262+0000 7f3972ffd640 1 -- 172.21.15.77:0/394566130 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3974066000 msgr2=0x7f397406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:20.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.262+0000 7f3972ffd640 1 --2- 172.21.15.77:0/394566130 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3974066000 0x7f397406a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.262+0000 7f3972ffd640 1 -- 172.21.15.77:0/394566130 >> v2:172.21.15.122:3300/0 conn(0x7f397415d1b0 msgr2=0x7f39740cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:20.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.262+0000 7f3972ffd640 1 --2- 172.21.15.77:0/394566130 >> v2:172.21.15.122:3300/0 conn(0x7f397415d1b0 0x7f39740cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.262+0000 7f3972ffd640 1 -- 172.21.15.77:0/394566130 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39740cde10 con 0x7f3974070ff0 2023-11-04T01:41:20.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.262+0000 7f3972ffd640 1 -- 172.21.15.77:0/394566130 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f3964001670 con 0x7f3974070ff0 2023-11-04T01:41:20.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.262+0000 7f3978dfa640 1 --2- 172.21.15.77:0/394566130 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3974066000 0x7f397406a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:20.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.262+0000 7f3972ffd640 1 -- 172.21.15.77:0/394566130 >> v1:172.21.15.77:6789/0 conn(0x7f3974070ff0 legacy=0x7f39740713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:20.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.262+0000 7f3972ffd640 1 --2- 172.21.15.77:0/394566130 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3974066000 0x7f395c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:20.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.262+0000 7f3972ffd640 1 --2- 172.21.15.77:0/394566130 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f395c003f60 0x7f395c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:20.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.262+0000 7f3972ffd640 1 --2- 172.21.15.77:0/394566130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f395c004d00 0x7f395c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:20.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.262+0000 7f3972ffd640 1 -- 172.21.15.77:0/394566130 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39740cd890 con 0x7f395c004d00 2023-11-04T01:41:20.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.262+0000 7f3972ffd640 1 -- 172.21.15.77:0/394566130 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39740cdb30 con 0x7f395c003f60 2023-11-04T01:41:20.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.262+0000 7f3972ffd640 1 -- 172.21.15.77:0/394566130 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f395c00ba60 con 0x7f3974066000 2023-11-04T01:41:20.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.262+0000 7f3978dfa640 1 --2- 172.21.15.77:0/394566130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f395c004d00 0x7f395c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:20.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.262+0000 7f3973fff640 1 --2- 172.21.15.77:0/394566130 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3974066000 0x7f395c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:20.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.262+0000 7f39737fe640 1 --2- 172.21.15.77:0/394566130 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f395c003f60 0x7f395c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:20.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.262+0000 7f3978dfa640 1 -- 172.21.15.77:0/394566130 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3974066000 msgr2=0x7f395c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:20.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.262+0000 7f3978dfa640 1 --2- 172.21.15.77:0/394566130 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3974066000 0x7f395c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.262+0000 7f3978dfa640 1 -- 172.21.15.77:0/394566130 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f395c003f60 msgr2=0x7f395c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:20.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.262+0000 7f3978dfa640 1 --2- 172.21.15.77:0/394566130 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f395c003f60 0x7f395c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.262+0000 7f3978dfa640 1 -- 172.21.15.77:0/394566130 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f395c003520 con 0x7f395c004d00 2023-11-04T01:41:20.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.263+0000 7f3978dfa640 1 --2- 172.21.15.77:0/394566130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f395c004d00 0x7f395c005180 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f396c0073e0 tx=0x7f395c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a18ccc093f1e4880 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:20.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.263+0000 7f3972ffd640 1 -- 172.21.15.77:0/394566130 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396c02cd30 con 0x7f395c004d00 2023-11-04T01:41:20.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.263+0000 7f3972ffd640 1 -- 172.21.15.77:0/394566130 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f396c02ce90 con 0x7f395c004d00 2023-11-04T01:41:20.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.263+0000 7f3972ffd640 1 -- 172.21.15.77:0/394566130 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396c034640 con 0x7f395c004d00 2023-11-04T01:41:20.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.264+0000 7f397a85d640 1 -- 172.21.15.77:0/394566130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f395c004d00 msgr2=0x7f395c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:20.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.264+0000 7f397a85d640 1 --2- 172.21.15.77:0/394566130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f395c004d00 0x7f395c005180 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f396c0073e0 tx=0x7f395c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.264+0000 7f3978dfa640 1 -- 172.21.15.77:0/394566130 reap_dead start 2023-11-04T01:41:20.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.264+0000 7f397a85d640 1 -- 172.21.15.77:0/394566130 shutdown_connections 2023-11-04T01:41:20.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.264+0000 7f397a85d640 1 -- 172.21.15.77:0/394566130 >> 172.21.15.77:0/394566130 conn(0x7f39740cbc90 msgr2=0x7f39740cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:20.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.264+0000 7f397a85d640 1 -- 172.21.15.77:0/394566130 shutdown_connections 2023-11-04T01:41:20.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.264+0000 7f397a85d640 1 -- 172.21.15.77:0/394566130 wait complete. 2023-11-04T01:41:20.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.265+0000 7f397a85d640 1 Processor -- start 2023-11-04T01:41:20.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.265+0000 7f397a85d640 1 -- start start 2023-11-04T01:41:20.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.266+0000 7f397a85d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39740c4e20 0x7f39740c6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:20.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.266+0000 7f397a85d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39740c5200 0x7f39740c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:20.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.266+0000 7f397a85d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39741515b0 0x7f3974151a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:20.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.266+0000 7f397a85d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39740b2d80 con 0x7f39740c4e20 2023-11-04T01:41:20.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.266+0000 7f397a85d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39740c7e50 con 0x7f39740c5200 2023-11-04T01:41:20.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.266+0000 7f397a85d640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3974151f80 con 0x7f39741515b0 2023-11-04T01:41:20.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.266+0000 7f3973fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39740c4e20 0x7f39740c6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:20.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.266+0000 7f3973fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39740c4e20 0x7f39740c6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40340/0 (socket says 172.21.15.77:40340) 2023-11-04T01:41:20.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.266+0000 7f3973fff640 1 -- 172.21.15.77:0/493586545 learned_addr learned my addr 172.21.15.77:0/493586545 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:20.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.266+0000 7f3978dfa640 1 --2- 172.21.15.77:0/493586545 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39741515b0 0x7f3974151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:20.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.266+0000 7f39737fe640 1 --2- 172.21.15.77:0/493586545 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39740c5200 0x7f39740c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:20.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.266+0000 7f3973fff640 1 -- 172.21.15.77:0/493586545 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39741515b0 msgr2=0x7f3974151a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:20.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.266+0000 7f3973fff640 1 --2- 172.21.15.77:0/493586545 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39741515b0 0x7f3974151a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.266+0000 7f3973fff640 1 -- 172.21.15.77:0/493586545 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39740c5200 msgr2=0x7f39740c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:20.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.266+0000 7f3973fff640 1 --2- 172.21.15.77:0/493586545 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39740c5200 0x7f39740c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.266+0000 7f3973fff640 1 -- 172.21.15.77:0/493586545 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39740c72d0 con 0x7f39740c4e20 2023-11-04T01:41:20.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.266+0000 7f39737fe640 1 --2- 172.21.15.77:0/493586545 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39740c5200 0x7f39740c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:20.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.266+0000 7f3973fff640 1 --2- 172.21.15.77:0/493586545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39740c4e20 0x7f39740c6cf0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f39640072c0 tx=0x7f3964007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:20.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.266+0000 7f3970ff9640 1 -- 172.21.15.77:0/493586545 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396400f9c0 con 0x7f39740c4e20 2023-11-04T01:41:20.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.267+0000 7f3970ff9640 1 -- 172.21.15.77:0/493586545 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f396400fb40 con 0x7f39740c4e20 2023-11-04T01:41:20.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.267+0000 7f397a85d640 1 -- 172.21.15.77:0/493586545 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39740c75b0 con 0x7f39740c4e20 2023-11-04T01:41:20.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.267+0000 7f3970ff9640 1 -- 172.21.15.77:0/493586545 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39640133f0 con 0x7f39740c4e20 2023-11-04T01:41:20.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.267+0000 7f397a85d640 1 -- 172.21.15.77:0/493586545 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39740c7b70 con 0x7f39740c4e20 2023-11-04T01:41:20.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.267+0000 7f397a85d640 1 -- 172.21.15.77:0/493586545 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3974074290 con 0x7f39740c4e20 2023-11-04T01:41:20.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.268+0000 7f3970ff9640 1 -- 172.21.15.77:0/493586545 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3964013550 con 0x7f39740c4e20 2023-11-04T01:41:20.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.268+0000 7f3970ff9640 1 --2- 172.21.15.77:0/493586545 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f396006ae70 0x7f396006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:20.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.268+0000 7f3970ff9640 1 -- 172.21.15.77:0/493586545 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f39640895e0 con 0x7f39740c4e20 2023-11-04T01:41:20.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.269+0000 7f39737fe640 1 --2- 172.21.15.77:0/493586545 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f396006ae70 0x7f396006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:20.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.269+0000 7f39737fe640 1 --2- 172.21.15.77:0/493586545 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f396006ae70 0x7f396006d330 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f39740c5df0 tx=0x7f3968008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:20.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.273+0000 7f3970ff9640 1 -- 172.21.15.77:0/493586545 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f39640548a0 con 0x7f39740c4e20 2023-11-04T01:41:20.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.500+0000 7f397a85d640 1 -- 172.21.15.77:0/493586545 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f397406d920 con 0x7f39740c4e20 2023-11-04T01:41:20.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.502+0000 7f3970ff9640 1 -- 172.21.15.77:0/493586545 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3964007b90 con 0x7f39740c4e20 2023-11-04T01:41:20.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.504+0000 7f397a85d640 1 -- 172.21.15.77:0/493586545 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f396006ae70 msgr2=0x7f396006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:20.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.504+0000 7f397a85d640 1 --2- 172.21.15.77:0/493586545 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f396006ae70 0x7f396006d330 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f39740c5df0 tx=0x7f3968008040 comp rx=0 tx=0).stop 2023-11-04T01:41:20.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.504+0000 7f397a85d640 1 -- 172.21.15.77:0/493586545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39740c4e20 msgr2=0x7f39740c6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:20.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.504+0000 7f397a85d640 1 --2- 172.21.15.77:0/493586545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39740c4e20 0x7f39740c6cf0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f39640072c0 tx=0x7f3964007780 comp rx=0 tx=0).stop 2023-11-04T01:41:20.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.504+0000 7f397a85d640 1 -- 172.21.15.77:0/493586545 shutdown_connections 2023-11-04T01:41:20.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.504+0000 7f397a85d640 1 --2- 172.21.15.77:0/493586545 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f396006ae70 0x7f396006d330 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.504+0000 7f397a85d640 1 --2- 172.21.15.77:0/493586545 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39741515b0 0x7f3974151a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.504+0000 7f397a85d640 1 --2- 172.21.15.77:0/493586545 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39740c5200 0x7f39740c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.504+0000 7f397a85d640 1 --2- 172.21.15.77:0/493586545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39740c4e20 0x7f39740c6cf0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.504+0000 7f397a85d640 1 -- 172.21.15.77:0/493586545 >> 172.21.15.77:0/493586545 conn(0x7f39740cbc90 msgr2=0x7f397406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:20.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.504+0000 7f397a85d640 1 -- 172.21.15.77:0/493586545 shutdown_connections 2023-11-04T01:41:20.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.504+0000 7f397a85d640 1 -- 172.21.15.77:0/493586545 wait complete. 2023-11-04T01:41:20.516 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-04T01:41:20.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.616+0000 7f80fb632640 1 Processor -- start 2023-11-04T01:41:20.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.616+0000 7f80fb632640 1 -- start start 2023-11-04T01:41:20.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.617+0000 7f80fb632640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f80f4159c00 0x7f80f40cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:20.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.617+0000 7f80fb632640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f80f40c48e0 0x7f80f40c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:20.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.617+0000 7f80fb632640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f415aff0 con 0x7f80f40adac0 2023-11-04T01:41:20.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.617+0000 7f80fb632640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80f40c52d0 con 0x7f80f4159c00 2023-11-04T01:41:20.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.617+0000 7f80fb632640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80f415a3e0 con 0x7f80f40c48e0 2023-11-04T01:41:20.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.617+0000 7f80f93ce640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f80f4159c00 0x7f80f40cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:20.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.617+0000 7f80f9bcf640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f80f40adac0 0x7f80f40adea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44274/0 (socket says 172.21.15.77:44274) 2023-11-04T01:41:20.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.617+0000 7f80f9bcf640 1 -- 172.21.15.77:0/1192784723 learned_addr learned my addr 172.21.15.77:0/1192784723 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:20.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.617+0000 7f80f93ce640 1 -- 172.21.15.77:0/1192784723 >> v2:172.21.15.122:3300/0 conn(0x7f80f40c48e0 msgr2=0x7f80f40c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:20.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.617+0000 7f80f93ce640 1 --2- 172.21.15.77:0/1192784723 >> v2:172.21.15.122:3300/0 conn(0x7f80f40c48e0 0x7f80f40c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.617+0000 7f80f93ce640 1 -- 172.21.15.77:0/1192784723 >> v1:172.21.15.77:6789/0 conn(0x7f80f40adac0 legacy=0x7f80f40adea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:20.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.617+0000 7f80f93ce640 1 -- 172.21.15.77:0/1192784723 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f415a6c0 con 0x7f80f4159c00 2023-11-04T01:41:20.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.618+0000 7f80f93ce640 1 --2- 172.21.15.77:0/1192784723 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80f4159c00 0x7f80f40cc890 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f80f406ebb0 tx=0x7f80ec02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c95826124f0a831 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:20.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.618+0000 7f80ebfff640 1 -- 172.21.15.77:0/1192784723 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec02cbf0 con 0x7f80f4159c00 2023-11-04T01:41:20.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.618+0000 7f80ebfff640 1 -- 172.21.15.77:0/1192784723 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ec02cd50 con 0x7f80f4159c00 2023-11-04T01:41:20.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.618+0000 7f80ebfff640 1 -- 172.21.15.77:0/1192784723 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec034660 con 0x7f80f4159c00 2023-11-04T01:41:20.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.619+0000 7f80fb632640 1 -- 172.21.15.77:0/1192784723 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80f4159c00 msgr2=0x7f80f40cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:20.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.619+0000 7f80fb632640 1 --2- 172.21.15.77:0/1192784723 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80f4159c00 0x7f80f40cc890 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f80f406ebb0 tx=0x7f80ec02be40 comp rx=0 tx=0).stop 2023-11-04T01:41:20.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.619+0000 7f80fb632640 1 -- 172.21.15.77:0/1192784723 shutdown_connections 2023-11-04T01:41:20.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.619+0000 7f80fb632640 1 --2- 172.21.15.77:0/1192784723 >> v2:172.21.15.122:3300/0 conn(0x7f80f40c48e0 0x7f80f40c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.619+0000 7f80fb632640 1 --2- 172.21.15.77:0/1192784723 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80f4159c00 0x7f80f40cc890 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.619+0000 7f80fb632640 1 -- 172.21.15.77:0/1192784723 >> 172.21.15.77:0/1192784723 conn(0x7f80f40ce950 msgr2=0x7f80f40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:20.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.619+0000 7f80fb632640 1 -- 172.21.15.77:0/1192784723 shutdown_connections 2023-11-04T01:41:20.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.619+0000 7f80fb632640 1 -- 172.21.15.77:0/1192784723 wait complete. 2023-11-04T01:41:20.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.620+0000 7f80fb632640 1 Processor -- start 2023-11-04T01:41:20.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.620+0000 7f80fb632640 1 -- start start 2023-11-04T01:41:20.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.621+0000 7f80fb632640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80f40adac0 0x7f80f414c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:20.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.621+0000 7f80fb632640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80f40c48e0 0x7f80f414c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:20.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.621+0000 7f80fb632640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80f4159c00 0x7f80f413f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:20.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.621+0000 7f80fb632640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f413cfa0 con 0x7f80f4159c00 2023-11-04T01:41:20.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.621+0000 7f80fb632640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f414e4f0 con 0x7f80f40adac0 2023-11-04T01:41:20.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.621+0000 7f80fb632640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f414dac0 con 0x7f80f40c48e0 2023-11-04T01:41:20.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.621+0000 7f80f9bcf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80f4159c00 0x7f80f413f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:20.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.621+0000 7f80f9bcf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80f4159c00 0x7f80f413f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40352/0 (socket says 172.21.15.77:40352) 2023-11-04T01:41:20.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.621+0000 7f80f9bcf640 1 -- 172.21.15.77:0/3002389439 learned_addr learned my addr 172.21.15.77:0/3002389439 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:20.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.621+0000 7f80f9bcf640 1 -- 172.21.15.77:0/3002389439 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80f40c48e0 msgr2=0x7f80f414c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:20.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.621+0000 7f80f9bcf640 1 --2- 172.21.15.77:0/3002389439 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80f40c48e0 0x7f80f414c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.621+0000 7f80f9bcf640 1 -- 172.21.15.77:0/3002389439 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80f40adac0 msgr2=0x7f80f414c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:20.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.621+0000 7f80f9bcf640 1 --2- 172.21.15.77:0/3002389439 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80f40adac0 0x7f80f414c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.621+0000 7f80f9bcf640 1 -- 172.21.15.77:0/3002389439 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ec009a70 con 0x7f80f4159c00 2023-11-04T01:41:20.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.621+0000 7f80f9bcf640 1 --2- 172.21.15.77:0/3002389439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80f4159c00 0x7f80f413f270 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f80f000c450 tx=0x7f80f000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:20.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.621+0000 7f80e9ffb640 1 -- 172.21.15.77:0/3002389439 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0005ce0 con 0x7f80f4159c00 2023-11-04T01:41:20.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.621+0000 7f80e9ffb640 1 -- 172.21.15.77:0/3002389439 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f0005e40 con 0x7f80f4159c00 2023-11-04T01:41:20.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.621+0000 7f80fb632640 1 -- 172.21.15.77:0/3002389439 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f414ceb0 con 0x7f80f4159c00 2023-11-04T01:41:20.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.621+0000 7f80e9ffb640 1 -- 172.21.15.77:0/3002389439 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0007270 con 0x7f80f4159c00 2023-11-04T01:41:20.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.622+0000 7f80fb632640 1 -- 172.21.15.77:0/3002389439 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f414d470 con 0x7f80f4159c00 2023-11-04T01:41:20.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.622+0000 7f80fb632640 1 -- 172.21.15.77:0/3002389439 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80f4074290 con 0x7f80f4159c00 2023-11-04T01:41:20.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.623+0000 7f80e9ffb640 1 -- 172.21.15.77:0/3002389439 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f80f00073d0 con 0x7f80f4159c00 2023-11-04T01:41:20.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.623+0000 7f80e9ffb640 1 --2- 172.21.15.77:0/3002389439 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f80d806ae70 0x7f80d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:20.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.623+0000 7f80e9ffb640 1 -- 172.21.15.77:0/3002389439 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f80f0088770 con 0x7f80f4159c00 2023-11-04T01:41:20.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.624+0000 7f80f93ce640 1 --2- 172.21.15.77:0/3002389439 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f80d806ae70 0x7f80d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:20.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.624+0000 7f80f93ce640 1 --2- 172.21.15.77:0/3002389439 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f80d806ae70 0x7f80d806d330 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f80ec036000 tx=0x7f80ec02e000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:20.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.627+0000 7f80e9ffb640 1 -- 172.21.15.77:0/3002389439 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f80f0053ae0 con 0x7f80f4159c00 2023-11-04T01:41:20.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.854+0000 7f80fb632640 1 -- 172.21.15.77:0/3002389439 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f80f414dc30 con 0x7f80f4159c00 2023-11-04T01:41:20.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.856+0000 7f80e9ffb640 1 -- 172.21.15.77:0/3002389439 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f80f00170a0 con 0x7f80f4159c00 2023-11-04T01:41:20.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.858+0000 7f80fb632640 1 -- 172.21.15.77:0/3002389439 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f80d806ae70 msgr2=0x7f80d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:20.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.858+0000 7f80fb632640 1 --2- 172.21.15.77:0/3002389439 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f80d806ae70 0x7f80d806d330 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f80ec036000 tx=0x7f80ec02e000 comp rx=0 tx=0).stop 2023-11-04T01:41:20.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.858+0000 7f80fb632640 1 -- 172.21.15.77:0/3002389439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80f4159c00 msgr2=0x7f80f413f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:20.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.858+0000 7f80fb632640 1 --2- 172.21.15.77:0/3002389439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80f4159c00 0x7f80f413f270 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f80f000c450 tx=0x7f80f000c910 comp rx=0 tx=0).stop 2023-11-04T01:41:20.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.858+0000 7f80fb632640 1 -- 172.21.15.77:0/3002389439 shutdown_connections 2023-11-04T01:41:20.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.858+0000 7f80fb632640 1 --2- 172.21.15.77:0/3002389439 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f80d806ae70 0x7f80d806d330 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.858+0000 7f80fb632640 1 --2- 172.21.15.77:0/3002389439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80f4159c00 0x7f80f413f270 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.858+0000 7f80fb632640 1 --2- 172.21.15.77:0/3002389439 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f80f40c48e0 0x7f80f414c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.858+0000 7f80fb632640 1 --2- 172.21.15.77:0/3002389439 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80f40adac0 0x7f80f414c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.858+0000 7f80fb632640 1 -- 172.21.15.77:0/3002389439 >> 172.21.15.77:0/3002389439 conn(0x7f80f40ce950 msgr2=0x7f80f40c37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:20.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.858+0000 7f80fb632640 1 -- 172.21.15.77:0/3002389439 shutdown_connections 2023-11-04T01:41:20.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.858+0000 7f80fb632640 1 -- 172.21.15.77:0/3002389439 wait complete. 2023-11-04T01:41:20.870 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-04T01:41:20.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.972+0000 7fcde9d9e640 1 Processor -- start 2023-11-04T01:41:20.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.972+0000 7fcde9d9e640 1 -- start start 2023-11-04T01:41:20.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.973+0000 7fcde9d9e640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fcde40cb690 0x7fcde4165920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:20.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.973+0000 7fcde9d9e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcde415af00 con 0x7fcde40afe70 2023-11-04T01:41:20.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.973+0000 7fcde9d9e640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcde415eec0 con 0x7fcde415ab20 2023-11-04T01:41:20.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.973+0000 7fcde9d9e640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcde40cfa20 con 0x7fcde40cb690 2023-11-04T01:41:20.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.973+0000 7fcde3fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fcde40afe70 0x7fcde40caf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44280/0 (socket says 172.21.15.77:44280) 2023-11-04T01:41:20.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.973+0000 7fcde3fff640 1 -- 172.21.15.77:0/3827286078 learned_addr learned my addr 172.21.15.77:0/3827286078 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:20.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.974+0000 7fcde959d640 1 --2- 172.21.15.77:0/3827286078 >> v2:172.21.15.122:3300/0 conn(0x7fcde40cb690 0x7fcde4165920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:20.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.974+0000 7fcde37fe640 1 -- 172.21.15.77:0/3827286078 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2448905576 0 0) 0x7fcde415af00 con 0x7fcde40afe70 2023-11-04T01:41:20.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.974+0000 7fcde37fe640 1 -- 172.21.15.77:0/3827286078 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdcc003520 con 0x7fcde40afe70 2023-11-04T01:41:20.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.974+0000 7fcde37fe640 1 -- 172.21.15.77:0/3827286078 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3972125019 0 0) 0x7fcdcc003520 con 0x7fcde40afe70 2023-11-04T01:41:20.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.974+0000 7fcde37fe640 1 -- 172.21.15.77:0/3827286078 >> v2:172.21.15.122:3300/0 conn(0x7fcde40cb690 msgr2=0x7fcde4165920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:20.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.974+0000 7fcde37fe640 1 --2- 172.21.15.77:0/3827286078 >> v2:172.21.15.122:3300/0 conn(0x7fcde40cb690 0x7fcde4165920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.974+0000 7fcde37fe640 1 -- 172.21.15.77:0/3827286078 >> v1:172.21.15.122:6789/0 conn(0x7fcde415ab20 legacy=0x7fcde40af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:20.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.974+0000 7fcde37fe640 1 -- 172.21.15.77:0/3827286078 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde40cbc40 con 0x7fcde40afe70 2023-11-04T01:41:20.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.974+0000 7fcde37fe640 1 -- 172.21.15.77:0/3827286078 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7fcdd8001670 con 0x7fcde40afe70 2023-11-04T01:41:20.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.974+0000 7fcde959d640 1 --2- 172.21.15.77:0/3827286078 >> v2:172.21.15.122:3300/0 conn(0x7fcde40cb690 0x7fcde4165920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:41:20.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.974+0000 7fcde37fe640 1 -- 172.21.15.77:0/3827286078 >> v1:172.21.15.77:6789/0 conn(0x7fcde40afe70 legacy=0x7fcde40caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:20.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.974+0000 7fcde37fe640 1 --2- 172.21.15.77:0/3827286078 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcdcc003970 0x7fcdcc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:20.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.974+0000 7fcde37fe640 1 --2- 172.21.15.77:0/3827286078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdcc0047c0 0x7fcdcc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:20.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.974+0000 7fcde37fe640 1 --2- 172.21.15.77:0/3827286078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcdcc005180 0x7fcdcc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:20.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.974+0000 7fcde37fe640 1 -- 172.21.15.77:0/3827286078 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde40cfa20 con 0x7fcdcc0047c0 2023-11-04T01:41:20.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.974+0000 7fcde37fe640 1 -- 172.21.15.77:0/3827286078 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc00c120 con 0x7fcdcc005180 2023-11-04T01:41:20.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.974+0000 7fcde37fe640 1 -- 172.21.15.77:0/3827286078 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc00c2e0 con 0x7fcdcc003970 2023-11-04T01:41:20.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.974+0000 7fcde3fff640 1 --2- 172.21.15.77:0/3827286078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdcc0047c0 0x7fcdcc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:20.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.974+0000 7fcde8d9c640 1 --2- 172.21.15.77:0/3827286078 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcdcc003970 0x7fcdcc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:20.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.974+0000 7fcde959d640 1 --2- 172.21.15.77:0/3827286078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcdcc005180 0x7fcdcc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:20.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.974+0000 7fcde3fff640 1 -- 172.21.15.77:0/3827286078 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcdcc003970 msgr2=0x7fcdcc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:20.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.974+0000 7fcde3fff640 1 --2- 172.21.15.77:0/3827286078 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcdcc003970 0x7fcdcc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.974+0000 7fcde3fff640 1 -- 172.21.15.77:0/3827286078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcdcc005180 msgr2=0x7fcdcc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:20.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.974+0000 7fcde3fff640 1 --2- 172.21.15.77:0/3827286078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcdcc005180 0x7fcdcc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.974+0000 7fcde959d640 1 -- 172.21.15.77:0/3827286078 reap_dead start 2023-11-04T01:41:20.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.974+0000 7fcde3fff640 1 -- 172.21.15.77:0/3827286078 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdcc003520 con 0x7fcdcc0047c0 2023-11-04T01:41:20.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.975+0000 7fcde3fff640 1 --2- 172.21.15.77:0/3827286078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdcc0047c0 0x7fcdcc004c40 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fcdd800c240 tx=0x7fcdcc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d5992b531fe019 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:20.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.975+0000 7fcde37fe640 1 -- 172.21.15.77:0/3827286078 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd8005ad0 con 0x7fcdcc0047c0 2023-11-04T01:41:20.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.975+0000 7fcde37fe640 1 -- 172.21.15.77:0/3827286078 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd8005c30 con 0x7fcdcc0047c0 2023-11-04T01:41:20.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.975+0000 7fcde37fe640 1 -- 172.21.15.77:0/3827286078 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd802ca90 con 0x7fcdcc0047c0 2023-11-04T01:41:20.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.976+0000 7fcde9d9e640 1 -- 172.21.15.77:0/3827286078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdcc0047c0 msgr2=0x7fcdcc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:20.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.976+0000 7fcde9d9e640 1 --2- 172.21.15.77:0/3827286078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdcc0047c0 0x7fcdcc004c40 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fcdd800c240 tx=0x7fcdcc0057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.976+0000 7fcde9d9e640 1 -- 172.21.15.77:0/3827286078 shutdown_connections 2023-11-04T01:41:20.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.976+0000 7fcde9d9e640 1 --2- 172.21.15.77:0/3827286078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdcc0047c0 0x7fcdcc004c40 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.976+0000 7fcde9d9e640 1 -- 172.21.15.77:0/3827286078 >> 172.21.15.77:0/3827286078 conn(0x7fcde40cd3b0 msgr2=0x7fcde40cd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:20.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.976+0000 7fcde9d9e640 1 -- 172.21.15.77:0/3827286078 shutdown_connections 2023-11-04T01:41:20.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.976+0000 7fcde9d9e640 1 -- 172.21.15.77:0/3827286078 wait complete. 2023-11-04T01:41:20.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.977+0000 7fcde9d9e640 1 Processor -- start 2023-11-04T01:41:20.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.977+0000 7fcde9d9e640 1 -- start start 2023-11-04T01:41:20.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.978+0000 7fcde9d9e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdcc0047c0 0x7fcde41f06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:20.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.978+0000 7fcde9d9e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcde40c7dc0 0x7fcde40c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:20.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.978+0000 7fcde9d9e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcde4157550 0x7fcde4157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:20.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.978+0000 7fcde9d9e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde4157f40 con 0x7fcdcc0047c0 2023-11-04T01:41:20.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.978+0000 7fcde9d9e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde41f1040 con 0x7fcde4157550 2023-11-04T01:41:20.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.978+0000 7fcde9d9e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde41f1320 con 0x7fcde40c7dc0 2023-11-04T01:41:20.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.978+0000 7fcde8d9c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdcc0047c0 0x7fcde41f06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:20.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.978+0000 7fcde8d9c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdcc0047c0 0x7fcde41f06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40370/0 (socket says 172.21.15.77:40370) 2023-11-04T01:41:20.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.978+0000 7fcde8d9c640 1 -- 172.21.15.77:0/1788723112 learned_addr learned my addr 172.21.15.77:0/1788723112 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:20.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.978+0000 7fcde3fff640 1 --2- 172.21.15.77:0/1788723112 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcde40c7dc0 0x7fcde40c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:20.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.978+0000 7fcde959d640 1 --2- 172.21.15.77:0/1788723112 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcde4157550 0x7fcde4157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:20.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.978+0000 7fcde8d9c640 1 -- 172.21.15.77:0/1788723112 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcde40c7dc0 msgr2=0x7fcde40c85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:20.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.978+0000 7fcde8d9c640 1 --2- 172.21.15.77:0/1788723112 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcde40c7dc0 0x7fcde40c85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.978+0000 7fcde8d9c640 1 -- 172.21.15.77:0/1788723112 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcde4157550 msgr2=0x7fcde4157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:20.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.978+0000 7fcde8d9c640 1 --2- 172.21.15.77:0/1788723112 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcde4157550 0x7fcde4157a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:20.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.978+0000 7fcde8d9c640 1 -- 172.21.15.77:0/1788723112 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde41f1600 con 0x7fcdcc0047c0 2023-11-04T01:41:20.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.978+0000 7fcde959d640 1 --2- 172.21.15.77:0/1788723112 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcde4157550 0x7fcde4157a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:20.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.979+0000 7fcde8d9c640 1 --2- 172.21.15.77:0/1788723112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdcc0047c0 0x7fcde41f06f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fcdd400f5f0 tx=0x7fcdd400fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:20.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.979+0000 7fcde17fa640 1 -- 172.21.15.77:0/1788723112 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd40052e0 con 0x7fcdcc0047c0 2023-11-04T01:41:20.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.979+0000 7fcde17fa640 1 -- 172.21.15.77:0/1788723112 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd4005440 con 0x7fcdcc0047c0 2023-11-04T01:41:20.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.979+0000 7fcde9d9e640 1 -- 172.21.15.77:0/1788723112 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcde415bff0 con 0x7fcdcc0047c0 2023-11-04T01:41:20.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.979+0000 7fcde17fa640 1 -- 172.21.15.77:0/1788723112 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4003810 con 0x7fcdcc0047c0 2023-11-04T01:41:20.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.979+0000 7fcde9d9e640 1 -- 172.21.15.77:0/1788723112 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde41f0c30 con 0x7fcdcc0047c0 2023-11-04T01:41:20.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.980+0000 7fcde9d9e640 1 -- 172.21.15.77:0/1788723112 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcde41f0dc0 con 0x7fcdcc0047c0 2023-11-04T01:41:20.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.980+0000 7fcde17fa640 1 -- 172.21.15.77:0/1788723112 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcdd4003970 con 0x7fcdcc0047c0 2023-11-04T01:41:20.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.980+0000 7fcde17fa640 1 --2- 172.21.15.77:0/1788723112 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcdd006aea0 0x7fcdd006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:20.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.980+0000 7fcde17fa640 1 -- 172.21.15.77:0/1788723112 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fcdd4089280 con 0x7fcdcc0047c0 2023-11-04T01:41:20.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.981+0000 7fcde3fff640 1 --2- 172.21.15.77:0/1788723112 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcdd006aea0 0x7fcdd006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:20.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.981+0000 7fcde3fff640 1 --2- 172.21.15.77:0/1788723112 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcdd006aea0 0x7fcdd006d360 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8034000 tx=0x7fcdd8009030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:20.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:20.984+0000 7fcde17fa640 1 -- 172.21.15.77:0/1788723112 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcdd4054540 con 0x7fcdcc0047c0 2023-11-04T01:41:21.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.214+0000 7fcde9d9e640 1 -- 172.21.15.77:0/1788723112 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fcde404ece0 con 0x7fcdcc0047c0 2023-11-04T01:41:21.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.216+0000 7fcde17fa640 1 -- 172.21.15.77:0/1788723112 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v10) v1 ==== 97+0+0 (secure 0 0 0) 0x7fcdd4057b60 con 0x7fcdcc0047c0 2023-11-04T01:41:21.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.218+0000 7fcde9d9e640 1 -- 172.21.15.77:0/1788723112 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcdd006aea0 msgr2=0x7fcdd006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:21.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.218+0000 7fcde9d9e640 1 --2- 172.21.15.77:0/1788723112 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcdd006aea0 0x7fcdd006d360 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8034000 tx=0x7fcdd8009030 comp rx=0 tx=0).stop 2023-11-04T01:41:21.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.218+0000 7fcde9d9e640 1 -- 172.21.15.77:0/1788723112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdcc0047c0 msgr2=0x7fcde41f06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:21.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.218+0000 7fcde9d9e640 1 --2- 172.21.15.77:0/1788723112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdcc0047c0 0x7fcde41f06f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fcdd400f5f0 tx=0x7fcdd400fab0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.218+0000 7fcde9d9e640 1 -- 172.21.15.77:0/1788723112 shutdown_connections 2023-11-04T01:41:21.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.218+0000 7fcde9d9e640 1 --2- 172.21.15.77:0/1788723112 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcdd006aea0 0x7fcdd006d360 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.218+0000 7fcde9d9e640 1 --2- 172.21.15.77:0/1788723112 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcde4157550 0x7fcde4157a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.218+0000 7fcde9d9e640 1 --2- 172.21.15.77:0/1788723112 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcde40c7dc0 0x7fcde40c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.218+0000 7fcde9d9e640 1 --2- 172.21.15.77:0/1788723112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdcc0047c0 0x7fcde41f06f0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.218+0000 7fcde9d9e640 1 -- 172.21.15.77:0/1788723112 >> 172.21.15.77:0/1788723112 conn(0x7fcde40cd3b0 msgr2=0x7fcde4159ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:21.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.219+0000 7fcde9d9e640 1 -- 172.21.15.77:0/1788723112 shutdown_connections 2023-11-04T01:41:21.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.219+0000 7fcde9d9e640 1 -- 172.21.15.77:0/1788723112 wait complete. 2023-11-04T01:41:21.231 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-04T01:41:21.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.329+0000 7feb5adc7640 1 Processor -- start 2023-11-04T01:41:21.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.329+0000 7feb5adc7640 1 -- start start 2023-11-04T01:41:21.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.329+0000 7feb5adc7640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feb5415ad30 0x7feb540adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:21.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.329+0000 7feb5adc7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7feb54070e20 0x7feb5415e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:21.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.329+0000 7feb5adc7640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb540c3900 con 0x7feb540ad730 2023-11-04T01:41:21.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.329+0000 7feb5adc7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb540ae260 con 0x7feb54070e20 2023-11-04T01:41:21.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.329+0000 7feb5adc7640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb540c3be0 con 0x7feb5415ad30 2023-11-04T01:41:21.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.330+0000 7feb59364640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7feb54070e20 0x7feb5415e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:21.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.330+0000 7feb59364640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7feb54070e20 0x7feb5415e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40382/0 (socket says 172.21.15.77:40382) 2023-11-04T01:41:21.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.330+0000 7feb59364640 1 -- 172.21.15.77:0/2693661544 learned_addr learned my addr 172.21.15.77:0/2693661544 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:21.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.330+0000 7feb58b63640 1 --2- 172.21.15.77:0/2693661544 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feb5415ad30 0x7feb540adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:21.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.330+0000 7feb59364640 1 -- 172.21.15.77:0/2693661544 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feb5415ad30 msgr2=0x7feb540adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:21.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.330+0000 7feb59364640 1 --2- 172.21.15.77:0/2693661544 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feb5415ad30 0x7feb540adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.330+0000 7feb59364640 1 -- 172.21.15.77:0/2693661544 >> v1:172.21.15.122:6789/0 conn(0x7feb540ad730 legacy=0x7feb54070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:21.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.330+0000 7feb59364640 1 -- 172.21.15.77:0/2693661544 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb540c3ec0 con 0x7feb54070e20 2023-11-04T01:41:21.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.331+0000 7feb59364640 1 --2- 172.21.15.77:0/2693661544 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb54070e20 0x7feb5415e740 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7feb4c009e50 tx=0x7feb4c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb4104b2e6575a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:21.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.331+0000 7feb537fe640 1 -- 172.21.15.77:0/2693661544 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c02c9e0 con 0x7feb54070e20 2023-11-04T01:41:21.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.331+0000 7feb537fe640 1 -- 172.21.15.77:0/2693661544 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4c02cb40 con 0x7feb54070e20 2023-11-04T01:41:21.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.331+0000 7feb537fe640 1 -- 172.21.15.77:0/2693661544 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c0343f0 con 0x7feb54070e20 2023-11-04T01:41:21.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.331+0000 7feb5adc7640 1 -- 172.21.15.77:0/2693661544 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb54070e20 msgr2=0x7feb5415e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:21.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.331+0000 7feb5adc7640 1 --2- 172.21.15.77:0/2693661544 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb54070e20 0x7feb5415e740 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7feb4c009e50 tx=0x7feb4c02be40 comp rx=0 tx=0).stop 2023-11-04T01:41:21.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.331+0000 7feb5adc7640 1 -- 172.21.15.77:0/2693661544 shutdown_connections 2023-11-04T01:41:21.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.331+0000 7feb5adc7640 1 --2- 172.21.15.77:0/2693661544 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb54070e20 0x7feb5415e740 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.331+0000 7feb5adc7640 1 --2- 172.21.15.77:0/2693661544 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feb5415ad30 0x7feb540adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.331+0000 7feb5adc7640 1 -- 172.21.15.77:0/2693661544 >> 172.21.15.77:0/2693661544 conn(0x7feb540ce950 msgr2=0x7feb540ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:21.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.331+0000 7feb5adc7640 1 -- 172.21.15.77:0/2693661544 shutdown_connections 2023-11-04T01:41:21.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.331+0000 7feb5adc7640 1 -- 172.21.15.77:0/2693661544 wait complete. 2023-11-04T01:41:21.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.332+0000 7feb5adc7640 1 Processor -- start 2023-11-04T01:41:21.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.333+0000 7feb5adc7640 1 -- start start 2023-11-04T01:41:21.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.333+0000 7feb5adc7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb54070e20 0x7feb540c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:21.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.333+0000 7feb5adc7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feb540ad730 0x7feb5415dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:21.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.333+0000 7feb5adc7640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feb5415ad30 0x7feb54151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:21.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.333+0000 7feb5adc7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb541f3980 con 0x7feb54070e20 2023-11-04T01:41:21.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.333+0000 7feb5adc7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb541f47a0 con 0x7feb540ad730 2023-11-04T01:41:21.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.333+0000 7feb5adc7640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb541f3b90 con 0x7feb5415ad30 2023-11-04T01:41:21.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.333+0000 7feb58b63640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb54070e20 0x7feb540c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:21.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.333+0000 7feb58b63640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb54070e20 0x7feb540c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40390/0 (socket says 172.21.15.77:40390) 2023-11-04T01:41:21.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.334+0000 7feb58b63640 1 -- 172.21.15.77:0/2850312161 learned_addr learned my addr 172.21.15.77:0/2850312161 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:21.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.334+0000 7feb59364640 1 --2- 172.21.15.77:0/2850312161 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feb5415ad30 0x7feb54151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:21.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.334+0000 7feb53fff640 1 --2- 172.21.15.77:0/2850312161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feb540ad730 0x7feb5415dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:21.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.334+0000 7feb58b63640 1 -- 172.21.15.77:0/2850312161 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feb5415ad30 msgr2=0x7feb54151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:21.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.334+0000 7feb58b63640 1 --2- 172.21.15.77:0/2850312161 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feb5415ad30 0x7feb54151510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.334+0000 7feb58b63640 1 -- 172.21.15.77:0/2850312161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feb540ad730 msgr2=0x7feb5415dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:21.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.334+0000 7feb58b63640 1 --2- 172.21.15.77:0/2850312161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feb540ad730 0x7feb5415dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.334+0000 7feb58b63640 1 -- 172.21.15.77:0/2850312161 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb4c009b30 con 0x7feb54070e20 2023-11-04T01:41:21.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.334+0000 7feb53fff640 1 --2- 172.21.15.77:0/2850312161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feb540ad730 0x7feb5415dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:21.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.334+0000 7feb58b63640 1 --2- 172.21.15.77:0/2850312161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb54070e20 0x7feb540c84d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7feb4400d620 tx=0x7feb4400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:21.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.334+0000 7feb517fa640 1 -- 172.21.15.77:0/2850312161 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4400b620 con 0x7feb54070e20 2023-11-04T01:41:21.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.334+0000 7feb517fa640 1 -- 172.21.15.77:0/2850312161 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4400b780 con 0x7feb54070e20 2023-11-04T01:41:21.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.334+0000 7feb5adc7640 1 -- 172.21.15.77:0/2850312161 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb541f3e70 con 0x7feb54070e20 2023-11-04T01:41:21.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.334+0000 7feb517fa640 1 -- 172.21.15.77:0/2850312161 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4400bb30 con 0x7feb54070e20 2023-11-04T01:41:21.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.334+0000 7feb5adc7640 1 -- 172.21.15.77:0/2850312161 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb541f4430 con 0x7feb54070e20 2023-11-04T01:41:21.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.335+0000 7feb5adc7640 1 -- 172.21.15.77:0/2850312161 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb54074290 con 0x7feb54070e20 2023-11-04T01:41:21.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.335+0000 7feb517fa640 1 -- 172.21.15.77:0/2850312161 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feb4400bc90 con 0x7feb54070e20 2023-11-04T01:41:21.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.336+0000 7feb517fa640 1 --2- 172.21.15.77:0/2850312161 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7feb4006ae70 0x7feb4006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:21.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.336+0000 7feb517fa640 1 -- 172.21.15.77:0/2850312161 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7feb44089840 con 0x7feb54070e20 2023-11-04T01:41:21.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.336+0000 7feb53fff640 1 --2- 172.21.15.77:0/2850312161 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7feb4006ae70 0x7feb4006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:21.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.336+0000 7feb53fff640 1 --2- 172.21.15.77:0/2850312161 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7feb4006ae70 0x7feb4006d330 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7feb540ad660 tx=0x7feb48009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:21.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.340+0000 7feb517fa640 1 -- 172.21.15.77:0/2850312161 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feb44054b90 con 0x7feb54070e20 2023-11-04T01:41:21.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.570+0000 7feb5adc7640 1 -- 172.21.15.77:0/2850312161 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7feb54071970 con 0x7feb54070e20 2023-11-04T01:41:21.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.575+0000 7feb517fa640 1 -- 172.21.15.77:0/2850312161 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7feb440581b0 con 0x7feb54070e20 2023-11-04T01:41:21.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.577+0000 7feb5adc7640 1 -- 172.21.15.77:0/2850312161 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7feb4006ae70 msgr2=0x7feb4006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:21.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.577+0000 7feb5adc7640 1 --2- 172.21.15.77:0/2850312161 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7feb4006ae70 0x7feb4006d330 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7feb540ad660 tx=0x7feb48009040 comp rx=0 tx=0).stop 2023-11-04T01:41:21.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.577+0000 7feb5adc7640 1 -- 172.21.15.77:0/2850312161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb54070e20 msgr2=0x7feb540c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:21.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.577+0000 7feb5adc7640 1 --2- 172.21.15.77:0/2850312161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb54070e20 0x7feb540c84d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7feb4400d620 tx=0x7feb4400dae0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.577+0000 7feb5adc7640 1 -- 172.21.15.77:0/2850312161 shutdown_connections 2023-11-04T01:41:21.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.577+0000 7feb5adc7640 1 --2- 172.21.15.77:0/2850312161 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7feb4006ae70 0x7feb4006d330 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.577+0000 7feb5adc7640 1 --2- 172.21.15.77:0/2850312161 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feb5415ad30 0x7feb54151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.577+0000 7feb5adc7640 1 --2- 172.21.15.77:0/2850312161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feb540ad730 0x7feb5415dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.577+0000 7feb5adc7640 1 --2- 172.21.15.77:0/2850312161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb54070e20 0x7feb540c84d0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.577+0000 7feb5adc7640 1 -- 172.21.15.77:0/2850312161 >> 172.21.15.77:0/2850312161 conn(0x7feb540ce950 msgr2=0x7feb540c9660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:21.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.577+0000 7feb5adc7640 1 -- 172.21.15.77:0/2850312161 shutdown_connections 2023-11-04T01:41:21.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.577+0000 7feb5adc7640 1 -- 172.21.15.77:0/2850312161 wait complete. 2023-11-04T01:41:21.590 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:21.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.687+0000 7f255381a640 1 Processor -- start 2023-11-04T01:41:21.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.688+0000 7f255381a640 1 -- start start 2023-11-04T01:41:21.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.688+0000 7f255381a640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f254c0cde60 0x7f254c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:21.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.688+0000 7f255381a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f254c0ce240 0x7f254c0d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:21.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.688+0000 7f255381a640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f254c15e000 con 0x7f254c15daa0 2023-11-04T01:41:21.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.688+0000 7f255381a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f254c15e5c0 con 0x7f254c0ce240 2023-11-04T01:41:21.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.688+0000 7f255381a640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f254c15e2e0 con 0x7f254c0cde60 2023-11-04T01:41:21.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.688+0000 7f2551db7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f254c0ce240 0x7f254c0d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:21.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.689+0000 7f2551db7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f254c0ce240 0x7f254c0d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40394/0 (socket says 172.21.15.77:40394) 2023-11-04T01:41:21.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.689+0000 7f2551db7640 1 -- 172.21.15.77:0/3699868940 learned_addr learned my addr 172.21.15.77:0/3699868940 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:21.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.689+0000 7f25515b6640 1 --2- 172.21.15.77:0/3699868940 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f254c0cde60 0x7f254c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:21.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.689+0000 7f2551db7640 1 -- 172.21.15.77:0/3699868940 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f254c0cde60 msgr2=0x7f254c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:21.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.689+0000 7f2551db7640 1 --2- 172.21.15.77:0/3699868940 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f254c0cde60 0x7f254c15d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.689+0000 7f2551db7640 1 -- 172.21.15.77:0/3699868940 >> v1:172.21.15.122:6789/0 conn(0x7f254c15daa0 legacy=0x7f254c157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:21.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.689+0000 7f2551db7640 1 -- 172.21.15.77:0/3699868940 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f254c0d1120 con 0x7f254c0ce240 2023-11-04T01:41:21.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.689+0000 7f2551db7640 1 --2- 172.21.15.77:0/3699868940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f254c0ce240 0x7f254c0d1920 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2544009e50 tx=0x7f254402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c84f1691df6c9a29 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:21.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.690+0000 7f2543fff640 1 -- 172.21.15.77:0/3699868940 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254402ca70 con 0x7f254c0ce240 2023-11-04T01:41:21.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.690+0000 7f2543fff640 1 -- 172.21.15.77:0/3699868940 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254402cbd0 con 0x7f254c0ce240 2023-11-04T01:41:21.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.690+0000 7f2543fff640 1 -- 172.21.15.77:0/3699868940 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25440343f0 con 0x7f254c0ce240 2023-11-04T01:41:21.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.690+0000 7f255381a640 1 -- 172.21.15.77:0/3699868940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f254c0ce240 msgr2=0x7f254c0d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:21.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.690+0000 7f255381a640 1 --2- 172.21.15.77:0/3699868940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f254c0ce240 0x7f254c0d1920 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2544009e50 tx=0x7f254402bed0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.690+0000 7f255381a640 1 -- 172.21.15.77:0/3699868940 shutdown_connections 2023-11-04T01:41:21.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.690+0000 7f255381a640 1 --2- 172.21.15.77:0/3699868940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f254c0ce240 0x7f254c0d1920 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.690+0000 7f255381a640 1 --2- 172.21.15.77:0/3699868940 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f254c0cde60 0x7f254c15d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.690+0000 7f255381a640 1 -- 172.21.15.77:0/3699868940 >> 172.21.15.77:0/3699868940 conn(0x7f254c071f30 msgr2=0x7f254c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:21.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.690+0000 7f255381a640 1 -- 172.21.15.77:0/3699868940 shutdown_connections 2023-11-04T01:41:21.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.690+0000 7f255381a640 1 -- 172.21.15.77:0/3699868940 wait complete. 2023-11-04T01:41:21.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.691+0000 7f255381a640 1 Processor -- start 2023-11-04T01:41:21.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.691+0000 7f255381a640 1 -- start start 2023-11-04T01:41:21.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.692+0000 7f255381a640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f254c0cde60 0x7f254c0ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:21.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.692+0000 7f255381a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f254c0ce240 0x7f254c0cab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:21.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.692+0000 7f255381a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f254c15daa0 0x7f254c152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:21.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.692+0000 7f255381a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254c152580 con 0x7f254c15daa0 2023-11-04T01:41:21.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.692+0000 7f255381a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254c151750 con 0x7f254c0ce240 2023-11-04T01:41:21.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.692+0000 7f255381a640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f254c151a30 con 0x7f254c0cde60 2023-11-04T01:41:21.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.692+0000 7f2551db7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f254c15daa0 0x7f254c152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:21.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.692+0000 7f2551db7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f254c15daa0 0x7f254c152cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40406/0 (socket says 172.21.15.77:40406) 2023-11-04T01:41:21.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.692+0000 7f2551db7640 1 -- 172.21.15.77:0/3003064563 learned_addr learned my addr 172.21.15.77:0/3003064563 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:21.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.692+0000 7f25515b6640 1 --2- 172.21.15.77:0/3003064563 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f254c0cde60 0x7f254c0ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:21.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.692+0000 7f2550db5640 1 --2- 172.21.15.77:0/3003064563 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f254c0ce240 0x7f254c0cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:21.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.692+0000 7f2551db7640 1 -- 172.21.15.77:0/3003064563 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f254c0cde60 msgr2=0x7f254c0ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:21.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.692+0000 7f2551db7640 1 --2- 172.21.15.77:0/3003064563 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f254c0cde60 0x7f254c0ca0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.692+0000 7f2551db7640 1 -- 172.21.15.77:0/3003064563 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f254c0ce240 msgr2=0x7f254c0cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:21.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.692+0000 7f2551db7640 1 --2- 172.21.15.77:0/3003064563 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f254c0ce240 0x7f254c0cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.693+0000 7f2551db7640 1 -- 172.21.15.77:0/3003064563 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2544009b30 con 0x7f254c15daa0 2023-11-04T01:41:21.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.693+0000 7f2550db5640 1 --2- 172.21.15.77:0/3003064563 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f254c0ce240 0x7f254c0cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:21.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.693+0000 7f2551db7640 1 --2- 172.21.15.77:0/3003064563 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f254c15daa0 0x7f254c152cf0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f2544036040 tx=0x7f2544004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:21.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.693+0000 7f2541ffb640 1 -- 172.21.15.77:0/3003064563 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2544009510 con 0x7f254c15daa0 2023-11-04T01:41:21.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.693+0000 7f2541ffb640 1 -- 172.21.15.77:0/3003064563 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254403e450 con 0x7f254c15daa0 2023-11-04T01:41:21.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.693+0000 7f255381a640 1 -- 172.21.15.77:0/3003064563 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f254c151d10 con 0x7f254c15daa0 2023-11-04T01:41:21.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.693+0000 7f2541ffb640 1 -- 172.21.15.77:0/3003064563 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254403e7e0 con 0x7f254c15daa0 2023-11-04T01:41:21.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.693+0000 7f255381a640 1 -- 172.21.15.77:0/3003064563 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f254c0ca5e0 con 0x7f254c15daa0 2023-11-04T01:41:21.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.694+0000 7f255381a640 1 -- 172.21.15.77:0/3003064563 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f254c152a10 con 0x7f254c15daa0 2023-11-04T01:41:21.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.694+0000 7f2541ffb640 1 -- 172.21.15.77:0/3003064563 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f254403e940 con 0x7f254c15daa0 2023-11-04T01:41:21.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.695+0000 7f2541ffb640 1 --2- 172.21.15.77:0/3003064563 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f253006aea0 0x7f253006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:21.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.695+0000 7f2541ffb640 1 -- 172.21.15.77:0/3003064563 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f25440abe00 con 0x7f254c15daa0 2023-11-04T01:41:21.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.695+0000 7f25515b6640 1 --2- 172.21.15.77:0/3003064563 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f253006aea0 0x7f253006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:21.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.696+0000 7f25515b6640 1 --2- 172.21.15.77:0/3003064563 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f253006aea0 0x7f253006d360 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f253c006fd0 tx=0x7f253c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:21.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.699+0000 7f2541ffb640 1 -- 172.21.15.77:0/3003064563 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f254c152a10 con 0x7f254c15daa0 2023-11-04T01:41:21.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.867+0000 7f255381a640 1 -- 172.21.15.77:0/3003064563 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f254c152a10 con 0x7f254c15daa0 2023-11-04T01:41:21.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.868+0000 7f2541ffb640 1 -- 172.21.15.77:0/3003064563 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+13050 (secure 0 0 0) 0x7f254c152a10 con 0x7f254c15daa0 2023-11-04T01:41:21.870 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:21.870 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":34,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:41:19.047118+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:21.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.870+0000 7f255381a640 1 -- 172.21.15.77:0/3003064563 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f253006aea0 msgr2=0x7f253006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:21.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.870+0000 7f255381a640 1 --2- 172.21.15.77:0/3003064563 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f253006aea0 0x7f253006d360 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f253c006fd0 tx=0x7f253c008040 comp rx=0 tx=0).stop 2023-11-04T01:41:21.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.870+0000 7f255381a640 1 -- 172.21.15.77:0/3003064563 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f254c15daa0 msgr2=0x7f254c152cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:21.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.870+0000 7f255381a640 1 --2- 172.21.15.77:0/3003064563 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f254c15daa0 0x7f254c152cf0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f2544036040 tx=0x7f2544004a40 comp rx=0 tx=0).stop 2023-11-04T01:41:21.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.870+0000 7f255381a640 1 -- 172.21.15.77:0/3003064563 shutdown_connections 2023-11-04T01:41:21.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.870+0000 7f255381a640 1 --2- 172.21.15.77:0/3003064563 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f253006aea0 0x7f253006d360 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.870+0000 7f255381a640 1 --2- 172.21.15.77:0/3003064563 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f254c15daa0 0x7f254c152cf0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.870+0000 7f255381a640 1 --2- 172.21.15.77:0/3003064563 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f254c0ce240 0x7f254c0cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.870+0000 7f255381a640 1 --2- 172.21.15.77:0/3003064563 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f254c0cde60 0x7f254c0ca0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.870+0000 7f255381a640 1 -- 172.21.15.77:0/3003064563 >> 172.21.15.77:0/3003064563 conn(0x7f254c071f30 msgr2=0x7f254c0c91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:21.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.870+0000 7f255381a640 1 -- 172.21.15.77:0/3003064563 shutdown_connections 2023-11-04T01:41:21.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.870+0000 7f255381a640 1 -- 172.21.15.77:0/3003064563 wait complete. 2023-11-04T01:41:21.882 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:41:21.883 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:41:21.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.984+0000 7f84e04e1640 1 Processor -- start 2023-11-04T01:41:21.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.984+0000 7f84e04e1640 1 -- start start 2023-11-04T01:41:21.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.985+0000 7f84e04e1640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84d80ae1d0 0x7f84d80cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:21.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.985+0000 7f84e04e1640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84d815aff0 con 0x7f84d80c4ff0 2023-11-04T01:41:21.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.985+0000 7f84e04e1640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84d815a3e0 con 0x7f84d8159c00 2023-11-04T01:41:21.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.985+0000 7f84e04e1640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d815a6c0 con 0x7f84d80ae1d0 2023-11-04T01:41:21.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.985+0000 7f84dda7c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f84d80c4ff0 0x7f84d80adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44292/0 (socket says 172.21.15.77:44292) 2023-11-04T01:41:21.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.985+0000 7f84dda7c640 1 -- 172.21.15.77:0/3610313314 learned_addr learned my addr 172.21.15.77:0/3610313314 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:21.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.985+0000 7f84dea7e640 1 --2- 172.21.15.77:0/3610313314 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84d80ae1d0 0x7f84d80cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:21.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.985+0000 7f84dd27b640 1 -- 172.21.15.77:0/3610313314 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1647054754 0 0) 0x7f84d815aff0 con 0x7f84d80c4ff0 2023-11-04T01:41:21.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.985+0000 7f84dd27b640 1 -- 172.21.15.77:0/3610313314 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84c4003520 con 0x7f84d80c4ff0 2023-11-04T01:41:21.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.985+0000 7f84dd27b640 1 -- 172.21.15.77:0/3610313314 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4242407542 0 0) 0x7f84c4003520 con 0x7f84d80c4ff0 2023-11-04T01:41:21.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.985+0000 7f84dd27b640 1 -- 172.21.15.77:0/3610313314 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84d80ae1d0 msgr2=0x7f84d80cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:21.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.985+0000 7f84dd27b640 1 --2- 172.21.15.77:0/3610313314 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84d80ae1d0 0x7f84d80cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.985+0000 7f84dd27b640 1 -- 172.21.15.77:0/3610313314 >> v1:172.21.15.122:6789/0 conn(0x7f84d8159c00 legacy=0x7f84d80c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:21.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.985+0000 7f84dd27b640 1 -- 172.21.15.77:0/3610313314 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d815a9a0 con 0x7f84d80c4ff0 2023-11-04T01:41:21.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.985+0000 7f84dd27b640 1 -- 172.21.15.77:0/3610313314 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f84c8001670 con 0x7f84d80c4ff0 2023-11-04T01:41:21.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.985+0000 7f84dd27b640 1 -- 172.21.15.77:0/3610313314 >> v1:172.21.15.77:6789/0 conn(0x7f84d80c4ff0 legacy=0x7f84d80adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:21.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.985+0000 7f84dd27b640 1 --2- 172.21.15.77:0/3610313314 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84c40039a0 0x7f84c4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:21.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.985+0000 7f84dd27b640 1 --2- 172.21.15.77:0/3610313314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84c40047c0 0x7f84c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:21.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.985+0000 7f84dd27b640 1 --2- 172.21.15.77:0/3610313314 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84d80ae1d0 0x7f84c4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:21.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.985+0000 7f84dd27b640 1 -- 172.21.15.77:0/3610313314 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d815a6c0 con 0x7f84c40047c0 2023-11-04T01:41:21.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.985+0000 7f84dd27b640 1 -- 172.21.15.77:0/3610313314 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c400ba60 con 0x7f84c40039a0 2023-11-04T01:41:21.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.985+0000 7f84dd27b640 1 -- 172.21.15.77:0/3610313314 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c400de30 con 0x7f84d80ae1d0 2023-11-04T01:41:21.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.986+0000 7f84dda7c640 1 --2- 172.21.15.77:0/3610313314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84c40047c0 0x7f84c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:21.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.986+0000 7f84de27d640 1 --2- 172.21.15.77:0/3610313314 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84c40039a0 0x7f84c4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:21.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.986+0000 7f84dea7e640 1 --2- 172.21.15.77:0/3610313314 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84d80ae1d0 0x7f84c4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:21.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.986+0000 7f84dda7c640 1 -- 172.21.15.77:0/3610313314 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84d80ae1d0 msgr2=0x7f84c4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:21.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.986+0000 7f84dda7c640 1 --2- 172.21.15.77:0/3610313314 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84d80ae1d0 0x7f84c4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.986+0000 7f84dda7c640 1 -- 172.21.15.77:0/3610313314 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84c40039a0 msgr2=0x7f84c4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:21.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.986+0000 7f84dda7c640 1 --2- 172.21.15.77:0/3610313314 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84c40039a0 0x7f84c4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.986+0000 7f84dda7c640 1 -- 172.21.15.77:0/3610313314 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c4003520 con 0x7f84c40047c0 2023-11-04T01:41:21.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.987+0000 7f84dda7c640 1 --2- 172.21.15.77:0/3610313314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84c40047c0 0x7f84c4004c40 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f84c8001eb0 tx=0x7f84c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0c682660e43830 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:21.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.987+0000 7f84dd27b640 1 -- 172.21.15.77:0/3610313314 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c8005ad0 con 0x7f84c40047c0 2023-11-04T01:41:21.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.987+0000 7f84dd27b640 1 -- 172.21.15.77:0/3610313314 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c8005c30 con 0x7f84c40047c0 2023-11-04T01:41:21.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.987+0000 7f84dd27b640 1 -- 172.21.15.77:0/3610313314 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c802c810 con 0x7f84c40047c0 2023-11-04T01:41:21.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.987+0000 7f84e04e1640 1 -- 172.21.15.77:0/3610313314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84c40047c0 msgr2=0x7f84c4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:21.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.987+0000 7f84e04e1640 1 --2- 172.21.15.77:0/3610313314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84c40047c0 0x7f84c4004c40 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f84c8001eb0 tx=0x7f84c40057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:21.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.987+0000 7f84dea7e640 1 -- 172.21.15.77:0/3610313314 reap_dead start 2023-11-04T01:41:21.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.987+0000 7f84e04e1640 1 -- 172.21.15.77:0/3610313314 shutdown_connections 2023-11-04T01:41:21.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.987+0000 7f84e04e1640 1 -- 172.21.15.77:0/3610313314 >> 172.21.15.77:0/3610313314 conn(0x7f84d80ce950 msgr2=0x7f84d80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:21.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.987+0000 7f84e04e1640 1 -- 172.21.15.77:0/3610313314 shutdown_connections 2023-11-04T01:41:21.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.987+0000 7f84e04e1640 1 -- 172.21.15.77:0/3610313314 wait complete. 2023-11-04T01:41:22.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.988+0000 7f84e04e1640 1 Processor -- start 2023-11-04T01:41:22.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.988+0000 7f84e04e1640 1 -- start start 2023-11-04T01:41:22.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.989+0000 7f84e04e1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84c40047c0 0x7f84d80c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.989+0000 7f84e04e1640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84d81f2220 0x7f84d814a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.989+0000 7f84e04e1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84d81f26a0 0x7f84d814a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.989+0000 7f84e04e1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d81ef190 con 0x7f84c40047c0 2023-11-04T01:41:22.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.989+0000 7f84e04e1640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d81ee510 con 0x7f84d81f26a0 2023-11-04T01:41:22.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.989+0000 7f84e04e1640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d81ee7f0 con 0x7f84d81f2220 2023-11-04T01:41:22.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.989+0000 7f84de27d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84c40047c0 0x7f84d80c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.989+0000 7f84de27d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84c40047c0 0x7f84d80c8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40416/0 (socket says 172.21.15.77:40416) 2023-11-04T01:41:22.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.989+0000 7f84de27d640 1 -- 172.21.15.77:0/3255388367 learned_addr learned my addr 172.21.15.77:0/3255388367 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:22.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.990+0000 7f84de27d640 1 -- 172.21.15.77:0/3255388367 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84d81f2220 msgr2=0x7f84d814a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.990+0000 7f84de27d640 1 --2- 172.21.15.77:0/3255388367 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84d81f2220 0x7f84d814a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.990+0000 7f84de27d640 1 -- 172.21.15.77:0/3255388367 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84d81f26a0 msgr2=0x7f84d814a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.990+0000 7f84de27d640 1 --2- 172.21.15.77:0/3255388367 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84d81f26a0 0x7f84d814a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.990+0000 7f84de27d640 1 -- 172.21.15.77:0/3255388367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d81eead0 con 0x7f84c40047c0 2023-11-04T01:41:22.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.990+0000 7f84de27d640 1 --2- 172.21.15.77:0/3255388367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84c40047c0 0x7f84d80c8160 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f84d400f5f0 tx=0x7f84d400fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:22.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.990+0000 7f84ceffd640 1 -- 172.21.15.77:0/3255388367 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d40052e0 con 0x7f84c40047c0 2023-11-04T01:41:22.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.990+0000 7f84ceffd640 1 -- 172.21.15.77:0/3255388367 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d4005440 con 0x7f84c40047c0 2023-11-04T01:41:22.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.990+0000 7f84e04e1640 1 -- 172.21.15.77:0/3255388367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d81eedb0 con 0x7f84c40047c0 2023-11-04T01:41:22.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.990+0000 7f84ceffd640 1 -- 172.21.15.77:0/3255388367 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d4003810 con 0x7f84c40047c0 2023-11-04T01:41:22.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.990+0000 7f84e04e1640 1 -- 172.21.15.77:0/3255388367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d81f1d20 con 0x7f84c40047c0 2023-11-04T01:41:22.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.991+0000 7f84e04e1640 1 -- 172.21.15.77:0/3255388367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84d81ef400 con 0x7f84c40047c0 2023-11-04T01:41:22.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.991+0000 7f84ceffd640 1 -- 172.21.15.77:0/3255388367 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f84d4003970 con 0x7f84c40047c0 2023-11-04T01:41:22.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.992+0000 7f84ceffd640 1 --2- 172.21.15.77:0/3255388367 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f84bc06ae70 0x7f84bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.992+0000 7f84ceffd640 1 -- 172.21.15.77:0/3255388367 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f84d4089240 con 0x7f84c40047c0 2023-11-04T01:41:22.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.992+0000 7f84dda7c640 1 --2- 172.21.15.77:0/3255388367 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f84bc06ae70 0x7f84bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.992+0000 7f84dda7c640 1 --2- 172.21.15.77:0/3255388367 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f84bc06ae70 0x7f84bc06d330 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f84c8034000 tx=0x7f84c8007000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:22.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:21.996+0000 7f84ceffd640 1 -- 172.21.15.77:0/3255388367 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f84d81ef400 con 0x7f84c40047c0 2023-11-04T01:41:22.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.161+0000 7f84e04e1640 1 -- 172.21.15.77:0/3255388367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f84d81ef400 con 0x7f84c40047c0 2023-11-04T01:41:22.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.162+0000 7f84ceffd640 1 -- 172.21.15.77:0/3255388367 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f84d81ef400 con 0x7f84c40047c0 2023-11-04T01:41:22.164 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:41:22.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.164+0000 7f84e04e1640 1 -- 172.21.15.77:0/3255388367 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f84bc06ae70 msgr2=0x7f84bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.164+0000 7f84e04e1640 1 --2- 172.21.15.77:0/3255388367 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f84bc06ae70 0x7f84bc06d330 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f84c8034000 tx=0x7f84c8007000 comp rx=0 tx=0).stop 2023-11-04T01:41:22.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.164+0000 7f84e04e1640 1 -- 172.21.15.77:0/3255388367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84c40047c0 msgr2=0x7f84d80c8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.164+0000 7f84e04e1640 1 --2- 172.21.15.77:0/3255388367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84c40047c0 0x7f84d80c8160 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f84d400f5f0 tx=0x7f84d400fab0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.164+0000 7f84e04e1640 1 -- 172.21.15.77:0/3255388367 shutdown_connections 2023-11-04T01:41:22.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.164+0000 7f84e04e1640 1 --2- 172.21.15.77:0/3255388367 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f84bc06ae70 0x7f84bc06d330 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.164+0000 7f84e04e1640 1 --2- 172.21.15.77:0/3255388367 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84d81f26a0 0x7f84d814a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.164+0000 7f84e04e1640 1 --2- 172.21.15.77:0/3255388367 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84d81f2220 0x7f84d814a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.164+0000 7f84e04e1640 1 --2- 172.21.15.77:0/3255388367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84c40047c0 0x7f84d80c8160 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.164+0000 7f84e04e1640 1 -- 172.21.15.77:0/3255388367 >> 172.21.15.77:0/3255388367 conn(0x7f84d80ce950 msgr2=0x7f84d806d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:22.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.164+0000 7f84e04e1640 1 -- 172.21.15.77:0/3255388367 shutdown_connections 2023-11-04T01:41:22.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.164+0000 7f84e04e1640 1 -- 172.21.15.77:0/3255388367 wait complete. 2023-11-04T01:41:22.176 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T01:41:22.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.274+0000 7fc8131cc640 1 Processor -- start 2023-11-04T01:41:22.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.274+0000 7fc8131cc640 1 -- start start 2023-11-04T01:41:22.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.275+0000 7fc8131cc640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc80c0cda60 0x7fc80c0ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.275+0000 7fc8131cc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc80c070d40 0x7fc80c06c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.275+0000 7fc8131cc640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc80c0cc990 con 0x7fc80c0b0cd0 2023-11-04T01:41:22.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.275+0000 7fc8131cc640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc80c0ccc70 con 0x7fc80c070d40 2023-11-04T01:41:22.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.275+0000 7fc8131cc640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc80c0c9ce0 con 0x7fc80c0cda60 2023-11-04T01:41:22.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.275+0000 7fc811769640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc80c070d40 0x7fc80c06c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.275+0000 7fc811769640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc80c070d40 0x7fc80c06c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40422/0 (socket says 172.21.15.77:40422) 2023-11-04T01:41:22.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.275+0000 7fc811769640 1 -- 172.21.15.77:0/2379597073 learned_addr learned my addr 172.21.15.77:0/2379597073 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:22.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.275+0000 7fc810f68640 1 --2- 172.21.15.77:0/2379597073 >> v2:172.21.15.122:3300/0 conn(0x7fc80c0cda60 0x7fc80c0ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.275+0000 7fc811769640 1 -- 172.21.15.77:0/2379597073 >> v2:172.21.15.122:3300/0 conn(0x7fc80c0cda60 msgr2=0x7fc80c0ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:22.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.275+0000 7fc811769640 1 --2- 172.21.15.77:0/2379597073 >> v2:172.21.15.122:3300/0 conn(0x7fc80c0cda60 0x7fc80c0ca7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.275+0000 7fc811769640 1 -- 172.21.15.77:0/2379597073 >> v1:172.21.15.122:6789/0 conn(0x7fc80c0b0cd0 legacy=0x7fc80c070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:22.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.275+0000 7fc811769640 1 -- 172.21.15.77:0/2379597073 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc80c0c9fc0 con 0x7fc80c070d40 2023-11-04T01:41:22.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.276+0000 7fc811769640 1 --2- 172.21.15.77:0/2379597073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc80c070d40 0x7fc80c06c200 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc80c0cf800 tx=0x7fc80402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b1d83af3127e29 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:22.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.276+0000 7fc80b7fe640 1 -- 172.21.15.77:0/2379597073 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80402ca80 con 0x7fc80c070d40 2023-11-04T01:41:22.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.276+0000 7fc80b7fe640 1 -- 172.21.15.77:0/2379597073 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80402cbe0 con 0x7fc80c070d40 2023-11-04T01:41:22.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.276+0000 7fc80b7fe640 1 -- 172.21.15.77:0/2379597073 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8040343f0 con 0x7fc80c070d40 2023-11-04T01:41:22.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.277+0000 7fc8131cc640 1 -- 172.21.15.77:0/2379597073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc80c070d40 msgr2=0x7fc80c06c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.277+0000 7fc8131cc640 1 --2- 172.21.15.77:0/2379597073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc80c070d40 0x7fc80c06c200 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc80c0cf800 tx=0x7fc80402bee0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.277+0000 7fc8131cc640 1 -- 172.21.15.77:0/2379597073 shutdown_connections 2023-11-04T01:41:22.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.277+0000 7fc8131cc640 1 --2- 172.21.15.77:0/2379597073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc80c070d40 0x7fc80c06c200 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.277+0000 7fc8131cc640 1 --2- 172.21.15.77:0/2379597073 >> v2:172.21.15.122:3300/0 conn(0x7fc80c0cda60 0x7fc80c0ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.277+0000 7fc8131cc640 1 -- 172.21.15.77:0/2379597073 >> 172.21.15.77:0/2379597073 conn(0x7fc80c0ce950 msgr2=0x7fc80c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:22.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.277+0000 7fc8131cc640 1 -- 172.21.15.77:0/2379597073 shutdown_connections 2023-11-04T01:41:22.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.277+0000 7fc8131cc640 1 -- 172.21.15.77:0/2379597073 wait complete. 2023-11-04T01:41:22.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.278+0000 7fc8131cc640 1 Processor -- start 2023-11-04T01:41:22.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.278+0000 7fc8131cc640 1 -- start start 2023-11-04T01:41:22.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.279+0000 7fc8131cc640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc80c070d40 0x7fc80c0c7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.279+0000 7fc8131cc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc80c0b0cd0 0x7fc80c157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.279+0000 7fc8131cc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc80c0cda60 0x7fc80c0c5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.279+0000 7fc8131cc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c1e2860 con 0x7fc80c0cda60 2023-11-04T01:41:22.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.279+0000 7fc8131cc640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c0c57e0 con 0x7fc80c0b0cd0 2023-11-04T01:41:22.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.279+0000 7fc8131cc640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c1581e0 con 0x7fc80c070d40 2023-11-04T01:41:22.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.279+0000 7fc811769640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc80c0cda60 0x7fc80c0c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.279+0000 7fc811769640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc80c0cda60 0x7fc80c0c5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40434/0 (socket says 172.21.15.77:40434) 2023-11-04T01:41:22.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.279+0000 7fc811769640 1 -- 172.21.15.77:0/3708413200 learned_addr learned my addr 172.21.15.77:0/3708413200 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:22.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.279+0000 7fc80bfff640 1 --2- 172.21.15.77:0/3708413200 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc80c0b0cd0 0x7fc80c157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.279+0000 7fc811769640 1 -- 172.21.15.77:0/3708413200 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc80c070d40 msgr2=0x7fc80c0c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.279+0000 7fc810f68640 1 --2- 172.21.15.77:0/3708413200 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc80c070d40 0x7fc80c0c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.279+0000 7fc811769640 1 --2- 172.21.15.77:0/3708413200 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc80c070d40 0x7fc80c0c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.279+0000 7fc811769640 1 -- 172.21.15.77:0/3708413200 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc80c0b0cd0 msgr2=0x7fc80c157ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.279+0000 7fc811769640 1 --2- 172.21.15.77:0/3708413200 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc80c0b0cd0 0x7fc80c157ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.279+0000 7fc811769640 1 -- 172.21.15.77:0/3708413200 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc804009b30 con 0x7fc80c0cda60 2023-11-04T01:41:22.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.279+0000 7fc80bfff640 1 --2- 172.21.15.77:0/3708413200 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc80c0b0cd0 0x7fc80c157ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:22.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.279+0000 7fc810f68640 1 --2- 172.21.15.77:0/3708413200 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc80c070d40 0x7fc80c0c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:22.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.279+0000 7fc811769640 1 --2- 172.21.15.77:0/3708413200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc80c0cda60 0x7fc80c0c5020 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc804036040 tx=0x7fc804004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:22.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.280+0000 7fc8097fa640 1 -- 172.21.15.77:0/3708413200 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc804009510 con 0x7fc80c0cda60 2023-11-04T01:41:22.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.280+0000 7fc8097fa640 1 -- 172.21.15.77:0/3708413200 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80403e450 con 0x7fc80c0cda60 2023-11-04T01:41:22.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.280+0000 7fc8131cc640 1 -- 172.21.15.77:0/3708413200 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc80c0c5560 con 0x7fc80c0cda60 2023-11-04T01:41:22.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.280+0000 7fc8097fa640 1 -- 172.21.15.77:0/3708413200 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80403e7e0 con 0x7fc80c0cda60 2023-11-04T01:41:22.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.280+0000 7fc8131cc640 1 -- 172.21.15.77:0/3708413200 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc80c0abd60 con 0x7fc80c0cda60 2023-11-04T01:41:22.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.281+0000 7fc8131cc640 1 -- 172.21.15.77:0/3708413200 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc80c074290 con 0x7fc80c0cda60 2023-11-04T01:41:22.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.281+0000 7fc8097fa640 1 -- 172.21.15.77:0/3708413200 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc80402cd50 con 0x7fc80c0cda60 2023-11-04T01:41:22.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.282+0000 7fc8097fa640 1 --2- 172.21.15.77:0/3708413200 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc7f806ae70 0x7fc7f806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.282+0000 7fc8097fa640 1 -- 172.21.15.77:0/3708413200 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fc8040abed0 con 0x7fc80c0cda60 2023-11-04T01:41:22.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.282+0000 7fc810f68640 1 --2- 172.21.15.77:0/3708413200 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc7f806ae70 0x7fc7f806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.282+0000 7fc810f68640 1 --2- 172.21.15.77:0/3708413200 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc7f806ae70 0x7fc7f806d330 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc006fd0 tx=0x7fc7fc008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:22.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.286+0000 7fc8097fa640 1 -- 172.21.15.77:0/3708413200 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc804077220 con 0x7fc80c0cda60 2023-11-04T01:41:22.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.454+0000 7fc8131cc640 1 -- 172.21.15.77:0/3708413200 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc80c0b48d0 con 0x7fc80c0cda60 2023-11-04T01:41:22.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.454+0000 7fc8097fa640 1 -- 172.21.15.77:0/3708413200 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc804043060 con 0x7fc80c0cda60 2023-11-04T01:41:22.456 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:22.457 INFO:teuthology.orchestra.run.smithi077.stdout:[ 2023-11-04T01:41:22.457 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:22.457 INFO:teuthology.orchestra.run.smithi077.stdout: "poolnum": 1, 2023-11-04T01:41:22.457 INFO:teuthology.orchestra.run.smithi077.stdout: "poolname": ".mgr" 2023-11-04T01:41:22.458 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:22.458 INFO:teuthology.orchestra.run.smithi077.stdout:] 2023-11-04T01:41:22.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.456+0000 7fc8131cc640 1 -- 172.21.15.77:0/3708413200 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc7f806ae70 msgr2=0x7fc7f806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.456+0000 7fc8131cc640 1 --2- 172.21.15.77:0/3708413200 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc7f806ae70 0x7fc7f806d330 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc006fd0 tx=0x7fc7fc008040 comp rx=0 tx=0).stop 2023-11-04T01:41:22.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.456+0000 7fc8131cc640 1 -- 172.21.15.77:0/3708413200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc80c0cda60 msgr2=0x7fc80c0c5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.456+0000 7fc8131cc640 1 --2- 172.21.15.77:0/3708413200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc80c0cda60 0x7fc80c0c5020 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc804036040 tx=0x7fc804004a40 comp rx=0 tx=0).stop 2023-11-04T01:41:22.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.456+0000 7fc8131cc640 1 -- 172.21.15.77:0/3708413200 shutdown_connections 2023-11-04T01:41:22.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.456+0000 7fc8131cc640 1 --2- 172.21.15.77:0/3708413200 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc7f806ae70 0x7fc7f806d330 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.456+0000 7fc8131cc640 1 --2- 172.21.15.77:0/3708413200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc80c0cda60 0x7fc80c0c5020 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.456+0000 7fc8131cc640 1 --2- 172.21.15.77:0/3708413200 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc80c0b0cd0 0x7fc80c157ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.456+0000 7fc8131cc640 1 --2- 172.21.15.77:0/3708413200 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc80c070d40 0x7fc80c0c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.456+0000 7fc8131cc640 1 -- 172.21.15.77:0/3708413200 >> 172.21.15.77:0/3708413200 conn(0x7fc80c0ce950 msgr2=0x7fc80c0b0440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:22.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.456+0000 7fc8131cc640 1 -- 172.21.15.77:0/3708413200 shutdown_connections 2023-11-04T01:41:22.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.456+0000 7fc8131cc640 1 -- 172.21.15.77:0/3708413200 wait complete. 2023-11-04T01:41:22.468 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T01:41:22.469 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T01:41:22.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.570+0000 7f17eb67c640 1 Processor -- start 2023-11-04T01:41:22.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.571+0000 7f17eb67c640 1 -- start start 2023-11-04T01:41:22.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.571+0000 7f17eb67c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f17e4151ea0 0x7f17e415b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.571+0000 7f17eb67c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f17e406dd50 0x7f17e40c9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.571+0000 7f17eb67c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17e406cf90 con 0x7f17e415f510 2023-11-04T01:41:22.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.571+0000 7f17eb67c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17e406d270 con 0x7f17e4151ea0 2023-11-04T01:41:22.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.571+0000 7f17eb67c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17e406d550 con 0x7f17e406dd50 2023-11-04T01:41:22.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.572+0000 7f17e9418640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f17e4151ea0 0x7f17e415b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.572+0000 7f17e8c17640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f17e415f510 0x7f17e40cb150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44294/0 (socket says 172.21.15.77:44294) 2023-11-04T01:41:22.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.572+0000 7f17e8c17640 1 -- 172.21.15.77:0/1274818291 learned_addr learned my addr 172.21.15.77:0/1274818291 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:22.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.572+0000 7f17e9c19640 1 --2- 172.21.15.77:0/1274818291 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f17e406dd50 0x7f17e40c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.572+0000 7f17e9418640 1 -- 172.21.15.77:0/1274818291 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f17e406dd50 msgr2=0x7f17e40c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:22.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.572+0000 7f17e9418640 1 --2- 172.21.15.77:0/1274818291 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f17e406dd50 0x7f17e40c9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.572+0000 7f17e9418640 1 -- 172.21.15.77:0/1274818291 >> v1:172.21.15.77:6789/0 conn(0x7f17e415f510 legacy=0x7f17e40cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.572+0000 7f17dbfff640 1 -- 172.21.15.77:0/1274818291 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 739483343 0 0) 0x7f17e406cf90 con 0x7f17e415f510 2023-11-04T01:41:22.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.572+0000 7f17e9418640 1 -- 172.21.15.77:0/1274818291 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e406d830 con 0x7f17e4151ea0 2023-11-04T01:41:22.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.573+0000 7f17e9418640 1 --2- 172.21.15.77:0/1274818291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17e4151ea0 0x7f17e415b9c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f17e0009d90 tx=0x7f17e002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1717f5d4efb967e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:22.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.573+0000 7f17dbfff640 1 -- 172.21.15.77:0/1274818291 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e002cc50 con 0x7f17e4151ea0 2023-11-04T01:41:22.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.573+0000 7f17dbfff640 1 -- 172.21.15.77:0/1274818291 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e002cdb0 con 0x7f17e4151ea0 2023-11-04T01:41:22.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.573+0000 7f17dbfff640 1 -- 172.21.15.77:0/1274818291 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e0034660 con 0x7f17e4151ea0 2023-11-04T01:41:22.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.573+0000 7f17eb67c640 1 -- 172.21.15.77:0/1274818291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17e4151ea0 msgr2=0x7f17e415b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.573+0000 7f17eb67c640 1 --2- 172.21.15.77:0/1274818291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17e4151ea0 0x7f17e415b9c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f17e0009d90 tx=0x7f17e002bea0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.573+0000 7f17eb67c640 1 -- 172.21.15.77:0/1274818291 shutdown_connections 2023-11-04T01:41:22.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.573+0000 7f17eb67c640 1 --2- 172.21.15.77:0/1274818291 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f17e406dd50 0x7f17e40c9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.573+0000 7f17eb67c640 1 --2- 172.21.15.77:0/1274818291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17e4151ea0 0x7f17e415b9c0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.573+0000 7f17eb67c640 1 -- 172.21.15.77:0/1274818291 >> 172.21.15.77:0/1274818291 conn(0x7f17e40b05d0 msgr2=0x7f17e40b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:22.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.573+0000 7f17eb67c640 1 -- 172.21.15.77:0/1274818291 shutdown_connections 2023-11-04T01:41:22.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.573+0000 7f17eb67c640 1 -- 172.21.15.77:0/1274818291 wait complete. 2023-11-04T01:41:22.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.574+0000 7f17eb67c640 1 Processor -- start 2023-11-04T01:41:22.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.574+0000 7f17eb67c640 1 -- start start 2023-11-04T01:41:22.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.575+0000 7f17eb67c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17e406dd50 0x7f17e41edf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.575+0000 7f17eb67c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f17e4151ea0 0x7f17e40c7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.575+0000 7f17eb67c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17e415f510 0x7f17e41f0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.575+0000 7f17eb67c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e41f1960 con 0x7f17e406dd50 2023-11-04T01:41:22.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.575+0000 7f17eb67c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e40c7060 con 0x7f17e415f510 2023-11-04T01:41:22.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.575+0000 7f17eb67c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17e414d880 con 0x7f17e4151ea0 2023-11-04T01:41:22.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.575+0000 7f17e9418640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17e406dd50 0x7f17e41edf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.575+0000 7f17e9418640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17e406dd50 0x7f17e41edf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40446/0 (socket says 172.21.15.77:40446) 2023-11-04T01:41:22.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.575+0000 7f17e9418640 1 -- 172.21.15.77:0/2051111896 learned_addr learned my addr 172.21.15.77:0/2051111896 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:22.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.576+0000 7f17e9c19640 1 --2- 172.21.15.77:0/2051111896 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17e415f510 0x7f17e41f0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.576+0000 7f17e8c17640 1 --2- 172.21.15.77:0/2051111896 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f17e4151ea0 0x7f17e40c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.576+0000 7f17e9418640 1 -- 172.21.15.77:0/2051111896 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f17e4151ea0 msgr2=0x7f17e40c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.576+0000 7f17e9418640 1 --2- 172.21.15.77:0/2051111896 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f17e4151ea0 0x7f17e40c7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.576+0000 7f17e9418640 1 -- 172.21.15.77:0/2051111896 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17e415f510 msgr2=0x7f17e41f0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:22.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.576+0000 7f17e9418640 1 --2- 172.21.15.77:0/2051111896 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17e415f510 0x7f17e41f0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:22.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.576+0000 7f17e9418640 1 -- 172.21.15.77:0/2051111896 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e0009a70 con 0x7f17e406dd50 2023-11-04T01:41:22.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.576+0000 7f17e9418640 1 --2- 172.21.15.77:0/2051111896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17e406dd50 0x7f17e41edf00 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f17e0009d90 tx=0x7f17e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:22.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.578+0000 7f17d9ffb640 1 -- 172.21.15.77:0/2051111896 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e0040650 con 0x7f17e406dd50 2023-11-04T01:41:22.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.578+0000 7f17d9ffb640 1 -- 172.21.15.77:0/2051111896 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e00407b0 con 0x7f17e406dd50 2023-11-04T01:41:22.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.578+0000 7f17eb67c640 1 -- 172.21.15.77:0/2051111896 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17e41f13a0 con 0x7f17e406dd50 2023-11-04T01:41:22.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.578+0000 7f17d9ffb640 1 -- 172.21.15.77:0/2051111896 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e0040b60 con 0x7f17e406dd50 2023-11-04T01:41:22.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.578+0000 7f17eb67c640 1 -- 172.21.15.77:0/2051111896 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e40c6c80 con 0x7f17e406dd50 2023-11-04T01:41:22.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.579+0000 7f17eb67c640 1 -- 172.21.15.77:0/2051111896 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17e40c71a0 con 0x7f17e406dd50 2023-11-04T01:41:22.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.579+0000 7f17d9ffb640 1 -- 172.21.15.77:0/2051111896 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f17e0040cc0 con 0x7f17e406dd50 2023-11-04T01:41:22.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.579+0000 7f17d9ffb640 1 --2- 172.21.15.77:0/2051111896 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f17c806ae70 0x7f17c806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:22.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.580+0000 7f17d9ffb640 1 -- 172.21.15.77:0/2051111896 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f17e00ac220 con 0x7f17e406dd50 2023-11-04T01:41:22.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.580+0000 7f17e8c17640 1 --2- 172.21.15.77:0/2051111896 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f17c806ae70 0x7f17c806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:22.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.580+0000 7f17e8c17640 1 --2- 172.21.15.77:0/2051111896 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f17c806ae70 0x7f17c806d330 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f17e40ca340 tx=0x7f17d4007c00 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:22.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.584+0000 7f17d9ffb640 1 -- 172.21.15.77:0/2051111896 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f17e0077610 con 0x7f17e406dd50 2023-11-04T01:41:22.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:22.750+0000 7f17eb67c640 1 -- 172.21.15.77:0/2051111896 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f17e404e490 con 0x7f17e406dd50 2023-11-04T01:41:23.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.578+0000 7f17d9ffb640 1 -- 172.21.15.77:0/2051111896 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7f17e007ac30 con 0x7f17e406dd50 2023-11-04T01:41:23.581 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_metadata' created 2023-11-04T01:41:23.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.582+0000 7f17eb67c640 1 -- 172.21.15.77:0/2051111896 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f17c806ae70 msgr2=0x7f17c806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:23.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.582+0000 7f17eb67c640 1 --2- 172.21.15.77:0/2051111896 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f17c806ae70 0x7f17c806d330 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f17e40ca340 tx=0x7f17d4007c00 comp rx=0 tx=0).stop 2023-11-04T01:41:23.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.582+0000 7f17eb67c640 1 -- 172.21.15.77:0/2051111896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17e406dd50 msgr2=0x7f17e41edf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:23.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.582+0000 7f17eb67c640 1 --2- 172.21.15.77:0/2051111896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17e406dd50 0x7f17e41edf00 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f17e0009d90 tx=0x7f17e0004a40 comp rx=0 tx=0).stop 2023-11-04T01:41:23.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.582+0000 7f17eb67c640 1 -- 172.21.15.77:0/2051111896 shutdown_connections 2023-11-04T01:41:23.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.582+0000 7f17eb67c640 1 --2- 172.21.15.77:0/2051111896 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f17c806ae70 0x7f17c806d330 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.582+0000 7f17eb67c640 1 --2- 172.21.15.77:0/2051111896 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17e415f510 0x7f17e41f0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.582+0000 7f17eb67c640 1 --2- 172.21.15.77:0/2051111896 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f17e4151ea0 0x7f17e40c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.582+0000 7f17eb67c640 1 --2- 172.21.15.77:0/2051111896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17e406dd50 0x7f17e41edf00 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.582+0000 7f17eb67c640 1 -- 172.21.15.77:0/2051111896 >> 172.21.15.77:0/2051111896 conn(0x7f17e40b05d0 msgr2=0x7f17e40b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:23.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.583+0000 7f17eb67c640 1 -- 172.21.15.77:0/2051111896 shutdown_connections 2023-11-04T01:41:23.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.583+0000 7f17eb67c640 1 -- 172.21.15.77:0/2051111896 wait complete. 2023-11-04T01:41:23.600 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T01:41:23.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.711+0000 7f544d590640 1 Processor -- start 2023-11-04T01:41:23.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.711+0000 7f544d590640 1 -- start start 2023-11-04T01:41:23.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.712+0000 7f544d590640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5448153e60 0x7f544815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:23.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.712+0000 7f544d590640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54480cd6d0 0x7f5448161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:23.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.712+0000 7f544d590640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54480cde60 con 0x7f54480b4880 2023-11-04T01:41:23.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.712+0000 7f544d590640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5448160f90 con 0x7f5448153e60 2023-11-04T01:41:23.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.712+0000 7f544d590640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f544815e400 con 0x7f54480cd6d0 2023-11-04T01:41:23.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.712+0000 7f5446ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5448153e60 0x7f544815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:23.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.712+0000 7f54477fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f54480b4880 0x7f54480b4ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44304/0 (socket says 172.21.15.77:44304) 2023-11-04T01:41:23.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.712+0000 7f54477fe640 1 -- 172.21.15.77:0/62418793 learned_addr learned my addr 172.21.15.77:0/62418793 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:23.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.712+0000 7f543ffff640 1 --2- 172.21.15.77:0/62418793 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54480cd6d0 0x7f5448161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:23.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.712+0000 7f5446ffd640 1 -- 172.21.15.77:0/62418793 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54480cd6d0 msgr2=0x7f5448161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:23.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.712+0000 7f5446ffd640 1 --2- 172.21.15.77:0/62418793 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54480cd6d0 0x7f5448161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.712+0000 7f5446ffd640 1 -- 172.21.15.77:0/62418793 >> v1:172.21.15.77:6789/0 conn(0x7f54480b4880 legacy=0x7f54480b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:23.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.712+0000 7f5446ffd640 1 -- 172.21.15.77:0/62418793 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5448161960 con 0x7f5448153e60 2023-11-04T01:41:23.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.712+0000 7f54467fc640 1 -- 172.21.15.77:0/62418793 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 156679666 0 0) 0x7f54480cde60 con 0x7f54480b4880 2023-11-04T01:41:23.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.713+0000 7f5446ffd640 1 --2- 172.21.15.77:0/62418793 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5448153e60 0x7f544815dec0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f54380097a0 tx=0x7f543802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25b4efee7d15522 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:23.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.713+0000 7f54467fc640 1 -- 172.21.15.77:0/62418793 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5438031830 con 0x7f5448153e60 2023-11-04T01:41:23.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.713+0000 7f54467fc640 1 -- 172.21.15.77:0/62418793 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5438031990 con 0x7f5448153e60 2023-11-04T01:41:23.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.713+0000 7f54467fc640 1 -- 172.21.15.77:0/62418793 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5438031d20 con 0x7f5448153e60 2023-11-04T01:41:23.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.713+0000 7f544d590640 1 -- 172.21.15.77:0/62418793 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5448153e60 msgr2=0x7f544815dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:23.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.713+0000 7f544d590640 1 --2- 172.21.15.77:0/62418793 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5448153e60 0x7f544815dec0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f54380097a0 tx=0x7f543802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.714+0000 7f544d590640 1 -- 172.21.15.77:0/62418793 shutdown_connections 2023-11-04T01:41:23.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.714+0000 7f544d590640 1 --2- 172.21.15.77:0/62418793 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54480cd6d0 0x7f5448161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.714+0000 7f544d590640 1 --2- 172.21.15.77:0/62418793 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5448153e60 0x7f544815dec0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.714+0000 7f544d590640 1 -- 172.21.15.77:0/62418793 >> 172.21.15.77:0/62418793 conn(0x7f54480cf880 msgr2=0x7f54480cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:23.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.714+0000 7f544d590640 1 -- 172.21.15.77:0/62418793 shutdown_connections 2023-11-04T01:41:23.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.714+0000 7f544d590640 1 -- 172.21.15.77:0/62418793 wait complete. 2023-11-04T01:41:23.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.715+0000 7f544d590640 1 Processor -- start 2023-11-04T01:41:23.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.715+0000 7f544d590640 1 -- start start 2023-11-04T01:41:23.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.715+0000 7f544d590640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54480b4880 0x7f5448150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:23.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.715+0000 7f544d590640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54480cd6d0 0x7f54480c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:23.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.715+0000 7f544d590640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5448153e60 0x7f54480c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:23.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.715+0000 7f544d590640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54480caea0 con 0x7f5448153e60 2023-11-04T01:41:23.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.715+0000 7f544d590640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54480c6a20 con 0x7f54480cd6d0 2023-11-04T01:41:23.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.715+0000 7f544d590640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54480cabc0 con 0x7f54480b4880 2023-11-04T01:41:23.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.716+0000 7f54477fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5448153e60 0x7f54480c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:23.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.716+0000 7f54477fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5448153e60 0x7f54480c9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40462/0 (socket says 172.21.15.77:40462) 2023-11-04T01:41:23.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.716+0000 7f54477fe640 1 -- 172.21.15.77:0/2291724161 learned_addr learned my addr 172.21.15.77:0/2291724161 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:23.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.716+0000 7f5446ffd640 1 --2- 172.21.15.77:0/2291724161 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54480b4880 0x7f5448150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:23.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.716+0000 7f543ffff640 1 --2- 172.21.15.77:0/2291724161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54480cd6d0 0x7f54480c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:23.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.716+0000 7f54477fe640 1 -- 172.21.15.77:0/2291724161 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54480b4880 msgr2=0x7f5448150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:23.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.716+0000 7f54477fe640 1 --2- 172.21.15.77:0/2291724161 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54480b4880 0x7f5448150590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.716+0000 7f54477fe640 1 -- 172.21.15.77:0/2291724161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54480cd6d0 msgr2=0x7f54480c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:23.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.716+0000 7f54477fe640 1 --2- 172.21.15.77:0/2291724161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54480cd6d0 0x7f54480c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:23.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.716+0000 7f54477fe640 1 -- 172.21.15.77:0/2291724161 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5438009400 con 0x7f5448153e60 2023-11-04T01:41:23.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.716+0000 7f543ffff640 1 --2- 172.21.15.77:0/2291724161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54480cd6d0 0x7f54480c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:23.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.716+0000 7f54477fe640 1 --2- 172.21.15.77:0/2291724161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5448153e60 0x7f54480c9000 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f544000c7e0 tx=0x7f544000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:23.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.716+0000 7f543f7fe640 1 -- 172.21.15.77:0/2291724161 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544000a640 con 0x7f5448153e60 2023-11-04T01:41:23.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.716+0000 7f543f7fe640 1 -- 172.21.15.77:0/2291724161 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544000a7c0 con 0x7f5448153e60 2023-11-04T01:41:23.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.716+0000 7f543f7fe640 1 -- 172.21.15.77:0/2291724161 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544000ab70 con 0x7f5448153e60 2023-11-04T01:41:23.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.716+0000 7f544d590640 1 -- 172.21.15.77:0/2291724161 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54480c6cc0 con 0x7f5448153e60 2023-11-04T01:41:23.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.716+0000 7f544d590640 1 -- 172.21.15.77:0/2291724161 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54481f2680 con 0x7f5448153e60 2023-11-04T01:41:23.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.717+0000 7f544d590640 1 -- 172.21.15.77:0/2291724161 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5448074290 con 0x7f5448153e60 2023-11-04T01:41:23.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.718+0000 7f543f7fe640 1 -- 172.21.15.77:0/2291724161 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f544000acd0 con 0x7f5448153e60 2023-11-04T01:41:23.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.718+0000 7f543f7fe640 1 --2- 172.21.15.77:0/2291724161 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f542806aea0 0x7f542806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:23.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.718+0000 7f543f7fe640 1 -- 172.21.15.77:0/2291724161 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f5440088c00 con 0x7f5448153e60 2023-11-04T01:41:23.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.718+0000 7f5446ffd640 1 --2- 172.21.15.77:0/2291724161 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f542806aea0 0x7f542806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:23.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.719+0000 7f5446ffd640 1 --2- 172.21.15.77:0/2291724161 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f542806aea0 0x7f542806d360 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5438036000 tx=0x7f543803c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:23.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.722+0000 7f543f7fe640 1 -- 172.21.15.77:0/2291724161 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5440053ec0 con 0x7f5448153e60 2023-11-04T01:41:23.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:23.889+0000 7f544d590640 1 -- 172.21.15.77:0/2291724161 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f54480d0b80 con 0x7f5448153e60 2023-11-04T01:41:24.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.586+0000 7f543f7fe640 1 -- 172.21.15.77:0/2291724161 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v36) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5440018020 con 0x7f5448153e60 2023-11-04T01:41:24.588 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data' created 2023-11-04T01:41:24.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.589+0000 7f544d590640 1 -- 172.21.15.77:0/2291724161 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f542806aea0 msgr2=0x7f542806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:24.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.589+0000 7f544d590640 1 --2- 172.21.15.77:0/2291724161 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f542806aea0 0x7f542806d360 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5438036000 tx=0x7f543803c040 comp rx=0 tx=0).stop 2023-11-04T01:41:24.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.589+0000 7f544d590640 1 -- 172.21.15.77:0/2291724161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5448153e60 msgr2=0x7f54480c9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:24.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.589+0000 7f544d590640 1 --2- 172.21.15.77:0/2291724161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5448153e60 0x7f54480c9000 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f544000c7e0 tx=0x7f544000cca0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.590+0000 7f544d590640 1 -- 172.21.15.77:0/2291724161 shutdown_connections 2023-11-04T01:41:24.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.590+0000 7f544d590640 1 --2- 172.21.15.77:0/2291724161 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f542806aea0 0x7f542806d360 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.590+0000 7f544d590640 1 --2- 172.21.15.77:0/2291724161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5448153e60 0x7f54480c9000 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.590+0000 7f544d590640 1 --2- 172.21.15.77:0/2291724161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54480cd6d0 0x7f54480c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.590+0000 7f544d590640 1 --2- 172.21.15.77:0/2291724161 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54480b4880 0x7f5448150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.590+0000 7f544d590640 1 -- 172.21.15.77:0/2291724161 >> 172.21.15.77:0/2291724161 conn(0x7f54480cf880 msgr2=0x7f54480cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:24.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.590+0000 7f544d590640 1 -- 172.21.15.77:0/2291724161 shutdown_connections 2023-11-04T01:41:24.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.590+0000 7f544d590640 1 -- 172.21.15.77:0/2291724161 wait complete. 2023-11-04T01:41:24.614 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T01:41:24.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.719+0000 7f99270c2640 1 Processor -- start 2023-11-04T01:41:24.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.719+0000 7f99270c2640 1 -- start start 2023-11-04T01:41:24.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.719+0000 7f99270c2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f992015ad30 0x7f99200adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:24.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.719+0000 7f99270c2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9920070e20 0x7f992015e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:24.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.719+0000 7f99270c2640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99200c3900 con 0x7f99200ad730 2023-11-04T01:41:24.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.719+0000 7f99270c2640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99200ae260 con 0x7f9920070e20 2023-11-04T01:41:24.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.719+0000 7f99270c2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99200c3be0 con 0x7f992015ad30 2023-11-04T01:41:24.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.720+0000 7f992565f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9920070e20 0x7f992015e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:24.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.720+0000 7f992565f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9920070e20 0x7f992015e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40478/0 (socket says 172.21.15.77:40478) 2023-11-04T01:41:24.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.720+0000 7f992565f640 1 -- 172.21.15.77:0/3731403702 learned_addr learned my addr 172.21.15.77:0/3731403702 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:24.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.720+0000 7f9924e5e640 1 --2- 172.21.15.77:0/3731403702 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f992015ad30 0x7f99200adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:24.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.720+0000 7f992565f640 1 -- 172.21.15.77:0/3731403702 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f992015ad30 msgr2=0x7f99200adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:24.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.720+0000 7f992565f640 1 --2- 172.21.15.77:0/3731403702 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f992015ad30 0x7f99200adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.720+0000 7f992565f640 1 -- 172.21.15.77:0/3731403702 >> v1:172.21.15.122:6789/0 conn(0x7f99200ad730 legacy=0x7f9920070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:24.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.720+0000 7f992565f640 1 -- 172.21.15.77:0/3731403702 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99200c3ec0 con 0x7f9920070e20 2023-11-04T01:41:24.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.721+0000 7f992565f640 1 --2- 172.21.15.77:0/3731403702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9920070e20 0x7f992015e740 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9918009e50 tx=0x7f991802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e5ecd69cabf775 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:24.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.721+0000 7f991f7fe640 1 -- 172.21.15.77:0/3731403702 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991802ca70 con 0x7f9920070e20 2023-11-04T01:41:24.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.721+0000 7f991f7fe640 1 -- 172.21.15.77:0/3731403702 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991802cbd0 con 0x7f9920070e20 2023-11-04T01:41:24.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.721+0000 7f991f7fe640 1 -- 172.21.15.77:0/3731403702 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99180343f0 con 0x7f9920070e20 2023-11-04T01:41:24.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.721+0000 7f99270c2640 1 -- 172.21.15.77:0/3731403702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9920070e20 msgr2=0x7f992015e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:24.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.721+0000 7f99270c2640 1 --2- 172.21.15.77:0/3731403702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9920070e20 0x7f992015e740 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9918009e50 tx=0x7f991802bed0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.721+0000 7f99270c2640 1 -- 172.21.15.77:0/3731403702 shutdown_connections 2023-11-04T01:41:24.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.721+0000 7f99270c2640 1 --2- 172.21.15.77:0/3731403702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9920070e20 0x7f992015e740 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.721+0000 7f99270c2640 1 --2- 172.21.15.77:0/3731403702 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f992015ad30 0x7f99200adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.721+0000 7f99270c2640 1 -- 172.21.15.77:0/3731403702 >> 172.21.15.77:0/3731403702 conn(0x7f99200ce950 msgr2=0x7f99200ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:24.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.721+0000 7f99270c2640 1 -- 172.21.15.77:0/3731403702 shutdown_connections 2023-11-04T01:41:24.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.721+0000 7f99270c2640 1 -- 172.21.15.77:0/3731403702 wait complete. 2023-11-04T01:41:24.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.723+0000 7f99270c2640 1 Processor -- start 2023-11-04T01:41:24.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.723+0000 7f99270c2640 1 -- start start 2023-11-04T01:41:24.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.723+0000 7f99270c2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9920070e20 0x7f9920158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:24.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.723+0000 7f99270c2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99200ad730 0x7f9920150790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:24.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.723+0000 7f99270c2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f992015ad30 0x7f9920153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:24.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.723+0000 7f99270c2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99201594f0 con 0x7f99200ad730 2023-11-04T01:41:24.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.723+0000 7f99270c2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9920159270 con 0x7f992015ad30 2023-11-04T01:41:24.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.723+0000 7f99270c2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99200cd1d0 con 0x7f9920070e20 2023-11-04T01:41:24.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.724+0000 7f991ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99200ad730 0x7f9920150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:24.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.724+0000 7f991ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99200ad730 0x7f9920150790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40490/0 (socket says 172.21.15.77:40490) 2023-11-04T01:41:24.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.724+0000 7f991ffff640 1 -- 172.21.15.77:0/3005971583 learned_addr learned my addr 172.21.15.77:0/3005971583 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:24.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.724+0000 7f992565f640 1 --2- 172.21.15.77:0/3005971583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f992015ad30 0x7f9920153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:24.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.724+0000 7f991ffff640 1 -- 172.21.15.77:0/3005971583 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9920070e20 msgr2=0x7f9920158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:24.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.724+0000 7f9924e5e640 1 --2- 172.21.15.77:0/3005971583 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9920070e20 0x7f9920158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:24.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.724+0000 7f991ffff640 1 --2- 172.21.15.77:0/3005971583 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9920070e20 0x7f9920158d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.724+0000 7f991ffff640 1 -- 172.21.15.77:0/3005971583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f992015ad30 msgr2=0x7f9920153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:24.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.724+0000 7f991ffff640 1 --2- 172.21.15.77:0/3005971583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f992015ad30 0x7f9920153340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:24.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.724+0000 7f991ffff640 1 -- 172.21.15.77:0/3005971583 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9918009b30 con 0x7f99200ad730 2023-11-04T01:41:24.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.724+0000 7f991ffff640 1 --2- 172.21.15.77:0/3005971583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99200ad730 0x7f9920150790 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f990c00c450 tx=0x7f990c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:24.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.724+0000 7f991d7fa640 1 -- 172.21.15.77:0/3005971583 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c0052d0 con 0x7f99200ad730 2023-11-04T01:41:24.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.724+0000 7f991d7fa640 1 -- 172.21.15.77:0/3005971583 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990c005430 con 0x7f99200ad730 2023-11-04T01:41:24.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.724+0000 7f99270c2640 1 -- 172.21.15.77:0/3005971583 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99200cd4b0 con 0x7f99200ad730 2023-11-04T01:41:24.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.724+0000 7f991d7fa640 1 -- 172.21.15.77:0/3005971583 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c012870 con 0x7f99200ad730 2023-11-04T01:41:24.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.724+0000 7f99270c2640 1 -- 172.21.15.77:0/3005971583 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99200cda70 con 0x7f99200ad730 2023-11-04T01:41:24.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.725+0000 7f99270c2640 1 -- 172.21.15.77:0/3005971583 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9920074290 con 0x7f99200ad730 2023-11-04T01:41:24.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.726+0000 7f991d7fa640 1 -- 172.21.15.77:0/3005971583 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f990c0129d0 con 0x7f99200ad730 2023-11-04T01:41:24.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.726+0000 7f991d7fa640 1 --2- 172.21.15.77:0/3005971583 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f990406ae70 0x7f990406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:24.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.726+0000 7f991d7fa640 1 -- 172.21.15.77:0/3005971583 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f990c089280 con 0x7f99200ad730 2023-11-04T01:41:24.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.726+0000 7f9924e5e640 1 --2- 172.21.15.77:0/3005971583 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f990406ae70 0x7f990406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:24.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.727+0000 7f9924e5e640 1 --2- 172.21.15.77:0/3005971583 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f990406ae70 0x7f990406d330 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9914006fd0 tx=0x7f9914008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:24.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.730+0000 7f991d7fa640 1 -- 172.21.15.77:0/3005971583 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f990c0541c0 con 0x7f99200ad730 2023-11-04T01:41:24.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:24.931+0000 7f99270c2640 1 -- 172.21.15.77:0/3005971583 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9920071970 con 0x7f99200ad730 2023-11-04T01:41:25.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.587+0000 7f991d7fa640 1 -- 172.21.15.77:0/3005971583 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f990c0577e0 con 0x7f99200ad730 2023-11-04T01:41:25.589 INFO:teuthology.orchestra.run.smithi077.stderr:new fs with metadata pool 5 and data pool 6 2023-11-04T01:41:25.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.589+0000 7f99270c2640 1 -- 172.21.15.77:0/3005971583 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f990406ae70 msgr2=0x7f990406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:25.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.589+0000 7f99270c2640 1 --2- 172.21.15.77:0/3005971583 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f990406ae70 0x7f990406d330 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9914006fd0 tx=0x7f9914008040 comp rx=0 tx=0).stop 2023-11-04T01:41:25.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.589+0000 7f99270c2640 1 -- 172.21.15.77:0/3005971583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99200ad730 msgr2=0x7f9920150790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:25.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.589+0000 7f99270c2640 1 --2- 172.21.15.77:0/3005971583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99200ad730 0x7f9920150790 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f990c00c450 tx=0x7f990c00c910 comp rx=0 tx=0).stop 2023-11-04T01:41:25.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.589+0000 7f99270c2640 1 -- 172.21.15.77:0/3005971583 shutdown_connections 2023-11-04T01:41:25.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.589+0000 7f99270c2640 1 --2- 172.21.15.77:0/3005971583 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f990406ae70 0x7f990406d330 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.589+0000 7f99270c2640 1 --2- 172.21.15.77:0/3005971583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f992015ad30 0x7f9920153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.589+0000 7f99270c2640 1 --2- 172.21.15.77:0/3005971583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99200ad730 0x7f9920150790 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.589+0000 7f99270c2640 1 --2- 172.21.15.77:0/3005971583 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9920070e20 0x7f9920158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.589+0000 7f99270c2640 1 -- 172.21.15.77:0/3005971583 >> 172.21.15.77:0/3005971583 conn(0x7f99200ce950 msgr2=0x7f99200b03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:25.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.589+0000 7f99270c2640 1 -- 172.21.15.77:0/3005971583 shutdown_connections 2023-11-04T01:41:25.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.589+0000 7f99270c2640 1 -- 172.21.15.77:0/3005971583 wait complete. 2023-11-04T01:41:25.606 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:25.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.708+0000 7f34a1739640 1 Processor -- start 2023-11-04T01:41:25.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.708+0000 7f34a1739640 1 -- start start 2023-11-04T01:41:25.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.709+0000 7f34a1739640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f349c0b42c0 0x7f349c0c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:25.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.709+0000 7f34a1739640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f349c0c9c40 0x7f349c0b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:25.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.709+0000 7f34a1739640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f349c0ca090 con 0x7f349c15ad80 2023-11-04T01:41:25.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.709+0000 7f34a1739640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f349c06cfa0 con 0x7f349c0c9c40 2023-11-04T01:41:25.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.709+0000 7f34a1739640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349c06d280 con 0x7f349c0b42c0 2023-11-04T01:41:25.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.709+0000 7f349b7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f349c0c9c40 0x7f349c0b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:25.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.709+0000 7f349affd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f349c15ad80 0x7f349c06c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44318/0 (socket says 172.21.15.77:44318) 2023-11-04T01:41:25.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.709+0000 7f349affd640 1 -- 172.21.15.77:0/3192605777 learned_addr learned my addr 172.21.15.77:0/3192605777 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:25.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.709+0000 7f349b7fe640 1 -- 172.21.15.77:0/3192605777 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f349c0b42c0 msgr2=0x7f349c0c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:25.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.709+0000 7f349a7fc640 1 --2- 172.21.15.77:0/3192605777 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f349c0b42c0 0x7f349c0c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:25.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.709+0000 7f3499ffb640 1 -- 172.21.15.77:0/3192605777 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2706908296 0 0) 0x7f348c001490 con 0x7f349c15ad80 2023-11-04T01:41:25.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.709+0000 7f349b7fe640 1 --2- 172.21.15.77:0/3192605777 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f349c0b42c0 0x7f349c0c9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.709+0000 7f349b7fe640 1 -- 172.21.15.77:0/3192605777 >> v1:172.21.15.77:6789/0 conn(0x7f349c15ad80 legacy=0x7f349c06c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:25.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.709+0000 7f349b7fe640 1 -- 172.21.15.77:0/3192605777 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349c06d560 con 0x7f349c0c9c40 2023-11-04T01:41:25.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.710+0000 7f349b7fe640 1 --2- 172.21.15.77:0/3192605777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f349c0c9c40 0x7f349c0b1a40 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f34940097a0 tx=0x7f349402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e80949b7d36d7fa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:25.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.710+0000 7f3499ffb640 1 -- 172.21.15.77:0/3192605777 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3494030610 con 0x7f349c0c9c40 2023-11-04T01:41:25.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.710+0000 7f3499ffb640 1 -- 172.21.15.77:0/3192605777 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3494030770 con 0x7f349c0c9c40 2023-11-04T01:41:25.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.710+0000 7f3499ffb640 1 -- 172.21.15.77:0/3192605777 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3494030b00 con 0x7f349c0c9c40 2023-11-04T01:41:25.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.711+0000 7f34a1739640 1 -- 172.21.15.77:0/3192605777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f349c0c9c40 msgr2=0x7f349c0b1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:25.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.711+0000 7f34a1739640 1 --2- 172.21.15.77:0/3192605777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f349c0c9c40 0x7f349c0b1a40 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f34940097a0 tx=0x7f349402b960 comp rx=0 tx=0).stop 2023-11-04T01:41:25.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.711+0000 7f34a1739640 1 -- 172.21.15.77:0/3192605777 shutdown_connections 2023-11-04T01:41:25.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.711+0000 7f34a1739640 1 --2- 172.21.15.77:0/3192605777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f349c0c9c40 0x7f349c0b1a40 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.711+0000 7f34a1739640 1 --2- 172.21.15.77:0/3192605777 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f349c0b42c0 0x7f349c0c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.711+0000 7f34a1739640 1 -- 172.21.15.77:0/3192605777 >> 172.21.15.77:0/3192605777 conn(0x7f349c0ce950 msgr2=0x7f349c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:25.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.711+0000 7f34a1739640 1 -- 172.21.15.77:0/3192605777 shutdown_connections 2023-11-04T01:41:25.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.711+0000 7f34a1739640 1 -- 172.21.15.77:0/3192605777 wait complete. 2023-11-04T01:41:25.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.712+0000 7f34a1739640 1 Processor -- start 2023-11-04T01:41:25.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.712+0000 7f34a1739640 1 -- start start 2023-11-04T01:41:25.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.713+0000 7f34a1739640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f349c0b42c0 0x7f349c1f10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:25.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.713+0000 7f34a1739640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f349c0c9c40 0x7f349c15c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:25.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.713+0000 7f34a1739640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f349c15ad80 0x7f349c1ed8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:25.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.713+0000 7f34a1739640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349c0c52b0 con 0x7f349c0b42c0 2023-11-04T01:41:25.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.713+0000 7f34a1739640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349c1f15e0 con 0x7f349c15ad80 2023-11-04T01:41:25.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.713+0000 7f34a1739640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349c15cac0 con 0x7f349c0c9c40 2023-11-04T01:41:25.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.713+0000 7f349affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f349c0b42c0 0x7f349c1f10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:25.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.713+0000 7f349affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f349c0b42c0 0x7f349c1f10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40512/0 (socket says 172.21.15.77:40512) 2023-11-04T01:41:25.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.713+0000 7f349affd640 1 -- 172.21.15.77:0/2920836044 learned_addr learned my addr 172.21.15.77:0/2920836044 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:25.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.713+0000 7f349a7fc640 1 --2- 172.21.15.77:0/2920836044 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f349c0c9c40 0x7f349c15c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:25.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.713+0000 7f349affd640 1 -- 172.21.15.77:0/2920836044 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f349c0c9c40 msgr2=0x7f349c15c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:25.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.713+0000 7f349b7fe640 1 --2- 172.21.15.77:0/2920836044 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f349c15ad80 0x7f349c1ed8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:25.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.713+0000 7f349affd640 1 --2- 172.21.15.77:0/2920836044 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f349c0c9c40 0x7f349c15c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.713+0000 7f349affd640 1 -- 172.21.15.77:0/2920836044 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f349c15ad80 msgr2=0x7f349c1ed8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:25.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.713+0000 7f349affd640 1 --2- 172.21.15.77:0/2920836044 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f349c15ad80 0x7f349c1ed8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.713+0000 7f349affd640 1 -- 172.21.15.77:0/2920836044 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3494009400 con 0x7f349c0b42c0 2023-11-04T01:41:25.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.713+0000 7f349a7fc640 1 --2- 172.21.15.77:0/2920836044 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f349c0c9c40 0x7f349c15c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:25.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.713+0000 7f349b7fe640 1 --2- 172.21.15.77:0/2920836044 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f349c15ad80 0x7f349c1ed8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:25.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.713+0000 7f349affd640 1 --2- 172.21.15.77:0/2920836044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f349c0b42c0 0x7f349c1f10a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f348c00c890 tx=0x7f348c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:25.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.714+0000 7f34837fe640 1 -- 172.21.15.77:0/2920836044 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c00a640 con 0x7f349c0b42c0 2023-11-04T01:41:25.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.714+0000 7f34837fe640 1 -- 172.21.15.77:0/2920836044 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348c00a7a0 con 0x7f349c0b42c0 2023-11-04T01:41:25.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.714+0000 7f34a1739640 1 -- 172.21.15.77:0/2920836044 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f349c15b4e0 con 0x7f349c0b42c0 2023-11-04T01:41:25.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.714+0000 7f34837fe640 1 -- 172.21.15.77:0/2920836044 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c00ab30 con 0x7f349c0b42c0 2023-11-04T01:41:25.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.714+0000 7f34a1739640 1 -- 172.21.15.77:0/2920836044 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f349c15b870 con 0x7f349c0b42c0 2023-11-04T01:41:25.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.715+0000 7f34a1739640 1 -- 172.21.15.77:0/2920836044 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f349c074290 con 0x7f349c0b42c0 2023-11-04T01:41:25.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.715+0000 7f34837fe640 1 -- 172.21.15.77:0/2920836044 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f348c00ac90 con 0x7f349c0b42c0 2023-11-04T01:41:25.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.715+0000 7f34837fe640 1 --2- 172.21.15.77:0/2920836044 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f348806ae70 0x7f348806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:25.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.715+0000 7f34837fe640 1 -- 172.21.15.77:0/2920836044 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f348c088ec0 con 0x7f349c0b42c0 2023-11-04T01:41:25.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.716+0000 7f349a7fc640 1 --2- 172.21.15.77:0/2920836044 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f348806ae70 0x7f348806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:25.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.716+0000 7f349a7fc640 1 --2- 172.21.15.77:0/2920836044 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f348806ae70 0x7f348806d330 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f349c15e400 tx=0x7f3490008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:25.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.720+0000 7f34837fe640 1 -- 172.21.15.77:0/2920836044 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f348c053e30 con 0x7f349c0b42c0 2023-11-04T01:41:25.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.890+0000 7f34a1739640 1 -- 172.21.15.77:0/2920836044 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f349c0ca090 con 0x7f349c0b42c0 2023-11-04T01:41:25.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.891+0000 7f34837fe640 1 -- 172.21.15.77:0/2920836044 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16775 (secure 0 0 0) 0x7f349c0ca090 con 0x7f349c0b42c0 2023-11-04T01:41:25.893 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:25.893 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":37,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:41:24.932755+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:41:22.769937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-04T01:41:23.907965+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:25.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.893+0000 7f34a1739640 1 -- 172.21.15.77:0/2920836044 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f348806ae70 msgr2=0x7f348806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:25.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.893+0000 7f34a1739640 1 --2- 172.21.15.77:0/2920836044 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f348806ae70 0x7f348806d330 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f349c15e400 tx=0x7f3490008040 comp rx=0 tx=0).stop 2023-11-04T01:41:25.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.893+0000 7f34a1739640 1 -- 172.21.15.77:0/2920836044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f349c0b42c0 msgr2=0x7f349c1f10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:25.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.893+0000 7f34a1739640 1 --2- 172.21.15.77:0/2920836044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f349c0b42c0 0x7f349c1f10a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f348c00c890 tx=0x7f348c00cd50 comp rx=0 tx=0).stop 2023-11-04T01:41:25.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.893+0000 7f34a1739640 1 -- 172.21.15.77:0/2920836044 shutdown_connections 2023-11-04T01:41:25.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.893+0000 7f34a1739640 1 --2- 172.21.15.77:0/2920836044 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f348806ae70 0x7f348806d330 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.893+0000 7f34a1739640 1 --2- 172.21.15.77:0/2920836044 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f349c15ad80 0x7f349c1ed8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.893+0000 7f34a1739640 1 --2- 172.21.15.77:0/2920836044 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f349c0c9c40 0x7f349c15c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.893+0000 7f34a1739640 1 --2- 172.21.15.77:0/2920836044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f349c0b42c0 0x7f349c1f10a0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:25.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.893+0000 7f34a1739640 1 -- 172.21.15.77:0/2920836044 >> 172.21.15.77:0/2920836044 conn(0x7f349c0ce950 msgr2=0x7f349c0aefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:25.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.893+0000 7f34a1739640 1 -- 172.21.15.77:0/2920836044 shutdown_connections 2023-11-04T01:41:25.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:25.893+0000 7f34a1739640 1 -- 172.21.15.77:0/2920836044 wait complete. 2023-11-04T01:41:25.906 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:26.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.004+0000 7fe461b68640 1 Processor -- start 2023-11-04T01:41:26.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.004+0000 7fe461b68640 1 -- start start 2023-11-04T01:41:26.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.005+0000 7fe461b68640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe45c15ad80 0x7fe45c06c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.005+0000 7fe461b68640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe45c06cd00 con 0x7fe45c0c9e10 2023-11-04T01:41:26.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.005+0000 7fe461b68640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe45c06cfa0 con 0x7fe45c0b42c0 2023-11-04T01:41:26.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.005+0000 7fe461b68640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe45c06d280 con 0x7fe45c15ad80 2023-11-04T01:41:26.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.005+0000 7fe45bfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe45c0c9e10 0x7fe45c0b1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44324/0 (socket says 172.21.15.77:44324) 2023-11-04T01:41:26.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.005+0000 7fe45bfff640 1 -- 172.21.15.77:0/2708059427 learned_addr learned my addr 172.21.15.77:0/2708059427 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:26.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.006+0000 7fe45b7fe640 1 --2- 172.21.15.77:0/2708059427 >> v2:172.21.15.122:3300/0 conn(0x7fe45c15ad80 0x7fe45c06c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.006+0000 7fe45a7fc640 1 -- 172.21.15.77:0/2708059427 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1558402009 0 0) 0x7fe45c06cd00 con 0x7fe45c0c9e10 2023-11-04T01:41:26.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.006+0000 7fe45a7fc640 1 -- 172.21.15.77:0/2708059427 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe444003520 con 0x7fe45c0c9e10 2023-11-04T01:41:26.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.006+0000 7fe45a7fc640 1 -- 172.21.15.77:0/2708059427 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2865065637 0 0) 0x7fe444003520 con 0x7fe45c0c9e10 2023-11-04T01:41:26.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.006+0000 7fe45a7fc640 1 -- 172.21.15.77:0/2708059427 >> v2:172.21.15.122:3300/0 conn(0x7fe45c15ad80 msgr2=0x7fe45c06c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:26.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.006+0000 7fe45a7fc640 1 --2- 172.21.15.77:0/2708059427 >> v2:172.21.15.122:3300/0 conn(0x7fe45c15ad80 0x7fe45c06c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.006+0000 7fe45a7fc640 1 -- 172.21.15.77:0/2708059427 >> v1:172.21.15.122:6789/0 conn(0x7fe45c0b42c0 legacy=0x7fe45c0c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:26.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.006+0000 7fe45a7fc640 1 -- 172.21.15.77:0/2708059427 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45c06d560 con 0x7fe45c0c9e10 2023-11-04T01:41:26.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.006+0000 7fe45a7fc640 1 -- 172.21.15.77:0/2708059427 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7fe4540019f0 con 0x7fe45c0c9e10 2023-11-04T01:41:26.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.006+0000 7fe45a7fc640 1 -- 172.21.15.77:0/2708059427 >> v1:172.21.15.77:6789/0 conn(0x7fe45c0c9e10 legacy=0x7fe45c0b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:26.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.006+0000 7fe45a7fc640 1 --2- 172.21.15.77:0/2708059427 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe444003970 0x7fe444003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.006+0000 7fe45a7fc640 1 --2- 172.21.15.77:0/2708059427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4440047c0 0x7fe444004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.006+0000 7fe45a7fc640 1 --2- 172.21.15.77:0/2708059427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe444005180 0x7fe44400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.006+0000 7fe45a7fc640 1 -- 172.21.15.77:0/2708059427 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c06d280 con 0x7fe4440047c0 2023-11-04T01:41:26.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.006+0000 7fe45a7fc640 1 -- 172.21.15.77:0/2708059427 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44400c030 con 0x7fe444005180 2023-11-04T01:41:26.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.006+0000 7fe45a7fc640 1 -- 172.21.15.77:0/2708059427 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe44400c1f0 con 0x7fe444003970 2023-11-04T01:41:26.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.006+0000 7fe45affd640 1 --2- 172.21.15.77:0/2708059427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4440047c0 0x7fe444004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.006+0000 7fe45b7fe640 1 --2- 172.21.15.77:0/2708059427 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe444003970 0x7fe444003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.006+0000 7fe45bfff640 1 --2- 172.21.15.77:0/2708059427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe444005180 0x7fe44400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.006+0000 7fe45affd640 1 -- 172.21.15.77:0/2708059427 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe444003970 msgr2=0x7fe444003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:26.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.006+0000 7fe45affd640 1 --2- 172.21.15.77:0/2708059427 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe444003970 0x7fe444003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.006+0000 7fe45affd640 1 -- 172.21.15.77:0/2708059427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe444005180 msgr2=0x7fe44400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:26.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.006+0000 7fe45affd640 1 --2- 172.21.15.77:0/2708059427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe444005180 0x7fe44400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.006+0000 7fe45affd640 1 -- 172.21.15.77:0/2708059427 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe444003520 con 0x7fe4440047c0 2023-11-04T01:41:26.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.006+0000 7fe45bfff640 1 --2- 172.21.15.77:0/2708059427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe444005180 0x7fe44400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:26.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.006+0000 7fe45bfff640 1 -- 172.21.15.77:0/2708059427 reap_dead start 2023-11-04T01:41:26.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.007+0000 7fe45affd640 1 --2- 172.21.15.77:0/2708059427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4440047c0 0x7fe444004c40 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe450001750 tx=0x7fe4440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a8efa5d7778cc7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:26.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.007+0000 7fe45a7fc640 1 -- 172.21.15.77:0/2708059427 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4500052d0 con 0x7fe4440047c0 2023-11-04T01:41:26.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.007+0000 7fe45a7fc640 1 -- 172.21.15.77:0/2708059427 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe45002e050 con 0x7fe4440047c0 2023-11-04T01:41:26.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.007+0000 7fe45a7fc640 1 -- 172.21.15.77:0/2708059427 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe450003830 con 0x7fe4440047c0 2023-11-04T01:41:26.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.008+0000 7fe461b68640 1 -- 172.21.15.77:0/2708059427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4440047c0 msgr2=0x7fe444004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:26.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.008+0000 7fe461b68640 1 --2- 172.21.15.77:0/2708059427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4440047c0 0x7fe444004c40 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe450001750 tx=0x7fe4440057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.008+0000 7fe461b68640 1 -- 172.21.15.77:0/2708059427 shutdown_connections 2023-11-04T01:41:26.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.008+0000 7fe461b68640 1 --2- 172.21.15.77:0/2708059427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4440047c0 0x7fe444004c40 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.008+0000 7fe461b68640 1 -- 172.21.15.77:0/2708059427 >> 172.21.15.77:0/2708059427 conn(0x7fe45c0ce950 msgr2=0x7fe45c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:26.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.008+0000 7fe461b68640 1 -- 172.21.15.77:0/2708059427 shutdown_connections 2023-11-04T01:41:26.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.008+0000 7fe461b68640 1 -- 172.21.15.77:0/2708059427 wait complete. 2023-11-04T01:41:26.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.009+0000 7fe461b68640 1 Processor -- start 2023-11-04T01:41:26.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.009+0000 7fe461b68640 1 -- start start 2023-11-04T01:41:26.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.010+0000 7fe461b68640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4440047c0 0x7fe45c14ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.010+0000 7fe461b68640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe45c1599d0 0x7fe45c14d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.010+0000 7fe461b68640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe45c159e50 0x7fe45c15d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.010+0000 7fe461b68640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c1597b0 con 0x7fe4440047c0 2023-11-04T01:41:26.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.010+0000 7fe461b68640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c14d3a0 con 0x7fe45c159e50 2023-11-04T01:41:26.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.010+0000 7fe461b68640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c15c4e0 con 0x7fe45c1599d0 2023-11-04T01:41:26.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.010+0000 7fe45b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4440047c0 0x7fe45c14ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.010+0000 7fe45b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4440047c0 0x7fe45c14ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40532/0 (socket says 172.21.15.77:40532) 2023-11-04T01:41:26.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.010+0000 7fe45b7fe640 1 -- 172.21.15.77:0/2900007916 learned_addr learned my addr 172.21.15.77:0/2900007916 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:26.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.010+0000 7fe45affd640 1 --2- 172.21.15.77:0/2900007916 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe45c1599d0 0x7fe45c14d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.010+0000 7fe45bfff640 1 --2- 172.21.15.77:0/2900007916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe45c159e50 0x7fe45c15d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.010+0000 7fe45b7fe640 1 -- 172.21.15.77:0/2900007916 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe45c1599d0 msgr2=0x7fe45c14d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:26.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.010+0000 7fe45b7fe640 1 --2- 172.21.15.77:0/2900007916 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe45c1599d0 0x7fe45c14d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.010+0000 7fe45b7fe640 1 -- 172.21.15.77:0/2900007916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe45c159e50 msgr2=0x7fe45c15d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:26.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.010+0000 7fe45b7fe640 1 --2- 172.21.15.77:0/2900007916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe45c159e50 0x7fe45c15d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.010+0000 7fe45b7fe640 1 -- 172.21.15.77:0/2900007916 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45c15c7c0 con 0x7fe4440047c0 2023-11-04T01:41:26.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.010+0000 7fe45affd640 1 --2- 172.21.15.77:0/2900007916 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe45c1599d0 0x7fe45c14d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:26.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.010+0000 7fe45b7fe640 1 --2- 172.21.15.77:0/2900007916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4440047c0 0x7fe45c14ce60 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe44c011a70 tx=0x7fe44c011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:26.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.010+0000 7fe443fff640 1 -- 172.21.15.77:0/2900007916 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c009680 con 0x7fe4440047c0 2023-11-04T01:41:26.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.011+0000 7fe443fff640 1 -- 172.21.15.77:0/2900007916 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe44c00fb50 con 0x7fe4440047c0 2023-11-04T01:41:26.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.011+0000 7fe461b68640 1 -- 172.21.15.77:0/2900007916 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe45c15caa0 con 0x7fe4440047c0 2023-11-04T01:41:26.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.011+0000 7fe443fff640 1 -- 172.21.15.77:0/2900007916 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c00fee0 con 0x7fe4440047c0 2023-11-04T01:41:26.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.011+0000 7fe461b68640 1 -- 172.21.15.77:0/2900007916 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe45c15d060 con 0x7fe4440047c0 2023-11-04T01:41:26.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.011+0000 7fe461b68640 1 -- 172.21.15.77:0/2900007916 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe45c074290 con 0x7fe4440047c0 2023-11-04T01:41:26.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.012+0000 7fe443fff640 1 -- 172.21.15.77:0/2900007916 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe44c014440 con 0x7fe4440047c0 2023-11-04T01:41:26.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.012+0000 7fe443fff640 1 --2- 172.21.15.77:0/2900007916 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe44806ae70 0x7fe44806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.012+0000 7fe443fff640 1 -- 172.21.15.77:0/2900007916 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe44c08a080 con 0x7fe4440047c0 2023-11-04T01:41:26.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.013+0000 7fe45affd640 1 --2- 172.21.15.77:0/2900007916 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe44806ae70 0x7fe44806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.013+0000 7fe45affd640 1 --2- 172.21.15.77:0/2900007916 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe44806ae70 0x7fe44806d330 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe450033000 tx=0x7fe450009030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:26.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.016+0000 7fe443fff640 1 -- 172.21.15.77:0/2900007916 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe44c054ff0 con 0x7fe4440047c0 2023-11-04T01:41:26.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.182+0000 7fe461b68640 1 -- 172.21.15.77:0/2900007916 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe45c15e2b0 con 0x7fe4440047c0 2023-11-04T01:41:26.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.184+0000 7fe443fff640 1 -- 172.21.15.77:0/2900007916 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16775 (secure 0 0 0) 0x7fe44c058610 con 0x7fe4440047c0 2023-11-04T01:41:26.186 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:26.186 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":37,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:41:24.932755+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:41:22.769937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-04T01:41:23.907965+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:26.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.185+0000 7fe461b68640 1 -- 172.21.15.77:0/2900007916 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe44806ae70 msgr2=0x7fe44806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:26.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.185+0000 7fe461b68640 1 --2- 172.21.15.77:0/2900007916 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe44806ae70 0x7fe44806d330 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe450033000 tx=0x7fe450009030 comp rx=0 tx=0).stop 2023-11-04T01:41:26.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.185+0000 7fe461b68640 1 -- 172.21.15.77:0/2900007916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4440047c0 msgr2=0x7fe45c14ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:26.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.185+0000 7fe461b68640 1 --2- 172.21.15.77:0/2900007916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4440047c0 0x7fe45c14ce60 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe44c011a70 tx=0x7fe44c011f30 comp rx=0 tx=0).stop 2023-11-04T01:41:26.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.185+0000 7fe461b68640 1 -- 172.21.15.77:0/2900007916 shutdown_connections 2023-11-04T01:41:26.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.185+0000 7fe461b68640 1 --2- 172.21.15.77:0/2900007916 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe44806ae70 0x7fe44806d330 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.185+0000 7fe461b68640 1 --2- 172.21.15.77:0/2900007916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe45c159e50 0x7fe45c15d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.185+0000 7fe461b68640 1 --2- 172.21.15.77:0/2900007916 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe45c1599d0 0x7fe45c14d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.185+0000 7fe461b68640 1 --2- 172.21.15.77:0/2900007916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4440047c0 0x7fe45c14ce60 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.185+0000 7fe461b68640 1 -- 172.21.15.77:0/2900007916 >> 172.21.15.77:0/2900007916 conn(0x7fe45c0ce950 msgr2=0x7fe45c0c4680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:26.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.186+0000 7fe461b68640 1 -- 172.21.15.77:0/2900007916 shutdown_connections 2023-11-04T01:41:26.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.186+0000 7fe461b68640 1 -- 172.21.15.77:0/2900007916 wait complete. 2023-11-04T01:41:26.198 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T01:41:26.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.299+0000 7fdc7614c640 1 Processor -- start 2023-11-04T01:41:26.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.299+0000 7fdc7614c640 1 -- start start 2023-11-04T01:41:26.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.300+0000 7fdc7614c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc700c4ff0 0x7fdc700cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.300+0000 7fdc7614c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdc700adac0 0x7fdc700adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.300+0000 7fdc7614c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc7015aff0 con 0x7fdc70159c00 2023-11-04T01:41:26.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.300+0000 7fdc7614c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc700ae450 con 0x7fdc700adac0 2023-11-04T01:41:26.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.300+0000 7fdc7614c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7015a3e0 con 0x7fdc700c4ff0 2023-11-04T01:41:26.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.300+0000 7fdc6ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdc700adac0 0x7fdc700adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.300+0000 7fdc6ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdc700adac0 0x7fdc700adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40536/0 (socket says 172.21.15.77:40536) 2023-11-04T01:41:26.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.300+0000 7fdc6ffff640 1 -- 172.21.15.77:0/1741753724 learned_addr learned my addr 172.21.15.77:0/1741753724 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:26.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.300+0000 7fdc6effd640 1 --2- 172.21.15.77:0/1741753724 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc700c4ff0 0x7fdc700cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.300+0000 7fdc6ffff640 1 -- 172.21.15.77:0/1741753724 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc700c4ff0 msgr2=0x7fdc700cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:26.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.300+0000 7fdc6ffff640 1 --2- 172.21.15.77:0/1741753724 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc700c4ff0 0x7fdc700cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.300+0000 7fdc6ffff640 1 -- 172.21.15.77:0/1741753724 >> v1:172.21.15.122:6789/0 conn(0x7fdc70159c00 legacy=0x7fdc700c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:26.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.300+0000 7fdc6ffff640 1 -- 172.21.15.77:0/1741753724 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc7015a6c0 con 0x7fdc700adac0 2023-11-04T01:41:26.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.300+0000 7fdc6effd640 1 --2- 172.21.15.77:0/1741753724 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc700c4ff0 0x7fdc700cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:26.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.301+0000 7fdc6ffff640 1 --2- 172.21.15.77:0/1741753724 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc700adac0 0x7fdc700adf10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fdc6800d150 tx=0x7fdc6802e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=670a50f110686a9a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:26.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.301+0000 7fdc6e7fc640 1 -- 172.21.15.77:0/1741753724 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6800b0d0 con 0x7fdc700adac0 2023-11-04T01:41:26.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.301+0000 7fdc6e7fc640 1 -- 172.21.15.77:0/1741753724 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6800b230 con 0x7fdc700adac0 2023-11-04T01:41:26.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.301+0000 7fdc6e7fc640 1 -- 172.21.15.77:0/1741753724 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc68009600 con 0x7fdc700adac0 2023-11-04T01:41:26.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.301+0000 7fdc7614c640 1 -- 172.21.15.77:0/1741753724 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc700adac0 msgr2=0x7fdc700adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:26.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.301+0000 7fdc7614c640 1 --2- 172.21.15.77:0/1741753724 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc700adac0 0x7fdc700adf10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fdc6800d150 tx=0x7fdc6802e160 comp rx=0 tx=0).stop 2023-11-04T01:41:26.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.302+0000 7fdc7614c640 1 -- 172.21.15.77:0/1741753724 shutdown_connections 2023-11-04T01:41:26.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.302+0000 7fdc7614c640 1 --2- 172.21.15.77:0/1741753724 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc700adac0 0x7fdc700adf10 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.302+0000 7fdc7614c640 1 --2- 172.21.15.77:0/1741753724 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc700c4ff0 0x7fdc700cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.302+0000 7fdc7614c640 1 -- 172.21.15.77:0/1741753724 >> 172.21.15.77:0/1741753724 conn(0x7fdc700ce950 msgr2=0x7fdc700ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:26.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.302+0000 7fdc7614c640 1 -- 172.21.15.77:0/1741753724 shutdown_connections 2023-11-04T01:41:26.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.302+0000 7fdc7614c640 1 -- 172.21.15.77:0/1741753724 wait complete. 2023-11-04T01:41:26.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.303+0000 7fdc7614c640 1 Processor -- start 2023-11-04T01:41:26.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.303+0000 7fdc7614c640 1 -- start start 2023-11-04T01:41:26.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.304+0000 7fdc7614c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc700adac0 0x7fdc701441a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.304+0000 7fdc7614c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc700c4ff0 0x7fdc70150a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.304+0000 7fdc7614c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc70159c00 0x7fdc70153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.304+0000 7fdc7614c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc70152d00 con 0x7fdc70159c00 2023-11-04T01:41:26.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.304+0000 7fdc7614c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc70144aa0 con 0x7fdc700adac0 2023-11-04T01:41:26.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.304+0000 7fdc7614c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc70152180 con 0x7fdc700c4ff0 2023-11-04T01:41:26.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.304+0000 7fdc6ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc70159c00 0x7fdc70153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.304+0000 7fdc6ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc70159c00 0x7fdc70153340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40552/0 (socket says 172.21.15.77:40552) 2023-11-04T01:41:26.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.304+0000 7fdc6ffff640 1 -- 172.21.15.77:0/1064637430 learned_addr learned my addr 172.21.15.77:0/1064637430 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:26.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.304+0000 7fdc6effd640 1 --2- 172.21.15.77:0/1064637430 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc700c4ff0 0x7fdc70150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.304+0000 7fdc6f7fe640 1 --2- 172.21.15.77:0/1064637430 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc700adac0 0x7fdc701441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.304+0000 7fdc6ffff640 1 -- 172.21.15.77:0/1064637430 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc700c4ff0 msgr2=0x7fdc70150a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:26.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.304+0000 7fdc6ffff640 1 --2- 172.21.15.77:0/1064637430 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc700c4ff0 0x7fdc70150a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.304+0000 7fdc6ffff640 1 -- 172.21.15.77:0/1064637430 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc700adac0 msgr2=0x7fdc701441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:26.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.304+0000 7fdc6ffff640 1 --2- 172.21.15.77:0/1064637430 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc700adac0 0x7fdc701441a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.304+0000 7fdc6ffff640 1 -- 172.21.15.77:0/1064637430 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6800bd40 con 0x7fdc70159c00 2023-11-04T01:41:26.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.304+0000 7fdc6f7fe640 1 --2- 172.21.15.77:0/1064637430 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc700adac0 0x7fdc701441a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:26.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.304+0000 7fdc6ffff640 1 --2- 172.21.15.77:0/1064637430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc70159c00 0x7fdc70153340 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fdc6800d150 tx=0x7fdc68004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:26.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.304+0000 7fdc57fff640 1 -- 172.21.15.77:0/1064637430 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6800b0d0 con 0x7fdc70159c00 2023-11-04T01:41:26.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.304+0000 7fdc57fff640 1 -- 172.21.15.77:0/1064637430 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6800b720 con 0x7fdc70159c00 2023-11-04T01:41:26.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.304+0000 7fdc7614c640 1 -- 172.21.15.77:0/1064637430 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc70152460 con 0x7fdc70159c00 2023-11-04T01:41:26.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.304+0000 7fdc57fff640 1 -- 172.21.15.77:0/1064637430 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc68040880 con 0x7fdc70159c00 2023-11-04T01:41:26.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.304+0000 7fdc7614c640 1 -- 172.21.15.77:0/1064637430 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc70152a20 con 0x7fdc70159c00 2023-11-04T01:41:26.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.305+0000 7fdc7614c640 1 -- 172.21.15.77:0/1064637430 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc700adf10 con 0x7fdc70159c00 2023-11-04T01:41:26.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.306+0000 7fdc57fff640 1 -- 172.21.15.77:0/1064637430 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdc680409e0 con 0x7fdc70159c00 2023-11-04T01:41:26.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.306+0000 7fdc57fff640 1 --2- 172.21.15.77:0/1064637430 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdc5c06ae70 0x7fdc5c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.306+0000 7fdc57fff640 1 -- 172.21.15.77:0/1064637430 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fdc680ae730 con 0x7fdc70159c00 2023-11-04T01:41:26.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.306+0000 7fdc6f7fe640 1 --2- 172.21.15.77:0/1064637430 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdc5c06ae70 0x7fdc5c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.307+0000 7fdc6f7fe640 1 --2- 172.21.15.77:0/1064637430 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdc5c06ae70 0x7fdc5c06d330 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdc60007fd0 tx=0x7fdc60009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:26.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.310+0000 7fdc57fff640 1 -- 172.21.15.77:0/1064637430 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdc680796a0 con 0x7fdc70159c00 2023-11-04T01:41:26.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.512+0000 7fdc7614c640 1 -- 172.21.15.77:0/1064637430 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdc70074290 con 0x7fdc70159c00 2023-11-04T01:41:26.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.601+0000 7fdc57fff640 1 -- 172.21.15.77:0/1064637430 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdc6807ccc0 con 0x7fdc70159c00 2023-11-04T01:41:26.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.603+0000 7fdc7614c640 1 -- 172.21.15.77:0/1064637430 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdc5c06ae70 msgr2=0x7fdc5c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:26.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.603+0000 7fdc7614c640 1 --2- 172.21.15.77:0/1064637430 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdc5c06ae70 0x7fdc5c06d330 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdc60007fd0 tx=0x7fdc60009040 comp rx=0 tx=0).stop 2023-11-04T01:41:26.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.603+0000 7fdc7614c640 1 -- 172.21.15.77:0/1064637430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc70159c00 msgr2=0x7fdc70153340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:26.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.603+0000 7fdc7614c640 1 --2- 172.21.15.77:0/1064637430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc70159c00 0x7fdc70153340 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fdc6800d150 tx=0x7fdc68004a40 comp rx=0 tx=0).stop 2023-11-04T01:41:26.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.603+0000 7fdc7614c640 1 -- 172.21.15.77:0/1064637430 shutdown_connections 2023-11-04T01:41:26.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.603+0000 7fdc7614c640 1 --2- 172.21.15.77:0/1064637430 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdc5c06ae70 0x7fdc5c06d330 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.603+0000 7fdc7614c640 1 --2- 172.21.15.77:0/1064637430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc70159c00 0x7fdc70153340 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.603+0000 7fdc7614c640 1 --2- 172.21.15.77:0/1064637430 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc700c4ff0 0x7fdc70150a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.603+0000 7fdc7614c640 1 --2- 172.21.15.77:0/1064637430 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc700adac0 0x7fdc701441a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.603+0000 7fdc7614c640 1 -- 172.21.15.77:0/1064637430 >> 172.21.15.77:0/1064637430 conn(0x7fdc700ce950 msgr2=0x7fdc700c7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:26.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.603+0000 7fdc7614c640 1 -- 172.21.15.77:0/1064637430 shutdown_connections 2023-11-04T01:41:26.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.603+0000 7fdc7614c640 1 -- 172.21.15.77:0/1064637430 wait complete. 2023-11-04T01:41:26.615 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-04T01:41:26.616 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T01:41:26.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.717+0000 7f8fab7f5640 1 Processor -- start 2023-11-04T01:41:26.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.717+0000 7f8fab7f5640 1 -- start start 2023-11-04T01:41:26.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.718+0000 7f8fab7f5640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8fa4070ff0 0x7f8fa40cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.718+0000 7f8fab7f5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8fa4066000 0x7f8fa406a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.718+0000 7f8fab7f5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fa40c9bf0 con 0x7f8fa415d1b0 2023-11-04T01:41:26.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.718+0000 7f8fab7f5640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fa40cd890 con 0x7f8fa4070ff0 2023-11-04T01:41:26.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.718+0000 7f8fab7f5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa40cdb30 con 0x7f8fa4066000 2023-11-04T01:41:26.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.718+0000 7f8fa8d90640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f8fa415d1b0 0x7f8fa40713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44336/0 (socket says 172.21.15.77:44336) 2023-11-04T01:41:26.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.718+0000 7f8fa8d90640 1 -- 172.21.15.77:0/1242745198 learned_addr learned my addr 172.21.15.77:0/1242745198 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:26.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.718+0000 7f8f9bfff640 1 -- 172.21.15.77:0/1242745198 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 621953274 0 0) 0x7f8fa40c9bf0 con 0x7f8fa415d1b0 2023-11-04T01:41:26.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.718+0000 7f8f9bfff640 1 -- 172.21.15.77:0/1242745198 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f90003520 con 0x7f8fa415d1b0 2023-11-04T01:41:26.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.718+0000 7f8fa9591640 1 --2- 172.21.15.77:0/1242745198 >> v2:172.21.15.122:3300/0 conn(0x7f8fa4070ff0 0x7f8fa40cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.718+0000 7f8fa9d92640 1 --2- 172.21.15.77:0/1242745198 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8fa4066000 0x7f8fa406a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.718+0000 7f8f9bfff640 1 -- 172.21.15.77:0/1242745198 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3392609073 0 0) 0x7f8f90003520 con 0x7f8fa415d1b0 2023-11-04T01:41:26.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.718+0000 7f8f9bfff640 1 -- 172.21.15.77:0/1242745198 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8fa4066000 msgr2=0x7f8fa406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:26.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.718+0000 7f8f9bfff640 1 --2- 172.21.15.77:0/1242745198 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8fa4066000 0x7f8fa406a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.718+0000 7f8f9bfff640 1 -- 172.21.15.77:0/1242745198 >> v2:172.21.15.122:3300/0 conn(0x7f8fa4070ff0 msgr2=0x7f8fa40cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:26.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.718+0000 7f8f9bfff640 1 --2- 172.21.15.77:0/1242745198 >> v2:172.21.15.122:3300/0 conn(0x7f8fa4070ff0 0x7f8fa40cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.718+0000 7f8f9bfff640 1 -- 172.21.15.77:0/1242745198 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa40cde10 con 0x7f8fa415d1b0 2023-11-04T01:41:26.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.718+0000 7f8f9bfff640 1 -- 172.21.15.77:0/1242745198 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f8f94001670 con 0x7f8fa415d1b0 2023-11-04T01:41:26.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.718+0000 7f8f9bfff640 1 -- 172.21.15.77:0/1242745198 >> v1:172.21.15.77:6789/0 conn(0x7f8fa415d1b0 legacy=0x7f8fa40713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:26.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.718+0000 7f8f9bfff640 1 --2- 172.21.15.77:0/1242745198 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f90003970 0x7f8f90003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.718+0000 7f8f9bfff640 1 --2- 172.21.15.77:0/1242745198 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8fa4066000 0x7f8f900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.718+0000 7f8f9bfff640 1 --2- 172.21.15.77:0/1242745198 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f90004d00 0x7f8f90005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.718+0000 7f8f9bfff640 1 -- 172.21.15.77:0/1242745198 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa40cd890 con 0x7f8f90003970 2023-11-04T01:41:26.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.718+0000 7f8f9bfff640 1 -- 172.21.15.77:0/1242745198 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa40cdb30 con 0x7f8f90004d00 2023-11-04T01:41:26.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.718+0000 7f8f9bfff640 1 -- 172.21.15.77:0/1242745198 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9000b980 con 0x7f8fa4066000 2023-11-04T01:41:26.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.718+0000 7f8fa9591640 1 --2- 172.21.15.77:0/1242745198 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f90003970 0x7f8f90003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.718+0000 7f8fa8d90640 1 --2- 172.21.15.77:0/1242745198 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8fa4066000 0x7f8f900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.719+0000 7f8fa9d92640 1 --2- 172.21.15.77:0/1242745198 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f90004d00 0x7f8f90005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.719+0000 7f8fa9591640 1 -- 172.21.15.77:0/1242745198 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8fa4066000 msgr2=0x7f8f900047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:26.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.719+0000 7f8fa9591640 1 --2- 172.21.15.77:0/1242745198 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8fa4066000 0x7f8f900047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.719+0000 7f8fa9591640 1 -- 172.21.15.77:0/1242745198 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f90004d00 msgr2=0x7f8f90005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:26.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.719+0000 7f8fa9591640 1 --2- 172.21.15.77:0/1242745198 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f90004d00 0x7f8f90005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.719+0000 7f8fa9591640 1 -- 172.21.15.77:0/1242745198 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f90003520 con 0x7f8f90003970 2023-11-04T01:41:26.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.719+0000 7f8fa9d92640 1 --2- 172.21.15.77:0/1242745198 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f90004d00 0x7f8f90005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:26.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.719+0000 7f8fa9591640 1 --2- 172.21.15.77:0/1242745198 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f90003970 0x7f8f90003d90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0009ac0 tx=0x7f8f900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=773c1f01bb40bf21 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:26.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.719+0000 7f8f9bfff640 1 -- 172.21.15.77:0/1242745198 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa002c710 con 0x7f8f90003970 2023-11-04T01:41:26.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.720+0000 7f8f9bfff640 1 -- 172.21.15.77:0/1242745198 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa002c870 con 0x7f8f90003970 2023-11-04T01:41:26.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.720+0000 7f8f9bfff640 1 -- 172.21.15.77:0/1242745198 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa002cc00 con 0x7f8f90003970 2023-11-04T01:41:26.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.720+0000 7f8fab7f5640 1 -- 172.21.15.77:0/1242745198 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f90003970 msgr2=0x7f8f90003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:26.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.720+0000 7f8fab7f5640 1 --2- 172.21.15.77:0/1242745198 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f90003970 0x7f8f90003d90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0009ac0 tx=0x7f8f900057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.720+0000 7f8fa9d92640 1 -- 172.21.15.77:0/1242745198 reap_dead start 2023-11-04T01:41:26.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.720+0000 7f8fab7f5640 1 -- 172.21.15.77:0/1242745198 shutdown_connections 2023-11-04T01:41:26.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.720+0000 7f8fab7f5640 1 -- 172.21.15.77:0/1242745198 >> 172.21.15.77:0/1242745198 conn(0x7f8fa40cbc90 msgr2=0x7f8fa40cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:26.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.720+0000 7f8fab7f5640 1 -- 172.21.15.77:0/1242745198 shutdown_connections 2023-11-04T01:41:26.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.720+0000 7f8fab7f5640 1 -- 172.21.15.77:0/1242745198 wait complete. 2023-11-04T01:41:26.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.721+0000 7f8fab7f5640 1 Processor -- start 2023-11-04T01:41:26.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.721+0000 7f8fab7f5640 1 -- start start 2023-11-04T01:41:26.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.722+0000 7f8fab7f5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f90003970 0x7f8fa41f2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.722+0000 7f8fab7f5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8fa40c2d40 0x7f8fa40c3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.722+0000 7f8fab7f5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fa40adc30 0x7f8fa40ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.722+0000 7f8fab7f5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa40c4170 con 0x7f8fa40adc30 2023-11-04T01:41:26.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.722+0000 7f8fab7f5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa40ae5f0 con 0x7f8f90003970 2023-11-04T01:41:26.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.722+0000 7f8fab7f5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa40c4920 con 0x7f8fa40c2d40 2023-11-04T01:41:26.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.722+0000 7f8fa9d92640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fa40adc30 0x7f8fa40ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.722+0000 7f8fa9d92640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fa40adc30 0x7f8fa40ae0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40578/0 (socket says 172.21.15.77:40578) 2023-11-04T01:41:26.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.722+0000 7f8fa9d92640 1 -- 172.21.15.77:0/3756154688 learned_addr learned my addr 172.21.15.77:0/3756154688 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:26.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.722+0000 7f8fa9591640 1 --2- 172.21.15.77:0/3756154688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f90003970 0x7f8fa41f2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.722+0000 7f8fa8d90640 1 --2- 172.21.15.77:0/3756154688 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8fa40c2d40 0x7f8fa40c3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.722+0000 7f8fa9d92640 1 -- 172.21.15.77:0/3756154688 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8fa40c2d40 msgr2=0x7f8fa40c3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:26.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.722+0000 7f8fa9d92640 1 --2- 172.21.15.77:0/3756154688 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8fa40c2d40 0x7f8fa40c3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.722+0000 7f8fa9d92640 1 -- 172.21.15.77:0/3756154688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f90003970 msgr2=0x7f8fa41f2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:26.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.722+0000 7f8fa9d92640 1 --2- 172.21.15.77:0/3756154688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f90003970 0x7f8fa41f2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:26.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.722+0000 7f8fa9d92640 1 -- 172.21.15.77:0/3756154688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa40af720 con 0x7f8fa40adc30 2023-11-04T01:41:26.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.723+0000 7f8fa9d92640 1 --2- 172.21.15.77:0/3756154688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fa40adc30 0x7f8fa40ae0b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f8fa406c780 tx=0x7f8f9c010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:26.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.723+0000 7f8f99ffb640 1 -- 172.21.15.77:0/3756154688 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c00e050 con 0x7f8fa40adc30 2023-11-04T01:41:26.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.723+0000 7f8f99ffb640 1 -- 172.21.15.77:0/3756154688 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9c00f040 con 0x7f8fa40adc30 2023-11-04T01:41:26.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.723+0000 7f8fab7f5640 1 -- 172.21.15.77:0/3756154688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa40c4360 con 0x7f8fa40adc30 2023-11-04T01:41:26.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.723+0000 7f8f99ffb640 1 -- 172.21.15.77:0/3756154688 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c010d20 con 0x7f8fa40adc30 2023-11-04T01:41:26.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.723+0000 7f8fab7f5640 1 -- 172.21.15.77:0/3756154688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa40aba80 con 0x7f8fa40adc30 2023-11-04T01:41:26.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.724+0000 7f8fab7f5640 1 -- 172.21.15.77:0/3756154688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa40ab8e0 con 0x7f8fa40adc30 2023-11-04T01:41:26.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.724+0000 7f8f99ffb640 1 -- 172.21.15.77:0/3756154688 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8f9c015440 con 0x7f8fa40adc30 2023-11-04T01:41:26.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.725+0000 7f8f99ffb640 1 --2- 172.21.15.77:0/3756154688 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8f8806ae70 0x7f8f8806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:26.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.725+0000 7f8f99ffb640 1 -- 172.21.15.77:0/3756154688 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8f9c0898a0 con 0x7f8fa40adc30 2023-11-04T01:41:26.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.725+0000 7f8fa9591640 1 --2- 172.21.15.77:0/3756154688 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8f8806ae70 0x7f8f8806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:26.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.725+0000 7f8fa9591640 1 --2- 172.21.15.77:0/3756154688 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8f8806ae70 0x7f8f8806d330 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0036000 tx=0x7f8fa0030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:26.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.729+0000 7f8f99ffb640 1 -- 172.21.15.77:0/3756154688 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8fa40ab8e0 con 0x7f8fa40adc30 2023-11-04T01:41:26.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:26.929+0000 7f8fab7f5640 1 -- 172.21.15.77:0/3756154688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f8fa40ab8e0 con 0x7f8fa40adc30 2023-11-04T01:41:27.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.602+0000 7f8f99ffb640 1 -- 172.21.15.77:0/3756154688 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8fa40ab8e0 con 0x7f8fa40adc30 2023-11-04T01:41:27.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.605+0000 7f8fab7f5640 1 -- 172.21.15.77:0/3756154688 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8f8806ae70 msgr2=0x7f8f8806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:27.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.605+0000 7f8fab7f5640 1 --2- 172.21.15.77:0/3756154688 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8f8806ae70 0x7f8f8806d330 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0036000 tx=0x7f8fa0030000 comp rx=0 tx=0).stop 2023-11-04T01:41:27.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.605+0000 7f8fab7f5640 1 -- 172.21.15.77:0/3756154688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fa40adc30 msgr2=0x7f8fa40ae0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:27.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.605+0000 7f8fab7f5640 1 --2- 172.21.15.77:0/3756154688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fa40adc30 0x7f8fa40ae0b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f8fa406c780 tx=0x7f8f9c010590 comp rx=0 tx=0).stop 2023-11-04T01:41:27.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.605+0000 7f8fab7f5640 1 -- 172.21.15.77:0/3756154688 shutdown_connections 2023-11-04T01:41:27.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.605+0000 7f8fab7f5640 1 --2- 172.21.15.77:0/3756154688 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8f8806ae70 0x7f8f8806d330 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:27.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.605+0000 7f8fab7f5640 1 --2- 172.21.15.77:0/3756154688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fa40adc30 0x7f8fa40ae0b0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:27.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.605+0000 7f8fab7f5640 1 --2- 172.21.15.77:0/3756154688 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8fa40c2d40 0x7f8fa40c3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:27.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.605+0000 7f8fab7f5640 1 --2- 172.21.15.77:0/3756154688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f90003970 0x7f8fa41f2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:27.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.605+0000 7f8fab7f5640 1 -- 172.21.15.77:0/3756154688 >> 172.21.15.77:0/3756154688 conn(0x7f8fa40cbc90 msgr2=0x7f8fa40ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:27.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.605+0000 7f8fab7f5640 1 -- 172.21.15.77:0/3756154688 shutdown_connections 2023-11-04T01:41:27.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.605+0000 7f8fab7f5640 1 -- 172.21.15.77:0/3756154688 wait complete. 2023-11-04T01:41:27.618 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T01:41:27.618 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:27.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.718+0000 7f9149300640 1 Processor -- start 2023-11-04T01:41:27.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.718+0000 7f9149300640 1 -- start start 2023-11-04T01:41:27.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.719+0000 7f9149300640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f91440cda60 0x7f91440ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:27.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.719+0000 7f9149300640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91440cc990 con 0x7f91440b0cd0 2023-11-04T01:41:27.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.719+0000 7f9149300640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91440ccc70 con 0x7f9144070d40 2023-11-04T01:41:27.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.719+0000 7f9149300640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91440c9ce0 con 0x7f91440cda60 2023-11-04T01:41:27.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.719+0000 7f9142ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f91440cda60 0x7f91440ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:27.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.719+0000 7f91427fc640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f91440b0cd0 0x7f9144070630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:34442/0 (socket says 172.21.15.77:34442) 2023-11-04T01:41:27.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.719+0000 7f91427fc640 1 -- 172.21.15.77:0/2181000329 learned_addr learned my addr 172.21.15.77:0/2181000329 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:27.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.719+0000 7f9142ffd640 1 -- 172.21.15.77:0/2181000329 >> v1:172.21.15.122:6789/0 conn(0x7f9144070d40 legacy=0x7f914406c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:27.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.719+0000 7f9142ffd640 1 -- 172.21.15.77:0/2181000329 >> v1:172.21.15.77:6789/0 conn(0x7f91440b0cd0 legacy=0x7f9144070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:27.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.719+0000 7f9142ffd640 1 -- 172.21.15.77:0/2181000329 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91440c9fc0 con 0x7f91440cda60 2023-11-04T01:41:27.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.719+0000 7f9141ffb640 1 -- 172.21.15.77:0/2181000329 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 616937872 0 0) 0x7f91440cc990 con 0x7f91440b0cd0 2023-11-04T01:41:27.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.720+0000 7f9142ffd640 1 --2- 172.21.15.77:0/2181000329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91440cda60 0x7f91440ca7a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f913400a940 tx=0x7f913402cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1ce1a0b5ceb33fe server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:27.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.720+0000 7f9141ffb640 1 -- 172.21.15.77:0/2181000329 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913402db40 con 0x7f91440cda60 2023-11-04T01:41:27.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.720+0000 7f9141ffb640 1 -- 172.21.15.77:0/2181000329 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913402dca0 con 0x7f91440cda60 2023-11-04T01:41:27.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.720+0000 7f9141ffb640 1 -- 172.21.15.77:0/2181000329 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9134035660 con 0x7f91440cda60 2023-11-04T01:41:27.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.721+0000 7f9149300640 1 -- 172.21.15.77:0/2181000329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91440cda60 msgr2=0x7f91440ca7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:27.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.721+0000 7f9149300640 1 --2- 172.21.15.77:0/2181000329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91440cda60 0x7f91440ca7a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f913400a940 tx=0x7f913402cd90 comp rx=0 tx=0).stop 2023-11-04T01:41:27.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.721+0000 7f9149300640 1 -- 172.21.15.77:0/2181000329 shutdown_connections 2023-11-04T01:41:27.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.721+0000 7f9149300640 1 --2- 172.21.15.77:0/2181000329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91440cda60 0x7f91440ca7a0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:27.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.721+0000 7f9149300640 1 -- 172.21.15.77:0/2181000329 >> 172.21.15.77:0/2181000329 conn(0x7f91440ce950 msgr2=0x7f91440ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:27.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.721+0000 7f9149300640 1 -- 172.21.15.77:0/2181000329 shutdown_connections 2023-11-04T01:41:27.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.721+0000 7f9149300640 1 -- 172.21.15.77:0/2181000329 wait complete. 2023-11-04T01:41:27.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.722+0000 7f9149300640 1 Processor -- start 2023-11-04T01:41:27.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.722+0000 7f9149300640 1 -- start start 2023-11-04T01:41:27.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.723+0000 7f9149300640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9144070d40 0x7f91441ee850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:27.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.723+0000 7f9149300640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f91440b0cd0 0x7f91440c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:27.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.723+0000 7f9149300640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91440cda60 0x7f91440c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:27.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.723+0000 7f9149300640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91440b19e0 con 0x7f91440cda60 2023-11-04T01:41:27.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.723+0000 7f9149300640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91440b1c30 con 0x7f9144070d40 2023-11-04T01:41:27.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.723+0000 7f9149300640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91440b1f10 con 0x7f91440b0cd0 2023-11-04T01:41:27.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.723+0000 7f91437fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91440cda60 0x7f91440c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:27.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.723+0000 7f91437fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91440cda60 0x7f91440c82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43516/0 (socket says 172.21.15.77:43516) 2023-11-04T01:41:27.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.723+0000 7f91437fe640 1 -- 172.21.15.77:0/1552725095 learned_addr learned my addr 172.21.15.77:0/1552725095 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:27.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.723+0000 7f91427fc640 1 --2- 172.21.15.77:0/1552725095 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f91440b0cd0 0x7f91440c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:27.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.723+0000 7f9142ffd640 1 --2- 172.21.15.77:0/1552725095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9144070d40 0x7f91441ee850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:27.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.723+0000 7f91437fe640 1 -- 172.21.15.77:0/1552725095 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f91440b0cd0 msgr2=0x7f91440c7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:27.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.723+0000 7f91437fe640 1 --2- 172.21.15.77:0/1552725095 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f91440b0cd0 0x7f91440c7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:27.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.723+0000 7f91437fe640 1 -- 172.21.15.77:0/1552725095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9144070d40 msgr2=0x7f91441ee850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:27.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.723+0000 7f91437fe640 1 --2- 172.21.15.77:0/1552725095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9144070d40 0x7f91441ee850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:27.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.723+0000 7f91437fe640 1 -- 172.21.15.77:0/1552725095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913400a5a0 con 0x7f91440cda60 2023-11-04T01:41:27.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.723+0000 7f91427fc640 1 --2- 172.21.15.77:0/1552725095 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f91440b0cd0 0x7f91440c7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:27.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.723+0000 7f91437fe640 1 --2- 172.21.15.77:0/1552725095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91440cda60 0x7f91440c82e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f913c00c780 tx=0x7f913c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:27.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.723+0000 7f912b7fe640 1 -- 172.21.15.77:0/1552725095 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c004b60 con 0x7f91440cda60 2023-11-04T01:41:27.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.724+0000 7f912b7fe640 1 -- 172.21.15.77:0/1552725095 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913c00ce90 con 0x7f91440cda60 2023-11-04T01:41:27.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.724+0000 7f9149300640 1 -- 172.21.15.77:0/1552725095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91440b21f0 con 0x7f91440cda60 2023-11-04T01:41:27.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.724+0000 7f912b7fe640 1 -- 172.21.15.77:0/1552725095 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c00a850 con 0x7f91440cda60 2023-11-04T01:41:27.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.724+0000 7f9149300640 1 -- 172.21.15.77:0/1552725095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91441eed90 con 0x7f91440cda60 2023-11-04T01:41:27.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.724+0000 7f9149300640 1 -- 172.21.15.77:0/1552725095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91440b2710 con 0x7f91440cda60 2023-11-04T01:41:27.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.725+0000 7f912b7fe640 1 -- 172.21.15.77:0/1552725095 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f913c00a9b0 con 0x7f91440cda60 2023-11-04T01:41:27.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.725+0000 7f912b7fe640 1 --2- 172.21.15.77:0/1552725095 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f913006ae70 0x7f913006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:27.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.725+0000 7f912b7fe640 1 -- 172.21.15.77:0/1552725095 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f913c089830 con 0x7f91440cda60 2023-11-04T01:41:27.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.726+0000 7f9142ffd640 1 --2- 172.21.15.77:0/1552725095 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f913006ae70 0x7f913006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:27.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.726+0000 7f9142ffd640 1 --2- 172.21.15.77:0/1552725095 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f913006ae70 0x7f913006d330 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9134037000 tx=0x7f9134008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:27.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.729+0000 7f912b7fe640 1 -- 172.21.15.77:0/1552725095 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f91440b2710 con 0x7f91440cda60 2023-11-04T01:41:27.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.928+0000 7f9149300640 1 -- 172.21.15.77:0/1552725095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91440b2710 con 0x7f91440cda60 2023-11-04T01:41:27.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.928+0000 7f912b7fe640 1 -- 172.21.15.77:0/1552725095 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4920 (secure 0 0 0) 0x7f91440b2710 con 0x7f91440cda60 2023-11-04T01:41:27.931 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:27.931 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5511,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/1132914884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1132914884},{"type":"v1","addr":"172.21.15.77:6834","nonce":1132914884}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5514,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/530959421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":530959421},{"type":"v1","addr":"172.21.15.77:6835","nonce":530959421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":34823,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/1375125704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1375125704},{"type":"v1","addr":"172.21.15.122:6836","nonce":1375125704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:41:24.933073+0000","modified":"2023-11-04T01:41:26.930876+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34826},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34826":{"gid":34826,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/3085479427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":3085479427},{"type":"v1","addr":"172.21.15.122:6837","nonce":3085479427}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-04T01:41:27.932 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 16 2023-11-04T01:41:27.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.930+0000 7f9149300640 1 -- 172.21.15.77:0/1552725095 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f913006ae70 msgr2=0x7f913006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:27.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.930+0000 7f9149300640 1 --2- 172.21.15.77:0/1552725095 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f913006ae70 0x7f913006d330 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9134037000 tx=0x7f9134008040 comp rx=0 tx=0).stop 2023-11-04T01:41:27.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.930+0000 7f9149300640 1 -- 172.21.15.77:0/1552725095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91440cda60 msgr2=0x7f91440c82e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:27.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.930+0000 7f9149300640 1 --2- 172.21.15.77:0/1552725095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91440cda60 0x7f91440c82e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f913c00c780 tx=0x7f913c00cc40 comp rx=0 tx=0).stop 2023-11-04T01:41:27.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.930+0000 7f9149300640 1 -- 172.21.15.77:0/1552725095 shutdown_connections 2023-11-04T01:41:27.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.930+0000 7f9149300640 1 --2- 172.21.15.77:0/1552725095 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f913006ae70 0x7f913006d330 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:27.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.930+0000 7f9149300640 1 --2- 172.21.15.77:0/1552725095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91440cda60 0x7f91440c82e0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:27.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.930+0000 7f9149300640 1 --2- 172.21.15.77:0/1552725095 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f91440b0cd0 0x7f91440c7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:27.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.930+0000 7f9149300640 1 --2- 172.21.15.77:0/1552725095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9144070d40 0x7f91441ee850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:27.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.930+0000 7f9149300640 1 -- 172.21.15.77:0/1552725095 >> 172.21.15.77:0/1552725095 conn(0x7f91440ce950 msgr2=0x7f9144158af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:27.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.930+0000 7f9149300640 1 -- 172.21.15.77:0/1552725095 shutdown_connections 2023-11-04T01:41:27.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:27.930+0000 7f9149300640 1 -- 172.21.15.77:0/1552725095 wait complete. 2023-11-04T01:41:27.943 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:28.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.041+0000 7f02f4df5640 1 Processor -- start 2023-11-04T01:41:28.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.041+0000 7f02f4df5640 1 -- start start 2023-11-04T01:41:28.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.041+0000 7f02f4df5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f02f015ae40 0x7f02f015bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.042+0000 7f02f4df5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f02f00cbc00 0x7f02f00cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.042+0000 7f02f4df5640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f02f00cd860 0x7f02f00b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.042+0000 7f02f4df5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02f00cc450 con 0x7f02f00cbc00 2023-11-04T01:41:28.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.042+0000 7f02f4df5640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02f015f400 con 0x7f02f00cd860 2023-11-04T01:41:28.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.042+0000 7f02f4df5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f015b220 con 0x7f02f015ae40 2023-11-04T01:41:28.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.042+0000 7f02edd9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f02f00cbc00 0x7f02f00cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.042+0000 7f02edd9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f02f00cbc00 0x7f02f00cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43532/0 (socket says 172.21.15.77:43532) 2023-11-04T01:41:28.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.042+0000 7f02edd9b640 1 -- 172.21.15.77:0/3643881467 learned_addr learned my addr 172.21.15.77:0/3643881467 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:28.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.042+0000 7f02edd9b640 1 -- 172.21.15.77:0/3643881467 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f02f015ae40 msgr2=0x7f02f015bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:28.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.042+0000 7f02ee59c640 1 --2- 172.21.15.77:0/3643881467 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f02f015ae40 0x7f02f015bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.042+0000 7f02eed9d640 1 --2- 172.21.15.77:0/3643881467 >> v2:172.21.15.122:3300/0 conn(0x7f02f00cd860 0x7f02f00b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.042+0000 7f02edd9b640 1 --2- 172.21.15.77:0/3643881467 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f02f015ae40 0x7f02f015bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.042+0000 7f02edd9b640 1 -- 172.21.15.77:0/3643881467 >> v2:172.21.15.122:3300/0 conn(0x7f02f00cd860 msgr2=0x7f02f00b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:28.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.042+0000 7f02edd9b640 1 --2- 172.21.15.77:0/3643881467 >> v2:172.21.15.122:3300/0 conn(0x7f02f00cd860 0x7f02f00b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.042+0000 7f02edd9b640 1 -- 172.21.15.77:0/3643881467 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f015f890 con 0x7f02f00cbc00 2023-11-04T01:41:28.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.042+0000 7f02ee59c640 1 --2- 172.21.15.77:0/3643881467 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f02f015ae40 0x7f02f015bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:28.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.042+0000 7f02eed9d640 1 --2- 172.21.15.77:0/3643881467 >> v2:172.21.15.122:3300/0 conn(0x7f02f00cd860 0x7f02f00b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:28.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.043+0000 7f02edd9b640 1 --2- 172.21.15.77:0/3643881467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02f00cbc00 0x7f02f00cd320 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f02f015f370 tx=0x7f02e402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b01f8fef8fc9eb94 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:28.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.043+0000 7f02ed59a640 1 -- 172.21.15.77:0/3643881467 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e4031870 con 0x7f02f00cbc00 2023-11-04T01:41:28.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.043+0000 7f02ed59a640 1 -- 172.21.15.77:0/3643881467 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e40319d0 con 0x7f02f00cbc00 2023-11-04T01:41:28.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.043+0000 7f02ed59a640 1 -- 172.21.15.77:0/3643881467 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e4031d60 con 0x7f02f00cbc00 2023-11-04T01:41:28.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.043+0000 7f02f4df5640 1 -- 172.21.15.77:0/3643881467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02f00cbc00 msgr2=0x7f02f00cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.043+0000 7f02f4df5640 1 --2- 172.21.15.77:0/3643881467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02f00cbc00 0x7f02f00cd320 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f02f015f370 tx=0x7f02e402b910 comp rx=0 tx=0).stop 2023-11-04T01:41:28.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.043+0000 7f02f4df5640 1 -- 172.21.15.77:0/3643881467 shutdown_connections 2023-11-04T01:41:28.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.043+0000 7f02f4df5640 1 --2- 172.21.15.77:0/3643881467 >> v2:172.21.15.122:3300/0 conn(0x7f02f00cd860 0x7f02f00b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.043+0000 7f02f4df5640 1 --2- 172.21.15.77:0/3643881467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02f00cbc00 0x7f02f00cd320 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.043+0000 7f02f4df5640 1 --2- 172.21.15.77:0/3643881467 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f02f015ae40 0x7f02f015bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.043+0000 7f02f4df5640 1 -- 172.21.15.77:0/3643881467 >> 172.21.15.77:0/3643881467 conn(0x7f02f006ea90 msgr2=0x7f02f006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:28.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.044+0000 7f02f4df5640 1 -- 172.21.15.77:0/3643881467 shutdown_connections 2023-11-04T01:41:28.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.044+0000 7f02f4df5640 1 -- 172.21.15.77:0/3643881467 wait complete. 2023-11-04T01:41:28.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.045+0000 7f02f4df5640 1 Processor -- start 2023-11-04T01:41:28.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.045+0000 7f02f4df5640 1 -- start start 2023-11-04T01:41:28.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.045+0000 7f02f4df5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02f00cbc00 0x7f02f014f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.045+0000 7f02f4df5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f02f00cd860 0x7f02f00c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.045+0000 7f02f4df5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02f015ae40 0x7f02f01504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.045+0000 7f02f4df5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f00c9c50 con 0x7f02f00cbc00 2023-11-04T01:41:28.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.045+0000 7f02f4df5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f00c9040 con 0x7f02f015ae40 2023-11-04T01:41:28.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.045+0000 7f02f4df5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f00c9320 con 0x7f02f00cd860 2023-11-04T01:41:28.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.046+0000 7f02ee59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02f00cbc00 0x7f02f014f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.046+0000 7f02ee59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02f00cbc00 0x7f02f014f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43538/0 (socket says 172.21.15.77:43538) 2023-11-04T01:41:28.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.046+0000 7f02ee59c640 1 -- 172.21.15.77:0/1912600588 learned_addr learned my addr 172.21.15.77:0/1912600588 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:28.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.046+0000 7f02edd9b640 1 --2- 172.21.15.77:0/1912600588 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f02f00cd860 0x7f02f00c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.046+0000 7f02ee59c640 1 -- 172.21.15.77:0/1912600588 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f02f00cd860 msgr2=0x7f02f00c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.046+0000 7f02ee59c640 1 --2- 172.21.15.77:0/1912600588 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f02f00cd860 0x7f02f00c8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.046+0000 7f02eed9d640 1 --2- 172.21.15.77:0/1912600588 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02f015ae40 0x7f02f01504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.046+0000 7f02ee59c640 1 -- 172.21.15.77:0/1912600588 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02f015ae40 msgr2=0x7f02f01504c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.046+0000 7f02ee59c640 1 --2- 172.21.15.77:0/1912600588 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02f015ae40 0x7f02f01504c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.046+0000 7f02ee59c640 1 -- 172.21.15.77:0/1912600588 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e40094d0 con 0x7f02f00cbc00 2023-11-04T01:41:28.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.046+0000 7f02ee59c640 1 --2- 172.21.15.77:0/1912600588 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02f00cbc00 0x7f02f014f120 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f02e000c7f0 tx=0x7f02e000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:28.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.046+0000 7f02deffd640 1 -- 172.21.15.77:0/1912600588 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e0007820 con 0x7f02f00cbc00 2023-11-04T01:41:28.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.046+0000 7f02deffd640 1 -- 172.21.15.77:0/1912600588 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e0007980 con 0x7f02f00cbc00 2023-11-04T01:41:28.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.046+0000 7f02deffd640 1 -- 172.21.15.77:0/1912600588 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e0007cf0 con 0x7f02f00cbc00 2023-11-04T01:41:28.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.046+0000 7f02f4df5640 1 -- 172.21.15.77:0/1912600588 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02f00c9600 con 0x7f02f00cbc00 2023-11-04T01:41:28.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.046+0000 7f02f4df5640 1 -- 172.21.15.77:0/1912600588 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f014f660 con 0x7f02f00cbc00 2023-11-04T01:41:28.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.047+0000 7f02f4df5640 1 -- 172.21.15.77:0/1912600588 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02f00c9f30 con 0x7f02f00cbc00 2023-11-04T01:41:28.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.048+0000 7f02deffd640 1 -- 172.21.15.77:0/1912600588 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f02e00113f0 con 0x7f02f00cbc00 2023-11-04T01:41:28.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.048+0000 7f02deffd640 1 --2- 172.21.15.77:0/1912600588 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f02d006ae70 0x7f02d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.048+0000 7f02deffd640 1 -- 172.21.15.77:0/1912600588 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f02e0089a60 con 0x7f02f00cbc00 2023-11-04T01:41:28.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.048+0000 7f02edd9b640 1 --2- 172.21.15.77:0/1912600588 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f02d006ae70 0x7f02d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.049+0000 7f02edd9b640 1 --2- 172.21.15.77:0/1912600588 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f02d006ae70 0x7f02d006d330 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f02e4036000 tx=0x7f02e403c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:28.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.052+0000 7f02deffd640 1 -- 172.21.15.77:0/1912600588 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f02e00549d0 con 0x7f02f00cbc00 2023-11-04T01:41:28.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.222+0000 7f02f4df5640 1 -- 172.21.15.77:0/1912600588 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02f00ce2d0 con 0x7f02f00cbc00 2023-11-04T01:41:28.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.223+0000 7f02deffd640 1 -- 172.21.15.77:0/1912600588 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16762 (secure 0 0 0) 0x7f02e001f090 con 0x7f02f00cbc00 2023-11-04T01:41:28.225 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:28.225 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":38,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:41:26.560723+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:41:22.769937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-04T01:41:23.907965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:28.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.225+0000 7f02f4df5640 1 -- 172.21.15.77:0/1912600588 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f02d006ae70 msgr2=0x7f02d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.225+0000 7f02f4df5640 1 --2- 172.21.15.77:0/1912600588 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f02d006ae70 0x7f02d006d330 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f02e4036000 tx=0x7f02e403c040 comp rx=0 tx=0).stop 2023-11-04T01:41:28.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.225+0000 7f02f4df5640 1 -- 172.21.15.77:0/1912600588 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02f00cbc00 msgr2=0x7f02f014f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.225+0000 7f02f4df5640 1 --2- 172.21.15.77:0/1912600588 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02f00cbc00 0x7f02f014f120 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f02e000c7f0 tx=0x7f02e000ccb0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.225+0000 7f02f4df5640 1 -- 172.21.15.77:0/1912600588 shutdown_connections 2023-11-04T01:41:28.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.225+0000 7f02f4df5640 1 --2- 172.21.15.77:0/1912600588 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f02d006ae70 0x7f02d006d330 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.225+0000 7f02f4df5640 1 --2- 172.21.15.77:0/1912600588 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02f015ae40 0x7f02f01504c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.225+0000 7f02f4df5640 1 --2- 172.21.15.77:0/1912600588 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f02f00cd860 0x7f02f00c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.225+0000 7f02f4df5640 1 --2- 172.21.15.77:0/1912600588 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02f00cbc00 0x7f02f014f120 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.225+0000 7f02f4df5640 1 -- 172.21.15.77:0/1912600588 >> 172.21.15.77:0/1912600588 conn(0x7f02f006ea90 msgr2=0x7f02f00b6370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:28.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.225+0000 7f02f4df5640 1 -- 172.21.15.77:0/1912600588 shutdown_connections 2023-11-04T01:41:28.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.225+0000 7f02f4df5640 1 -- 172.21.15.77:0/1912600588 wait complete. 2023-11-04T01:41:28.237 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T01:41:28.238 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:41:28.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.336+0000 7f9d01a4b640 1 Processor -- start 2023-11-04T01:41:28.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.336+0000 7f9d01a4b640 1 -- start start 2023-11-04T01:41:28.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.337+0000 7f9d01a4b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9cfc0cde60 0x7f9cfc15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.337+0000 7f9d01a4b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9cfc0ce240 0x7f9cfc0d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.337+0000 7f9d01a4b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc15e000 con 0x7f9cfc15daa0 2023-11-04T01:41:28.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.337+0000 7f9d01a4b640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc15e5c0 con 0x7f9cfc0ce240 2023-11-04T01:41:28.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.337+0000 7f9d01a4b640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc15e2e0 con 0x7f9cfc0cde60 2023-11-04T01:41:28.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.337+0000 7f9cfa7fc640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f9cfc15daa0 0x7f9cfc157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:34450/0 (socket says 172.21.15.77:34450) 2023-11-04T01:41:28.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.338+0000 7f9cfa7fc640 1 -- 172.21.15.77:0/1836042074 learned_addr learned my addr 172.21.15.77:0/1836042074 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:28.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.338+0000 7f9cfaffd640 1 --2- 172.21.15.77:0/1836042074 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9cfc0cde60 0x7f9cfc15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.338+0000 7f9cfb7fe640 1 --2- 172.21.15.77:0/1836042074 >> v2:172.21.15.122:3300/0 conn(0x7f9cfc0ce240 0x7f9cfc0d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.338+0000 7f9cf9ffb640 1 -- 172.21.15.77:0/1836042074 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2612557812 0 0) 0x7f9cfc15e000 con 0x7f9cfc15daa0 2023-11-04T01:41:28.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.338+0000 7f9cf9ffb640 1 -- 172.21.15.77:0/1836042074 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ce4003520 con 0x7f9cfc15daa0 2023-11-04T01:41:28.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.338+0000 7f9cf9ffb640 1 -- 172.21.15.77:0/1836042074 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1887304390 0 0) 0x7f9ce4003520 con 0x7f9cfc15daa0 2023-11-04T01:41:28.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.338+0000 7f9cf9ffb640 1 -- 172.21.15.77:0/1836042074 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9cfc0cde60 msgr2=0x7f9cfc15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:28.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.338+0000 7f9cf9ffb640 1 --2- 172.21.15.77:0/1836042074 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9cfc0cde60 0x7f9cfc15d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.338+0000 7f9cf9ffb640 1 -- 172.21.15.77:0/1836042074 >> v2:172.21.15.122:3300/0 conn(0x7f9cfc0ce240 msgr2=0x7f9cfc0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:28.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.338+0000 7f9cf9ffb640 1 --2- 172.21.15.77:0/1836042074 >> v2:172.21.15.122:3300/0 conn(0x7f9cfc0ce240 0x7f9cfc0d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.338+0000 7f9cf9ffb640 1 -- 172.21.15.77:0/1836042074 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cfc0d1120 con 0x7f9cfc15daa0 2023-11-04T01:41:28.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.338+0000 7f9cf9ffb640 1 -- 172.21.15.77:0/1836042074 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f9cf0001670 con 0x7f9cfc15daa0 2023-11-04T01:41:28.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.338+0000 7f9cf9ffb640 1 -- 172.21.15.77:0/1836042074 >> v1:172.21.15.77:6789/0 conn(0x7f9cfc15daa0 legacy=0x7f9cfc157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.338+0000 7f9cf9ffb640 1 --2- 172.21.15.77:0/1836042074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ce4003970 0x7f9ce4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.338+0000 7f9cf9ffb640 1 --2- 172.21.15.77:0/1836042074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ce40047c0 0x7f9ce4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.338+0000 7f9cf9ffb640 1 --2- 172.21.15.77:0/1836042074 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9cfc0cde60 0x7f9ce4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.338+0000 7f9cf9ffb640 1 -- 172.21.15.77:0/1836042074 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc15e5c0 con 0x7f9ce4003970 2023-11-04T01:41:28.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.338+0000 7f9cf9ffb640 1 -- 172.21.15.77:0/1836042074 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc15e2e0 con 0x7f9ce40047c0 2023-11-04T01:41:28.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.338+0000 7f9cf9ffb640 1 -- 172.21.15.77:0/1836042074 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce400b980 con 0x7f9cfc0cde60 2023-11-04T01:41:28.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.338+0000 7f9cfaffd640 1 --2- 172.21.15.77:0/1836042074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ce4003970 0x7f9ce4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.338+0000 7f9cfa7fc640 1 --2- 172.21.15.77:0/1836042074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ce40047c0 0x7f9ce4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.338+0000 7f9cfb7fe640 1 --2- 172.21.15.77:0/1836042074 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9cfc0cde60 0x7f9ce4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.338+0000 7f9cfaffd640 1 -- 172.21.15.77:0/1836042074 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9cfc0cde60 msgr2=0x7f9ce4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:28.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.338+0000 7f9cfaffd640 1 --2- 172.21.15.77:0/1836042074 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9cfc0cde60 0x7f9ce4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.338+0000 7f9cfaffd640 1 -- 172.21.15.77:0/1836042074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ce40047c0 msgr2=0x7f9ce4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:28.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.338+0000 7f9cfaffd640 1 --2- 172.21.15.77:0/1836042074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ce40047c0 0x7f9ce4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.338+0000 7f9cfaffd640 1 -- 172.21.15.77:0/1836042074 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce4003520 con 0x7f9ce4003970 2023-11-04T01:41:28.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.339+0000 7f9cfaffd640 1 --2- 172.21.15.77:0/1836042074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ce4003970 0x7f9ce4003d90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9cec009ac0 tx=0x7f9ce40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ccae05723af075 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:28.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.339+0000 7f9cf9ffb640 1 -- 172.21.15.77:0/1836042074 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cec02c6b0 con 0x7f9ce4003970 2023-11-04T01:41:28.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.339+0000 7f9cf9ffb640 1 -- 172.21.15.77:0/1836042074 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cec02c810 con 0x7f9ce4003970 2023-11-04T01:41:28.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.339+0000 7f9cf9ffb640 1 -- 172.21.15.77:0/1836042074 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cec02cba0 con 0x7f9ce4003970 2023-11-04T01:41:28.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.340+0000 7f9d01a4b640 1 -- 172.21.15.77:0/1836042074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ce4003970 msgr2=0x7f9ce4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.340+0000 7f9d01a4b640 1 --2- 172.21.15.77:0/1836042074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ce4003970 0x7f9ce4003d90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9cec009ac0 tx=0x7f9ce40057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.340+0000 7f9cfb7fe640 1 -- 172.21.15.77:0/1836042074 reap_dead start 2023-11-04T01:41:28.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.340+0000 7f9d01a4b640 1 -- 172.21.15.77:0/1836042074 shutdown_connections 2023-11-04T01:41:28.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.340+0000 7f9d01a4b640 1 -- 172.21.15.77:0/1836042074 >> 172.21.15.77:0/1836042074 conn(0x7f9cfc071f30 msgr2=0x7f9cfc0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:28.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.340+0000 7f9d01a4b640 1 -- 172.21.15.77:0/1836042074 shutdown_connections 2023-11-04T01:41:28.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.340+0000 7f9d01a4b640 1 -- 172.21.15.77:0/1836042074 wait complete. 2023-11-04T01:41:28.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.341+0000 7f9d01a4b640 1 Processor -- start 2023-11-04T01:41:28.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.341+0000 7f9d01a4b640 1 -- start start 2023-11-04T01:41:28.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.342+0000 7f9d01a4b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9ce4003970 0x7f9cfc14b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.342+0000 7f9d01a4b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cfc15a460 0x7f9cfc158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.342+0000 7f9d01a4b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9cfc158f40 0x7f9cfc154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.342+0000 7f9d01a4b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc159fd0 con 0x7f9cfc15a460 2023-11-04T01:41:28.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.342+0000 7f9d01a4b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc1593c0 con 0x7f9cfc158f40 2023-11-04T01:41:28.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.342+0000 7f9d01a4b640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc1596a0 con 0x7f9ce4003970 2023-11-04T01:41:28.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.342+0000 7f9cfa7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cfc15a460 0x7f9cfc158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.342+0000 7f9cfa7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cfc15a460 0x7f9cfc158a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43562/0 (socket says 172.21.15.77:43562) 2023-11-04T01:41:28.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.342+0000 7f9cfa7fc640 1 -- 172.21.15.77:0/3882905799 learned_addr learned my addr 172.21.15.77:0/3882905799 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:28.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.342+0000 7f9cfaffd640 1 --2- 172.21.15.77:0/3882905799 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9ce4003970 0x7f9cfc14b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.342+0000 7f9cfb7fe640 1 --2- 172.21.15.77:0/3882905799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9cfc158f40 0x7f9cfc154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.342+0000 7f9cfa7fc640 1 -- 172.21.15.77:0/3882905799 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9ce4003970 msgr2=0x7f9cfc14b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.342+0000 7f9cfa7fc640 1 --2- 172.21.15.77:0/3882905799 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9ce4003970 0x7f9cfc14b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.342+0000 7f9cfa7fc640 1 -- 172.21.15.77:0/3882905799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9cfc158f40 msgr2=0x7f9cfc154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.342+0000 7f9cfa7fc640 1 --2- 172.21.15.77:0/3882905799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9cfc158f40 0x7f9cfc154380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.342+0000 7f9cfa7fc640 1 -- 172.21.15.77:0/3882905799 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cfc159980 con 0x7f9cfc15a460 2023-11-04T01:41:28.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.342+0000 7f9cfb7fe640 1 --2- 172.21.15.77:0/3882905799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9cfc158f40 0x7f9cfc154380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:28.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.342+0000 7f9cfa7fc640 1 --2- 172.21.15.77:0/3882905799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cfc15a460 0x7f9cfc158a00 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0000fd0 tx=0x7f9cf0007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:28.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.342+0000 7f9ce3fff640 1 -- 172.21.15.77:0/3882905799 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf0007c60 con 0x7f9cfc15a460 2023-11-04T01:41:28.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.342+0000 7f9ce3fff640 1 -- 172.21.15.77:0/3882905799 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf000f930 con 0x7f9cfc15a460 2023-11-04T01:41:28.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.343+0000 7f9d01a4b640 1 -- 172.21.15.77:0/3882905799 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cfc159c60 con 0x7f9cfc15a460 2023-11-04T01:41:28.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.343+0000 7f9ce3fff640 1 -- 172.21.15.77:0/3882905799 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf000fcc0 con 0x7f9cfc15a460 2023-11-04T01:41:28.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.343+0000 7f9d01a4b640 1 -- 172.21.15.77:0/3882905799 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cfc15bc70 con 0x7f9cfc15a460 2023-11-04T01:41:28.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.343+0000 7f9d01a4b640 1 -- 172.21.15.77:0/3882905799 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cfc15be90 con 0x7f9cfc15a460 2023-11-04T01:41:28.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.344+0000 7f9ce3fff640 1 -- 172.21.15.77:0/3882905799 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9cf001d460 con 0x7f9cfc15a460 2023-11-04T01:41:28.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.344+0000 7f9ce3fff640 1 --2- 172.21.15.77:0/3882905799 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9ce806ae70 0x7f9ce806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.344+0000 7f9ce3fff640 1 -- 172.21.15.77:0/3882905799 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9cf0089910 con 0x7f9cfc15a460 2023-11-04T01:41:28.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.344+0000 7f9cfaffd640 1 --2- 172.21.15.77:0/3882905799 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9ce806ae70 0x7f9ce806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.345+0000 7f9cfaffd640 1 --2- 172.21.15.77:0/3882905799 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9ce806ae70 0x7f9ce806d330 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9cec036000 tx=0x7f9cec030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:28.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.348+0000 7f9ce3fff640 1 -- 172.21.15.77:0/3882905799 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9cfc15be90 con 0x7f9cfc15a460 2023-11-04T01:41:28.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.510+0000 7f9d01a4b640 1 -- 172.21.15.77:0/3882905799 --> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9cfc0d1400 con 0x7f9ce806ae70 2023-11-04T01:41:28.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.519+0000 7f9ce3fff640 1 -- 172.21.15.77:0/3882905799 <== mgr.4123 v2:172.21.15.122:6832/2275325762 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289268 (secure 0 0 0) 0x7f9cec004140 con 0x7f9ce806ae70 2023-11-04T01:41:28.523 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:28.525 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-04T01:41:28.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.522+0000 7f9d01a4b640 1 -- 172.21.15.77:0/3882905799 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9ce806ae70 msgr2=0x7f9ce806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.522+0000 7f9d01a4b640 1 --2- 172.21.15.77:0/3882905799 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9ce806ae70 0x7f9ce806d330 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9cec036000 tx=0x7f9cec030000 comp rx=0 tx=0).stop 2023-11-04T01:41:28.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.522+0000 7f9d01a4b640 1 -- 172.21.15.77:0/3882905799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cfc15a460 msgr2=0x7f9cfc158a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.522+0000 7f9d01a4b640 1 --2- 172.21.15.77:0/3882905799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cfc15a460 0x7f9cfc158a00 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0000fd0 tx=0x7f9cf0007720 comp rx=0 tx=0).stop 2023-11-04T01:41:28.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.522+0000 7f9d01a4b640 1 -- 172.21.15.77:0/3882905799 shutdown_connections 2023-11-04T01:41:28.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.522+0000 7f9d01a4b640 1 --2- 172.21.15.77:0/3882905799 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9ce806ae70 0x7f9ce806d330 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.522+0000 7f9d01a4b640 1 --2- 172.21.15.77:0/3882905799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9cfc158f40 0x7f9cfc154380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.522+0000 7f9d01a4b640 1 --2- 172.21.15.77:0/3882905799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9cfc15a460 0x7f9cfc158a00 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.522+0000 7f9d01a4b640 1 --2- 172.21.15.77:0/3882905799 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9ce4003970 0x7f9cfc14b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.522+0000 7f9d01a4b640 1 -- 172.21.15.77:0/3882905799 >> 172.21.15.77:0/3882905799 conn(0x7f9cfc071f30 msgr2=0x7f9cfc0c9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:28.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.522+0000 7f9d01a4b640 1 -- 172.21.15.77:0/3882905799 shutdown_connections 2023-11-04T01:41:28.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.522+0000 7f9d01a4b640 1 -- 172.21.15.77:0/3882905799 wait complete. 2023-11-04T01:41:28.534 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2023-11-04T01:41:27.646369+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":95,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220732,"kb_used_data":4560,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753988,"statfs":{"total":773094113280,"available":772868083712,"internally_reserved":0,"allocated":4669440,"data_stored":2646133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.061114"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.566641+0000","last_change":"2023-11-04T01:41:25.573749+0000","last_active":"2023-11-04T01:41:26.566641+0000","last_peered":"2023-11-04T01:41:26.566641+0000","last_clean":"2023-11-04T01:41:26.566641+0000","last_became_active":"2023-11-04T01:41:25.573483+0000","last_became_peered":"2023-11-04T01:41:25.573483+0000","last_unstale":"2023-11-04T01:41:26.566641+0000","last_undegraded":"2023-11-04T01:41:26.566641+0000","last_fullsized":"2023-11-04T01:41:26.566641+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:08:19.264763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.566533+0000","last_change":"2023-11-04T01:41:25.573779+0000","last_active":"2023-11-04T01:41:26.566533+0000","last_peered":"2023-11-04T01:41:26.566533+0000","last_clean":"2023-11-04T01:41:26.566533+0000","last_became_active":"2023-11-04T01:41:25.573489+0000","last_became_peered":"2023-11-04T01:41:25.573489+0000","last_unstale":"2023-11-04T01:41:26.566533+0000","last_undegraded":"2023-11-04T01:41:26.566533+0000","last_fullsized":"2023-11-04T01:41:26.566533+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:23:14.611819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.581229+0000","last_change":"2023-11-04T01:41:25.576101+0000","last_active":"2023-11-04T01:41:25.581229+0000","last_peered":"2023-11-04T01:41:25.581229+0000","last_clean":"2023-11-04T01:41:25.581229+0000","last_became_active":"2023-11-04T01:41:25.575852+0000","last_became_peered":"2023-11-04T01:41:25.575852+0000","last_unstale":"2023-11-04T01:41:25.581229+0000","last_undegraded":"2023-11-04T01:41:25.581229+0000","last_fullsized":"2023-11-04T01:41:25.581229+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:35.072439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.581372+0000","last_change":"2023-11-04T01:41:25.577311+0000","last_active":"2023-11-04T01:41:25.581372+0000","last_peered":"2023-11-04T01:41:25.581372+0000","last_clean":"2023-11-04T01:41:25.581372+0000","last_became_active":"2023-11-04T01:41:25.576982+0000","last_became_peered":"2023-11-04T01:41:25.576982+0000","last_unstale":"2023-11-04T01:41:25.581372+0000","last_undegraded":"2023-11-04T01:41:25.581372+0000","last_fullsized":"2023-11-04T01:41:25.581372+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:04:39.682987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.586492+0000","last_change":"2023-11-04T01:41:25.581748+0000","last_active":"2023-11-04T01:41:25.586492+0000","last_peered":"2023-11-04T01:41:25.586492+0000","last_clean":"2023-11-04T01:41:25.586492+0000","last_became_active":"2023-11-04T01:41:25.581130+0000","last_became_peered":"2023-11-04T01:41:25.581130+0000","last_unstale":"2023-11-04T01:41:25.586492+0000","last_undegraded":"2023-11-04T01:41:25.586492+0000","last_fullsized":"2023-11-04T01:41:25.586492+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:04:19.770749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:27.332816+0000","last_change":"2023-11-04T01:41:25.573165+0000","last_active":"2023-11-04T01:41:27.332816+0000","last_peered":"2023-11-04T01:41:27.332816+0000","last_clean":"2023-11-04T01:41:27.332816+0000","last_became_active":"2023-11-04T01:41:25.572920+0000","last_became_peered":"2023-11-04T01:41:25.572920+0000","last_unstale":"2023-11-04T01:41:27.332816+0000","last_undegraded":"2023-11-04T01:41:27.332816+0000","last_fullsized":"2023-11-04T01:41:27.332816+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:34:36.106454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568430+0000","last_change":"2023-11-04T01:41:25.576680+0000","last_active":"2023-11-04T01:41:26.568430+0000","last_peered":"2023-11-04T01:41:26.568430+0000","last_clean":"2023-11-04T01:41:26.568430+0000","last_became_active":"2023-11-04T01:41:25.576413+0000","last_became_peered":"2023-11-04T01:41:25.576413+0000","last_unstale":"2023-11-04T01:41:26.568430+0000","last_undegraded":"2023-11-04T01:41:26.568430+0000","last_fullsized":"2023-11-04T01:41:26.568430+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:15:27.535767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.566168+0000","last_change":"2023-11-04T01:41:25.571983+0000","last_active":"2023-11-04T01:41:26.566168+0000","last_peered":"2023-11-04T01:41:26.566168+0000","last_clean":"2023-11-04T01:41:26.566168+0000","last_became_active":"2023-11-04T01:41:25.571687+0000","last_became_peered":"2023-11-04T01:41:25.571687+0000","last_unstale":"2023-11-04T01:41:26.566168+0000","last_undegraded":"2023-11-04T01:41:26.566168+0000","last_fullsized":"2023-11-04T01:41:26.566168+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:02:20.439674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.581151+0000","last_change":"2023-11-04T01:41:25.576815+0000","last_active":"2023-11-04T01:41:25.581151+0000","last_peered":"2023-11-04T01:41:25.581151+0000","last_clean":"2023-11-04T01:41:25.581151+0000","last_became_active":"2023-11-04T01:41:25.576498+0000","last_became_peered":"2023-11-04T01:41:25.576498+0000","last_unstale":"2023-11-04T01:41:25.581151+0000","last_undegraded":"2023-11-04T01:41:25.581151+0000","last_fullsized":"2023-11-04T01:41:25.581151+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:01:55.727018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568787+0000","last_change":"2023-11-04T01:41:25.574168+0000","last_active":"2023-11-04T01:41:26.568787+0000","last_peered":"2023-11-04T01:41:26.568787+0000","last_clean":"2023-11-04T01:41:26.568787+0000","last_became_active":"2023-11-04T01:41:25.573879+0000","last_became_peered":"2023-11-04T01:41:25.573879+0000","last_unstale":"2023-11-04T01:41:26.568787+0000","last_undegraded":"2023-11-04T01:41:26.568787+0000","last_fullsized":"2023-11-04T01:41:26.568787+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:10.968397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568929+0000","last_change":"2023-11-04T01:41:25.579906+0000","last_active":"2023-11-04T01:41:26.568929+0000","last_peered":"2023-11-04T01:41:26.568929+0000","last_clean":"2023-11-04T01:41:26.568929+0000","last_became_active":"2023-11-04T01:41:25.579435+0000","last_became_peered":"2023-11-04T01:41:25.579435+0000","last_unstale":"2023-11-04T01:41:26.568929+0000","last_undegraded":"2023-11-04T01:41:26.568929+0000","last_fullsized":"2023-11-04T01:41:26.568929+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:23:14.611819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.581203+0000","last_change":"2023-11-04T01:41:25.576944+0000","last_active":"2023-11-04T01:41:25.581203+0000","last_peered":"2023-11-04T01:41:25.581203+0000","last_clean":"2023-11-04T01:41:25.581203+0000","last_became_active":"2023-11-04T01:41:25.576663+0000","last_became_peered":"2023-11-04T01:41:25.576663+0000","last_unstale":"2023-11-04T01:41:25.581203+0000","last_undegraded":"2023-11-04T01:41:25.581203+0000","last_fullsized":"2023-11-04T01:41:25.581203+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:29:11.820370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568773+0000","last_change":"2023-11-04T01:41:25.571580+0000","last_active":"2023-11-04T01:41:26.568773+0000","last_peered":"2023-11-04T01:41:26.568773+0000","last_clean":"2023-11-04T01:41:26.568773+0000","last_became_active":"2023-11-04T01:41:25.571291+0000","last_became_peered":"2023-11-04T01:41:25.571291+0000","last_unstale":"2023-11-04T01:41:26.568773+0000","last_undegraded":"2023-11-04T01:41:26.568773+0000","last_fullsized":"2023-11-04T01:41:26.568773+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:14:12.898473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.585216+0000","last_change":"2023-11-04T01:41:25.584193+0000","last_active":"2023-11-04T01:41:25.585216+0000","last_peered":"2023-11-04T01:41:25.585216+0000","last_clean":"2023-11-04T01:41:25.585216+0000","last_became_active":"2023-11-04T01:41:25.583936+0000","last_became_peered":"2023-11-04T01:41:25.583936+0000","last_unstale":"2023-11-04T01:41:25.585216+0000","last_undegraded":"2023-11-04T01:41:25.585216+0000","last_fullsized":"2023-11-04T01:41:25.585216+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:59:53.806180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568591+0000","last_change":"2023-11-04T01:41:25.578808+0000","last_active":"2023-11-04T01:41:26.568591+0000","last_peered":"2023-11-04T01:41:26.568591+0000","last_clean":"2023-11-04T01:41:26.568591+0000","last_became_active":"2023-11-04T01:41:25.578542+0000","last_became_peered":"2023-11-04T01:41:25.578542+0000","last_unstale":"2023-11-04T01:41:26.568591+0000","last_undegraded":"2023-11-04T01:41:26.568591+0000","last_fullsized":"2023-11-04T01:41:26.568591+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:43.475755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568071+0000","last_change":"2023-11-04T01:41:25.575093+0000","last_active":"2023-11-04T01:41:26.568071+0000","last_peered":"2023-11-04T01:41:26.568071+0000","last_clean":"2023-11-04T01:41:26.568071+0000","last_became_active":"2023-11-04T01:41:25.574820+0000","last_became_peered":"2023-11-04T01:41:25.574820+0000","last_unstale":"2023-11-04T01:41:26.568071+0000","last_undegraded":"2023-11-04T01:41:26.568071+0000","last_fullsized":"2023-11-04T01:41:26.568071+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:32:10.752870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568621+0000","last_change":"2023-11-04T01:41:25.579427+0000","last_active":"2023-11-04T01:41:26.568621+0000","last_peered":"2023-11-04T01:41:26.568621+0000","last_clean":"2023-11-04T01:41:26.568621+0000","last_became_active":"2023-11-04T01:41:25.577158+0000","last_became_peered":"2023-11-04T01:41:25.577158+0000","last_unstale":"2023-11-04T01:41:26.568621+0000","last_undegraded":"2023-11-04T01:41:26.568621+0000","last_fullsized":"2023-11-04T01:41:26.568621+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:50.487101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.585396+0000","last_change":"2023-11-04T01:41:25.583900+0000","last_active":"2023-11-04T01:41:25.585396+0000","last_peered":"2023-11-04T01:41:25.585396+0000","last_clean":"2023-11-04T01:41:25.585396+0000","last_became_active":"2023-11-04T01:41:25.583649+0000","last_became_peered":"2023-11-04T01:41:25.583649+0000","last_unstale":"2023-11-04T01:41:25.585396+0000","last_undegraded":"2023-11-04T01:41:25.585396+0000","last_fullsized":"2023-11-04T01:41:25.585396+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:27:22.015978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.583552+0000","last_change":"2023-11-04T01:41:25.579023+0000","last_active":"2023-11-04T01:41:25.583552+0000","last_peered":"2023-11-04T01:41:25.583552+0000","last_clean":"2023-11-04T01:41:25.583552+0000","last_became_active":"2023-11-04T01:41:25.578725+0000","last_became_peered":"2023-11-04T01:41:25.578725+0000","last_unstale":"2023-11-04T01:41:25.583552+0000","last_undegraded":"2023-11-04T01:41:25.583552+0000","last_fullsized":"2023-11-04T01:41:25.583552+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:50:35.238638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.583287+0000","last_change":"2023-11-04T01:41:25.582112+0000","last_active":"2023-11-04T01:41:25.583287+0000","last_peered":"2023-11-04T01:41:25.583287+0000","last_clean":"2023-11-04T01:41:25.583287+0000","last_became_active":"2023-11-04T01:41:25.581158+0000","last_became_peered":"2023-11-04T01:41:25.581158+0000","last_unstale":"2023-11-04T01:41:25.583287+0000","last_undegraded":"2023-11-04T01:41:25.583287+0000","last_fullsized":"2023-11-04T01:41:25.583287+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:07:31.735125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568853+0000","last_change":"2023-11-04T01:41:25.572136+0000","last_active":"2023-11-04T01:41:26.568853+0000","last_peered":"2023-11-04T01:41:26.568853+0000","last_clean":"2023-11-04T01:41:26.568853+0000","last_became_active":"2023-11-04T01:41:25.571852+0000","last_became_peered":"2023-11-04T01:41:25.571852+0000","last_unstale":"2023-11-04T01:41:26.568853+0000","last_undegraded":"2023-11-04T01:41:26.568853+0000","last_fullsized":"2023-11-04T01:41:26.568853+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:38.999965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.584283+0000","last_change":"2023-11-04T01:41:25.579004+0000","last_active":"2023-11-04T01:41:25.584283+0000","last_peered":"2023-11-04T01:41:25.584283+0000","last_clean":"2023-11-04T01:41:25.584283+0000","last_became_active":"2023-11-04T01:41:25.577403+0000","last_became_peered":"2023-11-04T01:41:25.577403+0000","last_unstale":"2023-11-04T01:41:25.584283+0000","last_undegraded":"2023-11-04T01:41:25.584283+0000","last_fullsized":"2023-11-04T01:41:25.584283+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:29:11.820370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568036+0000","last_change":"2023-11-04T01:41:25.580848+0000","last_active":"2023-11-04T01:41:26.568036+0000","last_peered":"2023-11-04T01:41:26.568036+0000","last_clean":"2023-11-04T01:41:26.568036+0000","last_became_active":"2023-11-04T01:41:25.579881+0000","last_became_peered":"2023-11-04T01:41:25.579881+0000","last_unstale":"2023-11-04T01:41:26.568036+0000","last_undegraded":"2023-11-04T01:41:26.568036+0000","last_fullsized":"2023-11-04T01:41:26.568036+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:02:20.439674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.583629+0000","last_change":"2023-11-04T01:41:25.580228+0000","last_active":"2023-11-04T01:41:25.583629+0000","last_peered":"2023-11-04T01:41:25.583629+0000","last_clean":"2023-11-04T01:41:25.583629+0000","last_became_active":"2023-11-04T01:41:25.579946+0000","last_became_peered":"2023-11-04T01:41:25.579946+0000","last_unstale":"2023-11-04T01:41:25.583629+0000","last_undegraded":"2023-11-04T01:41:25.583629+0000","last_fullsized":"2023-11-04T01:41:25.583629+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:33:55.674169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.584516+0000","last_change":"2023-11-04T01:41:25.580750+0000","last_active":"2023-11-04T01:41:25.584516+0000","last_peered":"2023-11-04T01:41:25.584516+0000","last_clean":"2023-11-04T01:41:25.584516+0000","last_became_active":"2023-11-04T01:41:25.580364+0000","last_became_peered":"2023-11-04T01:41:25.580364+0000","last_unstale":"2023-11-04T01:41:25.584516+0000","last_undegraded":"2023-11-04T01:41:25.584516+0000","last_fullsized":"2023-11-04T01:41:25.584516+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:00:38.558380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:27.332880+0000","last_change":"2023-11-04T01:41:25.576048+0000","last_active":"2023-11-04T01:41:27.332880+0000","last_peered":"2023-11-04T01:41:27.332880+0000","last_clean":"2023-11-04T01:41:27.332880+0000","last_became_active":"2023-11-04T01:41:25.575801+0000","last_became_peered":"2023-11-04T01:41:25.575801+0000","last_unstale":"2023-11-04T01:41:27.332880+0000","last_undegraded":"2023-11-04T01:41:27.332880+0000","last_fullsized":"2023-11-04T01:41:27.332880+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:00:01.250924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.582976+0000","last_change":"2023-11-04T01:41:25.578106+0000","last_active":"2023-11-04T01:41:25.582976+0000","last_peered":"2023-11-04T01:41:25.582976+0000","last_clean":"2023-11-04T01:41:25.582976+0000","last_became_active":"2023-11-04T01:41:25.577594+0000","last_became_peered":"2023-11-04T01:41:25.577594+0000","last_unstale":"2023-11-04T01:41:25.582976+0000","last_undegraded":"2023-11-04T01:41:25.582976+0000","last_fullsized":"2023-11-04T01:41:25.582976+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:27:53.357719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568147+0000","last_change":"2023-11-04T01:41:25.577438+0000","last_active":"2023-11-04T01:41:26.568147+0000","last_peered":"2023-11-04T01:41:26.568147+0000","last_clean":"2023-11-04T01:41:26.568147+0000","last_became_active":"2023-11-04T01:41:25.577206+0000","last_became_peered":"2023-11-04T01:41:25.577206+0000","last_unstale":"2023-11-04T01:41:26.568147+0000","last_undegraded":"2023-11-04T01:41:26.568147+0000","last_fullsized":"2023-11-04T01:41:26.568147+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:32:10.752870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.582724+0000","last_change":"2023-11-04T01:41:25.579910+0000","last_active":"2023-11-04T01:41:25.582724+0000","last_peered":"2023-11-04T01:41:25.582724+0000","last_clean":"2023-11-04T01:41:25.582724+0000","last_became_active":"2023-11-04T01:41:25.579378+0000","last_became_peered":"2023-11-04T01:41:25.579378+0000","last_unstale":"2023-11-04T01:41:25.582724+0000","last_undegraded":"2023-11-04T01:41:25.582724+0000","last_fullsized":"2023-11-04T01:41:25.582724+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:53:08.753307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.577670+0000","last_change":"2023-11-04T01:41:25.575892+0000","last_active":"2023-11-04T01:41:25.577670+0000","last_peered":"2023-11-04T01:41:25.577670+0000","last_clean":"2023-11-04T01:41:25.577670+0000","last_became_active":"2023-11-04T01:41:25.575628+0000","last_became_peered":"2023-11-04T01:41:25.575628+0000","last_unstale":"2023-11-04T01:41:25.577670+0000","last_undegraded":"2023-11-04T01:41:25.577670+0000","last_fullsized":"2023-11-04T01:41:25.577670+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:01:55.727018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.567671+0000","last_change":"2023-11-04T01:41:25.576766+0000","last_active":"2023-11-04T01:41:26.567671+0000","last_peered":"2023-11-04T01:41:26.567671+0000","last_clean":"2023-11-04T01:41:26.567671+0000","last_became_active":"2023-11-04T01:41:25.576484+0000","last_became_peered":"2023-11-04T01:41:25.576484+0000","last_unstale":"2023-11-04T01:41:26.567671+0000","last_undegraded":"2023-11-04T01:41:26.567671+0000","last_fullsized":"2023-11-04T01:41:26.567671+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:22:56.441635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:27.332711+0000","last_change":"2023-11-04T01:41:25.574239+0000","last_active":"2023-11-04T01:41:27.332711+0000","last_peered":"2023-11-04T01:41:27.332711+0000","last_clean":"2023-11-04T01:41:27.332711+0000","last_became_active":"2023-11-04T01:41:25.573990+0000","last_became_peered":"2023-11-04T01:41:25.573990+0000","last_unstale":"2023-11-04T01:41:27.332711+0000","last_undegraded":"2023-11-04T01:41:27.332711+0000","last_fullsized":"2023-11-04T01:41:27.332711+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:25.932332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568459+0000","last_change":"2023-11-04T01:41:25.578535+0000","last_active":"2023-11-04T01:41:26.568459+0000","last_peered":"2023-11-04T01:41:26.568459+0000","last_clean":"2023-11-04T01:41:26.568459+0000","last_became_active":"2023-11-04T01:41:25.576159+0000","last_became_peered":"2023-11-04T01:41:25.576159+0000","last_unstale":"2023-11-04T01:41:26.568459+0000","last_undegraded":"2023-11-04T01:41:26.568459+0000","last_fullsized":"2023-11-04T01:41:26.568459+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:10.968397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.599337+0000","last_change":"2023-11-04T01:41:24.606738+0000","last_active":"2023-11-04T01:41:25.599337+0000","last_peered":"2023-11-04T01:41:25.599337+0000","last_clean":"2023-11-04T01:41:25.599337+0000","last_became_active":"2023-11-04T01:41:24.605342+0000","last_became_peered":"2023-11-04T01:41:24.605342+0000","last_unstale":"2023-11-04T01:41:25.599337+0000","last_undegraded":"2023-11-04T01:41:25.599337+0000","last_fullsized":"2023-11-04T01:41:25.599337+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:34.069843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:27.332977+0000","last_change":"2023-11-04T01:41:25.578507+0000","last_active":"2023-11-04T01:41:27.332977+0000","last_peered":"2023-11-04T01:41:27.332977+0000","last_clean":"2023-11-04T01:41:27.332977+0000","last_became_active":"2023-11-04T01:41:25.578041+0000","last_became_peered":"2023-11-04T01:41:25.578041+0000","last_unstale":"2023-11-04T01:41:27.332977+0000","last_undegraded":"2023-11-04T01:41:27.332977+0000","last_fullsized":"2023-11-04T01:41:27.332977+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:57:51.209383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.599159+0000","last_change":"2023-11-04T01:41:24.603124+0000","last_active":"2023-11-04T01:41:25.599159+0000","last_peered":"2023-11-04T01:41:25.599159+0000","last_clean":"2023-11-04T01:41:25.599159+0000","last_became_active":"2023-11-04T01:41:24.602856+0000","last_became_peered":"2023-11-04T01:41:24.602856+0000","last_unstale":"2023-11-04T01:41:25.599159+0000","last_undegraded":"2023-11-04T01:41:25.599159+0000","last_fullsized":"2023-11-04T01:41:25.599159+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:24.929736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.584089+0000","last_change":"2023-11-04T01:41:25.578960+0000","last_active":"2023-11-04T01:41:25.584089+0000","last_peered":"2023-11-04T01:41:25.584089+0000","last_clean":"2023-11-04T01:41:25.584089+0000","last_became_active":"2023-11-04T01:41:25.578699+0000","last_became_peered":"2023-11-04T01:41:25.578699+0000","last_unstale":"2023-11-04T01:41:25.584089+0000","last_undegraded":"2023-11-04T01:41:25.584089+0000","last_fullsized":"2023-11-04T01:41:25.584089+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:35.072439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:27.333000+0000","last_change":"2023-11-04T01:41:24.603777+0000","last_active":"2023-11-04T01:41:27.333000+0000","last_peered":"2023-11-04T01:41:27.333000+0000","last_clean":"2023-11-04T01:41:27.333000+0000","last_became_active":"2023-11-04T01:41:24.601964+0000","last_became_peered":"2023-11-04T01:41:24.601964+0000","last_unstale":"2023-11-04T01:41:27.333000+0000","last_undegraded":"2023-11-04T01:41:27.333000+0000","last_fullsized":"2023-11-04T01:41:27.333000+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:15.895433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.566573+0000","last_change":"2023-11-04T01:41:25.574546+0000","last_active":"2023-11-04T01:41:26.566573+0000","last_peered":"2023-11-04T01:41:26.566573+0000","last_clean":"2023-11-04T01:41:26.566573+0000","last_became_active":"2023-11-04T01:41:25.574281+0000","last_became_peered":"2023-11-04T01:41:25.574281+0000","last_unstale":"2023-11-04T01:41:26.566573+0000","last_undegraded":"2023-11-04T01:41:26.566573+0000","last_fullsized":"2023-11-04T01:41:26.566573+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:15:23.173234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.599792+0000","last_change":"2023-11-04T01:41:24.602749+0000","last_active":"2023-11-04T01:41:25.599792+0000","last_peered":"2023-11-04T01:41:25.599792+0000","last_clean":"2023-11-04T01:41:25.599792+0000","last_became_active":"2023-11-04T01:41:24.602472+0000","last_became_peered":"2023-11-04T01:41:24.602472+0000","last_unstale":"2023-11-04T01:41:25.599792+0000","last_undegraded":"2023-11-04T01:41:25.599792+0000","last_fullsized":"2023-11-04T01:41:25.599792+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:01:54.724422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.583601+0000","last_change":"2023-11-04T01:41:25.578528+0000","last_active":"2023-11-04T01:41:25.583601+0000","last_peered":"2023-11-04T01:41:25.583601+0000","last_clean":"2023-11-04T01:41:25.583601+0000","last_became_active":"2023-11-04T01:41:25.578280+0000","last_became_peered":"2023-11-04T01:41:25.578280+0000","last_unstale":"2023-11-04T01:41:25.583601+0000","last_undegraded":"2023-11-04T01:41:25.583601+0000","last_fullsized":"2023-11-04T01:41:25.583601+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:26.997598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.569047+0000","last_change":"2023-11-04T01:41:24.607356+0000","last_active":"2023-11-04T01:41:26.569047+0000","last_peered":"2023-11-04T01:41:26.569047+0000","last_clean":"2023-11-04T01:41:26.569047+0000","last_became_active":"2023-11-04T01:41:24.606799+0000","last_became_peered":"2023-11-04T01:41:24.606799+0000","last_unstale":"2023-11-04T01:41:26.569047+0000","last_undegraded":"2023-11-04T01:41:26.569047+0000","last_fullsized":"2023-11-04T01:41:26.569047+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:22:55.439039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568572+0000","last_change":"2023-11-04T01:41:25.571959+0000","last_active":"2023-11-04T01:41:26.568572+0000","last_peered":"2023-11-04T01:41:26.568572+0000","last_clean":"2023-11-04T01:41:26.568572+0000","last_became_active":"2023-11-04T01:41:25.571673+0000","last_became_peered":"2023-11-04T01:41:25.571673+0000","last_unstale":"2023-11-04T01:41:26.568572+0000","last_undegraded":"2023-11-04T01:41:26.568572+0000","last_fullsized":"2023-11-04T01:41:26.568572+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:02:20.439674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568127+0000","last_change":"2023-11-04T01:41:24.604257+0000","last_active":"2023-11-04T01:41:26.568127+0000","last_peered":"2023-11-04T01:41:26.568127+0000","last_clean":"2023-11-04T01:41:26.568127+0000","last_became_active":"2023-11-04T01:41:24.603954+0000","last_became_peered":"2023-11-04T01:41:24.603954+0000","last_unstale":"2023-11-04T01:41:26.568127+0000","last_undegraded":"2023-11-04T01:41:26.568127+0000","last_fullsized":"2023-11-04T01:41:26.568127+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:29:10.817773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.584559+0000","last_change":"2023-11-04T01:41:25.581537+0000","last_active":"2023-11-04T01:41:25.584559+0000","last_peered":"2023-11-04T01:41:25.584559+0000","last_clean":"2023-11-04T01:41:25.584559+0000","last_became_active":"2023-11-04T01:41:25.581297+0000","last_became_peered":"2023-11-04T01:41:25.581297+0000","last_unstale":"2023-11-04T01:41:25.584559+0000","last_undegraded":"2023-11-04T01:41:25.584559+0000","last_fullsized":"2023-11-04T01:41:25.584559+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:26.997598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:27.332945+0000","last_change":"2023-11-04T01:41:24.608996+0000","last_active":"2023-11-04T01:41:27.332945+0000","last_peered":"2023-11-04T01:41:27.332945+0000","last_clean":"2023-11-04T01:41:27.332945+0000","last_became_active":"2023-11-04T01:41:24.608704+0000","last_became_peered":"2023-11-04T01:41:24.608704+0000","last_unstale":"2023-11-04T01:41:27.332945+0000","last_undegraded":"2023-11-04T01:41:27.332945+0000","last_fullsized":"2023-11-04T01:41:27.332945+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:34.069843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.566349+0000","last_change":"2023-11-04T01:41:25.570618+0000","last_active":"2023-11-04T01:41:26.566349+0000","last_peered":"2023-11-04T01:41:26.566349+0000","last_clean":"2023-11-04T01:41:26.566349+0000","last_became_active":"2023-11-04T01:41:25.570027+0000","last_became_peered":"2023-11-04T01:41:25.570027+0000","last_unstale":"2023-11-04T01:41:26.566349+0000","last_undegraded":"2023-11-04T01:41:26.566349+0000","last_fullsized":"2023-11-04T01:41:26.566349+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:14:12.898473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.567682+0000","last_change":"2023-11-04T01:41:24.606589+0000","last_active":"2023-11-04T01:41:25.567682+0000","last_peered":"2023-11-04T01:41:25.567682+0000","last_clean":"2023-11-04T01:41:25.567682+0000","last_became_active":"2023-11-04T01:41:24.606210+0000","last_became_peered":"2023-11-04T01:41:24.606210+0000","last_unstale":"2023-11-04T01:41:25.567682+0000","last_undegraded":"2023-11-04T01:41:25.567682+0000","last_fullsized":"2023-11-04T01:41:25.567682+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:07:30.732529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.586453+0000","last_change":"2023-11-04T01:41:25.581259+0000","last_active":"2023-11-04T01:41:25.586453+0000","last_peered":"2023-11-04T01:41:25.586453+0000","last_clean":"2023-11-04T01:41:25.586453+0000","last_became_active":"2023-11-04T01:41:25.580950+0000","last_became_peered":"2023-11-04T01:41:25.580950+0000","last_unstale":"2023-11-04T01:41:25.586453+0000","last_undegraded":"2023-11-04T01:41:25.586453+0000","last_fullsized":"2023-11-04T01:41:25.586453+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:40:09.942764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.566615+0000","last_change":"2023-11-04T01:41:24.600989+0000","last_active":"2023-11-04T01:41:26.566615+0000","last_peered":"2023-11-04T01:41:26.566615+0000","last_clean":"2023-11-04T01:41:26.566615+0000","last_became_active":"2023-11-04T01:41:24.600717+0000","last_became_peered":"2023-11-04T01:41:24.600717+0000","last_unstale":"2023-11-04T01:41:26.566615+0000","last_undegraded":"2023-11-04T01:41:26.566615+0000","last_fullsized":"2023-11-04T01:41:26.566615+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:32:09.750274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568521+0000","last_change":"2023-11-04T01:41:25.576139+0000","last_active":"2023-11-04T01:41:26.568521+0000","last_peered":"2023-11-04T01:41:26.568521+0000","last_clean":"2023-11-04T01:41:26.568521+0000","last_became_active":"2023-11-04T01:41:25.575679+0000","last_became_peered":"2023-11-04T01:41:25.575679+0000","last_unstale":"2023-11-04T01:41:26.568521+0000","last_undegraded":"2023-11-04T01:41:26.568521+0000","last_fullsized":"2023-11-04T01:41:26.568521+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:38.999965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.569090+0000","last_change":"2023-11-04T01:41:24.612559+0000","last_active":"2023-11-04T01:41:26.569090+0000","last_peered":"2023-11-04T01:41:26.569090+0000","last_clean":"2023-11-04T01:41:26.569090+0000","last_became_active":"2023-11-04T01:41:24.612210+0000","last_became_peered":"2023-11-04T01:41:24.612210+0000","last_unstale":"2023-11-04T01:41:26.569090+0000","last_undegraded":"2023-11-04T01:41:26.569090+0000","last_fullsized":"2023-11-04T01:41:26.569090+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:06:16.567391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.586557+0000","last_change":"2023-11-04T01:41:25.582683+0000","last_active":"2023-11-04T01:41:25.586557+0000","last_peered":"2023-11-04T01:41:25.586557+0000","last_clean":"2023-11-04T01:41:25.586557+0000","last_became_active":"2023-11-04T01:41:25.582394+0000","last_became_peered":"2023-11-04T01:41:25.582394+0000","last_unstale":"2023-11-04T01:41:25.586557+0000","last_undegraded":"2023-11-04T01:41:25.586557+0000","last_fullsized":"2023-11-04T01:41:25.586557+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:14:18.522403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.569063+0000","last_change":"2023-11-04T01:41:24.612564+0000","last_active":"2023-11-04T01:41:26.569063+0000","last_peered":"2023-11-04T01:41:26.569063+0000","last_clean":"2023-11-04T01:41:26.569063+0000","last_became_active":"2023-11-04T01:41:24.612307+0000","last_became_peered":"2023-11-04T01:41:24.612307+0000","last_unstale":"2023-11-04T01:41:26.569063+0000","last_undegraded":"2023-11-04T01:41:26.569063+0000","last_fullsized":"2023-11-04T01:41:26.569063+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:34:35.103857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.584181+0000","last_change":"2023-11-04T01:41:25.579187+0000","last_active":"2023-11-04T01:41:25.584181+0000","last_peered":"2023-11-04T01:41:25.584181+0000","last_clean":"2023-11-04T01:41:25.584181+0000","last_became_active":"2023-11-04T01:41:25.577013+0000","last_became_peered":"2023-11-04T01:41:25.577013+0000","last_unstale":"2023-11-04T01:41:25.584181+0000","last_undegraded":"2023-11-04T01:41:25.584181+0000","last_fullsized":"2023-11-04T01:41:25.584181+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:27:22.015978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.566465+0000","last_change":"2023-11-04T01:41:24.600028+0000","last_active":"2023-11-04T01:41:26.566465+0000","last_peered":"2023-11-04T01:41:26.566465+0000","last_clean":"2023-11-04T01:41:26.566465+0000","last_became_active":"2023-11-04T01:41:24.599043+0000","last_became_peered":"2023-11-04T01:41:24.599043+0000","last_unstale":"2023-11-04T01:41:26.566465+0000","last_undegraded":"2023-11-04T01:41:26.566465+0000","last_fullsized":"2023-11-04T01:41:26.566465+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:57:05.908791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.578610+0000","last_change":"2023-11-04T01:41:25.575688+0000","last_active":"2023-11-04T01:41:25.578610+0000","last_peered":"2023-11-04T01:41:25.578610+0000","last_clean":"2023-11-04T01:41:25.578610+0000","last_became_active":"2023-11-04T01:41:25.575426+0000","last_became_peered":"2023-11-04T01:41:25.575426+0000","last_unstale":"2023-11-04T01:41:25.578610+0000","last_undegraded":"2023-11-04T01:41:25.578610+0000","last_fullsized":"2023-11-04T01:41:25.578610+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:03:50.510106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.566460+0000","last_change":"2023-11-04T01:41:24.601713+0000","last_active":"2023-11-04T01:41:26.566460+0000","last_peered":"2023-11-04T01:41:26.566460+0000","last_clean":"2023-11-04T01:41:26.566460+0000","last_became_active":"2023-11-04T01:41:24.601394+0000","last_became_peered":"2023-11-04T01:41:24.601394+0000","last_unstale":"2023-11-04T01:41:26.566460+0000","last_undegraded":"2023-11-04T01:41:26.566460+0000","last_fullsized":"2023-11-04T01:41:26.566460+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:20:19.252597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.566227+0000","last_change":"2023-11-04T01:41:25.577425+0000","last_active":"2023-11-04T01:41:26.566227+0000","last_peered":"2023-11-04T01:41:26.566227+0000","last_clean":"2023-11-04T01:41:26.566227+0000","last_became_active":"2023-11-04T01:41:25.577173+0000","last_became_peered":"2023-11-04T01:41:25.577173+0000","last_unstale":"2023-11-04T01:41:26.566227+0000","last_undegraded":"2023-11-04T01:41:26.566227+0000","last_fullsized":"2023-11-04T01:41:26.566227+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:43.475755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:27.332682+0000","last_change":"2023-11-04T01:41:24.608967+0000","last_active":"2023-11-04T01:41:27.332682+0000","last_peered":"2023-11-04T01:41:27.332682+0000","last_clean":"2023-11-04T01:41:27.332682+0000","last_became_active":"2023-11-04T01:41:24.608656+0000","last_became_peered":"2023-11-04T01:41:24.608656+0000","last_unstale":"2023-11-04T01:41:27.332682+0000","last_undegraded":"2023-11-04T01:41:27.332682+0000","last_fullsized":"2023-11-04T01:41:27.332682+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:25.995002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.567772+0000","last_change":"2023-11-04T01:41:25.574677+0000","last_active":"2023-11-04T01:41:26.567772+0000","last_peered":"2023-11-04T01:41:26.567772+0000","last_clean":"2023-11-04T01:41:26.567772+0000","last_became_active":"2023-11-04T01:41:25.574399+0000","last_became_peered":"2023-11-04T01:41:25.574399+0000","last_unstale":"2023-11-04T01:41:26.567772+0000","last_undegraded":"2023-11-04T01:41:26.567772+0000","last_fullsized":"2023-11-04T01:41:26.567772+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:15:27.535767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.571105+0000","last_change":"2023-11-04T01:41:24.605942+0000","last_active":"2023-11-04T01:41:25.571105+0000","last_peered":"2023-11-04T01:41:25.571105+0000","last_clean":"2023-11-04T01:41:25.571105+0000","last_became_active":"2023-11-04T01:41:24.605654+0000","last_became_peered":"2023-11-04T01:41:24.605654+0000","last_unstale":"2023-11-04T01:41:25.571105+0000","last_undegraded":"2023-11-04T01:41:25.571105+0000","last_fullsized":"2023-11-04T01:41:25.571105+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:29:10.817773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.566376+0000","last_change":"2023-11-04T01:41:25.576987+0000","last_active":"2023-11-04T01:41:26.566376+0000","last_peered":"2023-11-04T01:41:26.566376+0000","last_clean":"2023-11-04T01:41:26.566376+0000","last_became_active":"2023-11-04T01:41:25.576713+0000","last_became_peered":"2023-11-04T01:41:25.576713+0000","last_unstale":"2023-11-04T01:41:26.566376+0000","last_undegraded":"2023-11-04T01:41:26.566376+0000","last_fullsized":"2023-11-04T01:41:26.566376+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:10.968397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.567555+0000","last_change":"2023-11-04T01:41:24.605029+0000","last_active":"2023-11-04T01:41:26.567555+0000","last_peered":"2023-11-04T01:41:26.567555+0000","last_clean":"2023-11-04T01:41:26.567555+0000","last_became_active":"2023-11-04T01:41:24.604659+0000","last_became_peered":"2023-11-04T01:41:24.604659+0000","last_unstale":"2023-11-04T01:41:26.567555+0000","last_undegraded":"2023-11-04T01:41:26.567555+0000","last_fullsized":"2023-11-04T01:41:26.567555+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:03:49.507510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.566498+0000","last_change":"2023-11-04T01:41:25.573914+0000","last_active":"2023-11-04T01:41:26.566498+0000","last_peered":"2023-11-04T01:41:26.566498+0000","last_clean":"2023-11-04T01:41:26.566498+0000","last_became_active":"2023-11-04T01:41:25.573651+0000","last_became_peered":"2023-11-04T01:41:25.573651+0000","last_unstale":"2023-11-04T01:41:26.566498+0000","last_undegraded":"2023-11-04T01:41:26.566498+0000","last_fullsized":"2023-11-04T01:41:26.566498+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:50.487101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.569052+0000","last_change":"2023-11-04T01:41:24.610629+0000","last_active":"2023-11-04T01:41:26.569052+0000","last_peered":"2023-11-04T01:41:26.569052+0000","last_clean":"2023-11-04T01:41:26.569052+0000","last_became_active":"2023-11-04T01:41:24.610307+0000","last_became_peered":"2023-11-04T01:41:24.610307+0000","last_unstale":"2023-11-04T01:41:26.569052+0000","last_undegraded":"2023-11-04T01:41:26.569052+0000","last_fullsized":"2023-11-04T01:41:26.569052+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:20:19.252597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.569072+0000","last_change":"2023-11-04T01:41:25.574305+0000","last_active":"2023-11-04T01:41:26.569072+0000","last_peered":"2023-11-04T01:41:26.569072+0000","last_clean":"2023-11-04T01:41:26.569072+0000","last_became_active":"2023-11-04T01:41:25.573941+0000","last_became_peered":"2023-11-04T01:41:25.573941+0000","last_unstale":"2023-11-04T01:41:26.569072+0000","last_undegraded":"2023-11-04T01:41:26.569072+0000","last_fullsized":"2023-11-04T01:41:26.569072+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:08:19.264763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.598235+0000","last_change":"2023-11-04T01:41:24.611328+0000","last_active":"2023-11-04T01:41:25.598235+0000","last_peered":"2023-11-04T01:41:25.598235+0000","last_clean":"2023-11-04T01:41:25.598235+0000","last_became_active":"2023-11-04T01:41:24.611011+0000","last_became_peered":"2023-11-04T01:41:24.611011+0000","last_unstale":"2023-11-04T01:41:25.598235+0000","last_undegraded":"2023-11-04T01:41:25.598235+0000","last_fullsized":"2023-11-04T01:41:25.598235+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:15.895433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.584071+0000","last_change":"2023-11-04T01:41:25.578489+0000","last_active":"2023-11-04T01:41:25.584071+0000","last_peered":"2023-11-04T01:41:25.584071+0000","last_clean":"2023-11-04T01:41:25.584071+0000","last_became_active":"2023-11-04T01:41:25.578222+0000","last_became_peered":"2023-11-04T01:41:25.578222+0000","last_unstale":"2023-11-04T01:41:25.584071+0000","last_undegraded":"2023-11-04T01:41:25.584071+0000","last_fullsized":"2023-11-04T01:41:25.584071+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:03:05.704475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.599150+0000","last_change":"2023-11-04T01:41:24.603796+0000","last_active":"2023-11-04T01:41:25.599150+0000","last_peered":"2023-11-04T01:41:25.599150+0000","last_clean":"2023-11-04T01:41:25.599150+0000","last_became_active":"2023-11-04T01:41:24.603505+0000","last_became_peered":"2023-11-04T01:41:24.603505+0000","last_unstale":"2023-11-04T01:41:25.599150+0000","last_undegraded":"2023-11-04T01:41:25.599150+0000","last_fullsized":"2023-11-04T01:41:25.599150+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:55:26.262667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.579133+0000","last_change":"2023-11-04T01:41:25.575463+0000","last_active":"2023-11-04T01:41:25.579133+0000","last_peered":"2023-11-04T01:41:25.579133+0000","last_clean":"2023-11-04T01:41:25.579133+0000","last_became_active":"2023-11-04T01:41:25.575169+0000","last_became_peered":"2023-11-04T01:41:25.575169+0000","last_unstale":"2023-11-04T01:41:25.579133+0000","last_undegraded":"2023-11-04T01:41:25.579133+0000","last_fullsized":"2023-11-04T01:41:25.579133+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:01:42.164068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:27.332814+0000","last_change":"2023-11-04T01:41:24.604561+0000","last_active":"2023-11-04T01:41:27.332814+0000","last_peered":"2023-11-04T01:41:27.332814+0000","last_clean":"2023-11-04T01:41:27.332814+0000","last_became_active":"2023-11-04T01:41:24.604300+0000","last_became_peered":"2023-11-04T01:41:24.604300+0000","last_unstale":"2023-11-04T01:41:27.332814+0000","last_undegraded":"2023-11-04T01:41:27.332814+0000","last_fullsized":"2023-11-04T01:41:27.332814+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:03:49.507510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.567869+0000","last_change":"2023-11-04T01:41:25.579034+0000","last_active":"2023-11-04T01:41:26.567869+0000","last_peered":"2023-11-04T01:41:26.567869+0000","last_clean":"2023-11-04T01:41:26.567869+0000","last_became_active":"2023-11-04T01:41:25.578703+0000","last_became_peered":"2023-11-04T01:41:25.578703+0000","last_unstale":"2023-11-04T01:41:26.567869+0000","last_undegraded":"2023-11-04T01:41:26.567869+0000","last_fullsized":"2023-11-04T01:41:26.567869+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:20:20.255193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.602150+0000","last_change":"2023-11-04T01:41:24.607068+0000","last_active":"2023-11-04T01:41:25.602150+0000","last_peered":"2023-11-04T01:41:25.602150+0000","last_clean":"2023-11-04T01:41:25.602150+0000","last_became_active":"2023-11-04T01:41:24.606776+0000","last_became_peered":"2023-11-04T01:41:24.606776+0000","last_unstale":"2023-11-04T01:41:25.602150+0000","last_undegraded":"2023-11-04T01:41:25.602150+0000","last_fullsized":"2023-11-04T01:41:25.602150+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:15:43.120929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.586579+0000","last_change":"2023-11-04T01:41:25.583294+0000","last_active":"2023-11-04T01:41:25.586579+0000","last_peered":"2023-11-04T01:41:25.586579+0000","last_clean":"2023-11-04T01:41:25.586579+0000","last_became_active":"2023-11-04T01:41:25.582959+0000","last_became_peered":"2023-11-04T01:41:25.582959+0000","last_unstale":"2023-11-04T01:41:25.586579+0000","last_undegraded":"2023-11-04T01:41:25.586579+0000","last_fullsized":"2023-11-04T01:41:25.586579+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:59:53.806180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.567089+0000","last_change":"2023-11-04T01:41:24.603837+0000","last_active":"2023-11-04T01:41:25.567089+0000","last_peered":"2023-11-04T01:41:25.567089+0000","last_clean":"2023-11-04T01:41:25.567089+0000","last_became_active":"2023-11-04T01:41:24.603529+0000","last_became_peered":"2023-11-04T01:41:24.603529+0000","last_unstale":"2023-11-04T01:41:25.567089+0000","last_undegraded":"2023-11-04T01:41:25.567089+0000","last_fullsized":"2023-11-04T01:41:25.567089+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:26:58.896034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568919+0000","last_change":"2023-11-04T01:41:25.577852+0000","last_active":"2023-11-04T01:41:26.568919+0000","last_peered":"2023-11-04T01:41:26.568919+0000","last_clean":"2023-11-04T01:41:26.568919+0000","last_became_active":"2023-11-04T01:41:25.577588+0000","last_became_peered":"2023-11-04T01:41:25.577588+0000","last_unstale":"2023-11-04T01:41:26.568919+0000","last_undegraded":"2023-11-04T01:41:26.568919+0000","last_fullsized":"2023-11-04T01:41:26.568919+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:50.487101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.567832+0000","last_change":"2023-11-04T01:41:24.608471+0000","last_active":"2023-11-04T01:41:26.567832+0000","last_peered":"2023-11-04T01:41:26.567832+0000","last_clean":"2023-11-04T01:41:26.567832+0000","last_became_active":"2023-11-04T01:41:24.608157+0000","last_became_peered":"2023-11-04T01:41:24.608157+0000","last_unstale":"2023-11-04T01:41:26.567832+0000","last_undegraded":"2023-11-04T01:41:26.567832+0000","last_fullsized":"2023-11-04T01:41:26.567832+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:00:00.248328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.566465+0000","last_change":"2023-11-04T01:41:25.570791+0000","last_active":"2023-11-04T01:41:26.566465+0000","last_peered":"2023-11-04T01:41:26.566465+0000","last_clean":"2023-11-04T01:41:26.566465+0000","last_became_active":"2023-11-04T01:41:25.570372+0000","last_became_peered":"2023-11-04T01:41:25.570372+0000","last_unstale":"2023-11-04T01:41:26.566465+0000","last_undegraded":"2023-11-04T01:41:26.566465+0000","last_fullsized":"2023-11-04T01:41:26.566465+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:38.999965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.568328+0000","last_change":"2023-11-04T01:41:24.606393+0000","last_active":"2023-11-04T01:41:25.568328+0000","last_peered":"2023-11-04T01:41:25.568328+0000","last_clean":"2023-11-04T01:41:25.568328+0000","last_became_active":"2023-11-04T01:41:24.606010+0000","last_became_peered":"2023-11-04T01:41:24.606010+0000","last_unstale":"2023-11-04T01:41:25.568328+0000","last_undegraded":"2023-11-04T01:41:25.568328+0000","last_fullsized":"2023-11-04T01:41:25.568328+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:23:23.761922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:27.332887+0000","last_change":"2023-11-04T01:41:25.578237+0000","last_active":"2023-11-04T01:41:27.332887+0000","last_peered":"2023-11-04T01:41:27.332887+0000","last_clean":"2023-11-04T01:41:27.332887+0000","last_became_active":"2023-11-04T01:41:25.577971+0000","last_became_peered":"2023-11-04T01:41:25.577971+0000","last_unstale":"2023-11-04T01:41:27.332887+0000","last_undegraded":"2023-11-04T01:41:27.332887+0000","last_fullsized":"2023-11-04T01:41:27.332887+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:06:17.569987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.569144+0000","last_change":"2023-11-04T01:41:24.612615+0000","last_active":"2023-11-04T01:41:26.569144+0000","last_peered":"2023-11-04T01:41:26.569144+0000","last_clean":"2023-11-04T01:41:26.569144+0000","last_became_active":"2023-11-04T01:41:24.612325+0000","last_became_peered":"2023-11-04T01:41:24.612325+0000","last_unstale":"2023-11-04T01:41:26.569144+0000","last_undegraded":"2023-11-04T01:41:26.569144+0000","last_fullsized":"2023-11-04T01:41:26.569144+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:57:50.206787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568428+0000","last_change":"2023-11-04T01:41:25.575978+0000","last_active":"2023-11-04T01:41:26.568428+0000","last_peered":"2023-11-04T01:41:26.568428+0000","last_clean":"2023-11-04T01:41:26.568428+0000","last_became_active":"2023-11-04T01:41:25.575296+0000","last_became_peered":"2023-11-04T01:41:25.575296+0000","last_unstale":"2023-11-04T01:41:26.568428+0000","last_undegraded":"2023-11-04T01:41:26.568428+0000","last_fullsized":"2023-11-04T01:41:26.568428+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:14:12.898473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.568467+0000","last_change":"2023-11-04T01:41:24.611105+0000","last_active":"2023-11-04T01:41:25.568467+0000","last_peered":"2023-11-04T01:41:25.568467+0000","last_clean":"2023-11-04T01:41:25.568467+0000","last_became_active":"2023-11-04T01:41:24.610883+0000","last_became_peered":"2023-11-04T01:41:24.610883+0000","last_unstale":"2023-11-04T01:41:25.568467+0000","last_undegraded":"2023-11-04T01:41:25.568467+0000","last_fullsized":"2023-11-04T01:41:25.568467+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:30:56.300327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.566643+0000","last_change":"2023-11-04T01:41:25.581568+0000","last_active":"2023-11-04T01:41:26.566643+0000","last_peered":"2023-11-04T01:41:26.566643+0000","last_clean":"2023-11-04T01:41:26.566643+0000","last_became_active":"2023-11-04T01:41:25.581313+0000","last_became_peered":"2023-11-04T01:41:25.581313+0000","last_unstale":"2023-11-04T01:41:26.566643+0000","last_undegraded":"2023-11-04T01:41:26.566643+0000","last_fullsized":"2023-11-04T01:41:26.566643+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:42:28.590161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.569272+0000","last_change":"2023-11-04T01:41:24.602271+0000","last_active":"2023-11-04T01:41:25.569272+0000","last_peered":"2023-11-04T01:41:25.569272+0000","last_clean":"2023-11-04T01:41:25.569272+0000","last_became_active":"2023-11-04T01:41:24.601954+0000","last_became_peered":"2023-11-04T01:41:24.601954+0000","last_unstale":"2023-11-04T01:41:25.569272+0000","last_undegraded":"2023-11-04T01:41:25.569272+0000","last_fullsized":"2023-11-04T01:41:25.569272+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:03:04.701879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.576404+0000","last_change":"2023-11-04T01:41:25.574444+0000","last_active":"2023-11-04T01:41:25.576404+0000","last_peered":"2023-11-04T01:41:25.576404+0000","last_clean":"2023-11-04T01:41:25.576404+0000","last_became_active":"2023-11-04T01:41:25.574188+0000","last_became_peered":"2023-11-04T01:41:25.574188+0000","last_unstale":"2023-11-04T01:41:25.576404+0000","last_undegraded":"2023-11-04T01:41:25.576404+0000","last_fullsized":"2023-11-04T01:41:25.576404+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:07:31.735125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.570735+0000","last_change":"2023-11-04T01:41:24.604730+0000","last_active":"2023-11-04T01:41:25.570735+0000","last_peered":"2023-11-04T01:41:25.570735+0000","last_clean":"2023-11-04T01:41:25.570735+0000","last_became_active":"2023-11-04T01:41:24.604427+0000","last_became_peered":"2023-11-04T01:41:24.604427+0000","last_unstale":"2023-11-04T01:41:25.570735+0000","last_undegraded":"2023-11-04T01:41:25.570735+0000","last_fullsized":"2023-11-04T01:41:25.570735+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:15.895433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:27.332792+0000","last_change":"2023-11-04T01:41:25.575421+0000","last_active":"2023-11-04T01:41:27.332792+0000","last_peered":"2023-11-04T01:41:27.332792+0000","last_clean":"2023-11-04T01:41:27.332792+0000","last_became_active":"2023-11-04T01:41:25.575164+0000","last_became_peered":"2023-11-04T01:41:25.575164+0000","last_unstale":"2023-11-04T01:41:27.332792+0000","last_undegraded":"2023-11-04T01:41:27.332792+0000","last_fullsized":"2023-11-04T01:41:27.332792+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:57:06.911387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.571335+0000","last_change":"2023-11-04T01:41:24.606507+0000","last_active":"2023-11-04T01:41:25.571335+0000","last_peered":"2023-11-04T01:41:25.571335+0000","last_clean":"2023-11-04T01:41:25.571335+0000","last_became_active":"2023-11-04T01:41:24.606208+0000","last_became_peered":"2023-11-04T01:41:24.606208+0000","last_unstale":"2023-11-04T01:41:25.571335+0000","last_undegraded":"2023-11-04T01:41:25.571335+0000","last_fullsized":"2023-11-04T01:41:25.571335+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:25.995002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.584300+0000","last_change":"2023-11-04T01:41:25.579531+0000","last_active":"2023-11-04T01:41:25.584300+0000","last_peered":"2023-11-04T01:41:25.584300+0000","last_clean":"2023-11-04T01:41:25.584300+0000","last_became_active":"2023-11-04T01:41:25.579280+0000","last_became_peered":"2023-11-04T01:41:25.579280+0000","last_unstale":"2023-11-04T01:41:25.584300+0000","last_undegraded":"2023-11-04T01:41:25.584300+0000","last_fullsized":"2023-11-04T01:41:25.584300+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:03:50.510106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.567518+0000","last_change":"2023-11-04T01:41:24.603274+0000","last_active":"2023-11-04T01:41:25.567518+0000","last_peered":"2023-11-04T01:41:25.567518+0000","last_clean":"2023-11-04T01:41:25.567518+0000","last_became_active":"2023-11-04T01:41:24.603004+0000","last_became_peered":"2023-11-04T01:41:24.603004+0000","last_unstale":"2023-11-04T01:41:25.567518+0000","last_undegraded":"2023-11-04T01:41:25.567518+0000","last_fullsized":"2023-11-04T01:41:25.567518+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:00:37.555784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568158+0000","last_change":"2023-11-04T01:41:25.574347+0000","last_active":"2023-11-04T01:41:26.568158+0000","last_peered":"2023-11-04T01:41:26.568158+0000","last_clean":"2023-11-04T01:41:26.568158+0000","last_became_active":"2023-11-04T01:41:25.574073+0000","last_became_peered":"2023-11-04T01:41:25.574073+0000","last_unstale":"2023-11-04T01:41:26.568158+0000","last_undegraded":"2023-11-04T01:41:26.568158+0000","last_fullsized":"2023-11-04T01:41:26.568158+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:43.475755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.566185+0000","last_change":"2023-11-04T01:41:24.601708+0000","last_active":"2023-11-04T01:41:26.566185+0000","last_peered":"2023-11-04T01:41:26.566185+0000","last_clean":"2023-11-04T01:41:26.566185+0000","last_became_active":"2023-11-04T01:41:24.601460+0000","last_became_peered":"2023-11-04T01:41:24.601460+0000","last_unstale":"2023-11-04T01:41:26.566185+0000","last_undegraded":"2023-11-04T01:41:26.566185+0000","last_fullsized":"2023-11-04T01:41:26.566185+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:59:52.803584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568982+0000","last_change":"2023-11-04T01:41:25.576919+0000","last_active":"2023-11-04T01:41:26.568982+0000","last_peered":"2023-11-04T01:41:26.568982+0000","last_clean":"2023-11-04T01:41:26.568982+0000","last_became_active":"2023-11-04T01:41:25.576679+0000","last_became_peered":"2023-11-04T01:41:25.576679+0000","last_unstale":"2023-11-04T01:41:26.568982+0000","last_undegraded":"2023-11-04T01:41:26.568982+0000","last_fullsized":"2023-11-04T01:41:26.568982+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:15:23.173234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568380+0000","last_change":"2023-11-04T01:41:24.606181+0000","last_active":"2023-11-04T01:41:26.568380+0000","last_peered":"2023-11-04T01:41:26.568380+0000","last_clean":"2023-11-04T01:41:26.568380+0000","last_became_active":"2023-11-04T01:41:24.605884+0000","last_became_peered":"2023-11-04T01:41:24.605884+0000","last_unstale":"2023-11-04T01:41:26.568380+0000","last_undegraded":"2023-11-04T01:41:26.568380+0000","last_fullsized":"2023-11-04T01:41:26.568380+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:06:16.567391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.566987+0000","last_change":"2023-11-04T01:39:54.204460+0000","last_active":"2023-11-04T01:41:25.566987+0000","last_peered":"2023-11-04T01:41:25.566987+0000","last_clean":"2023-11-04T01:41:25.566987+0000","last_became_active":"2023-11-04T01:39:54.203352+0000","last_became_peered":"2023-11-04T01:39:54.203352+0000","last_unstale":"2023-11-04T01:41:25.566987+0000","last_undegraded":"2023-11-04T01:41:25.566987+0000","last_fullsized":"2023-11-04T01:41:25.566987+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:52.627032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:52.627032+0000","last_clean_scrub_stamp":"2023-11-04T01:39:52.627032+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:17:18.474768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":188604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.78200000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.71999999999999997}]},{"osd":2,"last update":"Sat Nov 4 01:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.752},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.76300000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.79800000000000004}]},{"osd":4,"last update":"Sat Nov 4 01:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.629},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.54600000000000004}]},{"osd":6,"last update":"Sat Nov 4 01:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.51900000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.65100000000000002}]}]},{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1036288,"data_stored":773922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.63600000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.72199999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.78100000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.68000000000000005}]},{"osd":4,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.308},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.377}]},{"osd":5,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.34399999999999997}]},{"osd":6,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.41899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":182454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.49099999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.60799999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.56499999999999995}]},{"osd":3,"last update":"Sat Nov 4 01:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.58299999999999996}]},{"osd":4,"last update":"Sat Nov 4 01:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.39600000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.54400000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.441},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.50800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":434176,"data_stored":182476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.55600000000000005}]},{"osd":1,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.54300000000000004}]},{"osd":2,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.58299999999999996}]},{"osd":3,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.49199999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.39800000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.379}]},{"osd":7,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.433},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.629}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":183518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"last":0.45200000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.56299999999999994}]},{"osd":2,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.50900000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.59899999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.59099999999999997}]},{"osd":6,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.64800000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.63}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":181942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.249},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.30399999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.34100000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.32400000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.52000000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.53100000000000003}]},{"osd":6,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.54400000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.44},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.50700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":181962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.443,"5min":0.443,"15min":0.443},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"last":0.50600000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.52200000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.57299999999999995}]},{"osd":4,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.79400000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.71699999999999997}]},{"osd":6,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.68500000000000005}]},{"osd":7,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.82799999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1019904,"data_stored":771255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.41899999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.377},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.35699999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.46200000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.70399999999999996}]},{"osd":5,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.58399999999999996}]},{"osd":6,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.67500000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.66400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:41:28.541 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:41:28.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.672+0000 7f2eb344f640 1 Processor -- start 2023-11-04T01:41:28.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.673+0000 7f2eb344f640 1 -- start start 2023-11-04T01:41:28.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.673+0000 7f2eb344f640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2eac0cde60 0x7f2eac15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.673+0000 7f2eb344f640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2eac15daa0 0x7f2eac157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.673+0000 7f2eb344f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2eac0ce240 0x7f2eac157540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.673+0000 7f2eb344f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eac15e5c0 con 0x7f2eac0ce240 2023-11-04T01:41:28.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.673+0000 7f2eb344f640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eac157a80 con 0x7f2eac0cde60 2023-11-04T01:41:28.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.673+0000 7f2eb344f640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac15e000 con 0x7f2eac15daa0 2023-11-04T01:41:28.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.674+0000 7f2eb19ec640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2eac0ce240 0x7f2eac157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.674+0000 7f2eb19ec640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2eac0ce240 0x7f2eac157540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43566/0 (socket says 172.21.15.77:43566) 2023-11-04T01:41:28.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.674+0000 7f2eb19ec640 1 -- 172.21.15.77:0/1713008820 learned_addr learned my addr 172.21.15.77:0/1713008820 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:28.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.674+0000 7f2eb09ea640 1 --2- 172.21.15.77:0/1713008820 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2eac15daa0 0x7f2eac157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.674+0000 7f2eb11eb640 1 --2- 172.21.15.77:0/1713008820 >> v2:172.21.15.122:3300/0 conn(0x7f2eac0cde60 0x7f2eac15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.674+0000 7f2eb19ec640 1 -- 172.21.15.77:0/1713008820 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2eac15daa0 msgr2=0x7f2eac157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:28.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.674+0000 7f2eb19ec640 1 --2- 172.21.15.77:0/1713008820 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2eac15daa0 0x7f2eac157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.674+0000 7f2eb19ec640 1 -- 172.21.15.77:0/1713008820 >> v2:172.21.15.122:3300/0 conn(0x7f2eac0cde60 msgr2=0x7f2eac15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:28.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.674+0000 7f2eb19ec640 1 --2- 172.21.15.77:0/1713008820 >> v2:172.21.15.122:3300/0 conn(0x7f2eac0cde60 0x7f2eac15d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.674+0000 7f2eb19ec640 1 -- 172.21.15.77:0/1713008820 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eac15e2e0 con 0x7f2eac0ce240 2023-11-04T01:41:28.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.675+0000 7f2eb19ec640 1 --2- 172.21.15.77:0/1713008820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2eac0ce240 0x7f2eac157540 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0b5550 tx=0x7f2ea802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b455d7060dffed5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:28.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.675+0000 7f2ea3fff640 1 -- 172.21.15.77:0/1713008820 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8031870 con 0x7f2eac0ce240 2023-11-04T01:41:28.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.675+0000 7f2ea3fff640 1 -- 172.21.15.77:0/1713008820 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea80319d0 con 0x7f2eac0ce240 2023-11-04T01:41:28.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.675+0000 7f2ea3fff640 1 -- 172.21.15.77:0/1713008820 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8031d60 con 0x7f2eac0ce240 2023-11-04T01:41:28.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.675+0000 7f2eb344f640 1 -- 172.21.15.77:0/1713008820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2eac0ce240 msgr2=0x7f2eac157540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.675+0000 7f2eb344f640 1 --2- 172.21.15.77:0/1713008820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2eac0ce240 0x7f2eac157540 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0b5550 tx=0x7f2ea802b910 comp rx=0 tx=0).stop 2023-11-04T01:41:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.675+0000 7f2eb344f640 1 -- 172.21.15.77:0/1713008820 shutdown_connections 2023-11-04T01:41:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.675+0000 7f2eb344f640 1 --2- 172.21.15.77:0/1713008820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2eac0ce240 0x7f2eac157540 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.675+0000 7f2eb344f640 1 --2- 172.21.15.77:0/1713008820 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2eac15daa0 0x7f2eac157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.675+0000 7f2eb344f640 1 --2- 172.21.15.77:0/1713008820 >> v2:172.21.15.122:3300/0 conn(0x7f2eac0cde60 0x7f2eac15d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.675+0000 7f2eb344f640 1 -- 172.21.15.77:0/1713008820 >> 172.21.15.77:0/1713008820 conn(0x7f2eac071f30 msgr2=0x7f2eac0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:28.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.675+0000 7f2eb344f640 1 -- 172.21.15.77:0/1713008820 shutdown_connections 2023-11-04T01:41:28.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.675+0000 7f2eb344f640 1 -- 172.21.15.77:0/1713008820 wait complete. 2023-11-04T01:41:28.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.677+0000 7f2eb344f640 1 Processor -- start 2023-11-04T01:41:28.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.677+0000 7f2eb344f640 1 -- start start 2023-11-04T01:41:28.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.677+0000 7f2eb344f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2eac0cde60 0x7f2eac14f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.677+0000 7f2eb344f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2eac0ce240 0x7f2eac151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.677+0000 7f2eb344f640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2eac15daa0 0x7f2eac14a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.677+0000 7f2eb344f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac1538e0 con 0x7f2eac0ce240 2023-11-04T01:41:28.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.677+0000 7f2eb344f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac153540 con 0x7f2eac0cde60 2023-11-04T01:41:28.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.677+0000 7f2eb344f640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac150280 con 0x7f2eac15daa0 2023-11-04T01:41:28.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.677+0000 7f2eb09ea640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2eac0ce240 0x7f2eac151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.677+0000 7f2eb09ea640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2eac0ce240 0x7f2eac151750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43580/0 (socket says 172.21.15.77:43580) 2023-11-04T01:41:28.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.677+0000 7f2eb09ea640 1 -- 172.21.15.77:0/3920020408 learned_addr learned my addr 172.21.15.77:0/3920020408 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:28.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.678+0000 7f2eb09ea640 1 -- 172.21.15.77:0/3920020408 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2eac15daa0 msgr2=0x7f2eac14a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.678+0000 7f2eb09ea640 1 --2- 172.21.15.77:0/3920020408 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2eac15daa0 0x7f2eac14a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.678+0000 7f2eb09ea640 1 -- 172.21.15.77:0/3920020408 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2eac0cde60 msgr2=0x7f2eac14f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.678+0000 7f2eb09ea640 1 --2- 172.21.15.77:0/3920020408 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2eac0cde60 0x7f2eac14f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.678+0000 7f2eb09ea640 1 -- 172.21.15.77:0/3920020408 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea80094d0 con 0x7f2eac0ce240 2023-11-04T01:41:28.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.678+0000 7f2eb09ea640 1 --2- 172.21.15.77:0/3920020408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2eac0ce240 0x7f2eac151750 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c00d5f0 tx=0x7f2e9c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:28.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.678+0000 7f2ea1ffb640 1 -- 172.21.15.77:0/3920020408 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c0125f0 con 0x7f2eac0ce240 2023-11-04T01:41:28.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.678+0000 7f2ea1ffb640 1 -- 172.21.15.77:0/3920020408 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9c012750 con 0x7f2eac0ce240 2023-11-04T01:41:28.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.678+0000 7f2ea1ffb640 1 -- 172.21.15.77:0/3920020408 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c012b00 con 0x7f2eac0ce240 2023-11-04T01:41:28.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.678+0000 7f2eb344f640 1 -- 172.21.15.77:0/3920020408 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eac150560 con 0x7f2eac0ce240 2023-11-04T01:41:28.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.678+0000 7f2eb344f640 1 -- 172.21.15.77:0/3920020408 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eac14fe90 con 0x7f2eac0ce240 2023-11-04T01:41:28.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.679+0000 7f2eb344f640 1 -- 172.21.15.77:0/3920020408 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eac150050 con 0x7f2eac0ce240 2023-11-04T01:41:28.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.679+0000 7f2ea1ffb640 1 -- 172.21.15.77:0/3920020408 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2e9c012c60 con 0x7f2eac0ce240 2023-11-04T01:41:28.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.680+0000 7f2ea1ffb640 1 --2- 172.21.15.77:0/3920020408 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2e9006ae70 0x7f2e9006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:28.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.680+0000 7f2ea1ffb640 1 -- 172.21.15.77:0/3920020408 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2e9c089bb0 con 0x7f2eac0ce240 2023-11-04T01:41:28.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.680+0000 7f2eb11eb640 1 --2- 172.21.15.77:0/3920020408 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2e9006ae70 0x7f2e9006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:28.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.680+0000 7f2eb11eb640 1 --2- 172.21.15.77:0/3920020408 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2e9006ae70 0x7f2e9006d330 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4009540 tx=0x7f2ea4009450 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:28.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.684+0000 7f2ea1ffb640 1 -- 172.21.15.77:0/3920020408 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2e9c054bb0 con 0x7f2eac0ce240 2023-11-04T01:41:28.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.845+0000 7f2eb344f640 1 -- 172.21.15.77:0/3920020408 --> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2eac0d1400 con 0x7f2e9006ae70 2023-11-04T01:41:28.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.853+0000 7f2ea1ffb640 1 -- 172.21.15.77:0/3920020408 <== mgr.4123 v2:172.21.15.122:6832/2275325762 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289268 (secure 0 0 0) 0x7f2ea4007e40 con 0x7f2e9006ae70 2023-11-04T01:41:28.860 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:28.862 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-04T01:41:28.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.856+0000 7f2eb344f640 1 -- 172.21.15.77:0/3920020408 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2e9006ae70 msgr2=0x7f2e9006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.856+0000 7f2eb344f640 1 --2- 172.21.15.77:0/3920020408 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2e9006ae70 0x7f2e9006d330 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4009540 tx=0x7f2ea4009450 comp rx=0 tx=0).stop 2023-11-04T01:41:28.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.856+0000 7f2eb344f640 1 -- 172.21.15.77:0/3920020408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2eac0ce240 msgr2=0x7f2eac151750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:28.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.856+0000 7f2eb344f640 1 --2- 172.21.15.77:0/3920020408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2eac0ce240 0x7f2eac151750 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c00d5f0 tx=0x7f2e9c00dab0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.856+0000 7f2eb344f640 1 -- 172.21.15.77:0/3920020408 shutdown_connections 2023-11-04T01:41:28.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.856+0000 7f2eb344f640 1 --2- 172.21.15.77:0/3920020408 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2e9006ae70 0x7f2e9006d330 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.856+0000 7f2eb344f640 1 --2- 172.21.15.77:0/3920020408 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2eac15daa0 0x7f2eac14a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.856+0000 7f2eb344f640 1 --2- 172.21.15.77:0/3920020408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2eac0ce240 0x7f2eac151750 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.856+0000 7f2eb344f640 1 --2- 172.21.15.77:0/3920020408 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2eac0cde60 0x7f2eac14f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:28.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.856+0000 7f2eb344f640 1 -- 172.21.15.77:0/3920020408 >> 172.21.15.77:0/3920020408 conn(0x7f2eac071f30 msgr2=0x7f2eac0b7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:28.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.856+0000 7f2eb344f640 1 -- 172.21.15.77:0/3920020408 shutdown_connections 2023-11-04T01:41:28.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:28.856+0000 7f2eb344f640 1 -- 172.21.15.77:0/3920020408 wait complete. 2023-11-04T01:41:28.868 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2023-11-04T01:41:27.646369+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":95,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220732,"kb_used_data":4560,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753988,"statfs":{"total":773094113280,"available":772868083712,"internally_reserved":0,"allocated":4669440,"data_stored":2646133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.061114"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.566641+0000","last_change":"2023-11-04T01:41:25.573749+0000","last_active":"2023-11-04T01:41:26.566641+0000","last_peered":"2023-11-04T01:41:26.566641+0000","last_clean":"2023-11-04T01:41:26.566641+0000","last_became_active":"2023-11-04T01:41:25.573483+0000","last_became_peered":"2023-11-04T01:41:25.573483+0000","last_unstale":"2023-11-04T01:41:26.566641+0000","last_undegraded":"2023-11-04T01:41:26.566641+0000","last_fullsized":"2023-11-04T01:41:26.566641+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:08:19.264763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.566533+0000","last_change":"2023-11-04T01:41:25.573779+0000","last_active":"2023-11-04T01:41:26.566533+0000","last_peered":"2023-11-04T01:41:26.566533+0000","last_clean":"2023-11-04T01:41:26.566533+0000","last_became_active":"2023-11-04T01:41:25.573489+0000","last_became_peered":"2023-11-04T01:41:25.573489+0000","last_unstale":"2023-11-04T01:41:26.566533+0000","last_undegraded":"2023-11-04T01:41:26.566533+0000","last_fullsized":"2023-11-04T01:41:26.566533+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:23:14.611819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.581229+0000","last_change":"2023-11-04T01:41:25.576101+0000","last_active":"2023-11-04T01:41:25.581229+0000","last_peered":"2023-11-04T01:41:25.581229+0000","last_clean":"2023-11-04T01:41:25.581229+0000","last_became_active":"2023-11-04T01:41:25.575852+0000","last_became_peered":"2023-11-04T01:41:25.575852+0000","last_unstale":"2023-11-04T01:41:25.581229+0000","last_undegraded":"2023-11-04T01:41:25.581229+0000","last_fullsized":"2023-11-04T01:41:25.581229+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:35.072439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.581372+0000","last_change":"2023-11-04T01:41:25.577311+0000","last_active":"2023-11-04T01:41:25.581372+0000","last_peered":"2023-11-04T01:41:25.581372+0000","last_clean":"2023-11-04T01:41:25.581372+0000","last_became_active":"2023-11-04T01:41:25.576982+0000","last_became_peered":"2023-11-04T01:41:25.576982+0000","last_unstale":"2023-11-04T01:41:25.581372+0000","last_undegraded":"2023-11-04T01:41:25.581372+0000","last_fullsized":"2023-11-04T01:41:25.581372+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:04:39.682987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.586492+0000","last_change":"2023-11-04T01:41:25.581748+0000","last_active":"2023-11-04T01:41:25.586492+0000","last_peered":"2023-11-04T01:41:25.586492+0000","last_clean":"2023-11-04T01:41:25.586492+0000","last_became_active":"2023-11-04T01:41:25.581130+0000","last_became_peered":"2023-11-04T01:41:25.581130+0000","last_unstale":"2023-11-04T01:41:25.586492+0000","last_undegraded":"2023-11-04T01:41:25.586492+0000","last_fullsized":"2023-11-04T01:41:25.586492+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:04:19.770749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:27.332816+0000","last_change":"2023-11-04T01:41:25.573165+0000","last_active":"2023-11-04T01:41:27.332816+0000","last_peered":"2023-11-04T01:41:27.332816+0000","last_clean":"2023-11-04T01:41:27.332816+0000","last_became_active":"2023-11-04T01:41:25.572920+0000","last_became_peered":"2023-11-04T01:41:25.572920+0000","last_unstale":"2023-11-04T01:41:27.332816+0000","last_undegraded":"2023-11-04T01:41:27.332816+0000","last_fullsized":"2023-11-04T01:41:27.332816+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:34:36.106454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568430+0000","last_change":"2023-11-04T01:41:25.576680+0000","last_active":"2023-11-04T01:41:26.568430+0000","last_peered":"2023-11-04T01:41:26.568430+0000","last_clean":"2023-11-04T01:41:26.568430+0000","last_became_active":"2023-11-04T01:41:25.576413+0000","last_became_peered":"2023-11-04T01:41:25.576413+0000","last_unstale":"2023-11-04T01:41:26.568430+0000","last_undegraded":"2023-11-04T01:41:26.568430+0000","last_fullsized":"2023-11-04T01:41:26.568430+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:15:27.535767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.566168+0000","last_change":"2023-11-04T01:41:25.571983+0000","last_active":"2023-11-04T01:41:26.566168+0000","last_peered":"2023-11-04T01:41:26.566168+0000","last_clean":"2023-11-04T01:41:26.566168+0000","last_became_active":"2023-11-04T01:41:25.571687+0000","last_became_peered":"2023-11-04T01:41:25.571687+0000","last_unstale":"2023-11-04T01:41:26.566168+0000","last_undegraded":"2023-11-04T01:41:26.566168+0000","last_fullsized":"2023-11-04T01:41:26.566168+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:02:20.439674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.581151+0000","last_change":"2023-11-04T01:41:25.576815+0000","last_active":"2023-11-04T01:41:25.581151+0000","last_peered":"2023-11-04T01:41:25.581151+0000","last_clean":"2023-11-04T01:41:25.581151+0000","last_became_active":"2023-11-04T01:41:25.576498+0000","last_became_peered":"2023-11-04T01:41:25.576498+0000","last_unstale":"2023-11-04T01:41:25.581151+0000","last_undegraded":"2023-11-04T01:41:25.581151+0000","last_fullsized":"2023-11-04T01:41:25.581151+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:01:55.727018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568787+0000","last_change":"2023-11-04T01:41:25.574168+0000","last_active":"2023-11-04T01:41:26.568787+0000","last_peered":"2023-11-04T01:41:26.568787+0000","last_clean":"2023-11-04T01:41:26.568787+0000","last_became_active":"2023-11-04T01:41:25.573879+0000","last_became_peered":"2023-11-04T01:41:25.573879+0000","last_unstale":"2023-11-04T01:41:26.568787+0000","last_undegraded":"2023-11-04T01:41:26.568787+0000","last_fullsized":"2023-11-04T01:41:26.568787+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:10.968397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568929+0000","last_change":"2023-11-04T01:41:25.579906+0000","last_active":"2023-11-04T01:41:26.568929+0000","last_peered":"2023-11-04T01:41:26.568929+0000","last_clean":"2023-11-04T01:41:26.568929+0000","last_became_active":"2023-11-04T01:41:25.579435+0000","last_became_peered":"2023-11-04T01:41:25.579435+0000","last_unstale":"2023-11-04T01:41:26.568929+0000","last_undegraded":"2023-11-04T01:41:26.568929+0000","last_fullsized":"2023-11-04T01:41:26.568929+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:23:14.611819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.581203+0000","last_change":"2023-11-04T01:41:25.576944+0000","last_active":"2023-11-04T01:41:25.581203+0000","last_peered":"2023-11-04T01:41:25.581203+0000","last_clean":"2023-11-04T01:41:25.581203+0000","last_became_active":"2023-11-04T01:41:25.576663+0000","last_became_peered":"2023-11-04T01:41:25.576663+0000","last_unstale":"2023-11-04T01:41:25.581203+0000","last_undegraded":"2023-11-04T01:41:25.581203+0000","last_fullsized":"2023-11-04T01:41:25.581203+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:29:11.820370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568773+0000","last_change":"2023-11-04T01:41:25.571580+0000","last_active":"2023-11-04T01:41:26.568773+0000","last_peered":"2023-11-04T01:41:26.568773+0000","last_clean":"2023-11-04T01:41:26.568773+0000","last_became_active":"2023-11-04T01:41:25.571291+0000","last_became_peered":"2023-11-04T01:41:25.571291+0000","last_unstale":"2023-11-04T01:41:26.568773+0000","last_undegraded":"2023-11-04T01:41:26.568773+0000","last_fullsized":"2023-11-04T01:41:26.568773+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:14:12.898473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.585216+0000","last_change":"2023-11-04T01:41:25.584193+0000","last_active":"2023-11-04T01:41:25.585216+0000","last_peered":"2023-11-04T01:41:25.585216+0000","last_clean":"2023-11-04T01:41:25.585216+0000","last_became_active":"2023-11-04T01:41:25.583936+0000","last_became_peered":"2023-11-04T01:41:25.583936+0000","last_unstale":"2023-11-04T01:41:25.585216+0000","last_undegraded":"2023-11-04T01:41:25.585216+0000","last_fullsized":"2023-11-04T01:41:25.585216+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:59:53.806180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568591+0000","last_change":"2023-11-04T01:41:25.578808+0000","last_active":"2023-11-04T01:41:26.568591+0000","last_peered":"2023-11-04T01:41:26.568591+0000","last_clean":"2023-11-04T01:41:26.568591+0000","last_became_active":"2023-11-04T01:41:25.578542+0000","last_became_peered":"2023-11-04T01:41:25.578542+0000","last_unstale":"2023-11-04T01:41:26.568591+0000","last_undegraded":"2023-11-04T01:41:26.568591+0000","last_fullsized":"2023-11-04T01:41:26.568591+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:43.475755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568071+0000","last_change":"2023-11-04T01:41:25.575093+0000","last_active":"2023-11-04T01:41:26.568071+0000","last_peered":"2023-11-04T01:41:26.568071+0000","last_clean":"2023-11-04T01:41:26.568071+0000","last_became_active":"2023-11-04T01:41:25.574820+0000","last_became_peered":"2023-11-04T01:41:25.574820+0000","last_unstale":"2023-11-04T01:41:26.568071+0000","last_undegraded":"2023-11-04T01:41:26.568071+0000","last_fullsized":"2023-11-04T01:41:26.568071+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:32:10.752870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568621+0000","last_change":"2023-11-04T01:41:25.579427+0000","last_active":"2023-11-04T01:41:26.568621+0000","last_peered":"2023-11-04T01:41:26.568621+0000","last_clean":"2023-11-04T01:41:26.568621+0000","last_became_active":"2023-11-04T01:41:25.577158+0000","last_became_peered":"2023-11-04T01:41:25.577158+0000","last_unstale":"2023-11-04T01:41:26.568621+0000","last_undegraded":"2023-11-04T01:41:26.568621+0000","last_fullsized":"2023-11-04T01:41:26.568621+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:50.487101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.585396+0000","last_change":"2023-11-04T01:41:25.583900+0000","last_active":"2023-11-04T01:41:25.585396+0000","last_peered":"2023-11-04T01:41:25.585396+0000","last_clean":"2023-11-04T01:41:25.585396+0000","last_became_active":"2023-11-04T01:41:25.583649+0000","last_became_peered":"2023-11-04T01:41:25.583649+0000","last_unstale":"2023-11-04T01:41:25.585396+0000","last_undegraded":"2023-11-04T01:41:25.585396+0000","last_fullsized":"2023-11-04T01:41:25.585396+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:27:22.015978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.583552+0000","last_change":"2023-11-04T01:41:25.579023+0000","last_active":"2023-11-04T01:41:25.583552+0000","last_peered":"2023-11-04T01:41:25.583552+0000","last_clean":"2023-11-04T01:41:25.583552+0000","last_became_active":"2023-11-04T01:41:25.578725+0000","last_became_peered":"2023-11-04T01:41:25.578725+0000","last_unstale":"2023-11-04T01:41:25.583552+0000","last_undegraded":"2023-11-04T01:41:25.583552+0000","last_fullsized":"2023-11-04T01:41:25.583552+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:50:35.238638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.583287+0000","last_change":"2023-11-04T01:41:25.582112+0000","last_active":"2023-11-04T01:41:25.583287+0000","last_peered":"2023-11-04T01:41:25.583287+0000","last_clean":"2023-11-04T01:41:25.583287+0000","last_became_active":"2023-11-04T01:41:25.581158+0000","last_became_peered":"2023-11-04T01:41:25.581158+0000","last_unstale":"2023-11-04T01:41:25.583287+0000","last_undegraded":"2023-11-04T01:41:25.583287+0000","last_fullsized":"2023-11-04T01:41:25.583287+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:07:31.735125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568853+0000","last_change":"2023-11-04T01:41:25.572136+0000","last_active":"2023-11-04T01:41:26.568853+0000","last_peered":"2023-11-04T01:41:26.568853+0000","last_clean":"2023-11-04T01:41:26.568853+0000","last_became_active":"2023-11-04T01:41:25.571852+0000","last_became_peered":"2023-11-04T01:41:25.571852+0000","last_unstale":"2023-11-04T01:41:26.568853+0000","last_undegraded":"2023-11-04T01:41:26.568853+0000","last_fullsized":"2023-11-04T01:41:26.568853+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:38.999965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.584283+0000","last_change":"2023-11-04T01:41:25.579004+0000","last_active":"2023-11-04T01:41:25.584283+0000","last_peered":"2023-11-04T01:41:25.584283+0000","last_clean":"2023-11-04T01:41:25.584283+0000","last_became_active":"2023-11-04T01:41:25.577403+0000","last_became_peered":"2023-11-04T01:41:25.577403+0000","last_unstale":"2023-11-04T01:41:25.584283+0000","last_undegraded":"2023-11-04T01:41:25.584283+0000","last_fullsized":"2023-11-04T01:41:25.584283+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:29:11.820370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568036+0000","last_change":"2023-11-04T01:41:25.580848+0000","last_active":"2023-11-04T01:41:26.568036+0000","last_peered":"2023-11-04T01:41:26.568036+0000","last_clean":"2023-11-04T01:41:26.568036+0000","last_became_active":"2023-11-04T01:41:25.579881+0000","last_became_peered":"2023-11-04T01:41:25.579881+0000","last_unstale":"2023-11-04T01:41:26.568036+0000","last_undegraded":"2023-11-04T01:41:26.568036+0000","last_fullsized":"2023-11-04T01:41:26.568036+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:02:20.439674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.583629+0000","last_change":"2023-11-04T01:41:25.580228+0000","last_active":"2023-11-04T01:41:25.583629+0000","last_peered":"2023-11-04T01:41:25.583629+0000","last_clean":"2023-11-04T01:41:25.583629+0000","last_became_active":"2023-11-04T01:41:25.579946+0000","last_became_peered":"2023-11-04T01:41:25.579946+0000","last_unstale":"2023-11-04T01:41:25.583629+0000","last_undegraded":"2023-11-04T01:41:25.583629+0000","last_fullsized":"2023-11-04T01:41:25.583629+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:33:55.674169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.584516+0000","last_change":"2023-11-04T01:41:25.580750+0000","last_active":"2023-11-04T01:41:25.584516+0000","last_peered":"2023-11-04T01:41:25.584516+0000","last_clean":"2023-11-04T01:41:25.584516+0000","last_became_active":"2023-11-04T01:41:25.580364+0000","last_became_peered":"2023-11-04T01:41:25.580364+0000","last_unstale":"2023-11-04T01:41:25.584516+0000","last_undegraded":"2023-11-04T01:41:25.584516+0000","last_fullsized":"2023-11-04T01:41:25.584516+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:00:38.558380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:27.332880+0000","last_change":"2023-11-04T01:41:25.576048+0000","last_active":"2023-11-04T01:41:27.332880+0000","last_peered":"2023-11-04T01:41:27.332880+0000","last_clean":"2023-11-04T01:41:27.332880+0000","last_became_active":"2023-11-04T01:41:25.575801+0000","last_became_peered":"2023-11-04T01:41:25.575801+0000","last_unstale":"2023-11-04T01:41:27.332880+0000","last_undegraded":"2023-11-04T01:41:27.332880+0000","last_fullsized":"2023-11-04T01:41:27.332880+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:00:01.250924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.582976+0000","last_change":"2023-11-04T01:41:25.578106+0000","last_active":"2023-11-04T01:41:25.582976+0000","last_peered":"2023-11-04T01:41:25.582976+0000","last_clean":"2023-11-04T01:41:25.582976+0000","last_became_active":"2023-11-04T01:41:25.577594+0000","last_became_peered":"2023-11-04T01:41:25.577594+0000","last_unstale":"2023-11-04T01:41:25.582976+0000","last_undegraded":"2023-11-04T01:41:25.582976+0000","last_fullsized":"2023-11-04T01:41:25.582976+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:27:53.357719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568147+0000","last_change":"2023-11-04T01:41:25.577438+0000","last_active":"2023-11-04T01:41:26.568147+0000","last_peered":"2023-11-04T01:41:26.568147+0000","last_clean":"2023-11-04T01:41:26.568147+0000","last_became_active":"2023-11-04T01:41:25.577206+0000","last_became_peered":"2023-11-04T01:41:25.577206+0000","last_unstale":"2023-11-04T01:41:26.568147+0000","last_undegraded":"2023-11-04T01:41:26.568147+0000","last_fullsized":"2023-11-04T01:41:26.568147+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:32:10.752870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.582724+0000","last_change":"2023-11-04T01:41:25.579910+0000","last_active":"2023-11-04T01:41:25.582724+0000","last_peered":"2023-11-04T01:41:25.582724+0000","last_clean":"2023-11-04T01:41:25.582724+0000","last_became_active":"2023-11-04T01:41:25.579378+0000","last_became_peered":"2023-11-04T01:41:25.579378+0000","last_unstale":"2023-11-04T01:41:25.582724+0000","last_undegraded":"2023-11-04T01:41:25.582724+0000","last_fullsized":"2023-11-04T01:41:25.582724+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:53:08.753307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.577670+0000","last_change":"2023-11-04T01:41:25.575892+0000","last_active":"2023-11-04T01:41:25.577670+0000","last_peered":"2023-11-04T01:41:25.577670+0000","last_clean":"2023-11-04T01:41:25.577670+0000","last_became_active":"2023-11-04T01:41:25.575628+0000","last_became_peered":"2023-11-04T01:41:25.575628+0000","last_unstale":"2023-11-04T01:41:25.577670+0000","last_undegraded":"2023-11-04T01:41:25.577670+0000","last_fullsized":"2023-11-04T01:41:25.577670+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:01:55.727018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.567671+0000","last_change":"2023-11-04T01:41:25.576766+0000","last_active":"2023-11-04T01:41:26.567671+0000","last_peered":"2023-11-04T01:41:26.567671+0000","last_clean":"2023-11-04T01:41:26.567671+0000","last_became_active":"2023-11-04T01:41:25.576484+0000","last_became_peered":"2023-11-04T01:41:25.576484+0000","last_unstale":"2023-11-04T01:41:26.567671+0000","last_undegraded":"2023-11-04T01:41:26.567671+0000","last_fullsized":"2023-11-04T01:41:26.567671+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:22:56.441635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:27.332711+0000","last_change":"2023-11-04T01:41:25.574239+0000","last_active":"2023-11-04T01:41:27.332711+0000","last_peered":"2023-11-04T01:41:27.332711+0000","last_clean":"2023-11-04T01:41:27.332711+0000","last_became_active":"2023-11-04T01:41:25.573990+0000","last_became_peered":"2023-11-04T01:41:25.573990+0000","last_unstale":"2023-11-04T01:41:27.332711+0000","last_undegraded":"2023-11-04T01:41:27.332711+0000","last_fullsized":"2023-11-04T01:41:27.332711+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:25.932332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568459+0000","last_change":"2023-11-04T01:41:25.578535+0000","last_active":"2023-11-04T01:41:26.568459+0000","last_peered":"2023-11-04T01:41:26.568459+0000","last_clean":"2023-11-04T01:41:26.568459+0000","last_became_active":"2023-11-04T01:41:25.576159+0000","last_became_peered":"2023-11-04T01:41:25.576159+0000","last_unstale":"2023-11-04T01:41:26.568459+0000","last_undegraded":"2023-11-04T01:41:26.568459+0000","last_fullsized":"2023-11-04T01:41:26.568459+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:10.968397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.599337+0000","last_change":"2023-11-04T01:41:24.606738+0000","last_active":"2023-11-04T01:41:25.599337+0000","last_peered":"2023-11-04T01:41:25.599337+0000","last_clean":"2023-11-04T01:41:25.599337+0000","last_became_active":"2023-11-04T01:41:24.605342+0000","last_became_peered":"2023-11-04T01:41:24.605342+0000","last_unstale":"2023-11-04T01:41:25.599337+0000","last_undegraded":"2023-11-04T01:41:25.599337+0000","last_fullsized":"2023-11-04T01:41:25.599337+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:34.069843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:27.332977+0000","last_change":"2023-11-04T01:41:25.578507+0000","last_active":"2023-11-04T01:41:27.332977+0000","last_peered":"2023-11-04T01:41:27.332977+0000","last_clean":"2023-11-04T01:41:27.332977+0000","last_became_active":"2023-11-04T01:41:25.578041+0000","last_became_peered":"2023-11-04T01:41:25.578041+0000","last_unstale":"2023-11-04T01:41:27.332977+0000","last_undegraded":"2023-11-04T01:41:27.332977+0000","last_fullsized":"2023-11-04T01:41:27.332977+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:57:51.209383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.599159+0000","last_change":"2023-11-04T01:41:24.603124+0000","last_active":"2023-11-04T01:41:25.599159+0000","last_peered":"2023-11-04T01:41:25.599159+0000","last_clean":"2023-11-04T01:41:25.599159+0000","last_became_active":"2023-11-04T01:41:24.602856+0000","last_became_peered":"2023-11-04T01:41:24.602856+0000","last_unstale":"2023-11-04T01:41:25.599159+0000","last_undegraded":"2023-11-04T01:41:25.599159+0000","last_fullsized":"2023-11-04T01:41:25.599159+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:14:24.929736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.584089+0000","last_change":"2023-11-04T01:41:25.578960+0000","last_active":"2023-11-04T01:41:25.584089+0000","last_peered":"2023-11-04T01:41:25.584089+0000","last_clean":"2023-11-04T01:41:25.584089+0000","last_became_active":"2023-11-04T01:41:25.578699+0000","last_became_peered":"2023-11-04T01:41:25.578699+0000","last_unstale":"2023-11-04T01:41:25.584089+0000","last_undegraded":"2023-11-04T01:41:25.584089+0000","last_fullsized":"2023-11-04T01:41:25.584089+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:35.072439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:27.333000+0000","last_change":"2023-11-04T01:41:24.603777+0000","last_active":"2023-11-04T01:41:27.333000+0000","last_peered":"2023-11-04T01:41:27.333000+0000","last_clean":"2023-11-04T01:41:27.333000+0000","last_became_active":"2023-11-04T01:41:24.601964+0000","last_became_peered":"2023-11-04T01:41:24.601964+0000","last_unstale":"2023-11-04T01:41:27.333000+0000","last_undegraded":"2023-11-04T01:41:27.333000+0000","last_fullsized":"2023-11-04T01:41:27.333000+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:15.895433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.566573+0000","last_change":"2023-11-04T01:41:25.574546+0000","last_active":"2023-11-04T01:41:26.566573+0000","last_peered":"2023-11-04T01:41:26.566573+0000","last_clean":"2023-11-04T01:41:26.566573+0000","last_became_active":"2023-11-04T01:41:25.574281+0000","last_became_peered":"2023-11-04T01:41:25.574281+0000","last_unstale":"2023-11-04T01:41:26.566573+0000","last_undegraded":"2023-11-04T01:41:26.566573+0000","last_fullsized":"2023-11-04T01:41:26.566573+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:15:23.173234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.599792+0000","last_change":"2023-11-04T01:41:24.602749+0000","last_active":"2023-11-04T01:41:25.599792+0000","last_peered":"2023-11-04T01:41:25.599792+0000","last_clean":"2023-11-04T01:41:25.599792+0000","last_became_active":"2023-11-04T01:41:24.602472+0000","last_became_peered":"2023-11-04T01:41:24.602472+0000","last_unstale":"2023-11-04T01:41:25.599792+0000","last_undegraded":"2023-11-04T01:41:25.599792+0000","last_fullsized":"2023-11-04T01:41:25.599792+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:01:54.724422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.583601+0000","last_change":"2023-11-04T01:41:25.578528+0000","last_active":"2023-11-04T01:41:25.583601+0000","last_peered":"2023-11-04T01:41:25.583601+0000","last_clean":"2023-11-04T01:41:25.583601+0000","last_became_active":"2023-11-04T01:41:25.578280+0000","last_became_peered":"2023-11-04T01:41:25.578280+0000","last_unstale":"2023-11-04T01:41:25.583601+0000","last_undegraded":"2023-11-04T01:41:25.583601+0000","last_fullsized":"2023-11-04T01:41:25.583601+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:26.997598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.569047+0000","last_change":"2023-11-04T01:41:24.607356+0000","last_active":"2023-11-04T01:41:26.569047+0000","last_peered":"2023-11-04T01:41:26.569047+0000","last_clean":"2023-11-04T01:41:26.569047+0000","last_became_active":"2023-11-04T01:41:24.606799+0000","last_became_peered":"2023-11-04T01:41:24.606799+0000","last_unstale":"2023-11-04T01:41:26.569047+0000","last_undegraded":"2023-11-04T01:41:26.569047+0000","last_fullsized":"2023-11-04T01:41:26.569047+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:22:55.439039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568572+0000","last_change":"2023-11-04T01:41:25.571959+0000","last_active":"2023-11-04T01:41:26.568572+0000","last_peered":"2023-11-04T01:41:26.568572+0000","last_clean":"2023-11-04T01:41:26.568572+0000","last_became_active":"2023-11-04T01:41:25.571673+0000","last_became_peered":"2023-11-04T01:41:25.571673+0000","last_unstale":"2023-11-04T01:41:26.568572+0000","last_undegraded":"2023-11-04T01:41:26.568572+0000","last_fullsized":"2023-11-04T01:41:26.568572+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:02:20.439674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568127+0000","last_change":"2023-11-04T01:41:24.604257+0000","last_active":"2023-11-04T01:41:26.568127+0000","last_peered":"2023-11-04T01:41:26.568127+0000","last_clean":"2023-11-04T01:41:26.568127+0000","last_became_active":"2023-11-04T01:41:24.603954+0000","last_became_peered":"2023-11-04T01:41:24.603954+0000","last_unstale":"2023-11-04T01:41:26.568127+0000","last_undegraded":"2023-11-04T01:41:26.568127+0000","last_fullsized":"2023-11-04T01:41:26.568127+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:29:10.817773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.584559+0000","last_change":"2023-11-04T01:41:25.581537+0000","last_active":"2023-11-04T01:41:25.584559+0000","last_peered":"2023-11-04T01:41:25.584559+0000","last_clean":"2023-11-04T01:41:25.584559+0000","last_became_active":"2023-11-04T01:41:25.581297+0000","last_became_peered":"2023-11-04T01:41:25.581297+0000","last_unstale":"2023-11-04T01:41:25.584559+0000","last_undegraded":"2023-11-04T01:41:25.584559+0000","last_fullsized":"2023-11-04T01:41:25.584559+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:26.997598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:27.332945+0000","last_change":"2023-11-04T01:41:24.608996+0000","last_active":"2023-11-04T01:41:27.332945+0000","last_peered":"2023-11-04T01:41:27.332945+0000","last_clean":"2023-11-04T01:41:27.332945+0000","last_became_active":"2023-11-04T01:41:24.608704+0000","last_became_peered":"2023-11-04T01:41:24.608704+0000","last_unstale":"2023-11-04T01:41:27.332945+0000","last_undegraded":"2023-11-04T01:41:27.332945+0000","last_fullsized":"2023-11-04T01:41:27.332945+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:34.069843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.566349+0000","last_change":"2023-11-04T01:41:25.570618+0000","last_active":"2023-11-04T01:41:26.566349+0000","last_peered":"2023-11-04T01:41:26.566349+0000","last_clean":"2023-11-04T01:41:26.566349+0000","last_became_active":"2023-11-04T01:41:25.570027+0000","last_became_peered":"2023-11-04T01:41:25.570027+0000","last_unstale":"2023-11-04T01:41:26.566349+0000","last_undegraded":"2023-11-04T01:41:26.566349+0000","last_fullsized":"2023-11-04T01:41:26.566349+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:14:12.898473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.567682+0000","last_change":"2023-11-04T01:41:24.606589+0000","last_active":"2023-11-04T01:41:25.567682+0000","last_peered":"2023-11-04T01:41:25.567682+0000","last_clean":"2023-11-04T01:41:25.567682+0000","last_became_active":"2023-11-04T01:41:24.606210+0000","last_became_peered":"2023-11-04T01:41:24.606210+0000","last_unstale":"2023-11-04T01:41:25.567682+0000","last_undegraded":"2023-11-04T01:41:25.567682+0000","last_fullsized":"2023-11-04T01:41:25.567682+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:07:30.732529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.586453+0000","last_change":"2023-11-04T01:41:25.581259+0000","last_active":"2023-11-04T01:41:25.586453+0000","last_peered":"2023-11-04T01:41:25.586453+0000","last_clean":"2023-11-04T01:41:25.586453+0000","last_became_active":"2023-11-04T01:41:25.580950+0000","last_became_peered":"2023-11-04T01:41:25.580950+0000","last_unstale":"2023-11-04T01:41:25.586453+0000","last_undegraded":"2023-11-04T01:41:25.586453+0000","last_fullsized":"2023-11-04T01:41:25.586453+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:40:09.942764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.566615+0000","last_change":"2023-11-04T01:41:24.600989+0000","last_active":"2023-11-04T01:41:26.566615+0000","last_peered":"2023-11-04T01:41:26.566615+0000","last_clean":"2023-11-04T01:41:26.566615+0000","last_became_active":"2023-11-04T01:41:24.600717+0000","last_became_peered":"2023-11-04T01:41:24.600717+0000","last_unstale":"2023-11-04T01:41:26.566615+0000","last_undegraded":"2023-11-04T01:41:26.566615+0000","last_fullsized":"2023-11-04T01:41:26.566615+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:32:09.750274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568521+0000","last_change":"2023-11-04T01:41:25.576139+0000","last_active":"2023-11-04T01:41:26.568521+0000","last_peered":"2023-11-04T01:41:26.568521+0000","last_clean":"2023-11-04T01:41:26.568521+0000","last_became_active":"2023-11-04T01:41:25.575679+0000","last_became_peered":"2023-11-04T01:41:25.575679+0000","last_unstale":"2023-11-04T01:41:26.568521+0000","last_undegraded":"2023-11-04T01:41:26.568521+0000","last_fullsized":"2023-11-04T01:41:26.568521+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:38.999965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.569090+0000","last_change":"2023-11-04T01:41:24.612559+0000","last_active":"2023-11-04T01:41:26.569090+0000","last_peered":"2023-11-04T01:41:26.569090+0000","last_clean":"2023-11-04T01:41:26.569090+0000","last_became_active":"2023-11-04T01:41:24.612210+0000","last_became_peered":"2023-11-04T01:41:24.612210+0000","last_unstale":"2023-11-04T01:41:26.569090+0000","last_undegraded":"2023-11-04T01:41:26.569090+0000","last_fullsized":"2023-11-04T01:41:26.569090+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:06:16.567391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.586557+0000","last_change":"2023-11-04T01:41:25.582683+0000","last_active":"2023-11-04T01:41:25.586557+0000","last_peered":"2023-11-04T01:41:25.586557+0000","last_clean":"2023-11-04T01:41:25.586557+0000","last_became_active":"2023-11-04T01:41:25.582394+0000","last_became_peered":"2023-11-04T01:41:25.582394+0000","last_unstale":"2023-11-04T01:41:25.586557+0000","last_undegraded":"2023-11-04T01:41:25.586557+0000","last_fullsized":"2023-11-04T01:41:25.586557+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:14:18.522403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.569063+0000","last_change":"2023-11-04T01:41:24.612564+0000","last_active":"2023-11-04T01:41:26.569063+0000","last_peered":"2023-11-04T01:41:26.569063+0000","last_clean":"2023-11-04T01:41:26.569063+0000","last_became_active":"2023-11-04T01:41:24.612307+0000","last_became_peered":"2023-11-04T01:41:24.612307+0000","last_unstale":"2023-11-04T01:41:26.569063+0000","last_undegraded":"2023-11-04T01:41:26.569063+0000","last_fullsized":"2023-11-04T01:41:26.569063+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:34:35.103857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.584181+0000","last_change":"2023-11-04T01:41:25.579187+0000","last_active":"2023-11-04T01:41:25.584181+0000","last_peered":"2023-11-04T01:41:25.584181+0000","last_clean":"2023-11-04T01:41:25.584181+0000","last_became_active":"2023-11-04T01:41:25.577013+0000","last_became_peered":"2023-11-04T01:41:25.577013+0000","last_unstale":"2023-11-04T01:41:25.584181+0000","last_undegraded":"2023-11-04T01:41:25.584181+0000","last_fullsized":"2023-11-04T01:41:25.584181+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:27:22.015978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.566465+0000","last_change":"2023-11-04T01:41:24.600028+0000","last_active":"2023-11-04T01:41:26.566465+0000","last_peered":"2023-11-04T01:41:26.566465+0000","last_clean":"2023-11-04T01:41:26.566465+0000","last_became_active":"2023-11-04T01:41:24.599043+0000","last_became_peered":"2023-11-04T01:41:24.599043+0000","last_unstale":"2023-11-04T01:41:26.566465+0000","last_undegraded":"2023-11-04T01:41:26.566465+0000","last_fullsized":"2023-11-04T01:41:26.566465+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:57:05.908791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.578610+0000","last_change":"2023-11-04T01:41:25.575688+0000","last_active":"2023-11-04T01:41:25.578610+0000","last_peered":"2023-11-04T01:41:25.578610+0000","last_clean":"2023-11-04T01:41:25.578610+0000","last_became_active":"2023-11-04T01:41:25.575426+0000","last_became_peered":"2023-11-04T01:41:25.575426+0000","last_unstale":"2023-11-04T01:41:25.578610+0000","last_undegraded":"2023-11-04T01:41:25.578610+0000","last_fullsized":"2023-11-04T01:41:25.578610+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:03:50.510106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.566460+0000","last_change":"2023-11-04T01:41:24.601713+0000","last_active":"2023-11-04T01:41:26.566460+0000","last_peered":"2023-11-04T01:41:26.566460+0000","last_clean":"2023-11-04T01:41:26.566460+0000","last_became_active":"2023-11-04T01:41:24.601394+0000","last_became_peered":"2023-11-04T01:41:24.601394+0000","last_unstale":"2023-11-04T01:41:26.566460+0000","last_undegraded":"2023-11-04T01:41:26.566460+0000","last_fullsized":"2023-11-04T01:41:26.566460+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:20:19.252597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.566227+0000","last_change":"2023-11-04T01:41:25.577425+0000","last_active":"2023-11-04T01:41:26.566227+0000","last_peered":"2023-11-04T01:41:26.566227+0000","last_clean":"2023-11-04T01:41:26.566227+0000","last_became_active":"2023-11-04T01:41:25.577173+0000","last_became_peered":"2023-11-04T01:41:25.577173+0000","last_unstale":"2023-11-04T01:41:26.566227+0000","last_undegraded":"2023-11-04T01:41:26.566227+0000","last_fullsized":"2023-11-04T01:41:26.566227+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:43.475755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:27.332682+0000","last_change":"2023-11-04T01:41:24.608967+0000","last_active":"2023-11-04T01:41:27.332682+0000","last_peered":"2023-11-04T01:41:27.332682+0000","last_clean":"2023-11-04T01:41:27.332682+0000","last_became_active":"2023-11-04T01:41:24.608656+0000","last_became_peered":"2023-11-04T01:41:24.608656+0000","last_unstale":"2023-11-04T01:41:27.332682+0000","last_undegraded":"2023-11-04T01:41:27.332682+0000","last_fullsized":"2023-11-04T01:41:27.332682+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:25.995002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.567772+0000","last_change":"2023-11-04T01:41:25.574677+0000","last_active":"2023-11-04T01:41:26.567772+0000","last_peered":"2023-11-04T01:41:26.567772+0000","last_clean":"2023-11-04T01:41:26.567772+0000","last_became_active":"2023-11-04T01:41:25.574399+0000","last_became_peered":"2023-11-04T01:41:25.574399+0000","last_unstale":"2023-11-04T01:41:26.567772+0000","last_undegraded":"2023-11-04T01:41:26.567772+0000","last_fullsized":"2023-11-04T01:41:26.567772+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:15:27.535767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.571105+0000","last_change":"2023-11-04T01:41:24.605942+0000","last_active":"2023-11-04T01:41:25.571105+0000","last_peered":"2023-11-04T01:41:25.571105+0000","last_clean":"2023-11-04T01:41:25.571105+0000","last_became_active":"2023-11-04T01:41:24.605654+0000","last_became_peered":"2023-11-04T01:41:24.605654+0000","last_unstale":"2023-11-04T01:41:25.571105+0000","last_undegraded":"2023-11-04T01:41:25.571105+0000","last_fullsized":"2023-11-04T01:41:25.571105+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:29:10.817773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.566376+0000","last_change":"2023-11-04T01:41:25.576987+0000","last_active":"2023-11-04T01:41:26.566376+0000","last_peered":"2023-11-04T01:41:26.566376+0000","last_clean":"2023-11-04T01:41:26.566376+0000","last_became_active":"2023-11-04T01:41:25.576713+0000","last_became_peered":"2023-11-04T01:41:25.576713+0000","last_unstale":"2023-11-04T01:41:26.566376+0000","last_undegraded":"2023-11-04T01:41:26.566376+0000","last_fullsized":"2023-11-04T01:41:26.566376+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:10.968397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.567555+0000","last_change":"2023-11-04T01:41:24.605029+0000","last_active":"2023-11-04T01:41:26.567555+0000","last_peered":"2023-11-04T01:41:26.567555+0000","last_clean":"2023-11-04T01:41:26.567555+0000","last_became_active":"2023-11-04T01:41:24.604659+0000","last_became_peered":"2023-11-04T01:41:24.604659+0000","last_unstale":"2023-11-04T01:41:26.567555+0000","last_undegraded":"2023-11-04T01:41:26.567555+0000","last_fullsized":"2023-11-04T01:41:26.567555+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:03:49.507510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.566498+0000","last_change":"2023-11-04T01:41:25.573914+0000","last_active":"2023-11-04T01:41:26.566498+0000","last_peered":"2023-11-04T01:41:26.566498+0000","last_clean":"2023-11-04T01:41:26.566498+0000","last_became_active":"2023-11-04T01:41:25.573651+0000","last_became_peered":"2023-11-04T01:41:25.573651+0000","last_unstale":"2023-11-04T01:41:26.566498+0000","last_undegraded":"2023-11-04T01:41:26.566498+0000","last_fullsized":"2023-11-04T01:41:26.566498+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:50.487101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.569052+0000","last_change":"2023-11-04T01:41:24.610629+0000","last_active":"2023-11-04T01:41:26.569052+0000","last_peered":"2023-11-04T01:41:26.569052+0000","last_clean":"2023-11-04T01:41:26.569052+0000","last_became_active":"2023-11-04T01:41:24.610307+0000","last_became_peered":"2023-11-04T01:41:24.610307+0000","last_unstale":"2023-11-04T01:41:26.569052+0000","last_undegraded":"2023-11-04T01:41:26.569052+0000","last_fullsized":"2023-11-04T01:41:26.569052+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:20:19.252597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.569072+0000","last_change":"2023-11-04T01:41:25.574305+0000","last_active":"2023-11-04T01:41:26.569072+0000","last_peered":"2023-11-04T01:41:26.569072+0000","last_clean":"2023-11-04T01:41:26.569072+0000","last_became_active":"2023-11-04T01:41:25.573941+0000","last_became_peered":"2023-11-04T01:41:25.573941+0000","last_unstale":"2023-11-04T01:41:26.569072+0000","last_undegraded":"2023-11-04T01:41:26.569072+0000","last_fullsized":"2023-11-04T01:41:26.569072+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:08:19.264763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.598235+0000","last_change":"2023-11-04T01:41:24.611328+0000","last_active":"2023-11-04T01:41:25.598235+0000","last_peered":"2023-11-04T01:41:25.598235+0000","last_clean":"2023-11-04T01:41:25.598235+0000","last_became_active":"2023-11-04T01:41:24.611011+0000","last_became_peered":"2023-11-04T01:41:24.611011+0000","last_unstale":"2023-11-04T01:41:25.598235+0000","last_undegraded":"2023-11-04T01:41:25.598235+0000","last_fullsized":"2023-11-04T01:41:25.598235+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:15.895433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.584071+0000","last_change":"2023-11-04T01:41:25.578489+0000","last_active":"2023-11-04T01:41:25.584071+0000","last_peered":"2023-11-04T01:41:25.584071+0000","last_clean":"2023-11-04T01:41:25.584071+0000","last_became_active":"2023-11-04T01:41:25.578222+0000","last_became_peered":"2023-11-04T01:41:25.578222+0000","last_unstale":"2023-11-04T01:41:25.584071+0000","last_undegraded":"2023-11-04T01:41:25.584071+0000","last_fullsized":"2023-11-04T01:41:25.584071+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:03:05.704475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.599150+0000","last_change":"2023-11-04T01:41:24.603796+0000","last_active":"2023-11-04T01:41:25.599150+0000","last_peered":"2023-11-04T01:41:25.599150+0000","last_clean":"2023-11-04T01:41:25.599150+0000","last_became_active":"2023-11-04T01:41:24.603505+0000","last_became_peered":"2023-11-04T01:41:24.603505+0000","last_unstale":"2023-11-04T01:41:25.599150+0000","last_undegraded":"2023-11-04T01:41:25.599150+0000","last_fullsized":"2023-11-04T01:41:25.599150+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:55:26.262667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.579133+0000","last_change":"2023-11-04T01:41:25.575463+0000","last_active":"2023-11-04T01:41:25.579133+0000","last_peered":"2023-11-04T01:41:25.579133+0000","last_clean":"2023-11-04T01:41:25.579133+0000","last_became_active":"2023-11-04T01:41:25.575169+0000","last_became_peered":"2023-11-04T01:41:25.575169+0000","last_unstale":"2023-11-04T01:41:25.579133+0000","last_undegraded":"2023-11-04T01:41:25.579133+0000","last_fullsized":"2023-11-04T01:41:25.579133+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:01:42.164068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:27.332814+0000","last_change":"2023-11-04T01:41:24.604561+0000","last_active":"2023-11-04T01:41:27.332814+0000","last_peered":"2023-11-04T01:41:27.332814+0000","last_clean":"2023-11-04T01:41:27.332814+0000","last_became_active":"2023-11-04T01:41:24.604300+0000","last_became_peered":"2023-11-04T01:41:24.604300+0000","last_unstale":"2023-11-04T01:41:27.332814+0000","last_undegraded":"2023-11-04T01:41:27.332814+0000","last_fullsized":"2023-11-04T01:41:27.332814+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:03:49.507510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.567869+0000","last_change":"2023-11-04T01:41:25.579034+0000","last_active":"2023-11-04T01:41:26.567869+0000","last_peered":"2023-11-04T01:41:26.567869+0000","last_clean":"2023-11-04T01:41:26.567869+0000","last_became_active":"2023-11-04T01:41:25.578703+0000","last_became_peered":"2023-11-04T01:41:25.578703+0000","last_unstale":"2023-11-04T01:41:26.567869+0000","last_undegraded":"2023-11-04T01:41:26.567869+0000","last_fullsized":"2023-11-04T01:41:26.567869+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:20:20.255193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.602150+0000","last_change":"2023-11-04T01:41:24.607068+0000","last_active":"2023-11-04T01:41:25.602150+0000","last_peered":"2023-11-04T01:41:25.602150+0000","last_clean":"2023-11-04T01:41:25.602150+0000","last_became_active":"2023-11-04T01:41:24.606776+0000","last_became_peered":"2023-11-04T01:41:24.606776+0000","last_unstale":"2023-11-04T01:41:25.602150+0000","last_undegraded":"2023-11-04T01:41:25.602150+0000","last_fullsized":"2023-11-04T01:41:25.602150+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:15:43.120929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.586579+0000","last_change":"2023-11-04T01:41:25.583294+0000","last_active":"2023-11-04T01:41:25.586579+0000","last_peered":"2023-11-04T01:41:25.586579+0000","last_clean":"2023-11-04T01:41:25.586579+0000","last_became_active":"2023-11-04T01:41:25.582959+0000","last_became_peered":"2023-11-04T01:41:25.582959+0000","last_unstale":"2023-11-04T01:41:25.586579+0000","last_undegraded":"2023-11-04T01:41:25.586579+0000","last_fullsized":"2023-11-04T01:41:25.586579+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:59:53.806180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.567089+0000","last_change":"2023-11-04T01:41:24.603837+0000","last_active":"2023-11-04T01:41:25.567089+0000","last_peered":"2023-11-04T01:41:25.567089+0000","last_clean":"2023-11-04T01:41:25.567089+0000","last_became_active":"2023-11-04T01:41:24.603529+0000","last_became_peered":"2023-11-04T01:41:24.603529+0000","last_unstale":"2023-11-04T01:41:25.567089+0000","last_undegraded":"2023-11-04T01:41:25.567089+0000","last_fullsized":"2023-11-04T01:41:25.567089+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:26:58.896034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568919+0000","last_change":"2023-11-04T01:41:25.577852+0000","last_active":"2023-11-04T01:41:26.568919+0000","last_peered":"2023-11-04T01:41:26.568919+0000","last_clean":"2023-11-04T01:41:26.568919+0000","last_became_active":"2023-11-04T01:41:25.577588+0000","last_became_peered":"2023-11-04T01:41:25.577588+0000","last_unstale":"2023-11-04T01:41:26.568919+0000","last_undegraded":"2023-11-04T01:41:26.568919+0000","last_fullsized":"2023-11-04T01:41:26.568919+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:50.487101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.567832+0000","last_change":"2023-11-04T01:41:24.608471+0000","last_active":"2023-11-04T01:41:26.567832+0000","last_peered":"2023-11-04T01:41:26.567832+0000","last_clean":"2023-11-04T01:41:26.567832+0000","last_became_active":"2023-11-04T01:41:24.608157+0000","last_became_peered":"2023-11-04T01:41:24.608157+0000","last_unstale":"2023-11-04T01:41:26.567832+0000","last_undegraded":"2023-11-04T01:41:26.567832+0000","last_fullsized":"2023-11-04T01:41:26.567832+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:00:00.248328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.566465+0000","last_change":"2023-11-04T01:41:25.570791+0000","last_active":"2023-11-04T01:41:26.566465+0000","last_peered":"2023-11-04T01:41:26.566465+0000","last_clean":"2023-11-04T01:41:26.566465+0000","last_became_active":"2023-11-04T01:41:25.570372+0000","last_became_peered":"2023-11-04T01:41:25.570372+0000","last_unstale":"2023-11-04T01:41:26.566465+0000","last_undegraded":"2023-11-04T01:41:26.566465+0000","last_fullsized":"2023-11-04T01:41:26.566465+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:38.999965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.568328+0000","last_change":"2023-11-04T01:41:24.606393+0000","last_active":"2023-11-04T01:41:25.568328+0000","last_peered":"2023-11-04T01:41:25.568328+0000","last_clean":"2023-11-04T01:41:25.568328+0000","last_became_active":"2023-11-04T01:41:24.606010+0000","last_became_peered":"2023-11-04T01:41:24.606010+0000","last_unstale":"2023-11-04T01:41:25.568328+0000","last_undegraded":"2023-11-04T01:41:25.568328+0000","last_fullsized":"2023-11-04T01:41:25.568328+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:23:23.761922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:27.332887+0000","last_change":"2023-11-04T01:41:25.578237+0000","last_active":"2023-11-04T01:41:27.332887+0000","last_peered":"2023-11-04T01:41:27.332887+0000","last_clean":"2023-11-04T01:41:27.332887+0000","last_became_active":"2023-11-04T01:41:25.577971+0000","last_became_peered":"2023-11-04T01:41:25.577971+0000","last_unstale":"2023-11-04T01:41:27.332887+0000","last_undegraded":"2023-11-04T01:41:27.332887+0000","last_fullsized":"2023-11-04T01:41:27.332887+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:06:17.569987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.569144+0000","last_change":"2023-11-04T01:41:24.612615+0000","last_active":"2023-11-04T01:41:26.569144+0000","last_peered":"2023-11-04T01:41:26.569144+0000","last_clean":"2023-11-04T01:41:26.569144+0000","last_became_active":"2023-11-04T01:41:24.612325+0000","last_became_peered":"2023-11-04T01:41:24.612325+0000","last_unstale":"2023-11-04T01:41:26.569144+0000","last_undegraded":"2023-11-04T01:41:26.569144+0000","last_fullsized":"2023-11-04T01:41:26.569144+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:57:50.206787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568428+0000","last_change":"2023-11-04T01:41:25.575978+0000","last_active":"2023-11-04T01:41:26.568428+0000","last_peered":"2023-11-04T01:41:26.568428+0000","last_clean":"2023-11-04T01:41:26.568428+0000","last_became_active":"2023-11-04T01:41:25.575296+0000","last_became_peered":"2023-11-04T01:41:25.575296+0000","last_unstale":"2023-11-04T01:41:26.568428+0000","last_undegraded":"2023-11-04T01:41:26.568428+0000","last_fullsized":"2023-11-04T01:41:26.568428+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:14:12.898473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.568467+0000","last_change":"2023-11-04T01:41:24.611105+0000","last_active":"2023-11-04T01:41:25.568467+0000","last_peered":"2023-11-04T01:41:25.568467+0000","last_clean":"2023-11-04T01:41:25.568467+0000","last_became_active":"2023-11-04T01:41:24.610883+0000","last_became_peered":"2023-11-04T01:41:24.610883+0000","last_unstale":"2023-11-04T01:41:25.568467+0000","last_undegraded":"2023-11-04T01:41:25.568467+0000","last_fullsized":"2023-11-04T01:41:25.568467+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:30:56.300327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.566643+0000","last_change":"2023-11-04T01:41:25.581568+0000","last_active":"2023-11-04T01:41:26.566643+0000","last_peered":"2023-11-04T01:41:26.566643+0000","last_clean":"2023-11-04T01:41:26.566643+0000","last_became_active":"2023-11-04T01:41:25.581313+0000","last_became_peered":"2023-11-04T01:41:25.581313+0000","last_unstale":"2023-11-04T01:41:26.566643+0000","last_undegraded":"2023-11-04T01:41:26.566643+0000","last_fullsized":"2023-11-04T01:41:26.566643+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:42:28.590161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.569272+0000","last_change":"2023-11-04T01:41:24.602271+0000","last_active":"2023-11-04T01:41:25.569272+0000","last_peered":"2023-11-04T01:41:25.569272+0000","last_clean":"2023-11-04T01:41:25.569272+0000","last_became_active":"2023-11-04T01:41:24.601954+0000","last_became_peered":"2023-11-04T01:41:24.601954+0000","last_unstale":"2023-11-04T01:41:25.569272+0000","last_undegraded":"2023-11-04T01:41:25.569272+0000","last_fullsized":"2023-11-04T01:41:25.569272+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:03:04.701879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.576404+0000","last_change":"2023-11-04T01:41:25.574444+0000","last_active":"2023-11-04T01:41:25.576404+0000","last_peered":"2023-11-04T01:41:25.576404+0000","last_clean":"2023-11-04T01:41:25.576404+0000","last_became_active":"2023-11-04T01:41:25.574188+0000","last_became_peered":"2023-11-04T01:41:25.574188+0000","last_unstale":"2023-11-04T01:41:25.576404+0000","last_undegraded":"2023-11-04T01:41:25.576404+0000","last_fullsized":"2023-11-04T01:41:25.576404+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:07:31.735125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.570735+0000","last_change":"2023-11-04T01:41:24.604730+0000","last_active":"2023-11-04T01:41:25.570735+0000","last_peered":"2023-11-04T01:41:25.570735+0000","last_clean":"2023-11-04T01:41:25.570735+0000","last_became_active":"2023-11-04T01:41:24.604427+0000","last_became_peered":"2023-11-04T01:41:24.604427+0000","last_unstale":"2023-11-04T01:41:25.570735+0000","last_undegraded":"2023-11-04T01:41:25.570735+0000","last_fullsized":"2023-11-04T01:41:25.570735+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:15.895433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:27.332792+0000","last_change":"2023-11-04T01:41:25.575421+0000","last_active":"2023-11-04T01:41:27.332792+0000","last_peered":"2023-11-04T01:41:27.332792+0000","last_clean":"2023-11-04T01:41:27.332792+0000","last_became_active":"2023-11-04T01:41:25.575164+0000","last_became_peered":"2023-11-04T01:41:25.575164+0000","last_unstale":"2023-11-04T01:41:27.332792+0000","last_undegraded":"2023-11-04T01:41:27.332792+0000","last_fullsized":"2023-11-04T01:41:27.332792+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:57:06.911387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.571335+0000","last_change":"2023-11-04T01:41:24.606507+0000","last_active":"2023-11-04T01:41:25.571335+0000","last_peered":"2023-11-04T01:41:25.571335+0000","last_clean":"2023-11-04T01:41:25.571335+0000","last_became_active":"2023-11-04T01:41:24.606208+0000","last_became_peered":"2023-11-04T01:41:24.606208+0000","last_unstale":"2023-11-04T01:41:25.571335+0000","last_undegraded":"2023-11-04T01:41:25.571335+0000","last_fullsized":"2023-11-04T01:41:25.571335+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:25.995002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.584300+0000","last_change":"2023-11-04T01:41:25.579531+0000","last_active":"2023-11-04T01:41:25.584300+0000","last_peered":"2023-11-04T01:41:25.584300+0000","last_clean":"2023-11-04T01:41:25.584300+0000","last_became_active":"2023-11-04T01:41:25.579280+0000","last_became_peered":"2023-11-04T01:41:25.579280+0000","last_unstale":"2023-11-04T01:41:25.584300+0000","last_undegraded":"2023-11-04T01:41:25.584300+0000","last_fullsized":"2023-11-04T01:41:25.584300+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:03:50.510106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.567518+0000","last_change":"2023-11-04T01:41:24.603274+0000","last_active":"2023-11-04T01:41:25.567518+0000","last_peered":"2023-11-04T01:41:25.567518+0000","last_clean":"2023-11-04T01:41:25.567518+0000","last_became_active":"2023-11-04T01:41:24.603004+0000","last_became_peered":"2023-11-04T01:41:24.603004+0000","last_unstale":"2023-11-04T01:41:25.567518+0000","last_undegraded":"2023-11-04T01:41:25.567518+0000","last_fullsized":"2023-11-04T01:41:25.567518+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:00:37.555784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568158+0000","last_change":"2023-11-04T01:41:25.574347+0000","last_active":"2023-11-04T01:41:26.568158+0000","last_peered":"2023-11-04T01:41:26.568158+0000","last_clean":"2023-11-04T01:41:26.568158+0000","last_became_active":"2023-11-04T01:41:25.574073+0000","last_became_peered":"2023-11-04T01:41:25.574073+0000","last_unstale":"2023-11-04T01:41:26.568158+0000","last_undegraded":"2023-11-04T01:41:26.568158+0000","last_fullsized":"2023-11-04T01:41:26.568158+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:43.475755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.566185+0000","last_change":"2023-11-04T01:41:24.601708+0000","last_active":"2023-11-04T01:41:26.566185+0000","last_peered":"2023-11-04T01:41:26.566185+0000","last_clean":"2023-11-04T01:41:26.566185+0000","last_became_active":"2023-11-04T01:41:24.601460+0000","last_became_peered":"2023-11-04T01:41:24.601460+0000","last_unstale":"2023-11-04T01:41:26.566185+0000","last_undegraded":"2023-11-04T01:41:26.566185+0000","last_fullsized":"2023-11-04T01:41:26.566185+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:59:52.803584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568982+0000","last_change":"2023-11-04T01:41:25.576919+0000","last_active":"2023-11-04T01:41:26.568982+0000","last_peered":"2023-11-04T01:41:26.568982+0000","last_clean":"2023-11-04T01:41:26.568982+0000","last_became_active":"2023-11-04T01:41:25.576679+0000","last_became_peered":"2023-11-04T01:41:25.576679+0000","last_unstale":"2023-11-04T01:41:26.568982+0000","last_undegraded":"2023-11-04T01:41:26.568982+0000","last_fullsized":"2023-11-04T01:41:26.568982+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:24.580038+0000","last_clean_scrub_stamp":"2023-11-04T01:41:24.580038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:15:23.173234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-04T01:41:26.568380+0000","last_change":"2023-11-04T01:41:24.606181+0000","last_active":"2023-11-04T01:41:26.568380+0000","last_peered":"2023-11-04T01:41:26.568380+0000","last_clean":"2023-11-04T01:41:26.568380+0000","last_became_active":"2023-11-04T01:41:24.605884+0000","last_became_peered":"2023-11-04T01:41:24.605884+0000","last_unstale":"2023-11-04T01:41:26.568380+0000","last_undegraded":"2023-11-04T01:41:26.568380+0000","last_fullsized":"2023-11-04T01:41:26.568380+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:23.577442+0000","last_clean_scrub_stamp":"2023-11-04T01:41:23.577442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:06:16.567391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-04T01:41:25.566987+0000","last_change":"2023-11-04T01:39:54.204460+0000","last_active":"2023-11-04T01:41:25.566987+0000","last_peered":"2023-11-04T01:41:25.566987+0000","last_clean":"2023-11-04T01:41:25.566987+0000","last_became_active":"2023-11-04T01:39:54.203352+0000","last_became_peered":"2023-11-04T01:39:54.203352+0000","last_unstale":"2023-11-04T01:41:25.566987+0000","last_undegraded":"2023-11-04T01:41:25.566987+0000","last_fullsized":"2023-11-04T01:41:25.566987+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:52.627032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:52.627032+0000","last_clean_scrub_stamp":"2023-11-04T01:39:52.627032+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:17:18.474768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":188604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.78200000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.71999999999999997}]},{"osd":2,"last update":"Sat Nov 4 01:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.752},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.76300000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.79800000000000004}]},{"osd":4,"last update":"Sat Nov 4 01:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.629},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.54600000000000004}]},{"osd":6,"last update":"Sat Nov 4 01:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.51900000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.65100000000000002}]}]},{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1036288,"data_stored":773922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.63600000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.72199999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.78100000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.68000000000000005}]},{"osd":4,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.308},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.377}]},{"osd":5,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.34399999999999997}]},{"osd":6,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.41899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":182454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.49099999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.60799999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.56499999999999995}]},{"osd":3,"last update":"Sat Nov 4 01:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.58299999999999996}]},{"osd":4,"last update":"Sat Nov 4 01:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.39600000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.54400000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.441},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.50800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":434176,"data_stored":182476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.55600000000000005}]},{"osd":1,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.54300000000000004}]},{"osd":2,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.58299999999999996}]},{"osd":3,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.49199999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.39800000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.379}]},{"osd":7,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.433},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.629}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":183518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"last":0.45200000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.56299999999999994}]},{"osd":2,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.50900000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.59899999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.59099999999999997}]},{"osd":6,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.64800000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.63}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":181942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.249},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.30399999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.34100000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.32400000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.52000000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.53100000000000003}]},{"osd":6,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.54400000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.44},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.50700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":181962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.443,"5min":0.443,"15min":0.443},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"last":0.50600000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.52200000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.57299999999999995}]},{"osd":4,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.79400000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.71699999999999997}]},{"osd":6,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.68500000000000005}]},{"osd":7,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.82799999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1019904,"data_stored":771255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.41899999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.377},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.35699999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.46200000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.70399999999999996}]},{"osd":5,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.58399999999999996}]},{"osd":6,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.67500000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.66400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:41:28.874 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T01:41:28.875 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-04T01:41:29.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.012+0000 7fa0be91d640 1 Processor -- start 2023-11-04T01:41:29.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.012+0000 7fa0be91d640 1 -- start start 2023-11-04T01:41:29.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.013+0000 7fa0be91d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa0b80cdc20 0x7fa0b8165950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.013+0000 7fa0be91d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0b80d0280 con 0x7fa0b80d0710 2023-11-04T01:41:29.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.013+0000 7fa0be91d640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0b80cf670 con 0x7fa0b815e430 2023-11-04T01:41:29.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.013+0000 7fa0be91d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0b80cf950 con 0x7fa0b80cdc20 2023-11-04T01:41:29.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.013+0000 7fa0bceba640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa0b80cdc20 0x7fa0b8165950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.013+0000 7fa0b77fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fa0b80d0710 0x7fa0b80cd510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:34458/0 (socket says 172.21.15.77:34458) 2023-11-04T01:41:29.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.013+0000 7fa0b77fe640 1 -- 172.21.15.77:0/2241249871 learned_addr learned my addr 172.21.15.77:0/2241249871 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:29.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.014+0000 7fa0bceba640 1 -- 172.21.15.77:0/2241249871 >> v1:172.21.15.122:6789/0 conn(0x7fa0b815e430 legacy=0x7fa0b80cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:29.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.014+0000 7fa0bceba640 1 -- 172.21.15.77:0/2241249871 >> v1:172.21.15.77:6789/0 conn(0x7fa0b80d0710 legacy=0x7fa0b80cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.014+0000 7fa0bceba640 1 -- 172.21.15.77:0/2241249871 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b80cfc30 con 0x7fa0b80cdc20 2023-11-04T01:41:29.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.014+0000 7fa0b6ffd640 1 -- 172.21.15.77:0/2241249871 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4081054522 0 0) 0x7fa0b80d0280 con 0x7fa0b80d0710 2023-11-04T01:41:29.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.014+0000 7fa0bceba640 1 --2- 172.21.15.77:0/2241249871 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0b80cdc20 0x7fa0b8165950 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0009d90 tx=0x7fa0b002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf1ea445ecee1f77 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:29.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.014+0000 7fa0b6ffd640 1 -- 172.21.15.77:0/2241249871 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b002cc60 con 0x7fa0b80cdc20 2023-11-04T01:41:29.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.015+0000 7fa0b6ffd640 1 -- 172.21.15.77:0/2241249871 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b002cdc0 con 0x7fa0b80cdc20 2023-11-04T01:41:29.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.015+0000 7fa0b6ffd640 1 -- 172.21.15.77:0/2241249871 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0034660 con 0x7fa0b80cdc20 2023-11-04T01:41:29.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.015+0000 7fa0be91d640 1 -- 172.21.15.77:0/2241249871 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0b80cdc20 msgr2=0x7fa0b8165950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.015+0000 7fa0be91d640 1 --2- 172.21.15.77:0/2241249871 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0b80cdc20 0x7fa0b8165950 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0009d90 tx=0x7fa0b002beb0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.015+0000 7fa0be91d640 1 -- 172.21.15.77:0/2241249871 shutdown_connections 2023-11-04T01:41:29.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.015+0000 7fa0be91d640 1 --2- 172.21.15.77:0/2241249871 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0b80cdc20 0x7fa0b8165950 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.015+0000 7fa0be91d640 1 -- 172.21.15.77:0/2241249871 >> 172.21.15.77:0/2241249871 conn(0x7fa0b806ea20 msgr2=0x7fa0b806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:29.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.015+0000 7fa0be91d640 1 -- 172.21.15.77:0/2241249871 shutdown_connections 2023-11-04T01:41:29.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.015+0000 7fa0be91d640 1 -- 172.21.15.77:0/2241249871 wait complete. 2023-11-04T01:41:29.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.016+0000 7fa0be91d640 1 Processor -- start 2023-11-04T01:41:29.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.016+0000 7fa0be91d640 1 -- start start 2023-11-04T01:41:29.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.017+0000 7fa0be91d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa0b80cdc20 0x7fa0b8148f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.017+0000 7fa0be91d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0b80d0710 0x7fa0b81f0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.017+0000 7fa0be91d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0b815e430 0x7fa0b80cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.017+0000 7fa0be91d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b80c8010 con 0x7fa0b815e430 2023-11-04T01:41:29.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.017+0000 7fa0be91d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b80c7c70 con 0x7fa0b80d0710 2023-11-04T01:41:29.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.017+0000 7fa0be91d640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b81f0ba0 con 0x7fa0b80cdc20 2023-11-04T01:41:29.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.017+0000 7fa0bceba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0b815e430 0x7fa0b80cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.017+0000 7fa0bceba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0b815e430 0x7fa0b80cb5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43612/0 (socket says 172.21.15.77:43612) 2023-11-04T01:41:29.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.017+0000 7fa0bceba640 1 -- 172.21.15.77:0/731171877 learned_addr learned my addr 172.21.15.77:0/731171877 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:29.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.017+0000 7fa0b7fff640 1 --2- 172.21.15.77:0/731171877 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa0b80cdc20 0x7fa0b8148f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.017+0000 7fa0b77fe640 1 --2- 172.21.15.77:0/731171877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0b80d0710 0x7fa0b81f0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.018+0000 7fa0bceba640 1 -- 172.21.15.77:0/731171877 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa0b80cdc20 msgr2=0x7fa0b8148f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.018+0000 7fa0bceba640 1 --2- 172.21.15.77:0/731171877 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa0b80cdc20 0x7fa0b8148f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.018+0000 7fa0bceba640 1 -- 172.21.15.77:0/731171877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0b80d0710 msgr2=0x7fa0b81f0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.018+0000 7fa0bceba640 1 --2- 172.21.15.77:0/731171877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0b80d0710 0x7fa0b81f0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.018+0000 7fa0bceba640 1 -- 172.21.15.77:0/731171877 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b0009a70 con 0x7fa0b815e430 2023-11-04T01:41:29.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.018+0000 7fa0b7fff640 1 --2- 172.21.15.77:0/731171877 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa0b80cdc20 0x7fa0b8148f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:29.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.018+0000 7fa0b77fe640 1 --2- 172.21.15.77:0/731171877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0b80d0710 0x7fa0b81f0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:29.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.018+0000 7fa0bceba640 1 --2- 172.21.15.77:0/731171877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0b815e430 0x7fa0b80cb5b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0009eb0 tx=0x7fa0b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:29.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.018+0000 7fa0b4ff9640 1 -- 172.21.15.77:0/731171877 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b003f420 con 0x7fa0b815e430 2023-11-04T01:41:29.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.018+0000 7fa0b4ff9640 1 -- 172.21.15.77:0/731171877 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b003f580 con 0x7fa0b815e430 2023-11-04T01:41:29.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.018+0000 7fa0be91d640 1 -- 172.21.15.77:0/731171877 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0b81f0e80 con 0x7fa0b815e430 2023-11-04T01:41:29.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.018+0000 7fa0b4ff9640 1 -- 172.21.15.77:0/731171877 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b003f910 con 0x7fa0b815e430 2023-11-04T01:41:29.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.018+0000 7fa0be91d640 1 -- 172.21.15.77:0/731171877 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b8149470 con 0x7fa0b815e430 2023-11-04T01:41:29.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.019+0000 7fa0be91d640 1 -- 172.21.15.77:0/731171877 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0b80c8150 con 0x7fa0b815e430 2023-11-04T01:41:29.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.019+0000 7fa0b4ff9640 1 -- 172.21.15.77:0/731171877 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa0b003fa70 con 0x7fa0b815e430 2023-11-04T01:41:29.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.020+0000 7fa0b4ff9640 1 --2- 172.21.15.77:0/731171877 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa0a406ae70 0x7fa0a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.020+0000 7fa0b4ff9640 1 -- 172.21.15.77:0/731171877 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa0b00ac180 con 0x7fa0b815e430 2023-11-04T01:41:29.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.020+0000 7fa0b7fff640 1 --2- 172.21.15.77:0/731171877 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa0a406ae70 0x7fa0a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.021+0000 7fa0b7fff640 1 --2- 172.21.15.77:0/731171877 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa0a406ae70 0x7fa0a406d330 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa0a800a830 tx=0x7fa0a8008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:29.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.024+0000 7fa0b4ff9640 1 -- 172.21.15.77:0/731171877 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa0b80c8150 con 0x7fa0b815e430 2023-11-04T01:41:29.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.255+0000 7fa0be91d640 1 -- 172.21.15.77:0/731171877 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa0b80c8150 con 0x7fa0b815e430 2023-11-04T01:41:29.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.257+0000 7fa0b4ff9640 1 -- 172.21.15.77:0/731171877 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 190+0+147 (secure 0 0 0) 0x7fa0b80c8150 con 0x7fa0b815e430 2023-11-04T01:41:29.259 INFO:teuthology.orchestra.run.smithi077.stdout:[client.0] 2023-11-04T01:41:29.259 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQC2oEVlChU2FxAAt1/aJZOrufjVZhraPqv1Gw== 2023-11-04T01:41:29.260 INFO:teuthology.orchestra.run.smithi077.stdout: caps mds = "allow" 2023-11-04T01:41:29.260 INFO:teuthology.orchestra.run.smithi077.stdout: caps mon = "allow r" 2023-11-04T01:41:29.260 INFO:teuthology.orchestra.run.smithi077.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-04T01:41:29.261 INFO:teuthology.orchestra.run.smithi077.stderr:updated caps for client.0 2023-11-04T01:41:29.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.259+0000 7fa0be91d640 1 -- 172.21.15.77:0/731171877 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa0a406ae70 msgr2=0x7fa0a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.259+0000 7fa0be91d640 1 --2- 172.21.15.77:0/731171877 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa0a406ae70 0x7fa0a406d330 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa0a800a830 tx=0x7fa0a8008040 comp rx=0 tx=0).stop 2023-11-04T01:41:29.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.259+0000 7fa0be91d640 1 -- 172.21.15.77:0/731171877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0b815e430 msgr2=0x7fa0b80cb5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.259+0000 7fa0be91d640 1 --2- 172.21.15.77:0/731171877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0b815e430 0x7fa0b80cb5b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0009eb0 tx=0x7fa0b0004a40 comp rx=0 tx=0).stop 2023-11-04T01:41:29.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.259+0000 7fa0be91d640 1 -- 172.21.15.77:0/731171877 shutdown_connections 2023-11-04T01:41:29.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.259+0000 7fa0be91d640 1 --2- 172.21.15.77:0/731171877 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa0a406ae70 0x7fa0a406d330 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.259+0000 7fa0be91d640 1 --2- 172.21.15.77:0/731171877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0b815e430 0x7fa0b80cb5b0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.259+0000 7fa0be91d640 1 --2- 172.21.15.77:0/731171877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa0b80d0710 0x7fa0b81f0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.259+0000 7fa0be91d640 1 --2- 172.21.15.77:0/731171877 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa0b80cdc20 0x7fa0b8148f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.259+0000 7fa0be91d640 1 -- 172.21.15.77:0/731171877 >> 172.21.15.77:0/731171877 conn(0x7fa0b806ea20 msgr2=0x7fa0b815d010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:29.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.260+0000 7fa0be91d640 1 -- 172.21.15.77:0/731171877 shutdown_connections 2023-11-04T01:41:29.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.260+0000 7fa0be91d640 1 -- 172.21.15.77:0/731171877 wait complete. 2023-11-04T01:41:29.272 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:29.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.371+0000 7f4d67d55640 1 Processor -- start 2023-11-04T01:41:29.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.371+0000 7f4d67d55640 1 -- start start 2023-11-04T01:41:29.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.372+0000 7f4d67d55640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d600ce240 0x7f4d60157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.372+0000 7f4d67d55640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4d60157540 0x7f4d600d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.372+0000 7f4d67d55640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d6015e000 con 0x7f4d600cde60 2023-11-04T01:41:29.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.372+0000 7f4d67d55640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d6015e5c0 con 0x7f4d60157540 2023-11-04T01:41:29.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.372+0000 7f4d67d55640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6015e2e0 con 0x7f4d600ce240 2023-11-04T01:41:29.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.372+0000 7f4d65af1640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f4d600cde60 0x7f4d6015d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:34472/0 (socket says 172.21.15.77:34472) 2023-11-04T01:41:29.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.372+0000 7f4d65af1640 1 -- 172.21.15.77:0/1478976522 learned_addr learned my addr 172.21.15.77:0/1478976522 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:29.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.372+0000 7f4d652f0640 1 --2- 172.21.15.77:0/1478976522 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d600ce240 0x7f4d60157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.372+0000 7f4d662f2640 1 --2- 172.21.15.77:0/1478976522 >> v2:172.21.15.122:3300/0 conn(0x7f4d60157540 0x7f4d600d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.372+0000 7f4d64aef640 1 -- 172.21.15.77:0/1478976522 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4287289796 0 0) 0x7f4d6015e000 con 0x7f4d600cde60 2023-11-04T01:41:29.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.372+0000 7f4d64aef640 1 -- 172.21.15.77:0/1478976522 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d4c003520 con 0x7f4d600cde60 2023-11-04T01:41:29.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.373+0000 7f4d64aef640 1 -- 172.21.15.77:0/1478976522 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1690590131 0 0) 0x7f4d4c003520 con 0x7f4d600cde60 2023-11-04T01:41:29.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.373+0000 7f4d64aef640 1 -- 172.21.15.77:0/1478976522 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d600ce240 msgr2=0x7f4d60157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:29.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.373+0000 7f4d64aef640 1 --2- 172.21.15.77:0/1478976522 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d600ce240 0x7f4d60157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.373+0000 7f4d64aef640 1 -- 172.21.15.77:0/1478976522 >> v2:172.21.15.122:3300/0 conn(0x7f4d60157540 msgr2=0x7f4d600d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:29.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.373+0000 7f4d64aef640 1 --2- 172.21.15.77:0/1478976522 >> v2:172.21.15.122:3300/0 conn(0x7f4d60157540 0x7f4d600d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.373+0000 7f4d64aef640 1 -- 172.21.15.77:0/1478976522 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d600d1120 con 0x7f4d600cde60 2023-11-04T01:41:29.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.373+0000 7f4d64aef640 1 -- 172.21.15.77:0/1478976522 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f4d50001670 con 0x7f4d600cde60 2023-11-04T01:41:29.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.373+0000 7f4d662f2640 1 --2- 172.21.15.77:0/1478976522 >> v2:172.21.15.122:3300/0 conn(0x7f4d60157540 0x7f4d600d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:41:29.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.373+0000 7f4d64aef640 1 -- 172.21.15.77:0/1478976522 >> v1:172.21.15.77:6789/0 conn(0x7f4d600cde60 legacy=0x7f4d6015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.373+0000 7f4d64aef640 1 --2- 172.21.15.77:0/1478976522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d4c003970 0x7f4d4c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.373+0000 7f4d64aef640 1 --2- 172.21.15.77:0/1478976522 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d4c0047c0 0x7f4d4c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.373+0000 7f4d64aef640 1 --2- 172.21.15.77:0/1478976522 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d4c005180 0x7f4d4c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.373+0000 7f4d64aef640 1 -- 172.21.15.77:0/1478976522 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6015e5c0 con 0x7f4d4c003970 2023-11-04T01:41:29.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.373+0000 7f4d64aef640 1 -- 172.21.15.77:0/1478976522 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6015e2e0 con 0x7f4d4c005180 2023-11-04T01:41:29.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.373+0000 7f4d64aef640 1 -- 172.21.15.77:0/1478976522 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c00bec0 con 0x7f4d4c0047c0 2023-11-04T01:41:29.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.373+0000 7f4d652f0640 1 --2- 172.21.15.77:0/1478976522 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d600ce240 0x7f4d60157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:41:29.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.373+0000 7f4d65af1640 1 --2- 172.21.15.77:0/1478976522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d4c003970 0x7f4d4c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.373+0000 7f4d662f2640 1 --2- 172.21.15.77:0/1478976522 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d4c005180 0x7f4d4c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.373+0000 7f4d652f0640 1 --2- 172.21.15.77:0/1478976522 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d4c0047c0 0x7f4d4c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.373+0000 7f4d65af1640 1 -- 172.21.15.77:0/1478976522 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d4c0047c0 msgr2=0x7f4d4c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:29.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.373+0000 7f4d65af1640 1 --2- 172.21.15.77:0/1478976522 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d4c0047c0 0x7f4d4c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.373+0000 7f4d65af1640 1 -- 172.21.15.77:0/1478976522 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d4c005180 msgr2=0x7f4d4c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:29.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.373+0000 7f4d65af1640 1 --2- 172.21.15.77:0/1478976522 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d4c005180 0x7f4d4c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.373+0000 7f4d65af1640 1 -- 172.21.15.77:0/1478976522 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4c003520 con 0x7f4d4c003970 2023-11-04T01:41:29.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.373+0000 7f4d652f0640 1 --2- 172.21.15.77:0/1478976522 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d4c0047c0 0x7f4d4c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:29.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.373+0000 7f4d662f2640 1 --2- 172.21.15.77:0/1478976522 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d4c005180 0x7f4d4c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:29.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.374+0000 7f4d65af1640 1 --2- 172.21.15.77:0/1478976522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d4c003970 0x7f4d4c003d90 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4d5000c270 tx=0x7f4d4c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ee2499b191ce27 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:29.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.374+0000 7f4d64aef640 1 -- 172.21.15.77:0/1478976522 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5002cae0 con 0x7f4d4c003970 2023-11-04T01:41:29.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.374+0000 7f4d64aef640 1 -- 172.21.15.77:0/1478976522 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5002cc40 con 0x7f4d4c003970 2023-11-04T01:41:29.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.374+0000 7f4d64aef640 1 -- 172.21.15.77:0/1478976522 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d500058d0 con 0x7f4d4c003970 2023-11-04T01:41:29.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.375+0000 7f4d67d55640 1 -- 172.21.15.77:0/1478976522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d4c003970 msgr2=0x7f4d4c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.375+0000 7f4d67d55640 1 --2- 172.21.15.77:0/1478976522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d4c003970 0x7f4d4c003d90 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4d5000c270 tx=0x7f4d4c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.375+0000 7f4d662f2640 1 -- 172.21.15.77:0/1478976522 reap_dead start 2023-11-04T01:41:29.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.375+0000 7f4d67d55640 1 -- 172.21.15.77:0/1478976522 shutdown_connections 2023-11-04T01:41:29.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.375+0000 7f4d67d55640 1 -- 172.21.15.77:0/1478976522 >> 172.21.15.77:0/1478976522 conn(0x7f4d60071f30 msgr2=0x7f4d600cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:29.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.375+0000 7f4d67d55640 1 -- 172.21.15.77:0/1478976522 shutdown_connections 2023-11-04T01:41:29.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.375+0000 7f4d67d55640 1 -- 172.21.15.77:0/1478976522 wait complete. 2023-11-04T01:41:29.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.376+0000 7f4d67d55640 1 Processor -- start 2023-11-04T01:41:29.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.376+0000 7f4d67d55640 1 -- start start 2023-11-04T01:41:29.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.377+0000 7f4d67d55640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d4c003970 0x7f4d601f6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.377+0000 7f4d67d55640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d600cb4e0 0x7f4d6015ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.377+0000 7f4d67d55640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d60149e00 0x7f4d6014a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.377+0000 7f4d67d55640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6014a7c0 con 0x7f4d4c003970 2023-11-04T01:41:29.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.377+0000 7f4d67d55640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d600cc8d0 con 0x7f4d600cb4e0 2023-11-04T01:41:29.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.377+0000 7f4d67d55640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d600cbcc0 con 0x7f4d60149e00 2023-11-04T01:41:29.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.377+0000 7f4d65af1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d4c003970 0x7f4d601f6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.377+0000 7f4d65af1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d4c003970 0x7f4d601f6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43638/0 (socket says 172.21.15.77:43638) 2023-11-04T01:41:29.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.377+0000 7f4d65af1640 1 -- 172.21.15.77:0/242753932 learned_addr learned my addr 172.21.15.77:0/242753932 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:29.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.377+0000 7f4d662f2640 1 --2- 172.21.15.77:0/242753932 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d60149e00 0x7f4d6014a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.377+0000 7f4d652f0640 1 --2- 172.21.15.77:0/242753932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d600cb4e0 0x7f4d6015ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.377+0000 7f4d65af1640 1 -- 172.21.15.77:0/242753932 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d60149e00 msgr2=0x7f4d6014a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.377+0000 7f4d65af1640 1 --2- 172.21.15.77:0/242753932 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d60149e00 0x7f4d6014a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.377+0000 7f4d65af1640 1 -- 172.21.15.77:0/242753932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d600cb4e0 msgr2=0x7f4d6015ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.377+0000 7f4d65af1640 1 --2- 172.21.15.77:0/242753932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d600cb4e0 0x7f4d6015ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.377+0000 7f4d65af1640 1 -- 172.21.15.77:0/242753932 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d600cbfa0 con 0x7f4d4c003970 2023-11-04T01:41:29.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.377+0000 7f4d652f0640 1 --2- 172.21.15.77:0/242753932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d600cb4e0 0x7f4d6015ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:29.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.377+0000 7f4d65af1640 1 --2- 172.21.15.77:0/242753932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d4c003970 0x7f4d601f6810 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4d5000c190 tx=0x7f4d50001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:29.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.377+0000 7f4d567fc640 1 -- 172.21.15.77:0/242753932 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d50039070 con 0x7f4d4c003970 2023-11-04T01:41:29.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.377+0000 7f4d567fc640 1 -- 172.21.15.77:0/242753932 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d50005c80 con 0x7f4d4c003970 2023-11-04T01:41:29.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.377+0000 7f4d567fc640 1 -- 172.21.15.77:0/242753932 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5003c040 con 0x7f4d4c003970 2023-11-04T01:41:29.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.377+0000 7f4d67d55640 1 -- 172.21.15.77:0/242753932 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d600cc280 con 0x7f4d4c003970 2023-11-04T01:41:29.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.378+0000 7f4d67d55640 1 -- 172.21.15.77:0/242753932 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d600ccd60 con 0x7f4d4c003970 2023-11-04T01:41:29.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.378+0000 7f4d67d55640 1 -- 172.21.15.77:0/242753932 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d60074290 con 0x7f4d4c003970 2023-11-04T01:41:29.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.379+0000 7f4d567fc640 1 -- 172.21.15.77:0/242753932 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4d50032070 con 0x7f4d4c003970 2023-11-04T01:41:29.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.379+0000 7f4d567fc640 1 --2- 172.21.15.77:0/242753932 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4d4406aea0 0x7f4d4406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:29.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.379+0000 7f4d567fc640 1 -- 172.21.15.77:0/242753932 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4d500aab20 con 0x7f4d4c003970 2023-11-04T01:41:29.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.380+0000 7f4d652f0640 1 --2- 172.21.15.77:0/242753932 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4d4406aea0 0x7f4d4406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:29.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.380+0000 7f4d652f0640 1 --2- 172.21.15.77:0/242753932 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4d4406aea0 0x7f4d4406d360 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c006e80 tx=0x7f4d5c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:29.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.383+0000 7f4d567fc640 1 -- 172.21.15.77:0/242753932 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4d50075ae0 con 0x7f4d4c003970 2023-11-04T01:41:29.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.591+0000 7f4d67d55640 1 -- 172.21.15.77:0/242753932 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d601559e0 con 0x7f4d4c003970 2023-11-04T01:41:29.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.592+0000 7f4d567fc640 1 -- 172.21.15.77:0/242753932 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4920 (secure 0 0 0) 0x7f4d50046070 con 0x7f4d4c003970 2023-11-04T01:41:29.594 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:29.594 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5511,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/1132914884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1132914884},{"type":"v1","addr":"172.21.15.77:6834","nonce":1132914884}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5514,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/530959421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":530959421},{"type":"v1","addr":"172.21.15.77:6835","nonce":530959421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":34823,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/1375125704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1375125704},{"type":"v1","addr":"172.21.15.122:6836","nonce":1375125704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:41:24.933073+0000","modified":"2023-11-04T01:41:26.930876+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34826},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34826":{"gid":34826,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/3085479427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":3085479427},{"type":"v1","addr":"172.21.15.122:6837","nonce":3085479427}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-04T01:41:29.595 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 16 2023-11-04T01:41:29.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.594+0000 7f4d67d55640 1 -- 172.21.15.77:0/242753932 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4d4406aea0 msgr2=0x7f4d4406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.594+0000 7f4d67d55640 1 --2- 172.21.15.77:0/242753932 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4d4406aea0 0x7f4d4406d360 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c006e80 tx=0x7f4d5c008040 comp rx=0 tx=0).stop 2023-11-04T01:41:29.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.594+0000 7f4d67d55640 1 -- 172.21.15.77:0/242753932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d4c003970 msgr2=0x7f4d601f6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:29.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.594+0000 7f4d67d55640 1 --2- 172.21.15.77:0/242753932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d4c003970 0x7f4d601f6810 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4d5000c190 tx=0x7f4d50001a00 comp rx=0 tx=0).stop 2023-11-04T01:41:29.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.594+0000 7f4d67d55640 1 -- 172.21.15.77:0/242753932 shutdown_connections 2023-11-04T01:41:29.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.594+0000 7f4d67d55640 1 --2- 172.21.15.77:0/242753932 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4d4406aea0 0x7f4d4406d360 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.594+0000 7f4d67d55640 1 --2- 172.21.15.77:0/242753932 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d60149e00 0x7f4d6014a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.594+0000 7f4d67d55640 1 --2- 172.21.15.77:0/242753932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d600cb4e0 0x7f4d6015ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.594+0000 7f4d67d55640 1 --2- 172.21.15.77:0/242753932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d4c003970 0x7f4d601f6810 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:29.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.594+0000 7f4d67d55640 1 -- 172.21.15.77:0/242753932 >> 172.21.15.77:0/242753932 conn(0x7f4d60071f30 msgr2=0x7f4d600cf660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:29.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.594+0000 7f4d67d55640 1 -- 172.21.15.77:0/242753932 shutdown_connections 2023-11-04T01:41:29.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:29.594+0000 7f4d67d55640 1 -- 172.21.15.77:0/242753932 wait complete. 2023-11-04T01:41:30.009 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:41:24.933073+0000', 'modified': '2023-11-04T01:41:26.930876+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 34826}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_34826': {'gid': 34826, 'name': 'd', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.122:6837/3085479427', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6835', 'nonce': 3085479427}, {'type': 'v1', 'addr': '172.21.15.122:6837', 'nonce': 3085479427}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:41:30.010 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:41:30.010 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-04T01:41:30.045 INFO:tasks.ceph.mds.d.smithi122.stderr:2023-11-04T01:41:30.043+0000 7f9f31d3a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:41:30.054 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:41:30.056 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:41:30.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.112+0000 7fe14655e640 1 Processor -- start 2023-11-04T01:41:30.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.112+0000 7fe14655e640 1 -- start start 2023-11-04T01:41:30.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.113+0000 7fe14655e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe14015af20 0x7fe1400b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.113+0000 7fe14655e640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe1400b64c0 0x7fe1400cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.113+0000 7fe14655e640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1400d01f0 con 0x7fe1400cd3b0 2023-11-04T01:41:30.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.113+0000 7fe14655e640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1400b6a40 con 0x7fe1400b64c0 2023-11-04T01:41:30.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.113+0000 7fe14655e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1400d04b0 con 0x7fe14015af20 2023-11-04T01:41:30.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.113+0000 7fe13ffff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe14015af20 0x7fe1400b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.113+0000 7fe13ffff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe14015af20 0x7fe1400b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:38864/0 (socket says 172.21.15.77:38864) 2023-11-04T01:41:30.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.113+0000 7fe13f7fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe1400b64c0 0x7fe1400cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.113+0000 7fe13ffff640 1 -- 172.21.15.77:0/184066066 learned_addr learned my addr 172.21.15.77:0/184066066 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:30.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.113+0000 7fe13f7fe640 1 -- 172.21.15.77:0/184066066 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe14015af20 msgr2=0x7fe1400b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:30.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.113+0000 7fe13f7fe640 1 --2- 172.21.15.77:0/184066066 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe14015af20 0x7fe1400b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.113+0000 7fe13f7fe640 1 -- 172.21.15.77:0/184066066 >> v1:172.21.15.122:6789/0 conn(0x7fe1400cd3b0 legacy=0x7fe1400b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.113+0000 7fe13f7fe640 1 -- 172.21.15.77:0/184066066 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1400d0790 con 0x7fe1400b64c0 2023-11-04T01:41:30.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.113+0000 7fe13ffff640 1 --2- 172.21.15.77:0/184066066 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe14015af20 0x7fe1400b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:41:30.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.114+0000 7fe13f7fe640 1 --2- 172.21.15.77:0/184066066 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1400b64c0 0x7fe1400cbc70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe1340097a0 tx=0x7fe13402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9dba72bc00cf49e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:30.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.114+0000 7fe13effd640 1 -- 172.21.15.77:0/184066066 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe134031830 con 0x7fe1400b64c0 2023-11-04T01:41:30.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.114+0000 7fe13effd640 1 -- 172.21.15.77:0/184066066 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe134031990 con 0x7fe1400b64c0 2023-11-04T01:41:30.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.114+0000 7fe13effd640 1 -- 172.21.15.77:0/184066066 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe134031d20 con 0x7fe1400b64c0 2023-11-04T01:41:30.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.115+0000 7fe14655e640 1 -- 172.21.15.77:0/184066066 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1400b64c0 msgr2=0x7fe1400cbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.115+0000 7fe14655e640 1 --2- 172.21.15.77:0/184066066 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1400b64c0 0x7fe1400cbc70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe1340097a0 tx=0x7fe13402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.115+0000 7fe14655e640 1 -- 172.21.15.77:0/184066066 shutdown_connections 2023-11-04T01:41:30.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.115+0000 7fe14655e640 1 --2- 172.21.15.77:0/184066066 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1400b64c0 0x7fe1400cbc70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.115+0000 7fe14655e640 1 --2- 172.21.15.77:0/184066066 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe14015af20 0x7fe1400b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.115+0000 7fe14655e640 1 -- 172.21.15.77:0/184066066 >> 172.21.15.77:0/184066066 conn(0x7fe14006ea20 msgr2=0x7fe14006ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:30.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.115+0000 7fe14655e640 1 -- 172.21.15.77:0/184066066 shutdown_connections 2023-11-04T01:41:30.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.115+0000 7fe14655e640 1 -- 172.21.15.77:0/184066066 wait complete. 2023-11-04T01:41:30.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.116+0000 7fe14655e640 1 Processor -- start 2023-11-04T01:41:30.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.116+0000 7fe14655e640 1 -- start start 2023-11-04T01:41:30.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.117+0000 7fe14655e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1400b64c0 0x7fe140153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.117+0000 7fe14655e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1400cd3b0 0x7fe1400c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.117+0000 7fe14655e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe14015af20 0x7fe140150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.117+0000 7fe14655e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe140152a20 con 0x7fe1400cd3b0 2023-11-04T01:41:30.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.117+0000 7fe14655e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe140152fe0 con 0x7fe1400b64c0 2023-11-04T01:41:30.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.117+0000 7fe14655e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1401539b0 con 0x7fe14015af20 2023-11-04T01:41:30.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.117+0000 7fe13f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1400cd3b0 0x7fe1400c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.117+0000 7fe13f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1400cd3b0 0x7fe1400c6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43642/0 (socket says 172.21.15.77:43642) 2023-11-04T01:41:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.117+0000 7fe13f7fe640 1 -- 172.21.15.77:0/2801723891 learned_addr learned my addr 172.21.15.77:0/2801723891 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.117+0000 7fe144afb640 1 --2- 172.21.15.77:0/2801723891 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe14015af20 0x7fe140150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.117+0000 7fe13ffff640 1 --2- 172.21.15.77:0/2801723891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1400b64c0 0x7fe140153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.117+0000 7fe13f7fe640 1 -- 172.21.15.77:0/2801723891 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe14015af20 msgr2=0x7fe140150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.117+0000 7fe13f7fe640 1 --2- 172.21.15.77:0/2801723891 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe14015af20 0x7fe140150e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.118+0000 7fe13f7fe640 1 -- 172.21.15.77:0/2801723891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1400b64c0 msgr2=0x7fe140153470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.118+0000 7fe13f7fe640 1 --2- 172.21.15.77:0/2801723891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1400b64c0 0x7fe140153470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.118+0000 7fe13f7fe640 1 -- 172.21.15.77:0/2801723891 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1300094d0 con 0x7fe1400cd3b0 2023-11-04T01:41:30.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.118+0000 7fe13f7fe640 1 --2- 172.21.15.77:0/2801723891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1400cd3b0 0x7fe1400c6e90 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fe13402bee0 tx=0x7fe1340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.118+0000 7fe13cff9640 1 -- 172.21.15.77:0/2801723891 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13403a6f0 con 0x7fe1400cd3b0 2023-11-04T01:41:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.118+0000 7fe13cff9640 1 -- 172.21.15.77:0/2801723891 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13403a870 con 0x7fe1400cd3b0 2023-11-04T01:41:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.118+0000 7fe14655e640 1 -- 172.21.15.77:0/2801723891 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe134009400 con 0x7fe1400cd3b0 2023-11-04T01:41:30.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.118+0000 7fe13cff9640 1 -- 172.21.15.77:0/2801723891 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13403ac20 con 0x7fe1400cd3b0 2023-11-04T01:41:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.118+0000 7fe14655e640 1 -- 172.21.15.77:0/2801723891 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe140151970 con 0x7fe1400cd3b0 2023-11-04T01:41:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.120+0000 7fe13cff9640 1 -- 172.21.15.77:0/2801723891 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe13404c3b0 con 0x7fe1400cd3b0 2023-11-04T01:41:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.120+0000 7fe13cff9640 1 --2- 172.21.15.77:0/2801723891 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe12c06ae70 0x7fe12c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.120+0000 7fe13cff9640 1 -- 172.21.15.77:0/2801723891 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe1340ab2e0 con 0x7fe1400cd3b0 2023-11-04T01:41:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.120+0000 7fe13ffff640 1 --2- 172.21.15.77:0/2801723891 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe12c06ae70 0x7fe12c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.121+0000 7fe1491c8740 1 Processor -- start 2023-11-04T01:41:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.121+0000 7fe13ffff640 1 --2- 172.21.15.77:0/2801723891 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe12c06ae70 0x7fe12c06d330 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe130006ca0 tx=0x7fe130009240 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.121+0000 7fe1491c8740 1 -- start start 2023-11-04T01:41:30.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.122+0000 7fe1491c8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab982f2850 0x55ab982c5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.122+0000 7fe1491c8740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab982f2c30 0x55ab982f55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.122+0000 7fe1491c8740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ab982c5c90 0x55ab982f5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.122+0000 7fe1491c8740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab981d6740 con 0x55ab982f2c30 2023-11-04T01:41:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.122+0000 7fe1491c8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab982388d0 con 0x55ab982f2850 2023-11-04T01:41:30.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.122+0000 7fe1491c8740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ab98235fc0 con 0x55ab982c5c90 2023-11-04T01:41:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.122+0000 7fe13f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab982f2c30 0x55ab982f55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.122+0000 7fe13f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab982f2c30 0x55ab982f55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43654/0 (socket says 172.21.15.77:43654) 2023-11-04T01:41:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.122+0000 7fe13ffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab982f2850 0x55ab982c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.122+0000 7fe13f7fe640 1 -- 172.21.15.77:0/216875426 learned_addr learned my addr 172.21.15.77:0/216875426 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.122+0000 7fe144afb640 1 --2- 172.21.15.77:0/216875426 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ab982c5c90 0x55ab982f5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.122+0000 7fe13f7fe640 1 -- 172.21.15.77:0/216875426 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ab982c5c90 msgr2=0x55ab982f5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:30.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.122+0000 7fe13f7fe640 1 --2- 172.21.15.77:0/216875426 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ab982c5c90 0x55ab982f5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.122+0000 7fe13f7fe640 1 -- 172.21.15.77:0/216875426 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab982f2850 msgr2=0x55ab982c5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:30.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.122+0000 7fe13f7fe640 1 --2- 172.21.15.77:0/216875426 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab982f2850 0x55ab982c5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.122+0000 7fe13f7fe640 1 -- 172.21.15.77:0/216875426 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab981f4ca0 con 0x55ab982f2c30 2023-11-04T01:41:30.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.122+0000 7fe13ffff640 1 --2- 172.21.15.77:0/216875426 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab982f2850 0x55ab982c5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:41:30.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.122+0000 7fe13f7fe640 1 --2- 172.21.15.77:0/216875426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab982f2c30 0x55ab982f55e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe1340765e0 tx=0x7fe134031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af573f09547cd64b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:30.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.122+0000 7fe125ffb640 1 -- 172.21.15.77:0/216875426 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe134082330 con 0x55ab982f2c30 2023-11-04T01:41:30.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.122+0000 7fe125ffb640 1 -- 172.21.15.77:0/216875426 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe134078220 con 0x55ab982f2c30 2023-11-04T01:41:30.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.122+0000 7fe125ffb640 1 -- 172.21.15.77:0/216875426 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13403ad80 con 0x55ab982f2c30 2023-11-04T01:41:30.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.123+0000 7fe1491c8740 1 -- 172.21.15.77:0/216875426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab982f2c30 msgr2=0x55ab982f55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.123+0000 7fe1491c8740 1 --2- 172.21.15.77:0/216875426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab982f2c30 0x55ab982f55e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe1340765e0 tx=0x7fe134031000 comp rx=0 tx=0).stop 2023-11-04T01:41:30.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.123+0000 7fe1491c8740 1 -- 172.21.15.77:0/216875426 shutdown_connections 2023-11-04T01:41:30.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.123+0000 7fe1491c8740 1 --2- 172.21.15.77:0/216875426 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ab982c5c90 0x55ab982f5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.123+0000 7fe1491c8740 1 --2- 172.21.15.77:0/216875426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab982f2c30 0x55ab982f55e0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.123+0000 7fe1491c8740 1 --2- 172.21.15.77:0/216875426 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab982f2850 0x55ab982c5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.123+0000 7fe1491c8740 1 -- 172.21.15.77:0/216875426 >> 172.21.15.77:0/216875426 conn(0x55ab982c7a60 msgr2=0x55ab983105e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:30.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.123+0000 7fe1491c8740 1 -- 172.21.15.77:0/216875426 shutdown_connections 2023-11-04T01:41:30.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.123+0000 7fe1491c8740 1 -- 172.21.15.77:0/216875426 wait complete. 2023-11-04T01:41:30.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.124+0000 7fe1491c8740 1 -- start start 2023-11-04T01:41:30.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.124+0000 7fe1491c8740 1 Processor -- start 2023-11-04T01:41:30.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.125+0000 7fe1491c8740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ab982f2850 0x55ab982e3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.125+0000 7fe1491c8740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab982f2c30 0x55ab9830ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.125+0000 7fe1491c8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab982e44d0 0x55ab982f7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.125+0000 7fe1491c8740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab982318b0 con 0x55ab982f2c30 2023-11-04T01:41:30.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.125+0000 7fe1491c8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab981ebc80 con 0x55ab982e44d0 2023-11-04T01:41:30.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.125+0000 7fe1491c8740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ab981eb920 con 0x55ab982f2850 2023-11-04T01:41:30.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.125+0000 7fe1491c8740 10 client.0 _ll_register_callbacks cb 0x55ab97f43ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:41:30.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.125+0000 7fe13f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab982f2c30 0x55ab9830ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.125+0000 7fe13f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab982f2c30 0x55ab9830ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43662/0 (socket says 172.21.15.77:43662) 2023-11-04T01:41:30.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.125+0000 7fe13f7fe640 1 -- 172.21.15.77:0/525993837 learned_addr learned my addr 172.21.15.77:0/525993837 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:30.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.125+0000 7fe13ffff640 1 --2- 172.21.15.77:0/525993837 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ab982f2850 0x55ab982e3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.125+0000 7fe144afb640 1 --2- 172.21.15.77:0/525993837 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab982e44d0 0x55ab982f7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.125+0000 7fe13f7fe640 1 -- 172.21.15.77:0/525993837 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ab982f2850 msgr2=0x55ab982e3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:30.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.125+0000 7fe13f7fe640 1 --2- 172.21.15.77:0/525993837 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ab982f2850 0x55ab982e3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.125+0000 7fe13f7fe640 1 -- 172.21.15.77:0/525993837 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab982e44d0 msgr2=0x55ab982f7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:30.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.125+0000 7fe13f7fe640 1 --2- 172.21.15.77:0/525993837 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab982e44d0 0x55ab982f7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.125+0000 7fe13f7fe640 1 -- 172.21.15.77:0/525993837 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe140151970 con 0x55ab982f2c30 2023-11-04T01:41:30.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.125+0000 7fe13f7fe640 1 --2- 172.21.15.77:0/525993837 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab982f2c30 0x55ab9830ad60 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fe1340a9720 tx=0x7fe134040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0e3e702411ad774 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:30.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.125+0000 7fe11effd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:41:30.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.125+0000 7fe11effd640 1 -- 172.21.15.77:0/525993837 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe134082330 con 0x55ab982f2c30 2023-11-04T01:41:30.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.125+0000 7fe11effd640 1 -- 172.21.15.77:0/525993837 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe134083d70 con 0x55ab982f2c30 2023-11-04T01:41:30.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.125+0000 7fe1491c8740 1 -- 172.21.15.77:0/525993837 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ab981ddbf0 con 0x55ab982f2c30 2023-11-04T01:41:30.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.125+0000 7fe11effd640 1 -- 172.21.15.77:0/525993837 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1340767f0 con 0x55ab982f2c30 2023-11-04T01:41:30.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.125+0000 7fe1491c8740 10 client.5697 fetch_fsmap learned FSMap version 16 2023-11-04T01:41:30.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.125+0000 7fe1491c8740 1 -- 172.21.15.77:0/525993837 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55ab9822ff30 con 0x55ab982f2c30 2023-11-04T01:41:30.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.126+0000 7fe11effd640 1 -- 172.21.15.77:0/525993837 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ab981ddbf0 con 0x55ab982f2c30 2023-11-04T01:41:30.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.126+0000 7fe11effd640 1 -- 172.21.15.77:0/525993837 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe1340800b0 con 0x55ab982f2c30 2023-11-04T01:41:30.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.126+0000 7fe1491c8740 10 client.5697 fetch_fsmap finished waiting for FSMap version 16 2023-11-04T01:41:30.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.126+0000 7fe1491c8740 10 client.5697 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:41:30.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.126+0000 7fe1491c8740 20 client.5697 populate_metadata read hostname 'smithi077' 2023-11-04T01:41:30.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.126+0000 7fe1491c8740 1 --2- 172.21.15.77:0/525993837 >> [v2:172.21.15.122:6835/3085479427,v1:172.21.15.122:6837/3085479427] conn(0x55ab98309e50 0x55ab9832e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.126+0000 7fe1491c8740 4 client.5697 mds_command: new command op to 34826 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:41:30.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.126+0000 7fe1491c8740 1 -- 172.21.15.77:0/525993837 --> [v2:172.21.15.122:6835/3085479427,v1:172.21.15.122:6837/3085479427] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ab9822a890 con 0x55ab98309e50 2023-11-04T01:41:30.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.126+0000 7fe13ffff640 1 --2- 172.21.15.77:0/525993837 >> [v2:172.21.15.122:6835/3085479427,v1:172.21.15.122:6837/3085479427] conn(0x55ab98309e50 0x55ab9832e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.126+0000 7fe13ffff640 1 --2- 172.21.15.77:0/525993837 >> [v2:172.21.15.122:6835/3085479427,v1:172.21.15.122:6837/3085479427] conn(0x55ab98309e50 0x55ab9832e1c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8f96a1379635ea7 server_cookie=a3a3865bfb089fa3 in_seq=0 out_seq=0 2023-11-04T01:41:30.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.126+0000 7fe11effd640 10 client.5697 ms_handle_connect on v2:172.21.15.122:6835/3085479427 2023-11-04T01:41:30.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.127+0000 7fe11effd640 1 -- 172.21.15.77:0/525993837 <== mds.0 v2:172.21.15.122:6835/3085479427 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ab9822a890 con 0x55ab98309e50 2023-11-04T01:41:30.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.127+0000 7fe11effd640 10 client.5697 handle_command_reply: tid=0 2023-11-04T01:41:30.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.127+0000 7fe1491c8740 1 client.5697 shutdown 2023-11-04T01:41:30.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.127+0000 7fe1491c8740 1 -- 172.21.15.77:0/525993837 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab982f2c30 msgr2=0x55ab9830ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.127+0000 7fe1491c8740 1 --2- 172.21.15.77:0/525993837 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab982f2c30 0x55ab9830ad60 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fe1340a9720 tx=0x7fe134040000 comp rx=0 tx=0).stop 2023-11-04T01:41:30.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.127+0000 7fe1491c8740 1 -- 172.21.15.77:0/525993837 shutdown_connections 2023-11-04T01:41:30.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.127+0000 7fe1491c8740 1 --2- 172.21.15.77:0/525993837 >> [v2:172.21.15.122:6835/3085479427,v1:172.21.15.122:6837/3085479427] conn(0x55ab98309e50 0x55ab9832e1c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.127+0000 7fe1491c8740 1 --2- 172.21.15.77:0/525993837 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab982e44d0 0x55ab982f7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.127+0000 7fe1491c8740 1 --2- 172.21.15.77:0/525993837 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab982f2c30 0x55ab9830ad60 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.127+0000 7fe11effd640 0 client.5697 ms_handle_reset on v2:172.21.15.122:6835/3085479427 2023-11-04T01:41:30.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.127+0000 7fe1491c8740 1 --2- 172.21.15.77:0/525993837 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ab982f2850 0x55ab982e3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.127+0000 7fe1491c8740 1 -- 172.21.15.77:0/525993837 >> 172.21.15.77:0/525993837 conn(0x55ab982c5c90 msgr2=0x55ab982c9800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:30.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.127+0000 7fe1491c8740 1 -- 172.21.15.77:0/525993837 shutdown_connections 2023-11-04T01:41:30.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.127+0000 7fe1491c8740 1 -- 172.21.15.77:0/525993837 wait complete. 2023-11-04T01:41:30.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.128+0000 7fe1491c8740 20 client.5697 trim_cache size 0 max 16384 2023-11-04T01:41:30.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.143+0000 7fe1491c8740 1 Processor -- start 2023-11-04T01:41:30.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.143+0000 7fe1491c8740 1 -- start start 2023-11-04T01:41:30.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.144+0000 7fe1491c8740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ab982e44d0 0x55ab9830bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.144+0000 7fe1491c8740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab982f2850 0x55ab9830c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.144+0000 7fe1491c8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab982f2c30 0x55ab982f65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.144+0000 7fe1491c8740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab981b1280 con 0x55ab982f2850 2023-11-04T01:41:30.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.144+0000 7fe1491c8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab982f6160 con 0x55ab982f2c30 2023-11-04T01:41:30.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.144+0000 7fe1491c8740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ab982f5b40 con 0x55ab982e44d0 2023-11-04T01:41:30.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.144+0000 7fe13f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab982f2850 0x55ab9830c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.144+0000 7fe13f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab982f2850 0x55ab9830c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43664/0 (socket says 172.21.15.77:43664) 2023-11-04T01:41:30.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.144+0000 7fe13f7fe640 1 -- 172.21.15.77:0/1886647910 learned_addr learned my addr 172.21.15.77:0/1886647910 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:30.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.144+0000 7fe13ffff640 1 --2- 172.21.15.77:0/1886647910 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ab982e44d0 0x55ab9830bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.144+0000 7fe144afb640 1 --2- 172.21.15.77:0/1886647910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab982f2c30 0x55ab982f65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.144+0000 7fe13f7fe640 1 -- 172.21.15.77:0/1886647910 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ab982e44d0 msgr2=0x55ab9830bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:30.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.144+0000 7fe13f7fe640 1 --2- 172.21.15.77:0/1886647910 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ab982e44d0 0x55ab9830bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.144+0000 7fe13f7fe640 1 -- 172.21.15.77:0/1886647910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab982f2c30 msgr2=0x55ab982f65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:30.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.144+0000 7fe13f7fe640 1 --2- 172.21.15.77:0/1886647910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab982f2c30 0x55ab982f65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.144+0000 7fe13f7fe640 1 -- 172.21.15.77:0/1886647910 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab981cdd10 con 0x55ab982f2850 2023-11-04T01:41:30.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.144+0000 7fe144afb640 1 --2- 172.21.15.77:0/1886647910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab982f2c30 0x55ab982f65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:30.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.144+0000 7fe13f7fe640 1 --2- 172.21.15.77:0/1886647910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab982f2850 0x55ab9830c080 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fe13407a070 tx=0x7fe13408e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43b80f3342fcc9cd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:30.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.145+0000 7fe1267fc640 1 -- 172.21.15.77:0/1886647910 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13402d040 con 0x55ab982f2850 2023-11-04T01:41:30.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.145+0000 7fe1267fc640 1 -- 172.21.15.77:0/1886647910 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe134079c20 con 0x55ab982f2850 2023-11-04T01:41:30.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.145+0000 7fe1267fc640 1 -- 172.21.15.77:0/1886647910 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe134082330 con 0x55ab982f2850 2023-11-04T01:41:30.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.145+0000 7fe1491c8740 1 -- 172.21.15.77:0/1886647910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab982f2850 msgr2=0x55ab9830c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.145+0000 7fe1491c8740 1 --2- 172.21.15.77:0/1886647910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab982f2850 0x55ab9830c080 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fe13407a070 tx=0x7fe13408e000 comp rx=0 tx=0).stop 2023-11-04T01:41:30.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.145+0000 7fe1491c8740 1 -- 172.21.15.77:0/1886647910 shutdown_connections 2023-11-04T01:41:30.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.145+0000 7fe1491c8740 1 --2- 172.21.15.77:0/1886647910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab982f2c30 0x55ab982f65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.145+0000 7fe1491c8740 1 --2- 172.21.15.77:0/1886647910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab982f2850 0x55ab9830c080 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.145+0000 7fe1491c8740 1 --2- 172.21.15.77:0/1886647910 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ab982e44d0 0x55ab9830bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.145+0000 7fe1491c8740 1 -- 172.21.15.77:0/1886647910 >> 172.21.15.77:0/1886647910 conn(0x55ab982c5c90 msgr2=0x55ab9830a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:30.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.145+0000 7fe1491c8740 1 -- 172.21.15.77:0/1886647910 shutdown_connections 2023-11-04T01:41:30.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.145+0000 7fe1491c8740 1 -- 172.21.15.77:0/1886647910 wait complete. 2023-11-04T01:41:30.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.146+0000 7fe1491c8740 1 -- start start 2023-11-04T01:41:30.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.146+0000 7fe1491c8740 1 Processor -- start 2023-11-04T01:41:30.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.147+0000 7fe1491c8740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab982e44d0 0x55ab9836aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.147+0000 7fe1491c8740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ab982f2850 0x55ab982c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.147+0000 7fe1491c8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab982f2c30 0x55ab9832eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.147+0000 7fe1491c8740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab9836b010 con 0x55ab982e44d0 2023-11-04T01:41:30.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.147+0000 7fe1491c8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab9832f7a0 con 0x55ab982f2c30 2023-11-04T01:41:30.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.147+0000 7fe1491c8740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ab9836e700 con 0x55ab982f2850 2023-11-04T01:41:30.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.147+0000 7fe1491c8740 10 client.0 _ll_register_callbacks cb 0x7fe138001540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:41:30.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.147+0000 7fe13ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab982e44d0 0x55ab9836aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.147+0000 7fe13ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab982e44d0 0x55ab9836aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43678/0 (socket says 172.21.15.77:43678) 2023-11-04T01:41:30.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.147+0000 7fe13ffff640 1 -- 172.21.15.77:0/3419819414 learned_addr learned my addr 172.21.15.77:0/3419819414 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:30.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.147+0000 7fe144afb640 1 --2- 172.21.15.77:0/3419819414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab982f2c30 0x55ab9832eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.147+0000 7fe13f7fe640 1 --2- 172.21.15.77:0/3419819414 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ab982f2850 0x55ab982c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.147+0000 7fe13ffff640 1 -- 172.21.15.77:0/3419819414 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ab982f2850 msgr2=0x55ab982c92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:30.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.147+0000 7fe13ffff640 1 --2- 172.21.15.77:0/3419819414 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ab982f2850 0x55ab982c92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.147+0000 7fe13ffff640 1 -- 172.21.15.77:0/3419819414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab982f2c30 msgr2=0x55ab9832eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:30.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.147+0000 7fe13ffff640 1 --2- 172.21.15.77:0/3419819414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab982f2c30 0x55ab9832eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.147+0000 7fe13ffff640 1 -- 172.21.15.77:0/3419819414 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ab9822ff30 con 0x55ab982e44d0 2023-11-04T01:41:30.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.147+0000 7fe144afb640 1 --2- 172.21.15.77:0/3419819414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab982f2c30 0x55ab9832eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:41:30.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.147+0000 7fe13ffff640 1 --2- 172.21.15.77:0/3419819414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab982e44d0 0x55ab9836aad0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x55ab981ebd60 tx=0x7fe130004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd82fcc34f69aa7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:30.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.147+0000 7fe11effd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:41:30.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.147+0000 7fe11effd640 1 -- 172.21.15.77:0/3419819414 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13002a610 con 0x55ab982e44d0 2023-11-04T01:41:30.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.147+0000 7fe11effd640 1 -- 172.21.15.77:0/3419819414 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe130030070 con 0x55ab982e44d0 2023-11-04T01:41:30.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.147+0000 7fe1491c8740 1 -- 172.21.15.77:0/3419819414 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ab982f9b90 con 0x55ab982e44d0 2023-11-04T01:41:30.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.148+0000 7fe11effd640 1 -- 172.21.15.77:0/3419819414 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe13002a770 con 0x55ab982e44d0 2023-11-04T01:41:30.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.148+0000 7fe1491c8740 10 client.5703 fetch_fsmap learned FSMap version 16 2023-11-04T01:41:30.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.148+0000 7fe1491c8740 1 -- 172.21.15.77:0/3419819414 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55ab981f3500 con 0x55ab982e44d0 2023-11-04T01:41:30.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.148+0000 7fe11effd640 1 -- 172.21.15.77:0/3419819414 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ab982f9b90 con 0x55ab982e44d0 2023-11-04T01:41:30.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.148+0000 7fe11effd640 1 -- 172.21.15.77:0/3419819414 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe130014780 con 0x55ab982e44d0 2023-11-04T01:41:30.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.148+0000 7fe1491c8740 10 client.5703 fetch_fsmap finished waiting for FSMap version 16 2023-11-04T01:41:30.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.148+0000 7fe1491c8740 10 client.5703 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:41:30.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.148+0000 7fe1491c8740 20 client.5703 populate_metadata read hostname 'smithi077' 2023-11-04T01:41:30.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.148+0000 7fe1491c8740 1 --2- 172.21.15.77:0/3419819414 >> [v2:172.21.15.122:6835/3085479427,v1:172.21.15.122:6837/3085479427] conn(0x55ab9830bdc0 0x55ab982f6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.148+0000 7fe1491c8740 4 client.5703 mds_command: new command op to 34826 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:41:30.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.148+0000 7fe1491c8740 1 -- 172.21.15.77:0/3419819414 --> [v2:172.21.15.122:6835/3085479427,v1:172.21.15.122:6837/3085479427] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fe134078220 con 0x55ab9830bdc0 2023-11-04T01:41:30.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.148+0000 7fe13f7fe640 1 --2- 172.21.15.77:0/3419819414 >> [v2:172.21.15.122:6835/3085479427,v1:172.21.15.122:6837/3085479427] conn(0x55ab9830bdc0 0x55ab982f6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.148+0000 7fe13f7fe640 1 --2- 172.21.15.77:0/3419819414 >> [v2:172.21.15.122:6835/3085479427,v1:172.21.15.122:6837/3085479427] conn(0x55ab9830bdc0 0x55ab982f6160 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ad0e718a6a5fbfb server_cookie=1e2adceb2770bf2c in_seq=0 out_seq=0 2023-11-04T01:41:30.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.148+0000 7fe11effd640 10 client.5703 ms_handle_connect on v2:172.21.15.122:6835/3085479427 2023-11-04T01:41:30.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.149+0000 7fe11effd640 1 -- 172.21.15.77:0/3419819414 <== mds.0 v2:172.21.15.122:6835/3085479427 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x7fe134078220 con 0x55ab9830bdc0 2023-11-04T01:41:30.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.149+0000 7fe11effd640 10 client.5703 handle_command_reply: tid=0 2023-11-04T01:41:30.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.149+0000 7fe1491c8740 1 client.5703 shutdown 2023-11-04T01:41:30.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.149+0000 7fe1491c8740 1 -- 172.21.15.77:0/3419819414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab982e44d0 msgr2=0x55ab9836aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.149+0000 7fe1491c8740 1 --2- 172.21.15.77:0/3419819414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab982e44d0 0x55ab9836aad0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x55ab981ebd60 tx=0x7fe130004730 comp rx=0 tx=0).stop 2023-11-04T01:41:30.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.149+0000 7fe1491c8740 1 -- 172.21.15.77:0/3419819414 shutdown_connections 2023-11-04T01:41:30.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.149+0000 7fe1491c8740 1 --2- 172.21.15.77:0/3419819414 >> [v2:172.21.15.122:6835/3085479427,v1:172.21.15.122:6837/3085479427] conn(0x55ab9830bdc0 0x55ab982f6160 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.149+0000 7fe1491c8740 1 --2- 172.21.15.77:0/3419819414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ab982f2c30 0x55ab9832eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.149+0000 7fe1491c8740 1 --2- 172.21.15.77:0/3419819414 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55ab982f2850 0x55ab982c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.149+0000 7fe1491c8740 1 --2- 172.21.15.77:0/3419819414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ab982e44d0 0x55ab9836aad0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.149+0000 7fe11effd640 0 client.5703 ms_handle_reset on v2:172.21.15.122:6835/3085479427 2023-11-04T01:41:30.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.149+0000 7fe1491c8740 1 -- 172.21.15.77:0/3419819414 >> 172.21.15.77:0/3419819414 conn(0x55ab982c5c90 msgr2=0x55ab982f7550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:30.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.149+0000 7fe1491c8740 1 -- 172.21.15.77:0/3419819414 shutdown_connections 2023-11-04T01:41:30.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.149+0000 7fe1491c8740 1 -- 172.21.15.77:0/3419819414 wait complete. 2023-11-04T01:41:30.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.149+0000 7fe1491c8740 20 client.5703 trim_cache size 0 max 16384 2023-11-04T01:41:30.180 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-04T01:41:30.181 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "0c22c75d-0169-41ef-b663-6ac1c5b0f71f", 2023-11-04T01:41:30.181 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 0, 2023-11-04T01:41:30.181 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 34826, 2023-11-04T01:41:30.181 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2023-11-04T01:41:30.181 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2023-11-04T01:41:30.182 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2023-11-04T01:41:30.182 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 4.5613842150000004, 2023-11-04T01:41:30.182 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 16, 2023-11-04T01:41:30.182 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 38, 2023-11-04T01:41:30.182 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 38, 2023-11-04T01:41:30.183 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 11.969589825 2023-11-04T01:41:30.183 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-04T01:41:30.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.149+0000 7fe14655e640 1 -- 172.21.15.77:0/2801723891 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe12c06ae70 msgr2=0x7fe12c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.149+0000 7fe14655e640 1 --2- 172.21.15.77:0/2801723891 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe12c06ae70 0x7fe12c06d330 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe130006ca0 tx=0x7fe130009240 comp rx=0 tx=0).stop 2023-11-04T01:41:30.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.149+0000 7fe14655e640 1 -- 172.21.15.77:0/2801723891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1400cd3b0 msgr2=0x7fe1400c6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.149+0000 7fe14655e640 1 --2- 172.21.15.77:0/2801723891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1400cd3b0 0x7fe1400c6e90 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fe13402bee0 tx=0x7fe1340046c0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.150+0000 7fe14655e640 1 -- 172.21.15.77:0/2801723891 shutdown_connections 2023-11-04T01:41:30.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.150+0000 7fe14655e640 1 --2- 172.21.15.77:0/2801723891 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe12c06ae70 0x7fe12c06d330 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.150+0000 7fe14655e640 1 --2- 172.21.15.77:0/2801723891 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe14015af20 0x7fe140150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.150+0000 7fe14655e640 1 --2- 172.21.15.77:0/2801723891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1400cd3b0 0x7fe1400c6e90 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.150+0000 7fe14655e640 1 --2- 172.21.15.77:0/2801723891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1400b64c0 0x7fe140153470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.150+0000 7fe14655e640 1 -- 172.21.15.77:0/2801723891 >> 172.21.15.77:0/2801723891 conn(0x7fe14006ea20 msgr2=0x7fe1400cd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:30.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.150+0000 7fe14655e640 1 -- 172.21.15.77:0/2801723891 shutdown_connections 2023-11-04T01:41:30.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.150+0000 7fe14655e640 1 -- 172.21.15.77:0/2801723891 wait complete. 2023-11-04T01:41:30.187 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:41:30.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.323+0000 7f7672c90640 1 Processor -- start 2023-11-04T01:41:30.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.323+0000 7f7672c90640 1 -- start start 2023-11-04T01:41:30.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.324+0000 7f7672c90640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f766c0cde60 0x7f766c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.324+0000 7f7672c90640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f766c15daa0 0x7f766c157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.324+0000 7f7672c90640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f766c15e000 con 0x7f766c0ce240 2023-11-04T01:41:30.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.324+0000 7f7672c90640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f766c15e5c0 con 0x7f766c0cde60 2023-11-04T01:41:30.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.324+0000 7f7672c90640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f766c15e2e0 con 0x7f766c15daa0 2023-11-04T01:41:30.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.324+0000 7f7670a2c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f766c0cde60 0x7f766c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.324+0000 7f7670a2c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f766c0cde60 0x7f766c15d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43694/0 (socket says 172.21.15.77:43694) 2023-11-04T01:41:30.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.324+0000 7f7670a2c640 1 -- 172.21.15.77:0/870302081 learned_addr learned my addr 172.21.15.77:0/870302081 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:30.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.324+0000 7f766bfff640 1 --2- 172.21.15.77:0/870302081 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f766c15daa0 0x7f766c157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.324+0000 7f7670a2c640 1 -- 172.21.15.77:0/870302081 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f766c15daa0 msgr2=0x7f766c157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:30.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.324+0000 7f7670a2c640 1 --2- 172.21.15.77:0/870302081 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f766c15daa0 0x7f766c157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.324+0000 7f7670a2c640 1 -- 172.21.15.77:0/870302081 >> v1:172.21.15.122:6789/0 conn(0x7f766c0ce240 legacy=0x7f766c06b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.324+0000 7f7670a2c640 1 -- 172.21.15.77:0/870302081 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766c0d1120 con 0x7f766c0cde60 2023-11-04T01:41:30.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.325+0000 7f7670a2c640 1 --2- 172.21.15.77:0/870302081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f766c0cde60 0x7f766c15d560 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f7660009870 tx=0x7f766002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fc2159d3f2ba352 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:30.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.325+0000 7f766b7fe640 1 -- 172.21.15.77:0/870302081 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7660030840 con 0x7f766c0cde60 2023-11-04T01:41:30.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.325+0000 7f766b7fe640 1 -- 172.21.15.77:0/870302081 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76600309a0 con 0x7f766c0cde60 2023-11-04T01:41:30.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.325+0000 7f766b7fe640 1 -- 172.21.15.77:0/870302081 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7660030d30 con 0x7f766c0cde60 2023-11-04T01:41:30.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.325+0000 7f7672c90640 1 -- 172.21.15.77:0/870302081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f766c0cde60 msgr2=0x7f766c15d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.325+0000 7f7672c90640 1 --2- 172.21.15.77:0/870302081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f766c0cde60 0x7f766c15d560 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f7660009870 tx=0x7f766002b980 comp rx=0 tx=0).stop 2023-11-04T01:41:30.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.326+0000 7f7672c90640 1 -- 172.21.15.77:0/870302081 shutdown_connections 2023-11-04T01:41:30.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.326+0000 7f7672c90640 1 --2- 172.21.15.77:0/870302081 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f766c15daa0 0x7f766c157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.326+0000 7f7672c90640 1 --2- 172.21.15.77:0/870302081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f766c0cde60 0x7f766c15d560 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.326+0000 7f7672c90640 1 -- 172.21.15.77:0/870302081 >> 172.21.15.77:0/870302081 conn(0x7f766c071f30 msgr2=0x7f766c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:30.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.326+0000 7f7672c90640 1 -- 172.21.15.77:0/870302081 shutdown_connections 2023-11-04T01:41:30.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.326+0000 7f7672c90640 1 -- 172.21.15.77:0/870302081 wait complete. 2023-11-04T01:41:30.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.327+0000 7f7672c90640 1 Processor -- start 2023-11-04T01:41:30.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.327+0000 7f7672c90640 1 -- start start 2023-11-04T01:41:30.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.328+0000 7f7672c90640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f766c0cde60 0x7f766c1f2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.328+0000 7f7672c90640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f766c0ce240 0x7f766c1f1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.328+0000 7f7672c90640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f766c15daa0 0x7f766c1f5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.328+0000 7f7672c90640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766c1f65c0 con 0x7f766c0ce240 2023-11-04T01:41:30.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.328+0000 7f7672c90640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766c1f68a0 con 0x7f766c15daa0 2023-11-04T01:41:30.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.328+0000 7f7672c90640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f766c1f2770 con 0x7f766c0cde60 2023-11-04T01:41:30.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.328+0000 7f766bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f766c0ce240 0x7f766c1f1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.328+0000 7f766bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f766c0ce240 0x7f766c1f1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43696/0 (socket says 172.21.15.77:43696) 2023-11-04T01:41:30.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.328+0000 7f766bfff640 1 -- 172.21.15.77:0/3886520776 learned_addr learned my addr 172.21.15.77:0/3886520776 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:30.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.328+0000 7f7670a2c640 1 --2- 172.21.15.77:0/3886520776 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f766c0cde60 0x7f766c1f2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.328+0000 7f767122d640 1 --2- 172.21.15.77:0/3886520776 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f766c15daa0 0x7f766c1f5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.328+0000 7f766bfff640 1 -- 172.21.15.77:0/3886520776 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f766c0cde60 msgr2=0x7f766c1f2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.328+0000 7f766bfff640 1 --2- 172.21.15.77:0/3886520776 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f766c0cde60 0x7f766c1f2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.328+0000 7f766bfff640 1 -- 172.21.15.77:0/3886520776 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f766c15daa0 msgr2=0x7f766c1f5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.328+0000 7f766bfff640 1 --2- 172.21.15.77:0/3886520776 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f766c15daa0 0x7f766c1f5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.328+0000 7f766bfff640 1 -- 172.21.15.77:0/3886520776 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76600094d0 con 0x7f766c0ce240 2023-11-04T01:41:30.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.328+0000 7f767122d640 1 --2- 172.21.15.77:0/3886520776 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f766c15daa0 0x7f766c1f5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:30.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.328+0000 7f7670a2c640 1 --2- 172.21.15.77:0/3886520776 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f766c0cde60 0x7f766c1f2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:30.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.328+0000 7f766bfff640 1 --2- 172.21.15.77:0/3886520776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f766c0ce240 0x7f766c1f1e70 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f765800e870 tx=0x7f765800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:30.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.328+0000 7f76697fa640 1 -- 172.21.15.77:0/3886520776 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76580094f0 con 0x7f766c0ce240 2023-11-04T01:41:30.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.328+0000 7f76697fa640 1 -- 172.21.15.77:0/3886520776 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765800c940 con 0x7f766c0ce240 2023-11-04T01:41:30.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.328+0000 7f76697fa640 1 -- 172.21.15.77:0/3886520776 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765800ccf0 con 0x7f766c0ce240 2023-11-04T01:41:30.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.328+0000 7f7672c90640 1 -- 172.21.15.77:0/3886520776 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f766c1f2a50 con 0x7f766c0ce240 2023-11-04T01:41:30.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.328+0000 7f7672c90640 1 -- 172.21.15.77:0/3886520776 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f766c15c6e0 con 0x7f766c0ce240 2023-11-04T01:41:30.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.329+0000 7f7672c90640 1 -- 172.21.15.77:0/3886520776 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f766c1f6ac0 con 0x7f766c0ce240 2023-11-04T01:41:30.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.330+0000 7f76697fa640 1 -- 172.21.15.77:0/3886520776 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7658013470 con 0x7f766c0ce240 2023-11-04T01:41:30.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.330+0000 7f76697fa640 1 --2- 172.21.15.77:0/3886520776 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f765006aea0 0x7f765006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:30.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.330+0000 7f76697fa640 1 -- 172.21.15.77:0/3886520776 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7658089770 con 0x7f766c0ce240 2023-11-04T01:41:30.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.331+0000 7f7670a2c640 1 --2- 172.21.15.77:0/3886520776 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f765006aea0 0x7f765006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:30.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.331+0000 7f7670a2c640 1 --2- 172.21.15.77:0/3886520776 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f765006aea0 0x7f765006d360 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7660036000 tx=0x7f766003b040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:30.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.335+0000 7f76697fa640 1 -- 172.21.15.77:0/3886520776 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7658054770 con 0x7f766c0ce240 2023-11-04T01:41:30.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.540+0000 7f7672c90640 1 -- 172.21.15.77:0/3886520776 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f766c074290 con 0x7f766c0ce240 2023-11-04T01:41:30.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.540+0000 7f76697fa640 1 -- 172.21.15.77:0/3886520776 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7658057d90 con 0x7f766c0ce240 2023-11-04T01:41:30.543 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:41:30.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.542+0000 7f7672c90640 1 -- 172.21.15.77:0/3886520776 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f765006aea0 msgr2=0x7f765006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.542+0000 7f7672c90640 1 --2- 172.21.15.77:0/3886520776 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f765006aea0 0x7f765006d360 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7660036000 tx=0x7f766003b040 comp rx=0 tx=0).stop 2023-11-04T01:41:30.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.542+0000 7f7672c90640 1 -- 172.21.15.77:0/3886520776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f766c0ce240 msgr2=0x7f766c1f1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:30.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.542+0000 7f7672c90640 1 --2- 172.21.15.77:0/3886520776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f766c0ce240 0x7f766c1f1e70 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f765800e870 tx=0x7f765800ed30 comp rx=0 tx=0).stop 2023-11-04T01:41:30.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.542+0000 7f7672c90640 1 -- 172.21.15.77:0/3886520776 shutdown_connections 2023-11-04T01:41:30.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.542+0000 7f7672c90640 1 --2- 172.21.15.77:0/3886520776 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f765006aea0 0x7f765006d360 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.542+0000 7f7672c90640 1 --2- 172.21.15.77:0/3886520776 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f766c15daa0 0x7f766c1f5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.542+0000 7f7672c90640 1 --2- 172.21.15.77:0/3886520776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f766c0ce240 0x7f766c1f1e70 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.542+0000 7f7672c90640 1 --2- 172.21.15.77:0/3886520776 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f766c0cde60 0x7f766c1f2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:30.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.542+0000 7f7672c90640 1 -- 172.21.15.77:0/3886520776 >> 172.21.15.77:0/3886520776 conn(0x7f766c071f30 msgr2=0x7f766c0c6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:30.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.542+0000 7f7672c90640 1 -- 172.21.15.77:0/3886520776 shutdown_connections 2023-11-04T01:41:30.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:30.542+0000 7f7672c90640 1 -- 172.21.15.77:0/3886520776 wait complete. 2023-11-04T01:41:30.554 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:41:30.555 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:41:30.555 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2023-11-04T01:41:30.556 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:41:30.556 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:41:30.556 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:41:30.557 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:41:30.557 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:41:30.557 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:41:30.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:30.558 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2023-11-04T01:41:30.574 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:41:30.574 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:41:30.574 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:41:30.574 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:41:30.575 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2023-11-04T01:41:30.575 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:41:30.575 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:41:30.575 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:41:30.575 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f0 2023-11-04T01:41:30.576 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:41:30.576 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:41:30.576 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f1 2023-11-04T01:41:30.576 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:41:30.576 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:41:30.577 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:41:30.577 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:41:30.578 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:41:30.578 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 42315sec preferred_lft 42315sec 2023-11-04T01:41:30.578 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::ec4:7aff:fe8f:d3d3/64 scope link 2023-11-04T01:41:30.578 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:41:30.579 INFO:teuthology.orchestra.run.smithi077.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:41:30.579 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 06:3a:02:11:c4:57 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:41:30.579 INFO:teuthology.orchestra.run.smithi077.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:41:30.579 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:41:30.579 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::8039:1aff:fee2:109f/64 scope link 2023-11-04T01:41:30.580 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:41:30.580 INFO:teuthology.orchestra.run.smithi077.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:41:30.580 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 06:3a:02:11:c4:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:41:30.580 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::43a:2ff:fe11:c457/64 scope link 2023-11-04T01:41:30.580 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:41:30.581 INFO:teuthology.orchestra.run.smithi077.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:41:30.581 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether c2:4f:2a:69:4f:38 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:41:30.581 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::c04f:2aff:fe69:4f38/64 scope link 2023-11-04T01:41:30.581 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:41:30.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:30.582 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:41:30.640 INFO:teuthology.orchestra.run.smithi077.stdout:1 2023-11-04T01:41:30.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:30.641 DEBUG:teuthology.orchestra.run.smithi077:> route 2023-11-04T01:41:30.697 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2023-11-04T01:41:30.697 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:41:30.697 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:41:30.698 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:41:30.698 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:41:30.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:30.699 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-11-04T01:41:30.699 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-11-04T01:41:30.700 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:41:30.700 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:41:30.700 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:41:30.701 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-11-04T01:41:30.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:30.794 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2023-11-04T01:41:30.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:41:30.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:41:30.809 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:41:30.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:30.810 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 up 2023-11-04T01:41:30.876 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:41:30.877 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:41:30.877 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:41:30.931 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:41:30.932 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:41:30.932 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:41:30.986 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:41:31.041 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2023-11-04T01:41:31.042 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2023-11-04T01:41:31.042 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2023-11-04T01:41:31.042 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2023-11-04T01:41:31.043 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2023-11-04T01:41:31.043 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2023-11-04T01:41:31.043 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2023-11-04T01:41:31.043 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2023-11-04T01:41:31.043 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2023-11-04T01:41:31.044 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2023-11-04T01:41:31.044 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2023-11-04T01:41:31.044 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2023-11-04T01:41:31.044 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:41:31.044 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2023-11-04T01:41:31.045 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2023-11-04T01:41:31.045 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2023-11-04T01:41:31.045 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2023-11-04T01:41:31.045 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2023-11-04T01:41:31.045 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2023-11-04T01:41:31.046 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:41:31.046 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:41:31.046 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:41:31.046 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:41:31.046 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2023-11-04T01:41:31.047 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2023-11-04T01:41:31.047 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:41:31.047 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:41:31.047 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:41:31.047 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:41:31.047 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2023-11-04T01:41:31.048 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:41:31.048 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:41:31.048 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:41:31.048 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:41:31.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:31.049 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-11-04T01:41:31.097 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:41:31.098 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:41:31.140 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:41:31.156 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2023-11-04T01:41:31.156 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2023-11-04T01:41:31.156 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2023-11-04T01:41:31.157 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2023-11-04T01:41:31.157 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2023-11-04T01:41:31.157 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2023-11-04T01:41:31.157 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2023-11-04T01:41:31.158 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2023-11-04T01:41:31.158 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2023-11-04T01:41:31.158 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2023-11-04T01:41:31.158 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2023-11-04T01:41:31.159 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2023-11-04T01:41:31.159 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:41:31.159 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2023-11-04T01:41:31.160 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2023-11-04T01:41:31.160 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2023-11-04T01:41:31.160 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2023-11-04T01:41:31.160 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2023-11-04T01:41:31.160 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2023-11-04T01:41:31.161 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:41:31.161 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:41:31.161 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:41:31.162 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:41:31.162 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2023-11-04T01:41:31.162 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2023-11-04T01:41:31.162 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:41:31.162 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:41:31.163 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:41:31.163 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:41:31.163 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2023-11-04T01:41:31.163 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:41:31.164 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:41:31.164 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:41:31.164 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:41:31.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:31.165 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-11-04T01:41:31.229 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:2023-11-04T01:41:31.227+0000 7f80bea42480 -1 init, newargv = 0x559da5a1d080 newargc=15 2023-11-04T01:41:31.230 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[135205]: starting ceph client 2023-11-04T01:41:31.234 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[135205]: starting fuse 2023-11-04T01:41:32.312 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:41:32.332 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2023-11-04T01:41:32.333 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2023-11-04T01:41:32.333 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2023-11-04T01:41:32.333 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2023-11-04T01:41:32.333 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2023-11-04T01:41:32.334 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2023-11-04T01:41:32.334 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2023-11-04T01:41:32.334 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2023-11-04T01:41:32.334 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2023-11-04T01:41:32.335 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2023-11-04T01:41:32.335 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2023-11-04T01:41:32.335 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2023-11-04T01:41:32.335 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:41:32.335 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2023-11-04T01:41:32.336 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2023-11-04T01:41:32.336 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2023-11-04T01:41:32.336 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2023-11-04T01:41:32.336 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2023-11-04T01:41:32.337 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2023-11-04T01:41:32.337 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:41:32.337 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:41:32.338 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:41:32.338 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:41:32.338 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2023-11-04T01:41:32.338 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2023-11-04T01:41:32.339 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:41:32.339 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:41:32.339 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:41:32.339 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:41:32.339 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2023-11-04T01:41:32.339 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:41:32.340 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:41:32.340 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:41:32.340 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:41:32.340 INFO:teuthology.orchestra.run.smithi077.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:41:32.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:32.341 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-11-04T01:41:32.391 INFO:teuthology.orchestra.run.smithi077.stdout:42 2023-11-04T01:41:32.391 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-11-04T01:41:32.392 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:41:32.392 DEBUG:teuthology.orchestra.run.smithi077:> import glob 2023-11-04T01:41:32.393 DEBUG:teuthology.orchestra.run.smithi077:> import re 2023-11-04T01:41:32.393 DEBUG:teuthology.orchestra.run.smithi077:> import os 2023-11-04T01:41:32.393 DEBUG:teuthology.orchestra.run.smithi077:> import subprocess 2023-11-04T01:41:32.394 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:41:32.394 DEBUG:teuthology.orchestra.run.smithi077:> def _find_admin_socket(client_name): 2023-11-04T01:41:32.394 DEBUG:teuthology.orchestra.run.smithi077:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:41:32.395 DEBUG:teuthology.orchestra.run.smithi077:> files = glob.glob(asok_path) 2023-11-04T01:41:32.395 DEBUG:teuthology.orchestra.run.smithi077:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:41:32.396 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:41:32.396 DEBUG:teuthology.orchestra.run.smithi077:> # Given a non-glob path, it better be there 2023-11-04T01:41:32.396 DEBUG:teuthology.orchestra.run.smithi077:> if "*" not in asok_path: 2023-11-04T01:41:32.397 DEBUG:teuthology.orchestra.run.smithi077:> assert(len(files) == 1) 2023-11-04T01:41:32.397 DEBUG:teuthology.orchestra.run.smithi077:> return files[0] 2023-11-04T01:41:32.397 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:41:32.398 DEBUG:teuthology.orchestra.run.smithi077:> for f in files: 2023-11-04T01:41:32.398 DEBUG:teuthology.orchestra.run.smithi077:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:41:32.398 DEBUG:teuthology.orchestra.run.smithi077:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:41:32.399 DEBUG:teuthology.orchestra.run.smithi077:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:41:32.399 DEBUG:teuthology.orchestra.run.smithi077:> contents = proc_f.read() 2023-11-04T01:41:32.400 DEBUG:teuthology.orchestra.run.smithi077:> if mountpoint in contents: 2023-11-04T01:41:32.400 DEBUG:teuthology.orchestra.run.smithi077:> return f 2023-11-04T01:41:32.400 DEBUG:teuthology.orchestra.run.smithi077:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:41:32.401 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:41:32.401 DEBUG:teuthology.orchestra.run.smithi077:> print(_find_admin_socket("client.0")) 2023-11-04T01:41:32.401 DEBUG:teuthology.orchestra.run.smithi077:> ' 2023-11-04T01:41:32.518 INFO:teuthology.orchestra.run.smithi077.stdout:/var/run/ceph/ceph-client.0.135205.asok 2023-11-04T01:41:32.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:41:32.529 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.135205.asok 2023-11-04T01:41:32.530 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:41:32.530 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.135205.asok status 2023-11-04T01:41:32.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:41:32.699 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-04T01:41:32.699 INFO:teuthology.orchestra.run.smithi077.stdout: "metadata": { 2023-11-04T01:41:32.699 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:41:32.699 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:41:32.700 INFO:teuthology.orchestra.run.smithi077.stdout: "entity_id": "0", 2023-11-04T01:41:32.700 INFO:teuthology.orchestra.run.smithi077.stdout: "hostname": "smithi077", 2023-11-04T01:41:32.700 INFO:teuthology.orchestra.run.smithi077.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:41:32.700 INFO:teuthology.orchestra.run.smithi077.stdout: "pid": "135205", 2023-11-04T01:41:32.700 INFO:teuthology.orchestra.run.smithi077.stdout: "root": "/" 2023-11-04T01:41:32.701 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:32.701 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_count": 0, 2023-11-04T01:41:32.701 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_pinned_count": 0, 2023-11-04T01:41:32.701 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 5715, 2023-11-04T01:41:32.701 INFO:teuthology.orchestra.run.smithi077.stdout: "inst": { 2023-11-04T01:41:32.702 INFO:teuthology.orchestra.run.smithi077.stdout: "name": { 2023-11-04T01:41:32.702 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "client", 2023-11-04T01:41:32.702 INFO:teuthology.orchestra.run.smithi077.stdout: "num": 5715 2023-11-04T01:41:32.702 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:32.702 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2023-11-04T01:41:32.703 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2023-11-04T01:41:32.703 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:41:32.703 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2060221055 2023-11-04T01:41:32.703 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:32.703 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:32.704 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2023-11-04T01:41:32.704 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2023-11-04T01:41:32.704 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:41:32.704 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2060221055 2023-11-04T01:41:32.704 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:32.705 INFO:teuthology.orchestra.run.smithi077.stdout: "inst_str": "client.5715 192.168.0.1:0/2060221055", 2023-11-04T01:41:32.705 INFO:teuthology.orchestra.run.smithi077.stdout: "addr_str": "192.168.0.1:0/2060221055", 2023-11-04T01:41:32.705 INFO:teuthology.orchestra.run.smithi077.stdout: "inode_count": 1, 2023-11-04T01:41:32.705 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_epoch": 16, 2023-11-04T01:41:32.705 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch": 38, 2023-11-04T01:41:32.706 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:41:32.706 INFO:teuthology.orchestra.run.smithi077.stdout: "blocklisted": false, 2023-11-04T01:41:32.706 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs" 2023-11-04T01:41:32.706 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-04T01:41:32.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:41:32.713 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:41:32.713 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:41:32.714 DEBUG:teuthology.orchestra.run.smithi077:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:41:32.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:41:32.773 INFO:teuthology.orchestra.run.smithi077.stdout:fuseblk 2023-11-04T01:41:32.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:41:32.779 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:41:32.779 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:41:32.780 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:41:32.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:41:32.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:41:32.846 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create snap-test-pool 2023-11-04T01:41:32.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.945+0000 7f4c5796c640 1 Processor -- start 2023-11-04T01:41:32.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.946+0000 7f4c5796c640 1 -- start start 2023-11-04T01:41:32.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.946+0000 7f4c5796c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4c50159d40 0x7f4c500cdc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:32.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.946+0000 7f4c5796c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4c500cf420 0x7f4c500cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:32.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.946+0000 7f4c5796c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c500ca550 con 0x7f4c500c87d0 2023-11-04T01:41:32.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.946+0000 7f4c5796c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c500caeb0 con 0x7f4c50159d40 2023-11-04T01:41:32.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.946+0000 7f4c5796c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c5006d060 con 0x7f4c500cf420 2023-11-04T01:41:32.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.947+0000 7f4c55708640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4c50159d40 0x7f4c500cdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:32.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.947+0000 7f4c54f07640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f4c500c87d0 0x7f4c500ced10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:34480/0 (socket says 172.21.15.77:34480) 2023-11-04T01:41:32.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.947+0000 7f4c54f07640 1 -- 172.21.15.77:0/904966277 learned_addr learned my addr 172.21.15.77:0/904966277 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:32.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.947+0000 7f4c55708640 1 -- 172.21.15.77:0/904966277 >> v2:172.21.15.122:3300/0 conn(0x7f4c500cf420 msgr2=0x7f4c500cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:32.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.947+0000 7f4c55708640 1 --2- 172.21.15.77:0/904966277 >> v2:172.21.15.122:3300/0 conn(0x7f4c500cf420 0x7f4c500cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:32.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.947+0000 7f4c55708640 1 -- 172.21.15.77:0/904966277 >> v1:172.21.15.77:6789/0 conn(0x7f4c500c87d0 legacy=0x7f4c500ced10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:32.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.947+0000 7f4c47fff640 1 -- 172.21.15.77:0/904966277 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3602655624 0 0) 0x7f4c500ca550 con 0x7f4c500c87d0 2023-11-04T01:41:32.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.947+0000 7f4c55708640 1 -- 172.21.15.77:0/904966277 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c500ce1b0 con 0x7f4c50159d40 2023-11-04T01:41:32.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.948+0000 7f4c55708640 1 --2- 172.21.15.77:0/904966277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c50159d40 0x7f4c500cdc70 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c0097a0 tx=0x7f4c4c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde965c3948e2ac6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:32.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.948+0000 7f4c47fff640 1 -- 172.21.15.77:0/904966277 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c02e070 con 0x7f4c50159d40 2023-11-04T01:41:32.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.948+0000 7f4c47fff640 1 -- 172.21.15.77:0/904966277 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4c0315a0 con 0x7f4c50159d40 2023-11-04T01:41:32.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.948+0000 7f4c47fff640 1 -- 172.21.15.77:0/904966277 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c031930 con 0x7f4c50159d40 2023-11-04T01:41:32.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.948+0000 7f4c5796c640 1 -- 172.21.15.77:0/904966277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c50159d40 msgr2=0x7f4c500cdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:32.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.948+0000 7f4c5796c640 1 --2- 172.21.15.77:0/904966277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c50159d40 0x7f4c500cdc70 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c0097a0 tx=0x7f4c4c02b840 comp rx=0 tx=0).stop 2023-11-04T01:41:32.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.948+0000 7f4c5796c640 1 -- 172.21.15.77:0/904966277 shutdown_connections 2023-11-04T01:41:32.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.948+0000 7f4c5796c640 1 --2- 172.21.15.77:0/904966277 >> v2:172.21.15.122:3300/0 conn(0x7f4c500cf420 0x7f4c500cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:32.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.948+0000 7f4c5796c640 1 --2- 172.21.15.77:0/904966277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c50159d40 0x7f4c500cdc70 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:32.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.948+0000 7f4c5796c640 1 -- 172.21.15.77:0/904966277 >> 172.21.15.77:0/904966277 conn(0x7f4c500b1c50 msgr2=0x7f4c500b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:32.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.948+0000 7f4c5796c640 1 -- 172.21.15.77:0/904966277 shutdown_connections 2023-11-04T01:41:32.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.948+0000 7f4c5796c640 1 -- 172.21.15.77:0/904966277 wait complete. 2023-11-04T01:41:32.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.949+0000 7f4c5796c640 1 Processor -- start 2023-11-04T01:41:32.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.949+0000 7f4c5796c640 1 -- start start 2023-11-04T01:41:32.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.950+0000 7f4c5796c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c500c87d0 0x7f4c50150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:32.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.950+0000 7f4c5796c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c500cf420 0x7f4c5015cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:32.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.950+0000 7f4c5796c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4c50159d40 0x7f4c500cd500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:32.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.950+0000 7f4c5796c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c501540c0 con 0x7f4c500c87d0 2023-11-04T01:41:32.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.950+0000 7f4c5796c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c501543a0 con 0x7f4c500cf420 2023-11-04T01:41:32.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.950+0000 7f4c5796c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c50154680 con 0x7f4c50159d40 2023-11-04T01:41:32.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.950+0000 7f4c55708640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c500c87d0 0x7f4c50150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:32.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.950+0000 7f4c55708640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c500c87d0 0x7f4c50150140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43714/0 (socket says 172.21.15.77:43714) 2023-11-04T01:41:32.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.950+0000 7f4c55708640 1 -- 172.21.15.77:0/1610965324 learned_addr learned my addr 172.21.15.77:0/1610965324 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:32.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.950+0000 7f4c55f09640 1 --2- 172.21.15.77:0/1610965324 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4c50159d40 0x7f4c500cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:32.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.950+0000 7f4c54f07640 1 --2- 172.21.15.77:0/1610965324 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c500cf420 0x7f4c5015cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:32.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.950+0000 7f4c55708640 1 -- 172.21.15.77:0/1610965324 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4c50159d40 msgr2=0x7f4c500cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:32.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.951+0000 7f4c55708640 1 --2- 172.21.15.77:0/1610965324 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4c50159d40 0x7f4c500cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:32.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.951+0000 7f4c55708640 1 -- 172.21.15.77:0/1610965324 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c500cf420 msgr2=0x7f4c5015cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:32.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.951+0000 7f4c55708640 1 --2- 172.21.15.77:0/1610965324 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c500cf420 0x7f4c5015cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:32.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.951+0000 7f4c55708640 1 -- 172.21.15.77:0/1610965324 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c4c009400 con 0x7f4c500c87d0 2023-11-04T01:41:32.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.951+0000 7f4c54f07640 1 --2- 172.21.15.77:0/1610965324 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c500cf420 0x7f4c5015cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:32.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.951+0000 7f4c55708640 1 --2- 172.21.15.77:0/1610965324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c500c87d0 0x7f4c50150140 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c0097a0 tx=0x7f4c4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:32.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.951+0000 7f4c45ffb640 1 -- 172.21.15.77:0/1610965324 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c032840 con 0x7f4c500c87d0 2023-11-04T01:41:32.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.951+0000 7f4c45ffb640 1 -- 172.21.15.77:0/1610965324 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4c0329a0 con 0x7f4c500c87d0 2023-11-04T01:41:32.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.951+0000 7f4c5796c640 1 -- 172.21.15.77:0/1610965324 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c50154960 con 0x7f4c500c87d0 2023-11-04T01:41:32.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.951+0000 7f4c45ffb640 1 -- 172.21.15.77:0/1610965324 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c032d50 con 0x7f4c500c87d0 2023-11-04T01:41:32.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.951+0000 7f4c5796c640 1 -- 172.21.15.77:0/1610965324 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c50155160 con 0x7f4c500c87d0 2023-11-04T01:41:32.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.952+0000 7f4c5796c640 1 -- 172.21.15.77:0/1610965324 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c50074290 con 0x7f4c500c87d0 2023-11-04T01:41:32.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.952+0000 7f4c45ffb640 1 -- 172.21.15.77:0/1610965324 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4c4c03b3f0 con 0x7f4c500c87d0 2023-11-04T01:41:32.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.953+0000 7f4c45ffb640 1 --2- 172.21.15.77:0/1610965324 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4c3406aea0 0x7f4c3406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:32.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.953+0000 7f4c45ffb640 1 -- 172.21.15.77:0/1610965324 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4c4c0ab7c0 con 0x7f4c500c87d0 2023-11-04T01:41:32.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.953+0000 7f4c54f07640 1 --2- 172.21.15.77:0/1610965324 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4c3406aea0 0x7f4c3406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:32.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.954+0000 7f4c54f07640 1 --2- 172.21.15.77:0/1610965324 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4c3406aea0 0x7f4c3406d360 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4c500ce0c0 tx=0x7f4c40009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:32.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:32.957+0000 7f4c45ffb640 1 -- 172.21.15.77:0/1610965324 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4c4c0767c0 con 0x7f4c500c87d0 2023-11-04T01:41:33.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.123+0000 7f4c5796c640 1 -- 172.21.15.77:0/1610965324 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "snap-test-pool"} v 0) v1 -- 0x7f4c5006eef0 con 0x7f4c500c87d0 2023-11-04T01:41:33.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.710+0000 7f4c45ffb640 1 -- 172.21.15.77:0/1610965324 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "snap-test-pool"}]=0 pool 'snap-test-pool' created v39) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4c4c079de0 con 0x7f4c500c87d0 2023-11-04T01:41:33.712 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'snap-test-pool' created 2023-11-04T01:41:33.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.713+0000 7f4c5796c640 1 -- 172.21.15.77:0/1610965324 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4c3406aea0 msgr2=0x7f4c3406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:33.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.713+0000 7f4c5796c640 1 --2- 172.21.15.77:0/1610965324 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4c3406aea0 0x7f4c3406d360 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4c500ce0c0 tx=0x7f4c40009040 comp rx=0 tx=0).stop 2023-11-04T01:41:33.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.713+0000 7f4c5796c640 1 -- 172.21.15.77:0/1610965324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c500c87d0 msgr2=0x7f4c50150140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:33.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.713+0000 7f4c5796c640 1 --2- 172.21.15.77:0/1610965324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c500c87d0 0x7f4c50150140 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c0097a0 tx=0x7f4c4c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:41:33.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.713+0000 7f4c5796c640 1 -- 172.21.15.77:0/1610965324 shutdown_connections 2023-11-04T01:41:33.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.713+0000 7f4c5796c640 1 --2- 172.21.15.77:0/1610965324 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4c3406aea0 0x7f4c3406d360 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:33.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.713+0000 7f4c5796c640 1 --2- 172.21.15.77:0/1610965324 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4c50159d40 0x7f4c500cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:33.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.713+0000 7f4c5796c640 1 --2- 172.21.15.77:0/1610965324 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c500cf420 0x7f4c5015cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:33.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.713+0000 7f4c5796c640 1 --2- 172.21.15.77:0/1610965324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c500c87d0 0x7f4c50150140 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:33.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.713+0000 7f4c5796c640 1 -- 172.21.15.77:0/1610965324 >> 172.21.15.77:0/1610965324 conn(0x7f4c500b1c50 msgr2=0x7f4c500b3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:33.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.713+0000 7f4c5796c640 1 -- 172.21.15.77:0/1610965324 shutdown_connections 2023-11-04T01:41:33.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.713+0000 7f4c5796c640 1 -- 172.21.15.77:0/1610965324 wait complete. 2023-11-04T01:41:33.728 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool snap-test-pool mksnap snap3 2023-11-04T01:41:33.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.768+0000 7fe446c0bf40 1 Processor -- start 2023-11-04T01:41:33.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.768+0000 7fe446c0bf40 1 -- start start 2023-11-04T01:41:33.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.768+0000 7fe446c0bf40 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5587de7d5960 0x5587de875b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:33.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.768+0000 7fe446c0bf40 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587de7f57d0 0x5587de875550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:33.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.768+0000 7fe446c0bf40 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5587de87a960 0x5587de885420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:33.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.768+0000 7fe446c0bf40 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587de75b3b0 con 0x5587de7f57d0 2023-11-04T01:41:33.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.768+0000 7fe446c0bf40 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587de6f5650 con 0x5587de7d5960 2023-11-04T01:41:33.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.768+0000 7fe446c0bf40 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x5587de6f52f0 con 0x5587de87a960 2023-11-04T01:41:33.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.768+0000 7fe43b24f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587de7f57d0 0x5587de875550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:33.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.768+0000 7fe43b24f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587de7f57d0 0x5587de875550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43738/0 (socket says 172.21.15.77:43738) 2023-11-04T01:41:33.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.768+0000 7fe43b24f640 1 -- 172.21.15.77:0/2154056713 learned_addr learned my addr 172.21.15.77:0/2154056713 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:33.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.769+0000 7fe444251640 1 --2- 172.21.15.77:0/2154056713 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5587de87a960 0x5587de885420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:33.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.769+0000 7fe443a50640 1 --2- 172.21.15.77:0/2154056713 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5587de7d5960 0x5587de875b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:33.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.769+0000 7fe43b24f640 1 -- 172.21.15.77:0/2154056713 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5587de87a960 msgr2=0x5587de885420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:33.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.769+0000 7fe43b24f640 1 --2- 172.21.15.77:0/2154056713 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5587de87a960 0x5587de885420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:33.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.769+0000 7fe43b24f640 1 -- 172.21.15.77:0/2154056713 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5587de7d5960 msgr2=0x5587de875b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:33.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.769+0000 7fe43b24f640 1 --2- 172.21.15.77:0/2154056713 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5587de7d5960 0x5587de875b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:33.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.769+0000 7fe43b24f640 1 -- 172.21.15.77:0/2154056713 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42c005d20 con 0x5587de7f57d0 2023-11-04T01:41:33.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.769+0000 7fe43b24f640 1 --2- 172.21.15.77:0/2154056713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587de7f57d0 0x5587de875550 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe42c00a440 tx=0x7fe42c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b43b695c803500b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:33.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.769+0000 7fe442a4e640 1 -- 172.21.15.77:0/2154056713 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c04aea0 con 0x5587de7f57d0 2023-11-04T01:41:33.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.769+0000 7fe442a4e640 1 -- 172.21.15.77:0/2154056713 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42c052640 con 0x5587de7f57d0 2023-11-04T01:41:33.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.769+0000 7fe442a4e640 1 -- 172.21.15.77:0/2154056713 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c0529d0 con 0x5587de7f57d0 2023-11-04T01:41:33.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.769+0000 7fe446c0bf40 1 -- 172.21.15.77:0/2154056713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587de7f57d0 msgr2=0x5587de875550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:33.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.769+0000 7fe446c0bf40 1 --2- 172.21.15.77:0/2154056713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587de7f57d0 0x5587de875550 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe42c00a440 tx=0x7fe42c04c000 comp rx=0 tx=0).stop 2023-11-04T01:41:33.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.769+0000 7fe446c0bf40 1 -- 172.21.15.77:0/2154056713 shutdown_connections 2023-11-04T01:41:33.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.769+0000 7fe446c0bf40 1 --2- 172.21.15.77:0/2154056713 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5587de87a960 0x5587de885420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:33.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.769+0000 7fe446c0bf40 1 --2- 172.21.15.77:0/2154056713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587de7f57d0 0x5587de875550 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:33.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.769+0000 7fe446c0bf40 1 --2- 172.21.15.77:0/2154056713 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5587de7d5960 0x5587de875b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:33.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.770+0000 7fe446c0bf40 1 -- 172.21.15.77:0/2154056713 >> 172.21.15.77:0/2154056713 conn(0x5587de7d7f40 msgr2=0x5587de7d6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:33.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.770+0000 7fe446c0bf40 1 -- 172.21.15.77:0/2154056713 shutdown_connections 2023-11-04T01:41:33.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.770+0000 7fe446c0bf40 1 -- 172.21.15.77:0/2154056713 wait complete. 2023-11-04T01:41:33.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.770+0000 7fe446c0bf40 1 Processor -- start 2023-11-04T01:41:33.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.770+0000 7fe446c0bf40 1 -- start start 2023-11-04T01:41:33.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.771+0000 7fe446c0bf40 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5587de7d5960 0x5587de86ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:33.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.771+0000 7fe446c0bf40 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5587de7f57d0 0x5587de91bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:33.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.771+0000 7fe446c0bf40 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587de87a960 0x5587de876880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:33.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.771+0000 7fe446c0bf40 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587de6d54f0 con 0x5587de87a960 2023-11-04T01:41:33.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.771+0000 7fe446c0bf40 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587de7d5490 con 0x5587de7d5960 2023-11-04T01:41:33.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.771+0000 7fe446c0bf40 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x5587de7f0a80 con 0x5587de7f57d0 2023-11-04T01:41:33.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.771+0000 7fe444251640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587de87a960 0x5587de876880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:33.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.771+0000 7fe444251640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587de87a960 0x5587de876880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43744/0 (socket says 172.21.15.77:43744) 2023-11-04T01:41:33.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.771+0000 7fe444251640 1 -- 172.21.15.77:0/303930307 learned_addr learned my addr 172.21.15.77:0/303930307 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:33.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.771+0000 7fe443a50640 1 --2- 172.21.15.77:0/303930307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5587de7d5960 0x5587de86ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:33.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.771+0000 7fe43b24f640 1 --2- 172.21.15.77:0/303930307 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5587de7f57d0 0x5587de91bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:33.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.771+0000 7fe444251640 1 -- 172.21.15.77:0/303930307 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5587de7f57d0 msgr2=0x5587de91bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:33.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.771+0000 7fe444251640 1 --2- 172.21.15.77:0/303930307 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5587de7f57d0 0x5587de91bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:33.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.771+0000 7fe444251640 1 -- 172.21.15.77:0/303930307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5587de7d5960 msgr2=0x5587de86ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:33.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.771+0000 7fe444251640 1 --2- 172.21.15.77:0/303930307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5587de7d5960 0x5587de86ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:33.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.771+0000 7fe444251640 1 -- 172.21.15.77:0/303930307 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5587de71b770 con 0x5587de87a960 2023-11-04T01:41:33.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.771+0000 7fe444251640 1 --2- 172.21.15.77:0/303930307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587de87a960 0x5587de876880 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe43c00e2f0 tx=0x7fe43c00e7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:33.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.772+0000 7fe441a4c640 1 -- 172.21.15.77:0/303930307 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c013870 con 0x5587de87a960 2023-11-04T01:41:33.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.772+0000 7fe441a4c640 1 -- 172.21.15.77:0/303930307 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43c0139d0 con 0x5587de87a960 2023-11-04T01:41:33.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.772+0000 7fe446c0bf40 1 -- 172.21.15.77:0/303930307 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5587de701780 con 0x5587de87a960 2023-11-04T01:41:33.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.772+0000 7fe441a4c640 1 -- 172.21.15.77:0/303930307 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c013d60 con 0x5587de87a960 2023-11-04T01:41:33.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.772+0000 7fe446c0bf40 1 -- 172.21.15.77:0/303930307 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5587de6f4930 con 0x5587de87a960 2023-11-04T01:41:33.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.773+0000 7fe441a4c640 1 -- 172.21.15.77:0/303930307 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe43c014410 con 0x5587de87a960 2023-11-04T01:41:33.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.773+0000 7fe441a4c640 1 --2- 172.21.15.77:0/303930307 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe424069820 0x7fe42406bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:33.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.774+0000 7fe441a4c640 1 -- 172.21.15.77:0/303930307 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe43c088df0 con 0x5587de87a960 2023-11-04T01:41:33.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.774+0000 7fe443a50640 1 --2- 172.21.15.77:0/303930307 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe424069820 0x7fe42406bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:33.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.774+0000 7fe446c0bf40 1 -- 172.21.15.77:0/303930307 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- pool_op(create snap pool 7 tid 1 name snap3 v0) v4 -- 0x5587de765330 con 0x5587de87a960 2023-11-04T01:41:33.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:33.774+0000 7fe443a50640 1 --2- 172.21.15.77:0/303930307 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe424069820 0x7fe42406bce0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe434004170 tx=0x7fe434000bc0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:34.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.722+0000 7fe441a4c640 1 -- 172.21.15.77:0/303930307 <== mon.0 v2:172.21.15.77:3300/0 6 ==== pool_op_reply(tid 1 (0) Success v40) v1 ==== 43+0+0 (secure 0 0 0) 0x7fe43c018020 con 0x5587de87a960 2023-11-04T01:41:34.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.722+0000 7fe441a4c640 1 -- 172.21.15.77:0/303930307 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=40}) v3 -- 0x7fe424072510 con 0x5587de87a960 2023-11-04T01:41:34.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.723+0000 7fe441a4c640 1 -- 172.21.15.77:0/303930307 <== mon.0 v2:172.21.15.77:3300/0 7 ==== osd_map(40..40 src has 1..40) v4 ==== 718+0+0 (secure 0 0 0) 0x7fe43c057a00 con 0x5587de87a960 2023-11-04T01:41:34.725 INFO:teuthology.orchestra.run.smithi077.stdout:created pool snap-test-pool snap snap3 2023-11-04T01:41:34.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.723+0000 7fe446c0bf40 1 -- 172.21.15.77:0/303930307 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe424069820 msgr2=0x7fe42406bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:34.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.723+0000 7fe446c0bf40 1 --2- 172.21.15.77:0/303930307 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe424069820 0x7fe42406bce0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe434004170 tx=0x7fe434000bc0 comp rx=0 tx=0).stop 2023-11-04T01:41:34.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.723+0000 7fe446c0bf40 1 -- 172.21.15.77:0/303930307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587de87a960 msgr2=0x5587de876880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:34.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.723+0000 7fe446c0bf40 1 --2- 172.21.15.77:0/303930307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587de87a960 0x5587de876880 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe43c00e2f0 tx=0x7fe43c00e7b0 comp rx=0 tx=0).stop 2023-11-04T01:41:34.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.724+0000 7fe446c0bf40 1 -- 172.21.15.77:0/303930307 shutdown_connections 2023-11-04T01:41:34.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.724+0000 7fe446c0bf40 1 --2- 172.21.15.77:0/303930307 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe424069820 0x7fe42406bce0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:34.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.725+0000 7fe446c0bf40 1 --2- 172.21.15.77:0/303930307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5587de87a960 0x5587de876880 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:34.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.725+0000 7fe446c0bf40 1 --2- 172.21.15.77:0/303930307 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5587de7f57d0 0x5587de91bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:34.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.725+0000 7fe446c0bf40 1 --2- 172.21.15.77:0/303930307 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5587de7d5960 0x5587de86ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:34.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.725+0000 7fe446c0bf40 1 -- 172.21.15.77:0/303930307 >> 172.21.15.77:0/303930307 conn(0x5587de7d7f40 msgr2=0x5587de8853e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:34.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.725+0000 7fe446c0bf40 1 -- 172.21.15.77:0/303930307 shutdown_connections 2023-11-04T01:41:34.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.726+0000 7fe446c0bf40 1 -- 172.21.15.77:0/303930307 wait complete. 2023-11-04T01:41:34.737 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs snap-test-pool 2023-11-04T01:41:34.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.880+0000 7f00ef3f5640 1 Processor -- start 2023-11-04T01:41:34.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.880+0000 7f00ef3f5640 1 -- start start 2023-11-04T01:41:34.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.881+0000 7f00ef3f5640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f00e81603d0 0x7f00e80b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:34.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.881+0000 7f00ef3f5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00e80722a0 0x7f00e806a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:34.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.881+0000 7f00ef3f5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e80cdf80 con 0x7f00e806a660 2023-11-04T01:41:34.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.881+0000 7f00ef3f5640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00e80b19d0 con 0x7f00e81603d0 2023-11-04T01:41:34.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.881+0000 7f00ef3f5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e806aaf0 con 0x7f00e80722a0 2023-11-04T01:41:34.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.881+0000 7f00ed992640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f00e806a660 0x7f00e8160b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:34496/0 (socket says 172.21.15.77:34496) 2023-11-04T01:41:34.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.881+0000 7f00ed992640 1 -- 172.21.15.77:0/555639008 learned_addr learned my addr 172.21.15.77:0/555639008 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:34.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.882+0000 7f00dffff640 1 -- 172.21.15.77:0/555639008 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2693764381 0 0) 0x7f00e80cdf80 con 0x7f00e806a660 2023-11-04T01:41:34.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.882+0000 7f00ec990640 1 --2- 172.21.15.77:0/555639008 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00e80722a0 0x7f00e806a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:34.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.882+0000 7f00ed191640 1 --2- 172.21.15.77:0/555639008 >> v2:172.21.15.122:3300/0 conn(0x7f00e81603d0 0x7f00e80b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:34.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.882+0000 7f00dffff640 1 -- 172.21.15.77:0/555639008 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00d4003520 con 0x7f00e806a660 2023-11-04T01:41:34.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.882+0000 7f00dffff640 1 -- 172.21.15.77:0/555639008 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1341170415 0 0) 0x7f00d4003520 con 0x7f00e806a660 2023-11-04T01:41:34.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.882+0000 7f00dffff640 1 -- 172.21.15.77:0/555639008 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00e80722a0 msgr2=0x7f00e806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:34.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.882+0000 7f00dffff640 1 --2- 172.21.15.77:0/555639008 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00e80722a0 0x7f00e806a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:34.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.882+0000 7f00dffff640 1 -- 172.21.15.77:0/555639008 >> v2:172.21.15.122:3300/0 conn(0x7f00e81603d0 msgr2=0x7f00e80b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:34.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.882+0000 7f00dffff640 1 --2- 172.21.15.77:0/555639008 >> v2:172.21.15.122:3300/0 conn(0x7f00e81603d0 0x7f00e80b1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:34.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.882+0000 7f00dffff640 1 -- 172.21.15.77:0/555639008 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e80ce6f0 con 0x7f00e806a660 2023-11-04T01:41:34.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.882+0000 7f00dffff640 1 -- 172.21.15.77:0/555639008 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f00e0001670 con 0x7f00e806a660 2023-11-04T01:41:34.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.882+0000 7f00dffff640 1 -- 172.21.15.77:0/555639008 >> v1:172.21.15.77:6789/0 conn(0x7f00e806a660 legacy=0x7f00e8160b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:34.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.882+0000 7f00dffff640 1 --2- 172.21.15.77:0/555639008 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00e80722a0 0x7f00d4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:34.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.882+0000 7f00dffff640 1 --2- 172.21.15.77:0/555639008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00d4003ef0 0x7f00d40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:34.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.882+0000 7f00dffff640 1 --2- 172.21.15.77:0/555639008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00d4004d00 0x7f00d4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:34.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.882+0000 7f00dffff640 1 -- 172.21.15.77:0/555639008 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e806aaf0 con 0x7f00d4003ef0 2023-11-04T01:41:34.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.882+0000 7f00dffff640 1 -- 172.21.15.77:0/555639008 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d400ba30 con 0x7f00d4004d00 2023-11-04T01:41:34.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.882+0000 7f00dffff640 1 -- 172.21.15.77:0/555639008 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d400bbc0 con 0x7f00e80722a0 2023-11-04T01:41:34.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.882+0000 7f00ec990640 1 --2- 172.21.15.77:0/555639008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00d4003ef0 0x7f00d40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:34.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.882+0000 7f00ed992640 1 --2- 172.21.15.77:0/555639008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00d4004d00 0x7f00d4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:34.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.882+0000 7f00ed191640 1 --2- 172.21.15.77:0/555639008 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00e80722a0 0x7f00d4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:34.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.882+0000 7f00ec990640 1 -- 172.21.15.77:0/555639008 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00e80722a0 msgr2=0x7f00d4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:34.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.882+0000 7f00ec990640 1 --2- 172.21.15.77:0/555639008 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00e80722a0 0x7f00d4003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:34.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.882+0000 7f00ec990640 1 -- 172.21.15.77:0/555639008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00d4004d00 msgr2=0x7f00d4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:34.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.882+0000 7f00ec990640 1 --2- 172.21.15.77:0/555639008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00d4004d00 0x7f00d4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:34.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.882+0000 7f00ec990640 1 -- 172.21.15.77:0/555639008 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d4003520 con 0x7f00d4003ef0 2023-11-04T01:41:34.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.882+0000 7f00ed992640 1 --2- 172.21.15.77:0/555639008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00d4004d00 0x7f00d4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:34.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.883+0000 7f00ec990640 1 --2- 172.21.15.77:0/555639008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00d4003ef0 0x7f00d40047c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f00d800ba60 tx=0x7f00d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4944b0455446758 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:34.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.883+0000 7f00dffff640 1 -- 172.21.15.77:0/555639008 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d8032630 con 0x7f00d4003ef0 2023-11-04T01:41:34.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.883+0000 7f00dffff640 1 -- 172.21.15.77:0/555639008 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d8032790 con 0x7f00d4003ef0 2023-11-04T01:41:34.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.883+0000 7f00dffff640 1 -- 172.21.15.77:0/555639008 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d8032b20 con 0x7f00d4003ef0 2023-11-04T01:41:34.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.884+0000 7f00ef3f5640 1 -- 172.21.15.77:0/555639008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00d4003ef0 msgr2=0x7f00d40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:34.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.884+0000 7f00ef3f5640 1 --2- 172.21.15.77:0/555639008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00d4003ef0 0x7f00d40047c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f00d800ba60 tx=0x7f00d40057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:34.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.884+0000 7f00ed992640 1 -- 172.21.15.77:0/555639008 reap_dead start 2023-11-04T01:41:34.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.884+0000 7f00ef3f5640 1 -- 172.21.15.77:0/555639008 shutdown_connections 2023-11-04T01:41:34.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.884+0000 7f00ef3f5640 1 -- 172.21.15.77:0/555639008 >> 172.21.15.77:0/555639008 conn(0x7f00e806d800 msgr2=0x7f00e806dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:34.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.884+0000 7f00ef3f5640 1 -- 172.21.15.77:0/555639008 shutdown_connections 2023-11-04T01:41:34.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.884+0000 7f00ef3f5640 1 -- 172.21.15.77:0/555639008 wait complete. 2023-11-04T01:41:34.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.885+0000 7f00ef3f5640 1 Processor -- start 2023-11-04T01:41:34.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.885+0000 7f00ef3f5640 1 -- start start 2023-11-04T01:41:34.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.886+0000 7f00ef3f5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00d4003ef0 0x7f00e8151870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:34.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.886+0000 7f00ef3f5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00e8153bd0 0x7f00e8150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:34.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.886+0000 7f00ef3f5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00e80c5ba0 0x7f00e80c6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:34.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.886+0000 7f00ef3f5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e80c6560 con 0x7f00d4003ef0 2023-11-04T01:41:34.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.886+0000 7f00ef3f5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e80b2920 con 0x7f00e80c5ba0 2023-11-04T01:41:34.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.886+0000 7f00ef3f5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e8151490 con 0x7f00e8153bd0 2023-11-04T01:41:34.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.886+0000 7f00ed191640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00d4003ef0 0x7f00e8151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:34.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.886+0000 7f00ed191640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00d4003ef0 0x7f00e8151870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43760/0 (socket says 172.21.15.77:43760) 2023-11-04T01:41:34.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.886+0000 7f00ed191640 1 -- 172.21.15.77:0/2349335891 learned_addr learned my addr 172.21.15.77:0/2349335891 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:34.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.886+0000 7f00ed992640 1 --2- 172.21.15.77:0/2349335891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00e80c5ba0 0x7f00e80c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:34.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.886+0000 7f00ec990640 1 --2- 172.21.15.77:0/2349335891 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00e8153bd0 0x7f00e8150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:34.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.886+0000 7f00ed191640 1 -- 172.21.15.77:0/2349335891 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00e8153bd0 msgr2=0x7f00e8150f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:34.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.886+0000 7f00ed191640 1 --2- 172.21.15.77:0/2349335891 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00e8153bd0 0x7f00e8150f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:34.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.886+0000 7f00ed191640 1 -- 172.21.15.77:0/2349335891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00e80c5ba0 msgr2=0x7f00e80c6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:34.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.886+0000 7f00ed191640 1 --2- 172.21.15.77:0/2349335891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00e80c5ba0 0x7f00e80c6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:34.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.886+0000 7f00ed191640 1 -- 172.21.15.77:0/2349335891 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e81543e0 con 0x7f00d4003ef0 2023-11-04T01:41:34.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.886+0000 7f00ed191640 1 --2- 172.21.15.77:0/2349335891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00d4003ef0 0x7f00e8151870 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f00e4007f30 tx=0x7f00e4011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:34.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.886+0000 7f00ddffb640 1 -- 172.21.15.77:0/2349335891 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e400e030 con 0x7f00d4003ef0 2023-11-04T01:41:34.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.886+0000 7f00ddffb640 1 -- 172.21.15.77:0/2349335891 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e4016470 con 0x7f00d4003ef0 2023-11-04T01:41:34.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.886+0000 7f00ef3f5640 1 -- 172.21.15.77:0/2349335891 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e81546c0 con 0x7f00d4003ef0 2023-11-04T01:41:34.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.886+0000 7f00ddffb640 1 -- 172.21.15.77:0/2349335891 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e4016820 con 0x7f00d4003ef0 2023-11-04T01:41:34.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.887+0000 7f00ef3f5640 1 -- 172.21.15.77:0/2349335891 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e80b2b70 con 0x7f00d4003ef0 2023-11-04T01:41:34.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.888+0000 7f00ef3f5640 1 -- 172.21.15.77:0/2349335891 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e80b2d30 con 0x7f00d4003ef0 2023-11-04T01:41:34.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.888+0000 7f00ddffb640 1 -- 172.21.15.77:0/2349335891 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f00e4016980 con 0x7f00d4003ef0 2023-11-04T01:41:34.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.888+0000 7f00ddffb640 1 --2- 172.21.15.77:0/2349335891 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f00cc06ae70 0x7f00cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:34.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.888+0000 7f00ddffb640 1 -- 172.21.15.77:0/2349335891 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6421+0+0 (secure 0 0 0) 0x7f00e400f070 con 0x7f00d4003ef0 2023-11-04T01:41:34.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.889+0000 7f00ec990640 1 --2- 172.21.15.77:0/2349335891 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f00cc06ae70 0x7f00cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:34.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.889+0000 7f00ec990640 1 --2- 172.21.15.77:0/2349335891 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f00cc06ae70 0x7f00cc06d330 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f00d800ba30 tx=0x7f00d8030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:34.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:34.893+0000 7f00ddffb640 1 -- 172.21.15.77:0/2349335891 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f00e40556d0 con 0x7f00d4003ef0 2023-11-04T01:41:35.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.097+0000 7f00ef3f5640 1 -- 172.21.15.77:0/2349335891 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "snap-test-pool"} v 0) v1 -- 0x7f00e806e5b0 con 0x7f00d4003ef0 2023-11-04T01:41:35.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.097+0000 7f00ddffb640 1 -- 172.21.15.77:0/2349335891 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "snap-test-pool"}]=-95 pool(7) already has mon-managed snaps; can't attach pool to fs v16) v1 ==== 173+0+0 (secure 0 0 0) 0x7f00e4058cf0 con 0x7f00d4003ef0 2023-11-04T01:41:35.099 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENOTSUP: pool(7) already has mon-managed snaps; can't attach pool to fs 2023-11-04T01:41:35.103 DEBUG:teuthology.orchestra.run:got remote process result: 95 2023-11-04T01:41:35.104 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool snap-test-pool rmsnap snap3 2023-11-04T01:41:35.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.143+0000 7f4697243f40 1 Processor -- start 2023-11-04T01:41:35.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.143+0000 7f4697243f40 1 -- start start 2023-11-04T01:41:35.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.144+0000 7f4697243f40 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4680002290 0x560295e7d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.144+0000 7f4697243f40 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560295e8f540 0x560295e7e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.144+0000 7f4697243f40 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560295e8fd50 0x560295ddd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.144+0000 7f4697243f40 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x560295d65ac0 con 0x560295e8f540 2023-11-04T01:41:35.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.144+0000 7f4697243f40 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x560295d613b0 con 0x7f4680002290 2023-11-04T01:41:35.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.144+0000 7f4697243f40 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x560295cfb650 con 0x560295e8fd50 2023-11-04T01:41:35.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.144+0000 7f468bdec640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560295e8f540 0x560295e7e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:35.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.144+0000 7f468bdec640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560295e8f540 0x560295e7e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43782/0 (socket says 172.21.15.77:43782) 2023-11-04T01:41:35.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.144+0000 7f468bdec640 1 -- 172.21.15.77:0/2973295297 learned_addr learned my addr 172.21.15.77:0/2973295297 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:35.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.144+0000 7f46945ed640 1 --2- 172.21.15.77:0/2973295297 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4680002290 0x560295e7d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:35.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.144+0000 7f468bdec640 1 -- 172.21.15.77:0/2973295297 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560295e8fd50 msgr2=0x560295ddd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:35.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.144+0000 7f468bdec640 1 --2- 172.21.15.77:0/2973295297 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560295e8fd50 0x560295ddd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.144+0000 7f468bdec640 1 -- 172.21.15.77:0/2973295297 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4680002290 msgr2=0x560295e7d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:35.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.144+0000 7f468bdec640 1 --2- 172.21.15.77:0/2973295297 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4680002290 0x560295e7d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.144+0000 7f468bdec640 1 -- 172.21.15.77:0/2973295297 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560295cfa930 con 0x560295e8f540 2023-11-04T01:41:35.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.144+0000 7f468bdec640 1 --2- 172.21.15.77:0/2973295297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560295e8f540 0x560295e7e6e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f467c0097b0 tx=0x7f467c005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf2d1bdbf865146 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:35.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.144+0000 7f46935eb640 1 -- 172.21.15.77:0/2973295297 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c00f070 con 0x560295e8f540 2023-11-04T01:41:35.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.145+0000 7f46935eb640 1 -- 172.21.15.77:0/2973295297 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467c010040 con 0x560295e8f540 2023-11-04T01:41:35.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.145+0000 7f46935eb640 1 -- 172.21.15.77:0/2973295297 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c007a00 con 0x560295e8f540 2023-11-04T01:41:35.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.145+0000 7f4697243f40 1 -- 172.21.15.77:0/2973295297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560295e8f540 msgr2=0x560295e7e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:35.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.145+0000 7f4697243f40 1 --2- 172.21.15.77:0/2973295297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560295e8f540 0x560295e7e6e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f467c0097b0 tx=0x7f467c005a00 comp rx=0 tx=0).stop 2023-11-04T01:41:35.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.145+0000 7f4697243f40 1 -- 172.21.15.77:0/2973295297 shutdown_connections 2023-11-04T01:41:35.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.145+0000 7f4697243f40 1 --2- 172.21.15.77:0/2973295297 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560295e8fd50 0x560295ddd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.145+0000 7f4697243f40 1 --2- 172.21.15.77:0/2973295297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560295e8f540 0x560295e7e6e0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.145+0000 7f4697243f40 1 --2- 172.21.15.77:0/2973295297 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4680002290 0x560295e7d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.145+0000 7f4697243f40 1 -- 172.21.15.77:0/2973295297 >> 172.21.15.77:0/2973295297 conn(0x560295dddf40 msgr2=0x560295de06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:35.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.145+0000 7f4697243f40 1 -- 172.21.15.77:0/2973295297 shutdown_connections 2023-11-04T01:41:35.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.145+0000 7f4697243f40 1 -- 172.21.15.77:0/2973295297 wait complete. 2023-11-04T01:41:35.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.146+0000 7f4697243f40 1 Processor -- start 2023-11-04T01:41:35.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.146+0000 7f4697243f40 1 -- start start 2023-11-04T01:41:35.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.146+0000 7f4697243f40 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560295e8f540 0x560295e8b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.146+0000 7f4697243f40 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560295e8fd50 0x560295df6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.146+0000 7f4697243f40 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4680002290 0x560295e76eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.146+0000 7f4697243f40 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x560295cfb2f0 con 0x560295e8fd50 2023-11-04T01:41:35.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.146+0000 7f4697243f40 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x560295cdb4f0 con 0x560295e8f540 2023-11-04T01:41:35.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.146+0000 7f4697243f40 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x560295df6500 con 0x7f4680002290 2023-11-04T01:41:35.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.146+0000 7f468bdec640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560295e8fd50 0x560295df6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:35.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.146+0000 7f468bdec640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560295e8fd50 0x560295df6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43798/0 (socket says 172.21.15.77:43798) 2023-11-04T01:41:35.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.146+0000 7f468bdec640 1 -- 172.21.15.77:0/3854697681 learned_addr learned my addr 172.21.15.77:0/3854697681 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:35.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.147+0000 7f46945ed640 1 --2- 172.21.15.77:0/3854697681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560295e8f540 0x560295e8b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:35.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.147+0000 7f4694dee640 1 --2- 172.21.15.77:0/3854697681 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4680002290 0x560295e76eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:35.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.147+0000 7f468bdec640 1 -- 172.21.15.77:0/3854697681 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4680002290 msgr2=0x560295e76eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:35.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.147+0000 7f468bdec640 1 --2- 172.21.15.77:0/3854697681 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4680002290 0x560295e76eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.147+0000 7f468bdec640 1 -- 172.21.15.77:0/3854697681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560295e8f540 msgr2=0x560295e8b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:35.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.147+0000 7f468bdec640 1 --2- 172.21.15.77:0/3854697681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560295e8f540 0x560295e8b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.147+0000 7f468bdec640 1 -- 172.21.15.77:0/3854697681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467c009410 con 0x560295e8fd50 2023-11-04T01:41:35.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.147+0000 7f468bdec640 1 --2- 172.21.15.77:0/3854697681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560295e8fd50 0x560295df6920 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x560295e8c970 tx=0x7f467c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:35.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.147+0000 7f46925e9640 1 -- 172.21.15.77:0/3854697681 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c027670 con 0x560295e8fd50 2023-11-04T01:41:35.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.147+0000 7f46925e9640 1 -- 172.21.15.77:0/3854697681 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467c0277f0 con 0x560295e8fd50 2023-11-04T01:41:35.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.147+0000 7f4697243f40 1 -- 172.21.15.77:0/3854697681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560295cfa390 con 0x560295e8fd50 2023-11-04T01:41:35.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.147+0000 7f46925e9640 1 -- 172.21.15.77:0/3854697681 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c027ba0 con 0x560295e8fd50 2023-11-04T01:41:35.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.147+0000 7f4697243f40 1 -- 172.21.15.77:0/3854697681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560295e7f790 con 0x560295e8fd50 2023-11-04T01:41:35.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.149+0000 7f46925e9640 1 -- 172.21.15.77:0/3854697681 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f467c024070 con 0x560295e8fd50 2023-11-04T01:41:35.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.149+0000 7f46925e9640 1 --2- 172.21.15.77:0/3854697681 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4674069850 0x7f467406bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.149+0000 7f46925e9640 1 -- 172.21.15.77:0/3854697681 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6421+0+0 (secure 0 0 0) 0x7f467c089f40 con 0x560295e8fd50 2023-11-04T01:41:35.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.149+0000 7f46945ed640 1 --2- 172.21.15.77:0/3854697681 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4674069850 0x7f467406bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:35.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.149+0000 7f4697243f40 1 -- 172.21.15.77:0/3854697681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- pool_op(delete snap pool 7 tid 1 name snap3 v0) v4 -- 0x560295d6b330 con 0x560295e8fd50 2023-11-04T01:41:35.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.150+0000 7f46945ed640 1 --2- 172.21.15.77:0/3854697681 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4674069850 0x7f467406bd10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4684054000 tx=0x7f468404c000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:35.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.727+0000 7f46925e9640 1 -- 172.21.15.77:0/3854697681 <== mon.0 v2:172.21.15.77:3300/0 6 ==== pool_op_reply(tid 1 (0) Success v41) v1 ==== 43+0+0 (secure 0 0 0) 0x7f467c055040 con 0x560295e8fd50 2023-11-04T01:41:35.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.727+0000 7f46925e9640 1 -- 172.21.15.77:0/3854697681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=41}) v3 -- 0x7f46740725a0 con 0x560295e8fd50 2023-11-04T01:41:35.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.728+0000 7f46925e9640 1 -- 172.21.15.77:0/3854697681 <== mon.0 v2:172.21.15.77:3300/0 7 ==== osd_map(41..41 src has 1..41) v4 ==== 643+0+0 (secure 0 0 0) 0x7f467c058d00 con 0x560295e8fd50 2023-11-04T01:41:35.730 INFO:teuthology.orchestra.run.smithi077.stdout:removed pool snap-test-pool snap snap3 2023-11-04T01:41:35.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.728+0000 7f4697243f40 1 -- 172.21.15.77:0/3854697681 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4674069850 msgr2=0x7f467406bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:35.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.728+0000 7f4697243f40 1 --2- 172.21.15.77:0/3854697681 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4674069850 0x7f467406bd10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4684054000 tx=0x7f468404c000 comp rx=0 tx=0).stop 2023-11-04T01:41:35.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.728+0000 7f4697243f40 1 -- 172.21.15.77:0/3854697681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560295e8fd50 msgr2=0x560295df6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:35.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.728+0000 7f4697243f40 1 --2- 172.21.15.77:0/3854697681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560295e8fd50 0x560295df6920 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x560295e8c970 tx=0x7f467c002fb0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.728+0000 7f4697243f40 1 -- 172.21.15.77:0/3854697681 shutdown_connections 2023-11-04T01:41:35.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.728+0000 7f4697243f40 1 --2- 172.21.15.77:0/3854697681 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4674069850 0x7f467406bd10 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.728+0000 7f4697243f40 1 --2- 172.21.15.77:0/3854697681 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4680002290 0x560295e76eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.728+0000 7f4697243f40 1 --2- 172.21.15.77:0/3854697681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560295e8fd50 0x560295df6920 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.728+0000 7f4697243f40 1 --2- 172.21.15.77:0/3854697681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560295e8f540 0x560295e8b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.728+0000 7f4697243f40 1 -- 172.21.15.77:0/3854697681 >> 172.21.15.77:0/3854697681 conn(0x560295dddf40 msgr2=0x560295d9cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:35.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.728+0000 7f4697243f40 1 -- 172.21.15.77:0/3854697681 shutdown_connections 2023-11-04T01:41:35.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.728+0000 7f4697243f40 1 -- 172.21.15.77:0/3854697681 wait complete. 2023-11-04T01:41:35.735 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete snap-test-pool 2023-11-04T01:41:35.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.876+0000 7f8380597640 1 Processor -- start 2023-11-04T01:41:35.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.876+0000 7f8380597640 1 -- start start 2023-11-04T01:41:35.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.877+0000 7f8380597640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f837815e430 0x7f83780cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.877+0000 7f8380597640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f83780cf160 0x7f83780cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.877+0000 7f8380597640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f83780d0710 0x7f83780cda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.877+0000 7f8380597640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83780cdf90 con 0x7f83780cf160 2023-11-04T01:41:35.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.877+0000 7f8380597640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83780d0280 con 0x7f837815e430 2023-11-04T01:41:35.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.877+0000 7f8380597640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83780cf670 con 0x7f83780d0710 2023-11-04T01:41:35.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.877+0000 7f837db32640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f83780cf160 0x7f83780cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:35.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.877+0000 7f837db32640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f83780cf160 0x7f83780cd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43804/0 (socket says 172.21.15.77:43804) 2023-11-04T01:41:35.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.877+0000 7f837db32640 1 -- 172.21.15.77:0/2577614508 learned_addr learned my addr 172.21.15.77:0/2577614508 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:35.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.877+0000 7f837eb34640 1 --2- 172.21.15.77:0/2577614508 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f83780d0710 0x7f83780cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:35.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.877+0000 7f837e333640 1 --2- 172.21.15.77:0/2577614508 >> v2:172.21.15.122:3300/0 conn(0x7f837815e430 0x7f83780cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:35.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.877+0000 7f837db32640 1 -- 172.21.15.77:0/2577614508 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f83780d0710 msgr2=0x7f83780cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:35.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.877+0000 7f837db32640 1 --2- 172.21.15.77:0/2577614508 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f83780d0710 0x7f83780cda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.877+0000 7f837db32640 1 -- 172.21.15.77:0/2577614508 >> v2:172.21.15.122:3300/0 conn(0x7f837815e430 msgr2=0x7f83780cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:35.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.877+0000 7f837db32640 1 --2- 172.21.15.77:0/2577614508 >> v2:172.21.15.122:3300/0 conn(0x7f837815e430 0x7f83780cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.877+0000 7f837db32640 1 -- 172.21.15.77:0/2577614508 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83780cf950 con 0x7f83780cf160 2023-11-04T01:41:35.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.877+0000 7f837eb34640 1 --2- 172.21.15.77:0/2577614508 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f83780d0710 0x7f83780cda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:35.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.878+0000 7f837e333640 1 --2- 172.21.15.77:0/2577614508 >> v2:172.21.15.122:3300/0 conn(0x7f837815e430 0x7f83780cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:35.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.878+0000 7f837db32640 1 --2- 172.21.15.77:0/2577614508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83780cf160 0x7f83780cd510 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f837806e5b0 tx=0x7f836802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79103c9c4db75f2a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:35.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.878+0000 7f837d331640 1 -- 172.21.15.77:0/2577614508 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8368031870 con 0x7f83780cf160 2023-11-04T01:41:35.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.878+0000 7f837d331640 1 -- 172.21.15.77:0/2577614508 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83680319d0 con 0x7f83780cf160 2023-11-04T01:41:35.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.878+0000 7f837d331640 1 -- 172.21.15.77:0/2577614508 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8368031d60 con 0x7f83780cf160 2023-11-04T01:41:35.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.879+0000 7f8380597640 1 -- 172.21.15.77:0/2577614508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83780cf160 msgr2=0x7f83780cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:35.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.879+0000 7f8380597640 1 --2- 172.21.15.77:0/2577614508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83780cf160 0x7f83780cd510 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f837806e5b0 tx=0x7f836802b910 comp rx=0 tx=0).stop 2023-11-04T01:41:35.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.879+0000 7f8380597640 1 -- 172.21.15.77:0/2577614508 shutdown_connections 2023-11-04T01:41:35.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.879+0000 7f8380597640 1 --2- 172.21.15.77:0/2577614508 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f83780d0710 0x7f83780cda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.879+0000 7f8380597640 1 --2- 172.21.15.77:0/2577614508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83780cf160 0x7f83780cd510 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.879+0000 7f8380597640 1 --2- 172.21.15.77:0/2577614508 >> v2:172.21.15.122:3300/0 conn(0x7f837815e430 0x7f83780cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.879+0000 7f8380597640 1 -- 172.21.15.77:0/2577614508 >> 172.21.15.77:0/2577614508 conn(0x7f837806ea20 msgr2=0x7f837806ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:35.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.879+0000 7f8380597640 1 -- 172.21.15.77:0/2577614508 shutdown_connections 2023-11-04T01:41:35.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.879+0000 7f8380597640 1 -- 172.21.15.77:0/2577614508 wait complete. 2023-11-04T01:41:35.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.879+0000 7f8380597640 1 Processor -- start 2023-11-04T01:41:35.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.879+0000 7f8380597640 1 -- start start 2023-11-04T01:41:35.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.880+0000 7f8380597640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f83780cf160 0x7f8378146000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.880+0000 7f8380597640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83780d0710 0x7f83781586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.880+0000 7f8380597640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f837815e430 0x7f8378158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.880+0000 7f8380597640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83780c8140 con 0x7f837815e430 2023-11-04T01:41:35.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.880+0000 7f8380597640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8378146540 con 0x7f83780d0710 2023-11-04T01:41:35.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.880+0000 7f8380597640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8378157ad0 con 0x7f83780cf160 2023-11-04T01:41:35.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.880+0000 7f837eb34640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f837815e430 0x7f8378158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:35.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.880+0000 7f837eb34640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f837815e430 0x7f8378158c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43806/0 (socket says 172.21.15.77:43806) 2023-11-04T01:41:35.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.880+0000 7f837eb34640 1 -- 172.21.15.77:0/1074329182 learned_addr learned my addr 172.21.15.77:0/1074329182 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:35.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.880+0000 7f837e333640 1 --2- 172.21.15.77:0/1074329182 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f83780cf160 0x7f8378146000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:35.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.880+0000 7f837db32640 1 --2- 172.21.15.77:0/1074329182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83780d0710 0x7f83781586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:35.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.880+0000 7f837eb34640 1 -- 172.21.15.77:0/1074329182 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f83780cf160 msgr2=0x7f8378146000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:35.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.880+0000 7f837eb34640 1 --2- 172.21.15.77:0/1074329182 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f83780cf160 0x7f8378146000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.880+0000 7f837eb34640 1 -- 172.21.15.77:0/1074329182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83780d0710 msgr2=0x7f83781586c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:35.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.880+0000 7f837eb34640 1 --2- 172.21.15.77:0/1074329182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83780d0710 0x7f83781586c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:35.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.880+0000 7f837eb34640 1 -- 172.21.15.77:0/1074329182 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83680094d0 con 0x7f837815e430 2023-11-04T01:41:35.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.881+0000 7f837eb34640 1 --2- 172.21.15.77:0/1074329182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f837815e430 0x7f8378158c00 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8370006b10 tx=0x7f837000ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:35.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.881+0000 7f836effd640 1 -- 172.21.15.77:0/1074329182 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8370011800 con 0x7f837815e430 2023-11-04T01:41:35.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.881+0000 7f836effd640 1 -- 172.21.15.77:0/1074329182 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8370011960 con 0x7f837815e430 2023-11-04T01:41:35.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.881+0000 7f8380597640 1 -- 172.21.15.77:0/1074329182 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83781592a0 con 0x7f837815e430 2023-11-04T01:41:35.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.881+0000 7f836effd640 1 -- 172.21.15.77:0/1074329182 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8370011d10 con 0x7f837815e430 2023-11-04T01:41:35.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.881+0000 7f8380597640 1 -- 172.21.15.77:0/1074329182 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83780c8630 con 0x7f837815e430 2023-11-04T01:41:35.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.882+0000 7f8380597640 1 -- 172.21.15.77:0/1074329182 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8378074290 con 0x7f837815e430 2023-11-04T01:41:35.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.882+0000 7f836effd640 1 -- 172.21.15.77:0/1074329182 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8370018360 con 0x7f837815e430 2023-11-04T01:41:35.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.883+0000 7f836effd640 1 --2- 172.21.15.77:0/1074329182 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f835c06ae70 0x7f835c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:35.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.883+0000 7f836effd640 1 -- 172.21.15.77:0/1074329182 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f8370089950 con 0x7f837815e430 2023-11-04T01:41:35.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.883+0000 7f837e333640 1 --2- 172.21.15.77:0/1074329182 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f835c06ae70 0x7f835c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:35.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.883+0000 7f837e333640 1 --2- 172.21.15.77:0/1074329182 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f835c06ae70 0x7f835c06d330 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f837400d620 tx=0x7f8374007810 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:35.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:35.887+0000 7f836effd640 1 -- 172.21.15.77:0/1074329182 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8370054740 con 0x7f837815e430 2023-11-04T01:41:36.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.053+0000 7f8380597640 1 -- 172.21.15.77:0/1074329182 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "snap-test-pool"} v 0) v1 -- 0x7f83780c7f20 con 0x7f837815e430 2023-11-04T01:41:36.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.053+0000 7f836effd640 1 -- 172.21.15.77:0/1074329182 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "snap-test-pool"}]=-1 WARNING: this will *PERMANENTLY DESTROY* all data stored in pool snap-test-pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. v41) v1 ==== 296+0+0 (secure 0 0 0) 0x7f837001f0a0 con 0x7f837815e430 2023-11-04T01:41:36.056 INFO:teuthology.orchestra.run.smithi077.stderr:Error EPERM: WARNING: this will *PERMANENTLY DESTROY* all data stored in pool snap-test-pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. 2023-11-04T01:41:36.061 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:41:36.061 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:41:36.062 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:41:36.113 DEBUG:teuthology.orchestra.run.smithi122:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:41:36.167 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:41:36.168 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:41:36.168 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:41:36.186 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:36.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.325+0000 7fb858694640 1 Processor -- start 2023-11-04T01:41:36.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.325+0000 7fb858694640 1 -- start start 2023-11-04T01:41:36.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.326+0000 7fb858694640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb8500b42c0 0x7fb8500c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.326+0000 7fb858694640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb8500c9c40 0x7fb8500b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.326+0000 7fb858694640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8500ca050 con 0x7fb85015ad80 2023-11-04T01:41:36.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.326+0000 7fb858694640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb85006cfa0 con 0x7fb8500b42c0 2023-11-04T01:41:36.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.326+0000 7fb858694640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb85006d280 con 0x7fb8500c9c40 2023-11-04T01:41:36.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.326+0000 7fb855c2f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb8500b42c0 0x7fb8500c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.326+0000 7fb855c2f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb8500b42c0 0x7fb8500c9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43820/0 (socket says 172.21.15.77:43820) 2023-11-04T01:41:36.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.326+0000 7fb855c2f640 1 -- 172.21.15.77:0/1492169536 learned_addr learned my addr 172.21.15.77:0/1492169536 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:36.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.326+0000 7fb856c31640 1 --2- 172.21.15.77:0/1492169536 >> v2:172.21.15.122:3300/0 conn(0x7fb8500c9c40 0x7fb8500b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.326+0000 7fb855c2f640 1 -- 172.21.15.77:0/1492169536 >> v2:172.21.15.122:3300/0 conn(0x7fb8500c9c40 msgr2=0x7fb8500b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:36.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.326+0000 7fb855c2f640 1 --2- 172.21.15.77:0/1492169536 >> v2:172.21.15.122:3300/0 conn(0x7fb8500c9c40 0x7fb8500b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.326+0000 7fb855c2f640 1 -- 172.21.15.77:0/1492169536 >> v1:172.21.15.122:6789/0 conn(0x7fb85015ad80 legacy=0x7fb85006c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:36.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.326+0000 7fb855c2f640 1 -- 172.21.15.77:0/1492169536 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85006d560 con 0x7fb8500b42c0 2023-11-04T01:41:36.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.327+0000 7fb855c2f640 1 --2- 172.21.15.77:0/1492169536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8500b42c0 0x7fb8500c9700 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb8500c8e50 tx=0x7fb84002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79a748ac448d0c65 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:36.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.327+0000 7fb85542e640 1 -- 172.21.15.77:0/1492169536 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb840030860 con 0x7fb8500b42c0 2023-11-04T01:41:36.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.327+0000 7fb85542e640 1 -- 172.21.15.77:0/1492169536 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8400309c0 con 0x7fb8500b42c0 2023-11-04T01:41:36.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.327+0000 7fb85542e640 1 -- 172.21.15.77:0/1492169536 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb840030d50 con 0x7fb8500b42c0 2023-11-04T01:41:36.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.327+0000 7fb858694640 1 -- 172.21.15.77:0/1492169536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8500b42c0 msgr2=0x7fb8500c9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.327+0000 7fb858694640 1 --2- 172.21.15.77:0/1492169536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8500b42c0 0x7fb8500c9700 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb8500c8e50 tx=0x7fb84002b9a0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.327+0000 7fb858694640 1 -- 172.21.15.77:0/1492169536 shutdown_connections 2023-11-04T01:41:36.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.328+0000 7fb858694640 1 --2- 172.21.15.77:0/1492169536 >> v2:172.21.15.122:3300/0 conn(0x7fb8500c9c40 0x7fb8500b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.328+0000 7fb858694640 1 --2- 172.21.15.77:0/1492169536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8500b42c0 0x7fb8500c9700 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.328+0000 7fb858694640 1 -- 172.21.15.77:0/1492169536 >> 172.21.15.77:0/1492169536 conn(0x7fb8500ce950 msgr2=0x7fb8500ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:36.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.328+0000 7fb858694640 1 -- 172.21.15.77:0/1492169536 shutdown_connections 2023-11-04T01:41:36.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.328+0000 7fb858694640 1 -- 172.21.15.77:0/1492169536 wait complete. 2023-11-04T01:41:36.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.329+0000 7fb858694640 1 Processor -- start 2023-11-04T01:41:36.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.329+0000 7fb858694640 1 -- start start 2023-11-04T01:41:36.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.329+0000 7fb858694640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb8500b42c0 0x7fb85015bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.329+0000 7fb858694640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8500c9c40 0x7fb85015c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.329+0000 7fb858694640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb85015ad80 0x7fb8500af4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.329+0000 7fb858694640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85015d220 con 0x7fb85015ad80 2023-11-04T01:41:36.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.329+0000 7fb858694640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85015cdd0 con 0x7fb8500c9c40 2023-11-04T01:41:36.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.329+0000 7fb858694640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85015d470 con 0x7fb8500b42c0 2023-11-04T01:41:36.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.330+0000 7fb856c31640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb85015ad80 0x7fb8500af4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.330+0000 7fb856c31640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb85015ad80 0x7fb8500af4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43822/0 (socket says 172.21.15.77:43822) 2023-11-04T01:41:36.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.330+0000 7fb856c31640 1 -- 172.21.15.77:0/1042090714 learned_addr learned my addr 172.21.15.77:0/1042090714 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:36.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.330+0000 7fb856430640 1 --2- 172.21.15.77:0/1042090714 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb8500b42c0 0x7fb85015bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.330+0000 7fb855c2f640 1 --2- 172.21.15.77:0/1042090714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8500c9c40 0x7fb85015c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.330+0000 7fb856c31640 1 -- 172.21.15.77:0/1042090714 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb8500b42c0 msgr2=0x7fb85015bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.330+0000 7fb856c31640 1 --2- 172.21.15.77:0/1042090714 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb8500b42c0 0x7fb85015bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.330+0000 7fb856c31640 1 -- 172.21.15.77:0/1042090714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8500c9c40 msgr2=0x7fb85015c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.330+0000 7fb856c31640 1 --2- 172.21.15.77:0/1042090714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8500c9c40 0x7fb85015c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.330+0000 7fb856c31640 1 -- 172.21.15.77:0/1042090714 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8400094d0 con 0x7fb85015ad80 2023-11-04T01:41:36.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.330+0000 7fb856c31640 1 --2- 172.21.15.77:0/1042090714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb85015ad80 0x7fb8500af4e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb848007e40 tx=0x7fb84800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:36.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.330+0000 7fb846ffd640 1 -- 172.21.15.77:0/1042090714 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb848014620 con 0x7fb85015ad80 2023-11-04T01:41:36.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.330+0000 7fb846ffd640 1 -- 172.21.15.77:0/1042090714 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84800ee90 con 0x7fb85015ad80 2023-11-04T01:41:36.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.330+0000 7fb858694640 1 -- 172.21.15.77:0/1042090714 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb85015d750 con 0x7fb85015ad80 2023-11-04T01:41:36.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.330+0000 7fb846ffd640 1 -- 172.21.15.77:0/1042090714 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8480149e0 con 0x7fb85015ad80 2023-11-04T01:41:36.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.330+0000 7fb858694640 1 -- 172.21.15.77:0/1042090714 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb85015dd10 con 0x7fb85015ad80 2023-11-04T01:41:36.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.331+0000 7fb858694640 1 -- 172.21.15.77:0/1042090714 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb85015df00 con 0x7fb85015ad80 2023-11-04T01:41:36.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.331+0000 7fb846ffd640 1 -- 172.21.15.77:0/1042090714 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb848014b40 con 0x7fb85015ad80 2023-11-04T01:41:36.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.332+0000 7fb846ffd640 1 --2- 172.21.15.77:0/1042090714 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb83406ae70 0x7fb83406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.332+0000 7fb846ffd640 1 -- 172.21.15.77:0/1042090714 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7fb84808a310 con 0x7fb85015ad80 2023-11-04T01:41:36.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.332+0000 7fb856430640 1 --2- 172.21.15.77:0/1042090714 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb83406ae70 0x7fb83406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.333+0000 7fb856430640 1 --2- 172.21.15.77:0/1042090714 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb83406ae70 0x7fb83406d330 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb84c004ea0 tx=0x7fb84c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:36.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.336+0000 7fb846ffd640 1 -- 172.21.15.77:0/1042090714 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb8480550e0 con 0x7fb85015ad80 2023-11-04T01:41:36.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.504+0000 7fb858694640 1 -- 172.21.15.77:0/1042090714 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb850074290 con 0x7fb85015ad80 2023-11-04T01:41:36.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.505+0000 7fb846ffd640 1 -- 172.21.15.77:0/1042090714 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+18601 (secure 0 0 0) 0x7fb848058700 con 0x7fb85015ad80 2023-11-04T01:41:36.508 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:36.509 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":41,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:41:35.720651+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:41:22.769937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-04T01:41:23.907965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":1,"length":1}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":1,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:36.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.507+0000 7fb858694640 1 -- 172.21.15.77:0/1042090714 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb83406ae70 msgr2=0x7fb83406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.507+0000 7fb858694640 1 --2- 172.21.15.77:0/1042090714 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb83406ae70 0x7fb83406d330 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb84c004ea0 tx=0x7fb84c009040 comp rx=0 tx=0).stop 2023-11-04T01:41:36.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.507+0000 7fb858694640 1 -- 172.21.15.77:0/1042090714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb85015ad80 msgr2=0x7fb8500af4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.507+0000 7fb858694640 1 --2- 172.21.15.77:0/1042090714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb85015ad80 0x7fb8500af4e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb848007e40 tx=0x7fb84800e4b0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.507+0000 7fb858694640 1 -- 172.21.15.77:0/1042090714 shutdown_connections 2023-11-04T01:41:36.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.507+0000 7fb858694640 1 --2- 172.21.15.77:0/1042090714 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb83406ae70 0x7fb83406d330 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.507+0000 7fb858694640 1 --2- 172.21.15.77:0/1042090714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb85015ad80 0x7fb8500af4e0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.507+0000 7fb858694640 1 --2- 172.21.15.77:0/1042090714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8500c9c40 0x7fb85015c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.507+0000 7fb858694640 1 --2- 172.21.15.77:0/1042090714 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb8500b42c0 0x7fb85015bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.507+0000 7fb858694640 1 -- 172.21.15.77:0/1042090714 >> 172.21.15.77:0/1042090714 conn(0x7fb8500ce950 msgr2=0x7fb8500b19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:36.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.507+0000 7fb858694640 1 -- 172.21.15.77:0/1042090714 shutdown_connections 2023-11-04T01:41:36.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.507+0000 7fb858694640 1 -- 172.21.15.77:0/1042090714 wait complete. 2023-11-04T01:41:36.521 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:41:22.769937+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:41:23.907965+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:33.142176+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:41:36.522 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:41:36.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.622+0000 7f4cfb939640 1 Processor -- start 2023-11-04T01:41:36.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.622+0000 7f4cfb939640 1 -- start start 2023-11-04T01:41:36.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.623+0000 7f4cfb939640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4cf415ad40 0x7f4cf406b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.623+0000 7f4cfb939640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cf4065df0 con 0x7f4cf415b120 2023-11-04T01:41:36.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.623+0000 7f4cfb939640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cf4066040 con 0x7f4cf40c9b60 2023-11-04T01:41:36.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.623+0000 7f4cfb939640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf406bc40 con 0x7f4cf415ad40 2023-11-04T01:41:36.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.623+0000 7f4cf8ed4640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f4cf415b120 0x7f4cf415f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:34514/0 (socket says 172.21.15.77:34514) 2023-11-04T01:41:36.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.623+0000 7f4cf8ed4640 1 -- 172.21.15.77:0/3924086765 learned_addr learned my addr 172.21.15.77:0/3924086765 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:36.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.623+0000 7f4cebfff640 1 -- 172.21.15.77:0/3924086765 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 235896418 0 0) 0x7f4cf4065df0 con 0x7f4cf415b120 2023-11-04T01:41:36.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.623+0000 7f4cebfff640 1 -- 172.21.15.77:0/3924086765 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ce0003520 con 0x7f4cf415b120 2023-11-04T01:41:36.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.623+0000 7f4cf96d5640 1 --2- 172.21.15.77:0/3924086765 >> v2:172.21.15.122:3300/0 conn(0x7f4cf415ad40 0x7f4cf406b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.623+0000 7f4cebfff640 1 -- 172.21.15.77:0/3924086765 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2030536721 0 0) 0x7f4ce0003520 con 0x7f4cf415b120 2023-11-04T01:41:36.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.623+0000 7f4cebfff640 1 -- 172.21.15.77:0/3924086765 >> v2:172.21.15.122:3300/0 conn(0x7f4cf415ad40 msgr2=0x7f4cf406b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:36.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.623+0000 7f4cebfff640 1 --2- 172.21.15.77:0/3924086765 >> v2:172.21.15.122:3300/0 conn(0x7f4cf415ad40 0x7f4cf406b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.623+0000 7f4cebfff640 1 -- 172.21.15.77:0/3924086765 >> v1:172.21.15.122:6789/0 conn(0x7f4cf40c9b60 legacy=0x7f4cf4070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:36.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.623+0000 7f4cebfff640 1 -- 172.21.15.77:0/3924086765 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf4066320 con 0x7f4cf415b120 2023-11-04T01:41:36.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.623+0000 7f4cebfff640 1 -- 172.21.15.77:0/3924086765 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f4ce4001670 con 0x7f4cf415b120 2023-11-04T01:41:36.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.623+0000 7f4cebfff640 1 -- 172.21.15.77:0/3924086765 >> v1:172.21.15.77:6789/0 conn(0x7f4cf415b120 legacy=0x7f4cf415f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.623+0000 7f4cebfff640 1 --2- 172.21.15.77:0/3924086765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce0003970 0x7f4ce0003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.623+0000 7f4cebfff640 1 --2- 172.21.15.77:0/3924086765 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ce00047c0 0x7f4ce0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.623+0000 7f4cebfff640 1 --2- 172.21.15.77:0/3924086765 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ce0005180 0x7f4ce000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.623+0000 7f4cebfff640 1 -- 172.21.15.77:0/3924086765 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf406bc40 con 0x7f4ce0003970 2023-11-04T01:41:36.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.623+0000 7f4cebfff640 1 -- 172.21.15.77:0/3924086765 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce000c0b0 con 0x7f4ce00047c0 2023-11-04T01:41:36.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.623+0000 7f4cebfff640 1 -- 172.21.15.77:0/3924086765 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce000c270 con 0x7f4ce0005180 2023-11-04T01:41:36.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.624+0000 7f4cf96d5640 1 --2- 172.21.15.77:0/3924086765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce0003970 0x7f4ce0003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.624+0000 7f4cf8ed4640 1 --2- 172.21.15.77:0/3924086765 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ce00047c0 0x7f4ce0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.624+0000 7f4cf9ed6640 1 --2- 172.21.15.77:0/3924086765 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ce0005180 0x7f4ce000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.624+0000 7f4cf96d5640 1 -- 172.21.15.77:0/3924086765 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ce0005180 msgr2=0x7f4ce000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:36.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.624+0000 7f4cf96d5640 1 --2- 172.21.15.77:0/3924086765 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ce0005180 0x7f4ce000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.624+0000 7f4cf96d5640 1 -- 172.21.15.77:0/3924086765 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ce00047c0 msgr2=0x7f4ce0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:36.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.624+0000 7f4cf96d5640 1 --2- 172.21.15.77:0/3924086765 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ce00047c0 0x7f4ce0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.624+0000 7f4cf96d5640 1 -- 172.21.15.77:0/3924086765 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce0003520 con 0x7f4ce0003970 2023-11-04T01:41:36.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.624+0000 7f4cf9ed6640 1 --2- 172.21.15.77:0/3924086765 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ce0005180 0x7f4ce000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:36.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.624+0000 7f4cf9ed6640 1 -- 172.21.15.77:0/3924086765 reap_dead start 2023-11-04T01:41:36.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.625+0000 7f4cf96d5640 1 --2- 172.21.15.77:0/3924086765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce0003970 0x7f4ce0003d70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4cf000ba00 tx=0x7f4ce00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=367d4abe5d77d1c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:36.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.625+0000 7f4cebfff640 1 -- 172.21.15.77:0/3924086765 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0033680 con 0x7f4ce0003970 2023-11-04T01:41:36.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.625+0000 7f4cebfff640 1 -- 172.21.15.77:0/3924086765 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf00337e0 con 0x7f4ce0003970 2023-11-04T01:41:36.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.625+0000 7f4cebfff640 1 -- 172.21.15.77:0/3924086765 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0033b70 con 0x7f4ce0003970 2023-11-04T01:41:36.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.625+0000 7f4cfb939640 1 -- 172.21.15.77:0/3924086765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce0003970 msgr2=0x7f4ce0003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.625+0000 7f4cfb939640 1 --2- 172.21.15.77:0/3924086765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce0003970 0x7f4ce0003d70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4cf000ba00 tx=0x7f4ce00057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.625+0000 7f4cfb939640 1 -- 172.21.15.77:0/3924086765 shutdown_connections 2023-11-04T01:41:36.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.625+0000 7f4cfb939640 1 --2- 172.21.15.77:0/3924086765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce0003970 0x7f4ce0003d70 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.625+0000 7f4cfb939640 1 -- 172.21.15.77:0/3924086765 >> 172.21.15.77:0/3924086765 conn(0x7f4cf40cbc90 msgr2=0x7f4cf40cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:36.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.625+0000 7f4cfb939640 1 -- 172.21.15.77:0/3924086765 shutdown_connections 2023-11-04T01:41:36.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.625+0000 7f4cfb939640 1 -- 172.21.15.77:0/3924086765 wait complete. 2023-11-04T01:41:36.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.626+0000 7f4cfb939640 1 Processor -- start 2023-11-04T01:41:36.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.626+0000 7f4cfb939640 1 -- start start 2023-11-04T01:41:36.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.627+0000 7f4cfb939640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce0003970 0x7f4cf4159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.627+0000 7f4cfb939640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4cf41566a0 0x7f4cf40c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.627+0000 7f4cfb939640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4cf40c62e0 0x7f4cf40c6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.627+0000 7f4cfb939640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf415a520 con 0x7f4ce0003970 2023-11-04T01:41:36.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.627+0000 7f4cfb939640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf4151c70 con 0x7f4cf41566a0 2023-11-04T01:41:36.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.627+0000 7f4cfb939640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf4156b00 con 0x7f4cf40c62e0 2023-11-04T01:41:36.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.627+0000 7f4cf96d5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce0003970 0x7f4cf4159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.627+0000 7f4cf96d5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce0003970 0x7f4cf4159310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43832/0 (socket says 172.21.15.77:43832) 2023-11-04T01:41:36.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.627+0000 7f4cf96d5640 1 -- 172.21.15.77:0/2838601381 learned_addr learned my addr 172.21.15.77:0/2838601381 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:36.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.627+0000 7f4cf8ed4640 1 --2- 172.21.15.77:0/2838601381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4cf41566a0 0x7f4cf40c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.627+0000 7f4cf9ed6640 1 --2- 172.21.15.77:0/2838601381 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4cf40c62e0 0x7f4cf40c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.628+0000 7f4cf96d5640 1 -- 172.21.15.77:0/2838601381 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4cf40c62e0 msgr2=0x7f4cf40c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.628+0000 7f4cf96d5640 1 --2- 172.21.15.77:0/2838601381 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4cf40c62e0 0x7f4cf40c6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.628+0000 7f4cf96d5640 1 -- 172.21.15.77:0/2838601381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4cf41566a0 msgr2=0x7f4cf40c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.628+0000 7f4cf96d5640 1 --2- 172.21.15.77:0/2838601381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4cf41566a0 0x7f4cf40c53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.628+0000 7f4cf96d5640 1 -- 172.21.15.77:0/2838601381 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf4159910 con 0x7f4ce0003970 2023-11-04T01:41:36.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.628+0000 7f4cf8ed4640 1 --2- 172.21.15.77:0/2838601381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4cf41566a0 0x7f4cf40c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:36.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.628+0000 7f4cf9ed6640 1 --2- 172.21.15.77:0/2838601381 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4cf40c62e0 0x7f4cf40c6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:36.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.628+0000 7f4cf96d5640 1 --2- 172.21.15.77:0/2838601381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce0003970 0x7f4cf4159310 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0035040 tx=0x7f4cf0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:36.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.628+0000 7f4ce9ffb640 1 -- 172.21.15.77:0/2838601381 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0004220 con 0x7f4ce0003970 2023-11-04T01:41:36.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.628+0000 7f4ce9ffb640 1 -- 172.21.15.77:0/2838601381 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf0040070 con 0x7f4ce0003970 2023-11-04T01:41:36.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.628+0000 7f4cfb939640 1 -- 172.21.15.77:0/2838601381 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf4159bf0 con 0x7f4ce0003970 2023-11-04T01:41:36.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.628+0000 7f4ce9ffb640 1 -- 172.21.15.77:0/2838601381 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0003610 con 0x7f4ce0003970 2023-11-04T01:41:36.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.628+0000 7f4cfb939640 1 -- 172.21.15.77:0/2838601381 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf415a1b0 con 0x7f4ce0003970 2023-11-04T01:41:36.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.629+0000 7f4cfb939640 1 -- 172.21.15.77:0/2838601381 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf415a340 con 0x7f4ce0003970 2023-11-04T01:41:36.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.629+0000 7f4ce9ffb640 1 -- 172.21.15.77:0/2838601381 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4cf0003770 con 0x7f4ce0003970 2023-11-04T01:41:36.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.630+0000 7f4ce9ffb640 1 --2- 172.21.15.77:0/2838601381 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4cd806aea0 0x7f4cd806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.630+0000 7f4ce9ffb640 1 -- 172.21.15.77:0/2838601381 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f4cf00abaa0 con 0x7f4ce0003970 2023-11-04T01:41:36.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.630+0000 7f4cf8ed4640 1 --2- 172.21.15.77:0/2838601381 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4cd806aea0 0x7f4cd806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.630+0000 7f4cf8ed4640 1 --2- 172.21.15.77:0/2838601381 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4cd806aea0 0x7f4cd806d360 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4ce4001050 tx=0x7f4ce4009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:36.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.634+0000 7f4ce9ffb640 1 -- 172.21.15.77:0/2838601381 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4cf0076870 con 0x7f4ce0003970 2023-11-04T01:41:36.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.802+0000 7f4cfb939640 1 -- 172.21.15.77:0/2838601381 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4cf415ebd0 con 0x7f4ce0003970 2023-11-04T01:41:36.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.802+0000 7f4ce9ffb640 1 -- 172.21.15.77:0/2838601381 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4cf00420a0 con 0x7f4ce0003970 2023-11-04T01:41:36.805 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:41:36.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.804+0000 7f4cfb939640 1 -- 172.21.15.77:0/2838601381 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4cd806aea0 msgr2=0x7f4cd806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.804+0000 7f4cfb939640 1 --2- 172.21.15.77:0/2838601381 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4cd806aea0 0x7f4cd806d360 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4ce4001050 tx=0x7f4ce4009040 comp rx=0 tx=0).stop 2023-11-04T01:41:36.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.804+0000 7f4cfb939640 1 -- 172.21.15.77:0/2838601381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce0003970 msgr2=0x7f4cf4159310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.804+0000 7f4cfb939640 1 --2- 172.21.15.77:0/2838601381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce0003970 0x7f4cf4159310 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0035040 tx=0x7f4cf0004730 comp rx=0 tx=0).stop 2023-11-04T01:41:36.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.804+0000 7f4cfb939640 1 -- 172.21.15.77:0/2838601381 shutdown_connections 2023-11-04T01:41:36.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.804+0000 7f4cfb939640 1 --2- 172.21.15.77:0/2838601381 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4cd806aea0 0x7f4cd806d360 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.804+0000 7f4cfb939640 1 --2- 172.21.15.77:0/2838601381 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4cf40c62e0 0x7f4cf40c6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.804+0000 7f4cfb939640 1 --2- 172.21.15.77:0/2838601381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4cf41566a0 0x7f4cf40c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.804+0000 7f4cfb939640 1 --2- 172.21.15.77:0/2838601381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce0003970 0x7f4cf4159310 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.804+0000 7f4cfb939640 1 -- 172.21.15.77:0/2838601381 >> 172.21.15.77:0/2838601381 conn(0x7f4cf40cbc90 msgr2=0x7f4cf40ca970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:36.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.804+0000 7f4cfb939640 1 -- 172.21.15.77:0/2838601381 shutdown_connections 2023-11-04T01:41:36.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.804+0000 7f4cfb939640 1 -- 172.21.15.77:0/2838601381 wait complete. 2023-11-04T01:41:36.817 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:41:36.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.917+0000 7ff28687c640 1 Processor -- start 2023-11-04T01:41:36.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.917+0000 7ff28687c640 1 -- start start 2023-11-04T01:41:36.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.918+0000 7ff28687c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff280153e60 0x7ff28015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.918+0000 7ff28687c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff2800b4880 0x7ff2800b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.918+0000 7ff28687c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2800cde60 con 0x7ff2800cd6d0 2023-11-04T01:41:36.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.918+0000 7ff28687c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2800b5230 con 0x7ff2800b4880 2023-11-04T01:41:36.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.918+0000 7ff28687c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff280160f90 con 0x7ff280153e60 2023-11-04T01:41:36.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.918+0000 7ff27f7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ff2800cd6d0 0x7ff280161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:34516/0 (socket says 172.21.15.77:34516) 2023-11-04T01:41:36.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.918+0000 7ff27f7fe640 1 -- 172.21.15.77:0/2588505434 learned_addr learned my addr 172.21.15.77:0/2588505434 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:36.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.919+0000 7ff284e19640 1 --2- 172.21.15.77:0/2588505434 >> v2:172.21.15.122:3300/0 conn(0x7ff2800b4880 0x7ff2800b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.919+0000 7ff27ffff640 1 --2- 172.21.15.77:0/2588505434 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff280153e60 0x7ff28015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.919+0000 7ff27effd640 1 -- 172.21.15.77:0/2588505434 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3156987668 0 0) 0x7ff2800cde60 con 0x7ff2800cd6d0 2023-11-04T01:41:36.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.919+0000 7ff27effd640 1 -- 172.21.15.77:0/2588505434 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff268003520 con 0x7ff2800cd6d0 2023-11-04T01:41:36.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.919+0000 7ff27effd640 1 -- 172.21.15.77:0/2588505434 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1233580031 0 0) 0x7ff268003520 con 0x7ff2800cd6d0 2023-11-04T01:41:36.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.919+0000 7ff27effd640 1 -- 172.21.15.77:0/2588505434 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff280153e60 msgr2=0x7ff28015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:36.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.919+0000 7ff27effd640 1 --2- 172.21.15.77:0/2588505434 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff280153e60 0x7ff28015dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.919+0000 7ff27effd640 1 -- 172.21.15.77:0/2588505434 >> v2:172.21.15.122:3300/0 conn(0x7ff2800b4880 msgr2=0x7ff2800b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:36.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.919+0000 7ff27effd640 1 --2- 172.21.15.77:0/2588505434 >> v2:172.21.15.122:3300/0 conn(0x7ff2800b4880 0x7ff2800b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.919+0000 7ff27effd640 1 -- 172.21.15.77:0/2588505434 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff28015e400 con 0x7ff2800cd6d0 2023-11-04T01:41:36.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.919+0000 7ff27effd640 1 -- 172.21.15.77:0/2588505434 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7ff274001670 con 0x7ff2800cd6d0 2023-11-04T01:41:36.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.919+0000 7ff27effd640 1 -- 172.21.15.77:0/2588505434 >> v1:172.21.15.77:6789/0 conn(0x7ff2800cd6d0 legacy=0x7ff280161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.919+0000 7ff27effd640 1 --2- 172.21.15.77:0/2588505434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff268003970 0x7ff268003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.919+0000 7ff27effd640 1 --2- 172.21.15.77:0/2588505434 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff280153e60 0x7ff2680047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.919+0000 7ff27effd640 1 --2- 172.21.15.77:0/2588505434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff268004d00 0x7ff268005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.919+0000 7ff27effd640 1 -- 172.21.15.77:0/2588505434 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2800b5230 con 0x7ff268004d00 2023-11-04T01:41:36.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.919+0000 7ff27effd640 1 -- 172.21.15.77:0/2588505434 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff280160f90 con 0x7ff268003970 2023-11-04T01:41:36.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.919+0000 7ff27effd640 1 -- 172.21.15.77:0/2588505434 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff26800b980 con 0x7ff280153e60 2023-11-04T01:41:36.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.919+0000 7ff284e19640 1 --2- 172.21.15.77:0/2588505434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff268004d00 0x7ff268005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.919+0000 7ff27ffff640 1 --2- 172.21.15.77:0/2588505434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff268003970 0x7ff268003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.919+0000 7ff27f7fe640 1 --2- 172.21.15.77:0/2588505434 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff280153e60 0x7ff2680047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.919+0000 7ff284e19640 1 -- 172.21.15.77:0/2588505434 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff280153e60 msgr2=0x7ff2680047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:36.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.919+0000 7ff284e19640 1 --2- 172.21.15.77:0/2588505434 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff280153e60 0x7ff2680047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.919+0000 7ff284e19640 1 -- 172.21.15.77:0/2588505434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff268003970 msgr2=0x7ff268003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:36.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.919+0000 7ff284e19640 1 --2- 172.21.15.77:0/2588505434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff268003970 0x7ff268003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.919+0000 7ff284e19640 1 -- 172.21.15.77:0/2588505434 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff268003520 con 0x7ff268004d00 2023-11-04T01:41:36.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.920+0000 7ff284e19640 1 --2- 172.21.15.77:0/2588505434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff268004d00 0x7ff268005180 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ff278009fc0 tx=0x7ff2680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a120fdc875830b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:36.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.920+0000 7ff27effd640 1 -- 172.21.15.77:0/2588505434 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27802cc60 con 0x7ff268004d00 2023-11-04T01:41:36.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.920+0000 7ff27effd640 1 -- 172.21.15.77:0/2588505434 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27800f040 con 0x7ff268004d00 2023-11-04T01:41:36.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.920+0000 7ff27effd640 1 -- 172.21.15.77:0/2588505434 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff278034440 con 0x7ff268004d00 2023-11-04T01:41:36.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.921+0000 7ff28687c640 1 -- 172.21.15.77:0/2588505434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff268004d00 msgr2=0x7ff268005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.921+0000 7ff28687c640 1 --2- 172.21.15.77:0/2588505434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff268004d00 0x7ff268005180 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ff278009fc0 tx=0x7ff2680057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.921+0000 7ff284e19640 1 -- 172.21.15.77:0/2588505434 reap_dead start 2023-11-04T01:41:36.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.921+0000 7ff28687c640 1 -- 172.21.15.77:0/2588505434 shutdown_connections 2023-11-04T01:41:36.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.921+0000 7ff28687c640 1 -- 172.21.15.77:0/2588505434 >> 172.21.15.77:0/2588505434 conn(0x7ff2800cf880 msgr2=0x7ff2800cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:36.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.921+0000 7ff28687c640 1 -- 172.21.15.77:0/2588505434 shutdown_connections 2023-11-04T01:41:36.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.921+0000 7ff28687c640 1 -- 172.21.15.77:0/2588505434 wait complete. 2023-11-04T01:41:36.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.922+0000 7ff28687c640 1 Processor -- start 2023-11-04T01:41:36.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.922+0000 7ff28687c640 1 -- start start 2023-11-04T01:41:36.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.923+0000 7ff28687c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2800c9040 0x7ff2800b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.923+0000 7ff28687c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff2800c9420 0x7ff2800b7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.923+0000 7ff28687c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff280154ce0 0x7ff280155190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.923+0000 7ff28687c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff280155aa0 con 0x7ff2800c9040 2023-11-04T01:41:36.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.923+0000 7ff28687c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff280155d80 con 0x7ff280154ce0 2023-11-04T01:41:36.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.923+0000 7ff28687c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff280156060 con 0x7ff2800c9420 2023-11-04T01:41:36.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.923+0000 7ff27ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2800c9040 0x7ff2800b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.923+0000 7ff27ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2800c9040 0x7ff2800b7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43850/0 (socket says 172.21.15.77:43850) 2023-11-04T01:41:36.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.923+0000 7ff27ffff640 1 -- 172.21.15.77:0/2564843552 learned_addr learned my addr 172.21.15.77:0/2564843552 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:36.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.923+0000 7ff27f7fe640 1 --2- 172.21.15.77:0/2564843552 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff2800c9420 0x7ff2800b7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.923+0000 7ff284e19640 1 --2- 172.21.15.77:0/2564843552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff280154ce0 0x7ff280155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.923+0000 7ff27ffff640 1 -- 172.21.15.77:0/2564843552 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff2800c9420 msgr2=0x7ff2800b7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.923+0000 7ff27ffff640 1 --2- 172.21.15.77:0/2564843552 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff2800c9420 0x7ff2800b7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.923+0000 7ff27ffff640 1 -- 172.21.15.77:0/2564843552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff280154ce0 msgr2=0x7ff280155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:36.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.923+0000 7ff27ffff640 1 --2- 172.21.15.77:0/2564843552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff280154ce0 0x7ff280155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:36.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.923+0000 7ff27ffff640 1 -- 172.21.15.77:0/2564843552 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff280156340 con 0x7ff2800c9040 2023-11-04T01:41:36.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.923+0000 7ff27f7fe640 1 --2- 172.21.15.77:0/2564843552 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff2800c9420 0x7ff2800b7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:36.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.923+0000 7ff27ffff640 1 --2- 172.21.15.77:0/2564843552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2800c9040 0x7ff2800b7150 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ff2700119a0 tx=0x7ff270011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:36.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.923+0000 7ff27cff9640 1 -- 172.21.15.77:0/2564843552 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27000faf0 con 0x7ff2800c9040 2023-11-04T01:41:36.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.923+0000 7ff27cff9640 1 -- 172.21.15.77:0/2564843552 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27000fc50 con 0x7ff2800c9040 2023-11-04T01:41:36.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.923+0000 7ff27cff9640 1 -- 172.21.15.77:0/2564843552 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff270014440 con 0x7ff2800c9040 2023-11-04T01:41:36.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.924+0000 7ff28687c640 1 -- 172.21.15.77:0/2564843552 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff280156620 con 0x7ff2800c9040 2023-11-04T01:41:36.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.924+0000 7ff28687c640 1 -- 172.21.15.77:0/2564843552 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2800caf20 con 0x7ff2800c9040 2023-11-04T01:41:36.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.924+0000 7ff28687c640 1 -- 172.21.15.77:0/2564843552 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff28015ee20 con 0x7ff2800c9040 2023-11-04T01:41:36.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.925+0000 7ff27cff9640 1 -- 172.21.15.77:0/2564843552 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff2700145a0 con 0x7ff2800c9040 2023-11-04T01:41:36.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.925+0000 7ff27cff9640 1 --2- 172.21.15.77:0/2564843552 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff26c06aea0 0x7ff26c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:36.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.925+0000 7ff27cff9640 1 -- 172.21.15.77:0/2564843552 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7ff27008a1c0 con 0x7ff2800c9040 2023-11-04T01:41:36.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.925+0000 7ff27f7fe640 1 --2- 172.21.15.77:0/2564843552 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff26c06aea0 0x7ff26c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:36.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.926+0000 7ff27f7fe640 1 --2- 172.21.15.77:0/2564843552 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff26c06aea0 0x7ff26c06d360 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff2800c9800 tx=0x7ff274009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:36.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:36.929+0000 7ff27cff9640 1 -- 172.21.15.77:0/2564843552 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff270054f90 con 0x7ff2800c9040 2023-11-04T01:41:37.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.093+0000 7ff28687c640 1 -- 172.21.15.77:0/2564843552 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff280074290 con 0x7ff2800c9040 2023-11-04T01:41:37.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.093+0000 7ff27cff9640 1 -- 172.21.15.77:0/2564843552 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff2700585b0 con 0x7ff2800c9040 2023-11-04T01:41:37.096 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:41:37.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.095+0000 7ff28687c640 1 -- 172.21.15.77:0/2564843552 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff26c06aea0 msgr2=0x7ff26c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.095+0000 7ff28687c640 1 --2- 172.21.15.77:0/2564843552 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff26c06aea0 0x7ff26c06d360 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff2800c9800 tx=0x7ff274009040 comp rx=0 tx=0).stop 2023-11-04T01:41:37.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.095+0000 7ff28687c640 1 -- 172.21.15.77:0/2564843552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2800c9040 msgr2=0x7ff2800b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.095+0000 7ff28687c640 1 --2- 172.21.15.77:0/2564843552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2800c9040 0x7ff2800b7150 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ff2700119a0 tx=0x7ff270011e60 comp rx=0 tx=0).stop 2023-11-04T01:41:37.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.095+0000 7ff28687c640 1 -- 172.21.15.77:0/2564843552 shutdown_connections 2023-11-04T01:41:37.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.095+0000 7ff28687c640 1 --2- 172.21.15.77:0/2564843552 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff26c06aea0 0x7ff26c06d360 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.095+0000 7ff28687c640 1 --2- 172.21.15.77:0/2564843552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff280154ce0 0x7ff280155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.095+0000 7ff28687c640 1 --2- 172.21.15.77:0/2564843552 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff2800c9420 0x7ff2800b7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.095+0000 7ff28687c640 1 --2- 172.21.15.77:0/2564843552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2800c9040 0x7ff2800b7150 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.095+0000 7ff28687c640 1 -- 172.21.15.77:0/2564843552 >> 172.21.15.77:0/2564843552 conn(0x7ff2800cf880 msgr2=0x7ff28015e590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:37.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.095+0000 7ff28687c640 1 -- 172.21.15.77:0/2564843552 shutdown_connections 2023-11-04T01:41:37.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.095+0000 7ff28687c640 1 -- 172.21.15.77:0/2564843552 wait complete. 2023-11-04T01:41:37.109 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:41:37.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.209+0000 7f9dfa389640 1 Processor -- start 2023-11-04T01:41:37.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.209+0000 7f9dfa389640 1 -- start start 2023-11-04T01:41:37.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.210+0000 7f9dfa389640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9df41460c0 0x7f9df40b1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.210+0000 7f9dfa389640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9df40c37d0 0x7f9df40c3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.210+0000 7f9dfa389640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9df4070710 0x7f9df4070b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.210+0000 7f9dfa389640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9df41464a0 con 0x7f9df41460c0 2023-11-04T01:41:37.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.210+0000 7f9dfa389640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9df40c4170 con 0x7f9df4070710 2023-11-04T01:41:37.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.210+0000 7f9dfa389640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df40710a0 con 0x7f9df40c37d0 2023-11-04T01:41:37.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.210+0000 7f9df3fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9df41460c0 0x7f9df40b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.210+0000 7f9df3fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9df41460c0 0x7f9df40b1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43858/0 (socket says 172.21.15.77:43858) 2023-11-04T01:41:37.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.210+0000 7f9df3fff640 1 -- 172.21.15.77:0/530972816 learned_addr learned my addr 172.21.15.77:0/530972816 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:37.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.210+0000 7f9df37fe640 1 --2- 172.21.15.77:0/530972816 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9df40c37d0 0x7f9df40c3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.210+0000 7f9df8926640 1 --2- 172.21.15.77:0/530972816 >> v2:172.21.15.122:3300/0 conn(0x7f9df4070710 0x7f9df4070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.211+0000 7f9df3fff640 1 -- 172.21.15.77:0/530972816 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9df40c37d0 msgr2=0x7f9df40c3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.211+0000 7f9df3fff640 1 --2- 172.21.15.77:0/530972816 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9df40c37d0 0x7f9df40c3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.211+0000 7f9df3fff640 1 -- 172.21.15.77:0/530972816 >> v2:172.21.15.122:3300/0 conn(0x7f9df4070710 msgr2=0x7f9df4070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.211+0000 7f9df3fff640 1 --2- 172.21.15.77:0/530972816 >> v2:172.21.15.122:3300/0 conn(0x7f9df4070710 0x7f9df4070b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.211+0000 7f9df3fff640 1 -- 172.21.15.77:0/530972816 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df4146950 con 0x7f9df41460c0 2023-11-04T01:41:37.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.211+0000 7f9df3fff640 1 --2- 172.21.15.77:0/530972816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9df41460c0 0x7f9df40b1860 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9df4071210 tx=0x7f9de402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf6a92217d98c76e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.211+0000 7f9df2ffd640 1 -- 172.21.15.77:0/530972816 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de4031640 con 0x7f9df41460c0 2023-11-04T01:41:37.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.211+0000 7f9df2ffd640 1 -- 172.21.15.77:0/530972816 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de40317a0 con 0x7f9df41460c0 2023-11-04T01:41:37.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.212+0000 7f9df2ffd640 1 -- 172.21.15.77:0/530972816 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de4031b30 con 0x7f9df41460c0 2023-11-04T01:41:37.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.212+0000 7f9dfa389640 1 -- 172.21.15.77:0/530972816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9df41460c0 msgr2=0x7f9df40b1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.212+0000 7f9dfa389640 1 --2- 172.21.15.77:0/530972816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9df41460c0 0x7f9df40b1860 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9df4071210 tx=0x7f9de402b8f0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.212+0000 7f9dfa389640 1 -- 172.21.15.77:0/530972816 shutdown_connections 2023-11-04T01:41:37.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.212+0000 7f9dfa389640 1 --2- 172.21.15.77:0/530972816 >> v2:172.21.15.122:3300/0 conn(0x7f9df4070710 0x7f9df4070b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.212+0000 7f9dfa389640 1 --2- 172.21.15.77:0/530972816 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9df40c37d0 0x7f9df40c3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.212+0000 7f9dfa389640 1 --2- 172.21.15.77:0/530972816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9df41460c0 0x7f9df40b1860 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.212+0000 7f9dfa389640 1 -- 172.21.15.77:0/530972816 >> 172.21.15.77:0/530972816 conn(0x7f9df40ce950 msgr2=0x7f9df40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:37.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.212+0000 7f9dfa389640 1 -- 172.21.15.77:0/530972816 shutdown_connections 2023-11-04T01:41:37.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.212+0000 7f9dfa389640 1 -- 172.21.15.77:0/530972816 wait complete. 2023-11-04T01:41:37.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.213+0000 7f9dfa389640 1 Processor -- start 2023-11-04T01:41:37.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.213+0000 7f9dfa389640 1 -- start start 2023-11-04T01:41:37.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.214+0000 7f9dfa389640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9df4070710 0x7f9df40b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.214+0000 7f9dfa389640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9df40c37d0 0x7f9df40b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.214+0000 7f9dfa389640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9df41460c0 0x7f9df415caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.214+0000 7f9dfa389640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df40b1d30 con 0x7f9df41460c0 2023-11-04T01:41:37.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.214+0000 7f9dfa389640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df40b2010 con 0x7f9df4070710 2023-11-04T01:41:37.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.214+0000 7f9dfa389640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df40b22f0 con 0x7f9df40c37d0 2023-11-04T01:41:37.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.214+0000 7f9df8926640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9df41460c0 0x7f9df415caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.214+0000 7f9df8926640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9df41460c0 0x7f9df415caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43860/0 (socket says 172.21.15.77:43860) 2023-11-04T01:41:37.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.214+0000 7f9df8926640 1 -- 172.21.15.77:0/331637774 learned_addr learned my addr 172.21.15.77:0/331637774 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:37.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.214+0000 7f9df3fff640 1 --2- 172.21.15.77:0/331637774 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9df4070710 0x7f9df40b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.214+0000 7f9df37fe640 1 --2- 172.21.15.77:0/331637774 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9df40c37d0 0x7f9df40b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.215+0000 7f9df8926640 1 -- 172.21.15.77:0/331637774 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9df40c37d0 msgr2=0x7f9df40b2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.215+0000 7f9df8926640 1 --2- 172.21.15.77:0/331637774 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9df40c37d0 0x7f9df40b2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.215+0000 7f9df8926640 1 -- 172.21.15.77:0/331637774 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9df4070710 msgr2=0x7f9df40b14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.215+0000 7f9df8926640 1 --2- 172.21.15.77:0/331637774 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9df4070710 0x7f9df40b14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.215+0000 7f9df8926640 1 -- 172.21.15.77:0/331637774 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de40094d0 con 0x7f9df41460c0 2023-11-04T01:41:37.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.215+0000 7f9df8926640 1 --2- 172.21.15.77:0/331637774 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9df41460c0 0x7f9df415caa0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9dec007e60 tx=0x7f9dec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.215+0000 7f9df0ff9640 1 -- 172.21.15.77:0/331637774 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec014420 con 0x7f9df41460c0 2023-11-04T01:41:37.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.215+0000 7f9df0ff9640 1 -- 172.21.15.77:0/331637774 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dec0145a0 con 0x7f9df41460c0 2023-11-04T01:41:37.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.215+0000 7f9dfa389640 1 -- 172.21.15.77:0/331637774 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9df40b25d0 con 0x7f9df41460c0 2023-11-04T01:41:37.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.215+0000 7f9df0ff9640 1 -- 172.21.15.77:0/331637774 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec014950 con 0x7f9df41460c0 2023-11-04T01:41:37.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.215+0000 7f9dfa389640 1 -- 172.21.15.77:0/331637774 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9df40b1a20 con 0x7f9df41460c0 2023-11-04T01:41:37.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.216+0000 7f9dfa389640 1 -- 172.21.15.77:0/331637774 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9df40b2af0 con 0x7f9df41460c0 2023-11-04T01:41:37.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.216+0000 7f9df0ff9640 1 -- 172.21.15.77:0/331637774 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9dec014ab0 con 0x7f9df41460c0 2023-11-04T01:41:37.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.216+0000 7f9df0ff9640 1 --2- 172.21.15.77:0/331637774 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9de006ae70 0x7f9de006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.217+0000 7f9df0ff9640 1 -- 172.21.15.77:0/331637774 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f9dec08a0c0 con 0x7f9df41460c0 2023-11-04T01:41:37.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.217+0000 7f9df3fff640 1 --2- 172.21.15.77:0/331637774 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9de006ae70 0x7f9de006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.217+0000 7f9df3fff640 1 --2- 172.21.15.77:0/331637774 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9de006ae70 0x7f9de006d330 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9de4036000 tx=0x7f9de403c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.221+0000 7f9df0ff9640 1 -- 172.21.15.77:0/331637774 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9df40b2af0 con 0x7f9df41460c0 2023-11-04T01:41:37.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.387+0000 7f9dfa389640 1 -- 172.21.15.77:0/331637774 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9df40b2af0 con 0x7f9df41460c0 2023-11-04T01:41:37.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.387+0000 7f9df0ff9640 1 -- 172.21.15.77:0/331637774 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9df40b2af0 con 0x7f9df41460c0 2023-11-04T01:41:37.390 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-04T01:41:37.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.389+0000 7f9dfa389640 1 -- 172.21.15.77:0/331637774 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9de006ae70 msgr2=0x7f9de006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.389+0000 7f9dfa389640 1 --2- 172.21.15.77:0/331637774 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9de006ae70 0x7f9de006d330 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9de4036000 tx=0x7f9de403c040 comp rx=0 tx=0).stop 2023-11-04T01:41:37.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.389+0000 7f9dfa389640 1 -- 172.21.15.77:0/331637774 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9df41460c0 msgr2=0x7f9df415caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.389+0000 7f9dfa389640 1 --2- 172.21.15.77:0/331637774 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9df41460c0 0x7f9df415caa0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9dec007e60 tx=0x7f9dec00e4b0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.389+0000 7f9dfa389640 1 -- 172.21.15.77:0/331637774 shutdown_connections 2023-11-04T01:41:37.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.389+0000 7f9dfa389640 1 --2- 172.21.15.77:0/331637774 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9de006ae70 0x7f9de006d330 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.389+0000 7f9dfa389640 1 --2- 172.21.15.77:0/331637774 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9df41460c0 0x7f9df415caa0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.389+0000 7f9dfa389640 1 --2- 172.21.15.77:0/331637774 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9df40c37d0 0x7f9df40b2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.389+0000 7f9dfa389640 1 --2- 172.21.15.77:0/331637774 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9df4070710 0x7f9df40b14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.389+0000 7f9dfa389640 1 -- 172.21.15.77:0/331637774 >> 172.21.15.77:0/331637774 conn(0x7f9df40ce950 msgr2=0x7f9df415fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:37.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.389+0000 7f9dfa389640 1 -- 172.21.15.77:0/331637774 shutdown_connections 2023-11-04T01:41:37.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.389+0000 7f9dfa389640 1 -- 172.21.15.77:0/331637774 wait complete. 2023-11-04T01:41:37.403 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:41:37.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.502+0000 7f65e7ec2640 1 Processor -- start 2023-11-04T01:41:37.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.503+0000 7f65e7ec2640 1 -- start start 2023-11-04T01:41:37.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.503+0000 7f65e7ec2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f65e0159c00 0x7f65e00cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.503+0000 7f65e7ec2640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f65e00ae1d0 0x7f65e00c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.503+0000 7f65e7ec2640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65e015aff0 con 0x7f65e00c48e0 2023-11-04T01:41:37.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.503+0000 7f65e7ec2640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65e00c52d0 con 0x7f65e0159c00 2023-11-04T01:41:37.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.503+0000 7f65e7ec2640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65e015a3e0 con 0x7f65e00ae1d0 2023-11-04T01:41:37.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.504+0000 7f65e5c5e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f65e0159c00 0x7f65e00cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.504+0000 7f65e5c5e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f65e0159c00 0x7f65e00cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45262/0 (socket says 172.21.15.77:45262) 2023-11-04T01:41:37.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.504+0000 7f65e5c5e640 1 -- 172.21.15.77:0/605235520 learned_addr learned my addr 172.21.15.77:0/605235520 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:37.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.504+0000 7f65e645f640 1 --2- 172.21.15.77:0/605235520 >> v2:172.21.15.122:3300/0 conn(0x7f65e00ae1d0 0x7f65e00c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.504+0000 7f65e5c5e640 1 -- 172.21.15.77:0/605235520 >> v2:172.21.15.122:3300/0 conn(0x7f65e00ae1d0 msgr2=0x7f65e00c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.504+0000 7f65e5c5e640 1 --2- 172.21.15.77:0/605235520 >> v2:172.21.15.122:3300/0 conn(0x7f65e00ae1d0 0x7f65e00c4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.504+0000 7f65e5c5e640 1 -- 172.21.15.77:0/605235520 >> v1:172.21.15.122:6789/0 conn(0x7f65e00c48e0 legacy=0x7f65e00adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.504+0000 7f65e5c5e640 1 -- 172.21.15.77:0/605235520 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e015a6c0 con 0x7f65e0159c00 2023-11-04T01:41:37.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.505+0000 7f65e5c5e640 1 --2- 172.21.15.77:0/605235520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65e0159c00 0x7f65e00cc890 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f65e00ce800 tx=0x7f65dc02e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d86cd07c418f8f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.505+0000 7f65e4c5c640 1 -- 172.21.15.77:0/605235520 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65dc02ee00 con 0x7f65e0159c00 2023-11-04T01:41:37.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.505+0000 7f65e4c5c640 1 -- 172.21.15.77:0/605235520 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65dc036440 con 0x7f65e0159c00 2023-11-04T01:41:37.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.505+0000 7f65e4c5c640 1 -- 172.21.15.77:0/605235520 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65dc0367d0 con 0x7f65e0159c00 2023-11-04T01:41:37.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.505+0000 7f65e7ec2640 1 -- 172.21.15.77:0/605235520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65e0159c00 msgr2=0x7f65e00cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.505+0000 7f65e7ec2640 1 --2- 172.21.15.77:0/605235520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65e0159c00 0x7f65e00cc890 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f65e00ce800 tx=0x7f65dc02e050 comp rx=0 tx=0).stop 2023-11-04T01:41:37.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.505+0000 7f65e7ec2640 1 -- 172.21.15.77:0/605235520 shutdown_connections 2023-11-04T01:41:37.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.505+0000 7f65e7ec2640 1 --2- 172.21.15.77:0/605235520 >> v2:172.21.15.122:3300/0 conn(0x7f65e00ae1d0 0x7f65e00c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.505+0000 7f65e7ec2640 1 --2- 172.21.15.77:0/605235520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65e0159c00 0x7f65e00cc890 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.505+0000 7f65e7ec2640 1 -- 172.21.15.77:0/605235520 >> 172.21.15.77:0/605235520 conn(0x7f65e00ce950 msgr2=0x7f65e00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:37.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.505+0000 7f65e7ec2640 1 -- 172.21.15.77:0/605235520 shutdown_connections 2023-11-04T01:41:37.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.505+0000 7f65e7ec2640 1 -- 172.21.15.77:0/605235520 wait complete. 2023-11-04T01:41:37.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.507+0000 7f65e7ec2640 1 Processor -- start 2023-11-04T01:41:37.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.507+0000 7f65e7ec2640 1 -- start start 2023-11-04T01:41:37.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.507+0000 7f65e7ec2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f65e00ae1d0 0x7f65e00c7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.507+0000 7f65e7ec2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f65e00c48e0 0x7f65e01589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.507+0000 7f65e7ec2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65e0159c00 0x7f65e00a74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.507+0000 7f65e7ec2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e01ef750 con 0x7f65e0159c00 2023-11-04T01:41:37.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.507+0000 7f65e7ec2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e00c7fb0 con 0x7f65e00ae1d0 2023-11-04T01:41:37.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.507+0000 7f65e7ec2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e00c8290 con 0x7f65e00c48e0 2023-11-04T01:41:37.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.507+0000 7f65e645f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65e0159c00 0x7f65e00a74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.507+0000 7f65e645f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65e0159c00 0x7f65e00a74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45272/0 (socket says 172.21.15.77:45272) 2023-11-04T01:41:37.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.507+0000 7f65e645f640 1 -- 172.21.15.77:0/1951167604 learned_addr learned my addr 172.21.15.77:0/1951167604 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:37.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.508+0000 7f65e5c5e640 1 --2- 172.21.15.77:0/1951167604 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f65e00ae1d0 0x7f65e00c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.508+0000 7f65e545d640 1 --2- 172.21.15.77:0/1951167604 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f65e00c48e0 0x7f65e01589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.508+0000 7f65e645f640 1 -- 172.21.15.77:0/1951167604 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f65e00c48e0 msgr2=0x7f65e01589b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.508+0000 7f65e645f640 1 --2- 172.21.15.77:0/1951167604 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f65e00c48e0 0x7f65e01589b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.508+0000 7f65e645f640 1 -- 172.21.15.77:0/1951167604 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f65e00ae1d0 msgr2=0x7f65e00c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.508+0000 7f65e645f640 1 --2- 172.21.15.77:0/1951167604 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f65e00ae1d0 0x7f65e00c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.508+0000 7f65e645f640 1 -- 172.21.15.77:0/1951167604 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65dc00b770 con 0x7f65e0159c00 2023-11-04T01:41:37.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.508+0000 7f65e545d640 1 --2- 172.21.15.77:0/1951167604 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f65e00c48e0 0x7f65e01589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:37.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.508+0000 7f65e645f640 1 --2- 172.21.15.77:0/1951167604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65e0159c00 0x7f65e00a74c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f65d800cd70 tx=0x7f65d800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.508+0000 7f65d67fc640 1 -- 172.21.15.77:0/1951167604 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d8003b90 con 0x7f65e0159c00 2023-11-04T01:41:37.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.508+0000 7f65d67fc640 1 -- 172.21.15.77:0/1951167604 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d8003cf0 con 0x7f65e0159c00 2023-11-04T01:41:37.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.508+0000 7f65e7ec2640 1 -- 172.21.15.77:0/1951167604 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65e00c8570 con 0x7f65e0159c00 2023-11-04T01:41:37.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.508+0000 7f65d67fc640 1 -- 172.21.15.77:0/1951167604 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d8004240 con 0x7f65e0159c00 2023-11-04T01:41:37.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.508+0000 7f65e7ec2640 1 -- 172.21.15.77:0/1951167604 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65e0158ef0 con 0x7f65e0159c00 2023-11-04T01:41:37.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.509+0000 7f65e7ec2640 1 -- 172.21.15.77:0/1951167604 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65e00c87b0 con 0x7f65e0159c00 2023-11-04T01:41:37.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.510+0000 7f65d67fc640 1 -- 172.21.15.77:0/1951167604 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f65d80043a0 con 0x7f65e0159c00 2023-11-04T01:41:37.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.510+0000 7f65d67fc640 1 --2- 172.21.15.77:0/1951167604 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f65c406ae70 0x7f65c406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.510+0000 7f65d67fc640 1 -- 172.21.15.77:0/1951167604 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f65d8012070 con 0x7f65e0159c00 2023-11-04T01:41:37.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.510+0000 7f65e5c5e640 1 --2- 172.21.15.77:0/1951167604 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f65c406ae70 0x7f65c406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.511+0000 7f65e5c5e640 1 --2- 172.21.15.77:0/1951167604 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f65c406ae70 0x7f65c406d330 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f65dc038000 tx=0x7f65dc032000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.514+0000 7f65d67fc640 1 -- 172.21.15.77:0/1951167604 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f65e00c87b0 con 0x7f65e0159c00 2023-11-04T01:41:37.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.681+0000 7f65e7ec2640 1 -- 172.21.15.77:0/1951167604 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f65e01ef4b0 con 0x7f65e0159c00 2023-11-04T01:41:37.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.681+0000 7f65d67fc640 1 -- 172.21.15.77:0/1951167604 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v41) v1 ==== 103+0+11 (secure 0 0 0) 0x7f65e01ef4b0 con 0x7f65e0159c00 2023-11-04T01:41:37.685 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:41:37.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.683+0000 7f65e7ec2640 1 -- 172.21.15.77:0/1951167604 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f65c406ae70 msgr2=0x7f65c406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.683+0000 7f65e7ec2640 1 --2- 172.21.15.77:0/1951167604 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f65c406ae70 0x7f65c406d330 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f65dc038000 tx=0x7f65dc032000 comp rx=0 tx=0).stop 2023-11-04T01:41:37.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.683+0000 7f65e7ec2640 1 -- 172.21.15.77:0/1951167604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65e0159c00 msgr2=0x7f65e00a74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.683+0000 7f65e7ec2640 1 --2- 172.21.15.77:0/1951167604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65e0159c00 0x7f65e00a74c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f65d800cd70 tx=0x7f65d800a660 comp rx=0 tx=0).stop 2023-11-04T01:41:37.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.683+0000 7f65e7ec2640 1 -- 172.21.15.77:0/1951167604 shutdown_connections 2023-11-04T01:41:37.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.683+0000 7f65e7ec2640 1 --2- 172.21.15.77:0/1951167604 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f65c406ae70 0x7f65c406d330 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.683+0000 7f65e7ec2640 1 --2- 172.21.15.77:0/1951167604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65e0159c00 0x7f65e00a74c0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.683+0000 7f65e7ec2640 1 --2- 172.21.15.77:0/1951167604 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f65e00c48e0 0x7f65e01589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.683+0000 7f65e7ec2640 1 --2- 172.21.15.77:0/1951167604 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f65e00ae1d0 0x7f65e00c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.683+0000 7f65e7ec2640 1 -- 172.21.15.77:0/1951167604 >> 172.21.15.77:0/1951167604 conn(0x7f65e00ce950 msgr2=0x7f65e006d080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:37.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.683+0000 7f65e7ec2640 1 -- 172.21.15.77:0/1951167604 shutdown_connections 2023-11-04T01:41:37.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.683+0000 7f65e7ec2640 1 -- 172.21.15.77:0/1951167604 wait complete. 2023-11-04T01:41:37.697 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:41:37.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.796+0000 7f5925b97640 1 Processor -- start 2023-11-04T01:41:37.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.796+0000 7f5925b97640 1 -- start start 2023-11-04T01:41:37.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.797+0000 7f5925b97640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5920160430 0x7f59200b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.797+0000 7f5925b97640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f59200b2b60 0x7f592006bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.797+0000 7f5925b97640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f592006c1d0 0x7f5920160b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.797+0000 7f5925b97640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59200cb580 con 0x7f59200b2b60 2023-11-04T01:41:37.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.797+0000 7f5925b97640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59200b2fc0 con 0x7f592006c1d0 2023-11-04T01:41:37.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.797+0000 7f5925b97640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f592006ca40 con 0x7f5920160430 2023-11-04T01:41:37.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.797+0000 7f5916ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f59200b2b60 0x7f592006bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.797+0000 7f5916ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f59200b2b60 0x7f592006bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45278/0 (socket says 172.21.15.77:45278) 2023-11-04T01:41:37.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.797+0000 7f5916ffd640 1 -- 172.21.15.77:0/1331953276 learned_addr learned my addr 172.21.15.77:0/1331953276 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:37.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.797+0000 7f591f7fe640 1 --2- 172.21.15.77:0/1331953276 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5920160430 0x7f59200b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.798+0000 7f591ffff640 1 --2- 172.21.15.77:0/1331953276 >> v2:172.21.15.122:3300/0 conn(0x7f592006c1d0 0x7f5920160b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.798+0000 7f5916ffd640 1 -- 172.21.15.77:0/1331953276 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5920160430 msgr2=0x7f59200b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.798+0000 7f5916ffd640 1 --2- 172.21.15.77:0/1331953276 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5920160430 0x7f59200b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.798+0000 7f5916ffd640 1 -- 172.21.15.77:0/1331953276 >> v2:172.21.15.122:3300/0 conn(0x7f592006c1d0 msgr2=0x7f5920160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:37.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.798+0000 7f5916ffd640 1 --2- 172.21.15.77:0/1331953276 >> v2:172.21.15.122:3300/0 conn(0x7f592006c1d0 0x7f5920160b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.798+0000 7f5916ffd640 1 -- 172.21.15.77:0/1331953276 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592006cd20 con 0x7f59200b2b60 2023-11-04T01:41:37.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.798+0000 7f5916ffd640 1 --2- 172.21.15.77:0/1331953276 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59200b2b60 0x7f592006bc90 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f59200ce900 tx=0x7f590802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43e54aeaf59f352c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.798+0000 7f591effd640 1 -- 172.21.15.77:0/1331953276 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5908031870 con 0x7f59200b2b60 2023-11-04T01:41:37.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.798+0000 7f591effd640 1 -- 172.21.15.77:0/1331953276 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59080319d0 con 0x7f59200b2b60 2023-11-04T01:41:37.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.799+0000 7f591effd640 1 -- 172.21.15.77:0/1331953276 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5908031d60 con 0x7f59200b2b60 2023-11-04T01:41:37.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.799+0000 7f5925b97640 1 -- 172.21.15.77:0/1331953276 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59200b2b60 msgr2=0x7f592006bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.799+0000 7f5925b97640 1 --2- 172.21.15.77:0/1331953276 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59200b2b60 0x7f592006bc90 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f59200ce900 tx=0x7f590802b910 comp rx=0 tx=0).stop 2023-11-04T01:41:37.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.799+0000 7f5925b97640 1 -- 172.21.15.77:0/1331953276 shutdown_connections 2023-11-04T01:41:37.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.799+0000 7f5925b97640 1 --2- 172.21.15.77:0/1331953276 >> v2:172.21.15.122:3300/0 conn(0x7f592006c1d0 0x7f5920160b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.799+0000 7f5925b97640 1 --2- 172.21.15.77:0/1331953276 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59200b2b60 0x7f592006bc90 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.799+0000 7f5925b97640 1 --2- 172.21.15.77:0/1331953276 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5920160430 0x7f59200b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.799+0000 7f5925b97640 1 -- 172.21.15.77:0/1331953276 >> 172.21.15.77:0/1331953276 conn(0x7f592006ea20 msgr2=0x7f592006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:37.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.799+0000 7f5925b97640 1 -- 172.21.15.77:0/1331953276 shutdown_connections 2023-11-04T01:41:37.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.799+0000 7f5925b97640 1 -- 172.21.15.77:0/1331953276 wait complete. 2023-11-04T01:41:37.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.800+0000 7f5925b97640 1 Processor -- start 2023-11-04T01:41:37.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.800+0000 7f5925b97640 1 -- start start 2023-11-04T01:41:37.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.801+0000 7f5925b97640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f592006c1d0 0x7f59200c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.801+0000 7f5925b97640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f59200b2b60 0x7f59200c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.801+0000 7f5925b97640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5920160430 0x7f5920152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.801+0000 7f5925b97640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59200c5130 con 0x7f5920160430 2023-11-04T01:41:37.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.801+0000 7f5925b97640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59200c8c10 con 0x7f592006c1d0 2023-11-04T01:41:37.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.801+0000 7f5925b97640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59200c8370 con 0x7f59200b2b60 2023-11-04T01:41:37.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.801+0000 7f591ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5920160430 0x7f5920152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.801+0000 7f591ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5920160430 0x7f5920152300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45284/0 (socket says 172.21.15.77:45284) 2023-11-04T01:41:37.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.801+0000 7f591ffff640 1 -- 172.21.15.77:0/2190444346 learned_addr learned my addr 172.21.15.77:0/2190444346 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:37.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.801+0000 7f5916ffd640 1 --2- 172.21.15.77:0/2190444346 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f59200b2b60 0x7f59200c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.801+0000 7f591f7fe640 1 --2- 172.21.15.77:0/2190444346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f592006c1d0 0x7f59200c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.802+0000 7f591ffff640 1 -- 172.21.15.77:0/2190444346 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f59200b2b60 msgr2=0x7f59200c4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.802+0000 7f591ffff640 1 --2- 172.21.15.77:0/2190444346 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f59200b2b60 0x7f59200c4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.802+0000 7f591ffff640 1 -- 172.21.15.77:0/2190444346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f592006c1d0 msgr2=0x7f59200c7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.802+0000 7f591ffff640 1 --2- 172.21.15.77:0/2190444346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f592006c1d0 0x7f59200c7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.802+0000 7f591ffff640 1 -- 172.21.15.77:0/2190444346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59080094d0 con 0x7f5920160430 2023-11-04T01:41:37.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.802+0000 7f591ffff640 1 --2- 172.21.15.77:0/2190444346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5920160430 0x7f5920152300 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f5918007e60 tx=0x7f591800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.802+0000 7f591cff9640 1 -- 172.21.15.77:0/2190444346 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5918014620 con 0x7f5920160430 2023-11-04T01:41:37.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.802+0000 7f591cff9640 1 -- 172.21.15.77:0/2190444346 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591800ee90 con 0x7f5920160430 2023-11-04T01:41:37.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.802+0000 7f591cff9640 1 -- 172.21.15.77:0/2190444346 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59180149e0 con 0x7f5920160430 2023-11-04T01:41:37.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.802+0000 7f5925b97640 1 -- 172.21.15.77:0/2190444346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59200c8650 con 0x7f5920160430 2023-11-04T01:41:37.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.802+0000 7f5925b97640 1 -- 172.21.15.77:0/2190444346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59200c93a0 con 0x7f5920160430 2023-11-04T01:41:37.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.803+0000 7f5925b97640 1 -- 172.21.15.77:0/2190444346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5920074290 con 0x7f5920160430 2023-11-04T01:41:37.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.803+0000 7f591cff9640 1 -- 172.21.15.77:0/2190444346 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5918014b40 con 0x7f5920160430 2023-11-04T01:41:37.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.804+0000 7f591cff9640 1 --2- 172.21.15.77:0/2190444346 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f590006ae70 0x7f590006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:37.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.804+0000 7f591cff9640 1 -- 172.21.15.77:0/2190444346 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f591808a1c0 con 0x7f5920160430 2023-11-04T01:41:37.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.804+0000 7f591f7fe640 1 --2- 172.21.15.77:0/2190444346 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f590006ae70 0x7f590006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:37.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.804+0000 7f591f7fe640 1 --2- 172.21.15.77:0/2190444346 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f590006ae70 0x7f590006d330 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5910006fd0 tx=0x7f5910008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:37.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.808+0000 7f591cff9640 1 -- 172.21.15.77:0/2190444346 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5918055020 con 0x7f5920160430 2023-11-04T01:41:37.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.985+0000 7f5925b97640 1 -- 172.21.15.77:0/2190444346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f59200b6b20 con 0x7f5920160430 2023-11-04T01:41:37.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.985+0000 7f591cff9640 1 -- 172.21.15.77:0/2190444346 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v41) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5918058640 con 0x7f5920160430 2023-11-04T01:41:37.989 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-11-04T01:41:37.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.987+0000 7f5925b97640 1 -- 172.21.15.77:0/2190444346 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f590006ae70 msgr2=0x7f590006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.987+0000 7f5925b97640 1 --2- 172.21.15.77:0/2190444346 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f590006ae70 0x7f590006d330 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5910006fd0 tx=0x7f5910008040 comp rx=0 tx=0).stop 2023-11-04T01:41:37.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.987+0000 7f5925b97640 1 -- 172.21.15.77:0/2190444346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5920160430 msgr2=0x7f5920152300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:37.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.987+0000 7f5925b97640 1 --2- 172.21.15.77:0/2190444346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5920160430 0x7f5920152300 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f5918007e60 tx=0x7f591800e4b0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.987+0000 7f5925b97640 1 -- 172.21.15.77:0/2190444346 shutdown_connections 2023-11-04T01:41:37.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.987+0000 7f5925b97640 1 --2- 172.21.15.77:0/2190444346 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f590006ae70 0x7f590006d330 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.987+0000 7f5925b97640 1 --2- 172.21.15.77:0/2190444346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5920160430 0x7f5920152300 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.987+0000 7f5925b97640 1 --2- 172.21.15.77:0/2190444346 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f59200b2b60 0x7f59200c4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.987+0000 7f5925b97640 1 --2- 172.21.15.77:0/2190444346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f592006c1d0 0x7f59200c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:37.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.987+0000 7f5925b97640 1 -- 172.21.15.77:0/2190444346 >> 172.21.15.77:0/2190444346 conn(0x7f592006ea20 msgr2=0x7f59200b2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:37.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.987+0000 7f5925b97640 1 -- 172.21.15.77:0/2190444346 shutdown_connections 2023-11-04T01:41:37.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:37.987+0000 7f5925b97640 1 -- 172.21.15.77:0/2190444346 wait complete. 2023-11-04T01:41:38.001 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi077.front.sepia.ceph.com... 2023-11-04T01:41:38.002 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:41:38.002 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T01:41:38.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:41:38.062 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[135205]: fuse finished with error 0 and tester_r 0 2023-11-04T01:41:38.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:41:38.067 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:2023-11-04T01:41:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:41:38.069 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2023-11-04T01:41:38.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:38.070 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:41:38.085 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:41:38.086 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:41:38.105 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056339,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13650 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:41:38.105 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi122.front.sepia.ceph.com 2023-11-04T01:41:38.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:38.106 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:41:38.162 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:41:38.163 INFO:teuthology.orchestra.run.smithi122.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-04T01:41:38.164 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:41:38.164 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:41:38.180 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19534 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:41:38.181 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2023-11-04T01:41:38.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:38.182 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:41:38.236 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:41:38.237 INFO:teuthology.orchestra.run.smithi077.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-04T01:41:38.237 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:41:38.238 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:41:38.256 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056339,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13650 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:41:38.256 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi122.front.sepia.ceph.com 2023-11-04T01:41:38.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:41:38.257 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:41:38.313 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:41:38.314 INFO:teuthology.orchestra.run.smithi122.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-04T01:41:38.314 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:38.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.412+0000 7f8ba1597640 1 Processor -- start 2023-11-04T01:41:38.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.412+0000 7f8ba1597640 1 -- start start 2023-11-04T01:41:38.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.413+0000 7f8ba1597640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8b9c0ce240 0x7f8b9c157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:38.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.413+0000 7f8ba1597640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b9c15e000 con 0x7f8b9c157540 2023-11-04T01:41:38.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.413+0000 7f8ba1597640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b9c15e2e0 con 0x7f8b9c0cde60 2023-11-04T01:41:38.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.413+0000 7f8ba1597640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b9c15e5c0 con 0x7f8b9c0ce240 2023-11-04T01:41:38.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.413+0000 7f8b93fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8b9c0ce240 0x7f8b9c157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:38.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.413+0000 7f8b9b7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f8b9c157540 0x7f8b9c0d1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:50720/0 (socket says 172.21.15.77:50720) 2023-11-04T01:41:38.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.413+0000 7f8b9b7fe640 1 -- 172.21.15.77:0/835228077 learned_addr learned my addr 172.21.15.77:0/835228077 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:38.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.413+0000 7f8b93fff640 1 -- 172.21.15.77:0/835228077 >> v1:172.21.15.122:6789/0 conn(0x7f8b9c0cde60 legacy=0x7f8b9c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:38.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.413+0000 7f8b93fff640 1 -- 172.21.15.77:0/835228077 >> v1:172.21.15.77:6789/0 conn(0x7f8b9c157540 legacy=0x7f8b9c0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:38.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.413+0000 7f8b9a7fc640 1 -- 172.21.15.77:0/835228077 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 6045173 0 0) 0x7f8b9c15e000 con 0x7f8b9c157540 2023-11-04T01:41:38.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.413+0000 7f8b93fff640 1 -- 172.21.15.77:0/835228077 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9c0d1120 con 0x7f8b9c0ce240 2023-11-04T01:41:38.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.414+0000 7f8b93fff640 1 --2- 172.21.15.77:0/835228077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b9c0ce240 0x7f8b9c157000 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f8b840097a0 tx=0x7f8b8402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd1a557e235f413b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:38.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.414+0000 7f8b9a7fc640 1 -- 172.21.15.77:0/835228077 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b84031830 con 0x7f8b9c0ce240 2023-11-04T01:41:38.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.414+0000 7f8b9a7fc640 1 -- 172.21.15.77:0/835228077 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b84031990 con 0x7f8b9c0ce240 2023-11-04T01:41:38.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.414+0000 7f8b9a7fc640 1 -- 172.21.15.77:0/835228077 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b84031d20 con 0x7f8b9c0ce240 2023-11-04T01:41:38.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.415+0000 7f8ba1597640 1 -- 172.21.15.77:0/835228077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b9c0ce240 msgr2=0x7f8b9c157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:38.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.415+0000 7f8ba1597640 1 --2- 172.21.15.77:0/835228077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b9c0ce240 0x7f8b9c157000 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f8b840097a0 tx=0x7f8b8402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:38.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.415+0000 7f8ba1597640 1 -- 172.21.15.77:0/835228077 shutdown_connections 2023-11-04T01:41:38.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.415+0000 7f8ba1597640 1 --2- 172.21.15.77:0/835228077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b9c0ce240 0x7f8b9c157000 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:38.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.415+0000 7f8ba1597640 1 -- 172.21.15.77:0/835228077 >> 172.21.15.77:0/835228077 conn(0x7f8b9c071f30 msgr2=0x7f8b9c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:38.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.415+0000 7f8ba1597640 1 -- 172.21.15.77:0/835228077 shutdown_connections 2023-11-04T01:41:38.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.415+0000 7f8ba1597640 1 -- 172.21.15.77:0/835228077 wait complete. 2023-11-04T01:41:38.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.416+0000 7f8ba1597640 1 Processor -- start 2023-11-04T01:41:38.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.416+0000 7f8ba1597640 1 -- start start 2023-11-04T01:41:38.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.417+0000 7f8ba1597640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b9c0cde60 0x7f8b9c15b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:38.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.417+0000 7f8ba1597640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b9c0ce240 0x7f8b9c0cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:38.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.417+0000 7f8ba1597640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b9c157540 0x7f8b9c14c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:38.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.417+0000 7f8ba1597640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c157b30 con 0x7f8b9c0ce240 2023-11-04T01:41:38.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.417+0000 7f8ba1597640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c1f65f0 con 0x7f8b9c0cde60 2023-11-04T01:41:38.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.417+0000 7f8ba1597640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c1f68d0 con 0x7f8b9c157540 2023-11-04T01:41:38.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.417+0000 7f8b93fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b9c0ce240 0x7f8b9c0cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:38.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.417+0000 7f8b93fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b9c0ce240 0x7f8b9c0cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45306/0 (socket says 172.21.15.77:45306) 2023-11-04T01:41:38.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.417+0000 7f8b93fff640 1 -- 172.21.15.77:0/966145191 learned_addr learned my addr 172.21.15.77:0/966145191 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:38.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.417+0000 7f8b93fff640 1 -- 172.21.15.77:0/966145191 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b9c157540 msgr2=0x7f8b9c14c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:38.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.417+0000 7f8b93fff640 1 --2- 172.21.15.77:0/966145191 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b9c157540 0x7f8b9c14c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:38.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.417+0000 7f8b93fff640 1 -- 172.21.15.77:0/966145191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b9c0cde60 msgr2=0x7f8b9c15b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:38.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.417+0000 7f8b93fff640 1 --2- 172.21.15.77:0/966145191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b9c0cde60 0x7f8b9c15b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:38.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.417+0000 7f8b93fff640 1 -- 172.21.15.77:0/966145191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b84009400 con 0x7f8b9c0ce240 2023-11-04T01:41:38.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.417+0000 7f8b93fff640 1 --2- 172.21.15.77:0/966145191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b9c0ce240 0x7f8b9c0cbf40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8b840098c0 tx=0x7f8b840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:38.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.417+0000 7f8b937fe640 1 -- 172.21.15.77:0/966145191 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8403ba70 con 0x7f8b9c0ce240 2023-11-04T01:41:38.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.417+0000 7f8b937fe640 1 -- 172.21.15.77:0/966145191 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8403bbf0 con 0x7f8b9c0ce240 2023-11-04T01:41:38.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.417+0000 7f8b937fe640 1 -- 172.21.15.77:0/966145191 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b840453f0 con 0x7f8b9c0ce240 2023-11-04T01:41:38.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.417+0000 7f8ba1597640 1 -- 172.21.15.77:0/966145191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b9c1f6bb0 con 0x7f8b9c0ce240 2023-11-04T01:41:38.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.417+0000 7f8ba1597640 1 -- 172.21.15.77:0/966145191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b9c153540 con 0x7f8b9c0ce240 2023-11-04T01:41:38.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.418+0000 7f8ba1597640 1 -- 172.21.15.77:0/966145191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b9c153730 con 0x7f8b9c0ce240 2023-11-04T01:41:38.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.419+0000 7f8b937fe640 1 -- 172.21.15.77:0/966145191 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8b8404e450 con 0x7f8b9c0ce240 2023-11-04T01:41:38.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.419+0000 7f8b937fe640 1 --2- 172.21.15.77:0/966145191 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8b7c06ae70 0x7f8b7c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:38.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.419+0000 7f8b937fe640 1 -- 172.21.15.77:0/966145191 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f8b840abb00 con 0x7f8b9c0ce240 2023-11-04T01:41:38.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.420+0000 7f8b9affd640 1 --2- 172.21.15.77:0/966145191 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8b7c06ae70 0x7f8b7c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:38.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.420+0000 7f8b9affd640 1 --2- 172.21.15.77:0/966145191 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8b7c06ae70 0x7f8b7c06d330 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c001560 tx=0x7f8b8c007990 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:38.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.424+0000 7f8b937fe640 1 -- 172.21.15.77:0/966145191 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8b9c153730 con 0x7f8b9c0ce240 2023-11-04T01:41:38.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.623+0000 7f8ba1597640 1 -- 172.21.15.77:0/966145191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b9c153730 con 0x7f8b9c0ce240 2023-11-04T01:41:38.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.623+0000 7f8b937fe640 1 -- 172.21.15.77:0/966145191 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4920 (secure 0 0 0) 0x7f8b9c153730 con 0x7f8b9c0ce240 2023-11-04T01:41:38.627 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:38.627 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5511,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/1132914884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1132914884},{"type":"v1","addr":"172.21.15.77:6834","nonce":1132914884}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5514,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/530959421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":530959421},{"type":"v1","addr":"172.21.15.77:6835","nonce":530959421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":34823,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/1375125704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1375125704},{"type":"v1","addr":"172.21.15.122:6836","nonce":1375125704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:41:24.933073+0000","modified":"2023-11-04T01:41:26.930876+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34826},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34826":{"gid":34826,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/3085479427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":3085479427},{"type":"v1","addr":"172.21.15.122:6837","nonce":3085479427}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-04T01:41:38.628 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 16 2023-11-04T01:41:38.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.625+0000 7f8ba1597640 1 -- 172.21.15.77:0/966145191 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8b7c06ae70 msgr2=0x7f8b7c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:38.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.625+0000 7f8ba1597640 1 --2- 172.21.15.77:0/966145191 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8b7c06ae70 0x7f8b7c06d330 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c001560 tx=0x7f8b8c007990 comp rx=0 tx=0).stop 2023-11-04T01:41:38.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.625+0000 7f8ba1597640 1 -- 172.21.15.77:0/966145191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b9c0ce240 msgr2=0x7f8b9c0cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:38.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.625+0000 7f8ba1597640 1 --2- 172.21.15.77:0/966145191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b9c0ce240 0x7f8b9c0cbf40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8b840098c0 tx=0x7f8b840046c0 comp rx=0 tx=0).stop 2023-11-04T01:41:38.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.625+0000 7f8ba1597640 1 -- 172.21.15.77:0/966145191 shutdown_connections 2023-11-04T01:41:38.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.625+0000 7f8ba1597640 1 --2- 172.21.15.77:0/966145191 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8b7c06ae70 0x7f8b7c06d330 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:38.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.625+0000 7f8ba1597640 1 --2- 172.21.15.77:0/966145191 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b9c157540 0x7f8b9c14c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:38.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.625+0000 7f8ba1597640 1 --2- 172.21.15.77:0/966145191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b9c0ce240 0x7f8b9c0cbf40 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:38.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.625+0000 7f8ba1597640 1 --2- 172.21.15.77:0/966145191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b9c0cde60 0x7f8b9c15b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:38.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.625+0000 7f8ba1597640 1 -- 172.21.15.77:0/966145191 >> 172.21.15.77:0/966145191 conn(0x7f8b9c071f30 msgr2=0x7f8b9c072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:38.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.625+0000 7f8ba1597640 1 -- 172.21.15.77:0/966145191 shutdown_connections 2023-11-04T01:41:38.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.625+0000 7f8ba1597640 1 -- 172.21.15.77:0/966145191 wait complete. 2023-11-04T01:41:38.639 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:38.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.736+0000 7f5e3df2c640 1 Processor -- start 2023-11-04T01:41:38.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.736+0000 7f5e3df2c640 1 -- start start 2023-11-04T01:41:38.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.737+0000 7f5e3df2c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5e38159c70 0x7f5e380ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:38.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.737+0000 7f5e3df2c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5e380b0ae0 0x7f5e3815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:38.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.737+0000 7f5e3df2c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e380b4110 con 0x7f5e3806db20 2023-11-04T01:41:38.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.737+0000 7f5e3df2c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e380b49b0 con 0x7f5e380b0ae0 2023-11-04T01:41:38.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.737+0000 7f5e3df2c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e380b43f0 con 0x7f5e38159c70 2023-11-04T01:41:38.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.737+0000 7f5e37fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5e380b0ae0 0x7f5e3815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:38.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.737+0000 7f5e377fe640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5e38159c70 0x7f5e380ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:38.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.737+0000 7f5e37fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5e380b0ae0 0x7f5e3815d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:45720/0 (socket says 172.21.15.77:45720) 2023-11-04T01:41:38.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.737+0000 7f5e377fe640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5e38159c70 0x7f5e380ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:50866/0 (socket says 172.21.15.77:50866) 2023-11-04T01:41:38.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.737+0000 7f5e37fff640 1 -- 172.21.15.77:0/1496207186 learned_addr learned my addr 172.21.15.77:0/1496207186 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:38.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.737+0000 7f5e36ffd640 1 --1- 172.21.15.77:0/1496207186 >> v1:172.21.15.122:6789/0 conn(0x7f5e3806db20 0x7f5e380b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:47150/0 (socket says 172.21.15.77:47150) 2023-11-04T01:41:38.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.737+0000 7f5e37fff640 1 -- 172.21.15.77:0/1496207186 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5e38159c70 msgr2=0x7f5e380ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:38.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.737+0000 7f5e37fff640 1 --2- 172.21.15.77:0/1496207186 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5e38159c70 0x7f5e380ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:38.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.737+0000 7f5e37fff640 1 -- 172.21.15.77:0/1496207186 >> v1:172.21.15.122:6789/0 conn(0x7f5e3806db20 legacy=0x7f5e380b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:38.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.737+0000 7f5e37fff640 1 -- 172.21.15.77:0/1496207186 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e380b46d0 con 0x7f5e380b0ae0 2023-11-04T01:41:38.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.738+0000 7f5e37fff640 1 --2- 172.21.15.77:0/1496207186 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e380b0ae0 0x7f5e3815d7d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5e28009e50 tx=0x7f5e2802bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdb40c8b7879d29a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:38.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.742+0000 7f5e367fc640 1 -- 172.21.15.77:0/1496207186 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2802cb00 con 0x7f5e380b0ae0 2023-11-04T01:41:38.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.742+0000 7f5e367fc640 1 -- 172.21.15.77:0/1496207186 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2802cc60 con 0x7f5e380b0ae0 2023-11-04T01:41:38.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.742+0000 7f5e367fc640 1 -- 172.21.15.77:0/1496207186 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e280343f0 con 0x7f5e380b0ae0 2023-11-04T01:41:38.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.743+0000 7f5e3df2c640 1 -- 172.21.15.77:0/1496207186 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e380b0ae0 msgr2=0x7f5e3815d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:38.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.743+0000 7f5e3df2c640 1 --2- 172.21.15.77:0/1496207186 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e380b0ae0 0x7f5e3815d7d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5e28009e50 tx=0x7f5e2802bf60 comp rx=0 tx=0).stop 2023-11-04T01:41:38.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.743+0000 7f5e3df2c640 1 -- 172.21.15.77:0/1496207186 shutdown_connections 2023-11-04T01:41:38.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.743+0000 7f5e3df2c640 1 --2- 172.21.15.77:0/1496207186 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e380b0ae0 0x7f5e3815d7d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:38.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.743+0000 7f5e3df2c640 1 --2- 172.21.15.77:0/1496207186 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5e38159c70 0x7f5e380ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:38.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.743+0000 7f5e3df2c640 1 -- 172.21.15.77:0/1496207186 >> 172.21.15.77:0/1496207186 conn(0x7f5e380ce950 msgr2=0x7f5e380ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:38.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.743+0000 7f5e3df2c640 1 -- 172.21.15.77:0/1496207186 shutdown_connections 2023-11-04T01:41:38.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.743+0000 7f5e3df2c640 1 -- 172.21.15.77:0/1496207186 wait complete. 2023-11-04T01:41:38.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.744+0000 7f5e3df2c640 1 Processor -- start 2023-11-04T01:41:38.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.744+0000 7f5e3df2c640 1 -- start start 2023-11-04T01:41:38.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.745+0000 7f5e3df2c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e3806db20 0x7f5e381526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:38.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.745+0000 7f5e3df2c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5e380b0ae0 0x7f5e3814ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:38.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.745+0000 7f5e3df2c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e38159c70 0x7f5e38070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:38.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.745+0000 7f5e3df2c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e380c5b20 con 0x7f5e3806db20 2023-11-04T01:41:38.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.745+0000 7f5e3df2c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e38155020 con 0x7f5e38159c70 2023-11-04T01:41:38.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.745+0000 7f5e3df2c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e38155300 con 0x7f5e380b0ae0 2023-11-04T01:41:38.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.745+0000 7f5e377fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e3806db20 0x7f5e381526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:38.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.745+0000 7f5e377fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e3806db20 0x7f5e381526d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45314/0 (socket says 172.21.15.77:45314) 2023-11-04T01:41:38.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.745+0000 7f5e377fe640 1 -- 172.21.15.77:0/578917568 learned_addr learned my addr 172.21.15.77:0/578917568 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:38.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.745+0000 7f5e36ffd640 1 --2- 172.21.15.77:0/578917568 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5e380b0ae0 0x7f5e3814ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:38.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.745+0000 7f5e37fff640 1 --2- 172.21.15.77:0/578917568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e38159c70 0x7f5e38070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:38.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.745+0000 7f5e377fe640 1 -- 172.21.15.77:0/578917568 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5e380b0ae0 msgr2=0x7f5e3814ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:38.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.745+0000 7f5e377fe640 1 --2- 172.21.15.77:0/578917568 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5e380b0ae0 0x7f5e3814ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:38.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.745+0000 7f5e377fe640 1 -- 172.21.15.77:0/578917568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e38159c70 msgr2=0x7f5e38070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:38.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.745+0000 7f5e377fe640 1 --2- 172.21.15.77:0/578917568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e38159c70 0x7f5e38070710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:38.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.745+0000 7f5e377fe640 1 -- 172.21.15.77:0/578917568 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e28009b30 con 0x7f5e3806db20 2023-11-04T01:41:38.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.745+0000 7f5e37fff640 1 --2- 172.21.15.77:0/578917568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e38159c70 0x7f5e38070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:38.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.745+0000 7f5e36ffd640 1 --2- 172.21.15.77:0/578917568 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5e380b0ae0 0x7f5e3814ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:38.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.745+0000 7f5e377fe640 1 --2- 172.21.15.77:0/578917568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e3806db20 0x7f5e381526d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5e3000e870 tx=0x7f5e3000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:38.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.745+0000 7f5e1ffff640 1 -- 172.21.15.77:0/578917568 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e300094f0 con 0x7f5e3806db20 2023-11-04T01:41:38.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.745+0000 7f5e1ffff640 1 -- 172.21.15.77:0/578917568 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3000c940 con 0x7f5e3806db20 2023-11-04T01:41:38.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.745+0000 7f5e3df2c640 1 -- 172.21.15.77:0/578917568 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e381555e0 con 0x7f5e3806db20 2023-11-04T01:41:38.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.745+0000 7f5e1ffff640 1 -- 172.21.15.77:0/578917568 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3000ccf0 con 0x7f5e3806db20 2023-11-04T01:41:38.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.745+0000 7f5e3df2c640 1 -- 172.21.15.77:0/578917568 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e38154d10 con 0x7f5e3806db20 2023-11-04T01:41:38.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.746+0000 7f5e3df2c640 1 -- 172.21.15.77:0/578917568 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e380c5d90 con 0x7f5e3806db20 2023-11-04T01:41:38.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.747+0000 7f5e1ffff640 1 -- 172.21.15.77:0/578917568 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5e30013470 con 0x7f5e3806db20 2023-11-04T01:41:38.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.747+0000 7f5e1ffff640 1 --2- 172.21.15.77:0/578917568 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5e2406aea0 0x7f5e2406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:38.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.747+0000 7f5e1ffff640 1 -- 172.21.15.77:0/578917568 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f5e300899a0 con 0x7f5e3806db20 2023-11-04T01:41:38.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.748+0000 7f5e36ffd640 1 --2- 172.21.15.77:0/578917568 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5e2406aea0 0x7f5e2406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:38.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.748+0000 7f5e36ffd640 1 --2- 172.21.15.77:0/578917568 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5e2406aea0 0x7f5e2406d360 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c007fd0 tx=0x7f5e2c007d60 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:38.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.751+0000 7f5e1ffff640 1 -- 172.21.15.77:0/578917568 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5e30054750 con 0x7f5e3806db20 2023-11-04T01:41:38.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.917+0000 7f5e3df2c640 1 -- 172.21.15.77:0/578917568 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e38074290 con 0x7f5e3806db20 2023-11-04T01:41:38.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.918+0000 7f5e1ffff640 1 -- 172.21.15.77:0/578917568 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+18601 (secure 0 0 0) 0x7f5e30017090 con 0x7f5e3806db20 2023-11-04T01:41:38.921 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:38.922 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":41,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:41:35.720651+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:41:22.769937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-04T01:41:23.907965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":1,"length":1}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":1,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:38.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.920+0000 7f5e3df2c640 1 -- 172.21.15.77:0/578917568 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5e2406aea0 msgr2=0x7f5e2406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:38.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.920+0000 7f5e3df2c640 1 --2- 172.21.15.77:0/578917568 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5e2406aea0 0x7f5e2406d360 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c007fd0 tx=0x7f5e2c007d60 comp rx=0 tx=0).stop 2023-11-04T01:41:38.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.920+0000 7f5e3df2c640 1 -- 172.21.15.77:0/578917568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e3806db20 msgr2=0x7f5e381526d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:38.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.920+0000 7f5e3df2c640 1 --2- 172.21.15.77:0/578917568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e3806db20 0x7f5e381526d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5e3000e870 tx=0x7f5e3000ed30 comp rx=0 tx=0).stop 2023-11-04T01:41:38.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.920+0000 7f5e3df2c640 1 -- 172.21.15.77:0/578917568 shutdown_connections 2023-11-04T01:41:38.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.920+0000 7f5e3df2c640 1 --2- 172.21.15.77:0/578917568 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5e2406aea0 0x7f5e2406d360 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:38.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.920+0000 7f5e3df2c640 1 --2- 172.21.15.77:0/578917568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e38159c70 0x7f5e38070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:38.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.920+0000 7f5e3df2c640 1 --2- 172.21.15.77:0/578917568 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5e380b0ae0 0x7f5e3814ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:38.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.920+0000 7f5e3df2c640 1 --2- 172.21.15.77:0/578917568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e3806db20 0x7f5e381526d0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:38.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.920+0000 7f5e3df2c640 1 -- 172.21.15.77:0/578917568 >> 172.21.15.77:0/578917568 conn(0x7f5e380ce950 msgr2=0x7f5e380b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:38.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.921+0000 7f5e3df2c640 1 -- 172.21.15.77:0/578917568 shutdown_connections 2023-11-04T01:41:38.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:38.921+0000 7f5e3df2c640 1 -- 172.21.15.77:0/578917568 wait complete. 2023-11-04T01:41:38.935 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:41:22.769937+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:41:23.907965+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:33.142176+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:41:38.937 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:41:39.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.038+0000 7fc70ee87640 1 Processor -- start 2023-11-04T01:41:39.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.038+0000 7fc70ee87640 1 -- start start 2023-11-04T01:41:39.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.039+0000 7fc70ee87640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc7080c4ff0 0x7fc7080cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:39.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.039+0000 7fc70ee87640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc70815aff0 con 0x7fc7080adac0 2023-11-04T01:41:39.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.039+0000 7fc70ee87640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc70815a3e0 con 0x7fc708159c00 2023-11-04T01:41:39.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.039+0000 7fc70ee87640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc70815a6c0 con 0x7fc7080c4ff0 2023-11-04T01:41:39.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.039+0000 7fc707fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc7080c4ff0 0x7fc7080cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:39.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.039+0000 7fc70d424640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc7080adac0 0x7fc7080adf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:50722/0 (socket says 172.21.15.77:50722) 2023-11-04T01:41:39.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.039+0000 7fc70d424640 1 -- 172.21.15.77:0/3502801420 learned_addr learned my addr 172.21.15.77:0/3502801420 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:39.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.039+0000 7fc707fff640 1 -- 172.21.15.77:0/3502801420 >> v1:172.21.15.122:6789/0 conn(0x7fc708159c00 legacy=0x7fc7080c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:39.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.039+0000 7fc707fff640 1 -- 172.21.15.77:0/3502801420 >> v1:172.21.15.77:6789/0 conn(0x7fc7080adac0 legacy=0x7fc7080adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:39.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.039+0000 7fc707fff640 1 -- 172.21.15.77:0/3502801420 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc70815a9a0 con 0x7fc7080c4ff0 2023-11-04T01:41:39.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.039+0000 7fc7077fe640 1 -- 172.21.15.77:0/3502801420 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1419545096 0 0) 0x7fc70815aff0 con 0x7fc7080adac0 2023-11-04T01:41:39.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.040+0000 7fc707fff640 1 --2- 172.21.15.77:0/3502801420 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7080c4ff0 0x7fc7080cc890 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc6f40097a0 tx=0x7fc6f402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=445eac0db569f121 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:39.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.040+0000 7fc7077fe640 1 -- 172.21.15.77:0/3502801420 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f4031830 con 0x7fc7080c4ff0 2023-11-04T01:41:39.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.040+0000 7fc7077fe640 1 -- 172.21.15.77:0/3502801420 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f4031990 con 0x7fc7080c4ff0 2023-11-04T01:41:39.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.040+0000 7fc7077fe640 1 -- 172.21.15.77:0/3502801420 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f4031d20 con 0x7fc7080c4ff0 2023-11-04T01:41:39.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.040+0000 7fc70ee87640 1 -- 172.21.15.77:0/3502801420 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7080c4ff0 msgr2=0x7fc7080cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:39.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.040+0000 7fc70ee87640 1 --2- 172.21.15.77:0/3502801420 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7080c4ff0 0x7fc7080cc890 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc6f40097a0 tx=0x7fc6f402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.041+0000 7fc70ee87640 1 -- 172.21.15.77:0/3502801420 shutdown_connections 2023-11-04T01:41:39.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.041+0000 7fc70ee87640 1 --2- 172.21.15.77:0/3502801420 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7080c4ff0 0x7fc7080cc890 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.041+0000 7fc70ee87640 1 -- 172.21.15.77:0/3502801420 >> 172.21.15.77:0/3502801420 conn(0x7fc7080ce950 msgr2=0x7fc7080ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:39.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.041+0000 7fc70ee87640 1 -- 172.21.15.77:0/3502801420 shutdown_connections 2023-11-04T01:41:39.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.041+0000 7fc70ee87640 1 -- 172.21.15.77:0/3502801420 wait complete. 2023-11-04T01:41:39.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.042+0000 7fc70ee87640 1 Processor -- start 2023-11-04T01:41:39.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.042+0000 7fc70ee87640 1 -- start start 2023-11-04T01:41:39.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.043+0000 7fc70ee87640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7080adac0 0x7fc7081558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:39.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.043+0000 7fc70ee87640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7080c4ff0 0x7fc708151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:39.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.043+0000 7fc70ee87640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc708159c00 0x7fc70814c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:39.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.043+0000 7fc70ee87640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc708157790 con 0x7fc7080adac0 2023-11-04T01:41:39.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.043+0000 7fc70ee87640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc708151ca0 con 0x7fc7080c4ff0 2023-11-04T01:41:39.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.043+0000 7fc70ee87640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70814ccb0 con 0x7fc708159c00 2023-11-04T01:41:39.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.043+0000 7fc70cc23640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7080adac0 0x7fc7081558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:39.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.043+0000 7fc70cc23640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7080adac0 0x7fc7081558e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45336/0 (socket says 172.21.15.77:45336) 2023-11-04T01:41:39.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.043+0000 7fc70cc23640 1 -- 172.21.15.77:0/499636469 learned_addr learned my addr 172.21.15.77:0/499636469 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:39.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.043+0000 7fc70cc23640 1 -- 172.21.15.77:0/499636469 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc708159c00 msgr2=0x7fc70814c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:39.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.043+0000 7fc70cc23640 1 --2- 172.21.15.77:0/499636469 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc708159c00 0x7fc70814c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.043+0000 7fc70cc23640 1 -- 172.21.15.77:0/499636469 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7080c4ff0 msgr2=0x7fc708151760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:39.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.043+0000 7fc70cc23640 1 --2- 172.21.15.77:0/499636469 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7080c4ff0 0x7fc708151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.043+0000 7fc70cc23640 1 -- 172.21.15.77:0/499636469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f4009400 con 0x7fc7080adac0 2023-11-04T01:41:39.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.043+0000 7fc70cc23640 1 --2- 172.21.15.77:0/499636469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7080adac0 0x7fc7081558e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc00b3e0 tx=0x7fc6fc00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:39.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.043+0000 7fc7057fa640 1 -- 172.21.15.77:0/499636469 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc011830 con 0x7fc7080adac0 2023-11-04T01:41:39.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.043+0000 7fc7057fa640 1 -- 172.21.15.77:0/499636469 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6fc0119b0 con 0x7fc7080adac0 2023-11-04T01:41:39.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.043+0000 7fc70ee87640 1 -- 172.21.15.77:0/499636469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc708151ed0 con 0x7fc7080adac0 2023-11-04T01:41:39.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.043+0000 7fc7057fa640 1 -- 172.21.15.77:0/499636469 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc011d60 con 0x7fc7080adac0 2023-11-04T01:41:39.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.043+0000 7fc70ee87640 1 -- 172.21.15.77:0/499636469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc708152490 con 0x7fc7080adac0 2023-11-04T01:41:39.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.044+0000 7fc70ee87640 1 -- 172.21.15.77:0/499636469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc708074290 con 0x7fc7080adac0 2023-11-04T01:41:39.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.045+0000 7fc7057fa640 1 -- 172.21.15.77:0/499636469 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc6fc01a400 con 0x7fc7080adac0 2023-11-04T01:41:39.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.045+0000 7fc7057fa640 1 --2- 172.21.15.77:0/499636469 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc6ec06ae70 0x7fc6ec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:39.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.045+0000 7fc7057fa640 1 -- 172.21.15.77:0/499636469 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7fc6fc089a60 con 0x7fc7080adac0 2023-11-04T01:41:39.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.045+0000 7fc707fff640 1 --2- 172.21.15.77:0/499636469 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc6ec06ae70 0x7fc6ec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:39.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.046+0000 7fc707fff640 1 --2- 172.21.15.77:0/499636469 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc6ec06ae70 0x7fc6ec06d330 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4036000 tx=0x7fc6f4030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:39.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.049+0000 7fc7057fa640 1 -- 172.21.15.77:0/499636469 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc6fc054830 con 0x7fc7080adac0 2023-11-04T01:41:39.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.216+0000 7fc70ee87640 1 -- 172.21.15.77:0/499636469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc7081534e0 con 0x7fc7080adac0 2023-11-04T01:41:39.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.217+0000 7fc7057fa640 1 -- 172.21.15.77:0/499636469 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc6fc015020 con 0x7fc7080adac0 2023-11-04T01:41:39.220 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:41:39.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.218+0000 7fc70ee87640 1 -- 172.21.15.77:0/499636469 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc6ec06ae70 msgr2=0x7fc6ec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:39.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.218+0000 7fc70ee87640 1 --2- 172.21.15.77:0/499636469 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc6ec06ae70 0x7fc6ec06d330 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4036000 tx=0x7fc6f4030000 comp rx=0 tx=0).stop 2023-11-04T01:41:39.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.218+0000 7fc70ee87640 1 -- 172.21.15.77:0/499636469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7080adac0 msgr2=0x7fc7081558e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:39.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.218+0000 7fc70ee87640 1 --2- 172.21.15.77:0/499636469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7080adac0 0x7fc7081558e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc00b3e0 tx=0x7fc6fc00b8a0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.218+0000 7fc70ee87640 1 -- 172.21.15.77:0/499636469 shutdown_connections 2023-11-04T01:41:39.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.218+0000 7fc70ee87640 1 --2- 172.21.15.77:0/499636469 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc6ec06ae70 0x7fc6ec06d330 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.218+0000 7fc70ee87640 1 --2- 172.21.15.77:0/499636469 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc708159c00 0x7fc70814c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.218+0000 7fc70ee87640 1 --2- 172.21.15.77:0/499636469 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7080c4ff0 0x7fc708151760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.218+0000 7fc70ee87640 1 --2- 172.21.15.77:0/499636469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7080adac0 0x7fc7081558e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.219+0000 7fc70ee87640 1 -- 172.21.15.77:0/499636469 >> 172.21.15.77:0/499636469 conn(0x7fc7080ce950 msgr2=0x7fc70806d660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:39.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.219+0000 7fc70ee87640 1 -- 172.21.15.77:0/499636469 shutdown_connections 2023-11-04T01:41:39.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.219+0000 7fc70ee87640 1 -- 172.21.15.77:0/499636469 wait complete. 2023-11-04T01:41:39.232 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:41:39.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.331+0000 7fa847894640 1 Processor -- start 2023-11-04T01:41:39.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.332+0000 7fa847894640 1 -- start start 2023-11-04T01:41:39.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.332+0000 7fa847894640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa8401609e0 0x7fa8400cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:39.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.332+0000 7fa847894640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa8400ccde0 0x7fa84006e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:39.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.332+0000 7fa847894640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa84006e1a0 con 0x7fa840160600 2023-11-04T01:41:39.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.332+0000 7fa847894640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8400cd330 con 0x7fa8401609e0 2023-11-04T01:41:39.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.332+0000 7fa847894640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84006db50 con 0x7fa8400ccde0 2023-11-04T01:41:39.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.333+0000 7fa845e31640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa8400ccde0 0x7fa84006e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:39.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.333+0000 7fa844e2f640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa8401609e0 0x7fa8400cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:39.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.333+0000 7fa845e31640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa8400ccde0 0x7fa84006e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:50890/0 (socket says 172.21.15.77:50890) 2023-11-04T01:41:39.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.333+0000 7fa845e31640 1 -- 172.21.15.77:0/2921169713 learned_addr learned my addr 172.21.15.77:0/2921169713 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:39.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.333+0000 7fa845e31640 1 -- 172.21.15.77:0/2921169713 >> v2:172.21.15.122:3300/0 conn(0x7fa8401609e0 msgr2=0x7fa8400cdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:39.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.333+0000 7fa845e31640 1 --2- 172.21.15.77:0/2921169713 >> v2:172.21.15.122:3300/0 conn(0x7fa8401609e0 0x7fa8400cdd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.333+0000 7fa845e31640 1 -- 172.21.15.77:0/2921169713 >> v1:172.21.15.122:6789/0 conn(0x7fa840160600 legacy=0x7fa8400cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:39.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.333+0000 7fa845e31640 1 -- 172.21.15.77:0/2921169713 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa84006de30 con 0x7fa8400ccde0 2023-11-04T01:41:39.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.333+0000 7fa844e2f640 1 --2- 172.21.15.77:0/2921169713 >> v2:172.21.15.122:3300/0 conn(0x7fa8401609e0 0x7fa8400cdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:41:39.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.334+0000 7fa845e31640 1 --2- 172.21.15.77:0/2921169713 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa8400ccde0 0x7fa84006e630 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa838009e50 tx=0x7fa83802bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2960d968854354f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:39.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.334+0000 7fa833fff640 1 -- 172.21.15.77:0/2921169713 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83802cb90 con 0x7fa8400ccde0 2023-11-04T01:41:39.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.334+0000 7fa833fff640 1 -- 172.21.15.77:0/2921169713 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83802ccf0 con 0x7fa8400ccde0 2023-11-04T01:41:39.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.334+0000 7fa833fff640 1 -- 172.21.15.77:0/2921169713 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa838034610 con 0x7fa8400ccde0 2023-11-04T01:41:39.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.335+0000 7fa847894640 1 -- 172.21.15.77:0/2921169713 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa8400ccde0 msgr2=0x7fa84006e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:39.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.335+0000 7fa847894640 1 --2- 172.21.15.77:0/2921169713 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa8400ccde0 0x7fa84006e630 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa838009e50 tx=0x7fa83802bff0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.335+0000 7fa847894640 1 -- 172.21.15.77:0/2921169713 shutdown_connections 2023-11-04T01:41:39.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.335+0000 7fa847894640 1 --2- 172.21.15.77:0/2921169713 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa8400ccde0 0x7fa84006e630 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.335+0000 7fa847894640 1 --2- 172.21.15.77:0/2921169713 >> v2:172.21.15.122:3300/0 conn(0x7fa8401609e0 0x7fa8400cdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.335+0000 7fa847894640 1 -- 172.21.15.77:0/2921169713 >> 172.21.15.77:0/2921169713 conn(0x7fa84006a120 msgr2=0x7fa84006a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:39.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.335+0000 7fa847894640 1 -- 172.21.15.77:0/2921169713 shutdown_connections 2023-11-04T01:41:39.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.335+0000 7fa847894640 1 -- 172.21.15.77:0/2921169713 wait complete. 2023-11-04T01:41:39.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.336+0000 7fa847894640 1 Processor -- start 2023-11-04T01:41:39.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.336+0000 7fa847894640 1 -- start start 2023-11-04T01:41:39.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.336+0000 7fa847894640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8400ccde0 0x7fa8401582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:39.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.337+0000 7fa847894640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa840160600 0x7fa84015f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:39.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.337+0000 7fa847894640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa8401609e0 0x7fa8401597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:39.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.337+0000 7fa847894640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8400b2390 con 0x7fa8400ccde0 2023-11-04T01:41:39.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.337+0000 7fa847894640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8400ada20 con 0x7fa840160600 2023-11-04T01:41:39.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.337+0000 7fa847894640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8400acea0 con 0x7fa8401609e0 2023-11-04T01:41:39.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.337+0000 7fa845630640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8400ccde0 0x7fa8401582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:39.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.337+0000 7fa845630640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8400ccde0 0x7fa8401582d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45350/0 (socket says 172.21.15.77:45350) 2023-11-04T01:41:39.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.337+0000 7fa845630640 1 -- 172.21.15.77:0/4055523928 learned_addr learned my addr 172.21.15.77:0/4055523928 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:39.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.337+0000 7fa845e31640 1 --2- 172.21.15.77:0/4055523928 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa8401609e0 0x7fa8401597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:39.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.337+0000 7fa844e2f640 1 --2- 172.21.15.77:0/4055523928 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa840160600 0x7fa84015f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:39.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.337+0000 7fa845630640 1 -- 172.21.15.77:0/4055523928 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa8401609e0 msgr2=0x7fa8401597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:39.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.337+0000 7fa845630640 1 --2- 172.21.15.77:0/4055523928 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa8401609e0 0x7fa8401597e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.337+0000 7fa845630640 1 -- 172.21.15.77:0/4055523928 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa840160600 msgr2=0x7fa84015f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:39.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.337+0000 7fa845630640 1 --2- 172.21.15.77:0/4055523928 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa840160600 0x7fa84015f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.337+0000 7fa845630640 1 -- 172.21.15.77:0/4055523928 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83c009400 con 0x7fa8400ccde0 2023-11-04T01:41:39.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.337+0000 7fa845630640 1 --2- 172.21.15.77:0/4055523928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8400ccde0 0x7fa8401582d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fa83400c450 tx=0x7fa83400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:39.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.337+0000 7fa831ffb640 1 -- 172.21.15.77:0/4055523928 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8340052d0 con 0x7fa8400ccde0 2023-11-04T01:41:39.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.337+0000 7fa831ffb640 1 -- 172.21.15.77:0/4055523928 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa834005430 con 0x7fa8400ccde0 2023-11-04T01:41:39.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.337+0000 7fa847894640 1 -- 172.21.15.77:0/4055523928 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa838009b30 con 0x7fa8400ccde0 2023-11-04T01:41:39.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.337+0000 7fa831ffb640 1 -- 172.21.15.77:0/4055523928 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa834012870 con 0x7fa8400ccde0 2023-11-04T01:41:39.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.338+0000 7fa847894640 1 -- 172.21.15.77:0/4055523928 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8400ad460 con 0x7fa8400ccde0 2023-11-04T01:41:39.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.338+0000 7fa847894640 1 -- 172.21.15.77:0/4055523928 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa840074290 con 0x7fa8400ccde0 2023-11-04T01:41:39.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.339+0000 7fa831ffb640 1 -- 172.21.15.77:0/4055523928 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa8340129d0 con 0x7fa8400ccde0 2023-11-04T01:41:39.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.339+0000 7fa831ffb640 1 --2- 172.21.15.77:0/4055523928 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa82406ae70 0x7fa82406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:39.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.339+0000 7fa831ffb640 1 -- 172.21.15.77:0/4055523928 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7fa834089480 con 0x7fa8400ccde0 2023-11-04T01:41:39.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.339+0000 7fa844e2f640 1 --2- 172.21.15.77:0/4055523928 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa82406ae70 0x7fa82406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:39.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.340+0000 7fa844e2f640 1 --2- 172.21.15.77:0/4055523928 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa82406ae70 0x7fa82406d330 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa8400aef80 tx=0x7fa83c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:39.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.343+0000 7fa831ffb640 1 -- 172.21.15.77:0/4055523928 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa8340541c0 con 0x7fa8400ccde0 2023-11-04T01:41:39.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.507+0000 7fa847894640 1 -- 172.21.15.77:0/4055523928 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa84015fe20 con 0x7fa8400ccde0 2023-11-04T01:41:39.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.508+0000 7fa831ffb640 1 -- 172.21.15.77:0/4055523928 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa8340577e0 con 0x7fa8400ccde0 2023-11-04T01:41:39.511 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:41:39.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.510+0000 7fa847894640 1 -- 172.21.15.77:0/4055523928 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa82406ae70 msgr2=0x7fa82406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:39.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.510+0000 7fa847894640 1 --2- 172.21.15.77:0/4055523928 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa82406ae70 0x7fa82406d330 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa8400aef80 tx=0x7fa83c008040 comp rx=0 tx=0).stop 2023-11-04T01:41:39.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.510+0000 7fa847894640 1 -- 172.21.15.77:0/4055523928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8400ccde0 msgr2=0x7fa8401582d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:39.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.510+0000 7fa847894640 1 --2- 172.21.15.77:0/4055523928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8400ccde0 0x7fa8401582d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fa83400c450 tx=0x7fa83400c910 comp rx=0 tx=0).stop 2023-11-04T01:41:39.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.510+0000 7fa847894640 1 -- 172.21.15.77:0/4055523928 shutdown_connections 2023-11-04T01:41:39.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.510+0000 7fa847894640 1 --2- 172.21.15.77:0/4055523928 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa82406ae70 0x7fa82406d330 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.510+0000 7fa847894640 1 --2- 172.21.15.77:0/4055523928 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa8401609e0 0x7fa8401597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.510+0000 7fa847894640 1 --2- 172.21.15.77:0/4055523928 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa840160600 0x7fa84015f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.510+0000 7fa847894640 1 --2- 172.21.15.77:0/4055523928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8400ccde0 0x7fa8401582d0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.510+0000 7fa847894640 1 -- 172.21.15.77:0/4055523928 >> 172.21.15.77:0/4055523928 conn(0x7fa84006a120 msgr2=0x7fa8400ca400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:39.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.510+0000 7fa847894640 1 -- 172.21.15.77:0/4055523928 shutdown_connections 2023-11-04T01:41:39.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.510+0000 7fa847894640 1 -- 172.21.15.77:0/4055523928 wait complete. 2023-11-04T01:41:39.523 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:41:39.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.623+0000 7fca620a9640 1 Processor -- start 2023-11-04T01:41:39.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.623+0000 7fca620a9640 1 -- start start 2023-11-04T01:41:39.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.623+0000 7fca620a9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca5c0cc520 0x7fca5c070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:39.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.623+0000 7fca620a9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fca5c0cc9a0 0x7fca5c0714e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:39.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.624+0000 7fca620a9640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca5c0c3860 con 0x7fca5c153850 2023-11-04T01:41:39.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.624+0000 7fca620a9640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca5c0c9250 con 0x7fca5c0cc9a0 2023-11-04T01:41:39.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.624+0000 7fca620a9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca5c153c30 con 0x7fca5c0cc520 2023-11-04T01:41:39.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.624+0000 7fca5affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca5c0cc520 0x7fca5c070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:39.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.624+0000 7fca5bfff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fca5c0cc9a0 0x7fca5c0714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:39.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.624+0000 7fca5affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca5c0cc520 0x7fca5c070fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:50910/0 (socket says 172.21.15.77:50910) 2023-11-04T01:41:39.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.624+0000 7fca5bfff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fca5c0cc9a0 0x7fca5c0714e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:45760/0 (socket says 172.21.15.77:45760) 2023-11-04T01:41:39.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.624+0000 7fca5affd640 1 -- 172.21.15.77:0/2646165188 learned_addr learned my addr 172.21.15.77:0/2646165188 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:39.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.624+0000 7fca5b7fe640 1 --1- 172.21.15.77:0/2646165188 >> v1:172.21.15.122:6789/0 conn(0x7fca5c153850 0x7fca5c15a1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:47188/0 (socket says 172.21.15.77:47188) 2023-11-04T01:41:39.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.624+0000 7fca5bfff640 1 -- 172.21.15.77:0/2646165188 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca5c0cc520 msgr2=0x7fca5c070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:39.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.624+0000 7fca5bfff640 1 --2- 172.21.15.77:0/2646165188 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca5c0cc520 0x7fca5c070fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.624+0000 7fca5bfff640 1 -- 172.21.15.77:0/2646165188 >> v1:172.21.15.122:6789/0 conn(0x7fca5c153850 legacy=0x7fca5c15a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:39.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.624+0000 7fca5bfff640 1 -- 172.21.15.77:0/2646165188 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5c0ce590 con 0x7fca5c0cc9a0 2023-11-04T01:41:39.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.624+0000 7fca5affd640 1 --2- 172.21.15.77:0/2646165188 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca5c0cc520 0x7fca5c070fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:41:39.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.625+0000 7fca5bfff640 1 --2- 172.21.15.77:0/2646165188 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca5c0cc9a0 0x7fca5c0714e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fca54009d90 tx=0x7fca5402bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4415dbc15dc69539 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:39.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.625+0000 7fca5a7fc640 1 -- 172.21.15.77:0/2646165188 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5402cc50 con 0x7fca5c0cc9a0 2023-11-04T01:41:39.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.625+0000 7fca5a7fc640 1 -- 172.21.15.77:0/2646165188 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca5402cdb0 con 0x7fca5c0cc9a0 2023-11-04T01:41:39.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.625+0000 7fca5a7fc640 1 -- 172.21.15.77:0/2646165188 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca54034660 con 0x7fca5c0cc9a0 2023-11-04T01:41:39.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.626+0000 7fca620a9640 1 -- 172.21.15.77:0/2646165188 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca5c0cc9a0 msgr2=0x7fca5c0714e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:39.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.626+0000 7fca620a9640 1 --2- 172.21.15.77:0/2646165188 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca5c0cc9a0 0x7fca5c0714e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fca54009d90 tx=0x7fca5402bea0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.626+0000 7fca620a9640 1 -- 172.21.15.77:0/2646165188 shutdown_connections 2023-11-04T01:41:39.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.626+0000 7fca620a9640 1 --2- 172.21.15.77:0/2646165188 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca5c0cc9a0 0x7fca5c0714e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.626+0000 7fca620a9640 1 --2- 172.21.15.77:0/2646165188 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca5c0cc520 0x7fca5c070fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.626+0000 7fca620a9640 1 -- 172.21.15.77:0/2646165188 >> 172.21.15.77:0/2646165188 conn(0x7fca5c0ce950 msgr2=0x7fca5c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:39.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.626+0000 7fca620a9640 1 -- 172.21.15.77:0/2646165188 shutdown_connections 2023-11-04T01:41:39.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.626+0000 7fca620a9640 1 -- 172.21.15.77:0/2646165188 wait complete. 2023-11-04T01:41:39.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.627+0000 7fca620a9640 1 Processor -- start 2023-11-04T01:41:39.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.627+0000 7fca620a9640 1 -- start start 2023-11-04T01:41:39.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.628+0000 7fca620a9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca5c0cc520 0x7fca5c14e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:39.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.628+0000 7fca620a9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca5c0cc9a0 0x7fca5c1f6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:39.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.628+0000 7fca620a9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca5c153850 0x7fca5c154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:39.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.628+0000 7fca620a9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5c0ab8d0 con 0x7fca5c0cc520 2023-11-04T01:41:39.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.628+0000 7fca620a9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5c1f6e00 con 0x7fca5c0cc9a0 2023-11-04T01:41:39.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.628+0000 7fca620a9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca5c1f70e0 con 0x7fca5c153850 2023-11-04T01:41:39.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.628+0000 7fca5b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca5c0cc520 0x7fca5c14e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:39.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.628+0000 7fca5b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca5c0cc520 0x7fca5c14e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45366/0 (socket says 172.21.15.77:45366) 2023-11-04T01:41:39.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.628+0000 7fca5b7fe640 1 -- 172.21.15.77:0/414903948 learned_addr learned my addr 172.21.15.77:0/414903948 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:39.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.628+0000 7fca5affd640 1 --2- 172.21.15.77:0/414903948 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca5c0cc9a0 0x7fca5c1f6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:39.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.628+0000 7fca5bfff640 1 --2- 172.21.15.77:0/414903948 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca5c153850 0x7fca5c154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:39.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.628+0000 7fca5b7fe640 1 -- 172.21.15.77:0/414903948 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca5c153850 msgr2=0x7fca5c154dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:39.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.628+0000 7fca5b7fe640 1 --2- 172.21.15.77:0/414903948 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca5c153850 0x7fca5c154dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.628+0000 7fca5b7fe640 1 -- 172.21.15.77:0/414903948 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca5c0cc9a0 msgr2=0x7fca5c1f6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:39.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.628+0000 7fca5b7fe640 1 --2- 172.21.15.77:0/414903948 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca5c0cc9a0 0x7fca5c1f6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.628+0000 7fca5b7fe640 1 -- 172.21.15.77:0/414903948 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5000b770 con 0x7fca5c0cc520 2023-11-04T01:41:39.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.628+0000 7fca5affd640 1 --2- 172.21.15.77:0/414903948 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca5c0cc9a0 0x7fca5c1f6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:39.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.628+0000 7fca5b7fe640 1 --2- 172.21.15.77:0/414903948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca5c0cc520 0x7fca5c14e790 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fca4c00c3e0 tx=0x7fca4c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:39.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.629+0000 7fca43fff640 1 -- 172.21.15.77:0/414903948 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c0074e0 con 0x7fca5c0cc520 2023-11-04T01:41:39.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.629+0000 7fca43fff640 1 -- 172.21.15.77:0/414903948 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4c007640 con 0x7fca5c0cc520 2023-11-04T01:41:39.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.629+0000 7fca620a9640 1 -- 172.21.15.77:0/414903948 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca54009a70 con 0x7fca5c0cc520 2023-11-04T01:41:39.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.629+0000 7fca43fff640 1 -- 172.21.15.77:0/414903948 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c0049e0 con 0x7fca5c0cc520 2023-11-04T01:41:39.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.629+0000 7fca620a9640 1 -- 172.21.15.77:0/414903948 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca5c0abe00 con 0x7fca5c0cc520 2023-11-04T01:41:39.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.630+0000 7fca620a9640 1 -- 172.21.15.77:0/414903948 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca5c074290 con 0x7fca5c0cc520 2023-11-04T01:41:39.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.630+0000 7fca43fff640 1 -- 172.21.15.77:0/414903948 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fca4c004b40 con 0x7fca5c0cc520 2023-11-04T01:41:39.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.630+0000 7fca43fff640 1 --2- 172.21.15.77:0/414903948 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fca4806ae70 0x7fca4806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:39.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.630+0000 7fca43fff640 1 -- 172.21.15.77:0/414903948 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7fca4c089370 con 0x7fca5c0cc520 2023-11-04T01:41:39.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.630+0000 7fca5affd640 1 --2- 172.21.15.77:0/414903948 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fca4806ae70 0x7fca4806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:39.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.631+0000 7fca5affd640 1 --2- 172.21.15.77:0/414903948 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fca4806ae70 0x7fca4806d330 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fca5000bf30 tx=0x7fca5000b450 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:39.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.634+0000 7fca43fff640 1 -- 172.21.15.77:0/414903948 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fca4c0540c0 con 0x7fca5c0cc520 2023-11-04T01:41:39.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.803+0000 7fca620a9640 1 -- 172.21.15.77:0/414903948 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fca5c157140 con 0x7fca5c0cc520 2023-11-04T01:41:39.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.803+0000 7fca43fff640 1 -- 172.21.15.77:0/414903948 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7fca4c0576e0 con 0x7fca5c0cc520 2023-11-04T01:41:39.807 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-04T01:41:39.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.805+0000 7fca620a9640 1 -- 172.21.15.77:0/414903948 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fca4806ae70 msgr2=0x7fca4806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:39.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.805+0000 7fca620a9640 1 --2- 172.21.15.77:0/414903948 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fca4806ae70 0x7fca4806d330 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fca5000bf30 tx=0x7fca5000b450 comp rx=0 tx=0).stop 2023-11-04T01:41:39.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.805+0000 7fca620a9640 1 -- 172.21.15.77:0/414903948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca5c0cc520 msgr2=0x7fca5c14e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:39.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.805+0000 7fca620a9640 1 --2- 172.21.15.77:0/414903948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca5c0cc520 0x7fca5c14e790 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fca4c00c3e0 tx=0x7fca4c00c8a0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.805+0000 7fca620a9640 1 -- 172.21.15.77:0/414903948 shutdown_connections 2023-11-04T01:41:39.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.805+0000 7fca620a9640 1 --2- 172.21.15.77:0/414903948 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fca4806ae70 0x7fca4806d330 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.805+0000 7fca620a9640 1 --2- 172.21.15.77:0/414903948 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fca5c153850 0x7fca5c154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.805+0000 7fca620a9640 1 --2- 172.21.15.77:0/414903948 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca5c0cc9a0 0x7fca5c1f6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.805+0000 7fca620a9640 1 --2- 172.21.15.77:0/414903948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca5c0cc520 0x7fca5c14e790 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.805+0000 7fca620a9640 1 -- 172.21.15.77:0/414903948 >> 172.21.15.77:0/414903948 conn(0x7fca5c0ce950 msgr2=0x7fca5c071290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:39.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.806+0000 7fca620a9640 1 -- 172.21.15.77:0/414903948 shutdown_connections 2023-11-04T01:41:39.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.806+0000 7fca620a9640 1 -- 172.21.15.77:0/414903948 wait complete. 2023-11-04T01:41:39.819 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:41:39.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.921+0000 7effc38a2640 1 Processor -- start 2023-11-04T01:41:39.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.922+0000 7effc38a2640 1 -- start start 2023-11-04T01:41:39.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.922+0000 7effc38a2640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7effbc153e60 0x7effbc15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:39.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.922+0000 7effc38a2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7effbc0cd6d0 0x7effbc161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:39.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.922+0000 7effc38a2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7effbc0b4880 0x7effbc0b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:39.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.922+0000 7effc38a2640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effbc0cde60 con 0x7effbc0b4880 2023-11-04T01:41:39.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.922+0000 7effc38a2640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effbc160f90 con 0x7effbc153e60 2023-11-04T01:41:39.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.922+0000 7effc38a2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effbc0b51e0 con 0x7effbc0cd6d0 2023-11-04T01:41:39.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.922+0000 7effc1e3f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7effbc0b4880 0x7effbc0b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:39.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.923+0000 7effc1e3f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7effbc0b4880 0x7effbc0b4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45382/0 (socket says 172.21.15.77:45382) 2023-11-04T01:41:39.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.923+0000 7effc1e3f640 1 -- 172.21.15.77:0/937311369 learned_addr learned my addr 172.21.15.77:0/937311369 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:39.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.923+0000 7effc163e640 1 --2- 172.21.15.77:0/937311369 >> v2:172.21.15.122:3300/0 conn(0x7effbc153e60 0x7effbc15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:39.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.923+0000 7effc0e3d640 1 --2- 172.21.15.77:0/937311369 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7effbc0cd6d0 0x7effbc161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:39.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.923+0000 7effc1e3f640 1 -- 172.21.15.77:0/937311369 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7effbc0cd6d0 msgr2=0x7effbc161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:39.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.923+0000 7effc1e3f640 1 --2- 172.21.15.77:0/937311369 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7effbc0cd6d0 0x7effbc161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.923+0000 7effc1e3f640 1 -- 172.21.15.77:0/937311369 >> v2:172.21.15.122:3300/0 conn(0x7effbc153e60 msgr2=0x7effbc15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:39.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.923+0000 7effc1e3f640 1 --2- 172.21.15.77:0/937311369 >> v2:172.21.15.122:3300/0 conn(0x7effbc153e60 0x7effbc15dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.923+0000 7effc1e3f640 1 -- 172.21.15.77:0/937311369 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effbc15e400 con 0x7effbc0b4880 2023-11-04T01:41:39.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.924+0000 7effc1e3f640 1 --2- 172.21.15.77:0/937311369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effbc0b4880 0x7effbc0b4ca0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7effbc08abe0 tx=0x7effb402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3797df2cc952aa7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:39.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.924+0000 7effb3fff640 1 -- 172.21.15.77:0/937311369 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb402ca70 con 0x7effbc0b4880 2023-11-04T01:41:39.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.924+0000 7effb3fff640 1 -- 172.21.15.77:0/937311369 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb402cbd0 con 0x7effbc0b4880 2023-11-04T01:41:39.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.924+0000 7effb3fff640 1 -- 172.21.15.77:0/937311369 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb40343f0 con 0x7effbc0b4880 2023-11-04T01:41:39.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.924+0000 7effc38a2640 1 -- 172.21.15.77:0/937311369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effbc0b4880 msgr2=0x7effbc0b4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:39.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.924+0000 7effc38a2640 1 --2- 172.21.15.77:0/937311369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effbc0b4880 0x7effbc0b4ca0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7effbc08abe0 tx=0x7effb402bed0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.925+0000 7effc38a2640 1 -- 172.21.15.77:0/937311369 shutdown_connections 2023-11-04T01:41:39.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.925+0000 7effc38a2640 1 --2- 172.21.15.77:0/937311369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effbc0b4880 0x7effbc0b4ca0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.925+0000 7effc38a2640 1 --2- 172.21.15.77:0/937311369 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7effbc0cd6d0 0x7effbc161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.925+0000 7effc38a2640 1 --2- 172.21.15.77:0/937311369 >> v2:172.21.15.122:3300/0 conn(0x7effbc153e60 0x7effbc15dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.925+0000 7effc38a2640 1 -- 172.21.15.77:0/937311369 >> 172.21.15.77:0/937311369 conn(0x7effbc0cf880 msgr2=0x7effbc0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:39.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.925+0000 7effc38a2640 1 -- 172.21.15.77:0/937311369 shutdown_connections 2023-11-04T01:41:39.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.925+0000 7effc38a2640 1 -- 172.21.15.77:0/937311369 wait complete. 2023-11-04T01:41:39.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.926+0000 7effc38a2640 1 Processor -- start 2023-11-04T01:41:39.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.926+0000 7effc38a2640 1 -- start start 2023-11-04T01:41:39.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.927+0000 7effc38a2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effbc0b4880 0x7effbc159e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:39.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.927+0000 7effc38a2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effbc0cd6d0 0x7effbc0c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:39.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.927+0000 7effc38a2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7effbc153e60 0x7effbc1f5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:39.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.927+0000 7effc38a2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc15a3a0 con 0x7effbc0cd6d0 2023-11-04T01:41:39.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.927+0000 7effc38a2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc0c97d0 con 0x7effbc0b4880 2023-11-04T01:41:39.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.927+0000 7effc38a2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effbc0c7d00 con 0x7effbc153e60 2023-11-04T01:41:39.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.927+0000 7effc0e3d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effbc0cd6d0 0x7effbc0c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:39.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.927+0000 7effc0e3d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effbc0cd6d0 0x7effbc0c9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45392/0 (socket says 172.21.15.77:45392) 2023-11-04T01:41:39.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.927+0000 7effc0e3d640 1 -- 172.21.15.77:0/3294219219 learned_addr learned my addr 172.21.15.77:0/3294219219 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:39.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.927+0000 7effc163e640 1 --2- 172.21.15.77:0/3294219219 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effbc0b4880 0x7effbc159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:39.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.927+0000 7effc1e3f640 1 --2- 172.21.15.77:0/3294219219 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7effbc153e60 0x7effbc1f5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:39.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.927+0000 7effc0e3d640 1 -- 172.21.15.77:0/3294219219 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7effbc153e60 msgr2=0x7effbc1f5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:39.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.927+0000 7effc0e3d640 1 --2- 172.21.15.77:0/3294219219 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7effbc153e60 0x7effbc1f5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.927+0000 7effc0e3d640 1 -- 172.21.15.77:0/3294219219 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effbc0b4880 msgr2=0x7effbc159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:39.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.927+0000 7effc0e3d640 1 --2- 172.21.15.77:0/3294219219 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effbc0b4880 0x7effbc159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:39.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.927+0000 7effc0e3d640 1 -- 172.21.15.77:0/3294219219 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb4009b30 con 0x7effbc0cd6d0 2023-11-04T01:41:39.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.927+0000 7effc0e3d640 1 --2- 172.21.15.77:0/3294219219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effbc0cd6d0 0x7effbc0c9290 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7effb800d800 tx=0x7effb800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:39.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.927+0000 7effb1ffb640 1 -- 172.21.15.77:0/3294219219 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb80096a0 con 0x7effbc0cd6d0 2023-11-04T01:41:39.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.927+0000 7effb1ffb640 1 -- 172.21.15.77:0/3294219219 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb8009800 con 0x7effbc0cd6d0 2023-11-04T01:41:39.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.927+0000 7effc38a2640 1 -- 172.21.15.77:0/3294219219 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effbc0c6c60 con 0x7effbc0cd6d0 2023-11-04T01:41:39.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.928+0000 7effb1ffb640 1 -- 172.21.15.77:0/3294219219 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb8009b90 con 0x7effbc0cd6d0 2023-11-04T01:41:39.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.928+0000 7effc38a2640 1 -- 172.21.15.77:0/3294219219 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effbc0c7220 con 0x7effbc0cd6d0 2023-11-04T01:41:39.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.929+0000 7effc38a2640 1 -- 172.21.15.77:0/3294219219 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effbc074290 con 0x7effbc0cd6d0 2023-11-04T01:41:39.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.929+0000 7effb1ffb640 1 -- 172.21.15.77:0/3294219219 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7effb8009cf0 con 0x7effbc0cd6d0 2023-11-04T01:41:39.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.929+0000 7effb1ffb640 1 --2- 172.21.15.77:0/3294219219 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7effa006ae70 0x7effa006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:39.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.930+0000 7effb1ffb640 1 -- 172.21.15.77:0/3294219219 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7effb8089f10 con 0x7effbc0cd6d0 2023-11-04T01:41:39.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.930+0000 7effc163e640 1 --2- 172.21.15.77:0/3294219219 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7effa006ae70 0x7effa006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:39.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.930+0000 7effc163e640 1 --2- 172.21.15.77:0/3294219219 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7effa006ae70 0x7effa006d330 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7effac0079a0 tx=0x7effac008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:39.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:39.934+0000 7effb1ffb640 1 -- 172.21.15.77:0/3294219219 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7effb8054d90 con 0x7effbc0cd6d0 2023-11-04T01:41:40.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.099+0000 7effc38a2640 1 -- 172.21.15.77:0/3294219219 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7effbc0d0b80 con 0x7effbc0cd6d0 2023-11-04T01:41:40.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.100+0000 7effb1ffb640 1 -- 172.21.15.77:0/3294219219 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v41) v1 ==== 103+0+11 (secure 0 0 0) 0x7effb800b440 con 0x7effbc0cd6d0 2023-11-04T01:41:40.103 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:41:40.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.101+0000 7effc38a2640 1 -- 172.21.15.77:0/3294219219 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7effa006ae70 msgr2=0x7effa006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.101+0000 7effc38a2640 1 --2- 172.21.15.77:0/3294219219 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7effa006ae70 0x7effa006d330 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7effac0079a0 tx=0x7effac008040 comp rx=0 tx=0).stop 2023-11-04T01:41:40.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.101+0000 7effc38a2640 1 -- 172.21.15.77:0/3294219219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effbc0cd6d0 msgr2=0x7effbc0c9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.101+0000 7effc38a2640 1 --2- 172.21.15.77:0/3294219219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effbc0cd6d0 0x7effbc0c9290 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7effb800d800 tx=0x7effb800dcc0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.102+0000 7effc38a2640 1 -- 172.21.15.77:0/3294219219 shutdown_connections 2023-11-04T01:41:40.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.102+0000 7effc38a2640 1 --2- 172.21.15.77:0/3294219219 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7effa006ae70 0x7effa006d330 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.102+0000 7effc38a2640 1 --2- 172.21.15.77:0/3294219219 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7effbc153e60 0x7effbc1f5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.102+0000 7effc38a2640 1 --2- 172.21.15.77:0/3294219219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effbc0cd6d0 0x7effbc0c9290 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.102+0000 7effc38a2640 1 --2- 172.21.15.77:0/3294219219 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effbc0b4880 0x7effbc159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.102+0000 7effc38a2640 1 -- 172.21.15.77:0/3294219219 >> 172.21.15.77:0/3294219219 conn(0x7effbc0cf880 msgr2=0x7effbc0d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:40.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.102+0000 7effc38a2640 1 -- 172.21.15.77:0/3294219219 shutdown_connections 2023-11-04T01:41:40.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.102+0000 7effc38a2640 1 -- 172.21.15.77:0/3294219219 wait complete. 2023-11-04T01:41:40.115 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:40.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.213+0000 7f7e33a1a640 1 Processor -- start 2023-11-04T01:41:40.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.213+0000 7f7e33a1a640 1 -- start start 2023-11-04T01:41:40.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.214+0000 7f7e33a1a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7e2c159c70 0x7f7e2c0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.214+0000 7f7e33a1a640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7e2c06db20 0x7f7e2c0b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.214+0000 7f7e33a1a640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e2c0b4110 con 0x7f7e2c0b0910 2023-11-04T01:41:40.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.214+0000 7f7e33a1a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e2c0b49b0 con 0x7f7e2c159c70 2023-11-04T01:41:40.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.214+0000 7f7e33a1a640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e2c0b0da0 con 0x7f7e2c06db20 2023-11-04T01:41:40.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.214+0000 7f7e317b6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7e2c159c70 0x7f7e2c0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.214+0000 7f7e317b6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7e2c159c70 0x7f7e2c0ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45394/0 (socket says 172.21.15.77:45394) 2023-11-04T01:41:40.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.214+0000 7f7e317b6640 1 -- 172.21.15.77:0/3468501404 learned_addr learned my addr 172.21.15.77:0/3468501404 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:40.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.214+0000 7f7e30fb5640 1 --2- 172.21.15.77:0/3468501404 >> v2:172.21.15.122:3300/0 conn(0x7f7e2c06db20 0x7f7e2c0b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.214+0000 7f7e317b6640 1 -- 172.21.15.77:0/3468501404 >> v2:172.21.15.122:3300/0 conn(0x7f7e2c06db20 msgr2=0x7f7e2c0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:40.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.214+0000 7f7e317b6640 1 --2- 172.21.15.77:0/3468501404 >> v2:172.21.15.122:3300/0 conn(0x7f7e2c06db20 0x7f7e2c0b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.214+0000 7f7e317b6640 1 -- 172.21.15.77:0/3468501404 >> v1:172.21.15.122:6789/0 conn(0x7f7e2c0b0910 legacy=0x7f7e2c15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.214+0000 7f7e317b6640 1 -- 172.21.15.77:0/3468501404 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e2c0b43f0 con 0x7f7e2c159c70 2023-11-04T01:41:40.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.215+0000 7f7e317b6640 1 --2- 172.21.15.77:0/3468501404 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e2c159c70 0x7f7e2c0ce370 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c0cf800 tx=0x7f7e2802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5213b8d6514a8c4b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:40.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.215+0000 7f7e23fff640 1 -- 172.21.15.77:0/3468501404 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e28030860 con 0x7f7e2c159c70 2023-11-04T01:41:40.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.215+0000 7f7e23fff640 1 -- 172.21.15.77:0/3468501404 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e280309c0 con 0x7f7e2c159c70 2023-11-04T01:41:40.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.215+0000 7f7e23fff640 1 -- 172.21.15.77:0/3468501404 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e28030d50 con 0x7f7e2c159c70 2023-11-04T01:41:40.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.216+0000 7f7e33a1a640 1 -- 172.21.15.77:0/3468501404 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e2c159c70 msgr2=0x7f7e2c0ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.216+0000 7f7e33a1a640 1 --2- 172.21.15.77:0/3468501404 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e2c159c70 0x7f7e2c0ce370 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c0cf800 tx=0x7f7e2802b9a0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.216+0000 7f7e33a1a640 1 -- 172.21.15.77:0/3468501404 shutdown_connections 2023-11-04T01:41:40.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.216+0000 7f7e33a1a640 1 --2- 172.21.15.77:0/3468501404 >> v2:172.21.15.122:3300/0 conn(0x7f7e2c06db20 0x7f7e2c0b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.216+0000 7f7e33a1a640 1 --2- 172.21.15.77:0/3468501404 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e2c159c70 0x7f7e2c0ce370 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.216+0000 7f7e33a1a640 1 -- 172.21.15.77:0/3468501404 >> 172.21.15.77:0/3468501404 conn(0x7f7e2c0ce950 msgr2=0x7f7e2c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:40.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.216+0000 7f7e33a1a640 1 -- 172.21.15.77:0/3468501404 shutdown_connections 2023-11-04T01:41:40.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.216+0000 7f7e33a1a640 1 -- 172.21.15.77:0/3468501404 wait complete. 2023-11-04T01:41:40.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.217+0000 7f7e33a1a640 1 Processor -- start 2023-11-04T01:41:40.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.217+0000 7f7e33a1a640 1 -- start start 2023-11-04T01:41:40.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.218+0000 7f7e33a1a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e2c06db20 0x7f7e2c1e68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.218+0000 7f7e33a1a640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7e2c0b0910 0x7f7e2c0b2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.218+0000 7f7e33a1a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e2c159c70 0x7f7e2c0b2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.218+0000 7f7e33a1a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c13ef20 con 0x7f7e2c06db20 2023-11-04T01:41:40.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.218+0000 7f7e33a1a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c0b2dc0 con 0x7f7e2c159c70 2023-11-04T01:41:40.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.218+0000 7f7e33a1a640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c0b30a0 con 0x7f7e2c0b0910 2023-11-04T01:41:40.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.218+0000 7f7e317b6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e2c06db20 0x7f7e2c1e68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.218+0000 7f7e317b6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e2c06db20 0x7f7e2c1e68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45410/0 (socket says 172.21.15.77:45410) 2023-11-04T01:41:40.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.218+0000 7f7e317b6640 1 -- 172.21.15.77:0/3466270226 learned_addr learned my addr 172.21.15.77:0/3466270226 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:40.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.218+0000 7f7e30fb5640 1 --2- 172.21.15.77:0/3466270226 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7e2c0b0910 0x7f7e2c0b2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.218+0000 7f7e31fb7640 1 --2- 172.21.15.77:0/3466270226 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e2c159c70 0x7f7e2c0b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.218+0000 7f7e317b6640 1 -- 172.21.15.77:0/3466270226 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7e2c0b0910 msgr2=0x7f7e2c0b2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.218+0000 7f7e317b6640 1 --2- 172.21.15.77:0/3466270226 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7e2c0b0910 0x7f7e2c0b2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.218+0000 7f7e317b6640 1 -- 172.21.15.77:0/3466270226 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e2c159c70 msgr2=0x7f7e2c0b2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.218+0000 7f7e317b6640 1 --2- 172.21.15.77:0/3466270226 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e2c159c70 0x7f7e2c0b2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.218+0000 7f7e317b6640 1 -- 172.21.15.77:0/3466270226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e280094d0 con 0x7f7e2c06db20 2023-11-04T01:41:40.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.218+0000 7f7e30fb5640 1 --2- 172.21.15.77:0/3466270226 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7e2c0b0910 0x7f7e2c0b2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:40.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.218+0000 7f7e31fb7640 1 --2- 172.21.15.77:0/3466270226 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e2c159c70 0x7f7e2c0b2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:40.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.218+0000 7f7e317b6640 1 --2- 172.21.15.77:0/3466270226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e2c06db20 0x7f7e2c1e68a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f7e28000c00 tx=0x7f7e28004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:40.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.218+0000 7f7e21ffb640 1 -- 172.21.15.77:0/3466270226 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e28039c90 con 0x7f7e2c06db20 2023-11-04T01:41:40.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.219+0000 7f7e21ffb640 1 -- 172.21.15.77:0/3466270226 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e28039df0 con 0x7f7e2c06db20 2023-11-04T01:41:40.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.219+0000 7f7e33a1a640 1 -- 172.21.15.77:0/3466270226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e2c0b3380 con 0x7f7e2c06db20 2023-11-04T01:41:40.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.219+0000 7f7e21ffb640 1 -- 172.21.15.77:0/3466270226 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e28043640 con 0x7f7e2c06db20 2023-11-04T01:41:40.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.219+0000 7f7e33a1a640 1 -- 172.21.15.77:0/3466270226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e2c1e6de0 con 0x7f7e2c06db20 2023-11-04T01:41:40.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.220+0000 7f7e33a1a640 1 -- 172.21.15.77:0/3466270226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e2c074290 con 0x7f7e2c06db20 2023-11-04T01:41:40.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.220+0000 7f7e21ffb640 1 -- 172.21.15.77:0/3466270226 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7e280437a0 con 0x7f7e2c06db20 2023-11-04T01:41:40.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.220+0000 7f7e21ffb640 1 --2- 172.21.15.77:0/3466270226 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7e1006ae70 0x7f7e1006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.221+0000 7f7e21ffb640 1 -- 172.21.15.77:0/3466270226 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f7e2803e070 con 0x7f7e2c06db20 2023-11-04T01:41:40.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.221+0000 7f7e30fb5640 1 --2- 172.21.15.77:0/3466270226 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7e1006ae70 0x7f7e1006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.221+0000 7f7e30fb5640 1 --2- 172.21.15.77:0/3466270226 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7e1006ae70 0x7f7e1006d330 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c15cee0 tx=0x7f7e1c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:40.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.225+0000 7f7e21ffb640 1 -- 172.21.15.77:0/3466270226 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7e280779b0 con 0x7f7e2c06db20 2023-11-04T01:41:40.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.426+0000 7f7e33a1a640 1 -- 172.21.15.77:0/3466270226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e2c06d3f0 con 0x7f7e2c06db20 2023-11-04T01:41:40.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.426+0000 7f7e21ffb640 1 -- 172.21.15.77:0/3466270226 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4920 (secure 0 0 0) 0x7f7e2807afd0 con 0x7f7e2c06db20 2023-11-04T01:41:40.429 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:40.430 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5511,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/1132914884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1132914884},{"type":"v1","addr":"172.21.15.77:6834","nonce":1132914884}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5514,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/530959421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":530959421},{"type":"v1","addr":"172.21.15.77:6835","nonce":530959421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":34823,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/1375125704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1375125704},{"type":"v1","addr":"172.21.15.122:6836","nonce":1375125704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:41:24.933073+0000","modified":"2023-11-04T01:41:26.930876+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34826},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34826":{"gid":34826,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/3085479427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":3085479427},{"type":"v1","addr":"172.21.15.122:6837","nonce":3085479427}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-04T01:41:40.430 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 16 2023-11-04T01:41:40.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.428+0000 7f7e33a1a640 1 -- 172.21.15.77:0/3466270226 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7e1006ae70 msgr2=0x7f7e1006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.428+0000 7f7e33a1a640 1 --2- 172.21.15.77:0/3466270226 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7e1006ae70 0x7f7e1006d330 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c15cee0 tx=0x7f7e1c008040 comp rx=0 tx=0).stop 2023-11-04T01:41:40.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.428+0000 7f7e33a1a640 1 -- 172.21.15.77:0/3466270226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e2c06db20 msgr2=0x7f7e2c1e68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.428+0000 7f7e33a1a640 1 --2- 172.21.15.77:0/3466270226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e2c06db20 0x7f7e2c1e68a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f7e28000c00 tx=0x7f7e28004730 comp rx=0 tx=0).stop 2023-11-04T01:41:40.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.428+0000 7f7e33a1a640 1 -- 172.21.15.77:0/3466270226 shutdown_connections 2023-11-04T01:41:40.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.428+0000 7f7e33a1a640 1 --2- 172.21.15.77:0/3466270226 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7e1006ae70 0x7f7e1006d330 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.428+0000 7f7e33a1a640 1 --2- 172.21.15.77:0/3466270226 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e2c159c70 0x7f7e2c0b2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.428+0000 7f7e33a1a640 1 --2- 172.21.15.77:0/3466270226 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7e2c0b0910 0x7f7e2c0b2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.428+0000 7f7e33a1a640 1 --2- 172.21.15.77:0/3466270226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e2c06db20 0x7f7e2c1e68a0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.428+0000 7f7e33a1a640 1 -- 172.21.15.77:0/3466270226 >> 172.21.15.77:0/3466270226 conn(0x7f7e2c0ce950 msgr2=0x7f7e2c0706f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:40.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.428+0000 7f7e33a1a640 1 -- 172.21.15.77:0/3466270226 shutdown_connections 2023-11-04T01:41:40.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.428+0000 7f7e33a1a640 1 -- 172.21.15.77:0/3466270226 wait complete. 2023-11-04T01:41:40.442 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:40.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.542+0000 7f21e44fc640 1 Processor -- start 2023-11-04T01:41:40.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.542+0000 7f21e44fc640 1 -- start start 2023-11-04T01:41:40.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.543+0000 7f21e44fc640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f21dc0b0ae0 0x7f21dc0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.543+0000 7f21e44fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f21dc06db20 0x7f21dc15d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.543+0000 7f21e44fc640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21dc0b4110 con 0x7f21dc159c70 2023-11-04T01:41:40.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.543+0000 7f21e44fc640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21dc0b49b0 con 0x7f21dc06db20 2023-11-04T01:41:40.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.543+0000 7f21e44fc640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc0b43f0 con 0x7f21dc0b0ae0 2023-11-04T01:41:40.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.543+0000 7f21e2a99640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f21dc06db20 0x7f21dc15d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.543+0000 7f21e2a99640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f21dc06db20 0x7f21dc15d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45422/0 (socket says 172.21.15.77:45422) 2023-11-04T01:41:40.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.543+0000 7f21e2a99640 1 -- 172.21.15.77:0/2003622353 learned_addr learned my addr 172.21.15.77:0/2003622353 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:40.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.544+0000 7f21e1a97640 1 --2- 172.21.15.77:0/2003622353 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f21dc0b0ae0 0x7f21dc0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.544+0000 7f21e2a99640 1 -- 172.21.15.77:0/2003622353 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f21dc0b0ae0 msgr2=0x7f21dc0ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:40.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.544+0000 7f21e2a99640 1 --2- 172.21.15.77:0/2003622353 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f21dc0b0ae0 0x7f21dc0ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.544+0000 7f21e2a99640 1 -- 172.21.15.77:0/2003622353 >> v1:172.21.15.122:6789/0 conn(0x7f21dc159c70 legacy=0x7f21dc0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:40.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.544+0000 7f21e2a99640 1 -- 172.21.15.77:0/2003622353 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21dc0b46d0 con 0x7f21dc06db20 2023-11-04T01:41:40.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.544+0000 7f21e2a99640 1 --2- 172.21.15.77:0/2003622353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21dc06db20 0x7f21dc15d7d0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f21d400bb10 tx=0x7f21d402e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8d9217deaeae967 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:40.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.544+0000 7f21e1296640 1 -- 172.21.15.77:0/2003622353 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d402ee70 con 0x7f21dc06db20 2023-11-04T01:41:40.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.545+0000 7f21e1296640 1 -- 172.21.15.77:0/2003622353 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d4036440 con 0x7f21dc06db20 2023-11-04T01:41:40.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.545+0000 7f21e1296640 1 -- 172.21.15.77:0/2003622353 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d40367d0 con 0x7f21dc06db20 2023-11-04T01:41:40.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.545+0000 7f21e44fc640 1 -- 172.21.15.77:0/2003622353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21dc06db20 msgr2=0x7f21dc15d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.545+0000 7f21e44fc640 1 --2- 172.21.15.77:0/2003622353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21dc06db20 0x7f21dc15d7d0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f21d400bb10 tx=0x7f21d402e0c0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.545+0000 7f21e44fc640 1 -- 172.21.15.77:0/2003622353 shutdown_connections 2023-11-04T01:41:40.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.545+0000 7f21e44fc640 1 --2- 172.21.15.77:0/2003622353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21dc06db20 0x7f21dc15d7d0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.545+0000 7f21e44fc640 1 --2- 172.21.15.77:0/2003622353 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f21dc0b0ae0 0x7f21dc0ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.545+0000 7f21e44fc640 1 -- 172.21.15.77:0/2003622353 >> 172.21.15.77:0/2003622353 conn(0x7f21dc0ce950 msgr2=0x7f21dc0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:40.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.545+0000 7f21e44fc640 1 -- 172.21.15.77:0/2003622353 shutdown_connections 2023-11-04T01:41:40.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.545+0000 7f21e44fc640 1 -- 172.21.15.77:0/2003622353 wait complete. 2023-11-04T01:41:40.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.546+0000 7f21e44fc640 1 Processor -- start 2023-11-04T01:41:40.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.546+0000 7f21e44fc640 1 -- start start 2023-11-04T01:41:40.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.547+0000 7f21e44fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21dc06db20 0x7f21dc151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.547+0000 7f21e44fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21dc0b0ae0 0x7f21dc0ae840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.547+0000 7f21e44fc640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f21dc159c70 0x7f21dc0aed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.547+0000 7f21e44fc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc15a050 con 0x7f21dc0b0ae0 2023-11-04T01:41:40.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.547+0000 7f21e44fc640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc0ab8e0 con 0x7f21dc06db20 2023-11-04T01:41:40.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.547+0000 7f21e44fc640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc1523d0 con 0x7f21dc159c70 2023-11-04T01:41:40.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.547+0000 7f21e1a97640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21dc0b0ae0 0x7f21dc0ae840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.547+0000 7f21e1a97640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21dc0b0ae0 0x7f21dc0ae840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45438/0 (socket says 172.21.15.77:45438) 2023-11-04T01:41:40.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.547+0000 7f21e1a97640 1 -- 172.21.15.77:0/2328999616 learned_addr learned my addr 172.21.15.77:0/2328999616 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:40.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.547+0000 7f21e1a97640 1 -- 172.21.15.77:0/2328999616 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f21dc159c70 msgr2=0x7f21dc0aed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.547+0000 7f21e1a97640 1 --2- 172.21.15.77:0/2328999616 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f21dc159c70 0x7f21dc0aed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.547+0000 7f21e2298640 1 --2- 172.21.15.77:0/2328999616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21dc06db20 0x7f21dc151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.547+0000 7f21e1a97640 1 -- 172.21.15.77:0/2328999616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21dc06db20 msgr2=0x7f21dc151e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.547+0000 7f21e1a97640 1 --2- 172.21.15.77:0/2328999616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21dc06db20 0x7f21dc151e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.547+0000 7f21e1a97640 1 -- 172.21.15.77:0/2328999616 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d400b770 con 0x7f21dc0b0ae0 2023-11-04T01:41:40.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.548+0000 7f21e1a97640 1 --2- 172.21.15.77:0/2328999616 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21dc0b0ae0 0x7f21dc0ae840 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f21cc00c820 tx=0x7f21cc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:40.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.548+0000 7f21d2ffd640 1 -- 172.21.15.77:0/2328999616 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21cc004220 con 0x7f21dc0b0ae0 2023-11-04T01:41:40.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.548+0000 7f21d2ffd640 1 -- 172.21.15.77:0/2328999616 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21cc0043a0 con 0x7f21dc0b0ae0 2023-11-04T01:41:40.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.548+0000 7f21d2ffd640 1 -- 172.21.15.77:0/2328999616 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21cc007a70 con 0x7f21dc0b0ae0 2023-11-04T01:41:40.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.548+0000 7f21e44fc640 1 -- 172.21.15.77:0/2328999616 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21dc1527d0 con 0x7f21dc0b0ae0 2023-11-04T01:41:40.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.548+0000 7f21e44fc640 1 -- 172.21.15.77:0/2328999616 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21dc1f6380 con 0x7f21dc0b0ae0 2023-11-04T01:41:40.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.549+0000 7f21e44fc640 1 -- 172.21.15.77:0/2328999616 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21dc074290 con 0x7f21dc0b0ae0 2023-11-04T01:41:40.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.549+0000 7f21d2ffd640 1 -- 172.21.15.77:0/2328999616 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f21cc007bd0 con 0x7f21dc0b0ae0 2023-11-04T01:41:40.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.549+0000 7f21d2ffd640 1 --2- 172.21.15.77:0/2328999616 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f21c006ae70 0x7f21c006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.550+0000 7f21d2ffd640 1 -- 172.21.15.77:0/2328999616 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f21cc0896b0 con 0x7f21dc0b0ae0 2023-11-04T01:41:40.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.550+0000 7f21e2298640 1 --2- 172.21.15.77:0/2328999616 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f21c006ae70 0x7f21c006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.550+0000 7f21e2298640 1 --2- 172.21.15.77:0/2328999616 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f21c006ae70 0x7f21c006d330 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f21d8007fd0 tx=0x7f21d8009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:40.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.554+0000 7f21d2ffd640 1 -- 172.21.15.77:0/2328999616 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f21cc054480 con 0x7f21dc0b0ae0 2023-11-04T01:41:40.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.724+0000 7f21e44fc640 1 -- 172.21.15.77:0/2328999616 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21dc06d3f0 con 0x7f21dc0b0ae0 2023-11-04T01:41:40.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.725+0000 7f21d2ffd640 1 -- 172.21.15.77:0/2328999616 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18558 (secure 0 0 0) 0x7f21cc057aa0 con 0x7f21dc0b0ae0 2023-11-04T01:41:40.731 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:40.731 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":42,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:41:40.561109+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:41:22.769937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-04T01:41:23.907965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":7,"snaps":[{"begin":1,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:40.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.727+0000 7f21e44fc640 1 -- 172.21.15.77:0/2328999616 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f21c006ae70 msgr2=0x7f21c006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.727+0000 7f21e44fc640 1 --2- 172.21.15.77:0/2328999616 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f21c006ae70 0x7f21c006d330 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f21d8007fd0 tx=0x7f21d8009040 comp rx=0 tx=0).stop 2023-11-04T01:41:40.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.727+0000 7f21e44fc640 1 -- 172.21.15.77:0/2328999616 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21dc0b0ae0 msgr2=0x7f21dc0ae840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.727+0000 7f21e44fc640 1 --2- 172.21.15.77:0/2328999616 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21dc0b0ae0 0x7f21dc0ae840 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f21cc00c820 tx=0x7f21cc00cce0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.727+0000 7f21e44fc640 1 -- 172.21.15.77:0/2328999616 shutdown_connections 2023-11-04T01:41:40.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.727+0000 7f21e44fc640 1 --2- 172.21.15.77:0/2328999616 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f21c006ae70 0x7f21c006d330 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.727+0000 7f21e44fc640 1 --2- 172.21.15.77:0/2328999616 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f21dc159c70 0x7f21dc0aed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.727+0000 7f21e44fc640 1 --2- 172.21.15.77:0/2328999616 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21dc0b0ae0 0x7f21dc0ae840 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.727+0000 7f21e44fc640 1 --2- 172.21.15.77:0/2328999616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f21dc06db20 0x7f21dc151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.727+0000 7f21e44fc640 1 -- 172.21.15.77:0/2328999616 >> 172.21.15.77:0/2328999616 conn(0x7f21dc0ce950 msgr2=0x7f21dc0b1570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:40.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.727+0000 7f21e44fc640 1 -- 172.21.15.77:0/2328999616 shutdown_connections 2023-11-04T01:41:40.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.727+0000 7f21e44fc640 1 -- 172.21.15.77:0/2328999616 wait complete. 2023-11-04T01:41:40.742 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-04T01:41:40.742 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:40.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.839+0000 7f9eb43bb640 1 Processor -- start 2023-11-04T01:41:40.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.839+0000 7f9eb43bb640 1 -- start start 2023-11-04T01:41:40.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.840+0000 7f9eb43bb640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9eac0ce370 0x7f9eac06db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.840+0000 7f9eb43bb640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eac06e060 con 0x7f9eac159c70 2023-11-04T01:41:40.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.840+0000 7f9eb43bb640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eac0b4110 con 0x7f9eac0b0ae0 2023-11-04T01:41:40.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.840+0000 7f9eb43bb640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eac0b49b0 con 0x7f9eac0ce370 2023-11-04T01:41:40.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.840+0000 7f9eb2157640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f9eac159c70 0x7f9eac0b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:50728/0 (socket says 172.21.15.77:50728) 2023-11-04T01:41:40.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.840+0000 7f9eb2157640 1 -- 172.21.15.77:0/753308196 learned_addr learned my addr 172.21.15.77:0/753308196 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:40.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.840+0000 7f9eb2958640 1 --2- 172.21.15.77:0/753308196 >> v2:172.21.15.122:3300/0 conn(0x7f9eac0ce370 0x7f9eac06db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.840+0000 7f9eb1155640 1 -- 172.21.15.77:0/753308196 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 609278434 0 0) 0x7f9eac06e060 con 0x7f9eac159c70 2023-11-04T01:41:40.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.840+0000 7f9eb1155640 1 -- 172.21.15.77:0/753308196 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e98003520 con 0x7f9eac159c70 2023-11-04T01:41:40.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.840+0000 7f9eb1155640 1 -- 172.21.15.77:0/753308196 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 205754597 0 0) 0x7f9e98003520 con 0x7f9eac159c70 2023-11-04T01:41:40.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.840+0000 7f9eb1155640 1 -- 172.21.15.77:0/753308196 >> v2:172.21.15.122:3300/0 conn(0x7f9eac0ce370 msgr2=0x7f9eac06db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:40.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.840+0000 7f9eb1155640 1 --2- 172.21.15.77:0/753308196 >> v2:172.21.15.122:3300/0 conn(0x7f9eac0ce370 0x7f9eac06db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.840+0000 7f9eb1155640 1 -- 172.21.15.77:0/753308196 >> v1:172.21.15.122:6789/0 conn(0x7f9eac0b0ae0 legacy=0x7f9eac15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.841+0000 7f9eb1155640 1 -- 172.21.15.77:0/753308196 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eac0b43f0 con 0x7f9eac159c70 2023-11-04T01:41:40.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.841+0000 7f9eb1155640 1 -- 172.21.15.77:0/753308196 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f9ea8001670 con 0x7f9eac159c70 2023-11-04T01:41:40.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.841+0000 7f9eb1155640 1 -- 172.21.15.77:0/753308196 >> v1:172.21.15.77:6789/0 conn(0x7f9eac159c70 legacy=0x7f9eac0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.841+0000 7f9eb1155640 1 --2- 172.21.15.77:0/753308196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e98003970 0x7f9e98003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.841+0000 7f9eb1155640 1 --2- 172.21.15.77:0/753308196 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9e980047c0 0x7f9e98004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.841+0000 7f9eb1155640 1 --2- 172.21.15.77:0/753308196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e98005180 0x7f9e9800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.841+0000 7f9eb1155640 1 -- 172.21.15.77:0/753308196 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac0b49b0 con 0x7f9e98005180 2023-11-04T01:41:40.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.841+0000 7f9eb1155640 1 -- 172.21.15.77:0/753308196 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9800c050 con 0x7f9e98003970 2023-11-04T01:41:40.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.841+0000 7f9eb1155640 1 -- 172.21.15.77:0/753308196 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9800c210 con 0x7f9e980047c0 2023-11-04T01:41:40.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.841+0000 7f9eb2958640 1 --2- 172.21.15.77:0/753308196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e98005180 0x7f9e9800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.841+0000 7f9eb2157640 1 --2- 172.21.15.77:0/753308196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e98003970 0x7f9e98003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.841+0000 7f9eb1956640 1 --2- 172.21.15.77:0/753308196 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9e980047c0 0x7f9e98004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.841+0000 7f9eb2958640 1 -- 172.21.15.77:0/753308196 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9e980047c0 msgr2=0x7f9e98004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:40.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.841+0000 7f9eb2958640 1 --2- 172.21.15.77:0/753308196 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9e980047c0 0x7f9e98004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.841+0000 7f9eb2958640 1 -- 172.21.15.77:0/753308196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e98003970 msgr2=0x7f9e98003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:40.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.841+0000 7f9eb2958640 1 --2- 172.21.15.77:0/753308196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e98003970 0x7f9e98003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.841+0000 7f9eb2958640 1 -- 172.21.15.77:0/753308196 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e98003520 con 0x7f9e98005180 2023-11-04T01:41:40.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.842+0000 7f9eb2958640 1 -- 172.21.15.77:0/753308196 reap_dead start 2023-11-04T01:41:40.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.842+0000 7f9eb2958640 1 --2- 172.21.15.77:0/753308196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e98005180 0x7f9e9800b980 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4009fc0 tx=0x7f9e980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf087b78afa5bf2f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:40.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.842+0000 7f9eb1155640 1 -- 172.21.15.77:0/753308196 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea402cc60 con 0x7f9e98005180 2023-11-04T01:41:40.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.842+0000 7f9eb1155640 1 -- 172.21.15.77:0/753308196 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea400f040 con 0x7f9e98005180 2023-11-04T01:41:40.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.842+0000 7f9eb1155640 1 -- 172.21.15.77:0/753308196 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4003990 con 0x7f9e98005180 2023-11-04T01:41:40.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.842+0000 7f9eb43bb640 1 -- 172.21.15.77:0/753308196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e98005180 msgr2=0x7f9e9800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.842+0000 7f9eb43bb640 1 --2- 172.21.15.77:0/753308196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e98005180 0x7f9e9800b980 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4009fc0 tx=0x7f9e980057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.842+0000 7f9eb43bb640 1 -- 172.21.15.77:0/753308196 shutdown_connections 2023-11-04T01:41:40.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.842+0000 7f9eb43bb640 1 --2- 172.21.15.77:0/753308196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e98005180 0x7f9e9800b980 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.842+0000 7f9eb43bb640 1 -- 172.21.15.77:0/753308196 >> 172.21.15.77:0/753308196 conn(0x7f9eac0ce950 msgr2=0x7f9eac0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:40.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.843+0000 7f9eb43bb640 1 -- 172.21.15.77:0/753308196 shutdown_connections 2023-11-04T01:41:40.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.843+0000 7f9eb43bb640 1 -- 172.21.15.77:0/753308196 wait complete. 2023-11-04T01:41:40.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.844+0000 7f9eb43bb640 1 Processor -- start 2023-11-04T01:41:40.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.844+0000 7f9eb43bb640 1 -- start start 2023-11-04T01:41:40.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.844+0000 7f9eb43bb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e98005180 0x7f9eac150c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.844+0000 7f9eb43bb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9eac157260 0x7f9eac152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.844+0000 7f9eb43bb640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9eac153030 0x7f9eac0c4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.844+0000 7f9eb43bb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac0ce7e0 con 0x7f9e98005180 2023-11-04T01:41:40.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.844+0000 7f9eb43bb640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac154060 con 0x7f9eac157260 2023-11-04T01:41:40.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.844+0000 7f9eb43bb640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac1534e0 con 0x7f9eac153030 2023-11-04T01:41:40.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.845+0000 7f9eb2157640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e98005180 0x7f9eac150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.845+0000 7f9eb2157640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e98005180 0x7f9eac150c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45466/0 (socket says 172.21.15.77:45466) 2023-11-04T01:41:40.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.845+0000 7f9eb2157640 1 -- 172.21.15.77:0/2947877926 learned_addr learned my addr 172.21.15.77:0/2947877926 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:40.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.845+0000 7f9eb1956640 1 --2- 172.21.15.77:0/2947877926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9eac157260 0x7f9eac152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.845+0000 7f9eb2157640 1 -- 172.21.15.77:0/2947877926 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9eac153030 msgr2=0x7f9eac0c4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.845+0000 7f9eb2157640 1 --2- 172.21.15.77:0/2947877926 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9eac153030 0x7f9eac0c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.845+0000 7f9eb2157640 1 -- 172.21.15.77:0/2947877926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9eac157260 msgr2=0x7f9eac152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:40.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.845+0000 7f9eb2157640 1 --2- 172.21.15.77:0/2947877926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9eac157260 0x7f9eac152af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:40.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.845+0000 7f9eb2157640 1 -- 172.21.15.77:0/2947877926 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eac1537c0 con 0x7f9e98005180 2023-11-04T01:41:40.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.845+0000 7f9eb2157640 1 --2- 172.21.15.77:0/2947877926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e98005180 0x7f9eac150c90 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8004a10 tx=0x7f9ea8004ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:40.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.845+0000 7f9ea2ffd640 1 -- 172.21.15.77:0/2947877926 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8011be0 con 0x7f9e98005180 2023-11-04T01:41:40.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.845+0000 7f9ea2ffd640 1 -- 172.21.15.77:0/2947877926 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea8011d60 con 0x7f9e98005180 2023-11-04T01:41:40.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.845+0000 7f9eb43bb640 1 -- 172.21.15.77:0/2947877926 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eac153aa0 con 0x7f9e98005180 2023-11-04T01:41:40.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.845+0000 7f9ea2ffd640 1 -- 172.21.15.77:0/2947877926 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea80145b0 con 0x7f9e98005180 2023-11-04T01:41:40.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.845+0000 7f9eb43bb640 1 -- 172.21.15.77:0/2947877926 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eac1511d0 con 0x7f9e98005180 2023-11-04T01:41:40.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.846+0000 7f9eb43bb640 1 -- 172.21.15.77:0/2947877926 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eac074290 con 0x7f9e98005180 2023-11-04T01:41:40.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.847+0000 7f9ea2ffd640 1 -- 172.21.15.77:0/2947877926 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9ea8014710 con 0x7f9e98005180 2023-11-04T01:41:40.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.847+0000 7f9ea2ffd640 1 --2- 172.21.15.77:0/2947877926 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9e9006ae70 0x7f9e9006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:40.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.847+0000 7f9ea2ffd640 1 -- 172.21.15.77:0/2947877926 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f9ea808ba70 con 0x7f9e98005180 2023-11-04T01:41:40.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.847+0000 7f9eb1956640 1 --2- 172.21.15.77:0/2947877926 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9e9006ae70 0x7f9e9006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:40.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.848+0000 7f9eb1956640 1 --2- 172.21.15.77:0/2947877926 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9e9006ae70 0x7f9e9006d330 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c000c00 tx=0x7f9e9c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:40.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:40.851+0000 7f9ea2ffd640 1 -- 172.21.15.77:0/2947877926 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9ea8056860 con 0x7f9e98005180 2023-11-04T01:41:41.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.052+0000 7f9eb43bb640 1 -- 172.21.15.77:0/2947877926 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9eac06d3f0 con 0x7f9e98005180 2023-11-04T01:41:41.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.052+0000 7f9ea2ffd640 1 -- 172.21.15.77:0/2947877926 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4920 (secure 0 0 0) 0x7f9ea801c070 con 0x7f9e98005180 2023-11-04T01:41:41.055 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:41.056 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5511,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/1132914884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1132914884},{"type":"v1","addr":"172.21.15.77:6834","nonce":1132914884}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5514,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/530959421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":530959421},{"type":"v1","addr":"172.21.15.77:6835","nonce":530959421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":34823,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/1375125704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1375125704},{"type":"v1","addr":"172.21.15.122:6836","nonce":1375125704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:41:24.933073+0000","modified":"2023-11-04T01:41:26.930876+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34826},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34826":{"gid":34826,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/3085479427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":3085479427},{"type":"v1","addr":"172.21.15.122:6837","nonce":3085479427}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-04T01:41:41.056 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 16 2023-11-04T01:41:41.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.054+0000 7f9eb43bb640 1 -- 172.21.15.77:0/2947877926 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9e9006ae70 msgr2=0x7f9e9006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.054+0000 7f9eb43bb640 1 --2- 172.21.15.77:0/2947877926 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9e9006ae70 0x7f9e9006d330 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c000c00 tx=0x7f9e9c009040 comp rx=0 tx=0).stop 2023-11-04T01:41:41.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.054+0000 7f9eb43bb640 1 -- 172.21.15.77:0/2947877926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e98005180 msgr2=0x7f9eac150c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.054+0000 7f9eb43bb640 1 --2- 172.21.15.77:0/2947877926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e98005180 0x7f9eac150c90 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8004a10 tx=0x7f9ea8004ed0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.054+0000 7f9eb43bb640 1 -- 172.21.15.77:0/2947877926 shutdown_connections 2023-11-04T01:41:41.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.054+0000 7f9eb43bb640 1 --2- 172.21.15.77:0/2947877926 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9e9006ae70 0x7f9e9006d330 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.054+0000 7f9eb43bb640 1 --2- 172.21.15.77:0/2947877926 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9eac153030 0x7f9eac0c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.054+0000 7f9eb43bb640 1 --2- 172.21.15.77:0/2947877926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9eac157260 0x7f9eac152af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.054+0000 7f9eb43bb640 1 --2- 172.21.15.77:0/2947877926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e98005180 0x7f9eac150c90 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.054+0000 7f9eb43bb640 1 -- 172.21.15.77:0/2947877926 >> 172.21.15.77:0/2947877926 conn(0x7f9eac0ce950 msgr2=0x7f9eac06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:41.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.054+0000 7f9eb43bb640 1 -- 172.21.15.77:0/2947877926 shutdown_connections 2023-11-04T01:41:41.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.054+0000 7f9eb43bb640 1 -- 172.21.15.77:0/2947877926 wait complete. 2023-11-04T01:41:41.067 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:41.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.164+0000 7f8ddc407640 1 Processor -- start 2023-11-04T01:41:41.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.164+0000 7f8ddc407640 1 -- start start 2023-11-04T01:41:41.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.165+0000 7f8ddc407640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8dd40cde60 0x7f8dd415d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.165+0000 7f8ddc407640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8dd415daa0 0x7f8dd4157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.165+0000 7f8ddc407640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8dd40ce240 0x7f8dd4157540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.165+0000 7f8ddc407640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dd415e5c0 con 0x7f8dd415daa0 2023-11-04T01:41:41.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.165+0000 7f8ddc407640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dd4157a80 con 0x7f8dd40ce240 2023-11-04T01:41:41.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.165+0000 7f8ddc407640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd415e000 con 0x7f8dd40cde60 2023-11-04T01:41:41.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.165+0000 7f8dd99a2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8dd415daa0 0x7f8dd4157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.166+0000 7f8dd99a2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8dd415daa0 0x7f8dd4157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45472/0 (socket says 172.21.15.77:45472) 2023-11-04T01:41:41.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.166+0000 7f8dd99a2640 1 -- 172.21.15.77:0/987828394 learned_addr learned my addr 172.21.15.77:0/987828394 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:41.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.166+0000 7f8dda1a3640 1 --2- 172.21.15.77:0/987828394 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8dd40cde60 0x7f8dd415d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.166+0000 7f8dda9a4640 1 --2- 172.21.15.77:0/987828394 >> v2:172.21.15.122:3300/0 conn(0x7f8dd40ce240 0x7f8dd4157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.166+0000 7f8dd99a2640 1 -- 172.21.15.77:0/987828394 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8dd40cde60 msgr2=0x7f8dd415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:41.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.166+0000 7f8dd99a2640 1 --2- 172.21.15.77:0/987828394 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8dd40cde60 0x7f8dd415d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.166+0000 7f8dd99a2640 1 -- 172.21.15.77:0/987828394 >> v2:172.21.15.122:3300/0 conn(0x7f8dd40ce240 msgr2=0x7f8dd4157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:41.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.166+0000 7f8dd99a2640 1 --2- 172.21.15.77:0/987828394 >> v2:172.21.15.122:3300/0 conn(0x7f8dd40ce240 0x7f8dd4157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.166+0000 7f8dd99a2640 1 -- 172.21.15.77:0/987828394 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd415e2e0 con 0x7f8dd415daa0 2023-11-04T01:41:41.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.166+0000 7f8dda1a3640 1 --2- 172.21.15.77:0/987828394 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8dd40cde60 0x7f8dd415d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:41.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.166+0000 7f8dda9a4640 1 --2- 172.21.15.77:0/987828394 >> v2:172.21.15.122:3300/0 conn(0x7f8dd40ce240 0x7f8dd4157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:41.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.167+0000 7f8dd99a2640 1 --2- 172.21.15.77:0/987828394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8dd415daa0 0x7f8dd4157000 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f8dd415df30 tx=0x7f8dc402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aadb87c5b9f20c09 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:41.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.167+0000 7f8dd91a1640 1 -- 172.21.15.77:0/987828394 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc4031870 con 0x7f8dd415daa0 2023-11-04T01:41:41.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.167+0000 7f8dd91a1640 1 -- 172.21.15.77:0/987828394 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc40319d0 con 0x7f8dd415daa0 2023-11-04T01:41:41.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.167+0000 7f8dd91a1640 1 -- 172.21.15.77:0/987828394 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc4031d60 con 0x7f8dd415daa0 2023-11-04T01:41:41.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.167+0000 7f8ddc407640 1 -- 172.21.15.77:0/987828394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8dd415daa0 msgr2=0x7f8dd4157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.167+0000 7f8ddc407640 1 --2- 172.21.15.77:0/987828394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8dd415daa0 0x7f8dd4157000 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f8dd415df30 tx=0x7f8dc402b910 comp rx=0 tx=0).stop 2023-11-04T01:41:41.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.167+0000 7f8ddc407640 1 -- 172.21.15.77:0/987828394 shutdown_connections 2023-11-04T01:41:41.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.167+0000 7f8ddc407640 1 --2- 172.21.15.77:0/987828394 >> v2:172.21.15.122:3300/0 conn(0x7f8dd40ce240 0x7f8dd4157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.167+0000 7f8ddc407640 1 --2- 172.21.15.77:0/987828394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8dd415daa0 0x7f8dd4157000 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.167+0000 7f8ddc407640 1 --2- 172.21.15.77:0/987828394 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8dd40cde60 0x7f8dd415d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.167+0000 7f8ddc407640 1 -- 172.21.15.77:0/987828394 >> 172.21.15.77:0/987828394 conn(0x7f8dd4071f30 msgr2=0x7f8dd40cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:41.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.167+0000 7f8ddc407640 1 -- 172.21.15.77:0/987828394 shutdown_connections 2023-11-04T01:41:41.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.167+0000 7f8ddc407640 1 -- 172.21.15.77:0/987828394 wait complete. 2023-11-04T01:41:41.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.168+0000 7f8ddc407640 1 Processor -- start 2023-11-04T01:41:41.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.168+0000 7f8ddc407640 1 -- start start 2023-11-04T01:41:41.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.169+0000 7f8ddc407640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8dd40cde60 0x7f8dd41585d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.169+0000 7f8ddc407640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8dd40ce240 0x7f8dd4147f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.169+0000 7f8ddc407640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8dd415daa0 0x7f8dd4148440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.169+0000 7f8ddc407640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd41f2210 con 0x7f8dd40cde60 2023-11-04T01:41:41.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.169+0000 7f8ddc407640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd4158e20 con 0x7f8dd40ce240 2023-11-04T01:41:41.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.169+0000 7f8ddc407640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd4159100 con 0x7f8dd415daa0 2023-11-04T01:41:41.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.169+0000 7f8dda1a3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8dd40cde60 0x7f8dd41585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.169+0000 7f8dda1a3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8dd40cde60 0x7f8dd41585d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45486/0 (socket says 172.21.15.77:45486) 2023-11-04T01:41:41.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.169+0000 7f8dda1a3640 1 -- 172.21.15.77:0/1310209168 learned_addr learned my addr 172.21.15.77:0/1310209168 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:41.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.169+0000 7f8dda9a4640 1 --2- 172.21.15.77:0/1310209168 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8dd415daa0 0x7f8dd4148440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.169+0000 7f8dd99a2640 1 --2- 172.21.15.77:0/1310209168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8dd40ce240 0x7f8dd4147f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.170+0000 7f8dda1a3640 1 -- 172.21.15.77:0/1310209168 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8dd415daa0 msgr2=0x7f8dd4148440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.170+0000 7f8dda1a3640 1 --2- 172.21.15.77:0/1310209168 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8dd415daa0 0x7f8dd4148440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.170+0000 7f8dda1a3640 1 -- 172.21.15.77:0/1310209168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8dd40ce240 msgr2=0x7f8dd4147f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.170+0000 7f8dda1a3640 1 --2- 172.21.15.77:0/1310209168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8dd40ce240 0x7f8dd4147f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.170+0000 7f8dda1a3640 1 -- 172.21.15.77:0/1310209168 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc40094d0 con 0x7f8dd40cde60 2023-11-04T01:41:41.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.170+0000 7f8dda1a3640 1 --2- 172.21.15.77:0/1310209168 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8dd40cde60 0x7f8dd41585d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f8dd000cee0 tx=0x7f8dd000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:41.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.170+0000 7f8dcaffd640 1 -- 172.21.15.77:0/1310209168 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd000d840 con 0x7f8dd40cde60 2023-11-04T01:41:41.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.170+0000 7f8dcaffd640 1 -- 172.21.15.77:0/1310209168 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd000d9a0 con 0x7f8dd40cde60 2023-11-04T01:41:41.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.170+0000 7f8ddc407640 1 -- 172.21.15.77:0/1310209168 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dd41593e0 con 0x7f8dd40cde60 2023-11-04T01:41:41.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.170+0000 7f8dcaffd640 1 -- 172.21.15.77:0/1310209168 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd000dd30 con 0x7f8dd40cde60 2023-11-04T01:41:41.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.170+0000 7f8ddc407640 1 -- 172.21.15.77:0/1310209168 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dd4158b10 con 0x7f8dd40cde60 2023-11-04T01:41:41.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.171+0000 7f8ddc407640 1 -- 172.21.15.77:0/1310209168 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dd4074290 con 0x7f8dd40cde60 2023-11-04T01:41:41.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.171+0000 7f8dcaffd640 1 -- 172.21.15.77:0/1310209168 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8dd0015440 con 0x7f8dd40cde60 2023-11-04T01:41:41.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.172+0000 7f8dcaffd640 1 --2- 172.21.15.77:0/1310209168 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8db806ae70 0x7f8db806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.172+0000 7f8dcaffd640 1 -- 172.21.15.77:0/1310209168 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f8dd008a1a0 con 0x7f8dd40cde60 2023-11-04T01:41:41.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.172+0000 7f8dd99a2640 1 --2- 172.21.15.77:0/1310209168 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8db806ae70 0x7f8db806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.173+0000 7f8dd99a2640 1 --2- 172.21.15.77:0/1310209168 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8db806ae70 0x7f8db806d330 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8dc4036000 tx=0x7f8dc403c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:41.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.176+0000 7f8dcaffd640 1 -- 172.21.15.77:0/1310209168 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8dd0055040 con 0x7f8dd40cde60 2023-11-04T01:41:41.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.377+0000 7f8ddc407640 1 -- 172.21.15.77:0/1310209168 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8dd40d0d50 con 0x7f8dd40cde60 2023-11-04T01:41:41.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.378+0000 7f8dcaffd640 1 -- 172.21.15.77:0/1310209168 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4920 (secure 0 0 0) 0x7f8dd0058660 con 0x7f8dd40cde60 2023-11-04T01:41:41.381 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:41.381 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5511,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/1132914884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1132914884},{"type":"v1","addr":"172.21.15.77:6834","nonce":1132914884}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5514,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/530959421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":530959421},{"type":"v1","addr":"172.21.15.77:6835","nonce":530959421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":34823,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/1375125704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1375125704},{"type":"v1","addr":"172.21.15.122:6836","nonce":1375125704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:41:24.933073+0000","modified":"2023-11-04T01:41:26.930876+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34826},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34826":{"gid":34826,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/3085479427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":3085479427},{"type":"v1","addr":"172.21.15.122:6837","nonce":3085479427}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-04T01:41:41.381 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 16 2023-11-04T01:41:41.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.379+0000 7f8ddc407640 1 -- 172.21.15.77:0/1310209168 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8db806ae70 msgr2=0x7f8db806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.379+0000 7f8ddc407640 1 --2- 172.21.15.77:0/1310209168 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8db806ae70 0x7f8db806d330 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8dc4036000 tx=0x7f8dc403c040 comp rx=0 tx=0).stop 2023-11-04T01:41:41.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.379+0000 7f8ddc407640 1 -- 172.21.15.77:0/1310209168 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8dd40cde60 msgr2=0x7f8dd41585d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.379+0000 7f8ddc407640 1 --2- 172.21.15.77:0/1310209168 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8dd40cde60 0x7f8dd41585d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f8dd000cee0 tx=0x7f8dd000a710 comp rx=0 tx=0).stop 2023-11-04T01:41:41.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.380+0000 7f8ddc407640 1 -- 172.21.15.77:0/1310209168 shutdown_connections 2023-11-04T01:41:41.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.380+0000 7f8ddc407640 1 --2- 172.21.15.77:0/1310209168 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8db806ae70 0x7f8db806d330 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.380+0000 7f8ddc407640 1 --2- 172.21.15.77:0/1310209168 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8dd415daa0 0x7f8dd4148440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.380+0000 7f8ddc407640 1 --2- 172.21.15.77:0/1310209168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8dd40ce240 0x7f8dd4147f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.380+0000 7f8ddc407640 1 --2- 172.21.15.77:0/1310209168 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8dd40cde60 0x7f8dd41585d0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.380+0000 7f8ddc407640 1 -- 172.21.15.77:0/1310209168 >> 172.21.15.77:0/1310209168 conn(0x7f8dd4071f30 msgr2=0x7f8dd40b7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:41.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.380+0000 7f8ddc407640 1 -- 172.21.15.77:0/1310209168 shutdown_connections 2023-11-04T01:41:41.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.380+0000 7f8ddc407640 1 -- 172.21.15.77:0/1310209168 wait complete. 2023-11-04T01:41:41.393 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:41.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.492+0000 7f2e15626640 1 Processor -- start 2023-11-04T01:41:41.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.492+0000 7f2e15626640 1 -- start start 2023-11-04T01:41:41.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.492+0000 7f2e15626640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e100cde60 0x7f2e1015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.492+0000 7f2e15626640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2e100ce240 0x7f2e100d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.492+0000 7f2e15626640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e1015e000 con 0x7f2e1015daa0 2023-11-04T01:41:41.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.492+0000 7f2e15626640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e1015e5c0 con 0x7f2e100ce240 2023-11-04T01:41:41.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.492+0000 7f2e15626640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1015e2e0 con 0x7f2e100cde60 2023-11-04T01:41:41.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.493+0000 7f2e0f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2e100ce240 0x7f2e100d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.493+0000 7f2e0f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2e100ce240 0x7f2e100d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45492/0 (socket says 172.21.15.77:45492) 2023-11-04T01:41:41.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.493+0000 7f2e0f7fe640 1 -- 172.21.15.77:0/1162801547 learned_addr learned my addr 172.21.15.77:0/1162801547 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:41.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.493+0000 7f2e0effd640 1 --2- 172.21.15.77:0/1162801547 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e100cde60 0x7f2e1015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.493+0000 7f2e0f7fe640 1 -- 172.21.15.77:0/1162801547 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e100cde60 msgr2=0x7f2e1015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:41.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.493+0000 7f2e0f7fe640 1 --2- 172.21.15.77:0/1162801547 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e100cde60 0x7f2e1015d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.493+0000 7f2e0f7fe640 1 -- 172.21.15.77:0/1162801547 >> v1:172.21.15.122:6789/0 conn(0x7f2e1015daa0 legacy=0x7f2e10157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.493+0000 7f2e0f7fe640 1 -- 172.21.15.77:0/1162801547 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e100d1120 con 0x7f2e100ce240 2023-11-04T01:41:41.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.493+0000 7f2e0f7fe640 1 --2- 172.21.15.77:0/1162801547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e100ce240 0x7f2e100d1920 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f2e08009e50 tx=0x7f2e0802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40a2ea138ce0ed09 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:41.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.494+0000 7f2e0e7fc640 1 -- 172.21.15.77:0/1162801547 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0802cb00 con 0x7f2e100ce240 2023-11-04T01:41:41.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.494+0000 7f2e0e7fc640 1 -- 172.21.15.77:0/1162801547 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0802cc60 con 0x7f2e100ce240 2023-11-04T01:41:41.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.494+0000 7f2e0e7fc640 1 -- 172.21.15.77:0/1162801547 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e080343f0 con 0x7f2e100ce240 2023-11-04T01:41:41.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.494+0000 7f2e15626640 1 -- 172.21.15.77:0/1162801547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e100ce240 msgr2=0x7f2e100d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.494+0000 7f2e15626640 1 --2- 172.21.15.77:0/1162801547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e100ce240 0x7f2e100d1920 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f2e08009e50 tx=0x7f2e0802bf60 comp rx=0 tx=0).stop 2023-11-04T01:41:41.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.494+0000 7f2e15626640 1 -- 172.21.15.77:0/1162801547 shutdown_connections 2023-11-04T01:41:41.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.494+0000 7f2e15626640 1 --2- 172.21.15.77:0/1162801547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e100ce240 0x7f2e100d1920 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.494+0000 7f2e15626640 1 --2- 172.21.15.77:0/1162801547 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e100cde60 0x7f2e1015d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.494+0000 7f2e15626640 1 -- 172.21.15.77:0/1162801547 >> 172.21.15.77:0/1162801547 conn(0x7f2e10071f30 msgr2=0x7f2e100cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:41.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.494+0000 7f2e15626640 1 -- 172.21.15.77:0/1162801547 shutdown_connections 2023-11-04T01:41:41.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.494+0000 7f2e15626640 1 -- 172.21.15.77:0/1162801547 wait complete. 2023-11-04T01:41:41.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.495+0000 7f2e15626640 1 Processor -- start 2023-11-04T01:41:41.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.496+0000 7f2e15626640 1 -- start start 2023-11-04T01:41:41.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.496+0000 7f2e15626640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e100cde60 0x7f2e101f2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.496+0000 7f2e15626640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e100ce240 0x7f2e100c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.496+0000 7f2e15626640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e1015daa0 0x7f2e100cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.496+0000 7f2e15626640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e100cae20 con 0x7f2e100ce240 2023-11-04T01:41:41.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.496+0000 7f2e15626640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e100ca860 con 0x7f2e100cde60 2023-11-04T01:41:41.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.496+0000 7f2e15626640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e100cab40 con 0x7f2e1015daa0 2023-11-04T01:41:41.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.496+0000 7f2e067fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e100ce240 0x7f2e100c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.496+0000 7f2e067fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e100ce240 0x7f2e100c9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45508/0 (socket says 172.21.15.77:45508) 2023-11-04T01:41:41.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.496+0000 7f2e067fc640 1 -- 172.21.15.77:0/2273342155 learned_addr learned my addr 172.21.15.77:0/2273342155 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:41.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.497+0000 7f2e0f7fe640 1 --2- 172.21.15.77:0/2273342155 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e1015daa0 0x7f2e100cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.497+0000 7f2e0effd640 1 --2- 172.21.15.77:0/2273342155 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e100cde60 0x7f2e101f2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.497+0000 7f2e067fc640 1 -- 172.21.15.77:0/2273342155 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e1015daa0 msgr2=0x7f2e100cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.497+0000 7f2e067fc640 1 --2- 172.21.15.77:0/2273342155 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e1015daa0 0x7f2e100cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.497+0000 7f2e067fc640 1 -- 172.21.15.77:0/2273342155 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e100cde60 msgr2=0x7f2e101f2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.497+0000 7f2e067fc640 1 --2- 172.21.15.77:0/2273342155 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e100cde60 0x7f2e101f2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.497+0000 7f2e067fc640 1 -- 172.21.15.77:0/2273342155 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e08009b30 con 0x7f2e100ce240 2023-11-04T01:41:41.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.497+0000 7f2e0effd640 1 --2- 172.21.15.77:0/2273342155 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e100cde60 0x7f2e101f2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:41.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.497+0000 7f2e067fc640 1 --2- 172.21.15.77:0/2273342155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e100ce240 0x7f2e100c9ef0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f2df800c400 tx=0x7f2df800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:41.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.497+0000 7f2e07fff640 1 -- 172.21.15.77:0/2273342155 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df80052d0 con 0x7f2e100ce240 2023-11-04T01:41:41.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.497+0000 7f2e07fff640 1 -- 172.21.15.77:0/2273342155 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df8005430 con 0x7f2e100ce240 2023-11-04T01:41:41.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.497+0000 7f2e07fff640 1 -- 172.21.15.77:0/2273342155 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df8003830 con 0x7f2e100ce240 2023-11-04T01:41:41.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.497+0000 7f2e15626640 1 -- 172.21.15.77:0/2273342155 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e10152590 con 0x7f2e100ce240 2023-11-04T01:41:41.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.497+0000 7f2e15626640 1 -- 172.21.15.77:0/2273342155 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e101f2540 con 0x7f2e100ce240 2023-11-04T01:41:41.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.498+0000 7f2e15626640 1 -- 172.21.15.77:0/2273342155 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e10152ab0 con 0x7f2e100ce240 2023-11-04T01:41:41.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.498+0000 7f2e07fff640 1 -- 172.21.15.77:0/2273342155 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2df8003990 con 0x7f2e100ce240 2023-11-04T01:41:41.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.499+0000 7f2e07fff640 1 --2- 172.21.15.77:0/2273342155 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2df006ae70 0x7f2df006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.499+0000 7f2e07fff640 1 -- 172.21.15.77:0/2273342155 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f2df8088dc0 con 0x7f2e100ce240 2023-11-04T01:41:41.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.499+0000 7f2e0effd640 1 --2- 172.21.15.77:0/2273342155 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2df006ae70 0x7f2df006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.499+0000 7f2e0effd640 1 --2- 172.21.15.77:0/2273342155 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2df006ae70 0x7f2df006d330 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2e00006fd0 tx=0x7f2e00008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:41.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.503+0000 7f2e07fff640 1 -- 172.21.15.77:0/2273342155 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2e10152ab0 con 0x7f2e100ce240 2023-11-04T01:41:41.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.674+0000 7f2e15626640 1 -- 172.21.15.77:0/2273342155 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e10152ab0 con 0x7f2e100ce240 2023-11-04T01:41:41.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.675+0000 7f2e07fff640 1 -- 172.21.15.77:0/2273342155 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18558 (secure 0 0 0) 0x7f2e10152ab0 con 0x7f2e100ce240 2023-11-04T01:41:41.678 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:41.678 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":42,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:41:40.561109+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:41:22.769937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-04T01:41:23.907965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":7,"snaps":[{"begin":1,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:41.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.677+0000 7f2e15626640 1 -- 172.21.15.77:0/2273342155 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2df006ae70 msgr2=0x7f2df006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.677+0000 7f2e15626640 1 --2- 172.21.15.77:0/2273342155 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2df006ae70 0x7f2df006d330 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2e00006fd0 tx=0x7f2e00008040 comp rx=0 tx=0).stop 2023-11-04T01:41:41.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.677+0000 7f2e15626640 1 -- 172.21.15.77:0/2273342155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e100ce240 msgr2=0x7f2e100c9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.677+0000 7f2e15626640 1 --2- 172.21.15.77:0/2273342155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e100ce240 0x7f2e100c9ef0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f2df800c400 tx=0x7f2df800c8c0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.677+0000 7f2e15626640 1 -- 172.21.15.77:0/2273342155 shutdown_connections 2023-11-04T01:41:41.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.677+0000 7f2e15626640 1 --2- 172.21.15.77:0/2273342155 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2df006ae70 0x7f2df006d330 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.677+0000 7f2e15626640 1 --2- 172.21.15.77:0/2273342155 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e1015daa0 0x7f2e100cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.677+0000 7f2e15626640 1 --2- 172.21.15.77:0/2273342155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e100ce240 0x7f2e100c9ef0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.677+0000 7f2e15626640 1 --2- 172.21.15.77:0/2273342155 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e100cde60 0x7f2e101f2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.677+0000 7f2e15626640 1 -- 172.21.15.77:0/2273342155 >> 172.21.15.77:0/2273342155 conn(0x7f2e10071f30 msgr2=0x7f2e100d1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:41.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.677+0000 7f2e15626640 1 -- 172.21.15.77:0/2273342155 shutdown_connections 2023-11-04T01:41:41.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.677+0000 7f2e15626640 1 -- 172.21.15.77:0/2273342155 wait complete. 2023-11-04T01:41:41.691 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-04T01:41:41.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.791+0000 7f7e8ea7c640 1 Processor -- start 2023-11-04T01:41:41.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.791+0000 7f7e8ea7c640 1 -- start start 2023-11-04T01:41:41.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.792+0000 7f7e8ea7c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7e880cd6d0 0x7f7e88161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.792+0000 7f7e8ea7c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e880cde60 con 0x7f7e880b4880 2023-11-04T01:41:41.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.792+0000 7f7e8ea7c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e88160f90 con 0x7f7e88153e60 2023-11-04T01:41:41.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.792+0000 7f7e8ea7c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e88161960 con 0x7f7e880cd6d0 2023-11-04T01:41:41.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.792+0000 7f7e87fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7e880cd6d0 0x7f7e88161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.792+0000 7f7e8d019640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f7e880b4880 0x7f7e880d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:50736/0 (socket says 172.21.15.77:50736) 2023-11-04T01:41:41.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.792+0000 7f7e8d019640 1 -- 172.21.15.77:0/1344395897 learned_addr learned my addr 172.21.15.77:0/1344395897 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:41.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.792+0000 7f7e87fff640 1 -- 172.21.15.77:0/1344395897 >> v1:172.21.15.122:6789/0 conn(0x7f7e88153e60 legacy=0x7f7e8815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:41.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.792+0000 7f7e87fff640 1 -- 172.21.15.77:0/1344395897 >> v1:172.21.15.77:6789/0 conn(0x7f7e880b4880 legacy=0x7f7e880d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.792+0000 7f7e87fff640 1 -- 172.21.15.77:0/1344395897 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e880ce090 con 0x7f7e880cd6d0 2023-11-04T01:41:41.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.793+0000 7f7e87fff640 1 --2- 172.21.15.77:0/1344395897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e880cd6d0 0x7f7e88161420 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f7e740097a0 tx=0x7f7e7402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a125043b85e05e2f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:41.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.793+0000 7f7e877fe640 1 -- 172.21.15.77:0/1344395897 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e74031830 con 0x7f7e880cd6d0 2023-11-04T01:41:41.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.793+0000 7f7e877fe640 1 -- 172.21.15.77:0/1344395897 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e74031990 con 0x7f7e880cd6d0 2023-11-04T01:41:41.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.793+0000 7f7e877fe640 1 -- 172.21.15.77:0/1344395897 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e74031d20 con 0x7f7e880cd6d0 2023-11-04T01:41:41.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.794+0000 7f7e8ea7c640 1 -- 172.21.15.77:0/1344395897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e880cd6d0 msgr2=0x7f7e88161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.794+0000 7f7e8ea7c640 1 --2- 172.21.15.77:0/1344395897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e880cd6d0 0x7f7e88161420 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f7e740097a0 tx=0x7f7e7402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.794+0000 7f7e8ea7c640 1 -- 172.21.15.77:0/1344395897 shutdown_connections 2023-11-04T01:41:41.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.794+0000 7f7e8ea7c640 1 --2- 172.21.15.77:0/1344395897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e880cd6d0 0x7f7e88161420 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.794+0000 7f7e8ea7c640 1 -- 172.21.15.77:0/1344395897 >> 172.21.15.77:0/1344395897 conn(0x7f7e880cf880 msgr2=0x7f7e880cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:41.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.794+0000 7f7e8ea7c640 1 -- 172.21.15.77:0/1344395897 shutdown_connections 2023-11-04T01:41:41.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.794+0000 7f7e8ea7c640 1 -- 172.21.15.77:0/1344395897 wait complete. 2023-11-04T01:41:41.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.795+0000 7f7e8ea7c640 1 Processor -- start 2023-11-04T01:41:41.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.795+0000 7f7e8ea7c640 1 -- start start 2023-11-04T01:41:41.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.796+0000 7f7e8ea7c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7e880b4880 0x7f7e88150500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.796+0000 7f7e8ea7c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e880cd6d0 0x7f7e88154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.796+0000 7f7e8ea7c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e88153e60 0x7f7e880b76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.796+0000 7f7e8ea7c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8815ef10 con 0x7f7e88153e60 2023-11-04T01:41:41.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.796+0000 7f7e8ea7c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8815fd70 con 0x7f7e880cd6d0 2023-11-04T01:41:41.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.796+0000 7f7e8ea7c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8815f160 con 0x7f7e880b4880 2023-11-04T01:41:41.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.796+0000 7f7e8d019640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e88153e60 0x7f7e880b76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.796+0000 7f7e8d019640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e88153e60 0x7f7e880b76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45516/0 (socket says 172.21.15.77:45516) 2023-11-04T01:41:41.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.796+0000 7f7e8d019640 1 -- 172.21.15.77:0/2335380991 learned_addr learned my addr 172.21.15.77:0/2335380991 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:41.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.796+0000 7f7e87fff640 1 --2- 172.21.15.77:0/2335380991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e880cd6d0 0x7f7e88154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.796+0000 7f7e8c818640 1 --2- 172.21.15.77:0/2335380991 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7e880b4880 0x7f7e88150500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.796+0000 7f7e8d019640 1 -- 172.21.15.77:0/2335380991 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7e880b4880 msgr2=0x7f7e88150500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.796+0000 7f7e8d019640 1 --2- 172.21.15.77:0/2335380991 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7e880b4880 0x7f7e88150500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.796+0000 7f7e8d019640 1 -- 172.21.15.77:0/2335380991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e880cd6d0 msgr2=0x7f7e88154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:41.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.796+0000 7f7e8d019640 1 --2- 172.21.15.77:0/2335380991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e880cd6d0 0x7f7e88154570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:41.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.796+0000 7f7e8d019640 1 -- 172.21.15.77:0/2335380991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e74009400 con 0x7f7e88153e60 2023-11-04T01:41:41.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.796+0000 7f7e87fff640 1 --2- 172.21.15.77:0/2335380991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e880cd6d0 0x7f7e88154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:41.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.796+0000 7f7e8c818640 1 --2- 172.21.15.77:0/2335380991 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7e880b4880 0x7f7e88150500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:41.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.796+0000 7f7e8d019640 1 --2- 172.21.15.77:0/2335380991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e88153e60 0x7f7e880b76f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f7e8000cbc0 tx=0x7f7e8000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:41.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.796+0000 7f7e857fa640 1 -- 172.21.15.77:0/2335380991 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8000ad40 con 0x7f7e88153e60 2023-11-04T01:41:41.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.796+0000 7f7e857fa640 1 -- 172.21.15.77:0/2335380991 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e80012400 con 0x7f7e88153e60 2023-11-04T01:41:41.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.796+0000 7f7e8ea7c640 1 -- 172.21.15.77:0/2335380991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e8815f440 con 0x7f7e88153e60 2023-11-04T01:41:41.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.796+0000 7f7e857fa640 1 -- 172.21.15.77:0/2335380991 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8000aea0 con 0x7f7e88153e60 2023-11-04T01:41:41.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.796+0000 7f7e8ea7c640 1 -- 172.21.15.77:0/2335380991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e8815fa00 con 0x7f7e88153e60 2023-11-04T01:41:41.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.797+0000 7f7e8ea7c640 1 -- 172.21.15.77:0/2335380991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e88156060 con 0x7f7e88153e60 2023-11-04T01:41:41.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.798+0000 7f7e857fa640 1 -- 172.21.15.77:0/2335380991 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7e80007070 con 0x7f7e88153e60 2023-11-04T01:41:41.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.798+0000 7f7e857fa640 1 --2- 172.21.15.77:0/2335380991 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7e6c06aea0 0x7f7e6c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:41.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.798+0000 7f7e857fa640 1 -- 172.21.15.77:0/2335380991 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f7e800896f0 con 0x7f7e88153e60 2023-11-04T01:41:41.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.798+0000 7f7e8c818640 1 --2- 172.21.15.77:0/2335380991 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7e6c06aea0 0x7f7e6c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:41.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.799+0000 7f7e8c818640 1 --2- 172.21.15.77:0/2335380991 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7e6c06aea0 0x7f7e6c06d360 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7e8815bdb0 tx=0x7f7e7c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:41.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:41.802+0000 7f7e857fa640 1 -- 172.21.15.77:0/2335380991 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7e80054590 con 0x7f7e88153e60 2023-11-04T01:41:42.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.003+0000 7f7e8ea7c640 1 -- 172.21.15.77:0/2335380991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7e88074290 con 0x7f7e88153e60 2023-11-04T01:41:42.006 INFO:tasks.ceph.mon.a.smithi077.stderr:2023-11-04T01:41:42.003+0000 7f1217737640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-04T01:41:42.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.005+0000 7f7e857fa640 1 -- 172.21.15.77:0/2335380991 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7e80057bb0 con 0x7f7e88153e60 2023-11-04T01:41:42.007 INFO:teuthology.orchestra.run.smithi077.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-04T01:41:42.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.007+0000 7f7e8ea7c640 1 -- 172.21.15.77:0/2335380991 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7e6c06aea0 msgr2=0x7f7e6c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.007+0000 7f7e8ea7c640 1 --2- 172.21.15.77:0/2335380991 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7e6c06aea0 0x7f7e6c06d360 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7e8815bdb0 tx=0x7f7e7c008040 comp rx=0 tx=0).stop 2023-11-04T01:41:42.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.007+0000 7f7e8ea7c640 1 -- 172.21.15.77:0/2335380991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e88153e60 msgr2=0x7f7e880b76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.007+0000 7f7e8ea7c640 1 --2- 172.21.15.77:0/2335380991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e88153e60 0x7f7e880b76f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f7e8000cbc0 tx=0x7f7e8000a430 comp rx=0 tx=0).stop 2023-11-04T01:41:42.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.007+0000 7f7e8ea7c640 1 -- 172.21.15.77:0/2335380991 shutdown_connections 2023-11-04T01:41:42.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.007+0000 7f7e8ea7c640 1 --2- 172.21.15.77:0/2335380991 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7e6c06aea0 0x7f7e6c06d360 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.007+0000 7f7e8ea7c640 1 --2- 172.21.15.77:0/2335380991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e88153e60 0x7f7e880b76f0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.007+0000 7f7e8ea7c640 1 --2- 172.21.15.77:0/2335380991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e880cd6d0 0x7f7e88154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.007+0000 7f7e8ea7c640 1 --2- 172.21.15.77:0/2335380991 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7e880b4880 0x7f7e88150500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.007+0000 7f7e8ea7c640 1 -- 172.21.15.77:0/2335380991 >> 172.21.15.77:0/2335380991 conn(0x7f7e880cf880 msgr2=0x7f7e880b4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:42.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.007+0000 7f7e8ea7c640 1 -- 172.21.15.77:0/2335380991 shutdown_connections 2023-11-04T01:41:42.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.007+0000 7f7e8ea7c640 1 -- 172.21.15.77:0/2335380991 wait complete. 2023-11-04T01:41:42.013 INFO:tasks.ceph.mds.d.smithi122.stderr: -1864> 2023-11-04T01:41:18.178+0000 7f9f37d46640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-11-04T01:41:42.013 INFO:tasks.ceph.mds.d.smithi122.stderr: -665> 2023-11-04T01:41:30.043+0000 7f9f31d3a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:41:42.022 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-04T01:41:42.039 INFO:tasks.ceph.mds.d.smithi122.stdout:starting mds.d at 2023-11-04T01:41:42.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.121+0000 7f22387f5640 1 Processor -- start 2023-11-04T01:41:42.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.121+0000 7f22387f5640 1 -- start start 2023-11-04T01:41:42.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.122+0000 7f22387f5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f22301605b0 0x7f22300ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.122+0000 7f22387f5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f223006a830 0x7f22300cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.122+0000 7f22387f5640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2230160990 con 0x7f22300b1a40 2023-11-04T01:41:42.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.122+0000 7f22387f5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22300cc7c0 con 0x7f22301605b0 2023-11-04T01:41:42.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.122+0000 7f22387f5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22300cd750 con 0x7f223006a830 2023-11-04T01:41:42.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.122+0000 7f2236591640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f22301605b0 0x7f22300ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.122+0000 7f2236591640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f22301605b0 0x7f22300ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45520/0 (socket says 172.21.15.77:45520) 2023-11-04T01:41:42.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.122+0000 7f2236591640 1 -- 172.21.15.77:0/2498026737 learned_addr learned my addr 172.21.15.77:0/2498026737 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:42.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.122+0000 7f2236d92640 1 --2- 172.21.15.77:0/2498026737 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f223006a830 0x7f22300cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.123+0000 7f2236591640 1 -- 172.21.15.77:0/2498026737 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f223006a830 msgr2=0x7f22300cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:42.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.123+0000 7f2236591640 1 --2- 172.21.15.77:0/2498026737 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f223006a830 0x7f22300cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.123+0000 7f2236591640 1 -- 172.21.15.77:0/2498026737 >> v1:172.21.15.122:6789/0 conn(0x7f22300b1a40 legacy=0x7f223006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:42.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.123+0000 7f2236591640 1 -- 172.21.15.77:0/2498026737 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22300cc4e0 con 0x7f22301605b0 2023-11-04T01:41:42.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.123+0000 7f2236d92640 1 --2- 172.21.15.77:0/2498026737 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f223006a830 0x7f22300cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:42.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.123+0000 7f2236591640 1 --2- 172.21.15.77:0/2498026737 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22301605b0 0x7f22300ccbc0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f222c009870 tx=0x7f222c02b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec0d83f326714182 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:42.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.123+0000 7f223558f640 1 -- 172.21.15.77:0/2498026737 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c031740 con 0x7f22301605b0 2023-11-04T01:41:42.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.123+0000 7f223558f640 1 -- 172.21.15.77:0/2498026737 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222c0318a0 con 0x7f22301605b0 2023-11-04T01:41:42.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.123+0000 7f223558f640 1 -- 172.21.15.77:0/2498026737 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c031c30 con 0x7f22301605b0 2023-11-04T01:41:42.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.124+0000 7f22387f5640 1 -- 172.21.15.77:0/2498026737 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22301605b0 msgr2=0x7f22300ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.124+0000 7f22387f5640 1 --2- 172.21.15.77:0/2498026737 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22301605b0 0x7f22300ccbc0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f222c009870 tx=0x7f222c02b7e0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.124+0000 7f22387f5640 1 -- 172.21.15.77:0/2498026737 shutdown_connections 2023-11-04T01:41:42.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.124+0000 7f22387f5640 1 --2- 172.21.15.77:0/2498026737 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f223006a830 0x7f22300cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.124+0000 7f22387f5640 1 --2- 172.21.15.77:0/2498026737 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22301605b0 0x7f22300ccbc0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.124+0000 7f22387f5640 1 -- 172.21.15.77:0/2498026737 >> 172.21.15.77:0/2498026737 conn(0x7f2230071820 msgr2=0x7f2230071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:42.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.124+0000 7f22387f5640 1 -- 172.21.15.77:0/2498026737 shutdown_connections 2023-11-04T01:41:42.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.124+0000 7f22387f5640 1 -- 172.21.15.77:0/2498026737 wait complete. 2023-11-04T01:41:42.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.125+0000 7f22387f5640 1 Processor -- start 2023-11-04T01:41:42.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.125+0000 7f22387f5640 1 -- start start 2023-11-04T01:41:42.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.126+0000 7f22387f5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f223006a830 0x7f22300b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.126+0000 7f22387f5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f22301605b0 0x7f223015b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.126+0000 7f22387f5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f223015b580 0x7f22300abdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.126+0000 7f22387f5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22300b5830 con 0x7f223015b580 2023-11-04T01:41:42.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.126+0000 7f22387f5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22300b5020 con 0x7f223006a830 2023-11-04T01:41:42.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.126+0000 7f22387f5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22300b5270 con 0x7f22301605b0 2023-11-04T01:41:42.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.126+0000 7f2236d92640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f223015b580 0x7f22300abdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.126+0000 7f2236d92640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f223015b580 0x7f22300abdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45524/0 (socket says 172.21.15.77:45524) 2023-11-04T01:41:42.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.126+0000 7f2236d92640 1 -- 172.21.15.77:0/4190775448 learned_addr learned my addr 172.21.15.77:0/4190775448 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:42.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.126+0000 7f2236591640 1 --2- 172.21.15.77:0/4190775448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f223006a830 0x7f22300b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.126+0000 7f2235d90640 1 --2- 172.21.15.77:0/4190775448 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f22301605b0 0x7f223015b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.126+0000 7f2236d92640 1 -- 172.21.15.77:0/4190775448 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f22301605b0 msgr2=0x7f223015b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.126+0000 7f2236d92640 1 --2- 172.21.15.77:0/4190775448 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f22301605b0 0x7f223015b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.126+0000 7f2236d92640 1 -- 172.21.15.77:0/4190775448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f223006a830 msgr2=0x7f22300b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:42.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.126+0000 7f2236d92640 1 --2- 172.21.15.77:0/4190775448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f223006a830 0x7f22300b3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:42.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.126+0000 7f2236d92640 1 -- 172.21.15.77:0/4190775448 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f222c0094d0 con 0x7f223015b580 2023-11-04T01:41:42.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.126+0000 7f2236591640 1 --2- 172.21.15.77:0/4190775448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f223006a830 0x7f22300b3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:42.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.127+0000 7f2236d92640 1 --2- 172.21.15.77:0/4190775448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f223015b580 0x7f22300abdb0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f222800cd80 tx=0x7f222800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:42.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.127+0000 7f2226ffd640 1 -- 172.21.15.77:0/4190775448 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222800f680 con 0x7f223015b580 2023-11-04T01:41:42.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.127+0000 7f2226ffd640 1 -- 172.21.15.77:0/4190775448 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222800f800 con 0x7f223015b580 2023-11-04T01:41:42.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.127+0000 7f2226ffd640 1 -- 172.21.15.77:0/4190775448 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222800fbb0 con 0x7f223015b580 2023-11-04T01:41:42.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.127+0000 7f22387f5640 1 -- 172.21.15.77:0/4190775448 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22300b5550 con 0x7f223015b580 2023-11-04T01:41:42.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.127+0000 7f22387f5640 1 -- 172.21.15.77:0/4190775448 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22300b3500 con 0x7f223015b580 2023-11-04T01:41:42.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.128+0000 7f22387f5640 1 -- 172.21.15.77:0/4190775448 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22300672a0 con 0x7f223015b580 2023-11-04T01:41:42.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.128+0000 7f2226ffd640 1 -- 172.21.15.77:0/4190775448 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f222800b040 con 0x7f223015b580 2023-11-04T01:41:42.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.128+0000 7f2226ffd640 1 --2- 172.21.15.77:0/4190775448 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f221406ae70 0x7f221406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:42.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.129+0000 7f2226ffd640 1 -- 172.21.15.77:0/4190775448 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f222808a290 con 0x7f223015b580 2023-11-04T01:41:42.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.129+0000 7f2236591640 1 --2- 172.21.15.77:0/4190775448 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f221406ae70 0x7f221406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:42.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.130+0000 7f2236591640 1 --2- 172.21.15.77:0/4190775448 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f221406ae70 0x7f221406d330 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f222c035000 tx=0x7f222c008030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:42.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.133+0000 7f2226ffd640 1 -- 172.21.15.77:0/4190775448 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f22280550f0 con 0x7f223015b580 2023-11-04T01:41:42.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:42.335+0000 7f22387f5640 1 -- 172.21.15.77:0/4190775448 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f22300b3080 con 0x7f223015b580 2023-11-04T01:41:43.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.009+0000 7f2226ffd640 1 -- 172.21.15.77:0/4190775448 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7f22300b3080 con 0x7f223015b580 2023-11-04T01:41:43.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.010+0000 7f22387f5640 1 -- 172.21.15.77:0/4190775448 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f221406ae70 msgr2=0x7f221406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.010+0000 7f22387f5640 1 --2- 172.21.15.77:0/4190775448 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f221406ae70 0x7f221406d330 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f222c035000 tx=0x7f222c008030 comp rx=0 tx=0).stop 2023-11-04T01:41:43.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.010+0000 7f22387f5640 1 -- 172.21.15.77:0/4190775448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f223015b580 msgr2=0x7f22300abdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.010+0000 7f22387f5640 1 --2- 172.21.15.77:0/4190775448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f223015b580 0x7f22300abdb0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f222800cd80 tx=0x7f222800a650 comp rx=0 tx=0).stop 2023-11-04T01:41:43.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.010+0000 7f22387f5640 1 -- 172.21.15.77:0/4190775448 shutdown_connections 2023-11-04T01:41:43.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.010+0000 7f22387f5640 1 --2- 172.21.15.77:0/4190775448 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f221406ae70 0x7f221406d330 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.010+0000 7f22387f5640 1 --2- 172.21.15.77:0/4190775448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f223015b580 0x7f22300abdb0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.010+0000 7f22387f5640 1 --2- 172.21.15.77:0/4190775448 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f22301605b0 0x7f223015b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.010+0000 7f22387f5640 1 --2- 172.21.15.77:0/4190775448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f223006a830 0x7f22300b3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.010+0000 7f22387f5640 1 -- 172.21.15.77:0/4190775448 >> 172.21.15.77:0/4190775448 conn(0x7f2230071820 msgr2=0x7f22300b0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:43.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.010+0000 7f22387f5640 1 -- 172.21.15.77:0/4190775448 shutdown_connections 2023-11-04T01:41:43.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.010+0000 7f22387f5640 1 -- 172.21.15.77:0/4190775448 wait complete. 2023-11-04T01:41:43.024 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-04T01:41:43.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.126+0000 7fc9c236e640 1 Processor -- start 2023-11-04T01:41:43.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.126+0000 7fc9c236e640 1 -- start start 2023-11-04T01:41:43.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.128+0000 7fc9c236e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc9bc06dd50 0x7fc9bc165bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:43.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.128+0000 7fc9c236e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9bc15c0d0 con 0x7fc9bc151ea0 2023-11-04T01:41:43.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.128+0000 7fc9c236e640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9bc06cf90 con 0x7fc9bc15f510 2023-11-04T01:41:43.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.128+0000 7fc9c236e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc06d270 con 0x7fc9bc06dd50 2023-11-04T01:41:43.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.128+0000 7fc9bbfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc9bc151ea0 0x7fc9bc15b9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:50742/0 (socket says 172.21.15.77:50742) 2023-11-04T01:41:43.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.128+0000 7fc9bbfff640 1 -- 172.21.15.77:0/1311865627 learned_addr learned my addr 172.21.15.77:0/1311865627 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:43.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.128+0000 7fc9baffd640 1 -- 172.21.15.77:0/1311865627 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 850435852 0 0) 0x7fc9bc15c0d0 con 0x7fc9bc151ea0 2023-11-04T01:41:43.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.128+0000 7fc9c090b640 1 --2- 172.21.15.77:0/1311865627 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc9bc06dd50 0x7fc9bc165bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:43.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.128+0000 7fc9baffd640 1 -- 172.21.15.77:0/1311865627 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9a4003520 con 0x7fc9bc151ea0 2023-11-04T01:41:43.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.129+0000 7fc9baffd640 1 -- 172.21.15.77:0/1311865627 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3761124968 0 0) 0x7fc9a4003520 con 0x7fc9bc151ea0 2023-11-04T01:41:43.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.129+0000 7fc9baffd640 1 -- 172.21.15.77:0/1311865627 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc9bc06dd50 msgr2=0x7fc9bc165bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:43.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.129+0000 7fc9baffd640 1 --2- 172.21.15.77:0/1311865627 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc9bc06dd50 0x7fc9bc165bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.129+0000 7fc9baffd640 1 -- 172.21.15.77:0/1311865627 >> v1:172.21.15.122:6789/0 conn(0x7fc9bc15f510 legacy=0x7fc9bc0cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.129+0000 7fc9baffd640 1 -- 172.21.15.77:0/1311865627 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9bc06d550 con 0x7fc9bc151ea0 2023-11-04T01:41:43.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.129+0000 7fc9baffd640 1 -- 172.21.15.77:0/1311865627 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7fc9ac001670 con 0x7fc9bc151ea0 2023-11-04T01:41:43.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.129+0000 7fc9baffd640 1 -- 172.21.15.77:0/1311865627 >> v1:172.21.15.77:6789/0 conn(0x7fc9bc151ea0 legacy=0x7fc9bc15b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.129+0000 7fc9baffd640 1 --2- 172.21.15.77:0/1311865627 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9a40039a0 0x7fc9a4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:43.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.129+0000 7fc9baffd640 1 --2- 172.21.15.77:0/1311865627 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9a40047c0 0x7fc9a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:43.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.129+0000 7fc9baffd640 1 --2- 172.21.15.77:0/1311865627 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc9bc06dd50 0x7fc9a4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:43.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.129+0000 7fc9baffd640 1 -- 172.21.15.77:0/1311865627 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc06d270 con 0x7fc9a40039a0 2023-11-04T01:41:43.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.129+0000 7fc9baffd640 1 -- 172.21.15.77:0/1311865627 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a400ba60 con 0x7fc9a40047c0 2023-11-04T01:41:43.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.129+0000 7fc9baffd640 1 -- 172.21.15.77:0/1311865627 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a400bc20 con 0x7fc9bc06dd50 2023-11-04T01:41:43.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.129+0000 7fc9bbfff640 1 --2- 172.21.15.77:0/1311865627 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9a40039a0 0x7fc9a4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:43.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.129+0000 7fc9c090b640 1 --2- 172.21.15.77:0/1311865627 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc9bc06dd50 0x7fc9a4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:43.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.129+0000 7fc9bb7fe640 1 --2- 172.21.15.77:0/1311865627 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9a40047c0 0x7fc9a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:43.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.129+0000 7fc9bbfff640 1 -- 172.21.15.77:0/1311865627 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc9bc06dd50 msgr2=0x7fc9a4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:43.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.129+0000 7fc9bbfff640 1 --2- 172.21.15.77:0/1311865627 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc9bc06dd50 0x7fc9a4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.129+0000 7fc9bbfff640 1 -- 172.21.15.77:0/1311865627 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9a40047c0 msgr2=0x7fc9a4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:43.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.129+0000 7fc9bbfff640 1 --2- 172.21.15.77:0/1311865627 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9a40047c0 0x7fc9a4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.129+0000 7fc9bbfff640 1 -- 172.21.15.77:0/1311865627 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a4003520 con 0x7fc9a40039a0 2023-11-04T01:41:43.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.129+0000 7fc9bb7fe640 1 --2- 172.21.15.77:0/1311865627 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9a40047c0 0x7fc9a4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:43.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.130+0000 7fc9bbfff640 1 --2- 172.21.15.77:0/1311865627 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9a40039a0 0x7fc9a4003dc0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac00c210 tx=0x7fc9a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ebc06f119e8fe15 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:43.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.130+0000 7fc9baffd640 1 -- 172.21.15.77:0/1311865627 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac005ad0 con 0x7fc9a40039a0 2023-11-04T01:41:43.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.130+0000 7fc9baffd640 1 -- 172.21.15.77:0/1311865627 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ac005c30 con 0x7fc9a40039a0 2023-11-04T01:41:43.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.130+0000 7fc9baffd640 1 -- 172.21.15.77:0/1311865627 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac02c870 con 0x7fc9a40039a0 2023-11-04T01:41:43.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.131+0000 7fc9c236e640 1 -- 172.21.15.77:0/1311865627 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9a40039a0 msgr2=0x7fc9a4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.131+0000 7fc9c236e640 1 --2- 172.21.15.77:0/1311865627 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9a40039a0 0x7fc9a4003dc0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac00c210 tx=0x7fc9a40057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.131+0000 7fc9c090b640 1 -- 172.21.15.77:0/1311865627 reap_dead start 2023-11-04T01:41:43.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.131+0000 7fc9c236e640 1 -- 172.21.15.77:0/1311865627 shutdown_connections 2023-11-04T01:41:43.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.131+0000 7fc9c236e640 1 -- 172.21.15.77:0/1311865627 >> 172.21.15.77:0/1311865627 conn(0x7fc9bc0b05d0 msgr2=0x7fc9bc0b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:43.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.131+0000 7fc9c236e640 1 -- 172.21.15.77:0/1311865627 shutdown_connections 2023-11-04T01:41:43.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.131+0000 7fc9c236e640 1 -- 172.21.15.77:0/1311865627 wait complete. 2023-11-04T01:41:43.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.132+0000 7fc9c236e640 1 Processor -- start 2023-11-04T01:41:43.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.132+0000 7fc9c236e640 1 -- start start 2023-11-04T01:41:43.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.133+0000 7fc9c236e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9a40039a0 0x7fc9bc1422d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:43.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.133+0000 7fc9c236e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc9bc0b27c0 0x7fc9bc0ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:43.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.133+0000 7fc9c236e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9bc0cee10 0x7fc9bc0c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:43.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.133+0000 7fc9c236e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc0cf290 con 0x7fc9a40039a0 2023-11-04T01:41:43.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.133+0000 7fc9c236e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc0b1720 con 0x7fc9bc0cee10 2023-11-04T01:41:43.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.133+0000 7fc9c236e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc0b1a00 con 0x7fc9bc0b27c0 2023-11-04T01:41:43.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.133+0000 7fc9bbfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9a40039a0 0x7fc9bc1422d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:43.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.133+0000 7fc9bbfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9a40039a0 0x7fc9bc1422d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45540/0 (socket says 172.21.15.77:45540) 2023-11-04T01:41:43.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.133+0000 7fc9bbfff640 1 -- 172.21.15.77:0/1623862305 learned_addr learned my addr 172.21.15.77:0/1623862305 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:43.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.133+0000 7fc9c090b640 1 --2- 172.21.15.77:0/1623862305 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9bc0cee10 0x7fc9bc0c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:43.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.133+0000 7fc9bb7fe640 1 --2- 172.21.15.77:0/1623862305 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc9bc0b27c0 0x7fc9bc0ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:43.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.133+0000 7fc9bbfff640 1 -- 172.21.15.77:0/1623862305 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc9bc0b27c0 msgr2=0x7fc9bc0ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.133+0000 7fc9bbfff640 1 --2- 172.21.15.77:0/1623862305 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc9bc0b27c0 0x7fc9bc0ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.133+0000 7fc9bbfff640 1 -- 172.21.15.77:0/1623862305 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9bc0cee10 msgr2=0x7fc9bc0c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:43.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.133+0000 7fc9bbfff640 1 --2- 172.21.15.77:0/1623862305 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9bc0cee10 0x7fc9bc0c7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:43.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.133+0000 7fc9bbfff640 1 -- 172.21.15.77:0/1623862305 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9bc0b1ce0 con 0x7fc9a40039a0 2023-11-04T01:41:43.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.133+0000 7fc9bbfff640 1 --2- 172.21.15.77:0/1623862305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9a40039a0 0x7fc9bc1422d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac00c210 tx=0x7fc9ac001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:43.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.133+0000 7fc9b8ff9640 1 -- 172.21.15.77:0/1623862305 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac03c040 con 0x7fc9a40039a0 2023-11-04T01:41:43.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.133+0000 7fc9b8ff9640 1 -- 172.21.15.77:0/1623862305 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ac02cc80 con 0x7fc9a40039a0 2023-11-04T01:41:43.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.133+0000 7fc9c236e640 1 -- 172.21.15.77:0/1623862305 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9bc0b1fc0 con 0x7fc9a40039a0 2023-11-04T01:41:43.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.133+0000 7fc9b8ff9640 1 -- 172.21.15.77:0/1623862305 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac007070 con 0x7fc9a40039a0 2023-11-04T01:41:43.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.133+0000 7fc9c236e640 1 -- 172.21.15.77:0/1623862305 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9bc142810 con 0x7fc9a40039a0 2023-11-04T01:41:43.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.134+0000 7fc9c236e640 1 -- 172.21.15.77:0/1623862305 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9bc15d2f0 con 0x7fc9a40039a0 2023-11-04T01:41:43.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.135+0000 7fc9b8ff9640 1 -- 172.21.15.77:0/1623862305 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc9ac032070 con 0x7fc9a40039a0 2023-11-04T01:41:43.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.135+0000 7fc9b8ff9640 1 --2- 172.21.15.77:0/1623862305 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc9a806aea0 0x7fc9a806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:43.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.135+0000 7fc9b8ff9640 1 -- 172.21.15.77:0/1623862305 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6468+0+0 (secure 0 0 0) 0x7fc9ac0aacd0 con 0x7fc9a40039a0 2023-11-04T01:41:43.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.135+0000 7fc9bb7fe640 1 --2- 172.21.15.77:0/1623862305 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc9a806aea0 0x7fc9a806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:43.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.136+0000 7fc9bb7fe640 1 --2- 172.21.15.77:0/1623862305 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc9a806aea0 0x7fc9a806d360 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0cb510 tx=0x7fc9b0009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:43.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.139+0000 7fc9b8ff9640 1 -- 172.21.15.77:0/1623862305 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc9ac075a80 con 0x7fc9a40039a0 2023-11-04T01:41:43.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:43.306+0000 7fc9c236e640 1 -- 172.21.15.77:0/1623862305 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc9bc15adf0 con 0x7fc9a40039a0 2023-11-04T01:41:44.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.013+0000 7fc9b8ff9640 1 -- 172.21.15.77:0/1623862305 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v44) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc9ac046020 con 0x7fc9a40039a0 2023-11-04T01:41:44.015 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_metadata' removed 2023-11-04T01:41:44.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.016+0000 7fc9c236e640 1 -- 172.21.15.77:0/1623862305 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc9a806aea0 msgr2=0x7fc9a806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:44.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.016+0000 7fc9c236e640 1 --2- 172.21.15.77:0/1623862305 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc9a806aea0 0x7fc9a806d360 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0cb510 tx=0x7fc9b0009040 comp rx=0 tx=0).stop 2023-11-04T01:41:44.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.016+0000 7fc9c236e640 1 -- 172.21.15.77:0/1623862305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9a40039a0 msgr2=0x7fc9bc1422d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:44.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.016+0000 7fc9c236e640 1 --2- 172.21.15.77:0/1623862305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9a40039a0 0x7fc9bc1422d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac00c210 tx=0x7fc9ac001a00 comp rx=0 tx=0).stop 2023-11-04T01:41:44.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.016+0000 7fc9c236e640 1 -- 172.21.15.77:0/1623862305 shutdown_connections 2023-11-04T01:41:44.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.016+0000 7fc9c236e640 1 --2- 172.21.15.77:0/1623862305 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc9a806aea0 0x7fc9a806d360 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.016+0000 7fc9c236e640 1 --2- 172.21.15.77:0/1623862305 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9bc0cee10 0x7fc9bc0c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.016+0000 7fc9c236e640 1 --2- 172.21.15.77:0/1623862305 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc9bc0b27c0 0x7fc9bc0ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.016+0000 7fc9c236e640 1 --2- 172.21.15.77:0/1623862305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9a40039a0 0x7fc9bc1422d0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.016+0000 7fc9c236e640 1 -- 172.21.15.77:0/1623862305 >> 172.21.15.77:0/1623862305 conn(0x7fc9bc0b05d0 msgr2=0x7fc9bc0cd260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:44.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.016+0000 7fc9c236e640 1 -- 172.21.15.77:0/1623862305 shutdown_connections 2023-11-04T01:41:44.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.017+0000 7fc9c236e640 1 -- 172.21.15.77:0/1623862305 wait complete. 2023-11-04T01:41:44.031 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-04T01:41:44.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.134+0000 7fedb8973640 1 Processor -- start 2023-11-04T01:41:44.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.134+0000 7fedb8973640 1 -- start start 2023-11-04T01:41:44.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.135+0000 7fedb8973640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fedb40c4f90 0x7fedb415d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:44.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.135+0000 7fedb8973640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fedb40caf80 0x7fedb415d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:44.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.135+0000 7fedb8973640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fedb40c5370 0x7fedb40c3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:44.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.135+0000 7fedb8973640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb415de50 con 0x7fedb40caf80 2023-11-04T01:41:44.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.135+0000 7fedb8973640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb415db80 con 0x7fedb40c4f90 2023-11-04T01:41:44.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.135+0000 7fedb8973640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb40ca1c0 con 0x7fedb40c5370 2023-11-04T01:41:44.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.135+0000 7feda9d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fedb40caf80 0x7fedb415d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:44.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.135+0000 7feda9d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fedb40caf80 0x7fedb415d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45554/0 (socket says 172.21.15.77:45554) 2023-11-04T01:41:44.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.135+0000 7feda9d9b640 1 -- 172.21.15.77:0/1964375133 learned_addr learned my addr 172.21.15.77:0/1964375133 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:44.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.135+0000 7feda9d9b640 1 -- 172.21.15.77:0/1964375133 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fedb40c5370 msgr2=0x7fedb40c3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:44.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.135+0000 7feda9d9b640 1 --2- 172.21.15.77:0/1964375133 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fedb40c5370 0x7fedb40c3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.135+0000 7feda9d9b640 1 -- 172.21.15.77:0/1964375133 >> v2:172.21.15.122:3300/0 conn(0x7fedb40c4f90 msgr2=0x7fedb415d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:44.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.135+0000 7feda9d9b640 1 --2- 172.21.15.77:0/1964375133 >> v2:172.21.15.122:3300/0 conn(0x7fedb40c4f90 0x7fedb415d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.135+0000 7feda9d9b640 1 -- 172.21.15.77:0/1964375133 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb40ca4a0 con 0x7fedb40caf80 2023-11-04T01:41:44.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.136+0000 7feda9d9b640 1 --2- 172.21.15.77:0/1964375133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb40caf80 0x7fedb415d640 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fedb40cc200 tx=0x7fed9c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a366c1c0d0f4949 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:44.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.136+0000 7fedb1d9b640 1 -- 172.21.15.77:0/1964375133 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c0317e0 con 0x7fedb40caf80 2023-11-04T01:41:44.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.136+0000 7fedb1d9b640 1 -- 172.21.15.77:0/1964375133 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9c031940 con 0x7fedb40caf80 2023-11-04T01:41:44.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.136+0000 7fedb1d9b640 1 -- 172.21.15.77:0/1964375133 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c031cd0 con 0x7fedb40caf80 2023-11-04T01:41:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.136+0000 7fedb8973640 1 -- 172.21.15.77:0/1964375133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb40caf80 msgr2=0x7fedb415d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.136+0000 7fedb8973640 1 --2- 172.21.15.77:0/1964375133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb40caf80 0x7fedb415d640 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fedb40cc200 tx=0x7fed9c02b880 comp rx=0 tx=0).stop 2023-11-04T01:41:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.136+0000 7fedb8973640 1 -- 172.21.15.77:0/1964375133 shutdown_connections 2023-11-04T01:41:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.136+0000 7fedb8973640 1 --2- 172.21.15.77:0/1964375133 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fedb40c5370 0x7fedb40c3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.136+0000 7fedb8973640 1 --2- 172.21.15.77:0/1964375133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb40caf80 0x7fedb415d640 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.136+0000 7fedb8973640 1 --2- 172.21.15.77:0/1964375133 >> v2:172.21.15.122:3300/0 conn(0x7fedb40c4f90 0x7fedb415d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.136+0000 7fedb8973640 1 -- 172.21.15.77:0/1964375133 >> 172.21.15.77:0/1964375133 conn(0x7fedb40b05d0 msgr2=0x7fedb40b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:44.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.136+0000 7fedb8973640 1 -- 172.21.15.77:0/1964375133 shutdown_connections 2023-11-04T01:41:44.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.136+0000 7fedb8973640 1 -- 172.21.15.77:0/1964375133 wait complete. 2023-11-04T01:41:44.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.138+0000 7fedb8973640 1 Processor -- start 2023-11-04T01:41:44.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.138+0000 7fedb8973640 1 -- start start 2023-11-04T01:41:44.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.138+0000 7fedb8973640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fedb40c4f90 0x7fedb41f2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:44.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.138+0000 7fedb8973640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fedb40c5370 0x7fedb40acce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:44.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.138+0000 7fedb8973640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb40caf80 0x7fedb40ae420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:44.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.138+0000 7fedb8973640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb40abc40 con 0x7fedb40caf80 2023-11-04T01:41:44.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.139+0000 7fedb8973640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb40abf20 con 0x7fedb40c5370 2023-11-04T01:41:44.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.139+0000 7fedb8973640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb40ac200 con 0x7fedb40c4f90 2023-11-04T01:41:44.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.139+0000 7fedb2d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb40caf80 0x7fedb40ae420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:44.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.139+0000 7fedb2d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb40caf80 0x7fedb40ae420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45556/0 (socket says 172.21.15.77:45556) 2023-11-04T01:41:44.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.139+0000 7fedb2d9d640 1 -- 172.21.15.77:0/4232084045 learned_addr learned my addr 172.21.15.77:0/4232084045 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:44.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.139+0000 7fedb259c640 1 --2- 172.21.15.77:0/4232084045 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fedb40c4f90 0x7fedb41f2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:44.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.139+0000 7feda9d9b640 1 --2- 172.21.15.77:0/4232084045 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fedb40c5370 0x7fedb40acce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:44.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.139+0000 7fedb2d9d640 1 -- 172.21.15.77:0/4232084045 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fedb40c4f90 msgr2=0x7fedb41f2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:44.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.139+0000 7fedb2d9d640 1 --2- 172.21.15.77:0/4232084045 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fedb40c4f90 0x7fedb41f2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.139+0000 7fedb2d9d640 1 -- 172.21.15.77:0/4232084045 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fedb40c5370 msgr2=0x7fedb40acce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:44.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.139+0000 7fedb2d9d640 1 --2- 172.21.15.77:0/4232084045 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fedb40c5370 0x7fedb40acce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:44.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.139+0000 7fedb2d9d640 1 -- 172.21.15.77:0/4232084045 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9c0094d0 con 0x7fedb40caf80 2023-11-04T01:41:44.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.139+0000 7fedb259c640 1 --2- 172.21.15.77:0/4232084045 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fedb40c4f90 0x7fedb41f2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:44.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.139+0000 7feda9d9b640 1 --2- 172.21.15.77:0/4232084045 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fedb40c5370 0x7fedb40acce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:44.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.139+0000 7fedb2d9d640 1 --2- 172.21.15.77:0/4232084045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb40caf80 0x7fedb40ae420 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fedac00b970 tx=0x7fedac00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:44.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.139+0000 7fedab7fe640 1 -- 172.21.15.77:0/4232084045 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac00cb40 con 0x7fedb40caf80 2023-11-04T01:41:44.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.139+0000 7fedab7fe640 1 -- 172.21.15.77:0/4232084045 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedac00ccc0 con 0x7fedb40caf80 2023-11-04T01:41:44.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.139+0000 7fedb8973640 1 -- 172.21.15.77:0/4232084045 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb40ac4e0 con 0x7fedb40caf80 2023-11-04T01:41:44.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.139+0000 7fedab7fe640 1 -- 172.21.15.77:0/4232084045 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac014680 con 0x7fedb40caf80 2023-11-04T01:41:44.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.139+0000 7fedb8973640 1 -- 172.21.15.77:0/4232084045 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb40ab8d0 con 0x7fedb40caf80 2023-11-04T01:41:44.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.140+0000 7fedb8973640 1 -- 172.21.15.77:0/4232084045 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb40aca00 con 0x7fedb40caf80 2023-11-04T01:41:44.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.141+0000 7fedab7fe640 1 -- 172.21.15.77:0/4232084045 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fedac01d3b0 con 0x7fedb40caf80 2023-11-04T01:41:44.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.141+0000 7fedab7fe640 1 --2- 172.21.15.77:0/4232084045 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fed9406ae70 0x7fed9406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:44.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.141+0000 7fedab7fe640 1 -- 172.21.15.77:0/4232084045 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6030+0+0 (secure 0 0 0) 0x7fedac089700 con 0x7fedb40caf80 2023-11-04T01:41:44.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.141+0000 7fedb259c640 1 --2- 172.21.15.77:0/4232084045 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fed9406ae70 0x7fed9406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:44.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.142+0000 7fedb259c640 1 --2- 172.21.15.77:0/4232084045 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fed9406ae70 0x7fed9406d330 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7feda4006fd0 tx=0x7feda4008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:44.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.145+0000 7fedab7fe640 1 -- 172.21.15.77:0/4232084045 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fedb40aca00 con 0x7fedb40caf80 2023-11-04T01:41:44.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:44.310+0000 7fedb8973640 1 -- 172.21.15.77:0/4232084045 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fedb40aca00 con 0x7fedb40caf80 2023-11-04T01:41:45.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.018+0000 7fedab7fe640 1 -- 172.21.15.77:0/4232084045 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v45) v1 ==== 169+0+0 (secure 0 0 0) 0x7fedb40aca00 con 0x7fedb40caf80 2023-11-04T01:41:45.020 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data' removed 2023-11-04T01:41:45.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.021+0000 7fedb8973640 1 -- 172.21.15.77:0/4232084045 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fed9406ae70 msgr2=0x7fed9406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:45.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.021+0000 7fedb8973640 1 --2- 172.21.15.77:0/4232084045 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fed9406ae70 0x7fed9406d330 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7feda4006fd0 tx=0x7feda4008040 comp rx=0 tx=0).stop 2023-11-04T01:41:45.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.021+0000 7fedb8973640 1 -- 172.21.15.77:0/4232084045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb40caf80 msgr2=0x7fedb40ae420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:45.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.021+0000 7fedb8973640 1 --2- 172.21.15.77:0/4232084045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb40caf80 0x7fedb40ae420 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fedac00b970 tx=0x7fedac00be30 comp rx=0 tx=0).stop 2023-11-04T01:41:45.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.022+0000 7fedb8973640 1 -- 172.21.15.77:0/4232084045 shutdown_connections 2023-11-04T01:41:45.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.022+0000 7fedb8973640 1 --2- 172.21.15.77:0/4232084045 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fed9406ae70 0x7fed9406d330 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.022+0000 7fedb8973640 1 --2- 172.21.15.77:0/4232084045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb40caf80 0x7fedb40ae420 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.022+0000 7fedb8973640 1 --2- 172.21.15.77:0/4232084045 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fedb40c5370 0x7fedb40acce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.022+0000 7fedb8973640 1 --2- 172.21.15.77:0/4232084045 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fedb40c4f90 0x7fedb41f2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.022+0000 7fedb8973640 1 -- 172.21.15.77:0/4232084045 >> 172.21.15.77:0/4232084045 conn(0x7fedb40b05d0 msgr2=0x7fedb41586a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:45.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.022+0000 7fedb8973640 1 -- 172.21.15.77:0/4232084045 shutdown_connections 2023-11-04T01:41:45.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.022+0000 7fedb8973640 1 -- 172.21.15.77:0/4232084045 wait complete. 2023-11-04T01:41:45.036 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-04T01:41:45.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.138+0000 7fdc6e8af640 1 Processor -- start 2023-11-04T01:41:45.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.138+0000 7fdc6e8af640 1 -- start start 2023-11-04T01:41:45.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.139+0000 7fdc6e8af640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdc68159c00 0x7fdc680cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.139+0000 7fdc6e8af640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc6815aff0 con 0x7fdc680ae1d0 2023-11-04T01:41:45.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.139+0000 7fdc6e8af640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc6815a3e0 con 0x7fdc680c48e0 2023-11-04T01:41:45.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.139+0000 7fdc6e8af640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc6815a6c0 con 0x7fdc68159c00 2023-11-04T01:41:45.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.139+0000 7fdc67fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdc68159c00 0x7fdc680cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:45.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.139+0000 7fdc6ce4c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fdc680ae1d0 0x7fdc680709f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:50748/0 (socket says 172.21.15.77:50748) 2023-11-04T01:41:45.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.139+0000 7fdc6ce4c640 1 -- 172.21.15.77:0/3371302119 learned_addr learned my addr 172.21.15.77:0/3371302119 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:45.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.140+0000 7fdc67fff640 1 -- 172.21.15.77:0/3371302119 >> v1:172.21.15.122:6789/0 conn(0x7fdc680c48e0 legacy=0x7fdc680adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:45.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.140+0000 7fdc67fff640 1 -- 172.21.15.77:0/3371302119 >> v1:172.21.15.77:6789/0 conn(0x7fdc680ae1d0 legacy=0x7fdc680709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:45.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.140+0000 7fdc67fff640 1 -- 172.21.15.77:0/3371302119 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6815a9a0 con 0x7fdc68159c00 2023-11-04T01:41:45.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.140+0000 7fdc67fff640 1 --2- 172.21.15.77:0/3371302119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc68159c00 0x7fdc680cc890 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fdc580097a0 tx=0x7fdc5802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c8d189c746191ad server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:45.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.140+0000 7fdc66ffd640 1 -- 172.21.15.77:0/3371302119 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5802e070 con 0x7fdc68159c00 2023-11-04T01:41:45.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.140+0000 7fdc66ffd640 1 -- 172.21.15.77:0/3371302119 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc580315a0 con 0x7fdc68159c00 2023-11-04T01:41:45.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.140+0000 7fdc66ffd640 1 -- 172.21.15.77:0/3371302119 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc58031930 con 0x7fdc68159c00 2023-11-04T01:41:45.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.141+0000 7fdc6e8af640 1 -- 172.21.15.77:0/3371302119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc68159c00 msgr2=0x7fdc680cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:45.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.141+0000 7fdc6e8af640 1 --2- 172.21.15.77:0/3371302119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc68159c00 0x7fdc680cc890 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fdc580097a0 tx=0x7fdc5802b840 comp rx=0 tx=0).stop 2023-11-04T01:41:45.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.141+0000 7fdc6e8af640 1 -- 172.21.15.77:0/3371302119 shutdown_connections 2023-11-04T01:41:45.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.141+0000 7fdc6e8af640 1 --2- 172.21.15.77:0/3371302119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc68159c00 0x7fdc680cc890 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.141+0000 7fdc6e8af640 1 -- 172.21.15.77:0/3371302119 >> 172.21.15.77:0/3371302119 conn(0x7fdc680ce950 msgr2=0x7fdc680ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:45.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.141+0000 7fdc6e8af640 1 -- 172.21.15.77:0/3371302119 shutdown_connections 2023-11-04T01:41:45.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.141+0000 7fdc6e8af640 1 -- 172.21.15.77:0/3371302119 wait complete. 2023-11-04T01:41:45.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.142+0000 7fdc6e8af640 1 Processor -- start 2023-11-04T01:41:45.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.142+0000 7fdc6e8af640 1 -- start start 2023-11-04T01:41:45.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.143+0000 7fdc6e8af640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc680ae1d0 0x7fdc680b4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.143+0000 7fdc6e8af640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc680c48e0 0x7fdc68157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.143+0000 7fdc6e8af640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc68159c00 0x7fdc681580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.143+0000 7fdc6e8af640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc68144b00 con 0x7fdc680ae1d0 2023-11-04T01:41:45.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.143+0000 7fdc6e8af640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc68140f00 con 0x7fdc680c48e0 2023-11-04T01:41:45.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.143+0000 7fdc6e8af640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc68142980 con 0x7fdc68159c00 2023-11-04T01:41:45.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.143+0000 7fdc67fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc680ae1d0 0x7fdc680b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:45.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.143+0000 7fdc67fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc680ae1d0 0x7fdc680b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45576/0 (socket says 172.21.15.77:45576) 2023-11-04T01:41:45.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.143+0000 7fdc67fff640 1 -- 172.21.15.77:0/2717251308 learned_addr learned my addr 172.21.15.77:0/2717251308 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:45.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.143+0000 7fdc67fff640 1 -- 172.21.15.77:0/2717251308 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc68159c00 msgr2=0x7fdc681580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:45.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.143+0000 7fdc67fff640 1 --2- 172.21.15.77:0/2717251308 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc68159c00 0x7fdc681580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.143+0000 7fdc67fff640 1 -- 172.21.15.77:0/2717251308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc680c48e0 msgr2=0x7fdc68157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:45.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.143+0000 7fdc67fff640 1 --2- 172.21.15.77:0/2717251308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc680c48e0 0x7fdc68157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.143+0000 7fdc67fff640 1 -- 172.21.15.77:0/2717251308 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc58009400 con 0x7fdc680ae1d0 2023-11-04T01:41:45.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.143+0000 7fdc67fff640 1 --2- 172.21.15.77:0/2717251308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc680ae1d0 0x7fdc680b4250 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fdc58034040 tx=0x7fdc580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:45.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.144+0000 7fdc64ff9640 1 -- 172.21.15.77:0/2717251308 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc58032900 con 0x7fdc680ae1d0 2023-11-04T01:41:45.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.144+0000 7fdc64ff9640 1 -- 172.21.15.77:0/2717251308 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc58032a80 con 0x7fdc680ae1d0 2023-11-04T01:41:45.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.144+0000 7fdc64ff9640 1 -- 172.21.15.77:0/2717251308 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc58032e30 con 0x7fdc680ae1d0 2023-11-04T01:41:45.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.144+0000 7fdc6e8af640 1 -- 172.21.15.77:0/2717251308 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc68142c60 con 0x7fdc680ae1d0 2023-11-04T01:41:45.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.144+0000 7fdc6e8af640 1 -- 172.21.15.77:0/2717251308 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc68144720 con 0x7fdc680ae1d0 2023-11-04T01:41:45.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.145+0000 7fdc6e8af640 1 -- 172.21.15.77:0/2717251308 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc681448b0 con 0x7fdc680ae1d0 2023-11-04T01:41:45.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.145+0000 7fdc64ff9640 1 -- 172.21.15.77:0/2717251308 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdc5803b3f0 con 0x7fdc680ae1d0 2023-11-04T01:41:45.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.146+0000 7fdc64ff9640 1 --2- 172.21.15.77:0/2717251308 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdc5406ae70 0x7fdc5406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.146+0000 7fdc64ff9640 1 -- 172.21.15.77:0/2717251308 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fdc580ab670 con 0x7fdc680ae1d0 2023-11-04T01:41:45.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.146+0000 7fdc677fe640 1 --2- 172.21.15.77:0/2717251308 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdc5406ae70 0x7fdc5406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:45.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.146+0000 7fdc677fe640 1 --2- 172.21.15.77:0/2717251308 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdc5406ae70 0x7fdc5406d330 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdc680c8a20 tx=0x7fdc5c007990 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:45.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.150+0000 7fdc64ff9640 1 -- 172.21.15.77:0/2717251308 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdc58076780 con 0x7fdc680ae1d0 2023-11-04T01:41:45.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.319+0000 7fdc6e8af640 1 -- 172.21.15.77:0/2717251308 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fdc68074290 con 0x7fdc680ae1d0 2023-11-04T01:41:45.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.322+0000 7fdc64ff9640 1 -- 172.21.15.77:0/2717251308 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v12) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdc58079da0 con 0x7fdc680ae1d0 2023-11-04T01:41:45.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.324+0000 7fdc6e8af640 1 -- 172.21.15.77:0/2717251308 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdc5406ae70 msgr2=0x7fdc5406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:45.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.324+0000 7fdc6e8af640 1 --2- 172.21.15.77:0/2717251308 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdc5406ae70 0x7fdc5406d330 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdc680c8a20 tx=0x7fdc5c007990 comp rx=0 tx=0).stop 2023-11-04T01:41:45.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.324+0000 7fdc6e8af640 1 -- 172.21.15.77:0/2717251308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc680ae1d0 msgr2=0x7fdc680b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:45.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.324+0000 7fdc6e8af640 1 --2- 172.21.15.77:0/2717251308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc680ae1d0 0x7fdc680b4250 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fdc58034040 tx=0x7fdc580046c0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.324+0000 7fdc6e8af640 1 -- 172.21.15.77:0/2717251308 shutdown_connections 2023-11-04T01:41:45.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.324+0000 7fdc6e8af640 1 --2- 172.21.15.77:0/2717251308 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdc5406ae70 0x7fdc5406d330 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.324+0000 7fdc6e8af640 1 --2- 172.21.15.77:0/2717251308 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc68159c00 0x7fdc681580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.324+0000 7fdc6e8af640 1 --2- 172.21.15.77:0/2717251308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc680c48e0 0x7fdc68157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.324+0000 7fdc6e8af640 1 --2- 172.21.15.77:0/2717251308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc680ae1d0 0x7fdc680b4250 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.324+0000 7fdc6e8af640 1 -- 172.21.15.77:0/2717251308 >> 172.21.15.77:0/2717251308 conn(0x7fdc680ce950 msgr2=0x7fdc68070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:45.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.324+0000 7fdc6e8af640 1 -- 172.21.15.77:0/2717251308 shutdown_connections 2023-11-04T01:41:45.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.324+0000 7fdc6e8af640 1 -- 172.21.15.77:0/2717251308 wait complete. 2023-11-04T01:41:45.336 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails' 2023-11-04T01:41:45.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.434+0000 7f0940221640 1 Processor -- start 2023-11-04T01:41:45.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.434+0000 7f0940221640 1 -- start start 2023-11-04T01:41:45.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.435+0000 7f0940221640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f09380b0ae0 0x7f09380ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.435+0000 7f0940221640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f093806db20 0x7f093815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.435+0000 7f0940221640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09380b4110 con 0x7f0938159c70 2023-11-04T01:41:45.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.435+0000 7f0940221640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09380b49b0 con 0x7f09380b0ae0 2023-11-04T01:41:45.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.435+0000 7f0940221640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09380b43f0 con 0x7f093806db20 2023-11-04T01:41:45.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.435+0000 7f093dfbd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f0938159c70 0x7f09380b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:50752/0 (socket says 172.21.15.77:50752) 2023-11-04T01:41:45.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.435+0000 7f093dfbd640 1 -- 172.21.15.77:0/1355832833 learned_addr learned my addr 172.21.15.77:0/1355832833 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:45.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.435+0000 7f093cfbb640 1 -- 172.21.15.77:0/1355832833 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3691574315 0 0) 0x7f09380b4110 con 0x7f0938159c70 2023-11-04T01:41:45.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.435+0000 7f093cfbb640 1 -- 172.21.15.77:0/1355832833 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0924003520 con 0x7f0938159c70 2023-11-04T01:41:45.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.436+0000 7f093e7be640 1 --2- 172.21.15.77:0/1355832833 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f093806db20 0x7f093815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:45.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.436+0000 7f093d7bc640 1 --2- 172.21.15.77:0/1355832833 >> v2:172.21.15.122:3300/0 conn(0x7f09380b0ae0 0x7f09380ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:45.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.436+0000 7f093cfbb640 1 -- 172.21.15.77:0/1355832833 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4242025421 0 0) 0x7f0924003520 con 0x7f0938159c70 2023-11-04T01:41:45.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.436+0000 7f093cfbb640 1 -- 172.21.15.77:0/1355832833 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f093806db20 msgr2=0x7f093815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:45.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.436+0000 7f093cfbb640 1 --2- 172.21.15.77:0/1355832833 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f093806db20 0x7f093815d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.436+0000 7f093cfbb640 1 -- 172.21.15.77:0/1355832833 >> v2:172.21.15.122:3300/0 conn(0x7f09380b0ae0 msgr2=0x7f09380ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:45.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.436+0000 7f093cfbb640 1 --2- 172.21.15.77:0/1355832833 >> v2:172.21.15.122:3300/0 conn(0x7f09380b0ae0 0x7f09380ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.436+0000 7f093cfbb640 1 -- 172.21.15.77:0/1355832833 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09380b46d0 con 0x7f0938159c70 2023-11-04T01:41:45.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.436+0000 7f093cfbb640 1 -- 172.21.15.77:0/1355832833 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f09340019f0 con 0x7f0938159c70 2023-11-04T01:41:45.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.436+0000 7f093e7be640 1 --2- 172.21.15.77:0/1355832833 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f093806db20 0x7f093815d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:45.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.436+0000 7f093cfbb640 1 -- 172.21.15.77:0/1355832833 >> v1:172.21.15.77:6789/0 conn(0x7f0938159c70 legacy=0x7f09380b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:45.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.436+0000 7f093cfbb640 1 --2- 172.21.15.77:0/1355832833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0924003970 0x7f0924003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.436+0000 7f093cfbb640 1 --2- 172.21.15.77:0/1355832833 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f093806db20 0x7f09240047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.436+0000 7f093cfbb640 1 --2- 172.21.15.77:0/1355832833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0924004d00 0x7f0924005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.436+0000 7f093cfbb640 1 -- 172.21.15.77:0/1355832833 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09380b49b0 con 0x7f0924003970 2023-11-04T01:41:45.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.436+0000 7f093cfbb640 1 -- 172.21.15.77:0/1355832833 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09380b43f0 con 0x7f0924004d00 2023-11-04T01:41:45.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.436+0000 7f093cfbb640 1 -- 172.21.15.77:0/1355832833 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f092400ba00 con 0x7f093806db20 2023-11-04T01:41:45.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.436+0000 7f093dfbd640 1 --2- 172.21.15.77:0/1355832833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0924003970 0x7f0924003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:45.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.436+0000 7f093e7be640 1 --2- 172.21.15.77:0/1355832833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0924004d00 0x7f0924005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:45.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.436+0000 7f093d7bc640 1 --2- 172.21.15.77:0/1355832833 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f093806db20 0x7f09240047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:45.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.436+0000 7f093dfbd640 1 -- 172.21.15.77:0/1355832833 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f093806db20 msgr2=0x7f09240047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:45.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.436+0000 7f093dfbd640 1 --2- 172.21.15.77:0/1355832833 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f093806db20 0x7f09240047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.436+0000 7f093dfbd640 1 -- 172.21.15.77:0/1355832833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0924004d00 msgr2=0x7f0924005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:45.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.436+0000 7f093dfbd640 1 --2- 172.21.15.77:0/1355832833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0924004d00 0x7f0924005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.436+0000 7f093dfbd640 1 -- 172.21.15.77:0/1355832833 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0924003520 con 0x7f0924003970 2023-11-04T01:41:45.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.437+0000 7f093dfbd640 1 --2- 172.21.15.77:0/1355832833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0924003970 0x7f0924003d90 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f093400a860 tx=0x7f09240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f736c4c07ca90a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:45.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.437+0000 7f093cfbb640 1 -- 172.21.15.77:0/1355832833 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0934034630 con 0x7f0924003970 2023-11-04T01:41:45.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.437+0000 7f093cfbb640 1 -- 172.21.15.77:0/1355832833 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093402f070 con 0x7f0924003970 2023-11-04T01:41:45.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.437+0000 7f093cfbb640 1 -- 172.21.15.77:0/1355832833 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09340349f0 con 0x7f0924003970 2023-11-04T01:41:45.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.437+0000 7f0940221640 1 -- 172.21.15.77:0/1355832833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0924003970 msgr2=0x7f0924003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:45.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.437+0000 7f0940221640 1 --2- 172.21.15.77:0/1355832833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0924003970 0x7f0924003d90 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f093400a860 tx=0x7f09240057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.437+0000 7f093e7be640 1 -- 172.21.15.77:0/1355832833 reap_dead start 2023-11-04T01:41:45.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.438+0000 7f0940221640 1 -- 172.21.15.77:0/1355832833 shutdown_connections 2023-11-04T01:41:45.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.438+0000 7f0940221640 1 -- 172.21.15.77:0/1355832833 >> 172.21.15.77:0/1355832833 conn(0x7f09380ce950 msgr2=0x7f09380ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:45.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.438+0000 7f0940221640 1 -- 172.21.15.77:0/1355832833 shutdown_connections 2023-11-04T01:41:45.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.438+0000 7f0940221640 1 -- 172.21.15.77:0/1355832833 wait complete. 2023-11-04T01:41:45.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.439+0000 7f0940221640 1 Processor -- start 2023-11-04T01:41:45.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.439+0000 7f0940221640 1 -- start start 2023-11-04T01:41:45.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.439+0000 7f0940221640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0924003970 0x7f093814e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.439+0000 7f0940221640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09380c5990 0x7f09380aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.439+0000 7f0940221640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09380af020 0x7f0938148cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.439+0000 7f0940221640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09381485a0 con 0x7f09380af020 2023-11-04T01:41:45.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.439+0000 7f0940221640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0938147b20 con 0x7f09380c5990 2023-11-04T01:41:45.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.439+0000 7f0940221640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09380c7200 con 0x7f0924003970 2023-11-04T01:41:45.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.440+0000 7f093e7be640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09380af020 0x7f0938148cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:45.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.440+0000 7f093e7be640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09380af020 0x7f0938148cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45586/0 (socket says 172.21.15.77:45586) 2023-11-04T01:41:45.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.440+0000 7f093e7be640 1 -- 172.21.15.77:0/3789429264 learned_addr learned my addr 172.21.15.77:0/3789429264 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:45.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.440+0000 7f093dfbd640 1 --2- 172.21.15.77:0/3789429264 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0924003970 0x7f093814e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:45.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.440+0000 7f093d7bc640 1 --2- 172.21.15.77:0/3789429264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09380c5990 0x7f09380aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:45.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.440+0000 7f093e7be640 1 -- 172.21.15.77:0/3789429264 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0924003970 msgr2=0x7f093814e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:45.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.440+0000 7f093e7be640 1 --2- 172.21.15.77:0/3789429264 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0924003970 0x7f093814e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.440+0000 7f093e7be640 1 -- 172.21.15.77:0/3789429264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09380c5990 msgr2=0x7f09380aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:45.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.440+0000 7f093e7be640 1 --2- 172.21.15.77:0/3789429264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09380c5990 0x7f09380aeae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:45.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.440+0000 7f093e7be640 1 -- 172.21.15.77:0/3789429264 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09380c6960 con 0x7f09380af020 2023-11-04T01:41:45.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.440+0000 7f093dfbd640 1 --2- 172.21.15.77:0/3789429264 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0924003970 0x7f093814e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:45.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.440+0000 7f093e7be640 1 --2- 172.21.15.77:0/3789429264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09380af020 0x7f0938148cb0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f093806d3c0 tx=0x7f09300108b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:45.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.440+0000 7f092e7fc640 1 -- 172.21.15.77:0/3789429264 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0930004440 con 0x7f09380af020 2023-11-04T01:41:45.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.440+0000 7f092e7fc640 1 -- 172.21.15.77:0/3789429264 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093000c050 con 0x7f09380af020 2023-11-04T01:41:45.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.440+0000 7f0940221640 1 -- 172.21.15.77:0/3789429264 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09380c6c40 con 0x7f09380af020 2023-11-04T01:41:45.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.440+0000 7f092e7fc640 1 -- 172.21.15.77:0/3789429264 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0930003850 con 0x7f09380af020 2023-11-04T01:41:45.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.440+0000 7f0940221640 1 -- 172.21.15.77:0/3789429264 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0938148790 con 0x7f09380af020 2023-11-04T01:41:45.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.441+0000 7f0940221640 1 -- 172.21.15.77:0/3789429264 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0938074290 con 0x7f09380af020 2023-11-04T01:41:45.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.442+0000 7f092e7fc640 1 -- 172.21.15.77:0/3789429264 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f09300039b0 con 0x7f09380af020 2023-11-04T01:41:45.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.442+0000 7f092e7fc640 1 --2- 172.21.15.77:0/3789429264 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f091c06ae70 0x7f091c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:45.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.442+0000 7f092e7fc640 1 -- 172.21.15.77:0/3789429264 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f0930089280 con 0x7f09380af020 2023-11-04T01:41:45.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.442+0000 7f093dfbd640 1 --2- 172.21.15.77:0/3789429264 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f091c06ae70 0x7f091c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:45.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.443+0000 7f093dfbd640 1 --2- 172.21.15.77:0/3789429264 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f091c06ae70 0x7f091c06d330 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0934034000 tx=0x7f0934009030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:45.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.446+0000 7f092e7fc640 1 -- 172.21.15.77:0/3789429264 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0930054420 con 0x7f09380af020 2023-11-04T01:41:45.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:45.682+0000 7f0940221640 1 -- 172.21.15.77:0/3789429264 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails"]} v 0) v1 -- 0x7f09380ce730 con 0x7f09380af020 2023-11-04T01:41:46.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.019+0000 7f092e7fc640 1 -- 172.21.15.77:0/3789429264 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails"]}]=0 v116) v1 ==== 173+0+0 (secure 0 0 0) 0x7f0930000e60 con 0x7f09380af020 2023-11-04T01:41:46.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.021+0000 7f0940221640 1 -- 172.21.15.77:0/3789429264 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f091c06ae70 msgr2=0x7f091c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.021+0000 7f0940221640 1 --2- 172.21.15.77:0/3789429264 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f091c06ae70 0x7f091c06d330 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0934034000 tx=0x7f0934009030 comp rx=0 tx=0).stop 2023-11-04T01:41:46.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.021+0000 7f0940221640 1 -- 172.21.15.77:0/3789429264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09380af020 msgr2=0x7f0938148cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.021+0000 7f0940221640 1 --2- 172.21.15.77:0/3789429264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09380af020 0x7f0938148cb0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f093806d3c0 tx=0x7f09300108b0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.021+0000 7f0940221640 1 -- 172.21.15.77:0/3789429264 shutdown_connections 2023-11-04T01:41:46.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.021+0000 7f0940221640 1 --2- 172.21.15.77:0/3789429264 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f091c06ae70 0x7f091c06d330 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.021+0000 7f0940221640 1 --2- 172.21.15.77:0/3789429264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09380af020 0x7f0938148cb0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.021+0000 7f0940221640 1 --2- 172.21.15.77:0/3789429264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09380c5990 0x7f09380aeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.021+0000 7f0940221640 1 --2- 172.21.15.77:0/3789429264 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0924003970 0x7f093814e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.021+0000 7f0940221640 1 -- 172.21.15.77:0/3789429264 >> 172.21.15.77:0/3789429264 conn(0x7f09380ce950 msgr2=0x7f09380ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:46.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.021+0000 7f0940221640 1 -- 172.21.15.77:0/3789429264 shutdown_connections 2023-11-04T01:41:46.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.021+0000 7f0940221640 1 -- 172.21.15.77:0/3789429264 wait complete. 2023-11-04T01:41:46.035 INFO:tasks.cephfs_test_runner:Test that attempt to attach pool with snapshots to an fs fails ... ok 2023-11-04T01:41:46.035 INFO:tasks.cephfs_test_runner:Starting test: test_disallow_monitor_managed_snaps_for_fs_pools (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) Test that creation of monitor managed snaps fails for pools attached 2023-11-04T01:41:46.036 INFO:tasks.cephfs_test_runner:test_disallow_monitor_managed_snaps_for_fs_pools (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) 2023-11-04T01:41:46.036 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:46.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.136+0000 7f2095fe2640 1 Processor -- start 2023-11-04T01:41:46.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.137+0000 7f2095fe2640 1 -- start start 2023-11-04T01:41:46.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.137+0000 7f2095fe2640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f20900cde60 0x7f209015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.137+0000 7f2095fe2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20900ce240 0x7f20900d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.137+0000 7f2095fe2640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f209015e000 con 0x7f209015daa0 2023-11-04T01:41:46.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.137+0000 7f2095fe2640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f209015e5c0 con 0x7f20900cde60 2023-11-04T01:41:46.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.137+0000 7f2095fe2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f209015e2e0 con 0x7f20900ce240 2023-11-04T01:41:46.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.138+0000 7f208ffff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20900ce240 0x7f20900d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.138+0000 7f208f7fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f20900cde60 0x7f209015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.138+0000 7f208ffff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20900ce240 0x7f20900d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:51086/0 (socket says 172.21.15.77:51086) 2023-11-04T01:41:46.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.138+0000 7f2086ffd640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f209015daa0 0x7f2090157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:47282/0 (socket says 172.21.15.77:47282) 2023-11-04T01:41:46.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.138+0000 7f208f7fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f20900cde60 0x7f209015d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:46002/0 (socket says 172.21.15.77:46002) 2023-11-04T01:41:46.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.138+0000 7f208ffff640 1 -- 172.21.15.77:0/1560956631 learned_addr learned my addr 172.21.15.77:0/1560956631 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:46.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.138+0000 7f208ffff640 1 -- 172.21.15.77:0/1560956631 >> v2:172.21.15.122:3300/0 conn(0x7f20900cde60 msgr2=0x7f209015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:46.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.138+0000 7f208ffff640 1 --2- 172.21.15.77:0/1560956631 >> v2:172.21.15.122:3300/0 conn(0x7f20900cde60 0x7f209015d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.138+0000 7f208ffff640 1 -- 172.21.15.77:0/1560956631 >> v1:172.21.15.122:6789/0 conn(0x7f209015daa0 legacy=0x7f2090157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.138+0000 7f208ffff640 1 -- 172.21.15.77:0/1560956631 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20900d1120 con 0x7f20900ce240 2023-11-04T01:41:46.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.139+0000 7f208ffff640 1 --2- 172.21.15.77:0/1560956631 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20900ce240 0x7f20900d1920 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2088009e50 tx=0x7f208802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=629bb09aac61c98d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:46.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.139+0000 7f208effd640 1 -- 172.21.15.77:0/1560956631 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208802cb00 con 0x7f20900ce240 2023-11-04T01:41:46.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.139+0000 7f208effd640 1 -- 172.21.15.77:0/1560956631 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208802cc60 con 0x7f20900ce240 2023-11-04T01:41:46.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.139+0000 7f208effd640 1 -- 172.21.15.77:0/1560956631 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20880343f0 con 0x7f20900ce240 2023-11-04T01:41:46.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.139+0000 7f2095fe2640 1 -- 172.21.15.77:0/1560956631 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20900ce240 msgr2=0x7f20900d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.139+0000 7f2095fe2640 1 --2- 172.21.15.77:0/1560956631 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20900ce240 0x7f20900d1920 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2088009e50 tx=0x7f208802bf60 comp rx=0 tx=0).stop 2023-11-04T01:41:46.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.140+0000 7f2095fe2640 1 -- 172.21.15.77:0/1560956631 shutdown_connections 2023-11-04T01:41:46.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.140+0000 7f2095fe2640 1 --2- 172.21.15.77:0/1560956631 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20900ce240 0x7f20900d1920 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.140+0000 7f2095fe2640 1 --2- 172.21.15.77:0/1560956631 >> v2:172.21.15.122:3300/0 conn(0x7f20900cde60 0x7f209015d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.140+0000 7f2095fe2640 1 -- 172.21.15.77:0/1560956631 >> 172.21.15.77:0/1560956631 conn(0x7f2090071f30 msgr2=0x7f20900cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:46.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.140+0000 7f2095fe2640 1 -- 172.21.15.77:0/1560956631 shutdown_connections 2023-11-04T01:41:46.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.140+0000 7f2095fe2640 1 -- 172.21.15.77:0/1560956631 wait complete. 2023-11-04T01:41:46.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.141+0000 7f2095fe2640 1 Processor -- start 2023-11-04T01:41:46.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.141+0000 7f2095fe2640 1 -- start start 2023-11-04T01:41:46.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.142+0000 7f2095fe2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20900cde60 0x7f209014b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.142+0000 7f2095fe2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20900ce240 0x7f20900b8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.142+0000 7f2095fe2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f209015daa0 0x7f20900cc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.142+0000 7f2095fe2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2090155910 con 0x7f20900ce240 2023-11-04T01:41:46.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.142+0000 7f2095fe2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2090155120 con 0x7f209015daa0 2023-11-04T01:41:46.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.142+0000 7f2095fe2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2090155350 con 0x7f20900cde60 2023-11-04T01:41:46.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.142+0000 7f2086ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20900ce240 0x7f20900b8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.142+0000 7f2086ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20900ce240 0x7f20900b8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45592/0 (socket says 172.21.15.77:45592) 2023-11-04T01:41:46.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.142+0000 7f2086ffd640 1 -- 172.21.15.77:0/3886926797 learned_addr learned my addr 172.21.15.77:0/3886926797 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:46.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.142+0000 7f208f7fe640 1 --2- 172.21.15.77:0/3886926797 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20900cde60 0x7f209014b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.142+0000 7f208ffff640 1 --2- 172.21.15.77:0/3886926797 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f209015daa0 0x7f20900cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.142+0000 7f2086ffd640 1 -- 172.21.15.77:0/3886926797 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20900cde60 msgr2=0x7f209014b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.142+0000 7f2086ffd640 1 --2- 172.21.15.77:0/3886926797 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20900cde60 0x7f209014b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.142+0000 7f2086ffd640 1 -- 172.21.15.77:0/3886926797 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f209015daa0 msgr2=0x7f20900cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.142+0000 7f2086ffd640 1 --2- 172.21.15.77:0/3886926797 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f209015daa0 0x7f20900cc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.142+0000 7f2086ffd640 1 -- 172.21.15.77:0/3886926797 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2088009b30 con 0x7f20900ce240 2023-11-04T01:41:46.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.142+0000 7f208ffff640 1 --2- 172.21.15.77:0/3886926797 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f209015daa0 0x7f20900cc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:46.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.142+0000 7f2086ffd640 1 --2- 172.21.15.77:0/3886926797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20900ce240 0x7f20900b8150 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f207800c3c0 tx=0x7f207800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:46.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.143+0000 7f208cff9640 1 -- 172.21.15.77:0/3886926797 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20780074e0 con 0x7f20900ce240 2023-11-04T01:41:46.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.143+0000 7f208cff9640 1 -- 172.21.15.77:0/3886926797 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2078007640 con 0x7f20900ce240 2023-11-04T01:41:46.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.143+0000 7f2095fe2640 1 -- 172.21.15.77:0/3886926797 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2090155630 con 0x7f20900ce240 2023-11-04T01:41:46.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.143+0000 7f208cff9640 1 -- 172.21.15.77:0/3886926797 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2078004a00 con 0x7f20900ce240 2023-11-04T01:41:46.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.143+0000 7f2095fe2640 1 -- 172.21.15.77:0/3886926797 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20900ca370 con 0x7f20900ce240 2023-11-04T01:41:46.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.144+0000 7f2095fe2640 1 -- 172.21.15.77:0/3886926797 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20900c9ed0 con 0x7f20900ce240 2023-11-04T01:41:46.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.144+0000 7f208cff9640 1 -- 172.21.15.77:0/3886926797 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2078004b60 con 0x7f20900ce240 2023-11-04T01:41:46.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.144+0000 7f208cff9640 1 --2- 172.21.15.77:0/3886926797 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f207006ae70 0x7f207006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.144+0000 7f208cff9640 1 -- 172.21.15.77:0/3886926797 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f2078089010 con 0x7f20900ce240 2023-11-04T01:41:46.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.144+0000 7f208f7fe640 1 --2- 172.21.15.77:0/3886926797 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f207006ae70 0x7f207006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.145+0000 7f208f7fe640 1 --2- 172.21.15.77:0/3886926797 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f207006ae70 0x7f207006d330 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2080009ad0 tx=0x7f2080008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:46.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.149+0000 7f208cff9640 1 -- 172.21.15.77:0/3886926797 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f20780540a0 con 0x7f20900ce240 2023-11-04T01:41:46.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.316+0000 7f2095fe2640 1 -- 172.21.15.77:0/3886926797 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2090074290 con 0x7f20900ce240 2023-11-04T01:41:46.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.317+0000 7f208cff9640 1 -- 172.21.15.77:0/3886926797 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+14934 (secure 0 0 0) 0x7f20780576c0 con 0x7f20900ce240 2023-11-04T01:41:46.319 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:46.319 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":45,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:41:45.014451+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.122:6837/3085479427":"2023-11-05T01:41:42.005452+0000","172.21.15.122:6835/3085479427":"2023-11-05T01:41:42.005452+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:46.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.319+0000 7f2095fe2640 1 -- 172.21.15.77:0/3886926797 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f207006ae70 msgr2=0x7f207006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.319+0000 7f2095fe2640 1 --2- 172.21.15.77:0/3886926797 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f207006ae70 0x7f207006d330 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2080009ad0 tx=0x7f2080008040 comp rx=0 tx=0).stop 2023-11-04T01:41:46.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.319+0000 7f2095fe2640 1 -- 172.21.15.77:0/3886926797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20900ce240 msgr2=0x7f20900b8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.319+0000 7f2095fe2640 1 --2- 172.21.15.77:0/3886926797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20900ce240 0x7f20900b8150 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f207800c3c0 tx=0x7f207800c880 comp rx=0 tx=0).stop 2023-11-04T01:41:46.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.319+0000 7f2095fe2640 1 -- 172.21.15.77:0/3886926797 shutdown_connections 2023-11-04T01:41:46.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.319+0000 7f2095fe2640 1 --2- 172.21.15.77:0/3886926797 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f207006ae70 0x7f207006d330 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.319+0000 7f2095fe2640 1 --2- 172.21.15.77:0/3886926797 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f209015daa0 0x7f20900cc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.319+0000 7f2095fe2640 1 --2- 172.21.15.77:0/3886926797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20900ce240 0x7f20900b8150 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.319+0000 7f2095fe2640 1 --2- 172.21.15.77:0/3886926797 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20900cde60 0x7f209014b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.319+0000 7f2095fe2640 1 -- 172.21.15.77:0/3886926797 >> 172.21.15.77:0/3886926797 conn(0x7f2090071f30 msgr2=0x7f20900b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:46.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.319+0000 7f2095fe2640 1 -- 172.21.15.77:0/3886926797 shutdown_connections 2023-11-04T01:41:46.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.319+0000 7f2095fe2640 1 -- 172.21.15.77:0/3886926797 wait complete. 2023-11-04T01:41:46.332 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:33.142176+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:41:46.333 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:41:46.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.433+0000 7f96e0ee0640 1 Processor -- start 2023-11-04T01:41:46.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.433+0000 7f96e0ee0640 1 -- start start 2023-11-04T01:41:46.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.434+0000 7f96e0ee0640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f96dc0b2d30 0x7f96dc06bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.434+0000 7f96e0ee0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f96dc06c1d0 0x7f96dc0cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.434+0000 7f96e0ee0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96dc06ca40 con 0x7f96dc160430 2023-11-04T01:41:46.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.434+0000 7f96e0ee0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96dc0cb580 con 0x7f96dc06c1d0 2023-11-04T01:41:46.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.434+0000 7f96e0ee0640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96dc06cd20 con 0x7f96dc0b2d30 2023-11-04T01:41:46.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.434+0000 7f96dad9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f96dc06c1d0 0x7f96dc0cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.434+0000 7f96da59c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f96dc160430 0x7f96dc0b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:50760/0 (socket says 172.21.15.77:50760) 2023-11-04T01:41:46.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.434+0000 7f96da59c640 1 -- 172.21.15.77:0/1160784488 learned_addr learned my addr 172.21.15.77:0/1160784488 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:46.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.435+0000 7f96dad9d640 1 -- 172.21.15.77:0/1160784488 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f96dc0b2d30 msgr2=0x7f96dc06bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:46.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.435+0000 7f96dad9d640 1 --2- 172.21.15.77:0/1160784488 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f96dc0b2d30 0x7f96dc06bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.435+0000 7f96dad9d640 1 -- 172.21.15.77:0/1160784488 >> v1:172.21.15.77:6789/0 conn(0x7f96dc160430 legacy=0x7f96dc0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.435+0000 7f96dad9d640 1 -- 172.21.15.77:0/1160784488 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96dc06d000 con 0x7f96dc06c1d0 2023-11-04T01:41:46.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.435+0000 7f96d959a640 1 -- 172.21.15.77:0/1160784488 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2048164596 0 0) 0x7f96dc06ca40 con 0x7f96dc160430 2023-11-04T01:41:46.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.435+0000 7f96dad9d640 1 --2- 172.21.15.77:0/1160784488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96dc06c1d0 0x7f96dc0cbcb0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f96d40097a0 tx=0x7f96d402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=741c93ce2fe7248a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:46.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.436+0000 7f96d959a640 1 -- 172.21.15.77:0/1160784488 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d4031830 con 0x7f96dc06c1d0 2023-11-04T01:41:46.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.436+0000 7f96d959a640 1 -- 172.21.15.77:0/1160784488 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d4031990 con 0x7f96dc06c1d0 2023-11-04T01:41:46.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.436+0000 7f96d959a640 1 -- 172.21.15.77:0/1160784488 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d4031d20 con 0x7f96dc06c1d0 2023-11-04T01:41:46.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.436+0000 7f96e0ee0640 1 -- 172.21.15.77:0/1160784488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96dc06c1d0 msgr2=0x7f96dc0cbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.436+0000 7f96e0ee0640 1 --2- 172.21.15.77:0/1160784488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96dc06c1d0 0x7f96dc0cbcb0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f96d40097a0 tx=0x7f96d402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.436+0000 7f96e0ee0640 1 -- 172.21.15.77:0/1160784488 shutdown_connections 2023-11-04T01:41:46.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.436+0000 7f96e0ee0640 1 --2- 172.21.15.77:0/1160784488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96dc06c1d0 0x7f96dc0cbcb0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.436+0000 7f96e0ee0640 1 --2- 172.21.15.77:0/1160784488 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f96dc0b2d30 0x7f96dc06bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.436+0000 7f96e0ee0640 1 -- 172.21.15.77:0/1160784488 >> 172.21.15.77:0/1160784488 conn(0x7f96dc06ea20 msgr2=0x7f96dc06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:46.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.436+0000 7f96e0ee0640 1 -- 172.21.15.77:0/1160784488 shutdown_connections 2023-11-04T01:41:46.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.436+0000 7f96e0ee0640 1 -- 172.21.15.77:0/1160784488 wait complete. 2023-11-04T01:41:46.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.438+0000 7f96e0ee0640 1 Processor -- start 2023-11-04T01:41:46.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.438+0000 7f96e0ee0640 1 -- start start 2023-11-04T01:41:46.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.438+0000 7f96e0ee0640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f96dc06c1d0 0x7f96dc0c6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.438+0000 7f96e0ee0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96dc0b2d30 0x7f96dc1469e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.438+0000 7f96e0ee0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96dc160430 0x7f96dc15ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.438+0000 7f96e0ee0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96dc0c9b80 con 0x7f96dc160430 2023-11-04T01:41:46.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.438+0000 7f96e0ee0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96dc0c9270 con 0x7f96dc0b2d30 2023-11-04T01:41:46.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.438+0000 7f96e0ee0640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96dc0c7400 con 0x7f96dc06c1d0 2023-11-04T01:41:46.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.438+0000 7f96dad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96dc160430 0x7f96dc15ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.438+0000 7f96dad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96dc160430 0x7f96dc15ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45608/0 (socket says 172.21.15.77:45608) 2023-11-04T01:41:46.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.438+0000 7f96dad9d640 1 -- 172.21.15.77:0/1594674418 learned_addr learned my addr 172.21.15.77:0/1594674418 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:46.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.439+0000 7f96d9d9b640 1 --2- 172.21.15.77:0/1594674418 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96dc0b2d30 0x7f96dc1469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.439+0000 7f96da59c640 1 --2- 172.21.15.77:0/1594674418 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f96dc06c1d0 0x7f96dc0c6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.439+0000 7f96dad9d640 1 -- 172.21.15.77:0/1594674418 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f96dc06c1d0 msgr2=0x7f96dc0c6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.439+0000 7f96dad9d640 1 --2- 172.21.15.77:0/1594674418 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f96dc06c1d0 0x7f96dc0c6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.439+0000 7f96dad9d640 1 -- 172.21.15.77:0/1594674418 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96dc0b2d30 msgr2=0x7f96dc1469e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.439+0000 7f96dad9d640 1 --2- 172.21.15.77:0/1594674418 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96dc0b2d30 0x7f96dc1469e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.439+0000 7f96dad9d640 1 -- 172.21.15.77:0/1594674418 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d4009400 con 0x7f96dc160430 2023-11-04T01:41:46.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.439+0000 7f96da59c640 1 --2- 172.21.15.77:0/1594674418 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f96dc06c1d0 0x7f96dc0c6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:46.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.439+0000 7f96dad9d640 1 --2- 172.21.15.77:0/1594674418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96dc160430 0x7f96dc15ea70 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f96d402bee0 tx=0x7f96d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:46.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.439+0000 7f96caffd640 1 -- 172.21.15.77:0/1594674418 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d403b9f0 con 0x7f96dc160430 2023-11-04T01:41:46.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.439+0000 7f96caffd640 1 -- 172.21.15.77:0/1594674418 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d403bb50 con 0x7f96dc160430 2023-11-04T01:41:46.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.439+0000 7f96e0ee0640 1 -- 172.21.15.77:0/1594674418 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96dc0c8a30 con 0x7f96dc160430 2023-11-04T01:41:46.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.439+0000 7f96caffd640 1 -- 172.21.15.77:0/1594674418 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d40453f0 con 0x7f96dc160430 2023-11-04T01:41:46.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.439+0000 7f96e0ee0640 1 -- 172.21.15.77:0/1594674418 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96dc0c97a0 con 0x7f96dc160430 2023-11-04T01:41:46.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.440+0000 7f96e0ee0640 1 -- 172.21.15.77:0/1594674418 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96dc0c9cc0 con 0x7f96dc160430 2023-11-04T01:41:46.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.440+0000 7f96caffd640 1 -- 172.21.15.77:0/1594674418 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f96d4045550 con 0x7f96dc160430 2023-11-04T01:41:46.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.441+0000 7f96caffd640 1 --2- 172.21.15.77:0/1594674418 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f96bc06ae70 0x7f96bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.441+0000 7f96caffd640 1 -- 172.21.15.77:0/1594674418 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f96d40ab970 con 0x7f96dc160430 2023-11-04T01:41:46.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.441+0000 7f96da59c640 1 --2- 172.21.15.77:0/1594674418 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f96bc06ae70 0x7f96bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.442+0000 7f96da59c640 1 --2- 172.21.15.77:0/1594674418 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f96bc06ae70 0x7f96bc06d330 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f96cc007fd0 tx=0x7f96cc009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:46.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.445+0000 7f96caffd640 1 -- 172.21.15.77:0/1594674418 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f96dc0c9cc0 con 0x7f96dc160430 2023-11-04T01:41:46.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.609+0000 7f96e0ee0640 1 -- 172.21.15.77:0/1594674418 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f96dc0c9cc0 con 0x7f96dc160430 2023-11-04T01:41:46.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.609+0000 7f96caffd640 1 -- 172.21.15.77:0/1594674418 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v45) v1 ==== 93+0+10 (secure 0 0 0) 0x7f96dc0c9cc0 con 0x7f96dc160430 2023-11-04T01:41:46.611 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:41:46.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.611+0000 7f96e0ee0640 1 -- 172.21.15.77:0/1594674418 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f96bc06ae70 msgr2=0x7f96bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.611+0000 7f96e0ee0640 1 --2- 172.21.15.77:0/1594674418 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f96bc06ae70 0x7f96bc06d330 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f96cc007fd0 tx=0x7f96cc009040 comp rx=0 tx=0).stop 2023-11-04T01:41:46.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.611+0000 7f96e0ee0640 1 -- 172.21.15.77:0/1594674418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96dc160430 msgr2=0x7f96dc15ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.611+0000 7f96e0ee0640 1 --2- 172.21.15.77:0/1594674418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96dc160430 0x7f96dc15ea70 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f96d402bee0 tx=0x7f96d40046c0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.611+0000 7f96e0ee0640 1 -- 172.21.15.77:0/1594674418 shutdown_connections 2023-11-04T01:41:46.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.611+0000 7f96e0ee0640 1 --2- 172.21.15.77:0/1594674418 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f96bc06ae70 0x7f96bc06d330 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.611+0000 7f96e0ee0640 1 --2- 172.21.15.77:0/1594674418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96dc160430 0x7f96dc15ea70 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.611+0000 7f96e0ee0640 1 --2- 172.21.15.77:0/1594674418 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96dc0b2d30 0x7f96dc1469e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.611+0000 7f96e0ee0640 1 --2- 172.21.15.77:0/1594674418 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f96dc06c1d0 0x7f96dc0c6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.611+0000 7f96e0ee0640 1 -- 172.21.15.77:0/1594674418 >> 172.21.15.77:0/1594674418 conn(0x7f96dc06ea20 msgr2=0x7f96dc0cc840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:46.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.611+0000 7f96e0ee0640 1 -- 172.21.15.77:0/1594674418 shutdown_connections 2023-11-04T01:41:46.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.611+0000 7f96e0ee0640 1 -- 172.21.15.77:0/1594674418 wait complete. 2023-11-04T01:41:46.623 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:41:46.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.725+0000 7f8ac90a9640 1 Processor -- start 2023-11-04T01:41:46.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.725+0000 7f8ac90a9640 1 -- start start 2023-11-04T01:41:46.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.725+0000 7f8ac90a9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8ac40c4ff0 0x7f8ac40cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.725+0000 7f8ac90a9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ac40adac0 0x7f8ac40adf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.725+0000 7f8ac90a9640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ac415aff0 con 0x7f8ac4159c00 2023-11-04T01:41:46.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.725+0000 7f8ac90a9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ac40ae460 con 0x7f8ac40c4ff0 2023-11-04T01:41:46.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.725+0000 7f8ac90a9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac415a3e0 con 0x7f8ac40adac0 2023-11-04T01:41:46.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.726+0000 7f8ac259c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8ac40c4ff0 0x7f8ac40cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.726+0000 7f8ac259c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8ac40c4ff0 0x7f8ac40cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45610/0 (socket says 172.21.15.77:45610) 2023-11-04T01:41:46.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.726+0000 7f8ac259c640 1 -- 172.21.15.77:0/1186308906 learned_addr learned my addr 172.21.15.77:0/1186308906 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:46.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.726+0000 7f8ac359e640 1 --2- 172.21.15.77:0/1186308906 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ac40adac0 0x7f8ac40adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.726+0000 7f8ac259c640 1 -- 172.21.15.77:0/1186308906 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ac40adac0 msgr2=0x7f8ac40adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:46.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.726+0000 7f8ac259c640 1 --2- 172.21.15.77:0/1186308906 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ac40adac0 0x7f8ac40adf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.726+0000 7f8ac259c640 1 -- 172.21.15.77:0/1186308906 >> v1:172.21.15.122:6789/0 conn(0x7f8ac4159c00 legacy=0x7f8ac40c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:46.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.726+0000 7f8ac259c640 1 -- 172.21.15.77:0/1186308906 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac415a6c0 con 0x7f8ac40c4ff0 2023-11-04T01:41:46.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.727+0000 7f8ac259c640 1 --2- 172.21.15.77:0/1186308906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac40c4ff0 0x7f8ac40cc890 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8009870 tx=0x7f8ab802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4065c92ab3f5bd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:46.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.727+0000 7f8ac1d9b640 1 -- 172.21.15.77:0/1186308906 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8031640 con 0x7f8ac40c4ff0 2023-11-04T01:41:46.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.727+0000 7f8ac1d9b640 1 -- 172.21.15.77:0/1186308906 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab80317a0 con 0x7f8ac40c4ff0 2023-11-04T01:41:46.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.727+0000 7f8ac1d9b640 1 -- 172.21.15.77:0/1186308906 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8031b30 con 0x7f8ac40c4ff0 2023-11-04T01:41:46.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.727+0000 7f8ac90a9640 1 -- 172.21.15.77:0/1186308906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac40c4ff0 msgr2=0x7f8ac40cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.727+0000 7f8ac90a9640 1 --2- 172.21.15.77:0/1186308906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac40c4ff0 0x7f8ac40cc890 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8009870 tx=0x7f8ab802b8f0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.727+0000 7f8ac90a9640 1 -- 172.21.15.77:0/1186308906 shutdown_connections 2023-11-04T01:41:46.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.727+0000 7f8ac90a9640 1 --2- 172.21.15.77:0/1186308906 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ac40adac0 0x7f8ac40adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.727+0000 7f8ac90a9640 1 --2- 172.21.15.77:0/1186308906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac40c4ff0 0x7f8ac40cc890 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.727+0000 7f8ac90a9640 1 -- 172.21.15.77:0/1186308906 >> 172.21.15.77:0/1186308906 conn(0x7f8ac40ce950 msgr2=0x7f8ac40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:46.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.727+0000 7f8ac90a9640 1 -- 172.21.15.77:0/1186308906 shutdown_connections 2023-11-04T01:41:46.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.727+0000 7f8ac90a9640 1 -- 172.21.15.77:0/1186308906 wait complete. 2023-11-04T01:41:46.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.729+0000 7f8ac90a9640 1 Processor -- start 2023-11-04T01:41:46.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.729+0000 7f8ac90a9640 1 -- start start 2023-11-04T01:41:46.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.729+0000 7f8ac90a9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac40adac0 0x7f8ac40b4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.729+0000 7f8ac90a9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ac40c4ff0 0x7f8ac40c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.729+0000 7f8ac90a9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ac4159c00 0x7f8ac414d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.729+0000 7f8ac90a9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac40b4690 con 0x7f8ac40adac0 2023-11-04T01:41:46.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.729+0000 7f8ac90a9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac40c5f60 con 0x7f8ac4159c00 2023-11-04T01:41:46.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.729+0000 7f8ac90a9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac40c81d0 con 0x7f8ac40c4ff0 2023-11-04T01:41:46.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.730+0000 7f8ac2d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac40adac0 0x7f8ac40b4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.730+0000 7f8ac2d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac40adac0 0x7f8ac40b4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45624/0 (socket says 172.21.15.77:45624) 2023-11-04T01:41:46.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.730+0000 7f8ac2d9d640 1 -- 172.21.15.77:0/3451726605 learned_addr learned my addr 172.21.15.77:0/3451726605 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:46.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.730+0000 7f8ac2d9d640 1 -- 172.21.15.77:0/3451726605 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ac40c4ff0 msgr2=0x7f8ac40c5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.730+0000 7f8ac2d9d640 1 --2- 172.21.15.77:0/3451726605 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ac40c4ff0 0x7f8ac40c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.730+0000 7f8ac2d9d640 1 -- 172.21.15.77:0/3451726605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ac4159c00 msgr2=0x7f8ac414d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.730+0000 7f8ac2d9d640 1 --2- 172.21.15.77:0/3451726605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ac4159c00 0x7f8ac414d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.730+0000 7f8ac2d9d640 1 -- 172.21.15.77:0/3451726605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab80094d0 con 0x7f8ac40adac0 2023-11-04T01:41:46.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.730+0000 7f8ac2d9d640 1 --2- 172.21.15.77:0/3451726605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac40adac0 0x7f8ac40b4150 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400b3f0 tx=0x7f8ab400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:46.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.730+0000 7f8aab7fe640 1 -- 172.21.15.77:0/3451726605 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4011830 con 0x7f8ac40adac0 2023-11-04T01:41:46.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.730+0000 7f8aab7fe640 1 -- 172.21.15.77:0/3451726605 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab4011990 con 0x7f8ac40adac0 2023-11-04T01:41:46.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.730+0000 7f8aab7fe640 1 -- 172.21.15.77:0/3451726605 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4011d40 con 0x7f8ac40adac0 2023-11-04T01:41:46.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.730+0000 7f8ac90a9640 1 -- 172.21.15.77:0/3451726605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac40c6190 con 0x7f8ac40adac0 2023-11-04T01:41:46.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.730+0000 7f8ac90a9640 1 -- 172.21.15.77:0/3451726605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac40c7b80 con 0x7f8ac40adac0 2023-11-04T01:41:46.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.731+0000 7f8ac90a9640 1 -- 172.21.15.77:0/3451726605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ac4074290 con 0x7f8ac40adac0 2023-11-04T01:41:46.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.732+0000 7f8aab7fe640 1 -- 172.21.15.77:0/3451726605 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8ab401a400 con 0x7f8ac40adac0 2023-11-04T01:41:46.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.732+0000 7f8aab7fe640 1 --2- 172.21.15.77:0/3451726605 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8ab006ae70 0x7f8ab006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:46.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.732+0000 7f8aab7fe640 1 -- 172.21.15.77:0/3451726605 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f8ab40894a0 con 0x7f8ac40adac0 2023-11-04T01:41:46.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.732+0000 7f8ac259c640 1 --2- 172.21.15.77:0/3451726605 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8ab006ae70 0x7f8ab006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:46.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.733+0000 7f8ac259c640 1 --2- 172.21.15.77:0/3451726605 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8ab006ae70 0x7f8ab006d330 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8036000 tx=0x7f8ab8030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:46.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.736+0000 7f8aab7fe640 1 -- 172.21.15.77:0/3451726605 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8ab4054530 con 0x7f8ac40adac0 2023-11-04T01:41:46.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.901+0000 7f8ac90a9640 1 -- 172.21.15.77:0/3451726605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f8ac40725c0 con 0x7f8ac40adac0 2023-11-04T01:41:46.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.902+0000 7f8aab7fe640 1 -- 172.21.15.77:0/3451726605 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v45) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8ab4057b50 con 0x7f8ac40adac0 2023-11-04T01:41:46.904 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:41:46.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.904+0000 7f8ac90a9640 1 -- 172.21.15.77:0/3451726605 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8ab006ae70 msgr2=0x7f8ab006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.904+0000 7f8ac90a9640 1 --2- 172.21.15.77:0/3451726605 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8ab006ae70 0x7f8ab006d330 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8036000 tx=0x7f8ab8030000 comp rx=0 tx=0).stop 2023-11-04T01:41:46.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.904+0000 7f8ac90a9640 1 -- 172.21.15.77:0/3451726605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac40adac0 msgr2=0x7f8ac40b4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:46.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.904+0000 7f8ac90a9640 1 --2- 172.21.15.77:0/3451726605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac40adac0 0x7f8ac40b4150 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400b3f0 tx=0x7f8ab400b8b0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.904+0000 7f8ac90a9640 1 -- 172.21.15.77:0/3451726605 shutdown_connections 2023-11-04T01:41:46.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.904+0000 7f8ac90a9640 1 --2- 172.21.15.77:0/3451726605 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8ab006ae70 0x7f8ab006d330 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.904+0000 7f8ac90a9640 1 --2- 172.21.15.77:0/3451726605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ac4159c00 0x7f8ac414d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.904+0000 7f8ac90a9640 1 --2- 172.21.15.77:0/3451726605 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ac40c4ff0 0x7f8ac40c5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.904+0000 7f8ac90a9640 1 --2- 172.21.15.77:0/3451726605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac40adac0 0x7f8ac40b4150 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:46.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.904+0000 7f8ac90a9640 1 -- 172.21.15.77:0/3451726605 >> 172.21.15.77:0/3451726605 conn(0x7f8ac40ce950 msgr2=0x7f8ac40709f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:46.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.904+0000 7f8ac90a9640 1 -- 172.21.15.77:0/3451726605 shutdown_connections 2023-11-04T01:41:46.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:46.904+0000 7f8ac90a9640 1 -- 172.21.15.77:0/3451726605 wait complete. 2023-11-04T01:41:46.918 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools' 2023-11-04T01:41:47.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.016+0000 7f0340d7c640 1 Processor -- start 2023-11-04T01:41:47.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.016+0000 7f0340d7c640 1 -- start start 2023-11-04T01:41:47.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.017+0000 7f0340d7c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f033c15ae70 0x7f033c15f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:47.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.017+0000 7f0340d7c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f033c0c99b0 0x7f033c06d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:47.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.017+0000 7f0340d7c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f033c0cab30 con 0x7f033c06d550 2023-11-04T01:41:47.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.017+0000 7f0340d7c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f033c06d9e0 con 0x7f033c15ae70 2023-11-04T01:41:47.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.017+0000 7f0340d7c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033c0b5110 con 0x7f033c0c99b0 2023-11-04T01:41:47.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.017+0000 7f033a59c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f033c15ae70 0x7f033c15f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:47.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.017+0000 7f033a59c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f033c15ae70 0x7f033c15f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45640/0 (socket says 172.21.15.77:45640) 2023-11-04T01:41:47.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.017+0000 7f033a59c640 1 -- 172.21.15.77:0/2467970681 learned_addr learned my addr 172.21.15.77:0/2467970681 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:47.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.017+0000 7f0339d9b640 1 --2- 172.21.15.77:0/2467970681 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f033c0c99b0 0x7f033c06d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:47.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.017+0000 7f033a59c640 1 -- 172.21.15.77:0/2467970681 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f033c0c99b0 msgr2=0x7f033c06d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:47.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.017+0000 7f033a59c640 1 --2- 172.21.15.77:0/2467970681 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f033c0c99b0 0x7f033c06d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:47.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.017+0000 7f033a59c640 1 -- 172.21.15.77:0/2467970681 >> v1:172.21.15.122:6789/0 conn(0x7f033c06d550 legacy=0x7f033c071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:47.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.017+0000 7f033a59c640 1 -- 172.21.15.77:0/2467970681 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033c15f820 con 0x7f033c15ae70 2023-11-04T01:41:47.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.017+0000 7f0339d9b640 1 --2- 172.21.15.77:0/2467970681 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f033c0c99b0 0x7f033c06d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:47.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.018+0000 7f033a59c640 1 --2- 172.21.15.77:0/2467970681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033c15ae70 0x7f033c15f2e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f032c009870 tx=0x7f032c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e1fedb9ac06028 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:47.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.018+0000 7f033959a640 1 -- 172.21.15.77:0/2467970681 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c030840 con 0x7f033c15ae70 2023-11-04T01:41:47.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.018+0000 7f033959a640 1 -- 172.21.15.77:0/2467970681 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032c0309a0 con 0x7f033c15ae70 2023-11-04T01:41:47.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.018+0000 7f033959a640 1 -- 172.21.15.77:0/2467970681 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c030d30 con 0x7f033c15ae70 2023-11-04T01:41:47.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.019+0000 7f0340d7c640 1 -- 172.21.15.77:0/2467970681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033c15ae70 msgr2=0x7f033c15f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:47.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.019+0000 7f0340d7c640 1 --2- 172.21.15.77:0/2467970681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033c15ae70 0x7f033c15f2e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f032c009870 tx=0x7f032c02b980 comp rx=0 tx=0).stop 2023-11-04T01:41:47.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.019+0000 7f0340d7c640 1 -- 172.21.15.77:0/2467970681 shutdown_connections 2023-11-04T01:41:47.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.019+0000 7f0340d7c640 1 --2- 172.21.15.77:0/2467970681 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f033c0c99b0 0x7f033c06d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:47.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.019+0000 7f0340d7c640 1 --2- 172.21.15.77:0/2467970681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033c15ae70 0x7f033c15f2e0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:47.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.019+0000 7f0340d7c640 1 -- 172.21.15.77:0/2467970681 >> 172.21.15.77:0/2467970681 conn(0x7f033c0cf4b0 msgr2=0x7f033c0cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:47.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.019+0000 7f0340d7c640 1 -- 172.21.15.77:0/2467970681 shutdown_connections 2023-11-04T01:41:47.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.019+0000 7f0340d7c640 1 -- 172.21.15.77:0/2467970681 wait complete. 2023-11-04T01:41:47.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.020+0000 7f0340d7c640 1 Processor -- start 2023-11-04T01:41:47.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.020+0000 7f0340d7c640 1 -- start start 2023-11-04T01:41:47.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.021+0000 7f0340d7c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033c06d550 0x7f033c151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:47.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.021+0000 7f0340d7c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f033c0c99b0 0x7f033c0c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:47.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.021+0000 7f0340d7c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f033c15ae70 0x7f033c154e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:47.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.021+0000 7f0340d7c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033c0c3f10 con 0x7f033c06d550 2023-11-04T01:41:47.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.021+0000 7f0340d7c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033c0c3300 con 0x7f033c0c99b0 2023-11-04T01:41:47.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.021+0000 7f0340d7c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033c0c35e0 con 0x7f033c15ae70 2023-11-04T01:41:47.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.021+0000 7f033a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033c06d550 0x7f033c151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:47.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.021+0000 7f033a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033c06d550 0x7f033c151b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45646/0 (socket says 172.21.15.77:45646) 2023-11-04T01:41:47.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.021+0000 7f033a59c640 1 -- 172.21.15.77:0/13799867 learned_addr learned my addr 172.21.15.77:0/13799867 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:47.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.021+0000 7f0339d9b640 1 --2- 172.21.15.77:0/13799867 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f033c0c99b0 0x7f033c0c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:47.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.021+0000 7f033ad9d640 1 --2- 172.21.15.77:0/13799867 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f033c15ae70 0x7f033c154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:47.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.021+0000 7f033a59c640 1 -- 172.21.15.77:0/13799867 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f033c15ae70 msgr2=0x7f033c154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:47.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.021+0000 7f033a59c640 1 --2- 172.21.15.77:0/13799867 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f033c15ae70 0x7f033c154e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:47.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.021+0000 7f033a59c640 1 -- 172.21.15.77:0/13799867 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f033c0c99b0 msgr2=0x7f033c0c43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:47.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.021+0000 7f033a59c640 1 --2- 172.21.15.77:0/13799867 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f033c0c99b0 0x7f033c0c43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:47.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.021+0000 7f033a59c640 1 -- 172.21.15.77:0/13799867 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f032c0094d0 con 0x7f033c06d550 2023-11-04T01:41:47.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.022+0000 7f033a59c640 1 --2- 172.21.15.77:0/13799867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033c06d550 0x7f033c151b40 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f032c000c00 tx=0x7f032c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:47.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.022+0000 7f032affd640 1 -- 172.21.15.77:0/13799867 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c030810 con 0x7f033c06d550 2023-11-04T01:41:47.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.022+0000 7f032affd640 1 -- 172.21.15.77:0/13799867 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032c039d90 con 0x7f033c06d550 2023-11-04T01:41:47.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.022+0000 7f032affd640 1 -- 172.21.15.77:0/13799867 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c043670 con 0x7f033c06d550 2023-11-04T01:41:47.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.022+0000 7f0340d7c640 1 -- 172.21.15.77:0/13799867 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f033c0c38c0 con 0x7f033c06d550 2023-11-04T01:41:47.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.022+0000 7f0340d7c640 1 -- 172.21.15.77:0/13799867 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f033c0c48e0 con 0x7f033c06d550 2023-11-04T01:41:47.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.023+0000 7f0340d7c640 1 -- 172.21.15.77:0/13799867 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f033c074290 con 0x7f033c06d550 2023-11-04T01:41:47.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.024+0000 7f032affd640 1 -- 172.21.15.77:0/13799867 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f032c02f390 con 0x7f033c06d550 2023-11-04T01:41:47.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.024+0000 7f032affd640 1 --2- 172.21.15.77:0/13799867 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f031c06aea0 0x7f031c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:47.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.024+0000 7f032affd640 1 -- 172.21.15.77:0/13799867 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f032c0ab850 con 0x7f033c06d550 2023-11-04T01:41:47.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.024+0000 7f0339d9b640 1 --2- 172.21.15.77:0/13799867 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f031c06aea0 0x7f031c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:47.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.025+0000 7f0339d9b640 1 --2- 172.21.15.77:0/13799867 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f031c06aea0 0x7f031c06d360 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f033c15f3f0 tx=0x7f0330008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:47.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.028+0000 7f032affd640 1 -- 172.21.15.77:0/13799867 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f032c076a10 con 0x7f033c06d550 2023-11-04T01:41:47.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:47.257+0000 7f0340d7c640 1 -- 172.21.15.77:0/13799867 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools"]} v 0) v1 -- 0x7f033c0ca740 con 0x7f033c06d550 2023-11-04T01:41:48.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.025+0000 7f032affd640 1 -- 172.21.15.77:0/13799867 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools"]}]=0 v118) v1 ==== 181+0+0 (secure 0 0 0) 0x7f032c0340f0 con 0x7f033c06d550 2023-11-04T01:41:48.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.027+0000 7f0340d7c640 1 -- 172.21.15.77:0/13799867 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f031c06aea0 msgr2=0x7f031c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:48.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.027+0000 7f0340d7c640 1 --2- 172.21.15.77:0/13799867 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f031c06aea0 0x7f031c06d360 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f033c15f3f0 tx=0x7f0330008040 comp rx=0 tx=0).stop 2023-11-04T01:41:48.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.027+0000 7f0340d7c640 1 -- 172.21.15.77:0/13799867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033c06d550 msgr2=0x7f033c151b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:48.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.027+0000 7f0340d7c640 1 --2- 172.21.15.77:0/13799867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033c06d550 0x7f033c151b40 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f032c000c00 tx=0x7f032c004730 comp rx=0 tx=0).stop 2023-11-04T01:41:48.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.027+0000 7f0340d7c640 1 -- 172.21.15.77:0/13799867 shutdown_connections 2023-11-04T01:41:48.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.027+0000 7f0340d7c640 1 --2- 172.21.15.77:0/13799867 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f031c06aea0 0x7f031c06d360 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.027+0000 7f0340d7c640 1 --2- 172.21.15.77:0/13799867 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f033c15ae70 0x7f033c154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.027+0000 7f0340d7c640 1 --2- 172.21.15.77:0/13799867 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f033c0c99b0 0x7f033c0c43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.027+0000 7f0340d7c640 1 --2- 172.21.15.77:0/13799867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033c06d550 0x7f033c151b40 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.027+0000 7f0340d7c640 1 -- 172.21.15.77:0/13799867 >> 172.21.15.77:0/13799867 conn(0x7f033c0cf4b0 msgr2=0x7f033c0c8a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:48.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.028+0000 7f0340d7c640 1 -- 172.21.15.77:0/13799867 shutdown_connections 2023-11-04T01:41:48.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.028+0000 7f0340d7c640 1 -- 172.21.15.77:0/13799867 wait complete. 2023-11-04T01:41:48.042 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-04T01:41:48.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.147+0000 7f04f6f61640 1 Processor -- start 2023-11-04T01:41:48.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.147+0000 7f04f6f61640 1 -- start start 2023-11-04T01:41:48.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.148+0000 7f04f6f61640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04f0160430 0x7f04f00b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:48.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.148+0000 7f04f6f61640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f04f006c3a0 0x7f04f00cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:48.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.148+0000 7f04f6f61640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04f00b2fc0 con 0x7f04f00b2b60 2023-11-04T01:41:48.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.148+0000 7f04f6f61640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f00cb580 con 0x7f04f006c3a0 2023-11-04T01:41:48.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.148+0000 7f04f6f61640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f006ca40 con 0x7f04f0160430 2023-11-04T01:41:48.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.148+0000 7f04f54fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f04f006c3a0 0x7f04f00cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:48.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.148+0000 7f04effff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f04f00b2b60 0x7f04f006bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57074/0 (socket says 172.21.15.77:57074) 2023-11-04T01:41:48.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.148+0000 7f04effff640 1 -- 172.21.15.77:0/850001624 learned_addr learned my addr 172.21.15.77:0/850001624 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:48.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.149+0000 7f04f4cfd640 1 --2- 172.21.15.77:0/850001624 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04f0160430 0x7f04f00b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:48.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.149+0000 7f04f54fe640 1 -- 172.21.15.77:0/850001624 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04f0160430 msgr2=0x7f04f00b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:48.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.149+0000 7f04f54fe640 1 --2- 172.21.15.77:0/850001624 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04f0160430 0x7f04f00b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.149+0000 7f04f54fe640 1 -- 172.21.15.77:0/850001624 >> v1:172.21.15.77:6789/0 conn(0x7f04f00b2b60 legacy=0x7f04f006bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:48.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.149+0000 7f04ef7fe640 1 -- 172.21.15.77:0/850001624 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3264451084 0 0) 0x7f04f00b2fc0 con 0x7f04f00b2b60 2023-11-04T01:41:48.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.149+0000 7f04f54fe640 1 -- 172.21.15.77:0/850001624 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f006c810 con 0x7f04f006c3a0 2023-11-04T01:41:48.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.149+0000 7f04f54fe640 1 --2- 172.21.15.77:0/850001624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f006c3a0 0x7f04f00cbcb0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f04e8009d90 tx=0x7f04e802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=876fc135562e4ec9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:48.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.150+0000 7f04ef7fe640 1 -- 172.21.15.77:0/850001624 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e802cc50 con 0x7f04f006c3a0 2023-11-04T01:41:48.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.150+0000 7f04ef7fe640 1 -- 172.21.15.77:0/850001624 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e802cdb0 con 0x7f04f006c3a0 2023-11-04T01:41:48.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.150+0000 7f04ef7fe640 1 -- 172.21.15.77:0/850001624 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e8034660 con 0x7f04f006c3a0 2023-11-04T01:41:48.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.150+0000 7f04f6f61640 1 -- 172.21.15.77:0/850001624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f006c3a0 msgr2=0x7f04f00cbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:48.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.150+0000 7f04f6f61640 1 --2- 172.21.15.77:0/850001624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f006c3a0 0x7f04f00cbcb0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f04e8009d90 tx=0x7f04e802bea0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.150+0000 7f04f6f61640 1 -- 172.21.15.77:0/850001624 shutdown_connections 2023-11-04T01:41:48.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.150+0000 7f04f6f61640 1 --2- 172.21.15.77:0/850001624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f006c3a0 0x7f04f00cbcb0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.150+0000 7f04f6f61640 1 --2- 172.21.15.77:0/850001624 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04f0160430 0x7f04f00b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.150+0000 7f04f6f61640 1 -- 172.21.15.77:0/850001624 >> 172.21.15.77:0/850001624 conn(0x7f04f006ea20 msgr2=0x7f04f006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:48.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.150+0000 7f04f6f61640 1 -- 172.21.15.77:0/850001624 shutdown_connections 2023-11-04T01:41:48.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.150+0000 7f04f6f61640 1 -- 172.21.15.77:0/850001624 wait complete. 2023-11-04T01:41:48.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.151+0000 7f04f6f61640 1 Processor -- start 2023-11-04T01:41:48.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.151+0000 7f04f6f61640 1 -- start start 2023-11-04T01:41:48.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.152+0000 7f04f6f61640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f006c3a0 0x7f04f00c4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:48.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.152+0000 7f04f6f61640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04f00b2b60 0x7f04f01f1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:48.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.152+0000 7f04f6f61640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04f0160430 0x7f04f00c5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:48.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.152+0000 7f04f6f61640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f00cc560 con 0x7f04f006c3a0 2023-11-04T01:41:48.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.152+0000 7f04f6f61640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f00ccb20 con 0x7f04f00b2b60 2023-11-04T01:41:48.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.152+0000 7f04f6f61640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f00c9b90 con 0x7f04f0160430 2023-11-04T01:41:48.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.152+0000 7f04f4cfd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f006c3a0 0x7f04f00c4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:48.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.152+0000 7f04f4cfd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f006c3a0 0x7f04f00c4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54520/0 (socket says 172.21.15.77:54520) 2023-11-04T01:41:48.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.152+0000 7f04f4cfd640 1 -- 172.21.15.77:0/3082046113 learned_addr learned my addr 172.21.15.77:0/3082046113 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:48.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.153+0000 7f04effff640 1 --2- 172.21.15.77:0/3082046113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04f00b2b60 0x7f04f01f1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:48.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.153+0000 7f04f54fe640 1 --2- 172.21.15.77:0/3082046113 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04f0160430 0x7f04f00c5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:48.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.153+0000 7f04f4cfd640 1 -- 172.21.15.77:0/3082046113 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04f0160430 msgr2=0x7f04f00c5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:48.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.153+0000 7f04f4cfd640 1 --2- 172.21.15.77:0/3082046113 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04f0160430 0x7f04f00c5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.153+0000 7f04f4cfd640 1 -- 172.21.15.77:0/3082046113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04f00b2b60 msgr2=0x7f04f01f1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:48.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.153+0000 7f04f4cfd640 1 --2- 172.21.15.77:0/3082046113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04f00b2b60 0x7f04f01f1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.153+0000 7f04f4cfd640 1 -- 172.21.15.77:0/3082046113 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e8009a70 con 0x7f04f006c3a0 2023-11-04T01:41:48.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.153+0000 7f04f54fe640 1 --2- 172.21.15.77:0/3082046113 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04f0160430 0x7f04f00c5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:48.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.153+0000 7f04f4cfd640 1 --2- 172.21.15.77:0/3082046113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f006c3a0 0x7f04f00c4630 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f04e000d830 tx=0x7f04e000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:48.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.153+0000 7f04ed7fa640 1 -- 172.21.15.77:0/3082046113 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e000b6c0 con 0x7f04f006c3a0 2023-11-04T01:41:48.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.153+0000 7f04ed7fa640 1 -- 172.21.15.77:0/3082046113 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e000b820 con 0x7f04f006c3a0 2023-11-04T01:41:48.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.153+0000 7f04f6f61640 1 -- 172.21.15.77:0/3082046113 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f00c9e70 con 0x7f04f006c3a0 2023-11-04T01:41:48.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.153+0000 7f04ed7fa640 1 -- 172.21.15.77:0/3082046113 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e000bbb0 con 0x7f04f006c3a0 2023-11-04T01:41:48.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.153+0000 7f04f6f61640 1 -- 172.21.15.77:0/3082046113 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f01f2380 con 0x7f04f006c3a0 2023-11-04T01:41:48.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.154+0000 7f04f6f61640 1 -- 172.21.15.77:0/3082046113 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f0074290 con 0x7f04f006c3a0 2023-11-04T01:41:48.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.154+0000 7f04ed7fa640 1 -- 172.21.15.77:0/3082046113 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f04e001e460 con 0x7f04f006c3a0 2023-11-04T01:41:48.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.155+0000 7f04ed7fa640 1 --2- 172.21.15.77:0/3082046113 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f04dc06aea0 0x7f04dc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:48.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.155+0000 7f04ed7fa640 1 -- 172.21.15.77:0/3082046113 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f04e0089d20 con 0x7f04f006c3a0 2023-11-04T01:41:48.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.155+0000 7f04effff640 1 --2- 172.21.15.77:0/3082046113 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f04dc06aea0 0x7f04dc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:48.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.155+0000 7f04effff640 1 --2- 172.21.15.77:0/3082046113 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f04dc06aea0 0x7f04dc06d360 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f04f00c4b70 tx=0x7f04e4007b50 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:48.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.159+0000 7f04ed7fa640 1 -- 172.21.15.77:0/3082046113 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f04e0054e30 con 0x7f04f006c3a0 2023-11-04T01:41:48.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.324+0000 7f04f6f61640 1 -- 172.21.15.77:0/3082046113 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f04f00b6b20 con 0x7f04f006c3a0 2023-11-04T01:41:48.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.327+0000 7f04ed7fa640 1 -- 172.21.15.77:0/3082046113 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v13)=0 v13) v1 ==== 122+0+0 (secure 0 0 0) 0x7f04e0058450 con 0x7f04f006c3a0 2023-11-04T01:41:48.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.329+0000 7f04f6f61640 1 -- 172.21.15.77:0/3082046113 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f04dc06aea0 msgr2=0x7f04dc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:48.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.329+0000 7f04f6f61640 1 --2- 172.21.15.77:0/3082046113 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f04dc06aea0 0x7f04dc06d360 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f04f00c4b70 tx=0x7f04e4007b50 comp rx=0 tx=0).stop 2023-11-04T01:41:48.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.329+0000 7f04f6f61640 1 -- 172.21.15.77:0/3082046113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f006c3a0 msgr2=0x7f04f00c4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:48.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.329+0000 7f04f6f61640 1 --2- 172.21.15.77:0/3082046113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f006c3a0 0x7f04f00c4630 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f04e000d830 tx=0x7f04e000dcf0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.329+0000 7f04f6f61640 1 -- 172.21.15.77:0/3082046113 shutdown_connections 2023-11-04T01:41:48.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.329+0000 7f04f6f61640 1 --2- 172.21.15.77:0/3082046113 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f04dc06aea0 0x7f04dc06d360 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.329+0000 7f04f6f61640 1 --2- 172.21.15.77:0/3082046113 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04f0160430 0x7f04f00c5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.329+0000 7f04f6f61640 1 --2- 172.21.15.77:0/3082046113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04f00b2b60 0x7f04f01f1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.329+0000 7f04f6f61640 1 --2- 172.21.15.77:0/3082046113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f006c3a0 0x7f04f00c4630 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.329+0000 7f04f6f61640 1 -- 172.21.15.77:0/3082046113 >> 172.21.15.77:0/3082046113 conn(0x7f04f006ea20 msgr2=0x7f04f00b0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:48.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.329+0000 7f04f6f61640 1 -- 172.21.15.77:0/3082046113 shutdown_connections 2023-11-04T01:41:48.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.329+0000 7f04f6f61640 1 -- 172.21.15.77:0/3082046113 wait complete. 2023-11-04T01:41:48.342 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:41:48.343 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:41:48.378 DEBUG:teuthology.orchestra.run.smithi122:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:41:48.423 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:41:48.424 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:41:48.424 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:41:48.440 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19534 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:41:48.440 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:41:48.441 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:41:48.458 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056339,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13650 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 none /run/credentials/systemd-tmpfiles-clean.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 2023-11-04T01:41:48.459 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:41:48.459 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:41:48.494 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19534 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:41:48.495 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:41:48.495 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:41:48.515 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056339,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13650 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 none /run/credentials/systemd-tmpfiles-clean.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 2023-11-04T01:41:48.515 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-04T01:41:48.516 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:48.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.632+0000 7fd82759e640 1 Processor -- start 2023-11-04T01:41:48.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.633+0000 7fd82759e640 1 -- start start 2023-11-04T01:41:48.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.633+0000 7fd82759e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd82015ae40 0x7fd82015bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:48.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.633+0000 7fd82759e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd8200cda30 0x7fd8200ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:48.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.633+0000 7fd82759e640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8200cc450 con 0x7fd8200cbc00 2023-11-04T01:41:48.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.633+0000 7fd82759e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd82015f400 con 0x7fd8200cda30 2023-11-04T01:41:48.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.633+0000 7fd82759e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd82015b220 con 0x7fd82015ae40 2023-11-04T01:41:48.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.633+0000 7fd825b3b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd8200cda30 0x7fd8200ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:48.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.634+0000 7fd825b3b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd8200cda30 0x7fd8200ced70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54534/0 (socket says 172.21.15.77:54534) 2023-11-04T01:41:48.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.634+0000 7fd825b3b640 1 -- 172.21.15.77:0/1325096130 learned_addr learned my addr 172.21.15.77:0/1325096130 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:48.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.634+0000 7fd82533a640 1 --2- 172.21.15.77:0/1325096130 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd82015ae40 0x7fd82015bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:48.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.634+0000 7fd825b3b640 1 -- 172.21.15.77:0/1325096130 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd82015ae40 msgr2=0x7fd82015bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:48.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.634+0000 7fd825b3b640 1 --2- 172.21.15.77:0/1325096130 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd82015ae40 0x7fd82015bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.634+0000 7fd825b3b640 1 -- 172.21.15.77:0/1325096130 >> v1:172.21.15.122:6789/0 conn(0x7fd8200cbc00 legacy=0x7fd8200cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:48.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.634+0000 7fd825b3b640 1 -- 172.21.15.77:0/1325096130 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82015f890 con 0x7fd8200cda30 2023-11-04T01:41:48.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.635+0000 7fd825b3b640 1 --2- 172.21.15.77:0/1325096130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8200cda30 0x7fd8200ced70 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fd818009870 tx=0x7fd81802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6958985d4995562f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:48.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.635+0000 7fd817fff640 1 -- 172.21.15.77:0/1325096130 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd818030840 con 0x7fd8200cda30 2023-11-04T01:41:48.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.635+0000 7fd817fff640 1 -- 172.21.15.77:0/1325096130 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8180309a0 con 0x7fd8200cda30 2023-11-04T01:41:48.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.635+0000 7fd817fff640 1 -- 172.21.15.77:0/1325096130 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd818030d30 con 0x7fd8200cda30 2023-11-04T01:41:48.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.635+0000 7fd82759e640 1 -- 172.21.15.77:0/1325096130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8200cda30 msgr2=0x7fd8200ced70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:48.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.635+0000 7fd82759e640 1 --2- 172.21.15.77:0/1325096130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8200cda30 0x7fd8200ced70 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fd818009870 tx=0x7fd81802b980 comp rx=0 tx=0).stop 2023-11-04T01:41:48.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.635+0000 7fd82759e640 1 -- 172.21.15.77:0/1325096130 shutdown_connections 2023-11-04T01:41:48.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.635+0000 7fd82759e640 1 --2- 172.21.15.77:0/1325096130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8200cda30 0x7fd8200ced70 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.635+0000 7fd82759e640 1 --2- 172.21.15.77:0/1325096130 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd82015ae40 0x7fd82015bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.635+0000 7fd82759e640 1 -- 172.21.15.77:0/1325096130 >> 172.21.15.77:0/1325096130 conn(0x7fd82006ea90 msgr2=0x7fd82006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:48.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.635+0000 7fd82759e640 1 -- 172.21.15.77:0/1325096130 shutdown_connections 2023-11-04T01:41:48.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.635+0000 7fd82759e640 1 -- 172.21.15.77:0/1325096130 wait complete. 2023-11-04T01:41:48.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.636+0000 7fd82759e640 1 Processor -- start 2023-11-04T01:41:48.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.636+0000 7fd82759e640 1 -- start start 2023-11-04T01:41:48.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.637+0000 7fd82759e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd8200cbc00 0x7fd8200b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:48.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.637+0000 7fd82759e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8200cda30 0x7fd8201f3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:48.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.637+0000 7fd82759e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd82015ae40 0x7fd8200ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:48.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.637+0000 7fd82759e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8201f4440 con 0x7fd8200cda30 2023-11-04T01:41:48.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.637+0000 7fd82759e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8200c8920 con 0x7fd82015ae40 2023-11-04T01:41:48.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.637+0000 7fd82759e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8200c7d10 con 0x7fd8200cbc00 2023-11-04T01:41:48.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.637+0000 7fd824b39640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8200cda30 0x7fd8201f3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:48.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.637+0000 7fd824b39640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8200cda30 0x7fd8201f3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54544/0 (socket says 172.21.15.77:54544) 2023-11-04T01:41:48.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.637+0000 7fd824b39640 1 -- 172.21.15.77:0/3633517451 learned_addr learned my addr 172.21.15.77:0/3633517451 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:48.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.637+0000 7fd82533a640 1 --2- 172.21.15.77:0/3633517451 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd8200cbc00 0x7fd8200b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:48.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.637+0000 7fd825b3b640 1 --2- 172.21.15.77:0/3633517451 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd82015ae40 0x7fd8200ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:48.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.638+0000 7fd824b39640 1 -- 172.21.15.77:0/3633517451 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd8200cbc00 msgr2=0x7fd8200b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:48.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.638+0000 7fd824b39640 1 --2- 172.21.15.77:0/3633517451 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd8200cbc00 0x7fd8200b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.638+0000 7fd824b39640 1 -- 172.21.15.77:0/3633517451 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd82015ae40 msgr2=0x7fd8200ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:48.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.638+0000 7fd824b39640 1 --2- 172.21.15.77:0/3633517451 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd82015ae40 0x7fd8200ca3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.638+0000 7fd824b39640 1 -- 172.21.15.77:0/3633517451 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8180094d0 con 0x7fd8200cda30 2023-11-04T01:41:48.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.638+0000 7fd825b3b640 1 --2- 172.21.15.77:0/3633517451 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd82015ae40 0x7fd8200ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:48.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.638+0000 7fd824b39640 1 --2- 172.21.15.77:0/3633517451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8200cda30 0x7fd8201f3f00 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fd81000c450 tx=0x7fd81000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:48.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.638+0000 7fd815ffb640 1 -- 172.21.15.77:0/3633517451 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8100052d0 con 0x7fd8200cda30 2023-11-04T01:41:48.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.638+0000 7fd815ffb640 1 -- 172.21.15.77:0/3633517451 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd810005430 con 0x7fd8200cda30 2023-11-04T01:41:48.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.638+0000 7fd815ffb640 1 -- 172.21.15.77:0/3633517451 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd810012870 con 0x7fd8200cda30 2023-11-04T01:41:48.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.638+0000 7fd82759e640 1 -- 172.21.15.77:0/3633517451 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8200c7ff0 con 0x7fd8200cda30 2023-11-04T01:41:48.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.638+0000 7fd82759e640 1 -- 172.21.15.77:0/3633517451 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8200c85b0 con 0x7fd8200cda30 2023-11-04T01:41:48.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.639+0000 7fd82759e640 1 -- 172.21.15.77:0/3633517451 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8200ce2d0 con 0x7fd8200cda30 2023-11-04T01:41:48.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.639+0000 7fd815ffb640 1 -- 172.21.15.77:0/3633517451 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd8100129d0 con 0x7fd8200cda30 2023-11-04T01:41:48.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.640+0000 7fd815ffb640 1 --2- 172.21.15.77:0/3633517451 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd80406ae70 0x7fd80406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:48.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.640+0000 7fd815ffb640 1 -- 172.21.15.77:0/3633517451 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fd810088df0 con 0x7fd8200cda30 2023-11-04T01:41:48.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.640+0000 7fd82533a640 1 --2- 172.21.15.77:0/3633517451 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd80406ae70 0x7fd80406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:48.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.641+0000 7fd82533a640 1 --2- 172.21.15.77:0/3633517451 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd80406ae70 0x7fd80406d330 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd81c003aa0 tx=0x7fd81c009830 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:48.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.644+0000 7fd815ffb640 1 -- 172.21.15.77:0/3633517451 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd810053f90 con 0x7fd8200cda30 2023-11-04T01:41:48.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.845+0000 7fd82759e640 1 -- 172.21.15.77:0/3633517451 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8200cc450 con 0x7fd8200cda30 2023-11-04T01:41:48.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.846+0000 7fd815ffb640 1 -- 172.21.15.77:0/3633517451 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3700 (secure 0 0 0) 0x7fd8200cc450 con 0x7fd8200cda30 2023-11-04T01:41:48.848 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:48.848 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5511,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/1132914884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1132914884},{"type":"v1","addr":"172.21.15.77:6834","nonce":1132914884}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5514,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/530959421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":530959421},{"type":"v1","addr":"172.21.15.77:6835","nonce":530959421}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/363215230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":363215230},{"type":"v1","addr":"172.21.15.122:6837","nonce":363215230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":34823,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/1375125704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1375125704},{"type":"v1","addr":"172.21.15.122:6836","nonce":1375125704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[]} 2023-11-04T01:41:48.848 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 18 2023-11-04T01:41:48.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.847+0000 7fd82759e640 1 -- 172.21.15.77:0/3633517451 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd80406ae70 msgr2=0x7fd80406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:48.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.847+0000 7fd82759e640 1 --2- 172.21.15.77:0/3633517451 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd80406ae70 0x7fd80406d330 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd81c003aa0 tx=0x7fd81c009830 comp rx=0 tx=0).stop 2023-11-04T01:41:48.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.847+0000 7fd82759e640 1 -- 172.21.15.77:0/3633517451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8200cda30 msgr2=0x7fd8201f3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:48.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.847+0000 7fd82759e640 1 --2- 172.21.15.77:0/3633517451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8200cda30 0x7fd8201f3f00 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fd81000c450 tx=0x7fd81000c910 comp rx=0 tx=0).stop 2023-11-04T01:41:48.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.848+0000 7fd82759e640 1 -- 172.21.15.77:0/3633517451 shutdown_connections 2023-11-04T01:41:48.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.848+0000 7fd82759e640 1 --2- 172.21.15.77:0/3633517451 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd80406ae70 0x7fd80406d330 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.848+0000 7fd82759e640 1 --2- 172.21.15.77:0/3633517451 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd82015ae40 0x7fd8200ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.848+0000 7fd82759e640 1 --2- 172.21.15.77:0/3633517451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8200cda30 0x7fd8201f3f00 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.848+0000 7fd82759e640 1 --2- 172.21.15.77:0/3633517451 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd8200cbc00 0x7fd8200b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:48.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.848+0000 7fd82759e640 1 -- 172.21.15.77:0/3633517451 >> 172.21.15.77:0/3633517451 conn(0x7fd82006ea90 msgr2=0x7fd82015bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:48.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.848+0000 7fd82759e640 1 -- 172.21.15.77:0/3633517451 shutdown_connections 2023-11-04T01:41:48.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:48.848+0000 7fd82759e640 1 -- 172.21.15.77:0/3633517451 wait complete. 2023-11-04T01:41:48.862 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:41:48.862 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:41:48.863 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:41:48.863 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:41:48.864 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:41:48.864 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:41:48.864 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:41:48.864 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:41:48.865 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:41:48.865 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:41:48.865 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:41:48.866 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:41:48.866 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:41:48.866 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:41:48.866 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:41:48.867 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:41:48.873 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:41:48.873 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:41:48.874 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:41:48.875 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:41:48.877 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:41:48.878 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:41:48.879 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:41:48.879 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:41:48.916 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:41:48.917 DEBUG:teuthology.parallel:result is None 2023-11-04T01:41:48.917 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:41:48.918 DEBUG:teuthology.parallel:result is None 2023-11-04T01:41:48.920 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:41:48.920 DEBUG:teuthology.parallel:result is None 2023-11-04T01:41:48.921 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:41:48.921 DEBUG:teuthology.parallel:result is None 2023-11-04T01:41:48.922 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-04T01:41:48.991 INFO:tasks.ceph.mds.a.smithi077.stdout:starting mds.a at 2023-11-04T01:41:48.991 INFO:tasks.ceph.mds.c.smithi077.stdout:starting mds.c at 2023-11-04T01:41:49.006 INFO:tasks.ceph.mds.d.smithi122.stdout:starting mds.d at 2023-11-04T01:41:49.007 INFO:tasks.ceph.mds.b.smithi122.stdout:starting mds.b at 2023-11-04T01:41:49.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.025+0000 7f939234c640 1 Processor -- start 2023-11-04T01:41:49.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.025+0000 7f939234c640 1 -- start start 2023-11-04T01:41:49.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.026+0000 7f939234c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f938c0cd6d0 0x7f938c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:49.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.026+0000 7f938b7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f938c0cd6d0 0x7f938c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:49.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.026+0000 7f93908e9640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f938c0b4880 0x7f938c0d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57082/0 (socket says 172.21.15.77:57082) 2023-11-04T01:41:49.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.026+0000 7f93908e9640 1 -- 172.21.15.77:0/2292549576 learned_addr learned my addr 172.21.15.77:0/2292549576 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:49.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.026+0000 7f939234c640 1 -- 172.21.15.77:0/2292549576 --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f938c0cde60 con 0x7f938c0b4880 2023-11-04T01:41:49.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.026+0000 7f939234c640 1 -- 172.21.15.77:0/2292549576 --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f938c160f90 con 0x7f938c153e60 2023-11-04T01:41:49.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.026+0000 7f939234c640 1 -- 172.21.15.77:0/2292549576 --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f938c161960 con 0x7f938c0cd6d0 2023-11-04T01:41:49.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.027+0000 7f938b7fe640 1 -- 172.21.15.77:0/2292549576 >> v1:172.21.15.122:6789/0 conn(0x7f938c153e60 legacy=0x7f938c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:49.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.027+0000 7f938b7fe640 1 -- 172.21.15.77:0/2292549576 >> v1:172.21.15.77:6789/0 conn(0x7f938c0b4880 legacy=0x7f938c0d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:49.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.027+0000 7f938b7fe640 1 -- 172.21.15.77:0/2292549576 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938c0ce090 con 0x7f938c0cd6d0 2023-11-04T01:41:49.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.028+0000 7f938b7fe640 1 --2- 172.21.15.77:0/2292549576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f938c0cd6d0 0x7f938c161420 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f93800097a0 tx=0x7f938002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a93e0223a707838d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:49.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.029+0000 7f938affd640 1 -- 172.21.15.77:0/2292549576 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9380030610 con 0x7f938c0cd6d0 2023-11-04T01:41:49.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.029+0000 7f938affd640 1 -- 172.21.15.77:0/2292549576 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9380030770 con 0x7f938c0cd6d0 2023-11-04T01:41:49.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.029+0000 7f938affd640 1 -- 172.21.15.77:0/2292549576 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9380030b00 con 0x7f938c0cd6d0 2023-11-04T01:41:49.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.030+0000 7f939234c640 1 -- 172.21.15.77:0/2292549576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f938c0cd6d0 msgr2=0x7f938c161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:49.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.030+0000 7f939234c640 1 --2- 172.21.15.77:0/2292549576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f938c0cd6d0 0x7f938c161420 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f93800097a0 tx=0x7f938002b960 comp rx=0 tx=0).stop 2023-11-04T01:41:49.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.030+0000 7f939234c640 1 -- 172.21.15.77:0/2292549576 shutdown_connections 2023-11-04T01:41:49.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.030+0000 7f939234c640 1 --2- 172.21.15.77:0/2292549576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f938c0cd6d0 0x7f938c161420 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.030+0000 7f939234c640 1 -- 172.21.15.77:0/2292549576 >> 172.21.15.77:0/2292549576 conn(0x7f938c0cf880 msgr2=0x7f938c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:49.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.030+0000 7f939234c640 1 -- 172.21.15.77:0/2292549576 shutdown_connections 2023-11-04T01:41:49.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.030+0000 7f939234c640 1 -- 172.21.15.77:0/2292549576 wait complete. 2023-11-04T01:41:49.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.031+0000 7f939234c640 1 Processor -- start 2023-11-04T01:41:49.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.032+0000 7f939234c640 1 -- start start 2023-11-04T01:41:49.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.032+0000 7f939234c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f938c0b4880 0x7f938c0b3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:49.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.033+0000 7f939234c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f938c0cd6d0 0x7f938c157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:49.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.033+0000 7f939234c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f938c153e60 0x7f938c158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:49.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.033+0000 7f939234c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c0b2d00 con 0x7f938c0cd6d0 2023-11-04T01:41:49.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.033+0000 7f939234c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c158ba0 con 0x7f938c0b4880 2023-11-04T01:41:49.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.033+0000 7f939234c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f938c158270 con 0x7f938c153e60 2023-11-04T01:41:49.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.033+0000 7f938bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f938c0b4880 0x7f938c0b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:49.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.033+0000 7f938bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f938c0b4880 0x7f938c0b3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:50072/0 (socket says 172.21.15.77:50072) 2023-11-04T01:41:49.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.033+0000 7f938bfff640 1 -- 172.21.15.77:0/1572665757 learned_addr learned my addr 172.21.15.77:0/1572665757 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:49.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.033+0000 7f93908e9640 1 --2- 172.21.15.77:0/1572665757 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f938c153e60 0x7f938c158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:49.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.033+0000 7f938b7fe640 1 --2- 172.21.15.77:0/1572665757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f938c0cd6d0 0x7f938c157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:49.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.033+0000 7f93908e9640 1 -- 172.21.15.77:0/1572665757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f938c0b4880 msgr2=0x7f938c0b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:49.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.033+0000 7f93908e9640 1 --2- 172.21.15.77:0/1572665757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f938c0b4880 0x7f938c0b3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.033+0000 7f93908e9640 1 -- 172.21.15.77:0/1572665757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f938c0cd6d0 msgr2=0x7f938c157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:49.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.033+0000 7f93908e9640 1 --2- 172.21.15.77:0/1572665757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f938c0cd6d0 0x7f938c157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:49.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.033+0000 7f93908e9640 1 -- 172.21.15.77:0/1572665757 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9380009400 con 0x7f938c153e60 2023-11-04T01:41:49.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.033+0000 7f938b7fe640 1 --2- 172.21.15.77:0/1572665757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f938c0cd6d0 0x7f938c157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:41:49.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.033+0000 7f93908e9640 1 --2- 172.21.15.77:0/1572665757 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f938c153e60 0x7f938c158660 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f938400cad0 tx=0x7f938400cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:49.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.034+0000 7f9388ff9640 1 -- 172.21.15.77:0/1572665757 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938400ac30 con 0x7f938c153e60 2023-11-04T01:41:49.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.034+0000 7f9388ff9640 1 -- 172.21.15.77:0/1572665757 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938400ad90 con 0x7f938c153e60 2023-11-04T01:41:49.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.034+0000 7f939234c640 1 -- 172.21.15.77:0/1572665757 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f938c0b2360 con 0x7f938c153e60 2023-11-04T01:41:49.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.034+0000 7f9388ff9640 1 -- 172.21.15.77:0/1572665757 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9384012600 con 0x7f938c153e60 2023-11-04T01:41:49.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.034+0000 7f939234c640 1 -- 172.21.15.77:0/1572665757 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f938c0b2920 con 0x7f938c153e60 2023-11-04T01:41:49.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.035+0000 7f939234c640 1 -- 172.21.15.77:0/1572665757 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f938c074290 con 0x7f938c153e60 2023-11-04T01:41:49.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.035+0000 7f9388ff9640 1 -- 172.21.15.77:0/1572665757 <== mon.2 v2:172.21.15.122:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9384007070 con 0x7f938c153e60 2023-11-04T01:41:49.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.035+0000 7f9388ff9640 1 --2- 172.21.15.77:0/1572665757 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f937806ae70 0x7f937806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:49.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.035+0000 7f9388ff9640 1 -- 172.21.15.77:0/1572665757 <== mon.2 v2:172.21.15.122:3301/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f9384089360 con 0x7f938c153e60 2023-11-04T01:41:49.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.036+0000 7f938bfff640 1 --2- 172.21.15.77:0/1572665757 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f937806ae70 0x7f937806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:49.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.036+0000 7f938bfff640 1 --2- 172.21.15.77:0/1572665757 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f937806ae70 0x7f937806d330 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f937c007fd0 tx=0x7f937c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:49.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.043+0000 7f9388ff9640 1 -- 172.21.15.77:0/1572665757 <== mon.2 v2:172.21.15.122:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9384054530 con 0x7f938c153e60 2023-11-04T01:41:49.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:49.220+0000 7f939234c640 1 -- 172.21.15.77:0/1572665757 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f938c0d0b80 con 0x7f938c153e60 2023-11-04T01:41:50.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.048+0000 7f9388ff9640 1 -- 172.21.15.77:0/1572665757 <== mon.2 v2:172.21.15.122:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v50) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9384057b50 con 0x7f938c153e60 2023-11-04T01:41:50.051 INFO:teuthology.orchestra.run.smithi077.stderr: removed all blocklist entries 2023-11-04T01:41:50.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.051+0000 7f939234c640 1 -- 172.21.15.77:0/1572665757 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f937806ae70 msgr2=0x7f937806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:50.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.051+0000 7f939234c640 1 --2- 172.21.15.77:0/1572665757 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f937806ae70 0x7f937806d330 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f937c007fd0 tx=0x7f937c009040 comp rx=0 tx=0).stop 2023-11-04T01:41:50.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.051+0000 7f939234c640 1 -- 172.21.15.77:0/1572665757 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f938c153e60 msgr2=0x7f938c158660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:50.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.051+0000 7f939234c640 1 --2- 172.21.15.77:0/1572665757 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f938c153e60 0x7f938c158660 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f938400cad0 tx=0x7f938400cf90 comp rx=0 tx=0).stop 2023-11-04T01:41:50.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.051+0000 7f939234c640 1 -- 172.21.15.77:0/1572665757 shutdown_connections 2023-11-04T01:41:50.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.051+0000 7f939234c640 1 --2- 172.21.15.77:0/1572665757 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f937806ae70 0x7f937806d330 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.051+0000 7f939234c640 1 --2- 172.21.15.77:0/1572665757 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f938c153e60 0x7f938c158660 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.051+0000 7f939234c640 1 --2- 172.21.15.77:0/1572665757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f938c0cd6d0 0x7f938c157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.051+0000 7f939234c640 1 --2- 172.21.15.77:0/1572665757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f938c0b4880 0x7f938c0b3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.051+0000 7f939234c640 1 -- 172.21.15.77:0/1572665757 >> 172.21.15.77:0/1572665757 conn(0x7f938c0cf880 msgr2=0x7f938c15fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:50.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.051+0000 7f939234c640 1 -- 172.21.15.77:0/1572665757 shutdown_connections 2023-11-04T01:41:50.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.051+0000 7f939234c640 1 -- 172.21.15.77:0/1572665757 wait complete. 2023-11-04T01:41:50.064 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-04T01:41:50.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.166+0000 7f5ae51a5640 1 Processor -- start 2023-11-04T01:41:50.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.166+0000 7f5ae51a5640 1 -- start start 2023-11-04T01:41:50.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.166+0000 7f5ae51a5640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5ae00b0ae0 0x7f5ae00ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.166+0000 7f5ae51a5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ae00b4110 con 0x7f5ae0159c70 2023-11-04T01:41:50.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.166+0000 7f5ae51a5640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ae00b43f0 con 0x7f5ae006db20 2023-11-04T01:41:50.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.166+0000 7f5ae51a5640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ae00b49b0 con 0x7f5ae00b0ae0 2023-11-04T01:41:50.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.167+0000 7f5aded9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f5ae0159c70 0x7f5ae00b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57084/0 (socket says 172.21.15.77:57084) 2023-11-04T01:41:50.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.167+0000 7f5aded9d640 1 -- 172.21.15.77:0/3427165429 learned_addr learned my addr 172.21.15.77:0/3427165429 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:50.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.167+0000 7f5addd9b640 1 -- 172.21.15.77:0/3427165429 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2115202471 0 0) 0x7f5ae00b4110 con 0x7f5ae0159c70 2023-11-04T01:41:50.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.167+0000 7f5addd9b640 1 -- 172.21.15.77:0/3427165429 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ac8003520 con 0x7f5ae0159c70 2023-11-04T01:41:50.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.167+0000 7f5ade59c640 1 --2- 172.21.15.77:0/3427165429 >> v2:172.21.15.122:3300/0 conn(0x7f5ae00b0ae0 0x7f5ae00ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.167+0000 7f5addd9b640 1 -- 172.21.15.77:0/3427165429 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2383523978 0 0) 0x7f5ac8003520 con 0x7f5ae0159c70 2023-11-04T01:41:50.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.167+0000 7f5addd9b640 1 -- 172.21.15.77:0/3427165429 >> v2:172.21.15.122:3300/0 conn(0x7f5ae00b0ae0 msgr2=0x7f5ae00ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:50.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.167+0000 7f5addd9b640 1 --2- 172.21.15.77:0/3427165429 >> v2:172.21.15.122:3300/0 conn(0x7f5ae00b0ae0 0x7f5ae00ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.167+0000 7f5addd9b640 1 -- 172.21.15.77:0/3427165429 >> v1:172.21.15.122:6789/0 conn(0x7f5ae006db20 legacy=0x7f5ae015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:50.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.167+0000 7f5addd9b640 1 -- 172.21.15.77:0/3427165429 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae00b46d0 con 0x7f5ae0159c70 2023-11-04T01:41:50.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.167+0000 7f5addd9b640 1 -- 172.21.15.77:0/3427165429 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f5ad0001670 con 0x7f5ae0159c70 2023-11-04T01:41:50.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.167+0000 7f5addd9b640 1 -- 172.21.15.77:0/3427165429 >> v1:172.21.15.77:6789/0 conn(0x7f5ae0159c70 legacy=0x7f5ae00b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:50.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.167+0000 7f5addd9b640 1 --2- 172.21.15.77:0/3427165429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ac8003970 0x7f5ac8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.167+0000 7f5addd9b640 1 --2- 172.21.15.77:0/3427165429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ac80047c0 0x7f5ac8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.167+0000 7f5addd9b640 1 --2- 172.21.15.77:0/3427165429 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ac8005180 0x7f5ac800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.167+0000 7f5addd9b640 1 -- 172.21.15.77:0/3427165429 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae00b49b0 con 0x7f5ac80047c0 2023-11-04T01:41:50.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.167+0000 7f5addd9b640 1 -- 172.21.15.77:0/3427165429 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac800c0d0 con 0x7f5ac8003970 2023-11-04T01:41:50.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.167+0000 7f5addd9b640 1 -- 172.21.15.77:0/3427165429 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac800c290 con 0x7f5ac8005180 2023-11-04T01:41:50.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.167+0000 7f5ade59c640 1 --2- 172.21.15.77:0/3427165429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ac80047c0 0x7f5ac8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.167+0000 7f5aded9d640 1 --2- 172.21.15.77:0/3427165429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ac8003970 0x7f5ac8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.167+0000 7f5adf59e640 1 --2- 172.21.15.77:0/3427165429 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ac8005180 0x7f5ac800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.167+0000 7f5ade59c640 1 -- 172.21.15.77:0/3427165429 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ac8005180 msgr2=0x7f5ac800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:50.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.167+0000 7f5ade59c640 1 --2- 172.21.15.77:0/3427165429 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ac8005180 0x7f5ac800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.168+0000 7f5ade59c640 1 -- 172.21.15.77:0/3427165429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ac8003970 msgr2=0x7f5ac8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:50.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.168+0000 7f5ade59c640 1 --2- 172.21.15.77:0/3427165429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ac8003970 0x7f5ac8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.168+0000 7f5ade59c640 1 -- 172.21.15.77:0/3427165429 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac8003520 con 0x7f5ac80047c0 2023-11-04T01:41:50.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.168+0000 7f5adf59e640 1 -- 172.21.15.77:0/3427165429 reap_dead start 2023-11-04T01:41:50.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.168+0000 7f5aded9d640 1 --2- 172.21.15.77:0/3427165429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ac8003970 0x7f5ac8003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:50.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.168+0000 7f5ade59c640 1 --2- 172.21.15.77:0/3427165429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ac80047c0 0x7f5ac8004c40 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f5ad400ba30 tx=0x7f5ac80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd26b30a1b09293 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:50.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.168+0000 7f5addd9b640 1 -- 172.21.15.77:0/3427165429 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4032640 con 0x7f5ac80047c0 2023-11-04T01:41:50.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.168+0000 7f5addd9b640 1 -- 172.21.15.77:0/3427165429 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad40327a0 con 0x7f5ac80047c0 2023-11-04T01:41:50.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.168+0000 7f5addd9b640 1 -- 172.21.15.77:0/3427165429 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4032b30 con 0x7f5ac80047c0 2023-11-04T01:41:50.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.169+0000 7f5ae51a5640 1 -- 172.21.15.77:0/3427165429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ac80047c0 msgr2=0x7f5ac8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:50.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.169+0000 7f5ae51a5640 1 --2- 172.21.15.77:0/3427165429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ac80047c0 0x7f5ac8004c40 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f5ad400ba30 tx=0x7f5ac80057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.169+0000 7f5ae51a5640 1 -- 172.21.15.77:0/3427165429 shutdown_connections 2023-11-04T01:41:50.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.169+0000 7f5ae51a5640 1 --2- 172.21.15.77:0/3427165429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ac80047c0 0x7f5ac8004c40 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.169+0000 7f5ae51a5640 1 -- 172.21.15.77:0/3427165429 >> 172.21.15.77:0/3427165429 conn(0x7f5ae00ce950 msgr2=0x7f5ae00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:50.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.169+0000 7f5ae51a5640 1 -- 172.21.15.77:0/3427165429 shutdown_connections 2023-11-04T01:41:50.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.169+0000 7f5ae51a5640 1 -- 172.21.15.77:0/3427165429 wait complete. 2023-11-04T01:41:50.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.170+0000 7f5ae51a5640 1 Processor -- start 2023-11-04T01:41:50.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.170+0000 7f5ae51a5640 1 -- start start 2023-11-04T01:41:50.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.171+0000 7f5ae51a5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ac80047c0 0x7f5ae01ee920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.171+0000 7f5ae51a5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ae014e070 0x7f5ae00c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.171+0000 7f5ae51a5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ae0152840 0x7f5ae0152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.171+0000 7f5ae51a5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae0153200 con 0x7f5ae014e070 2023-11-04T01:41:50.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.171+0000 7f5ae51a5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae014e4f0 con 0x7f5ac80047c0 2023-11-04T01:41:50.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.171+0000 7f5ae51a5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae014fa40 con 0x7f5ae0152840 2023-11-04T01:41:50.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.171+0000 7f5ade59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ae014e070 0x7f5ae00c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.171+0000 7f5ade59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ae014e070 0x7f5ae00c88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54622/0 (socket says 172.21.15.77:54622) 2023-11-04T01:41:50.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.171+0000 7f5ade59c640 1 -- 172.21.15.77:0/2422276528 learned_addr learned my addr 172.21.15.77:0/2422276528 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:50.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.171+0000 7f5aded9d640 1 --2- 172.21.15.77:0/2422276528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ac80047c0 0x7f5ae01ee920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.171+0000 7f5adf59e640 1 --2- 172.21.15.77:0/2422276528 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ae0152840 0x7f5ae0152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.171+0000 7f5ade59c640 1 -- 172.21.15.77:0/2422276528 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ae0152840 msgr2=0x7f5ae0152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:50.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.171+0000 7f5ade59c640 1 --2- 172.21.15.77:0/2422276528 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ae0152840 0x7f5ae0152cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.171+0000 7f5ade59c640 1 -- 172.21.15.77:0/2422276528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ac80047c0 msgr2=0x7f5ae01ee920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:50.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.171+0000 7f5ade59c640 1 --2- 172.21.15.77:0/2422276528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ac80047c0 0x7f5ae01ee920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.171+0000 7f5ade59c640 1 -- 172.21.15.77:0/2422276528 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae01eef70 con 0x7f5ae014e070 2023-11-04T01:41:50.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.172+0000 7f5ade59c640 1 --2- 172.21.15.77:0/2422276528 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ae014e070 0x7f5ae00c88f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f5ad402bf90 tx=0x7f5ad4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:50.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.172+0000 7f5ac77fe640 1 -- 172.21.15.77:0/2422276528 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4004220 con 0x7f5ae014e070 2023-11-04T01:41:50.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.172+0000 7f5ac77fe640 1 -- 172.21.15.77:0/2422276528 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad40043a0 con 0x7f5ae014e070 2023-11-04T01:41:50.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.172+0000 7f5ae51a5640 1 -- 172.21.15.77:0/2422276528 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae01ef250 con 0x7f5ae014e070 2023-11-04T01:41:50.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.172+0000 7f5ac77fe640 1 -- 172.21.15.77:0/2422276528 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad403ca80 con 0x7f5ae014e070 2023-11-04T01:41:50.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.172+0000 7f5ae51a5640 1 -- 172.21.15.77:0/2422276528 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae01ef810 con 0x7f5ae014e070 2023-11-04T01:41:50.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.173+0000 7f5ae51a5640 1 -- 172.21.15.77:0/2422276528 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ae014fb80 con 0x7f5ae014e070 2023-11-04T01:41:50.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.173+0000 7f5ac77fe640 1 -- 172.21.15.77:0/2422276528 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5ad403cbe0 con 0x7f5ae014e070 2023-11-04T01:41:50.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.173+0000 7f5ac77fe640 1 --2- 172.21.15.77:0/2422276528 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5acc06aea0 0x7f5acc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.174+0000 7f5ac77fe640 1 -- 172.21.15.77:0/2422276528 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f5ad40abdf0 con 0x7f5ae014e070 2023-11-04T01:41:50.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.174+0000 7f5aded9d640 1 --2- 172.21.15.77:0/2422276528 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5acc06aea0 0x7f5acc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.174+0000 7f5aded9d640 1 --2- 172.21.15.77:0/2422276528 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5acc06aea0 0x7f5acc06d360 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5ae01521a0 tx=0x7f5ad0007040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:50.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.178+0000 7f5ac77fe640 1 -- 172.21.15.77:0/2422276528 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5ae014fb80 con 0x7f5ae014e070 2023-11-04T01:41:50.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.408+0000 7f5ae51a5640 1 -- 172.21.15.77:0/2422276528 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f5ae014fb80 con 0x7f5ae014e070 2023-11-04T01:41:50.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.409+0000 7f5ac77fe640 1 -- 172.21.15.77:0/2422276528 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f5ae014fb80 con 0x7f5ae014e070 2023-11-04T01:41:50.411 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:50.411 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-04T01:41:50.411 INFO:teuthology.orchestra.run.smithi077.stdout: "auth_dump": [ 2023-11-04T01:41:50.411 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:50.412 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.a", 2023-11-04T01:41:50.412 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC1oEVl/r6uOhAA9u5Hcsr4T+QfSgBmS6M2Cw==", 2023-11-04T01:41:50.412 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:50.412 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:41:50.413 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-04T01:41:50.413 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-04T01:41:50.413 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:41:50.413 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:50.413 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:50.413 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:50.414 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.b", 2023-11-04T01:41:50.414 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC2oEVlOr56CxAAxOke25BrKTy0Vozn/aPYVw==", 2023-11-04T01:41:50.414 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:50.414 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:41:50.414 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-04T01:41:50.415 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-04T01:41:50.415 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:41:50.415 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:50.415 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:50.415 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:50.416 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.c", 2023-11-04T01:41:50.416 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC2oEVlvLxtBhAAuxQpEPrSlVc/YBdqJJn7iA==", 2023-11-04T01:41:50.416 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:50.416 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:41:50.417 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-04T01:41:50.417 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-04T01:41:50.417 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:41:50.417 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:50.417 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:50.417 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:50.418 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.d", 2023-11-04T01:41:50.418 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC2oEVlB3PUEhAA0GaPLq/SwHPPHriYNnan9w==", 2023-11-04T01:41:50.418 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:50.418 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:41:50.418 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-04T01:41:50.419 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-04T01:41:50.419 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:41:50.419 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:50.419 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:50.419 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:50.420 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.0", 2023-11-04T01:41:50.420 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC5oEVl4pfcMxAATPwL4pgDM0ywnmsufp74lw==", 2023-11-04T01:41:50.420 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:50.420 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:41:50.420 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:41:50.421 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:41:50.421 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:50.421 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:50.421 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:50.421 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.1", 2023-11-04T01:41:50.422 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC8oEVl+qN4MhAAXZweqA2M4vvc4B04adonzQ==", 2023-11-04T01:41:50.422 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:50.422 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:41:50.422 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:41:50.422 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:41:50.423 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:50.423 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:50.423 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:50.423 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.2", 2023-11-04T01:41:50.423 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC/oEVlRuD4MBAAQPQL0SzC7Cj9bzR/Cj+maA==", 2023-11-04T01:41:50.424 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:50.424 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:41:50.424 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:41:50.424 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:41:50.424 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:50.425 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:50.425 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:50.425 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.3", 2023-11-04T01:41:50.425 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDCoEVlDO4fLxAASTTEpVp1dzEEci56OfSEMA==", 2023-11-04T01:41:50.425 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:50.426 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:41:50.426 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:41:50.426 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:41:50.426 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:50.427 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:50.427 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:50.427 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.4", 2023-11-04T01:41:50.427 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDIoEVlQGrxOBAACkSdOwyqhcMBPhXbpdXFKw==", 2023-11-04T01:41:50.427 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:50.428 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:41:50.428 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:41:50.428 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:41:50.428 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:50.428 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:50.429 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:50.429 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.5", 2023-11-04T01:41:50.429 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDLoEVlTrCoNhAAoLM/rpHPTO6H6eXr8so/pA==", 2023-11-04T01:41:50.429 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:50.429 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:41:50.430 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:41:50.430 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:41:50.430 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:50.430 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:50.430 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:50.431 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.6", 2023-11-04T01:41:50.431 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDOoEVlb81bNRAAp8gIPrPxc9T8yp9Z8JJm8g==", 2023-11-04T01:41:50.431 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:50.431 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:41:50.431 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:41:50.432 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:41:50.432 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:50.432 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:50.432 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:50.432 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.7", 2023-11-04T01:41:50.432 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDRoEVl2aM/NBAAbi6ZxsZ51qe78O1oaSpF8Q==", 2023-11-04T01:41:50.433 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:50.433 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:41:50.433 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:41:50.433 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:41:50.433 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:50.434 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:50.434 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:50.434 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.0", 2023-11-04T01:41:50.434 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC2oEVlChU2FxAAt1/aJZOrufjVZhraPqv1Gw==", 2023-11-04T01:41:50.435 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:50.435 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:41:50.435 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow r", 2023-11-04T01:41:50.435 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-04T01:41:50.435 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:50.436 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:50.436 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:50.436 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.1", 2023-11-04T01:41:50.436 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC2oEVlVY9FIBAAUiGoYvAgEDfoAKIJ9e/SOg==", 2023-11-04T01:41:50.436 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:50.437 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:41:50.437 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-11-04T01:41:50.437 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-11-04T01:41:50.437 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-11-04T01:41:50.437 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:50.438 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:50.438 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:50.438 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.2", 2023-11-04T01:41:50.438 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC2oEVliWLuHBAA7ElluXYK9/XvMXk4S1njJw==", 2023-11-04T01:41:50.438 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:50.439 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:41:50.439 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-11-04T01:41:50.439 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-11-04T01:41:50.439 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-11-04T01:41:50.439 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:50.439 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:50.440 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:50.440 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.3", 2023-11-04T01:41:50.440 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC2oEVlQ3QIJhAA5Fq/oI3qpJseGhwXV66eMA==", 2023-11-04T01:41:50.440 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:50.440 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:41:50.441 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-11-04T01:41:50.441 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-11-04T01:41:50.441 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-11-04T01:41:50.441 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:50.441 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:50.442 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:50.442 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.admin", 2023-11-04T01:41:50.442 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC1oEVlhrFGHhAA5nkKwuaaUv+zDDAG4XaBRQ==", 2023-11-04T01:41:50.442 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:50.442 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow *", 2023-11-04T01:41:50.443 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-04T01:41:50.443 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-04T01:41:50.443 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:41:50.443 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:50.443 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:50.443 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:50.444 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mgr.x", 2023-11-04T01:41:50.444 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC1oEVlvoNGNxAAB5/uyqV4Pf/HdyGcr8rVdw==", 2023-11-04T01:41:50.444 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:50.444 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow *", 2023-11-04T01:41:50.444 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile mgr", 2023-11-04T01:41:50.445 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:41:50.445 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:50.445 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:50.445 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:50.445 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mgr.y", 2023-11-04T01:41:50.446 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC1oEVlXDKNMxAAVhq0CA3RveLfU4A6oIO4jQ==", 2023-11-04T01:41:50.446 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:41:50.446 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow *", 2023-11-04T01:41:50.446 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile mgr", 2023-11-04T01:41:50.447 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:41:50.447 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:50.447 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:50.447 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2023-11-04T01:41:50.447 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-04T01:41:50.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.410+0000 7f5ae51a5640 1 -- 172.21.15.77:0/2422276528 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5acc06aea0 msgr2=0x7f5acc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:50.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.410+0000 7f5ae51a5640 1 --2- 172.21.15.77:0/2422276528 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5acc06aea0 0x7f5acc06d360 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5ae01521a0 tx=0x7f5ad0007040 comp rx=0 tx=0).stop 2023-11-04T01:41:50.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.410+0000 7f5ae51a5640 1 -- 172.21.15.77:0/2422276528 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ae014e070 msgr2=0x7f5ae00c88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:50.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.410+0000 7f5ae51a5640 1 --2- 172.21.15.77:0/2422276528 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ae014e070 0x7f5ae00c88f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f5ad402bf90 tx=0x7f5ad4004730 comp rx=0 tx=0).stop 2023-11-04T01:41:50.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.410+0000 7f5ae51a5640 1 -- 172.21.15.77:0/2422276528 shutdown_connections 2023-11-04T01:41:50.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.410+0000 7f5ae51a5640 1 --2- 172.21.15.77:0/2422276528 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5acc06aea0 0x7f5acc06d360 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.410+0000 7f5ae51a5640 1 --2- 172.21.15.77:0/2422276528 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ae0152840 0x7f5ae0152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.410+0000 7f5ae51a5640 1 --2- 172.21.15.77:0/2422276528 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ae014e070 0x7f5ae00c88f0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.410+0000 7f5ae51a5640 1 --2- 172.21.15.77:0/2422276528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ac80047c0 0x7f5ae01ee920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.410+0000 7f5ae51a5640 1 -- 172.21.15.77:0/2422276528 >> 172.21.15.77:0/2422276528 conn(0x7f5ae00ce950 msgr2=0x7f5ae00b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:50.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.411+0000 7f5ae51a5640 1 -- 172.21.15.77:0/2422276528 shutdown_connections 2023-11-04T01:41:50.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.411+0000 7f5ae51a5640 1 -- 172.21.15.77:0/2422276528 wait complete. 2023-11-04T01:41:50.452 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:50.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.549+0000 7f28a1d73640 1 Processor -- start 2023-11-04T01:41:50.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.549+0000 7f28a1d73640 1 -- start start 2023-11-04T01:41:50.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.550+0000 7f28a1d73640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f289c159c70 0x7f289c0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.550+0000 7f28a1d73640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f289c0b0ae0 0x7f289c15d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.550+0000 7f28a1d73640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f289c0b4110 con 0x7f289c06db20 2023-11-04T01:41:50.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.550+0000 7f28a1d73640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f289c0b49b0 con 0x7f289c159c70 2023-11-04T01:41:50.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.550+0000 7f28a1d73640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f289c0b43f0 con 0x7f289c0b0ae0 2023-11-04T01:41:50.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.550+0000 7f289b7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f289c159c70 0x7f289c0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.550+0000 7f289b7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f289c159c70 0x7f289c0ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54624/0 (socket says 172.21.15.77:54624) 2023-11-04T01:41:50.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.550+0000 7f289b7fe640 1 -- 172.21.15.77:0/1180858114 learned_addr learned my addr 172.21.15.77:0/1180858114 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:50.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.550+0000 7f289bfff640 1 --2- 172.21.15.77:0/1180858114 >> v2:172.21.15.122:3300/0 conn(0x7f289c0b0ae0 0x7f289c15d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.550+0000 7f289b7fe640 1 -- 172.21.15.77:0/1180858114 >> v2:172.21.15.122:3300/0 conn(0x7f289c0b0ae0 msgr2=0x7f289c15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:50.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.550+0000 7f289b7fe640 1 --2- 172.21.15.77:0/1180858114 >> v2:172.21.15.122:3300/0 conn(0x7f289c0b0ae0 0x7f289c15d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.550+0000 7f289b7fe640 1 -- 172.21.15.77:0/1180858114 >> v1:172.21.15.122:6789/0 conn(0x7f289c06db20 legacy=0x7f289c0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:50.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.550+0000 7f289b7fe640 1 -- 172.21.15.77:0/1180858114 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289c0b46d0 con 0x7f289c159c70 2023-11-04T01:41:50.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.551+0000 7f289b7fe640 1 --2- 172.21.15.77:0/1180858114 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f289c159c70 0x7f289c0ce370 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f289c0c5910 tx=0x7f288c02e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9375dfa17184abfc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:50.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.551+0000 7f289a7fc640 1 -- 172.21.15.77:0/1180858114 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c02ee90 con 0x7f289c159c70 2023-11-04T01:41:50.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.551+0000 7f289a7fc640 1 -- 172.21.15.77:0/1180858114 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288c036440 con 0x7f289c159c70 2023-11-04T01:41:50.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.551+0000 7f289a7fc640 1 -- 172.21.15.77:0/1180858114 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c0367d0 con 0x7f289c159c70 2023-11-04T01:41:50.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.551+0000 7f28a1d73640 1 -- 172.21.15.77:0/1180858114 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f289c159c70 msgr2=0x7f289c0ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:50.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.551+0000 7f28a1d73640 1 --2- 172.21.15.77:0/1180858114 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f289c159c70 0x7f289c0ce370 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f289c0c5910 tx=0x7f288c02e0e0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.551+0000 7f28a1d73640 1 -- 172.21.15.77:0/1180858114 shutdown_connections 2023-11-04T01:41:50.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.551+0000 7f28a1d73640 1 --2- 172.21.15.77:0/1180858114 >> v2:172.21.15.122:3300/0 conn(0x7f289c0b0ae0 0x7f289c15d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.551+0000 7f28a1d73640 1 --2- 172.21.15.77:0/1180858114 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f289c159c70 0x7f289c0ce370 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.551+0000 7f28a1d73640 1 -- 172.21.15.77:0/1180858114 >> 172.21.15.77:0/1180858114 conn(0x7f289c0ce950 msgr2=0x7f289c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:50.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.552+0000 7f28a1d73640 1 -- 172.21.15.77:0/1180858114 shutdown_connections 2023-11-04T01:41:50.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.552+0000 7f28a1d73640 1 -- 172.21.15.77:0/1180858114 wait complete. 2023-11-04T01:41:50.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.553+0000 7f28a1d73640 1 Processor -- start 2023-11-04T01:41:50.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.553+0000 7f28a1d73640 1 -- start start 2023-11-04T01:41:50.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.553+0000 7f28a1d73640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f289c06db20 0x7f289c1f2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.553+0000 7f28a1d73640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f289c0b0ae0 0x7f289c0cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.553+0000 7f28a1d73640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f289c159c70 0x7f289c0ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.554+0000 7f28a1d73640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289c14f800 con 0x7f289c0b0ae0 2023-11-04T01:41:50.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.554+0000 7f28a1d73640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289c1552f0 con 0x7f289c159c70 2023-11-04T01:41:50.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.554+0000 7f28a1d73640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289c14fa50 con 0x7f289c06db20 2023-11-04T01:41:50.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.554+0000 7f289affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f289c0b0ae0 0x7f289c0cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.554+0000 7f289affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f289c0b0ae0 0x7f289c0cc6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54632/0 (socket says 172.21.15.77:54632) 2023-11-04T01:41:50.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.554+0000 7f289affd640 1 -- 172.21.15.77:0/2495284397 learned_addr learned my addr 172.21.15.77:0/2495284397 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:50.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.554+0000 7f289b7fe640 1 --2- 172.21.15.77:0/2495284397 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f289c06db20 0x7f289c1f2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.554+0000 7f289bfff640 1 --2- 172.21.15.77:0/2495284397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f289c159c70 0x7f289c0ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.554+0000 7f289affd640 1 -- 172.21.15.77:0/2495284397 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f289c06db20 msgr2=0x7f289c1f2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:50.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.554+0000 7f289affd640 1 --2- 172.21.15.77:0/2495284397 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f289c06db20 0x7f289c1f2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.554+0000 7f289affd640 1 -- 172.21.15.77:0/2495284397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f289c159c70 msgr2=0x7f289c0ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:50.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.554+0000 7f289affd640 1 --2- 172.21.15.77:0/2495284397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f289c159c70 0x7f289c0ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.554+0000 7f289affd640 1 -- 172.21.15.77:0/2495284397 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288c00b770 con 0x7f289c0b0ae0 2023-11-04T01:41:50.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.554+0000 7f289bfff640 1 --2- 172.21.15.77:0/2495284397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f289c159c70 0x7f289c0ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:50.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.554+0000 7f289affd640 1 --2- 172.21.15.77:0/2495284397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f289c0b0ae0 0x7f289c0cc6d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f289000b3f0 tx=0x7f289000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:50.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.554+0000 7f2883fff640 1 -- 172.21.15.77:0/2495284397 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2890011830 con 0x7f289c0b0ae0 2023-11-04T01:41:50.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.554+0000 7f2883fff640 1 -- 172.21.15.77:0/2495284397 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2890011990 con 0x7f289c0b0ae0 2023-11-04T01:41:50.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.554+0000 7f28a1d73640 1 -- 172.21.15.77:0/2495284397 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f289c14fd30 con 0x7f289c0b0ae0 2023-11-04T01:41:50.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.554+0000 7f2883fff640 1 -- 172.21.15.77:0/2495284397 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2890011d40 con 0x7f289c0b0ae0 2023-11-04T01:41:50.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.554+0000 7f28a1d73640 1 -- 172.21.15.77:0/2495284397 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f289c1f2860 con 0x7f289c0b0ae0 2023-11-04T01:41:50.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.555+0000 7f28a1d73640 1 -- 172.21.15.77:0/2495284397 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f289c150250 con 0x7f289c0b0ae0 2023-11-04T01:41:50.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.556+0000 7f2883fff640 1 -- 172.21.15.77:0/2495284397 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f289001a400 con 0x7f289c0b0ae0 2023-11-04T01:41:50.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.556+0000 7f2883fff640 1 --2- 172.21.15.77:0/2495284397 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f288806aea0 0x7f288806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.556+0000 7f2883fff640 1 -- 172.21.15.77:0/2495284397 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f2890089360 con 0x7f289c0b0ae0 2023-11-04T01:41:50.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.556+0000 7f289b7fe640 1 --2- 172.21.15.77:0/2495284397 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f288806aea0 0x7f288806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.556+0000 7f289b7fe640 1 --2- 172.21.15.77:0/2495284397 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f288806aea0 0x7f288806d360 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f288c038000 tx=0x7f288c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:50.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.560+0000 7f2883fff640 1 -- 172.21.15.77:0/2495284397 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f289c150250 con 0x7f289c0b0ae0 2023-11-04T01:41:50.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.728+0000 7f28a1d73640 1 -- 172.21.15.77:0/2495284397 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f289c150250 con 0x7f289c0b0ae0 2023-11-04T01:41:50.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.729+0000 7f2883fff640 1 -- 172.21.15.77:0/2495284397 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+14803 (secure 0 0 0) 0x7f289c150250 con 0x7f289c0b0ae0 2023-11-04T01:41:50.731 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:50.731 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":50,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:41:50.040650+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:50.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.731+0000 7f28a1d73640 1 -- 172.21.15.77:0/2495284397 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f288806aea0 msgr2=0x7f288806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:50.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.731+0000 7f28a1d73640 1 --2- 172.21.15.77:0/2495284397 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f288806aea0 0x7f288806d360 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f288c038000 tx=0x7f288c008040 comp rx=0 tx=0).stop 2023-11-04T01:41:50.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.731+0000 7f28a1d73640 1 -- 172.21.15.77:0/2495284397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f289c0b0ae0 msgr2=0x7f289c0cc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:50.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.731+0000 7f28a1d73640 1 --2- 172.21.15.77:0/2495284397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f289c0b0ae0 0x7f289c0cc6d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f289000b3f0 tx=0x7f289000b8b0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.731+0000 7f28a1d73640 1 -- 172.21.15.77:0/2495284397 shutdown_connections 2023-11-04T01:41:50.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.731+0000 7f28a1d73640 1 --2- 172.21.15.77:0/2495284397 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f288806aea0 0x7f288806d360 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.731+0000 7f28a1d73640 1 --2- 172.21.15.77:0/2495284397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f289c159c70 0x7f289c0ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.731+0000 7f28a1d73640 1 --2- 172.21.15.77:0/2495284397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f289c0b0ae0 0x7f289c0cc6d0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.731+0000 7f28a1d73640 1 --2- 172.21.15.77:0/2495284397 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f289c06db20 0x7f289c1f2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.731+0000 7f28a1d73640 1 -- 172.21.15.77:0/2495284397 >> 172.21.15.77:0/2495284397 conn(0x7f289c0ce950 msgr2=0x7f289c0b1570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:50.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.731+0000 7f28a1d73640 1 -- 172.21.15.77:0/2495284397 shutdown_connections 2023-11-04T01:41:50.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.731+0000 7f28a1d73640 1 -- 172.21.15.77:0/2495284397 wait complete. 2023-11-04T01:41:50.744 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:33.142176+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:41:50.745 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:41:50.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.845+0000 7f61e21d7640 1 Processor -- start 2023-11-04T01:41:50.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.845+0000 7f61e21d7640 1 -- start start 2023-11-04T01:41:50.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.846+0000 7f61e21d7640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f61dc153e60 0x7f61dc15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.846+0000 7f61e21d7640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f61dc0cd6d0 0x7f61dc161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.846+0000 7f61e21d7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f61dc0b4880 0x7f61dc0b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.846+0000 7f61e21d7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61dc0cde60 con 0x7f61dc0b4880 2023-11-04T01:41:50.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.846+0000 7f61e21d7640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61dc160f90 con 0x7f61dc153e60 2023-11-04T01:41:50.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.846+0000 7f61e21d7640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc0b51e0 con 0x7f61dc0cd6d0 2023-11-04T01:41:50.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.846+0000 7f61dbfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f61dc0b4880 0x7f61dc0b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.846+0000 7f61dbfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f61dc0b4880 0x7f61dc0b4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54650/0 (socket says 172.21.15.77:54650) 2023-11-04T01:41:50.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.846+0000 7f61dbfff640 1 -- 172.21.15.77:0/3290579344 learned_addr learned my addr 172.21.15.77:0/3290579344 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:50.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.847+0000 7f61dbfff640 1 -- 172.21.15.77:0/3290579344 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f61dc0cd6d0 msgr2=0x7f61dc161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:50.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.847+0000 7f61dbfff640 1 --2- 172.21.15.77:0/3290579344 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f61dc0cd6d0 0x7f61dc161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.847+0000 7f61dbfff640 1 -- 172.21.15.77:0/3290579344 >> v2:172.21.15.122:3300/0 conn(0x7f61dc153e60 msgr2=0x7f61dc15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:50.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.847+0000 7f61dbfff640 1 --2- 172.21.15.77:0/3290579344 >> v2:172.21.15.122:3300/0 conn(0x7f61dc153e60 0x7f61dc15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.847+0000 7f61dbfff640 1 -- 172.21.15.77:0/3290579344 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61dc15e400 con 0x7f61dc0b4880 2023-11-04T01:41:50.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.847+0000 7f61dbfff640 1 --2- 172.21.15.77:0/3290579344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61dc0b4880 0x7f61dc0b4ca0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f61dc08abe0 tx=0x7f61d402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=310f2001ebc0fc33 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:50.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.847+0000 7f61da7fc640 1 -- 172.21.15.77:0/3290579344 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d402ca70 con 0x7f61dc0b4880 2023-11-04T01:41:50.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.848+0000 7f61da7fc640 1 -- 172.21.15.77:0/3290579344 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d402cbd0 con 0x7f61dc0b4880 2023-11-04T01:41:50.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.848+0000 7f61da7fc640 1 -- 172.21.15.77:0/3290579344 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d40343f0 con 0x7f61dc0b4880 2023-11-04T01:41:50.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.848+0000 7f61e21d7640 1 -- 172.21.15.77:0/3290579344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61dc0b4880 msgr2=0x7f61dc0b4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:50.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.848+0000 7f61e21d7640 1 --2- 172.21.15.77:0/3290579344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61dc0b4880 0x7f61dc0b4ca0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f61dc08abe0 tx=0x7f61d402bed0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.848+0000 7f61e21d7640 1 -- 172.21.15.77:0/3290579344 shutdown_connections 2023-11-04T01:41:50.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.848+0000 7f61e21d7640 1 --2- 172.21.15.77:0/3290579344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61dc0b4880 0x7f61dc0b4ca0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.848+0000 7f61e21d7640 1 --2- 172.21.15.77:0/3290579344 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f61dc0cd6d0 0x7f61dc161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.848+0000 7f61e21d7640 1 --2- 172.21.15.77:0/3290579344 >> v2:172.21.15.122:3300/0 conn(0x7f61dc153e60 0x7f61dc15dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.848+0000 7f61e21d7640 1 -- 172.21.15.77:0/3290579344 >> 172.21.15.77:0/3290579344 conn(0x7f61dc0cf880 msgr2=0x7f61dc0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:50.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.848+0000 7f61e21d7640 1 -- 172.21.15.77:0/3290579344 shutdown_connections 2023-11-04T01:41:50.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.848+0000 7f61e21d7640 1 -- 172.21.15.77:0/3290579344 wait complete. 2023-11-04T01:41:50.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.849+0000 7f61e21d7640 1 Processor -- start 2023-11-04T01:41:50.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.849+0000 7f61e21d7640 1 -- start start 2023-11-04T01:41:50.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.850+0000 7f61e21d7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61dc0b4880 0x7f61dc0caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.850+0000 7f61e21d7640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f61dc0cd6d0 0x7f61dc1f1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.850+0000 7f61e21d7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61dc153e60 0x7f61dc157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.850+0000 7f61e21d7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc0cb460 con 0x7f61dc0b4880 2023-11-04T01:41:50.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.850+0000 7f61e21d7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc0cb700 con 0x7f61dc153e60 2023-11-04T01:41:50.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.850+0000 7f61e21d7640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc0cb9e0 con 0x7f61dc0cd6d0 2023-11-04T01:41:50.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.850+0000 7f61db7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61dc0b4880 0x7f61dc0caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.850+0000 7f61db7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61dc0b4880 0x7f61dc0caf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54652/0 (socket says 172.21.15.77:54652) 2023-11-04T01:41:50.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.850+0000 7f61db7fe640 1 -- 172.21.15.77:0/878363312 learned_addr learned my addr 172.21.15.77:0/878363312 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:50.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.850+0000 7f61dbfff640 1 --2- 172.21.15.77:0/878363312 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61dc153e60 0x7f61dc157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.850+0000 7f61daffd640 1 --2- 172.21.15.77:0/878363312 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f61dc0cd6d0 0x7f61dc1f1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.850+0000 7f61db7fe640 1 -- 172.21.15.77:0/878363312 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f61dc0cd6d0 msgr2=0x7f61dc1f1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:50.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.850+0000 7f61db7fe640 1 --2- 172.21.15.77:0/878363312 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f61dc0cd6d0 0x7f61dc1f1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.850+0000 7f61db7fe640 1 -- 172.21.15.77:0/878363312 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61dc153e60 msgr2=0x7f61dc157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:50.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.850+0000 7f61db7fe640 1 --2- 172.21.15.77:0/878363312 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61dc153e60 0x7f61dc157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:50.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.850+0000 7f61db7fe640 1 -- 172.21.15.77:0/878363312 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d4009b30 con 0x7f61dc0b4880 2023-11-04T01:41:50.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.851+0000 7f61db7fe640 1 --2- 172.21.15.77:0/878363312 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61dc0b4880 0x7f61dc0caf20 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f61cc00b410 tx=0x7f61cc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:50.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.851+0000 7f61c3fff640 1 -- 172.21.15.77:0/878363312 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc011830 con 0x7f61dc0b4880 2023-11-04T01:41:50.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.851+0000 7f61c3fff640 1 -- 172.21.15.77:0/878363312 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61cc0119b0 con 0x7f61dc0b4880 2023-11-04T01:41:50.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.851+0000 7f61e21d7640 1 -- 172.21.15.77:0/878363312 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61dc0cbcc0 con 0x7f61dc0b4880 2023-11-04T01:41:50.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.851+0000 7f61c3fff640 1 -- 172.21.15.77:0/878363312 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc011d60 con 0x7f61dc0b4880 2023-11-04T01:41:50.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.851+0000 7f61e21d7640 1 -- 172.21.15.77:0/878363312 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61dc0cc280 con 0x7f61dc0b4880 2023-11-04T01:41:50.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.852+0000 7f61e21d7640 1 -- 172.21.15.77:0/878363312 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61dc074290 con 0x7f61dc0b4880 2023-11-04T01:41:50.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.852+0000 7f61c3fff640 1 -- 172.21.15.77:0/878363312 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f61cc01a400 con 0x7f61dc0b4880 2023-11-04T01:41:50.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.853+0000 7f61c3fff640 1 --2- 172.21.15.77:0/878363312 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f61c806ae70 0x7f61c806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:50.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.853+0000 7f61c3fff640 1 -- 172.21.15.77:0/878363312 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f61cc089700 con 0x7f61dc0b4880 2023-11-04T01:41:50.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.853+0000 7f61daffd640 1 --2- 172.21.15.77:0/878363312 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f61c806ae70 0x7f61c806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:50.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.853+0000 7f61daffd640 1 --2- 172.21.15.77:0/878363312 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f61c806ae70 0x7f61c806d330 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f61dc0c6c50 tx=0x7f61d0008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:50.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:50.857+0000 7f61c3fff640 1 -- 172.21.15.77:0/878363312 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f61cc054860 con 0x7f61dc0b4880 2023-11-04T01:41:51.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.020+0000 7f61e21d7640 1 -- 172.21.15.77:0/878363312 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f61dc0d0730 con 0x7f61dc0b4880 2023-11-04T01:41:51.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.020+0000 7f61c3fff640 1 -- 172.21.15.77:0/878363312 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7f61cc0150a0 con 0x7f61dc0b4880 2023-11-04T01:41:51.022 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:41:51.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.022+0000 7f61e21d7640 1 -- 172.21.15.77:0/878363312 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f61c806ae70 msgr2=0x7f61c806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.022+0000 7f61e21d7640 1 --2- 172.21.15.77:0/878363312 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f61c806ae70 0x7f61c806d330 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f61dc0c6c50 tx=0x7f61d0008040 comp rx=0 tx=0).stop 2023-11-04T01:41:51.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.022+0000 7f61e21d7640 1 -- 172.21.15.77:0/878363312 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61dc0b4880 msgr2=0x7f61dc0caf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.022+0000 7f61e21d7640 1 --2- 172.21.15.77:0/878363312 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61dc0b4880 0x7f61dc0caf20 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f61cc00b410 tx=0x7f61cc00b8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.022+0000 7f61e21d7640 1 -- 172.21.15.77:0/878363312 shutdown_connections 2023-11-04T01:41:51.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.022+0000 7f61e21d7640 1 --2- 172.21.15.77:0/878363312 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f61c806ae70 0x7f61c806d330 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.022+0000 7f61e21d7640 1 --2- 172.21.15.77:0/878363312 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61dc153e60 0x7f61dc157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.022+0000 7f61e21d7640 1 --2- 172.21.15.77:0/878363312 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f61dc0cd6d0 0x7f61dc1f1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.022+0000 7f61e21d7640 1 --2- 172.21.15.77:0/878363312 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61dc0b4880 0x7f61dc0caf20 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.022+0000 7f61e21d7640 1 -- 172.21.15.77:0/878363312 >> 172.21.15.77:0/878363312 conn(0x7f61dc0cf880 msgr2=0x7f61dc0d2550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:51.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.022+0000 7f61e21d7640 1 -- 172.21.15.77:0/878363312 shutdown_connections 2023-11-04T01:41:51.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.022+0000 7f61e21d7640 1 -- 172.21.15.77:0/878363312 wait complete. 2023-11-04T01:41:51.034 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:41:51.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.135+0000 7f1dd7fa9640 1 Processor -- start 2023-11-04T01:41:51.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.135+0000 7f1dd7fa9640 1 -- start start 2023-11-04T01:41:51.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.136+0000 7f1dd7fa9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1dd0160600 0x7f1dd00cd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.136+0000 7f1dd7fa9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1dd01609e0 0x7f1dd00cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.136+0000 7f1dd7fa9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1dd00ccde0 0x7f1dd00c9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.136+0000 7f1dd7fa9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd006e1a0 con 0x7f1dd0160600 2023-11-04T01:41:51.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.136+0000 7f1dd7fa9640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd00ce090 con 0x7f1dd00ccde0 2023-11-04T01:41:51.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.136+0000 7f1dd7fa9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd00cd330 con 0x7f1dd01609e0 2023-11-04T01:41:51.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.136+0000 7f1dd5d45640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1dd0160600 0x7f1dd00cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.136+0000 7f1dd5d45640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1dd0160600 0x7f1dd00cd610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54668/0 (socket says 172.21.15.77:54668) 2023-11-04T01:41:51.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.136+0000 7f1dd5d45640 1 -- 172.21.15.77:0/2344007143 learned_addr learned my addr 172.21.15.77:0/2344007143 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:51.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.136+0000 7f1dd6546640 1 --2- 172.21.15.77:0/2344007143 >> v2:172.21.15.122:3300/0 conn(0x7f1dd00ccde0 0x7f1dd00c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.136+0000 7f1dd5544640 1 --2- 172.21.15.77:0/2344007143 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1dd01609e0 0x7f1dd00cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.136+0000 7f1dd5d45640 1 -- 172.21.15.77:0/2344007143 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1dd01609e0 msgr2=0x7f1dd00cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:51.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.136+0000 7f1dd5d45640 1 --2- 172.21.15.77:0/2344007143 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1dd01609e0 0x7f1dd00cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.136+0000 7f1dd5d45640 1 -- 172.21.15.77:0/2344007143 >> v2:172.21.15.122:3300/0 conn(0x7f1dd00ccde0 msgr2=0x7f1dd00c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:51.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.136+0000 7f1dd5d45640 1 --2- 172.21.15.77:0/2344007143 >> v2:172.21.15.122:3300/0 conn(0x7f1dd00ccde0 0x7f1dd00c9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.136+0000 7f1dd5d45640 1 -- 172.21.15.77:0/2344007143 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd006db50 con 0x7f1dd0160600 2023-11-04T01:41:51.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.137+0000 7f1dd5d45640 1 --2- 172.21.15.77:0/2344007143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1dd0160600 0x7f1dd00cd610 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f1dd006faf0 tx=0x7f1dcc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6295fb3bbeebbf11 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:51.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.137+0000 7f1dd4d43640 1 -- 172.21.15.77:0/2344007143 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc030860 con 0x7f1dd0160600 2023-11-04T01:41:51.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.137+0000 7f1dd4d43640 1 -- 172.21.15.77:0/2344007143 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dcc0309c0 con 0x7f1dd0160600 2023-11-04T01:41:51.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.137+0000 7f1dd4d43640 1 -- 172.21.15.77:0/2344007143 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc030d50 con 0x7f1dd0160600 2023-11-04T01:41:51.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.137+0000 7f1dd7fa9640 1 -- 172.21.15.77:0/2344007143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1dd0160600 msgr2=0x7f1dd00cd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.137+0000 7f1dd7fa9640 1 --2- 172.21.15.77:0/2344007143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1dd0160600 0x7f1dd00cd610 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f1dd006faf0 tx=0x7f1dcc02b9a0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.137+0000 7f1dd7fa9640 1 -- 172.21.15.77:0/2344007143 shutdown_connections 2023-11-04T01:41:51.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.137+0000 7f1dd7fa9640 1 --2- 172.21.15.77:0/2344007143 >> v2:172.21.15.122:3300/0 conn(0x7f1dd00ccde0 0x7f1dd00c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.137+0000 7f1dd7fa9640 1 --2- 172.21.15.77:0/2344007143 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1dd01609e0 0x7f1dd00cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.137+0000 7f1dd7fa9640 1 --2- 172.21.15.77:0/2344007143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1dd0160600 0x7f1dd00cd610 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.137+0000 7f1dd7fa9640 1 -- 172.21.15.77:0/2344007143 >> 172.21.15.77:0/2344007143 conn(0x7f1dd006a120 msgr2=0x7f1dd006a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:51.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.137+0000 7f1dd7fa9640 1 -- 172.21.15.77:0/2344007143 shutdown_connections 2023-11-04T01:41:51.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.137+0000 7f1dd7fa9640 1 -- 172.21.15.77:0/2344007143 wait complete. 2023-11-04T01:41:51.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.139+0000 7f1dd7fa9640 1 Processor -- start 2023-11-04T01:41:51.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.139+0000 7f1dd7fa9640 1 -- start start 2023-11-04T01:41:51.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.139+0000 7f1dd7fa9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1dd00ccde0 0x7f1dd01e78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.139+0000 7f1dd7fa9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1dd0160600 0x7f1dd015b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.139+0000 7f1dd7fa9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1dd01609e0 0x7f1dd01f2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.139+0000 7f1dd7fa9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd00c2a40 con 0x7f1dd00ccde0 2023-11-04T01:41:51.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.139+0000 7f1dd7fa9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd01f3500 con 0x7f1dd01609e0 2023-11-04T01:41:51.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.139+0000 7f1dd7fa9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd01f37e0 con 0x7f1dd0160600 2023-11-04T01:41:51.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.139+0000 7f1dd5d45640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1dd00ccde0 0x7f1dd01e78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.139+0000 7f1dd5d45640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1dd00ccde0 0x7f1dd01e78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54670/0 (socket says 172.21.15.77:54670) 2023-11-04T01:41:51.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.139+0000 7f1dd5d45640 1 -- 172.21.15.77:0/4156454208 learned_addr learned my addr 172.21.15.77:0/4156454208 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:51.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.140+0000 7f1dd6546640 1 --2- 172.21.15.77:0/4156454208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1dd01609e0 0x7f1dd01f2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.140+0000 7f1dd5544640 1 --2- 172.21.15.77:0/4156454208 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1dd0160600 0x7f1dd015b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.140+0000 7f1dd5d45640 1 -- 172.21.15.77:0/4156454208 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1dd0160600 msgr2=0x7f1dd015b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.140+0000 7f1dd5d45640 1 --2- 172.21.15.77:0/4156454208 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1dd0160600 0x7f1dd015b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.140+0000 7f1dd5d45640 1 -- 172.21.15.77:0/4156454208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1dd01609e0 msgr2=0x7f1dd01f2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.140+0000 7f1dd5d45640 1 --2- 172.21.15.77:0/4156454208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1dd01609e0 0x7f1dd01f2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.140+0000 7f1dd5d45640 1 -- 172.21.15.77:0/4156454208 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dcc0094d0 con 0x7f1dd00ccde0 2023-11-04T01:41:51.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.140+0000 7f1dd6546640 1 --2- 172.21.15.77:0/4156454208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1dd01609e0 0x7f1dd01f2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:51.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.140+0000 7f1dd5d45640 1 --2- 172.21.15.77:0/4156454208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1dd00ccde0 0x7f1dd01e78c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc000c00 tx=0x7f1dcc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:51.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.140+0000 7f1dc67fc640 1 -- 172.21.15.77:0/4156454208 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc039d60 con 0x7f1dd00ccde0 2023-11-04T01:41:51.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.140+0000 7f1dc67fc640 1 -- 172.21.15.77:0/4156454208 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dcc043400 con 0x7f1dd00ccde0 2023-11-04T01:41:51.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.140+0000 7f1dd7fa9640 1 -- 172.21.15.77:0/4156454208 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd01f3ac0 con 0x7f1dd00ccde0 2023-11-04T01:41:51.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.140+0000 7f1dc67fc640 1 -- 172.21.15.77:0/4156454208 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc0437b0 con 0x7f1dd00ccde0 2023-11-04T01:41:51.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.140+0000 7f1dd7fa9640 1 -- 172.21.15.77:0/4156454208 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd015bb60 con 0x7f1dd00ccde0 2023-11-04T01:41:51.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.141+0000 7f1dd7fa9640 1 -- 172.21.15.77:0/4156454208 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd00c2e90 con 0x7f1dd00ccde0 2023-11-04T01:41:51.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.141+0000 7f1dc67fc640 1 -- 172.21.15.77:0/4156454208 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1dcc043910 con 0x7f1dd00ccde0 2023-11-04T01:41:51.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.142+0000 7f1dc67fc640 1 --2- 172.21.15.77:0/4156454208 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1db406ae70 0x7f1db406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.142+0000 7f1dc67fc640 1 -- 172.21.15.77:0/4156454208 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f1dcc03e070 con 0x7f1dd00ccde0 2023-11-04T01:41:51.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.142+0000 7f1dd5544640 1 --2- 172.21.15.77:0/4156454208 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1db406ae70 0x7f1db406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.142+0000 7f1dd5544640 1 --2- 172.21.15.77:0/4156454208 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1db406ae70 0x7f1db406d330 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1dd00c3ee0 tx=0x7f1dc0008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:51.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.146+0000 7f1dc67fc640 1 -- 172.21.15.77:0/4156454208 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1dd00c2e90 con 0x7f1dd00ccde0 2023-11-04T01:41:51.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.309+0000 7f1dd7fa9640 1 -- 172.21.15.77:0/4156454208 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f1dd00700f0 con 0x7f1dd00ccde0 2023-11-04T01:41:51.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.310+0000 7f1dc67fc640 1 -- 172.21.15.77:0/4156454208 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v50) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1dcc077b80 con 0x7f1dd00ccde0 2023-11-04T01:41:51.312 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:41:51.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.312+0000 7f1dd7fa9640 1 -- 172.21.15.77:0/4156454208 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1db406ae70 msgr2=0x7f1db406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.312+0000 7f1dd7fa9640 1 --2- 172.21.15.77:0/4156454208 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1db406ae70 0x7f1db406d330 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1dd00c3ee0 tx=0x7f1dc0008040 comp rx=0 tx=0).stop 2023-11-04T01:41:51.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.312+0000 7f1dd7fa9640 1 -- 172.21.15.77:0/4156454208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1dd00ccde0 msgr2=0x7f1dd01e78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.312+0000 7f1dd7fa9640 1 --2- 172.21.15.77:0/4156454208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1dd00ccde0 0x7f1dd01e78c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc000c00 tx=0x7f1dcc004730 comp rx=0 tx=0).stop 2023-11-04T01:41:51.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.312+0000 7f1dd7fa9640 1 -- 172.21.15.77:0/4156454208 shutdown_connections 2023-11-04T01:41:51.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.312+0000 7f1dd7fa9640 1 --2- 172.21.15.77:0/4156454208 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1db406ae70 0x7f1db406d330 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.312+0000 7f1dd7fa9640 1 --2- 172.21.15.77:0/4156454208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1dd01609e0 0x7f1dd01f2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.312+0000 7f1dd7fa9640 1 --2- 172.21.15.77:0/4156454208 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1dd0160600 0x7f1dd015b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.312+0000 7f1dd7fa9640 1 --2- 172.21.15.77:0/4156454208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1dd00ccde0 0x7f1dd01e78c0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.312+0000 7f1dd7fa9640 1 -- 172.21.15.77:0/4156454208 >> 172.21.15.77:0/4156454208 conn(0x7f1dd006a120 msgr2=0x7f1dd015dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:51.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.312+0000 7f1dd7fa9640 1 -- 172.21.15.77:0/4156454208 shutdown_connections 2023-11-04T01:41:51.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.312+0000 7f1dd7fa9640 1 -- 172.21.15.77:0/4156454208 wait complete. 2023-11-04T01:41:51.324 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T01:41:51.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.422+0000 7fd35eba9640 1 Processor -- start 2023-11-04T01:41:51.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.422+0000 7fd35eba9640 1 -- start start 2023-11-04T01:41:51.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.423+0000 7fd35eba9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd35815ad80 0x7fd35806c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.423+0000 7fd35eba9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd35806cd00 con 0x7fd3580b42c0 2023-11-04T01:41:51.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.423+0000 7fd35eba9640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd35806cfa0 con 0x7fd3580c9e10 2023-11-04T01:41:51.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.423+0000 7fd35eba9640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd35806d280 con 0x7fd35815ad80 2023-11-04T01:41:51.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.423+0000 7fd357fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd3580b42c0 0x7fd3580c9700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57088/0 (socket says 172.21.15.77:57088) 2023-11-04T01:41:51.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.423+0000 7fd357fff640 1 -- 172.21.15.77:0/2930144386 learned_addr learned my addr 172.21.15.77:0/2930144386 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:51.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.423+0000 7fd3577fe640 1 -- 172.21.15.77:0/2930144386 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 110678840 0 0) 0x7fd35806cd00 con 0x7fd3580b42c0 2023-11-04T01:41:51.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.423+0000 7fd35c945640 1 --2- 172.21.15.77:0/2930144386 >> v2:172.21.15.122:3300/0 conn(0x7fd35815ad80 0x7fd35806c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.423+0000 7fd3577fe640 1 -- 172.21.15.77:0/2930144386 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd348003520 con 0x7fd3580b42c0 2023-11-04T01:41:51.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.423+0000 7fd3577fe640 1 -- 172.21.15.77:0/2930144386 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3206331944 0 0) 0x7fd348003520 con 0x7fd3580b42c0 2023-11-04T01:41:51.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.423+0000 7fd3577fe640 1 -- 172.21.15.77:0/2930144386 >> v2:172.21.15.122:3300/0 conn(0x7fd35815ad80 msgr2=0x7fd35806c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:51.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.423+0000 7fd3577fe640 1 --2- 172.21.15.77:0/2930144386 >> v2:172.21.15.122:3300/0 conn(0x7fd35815ad80 0x7fd35806c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.423+0000 7fd3577fe640 1 -- 172.21.15.77:0/2930144386 >> v1:172.21.15.122:6789/0 conn(0x7fd3580c9e10 legacy=0x7fd3580b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.423+0000 7fd3577fe640 1 -- 172.21.15.77:0/2930144386 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd35806d560 con 0x7fd3580b42c0 2023-11-04T01:41:51.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.423+0000 7fd3577fe640 1 -- 172.21.15.77:0/2930144386 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7fd344001670 con 0x7fd3580b42c0 2023-11-04T01:41:51.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.423+0000 7fd3577fe640 1 -- 172.21.15.77:0/2930144386 >> v1:172.21.15.77:6789/0 conn(0x7fd3580b42c0 legacy=0x7fd3580c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.423+0000 7fd3577fe640 1 --2- 172.21.15.77:0/2930144386 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd348003970 0x7fd348003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.423+0000 7fd3577fe640 1 --2- 172.21.15.77:0/2930144386 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3480047c0 0x7fd348004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.423+0000 7fd3577fe640 1 --2- 172.21.15.77:0/2930144386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd348005180 0x7fd34800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.424+0000 7fd3577fe640 1 -- 172.21.15.77:0/2930144386 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35806d280 con 0x7fd348005180 2023-11-04T01:41:51.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.424+0000 7fd3577fe640 1 -- 172.21.15.77:0/2930144386 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34800c030 con 0x7fd348003970 2023-11-04T01:41:51.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.424+0000 7fd3577fe640 1 -- 172.21.15.77:0/2930144386 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd34800c1f0 con 0x7fd3480047c0 2023-11-04T01:41:51.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.424+0000 7fd35d146640 1 --2- 172.21.15.77:0/2930144386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd348005180 0x7fd34800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.424+0000 7fd35c945640 1 --2- 172.21.15.77:0/2930144386 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd348003970 0x7fd348003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.424+0000 7fd357fff640 1 --2- 172.21.15.77:0/2930144386 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3480047c0 0x7fd348004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.424+0000 7fd35d146640 1 -- 172.21.15.77:0/2930144386 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3480047c0 msgr2=0x7fd348004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:51.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.424+0000 7fd35d146640 1 --2- 172.21.15.77:0/2930144386 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3480047c0 0x7fd348004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.424+0000 7fd35d146640 1 -- 172.21.15.77:0/2930144386 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd348003970 msgr2=0x7fd348003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:51.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.424+0000 7fd35d146640 1 --2- 172.21.15.77:0/2930144386 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd348003970 0x7fd348003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.424+0000 7fd35d146640 1 -- 172.21.15.77:0/2930144386 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd348003520 con 0x7fd348005180 2023-11-04T01:41:51.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.424+0000 7fd357fff640 1 --2- 172.21.15.77:0/2930144386 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3480047c0 0x7fd348004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:51.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.424+0000 7fd35d146640 1 -- 172.21.15.77:0/2930144386 reap_dead start 2023-11-04T01:41:51.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.425+0000 7fd35d146640 1 --2- 172.21.15.77:0/2930144386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd348005180 0x7fd34800b980 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fd350001e50 tx=0x7fd3480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f9dbb5b3a791191 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:51.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.425+0000 7fd3577fe640 1 -- 172.21.15.77:0/2930144386 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd350003b70 con 0x7fd348005180 2023-11-04T01:41:51.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.425+0000 7fd3577fe640 1 -- 172.21.15.77:0/2930144386 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd350003d10 con 0x7fd348005180 2023-11-04T01:41:51.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.425+0000 7fd3577fe640 1 -- 172.21.15.77:0/2930144386 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd350005310 con 0x7fd348005180 2023-11-04T01:41:51.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.425+0000 7fd35eba9640 1 -- 172.21.15.77:0/2930144386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd348005180 msgr2=0x7fd34800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.425+0000 7fd35eba9640 1 --2- 172.21.15.77:0/2930144386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd348005180 0x7fd34800b980 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fd350001e50 tx=0x7fd3480057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.425+0000 7fd35eba9640 1 -- 172.21.15.77:0/2930144386 shutdown_connections 2023-11-04T01:41:51.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.425+0000 7fd35eba9640 1 --2- 172.21.15.77:0/2930144386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd348005180 0x7fd34800b980 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.425+0000 7fd35eba9640 1 -- 172.21.15.77:0/2930144386 >> 172.21.15.77:0/2930144386 conn(0x7fd3580ce950 msgr2=0x7fd3580ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:51.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.425+0000 7fd35eba9640 1 -- 172.21.15.77:0/2930144386 shutdown_connections 2023-11-04T01:41:51.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.425+0000 7fd35eba9640 1 -- 172.21.15.77:0/2930144386 wait complete. 2023-11-04T01:41:51.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.426+0000 7fd35eba9640 1 Processor -- start 2023-11-04T01:41:51.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.426+0000 7fd35eba9640 1 -- start start 2023-11-04T01:41:51.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.427+0000 7fd35eba9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd348005180 0x7fd35814c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.427+0000 7fd35eba9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd3580ccea0 0x7fd3581496e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.427+0000 7fd35eba9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd35814cae0 0x7fd358149c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.427+0000 7fd35eba9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3580cd330 con 0x7fd35814cae0 2023-11-04T01:41:51.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.427+0000 7fd35eba9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3580cd610 con 0x7fd3580ccea0 2023-11-04T01:41:51.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.427+0000 7fd35eba9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3580cd8f0 con 0x7fd348005180 2023-11-04T01:41:51.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.427+0000 7fd35d146640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd35814cae0 0x7fd358149c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.427+0000 7fd35d146640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd35814cae0 0x7fd358149c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54690/0 (socket says 172.21.15.77:54690) 2023-11-04T01:41:51.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.427+0000 7fd35d146640 1 -- 172.21.15.77:0/655937255 learned_addr learned my addr 172.21.15.77:0/655937255 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:51.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.428+0000 7fd357fff640 1 --2- 172.21.15.77:0/655937255 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd3580ccea0 0x7fd3581496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.428+0000 7fd35c945640 1 --2- 172.21.15.77:0/655937255 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd348005180 0x7fd35814c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.428+0000 7fd35d146640 1 -- 172.21.15.77:0/655937255 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd348005180 msgr2=0x7fd35814c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.428+0000 7fd35d146640 1 --2- 172.21.15.77:0/655937255 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd348005180 0x7fd35814c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.428+0000 7fd35d146640 1 -- 172.21.15.77:0/655937255 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd3580ccea0 msgr2=0x7fd3581496e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.428+0000 7fd35d146640 1 --2- 172.21.15.77:0/655937255 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd3580ccea0 0x7fd3581496e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.428+0000 7fd35d146640 1 -- 172.21.15.77:0/655937255 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3580cdbd0 con 0x7fd35814cae0 2023-11-04T01:41:51.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.428+0000 7fd35d146640 1 --2- 172.21.15.77:0/655937255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd35814cae0 0x7fd358149c20 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd350005040 tx=0x7fd3500014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:51.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.428+0000 7fd3557fa640 1 -- 172.21.15.77:0/655937255 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd350006d50 con 0x7fd35814cae0 2023-11-04T01:41:51.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.428+0000 7fd3557fa640 1 -- 172.21.15.77:0/655937255 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd350039480 con 0x7fd35814cae0 2023-11-04T01:41:51.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.428+0000 7fd35eba9640 1 -- 172.21.15.77:0/655937255 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd35814a6d0 con 0x7fd35814cae0 2023-11-04T01:41:51.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.428+0000 7fd3557fa640 1 -- 172.21.15.77:0/655937255 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3500397f0 con 0x7fd35814cae0 2023-11-04T01:41:51.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.428+0000 7fd35eba9640 1 -- 172.21.15.77:0/655937255 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd35814ab90 con 0x7fd35814cae0 2023-11-04T01:41:51.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.429+0000 7fd35eba9640 1 -- 172.21.15.77:0/655937255 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd358074290 con 0x7fd35814cae0 2023-11-04T01:41:51.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.430+0000 7fd3557fa640 1 -- 172.21.15.77:0/655937255 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd350039950 con 0x7fd35814cae0 2023-11-04T01:41:51.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.430+0000 7fd3557fa640 1 --2- 172.21.15.77:0/655937255 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd33c06aea0 0x7fd33c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.430+0000 7fd3557fa640 1 -- 172.21.15.77:0/655937255 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fd3500ab370 con 0x7fd35814cae0 2023-11-04T01:41:51.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.430+0000 7fd35c945640 1 --2- 172.21.15.77:0/655937255 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd33c06aea0 0x7fd33c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.430+0000 7fd35c945640 1 --2- 172.21.15.77:0/655937255 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd33c06aea0 0x7fd33c06d360 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd34c009a80 tx=0x7fd34c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:51.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.434+0000 7fd3557fa640 1 -- 172.21.15.77:0/655937255 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd3500764d0 con 0x7fd35814cae0 2023-11-04T01:41:51.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.601+0000 7fd35eba9640 1 -- 172.21.15.77:0/655937255 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd3580b4880 con 0x7fd35814cae0 2023-11-04T01:41:51.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.602+0000 7fd3557fa640 1 -- 172.21.15.77:0/655937255 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v50) v1 ==== 84+0+137 (secure 0 0 0) 0x7fd350079af0 con 0x7fd35814cae0 2023-11-04T01:41:51.604 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:51.604 INFO:teuthology.orchestra.run.smithi077.stdout:[ 2023-11-04T01:41:51.604 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:51.605 INFO:teuthology.orchestra.run.smithi077.stdout: "poolnum": 1, 2023-11-04T01:41:51.605 INFO:teuthology.orchestra.run.smithi077.stdout: "poolname": ".mgr" 2023-11-04T01:41:51.605 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:41:51.605 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:41:51.606 INFO:teuthology.orchestra.run.smithi077.stdout: "poolnum": 7, 2023-11-04T01:41:51.606 INFO:teuthology.orchestra.run.smithi077.stdout: "poolname": "snap-test-pool" 2023-11-04T01:41:51.606 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:41:51.606 INFO:teuthology.orchestra.run.smithi077.stdout:] 2023-11-04T01:41:51.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.604+0000 7fd35eba9640 1 -- 172.21.15.77:0/655937255 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd33c06aea0 msgr2=0x7fd33c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.604+0000 7fd35eba9640 1 --2- 172.21.15.77:0/655937255 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd33c06aea0 0x7fd33c06d360 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd34c009a80 tx=0x7fd34c008040 comp rx=0 tx=0).stop 2023-11-04T01:41:51.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.604+0000 7fd35eba9640 1 -- 172.21.15.77:0/655937255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd35814cae0 msgr2=0x7fd358149c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.604+0000 7fd35eba9640 1 --2- 172.21.15.77:0/655937255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd35814cae0 0x7fd358149c20 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd350005040 tx=0x7fd3500014a0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.604+0000 7fd35eba9640 1 -- 172.21.15.77:0/655937255 shutdown_connections 2023-11-04T01:41:51.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.604+0000 7fd35eba9640 1 --2- 172.21.15.77:0/655937255 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd33c06aea0 0x7fd33c06d360 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.604+0000 7fd35eba9640 1 --2- 172.21.15.77:0/655937255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd35814cae0 0x7fd358149c20 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.604+0000 7fd35eba9640 1 --2- 172.21.15.77:0/655937255 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd3580ccea0 0x7fd3581496e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.604+0000 7fd35eba9640 1 --2- 172.21.15.77:0/655937255 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd348005180 0x7fd35814c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.604+0000 7fd35eba9640 1 -- 172.21.15.77:0/655937255 >> 172.21.15.77:0/655937255 conn(0x7fd3580ce950 msgr2=0x7fd3580b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:51.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.604+0000 7fd35eba9640 1 -- 172.21.15.77:0/655937255 shutdown_connections 2023-11-04T01:41:51.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.604+0000 7fd35eba9640 1 -- 172.21.15.77:0/655937255 wait complete. 2023-11-04T01:41:51.616 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T01:41:51.617 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T01:41:51.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.719+0000 7f2539989640 1 Processor -- start 2023-11-04T01:41:51.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.719+0000 7f2539989640 1 -- start start 2023-11-04T01:41:51.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.720+0000 7f2539989640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f25340d2820 0x7f25340b8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.720+0000 7f2539989640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25340d2390 con 0x7f253415cd60 2023-11-04T01:41:51.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.720+0000 7f2539989640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25340d1780 con 0x7f25340ce090 2023-11-04T01:41:51.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.720+0000 7f2539989640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25340d1a60 con 0x7f25340d2820 2023-11-04T01:41:51.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.720+0000 7f2532ffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f253415cd60 0x7f25340cd980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57094/0 (socket says 172.21.15.77:57094) 2023-11-04T01:41:51.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.720+0000 7f2532ffd640 1 -- 172.21.15.77:0/1370182161 learned_addr learned my addr 172.21.15.77:0/1370182161 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:51.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.720+0000 7f25337fe640 1 --2- 172.21.15.77:0/1370182161 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f25340d2820 0x7f25340b8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.720+0000 7f25327fc640 1 -- 172.21.15.77:0/1370182161 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 26665699 0 0) 0x7f25340d2390 con 0x7f253415cd60 2023-11-04T01:41:51.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.720+0000 7f25327fc640 1 -- 172.21.15.77:0/1370182161 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2520003520 con 0x7f253415cd60 2023-11-04T01:41:51.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.720+0000 7f25327fc640 1 -- 172.21.15.77:0/1370182161 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2340315206 0 0) 0x7f2520003520 con 0x7f253415cd60 2023-11-04T01:41:51.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.720+0000 7f25327fc640 1 -- 172.21.15.77:0/1370182161 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f25340d2820 msgr2=0x7f25340b8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:51.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.720+0000 7f25327fc640 1 --2- 172.21.15.77:0/1370182161 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f25340d2820 0x7f25340b8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.720+0000 7f25327fc640 1 -- 172.21.15.77:0/1370182161 >> v1:172.21.15.122:6789/0 conn(0x7f25340ce090 legacy=0x7f25340b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.720+0000 7f25327fc640 1 -- 172.21.15.77:0/1370182161 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25340d1d40 con 0x7f253415cd60 2023-11-04T01:41:51.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.720+0000 7f25327fc640 1 -- 172.21.15.77:0/1370182161 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f2524001670 con 0x7f253415cd60 2023-11-04T01:41:51.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.720+0000 7f25327fc640 1 -- 172.21.15.77:0/1370182161 >> v1:172.21.15.77:6789/0 conn(0x7f253415cd60 legacy=0x7f25340cd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.720+0000 7f25327fc640 1 --2- 172.21.15.77:0/1370182161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25200039a0 0x7f2520003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.720+0000 7f25327fc640 1 --2- 172.21.15.77:0/1370182161 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f25340d2820 0x7f25200047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.720+0000 7f25327fc640 1 --2- 172.21.15.77:0/1370182161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2520004d00 0x7f2520005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.720+0000 7f25327fc640 1 -- 172.21.15.77:0/1370182161 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25340d1a60 con 0x7f25200039a0 2023-11-04T01:41:51.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.721+0000 7f25327fc640 1 -- 172.21.15.77:0/1370182161 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252000bab0 con 0x7f2520004d00 2023-11-04T01:41:51.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.721+0000 7f25327fc640 1 -- 172.21.15.77:0/1370182161 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f252000bc70 con 0x7f25340d2820 2023-11-04T01:41:51.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.721+0000 7f2532ffd640 1 --2- 172.21.15.77:0/1370182161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25200039a0 0x7f2520003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.721+0000 7f25337fe640 1 --2- 172.21.15.77:0/1370182161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2520004d00 0x7f2520005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.721+0000 7f252bfff640 1 --2- 172.21.15.77:0/1370182161 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f25340d2820 0x7f25200047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.721+0000 7f2532ffd640 1 -- 172.21.15.77:0/1370182161 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f25340d2820 msgr2=0x7f25200047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:51.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.721+0000 7f2532ffd640 1 --2- 172.21.15.77:0/1370182161 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f25340d2820 0x7f25200047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.721+0000 7f2532ffd640 1 -- 172.21.15.77:0/1370182161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2520004d00 msgr2=0x7f2520005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:51.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.721+0000 7f2532ffd640 1 --2- 172.21.15.77:0/1370182161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2520004d00 0x7f2520005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.721+0000 7f2532ffd640 1 -- 172.21.15.77:0/1370182161 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2520003520 con 0x7f25200039a0 2023-11-04T01:41:51.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.721+0000 7f25337fe640 1 --2- 172.21.15.77:0/1370182161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2520004d00 0x7f2520005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:51.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.721+0000 7f2532ffd640 1 --2- 172.21.15.77:0/1370182161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25200039a0 0x7f2520003dc0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f252400c240 tx=0x7f25200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faf154e9083999e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:51.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.722+0000 7f25327fc640 1 -- 172.21.15.77:0/1370182161 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2524005ad0 con 0x7f25200039a0 2023-11-04T01:41:51.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.722+0000 7f25327fc640 1 -- 172.21.15.77:0/1370182161 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2524005c50 con 0x7f25200039a0 2023-11-04T01:41:51.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.722+0000 7f25327fc640 1 -- 172.21.15.77:0/1370182161 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252402c810 con 0x7f25200039a0 2023-11-04T01:41:51.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.722+0000 7f2539989640 1 -- 172.21.15.77:0/1370182161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25200039a0 msgr2=0x7f2520003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.722+0000 7f2539989640 1 --2- 172.21.15.77:0/1370182161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25200039a0 0x7f2520003dc0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f252400c240 tx=0x7f25200057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.722+0000 7f25337fe640 1 -- 172.21.15.77:0/1370182161 reap_dead start 2023-11-04T01:41:51.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.722+0000 7f2539989640 1 -- 172.21.15.77:0/1370182161 shutdown_connections 2023-11-04T01:41:51.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.722+0000 7f2539989640 1 -- 172.21.15.77:0/1370182161 >> 172.21.15.77:0/1370182161 conn(0x7f25340cf730 msgr2=0x7f25340cfb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:51.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.722+0000 7f2539989640 1 -- 172.21.15.77:0/1370182161 shutdown_connections 2023-11-04T01:41:51.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.722+0000 7f2539989640 1 -- 172.21.15.77:0/1370182161 wait complete. 2023-11-04T01:41:51.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.723+0000 7f2539989640 1 Processor -- start 2023-11-04T01:41:51.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.723+0000 7f2539989640 1 -- start start 2023-11-04T01:41:51.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.724+0000 7f2539989640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25200039a0 0x7f25341f2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.724+0000 7f2539989640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2534158290 0x7f2534158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.724+0000 7f2539989640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f25341f67a0 0x7f25341f6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.724+0000 7f2539989640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25340c93a0 con 0x7f25200039a0 2023-11-04T01:41:51.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.724+0000 7f2539989640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2534158c50 con 0x7f25341f67a0 2023-11-04T01:41:51.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.724+0000 7f2539989640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25341f7160 con 0x7f2534158290 2023-11-04T01:41:51.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.724+0000 7f2532ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25200039a0 0x7f25341f2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.724+0000 7f2532ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25200039a0 0x7f25341f2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54698/0 (socket says 172.21.15.77:54698) 2023-11-04T01:41:51.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.724+0000 7f2532ffd640 1 -- 172.21.15.77:0/2877056212 learned_addr learned my addr 172.21.15.77:0/2877056212 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:51.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.724+0000 7f2532ffd640 1 -- 172.21.15.77:0/2877056212 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2534158290 msgr2=0x7f2534158710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.724+0000 7f2532ffd640 1 --2- 172.21.15.77:0/2877056212 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2534158290 0x7f2534158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.724+0000 7f2532ffd640 1 -- 172.21.15.77:0/2877056212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f25341f67a0 msgr2=0x7f25341f6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:51.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.724+0000 7f25337fe640 1 --2- 172.21.15.77:0/2877056212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f25341f67a0 0x7f25341f6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.725+0000 7f2532ffd640 1 --2- 172.21.15.77:0/2877056212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f25341f67a0 0x7f25341f6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:51.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.725+0000 7f2532ffd640 1 -- 172.21.15.77:0/2877056212 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25341f73b0 con 0x7f25200039a0 2023-11-04T01:41:51.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.725+0000 7f2532ffd640 1 --2- 172.21.15.77:0/2877056212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25200039a0 0x7f25341f2a40 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f252402c3b0 tx=0x7f2524001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:51.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.725+0000 7f2530ff9640 1 -- 172.21.15.77:0/2877056212 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2524039070 con 0x7f25200039a0 2023-11-04T01:41:51.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.725+0000 7f2530ff9640 1 -- 172.21.15.77:0/2877056212 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252402cc20 con 0x7f25200039a0 2023-11-04T01:41:51.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.725+0000 7f2539989640 1 -- 172.21.15.77:0/2877056212 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25341f7690 con 0x7f25200039a0 2023-11-04T01:41:51.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.725+0000 7f2530ff9640 1 -- 172.21.15.77:0/2877056212 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252403c040 con 0x7f25200039a0 2023-11-04T01:41:51.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.725+0000 7f2539989640 1 -- 172.21.15.77:0/2877056212 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25340ca100 con 0x7f25200039a0 2023-11-04T01:41:51.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.726+0000 7f2539989640 1 -- 172.21.15.77:0/2877056212 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25340cd860 con 0x7f25200039a0 2023-11-04T01:41:51.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.726+0000 7f2530ff9640 1 -- 172.21.15.77:0/2877056212 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2524032070 con 0x7f25200039a0 2023-11-04T01:41:51.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.726+0000 7f2530ff9640 1 --2- 172.21.15.77:0/2877056212 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f251406ae70 0x7f251406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:51.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.727+0000 7f2530ff9640 1 -- 172.21.15.77:0/2877056212 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f25240aa880 con 0x7f25200039a0 2023-11-04T01:41:51.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.727+0000 7f252bfff640 1 --2- 172.21.15.77:0/2877056212 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f251406ae70 0x7f251406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:51.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.727+0000 7f252bfff640 1 --2- 172.21.15.77:0/2877056212 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f251406ae70 0x7f251406d330 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f251c007af0 tx=0x7f251c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:51.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.731+0000 7f2530ff9640 1 -- 172.21.15.77:0/2877056212 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f25240759e0 con 0x7f25200039a0 2023-11-04T01:41:51.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:51.896+0000 7f2539989640 1 -- 172.21.15.77:0/2877056212 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f25340d0dc0 con 0x7f25200039a0 2023-11-04T01:41:52.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.051+0000 7f2530ff9640 1 -- 172.21.15.77:0/2877056212 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v51) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2524079000 con 0x7f25200039a0 2023-11-04T01:41:52.053 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_metadata' created 2023-11-04T01:41:52.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.053+0000 7f2539989640 1 -- 172.21.15.77:0/2877056212 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f251406ae70 msgr2=0x7f251406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:52.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.053+0000 7f2539989640 1 --2- 172.21.15.77:0/2877056212 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f251406ae70 0x7f251406d330 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f251c007af0 tx=0x7f251c009040 comp rx=0 tx=0).stop 2023-11-04T01:41:52.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.053+0000 7f2539989640 1 -- 172.21.15.77:0/2877056212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25200039a0 msgr2=0x7f25341f2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:52.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.053+0000 7f2539989640 1 --2- 172.21.15.77:0/2877056212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25200039a0 0x7f25341f2a40 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f252402c3b0 tx=0x7f2524001a00 comp rx=0 tx=0).stop 2023-11-04T01:41:52.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.053+0000 7f2539989640 1 -- 172.21.15.77:0/2877056212 shutdown_connections 2023-11-04T01:41:52.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.053+0000 7f2539989640 1 --2- 172.21.15.77:0/2877056212 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f251406ae70 0x7f251406d330 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.053+0000 7f2539989640 1 --2- 172.21.15.77:0/2877056212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f25341f67a0 0x7f25341f6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.053+0000 7f2539989640 1 --2- 172.21.15.77:0/2877056212 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2534158290 0x7f2534158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.053+0000 7f2539989640 1 --2- 172.21.15.77:0/2877056212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25200039a0 0x7f25341f2a40 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.053+0000 7f2539989640 1 -- 172.21.15.77:0/2877056212 >> 172.21.15.77:0/2877056212 conn(0x7f25340cf730 msgr2=0x7f2534159bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:52.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.053+0000 7f2539989640 1 -- 172.21.15.77:0/2877056212 shutdown_connections 2023-11-04T01:41:52.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.053+0000 7f2539989640 1 -- 172.21.15.77:0/2877056212 wait complete. 2023-11-04T01:41:52.069 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T01:41:52.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.174+0000 7f21162e1640 1 Processor -- start 2023-11-04T01:41:52.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.174+0000 7f21162e1640 1 -- start start 2023-11-04T01:41:52.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.175+0000 7f21162e1640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f211015ad30 0x7f21100adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:52.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.175+0000 7f21162e1640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2110070e20 0x7f211015e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:52.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.175+0000 7f21162e1640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21100c3900 con 0x7f21100ad730 2023-11-04T01:41:52.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.175+0000 7f21162e1640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21100ae260 con 0x7f2110070e20 2023-11-04T01:41:52.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.175+0000 7f21162e1640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21100c3be0 con 0x7f211015ad30 2023-11-04T01:41:52.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.175+0000 7f211487e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2110070e20 0x7f211015e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:52.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.175+0000 7f211487e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2110070e20 0x7f211015e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54708/0 (socket says 172.21.15.77:54708) 2023-11-04T01:41:52.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.175+0000 7f211487e640 1 -- 172.21.15.77:0/3974623969 learned_addr learned my addr 172.21.15.77:0/3974623969 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:52.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.175+0000 7f211487e640 1 -- 172.21.15.77:0/3974623969 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f211015ad30 msgr2=0x7f21100adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:52.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.175+0000 7f210ffff640 1 --2- 172.21.15.77:0/3974623969 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f211015ad30 0x7f21100adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:52.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.175+0000 7f211487e640 1 --2- 172.21.15.77:0/3974623969 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f211015ad30 0x7f21100adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.175+0000 7f211487e640 1 -- 172.21.15.77:0/3974623969 >> v1:172.21.15.122:6789/0 conn(0x7f21100ad730 legacy=0x7f2110070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:52.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.175+0000 7f211487e640 1 -- 172.21.15.77:0/3974623969 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21100c3ec0 con 0x7f2110070e20 2023-11-04T01:41:52.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.176+0000 7f211487e640 1 --2- 172.21.15.77:0/3974623969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2110070e20 0x7f211015e740 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f2108009e50 tx=0x7f210802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f091c15e2022451 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:52.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.176+0000 7f210effd640 1 -- 172.21.15.77:0/3974623969 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210802c9e0 con 0x7f2110070e20 2023-11-04T01:41:52.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.176+0000 7f210effd640 1 -- 172.21.15.77:0/3974623969 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210802cb40 con 0x7f2110070e20 2023-11-04T01:41:52.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.176+0000 7f210effd640 1 -- 172.21.15.77:0/3974623969 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21080343f0 con 0x7f2110070e20 2023-11-04T01:41:52.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.177+0000 7f21162e1640 1 -- 172.21.15.77:0/3974623969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2110070e20 msgr2=0x7f211015e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:52.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.177+0000 7f21162e1640 1 --2- 172.21.15.77:0/3974623969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2110070e20 0x7f211015e740 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f2108009e50 tx=0x7f210802be40 comp rx=0 tx=0).stop 2023-11-04T01:41:52.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.177+0000 7f21162e1640 1 -- 172.21.15.77:0/3974623969 shutdown_connections 2023-11-04T01:41:52.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.177+0000 7f21162e1640 1 --2- 172.21.15.77:0/3974623969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2110070e20 0x7f211015e740 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.177+0000 7f21162e1640 1 --2- 172.21.15.77:0/3974623969 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f211015ad30 0x7f21100adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.177+0000 7f21162e1640 1 -- 172.21.15.77:0/3974623969 >> 172.21.15.77:0/3974623969 conn(0x7f21100ce950 msgr2=0x7f21100ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:52.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.177+0000 7f21162e1640 1 -- 172.21.15.77:0/3974623969 shutdown_connections 2023-11-04T01:41:52.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.177+0000 7f21162e1640 1 -- 172.21.15.77:0/3974623969 wait complete. 2023-11-04T01:41:52.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.178+0000 7f21162e1640 1 Processor -- start 2023-11-04T01:41:52.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.178+0000 7f21162e1640 1 -- start start 2023-11-04T01:41:52.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.179+0000 7f21162e1640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2110070e20 0x7f21100b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:52.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.179+0000 7f21162e1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21100ad730 0x7f2110159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:52.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.179+0000 7f21162e1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f211015ad30 0x7f21101598b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:52.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.179+0000 7f21162e1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211015c090 con 0x7f21100ad730 2023-11-04T01:41:52.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.179+0000 7f21162e1640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211015d170 con 0x7f211015ad30 2023-11-04T01:41:52.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.179+0000 7f21162e1640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211015bdb0 con 0x7f2110070e20 2023-11-04T01:41:52.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.179+0000 7f210f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21100ad730 0x7f2110159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:52.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.179+0000 7f210f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21100ad730 0x7f2110159370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54714/0 (socket says 172.21.15.77:54714) 2023-11-04T01:41:52.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.179+0000 7f210f7fe640 1 -- 172.21.15.77:0/834701591 learned_addr learned my addr 172.21.15.77:0/834701591 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:52.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.179+0000 7f210ffff640 1 --2- 172.21.15.77:0/834701591 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2110070e20 0x7f21100b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:52.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.179+0000 7f211487e640 1 --2- 172.21.15.77:0/834701591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f211015ad30 0x7f21101598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:52.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.179+0000 7f210f7fe640 1 -- 172.21.15.77:0/834701591 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2110070e20 msgr2=0x7f21100b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:52.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.179+0000 7f210f7fe640 1 --2- 172.21.15.77:0/834701591 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2110070e20 0x7f21100b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.179+0000 7f210f7fe640 1 -- 172.21.15.77:0/834701591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f211015ad30 msgr2=0x7f21101598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:52.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.179+0000 7f210f7fe640 1 --2- 172.21.15.77:0/834701591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f211015ad30 0x7f21101598b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:52.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.179+0000 7f210f7fe640 1 -- 172.21.15.77:0/834701591 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2108009b30 con 0x7f21100ad730 2023-11-04T01:41:52.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.179+0000 7f211487e640 1 --2- 172.21.15.77:0/834701591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f211015ad30 0x7f21101598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:52.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.179+0000 7f210ffff640 1 --2- 172.21.15.77:0/834701591 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2110070e20 0x7f21100b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:52.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.179+0000 7f210f7fe640 1 --2- 172.21.15.77:0/834701591 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21100ad730 0x7f2110159370 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f20f800c430 tx=0x7f20f800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:52.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.179+0000 7f210cff9640 1 -- 172.21.15.77:0/834701591 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f8011790 con 0x7f21100ad730 2023-11-04T01:41:52.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.179+0000 7f210cff9640 1 -- 172.21.15.77:0/834701591 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f80118f0 con 0x7f21100ad730 2023-11-04T01:41:52.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.179+0000 7f21162e1640 1 -- 172.21.15.77:0/834701591 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21100b13e0 con 0x7f21100ad730 2023-11-04T01:41:52.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.180+0000 7f210cff9640 1 -- 172.21.15.77:0/834701591 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f8011ce0 con 0x7f21100ad730 2023-11-04T01:41:52.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.180+0000 7f21162e1640 1 -- 172.21.15.77:0/834701591 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21100b19a0 con 0x7f21100ad730 2023-11-04T01:41:52.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.180+0000 7f21162e1640 1 -- 172.21.15.77:0/834701591 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2110074290 con 0x7f21100ad730 2023-11-04T01:41:52.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.181+0000 7f210cff9640 1 -- 172.21.15.77:0/834701591 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f20f801c460 con 0x7f21100ad730 2023-11-04T01:41:52.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.181+0000 7f210cff9640 1 --2- 172.21.15.77:0/834701591 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f20f006ae70 0x7f20f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:52.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.181+0000 7f210cff9640 1 -- 172.21.15.77:0/834701591 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f20f8089fa0 con 0x7f21100ad730 2023-11-04T01:41:52.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.182+0000 7f210ffff640 1 --2- 172.21.15.77:0/834701591 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f20f006ae70 0x7f20f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:52.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.182+0000 7f210ffff640 1 --2- 172.21.15.77:0/834701591 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f20f006ae70 0x7f20f006d330 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f211015cb40 tx=0x7f2100008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:52.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.185+0000 7f210cff9640 1 -- 172.21.15.77:0/834701591 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f20f8055100 con 0x7f21100ad730 2023-11-04T01:41:52.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:52.352+0000 7f21162e1640 1 -- 172.21.15.77:0/834701591 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f211015dff0 con 0x7f21100ad730 2023-11-04T01:41:53.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.061+0000 7f210cff9640 1 -- 172.21.15.77:0/834701591 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v52) v1 ==== 170+0+0 (secure 0 0 0) 0x7f20f8058720 con 0x7f21100ad730 2023-11-04T01:41:53.063 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data' created 2023-11-04T01:41:53.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.067+0000 7f21162e1640 1 -- 172.21.15.77:0/834701591 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f20f006ae70 msgr2=0x7f20f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:53.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.067+0000 7f21162e1640 1 --2- 172.21.15.77:0/834701591 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f20f006ae70 0x7f20f006d330 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f211015cb40 tx=0x7f2100008040 comp rx=0 tx=0).stop 2023-11-04T01:41:53.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.067+0000 7f21162e1640 1 -- 172.21.15.77:0/834701591 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21100ad730 msgr2=0x7f2110159370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:53.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.067+0000 7f21162e1640 1 --2- 172.21.15.77:0/834701591 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21100ad730 0x7f2110159370 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f20f800c430 tx=0x7f20f800c8f0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.070+0000 7f21162e1640 1 -- 172.21.15.77:0/834701591 shutdown_connections 2023-11-04T01:41:53.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.070+0000 7f21162e1640 1 --2- 172.21.15.77:0/834701591 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f20f006ae70 0x7f20f006d330 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.070+0000 7f21162e1640 1 --2- 172.21.15.77:0/834701591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f211015ad30 0x7f21101598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.070+0000 7f21162e1640 1 --2- 172.21.15.77:0/834701591 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21100ad730 0x7f2110159370 secure :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f20f800c430 tx=0x7f20f800c8f0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.070+0000 7f21162e1640 1 --2- 172.21.15.77:0/834701591 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2110070e20 0x7f21100b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.070+0000 7f21162e1640 1 -- 172.21.15.77:0/834701591 >> 172.21.15.77:0/834701591 conn(0x7f21100ce950 msgr2=0x7f21100ca2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:53.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.072+0000 7f21162e1640 1 -- 172.21.15.77:0/834701591 shutdown_connections 2023-11-04T01:41:53.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.073+0000 7f21162e1640 1 -- 172.21.15.77:0/834701591 wait complete. 2023-11-04T01:41:53.093 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T01:41:53.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.197+0000 7fc4db221640 1 Processor -- start 2023-11-04T01:41:53.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.197+0000 7fc4db221640 1 -- start start 2023-11-04T01:41:53.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.198+0000 7fc4db221640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc4d40c4ff0 0x7fc4d40cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:53.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.198+0000 7fc4db221640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc4d40adac0 0x7fc4d40adf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:53.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.198+0000 7fc4db221640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d415aff0 con 0x7fc4d4159c00 2023-11-04T01:41:53.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.198+0000 7fc4db221640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4d40ae460 con 0x7fc4d40adac0 2023-11-04T01:41:53.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.198+0000 7fc4db221640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4d415a3e0 con 0x7fc4d40c4ff0 2023-11-04T01:41:53.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.198+0000 7fc4d97be640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc4d40adac0 0x7fc4d40adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:53.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.198+0000 7fc4d97be640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc4d40adac0 0x7fc4d40adf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54730/0 (socket says 172.21.15.77:54730) 2023-11-04T01:41:53.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.198+0000 7fc4d97be640 1 -- 172.21.15.77:0/734950626 learned_addr learned my addr 172.21.15.77:0/734950626 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:53.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.198+0000 7fc4d97be640 1 -- 172.21.15.77:0/734950626 >> v2:172.21.15.122:3300/0 conn(0x7fc4d40c4ff0 msgr2=0x7fc4d40cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:53.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.198+0000 7fc4d97be640 1 --2- 172.21.15.77:0/734950626 >> v2:172.21.15.122:3300/0 conn(0x7fc4d40c4ff0 0x7fc4d40cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.198+0000 7fc4d97be640 1 -- 172.21.15.77:0/734950626 >> v1:172.21.15.122:6789/0 conn(0x7fc4d4159c00 legacy=0x7fc4d40c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:53.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.198+0000 7fc4d97be640 1 -- 172.21.15.77:0/734950626 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d415a6c0 con 0x7fc4d40adac0 2023-11-04T01:41:53.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.199+0000 7fc4d97be640 1 --2- 172.21.15.77:0/734950626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4d40adac0 0x7fc4d40adf20 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc4d40cde50 tx=0x7fc4cc02bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee4fe1a7c393b780 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:53.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.199+0000 7fc4d37fe640 1 -- 172.21.15.77:0/734950626 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc02caa0 con 0x7fc4d40adac0 2023-11-04T01:41:53.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.199+0000 7fc4d37fe640 1 -- 172.21.15.77:0/734950626 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4cc02cc00 con 0x7fc4d40adac0 2023-11-04T01:41:53.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.199+0000 7fc4d37fe640 1 -- 172.21.15.77:0/734950626 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc0343f0 con 0x7fc4d40adac0 2023-11-04T01:41:53.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.199+0000 7fc4db221640 1 -- 172.21.15.77:0/734950626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4d40adac0 msgr2=0x7fc4d40adf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:53.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.199+0000 7fc4db221640 1 --2- 172.21.15.77:0/734950626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4d40adac0 0x7fc4d40adf20 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc4d40cde50 tx=0x7fc4cc02bf00 comp rx=0 tx=0).stop 2023-11-04T01:41:53.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.200+0000 7fc4db221640 1 -- 172.21.15.77:0/734950626 shutdown_connections 2023-11-04T01:41:53.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.200+0000 7fc4db221640 1 --2- 172.21.15.77:0/734950626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4d40adac0 0x7fc4d40adf20 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.200+0000 7fc4db221640 1 --2- 172.21.15.77:0/734950626 >> v2:172.21.15.122:3300/0 conn(0x7fc4d40c4ff0 0x7fc4d40cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.200+0000 7fc4db221640 1 -- 172.21.15.77:0/734950626 >> 172.21.15.77:0/734950626 conn(0x7fc4d40ce950 msgr2=0x7fc4d40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:53.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.200+0000 7fc4db221640 1 -- 172.21.15.77:0/734950626 shutdown_connections 2023-11-04T01:41:53.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.200+0000 7fc4db221640 1 -- 172.21.15.77:0/734950626 wait complete. 2023-11-04T01:41:53.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.201+0000 7fc4db221640 1 Processor -- start 2023-11-04T01:41:53.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.201+0000 7fc4db221640 1 -- start start 2023-11-04T01:41:53.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.202+0000 7fc4db221640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc4d40adac0 0x7fc4d4147400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:53.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.202+0000 7fc4db221640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4d40c4ff0 0x7fc4d40c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:53.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.202+0000 7fc4db221640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4d4159c00 0x7fc4d40c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:53.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.202+0000 7fc4db221640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d4151fa0 con 0x7fc4d40c4ff0 2023-11-04T01:41:53.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.202+0000 7fc4db221640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d4147940 con 0x7fc4d4159c00 2023-11-04T01:41:53.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.202+0000 7fc4db221640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d41510d0 con 0x7fc4d40adac0 2023-11-04T01:41:53.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.202+0000 7fc4d3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4d40c4ff0 0x7fc4d40c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:53.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.202+0000 7fc4d3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4d40c4ff0 0x7fc4d40c7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54738/0 (socket says 172.21.15.77:54738) 2023-11-04T01:41:53.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.202+0000 7fc4d3fff640 1 -- 172.21.15.77:0/2195886717 learned_addr learned my addr 172.21.15.77:0/2195886717 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:53.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.202+0000 7fc4d8fbd640 1 --2- 172.21.15.77:0/2195886717 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc4d40adac0 0x7fc4d4147400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:53.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.202+0000 7fc4d97be640 1 --2- 172.21.15.77:0/2195886717 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4d4159c00 0x7fc4d40c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:53.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.202+0000 7fc4d3fff640 1 -- 172.21.15.77:0/2195886717 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc4d40adac0 msgr2=0x7fc4d4147400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:53.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.202+0000 7fc4d3fff640 1 --2- 172.21.15.77:0/2195886717 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc4d40adac0 0x7fc4d4147400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.202+0000 7fc4d3fff640 1 -- 172.21.15.77:0/2195886717 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4d4159c00 msgr2=0x7fc4d40c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:53.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.202+0000 7fc4d3fff640 1 --2- 172.21.15.77:0/2195886717 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4d4159c00 0x7fc4d40c7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:53.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.202+0000 7fc4d3fff640 1 -- 172.21.15.77:0/2195886717 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4cc009b30 con 0x7fc4d40c4ff0 2023-11-04T01:41:53.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.202+0000 7fc4d3fff640 1 --2- 172.21.15.77:0/2195886717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4d40c4ff0 0x7fc4d40c7a30 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fc4c000b430 tx=0x7fc4c000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:53.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.202+0000 7fc4d17fa640 1 -- 172.21.15.77:0/2195886717 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c0011830 con 0x7fc4d40c4ff0 2023-11-04T01:41:53.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.202+0000 7fc4d17fa640 1 -- 172.21.15.77:0/2195886717 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c0011990 con 0x7fc4d40c4ff0 2023-11-04T01:41:53.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.202+0000 7fc4db221640 1 -- 172.21.15.77:0/2195886717 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4d4151320 con 0x7fc4d40c4ff0 2023-11-04T01:41:53.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.202+0000 7fc4d17fa640 1 -- 172.21.15.77:0/2195886717 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c0011d20 con 0x7fc4d40c4ff0 2023-11-04T01:41:53.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.202+0000 7fc4db221640 1 -- 172.21.15.77:0/2195886717 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d41518e0 con 0x7fc4d40c4ff0 2023-11-04T01:41:53.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.203+0000 7fc4db221640 1 -- 172.21.15.77:0/2195886717 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4d41520e0 con 0x7fc4d40c4ff0 2023-11-04T01:41:53.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.204+0000 7fc4d17fa640 1 -- 172.21.15.77:0/2195886717 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc4c001a400 con 0x7fc4d40c4ff0 2023-11-04T01:41:53.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.204+0000 7fc4d17fa640 1 --2- 172.21.15.77:0/2195886717 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc4b806ae70 0x7fc4b806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:53.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.204+0000 7fc4d17fa640 1 -- 172.21.15.77:0/2195886717 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6282+0+0 (secure 0 0 0) 0x7fc4c00899a0 con 0x7fc4d40c4ff0 2023-11-04T01:41:53.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.205+0000 7fc4d8fbd640 1 --2- 172.21.15.77:0/2195886717 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc4b806ae70 0x7fc4b806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:53.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.205+0000 7fc4d8fbd640 1 --2- 172.21.15.77:0/2195886717 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc4b806ae70 0x7fc4b806d330 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8007fd0 tx=0x7fc4c8009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:53.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.209+0000 7fc4d17fa640 1 -- 172.21.15.77:0/2195886717 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc4c0054810 con 0x7fc4d40c4ff0 2023-11-04T01:41:53.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:53.408+0000 7fc4db221640 1 -- 172.21.15.77:0/2195886717 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc4d4074290 con 0x7fc4d40c4ff0 2023-11-04T01:41:54.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.077+0000 7fc4d17fa640 1 -- 172.21.15.77:0/2195886717 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v20) v1 ==== 172+0+0 (secure 0 0 0) 0x7fc4c0057e30 con 0x7fc4d40c4ff0 2023-11-04T01:41:54.083 INFO:teuthology.orchestra.run.smithi077.stderr:new fs with metadata pool 8 and data pool 9 2023-11-04T01:41:54.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.082+0000 7fc4db221640 1 -- 172.21.15.77:0/2195886717 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc4b806ae70 msgr2=0x7fc4b806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:54.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.082+0000 7fc4db221640 1 --2- 172.21.15.77:0/2195886717 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc4b806ae70 0x7fc4b806d330 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8007fd0 tx=0x7fc4c8009040 comp rx=0 tx=0).stop 2023-11-04T01:41:54.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.082+0000 7fc4db221640 1 -- 172.21.15.77:0/2195886717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4d40c4ff0 msgr2=0x7fc4d40c7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:54.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.082+0000 7fc4db221640 1 --2- 172.21.15.77:0/2195886717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4d40c4ff0 0x7fc4d40c7a30 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fc4c000b430 tx=0x7fc4c000b8f0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.085+0000 7fc4db221640 1 -- 172.21.15.77:0/2195886717 shutdown_connections 2023-11-04T01:41:54.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.085+0000 7fc4db221640 1 --2- 172.21.15.77:0/2195886717 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc4b806ae70 0x7fc4b806d330 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.085+0000 7fc4db221640 1 --2- 172.21.15.77:0/2195886717 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc4d4159c00 0x7fc4d40c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.085+0000 7fc4db221640 1 --2- 172.21.15.77:0/2195886717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4d40c4ff0 0x7fc4d40c7a30 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.086+0000 7fc4db221640 1 --2- 172.21.15.77:0/2195886717 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc4d40adac0 0x7fc4d4147400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.086+0000 7fc4db221640 1 -- 172.21.15.77:0/2195886717 >> 172.21.15.77:0/2195886717 conn(0x7fc4d40ce950 msgr2=0x7fc4d40c4200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:54.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.086+0000 7fc4db221640 1 -- 172.21.15.77:0/2195886717 shutdown_connections 2023-11-04T01:41:54.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.087+0000 7fc4db221640 1 -- 172.21.15.77:0/2195886717 wait complete. 2023-11-04T01:41:54.110 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:54.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.211+0000 7f05747e2640 1 Processor -- start 2023-11-04T01:41:54.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.211+0000 7f05747e2640 1 -- start start 2023-11-04T01:41:54.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.212+0000 7f05747e2640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f056c0cde60 0x7f056c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.212+0000 7f05747e2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f056c15daa0 0x7f056c157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.212+0000 7f05747e2640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f056c15e000 con 0x7f056c0ce240 2023-11-04T01:41:54.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.212+0000 7f05747e2640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f056c15e5c0 con 0x7f056c15daa0 2023-11-04T01:41:54.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.212+0000 7f05747e2640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f056c15e2e0 con 0x7f056c0cde60 2023-11-04T01:41:54.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.213+0000 7f0571d7d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f056c15daa0 0x7f056c157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:54.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.213+0000 7f0571d7d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f056c15daa0 0x7f056c157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54744/0 (socket says 172.21.15.77:54744) 2023-11-04T01:41:54.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.213+0000 7f0571d7d640 1 -- 172.21.15.77:0/816742489 learned_addr learned my addr 172.21.15.77:0/816742489 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:54.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.213+0000 7f0571d7d640 1 -- 172.21.15.77:0/816742489 >> v2:172.21.15.122:3300/0 conn(0x7f056c0cde60 msgr2=0x7f056c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:54.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.213+0000 7f0571d7d640 1 --2- 172.21.15.77:0/816742489 >> v2:172.21.15.122:3300/0 conn(0x7f056c0cde60 0x7f056c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.213+0000 7f0571d7d640 1 -- 172.21.15.77:0/816742489 >> v1:172.21.15.122:6789/0 conn(0x7f056c0ce240 legacy=0x7f056c06b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:54.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.213+0000 7f0571d7d640 1 -- 172.21.15.77:0/816742489 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056c0d1120 con 0x7f056c15daa0 2023-11-04T01:41:54.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.214+0000 7f0571d7d640 1 --2- 172.21.15.77:0/816742489 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f056c15daa0 0x7f056c157000 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f056c0b5550 tx=0x7f056002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d926db1baa11f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:54.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.214+0000 7f057157c640 1 -- 172.21.15.77:0/816742489 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0560031870 con 0x7f056c15daa0 2023-11-04T01:41:54.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.214+0000 7f057157c640 1 -- 172.21.15.77:0/816742489 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05600319d0 con 0x7f056c15daa0 2023-11-04T01:41:54.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.214+0000 7f057157c640 1 -- 172.21.15.77:0/816742489 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0560031d60 con 0x7f056c15daa0 2023-11-04T01:41:54.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.214+0000 7f05747e2640 1 -- 172.21.15.77:0/816742489 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f056c15daa0 msgr2=0x7f056c157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:54.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.214+0000 7f05747e2640 1 --2- 172.21.15.77:0/816742489 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f056c15daa0 0x7f056c157000 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f056c0b5550 tx=0x7f056002b910 comp rx=0 tx=0).stop 2023-11-04T01:41:54.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.214+0000 7f05747e2640 1 -- 172.21.15.77:0/816742489 shutdown_connections 2023-11-04T01:41:54.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.214+0000 7f05747e2640 1 --2- 172.21.15.77:0/816742489 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f056c15daa0 0x7f056c157000 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.214+0000 7f05747e2640 1 --2- 172.21.15.77:0/816742489 >> v2:172.21.15.122:3300/0 conn(0x7f056c0cde60 0x7f056c15d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.214+0000 7f05747e2640 1 -- 172.21.15.77:0/816742489 >> 172.21.15.77:0/816742489 conn(0x7f056c071f30 msgr2=0x7f056c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:54.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.214+0000 7f05747e2640 1 -- 172.21.15.77:0/816742489 shutdown_connections 2023-11-04T01:41:54.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.214+0000 7f05747e2640 1 -- 172.21.15.77:0/816742489 wait complete. 2023-11-04T01:41:54.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.215+0000 7f05747e2640 1 Processor -- start 2023-11-04T01:41:54.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.215+0000 7f05747e2640 1 -- start start 2023-11-04T01:41:54.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.216+0000 7f05747e2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f056c0cde60 0x7f056c0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.216+0000 7f05747e2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f056c0ce240 0x7f056c1f5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.216+0000 7f05747e2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f056c15daa0 0x7f056c15c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.216+0000 7f05747e2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c1f6c50 con 0x7f056c0ce240 2023-11-04T01:41:54.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.216+0000 7f05747e2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c1f63b0 con 0x7f056c0cde60 2023-11-04T01:41:54.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.216+0000 7f05747e2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056c1f6690 con 0x7f056c15daa0 2023-11-04T01:41:54.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.216+0000 7f0571d7d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f056c0ce240 0x7f056c1f5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:54.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.216+0000 7f0571d7d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f056c0ce240 0x7f056c1f5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54752/0 (socket says 172.21.15.77:54752) 2023-11-04T01:41:54.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.216+0000 7f0571d7d640 1 -- 172.21.15.77:0/2325569495 learned_addr learned my addr 172.21.15.77:0/2325569495 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:54.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.216+0000 7f057257e640 1 --2- 172.21.15.77:0/2325569495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f056c0cde60 0x7f056c0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:54.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.216+0000 7f0571d7d640 1 -- 172.21.15.77:0/2325569495 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f056c15daa0 msgr2=0x7f056c15c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:54.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.217+0000 7f0571d7d640 1 --2- 172.21.15.77:0/2325569495 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f056c15daa0 0x7f056c15c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.217+0000 7f0571d7d640 1 -- 172.21.15.77:0/2325569495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f056c0cde60 msgr2=0x7f056c0caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:54.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.217+0000 7f0571d7d640 1 --2- 172.21.15.77:0/2325569495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f056c0cde60 0x7f056c0caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.217+0000 7f0571d7d640 1 -- 172.21.15.77:0/2325569495 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05600094d0 con 0x7f056c0ce240 2023-11-04T01:41:54.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.217+0000 7f057257e640 1 --2- 172.21.15.77:0/2325569495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f056c0cde60 0x7f056c0caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:54.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.217+0000 7f0571d7d640 1 --2- 172.21.15.77:0/2325569495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f056c0ce240 0x7f056c1f5cd0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f0560000c00 tx=0x7f05600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:54.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.217+0000 7f056affd640 1 -- 172.21.15.77:0/2325569495 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0560031840 con 0x7f056c0ce240 2023-11-04T01:41:54.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.217+0000 7f056affd640 1 -- 172.21.15.77:0/2325569495 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05600443f0 con 0x7f056c0ce240 2023-11-04T01:41:54.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.217+0000 7f056affd640 1 -- 172.21.15.77:0/2325569495 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05600447a0 con 0x7f056c0ce240 2023-11-04T01:41:54.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.217+0000 7f05747e2640 1 -- 172.21.15.77:0/2325569495 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f056c1f6970 con 0x7f056c0ce240 2023-11-04T01:41:54.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.217+0000 7f05747e2640 1 -- 172.21.15.77:0/2325569495 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f056c15ca20 con 0x7f056c0ce240 2023-11-04T01:41:54.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.218+0000 7f05747e2640 1 -- 172.21.15.77:0/2325569495 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f056c1f26e0 con 0x7f056c0ce240 2023-11-04T01:41:54.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.218+0000 7f056affd640 1 -- 172.21.15.77:0/2325569495 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f056004d450 con 0x7f056c0ce240 2023-11-04T01:41:54.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.218+0000 7f056affd640 1 --2- 172.21.15.77:0/2325569495 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f055806ae70 0x7f055806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.219+0000 7f056affd640 1 -- 172.21.15.77:0/2325569495 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f056002d040 con 0x7f056c0ce240 2023-11-04T01:41:54.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.219+0000 7f057257e640 1 --2- 172.21.15.77:0/2325569495 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f055806ae70 0x7f055806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:54.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.219+0000 7f057257e640 1 --2- 172.21.15.77:0/2325569495 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f055806ae70 0x7f055806d330 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0564006fd0 tx=0x7f0564008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:54.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.223+0000 7f056affd640 1 -- 172.21.15.77:0/2325569495 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f056c1f26e0 con 0x7f056c0ce240 2023-11-04T01:41:54.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.390+0000 7f05747e2640 1 -- 172.21.15.77:0/2325569495 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f056c1f2ac0 con 0x7f056c0ce240 2023-11-04T01:41:54.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.391+0000 7f056affd640 1 -- 172.21.15.77:0/2325569495 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+18524 (secure 0 0 0) 0x7f056c1f2ac0 con 0x7f056c0ce240 2023-11-04T01:41:54.393 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:54.393 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":53,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:41:53.409583+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:41:51.914855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-04T01:41:52.371167+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:54.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.393+0000 7f05747e2640 1 -- 172.21.15.77:0/2325569495 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f055806ae70 msgr2=0x7f055806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:54.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.393+0000 7f05747e2640 1 --2- 172.21.15.77:0/2325569495 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f055806ae70 0x7f055806d330 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0564006fd0 tx=0x7f0564008040 comp rx=0 tx=0).stop 2023-11-04T01:41:54.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.393+0000 7f05747e2640 1 -- 172.21.15.77:0/2325569495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f056c0ce240 msgr2=0x7f056c1f5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:54.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.393+0000 7f05747e2640 1 --2- 172.21.15.77:0/2325569495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f056c0ce240 0x7f056c1f5cd0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f0560000c00 tx=0x7f05600046c0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.393+0000 7f05747e2640 1 -- 172.21.15.77:0/2325569495 shutdown_connections 2023-11-04T01:41:54.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.393+0000 7f05747e2640 1 --2- 172.21.15.77:0/2325569495 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f055806ae70 0x7f055806d330 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.393+0000 7f05747e2640 1 --2- 172.21.15.77:0/2325569495 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f056c15daa0 0x7f056c15c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.393+0000 7f05747e2640 1 --2- 172.21.15.77:0/2325569495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f056c0ce240 0x7f056c1f5cd0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.393+0000 7f05747e2640 1 --2- 172.21.15.77:0/2325569495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f056c0cde60 0x7f056c0caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.393+0000 7f05747e2640 1 -- 172.21.15.77:0/2325569495 >> 172.21.15.77:0/2325569495 conn(0x7f056c071f30 msgr2=0x7f056c0d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:54.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.393+0000 7f05747e2640 1 -- 172.21.15.77:0/2325569495 shutdown_connections 2023-11-04T01:41:54.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.393+0000 7f05747e2640 1 -- 172.21.15.77:0/2325569495 wait complete. 2023-11-04T01:41:54.406 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:54.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.504+0000 7f601cca9640 1 Processor -- start 2023-11-04T01:41:54.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.504+0000 7f601cca9640 1 -- start start 2023-11-04T01:41:54.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.504+0000 7f601cca9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f60180cde60 0x7f601815d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.504+0000 7f601cca9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f601815daa0 0x7f6018157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.504+0000 7f601cca9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f60180ce240 0x7f6018157540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.504+0000 7f601cca9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f601815e5c0 con 0x7f60180cde60 2023-11-04T01:41:54.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.504+0000 7f601cca9640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6018157a80 con 0x7f60180ce240 2023-11-04T01:41:54.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.504+0000 7f601cca9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f601815e000 con 0x7f601815daa0 2023-11-04T01:41:54.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.505+0000 7f601659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f60180cde60 0x7f601815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:54.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.505+0000 7f601659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f60180cde60 0x7f601815d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54756/0 (socket says 172.21.15.77:54756) 2023-11-04T01:41:54.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.505+0000 7f601659c640 1 -- 172.21.15.77:0/1233520652 learned_addr learned my addr 172.21.15.77:0/1233520652 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:54.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.505+0000 7f6016d9d640 1 --2- 172.21.15.77:0/1233520652 >> v2:172.21.15.122:3300/0 conn(0x7f60180ce240 0x7f6018157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:54.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.505+0000 7f600ffff640 1 --2- 172.21.15.77:0/1233520652 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f601815daa0 0x7f6018157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:54.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.505+0000 7f601659c640 1 -- 172.21.15.77:0/1233520652 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f601815daa0 msgr2=0x7f6018157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:54.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.505+0000 7f601659c640 1 --2- 172.21.15.77:0/1233520652 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f601815daa0 0x7f6018157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.505+0000 7f601659c640 1 -- 172.21.15.77:0/1233520652 >> v2:172.21.15.122:3300/0 conn(0x7f60180ce240 msgr2=0x7f6018157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:54.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.505+0000 7f601659c640 1 --2- 172.21.15.77:0/1233520652 >> v2:172.21.15.122:3300/0 conn(0x7f60180ce240 0x7f6018157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.505+0000 7f601659c640 1 -- 172.21.15.77:0/1233520652 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601815e2e0 con 0x7f60180cde60 2023-11-04T01:41:54.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.506+0000 7f601659c640 1 --2- 172.21.15.77:0/1233520652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60180cde60 0x7f601815d560 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f601815df30 tx=0x7f600802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5e74adbd02cad50 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:54.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.506+0000 7f6015d9b640 1 -- 172.21.15.77:0/1233520652 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6008031870 con 0x7f60180cde60 2023-11-04T01:41:54.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.506+0000 7f6015d9b640 1 -- 172.21.15.77:0/1233520652 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60080319d0 con 0x7f60180cde60 2023-11-04T01:41:54.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.506+0000 7f6015d9b640 1 -- 172.21.15.77:0/1233520652 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6008031d60 con 0x7f60180cde60 2023-11-04T01:41:54.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.506+0000 7f601cca9640 1 -- 172.21.15.77:0/1233520652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60180cde60 msgr2=0x7f601815d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:54.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.506+0000 7f601cca9640 1 --2- 172.21.15.77:0/1233520652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60180cde60 0x7f601815d560 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f601815df30 tx=0x7f600802b910 comp rx=0 tx=0).stop 2023-11-04T01:41:54.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.506+0000 7f601cca9640 1 -- 172.21.15.77:0/1233520652 shutdown_connections 2023-11-04T01:41:54.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.506+0000 7f601cca9640 1 --2- 172.21.15.77:0/1233520652 >> v2:172.21.15.122:3300/0 conn(0x7f60180ce240 0x7f6018157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.506+0000 7f601cca9640 1 --2- 172.21.15.77:0/1233520652 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f601815daa0 0x7f6018157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.506+0000 7f601cca9640 1 --2- 172.21.15.77:0/1233520652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60180cde60 0x7f601815d560 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.506+0000 7f601cca9640 1 -- 172.21.15.77:0/1233520652 >> 172.21.15.77:0/1233520652 conn(0x7f6018071f30 msgr2=0x7f60180cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:54.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.506+0000 7f601cca9640 1 -- 172.21.15.77:0/1233520652 shutdown_connections 2023-11-04T01:41:54.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.506+0000 7f601cca9640 1 -- 172.21.15.77:0/1233520652 wait complete. 2023-11-04T01:41:54.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.508+0000 7f601cca9640 1 Processor -- start 2023-11-04T01:41:54.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.508+0000 7f601cca9640 1 -- start start 2023-11-04T01:41:54.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.508+0000 7f601cca9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f60180cde60 0x7f601815a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.508+0000 7f601cca9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60180ce240 0x7f60180cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.508+0000 7f601cca9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f601815daa0 0x7f60181f1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.508+0000 7f601cca9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601815ba70 con 0x7f601815daa0 2023-11-04T01:41:54.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.508+0000 7f601cca9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601815b1d0 con 0x7f60180ce240 2023-11-04T01:41:54.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.508+0000 7f601cca9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f601815b4b0 con 0x7f60180cde60 2023-11-04T01:41:54.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.509+0000 7f6016d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f601815daa0 0x7f60181f1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:54.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.509+0000 7f6016d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f601815daa0 0x7f60181f1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54768/0 (socket says 172.21.15.77:54768) 2023-11-04T01:41:54.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.509+0000 7f6016d9d640 1 -- 172.21.15.77:0/2128936478 learned_addr learned my addr 172.21.15.77:0/2128936478 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:54.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.509+0000 7f600ffff640 1 --2- 172.21.15.77:0/2128936478 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60180ce240 0x7f60180cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:54.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.509+0000 7f601659c640 1 --2- 172.21.15.77:0/2128936478 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f60180cde60 0x7f601815a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:54.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.509+0000 7f6016d9d640 1 -- 172.21.15.77:0/2128936478 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f60180cde60 msgr2=0x7f601815a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:54.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.509+0000 7f6016d9d640 1 --2- 172.21.15.77:0/2128936478 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f60180cde60 0x7f601815a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.509+0000 7f6016d9d640 1 -- 172.21.15.77:0/2128936478 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60180ce240 msgr2=0x7f60180cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:54.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.509+0000 7f6016d9d640 1 --2- 172.21.15.77:0/2128936478 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60180ce240 0x7f60180cccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.509+0000 7f6016d9d640 1 -- 172.21.15.77:0/2128936478 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60080094d0 con 0x7f601815daa0 2023-11-04T01:41:54.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.509+0000 7f600ffff640 1 --2- 172.21.15.77:0/2128936478 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60180ce240 0x7f60180cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:54.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.509+0000 7f6016d9d640 1 --2- 172.21.15.77:0/2128936478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f601815daa0 0x7f60181f1930 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f601000eed0 tx=0x7f601000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:54.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.509+0000 7f600effd640 1 -- 172.21.15.77:0/2128936478 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6010010040 con 0x7f601815daa0 2023-11-04T01:41:54.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.509+0000 7f600effd640 1 -- 172.21.15.77:0/2128936478 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6010014400 con 0x7f601815daa0 2023-11-04T01:41:54.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.509+0000 7f600effd640 1 -- 172.21.15.77:0/2128936478 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6010009ea0 con 0x7f601815daa0 2023-11-04T01:41:54.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.509+0000 7f601cca9640 1 -- 172.21.15.77:0/2128936478 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f601815b790 con 0x7f601815daa0 2023-11-04T01:41:54.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.509+0000 7f601cca9640 1 -- 172.21.15.77:0/2128936478 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f601815aec0 con 0x7f601815daa0 2023-11-04T01:41:54.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.510+0000 7f601cca9640 1 -- 172.21.15.77:0/2128936478 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6018074290 con 0x7f601815daa0 2023-11-04T01:41:54.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.510+0000 7f600effd640 1 -- 172.21.15.77:0/2128936478 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f60100147b0 con 0x7f601815daa0 2023-11-04T01:41:54.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.511+0000 7f600effd640 1 --2- 172.21.15.77:0/2128936478 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5ff806ae70 0x7f5ff806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.511+0000 7f600effd640 1 -- 172.21.15.77:0/2128936478 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f601008a050 con 0x7f601815daa0 2023-11-04T01:41:54.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.511+0000 7f601659c640 1 --2- 172.21.15.77:0/2128936478 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5ff806ae70 0x7f5ff806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:54.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.512+0000 7f601659c640 1 --2- 172.21.15.77:0/2128936478 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5ff806ae70 0x7f5ff806d330 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6008036000 tx=0x7f600803c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:54.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.515+0000 7f600effd640 1 -- 172.21.15.77:0/2128936478 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6010054e60 con 0x7f601815daa0 2023-11-04T01:41:54.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.681+0000 7f601cca9640 1 -- 172.21.15.77:0/2128936478 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60180d2990 con 0x7f601815daa0 2023-11-04T01:41:54.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.682+0000 7f600effd640 1 -- 172.21.15.77:0/2128936478 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+18524 (secure 0 0 0) 0x7f6010018090 con 0x7f601815daa0 2023-11-04T01:41:54.684 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:54.684 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":53,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:41:53.409583+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:41:51.914855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-04T01:41:52.371167+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:54.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.684+0000 7f601cca9640 1 -- 172.21.15.77:0/2128936478 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5ff806ae70 msgr2=0x7f5ff806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:54.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.684+0000 7f601cca9640 1 --2- 172.21.15.77:0/2128936478 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5ff806ae70 0x7f5ff806d330 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6008036000 tx=0x7f600803c040 comp rx=0 tx=0).stop 2023-11-04T01:41:54.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.684+0000 7f601cca9640 1 -- 172.21.15.77:0/2128936478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f601815daa0 msgr2=0x7f60181f1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:54.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.684+0000 7f601cca9640 1 --2- 172.21.15.77:0/2128936478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f601815daa0 0x7f60181f1930 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f601000eed0 tx=0x7f601000b480 comp rx=0 tx=0).stop 2023-11-04T01:41:54.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.684+0000 7f601cca9640 1 -- 172.21.15.77:0/2128936478 shutdown_connections 2023-11-04T01:41:54.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.684+0000 7f601cca9640 1 --2- 172.21.15.77:0/2128936478 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5ff806ae70 0x7f5ff806d330 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.684+0000 7f601cca9640 1 --2- 172.21.15.77:0/2128936478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f601815daa0 0x7f60181f1930 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.684+0000 7f601cca9640 1 --2- 172.21.15.77:0/2128936478 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60180ce240 0x7f60180cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.684+0000 7f601cca9640 1 --2- 172.21.15.77:0/2128936478 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f60180cde60 0x7f601815a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.684+0000 7f601cca9640 1 -- 172.21.15.77:0/2128936478 >> 172.21.15.77:0/2128936478 conn(0x7f6018071f30 msgr2=0x7f6018156dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:54.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.684+0000 7f601cca9640 1 -- 172.21.15.77:0/2128936478 shutdown_connections 2023-11-04T01:41:54.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.684+0000 7f601cca9640 1 -- 172.21.15.77:0/2128936478 wait complete. 2023-11-04T01:41:54.696 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T01:41:54.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.797+0000 7f7a22d5e640 1 Processor -- start 2023-11-04T01:41:54.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.798+0000 7f7a22d5e640 1 -- start start 2023-11-04T01:41:54.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.798+0000 7f7a22d5e640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7a1c159c00 0x7f7a1c0cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.798+0000 7f7a22d5e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7a1c0c48e0 0x7f7a1c0c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.798+0000 7f7a22d5e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a1c15aff0 con 0x7f7a1c0adac0 2023-11-04T01:41:54.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.798+0000 7f7a22d5e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a1c0c52d0 con 0x7f7a1c0c48e0 2023-11-04T01:41:54.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.798+0000 7f7a22d5e640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a1c15a3e0 con 0x7f7a1c159c00 2023-11-04T01:41:54.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.798+0000 7f7a1bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7a1c0c48e0 0x7f7a1c0c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:54.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.799+0000 7f7a212fb640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f7a1c0adac0 0x7f7a1c0adea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57108/0 (socket says 172.21.15.77:57108) 2023-11-04T01:41:54.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.799+0000 7f7a212fb640 1 -- 172.21.15.77:0/2306047109 learned_addr learned my addr 172.21.15.77:0/2306047109 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:54.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.799+0000 7f7a20afa640 1 --2- 172.21.15.77:0/2306047109 >> v2:172.21.15.122:3300/0 conn(0x7f7a1c159c00 0x7f7a1c0cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:54.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.799+0000 7f7a1bfff640 1 -- 172.21.15.77:0/2306047109 >> v2:172.21.15.122:3300/0 conn(0x7f7a1c159c00 msgr2=0x7f7a1c0cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:54.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.799+0000 7f7a1bfff640 1 --2- 172.21.15.77:0/2306047109 >> v2:172.21.15.122:3300/0 conn(0x7f7a1c159c00 0x7f7a1c0cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.799+0000 7f7a1bfff640 1 -- 172.21.15.77:0/2306047109 >> v1:172.21.15.77:6789/0 conn(0x7f7a1c0adac0 legacy=0x7f7a1c0adea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:54.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.799+0000 7f7a1b7fe640 1 -- 172.21.15.77:0/2306047109 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1476303615 0 0) 0x7f7a1c15aff0 con 0x7f7a1c0adac0 2023-11-04T01:41:54.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.799+0000 7f7a1bfff640 1 -- 172.21.15.77:0/2306047109 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1c15a6c0 con 0x7f7a1c0c48e0 2023-11-04T01:41:54.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.800+0000 7f7a1bfff640 1 --2- 172.21.15.77:0/2306047109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a1c0c48e0 0x7f7a1c0c4d90 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c0cc4d0 tx=0x7f7a0802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fdb490f8bc6c15e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:54.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.800+0000 7f7a1b7fe640 1 -- 172.21.15.77:0/2306047109 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0802e070 con 0x7f7a1c0c48e0 2023-11-04T01:41:54.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.800+0000 7f7a1b7fe640 1 -- 172.21.15.77:0/2306047109 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a080315a0 con 0x7f7a1c0c48e0 2023-11-04T01:41:54.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.800+0000 7f7a1b7fe640 1 -- 172.21.15.77:0/2306047109 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a08031930 con 0x7f7a1c0c48e0 2023-11-04T01:41:54.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.800+0000 7f7a22d5e640 1 -- 172.21.15.77:0/2306047109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a1c0c48e0 msgr2=0x7f7a1c0c4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:54.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.800+0000 7f7a22d5e640 1 --2- 172.21.15.77:0/2306047109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a1c0c48e0 0x7f7a1c0c4d90 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c0cc4d0 tx=0x7f7a0802b840 comp rx=0 tx=0).stop 2023-11-04T01:41:54.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.800+0000 7f7a22d5e640 1 -- 172.21.15.77:0/2306047109 shutdown_connections 2023-11-04T01:41:54.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.800+0000 7f7a22d5e640 1 --2- 172.21.15.77:0/2306047109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a1c0c48e0 0x7f7a1c0c4d90 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.800+0000 7f7a22d5e640 1 --2- 172.21.15.77:0/2306047109 >> v2:172.21.15.122:3300/0 conn(0x7f7a1c159c00 0x7f7a1c0cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.800+0000 7f7a22d5e640 1 -- 172.21.15.77:0/2306047109 >> 172.21.15.77:0/2306047109 conn(0x7f7a1c0ce950 msgr2=0x7f7a1c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:54.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.800+0000 7f7a22d5e640 1 -- 172.21.15.77:0/2306047109 shutdown_connections 2023-11-04T01:41:54.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.800+0000 7f7a22d5e640 1 -- 172.21.15.77:0/2306047109 wait complete. 2023-11-04T01:41:54.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.801+0000 7f7a22d5e640 1 Processor -- start 2023-11-04T01:41:54.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.801+0000 7f7a22d5e640 1 -- start start 2023-11-04T01:41:54.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.802+0000 7f7a22d5e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a1c0adac0 0x7f7a1c14f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.802+0000 7f7a22d5e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7a1c0c48e0 0x7f7a1c06da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.802+0000 7f7a22d5e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a1c159c00 0x7f7a1c06df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.802+0000 7f7a22d5e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c1f4900 con 0x7f7a1c159c00 2023-11-04T01:41:54.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.802+0000 7f7a22d5e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c14fb30 con 0x7f7a1c0adac0 2023-11-04T01:41:54.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.802+0000 7f7a22d5e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c1f3a30 con 0x7f7a1c0c48e0 2023-11-04T01:41:54.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.802+0000 7f7a212fb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a1c159c00 0x7f7a1c06df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:54.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.802+0000 7f7a212fb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a1c159c00 0x7f7a1c06df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54786/0 (socket says 172.21.15.77:54786) 2023-11-04T01:41:54.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.802+0000 7f7a212fb640 1 -- 172.21.15.77:0/3705710758 learned_addr learned my addr 172.21.15.77:0/3705710758 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:54.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.803+0000 7f7a1bfff640 1 --2- 172.21.15.77:0/3705710758 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7a1c0c48e0 0x7f7a1c06da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:54.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.803+0000 7f7a20afa640 1 --2- 172.21.15.77:0/3705710758 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a1c0adac0 0x7f7a1c14f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:54.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.803+0000 7f7a212fb640 1 -- 172.21.15.77:0/3705710758 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7a1c0c48e0 msgr2=0x7f7a1c06da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:54.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.803+0000 7f7a212fb640 1 --2- 172.21.15.77:0/3705710758 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7a1c0c48e0 0x7f7a1c06da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.803+0000 7f7a212fb640 1 -- 172.21.15.77:0/3705710758 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a1c0adac0 msgr2=0x7f7a1c14f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:54.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.803+0000 7f7a212fb640 1 --2- 172.21.15.77:0/3705710758 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a1c0adac0 0x7f7a1c14f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:54.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.803+0000 7f7a212fb640 1 -- 172.21.15.77:0/3705710758 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a08009400 con 0x7f7a1c159c00 2023-11-04T01:41:54.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.803+0000 7f7a20afa640 1 --2- 172.21.15.77:0/3705710758 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a1c0adac0 0x7f7a1c14f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:54.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.803+0000 7f7a1bfff640 1 --2- 172.21.15.77:0/3705710758 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7a1c0c48e0 0x7f7a1c06da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:54.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.803+0000 7f7a212fb640 1 --2- 172.21.15.77:0/3705710758 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a1c159c00 0x7f7a1c06df40 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f7a1400c7a0 tx=0x7f7a1400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:54.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.803+0000 7f7a197fa640 1 -- 172.21.15.77:0/3705710758 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1400a640 con 0x7f7a1c159c00 2023-11-04T01:41:54.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.803+0000 7f7a197fa640 1 -- 172.21.15.77:0/3705710758 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1400a7a0 con 0x7f7a1c159c00 2023-11-04T01:41:54.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.803+0000 7f7a197fa640 1 -- 172.21.15.77:0/3705710758 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1400abd0 con 0x7f7a1c159c00 2023-11-04T01:41:54.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.803+0000 7f7a22d5e640 1 -- 172.21.15.77:0/3705710758 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a1c1f3c80 con 0x7f7a1c159c00 2023-11-04T01:41:54.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.803+0000 7f7a22d5e640 1 -- 172.21.15.77:0/3705710758 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a1c1f4240 con 0x7f7a1c159c00 2023-11-04T01:41:54.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.804+0000 7f7a22d5e640 1 -- 172.21.15.77:0/3705710758 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a1c074290 con 0x7f7a1c159c00 2023-11-04T01:41:54.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.804+0000 7f7a197fa640 1 -- 172.21.15.77:0/3705710758 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7a1400ad30 con 0x7f7a1c159c00 2023-11-04T01:41:54.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.805+0000 7f7a197fa640 1 --2- 172.21.15.77:0/3705710758 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7a0006ae70 0x7f7a0006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:54.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.805+0000 7f7a197fa640 1 -- 172.21.15.77:0/3705710758 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7a14088db0 con 0x7f7a1c159c00 2023-11-04T01:41:54.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.805+0000 7f7a20afa640 1 --2- 172.21.15.77:0/3705710758 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7a0006ae70 0x7f7a0006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:54.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.805+0000 7f7a20afa640 1 --2- 172.21.15.77:0/3705710758 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7a0006ae70 0x7f7a0006d330 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7a10009a20 tx=0x7f7a10008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:54.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:54.809+0000 7f7a197fa640 1 -- 172.21.15.77:0/3705710758 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7a14053c50 con 0x7f7a1c159c00 2023-11-04T01:41:55.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.009+0000 7f7a22d5e640 1 -- 172.21.15.77:0/3705710758 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7a1c0cac90 con 0x7f7a1c159c00 2023-11-04T01:41:55.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.075+0000 7f7a197fa640 1 -- 172.21.15.77:0/3705710758 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v21) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7a14018070 con 0x7f7a1c159c00 2023-11-04T01:41:55.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.077+0000 7f7a22d5e640 1 -- 172.21.15.77:0/3705710758 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7a0006ae70 msgr2=0x7f7a0006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.077+0000 7f7a22d5e640 1 --2- 172.21.15.77:0/3705710758 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7a0006ae70 0x7f7a0006d330 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7a10009a20 tx=0x7f7a10008040 comp rx=0 tx=0).stop 2023-11-04T01:41:55.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.077+0000 7f7a22d5e640 1 -- 172.21.15.77:0/3705710758 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a1c159c00 msgr2=0x7f7a1c06df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.077+0000 7f7a22d5e640 1 --2- 172.21.15.77:0/3705710758 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a1c159c00 0x7f7a1c06df40 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f7a1400c7a0 tx=0x7f7a1400cc60 comp rx=0 tx=0).stop 2023-11-04T01:41:55.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.077+0000 7f7a22d5e640 1 -- 172.21.15.77:0/3705710758 shutdown_connections 2023-11-04T01:41:55.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.077+0000 7f7a22d5e640 1 --2- 172.21.15.77:0/3705710758 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7a0006ae70 0x7f7a0006d330 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.077+0000 7f7a22d5e640 1 --2- 172.21.15.77:0/3705710758 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a1c159c00 0x7f7a1c06df40 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.077+0000 7f7a22d5e640 1 --2- 172.21.15.77:0/3705710758 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7a1c0c48e0 0x7f7a1c06da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.077+0000 7f7a22d5e640 1 --2- 172.21.15.77:0/3705710758 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a1c0adac0 0x7f7a1c14f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.077+0000 7f7a22d5e640 1 -- 172.21.15.77:0/3705710758 >> 172.21.15.77:0/3705710758 conn(0x7f7a1c0ce950 msgr2=0x7f7a1c0cd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:55.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.077+0000 7f7a22d5e640 1 -- 172.21.15.77:0/3705710758 shutdown_connections 2023-11-04T01:41:55.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.077+0000 7f7a22d5e640 1 -- 172.21.15.77:0/3705710758 wait complete. 2023-11-04T01:41:55.090 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-04T01:41:55.091 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T01:41:55.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.192+0000 7fb11ca90640 1 Processor -- start 2023-11-04T01:41:55.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.192+0000 7fb11ca90640 1 -- start start 2023-11-04T01:41:55.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.193+0000 7fb11ca90640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb1180ad730 0x7fb1180adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.193+0000 7fb11ca90640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1180c3900 con 0x7fb118070e20 2023-11-04T01:41:55.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.193+0000 7fb11ca90640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1180c3be0 con 0x7fb11815ad30 2023-11-04T01:41:55.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.193+0000 7fb11ca90640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1180ae260 con 0x7fb1180ad730 2023-11-04T01:41:55.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.193+0000 7fb116d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb1180ad730 0x7fb1180adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.193+0000 7fb116d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb1180ad730 0x7fb1180adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54794/0 (socket says 172.21.15.77:54794) 2023-11-04T01:41:55.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.193+0000 7fb116d9d640 1 -- 172.21.15.77:0/4047167026 learned_addr learned my addr 172.21.15.77:0/4047167026 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:55.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.193+0000 7fb115d9b640 1 --1- 172.21.15.77:0/4047167026 >> v1:172.21.15.77:6789/0 conn(0x7fb118070e20 0x7fb11815e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57124/0 (socket says 172.21.15.77:57124) 2023-11-04T01:41:55.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.193+0000 7fb116d9d640 1 -- 172.21.15.77:0/4047167026 >> v1:172.21.15.122:6789/0 conn(0x7fb11815ad30 legacy=0x7fb118070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:55.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.193+0000 7fb116d9d640 1 -- 172.21.15.77:0/4047167026 >> v1:172.21.15.77:6789/0 conn(0x7fb118070e20 legacy=0x7fb11815e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.193+0000 7fb116d9d640 1 -- 172.21.15.77:0/4047167026 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1180c3ec0 con 0x7fb1180ad730 2023-11-04T01:41:55.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.194+0000 7fb116d9d640 1 --2- 172.21.15.77:0/4047167026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1180ad730 0x7fb1180adc80 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb110009e50 tx=0x7fb11002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f81b2d41a01e7e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:55.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.194+0000 7fb11559a640 1 -- 172.21.15.77:0/4047167026 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11002ca80 con 0x7fb1180ad730 2023-11-04T01:41:55.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.194+0000 7fb11559a640 1 -- 172.21.15.77:0/4047167026 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11002cbe0 con 0x7fb1180ad730 2023-11-04T01:41:55.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.194+0000 7fb11559a640 1 -- 172.21.15.77:0/4047167026 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1100343f0 con 0x7fb1180ad730 2023-11-04T01:41:55.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.194+0000 7fb11ca90640 1 -- 172.21.15.77:0/4047167026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1180ad730 msgr2=0x7fb1180adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.194+0000 7fb11ca90640 1 --2- 172.21.15.77:0/4047167026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1180ad730 0x7fb1180adc80 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb110009e50 tx=0x7fb11002bee0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.194+0000 7fb11ca90640 1 -- 172.21.15.77:0/4047167026 shutdown_connections 2023-11-04T01:41:55.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.194+0000 7fb11ca90640 1 --2- 172.21.15.77:0/4047167026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1180ad730 0x7fb1180adc80 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.194+0000 7fb11ca90640 1 -- 172.21.15.77:0/4047167026 >> 172.21.15.77:0/4047167026 conn(0x7fb1180ce950 msgr2=0x7fb1180ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:55.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.194+0000 7fb11ca90640 1 -- 172.21.15.77:0/4047167026 shutdown_connections 2023-11-04T01:41:55.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.194+0000 7fb11ca90640 1 -- 172.21.15.77:0/4047167026 wait complete. 2023-11-04T01:41:55.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.196+0000 7fb11ca90640 1 Processor -- start 2023-11-04T01:41:55.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.196+0000 7fb11ca90640 1 -- start start 2023-11-04T01:41:55.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.196+0000 7fb11ca90640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb118070e20 0x7fb1180c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.196+0000 7fb11ca90640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1180ad730 0x7fb1180c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.196+0000 7fb11ca90640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb11815ad30 0x7fb118144950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.196+0000 7fb11ca90640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1180c6550 con 0x7fb1180ad730 2023-11-04T01:41:55.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.196+0000 7fb11ca90640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1180c7cd0 con 0x7fb118070e20 2023-11-04T01:41:55.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.196+0000 7fb11ca90640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1180c7fb0 con 0x7fb11815ad30 2023-11-04T01:41:55.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.197+0000 7fb115d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1180ad730 0x7fb1180c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.197+0000 7fb115d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1180ad730 0x7fb1180c9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54808/0 (socket says 172.21.15.77:54808) 2023-11-04T01:41:55.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.197+0000 7fb115d9b640 1 -- 172.21.15.77:0/2987210868 learned_addr learned my addr 172.21.15.77:0/2987210868 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:55.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.197+0000 7fb11659c640 1 --2- 172.21.15.77:0/2987210868 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb118070e20 0x7fb1180c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.197+0000 7fb115d9b640 1 -- 172.21.15.77:0/2987210868 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb11815ad30 msgr2=0x7fb118144950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.197+0000 7fb115d9b640 1 --2- 172.21.15.77:0/2987210868 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb11815ad30 0x7fb118144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.197+0000 7fb115d9b640 1 -- 172.21.15.77:0/2987210868 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb118070e20 msgr2=0x7fb1180c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:55.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.197+0000 7fb115d9b640 1 --2- 172.21.15.77:0/2987210868 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb118070e20 0x7fb1180c9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:55.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.197+0000 7fb115d9b640 1 -- 172.21.15.77:0/2987210868 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb110009b30 con 0x7fb1180ad730 2023-11-04T01:41:55.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.197+0000 7fb115d9b640 1 --2- 172.21.15.77:0/2987210868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1180ad730 0x7fb1180c9dd0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fb10c00c400 tx=0x7fb10c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:55.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.197+0000 7fb106ffd640 1 -- 172.21.15.77:0/2987210868 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c0074e0 con 0x7fb1180ad730 2023-11-04T01:41:55.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.197+0000 7fb106ffd640 1 -- 172.21.15.77:0/2987210868 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10c007640 con 0x7fb1180ad730 2023-11-04T01:41:55.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.197+0000 7fb106ffd640 1 -- 172.21.15.77:0/2987210868 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c004a00 con 0x7fb1180ad730 2023-11-04T01:41:55.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.197+0000 7fb11ca90640 1 -- 172.21.15.77:0/2987210868 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1180c8290 con 0x7fb1180ad730 2023-11-04T01:41:55.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.197+0000 7fb11ca90640 1 -- 172.21.15.77:0/2987210868 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1180c8a90 con 0x7fb1180ad730 2023-11-04T01:41:55.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.198+0000 7fb11ca90640 1 -- 172.21.15.77:0/2987210868 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1180c87b0 con 0x7fb1180ad730 2023-11-04T01:41:55.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.198+0000 7fb106ffd640 1 -- 172.21.15.77:0/2987210868 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb10c004b60 con 0x7fb1180ad730 2023-11-04T01:41:55.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.199+0000 7fb106ffd640 1 --2- 172.21.15.77:0/2987210868 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb0f806ae70 0x7fb0f806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:55.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.199+0000 7fb106ffd640 1 -- 172.21.15.77:0/2987210868 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb10c0892b0 con 0x7fb1180ad730 2023-11-04T01:41:55.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.199+0000 7fb11659c640 1 --2- 172.21.15.77:0/2987210868 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb0f806ae70 0x7fb0f806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:55.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.200+0000 7fb11659c640 1 --2- 172.21.15.77:0/2987210868 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb0f806ae70 0x7fb0f806d330 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb118159950 tx=0x7fb108008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:55.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.203+0000 7fb106ffd640 1 -- 172.21.15.77:0/2987210868 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb1180c87b0 con 0x7fb1180ad730 2023-11-04T01:41:55.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:55.403+0000 7fb11ca90640 1 -- 172.21.15.77:0/2987210868 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb1180c87b0 con 0x7fb1180ad730 2023-11-04T01:41:56.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.083+0000 7fb106ffd640 1 -- 172.21.15.77:0/2987210868 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb1180c87b0 con 0x7fb1180ad730 2023-11-04T01:41:56.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.085+0000 7fb11ca90640 1 -- 172.21.15.77:0/2987210868 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb0f806ae70 msgr2=0x7fb0f806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.085+0000 7fb11ca90640 1 --2- 172.21.15.77:0/2987210868 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb0f806ae70 0x7fb0f806d330 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb118159950 tx=0x7fb108008040 comp rx=0 tx=0).stop 2023-11-04T01:41:56.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.085+0000 7fb11ca90640 1 -- 172.21.15.77:0/2987210868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1180ad730 msgr2=0x7fb1180c9dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.085+0000 7fb11ca90640 1 --2- 172.21.15.77:0/2987210868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1180ad730 0x7fb1180c9dd0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fb10c00c400 tx=0x7fb10c00c8c0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.085+0000 7fb11ca90640 1 -- 172.21.15.77:0/2987210868 shutdown_connections 2023-11-04T01:41:56.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.085+0000 7fb11ca90640 1 --2- 172.21.15.77:0/2987210868 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb0f806ae70 0x7fb0f806d330 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.085+0000 7fb11ca90640 1 --2- 172.21.15.77:0/2987210868 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb11815ad30 0x7fb118144950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.085+0000 7fb11ca90640 1 --2- 172.21.15.77:0/2987210868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1180ad730 0x7fb1180c9dd0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.085+0000 7fb11ca90640 1 --2- 172.21.15.77:0/2987210868 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb118070e20 0x7fb1180c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.085+0000 7fb11ca90640 1 -- 172.21.15.77:0/2987210868 >> 172.21.15.77:0/2987210868 conn(0x7fb1180ce950 msgr2=0x7fb11806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:56.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.086+0000 7fb11ca90640 1 -- 172.21.15.77:0/2987210868 shutdown_connections 2023-11-04T01:41:56.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.086+0000 7fb11ca90640 1 -- 172.21.15.77:0/2987210868 wait complete. 2023-11-04T01:41:56.099 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T01:41:56.100 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:41:56.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.201+0000 7fe43dfd0640 1 Processor -- start 2023-11-04T01:41:56.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.201+0000 7fe43dfd0640 1 -- start start 2023-11-04T01:41:56.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.202+0000 7fe43dfd0640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe4380cda60 0x7fe4380ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.202+0000 7fe43dfd0640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe438070d40 0x7fe43806c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.202+0000 7fe43dfd0640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4380cc990 con 0x7fe4380b0cd0 2023-11-04T01:41:56.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.202+0000 7fe43dfd0640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4380ccc70 con 0x7fe4380cda60 2023-11-04T01:41:56.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.202+0000 7fe43dfd0640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4380c9ce0 con 0x7fe438070d40 2023-11-04T01:41:56.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.202+0000 7fe4377fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe4380cda60 0x7fe4380ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.202+0000 7fe437fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe438070d40 0x7fe43806c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.202+0000 7fe436ffd640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fe4380b0cd0 0x7fe438070630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:34086/0 (socket says 172.21.15.77:34086) 2023-11-04T01:41:56.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.202+0000 7fe4377fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe4380cda60 0x7fe4380ca7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:50284/0 (socket says 172.21.15.77:50284) 2023-11-04T01:41:56.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.202+0000 7fe436ffd640 1 -- 172.21.15.77:0/126953634 learned_addr learned my addr 172.21.15.77:0/126953634 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:56.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.202+0000 7fe4377fe640 1 -- 172.21.15.77:0/126953634 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe438070d40 msgr2=0x7fe43806c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:56.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.202+0000 7fe4377fe640 1 --2- 172.21.15.77:0/126953634 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe438070d40 0x7fe43806c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.202+0000 7fe4377fe640 1 -- 172.21.15.77:0/126953634 >> v1:172.21.15.122:6789/0 conn(0x7fe4380b0cd0 legacy=0x7fe438070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.202+0000 7fe4377fe640 1 -- 172.21.15.77:0/126953634 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4380c9fc0 con 0x7fe4380cda60 2023-11-04T01:41:56.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.202+0000 7fe4367fc640 1 -- 172.21.15.77:0/126953634 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2886645952 0 0) 0x7fe4380cc990 con 0x7fe4380b0cd0 2023-11-04T01:41:56.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.202+0000 7fe437fff640 1 --2- 172.21.15.77:0/126953634 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe438070d40 0x7fe43806c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:41:56.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.203+0000 7fe4377fe640 1 --2- 172.21.15.77:0/126953634 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4380cda60 0x7fe4380ca7a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe42c0097a0 tx=0x7fe42c02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5082d6433977918c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:56.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.203+0000 7fe4367fc640 1 -- 172.21.15.77:0/126953634 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c02d040 con 0x7fe4380cda60 2023-11-04T01:41:56.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.203+0000 7fe4367fc640 1 -- 172.21.15.77:0/126953634 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42c031810 con 0x7fe4380cda60 2023-11-04T01:41:56.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.203+0000 7fe4367fc640 1 -- 172.21.15.77:0/126953634 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c031ba0 con 0x7fe4380cda60 2023-11-04T01:41:56.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.204+0000 7fe43dfd0640 1 -- 172.21.15.77:0/126953634 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4380cda60 msgr2=0x7fe4380ca7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.204+0000 7fe43dfd0640 1 --2- 172.21.15.77:0/126953634 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4380cda60 0x7fe4380ca7a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe42c0097a0 tx=0x7fe42c02b8b0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.204+0000 7fe43dfd0640 1 -- 172.21.15.77:0/126953634 shutdown_connections 2023-11-04T01:41:56.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.204+0000 7fe43dfd0640 1 --2- 172.21.15.77:0/126953634 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe438070d40 0x7fe43806c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.204+0000 7fe43dfd0640 1 --2- 172.21.15.77:0/126953634 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4380cda60 0x7fe4380ca7a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.204+0000 7fe43dfd0640 1 -- 172.21.15.77:0/126953634 >> 172.21.15.77:0/126953634 conn(0x7fe4380ce950 msgr2=0x7fe4380ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:56.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.204+0000 7fe43dfd0640 1 -- 172.21.15.77:0/126953634 shutdown_connections 2023-11-04T01:41:56.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.204+0000 7fe43dfd0640 1 -- 172.21.15.77:0/126953634 wait complete. 2023-11-04T01:41:56.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.205+0000 7fe43dfd0640 1 Processor -- start 2023-11-04T01:41:56.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.205+0000 7fe43dfd0640 1 -- start start 2023-11-04T01:41:56.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.206+0000 7fe43dfd0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe438070d40 0x7fe43814ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.206+0000 7fe43dfd0640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4380b0cd0 0x7fe4380c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.206+0000 7fe43dfd0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4380cda60 0x7fe4380c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.206+0000 7fe43dfd0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43814e300 con 0x7fe438070d40 2023-11-04T01:41:56.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.206+0000 7fe43dfd0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4381e2a70 con 0x7fe4380cda60 2023-11-04T01:41:56.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.206+0000 7fe43dfd0640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4380a9cf0 con 0x7fe4380b0cd0 2023-11-04T01:41:56.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.206+0000 7fe4377fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe438070d40 0x7fe43814ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.206+0000 7fe4377fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe438070d40 0x7fe43814ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54812/0 (socket says 172.21.15.77:54812) 2023-11-04T01:41:56.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.206+0000 7fe4377fe640 1 -- 172.21.15.77:0/4222698252 learned_addr learned my addr 172.21.15.77:0/4222698252 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:56.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.206+0000 7fe436ffd640 1 --2- 172.21.15.77:0/4222698252 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4380b0cd0 0x7fe4380c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.206+0000 7fe437fff640 1 --2- 172.21.15.77:0/4222698252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4380cda60 0x7fe4380c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.206+0000 7fe4377fe640 1 -- 172.21.15.77:0/4222698252 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4380b0cd0 msgr2=0x7fe4380c7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.206+0000 7fe4377fe640 1 --2- 172.21.15.77:0/4222698252 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4380b0cd0 0x7fe4380c7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.206+0000 7fe4377fe640 1 -- 172.21.15.77:0/4222698252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4380cda60 msgr2=0x7fe4380c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.206+0000 7fe4377fe640 1 --2- 172.21.15.77:0/4222698252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4380cda60 0x7fe4380c80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.206+0000 7fe4377fe640 1 -- 172.21.15.77:0/4222698252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe43000ab80 con 0x7fe438070d40 2023-11-04T01:41:56.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.206+0000 7fe4377fe640 1 --2- 172.21.15.77:0/4222698252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe438070d40 0x7fe43814ddc0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fe42c000c00 tx=0x7fe42c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:56.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.207+0000 7fe41ffff640 1 -- 172.21.15.77:0/4222698252 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c006e10 con 0x7fe438070d40 2023-11-04T01:41:56.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.207+0000 7fe41ffff640 1 -- 172.21.15.77:0/4222698252 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42c03ad60 con 0x7fe438070d40 2023-11-04T01:41:56.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.207+0000 7fe43dfd0640 1 -- 172.21.15.77:0/4222698252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe42c009400 con 0x7fe438070d40 2023-11-04T01:41:56.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.207+0000 7fe41ffff640 1 -- 172.21.15.77:0/4222698252 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c044630 con 0x7fe438070d40 2023-11-04T01:41:56.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.207+0000 7fe43dfd0640 1 -- 172.21.15.77:0/4222698252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4380aa2b0 con 0x7fe438070d40 2023-11-04T01:41:56.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.208+0000 7fe43dfd0640 1 -- 172.21.15.77:0/4222698252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4380ca280 con 0x7fe438070d40 2023-11-04T01:41:56.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.208+0000 7fe41ffff640 1 -- 172.21.15.77:0/4222698252 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe42c04d450 con 0x7fe438070d40 2023-11-04T01:41:56.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.208+0000 7fe41ffff640 1 --2- 172.21.15.77:0/4222698252 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe42406ae70 0x7fe42406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.208+0000 7fe41ffff640 1 -- 172.21.15.77:0/4222698252 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe42c0ab8a0 con 0x7fe438070d40 2023-11-04T01:41:56.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.209+0000 7fe436ffd640 1 --2- 172.21.15.77:0/4222698252 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe42406ae70 0x7fe42406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.209+0000 7fe436ffd640 1 --2- 172.21.15.77:0/4222698252 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe42406ae70 0x7fe42406d330 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe4381e2ce0 tx=0x7fe428007d50 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:56.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.213+0000 7fe41ffff640 1 -- 172.21.15.77:0/4222698252 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe4380ca280 con 0x7fe438070d40 2023-11-04T01:41:56.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.415+0000 7fe43dfd0640 1 -- 172.21.15.77:0/4222698252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4380ca280 con 0x7fe438070d40 2023-11-04T01:41:56.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.416+0000 7fe41ffff640 1 -- 172.21.15.77:0/4222698252 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4919 (secure 0 0 0) 0x7fe4380ca280 con 0x7fe438070d40 2023-11-04T01:41:56.418 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:56.418 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5458,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2636406417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2636406417},{"type":"v1","addr":"172.21.15.122:6836","nonce":2636406417}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5461,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/2931907615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":2931907615},{"type":"v1","addr":"172.21.15.122:6837","nonce":2931907615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5955,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1507226082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1507226082},{"type":"v1","addr":"172.21.15.77:6833","nonce":1507226082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:41:53.409913+0000","modified":"2023-11-04T01:41:55.404636+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5958},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5958":{"gid":5958,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6835/1237968770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1237968770},{"type":"v1","addr":"172.21.15.77:6835","nonce":1237968770}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-04T01:41:56.419 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 22 2023-11-04T01:41:56.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.417+0000 7fe43dfd0640 1 -- 172.21.15.77:0/4222698252 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe42406ae70 msgr2=0x7fe42406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.417+0000 7fe43dfd0640 1 --2- 172.21.15.77:0/4222698252 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe42406ae70 0x7fe42406d330 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe4381e2ce0 tx=0x7fe428007d50 comp rx=0 tx=0).stop 2023-11-04T01:41:56.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.417+0000 7fe43dfd0640 1 -- 172.21.15.77:0/4222698252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe438070d40 msgr2=0x7fe43814ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.417+0000 7fe43dfd0640 1 --2- 172.21.15.77:0/4222698252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe438070d40 0x7fe43814ddc0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fe42c000c00 tx=0x7fe42c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.417+0000 7fe43dfd0640 1 -- 172.21.15.77:0/4222698252 shutdown_connections 2023-11-04T01:41:56.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.417+0000 7fe43dfd0640 1 --2- 172.21.15.77:0/4222698252 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe42406ae70 0x7fe42406d330 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.417+0000 7fe43dfd0640 1 --2- 172.21.15.77:0/4222698252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4380cda60 0x7fe4380c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.417+0000 7fe43dfd0640 1 --2- 172.21.15.77:0/4222698252 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4380b0cd0 0x7fe4380c7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.417+0000 7fe43dfd0640 1 --2- 172.21.15.77:0/4222698252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe438070d40 0x7fe43814ddc0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.417+0000 7fe43dfd0640 1 -- 172.21.15.77:0/4222698252 >> 172.21.15.77:0/4222698252 conn(0x7fe4380ce950 msgr2=0x7fe438072ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:56.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.418+0000 7fe43dfd0640 1 -- 172.21.15.77:0/4222698252 shutdown_connections 2023-11-04T01:41:56.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.418+0000 7fe43dfd0640 1 -- 172.21.15.77:0/4222698252 wait complete. 2023-11-04T01:41:56.430 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:41:56.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.527+0000 7fd89bc61640 1 Processor -- start 2023-11-04T01:41:56.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.528+0000 7fd89bc61640 1 -- start start 2023-11-04T01:41:56.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.528+0000 7fd89bc61640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd8940aec80 0x7fd8940b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.528+0000 7fd89bc61640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd89406ef40 0x7fd8940cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.528+0000 7fd89bc61640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8940b1590 con 0x7fd8940af060 2023-11-04T01:41:56.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.528+0000 7fd89bc61640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd894155a40 con 0x7fd89406ef40 2023-11-04T01:41:56.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.528+0000 7fd89bc61640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd89406a8e0 con 0x7fd8940aec80 2023-11-04T01:41:56.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.529+0000 7fd89a1fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd89406ef40 0x7fd8940cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.529+0000 7fd8991fc640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd8940af060 0x7fd89406a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57128/0 (socket says 172.21.15.77:57128) 2023-11-04T01:41:56.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.529+0000 7fd8991fc640 1 -- 172.21.15.77:0/3836289167 learned_addr learned my addr 172.21.15.77:0/3836289167 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:56.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.529+0000 7fd8999fd640 1 --2- 172.21.15.77:0/3836289167 >> v2:172.21.15.122:3300/0 conn(0x7fd8940aec80 0x7fd8940b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.529+0000 7fd89a1fe640 1 -- 172.21.15.77:0/3836289167 >> v2:172.21.15.122:3300/0 conn(0x7fd8940aec80 msgr2=0x7fd8940b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:56.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.529+0000 7fd89a1fe640 1 --2- 172.21.15.77:0/3836289167 >> v2:172.21.15.122:3300/0 conn(0x7fd8940aec80 0x7fd8940b1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.529+0000 7fd89a1fe640 1 -- 172.21.15.77:0/3836289167 >> v1:172.21.15.77:6789/0 conn(0x7fd8940af060 legacy=0x7fd89406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.529+0000 7fd89a1fe640 1 -- 172.21.15.77:0/3836289167 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8940b1800 con 0x7fd89406ef40 2023-11-04T01:41:56.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.529+0000 7fd8989fb640 1 -- 172.21.15.77:0/3836289167 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 155540908 0 0) 0x7fd8940b1590 con 0x7fd8940af060 2023-11-04T01:41:56.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.530+0000 7fd89a1fe640 1 --2- 172.21.15.77:0/3836289167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd89406ef40 0x7fd8940cb7a0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd89406f440 tx=0x7fd88402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c866141a29d5267 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:56.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.530+0000 7fd8989fb640 1 -- 172.21.15.77:0/3836289167 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88402cc80 con 0x7fd89406ef40 2023-11-04T01:41:56.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.530+0000 7fd8989fb640 1 -- 172.21.15.77:0/3836289167 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88402cde0 con 0x7fd89406ef40 2023-11-04T01:41:56.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.530+0000 7fd8989fb640 1 -- 172.21.15.77:0/3836289167 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd884034660 con 0x7fd89406ef40 2023-11-04T01:41:56.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.530+0000 7fd89bc61640 1 -- 172.21.15.77:0/3836289167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd89406ef40 msgr2=0x7fd8940cb7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.530+0000 7fd89bc61640 1 --2- 172.21.15.77:0/3836289167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd89406ef40 0x7fd8940cb7a0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd89406f440 tx=0x7fd88402bed0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.530+0000 7fd89bc61640 1 -- 172.21.15.77:0/3836289167 shutdown_connections 2023-11-04T01:41:56.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.530+0000 7fd89bc61640 1 --2- 172.21.15.77:0/3836289167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd89406ef40 0x7fd8940cb7a0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.530+0000 7fd89bc61640 1 --2- 172.21.15.77:0/3836289167 >> v2:172.21.15.122:3300/0 conn(0x7fd8940aec80 0x7fd8940b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.530+0000 7fd89bc61640 1 -- 172.21.15.77:0/3836289167 >> 172.21.15.77:0/3836289167 conn(0x7fd894098d40 msgr2=0x7fd8940cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:56.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.530+0000 7fd89bc61640 1 -- 172.21.15.77:0/3836289167 shutdown_connections 2023-11-04T01:41:56.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.531+0000 7fd89bc61640 1 -- 172.21.15.77:0/3836289167 wait complete. 2023-11-04T01:41:56.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.532+0000 7fd89bc61640 1 Processor -- start 2023-11-04T01:41:56.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.532+0000 7fd89bc61640 1 -- start start 2023-11-04T01:41:56.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.532+0000 7fd89bc61640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd89406ef40 0x7fd89414cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.532+0000 7fd89bc61640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8940aec80 0x7fd89415d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.532+0000 7fd89bc61640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd8940af060 0x7fd8940ad610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.532+0000 7fd89bc61640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8940c6ab0 con 0x7fd8940aec80 2023-11-04T01:41:56.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.532+0000 7fd89bc61640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8941f15d0 con 0x7fd8940af060 2023-11-04T01:41:56.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.532+0000 7fd89bc61640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8941f18b0 con 0x7fd89406ef40 2023-11-04T01:41:56.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.532+0000 7fd8991fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8940aec80 0x7fd89415d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.532+0000 7fd8991fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8940aec80 0x7fd89415d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54834/0 (socket says 172.21.15.77:54834) 2023-11-04T01:41:56.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.532+0000 7fd8991fc640 1 -- 172.21.15.77:0/2093078184 learned_addr learned my addr 172.21.15.77:0/2093078184 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:56.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.533+0000 7fd89a1fe640 1 --2- 172.21.15.77:0/2093078184 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd8940af060 0x7fd8940ad610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.533+0000 7fd8999fd640 1 --2- 172.21.15.77:0/2093078184 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd89406ef40 0x7fd89414cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.533+0000 7fd8991fc640 1 -- 172.21.15.77:0/2093078184 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd89406ef40 msgr2=0x7fd89414cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.533+0000 7fd8991fc640 1 --2- 172.21.15.77:0/2093078184 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd89406ef40 0x7fd89414cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.533+0000 7fd8991fc640 1 -- 172.21.15.77:0/2093078184 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd8940af060 msgr2=0x7fd8940ad610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.533+0000 7fd8991fc640 1 --2- 172.21.15.77:0/2093078184 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd8940af060 0x7fd8940ad610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.533+0000 7fd8991fc640 1 -- 172.21.15.77:0/2093078184 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd884009a70 con 0x7fd8940aec80 2023-11-04T01:41:56.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.533+0000 7fd8999fd640 1 --2- 172.21.15.77:0/2093078184 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd89406ef40 0x7fd89414cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:56.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.533+0000 7fd8991fc640 1 --2- 172.21.15.77:0/2093078184 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8940aec80 0x7fd89415d210 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fd88800c410 tx=0x7fd88800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:56.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.533+0000 7fd8927fc640 1 -- 172.21.15.77:0/2093078184 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8880074e0 con 0x7fd8940aec80 2023-11-04T01:41:56.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.533+0000 7fd8927fc640 1 -- 172.21.15.77:0/2093078184 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8880057a0 con 0x7fd8940aec80 2023-11-04T01:41:56.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.533+0000 7fd89bc61640 1 -- 172.21.15.77:0/2093078184 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8941f1b90 con 0x7fd8940aec80 2023-11-04T01:41:56.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.533+0000 7fd8927fc640 1 -- 172.21.15.77:0/2093078184 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd888007660 con 0x7fd8940aec80 2023-11-04T01:41:56.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.533+0000 7fd89bc61640 1 -- 172.21.15.77:0/2093078184 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8941f2150 con 0x7fd8940aec80 2023-11-04T01:41:56.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.534+0000 7fd89bc61640 1 -- 172.21.15.77:0/2093078184 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8940cbc80 con 0x7fd8940aec80 2023-11-04T01:41:56.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.534+0000 7fd8927fc640 1 -- 172.21.15.77:0/2093078184 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd888005bd0 con 0x7fd8940aec80 2023-11-04T01:41:56.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.535+0000 7fd8927fc640 1 --2- 172.21.15.77:0/2093078184 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd88006ae70 0x7fd88006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.535+0000 7fd8927fc640 1 -- 172.21.15.77:0/2093078184 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd888088f00 con 0x7fd8940aec80 2023-11-04T01:41:56.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.535+0000 7fd8999fd640 1 --2- 172.21.15.77:0/2093078184 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd88006ae70 0x7fd88006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.535+0000 7fd8999fd640 1 --2- 172.21.15.77:0/2093078184 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd88006ae70 0x7fd88006d330 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd88c006fd0 tx=0x7fd88c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:56.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.539+0000 7fd8927fc640 1 -- 172.21.15.77:0/2093078184 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd888053d10 con 0x7fd8940aec80 2023-11-04T01:41:56.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.710+0000 7fd89bc61640 1 -- 172.21.15.77:0/2093078184 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd894074290 con 0x7fd8940aec80 2023-11-04T01:41:56.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.711+0000 7fd8927fc640 1 -- 172.21.15.77:0/2093078184 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+18511 (secure 0 0 0) 0x7fd888017020 con 0x7fd8940aec80 2023-11-04T01:41:56.713 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:56.713 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":54,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:41:55.075378+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:41:51.914855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-04T01:41:52.371167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:41:56.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.713+0000 7fd89bc61640 1 -- 172.21.15.77:0/2093078184 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd88006ae70 msgr2=0x7fd88006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.713+0000 7fd89bc61640 1 --2- 172.21.15.77:0/2093078184 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd88006ae70 0x7fd88006d330 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd88c006fd0 tx=0x7fd88c008040 comp rx=0 tx=0).stop 2023-11-04T01:41:56.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.713+0000 7fd89bc61640 1 -- 172.21.15.77:0/2093078184 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8940aec80 msgr2=0x7fd89415d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.713+0000 7fd89bc61640 1 --2- 172.21.15.77:0/2093078184 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8940aec80 0x7fd89415d210 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fd88800c410 tx=0x7fd88800c8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.713+0000 7fd89bc61640 1 -- 172.21.15.77:0/2093078184 shutdown_connections 2023-11-04T01:41:56.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.713+0000 7fd89bc61640 1 --2- 172.21.15.77:0/2093078184 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd88006ae70 0x7fd88006d330 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.713+0000 7fd89bc61640 1 --2- 172.21.15.77:0/2093078184 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd8940af060 0x7fd8940ad610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.713+0000 7fd89bc61640 1 --2- 172.21.15.77:0/2093078184 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8940aec80 0x7fd89415d210 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.713+0000 7fd89bc61640 1 --2- 172.21.15.77:0/2093078184 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd89406ef40 0x7fd89414cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.713+0000 7fd89bc61640 1 -- 172.21.15.77:0/2093078184 >> 172.21.15.77:0/2093078184 conn(0x7fd894098d40 msgr2=0x7fd8940cc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:56.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.713+0000 7fd89bc61640 1 -- 172.21.15.77:0/2093078184 shutdown_connections 2023-11-04T01:41:56.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.713+0000 7fd89bc61640 1 -- 172.21.15.77:0/2093078184 wait complete. 2023-11-04T01:41:56.726 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T01:41:56.726 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:41:56.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.824+0000 7f67405d0640 1 Processor -- start 2023-11-04T01:41:56.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.824+0000 7f67405d0640 1 -- start start 2023-11-04T01:41:56.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.825+0000 7f67405d0640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f67380b0ae0 0x7f67380ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.825+0000 7f67405d0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f673806db20 0x7f673815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.825+0000 7f67405d0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67380b4110 con 0x7f6738159c70 2023-11-04T01:41:56.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.825+0000 7f67405d0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67380b49b0 con 0x7f673806db20 2023-11-04T01:41:56.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.825+0000 7f67405d0640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67380b43f0 con 0x7f67380b0ae0 2023-11-04T01:41:56.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.826+0000 7f673eb6d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f673806db20 0x7f673815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.826+0000 7f673e36c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6738159c70 0x7f67380b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57144/0 (socket says 172.21.15.77:57144) 2023-11-04T01:41:56.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.826+0000 7f673eb6d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f673806db20 0x7f673815d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54838/0 (socket says 172.21.15.77:54838) 2023-11-04T01:41:56.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.826+0000 7f673e36c640 1 -- 172.21.15.77:0/1314783350 learned_addr learned my addr 172.21.15.77:0/1314783350 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:56.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.826+0000 7f673eb6d640 1 -- 172.21.15.77:0/1314783350 >> v2:172.21.15.122:3300/0 conn(0x7f67380b0ae0 msgr2=0x7f67380ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:56.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.826+0000 7f673db6b640 1 --2- 172.21.15.77:0/1314783350 >> v2:172.21.15.122:3300/0 conn(0x7f67380b0ae0 0x7f67380ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.826+0000 7f673eb6d640 1 --2- 172.21.15.77:0/1314783350 >> v2:172.21.15.122:3300/0 conn(0x7f67380b0ae0 0x7f67380ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.826+0000 7f673d36a640 1 -- 172.21.15.77:0/1314783350 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2942588749 0 0) 0x7f67380b4110 con 0x7f6738159c70 2023-11-04T01:41:56.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.826+0000 7f673eb6d640 1 -- 172.21.15.77:0/1314783350 >> v1:172.21.15.77:6789/0 conn(0x7f6738159c70 legacy=0x7f67380b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.826+0000 7f673eb6d640 1 -- 172.21.15.77:0/1314783350 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67380b46d0 con 0x7f673806db20 2023-11-04T01:41:56.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.826+0000 7f673db6b640 1 --2- 172.21.15.77:0/1314783350 >> v2:172.21.15.122:3300/0 conn(0x7f67380b0ae0 0x7f67380ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:56.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.827+0000 7f673eb6d640 1 --2- 172.21.15.77:0/1314783350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f673806db20 0x7f673815d7d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f67380cf800 tx=0x7f673002e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff8b88464527c6e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:56.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.827+0000 7f673d36a640 1 -- 172.21.15.77:0/1314783350 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673002ea60 con 0x7f673806db20 2023-11-04T01:41:56.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.827+0000 7f673d36a640 1 -- 172.21.15.77:0/1314783350 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673002ebc0 con 0x7f673806db20 2023-11-04T01:41:56.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.827+0000 7f673d36a640 1 -- 172.21.15.77:0/1314783350 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6730009540 con 0x7f673806db20 2023-11-04T01:41:56.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.827+0000 7f67405d0640 1 -- 172.21.15.77:0/1314783350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f673806db20 msgr2=0x7f673815d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.827+0000 7f67405d0640 1 --2- 172.21.15.77:0/1314783350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f673806db20 0x7f673815d7d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f67380cf800 tx=0x7f673002e0c0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.827+0000 7f67405d0640 1 -- 172.21.15.77:0/1314783350 shutdown_connections 2023-11-04T01:41:56.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.827+0000 7f67405d0640 1 --2- 172.21.15.77:0/1314783350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f673806db20 0x7f673815d7d0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.827+0000 7f67405d0640 1 --2- 172.21.15.77:0/1314783350 >> v2:172.21.15.122:3300/0 conn(0x7f67380b0ae0 0x7f67380ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.827+0000 7f67405d0640 1 -- 172.21.15.77:0/1314783350 >> 172.21.15.77:0/1314783350 conn(0x7f67380ce950 msgr2=0x7f67380ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:56.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.827+0000 7f67405d0640 1 -- 172.21.15.77:0/1314783350 shutdown_connections 2023-11-04T01:41:56.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.827+0000 7f67405d0640 1 -- 172.21.15.77:0/1314783350 wait complete. 2023-11-04T01:41:56.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.828+0000 7f67405d0640 1 Processor -- start 2023-11-04T01:41:56.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.828+0000 7f67405d0640 1 -- start start 2023-11-04T01:41:56.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.829+0000 7f67405d0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f673806db20 0x7f6738154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.829+0000 7f67405d0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67380b0ae0 0x7f673815c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.829+0000 7f67405d0640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6738159c70 0x7f673815c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.829+0000 7f67405d0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673815ac70 con 0x7f67380b0ae0 2023-11-04T01:41:56.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.829+0000 7f67405d0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673815af50 con 0x7f673806db20 2023-11-04T01:41:56.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.829+0000 7f67405d0640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f673815b230 con 0x7f6738159c70 2023-11-04T01:41:56.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.829+0000 7f673db6b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67380b0ae0 0x7f673815c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.829+0000 7f673db6b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67380b0ae0 0x7f673815c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54848/0 (socket says 172.21.15.77:54848) 2023-11-04T01:41:56.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.829+0000 7f673db6b640 1 -- 172.21.15.77:0/81195970 learned_addr learned my addr 172.21.15.77:0/81195970 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:56.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.829+0000 7f673e36c640 1 --2- 172.21.15.77:0/81195970 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f673806db20 0x7f6738154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.829+0000 7f673eb6d640 1 --2- 172.21.15.77:0/81195970 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6738159c70 0x7f673815c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.830+0000 7f673db6b640 1 -- 172.21.15.77:0/81195970 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6738159c70 msgr2=0x7f673815c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.830+0000 7f673db6b640 1 --2- 172.21.15.77:0/81195970 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6738159c70 0x7f673815c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.830+0000 7f673db6b640 1 -- 172.21.15.77:0/81195970 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f673806db20 msgr2=0x7f6738154010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:56.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.830+0000 7f673db6b640 1 --2- 172.21.15.77:0/81195970 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f673806db20 0x7f6738154010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:56.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.830+0000 7f673db6b640 1 -- 172.21.15.77:0/81195970 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f673000bc80 con 0x7f67380b0ae0 2023-11-04T01:41:56.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.830+0000 7f673db6b640 1 --2- 172.21.15.77:0/81195970 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67380b0ae0 0x7f673815c260 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f672800c7f0 tx=0x7f672800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:56.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.830+0000 7f672effd640 1 -- 172.21.15.77:0/81195970 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6728007a30 con 0x7f67380b0ae0 2023-11-04T01:41:56.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.830+0000 7f672effd640 1 -- 172.21.15.77:0/81195970 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6728007b90 con 0x7f67380b0ae0 2023-11-04T01:41:56.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.830+0000 7f672effd640 1 -- 172.21.15.77:0/81195970 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672800ce40 con 0x7f67380b0ae0 2023-11-04T01:41:56.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.830+0000 7f67405d0640 1 -- 172.21.15.77:0/81195970 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f673815b510 con 0x7f67380b0ae0 2023-11-04T01:41:56.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.830+0000 7f67405d0640 1 -- 172.21.15.77:0/81195970 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6738150ff0 con 0x7f67380b0ae0 2023-11-04T01:41:56.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.831+0000 7f67405d0640 1 -- 172.21.15.77:0/81195970 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67380c7150 con 0x7f67380b0ae0 2023-11-04T01:41:56.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.831+0000 7f672effd640 1 -- 172.21.15.77:0/81195970 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f67280113f0 con 0x7f67380b0ae0 2023-11-04T01:41:56.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.832+0000 7f672effd640 1 --2- 172.21.15.77:0/81195970 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f671c06aea0 0x7f671c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:56.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.832+0000 7f672effd640 1 -- 172.21.15.77:0/81195970 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f67280898c0 con 0x7f67380b0ae0 2023-11-04T01:41:56.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.832+0000 7f673e36c640 1 --2- 172.21.15.77:0/81195970 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f671c06aea0 0x7f671c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:56.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.832+0000 7f673e36c640 1 --2- 172.21.15.77:0/81195970 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f671c06aea0 0x7f671c06d360 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6734000f60 tx=0x7f6734007d50 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:56.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.836+0000 7f672effd640 1 -- 172.21.15.77:0/81195970 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6728054810 con 0x7f67380b0ae0 2023-11-04T01:41:56.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:56.998+0000 7f67405d0640 1 -- 172.21.15.77:0/81195970 --> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f67380cde50 con 0x7f671c06aea0 2023-11-04T01:41:57.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.007+0000 7f672effd640 1 -- 172.21.15.77:0/81195970 <== mgr.4123 v2:172.21.15.122:6832/2275325762 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+356327 (secure 0 0 0) 0x7f6734004c70 con 0x7f671c06aea0 2023-11-04T01:41:57.012 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:57.014 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-04T01:41:57.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.010+0000 7f67405d0640 1 -- 172.21.15.77:0/81195970 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f671c06aea0 msgr2=0x7f671c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.010+0000 7f67405d0640 1 --2- 172.21.15.77:0/81195970 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f671c06aea0 0x7f671c06d360 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6734000f60 tx=0x7f6734007d50 comp rx=0 tx=0).stop 2023-11-04T01:41:57.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.010+0000 7f67405d0640 1 -- 172.21.15.77:0/81195970 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67380b0ae0 msgr2=0x7f673815c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.010+0000 7f67405d0640 1 --2- 172.21.15.77:0/81195970 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67380b0ae0 0x7f673815c260 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f672800c7f0 tx=0x7f672800cbf0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.010+0000 7f67405d0640 1 -- 172.21.15.77:0/81195970 shutdown_connections 2023-11-04T01:41:57.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.010+0000 7f67405d0640 1 --2- 172.21.15.77:0/81195970 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f671c06aea0 0x7f671c06d360 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.010+0000 7f67405d0640 1 --2- 172.21.15.77:0/81195970 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6738159c70 0x7f673815c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.010+0000 7f67405d0640 1 --2- 172.21.15.77:0/81195970 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67380b0ae0 0x7f673815c260 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.010+0000 7f67405d0640 1 --2- 172.21.15.77:0/81195970 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f673806db20 0x7f6738154010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.010+0000 7f67405d0640 1 -- 172.21.15.77:0/81195970 >> 172.21.15.77:0/81195970 conn(0x7f67380ce950 msgr2=0x7f67380ccd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:57.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.010+0000 7f67405d0640 1 -- 172.21.15.77:0/81195970 shutdown_connections 2023-11-04T01:41:57.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.010+0000 7f67405d0640 1 -- 172.21.15.77:0/81195970 wait complete. 2023-11-04T01:41:57.023 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":109,"stamp":"2023-11-04T01:41:55.653350+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":86,"acting":86,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":70,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221976,"kb_used_data":5808,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752744,"statfs":{"total":773094113280,"available":772866809856,"internally_reserved":0,"allocated":5947392,"data_stored":3305095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000961"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":24,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:41:50.145693+0000","last_change":"2023-11-04T01:41:36.067943+0000","last_active":"2023-11-04T01:41:50.145693+0000","last_peered":"2023-11-04T01:41:50.145693+0000","last_clean":"2023-11-04T01:41:50.145693+0000","last_became_active":"2023-11-04T01:41:34.734305+0000","last_became_peered":"2023-11-04T01:41:34.734305+0000","last_unstale":"2023-11-04T01:41:50.145693+0000","last_undegraded":"2023-11-04T01:41:50.145693+0000","last_fullsized":"2023-11-04T01:41:50.145693+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:48.121273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033780399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:41:50.147752+0000","last_change":"2023-11-04T01:41:35.728832+0000","last_active":"2023-11-04T01:41:50.147752+0000","last_peered":"2023-11-04T01:41:50.147752+0000","last_clean":"2023-11-04T01:41:50.147752+0000","last_became_active":"2023-11-04T01:41:34.733517+0000","last_became_peered":"2023-11-04T01:41:34.733517+0000","last_unstale":"2023-11-04T01:41:50.147752+0000","last_undegraded":"2023-11-04T01:41:50.147752+0000","last_fullsized":"2023-11-04T01:41:50.147752+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:19.350812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042545700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-04T01:41:45.567119+0000","last_change":"2023-11-04T01:41:35.906660+0000","last_active":"2023-11-04T01:41:45.567119+0000","last_peered":"2023-11-04T01:41:45.567119+0000","last_clean":"2023-11-04T01:41:45.567119+0000","last_became_active":"2023-11-04T01:41:34.737209+0000","last_became_peered":"2023-11-04T01:41:34.737209+0000","last_unstale":"2023-11-04T01:41:45.567119+0000","last_undegraded":"2023-11-04T01:41:45.567119+0000","last_fullsized":"2023-11-04T01:41:45.567119+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:59.608410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068889500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-04T01:41:52.059680+0000","last_change":"2023-11-04T01:41:52.059680+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.059680+0000","last_undegraded":"2023-11-04T01:41:52.059680+0000","last_fullsized":"2023-11-04T01:41:52.059680+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":24,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:41:50.145506+0000","last_change":"2023-11-04T01:41:36.067946+0000","last_active":"2023-11-04T01:41:50.145506+0000","last_peered":"2023-11-04T01:41:50.145506+0000","last_clean":"2023-11-04T01:41:50.145506+0000","last_became_active":"2023-11-04T01:41:34.729591+0000","last_became_peered":"2023-11-04T01:41:34.729591+0000","last_unstale":"2023-11-04T01:41:50.145506+0000","last_undegraded":"2023-11-04T01:41:50.145506+0000","last_fullsized":"2023-11-04T01:41:50.145506+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:59.608410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032681099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-04T01:41:45.566416+0000","last_change":"2023-11-04T01:41:35.905999+0000","last_active":"2023-11-04T01:41:45.566416+0000","last_peered":"2023-11-04T01:41:45.566416+0000","last_clean":"2023-11-04T01:41:45.566416+0000","last_became_active":"2023-11-04T01:41:34.735286+0000","last_became_peered":"2023-11-04T01:41:34.735286+0000","last_unstale":"2023-11-04T01:41:45.566416+0000","last_undegraded":"2023-11-04T01:41:45.566416+0000","last_fullsized":"2023-11-04T01:41:45.566416+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:14:22.019781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051880100000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.043523+0000","last_change":"2023-11-04T01:41:36.344205+0000","last_active":"2023-11-04T01:41:49.043523+0000","last_peered":"2023-11-04T01:41:49.043523+0000","last_clean":"2023-11-04T01:41:49.043523+0000","last_became_active":"2023-11-04T01:41:34.733205+0000","last_became_peered":"2023-11-04T01:41:34.733205+0000","last_unstale":"2023-11-04T01:41:49.043523+0000","last_undegraded":"2023-11-04T01:41:49.043523+0000","last_fullsized":"2023-11-04T01:41:49.043523+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:37.958719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011584760000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.043744+0000","last_change":"2023-11-04T01:41:36.343728+0000","last_active":"2023-11-04T01:41:49.043744+0000","last_peered":"2023-11-04T01:41:49.043744+0000","last_clean":"2023-11-04T01:41:49.043744+0000","last_became_active":"2023-11-04T01:41:34.731106+0000","last_became_peered":"2023-11-04T01:41:34.731106+0000","last_unstale":"2023-11-04T01:41:49.043744+0000","last_undegraded":"2023-11-04T01:41:49.043744+0000","last_fullsized":"2023-11-04T01:41:49.043744+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:29.730483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058974500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.029114+0000","last_change":"2023-11-04T01:41:35.931778+0000","last_active":"2023-11-04T01:41:49.029114+0000","last_peered":"2023-11-04T01:41:49.029114+0000","last_clean":"2023-11-04T01:41:49.029114+0000","last_became_active":"2023-11-04T01:41:34.736897+0000","last_became_peered":"2023-11-04T01:41:34.736897+0000","last_unstale":"2023-11-04T01:41:49.029114+0000","last_undegraded":"2023-11-04T01:41:49.029114+0000","last_fullsized":"2023-11-04T01:41:49.029114+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:20.089706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071523300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.042724+0000","last_change":"2023-11-04T01:41:35.729017+0000","last_active":"2023-11-04T01:41:49.042724+0000","last_peered":"2023-11-04T01:41:49.042724+0000","last_clean":"2023-11-04T01:41:49.042724+0000","last_became_active":"2023-11-04T01:41:34.730592+0000","last_became_peered":"2023-11-04T01:41:34.730592+0000","last_unstale":"2023-11-04T01:41:49.042724+0000","last_undegraded":"2023-11-04T01:41:49.042724+0000","last_fullsized":"2023-11-04T01:41:49.042724+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:08.858430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088820999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":22,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.032594+0000","last_change":"2023-11-04T01:41:35.729378+0000","last_active":"2023-11-04T01:41:49.032594+0000","last_peered":"2023-11-04T01:41:49.032594+0000","last_clean":"2023-11-04T01:41:49.032594+0000","last_became_active":"2023-11-04T01:41:34.730387+0000","last_became_peered":"2023-11-04T01:41:34.730387+0000","last_unstale":"2023-11-04T01:41:49.032594+0000","last_undegraded":"2023-11-04T01:41:49.032594+0000","last_fullsized":"2023-11-04T01:41:49.032594+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:12.653602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072268699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.042812+0000","last_change":"2023-11-04T01:41:35.729318+0000","last_active":"2023-11-04T01:41:49.042812+0000","last_peered":"2023-11-04T01:41:49.042812+0000","last_clean":"2023-11-04T01:41:49.042812+0000","last_became_active":"2023-11-04T01:41:34.733796+0000","last_became_peered":"2023-11-04T01:41:34.733796+0000","last_unstale":"2023-11-04T01:41:49.042812+0000","last_undegraded":"2023-11-04T01:41:49.042812+0000","last_fullsized":"2023-11-04T01:41:49.042812+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:19.350812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053712200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-04T01:41:52.060141+0000","last_change":"2023-11-04T01:41:52.060141+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.060141+0000","last_undegraded":"2023-11-04T01:41:52.060141+0000","last_fullsized":"2023-11-04T01:41:52.060141+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.029177+0000","last_change":"2023-11-04T01:41:35.931929+0000","last_active":"2023-11-04T01:41:49.029177+0000","last_peered":"2023-11-04T01:41:49.029177+0000","last_clean":"2023-11-04T01:41:49.029177+0000","last_became_active":"2023-11-04T01:41:34.738795+0000","last_became_peered":"2023-11-04T01:41:34.738795+0000","last_unstale":"2023-11-04T01:41:49.029177+0000","last_undegraded":"2023-11-04T01:41:49.029177+0000","last_fullsized":"2023-11-04T01:41:49.029177+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:59.608410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046204999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.042687+0000","last_change":"2023-11-04T01:41:35.728945+0000","last_active":"2023-11-04T01:41:49.042687+0000","last_peered":"2023-11-04T01:41:49.042687+0000","last_clean":"2023-11-04T01:41:49.042687+0000","last_became_active":"2023-11-04T01:41:34.735082+0000","last_became_peered":"2023-11-04T01:41:34.735082+0000","last_unstale":"2023-11-04T01:41:49.042687+0000","last_undegraded":"2023-11-04T01:41:49.042687+0000","last_fullsized":"2023-11-04T01:41:49.042687+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:16.970814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079093000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.032394+0000","last_change":"2023-11-04T01:41:35.728625+0000","last_active":"2023-11-04T01:41:49.032394+0000","last_peered":"2023-11-04T01:41:49.032394+0000","last_clean":"2023-11-04T01:41:49.032394+0000","last_became_active":"2023-11-04T01:41:34.731514+0000","last_became_peered":"2023-11-04T01:41:34.731514+0000","last_unstale":"2023-11-04T01:41:49.032394+0000","last_undegraded":"2023-11-04T01:41:49.032394+0000","last_fullsized":"2023-11-04T01:41:49.032394+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:51:50.413223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047686400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-04T01:41:52.060438+0000","last_change":"2023-11-04T01:41:52.060438+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.060438+0000","last_undegraded":"2023-11-04T01:41:52.060438+0000","last_fullsized":"2023-11-04T01:41:52.060438+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.043759+0000","last_change":"2023-11-04T01:41:36.343762+0000","last_active":"2023-11-04T01:41:49.043759+0000","last_peered":"2023-11-04T01:41:49.043759+0000","last_clean":"2023-11-04T01:41:49.043759+0000","last_became_active":"2023-11-04T01:41:34.733406+0000","last_became_peered":"2023-11-04T01:41:34.733406+0000","last_unstale":"2023-11-04T01:41:49.043759+0000","last_undegraded":"2023-11-04T01:41:49.043759+0000","last_fullsized":"2023-11-04T01:41:49.043759+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:34:35.541159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058533399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-04T01:41:45.566518+0000","last_change":"2023-11-04T01:41:35.906297+0000","last_active":"2023-11-04T01:41:45.566518+0000","last_peered":"2023-11-04T01:41:45.566518+0000","last_clean":"2023-11-04T01:41:45.566518+0000","last_became_active":"2023-11-04T01:41:34.734134+0000","last_became_peered":"2023-11-04T01:41:34.734134+0000","last_unstale":"2023-11-04T01:41:45.566518+0000","last_undegraded":"2023-11-04T01:41:45.566518+0000","last_fullsized":"2023-11-04T01:41:45.566518+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:52.597063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087104900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-04T01:41:45.568486+0000","last_change":"2023-11-04T01:41:35.906596+0000","last_active":"2023-11-04T01:41:45.568486+0000","last_peered":"2023-11-04T01:41:45.568486+0000","last_clean":"2023-11-04T01:41:45.568486+0000","last_became_active":"2023-11-04T01:41:34.738529+0000","last_became_peered":"2023-11-04T01:41:34.738529+0000","last_unstale":"2023-11-04T01:41:45.568486+0000","last_undegraded":"2023-11-04T01:41:45.568486+0000","last_fullsized":"2023-11-04T01:41:45.568486+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:48.121273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086660600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-04T01:41:52.062138+0000","last_change":"2023-11-04T01:41:52.062138+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.062138+0000","last_undegraded":"2023-11-04T01:41:52.062138+0000","last_fullsized":"2023-11-04T01:41:52.062138+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-04T01:41:45.566615+0000","last_change":"2023-11-04T01:41:35.906430+0000","last_active":"2023-11-04T01:41:45.566615+0000","last_peered":"2023-11-04T01:41:45.566615+0000","last_clean":"2023-11-04T01:41:45.566615+0000","last_became_active":"2023-11-04T01:41:34.741147+0000","last_became_peered":"2023-11-04T01:41:34.741147+0000","last_unstale":"2023-11-04T01:41:45.566615+0000","last_undegraded":"2023-11-04T01:41:45.566615+0000","last_fullsized":"2023-11-04T01:41:45.566615+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:20.089706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090504400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.043743+0000","last_change":"2023-11-04T01:41:36.344408+0000","last_active":"2023-11-04T01:41:49.043743+0000","last_peered":"2023-11-04T01:41:49.043743+0000","last_clean":"2023-11-04T01:41:49.043743+0000","last_became_active":"2023-11-04T01:41:34.730735+0000","last_became_peered":"2023-11-04T01:41:34.730735+0000","last_unstale":"2023-11-04T01:41:49.043743+0000","last_undegraded":"2023-11-04T01:41:49.043743+0000","last_fullsized":"2023-11-04T01:41:49.043743+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:10:58.095232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081464299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-04T01:41:52.062152+0000","last_change":"2023-11-04T01:41:52.062152+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.062152+0000","last_undegraded":"2023-11-04T01:41:52.062152+0000","last_fullsized":"2023-11-04T01:41:52.062152+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":24,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.045533+0000","last_change":"2023-11-04T01:41:36.244245+0000","last_active":"2023-11-04T01:41:49.045533+0000","last_peered":"2023-11-04T01:41:49.045533+0000","last_clean":"2023-11-04T01:41:49.045533+0000","last_became_active":"2023-11-04T01:41:34.734925+0000","last_became_peered":"2023-11-04T01:41:34.734925+0000","last_unstale":"2023-11-04T01:41:49.045533+0000","last_undegraded":"2023-11-04T01:41:49.045533+0000","last_fullsized":"2023-11-04T01:41:49.045533+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:44.193748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025350200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.043600+0000","last_change":"2023-11-04T01:41:36.343956+0000","last_active":"2023-11-04T01:41:49.043600+0000","last_peered":"2023-11-04T01:41:49.043600+0000","last_clean":"2023-11-04T01:41:49.043600+0000","last_became_active":"2023-11-04T01:41:34.736013+0000","last_became_peered":"2023-11-04T01:41:34.736013+0000","last_unstale":"2023-11-04T01:41:49.043600+0000","last_undegraded":"2023-11-04T01:41:49.043600+0000","last_fullsized":"2023-11-04T01:41:49.043600+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:08.858430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081427799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-04T01:41:52.062157+0000","last_change":"2023-11-04T01:41:52.062157+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.062157+0000","last_undegraded":"2023-11-04T01:41:52.062157+0000","last_fullsized":"2023-11-04T01:41:52.062157+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":24,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.045479+0000","last_change":"2023-11-04T01:41:36.243977+0000","last_active":"2023-11-04T01:41:49.045479+0000","last_peered":"2023-11-04T01:41:49.045479+0000","last_clean":"2023-11-04T01:41:49.045479+0000","last_became_active":"2023-11-04T01:41:34.733127+0000","last_became_peered":"2023-11-04T01:41:34.733127+0000","last_unstale":"2023-11-04T01:41:49.045479+0000","last_undegraded":"2023-11-04T01:41:49.045479+0000","last_fullsized":"2023-11-04T01:41:49.045479+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:36.118907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051788300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-04T01:41:52.059600+0000","last_change":"2023-11-04T01:41:52.059600+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.059600+0000","last_undegraded":"2023-11-04T01:41:52.059600+0000","last_fullsized":"2023-11-04T01:41:52.059600+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":24,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:41:50.145482+0000","last_change":"2023-11-04T01:41:36.067797+0000","last_active":"2023-11-04T01:41:50.145482+0000","last_peered":"2023-11-04T01:41:50.145482+0000","last_clean":"2023-11-04T01:41:50.145482+0000","last_became_active":"2023-11-04T01:41:34.734880+0000","last_became_peered":"2023-11-04T01:41:34.734880+0000","last_unstale":"2023-11-04T01:41:50.145482+0000","last_undegraded":"2023-11-04T01:41:50.145482+0000","last_fullsized":"2023-11-04T01:41:50.145482+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:20.089706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036003499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.032386+0000","last_change":"2023-11-04T01:41:35.729089+0000","last_active":"2023-11-04T01:41:49.032386+0000","last_peered":"2023-11-04T01:41:49.032386+0000","last_clean":"2023-11-04T01:41:49.032386+0000","last_became_active":"2023-11-04T01:41:34.731063+0000","last_became_peered":"2023-11-04T01:41:34.731063+0000","last_unstale":"2023-11-04T01:41:49.032386+0000","last_undegraded":"2023-11-04T01:41:49.032386+0000","last_fullsized":"2023-11-04T01:41:49.032386+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:38:46.633175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083653600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-04T01:41:52.062185+0000","last_change":"2023-11-04T01:41:52.062185+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.062185+0000","last_undegraded":"2023-11-04T01:41:52.062185+0000","last_fullsized":"2023-11-04T01:41:52.062185+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.042763+0000","last_change":"2023-11-04T01:41:35.729232+0000","last_active":"2023-11-04T01:41:49.042763+0000","last_peered":"2023-11-04T01:41:49.042763+0000","last_clean":"2023-11-04T01:41:49.042763+0000","last_became_active":"2023-11-04T01:41:34.731490+0000","last_became_peered":"2023-11-04T01:41:34.731490+0000","last_unstale":"2023-11-04T01:41:49.042763+0000","last_undegraded":"2023-11-04T01:41:49.042763+0000","last_fullsized":"2023-11-04T01:41:49.042763+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:37.958719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089653699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.043614+0000","last_change":"2023-11-04T01:41:36.344018+0000","last_active":"2023-11-04T01:41:49.043614+0000","last_peered":"2023-11-04T01:41:49.043614+0000","last_clean":"2023-11-04T01:41:49.043614+0000","last_became_active":"2023-11-04T01:41:34.734178+0000","last_became_peered":"2023-11-04T01:41:34.734178+0000","last_unstale":"2023-11-04T01:41:49.043614+0000","last_undegraded":"2023-11-04T01:41:49.043614+0000","last_fullsized":"2023-11-04T01:41:49.043614+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:16.970814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077338299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-04T01:41:52.059884+0000","last_change":"2023-11-04T01:41:52.059884+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.059884+0000","last_undegraded":"2023-11-04T01:41:52.059884+0000","last_fullsized":"2023-11-04T01:41:52.059884+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-04T01:41:45.568246+0000","last_change":"2023-11-04T01:41:35.906788+0000","last_active":"2023-11-04T01:41:45.568246+0000","last_peered":"2023-11-04T01:41:45.568246+0000","last_clean":"2023-11-04T01:41:45.568246+0000","last_became_active":"2023-11-04T01:41:34.734386+0000","last_became_peered":"2023-11-04T01:41:34.734386+0000","last_unstale":"2023-11-04T01:41:45.568246+0000","last_undegraded":"2023-11-04T01:41:45.568246+0000","last_fullsized":"2023-11-04T01:41:45.568246+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:23:23.733128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060435600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.029038+0000","last_change":"2023-11-04T01:41:35.931718+0000","last_active":"2023-11-04T01:41:49.029038+0000","last_peered":"2023-11-04T01:41:49.029038+0000","last_clean":"2023-11-04T01:41:49.029038+0000","last_became_active":"2023-11-04T01:41:34.741033+0000","last_became_peered":"2023-11-04T01:41:34.741033+0000","last_unstale":"2023-11-04T01:41:49.029038+0000","last_undegraded":"2023-11-04T01:41:49.029038+0000","last_fullsized":"2023-11-04T01:41:49.029038+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:48.121273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065858400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":22,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:41:50.147952+0000","last_change":"2023-11-04T01:41:35.728094+0000","last_active":"2023-11-04T01:41:50.147952+0000","last_peered":"2023-11-04T01:41:50.147952+0000","last_clean":"2023-11-04T01:41:50.147952+0000","last_became_active":"2023-11-04T01:41:34.738687+0000","last_became_peered":"2023-11-04T01:41:34.738687+0000","last_unstale":"2023-11-04T01:41:50.147952+0000","last_undegraded":"2023-11-04T01:41:50.147952+0000","last_fullsized":"2023-11-04T01:41:50.147952+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:37.958719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068772699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":22,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.032404+0000","last_change":"2023-11-04T01:41:35.729106+0000","last_active":"2023-11-04T01:41:49.032404+0000","last_peered":"2023-11-04T01:41:49.032404+0000","last_clean":"2023-11-04T01:41:49.032404+0000","last_became_active":"2023-11-04T01:41:34.731230+0000","last_became_peered":"2023-11-04T01:41:34.731230+0000","last_unstale":"2023-11-04T01:41:49.032404+0000","last_undegraded":"2023-11-04T01:41:49.032404+0000","last_fullsized":"2023-11-04T01:41:49.032404+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:07:32.744572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078592199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-04T01:41:52.060071+0000","last_change":"2023-11-04T01:41:52.060071+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.060071+0000","last_undegraded":"2023-11-04T01:41:52.060071+0000","last_fullsized":"2023-11-04T01:41:52.060071+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.032492+0000","last_change":"2023-11-04T01:41:35.728672+0000","last_active":"2023-11-04T01:41:49.032492+0000","last_peered":"2023-11-04T01:41:49.032492+0000","last_clean":"2023-11-04T01:41:49.032492+0000","last_became_active":"2023-11-04T01:41:34.727419+0000","last_became_peered":"2023-11-04T01:41:34.727419+0000","last_unstale":"2023-11-04T01:41:49.032492+0000","last_undegraded":"2023-11-04T01:41:49.032492+0000","last_fullsized":"2023-11-04T01:41:49.032492+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:35:01.127206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044278299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.043813+0000","last_change":"2023-11-04T01:41:36.344271+0000","last_active":"2023-11-04T01:41:49.043813+0000","last_peered":"2023-11-04T01:41:49.043813+0000","last_clean":"2023-11-04T01:41:49.043813+0000","last_became_active":"2023-11-04T01:41:34.732524+0000","last_became_peered":"2023-11-04T01:41:34.732524+0000","last_unstale":"2023-11-04T01:41:49.043813+0000","last_undegraded":"2023-11-04T01:41:49.043813+0000","last_fullsized":"2023-11-04T01:41:49.043813+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:19.350812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081160599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":195,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.042690+0000","last_change":"2023-11-04T01:39:54.204460+0000","last_active":"2023-11-04T01:41:49.042690+0000","last_peered":"2023-11-04T01:41:49.042690+0000","last_clean":"2023-11-04T01:41:49.042690+0000","last_became_active":"2023-11-04T01:39:54.203352+0000","last_became_peered":"2023-11-04T01:39:54.203352+0000","last_unstale":"2023-11-04T01:41:49.042690+0000","last_undegraded":"2023-11-04T01:41:49.042690+0000","last_fullsized":"2023-11-04T01:41:49.042690+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:52.627032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:52.627032+0000","last_clean_scrub_stamp":"2023-11-04T01:39:52.627032+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:17:18.474768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":2},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":264861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.54500000000000004}]},{"osd":1,"last update":"Sat Nov 4 01:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.58199999999999996}]},{"osd":2,"last update":"Sat Nov 4 01:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.49399999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.629},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.65900000000000003}]},{"osd":4,"last update":"Sat Nov 4 01:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.503}]},{"osd":6,"last update":"Sat Nov 4 01:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.56499999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.68799999999999994}]}]},{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28180,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343660,"statfs":{"total":96636764160,"available":96607907840,"internally_reserved":0,"allocated":1187840,"data_stored":855229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.38400000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.46800000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.59299999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.65300000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.436},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.61299999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.64000000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.67000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":264861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.61799999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.51100000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.63800000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.65300000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.38200000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.36099999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.435},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.49299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":264861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.56999999999999995}]},{"osd":1,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.46100000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.624}]},{"osd":3,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.47799999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.497}]},{"osd":6,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.67800000000000005}]},{"osd":7,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.66300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":264861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"last":0.36499999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.40400000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.46000000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.57599999999999996}]},{"osd":5,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.505}]},{"osd":6,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.64400000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.53600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":264861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.313},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.68700000000000006}]},{"osd":1,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.38600000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":1.1739999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":1.2849999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":1.224}]},{"osd":5,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":1.196},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":1.25}]},{"osd":6,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":1.2989999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.70699999999999996}]},{"osd":7,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":1.268},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.67100000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":271351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.443,"5min":0.443,"15min":0.443},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"last":0.33000000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.31}]},{"osd":3,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.35099999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.39300000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.441},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.46300000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.42699999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.496},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.48699999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28180,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343660,"statfs":{"total":96636764160,"available":96607907840,"internally_reserved":0,"allocated":1183744,"data_stored":854210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.32500000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.34000000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.377}]},{"osd":4,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.60899999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.626},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.48599999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.59399999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.57999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:41:57.031 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:41:57.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.161+0000 7fefc454c640 1 Processor -- start 2023-11-04T01:41:57.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.161+0000 7fefc454c640 1 -- start start 2023-11-04T01:41:57.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.162+0000 7fefc454c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fefbc0cda60 0x7fefbc0ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.162+0000 7fefc454c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefbc0cc990 con 0x7fefbc070d40 2023-11-04T01:41:57.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.162+0000 7fefc454c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefbc0ccc70 con 0x7fefbc0b0cd0 2023-11-04T01:41:57.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.162+0000 7fefc454c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc0c9ce0 con 0x7fefbc0cda60 2023-11-04T01:41:57.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.162+0000 7fefc2ae9640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fefbc070d40 0x7fefbc06c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57160/0 (socket says 172.21.15.77:57160) 2023-11-04T01:41:57.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.162+0000 7fefc2ae9640 1 -- 172.21.15.77:0/3511772349 learned_addr learned my addr 172.21.15.77:0/3511772349 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:57.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.163+0000 7fefc12e6640 1 -- 172.21.15.77:0/3511772349 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463280060 0 0) 0x7fefbc0cc990 con 0x7fefbc070d40 2023-11-04T01:41:57.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.163+0000 7fefc22e8640 1 --2- 172.21.15.77:0/3511772349 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fefbc0cda60 0x7fefbc0ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.163+0000 7fefc12e6640 1 -- 172.21.15.77:0/3511772349 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefa4003520 con 0x7fefbc070d40 2023-11-04T01:41:57.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.163+0000 7fefc12e6640 1 -- 172.21.15.77:0/3511772349 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3963639873 0 0) 0x7fefa4003520 con 0x7fefbc070d40 2023-11-04T01:41:57.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.163+0000 7fefc12e6640 1 -- 172.21.15.77:0/3511772349 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fefbc0cda60 msgr2=0x7fefbc0ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:57.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.163+0000 7fefc12e6640 1 --2- 172.21.15.77:0/3511772349 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fefbc0cda60 0x7fefbc0ca7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.163+0000 7fefc12e6640 1 -- 172.21.15.77:0/3511772349 >> v1:172.21.15.122:6789/0 conn(0x7fefbc0b0cd0 legacy=0x7fefbc070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.163+0000 7fefc12e6640 1 -- 172.21.15.77:0/3511772349 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefbc0c9fc0 con 0x7fefbc070d40 2023-11-04T01:41:57.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.163+0000 7fefc12e6640 1 -- 172.21.15.77:0/3511772349 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7fefb4001670 con 0x7fefbc070d40 2023-11-04T01:41:57.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.163+0000 7fefc12e6640 1 -- 172.21.15.77:0/3511772349 >> v1:172.21.15.77:6789/0 conn(0x7fefbc070d40 legacy=0x7fefbc06c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.163+0000 7fefc12e6640 1 --2- 172.21.15.77:0/3511772349 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefa40039a0 0x7fefa4003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.163+0000 7fefc12e6640 1 --2- 172.21.15.77:0/3511772349 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fefbc0cda60 0x7fefa40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.163+0000 7fefc12e6640 1 --2- 172.21.15.77:0/3511772349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefa4004d00 0x7fefa4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.163+0000 7fefc12e6640 1 -- 172.21.15.77:0/3511772349 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc0c9ce0 con 0x7fefa4004d00 2023-11-04T01:41:57.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.163+0000 7fefc12e6640 1 -- 172.21.15.77:0/3511772349 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa400ba30 con 0x7fefa40039a0 2023-11-04T01:41:57.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.163+0000 7fefc12e6640 1 -- 172.21.15.77:0/3511772349 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa400bba0 con 0x7fefbc0cda60 2023-11-04T01:41:57.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.163+0000 7fefc2ae9640 1 --2- 172.21.15.77:0/3511772349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefa4004d00 0x7fefa4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.163+0000 7fefc22e8640 1 --2- 172.21.15.77:0/3511772349 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefa40039a0 0x7fefa4003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.163+0000 7fefc1ae7640 1 --2- 172.21.15.77:0/3511772349 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fefbc0cda60 0x7fefa40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.163+0000 7fefc2ae9640 1 -- 172.21.15.77:0/3511772349 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fefbc0cda60 msgr2=0x7fefa40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:57.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.163+0000 7fefc2ae9640 1 --2- 172.21.15.77:0/3511772349 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fefbc0cda60 0x7fefa40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.163+0000 7fefc2ae9640 1 -- 172.21.15.77:0/3511772349 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefa40039a0 msgr2=0x7fefa4003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:57.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.163+0000 7fefc2ae9640 1 --2- 172.21.15.77:0/3511772349 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefa40039a0 0x7fefa4003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.163+0000 7fefc2ae9640 1 -- 172.21.15.77:0/3511772349 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa4003520 con 0x7fefa4004d00 2023-11-04T01:41:57.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.164+0000 7fefc2ae9640 1 --2- 172.21.15.77:0/3511772349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefa4004d00 0x7fefa4005180 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fefb400c190 tx=0x7fefa40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f68b838628a5a769 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:57.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.164+0000 7fefc12e6640 1 -- 172.21.15.77:0/3511772349 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb4005ad0 con 0x7fefa4004d00 2023-11-04T01:41:57.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.164+0000 7fefc12e6640 1 -- 172.21.15.77:0/3511772349 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb4005c30 con 0x7fefa4004d00 2023-11-04T01:41:57.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.164+0000 7fefc12e6640 1 -- 172.21.15.77:0/3511772349 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb402c810 con 0x7fefa4004d00 2023-11-04T01:41:57.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.165+0000 7fefc454c640 1 -- 172.21.15.77:0/3511772349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefa4004d00 msgr2=0x7fefa4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.165+0000 7fefc454c640 1 --2- 172.21.15.77:0/3511772349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefa4004d00 0x7fefa4005180 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fefb400c190 tx=0x7fefa40057f0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.165+0000 7fefc2ae9640 1 -- 172.21.15.77:0/3511772349 reap_dead start 2023-11-04T01:41:57.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.165+0000 7fefc454c640 1 -- 172.21.15.77:0/3511772349 shutdown_connections 2023-11-04T01:41:57.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.165+0000 7fefc454c640 1 -- 172.21.15.77:0/3511772349 >> 172.21.15.77:0/3511772349 conn(0x7fefbc0ce950 msgr2=0x7fefbc0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:57.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.165+0000 7fefc454c640 1 -- 172.21.15.77:0/3511772349 shutdown_connections 2023-11-04T01:41:57.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.165+0000 7fefc454c640 1 -- 172.21.15.77:0/3511772349 wait complete. 2023-11-04T01:41:57.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.166+0000 7fefc454c640 1 Processor -- start 2023-11-04T01:41:57.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.166+0000 7fefc454c640 1 -- start start 2023-11-04T01:41:57.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.167+0000 7fefc454c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fefa4004d00 0x7fefbc0b1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.167+0000 7fefc454c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefbc13f510 0x7fefbc0c5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.167+0000 7fefc454c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefbc13f990 0x7fefbc157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.167+0000 7fefc454c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc0c4e10 con 0x7fefbc13f990 2023-11-04T01:41:57.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.167+0000 7fefc454c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc0c7060 con 0x7fefbc13f510 2023-11-04T01:41:57.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.167+0000 7fefc454c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc0c6450 con 0x7fefa4004d00 2023-11-04T01:41:57.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.167+0000 7fefc2ae9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefbc13f990 0x7fefbc157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.167+0000 7fefc2ae9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefbc13f990 0x7fefbc157d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54870/0 (socket says 172.21.15.77:54870) 2023-11-04T01:41:57.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.167+0000 7fefc2ae9640 1 -- 172.21.15.77:0/1949214734 learned_addr learned my addr 172.21.15.77:0/1949214734 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:57.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.167+0000 7fefc22e8640 1 --2- 172.21.15.77:0/1949214734 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fefa4004d00 0x7fefbc0b1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.167+0000 7fefc1ae7640 1 --2- 172.21.15.77:0/1949214734 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefbc13f510 0x7fefbc0c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.167+0000 7fefc2ae9640 1 -- 172.21.15.77:0/1949214734 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fefa4004d00 msgr2=0x7fefbc0b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.167+0000 7fefc2ae9640 1 --2- 172.21.15.77:0/1949214734 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fefa4004d00 0x7fefbc0b1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.167+0000 7fefc2ae9640 1 -- 172.21.15.77:0/1949214734 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefbc13f510 msgr2=0x7fefbc0c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.167+0000 7fefc2ae9640 1 --2- 172.21.15.77:0/1949214734 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefbc13f510 0x7fefbc0c5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.167+0000 7fefc2ae9640 1 -- 172.21.15.77:0/1949214734 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefbc0c6730 con 0x7fefbc13f990 2023-11-04T01:41:57.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.167+0000 7fefc2ae9640 1 --2- 172.21.15.77:0/1949214734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefbc13f990 0x7fefbc157d50 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fefb402c480 tx=0x7fefb402e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:57.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.167+0000 7fefbaffd640 1 -- 172.21.15.77:0/1949214734 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb403c040 con 0x7fefbc13f990 2023-11-04T01:41:57.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.167+0000 7fefbaffd640 1 -- 172.21.15.77:0/1949214734 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb402ca10 con 0x7fefbc13f990 2023-11-04T01:41:57.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.167+0000 7fefc454c640 1 -- 172.21.15.77:0/1949214734 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefbc0c6a10 con 0x7fefbc13f990 2023-11-04T01:41:57.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.167+0000 7fefbaffd640 1 -- 172.21.15.77:0/1949214734 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb402cd80 con 0x7fefbc13f990 2023-11-04T01:41:57.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.168+0000 7fefc454c640 1 -- 172.21.15.77:0/1949214734 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefbc0b1ea0 con 0x7fefbc13f990 2023-11-04T01:41:57.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.168+0000 7fefc454c640 1 -- 172.21.15.77:0/1949214734 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefbc074290 con 0x7fefbc13f990 2023-11-04T01:41:57.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.169+0000 7fefbaffd640 1 -- 172.21.15.77:0/1949214734 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fefb4032070 con 0x7fefbc13f990 2023-11-04T01:41:57.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.169+0000 7fefbaffd640 1 --2- 172.21.15.77:0/1949214734 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fefa806ae70 0x7fefa806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.169+0000 7fefbaffd640 1 -- 172.21.15.77:0/1949214734 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fefb40aa370 con 0x7fefbc13f990 2023-11-04T01:41:57.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.169+0000 7fefc22e8640 1 --2- 172.21.15.77:0/1949214734 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fefa806ae70 0x7fefa806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.170+0000 7fefc22e8640 1 --2- 172.21.15.77:0/1949214734 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fefa806ae70 0x7fefa806d330 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fefac014510 tx=0x7fefac00b040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:57.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.173+0000 7fefbaffd640 1 -- 172.21.15.77:0/1949214734 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fefb4075230 con 0x7fefbc13f990 2023-11-04T01:41:57.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.334+0000 7fefc454c640 1 -- 172.21.15.77:0/1949214734 --> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fefbc0ca2a0 con 0x7fefa806ae70 2023-11-04T01:41:57.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.343+0000 7fefbaffd640 1 -- 172.21.15.77:0/1949214734 <== mgr.4123 v2:172.21.15.122:6832/2275325762 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+356327 (secure 0 0 0) 0x7fefac00f040 con 0x7fefa806ae70 2023-11-04T01:41:57.349 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:57.350 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-04T01:41:57.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.347+0000 7fefc454c640 1 -- 172.21.15.77:0/1949214734 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fefa806ae70 msgr2=0x7fefa806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.347+0000 7fefc454c640 1 --2- 172.21.15.77:0/1949214734 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fefa806ae70 0x7fefa806d330 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fefac014510 tx=0x7fefac00b040 comp rx=0 tx=0).stop 2023-11-04T01:41:57.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.347+0000 7fefc454c640 1 -- 172.21.15.77:0/1949214734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefbc13f990 msgr2=0x7fefbc157d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.347+0000 7fefc454c640 1 --2- 172.21.15.77:0/1949214734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefbc13f990 0x7fefbc157d50 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fefb402c480 tx=0x7fefb402e070 comp rx=0 tx=0).stop 2023-11-04T01:41:57.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.347+0000 7fefc454c640 1 -- 172.21.15.77:0/1949214734 shutdown_connections 2023-11-04T01:41:57.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.347+0000 7fefc454c640 1 --2- 172.21.15.77:0/1949214734 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fefa806ae70 0x7fefa806d330 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.347+0000 7fefc454c640 1 --2- 172.21.15.77:0/1949214734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefbc13f990 0x7fefbc157d50 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.347+0000 7fefc454c640 1 --2- 172.21.15.77:0/1949214734 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefbc13f510 0x7fefbc0c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.347+0000 7fefc454c640 1 --2- 172.21.15.77:0/1949214734 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fefa4004d00 0x7fefbc0b1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.347+0000 7fefc454c640 1 -- 172.21.15.77:0/1949214734 >> 172.21.15.77:0/1949214734 conn(0x7fefbc0ce950 msgr2=0x7fefbc0ac6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:57.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.347+0000 7fefc454c640 1 -- 172.21.15.77:0/1949214734 shutdown_connections 2023-11-04T01:41:57.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.347+0000 7fefc454c640 1 -- 172.21.15.77:0/1949214734 wait complete. 2023-11-04T01:41:57.359 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":109,"stamp":"2023-11-04T01:41:55.653350+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":86,"acting":86,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":70,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221976,"kb_used_data":5808,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752744,"statfs":{"total":773094113280,"available":772866809856,"internally_reserved":0,"allocated":5947392,"data_stored":3305095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000961"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":24,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:41:50.145693+0000","last_change":"2023-11-04T01:41:36.067943+0000","last_active":"2023-11-04T01:41:50.145693+0000","last_peered":"2023-11-04T01:41:50.145693+0000","last_clean":"2023-11-04T01:41:50.145693+0000","last_became_active":"2023-11-04T01:41:34.734305+0000","last_became_peered":"2023-11-04T01:41:34.734305+0000","last_unstale":"2023-11-04T01:41:50.145693+0000","last_undegraded":"2023-11-04T01:41:50.145693+0000","last_fullsized":"2023-11-04T01:41:50.145693+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:48.121273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033780399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:41:50.147752+0000","last_change":"2023-11-04T01:41:35.728832+0000","last_active":"2023-11-04T01:41:50.147752+0000","last_peered":"2023-11-04T01:41:50.147752+0000","last_clean":"2023-11-04T01:41:50.147752+0000","last_became_active":"2023-11-04T01:41:34.733517+0000","last_became_peered":"2023-11-04T01:41:34.733517+0000","last_unstale":"2023-11-04T01:41:50.147752+0000","last_undegraded":"2023-11-04T01:41:50.147752+0000","last_fullsized":"2023-11-04T01:41:50.147752+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:19.350812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042545700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-04T01:41:45.567119+0000","last_change":"2023-11-04T01:41:35.906660+0000","last_active":"2023-11-04T01:41:45.567119+0000","last_peered":"2023-11-04T01:41:45.567119+0000","last_clean":"2023-11-04T01:41:45.567119+0000","last_became_active":"2023-11-04T01:41:34.737209+0000","last_became_peered":"2023-11-04T01:41:34.737209+0000","last_unstale":"2023-11-04T01:41:45.567119+0000","last_undegraded":"2023-11-04T01:41:45.567119+0000","last_fullsized":"2023-11-04T01:41:45.567119+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:59.608410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068889500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-04T01:41:52.059680+0000","last_change":"2023-11-04T01:41:52.059680+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.059680+0000","last_undegraded":"2023-11-04T01:41:52.059680+0000","last_fullsized":"2023-11-04T01:41:52.059680+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":24,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:41:50.145506+0000","last_change":"2023-11-04T01:41:36.067946+0000","last_active":"2023-11-04T01:41:50.145506+0000","last_peered":"2023-11-04T01:41:50.145506+0000","last_clean":"2023-11-04T01:41:50.145506+0000","last_became_active":"2023-11-04T01:41:34.729591+0000","last_became_peered":"2023-11-04T01:41:34.729591+0000","last_unstale":"2023-11-04T01:41:50.145506+0000","last_undegraded":"2023-11-04T01:41:50.145506+0000","last_fullsized":"2023-11-04T01:41:50.145506+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:59.608410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032681099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-04T01:41:45.566416+0000","last_change":"2023-11-04T01:41:35.905999+0000","last_active":"2023-11-04T01:41:45.566416+0000","last_peered":"2023-11-04T01:41:45.566416+0000","last_clean":"2023-11-04T01:41:45.566416+0000","last_became_active":"2023-11-04T01:41:34.735286+0000","last_became_peered":"2023-11-04T01:41:34.735286+0000","last_unstale":"2023-11-04T01:41:45.566416+0000","last_undegraded":"2023-11-04T01:41:45.566416+0000","last_fullsized":"2023-11-04T01:41:45.566416+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:14:22.019781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051880100000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.043523+0000","last_change":"2023-11-04T01:41:36.344205+0000","last_active":"2023-11-04T01:41:49.043523+0000","last_peered":"2023-11-04T01:41:49.043523+0000","last_clean":"2023-11-04T01:41:49.043523+0000","last_became_active":"2023-11-04T01:41:34.733205+0000","last_became_peered":"2023-11-04T01:41:34.733205+0000","last_unstale":"2023-11-04T01:41:49.043523+0000","last_undegraded":"2023-11-04T01:41:49.043523+0000","last_fullsized":"2023-11-04T01:41:49.043523+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:37.958719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011584760000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.043744+0000","last_change":"2023-11-04T01:41:36.343728+0000","last_active":"2023-11-04T01:41:49.043744+0000","last_peered":"2023-11-04T01:41:49.043744+0000","last_clean":"2023-11-04T01:41:49.043744+0000","last_became_active":"2023-11-04T01:41:34.731106+0000","last_became_peered":"2023-11-04T01:41:34.731106+0000","last_unstale":"2023-11-04T01:41:49.043744+0000","last_undegraded":"2023-11-04T01:41:49.043744+0000","last_fullsized":"2023-11-04T01:41:49.043744+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:29.730483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058974500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.029114+0000","last_change":"2023-11-04T01:41:35.931778+0000","last_active":"2023-11-04T01:41:49.029114+0000","last_peered":"2023-11-04T01:41:49.029114+0000","last_clean":"2023-11-04T01:41:49.029114+0000","last_became_active":"2023-11-04T01:41:34.736897+0000","last_became_peered":"2023-11-04T01:41:34.736897+0000","last_unstale":"2023-11-04T01:41:49.029114+0000","last_undegraded":"2023-11-04T01:41:49.029114+0000","last_fullsized":"2023-11-04T01:41:49.029114+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:20.089706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071523300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.042724+0000","last_change":"2023-11-04T01:41:35.729017+0000","last_active":"2023-11-04T01:41:49.042724+0000","last_peered":"2023-11-04T01:41:49.042724+0000","last_clean":"2023-11-04T01:41:49.042724+0000","last_became_active":"2023-11-04T01:41:34.730592+0000","last_became_peered":"2023-11-04T01:41:34.730592+0000","last_unstale":"2023-11-04T01:41:49.042724+0000","last_undegraded":"2023-11-04T01:41:49.042724+0000","last_fullsized":"2023-11-04T01:41:49.042724+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:08.858430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088820999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":22,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.032594+0000","last_change":"2023-11-04T01:41:35.729378+0000","last_active":"2023-11-04T01:41:49.032594+0000","last_peered":"2023-11-04T01:41:49.032594+0000","last_clean":"2023-11-04T01:41:49.032594+0000","last_became_active":"2023-11-04T01:41:34.730387+0000","last_became_peered":"2023-11-04T01:41:34.730387+0000","last_unstale":"2023-11-04T01:41:49.032594+0000","last_undegraded":"2023-11-04T01:41:49.032594+0000","last_fullsized":"2023-11-04T01:41:49.032594+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:12.653602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072268699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.042812+0000","last_change":"2023-11-04T01:41:35.729318+0000","last_active":"2023-11-04T01:41:49.042812+0000","last_peered":"2023-11-04T01:41:49.042812+0000","last_clean":"2023-11-04T01:41:49.042812+0000","last_became_active":"2023-11-04T01:41:34.733796+0000","last_became_peered":"2023-11-04T01:41:34.733796+0000","last_unstale":"2023-11-04T01:41:49.042812+0000","last_undegraded":"2023-11-04T01:41:49.042812+0000","last_fullsized":"2023-11-04T01:41:49.042812+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:19.350812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053712200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-04T01:41:52.060141+0000","last_change":"2023-11-04T01:41:52.060141+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.060141+0000","last_undegraded":"2023-11-04T01:41:52.060141+0000","last_fullsized":"2023-11-04T01:41:52.060141+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.029177+0000","last_change":"2023-11-04T01:41:35.931929+0000","last_active":"2023-11-04T01:41:49.029177+0000","last_peered":"2023-11-04T01:41:49.029177+0000","last_clean":"2023-11-04T01:41:49.029177+0000","last_became_active":"2023-11-04T01:41:34.738795+0000","last_became_peered":"2023-11-04T01:41:34.738795+0000","last_unstale":"2023-11-04T01:41:49.029177+0000","last_undegraded":"2023-11-04T01:41:49.029177+0000","last_fullsized":"2023-11-04T01:41:49.029177+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:59.608410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046204999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.042687+0000","last_change":"2023-11-04T01:41:35.728945+0000","last_active":"2023-11-04T01:41:49.042687+0000","last_peered":"2023-11-04T01:41:49.042687+0000","last_clean":"2023-11-04T01:41:49.042687+0000","last_became_active":"2023-11-04T01:41:34.735082+0000","last_became_peered":"2023-11-04T01:41:34.735082+0000","last_unstale":"2023-11-04T01:41:49.042687+0000","last_undegraded":"2023-11-04T01:41:49.042687+0000","last_fullsized":"2023-11-04T01:41:49.042687+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:16.970814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079093000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.032394+0000","last_change":"2023-11-04T01:41:35.728625+0000","last_active":"2023-11-04T01:41:49.032394+0000","last_peered":"2023-11-04T01:41:49.032394+0000","last_clean":"2023-11-04T01:41:49.032394+0000","last_became_active":"2023-11-04T01:41:34.731514+0000","last_became_peered":"2023-11-04T01:41:34.731514+0000","last_unstale":"2023-11-04T01:41:49.032394+0000","last_undegraded":"2023-11-04T01:41:49.032394+0000","last_fullsized":"2023-11-04T01:41:49.032394+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:51:50.413223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047686400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-04T01:41:52.060438+0000","last_change":"2023-11-04T01:41:52.060438+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.060438+0000","last_undegraded":"2023-11-04T01:41:52.060438+0000","last_fullsized":"2023-11-04T01:41:52.060438+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.043759+0000","last_change":"2023-11-04T01:41:36.343762+0000","last_active":"2023-11-04T01:41:49.043759+0000","last_peered":"2023-11-04T01:41:49.043759+0000","last_clean":"2023-11-04T01:41:49.043759+0000","last_became_active":"2023-11-04T01:41:34.733406+0000","last_became_peered":"2023-11-04T01:41:34.733406+0000","last_unstale":"2023-11-04T01:41:49.043759+0000","last_undegraded":"2023-11-04T01:41:49.043759+0000","last_fullsized":"2023-11-04T01:41:49.043759+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:34:35.541159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058533399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-04T01:41:45.566518+0000","last_change":"2023-11-04T01:41:35.906297+0000","last_active":"2023-11-04T01:41:45.566518+0000","last_peered":"2023-11-04T01:41:45.566518+0000","last_clean":"2023-11-04T01:41:45.566518+0000","last_became_active":"2023-11-04T01:41:34.734134+0000","last_became_peered":"2023-11-04T01:41:34.734134+0000","last_unstale":"2023-11-04T01:41:45.566518+0000","last_undegraded":"2023-11-04T01:41:45.566518+0000","last_fullsized":"2023-11-04T01:41:45.566518+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:52.597063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087104900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-04T01:41:45.568486+0000","last_change":"2023-11-04T01:41:35.906596+0000","last_active":"2023-11-04T01:41:45.568486+0000","last_peered":"2023-11-04T01:41:45.568486+0000","last_clean":"2023-11-04T01:41:45.568486+0000","last_became_active":"2023-11-04T01:41:34.738529+0000","last_became_peered":"2023-11-04T01:41:34.738529+0000","last_unstale":"2023-11-04T01:41:45.568486+0000","last_undegraded":"2023-11-04T01:41:45.568486+0000","last_fullsized":"2023-11-04T01:41:45.568486+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:48.121273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086660600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-04T01:41:52.062138+0000","last_change":"2023-11-04T01:41:52.062138+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.062138+0000","last_undegraded":"2023-11-04T01:41:52.062138+0000","last_fullsized":"2023-11-04T01:41:52.062138+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-04T01:41:45.566615+0000","last_change":"2023-11-04T01:41:35.906430+0000","last_active":"2023-11-04T01:41:45.566615+0000","last_peered":"2023-11-04T01:41:45.566615+0000","last_clean":"2023-11-04T01:41:45.566615+0000","last_became_active":"2023-11-04T01:41:34.741147+0000","last_became_peered":"2023-11-04T01:41:34.741147+0000","last_unstale":"2023-11-04T01:41:45.566615+0000","last_undegraded":"2023-11-04T01:41:45.566615+0000","last_fullsized":"2023-11-04T01:41:45.566615+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:20.089706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090504400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.043743+0000","last_change":"2023-11-04T01:41:36.344408+0000","last_active":"2023-11-04T01:41:49.043743+0000","last_peered":"2023-11-04T01:41:49.043743+0000","last_clean":"2023-11-04T01:41:49.043743+0000","last_became_active":"2023-11-04T01:41:34.730735+0000","last_became_peered":"2023-11-04T01:41:34.730735+0000","last_unstale":"2023-11-04T01:41:49.043743+0000","last_undegraded":"2023-11-04T01:41:49.043743+0000","last_fullsized":"2023-11-04T01:41:49.043743+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:10:58.095232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081464299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-04T01:41:52.062152+0000","last_change":"2023-11-04T01:41:52.062152+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.062152+0000","last_undegraded":"2023-11-04T01:41:52.062152+0000","last_fullsized":"2023-11-04T01:41:52.062152+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":24,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.045533+0000","last_change":"2023-11-04T01:41:36.244245+0000","last_active":"2023-11-04T01:41:49.045533+0000","last_peered":"2023-11-04T01:41:49.045533+0000","last_clean":"2023-11-04T01:41:49.045533+0000","last_became_active":"2023-11-04T01:41:34.734925+0000","last_became_peered":"2023-11-04T01:41:34.734925+0000","last_unstale":"2023-11-04T01:41:49.045533+0000","last_undegraded":"2023-11-04T01:41:49.045533+0000","last_fullsized":"2023-11-04T01:41:49.045533+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:44.193748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025350200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.043600+0000","last_change":"2023-11-04T01:41:36.343956+0000","last_active":"2023-11-04T01:41:49.043600+0000","last_peered":"2023-11-04T01:41:49.043600+0000","last_clean":"2023-11-04T01:41:49.043600+0000","last_became_active":"2023-11-04T01:41:34.736013+0000","last_became_peered":"2023-11-04T01:41:34.736013+0000","last_unstale":"2023-11-04T01:41:49.043600+0000","last_undegraded":"2023-11-04T01:41:49.043600+0000","last_fullsized":"2023-11-04T01:41:49.043600+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:08.858430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081427799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-04T01:41:52.062157+0000","last_change":"2023-11-04T01:41:52.062157+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.062157+0000","last_undegraded":"2023-11-04T01:41:52.062157+0000","last_fullsized":"2023-11-04T01:41:52.062157+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":24,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.045479+0000","last_change":"2023-11-04T01:41:36.243977+0000","last_active":"2023-11-04T01:41:49.045479+0000","last_peered":"2023-11-04T01:41:49.045479+0000","last_clean":"2023-11-04T01:41:49.045479+0000","last_became_active":"2023-11-04T01:41:34.733127+0000","last_became_peered":"2023-11-04T01:41:34.733127+0000","last_unstale":"2023-11-04T01:41:49.045479+0000","last_undegraded":"2023-11-04T01:41:49.045479+0000","last_fullsized":"2023-11-04T01:41:49.045479+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:36.118907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051788300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-04T01:41:52.059600+0000","last_change":"2023-11-04T01:41:52.059600+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.059600+0000","last_undegraded":"2023-11-04T01:41:52.059600+0000","last_fullsized":"2023-11-04T01:41:52.059600+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":24,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:41:50.145482+0000","last_change":"2023-11-04T01:41:36.067797+0000","last_active":"2023-11-04T01:41:50.145482+0000","last_peered":"2023-11-04T01:41:50.145482+0000","last_clean":"2023-11-04T01:41:50.145482+0000","last_became_active":"2023-11-04T01:41:34.734880+0000","last_became_peered":"2023-11-04T01:41:34.734880+0000","last_unstale":"2023-11-04T01:41:50.145482+0000","last_undegraded":"2023-11-04T01:41:50.145482+0000","last_fullsized":"2023-11-04T01:41:50.145482+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:20.089706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036003499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.032386+0000","last_change":"2023-11-04T01:41:35.729089+0000","last_active":"2023-11-04T01:41:49.032386+0000","last_peered":"2023-11-04T01:41:49.032386+0000","last_clean":"2023-11-04T01:41:49.032386+0000","last_became_active":"2023-11-04T01:41:34.731063+0000","last_became_peered":"2023-11-04T01:41:34.731063+0000","last_unstale":"2023-11-04T01:41:49.032386+0000","last_undegraded":"2023-11-04T01:41:49.032386+0000","last_fullsized":"2023-11-04T01:41:49.032386+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:38:46.633175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083653600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-04T01:41:52.062185+0000","last_change":"2023-11-04T01:41:52.062185+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.062185+0000","last_undegraded":"2023-11-04T01:41:52.062185+0000","last_fullsized":"2023-11-04T01:41:52.062185+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":25,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.042763+0000","last_change":"2023-11-04T01:41:35.729232+0000","last_active":"2023-11-04T01:41:49.042763+0000","last_peered":"2023-11-04T01:41:49.042763+0000","last_clean":"2023-11-04T01:41:49.042763+0000","last_became_active":"2023-11-04T01:41:34.731490+0000","last_became_peered":"2023-11-04T01:41:34.731490+0000","last_unstale":"2023-11-04T01:41:49.042763+0000","last_undegraded":"2023-11-04T01:41:49.042763+0000","last_fullsized":"2023-11-04T01:41:49.042763+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:37.958719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089653699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.043614+0000","last_change":"2023-11-04T01:41:36.344018+0000","last_active":"2023-11-04T01:41:49.043614+0000","last_peered":"2023-11-04T01:41:49.043614+0000","last_clean":"2023-11-04T01:41:49.043614+0000","last_became_active":"2023-11-04T01:41:34.734178+0000","last_became_peered":"2023-11-04T01:41:34.734178+0000","last_unstale":"2023-11-04T01:41:49.043614+0000","last_undegraded":"2023-11-04T01:41:49.043614+0000","last_fullsized":"2023-11-04T01:41:49.043614+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:16.970814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077338299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-04T01:41:52.059884+0000","last_change":"2023-11-04T01:41:52.059884+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.059884+0000","last_undegraded":"2023-11-04T01:41:52.059884+0000","last_fullsized":"2023-11-04T01:41:52.059884+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-04T01:41:45.568246+0000","last_change":"2023-11-04T01:41:35.906788+0000","last_active":"2023-11-04T01:41:45.568246+0000","last_peered":"2023-11-04T01:41:45.568246+0000","last_clean":"2023-11-04T01:41:45.568246+0000","last_became_active":"2023-11-04T01:41:34.734386+0000","last_became_peered":"2023-11-04T01:41:34.734386+0000","last_unstale":"2023-11-04T01:41:45.568246+0000","last_undegraded":"2023-11-04T01:41:45.568246+0000","last_fullsized":"2023-11-04T01:41:45.568246+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:23:23.733128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060435600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.029038+0000","last_change":"2023-11-04T01:41:35.931718+0000","last_active":"2023-11-04T01:41:49.029038+0000","last_peered":"2023-11-04T01:41:49.029038+0000","last_clean":"2023-11-04T01:41:49.029038+0000","last_became_active":"2023-11-04T01:41:34.741033+0000","last_became_peered":"2023-11-04T01:41:34.741033+0000","last_unstale":"2023-11-04T01:41:49.029038+0000","last_undegraded":"2023-11-04T01:41:49.029038+0000","last_fullsized":"2023-11-04T01:41:49.029038+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:48.121273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065858400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":22,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:41:50.147952+0000","last_change":"2023-11-04T01:41:35.728094+0000","last_active":"2023-11-04T01:41:50.147952+0000","last_peered":"2023-11-04T01:41:50.147952+0000","last_clean":"2023-11-04T01:41:50.147952+0000","last_became_active":"2023-11-04T01:41:34.738687+0000","last_became_peered":"2023-11-04T01:41:34.738687+0000","last_unstale":"2023-11-04T01:41:50.147952+0000","last_undegraded":"2023-11-04T01:41:50.147952+0000","last_fullsized":"2023-11-04T01:41:50.147952+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:37.958719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068772699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":22,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.032404+0000","last_change":"2023-11-04T01:41:35.729106+0000","last_active":"2023-11-04T01:41:49.032404+0000","last_peered":"2023-11-04T01:41:49.032404+0000","last_clean":"2023-11-04T01:41:49.032404+0000","last_became_active":"2023-11-04T01:41:34.731230+0000","last_became_peered":"2023-11-04T01:41:34.731230+0000","last_unstale":"2023-11-04T01:41:49.032404+0000","last_undegraded":"2023-11-04T01:41:49.032404+0000","last_fullsized":"2023-11-04T01:41:49.032404+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:07:32.744572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078592199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2023-11-04T01:41:52.060071+0000","last_change":"2023-11-04T01:41:52.060071+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.060071+0000","last_undegraded":"2023-11-04T01:41:52.060071+0000","last_fullsized":"2023-11-04T01:41:52.060071+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.032492+0000","last_change":"2023-11-04T01:41:35.728672+0000","last_active":"2023-11-04T01:41:49.032492+0000","last_peered":"2023-11-04T01:41:49.032492+0000","last_clean":"2023-11-04T01:41:49.032492+0000","last_became_active":"2023-11-04T01:41:34.727419+0000","last_became_peered":"2023-11-04T01:41:34.727419+0000","last_unstale":"2023-11-04T01:41:49.032492+0000","last_undegraded":"2023-11-04T01:41:49.032492+0000","last_fullsized":"2023-11-04T01:41:49.032492+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:35:01.127206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044278299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:53.052574+0000","last_change":"2023-11-04T01:41:53.052574+0000","last_active":"2023-11-04T01:41:53.052574+0000","last_peered":"2023-11-04T01:41:53.052574+0000","last_clean":"2023-11-04T01:41:53.052574+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:53.052574+0000","last_undegraded":"2023-11-04T01:41:53.052574+0000","last_fullsized":"2023-11-04T01:41:53.052574+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:41:52.045644+0000","last_change":"2023-11-04T01:41:52.045644+0000","last_active":"2023-11-04T01:41:52.045644+0000","last_peered":"2023-11-04T01:41:52.045644+0000","last_clean":"2023-11-04T01:41:52.045644+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:41:52.045644+0000","last_undegraded":"2023-11-04T01:41:52.045644+0000","last_fullsized":"2023-11-04T01:41:52.045644+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.043813+0000","last_change":"2023-11-04T01:41:36.344271+0000","last_active":"2023-11-04T01:41:49.043813+0000","last_peered":"2023-11-04T01:41:49.043813+0000","last_clean":"2023-11-04T01:41:49.043813+0000","last_became_active":"2023-11-04T01:41:34.732524+0000","last_became_peered":"2023-11-04T01:41:34.732524+0000","last_unstale":"2023-11-04T01:41:49.043813+0000","last_undegraded":"2023-11-04T01:41:49.043813+0000","last_fullsized":"2023-11-04T01:41:49.043813+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:19.350812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081160599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":195,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:41:49.042690+0000","last_change":"2023-11-04T01:39:54.204460+0000","last_active":"2023-11-04T01:41:49.042690+0000","last_peered":"2023-11-04T01:41:49.042690+0000","last_clean":"2023-11-04T01:41:49.042690+0000","last_became_active":"2023-11-04T01:39:54.203352+0000","last_became_peered":"2023-11-04T01:39:54.203352+0000","last_unstale":"2023-11-04T01:41:49.042690+0000","last_undegraded":"2023-11-04T01:41:49.042690+0000","last_fullsized":"2023-11-04T01:41:49.042690+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:52.627032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:52.627032+0000","last_clean_scrub_stamp":"2023-11-04T01:39:52.627032+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:17:18.474768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":2},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":264861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.54500000000000004}]},{"osd":1,"last update":"Sat Nov 4 01:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.58199999999999996}]},{"osd":2,"last update":"Sat Nov 4 01:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.49399999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.629},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.65900000000000003}]},{"osd":4,"last update":"Sat Nov 4 01:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.503}]},{"osd":6,"last update":"Sat Nov 4 01:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.56499999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.68799999999999994}]}]},{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28180,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343660,"statfs":{"total":96636764160,"available":96607907840,"internally_reserved":0,"allocated":1187840,"data_stored":855229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.38400000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.46800000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.59299999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.65300000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.436},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.61299999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.64000000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.67000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":264861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.61799999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.51100000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.63800000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.65300000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.38200000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.36099999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.435},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.49299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":264861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.56999999999999995}]},{"osd":1,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.46100000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.624}]},{"osd":3,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.47799999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.497}]},{"osd":6,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.67800000000000005}]},{"osd":7,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.66300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":264861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"last":0.36499999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.40400000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.46000000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.57599999999999996}]},{"osd":5,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.505}]},{"osd":6,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.64400000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.53600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":264861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.313},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.68700000000000006}]},{"osd":1,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.38600000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":1.1739999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":1.2849999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":1.224}]},{"osd":5,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":1.196},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":1.25}]},{"osd":6,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":1.2989999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.70699999999999996}]},{"osd":7,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":1.268},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.67100000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":271351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.443,"5min":0.443,"15min":0.443},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"last":0.33000000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.31}]},{"osd":3,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.35099999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.39300000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.441},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.46300000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.42699999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.496},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.48699999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28180,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343660,"statfs":{"total":96636764160,"available":96607907840,"internally_reserved":0,"allocated":1183744,"data_stored":854210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.32500000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.34000000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.377}]},{"osd":4,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.60899999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.626},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.48599999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.59399999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.57999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:41:57.366 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:41:57.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.498+0000 7fd620d78640 1 Processor -- start 2023-11-04T01:41:57.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.498+0000 7fd620d78640 1 -- start start 2023-11-04T01:41:57.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.498+0000 7fd620d78640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd61c0cde60 0x7fd61c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.498+0000 7fd620d78640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd61c0ce240 0x7fd61c0d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.498+0000 7fd620d78640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd61c15e000 con 0x7fd61c15daa0 2023-11-04T01:41:57.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.498+0000 7fd620d78640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd61c15e5c0 con 0x7fd61c0cde60 2023-11-04T01:41:57.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.498+0000 7fd620d78640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c15e2e0 con 0x7fd61c0ce240 2023-11-04T01:41:57.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.499+0000 7fd61a59c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd61c0cde60 0x7fd61c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.499+0000 7fd613fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd61c15daa0 0x7fd61c157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:42702/0 (socket says 172.21.15.77:42702) 2023-11-04T01:41:57.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.499+0000 7fd613fff640 1 -- 172.21.15.77:0/1322281604 learned_addr learned my addr 172.21.15.77:0/1322281604 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:41:57.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.499+0000 7fd61ad9d640 1 --2- 172.21.15.77:0/1322281604 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd61c0ce240 0x7fd61c0d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.499+0000 7fd61a59c640 1 -- 172.21.15.77:0/1322281604 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd61c0ce240 msgr2=0x7fd61c0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:57.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.499+0000 7fd61a59c640 1 --2- 172.21.15.77:0/1322281604 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd61c0ce240 0x7fd61c0d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.499+0000 7fd61a59c640 1 -- 172.21.15.77:0/1322281604 >> v1:172.21.15.77:6789/0 conn(0x7fd61c15daa0 legacy=0x7fd61c157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.499+0000 7fd619d9b640 1 -- 172.21.15.77:0/1322281604 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1896767756 0 0) 0x7fd61c15e000 con 0x7fd61c15daa0 2023-11-04T01:41:57.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.499+0000 7fd61a59c640 1 -- 172.21.15.77:0/1322281604 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd61c0d1120 con 0x7fd61c0cde60 2023-11-04T01:41:57.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.500+0000 7fd61a59c640 1 --2- 172.21.15.77:0/1322281604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd61c0cde60 0x7fd61c15d560 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0097a0 tx=0x7fd60c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f8ce27cb69fd126 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:57.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.500+0000 7fd619d9b640 1 -- 172.21.15.77:0/1322281604 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c031830 con 0x7fd61c0cde60 2023-11-04T01:41:57.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.500+0000 7fd619d9b640 1 -- 172.21.15.77:0/1322281604 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60c031990 con 0x7fd61c0cde60 2023-11-04T01:41:57.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.500+0000 7fd619d9b640 1 -- 172.21.15.77:0/1322281604 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c031d20 con 0x7fd61c0cde60 2023-11-04T01:41:57.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.500+0000 7fd620d78640 1 -- 172.21.15.77:0/1322281604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd61c0cde60 msgr2=0x7fd61c15d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.500+0000 7fd620d78640 1 --2- 172.21.15.77:0/1322281604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd61c0cde60 0x7fd61c15d560 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0097a0 tx=0x7fd60c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.500+0000 7fd620d78640 1 -- 172.21.15.77:0/1322281604 shutdown_connections 2023-11-04T01:41:57.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.500+0000 7fd620d78640 1 --2- 172.21.15.77:0/1322281604 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd61c0ce240 0x7fd61c0d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.500+0000 7fd620d78640 1 --2- 172.21.15.77:0/1322281604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd61c0cde60 0x7fd61c15d560 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.500+0000 7fd620d78640 1 -- 172.21.15.77:0/1322281604 >> 172.21.15.77:0/1322281604 conn(0x7fd61c071f30 msgr2=0x7fd61c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:57.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.500+0000 7fd620d78640 1 -- 172.21.15.77:0/1322281604 shutdown_connections 2023-11-04T01:41:57.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.500+0000 7fd620d78640 1 -- 172.21.15.77:0/1322281604 wait complete. 2023-11-04T01:41:57.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.502+0000 7fd620d78640 1 Processor -- start 2023-11-04T01:41:57.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.502+0000 7fd620d78640 1 -- start start 2023-11-04T01:41:57.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.502+0000 7fd620d78640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd61c0cde60 0x7fd61c15ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.502+0000 7fd620d78640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd61c0ce240 0x7fd61c14d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.502+0000 7fd620d78640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd61c15daa0 0x7fd61c157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.502+0000 7fd620d78640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c1584f0 con 0x7fd61c0cde60 2023-11-04T01:41:57.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.502+0000 7fd620d78640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c1587d0 con 0x7fd61c0ce240 2023-11-04T01:41:57.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.502+0000 7fd620d78640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c158ab0 con 0x7fd61c15daa0 2023-11-04T01:41:57.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.503+0000 7fd61a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd61c0cde60 0x7fd61c15ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.503+0000 7fd61a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd61c0cde60 0x7fd61c15ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56702/0 (socket says 172.21.15.77:56702) 2023-11-04T01:41:57.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.503+0000 7fd61a59c640 1 -- 172.21.15.77:0/1336888972 learned_addr learned my addr 172.21.15.77:0/1336888972 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:57.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.503+0000 7fd613fff640 1 --2- 172.21.15.77:0/1336888972 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd61c0ce240 0x7fd61c14d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.503+0000 7fd61ad9d640 1 --2- 172.21.15.77:0/1336888972 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd61c15daa0 0x7fd61c157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.503+0000 7fd61a59c640 1 -- 172.21.15.77:0/1336888972 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd61c15daa0 msgr2=0x7fd61c157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.503+0000 7fd61a59c640 1 --2- 172.21.15.77:0/1336888972 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd61c15daa0 0x7fd61c157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.503+0000 7fd61a59c640 1 -- 172.21.15.77:0/1336888972 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd61c0ce240 msgr2=0x7fd61c14d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.503+0000 7fd61a59c640 1 --2- 172.21.15.77:0/1336888972 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd61c0ce240 0x7fd61c14d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.503+0000 7fd61a59c640 1 -- 172.21.15.77:0/1336888972 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60c009400 con 0x7fd61c0cde60 2023-11-04T01:41:57.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.503+0000 7fd613fff640 1 --2- 172.21.15.77:0/1336888972 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd61c0ce240 0x7fd61c14d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:41:57.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.503+0000 7fd61a59c640 1 --2- 172.21.15.77:0/1336888972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd61c0cde60 0x7fd61c15ae30 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0098c0 tx=0x7fd60c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:57.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.503+0000 7fd612ffd640 1 -- 172.21.15.77:0/1336888972 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c03a6f0 con 0x7fd61c0cde60 2023-11-04T01:41:57.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.503+0000 7fd612ffd640 1 -- 172.21.15.77:0/1336888972 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60c03a870 con 0x7fd61c0cde60 2023-11-04T01:41:57.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.503+0000 7fd620d78640 1 -- 172.21.15.77:0/1336888972 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd61c158d90 con 0x7fd61c0cde60 2023-11-04T01:41:57.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.503+0000 7fd612ffd640 1 -- 172.21.15.77:0/1336888972 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c03ac20 con 0x7fd61c0cde60 2023-11-04T01:41:57.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.503+0000 7fd620d78640 1 -- 172.21.15.77:0/1336888972 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd61c158200 con 0x7fd61c0cde60 2023-11-04T01:41:57.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.504+0000 7fd620d78640 1 -- 172.21.15.77:0/1336888972 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd61c1592b0 con 0x7fd61c0cde60 2023-11-04T01:41:57.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.505+0000 7fd612ffd640 1 -- 172.21.15.77:0/1336888972 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd60c04c3b0 con 0x7fd61c0cde60 2023-11-04T01:41:57.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.505+0000 7fd612ffd640 1 --2- 172.21.15.77:0/1336888972 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd5fc06ae70 0x7fd5fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.505+0000 7fd612ffd640 1 -- 172.21.15.77:0/1336888972 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd60c0ab490 con 0x7fd61c0cde60 2023-11-04T01:41:57.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.505+0000 7fd613fff640 1 --2- 172.21.15.77:0/1336888972 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd5fc06ae70 0x7fd5fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.506+0000 7fd613fff640 1 --2- 172.21.15.77:0/1336888972 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd5fc06ae70 0x7fd5fc06d330 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd61c157c30 tx=0x7fd604007ca0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:57.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.509+0000 7fd612ffd640 1 -- 172.21.15.77:0/1336888972 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd61c1592b0 con 0x7fd61c0cde60 2023-11-04T01:41:57.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.672+0000 7fd620d78640 1 -- 172.21.15.77:0/1336888972 --> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd61c0d1400 con 0x7fd5fc06ae70 2023-11-04T01:41:57.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.682+0000 7fd612ffd640 1 -- 172.21.15.77:0/1336888972 <== mgr.4123 v2:172.21.15.122:6832/2275325762 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370225 (secure 0 0 0) 0x7fd604005c80 con 0x7fd5fc06ae70 2023-11-04T01:41:57.687 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:57.690 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-04T01:41:57.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.685+0000 7fd620d78640 1 -- 172.21.15.77:0/1336888972 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd5fc06ae70 msgr2=0x7fd5fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.685+0000 7fd620d78640 1 --2- 172.21.15.77:0/1336888972 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd5fc06ae70 0x7fd5fc06d330 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd61c157c30 tx=0x7fd604007ca0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.685+0000 7fd620d78640 1 -- 172.21.15.77:0/1336888972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd61c0cde60 msgr2=0x7fd61c15ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.685+0000 7fd620d78640 1 --2- 172.21.15.77:0/1336888972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd61c0cde60 0x7fd61c15ae30 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0098c0 tx=0x7fd60c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.685+0000 7fd620d78640 1 -- 172.21.15.77:0/1336888972 shutdown_connections 2023-11-04T01:41:57.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.685+0000 7fd620d78640 1 --2- 172.21.15.77:0/1336888972 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd5fc06ae70 0x7fd5fc06d330 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.685+0000 7fd620d78640 1 --2- 172.21.15.77:0/1336888972 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd61c15daa0 0x7fd61c157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.685+0000 7fd620d78640 1 --2- 172.21.15.77:0/1336888972 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd61c0ce240 0x7fd61c14d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.685+0000 7fd620d78640 1 --2- 172.21.15.77:0/1336888972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd61c0cde60 0x7fd61c15ae30 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.685+0000 7fd620d78640 1 -- 172.21.15.77:0/1336888972 >> 172.21.15.77:0/1336888972 conn(0x7fd61c071f30 msgr2=0x7fd61c0b79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:57.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.685+0000 7fd620d78640 1 -- 172.21.15.77:0/1336888972 shutdown_connections 2023-11-04T01:41:57.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.685+0000 7fd620d78640 1 -- 172.21.15.77:0/1336888972 wait complete. 2023-11-04T01:41:57.697 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2023-11-04T01:41:57.653885+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":200,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222384,"kb_used_data":6184,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752336,"statfs":{"total":773094113280,"available":772866392064,"internally_reserved":0,"allocated":6332416,"data_stored":3491368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.596875"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590009+0000","last_change":"2023-11-04T01:41:54.087836+0000","last_active":"2023-11-04T01:41:56.590009+0000","last_peered":"2023-11-04T01:41:56.590009+0000","last_clean":"2023-11-04T01:41:56.590009+0000","last_became_active":"2023-11-04T01:41:54.087590+0000","last_became_peered":"2023-11-04T01:41:54.087590+0000","last_unstale":"2023-11-04T01:41:56.590009+0000","last_undegraded":"2023-11-04T01:41:56.590009+0000","last_fullsized":"2023-11-04T01:41:56.590009+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:14:41.371010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590159+0000","last_change":"2023-11-04T01:41:54.092108+0000","last_active":"2023-11-04T01:41:56.590159+0000","last_peered":"2023-11-04T01:41:56.590159+0000","last_clean":"2023-11-04T01:41:56.590159+0000","last_became_active":"2023-11-04T01:41:54.091856+0000","last_became_peered":"2023-11-04T01:41:54.091856+0000","last_unstale":"2023-11-04T01:41:56.590159+0000","last_undegraded":"2023-11-04T01:41:56.590159+0000","last_fullsized":"2023-11-04T01:41:56.590159+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:52:17.923196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085645+0000","last_change":"2023-11-04T01:41:54.081697+0000","last_active":"2023-11-04T01:41:55.085645+0000","last_peered":"2023-11-04T01:41:55.085645+0000","last_clean":"2023-11-04T01:41:55.085645+0000","last_became_active":"2023-11-04T01:41:54.080925+0000","last_became_peered":"2023-11-04T01:41:54.080925+0000","last_unstale":"2023-11-04T01:41:55.085645+0000","last_undegraded":"2023-11-04T01:41:55.085645+0000","last_fullsized":"2023-11-04T01:41:55.085645+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:09:20.408298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085924+0000","last_change":"2023-11-04T01:41:54.085207+0000","last_active":"2023-11-04T01:41:55.085924+0000","last_peered":"2023-11-04T01:41:55.085924+0000","last_clean":"2023-11-04T01:41:55.085924+0000","last_became_active":"2023-11-04T01:41:54.081758+0000","last_became_peered":"2023-11-04T01:41:54.081758+0000","last_unstale":"2023-11-04T01:41:55.085924+0000","last_undegraded":"2023-11-04T01:41:55.085924+0000","last_fullsized":"2023-11-04T01:41:55.085924+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:49.436809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589675+0000","last_change":"2023-11-04T01:41:54.081691+0000","last_active":"2023-11-04T01:41:56.589675+0000","last_peered":"2023-11-04T01:41:56.589675+0000","last_clean":"2023-11-04T01:41:56.589675+0000","last_became_active":"2023-11-04T01:41:54.081400+0000","last_became_peered":"2023-11-04T01:41:54.081400+0000","last_unstale":"2023-11-04T01:41:56.589675+0000","last_undegraded":"2023-11-04T01:41:56.589675+0000","last_fullsized":"2023-11-04T01:41:56.589675+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:22:11.948292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589953+0000","last_change":"2023-11-04T01:41:54.090265+0000","last_active":"2023-11-04T01:41:56.589953+0000","last_peered":"2023-11-04T01:41:56.589953+0000","last_clean":"2023-11-04T01:41:56.589953+0000","last_became_active":"2023-11-04T01:41:54.090023+0000","last_became_peered":"2023-11-04T01:41:54.090023+0000","last_unstale":"2023-11-04T01:41:56.589953+0000","last_undegraded":"2023-11-04T01:41:56.589953+0000","last_fullsized":"2023-11-04T01:41:56.589953+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:09:05.963500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589192+0000","last_change":"2023-11-04T01:41:54.081762+0000","last_active":"2023-11-04T01:41:56.589192+0000","last_peered":"2023-11-04T01:41:56.589192+0000","last_clean":"2023-11-04T01:41:56.589192+0000","last_became_active":"2023-11-04T01:41:54.081515+0000","last_became_peered":"2023-11-04T01:41:54.081515+0000","last_unstale":"2023-11-04T01:41:56.589192+0000","last_undegraded":"2023-11-04T01:41:56.589192+0000","last_fullsized":"2023-11-04T01:41:56.589192+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:14.516867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589641+0000","last_change":"2023-11-04T01:41:54.080725+0000","last_active":"2023-11-04T01:41:56.589641+0000","last_peered":"2023-11-04T01:41:56.589641+0000","last_clean":"2023-11-04T01:41:56.589641+0000","last_became_active":"2023-11-04T01:41:54.080446+0000","last_became_peered":"2023-11-04T01:41:54.080446+0000","last_unstale":"2023-11-04T01:41:56.589641+0000","last_undegraded":"2023-11-04T01:41:56.589641+0000","last_fullsized":"2023-11-04T01:41:56.589641+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:36:28.196536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589582+0000","last_change":"2023-11-04T01:41:54.091895+0000","last_active":"2023-11-04T01:41:56.589582+0000","last_peered":"2023-11-04T01:41:56.589582+0000","last_clean":"2023-11-04T01:41:56.589582+0000","last_became_active":"2023-11-04T01:41:54.091641+0000","last_became_peered":"2023-11-04T01:41:54.091641+0000","last_unstale":"2023-11-04T01:41:56.589582+0000","last_undegraded":"2023-11-04T01:41:56.589582+0000","last_fullsized":"2023-11-04T01:41:56.589582+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:13:17.472616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.081608+0000","last_change":"2023-11-04T01:41:54.078741+0000","last_active":"2023-11-04T01:41:55.081608+0000","last_peered":"2023-11-04T01:41:55.081608+0000","last_clean":"2023-11-04T01:41:55.081608+0000","last_became_active":"2023-11-04T01:41:54.078419+0000","last_became_peered":"2023-11-04T01:41:54.078419+0000","last_unstale":"2023-11-04T01:41:55.081608+0000","last_undegraded":"2023-11-04T01:41:55.081608+0000","last_fullsized":"2023-11-04T01:41:55.081608+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:44.807007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.081745+0000","last_change":"2023-11-04T01:41:54.086241+0000","last_active":"2023-11-04T01:41:55.081745+0000","last_peered":"2023-11-04T01:41:55.081745+0000","last_clean":"2023-11-04T01:41:55.081745+0000","last_became_active":"2023-11-04T01:41:54.085701+0000","last_became_peered":"2023-11-04T01:41:54.085701+0000","last_unstale":"2023-11-04T01:41:55.081745+0000","last_undegraded":"2023-11-04T01:41:55.081745+0000","last_fullsized":"2023-11-04T01:41:55.081745+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:32:36.620521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.084622+0000","last_change":"2023-11-04T01:41:54.083807+0000","last_active":"2023-11-04T01:41:55.084622+0000","last_peered":"2023-11-04T01:41:55.084622+0000","last_clean":"2023-11-04T01:41:55.084622+0000","last_became_active":"2023-11-04T01:41:54.083543+0000","last_became_peered":"2023-11-04T01:41:54.083543+0000","last_unstale":"2023-11-04T01:41:55.084622+0000","last_undegraded":"2023-11-04T01:41:55.084622+0000","last_fullsized":"2023-11-04T01:41:55.084622+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:52.207829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.331475+0000","last_change":"2023-11-04T01:41:54.092079+0000","last_active":"2023-11-04T01:41:56.331475+0000","last_peered":"2023-11-04T01:41:56.331475+0000","last_clean":"2023-11-04T01:41:56.331475+0000","last_became_active":"2023-11-04T01:41:54.091786+0000","last_became_peered":"2023-11-04T01:41:54.091786+0000","last_unstale":"2023-11-04T01:41:56.331475+0000","last_undegraded":"2023-11-04T01:41:56.331475+0000","last_fullsized":"2023-11-04T01:41:56.331475+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:57:42.655270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589386+0000","last_change":"2023-11-04T01:41:54.085256+0000","last_active":"2023-11-04T01:41:56.589386+0000","last_peered":"2023-11-04T01:41:56.589386+0000","last_clean":"2023-11-04T01:41:56.589386+0000","last_became_active":"2023-11-04T01:41:54.084652+0000","last_became_peered":"2023-11-04T01:41:54.084652+0000","last_unstale":"2023-11-04T01:41:56.589386+0000","last_undegraded":"2023-11-04T01:41:56.589386+0000","last_fullsized":"2023-11-04T01:41:56.589386+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:44.807007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589329+0000","last_change":"2023-11-04T01:41:54.073589+0000","last_active":"2023-11-04T01:41:56.589329+0000","last_peered":"2023-11-04T01:41:56.589329+0000","last_clean":"2023-11-04T01:41:56.589329+0000","last_became_active":"2023-11-04T01:41:54.073292+0000","last_became_peered":"2023-11-04T01:41:54.073292+0000","last_unstale":"2023-11-04T01:41:56.589329+0000","last_undegraded":"2023-11-04T01:41:56.589329+0000","last_fullsized":"2023-11-04T01:41:56.589329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:40.760885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589277+0000","last_change":"2023-11-04T01:41:54.087994+0000","last_active":"2023-11-04T01:41:56.589277+0000","last_peered":"2023-11-04T01:41:56.589277+0000","last_clean":"2023-11-04T01:41:56.589277+0000","last_became_active":"2023-11-04T01:41:54.087529+0000","last_became_peered":"2023-11-04T01:41:54.087529+0000","last_unstale":"2023-11-04T01:41:56.589277+0000","last_undegraded":"2023-11-04T01:41:56.589277+0000","last_fullsized":"2023-11-04T01:41:56.589277+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:37:37.857295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590482+0000","last_change":"2023-11-04T01:41:54.084644+0000","last_active":"2023-11-04T01:41:56.590482+0000","last_peered":"2023-11-04T01:41:56.590482+0000","last_clean":"2023-11-04T01:41:56.590482+0000","last_became_active":"2023-11-04T01:41:54.084354+0000","last_became_peered":"2023-11-04T01:41:54.084354+0000","last_unstale":"2023-11-04T01:41:56.590482+0000","last_undegraded":"2023-11-04T01:41:56.590482+0000","last_fullsized":"2023-11-04T01:41:56.590482+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:56:59.472772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085262+0000","last_change":"2023-11-04T01:41:54.092787+0000","last_active":"2023-11-04T01:41:55.085262+0000","last_peered":"2023-11-04T01:41:55.085262+0000","last_clean":"2023-11-04T01:41:55.085262+0000","last_became_active":"2023-11-04T01:41:54.092471+0000","last_became_peered":"2023-11-04T01:41:54.092471+0000","last_unstale":"2023-11-04T01:41:55.085262+0000","last_undegraded":"2023-11-04T01:41:55.085262+0000","last_fullsized":"2023-11-04T01:41:55.085262+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:46:28.222652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589584+0000","last_change":"2023-11-04T01:41:54.087167+0000","last_active":"2023-11-04T01:41:56.589584+0000","last_peered":"2023-11-04T01:41:56.589584+0000","last_clean":"2023-11-04T01:41:56.589584+0000","last_became_active":"2023-11-04T01:41:54.086905+0000","last_became_peered":"2023-11-04T01:41:54.086905+0000","last_unstale":"2023-11-04T01:41:56.589584+0000","last_undegraded":"2023-11-04T01:41:56.589584+0000","last_fullsized":"2023-11-04T01:41:56.589584+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:02:48.912210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590277+0000","last_change":"2023-11-04T01:41:54.092451+0000","last_active":"2023-11-04T01:41:56.590277+0000","last_peered":"2023-11-04T01:41:56.590277+0000","last_clean":"2023-11-04T01:41:56.590277+0000","last_became_active":"2023-11-04T01:41:54.092212+0000","last_became_peered":"2023-11-04T01:41:54.092212+0000","last_unstale":"2023-11-04T01:41:56.590277+0000","last_undegraded":"2023-11-04T01:41:56.590277+0000","last_fullsized":"2023-11-04T01:41:56.590277+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:46:09.677609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.084974+0000","last_change":"2023-11-04T01:41:54.080620+0000","last_active":"2023-11-04T01:41:55.084974+0000","last_peered":"2023-11-04T01:41:55.084974+0000","last_clean":"2023-11-04T01:41:55.084974+0000","last_became_active":"2023-11-04T01:41:54.080202+0000","last_became_peered":"2023-11-04T01:41:54.080202+0000","last_unstale":"2023-11-04T01:41:55.084974+0000","last_undegraded":"2023-11-04T01:41:55.084974+0000","last_fullsized":"2023-11-04T01:41:55.084974+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:14:17.050765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590838+0000","last_change":"2023-11-04T01:41:54.091350+0000","last_active":"2023-11-04T01:41:56.590838+0000","last_peered":"2023-11-04T01:41:56.590838+0000","last_clean":"2023-11-04T01:41:56.590838+0000","last_became_active":"2023-11-04T01:41:54.090745+0000","last_became_peered":"2023-11-04T01:41:54.090745+0000","last_unstale":"2023-11-04T01:41:56.590838+0000","last_undegraded":"2023-11-04T01:41:56.590838+0000","last_fullsized":"2023-11-04T01:41:56.590838+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:46:29.429058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085258+0000","last_change":"2023-11-04T01:41:54.081175+0000","last_active":"2023-11-04T01:41:55.085258+0000","last_peered":"2023-11-04T01:41:55.085258+0000","last_clean":"2023-11-04T01:41:55.085258+0000","last_became_active":"2023-11-04T01:41:54.080838+0000","last_became_peered":"2023-11-04T01:41:54.080838+0000","last_unstale":"2023-11-04T01:41:55.085258+0000","last_undegraded":"2023-11-04T01:41:55.085258+0000","last_fullsized":"2023-11-04T01:41:55.085258+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:32:12.744944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.331133+0000","last_change":"2023-11-04T01:41:54.088758+0000","last_active":"2023-11-04T01:41:56.331133+0000","last_peered":"2023-11-04T01:41:56.331133+0000","last_clean":"2023-11-04T01:41:56.331133+0000","last_became_active":"2023-11-04T01:41:54.088433+0000","last_became_peered":"2023-11-04T01:41:54.088433+0000","last_unstale":"2023-11-04T01:41:56.331133+0000","last_undegraded":"2023-11-04T01:41:56.331133+0000","last_fullsized":"2023-11-04T01:41:56.331133+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:07:52.095800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590194+0000","last_change":"2023-11-04T01:41:54.085622+0000","last_active":"2023-11-04T01:41:56.590194+0000","last_peered":"2023-11-04T01:41:56.590194+0000","last_clean":"2023-11-04T01:41:56.590194+0000","last_became_active":"2023-11-04T01:41:54.085304+0000","last_became_peered":"2023-11-04T01:41:54.085304+0000","last_unstale":"2023-11-04T01:41:56.590194+0000","last_undegraded":"2023-11-04T01:41:56.590194+0000","last_fullsized":"2023-11-04T01:41:56.590194+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:39.440934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085016+0000","last_change":"2023-11-04T01:41:54.082662+0000","last_active":"2023-11-04T01:41:55.085016+0000","last_peered":"2023-11-04T01:41:55.085016+0000","last_clean":"2023-11-04T01:41:55.085016+0000","last_became_active":"2023-11-04T01:41:54.082371+0000","last_became_peered":"2023-11-04T01:41:54.082371+0000","last_unstale":"2023-11-04T01:41:55.085016+0000","last_undegraded":"2023-11-04T01:41:55.085016+0000","last_fullsized":"2023-11-04T01:41:55.085016+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:48:32.480005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590082+0000","last_change":"2023-11-04T01:41:54.089951+0000","last_active":"2023-11-04T01:41:56.590082+0000","last_peered":"2023-11-04T01:41:56.590082+0000","last_clean":"2023-11-04T01:41:56.590082+0000","last_became_active":"2023-11-04T01:41:54.089244+0000","last_became_peered":"2023-11-04T01:41:54.089244+0000","last_unstale":"2023-11-04T01:41:56.590082+0000","last_undegraded":"2023-11-04T01:41:56.590082+0000","last_fullsized":"2023-11-04T01:41:56.590082+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:49.436809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589399+0000","last_change":"2023-11-04T01:41:54.083191+0000","last_active":"2023-11-04T01:41:56.589399+0000","last_peered":"2023-11-04T01:41:56.589399+0000","last_clean":"2023-11-04T01:41:56.589399+0000","last_became_active":"2023-11-04T01:41:54.082930+0000","last_became_peered":"2023-11-04T01:41:54.082930+0000","last_unstale":"2023-11-04T01:41:56.589399+0000","last_undegraded":"2023-11-04T01:41:56.589399+0000","last_fullsized":"2023-11-04T01:41:56.589399+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:15:56.008303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590795+0000","last_change":"2023-11-04T01:41:54.088423+0000","last_active":"2023-11-04T01:41:56.590795+0000","last_peered":"2023-11-04T01:41:56.590795+0000","last_clean":"2023-11-04T01:41:56.590795+0000","last_became_active":"2023-11-04T01:41:54.088154+0000","last_became_peered":"2023-11-04T01:41:54.088154+0000","last_unstale":"2023-11-04T01:41:56.590795+0000","last_undegraded":"2023-11-04T01:41:56.590795+0000","last_fullsized":"2023-11-04T01:41:56.590795+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:47:50.594104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085545+0000","last_change":"2023-11-04T01:41:54.081291+0000","last_active":"2023-11-04T01:41:55.085545+0000","last_peered":"2023-11-04T01:41:55.085545+0000","last_clean":"2023-11-04T01:41:55.085545+0000","last_became_active":"2023-11-04T01:41:54.080954+0000","last_became_peered":"2023-11-04T01:41:54.080954+0000","last_unstale":"2023-11-04T01:41:55.085545+0000","last_undegraded":"2023-11-04T01:41:55.085545+0000","last_fullsized":"2023-11-04T01:41:55.085545+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:37:37.857295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589322+0000","last_change":"2023-11-04T01:41:54.085418+0000","last_active":"2023-11-04T01:41:56.589322+0000","last_peered":"2023-11-04T01:41:56.589322+0000","last_clean":"2023-11-04T01:41:56.589322+0000","last_became_active":"2023-11-04T01:41:54.084970+0000","last_became_peered":"2023-11-04T01:41:54.084970+0000","last_unstale":"2023-11-04T01:41:56.589322+0000","last_undegraded":"2023-11-04T01:41:56.589322+0000","last_fullsized":"2023-11-04T01:41:56.589322+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:32:39.225407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589155+0000","last_change":"2023-11-04T01:41:54.091099+0000","last_active":"2023-11-04T01:41:56.589155+0000","last_peered":"2023-11-04T01:41:56.589155+0000","last_clean":"2023-11-04T01:41:56.589155+0000","last_became_active":"2023-11-04T01:41:54.088304+0000","last_became_peered":"2023-11-04T01:41:54.088304+0000","last_unstale":"2023-11-04T01:41:56.589155+0000","last_undegraded":"2023-11-04T01:41:56.589155+0000","last_fullsized":"2023-11-04T01:41:56.589155+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:48:32.480005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085743+0000","last_change":"2023-11-04T01:41:54.076985+0000","last_active":"2023-11-04T01:41:55.085743+0000","last_peered":"2023-11-04T01:41:55.085743+0000","last_clean":"2023-11-04T01:41:55.085743+0000","last_became_active":"2023-11-04T01:41:54.076693+0000","last_became_peered":"2023-11-04T01:41:54.076693+0000","last_unstale":"2023-11-04T01:41:55.085743+0000","last_undegraded":"2023-11-04T01:41:55.085743+0000","last_fullsized":"2023-11-04T01:41:55.085743+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:09:05.963500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.331092+0000","last_change":"2023-11-04T01:41:53.075915+0000","last_active":"2023-11-04T01:41:56.331092+0000","last_peered":"2023-11-04T01:41:56.331092+0000","last_clean":"2023-11-04T01:41:56.331092+0000","last_became_active":"2023-11-04T01:41:53.075655+0000","last_became_peered":"2023-11-04T01:41:53.075655+0000","last_unstale":"2023-11-04T01:41:56.331092+0000","last_undegraded":"2023-11-04T01:41:56.331092+0000","last_fullsized":"2023-11-04T01:41:56.331092+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:52:08.757521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.069885+0000","last_change":"2023-11-04T01:41:36.067943+0000","last_active":"2023-11-04T01:41:54.069885+0000","last_peered":"2023-11-04T01:41:54.069885+0000","last_clean":"2023-11-04T01:41:54.069885+0000","last_became_active":"2023-11-04T01:41:34.734305+0000","last_became_peered":"2023-11-04T01:41:34.734305+0000","last_unstale":"2023-11-04T01:41:54.069885+0000","last_undegraded":"2023-11-04T01:41:54.069885+0000","last_fullsized":"2023-11-04T01:41:54.069885+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:48.121273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033780399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.084585+0000","last_change":"2023-11-04T01:41:54.091465+0000","last_active":"2023-11-04T01:41:55.084585+0000","last_peered":"2023-11-04T01:41:55.084585+0000","last_clean":"2023-11-04T01:41:55.084585+0000","last_became_active":"2023-11-04T01:41:54.090588+0000","last_became_peered":"2023-11-04T01:41:54.090588+0000","last_unstale":"2023-11-04T01:41:55.084585+0000","last_undegraded":"2023-11-04T01:41:55.084585+0000","last_fullsized":"2023-11-04T01:41:55.084585+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:46:28.222652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590684+0000","last_change":"2023-11-04T01:41:53.080156+0000","last_active":"2023-11-04T01:41:56.590684+0000","last_peered":"2023-11-04T01:41:56.590684+0000","last_clean":"2023-11-04T01:41:56.590684+0000","last_became_active":"2023-11-04T01:41:53.079885+0000","last_became_peered":"2023-11-04T01:41:53.079885+0000","last_unstale":"2023-11-04T01:41:56.590684+0000","last_undegraded":"2023-11-04T01:41:56.590684+0000","last_fullsized":"2023-11-04T01:41:56.590684+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:59:01.361687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":25,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.075075+0000","last_change":"2023-11-04T01:41:35.728832+0000","last_active":"2023-11-04T01:41:54.075075+0000","last_peered":"2023-11-04T01:41:54.075075+0000","last_clean":"2023-11-04T01:41:54.075075+0000","last_became_active":"2023-11-04T01:41:34.733517+0000","last_became_peered":"2023-11-04T01:41:34.733517+0000","last_unstale":"2023-11-04T01:41:54.075075+0000","last_undegraded":"2023-11-04T01:41:54.075075+0000","last_fullsized":"2023-11-04T01:41:54.075075+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:19.350812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042545700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085411+0000","last_change":"2023-11-04T01:41:54.081783+0000","last_active":"2023-11-04T01:41:55.085411+0000","last_peered":"2023-11-04T01:41:55.085411+0000","last_clean":"2023-11-04T01:41:55.085411+0000","last_became_active":"2023-11-04T01:41:54.081475+0000","last_became_peered":"2023-11-04T01:41:54.081475+0000","last_unstale":"2023-11-04T01:41:55.085411+0000","last_undegraded":"2023-11-04T01:41:55.085411+0000","last_fullsized":"2023-11-04T01:41:55.085411+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:48:32.480005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"53'8","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085700+0000","last_change":"2023-11-04T01:41:53.080511+0000","last_active":"2023-11-04T01:41:55.085700+0000","last_peered":"2023-11-04T01:41:55.085700+0000","last_clean":"2023-11-04T01:41:55.085700+0000","last_became_active":"2023-11-04T01:41:53.080220+0000","last_became_peered":"2023-11-04T01:41:53.080220+0000","last_unstale":"2023-11-04T01:41:55.085700+0000","last_undegraded":"2023-11-04T01:41:55.085700+0000","last_fullsized":"2023-11-04T01:41:55.085700+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:13.509937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":25,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.074083+0000","last_change":"2023-11-04T01:41:35.906660+0000","last_active":"2023-11-04T01:41:54.074083+0000","last_peered":"2023-11-04T01:41:54.074083+0000","last_clean":"2023-11-04T01:41:54.074083+0000","last_became_active":"2023-11-04T01:41:34.737209+0000","last_became_peered":"2023-11-04T01:41:34.737209+0000","last_unstale":"2023-11-04T01:41:54.074083+0000","last_undegraded":"2023-11-04T01:41:54.074083+0000","last_fullsized":"2023-11-04T01:41:54.074083+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:59.608410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068889500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589173+0000","last_change":"2023-11-04T01:41:54.075813+0000","last_active":"2023-11-04T01:41:56.589173+0000","last_peered":"2023-11-04T01:41:56.589173+0000","last_clean":"2023-11-04T01:41:56.589173+0000","last_became_active":"2023-11-04T01:41:54.071739+0000","last_became_peered":"2023-11-04T01:41:54.071739+0000","last_unstale":"2023-11-04T01:41:56.589173+0000","last_undegraded":"2023-11-04T01:41:56.589173+0000","last_fullsized":"2023-11-04T01:41:56.589173+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:58.634155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.074643+0000","last_change":"2023-11-04T01:41:53.077563+0000","last_active":"2023-11-04T01:41:54.074643+0000","last_peered":"2023-11-04T01:41:54.074643+0000","last_clean":"2023-11-04T01:41:54.074643+0000","last_became_active":"2023-11-04T01:41:53.077282+0000","last_became_peered":"2023-11-04T01:41:53.077282+0000","last_unstale":"2023-11-04T01:41:54.074643+0000","last_undegraded":"2023-11-04T01:41:54.074643+0000","last_fullsized":"2023-11-04T01:41:54.074643+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:26:30.691165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.069241+0000","last_change":"2023-11-04T01:41:36.067946+0000","last_active":"2023-11-04T01:41:54.069241+0000","last_peered":"2023-11-04T01:41:54.069241+0000","last_clean":"2023-11-04T01:41:54.069241+0000","last_became_active":"2023-11-04T01:41:34.729591+0000","last_became_peered":"2023-11-04T01:41:34.729591+0000","last_unstale":"2023-11-04T01:41:54.069241+0000","last_undegraded":"2023-11-04T01:41:54.069241+0000","last_fullsized":"2023-11-04T01:41:54.069241+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:59.608410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032681099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.086199+0000","last_change":"2023-11-04T01:41:54.083870+0000","last_active":"2023-11-04T01:41:55.086199+0000","last_peered":"2023-11-04T01:41:55.086199+0000","last_clean":"2023-11-04T01:41:55.086199+0000","last_became_active":"2023-11-04T01:41:54.083604+0000","last_became_peered":"2023-11-04T01:41:54.083604+0000","last_unstale":"2023-11-04T01:41:55.086199+0000","last_undegraded":"2023-11-04T01:41:55.086199+0000","last_fullsized":"2023-11-04T01:41:55.086199+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:02:33.389340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590318+0000","last_change":"2023-11-04T01:41:53.079881+0000","last_active":"2023-11-04T01:41:56.590318+0000","last_peered":"2023-11-04T01:41:56.590318+0000","last_clean":"2023-11-04T01:41:56.590318+0000","last_became_active":"2023-11-04T01:41:53.079530+0000","last_became_peered":"2023-11-04T01:41:53.079530+0000","last_unstale":"2023-11-04T01:41:56.590318+0000","last_undegraded":"2023-11-04T01:41:56.590318+0000","last_fullsized":"2023-11-04T01:41:56.590318+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:48:31.473075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":25,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.073242+0000","last_change":"2023-11-04T01:41:35.905999+0000","last_active":"2023-11-04T01:41:54.073242+0000","last_peered":"2023-11-04T01:41:54.073242+0000","last_clean":"2023-11-04T01:41:54.073242+0000","last_became_active":"2023-11-04T01:41:34.735286+0000","last_became_peered":"2023-11-04T01:41:34.735286+0000","last_unstale":"2023-11-04T01:41:54.073242+0000","last_undegraded":"2023-11-04T01:41:54.073242+0000","last_fullsized":"2023-11-04T01:41:54.073242+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:14:22.019781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051880100000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589638+0000","last_change":"2023-11-04T01:41:54.072933+0000","last_active":"2023-11-04T01:41:56.589638+0000","last_peered":"2023-11-04T01:41:56.589638+0000","last_clean":"2023-11-04T01:41:56.589638+0000","last_became_active":"2023-11-04T01:41:54.072650+0000","last_became_peered":"2023-11-04T01:41:54.072650+0000","last_unstale":"2023-11-04T01:41:56.589638+0000","last_undegraded":"2023-11-04T01:41:56.589638+0000","last_fullsized":"2023-11-04T01:41:56.589638+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:32:36.620521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.086308+0000","last_change":"2023-11-04T01:41:53.078747+0000","last_active":"2023-11-04T01:41:55.086308+0000","last_peered":"2023-11-04T01:41:55.086308+0000","last_clean":"2023-11-04T01:41:55.086308+0000","last_became_active":"2023-11-04T01:41:53.078478+0000","last_became_peered":"2023-11-04T01:41:53.078478+0000","last_unstale":"2023-11-04T01:41:55.086308+0000","last_undegraded":"2023-11-04T01:41:55.086308+0000","last_fullsized":"2023-11-04T01:41:55.086308+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:04.784101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.073488+0000","last_change":"2023-11-04T01:41:36.344205+0000","last_active":"2023-11-04T01:41:54.073488+0000","last_peered":"2023-11-04T01:41:54.073488+0000","last_clean":"2023-11-04T01:41:54.073488+0000","last_became_active":"2023-11-04T01:41:34.733205+0000","last_became_peered":"2023-11-04T01:41:34.733205+0000","last_unstale":"2023-11-04T01:41:54.073488+0000","last_undegraded":"2023-11-04T01:41:54.073488+0000","last_fullsized":"2023-11-04T01:41:54.073488+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:37.958719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011584760000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.086040+0000","last_change":"2023-11-04T01:41:54.084896+0000","last_active":"2023-11-04T01:41:55.086040+0000","last_peered":"2023-11-04T01:41:55.086040+0000","last_clean":"2023-11-04T01:41:55.086040+0000","last_became_active":"2023-11-04T01:41:54.084420+0000","last_became_peered":"2023-11-04T01:41:54.084420+0000","last_unstale":"2023-11-04T01:41:55.086040+0000","last_undegraded":"2023-11-04T01:41:55.086040+0000","last_fullsized":"2023-11-04T01:41:55.086040+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:19:37.120155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"53'6","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589458+0000","last_change":"2023-11-04T01:41:53.083938+0000","last_active":"2023-11-04T01:41:56.589458+0000","last_peered":"2023-11-04T01:41:56.589458+0000","last_clean":"2023-11-04T01:41:56.589458+0000","last_became_active":"2023-11-04T01:41:53.083642+0000","last_became_peered":"2023-11-04T01:41:53.083642+0000","last_unstale":"2023-11-04T01:41:56.589458+0000","last_undegraded":"2023-11-04T01:41:56.589458+0000","last_fullsized":"2023-11-04T01:41:56.589458+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:32:44.078800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.074562+0000","last_change":"2023-11-04T01:41:36.343728+0000","last_active":"2023-11-04T01:41:54.074562+0000","last_peered":"2023-11-04T01:41:54.074562+0000","last_clean":"2023-11-04T01:41:54.074562+0000","last_became_active":"2023-11-04T01:41:34.731106+0000","last_became_peered":"2023-11-04T01:41:34.731106+0000","last_unstale":"2023-11-04T01:41:54.074562+0000","last_undegraded":"2023-11-04T01:41:54.074562+0000","last_fullsized":"2023-11-04T01:41:54.074562+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:29.730483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058974500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.081479+0000","last_change":"2023-11-04T01:41:54.081291+0000","last_active":"2023-11-04T01:41:55.081479+0000","last_peered":"2023-11-04T01:41:55.081479+0000","last_clean":"2023-11-04T01:41:55.081479+0000","last_became_active":"2023-11-04T01:41:54.080945+0000","last_became_peered":"2023-11-04T01:41:54.080945+0000","last_unstale":"2023-11-04T01:41:55.081479+0000","last_undegraded":"2023-11-04T01:41:55.081479+0000","last_fullsized":"2023-11-04T01:41:55.081479+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:14.516867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"53'3","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085870+0000","last_change":"2023-11-04T01:41:53.074957+0000","last_active":"2023-11-04T01:41:55.085870+0000","last_peered":"2023-11-04T01:41:55.085870+0000","last_clean":"2023-11-04T01:41:55.085870+0000","last_became_active":"2023-11-04T01:41:53.074592+0000","last_became_peered":"2023-11-04T01:41:53.074592+0000","last_unstale":"2023-11-04T01:41:55.085870+0000","last_undegraded":"2023-11-04T01:41:55.085870+0000","last_fullsized":"2023-11-04T01:41:55.085870+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:16:02.695774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.068227+0000","last_change":"2023-11-04T01:41:35.931778+0000","last_active":"2023-11-04T01:41:54.068227+0000","last_peered":"2023-11-04T01:41:54.068227+0000","last_clean":"2023-11-04T01:41:54.068227+0000","last_became_active":"2023-11-04T01:41:34.736897+0000","last_became_peered":"2023-11-04T01:41:34.736897+0000","last_unstale":"2023-11-04T01:41:54.068227+0000","last_undegraded":"2023-11-04T01:41:54.068227+0000","last_fullsized":"2023-11-04T01:41:54.068227+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:20.089706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071523300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590552+0000","last_change":"2023-11-04T01:41:54.095817+0000","last_active":"2023-11-04T01:41:56.590552+0000","last_peered":"2023-11-04T01:41:56.590552+0000","last_clean":"2023-11-04T01:41:56.590552+0000","last_became_active":"2023-11-04T01:41:54.095553+0000","last_became_peered":"2023-11-04T01:41:54.095553+0000","last_unstale":"2023-11-04T01:41:56.590552+0000","last_undegraded":"2023-11-04T01:41:56.590552+0000","last_fullsized":"2023-11-04T01:41:56.590552+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:20:20.327739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590036+0000","last_change":"2023-11-04T01:41:53.077055+0000","last_active":"2023-11-04T01:41:56.590036+0000","last_peered":"2023-11-04T01:41:56.590036+0000","last_clean":"2023-11-04T01:41:56.590036+0000","last_became_active":"2023-11-04T01:41:53.076780+0000","last_became_peered":"2023-11-04T01:41:53.076780+0000","last_unstale":"2023-11-04T01:41:56.590036+0000","last_undegraded":"2023-11-04T01:41:56.590036+0000","last_fullsized":"2023-11-04T01:41:56.590036+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:31:22.001930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.069729+0000","last_change":"2023-11-04T01:41:35.729017+0000","last_active":"2023-11-04T01:41:54.069729+0000","last_peered":"2023-11-04T01:41:54.069729+0000","last_clean":"2023-11-04T01:41:54.069729+0000","last_became_active":"2023-11-04T01:41:34.730592+0000","last_became_peered":"2023-11-04T01:41:34.730592+0000","last_unstale":"2023-11-04T01:41:54.069729+0000","last_undegraded":"2023-11-04T01:41:54.069729+0000","last_fullsized":"2023-11-04T01:41:54.069729+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:08.858430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088820999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590990+0000","last_change":"2023-11-04T01:41:54.084606+0000","last_active":"2023-11-04T01:41:56.590990+0000","last_peered":"2023-11-04T01:41:56.590990+0000","last_clean":"2023-11-04T01:41:56.590990+0000","last_became_active":"2023-11-04T01:41:54.084326+0000","last_became_peered":"2023-11-04T01:41:54.084326+0000","last_unstale":"2023-11-04T01:41:56.590990+0000","last_undegraded":"2023-11-04T01:41:56.590990+0000","last_fullsized":"2023-11-04T01:41:56.590990+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:32:29.239625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589317+0000","last_change":"2023-11-04T01:41:53.084252+0000","last_active":"2023-11-04T01:41:56.589317+0000","last_peered":"2023-11-04T01:41:56.589317+0000","last_clean":"2023-11-04T01:41:56.589317+0000","last_became_active":"2023-11-04T01:41:53.083948+0000","last_became_peered":"2023-11-04T01:41:53.083948+0000","last_unstale":"2023-11-04T01:41:56.589317+0000","last_undegraded":"2023-11-04T01:41:56.589317+0000","last_fullsized":"2023-11-04T01:41:56.589317+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:57:41.648340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.077144+0000","last_change":"2023-11-04T01:41:35.729378+0000","last_active":"2023-11-04T01:41:54.077144+0000","last_peered":"2023-11-04T01:41:54.077144+0000","last_clean":"2023-11-04T01:41:54.077144+0000","last_became_active":"2023-11-04T01:41:34.730387+0000","last_became_peered":"2023-11-04T01:41:34.730387+0000","last_unstale":"2023-11-04T01:41:54.077144+0000","last_undegraded":"2023-11-04T01:41:54.077144+0000","last_fullsized":"2023-11-04T01:41:54.077144+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:12.653602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072268699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590186+0000","last_change":"2023-11-04T01:41:54.084539+0000","last_active":"2023-11-04T01:41:56.590186+0000","last_peered":"2023-11-04T01:41:56.590186+0000","last_clean":"2023-11-04T01:41:56.590186+0000","last_became_active":"2023-11-04T01:41:54.084254+0000","last_became_peered":"2023-11-04T01:41:54.084254+0000","last_unstale":"2023-11-04T01:41:56.590186+0000","last_undegraded":"2023-11-04T01:41:56.590186+0000","last_fullsized":"2023-11-04T01:41:56.590186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:15.904826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589151+0000","last_change":"2023-11-04T01:41:53.083914+0000","last_active":"2023-11-04T01:41:56.589151+0000","last_peered":"2023-11-04T01:41:56.589151+0000","last_clean":"2023-11-04T01:41:56.589151+0000","last_became_active":"2023-11-04T01:41:53.083658+0000","last_became_peered":"2023-11-04T01:41:53.083658+0000","last_unstale":"2023-11-04T01:41:56.589151+0000","last_undegraded":"2023-11-04T01:41:56.589151+0000","last_fullsized":"2023-11-04T01:41:56.589151+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:35:19.471505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.069646+0000","last_change":"2023-11-04T01:41:35.729318+0000","last_active":"2023-11-04T01:41:54.069646+0000","last_peered":"2023-11-04T01:41:54.069646+0000","last_clean":"2023-11-04T01:41:54.069646+0000","last_became_active":"2023-11-04T01:41:34.733796+0000","last_became_peered":"2023-11-04T01:41:34.733796+0000","last_unstale":"2023-11-04T01:41:54.069646+0000","last_undegraded":"2023-11-04T01:41:54.069646+0000","last_fullsized":"2023-11-04T01:41:54.069646+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:19.350812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053712200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.331250+0000","last_change":"2023-11-04T01:41:54.082009+0000","last_active":"2023-11-04T01:41:56.331250+0000","last_peered":"2023-11-04T01:41:56.331250+0000","last_clean":"2023-11-04T01:41:56.331250+0000","last_became_active":"2023-11-04T01:41:54.081727+0000","last_became_peered":"2023-11-04T01:41:54.081727+0000","last_unstale":"2023-11-04T01:41:56.331250+0000","last_undegraded":"2023-11-04T01:41:56.331250+0000","last_fullsized":"2023-11-04T01:41:56.331250+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:32.004830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.074695+0000","last_change":"2023-11-04T01:41:53.077862+0000","last_active":"2023-11-04T01:41:54.074695+0000","last_peered":"2023-11-04T01:41:54.074695+0000","last_clean":"2023-11-04T01:41:54.074695+0000","last_became_active":"2023-11-04T01:41:53.077454+0000","last_became_peered":"2023-11-04T01:41:53.077454+0000","last_unstale":"2023-11-04T01:41:54.074695+0000","last_undegraded":"2023-11-04T01:41:54.074695+0000","last_fullsized":"2023-11-04T01:41:54.074695+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:13:12.033711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.067806+0000","last_change":"2023-11-04T01:41:35.931929+0000","last_active":"2023-11-04T01:41:54.067806+0000","last_peered":"2023-11-04T01:41:54.067806+0000","last_clean":"2023-11-04T01:41:54.067806+0000","last_became_active":"2023-11-04T01:41:34.738795+0000","last_became_peered":"2023-11-04T01:41:34.738795+0000","last_unstale":"2023-11-04T01:41:54.067806+0000","last_undegraded":"2023-11-04T01:41:54.067806+0000","last_fullsized":"2023-11-04T01:41:54.067806+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:59.608410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046204999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.081684+0000","last_change":"2023-11-04T01:41:54.082457+0000","last_active":"2023-11-04T01:41:55.081684+0000","last_peered":"2023-11-04T01:41:55.081684+0000","last_clean":"2023-11-04T01:41:55.081684+0000","last_became_active":"2023-11-04T01:41:54.082130+0000","last_became_peered":"2023-11-04T01:41:54.082130+0000","last_unstale":"2023-11-04T01:41:55.081684+0000","last_undegraded":"2023-11-04T01:41:55.081684+0000","last_fullsized":"2023-11-04T01:41:55.081684+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:13:17.472616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590239+0000","last_change":"2023-11-04T01:41:53.076199+0000","last_active":"2023-11-04T01:41:56.590239+0000","last_peered":"2023-11-04T01:41:56.590239+0000","last_clean":"2023-11-04T01:41:56.590239+0000","last_became_active":"2023-11-04T01:41:53.075934+0000","last_became_peered":"2023-11-04T01:41:53.075934+0000","last_unstale":"2023-11-04T01:41:56.590239+0000","last_undegraded":"2023-11-04T01:41:56.590239+0000","last_fullsized":"2023-11-04T01:41:56.590239+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:51.200899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.069062+0000","last_change":"2023-11-04T01:41:35.728945+0000","last_active":"2023-11-04T01:41:54.069062+0000","last_peered":"2023-11-04T01:41:54.069062+0000","last_clean":"2023-11-04T01:41:54.069062+0000","last_became_active":"2023-11-04T01:41:34.735082+0000","last_became_peered":"2023-11-04T01:41:34.735082+0000","last_unstale":"2023-11-04T01:41:54.069062+0000","last_undegraded":"2023-11-04T01:41:54.069062+0000","last_fullsized":"2023-11-04T01:41:54.069062+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:16.970814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079093000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590578+0000","last_change":"2023-11-04T01:41:54.088881+0000","last_active":"2023-11-04T01:41:56.590578+0000","last_peered":"2023-11-04T01:41:56.590578+0000","last_clean":"2023-11-04T01:41:56.590578+0000","last_became_active":"2023-11-04T01:41:54.088232+0000","last_became_peered":"2023-11-04T01:41:54.088232+0000","last_unstale":"2023-11-04T01:41:56.590578+0000","last_undegraded":"2023-11-04T01:41:56.590578+0000","last_fullsized":"2023-11-04T01:41:56.590578+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:49:12.341595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"53'4","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590791+0000","last_change":"2023-11-04T01:41:53.080523+0000","last_active":"2023-11-04T01:41:56.590791+0000","last_peered":"2023-11-04T01:41:56.590791+0000","last_clean":"2023-11-04T01:41:56.590791+0000","last_became_active":"2023-11-04T01:41:53.080094+0000","last_became_peered":"2023-11-04T01:41:53.080094+0000","last_unstale":"2023-11-04T01:41:56.590791+0000","last_undegraded":"2023-11-04T01:41:56.590791+0000","last_fullsized":"2023-11-04T01:41:56.590791+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:46:27.215722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.073803+0000","last_change":"2023-11-04T01:41:35.728625+0000","last_active":"2023-11-04T01:41:54.073803+0000","last_peered":"2023-11-04T01:41:54.073803+0000","last_clean":"2023-11-04T01:41:54.073803+0000","last_became_active":"2023-11-04T01:41:34.731514+0000","last_became_peered":"2023-11-04T01:41:34.731514+0000","last_unstale":"2023-11-04T01:41:54.073803+0000","last_undegraded":"2023-11-04T01:41:54.073803+0000","last_fullsized":"2023-11-04T01:41:54.073803+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:51:50.413223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047686400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590191+0000","last_change":"2023-11-04T01:41:54.089484+0000","last_active":"2023-11-04T01:41:56.590191+0000","last_peered":"2023-11-04T01:41:56.590191+0000","last_clean":"2023-11-04T01:41:56.590191+0000","last_became_active":"2023-11-04T01:41:54.087702+0000","last_became_peered":"2023-11-04T01:41:54.087702+0000","last_unstale":"2023-11-04T01:41:56.590191+0000","last_undegraded":"2023-11-04T01:41:56.590191+0000","last_fullsized":"2023-11-04T01:41:56.590191+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:19:37.120155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"53'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.097178+0000","last_change":"2023-11-04T01:41:53.081291+0000","last_active":"2023-11-04T01:41:54.097178+0000","last_peered":"2023-11-04T01:41:54.097178+0000","last_clean":"2023-11-04T01:41:54.097178+0000","last_became_active":"2023-11-04T01:41:53.080917+0000","last_became_peered":"2023-11-04T01:41:53.080917+0000","last_unstale":"2023-11-04T01:41:54.097178+0000","last_undegraded":"2023-11-04T01:41:54.097178+0000","last_fullsized":"2023-11-04T01:41:54.097178+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:53:25.375890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.074641+0000","last_change":"2023-11-04T01:41:36.343762+0000","last_active":"2023-11-04T01:41:54.074641+0000","last_peered":"2023-11-04T01:41:54.074641+0000","last_clean":"2023-11-04T01:41:54.074641+0000","last_became_active":"2023-11-04T01:41:34.733406+0000","last_became_peered":"2023-11-04T01:41:34.733406+0000","last_unstale":"2023-11-04T01:41:54.074641+0000","last_undegraded":"2023-11-04T01:41:54.074641+0000","last_fullsized":"2023-11-04T01:41:54.074641+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:34:35.541159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058533399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590368+0000","last_change":"2023-11-04T01:41:54.087274+0000","last_active":"2023-11-04T01:41:56.590368+0000","last_peered":"2023-11-04T01:41:56.590368+0000","last_clean":"2023-11-04T01:41:56.590368+0000","last_became_active":"2023-11-04T01:41:54.087015+0000","last_became_peered":"2023-11-04T01:41:54.087015+0000","last_unstale":"2023-11-04T01:41:56.590368+0000","last_undegraded":"2023-11-04T01:41:56.590368+0000","last_fullsized":"2023-11-04T01:41:56.590368+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:59:02.368617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590382+0000","last_change":"2023-11-04T01:41:53.078589+0000","last_active":"2023-11-04T01:41:56.590382+0000","last_peered":"2023-11-04T01:41:56.590382+0000","last_clean":"2023-11-04T01:41:56.590382+0000","last_became_active":"2023-11-04T01:41:53.078299+0000","last_became_peered":"2023-11-04T01:41:53.078299+0000","last_unstale":"2023-11-04T01:41:56.590382+0000","last_undegraded":"2023-11-04T01:41:56.590382+0000","last_fullsized":"2023-11-04T01:41:56.590382+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:39:55.007483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":25,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.074298+0000","last_change":"2023-11-04T01:41:35.906297+0000","last_active":"2023-11-04T01:41:54.074298+0000","last_peered":"2023-11-04T01:41:54.074298+0000","last_clean":"2023-11-04T01:41:54.074298+0000","last_became_active":"2023-11-04T01:41:34.734134+0000","last_became_peered":"2023-11-04T01:41:34.734134+0000","last_unstale":"2023-11-04T01:41:54.074298+0000","last_undegraded":"2023-11-04T01:41:54.074298+0000","last_fullsized":"2023-11-04T01:41:54.074298+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:52.597063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087104900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085334+0000","last_change":"2023-11-04T01:41:54.088922+0000","last_active":"2023-11-04T01:41:55.085334+0000","last_peered":"2023-11-04T01:41:55.085334+0000","last_clean":"2023-11-04T01:41:55.085334+0000","last_became_active":"2023-11-04T01:41:54.088636+0000","last_became_peered":"2023-11-04T01:41:54.088636+0000","last_unstale":"2023-11-04T01:41:55.085334+0000","last_undegraded":"2023-11-04T01:41:55.085334+0000","last_fullsized":"2023-11-04T01:41:55.085334+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:52.207829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589388+0000","last_change":"2023-11-04T01:41:53.078664+0000","last_active":"2023-11-04T01:41:56.589388+0000","last_peered":"2023-11-04T01:41:56.589388+0000","last_clean":"2023-11-04T01:41:56.589388+0000","last_became_active":"2023-11-04T01:41:53.078411+0000","last_became_peered":"2023-11-04T01:41:53.078411+0000","last_unstale":"2023-11-04T01:41:56.589388+0000","last_undegraded":"2023-11-04T01:41:56.589388+0000","last_fullsized":"2023-11-04T01:41:56.589388+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:30.997900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":25,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.073574+0000","last_change":"2023-11-04T01:41:35.906596+0000","last_active":"2023-11-04T01:41:54.073574+0000","last_peered":"2023-11-04T01:41:54.073574+0000","last_clean":"2023-11-04T01:41:54.073574+0000","last_became_active":"2023-11-04T01:41:34.738529+0000","last_became_peered":"2023-11-04T01:41:34.738529+0000","last_unstale":"2023-11-04T01:41:54.073574+0000","last_undegraded":"2023-11-04T01:41:54.073574+0000","last_fullsized":"2023-11-04T01:41:54.073574+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:48.121273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086660600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590979+0000","last_change":"2023-11-04T01:41:54.091537+0000","last_active":"2023-11-04T01:41:56.590979+0000","last_peered":"2023-11-04T01:41:56.590979+0000","last_clean":"2023-11-04T01:41:56.590979+0000","last_became_active":"2023-11-04T01:41:54.091084+0000","last_became_peered":"2023-11-04T01:41:54.091084+0000","last_unstale":"2023-11-04T01:41:56.590979+0000","last_undegraded":"2023-11-04T01:41:56.590979+0000","last_fullsized":"2023-11-04T01:41:56.590979+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:16:45.397776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.068971+0000","last_change":"2023-11-04T01:41:53.075392+0000","last_active":"2023-11-04T01:41:54.068971+0000","last_peered":"2023-11-04T01:41:54.068971+0000","last_clean":"2023-11-04T01:41:54.068971+0000","last_became_active":"2023-11-04T01:41:53.075123+0000","last_became_peered":"2023-11-04T01:41:53.075123+0000","last_unstale":"2023-11-04T01:41:54.068971+0000","last_undegraded":"2023-11-04T01:41:54.068971+0000","last_fullsized":"2023-11-04T01:41:54.068971+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:11:16.439530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":25,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.073477+0000","last_change":"2023-11-04T01:41:35.906430+0000","last_active":"2023-11-04T01:41:54.073477+0000","last_peered":"2023-11-04T01:41:54.073477+0000","last_clean":"2023-11-04T01:41:54.073477+0000","last_became_active":"2023-11-04T01:41:34.741147+0000","last_became_peered":"2023-11-04T01:41:34.741147+0000","last_unstale":"2023-11-04T01:41:54.073477+0000","last_undegraded":"2023-11-04T01:41:54.073477+0000","last_fullsized":"2023-11-04T01:41:54.073477+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:20.089706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090504400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590317+0000","last_change":"2023-11-04T01:41:54.082050+0000","last_active":"2023-11-04T01:41:56.590317+0000","last_peered":"2023-11-04T01:41:56.590317+0000","last_clean":"2023-11-04T01:41:56.590317+0000","last_became_active":"2023-11-04T01:41:54.081752+0000","last_became_peered":"2023-11-04T01:41:54.081752+0000","last_unstale":"2023-11-04T01:41:56.590317+0000","last_undegraded":"2023-11-04T01:41:56.590317+0000","last_fullsized":"2023-11-04T01:41:56.590317+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:43:37.855647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589527+0000","last_change":"2023-11-04T01:41:53.079896+0000","last_active":"2023-11-04T01:41:56.589527+0000","last_peered":"2023-11-04T01:41:56.589527+0000","last_clean":"2023-11-04T01:41:56.589527+0000","last_became_active":"2023-11-04T01:41:53.079540+0000","last_became_peered":"2023-11-04T01:41:53.079540+0000","last_unstale":"2023-11-04T01:41:56.589527+0000","last_undegraded":"2023-11-04T01:41:56.589527+0000","last_fullsized":"2023-11-04T01:41:56.589527+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:53:25.375890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.077435+0000","last_change":"2023-11-04T01:41:36.344408+0000","last_active":"2023-11-04T01:41:54.077435+0000","last_peered":"2023-11-04T01:41:54.077435+0000","last_clean":"2023-11-04T01:41:54.077435+0000","last_became_active":"2023-11-04T01:41:34.730735+0000","last_became_peered":"2023-11-04T01:41:34.730735+0000","last_unstale":"2023-11-04T01:41:54.077435+0000","last_undegraded":"2023-11-04T01:41:54.077435+0000","last_fullsized":"2023-11-04T01:41:54.077435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:10:58.095232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081464299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.081224+0000","last_change":"2023-11-04T01:41:54.075442+0000","last_active":"2023-11-04T01:41:55.081224+0000","last_peered":"2023-11-04T01:41:55.081224+0000","last_clean":"2023-11-04T01:41:55.081224+0000","last_became_active":"2023-11-04T01:41:54.075156+0000","last_became_peered":"2023-11-04T01:41:54.075156+0000","last_unstale":"2023-11-04T01:41:55.081224+0000","last_undegraded":"2023-11-04T01:41:55.081224+0000","last_fullsized":"2023-11-04T01:41:55.081224+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:58.634155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.069229+0000","last_change":"2023-11-04T01:41:53.077515+0000","last_active":"2023-11-04T01:41:54.069229+0000","last_peered":"2023-11-04T01:41:54.069229+0000","last_clean":"2023-11-04T01:41:54.069229+0000","last_became_active":"2023-11-04T01:41:53.077273+0000","last_became_peered":"2023-11-04T01:41:53.077273+0000","last_unstale":"2023-11-04T01:41:54.069229+0000","last_undegraded":"2023-11-04T01:41:54.069229+0000","last_fullsized":"2023-11-04T01:41:54.069229+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:02:25.529139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":28,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.076226+0000","last_change":"2023-11-04T01:41:36.244245+0000","last_active":"2023-11-04T01:41:54.076226+0000","last_peered":"2023-11-04T01:41:54.076226+0000","last_clean":"2023-11-04T01:41:54.076226+0000","last_became_active":"2023-11-04T01:41:34.734925+0000","last_became_peered":"2023-11-04T01:41:34.734925+0000","last_unstale":"2023-11-04T01:41:54.076226+0000","last_undegraded":"2023-11-04T01:41:54.076226+0000","last_fullsized":"2023-11-04T01:41:54.076226+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:44.193748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025350200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085360+0000","last_change":"2023-11-04T01:41:54.083519+0000","last_active":"2023-11-04T01:41:55.085360+0000","last_peered":"2023-11-04T01:41:55.085360+0000","last_clean":"2023-11-04T01:41:55.085360+0000","last_became_active":"2023-11-04T01:41:54.083263+0000","last_became_peered":"2023-11-04T01:41:54.083263+0000","last_unstale":"2023-11-04T01:41:55.085360+0000","last_undegraded":"2023-11-04T01:41:55.085360+0000","last_fullsized":"2023-11-04T01:41:55.085360+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:09:05.963500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590649+0000","last_change":"2023-11-04T01:41:53.076654+0000","last_active":"2023-11-04T01:41:56.590649+0000","last_peered":"2023-11-04T01:41:56.590649+0000","last_clean":"2023-11-04T01:41:56.590649+0000","last_became_active":"2023-11-04T01:41:53.076139+0000","last_became_peered":"2023-11-04T01:41:53.076139+0000","last_unstale":"2023-11-04T01:41:56.590649+0000","last_undegraded":"2023-11-04T01:41:56.590649+0000","last_fullsized":"2023-11-04T01:41:56.590649+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:12:15.708878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.074053+0000","last_change":"2023-11-04T01:41:36.343956+0000","last_active":"2023-11-04T01:41:54.074053+0000","last_peered":"2023-11-04T01:41:54.074053+0000","last_clean":"2023-11-04T01:41:54.074053+0000","last_became_active":"2023-11-04T01:41:34.736013+0000","last_became_peered":"2023-11-04T01:41:34.736013+0000","last_unstale":"2023-11-04T01:41:54.074053+0000","last_undegraded":"2023-11-04T01:41:54.074053+0000","last_fullsized":"2023-11-04T01:41:54.074053+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:08.858430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081427799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085146+0000","last_change":"2023-11-04T01:41:54.084395+0000","last_active":"2023-11-04T01:41:55.085146+0000","last_peered":"2023-11-04T01:41:55.085146+0000","last_clean":"2023-11-04T01:41:55.085146+0000","last_became_active":"2023-11-04T01:41:54.084122+0000","last_became_peered":"2023-11-04T01:41:54.084122+0000","last_unstale":"2023-11-04T01:41:55.085146+0000","last_undegraded":"2023-11-04T01:41:55.085146+0000","last_fullsized":"2023-11-04T01:41:55.085146+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:37:37.857295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"53'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.099893+0000","last_change":"2023-11-04T01:41:53.076436+0000","last_active":"2023-11-04T01:41:54.099893+0000","last_peered":"2023-11-04T01:41:54.099893+0000","last_clean":"2023-11-04T01:41:54.099893+0000","last_became_active":"2023-11-04T01:41:53.076135+0000","last_became_peered":"2023-11-04T01:41:53.076135+0000","last_unstale":"2023-11-04T01:41:54.099893+0000","last_undegraded":"2023-11-04T01:41:54.099893+0000","last_fullsized":"2023-11-04T01:41:54.099893+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:32:44.078800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":28,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.073122+0000","last_change":"2023-11-04T01:41:36.243977+0000","last_active":"2023-11-04T01:41:54.073122+0000","last_peered":"2023-11-04T01:41:54.073122+0000","last_clean":"2023-11-04T01:41:54.073122+0000","last_became_active":"2023-11-04T01:41:34.733127+0000","last_became_peered":"2023-11-04T01:41:34.733127+0000","last_unstale":"2023-11-04T01:41:54.073122+0000","last_undegraded":"2023-11-04T01:41:54.073122+0000","last_fullsized":"2023-11-04T01:41:54.073122+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:36.118907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051788300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590302+0000","last_change":"2023-11-04T01:41:54.089679+0000","last_active":"2023-11-04T01:41:56.590302+0000","last_peered":"2023-11-04T01:41:56.590302+0000","last_clean":"2023-11-04T01:41:56.590302+0000","last_became_active":"2023-11-04T01:41:54.087983+0000","last_became_peered":"2023-11-04T01:41:54.087983+0000","last_unstale":"2023-11-04T01:41:56.590302+0000","last_undegraded":"2023-11-04T01:41:56.590302+0000","last_fullsized":"2023-11-04T01:41:56.590302+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:02:33.389340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.074953+0000","last_change":"2023-11-04T01:41:53.077963+0000","last_active":"2023-11-04T01:41:54.074953+0000","last_peered":"2023-11-04T01:41:54.074953+0000","last_clean":"2023-11-04T01:41:54.074953+0000","last_became_active":"2023-11-04T01:41:53.077696+0000","last_became_peered":"2023-11-04T01:41:53.077696+0000","last_unstale":"2023-11-04T01:41:54.074953+0000","last_undegraded":"2023-11-04T01:41:54.074953+0000","last_fullsized":"2023-11-04T01:41:54.074953+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:12:15.708878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.069594+0000","last_change":"2023-11-04T01:41:36.067797+0000","last_active":"2023-11-04T01:41:54.069594+0000","last_peered":"2023-11-04T01:41:54.069594+0000","last_clean":"2023-11-04T01:41:54.069594+0000","last_became_active":"2023-11-04T01:41:34.734880+0000","last_became_peered":"2023-11-04T01:41:34.734880+0000","last_unstale":"2023-11-04T01:41:54.069594+0000","last_undegraded":"2023-11-04T01:41:54.069594+0000","last_fullsized":"2023-11-04T01:41:54.069594+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:20.089706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036003499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.081521+0000","last_change":"2023-11-04T01:41:54.081767+0000","last_active":"2023-11-04T01:41:55.081521+0000","last_peered":"2023-11-04T01:41:55.081521+0000","last_clean":"2023-11-04T01:41:55.081521+0000","last_became_active":"2023-11-04T01:41:54.081486+0000","last_became_peered":"2023-11-04T01:41:54.081486+0000","last_unstale":"2023-11-04T01:41:55.081521+0000","last_undegraded":"2023-11-04T01:41:55.081521+0000","last_fullsized":"2023-11-04T01:41:55.081521+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:40.760885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.331460+0000","last_change":"2023-11-04T01:41:53.077939+0000","last_active":"2023-11-04T01:41:56.331460+0000","last_peered":"2023-11-04T01:41:56.331460+0000","last_clean":"2023-11-04T01:41:56.331460+0000","last_became_active":"2023-11-04T01:41:53.077680+0000","last_became_peered":"2023-11-04T01:41:53.077680+0000","last_unstale":"2023-11-04T01:41:56.331460+0000","last_undegraded":"2023-11-04T01:41:56.331460+0000","last_fullsized":"2023-11-04T01:41:56.331460+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:06:03.625159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.073784+0000","last_change":"2023-11-04T01:41:35.729089+0000","last_active":"2023-11-04T01:41:54.073784+0000","last_peered":"2023-11-04T01:41:54.073784+0000","last_clean":"2023-11-04T01:41:54.073784+0000","last_became_active":"2023-11-04T01:41:34.731063+0000","last_became_peered":"2023-11-04T01:41:34.731063+0000","last_unstale":"2023-11-04T01:41:54.073784+0000","last_undegraded":"2023-11-04T01:41:54.073784+0000","last_fullsized":"2023-11-04T01:41:54.073784+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:38:46.633175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083653600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589953+0000","last_change":"2023-11-04T01:41:54.086778+0000","last_active":"2023-11-04T01:41:56.589953+0000","last_peered":"2023-11-04T01:41:56.589953+0000","last_clean":"2023-11-04T01:41:56.589953+0000","last_became_active":"2023-11-04T01:41:54.086492+0000","last_became_peered":"2023-11-04T01:41:54.086492+0000","last_unstale":"2023-11-04T01:41:56.589953+0000","last_undegraded":"2023-11-04T01:41:56.589953+0000","last_fullsized":"2023-11-04T01:41:56.589953+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:09:20.408298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.069075+0000","last_change":"2023-11-04T01:41:53.078264+0000","last_active":"2023-11-04T01:41:54.069075+0000","last_peered":"2023-11-04T01:41:54.069075+0000","last_clean":"2023-11-04T01:41:54.069075+0000","last_became_active":"2023-11-04T01:41:53.077978+0000","last_became_peered":"2023-11-04T01:41:53.077978+0000","last_unstale":"2023-11-04T01:41:54.069075+0000","last_undegraded":"2023-11-04T01:41:54.069075+0000","last_fullsized":"2023-11-04T01:41:54.069075+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:52:08.757521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.069956+0000","last_change":"2023-11-04T01:41:35.729232+0000","last_active":"2023-11-04T01:41:54.069956+0000","last_peered":"2023-11-04T01:41:54.069956+0000","last_clean":"2023-11-04T01:41:54.069956+0000","last_became_active":"2023-11-04T01:41:34.731490+0000","last_became_peered":"2023-11-04T01:41:34.731490+0000","last_unstale":"2023-11-04T01:41:54.069956+0000","last_undegraded":"2023-11-04T01:41:54.069956+0000","last_fullsized":"2023-11-04T01:41:54.069956+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:37.958719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089653699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.084708+0000","last_change":"2023-11-04T01:41:54.085819+0000","last_active":"2023-11-04T01:41:55.084708+0000","last_peered":"2023-11-04T01:41:55.084708+0000","last_clean":"2023-11-04T01:41:55.084708+0000","last_became_active":"2023-11-04T01:41:54.085516+0000","last_became_peered":"2023-11-04T01:41:54.085516+0000","last_unstale":"2023-11-04T01:41:55.084708+0000","last_undegraded":"2023-11-04T01:41:55.084708+0000","last_fullsized":"2023-11-04T01:41:55.084708+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:39:56.014413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590820+0000","last_change":"2023-11-04T01:41:53.078721+0000","last_active":"2023-11-04T01:41:56.590820+0000","last_peered":"2023-11-04T01:41:56.590820+0000","last_clean":"2023-11-04T01:41:56.590820+0000","last_became_active":"2023-11-04T01:41:53.078424+0000","last_became_peered":"2023-11-04T01:41:53.078424+0000","last_unstale":"2023-11-04T01:41:56.590820+0000","last_undegraded":"2023-11-04T01:41:56.590820+0000","last_fullsized":"2023-11-04T01:41:56.590820+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:45:35.156451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.077159+0000","last_change":"2023-11-04T01:41:36.344018+0000","last_active":"2023-11-04T01:41:54.077159+0000","last_peered":"2023-11-04T01:41:54.077159+0000","last_clean":"2023-11-04T01:41:54.077159+0000","last_became_active":"2023-11-04T01:41:34.734178+0000","last_became_peered":"2023-11-04T01:41:34.734178+0000","last_unstale":"2023-11-04T01:41:54.077159+0000","last_undegraded":"2023-11-04T01:41:54.077159+0000","last_fullsized":"2023-11-04T01:41:54.077159+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:16.970814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077338299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590497+0000","last_change":"2023-11-04T01:41:54.087444+0000","last_active":"2023-11-04T01:41:56.590497+0000","last_peered":"2023-11-04T01:41:56.590497+0000","last_clean":"2023-11-04T01:41:56.590497+0000","last_became_active":"2023-11-04T01:41:54.087173+0000","last_became_peered":"2023-11-04T01:41:54.087173+0000","last_unstale":"2023-11-04T01:41:56.590497+0000","last_undegraded":"2023-11-04T01:41:56.590497+0000","last_fullsized":"2023-11-04T01:41:56.590497+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:45:36.163381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.075308+0000","last_change":"2023-11-04T01:41:53.079761+0000","last_active":"2023-11-04T01:41:54.075308+0000","last_peered":"2023-11-04T01:41:54.075308+0000","last_clean":"2023-11-04T01:41:54.075308+0000","last_became_active":"2023-11-04T01:41:53.079506+0000","last_became_peered":"2023-11-04T01:41:53.079506+0000","last_unstale":"2023-11-04T01:41:54.075308+0000","last_undegraded":"2023-11-04T01:41:54.075308+0000","last_fullsized":"2023-11-04T01:41:54.075308+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:14:16.043835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":25,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.074187+0000","last_change":"2023-11-04T01:41:35.906788+0000","last_active":"2023-11-04T01:41:54.074187+0000","last_peered":"2023-11-04T01:41:54.074187+0000","last_clean":"2023-11-04T01:41:54.074187+0000","last_became_active":"2023-11-04T01:41:34.734386+0000","last_became_peered":"2023-11-04T01:41:34.734386+0000","last_unstale":"2023-11-04T01:41:54.074187+0000","last_undegraded":"2023-11-04T01:41:54.074187+0000","last_fullsized":"2023-11-04T01:41:54.074187+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:23:23.733128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060435600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085258+0000","last_change":"2023-11-04T01:41:54.086713+0000","last_active":"2023-11-04T01:41:55.085258+0000","last_peered":"2023-11-04T01:41:55.085258+0000","last_clean":"2023-11-04T01:41:55.085258+0000","last_became_active":"2023-11-04T01:41:54.085354+0000","last_became_peered":"2023-11-04T01:41:54.085354+0000","last_unstale":"2023-11-04T01:41:55.085258+0000","last_undegraded":"2023-11-04T01:41:55.085258+0000","last_fullsized":"2023-11-04T01:41:55.085258+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:09:20.408298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590566+0000","last_change":"2023-11-04T01:41:53.081857+0000","last_active":"2023-11-04T01:41:56.590566+0000","last_peered":"2023-11-04T01:41:56.590566+0000","last_clean":"2023-11-04T01:41:56.590566+0000","last_became_active":"2023-11-04T01:41:53.081578+0000","last_became_peered":"2023-11-04T01:41:53.081578+0000","last_unstale":"2023-11-04T01:41:56.590566+0000","last_undegraded":"2023-11-04T01:41:56.590566+0000","last_fullsized":"2023-11-04T01:41:56.590566+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:13:12.033711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.067619+0000","last_change":"2023-11-04T01:41:35.931718+0000","last_active":"2023-11-04T01:41:54.067619+0000","last_peered":"2023-11-04T01:41:54.067619+0000","last_clean":"2023-11-04T01:41:54.067619+0000","last_became_active":"2023-11-04T01:41:34.741033+0000","last_became_peered":"2023-11-04T01:41:34.741033+0000","last_unstale":"2023-11-04T01:41:54.067619+0000","last_undegraded":"2023-11-04T01:41:54.067619+0000","last_fullsized":"2023-11-04T01:41:54.067619+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:48.121273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065858400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085410+0000","last_change":"2023-11-04T01:41:54.082720+0000","last_active":"2023-11-04T01:41:55.085410+0000","last_peered":"2023-11-04T01:41:55.085410+0000","last_clean":"2023-11-04T01:41:55.085410+0000","last_became_active":"2023-11-04T01:41:54.081261+0000","last_became_peered":"2023-11-04T01:41:54.081261+0000","last_unstale":"2023-11-04T01:41:55.085410+0000","last_undegraded":"2023-11-04T01:41:55.085410+0000","last_fullsized":"2023-11-04T01:41:55.085410+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:39:56.014413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590678+0000","last_change":"2023-11-04T01:41:53.079732+0000","last_active":"2023-11-04T01:41:56.590678+0000","last_peered":"2023-11-04T01:41:56.590678+0000","last_clean":"2023-11-04T01:41:56.590678+0000","last_became_active":"2023-11-04T01:41:53.079465+0000","last_became_peered":"2023-11-04T01:41:53.079465+0000","last_unstale":"2023-11-04T01:41:56.590678+0000","last_undegraded":"2023-11-04T01:41:56.590678+0000","last_fullsized":"2023-11-04T01:41:56.590678+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:09:19.401368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":25,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.075397+0000","last_change":"2023-11-04T01:41:35.728094+0000","last_active":"2023-11-04T01:41:54.075397+0000","last_peered":"2023-11-04T01:41:54.075397+0000","last_clean":"2023-11-04T01:41:54.075397+0000","last_became_active":"2023-11-04T01:41:34.738687+0000","last_became_peered":"2023-11-04T01:41:34.738687+0000","last_unstale":"2023-11-04T01:41:54.075397+0000","last_undegraded":"2023-11-04T01:41:54.075397+0000","last_fullsized":"2023-11-04T01:41:54.075397+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:37.958719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068772699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085802+0000","last_change":"2023-11-04T01:41:54.084706+0000","last_active":"2023-11-04T01:41:55.085802+0000","last_peered":"2023-11-04T01:41:55.085802+0000","last_clean":"2023-11-04T01:41:55.085802+0000","last_became_active":"2023-11-04T01:41:54.083966+0000","last_became_peered":"2023-11-04T01:41:54.083966+0000","last_unstale":"2023-11-04T01:41:55.085802+0000","last_undegraded":"2023-11-04T01:41:55.085802+0000","last_fullsized":"2023-11-04T01:41:55.085802+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:49.436809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590444+0000","last_change":"2023-11-04T01:41:53.081813+0000","last_active":"2023-11-04T01:41:56.590444+0000","last_peered":"2023-11-04T01:41:56.590444+0000","last_clean":"2023-11-04T01:41:56.590444+0000","last_became_active":"2023-11-04T01:41:53.081521+0000","last_became_peered":"2023-11-04T01:41:53.081521+0000","last_unstale":"2023-11-04T01:41:56.590444+0000","last_undegraded":"2023-11-04T01:41:56.590444+0000","last_fullsized":"2023-11-04T01:41:56.590444+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:32:11.738014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.077195+0000","last_change":"2023-11-04T01:41:35.729106+0000","last_active":"2023-11-04T01:41:54.077195+0000","last_peered":"2023-11-04T01:41:54.077195+0000","last_clean":"2023-11-04T01:41:54.077195+0000","last_became_active":"2023-11-04T01:41:34.731230+0000","last_became_peered":"2023-11-04T01:41:34.731230+0000","last_unstale":"2023-11-04T01:41:54.077195+0000","last_undegraded":"2023-11-04T01:41:54.077195+0000","last_fullsized":"2023-11-04T01:41:54.077195+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:07:32.744572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078592199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590168+0000","last_change":"2023-11-04T01:41:54.085266+0000","last_active":"2023-11-04T01:41:56.590168+0000","last_peered":"2023-11-04T01:41:56.590168+0000","last_clean":"2023-11-04T01:41:56.590168+0000","last_became_active":"2023-11-04T01:41:54.085007+0000","last_became_peered":"2023-11-04T01:41:54.085007+0000","last_unstale":"2023-11-04T01:41:56.590168+0000","last_undegraded":"2023-11-04T01:41:56.590168+0000","last_fullsized":"2023-11-04T01:41:56.590168+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:12:13.435625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"53'1","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.097091+0000","last_change":"2023-11-04T01:41:53.078346+0000","last_active":"2023-11-04T01:41:54.097091+0000","last_peered":"2023-11-04T01:41:54.097091+0000","last_clean":"2023-11-04T01:41:54.097091+0000","last_became_active":"2023-11-04T01:41:53.078087+0000","last_became_peered":"2023-11-04T01:41:53.078087+0000","last_unstale":"2023-11-04T01:41:54.097091+0000","last_undegraded":"2023-11-04T01:41:54.097091+0000","last_fullsized":"2023-11-04T01:41:54.097091+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:31:22.001930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.073871+0000","last_change":"2023-11-04T01:41:35.728672+0000","last_active":"2023-11-04T01:41:54.073871+0000","last_peered":"2023-11-04T01:41:54.073871+0000","last_clean":"2023-11-04T01:41:54.073871+0000","last_became_active":"2023-11-04T01:41:34.727419+0000","last_became_peered":"2023-11-04T01:41:34.727419+0000","last_unstale":"2023-11-04T01:41:54.073871+0000","last_undegraded":"2023-11-04T01:41:54.073871+0000","last_fullsized":"2023-11-04T01:41:54.073871+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:35:01.127206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044278299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589451+0000","last_change":"2023-11-04T01:41:54.091623+0000","last_active":"2023-11-04T01:41:56.589451+0000","last_peered":"2023-11-04T01:41:56.589451+0000","last_clean":"2023-11-04T01:41:56.589451+0000","last_became_active":"2023-11-04T01:41:54.091377+0000","last_became_peered":"2023-11-04T01:41:54.091377+0000","last_unstale":"2023-11-04T01:41:56.589451+0000","last_undegraded":"2023-11-04T01:41:56.589451+0000","last_fullsized":"2023-11-04T01:41:56.589451+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:14:51.971313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.331242+0000","last_change":"2023-11-04T01:41:53.079198+0000","last_active":"2023-11-04T01:41:56.331242+0000","last_peered":"2023-11-04T01:41:56.331242+0000","last_clean":"2023-11-04T01:41:56.331242+0000","last_became_active":"2023-11-04T01:41:53.078904+0000","last_became_peered":"2023-11-04T01:41:53.078904+0000","last_unstale":"2023-11-04T01:41:56.331242+0000","last_undegraded":"2023-11-04T01:41:56.331242+0000","last_fullsized":"2023-11-04T01:41:56.331242+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:37.695110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.076482+0000","last_change":"2023-11-04T01:41:36.344271+0000","last_active":"2023-11-04T01:41:54.076482+0000","last_peered":"2023-11-04T01:41:54.076482+0000","last_clean":"2023-11-04T01:41:54.076482+0000","last_became_active":"2023-11-04T01:41:34.732524+0000","last_became_peered":"2023-11-04T01:41:34.732524+0000","last_unstale":"2023-11-04T01:41:54.076482+0000","last_undegraded":"2023-11-04T01:41:54.076482+0000","last_fullsized":"2023-11-04T01:41:54.076482+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:19.350812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081160599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":200,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085780+0000","last_change":"2023-11-04T01:39:54.204460+0000","last_active":"2023-11-04T01:41:55.085780+0000","last_peered":"2023-11-04T01:41:55.085780+0000","last_clean":"2023-11-04T01:41:55.085780+0000","last_became_active":"2023-11-04T01:39:54.203352+0000","last_became_peered":"2023-11-04T01:39:54.203352+0000","last_unstale":"2023-11-04T01:41:55.085780+0000","last_undegraded":"2023-11-04T01:41:55.085780+0000","last_fullsized":"2023-11-04T01:41:55.085780+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:52.627032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:52.627032+0000","last_clean_scrub_stamp":"2023-11-04T01:39:52.627032+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:17:18.474768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":293364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53500000000000003,"15min":0.53800000000000003},"min":{"1min":0.40400000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.70199999999999996,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.499,"15min":0.497},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.53500000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55300000000000005,"15min":0.55200000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.71999999999999997,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.68300000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57099999999999995,"15min":0.57499999999999996},"min":{"1min":0.375,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.752,"5min":1.177,"15min":1.177},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55000000000000004,"15min":0.55400000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.66300000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.76200000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.63100000000000001,"15min":0.63600000000000001},"min":{"1min":0.49199999999999999,"5min":0.435,"15min":0.435},"max":{"1min":0.79800000000000004,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.63100000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.318,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77400000000000002,"5min":1.048,"15min":1.048},"last":0.432},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.32900000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.75700000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.39100000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.438,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.71399999999999997,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.61499999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.56999999999999995,"15min":0.55900000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.627,"15min":0.624},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.71599999999999997}]}]},{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28244,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343596,"statfs":{"total":96636764160,"available":96607842304,"internally_reserved":0,"allocated":1245184,"data_stored":883240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.53200000000000003,"15min":0.51600000000000001},"min":{"1min":0.38100000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":1.6899999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.7290000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.42399999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83599999999999997,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.63200000000000001,"15min":0.61599999999999999},"min":{"1min":0.46800000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.5049999999999999,"5min":2.5049999999999999,"15min":2.5049999999999999},"last":2.5049999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.59299999999999997,"15min":0.58499999999999996},"min":{"1min":0.42799999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":1.708},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.621,"15min":0.60399999999999998},"min":{"1min":0.50800000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":1.6579999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.58599999999999997,"15min":0.56499999999999995},"min":{"1min":0.40100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":3.2349999999999999,"5min":3.2349999999999999,"15min":3.2349999999999999},"last":3.2349999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.37,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79200000000000004,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.46200000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.5,"15min":0.48599999999999999},"min":{"1min":0.308,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":1.454},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.47999999999999998,"15min":0.46999999999999997},"min":{"1min":0.36599999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.78600000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.52400000000000002,"15min":0.503},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":1.629},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.55200000000000005,"15min":0.53000000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":2.4500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":2.4500000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.623,"15min":0.58899999999999997},"min":{"1min":0.39700000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":3.7850000000000001,"5min":3.7850000000000001,"15min":3.7850000000000001},"last":3.7850000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.56999999999999995,"15min":0.55400000000000005},"min":{"1min":0.39200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.6699999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":630784,"data_stored":285739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.40200000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.67100000000000004,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40000000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.64900000000000002,"5min":0.752,"15min":0.752},"last":0.53700000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56100000000000005,"15min":0.56599999999999995},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.72899999999999998,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.38,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.71399999999999997}]},{"osd":2,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.35299999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.69499999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57399999999999995,"15min":0.57899999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.67900000000000005,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.45800000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.47299999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.67400000000000004,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57999999999999996,"15min":0.57899999999999996},"min":{"1min":0.434,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.72799999999999998,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.434}]},{"osd":4,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.746,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.56699999999999995}]},{"osd":5,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78800000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58499999999999996,"15min":0.58599999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77600000000000002,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.77600000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.749,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61599999999999999,"15min":0.621},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82399999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.621}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":643072,"data_stored":287351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.621}]},{"osd":1,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.42299999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.48699999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.51700000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.45900000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.442},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.63600000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.60799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":638976,"data_stored":285795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.31900000000000001,"15min":0.317},"min":{"1min":0.20599999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.32800000000000001,"15min":0.32200000000000001},"min":{"1min":0.23699999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.29899999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.36599999999999999,"15min":0.372},"min":{"1min":0.23899999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.48499999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.58699999999999997,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.371}]},{"osd":2,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.36799999999999999,"15min":0.36699999999999999},"min":{"1min":0.28199999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.52700000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.42199999999999999,"15min":0.42699999999999999},"min":{"1min":0.30299999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.50900000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.34399999999999997}]},{"osd":4,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.81599999999999995,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58399999999999996,"15min":0.58799999999999997},"min":{"1min":0.40500000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.51000000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58699999999999997,"15min":0.59399999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79400000000000004,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.47899999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57699999999999996,"15min":0.58099999999999996},"min":{"1min":0.373,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77100000000000002,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60999999999999999,"15min":0.61599999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85199999999999998,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.59899999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.626,"15min":0.628},"min":{"1min":0.46400000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58599999999999997,"15min":0.58899999999999997},"min":{"1min":0.40000000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83199999999999996,"5min":0.87,"15min":0.87},"last":0.54200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":638976,"data_stored":285795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.23599999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.29199999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.31},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.36499999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.44700000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.441}]},{"osd":6,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.52200000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.54900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":647168,"data_stored":292802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.443,"5min":0.443,"15min":0.443},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"last":0.33000000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.31}]},{"osd":3,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.35099999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.39300000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.441},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.46300000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.42699999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.496},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.48699999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28228,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343612,"statfs":{"total":96636764160,"available":96607858688,"internally_reserved":0,"allocated":1236992,"data_stored":877282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.33000000000000002,"15min":0.33400000000000002},"min":{"1min":0.20799999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.40000000000000002,"5min":0.874,"15min":0.874},"last":0.378},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.38500000000000001,"15min":0.39200000000000002},"min":{"1min":0.28799999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.496,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.35499999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.36799999999999999,"15min":0.379},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.44900000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.37,"15min":0.377},"min":{"1min":0.27100000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.41999999999999998,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.32200000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.35599999999999998,"15min":0.35999999999999999},"min":{"1min":0.248,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.44600000000000001,"5min":1.278,"15min":1.278},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.434,"15min":0.442},"min":{"1min":0.33000000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.52900000000000003,"5min":1.304,"15min":1.304},"last":0.39900000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81799999999999995,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.625},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.629,"15min":0.627},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.83399999999999996,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.65900000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.378,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.5},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.59899999999999998,"15min":0.60499999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.873,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.56699999999999995}]},{"osd":6,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.622,"15min":0.621},"min":{"1min":0.41799999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90200000000000002,"5min":1.248,"15min":1.248},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42899999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.64800000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.62,"15min":0.622},"min":{"1min":0.42999999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.61099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:41:57.706 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-04T01:41:57.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.834+0000 7f76c7821640 1 Processor -- start 2023-11-04T01:41:57.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.834+0000 7f76c7821640 1 -- start start 2023-11-04T01:41:57.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.835+0000 7f76c7821640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f76c00cde60 0x7f76c015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.835+0000 7f76c7821640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f76c015daa0 0x7f76c0157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.835+0000 7f76c7821640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76c015e000 con 0x7f76c00ce240 2023-11-04T01:41:57.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.835+0000 7f76c7821640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76c015e5c0 con 0x7f76c00cde60 2023-11-04T01:41:57.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.835+0000 7f76c7821640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c015e2e0 con 0x7f76c015daa0 2023-11-04T01:41:57.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.836+0000 7f76c4dbc640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f76c015daa0 0x7f76c0157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.836+0000 7f76c55bd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f76c00cde60 0x7f76c015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.836+0000 7f76c5dbe640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f76c00ce240 0x7f76c006b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:57242/0 (socket says 172.21.15.77:57242) 2023-11-04T01:41:57.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.836+0000 7f76c55bd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f76c00cde60 0x7f76c015d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:58542/0 (socket says 172.21.15.77:58542) 2023-11-04T01:41:57.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.836+0000 7f76c4dbc640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f76c015daa0 0x7f76c0157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:53694/0 (socket says 172.21.15.77:53694) 2023-11-04T01:41:57.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.836+0000 7f76c55bd640 1 -- 172.21.15.77:0/4178820107 learned_addr learned my addr 172.21.15.77:0/4178820107 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:57.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.836+0000 7f76c55bd640 1 -- 172.21.15.77:0/4178820107 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f76c015daa0 msgr2=0x7f76c0157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:57.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.836+0000 7f76c55bd640 1 --2- 172.21.15.77:0/4178820107 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f76c015daa0 0x7f76c0157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.836+0000 7f76c55bd640 1 -- 172.21.15.77:0/4178820107 >> v1:172.21.15.122:6789/0 conn(0x7f76c00ce240 legacy=0x7f76c006b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.836+0000 7f76bffff640 1 -- 172.21.15.77:0/4178820107 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 822601850 0 0) 0x7f76c015e000 con 0x7f76c00ce240 2023-11-04T01:41:57.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.836+0000 7f76c55bd640 1 -- 172.21.15.77:0/4178820107 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c00d1120 con 0x7f76c00cde60 2023-11-04T01:41:57.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.836+0000 7f76c4dbc640 1 --2- 172.21.15.77:0/4178820107 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f76c015daa0 0x7f76c0157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:41:57.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.837+0000 7f76c55bd640 1 --2- 172.21.15.77:0/4178820107 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76c00cde60 0x7f76c015d560 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f76b8009870 tx=0x7f76b802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=905cad7aa7923488 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:57.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.837+0000 7f76bffff640 1 -- 172.21.15.77:0/4178820107 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b8030840 con 0x7f76c00cde60 2023-11-04T01:41:57.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.837+0000 7f76bffff640 1 -- 172.21.15.77:0/4178820107 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b80309a0 con 0x7f76c00cde60 2023-11-04T01:41:57.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.837+0000 7f76bffff640 1 -- 172.21.15.77:0/4178820107 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b8030d30 con 0x7f76c00cde60 2023-11-04T01:41:57.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.837+0000 7f76c7821640 1 -- 172.21.15.77:0/4178820107 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76c00cde60 msgr2=0x7f76c015d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.837+0000 7f76c7821640 1 --2- 172.21.15.77:0/4178820107 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76c00cde60 0x7f76c015d560 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f76b8009870 tx=0x7f76b802b980 comp rx=0 tx=0).stop 2023-11-04T01:41:57.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.838+0000 7f76c7821640 1 -- 172.21.15.77:0/4178820107 shutdown_connections 2023-11-04T01:41:57.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.838+0000 7f76c7821640 1 --2- 172.21.15.77:0/4178820107 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f76c015daa0 0x7f76c0157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.838+0000 7f76c7821640 1 --2- 172.21.15.77:0/4178820107 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76c00cde60 0x7f76c015d560 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.838+0000 7f76c7821640 1 -- 172.21.15.77:0/4178820107 >> 172.21.15.77:0/4178820107 conn(0x7f76c0071f30 msgr2=0x7f76c00cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:57.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.838+0000 7f76c7821640 1 -- 172.21.15.77:0/4178820107 shutdown_connections 2023-11-04T01:41:57.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.838+0000 7f76c7821640 1 -- 172.21.15.77:0/4178820107 wait complete. 2023-11-04T01:41:57.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.839+0000 7f76c7821640 1 Processor -- start 2023-11-04T01:41:57.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.839+0000 7f76c7821640 1 -- start start 2023-11-04T01:41:57.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.839+0000 7f76c7821640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76c00cde60 0x7f76c00c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.839+0000 7f76c7821640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f76c00ce240 0x7f76c015a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.840+0000 7f76c7821640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76c015daa0 0x7f76c01f1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.840+0000 7f76c7821640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c01478a0 con 0x7f76c015daa0 2023-11-04T01:41:57.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.840+0000 7f76c7821640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c015aa90 con 0x7f76c00cde60 2023-11-04T01:41:57.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.840+0000 7f76c7821640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c01f2520 con 0x7f76c00ce240 2023-11-04T01:41:57.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.840+0000 7f76c5dbe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76c015daa0 0x7f76c01f1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.840+0000 7f76c5dbe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76c015daa0 0x7f76c01f1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56710/0 (socket says 172.21.15.77:56710) 2023-11-04T01:41:57.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.840+0000 7f76c5dbe640 1 -- 172.21.15.77:0/23060528 learned_addr learned my addr 172.21.15.77:0/23060528 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:57.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.840+0000 7f76c55bd640 1 --2- 172.21.15.77:0/23060528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76c00cde60 0x7f76c00c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.840+0000 7f76c5dbe640 1 -- 172.21.15.77:0/23060528 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f76c00ce240 msgr2=0x7f76c015a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.840+0000 7f76c4dbc640 1 --2- 172.21.15.77:0/23060528 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f76c00ce240 0x7f76c015a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.840+0000 7f76c5dbe640 1 --2- 172.21.15.77:0/23060528 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f76c00ce240 0x7f76c015a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.840+0000 7f76c5dbe640 1 -- 172.21.15.77:0/23060528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76c00cde60 msgr2=0x7f76c00c90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:57.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.840+0000 7f76c5dbe640 1 --2- 172.21.15.77:0/23060528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76c00cde60 0x7f76c00c90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:57.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.840+0000 7f76c5dbe640 1 -- 172.21.15.77:0/23060528 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b4009a70 con 0x7f76c015daa0 2023-11-04T01:41:57.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.840+0000 7f76c55bd640 1 --2- 172.21.15.77:0/23060528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76c00cde60 0x7f76c00c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:41:57.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.840+0000 7f76c5dbe640 1 --2- 172.21.15.77:0/23060528 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76c015daa0 0x7f76c01f1fe0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f76b000c450 tx=0x7f76b000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:57.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.840+0000 7f76bdffb640 1 -- 172.21.15.77:0/23060528 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b00074e0 con 0x7f76c015daa0 2023-11-04T01:41:57.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.840+0000 7f76bdffb640 1 -- 172.21.15.77:0/23060528 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b0007660 con 0x7f76c015daa0 2023-11-04T01:41:57.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.840+0000 7f76c7821640 1 -- 172.21.15.77:0/23060528 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b80094d0 con 0x7f76c015daa0 2023-11-04T01:41:57.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.840+0000 7f76bdffb640 1 -- 172.21.15.77:0/23060528 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b0004a20 con 0x7f76c015daa0 2023-11-04T01:41:57.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.841+0000 7f76c7821640 1 -- 172.21.15.77:0/23060528 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c0147250 con 0x7f76c015daa0 2023-11-04T01:41:57.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.841+0000 7f76c7821640 1 -- 172.21.15.77:0/23060528 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c0147a50 con 0x7f76c015daa0 2023-11-04T01:41:57.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.842+0000 7f76bdffb640 1 -- 172.21.15.77:0/23060528 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f76b0004b80 con 0x7f76c015daa0 2023-11-04T01:41:57.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.842+0000 7f76bdffb640 1 --2- 172.21.15.77:0/23060528 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f76ac06aea0 0x7f76ac06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:57.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.842+0000 7f76bdffb640 1 -- 172.21.15.77:0/23060528 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f76b0088ca0 con 0x7f76c015daa0 2023-11-04T01:41:57.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.842+0000 7f76c55bd640 1 --2- 172.21.15.77:0/23060528 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f76ac06aea0 0x7f76ac06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:57.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.843+0000 7f76c55bd640 1 --2- 172.21.15.77:0/23060528 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f76ac06aea0 0x7f76ac06d360 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f76b8036000 tx=0x7f76b803b040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:57.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:57.846+0000 7f76bdffb640 1 -- 172.21.15.77:0/23060528 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f76c0147a50 con 0x7f76c015daa0 2023-11-04T01:41:58.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.076+0000 7f76c7821640 1 -- 172.21.15.77:0/23060528 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f76c0074290 con 0x7f76c015daa0 2023-11-04T01:41:58.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.077+0000 7f76bdffb640 1 -- 172.21.15.77:0/23060528 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1255 (secure 0 0 0) 0x7f76b0018080 con 0x7f76c015daa0 2023-11-04T01:41:58.079 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:58.079 INFO:teuthology.orchestra.run.smithi077.stdout:{"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","health":{"status":"HEALTH_WARN","checks":{"POOL_APP_NOT_ENABLED":{"severity":"HEALTH_WARN","summary":{"message":"1 pool(s) do not have an application enabled","count":1},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":136,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":54,"num_osds":8,"num_up_osds":8,"osd_up_since":1699061991,"num_in_osds":8,"osd_in_since":1699061982,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":86},{"state_name":"active+clean","count":33},{"state_name":"creating+peering","count":10}],"num_pgs":129,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":227303424,"bytes_avail":772866809856,"bytes_total":773094113280,"unknown_pgs_ratio":0.66666668653488159,"inactive_pgs_ratio":0.077519379556179047},"fsmap":{"epoch":22,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5958}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-11-04T01:41:09.642373+0000","services":{}},"progress_events":{}} 2023-11-04T01:41:58.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.079+0000 7f76c7821640 1 -- 172.21.15.77:0/23060528 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f76ac06aea0 msgr2=0x7f76ac06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:58.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.079+0000 7f76c7821640 1 --2- 172.21.15.77:0/23060528 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f76ac06aea0 0x7f76ac06d360 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f76b8036000 tx=0x7f76b803b040 comp rx=0 tx=0).stop 2023-11-04T01:41:58.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.079+0000 7f76c7821640 1 -- 172.21.15.77:0/23060528 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76c015daa0 msgr2=0x7f76c01f1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:58.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.079+0000 7f76c7821640 1 --2- 172.21.15.77:0/23060528 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76c015daa0 0x7f76c01f1fe0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f76b000c450 tx=0x7f76b000c910 comp rx=0 tx=0).stop 2023-11-04T01:41:58.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.079+0000 7f76c7821640 1 -- 172.21.15.77:0/23060528 shutdown_connections 2023-11-04T01:41:58.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.079+0000 7f76c7821640 1 --2- 172.21.15.77:0/23060528 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f76ac06aea0 0x7f76ac06d360 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.079+0000 7f76c7821640 1 --2- 172.21.15.77:0/23060528 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76c015daa0 0x7f76c01f1fe0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.079+0000 7f76c7821640 1 --2- 172.21.15.77:0/23060528 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f76c00ce240 0x7f76c015a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.079+0000 7f76c7821640 1 --2- 172.21.15.77:0/23060528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76c00cde60 0x7f76c00c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.079+0000 7f76c7821640 1 -- 172.21.15.77:0/23060528 >> 172.21.15.77:0/23060528 conn(0x7f76c0071f30 msgr2=0x7f76c00c6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:58.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.079+0000 7f76c7821640 1 -- 172.21.15.77:0/23060528 shutdown_connections 2023-11-04T01:41:58.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.079+0000 7f76c7821640 1 -- 172.21.15.77:0/23060528 wait complete. 2023-11-04T01:41:58.091 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-04T01:41:58.092 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:41:58.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.190+0000 7fb205bb6640 1 Processor -- start 2023-11-04T01:41:58.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.190+0000 7fb205bb6640 1 -- start start 2023-11-04T01:41:58.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.190+0000 7fb205bb6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb2000cde60 0x7fb20015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:58.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.190+0000 7fb205bb6640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb20015daa0 0x7fb200157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:58.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.190+0000 7fb205bb6640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb2000ce240 0x7fb200157540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:58.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.190+0000 7fb205bb6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb20015e5c0 con 0x7fb2000cde60 2023-11-04T01:41:58.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.190+0000 7fb205bb6640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb200157a80 con 0x7fb2000ce240 2023-11-04T01:41:58.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.190+0000 7fb205bb6640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20015e000 con 0x7fb20015daa0 2023-11-04T01:41:58.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.191+0000 7fb1ff7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb2000cde60 0x7fb20015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:58.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.191+0000 7fb1ff7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb2000cde60 0x7fb20015d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56722/0 (socket says 172.21.15.77:56722) 2023-11-04T01:41:58.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.191+0000 7fb1ff7fe640 1 -- 172.21.15.77:0/3121043377 learned_addr learned my addr 172.21.15.77:0/3121043377 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:58.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.191+0000 7fb1fffff640 1 --2- 172.21.15.77:0/3121043377 >> v2:172.21.15.122:3300/0 conn(0x7fb2000ce240 0x7fb200157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:58.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.191+0000 7fb1ff7fe640 1 -- 172.21.15.77:0/3121043377 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb20015daa0 msgr2=0x7fb200157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:58.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.191+0000 7fb1ff7fe640 1 --2- 172.21.15.77:0/3121043377 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb20015daa0 0x7fb200157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.191+0000 7fb1ff7fe640 1 -- 172.21.15.77:0/3121043377 >> v2:172.21.15.122:3300/0 conn(0x7fb2000ce240 msgr2=0x7fb200157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:58.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.191+0000 7fb1ff7fe640 1 --2- 172.21.15.77:0/3121043377 >> v2:172.21.15.122:3300/0 conn(0x7fb2000ce240 0x7fb200157540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.191+0000 7fb1ff7fe640 1 -- 172.21.15.77:0/3121043377 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20015e2e0 con 0x7fb2000cde60 2023-11-04T01:41:58.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.192+0000 7fb1ff7fe640 1 --2- 172.21.15.77:0/3121043377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2000cde60 0x7fb20015d560 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fb20015df30 tx=0x7fb1f002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f381f371e32780de server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:58.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.192+0000 7fb1fe7fc640 1 -- 172.21.15.77:0/3121043377 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0031870 con 0x7fb2000cde60 2023-11-04T01:41:58.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.192+0000 7fb1fe7fc640 1 -- 172.21.15.77:0/3121043377 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f00319d0 con 0x7fb2000cde60 2023-11-04T01:41:58.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.192+0000 7fb1fe7fc640 1 -- 172.21.15.77:0/3121043377 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0031d60 con 0x7fb2000cde60 2023-11-04T01:41:58.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.192+0000 7fb205bb6640 1 -- 172.21.15.77:0/3121043377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2000cde60 msgr2=0x7fb20015d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:58.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.192+0000 7fb205bb6640 1 --2- 172.21.15.77:0/3121043377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2000cde60 0x7fb20015d560 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fb20015df30 tx=0x7fb1f002b910 comp rx=0 tx=0).stop 2023-11-04T01:41:58.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.192+0000 7fb205bb6640 1 -- 172.21.15.77:0/3121043377 shutdown_connections 2023-11-04T01:41:58.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.192+0000 7fb205bb6640 1 --2- 172.21.15.77:0/3121043377 >> v2:172.21.15.122:3300/0 conn(0x7fb2000ce240 0x7fb200157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.192+0000 7fb205bb6640 1 --2- 172.21.15.77:0/3121043377 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb20015daa0 0x7fb200157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.192+0000 7fb205bb6640 1 --2- 172.21.15.77:0/3121043377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2000cde60 0x7fb20015d560 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.192+0000 7fb205bb6640 1 -- 172.21.15.77:0/3121043377 >> 172.21.15.77:0/3121043377 conn(0x7fb200071f30 msgr2=0x7fb2000cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:58.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.192+0000 7fb205bb6640 1 -- 172.21.15.77:0/3121043377 shutdown_connections 2023-11-04T01:41:58.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.192+0000 7fb205bb6640 1 -- 172.21.15.77:0/3121043377 wait complete. 2023-11-04T01:41:58.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.193+0000 7fb205bb6640 1 Processor -- start 2023-11-04T01:41:58.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.194+0000 7fb205bb6640 1 -- start start 2023-11-04T01:41:58.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.194+0000 7fb205bb6640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb2000cde60 0x7fb200157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:58.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.194+0000 7fb205bb6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2000ce240 0x7fb2000d1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:58.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.194+0000 7fb205bb6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb20015daa0 0x7fb20014c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:58.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.194+0000 7fb205bb6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb200158160 con 0x7fb20015daa0 2023-11-04T01:41:58.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.194+0000 7fb205bb6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20015b9a0 con 0x7fb2000ce240 2023-11-04T01:41:58.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.194+0000 7fb205bb6640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20015b0f0 con 0x7fb2000cde60 2023-11-04T01:41:58.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.194+0000 7fb1fffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb20015daa0 0x7fb20014c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:58.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.194+0000 7fb1fffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb20015daa0 0x7fb20014c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56726/0 (socket says 172.21.15.77:56726) 2023-11-04T01:41:58.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.194+0000 7fb1fffff640 1 -- 172.21.15.77:0/420785663 learned_addr learned my addr 172.21.15.77:0/420785663 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:41:58.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.195+0000 7fb1ff7fe640 1 --2- 172.21.15.77:0/420785663 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb2000cde60 0x7fb200157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:58.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.195+0000 7fb1feffd640 1 --2- 172.21.15.77:0/420785663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2000ce240 0x7fb2000d1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:58.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.195+0000 7fb1fffff640 1 -- 172.21.15.77:0/420785663 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb2000cde60 msgr2=0x7fb200157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:58.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.195+0000 7fb1fffff640 1 --2- 172.21.15.77:0/420785663 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb2000cde60 0x7fb200157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.195+0000 7fb1fffff640 1 -- 172.21.15.77:0/420785663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2000ce240 msgr2=0x7fb2000d1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:58.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.195+0000 7fb1fffff640 1 --2- 172.21.15.77:0/420785663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2000ce240 0x7fb2000d1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.195+0000 7fb1fffff640 1 -- 172.21.15.77:0/420785663 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f00094d0 con 0x7fb20015daa0 2023-11-04T01:41:58.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.195+0000 7fb1fffff640 1 --2- 172.21.15.77:0/420785663 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb20015daa0 0x7fb20014c050 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fb1f800cd70 tx=0x7fb1f800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:58.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.195+0000 7fb1e7fff640 1 -- 172.21.15.77:0/420785663 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f8003b90 con 0x7fb20015daa0 2023-11-04T01:41:58.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.195+0000 7fb1e7fff640 1 -- 172.21.15.77:0/420785663 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f8003cf0 con 0x7fb20015daa0 2023-11-04T01:41:58.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.195+0000 7fb205bb6640 1 -- 172.21.15.77:0/420785663 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2000cacd0 con 0x7fb20015daa0 2023-11-04T01:41:58.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.195+0000 7fb1e7fff640 1 -- 172.21.15.77:0/420785663 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f8004240 con 0x7fb20015daa0 2023-11-04T01:41:58.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.195+0000 7fb205bb6640 1 -- 172.21.15.77:0/420785663 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb20015b630 con 0x7fb20015daa0 2023-11-04T01:41:58.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.196+0000 7fb205bb6640 1 -- 172.21.15.77:0/420785663 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb20015bb50 con 0x7fb20015daa0 2023-11-04T01:41:58.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.196+0000 7fb1e7fff640 1 -- 172.21.15.77:0/420785663 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb1f80043a0 con 0x7fb20015daa0 2023-11-04T01:41:58.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.197+0000 7fb1e7fff640 1 --2- 172.21.15.77:0/420785663 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb1ec06aea0 0x7fb1ec06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:58.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.197+0000 7fb1e7fff640 1 -- 172.21.15.77:0/420785663 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb1f8012070 con 0x7fb20015daa0 2023-11-04T01:41:58.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.197+0000 7fb1ff7fe640 1 --2- 172.21.15.77:0/420785663 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb1ec06aea0 0x7fb1ec06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:58.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.197+0000 7fb1ff7fe640 1 --2- 172.21.15.77:0/420785663 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb1ec06aea0 0x7fb1ec06d360 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0036000 tx=0x7fb1f003c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:58.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.201+0000 7fb1e7fff640 1 -- 172.21.15.77:0/420785663 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb20015bb50 con 0x7fb20015daa0 2023-11-04T01:41:58.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.362+0000 7fb205bb6640 1 -- 172.21.15.77:0/420785663 --> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb2000d1400 con 0x7fb1ec06aea0 2023-11-04T01:41:58.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.372+0000 7fb1e7fff640 1 -- 172.21.15.77:0/420785663 <== mgr.4123 v2:172.21.15.122:6832/2275325762 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370225 (secure 0 0 0) 0x7fb1f0031810 con 0x7fb1ec06aea0 2023-11-04T01:41:58.378 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:41:58.380 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-04T01:41:58.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.375+0000 7fb205bb6640 1 -- 172.21.15.77:0/420785663 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb1ec06aea0 msgr2=0x7fb1ec06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:58.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.375+0000 7fb205bb6640 1 --2- 172.21.15.77:0/420785663 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb1ec06aea0 0x7fb1ec06d360 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0036000 tx=0x7fb1f003c040 comp rx=0 tx=0).stop 2023-11-04T01:41:58.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.375+0000 7fb205bb6640 1 -- 172.21.15.77:0/420785663 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb20015daa0 msgr2=0x7fb20014c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:58.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.375+0000 7fb205bb6640 1 --2- 172.21.15.77:0/420785663 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb20015daa0 0x7fb20014c050 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fb1f800cd70 tx=0x7fb1f800a660 comp rx=0 tx=0).stop 2023-11-04T01:41:58.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.376+0000 7fb205bb6640 1 -- 172.21.15.77:0/420785663 shutdown_connections 2023-11-04T01:41:58.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.376+0000 7fb205bb6640 1 --2- 172.21.15.77:0/420785663 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb1ec06aea0 0x7fb1ec06d360 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.376+0000 7fb205bb6640 1 --2- 172.21.15.77:0/420785663 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb20015daa0 0x7fb20014c050 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.376+0000 7fb205bb6640 1 --2- 172.21.15.77:0/420785663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2000ce240 0x7fb2000d1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.376+0000 7fb205bb6640 1 --2- 172.21.15.77:0/420785663 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb2000cde60 0x7fb200157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:58.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.376+0000 7fb205bb6640 1 -- 172.21.15.77:0/420785663 >> 172.21.15.77:0/420785663 conn(0x7fb200071f30 msgr2=0x7fb2000b7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:58.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.376+0000 7fb205bb6640 1 -- 172.21.15.77:0/420785663 shutdown_connections 2023-11-04T01:41:58.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:41:58.376+0000 7fb205bb6640 1 -- 172.21.15.77:0/420785663 wait complete. 2023-11-04T01:41:58.388 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2023-11-04T01:41:57.653885+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":200,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222384,"kb_used_data":6184,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752336,"statfs":{"total":773094113280,"available":772866392064,"internally_reserved":0,"allocated":6332416,"data_stored":3491368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.596875"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590009+0000","last_change":"2023-11-04T01:41:54.087836+0000","last_active":"2023-11-04T01:41:56.590009+0000","last_peered":"2023-11-04T01:41:56.590009+0000","last_clean":"2023-11-04T01:41:56.590009+0000","last_became_active":"2023-11-04T01:41:54.087590+0000","last_became_peered":"2023-11-04T01:41:54.087590+0000","last_unstale":"2023-11-04T01:41:56.590009+0000","last_undegraded":"2023-11-04T01:41:56.590009+0000","last_fullsized":"2023-11-04T01:41:56.590009+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:14:41.371010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590159+0000","last_change":"2023-11-04T01:41:54.092108+0000","last_active":"2023-11-04T01:41:56.590159+0000","last_peered":"2023-11-04T01:41:56.590159+0000","last_clean":"2023-11-04T01:41:56.590159+0000","last_became_active":"2023-11-04T01:41:54.091856+0000","last_became_peered":"2023-11-04T01:41:54.091856+0000","last_unstale":"2023-11-04T01:41:56.590159+0000","last_undegraded":"2023-11-04T01:41:56.590159+0000","last_fullsized":"2023-11-04T01:41:56.590159+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:52:17.923196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085645+0000","last_change":"2023-11-04T01:41:54.081697+0000","last_active":"2023-11-04T01:41:55.085645+0000","last_peered":"2023-11-04T01:41:55.085645+0000","last_clean":"2023-11-04T01:41:55.085645+0000","last_became_active":"2023-11-04T01:41:54.080925+0000","last_became_peered":"2023-11-04T01:41:54.080925+0000","last_unstale":"2023-11-04T01:41:55.085645+0000","last_undegraded":"2023-11-04T01:41:55.085645+0000","last_fullsized":"2023-11-04T01:41:55.085645+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:09:20.408298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085924+0000","last_change":"2023-11-04T01:41:54.085207+0000","last_active":"2023-11-04T01:41:55.085924+0000","last_peered":"2023-11-04T01:41:55.085924+0000","last_clean":"2023-11-04T01:41:55.085924+0000","last_became_active":"2023-11-04T01:41:54.081758+0000","last_became_peered":"2023-11-04T01:41:54.081758+0000","last_unstale":"2023-11-04T01:41:55.085924+0000","last_undegraded":"2023-11-04T01:41:55.085924+0000","last_fullsized":"2023-11-04T01:41:55.085924+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:49.436809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589675+0000","last_change":"2023-11-04T01:41:54.081691+0000","last_active":"2023-11-04T01:41:56.589675+0000","last_peered":"2023-11-04T01:41:56.589675+0000","last_clean":"2023-11-04T01:41:56.589675+0000","last_became_active":"2023-11-04T01:41:54.081400+0000","last_became_peered":"2023-11-04T01:41:54.081400+0000","last_unstale":"2023-11-04T01:41:56.589675+0000","last_undegraded":"2023-11-04T01:41:56.589675+0000","last_fullsized":"2023-11-04T01:41:56.589675+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:22:11.948292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589953+0000","last_change":"2023-11-04T01:41:54.090265+0000","last_active":"2023-11-04T01:41:56.589953+0000","last_peered":"2023-11-04T01:41:56.589953+0000","last_clean":"2023-11-04T01:41:56.589953+0000","last_became_active":"2023-11-04T01:41:54.090023+0000","last_became_peered":"2023-11-04T01:41:54.090023+0000","last_unstale":"2023-11-04T01:41:56.589953+0000","last_undegraded":"2023-11-04T01:41:56.589953+0000","last_fullsized":"2023-11-04T01:41:56.589953+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:09:05.963500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589192+0000","last_change":"2023-11-04T01:41:54.081762+0000","last_active":"2023-11-04T01:41:56.589192+0000","last_peered":"2023-11-04T01:41:56.589192+0000","last_clean":"2023-11-04T01:41:56.589192+0000","last_became_active":"2023-11-04T01:41:54.081515+0000","last_became_peered":"2023-11-04T01:41:54.081515+0000","last_unstale":"2023-11-04T01:41:56.589192+0000","last_undegraded":"2023-11-04T01:41:56.589192+0000","last_fullsized":"2023-11-04T01:41:56.589192+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:14.516867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589641+0000","last_change":"2023-11-04T01:41:54.080725+0000","last_active":"2023-11-04T01:41:56.589641+0000","last_peered":"2023-11-04T01:41:56.589641+0000","last_clean":"2023-11-04T01:41:56.589641+0000","last_became_active":"2023-11-04T01:41:54.080446+0000","last_became_peered":"2023-11-04T01:41:54.080446+0000","last_unstale":"2023-11-04T01:41:56.589641+0000","last_undegraded":"2023-11-04T01:41:56.589641+0000","last_fullsized":"2023-11-04T01:41:56.589641+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:36:28.196536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589582+0000","last_change":"2023-11-04T01:41:54.091895+0000","last_active":"2023-11-04T01:41:56.589582+0000","last_peered":"2023-11-04T01:41:56.589582+0000","last_clean":"2023-11-04T01:41:56.589582+0000","last_became_active":"2023-11-04T01:41:54.091641+0000","last_became_peered":"2023-11-04T01:41:54.091641+0000","last_unstale":"2023-11-04T01:41:56.589582+0000","last_undegraded":"2023-11-04T01:41:56.589582+0000","last_fullsized":"2023-11-04T01:41:56.589582+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:13:17.472616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.081608+0000","last_change":"2023-11-04T01:41:54.078741+0000","last_active":"2023-11-04T01:41:55.081608+0000","last_peered":"2023-11-04T01:41:55.081608+0000","last_clean":"2023-11-04T01:41:55.081608+0000","last_became_active":"2023-11-04T01:41:54.078419+0000","last_became_peered":"2023-11-04T01:41:54.078419+0000","last_unstale":"2023-11-04T01:41:55.081608+0000","last_undegraded":"2023-11-04T01:41:55.081608+0000","last_fullsized":"2023-11-04T01:41:55.081608+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:44.807007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.081745+0000","last_change":"2023-11-04T01:41:54.086241+0000","last_active":"2023-11-04T01:41:55.081745+0000","last_peered":"2023-11-04T01:41:55.081745+0000","last_clean":"2023-11-04T01:41:55.081745+0000","last_became_active":"2023-11-04T01:41:54.085701+0000","last_became_peered":"2023-11-04T01:41:54.085701+0000","last_unstale":"2023-11-04T01:41:55.081745+0000","last_undegraded":"2023-11-04T01:41:55.081745+0000","last_fullsized":"2023-11-04T01:41:55.081745+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:32:36.620521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.084622+0000","last_change":"2023-11-04T01:41:54.083807+0000","last_active":"2023-11-04T01:41:55.084622+0000","last_peered":"2023-11-04T01:41:55.084622+0000","last_clean":"2023-11-04T01:41:55.084622+0000","last_became_active":"2023-11-04T01:41:54.083543+0000","last_became_peered":"2023-11-04T01:41:54.083543+0000","last_unstale":"2023-11-04T01:41:55.084622+0000","last_undegraded":"2023-11-04T01:41:55.084622+0000","last_fullsized":"2023-11-04T01:41:55.084622+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:52.207829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.331475+0000","last_change":"2023-11-04T01:41:54.092079+0000","last_active":"2023-11-04T01:41:56.331475+0000","last_peered":"2023-11-04T01:41:56.331475+0000","last_clean":"2023-11-04T01:41:56.331475+0000","last_became_active":"2023-11-04T01:41:54.091786+0000","last_became_peered":"2023-11-04T01:41:54.091786+0000","last_unstale":"2023-11-04T01:41:56.331475+0000","last_undegraded":"2023-11-04T01:41:56.331475+0000","last_fullsized":"2023-11-04T01:41:56.331475+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:57:42.655270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589386+0000","last_change":"2023-11-04T01:41:54.085256+0000","last_active":"2023-11-04T01:41:56.589386+0000","last_peered":"2023-11-04T01:41:56.589386+0000","last_clean":"2023-11-04T01:41:56.589386+0000","last_became_active":"2023-11-04T01:41:54.084652+0000","last_became_peered":"2023-11-04T01:41:54.084652+0000","last_unstale":"2023-11-04T01:41:56.589386+0000","last_undegraded":"2023-11-04T01:41:56.589386+0000","last_fullsized":"2023-11-04T01:41:56.589386+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:44.807007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589329+0000","last_change":"2023-11-04T01:41:54.073589+0000","last_active":"2023-11-04T01:41:56.589329+0000","last_peered":"2023-11-04T01:41:56.589329+0000","last_clean":"2023-11-04T01:41:56.589329+0000","last_became_active":"2023-11-04T01:41:54.073292+0000","last_became_peered":"2023-11-04T01:41:54.073292+0000","last_unstale":"2023-11-04T01:41:56.589329+0000","last_undegraded":"2023-11-04T01:41:56.589329+0000","last_fullsized":"2023-11-04T01:41:56.589329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:40.760885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589277+0000","last_change":"2023-11-04T01:41:54.087994+0000","last_active":"2023-11-04T01:41:56.589277+0000","last_peered":"2023-11-04T01:41:56.589277+0000","last_clean":"2023-11-04T01:41:56.589277+0000","last_became_active":"2023-11-04T01:41:54.087529+0000","last_became_peered":"2023-11-04T01:41:54.087529+0000","last_unstale":"2023-11-04T01:41:56.589277+0000","last_undegraded":"2023-11-04T01:41:56.589277+0000","last_fullsized":"2023-11-04T01:41:56.589277+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:37:37.857295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590482+0000","last_change":"2023-11-04T01:41:54.084644+0000","last_active":"2023-11-04T01:41:56.590482+0000","last_peered":"2023-11-04T01:41:56.590482+0000","last_clean":"2023-11-04T01:41:56.590482+0000","last_became_active":"2023-11-04T01:41:54.084354+0000","last_became_peered":"2023-11-04T01:41:54.084354+0000","last_unstale":"2023-11-04T01:41:56.590482+0000","last_undegraded":"2023-11-04T01:41:56.590482+0000","last_fullsized":"2023-11-04T01:41:56.590482+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:56:59.472772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085262+0000","last_change":"2023-11-04T01:41:54.092787+0000","last_active":"2023-11-04T01:41:55.085262+0000","last_peered":"2023-11-04T01:41:55.085262+0000","last_clean":"2023-11-04T01:41:55.085262+0000","last_became_active":"2023-11-04T01:41:54.092471+0000","last_became_peered":"2023-11-04T01:41:54.092471+0000","last_unstale":"2023-11-04T01:41:55.085262+0000","last_undegraded":"2023-11-04T01:41:55.085262+0000","last_fullsized":"2023-11-04T01:41:55.085262+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:46:28.222652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589584+0000","last_change":"2023-11-04T01:41:54.087167+0000","last_active":"2023-11-04T01:41:56.589584+0000","last_peered":"2023-11-04T01:41:56.589584+0000","last_clean":"2023-11-04T01:41:56.589584+0000","last_became_active":"2023-11-04T01:41:54.086905+0000","last_became_peered":"2023-11-04T01:41:54.086905+0000","last_unstale":"2023-11-04T01:41:56.589584+0000","last_undegraded":"2023-11-04T01:41:56.589584+0000","last_fullsized":"2023-11-04T01:41:56.589584+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:02:48.912210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590277+0000","last_change":"2023-11-04T01:41:54.092451+0000","last_active":"2023-11-04T01:41:56.590277+0000","last_peered":"2023-11-04T01:41:56.590277+0000","last_clean":"2023-11-04T01:41:56.590277+0000","last_became_active":"2023-11-04T01:41:54.092212+0000","last_became_peered":"2023-11-04T01:41:54.092212+0000","last_unstale":"2023-11-04T01:41:56.590277+0000","last_undegraded":"2023-11-04T01:41:56.590277+0000","last_fullsized":"2023-11-04T01:41:56.590277+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:46:09.677609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.084974+0000","last_change":"2023-11-04T01:41:54.080620+0000","last_active":"2023-11-04T01:41:55.084974+0000","last_peered":"2023-11-04T01:41:55.084974+0000","last_clean":"2023-11-04T01:41:55.084974+0000","last_became_active":"2023-11-04T01:41:54.080202+0000","last_became_peered":"2023-11-04T01:41:54.080202+0000","last_unstale":"2023-11-04T01:41:55.084974+0000","last_undegraded":"2023-11-04T01:41:55.084974+0000","last_fullsized":"2023-11-04T01:41:55.084974+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:14:17.050765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590838+0000","last_change":"2023-11-04T01:41:54.091350+0000","last_active":"2023-11-04T01:41:56.590838+0000","last_peered":"2023-11-04T01:41:56.590838+0000","last_clean":"2023-11-04T01:41:56.590838+0000","last_became_active":"2023-11-04T01:41:54.090745+0000","last_became_peered":"2023-11-04T01:41:54.090745+0000","last_unstale":"2023-11-04T01:41:56.590838+0000","last_undegraded":"2023-11-04T01:41:56.590838+0000","last_fullsized":"2023-11-04T01:41:56.590838+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:46:29.429058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085258+0000","last_change":"2023-11-04T01:41:54.081175+0000","last_active":"2023-11-04T01:41:55.085258+0000","last_peered":"2023-11-04T01:41:55.085258+0000","last_clean":"2023-11-04T01:41:55.085258+0000","last_became_active":"2023-11-04T01:41:54.080838+0000","last_became_peered":"2023-11-04T01:41:54.080838+0000","last_unstale":"2023-11-04T01:41:55.085258+0000","last_undegraded":"2023-11-04T01:41:55.085258+0000","last_fullsized":"2023-11-04T01:41:55.085258+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:32:12.744944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.331133+0000","last_change":"2023-11-04T01:41:54.088758+0000","last_active":"2023-11-04T01:41:56.331133+0000","last_peered":"2023-11-04T01:41:56.331133+0000","last_clean":"2023-11-04T01:41:56.331133+0000","last_became_active":"2023-11-04T01:41:54.088433+0000","last_became_peered":"2023-11-04T01:41:54.088433+0000","last_unstale":"2023-11-04T01:41:56.331133+0000","last_undegraded":"2023-11-04T01:41:56.331133+0000","last_fullsized":"2023-11-04T01:41:56.331133+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:07:52.095800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590194+0000","last_change":"2023-11-04T01:41:54.085622+0000","last_active":"2023-11-04T01:41:56.590194+0000","last_peered":"2023-11-04T01:41:56.590194+0000","last_clean":"2023-11-04T01:41:56.590194+0000","last_became_active":"2023-11-04T01:41:54.085304+0000","last_became_peered":"2023-11-04T01:41:54.085304+0000","last_unstale":"2023-11-04T01:41:56.590194+0000","last_undegraded":"2023-11-04T01:41:56.590194+0000","last_fullsized":"2023-11-04T01:41:56.590194+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:39.440934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085016+0000","last_change":"2023-11-04T01:41:54.082662+0000","last_active":"2023-11-04T01:41:55.085016+0000","last_peered":"2023-11-04T01:41:55.085016+0000","last_clean":"2023-11-04T01:41:55.085016+0000","last_became_active":"2023-11-04T01:41:54.082371+0000","last_became_peered":"2023-11-04T01:41:54.082371+0000","last_unstale":"2023-11-04T01:41:55.085016+0000","last_undegraded":"2023-11-04T01:41:55.085016+0000","last_fullsized":"2023-11-04T01:41:55.085016+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:48:32.480005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590082+0000","last_change":"2023-11-04T01:41:54.089951+0000","last_active":"2023-11-04T01:41:56.590082+0000","last_peered":"2023-11-04T01:41:56.590082+0000","last_clean":"2023-11-04T01:41:56.590082+0000","last_became_active":"2023-11-04T01:41:54.089244+0000","last_became_peered":"2023-11-04T01:41:54.089244+0000","last_unstale":"2023-11-04T01:41:56.590082+0000","last_undegraded":"2023-11-04T01:41:56.590082+0000","last_fullsized":"2023-11-04T01:41:56.590082+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:49.436809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589399+0000","last_change":"2023-11-04T01:41:54.083191+0000","last_active":"2023-11-04T01:41:56.589399+0000","last_peered":"2023-11-04T01:41:56.589399+0000","last_clean":"2023-11-04T01:41:56.589399+0000","last_became_active":"2023-11-04T01:41:54.082930+0000","last_became_peered":"2023-11-04T01:41:54.082930+0000","last_unstale":"2023-11-04T01:41:56.589399+0000","last_undegraded":"2023-11-04T01:41:56.589399+0000","last_fullsized":"2023-11-04T01:41:56.589399+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:15:56.008303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590795+0000","last_change":"2023-11-04T01:41:54.088423+0000","last_active":"2023-11-04T01:41:56.590795+0000","last_peered":"2023-11-04T01:41:56.590795+0000","last_clean":"2023-11-04T01:41:56.590795+0000","last_became_active":"2023-11-04T01:41:54.088154+0000","last_became_peered":"2023-11-04T01:41:54.088154+0000","last_unstale":"2023-11-04T01:41:56.590795+0000","last_undegraded":"2023-11-04T01:41:56.590795+0000","last_fullsized":"2023-11-04T01:41:56.590795+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:47:50.594104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085545+0000","last_change":"2023-11-04T01:41:54.081291+0000","last_active":"2023-11-04T01:41:55.085545+0000","last_peered":"2023-11-04T01:41:55.085545+0000","last_clean":"2023-11-04T01:41:55.085545+0000","last_became_active":"2023-11-04T01:41:54.080954+0000","last_became_peered":"2023-11-04T01:41:54.080954+0000","last_unstale":"2023-11-04T01:41:55.085545+0000","last_undegraded":"2023-11-04T01:41:55.085545+0000","last_fullsized":"2023-11-04T01:41:55.085545+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:37:37.857295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589322+0000","last_change":"2023-11-04T01:41:54.085418+0000","last_active":"2023-11-04T01:41:56.589322+0000","last_peered":"2023-11-04T01:41:56.589322+0000","last_clean":"2023-11-04T01:41:56.589322+0000","last_became_active":"2023-11-04T01:41:54.084970+0000","last_became_peered":"2023-11-04T01:41:54.084970+0000","last_unstale":"2023-11-04T01:41:56.589322+0000","last_undegraded":"2023-11-04T01:41:56.589322+0000","last_fullsized":"2023-11-04T01:41:56.589322+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:32:39.225407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589155+0000","last_change":"2023-11-04T01:41:54.091099+0000","last_active":"2023-11-04T01:41:56.589155+0000","last_peered":"2023-11-04T01:41:56.589155+0000","last_clean":"2023-11-04T01:41:56.589155+0000","last_became_active":"2023-11-04T01:41:54.088304+0000","last_became_peered":"2023-11-04T01:41:54.088304+0000","last_unstale":"2023-11-04T01:41:56.589155+0000","last_undegraded":"2023-11-04T01:41:56.589155+0000","last_fullsized":"2023-11-04T01:41:56.589155+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:48:32.480005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085743+0000","last_change":"2023-11-04T01:41:54.076985+0000","last_active":"2023-11-04T01:41:55.085743+0000","last_peered":"2023-11-04T01:41:55.085743+0000","last_clean":"2023-11-04T01:41:55.085743+0000","last_became_active":"2023-11-04T01:41:54.076693+0000","last_became_peered":"2023-11-04T01:41:54.076693+0000","last_unstale":"2023-11-04T01:41:55.085743+0000","last_undegraded":"2023-11-04T01:41:55.085743+0000","last_fullsized":"2023-11-04T01:41:55.085743+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:09:05.963500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.331092+0000","last_change":"2023-11-04T01:41:53.075915+0000","last_active":"2023-11-04T01:41:56.331092+0000","last_peered":"2023-11-04T01:41:56.331092+0000","last_clean":"2023-11-04T01:41:56.331092+0000","last_became_active":"2023-11-04T01:41:53.075655+0000","last_became_peered":"2023-11-04T01:41:53.075655+0000","last_unstale":"2023-11-04T01:41:56.331092+0000","last_undegraded":"2023-11-04T01:41:56.331092+0000","last_fullsized":"2023-11-04T01:41:56.331092+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:52:08.757521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.069885+0000","last_change":"2023-11-04T01:41:36.067943+0000","last_active":"2023-11-04T01:41:54.069885+0000","last_peered":"2023-11-04T01:41:54.069885+0000","last_clean":"2023-11-04T01:41:54.069885+0000","last_became_active":"2023-11-04T01:41:34.734305+0000","last_became_peered":"2023-11-04T01:41:34.734305+0000","last_unstale":"2023-11-04T01:41:54.069885+0000","last_undegraded":"2023-11-04T01:41:54.069885+0000","last_fullsized":"2023-11-04T01:41:54.069885+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:48.121273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033780399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.084585+0000","last_change":"2023-11-04T01:41:54.091465+0000","last_active":"2023-11-04T01:41:55.084585+0000","last_peered":"2023-11-04T01:41:55.084585+0000","last_clean":"2023-11-04T01:41:55.084585+0000","last_became_active":"2023-11-04T01:41:54.090588+0000","last_became_peered":"2023-11-04T01:41:54.090588+0000","last_unstale":"2023-11-04T01:41:55.084585+0000","last_undegraded":"2023-11-04T01:41:55.084585+0000","last_fullsized":"2023-11-04T01:41:55.084585+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:46:28.222652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590684+0000","last_change":"2023-11-04T01:41:53.080156+0000","last_active":"2023-11-04T01:41:56.590684+0000","last_peered":"2023-11-04T01:41:56.590684+0000","last_clean":"2023-11-04T01:41:56.590684+0000","last_became_active":"2023-11-04T01:41:53.079885+0000","last_became_peered":"2023-11-04T01:41:53.079885+0000","last_unstale":"2023-11-04T01:41:56.590684+0000","last_undegraded":"2023-11-04T01:41:56.590684+0000","last_fullsized":"2023-11-04T01:41:56.590684+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:59:01.361687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":25,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.075075+0000","last_change":"2023-11-04T01:41:35.728832+0000","last_active":"2023-11-04T01:41:54.075075+0000","last_peered":"2023-11-04T01:41:54.075075+0000","last_clean":"2023-11-04T01:41:54.075075+0000","last_became_active":"2023-11-04T01:41:34.733517+0000","last_became_peered":"2023-11-04T01:41:34.733517+0000","last_unstale":"2023-11-04T01:41:54.075075+0000","last_undegraded":"2023-11-04T01:41:54.075075+0000","last_fullsized":"2023-11-04T01:41:54.075075+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:19.350812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042545700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085411+0000","last_change":"2023-11-04T01:41:54.081783+0000","last_active":"2023-11-04T01:41:55.085411+0000","last_peered":"2023-11-04T01:41:55.085411+0000","last_clean":"2023-11-04T01:41:55.085411+0000","last_became_active":"2023-11-04T01:41:54.081475+0000","last_became_peered":"2023-11-04T01:41:54.081475+0000","last_unstale":"2023-11-04T01:41:55.085411+0000","last_undegraded":"2023-11-04T01:41:55.085411+0000","last_fullsized":"2023-11-04T01:41:55.085411+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:48:32.480005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"53'8","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085700+0000","last_change":"2023-11-04T01:41:53.080511+0000","last_active":"2023-11-04T01:41:55.085700+0000","last_peered":"2023-11-04T01:41:55.085700+0000","last_clean":"2023-11-04T01:41:55.085700+0000","last_became_active":"2023-11-04T01:41:53.080220+0000","last_became_peered":"2023-11-04T01:41:53.080220+0000","last_unstale":"2023-11-04T01:41:55.085700+0000","last_undegraded":"2023-11-04T01:41:55.085700+0000","last_fullsized":"2023-11-04T01:41:55.085700+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:13.509937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":25,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.074083+0000","last_change":"2023-11-04T01:41:35.906660+0000","last_active":"2023-11-04T01:41:54.074083+0000","last_peered":"2023-11-04T01:41:54.074083+0000","last_clean":"2023-11-04T01:41:54.074083+0000","last_became_active":"2023-11-04T01:41:34.737209+0000","last_became_peered":"2023-11-04T01:41:34.737209+0000","last_unstale":"2023-11-04T01:41:54.074083+0000","last_undegraded":"2023-11-04T01:41:54.074083+0000","last_fullsized":"2023-11-04T01:41:54.074083+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:59.608410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068889500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589173+0000","last_change":"2023-11-04T01:41:54.075813+0000","last_active":"2023-11-04T01:41:56.589173+0000","last_peered":"2023-11-04T01:41:56.589173+0000","last_clean":"2023-11-04T01:41:56.589173+0000","last_became_active":"2023-11-04T01:41:54.071739+0000","last_became_peered":"2023-11-04T01:41:54.071739+0000","last_unstale":"2023-11-04T01:41:56.589173+0000","last_undegraded":"2023-11-04T01:41:56.589173+0000","last_fullsized":"2023-11-04T01:41:56.589173+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:58.634155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.074643+0000","last_change":"2023-11-04T01:41:53.077563+0000","last_active":"2023-11-04T01:41:54.074643+0000","last_peered":"2023-11-04T01:41:54.074643+0000","last_clean":"2023-11-04T01:41:54.074643+0000","last_became_active":"2023-11-04T01:41:53.077282+0000","last_became_peered":"2023-11-04T01:41:53.077282+0000","last_unstale":"2023-11-04T01:41:54.074643+0000","last_undegraded":"2023-11-04T01:41:54.074643+0000","last_fullsized":"2023-11-04T01:41:54.074643+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:26:30.691165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.069241+0000","last_change":"2023-11-04T01:41:36.067946+0000","last_active":"2023-11-04T01:41:54.069241+0000","last_peered":"2023-11-04T01:41:54.069241+0000","last_clean":"2023-11-04T01:41:54.069241+0000","last_became_active":"2023-11-04T01:41:34.729591+0000","last_became_peered":"2023-11-04T01:41:34.729591+0000","last_unstale":"2023-11-04T01:41:54.069241+0000","last_undegraded":"2023-11-04T01:41:54.069241+0000","last_fullsized":"2023-11-04T01:41:54.069241+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:59.608410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032681099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.086199+0000","last_change":"2023-11-04T01:41:54.083870+0000","last_active":"2023-11-04T01:41:55.086199+0000","last_peered":"2023-11-04T01:41:55.086199+0000","last_clean":"2023-11-04T01:41:55.086199+0000","last_became_active":"2023-11-04T01:41:54.083604+0000","last_became_peered":"2023-11-04T01:41:54.083604+0000","last_unstale":"2023-11-04T01:41:55.086199+0000","last_undegraded":"2023-11-04T01:41:55.086199+0000","last_fullsized":"2023-11-04T01:41:55.086199+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:02:33.389340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590318+0000","last_change":"2023-11-04T01:41:53.079881+0000","last_active":"2023-11-04T01:41:56.590318+0000","last_peered":"2023-11-04T01:41:56.590318+0000","last_clean":"2023-11-04T01:41:56.590318+0000","last_became_active":"2023-11-04T01:41:53.079530+0000","last_became_peered":"2023-11-04T01:41:53.079530+0000","last_unstale":"2023-11-04T01:41:56.590318+0000","last_undegraded":"2023-11-04T01:41:56.590318+0000","last_fullsized":"2023-11-04T01:41:56.590318+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:48:31.473075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":25,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.073242+0000","last_change":"2023-11-04T01:41:35.905999+0000","last_active":"2023-11-04T01:41:54.073242+0000","last_peered":"2023-11-04T01:41:54.073242+0000","last_clean":"2023-11-04T01:41:54.073242+0000","last_became_active":"2023-11-04T01:41:34.735286+0000","last_became_peered":"2023-11-04T01:41:34.735286+0000","last_unstale":"2023-11-04T01:41:54.073242+0000","last_undegraded":"2023-11-04T01:41:54.073242+0000","last_fullsized":"2023-11-04T01:41:54.073242+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:14:22.019781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051880100000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589638+0000","last_change":"2023-11-04T01:41:54.072933+0000","last_active":"2023-11-04T01:41:56.589638+0000","last_peered":"2023-11-04T01:41:56.589638+0000","last_clean":"2023-11-04T01:41:56.589638+0000","last_became_active":"2023-11-04T01:41:54.072650+0000","last_became_peered":"2023-11-04T01:41:54.072650+0000","last_unstale":"2023-11-04T01:41:56.589638+0000","last_undegraded":"2023-11-04T01:41:56.589638+0000","last_fullsized":"2023-11-04T01:41:56.589638+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:32:36.620521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.086308+0000","last_change":"2023-11-04T01:41:53.078747+0000","last_active":"2023-11-04T01:41:55.086308+0000","last_peered":"2023-11-04T01:41:55.086308+0000","last_clean":"2023-11-04T01:41:55.086308+0000","last_became_active":"2023-11-04T01:41:53.078478+0000","last_became_peered":"2023-11-04T01:41:53.078478+0000","last_unstale":"2023-11-04T01:41:55.086308+0000","last_undegraded":"2023-11-04T01:41:55.086308+0000","last_fullsized":"2023-11-04T01:41:55.086308+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:04.784101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.073488+0000","last_change":"2023-11-04T01:41:36.344205+0000","last_active":"2023-11-04T01:41:54.073488+0000","last_peered":"2023-11-04T01:41:54.073488+0000","last_clean":"2023-11-04T01:41:54.073488+0000","last_became_active":"2023-11-04T01:41:34.733205+0000","last_became_peered":"2023-11-04T01:41:34.733205+0000","last_unstale":"2023-11-04T01:41:54.073488+0000","last_undegraded":"2023-11-04T01:41:54.073488+0000","last_fullsized":"2023-11-04T01:41:54.073488+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:37.958719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011584760000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.086040+0000","last_change":"2023-11-04T01:41:54.084896+0000","last_active":"2023-11-04T01:41:55.086040+0000","last_peered":"2023-11-04T01:41:55.086040+0000","last_clean":"2023-11-04T01:41:55.086040+0000","last_became_active":"2023-11-04T01:41:54.084420+0000","last_became_peered":"2023-11-04T01:41:54.084420+0000","last_unstale":"2023-11-04T01:41:55.086040+0000","last_undegraded":"2023-11-04T01:41:55.086040+0000","last_fullsized":"2023-11-04T01:41:55.086040+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:19:37.120155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"53'6","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589458+0000","last_change":"2023-11-04T01:41:53.083938+0000","last_active":"2023-11-04T01:41:56.589458+0000","last_peered":"2023-11-04T01:41:56.589458+0000","last_clean":"2023-11-04T01:41:56.589458+0000","last_became_active":"2023-11-04T01:41:53.083642+0000","last_became_peered":"2023-11-04T01:41:53.083642+0000","last_unstale":"2023-11-04T01:41:56.589458+0000","last_undegraded":"2023-11-04T01:41:56.589458+0000","last_fullsized":"2023-11-04T01:41:56.589458+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:32:44.078800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.074562+0000","last_change":"2023-11-04T01:41:36.343728+0000","last_active":"2023-11-04T01:41:54.074562+0000","last_peered":"2023-11-04T01:41:54.074562+0000","last_clean":"2023-11-04T01:41:54.074562+0000","last_became_active":"2023-11-04T01:41:34.731106+0000","last_became_peered":"2023-11-04T01:41:34.731106+0000","last_unstale":"2023-11-04T01:41:54.074562+0000","last_undegraded":"2023-11-04T01:41:54.074562+0000","last_fullsized":"2023-11-04T01:41:54.074562+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:29.730483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058974500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.081479+0000","last_change":"2023-11-04T01:41:54.081291+0000","last_active":"2023-11-04T01:41:55.081479+0000","last_peered":"2023-11-04T01:41:55.081479+0000","last_clean":"2023-11-04T01:41:55.081479+0000","last_became_active":"2023-11-04T01:41:54.080945+0000","last_became_peered":"2023-11-04T01:41:54.080945+0000","last_unstale":"2023-11-04T01:41:55.081479+0000","last_undegraded":"2023-11-04T01:41:55.081479+0000","last_fullsized":"2023-11-04T01:41:55.081479+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:14.516867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"53'3","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085870+0000","last_change":"2023-11-04T01:41:53.074957+0000","last_active":"2023-11-04T01:41:55.085870+0000","last_peered":"2023-11-04T01:41:55.085870+0000","last_clean":"2023-11-04T01:41:55.085870+0000","last_became_active":"2023-11-04T01:41:53.074592+0000","last_became_peered":"2023-11-04T01:41:53.074592+0000","last_unstale":"2023-11-04T01:41:55.085870+0000","last_undegraded":"2023-11-04T01:41:55.085870+0000","last_fullsized":"2023-11-04T01:41:55.085870+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:16:02.695774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.068227+0000","last_change":"2023-11-04T01:41:35.931778+0000","last_active":"2023-11-04T01:41:54.068227+0000","last_peered":"2023-11-04T01:41:54.068227+0000","last_clean":"2023-11-04T01:41:54.068227+0000","last_became_active":"2023-11-04T01:41:34.736897+0000","last_became_peered":"2023-11-04T01:41:34.736897+0000","last_unstale":"2023-11-04T01:41:54.068227+0000","last_undegraded":"2023-11-04T01:41:54.068227+0000","last_fullsized":"2023-11-04T01:41:54.068227+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:20.089706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071523300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590552+0000","last_change":"2023-11-04T01:41:54.095817+0000","last_active":"2023-11-04T01:41:56.590552+0000","last_peered":"2023-11-04T01:41:56.590552+0000","last_clean":"2023-11-04T01:41:56.590552+0000","last_became_active":"2023-11-04T01:41:54.095553+0000","last_became_peered":"2023-11-04T01:41:54.095553+0000","last_unstale":"2023-11-04T01:41:56.590552+0000","last_undegraded":"2023-11-04T01:41:56.590552+0000","last_fullsized":"2023-11-04T01:41:56.590552+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:20:20.327739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590036+0000","last_change":"2023-11-04T01:41:53.077055+0000","last_active":"2023-11-04T01:41:56.590036+0000","last_peered":"2023-11-04T01:41:56.590036+0000","last_clean":"2023-11-04T01:41:56.590036+0000","last_became_active":"2023-11-04T01:41:53.076780+0000","last_became_peered":"2023-11-04T01:41:53.076780+0000","last_unstale":"2023-11-04T01:41:56.590036+0000","last_undegraded":"2023-11-04T01:41:56.590036+0000","last_fullsized":"2023-11-04T01:41:56.590036+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:31:22.001930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.069729+0000","last_change":"2023-11-04T01:41:35.729017+0000","last_active":"2023-11-04T01:41:54.069729+0000","last_peered":"2023-11-04T01:41:54.069729+0000","last_clean":"2023-11-04T01:41:54.069729+0000","last_became_active":"2023-11-04T01:41:34.730592+0000","last_became_peered":"2023-11-04T01:41:34.730592+0000","last_unstale":"2023-11-04T01:41:54.069729+0000","last_undegraded":"2023-11-04T01:41:54.069729+0000","last_fullsized":"2023-11-04T01:41:54.069729+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:08.858430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088820999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590990+0000","last_change":"2023-11-04T01:41:54.084606+0000","last_active":"2023-11-04T01:41:56.590990+0000","last_peered":"2023-11-04T01:41:56.590990+0000","last_clean":"2023-11-04T01:41:56.590990+0000","last_became_active":"2023-11-04T01:41:54.084326+0000","last_became_peered":"2023-11-04T01:41:54.084326+0000","last_unstale":"2023-11-04T01:41:56.590990+0000","last_undegraded":"2023-11-04T01:41:56.590990+0000","last_fullsized":"2023-11-04T01:41:56.590990+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:32:29.239625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589317+0000","last_change":"2023-11-04T01:41:53.084252+0000","last_active":"2023-11-04T01:41:56.589317+0000","last_peered":"2023-11-04T01:41:56.589317+0000","last_clean":"2023-11-04T01:41:56.589317+0000","last_became_active":"2023-11-04T01:41:53.083948+0000","last_became_peered":"2023-11-04T01:41:53.083948+0000","last_unstale":"2023-11-04T01:41:56.589317+0000","last_undegraded":"2023-11-04T01:41:56.589317+0000","last_fullsized":"2023-11-04T01:41:56.589317+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:57:41.648340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.077144+0000","last_change":"2023-11-04T01:41:35.729378+0000","last_active":"2023-11-04T01:41:54.077144+0000","last_peered":"2023-11-04T01:41:54.077144+0000","last_clean":"2023-11-04T01:41:54.077144+0000","last_became_active":"2023-11-04T01:41:34.730387+0000","last_became_peered":"2023-11-04T01:41:34.730387+0000","last_unstale":"2023-11-04T01:41:54.077144+0000","last_undegraded":"2023-11-04T01:41:54.077144+0000","last_fullsized":"2023-11-04T01:41:54.077144+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:12.653602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072268699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590186+0000","last_change":"2023-11-04T01:41:54.084539+0000","last_active":"2023-11-04T01:41:56.590186+0000","last_peered":"2023-11-04T01:41:56.590186+0000","last_clean":"2023-11-04T01:41:56.590186+0000","last_became_active":"2023-11-04T01:41:54.084254+0000","last_became_peered":"2023-11-04T01:41:54.084254+0000","last_unstale":"2023-11-04T01:41:56.590186+0000","last_undegraded":"2023-11-04T01:41:56.590186+0000","last_fullsized":"2023-11-04T01:41:56.590186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:15.904826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589151+0000","last_change":"2023-11-04T01:41:53.083914+0000","last_active":"2023-11-04T01:41:56.589151+0000","last_peered":"2023-11-04T01:41:56.589151+0000","last_clean":"2023-11-04T01:41:56.589151+0000","last_became_active":"2023-11-04T01:41:53.083658+0000","last_became_peered":"2023-11-04T01:41:53.083658+0000","last_unstale":"2023-11-04T01:41:56.589151+0000","last_undegraded":"2023-11-04T01:41:56.589151+0000","last_fullsized":"2023-11-04T01:41:56.589151+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:35:19.471505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.069646+0000","last_change":"2023-11-04T01:41:35.729318+0000","last_active":"2023-11-04T01:41:54.069646+0000","last_peered":"2023-11-04T01:41:54.069646+0000","last_clean":"2023-11-04T01:41:54.069646+0000","last_became_active":"2023-11-04T01:41:34.733796+0000","last_became_peered":"2023-11-04T01:41:34.733796+0000","last_unstale":"2023-11-04T01:41:54.069646+0000","last_undegraded":"2023-11-04T01:41:54.069646+0000","last_fullsized":"2023-11-04T01:41:54.069646+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:19.350812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053712200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.331250+0000","last_change":"2023-11-04T01:41:54.082009+0000","last_active":"2023-11-04T01:41:56.331250+0000","last_peered":"2023-11-04T01:41:56.331250+0000","last_clean":"2023-11-04T01:41:56.331250+0000","last_became_active":"2023-11-04T01:41:54.081727+0000","last_became_peered":"2023-11-04T01:41:54.081727+0000","last_unstale":"2023-11-04T01:41:56.331250+0000","last_undegraded":"2023-11-04T01:41:56.331250+0000","last_fullsized":"2023-11-04T01:41:56.331250+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:32.004830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.074695+0000","last_change":"2023-11-04T01:41:53.077862+0000","last_active":"2023-11-04T01:41:54.074695+0000","last_peered":"2023-11-04T01:41:54.074695+0000","last_clean":"2023-11-04T01:41:54.074695+0000","last_became_active":"2023-11-04T01:41:53.077454+0000","last_became_peered":"2023-11-04T01:41:53.077454+0000","last_unstale":"2023-11-04T01:41:54.074695+0000","last_undegraded":"2023-11-04T01:41:54.074695+0000","last_fullsized":"2023-11-04T01:41:54.074695+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:13:12.033711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.067806+0000","last_change":"2023-11-04T01:41:35.931929+0000","last_active":"2023-11-04T01:41:54.067806+0000","last_peered":"2023-11-04T01:41:54.067806+0000","last_clean":"2023-11-04T01:41:54.067806+0000","last_became_active":"2023-11-04T01:41:34.738795+0000","last_became_peered":"2023-11-04T01:41:34.738795+0000","last_unstale":"2023-11-04T01:41:54.067806+0000","last_undegraded":"2023-11-04T01:41:54.067806+0000","last_fullsized":"2023-11-04T01:41:54.067806+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:59.608410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046204999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.081684+0000","last_change":"2023-11-04T01:41:54.082457+0000","last_active":"2023-11-04T01:41:55.081684+0000","last_peered":"2023-11-04T01:41:55.081684+0000","last_clean":"2023-11-04T01:41:55.081684+0000","last_became_active":"2023-11-04T01:41:54.082130+0000","last_became_peered":"2023-11-04T01:41:54.082130+0000","last_unstale":"2023-11-04T01:41:55.081684+0000","last_undegraded":"2023-11-04T01:41:55.081684+0000","last_fullsized":"2023-11-04T01:41:55.081684+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:13:17.472616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590239+0000","last_change":"2023-11-04T01:41:53.076199+0000","last_active":"2023-11-04T01:41:56.590239+0000","last_peered":"2023-11-04T01:41:56.590239+0000","last_clean":"2023-11-04T01:41:56.590239+0000","last_became_active":"2023-11-04T01:41:53.075934+0000","last_became_peered":"2023-11-04T01:41:53.075934+0000","last_unstale":"2023-11-04T01:41:56.590239+0000","last_undegraded":"2023-11-04T01:41:56.590239+0000","last_fullsized":"2023-11-04T01:41:56.590239+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:51.200899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.069062+0000","last_change":"2023-11-04T01:41:35.728945+0000","last_active":"2023-11-04T01:41:54.069062+0000","last_peered":"2023-11-04T01:41:54.069062+0000","last_clean":"2023-11-04T01:41:54.069062+0000","last_became_active":"2023-11-04T01:41:34.735082+0000","last_became_peered":"2023-11-04T01:41:34.735082+0000","last_unstale":"2023-11-04T01:41:54.069062+0000","last_undegraded":"2023-11-04T01:41:54.069062+0000","last_fullsized":"2023-11-04T01:41:54.069062+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:16.970814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079093000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590578+0000","last_change":"2023-11-04T01:41:54.088881+0000","last_active":"2023-11-04T01:41:56.590578+0000","last_peered":"2023-11-04T01:41:56.590578+0000","last_clean":"2023-11-04T01:41:56.590578+0000","last_became_active":"2023-11-04T01:41:54.088232+0000","last_became_peered":"2023-11-04T01:41:54.088232+0000","last_unstale":"2023-11-04T01:41:56.590578+0000","last_undegraded":"2023-11-04T01:41:56.590578+0000","last_fullsized":"2023-11-04T01:41:56.590578+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:49:12.341595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"53'4","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590791+0000","last_change":"2023-11-04T01:41:53.080523+0000","last_active":"2023-11-04T01:41:56.590791+0000","last_peered":"2023-11-04T01:41:56.590791+0000","last_clean":"2023-11-04T01:41:56.590791+0000","last_became_active":"2023-11-04T01:41:53.080094+0000","last_became_peered":"2023-11-04T01:41:53.080094+0000","last_unstale":"2023-11-04T01:41:56.590791+0000","last_undegraded":"2023-11-04T01:41:56.590791+0000","last_fullsized":"2023-11-04T01:41:56.590791+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:46:27.215722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.073803+0000","last_change":"2023-11-04T01:41:35.728625+0000","last_active":"2023-11-04T01:41:54.073803+0000","last_peered":"2023-11-04T01:41:54.073803+0000","last_clean":"2023-11-04T01:41:54.073803+0000","last_became_active":"2023-11-04T01:41:34.731514+0000","last_became_peered":"2023-11-04T01:41:34.731514+0000","last_unstale":"2023-11-04T01:41:54.073803+0000","last_undegraded":"2023-11-04T01:41:54.073803+0000","last_fullsized":"2023-11-04T01:41:54.073803+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:51:50.413223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047686400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590191+0000","last_change":"2023-11-04T01:41:54.089484+0000","last_active":"2023-11-04T01:41:56.590191+0000","last_peered":"2023-11-04T01:41:56.590191+0000","last_clean":"2023-11-04T01:41:56.590191+0000","last_became_active":"2023-11-04T01:41:54.087702+0000","last_became_peered":"2023-11-04T01:41:54.087702+0000","last_unstale":"2023-11-04T01:41:56.590191+0000","last_undegraded":"2023-11-04T01:41:56.590191+0000","last_fullsized":"2023-11-04T01:41:56.590191+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:19:37.120155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"53'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.097178+0000","last_change":"2023-11-04T01:41:53.081291+0000","last_active":"2023-11-04T01:41:54.097178+0000","last_peered":"2023-11-04T01:41:54.097178+0000","last_clean":"2023-11-04T01:41:54.097178+0000","last_became_active":"2023-11-04T01:41:53.080917+0000","last_became_peered":"2023-11-04T01:41:53.080917+0000","last_unstale":"2023-11-04T01:41:54.097178+0000","last_undegraded":"2023-11-04T01:41:54.097178+0000","last_fullsized":"2023-11-04T01:41:54.097178+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:53:25.375890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.074641+0000","last_change":"2023-11-04T01:41:36.343762+0000","last_active":"2023-11-04T01:41:54.074641+0000","last_peered":"2023-11-04T01:41:54.074641+0000","last_clean":"2023-11-04T01:41:54.074641+0000","last_became_active":"2023-11-04T01:41:34.733406+0000","last_became_peered":"2023-11-04T01:41:34.733406+0000","last_unstale":"2023-11-04T01:41:54.074641+0000","last_undegraded":"2023-11-04T01:41:54.074641+0000","last_fullsized":"2023-11-04T01:41:54.074641+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:34:35.541159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058533399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590368+0000","last_change":"2023-11-04T01:41:54.087274+0000","last_active":"2023-11-04T01:41:56.590368+0000","last_peered":"2023-11-04T01:41:56.590368+0000","last_clean":"2023-11-04T01:41:56.590368+0000","last_became_active":"2023-11-04T01:41:54.087015+0000","last_became_peered":"2023-11-04T01:41:54.087015+0000","last_unstale":"2023-11-04T01:41:56.590368+0000","last_undegraded":"2023-11-04T01:41:56.590368+0000","last_fullsized":"2023-11-04T01:41:56.590368+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:59:02.368617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590382+0000","last_change":"2023-11-04T01:41:53.078589+0000","last_active":"2023-11-04T01:41:56.590382+0000","last_peered":"2023-11-04T01:41:56.590382+0000","last_clean":"2023-11-04T01:41:56.590382+0000","last_became_active":"2023-11-04T01:41:53.078299+0000","last_became_peered":"2023-11-04T01:41:53.078299+0000","last_unstale":"2023-11-04T01:41:56.590382+0000","last_undegraded":"2023-11-04T01:41:56.590382+0000","last_fullsized":"2023-11-04T01:41:56.590382+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:39:55.007483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":25,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.074298+0000","last_change":"2023-11-04T01:41:35.906297+0000","last_active":"2023-11-04T01:41:54.074298+0000","last_peered":"2023-11-04T01:41:54.074298+0000","last_clean":"2023-11-04T01:41:54.074298+0000","last_became_active":"2023-11-04T01:41:34.734134+0000","last_became_peered":"2023-11-04T01:41:34.734134+0000","last_unstale":"2023-11-04T01:41:54.074298+0000","last_undegraded":"2023-11-04T01:41:54.074298+0000","last_fullsized":"2023-11-04T01:41:54.074298+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:52.597063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087104900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085334+0000","last_change":"2023-11-04T01:41:54.088922+0000","last_active":"2023-11-04T01:41:55.085334+0000","last_peered":"2023-11-04T01:41:55.085334+0000","last_clean":"2023-11-04T01:41:55.085334+0000","last_became_active":"2023-11-04T01:41:54.088636+0000","last_became_peered":"2023-11-04T01:41:54.088636+0000","last_unstale":"2023-11-04T01:41:55.085334+0000","last_undegraded":"2023-11-04T01:41:55.085334+0000","last_fullsized":"2023-11-04T01:41:55.085334+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:52.207829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589388+0000","last_change":"2023-11-04T01:41:53.078664+0000","last_active":"2023-11-04T01:41:56.589388+0000","last_peered":"2023-11-04T01:41:56.589388+0000","last_clean":"2023-11-04T01:41:56.589388+0000","last_became_active":"2023-11-04T01:41:53.078411+0000","last_became_peered":"2023-11-04T01:41:53.078411+0000","last_unstale":"2023-11-04T01:41:56.589388+0000","last_undegraded":"2023-11-04T01:41:56.589388+0000","last_fullsized":"2023-11-04T01:41:56.589388+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:30.997900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":25,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.073574+0000","last_change":"2023-11-04T01:41:35.906596+0000","last_active":"2023-11-04T01:41:54.073574+0000","last_peered":"2023-11-04T01:41:54.073574+0000","last_clean":"2023-11-04T01:41:54.073574+0000","last_became_active":"2023-11-04T01:41:34.738529+0000","last_became_peered":"2023-11-04T01:41:34.738529+0000","last_unstale":"2023-11-04T01:41:54.073574+0000","last_undegraded":"2023-11-04T01:41:54.073574+0000","last_fullsized":"2023-11-04T01:41:54.073574+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:48.121273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086660600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590979+0000","last_change":"2023-11-04T01:41:54.091537+0000","last_active":"2023-11-04T01:41:56.590979+0000","last_peered":"2023-11-04T01:41:56.590979+0000","last_clean":"2023-11-04T01:41:56.590979+0000","last_became_active":"2023-11-04T01:41:54.091084+0000","last_became_peered":"2023-11-04T01:41:54.091084+0000","last_unstale":"2023-11-04T01:41:56.590979+0000","last_undegraded":"2023-11-04T01:41:56.590979+0000","last_fullsized":"2023-11-04T01:41:56.590979+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:16:45.397776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.068971+0000","last_change":"2023-11-04T01:41:53.075392+0000","last_active":"2023-11-04T01:41:54.068971+0000","last_peered":"2023-11-04T01:41:54.068971+0000","last_clean":"2023-11-04T01:41:54.068971+0000","last_became_active":"2023-11-04T01:41:53.075123+0000","last_became_peered":"2023-11-04T01:41:53.075123+0000","last_unstale":"2023-11-04T01:41:54.068971+0000","last_undegraded":"2023-11-04T01:41:54.068971+0000","last_fullsized":"2023-11-04T01:41:54.068971+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:11:16.439530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":25,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.073477+0000","last_change":"2023-11-04T01:41:35.906430+0000","last_active":"2023-11-04T01:41:54.073477+0000","last_peered":"2023-11-04T01:41:54.073477+0000","last_clean":"2023-11-04T01:41:54.073477+0000","last_became_active":"2023-11-04T01:41:34.741147+0000","last_became_peered":"2023-11-04T01:41:34.741147+0000","last_unstale":"2023-11-04T01:41:54.073477+0000","last_undegraded":"2023-11-04T01:41:54.073477+0000","last_fullsized":"2023-11-04T01:41:54.073477+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:20.089706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090504400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590317+0000","last_change":"2023-11-04T01:41:54.082050+0000","last_active":"2023-11-04T01:41:56.590317+0000","last_peered":"2023-11-04T01:41:56.590317+0000","last_clean":"2023-11-04T01:41:56.590317+0000","last_became_active":"2023-11-04T01:41:54.081752+0000","last_became_peered":"2023-11-04T01:41:54.081752+0000","last_unstale":"2023-11-04T01:41:56.590317+0000","last_undegraded":"2023-11-04T01:41:56.590317+0000","last_fullsized":"2023-11-04T01:41:56.590317+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:43:37.855647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589527+0000","last_change":"2023-11-04T01:41:53.079896+0000","last_active":"2023-11-04T01:41:56.589527+0000","last_peered":"2023-11-04T01:41:56.589527+0000","last_clean":"2023-11-04T01:41:56.589527+0000","last_became_active":"2023-11-04T01:41:53.079540+0000","last_became_peered":"2023-11-04T01:41:53.079540+0000","last_unstale":"2023-11-04T01:41:56.589527+0000","last_undegraded":"2023-11-04T01:41:56.589527+0000","last_fullsized":"2023-11-04T01:41:56.589527+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:53:25.375890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.077435+0000","last_change":"2023-11-04T01:41:36.344408+0000","last_active":"2023-11-04T01:41:54.077435+0000","last_peered":"2023-11-04T01:41:54.077435+0000","last_clean":"2023-11-04T01:41:54.077435+0000","last_became_active":"2023-11-04T01:41:34.730735+0000","last_became_peered":"2023-11-04T01:41:34.730735+0000","last_unstale":"2023-11-04T01:41:54.077435+0000","last_undegraded":"2023-11-04T01:41:54.077435+0000","last_fullsized":"2023-11-04T01:41:54.077435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:10:58.095232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081464299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.081224+0000","last_change":"2023-11-04T01:41:54.075442+0000","last_active":"2023-11-04T01:41:55.081224+0000","last_peered":"2023-11-04T01:41:55.081224+0000","last_clean":"2023-11-04T01:41:55.081224+0000","last_became_active":"2023-11-04T01:41:54.075156+0000","last_became_peered":"2023-11-04T01:41:54.075156+0000","last_unstale":"2023-11-04T01:41:55.081224+0000","last_undegraded":"2023-11-04T01:41:55.081224+0000","last_fullsized":"2023-11-04T01:41:55.081224+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:58.634155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.069229+0000","last_change":"2023-11-04T01:41:53.077515+0000","last_active":"2023-11-04T01:41:54.069229+0000","last_peered":"2023-11-04T01:41:54.069229+0000","last_clean":"2023-11-04T01:41:54.069229+0000","last_became_active":"2023-11-04T01:41:53.077273+0000","last_became_peered":"2023-11-04T01:41:53.077273+0000","last_unstale":"2023-11-04T01:41:54.069229+0000","last_undegraded":"2023-11-04T01:41:54.069229+0000","last_fullsized":"2023-11-04T01:41:54.069229+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:02:25.529139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":28,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.076226+0000","last_change":"2023-11-04T01:41:36.244245+0000","last_active":"2023-11-04T01:41:54.076226+0000","last_peered":"2023-11-04T01:41:54.076226+0000","last_clean":"2023-11-04T01:41:54.076226+0000","last_became_active":"2023-11-04T01:41:34.734925+0000","last_became_peered":"2023-11-04T01:41:34.734925+0000","last_unstale":"2023-11-04T01:41:54.076226+0000","last_undegraded":"2023-11-04T01:41:54.076226+0000","last_fullsized":"2023-11-04T01:41:54.076226+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:44.193748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025350200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085360+0000","last_change":"2023-11-04T01:41:54.083519+0000","last_active":"2023-11-04T01:41:55.085360+0000","last_peered":"2023-11-04T01:41:55.085360+0000","last_clean":"2023-11-04T01:41:55.085360+0000","last_became_active":"2023-11-04T01:41:54.083263+0000","last_became_peered":"2023-11-04T01:41:54.083263+0000","last_unstale":"2023-11-04T01:41:55.085360+0000","last_undegraded":"2023-11-04T01:41:55.085360+0000","last_fullsized":"2023-11-04T01:41:55.085360+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:09:05.963500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590649+0000","last_change":"2023-11-04T01:41:53.076654+0000","last_active":"2023-11-04T01:41:56.590649+0000","last_peered":"2023-11-04T01:41:56.590649+0000","last_clean":"2023-11-04T01:41:56.590649+0000","last_became_active":"2023-11-04T01:41:53.076139+0000","last_became_peered":"2023-11-04T01:41:53.076139+0000","last_unstale":"2023-11-04T01:41:56.590649+0000","last_undegraded":"2023-11-04T01:41:56.590649+0000","last_fullsized":"2023-11-04T01:41:56.590649+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:12:15.708878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.074053+0000","last_change":"2023-11-04T01:41:36.343956+0000","last_active":"2023-11-04T01:41:54.074053+0000","last_peered":"2023-11-04T01:41:54.074053+0000","last_clean":"2023-11-04T01:41:54.074053+0000","last_became_active":"2023-11-04T01:41:34.736013+0000","last_became_peered":"2023-11-04T01:41:34.736013+0000","last_unstale":"2023-11-04T01:41:54.074053+0000","last_undegraded":"2023-11-04T01:41:54.074053+0000","last_fullsized":"2023-11-04T01:41:54.074053+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:08.858430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081427799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085146+0000","last_change":"2023-11-04T01:41:54.084395+0000","last_active":"2023-11-04T01:41:55.085146+0000","last_peered":"2023-11-04T01:41:55.085146+0000","last_clean":"2023-11-04T01:41:55.085146+0000","last_became_active":"2023-11-04T01:41:54.084122+0000","last_became_peered":"2023-11-04T01:41:54.084122+0000","last_unstale":"2023-11-04T01:41:55.085146+0000","last_undegraded":"2023-11-04T01:41:55.085146+0000","last_fullsized":"2023-11-04T01:41:55.085146+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:37:37.857295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"53'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.099893+0000","last_change":"2023-11-04T01:41:53.076436+0000","last_active":"2023-11-04T01:41:54.099893+0000","last_peered":"2023-11-04T01:41:54.099893+0000","last_clean":"2023-11-04T01:41:54.099893+0000","last_became_active":"2023-11-04T01:41:53.076135+0000","last_became_peered":"2023-11-04T01:41:53.076135+0000","last_unstale":"2023-11-04T01:41:54.099893+0000","last_undegraded":"2023-11-04T01:41:54.099893+0000","last_fullsized":"2023-11-04T01:41:54.099893+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:32:44.078800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":28,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.073122+0000","last_change":"2023-11-04T01:41:36.243977+0000","last_active":"2023-11-04T01:41:54.073122+0000","last_peered":"2023-11-04T01:41:54.073122+0000","last_clean":"2023-11-04T01:41:54.073122+0000","last_became_active":"2023-11-04T01:41:34.733127+0000","last_became_peered":"2023-11-04T01:41:34.733127+0000","last_unstale":"2023-11-04T01:41:54.073122+0000","last_undegraded":"2023-11-04T01:41:54.073122+0000","last_fullsized":"2023-11-04T01:41:54.073122+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:36.118907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051788300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590302+0000","last_change":"2023-11-04T01:41:54.089679+0000","last_active":"2023-11-04T01:41:56.590302+0000","last_peered":"2023-11-04T01:41:56.590302+0000","last_clean":"2023-11-04T01:41:56.590302+0000","last_became_active":"2023-11-04T01:41:54.087983+0000","last_became_peered":"2023-11-04T01:41:54.087983+0000","last_unstale":"2023-11-04T01:41:56.590302+0000","last_undegraded":"2023-11-04T01:41:56.590302+0000","last_fullsized":"2023-11-04T01:41:56.590302+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:02:33.389340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.074953+0000","last_change":"2023-11-04T01:41:53.077963+0000","last_active":"2023-11-04T01:41:54.074953+0000","last_peered":"2023-11-04T01:41:54.074953+0000","last_clean":"2023-11-04T01:41:54.074953+0000","last_became_active":"2023-11-04T01:41:53.077696+0000","last_became_peered":"2023-11-04T01:41:53.077696+0000","last_unstale":"2023-11-04T01:41:54.074953+0000","last_undegraded":"2023-11-04T01:41:54.074953+0000","last_fullsized":"2023-11-04T01:41:54.074953+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:12:15.708878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.069594+0000","last_change":"2023-11-04T01:41:36.067797+0000","last_active":"2023-11-04T01:41:54.069594+0000","last_peered":"2023-11-04T01:41:54.069594+0000","last_clean":"2023-11-04T01:41:54.069594+0000","last_became_active":"2023-11-04T01:41:34.734880+0000","last_became_peered":"2023-11-04T01:41:34.734880+0000","last_unstale":"2023-11-04T01:41:54.069594+0000","last_undegraded":"2023-11-04T01:41:54.069594+0000","last_fullsized":"2023-11-04T01:41:54.069594+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:20.089706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036003499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.081521+0000","last_change":"2023-11-04T01:41:54.081767+0000","last_active":"2023-11-04T01:41:55.081521+0000","last_peered":"2023-11-04T01:41:55.081521+0000","last_clean":"2023-11-04T01:41:55.081521+0000","last_became_active":"2023-11-04T01:41:54.081486+0000","last_became_peered":"2023-11-04T01:41:54.081486+0000","last_unstale":"2023-11-04T01:41:55.081521+0000","last_undegraded":"2023-11-04T01:41:55.081521+0000","last_fullsized":"2023-11-04T01:41:55.081521+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:40.760885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.331460+0000","last_change":"2023-11-04T01:41:53.077939+0000","last_active":"2023-11-04T01:41:56.331460+0000","last_peered":"2023-11-04T01:41:56.331460+0000","last_clean":"2023-11-04T01:41:56.331460+0000","last_became_active":"2023-11-04T01:41:53.077680+0000","last_became_peered":"2023-11-04T01:41:53.077680+0000","last_unstale":"2023-11-04T01:41:56.331460+0000","last_undegraded":"2023-11-04T01:41:56.331460+0000","last_fullsized":"2023-11-04T01:41:56.331460+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:06:03.625159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.073784+0000","last_change":"2023-11-04T01:41:35.729089+0000","last_active":"2023-11-04T01:41:54.073784+0000","last_peered":"2023-11-04T01:41:54.073784+0000","last_clean":"2023-11-04T01:41:54.073784+0000","last_became_active":"2023-11-04T01:41:34.731063+0000","last_became_peered":"2023-11-04T01:41:34.731063+0000","last_unstale":"2023-11-04T01:41:54.073784+0000","last_undegraded":"2023-11-04T01:41:54.073784+0000","last_fullsized":"2023-11-04T01:41:54.073784+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:38:46.633175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083653600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589953+0000","last_change":"2023-11-04T01:41:54.086778+0000","last_active":"2023-11-04T01:41:56.589953+0000","last_peered":"2023-11-04T01:41:56.589953+0000","last_clean":"2023-11-04T01:41:56.589953+0000","last_became_active":"2023-11-04T01:41:54.086492+0000","last_became_peered":"2023-11-04T01:41:54.086492+0000","last_unstale":"2023-11-04T01:41:56.589953+0000","last_undegraded":"2023-11-04T01:41:56.589953+0000","last_fullsized":"2023-11-04T01:41:56.589953+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:09:20.408298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.069075+0000","last_change":"2023-11-04T01:41:53.078264+0000","last_active":"2023-11-04T01:41:54.069075+0000","last_peered":"2023-11-04T01:41:54.069075+0000","last_clean":"2023-11-04T01:41:54.069075+0000","last_became_active":"2023-11-04T01:41:53.077978+0000","last_became_peered":"2023-11-04T01:41:53.077978+0000","last_unstale":"2023-11-04T01:41:54.069075+0000","last_undegraded":"2023-11-04T01:41:54.069075+0000","last_fullsized":"2023-11-04T01:41:54.069075+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:52:08.757521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.069956+0000","last_change":"2023-11-04T01:41:35.729232+0000","last_active":"2023-11-04T01:41:54.069956+0000","last_peered":"2023-11-04T01:41:54.069956+0000","last_clean":"2023-11-04T01:41:54.069956+0000","last_became_active":"2023-11-04T01:41:34.731490+0000","last_became_peered":"2023-11-04T01:41:34.731490+0000","last_unstale":"2023-11-04T01:41:54.069956+0000","last_undegraded":"2023-11-04T01:41:54.069956+0000","last_fullsized":"2023-11-04T01:41:54.069956+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:37.958719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089653699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.084708+0000","last_change":"2023-11-04T01:41:54.085819+0000","last_active":"2023-11-04T01:41:55.084708+0000","last_peered":"2023-11-04T01:41:55.084708+0000","last_clean":"2023-11-04T01:41:55.084708+0000","last_became_active":"2023-11-04T01:41:54.085516+0000","last_became_peered":"2023-11-04T01:41:54.085516+0000","last_unstale":"2023-11-04T01:41:55.084708+0000","last_undegraded":"2023-11-04T01:41:55.084708+0000","last_fullsized":"2023-11-04T01:41:55.084708+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:39:56.014413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590820+0000","last_change":"2023-11-04T01:41:53.078721+0000","last_active":"2023-11-04T01:41:56.590820+0000","last_peered":"2023-11-04T01:41:56.590820+0000","last_clean":"2023-11-04T01:41:56.590820+0000","last_became_active":"2023-11-04T01:41:53.078424+0000","last_became_peered":"2023-11-04T01:41:53.078424+0000","last_unstale":"2023-11-04T01:41:56.590820+0000","last_undegraded":"2023-11-04T01:41:56.590820+0000","last_fullsized":"2023-11-04T01:41:56.590820+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:45:35.156451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.077159+0000","last_change":"2023-11-04T01:41:36.344018+0000","last_active":"2023-11-04T01:41:54.077159+0000","last_peered":"2023-11-04T01:41:54.077159+0000","last_clean":"2023-11-04T01:41:54.077159+0000","last_became_active":"2023-11-04T01:41:34.734178+0000","last_became_peered":"2023-11-04T01:41:34.734178+0000","last_unstale":"2023-11-04T01:41:54.077159+0000","last_undegraded":"2023-11-04T01:41:54.077159+0000","last_fullsized":"2023-11-04T01:41:54.077159+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:16.970814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077338299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590497+0000","last_change":"2023-11-04T01:41:54.087444+0000","last_active":"2023-11-04T01:41:56.590497+0000","last_peered":"2023-11-04T01:41:56.590497+0000","last_clean":"2023-11-04T01:41:56.590497+0000","last_became_active":"2023-11-04T01:41:54.087173+0000","last_became_peered":"2023-11-04T01:41:54.087173+0000","last_unstale":"2023-11-04T01:41:56.590497+0000","last_undegraded":"2023-11-04T01:41:56.590497+0000","last_fullsized":"2023-11-04T01:41:56.590497+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:45:36.163381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.075308+0000","last_change":"2023-11-04T01:41:53.079761+0000","last_active":"2023-11-04T01:41:54.075308+0000","last_peered":"2023-11-04T01:41:54.075308+0000","last_clean":"2023-11-04T01:41:54.075308+0000","last_became_active":"2023-11-04T01:41:53.079506+0000","last_became_peered":"2023-11-04T01:41:53.079506+0000","last_unstale":"2023-11-04T01:41:54.075308+0000","last_undegraded":"2023-11-04T01:41:54.075308+0000","last_fullsized":"2023-11-04T01:41:54.075308+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:14:16.043835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":25,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.074187+0000","last_change":"2023-11-04T01:41:35.906788+0000","last_active":"2023-11-04T01:41:54.074187+0000","last_peered":"2023-11-04T01:41:54.074187+0000","last_clean":"2023-11-04T01:41:54.074187+0000","last_became_active":"2023-11-04T01:41:34.734386+0000","last_became_peered":"2023-11-04T01:41:34.734386+0000","last_unstale":"2023-11-04T01:41:54.074187+0000","last_undegraded":"2023-11-04T01:41:54.074187+0000","last_fullsized":"2023-11-04T01:41:54.074187+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:23:23.733128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060435600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085258+0000","last_change":"2023-11-04T01:41:54.086713+0000","last_active":"2023-11-04T01:41:55.085258+0000","last_peered":"2023-11-04T01:41:55.085258+0000","last_clean":"2023-11-04T01:41:55.085258+0000","last_became_active":"2023-11-04T01:41:54.085354+0000","last_became_peered":"2023-11-04T01:41:54.085354+0000","last_unstale":"2023-11-04T01:41:55.085258+0000","last_undegraded":"2023-11-04T01:41:55.085258+0000","last_fullsized":"2023-11-04T01:41:55.085258+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:09:20.408298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590566+0000","last_change":"2023-11-04T01:41:53.081857+0000","last_active":"2023-11-04T01:41:56.590566+0000","last_peered":"2023-11-04T01:41:56.590566+0000","last_clean":"2023-11-04T01:41:56.590566+0000","last_became_active":"2023-11-04T01:41:53.081578+0000","last_became_peered":"2023-11-04T01:41:53.081578+0000","last_unstale":"2023-11-04T01:41:56.590566+0000","last_undegraded":"2023-11-04T01:41:56.590566+0000","last_fullsized":"2023-11-04T01:41:56.590566+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:13:12.033711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.067619+0000","last_change":"2023-11-04T01:41:35.931718+0000","last_active":"2023-11-04T01:41:54.067619+0000","last_peered":"2023-11-04T01:41:54.067619+0000","last_clean":"2023-11-04T01:41:54.067619+0000","last_became_active":"2023-11-04T01:41:34.741033+0000","last_became_peered":"2023-11-04T01:41:34.741033+0000","last_unstale":"2023-11-04T01:41:54.067619+0000","last_undegraded":"2023-11-04T01:41:54.067619+0000","last_fullsized":"2023-11-04T01:41:54.067619+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:48.121273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065858400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085410+0000","last_change":"2023-11-04T01:41:54.082720+0000","last_active":"2023-11-04T01:41:55.085410+0000","last_peered":"2023-11-04T01:41:55.085410+0000","last_clean":"2023-11-04T01:41:55.085410+0000","last_became_active":"2023-11-04T01:41:54.081261+0000","last_became_peered":"2023-11-04T01:41:54.081261+0000","last_unstale":"2023-11-04T01:41:55.085410+0000","last_undegraded":"2023-11-04T01:41:55.085410+0000","last_fullsized":"2023-11-04T01:41:55.085410+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:39:56.014413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590678+0000","last_change":"2023-11-04T01:41:53.079732+0000","last_active":"2023-11-04T01:41:56.590678+0000","last_peered":"2023-11-04T01:41:56.590678+0000","last_clean":"2023-11-04T01:41:56.590678+0000","last_became_active":"2023-11-04T01:41:53.079465+0000","last_became_peered":"2023-11-04T01:41:53.079465+0000","last_unstale":"2023-11-04T01:41:56.590678+0000","last_undegraded":"2023-11-04T01:41:56.590678+0000","last_fullsized":"2023-11-04T01:41:56.590678+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:09:19.401368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":25,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.075397+0000","last_change":"2023-11-04T01:41:35.728094+0000","last_active":"2023-11-04T01:41:54.075397+0000","last_peered":"2023-11-04T01:41:54.075397+0000","last_clean":"2023-11-04T01:41:54.075397+0000","last_became_active":"2023-11-04T01:41:34.738687+0000","last_became_peered":"2023-11-04T01:41:34.738687+0000","last_unstale":"2023-11-04T01:41:54.075397+0000","last_undegraded":"2023-11-04T01:41:54.075397+0000","last_fullsized":"2023-11-04T01:41:54.075397+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:37.958719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068772699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085802+0000","last_change":"2023-11-04T01:41:54.084706+0000","last_active":"2023-11-04T01:41:55.085802+0000","last_peered":"2023-11-04T01:41:55.085802+0000","last_clean":"2023-11-04T01:41:55.085802+0000","last_became_active":"2023-11-04T01:41:54.083966+0000","last_became_peered":"2023-11-04T01:41:54.083966+0000","last_unstale":"2023-11-04T01:41:55.085802+0000","last_undegraded":"2023-11-04T01:41:55.085802+0000","last_fullsized":"2023-11-04T01:41:55.085802+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:49.436809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590444+0000","last_change":"2023-11-04T01:41:53.081813+0000","last_active":"2023-11-04T01:41:56.590444+0000","last_peered":"2023-11-04T01:41:56.590444+0000","last_clean":"2023-11-04T01:41:56.590444+0000","last_became_active":"2023-11-04T01:41:53.081521+0000","last_became_peered":"2023-11-04T01:41:53.081521+0000","last_unstale":"2023-11-04T01:41:56.590444+0000","last_undegraded":"2023-11-04T01:41:56.590444+0000","last_fullsized":"2023-11-04T01:41:56.590444+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:32:11.738014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.077195+0000","last_change":"2023-11-04T01:41:35.729106+0000","last_active":"2023-11-04T01:41:54.077195+0000","last_peered":"2023-11-04T01:41:54.077195+0000","last_clean":"2023-11-04T01:41:54.077195+0000","last_became_active":"2023-11-04T01:41:34.731230+0000","last_became_peered":"2023-11-04T01:41:34.731230+0000","last_unstale":"2023-11-04T01:41:54.077195+0000","last_undegraded":"2023-11-04T01:41:54.077195+0000","last_fullsized":"2023-11-04T01:41:54.077195+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:07:32.744572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078592199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590168+0000","last_change":"2023-11-04T01:41:54.085266+0000","last_active":"2023-11-04T01:41:56.590168+0000","last_peered":"2023-11-04T01:41:56.590168+0000","last_clean":"2023-11-04T01:41:56.590168+0000","last_became_active":"2023-11-04T01:41:54.085007+0000","last_became_peered":"2023-11-04T01:41:54.085007+0000","last_unstale":"2023-11-04T01:41:56.590168+0000","last_undegraded":"2023-11-04T01:41:56.590168+0000","last_fullsized":"2023-11-04T01:41:56.590168+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:12:13.435625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"53'1","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.097091+0000","last_change":"2023-11-04T01:41:53.078346+0000","last_active":"2023-11-04T01:41:54.097091+0000","last_peered":"2023-11-04T01:41:54.097091+0000","last_clean":"2023-11-04T01:41:54.097091+0000","last_became_active":"2023-11-04T01:41:53.078087+0000","last_became_peered":"2023-11-04T01:41:53.078087+0000","last_unstale":"2023-11-04T01:41:54.097091+0000","last_undegraded":"2023-11-04T01:41:54.097091+0000","last_fullsized":"2023-11-04T01:41:54.097091+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:31:22.001930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.073871+0000","last_change":"2023-11-04T01:41:35.728672+0000","last_active":"2023-11-04T01:41:54.073871+0000","last_peered":"2023-11-04T01:41:54.073871+0000","last_clean":"2023-11-04T01:41:54.073871+0000","last_became_active":"2023-11-04T01:41:34.727419+0000","last_became_peered":"2023-11-04T01:41:34.727419+0000","last_unstale":"2023-11-04T01:41:54.073871+0000","last_undegraded":"2023-11-04T01:41:54.073871+0000","last_fullsized":"2023-11-04T01:41:54.073871+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:35:01.127206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044278299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589451+0000","last_change":"2023-11-04T01:41:54.091623+0000","last_active":"2023-11-04T01:41:56.589451+0000","last_peered":"2023-11-04T01:41:56.589451+0000","last_clean":"2023-11-04T01:41:56.589451+0000","last_became_active":"2023-11-04T01:41:54.091377+0000","last_became_peered":"2023-11-04T01:41:54.091377+0000","last_unstale":"2023-11-04T01:41:56.589451+0000","last_undegraded":"2023-11-04T01:41:56.589451+0000","last_fullsized":"2023-11-04T01:41:56.589451+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:14:51.971313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.331242+0000","last_change":"2023-11-04T01:41:53.079198+0000","last_active":"2023-11-04T01:41:56.331242+0000","last_peered":"2023-11-04T01:41:56.331242+0000","last_clean":"2023-11-04T01:41:56.331242+0000","last_became_active":"2023-11-04T01:41:53.078904+0000","last_became_peered":"2023-11-04T01:41:53.078904+0000","last_unstale":"2023-11-04T01:41:56.331242+0000","last_undegraded":"2023-11-04T01:41:56.331242+0000","last_fullsized":"2023-11-04T01:41:56.331242+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:37.695110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.076482+0000","last_change":"2023-11-04T01:41:36.344271+0000","last_active":"2023-11-04T01:41:54.076482+0000","last_peered":"2023-11-04T01:41:54.076482+0000","last_clean":"2023-11-04T01:41:54.076482+0000","last_became_active":"2023-11-04T01:41:34.732524+0000","last_became_peered":"2023-11-04T01:41:34.732524+0000","last_unstale":"2023-11-04T01:41:54.076482+0000","last_undegraded":"2023-11-04T01:41:54.076482+0000","last_fullsized":"2023-11-04T01:41:54.076482+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:19.350812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081160599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":200,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085780+0000","last_change":"2023-11-04T01:39:54.204460+0000","last_active":"2023-11-04T01:41:55.085780+0000","last_peered":"2023-11-04T01:41:55.085780+0000","last_clean":"2023-11-04T01:41:55.085780+0000","last_became_active":"2023-11-04T01:39:54.203352+0000","last_became_peered":"2023-11-04T01:39:54.203352+0000","last_unstale":"2023-11-04T01:41:55.085780+0000","last_undegraded":"2023-11-04T01:41:55.085780+0000","last_fullsized":"2023-11-04T01:41:55.085780+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:52.627032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:52.627032+0000","last_clean_scrub_stamp":"2023-11-04T01:39:52.627032+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:17:18.474768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":293364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53500000000000003,"15min":0.53800000000000003},"min":{"1min":0.40400000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.70199999999999996,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.499,"15min":0.497},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.53500000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55300000000000005,"15min":0.55200000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.71999999999999997,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.68300000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57099999999999995,"15min":0.57499999999999996},"min":{"1min":0.375,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.752,"5min":1.177,"15min":1.177},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55000000000000004,"15min":0.55400000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.66300000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.76200000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.63100000000000001,"15min":0.63600000000000001},"min":{"1min":0.49199999999999999,"5min":0.435,"15min":0.435},"max":{"1min":0.79800000000000004,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.63100000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.318,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77400000000000002,"5min":1.048,"15min":1.048},"last":0.432},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.32900000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.75700000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.39100000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.438,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.71399999999999997,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.61499999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.56999999999999995,"15min":0.55900000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.627,"15min":0.624},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.71599999999999997}]}]},{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28244,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343596,"statfs":{"total":96636764160,"available":96607842304,"internally_reserved":0,"allocated":1245184,"data_stored":883240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.53200000000000003,"15min":0.51600000000000001},"min":{"1min":0.38100000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":1.6899999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.7290000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.42399999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83599999999999997,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.63200000000000001,"15min":0.61599999999999999},"min":{"1min":0.46800000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.5049999999999999,"5min":2.5049999999999999,"15min":2.5049999999999999},"last":2.5049999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.59299999999999997,"15min":0.58499999999999996},"min":{"1min":0.42799999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":1.708},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.621,"15min":0.60399999999999998},"min":{"1min":0.50800000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":1.6579999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.58599999999999997,"15min":0.56499999999999995},"min":{"1min":0.40100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":3.2349999999999999,"5min":3.2349999999999999,"15min":3.2349999999999999},"last":3.2349999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.37,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79200000000000004,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.46200000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.5,"15min":0.48599999999999999},"min":{"1min":0.308,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":1.454},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.47999999999999998,"15min":0.46999999999999997},"min":{"1min":0.36599999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.78600000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.52400000000000002,"15min":0.503},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":1.629},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.55200000000000005,"15min":0.53000000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":2.4500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":2.4500000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.623,"15min":0.58899999999999997},"min":{"1min":0.39700000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":3.7850000000000001,"5min":3.7850000000000001,"15min":3.7850000000000001},"last":3.7850000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.56999999999999995,"15min":0.55400000000000005},"min":{"1min":0.39200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.6699999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":630784,"data_stored":285739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.40200000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.67100000000000004,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40000000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.64900000000000002,"5min":0.752,"15min":0.752},"last":0.53700000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56100000000000005,"15min":0.56599999999999995},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.72899999999999998,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.38,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.71399999999999997}]},{"osd":2,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.35299999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.69499999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57399999999999995,"15min":0.57899999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.67900000000000005,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.45800000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.47299999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.67400000000000004,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57999999999999996,"15min":0.57899999999999996},"min":{"1min":0.434,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.72799999999999998,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.434}]},{"osd":4,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.746,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.56699999999999995}]},{"osd":5,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78800000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58499999999999996,"15min":0.58599999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77600000000000002,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.77600000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.749,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61599999999999999,"15min":0.621},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82399999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.621}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":643072,"data_stored":287351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.621}]},{"osd":1,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.42299999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.48699999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.51700000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.45900000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.442},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.63600000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.60799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":638976,"data_stored":285795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.31900000000000001,"15min":0.317},"min":{"1min":0.20599999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.32800000000000001,"15min":0.32200000000000001},"min":{"1min":0.23699999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.29899999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.36599999999999999,"15min":0.372},"min":{"1min":0.23899999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.48499999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.58699999999999997,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.371}]},{"osd":2,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.36799999999999999,"15min":0.36699999999999999},"min":{"1min":0.28199999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.52700000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.42199999999999999,"15min":0.42699999999999999},"min":{"1min":0.30299999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.50900000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.34399999999999997}]},{"osd":4,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.81599999999999995,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58399999999999996,"15min":0.58799999999999997},"min":{"1min":0.40500000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.51000000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58699999999999997,"15min":0.59399999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79400000000000004,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.47899999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57699999999999996,"15min":0.58099999999999996},"min":{"1min":0.373,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77100000000000002,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60999999999999999,"15min":0.61599999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85199999999999998,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.59899999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.626,"15min":0.628},"min":{"1min":0.46400000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58599999999999997,"15min":0.58899999999999997},"min":{"1min":0.40000000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83199999999999996,"5min":0.87,"15min":0.87},"last":0.54200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":638976,"data_stored":285795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.23599999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.29199999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.31},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.36499999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.44700000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.441}]},{"osd":6,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.52200000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.54900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":647168,"data_stored":292802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.443,"5min":0.443,"15min":0.443},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"last":0.33000000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.31}]},{"osd":3,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.35099999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.39300000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.441},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.46300000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.42699999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.496},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.48699999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28228,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343612,"statfs":{"total":96636764160,"available":96607858688,"internally_reserved":0,"allocated":1236992,"data_stored":877282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.33000000000000002,"15min":0.33400000000000002},"min":{"1min":0.20799999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.40000000000000002,"5min":0.874,"15min":0.874},"last":0.378},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.38500000000000001,"15min":0.39200000000000002},"min":{"1min":0.28799999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.496,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.35499999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.36799999999999999,"15min":0.379},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.44900000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.37,"15min":0.377},"min":{"1min":0.27100000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.41999999999999998,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.32200000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.35599999999999998,"15min":0.35999999999999999},"min":{"1min":0.248,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.44600000000000001,"5min":1.278,"15min":1.278},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.434,"15min":0.442},"min":{"1min":0.33000000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.52900000000000003,"5min":1.304,"15min":1.304},"last":0.39900000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81799999999999995,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.625},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.629,"15min":0.627},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.83399999999999996,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.65900000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.378,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.5},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.59899999999999998,"15min":0.60499999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.873,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.56699999999999995}]},{"osd":6,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.622,"15min":0.621},"min":{"1min":0.41799999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90200000000000002,"5min":1.248,"15min":1.248},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42899999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.64800000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.62,"15min":0.622},"min":{"1min":0.42999999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.61099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:41:59.335 INFO:tasks.ceph.mds.c.smithi077.stderr:2023-11-04T01:41:59.333+0000 7f2d8d741640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:42:00.194 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:42:00.197 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:42:01.396 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:42:01.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.506+0000 7fb5e4d9e640 1 Processor -- start 2023-11-04T01:42:01.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.506+0000 7fb5e4d9e640 1 -- start start 2023-11-04T01:42:01.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.507+0000 7fb5e4d9e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb5e015d080 0x7fb5e00cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.507+0000 7fb5e4d9e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb5e015e100 0x7fb5e00cee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.507+0000 7fb5e4d9e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5e006d340 con 0x7fb5e00cf3d0 2023-11-04T01:42:01.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.507+0000 7fb5e4d9e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5e006cd80 con 0x7fb5e015e100 2023-11-04T01:42:01.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.507+0000 7fb5e4d9e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e006d060 con 0x7fb5e015d080 2023-11-04T01:42:01.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.507+0000 7fb5deffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb5e015e100 0x7fb5e00cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.507+0000 7fb5dffff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb5e00cf3d0 0x7fb5e00b2410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:42718/0 (socket says 172.21.15.77:42718) 2023-11-04T01:42:01.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.507+0000 7fb5dffff640 1 -- 172.21.15.77:0/2329836478 learned_addr learned my addr 172.21.15.77:0/2329836478 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:01.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.507+0000 7fb5deffd640 1 --2- 172.21.15.77:0/2329836478 >> v2:172.21.15.77:3300/0 conn(0x7fb5e015e100 0x7fb5e00cee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56734/0 (socket says 172.21.15.77:56734) 2023-11-04T01:42:01.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.507+0000 7fb5df7fe640 1 --2- 172.21.15.77:0/2329836478 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb5e015d080 0x7fb5e00cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.507+0000 7fb5deffd640 1 -- 172.21.15.77:0/2329836478 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb5e015d080 msgr2=0x7fb5e00cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:01.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.507+0000 7fb5deffd640 1 --2- 172.21.15.77:0/2329836478 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb5e015d080 0x7fb5e00cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.507+0000 7fb5deffd640 1 -- 172.21.15.77:0/2329836478 >> v1:172.21.15.77:6789/0 conn(0x7fb5e00cf3d0 legacy=0x7fb5e00b2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.507+0000 7fb5deffd640 1 -- 172.21.15.77:0/2329836478 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e00ce690 con 0x7fb5e015e100 2023-11-04T01:42:01.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.507+0000 7fb5de7fc640 1 -- 172.21.15.77:0/2329836478 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 116235463 0 0) 0x7fb5e006d340 con 0x7fb5e00cf3d0 2023-11-04T01:42:01.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.508+0000 7fb5deffd640 1 --2- 172.21.15.77:0/2329836478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5e015e100 0x7fb5e00cee90 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fb5d40097a0 tx=0x7fb5d402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f57cbd57caf69162 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:01.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.508+0000 7fb5de7fc640 1 -- 172.21.15.77:0/2329836478 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4031830 con 0x7fb5e015e100 2023-11-04T01:42:01.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.508+0000 7fb5de7fc640 1 -- 172.21.15.77:0/2329836478 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d4031990 con 0x7fb5e015e100 2023-11-04T01:42:01.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.508+0000 7fb5de7fc640 1 -- 172.21.15.77:0/2329836478 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4031d20 con 0x7fb5e015e100 2023-11-04T01:42:01.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.509+0000 7fb5e4d9e640 1 -- 172.21.15.77:0/2329836478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5e015e100 msgr2=0x7fb5e00cee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.509+0000 7fb5e4d9e640 1 --2- 172.21.15.77:0/2329836478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5e015e100 0x7fb5e00cee90 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fb5d40097a0 tx=0x7fb5d402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.509+0000 7fb5e4d9e640 1 -- 172.21.15.77:0/2329836478 shutdown_connections 2023-11-04T01:42:01.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.509+0000 7fb5e4d9e640 1 --2- 172.21.15.77:0/2329836478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5e015e100 0x7fb5e00cee90 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.509+0000 7fb5e4d9e640 1 --2- 172.21.15.77:0/2329836478 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb5e015d080 0x7fb5e00cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.509+0000 7fb5e4d9e640 1 -- 172.21.15.77:0/2329836478 >> 172.21.15.77:0/2329836478 conn(0x7fb5e00cd410 msgr2=0x7fb5e00cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:01.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.509+0000 7fb5e4d9e640 1 -- 172.21.15.77:0/2329836478 shutdown_connections 2023-11-04T01:42:01.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.509+0000 7fb5e4d9e640 1 -- 172.21.15.77:0/2329836478 wait complete. 2023-11-04T01:42:01.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.510+0000 7fb5e4d9e640 1 Processor -- start 2023-11-04T01:42:01.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.511+0000 7fb5e4d9e640 1 -- start start 2023-11-04T01:42:01.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.511+0000 7fb5e4d9e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5e015d080 0x7fb5e0159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.511+0000 7fb5e4d9e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5e015e100 0x7fb5e00b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.511+0000 7fb5e4d9e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb5e00b4b70 0x7fb5e00b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.511+0000 7fb5e4d9e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e00b5530 con 0x7fb5e015e100 2023-11-04T01:42:01.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.511+0000 7fb5e4d9e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e015a260 con 0x7fb5e015d080 2023-11-04T01:42:01.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.511+0000 7fb5e4d9e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e015e760 con 0x7fb5e00b4b70 2023-11-04T01:42:01.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.511+0000 7fb5deffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5e015e100 0x7fb5e00b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.512+0000 7fb5deffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5e015e100 0x7fb5e00b41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56748/0 (socket says 172.21.15.77:56748) 2023-11-04T01:42:01.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.512+0000 7fb5deffd640 1 -- 172.21.15.77:0/760457208 learned_addr learned my addr 172.21.15.77:0/760457208 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:01.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.512+0000 7fb5dffff640 1 --2- 172.21.15.77:0/760457208 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb5e00b4b70 0x7fb5e00b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.512+0000 7fb5df7fe640 1 --2- 172.21.15.77:0/760457208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5e015d080 0x7fb5e0159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.512+0000 7fb5deffd640 1 -- 172.21.15.77:0/760457208 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb5e00b4b70 msgr2=0x7fb5e00b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.512+0000 7fb5deffd640 1 --2- 172.21.15.77:0/760457208 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb5e00b4b70 0x7fb5e00b4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.512+0000 7fb5deffd640 1 -- 172.21.15.77:0/760457208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5e015d080 msgr2=0x7fb5e0159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.512+0000 7fb5deffd640 1 --2- 172.21.15.77:0/760457208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5e015d080 0x7fb5e0159d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.512+0000 7fb5deffd640 1 -- 172.21.15.77:0/760457208 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d4009400 con 0x7fb5e015e100 2023-11-04T01:42:01.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.512+0000 7fb5df7fe640 1 --2- 172.21.15.77:0/760457208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5e015d080 0x7fb5e0159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:01.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.512+0000 7fb5deffd640 1 --2- 172.21.15.77:0/760457208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5e015e100 0x7fb5e00b41f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fb5d40097a0 tx=0x7fb5d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:01.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.512+0000 7fb5c7fff640 1 -- 172.21.15.77:0/760457208 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4004230 con 0x7fb5e015e100 2023-11-04T01:42:01.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.512+0000 7fb5c7fff640 1 -- 172.21.15.77:0/760457208 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d4004390 con 0x7fb5e015e100 2023-11-04T01:42:01.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.512+0000 7fb5c7fff640 1 -- 172.21.15.77:0/760457208 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d403a880 con 0x7fb5e015e100 2023-11-04T01:42:01.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.512+0000 7fb5e4d9e640 1 -- 172.21.15.77:0/760457208 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5e015ea40 con 0x7fb5e015e100 2023-11-04T01:42:01.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.512+0000 7fb5e4d9e640 1 -- 172.21.15.77:0/760457208 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5e015f000 con 0x7fb5e015e100 2023-11-04T01:42:01.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.513+0000 7fb5e4d9e640 1 -- 172.21.15.77:0/760457208 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5e006e5b0 con 0x7fb5e015e100 2023-11-04T01:42:01.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.514+0000 7fb5c7fff640 1 -- 172.21.15.77:0/760457208 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb5d403a9e0 con 0x7fb5e015e100 2023-11-04T01:42:01.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.514+0000 7fb5c7fff640 1 --2- 172.21.15.77:0/760457208 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb5cc06aea0 0x7fb5cc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.514+0000 7fb5c7fff640 1 -- 172.21.15.77:0/760457208 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb5d40ac2f0 con 0x7fb5e015e100 2023-11-04T01:42:01.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.515+0000 7fb5df7fe640 1 --2- 172.21.15.77:0/760457208 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb5cc06aea0 0x7fb5cc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.515+0000 7fb5df7fe640 1 --2- 172.21.15.77:0/760457208 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb5cc06aea0 0x7fb5cc06d360 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0006fd0 tx=0x7fb5d0008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:01.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.519+0000 7fb5c7fff640 1 -- 172.21.15.77:0/760457208 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb5d4077220 con 0x7fb5e015e100 2023-11-04T01:42:01.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.682+0000 7fb5e4d9e640 1 -- 172.21.15.77:0/760457208 --> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb5e015e540 con 0x7fb5cc06aea0 2023-11-04T01:42:01.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.691+0000 7fb5c7fff640 1 -- 172.21.15.77:0/760457208 <== mgr.4123 v2:172.21.15.122:6832/2275325762 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370042 (secure 0 0 0) 0x7fb5d0009e10 con 0x7fb5cc06aea0 2023-11-04T01:42:01.697 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:01.699 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-04T01:42:01.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.695+0000 7fb5e4d9e640 1 -- 172.21.15.77:0/760457208 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb5cc06aea0 msgr2=0x7fb5cc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.695+0000 7fb5e4d9e640 1 --2- 172.21.15.77:0/760457208 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb5cc06aea0 0x7fb5cc06d360 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0006fd0 tx=0x7fb5d0008040 comp rx=0 tx=0).stop 2023-11-04T01:42:01.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.695+0000 7fb5e4d9e640 1 -- 172.21.15.77:0/760457208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5e015e100 msgr2=0x7fb5e00b41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.695+0000 7fb5e4d9e640 1 --2- 172.21.15.77:0/760457208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5e015e100 0x7fb5e00b41f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fb5d40097a0 tx=0x7fb5d40046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.695+0000 7fb5e4d9e640 1 -- 172.21.15.77:0/760457208 shutdown_connections 2023-11-04T01:42:01.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.695+0000 7fb5e4d9e640 1 --2- 172.21.15.77:0/760457208 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb5cc06aea0 0x7fb5cc06d360 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.695+0000 7fb5e4d9e640 1 --2- 172.21.15.77:0/760457208 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb5e00b4b70 0x7fb5e00b4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.695+0000 7fb5e4d9e640 1 --2- 172.21.15.77:0/760457208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5e015e100 0x7fb5e00b41f0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.695+0000 7fb5e4d9e640 1 --2- 172.21.15.77:0/760457208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5e015d080 0x7fb5e0159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.695+0000 7fb5e4d9e640 1 -- 172.21.15.77:0/760457208 >> 172.21.15.77:0/760457208 conn(0x7fb5e00cd410 msgr2=0x7fb5e015aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:01.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.695+0000 7fb5e4d9e640 1 -- 172.21.15.77:0/760457208 shutdown_connections 2023-11-04T01:42:01.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.695+0000 7fb5e4d9e640 1 -- 172.21.15.77:0/760457208 wait complete. 2023-11-04T01:42:01.707 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2023-11-04T01:42:01.654885+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":237,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222428,"kb_used_data":6244,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752292,"statfs":{"total":773094113280,"available":772866347008,"internally_reserved":0,"allocated":6393856,"data_stored":3526233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002056"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590009+0000","last_change":"2023-11-04T01:41:54.087836+0000","last_active":"2023-11-04T01:41:56.590009+0000","last_peered":"2023-11-04T01:41:56.590009+0000","last_clean":"2023-11-04T01:41:56.590009+0000","last_became_active":"2023-11-04T01:41:54.087590+0000","last_became_peered":"2023-11-04T01:41:54.087590+0000","last_unstale":"2023-11-04T01:41:56.590009+0000","last_undegraded":"2023-11-04T01:41:56.590009+0000","last_fullsized":"2023-11-04T01:41:56.590009+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:14:41.371010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590159+0000","last_change":"2023-11-04T01:41:54.092108+0000","last_active":"2023-11-04T01:41:56.590159+0000","last_peered":"2023-11-04T01:41:56.590159+0000","last_clean":"2023-11-04T01:41:56.590159+0000","last_became_active":"2023-11-04T01:41:54.091856+0000","last_became_peered":"2023-11-04T01:41:54.091856+0000","last_unstale":"2023-11-04T01:41:56.590159+0000","last_undegraded":"2023-11-04T01:41:56.590159+0000","last_fullsized":"2023-11-04T01:41:56.590159+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:52:17.923196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085645+0000","last_change":"2023-11-04T01:41:54.081697+0000","last_active":"2023-11-04T01:41:55.085645+0000","last_peered":"2023-11-04T01:41:55.085645+0000","last_clean":"2023-11-04T01:41:55.085645+0000","last_became_active":"2023-11-04T01:41:54.080925+0000","last_became_peered":"2023-11-04T01:41:54.080925+0000","last_unstale":"2023-11-04T01:41:55.085645+0000","last_undegraded":"2023-11-04T01:41:55.085645+0000","last_fullsized":"2023-11-04T01:41:55.085645+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:09:20.408298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085924+0000","last_change":"2023-11-04T01:41:54.085207+0000","last_active":"2023-11-04T01:41:55.085924+0000","last_peered":"2023-11-04T01:41:55.085924+0000","last_clean":"2023-11-04T01:41:55.085924+0000","last_became_active":"2023-11-04T01:41:54.081758+0000","last_became_peered":"2023-11-04T01:41:54.081758+0000","last_unstale":"2023-11-04T01:41:55.085924+0000","last_undegraded":"2023-11-04T01:41:55.085924+0000","last_fullsized":"2023-11-04T01:41:55.085924+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:49.436809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589675+0000","last_change":"2023-11-04T01:41:54.081691+0000","last_active":"2023-11-04T01:41:56.589675+0000","last_peered":"2023-11-04T01:41:56.589675+0000","last_clean":"2023-11-04T01:41:56.589675+0000","last_became_active":"2023-11-04T01:41:54.081400+0000","last_became_peered":"2023-11-04T01:41:54.081400+0000","last_unstale":"2023-11-04T01:41:56.589675+0000","last_undegraded":"2023-11-04T01:41:56.589675+0000","last_fullsized":"2023-11-04T01:41:56.589675+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:22:11.948292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589953+0000","last_change":"2023-11-04T01:41:54.090265+0000","last_active":"2023-11-04T01:41:56.589953+0000","last_peered":"2023-11-04T01:41:56.589953+0000","last_clean":"2023-11-04T01:41:56.589953+0000","last_became_active":"2023-11-04T01:41:54.090023+0000","last_became_peered":"2023-11-04T01:41:54.090023+0000","last_unstale":"2023-11-04T01:41:56.589953+0000","last_undegraded":"2023-11-04T01:41:56.589953+0000","last_fullsized":"2023-11-04T01:41:56.589953+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:09:05.963500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589192+0000","last_change":"2023-11-04T01:41:54.081762+0000","last_active":"2023-11-04T01:41:56.589192+0000","last_peered":"2023-11-04T01:41:56.589192+0000","last_clean":"2023-11-04T01:41:56.589192+0000","last_became_active":"2023-11-04T01:41:54.081515+0000","last_became_peered":"2023-11-04T01:41:54.081515+0000","last_unstale":"2023-11-04T01:41:56.589192+0000","last_undegraded":"2023-11-04T01:41:56.589192+0000","last_fullsized":"2023-11-04T01:41:56.589192+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:14.516867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589641+0000","last_change":"2023-11-04T01:41:54.080725+0000","last_active":"2023-11-04T01:41:56.589641+0000","last_peered":"2023-11-04T01:41:56.589641+0000","last_clean":"2023-11-04T01:41:56.589641+0000","last_became_active":"2023-11-04T01:41:54.080446+0000","last_became_peered":"2023-11-04T01:41:54.080446+0000","last_unstale":"2023-11-04T01:41:56.589641+0000","last_undegraded":"2023-11-04T01:41:56.589641+0000","last_fullsized":"2023-11-04T01:41:56.589641+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:36:28.196536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589582+0000","last_change":"2023-11-04T01:41:54.091895+0000","last_active":"2023-11-04T01:41:56.589582+0000","last_peered":"2023-11-04T01:41:56.589582+0000","last_clean":"2023-11-04T01:41:56.589582+0000","last_became_active":"2023-11-04T01:41:54.091641+0000","last_became_peered":"2023-11-04T01:41:54.091641+0000","last_unstale":"2023-11-04T01:41:56.589582+0000","last_undegraded":"2023-11-04T01:41:56.589582+0000","last_fullsized":"2023-11-04T01:41:56.589582+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:13:17.472616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.081608+0000","last_change":"2023-11-04T01:41:54.078741+0000","last_active":"2023-11-04T01:41:55.081608+0000","last_peered":"2023-11-04T01:41:55.081608+0000","last_clean":"2023-11-04T01:41:55.081608+0000","last_became_active":"2023-11-04T01:41:54.078419+0000","last_became_peered":"2023-11-04T01:41:54.078419+0000","last_unstale":"2023-11-04T01:41:55.081608+0000","last_undegraded":"2023-11-04T01:41:55.081608+0000","last_fullsized":"2023-11-04T01:41:55.081608+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:44.807007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.081745+0000","last_change":"2023-11-04T01:41:54.086241+0000","last_active":"2023-11-04T01:41:55.081745+0000","last_peered":"2023-11-04T01:41:55.081745+0000","last_clean":"2023-11-04T01:41:55.081745+0000","last_became_active":"2023-11-04T01:41:54.085701+0000","last_became_peered":"2023-11-04T01:41:54.085701+0000","last_unstale":"2023-11-04T01:41:55.081745+0000","last_undegraded":"2023-11-04T01:41:55.081745+0000","last_fullsized":"2023-11-04T01:41:55.081745+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:32:36.620521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.084622+0000","last_change":"2023-11-04T01:41:54.083807+0000","last_active":"2023-11-04T01:41:55.084622+0000","last_peered":"2023-11-04T01:41:55.084622+0000","last_clean":"2023-11-04T01:41:55.084622+0000","last_became_active":"2023-11-04T01:41:54.083543+0000","last_became_peered":"2023-11-04T01:41:54.083543+0000","last_unstale":"2023-11-04T01:41:55.084622+0000","last_undegraded":"2023-11-04T01:41:55.084622+0000","last_fullsized":"2023-11-04T01:41:55.084622+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:52.207829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.331475+0000","last_change":"2023-11-04T01:41:54.092079+0000","last_active":"2023-11-04T01:41:56.331475+0000","last_peered":"2023-11-04T01:41:56.331475+0000","last_clean":"2023-11-04T01:41:56.331475+0000","last_became_active":"2023-11-04T01:41:54.091786+0000","last_became_peered":"2023-11-04T01:41:54.091786+0000","last_unstale":"2023-11-04T01:41:56.331475+0000","last_undegraded":"2023-11-04T01:41:56.331475+0000","last_fullsized":"2023-11-04T01:41:56.331475+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:57:42.655270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589386+0000","last_change":"2023-11-04T01:41:54.085256+0000","last_active":"2023-11-04T01:41:56.589386+0000","last_peered":"2023-11-04T01:41:56.589386+0000","last_clean":"2023-11-04T01:41:56.589386+0000","last_became_active":"2023-11-04T01:41:54.084652+0000","last_became_peered":"2023-11-04T01:41:54.084652+0000","last_unstale":"2023-11-04T01:41:56.589386+0000","last_undegraded":"2023-11-04T01:41:56.589386+0000","last_fullsized":"2023-11-04T01:41:56.589386+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:44.807007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589329+0000","last_change":"2023-11-04T01:41:54.073589+0000","last_active":"2023-11-04T01:41:56.589329+0000","last_peered":"2023-11-04T01:41:56.589329+0000","last_clean":"2023-11-04T01:41:56.589329+0000","last_became_active":"2023-11-04T01:41:54.073292+0000","last_became_peered":"2023-11-04T01:41:54.073292+0000","last_unstale":"2023-11-04T01:41:56.589329+0000","last_undegraded":"2023-11-04T01:41:56.589329+0000","last_fullsized":"2023-11-04T01:41:56.589329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:40.760885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589277+0000","last_change":"2023-11-04T01:41:54.087994+0000","last_active":"2023-11-04T01:41:56.589277+0000","last_peered":"2023-11-04T01:41:56.589277+0000","last_clean":"2023-11-04T01:41:56.589277+0000","last_became_active":"2023-11-04T01:41:54.087529+0000","last_became_peered":"2023-11-04T01:41:54.087529+0000","last_unstale":"2023-11-04T01:41:56.589277+0000","last_undegraded":"2023-11-04T01:41:56.589277+0000","last_fullsized":"2023-11-04T01:41:56.589277+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:37:37.857295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590482+0000","last_change":"2023-11-04T01:41:54.084644+0000","last_active":"2023-11-04T01:41:56.590482+0000","last_peered":"2023-11-04T01:41:56.590482+0000","last_clean":"2023-11-04T01:41:56.590482+0000","last_became_active":"2023-11-04T01:41:54.084354+0000","last_became_peered":"2023-11-04T01:41:54.084354+0000","last_unstale":"2023-11-04T01:41:56.590482+0000","last_undegraded":"2023-11-04T01:41:56.590482+0000","last_fullsized":"2023-11-04T01:41:56.590482+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:56:59.472772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085262+0000","last_change":"2023-11-04T01:41:54.092787+0000","last_active":"2023-11-04T01:41:55.085262+0000","last_peered":"2023-11-04T01:41:55.085262+0000","last_clean":"2023-11-04T01:41:55.085262+0000","last_became_active":"2023-11-04T01:41:54.092471+0000","last_became_peered":"2023-11-04T01:41:54.092471+0000","last_unstale":"2023-11-04T01:41:55.085262+0000","last_undegraded":"2023-11-04T01:41:55.085262+0000","last_fullsized":"2023-11-04T01:41:55.085262+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:46:28.222652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589584+0000","last_change":"2023-11-04T01:41:54.087167+0000","last_active":"2023-11-04T01:41:56.589584+0000","last_peered":"2023-11-04T01:41:56.589584+0000","last_clean":"2023-11-04T01:41:56.589584+0000","last_became_active":"2023-11-04T01:41:54.086905+0000","last_became_peered":"2023-11-04T01:41:54.086905+0000","last_unstale":"2023-11-04T01:41:56.589584+0000","last_undegraded":"2023-11-04T01:41:56.589584+0000","last_fullsized":"2023-11-04T01:41:56.589584+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:02:48.912210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590277+0000","last_change":"2023-11-04T01:41:54.092451+0000","last_active":"2023-11-04T01:41:56.590277+0000","last_peered":"2023-11-04T01:41:56.590277+0000","last_clean":"2023-11-04T01:41:56.590277+0000","last_became_active":"2023-11-04T01:41:54.092212+0000","last_became_peered":"2023-11-04T01:41:54.092212+0000","last_unstale":"2023-11-04T01:41:56.590277+0000","last_undegraded":"2023-11-04T01:41:56.590277+0000","last_fullsized":"2023-11-04T01:41:56.590277+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:46:09.677609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.084974+0000","last_change":"2023-11-04T01:41:54.080620+0000","last_active":"2023-11-04T01:41:55.084974+0000","last_peered":"2023-11-04T01:41:55.084974+0000","last_clean":"2023-11-04T01:41:55.084974+0000","last_became_active":"2023-11-04T01:41:54.080202+0000","last_became_peered":"2023-11-04T01:41:54.080202+0000","last_unstale":"2023-11-04T01:41:55.084974+0000","last_undegraded":"2023-11-04T01:41:55.084974+0000","last_fullsized":"2023-11-04T01:41:55.084974+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:14:17.050765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590838+0000","last_change":"2023-11-04T01:41:54.091350+0000","last_active":"2023-11-04T01:41:56.590838+0000","last_peered":"2023-11-04T01:41:56.590838+0000","last_clean":"2023-11-04T01:41:56.590838+0000","last_became_active":"2023-11-04T01:41:54.090745+0000","last_became_peered":"2023-11-04T01:41:54.090745+0000","last_unstale":"2023-11-04T01:41:56.590838+0000","last_undegraded":"2023-11-04T01:41:56.590838+0000","last_fullsized":"2023-11-04T01:41:56.590838+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:46:29.429058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085258+0000","last_change":"2023-11-04T01:41:54.081175+0000","last_active":"2023-11-04T01:41:55.085258+0000","last_peered":"2023-11-04T01:41:55.085258+0000","last_clean":"2023-11-04T01:41:55.085258+0000","last_became_active":"2023-11-04T01:41:54.080838+0000","last_became_peered":"2023-11-04T01:41:54.080838+0000","last_unstale":"2023-11-04T01:41:55.085258+0000","last_undegraded":"2023-11-04T01:41:55.085258+0000","last_fullsized":"2023-11-04T01:41:55.085258+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:32:12.744944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.331133+0000","last_change":"2023-11-04T01:41:54.088758+0000","last_active":"2023-11-04T01:41:56.331133+0000","last_peered":"2023-11-04T01:41:56.331133+0000","last_clean":"2023-11-04T01:41:56.331133+0000","last_became_active":"2023-11-04T01:41:54.088433+0000","last_became_peered":"2023-11-04T01:41:54.088433+0000","last_unstale":"2023-11-04T01:41:56.331133+0000","last_undegraded":"2023-11-04T01:41:56.331133+0000","last_fullsized":"2023-11-04T01:41:56.331133+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:07:52.095800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590194+0000","last_change":"2023-11-04T01:41:54.085622+0000","last_active":"2023-11-04T01:41:56.590194+0000","last_peered":"2023-11-04T01:41:56.590194+0000","last_clean":"2023-11-04T01:41:56.590194+0000","last_became_active":"2023-11-04T01:41:54.085304+0000","last_became_peered":"2023-11-04T01:41:54.085304+0000","last_unstale":"2023-11-04T01:41:56.590194+0000","last_undegraded":"2023-11-04T01:41:56.590194+0000","last_fullsized":"2023-11-04T01:41:56.590194+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:39.440934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085016+0000","last_change":"2023-11-04T01:41:54.082662+0000","last_active":"2023-11-04T01:41:55.085016+0000","last_peered":"2023-11-04T01:41:55.085016+0000","last_clean":"2023-11-04T01:41:55.085016+0000","last_became_active":"2023-11-04T01:41:54.082371+0000","last_became_peered":"2023-11-04T01:41:54.082371+0000","last_unstale":"2023-11-04T01:41:55.085016+0000","last_undegraded":"2023-11-04T01:41:55.085016+0000","last_fullsized":"2023-11-04T01:41:55.085016+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:48:32.480005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590082+0000","last_change":"2023-11-04T01:41:54.089951+0000","last_active":"2023-11-04T01:41:56.590082+0000","last_peered":"2023-11-04T01:41:56.590082+0000","last_clean":"2023-11-04T01:41:56.590082+0000","last_became_active":"2023-11-04T01:41:54.089244+0000","last_became_peered":"2023-11-04T01:41:54.089244+0000","last_unstale":"2023-11-04T01:41:56.590082+0000","last_undegraded":"2023-11-04T01:41:56.590082+0000","last_fullsized":"2023-11-04T01:41:56.590082+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:49.436809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589399+0000","last_change":"2023-11-04T01:41:54.083191+0000","last_active":"2023-11-04T01:41:56.589399+0000","last_peered":"2023-11-04T01:41:56.589399+0000","last_clean":"2023-11-04T01:41:56.589399+0000","last_became_active":"2023-11-04T01:41:54.082930+0000","last_became_peered":"2023-11-04T01:41:54.082930+0000","last_unstale":"2023-11-04T01:41:56.589399+0000","last_undegraded":"2023-11-04T01:41:56.589399+0000","last_fullsized":"2023-11-04T01:41:56.589399+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:15:56.008303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590795+0000","last_change":"2023-11-04T01:41:54.088423+0000","last_active":"2023-11-04T01:41:56.590795+0000","last_peered":"2023-11-04T01:41:56.590795+0000","last_clean":"2023-11-04T01:41:56.590795+0000","last_became_active":"2023-11-04T01:41:54.088154+0000","last_became_peered":"2023-11-04T01:41:54.088154+0000","last_unstale":"2023-11-04T01:41:56.590795+0000","last_undegraded":"2023-11-04T01:41:56.590795+0000","last_fullsized":"2023-11-04T01:41:56.590795+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:47:50.594104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085545+0000","last_change":"2023-11-04T01:41:54.081291+0000","last_active":"2023-11-04T01:41:55.085545+0000","last_peered":"2023-11-04T01:41:55.085545+0000","last_clean":"2023-11-04T01:41:55.085545+0000","last_became_active":"2023-11-04T01:41:54.080954+0000","last_became_peered":"2023-11-04T01:41:54.080954+0000","last_unstale":"2023-11-04T01:41:55.085545+0000","last_undegraded":"2023-11-04T01:41:55.085545+0000","last_fullsized":"2023-11-04T01:41:55.085545+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:37:37.857295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589322+0000","last_change":"2023-11-04T01:41:54.085418+0000","last_active":"2023-11-04T01:41:56.589322+0000","last_peered":"2023-11-04T01:41:56.589322+0000","last_clean":"2023-11-04T01:41:56.589322+0000","last_became_active":"2023-11-04T01:41:54.084970+0000","last_became_peered":"2023-11-04T01:41:54.084970+0000","last_unstale":"2023-11-04T01:41:56.589322+0000","last_undegraded":"2023-11-04T01:41:56.589322+0000","last_fullsized":"2023-11-04T01:41:56.589322+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:32:39.225407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589155+0000","last_change":"2023-11-04T01:41:54.091099+0000","last_active":"2023-11-04T01:41:56.589155+0000","last_peered":"2023-11-04T01:41:56.589155+0000","last_clean":"2023-11-04T01:41:56.589155+0000","last_became_active":"2023-11-04T01:41:54.088304+0000","last_became_peered":"2023-11-04T01:41:54.088304+0000","last_unstale":"2023-11-04T01:41:56.589155+0000","last_undegraded":"2023-11-04T01:41:56.589155+0000","last_fullsized":"2023-11-04T01:41:56.589155+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:48:32.480005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085743+0000","last_change":"2023-11-04T01:41:54.076985+0000","last_active":"2023-11-04T01:41:55.085743+0000","last_peered":"2023-11-04T01:41:55.085743+0000","last_clean":"2023-11-04T01:41:55.085743+0000","last_became_active":"2023-11-04T01:41:54.076693+0000","last_became_peered":"2023-11-04T01:41:54.076693+0000","last_unstale":"2023-11-04T01:41:55.085743+0000","last_undegraded":"2023-11-04T01:41:55.085743+0000","last_fullsized":"2023-11-04T01:41:55.085743+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:09:05.963500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.331092+0000","last_change":"2023-11-04T01:41:53.075915+0000","last_active":"2023-11-04T01:41:56.331092+0000","last_peered":"2023-11-04T01:41:56.331092+0000","last_clean":"2023-11-04T01:41:56.331092+0000","last_became_active":"2023-11-04T01:41:53.075655+0000","last_became_peered":"2023-11-04T01:41:53.075655+0000","last_unstale":"2023-11-04T01:41:56.331092+0000","last_undegraded":"2023-11-04T01:41:56.331092+0000","last_fullsized":"2023-11-04T01:41:56.331092+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:52:08.757521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.069885+0000","last_change":"2023-11-04T01:41:36.067943+0000","last_active":"2023-11-04T01:41:54.069885+0000","last_peered":"2023-11-04T01:41:54.069885+0000","last_clean":"2023-11-04T01:41:54.069885+0000","last_became_active":"2023-11-04T01:41:34.734305+0000","last_became_peered":"2023-11-04T01:41:34.734305+0000","last_unstale":"2023-11-04T01:41:54.069885+0000","last_undegraded":"2023-11-04T01:41:54.069885+0000","last_fullsized":"2023-11-04T01:41:54.069885+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:48.121273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033780399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.084585+0000","last_change":"2023-11-04T01:41:54.091465+0000","last_active":"2023-11-04T01:41:55.084585+0000","last_peered":"2023-11-04T01:41:55.084585+0000","last_clean":"2023-11-04T01:41:55.084585+0000","last_became_active":"2023-11-04T01:41:54.090588+0000","last_became_peered":"2023-11-04T01:41:54.090588+0000","last_unstale":"2023-11-04T01:41:55.084585+0000","last_undegraded":"2023-11-04T01:41:55.084585+0000","last_fullsized":"2023-11-04T01:41:55.084585+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:46:28.222652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590684+0000","last_change":"2023-11-04T01:41:53.080156+0000","last_active":"2023-11-04T01:41:56.590684+0000","last_peered":"2023-11-04T01:41:56.590684+0000","last_clean":"2023-11-04T01:41:56.590684+0000","last_became_active":"2023-11-04T01:41:53.079885+0000","last_became_peered":"2023-11-04T01:41:53.079885+0000","last_unstale":"2023-11-04T01:41:56.590684+0000","last_undegraded":"2023-11-04T01:41:56.590684+0000","last_fullsized":"2023-11-04T01:41:56.590684+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:59:01.361687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":25,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.075075+0000","last_change":"2023-11-04T01:41:35.728832+0000","last_active":"2023-11-04T01:41:54.075075+0000","last_peered":"2023-11-04T01:41:54.075075+0000","last_clean":"2023-11-04T01:41:54.075075+0000","last_became_active":"2023-11-04T01:41:34.733517+0000","last_became_peered":"2023-11-04T01:41:34.733517+0000","last_unstale":"2023-11-04T01:41:54.075075+0000","last_undegraded":"2023-11-04T01:41:54.075075+0000","last_fullsized":"2023-11-04T01:41:54.075075+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:19.350812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042545700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085411+0000","last_change":"2023-11-04T01:41:54.081783+0000","last_active":"2023-11-04T01:41:55.085411+0000","last_peered":"2023-11-04T01:41:55.085411+0000","last_clean":"2023-11-04T01:41:55.085411+0000","last_became_active":"2023-11-04T01:41:54.081475+0000","last_became_peered":"2023-11-04T01:41:54.081475+0000","last_unstale":"2023-11-04T01:41:55.085411+0000","last_undegraded":"2023-11-04T01:41:55.085411+0000","last_fullsized":"2023-11-04T01:41:55.085411+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:48:32.480005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"53'8","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085700+0000","last_change":"2023-11-04T01:41:53.080511+0000","last_active":"2023-11-04T01:41:55.085700+0000","last_peered":"2023-11-04T01:41:55.085700+0000","last_clean":"2023-11-04T01:41:55.085700+0000","last_became_active":"2023-11-04T01:41:53.080220+0000","last_became_peered":"2023-11-04T01:41:53.080220+0000","last_unstale":"2023-11-04T01:41:55.085700+0000","last_undegraded":"2023-11-04T01:41:55.085700+0000","last_fullsized":"2023-11-04T01:41:55.085700+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:13.509937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":25,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.074083+0000","last_change":"2023-11-04T01:41:35.906660+0000","last_active":"2023-11-04T01:41:54.074083+0000","last_peered":"2023-11-04T01:41:54.074083+0000","last_clean":"2023-11-04T01:41:54.074083+0000","last_became_active":"2023-11-04T01:41:34.737209+0000","last_became_peered":"2023-11-04T01:41:34.737209+0000","last_unstale":"2023-11-04T01:41:54.074083+0000","last_undegraded":"2023-11-04T01:41:54.074083+0000","last_fullsized":"2023-11-04T01:41:54.074083+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:59.608410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068889500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589173+0000","last_change":"2023-11-04T01:41:54.075813+0000","last_active":"2023-11-04T01:41:56.589173+0000","last_peered":"2023-11-04T01:41:56.589173+0000","last_clean":"2023-11-04T01:41:56.589173+0000","last_became_active":"2023-11-04T01:41:54.071739+0000","last_became_peered":"2023-11-04T01:41:54.071739+0000","last_unstale":"2023-11-04T01:41:56.589173+0000","last_undegraded":"2023-11-04T01:41:56.589173+0000","last_fullsized":"2023-11-04T01:41:56.589173+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:58.634155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.074643+0000","last_change":"2023-11-04T01:41:53.077563+0000","last_active":"2023-11-04T01:41:54.074643+0000","last_peered":"2023-11-04T01:41:54.074643+0000","last_clean":"2023-11-04T01:41:54.074643+0000","last_became_active":"2023-11-04T01:41:53.077282+0000","last_became_peered":"2023-11-04T01:41:53.077282+0000","last_unstale":"2023-11-04T01:41:54.074643+0000","last_undegraded":"2023-11-04T01:41:54.074643+0000","last_fullsized":"2023-11-04T01:41:54.074643+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:26:30.691165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.069241+0000","last_change":"2023-11-04T01:41:36.067946+0000","last_active":"2023-11-04T01:41:54.069241+0000","last_peered":"2023-11-04T01:41:54.069241+0000","last_clean":"2023-11-04T01:41:54.069241+0000","last_became_active":"2023-11-04T01:41:34.729591+0000","last_became_peered":"2023-11-04T01:41:34.729591+0000","last_unstale":"2023-11-04T01:41:54.069241+0000","last_undegraded":"2023-11-04T01:41:54.069241+0000","last_fullsized":"2023-11-04T01:41:54.069241+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:59.608410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032681099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.086199+0000","last_change":"2023-11-04T01:41:54.083870+0000","last_active":"2023-11-04T01:41:55.086199+0000","last_peered":"2023-11-04T01:41:55.086199+0000","last_clean":"2023-11-04T01:41:55.086199+0000","last_became_active":"2023-11-04T01:41:54.083604+0000","last_became_peered":"2023-11-04T01:41:54.083604+0000","last_unstale":"2023-11-04T01:41:55.086199+0000","last_undegraded":"2023-11-04T01:41:55.086199+0000","last_fullsized":"2023-11-04T01:41:55.086199+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:02:33.389340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590318+0000","last_change":"2023-11-04T01:41:53.079881+0000","last_active":"2023-11-04T01:41:56.590318+0000","last_peered":"2023-11-04T01:41:56.590318+0000","last_clean":"2023-11-04T01:41:56.590318+0000","last_became_active":"2023-11-04T01:41:53.079530+0000","last_became_peered":"2023-11-04T01:41:53.079530+0000","last_unstale":"2023-11-04T01:41:56.590318+0000","last_undegraded":"2023-11-04T01:41:56.590318+0000","last_fullsized":"2023-11-04T01:41:56.590318+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:48:31.473075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":25,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.073242+0000","last_change":"2023-11-04T01:41:35.905999+0000","last_active":"2023-11-04T01:41:54.073242+0000","last_peered":"2023-11-04T01:41:54.073242+0000","last_clean":"2023-11-04T01:41:54.073242+0000","last_became_active":"2023-11-04T01:41:34.735286+0000","last_became_peered":"2023-11-04T01:41:34.735286+0000","last_unstale":"2023-11-04T01:41:54.073242+0000","last_undegraded":"2023-11-04T01:41:54.073242+0000","last_fullsized":"2023-11-04T01:41:54.073242+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:14:22.019781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051880100000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589638+0000","last_change":"2023-11-04T01:41:54.072933+0000","last_active":"2023-11-04T01:41:56.589638+0000","last_peered":"2023-11-04T01:41:56.589638+0000","last_clean":"2023-11-04T01:41:56.589638+0000","last_became_active":"2023-11-04T01:41:54.072650+0000","last_became_peered":"2023-11-04T01:41:54.072650+0000","last_unstale":"2023-11-04T01:41:56.589638+0000","last_undegraded":"2023-11-04T01:41:56.589638+0000","last_fullsized":"2023-11-04T01:41:56.589638+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:32:36.620521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.086308+0000","last_change":"2023-11-04T01:41:53.078747+0000","last_active":"2023-11-04T01:41:55.086308+0000","last_peered":"2023-11-04T01:41:55.086308+0000","last_clean":"2023-11-04T01:41:55.086308+0000","last_became_active":"2023-11-04T01:41:53.078478+0000","last_became_peered":"2023-11-04T01:41:53.078478+0000","last_unstale":"2023-11-04T01:41:55.086308+0000","last_undegraded":"2023-11-04T01:41:55.086308+0000","last_fullsized":"2023-11-04T01:41:55.086308+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:04.784101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.073488+0000","last_change":"2023-11-04T01:41:36.344205+0000","last_active":"2023-11-04T01:41:54.073488+0000","last_peered":"2023-11-04T01:41:54.073488+0000","last_clean":"2023-11-04T01:41:54.073488+0000","last_became_active":"2023-11-04T01:41:34.733205+0000","last_became_peered":"2023-11-04T01:41:34.733205+0000","last_unstale":"2023-11-04T01:41:54.073488+0000","last_undegraded":"2023-11-04T01:41:54.073488+0000","last_fullsized":"2023-11-04T01:41:54.073488+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:37.958719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011584760000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.086040+0000","last_change":"2023-11-04T01:41:54.084896+0000","last_active":"2023-11-04T01:41:55.086040+0000","last_peered":"2023-11-04T01:41:55.086040+0000","last_clean":"2023-11-04T01:41:55.086040+0000","last_became_active":"2023-11-04T01:41:54.084420+0000","last_became_peered":"2023-11-04T01:41:54.084420+0000","last_unstale":"2023-11-04T01:41:55.086040+0000","last_undegraded":"2023-11-04T01:41:55.086040+0000","last_fullsized":"2023-11-04T01:41:55.086040+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:19:37.120155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"53'6","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589458+0000","last_change":"2023-11-04T01:41:53.083938+0000","last_active":"2023-11-04T01:41:56.589458+0000","last_peered":"2023-11-04T01:41:56.589458+0000","last_clean":"2023-11-04T01:41:56.589458+0000","last_became_active":"2023-11-04T01:41:53.083642+0000","last_became_peered":"2023-11-04T01:41:53.083642+0000","last_unstale":"2023-11-04T01:41:56.589458+0000","last_undegraded":"2023-11-04T01:41:56.589458+0000","last_fullsized":"2023-11-04T01:41:56.589458+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:32:44.078800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.074562+0000","last_change":"2023-11-04T01:41:36.343728+0000","last_active":"2023-11-04T01:41:54.074562+0000","last_peered":"2023-11-04T01:41:54.074562+0000","last_clean":"2023-11-04T01:41:54.074562+0000","last_became_active":"2023-11-04T01:41:34.731106+0000","last_became_peered":"2023-11-04T01:41:34.731106+0000","last_unstale":"2023-11-04T01:41:54.074562+0000","last_undegraded":"2023-11-04T01:41:54.074562+0000","last_fullsized":"2023-11-04T01:41:54.074562+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:29.730483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058974500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.081479+0000","last_change":"2023-11-04T01:41:54.081291+0000","last_active":"2023-11-04T01:41:55.081479+0000","last_peered":"2023-11-04T01:41:55.081479+0000","last_clean":"2023-11-04T01:41:55.081479+0000","last_became_active":"2023-11-04T01:41:54.080945+0000","last_became_peered":"2023-11-04T01:41:54.080945+0000","last_unstale":"2023-11-04T01:41:55.081479+0000","last_undegraded":"2023-11-04T01:41:55.081479+0000","last_fullsized":"2023-11-04T01:41:55.081479+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:14.516867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"53'3","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085870+0000","last_change":"2023-11-04T01:41:53.074957+0000","last_active":"2023-11-04T01:41:55.085870+0000","last_peered":"2023-11-04T01:41:55.085870+0000","last_clean":"2023-11-04T01:41:55.085870+0000","last_became_active":"2023-11-04T01:41:53.074592+0000","last_became_peered":"2023-11-04T01:41:53.074592+0000","last_unstale":"2023-11-04T01:41:55.085870+0000","last_undegraded":"2023-11-04T01:41:55.085870+0000","last_fullsized":"2023-11-04T01:41:55.085870+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:16:02.695774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.068227+0000","last_change":"2023-11-04T01:41:35.931778+0000","last_active":"2023-11-04T01:41:54.068227+0000","last_peered":"2023-11-04T01:41:54.068227+0000","last_clean":"2023-11-04T01:41:54.068227+0000","last_became_active":"2023-11-04T01:41:34.736897+0000","last_became_peered":"2023-11-04T01:41:34.736897+0000","last_unstale":"2023-11-04T01:41:54.068227+0000","last_undegraded":"2023-11-04T01:41:54.068227+0000","last_fullsized":"2023-11-04T01:41:54.068227+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:20.089706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071523300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590552+0000","last_change":"2023-11-04T01:41:54.095817+0000","last_active":"2023-11-04T01:41:56.590552+0000","last_peered":"2023-11-04T01:41:56.590552+0000","last_clean":"2023-11-04T01:41:56.590552+0000","last_became_active":"2023-11-04T01:41:54.095553+0000","last_became_peered":"2023-11-04T01:41:54.095553+0000","last_unstale":"2023-11-04T01:41:56.590552+0000","last_undegraded":"2023-11-04T01:41:56.590552+0000","last_fullsized":"2023-11-04T01:41:56.590552+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:20:20.327739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590036+0000","last_change":"2023-11-04T01:41:53.077055+0000","last_active":"2023-11-04T01:41:56.590036+0000","last_peered":"2023-11-04T01:41:56.590036+0000","last_clean":"2023-11-04T01:41:56.590036+0000","last_became_active":"2023-11-04T01:41:53.076780+0000","last_became_peered":"2023-11-04T01:41:53.076780+0000","last_unstale":"2023-11-04T01:41:56.590036+0000","last_undegraded":"2023-11-04T01:41:56.590036+0000","last_fullsized":"2023-11-04T01:41:56.590036+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:31:22.001930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.069729+0000","last_change":"2023-11-04T01:41:35.729017+0000","last_active":"2023-11-04T01:41:54.069729+0000","last_peered":"2023-11-04T01:41:54.069729+0000","last_clean":"2023-11-04T01:41:54.069729+0000","last_became_active":"2023-11-04T01:41:34.730592+0000","last_became_peered":"2023-11-04T01:41:34.730592+0000","last_unstale":"2023-11-04T01:41:54.069729+0000","last_undegraded":"2023-11-04T01:41:54.069729+0000","last_fullsized":"2023-11-04T01:41:54.069729+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:08.858430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088820999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590990+0000","last_change":"2023-11-04T01:41:54.084606+0000","last_active":"2023-11-04T01:41:56.590990+0000","last_peered":"2023-11-04T01:41:56.590990+0000","last_clean":"2023-11-04T01:41:56.590990+0000","last_became_active":"2023-11-04T01:41:54.084326+0000","last_became_peered":"2023-11-04T01:41:54.084326+0000","last_unstale":"2023-11-04T01:41:56.590990+0000","last_undegraded":"2023-11-04T01:41:56.590990+0000","last_fullsized":"2023-11-04T01:41:56.590990+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:32:29.239625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589317+0000","last_change":"2023-11-04T01:41:53.084252+0000","last_active":"2023-11-04T01:41:56.589317+0000","last_peered":"2023-11-04T01:41:56.589317+0000","last_clean":"2023-11-04T01:41:56.589317+0000","last_became_active":"2023-11-04T01:41:53.083948+0000","last_became_peered":"2023-11-04T01:41:53.083948+0000","last_unstale":"2023-11-04T01:41:56.589317+0000","last_undegraded":"2023-11-04T01:41:56.589317+0000","last_fullsized":"2023-11-04T01:41:56.589317+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:57:41.648340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.077144+0000","last_change":"2023-11-04T01:41:35.729378+0000","last_active":"2023-11-04T01:41:54.077144+0000","last_peered":"2023-11-04T01:41:54.077144+0000","last_clean":"2023-11-04T01:41:54.077144+0000","last_became_active":"2023-11-04T01:41:34.730387+0000","last_became_peered":"2023-11-04T01:41:34.730387+0000","last_unstale":"2023-11-04T01:41:54.077144+0000","last_undegraded":"2023-11-04T01:41:54.077144+0000","last_fullsized":"2023-11-04T01:41:54.077144+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:12.653602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072268699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590186+0000","last_change":"2023-11-04T01:41:54.084539+0000","last_active":"2023-11-04T01:41:56.590186+0000","last_peered":"2023-11-04T01:41:56.590186+0000","last_clean":"2023-11-04T01:41:56.590186+0000","last_became_active":"2023-11-04T01:41:54.084254+0000","last_became_peered":"2023-11-04T01:41:54.084254+0000","last_unstale":"2023-11-04T01:41:56.590186+0000","last_undegraded":"2023-11-04T01:41:56.590186+0000","last_fullsized":"2023-11-04T01:41:56.590186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:15.904826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589151+0000","last_change":"2023-11-04T01:41:53.083914+0000","last_active":"2023-11-04T01:41:56.589151+0000","last_peered":"2023-11-04T01:41:56.589151+0000","last_clean":"2023-11-04T01:41:56.589151+0000","last_became_active":"2023-11-04T01:41:53.083658+0000","last_became_peered":"2023-11-04T01:41:53.083658+0000","last_unstale":"2023-11-04T01:41:56.589151+0000","last_undegraded":"2023-11-04T01:41:56.589151+0000","last_fullsized":"2023-11-04T01:41:56.589151+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:35:19.471505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.069646+0000","last_change":"2023-11-04T01:41:35.729318+0000","last_active":"2023-11-04T01:41:54.069646+0000","last_peered":"2023-11-04T01:41:54.069646+0000","last_clean":"2023-11-04T01:41:54.069646+0000","last_became_active":"2023-11-04T01:41:34.733796+0000","last_became_peered":"2023-11-04T01:41:34.733796+0000","last_unstale":"2023-11-04T01:41:54.069646+0000","last_undegraded":"2023-11-04T01:41:54.069646+0000","last_fullsized":"2023-11-04T01:41:54.069646+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:19.350812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053712200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.331250+0000","last_change":"2023-11-04T01:41:54.082009+0000","last_active":"2023-11-04T01:41:56.331250+0000","last_peered":"2023-11-04T01:41:56.331250+0000","last_clean":"2023-11-04T01:41:56.331250+0000","last_became_active":"2023-11-04T01:41:54.081727+0000","last_became_peered":"2023-11-04T01:41:54.081727+0000","last_unstale":"2023-11-04T01:41:56.331250+0000","last_undegraded":"2023-11-04T01:41:56.331250+0000","last_fullsized":"2023-11-04T01:41:56.331250+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:32.004830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.074695+0000","last_change":"2023-11-04T01:41:53.077862+0000","last_active":"2023-11-04T01:41:54.074695+0000","last_peered":"2023-11-04T01:41:54.074695+0000","last_clean":"2023-11-04T01:41:54.074695+0000","last_became_active":"2023-11-04T01:41:53.077454+0000","last_became_peered":"2023-11-04T01:41:53.077454+0000","last_unstale":"2023-11-04T01:41:54.074695+0000","last_undegraded":"2023-11-04T01:41:54.074695+0000","last_fullsized":"2023-11-04T01:41:54.074695+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:13:12.033711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.067806+0000","last_change":"2023-11-04T01:41:35.931929+0000","last_active":"2023-11-04T01:41:54.067806+0000","last_peered":"2023-11-04T01:41:54.067806+0000","last_clean":"2023-11-04T01:41:54.067806+0000","last_became_active":"2023-11-04T01:41:34.738795+0000","last_became_peered":"2023-11-04T01:41:34.738795+0000","last_unstale":"2023-11-04T01:41:54.067806+0000","last_undegraded":"2023-11-04T01:41:54.067806+0000","last_fullsized":"2023-11-04T01:41:54.067806+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:59.608410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046204999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.081684+0000","last_change":"2023-11-04T01:41:54.082457+0000","last_active":"2023-11-04T01:41:55.081684+0000","last_peered":"2023-11-04T01:41:55.081684+0000","last_clean":"2023-11-04T01:41:55.081684+0000","last_became_active":"2023-11-04T01:41:54.082130+0000","last_became_peered":"2023-11-04T01:41:54.082130+0000","last_unstale":"2023-11-04T01:41:55.081684+0000","last_undegraded":"2023-11-04T01:41:55.081684+0000","last_fullsized":"2023-11-04T01:41:55.081684+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:13:17.472616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590239+0000","last_change":"2023-11-04T01:41:53.076199+0000","last_active":"2023-11-04T01:41:56.590239+0000","last_peered":"2023-11-04T01:41:56.590239+0000","last_clean":"2023-11-04T01:41:56.590239+0000","last_became_active":"2023-11-04T01:41:53.075934+0000","last_became_peered":"2023-11-04T01:41:53.075934+0000","last_unstale":"2023-11-04T01:41:56.590239+0000","last_undegraded":"2023-11-04T01:41:56.590239+0000","last_fullsized":"2023-11-04T01:41:56.590239+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:51.200899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.069062+0000","last_change":"2023-11-04T01:41:35.728945+0000","last_active":"2023-11-04T01:41:54.069062+0000","last_peered":"2023-11-04T01:41:54.069062+0000","last_clean":"2023-11-04T01:41:54.069062+0000","last_became_active":"2023-11-04T01:41:34.735082+0000","last_became_peered":"2023-11-04T01:41:34.735082+0000","last_unstale":"2023-11-04T01:41:54.069062+0000","last_undegraded":"2023-11-04T01:41:54.069062+0000","last_fullsized":"2023-11-04T01:41:54.069062+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:16.970814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079093000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590578+0000","last_change":"2023-11-04T01:41:54.088881+0000","last_active":"2023-11-04T01:41:56.590578+0000","last_peered":"2023-11-04T01:41:56.590578+0000","last_clean":"2023-11-04T01:41:56.590578+0000","last_became_active":"2023-11-04T01:41:54.088232+0000","last_became_peered":"2023-11-04T01:41:54.088232+0000","last_unstale":"2023-11-04T01:41:56.590578+0000","last_undegraded":"2023-11-04T01:41:56.590578+0000","last_fullsized":"2023-11-04T01:41:56.590578+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:49:12.341595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"53'4","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590791+0000","last_change":"2023-11-04T01:41:53.080523+0000","last_active":"2023-11-04T01:41:56.590791+0000","last_peered":"2023-11-04T01:41:56.590791+0000","last_clean":"2023-11-04T01:41:56.590791+0000","last_became_active":"2023-11-04T01:41:53.080094+0000","last_became_peered":"2023-11-04T01:41:53.080094+0000","last_unstale":"2023-11-04T01:41:56.590791+0000","last_undegraded":"2023-11-04T01:41:56.590791+0000","last_fullsized":"2023-11-04T01:41:56.590791+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:46:27.215722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.073803+0000","last_change":"2023-11-04T01:41:35.728625+0000","last_active":"2023-11-04T01:41:54.073803+0000","last_peered":"2023-11-04T01:41:54.073803+0000","last_clean":"2023-11-04T01:41:54.073803+0000","last_became_active":"2023-11-04T01:41:34.731514+0000","last_became_peered":"2023-11-04T01:41:34.731514+0000","last_unstale":"2023-11-04T01:41:54.073803+0000","last_undegraded":"2023-11-04T01:41:54.073803+0000","last_fullsized":"2023-11-04T01:41:54.073803+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:51:50.413223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047686400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590191+0000","last_change":"2023-11-04T01:41:54.089484+0000","last_active":"2023-11-04T01:41:56.590191+0000","last_peered":"2023-11-04T01:41:56.590191+0000","last_clean":"2023-11-04T01:41:56.590191+0000","last_became_active":"2023-11-04T01:41:54.087702+0000","last_became_peered":"2023-11-04T01:41:54.087702+0000","last_unstale":"2023-11-04T01:41:56.590191+0000","last_undegraded":"2023-11-04T01:41:56.590191+0000","last_fullsized":"2023-11-04T01:41:56.590191+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:19:37.120155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"53'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.097178+0000","last_change":"2023-11-04T01:41:53.081291+0000","last_active":"2023-11-04T01:41:54.097178+0000","last_peered":"2023-11-04T01:41:54.097178+0000","last_clean":"2023-11-04T01:41:54.097178+0000","last_became_active":"2023-11-04T01:41:53.080917+0000","last_became_peered":"2023-11-04T01:41:53.080917+0000","last_unstale":"2023-11-04T01:41:54.097178+0000","last_undegraded":"2023-11-04T01:41:54.097178+0000","last_fullsized":"2023-11-04T01:41:54.097178+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:53:25.375890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.074641+0000","last_change":"2023-11-04T01:41:36.343762+0000","last_active":"2023-11-04T01:41:54.074641+0000","last_peered":"2023-11-04T01:41:54.074641+0000","last_clean":"2023-11-04T01:41:54.074641+0000","last_became_active":"2023-11-04T01:41:34.733406+0000","last_became_peered":"2023-11-04T01:41:34.733406+0000","last_unstale":"2023-11-04T01:41:54.074641+0000","last_undegraded":"2023-11-04T01:41:54.074641+0000","last_fullsized":"2023-11-04T01:41:54.074641+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:34:35.541159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058533399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590368+0000","last_change":"2023-11-04T01:41:54.087274+0000","last_active":"2023-11-04T01:41:56.590368+0000","last_peered":"2023-11-04T01:41:56.590368+0000","last_clean":"2023-11-04T01:41:56.590368+0000","last_became_active":"2023-11-04T01:41:54.087015+0000","last_became_peered":"2023-11-04T01:41:54.087015+0000","last_unstale":"2023-11-04T01:41:56.590368+0000","last_undegraded":"2023-11-04T01:41:56.590368+0000","last_fullsized":"2023-11-04T01:41:56.590368+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:59:02.368617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590382+0000","last_change":"2023-11-04T01:41:53.078589+0000","last_active":"2023-11-04T01:41:56.590382+0000","last_peered":"2023-11-04T01:41:56.590382+0000","last_clean":"2023-11-04T01:41:56.590382+0000","last_became_active":"2023-11-04T01:41:53.078299+0000","last_became_peered":"2023-11-04T01:41:53.078299+0000","last_unstale":"2023-11-04T01:41:56.590382+0000","last_undegraded":"2023-11-04T01:41:56.590382+0000","last_fullsized":"2023-11-04T01:41:56.590382+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:39:55.007483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":25,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.074298+0000","last_change":"2023-11-04T01:41:35.906297+0000","last_active":"2023-11-04T01:41:54.074298+0000","last_peered":"2023-11-04T01:41:54.074298+0000","last_clean":"2023-11-04T01:41:54.074298+0000","last_became_active":"2023-11-04T01:41:34.734134+0000","last_became_peered":"2023-11-04T01:41:34.734134+0000","last_unstale":"2023-11-04T01:41:54.074298+0000","last_undegraded":"2023-11-04T01:41:54.074298+0000","last_fullsized":"2023-11-04T01:41:54.074298+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:52.597063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087104900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085334+0000","last_change":"2023-11-04T01:41:54.088922+0000","last_active":"2023-11-04T01:41:55.085334+0000","last_peered":"2023-11-04T01:41:55.085334+0000","last_clean":"2023-11-04T01:41:55.085334+0000","last_became_active":"2023-11-04T01:41:54.088636+0000","last_became_peered":"2023-11-04T01:41:54.088636+0000","last_unstale":"2023-11-04T01:41:55.085334+0000","last_undegraded":"2023-11-04T01:41:55.085334+0000","last_fullsized":"2023-11-04T01:41:55.085334+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:52.207829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589388+0000","last_change":"2023-11-04T01:41:53.078664+0000","last_active":"2023-11-04T01:41:56.589388+0000","last_peered":"2023-11-04T01:41:56.589388+0000","last_clean":"2023-11-04T01:41:56.589388+0000","last_became_active":"2023-11-04T01:41:53.078411+0000","last_became_peered":"2023-11-04T01:41:53.078411+0000","last_unstale":"2023-11-04T01:41:56.589388+0000","last_undegraded":"2023-11-04T01:41:56.589388+0000","last_fullsized":"2023-11-04T01:41:56.589388+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:30.997900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":25,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.073574+0000","last_change":"2023-11-04T01:41:35.906596+0000","last_active":"2023-11-04T01:41:54.073574+0000","last_peered":"2023-11-04T01:41:54.073574+0000","last_clean":"2023-11-04T01:41:54.073574+0000","last_became_active":"2023-11-04T01:41:34.738529+0000","last_became_peered":"2023-11-04T01:41:34.738529+0000","last_unstale":"2023-11-04T01:41:54.073574+0000","last_undegraded":"2023-11-04T01:41:54.073574+0000","last_fullsized":"2023-11-04T01:41:54.073574+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:48.121273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086660600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590979+0000","last_change":"2023-11-04T01:41:54.091537+0000","last_active":"2023-11-04T01:41:56.590979+0000","last_peered":"2023-11-04T01:41:56.590979+0000","last_clean":"2023-11-04T01:41:56.590979+0000","last_became_active":"2023-11-04T01:41:54.091084+0000","last_became_peered":"2023-11-04T01:41:54.091084+0000","last_unstale":"2023-11-04T01:41:56.590979+0000","last_undegraded":"2023-11-04T01:41:56.590979+0000","last_fullsized":"2023-11-04T01:41:56.590979+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:16:45.397776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.068971+0000","last_change":"2023-11-04T01:41:53.075392+0000","last_active":"2023-11-04T01:41:54.068971+0000","last_peered":"2023-11-04T01:41:54.068971+0000","last_clean":"2023-11-04T01:41:54.068971+0000","last_became_active":"2023-11-04T01:41:53.075123+0000","last_became_peered":"2023-11-04T01:41:53.075123+0000","last_unstale":"2023-11-04T01:41:54.068971+0000","last_undegraded":"2023-11-04T01:41:54.068971+0000","last_fullsized":"2023-11-04T01:41:54.068971+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:11:16.439530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":25,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.073477+0000","last_change":"2023-11-04T01:41:35.906430+0000","last_active":"2023-11-04T01:41:54.073477+0000","last_peered":"2023-11-04T01:41:54.073477+0000","last_clean":"2023-11-04T01:41:54.073477+0000","last_became_active":"2023-11-04T01:41:34.741147+0000","last_became_peered":"2023-11-04T01:41:34.741147+0000","last_unstale":"2023-11-04T01:41:54.073477+0000","last_undegraded":"2023-11-04T01:41:54.073477+0000","last_fullsized":"2023-11-04T01:41:54.073477+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:20.089706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090504400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590317+0000","last_change":"2023-11-04T01:41:54.082050+0000","last_active":"2023-11-04T01:41:56.590317+0000","last_peered":"2023-11-04T01:41:56.590317+0000","last_clean":"2023-11-04T01:41:56.590317+0000","last_became_active":"2023-11-04T01:41:54.081752+0000","last_became_peered":"2023-11-04T01:41:54.081752+0000","last_unstale":"2023-11-04T01:41:56.590317+0000","last_undegraded":"2023-11-04T01:41:56.590317+0000","last_fullsized":"2023-11-04T01:41:56.590317+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:43:37.855647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589527+0000","last_change":"2023-11-04T01:41:53.079896+0000","last_active":"2023-11-04T01:41:56.589527+0000","last_peered":"2023-11-04T01:41:56.589527+0000","last_clean":"2023-11-04T01:41:56.589527+0000","last_became_active":"2023-11-04T01:41:53.079540+0000","last_became_peered":"2023-11-04T01:41:53.079540+0000","last_unstale":"2023-11-04T01:41:56.589527+0000","last_undegraded":"2023-11-04T01:41:56.589527+0000","last_fullsized":"2023-11-04T01:41:56.589527+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:53:25.375890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.077435+0000","last_change":"2023-11-04T01:41:36.344408+0000","last_active":"2023-11-04T01:41:54.077435+0000","last_peered":"2023-11-04T01:41:54.077435+0000","last_clean":"2023-11-04T01:41:54.077435+0000","last_became_active":"2023-11-04T01:41:34.730735+0000","last_became_peered":"2023-11-04T01:41:34.730735+0000","last_unstale":"2023-11-04T01:41:54.077435+0000","last_undegraded":"2023-11-04T01:41:54.077435+0000","last_fullsized":"2023-11-04T01:41:54.077435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:10:58.095232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081464299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.081224+0000","last_change":"2023-11-04T01:41:54.075442+0000","last_active":"2023-11-04T01:41:55.081224+0000","last_peered":"2023-11-04T01:41:55.081224+0000","last_clean":"2023-11-04T01:41:55.081224+0000","last_became_active":"2023-11-04T01:41:54.075156+0000","last_became_peered":"2023-11-04T01:41:54.075156+0000","last_unstale":"2023-11-04T01:41:55.081224+0000","last_undegraded":"2023-11-04T01:41:55.081224+0000","last_fullsized":"2023-11-04T01:41:55.081224+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:58.634155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.069229+0000","last_change":"2023-11-04T01:41:53.077515+0000","last_active":"2023-11-04T01:41:54.069229+0000","last_peered":"2023-11-04T01:41:54.069229+0000","last_clean":"2023-11-04T01:41:54.069229+0000","last_became_active":"2023-11-04T01:41:53.077273+0000","last_became_peered":"2023-11-04T01:41:53.077273+0000","last_unstale":"2023-11-04T01:41:54.069229+0000","last_undegraded":"2023-11-04T01:41:54.069229+0000","last_fullsized":"2023-11-04T01:41:54.069229+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:02:25.529139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":28,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.076226+0000","last_change":"2023-11-04T01:41:36.244245+0000","last_active":"2023-11-04T01:41:54.076226+0000","last_peered":"2023-11-04T01:41:54.076226+0000","last_clean":"2023-11-04T01:41:54.076226+0000","last_became_active":"2023-11-04T01:41:34.734925+0000","last_became_peered":"2023-11-04T01:41:34.734925+0000","last_unstale":"2023-11-04T01:41:54.076226+0000","last_undegraded":"2023-11-04T01:41:54.076226+0000","last_fullsized":"2023-11-04T01:41:54.076226+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:44.193748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025350200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085360+0000","last_change":"2023-11-04T01:41:54.083519+0000","last_active":"2023-11-04T01:41:55.085360+0000","last_peered":"2023-11-04T01:41:55.085360+0000","last_clean":"2023-11-04T01:41:55.085360+0000","last_became_active":"2023-11-04T01:41:54.083263+0000","last_became_peered":"2023-11-04T01:41:54.083263+0000","last_unstale":"2023-11-04T01:41:55.085360+0000","last_undegraded":"2023-11-04T01:41:55.085360+0000","last_fullsized":"2023-11-04T01:41:55.085360+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:09:05.963500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"54'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.650356+0000","last_change":"2023-11-04T01:41:53.076654+0000","last_active":"2023-11-04T01:41:56.650356+0000","last_peered":"2023-11-04T01:41:56.650356+0000","last_clean":"2023-11-04T01:41:56.650356+0000","last_became_active":"2023-11-04T01:41:53.076139+0000","last_became_peered":"2023-11-04T01:41:53.076139+0000","last_unstale":"2023-11-04T01:41:56.650356+0000","last_undegraded":"2023-11-04T01:41:56.650356+0000","last_fullsized":"2023-11-04T01:41:56.650356+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:12:15.708878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.074053+0000","last_change":"2023-11-04T01:41:36.343956+0000","last_active":"2023-11-04T01:41:54.074053+0000","last_peered":"2023-11-04T01:41:54.074053+0000","last_clean":"2023-11-04T01:41:54.074053+0000","last_became_active":"2023-11-04T01:41:34.736013+0000","last_became_peered":"2023-11-04T01:41:34.736013+0000","last_unstale":"2023-11-04T01:41:54.074053+0000","last_undegraded":"2023-11-04T01:41:54.074053+0000","last_fullsized":"2023-11-04T01:41:54.074053+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:08.858430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081427799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085146+0000","last_change":"2023-11-04T01:41:54.084395+0000","last_active":"2023-11-04T01:41:55.085146+0000","last_peered":"2023-11-04T01:41:55.085146+0000","last_clean":"2023-11-04T01:41:55.085146+0000","last_became_active":"2023-11-04T01:41:54.084122+0000","last_became_peered":"2023-11-04T01:41:54.084122+0000","last_unstale":"2023-11-04T01:41:55.085146+0000","last_undegraded":"2023-11-04T01:41:55.085146+0000","last_fullsized":"2023-11-04T01:41:55.085146+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:37:37.857295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"53'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.099893+0000","last_change":"2023-11-04T01:41:53.076436+0000","last_active":"2023-11-04T01:41:54.099893+0000","last_peered":"2023-11-04T01:41:54.099893+0000","last_clean":"2023-11-04T01:41:54.099893+0000","last_became_active":"2023-11-04T01:41:53.076135+0000","last_became_peered":"2023-11-04T01:41:53.076135+0000","last_unstale":"2023-11-04T01:41:54.099893+0000","last_undegraded":"2023-11-04T01:41:54.099893+0000","last_fullsized":"2023-11-04T01:41:54.099893+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:32:44.078800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":28,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.073122+0000","last_change":"2023-11-04T01:41:36.243977+0000","last_active":"2023-11-04T01:41:54.073122+0000","last_peered":"2023-11-04T01:41:54.073122+0000","last_clean":"2023-11-04T01:41:54.073122+0000","last_became_active":"2023-11-04T01:41:34.733127+0000","last_became_peered":"2023-11-04T01:41:34.733127+0000","last_unstale":"2023-11-04T01:41:54.073122+0000","last_undegraded":"2023-11-04T01:41:54.073122+0000","last_fullsized":"2023-11-04T01:41:54.073122+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:36.118907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051788300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590302+0000","last_change":"2023-11-04T01:41:54.089679+0000","last_active":"2023-11-04T01:41:56.590302+0000","last_peered":"2023-11-04T01:41:56.590302+0000","last_clean":"2023-11-04T01:41:56.590302+0000","last_became_active":"2023-11-04T01:41:54.087983+0000","last_became_peered":"2023-11-04T01:41:54.087983+0000","last_unstale":"2023-11-04T01:41:56.590302+0000","last_undegraded":"2023-11-04T01:41:56.590302+0000","last_fullsized":"2023-11-04T01:41:56.590302+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:02:33.389340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.074953+0000","last_change":"2023-11-04T01:41:53.077963+0000","last_active":"2023-11-04T01:41:54.074953+0000","last_peered":"2023-11-04T01:41:54.074953+0000","last_clean":"2023-11-04T01:41:54.074953+0000","last_became_active":"2023-11-04T01:41:53.077696+0000","last_became_peered":"2023-11-04T01:41:53.077696+0000","last_unstale":"2023-11-04T01:41:54.074953+0000","last_undegraded":"2023-11-04T01:41:54.074953+0000","last_fullsized":"2023-11-04T01:41:54.074953+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:12:15.708878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.069594+0000","last_change":"2023-11-04T01:41:36.067797+0000","last_active":"2023-11-04T01:41:54.069594+0000","last_peered":"2023-11-04T01:41:54.069594+0000","last_clean":"2023-11-04T01:41:54.069594+0000","last_became_active":"2023-11-04T01:41:34.734880+0000","last_became_peered":"2023-11-04T01:41:34.734880+0000","last_unstale":"2023-11-04T01:41:54.069594+0000","last_undegraded":"2023-11-04T01:41:54.069594+0000","last_fullsized":"2023-11-04T01:41:54.069594+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:20.089706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036003499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.081521+0000","last_change":"2023-11-04T01:41:54.081767+0000","last_active":"2023-11-04T01:41:55.081521+0000","last_peered":"2023-11-04T01:41:55.081521+0000","last_clean":"2023-11-04T01:41:55.081521+0000","last_became_active":"2023-11-04T01:41:54.081486+0000","last_became_peered":"2023-11-04T01:41:54.081486+0000","last_unstale":"2023-11-04T01:41:55.081521+0000","last_undegraded":"2023-11-04T01:41:55.081521+0000","last_fullsized":"2023-11-04T01:41:55.081521+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:11:40.760885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.331460+0000","last_change":"2023-11-04T01:41:53.077939+0000","last_active":"2023-11-04T01:41:56.331460+0000","last_peered":"2023-11-04T01:41:56.331460+0000","last_clean":"2023-11-04T01:41:56.331460+0000","last_became_active":"2023-11-04T01:41:53.077680+0000","last_became_peered":"2023-11-04T01:41:53.077680+0000","last_unstale":"2023-11-04T01:41:56.331460+0000","last_undegraded":"2023-11-04T01:41:56.331460+0000","last_fullsized":"2023-11-04T01:41:56.331460+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:06:03.625159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.073784+0000","last_change":"2023-11-04T01:41:35.729089+0000","last_active":"2023-11-04T01:41:54.073784+0000","last_peered":"2023-11-04T01:41:54.073784+0000","last_clean":"2023-11-04T01:41:54.073784+0000","last_became_active":"2023-11-04T01:41:34.731063+0000","last_became_peered":"2023-11-04T01:41:34.731063+0000","last_unstale":"2023-11-04T01:41:54.073784+0000","last_undegraded":"2023-11-04T01:41:54.073784+0000","last_fullsized":"2023-11-04T01:41:54.073784+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:38:46.633175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083653600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589953+0000","last_change":"2023-11-04T01:41:54.086778+0000","last_active":"2023-11-04T01:41:56.589953+0000","last_peered":"2023-11-04T01:41:56.589953+0000","last_clean":"2023-11-04T01:41:56.589953+0000","last_became_active":"2023-11-04T01:41:54.086492+0000","last_became_peered":"2023-11-04T01:41:54.086492+0000","last_unstale":"2023-11-04T01:41:56.589953+0000","last_undegraded":"2023-11-04T01:41:56.589953+0000","last_fullsized":"2023-11-04T01:41:56.589953+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:09:20.408298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.069075+0000","last_change":"2023-11-04T01:41:53.078264+0000","last_active":"2023-11-04T01:41:54.069075+0000","last_peered":"2023-11-04T01:41:54.069075+0000","last_clean":"2023-11-04T01:41:54.069075+0000","last_became_active":"2023-11-04T01:41:53.077978+0000","last_became_peered":"2023-11-04T01:41:53.077978+0000","last_unstale":"2023-11-04T01:41:54.069075+0000","last_undegraded":"2023-11-04T01:41:54.069075+0000","last_fullsized":"2023-11-04T01:41:54.069075+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:52:08.757521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":29,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.069956+0000","last_change":"2023-11-04T01:41:35.729232+0000","last_active":"2023-11-04T01:41:54.069956+0000","last_peered":"2023-11-04T01:41:54.069956+0000","last_clean":"2023-11-04T01:41:54.069956+0000","last_became_active":"2023-11-04T01:41:34.731490+0000","last_became_peered":"2023-11-04T01:41:34.731490+0000","last_unstale":"2023-11-04T01:41:54.069956+0000","last_undegraded":"2023-11-04T01:41:54.069956+0000","last_fullsized":"2023-11-04T01:41:54.069956+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:37.958719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089653699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.084708+0000","last_change":"2023-11-04T01:41:54.085819+0000","last_active":"2023-11-04T01:41:55.084708+0000","last_peered":"2023-11-04T01:41:55.084708+0000","last_clean":"2023-11-04T01:41:55.084708+0000","last_became_active":"2023-11-04T01:41:54.085516+0000","last_became_peered":"2023-11-04T01:41:54.085516+0000","last_unstale":"2023-11-04T01:41:55.084708+0000","last_undegraded":"2023-11-04T01:41:55.084708+0000","last_fullsized":"2023-11-04T01:41:55.084708+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:39:56.014413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590820+0000","last_change":"2023-11-04T01:41:53.078721+0000","last_active":"2023-11-04T01:41:56.590820+0000","last_peered":"2023-11-04T01:41:56.590820+0000","last_clean":"2023-11-04T01:41:56.590820+0000","last_became_active":"2023-11-04T01:41:53.078424+0000","last_became_peered":"2023-11-04T01:41:53.078424+0000","last_unstale":"2023-11-04T01:41:56.590820+0000","last_undegraded":"2023-11-04T01:41:56.590820+0000","last_fullsized":"2023-11-04T01:41:56.590820+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:45:35.156451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.077159+0000","last_change":"2023-11-04T01:41:36.344018+0000","last_active":"2023-11-04T01:41:54.077159+0000","last_peered":"2023-11-04T01:41:54.077159+0000","last_clean":"2023-11-04T01:41:54.077159+0000","last_became_active":"2023-11-04T01:41:34.734178+0000","last_became_peered":"2023-11-04T01:41:34.734178+0000","last_unstale":"2023-11-04T01:41:54.077159+0000","last_undegraded":"2023-11-04T01:41:54.077159+0000","last_fullsized":"2023-11-04T01:41:54.077159+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:16.970814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077338299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590497+0000","last_change":"2023-11-04T01:41:54.087444+0000","last_active":"2023-11-04T01:41:56.590497+0000","last_peered":"2023-11-04T01:41:56.590497+0000","last_clean":"2023-11-04T01:41:56.590497+0000","last_became_active":"2023-11-04T01:41:54.087173+0000","last_became_peered":"2023-11-04T01:41:54.087173+0000","last_unstale":"2023-11-04T01:41:56.590497+0000","last_undegraded":"2023-11-04T01:41:56.590497+0000","last_fullsized":"2023-11-04T01:41:56.590497+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:45:36.163381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.075308+0000","last_change":"2023-11-04T01:41:53.079761+0000","last_active":"2023-11-04T01:41:54.075308+0000","last_peered":"2023-11-04T01:41:54.075308+0000","last_clean":"2023-11-04T01:41:54.075308+0000","last_became_active":"2023-11-04T01:41:53.079506+0000","last_became_peered":"2023-11-04T01:41:53.079506+0000","last_unstale":"2023-11-04T01:41:54.075308+0000","last_undegraded":"2023-11-04T01:41:54.075308+0000","last_fullsized":"2023-11-04T01:41:54.075308+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:14:16.043835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":25,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.074187+0000","last_change":"2023-11-04T01:41:35.906788+0000","last_active":"2023-11-04T01:41:54.074187+0000","last_peered":"2023-11-04T01:41:54.074187+0000","last_clean":"2023-11-04T01:41:54.074187+0000","last_became_active":"2023-11-04T01:41:34.734386+0000","last_became_peered":"2023-11-04T01:41:34.734386+0000","last_unstale":"2023-11-04T01:41:54.074187+0000","last_undegraded":"2023-11-04T01:41:54.074187+0000","last_fullsized":"2023-11-04T01:41:54.074187+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:23:23.733128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060435600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085258+0000","last_change":"2023-11-04T01:41:54.086713+0000","last_active":"2023-11-04T01:41:55.085258+0000","last_peered":"2023-11-04T01:41:55.085258+0000","last_clean":"2023-11-04T01:41:55.085258+0000","last_became_active":"2023-11-04T01:41:54.085354+0000","last_became_peered":"2023-11-04T01:41:54.085354+0000","last_unstale":"2023-11-04T01:41:55.085258+0000","last_undegraded":"2023-11-04T01:41:55.085258+0000","last_fullsized":"2023-11-04T01:41:55.085258+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:09:20.408298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590566+0000","last_change":"2023-11-04T01:41:53.081857+0000","last_active":"2023-11-04T01:41:56.590566+0000","last_peered":"2023-11-04T01:41:56.590566+0000","last_clean":"2023-11-04T01:41:56.590566+0000","last_became_active":"2023-11-04T01:41:53.081578+0000","last_became_peered":"2023-11-04T01:41:53.081578+0000","last_unstale":"2023-11-04T01:41:56.590566+0000","last_undegraded":"2023-11-04T01:41:56.590566+0000","last_fullsized":"2023-11-04T01:41:56.590566+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:13:12.033711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.067619+0000","last_change":"2023-11-04T01:41:35.931718+0000","last_active":"2023-11-04T01:41:54.067619+0000","last_peered":"2023-11-04T01:41:54.067619+0000","last_clean":"2023-11-04T01:41:54.067619+0000","last_became_active":"2023-11-04T01:41:34.741033+0000","last_became_peered":"2023-11-04T01:41:34.741033+0000","last_unstale":"2023-11-04T01:41:54.067619+0000","last_undegraded":"2023-11-04T01:41:54.067619+0000","last_fullsized":"2023-11-04T01:41:54.067619+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:48.121273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065858400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085410+0000","last_change":"2023-11-04T01:41:54.082720+0000","last_active":"2023-11-04T01:41:55.085410+0000","last_peered":"2023-11-04T01:41:55.085410+0000","last_clean":"2023-11-04T01:41:55.085410+0000","last_became_active":"2023-11-04T01:41:54.081261+0000","last_became_peered":"2023-11-04T01:41:54.081261+0000","last_unstale":"2023-11-04T01:41:55.085410+0000","last_undegraded":"2023-11-04T01:41:55.085410+0000","last_fullsized":"2023-11-04T01:41:55.085410+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:39:56.014413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"53'1","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590678+0000","last_change":"2023-11-04T01:41:53.079732+0000","last_active":"2023-11-04T01:41:56.590678+0000","last_peered":"2023-11-04T01:41:56.590678+0000","last_clean":"2023-11-04T01:41:56.590678+0000","last_became_active":"2023-11-04T01:41:53.079465+0000","last_became_peered":"2023-11-04T01:41:53.079465+0000","last_unstale":"2023-11-04T01:41:56.590678+0000","last_undegraded":"2023-11-04T01:41:56.590678+0000","last_fullsized":"2023-11-04T01:41:56.590678+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:09:19.401368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":25,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.075397+0000","last_change":"2023-11-04T01:41:35.728094+0000","last_active":"2023-11-04T01:41:54.075397+0000","last_peered":"2023-11-04T01:41:54.075397+0000","last_clean":"2023-11-04T01:41:54.075397+0000","last_became_active":"2023-11-04T01:41:34.738687+0000","last_became_peered":"2023-11-04T01:41:34.738687+0000","last_unstale":"2023-11-04T01:41:54.075397+0000","last_undegraded":"2023-11-04T01:41:54.075397+0000","last_fullsized":"2023-11-04T01:41:54.075397+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:37.958719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068772699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085802+0000","last_change":"2023-11-04T01:41:54.084706+0000","last_active":"2023-11-04T01:41:55.085802+0000","last_peered":"2023-11-04T01:41:55.085802+0000","last_clean":"2023-11-04T01:41:55.085802+0000","last_became_active":"2023-11-04T01:41:54.083966+0000","last_became_peered":"2023-11-04T01:41:54.083966+0000","last_unstale":"2023-11-04T01:41:55.085802+0000","last_undegraded":"2023-11-04T01:41:55.085802+0000","last_fullsized":"2023-11-04T01:41:55.085802+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:49.436809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590444+0000","last_change":"2023-11-04T01:41:53.081813+0000","last_active":"2023-11-04T01:41:56.590444+0000","last_peered":"2023-11-04T01:41:56.590444+0000","last_clean":"2023-11-04T01:41:56.590444+0000","last_became_active":"2023-11-04T01:41:53.081521+0000","last_became_peered":"2023-11-04T01:41:53.081521+0000","last_unstale":"2023-11-04T01:41:56.590444+0000","last_undegraded":"2023-11-04T01:41:56.590444+0000","last_fullsized":"2023-11-04T01:41:56.590444+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:32:11.738014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.077195+0000","last_change":"2023-11-04T01:41:35.729106+0000","last_active":"2023-11-04T01:41:54.077195+0000","last_peered":"2023-11-04T01:41:54.077195+0000","last_clean":"2023-11-04T01:41:54.077195+0000","last_became_active":"2023-11-04T01:41:34.731230+0000","last_became_peered":"2023-11-04T01:41:34.731230+0000","last_unstale":"2023-11-04T01:41:54.077195+0000","last_undegraded":"2023-11-04T01:41:54.077195+0000","last_fullsized":"2023-11-04T01:41:54.077195+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:07:32.744572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078592199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.590168+0000","last_change":"2023-11-04T01:41:54.085266+0000","last_active":"2023-11-04T01:41:56.590168+0000","last_peered":"2023-11-04T01:41:56.590168+0000","last_clean":"2023-11-04T01:41:56.590168+0000","last_became_active":"2023-11-04T01:41:54.085007+0000","last_became_peered":"2023-11-04T01:41:54.085007+0000","last_unstale":"2023-11-04T01:41:56.590168+0000","last_undegraded":"2023-11-04T01:41:56.590168+0000","last_fullsized":"2023-11-04T01:41:56.590168+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:12:13.435625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"53'1","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.097091+0000","last_change":"2023-11-04T01:41:53.078346+0000","last_active":"2023-11-04T01:41:54.097091+0000","last_peered":"2023-11-04T01:41:54.097091+0000","last_clean":"2023-11-04T01:41:54.097091+0000","last_became_active":"2023-11-04T01:41:53.078087+0000","last_became_peered":"2023-11-04T01:41:53.078087+0000","last_unstale":"2023-11-04T01:41:54.097091+0000","last_undegraded":"2023-11-04T01:41:54.097091+0000","last_fullsized":"2023-11-04T01:41:54.097091+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:31:22.001930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.073871+0000","last_change":"2023-11-04T01:41:35.728672+0000","last_active":"2023-11-04T01:41:54.073871+0000","last_peered":"2023-11-04T01:41:54.073871+0000","last_clean":"2023-11-04T01:41:54.073871+0000","last_became_active":"2023-11-04T01:41:34.727419+0000","last_became_peered":"2023-11-04T01:41:34.727419+0000","last_unstale":"2023-11-04T01:41:54.073871+0000","last_undegraded":"2023-11-04T01:41:54.073871+0000","last_fullsized":"2023-11-04T01:41:54.073871+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:35:01.127206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044278299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.589451+0000","last_change":"2023-11-04T01:41:54.091623+0000","last_active":"2023-11-04T01:41:56.589451+0000","last_peered":"2023-11-04T01:41:56.589451+0000","last_clean":"2023-11-04T01:41:56.589451+0000","last_became_active":"2023-11-04T01:41:54.091377+0000","last_became_peered":"2023-11-04T01:41:54.091377+0000","last_unstale":"2023-11-04T01:41:56.589451+0000","last_undegraded":"2023-11-04T01:41:56.589451+0000","last_fullsized":"2023-11-04T01:41:56.589451+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:53.052574+0000","last_clean_scrub_stamp":"2023-11-04T01:41:53.052574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:14:51.971313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:56.331242+0000","last_change":"2023-11-04T01:41:53.079198+0000","last_active":"2023-11-04T01:41:56.331242+0000","last_peered":"2023-11-04T01:41:56.331242+0000","last_clean":"2023-11-04T01:41:56.331242+0000","last_became_active":"2023-11-04T01:41:53.078904+0000","last_became_peered":"2023-11-04T01:41:53.078904+0000","last_unstale":"2023-11-04T01:41:56.331242+0000","last_undegraded":"2023-11-04T01:41:56.331242+0000","last_fullsized":"2023-11-04T01:41:56.331242+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:52.045644+0000","last_clean_scrub_stamp":"2023-11-04T01:41:52.045644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:37.695110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":26,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-11-04T01:41:54.076482+0000","last_change":"2023-11-04T01:41:36.344271+0000","last_active":"2023-11-04T01:41:54.076482+0000","last_peered":"2023-11-04T01:41:54.076482+0000","last_clean":"2023-11-04T01:41:54.076482+0000","last_became_active":"2023-11-04T01:41:34.732524+0000","last_became_peered":"2023-11-04T01:41:34.732524+0000","last_unstale":"2023-11-04T01:41:54.076482+0000","last_undegraded":"2023-11-04T01:41:54.076482+0000","last_fullsized":"2023-11-04T01:41:54.076482+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:19.350812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081160599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":200,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-11-04T01:41:55.085780+0000","last_change":"2023-11-04T01:39:54.204460+0000","last_active":"2023-11-04T01:41:55.085780+0000","last_peered":"2023-11-04T01:41:55.085780+0000","last_clean":"2023-11-04T01:41:55.085780+0000","last_became_active":"2023-11-04T01:39:54.203352+0000","last_became_peered":"2023-11-04T01:39:54.203352+0000","last_unstale":"2023-11-04T01:41:55.085780+0000","last_undegraded":"2023-11-04T01:41:55.085780+0000","last_fullsized":"2023-11-04T01:41:55.085780+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:52.627032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:52.627032+0000","last_clean_scrub_stamp":"2023-11-04T01:39:52.627032+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:17:18.474768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":293364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53500000000000003,"15min":0.53800000000000003},"min":{"1min":0.40400000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.70199999999999996,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.499,"15min":0.497},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.53500000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55300000000000005,"15min":0.55200000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.71999999999999997,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.68300000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57099999999999995,"15min":0.57499999999999996},"min":{"1min":0.375,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.752,"5min":1.177,"15min":1.177},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55000000000000004,"15min":0.55400000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.66300000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.76200000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.63100000000000001,"15min":0.63600000000000001},"min":{"1min":0.49199999999999999,"5min":0.435,"15min":0.435},"max":{"1min":0.79800000000000004,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.63100000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.318,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77400000000000002,"5min":1.048,"15min":1.048},"last":0.432},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.32900000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.75700000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.39100000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.438,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.71399999999999997,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.61499999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.56999999999999995,"15min":0.55900000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.627,"15min":0.624},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.71599999999999997}]}]},{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28244,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343596,"statfs":{"total":96636764160,"available":96607842304,"internally_reserved":0,"allocated":1245184,"data_stored":883240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.53200000000000003,"15min":0.51600000000000001},"min":{"1min":0.38100000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.48099999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.42399999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83599999999999997,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.63200000000000001,"15min":0.61599999999999999},"min":{"1min":0.46800000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.5049999999999999,"5min":2.5049999999999999,"15min":2.5049999999999999},"last":0.56699999999999995}]},{"osd":2,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.59299999999999997,"15min":0.58499999999999996},"min":{"1min":0.42799999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.621,"15min":0.60399999999999998},"min":{"1min":0.50800000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.66600000000000004}]},{"osd":3,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.58599999999999997,"15min":0.56499999999999995},"min":{"1min":0.40100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":3.2349999999999999,"5min":3.2349999999999999,"15min":3.2349999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.37,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79200000000000004,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.63600000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.5,"15min":0.48599999999999999},"min":{"1min":0.308,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.47999999999999998,"15min":0.46999999999999997},"min":{"1min":0.36599999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.42699999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.52400000000000002,"15min":0.503},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.55200000000000005,"15min":0.53000000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":2.4500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.53900000000000003}]},{"osd":6,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.623,"15min":0.58899999999999997},"min":{"1min":0.39700000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":3.7850000000000001,"5min":3.7850000000000001,"15min":3.7850000000000001},"last":0.62},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.56999999999999995,"15min":0.55400000000000005},"min":{"1min":0.39200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.60299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":643072,"data_stored":292712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.40200000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.67100000000000004,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40000000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.64900000000000002,"5min":0.752,"15min":0.752},"last":0.56799999999999995}]},{"osd":1,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56100000000000005,"15min":0.56599999999999995},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.72899999999999998,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.38,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.55900000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.35299999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.69499999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57399999999999995,"15min":0.57899999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.67900000000000005,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.42699999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.47299999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.67400000000000004,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57999999999999996,"15min":0.57899999999999996},"min":{"1min":0.434,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.72799999999999998,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.63500000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.376},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.746,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.45500000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78800000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58499999999999996,"15min":0.58599999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77600000000000002,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.442}]},{"osd":7,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.749,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61599999999999999,"15min":0.621},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82399999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.54600000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":655360,"data_stored":294324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.505,"15min":0.502},"min":{"1min":0.32000000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66200000000000003,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.438},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51200000000000001,"15min":0.50800000000000001},"min":{"1min":0.33900000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.68700000000000006,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.57899999999999996}]},{"osd":1,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.49099999999999999,"15min":0.48299999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.69899999999999995,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.42299999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.67300000000000004,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.47299999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.53900000000000003},"min":{"1min":0.40300000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71099999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53400000000000003,"15min":0.53500000000000003},"min":{"1min":0.41499999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.67700000000000005,"5min":0.873,"15min":0.873},"last":0.52000000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53300000000000003,"15min":0.53400000000000003},"min":{"1min":0.39200000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.69299999999999995,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.74299999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.45300000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.47999999999999998,"15min":0.48299999999999998},"min":{"1min":0.34100000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.379},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.50600000000000001,"15min":0.50900000000000001},"min":{"1min":0.371,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66500000000000004,"5min":0.745,"15min":0.745},"last":0.39500000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.49299999999999999,"15min":0.497},"min":{"1min":0.34499999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.72399999999999998,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.755,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.33800000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.40699999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.751,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.34899999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.747,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.55900000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":651264,"data_stored":292768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.31900000000000001,"15min":0.317},"min":{"1min":0.20599999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.312},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.32800000000000001,"15min":0.32200000000000001},"min":{"1min":0.23699999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.40400000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.36599999999999999,"15min":0.372},"min":{"1min":0.23899999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.48499999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.58699999999999997,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.36399999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.36799999999999999,"15min":0.36699999999999999},"min":{"1min":0.28199999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.52700000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.42199999999999999,"15min":0.42699999999999999},"min":{"1min":0.30299999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.50900000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.432}]},{"osd":4,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.81599999999999995,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58399999999999996,"15min":0.58799999999999997},"min":{"1min":0.40500000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.64300000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58699999999999997,"15min":0.59399999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79400000000000004,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.60899999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57699999999999996,"15min":0.58099999999999996},"min":{"1min":0.373,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77100000000000002,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60999999999999999,"15min":0.61599999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85199999999999998,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.755}]},{"osd":7,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.626,"15min":0.628},"min":{"1min":0.46400000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58599999999999997,"15min":0.58899999999999997},"min":{"1min":0.40000000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83199999999999996,"5min":0.87,"15min":0.87},"last":0.628}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":651264,"data_stored":292768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.32000000000000001,"15min":0.32200000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.47999999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.36899999999999999,"15min":0.371},"min":{"1min":0.245,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.373,"15min":0.378},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.42199999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.42199999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.34999999999999998,"15min":0.35499999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.46600000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.29499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.53400000000000003}]},{"osd":4,"last update":"Sat Nov 4 01:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.55500000000000005,"15min":0.54700000000000004},"min":{"1min":0.41599999999999998,"5min":0.374,"15min":0.374},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.64800000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.378,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.41499999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.72899999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58299999999999996,"15min":0.57999999999999996},"min":{"1min":0.43099999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.55900000000000005,"15min":0.55400000000000005},"min":{"1min":0.42199999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.68500000000000005}]},{"osd":7,"last update":"Sat Nov 4 01:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60099999999999998,"15min":0.59999999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.66500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":647168,"data_stored":292802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.443,"5min":0.443,"15min":0.443},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"last":0.33000000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.31}]},{"osd":3,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.35099999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.39300000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.441},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.46300000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.42699999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:40:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.496},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.48699999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28240,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343600,"statfs":{"total":96636764160,"available":96607846400,"internally_reserved":0,"allocated":1249280,"data_stored":884255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.33000000000000002,"15min":0.33400000000000002},"min":{"1min":0.20799999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.40000000000000002,"5min":0.874,"15min":0.874},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.38500000000000001,"15min":0.39200000000000002},"min":{"1min":0.28799999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.496,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.35199999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.36799999999999999,"15min":0.379},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.44900000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.37,"15min":0.377},"min":{"1min":0.27100000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.41999999999999998,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.378}]},{"osd":3,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.35599999999999998,"15min":0.35999999999999999},"min":{"1min":0.248,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.44600000000000001,"5min":1.278,"15min":1.278},"last":0.308},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.434,"15min":0.442},"min":{"1min":0.33000000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.52900000000000003,"5min":1.304,"15min":1.304},"last":0.39400000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81799999999999995,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.629,"15min":0.627},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.83399999999999996,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.58999999999999997}]},{"osd":5,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.378,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.59899999999999998,"15min":0.60499999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.873,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.65200000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.622,"15min":0.621},"min":{"1min":0.41799999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90200000000000002,"5min":1.248,"15min":1.248},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42899999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.58099999999999996}]},{"osd":7,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.62,"15min":0.622},"min":{"1min":0.42999999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.629}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:42:01.716 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T01:42:01.717 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-04T01:42:01.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.852+0000 7f3d5c797640 1 Processor -- start 2023-11-04T01:42:01.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.852+0000 7f3d5c797640 1 -- start start 2023-11-04T01:42:01.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.853+0000 7f3d5c797640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3d5415ad30 0x7f3d540adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.853+0000 7f3d5c797640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3d54070e20 0x7f3d5415e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.853+0000 7f3d5c797640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d540c3900 con 0x7f3d540ad730 2023-11-04T01:42:01.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.853+0000 7f3d5c797640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d540ae260 con 0x7f3d5415ad30 2023-11-04T01:42:01.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.853+0000 7f3d5c797640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d540c3be0 con 0x7f3d54070e20 2023-11-04T01:42:01.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.853+0000 7f3d59d32640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f3d540ad730 0x7f3d54070710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:42730/0 (socket says 172.21.15.77:42730) 2023-11-04T01:42:01.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.853+0000 7f3d59d32640 1 -- 172.21.15.77:0/3661432473 learned_addr learned my addr 172.21.15.77:0/3661432473 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:01.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.854+0000 7f3d5a533640 1 --2- 172.21.15.77:0/3661432473 >> v2:172.21.15.122:3300/0 conn(0x7f3d5415ad30 0x7f3d540adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.854+0000 7f3d5ad34640 1 --2- 172.21.15.77:0/3661432473 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3d54070e20 0x7f3d5415e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.854+0000 7f3d59531640 1 -- 172.21.15.77:0/3661432473 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3980186452 0 0) 0x7f3d540c3900 con 0x7f3d540ad730 2023-11-04T01:42:01.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.854+0000 7f3d59531640 1 -- 172.21.15.77:0/3661432473 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d40003520 con 0x7f3d540ad730 2023-11-04T01:42:01.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.854+0000 7f3d59531640 1 -- 172.21.15.77:0/3661432473 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1606994509 0 0) 0x7f3d40003520 con 0x7f3d540ad730 2023-11-04T01:42:01.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.854+0000 7f3d59531640 1 -- 172.21.15.77:0/3661432473 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3d54070e20 msgr2=0x7f3d5415e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:01.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.854+0000 7f3d59531640 1 --2- 172.21.15.77:0/3661432473 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3d54070e20 0x7f3d5415e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.854+0000 7f3d59531640 1 -- 172.21.15.77:0/3661432473 >> v2:172.21.15.122:3300/0 conn(0x7f3d5415ad30 msgr2=0x7f3d540adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:01.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.854+0000 7f3d59531640 1 --2- 172.21.15.77:0/3661432473 >> v2:172.21.15.122:3300/0 conn(0x7f3d5415ad30 0x7f3d540adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.854+0000 7f3d59531640 1 -- 172.21.15.77:0/3661432473 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d540c3ec0 con 0x7f3d540ad730 2023-11-04T01:42:01.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.854+0000 7f3d59531640 1 -- 172.21.15.77:0/3661432473 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f3d44001670 con 0x7f3d540ad730 2023-11-04T01:42:01.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.854+0000 7f3d59531640 1 -- 172.21.15.77:0/3661432473 >> v1:172.21.15.77:6789/0 conn(0x7f3d540ad730 legacy=0x7f3d54070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.854+0000 7f3d59531640 1 --2- 172.21.15.77:0/3661432473 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d40003970 0x7f3d40003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.854+0000 7f3d59531640 1 --2- 172.21.15.77:0/3661432473 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3d54070e20 0x7f3d400047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.854+0000 7f3d59531640 1 --2- 172.21.15.77:0/3661432473 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d40004d00 0x7f3d40005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.854+0000 7f3d59531640 1 -- 172.21.15.77:0/3661432473 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d540ae260 con 0x7f3d40004d00 2023-11-04T01:42:01.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.854+0000 7f3d59531640 1 -- 172.21.15.77:0/3661432473 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d540c3be0 con 0x7f3d40003970 2023-11-04T01:42:01.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.854+0000 7f3d59531640 1 -- 172.21.15.77:0/3661432473 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4000b9d0 con 0x7f3d54070e20 2023-11-04T01:42:01.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.854+0000 7f3d5ad34640 1 --2- 172.21.15.77:0/3661432473 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d40004d00 0x7f3d40005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.854+0000 7f3d5a533640 1 --2- 172.21.15.77:0/3661432473 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d40003970 0x7f3d40003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.854+0000 7f3d59d32640 1 --2- 172.21.15.77:0/3661432473 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3d54070e20 0x7f3d400047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.854+0000 7f3d5ad34640 1 -- 172.21.15.77:0/3661432473 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3d54070e20 msgr2=0x7f3d400047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:01.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.854+0000 7f3d5ad34640 1 --2- 172.21.15.77:0/3661432473 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3d54070e20 0x7f3d400047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.854+0000 7f3d5ad34640 1 -- 172.21.15.77:0/3661432473 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d40003970 msgr2=0x7f3d40003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:01.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.854+0000 7f3d5ad34640 1 --2- 172.21.15.77:0/3661432473 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d40003970 0x7f3d40003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.854+0000 7f3d5ad34640 1 -- 172.21.15.77:0/3661432473 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d40003520 con 0x7f3d40004d00 2023-11-04T01:42:01.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.855+0000 7f3d5ad34640 1 --2- 172.21.15.77:0/3661432473 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d40004d00 0x7f3d40005180 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c009af0 tx=0x7f3d400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e118964aa68b9d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:01.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.855+0000 7f3d59531640 1 -- 172.21.15.77:0/3661432473 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c02c6b0 con 0x7f3d40004d00 2023-11-04T01:42:01.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.855+0000 7f3d59531640 1 -- 172.21.15.77:0/3661432473 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4c02c810 con 0x7f3d40004d00 2023-11-04T01:42:01.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.855+0000 7f3d59531640 1 -- 172.21.15.77:0/3661432473 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c02cba0 con 0x7f3d40004d00 2023-11-04T01:42:01.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.856+0000 7f3d5c797640 1 -- 172.21.15.77:0/3661432473 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d40004d00 msgr2=0x7f3d40005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.856+0000 7f3d5c797640 1 --2- 172.21.15.77:0/3661432473 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d40004d00 0x7f3d40005180 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c009af0 tx=0x7f3d400057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.856+0000 7f3d5ad34640 1 -- 172.21.15.77:0/3661432473 reap_dead start 2023-11-04T01:42:01.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.856+0000 7f3d5c797640 1 -- 172.21.15.77:0/3661432473 shutdown_connections 2023-11-04T01:42:01.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.856+0000 7f3d5c797640 1 -- 172.21.15.77:0/3661432473 >> 172.21.15.77:0/3661432473 conn(0x7f3d540ce950 msgr2=0x7f3d540ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:01.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.856+0000 7f3d5c797640 1 -- 172.21.15.77:0/3661432473 shutdown_connections 2023-11-04T01:42:01.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.856+0000 7f3d5c797640 1 -- 172.21.15.77:0/3661432473 wait complete. 2023-11-04T01:42:01.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.857+0000 7f3d5c797640 1 Processor -- start 2023-11-04T01:42:01.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.857+0000 7f3d5c797640 1 -- start start 2023-11-04T01:42:01.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.858+0000 7f3d5c797640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d40004d00 0x7f3d5414cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.858+0000 7f3d5c797640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d5414ee80 0x7f3d5414e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.858+0000 7f3d5c797640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3d54150400 0x7f3d54154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.858+0000 7f3d5c797640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5414d270 con 0x7f3d5414ee80 2023-11-04T01:42:01.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.858+0000 7f3d5c797640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5414f360 con 0x7f3d40004d00 2023-11-04T01:42:01.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.858+0000 7f3d5c797640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5414f640 con 0x7f3d54150400 2023-11-04T01:42:01.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.858+0000 7f3d59d32640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d5414ee80 0x7f3d5414e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.858+0000 7f3d59d32640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d5414ee80 0x7f3d5414e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56768/0 (socket says 172.21.15.77:56768) 2023-11-04T01:42:01.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.858+0000 7f3d59d32640 1 -- 172.21.15.77:0/2458576191 learned_addr learned my addr 172.21.15.77:0/2458576191 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:01.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.858+0000 7f3d5a533640 1 --2- 172.21.15.77:0/2458576191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d40004d00 0x7f3d5414cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.858+0000 7f3d5ad34640 1 --2- 172.21.15.77:0/2458576191 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3d54150400 0x7f3d54154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.858+0000 7f3d59d32640 1 -- 172.21.15.77:0/2458576191 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3d54150400 msgr2=0x7f3d54154760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.858+0000 7f3d59d32640 1 --2- 172.21.15.77:0/2458576191 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3d54150400 0x7f3d54154760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.858+0000 7f3d59d32640 1 -- 172.21.15.77:0/2458576191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d40004d00 msgr2=0x7f3d5414cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.858+0000 7f3d59d32640 1 --2- 172.21.15.77:0/2458576191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d40004d00 0x7f3d5414cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.858+0000 7f3d59d32640 1 -- 172.21.15.77:0/2458576191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5414f920 con 0x7f3d5414ee80 2023-11-04T01:42:01.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.858+0000 7f3d59d32640 1 --2- 172.21.15.77:0/2458576191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d5414ee80 0x7f3d5414e1b0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f3d44007310 tx=0x7f3d440077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:01.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.858+0000 7f3d4affd640 1 -- 172.21.15.77:0/2458576191 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4400f9c0 con 0x7f3d5414ee80 2023-11-04T01:42:01.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.858+0000 7f3d4affd640 1 -- 172.21.15.77:0/2458576191 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4400fb20 con 0x7f3d5414ee80 2023-11-04T01:42:01.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.858+0000 7f3d5c797640 1 -- 172.21.15.77:0/2458576191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d5414fc00 con 0x7f3d5414ee80 2023-11-04T01:42:01.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.858+0000 7f3d4affd640 1 -- 172.21.15.77:0/2458576191 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4400feb0 con 0x7f3d5414ee80 2023-11-04T01:42:01.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.858+0000 7f3d5c797640 1 -- 172.21.15.77:0/2458576191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d5414e6f0 con 0x7f3d5414ee80 2023-11-04T01:42:01.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.859+0000 7f3d5c797640 1 -- 172.21.15.77:0/2458576191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d54150120 con 0x7f3d5414ee80 2023-11-04T01:42:01.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.860+0000 7f3d4affd640 1 -- 172.21.15.77:0/2458576191 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3d4401d460 con 0x7f3d5414ee80 2023-11-04T01:42:01.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.860+0000 7f3d4affd640 1 --2- 172.21.15.77:0/2458576191 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3d3806aea0 0x7f3d3806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.860+0000 7f3d4affd640 1 -- 172.21.15.77:0/2458576191 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3d44089910 con 0x7f3d5414ee80 2023-11-04T01:42:01.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.860+0000 7f3d5a533640 1 --2- 172.21.15.77:0/2458576191 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3d3806aea0 0x7f3d3806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.861+0000 7f3d5a533640 1 --2- 172.21.15.77:0/2458576191 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3d3806aea0 0x7f3d3806d360 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3d54154700 tx=0x7f3d5000b040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:01.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:01.864+0000 7f3d4affd640 1 -- 172.21.15.77:0/2458576191 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3d54150120 con 0x7f3d5414ee80 2023-11-04T01:42:02.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.096+0000 7f3d5c797640 1 -- 172.21.15.77:0/2458576191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f3d54150120 con 0x7f3d5414ee80 2023-11-04T01:42:02.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.098+0000 7f3d4affd640 1 -- 172.21.15.77:0/2458576191 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f3d54150120 con 0x7f3d5414ee80 2023-11-04T01:42:02.100 INFO:teuthology.orchestra.run.smithi077.stdout:[client.0] 2023-11-04T01:42:02.100 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQC2oEVlChU2FxAAt1/aJZOrufjVZhraPqv1Gw== 2023-11-04T01:42:02.100 INFO:teuthology.orchestra.run.smithi077.stdout: caps mds = "allow" 2023-11-04T01:42:02.100 INFO:teuthology.orchestra.run.smithi077.stdout: caps mon = "allow r" 2023-11-04T01:42:02.101 INFO:teuthology.orchestra.run.smithi077.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-04T01:42:02.102 INFO:teuthology.orchestra.run.smithi077.stderr:updated caps for client.0 2023-11-04T01:42:02.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.100+0000 7f3d5c797640 1 -- 172.21.15.77:0/2458576191 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3d3806aea0 msgr2=0x7f3d3806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.100+0000 7f3d5c797640 1 --2- 172.21.15.77:0/2458576191 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3d3806aea0 0x7f3d3806d360 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3d54154700 tx=0x7f3d5000b040 comp rx=0 tx=0).stop 2023-11-04T01:42:02.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.100+0000 7f3d5c797640 1 -- 172.21.15.77:0/2458576191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d5414ee80 msgr2=0x7f3d5414e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.100+0000 7f3d5c797640 1 --2- 172.21.15.77:0/2458576191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d5414ee80 0x7f3d5414e1b0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f3d44007310 tx=0x7f3d440077d0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.100+0000 7f3d5c797640 1 -- 172.21.15.77:0/2458576191 shutdown_connections 2023-11-04T01:42:02.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.100+0000 7f3d5c797640 1 --2- 172.21.15.77:0/2458576191 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3d3806aea0 0x7f3d3806d360 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.100+0000 7f3d5c797640 1 --2- 172.21.15.77:0/2458576191 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3d54150400 0x7f3d54154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.100+0000 7f3d5c797640 1 --2- 172.21.15.77:0/2458576191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d5414ee80 0x7f3d5414e1b0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.100+0000 7f3d5c797640 1 --2- 172.21.15.77:0/2458576191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3d40004d00 0x7f3d5414cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.100+0000 7f3d5c797640 1 -- 172.21.15.77:0/2458576191 >> 172.21.15.77:0/2458576191 conn(0x7f3d540ce950 msgr2=0x7f3d540c9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:02.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.100+0000 7f3d5c797640 1 -- 172.21.15.77:0/2458576191 shutdown_connections 2023-11-04T01:42:02.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.100+0000 7f3d5c797640 1 -- 172.21.15.77:0/2458576191 wait complete. 2023-11-04T01:42:02.112 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:02.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.211+0000 7f8bf1a21640 1 Processor -- start 2023-11-04T01:42:02.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.211+0000 7f8bf1a21640 1 -- start start 2023-11-04T01:42:02.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.212+0000 7f8bf1a21640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8bec160440 0x7f8bec0b4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.212+0000 7f8bf1a21640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8bec0cddf0 0x7f8bec0b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.212+0000 7f8bf1a21640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bec0ce3a0 con 0x7f8bec0b6160 2023-11-04T01:42:02.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.212+0000 7f8bf1a21640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bec0d2c10 con 0x7f8bec160440 2023-11-04T01:42:02.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.212+0000 7f8bf1a21640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec0d1120 con 0x7f8bec0cddf0 2023-11-04T01:42:02.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.212+0000 7f8beaffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8bec160440 0x7f8bec0b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.212+0000 7f8beaffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8bec160440 0x7f8bec0b4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56772/0 (socket says 172.21.15.77:56772) 2023-11-04T01:42:02.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.212+0000 7f8beaffd640 1 -- 172.21.15.77:0/787341567 learned_addr learned my addr 172.21.15.77:0/787341567 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:02.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.212+0000 7f8beb7fe640 1 --2- 172.21.15.77:0/787341567 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8bec0cddf0 0x7f8bec0b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.212+0000 7f8beaffd640 1 -- 172.21.15.77:0/787341567 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8bec0cddf0 msgr2=0x7f8bec0b4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:02.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.212+0000 7f8beaffd640 1 --2- 172.21.15.77:0/787341567 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8bec0cddf0 0x7f8bec0b4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.212+0000 7f8beaffd640 1 -- 172.21.15.77:0/787341567 >> v1:172.21.15.122:6789/0 conn(0x7f8bec0b6160 legacy=0x7f8bec0cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.212+0000 7f8beaffd640 1 -- 172.21.15.77:0/787341567 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bec0d1400 con 0x7f8bec160440 2023-11-04T01:42:02.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.213+0000 7f8beaffd640 1 --2- 172.21.15.77:0/787341567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bec160440 0x7f8bec0b4900 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc009870 tx=0x7f8bdc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f92519c200eb89c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:02.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.213+0000 7f8bea7fc640 1 -- 172.21.15.77:0/787341567 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc030840 con 0x7f8bec160440 2023-11-04T01:42:02.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.213+0000 7f8bea7fc640 1 -- 172.21.15.77:0/787341567 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bdc0309a0 con 0x7f8bec160440 2023-11-04T01:42:02.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.213+0000 7f8bea7fc640 1 -- 172.21.15.77:0/787341567 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc030d30 con 0x7f8bec160440 2023-11-04T01:42:02.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.213+0000 7f8bf1a21640 1 -- 172.21.15.77:0/787341567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bec160440 msgr2=0x7f8bec0b4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.213+0000 7f8bf1a21640 1 --2- 172.21.15.77:0/787341567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bec160440 0x7f8bec0b4900 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc009870 tx=0x7f8bdc02b980 comp rx=0 tx=0).stop 2023-11-04T01:42:02.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.213+0000 7f8bf1a21640 1 -- 172.21.15.77:0/787341567 shutdown_connections 2023-11-04T01:42:02.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.213+0000 7f8bf1a21640 1 --2- 172.21.15.77:0/787341567 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8bec0cddf0 0x7f8bec0b4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.213+0000 7f8bf1a21640 1 --2- 172.21.15.77:0/787341567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bec160440 0x7f8bec0b4900 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.213+0000 7f8bf1a21640 1 -- 172.21.15.77:0/787341567 >> 172.21.15.77:0/787341567 conn(0x7f8bec0cf900 msgr2=0x7f8bec0cfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:02.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.214+0000 7f8bf1a21640 1 -- 172.21.15.77:0/787341567 shutdown_connections 2023-11-04T01:42:02.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.214+0000 7f8bf1a21640 1 -- 172.21.15.77:0/787341567 wait complete. 2023-11-04T01:42:02.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.215+0000 7f8bf1a21640 1 Processor -- start 2023-11-04T01:42:02.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.215+0000 7f8bf1a21640 1 -- start start 2023-11-04T01:42:02.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.215+0000 7f8bf1a21640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8bec0cddf0 0x7f8bec14c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.215+0000 7f8bf1a21640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bec160440 0x7f8bec1f2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.215+0000 7f8bf1a21640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8bec1f26d0 0x7f8bec0d1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.215+0000 7f8bf1a21640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec14b8a0 con 0x7f8bec160440 2023-11-04T01:42:02.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.215+0000 7f8bf1a21640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec14bb80 con 0x7f8bec0cddf0 2023-11-04T01:42:02.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.215+0000 7f8bf1a21640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec14be60 con 0x7f8bec1f26d0 2023-11-04T01:42:02.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.215+0000 7f8be3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bec160440 0x7f8bec1f2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.216+0000 7f8be3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bec160440 0x7f8bec1f2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56788/0 (socket says 172.21.15.77:56788) 2023-11-04T01:42:02.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.216+0000 7f8be3fff640 1 -- 172.21.15.77:0/1883225937 learned_addr learned my addr 172.21.15.77:0/1883225937 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:02.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.216+0000 7f8beaffd640 1 --2- 172.21.15.77:0/1883225937 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8bec0cddf0 0x7f8bec14c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.216+0000 7f8be3fff640 1 -- 172.21.15.77:0/1883225937 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8bec1f26d0 msgr2=0x7f8bec0d1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.216+0000 7f8be3fff640 1 --2- 172.21.15.77:0/1883225937 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8bec1f26d0 0x7f8bec0d1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.216+0000 7f8be3fff640 1 -- 172.21.15.77:0/1883225937 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8bec0cddf0 msgr2=0x7f8bec14c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.216+0000 7f8be3fff640 1 --2- 172.21.15.77:0/1883225937 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8bec0cddf0 0x7f8bec14c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.216+0000 7f8be3fff640 1 -- 172.21.15.77:0/1883225937 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bdc0094d0 con 0x7f8bec160440 2023-11-04T01:42:02.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.216+0000 7f8be3fff640 1 --2- 172.21.15.77:0/1883225937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bec160440 0x7f8bec1f2190 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f8bd400c4d0 tx=0x7f8bd400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:02.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.216+0000 7f8be8ff9640 1 -- 172.21.15.77:0/1883225937 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd40052d0 con 0x7f8bec160440 2023-11-04T01:42:02.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.216+0000 7f8be8ff9640 1 -- 172.21.15.77:0/1883225937 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd4005430 con 0x7f8bec160440 2023-11-04T01:42:02.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.216+0000 7f8bf1a21640 1 -- 172.21.15.77:0/1883225937 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bec14c140 con 0x7f8bec160440 2023-11-04T01:42:02.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.216+0000 7f8be8ff9640 1 -- 172.21.15.77:0/1883225937 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4012850 con 0x7f8bec160440 2023-11-04T01:42:02.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.216+0000 7f8bf1a21640 1 -- 172.21.15.77:0/1883225937 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bec0d2220 con 0x7f8bec160440 2023-11-04T01:42:02.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.217+0000 7f8bf1a21640 1 -- 172.21.15.77:0/1883225937 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bec0d24a0 con 0x7f8bec160440 2023-11-04T01:42:02.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.217+0000 7f8be8ff9640 1 -- 172.21.15.77:0/1883225937 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8bd40129b0 con 0x7f8bec160440 2023-11-04T01:42:02.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.218+0000 7f8be8ff9640 1 --2- 172.21.15.77:0/1883225937 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8bcc06aea0 0x7f8bcc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.218+0000 7f8be8ff9640 1 -- 172.21.15.77:0/1883225937 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8bd40892d0 con 0x7f8bec160440 2023-11-04T01:42:02.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.218+0000 7f8beaffd640 1 --2- 172.21.15.77:0/1883225937 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8bcc06aea0 0x7f8bcc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.218+0000 7f8beaffd640 1 --2- 172.21.15.77:0/1883225937 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8bcc06aea0 0x7f8bcc06d360 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc036000 tx=0x7f8bdc03b040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:02.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.222+0000 7f8be8ff9640 1 -- 172.21.15.77:0/1883225937 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8bd4054170 con 0x7f8bec160440 2023-11-04T01:42:02.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.423+0000 7f8bf1a21640 1 -- 172.21.15.77:0/1883225937 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8bec14b9e0 con 0x7f8bec160440 2023-11-04T01:42:02.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.423+0000 7f8be8ff9640 1 -- 172.21.15.77:0/1883225937 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f8bec14b9e0 con 0x7f8bec160440 2023-11-04T01:42:02.470 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:02.471 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5458,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2636406417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2636406417},{"type":"v1","addr":"172.21.15.122:6836","nonce":2636406417}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5461,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/2931907615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":2931907615},{"type":"v1","addr":"172.21.15.122:6837","nonce":2931907615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5955,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1507226082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1507226082},{"type":"v1","addr":"172.21.15.77:6833","nonce":1507226082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:41:53.409913+0000","modified":"2023-11-04T01:41:55.404636+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5958},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5958":{"gid":5958,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6835/1237968770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1237968770},{"type":"v1","addr":"172.21.15.77:6835","nonce":1237968770}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-04T01:42:02.472 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 22 2023-11-04T01:42:02.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.425+0000 7f8bf1a21640 1 -- 172.21.15.77:0/1883225937 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8bcc06aea0 msgr2=0x7f8bcc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.425+0000 7f8bf1a21640 1 --2- 172.21.15.77:0/1883225937 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8bcc06aea0 0x7f8bcc06d360 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc036000 tx=0x7f8bdc03b040 comp rx=0 tx=0).stop 2023-11-04T01:42:02.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.425+0000 7f8bf1a21640 1 -- 172.21.15.77:0/1883225937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bec160440 msgr2=0x7f8bec1f2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.425+0000 7f8bf1a21640 1 --2- 172.21.15.77:0/1883225937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bec160440 0x7f8bec1f2190 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f8bd400c4d0 tx=0x7f8bd400c990 comp rx=0 tx=0).stop 2023-11-04T01:42:02.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.425+0000 7f8bf1a21640 1 -- 172.21.15.77:0/1883225937 shutdown_connections 2023-11-04T01:42:02.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.425+0000 7f8bf1a21640 1 --2- 172.21.15.77:0/1883225937 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8bcc06aea0 0x7f8bcc06d360 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.425+0000 7f8bf1a21640 1 --2- 172.21.15.77:0/1883225937 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8bec1f26d0 0x7f8bec0d1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.425+0000 7f8bf1a21640 1 --2- 172.21.15.77:0/1883225937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bec160440 0x7f8bec1f2190 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.425+0000 7f8bf1a21640 1 --2- 172.21.15.77:0/1883225937 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8bec0cddf0 0x7f8bec14c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.425+0000 7f8bf1a21640 1 -- 172.21.15.77:0/1883225937 >> 172.21.15.77:0/1883225937 conn(0x7f8bec0cf900 msgr2=0x7f8bec0b49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:02.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.425+0000 7f8bf1a21640 1 -- 172.21.15.77:0/1883225937 shutdown_connections 2023-11-04T01:42:02.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.425+0000 7f8bf1a21640 1 -- 172.21.15.77:0/1883225937 wait complete. 2023-11-04T01:42:02.878 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:41:53.409913+0000', 'modified': '2023-11-04T01:41:55.404636+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5958}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5958': {'gid': 5958, 'name': 'c', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.77:6835/1237968770', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6834', 'nonce': 1237968770}, {'type': 'v1', 'addr': '172.21.15.77:6835', 'nonce': 1237968770}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:42:02.879 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:42:02.879 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-04T01:42:02.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.981+0000 7f602589b640 1 Processor -- start 2023-11-04T01:42:02.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.982+0000 7f602589b640 1 -- start start 2023-11-04T01:42:02.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.982+0000 7f602589b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f60200b4880 0x7f60200b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.982+0000 7f602589b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60200cde60 con 0x7f6020153e60 2023-11-04T01:42:02.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.982+0000 7f602589b640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6020160f90 con 0x7f60200cd6d0 2023-11-04T01:42:02.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.982+0000 7f602589b640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60200b5200 con 0x7f60200b4880 2023-11-04T01:42:02.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.982+0000 7f601effd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6020153e60 0x7f602015dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:42738/0 (socket says 172.21.15.77:42738) 2023-11-04T01:42:02.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.982+0000 7f601effd640 1 -- 172.21.15.77:0/616782169 learned_addr learned my addr 172.21.15.77:0/616782169 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:02.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.983+0000 7f601f7fe640 1 --2- 172.21.15.77:0/616782169 >> v2:172.21.15.122:3300/0 conn(0x7f60200b4880 0x7f60200b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.983+0000 7f601e7fc640 1 -- 172.21.15.77:0/616782169 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 955446646 0 0) 0x7f60200cde60 con 0x7f6020153e60 2023-11-04T01:42:02.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.983+0000 7f601e7fc640 1 -- 172.21.15.77:0/616782169 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f600c003520 con 0x7f6020153e60 2023-11-04T01:42:02.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.983+0000 7f601e7fc640 1 -- 172.21.15.77:0/616782169 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 73350574 0 0) 0x7f600c003520 con 0x7f6020153e60 2023-11-04T01:42:02.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.983+0000 7f601e7fc640 1 -- 172.21.15.77:0/616782169 >> v2:172.21.15.122:3300/0 conn(0x7f60200b4880 msgr2=0x7f60200b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:02.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.983+0000 7f601e7fc640 1 --2- 172.21.15.77:0/616782169 >> v2:172.21.15.122:3300/0 conn(0x7f60200b4880 0x7f60200b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.983+0000 7f601e7fc640 1 -- 172.21.15.77:0/616782169 >> v1:172.21.15.122:6789/0 conn(0x7f60200cd6d0 legacy=0x7f6020161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.983+0000 7f601e7fc640 1 -- 172.21.15.77:0/616782169 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60200ce090 con 0x7f6020153e60 2023-11-04T01:42:02.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.983+0000 7f601e7fc640 1 -- 172.21.15.77:0/616782169 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f6010001670 con 0x7f6020153e60 2023-11-04T01:42:02.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.983+0000 7f601e7fc640 1 -- 172.21.15.77:0/616782169 >> v1:172.21.15.77:6789/0 conn(0x7f6020153e60 legacy=0x7f602015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.983+0000 7f601e7fc640 1 --2- 172.21.15.77:0/616782169 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f600c003970 0x7f600c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.983+0000 7f601e7fc640 1 --2- 172.21.15.77:0/616782169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f600c0047c0 0x7f600c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.983+0000 7f601e7fc640 1 --2- 172.21.15.77:0/616782169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f600c005180 0x7f600c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.983+0000 7f601e7fc640 1 -- 172.21.15.77:0/616782169 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60200b5200 con 0x7f600c0047c0 2023-11-04T01:42:02.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.983+0000 7f601e7fc640 1 -- 172.21.15.77:0/616782169 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600c00c020 con 0x7f600c005180 2023-11-04T01:42:02.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.983+0000 7f601e7fc640 1 -- 172.21.15.77:0/616782169 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600c00c1e0 con 0x7f600c003970 2023-11-04T01:42:02.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.983+0000 7f60167fc640 1 --2- 172.21.15.77:0/616782169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f600c0047c0 0x7f600c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.983+0000 7f601f7fe640 1 --2- 172.21.15.77:0/616782169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f600c005180 0x7f600c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.983+0000 7f601effd640 1 --2- 172.21.15.77:0/616782169 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f600c003970 0x7f600c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.983+0000 7f60167fc640 1 -- 172.21.15.77:0/616782169 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f600c003970 msgr2=0x7f600c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:02.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.983+0000 7f60167fc640 1 --2- 172.21.15.77:0/616782169 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f600c003970 0x7f600c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.983+0000 7f60167fc640 1 -- 172.21.15.77:0/616782169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f600c005180 msgr2=0x7f600c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:02.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.983+0000 7f60167fc640 1 --2- 172.21.15.77:0/616782169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f600c005180 0x7f600c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.983+0000 7f601f7fe640 1 -- 172.21.15.77:0/616782169 reap_dead start 2023-11-04T01:42:02.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.983+0000 7f60167fc640 1 -- 172.21.15.77:0/616782169 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f600c003520 con 0x7f600c0047c0 2023-11-04T01:42:02.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.984+0000 7f60167fc640 1 --2- 172.21.15.77:0/616782169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f600c0047c0 0x7f600c004c40 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f6008001720 tx=0x7f600c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c206523b54749c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:02.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.984+0000 7f601e7fc640 1 -- 172.21.15.77:0/616782169 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60080052d0 con 0x7f600c0047c0 2023-11-04T01:42:02.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.984+0000 7f601e7fc640 1 -- 172.21.15.77:0/616782169 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600802e050 con 0x7f600c0047c0 2023-11-04T01:42:02.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.984+0000 7f601e7fc640 1 -- 172.21.15.77:0/616782169 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6008003830 con 0x7f600c0047c0 2023-11-04T01:42:02.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.985+0000 7f602589b640 1 -- 172.21.15.77:0/616782169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f600c0047c0 msgr2=0x7f600c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.985+0000 7f602589b640 1 --2- 172.21.15.77:0/616782169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f600c0047c0 0x7f600c004c40 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f6008001720 tx=0x7f600c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.985+0000 7f602589b640 1 -- 172.21.15.77:0/616782169 shutdown_connections 2023-11-04T01:42:02.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.985+0000 7f602589b640 1 --2- 172.21.15.77:0/616782169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f600c0047c0 0x7f600c004c40 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.985+0000 7f602589b640 1 -- 172.21.15.77:0/616782169 >> 172.21.15.77:0/616782169 conn(0x7f60200cf880 msgr2=0x7f60200cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:02.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.985+0000 7f602589b640 1 -- 172.21.15.77:0/616782169 shutdown_connections 2023-11-04T01:42:02.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.985+0000 7f602589b640 1 -- 172.21.15.77:0/616782169 wait complete. 2023-11-04T01:42:03.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.986+0000 7f602589b640 1 Processor -- start 2023-11-04T01:42:03.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.986+0000 7f602589b640 1 -- start start 2023-11-04T01:42:03.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.987+0000 7f602589b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f600c0047c0 0x7f602015a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.987+0000 7f602589b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60201f60b0 0x7f60201f6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.987+0000 7f602589b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60201f2ac0 0x7f60201f2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.987+0000 7f602589b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60201f6a70 con 0x7f60201f2ac0 2023-11-04T01:42:03.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.987+0000 7f602589b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60201f3480 con 0x7f60201f60b0 2023-11-04T01:42:03.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.987+0000 7f602589b640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60201f6ec0 con 0x7f600c0047c0 2023-11-04T01:42:03.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.987+0000 7f601f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60201f2ac0 0x7f60201f2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.987+0000 7f601f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60201f2ac0 0x7f60201f2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56804/0 (socket says 172.21.15.77:56804) 2023-11-04T01:42:03.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.987+0000 7f601f7fe640 1 -- 172.21.15.77:0/2290532389 learned_addr learned my addr 172.21.15.77:0/2290532389 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:03.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.987+0000 7f60167fc640 1 --2- 172.21.15.77:0/2290532389 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60201f60b0 0x7f60201f6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.987+0000 7f601effd640 1 --2- 172.21.15.77:0/2290532389 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f600c0047c0 0x7f602015a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.987+0000 7f601f7fe640 1 -- 172.21.15.77:0/2290532389 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f600c0047c0 msgr2=0x7f602015a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.987+0000 7f601f7fe640 1 --2- 172.21.15.77:0/2290532389 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f600c0047c0 0x7f602015a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.987+0000 7f601f7fe640 1 -- 172.21.15.77:0/2290532389 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60201f60b0 msgr2=0x7f60201f6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.987+0000 7f601f7fe640 1 --2- 172.21.15.77:0/2290532389 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60201f60b0 0x7f60201f6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.987+0000 7f601f7fe640 1 -- 172.21.15.77:0/2290532389 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60201f36a0 con 0x7f60201f2ac0 2023-11-04T01:42:03.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.987+0000 7f601f7fe640 1 --2- 172.21.15.77:0/2290532389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60201f2ac0 0x7f60201f2f40 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f60200c9e50 tx=0x7f601800f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:03.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.987+0000 7f601cff9640 1 -- 172.21.15.77:0/2290532389 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601800e040 con 0x7f60201f2ac0 2023-11-04T01:42:03.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.987+0000 7f601cff9640 1 -- 172.21.15.77:0/2290532389 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601800f040 con 0x7f60201f2ac0 2023-11-04T01:42:03.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.987+0000 7f602589b640 1 -- 172.21.15.77:0/2290532389 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60201f3980 con 0x7f60201f2ac0 2023-11-04T01:42:03.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.988+0000 7f601cff9640 1 -- 172.21.15.77:0/2290532389 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6018015430 con 0x7f60201f2ac0 2023-11-04T01:42:03.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.988+0000 7f602589b640 1 -- 172.21.15.77:0/2290532389 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6020159ff0 con 0x7f60201f2ac0 2023-11-04T01:42:03.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.989+0000 7f601cff9640 1 -- 172.21.15.77:0/2290532389 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6018015590 con 0x7f60201f2ac0 2023-11-04T01:42:03.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.990+0000 7f601cff9640 1 --2- 172.21.15.77:0/2290532389 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f600006aea0 0x7f600006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.990+0000 7f601cff9640 1 -- 172.21.15.77:0/2290532389 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f601808a310 con 0x7f60201f2ac0 2023-11-04T01:42:03.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.990+0000 7f601effd640 1 --2- 172.21.15.77:0/2290532389 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f600006aea0 0x7f600006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.990+0000 7f601effd640 1 --2- 172.21.15.77:0/2290532389 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f600006aea0 0x7f600006d360 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6010001050 tx=0x7f6010009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:03.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.991+0000 7f6028431740 1 Processor -- start 2023-11-04T01:42:03.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.991+0000 7f6028431740 1 -- start start 2023-11-04T01:42:03.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.991+0000 7f6028431740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560cbc188850 0x560cbc15b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.991+0000 7f6028431740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560cbc188c30 0x560cbc18b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.991+0000 7f6028431740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560cbc15bc90 0x560cbc18bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.991+0000 7f6028431740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cbc06c740 con 0x560cbc188850 2023-11-04T01:42:03.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.991+0000 7f6028431740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cbc0ce8d0 con 0x560cbc188c30 2023-11-04T01:42:03.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.991+0000 7f6028431740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x560cbc0cbfc0 con 0x560cbc15bc90 2023-11-04T01:42:03.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.992+0000 7f601effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560cbc188850 0x560cbc15b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.992+0000 7f601effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560cbc188850 0x560cbc15b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56808/0 (socket says 172.21.15.77:56808) 2023-11-04T01:42:03.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.992+0000 7f601effd640 1 -- 172.21.15.77:0/460766546 learned_addr learned my addr 172.21.15.77:0/460766546 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:03.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.992+0000 7f60167fc640 1 --2- 172.21.15.77:0/460766546 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560cbc188c30 0x560cbc18b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.992+0000 7f601f7fe640 1 --2- 172.21.15.77:0/460766546 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560cbc15bc90 0x560cbc18bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.992+0000 7f601effd640 1 -- 172.21.15.77:0/460766546 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560cbc15bc90 msgr2=0x560cbc18bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:03.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.992+0000 7f601effd640 1 --2- 172.21.15.77:0/460766546 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560cbc15bc90 0x560cbc18bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.992+0000 7f601effd640 1 -- 172.21.15.77:0/460766546 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560cbc188c30 msgr2=0x560cbc18b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:03.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.992+0000 7f601effd640 1 --2- 172.21.15.77:0/460766546 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560cbc188c30 0x560cbc18b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.992+0000 7f601effd640 1 -- 172.21.15.77:0/460766546 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560cbc08aca0 con 0x560cbc188850 2023-11-04T01:42:03.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.992+0000 7f601f7fe640 1 --2- 172.21.15.77:0/460766546 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560cbc15bc90 0x560cbc18bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:03.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.992+0000 7f60167fc640 1 --2- 172.21.15.77:0/460766546 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560cbc188c30 0x560cbc18b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:03.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.992+0000 7f601effd640 1 --2- 172.21.15.77:0/460766546 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560cbc188850 0x560cbc15b750 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f60100071e0 tx=0x7f6010013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f5c023fc5c01a61 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:03.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.992+0000 7f60157fa640 1 -- 172.21.15.77:0/460766546 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6010014b80 con 0x560cbc188850 2023-11-04T01:42:03.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.992+0000 7f60157fa640 1 -- 172.21.15.77:0/460766546 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6010014ce0 con 0x560cbc188850 2023-11-04T01:42:03.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.992+0000 7f60157fa640 1 -- 172.21.15.77:0/460766546 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6010022620 con 0x560cbc188850 2023-11-04T01:42:03.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.993+0000 7f6028431740 1 -- 172.21.15.77:0/460766546 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560cbc188850 msgr2=0x560cbc15b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.993+0000 7f6028431740 1 --2- 172.21.15.77:0/460766546 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560cbc188850 0x560cbc15b750 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f60100071e0 tx=0x7f6010013000 comp rx=0 tx=0).stop 2023-11-04T01:42:03.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.993+0000 7f6028431740 1 -- 172.21.15.77:0/460766546 shutdown_connections 2023-11-04T01:42:03.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.993+0000 7f6028431740 1 --2- 172.21.15.77:0/460766546 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560cbc15bc90 0x560cbc18bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.993+0000 7f6028431740 1 --2- 172.21.15.77:0/460766546 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560cbc188c30 0x560cbc18b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.993+0000 7f6028431740 1 --2- 172.21.15.77:0/460766546 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560cbc188850 0x560cbc15b750 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.993+0000 7f6028431740 1 -- 172.21.15.77:0/460766546 >> 172.21.15.77:0/460766546 conn(0x560cbc15da60 msgr2=0x560cbc1a65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:03.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.993+0000 7f6028431740 1 -- 172.21.15.77:0/460766546 shutdown_connections 2023-11-04T01:42:03.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.993+0000 7f6028431740 1 -- 172.21.15.77:0/460766546 wait complete. 2023-11-04T01:42:03.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.993+0000 7f6028431740 1 -- start start 2023-11-04T01:42:03.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.993+0000 7f6028431740 1 Processor -- start 2023-11-04T01:42:03.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.994+0000 7f6028431740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560cbc188850 0x560cbc1a65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.994+0000 7f6028431740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560cbc188c30 0x560cbc1a3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.994+0000 7f6028431740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560cbc1a44c0 0x560cbc1a0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.994+0000 7f6028431740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cbc0c78b0 con 0x560cbc188c30 2023-11-04T01:42:03.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.994+0000 7f6028431740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cbc081c80 con 0x560cbc188850 2023-11-04T01:42:03.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.994+0000 7f6028431740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x560cbc081920 con 0x560cbc1a44c0 2023-11-04T01:42:03.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.994+0000 7f6028431740 10 client.0 _ll_register_callbacks cb 0x560cbbdd9ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:42:03.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.994+0000 7f60167fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560cbc188c30 0x560cbc1a3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.994+0000 7f60167fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560cbc188c30 0x560cbc1a3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56818/0 (socket says 172.21.15.77:56818) 2023-11-04T01:42:03.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.994+0000 7f60167fc640 1 -- 172.21.15.77:0/1913342180 learned_addr learned my addr 172.21.15.77:0/1913342180 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:03.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.994+0000 7f601effd640 1 --2- 172.21.15.77:0/1913342180 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560cbc188850 0x560cbc1a65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.994+0000 7f601f7fe640 1 --2- 172.21.15.77:0/1913342180 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560cbc1a44c0 0x560cbc1a0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.995+0000 7f60167fc640 1 -- 172.21.15.77:0/1913342180 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560cbc1a44c0 msgr2=0x560cbc1a0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:03.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.995+0000 7f60167fc640 1 --2- 172.21.15.77:0/1913342180 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560cbc1a44c0 0x560cbc1a0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.995+0000 7f60167fc640 1 -- 172.21.15.77:0/1913342180 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560cbc188850 msgr2=0x560cbc1a65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:03.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.995+0000 7f60167fc640 1 --2- 172.21.15.77:0/1913342180 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560cbc188850 0x560cbc1a65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.995+0000 7f60167fc640 1 -- 172.21.15.77:0/1913342180 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f601000f040 con 0x560cbc188c30 2023-11-04T01:42:03.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.995+0000 7f601effd640 1 --2- 172.21.15.77:0/1913342180 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560cbc188850 0x560cbc1a65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:03.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.995+0000 7f60167fc640 1 --2- 172.21.15.77:0/1913342180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560cbc188c30 0x560cbc1a3f80 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f6008000c00 tx=0x7f6008001190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=180accb5f9e0a8ec server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:03.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.995+0000 7f5ffe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:42:03.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.995+0000 7f5ffe7fc640 1 -- 172.21.15.77:0/1913342180 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6008007040 con 0x560cbc188c30 2023-11-04T01:42:03.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.995+0000 7f5ffe7fc640 1 -- 172.21.15.77:0/1913342180 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f60080071a0 con 0x560cbc188c30 2023-11-04T01:42:03.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.995+0000 7f6028431740 1 -- 172.21.15.77:0/1913342180 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560cbc073bf0 con 0x560cbc188c30 2023-11-04T01:42:03.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.995+0000 7f5ffe7fc640 1 -- 172.21.15.77:0/1913342180 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6008007360 con 0x560cbc188c30 2023-11-04T01:42:03.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.995+0000 7f6028431740 10 client.6129 fetch_fsmap learned FSMap version 22 2023-11-04T01:42:03.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.995+0000 7f6028431740 1 -- 172.21.15.77:0/1913342180 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x560cbc0c5f30 con 0x560cbc188c30 2023-11-04T01:42:03.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.995+0000 7f5ffe7fc640 1 -- 172.21.15.77:0/1913342180 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560cbc073bf0 con 0x560cbc188c30 2023-11-04T01:42:03.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.995+0000 7f5ffe7fc640 1 -- 172.21.15.77:0/1913342180 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 22) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f60080074c0 con 0x560cbc188c30 2023-11-04T01:42:03.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.995+0000 7f6028431740 10 client.6129 fetch_fsmap finished waiting for FSMap version 22 2023-11-04T01:42:03.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.995+0000 7f6028431740 10 client.6129 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:42:03.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.995+0000 7f6028431740 20 client.6129 populate_metadata read hostname 'smithi077' 2023-11-04T01:42:03.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.995+0000 7f6028431740 1 --2- 172.21.15.77:0/1913342180 >> [v2:172.21.15.77:6834/1237968770,v1:172.21.15.77:6835/1237968770] conn(0x560cbc178c20 0x560cbc179000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.995+0000 7f6028431740 4 client.6129 mds_command: new command op to 5958 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:42:03.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.995+0000 7f6028431740 1 -- 172.21.15.77:0/1913342180 --> [v2:172.21.15.77:6834/1237968770,v1:172.21.15.77:6835/1237968770] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560cbc0c0890 con 0x560cbc178c20 2023-11-04T01:42:03.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.995+0000 7f601effd640 1 --2- 172.21.15.77:0/1913342180 >> [v2:172.21.15.77:6834/1237968770,v1:172.21.15.77:6835/1237968770] conn(0x560cbc178c20 0x560cbc179000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.996+0000 7f5ffe7fc640 10 client.6129 ms_handle_connect on v2:172.21.15.77:6834/1237968770 2023-11-04T01:42:03.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.996+0000 7f601effd640 1 --2- 172.21.15.77:0/1913342180 >> [v2:172.21.15.77:6834/1237968770,v1:172.21.15.77:6835/1237968770] conn(0x560cbc178c20 0x560cbc179000 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6c18c429ebbff7f server_cookie=c2f3292ac85dfe3e in_seq=0 out_seq=0 2023-11-04T01:42:03.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.996+0000 7f5ffe7fc640 1 -- 172.21.15.77:0/1913342180 <== mds.0 v2:172.21.15.77:6834/1237968770 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560cbc0c0890 con 0x560cbc178c20 2023-11-04T01:42:03.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.996+0000 7f5ffe7fc640 10 client.6129 handle_command_reply: tid=0 2023-11-04T01:42:03.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.996+0000 7f6028431740 1 client.6129 shutdown 2023-11-04T01:42:03.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.996+0000 7f6028431740 1 -- 172.21.15.77:0/1913342180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560cbc188c30 msgr2=0x560cbc1a3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.996+0000 7f6028431740 1 --2- 172.21.15.77:0/1913342180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560cbc188c30 0x560cbc1a3f80 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f6008000c00 tx=0x7f6008001190 comp rx=0 tx=0).stop 2023-11-04T01:42:03.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.997+0000 7f6028431740 1 -- 172.21.15.77:0/1913342180 shutdown_connections 2023-11-04T01:42:03.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.997+0000 7f6028431740 1 --2- 172.21.15.77:0/1913342180 >> [v2:172.21.15.77:6834/1237968770,v1:172.21.15.77:6835/1237968770] conn(0x560cbc178c20 0x560cbc179000 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.997+0000 7f6028431740 1 --2- 172.21.15.77:0/1913342180 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560cbc1a44c0 0x560cbc1a0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.997+0000 7f5ffe7fc640 0 client.6129 ms_handle_reset on v2:172.21.15.77:6834/1237968770 2023-11-04T01:42:03.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.997+0000 7f6028431740 1 --2- 172.21.15.77:0/1913342180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560cbc188c30 0x560cbc1a3f80 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.997+0000 7f6028431740 1 --2- 172.21.15.77:0/1913342180 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560cbc188850 0x560cbc1a65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.997+0000 7f6028431740 1 -- 172.21.15.77:0/1913342180 >> 172.21.15.77:0/1913342180 conn(0x560cbc15bc90 msgr2=0x560cbc15a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:03.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.997+0000 7f6028431740 1 -- 172.21.15.77:0/1913342180 shutdown_connections 2023-11-04T01:42:03.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.997+0000 7f6028431740 1 -- 172.21.15.77:0/1913342180 wait complete. 2023-11-04T01:42:03.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:02.997+0000 7f6028431740 20 client.6129 trim_cache size 0 max 16384 2023-11-04T01:42:03.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.012+0000 7f6028431740 1 Processor -- start 2023-11-04T01:42:03.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.012+0000 7f6028431740 1 -- start start 2023-11-04T01:42:03.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.013+0000 7f6028431740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560cbc188850 0x560cbc1c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.013+0000 7f6028431740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560cbc188c30 0x560cbc1a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.013+0000 7f6028431740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560cbc1a44c0 0x560cbc15a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.013+0000 7f6028431740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cbc047280 con 0x560cbc188c30 2023-11-04T01:42:03.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.013+0000 7f6028431740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cbc0c6a50 con 0x560cbc188850 2023-11-04T01:42:03.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.013+0000 7f6028431740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x560cbc1a5200 con 0x560cbc1a44c0 2023-11-04T01:42:03.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.013+0000 7f60167fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560cbc188c30 0x560cbc1a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.013+0000 7f60167fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560cbc188c30 0x560cbc1a4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56822/0 (socket says 172.21.15.77:56822) 2023-11-04T01:42:03.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.013+0000 7f60167fc640 1 -- 172.21.15.77:0/3886457395 learned_addr learned my addr 172.21.15.77:0/3886457395 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:03.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.013+0000 7f601f7fe640 1 --2- 172.21.15.77:0/3886457395 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560cbc1a44c0 0x560cbc15a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.013+0000 7f601effd640 1 --2- 172.21.15.77:0/3886457395 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560cbc188850 0x560cbc1c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.013+0000 7f60167fc640 1 -- 172.21.15.77:0/3886457395 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560cbc1a44c0 msgr2=0x560cbc15a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:03.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.013+0000 7f60167fc640 1 --2- 172.21.15.77:0/3886457395 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560cbc1a44c0 0x560cbc15a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.013+0000 7f60167fc640 1 -- 172.21.15.77:0/3886457395 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560cbc188850 msgr2=0x560cbc1c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:03.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.013+0000 7f60167fc640 1 --2- 172.21.15.77:0/3886457395 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560cbc188850 0x560cbc1c9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.013+0000 7f60167fc640 1 -- 172.21.15.77:0/3886457395 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560cbc063d10 con 0x560cbc188c30 2023-11-04T01:42:03.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.014+0000 7f60167fc640 1 --2- 172.21.15.77:0/3886457395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560cbc188c30 0x560cbc1a4cc0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f6008006970 tx=0x7f600803f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824dfdf113800bde server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:03.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.014+0000 7f6015ffb640 1 -- 172.21.15.77:0/3886457395 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6008007a30 con 0x560cbc188c30 2023-11-04T01:42:03.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.014+0000 7f6015ffb640 1 -- 172.21.15.77:0/3886457395 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6008006a90 con 0x560cbc188c30 2023-11-04T01:42:03.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.014+0000 7f6015ffb640 1 -- 172.21.15.77:0/3886457395 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6008006e70 con 0x560cbc188c30 2023-11-04T01:42:03.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.014+0000 7f6028431740 1 -- 172.21.15.77:0/3886457395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560cbc188c30 msgr2=0x560cbc1a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.014+0000 7f6028431740 1 --2- 172.21.15.77:0/3886457395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560cbc188c30 0x560cbc1a4cc0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f6008006970 tx=0x7f600803f000 comp rx=0 tx=0).stop 2023-11-04T01:42:03.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.014+0000 7f6028431740 1 -- 172.21.15.77:0/3886457395 shutdown_connections 2023-11-04T01:42:03.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.014+0000 7f6028431740 1 --2- 172.21.15.77:0/3886457395 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560cbc1a44c0 0x560cbc15a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.014+0000 7f6028431740 1 --2- 172.21.15.77:0/3886457395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560cbc188c30 0x560cbc1a4cc0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.014+0000 7f6028431740 1 --2- 172.21.15.77:0/3886457395 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560cbc188850 0x560cbc1c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.014+0000 7f6028431740 1 -- 172.21.15.77:0/3886457395 >> 172.21.15.77:0/3886457395 conn(0x560cbc15bc90 msgr2=0x560cbc162810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:03.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.014+0000 7f6028431740 1 -- 172.21.15.77:0/3886457395 shutdown_connections 2023-11-04T01:42:03.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.014+0000 7f6028431740 1 -- 172.21.15.77:0/3886457395 wait complete. 2023-11-04T01:42:03.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.015+0000 7f6028431740 1 -- start start 2023-11-04T01:42:03.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.015+0000 7f6028431740 1 Processor -- start 2023-11-04T01:42:03.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.016+0000 7f6028431740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560cbc188850 0x560cbc2109e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.016+0000 7f6028431740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560cbc188c30 0x560cbc1a8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.016+0000 7f6028431740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560cbc1a44c0 0x560cbc1a90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.016+0000 7f6028431740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cbc178ab0 con 0x560cbc188c30 2023-11-04T01:42:03.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.016+0000 7f6028431740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cbc18cd80 con 0x560cbc188850 2023-11-04T01:42:03.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.016+0000 7f6028431740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x560cbc156ec0 con 0x560cbc1a44c0 2023-11-04T01:42:03.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.016+0000 7f6028431740 10 client.0 _ll_register_callbacks cb 0x7f6010001110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:42:03.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.016+0000 7f60167fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560cbc188c30 0x560cbc1a8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.016+0000 7f60167fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560cbc188c30 0x560cbc1a8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56826/0 (socket says 172.21.15.77:56826) 2023-11-04T01:42:03.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.016+0000 7f60167fc640 1 -- 172.21.15.77:0/1704685662 learned_addr learned my addr 172.21.15.77:0/1704685662 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:03.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.016+0000 7f601effd640 1 --2- 172.21.15.77:0/1704685662 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560cbc188850 0x560cbc2109e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.016+0000 7f601f7fe640 1 --2- 172.21.15.77:0/1704685662 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560cbc1a44c0 0x560cbc1a90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.016+0000 7f60167fc640 1 -- 172.21.15.77:0/1704685662 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560cbc1a44c0 msgr2=0x560cbc1a90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:03.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.016+0000 7f60167fc640 1 --2- 172.21.15.77:0/1704685662 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560cbc1a44c0 0x560cbc1a90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.016+0000 7f60167fc640 1 -- 172.21.15.77:0/1704685662 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560cbc188850 msgr2=0x560cbc2109e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:03.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.016+0000 7f60167fc640 1 --2- 172.21.15.77:0/1704685662 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560cbc188850 0x560cbc2109e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.016+0000 7f60167fc640 1 -- 172.21.15.77:0/1704685662 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560cbc0c5f30 con 0x560cbc188c30 2023-11-04T01:42:03.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.016+0000 7f60167fc640 1 --2- 172.21.15.77:0/1704685662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560cbc188c30 0x560cbc1a8b60 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f6008054040 tx=0x7f6008007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac19ce70f45631f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:03.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.016+0000 7f5ffe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:42:03.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.016+0000 7f5ffe7fc640 1 -- 172.21.15.77:0/1704685662 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6008007a30 con 0x560cbc188c30 2023-11-04T01:42:03.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.016+0000 7f5ffe7fc640 1 -- 172.21.15.77:0/1704685662 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6008005420 con 0x560cbc188c30 2023-11-04T01:42:03.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.016+0000 7f6028431740 1 -- 172.21.15.77:0/1704685662 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6010014ce0 con 0x560cbc188c30 2023-11-04T01:42:03.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.016+0000 7f5ffe7fc640 1 -- 172.21.15.77:0/1704685662 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6008007520 con 0x560cbc188c30 2023-11-04T01:42:03.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.016+0000 7f6028431740 10 client.6135 fetch_fsmap learned FSMap version 22 2023-11-04T01:42:03.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.016+0000 7f6028431740 1 -- 172.21.15.77:0/1704685662 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x560cbc089500 con 0x560cbc188c30 2023-11-04T01:42:03.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.017+0000 7f5ffe7fc640 1 -- 172.21.15.77:0/1704685662 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6010014ce0 con 0x560cbc188c30 2023-11-04T01:42:03.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.017+0000 7f5ffe7fc640 1 -- 172.21.15.77:0/1704685662 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 22) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6008003800 con 0x560cbc188c30 2023-11-04T01:42:03.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.017+0000 7f6028431740 10 client.6135 fetch_fsmap finished waiting for FSMap version 22 2023-11-04T01:42:03.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.017+0000 7f6028431740 10 client.6135 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:42:03.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.017+0000 7f6028431740 20 client.6135 populate_metadata read hostname 'smithi077' 2023-11-04T01:42:03.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.017+0000 7f6028431740 1 --2- 172.21.15.77:0/1704685662 >> [v2:172.21.15.77:6834/1237968770,v1:172.21.15.77:6835/1237968770] conn(0x560cbc2144d0 0x560cbc2148b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.017+0000 7f6028431740 4 client.6135 mds_command: new command op to 5958 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:42:03.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.017+0000 7f6028431740 1 -- 172.21.15.77:0/1704685662 --> [v2:172.21.15.77:6834/1237968770,v1:172.21.15.77:6835/1237968770] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560cbc0c05b0 con 0x560cbc2144d0 2023-11-04T01:42:03.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.017+0000 7f601effd640 1 --2- 172.21.15.77:0/1704685662 >> [v2:172.21.15.77:6834/1237968770,v1:172.21.15.77:6835/1237968770] conn(0x560cbc2144d0 0x560cbc2148b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.017+0000 7f5ffe7fc640 10 client.6135 ms_handle_connect on v2:172.21.15.77:6834/1237968770 2023-11-04T01:42:03.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.017+0000 7f601effd640 1 --2- 172.21.15.77:0/1704685662 >> [v2:172.21.15.77:6834/1237968770,v1:172.21.15.77:6835/1237968770] conn(0x560cbc2144d0 0x560cbc2148b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8db1c6846dfb8cb0 server_cookie=b40c7108e9730d7a in_seq=0 out_seq=0 2023-11-04T01:42:03.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.017+0000 7f5ffe7fc640 1 -- 172.21.15.77:0/1704685662 <== mds.0 v2:172.21.15.77:6834/1237968770 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x560cbc0c05b0 con 0x560cbc2144d0 2023-11-04T01:42:03.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.017+0000 7f5ffe7fc640 10 client.6135 handle_command_reply: tid=0 2023-11-04T01:42:03.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.017+0000 7f6028431740 1 client.6135 shutdown 2023-11-04T01:42:03.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.017+0000 7f6028431740 1 -- 172.21.15.77:0/1704685662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560cbc188c30 msgr2=0x560cbc1a8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.017+0000 7f6028431740 1 --2- 172.21.15.77:0/1704685662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560cbc188c30 0x560cbc1a8b60 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f6008054040 tx=0x7f6008007c80 comp rx=0 tx=0).stop 2023-11-04T01:42:03.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.017+0000 7f6028431740 1 -- 172.21.15.77:0/1704685662 shutdown_connections 2023-11-04T01:42:03.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.017+0000 7f6028431740 1 --2- 172.21.15.77:0/1704685662 >> [v2:172.21.15.77:6834/1237968770,v1:172.21.15.77:6835/1237968770] conn(0x560cbc2144d0 0x560cbc2148b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.017+0000 7f6028431740 1 --2- 172.21.15.77:0/1704685662 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560cbc1a44c0 0x560cbc1a90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.017+0000 7f6028431740 1 --2- 172.21.15.77:0/1704685662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560cbc188c30 0x560cbc1a8b60 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.017+0000 7f5ffe7fc640 0 client.6135 ms_handle_reset on v2:172.21.15.77:6834/1237968770 2023-11-04T01:42:03.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.017+0000 7f6028431740 1 --2- 172.21.15.77:0/1704685662 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560cbc188850 0x560cbc2109e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.017+0000 7f6028431740 1 -- 172.21.15.77:0/1704685662 >> 172.21.15.77:0/1704685662 conn(0x560cbc15bc90 msgr2=0x560cbc1a9af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:03.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.018+0000 7f6028431740 1 -- 172.21.15.77:0/1704685662 shutdown_connections 2023-11-04T01:42:03.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.018+0000 7f6028431740 1 -- 172.21.15.77:0/1704685662 wait complete. 2023-11-04T01:42:03.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.018+0000 7f6028431740 20 client.6135 trim_cache size 0 max 16384 2023-11-04T01:42:03.053 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-04T01:42:03.053 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "0c22c75d-0169-41ef-b663-6ac1c5b0f71f", 2023-11-04T01:42:03.054 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 0, 2023-11-04T01:42:03.054 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 5958, 2023-11-04T01:42:03.054 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2023-11-04T01:42:03.054 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2023-11-04T01:42:03.054 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2023-11-04T01:42:03.055 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 8.9424844730000004, 2023-11-04T01:42:03.055 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 22, 2023-11-04T01:42:03.055 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 54, 2023-11-04T01:42:03.057 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 54, 2023-11-04T01:42:03.057 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 14.026022886 2023-11-04T01:42:03.058 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-04T01:42:03.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.018+0000 7f602589b640 1 -- 172.21.15.77:0/2290532389 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f600006aea0 msgr2=0x7f600006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.018+0000 7f602589b640 1 --2- 172.21.15.77:0/2290532389 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f600006aea0 0x7f600006d360 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6010001050 tx=0x7f6010009040 comp rx=0 tx=0).stop 2023-11-04T01:42:03.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.018+0000 7f602589b640 1 -- 172.21.15.77:0/2290532389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60201f2ac0 msgr2=0x7f60201f2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.018+0000 7f602589b640 1 --2- 172.21.15.77:0/2290532389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60201f2ac0 0x7f60201f2f40 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f60200c9e50 tx=0x7f601800f1b0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.018+0000 7f602589b640 1 -- 172.21.15.77:0/2290532389 shutdown_connections 2023-11-04T01:42:03.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.018+0000 7f602589b640 1 --2- 172.21.15.77:0/2290532389 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f600006aea0 0x7f600006d360 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.018+0000 7f602589b640 1 --2- 172.21.15.77:0/2290532389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60201f2ac0 0x7f60201f2f40 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.018+0000 7f602589b640 1 --2- 172.21.15.77:0/2290532389 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60201f60b0 0x7f60201f6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.018+0000 7f602589b640 1 --2- 172.21.15.77:0/2290532389 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f600c0047c0 0x7f602015a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.018+0000 7f602589b640 1 -- 172.21.15.77:0/2290532389 >> 172.21.15.77:0/2290532389 conn(0x7f60200cf880 msgr2=0x7f602015bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:03.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.018+0000 7f602589b640 1 -- 172.21.15.77:0/2290532389 shutdown_connections 2023-11-04T01:42:03.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.018+0000 7f602589b640 1 -- 172.21.15.77:0/2290532389 wait complete. 2023-11-04T01:42:03.062 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:42:03.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.162+0000 7f470d79e640 1 Processor -- start 2023-11-04T01:42:03.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.162+0000 7f470d79e640 1 -- start start 2023-11-04T01:42:03.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.163+0000 7f470d79e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f47080d0ff0 0x7f47080b5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.163+0000 7f470d79e640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f47080b8540 0x7f47080b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.163+0000 7f470d79e640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47080d14f0 con 0x7f47080d2b40 2023-11-04T01:42:03.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.163+0000 7f470d79e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47080d2170 con 0x7f47080d0ff0 2023-11-04T01:42:03.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.163+0000 7f470d79e640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47080d17d0 con 0x7f47080b8540 2023-11-04T01:42:03.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.163+0000 7f47077fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f47080d0ff0 0x7f47080b5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.163+0000 7f47077fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f47080d0ff0 0x7f47080b5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56834/0 (socket says 172.21.15.77:56834) 2023-11-04T01:42:03.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.163+0000 7f47077fe640 1 -- 172.21.15.77:0/3158092447 learned_addr learned my addr 172.21.15.77:0/3158092447 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:03.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.163+0000 7f47077fe640 1 -- 172.21.15.77:0/3158092447 >> v2:172.21.15.122:3300/0 conn(0x7f47080b8540 msgr2=0x7f47080b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:03.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.163+0000 7f47077fe640 1 --2- 172.21.15.77:0/3158092447 >> v2:172.21.15.122:3300/0 conn(0x7f47080b8540 0x7f47080b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.163+0000 7f47077fe640 1 -- 172.21.15.77:0/3158092447 >> v1:172.21.15.122:6789/0 conn(0x7f47080d2b40 legacy=0x7f47080d2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:03.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.163+0000 7f47077fe640 1 -- 172.21.15.77:0/3158092447 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47080d1ab0 con 0x7f47080d0ff0 2023-11-04T01:42:03.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.164+0000 7f47077fe640 1 --2- 172.21.15.77:0/3158092447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47080d0ff0 0x7f47080b5d50 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f47080b8d20 tx=0x7f46f002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9619bd038f2bd305 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:03.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.164+0000 7f4706ffd640 1 -- 172.21.15.77:0/3158092447 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f0031870 con 0x7f47080d0ff0 2023-11-04T01:42:03.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.164+0000 7f4706ffd640 1 -- 172.21.15.77:0/3158092447 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f00319d0 con 0x7f47080d0ff0 2023-11-04T01:42:03.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.164+0000 7f4706ffd640 1 -- 172.21.15.77:0/3158092447 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f0031d60 con 0x7f47080d0ff0 2023-11-04T01:42:03.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.164+0000 7f470d79e640 1 -- 172.21.15.77:0/3158092447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47080d0ff0 msgr2=0x7f47080b5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.164+0000 7f470d79e640 1 --2- 172.21.15.77:0/3158092447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47080d0ff0 0x7f47080b5d50 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f47080b8d20 tx=0x7f46f002b910 comp rx=0 tx=0).stop 2023-11-04T01:42:03.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.165+0000 7f470d79e640 1 -- 172.21.15.77:0/3158092447 shutdown_connections 2023-11-04T01:42:03.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.165+0000 7f470d79e640 1 --2- 172.21.15.77:0/3158092447 >> v2:172.21.15.122:3300/0 conn(0x7f47080b8540 0x7f47080b6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.165+0000 7f470d79e640 1 --2- 172.21.15.77:0/3158092447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47080d0ff0 0x7f47080b5d50 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.165+0000 7f470d79e640 1 -- 172.21.15.77:0/3158092447 >> 172.21.15.77:0/3158092447 conn(0x7f4708071c70 msgr2=0x7f4708072080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:03.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.165+0000 7f470d79e640 1 -- 172.21.15.77:0/3158092447 shutdown_connections 2023-11-04T01:42:03.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.165+0000 7f470d79e640 1 -- 172.21.15.77:0/3158092447 wait complete. 2023-11-04T01:42:03.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.166+0000 7f470d79e640 1 Processor -- start 2023-11-04T01:42:03.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.166+0000 7f470d79e640 1 -- start start 2023-11-04T01:42:03.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.167+0000 7f470d79e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f47080b8540 0x7f47080a9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.167+0000 7f470d79e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47080d0ff0 0x7f470814e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.167+0000 7f470d79e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47080d2b40 0x7f47081f34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.167+0000 7f470d79e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47080aa2b0 con 0x7f47080d2b40 2023-11-04T01:42:03.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.167+0000 7f470d79e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47081f2920 con 0x7f47080d0ff0 2023-11-04T01:42:03.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.167+0000 7f470d79e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47081f2c00 con 0x7f47080b8540 2023-11-04T01:42:03.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.167+0000 7f470cf9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47080d2b40 0x7f47081f34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.167+0000 7f470cf9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47080d2b40 0x7f47081f34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56840/0 (socket says 172.21.15.77:56840) 2023-11-04T01:42:03.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.167+0000 7f470cf9d640 1 -- 172.21.15.77:0/4015519609 learned_addr learned my addr 172.21.15.77:0/4015519609 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:03.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.167+0000 7f47077fe640 1 --2- 172.21.15.77:0/4015519609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47080d0ff0 0x7f470814e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.167+0000 7f4707fff640 1 --2- 172.21.15.77:0/4015519609 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f47080b8540 0x7f47080a9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.167+0000 7f470cf9d640 1 -- 172.21.15.77:0/4015519609 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f47080b8540 msgr2=0x7f47080a9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.167+0000 7f470cf9d640 1 --2- 172.21.15.77:0/4015519609 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f47080b8540 0x7f47080a9d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.167+0000 7f470cf9d640 1 -- 172.21.15.77:0/4015519609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47080d0ff0 msgr2=0x7f470814e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.167+0000 7f470cf9d640 1 --2- 172.21.15.77:0/4015519609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47080d0ff0 0x7f470814e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.167+0000 7f470cf9d640 1 -- 172.21.15.77:0/4015519609 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f00094d0 con 0x7f47080d2b40 2023-11-04T01:42:03.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.167+0000 7f470cf9d640 1 --2- 172.21.15.77:0/4015519609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47080d2b40 0x7f47081f34a0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f470000b970 tx=0x7f470000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:03.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.167+0000 7f4704ff9640 1 -- 172.21.15.77:0/4015519609 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470000cb40 con 0x7f47080d2b40 2023-11-04T01:42:03.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.167+0000 7f4704ff9640 1 -- 172.21.15.77:0/4015519609 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470000ccc0 con 0x7f47080d2b40 2023-11-04T01:42:03.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.167+0000 7f470d79e640 1 -- 172.21.15.77:0/4015519609 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47081f2ee0 con 0x7f47080d2b40 2023-11-04T01:42:03.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.167+0000 7f4704ff9640 1 -- 172.21.15.77:0/4015519609 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4700014680 con 0x7f47080d2b40 2023-11-04T01:42:03.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.168+0000 7f470d79e640 1 -- 172.21.15.77:0/4015519609 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f470814e7f0 con 0x7f47080d2b40 2023-11-04T01:42:03.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.169+0000 7f470d79e640 1 -- 172.21.15.77:0/4015519609 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f470804ece0 con 0x7f47080d2b40 2023-11-04T01:42:03.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.169+0000 7f4704ff9640 1 -- 172.21.15.77:0/4015519609 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f470001d3b0 con 0x7f47080d2b40 2023-11-04T01:42:03.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.169+0000 7f4704ff9640 1 --2- 172.21.15.77:0/4015519609 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f46e806ae70 0x7f46e806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.169+0000 7f4704ff9640 1 -- 172.21.15.77:0/4015519609 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4700089860 con 0x7f47080d2b40 2023-11-04T01:42:03.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.169+0000 7f4707fff640 1 --2- 172.21.15.77:0/4015519609 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f46e806ae70 0x7f46e806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.170+0000 7f4707fff640 1 --2- 172.21.15.77:0/4015519609 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f46e806ae70 0x7f46e806d330 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f46f800a730 tx=0x7f46f8008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:03.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.174+0000 7f4704ff9640 1 -- 172.21.15.77:0/4015519609 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4700054670 con 0x7f47080d2b40 2023-11-04T01:42:03.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.372+0000 7f470d79e640 1 -- 172.21.15.77:0/4015519609 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f47080b3470 con 0x7f47080d2b40 2023-11-04T01:42:03.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.372+0000 7f4704ff9640 1 -- 172.21.15.77:0/4015519609 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4700019070 con 0x7f47080d2b40 2023-11-04T01:42:03.374 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:42:03.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.374+0000 7f470d79e640 1 -- 172.21.15.77:0/4015519609 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f46e806ae70 msgr2=0x7f46e806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.374+0000 7f470d79e640 1 --2- 172.21.15.77:0/4015519609 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f46e806ae70 0x7f46e806d330 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f46f800a730 tx=0x7f46f8008040 comp rx=0 tx=0).stop 2023-11-04T01:42:03.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.374+0000 7f470d79e640 1 -- 172.21.15.77:0/4015519609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47080d2b40 msgr2=0x7f47081f34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.374+0000 7f470d79e640 1 --2- 172.21.15.77:0/4015519609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47080d2b40 0x7f47081f34a0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f470000b970 tx=0x7f470000be30 comp rx=0 tx=0).stop 2023-11-04T01:42:03.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.374+0000 7f470d79e640 1 -- 172.21.15.77:0/4015519609 shutdown_connections 2023-11-04T01:42:03.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.374+0000 7f470d79e640 1 --2- 172.21.15.77:0/4015519609 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f46e806ae70 0x7f46e806d330 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.374+0000 7f470d79e640 1 --2- 172.21.15.77:0/4015519609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47080d2b40 0x7f47081f34a0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.374+0000 7f470d79e640 1 --2- 172.21.15.77:0/4015519609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47080d0ff0 0x7f470814e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.374+0000 7f470d79e640 1 --2- 172.21.15.77:0/4015519609 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f47080b8540 0x7f47080a9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.374+0000 7f470d79e640 1 -- 172.21.15.77:0/4015519609 >> 172.21.15.77:0/4015519609 conn(0x7f4708071c70 msgr2=0x7f47080c6510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:03.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.374+0000 7f470d79e640 1 -- 172.21.15.77:0/4015519609 shutdown_connections 2023-11-04T01:42:03.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:03.374+0000 7f470d79e640 1 -- 172.21.15.77:0/4015519609 wait complete. 2023-11-04T01:42:03.386 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:42:03.387 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:42:03.387 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2023-11-04T01:42:03.387 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:42:03.388 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:03.388 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:42:03.389 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:42:03.389 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:42:03.389 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:42:03.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:03.390 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2023-11-04T01:42:03.406 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:42:03.406 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:42:03.406 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:42:03.407 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:03.407 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2023-11-04T01:42:03.407 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:03.407 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:42:03.408 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:03.408 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f0 2023-11-04T01:42:03.408 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:42:03.408 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:03.409 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f1 2023-11-04T01:42:03.409 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:42:03.409 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:03.409 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:42:03.409 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:03.410 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:42:03.410 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 42282sec preferred_lft 42282sec 2023-11-04T01:42:03.410 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::ec4:7aff:fe8f:d3d3/64 scope link 2023-11-04T01:42:03.410 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:03.411 INFO:teuthology.orchestra.run.smithi077.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:42:03.411 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 06:3a:02:11:c4:57 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:03.411 INFO:teuthology.orchestra.run.smithi077.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:42:03.411 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:03.412 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::8039:1aff:fee2:109f/64 scope link 2023-11-04T01:42:03.412 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:03.412 INFO:teuthology.orchestra.run.smithi077.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:42:03.412 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 06:3a:02:11:c4:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:03.412 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::43a:2ff:fe11:c457/64 scope link 2023-11-04T01:42:03.413 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:03.413 INFO:teuthology.orchestra.run.smithi077.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:42:03.413 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether c2:4f:2a:69:4f:38 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:03.413 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::c04f:2aff:fe69:4f38/64 scope link 2023-11-04T01:42:03.413 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:03.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:03.414 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:42:03.471 INFO:teuthology.orchestra.run.smithi077.stdout:1 2023-11-04T01:42:03.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:03.473 DEBUG:teuthology.orchestra.run.smithi077:> route 2023-11-04T01:42:03.529 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2023-11-04T01:42:03.529 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:42:03.530 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:42:03.530 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:42:03.530 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:42:03.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:03.531 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-11-04T01:42:03.531 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-11-04T01:42:03.532 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:42:03.532 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:42:03.533 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:42:03.533 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-11-04T01:42:03.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:03.625 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2023-11-04T01:42:03.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:42:03.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:42:03.641 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:42:03.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:03.642 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 up 2023-11-04T01:42:03.708 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:42:03.708 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:42:03.708 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:03.763 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:42:03.763 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:42:03.764 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:03.819 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:42:03.875 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2023-11-04T01:42:03.875 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2023-11-04T01:42:03.875 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2023-11-04T01:42:03.876 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2023-11-04T01:42:03.876 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2023-11-04T01:42:03.876 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2023-11-04T01:42:03.876 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2023-11-04T01:42:03.876 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2023-11-04T01:42:03.877 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2023-11-04T01:42:03.877 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2023-11-04T01:42:03.877 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2023-11-04T01:42:03.877 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2023-11-04T01:42:03.877 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:42:03.878 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2023-11-04T01:42:03.878 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2023-11-04T01:42:03.878 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2023-11-04T01:42:03.878 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2023-11-04T01:42:03.878 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2023-11-04T01:42:03.879 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2023-11-04T01:42:03.879 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:42:03.879 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:42:03.879 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:42:03.879 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:42:03.880 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2023-11-04T01:42:03.880 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2023-11-04T01:42:03.880 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:42:03.880 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:42:03.880 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:42:03.881 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:42:03.881 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2023-11-04T01:42:03.881 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:03.881 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:03.881 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:03.882 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:03.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:03.882 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-11-04T01:42:03.930 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:42:03.930 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:42:03.973 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:42:03.988 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2023-11-04T01:42:03.988 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2023-11-04T01:42:03.988 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2023-11-04T01:42:03.988 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2023-11-04T01:42:03.989 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2023-11-04T01:42:03.989 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2023-11-04T01:42:03.989 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2023-11-04T01:42:03.989 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2023-11-04T01:42:03.989 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2023-11-04T01:42:03.990 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2023-11-04T01:42:03.990 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2023-11-04T01:42:03.990 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2023-11-04T01:42:03.990 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:42:03.990 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2023-11-04T01:42:03.991 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2023-11-04T01:42:03.991 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2023-11-04T01:42:03.991 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2023-11-04T01:42:03.991 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2023-11-04T01:42:03.991 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2023-11-04T01:42:03.992 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:42:03.992 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:42:03.992 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:42:03.992 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:42:03.992 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2023-11-04T01:42:03.992 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2023-11-04T01:42:03.993 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:42:03.993 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:42:03.993 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:42:03.993 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:42:03.993 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2023-11-04T01:42:03.994 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:03.994 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:03.994 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:03.994 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:03.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:03.995 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-11-04T01:42:04.062 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:2023-11-04T01:42:04.061+0000 7ffab0a36480 -1 init, newargv = 0x55f4db7f7b00 newargc=15 2023-11-04T01:42:04.062 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[138344]: starting ceph client 2023-11-04T01:42:04.066 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[138344]: starting fuse 2023-11-04T01:42:05.144 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:42:05.164 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2023-11-04T01:42:05.164 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2023-11-04T01:42:05.165 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2023-11-04T01:42:05.165 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2023-11-04T01:42:05.165 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2023-11-04T01:42:05.165 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2023-11-04T01:42:05.165 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2023-11-04T01:42:05.166 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2023-11-04T01:42:05.166 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2023-11-04T01:42:05.166 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2023-11-04T01:42:05.166 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2023-11-04T01:42:05.166 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2023-11-04T01:42:05.167 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:42:05.167 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2023-11-04T01:42:05.167 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2023-11-04T01:42:05.167 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2023-11-04T01:42:05.167 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2023-11-04T01:42:05.168 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2023-11-04T01:42:05.168 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2023-11-04T01:42:05.168 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:42:05.168 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:42:05.168 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:42:05.169 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:42:05.169 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2023-11-04T01:42:05.169 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2023-11-04T01:42:05.169 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:42:05.169 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:42:05.169 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:42:05.170 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:42:05.170 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2023-11-04T01:42:05.170 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:05.170 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:05.171 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:05.171 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:05.171 INFO:teuthology.orchestra.run.smithi077.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:05.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:05.172 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-11-04T01:42:05.221 INFO:teuthology.orchestra.run.smithi077.stdout:42 2023-11-04T01:42:05.221 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-11-04T01:42:05.222 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:42:05.222 DEBUG:teuthology.orchestra.run.smithi077:> import glob 2023-11-04T01:42:05.223 DEBUG:teuthology.orchestra.run.smithi077:> import re 2023-11-04T01:42:05.223 DEBUG:teuthology.orchestra.run.smithi077:> import os 2023-11-04T01:42:05.223 DEBUG:teuthology.orchestra.run.smithi077:> import subprocess 2023-11-04T01:42:05.224 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:42:05.224 DEBUG:teuthology.orchestra.run.smithi077:> def _find_admin_socket(client_name): 2023-11-04T01:42:05.224 DEBUG:teuthology.orchestra.run.smithi077:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:42:05.225 DEBUG:teuthology.orchestra.run.smithi077:> files = glob.glob(asok_path) 2023-11-04T01:42:05.225 DEBUG:teuthology.orchestra.run.smithi077:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:42:05.225 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:42:05.226 DEBUG:teuthology.orchestra.run.smithi077:> # Given a non-glob path, it better be there 2023-11-04T01:42:05.226 DEBUG:teuthology.orchestra.run.smithi077:> if "*" not in asok_path: 2023-11-04T01:42:05.227 DEBUG:teuthology.orchestra.run.smithi077:> assert(len(files) == 1) 2023-11-04T01:42:05.227 DEBUG:teuthology.orchestra.run.smithi077:> return files[0] 2023-11-04T01:42:05.227 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:42:05.228 DEBUG:teuthology.orchestra.run.smithi077:> for f in files: 2023-11-04T01:42:05.228 DEBUG:teuthology.orchestra.run.smithi077:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:42:05.228 DEBUG:teuthology.orchestra.run.smithi077:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:42:05.229 DEBUG:teuthology.orchestra.run.smithi077:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:42:05.229 DEBUG:teuthology.orchestra.run.smithi077:> contents = proc_f.read() 2023-11-04T01:42:05.230 DEBUG:teuthology.orchestra.run.smithi077:> if mountpoint in contents: 2023-11-04T01:42:05.230 DEBUG:teuthology.orchestra.run.smithi077:> return f 2023-11-04T01:42:05.230 DEBUG:teuthology.orchestra.run.smithi077:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:42:05.231 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:42:05.231 DEBUG:teuthology.orchestra.run.smithi077:> print(_find_admin_socket("client.0")) 2023-11-04T01:42:05.232 DEBUG:teuthology.orchestra.run.smithi077:> ' 2023-11-04T01:42:05.347 INFO:teuthology.orchestra.run.smithi077.stdout:/var/run/ceph/ceph-client.0.138344.asok 2023-11-04T01:42:05.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:05.358 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.138344.asok 2023-11-04T01:42:05.359 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:05.359 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.138344.asok status 2023-11-04T01:42:05.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:05.527 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-04T01:42:05.527 INFO:teuthology.orchestra.run.smithi077.stdout: "metadata": { 2023-11-04T01:42:05.527 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:42:05.527 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:42:05.528 INFO:teuthology.orchestra.run.smithi077.stdout: "entity_id": "0", 2023-11-04T01:42:05.528 INFO:teuthology.orchestra.run.smithi077.stdout: "hostname": "smithi077", 2023-11-04T01:42:05.528 INFO:teuthology.orchestra.run.smithi077.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:42:05.528 INFO:teuthology.orchestra.run.smithi077.stdout: "pid": "138344", 2023-11-04T01:42:05.528 INFO:teuthology.orchestra.run.smithi077.stdout: "root": "/" 2023-11-04T01:42:05.529 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:05.529 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_count": 0, 2023-11-04T01:42:05.529 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_pinned_count": 0, 2023-11-04T01:42:05.529 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 6147, 2023-11-04T01:42:05.529 INFO:teuthology.orchestra.run.smithi077.stdout: "inst": { 2023-11-04T01:42:05.530 INFO:teuthology.orchestra.run.smithi077.stdout: "name": { 2023-11-04T01:42:05.530 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "client", 2023-11-04T01:42:05.530 INFO:teuthology.orchestra.run.smithi077.stdout: "num": 6147 2023-11-04T01:42:05.530 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:05.530 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2023-11-04T01:42:05.531 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2023-11-04T01:42:05.531 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:42:05.531 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 940408810 2023-11-04T01:42:05.531 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:05.531 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:05.532 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2023-11-04T01:42:05.532 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2023-11-04T01:42:05.532 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:42:05.532 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 940408810 2023-11-04T01:42:05.532 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:05.532 INFO:teuthology.orchestra.run.smithi077.stdout: "inst_str": "client.6147 192.168.0.1:0/940408810", 2023-11-04T01:42:05.533 INFO:teuthology.orchestra.run.smithi077.stdout: "addr_str": "192.168.0.1:0/940408810", 2023-11-04T01:42:05.533 INFO:teuthology.orchestra.run.smithi077.stdout: "inode_count": 1, 2023-11-04T01:42:05.533 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_epoch": 22, 2023-11-04T01:42:05.533 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch": 54, 2023-11-04T01:42:05.534 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:42:05.534 INFO:teuthology.orchestra.run.smithi077.stdout: "blocklisted": false, 2023-11-04T01:42:05.534 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs" 2023-11-04T01:42:05.534 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-04T01:42:05.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:05.541 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:05.542 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:42:05.542 DEBUG:teuthology.orchestra.run.smithi077:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:05.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:05.602 INFO:teuthology.orchestra.run.smithi077.stdout:fuseblk 2023-11-04T01:42:05.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:05.608 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:05.608 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:05.609 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:05.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:05.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:05.675 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data mksnap snap1 2023-11-04T01:42:05.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.713+0000 7f7ee8af9f40 1 Processor -- start 2023-11-04T01:42:05.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.713+0000 7f7ee8af9f40 1 -- start start 2023-11-04T01:42:05.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.714+0000 7f7ee8af9f40 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x557e4fbdd790 0x557e4fc79950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.714+0000 7f7ee8af9f40 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557e4fbfd7d0 0x557e4fbb16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.714+0000 7f7ee8af9f40 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557e4fc82960 0x557e4fbb1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.714+0000 7f7ee8af9f40 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e4fb633b0 con 0x557e4fbfd7d0 2023-11-04T01:42:05.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.714+0000 7f7ee8af9f40 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e4fafd650 con 0x557e4fc82960 2023-11-04T01:42:05.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.714+0000 7f7ee8af9f40 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x557e4fafd2f0 con 0x557e4fbdd790 2023-11-04T01:42:05.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.714+0000 7f7edffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557e4fbfd7d0 0x557e4fbb16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.714+0000 7f7edffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557e4fbfd7d0 0x557e4fbb16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56866/0 (socket says 172.21.15.77:56866) 2023-11-04T01:42:05.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.714+0000 7f7edffff640 1 -- 172.21.15.77:0/2109808049 learned_addr learned my addr 172.21.15.77:0/2109808049 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:05.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.714+0000 7f7ee6dfc640 1 --2- 172.21.15.77:0/2109808049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557e4fc82960 0x557e4fbb1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.714+0000 7f7ee65fb640 1 --2- 172.21.15.77:0/2109808049 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x557e4fbdd790 0x557e4fc79950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.714+0000 7f7edffff640 1 -- 172.21.15.77:0/2109808049 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x557e4fbdd790 msgr2=0x557e4fc79950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:05.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.714+0000 7f7edffff640 1 --2- 172.21.15.77:0/2109808049 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x557e4fbdd790 0x557e4fc79950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.714+0000 7f7edffff640 1 -- 172.21.15.77:0/2109808049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557e4fc82960 msgr2=0x557e4fbb1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:05.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.714+0000 7f7edffff640 1 --2- 172.21.15.77:0/2109808049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557e4fc82960 0x557e4fbb1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.714+0000 7f7edffff640 1 -- 172.21.15.77:0/2109808049 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed8005de0 con 0x557e4fbfd7d0 2023-11-04T01:42:05.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.715+0000 7f7edffff640 1 --2- 172.21.15.77:0/2109808049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557e4fbfd7d0 0x557e4fbb16c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f7ed000a640 tx=0x7f7ed0005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9af7fd09b22dad65 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:05.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.715+0000 7f7ee55f9640 1 -- 172.21.15.77:0/2109808049 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0008a00 con 0x557e4fbfd7d0 2023-11-04T01:42:05.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.715+0000 7f7ee55f9640 1 -- 172.21.15.77:0/2109808049 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed0008b60 con 0x557e4fbfd7d0 2023-11-04T01:42:05.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.715+0000 7f7ee55f9640 1 -- 172.21.15.77:0/2109808049 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0013440 con 0x557e4fbfd7d0 2023-11-04T01:42:05.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.715+0000 7f7ee8af9f40 1 -- 172.21.15.77:0/2109808049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557e4fbfd7d0 msgr2=0x557e4fbb16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:05.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.715+0000 7f7ee8af9f40 1 --2- 172.21.15.77:0/2109808049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557e4fbfd7d0 0x557e4fbb16c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f7ed000a640 tx=0x7f7ed0005f90 comp rx=0 tx=0).stop 2023-11-04T01:42:05.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.715+0000 7f7ee8af9f40 1 -- 172.21.15.77:0/2109808049 shutdown_connections 2023-11-04T01:42:05.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.715+0000 7f7ee8af9f40 1 --2- 172.21.15.77:0/2109808049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557e4fc82960 0x557e4fbb1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.715+0000 7f7ee8af9f40 1 --2- 172.21.15.77:0/2109808049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557e4fbfd7d0 0x557e4fbb16c0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.715+0000 7f7ee8af9f40 1 --2- 172.21.15.77:0/2109808049 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x557e4fbdd790 0x557e4fc79950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.715+0000 7f7ee8af9f40 1 -- 172.21.15.77:0/2109808049 >> 172.21.15.77:0/2109808049 conn(0x557e4fbdff40 msgr2=0x557e4fc80320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:05.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.715+0000 7f7ee8af9f40 1 -- 172.21.15.77:0/2109808049 shutdown_connections 2023-11-04T01:42:05.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.715+0000 7f7ee8af9f40 1 -- 172.21.15.77:0/2109808049 wait complete. 2023-11-04T01:42:05.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.716+0000 7f7ee8af9f40 1 Processor -- start 2023-11-04T01:42:05.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.716+0000 7f7ee8af9f40 1 -- start start 2023-11-04T01:42:05.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.716+0000 7f7ee8af9f40 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557e4fbdd790 0x557e4fbfa710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.716+0000 7f7ee8af9f40 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x557e4fbfd7d0 0x557e4fc76930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.716+0000 7f7ee8af9f40 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557e4fc82960 0x557e4fc7a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.716+0000 7f7ee8af9f40 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e4fadd4f0 con 0x557e4fc82960 2023-11-04T01:42:05.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.716+0000 7f7ee8af9f40 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e4fc7ad70 con 0x557e4fbdd790 2023-11-04T01:42:05.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.716+0000 7f7ee8af9f40 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x557e4fc7b050 con 0x557e4fbfd7d0 2023-11-04T01:42:05.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.717+0000 7f7ee6dfc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557e4fc82960 0x557e4fc7a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.717+0000 7f7ee6dfc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557e4fc82960 0x557e4fc7a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56870/0 (socket says 172.21.15.77:56870) 2023-11-04T01:42:05.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.717+0000 7f7ee6dfc640 1 -- 172.21.15.77:0/1879582801 learned_addr learned my addr 172.21.15.77:0/1879582801 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:05.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.717+0000 7f7ee65fb640 1 --2- 172.21.15.77:0/1879582801 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557e4fbdd790 0x557e4fbfa710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.717+0000 7f7edffff640 1 --2- 172.21.15.77:0/1879582801 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x557e4fbfd7d0 0x557e4fc76930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.717+0000 7f7ee6dfc640 1 -- 172.21.15.77:0/1879582801 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x557e4fbfd7d0 msgr2=0x557e4fc76930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:05.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.717+0000 7f7ee6dfc640 1 --2- 172.21.15.77:0/1879582801 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x557e4fbfd7d0 0x557e4fc76930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.717+0000 7f7ee6dfc640 1 -- 172.21.15.77:0/1879582801 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557e4fbdd790 msgr2=0x557e4fbfa710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:05.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.717+0000 7f7ee6dfc640 1 --2- 172.21.15.77:0/1879582801 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557e4fbdd790 0x557e4fbfa710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.717+0000 7f7ee6dfc640 1 -- 172.21.15.77:0/1879582801 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed0005d70 con 0x557e4fc82960 2023-11-04T01:42:05.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.717+0000 7f7edffff640 1 --2- 172.21.15.77:0/1879582801 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x557e4fbfd7d0 0x557e4fc76930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:05.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.717+0000 7f7ee6dfc640 1 --2- 172.21.15.77:0/1879582801 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557e4fc82960 0x557e4fc7a670 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000a1e0 tx=0x7f7ee000a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:05.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.717+0000 7f7edf7fe640 1 -- 172.21.15.77:0/1879582801 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0011630 con 0x557e4fc82960 2023-11-04T01:42:05.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.717+0000 7f7edf7fe640 1 -- 172.21.15.77:0/1879582801 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee00117b0 con 0x557e4fc82960 2023-11-04T01:42:05.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.717+0000 7f7ee8af9f40 1 -- 172.21.15.77:0/1879582801 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557e4fb09780 con 0x557e4fc82960 2023-11-04T01:42:05.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.717+0000 7f7edf7fe640 1 -- 172.21.15.77:0/1879582801 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0011b60 con 0x557e4fc82960 2023-11-04T01:42:05.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.717+0000 7f7ee8af9f40 1 -- 172.21.15.77:0/1879582801 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557e4fafc930 con 0x557e4fc82960 2023-11-04T01:42:05.735 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:42:05.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.719+0000 7f7edf7fe640 1 -- 172.21.15.77:0/1879582801 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7ee0011cc0 con 0x557e4fc82960 2023-11-04T01:42:05.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.719+0000 7f7edf7fe640 1 --2- 172.21.15.77:0/1879582801 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7ec8069820 0x7f7ec806bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.719+0000 7f7edf7fe640 1 -- 172.21.15.77:0/1879582801 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7ee0088810 con 0x557e4fc82960 2023-11-04T01:42:05.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.719+0000 7f7ee8af9f40 1 -- 172.21.15.77:0/1879582801 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- pool_op(create snap pool 9 tid 1 name snap1 v0) v4 -- 0x557e4fb6d330 con 0x557e4fc82960 2023-11-04T01:42:05.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.719+0000 7f7ee65fb640 1 --2- 172.21.15.77:0/1879582801 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7ec8069820 0x7f7ec806bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.719+0000 7f7edf7fe640 1 -- 172.21.15.77:0/1879582801 <== mon.0 v2:172.21.15.77:3300/0 6 ==== pool_op_reply(tid 1 (95) Operation not supported v54) v1 ==== 43+0+0 (secure 0 0 0) 0x7f7ee00536b0 con 0x557e4fc82960 2023-11-04T01:42:05.738 INFO:teuthology.orchestra.run.smithi077.stderr:error creating pool cephfs_data snapshot snap1: (95) Operation not supported 2023-11-04T01:42:05.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.719+0000 7f7ee8af9f40 1 -- 172.21.15.77:0/1879582801 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7ec8069820 msgr2=0x7f7ec806bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:05.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.719+0000 7f7ee8af9f40 1 --2- 172.21.15.77:0/1879582801 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7ec8069820 0x7f7ec806bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.719+0000 7f7ee8af9f40 1 -- 172.21.15.77:0/1879582801 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557e4fc82960 msgr2=0x557e4fc7a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:05.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.719+0000 7f7ee8af9f40 1 --2- 172.21.15.77:0/1879582801 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557e4fc82960 0x557e4fc7a670 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000a1e0 tx=0x7f7ee000a6a0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.719+0000 7f7ee8af9f40 1 -- 172.21.15.77:0/1879582801 shutdown_connections 2023-11-04T01:42:05.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.719+0000 7f7ee8af9f40 1 --2- 172.21.15.77:0/1879582801 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7ec8069820 0x7f7ec806bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.720+0000 7f7ee8af9f40 1 --2- 172.21.15.77:0/1879582801 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557e4fc82960 0x557e4fc7a670 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.720+0000 7f7ee8af9f40 1 --2- 172.21.15.77:0/1879582801 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x557e4fbfd7d0 0x557e4fc76930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.720+0000 7f7ee8af9f40 1 --2- 172.21.15.77:0/1879582801 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557e4fbdd790 0x557e4fbfa710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.720+0000 7f7ee8af9f40 1 -- 172.21.15.77:0/1879582801 >> 172.21.15.77:0/1879582801 conn(0x557e4fbdff40 msgr2=0x557e4fc7b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:05.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.720+0000 7f7ee8af9f40 1 -- 172.21.15.77:0/1879582801 shutdown_connections 2023-11-04T01:42:05.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.720+0000 7f7ee8af9f40 1 -- 172.21.15.77:0/1879582801 wait complete. 2023-11-04T01:42:05.741 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata mksnap snap2 2023-11-04T01:42:05.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.815+0000 7fcd973fef40 1 Processor -- start 2023-11-04T01:42:05.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.815+0000 7fcd973fef40 1 -- start start 2023-11-04T01:42:05.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.816+0000 7fcd973fef40 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560ce45252b0 0x560ce45d9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.816+0000 7fcd973fef40 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ce4551240 0x560ce45f4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.816+0000 7fcd973fef40 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560ce45e2310 0x560ce454d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.816+0000 7fcd973fef40 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ce446d650 con 0x560ce45252b0 2023-11-04T01:42:05.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.816+0000 7fcd973fef40 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ce446d2f0 con 0x560ce4551240 2023-11-04T01:42:05.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.816+0000 7fcd973fef40 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x560ce444d4f0 con 0x560ce45e2310 2023-11-04T01:42:05.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.816+0000 7fcd94f00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560ce45252b0 0x560ce45d9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.816+0000 7fcd94f00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560ce45252b0 0x560ce45d9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56874/0 (socket says 172.21.15.77:56874) 2023-11-04T01:42:05.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.816+0000 7fcd94f00640 1 -- 172.21.15.77:0/2868912791 learned_addr learned my addr 172.21.15.77:0/2868912791 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:05.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.816+0000 7fcd94f00640 1 -- 172.21.15.77:0/2868912791 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560ce45e2310 msgr2=0x560ce454d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:05.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.816+0000 7fcd94f00640 1 --2- 172.21.15.77:0/2868912791 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560ce45e2310 0x560ce454d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.816+0000 7fcd94f00640 1 -- 172.21.15.77:0/2868912791 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ce4551240 msgr2=0x560ce45f4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:05.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.816+0000 7fcd94f00640 1 --2- 172.21.15.77:0/2868912791 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ce4551240 0x560ce45f4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.816+0000 7fcd94f00640 1 -- 172.21.15.77:0/2868912791 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd88005de0 con 0x560ce45252b0 2023-11-04T01:42:05.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.816+0000 7fcd94f00640 1 --2- 172.21.15.77:0/2868912791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560ce45252b0 0x560ce45d9b30 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fcd840096b0 tx=0x7fcd84009b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37652578c56d8ff server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:05.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.816+0000 7fcd936fd640 1 -- 172.21.15.77:0/2868912791 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8400b930 con 0x560ce45252b0 2023-11-04T01:42:05.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.816+0000 7fcd936fd640 1 -- 172.21.15.77:0/2868912791 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8400ba90 con 0x560ce45252b0 2023-11-04T01:42:05.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.816+0000 7fcd936fd640 1 -- 172.21.15.77:0/2868912791 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8400be40 con 0x560ce45252b0 2023-11-04T01:42:05.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.817+0000 7fcd973fef40 1 -- 172.21.15.77:0/2868912791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560ce45252b0 msgr2=0x560ce45d9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:05.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.817+0000 7fcd973fef40 1 --2- 172.21.15.77:0/2868912791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560ce45252b0 0x560ce45d9b30 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fcd840096b0 tx=0x7fcd84009b70 comp rx=0 tx=0).stop 2023-11-04T01:42:05.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.817+0000 7fcd973fef40 1 -- 172.21.15.77:0/2868912791 shutdown_connections 2023-11-04T01:42:05.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.817+0000 7fcd973fef40 1 --2- 172.21.15.77:0/2868912791 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560ce45e2310 0x560ce454d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.817+0000 7fcd973fef40 1 --2- 172.21.15.77:0/2868912791 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ce4551240 0x560ce45f4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.817+0000 7fcd973fef40 1 --2- 172.21.15.77:0/2868912791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560ce45252b0 0x560ce45d9b30 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.817+0000 7fcd973fef40 1 -- 172.21.15.77:0/2868912791 >> 172.21.15.77:0/2868912791 conn(0x560ce454ff40 msgr2=0x560ce454e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:05.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.817+0000 7fcd973fef40 1 -- 172.21.15.77:0/2868912791 shutdown_connections 2023-11-04T01:42:05.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.817+0000 7fcd973fef40 1 -- 172.21.15.77:0/2868912791 wait complete. 2023-11-04T01:42:05.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.817+0000 7fcd973fef40 1 Processor -- start 2023-11-04T01:42:05.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.817+0000 7fcd973fef40 1 -- start start 2023-11-04T01:42:05.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.818+0000 7fcd973fef40 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560ce45252b0 0x560ce45e1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.818+0000 7fcd973fef40 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560ce4551240 0x560ce45f3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.818+0000 7fcd973fef40 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ce45e2310 0x560ce45f4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.818+0000 7fcd973fef40 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ce45dd9c0 con 0x560ce45252b0 2023-11-04T01:42:05.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.818+0000 7fcd973fef40 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ce45de810 con 0x560ce45e2310 2023-11-04T01:42:05.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.818+0000 7fcd973fef40 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x560ce45f4870 con 0x560ce4551240 2023-11-04T01:42:05.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.818+0000 7fcd94f00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560ce45252b0 0x560ce45e1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.818+0000 7fcd94f00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560ce45252b0 0x560ce45e1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56880/0 (socket says 172.21.15.77:56880) 2023-11-04T01:42:05.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.818+0000 7fcd94f00640 1 -- 172.21.15.77:0/2704487416 learned_addr learned my addr 172.21.15.77:0/2704487416 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:05.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.818+0000 7fcd946ff640 1 --2- 172.21.15.77:0/2704487416 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560ce4551240 0x560ce45f3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.818+0000 7fcd95701640 1 --2- 172.21.15.77:0/2704487416 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ce45e2310 0x560ce45f4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.818+0000 7fcd94f00640 1 -- 172.21.15.77:0/2704487416 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560ce4551240 msgr2=0x560ce45f3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:05.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.818+0000 7fcd94f00640 1 --2- 172.21.15.77:0/2704487416 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560ce4551240 0x560ce45f3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.818+0000 7fcd94f00640 1 -- 172.21.15.77:0/2704487416 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ce45e2310 msgr2=0x560ce45f4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:05.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.818+0000 7fcd94f00640 1 --2- 172.21.15.77:0/2704487416 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ce45e2310 0x560ce45f4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.818+0000 7fcd94f00640 1 -- 172.21.15.77:0/2704487416 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd840092e0 con 0x560ce45252b0 2023-11-04T01:42:05.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.818+0000 7fcd946ff640 1 --2- 172.21.15.77:0/2704487416 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560ce4551240 0x560ce45f3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:05.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.819+0000 7fcd94f00640 1 --2- 172.21.15.77:0/2704487416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560ce45252b0 0x560ce45e1280 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fcd84000f80 tx=0x7fcd84003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:05.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.819+0000 7fcd926fb640 1 -- 172.21.15.77:0/2704487416 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8401e040 con 0x560ce45252b0 2023-11-04T01:42:05.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.819+0000 7fcd926fb640 1 -- 172.21.15.77:0/2704487416 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd84019aa0 con 0x560ce45252b0 2023-11-04T01:42:05.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.819+0000 7fcd973fef40 1 -- 172.21.15.77:0/2704487416 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560ce4493770 con 0x560ce45252b0 2023-11-04T01:42:05.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.819+0000 7fcd926fb640 1 -- 172.21.15.77:0/2704487416 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd84019e90 con 0x560ce45252b0 2023-11-04T01:42:05.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.819+0000 7fcd973fef40 1 -- 172.21.15.77:0/2704487416 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560ce4479780 con 0x560ce45252b0 2023-11-04T01:42:05.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.820+0000 7fcd926fb640 1 -- 172.21.15.77:0/2704487416 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcd840103f0 con 0x560ce45252b0 2023-11-04T01:42:05.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.820+0000 7fcd926fb640 1 --2- 172.21.15.77:0/2704487416 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcd80069850 0x7fcd8006bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.820+0000 7fcd926fb640 1 -- 172.21.15.77:0/2704487416 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fcd8408a1b0 con 0x560ce45252b0 2023-11-04T01:42:05.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.821+0000 7fcd973fef40 1 -- 172.21.15.77:0/2704487416 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- pool_op(create snap pool 8 tid 1 name snap2 v0) v4 -- 0x560ce44dd330 con 0x560ce45252b0 2023-11-04T01:42:05.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.821+0000 7fcd946ff640 1 --2- 172.21.15.77:0/2704487416 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcd80069850 0x7fcd8006bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.821+0000 7fcd926fb640 1 -- 172.21.15.77:0/2704487416 <== mon.0 v2:172.21.15.77:3300/0 6 ==== pool_op_reply(tid 1 (95) Operation not supported v54) v1 ==== 43+0+0 (secure 0 0 0) 0x7fcd84055050 con 0x560ce45252b0 2023-11-04T01:42:05.837 INFO:teuthology.orchestra.run.smithi077.stderr:error creating pool cephfs_metadata snapshot snap2: (95) Operation not supported 2023-11-04T01:42:05.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.821+0000 7fcd973fef40 1 -- 172.21.15.77:0/2704487416 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcd80069850 msgr2=0x7fcd8006bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:05.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.821+0000 7fcd973fef40 1 --2- 172.21.15.77:0/2704487416 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcd80069850 0x7fcd8006bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.821+0000 7fcd973fef40 1 -- 172.21.15.77:0/2704487416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560ce45252b0 msgr2=0x560ce45e1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:05.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.821+0000 7fcd973fef40 1 --2- 172.21.15.77:0/2704487416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560ce45252b0 0x560ce45e1280 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fcd84000f80 tx=0x7fcd84003330 comp rx=0 tx=0).stop 2023-11-04T01:42:05.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.821+0000 7fcd973fef40 1 -- 172.21.15.77:0/2704487416 shutdown_connections 2023-11-04T01:42:05.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.821+0000 7fcd973fef40 1 --2- 172.21.15.77:0/2704487416 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcd80069850 0x7fcd8006bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.821+0000 7fcd973fef40 1 --2- 172.21.15.77:0/2704487416 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560ce45e2310 0x560ce45f4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.821+0000 7fcd973fef40 1 --2- 172.21.15.77:0/2704487416 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560ce4551240 0x560ce45f3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.821+0000 7fcd973fef40 1 --2- 172.21.15.77:0/2704487416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560ce45252b0 0x560ce45e1280 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.821+0000 7fcd973fef40 1 -- 172.21.15.77:0/2704487416 >> 172.21.15.77:0/2704487416 conn(0x560ce454ff40 msgr2=0x560ce45fbf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:05.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.821+0000 7fcd973fef40 1 -- 172.21.15.77:0/2704487416 shutdown_connections 2023-11-04T01:42:05.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.821+0000 7fcd973fef40 1 -- 172.21.15.77:0/2704487416 wait complete. 2023-11-04T01:42:05.840 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:42:05.841 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool mksnap cephfs_data snap3 2023-11-04T01:42:05.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.981+0000 7f24a85c5640 1 Processor -- start 2023-11-04T01:42:05.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.981+0000 7f24a85c5640 1 -- start start 2023-11-04T01:42:05.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.982+0000 7f24a85c5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f24a0159c00 0x7f24a00cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.982+0000 7f24a85c5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f24a00ae1d0 0x7f24a00c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.982+0000 7f24a85c5640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a015aff0 con 0x7f24a00c48e0 2023-11-04T01:42:05.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.982+0000 7f24a85c5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a00c52d0 con 0x7f24a0159c00 2023-11-04T01:42:05.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.982+0000 7f24a85c5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a015a3e0 con 0x7f24a00ae1d0 2023-11-04T01:42:05.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.982+0000 7f24a6361640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f24a0159c00 0x7f24a00cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.982+0000 7f24a6361640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f24a0159c00 0x7f24a00cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56886/0 (socket says 172.21.15.77:56886) 2023-11-04T01:42:05.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.982+0000 7f24a6361640 1 -- 172.21.15.77:0/1127788452 learned_addr learned my addr 172.21.15.77:0/1127788452 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:05.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.982+0000 7f24a6361640 1 -- 172.21.15.77:0/1127788452 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f24a00ae1d0 msgr2=0x7f24a00c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:05.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.982+0000 7f24a6b62640 1 --2- 172.21.15.77:0/1127788452 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f24a00ae1d0 0x7f24a00c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.982+0000 7f24a6361640 1 --2- 172.21.15.77:0/1127788452 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f24a00ae1d0 0x7f24a00c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.982+0000 7f24a6361640 1 -- 172.21.15.77:0/1127788452 >> v1:172.21.15.122:6789/0 conn(0x7f24a00c48e0 legacy=0x7f24a00adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:05.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.982+0000 7f24a6361640 1 -- 172.21.15.77:0/1127788452 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a015a6c0 con 0x7f24a0159c00 2023-11-04T01:42:05.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.983+0000 7f24a6b62640 1 --2- 172.21.15.77:0/1127788452 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f24a00ae1d0 0x7f24a00c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:05.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.983+0000 7f24a6361640 1 --2- 172.21.15.77:0/1127788452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24a0159c00 0x7f24a00cc890 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f249c009e50 tx=0x7f249c02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d2eba5bf8f197b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:05.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.983+0000 7f24a535f640 1 -- 172.21.15.77:0/1127788452 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c02c9f0 con 0x7f24a0159c00 2023-11-04T01:42:05.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.983+0000 7f24a535f640 1 -- 172.21.15.77:0/1127788452 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249c02cb50 con 0x7f24a0159c00 2023-11-04T01:42:05.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.983+0000 7f24a535f640 1 -- 172.21.15.77:0/1127788452 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c0343f0 con 0x7f24a0159c00 2023-11-04T01:42:05.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.984+0000 7f24a85c5640 1 -- 172.21.15.77:0/1127788452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24a0159c00 msgr2=0x7f24a00cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:05.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.984+0000 7f24a85c5640 1 --2- 172.21.15.77:0/1127788452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24a0159c00 0x7f24a00cc890 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f249c009e50 tx=0x7f249c02be50 comp rx=0 tx=0).stop 2023-11-04T01:42:05.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.984+0000 7f24a85c5640 1 -- 172.21.15.77:0/1127788452 shutdown_connections 2023-11-04T01:42:05.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.984+0000 7f24a85c5640 1 --2- 172.21.15.77:0/1127788452 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f24a00ae1d0 0x7f24a00c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.984+0000 7f24a85c5640 1 --2- 172.21.15.77:0/1127788452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24a0159c00 0x7f24a00cc890 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.984+0000 7f24a85c5640 1 -- 172.21.15.77:0/1127788452 >> 172.21.15.77:0/1127788452 conn(0x7f24a00ce950 msgr2=0x7f24a00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:05.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.984+0000 7f24a85c5640 1 -- 172.21.15.77:0/1127788452 shutdown_connections 2023-11-04T01:42:05.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.984+0000 7f24a85c5640 1 -- 172.21.15.77:0/1127788452 wait complete. 2023-11-04T01:42:05.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.985+0000 7f24a85c5640 1 Processor -- start 2023-11-04T01:42:05.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.985+0000 7f24a85c5640 1 -- start start 2023-11-04T01:42:05.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.986+0000 7f24a85c5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24a00ae1d0 0x7f24a00c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.986+0000 7f24a85c5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f24a00c48e0 0x7f24a015cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.986+0000 7f24a85c5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24a0159c00 0x7f24a013ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.986+0000 7f24a85c5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a00c7aa0 con 0x7f24a0159c00 2023-11-04T01:42:05.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.986+0000 7f24a85c5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a0143fe0 con 0x7f24a00ae1d0 2023-11-04T01:42:05.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.986+0000 7f24a85c5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a015d280 con 0x7f24a00c48e0 2023-11-04T01:42:05.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.986+0000 7f24a6b62640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24a0159c00 0x7f24a013ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.986+0000 7f24a6b62640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24a0159c00 0x7f24a013ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56890/0 (socket says 172.21.15.77:56890) 2023-11-04T01:42:05.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.986+0000 7f24a6b62640 1 -- 172.21.15.77:0/231210624 learned_addr learned my addr 172.21.15.77:0/231210624 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:05.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.986+0000 7f24a6361640 1 --2- 172.21.15.77:0/231210624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24a00ae1d0 0x7f24a00c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.986+0000 7f24a5b60640 1 --2- 172.21.15.77:0/231210624 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f24a00c48e0 0x7f24a015cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.986+0000 7f24a6b62640 1 -- 172.21.15.77:0/231210624 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f24a00c48e0 msgr2=0x7f24a015cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:05.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.986+0000 7f24a6b62640 1 --2- 172.21.15.77:0/231210624 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f24a00c48e0 0x7f24a015cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.986+0000 7f24a6b62640 1 -- 172.21.15.77:0/231210624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24a00ae1d0 msgr2=0x7f24a00c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:05.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.986+0000 7f24a6b62640 1 --2- 172.21.15.77:0/231210624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24a00ae1d0 0x7f24a00c67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:05.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.986+0000 7f24a6b62640 1 -- 172.21.15.77:0/231210624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f249c009b30 con 0x7f24a0159c00 2023-11-04T01:42:05.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.986+0000 7f24a6b62640 1 --2- 172.21.15.77:0/231210624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24a0159c00 0x7f24a013ca70 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f249800c7f0 tx=0x7f249800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:05.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.987+0000 7f2496ffd640 1 -- 172.21.15.77:0/231210624 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2498007820 con 0x7f24a0159c00 2023-11-04T01:42:05.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.987+0000 7f2496ffd640 1 -- 172.21.15.77:0/231210624 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2498007980 con 0x7f24a0159c00 2023-11-04T01:42:05.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.987+0000 7f24a85c5640 1 -- 172.21.15.77:0/231210624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a00c5a80 con 0x7f24a0159c00 2023-11-04T01:42:05.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.987+0000 7f2496ffd640 1 -- 172.21.15.77:0/231210624 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2498007d70 con 0x7f24a0159c00 2023-11-04T01:42:05.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.987+0000 7f24a85c5640 1 -- 172.21.15.77:0/231210624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a00c62c0 con 0x7f24a0159c00 2023-11-04T01:42:05.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.987+0000 7f24a85c5640 1 -- 172.21.15.77:0/231210624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a00c64e0 con 0x7f24a0159c00 2023-11-04T01:42:05.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.988+0000 7f2496ffd640 1 -- 172.21.15.77:0/231210624 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f24980113f0 con 0x7f24a0159c00 2023-11-04T01:42:05.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.988+0000 7f2496ffd640 1 --2- 172.21.15.77:0/231210624 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f248406ae70 0x7f248406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:05.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.989+0000 7f2496ffd640 1 -- 172.21.15.77:0/231210624 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f24980898d0 con 0x7f24a0159c00 2023-11-04T01:42:05.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.989+0000 7f24a6361640 1 --2- 172.21.15.77:0/231210624 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f248406ae70 0x7f248406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:05.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.989+0000 7f24a6361640 1 --2- 172.21.15.77:0/231210624 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f248406ae70 0x7f248406d330 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f249c035000 tx=0x7f249c030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:05.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:05.993+0000 7f2496ffd640 1 -- 172.21.15.77:0/231210624 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2498054820 con 0x7f24a0159c00 2023-11-04T01:42:06.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.158+0000 7f24a85c5640 1 -- 172.21.15.77:0/231210624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool mksnap", "pool": "cephfs_data", "snap": "snap3"} v 0) v1 -- 0x7f24a0074290 con 0x7f24a0159c00 2023-11-04T01:42:06.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.159+0000 7f2496ffd640 1 -- 172.21.15.77:0/231210624 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool mksnap", "pool": "cephfs_data", "snap": "snap3"}]=-95 (95) Operation not supported v54) v1 ==== 131+0+0 (secure 0 0 0) 0x7f2498057e40 con 0x7f24a0159c00 2023-11-04T01:42:06.161 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENOTSUP: (95) Operation not supported 2023-11-04T01:42:06.165 DEBUG:teuthology.orchestra.run:got remote process result: 95 2023-11-04T01:42:06.166 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool mksnap cephfs_metadata snap4 2023-11-04T01:42:06.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.267+0000 7f991e5ce640 1 Processor -- start 2023-11-04T01:42:06.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.267+0000 7f991e5ce640 1 -- start start 2023-11-04T01:42:06.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.268+0000 7f991e5ce640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f991815d1b0 0x7f99180cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:06.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.268+0000 7f991e5ce640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99180c9bf0 con 0x7f9918070ff0 2023-11-04T01:42:06.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.268+0000 7f991e5ce640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99180cd890 con 0x7f9918066000 2023-11-04T01:42:06.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.268+0000 7f991e5ce640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99180cdb30 con 0x7f991815d1b0 2023-11-04T01:42:06.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.268+0000 7f9917fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f9918070ff0 0x7f99180713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:42750/0 (socket says 172.21.15.77:42750) 2023-11-04T01:42:06.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.268+0000 7f9917fff640 1 -- 172.21.15.77:0/2368946036 learned_addr learned my addr 172.21.15.77:0/2368946036 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:06.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.268+0000 7f99177fe640 1 --2- 172.21.15.77:0/2368946036 >> v2:172.21.15.122:3300/0 conn(0x7f991815d1b0 0x7f99180cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:06.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.268+0000 7f9916ffd640 1 -- 172.21.15.77:0/2368946036 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1353023827 0 0) 0x7f99180c9bf0 con 0x7f9918070ff0 2023-11-04T01:42:06.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.268+0000 7f9916ffd640 1 -- 172.21.15.77:0/2368946036 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9900003520 con 0x7f9918070ff0 2023-11-04T01:42:06.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.268+0000 7f9916ffd640 1 -- 172.21.15.77:0/2368946036 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4019479998 0 0) 0x7f9900003520 con 0x7f9918070ff0 2023-11-04T01:42:06.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.268+0000 7f9916ffd640 1 -- 172.21.15.77:0/2368946036 >> v2:172.21.15.122:3300/0 conn(0x7f991815d1b0 msgr2=0x7f99180cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:06.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.268+0000 7f9916ffd640 1 --2- 172.21.15.77:0/2368946036 >> v2:172.21.15.122:3300/0 conn(0x7f991815d1b0 0x7f99180cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.268+0000 7f9916ffd640 1 -- 172.21.15.77:0/2368946036 >> v1:172.21.15.122:6789/0 conn(0x7f9918066000 legacy=0x7f991806a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:06.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.268+0000 7f9916ffd640 1 -- 172.21.15.77:0/2368946036 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99180cde10 con 0x7f9918070ff0 2023-11-04T01:42:06.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.268+0000 7f9916ffd640 1 -- 172.21.15.77:0/2368946036 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f9908001670 con 0x7f9918070ff0 2023-11-04T01:42:06.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.268+0000 7f9916ffd640 1 -- 172.21.15.77:0/2368946036 >> v1:172.21.15.77:6789/0 conn(0x7f9918070ff0 legacy=0x7f99180713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:06.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.268+0000 7f9916ffd640 1 --2- 172.21.15.77:0/2368946036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9900003970 0x7f9900003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:06.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.268+0000 7f9916ffd640 1 --2- 172.21.15.77:0/2368946036 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f99000047c0 0x7f9900004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:06.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.268+0000 7f9916ffd640 1 --2- 172.21.15.77:0/2368946036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9900005180 0x7f990000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:06.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.269+0000 7f9916ffd640 1 -- 172.21.15.77:0/2368946036 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99180cdb30 con 0x7f9900003970 2023-11-04T01:42:06.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.269+0000 7f9916ffd640 1 -- 172.21.15.77:0/2368946036 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990000c020 con 0x7f9900005180 2023-11-04T01:42:06.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.269+0000 7f9916ffd640 1 -- 172.21.15.77:0/2368946036 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f990000c1e0 con 0x7f99000047c0 2023-11-04T01:42:06.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.269+0000 7f9917fff640 1 --2- 172.21.15.77:0/2368946036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9900003970 0x7f9900003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:06.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.269+0000 7f991cb6b640 1 --2- 172.21.15.77:0/2368946036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9900005180 0x7f990000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:06.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.269+0000 7f99177fe640 1 --2- 172.21.15.77:0/2368946036 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f99000047c0 0x7f9900004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:06.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.269+0000 7f9917fff640 1 -- 172.21.15.77:0/2368946036 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f99000047c0 msgr2=0x7f9900004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:06.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.269+0000 7f9917fff640 1 --2- 172.21.15.77:0/2368946036 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f99000047c0 0x7f9900004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.269+0000 7f9917fff640 1 -- 172.21.15.77:0/2368946036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9900005180 msgr2=0x7f990000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:06.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.269+0000 7f9917fff640 1 --2- 172.21.15.77:0/2368946036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9900005180 0x7f990000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.269+0000 7f9917fff640 1 -- 172.21.15.77:0/2368946036 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9900003520 con 0x7f9900003970 2023-11-04T01:42:06.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.269+0000 7f991cb6b640 1 --2- 172.21.15.77:0/2368946036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9900005180 0x7f990000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:06.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.269+0000 7f991cb6b640 1 -- 172.21.15.77:0/2368946036 reap_dead start 2023-11-04T01:42:06.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.270+0000 7f9917fff640 1 --2- 172.21.15.77:0/2368946036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9900003970 0x7f9900003d90 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f990800c240 tx=0x7f99000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be294d9b1aa9d1b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:06.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.270+0000 7f9916ffd640 1 -- 172.21.15.77:0/2368946036 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9908005ad0 con 0x7f9900003970 2023-11-04T01:42:06.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.270+0000 7f9916ffd640 1 -- 172.21.15.77:0/2368946036 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9908005c30 con 0x7f9900003970 2023-11-04T01:42:06.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.270+0000 7f9916ffd640 1 -- 172.21.15.77:0/2368946036 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990802caf0 con 0x7f9900003970 2023-11-04T01:42:06.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.270+0000 7f991e5ce640 1 -- 172.21.15.77:0/2368946036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9900003970 msgr2=0x7f9900003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:06.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.270+0000 7f991e5ce640 1 --2- 172.21.15.77:0/2368946036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9900003970 0x7f9900003d90 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f990800c240 tx=0x7f99000057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.270+0000 7f991e5ce640 1 -- 172.21.15.77:0/2368946036 shutdown_connections 2023-11-04T01:42:06.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.270+0000 7f991e5ce640 1 --2- 172.21.15.77:0/2368946036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9900003970 0x7f9900003d90 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.270+0000 7f991e5ce640 1 -- 172.21.15.77:0/2368946036 >> 172.21.15.77:0/2368946036 conn(0x7f99180cbc90 msgr2=0x7f99180cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:06.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.270+0000 7f991e5ce640 1 -- 172.21.15.77:0/2368946036 shutdown_connections 2023-11-04T01:42:06.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.270+0000 7f991e5ce640 1 -- 172.21.15.77:0/2368946036 wait complete. 2023-11-04T01:42:06.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.271+0000 7f991e5ce640 1 Processor -- start 2023-11-04T01:42:06.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.272+0000 7f991e5ce640 1 -- start start 2023-11-04T01:42:06.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.272+0000 7f991e5ce640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9900003970 0x7f9918155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:06.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.272+0000 7f991e5ce640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f991815bb10 0x7f99180b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:06.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.272+0000 7f991e5ce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99180b1e30 0x7f99180b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:06.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.272+0000 7f991e5ce640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99180b27f0 con 0x7f99180b1e30 2023-11-04T01:42:06.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.272+0000 7f991e5ce640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99180b4fa0 con 0x7f991815bb10 2023-11-04T01:42:06.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.272+0000 7f991e5ce640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9918155db0 con 0x7f9900003970 2023-11-04T01:42:06.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.272+0000 7f991cb6b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99180b1e30 0x7f99180b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:06.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.272+0000 7f991cb6b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99180b1e30 0x7f99180b22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56910/0 (socket says 172.21.15.77:56910) 2023-11-04T01:42:06.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.272+0000 7f991cb6b640 1 -- 172.21.15.77:0/3392868393 learned_addr learned my addr 172.21.15.77:0/3392868393 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:06.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.273+0000 7f9917fff640 1 --2- 172.21.15.77:0/3392868393 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9900003970 0x7f9918155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:06.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.273+0000 7f99177fe640 1 --2- 172.21.15.77:0/3392868393 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f991815bb10 0x7f99180b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:06.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.273+0000 7f991cb6b640 1 -- 172.21.15.77:0/3392868393 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9900003970 msgr2=0x7f9918155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:06.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.273+0000 7f991cb6b640 1 --2- 172.21.15.77:0/3392868393 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9900003970 0x7f9918155870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.273+0000 7f991cb6b640 1 -- 172.21.15.77:0/3392868393 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f991815bb10 msgr2=0x7f99180b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:06.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.273+0000 7f991cb6b640 1 --2- 172.21.15.77:0/3392868393 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f991815bb10 0x7f99180b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.273+0000 7f991cb6b640 1 -- 172.21.15.77:0/3392868393 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99180b4700 con 0x7f99180b1e30 2023-11-04T01:42:06.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.273+0000 7f9917fff640 1 --2- 172.21.15.77:0/3392868393 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9900003970 0x7f9918155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:06.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.273+0000 7f99177fe640 1 --2- 172.21.15.77:0/3392868393 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f991815bb10 0x7f99180b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:06.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.273+0000 7f991cb6b640 1 --2- 172.21.15.77:0/3392868393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99180b1e30 0x7f99180b22b0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f99180b1de0 tx=0x7f991000e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:06.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.273+0000 7f9914ff9640 1 -- 172.21.15.77:0/3392868393 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9910003b80 con 0x7f99180b1e30 2023-11-04T01:42:06.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.273+0000 7f9914ff9640 1 -- 172.21.15.77:0/3392868393 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9910003ce0 con 0x7f99180b1e30 2023-11-04T01:42:06.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.273+0000 7f991e5ce640 1 -- 172.21.15.77:0/3392868393 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99180b49e0 con 0x7f99180b1e30 2023-11-04T01:42:06.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.273+0000 7f9914ff9640 1 -- 172.21.15.77:0/3392868393 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9910005310 con 0x7f99180b1e30 2023-11-04T01:42:06.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.273+0000 7f991e5ce640 1 -- 172.21.15.77:0/3392868393 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99180c2ee0 con 0x7f99180b1e30 2023-11-04T01:42:06.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.274+0000 7f991e5ce640 1 -- 172.21.15.77:0/3392868393 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99180c2d40 con 0x7f99180b1e30 2023-11-04T01:42:06.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.274+0000 7f9914ff9640 1 -- 172.21.15.77:0/3392868393 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9910005470 con 0x7f99180b1e30 2023-11-04T01:42:06.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.275+0000 7f9914ff9640 1 --2- 172.21.15.77:0/3392868393 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f990406aea0 0x7f990406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:06.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.275+0000 7f9914ff9640 1 -- 172.21.15.77:0/3392868393 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9910089030 con 0x7f99180b1e30 2023-11-04T01:42:06.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.275+0000 7f9917fff640 1 --2- 172.21.15.77:0/3392868393 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f990406aea0 0x7f990406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:06.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.275+0000 7f9917fff640 1 --2- 172.21.15.77:0/3392868393 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f990406aea0 0x7f990406d360 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9908034000 tx=0x7f9908009030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:06.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.279+0000 7f9914ff9640 1 -- 172.21.15.77:0/3392868393 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f99180c2d40 con 0x7f99180b1e30 2023-11-04T01:42:06.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.444+0000 7f991e5ce640 1 -- 172.21.15.77:0/3392868393 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool mksnap", "pool": "cephfs_metadata", "snap": "snap4"} v 0) v1 -- 0x7f99180c2d40 con 0x7f99180b1e30 2023-11-04T01:42:06.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.444+0000 7f9914ff9640 1 -- 172.21.15.77:0/3392868393 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool mksnap", "pool": "cephfs_metadata", "snap": "snap4"}]=-95 (95) Operation not supported v54) v1 ==== 135+0+0 (secure 0 0 0) 0x7f99180c2d40 con 0x7f99180b1e30 2023-11-04T01:42:06.446 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENOTSUP: (95) Operation not supported 2023-11-04T01:42:06.450 DEBUG:teuthology.orchestra.run:got remote process result: 95 2023-11-04T01:42:06.451 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:42:06.452 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:42:06.510 DEBUG:teuthology.orchestra.run.smithi122:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:42:06.556 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:42:06.556 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:42:06.557 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:42:06.572 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:06.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.710+0000 7f58e876c640 1 Processor -- start 2023-11-04T01:42:06.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.710+0000 7f58e876c640 1 -- start start 2023-11-04T01:42:06.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.711+0000 7f58e876c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f58e00cde60 0x7f58e015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:06.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.711+0000 7f58e876c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f58e015daa0 0x7f58e0157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:06.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.711+0000 7f58e876c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f58e00ce240 0x7f58e0157540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:06.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.711+0000 7f58e876c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58e015e5c0 con 0x7f58e00ce240 2023-11-04T01:42:06.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.711+0000 7f58e876c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58e0157a80 con 0x7f58e015daa0 2023-11-04T01:42:06.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.711+0000 7f58e876c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e015e000 con 0x7f58e00cde60 2023-11-04T01:42:06.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.712+0000 7f58e6d09640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f58e00ce240 0x7f58e0157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:06.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.712+0000 7f58e6d09640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f58e00ce240 0x7f58e0157540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56912/0 (socket says 172.21.15.77:56912) 2023-11-04T01:42:06.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.712+0000 7f58e6d09640 1 -- 172.21.15.77:0/316373138 learned_addr learned my addr 172.21.15.77:0/316373138 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:06.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.712+0000 7f58e6d09640 1 -- 172.21.15.77:0/316373138 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f58e00cde60 msgr2=0x7f58e015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:06.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.712+0000 7f58e6d09640 1 --2- 172.21.15.77:0/316373138 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f58e00cde60 0x7f58e015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.712+0000 7f58e6d09640 1 -- 172.21.15.77:0/316373138 >> v2:172.21.15.122:3300/0 conn(0x7f58e015daa0 msgr2=0x7f58e0157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:06.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.712+0000 7f58e5d07640 1 --2- 172.21.15.77:0/316373138 >> v2:172.21.15.122:3300/0 conn(0x7f58e015daa0 0x7f58e0157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:06.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.712+0000 7f58e6d09640 1 --2- 172.21.15.77:0/316373138 >> v2:172.21.15.122:3300/0 conn(0x7f58e015daa0 0x7f58e0157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.712+0000 7f58e6d09640 1 -- 172.21.15.77:0/316373138 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e015e2e0 con 0x7f58e00ce240 2023-11-04T01:42:06.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.713+0000 7f58e6d09640 1 --2- 172.21.15.77:0/316373138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58e00ce240 0x7f58e0157540 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f58e006c7c0 tx=0x7f58d802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b90e9b2ffa2f8c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:06.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.713+0000 7f58e5506640 1 -- 172.21.15.77:0/316373138 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d802ca70 con 0x7f58e00ce240 2023-11-04T01:42:06.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.713+0000 7f58e5506640 1 -- 172.21.15.77:0/316373138 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d802cbd0 con 0x7f58e00ce240 2023-11-04T01:42:06.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.713+0000 7f58e5506640 1 -- 172.21.15.77:0/316373138 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d80343f0 con 0x7f58e00ce240 2023-11-04T01:42:06.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.713+0000 7f58e876c640 1 -- 172.21.15.77:0/316373138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58e00ce240 msgr2=0x7f58e0157540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:06.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.713+0000 7f58e876c640 1 --2- 172.21.15.77:0/316373138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58e00ce240 0x7f58e0157540 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f58e006c7c0 tx=0x7f58d802bed0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.713+0000 7f58e876c640 1 -- 172.21.15.77:0/316373138 shutdown_connections 2023-11-04T01:42:06.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.713+0000 7f58e876c640 1 --2- 172.21.15.77:0/316373138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58e00ce240 0x7f58e0157540 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.713+0000 7f58e876c640 1 --2- 172.21.15.77:0/316373138 >> v2:172.21.15.122:3300/0 conn(0x7f58e015daa0 0x7f58e0157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.713+0000 7f58e876c640 1 --2- 172.21.15.77:0/316373138 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f58e00cde60 0x7f58e015d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.713+0000 7f58e876c640 1 -- 172.21.15.77:0/316373138 >> 172.21.15.77:0/316373138 conn(0x7f58e0071f30 msgr2=0x7f58e00cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:06.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.713+0000 7f58e876c640 1 -- 172.21.15.77:0/316373138 shutdown_connections 2023-11-04T01:42:06.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.714+0000 7f58e876c640 1 -- 172.21.15.77:0/316373138 wait complete. 2023-11-04T01:42:06.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.715+0000 7f58e876c640 1 Processor -- start 2023-11-04T01:42:06.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.715+0000 7f58e876c640 1 -- start start 2023-11-04T01:42:06.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.715+0000 7f58e876c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58e00cde60 0x7f58e01f3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:06.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.715+0000 7f58e876c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f58e00ce240 0x7f58e00ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:06.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.715+0000 7f58e876c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58e015daa0 0x7f58e014b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:06.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.715+0000 7f58e876c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e00cc660 con 0x7f58e015daa0 2023-11-04T01:42:06.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.715+0000 7f58e876c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e01f3da0 con 0x7f58e00cde60 2023-11-04T01:42:06.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.715+0000 7f58e876c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e00cb9e0 con 0x7f58e00ce240 2023-11-04T01:42:06.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.715+0000 7f58e6d09640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58e015daa0 0x7f58e014b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:06.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.715+0000 7f58e6d09640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58e015daa0 0x7f58e014b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56914/0 (socket says 172.21.15.77:56914) 2023-11-04T01:42:06.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.715+0000 7f58e6d09640 1 -- 172.21.15.77:0/2778562954 learned_addr learned my addr 172.21.15.77:0/2778562954 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:06.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.716+0000 7f58e6508640 1 --2- 172.21.15.77:0/2778562954 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58e00cde60 0x7f58e01f3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:06.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.716+0000 7f58e6d09640 1 -- 172.21.15.77:0/2778562954 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f58e00ce240 msgr2=0x7f58e00ca900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:06.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.716+0000 7f58e6d09640 1 --2- 172.21.15.77:0/2778562954 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f58e00ce240 0x7f58e00ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.716+0000 7f58e6d09640 1 -- 172.21.15.77:0/2778562954 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58e00cde60 msgr2=0x7f58e01f3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:06.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.716+0000 7f58e6d09640 1 --2- 172.21.15.77:0/2778562954 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58e00cde60 0x7f58e01f3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.716+0000 7f58e6d09640 1 -- 172.21.15.77:0/2778562954 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d8009b30 con 0x7f58e015daa0 2023-11-04T01:42:06.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.716+0000 7f58e6508640 1 --2- 172.21.15.77:0/2778562954 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58e00cde60 0x7f58e01f3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:06.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.716+0000 7f58e6d09640 1 --2- 172.21.15.77:0/2778562954 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58e015daa0 0x7f58e014b1b0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f58d8036040 tx=0x7f58d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:06.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.716+0000 7f58d2ffd640 1 -- 172.21.15.77:0/2778562954 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d803e450 con 0x7f58e015daa0 2023-11-04T01:42:06.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.716+0000 7f58d2ffd640 1 -- 172.21.15.77:0/2778562954 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d803e5d0 con 0x7f58e015daa0 2023-11-04T01:42:06.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.716+0000 7f58e876c640 1 -- 172.21.15.77:0/2778562954 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58e00cbcc0 con 0x7f58e015daa0 2023-11-04T01:42:06.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.716+0000 7f58d2ffd640 1 -- 172.21.15.77:0/2778562954 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d803e980 con 0x7f58e015daa0 2023-11-04T01:42:06.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.716+0000 7f58e876c640 1 -- 172.21.15.77:0/2778562954 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58e00cc280 con 0x7f58e015daa0 2023-11-04T01:42:06.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.717+0000 7f58e876c640 1 -- 172.21.15.77:0/2778562954 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58e00cc7a0 con 0x7f58e015daa0 2023-11-04T01:42:06.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.717+0000 7f58d2ffd640 1 -- 172.21.15.77:0/2778562954 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f58d803eae0 con 0x7f58e015daa0 2023-11-04T01:42:06.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.718+0000 7f58d2ffd640 1 --2- 172.21.15.77:0/2778562954 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f58c406ae70 0x7f58c406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:06.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.718+0000 7f58d2ffd640 1 -- 172.21.15.77:0/2778562954 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f58d80ac700 con 0x7f58e015daa0 2023-11-04T01:42:06.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.718+0000 7f58e6508640 1 --2- 172.21.15.77:0/2778562954 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f58c406ae70 0x7f58c406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:06.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.719+0000 7f58e6508640 1 --2- 172.21.15.77:0/2778562954 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f58c406ae70 0x7f58c406d330 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f58d4006fd0 tx=0x7f58d4008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:06.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.722+0000 7f58d2ffd640 1 -- 172.21.15.77:0/2778562954 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f58e00cc7a0 con 0x7f58e015daa0 2023-11-04T01:42:06.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.891+0000 7f58e876c640 1 -- 172.21.15.77:0/2778562954 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58e00cc7a0 con 0x7f58e015daa0 2023-11-04T01:42:06.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.892+0000 7f58d2ffd640 1 -- 172.21.15.77:0/2778562954 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+18511 (secure 0 0 0) 0x7f58e00cc7a0 con 0x7f58e015daa0 2023-11-04T01:42:06.894 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:06.894 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":54,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:41:55.075378+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:41:51.914855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-04T01:41:52.371167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:06.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.894+0000 7f58e876c640 1 -- 172.21.15.77:0/2778562954 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f58c406ae70 msgr2=0x7f58c406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:06.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.894+0000 7f58e876c640 1 --2- 172.21.15.77:0/2778562954 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f58c406ae70 0x7f58c406d330 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f58d4006fd0 tx=0x7f58d4008040 comp rx=0 tx=0).stop 2023-11-04T01:42:06.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.894+0000 7f58e876c640 1 -- 172.21.15.77:0/2778562954 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58e015daa0 msgr2=0x7f58e014b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:06.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.894+0000 7f58e876c640 1 --2- 172.21.15.77:0/2778562954 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58e015daa0 0x7f58e014b1b0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f58d8036040 tx=0x7f58d8004a40 comp rx=0 tx=0).stop 2023-11-04T01:42:06.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.894+0000 7f58e876c640 1 -- 172.21.15.77:0/2778562954 shutdown_connections 2023-11-04T01:42:06.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.894+0000 7f58e876c640 1 --2- 172.21.15.77:0/2778562954 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f58c406ae70 0x7f58c406d330 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.894+0000 7f58e876c640 1 --2- 172.21.15.77:0/2778562954 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58e015daa0 0x7f58e014b1b0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.894+0000 7f58e876c640 1 --2- 172.21.15.77:0/2778562954 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f58e00ce240 0x7f58e00ca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.894+0000 7f58e876c640 1 --2- 172.21.15.77:0/2778562954 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58e00cde60 0x7f58e01f3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:06.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.894+0000 7f58e876c640 1 -- 172.21.15.77:0/2778562954 >> 172.21.15.77:0/2778562954 conn(0x7f58e0071f30 msgr2=0x7f58e00d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:06.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.894+0000 7f58e876c640 1 -- 172.21.15.77:0/2778562954 shutdown_connections 2023-11-04T01:42:06.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:06.894+0000 7f58e876c640 1 -- 172.21.15.77:0/2778562954 wait complete. 2023-11-04T01:42:06.906 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:33.142176+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:41:51.914855+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:41:52.371167+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:42:06.907 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:42:07.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.007+0000 7f81523b6640 1 Processor -- start 2023-11-04T01:42:07.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.007+0000 7f81523b6640 1 -- start start 2023-11-04T01:42:07.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.008+0000 7f81523b6640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f814c0cd6d0 0x7f814c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:07.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.008+0000 7f81523b6640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f814c0b4880 0x7f814c0b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:07.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.008+0000 7f81523b6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f814c0cde60 con 0x7f814c153e60 2023-11-04T01:42:07.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.008+0000 7f81523b6640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f814c160f90 con 0x7f814c0b4880 2023-11-04T01:42:07.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.008+0000 7f81523b6640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f814c0b51e0 con 0x7f814c0cd6d0 2023-11-04T01:42:07.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.008+0000 7f814bfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f814c153e60 0x7f814c15dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:42756/0 (socket says 172.21.15.77:42756) 2023-11-04T01:42:07.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.008+0000 7f814bfff640 1 -- 172.21.15.77:0/2739495455 learned_addr learned my addr 172.21.15.77:0/2739495455 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:07.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.009+0000 7f814b7fe640 1 --2- 172.21.15.77:0/2739495455 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f814c0cd6d0 0x7f814c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:07.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.009+0000 7f8150953640 1 --2- 172.21.15.77:0/2739495455 >> v2:172.21.15.122:3300/0 conn(0x7f814c0b4880 0x7f814c0b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:07.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.009+0000 7f814affd640 1 -- 172.21.15.77:0/2739495455 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2208994842 0 0) 0x7f814c0cde60 con 0x7f814c153e60 2023-11-04T01:42:07.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.009+0000 7f814affd640 1 -- 172.21.15.77:0/2739495455 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8134003520 con 0x7f814c153e60 2023-11-04T01:42:07.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.009+0000 7f814affd640 1 -- 172.21.15.77:0/2739495455 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 44398848 0 0) 0x7f8134003520 con 0x7f814c153e60 2023-11-04T01:42:07.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.009+0000 7f814affd640 1 -- 172.21.15.77:0/2739495455 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f814c0cd6d0 msgr2=0x7f814c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:07.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.009+0000 7f814affd640 1 --2- 172.21.15.77:0/2739495455 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f814c0cd6d0 0x7f814c161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.009+0000 7f814affd640 1 -- 172.21.15.77:0/2739495455 >> v2:172.21.15.122:3300/0 conn(0x7f814c0b4880 msgr2=0x7f814c0b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:07.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.009+0000 7f814affd640 1 --2- 172.21.15.77:0/2739495455 >> v2:172.21.15.122:3300/0 conn(0x7f814c0b4880 0x7f814c0b4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.009+0000 7f814affd640 1 -- 172.21.15.77:0/2739495455 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814c161960 con 0x7f814c153e60 2023-11-04T01:42:07.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.009+0000 7f814affd640 1 -- 172.21.15.77:0/2739495455 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f813c001670 con 0x7f814c153e60 2023-11-04T01:42:07.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.009+0000 7f814affd640 1 -- 172.21.15.77:0/2739495455 >> v1:172.21.15.77:6789/0 conn(0x7f814c153e60 legacy=0x7f814c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:07.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.009+0000 7f814affd640 1 --2- 172.21.15.77:0/2739495455 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8134003970 0x7f8134003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:07.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.009+0000 7f814affd640 1 --2- 172.21.15.77:0/2739495455 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f814c0cd6d0 0x7f81340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:07.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.009+0000 7f814affd640 1 --2- 172.21.15.77:0/2739495455 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8134004d00 0x7f8134005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:07.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.009+0000 7f814affd640 1 -- 172.21.15.77:0/2739495455 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814c160f90 con 0x7f8134004d00 2023-11-04T01:42:07.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.009+0000 7f814affd640 1 -- 172.21.15.77:0/2739495455 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814c0b51e0 con 0x7f8134003970 2023-11-04T01:42:07.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.009+0000 7f814affd640 1 -- 172.21.15.77:0/2739495455 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813400b980 con 0x7f814c0cd6d0 2023-11-04T01:42:07.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.009+0000 7f8150953640 1 --2- 172.21.15.77:0/2739495455 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8134004d00 0x7f8134005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:07.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.009+0000 7f814b7fe640 1 --2- 172.21.15.77:0/2739495455 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f814c0cd6d0 0x7f81340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:07.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.009+0000 7f814bfff640 1 --2- 172.21.15.77:0/2739495455 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8134003970 0x7f8134003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:07.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.009+0000 7f8150953640 1 -- 172.21.15.77:0/2739495455 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f814c0cd6d0 msgr2=0x7f81340047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:07.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.009+0000 7f8150953640 1 --2- 172.21.15.77:0/2739495455 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f814c0cd6d0 0x7f81340047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.009+0000 7f8150953640 1 -- 172.21.15.77:0/2739495455 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8134003970 msgr2=0x7f8134003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:07.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.009+0000 7f8150953640 1 --2- 172.21.15.77:0/2739495455 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8134003970 0x7f8134003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.009+0000 7f8150953640 1 -- 172.21.15.77:0/2739495455 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8134003520 con 0x7f8134004d00 2023-11-04T01:42:07.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.009+0000 7f814b7fe640 1 --2- 172.21.15.77:0/2739495455 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f814c0cd6d0 0x7f81340047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:07.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.009+0000 7f814bfff640 1 --2- 172.21.15.77:0/2739495455 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8134003970 0x7f8134003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:07.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.010+0000 7f8150953640 1 --2- 172.21.15.77:0/2739495455 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8134004d00 0x7f8134005180 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f814400e170 tx=0x7f81340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f5158caae22db2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:07.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.010+0000 7f814affd640 1 -- 172.21.15.77:0/2739495455 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814402cc20 con 0x7f8134004d00 2023-11-04T01:42:07.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.010+0000 7f814affd640 1 -- 172.21.15.77:0/2739495455 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814400f040 con 0x7f8134004d00 2023-11-04T01:42:07.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.010+0000 7f814affd640 1 -- 172.21.15.77:0/2739495455 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8144034440 con 0x7f8134004d00 2023-11-04T01:42:07.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.011+0000 7f81523b6640 1 -- 172.21.15.77:0/2739495455 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8134004d00 msgr2=0x7f8134005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:07.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.011+0000 7f81523b6640 1 --2- 172.21.15.77:0/2739495455 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8134004d00 0x7f8134005180 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f814400e170 tx=0x7f81340057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.011+0000 7f8150953640 1 -- 172.21.15.77:0/2739495455 reap_dead start 2023-11-04T01:42:07.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.011+0000 7f81523b6640 1 -- 172.21.15.77:0/2739495455 shutdown_connections 2023-11-04T01:42:07.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.011+0000 7f81523b6640 1 -- 172.21.15.77:0/2739495455 >> 172.21.15.77:0/2739495455 conn(0x7f814c0cf880 msgr2=0x7f814c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:07.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.011+0000 7f81523b6640 1 -- 172.21.15.77:0/2739495455 shutdown_connections 2023-11-04T01:42:07.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.011+0000 7f81523b6640 1 -- 172.21.15.77:0/2739495455 wait complete. 2023-11-04T01:42:07.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.012+0000 7f81523b6640 1 Processor -- start 2023-11-04T01:42:07.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.012+0000 7f81523b6640 1 -- start start 2023-11-04T01:42:07.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.013+0000 7f81523b6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f814c15c8f0 0x7f814c0cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:07.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.013+0000 7f81523b6640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f814c0c8b00 0x7f814c0c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:07.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.013+0000 7f81523b6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f814c1f5b60 0x7f814c1f6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:07.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.013+0000 7f81523b6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814c0c9ed0 con 0x7f814c15c8f0 2023-11-04T01:42:07.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.013+0000 7f81523b6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814c0c94a0 con 0x7f814c1f5b60 2023-11-04T01:42:07.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.013+0000 7f81523b6640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f814c1f6870 con 0x7f814c0c8b00 2023-11-04T01:42:07.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.013+0000 7f814bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f814c15c8f0 0x7f814c0cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:07.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.013+0000 7f814bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f814c15c8f0 0x7f814c0cabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56930/0 (socket says 172.21.15.77:56930) 2023-11-04T01:42:07.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.013+0000 7f814bfff640 1 -- 172.21.15.77:0/3040608151 learned_addr learned my addr 172.21.15.77:0/3040608151 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:07.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.013+0000 7f8150953640 1 --2- 172.21.15.77:0/3040608151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f814c1f5b60 0x7f814c1f6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:07.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.013+0000 7f814b7fe640 1 --2- 172.21.15.77:0/3040608151 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f814c0c8b00 0x7f814c0c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:07.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.013+0000 7f814bfff640 1 -- 172.21.15.77:0/3040608151 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f814c0c8b00 msgr2=0x7f814c0c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:07.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.013+0000 7f814bfff640 1 --2- 172.21.15.77:0/3040608151 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f814c0c8b00 0x7f814c0c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.013+0000 7f814bfff640 1 -- 172.21.15.77:0/3040608151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f814c1f5b60 msgr2=0x7f814c1f6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:07.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.013+0000 7f814bfff640 1 --2- 172.21.15.77:0/3040608151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f814c1f5b60 0x7f814c1f6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.013+0000 7f814bfff640 1 -- 172.21.15.77:0/3040608151 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814c0ca0e0 con 0x7f814c15c8f0 2023-11-04T01:42:07.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.013+0000 7f814bfff640 1 --2- 172.21.15.77:0/3040608151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f814c15c8f0 0x7f814c0cabc0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f813c00eaf0 tx=0x7f813c001610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:07.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.013+0000 7f8148ff9640 1 -- 172.21.15.77:0/3040608151 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813c00c8d0 con 0x7f814c15c8f0 2023-11-04T01:42:07.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.013+0000 7f8148ff9640 1 -- 172.21.15.77:0/3040608151 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813c00ca30 con 0x7f814c15c8f0 2023-11-04T01:42:07.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.013+0000 7f8148ff9640 1 -- 172.21.15.77:0/3040608151 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813c00cda0 con 0x7f814c15c8f0 2023-11-04T01:42:07.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.013+0000 7f81523b6640 1 -- 172.21.15.77:0/3040608151 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f814c0ca3c0 con 0x7f814c15c8f0 2023-11-04T01:42:07.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.014+0000 7f81523b6640 1 -- 172.21.15.77:0/3040608151 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f814c1f6550 con 0x7f814c15c8f0 2023-11-04T01:42:07.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.015+0000 7f81523b6640 1 -- 172.21.15.77:0/3040608151 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f814c0ca8e0 con 0x7f814c15c8f0 2023-11-04T01:42:07.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.015+0000 7f8148ff9640 1 -- 172.21.15.77:0/3040608151 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f813c01d460 con 0x7f814c15c8f0 2023-11-04T01:42:07.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.015+0000 7f8148ff9640 1 --2- 172.21.15.77:0/3040608151 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f813806ae70 0x7f813806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:07.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.015+0000 7f8148ff9640 1 -- 172.21.15.77:0/3040608151 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f813c0897a0 con 0x7f814c15c8f0 2023-11-04T01:42:07.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.015+0000 7f814b7fe640 1 --2- 172.21.15.77:0/3040608151 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f813806ae70 0x7f813806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:07.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.016+0000 7f814b7fe640 1 --2- 172.21.15.77:0/3040608151 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f813806ae70 0x7f813806d330 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f814c1549d0 tx=0x7f8140008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:07.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.019+0000 7f8148ff9640 1 -- 172.21.15.77:0/3040608151 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f814c0ca8e0 con 0x7f814c15c8f0 2023-11-04T01:42:07.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.185+0000 7f81523b6640 1 -- 172.21.15.77:0/3040608151 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f814c0ca8e0 con 0x7f814c15c8f0 2023-11-04T01:42:07.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.185+0000 7f8148ff9640 1 -- 172.21.15.77:0/3040608151 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f814c0ca8e0 con 0x7f814c15c8f0 2023-11-04T01:42:07.187 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:42:07.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.187+0000 7f81523b6640 1 -- 172.21.15.77:0/3040608151 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f813806ae70 msgr2=0x7f813806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:07.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.187+0000 7f81523b6640 1 --2- 172.21.15.77:0/3040608151 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f813806ae70 0x7f813806d330 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f814c1549d0 tx=0x7f8140008040 comp rx=0 tx=0).stop 2023-11-04T01:42:07.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.187+0000 7f81523b6640 1 -- 172.21.15.77:0/3040608151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f814c15c8f0 msgr2=0x7f814c0cabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:07.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.187+0000 7f81523b6640 1 --2- 172.21.15.77:0/3040608151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f814c15c8f0 0x7f814c0cabc0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f813c00eaf0 tx=0x7f813c001610 comp rx=0 tx=0).stop 2023-11-04T01:42:07.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.187+0000 7f81523b6640 1 -- 172.21.15.77:0/3040608151 shutdown_connections 2023-11-04T01:42:07.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.187+0000 7f81523b6640 1 --2- 172.21.15.77:0/3040608151 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f813806ae70 0x7f813806d330 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.187+0000 7f81523b6640 1 --2- 172.21.15.77:0/3040608151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f814c1f5b60 0x7f814c1f6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.187+0000 7f81523b6640 1 --2- 172.21.15.77:0/3040608151 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f814c0c8b00 0x7f814c0c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.187+0000 7f81523b6640 1 --2- 172.21.15.77:0/3040608151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f814c15c8f0 0x7f814c0cabc0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.187+0000 7f81523b6640 1 -- 172.21.15.77:0/3040608151 >> 172.21.15.77:0/3040608151 conn(0x7f814c0cf880 msgr2=0x7f814c15dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:07.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.187+0000 7f81523b6640 1 -- 172.21.15.77:0/3040608151 shutdown_connections 2023-11-04T01:42:07.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.187+0000 7f81523b6640 1 -- 172.21.15.77:0/3040608151 wait complete. 2023-11-04T01:42:07.199 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:42:07.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.299+0000 7f6f61e64640 1 Processor -- start 2023-11-04T01:42:07.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.299+0000 7f6f61e64640 1 -- start start 2023-11-04T01:42:07.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.300+0000 7f6f61e64640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6f5c1605b0 0x7f6f5c0ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:07.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.300+0000 7f6f61e64640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f5c0b1a40 0x7f6f5c06a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:07.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.300+0000 7f6f61e64640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6f5c0ca560 0x7f6f5c06a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:07.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.300+0000 7f6f61e64640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f5c160990 con 0x7f6f5c0ca560 2023-11-04T01:42:07.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.300+0000 7f6f61e64640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f5c0cc7c0 con 0x7f6f5c1605b0 2023-11-04T01:42:07.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.300+0000 7f6f61e64640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c0cd750 con 0x7f6f5c0b1a40 2023-11-04T01:42:07.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.300+0000 7f6f5bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6f5c0ca560 0x7f6f5c06a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:07.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.300+0000 7f6f5bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6f5c0ca560 0x7f6f5c06a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56938/0 (socket says 172.21.15.77:56938) 2023-11-04T01:42:07.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.300+0000 7f6f5bfff640 1 -- 172.21.15.77:0/1983839936 learned_addr learned my addr 172.21.15.77:0/1983839936 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:07.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.300+0000 7f6f5b7fe640 1 --2- 172.21.15.77:0/1983839936 >> v2:172.21.15.122:3300/0 conn(0x7f6f5c1605b0 0x7f6f5c0ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:07.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.300+0000 7f6f5affd640 1 --2- 172.21.15.77:0/1983839936 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f5c0b1a40 0x7f6f5c06a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:07.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.301+0000 7f6f5bfff640 1 -- 172.21.15.77:0/1983839936 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f5c0b1a40 msgr2=0x7f6f5c06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:07.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.301+0000 7f6f5bfff640 1 --2- 172.21.15.77:0/1983839936 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f5c0b1a40 0x7f6f5c06a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.301+0000 7f6f5bfff640 1 -- 172.21.15.77:0/1983839936 >> v2:172.21.15.122:3300/0 conn(0x7f6f5c1605b0 msgr2=0x7f6f5c0ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:07.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.301+0000 7f6f5bfff640 1 --2- 172.21.15.77:0/1983839936 >> v2:172.21.15.122:3300/0 conn(0x7f6f5c1605b0 0x7f6f5c0ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.301+0000 7f6f5bfff640 1 -- 172.21.15.77:0/1983839936 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5c0cc4e0 con 0x7f6f5c0ca560 2023-11-04T01:42:07.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.301+0000 7f6f5b7fe640 1 --2- 172.21.15.77:0/1983839936 >> v2:172.21.15.122:3300/0 conn(0x7f6f5c1605b0 0x7f6f5c0ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:07.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.301+0000 7f6f5affd640 1 --2- 172.21.15.77:0/1983839936 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f5c0b1a40 0x7f6f5c06a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:07.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.301+0000 7f6f5bfff640 1 --2- 172.21.15.77:0/1983839936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f5c0ca560 0x7f6f5c06a660 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c072900 tx=0x7f6f5402bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff179940504225f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:07.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.302+0000 7f6f5a7fc640 1 -- 172.21.15.77:0/1983839936 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5402c950 con 0x7f6f5c0ca560 2023-11-04T01:42:07.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.302+0000 7f6f5a7fc640 1 -- 172.21.15.77:0/1983839936 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5402cab0 con 0x7f6f5c0ca560 2023-11-04T01:42:07.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.302+0000 7f6f5a7fc640 1 -- 172.21.15.77:0/1983839936 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5402ce40 con 0x7f6f5c0ca560 2023-11-04T01:42:07.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.302+0000 7f6f61e64640 1 -- 172.21.15.77:0/1983839936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f5c0ca560 msgr2=0x7f6f5c06a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:07.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.302+0000 7f6f61e64640 1 --2- 172.21.15.77:0/1983839936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f5c0ca560 0x7f6f5c06a660 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c072900 tx=0x7f6f5402bdb0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.302+0000 7f6f61e64640 1 -- 172.21.15.77:0/1983839936 shutdown_connections 2023-11-04T01:42:07.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.302+0000 7f6f61e64640 1 --2- 172.21.15.77:0/1983839936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f5c0ca560 0x7f6f5c06a660 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.302+0000 7f6f61e64640 1 --2- 172.21.15.77:0/1983839936 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f5c0b1a40 0x7f6f5c06a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.302+0000 7f6f61e64640 1 --2- 172.21.15.77:0/1983839936 >> v2:172.21.15.122:3300/0 conn(0x7f6f5c1605b0 0x7f6f5c0ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.302+0000 7f6f61e64640 1 -- 172.21.15.77:0/1983839936 >> 172.21.15.77:0/1983839936 conn(0x7f6f5c071820 msgr2=0x7f6f5c071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:07.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.302+0000 7f6f61e64640 1 -- 172.21.15.77:0/1983839936 shutdown_connections 2023-11-04T01:42:07.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.302+0000 7f6f61e64640 1 -- 172.21.15.77:0/1983839936 wait complete. 2023-11-04T01:42:07.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.303+0000 7f6f61e64640 1 Processor -- start 2023-11-04T01:42:07.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.303+0000 7f6f61e64640 1 -- start start 2023-11-04T01:42:07.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.304+0000 7f6f61e64640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f5c0ca560 0x7f6f5c0c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:07.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.304+0000 7f6f61e64640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f5c1605b0 0x7f6f5c0c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:07.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.304+0000 7f6f61e64640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f5c0c7b70 0x7f6f5c14a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:07.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.304+0000 7f6f61e64640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c0c8c70 con 0x7f6f5c1605b0 2023-11-04T01:42:07.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.304+0000 7f6f61e64640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c15d260 con 0x7f6f5c0c7b70 2023-11-04T01:42:07.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.304+0000 7f6f61e64640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c0c64a0 con 0x7f6f5c0ca560 2023-11-04T01:42:07.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.304+0000 7f6f5affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f5c1605b0 0x7f6f5c0c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:07.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.304+0000 7f6f5affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f5c1605b0 0x7f6f5c0c5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56948/0 (socket says 172.21.15.77:56948) 2023-11-04T01:42:07.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.304+0000 7f6f5affd640 1 -- 172.21.15.77:0/3726779294 learned_addr learned my addr 172.21.15.77:0/3726779294 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:07.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.304+0000 7f6f5b7fe640 1 --2- 172.21.15.77:0/3726779294 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f5c0ca560 0x7f6f5c0c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:07.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.304+0000 7f6f5bfff640 1 --2- 172.21.15.77:0/3726779294 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f5c0c7b70 0x7f6f5c14a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:07.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.305+0000 7f6f5affd640 1 -- 172.21.15.77:0/3726779294 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f5c0ca560 msgr2=0x7f6f5c0c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:07.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.305+0000 7f6f5affd640 1 --2- 172.21.15.77:0/3726779294 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f5c0ca560 0x7f6f5c0c9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.305+0000 7f6f5affd640 1 -- 172.21.15.77:0/3726779294 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f5c0c7b70 msgr2=0x7f6f5c14a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:07.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.305+0000 7f6f5affd640 1 --2- 172.21.15.77:0/3726779294 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f5c0c7b70 0x7f6f5c14a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.305+0000 7f6f5affd640 1 -- 172.21.15.77:0/3726779294 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f54009b30 con 0x7f6f5c1605b0 2023-11-04T01:42:07.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.305+0000 7f6f5affd640 1 --2- 172.21.15.77:0/3726779294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f5c1605b0 0x7f6f5c0c5f60 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000d830 tx=0x7f6f5000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:07.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.305+0000 7f6f43fff640 1 -- 172.21.15.77:0/3726779294 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5000be10 con 0x7f6f5c1605b0 2023-11-04T01:42:07.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.305+0000 7f6f43fff640 1 -- 172.21.15.77:0/3726779294 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f50004030 con 0x7f6f5c1605b0 2023-11-04T01:42:07.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.305+0000 7f6f43fff640 1 -- 172.21.15.77:0/3726779294 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f500043c0 con 0x7f6f5c1605b0 2023-11-04T01:42:07.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.305+0000 7f6f61e64640 1 -- 172.21.15.77:0/3726779294 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f5c14ad30 con 0x7f6f5c1605b0 2023-11-04T01:42:07.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.305+0000 7f6f61e64640 1 -- 172.21.15.77:0/3726779294 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f5c0c82d0 con 0x7f6f5c1605b0 2023-11-04T01:42:07.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.306+0000 7f6f61e64640 1 -- 172.21.15.77:0/3726779294 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f5c0c8ee0 con 0x7f6f5c1605b0 2023-11-04T01:42:07.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.306+0000 7f6f43fff640 1 -- 172.21.15.77:0/3726779294 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6f500098b0 con 0x7f6f5c1605b0 2023-11-04T01:42:07.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.307+0000 7f6f43fff640 1 --2- 172.21.15.77:0/3726779294 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6f4806ae70 0x7f6f4806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:07.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.307+0000 7f6f43fff640 1 -- 172.21.15.77:0/3726779294 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6f50089850 con 0x7f6f5c1605b0 2023-11-04T01:42:07.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.307+0000 7f6f5b7fe640 1 --2- 172.21.15.77:0/3726779294 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6f4806ae70 0x7f6f4806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:07.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.307+0000 7f6f5b7fe640 1 --2- 172.21.15.77:0/3726779294 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6f4806ae70 0x7f6f4806d330 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c006fd0 tx=0x7f6f4c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:07.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.311+0000 7f6f43fff640 1 -- 172.21.15.77:0/3726779294 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6f500547a0 con 0x7f6f5c1605b0 2023-11-04T01:42:07.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.476+0000 7f6f61e64640 1 -- 172.21.15.77:0/3726779294 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f6f5c0672a0 con 0x7f6f5c1605b0 2023-11-04T01:42:07.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.477+0000 7f6f43fff640 1 -- 172.21.15.77:0/3726779294 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v54) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6f50057dc0 con 0x7f6f5c1605b0 2023-11-04T01:42:07.479 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:42:07.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.479+0000 7f6f61e64640 1 -- 172.21.15.77:0/3726779294 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6f4806ae70 msgr2=0x7f6f4806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:07.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.479+0000 7f6f61e64640 1 --2- 172.21.15.77:0/3726779294 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6f4806ae70 0x7f6f4806d330 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c006fd0 tx=0x7f6f4c008040 comp rx=0 tx=0).stop 2023-11-04T01:42:07.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.479+0000 7f6f61e64640 1 -- 172.21.15.77:0/3726779294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f5c1605b0 msgr2=0x7f6f5c0c5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:07.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.479+0000 7f6f61e64640 1 --2- 172.21.15.77:0/3726779294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f5c1605b0 0x7f6f5c0c5f60 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000d830 tx=0x7f6f5000dcf0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.479+0000 7f6f61e64640 1 -- 172.21.15.77:0/3726779294 shutdown_connections 2023-11-04T01:42:07.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.479+0000 7f6f61e64640 1 --2- 172.21.15.77:0/3726779294 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6f4806ae70 0x7f6f4806d330 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.479+0000 7f6f61e64640 1 --2- 172.21.15.77:0/3726779294 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f5c0c7b70 0x7f6f5c14a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.479+0000 7f6f61e64640 1 --2- 172.21.15.77:0/3726779294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f5c1605b0 0x7f6f5c0c5f60 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.479+0000 7f6f61e64640 1 --2- 172.21.15.77:0/3726779294 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f5c0ca560 0x7f6f5c0c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.479+0000 7f6f61e64640 1 -- 172.21.15.77:0/3726779294 >> 172.21.15.77:0/3726779294 conn(0x7f6f5c071820 msgr2=0x7f6f5c0cae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:07.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.479+0000 7f6f61e64640 1 -- 172.21.15.77:0/3726779294 shutdown_connections 2023-11-04T01:42:07.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.479+0000 7f6f61e64640 1 -- 172.21.15.77:0/3726779294 wait complete. 2023-11-04T01:42:07.491 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:42:07.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.593+0000 7fd655f5e640 1 Processor -- start 2023-11-04T01:42:07.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.593+0000 7fd655f5e640 1 -- start start 2023-11-04T01:42:07.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.593+0000 7fd655f5e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd650159c00 0x7fd6500cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:07.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.593+0000 7fd655f5e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd6500c48e0 0x7fd6500c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:07.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.593+0000 7fd655f5e640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd65015aff0 con 0x7fd6500adac0 2023-11-04T01:42:07.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.593+0000 7fd655f5e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6500c52a0 con 0x7fd6500c48e0 2023-11-04T01:42:07.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.593+0000 7fd655f5e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd65015a3e0 con 0x7fd650159c00 2023-11-04T01:42:07.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.593+0000 7fd64effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd6500c48e0 0x7fd6500c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:07.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.594+0000 7fd64effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd6500c48e0 0x7fd6500c4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51874/0 (socket says 172.21.15.77:51874) 2023-11-04T01:42:07.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.594+0000 7fd64effd640 1 -- 172.21.15.77:0/3385672944 learned_addr learned my addr 172.21.15.77:0/3385672944 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:07.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.594+0000 7fd64effd640 1 -- 172.21.15.77:0/3385672944 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd650159c00 msgr2=0x7fd6500cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:07.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.594+0000 7fd64effd640 1 --2- 172.21.15.77:0/3385672944 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd650159c00 0x7fd6500cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.594+0000 7fd64effd640 1 -- 172.21.15.77:0/3385672944 >> v1:172.21.15.122:6789/0 conn(0x7fd6500adac0 legacy=0x7fd6500adef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:07.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.594+0000 7fd64effd640 1 -- 172.21.15.77:0/3385672944 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd65015a6c0 con 0x7fd6500c48e0 2023-11-04T01:42:07.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.594+0000 7fd64effd640 1 --2- 172.21.15.77:0/3385672944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6500c48e0 0x7fd6500c4d60 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fd644009870 tx=0x7fd64402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a19ca309dec9620 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:07.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.595+0000 7fd64e7fc640 1 -- 172.21.15.77:0/3385672944 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd644031640 con 0x7fd6500c48e0 2023-11-04T01:42:07.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.595+0000 7fd64e7fc640 1 -- 172.21.15.77:0/3385672944 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6440317a0 con 0x7fd6500c48e0 2023-11-04T01:42:07.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.595+0000 7fd64e7fc640 1 -- 172.21.15.77:0/3385672944 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd644031b30 con 0x7fd6500c48e0 2023-11-04T01:42:07.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.595+0000 7fd655f5e640 1 -- 172.21.15.77:0/3385672944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6500c48e0 msgr2=0x7fd6500c4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:07.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.595+0000 7fd655f5e640 1 --2- 172.21.15.77:0/3385672944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6500c48e0 0x7fd6500c4d60 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fd644009870 tx=0x7fd64402b8f0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.595+0000 7fd655f5e640 1 -- 172.21.15.77:0/3385672944 shutdown_connections 2023-11-04T01:42:07.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.595+0000 7fd655f5e640 1 --2- 172.21.15.77:0/3385672944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6500c48e0 0x7fd6500c4d60 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.595+0000 7fd655f5e640 1 --2- 172.21.15.77:0/3385672944 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd650159c00 0x7fd6500cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.595+0000 7fd655f5e640 1 -- 172.21.15.77:0/3385672944 >> 172.21.15.77:0/3385672944 conn(0x7fd6500ce950 msgr2=0x7fd6500ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:07.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.595+0000 7fd655f5e640 1 -- 172.21.15.77:0/3385672944 shutdown_connections 2023-11-04T01:42:07.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.595+0000 7fd655f5e640 1 -- 172.21.15.77:0/3385672944 wait complete. 2023-11-04T01:42:07.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.596+0000 7fd655f5e640 1 Processor -- start 2023-11-04T01:42:07.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.597+0000 7fd655f5e640 1 -- start start 2023-11-04T01:42:07.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.597+0000 7fd655f5e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd6500adac0 0x7fd65013df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:07.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.597+0000 7fd655f5e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6500c48e0 0x7fd65015b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:07.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.597+0000 7fd655f5e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd650159c00 0x7fd65015b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:07.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.597+0000 7fd655f5e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd650143330 con 0x7fd6500c48e0 2023-11-04T01:42:07.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.597+0000 7fd655f5e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6500c5d90 con 0x7fd6500adac0 2023-11-04T01:42:07.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.597+0000 7fd655f5e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd65013e460 con 0x7fd650159c00 2023-11-04T01:42:07.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.597+0000 7fd64effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6500c48e0 0x7fd65015b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:07.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.597+0000 7fd64effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6500c48e0 0x7fd65015b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51888/0 (socket says 172.21.15.77:51888) 2023-11-04T01:42:07.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.597+0000 7fd64effd640 1 -- 172.21.15.77:0/3550400595 learned_addr learned my addr 172.21.15.77:0/3550400595 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:07.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.598+0000 7fd64ffff640 1 --2- 172.21.15.77:0/3550400595 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd650159c00 0x7fd65015b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:07.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.598+0000 7fd64f7fe640 1 --2- 172.21.15.77:0/3550400595 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd6500adac0 0x7fd65013df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:07.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.598+0000 7fd64effd640 1 -- 172.21.15.77:0/3550400595 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd650159c00 msgr2=0x7fd65015b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:07.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.598+0000 7fd64effd640 1 --2- 172.21.15.77:0/3550400595 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd650159c00 0x7fd65015b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.598+0000 7fd64effd640 1 -- 172.21.15.77:0/3550400595 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd6500adac0 msgr2=0x7fd65013df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:07.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.598+0000 7fd64effd640 1 --2- 172.21.15.77:0/3550400595 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd6500adac0 0x7fd65013df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.598+0000 7fd64effd640 1 -- 172.21.15.77:0/3550400595 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6440094d0 con 0x7fd6500c48e0 2023-11-04T01:42:07.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.598+0000 7fd64effd640 1 --2- 172.21.15.77:0/3550400595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6500c48e0 0x7fd65015b1a0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fd644009870 tx=0x7fd6440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:07.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.598+0000 7fd637fff640 1 -- 172.21.15.77:0/3550400595 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64403ac60 con 0x7fd6500c48e0 2023-11-04T01:42:07.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.598+0000 7fd637fff640 1 -- 172.21.15.77:0/3550400595 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd64403adc0 con 0x7fd6500c48e0 2023-11-04T01:42:07.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.598+0000 7fd637fff640 1 -- 172.21.15.77:0/3550400595 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd644044630 con 0x7fd6500c48e0 2023-11-04T01:42:07.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.598+0000 7fd655f5e640 1 -- 172.21.15.77:0/3550400595 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd65014e080 con 0x7fd6500c48e0 2023-11-04T01:42:07.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.598+0000 7fd655f5e640 1 -- 172.21.15.77:0/3550400595 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd65014e640 con 0x7fd6500c48e0 2023-11-04T01:42:07.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.599+0000 7fd655f5e640 1 -- 172.21.15.77:0/3550400595 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd650074290 con 0x7fd6500c48e0 2023-11-04T01:42:07.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.599+0000 7fd637fff640 1 -- 172.21.15.77:0/3550400595 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd64402f050 con 0x7fd6500c48e0 2023-11-04T01:42:07.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.600+0000 7fd637fff640 1 --2- 172.21.15.77:0/3550400595 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd63c06aea0 0x7fd63c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:07.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.600+0000 7fd637fff640 1 -- 172.21.15.77:0/3550400595 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd6440ab840 con 0x7fd6500c48e0 2023-11-04T01:42:07.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.600+0000 7fd64f7fe640 1 --2- 172.21.15.77:0/3550400595 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd63c06aea0 0x7fd63c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:07.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.600+0000 7fd64f7fe640 1 --2- 172.21.15.77:0/3550400595 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd63c06aea0 0x7fd63c06d360 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd650071180 tx=0x7fd640008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:07.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.604+0000 7fd637fff640 1 -- 172.21.15.77:0/3550400595 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd644076650 con 0x7fd6500c48e0 2023-11-04T01:42:07.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.769+0000 7fd655f5e640 1 -- 172.21.15.77:0/3550400595 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd65006e210 con 0x7fd6500c48e0 2023-11-04T01:42:07.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.770+0000 7fd637fff640 1 -- 172.21.15.77:0/3550400595 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd644079c70 con 0x7fd6500c48e0 2023-11-04T01:42:07.772 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:42:07.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.772+0000 7fd655f5e640 1 -- 172.21.15.77:0/3550400595 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd63c06aea0 msgr2=0x7fd63c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:07.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.772+0000 7fd655f5e640 1 --2- 172.21.15.77:0/3550400595 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd63c06aea0 0x7fd63c06d360 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd650071180 tx=0x7fd640008040 comp rx=0 tx=0).stop 2023-11-04T01:42:07.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.772+0000 7fd655f5e640 1 -- 172.21.15.77:0/3550400595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6500c48e0 msgr2=0x7fd65015b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:07.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.772+0000 7fd655f5e640 1 --2- 172.21.15.77:0/3550400595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6500c48e0 0x7fd65015b1a0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fd644009870 tx=0x7fd6440046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.772+0000 7fd655f5e640 1 -- 172.21.15.77:0/3550400595 shutdown_connections 2023-11-04T01:42:07.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.772+0000 7fd655f5e640 1 --2- 172.21.15.77:0/3550400595 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd63c06aea0 0x7fd63c06d360 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.772+0000 7fd655f5e640 1 --2- 172.21.15.77:0/3550400595 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd650159c00 0x7fd65015b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.772+0000 7fd655f5e640 1 --2- 172.21.15.77:0/3550400595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6500c48e0 0x7fd65015b1a0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.772+0000 7fd655f5e640 1 --2- 172.21.15.77:0/3550400595 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd6500adac0 0x7fd65013df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.772+0000 7fd655f5e640 1 -- 172.21.15.77:0/3550400595 >> 172.21.15.77:0/3550400595 conn(0x7fd6500ce950 msgr2=0x7fd650158c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:07.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.772+0000 7fd655f5e640 1 -- 172.21.15.77:0/3550400595 shutdown_connections 2023-11-04T01:42:07.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.772+0000 7fd655f5e640 1 -- 172.21.15.77:0/3550400595 wait complete. 2023-11-04T01:42:07.784 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:42:07.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.884+0000 7f9753aa2640 1 Processor -- start 2023-11-04T01:42:07.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.885+0000 7f9753aa2640 1 -- start start 2023-11-04T01:42:07.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.885+0000 7f9753aa2640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f974c0b4880 0x7f974c0b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:07.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.885+0000 7f9753aa2640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f974c0cde60 con 0x7f974c0cd6d0 2023-11-04T01:42:07.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.885+0000 7f9753aa2640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f974c160f90 con 0x7f974c153e60 2023-11-04T01:42:07.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.885+0000 7f9753aa2640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f974c0b5200 con 0x7f974c0b4880 2023-11-04T01:42:07.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.885+0000 7f975103d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f974c0cd6d0 0x7f974c161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55196/0 (socket says 172.21.15.77:55196) 2023-11-04T01:42:07.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.885+0000 7f975103d640 1 -- 172.21.15.77:0/3572122064 learned_addr learned my addr 172.21.15.77:0/3572122064 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:07.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.886+0000 7f975083c640 1 -- 172.21.15.77:0/3572122064 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3433988957 0 0) 0x7f974c0cde60 con 0x7f974c0cd6d0 2023-11-04T01:42:07.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.886+0000 7f975083c640 1 -- 172.21.15.77:0/3572122064 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9738003520 con 0x7f974c0cd6d0 2023-11-04T01:42:07.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.886+0000 7f975203f640 1 --2- 172.21.15.77:0/3572122064 >> v2:172.21.15.122:3300/0 conn(0x7f974c0b4880 0x7f974c0b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:07.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.886+0000 7f975083c640 1 -- 172.21.15.77:0/3572122064 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2691397714 0 0) 0x7f9738003520 con 0x7f974c0cd6d0 2023-11-04T01:42:07.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.886+0000 7f975083c640 1 -- 172.21.15.77:0/3572122064 >> v2:172.21.15.122:3300/0 conn(0x7f974c0b4880 msgr2=0x7f974c0b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:07.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.886+0000 7f975083c640 1 --2- 172.21.15.77:0/3572122064 >> v2:172.21.15.122:3300/0 conn(0x7f974c0b4880 0x7f974c0b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.886+0000 7f975083c640 1 -- 172.21.15.77:0/3572122064 >> v1:172.21.15.122:6789/0 conn(0x7f974c153e60 legacy=0x7f974c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:07.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.886+0000 7f975083c640 1 -- 172.21.15.77:0/3572122064 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f974c0ce090 con 0x7f974c0cd6d0 2023-11-04T01:42:07.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.886+0000 7f975083c640 1 -- 172.21.15.77:0/3572122064 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f973c001670 con 0x7f974c0cd6d0 2023-11-04T01:42:07.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.886+0000 7f975203f640 1 --2- 172.21.15.77:0/3572122064 >> v2:172.21.15.122:3300/0 conn(0x7f974c0b4880 0x7f974c0b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:07.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.886+0000 7f975083c640 1 -- 172.21.15.77:0/3572122064 >> v1:172.21.15.77:6789/0 conn(0x7f974c0cd6d0 legacy=0x7f974c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:07.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.886+0000 7f975083c640 1 --2- 172.21.15.77:0/3572122064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9738003970 0x7f9738003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:07.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.886+0000 7f975083c640 1 --2- 172.21.15.77:0/3572122064 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97380047c0 0x7f9738004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:07.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.886+0000 7f975083c640 1 --2- 172.21.15.77:0/3572122064 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9738005180 0x7f973800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:07.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.886+0000 7f975083c640 1 -- 172.21.15.77:0/3572122064 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f974c0b5200 con 0x7f9738003970 2023-11-04T01:42:07.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.886+0000 7f975083c640 1 -- 172.21.15.77:0/3572122064 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973800c0d0 con 0x7f9738005180 2023-11-04T01:42:07.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.886+0000 7f975083c640 1 -- 172.21.15.77:0/3572122064 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973800c290 con 0x7f97380047c0 2023-11-04T01:42:07.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.886+0000 7f975183e640 1 --2- 172.21.15.77:0/3572122064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9738003970 0x7f9738003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:07.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.886+0000 7f975103d640 1 --2- 172.21.15.77:0/3572122064 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97380047c0 0x7f9738004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:07.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.886+0000 7f975203f640 1 --2- 172.21.15.77:0/3572122064 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9738005180 0x7f973800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:07.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.886+0000 7f975183e640 1 -- 172.21.15.77:0/3572122064 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97380047c0 msgr2=0x7f9738004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:07.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.886+0000 7f975183e640 1 --2- 172.21.15.77:0/3572122064 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97380047c0 0x7f9738004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.886+0000 7f975183e640 1 -- 172.21.15.77:0/3572122064 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9738005180 msgr2=0x7f973800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:07.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.886+0000 7f975183e640 1 --2- 172.21.15.77:0/3572122064 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9738005180 0x7f973800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.886+0000 7f975183e640 1 -- 172.21.15.77:0/3572122064 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9738003520 con 0x7f9738003970 2023-11-04T01:42:07.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.886+0000 7f975203f640 1 --2- 172.21.15.77:0/3572122064 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9738005180 0x7f973800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:07.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.886+0000 7f975203f640 1 -- 172.21.15.77:0/3572122064 reap_dead start 2023-11-04T01:42:07.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.887+0000 7f975183e640 1 --2- 172.21.15.77:0/3572122064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9738003970 0x7f9738003d90 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f9748001e50 tx=0x7f97380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fa3d478bb161a8e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:07.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.887+0000 7f975083c640 1 -- 172.21.15.77:0/3572122064 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9748003b70 con 0x7f9738003970 2023-11-04T01:42:07.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.887+0000 7f975083c640 1 -- 172.21.15.77:0/3572122064 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9748003cd0 con 0x7f9738003970 2023-11-04T01:42:07.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.887+0000 7f975083c640 1 -- 172.21.15.77:0/3572122064 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9748005310 con 0x7f9738003970 2023-11-04T01:42:07.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.888+0000 7f9753aa2640 1 -- 172.21.15.77:0/3572122064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9738003970 msgr2=0x7f9738003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:07.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.888+0000 7f9753aa2640 1 --2- 172.21.15.77:0/3572122064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9738003970 0x7f9738003d90 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f9748001e50 tx=0x7f97380057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.888+0000 7f9753aa2640 1 -- 172.21.15.77:0/3572122064 shutdown_connections 2023-11-04T01:42:07.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.888+0000 7f9753aa2640 1 --2- 172.21.15.77:0/3572122064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9738003970 0x7f9738003d90 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.888+0000 7f9753aa2640 1 -- 172.21.15.77:0/3572122064 >> 172.21.15.77:0/3572122064 conn(0x7f974c0cf880 msgr2=0x7f974c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:07.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.888+0000 7f9753aa2640 1 -- 172.21.15.77:0/3572122064 shutdown_connections 2023-11-04T01:42:07.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.888+0000 7f9753aa2640 1 -- 172.21.15.77:0/3572122064 wait complete. 2023-11-04T01:42:07.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.889+0000 7f9753aa2640 1 Processor -- start 2023-11-04T01:42:07.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.889+0000 7f9753aa2640 1 -- start start 2023-11-04T01:42:07.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.890+0000 7f9753aa2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9738003970 0x7f974c1f59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:07.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.890+0000 7f9753aa2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f974c154f90 0x7f974c155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:07.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.890+0000 7f9753aa2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f974c0d2de0 0x7f974c0d3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:07.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.890+0000 7f9753aa2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f974c155950 con 0x7f974c0d2de0 2023-11-04T01:42:07.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.890+0000 7f9753aa2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f974c0d37a0 con 0x7f974c154f90 2023-11-04T01:42:07.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.890+0000 7f9753aa2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f974c1f5f30 con 0x7f9738003970 2023-11-04T01:42:07.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.890+0000 7f975203f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f974c0d2de0 0x7f974c0d3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:07.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.890+0000 7f975203f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f974c0d2de0 0x7f974c0d3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51906/0 (socket says 172.21.15.77:51906) 2023-11-04T01:42:07.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.890+0000 7f975203f640 1 -- 172.21.15.77:0/1716848432 learned_addr learned my addr 172.21.15.77:0/1716848432 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:07.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.890+0000 7f975203f640 1 -- 172.21.15.77:0/1716848432 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9738003970 msgr2=0x7f974c1f59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:07.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.890+0000 7f975203f640 1 --2- 172.21.15.77:0/1716848432 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9738003970 0x7f974c1f59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.890+0000 7f975203f640 1 -- 172.21.15.77:0/1716848432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f974c154f90 msgr2=0x7f974c155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:07.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.890+0000 7f975203f640 1 --2- 172.21.15.77:0/1716848432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f974c154f90 0x7f974c155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:07.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.890+0000 7f975203f640 1 -- 172.21.15.77:0/1716848432 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f974c155b50 con 0x7f974c0d2de0 2023-11-04T01:42:07.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.890+0000 7f975203f640 1 --2- 172.21.15.77:0/1716848432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f974c0d2de0 0x7f974c0d3260 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f974c06c900 tx=0x7f9744010920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:07.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.890+0000 7f97427fc640 1 -- 172.21.15.77:0/1716848432 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9744015880 con 0x7f974c0d2de0 2023-11-04T01:42:07.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.890+0000 7f97427fc640 1 -- 172.21.15.77:0/1716848432 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974400c050 con 0x7f974c0d2de0 2023-11-04T01:42:07.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.890+0000 7f9753aa2640 1 -- 172.21.15.77:0/1716848432 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f974c155e30 con 0x7f974c0d2de0 2023-11-04T01:42:07.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.890+0000 7f97427fc640 1 -- 172.21.15.77:0/1716848432 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9744015c20 con 0x7f974c0d2de0 2023-11-04T01:42:07.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.891+0000 7f9753aa2640 1 -- 172.21.15.77:0/1716848432 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f974c1563f0 con 0x7f974c0d2de0 2023-11-04T01:42:07.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.891+0000 7f9753aa2640 1 -- 172.21.15.77:0/1716848432 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f974c0cd4f0 con 0x7f974c0d2de0 2023-11-04T01:42:07.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.892+0000 7f97427fc640 1 -- 172.21.15.77:0/1716848432 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9744020460 con 0x7f974c0d2de0 2023-11-04T01:42:07.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.892+0000 7f97427fc640 1 --2- 172.21.15.77:0/1716848432 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f973006aea0 0x7f973006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:07.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.892+0000 7f97427fc640 1 -- 172.21.15.77:0/1716848432 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f97440897b0 con 0x7f974c0d2de0 2023-11-04T01:42:07.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.893+0000 7f975183e640 1 --2- 172.21.15.77:0/1716848432 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f973006aea0 0x7f973006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:07.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.893+0000 7f975183e640 1 --2- 172.21.15.77:0/1716848432 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f973006aea0 0x7f973006d360 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9748034000 tx=0x7f9748030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:07.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:07.896+0000 7f97427fc640 1 -- 172.21.15.77:0/1716848432 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9744054650 con 0x7f974c0d2de0 2023-11-04T01:42:08.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.064+0000 7f9753aa2640 1 -- 172.21.15.77:0/1716848432 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f974c0c9ce0 con 0x7f974c0d2de0 2023-11-04T01:42:08.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.064+0000 7f97427fc640 1 -- 172.21.15.77:0/1716848432 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7f974c0c9ce0 con 0x7f974c0d2de0 2023-11-04T01:42:08.066 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-04T01:42:08.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.066+0000 7f9753aa2640 1 -- 172.21.15.77:0/1716848432 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f973006aea0 msgr2=0x7f973006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:08.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.066+0000 7f9753aa2640 1 --2- 172.21.15.77:0/1716848432 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f973006aea0 0x7f973006d360 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9748034000 tx=0x7f9748030000 comp rx=0 tx=0).stop 2023-11-04T01:42:08.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.066+0000 7f9753aa2640 1 -- 172.21.15.77:0/1716848432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f974c0d2de0 msgr2=0x7f974c0d3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:08.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.066+0000 7f9753aa2640 1 --2- 172.21.15.77:0/1716848432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f974c0d2de0 0x7f974c0d3260 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f974c06c900 tx=0x7f9744010920 comp rx=0 tx=0).stop 2023-11-04T01:42:08.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.066+0000 7f9753aa2640 1 -- 172.21.15.77:0/1716848432 shutdown_connections 2023-11-04T01:42:08.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.066+0000 7f9753aa2640 1 --2- 172.21.15.77:0/1716848432 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f973006aea0 0x7f973006d360 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.066+0000 7f9753aa2640 1 --2- 172.21.15.77:0/1716848432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f974c0d2de0 0x7f974c0d3260 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.066+0000 7f9753aa2640 1 --2- 172.21.15.77:0/1716848432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f974c154f90 0x7f974c155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.066+0000 7f9753aa2640 1 --2- 172.21.15.77:0/1716848432 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9738003970 0x7f974c1f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.066+0000 7f9753aa2640 1 -- 172.21.15.77:0/1716848432 >> 172.21.15.77:0/1716848432 conn(0x7f974c0cf880 msgr2=0x7f974c0d25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:08.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.066+0000 7f9753aa2640 1 -- 172.21.15.77:0/1716848432 shutdown_connections 2023-11-04T01:42:08.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.066+0000 7f9753aa2640 1 -- 172.21.15.77:0/1716848432 wait complete. 2023-11-04T01:42:08.078 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:42:08.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.176+0000 7f4f3281a640 1 Processor -- start 2023-11-04T01:42:08.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.176+0000 7f4f3281a640 1 -- start start 2023-11-04T01:42:08.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.177+0000 7f4f3281a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4f2c0c37d0 0x7f4f2c0c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:08.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.177+0000 7f4f3281a640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4f2c070710 0x7f4f2c070b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:08.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.177+0000 7f4f3281a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f2c0710a0 con 0x7f4f2c1460c0 2023-11-04T01:42:08.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.177+0000 7f4f3281a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f2c1464a0 con 0x7f4f2c0c37d0 2023-11-04T01:42:08.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.177+0000 7f4f3281a640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c0c41a0 con 0x7f4f2c070710 2023-11-04T01:42:08.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.177+0000 7f4f2bfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f4f2c1460c0 0x7f4f2c0b1860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55212/0 (socket says 172.21.15.77:55212) 2023-11-04T01:42:08.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.177+0000 7f4f2bfff640 1 -- 172.21.15.77:0/1335814508 learned_addr learned my addr 172.21.15.77:0/1335814508 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:08.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.177+0000 7f4f2b7fe640 1 --2- 172.21.15.77:0/1335814508 >> v2:172.21.15.77:3300/0 conn(0x7f4f2c0c37d0 0x7f4f2c0c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:08.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.178+0000 7f4f30db7640 1 --2- 172.21.15.77:0/1335814508 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4f2c070710 0x7f4f2c070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:08.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.178+0000 7f4f2affd640 1 -- 172.21.15.77:0/1335814508 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 202113126 0 0) 0x7f4f1c001110 con 0x7f4f2c1460c0 2023-11-04T01:42:08.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.178+0000 7f4f2affd640 1 -- 172.21.15.77:0/1335814508 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f14003520 con 0x7f4f2c1460c0 2023-11-04T01:42:08.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.178+0000 7f4f2b7fe640 1 -- 172.21.15.77:0/1335814508 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4f2c070710 msgr2=0x7f4f2c070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:08.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.178+0000 7f4f2b7fe640 1 --2- 172.21.15.77:0/1335814508 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4f2c070710 0x7f4f2c070b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.178+0000 7f4f2b7fe640 1 -- 172.21.15.77:0/1335814508 >> v1:172.21.15.77:6789/0 conn(0x7f4f2c1460c0 legacy=0x7f4f2c0b1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:08.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.178+0000 7f4f2b7fe640 1 -- 172.21.15.77:0/1335814508 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f2c146950 con 0x7f4f2c0c37d0 2023-11-04T01:42:08.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.178+0000 7f4f2b7fe640 1 --2- 172.21.15.77:0/1335814508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f2c0c37d0 0x7f4f2c0c3c60 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f4f200097d0 tx=0x7f4f2002b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a3f998a41f5b51e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:08.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.179+0000 7f4f2affd640 1 -- 172.21.15.77:0/1335814508 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f20031800 con 0x7f4f2c0c37d0 2023-11-04T01:42:08.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.179+0000 7f4f2affd640 1 -- 172.21.15.77:0/1335814508 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f20031960 con 0x7f4f2c0c37d0 2023-11-04T01:42:08.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.179+0000 7f4f2affd640 1 -- 172.21.15.77:0/1335814508 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f20031cf0 con 0x7f4f2c0c37d0 2023-11-04T01:42:08.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.179+0000 7f4f3281a640 1 -- 172.21.15.77:0/1335814508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f2c0c37d0 msgr2=0x7f4f2c0c3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:08.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.179+0000 7f4f3281a640 1 --2- 172.21.15.77:0/1335814508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f2c0c37d0 0x7f4f2c0c3c60 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f4f200097d0 tx=0x7f4f2002b8a0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.179+0000 7f4f3281a640 1 -- 172.21.15.77:0/1335814508 shutdown_connections 2023-11-04T01:42:08.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.179+0000 7f4f3281a640 1 --2- 172.21.15.77:0/1335814508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f2c0c37d0 0x7f4f2c0c3c60 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.179+0000 7f4f3281a640 1 --2- 172.21.15.77:0/1335814508 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4f2c070710 0x7f4f2c070b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.179+0000 7f4f3281a640 1 -- 172.21.15.77:0/1335814508 >> 172.21.15.77:0/1335814508 conn(0x7f4f2c0ce950 msgr2=0x7f4f2c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:08.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.179+0000 7f4f3281a640 1 -- 172.21.15.77:0/1335814508 shutdown_connections 2023-11-04T01:42:08.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.179+0000 7f4f3281a640 1 -- 172.21.15.77:0/1335814508 wait complete. 2023-11-04T01:42:08.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.180+0000 7f4f3281a640 1 Processor -- start 2023-11-04T01:42:08.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.180+0000 7f4f3281a640 1 -- start start 2023-11-04T01:42:08.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.181+0000 7f4f3281a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f2c070710 0x7f4f2c0ac1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:08.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.181+0000 7f4f3281a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f2c0c37d0 0x7f4f2c1f2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:08.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.181+0000 7f4f3281a640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4f2c1460c0 0x7f4f2c15e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:08.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.181+0000 7f4f3281a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c0c6980 con 0x7f4f2c0c37d0 2023-11-04T01:42:08.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.181+0000 7f4f3281a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c0c5a20 con 0x7f4f2c070710 2023-11-04T01:42:08.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.181+0000 7f4f3281a640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c0c5d00 con 0x7f4f2c1460c0 2023-11-04T01:42:08.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.181+0000 7f4f2b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f2c0c37d0 0x7f4f2c1f2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:08.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.181+0000 7f4f2b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f2c0c37d0 0x7f4f2c1f2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51934/0 (socket says 172.21.15.77:51934) 2023-11-04T01:42:08.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.181+0000 7f4f2b7fe640 1 -- 172.21.15.77:0/2850464332 learned_addr learned my addr 172.21.15.77:0/2850464332 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:08.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.182+0000 7f4f30db7640 1 --2- 172.21.15.77:0/2850464332 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4f2c1460c0 0x7f4f2c15e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:08.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.182+0000 7f4f2bfff640 1 --2- 172.21.15.77:0/2850464332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f2c070710 0x7f4f2c0ac1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:08.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.182+0000 7f4f2b7fe640 1 -- 172.21.15.77:0/2850464332 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4f2c1460c0 msgr2=0x7f4f2c15e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:08.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.182+0000 7f4f2b7fe640 1 --2- 172.21.15.77:0/2850464332 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4f2c1460c0 0x7f4f2c15e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.182+0000 7f4f2b7fe640 1 -- 172.21.15.77:0/2850464332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f2c070710 msgr2=0x7f4f2c0ac1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:08.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.182+0000 7f4f2b7fe640 1 --2- 172.21.15.77:0/2850464332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f2c070710 0x7f4f2c0ac1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.182+0000 7f4f2b7fe640 1 -- 172.21.15.77:0/2850464332 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f20009400 con 0x7f4f2c0c37d0 2023-11-04T01:42:08.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.182+0000 7f4f2bfff640 1 --2- 172.21.15.77:0/2850464332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f2c070710 0x7f4f2c0ac1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:08.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.182+0000 7f4f30db7640 1 --2- 172.21.15.77:0/2850464332 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4f2c1460c0 0x7f4f2c15e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:08.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.182+0000 7f4f2b7fe640 1 --2- 172.21.15.77:0/2850464332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f2c0c37d0 0x7f4f2c1f2b70 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f4f200098f0 tx=0x7f4f200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:08.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.182+0000 7f4f28ff9640 1 -- 172.21.15.77:0/2850464332 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2003bc70 con 0x7f4f2c0c37d0 2023-11-04T01:42:08.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.182+0000 7f4f28ff9640 1 -- 172.21.15.77:0/2850464332 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2003be10 con 0x7f4f2c0c37d0 2023-11-04T01:42:08.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.182+0000 7f4f3281a640 1 -- 172.21.15.77:0/2850464332 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2c0c5fe0 con 0x7f4f2c0c37d0 2023-11-04T01:42:08.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.182+0000 7f4f28ff9640 1 -- 172.21.15.77:0/2850464332 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f20045630 con 0x7f4f2c0c37d0 2023-11-04T01:42:08.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.182+0000 7f4f3281a640 1 -- 172.21.15.77:0/2850464332 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f2c0c65a0 con 0x7f4f2c0c37d0 2023-11-04T01:42:08.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.183+0000 7f4f3281a640 1 -- 172.21.15.77:0/2850464332 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f2c0c6ac0 con 0x7f4f2c0c37d0 2023-11-04T01:42:08.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.183+0000 7f4f28ff9640 1 -- 172.21.15.77:0/2850464332 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4f2004e450 con 0x7f4f2c0c37d0 2023-11-04T01:42:08.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.184+0000 7f4f28ff9640 1 --2- 172.21.15.77:0/2850464332 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4f1806ae70 0x7f4f1806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:08.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.184+0000 7f4f28ff9640 1 -- 172.21.15.77:0/2850464332 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4f2002e070 con 0x7f4f2c0c37d0 2023-11-04T01:42:08.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.184+0000 7f4f2bfff640 1 --2- 172.21.15.77:0/2850464332 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4f1806ae70 0x7f4f1806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:08.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.184+0000 7f4f2bfff640 1 --2- 172.21.15.77:0/2850464332 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4f1806ae70 0x7f4f1806d330 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c005880 tx=0x7f4f1c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:08.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.188+0000 7f4f28ff9640 1 -- 172.21.15.77:0/2850464332 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4f2c0c6ac0 con 0x7f4f2c0c37d0 2023-11-04T01:42:08.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.366+0000 7f4f3281a640 1 -- 172.21.15.77:0/2850464332 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4f2c0c6ac0 con 0x7f4f2c0c37d0 2023-11-04T01:42:08.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.366+0000 7f4f28ff9640 1 -- 172.21.15.77:0/2850464332 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4f2c0c6ac0 con 0x7f4f2c0c37d0 2023-11-04T01:42:08.368 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-11-04T01:42:08.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.368+0000 7f4f3281a640 1 -- 172.21.15.77:0/2850464332 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4f1806ae70 msgr2=0x7f4f1806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:08.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.368+0000 7f4f3281a640 1 --2- 172.21.15.77:0/2850464332 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4f1806ae70 0x7f4f1806d330 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c005880 tx=0x7f4f1c009040 comp rx=0 tx=0).stop 2023-11-04T01:42:08.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.368+0000 7f4f3281a640 1 -- 172.21.15.77:0/2850464332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f2c0c37d0 msgr2=0x7f4f2c1f2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:08.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.368+0000 7f4f3281a640 1 --2- 172.21.15.77:0/2850464332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f2c0c37d0 0x7f4f2c1f2b70 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f4f200098f0 tx=0x7f4f200046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.368+0000 7f4f3281a640 1 -- 172.21.15.77:0/2850464332 shutdown_connections 2023-11-04T01:42:08.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.368+0000 7f4f3281a640 1 --2- 172.21.15.77:0/2850464332 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4f1806ae70 0x7f4f1806d330 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.368+0000 7f4f3281a640 1 --2- 172.21.15.77:0/2850464332 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4f2c1460c0 0x7f4f2c15e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.368+0000 7f4f3281a640 1 --2- 172.21.15.77:0/2850464332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f2c0c37d0 0x7f4f2c1f2b70 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.368+0000 7f4f3281a640 1 --2- 172.21.15.77:0/2850464332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f2c070710 0x7f4f2c0ac1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.368+0000 7f4f3281a640 1 -- 172.21.15.77:0/2850464332 >> 172.21.15.77:0/2850464332 conn(0x7f4f2c0ce950 msgr2=0x7f4f2c0c4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:08.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.368+0000 7f4f3281a640 1 -- 172.21.15.77:0/2850464332 shutdown_connections 2023-11-04T01:42:08.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.368+0000 7f4f3281a640 1 -- 172.21.15.77:0/2850464332 wait complete. 2023-11-04T01:42:08.380 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi077.front.sepia.ceph.com... 2023-11-04T01:42:08.381 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:08.381 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:08.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:08.440 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[138344]: fuse finished with error 0 and tester_r 0 2023-11-04T01:42:08.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:08.446 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:2023-11-04T01:42:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:08.447 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2023-11-04T01:42:08.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:08.448 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:42:08.463 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:42:08.463 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:42:08.482 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056339,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13650 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:42:08.483 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi122.front.sepia.ceph.com 2023-11-04T01:42:08.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:08.484 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:42:08.540 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:42:08.541 INFO:teuthology.orchestra.run.smithi122.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-04T01:42:08.541 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:42:08.542 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:42:08.557 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19534 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:42:08.558 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2023-11-04T01:42:08.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:08.559 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:42:08.612 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:42:08.613 INFO:teuthology.orchestra.run.smithi077.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-04T01:42:08.613 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:42:08.614 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:42:08.633 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056339,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13650 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:42:08.634 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi122.front.sepia.ceph.com 2023-11-04T01:42:08.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:08.635 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:42:08.691 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:42:08.692 INFO:teuthology.orchestra.run.smithi122.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-04T01:42:08.692 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:08.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.790+0000 7f20793d5640 1 Processor -- start 2023-11-04T01:42:08.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.790+0000 7f20793d5640 1 -- start start 2023-11-04T01:42:08.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.791+0000 7f20793d5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f207415ce70 0x7f207406d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:08.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.791+0000 7f20793d5640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f207415d250 0x7f20740c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:08.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.791+0000 7f20793d5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f207406a120 con 0x7f20740c9d70 2023-11-04T01:42:08.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.791+0000 7f20793d5640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20740cdc10 con 0x7f207415d250 2023-11-04T01:42:08.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.791+0000 7f20793d5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f207406def0 con 0x7f207415ce70 2023-11-04T01:42:08.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.791+0000 7f20737fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f20740c9d70 0x7f20740ccdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55224/0 (socket says 172.21.15.77:55224) 2023-11-04T01:42:08.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.791+0000 7f20737fe640 1 -- 172.21.15.77:0/3439398795 learned_addr learned my addr 172.21.15.77:0/3439398795 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:08.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.791+0000 7f206bfff640 1 --2- 172.21.15.77:0/3439398795 >> v2:172.21.15.122:3300/0 conn(0x7f207415d250 0x7f20740c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:08.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.791+0000 7f2072ffd640 1 --2- 172.21.15.77:0/3439398795 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f207415ce70 0x7f207406d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:08.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.791+0000 7f20727fc640 1 -- 172.21.15.77:0/3439398795 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3223071398 0 0) 0x7f207406a120 con 0x7f20740c9d70 2023-11-04T01:42:08.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.791+0000 7f20727fc640 1 -- 172.21.15.77:0/3439398795 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2060003520 con 0x7f20740c9d70 2023-11-04T01:42:08.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.791+0000 7f20727fc640 1 -- 172.21.15.77:0/3439398795 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1300082349 0 0) 0x7f2060003520 con 0x7f20740c9d70 2023-11-04T01:42:08.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.791+0000 7f20727fc640 1 -- 172.21.15.77:0/3439398795 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f207415ce70 msgr2=0x7f207406d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:08.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.791+0000 7f20727fc640 1 --2- 172.21.15.77:0/3439398795 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f207415ce70 0x7f207406d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.791+0000 7f20727fc640 1 -- 172.21.15.77:0/3439398795 >> v2:172.21.15.122:3300/0 conn(0x7f207415d250 msgr2=0x7f20740c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:08.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.791+0000 7f20727fc640 1 --2- 172.21.15.77:0/3439398795 >> v2:172.21.15.122:3300/0 conn(0x7f207415d250 0x7f20740c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.791+0000 7f20727fc640 1 -- 172.21.15.77:0/3439398795 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f207406a370 con 0x7f20740c9d70 2023-11-04T01:42:08.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.791+0000 7f20727fc640 1 -- 172.21.15.77:0/3439398795 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f206c0019f0 con 0x7f20740c9d70 2023-11-04T01:42:08.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.791+0000 7f20727fc640 1 -- 172.21.15.77:0/3439398795 >> v1:172.21.15.77:6789/0 conn(0x7f20740c9d70 legacy=0x7f20740ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:08.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.791+0000 7f20727fc640 1 --2- 172.21.15.77:0/3439398795 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f207415ce70 0x7f2060003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:08.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.791+0000 7f20727fc640 1 --2- 172.21.15.77:0/3439398795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2060003ef0 0x7f20600047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:08.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.791+0000 7f20727fc640 1 --2- 172.21.15.77:0/3439398795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2060004d00 0x7f2060005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:08.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.791+0000 7f20727fc640 1 -- 172.21.15.77:0/3439398795 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20740cdc10 con 0x7f2060004d00 2023-11-04T01:42:08.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.791+0000 7f20727fc640 1 -- 172.21.15.77:0/3439398795 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207406def0 con 0x7f2060003ef0 2023-11-04T01:42:08.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.791+0000 7f20727fc640 1 -- 172.21.15.77:0/3439398795 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f206000b980 con 0x7f207415ce70 2023-11-04T01:42:08.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.792+0000 7f20737fe640 1 --2- 172.21.15.77:0/3439398795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2060004d00 0x7f2060005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:08.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.792+0000 7f2072ffd640 1 --2- 172.21.15.77:0/3439398795 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f207415ce70 0x7f2060003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:08.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.792+0000 7f206bfff640 1 --2- 172.21.15.77:0/3439398795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2060003ef0 0x7f20600047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:08.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.792+0000 7f20737fe640 1 -- 172.21.15.77:0/3439398795 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f207415ce70 msgr2=0x7f2060003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:08.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.792+0000 7f20737fe640 1 --2- 172.21.15.77:0/3439398795 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f207415ce70 0x7f2060003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.792+0000 7f20737fe640 1 -- 172.21.15.77:0/3439398795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2060003ef0 msgr2=0x7f20600047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:08.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.792+0000 7f20737fe640 1 --2- 172.21.15.77:0/3439398795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2060003ef0 0x7f20600047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.792+0000 7f20737fe640 1 -- 172.21.15.77:0/3439398795 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2060003520 con 0x7f2060004d00 2023-11-04T01:42:08.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.792+0000 7f206bfff640 1 --2- 172.21.15.77:0/3439398795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2060003ef0 0x7f20600047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:08.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.792+0000 7f2072ffd640 1 --2- 172.21.15.77:0/3439398795 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f207415ce70 0x7f2060003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:08.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.792+0000 7f20737fe640 1 --2- 172.21.15.77:0/3439398795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2060004d00 0x7f2060005180 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f206c00a830 tx=0x7f20600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa507c56eae7320a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:08.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.793+0000 7f20727fc640 1 -- 172.21.15.77:0/3439398795 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206c034630 con 0x7f2060004d00 2023-11-04T01:42:08.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.793+0000 7f20727fc640 1 -- 172.21.15.77:0/3439398795 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f206c02f070 con 0x7f2060004d00 2023-11-04T01:42:08.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.793+0000 7f20727fc640 1 -- 172.21.15.77:0/3439398795 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206c034a50 con 0x7f2060004d00 2023-11-04T01:42:08.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.793+0000 7f20793d5640 1 -- 172.21.15.77:0/3439398795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2060004d00 msgr2=0x7f2060005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:08.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.793+0000 7f20793d5640 1 --2- 172.21.15.77:0/3439398795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2060004d00 0x7f2060005180 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f206c00a830 tx=0x7f20600057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.793+0000 7f20737fe640 1 -- 172.21.15.77:0/3439398795 reap_dead start 2023-11-04T01:42:08.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.793+0000 7f20793d5640 1 -- 172.21.15.77:0/3439398795 shutdown_connections 2023-11-04T01:42:08.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.793+0000 7f20793d5640 1 -- 172.21.15.77:0/3439398795 >> 172.21.15.77:0/3439398795 conn(0x7f20740b0cd0 msgr2=0x7f20740b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:08.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.793+0000 7f20793d5640 1 -- 172.21.15.77:0/3439398795 shutdown_connections 2023-11-04T01:42:08.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.793+0000 7f20793d5640 1 -- 172.21.15.77:0/3439398795 wait complete. 2023-11-04T01:42:08.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.794+0000 7f20793d5640 1 Processor -- start 2023-11-04T01:42:08.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.794+0000 7f20793d5640 1 -- start start 2023-11-04T01:42:08.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.795+0000 7f20793d5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2060004d00 0x7f20740c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:08.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.795+0000 7f20793d5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2074156350 0x7f20741567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:08.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.795+0000 7f20793d5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2074158260 0x7f20741586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:08.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.795+0000 7f20793d5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20741e5700 con 0x7f2074158260 2023-11-04T01:42:08.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.795+0000 7f20793d5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2074156d10 con 0x7f2060004d00 2023-11-04T01:42:08.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.795+0000 7f20793d5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20740c6f00 con 0x7f2074156350 2023-11-04T01:42:08.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.795+0000 7f20737fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2074158260 0x7f20741586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:08.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.795+0000 7f20737fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2074158260 0x7f20741586e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51946/0 (socket says 172.21.15.77:51946) 2023-11-04T01:42:08.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.795+0000 7f20737fe640 1 -- 172.21.15.77:0/1258253994 learned_addr learned my addr 172.21.15.77:0/1258253994 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:08.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.795+0000 7f206bfff640 1 --2- 172.21.15.77:0/1258253994 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2074156350 0x7f20741567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:08.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.795+0000 7f2072ffd640 1 --2- 172.21.15.77:0/1258253994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2060004d00 0x7f20740c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:08.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.795+0000 7f20737fe640 1 -- 172.21.15.77:0/1258253994 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2074156350 msgr2=0x7f20741567d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:08.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.795+0000 7f20737fe640 1 --2- 172.21.15.77:0/1258253994 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2074156350 0x7f20741567d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.795+0000 7f20737fe640 1 -- 172.21.15.77:0/1258253994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2060004d00 msgr2=0x7f20740c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:08.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.795+0000 7f20737fe640 1 --2- 172.21.15.77:0/1258253994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2060004d00 0x7f20740c5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:08.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.796+0000 7f20737fe640 1 -- 172.21.15.77:0/1258253994 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2074158f70 con 0x7f2074158260 2023-11-04T01:42:08.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.796+0000 7f20737fe640 1 --2- 172.21.15.77:0/1258253994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2074158260 0x7f20741586e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f206c001cb0 tx=0x7f207406e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:08.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.796+0000 7f206b7fe640 1 -- 172.21.15.77:0/1258253994 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206c001fc0 con 0x7f2074158260 2023-11-04T01:42:08.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.796+0000 7f206b7fe640 1 -- 172.21.15.77:0/1258253994 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f206c034640 con 0x7f2074158260 2023-11-04T01:42:08.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.796+0000 7f206b7fe640 1 -- 172.21.15.77:0/1258253994 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206c0349b0 con 0x7f2074158260 2023-11-04T01:42:08.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.796+0000 7f20793d5640 1 -- 172.21.15.77:0/1258253994 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2074159250 con 0x7f2074158260 2023-11-04T01:42:08.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.796+0000 7f20793d5640 1 -- 172.21.15.77:0/1258253994 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20740c7180 con 0x7f2074158260 2023-11-04T01:42:08.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.797+0000 7f20793d5640 1 -- 172.21.15.77:0/1258253994 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2074074290 con 0x7f2074158260 2023-11-04T01:42:08.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.797+0000 7f206b7fe640 1 -- 172.21.15.77:0/1258253994 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f206c031030 con 0x7f2074158260 2023-11-04T01:42:08.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.798+0000 7f206b7fe640 1 --2- 172.21.15.77:0/1258253994 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f205406aea0 0x7f205406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:08.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.798+0000 7f206b7fe640 1 -- 172.21.15.77:0/1258253994 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f206c0ab910 con 0x7f2074158260 2023-11-04T01:42:08.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.798+0000 7f2072ffd640 1 --2- 172.21.15.77:0/1258253994 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f205406aea0 0x7f205406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:08.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.798+0000 7f2072ffd640 1 --2- 172.21.15.77:0/1258253994 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f205406aea0 0x7f205406d360 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f20741e51f0 tx=0x7f2064008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:08.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:08.802+0000 7f206b7fe640 1 -- 172.21.15.77:0/1258253994 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f206c07a260 con 0x7f2074158260 2023-11-04T01:42:09.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.006+0000 7f20793d5640 1 -- 172.21.15.77:0/1258253994 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2074074290 con 0x7f2074158260 2023-11-04T01:42:09.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.006+0000 7f206b7fe640 1 -- 172.21.15.77:0/1258253994 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f206c079df0 con 0x7f2074158260 2023-11-04T01:42:09.011 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:09.011 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5458,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2636406417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2636406417},{"type":"v1","addr":"172.21.15.122:6836","nonce":2636406417}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5461,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/2931907615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":2931907615},{"type":"v1","addr":"172.21.15.122:6837","nonce":2931907615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5955,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1507226082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1507226082},{"type":"v1","addr":"172.21.15.77:6833","nonce":1507226082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:41:53.409913+0000","modified":"2023-11-04T01:41:55.404636+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5958},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5958":{"gid":5958,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6835/1237968770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1237968770},{"type":"v1","addr":"172.21.15.77:6835","nonce":1237968770}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-04T01:42:09.012 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 22 2023-11-04T01:42:09.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.008+0000 7f20793d5640 1 -- 172.21.15.77:0/1258253994 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f205406aea0 msgr2=0x7f205406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.008+0000 7f20793d5640 1 --2- 172.21.15.77:0/1258253994 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f205406aea0 0x7f205406d360 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f20741e51f0 tx=0x7f2064008040 comp rx=0 tx=0).stop 2023-11-04T01:42:09.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.008+0000 7f20793d5640 1 -- 172.21.15.77:0/1258253994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2074158260 msgr2=0x7f20741586e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.008+0000 7f20793d5640 1 --2- 172.21.15.77:0/1258253994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2074158260 0x7f20741586e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f206c001cb0 tx=0x7f207406e170 comp rx=0 tx=0).stop 2023-11-04T01:42:09.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.008+0000 7f20793d5640 1 -- 172.21.15.77:0/1258253994 shutdown_connections 2023-11-04T01:42:09.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.008+0000 7f20793d5640 1 --2- 172.21.15.77:0/1258253994 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f205406aea0 0x7f205406d360 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.008+0000 7f20793d5640 1 --2- 172.21.15.77:0/1258253994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2074158260 0x7f20741586e0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.008+0000 7f20793d5640 1 --2- 172.21.15.77:0/1258253994 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2074156350 0x7f20741567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.008+0000 7f20793d5640 1 --2- 172.21.15.77:0/1258253994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2060004d00 0x7f20740c5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.008+0000 7f20793d5640 1 -- 172.21.15.77:0/1258253994 >> 172.21.15.77:0/1258253994 conn(0x7f20740b0cd0 msgr2=0x7f20741559b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:09.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.008+0000 7f20793d5640 1 -- 172.21.15.77:0/1258253994 shutdown_connections 2023-11-04T01:42:09.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.008+0000 7f20793d5640 1 -- 172.21.15.77:0/1258253994 wait complete. 2023-11-04T01:42:09.021 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:09.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.121+0000 7ffa73b2c640 1 Processor -- start 2023-11-04T01:42:09.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.121+0000 7ffa73b2c640 1 -- start start 2023-11-04T01:42:09.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.122+0000 7ffa73b2c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffa6c06c6f0 0x7ffa6c06cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.122+0000 7ffa73b2c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa6c0ca450 con 0x7ffa6c0b07f0 2023-11-04T01:42:09.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.122+0000 7ffa73b2c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa6c15bc30 con 0x7ffa6c15aa30 2023-11-04T01:42:09.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.122+0000 7ffa73b2c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c06d090 con 0x7ffa6c06c6f0 2023-11-04T01:42:09.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.122+0000 7ffa720c9640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ffa6c0b07f0 0x7ffa6c15ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55230/0 (socket says 172.21.15.77:55230) 2023-11-04T01:42:09.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.122+0000 7ffa720c9640 1 -- 172.21.15.77:0/3421241377 learned_addr learned my addr 172.21.15.77:0/3421241377 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:09.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.122+0000 7ffa710c7640 1 --2- 172.21.15.77:0/3421241377 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffa6c06c6f0 0x7ffa6c06cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.122+0000 7ffa708c6640 1 -- 172.21.15.77:0/3421241377 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1386343146 0 0) 0x7ffa6c0ca450 con 0x7ffa6c0b07f0 2023-11-04T01:42:09.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.122+0000 7ffa708c6640 1 -- 172.21.15.77:0/3421241377 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa58003520 con 0x7ffa6c0b07f0 2023-11-04T01:42:09.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.122+0000 7ffa708c6640 1 -- 172.21.15.77:0/3421241377 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1278277025 0 0) 0x7ffa6c15bc30 con 0x7ffa6c15aa30 2023-11-04T01:42:09.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.122+0000 7ffa708c6640 1 -- 172.21.15.77:0/3421241377 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa6c0ca450 con 0x7ffa6c15aa30 2023-11-04T01:42:09.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.122+0000 7ffa708c6640 1 -- 172.21.15.77:0/3421241377 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2458883441 0 0) 0x7ffa58003520 con 0x7ffa6c0b07f0 2023-11-04T01:42:09.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.122+0000 7ffa710c7640 1 -- 172.21.15.77:0/3421241377 >> v1:172.21.15.122:6789/0 conn(0x7ffa6c15aa30 legacy=0x7ffa6c0c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.122+0000 7ffa710c7640 1 -- 172.21.15.77:0/3421241377 >> v1:172.21.15.77:6789/0 conn(0x7ffa6c0b07f0 legacy=0x7ffa6c15ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.122+0000 7ffa710c7640 1 -- 172.21.15.77:0/3421241377 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6c15bf10 con 0x7ffa6c06c6f0 2023-11-04T01:42:09.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.123+0000 7ffa710c7640 1 --2- 172.21.15.77:0/3421241377 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffa6c06c6f0 0x7ffa6c06cb50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c0097d0 tx=0x7ffa5c02b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0be094115ae5665 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:09.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.123+0000 7ffa708c6640 1 -- 172.21.15.77:0/3421241377 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa640019f0 con 0x7ffa6c06c6f0 2023-11-04T01:42:09.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.123+0000 7ffa708c6640 1 -- 172.21.15.77:0/3421241377 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5c02e050 con 0x7ffa6c06c6f0 2023-11-04T01:42:09.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.124+0000 7ffa708c6640 1 -- 172.21.15.77:0/3421241377 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c030710 con 0x7ffa6c06c6f0 2023-11-04T01:42:09.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.124+0000 7ffa73b2c640 1 -- 172.21.15.77:0/3421241377 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffa6c06c6f0 msgr2=0x7ffa6c06cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.124+0000 7ffa73b2c640 1 --2- 172.21.15.77:0/3421241377 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffa6c06c6f0 0x7ffa6c06cb50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c0097d0 tx=0x7ffa5c02b800 comp rx=0 tx=0).stop 2023-11-04T01:42:09.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.124+0000 7ffa73b2c640 1 -- 172.21.15.77:0/3421241377 shutdown_connections 2023-11-04T01:42:09.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.124+0000 7ffa73b2c640 1 --2- 172.21.15.77:0/3421241377 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffa6c06c6f0 0x7ffa6c06cb50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.124+0000 7ffa73b2c640 1 -- 172.21.15.77:0/3421241377 >> 172.21.15.77:0/3421241377 conn(0x7ffa6c0cb7f0 msgr2=0x7ffa6c0cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:09.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.124+0000 7ffa73b2c640 1 -- 172.21.15.77:0/3421241377 shutdown_connections 2023-11-04T01:42:09.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.124+0000 7ffa73b2c640 1 -- 172.21.15.77:0/3421241377 wait complete. 2023-11-04T01:42:09.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.125+0000 7ffa73b2c640 1 Processor -- start 2023-11-04T01:42:09.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.125+0000 7ffa73b2c640 1 -- start start 2023-11-04T01:42:09.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.126+0000 7ffa73b2c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffa6c06c6f0 0x7ffa6c1efd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.126+0000 7ffa73b2c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa6c0b07f0 0x7ffa6c158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.126+0000 7ffa73b2c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffa6c15aa30 0x7ffa6c159530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.126+0000 7ffa73b2c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c0c80d0 con 0x7ffa6c0b07f0 2023-11-04T01:42:09.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.126+0000 7ffa73b2c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c15cae0 con 0x7ffa6c06c6f0 2023-11-04T01:42:09.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.126+0000 7ffa73b2c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c0b1f60 con 0x7ffa6c15aa30 2023-11-04T01:42:09.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.126+0000 7ffa710c7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa6c0b07f0 0x7ffa6c158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.126+0000 7ffa710c7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa6c0b07f0 0x7ffa6c158ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51956/0 (socket says 172.21.15.77:51956) 2023-11-04T01:42:09.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.126+0000 7ffa710c7640 1 -- 172.21.15.77:0/899819106 learned_addr learned my addr 172.21.15.77:0/899819106 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:09.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.126+0000 7ffa720c9640 1 --2- 172.21.15.77:0/899819106 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffa6c15aa30 0x7ffa6c159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.126+0000 7ffa718c8640 1 --2- 172.21.15.77:0/899819106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffa6c06c6f0 0x7ffa6c1efd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.126+0000 7ffa710c7640 1 -- 172.21.15.77:0/899819106 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffa6c15aa30 msgr2=0x7ffa6c159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.126+0000 7ffa710c7640 1 --2- 172.21.15.77:0/899819106 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffa6c15aa30 0x7ffa6c159530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.126+0000 7ffa710c7640 1 -- 172.21.15.77:0/899819106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffa6c06c6f0 msgr2=0x7ffa6c1efd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.126+0000 7ffa710c7640 1 --2- 172.21.15.77:0/899819106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffa6c06c6f0 0x7ffa6c1efd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.126+0000 7ffa710c7640 1 -- 172.21.15.77:0/899819106 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5c009400 con 0x7ffa6c0b07f0 2023-11-04T01:42:09.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.126+0000 7ffa710c7640 1 --2- 172.21.15.77:0/899819106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa6c0b07f0 0x7ffa6c158ff0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c02b840 tx=0x7ffa5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:09.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.127+0000 7ffa627fc640 1 -- 172.21.15.77:0/899819106 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c03c620 con 0x7ffa6c0b07f0 2023-11-04T01:42:09.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.127+0000 7ffa627fc640 1 -- 172.21.15.77:0/899819106 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5c03c7a0 con 0x7ffa6c0b07f0 2023-11-04T01:42:09.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.127+0000 7ffa73b2c640 1 -- 172.21.15.77:0/899819106 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa6c0c7830 con 0x7ffa6c0b07f0 2023-11-04T01:42:09.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.127+0000 7ffa627fc640 1 -- 172.21.15.77:0/899819106 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c03cb50 con 0x7ffa6c0b07f0 2023-11-04T01:42:09.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.127+0000 7ffa73b2c640 1 -- 172.21.15.77:0/899819106 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa6c0c7df0 con 0x7ffa6c0b07f0 2023-11-04T01:42:09.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.128+0000 7ffa73b2c640 1 -- 172.21.15.77:0/899819106 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa6c15c8b0 con 0x7ffa6c0b07f0 2023-11-04T01:42:09.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.128+0000 7ffa627fc640 1 -- 172.21.15.77:0/899819106 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffa5c039070 con 0x7ffa6c0b07f0 2023-11-04T01:42:09.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.128+0000 7ffa627fc640 1 --2- 172.21.15.77:0/899819106 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ffa5006aea0 0x7ffa5006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.128+0000 7ffa627fc640 1 -- 172.21.15.77:0/899819106 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ffa5c0aace0 con 0x7ffa6c0b07f0 2023-11-04T01:42:09.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.129+0000 7ffa718c8640 1 --2- 172.21.15.77:0/899819106 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ffa5006aea0 0x7ffa5006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.129+0000 7ffa718c8640 1 --2- 172.21.15.77:0/899819106 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ffa5006aea0 0x7ffa5006d360 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ffa680010e0 tx=0x7ffa68009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:09.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.133+0000 7ffa627fc640 1 -- 172.21.15.77:0/899819106 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffa6c15c8b0 con 0x7ffa6c0b07f0 2023-11-04T01:42:09.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.299+0000 7ffa73b2c640 1 -- 172.21.15.77:0/899819106 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa6c15c8b0 con 0x7ffa6c0b07f0 2023-11-04T01:42:09.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.300+0000 7ffa627fc640 1 -- 172.21.15.77:0/899819106 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+18511 (secure 0 0 0) 0x7ffa5c037090 con 0x7ffa6c0b07f0 2023-11-04T01:42:09.302 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:09.303 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":54,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:41:55.075378+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:41:51.914855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-04T01:41:52.371167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:09.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.302+0000 7ffa73b2c640 1 -- 172.21.15.77:0/899819106 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ffa5006aea0 msgr2=0x7ffa5006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.302+0000 7ffa73b2c640 1 --2- 172.21.15.77:0/899819106 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ffa5006aea0 0x7ffa5006d360 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ffa680010e0 tx=0x7ffa68009040 comp rx=0 tx=0).stop 2023-11-04T01:42:09.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.302+0000 7ffa73b2c640 1 -- 172.21.15.77:0/899819106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa6c0b07f0 msgr2=0x7ffa6c158ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.302+0000 7ffa73b2c640 1 --2- 172.21.15.77:0/899819106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa6c0b07f0 0x7ffa6c158ff0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c02b840 tx=0x7ffa5c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.302+0000 7ffa73b2c640 1 -- 172.21.15.77:0/899819106 shutdown_connections 2023-11-04T01:42:09.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.302+0000 7ffa73b2c640 1 --2- 172.21.15.77:0/899819106 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ffa5006aea0 0x7ffa5006d360 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.302+0000 7ffa73b2c640 1 --2- 172.21.15.77:0/899819106 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffa6c15aa30 0x7ffa6c159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.302+0000 7ffa73b2c640 1 --2- 172.21.15.77:0/899819106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa6c0b07f0 0x7ffa6c158ff0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.302+0000 7ffa73b2c640 1 --2- 172.21.15.77:0/899819106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffa6c06c6f0 0x7ffa6c1efd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.302+0000 7ffa73b2c640 1 -- 172.21.15.77:0/899819106 >> 172.21.15.77:0/899819106 conn(0x7ffa6c0cb7f0 msgr2=0x7ffa6c0c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:09.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.302+0000 7ffa73b2c640 1 -- 172.21.15.77:0/899819106 shutdown_connections 2023-11-04T01:42:09.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.302+0000 7ffa73b2c640 1 -- 172.21.15.77:0/899819106 wait complete. 2023-11-04T01:42:09.315 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:33.142176+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:41:51.914855+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:41:52.371167+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:42:09.315 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:42:09.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.416+0000 7f4d7ae2b640 1 Processor -- start 2023-11-04T01:42:09.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.416+0000 7f4d7ae2b640 1 -- start start 2023-11-04T01:42:09.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.417+0000 7f4d7ae2b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4d74159c00 0x7f4d740cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.417+0000 7f4d7ae2b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d740ae1d0 0x7f4d740c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.417+0000 7f4d7ae2b640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d7415aff0 con 0x7f4d740c48e0 2023-11-04T01:42:09.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.417+0000 7f4d7ae2b640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d740c52d0 con 0x7f4d74159c00 2023-11-04T01:42:09.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.417+0000 7f4d7ae2b640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7415a3e0 con 0x7f4d740ae1d0 2023-11-04T01:42:09.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.417+0000 7f4d793c8640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d740ae1d0 0x7f4d740c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.417+0000 7f4d78bc7640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4d74159c00 0x7f4d740cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.417+0000 7f4d793c8640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d740ae1d0 0x7f4d740c4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:33586/0 (socket says 172.21.15.77:33586) 2023-11-04T01:42:09.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.417+0000 7f4d793c8640 1 -- 172.21.15.77:0/505237492 learned_addr learned my addr 172.21.15.77:0/505237492 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:09.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.417+0000 7f4d6bfff640 1 --1- 172.21.15.77:0/505237492 >> v1:172.21.15.122:6789/0 conn(0x7f4d740c48e0 0x7f4d740adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:56594/0 (socket says 172.21.15.77:56594) 2023-11-04T01:42:09.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.417+0000 7f4d78bc7640 1 -- 172.21.15.77:0/505237492 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d740ae1d0 msgr2=0x7f4d740c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:09.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.417+0000 7f4d78bc7640 1 --2- 172.21.15.77:0/505237492 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d740ae1d0 0x7f4d740c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.417+0000 7f4d78bc7640 1 -- 172.21.15.77:0/505237492 >> v1:172.21.15.122:6789/0 conn(0x7f4d740c48e0 legacy=0x7f4d740adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.418+0000 7f4d6b7fe640 1 -- 172.21.15.77:0/505237492 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4214932891 0 0) 0x7f4d7415aff0 con 0x7f4d740c48e0 2023-11-04T01:42:09.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.418+0000 7f4d78bc7640 1 -- 172.21.15.77:0/505237492 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7415a6c0 con 0x7f4d74159c00 2023-11-04T01:42:09.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.418+0000 7f4d793c8640 1 --2- 172.21.15.77:0/505237492 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d740ae1d0 0x7f4d740c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:09.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.418+0000 7f4d78bc7640 1 --2- 172.21.15.77:0/505237492 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d74159c00 0x7f4d740cc890 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4d700097a0 tx=0x7f4d7002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba4ab41a13c429cb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:09.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.418+0000 7f4d6b7fe640 1 -- 172.21.15.77:0/505237492 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d70031780 con 0x7f4d74159c00 2023-11-04T01:42:09.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.419+0000 7f4d6b7fe640 1 -- 172.21.15.77:0/505237492 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d700318e0 con 0x7f4d74159c00 2023-11-04T01:42:09.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.419+0000 7f4d6b7fe640 1 -- 172.21.15.77:0/505237492 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d70031c70 con 0x7f4d74159c00 2023-11-04T01:42:09.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.419+0000 7f4d7ae2b640 1 -- 172.21.15.77:0/505237492 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d74159c00 msgr2=0x7f4d740cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.419+0000 7f4d7ae2b640 1 --2- 172.21.15.77:0/505237492 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d74159c00 0x7f4d740cc890 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4d700097a0 tx=0x7f4d7002b820 comp rx=0 tx=0).stop 2023-11-04T01:42:09.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.419+0000 7f4d7ae2b640 1 -- 172.21.15.77:0/505237492 shutdown_connections 2023-11-04T01:42:09.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.419+0000 7f4d7ae2b640 1 --2- 172.21.15.77:0/505237492 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d740ae1d0 0x7f4d740c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.419+0000 7f4d7ae2b640 1 --2- 172.21.15.77:0/505237492 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d74159c00 0x7f4d740cc890 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.419+0000 7f4d7ae2b640 1 -- 172.21.15.77:0/505237492 >> 172.21.15.77:0/505237492 conn(0x7f4d740ce950 msgr2=0x7f4d740ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:09.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.419+0000 7f4d7ae2b640 1 -- 172.21.15.77:0/505237492 shutdown_connections 2023-11-04T01:42:09.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.419+0000 7f4d7ae2b640 1 -- 172.21.15.77:0/505237492 wait complete. 2023-11-04T01:42:09.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.420+0000 7f4d7ae2b640 1 Processor -- start 2023-11-04T01:42:09.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.420+0000 7f4d7ae2b640 1 -- start start 2023-11-04T01:42:09.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.421+0000 7f4d7ae2b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d740ae1d0 0x7f4d740c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.421+0000 7f4d7ae2b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d740c48e0 0x7f4d74154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.421+0000 7f4d7ae2b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d74159c00 0x7f4d74154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.421+0000 7f4d7ae2b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d740c8580 con 0x7f4d740ae1d0 2023-11-04T01:42:09.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.421+0000 7f4d7ae2b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d740c5a20 con 0x7f4d740c48e0 2023-11-04T01:42:09.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.421+0000 7f4d7ae2b640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d741f2e60 con 0x7f4d74159c00 2023-11-04T01:42:09.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.421+0000 7f4d78bc7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d740ae1d0 0x7f4d740c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.421+0000 7f4d78bc7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d740ae1d0 0x7f4d740c8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51970/0 (socket says 172.21.15.77:51970) 2023-11-04T01:42:09.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.421+0000 7f4d78bc7640 1 -- 172.21.15.77:0/2547037512 learned_addr learned my addr 172.21.15.77:0/2547037512 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:09.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.421+0000 7f4d793c8640 1 --2- 172.21.15.77:0/2547037512 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d74159c00 0x7f4d74154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.421+0000 7f4d6bfff640 1 --2- 172.21.15.77:0/2547037512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d740c48e0 0x7f4d74154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.422+0000 7f4d78bc7640 1 -- 172.21.15.77:0/2547037512 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d74159c00 msgr2=0x7f4d74154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.422+0000 7f4d78bc7640 1 --2- 172.21.15.77:0/2547037512 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d74159c00 0x7f4d74154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.422+0000 7f4d78bc7640 1 -- 172.21.15.77:0/2547037512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d740c48e0 msgr2=0x7f4d74154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.422+0000 7f4d78bc7640 1 --2- 172.21.15.77:0/2547037512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d740c48e0 0x7f4d74154630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.422+0000 7f4d78bc7640 1 -- 172.21.15.77:0/2547037512 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d6c009b30 con 0x7f4d740ae1d0 2023-11-04T01:42:09.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.422+0000 7f4d78bc7640 1 --2- 172.21.15.77:0/2547037512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d740ae1d0 0x7f4d740c8040 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f4d700097a0 tx=0x7f4d700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:09.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.422+0000 7f4d697fa640 1 -- 172.21.15.77:0/2547037512 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d70004230 con 0x7f4d740ae1d0 2023-11-04T01:42:09.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.422+0000 7f4d697fa640 1 -- 172.21.15.77:0/2547037512 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d70004390 con 0x7f4d740ae1d0 2023-11-04T01:42:09.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.422+0000 7f4d7ae2b640 1 -- 172.21.15.77:0/2547037512 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d70009400 con 0x7f4d740ae1d0 2023-11-04T01:42:09.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.422+0000 7f4d697fa640 1 -- 172.21.15.77:0/2547037512 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d70032860 con 0x7f4d740ae1d0 2023-11-04T01:42:09.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.422+0000 7f4d7ae2b640 1 -- 172.21.15.77:0/2547037512 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d741f3420 con 0x7f4d740ae1d0 2023-11-04T01:42:09.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.423+0000 7f4d7ae2b640 1 -- 172.21.15.77:0/2547037512 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d74074290 con 0x7f4d740ae1d0 2023-11-04T01:42:09.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.423+0000 7f4d697fa640 1 -- 172.21.15.77:0/2547037512 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4d700329c0 con 0x7f4d740ae1d0 2023-11-04T01:42:09.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.423+0000 7f4d697fa640 1 --2- 172.21.15.77:0/2547037512 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4d6006ae70 0x7f4d6006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.424+0000 7f4d697fa640 1 -- 172.21.15.77:0/2547037512 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4d700ab9e0 con 0x7f4d740ae1d0 2023-11-04T01:42:09.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.424+0000 7f4d6bfff640 1 --2- 172.21.15.77:0/2547037512 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4d6006ae70 0x7f4d6006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.424+0000 7f4d6bfff640 1 --2- 172.21.15.77:0/2547037512 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4d6006ae70 0x7f4d6006d330 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4d74154e50 tx=0x7f4d64007d50 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:09.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.428+0000 7f4d697fa640 1 -- 172.21.15.77:0/2547037512 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4d70076820 con 0x7f4d740ae1d0 2023-11-04T01:42:09.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.594+0000 7f4d7ae2b640 1 -- 172.21.15.77:0/2547037512 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4d7415c090 con 0x7f4d740ae1d0 2023-11-04T01:42:09.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.594+0000 7f4d697fa640 1 -- 172.21.15.77:0/2547037512 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4d70079e40 con 0x7f4d740ae1d0 2023-11-04T01:42:09.596 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:42:09.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.596+0000 7f4d7ae2b640 1 -- 172.21.15.77:0/2547037512 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4d6006ae70 msgr2=0x7f4d6006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.596+0000 7f4d7ae2b640 1 --2- 172.21.15.77:0/2547037512 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4d6006ae70 0x7f4d6006d330 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4d74154e50 tx=0x7f4d64007d50 comp rx=0 tx=0).stop 2023-11-04T01:42:09.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.596+0000 7f4d7ae2b640 1 -- 172.21.15.77:0/2547037512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d740ae1d0 msgr2=0x7f4d740c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.596+0000 7f4d7ae2b640 1 --2- 172.21.15.77:0/2547037512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d740ae1d0 0x7f4d740c8040 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f4d700097a0 tx=0x7f4d700046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.596+0000 7f4d7ae2b640 1 -- 172.21.15.77:0/2547037512 shutdown_connections 2023-11-04T01:42:09.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.596+0000 7f4d7ae2b640 1 --2- 172.21.15.77:0/2547037512 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4d6006ae70 0x7f4d6006d330 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.596+0000 7f4d7ae2b640 1 --2- 172.21.15.77:0/2547037512 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d74159c00 0x7f4d74154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.596+0000 7f4d7ae2b640 1 --2- 172.21.15.77:0/2547037512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d740c48e0 0x7f4d74154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.596+0000 7f4d7ae2b640 1 --2- 172.21.15.77:0/2547037512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d740ae1d0 0x7f4d740c8040 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.596+0000 7f4d7ae2b640 1 -- 172.21.15.77:0/2547037512 >> 172.21.15.77:0/2547037512 conn(0x7f4d740ce950 msgr2=0x7f4d740ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:09.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.596+0000 7f4d7ae2b640 1 -- 172.21.15.77:0/2547037512 shutdown_connections 2023-11-04T01:42:09.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.596+0000 7f4d7ae2b640 1 -- 172.21.15.77:0/2547037512 wait complete. 2023-11-04T01:42:09.608 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:42:09.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.708+0000 7f36ee4da640 1 Processor -- start 2023-11-04T01:42:09.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.708+0000 7f36ee4da640 1 -- start start 2023-11-04T01:42:09.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.709+0000 7f36ee4da640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f36e8066000 0x7f36e80cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.709+0000 7f36ee4da640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36e80c9bf0 con 0x7f36e8070ff0 2023-11-04T01:42:09.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.709+0000 7f36ee4da640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36e80cd890 con 0x7f36e815d1b0 2023-11-04T01:42:09.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.709+0000 7f36ee4da640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e80cdb30 con 0x7f36e8066000 2023-11-04T01:42:09.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.709+0000 7f36e7fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f36e8070ff0 0x7f36e80713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55246/0 (socket says 172.21.15.77:55246) 2023-11-04T01:42:09.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.709+0000 7f36e7fff640 1 -- 172.21.15.77:0/2128985811 learned_addr learned my addr 172.21.15.77:0/2128985811 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:09.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.709+0000 7f36eca77640 1 --2- 172.21.15.77:0/2128985811 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f36e8066000 0x7f36e80cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.709+0000 7f36e6ffd640 1 -- 172.21.15.77:0/2128985811 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1902158312 0 0) 0x7f36e80c9bf0 con 0x7f36e8070ff0 2023-11-04T01:42:09.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.709+0000 7f36e6ffd640 1 -- 172.21.15.77:0/2128985811 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36d0003520 con 0x7f36e8070ff0 2023-11-04T01:42:09.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.710+0000 7f36e6ffd640 1 -- 172.21.15.77:0/2128985811 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 222644228 0 0) 0x7f36d0003520 con 0x7f36e8070ff0 2023-11-04T01:42:09.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.710+0000 7f36e6ffd640 1 -- 172.21.15.77:0/2128985811 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f36e8066000 msgr2=0x7f36e80cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:09.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.710+0000 7f36e6ffd640 1 --2- 172.21.15.77:0/2128985811 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f36e8066000 0x7f36e80cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.710+0000 7f36e6ffd640 1 -- 172.21.15.77:0/2128985811 >> v1:172.21.15.122:6789/0 conn(0x7f36e815d1b0 legacy=0x7f36e806a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.710+0000 7f36e6ffd640 1 -- 172.21.15.77:0/2128985811 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e80cde10 con 0x7f36e8070ff0 2023-11-04T01:42:09.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.710+0000 7f36e6ffd640 1 -- 172.21.15.77:0/2128985811 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f36d8001670 con 0x7f36e8070ff0 2023-11-04T01:42:09.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.710+0000 7f36e6ffd640 1 -- 172.21.15.77:0/2128985811 >> v1:172.21.15.77:6789/0 conn(0x7f36e8070ff0 legacy=0x7f36e80713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.710+0000 7f36e6ffd640 1 --2- 172.21.15.77:0/2128985811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36d00039a0 0x7f36d0003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.710+0000 7f36e6ffd640 1 --2- 172.21.15.77:0/2128985811 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f36e8066000 0x7f36d00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.710+0000 7f36e6ffd640 1 --2- 172.21.15.77:0/2128985811 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f36d0004d00 0x7f36d0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.710+0000 7f36e6ffd640 1 -- 172.21.15.77:0/2128985811 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e80cdb30 con 0x7f36d00039a0 2023-11-04T01:42:09.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.710+0000 7f36e6ffd640 1 -- 172.21.15.77:0/2128985811 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d000b980 con 0x7f36d0004d00 2023-11-04T01:42:09.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.710+0000 7f36e6ffd640 1 -- 172.21.15.77:0/2128985811 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d000bb40 con 0x7f36e8066000 2023-11-04T01:42:09.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.710+0000 7f36e7fff640 1 --2- 172.21.15.77:0/2128985811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36d00039a0 0x7f36d0003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.710+0000 7f36eca77640 1 --2- 172.21.15.77:0/2128985811 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f36d0004d00 0x7f36d0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.710+0000 7f36e77fe640 1 --2- 172.21.15.77:0/2128985811 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f36e8066000 0x7f36d00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.710+0000 7f36e7fff640 1 -- 172.21.15.77:0/2128985811 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f36e8066000 msgr2=0x7f36d00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:09.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.710+0000 7f36e7fff640 1 --2- 172.21.15.77:0/2128985811 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f36e8066000 0x7f36d00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.710+0000 7f36e7fff640 1 -- 172.21.15.77:0/2128985811 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f36d0004d00 msgr2=0x7f36d0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:09.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.710+0000 7f36e7fff640 1 --2- 172.21.15.77:0/2128985811 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f36d0004d00 0x7f36d0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.710+0000 7f36e7fff640 1 -- 172.21.15.77:0/2128985811 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d0003520 con 0x7f36d00039a0 2023-11-04T01:42:09.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.711+0000 7f36e7fff640 1 --2- 172.21.15.77:0/2128985811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36d00039a0 0x7f36d0003d80 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f36d800c190 tx=0x7f36d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b66215a6ef655 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:09.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.711+0000 7f36e6ffd640 1 -- 172.21.15.77:0/2128985811 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d8005ad0 con 0x7f36d00039a0 2023-11-04T01:42:09.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.711+0000 7f36e6ffd640 1 -- 172.21.15.77:0/2128985811 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d8005c50 con 0x7f36d00039a0 2023-11-04T01:42:09.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.711+0000 7f36e6ffd640 1 -- 172.21.15.77:0/2128985811 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d802c790 con 0x7f36d00039a0 2023-11-04T01:42:09.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.712+0000 7f36ee4da640 1 -- 172.21.15.77:0/2128985811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36d00039a0 msgr2=0x7f36d0003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.712+0000 7f36ee4da640 1 --2- 172.21.15.77:0/2128985811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36d00039a0 0x7f36d0003d80 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f36d800c190 tx=0x7f36d00057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.712+0000 7f36eca77640 1 -- 172.21.15.77:0/2128985811 reap_dead start 2023-11-04T01:42:09.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.712+0000 7f36ee4da640 1 -- 172.21.15.77:0/2128985811 shutdown_connections 2023-11-04T01:42:09.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.712+0000 7f36ee4da640 1 -- 172.21.15.77:0/2128985811 >> 172.21.15.77:0/2128985811 conn(0x7f36e80cbc90 msgr2=0x7f36e80cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:09.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.712+0000 7f36ee4da640 1 -- 172.21.15.77:0/2128985811 shutdown_connections 2023-11-04T01:42:09.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.712+0000 7f36ee4da640 1 -- 172.21.15.77:0/2128985811 wait complete. 2023-11-04T01:42:09.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.713+0000 7f36ee4da640 1 Processor -- start 2023-11-04T01:42:09.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.713+0000 7f36ee4da640 1 -- start start 2023-11-04T01:42:09.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.714+0000 7f36ee4da640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f36d00039a0 0x7f36e81569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.714+0000 7f36ee4da640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36e80c7260 0x7f36e80c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.714+0000 7f36ee4da640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f36e80c76e0 0x7f36e80c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.714+0000 7f36ee4da640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e8159560 con 0x7f36e80c7260 2023-11-04T01:42:09.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.714+0000 7f36ee4da640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e8159840 con 0x7f36e80c76e0 2023-11-04T01:42:09.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.714+0000 7f36ee4da640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e8159b20 con 0x7f36d00039a0 2023-11-04T01:42:09.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.714+0000 7f36e77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36e80c7260 0x7f36e80c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.714+0000 7f36e77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36e80c7260 0x7f36e80c4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51986/0 (socket says 172.21.15.77:51986) 2023-11-04T01:42:09.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.714+0000 7f36e77fe640 1 -- 172.21.15.77:0/195065838 learned_addr learned my addr 172.21.15.77:0/195065838 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:09.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.714+0000 7f36e77fe640 1 -- 172.21.15.77:0/195065838 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f36d00039a0 msgr2=0x7f36e81569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.714+0000 7f36e77fe640 1 --2- 172.21.15.77:0/195065838 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f36d00039a0 0x7f36e81569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.714+0000 7f36e77fe640 1 -- 172.21.15.77:0/195065838 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f36e80c76e0 msgr2=0x7f36e80c52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.714+0000 7f36e77fe640 1 --2- 172.21.15.77:0/195065838 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f36e80c76e0 0x7f36e80c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.714+0000 7f36e77fe640 1 -- 172.21.15.77:0/195065838 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e8159e00 con 0x7f36e80c7260 2023-11-04T01:42:09.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.714+0000 7f36e77fe640 1 --2- 172.21.15.77:0/195065838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36e80c7260 0x7f36e80c4d80 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f36dc00f770 tx=0x7f36dc00fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:09.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.714+0000 7f36e4ff9640 1 -- 172.21.15.77:0/195065838 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc00fe80 con 0x7f36e80c7260 2023-11-04T01:42:09.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.714+0000 7f36e4ff9640 1 -- 172.21.15.77:0/195065838 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36dc0052e0 con 0x7f36e80c7260 2023-11-04T01:42:09.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.714+0000 7f36ee4da640 1 -- 172.21.15.77:0/195065838 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e815a0e0 con 0x7f36e80c7260 2023-11-04T01:42:09.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.714+0000 7f36e4ff9640 1 -- 172.21.15.77:0/195065838 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc00d6b0 con 0x7f36e80c7260 2023-11-04T01:42:09.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.714+0000 7f36ee4da640 1 -- 172.21.15.77:0/195065838 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e815a600 con 0x7f36e80c7260 2023-11-04T01:42:09.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.715+0000 7f36ee4da640 1 -- 172.21.15.77:0/195065838 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36e8159c60 con 0x7f36e80c7260 2023-11-04T01:42:09.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.716+0000 7f36e4ff9640 1 -- 172.21.15.77:0/195065838 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f36dc00d810 con 0x7f36e80c7260 2023-11-04T01:42:09.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.716+0000 7f36e4ff9640 1 --2- 172.21.15.77:0/195065838 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f36d406ae70 0x7f36d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:09.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.716+0000 7f36e4ff9640 1 -- 172.21.15.77:0/195065838 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f36dc089830 con 0x7f36e80c7260 2023-11-04T01:42:09.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.716+0000 7f36e7fff640 1 --2- 172.21.15.77:0/195065838 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f36d406ae70 0x7f36d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:09.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.717+0000 7f36e7fff640 1 --2- 172.21.15.77:0/195065838 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f36d406ae70 0x7f36d406d330 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f36d8034000 tx=0x7f36d8007000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:09.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.720+0000 7f36e4ff9640 1 -- 172.21.15.77:0/195065838 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f36e8159c60 con 0x7f36e80c7260 2023-11-04T01:42:09.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.884+0000 7f36ee4da640 1 -- 172.21.15.77:0/195065838 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f36e8159c60 con 0x7f36e80c7260 2023-11-04T01:42:09.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.884+0000 7f36e4ff9640 1 -- 172.21.15.77:0/195065838 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v54) v1 ==== 103+0+11 (secure 0 0 0) 0x7f36e8159c60 con 0x7f36e80c7260 2023-11-04T01:42:09.886 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:42:09.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.886+0000 7f36ee4da640 1 -- 172.21.15.77:0/195065838 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f36d406ae70 msgr2=0x7f36d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.886+0000 7f36ee4da640 1 --2- 172.21.15.77:0/195065838 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f36d406ae70 0x7f36d406d330 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f36d8034000 tx=0x7f36d8007000 comp rx=0 tx=0).stop 2023-11-04T01:42:09.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.886+0000 7f36ee4da640 1 -- 172.21.15.77:0/195065838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36e80c7260 msgr2=0x7f36e80c4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:09.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.886+0000 7f36ee4da640 1 --2- 172.21.15.77:0/195065838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36e80c7260 0x7f36e80c4d80 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f36dc00f770 tx=0x7f36dc00fc30 comp rx=0 tx=0).stop 2023-11-04T01:42:09.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.886+0000 7f36ee4da640 1 -- 172.21.15.77:0/195065838 shutdown_connections 2023-11-04T01:42:09.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.886+0000 7f36ee4da640 1 --2- 172.21.15.77:0/195065838 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f36d406ae70 0x7f36d406d330 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.886+0000 7f36ee4da640 1 --2- 172.21.15.77:0/195065838 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f36e80c76e0 0x7f36e80c52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.886+0000 7f36ee4da640 1 --2- 172.21.15.77:0/195065838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36e80c7260 0x7f36e80c4d80 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.886+0000 7f36ee4da640 1 --2- 172.21.15.77:0/195065838 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f36d00039a0 0x7f36e81569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:09.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.886+0000 7f36ee4da640 1 -- 172.21.15.77:0/195065838 >> 172.21.15.77:0/195065838 conn(0x7f36e80cbc90 msgr2=0x7f36e815f700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:09.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.886+0000 7f36ee4da640 1 -- 172.21.15.77:0/195065838 shutdown_connections 2023-11-04T01:42:09.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.886+0000 7f36ee4da640 1 -- 172.21.15.77:0/195065838 wait complete. 2023-11-04T01:42:09.898 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:42:10.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.998+0000 7f09059a9640 1 Processor -- start 2023-11-04T01:42:10.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.998+0000 7f09059a9640 1 -- start start 2023-11-04T01:42:10.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.999+0000 7f09059a9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f09000cdac0 0x7f09000b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:10.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.999+0000 7f09059a9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09000d01f0 con 0x7f09000b64c0 2023-11-04T01:42:10.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.999+0000 7f09059a9640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09000b6a40 con 0x7f090015af20 2023-11-04T01:42:10.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.999+0000 7f09059a9640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09000cc380 con 0x7f09000cdac0 2023-11-04T01:42:10.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.999+0000 7f08fe7fc640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f09000b64c0 0x7f09000cd3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55248/0 (socket says 172.21.15.77:55248) 2023-11-04T01:42:10.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.999+0000 7f08fe7fc640 1 -- 172.21.15.77:0/3847739452 learned_addr learned my addr 172.21.15.77:0/3847739452 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:10.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:09.999+0000 7f08ff7fe640 1 --2- 172.21.15.77:0/3847739452 >> v2:172.21.15.122:3300/0 conn(0x7f09000cdac0 0x7f09000b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:10.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.000+0000 7f08fdffb640 1 -- 172.21.15.77:0/3847739452 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2304515965 0 0) 0x7f09000d01f0 con 0x7f09000b64c0 2023-11-04T01:42:10.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.000+0000 7f08fdffb640 1 -- 172.21.15.77:0/3847739452 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08e8003520 con 0x7f09000b64c0 2023-11-04T01:42:10.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.000+0000 7f08ff7fe640 1 -- 172.21.15.77:0/3847739452 >> v1:172.21.15.122:6789/0 conn(0x7f090015af20 legacy=0x7f09000cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.000+0000 7f08fdffb640 1 -- 172.21.15.77:0/3847739452 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2764362049 0 0) 0x7f08e8003520 con 0x7f09000b64c0 2023-11-04T01:42:10.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.000+0000 7f08ff7fe640 1 -- 172.21.15.77:0/3847739452 >> v1:172.21.15.77:6789/0 conn(0x7f09000b64c0 legacy=0x7f09000cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.000+0000 7f08ff7fe640 1 -- 172.21.15.77:0/3847739452 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09000d04b0 con 0x7f09000cdac0 2023-11-04T01:42:10.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.001+0000 7f08ff7fe640 1 --2- 172.21.15.77:0/3847739452 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09000cdac0 0x7f09000b3cd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f08f80097a0 tx=0x7f08f802b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c69f4e936f458d5d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:10.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.001+0000 7f08fdffb640 1 -- 172.21.15.77:0/3847739452 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f802f050 con 0x7f09000cdac0 2023-11-04T01:42:10.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.001+0000 7f08fdffb640 1 -- 172.21.15.77:0/3847739452 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f8031500 con 0x7f09000cdac0 2023-11-04T01:42:10.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.001+0000 7f08fdffb640 1 -- 172.21.15.77:0/3847739452 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f4001670 con 0x7f09000cdac0 2023-11-04T01:42:10.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.001+0000 7f09059a9640 1 -- 172.21.15.77:0/3847739452 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09000cdac0 msgr2=0x7f09000b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.001+0000 7f09059a9640 1 --2- 172.21.15.77:0/3847739452 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09000cdac0 0x7f09000b3cd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f08f80097a0 tx=0x7f08f802b820 comp rx=0 tx=0).stop 2023-11-04T01:42:10.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.001+0000 7f09059a9640 1 -- 172.21.15.77:0/3847739452 shutdown_connections 2023-11-04T01:42:10.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.001+0000 7f09059a9640 1 --2- 172.21.15.77:0/3847739452 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09000cdac0 0x7f09000b3cd0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.001+0000 7f09059a9640 1 -- 172.21.15.77:0/3847739452 >> 172.21.15.77:0/3847739452 conn(0x7f090006ea20 msgr2=0x7f090006ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:10.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.001+0000 7f09059a9640 1 -- 172.21.15.77:0/3847739452 shutdown_connections 2023-11-04T01:42:10.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.001+0000 7f09059a9640 1 -- 172.21.15.77:0/3847739452 wait complete. 2023-11-04T01:42:10.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.002+0000 7f09059a9640 1 Processor -- start 2023-11-04T01:42:10.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.003+0000 7f09059a9640 1 -- start start 2023-11-04T01:42:10.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.003+0000 7f09059a9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09000b64c0 0x7f090006ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:10.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.003+0000 7f09059a9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09000cdac0 0x7f09000c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:10.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.003+0000 7f09059a9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f090015af20 0x7f090014fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:10.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.003+0000 7f09059a9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0900150da0 con 0x7f09000cdac0 2023-11-04T01:42:10.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.003+0000 7f09059a9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09000b43a0 con 0x7f09000b64c0 2023-11-04T01:42:10.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.003+0000 7f09059a9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09000b5c60 con 0x7f090015af20 2023-11-04T01:42:10.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.003+0000 7f08fe7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09000cdac0 0x7f09000c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:10.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.003+0000 7f08fe7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09000cdac0 0x7f09000c8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51990/0 (socket says 172.21.15.77:51990) 2023-11-04T01:42:10.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.003+0000 7f08fe7fc640 1 -- 172.21.15.77:0/84486399 learned_addr learned my addr 172.21.15.77:0/84486399 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:10.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.004+0000 7f08fe7fc640 1 -- 172.21.15.77:0/84486399 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f090015af20 msgr2=0x7f090014fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.004+0000 7f08feffd640 1 --2- 172.21.15.77:0/84486399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09000b64c0 0x7f090006ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:10.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.004+0000 7f08fe7fc640 1 --2- 172.21.15.77:0/84486399 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f090015af20 0x7f090014fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.004+0000 7f08fe7fc640 1 -- 172.21.15.77:0/84486399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09000b64c0 msgr2=0x7f090006ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.004+0000 7f08fe7fc640 1 --2- 172.21.15.77:0/84486399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09000b64c0 0x7f090006ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.004+0000 7f08fe7fc640 1 -- 172.21.15.77:0/84486399 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f8009400 con 0x7f09000cdac0 2023-11-04T01:42:10.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.004+0000 7f08fe7fc640 1 --2- 172.21.15.77:0/84486399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09000cdac0 0x7f09000c8680 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f08f400c750 tx=0x7f08f400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:10.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.004+0000 7f08e7fff640 1 -- 172.21.15.77:0/84486399 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f4005ad0 con 0x7f09000cdac0 2023-11-04T01:42:10.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.004+0000 7f08e7fff640 1 -- 172.21.15.77:0/84486399 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f4005c50 con 0x7f09000cdac0 2023-11-04T01:42:10.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.004+0000 7f08e7fff640 1 -- 172.21.15.77:0/84486399 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f4007070 con 0x7f09000cdac0 2023-11-04T01:42:10.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.004+0000 7f09059a9640 1 -- 172.21.15.77:0/84486399 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09000b5f40 con 0x7f09000cdac0 2023-11-04T01:42:10.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.004+0000 7f09059a9640 1 -- 172.21.15.77:0/84486399 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0900152bc0 con 0x7f09000cdac0 2023-11-04T01:42:10.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.005+0000 7f09059a9640 1 -- 172.21.15.77:0/84486399 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09000b4550 con 0x7f09000cdac0 2023-11-04T01:42:10.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.005+0000 7f08e7fff640 1 -- 172.21.15.77:0/84486399 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f08f40071d0 con 0x7f09000cdac0 2023-11-04T01:42:10.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.006+0000 7f08e7fff640 1 --2- 172.21.15.77:0/84486399 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f08ec06ae70 0x7f08ec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:10.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.006+0000 7f08e7fff640 1 -- 172.21.15.77:0/84486399 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f08f40896d0 con 0x7f09000cdac0 2023-11-04T01:42:10.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.006+0000 7f08feffd640 1 --2- 172.21.15.77:0/84486399 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f08ec06ae70 0x7f08ec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:10.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.006+0000 7f08feffd640 1 --2- 172.21.15.77:0/84486399 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f08ec06ae70 0x7f08ec06d330 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f08f0007fd0 tx=0x7f08f0009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:10.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.010+0000 7f08e7fff640 1 -- 172.21.15.77:0/84486399 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f09000b4550 con 0x7f09000cdac0 2023-11-04T01:42:10.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.179+0000 7f09059a9640 1 -- 172.21.15.77:0/84486399 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f090006d3d0 con 0x7f09000cdac0 2023-11-04T01:42:10.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.179+0000 7f08e7fff640 1 -- 172.21.15.77:0/84486399 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7f08f4054450 con 0x7f09000cdac0 2023-11-04T01:42:10.181 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:42:10.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.181+0000 7f09059a9640 1 -- 172.21.15.77:0/84486399 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f08ec06ae70 msgr2=0x7f08ec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.181+0000 7f09059a9640 1 --2- 172.21.15.77:0/84486399 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f08ec06ae70 0x7f08ec06d330 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f08f0007fd0 tx=0x7f08f0009040 comp rx=0 tx=0).stop 2023-11-04T01:42:10.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.181+0000 7f09059a9640 1 -- 172.21.15.77:0/84486399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09000cdac0 msgr2=0x7f09000c8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.181+0000 7f09059a9640 1 --2- 172.21.15.77:0/84486399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09000cdac0 0x7f09000c8680 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f08f400c750 tx=0x7f08f400cc10 comp rx=0 tx=0).stop 2023-11-04T01:42:10.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.181+0000 7f09059a9640 1 -- 172.21.15.77:0/84486399 shutdown_connections 2023-11-04T01:42:10.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.181+0000 7f09059a9640 1 --2- 172.21.15.77:0/84486399 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f08ec06ae70 0x7f08ec06d330 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.181+0000 7f09059a9640 1 --2- 172.21.15.77:0/84486399 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f090015af20 0x7f090014fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.181+0000 7f09059a9640 1 --2- 172.21.15.77:0/84486399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09000cdac0 0x7f09000c8680 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.181+0000 7f09059a9640 1 --2- 172.21.15.77:0/84486399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09000b64c0 0x7f090006ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.181+0000 7f09059a9640 1 -- 172.21.15.77:0/84486399 >> 172.21.15.77:0/84486399 conn(0x7f090006ea20 msgr2=0x7f09000cfc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:10.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.181+0000 7f09059a9640 1 -- 172.21.15.77:0/84486399 shutdown_connections 2023-11-04T01:42:10.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.181+0000 7f09059a9640 1 -- 172.21.15.77:0/84486399 wait complete. 2023-11-04T01:42:10.193 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:42:10.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.294+0000 7f039aa4f640 1 Processor -- start 2023-11-04T01:42:10.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.294+0000 7f039aa4f640 1 -- start start 2023-11-04T01:42:10.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.294+0000 7f039aa4f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f039415ad30 0x7f03940adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:10.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.294+0000 7f039aa4f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03940c3900 con 0x7f03940ad730 2023-11-04T01:42:10.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.294+0000 7f039aa4f640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03940c3be0 con 0x7f0394070e20 2023-11-04T01:42:10.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.294+0000 7f039aa4f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03940ae260 con 0x7f039415ad30 2023-11-04T01:42:10.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.295+0000 7f0393fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f039415ad30 0x7f03940adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:10.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.295+0000 7f0393fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f039415ad30 0x7f03940adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51996/0 (socket says 172.21.15.77:51996) 2023-11-04T01:42:10.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.295+0000 7f0393fff640 1 -- 172.21.15.77:0/4098960339 learned_addr learned my addr 172.21.15.77:0/4098960339 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:10.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.295+0000 7f03937fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f03940ad730 0x7f0394070710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55250/0 (socket says 172.21.15.77:55250) 2023-11-04T01:42:10.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.295+0000 7f0393fff640 1 -- 172.21.15.77:0/4098960339 >> v1:172.21.15.122:6789/0 conn(0x7f0394070e20 legacy=0x7f039415e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.295+0000 7f0393fff640 1 -- 172.21.15.77:0/4098960339 >> v1:172.21.15.77:6789/0 conn(0x7f03940ad730 legacy=0x7f0394070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.295+0000 7f0392ffd640 1 -- 172.21.15.77:0/4098960339 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 386302025 0 0) 0x7f03940c3900 con 0x7f03940ad730 2023-11-04T01:42:10.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.295+0000 7f0393fff640 1 -- 172.21.15.77:0/4098960339 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03940c3ec0 con 0x7f039415ad30 2023-11-04T01:42:10.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.296+0000 7f0393fff640 1 --2- 172.21.15.77:0/4098960339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f039415ad30 0x7f03940adc80 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f0384009870 tx=0x7f038402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40aa97587cc3105d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:10.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.296+0000 7f0392ffd640 1 -- 172.21.15.77:0/4098960339 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0384030860 con 0x7f039415ad30 2023-11-04T01:42:10.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.296+0000 7f0392ffd640 1 -- 172.21.15.77:0/4098960339 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03840309c0 con 0x7f039415ad30 2023-11-04T01:42:10.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.296+0000 7f0392ffd640 1 -- 172.21.15.77:0/4098960339 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0384030d50 con 0x7f039415ad30 2023-11-04T01:42:10.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.296+0000 7f039aa4f640 1 -- 172.21.15.77:0/4098960339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f039415ad30 msgr2=0x7f03940adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.296+0000 7f039aa4f640 1 --2- 172.21.15.77:0/4098960339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f039415ad30 0x7f03940adc80 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f0384009870 tx=0x7f038402b9a0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.296+0000 7f039aa4f640 1 -- 172.21.15.77:0/4098960339 shutdown_connections 2023-11-04T01:42:10.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.296+0000 7f039aa4f640 1 --2- 172.21.15.77:0/4098960339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f039415ad30 0x7f03940adc80 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.296+0000 7f039aa4f640 1 -- 172.21.15.77:0/4098960339 >> 172.21.15.77:0/4098960339 conn(0x7f03940ce950 msgr2=0x7f03940ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:10.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.296+0000 7f039aa4f640 1 -- 172.21.15.77:0/4098960339 shutdown_connections 2023-11-04T01:42:10.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.296+0000 7f039aa4f640 1 -- 172.21.15.77:0/4098960339 wait complete. 2023-11-04T01:42:10.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.297+0000 7f039aa4f640 1 Processor -- start 2023-11-04T01:42:10.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.298+0000 7f039aa4f640 1 -- start start 2023-11-04T01:42:10.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.298+0000 7f039aa4f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0394070e20 0x7f03941efcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:10.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.298+0000 7f039aa4f640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f03940ad730 0x7f039415d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:10.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.298+0000 7f039aa4f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f039415ad30 0x7f039415b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:10.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.298+0000 7f039aa4f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03940b3ce0 con 0x7f0394070e20 2023-11-04T01:42:10.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.298+0000 7f039aa4f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03940b30d0 con 0x7f039415ad30 2023-11-04T01:42:10.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.298+0000 7f039aa4f640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03940b33b0 con 0x7f03940ad730 2023-11-04T01:42:10.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.298+0000 7f0393fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0394070e20 0x7f03941efcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:10.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.298+0000 7f0393fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0394070e20 0x7f03941efcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52008/0 (socket says 172.21.15.77:52008) 2023-11-04T01:42:10.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.298+0000 7f0393fff640 1 -- 172.21.15.77:0/4049125738 learned_addr learned my addr 172.21.15.77:0/4049125738 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:10.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.299+0000 7f0393fff640 1 -- 172.21.15.77:0/4049125738 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f03940ad730 msgr2=0x7f039415d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.299+0000 7f0393fff640 1 --2- 172.21.15.77:0/4049125738 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f03940ad730 0x7f039415d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.299+0000 7f0393fff640 1 -- 172.21.15.77:0/4049125738 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f039415ad30 msgr2=0x7f039415b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.299+0000 7f0393fff640 1 --2- 172.21.15.77:0/4049125738 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f039415ad30 0x7f039415b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.299+0000 7f0393fff640 1 -- 172.21.15.77:0/4049125738 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03840094d0 con 0x7f0394070e20 2023-11-04T01:42:10.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.299+0000 7f0393fff640 1 --2- 172.21.15.77:0/4049125738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0394070e20 0x7f03941efcf0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f0384009870 tx=0x7f0384004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:10.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.299+0000 7f0390ff9640 1 -- 172.21.15.77:0/4049125738 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0384030810 con 0x7f0394070e20 2023-11-04T01:42:10.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.299+0000 7f0390ff9640 1 -- 172.21.15.77:0/4049125738 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0384039d90 con 0x7f0394070e20 2023-11-04T01:42:10.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.299+0000 7f039aa4f640 1 -- 172.21.15.77:0/4049125738 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03940b3690 con 0x7f0394070e20 2023-11-04T01:42:10.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.299+0000 7f0390ff9640 1 -- 172.21.15.77:0/4049125738 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0384043630 con 0x7f0394070e20 2023-11-04T01:42:10.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.299+0000 7f039aa4f640 1 -- 172.21.15.77:0/4049125738 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03941f0230 con 0x7f0394070e20 2023-11-04T01:42:10.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.300+0000 7f039aa4f640 1 -- 172.21.15.77:0/4049125738 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0394074290 con 0x7f0394070e20 2023-11-04T01:42:10.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.300+0000 7f0390ff9640 1 -- 172.21.15.77:0/4049125738 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f038404c3b0 con 0x7f0394070e20 2023-11-04T01:42:10.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.301+0000 7f0390ff9640 1 --2- 172.21.15.77:0/4049125738 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f038006ae70 0x7f038006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:10.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.301+0000 7f0390ff9640 1 -- 172.21.15.77:0/4049125738 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f03840abe70 con 0x7f0394070e20 2023-11-04T01:42:10.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.301+0000 7f03937fe640 1 --2- 172.21.15.77:0/4049125738 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f038006ae70 0x7f038006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:10.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.301+0000 7f03937fe640 1 --2- 172.21.15.77:0/4049125738 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f038006ae70 0x7f038006d330 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0388007fd0 tx=0x7f0388007920 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:10.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.305+0000 7f0390ff9640 1 -- 172.21.15.77:0/4049125738 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0384076d10 con 0x7f0394070e20 2023-11-04T01:42:10.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.471+0000 7f039aa4f640 1 -- 172.21.15.77:0/4049125738 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0394071970 con 0x7f0394070e20 2023-11-04T01:42:10.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.472+0000 7f0390ff9640 1 -- 172.21.15.77:0/4049125738 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0384048020 con 0x7f0394070e20 2023-11-04T01:42:10.474 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-04T01:42:10.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.474+0000 7f039aa4f640 1 -- 172.21.15.77:0/4049125738 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f038006ae70 msgr2=0x7f038006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.474+0000 7f039aa4f640 1 --2- 172.21.15.77:0/4049125738 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f038006ae70 0x7f038006d330 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0388007fd0 tx=0x7f0388007920 comp rx=0 tx=0).stop 2023-11-04T01:42:10.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.474+0000 7f039aa4f640 1 -- 172.21.15.77:0/4049125738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0394070e20 msgr2=0x7f03941efcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.474+0000 7f039aa4f640 1 --2- 172.21.15.77:0/4049125738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0394070e20 0x7f03941efcf0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f0384009870 tx=0x7f0384004730 comp rx=0 tx=0).stop 2023-11-04T01:42:10.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.474+0000 7f039aa4f640 1 -- 172.21.15.77:0/4049125738 shutdown_connections 2023-11-04T01:42:10.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.474+0000 7f039aa4f640 1 --2- 172.21.15.77:0/4049125738 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f038006ae70 0x7f038006d330 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.474+0000 7f039aa4f640 1 --2- 172.21.15.77:0/4049125738 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f039415ad30 0x7f039415b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.474+0000 7f039aa4f640 1 --2- 172.21.15.77:0/4049125738 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f03940ad730 0x7f039415d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.474+0000 7f039aa4f640 1 --2- 172.21.15.77:0/4049125738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0394070e20 0x7f03941efcf0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.474+0000 7f039aa4f640 1 -- 172.21.15.77:0/4049125738 >> 172.21.15.77:0/4049125738 conn(0x7f03940ce950 msgr2=0x7f039406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:10.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.474+0000 7f039aa4f640 1 -- 172.21.15.77:0/4049125738 shutdown_connections 2023-11-04T01:42:10.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.474+0000 7f039aa4f640 1 -- 172.21.15.77:0/4049125738 wait complete. 2023-11-04T01:42:10.487 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:10.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.586+0000 7f4019fe2640 1 Processor -- start 2023-11-04T01:42:10.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.586+0000 7f4019fe2640 1 -- start start 2023-11-04T01:42:10.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.587+0000 7f4019fe2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f40140cde60 0x7f401415d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:10.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.587+0000 7f4019fe2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f401415daa0 0x7f4014157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:10.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.587+0000 7f4019fe2640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f401415e000 con 0x7f40140ce240 2023-11-04T01:42:10.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.587+0000 7f4019fe2640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f401415e5c0 con 0x7f40140cde60 2023-11-04T01:42:10.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.587+0000 7f4019fe2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f401415e2e0 con 0x7f401415daa0 2023-11-04T01:42:10.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.587+0000 7f40137fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f40140cde60 0x7f401415d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:10.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.587+0000 7f4013fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f40140ce240 0x7f401406b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55254/0 (socket says 172.21.15.77:55254) 2023-11-04T01:42:10.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.587+0000 7f4013fff640 1 -- 172.21.15.77:0/2471488303 learned_addr learned my addr 172.21.15.77:0/2471488303 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:10.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.588+0000 7f4012ffd640 1 --2- 172.21.15.77:0/2471488303 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f401415daa0 0x7f4014157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:10.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.588+0000 7f40127fc640 1 -- 172.21.15.77:0/2471488303 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1147051506 0 0) 0x7f401415e000 con 0x7f40140ce240 2023-11-04T01:42:10.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.588+0000 7f40127fc640 1 -- 172.21.15.77:0/2471488303 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ffc003520 con 0x7f40140ce240 2023-11-04T01:42:10.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.588+0000 7f40137fe640 1 -- 172.21.15.77:0/2471488303 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f401415daa0 msgr2=0x7f4014157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:10.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.588+0000 7f40137fe640 1 --2- 172.21.15.77:0/2471488303 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f401415daa0 0x7f4014157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.588+0000 7f40137fe640 1 -- 172.21.15.77:0/2471488303 >> v1:172.21.15.77:6789/0 conn(0x7f40140ce240 legacy=0x7f401406b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.588+0000 7f40137fe640 1 -- 172.21.15.77:0/2471488303 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40140d1120 con 0x7f40140cde60 2023-11-04T01:42:10.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.588+0000 7f40137fe640 1 --2- 172.21.15.77:0/2471488303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40140cde60 0x7f401415d560 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f40040097a0 tx=0x7f400402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31843a08f9ec17b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:10.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.589+0000 7f40127fc640 1 -- 172.21.15.77:0/2471488303 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4004031830 con 0x7f40140cde60 2023-11-04T01:42:10.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.589+0000 7f40127fc640 1 -- 172.21.15.77:0/2471488303 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4004031990 con 0x7f40140cde60 2023-11-04T01:42:10.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.589+0000 7f40127fc640 1 -- 172.21.15.77:0/2471488303 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4004031d20 con 0x7f40140cde60 2023-11-04T01:42:10.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.589+0000 7f4019fe2640 1 -- 172.21.15.77:0/2471488303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40140cde60 msgr2=0x7f401415d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.589+0000 7f4019fe2640 1 --2- 172.21.15.77:0/2471488303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40140cde60 0x7f401415d560 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f40040097a0 tx=0x7f400402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.589+0000 7f4019fe2640 1 -- 172.21.15.77:0/2471488303 shutdown_connections 2023-11-04T01:42:10.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.589+0000 7f4019fe2640 1 --2- 172.21.15.77:0/2471488303 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f401415daa0 0x7f4014157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.589+0000 7f4019fe2640 1 --2- 172.21.15.77:0/2471488303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40140cde60 0x7f401415d560 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.589+0000 7f4019fe2640 1 -- 172.21.15.77:0/2471488303 >> 172.21.15.77:0/2471488303 conn(0x7f4014071f30 msgr2=0x7f40140cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:10.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.589+0000 7f4019fe2640 1 -- 172.21.15.77:0/2471488303 shutdown_connections 2023-11-04T01:42:10.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.589+0000 7f4019fe2640 1 -- 172.21.15.77:0/2471488303 wait complete. 2023-11-04T01:42:10.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.590+0000 7f4019fe2640 1 Processor -- start 2023-11-04T01:42:10.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.591+0000 7f4019fe2640 1 -- start start 2023-11-04T01:42:10.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.591+0000 7f4019fe2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f40140cde60 0x7f40141f23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:10.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.591+0000 7f4019fe2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40140ce240 0x7f4014148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:10.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.591+0000 7f4019fe2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f401415daa0 0x7f401415aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:10.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.591+0000 7f4019fe2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4014149f40 con 0x7f40140ce240 2023-11-04T01:42:10.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.591+0000 7f4019fe2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4014149980 con 0x7f401415daa0 2023-11-04T01:42:10.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.591+0000 7f4019fe2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4014149c60 con 0x7f40140cde60 2023-11-04T01:42:10.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.591+0000 7f4012ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40140ce240 0x7f4014148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:10.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.591+0000 7f4012ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40140ce240 0x7f4014148fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52014/0 (socket says 172.21.15.77:52014) 2023-11-04T01:42:10.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.591+0000 7f4012ffd640 1 -- 172.21.15.77:0/2577696891 learned_addr learned my addr 172.21.15.77:0/2577696891 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:10.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.592+0000 7f4012ffd640 1 -- 172.21.15.77:0/2577696891 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f40140cde60 msgr2=0x7f40141f23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.592+0000 7f4012ffd640 1 --2- 172.21.15.77:0/2577696891 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f40140cde60 0x7f40141f23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.592+0000 7f4012ffd640 1 -- 172.21.15.77:0/2577696891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f401415daa0 msgr2=0x7f401415aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.592+0000 7f4012ffd640 1 --2- 172.21.15.77:0/2577696891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f401415daa0 0x7f401415aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.592+0000 7f4012ffd640 1 -- 172.21.15.77:0/2577696891 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4004009400 con 0x7f40140ce240 2023-11-04T01:42:10.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.592+0000 7f4012ffd640 1 --2- 172.21.15.77:0/2577696891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40140ce240 0x7f4014148fb0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f400800e870 tx=0x7f400800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:10.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.592+0000 7f3ffbfff640 1 -- 172.21.15.77:0/2577696891 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40080094f0 con 0x7f40140ce240 2023-11-04T01:42:10.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.592+0000 7f3ffbfff640 1 -- 172.21.15.77:0/2577696891 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400800c940 con 0x7f40140ce240 2023-11-04T01:42:10.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.592+0000 7f4019fe2640 1 -- 172.21.15.77:0/2577696891 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40141470b0 con 0x7f40140ce240 2023-11-04T01:42:10.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.592+0000 7f3ffbfff640 1 -- 172.21.15.77:0/2577696891 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400800ccf0 con 0x7f40140ce240 2023-11-04T01:42:10.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.592+0000 7f4019fe2640 1 -- 172.21.15.77:0/2577696891 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40141494f0 con 0x7f40140ce240 2023-11-04T01:42:10.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.593+0000 7f4019fe2640 1 -- 172.21.15.77:0/2577696891 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f401415cfe0 con 0x7f40140ce240 2023-11-04T01:42:10.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.593+0000 7f3ffbfff640 1 -- 172.21.15.77:0/2577696891 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4008013470 con 0x7f40140ce240 2023-11-04T01:42:10.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.594+0000 7f3ffbfff640 1 --2- 172.21.15.77:0/2577696891 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f400006ae70 0x7f400006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:10.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.594+0000 7f3ffbfff640 1 -- 172.21.15.77:0/2577696891 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4008089d20 con 0x7f40140ce240 2023-11-04T01:42:10.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.594+0000 7f40137fe640 1 --2- 172.21.15.77:0/2577696891 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f400006ae70 0x7f400006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:10.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.594+0000 7f40137fe640 1 --2- 172.21.15.77:0/2577696891 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f400006ae70 0x7f400006d330 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4004036000 tx=0x7f4004030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:10.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.598+0000 7f3ffbfff640 1 -- 172.21.15.77:0/2577696891 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4008054b30 con 0x7f40140ce240 2023-11-04T01:42:10.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.797+0000 7f4019fe2640 1 -- 172.21.15.77:0/2577696891 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4014074290 con 0x7f40140ce240 2023-11-04T01:42:10.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.797+0000 7f3ffbfff640 1 -- 172.21.15.77:0/2577696891 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f4008017090 con 0x7f40140ce240 2023-11-04T01:42:10.800 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:10.800 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5458,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2636406417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2636406417},{"type":"v1","addr":"172.21.15.122:6836","nonce":2636406417}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5461,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/2931907615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":2931907615},{"type":"v1","addr":"172.21.15.122:6837","nonce":2931907615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5955,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1507226082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1507226082},{"type":"v1","addr":"172.21.15.77:6833","nonce":1507226082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:41:53.409913+0000","modified":"2023-11-04T01:41:55.404636+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5958},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5958":{"gid":5958,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6835/1237968770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1237968770},{"type":"v1","addr":"172.21.15.77:6835","nonce":1237968770}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-04T01:42:10.800 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 22 2023-11-04T01:42:10.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.799+0000 7f4019fe2640 1 -- 172.21.15.77:0/2577696891 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f400006ae70 msgr2=0x7f400006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.799+0000 7f4019fe2640 1 --2- 172.21.15.77:0/2577696891 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f400006ae70 0x7f400006d330 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4004036000 tx=0x7f4004030000 comp rx=0 tx=0).stop 2023-11-04T01:42:10.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.799+0000 7f4019fe2640 1 -- 172.21.15.77:0/2577696891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40140ce240 msgr2=0x7f4014148fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.799+0000 7f4019fe2640 1 --2- 172.21.15.77:0/2577696891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40140ce240 0x7f4014148fb0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f400800e870 tx=0x7f400800ed30 comp rx=0 tx=0).stop 2023-11-04T01:42:10.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.799+0000 7f4019fe2640 1 -- 172.21.15.77:0/2577696891 shutdown_connections 2023-11-04T01:42:10.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.799+0000 7f4019fe2640 1 --2- 172.21.15.77:0/2577696891 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f400006ae70 0x7f400006d330 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.799+0000 7f4019fe2640 1 --2- 172.21.15.77:0/2577696891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f401415daa0 0x7f401415aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.799+0000 7f4019fe2640 1 --2- 172.21.15.77:0/2577696891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40140ce240 0x7f4014148fb0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.799+0000 7f4019fe2640 1 --2- 172.21.15.77:0/2577696891 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f40140cde60 0x7f40141f23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.799+0000 7f4019fe2640 1 -- 172.21.15.77:0/2577696891 >> 172.21.15.77:0/2577696891 conn(0x7f4014071f30 msgr2=0x7f40140c8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:10.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.800+0000 7f4019fe2640 1 -- 172.21.15.77:0/2577696891 shutdown_connections 2023-11-04T01:42:10.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.800+0000 7f4019fe2640 1 -- 172.21.15.77:0/2577696891 wait complete. 2023-11-04T01:42:10.812 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:10.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.910+0000 7ff1402c9640 1 Processor -- start 2023-11-04T01:42:10.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.910+0000 7ff1402c9640 1 -- start start 2023-11-04T01:42:10.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.911+0000 7ff1402c9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff13815ce70 0x7ff13806d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:10.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.911+0000 7ff1402c9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff13815d250 0x7ff1380c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:10.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.911+0000 7ff1402c9640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff13806a120 con 0x7ff1380c9d70 2023-11-04T01:42:10.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.911+0000 7ff1402c9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1380cdc10 con 0x7ff13815ce70 2023-11-04T01:42:10.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.911+0000 7ff1402c9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13806def0 con 0x7ff13815d250 2023-11-04T01:42:10.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.911+0000 7ff13e065640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff13815ce70 0x7ff13806d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:10.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.911+0000 7ff13e065640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff13815ce70 0x7ff13806d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52018/0 (socket says 172.21.15.77:52018) 2023-11-04T01:42:10.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.911+0000 7ff13e065640 1 -- 172.21.15.77:0/3073803516 learned_addr learned my addr 172.21.15.77:0/3073803516 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:10.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.911+0000 7ff13d864640 1 --2- 172.21.15.77:0/3073803516 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff13815d250 0x7ff1380c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:10.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.911+0000 7ff13e065640 1 -- 172.21.15.77:0/3073803516 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff13815d250 msgr2=0x7ff1380c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:10.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.911+0000 7ff13e065640 1 --2- 172.21.15.77:0/3073803516 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff13815d250 0x7ff1380c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.911+0000 7ff13e065640 1 -- 172.21.15.77:0/3073803516 >> v1:172.21.15.122:6789/0 conn(0x7ff1380c9d70 legacy=0x7ff1380ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.911+0000 7ff13e065640 1 -- 172.21.15.77:0/3073803516 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13806a370 con 0x7ff13815ce70 2023-11-04T01:42:10.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.912+0000 7ff13e065640 1 --2- 172.21.15.77:0/3073803516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff13815ce70 0x7ff13806d9b0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7ff128009870 tx=0x7ff12802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc14a730ef893547 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:10.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.912+0000 7ff13d063640 1 -- 172.21.15.77:0/3073803516 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff128030840 con 0x7ff13815ce70 2023-11-04T01:42:10.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.912+0000 7ff13d063640 1 -- 172.21.15.77:0/3073803516 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1280309a0 con 0x7ff13815ce70 2023-11-04T01:42:10.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.912+0000 7ff13d063640 1 -- 172.21.15.77:0/3073803516 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff128030d30 con 0x7ff13815ce70 2023-11-04T01:42:10.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.912+0000 7ff1402c9640 1 -- 172.21.15.77:0/3073803516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff13815ce70 msgr2=0x7ff13806d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.912+0000 7ff1402c9640 1 --2- 172.21.15.77:0/3073803516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff13815ce70 0x7ff13806d9b0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7ff128009870 tx=0x7ff12802b980 comp rx=0 tx=0).stop 2023-11-04T01:42:10.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.913+0000 7ff1402c9640 1 -- 172.21.15.77:0/3073803516 shutdown_connections 2023-11-04T01:42:10.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.913+0000 7ff1402c9640 1 --2- 172.21.15.77:0/3073803516 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff13815d250 0x7ff1380c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.913+0000 7ff1402c9640 1 --2- 172.21.15.77:0/3073803516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff13815ce70 0x7ff13806d9b0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.913+0000 7ff1402c9640 1 -- 172.21.15.77:0/3073803516 >> 172.21.15.77:0/3073803516 conn(0x7ff1380b0cd0 msgr2=0x7ff1380b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:10.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.913+0000 7ff1402c9640 1 -- 172.21.15.77:0/3073803516 shutdown_connections 2023-11-04T01:42:10.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.913+0000 7ff1402c9640 1 -- 172.21.15.77:0/3073803516 wait complete. 2023-11-04T01:42:10.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.914+0000 7ff1402c9640 1 Processor -- start 2023-11-04T01:42:10.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.914+0000 7ff1402c9640 1 -- start start 2023-11-04T01:42:10.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.914+0000 7ff1402c9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff13815ce70 0x7ff1380c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:10.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.914+0000 7ff1402c9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff13815d250 0x7ff138153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:10.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.914+0000 7ff1402c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1380c62b0 0x7ff13806b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:10.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.914+0000 7ff1402c9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1381f3450 con 0x7ff1380c62b0 2023-11-04T01:42:10.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.914+0000 7ff1402c9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1380c6820 con 0x7ff13815d250 2023-11-04T01:42:10.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.914+0000 7ff1402c9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1381f2e00 con 0x7ff13815ce70 2023-11-04T01:42:10.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.915+0000 7ff13e866640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1380c62b0 0x7ff13806b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:10.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.915+0000 7ff13e866640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1380c62b0 0x7ff13806b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52030/0 (socket says 172.21.15.77:52030) 2023-11-04T01:42:10.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.915+0000 7ff13e866640 1 -- 172.21.15.77:0/1583395836 learned_addr learned my addr 172.21.15.77:0/1583395836 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:10.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.915+0000 7ff13d864640 1 --2- 172.21.15.77:0/1583395836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff13815d250 0x7ff138153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:10.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.915+0000 7ff13e866640 1 -- 172.21.15.77:0/1583395836 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff13815ce70 msgr2=0x7ff1380c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.915+0000 7ff13e866640 1 --2- 172.21.15.77:0/1583395836 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff13815ce70 0x7ff1380c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.915+0000 7ff13e866640 1 -- 172.21.15.77:0/1583395836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff13815d250 msgr2=0x7ff138153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.915+0000 7ff13e866640 1 --2- 172.21.15.77:0/1583395836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff13815d250 0x7ff138153fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.915+0000 7ff13e866640 1 -- 172.21.15.77:0/1583395836 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1280094d0 con 0x7ff1380c62b0 2023-11-04T01:42:10.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.915+0000 7ff13d864640 1 --2- 172.21.15.77:0/1583395836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff13815d250 0x7ff138153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:10.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.915+0000 7ff13e866640 1 --2- 172.21.15.77:0/1583395836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1380c62b0 0x7ff13806b030 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7ff13000c7a0 tx=0x7ff13000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:10.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.915+0000 7ff12effd640 1 -- 172.21.15.77:0/1583395836 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff130003b70 con 0x7ff1380c62b0 2023-11-04T01:42:10.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.915+0000 7ff12effd640 1 -- 172.21.15.77:0/1583395836 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff130003cf0 con 0x7ff1380c62b0 2023-11-04T01:42:10.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.915+0000 7ff12effd640 1 -- 172.21.15.77:0/1583395836 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff130003ea0 con 0x7ff1380c62b0 2023-11-04T01:42:10.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.915+0000 7ff1402c9640 1 -- 172.21.15.77:0/1583395836 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1381f30e0 con 0x7ff1380c62b0 2023-11-04T01:42:10.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.915+0000 7ff1402c9640 1 -- 172.21.15.77:0/1583395836 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1380c9090 con 0x7ff1380c62b0 2023-11-04T01:42:10.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.916+0000 7ff1402c9640 1 -- 172.21.15.77:0/1583395836 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1381f2c30 con 0x7ff1380c62b0 2023-11-04T01:42:10.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.917+0000 7ff12effd640 1 -- 172.21.15.77:0/1583395836 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff13000aa90 con 0x7ff1380c62b0 2023-11-04T01:42:10.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.917+0000 7ff12effd640 1 --2- 172.21.15.77:0/1583395836 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff11c06aea0 0x7ff11c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:10.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.917+0000 7ff12effd640 1 -- 172.21.15.77:0/1583395836 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff1300896d0 con 0x7ff1380c62b0 2023-11-04T01:42:10.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.917+0000 7ff13e065640 1 --2- 172.21.15.77:0/1583395836 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff11c06aea0 0x7ff11c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:10.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.918+0000 7ff13e065640 1 --2- 172.21.15.77:0/1583395836 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff11c06aea0 0x7ff11c06d360 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff128036000 tx=0x7ff12803b040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:10.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:10.921+0000 7ff12effd640 1 -- 172.21.15.77:0/1583395836 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff1300544e0 con 0x7ff1380c62b0 2023-11-04T01:42:11.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.088+0000 7ff1402c9640 1 -- 172.21.15.77:0/1583395836 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff138074290 con 0x7ff1380c62b0 2023-11-04T01:42:11.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.089+0000 7ff12effd640 1 -- 172.21.15.77:0/1583395836 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+18511 (secure 0 0 0) 0x7ff130057b00 con 0x7ff1380c62b0 2023-11-04T01:42:11.091 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:11.092 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":54,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:41:55.075378+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:41:51.914855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-04T01:41:52.371167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:11.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.092+0000 7ff1402c9640 1 -- 172.21.15.77:0/1583395836 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff11c06aea0 msgr2=0x7ff11c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:11.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.092+0000 7ff1402c9640 1 --2- 172.21.15.77:0/1583395836 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff11c06aea0 0x7ff11c06d360 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff128036000 tx=0x7ff12803b040 comp rx=0 tx=0).stop 2023-11-04T01:42:11.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.092+0000 7ff1402c9640 1 -- 172.21.15.77:0/1583395836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1380c62b0 msgr2=0x7ff13806b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:11.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.092+0000 7ff1402c9640 1 --2- 172.21.15.77:0/1583395836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1380c62b0 0x7ff13806b030 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7ff13000c7a0 tx=0x7ff13000cc60 comp rx=0 tx=0).stop 2023-11-04T01:42:11.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.092+0000 7ff1402c9640 1 -- 172.21.15.77:0/1583395836 shutdown_connections 2023-11-04T01:42:11.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.092+0000 7ff1402c9640 1 --2- 172.21.15.77:0/1583395836 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff11c06aea0 0x7ff11c06d360 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.092+0000 7ff1402c9640 1 --2- 172.21.15.77:0/1583395836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1380c62b0 0x7ff13806b030 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.092+0000 7ff1402c9640 1 --2- 172.21.15.77:0/1583395836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff13815d250 0x7ff138153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.092+0000 7ff1402c9640 1 --2- 172.21.15.77:0/1583395836 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff13815ce70 0x7ff1380c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.092+0000 7ff1402c9640 1 -- 172.21.15.77:0/1583395836 >> 172.21.15.77:0/1583395836 conn(0x7ff1380b0cd0 msgr2=0x7ff1381e8700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:11.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.092+0000 7ff1402c9640 1 -- 172.21.15.77:0/1583395836 shutdown_connections 2023-11-04T01:42:11.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.092+0000 7ff1402c9640 1 -- 172.21.15.77:0/1583395836 wait complete. 2023-11-04T01:42:11.104 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-04T01:42:11.105 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:11.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.203+0000 7f70c04d4640 1 Processor -- start 2023-11-04T01:42:11.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.203+0000 7f70c04d4640 1 -- start start 2023-11-04T01:42:11.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.204+0000 7f70c04d4640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70b815ce60 0x7f70b806b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:11.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.204+0000 7f70c04d4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f70b806bd30 0x7f70b8160b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:11.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.204+0000 7f70c04d4640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f70b8161050 0x7f70b80cf160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:11.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.204+0000 7f70c04d4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b80cbde0 con 0x7f70b806bd30 2023-11-04T01:42:11.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.204+0000 7f70c04d4640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b81615d0 con 0x7f70b8161050 2023-11-04T01:42:11.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.204+0000 7f70c04d4640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b81618b0 con 0x7f70b815ce60 2023-11-04T01:42:11.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.204+0000 7f70bda6f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f70b806bd30 0x7f70b8160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:11.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.204+0000 7f70bda6f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f70b806bd30 0x7f70b8160b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52042/0 (socket says 172.21.15.77:52042) 2023-11-04T01:42:11.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.204+0000 7f70bda6f640 1 -- 172.21.15.77:0/334397888 learned_addr learned my addr 172.21.15.77:0/334397888 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:11.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.204+0000 7f70bea71640 1 --2- 172.21.15.77:0/334397888 >> v2:172.21.15.122:3300/0 conn(0x7f70b8161050 0x7f70b80cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:11.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.204+0000 7f70be270640 1 --2- 172.21.15.77:0/334397888 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70b815ce60 0x7f70b806b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:11.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.204+0000 7f70bda6f640 1 -- 172.21.15.77:0/334397888 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70b815ce60 msgr2=0x7f70b806b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:11.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.204+0000 7f70bda6f640 1 --2- 172.21.15.77:0/334397888 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70b815ce60 0x7f70b806b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.204+0000 7f70bda6f640 1 -- 172.21.15.77:0/334397888 >> v2:172.21.15.122:3300/0 conn(0x7f70b8161050 msgr2=0x7f70b80cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:11.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.204+0000 7f70bda6f640 1 --2- 172.21.15.77:0/334397888 >> v2:172.21.15.122:3300/0 conn(0x7f70b8161050 0x7f70b80cf160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.204+0000 7f70bda6f640 1 -- 172.21.15.77:0/334397888 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b80cba00 con 0x7f70b806bd30 2023-11-04T01:42:11.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.205+0000 7f70bda6f640 1 --2- 172.21.15.77:0/334397888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70b806bd30 0x7f70b8160b10 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f70b80b05d0 tx=0x7f70a802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f5e473b2fb52010 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:11.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.205+0000 7f70bd26e640 1 -- 172.21.15.77:0/334397888 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a8031870 con 0x7f70b806bd30 2023-11-04T01:42:11.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.205+0000 7f70bd26e640 1 -- 172.21.15.77:0/334397888 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a80319d0 con 0x7f70b806bd30 2023-11-04T01:42:11.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.205+0000 7f70bd26e640 1 -- 172.21.15.77:0/334397888 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a8031d60 con 0x7f70b806bd30 2023-11-04T01:42:11.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.205+0000 7f70c04d4640 1 -- 172.21.15.77:0/334397888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70b806bd30 msgr2=0x7f70b8160b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:11.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.205+0000 7f70c04d4640 1 --2- 172.21.15.77:0/334397888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70b806bd30 0x7f70b8160b10 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f70b80b05d0 tx=0x7f70a802b910 comp rx=0 tx=0).stop 2023-11-04T01:42:11.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.206+0000 7f70c04d4640 1 -- 172.21.15.77:0/334397888 shutdown_connections 2023-11-04T01:42:11.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.206+0000 7f70c04d4640 1 --2- 172.21.15.77:0/334397888 >> v2:172.21.15.122:3300/0 conn(0x7f70b8161050 0x7f70b80cf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.206+0000 7f70c04d4640 1 --2- 172.21.15.77:0/334397888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70b806bd30 0x7f70b8160b10 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.206+0000 7f70c04d4640 1 --2- 172.21.15.77:0/334397888 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70b815ce60 0x7f70b806b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.206+0000 7f70c04d4640 1 -- 172.21.15.77:0/334397888 >> 172.21.15.77:0/334397888 conn(0x7f70b806ea90 msgr2=0x7f70b806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:11.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.206+0000 7f70c04d4640 1 -- 172.21.15.77:0/334397888 shutdown_connections 2023-11-04T01:42:11.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.206+0000 7f70c04d4640 1 -- 172.21.15.77:0/334397888 wait complete. 2023-11-04T01:42:11.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.207+0000 7f70c04d4640 1 Processor -- start 2023-11-04T01:42:11.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.207+0000 7f70c04d4640 1 -- start start 2023-11-04T01:42:11.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.207+0000 7f70c04d4640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70b815ce60 0x7f70b80b63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:11.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.207+0000 7f70c04d4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70b8161050 0x7f70b814ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:11.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.207+0000 7f70c04d4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70b8157140 0x7f70b80b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:11.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.207+0000 7f70c04d4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b80b5a10 con 0x7f70b8157140 2023-11-04T01:42:11.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.207+0000 7f70c04d4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b80b41a0 con 0x7f70b8161050 2023-11-04T01:42:11.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.207+0000 7f70c04d4640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b80b5c60 con 0x7f70b815ce60 2023-11-04T01:42:11.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.207+0000 7f70bea71640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70b8157140 0x7f70b80b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:11.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.208+0000 7f70bea71640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70b8157140 0x7f70b80b4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52046/0 (socket says 172.21.15.77:52046) 2023-11-04T01:42:11.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.208+0000 7f70bea71640 1 -- 172.21.15.77:0/2320805867 learned_addr learned my addr 172.21.15.77:0/2320805867 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:11.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.208+0000 7f70be270640 1 --2- 172.21.15.77:0/2320805867 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70b815ce60 0x7f70b80b63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:11.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.208+0000 7f70bea71640 1 -- 172.21.15.77:0/2320805867 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70b815ce60 msgr2=0x7f70b80b63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:11.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.208+0000 7f70bea71640 1 --2- 172.21.15.77:0/2320805867 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70b815ce60 0x7f70b80b63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.208+0000 7f70bea71640 1 -- 172.21.15.77:0/2320805867 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70b8161050 msgr2=0x7f70b814ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:11.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.208+0000 7f70bea71640 1 --2- 172.21.15.77:0/2320805867 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70b8161050 0x7f70b814ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.208+0000 7f70bea71640 1 -- 172.21.15.77:0/2320805867 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a80094d0 con 0x7f70b8157140 2023-11-04T01:42:11.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.208+0000 7f70bea71640 1 --2- 172.21.15.77:0/2320805867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70b8157140 0x7f70b80b4c20 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f70b0007e60 tx=0x7f70b000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:11.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.208+0000 7f70aeffd640 1 -- 172.21.15.77:0/2320805867 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b0014620 con 0x7f70b8157140 2023-11-04T01:42:11.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.208+0000 7f70aeffd640 1 -- 172.21.15.77:0/2320805867 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b00147a0 con 0x7f70b8157140 2023-11-04T01:42:11.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.208+0000 7f70c04d4640 1 -- 172.21.15.77:0/2320805867 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b80b5f40 con 0x7f70b8157140 2023-11-04T01:42:11.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.208+0000 7f70aeffd640 1 -- 172.21.15.77:0/2320805867 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b0014b50 con 0x7f70b8157140 2023-11-04T01:42:11.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.208+0000 7f70c04d4640 1 -- 172.21.15.77:0/2320805867 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b80b4700 con 0x7f70b8157140 2023-11-04T01:42:11.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.209+0000 7f70c04d4640 1 -- 172.21.15.77:0/2320805867 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b80b48f0 con 0x7f70b8157140 2023-11-04T01:42:11.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.209+0000 7f70aeffd640 1 -- 172.21.15.77:0/2320805867 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f70b0014cb0 con 0x7f70b8157140 2023-11-04T01:42:11.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.210+0000 7f70aeffd640 1 --2- 172.21.15.77:0/2320805867 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f709c06aea0 0x7f709c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:11.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.210+0000 7f70aeffd640 1 -- 172.21.15.77:0/2320805867 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f70b008a250 con 0x7f70b8157140 2023-11-04T01:42:11.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.210+0000 7f70be270640 1 --2- 172.21.15.77:0/2320805867 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f709c06aea0 0x7f709c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:11.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.210+0000 7f70be270640 1 --2- 172.21.15.77:0/2320805867 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f709c06aea0 0x7f709c06d360 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f70b4006fd0 tx=0x7f70b4008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:11.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.214+0000 7f70aeffd640 1 -- 172.21.15.77:0/2320805867 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f70b0055060 con 0x7f70b8157140 2023-11-04T01:42:11.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.415+0000 7f70c04d4640 1 -- 172.21.15.77:0/2320805867 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70b8074290 con 0x7f70b8157140 2023-11-04T01:42:11.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.415+0000 7f70aeffd640 1 -- 172.21.15.77:0/2320805867 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f70b0058680 con 0x7f70b8157140 2023-11-04T01:42:11.417 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:11.418 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5458,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2636406417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2636406417},{"type":"v1","addr":"172.21.15.122:6836","nonce":2636406417}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5461,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/2931907615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":2931907615},{"type":"v1","addr":"172.21.15.122:6837","nonce":2931907615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5955,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1507226082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1507226082},{"type":"v1","addr":"172.21.15.77:6833","nonce":1507226082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:41:53.409913+0000","modified":"2023-11-04T01:41:55.404636+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5958},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5958":{"gid":5958,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6835/1237968770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1237968770},{"type":"v1","addr":"172.21.15.77:6835","nonce":1237968770}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-04T01:42:11.418 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 22 2023-11-04T01:42:11.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.417+0000 7f70c04d4640 1 -- 172.21.15.77:0/2320805867 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f709c06aea0 msgr2=0x7f709c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:11.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.417+0000 7f70c04d4640 1 --2- 172.21.15.77:0/2320805867 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f709c06aea0 0x7f709c06d360 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f70b4006fd0 tx=0x7f70b4008040 comp rx=0 tx=0).stop 2023-11-04T01:42:11.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.417+0000 7f70c04d4640 1 -- 172.21.15.77:0/2320805867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70b8157140 msgr2=0x7f70b80b4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:11.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.417+0000 7f70c04d4640 1 --2- 172.21.15.77:0/2320805867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70b8157140 0x7f70b80b4c20 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f70b0007e60 tx=0x7f70b000e4b0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.417+0000 7f70c04d4640 1 -- 172.21.15.77:0/2320805867 shutdown_connections 2023-11-04T01:42:11.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.417+0000 7f70c04d4640 1 --2- 172.21.15.77:0/2320805867 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f709c06aea0 0x7f709c06d360 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.417+0000 7f70c04d4640 1 --2- 172.21.15.77:0/2320805867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70b8157140 0x7f70b80b4c20 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.417+0000 7f70c04d4640 1 --2- 172.21.15.77:0/2320805867 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70b8161050 0x7f70b814ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.417+0000 7f70c04d4640 1 --2- 172.21.15.77:0/2320805867 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70b815ce60 0x7f70b80b63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.417+0000 7f70c04d4640 1 -- 172.21.15.77:0/2320805867 >> 172.21.15.77:0/2320805867 conn(0x7f70b806ea90 msgr2=0x7f70b80c58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:11.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.417+0000 7f70c04d4640 1 -- 172.21.15.77:0/2320805867 shutdown_connections 2023-11-04T01:42:11.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.417+0000 7f70c04d4640 1 -- 172.21.15.77:0/2320805867 wait complete. 2023-11-04T01:42:11.430 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:11.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.528+0000 7f6ae249b640 1 Processor -- start 2023-11-04T01:42:11.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.528+0000 7f6ae249b640 1 -- start start 2023-11-04T01:42:11.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.529+0000 7f6ae249b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6adc15ce60 0x7f6adc06b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:11.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.529+0000 7f6ae249b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6adc06bd30 0x7f6adc160b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:11.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.529+0000 7f6ae249b640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6adc1615d0 con 0x7f6adc161050 2023-11-04T01:42:11.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.529+0000 7f6ae249b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6adc0cbde0 con 0x7f6adc06bd30 2023-11-04T01:42:11.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.529+0000 7f6ae249b640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6adc1618b0 con 0x7f6adc15ce60 2023-11-04T01:42:11.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.529+0000 7f6adb7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6adc06bd30 0x7f6adc160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:11.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.529+0000 7f6adb7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6adc06bd30 0x7f6adc160b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52048/0 (socket says 172.21.15.77:52048) 2023-11-04T01:42:11.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.529+0000 7f6adb7fe640 1 -- 172.21.15.77:0/1870607765 learned_addr learned my addr 172.21.15.77:0/1870607765 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:11.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.529+0000 7f6adbfff640 1 --2- 172.21.15.77:0/1870607765 >> v2:172.21.15.122:3300/0 conn(0x7f6adc15ce60 0x7f6adc06b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:11.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.529+0000 7f6adb7fe640 1 -- 172.21.15.77:0/1870607765 >> v2:172.21.15.122:3300/0 conn(0x7f6adc15ce60 msgr2=0x7f6adc06b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:11.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.529+0000 7f6adb7fe640 1 --2- 172.21.15.77:0/1870607765 >> v2:172.21.15.122:3300/0 conn(0x7f6adc15ce60 0x7f6adc06b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.529+0000 7f6adb7fe640 1 -- 172.21.15.77:0/1870607765 >> v1:172.21.15.122:6789/0 conn(0x7f6adc161050 legacy=0x7f6adc0cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:11.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.529+0000 7f6adb7fe640 1 -- 172.21.15.77:0/1870607765 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6adc0cba00 con 0x7f6adc06bd30 2023-11-04T01:42:11.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.530+0000 7f6adb7fe640 1 --2- 172.21.15.77:0/1870607765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6adc06bd30 0x7f6adc160b10 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f6adc06e960 tx=0x7f6ad002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de47b231f0ec8cf2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:11.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.530+0000 7f6adaffd640 1 -- 172.21.15.77:0/1870607765 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0031870 con 0x7f6adc06bd30 2023-11-04T01:42:11.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.530+0000 7f6adaffd640 1 -- 172.21.15.77:0/1870607765 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad00319d0 con 0x7f6adc06bd30 2023-11-04T01:42:11.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.530+0000 7f6adaffd640 1 -- 172.21.15.77:0/1870607765 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0031d60 con 0x7f6adc06bd30 2023-11-04T01:42:11.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.530+0000 7f6ae249b640 1 -- 172.21.15.77:0/1870607765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6adc06bd30 msgr2=0x7f6adc160b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:11.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.530+0000 7f6ae249b640 1 --2- 172.21.15.77:0/1870607765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6adc06bd30 0x7f6adc160b10 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f6adc06e960 tx=0x7f6ad002b910 comp rx=0 tx=0).stop 2023-11-04T01:42:11.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.530+0000 7f6ae249b640 1 -- 172.21.15.77:0/1870607765 shutdown_connections 2023-11-04T01:42:11.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.530+0000 7f6ae249b640 1 --2- 172.21.15.77:0/1870607765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6adc06bd30 0x7f6adc160b10 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.530+0000 7f6ae249b640 1 --2- 172.21.15.77:0/1870607765 >> v2:172.21.15.122:3300/0 conn(0x7f6adc15ce60 0x7f6adc06b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.530+0000 7f6ae249b640 1 -- 172.21.15.77:0/1870607765 >> 172.21.15.77:0/1870607765 conn(0x7f6adc06ea90 msgr2=0x7f6adc06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:11.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.530+0000 7f6ae249b640 1 -- 172.21.15.77:0/1870607765 shutdown_connections 2023-11-04T01:42:11.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.530+0000 7f6ae249b640 1 -- 172.21.15.77:0/1870607765 wait complete. 2023-11-04T01:42:11.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.532+0000 7f6ae249b640 1 Processor -- start 2023-11-04T01:42:11.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.532+0000 7f6ae249b640 1 -- start start 2023-11-04T01:42:11.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.532+0000 7f6ae249b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6adc15ce60 0x7f6adc15a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:11.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.532+0000 7f6ae249b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6adc161050 0x7f6adc0cc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:11.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.532+0000 7f6ae249b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6adc0cc740 0x7f6adc0c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:11.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.532+0000 7f6ae249b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc0ccbd0 con 0x7f6adc0cc740 2023-11-04T01:42:11.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.532+0000 7f6ae249b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc1f2ae0 con 0x7f6adc161050 2023-11-04T01:42:11.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.532+0000 7f6ae249b640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc1f2cf0 con 0x7f6adc15ce60 2023-11-04T01:42:11.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.533+0000 7f6ae0a38640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6adc0cc740 0x7f6adc0c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:11.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.533+0000 7f6ae0a38640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6adc0cc740 0x7f6adc0c95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52060/0 (socket says 172.21.15.77:52060) 2023-11-04T01:42:11.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.533+0000 7f6ae0a38640 1 -- 172.21.15.77:0/3568468118 learned_addr learned my addr 172.21.15.77:0/3568468118 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:11.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.533+0000 7f6adb7fe640 1 --2- 172.21.15.77:0/3568468118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6adc161050 0x7f6adc0cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:11.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.533+0000 7f6adbfff640 1 --2- 172.21.15.77:0/3568468118 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6adc15ce60 0x7f6adc15a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:11.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.533+0000 7f6ae0a38640 1 -- 172.21.15.77:0/3568468118 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6adc15ce60 msgr2=0x7f6adc15a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:11.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.533+0000 7f6ae0a38640 1 --2- 172.21.15.77:0/3568468118 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6adc15ce60 0x7f6adc15a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.533+0000 7f6ae0a38640 1 -- 172.21.15.77:0/3568468118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6adc161050 msgr2=0x7f6adc0cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:11.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.533+0000 7f6ae0a38640 1 --2- 172.21.15.77:0/3568468118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6adc161050 0x7f6adc0cc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.533+0000 7f6ae0a38640 1 -- 172.21.15.77:0/3568468118 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad00094d0 con 0x7f6adc0cc740 2023-11-04T01:42:11.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.533+0000 7f6ae0a38640 1 --2- 172.21.15.77:0/3568468118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6adc0cc740 0x7f6adc0c95b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f6ad400c780 tx=0x7f6ad400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:11.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.533+0000 7f6ad8ff9640 1 -- 172.21.15.77:0/3568468118 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4004b60 con 0x7f6adc0cc740 2023-11-04T01:42:11.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.533+0000 7f6ad8ff9640 1 -- 172.21.15.77:0/3568468118 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad400ce90 con 0x7f6adc0cc740 2023-11-04T01:42:11.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.533+0000 7f6ae249b640 1 -- 172.21.15.77:0/3568468118 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6adc1f2fd0 con 0x7f6adc0cc740 2023-11-04T01:42:11.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.533+0000 7f6ad8ff9640 1 -- 172.21.15.77:0/3568468118 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad400a850 con 0x7f6adc0cc740 2023-11-04T01:42:11.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.533+0000 7f6ae249b640 1 -- 172.21.15.77:0/3568468118 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6adc1f3590 con 0x7f6adc0cc740 2023-11-04T01:42:11.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.534+0000 7f6ae249b640 1 -- 172.21.15.77:0/3568468118 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6adc074290 con 0x7f6adc0cc740 2023-11-04T01:42:11.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.535+0000 7f6ad8ff9640 1 -- 172.21.15.77:0/3568468118 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6ad400a9b0 con 0x7f6adc0cc740 2023-11-04T01:42:11.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.535+0000 7f6ad8ff9640 1 --2- 172.21.15.77:0/3568468118 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6ac806ae70 0x7f6ac806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:11.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.535+0000 7f6ad8ff9640 1 -- 172.21.15.77:0/3568468118 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6ad40898c0 con 0x7f6adc0cc740 2023-11-04T01:42:11.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.535+0000 7f6adbfff640 1 --2- 172.21.15.77:0/3568468118 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6ac806ae70 0x7f6ac806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:11.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.536+0000 7f6adbfff640 1 --2- 172.21.15.77:0/3568468118 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6ac806ae70 0x7f6ac806d330 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6acc006fd0 tx=0x7f6acc008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:11.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.539+0000 7f6ad8ff9640 1 -- 172.21.15.77:0/3568468118 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6ad4054780 con 0x7f6adc0cc740 2023-11-04T01:42:11.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.741+0000 7f6ae249b640 1 -- 172.21.15.77:0/3568468118 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6adc06b3e0 con 0x7f6adc0cc740 2023-11-04T01:42:11.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.741+0000 7f6ad8ff9640 1 -- 172.21.15.77:0/3568468118 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f6ad4057da0 con 0x7f6adc0cc740 2023-11-04T01:42:11.743 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:11.744 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5458,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2636406417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2636406417},{"type":"v1","addr":"172.21.15.122:6836","nonce":2636406417}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5461,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/2931907615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":2931907615},{"type":"v1","addr":"172.21.15.122:6837","nonce":2931907615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5955,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1507226082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1507226082},{"type":"v1","addr":"172.21.15.77:6833","nonce":1507226082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:41:53.409913+0000","modified":"2023-11-04T01:41:55.404636+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5958},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5958":{"gid":5958,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6835/1237968770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1237968770},{"type":"v1","addr":"172.21.15.77:6835","nonce":1237968770}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-04T01:42:11.744 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 22 2023-11-04T01:42:11.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.743+0000 7f6ae249b640 1 -- 172.21.15.77:0/3568468118 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6ac806ae70 msgr2=0x7f6ac806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:11.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.743+0000 7f6ae249b640 1 --2- 172.21.15.77:0/3568468118 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6ac806ae70 0x7f6ac806d330 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6acc006fd0 tx=0x7f6acc008040 comp rx=0 tx=0).stop 2023-11-04T01:42:11.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.743+0000 7f6ae249b640 1 -- 172.21.15.77:0/3568468118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6adc0cc740 msgr2=0x7f6adc0c95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:11.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.743+0000 7f6ae249b640 1 --2- 172.21.15.77:0/3568468118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6adc0cc740 0x7f6adc0c95b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f6ad400c780 tx=0x7f6ad400cc40 comp rx=0 tx=0).stop 2023-11-04T01:42:11.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.743+0000 7f6ae249b640 1 -- 172.21.15.77:0/3568468118 shutdown_connections 2023-11-04T01:42:11.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.743+0000 7f6ae249b640 1 --2- 172.21.15.77:0/3568468118 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6ac806ae70 0x7f6ac806d330 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.743+0000 7f6ae249b640 1 --2- 172.21.15.77:0/3568468118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6adc0cc740 0x7f6adc0c95b0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.743+0000 7f6ae249b640 1 --2- 172.21.15.77:0/3568468118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6adc161050 0x7f6adc0cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.743+0000 7f6ae249b640 1 --2- 172.21.15.77:0/3568468118 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6adc15ce60 0x7f6adc15a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.743+0000 7f6ae249b640 1 -- 172.21.15.77:0/3568468118 >> 172.21.15.77:0/3568468118 conn(0x7f6adc06ea90 msgr2=0x7f6adc15f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:11.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.743+0000 7f6ae249b640 1 -- 172.21.15.77:0/3568468118 shutdown_connections 2023-11-04T01:42:11.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.743+0000 7f6ae249b640 1 -- 172.21.15.77:0/3568468118 wait complete. 2023-11-04T01:42:11.756 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:11.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.853+0000 7fcecea10640 1 Processor -- start 2023-11-04T01:42:11.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.853+0000 7fcecea10640 1 -- start start 2023-11-04T01:42:11.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.854+0000 7fcecea10640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fcec815ae40 0x7fcec815bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:11.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.854+0000 7fcecea10640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcec80cbc00 0x7fcec80cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:11.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.854+0000 7fcecea10640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcec80cc450 con 0x7fcec80cd860 2023-11-04T01:42:11.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.854+0000 7fcecea10640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcec815f400 con 0x7fcec80cbc00 2023-11-04T01:42:11.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.854+0000 7fcecea10640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcec815b220 con 0x7fcec815ae40 2023-11-04T01:42:11.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.854+0000 7fcec77fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcec80cbc00 0x7fcec80cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:11.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.854+0000 7fceccfad640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fcec80cd860 0x7fcec80b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55258/0 (socket says 172.21.15.77:55258) 2023-11-04T01:42:11.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.854+0000 7fcec77fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcec80cbc00 0x7fcec80cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52074/0 (socket says 172.21.15.77:52074) 2023-11-04T01:42:11.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.854+0000 7fceccfad640 1 -- 172.21.15.77:0/201152236 learned_addr learned my addr 172.21.15.77:0/201152236 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:11.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.855+0000 7fcec7fff640 1 --2- 172.21.15.77:0/201152236 >> v2:172.21.15.122:3300/0 conn(0x7fcec815ae40 0x7fcec815bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:11.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.855+0000 7fcec77fe640 1 -- 172.21.15.77:0/201152236 >> v2:172.21.15.122:3300/0 conn(0x7fcec815ae40 msgr2=0x7fcec815bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:11.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.855+0000 7fcec77fe640 1 --2- 172.21.15.77:0/201152236 >> v2:172.21.15.122:3300/0 conn(0x7fcec815ae40 0x7fcec815bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.855+0000 7fcec77fe640 1 -- 172.21.15.77:0/201152236 >> v1:172.21.15.77:6789/0 conn(0x7fcec80cd860 legacy=0x7fcec80b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:11.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.855+0000 7fcec77fe640 1 -- 172.21.15.77:0/201152236 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec815f890 con 0x7fcec80cbc00 2023-11-04T01:42:11.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.855+0000 7fcec6ffd640 1 -- 172.21.15.77:0/201152236 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1673201658 0 0) 0x7fcec0001490 con 0x7fcec80cd860 2023-11-04T01:42:11.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.855+0000 7fcec7fff640 1 --2- 172.21.15.77:0/201152236 >> v2:172.21.15.122:3300/0 conn(0x7fcec815ae40 0x7fcec815bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:11.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.855+0000 7fcec77fe640 1 --2- 172.21.15.77:0/201152236 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcec80cbc00 0x7fcec80cd320 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fcec806e580 tx=0x7fcebc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2050329d61159cd3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:11.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.855+0000 7fcec6ffd640 1 -- 172.21.15.77:0/201152236 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcebc031830 con 0x7fcec80cbc00 2023-11-04T01:42:11.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.855+0000 7fcec6ffd640 1 -- 172.21.15.77:0/201152236 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcebc031990 con 0x7fcec80cbc00 2023-11-04T01:42:11.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.855+0000 7fcec6ffd640 1 -- 172.21.15.77:0/201152236 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcebc031d20 con 0x7fcec80cbc00 2023-11-04T01:42:11.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.856+0000 7fcecea10640 1 -- 172.21.15.77:0/201152236 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcec80cbc00 msgr2=0x7fcec80cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:11.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.856+0000 7fcecea10640 1 --2- 172.21.15.77:0/201152236 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcec80cbc00 0x7fcec80cd320 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fcec806e580 tx=0x7fcebc02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.856+0000 7fcecea10640 1 -- 172.21.15.77:0/201152236 shutdown_connections 2023-11-04T01:42:11.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.856+0000 7fcecea10640 1 --2- 172.21.15.77:0/201152236 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcec80cbc00 0x7fcec80cd320 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.856+0000 7fcecea10640 1 --2- 172.21.15.77:0/201152236 >> v2:172.21.15.122:3300/0 conn(0x7fcec815ae40 0x7fcec815bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.856+0000 7fcecea10640 1 -- 172.21.15.77:0/201152236 >> 172.21.15.77:0/201152236 conn(0x7fcec806ea90 msgr2=0x7fcec806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:11.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.856+0000 7fcecea10640 1 -- 172.21.15.77:0/201152236 shutdown_connections 2023-11-04T01:42:11.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.856+0000 7fcecea10640 1 -- 172.21.15.77:0/201152236 wait complete. 2023-11-04T01:42:11.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.857+0000 7fcecea10640 1 Processor -- start 2023-11-04T01:42:11.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.857+0000 7fcecea10640 1 -- start start 2023-11-04T01:42:11.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.858+0000 7fcecea10640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcec80cbc00 0x7fcec80c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:11.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.858+0000 7fcecea10640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcec80cd860 0x7fcec814a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:11.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.858+0000 7fcecea10640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcec815ae40 0x7fcec815ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:11.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.858+0000 7fcecea10640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec80a8b30 con 0x7fcec80cd860 2023-11-04T01:42:11.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.858+0000 7fcecea10640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec80a86a0 con 0x7fcec815ae40 2023-11-04T01:42:11.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.858+0000 7fcecea10640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcec80c8bc0 con 0x7fcec80cbc00 2023-11-04T01:42:11.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.858+0000 7fcec77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcec80cd860 0x7fcec814a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:11.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.858+0000 7fcec77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcec80cd860 0x7fcec814a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52080/0 (socket says 172.21.15.77:52080) 2023-11-04T01:42:11.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.858+0000 7fcec77fe640 1 -- 172.21.15.77:0/2727652499 learned_addr learned my addr 172.21.15.77:0/2727652499 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:11.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.858+0000 7fceccfad640 1 --2- 172.21.15.77:0/2727652499 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcec815ae40 0x7fcec815ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:11.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.858+0000 7fcec7fff640 1 --2- 172.21.15.77:0/2727652499 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcec80cbc00 0x7fcec80c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:11.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.858+0000 7fcec77fe640 1 -- 172.21.15.77:0/2727652499 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcec80cbc00 msgr2=0x7fcec80c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:11.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.858+0000 7fcec77fe640 1 --2- 172.21.15.77:0/2727652499 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcec80cbc00 0x7fcec80c8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.858+0000 7fcec77fe640 1 -- 172.21.15.77:0/2727652499 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcec815ae40 msgr2=0x7fcec815ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:11.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.858+0000 7fcec77fe640 1 --2- 172.21.15.77:0/2727652499 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcec815ae40 0x7fcec815ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:11.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.858+0000 7fcec77fe640 1 -- 172.21.15.77:0/2727652499 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcebc009400 con 0x7fcec80cd860 2023-11-04T01:42:11.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.858+0000 7fceccfad640 1 --2- 172.21.15.77:0/2727652499 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcec815ae40 0x7fcec815ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:11.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.858+0000 7fcec7fff640 1 --2- 172.21.15.77:0/2727652499 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcec80cbc00 0x7fcec80c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:11.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.859+0000 7fcec77fe640 1 --2- 172.21.15.77:0/2727652499 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcec80cd860 0x7fcec814a1f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fcebc009890 tx=0x7fcebc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:11.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.859+0000 7fcec4ff9640 1 -- 172.21.15.77:0/2727652499 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcebc03ba70 con 0x7fcec80cd860 2023-11-04T01:42:11.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.859+0000 7fcec4ff9640 1 -- 172.21.15.77:0/2727652499 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcebc03bbf0 con 0x7fcec80cd860 2023-11-04T01:42:11.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.859+0000 7fcecea10640 1 -- 172.21.15.77:0/2727652499 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcec80a7a90 con 0x7fcec80cd860 2023-11-04T01:42:11.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.859+0000 7fcec4ff9640 1 -- 172.21.15.77:0/2727652499 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcebc045400 con 0x7fcec80cd860 2023-11-04T01:42:11.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.859+0000 7fcecea10640 1 -- 172.21.15.77:0/2727652499 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcec80a8050 con 0x7fcec80cd860 2023-11-04T01:42:11.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.860+0000 7fcecea10640 1 -- 172.21.15.77:0/2727652499 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcec80ce2d0 con 0x7fcec80cd860 2023-11-04T01:42:11.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.860+0000 7fcec4ff9640 1 -- 172.21.15.77:0/2727652499 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcebc04e440 con 0x7fcec80cd860 2023-11-04T01:42:11.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.860+0000 7fcec4ff9640 1 --2- 172.21.15.77:0/2727652499 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fceb406ae70 0x7fceb406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:11.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.861+0000 7fcec4ff9640 1 -- 172.21.15.77:0/2727652499 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fcebc0abbb0 con 0x7fcec80cd860 2023-11-04T01:42:11.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.861+0000 7fcec7fff640 1 --2- 172.21.15.77:0/2727652499 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fceb406ae70 0x7fceb406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:11.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.861+0000 7fcec7fff640 1 --2- 172.21.15.77:0/2727652499 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fceb406ae70 0x7fceb406d330 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fceb8006fd0 tx=0x7fceb8008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:11.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:11.865+0000 7fcec4ff9640 1 -- 172.21.15.77:0/2727652499 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcebc0769c0 con 0x7fcec80cd860 2023-11-04T01:42:12.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.031+0000 7fcecea10640 1 -- 172.21.15.77:0/2727652499 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcec8074290 con 0x7fcec80cd860 2023-11-04T01:42:12.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.032+0000 7fcec4ff9640 1 -- 172.21.15.77:0/2727652499 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+18511 (secure 0 0 0) 0x7fcebc035090 con 0x7fcec80cd860 2023-11-04T01:42:12.034 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:12.034 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":54,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:41:55.075378+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:41:51.914855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-04T01:41:52.371167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:12.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.034+0000 7fcecea10640 1 -- 172.21.15.77:0/2727652499 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fceb406ae70 msgr2=0x7fceb406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:12.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.034+0000 7fcecea10640 1 --2- 172.21.15.77:0/2727652499 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fceb406ae70 0x7fceb406d330 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fceb8006fd0 tx=0x7fceb8008040 comp rx=0 tx=0).stop 2023-11-04T01:42:12.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.034+0000 7fcecea10640 1 -- 172.21.15.77:0/2727652499 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcec80cd860 msgr2=0x7fcec814a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:12.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.034+0000 7fcecea10640 1 --2- 172.21.15.77:0/2727652499 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcec80cd860 0x7fcec814a1f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fcebc009890 tx=0x7fcebc0046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:12.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.034+0000 7fcecea10640 1 -- 172.21.15.77:0/2727652499 shutdown_connections 2023-11-04T01:42:12.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.034+0000 7fcecea10640 1 --2- 172.21.15.77:0/2727652499 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fceb406ae70 0x7fceb406d330 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:12.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.034+0000 7fcecea10640 1 --2- 172.21.15.77:0/2727652499 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcec815ae40 0x7fcec815ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:12.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.034+0000 7fcecea10640 1 --2- 172.21.15.77:0/2727652499 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcec80cd860 0x7fcec814a1f0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:12.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.034+0000 7fcecea10640 1 --2- 172.21.15.77:0/2727652499 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcec80cbc00 0x7fcec80c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:12.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.034+0000 7fcecea10640 1 -- 172.21.15.77:0/2727652499 >> 172.21.15.77:0/2727652499 conn(0x7fcec806ea90 msgr2=0x7fcec815dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:12.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.034+0000 7fcecea10640 1 -- 172.21.15.77:0/2727652499 shutdown_connections 2023-11-04T01:42:12.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.034+0000 7fcecea10640 1 -- 172.21.15.77:0/2727652499 wait complete. 2023-11-04T01:42:12.047 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-04T01:42:12.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.145+0000 7f0eb0c4f640 1 Processor -- start 2023-11-04T01:42:12.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.145+0000 7f0eb0c4f640 1 -- start start 2023-11-04T01:42:12.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.146+0000 7f0eb0c4f640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f0eac0c4ff0 0x7f0eac0cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:12.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.146+0000 7f0eb0c4f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eac15aff0 con 0x7f0eac159c00 2023-11-04T01:42:12.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.146+0000 7f0eb0c4f640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eac15a3e0 con 0x7f0eac0adac0 2023-11-04T01:42:12.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.146+0000 7f0eb0c4f640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eac15a6c0 con 0x7f0eac0c4ff0 2023-11-04T01:42:12.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.146+0000 7f0eaa59c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f0eac159c00 0x7f0eac0c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55260/0 (socket says 172.21.15.77:55260) 2023-11-04T01:42:12.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.146+0000 7f0eaa59c640 1 -- 172.21.15.77:0/1188286488 learned_addr learned my addr 172.21.15.77:0/1188286488 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:12.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.147+0000 7f0ea9d9b640 1 --2- 172.21.15.77:0/1188286488 >> v2:172.21.15.122:3300/0 conn(0x7f0eac0c4ff0 0x7f0eac0cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:12.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.147+0000 7f0ea959a640 1 -- 172.21.15.77:0/1188286488 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1033339344 0 0) 0x7f0eac15aff0 con 0x7f0eac159c00 2023-11-04T01:42:12.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.147+0000 7f0ea959a640 1 -- 172.21.15.77:0/1188286488 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e94003520 con 0x7f0eac159c00 2023-11-04T01:42:12.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.147+0000 7f0ea959a640 1 -- 172.21.15.77:0/1188286488 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3966130819 0 0) 0x7f0e94003520 con 0x7f0eac159c00 2023-11-04T01:42:12.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.147+0000 7f0ea959a640 1 -- 172.21.15.77:0/1188286488 >> v2:172.21.15.122:3300/0 conn(0x7f0eac0c4ff0 msgr2=0x7f0eac0cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:12.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.147+0000 7f0ea959a640 1 --2- 172.21.15.77:0/1188286488 >> v2:172.21.15.122:3300/0 conn(0x7f0eac0c4ff0 0x7f0eac0cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:12.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.147+0000 7f0ea959a640 1 -- 172.21.15.77:0/1188286488 >> v1:172.21.15.122:6789/0 conn(0x7f0eac0adac0 legacy=0x7f0eac0adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:12.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.147+0000 7f0ea959a640 1 -- 172.21.15.77:0/1188286488 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eac15a9a0 con 0x7f0eac159c00 2023-11-04T01:42:12.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.147+0000 7f0ea959a640 1 -- 172.21.15.77:0/1188286488 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f0ea4001670 con 0x7f0eac159c00 2023-11-04T01:42:12.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.147+0000 7f0ea959a640 1 -- 172.21.15.77:0/1188286488 >> v1:172.21.15.77:6789/0 conn(0x7f0eac159c00 legacy=0x7f0eac0c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:12.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.147+0000 7f0ea959a640 1 --2- 172.21.15.77:0/1188286488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e94003970 0x7f0e94003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:12.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.147+0000 7f0ea959a640 1 --2- 172.21.15.77:0/1188286488 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e94004370 0x7f0e94004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:12.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.147+0000 7f0ea959a640 1 --2- 172.21.15.77:0/1188286488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e94005040 0x7f0e9400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:12.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.147+0000 7f0ea959a640 1 -- 172.21.15.77:0/1188286488 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac15a6c0 con 0x7f0e94005040 2023-11-04T01:42:12.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.147+0000 7f0ea959a640 1 -- 172.21.15.77:0/1188286488 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9400bfa0 con 0x7f0e94003970 2023-11-04T01:42:12.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.147+0000 7f0ea959a640 1 -- 172.21.15.77:0/1188286488 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9400c160 con 0x7f0e94004370 2023-11-04T01:42:12.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.147+0000 7f0eaad9d640 1 --2- 172.21.15.77:0/1188286488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e94005040 0x7f0e9400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:12.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.147+0000 7f0eaa59c640 1 --2- 172.21.15.77:0/1188286488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e94003970 0x7f0e94003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:12.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.147+0000 7f0ea9d9b640 1 --2- 172.21.15.77:0/1188286488 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e94004370 0x7f0e94004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:12.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.147+0000 7f0eaad9d640 1 -- 172.21.15.77:0/1188286488 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e94004370 msgr2=0x7f0e94004840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:12.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.147+0000 7f0eaad9d640 1 --2- 172.21.15.77:0/1188286488 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e94004370 0x7f0e94004840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:12.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.147+0000 7f0eaad9d640 1 -- 172.21.15.77:0/1188286488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e94003970 msgr2=0x7f0e94003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:12.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.147+0000 7f0eaad9d640 1 --2- 172.21.15.77:0/1188286488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e94003970 0x7f0e94003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:12.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.147+0000 7f0eaad9d640 1 -- 172.21.15.77:0/1188286488 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e94003520 con 0x7f0e94005040 2023-11-04T01:42:12.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.148+0000 7f0eaad9d640 1 -- 172.21.15.77:0/1188286488 reap_dead start 2023-11-04T01:42:12.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.148+0000 7f0eaad9d640 1 --2- 172.21.15.77:0/1188286488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e94005040 0x7f0e9400b980 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c001860 tx=0x7f0e940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=382b8495816d90a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:12.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.148+0000 7f0ea959a640 1 -- 172.21.15.77:0/1188286488 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c005110 con 0x7f0e94005040 2023-11-04T01:42:12.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.148+0000 7f0ea959a640 1 -- 172.21.15.77:0/1188286488 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9c005290 con 0x7f0e94005040 2023-11-04T01:42:12.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.148+0000 7f0ea959a640 1 -- 172.21.15.77:0/1188286488 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c0035f0 con 0x7f0e94005040 2023-11-04T01:42:12.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.149+0000 7f0eb0c4f640 1 -- 172.21.15.77:0/1188286488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e94005040 msgr2=0x7f0e9400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:12.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.149+0000 7f0eb0c4f640 1 --2- 172.21.15.77:0/1188286488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e94005040 0x7f0e9400b980 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c001860 tx=0x7f0e940057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:12.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.149+0000 7f0eb0c4f640 1 -- 172.21.15.77:0/1188286488 shutdown_connections 2023-11-04T01:42:12.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.149+0000 7f0eb0c4f640 1 --2- 172.21.15.77:0/1188286488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e94005040 0x7f0e9400b980 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:12.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.149+0000 7f0eb0c4f640 1 -- 172.21.15.77:0/1188286488 >> 172.21.15.77:0/1188286488 conn(0x7f0eac0ce950 msgr2=0x7f0eac0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:12.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.149+0000 7f0eb0c4f640 1 -- 172.21.15.77:0/1188286488 shutdown_connections 2023-11-04T01:42:12.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.149+0000 7f0eb0c4f640 1 -- 172.21.15.77:0/1188286488 wait complete. 2023-11-04T01:42:12.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.150+0000 7f0eb0c4f640 1 Processor -- start 2023-11-04T01:42:12.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.150+0000 7f0eb0c4f640 1 -- start start 2023-11-04T01:42:12.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.151+0000 7f0eb0c4f640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e94005040 0x7f0eac157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:12.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.151+0000 7f0eb0c4f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0eac1eec90 0x7f0eac1561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:12.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.151+0000 7f0eb0c4f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0eac1ef0f0 0x7f0eac156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:12.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.151+0000 7f0eb0c4f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac1489e0 con 0x7f0eac1eec90 2023-11-04T01:42:12.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.151+0000 7f0eb0c4f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac156d60 con 0x7f0eac1ef0f0 2023-11-04T01:42:12.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.151+0000 7f0eb0c4f640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac157040 con 0x7f0e94005040 2023-11-04T01:42:12.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.151+0000 7f0ea9d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0eac1eec90 0x7f0eac1561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:12.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.151+0000 7f0ea9d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0eac1eec90 0x7f0eac1561f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52092/0 (socket says 172.21.15.77:52092) 2023-11-04T01:42:12.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.151+0000 7f0ea9d9b640 1 -- 172.21.15.77:0/148587119 learned_addr learned my addr 172.21.15.77:0/148587119 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:12.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.151+0000 7f0eaa59c640 1 --2- 172.21.15.77:0/148587119 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e94005040 0x7f0eac157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:12.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.151+0000 7f0eaad9d640 1 --2- 172.21.15.77:0/148587119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0eac1ef0f0 0x7f0eac156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:12.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.151+0000 7f0ea9d9b640 1 -- 172.21.15.77:0/148587119 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e94005040 msgr2=0x7f0eac157e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:12.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.151+0000 7f0ea9d9b640 1 --2- 172.21.15.77:0/148587119 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e94005040 0x7f0eac157e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:12.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.151+0000 7f0ea9d9b640 1 -- 172.21.15.77:0/148587119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0eac1ef0f0 msgr2=0x7f0eac156730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:12.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.151+0000 7f0ea9d9b640 1 --2- 172.21.15.77:0/148587119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0eac1ef0f0 0x7f0eac156730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:12.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.151+0000 7f0ea9d9b640 1 -- 172.21.15.77:0/148587119 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eac157320 con 0x7f0eac1eec90 2023-11-04T01:42:12.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.151+0000 7f0ea9d9b640 1 --2- 172.21.15.77:0/148587119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0eac1eec90 0x7f0eac1561f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0007dd0 tx=0x7f0ea00115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:12.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.152+0000 7f0e9affd640 1 -- 172.21.15.77:0/148587119 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea000e070 con 0x7f0eac1eec90 2023-11-04T01:42:12.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.152+0000 7f0e9affd640 1 -- 172.21.15.77:0/148587119 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea0011ec0 con 0x7f0eac1eec90 2023-11-04T01:42:12.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.152+0000 7f0e9affd640 1 -- 172.21.15.77:0/148587119 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0003990 con 0x7f0eac1eec90 2023-11-04T01:42:12.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.152+0000 7f0eb0c4f640 1 -- 172.21.15.77:0/148587119 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eac157600 con 0x7f0eac1eec90 2023-11-04T01:42:12.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.152+0000 7f0eb0c4f640 1 -- 172.21.15.77:0/148587119 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eac158340 con 0x7f0eac1eec90 2023-11-04T01:42:12.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.153+0000 7f0eb0c4f640 1 -- 172.21.15.77:0/148587119 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eac074290 con 0x7f0eac1eec90 2023-11-04T01:42:12.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.153+0000 7f0e9affd640 1 -- 172.21.15.77:0/148587119 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0ea0003af0 con 0x7f0eac1eec90 2023-11-04T01:42:12.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.153+0000 7f0e9affd640 1 --2- 172.21.15.77:0/148587119 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0e8c06ae70 0x7f0e8c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:12.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.153+0000 7f0e9affd640 1 -- 172.21.15.77:0/148587119 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0ea008a2c0 con 0x7f0eac1eec90 2023-11-04T01:42:12.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.154+0000 7f0eaa59c640 1 --2- 172.21.15.77:0/148587119 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0e8c06ae70 0x7f0e8c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:12.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.154+0000 7f0eaa59c640 1 --2- 172.21.15.77:0/148587119 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0e8c06ae70 0x7f0e8c06d330 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0ea40011e0 tx=0x7f0ea4001150 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:12.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.157+0000 7f0e9affd640 1 -- 172.21.15.77:0/148587119 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0ea0055040 con 0x7f0eac1eec90 2023-11-04T01:42:12.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.359+0000 7f0eb0c4f640 1 -- 172.21.15.77:0/148587119 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0eac0c8c60 con 0x7f0eac1eec90 2023-11-04T01:42:12.362 INFO:tasks.ceph.mon.a.smithi077.stderr:2023-11-04T01:42:12.360+0000 7f1217737640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-04T01:42:12.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.361+0000 7f0e9affd640 1 -- 172.21.15.77:0/148587119 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0ea0058660 con 0x7f0eac1eec90 2023-11-04T01:42:12.363 INFO:teuthology.orchestra.run.smithi077.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-04T01:42:12.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.364+0000 7f0eb0c4f640 1 -- 172.21.15.77:0/148587119 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0e8c06ae70 msgr2=0x7f0e8c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:12.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.364+0000 7f0eb0c4f640 1 --2- 172.21.15.77:0/148587119 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0e8c06ae70 0x7f0e8c06d330 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0ea40011e0 tx=0x7f0ea4001150 comp rx=0 tx=0).stop 2023-11-04T01:42:12.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.364+0000 7f0eb0c4f640 1 -- 172.21.15.77:0/148587119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0eac1eec90 msgr2=0x7f0eac1561f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:12.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.364+0000 7f0eb0c4f640 1 --2- 172.21.15.77:0/148587119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0eac1eec90 0x7f0eac1561f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0007dd0 tx=0x7f0ea00115a0 comp rx=0 tx=0).stop 2023-11-04T01:42:12.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.364+0000 7f0eb0c4f640 1 -- 172.21.15.77:0/148587119 shutdown_connections 2023-11-04T01:42:12.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.364+0000 7f0eb0c4f640 1 --2- 172.21.15.77:0/148587119 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0e8c06ae70 0x7f0e8c06d330 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:12.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.364+0000 7f0eb0c4f640 1 --2- 172.21.15.77:0/148587119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0eac1ef0f0 0x7f0eac156730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:12.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.364+0000 7f0eb0c4f640 1 --2- 172.21.15.77:0/148587119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0eac1eec90 0x7f0eac1561f0 secure :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0007dd0 tx=0x7f0ea00115a0 comp rx=0 tx=0).stop 2023-11-04T01:42:12.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.364+0000 7f0eb0c4f640 1 --2- 172.21.15.77:0/148587119 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e94005040 0x7f0eac157e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:12.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.364+0000 7f0eb0c4f640 1 -- 172.21.15.77:0/148587119 >> 172.21.15.77:0/148587119 conn(0x7f0eac0ce950 msgr2=0x7f0eac06d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:12.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.365+0000 7f0eb0c4f640 1 -- 172.21.15.77:0/148587119 shutdown_connections 2023-11-04T01:42:12.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.365+0000 7f0eb0c4f640 1 -- 172.21.15.77:0/148587119 wait complete. 2023-11-04T01:42:12.369 INFO:tasks.ceph.mds.c.smithi077.stderr: -622> 2023-11-04T01:41:59.333+0000 7f2d8d741640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:42:12.378 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-04T01:42:12.392 INFO:tasks.ceph.mds.c.smithi077.stdout:starting mds.c at 2023-11-04T01:42:12.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.478+0000 7f5bdc27c640 1 Processor -- start 2023-11-04T01:42:12.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.479+0000 7f5bdc27c640 1 -- start start 2023-11-04T01:42:12.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.479+0000 7f5bdc27c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5bd415ad40 0x7f5bd406b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:12.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.479+0000 7f5bdc27c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5bd415b120 0x7f5bd415f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:12.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.479+0000 7f5bdc27c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bd4065df0 con 0x7f5bd40c9b60 2023-11-04T01:42:12.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.480+0000 7f5bdc27c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bd406bc40 con 0x7f5bd415ad40 2023-11-04T01:42:12.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.480+0000 7f5bdc27c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bd415f910 con 0x7f5bd415b120 2023-11-04T01:42:12.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.480+0000 7f5bda018640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5bd415ad40 0x7f5bd406b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:12.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.480+0000 7f5bda018640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5bd415ad40 0x7f5bd406b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52104/0 (socket says 172.21.15.77:52104) 2023-11-04T01:42:12.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.480+0000 7f5bda018640 1 -- 172.21.15.77:0/910270986 learned_addr learned my addr 172.21.15.77:0/910270986 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:12.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.480+0000 7f5bd9817640 1 --2- 172.21.15.77:0/910270986 >> v2:172.21.15.122:3300/0 conn(0x7f5bd415b120 0x7f5bd415f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:12.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.480+0000 7f5bda018640 1 -- 172.21.15.77:0/910270986 >> v2:172.21.15.122:3300/0 conn(0x7f5bd415b120 msgr2=0x7f5bd415f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:12.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.480+0000 7f5bda018640 1 --2- 172.21.15.77:0/910270986 >> v2:172.21.15.122:3300/0 conn(0x7f5bd415b120 0x7f5bd415f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:12.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.480+0000 7f5bda018640 1 -- 172.21.15.77:0/910270986 >> v1:172.21.15.122:6789/0 conn(0x7f5bd40c9b60 legacy=0x7f5bd4070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:12.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.480+0000 7f5bda018640 1 -- 172.21.15.77:0/910270986 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd4066040 con 0x7f5bd415ad40 2023-11-04T01:42:12.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.480+0000 7f5bd9817640 1 --2- 172.21.15.77:0/910270986 >> v2:172.21.15.122:3300/0 conn(0x7f5bd415b120 0x7f5bd415f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:12.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.481+0000 7f5bda018640 1 --2- 172.21.15.77:0/910270986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bd415ad40 0x7f5bd406b700 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f5bd40cf060 tx=0x7f5bd002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1d56491fa287b65 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:12.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.481+0000 7f5bd9016640 1 -- 172.21.15.77:0/910270986 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd0031870 con 0x7f5bd415ad40 2023-11-04T01:42:12.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.481+0000 7f5bd9016640 1 -- 172.21.15.77:0/910270986 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd00319d0 con 0x7f5bd415ad40 2023-11-04T01:42:12.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.481+0000 7f5bd9016640 1 -- 172.21.15.77:0/910270986 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd0031d60 con 0x7f5bd415ad40 2023-11-04T01:42:12.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.481+0000 7f5bdc27c640 1 -- 172.21.15.77:0/910270986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bd415ad40 msgr2=0x7f5bd406b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:12.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.481+0000 7f5bdc27c640 1 --2- 172.21.15.77:0/910270986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bd415ad40 0x7f5bd406b700 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f5bd40cf060 tx=0x7f5bd002b910 comp rx=0 tx=0).stop 2023-11-04T01:42:12.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.482+0000 7f5bdc27c640 1 -- 172.21.15.77:0/910270986 shutdown_connections 2023-11-04T01:42:12.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.482+0000 7f5bdc27c640 1 --2- 172.21.15.77:0/910270986 >> v2:172.21.15.122:3300/0 conn(0x7f5bd415b120 0x7f5bd415f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:12.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.482+0000 7f5bdc27c640 1 --2- 172.21.15.77:0/910270986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bd415ad40 0x7f5bd406b700 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:12.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.482+0000 7f5bdc27c640 1 -- 172.21.15.77:0/910270986 >> 172.21.15.77:0/910270986 conn(0x7f5bd40cbc90 msgr2=0x7f5bd40cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:12.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.482+0000 7f5bdc27c640 1 -- 172.21.15.77:0/910270986 shutdown_connections 2023-11-04T01:42:12.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.482+0000 7f5bdc27c640 1 -- 172.21.15.77:0/910270986 wait complete. 2023-11-04T01:42:12.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.483+0000 7f5bdc27c640 1 Processor -- start 2023-11-04T01:42:12.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.483+0000 7f5bdc27c640 1 -- start start 2023-11-04T01:42:12.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.483+0000 7f5bdc27c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5bd40c9b60 0x7f5bd40c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:12.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.483+0000 7f5bdc27c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5bd415ad40 0x7f5bd414d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:12.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.483+0000 7f5bdc27c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bd415b120 0x7f5bd40c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:12.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.483+0000 7f5bdc27c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd40c7cd0 con 0x7f5bd415b120 2023-11-04T01:42:12.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.483+0000 7f5bdc27c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd40c7ee0 con 0x7f5bd415ad40 2023-11-04T01:42:12.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.483+0000 7f5bdc27c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd40c81c0 con 0x7f5bd40c9b60 2023-11-04T01:42:12.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.483+0000 7f5bda819640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bd415b120 0x7f5bd40c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:12.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.484+0000 7f5bda819640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bd415b120 0x7f5bd40c7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52110/0 (socket says 172.21.15.77:52110) 2023-11-04T01:42:12.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.484+0000 7f5bda819640 1 -- 172.21.15.77:0/3948044302 learned_addr learned my addr 172.21.15.77:0/3948044302 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:12.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.484+0000 7f5bda819640 1 -- 172.21.15.77:0/3948044302 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5bd40c9b60 msgr2=0x7f5bd40c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:12.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.484+0000 7f5bda819640 1 --2- 172.21.15.77:0/3948044302 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5bd40c9b60 0x7f5bd40c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:12.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.484+0000 7f5bd9817640 1 --2- 172.21.15.77:0/3948044302 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5bd415ad40 0x7f5bd414d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:12.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.484+0000 7f5bda819640 1 -- 172.21.15.77:0/3948044302 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5bd415ad40 msgr2=0x7f5bd414d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:12.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.484+0000 7f5bda819640 1 --2- 172.21.15.77:0/3948044302 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5bd415ad40 0x7f5bd414d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:12.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.484+0000 7f5bda819640 1 -- 172.21.15.77:0/3948044302 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd00094d0 con 0x7f5bd415b120 2023-11-04T01:42:12.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.484+0000 7f5bda819640 1 --2- 172.21.15.77:0/3948044302 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bd415b120 0x7f5bd40c7790 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc00c780 tx=0x7f5bcc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:12.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.484+0000 7f5bc6ffd640 1 -- 172.21.15.77:0/3948044302 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc004b60 con 0x7f5bd415b120 2023-11-04T01:42:12.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.484+0000 7f5bc6ffd640 1 -- 172.21.15.77:0/3948044302 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bcc00ce90 con 0x7f5bd415b120 2023-11-04T01:42:12.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.484+0000 7f5bdc27c640 1 -- 172.21.15.77:0/3948044302 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bd40c84a0 con 0x7f5bd415b120 2023-11-04T01:42:12.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.484+0000 7f5bc6ffd640 1 -- 172.21.15.77:0/3948044302 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc00a850 con 0x7f5bd415b120 2023-11-04T01:42:12.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.484+0000 7f5bdc27c640 1 -- 172.21.15.77:0/3948044302 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bd40c8a60 con 0x7f5bd415b120 2023-11-04T01:42:12.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.485+0000 7f5bdc27c640 1 -- 172.21.15.77:0/3948044302 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bd4074290 con 0x7f5bd415b120 2023-11-04T01:42:12.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.485+0000 7f5bc6ffd640 1 -- 172.21.15.77:0/3948044302 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5bcc00a9b0 con 0x7f5bd415b120 2023-11-04T01:42:12.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.486+0000 7f5bc6ffd640 1 --2- 172.21.15.77:0/3948044302 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5bb806ae70 0x7f5bb806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:12.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.486+0000 7f5bc6ffd640 1 -- 172.21.15.77:0/3948044302 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f5bcc089a80 con 0x7f5bd415b120 2023-11-04T01:42:12.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.486+0000 7f5bda018640 1 --2- 172.21.15.77:0/3948044302 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5bb806ae70 0x7f5bb806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:12.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.487+0000 7f5bda018640 1 --2- 172.21.15.77:0/3948044302 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5bb806ae70 0x7f5bb806d330 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0036000 tx=0x7f5bd0030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:12.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.490+0000 7f5bc6ffd640 1 -- 172.21.15.77:0/3948044302 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5bcc054830 con 0x7f5bd415b120 2023-11-04T01:42:12.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:12.692+0000 7f5bdc27c640 1 -- 172.21.15.77:0/3948044302 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5bd40ccac0 con 0x7f5bd415b120 2023-11-04T01:42:13.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.363+0000 7f5bc6ffd640 1 -- 172.21.15.77:0/3948044302 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5bcc057e50 con 0x7f5bd415b120 2023-11-04T01:42:13.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.365+0000 7f5bdc27c640 1 -- 172.21.15.77:0/3948044302 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5bb806ae70 msgr2=0x7f5bb806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:13.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.365+0000 7f5bdc27c640 1 --2- 172.21.15.77:0/3948044302 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5bb806ae70 0x7f5bb806d330 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0036000 tx=0x7f5bd0030000 comp rx=0 tx=0).stop 2023-11-04T01:42:13.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.365+0000 7f5bdc27c640 1 -- 172.21.15.77:0/3948044302 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bd415b120 msgr2=0x7f5bd40c7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:13.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.365+0000 7f5bdc27c640 1 --2- 172.21.15.77:0/3948044302 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bd415b120 0x7f5bd40c7790 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc00c780 tx=0x7f5bcc00cc40 comp rx=0 tx=0).stop 2023-11-04T01:42:13.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.365+0000 7f5bdc27c640 1 -- 172.21.15.77:0/3948044302 shutdown_connections 2023-11-04T01:42:13.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.365+0000 7f5bdc27c640 1 --2- 172.21.15.77:0/3948044302 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5bb806ae70 0x7f5bb806d330 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:13.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.365+0000 7f5bdc27c640 1 --2- 172.21.15.77:0/3948044302 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bd415b120 0x7f5bd40c7790 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:13.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.365+0000 7f5bdc27c640 1 --2- 172.21.15.77:0/3948044302 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5bd415ad40 0x7f5bd414d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:13.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.365+0000 7f5bdc27c640 1 --2- 172.21.15.77:0/3948044302 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5bd40c9b60 0x7f5bd40c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:13.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.365+0000 7f5bdc27c640 1 -- 172.21.15.77:0/3948044302 >> 172.21.15.77:0/3948044302 conn(0x7f5bd40cbc90 msgr2=0x7f5bd4155230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:13.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.365+0000 7f5bdc27c640 1 -- 172.21.15.77:0/3948044302 shutdown_connections 2023-11-04T01:42:13.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.365+0000 7f5bdc27c640 1 -- 172.21.15.77:0/3948044302 wait complete. 2023-11-04T01:42:13.379 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-04T01:42:13.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.525+0000 7f48b5d00640 1 Processor -- start 2023-11-04T01:42:13.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.525+0000 7f48b5d00640 1 -- start start 2023-11-04T01:42:13.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.525+0000 7f48b5d00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f48b00cd360 0x7f48b00b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:13.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.525+0000 7f48b5d00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b006ed30 con 0x7f48b00cd740 2023-11-04T01:42:13.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.525+0000 7f48b5d00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b006f260 con 0x7f48b006f4a0 2023-11-04T01:42:13.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.525+0000 7f48b5d00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b006a8a0 con 0x7f48b00cd360 2023-11-04T01:42:13.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.526+0000 7f48affff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f48b00cd740 0x7f48b015f2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55270/0 (socket says 172.21.15.77:55270) 2023-11-04T01:42:13.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.526+0000 7f48affff640 1 -- 172.21.15.77:0/373999338 learned_addr learned my addr 172.21.15.77:0/373999338 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:13.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.526+0000 7f48af7fe640 1 --2- 172.21.15.77:0/373999338 >> v2:172.21.15.122:3300/0 conn(0x7f48b00cd360 0x7f48b00b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:13.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.526+0000 7f48ae7fc640 1 -- 172.21.15.77:0/373999338 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3884839408 0 0) 0x7f48b006ed30 con 0x7f48b00cd740 2023-11-04T01:42:13.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.526+0000 7f48ae7fc640 1 -- 172.21.15.77:0/373999338 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4898003520 con 0x7f48b00cd740 2023-11-04T01:42:13.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.526+0000 7f48ae7fc640 1 -- 172.21.15.77:0/373999338 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1978914484 0 0) 0x7f4898003520 con 0x7f48b00cd740 2023-11-04T01:42:13.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.526+0000 7f48af7fe640 1 -- 172.21.15.77:0/373999338 >> v1:172.21.15.122:6789/0 conn(0x7f48b006f4a0 legacy=0x7f48b006ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:13.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.526+0000 7f48af7fe640 1 -- 172.21.15.77:0/373999338 >> v1:172.21.15.77:6789/0 conn(0x7f48b00cd740 legacy=0x7f48b015f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:13.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.526+0000 7f48af7fe640 1 -- 172.21.15.77:0/373999338 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b006ef80 con 0x7f48b00cd360 2023-11-04T01:42:13.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.527+0000 7f48af7fe640 1 --2- 172.21.15.77:0/373999338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48b00cd360 0x7f48b00b2470 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f48a40097a0 tx=0x7f48a402b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c9284011be8006e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:13.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.527+0000 7f48ae7fc640 1 -- 172.21.15.77:0/373999338 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a402f050 con 0x7f48b00cd360 2023-11-04T01:42:13.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.527+0000 7f48ae7fc640 1 -- 172.21.15.77:0/373999338 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a4031500 con 0x7f48b00cd360 2023-11-04T01:42:13.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.527+0000 7f48ae7fc640 1 -- 172.21.15.77:0/373999338 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a80019f0 con 0x7f48b00cd360 2023-11-04T01:42:13.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.528+0000 7f48b5d00640 1 -- 172.21.15.77:0/373999338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48b00cd360 msgr2=0x7f48b00b2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:13.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.528+0000 7f48b5d00640 1 --2- 172.21.15.77:0/373999338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48b00cd360 0x7f48b00b2470 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f48a40097a0 tx=0x7f48a402b820 comp rx=0 tx=0).stop 2023-11-04T01:42:13.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.528+0000 7f48b5d00640 1 -- 172.21.15.77:0/373999338 shutdown_connections 2023-11-04T01:42:13.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.528+0000 7f48b5d00640 1 --2- 172.21.15.77:0/373999338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48b00cd360 0x7f48b00b2470 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:13.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.528+0000 7f48b5d00640 1 -- 172.21.15.77:0/373999338 >> 172.21.15.77:0/373999338 conn(0x7f48b00b0ce0 msgr2=0x7f48b00b10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:13.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.528+0000 7f48b5d00640 1 -- 172.21.15.77:0/373999338 shutdown_connections 2023-11-04T01:42:13.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.528+0000 7f48b5d00640 1 -- 172.21.15.77:0/373999338 wait complete. 2023-11-04T01:42:13.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.529+0000 7f48b5d00640 1 Processor -- start 2023-11-04T01:42:13.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.529+0000 7f48b5d00640 1 -- start start 2023-11-04T01:42:13.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.530+0000 7f48b5d00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48b006f4a0 0x7f48b01f0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:13.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.530+0000 7f48b5d00640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f48b00cd360 0x7f48b01574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:13.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.530+0000 7f48b5d00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48b00cd740 0x7f48b0157a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:13.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.530+0000 7f48b5d00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b01f0580 con 0x7f48b00cd740 2023-11-04T01:42:13.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.530+0000 7f48b5d00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b015cf30 con 0x7f48b006f4a0 2023-11-04T01:42:13.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.530+0000 7f48b5d00640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b00c2dc0 con 0x7f48b00cd360 2023-11-04T01:42:13.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.530+0000 7f48affff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48b00cd740 0x7f48b0157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:13.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.530+0000 7f48affff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48b00cd740 0x7f48b0157a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52122/0 (socket says 172.21.15.77:52122) 2023-11-04T01:42:13.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.530+0000 7f48affff640 1 -- 172.21.15.77:0/937170323 learned_addr learned my addr 172.21.15.77:0/937170323 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:13.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.530+0000 7f48af7fe640 1 --2- 172.21.15.77:0/937170323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48b006f4a0 0x7f48b01f0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:13.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.530+0000 7f48aeffd640 1 --2- 172.21.15.77:0/937170323 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f48b00cd360 0x7f48b01574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:13.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.530+0000 7f48affff640 1 -- 172.21.15.77:0/937170323 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f48b00cd360 msgr2=0x7f48b01574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:13.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.530+0000 7f48affff640 1 --2- 172.21.15.77:0/937170323 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f48b00cd360 0x7f48b01574d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:13.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.530+0000 7f48affff640 1 -- 172.21.15.77:0/937170323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48b006f4a0 msgr2=0x7f48b01f0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:13.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.530+0000 7f48affff640 1 --2- 172.21.15.77:0/937170323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48b006f4a0 0x7f48b01f0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:13.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.530+0000 7f48affff640 1 -- 172.21.15.77:0/937170323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a4009400 con 0x7f48b00cd740 2023-11-04T01:42:13.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.530+0000 7f48af7fe640 1 --2- 172.21.15.77:0/937170323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48b006f4a0 0x7f48b01f0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:13.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.530+0000 7f48affff640 1 --2- 172.21.15.77:0/937170323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48b00cd740 0x7f48b0157a10 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f48a800cc30 tx=0x7f48a800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:13.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.530+0000 7f4897fff640 1 -- 172.21.15.77:0/937170323 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a800ce40 con 0x7f48b00cd740 2023-11-04T01:42:13.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.530+0000 7f4897fff640 1 -- 172.21.15.77:0/937170323 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a8012400 con 0x7f48b00cd740 2023-11-04T01:42:13.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.530+0000 7f48b5d00640 1 -- 172.21.15.77:0/937170323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b00c30a0 con 0x7f48b00cd740 2023-11-04T01:42:13.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.530+0000 7f4897fff640 1 -- 172.21.15.77:0/937170323 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a80127f0 con 0x7f48b00cd740 2023-11-04T01:42:13.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.530+0000 7f48b5d00640 1 -- 172.21.15.77:0/937170323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b00c3660 con 0x7f48b00cd740 2023-11-04T01:42:13.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.531+0000 7f48b5d00640 1 -- 172.21.15.77:0/937170323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b00c3880 con 0x7f48b00cd740 2023-11-04T01:42:13.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.532+0000 7f4897fff640 1 -- 172.21.15.77:0/937170323 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f48a8012950 con 0x7f48b00cd740 2023-11-04T01:42:13.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.532+0000 7f4897fff640 1 --2- 172.21.15.77:0/937170323 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f489c06ae70 0x7f489c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:13.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.532+0000 7f4897fff640 1 -- 172.21.15.77:0/937170323 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f48a8089fc0 con 0x7f48b00cd740 2023-11-04T01:42:13.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.532+0000 7f48af7fe640 1 --2- 172.21.15.77:0/937170323 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f489c06ae70 0x7f489c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:13.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.533+0000 7f48af7fe640 1 --2- 172.21.15.77:0/937170323 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f489c06ae70 0x7f489c06d330 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f48a4035000 tx=0x7f48a4008030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:13.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.536+0000 7f4897fff640 1 -- 172.21.15.77:0/937170323 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f48a80bcca0 con 0x7f48b00cd740 2023-11-04T01:42:13.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:13.703+0000 7f48b5d00640 1 -- 172.21.15.77:0/937170323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f48b004e490 con 0x7f48b00cd740 2023-11-04T01:42:14.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.600+0000 7f4897fff640 1 -- 172.21.15.77:0/937170323 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v56) v1 ==== 181+0+0 (secure 0 0 0) 0x7f48a8054e00 con 0x7f48b00cd740 2023-11-04T01:42:14.602 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_metadata' removed 2023-11-04T01:42:14.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.604+0000 7f48b5d00640 1 -- 172.21.15.77:0/937170323 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f489c06ae70 msgr2=0x7f489c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:14.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.604+0000 7f48b5d00640 1 --2- 172.21.15.77:0/937170323 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f489c06ae70 0x7f489c06d330 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f48a4035000 tx=0x7f48a4008030 comp rx=0 tx=0).stop 2023-11-04T01:42:14.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.604+0000 7f48b5d00640 1 -- 172.21.15.77:0/937170323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48b00cd740 msgr2=0x7f48b0157a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:14.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.604+0000 7f48b5d00640 1 --2- 172.21.15.77:0/937170323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48b00cd740 0x7f48b0157a10 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f48a800cc30 tx=0x7f48a800a430 comp rx=0 tx=0).stop 2023-11-04T01:42:14.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.604+0000 7f48b5d00640 1 -- 172.21.15.77:0/937170323 shutdown_connections 2023-11-04T01:42:14.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.604+0000 7f48b5d00640 1 --2- 172.21.15.77:0/937170323 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f489c06ae70 0x7f489c06d330 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.604+0000 7f48b5d00640 1 --2- 172.21.15.77:0/937170323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48b00cd740 0x7f48b0157a10 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.604+0000 7f48b5d00640 1 --2- 172.21.15.77:0/937170323 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f48b00cd360 0x7f48b01574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.604+0000 7f48b5d00640 1 --2- 172.21.15.77:0/937170323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f48b006f4a0 0x7f48b01f0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.604+0000 7f48b5d00640 1 -- 172.21.15.77:0/937170323 >> 172.21.15.77:0/937170323 conn(0x7f48b00b0ce0 msgr2=0x7f48b01588d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:14.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.604+0000 7f48b5d00640 1 -- 172.21.15.77:0/937170323 shutdown_connections 2023-11-04T01:42:14.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.604+0000 7f48b5d00640 1 -- 172.21.15.77:0/937170323 wait complete. 2023-11-04T01:42:14.620 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-04T01:42:14.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.732+0000 7f7f8802b640 1 Processor -- start 2023-11-04T01:42:14.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.732+0000 7f7f8802b640 1 -- start start 2023-11-04T01:42:14.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.733+0000 7f7f8802b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7f800cd9f0 0x7f7f800cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:14.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.733+0000 7f7f8802b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7f800d27c0 0x7f7f8015d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:14.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.733+0000 7f7f8802b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f800d1320 con 0x7f7f8015d4b0 2023-11-04T01:42:14.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.733+0000 7f7f8802b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f8015e4d0 con 0x7f7f800cd9f0 2023-11-04T01:42:14.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.733+0000 7f7f8802b640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f800ce310 con 0x7f7f800d27c0 2023-11-04T01:42:14.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.733+0000 7f7f85dc7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7f800cd9f0 0x7f7f800cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:14.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.733+0000 7f7f855c6640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f7f8015d4b0 0x7f7f800b47e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55274/0 (socket says 172.21.15.77:55274) 2023-11-04T01:42:14.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.733+0000 7f7f855c6640 1 -- 172.21.15.77:0/2637227577 learned_addr learned my addr 172.21.15.77:0/2637227577 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:14.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.733+0000 7f7f85dc7640 1 --2- 172.21.15.77:0/2637227577 >> v2:172.21.15.77:3300/0 conn(0x7f7f800cd9f0 0x7f7f800cddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52134/0 (socket says 172.21.15.77:52134) 2023-11-04T01:42:14.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.733+0000 7f7f865c8640 1 --2- 172.21.15.77:0/2637227577 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7f800d27c0 0x7f7f8015d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:14.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.733+0000 7f7f85dc7640 1 -- 172.21.15.77:0/2637227577 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7f800d27c0 msgr2=0x7f7f8015d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:14.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.733+0000 7f7f84dc5640 1 -- 172.21.15.77:0/2637227577 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4230182588 0 0) 0x7f7f800d1320 con 0x7f7f8015d4b0 2023-11-04T01:42:14.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.733+0000 7f7f85dc7640 1 --2- 172.21.15.77:0/2637227577 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7f800d27c0 0x7f7f8015d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.733+0000 7f7f85dc7640 1 -- 172.21.15.77:0/2637227577 >> v1:172.21.15.77:6789/0 conn(0x7f7f8015d4b0 legacy=0x7f7f800b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:14.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.733+0000 7f7f85dc7640 1 -- 172.21.15.77:0/2637227577 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8015df10 con 0x7f7f800cd9f0 2023-11-04T01:42:14.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.733+0000 7f7f865c8640 1 --2- 172.21.15.77:0/2637227577 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7f800d27c0 0x7f7f8015d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:14.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.734+0000 7f7f85dc7640 1 --2- 172.21.15.77:0/2637227577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f800cd9f0 0x7f7f800cddd0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c0097a0 tx=0x7f7f7c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d13ce402a451009 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:14.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.734+0000 7f7f84dc5640 1 -- 172.21.15.77:0/2637227577 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c030610 con 0x7f7f800cd9f0 2023-11-04T01:42:14.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.734+0000 7f7f84dc5640 1 -- 172.21.15.77:0/2637227577 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7c030770 con 0x7f7f800cd9f0 2023-11-04T01:42:14.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.734+0000 7f7f84dc5640 1 -- 172.21.15.77:0/2637227577 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c030b00 con 0x7f7f800cd9f0 2023-11-04T01:42:14.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.735+0000 7f7f8802b640 1 -- 172.21.15.77:0/2637227577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f800cd9f0 msgr2=0x7f7f800cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:14.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.735+0000 7f7f8802b640 1 --2- 172.21.15.77:0/2637227577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f800cd9f0 0x7f7f800cddd0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c0097a0 tx=0x7f7f7c02b960 comp rx=0 tx=0).stop 2023-11-04T01:42:14.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.735+0000 7f7f8802b640 1 -- 172.21.15.77:0/2637227577 shutdown_connections 2023-11-04T01:42:14.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.735+0000 7f7f8802b640 1 --2- 172.21.15.77:0/2637227577 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7f800d27c0 0x7f7f8015d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.735+0000 7f7f8802b640 1 --2- 172.21.15.77:0/2637227577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f800cd9f0 0x7f7f800cddd0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.735+0000 7f7f8802b640 1 -- 172.21.15.77:0/2637227577 >> 172.21.15.77:0/2637227577 conn(0x7f7f80071c40 msgr2=0x7f7f80072050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:14.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.735+0000 7f7f8802b640 1 -- 172.21.15.77:0/2637227577 shutdown_connections 2023-11-04T01:42:14.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.735+0000 7f7f8802b640 1 -- 172.21.15.77:0/2637227577 wait complete. 2023-11-04T01:42:14.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.736+0000 7f7f8802b640 1 Processor -- start 2023-11-04T01:42:14.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.736+0000 7f7f8802b640 1 -- start start 2023-11-04T01:42:14.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.737+0000 7f7f8802b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f800cd9f0 0x7f7f801f67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:14.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.737+0000 7f7f8802b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f800d27c0 0x7f7f800b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:14.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.737+0000 7f7f8802b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7f8015d4b0 0x7f7f800cf770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:14.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.737+0000 7f7f8802b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f801f2820 con 0x7f7f800d27c0 2023-11-04T01:42:14.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.737+0000 7f7f8802b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f801f6d30 con 0x7f7f800cd9f0 2023-11-04T01:42:14.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.737+0000 7f7f8802b640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f801f2a30 con 0x7f7f8015d4b0 2023-11-04T01:42:14.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.737+0000 7f7f855c6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f800d27c0 0x7f7f800b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:14.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.737+0000 7f7f855c6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f800d27c0 0x7f7f800b1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52150/0 (socket says 172.21.15.77:52150) 2023-11-04T01:42:14.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.737+0000 7f7f855c6640 1 -- 172.21.15.77:0/3241629052 learned_addr learned my addr 172.21.15.77:0/3241629052 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:14.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.737+0000 7f7f865c8640 1 --2- 172.21.15.77:0/3241629052 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7f8015d4b0 0x7f7f800cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:14.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.737+0000 7f7f85dc7640 1 --2- 172.21.15.77:0/3241629052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f800cd9f0 0x7f7f801f67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:14.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.737+0000 7f7f855c6640 1 -- 172.21.15.77:0/3241629052 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7f8015d4b0 msgr2=0x7f7f800cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:14.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.737+0000 7f7f855c6640 1 --2- 172.21.15.77:0/3241629052 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7f8015d4b0 0x7f7f800cf770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.737+0000 7f7f855c6640 1 -- 172.21.15.77:0/3241629052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f800cd9f0 msgr2=0x7f7f801f67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:14.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.737+0000 7f7f855c6640 1 --2- 172.21.15.77:0/3241629052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f800cd9f0 0x7f7f801f67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:14.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.737+0000 7f7f855c6640 1 -- 172.21.15.77:0/3241629052 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f7c009400 con 0x7f7f800d27c0 2023-11-04T01:42:14.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.738+0000 7f7f855c6640 1 --2- 172.21.15.77:0/3241629052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f800d27c0 0x7f7f800b1ed0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f7f7000c430 tx=0x7f7f7000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:14.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.738+0000 7f7f767fc640 1 -- 172.21.15.77:0/3241629052 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f700074e0 con 0x7f7f800d27c0 2023-11-04T01:42:14.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.738+0000 7f7f767fc640 1 -- 172.21.15.77:0/3241629052 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f70007660 con 0x7f7f800d27c0 2023-11-04T01:42:14.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.738+0000 7f7f8802b640 1 -- 172.21.15.77:0/3241629052 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f801f2d10 con 0x7f7f800d27c0 2023-11-04T01:42:14.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.738+0000 7f7f767fc640 1 -- 172.21.15.77:0/3241629052 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f70004a20 con 0x7f7f800d27c0 2023-11-04T01:42:14.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.738+0000 7f7f8802b640 1 -- 172.21.15.77:0/3241629052 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f801f32d0 con 0x7f7f800d27c0 2023-11-04T01:42:14.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.739+0000 7f7f8802b640 1 -- 172.21.15.77:0/3241629052 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f8004e490 con 0x7f7f800d27c0 2023-11-04T01:42:14.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.739+0000 7f7f767fc640 1 -- 172.21.15.77:0/3241629052 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7f70004b80 con 0x7f7f800d27c0 2023-11-04T01:42:14.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.740+0000 7f7f767fc640 1 --2- 172.21.15.77:0/3241629052 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7f6406ae70 0x7f7f6406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:14.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.740+0000 7f7f767fc640 1 -- 172.21.15.77:0/3241629052 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6030+0+0 (secure 0 0 0) 0x7f7f700893a0 con 0x7f7f800d27c0 2023-11-04T01:42:14.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.740+0000 7f7f85dc7640 1 --2- 172.21.15.77:0/3241629052 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7f6406ae70 0x7f7f6406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:14.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.740+0000 7f7f85dc7640 1 --2- 172.21.15.77:0/3241629052 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7f6406ae70 0x7f7f6406d330 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c036000 tx=0x7f7f7c03b040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:14.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.744+0000 7f7f767fc640 1 -- 172.21.15.77:0/3241629052 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7f70054450 con 0x7f7f800d27c0 2023-11-04T01:42:14.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:14.912+0000 7f7f8802b640 1 -- 172.21.15.77:0/3241629052 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7f800ccbb0 con 0x7f7f800d27c0 2023-11-04T01:42:15.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.605+0000 7f7f767fc640 1 -- 172.21.15.77:0/3241629052 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v57) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7f70057a70 con 0x7f7f800d27c0 2023-11-04T01:42:15.607 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data' removed 2023-11-04T01:42:15.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.609+0000 7f7f8802b640 1 -- 172.21.15.77:0/3241629052 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7f6406ae70 msgr2=0x7f7f6406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.609+0000 7f7f8802b640 1 --2- 172.21.15.77:0/3241629052 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7f6406ae70 0x7f7f6406d330 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c036000 tx=0x7f7f7c03b040 comp rx=0 tx=0).stop 2023-11-04T01:42:15.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.609+0000 7f7f8802b640 1 -- 172.21.15.77:0/3241629052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f800d27c0 msgr2=0x7f7f800b1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.609+0000 7f7f8802b640 1 --2- 172.21.15.77:0/3241629052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f800d27c0 0x7f7f800b1ed0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f7f7000c430 tx=0x7f7f7000c8f0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.609+0000 7f7f8802b640 1 -- 172.21.15.77:0/3241629052 shutdown_connections 2023-11-04T01:42:15.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.609+0000 7f7f8802b640 1 --2- 172.21.15.77:0/3241629052 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7f6406ae70 0x7f7f6406d330 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.609+0000 7f7f8802b640 1 --2- 172.21.15.77:0/3241629052 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7f8015d4b0 0x7f7f800cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.609+0000 7f7f8802b640 1 --2- 172.21.15.77:0/3241629052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f800d27c0 0x7f7f800b1ed0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.609+0000 7f7f8802b640 1 --2- 172.21.15.77:0/3241629052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f800cd9f0 0x7f7f801f67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.609+0000 7f7f8802b640 1 -- 172.21.15.77:0/3241629052 >> 172.21.15.77:0/3241629052 conn(0x7f7f80071c40 msgr2=0x7f7f80159980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:15.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.610+0000 7f7f8802b640 1 -- 172.21.15.77:0/3241629052 shutdown_connections 2023-11-04T01:42:15.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.610+0000 7f7f8802b640 1 -- 172.21.15.77:0/3241629052 wait complete. 2023-11-04T01:42:15.625 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-04T01:42:15.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.730+0000 7fc6ae753640 1 Processor -- start 2023-11-04T01:42:15.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.730+0000 7fc6ae753640 1 -- start start 2023-11-04T01:42:15.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.730+0000 7fc6ae753640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc6a8153e60 0x7fc6a815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.730+0000 7fc6ae753640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc6a80b4880 0x7fc6a80b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.730+0000 7fc6ae753640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a80cde60 con 0x7fc6a80cd6d0 2023-11-04T01:42:15.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.730+0000 7fc6ae753640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6a80b5230 con 0x7fc6a80b4880 2023-11-04T01:42:15.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.730+0000 7fc6ae753640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a8160f90 con 0x7fc6a8153e60 2023-11-04T01:42:15.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.731+0000 7fc6accf0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc6a80b4880 0x7fc6a80b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.731+0000 7fc6accf0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc6a80b4880 0x7fc6a80b4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52154/0 (socket says 172.21.15.77:52154) 2023-11-04T01:42:15.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.731+0000 7fc6a77fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc6a80cd6d0 0x7fc6a8161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55278/0 (socket says 172.21.15.77:55278) 2023-11-04T01:42:15.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.731+0000 7fc6accf0640 1 -- 172.21.15.77:0/93097828 learned_addr learned my addr 172.21.15.77:0/93097828 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:15.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.731+0000 7fc6accf0640 1 -- 172.21.15.77:0/93097828 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc6a8153e60 msgr2=0x7fc6a815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:15.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.731+0000 7fc6a7fff640 1 --2- 172.21.15.77:0/93097828 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc6a8153e60 0x7fc6a815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.731+0000 7fc6a6ffd640 1 -- 172.21.15.77:0/93097828 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4259040854 0 0) 0x7fc6a80cde60 con 0x7fc6a80cd6d0 2023-11-04T01:42:15.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.731+0000 7fc6accf0640 1 --2- 172.21.15.77:0/93097828 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc6a8153e60 0x7fc6a815dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.731+0000 7fc6accf0640 1 -- 172.21.15.77:0/93097828 >> v1:172.21.15.77:6789/0 conn(0x7fc6a80cd6d0 legacy=0x7fc6a8161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.731+0000 7fc6accf0640 1 -- 172.21.15.77:0/93097828 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a815e400 con 0x7fc6a80b4880 2023-11-04T01:42:15.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.731+0000 7fc6a7fff640 1 --2- 172.21.15.77:0/93097828 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc6a8153e60 0x7fc6a815dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:15.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.732+0000 7fc6accf0640 1 --2- 172.21.15.77:0/93097828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6a80b4880 0x7fc6a80b4cf0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0009e50 tx=0x7fc6a002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e459422baecd6f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:15.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.732+0000 7fc6a6ffd640 1 -- 172.21.15.77:0/93097828 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a002cb00 con 0x7fc6a80b4880 2023-11-04T01:42:15.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.732+0000 7fc6a6ffd640 1 -- 172.21.15.77:0/93097828 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a002cc60 con 0x7fc6a80b4880 2023-11-04T01:42:15.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.732+0000 7fc6a6ffd640 1 -- 172.21.15.77:0/93097828 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a00343f0 con 0x7fc6a80b4880 2023-11-04T01:42:15.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.732+0000 7fc6ae753640 1 -- 172.21.15.77:0/93097828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6a80b4880 msgr2=0x7fc6a80b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.732+0000 7fc6ae753640 1 --2- 172.21.15.77:0/93097828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6a80b4880 0x7fc6a80b4cf0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0009e50 tx=0x7fc6a002bf60 comp rx=0 tx=0).stop 2023-11-04T01:42:15.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.732+0000 7fc6ae753640 1 -- 172.21.15.77:0/93097828 shutdown_connections 2023-11-04T01:42:15.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.732+0000 7fc6ae753640 1 --2- 172.21.15.77:0/93097828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6a80b4880 0x7fc6a80b4cf0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.732+0000 7fc6ae753640 1 --2- 172.21.15.77:0/93097828 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc6a8153e60 0x7fc6a815dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.732+0000 7fc6ae753640 1 -- 172.21.15.77:0/93097828 >> 172.21.15.77:0/93097828 conn(0x7fc6a80cf880 msgr2=0x7fc6a80cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:15.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.732+0000 7fc6ae753640 1 -- 172.21.15.77:0/93097828 shutdown_connections 2023-11-04T01:42:15.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.732+0000 7fc6ae753640 1 -- 172.21.15.77:0/93097828 wait complete. 2023-11-04T01:42:15.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.734+0000 7fc6ae753640 1 Processor -- start 2023-11-04T01:42:15.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.734+0000 7fc6ae753640 1 -- start start 2023-11-04T01:42:15.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.734+0000 7fc6ae753640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc6a80b4880 0x7fc6a80c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.734+0000 7fc6ae753640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc6a80cd6d0 0x7fc6a8154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.734+0000 7fc6ae753640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6a8153e60 0x7fc6a81f5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.734+0000 7fc6ae753640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a80c6290 con 0x7fc6a8153e60 2023-11-04T01:42:15.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.734+0000 7fc6ae753640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a8156cb0 con 0x7fc6a80b4880 2023-11-04T01:42:15.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.734+0000 7fc6ae753640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a81560a0 con 0x7fc6a80cd6d0 2023-11-04T01:42:15.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.735+0000 7fc6accf0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6a8153e60 0x7fc6a81f5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.735+0000 7fc6accf0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6a8153e60 0x7fc6a81f5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52168/0 (socket says 172.21.15.77:52168) 2023-11-04T01:42:15.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.735+0000 7fc6accf0640 1 -- 172.21.15.77:0/1692143796 learned_addr learned my addr 172.21.15.77:0/1692143796 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:15.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.735+0000 7fc6a77fe640 1 --2- 172.21.15.77:0/1692143796 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc6a80cd6d0 0x7fc6a8154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.735+0000 7fc6a7fff640 1 --2- 172.21.15.77:0/1692143796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc6a80b4880 0x7fc6a80c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.735+0000 7fc6accf0640 1 -- 172.21.15.77:0/1692143796 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc6a80cd6d0 msgr2=0x7fc6a8154320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.735+0000 7fc6accf0640 1 --2- 172.21.15.77:0/1692143796 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc6a80cd6d0 0x7fc6a8154320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.735+0000 7fc6accf0640 1 -- 172.21.15.77:0/1692143796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc6a80b4880 msgr2=0x7fc6a80c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.735+0000 7fc6accf0640 1 --2- 172.21.15.77:0/1692143796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc6a80b4880 0x7fc6a80c5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.735+0000 7fc6accf0640 1 -- 172.21.15.77:0/1692143796 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a0009b30 con 0x7fc6a8153e60 2023-11-04T01:42:15.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.735+0000 7fc6accf0640 1 --2- 172.21.15.77:0/1692143796 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6a8153e60 0x7fc6a81f5f70 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0009e50 tx=0x7fc6a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:15.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.735+0000 7fc6a4ff9640 1 -- 172.21.15.77:0/1692143796 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0009510 con 0x7fc6a8153e60 2023-11-04T01:42:15.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.735+0000 7fc6a4ff9640 1 -- 172.21.15.77:0/1692143796 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a003e450 con 0x7fc6a8153e60 2023-11-04T01:42:15.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.735+0000 7fc6ae753640 1 -- 172.21.15.77:0/1692143796 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a8156380 con 0x7fc6a8153e60 2023-11-04T01:42:15.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.735+0000 7fc6a4ff9640 1 -- 172.21.15.77:0/1692143796 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a003e7e0 con 0x7fc6a8153e60 2023-11-04T01:42:15.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.735+0000 7fc6ae753640 1 -- 172.21.15.77:0/1692143796 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a8156940 con 0x7fc6a8153e60 2023-11-04T01:42:15.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.736+0000 7fc6ae753640 1 -- 172.21.15.77:0/1692143796 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6a8156e60 con 0x7fc6a8153e60 2023-11-04T01:42:15.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.737+0000 7fc6a4ff9640 1 -- 172.21.15.77:0/1692143796 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc6a003e940 con 0x7fc6a8153e60 2023-11-04T01:42:15.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.737+0000 7fc6a4ff9640 1 --2- 172.21.15.77:0/1692143796 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc69406ae70 0x7fc69406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:15.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.737+0000 7fc6a4ff9640 1 -- 172.21.15.77:0/1692143796 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fc6a00ac3c0 con 0x7fc6a8153e60 2023-11-04T01:42:15.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.737+0000 7fc6a7fff640 1 --2- 172.21.15.77:0/1692143796 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc69406ae70 0x7fc69406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:15.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.738+0000 7fc6a7fff640 1 --2- 172.21.15.77:0/1692143796 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc69406ae70 0x7fc69406d330 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc69800a950 tx=0x7fc698008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:15.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.742+0000 7fc6a4ff9640 1 -- 172.21.15.77:0/1692143796 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc6a8156e60 con 0x7fc6a8153e60 2023-11-04T01:42:15.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.915+0000 7fc6ae753640 1 -- 172.21.15.77:0/1692143796 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc6a8156ad0 con 0x7fc6a8153e60 2023-11-04T01:42:15.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.919+0000 7fc6a4ff9640 1 -- 172.21.15.77:0/1692143796 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v14) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc6a0077560 con 0x7fc6a8153e60 2023-11-04T01:42:15.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.921+0000 7fc6ae753640 1 -- 172.21.15.77:0/1692143796 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc69406ae70 msgr2=0x7fc69406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.921+0000 7fc6ae753640 1 --2- 172.21.15.77:0/1692143796 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc69406ae70 0x7fc69406d330 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc69800a950 tx=0x7fc698008040 comp rx=0 tx=0).stop 2023-11-04T01:42:15.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.921+0000 7fc6ae753640 1 -- 172.21.15.77:0/1692143796 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6a8153e60 msgr2=0x7fc6a81f5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:15.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.921+0000 7fc6ae753640 1 --2- 172.21.15.77:0/1692143796 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6a8153e60 0x7fc6a81f5f70 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0009e50 tx=0x7fc6a0004a40 comp rx=0 tx=0).stop 2023-11-04T01:42:15.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.921+0000 7fc6ae753640 1 -- 172.21.15.77:0/1692143796 shutdown_connections 2023-11-04T01:42:15.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.921+0000 7fc6ae753640 1 --2- 172.21.15.77:0/1692143796 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc69406ae70 0x7fc69406d330 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.921+0000 7fc6ae753640 1 --2- 172.21.15.77:0/1692143796 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6a8153e60 0x7fc6a81f5f70 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.921+0000 7fc6ae753640 1 --2- 172.21.15.77:0/1692143796 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc6a80cd6d0 0x7fc6a8154320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.921+0000 7fc6ae753640 1 --2- 172.21.15.77:0/1692143796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc6a80b4880 0x7fc6a80c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:15.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.921+0000 7fc6ae753640 1 -- 172.21.15.77:0/1692143796 >> 172.21.15.77:0/1692143796 conn(0x7fc6a80cf880 msgr2=0x7fc6a8161420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:15.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.921+0000 7fc6ae753640 1 -- 172.21.15.77:0/1692143796 shutdown_connections 2023-11-04T01:42:15.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:15.921+0000 7fc6ae753640 1 -- 172.21.15.77:0/1692143796 wait complete. 2023-11-04T01:42:15.933 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools' 2023-11-04T01:42:16.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.031+0000 7f6c56061640 1 Processor -- start 2023-11-04T01:42:16.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.031+0000 7f6c56061640 1 -- start start 2023-11-04T01:42:16.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.032+0000 7f6c56061640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6c50160500 0x7f6c5006a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:16.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.032+0000 7f6c56061640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6c500cc040 0x7f6c5006a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:16.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.032+0000 7f6c56061640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c500ce060 con 0x7f6c5006f6e0 2023-11-04T01:42:16.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.032+0000 7f6c56061640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c500b1ce0 con 0x7f6c500cc040 2023-11-04T01:42:16.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.032+0000 7f6c56061640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c500b1fc0 con 0x7f6c50160500 2023-11-04T01:42:16.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.032+0000 7f6c4f7fe640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6c50160500 0x7f6c5006a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:16.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.032+0000 7f6c4ffff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6c500cc040 0x7f6c5006a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:16.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.032+0000 7f6c4f7fe640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6c50160500 0x7f6c5006a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:33824/0 (socket says 172.21.15.77:33824) 2023-11-04T01:42:16.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.032+0000 7f6c4f7fe640 1 -- 172.21.15.77:0/2168070323 learned_addr learned my addr 172.21.15.77:0/2168070323 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:16.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.033+0000 7f6c4f7fe640 1 -- 172.21.15.77:0/2168070323 >> v2:172.21.15.122:3300/0 conn(0x7f6c500cc040 msgr2=0x7f6c5006a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:16.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.033+0000 7f6c4f7fe640 1 --2- 172.21.15.77:0/2168070323 >> v2:172.21.15.122:3300/0 conn(0x7f6c500cc040 0x7f6c5006a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:16.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.033+0000 7f6c4f7fe640 1 -- 172.21.15.77:0/2168070323 >> v1:172.21.15.122:6789/0 conn(0x7f6c5006f6e0 legacy=0x7f6c50160c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:16.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.033+0000 7f6c4f7fe640 1 -- 172.21.15.77:0/2168070323 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c500ce320 con 0x7f6c50160500 2023-11-04T01:42:16.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.033+0000 7f6c4ffff640 1 --2- 172.21.15.77:0/2168070323 >> v2:172.21.15.122:3300/0 conn(0x7f6c500cc040 0x7f6c5006a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:16.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.034+0000 7f6c4f7fe640 1 --2- 172.21.15.77:0/2168070323 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6c50160500 0x7f6c5006a120 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6c40009870 tx=0x7f6c4002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf1160d1bf9495f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:16.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.034+0000 7f6c4e7fc640 1 -- 172.21.15.77:0/2168070323 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c40031640 con 0x7f6c50160500 2023-11-04T01:42:16.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.034+0000 7f6c4e7fc640 1 -- 172.21.15.77:0/2168070323 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c400317a0 con 0x7f6c50160500 2023-11-04T01:42:16.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.034+0000 7f6c4e7fc640 1 -- 172.21.15.77:0/2168070323 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c40031b30 con 0x7f6c50160500 2023-11-04T01:42:16.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.034+0000 7f6c56061640 1 -- 172.21.15.77:0/2168070323 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6c50160500 msgr2=0x7f6c5006a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:16.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.034+0000 7f6c56061640 1 --2- 172.21.15.77:0/2168070323 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6c50160500 0x7f6c5006a120 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6c40009870 tx=0x7f6c4002b8f0 comp rx=0 tx=0).stop 2023-11-04T01:42:16.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.034+0000 7f6c56061640 1 -- 172.21.15.77:0/2168070323 shutdown_connections 2023-11-04T01:42:16.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.034+0000 7f6c56061640 1 --2- 172.21.15.77:0/2168070323 >> v2:172.21.15.122:3300/0 conn(0x7f6c500cc040 0x7f6c5006a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:16.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.034+0000 7f6c56061640 1 --2- 172.21.15.77:0/2168070323 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6c50160500 0x7f6c5006a120 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:16.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.034+0000 7f6c56061640 1 -- 172.21.15.77:0/2168070323 >> 172.21.15.77:0/2168070323 conn(0x7f6c5006d8b0 msgr2=0x7f6c5006dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:16.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.034+0000 7f6c56061640 1 -- 172.21.15.77:0/2168070323 shutdown_connections 2023-11-04T01:42:16.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.034+0000 7f6c56061640 1 -- 172.21.15.77:0/2168070323 wait complete. 2023-11-04T01:42:16.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.035+0000 7f6c56061640 1 Processor -- start 2023-11-04T01:42:16.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.036+0000 7f6c56061640 1 -- start start 2023-11-04T01:42:16.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.036+0000 7f6c56061640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c5006f6e0 0x7f6c5015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:16.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.036+0000 7f6c56061640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6c500cc040 0x7f6c5014ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:16.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.036+0000 7f6c56061640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c50160500 0x7f6c5015c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:16.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.036+0000 7f6c56061640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5015d250 con 0x7f6c50160500 2023-11-04T01:42:16.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.036+0000 7f6c56061640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5015d530 con 0x7f6c5006f6e0 2023-11-04T01:42:16.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.036+0000 7f6c56061640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5015d810 con 0x7f6c500cc040 2023-11-04T01:42:16.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.036+0000 7f6c4ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c50160500 0x7f6c5015c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:16.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.037+0000 7f6c4ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c50160500 0x7f6c5015c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52170/0 (socket says 172.21.15.77:52170) 2023-11-04T01:42:16.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.037+0000 7f6c4ffff640 1 -- 172.21.15.77:0/1373487165 learned_addr learned my addr 172.21.15.77:0/1373487165 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:16.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.037+0000 7f6c4f7fe640 1 --2- 172.21.15.77:0/1373487165 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c5006f6e0 0x7f6c5015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:16.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.037+0000 7f6c4effd640 1 --2- 172.21.15.77:0/1373487165 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6c500cc040 0x7f6c5014ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:16.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.037+0000 7f6c4ffff640 1 -- 172.21.15.77:0/1373487165 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6c500cc040 msgr2=0x7f6c5014ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:16.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.037+0000 7f6c4ffff640 1 --2- 172.21.15.77:0/1373487165 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6c500cc040 0x7f6c5014ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:16.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.037+0000 7f6c4ffff640 1 -- 172.21.15.77:0/1373487165 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c5006f6e0 msgr2=0x7f6c5015e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:16.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.037+0000 7f6c4ffff640 1 --2- 172.21.15.77:0/1373487165 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c5006f6e0 0x7f6c5015e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:16.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.037+0000 7f6c4ffff640 1 -- 172.21.15.77:0/1373487165 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c48009a70 con 0x7f6c50160500 2023-11-04T01:42:16.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.037+0000 7f6c4ffff640 1 --2- 172.21.15.77:0/1373487165 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c50160500 0x7f6c5015c7d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f6c4800efb0 tx=0x7f6c4800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:16.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.037+0000 7f6c37fff640 1 -- 172.21.15.77:0/1373487165 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c48014480 con 0x7f6c50160500 2023-11-04T01:42:16.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.037+0000 7f6c37fff640 1 -- 172.21.15.77:0/1373487165 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4800f040 con 0x7f6c50160500 2023-11-04T01:42:16.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.037+0000 7f6c56061640 1 -- 172.21.15.77:0/1373487165 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c400094d0 con 0x7f6c50160500 2023-11-04T01:42:16.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.037+0000 7f6c37fff640 1 -- 172.21.15.77:0/1373487165 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c48014800 con 0x7f6c50160500 2023-11-04T01:42:16.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.037+0000 7f6c56061640 1 -- 172.21.15.77:0/1373487165 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c5015ddd0 con 0x7f6c50160500 2023-11-04T01:42:16.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.038+0000 7f6c56061640 1 -- 172.21.15.77:0/1373487165 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c50074290 con 0x7f6c50160500 2023-11-04T01:42:16.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.039+0000 7f6c37fff640 1 -- 172.21.15.77:0/1373487165 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6c48014960 con 0x7f6c50160500 2023-11-04T01:42:16.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.039+0000 7f6c37fff640 1 --2- 172.21.15.77:0/1373487165 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6c3c06ae70 0x7f6c3c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:16.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.039+0000 7f6c37fff640 1 -- 172.21.15.77:0/1373487165 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f6c4808a700 con 0x7f6c50160500 2023-11-04T01:42:16.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.039+0000 7f6c4f7fe640 1 --2- 172.21.15.77:0/1373487165 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6c3c06ae70 0x7f6c3c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:16.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.040+0000 7f6c4f7fe640 1 --2- 172.21.15.77:0/1373487165 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6c3c06ae70 0x7f6c3c06d330 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6c40036000 tx=0x7f6c4003c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:16.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.043+0000 7f6c37fff640 1 -- 172.21.15.77:0/1373487165 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6c48055790 con 0x7f6c50160500 2023-11-04T01:42:16.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.273+0000 7f6c56061640 1 -- 172.21.15.77:0/1373487165 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools"]} v 0) v1 -- 0x7f6c5015c550 con 0x7f6c50160500 2023-11-04T01:42:16.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.609+0000 7f6c37fff640 1 -- 172.21.15.77:0/1373487165 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools"]}]=0 v144) v1 ==== 178+0+0 (secure 0 0 0) 0x7f6c48058db0 con 0x7f6c50160500 2023-11-04T01:42:16.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.611+0000 7f6c56061640 1 -- 172.21.15.77:0/1373487165 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6c3c06ae70 msgr2=0x7f6c3c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:16.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.611+0000 7f6c56061640 1 --2- 172.21.15.77:0/1373487165 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6c3c06ae70 0x7f6c3c06d330 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6c40036000 tx=0x7f6c4003c040 comp rx=0 tx=0).stop 2023-11-04T01:42:16.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.611+0000 7f6c56061640 1 -- 172.21.15.77:0/1373487165 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c50160500 msgr2=0x7f6c5015c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:16.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.611+0000 7f6c56061640 1 --2- 172.21.15.77:0/1373487165 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c50160500 0x7f6c5015c7d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f6c4800efb0 tx=0x7f6c4800c490 comp rx=0 tx=0).stop 2023-11-04T01:42:16.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.611+0000 7f6c56061640 1 -- 172.21.15.77:0/1373487165 shutdown_connections 2023-11-04T01:42:16.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.611+0000 7f6c56061640 1 --2- 172.21.15.77:0/1373487165 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6c3c06ae70 0x7f6c3c06d330 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:16.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.611+0000 7f6c56061640 1 --2- 172.21.15.77:0/1373487165 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c50160500 0x7f6c5015c7d0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:16.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.611+0000 7f6c56061640 1 --2- 172.21.15.77:0/1373487165 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6c500cc040 0x7f6c5014ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:16.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.611+0000 7f6c56061640 1 --2- 172.21.15.77:0/1373487165 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c5006f6e0 0x7f6c5015e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:16.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.612+0000 7f6c56061640 1 -- 172.21.15.77:0/1373487165 >> 172.21.15.77:0/1373487165 conn(0x7f6c5006d8b0 msgr2=0x7f6c500cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:16.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.612+0000 7f6c56061640 1 -- 172.21.15.77:0/1373487165 shutdown_connections 2023-11-04T01:42:16.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.612+0000 7f6c56061640 1 -- 172.21.15.77:0/1373487165 wait complete. 2023-11-04T01:42:16.625 INFO:tasks.cephfs_test_runner:Test that creation of monitor managed snaps fails for pools attached ... ok 2023-11-04T01:42:16.625 INFO:tasks.cephfs_test_runner:Starting test: test_using_pool_with_snap_fails_fs_creation (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) Test that using a pool with snaps for fs creation fails 2023-11-04T01:42:16.625 INFO:tasks.cephfs_test_runner:test_using_pool_with_snap_fails_fs_creation (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) 2023-11-04T01:42:16.626 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:16.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.724+0000 7f3eae21a640 1 Processor -- start 2023-11-04T01:42:16.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.724+0000 7f3eae21a640 1 -- start start 2023-11-04T01:42:16.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.725+0000 7f3eae21a640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3ea80cde60 0x7f3ea815d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:16.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.725+0000 7f3eae21a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3ea80ce240 0x7f3ea80d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:16.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.725+0000 7f3eae21a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ea815e000 con 0x7f3ea815daa0 2023-11-04T01:42:16.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.725+0000 7f3eae21a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ea815e5c0 con 0x7f3ea80ce240 2023-11-04T01:42:16.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.725+0000 7f3eae21a640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ea815e2e0 con 0x7f3ea80cde60 2023-11-04T01:42:16.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.725+0000 7f3ea7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3ea80ce240 0x7f3ea80d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:16.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.725+0000 7f3e9effd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f3ea815daa0 0x7f3ea8157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55292/0 (socket says 172.21.15.77:55292) 2023-11-04T01:42:16.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.725+0000 7f3e9effd640 1 -- 172.21.15.77:0/741139819 learned_addr learned my addr 172.21.15.77:0/741139819 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:16.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.726+0000 7f3ea77fe640 1 --2- 172.21.15.77:0/741139819 >> v2:172.21.15.122:3300/0 conn(0x7f3ea80cde60 0x7f3ea815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:16.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.726+0000 7f3ea7fff640 1 -- 172.21.15.77:0/741139819 >> v2:172.21.15.122:3300/0 conn(0x7f3ea80cde60 msgr2=0x7f3ea815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:16.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.726+0000 7f3ea7fff640 1 --2- 172.21.15.77:0/741139819 >> v2:172.21.15.122:3300/0 conn(0x7f3ea80cde60 0x7f3ea815d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:16.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.726+0000 7f3ea7fff640 1 -- 172.21.15.77:0/741139819 >> v1:172.21.15.77:6789/0 conn(0x7f3ea815daa0 legacy=0x7f3ea8157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:16.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.726+0000 7f3ea6ffd640 1 -- 172.21.15.77:0/741139819 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4209545339 0 0) 0x7f3ea815e000 con 0x7f3ea815daa0 2023-11-04T01:42:16.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.726+0000 7f3ea7fff640 1 -- 172.21.15.77:0/741139819 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea80d1120 con 0x7f3ea80ce240 2023-11-04T01:42:16.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.726+0000 7f3ea77fe640 1 --2- 172.21.15.77:0/741139819 >> v2:172.21.15.122:3300/0 conn(0x7f3ea80cde60 0x7f3ea815d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:16.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.726+0000 7f3ea7fff640 1 --2- 172.21.15.77:0/741139819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ea80ce240 0x7f3ea80d1920 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f3ea80b5550 tx=0x7f3ea002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55df252202848dc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:16.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.727+0000 7f3ea6ffd640 1 -- 172.21.15.77:0/741139819 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea002cc80 con 0x7f3ea80ce240 2023-11-04T01:42:16.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.727+0000 7f3ea6ffd640 1 -- 172.21.15.77:0/741139819 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea002cde0 con 0x7f3ea80ce240 2023-11-04T01:42:16.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.727+0000 7f3ea6ffd640 1 -- 172.21.15.77:0/741139819 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea0034660 con 0x7f3ea80ce240 2023-11-04T01:42:16.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.727+0000 7f3eae21a640 1 -- 172.21.15.77:0/741139819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ea80ce240 msgr2=0x7f3ea80d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:16.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.727+0000 7f3eae21a640 1 --2- 172.21.15.77:0/741139819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ea80ce240 0x7f3ea80d1920 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f3ea80b5550 tx=0x7f3ea002bed0 comp rx=0 tx=0).stop 2023-11-04T01:42:16.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.727+0000 7f3eae21a640 1 -- 172.21.15.77:0/741139819 shutdown_connections 2023-11-04T01:42:16.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.727+0000 7f3eae21a640 1 --2- 172.21.15.77:0/741139819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ea80ce240 0x7f3ea80d1920 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:16.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.727+0000 7f3eae21a640 1 --2- 172.21.15.77:0/741139819 >> v2:172.21.15.122:3300/0 conn(0x7f3ea80cde60 0x7f3ea815d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:16.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.727+0000 7f3eae21a640 1 -- 172.21.15.77:0/741139819 >> 172.21.15.77:0/741139819 conn(0x7f3ea8071f30 msgr2=0x7f3ea80cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:16.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.727+0000 7f3eae21a640 1 -- 172.21.15.77:0/741139819 shutdown_connections 2023-11-04T01:42:16.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.727+0000 7f3eae21a640 1 -- 172.21.15.77:0/741139819 wait complete. 2023-11-04T01:42:16.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.728+0000 7f3eae21a640 1 Processor -- start 2023-11-04T01:42:16.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.729+0000 7f3eae21a640 1 -- start start 2023-11-04T01:42:16.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.729+0000 7f3eae21a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ea80cde60 0x7f3ea8151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:16.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.729+0000 7f3eae21a640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3ea80ce240 0x7f3ea814b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:16.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.729+0000 7f3eae21a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ea815daa0 0x7f3ea80cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:16.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.729+0000 7f3eae21a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea814f3e0 con 0x7f3ea80cde60 2023-11-04T01:42:16.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.729+0000 7f3eae21a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea81f2960 con 0x7f3ea815daa0 2023-11-04T01:42:16.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.729+0000 7f3eae21a640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea81f3970 con 0x7f3ea80ce240 2023-11-04T01:42:16.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.729+0000 7f3ea77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ea80cde60 0x7f3ea8151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:16.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.729+0000 7f3ea77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ea80cde60 0x7f3ea8151d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52184/0 (socket says 172.21.15.77:52184) 2023-11-04T01:42:16.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.729+0000 7f3ea77fe640 1 -- 172.21.15.77:0/3623887432 learned_addr learned my addr 172.21.15.77:0/3623887432 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:16.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.729+0000 7f3ea7fff640 1 --2- 172.21.15.77:0/3623887432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ea815daa0 0x7f3ea80cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:16.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.730+0000 7f3e9effd640 1 --2- 172.21.15.77:0/3623887432 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3ea80ce240 0x7f3ea814b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:16.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.730+0000 7f3ea77fe640 1 -- 172.21.15.77:0/3623887432 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3ea80ce240 msgr2=0x7f3ea814b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:16.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.730+0000 7f3ea77fe640 1 --2- 172.21.15.77:0/3623887432 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3ea80ce240 0x7f3ea814b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:16.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.730+0000 7f3ea77fe640 1 -- 172.21.15.77:0/3623887432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ea815daa0 msgr2=0x7f3ea80cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:16.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.730+0000 7f3ea77fe640 1 --2- 172.21.15.77:0/3623887432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ea815daa0 0x7f3ea80cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:16.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.730+0000 7f3ea77fe640 1 -- 172.21.15.77:0/3623887432 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea0009a70 con 0x7f3ea80cde60 2023-11-04T01:42:16.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.730+0000 7f3e9effd640 1 --2- 172.21.15.77:0/3623887432 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3ea80ce240 0x7f3ea814b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:16.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.730+0000 7f3ea77fe640 1 --2- 172.21.15.77:0/3623887432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ea80cde60 0x7f3ea8151d10 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f3e9800c7f0 tx=0x7f3e9800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:16.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.730+0000 7f3ea4ff9640 1 -- 172.21.15.77:0/3623887432 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e98007a30 con 0x7f3ea80cde60 2023-11-04T01:42:16.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.730+0000 7f3ea4ff9640 1 -- 172.21.15.77:0/3623887432 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e98007b90 con 0x7f3ea80cde60 2023-11-04T01:42:16.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.730+0000 7f3eae21a640 1 -- 172.21.15.77:0/3623887432 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ea814b9a0 con 0x7f3ea80cde60 2023-11-04T01:42:16.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.730+0000 7f3ea4ff9640 1 -- 172.21.15.77:0/3623887432 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9800ce40 con 0x7f3ea80cde60 2023-11-04T01:42:16.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.730+0000 7f3eae21a640 1 -- 172.21.15.77:0/3623887432 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea81f2e90 con 0x7f3ea80cde60 2023-11-04T01:42:16.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.731+0000 7f3eae21a640 1 -- 172.21.15.77:0/3623887432 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ea8074290 con 0x7f3ea80cde60 2023-11-04T01:42:16.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.731+0000 7f3ea4ff9640 1 -- 172.21.15.77:0/3623887432 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3e980113f0 con 0x7f3ea80cde60 2023-11-04T01:42:16.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.732+0000 7f3ea4ff9640 1 --2- 172.21.15.77:0/3623887432 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3e8806aea0 0x7f3e8806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:16.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.732+0000 7f3ea4ff9640 1 -- 172.21.15.77:0/3623887432 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f3e98089720 con 0x7f3ea80cde60 2023-11-04T01:42:16.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.732+0000 7f3e9effd640 1 --2- 172.21.15.77:0/3623887432 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3e8806aea0 0x7f3e8806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:16.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.732+0000 7f3e9effd640 1 --2- 172.21.15.77:0/3623887432 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3e8806aea0 0x7f3e8806d360 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3ea81523a0 tx=0x7f3e90009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:16.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.736+0000 7f3ea4ff9640 1 -- 172.21.15.77:0/3623887432 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3e98054840 con 0x7f3ea80cde60 2023-11-04T01:42:16.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.902+0000 7f3eae21a640 1 -- 172.21.15.77:0/3623887432 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ea80b4b20 con 0x7f3ea80cde60 2023-11-04T01:42:16.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.903+0000 7f3ea4ff9640 1 -- 172.21.15.77:0/3623887432 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+14932 (secure 0 0 0) 0x7f3e98057e60 con 0x7f3ea80cde60 2023-11-04T01:42:16.906 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:16.906 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":57,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:42:15.601471+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:6835/1237968770":"2023-11-05T01:42:12.361072+0000","172.21.15.77:6834/1237968770":"2023-11-05T01:42:12.361072+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:16.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.905+0000 7f3eae21a640 1 -- 172.21.15.77:0/3623887432 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3e8806aea0 msgr2=0x7f3e8806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:16.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.905+0000 7f3eae21a640 1 --2- 172.21.15.77:0/3623887432 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3e8806aea0 0x7f3e8806d360 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3ea81523a0 tx=0x7f3e90009040 comp rx=0 tx=0).stop 2023-11-04T01:42:16.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.905+0000 7f3eae21a640 1 -- 172.21.15.77:0/3623887432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ea80cde60 msgr2=0x7f3ea8151d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:16.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.905+0000 7f3eae21a640 1 --2- 172.21.15.77:0/3623887432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ea80cde60 0x7f3ea8151d10 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f3e9800c7f0 tx=0x7f3e9800cbf0 comp rx=0 tx=0).stop 2023-11-04T01:42:16.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.905+0000 7f3eae21a640 1 -- 172.21.15.77:0/3623887432 shutdown_connections 2023-11-04T01:42:16.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.905+0000 7f3eae21a640 1 --2- 172.21.15.77:0/3623887432 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3e8806aea0 0x7f3e8806d360 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:16.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.905+0000 7f3eae21a640 1 --2- 172.21.15.77:0/3623887432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ea815daa0 0x7f3ea80cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:16.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.905+0000 7f3eae21a640 1 --2- 172.21.15.77:0/3623887432 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3ea80ce240 0x7f3ea814b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:16.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.905+0000 7f3eae21a640 1 --2- 172.21.15.77:0/3623887432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ea80cde60 0x7f3ea8151d10 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:16.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.905+0000 7f3eae21a640 1 -- 172.21.15.77:0/3623887432 >> 172.21.15.77:0/3623887432 conn(0x7f3ea8071f30 msgr2=0x7f3ea80b7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:16.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.905+0000 7f3eae21a640 1 -- 172.21.15.77:0/3623887432 shutdown_connections 2023-11-04T01:42:16.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:16.905+0000 7f3eae21a640 1 -- 172.21.15.77:0/3623887432 wait complete. 2023-11-04T01:42:16.918 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:33.142176+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:42:16.918 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:42:17.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.019+0000 7f38c5f78640 1 Processor -- start 2023-11-04T01:42:17.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.019+0000 7f38c5f78640 1 -- start start 2023-11-04T01:42:17.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.020+0000 7f38c5f78640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f38c015e430 0x7f38c00cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.020+0000 7f38c5f78640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f38c00cf160 0x7f38c00cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.020+0000 7f38c5f78640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c00d0280 con 0x7f38c00d0710 2023-11-04T01:42:17.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.020+0000 7f38c5f78640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c00cf670 con 0x7f38c015e430 2023-11-04T01:42:17.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.020+0000 7f38c5f78640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c00cf950 con 0x7f38c00cf160 2023-11-04T01:42:17.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.020+0000 7f38bf7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f38c015e430 0x7f38c00cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.020+0000 7f38bffff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f38c00d0710 0x7f38c00b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55304/0 (socket says 172.21.15.77:55304) 2023-11-04T01:42:17.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.020+0000 7f38bffff640 1 -- 172.21.15.77:0/279145304 learned_addr learned my addr 172.21.15.77:0/279145304 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:17.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.021+0000 7f38bf7fe640 1 -- 172.21.15.77:0/279145304 >> v2:172.21.15.122:3300/0 conn(0x7f38c00cf160 msgr2=0x7f38c00cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:17.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.021+0000 7f38bf7fe640 1 --2- 172.21.15.77:0/279145304 >> v2:172.21.15.122:3300/0 conn(0x7f38c00cf160 0x7f38c00cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.021+0000 7f38bf7fe640 1 -- 172.21.15.77:0/279145304 >> v1:172.21.15.77:6789/0 conn(0x7f38c00d0710 legacy=0x7f38c00b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.021+0000 7f38bf7fe640 1 -- 172.21.15.77:0/279145304 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c00cfc30 con 0x7f38c015e430 2023-11-04T01:42:17.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.021+0000 7f38be7fc640 1 -- 172.21.15.77:0/279145304 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 868833519 0 0) 0x7f38c00d0280 con 0x7f38c00d0710 2023-11-04T01:42:17.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.021+0000 7f38bf7fe640 1 --2- 172.21.15.77:0/279145304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38c015e430 0x7f38c00cec20 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f38c00cb3c0 tx=0x7f38b002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1032b97d2394e766 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:17.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.021+0000 7f38be7fc640 1 -- 172.21.15.77:0/279145304 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b0031830 con 0x7f38c015e430 2023-11-04T01:42:17.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.021+0000 7f38be7fc640 1 -- 172.21.15.77:0/279145304 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b0031990 con 0x7f38c015e430 2023-11-04T01:42:17.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.021+0000 7f38be7fc640 1 -- 172.21.15.77:0/279145304 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b0031d20 con 0x7f38c015e430 2023-11-04T01:42:17.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.022+0000 7f38c5f78640 1 -- 172.21.15.77:0/279145304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38c015e430 msgr2=0x7f38c00cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.022+0000 7f38c5f78640 1 --2- 172.21.15.77:0/279145304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38c015e430 0x7f38c00cec20 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f38c00cb3c0 tx=0x7f38b002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.022+0000 7f38c5f78640 1 -- 172.21.15.77:0/279145304 shutdown_connections 2023-11-04T01:42:17.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.022+0000 7f38c5f78640 1 --2- 172.21.15.77:0/279145304 >> v2:172.21.15.122:3300/0 conn(0x7f38c00cf160 0x7f38c00cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.022+0000 7f38c5f78640 1 --2- 172.21.15.77:0/279145304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38c015e430 0x7f38c00cec20 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.022+0000 7f38c5f78640 1 -- 172.21.15.77:0/279145304 >> 172.21.15.77:0/279145304 conn(0x7f38c006ea20 msgr2=0x7f38c006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:17.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.022+0000 7f38c5f78640 1 -- 172.21.15.77:0/279145304 shutdown_connections 2023-11-04T01:42:17.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.022+0000 7f38c5f78640 1 -- 172.21.15.77:0/279145304 wait complete. 2023-11-04T01:42:17.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.023+0000 7f38c5f78640 1 Processor -- start 2023-11-04T01:42:17.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.023+0000 7f38c5f78640 1 -- start start 2023-11-04T01:42:17.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.024+0000 7f38c5f78640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f38c00cf160 0x7f38c0155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.024+0000 7f38c5f78640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38c00d0710 0x7f38c01efff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.024+0000 7f38c5f78640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38c015e430 0x7f38c0157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.024+0000 7f38c5f78640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c01567d0 con 0x7f38c00d0710 2023-11-04T01:42:17.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.024+0000 7f38c5f78640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c0156ab0 con 0x7f38c015e430 2023-11-04T01:42:17.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.024+0000 7f38c5f78640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c0156d90 con 0x7f38c00cf160 2023-11-04T01:42:17.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.024+0000 7f38beffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38c00d0710 0x7f38c01efff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.024+0000 7f38beffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38c00d0710 0x7f38c01efff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52204/0 (socket says 172.21.15.77:52204) 2023-11-04T01:42:17.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.024+0000 7f38beffd640 1 -- 172.21.15.77:0/1792114981 learned_addr learned my addr 172.21.15.77:0/1792114981 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:17.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.024+0000 7f38bf7fe640 1 --2- 172.21.15.77:0/1792114981 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f38c00cf160 0x7f38c0155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.024+0000 7f38bffff640 1 --2- 172.21.15.77:0/1792114981 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38c015e430 0x7f38c0157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.024+0000 7f38beffd640 1 -- 172.21.15.77:0/1792114981 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f38c00cf160 msgr2=0x7f38c0155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.024+0000 7f38beffd640 1 --2- 172.21.15.77:0/1792114981 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f38c00cf160 0x7f38c0155ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.024+0000 7f38beffd640 1 -- 172.21.15.77:0/1792114981 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38c015e430 msgr2=0x7f38c0157430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.024+0000 7f38beffd640 1 --2- 172.21.15.77:0/1792114981 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38c015e430 0x7f38c0157430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.024+0000 7f38beffd640 1 -- 172.21.15.77:0/1792114981 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b0009400 con 0x7f38c00d0710 2023-11-04T01:42:17.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.025+0000 7f38beffd640 1 --2- 172.21.15.77:0/1792114981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38c00d0710 0x7f38c01efff0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f38b400b410 tx=0x7f38b400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:17.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.025+0000 7f38a7fff640 1 -- 172.21.15.77:0/1792114981 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b4011830 con 0x7f38c00d0710 2023-11-04T01:42:17.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.025+0000 7f38a7fff640 1 -- 172.21.15.77:0/1792114981 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b40119b0 con 0x7f38c00d0710 2023-11-04T01:42:17.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.025+0000 7f38a7fff640 1 -- 172.21.15.77:0/1792114981 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b4011d60 con 0x7f38c00d0710 2023-11-04T01:42:17.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.025+0000 7f38c5f78640 1 -- 172.21.15.77:0/1792114981 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c00b05e0 con 0x7f38c00d0710 2023-11-04T01:42:17.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.025+0000 7f38c5f78640 1 -- 172.21.15.77:0/1792114981 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c0156430 con 0x7f38c00d0710 2023-11-04T01:42:17.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.026+0000 7f38c5f78640 1 -- 172.21.15.77:0/1792114981 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c00b0b00 con 0x7f38c00d0710 2023-11-04T01:42:17.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.026+0000 7f38a7fff640 1 -- 172.21.15.77:0/1792114981 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f38b401a400 con 0x7f38c00d0710 2023-11-04T01:42:17.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.026+0000 7f38a7fff640 1 --2- 172.21.15.77:0/1792114981 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f38ac06ae70 0x7f38ac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.027+0000 7f38a7fff640 1 -- 172.21.15.77:0/1792114981 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f38b4089780 con 0x7f38c00d0710 2023-11-04T01:42:17.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.027+0000 7f38bf7fe640 1 --2- 172.21.15.77:0/1792114981 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f38ac06ae70 0x7f38ac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.027+0000 7f38bf7fe640 1 --2- 172.21.15.77:0/1792114981 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f38ac06ae70 0x7f38ac06d330 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f38b0036000 tx=0x7f38b0008030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:17.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.031+0000 7f38a7fff640 1 -- 172.21.15.77:0/1792114981 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f38c00b0b00 con 0x7f38c00d0710 2023-11-04T01:42:17.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.195+0000 7f38c5f78640 1 -- 172.21.15.77:0/1792114981 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f38c00b0b00 con 0x7f38c00d0710 2023-11-04T01:42:17.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.196+0000 7f38a7fff640 1 -- 172.21.15.77:0/1792114981 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) v1 ==== 93+0+10 (secure 0 0 0) 0x7f38c00b0b00 con 0x7f38c00d0710 2023-11-04T01:42:17.198 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:42:17.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.197+0000 7f38c5f78640 1 -- 172.21.15.77:0/1792114981 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f38ac06ae70 msgr2=0x7f38ac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.197+0000 7f38c5f78640 1 --2- 172.21.15.77:0/1792114981 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f38ac06ae70 0x7f38ac06d330 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f38b0036000 tx=0x7f38b0008030 comp rx=0 tx=0).stop 2023-11-04T01:42:17.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.197+0000 7f38c5f78640 1 -- 172.21.15.77:0/1792114981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38c00d0710 msgr2=0x7f38c01efff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.197+0000 7f38c5f78640 1 --2- 172.21.15.77:0/1792114981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38c00d0710 0x7f38c01efff0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f38b400b410 tx=0x7f38b400b8d0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.197+0000 7f38c5f78640 1 -- 172.21.15.77:0/1792114981 shutdown_connections 2023-11-04T01:42:17.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.197+0000 7f38c5f78640 1 --2- 172.21.15.77:0/1792114981 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f38ac06ae70 0x7f38ac06d330 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.197+0000 7f38c5f78640 1 --2- 172.21.15.77:0/1792114981 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38c015e430 0x7f38c0157430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.197+0000 7f38c5f78640 1 --2- 172.21.15.77:0/1792114981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38c00d0710 0x7f38c01efff0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.197+0000 7f38c5f78640 1 --2- 172.21.15.77:0/1792114981 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f38c00cf160 0x7f38c0155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.197+0000 7f38c5f78640 1 -- 172.21.15.77:0/1792114981 >> 172.21.15.77:0/1792114981 conn(0x7f38c006ea20 msgr2=0x7f38c00c4700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:17.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.198+0000 7f38c5f78640 1 -- 172.21.15.77:0/1792114981 shutdown_connections 2023-11-04T01:42:17.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.198+0000 7f38c5f78640 1 -- 172.21.15.77:0/1792114981 wait complete. 2023-11-04T01:42:17.210 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:42:17.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.310+0000 7fe32faec640 1 Processor -- start 2023-11-04T01:42:17.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.310+0000 7fe32faec640 1 -- start start 2023-11-04T01:42:17.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.311+0000 7fe32faec640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe3280b1a40 0x7fe3280ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.311+0000 7fe32faec640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe32806a830 0x7fe3280cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.311+0000 7fe32faec640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe328160990 con 0x7fe3281605b0 2023-11-04T01:42:17.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.311+0000 7fe32faec640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3280cc7c0 con 0x7fe3280b1a40 2023-11-04T01:42:17.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.311+0000 7fe32faec640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3280cd750 con 0x7fe32806a830 2023-11-04T01:42:17.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.311+0000 7fe32d087640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe3280b1a40 0x7fe3280ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.311+0000 7fe32d087640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe3280b1a40 0x7fe3280ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52212/0 (socket says 172.21.15.77:52212) 2023-11-04T01:42:17.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.311+0000 7fe32d087640 1 -- 172.21.15.77:0/3438409636 learned_addr learned my addr 172.21.15.77:0/3438409636 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:17.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.311+0000 7fe32d888640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe3281605b0 0x7fe32806a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55320/0 (socket says 172.21.15.77:55320) 2023-11-04T01:42:17.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.312+0000 7fe32e089640 1 --2- 172.21.15.77:0/3438409636 >> v2:172.21.15.122:3300/0 conn(0x7fe32806a830 0x7fe3280cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.312+0000 7fe32d087640 1 -- 172.21.15.77:0/3438409636 >> v2:172.21.15.122:3300/0 conn(0x7fe32806a830 msgr2=0x7fe3280cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:17.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.312+0000 7fe32d087640 1 --2- 172.21.15.77:0/3438409636 >> v2:172.21.15.122:3300/0 conn(0x7fe32806a830 0x7fe3280cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.312+0000 7fe32d087640 1 -- 172.21.15.77:0/3438409636 >> v1:172.21.15.77:6789/0 conn(0x7fe3281605b0 legacy=0x7fe32806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.312+0000 7fe32d087640 1 -- 172.21.15.77:0/3438409636 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3280cc4e0 con 0x7fe3280b1a40 2023-11-04T01:42:17.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.312+0000 7fe32c886640 1 -- 172.21.15.77:0/3438409636 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 394480259 0 0) 0x7fe328160990 con 0x7fe3281605b0 2023-11-04T01:42:17.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.312+0000 7fe32d087640 1 --2- 172.21.15.77:0/3438409636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3280b1a40 0x7fe3280ccbc0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fe3280c6aa0 tx=0x7fe31802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d6c9f80373b68c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:17.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.312+0000 7fe32c886640 1 -- 172.21.15.77:0/3438409636 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3180317e0 con 0x7fe3280b1a40 2023-11-04T01:42:17.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.313+0000 7fe32c886640 1 -- 172.21.15.77:0/3438409636 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe318031940 con 0x7fe3280b1a40 2023-11-04T01:42:17.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.313+0000 7fe32c886640 1 -- 172.21.15.77:0/3438409636 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe318031cd0 con 0x7fe3280b1a40 2023-11-04T01:42:17.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.313+0000 7fe32faec640 1 -- 172.21.15.77:0/3438409636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3280b1a40 msgr2=0x7fe3280ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.313+0000 7fe32faec640 1 --2- 172.21.15.77:0/3438409636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3280b1a40 0x7fe3280ccbc0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fe3280c6aa0 tx=0x7fe31802b880 comp rx=0 tx=0).stop 2023-11-04T01:42:17.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.313+0000 7fe32faec640 1 -- 172.21.15.77:0/3438409636 shutdown_connections 2023-11-04T01:42:17.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.313+0000 7fe32faec640 1 --2- 172.21.15.77:0/3438409636 >> v2:172.21.15.122:3300/0 conn(0x7fe32806a830 0x7fe3280cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.313+0000 7fe32faec640 1 --2- 172.21.15.77:0/3438409636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3280b1a40 0x7fe3280ccbc0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.313+0000 7fe32faec640 1 -- 172.21.15.77:0/3438409636 >> 172.21.15.77:0/3438409636 conn(0x7fe328071820 msgr2=0x7fe328071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:17.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.313+0000 7fe32faec640 1 -- 172.21.15.77:0/3438409636 shutdown_connections 2023-11-04T01:42:17.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.313+0000 7fe32faec640 1 -- 172.21.15.77:0/3438409636 wait complete. 2023-11-04T01:42:17.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.314+0000 7fe32faec640 1 Processor -- start 2023-11-04T01:42:17.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.314+0000 7fe32faec640 1 -- start start 2023-11-04T01:42:17.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.315+0000 7fe32faec640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe32806a830 0x7fe32814a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.315+0000 7fe32faec640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe3281605b0 0x7fe3280b4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.315+0000 7fe32faec640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3280b46a0 0x7fe32815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.315+0000 7fe32faec640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32814aaf0 con 0x7fe3280b46a0 2023-11-04T01:42:17.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.315+0000 7fe32faec640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3280b55a0 con 0x7fe32806a830 2023-11-04T01:42:17.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.315+0000 7fe32faec640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3280b4d00 con 0x7fe3281605b0 2023-11-04T01:42:17.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.315+0000 7fe32e089640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3280b46a0 0x7fe32815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.315+0000 7fe32e089640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3280b46a0 0x7fe32815cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52218/0 (socket says 172.21.15.77:52218) 2023-11-04T01:42:17.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.315+0000 7fe32e089640 1 -- 172.21.15.77:0/1248699374 learned_addr learned my addr 172.21.15.77:0/1248699374 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:17.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.315+0000 7fe32d888640 1 --2- 172.21.15.77:0/1248699374 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe32806a830 0x7fe32814a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.315+0000 7fe32d087640 1 --2- 172.21.15.77:0/1248699374 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe3281605b0 0x7fe3280b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.315+0000 7fe32e089640 1 -- 172.21.15.77:0/1248699374 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe3281605b0 msgr2=0x7fe3280b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.315+0000 7fe32e089640 1 --2- 172.21.15.77:0/1248699374 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe3281605b0 0x7fe3280b4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.315+0000 7fe32e089640 1 -- 172.21.15.77:0/1248699374 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe32806a830 msgr2=0x7fe32814a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.315+0000 7fe32e089640 1 --2- 172.21.15.77:0/1248699374 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe32806a830 0x7fe32814a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.315+0000 7fe32e089640 1 -- 172.21.15.77:0/1248699374 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3180094d0 con 0x7fe3280b46a0 2023-11-04T01:42:17.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.315+0000 7fe32d087640 1 --2- 172.21.15.77:0/1248699374 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe3281605b0 0x7fe3280b4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:17.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.316+0000 7fe32e089640 1 --2- 172.21.15.77:0/1248699374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3280b46a0 0x7fe32815cac0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fe32000d5d0 tx=0x7fe32000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:17.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.316+0000 7fe31e7fc640 1 -- 172.21.15.77:0/1248699374 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3200125f0 con 0x7fe3280b46a0 2023-11-04T01:42:17.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.316+0000 7fe31e7fc640 1 -- 172.21.15.77:0/1248699374 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe320012770 con 0x7fe3280b46a0 2023-11-04T01:42:17.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.316+0000 7fe32faec640 1 -- 172.21.15.77:0/1248699374 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3280b4fe0 con 0x7fe3280b46a0 2023-11-04T01:42:17.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.316+0000 7fe31e7fc640 1 -- 172.21.15.77:0/1248699374 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe320012b20 con 0x7fe3280b46a0 2023-11-04T01:42:17.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.316+0000 7fe32faec640 1 -- 172.21.15.77:0/1248699374 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe32814ae60 con 0x7fe3280b46a0 2023-11-04T01:42:17.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.317+0000 7fe32faec640 1 -- 172.21.15.77:0/1248699374 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3280672a0 con 0x7fe3280b46a0 2023-11-04T01:42:17.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.317+0000 7fe31e7fc640 1 -- 172.21.15.77:0/1248699374 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe320012c80 con 0x7fe3280b46a0 2023-11-04T01:42:17.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.317+0000 7fe31e7fc640 1 --2- 172.21.15.77:0/1248699374 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe30c06ae70 0x7fe30c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.318+0000 7fe31e7fc640 1 -- 172.21.15.77:0/1248699374 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fe320089a80 con 0x7fe3280b46a0 2023-11-04T01:42:17.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.318+0000 7fe32d888640 1 --2- 172.21.15.77:0/1248699374 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe30c06ae70 0x7fe30c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.318+0000 7fe32d888640 1 --2- 172.21.15.77:0/1248699374 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe30c06ae70 0x7fe30c06d330 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe324007ed0 tx=0x7fe324007e60 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:17.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.322+0000 7fe31e7fc640 1 -- 172.21.15.77:0/1248699374 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe320054ba0 con 0x7fe3280b46a0 2023-11-04T01:42:17.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.486+0000 7fe32faec640 1 -- 172.21.15.77:0/1248699374 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fe328074290 con 0x7fe3280b46a0 2023-11-04T01:42:17.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.487+0000 7fe31e7fc640 1 -- 172.21.15.77:0/1248699374 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v57) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe3200581c0 con 0x7fe3280b46a0 2023-11-04T01:42:17.489 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:42:17.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.488+0000 7fe32faec640 1 -- 172.21.15.77:0/1248699374 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe30c06ae70 msgr2=0x7fe30c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.488+0000 7fe32faec640 1 --2- 172.21.15.77:0/1248699374 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe30c06ae70 0x7fe30c06d330 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe324007ed0 tx=0x7fe324007e60 comp rx=0 tx=0).stop 2023-11-04T01:42:17.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.488+0000 7fe32faec640 1 -- 172.21.15.77:0/1248699374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3280b46a0 msgr2=0x7fe32815cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.488+0000 7fe32faec640 1 --2- 172.21.15.77:0/1248699374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3280b46a0 0x7fe32815cac0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fe32000d5d0 tx=0x7fe32000da90 comp rx=0 tx=0).stop 2023-11-04T01:42:17.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.488+0000 7fe32faec640 1 -- 172.21.15.77:0/1248699374 shutdown_connections 2023-11-04T01:42:17.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.488+0000 7fe32faec640 1 --2- 172.21.15.77:0/1248699374 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe30c06ae70 0x7fe30c06d330 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.488+0000 7fe32faec640 1 --2- 172.21.15.77:0/1248699374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3280b46a0 0x7fe32815cac0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.488+0000 7fe32faec640 1 --2- 172.21.15.77:0/1248699374 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe3281605b0 0x7fe3280b4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.488+0000 7fe32faec640 1 --2- 172.21.15.77:0/1248699374 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe32806a830 0x7fe32814a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.488+0000 7fe32faec640 1 -- 172.21.15.77:0/1248699374 >> 172.21.15.77:0/1248699374 conn(0x7fe328071820 msgr2=0x7fe3280af550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:17.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.489+0000 7fe32faec640 1 -- 172.21.15.77:0/1248699374 shutdown_connections 2023-11-04T01:42:17.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.489+0000 7fe32faec640 1 -- 172.21.15.77:0/1248699374 wait complete. 2023-11-04T01:42:17.501 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation' 2023-11-04T01:42:17.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.599+0000 7f1086661640 1 Processor -- start 2023-11-04T01:42:17.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.599+0000 7f1086661640 1 -- start start 2023-11-04T01:42:17.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.600+0000 7f1086661640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f108015ce70 0x7f108006d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.600+0000 7f1086661640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f10800cb5c0 0x7f10800ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.600+0000 7f1086661640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f108006a120 con 0x7f108015d250 2023-11-04T01:42:17.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.600+0000 7f1086661640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10800cdc10 con 0x7f10800cb5c0 2023-11-04T01:42:17.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.600+0000 7f1086661640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108006def0 con 0x7f108015ce70 2023-11-04T01:42:17.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.600+0000 7f1084bfe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f10800cb5c0 0x7f10800ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.600+0000 7f1084bfe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f10800cb5c0 0x7f10800ccdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58070/0 (socket says 172.21.15.77:58070) 2023-11-04T01:42:17.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.600+0000 7f1084bfe640 1 -- 172.21.15.77:0/2863162811 learned_addr learned my addr 172.21.15.77:0/2863162811 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:17.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.600+0000 7f107f7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f108015d250 0x7f10800c9830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35666/0 (socket says 172.21.15.77:35666) 2023-11-04T01:42:17.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.600+0000 7f107ffff640 1 --2- 172.21.15.77:0/2863162811 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f108015ce70 0x7f108006d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.601+0000 7f1084bfe640 1 -- 172.21.15.77:0/2863162811 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f108015ce70 msgr2=0x7f108006d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:17.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.601+0000 7f1084bfe640 1 --2- 172.21.15.77:0/2863162811 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f108015ce70 0x7f108006d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.601+0000 7f1084bfe640 1 -- 172.21.15.77:0/2863162811 >> v1:172.21.15.77:6789/0 conn(0x7f108015d250 legacy=0x7f10800c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.601+0000 7f1084bfe640 1 -- 172.21.15.77:0/2863162811 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10800c9f40 con 0x7f10800cb5c0 2023-11-04T01:42:17.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.601+0000 7f107effd640 1 -- 172.21.15.77:0/2863162811 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2549866965 0 0) 0x7f108006a120 con 0x7f108015d250 2023-11-04T01:42:17.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.601+0000 7f1084bfe640 1 --2- 172.21.15.77:0/2863162811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10800cb5c0 0x7f10800ccdb0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f1078009e50 tx=0x7f107802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd54c873dd18c10d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:17.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.601+0000 7f107effd640 1 -- 172.21.15.77:0/2863162811 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107802cb00 con 0x7f10800cb5c0 2023-11-04T01:42:17.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.602+0000 7f107effd640 1 -- 172.21.15.77:0/2863162811 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107802cc60 con 0x7f10800cb5c0 2023-11-04T01:42:17.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.602+0000 7f107effd640 1 -- 172.21.15.77:0/2863162811 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10780343f0 con 0x7f10800cb5c0 2023-11-04T01:42:17.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.602+0000 7f1086661640 1 -- 172.21.15.77:0/2863162811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10800cb5c0 msgr2=0x7f10800ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.602+0000 7f1086661640 1 --2- 172.21.15.77:0/2863162811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10800cb5c0 0x7f10800ccdb0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f1078009e50 tx=0x7f107802bf60 comp rx=0 tx=0).stop 2023-11-04T01:42:17.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.602+0000 7f1086661640 1 -- 172.21.15.77:0/2863162811 shutdown_connections 2023-11-04T01:42:17.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.602+0000 7f1086661640 1 --2- 172.21.15.77:0/2863162811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10800cb5c0 0x7f10800ccdb0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.602+0000 7f1086661640 1 --2- 172.21.15.77:0/2863162811 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f108015ce70 0x7f108006d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.602+0000 7f1086661640 1 -- 172.21.15.77:0/2863162811 >> 172.21.15.77:0/2863162811 conn(0x7f10800b0cd0 msgr2=0x7f10800b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:17.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.602+0000 7f1086661640 1 -- 172.21.15.77:0/2863162811 shutdown_connections 2023-11-04T01:42:17.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.602+0000 7f1086661640 1 -- 172.21.15.77:0/2863162811 wait complete. 2023-11-04T01:42:17.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.603+0000 7f1086661640 1 Processor -- start 2023-11-04T01:42:17.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.604+0000 7f1086661640 1 -- start start 2023-11-04T01:42:17.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.604+0000 7f1086661640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f10800cb5c0 0x7f108014d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.604+0000 7f1086661640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f108015ce70 0x7f10800acb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.604+0000 7f1086661640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f108015d250 0x7f10800ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.604+0000 7f1086661640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10801e3360 con 0x7f108015ce70 2023-11-04T01:42:17.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.604+0000 7f1086661640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10800c34a0 con 0x7f108015d250 2023-11-04T01:42:17.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.604+0000 7f1086661640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10800c3d40 con 0x7f10800cb5c0 2023-11-04T01:42:17.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.604+0000 7f107f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f108015ce70 0x7f10800acb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.604+0000 7f107f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f108015ce70 0x7f10800acb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58078/0 (socket says 172.21.15.77:58078) 2023-11-04T01:42:17.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.604+0000 7f107f7fe640 1 -- 172.21.15.77:0/3750448777 learned_addr learned my addr 172.21.15.77:0/3750448777 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:17.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.605+0000 7f1084bfe640 1 --2- 172.21.15.77:0/3750448777 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f108015d250 0x7f10800ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.605+0000 7f107f7fe640 1 -- 172.21.15.77:0/3750448777 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f10800cb5c0 msgr2=0x7f108014d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.605+0000 7f107ffff640 1 --2- 172.21.15.77:0/3750448777 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f10800cb5c0 0x7f108014d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.605+0000 7f107f7fe640 1 --2- 172.21.15.77:0/3750448777 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f10800cb5c0 0x7f108014d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.605+0000 7f107f7fe640 1 -- 172.21.15.77:0/3750448777 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f108015d250 msgr2=0x7f10800ad0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.605+0000 7f107f7fe640 1 --2- 172.21.15.77:0/3750448777 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f108015d250 0x7f10800ad0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.605+0000 7f107f7fe640 1 -- 172.21.15.77:0/3750448777 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1078009b30 con 0x7f108015ce70 2023-11-04T01:42:17.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.605+0000 7f1084bfe640 1 --2- 172.21.15.77:0/3750448777 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f108015d250 0x7f10800ad0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:17.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.605+0000 7f107ffff640 1 --2- 172.21.15.77:0/3750448777 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f10800cb5c0 0x7f108014d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:17.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.605+0000 7f107f7fe640 1 --2- 172.21.15.77:0/3750448777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f108015ce70 0x7f10800acb70 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f107400c4b0 tx=0x7f107400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:17.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.605+0000 7f107cff9640 1 -- 172.21.15.77:0/3750448777 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10740074e0 con 0x7f108015ce70 2023-11-04T01:42:17.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.605+0000 7f107cff9640 1 -- 172.21.15.77:0/3750448777 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1074007660 con 0x7f108015ce70 2023-11-04T01:42:17.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.605+0000 7f1086661640 1 -- 172.21.15.77:0/3750448777 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f108014da50 con 0x7f108015ce70 2023-11-04T01:42:17.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.605+0000 7f107cff9640 1 -- 172.21.15.77:0/3750448777 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1074004a20 con 0x7f108015ce70 2023-11-04T01:42:17.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.605+0000 7f1086661640 1 -- 172.21.15.77:0/3750448777 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10800c36f0 con 0x7f108015ce70 2023-11-04T01:42:17.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.606+0000 7f1086661640 1 -- 172.21.15.77:0/3750448777 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10800c3eb0 con 0x7f108015ce70 2023-11-04T01:42:17.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.606+0000 7f107cff9640 1 -- 172.21.15.77:0/3750448777 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1074004b80 con 0x7f108015ce70 2023-11-04T01:42:17.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.607+0000 7f107cff9640 1 --2- 172.21.15.77:0/3750448777 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f106c06ae70 0x7f106c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.607+0000 7f107cff9640 1 -- 172.21.15.77:0/3750448777 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f1074088a70 con 0x7f108015ce70 2023-11-04T01:42:17.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.607+0000 7f107ffff640 1 --2- 172.21.15.77:0/3750448777 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f106c06ae70 0x7f106c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.608+0000 7f107ffff640 1 --2- 172.21.15.77:0/3750448777 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f106c06ae70 0x7f106c06d330 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1070006fd0 tx=0x7f1070008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:17.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.611+0000 7f107cff9640 1 -- 172.21.15.77:0/3750448777 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1074053c40 con 0x7f108015ce70 2023-11-04T01:42:17.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:17.843+0000 7f1086661640 1 -- 172.21.15.77:0/3750448777 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation"]} v 0) v1 -- 0x7f1080074290 con 0x7f108015ce70 2023-11-04T01:42:18.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.617+0000 7f107cff9640 1 -- 172.21.15.77:0/3750448777 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation"]}]=0 v146) v1 ==== 176+0+0 (secure 0 0 0) 0x7f1074018020 con 0x7f108015ce70 2023-11-04T01:42:18.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.620+0000 7f1086661640 1 -- 172.21.15.77:0/3750448777 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f106c06ae70 msgr2=0x7f106c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:18.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.620+0000 7f1086661640 1 --2- 172.21.15.77:0/3750448777 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f106c06ae70 0x7f106c06d330 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1070006fd0 tx=0x7f1070008040 comp rx=0 tx=0).stop 2023-11-04T01:42:18.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.620+0000 7f1086661640 1 -- 172.21.15.77:0/3750448777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f108015ce70 msgr2=0x7f10800acb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:18.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.620+0000 7f1086661640 1 --2- 172.21.15.77:0/3750448777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f108015ce70 0x7f10800acb70 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f107400c4b0 tx=0x7f107400c970 comp rx=0 tx=0).stop 2023-11-04T01:42:18.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.620+0000 7f1086661640 1 -- 172.21.15.77:0/3750448777 shutdown_connections 2023-11-04T01:42:18.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.620+0000 7f1086661640 1 --2- 172.21.15.77:0/3750448777 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f106c06ae70 0x7f106c06d330 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.620+0000 7f1086661640 1 --2- 172.21.15.77:0/3750448777 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f108015d250 0x7f10800ad0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.620+0000 7f1086661640 1 --2- 172.21.15.77:0/3750448777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f108015ce70 0x7f10800acb70 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.620+0000 7f1086661640 1 --2- 172.21.15.77:0/3750448777 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f10800cb5c0 0x7f108014d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.620+0000 7f1086661640 1 -- 172.21.15.77:0/3750448777 >> 172.21.15.77:0/3750448777 conn(0x7f10800b0cd0 msgr2=0x7f10800c2040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:18.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.620+0000 7f1086661640 1 -- 172.21.15.77:0/3750448777 shutdown_connections 2023-11-04T01:42:18.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.620+0000 7f1086661640 1 -- 172.21.15.77:0/3750448777 wait complete. 2023-11-04T01:42:18.635 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-04T01:42:18.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.742+0000 7f94392b4640 1 Processor -- start 2023-11-04T01:42:18.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.742+0000 7f94392b4640 1 -- start start 2023-11-04T01:42:18.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.743+0000 7f94392b4640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9434153e60 0x7f943415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:18.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.743+0000 7f94392b4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f94340b4880 0x7f94340b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:18.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.743+0000 7f94392b4640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94340cde60 con 0x7f94340cd6d0 2023-11-04T01:42:18.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.743+0000 7f94392b4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94340b5230 con 0x7f94340b4880 2023-11-04T01:42:18.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.743+0000 7f94392b4640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9434160f90 con 0x7f9434153e60 2023-11-04T01:42:18.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.743+0000 7f94337fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f94340b4880 0x7f94340b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:18.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.743+0000 7f94337fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f94340b4880 0x7f94340b4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58082/0 (socket says 172.21.15.77:58082) 2023-11-04T01:42:18.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.743+0000 7f94337fe640 1 -- 172.21.15.77:0/2279317187 learned_addr learned my addr 172.21.15.77:0/2279317187 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:18.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.743+0000 7f94337fe640 1 -- 172.21.15.77:0/2279317187 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9434153e60 msgr2=0x7f943415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:18.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.743+0000 7f9432ffd640 1 --2- 172.21.15.77:0/2279317187 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9434153e60 0x7f943415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:18.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.743+0000 7f94337fe640 1 --2- 172.21.15.77:0/2279317187 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9434153e60 0x7f943415dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.743+0000 7f94337fe640 1 -- 172.21.15.77:0/2279317187 >> v1:172.21.15.122:6789/0 conn(0x7f94340cd6d0 legacy=0x7f9434161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:18.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.743+0000 7f94337fe640 1 -- 172.21.15.77:0/2279317187 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943415e400 con 0x7f94340b4880 2023-11-04T01:42:18.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.743+0000 7f9432ffd640 1 --2- 172.21.15.77:0/2279317187 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9434153e60 0x7f943415dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:18.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.744+0000 7f94337fe640 1 --2- 172.21.15.77:0/2279317187 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94340b4880 0x7f94340b4cf0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f942c009e50 tx=0x7f942c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e11585351380c32 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:18.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.744+0000 7f9431ffb640 1 -- 172.21.15.77:0/2279317187 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c02ca70 con 0x7f94340b4880 2023-11-04T01:42:18.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.744+0000 7f9431ffb640 1 -- 172.21.15.77:0/2279317187 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942c02cbd0 con 0x7f94340b4880 2023-11-04T01:42:18.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.744+0000 7f9431ffb640 1 -- 172.21.15.77:0/2279317187 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c0343f0 con 0x7f94340b4880 2023-11-04T01:42:18.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.745+0000 7f94392b4640 1 -- 172.21.15.77:0/2279317187 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94340b4880 msgr2=0x7f94340b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:18.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.745+0000 7f94392b4640 1 --2- 172.21.15.77:0/2279317187 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94340b4880 0x7f94340b4cf0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f942c009e50 tx=0x7f942c02bed0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.745+0000 7f94392b4640 1 -- 172.21.15.77:0/2279317187 shutdown_connections 2023-11-04T01:42:18.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.745+0000 7f94392b4640 1 --2- 172.21.15.77:0/2279317187 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94340b4880 0x7f94340b4cf0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.745+0000 7f94392b4640 1 --2- 172.21.15.77:0/2279317187 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9434153e60 0x7f943415dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.745+0000 7f94392b4640 1 -- 172.21.15.77:0/2279317187 >> 172.21.15.77:0/2279317187 conn(0x7f94340cf880 msgr2=0x7f94340cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:18.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.745+0000 7f94392b4640 1 -- 172.21.15.77:0/2279317187 shutdown_connections 2023-11-04T01:42:18.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.745+0000 7f94392b4640 1 -- 172.21.15.77:0/2279317187 wait complete. 2023-11-04T01:42:18.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.746+0000 7f94392b4640 1 Processor -- start 2023-11-04T01:42:18.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.746+0000 7f94392b4640 1 -- start start 2023-11-04T01:42:18.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.747+0000 7f94392b4640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f94340b4880 0x7f94341f2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:18.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.747+0000 7f94392b4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94340cd6d0 0x7f94340c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:18.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.747+0000 7f94392b4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9434153e60 0x7f94340c9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:18.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.747+0000 7f94392b4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9434148630 con 0x7f94340cd6d0 2023-11-04T01:42:18.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.747+0000 7f94392b4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9434154cf0 con 0x7f9434153e60 2023-11-04T01:42:18.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.747+0000 7f94392b4640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9434156c70 con 0x7f94340b4880 2023-11-04T01:42:18.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.747+0000 7f94327fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94340cd6d0 0x7f94340c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:18.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.747+0000 7f94327fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94340cd6d0 0x7f94340c8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58094/0 (socket says 172.21.15.77:58094) 2023-11-04T01:42:18.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.747+0000 7f94327fc640 1 -- 172.21.15.77:0/1957986648 learned_addr learned my addr 172.21.15.77:0/1957986648 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:18.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.747+0000 7f94337fe640 1 --2- 172.21.15.77:0/1957986648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9434153e60 0x7f94340c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:18.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.747+0000 7f9432ffd640 1 --2- 172.21.15.77:0/1957986648 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f94340b4880 0x7f94341f2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:18.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.747+0000 7f94327fc640 1 -- 172.21.15.77:0/1957986648 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f94340b4880 msgr2=0x7f94341f2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:18.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.747+0000 7f94327fc640 1 --2- 172.21.15.77:0/1957986648 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f94340b4880 0x7f94341f2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.747+0000 7f94327fc640 1 -- 172.21.15.77:0/1957986648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9434153e60 msgr2=0x7f94340c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:18.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.747+0000 7f94327fc640 1 --2- 172.21.15.77:0/1957986648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9434153e60 0x7f94340c9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.747+0000 7f94327fc640 1 -- 172.21.15.77:0/1957986648 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f942c009b30 con 0x7f94340cd6d0 2023-11-04T01:42:18.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.747+0000 7f94327fc640 1 --2- 172.21.15.77:0/1957986648 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94340cd6d0 0x7f94340c8e40 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f942800c430 tx=0x7f942800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:18.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.747+0000 7f941b7fe640 1 -- 172.21.15.77:0/1957986648 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9428011790 con 0x7f94340cd6d0 2023-11-04T01:42:18.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.747+0000 7f941b7fe640 1 -- 172.21.15.77:0/1957986648 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94280118f0 con 0x7f94340cd6d0 2023-11-04T01:42:18.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.747+0000 7f94392b4640 1 -- 172.21.15.77:0/1957986648 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94341543c0 con 0x7f94340cd6d0 2023-11-04T01:42:18.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.747+0000 7f941b7fe640 1 -- 172.21.15.77:0/1957986648 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9428011ca0 con 0x7f94340cd6d0 2023-11-04T01:42:18.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.747+0000 7f94392b4640 1 -- 172.21.15.77:0/1957986648 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9434154980 con 0x7f94340cd6d0 2023-11-04T01:42:18.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.748+0000 7f94392b4640 1 -- 172.21.15.77:0/1957986648 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9434160c00 con 0x7f94340cd6d0 2023-11-04T01:42:18.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.749+0000 7f941b7fe640 1 -- 172.21.15.77:0/1957986648 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f942801c460 con 0x7f94340cd6d0 2023-11-04T01:42:18.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.749+0000 7f941b7fe640 1 --2- 172.21.15.77:0/1957986648 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f942006ae70 0x7f942006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:18.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.749+0000 7f941b7fe640 1 -- 172.21.15.77:0/1957986648 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f9428089520 con 0x7f94340cd6d0 2023-11-04T01:42:18.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.749+0000 7f9432ffd640 1 --2- 172.21.15.77:0/1957986648 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f942006ae70 0x7f942006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:18.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.750+0000 7f9432ffd640 1 --2- 172.21.15.77:0/1957986648 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f942006ae70 0x7f942006d330 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f942400a950 tx=0x7f9424008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:18.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.754+0000 7f941b7fe640 1 -- 172.21.15.77:0/1957986648 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9434160c00 con 0x7f94340cd6d0 2023-11-04T01:42:18.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.919+0000 7f94392b4640 1 -- 172.21.15.77:0/1957986648 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f9434154ea0 con 0x7f94340cd6d0 2023-11-04T01:42:18.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.922+0000 7f941b7fe640 1 -- 172.21.15.77:0/1957986648 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v15)=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9434154ea0 con 0x7f94340cd6d0 2023-11-04T01:42:18.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.924+0000 7f94392b4640 1 -- 172.21.15.77:0/1957986648 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f942006ae70 msgr2=0x7f942006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:18.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.924+0000 7f94392b4640 1 --2- 172.21.15.77:0/1957986648 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f942006ae70 0x7f942006d330 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f942400a950 tx=0x7f9424008040 comp rx=0 tx=0).stop 2023-11-04T01:42:18.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.924+0000 7f94392b4640 1 -- 172.21.15.77:0/1957986648 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94340cd6d0 msgr2=0x7f94340c8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:18.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.924+0000 7f94392b4640 1 --2- 172.21.15.77:0/1957986648 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94340cd6d0 0x7f94340c8e40 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f942800c430 tx=0x7f942800c8f0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.924+0000 7f94392b4640 1 -- 172.21.15.77:0/1957986648 shutdown_connections 2023-11-04T01:42:18.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.924+0000 7f94392b4640 1 --2- 172.21.15.77:0/1957986648 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f942006ae70 0x7f942006d330 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.924+0000 7f94392b4640 1 --2- 172.21.15.77:0/1957986648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9434153e60 0x7f94340c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.924+0000 7f94392b4640 1 --2- 172.21.15.77:0/1957986648 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94340cd6d0 0x7f94340c8e40 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.924+0000 7f94392b4640 1 --2- 172.21.15.77:0/1957986648 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f94340b4880 0x7f94341f2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.924+0000 7f94392b4640 1 -- 172.21.15.77:0/1957986648 >> 172.21.15.77:0/1957986648 conn(0x7f94340cf880 msgr2=0x7f94340d18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:18.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.924+0000 7f94392b4640 1 -- 172.21.15.77:0/1957986648 shutdown_connections 2023-11-04T01:42:18.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:18.924+0000 7f94392b4640 1 -- 172.21.15.77:0/1957986648 wait complete. 2023-11-04T01:42:18.936 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:42:18.937 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:42:18.978 DEBUG:teuthology.orchestra.run.smithi122:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:42:19.024 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:42:19.025 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:42:19.025 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:42:19.040 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19534 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:42:19.041 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:42:19.041 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:42:19.059 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056339,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13650 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:42:19.059 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:42:19.060 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:42:19.094 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19534 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:42:19.095 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:42:19.095 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:42:19.116 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056339,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13650 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:42:19.117 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-04T01:42:19.117 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:19.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.231+0000 7ff55a77c640 1 Processor -- start 2023-11-04T01:42:19.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.231+0000 7ff55a77c640 1 -- start start 2023-11-04T01:42:19.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.232+0000 7ff55a77c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff55415ad80 0x7ff55406c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.232+0000 7ff55a77c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff5540c9e10 0x7ff5540b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.232+0000 7ff55a77c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff55406cd00 con 0x7ff5540b42c0 2023-11-04T01:42:19.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.232+0000 7ff55a77c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff55406cfa0 con 0x7ff55415ad80 2023-11-04T01:42:19.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.232+0000 7ff55a77c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff55406d280 con 0x7ff5540c9e10 2023-11-04T01:42:19.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.232+0000 7ff553fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff55415ad80 0x7ff55406c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.232+0000 7ff5537fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ff5540b42c0 0x7ff5540c9700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35682/0 (socket says 172.21.15.77:35682) 2023-11-04T01:42:19.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.232+0000 7ff5537fe640 1 -- 172.21.15.77:0/495598717 learned_addr learned my addr 172.21.15.77:0/495598717 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:19.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.232+0000 7ff558d19640 1 --2- 172.21.15.77:0/495598717 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff5540c9e10 0x7ff5540b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.232+0000 7ff553fff640 1 -- 172.21.15.77:0/495598717 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff5540c9e10 msgr2=0x7ff5540b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:19.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.232+0000 7ff553fff640 1 --2- 172.21.15.77:0/495598717 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff5540c9e10 0x7ff5540b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.232+0000 7ff553fff640 1 -- 172.21.15.77:0/495598717 >> v1:172.21.15.77:6789/0 conn(0x7ff5540b42c0 legacy=0x7ff5540c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:19.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.232+0000 7ff553fff640 1 -- 172.21.15.77:0/495598717 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff55406d560 con 0x7ff55415ad80 2023-11-04T01:42:19.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.233+0000 7ff553fff640 1 --2- 172.21.15.77:0/495598717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff55415ad80 0x7ff55406c7c0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7ff5440097a0 tx=0x7ff54402b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8335a27c5fdf5d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:19.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.233+0000 7ff552ffd640 1 -- 172.21.15.77:0/495598717 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff544030800 con 0x7ff55415ad80 2023-11-04T01:42:19.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.233+0000 7ff552ffd640 1 -- 172.21.15.77:0/495598717 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff544030960 con 0x7ff55415ad80 2023-11-04T01:42:19.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.233+0000 7ff552ffd640 1 -- 172.21.15.77:0/495598717 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff544030cf0 con 0x7ff55415ad80 2023-11-04T01:42:19.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.234+0000 7ff55a77c640 1 -- 172.21.15.77:0/495598717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff55415ad80 msgr2=0x7ff55406c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:19.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.234+0000 7ff55a77c640 1 --2- 172.21.15.77:0/495598717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff55415ad80 0x7ff55406c7c0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7ff5440097a0 tx=0x7ff54402b940 comp rx=0 tx=0).stop 2023-11-04T01:42:19.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.234+0000 7ff55a77c640 1 -- 172.21.15.77:0/495598717 shutdown_connections 2023-11-04T01:42:19.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.234+0000 7ff55a77c640 1 --2- 172.21.15.77:0/495598717 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff5540c9e10 0x7ff5540b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.234+0000 7ff55a77c640 1 --2- 172.21.15.77:0/495598717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff55415ad80 0x7ff55406c7c0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.234+0000 7ff55a77c640 1 -- 172.21.15.77:0/495598717 >> 172.21.15.77:0/495598717 conn(0x7ff5540ce950 msgr2=0x7ff5540ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:19.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.234+0000 7ff55a77c640 1 -- 172.21.15.77:0/495598717 shutdown_connections 2023-11-04T01:42:19.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.234+0000 7ff55a77c640 1 -- 172.21.15.77:0/495598717 wait complete. 2023-11-04T01:42:19.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.235+0000 7ff55a77c640 1 Processor -- start 2023-11-04T01:42:19.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.235+0000 7ff55a77c640 1 -- start start 2023-11-04T01:42:19.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.236+0000 7ff55a77c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5540b42c0 0x7ff554151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.236+0000 7ff55a77c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff5540c9e10 0x7ff554156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.236+0000 7ff55a77c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff55415ad80 0x7ff554156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.236+0000 7ff55a77c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff554153e80 con 0x7ff55415ad80 2023-11-04T01:42:19.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.236+0000 7ff55a77c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5541f0d60 con 0x7ff5540b42c0 2023-11-04T01:42:19.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.236+0000 7ff55a77c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5541f1040 con 0x7ff5540c9e10 2023-11-04T01:42:19.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.236+0000 7ff558d19640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff55415ad80 0x7ff554156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.236+0000 7ff558d19640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff55415ad80 0x7ff554156fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58108/0 (socket says 172.21.15.77:58108) 2023-11-04T01:42:19.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.236+0000 7ff558d19640 1 -- 172.21.15.77:0/988279453 learned_addr learned my addr 172.21.15.77:0/988279453 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:19.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.236+0000 7ff5537fe640 1 --2- 172.21.15.77:0/988279453 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff5540c9e10 0x7ff554156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.236+0000 7ff553fff640 1 --2- 172.21.15.77:0/988279453 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5540b42c0 0x7ff554151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.236+0000 7ff558d19640 1 -- 172.21.15.77:0/988279453 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff5540c9e10 msgr2=0x7ff554156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:19.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.236+0000 7ff558d19640 1 --2- 172.21.15.77:0/988279453 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff5540c9e10 0x7ff554156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.236+0000 7ff558d19640 1 -- 172.21.15.77:0/988279453 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5540b42c0 msgr2=0x7ff554151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:19.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.236+0000 7ff558d19640 1 --2- 172.21.15.77:0/988279453 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5540b42c0 0x7ff554151790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.236+0000 7ff558d19640 1 -- 172.21.15.77:0/988279453 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff544009400 con 0x7ff55415ad80 2023-11-04T01:42:19.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.236+0000 7ff5537fe640 1 --2- 172.21.15.77:0/988279453 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff5540c9e10 0x7ff554156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:19.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.236+0000 7ff553fff640 1 --2- 172.21.15.77:0/988279453 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5540b42c0 0x7ff554151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:19.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.237+0000 7ff558d19640 1 --2- 172.21.15.77:0/988279453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff55415ad80 0x7ff554156fe0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7ff54c007e40 tx=0x7ff54c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:19.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.237+0000 7ff550ff9640 1 -- 172.21.15.77:0/988279453 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54c014620 con 0x7ff55415ad80 2023-11-04T01:42:19.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.237+0000 7ff550ff9640 1 -- 172.21.15.77:0/988279453 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54c00ee90 con 0x7ff55415ad80 2023-11-04T01:42:19.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.237+0000 7ff55a77c640 1 -- 172.21.15.77:0/988279453 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5541f1320 con 0x7ff55415ad80 2023-11-04T01:42:19.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.237+0000 7ff550ff9640 1 -- 172.21.15.77:0/988279453 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54c0149e0 con 0x7ff55415ad80 2023-11-04T01:42:19.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.237+0000 7ff55a77c640 1 -- 172.21.15.77:0/988279453 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5541f1b20 con 0x7ff55415ad80 2023-11-04T01:42:19.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.238+0000 7ff55a77c640 1 -- 172.21.15.77:0/988279453 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5541f1840 con 0x7ff55415ad80 2023-11-04T01:42:19.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.238+0000 7ff550ff9640 1 -- 172.21.15.77:0/988279453 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff54c014b40 con 0x7ff55415ad80 2023-11-04T01:42:19.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.239+0000 7ff550ff9640 1 --2- 172.21.15.77:0/988279453 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff54006ae70 0x7ff54006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.239+0000 7ff550ff9640 1 -- 172.21.15.77:0/988279453 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5616+0+0 (secure 0 0 0) 0x7ff54c089fb0 con 0x7ff55415ad80 2023-11-04T01:42:19.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.239+0000 7ff553fff640 1 --2- 172.21.15.77:0/988279453 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff54006ae70 0x7ff54006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.239+0000 7ff553fff640 1 --2- 172.21.15.77:0/988279453 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff54006ae70 0x7ff54006d330 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff544036000 tx=0x7ff54403b040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:19.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.243+0000 7ff550ff9640 1 -- 172.21.15.77:0/988279453 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff54c0bcca0 con 0x7ff55415ad80 2023-11-04T01:42:19.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.444+0000 7ff55a77c640 1 -- 172.21.15.77:0/988279453 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff554074290 con 0x7ff55415ad80 2023-11-04T01:42:19.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.444+0000 7ff550ff9640 1 -- 172.21.15.77:0/988279453 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+3705 (secure 0 0 0) 0x7ff5541f1840 con 0x7ff55415ad80 2023-11-04T01:42:19.446 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:19.447 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5458,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2636406417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2636406417},{"type":"v1","addr":"172.21.15.122:6836","nonce":2636406417}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5461,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/2931907615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":2931907615},{"type":"v1","addr":"172.21.15.122:6837","nonce":2931907615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5955,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1507226082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1507226082},{"type":"v1","addr":"172.21.15.77:6833","nonce":1507226082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":6300,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3092672128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":3092672128},{"type":"v1","addr":"172.21.15.77:6835","nonce":3092672128}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24}],"filesystems":[]} 2023-11-04T01:42:19.448 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 24 2023-11-04T01:42:19.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.446+0000 7ff55a77c640 1 -- 172.21.15.77:0/988279453 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff54006ae70 msgr2=0x7ff54006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:19.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.446+0000 7ff55a77c640 1 --2- 172.21.15.77:0/988279453 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff54006ae70 0x7ff54006d330 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff544036000 tx=0x7ff54403b040 comp rx=0 tx=0).stop 2023-11-04T01:42:19.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.446+0000 7ff55a77c640 1 -- 172.21.15.77:0/988279453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff55415ad80 msgr2=0x7ff554156fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:19.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.446+0000 7ff55a77c640 1 --2- 172.21.15.77:0/988279453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff55415ad80 0x7ff554156fe0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7ff54c007e40 tx=0x7ff54c00e4b0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.446+0000 7ff55a77c640 1 -- 172.21.15.77:0/988279453 shutdown_connections 2023-11-04T01:42:19.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.446+0000 7ff55a77c640 1 --2- 172.21.15.77:0/988279453 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff54006ae70 0x7ff54006d330 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.446+0000 7ff55a77c640 1 --2- 172.21.15.77:0/988279453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff55415ad80 0x7ff554156fe0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.446+0000 7ff55a77c640 1 --2- 172.21.15.77:0/988279453 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff5540c9e10 0x7ff554156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.446+0000 7ff55a77c640 1 --2- 172.21.15.77:0/988279453 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5540b42c0 0x7ff554151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.446+0000 7ff55a77c640 1 -- 172.21.15.77:0/988279453 >> 172.21.15.77:0/988279453 conn(0x7ff5540ce950 msgr2=0x7ff5540ae890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:19.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.446+0000 7ff55a77c640 1 -- 172.21.15.77:0/988279453 shutdown_connections 2023-11-04T01:42:19.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.446+0000 7ff55a77c640 1 -- 172.21.15.77:0/988279453 wait complete. 2023-11-04T01:42:19.459 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:42:19.459 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:42:19.460 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:42:19.460 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:42:19.460 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:42:19.461 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:42:19.461 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:42:19.462 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:42:19.462 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:42:19.465 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:42:19.466 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:42:19.467 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:42:19.467 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:42:19.467 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:42:19.468 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:42:19.468 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:42:19.469 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:42:19.470 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:42:19.471 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:42:19.471 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:42:19.478 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:42:19.479 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:42:19.480 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:42:19.480 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:42:19.513 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:42:19.514 DEBUG:teuthology.parallel:result is None 2023-11-04T01:42:19.515 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:42:19.515 DEBUG:teuthology.parallel:result is None 2023-11-04T01:42:19.521 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:42:19.522 DEBUG:teuthology.parallel:result is None 2023-11-04T01:42:19.522 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:42:19.523 DEBUG:teuthology.parallel:result is None 2023-11-04T01:42:19.523 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-04T01:42:19.588 INFO:tasks.ceph.mds.a.smithi077.stdout:starting mds.a at 2023-11-04T01:42:19.589 INFO:tasks.ceph.mds.c.smithi077.stdout:starting mds.c at 2023-11-04T01:42:19.606 INFO:tasks.ceph.mds.b.smithi122.stdout:starting mds.b at 2023-11-04T01:42:19.606 INFO:tasks.ceph.mds.d.smithi122.stdout:starting mds.d at 2023-11-04T01:42:19.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.627+0000 7f8112f55640 1 Processor -- start 2023-11-04T01:42:19.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.627+0000 7f8112f55640 1 -- start start 2023-11-04T01:42:19.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.628+0000 7f8112f55640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f810c153e60 0x7f810c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.628+0000 7f8112f55640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f810c0cd6d0 0x7f810c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.628+0000 7f8112f55640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f810c0cde60 con 0x7f810c0b4880 2023-11-04T01:42:19.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.628+0000 7f8112f55640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f810c160f90 con 0x7f810c0cd6d0 2023-11-04T01:42:19.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.628+0000 7f8112f55640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810c15e400 con 0x7f810c153e60 2023-11-04T01:42:19.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.628+0000 7f810bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f810c0cd6d0 0x7f810c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.628+0000 7f810bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f810c0cd6d0 0x7f810c161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58156/0 (socket says 172.21.15.77:58156) 2023-11-04T01:42:19.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.628+0000 7f810bfff640 1 -- 172.21.15.77:0/702920456 learned_addr learned my addr 172.21.15.77:0/702920456 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:19.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.628+0000 7f8110cf1640 1 --2- 172.21.15.77:0/702920456 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f810c153e60 0x7f810c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.629+0000 7f810bfff640 1 -- 172.21.15.77:0/702920456 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f810c153e60 msgr2=0x7f810c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:19.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.629+0000 7f810bfff640 1 --2- 172.21.15.77:0/702920456 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f810c153e60 0x7f810c15dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.629+0000 7f810bfff640 1 -- 172.21.15.77:0/702920456 >> v1:172.21.15.122:6789/0 conn(0x7f810c0b4880 legacy=0x7f810c06b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:19.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.629+0000 7f810bfff640 1 -- 172.21.15.77:0/702920456 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810c161960 con 0x7f810c0cd6d0 2023-11-04T01:42:19.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.629+0000 7f810bfff640 1 --2- 172.21.15.77:0/702920456 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f810c0cd6d0 0x7f810c161420 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f8100009870 tx=0x7f810002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a53c83cfbb6203 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:19.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.630+0000 7f810b7fe640 1 -- 172.21.15.77:0/702920456 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100030840 con 0x7f810c0cd6d0 2023-11-04T01:42:19.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.630+0000 7f810b7fe640 1 -- 172.21.15.77:0/702920456 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81000309a0 con 0x7f810c0cd6d0 2023-11-04T01:42:19.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.630+0000 7f810b7fe640 1 -- 172.21.15.77:0/702920456 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100030d30 con 0x7f810c0cd6d0 2023-11-04T01:42:19.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.630+0000 7f8112f55640 1 -- 172.21.15.77:0/702920456 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f810c0cd6d0 msgr2=0x7f810c161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:19.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.630+0000 7f8112f55640 1 --2- 172.21.15.77:0/702920456 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f810c0cd6d0 0x7f810c161420 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f8100009870 tx=0x7f810002b980 comp rx=0 tx=0).stop 2023-11-04T01:42:19.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.630+0000 7f8112f55640 1 -- 172.21.15.77:0/702920456 shutdown_connections 2023-11-04T01:42:19.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.630+0000 7f8112f55640 1 --2- 172.21.15.77:0/702920456 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f810c0cd6d0 0x7f810c161420 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.630+0000 7f8112f55640 1 --2- 172.21.15.77:0/702920456 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f810c153e60 0x7f810c15dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.630+0000 7f8112f55640 1 -- 172.21.15.77:0/702920456 >> 172.21.15.77:0/702920456 conn(0x7f810c0cf880 msgr2=0x7f810c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:19.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.631+0000 7f8112f55640 1 -- 172.21.15.77:0/702920456 shutdown_connections 2023-11-04T01:42:19.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.631+0000 7f8112f55640 1 -- 172.21.15.77:0/702920456 wait complete. 2023-11-04T01:42:19.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.632+0000 7f8112f55640 1 Processor -- start 2023-11-04T01:42:19.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.632+0000 7f8112f55640 1 -- start start 2023-11-04T01:42:19.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.633+0000 7f8112f55640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f810c0b4880 0x7f810c1533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.633+0000 7f8112f55640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f810c0cd6d0 0x7f810c157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.633+0000 7f8112f55640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f810c153e60 0x7f810c159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.633+0000 7f8112f55640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c1538e0 con 0x7f810c153e60 2023-11-04T01:42:19.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.633+0000 7f8112f55640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c1f3ca0 con 0x7f810c0cd6d0 2023-11-04T01:42:19.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.633+0000 7f8112f55640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810c0cbe00 con 0x7f810c0b4880 2023-11-04T01:42:19.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.633+0000 7f81114f2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f810c153e60 0x7f810c159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.633+0000 7f81114f2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f810c153e60 0x7f810c159160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58160/0 (socket says 172.21.15.77:58160) 2023-11-04T01:42:19.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.633+0000 7f81114f2640 1 -- 172.21.15.77:0/854886985 learned_addr learned my addr 172.21.15.77:0/854886985 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:19.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.633+0000 7f8110cf1640 1 --2- 172.21.15.77:0/854886985 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f810c0b4880 0x7f810c1533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.633+0000 7f810bfff640 1 --2- 172.21.15.77:0/854886985 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f810c0cd6d0 0x7f810c157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.634+0000 7f81114f2640 1 -- 172.21.15.77:0/854886985 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f810c0b4880 msgr2=0x7f810c1533a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:19.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.634+0000 7f81114f2640 1 --2- 172.21.15.77:0/854886985 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f810c0b4880 0x7f810c1533a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.634+0000 7f81114f2640 1 -- 172.21.15.77:0/854886985 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f810c0cd6d0 msgr2=0x7f810c157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:19.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.634+0000 7f81114f2640 1 --2- 172.21.15.77:0/854886985 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f810c0cd6d0 0x7f810c157060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:19.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.634+0000 7f81114f2640 1 -- 172.21.15.77:0/854886985 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81000094d0 con 0x7f810c153e60 2023-11-04T01:42:19.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.634+0000 7f81114f2640 1 --2- 172.21.15.77:0/854886985 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f810c153e60 0x7f810c159160 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f810400c710 tx=0x7f810400cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:19.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.634+0000 7f81097fa640 1 -- 172.21.15.77:0/854886985 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8104006d50 con 0x7f810c153e60 2023-11-04T01:42:19.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.634+0000 7f81097fa640 1 -- 172.21.15.77:0/854886985 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810400ce20 con 0x7f810c153e60 2023-11-04T01:42:19.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.634+0000 7f8112f55640 1 -- 172.21.15.77:0/854886985 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f810c15a350 con 0x7f810c153e60 2023-11-04T01:42:19.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.634+0000 7f81097fa640 1 -- 172.21.15.77:0/854886985 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8104003bb0 con 0x7f810c153e60 2023-11-04T01:42:19.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.634+0000 7f8112f55640 1 -- 172.21.15.77:0/854886985 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810c15a910 con 0x7f810c153e60 2023-11-04T01:42:19.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.635+0000 7f8112f55640 1 -- 172.21.15.77:0/854886985 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f810c160be0 con 0x7f810c153e60 2023-11-04T01:42:19.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.635+0000 7f81097fa640 1 -- 172.21.15.77:0/854886985 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8104003d10 con 0x7f810c153e60 2023-11-04T01:42:19.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.636+0000 7f81097fa640 1 --2- 172.21.15.77:0/854886985 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f80f806ae70 0x7f80f806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:19.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.636+0000 7f81097fa640 1 -- 172.21.15.77:0/854886985 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f8104089050 con 0x7f810c153e60 2023-11-04T01:42:19.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.636+0000 7f8110cf1640 1 --2- 172.21.15.77:0/854886985 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f80f806ae70 0x7f80f806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:19.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.637+0000 7f8110cf1640 1 --2- 172.21.15.77:0/854886985 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f80f806ae70 0x7f80f806d330 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f80fc009aa0 tx=0x7f80fc009190 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:19.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.640+0000 7f81097fa640 1 -- 172.21.15.77:0/854886985 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8104057c80 con 0x7f810c153e60 2023-11-04T01:42:19.681 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-11-04T01:42:19.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:19.818+0000 7f8112f55640 1 -- 172.21.15.77:0/854886985 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f810c074290 con 0x7f810c153e60 2023-11-04T01:42:20.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.635+0000 7f81097fa640 1 -- 172.21.15.77:0/854886985 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v62) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8104057810 con 0x7f810c153e60 2023-11-04T01:42:20.638 INFO:teuthology.orchestra.run.smithi077.stderr: removed all blocklist entries 2023-11-04T01:42:20.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.638+0000 7f8112f55640 1 -- 172.21.15.77:0/854886985 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f80f806ae70 msgr2=0x7f80f806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.638+0000 7f8112f55640 1 --2- 172.21.15.77:0/854886985 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f80f806ae70 0x7f80f806d330 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f80fc009aa0 tx=0x7f80fc009190 comp rx=0 tx=0).stop 2023-11-04T01:42:20.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.638+0000 7f8112f55640 1 -- 172.21.15.77:0/854886985 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f810c153e60 msgr2=0x7f810c159160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.638+0000 7f8112f55640 1 --2- 172.21.15.77:0/854886985 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f810c153e60 0x7f810c159160 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f810400c710 tx=0x7f810400cbd0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.638+0000 7f8112f55640 1 -- 172.21.15.77:0/854886985 shutdown_connections 2023-11-04T01:42:20.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.638+0000 7f8112f55640 1 --2- 172.21.15.77:0/854886985 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f80f806ae70 0x7f80f806d330 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.638+0000 7f8112f55640 1 --2- 172.21.15.77:0/854886985 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f810c153e60 0x7f810c159160 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.638+0000 7f8112f55640 1 --2- 172.21.15.77:0/854886985 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f810c0cd6d0 0x7f810c157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.638+0000 7f8112f55640 1 --2- 172.21.15.77:0/854886985 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f810c0b4880 0x7f810c1533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.638+0000 7f8112f55640 1 -- 172.21.15.77:0/854886985 >> 172.21.15.77:0/854886985 conn(0x7f810c0cf880 msgr2=0x7f810c15e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:20.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.638+0000 7f8112f55640 1 -- 172.21.15.77:0/854886985 shutdown_connections 2023-11-04T01:42:20.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.638+0000 7f8112f55640 1 -- 172.21.15.77:0/854886985 wait complete. 2023-11-04T01:42:20.653 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-04T01:42:20.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.756+0000 7f18c0325640 1 Processor -- start 2023-11-04T01:42:20.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.756+0000 7f18c0325640 1 -- start start 2023-11-04T01:42:20.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.757+0000 7f18c0325640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f18b8159c70 0x7f18b80ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.757+0000 7f18c0325640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f18b806db20 0x7f18b80b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.757+0000 7f18c0325640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18b80b4110 con 0x7f18b80b0910 2023-11-04T01:42:20.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.757+0000 7f18c0325640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b80b49b0 con 0x7f18b8159c70 2023-11-04T01:42:20.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.757+0000 7f18c0325640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b80b0da0 con 0x7f18b806db20 2023-11-04T01:42:20.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.757+0000 7f18be8c2640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f18b80b0910 0x7f18b815d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35708/0 (socket says 172.21.15.77:35708) 2023-11-04T01:42:20.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.757+0000 7f18be8c2640 1 -- 172.21.15.77:0/1021136136 learned_addr learned my addr 172.21.15.77:0/1021136136 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:20.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.757+0000 7f18be0c1640 1 --2- 172.21.15.77:0/1021136136 >> v2:172.21.15.122:3300/0 conn(0x7f18b8159c70 0x7f18b80ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.757+0000 7f18bd8c0640 1 --2- 172.21.15.77:0/1021136136 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f18b806db20 0x7f18b80b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.757+0000 7f18bd0bf640 1 -- 172.21.15.77:0/1021136136 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2282578032 0 0) 0x7f18b80b4110 con 0x7f18b80b0910 2023-11-04T01:42:20.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.757+0000 7f18bd0bf640 1 -- 172.21.15.77:0/1021136136 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18a4003520 con 0x7f18b80b0910 2023-11-04T01:42:20.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.757+0000 7f18bd0bf640 1 -- 172.21.15.77:0/1021136136 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 260765995 0 0) 0x7f18a4003520 con 0x7f18b80b0910 2023-11-04T01:42:20.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.757+0000 7f18bd0bf640 1 -- 172.21.15.77:0/1021136136 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f18b806db20 msgr2=0x7f18b80b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:20.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.757+0000 7f18bd0bf640 1 --2- 172.21.15.77:0/1021136136 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f18b806db20 0x7f18b80b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.757+0000 7f18bd0bf640 1 -- 172.21.15.77:0/1021136136 >> v2:172.21.15.122:3300/0 conn(0x7f18b8159c70 msgr2=0x7f18b80ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:20.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.757+0000 7f18bd0bf640 1 --2- 172.21.15.77:0/1021136136 >> v2:172.21.15.122:3300/0 conn(0x7f18b8159c70 0x7f18b80ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.757+0000 7f18bd0bf640 1 -- 172.21.15.77:0/1021136136 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b80b43f0 con 0x7f18b80b0910 2023-11-04T01:42:20.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.757+0000 7f18bd0bf640 1 -- 172.21.15.77:0/1021136136 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f18b00019f0 con 0x7f18b80b0910 2023-11-04T01:42:20.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.757+0000 7f18be0c1640 1 --2- 172.21.15.77:0/1021136136 >> v2:172.21.15.122:3300/0 conn(0x7f18b8159c70 0x7f18b80ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:20.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.757+0000 7f18bd0bf640 1 -- 172.21.15.77:0/1021136136 >> v1:172.21.15.77:6789/0 conn(0x7f18b80b0910 legacy=0x7f18b815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.757+0000 7f18bd0bf640 1 --2- 172.21.15.77:0/1021136136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18a4003970 0x7f18a4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.757+0000 7f18bd0bf640 1 --2- 172.21.15.77:0/1021136136 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f18b806db20 0x7f18a40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.757+0000 7f18bd0bf640 1 --2- 172.21.15.77:0/1021136136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f18a4004d00 0x7f18a4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.757+0000 7f18bd0bf640 1 -- 172.21.15.77:0/1021136136 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b80b49b0 con 0x7f18a4003970 2023-11-04T01:42:20.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.757+0000 7f18bd0bf640 1 -- 172.21.15.77:0/1021136136 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b80b0da0 con 0x7f18a4004d00 2023-11-04T01:42:20.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.757+0000 7f18bd0bf640 1 -- 172.21.15.77:0/1021136136 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a400b980 con 0x7f18b806db20 2023-11-04T01:42:20.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.758+0000 7f18be0c1640 1 --2- 172.21.15.77:0/1021136136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18a4003970 0x7f18a4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.758+0000 7f18bd8c0640 1 --2- 172.21.15.77:0/1021136136 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f18b806db20 0x7f18a40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.758+0000 7f18be8c2640 1 --2- 172.21.15.77:0/1021136136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f18a4004d00 0x7f18a4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.758+0000 7f18be0c1640 1 -- 172.21.15.77:0/1021136136 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f18b806db20 msgr2=0x7f18a40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:20.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.758+0000 7f18be0c1640 1 --2- 172.21.15.77:0/1021136136 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f18b806db20 0x7f18a40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.758+0000 7f18be0c1640 1 -- 172.21.15.77:0/1021136136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f18a4004d00 msgr2=0x7f18a4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:20.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.758+0000 7f18be0c1640 1 --2- 172.21.15.77:0/1021136136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f18a4004d00 0x7f18a4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.758+0000 7f18be0c1640 1 -- 172.21.15.77:0/1021136136 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a4003520 con 0x7f18a4003970 2023-11-04T01:42:20.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.758+0000 7f18bd8c0640 1 --2- 172.21.15.77:0/1021136136 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f18b806db20 0x7f18a40047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:20.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.758+0000 7f18be0c1640 1 --2- 172.21.15.77:0/1021136136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18a4003970 0x7f18a4003d90 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f18b4009c90 tx=0x7f18a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63318e9d087b9b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:20.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.759+0000 7f18bd0bf640 1 -- 172.21.15.77:0/1021136136 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b402c980 con 0x7f18a4003970 2023-11-04T01:42:20.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.759+0000 7f18bd0bf640 1 -- 172.21.15.77:0/1021136136 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b402cae0 con 0x7f18a4003970 2023-11-04T01:42:20.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.759+0000 7f18bd0bf640 1 -- 172.21.15.77:0/1021136136 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b402ce90 con 0x7f18a4003970 2023-11-04T01:42:20.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.759+0000 7f18c0325640 1 -- 172.21.15.77:0/1021136136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18a4003970 msgr2=0x7f18a4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.759+0000 7f18c0325640 1 --2- 172.21.15.77:0/1021136136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18a4003970 0x7f18a4003d90 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f18b4009c90 tx=0x7f18a40057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.759+0000 7f18be8c2640 1 -- 172.21.15.77:0/1021136136 reap_dead start 2023-11-04T01:42:20.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.759+0000 7f18c0325640 1 -- 172.21.15.77:0/1021136136 shutdown_connections 2023-11-04T01:42:20.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.759+0000 7f18c0325640 1 -- 172.21.15.77:0/1021136136 >> 172.21.15.77:0/1021136136 conn(0x7f18b80ce950 msgr2=0x7f18b80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:20.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.759+0000 7f18c0325640 1 -- 172.21.15.77:0/1021136136 shutdown_connections 2023-11-04T01:42:20.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.759+0000 7f18c0325640 1 -- 172.21.15.77:0/1021136136 wait complete. 2023-11-04T01:42:20.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.760+0000 7f18c0325640 1 Processor -- start 2023-11-04T01:42:20.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.760+0000 7f18c0325640 1 -- start start 2023-11-04T01:42:20.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.761+0000 7f18c0325640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18a4003970 0x7f18b81f2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.761+0000 7f18c0325640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f18b80b3130 0x7f18b80b0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.761+0000 7f18c0325640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f18b80af220 0x7f18b80af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.761+0000 7f18c0325640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b80b35b0 con 0x7f18a4003970 2023-11-04T01:42:20.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.761+0000 7f18c0325640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b80ad580 con 0x7f18b80b3130 2023-11-04T01:42:20.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.761+0000 7f18c0325640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b814c5f0 con 0x7f18b80af220 2023-11-04T01:42:20.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.761+0000 7f18be0c1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18a4003970 0x7f18b81f2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.761+0000 7f18be0c1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18a4003970 0x7f18b81f2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58182/0 (socket says 172.21.15.77:58182) 2023-11-04T01:42:20.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.761+0000 7f18be0c1640 1 -- 172.21.15.77:0/530049152 learned_addr learned my addr 172.21.15.77:0/530049152 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:20.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.761+0000 7f18be0c1640 1 -- 172.21.15.77:0/530049152 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f18b80af220 msgr2=0x7f18b80af6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.761+0000 7f18bd8c0640 1 --2- 172.21.15.77:0/530049152 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f18b80b3130 0x7f18b80b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.761+0000 7f18be0c1640 1 --2- 172.21.15.77:0/530049152 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f18b80af220 0x7f18b80af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.762+0000 7f18be0c1640 1 -- 172.21.15.77:0/530049152 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f18b80b3130 msgr2=0x7f18b80b0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.762+0000 7f18be0c1640 1 --2- 172.21.15.77:0/530049152 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f18b80b3130 0x7f18b80b0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.762+0000 7f18be0c1640 1 -- 172.21.15.77:0/530049152 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b81f2be0 con 0x7f18a4003970 2023-11-04T01:42:20.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.762+0000 7f18bd8c0640 1 --2- 172.21.15.77:0/530049152 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f18b80b3130 0x7f18b80b0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:20.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.762+0000 7f18be0c1640 1 --2- 172.21.15.77:0/530049152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18a4003970 0x7f18b81f2590 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f18b402c460 tx=0x7f18b4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:20.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.762+0000 7f18aeffd640 1 -- 172.21.15.77:0/530049152 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b4034a00 con 0x7f18a4003970 2023-11-04T01:42:20.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.762+0000 7f18aeffd640 1 -- 172.21.15.77:0/530049152 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b4034ba0 con 0x7f18a4003970 2023-11-04T01:42:20.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.762+0000 7f18c0325640 1 -- 172.21.15.77:0/530049152 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b81f2ec0 con 0x7f18a4003970 2023-11-04T01:42:20.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.762+0000 7f18aeffd640 1 -- 172.21.15.77:0/530049152 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b4004020 con 0x7f18a4003970 2023-11-04T01:42:20.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.762+0000 7f18c0325640 1 -- 172.21.15.77:0/530049152 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b80b0690 con 0x7f18a4003970 2023-11-04T01:42:20.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.763+0000 7f18c0325640 1 -- 172.21.15.77:0/530049152 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b814c7c0 con 0x7f18a4003970 2023-11-04T01:42:20.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.763+0000 7f18aeffd640 1 -- 172.21.15.77:0/530049152 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f18b4004180 con 0x7f18a4003970 2023-11-04T01:42:20.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.764+0000 7f18aeffd640 1 --2- 172.21.15.77:0/530049152 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f189c06aea0 0x7f189c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.764+0000 7f18aeffd640 1 -- 172.21.15.77:0/530049152 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f18b40ab700 con 0x7f18a4003970 2023-11-04T01:42:20.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.764+0000 7f18bd8c0640 1 --2- 172.21.15.77:0/530049152 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f189c06aea0 0x7f189c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.764+0000 7f18bd8c0640 1 --2- 172.21.15.77:0/530049152 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f189c06aea0 0x7f189c06d360 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f18b8158cc0 tx=0x7f18a8008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:20.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.768+0000 7f18aeffd640 1 -- 172.21.15.77:0/530049152 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f18b814c7c0 con 0x7f18a4003970 2023-11-04T01:42:20.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.994+0000 7f18c0325640 1 -- 172.21.15.77:0/530049152 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f18b814c7c0 con 0x7f18a4003970 2023-11-04T01:42:20.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.994+0000 7f18aeffd640 1 -- 172.21.15.77:0/530049152 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f18b814c7c0 con 0x7f18a4003970 2023-11-04T01:42:20.997 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:20.997 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-04T01:42:20.997 INFO:teuthology.orchestra.run.smithi077.stdout: "auth_dump": [ 2023-11-04T01:42:20.997 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:20.997 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.a", 2023-11-04T01:42:20.998 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC1oEVl/r6uOhAA9u5Hcsr4T+QfSgBmS6M2Cw==", 2023-11-04T01:42:20.998 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:20.998 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:42:20.998 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-04T01:42:20.999 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-04T01:42:20.999 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:42:20.999 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:20.999 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:20.999 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:21.000 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.b", 2023-11-04T01:42:21.000 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC2oEVlOr56CxAAxOke25BrKTy0Vozn/aPYVw==", 2023-11-04T01:42:21.000 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:21.000 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:42:21.000 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-04T01:42:21.001 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-04T01:42:21.001 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:42:21.001 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:21.001 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:21.001 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:21.002 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.c", 2023-11-04T01:42:21.002 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC2oEVlvLxtBhAAuxQpEPrSlVc/YBdqJJn7iA==", 2023-11-04T01:42:21.002 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:21.002 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:42:21.002 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-04T01:42:21.003 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-04T01:42:21.003 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:42:21.003 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:21.003 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:21.003 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:21.004 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.d", 2023-11-04T01:42:21.004 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC2oEVlB3PUEhAA0GaPLq/SwHPPHriYNnan9w==", 2023-11-04T01:42:21.004 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:21.004 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:42:21.004 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-04T01:42:21.004 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-04T01:42:21.005 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:42:21.005 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:21.005 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:21.005 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:21.005 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.0", 2023-11-04T01:42:21.006 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC5oEVl4pfcMxAATPwL4pgDM0ywnmsufp74lw==", 2023-11-04T01:42:21.006 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:21.006 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:42:21.006 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:42:21.007 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:42:21.007 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:21.007 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:21.007 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:21.008 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.1", 2023-11-04T01:42:21.008 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC8oEVl+qN4MhAAXZweqA2M4vvc4B04adonzQ==", 2023-11-04T01:42:21.008 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:21.008 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:42:21.008 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:42:21.009 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:42:21.009 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:21.009 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:21.009 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:21.009 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.2", 2023-11-04T01:42:21.010 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC/oEVlRuD4MBAAQPQL0SzC7Cj9bzR/Cj+maA==", 2023-11-04T01:42:21.010 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:21.010 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:42:21.010 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:42:21.010 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:42:21.011 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:21.011 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:21.011 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:21.011 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.3", 2023-11-04T01:42:21.012 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDCoEVlDO4fLxAASTTEpVp1dzEEci56OfSEMA==", 2023-11-04T01:42:21.012 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:21.012 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:42:21.012 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:42:21.012 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:42:21.013 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:21.013 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:21.013 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:21.013 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.4", 2023-11-04T01:42:21.013 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDIoEVlQGrxOBAACkSdOwyqhcMBPhXbpdXFKw==", 2023-11-04T01:42:21.014 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:21.014 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:42:21.014 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:42:21.014 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:42:21.014 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:21.014 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:21.015 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:21.015 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.5", 2023-11-04T01:42:21.015 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDLoEVlTrCoNhAAoLM/rpHPTO6H6eXr8so/pA==", 2023-11-04T01:42:21.015 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:21.015 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:42:21.016 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:42:21.016 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:42:21.016 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:21.016 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:21.016 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:21.017 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.6", 2023-11-04T01:42:21.017 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDOoEVlb81bNRAAp8gIPrPxc9T8yp9Z8JJm8g==", 2023-11-04T01:42:21.017 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:21.017 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:42:21.017 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:42:21.018 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:42:21.018 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:21.018 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:21.018 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:21.018 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.7", 2023-11-04T01:42:21.018 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDRoEVl2aM/NBAAbi6ZxsZ51qe78O1oaSpF8Q==", 2023-11-04T01:42:21.019 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:21.019 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:42:21.019 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:42:21.019 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:42:21.019 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:21.020 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:21.020 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:21.020 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.0", 2023-11-04T01:42:21.020 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC2oEVlChU2FxAAt1/aJZOrufjVZhraPqv1Gw==", 2023-11-04T01:42:21.020 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:21.021 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:42:21.021 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow r", 2023-11-04T01:42:21.021 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-04T01:42:21.021 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:21.021 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:21.022 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:21.022 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.1", 2023-11-04T01:42:21.022 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC2oEVlVY9FIBAAUiGoYvAgEDfoAKIJ9e/SOg==", 2023-11-04T01:42:21.022 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:21.022 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:42:21.023 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-11-04T01:42:21.023 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-11-04T01:42:21.023 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-11-04T01:42:21.023 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:21.023 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:21.024 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:21.024 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.2", 2023-11-04T01:42:21.024 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC2oEVliWLuHBAA7ElluXYK9/XvMXk4S1njJw==", 2023-11-04T01:42:21.024 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:21.024 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:42:21.025 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-11-04T01:42:21.025 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-11-04T01:42:21.025 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-11-04T01:42:21.025 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:21.025 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:21.026 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:21.026 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.3", 2023-11-04T01:42:21.026 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC2oEVlQ3QIJhAA5Fq/oI3qpJseGhwXV66eMA==", 2023-11-04T01:42:21.026 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:21.026 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:42:21.027 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-11-04T01:42:21.027 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-11-04T01:42:21.027 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-11-04T01:42:21.027 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:21.027 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:21.027 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:21.028 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.admin", 2023-11-04T01:42:21.028 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC1oEVlhrFGHhAA5nkKwuaaUv+zDDAG4XaBRQ==", 2023-11-04T01:42:21.028 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:21.028 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow *", 2023-11-04T01:42:21.028 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-04T01:42:21.029 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-04T01:42:21.029 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:42:21.029 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:21.029 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:21.029 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:21.030 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mgr.x", 2023-11-04T01:42:21.030 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC1oEVlvoNGNxAAB5/uyqV4Pf/HdyGcr8rVdw==", 2023-11-04T01:42:21.030 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:21.030 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow *", 2023-11-04T01:42:21.031 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile mgr", 2023-11-04T01:42:21.031 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:42:21.031 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:21.031 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:21.031 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:21.031 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mgr.y", 2023-11-04T01:42:21.032 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC1oEVlXDKNMxAAVhq0CA3RveLfU4A6oIO4jQ==", 2023-11-04T01:42:21.032 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:21.032 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow *", 2023-11-04T01:42:21.032 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile mgr", 2023-11-04T01:42:21.032 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:42:21.033 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:21.033 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:21.033 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2023-11-04T01:42:21.033 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-04T01:42:21.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.996+0000 7f18c0325640 1 -- 172.21.15.77:0/530049152 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f189c06aea0 msgr2=0x7f189c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.996+0000 7f18c0325640 1 --2- 172.21.15.77:0/530049152 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f189c06aea0 0x7f189c06d360 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f18b8158cc0 tx=0x7f18a8008040 comp rx=0 tx=0).stop 2023-11-04T01:42:21.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.996+0000 7f18c0325640 1 -- 172.21.15.77:0/530049152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18a4003970 msgr2=0x7f18b81f2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.996+0000 7f18c0325640 1 --2- 172.21.15.77:0/530049152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18a4003970 0x7f18b81f2590 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f18b402c460 tx=0x7f18b4004730 comp rx=0 tx=0).stop 2023-11-04T01:42:21.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.996+0000 7f18c0325640 1 -- 172.21.15.77:0/530049152 shutdown_connections 2023-11-04T01:42:21.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.996+0000 7f18c0325640 1 --2- 172.21.15.77:0/530049152 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f189c06aea0 0x7f189c06d360 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.996+0000 7f18c0325640 1 --2- 172.21.15.77:0/530049152 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f18b80af220 0x7f18b80af6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.996+0000 7f18c0325640 1 --2- 172.21.15.77:0/530049152 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f18b80b3130 0x7f18b80b0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.996+0000 7f18c0325640 1 --2- 172.21.15.77:0/530049152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18a4003970 0x7f18b81f2590 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.996+0000 7f18c0325640 1 -- 172.21.15.77:0/530049152 >> 172.21.15.77:0/530049152 conn(0x7f18b80ce950 msgr2=0x7f18b80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:21.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.996+0000 7f18c0325640 1 -- 172.21.15.77:0/530049152 shutdown_connections 2023-11-04T01:42:21.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:20.996+0000 7f18c0325640 1 -- 172.21.15.77:0/530049152 wait complete. 2023-11-04T01:42:21.038 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:21.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.135+0000 7fb4ecbf5640 1 Processor -- start 2023-11-04T01:42:21.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.135+0000 7fb4ecbf5640 1 -- start start 2023-11-04T01:42:21.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.136+0000 7fb4ecbf5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4e815ae40 0x7fb4e815bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.136+0000 7fb4ecbf5640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb4e80cda30 0x7fb4e80ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.136+0000 7fb4ecbf5640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e80cc450 con 0x7fb4e80cbc00 2023-11-04T01:42:21.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.136+0000 7fb4ecbf5640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e815f400 con 0x7fb4e80cda30 2023-11-04T01:42:21.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.136+0000 7fb4ecbf5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e815b220 con 0x7fb4e815ae40 2023-11-04T01:42:21.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.137+0000 7fb4e659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4e815ae40 0x7fb4e815bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.137+0000 7fb4e6d9d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb4e80cda30 0x7fb4e80ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.137+0000 7fb4e6d9d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb4e80cda30 0x7fb4e80ced70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:38630/0 (socket says 172.21.15.77:38630) 2023-11-04T01:42:21.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.137+0000 7fb4e6d9d640 1 -- 172.21.15.77:0/2115329865 learned_addr learned my addr 172.21.15.77:0/2115329865 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:21.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.137+0000 7fb4e659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4e815ae40 0x7fb4e815bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:52944/0 (socket says 172.21.15.77:52944) 2023-11-04T01:42:21.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.137+0000 7fb4dffff640 1 --1- 172.21.15.77:0/2115329865 >> v1:172.21.15.122:6789/0 conn(0x7fb4e80cbc00 0x7fb4e80cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:52106/0 (socket says 172.21.15.77:52106) 2023-11-04T01:42:21.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.137+0000 7fb4e659c640 1 -- 172.21.15.77:0/2115329865 >> v2:172.21.15.122:3300/0 conn(0x7fb4e80cda30 msgr2=0x7fb4e80ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:21.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.137+0000 7fb4e659c640 1 --2- 172.21.15.77:0/2115329865 >> v2:172.21.15.122:3300/0 conn(0x7fb4e80cda30 0x7fb4e80ced70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.137+0000 7fb4e659c640 1 -- 172.21.15.77:0/2115329865 >> v1:172.21.15.122:6789/0 conn(0x7fb4e80cbc00 legacy=0x7fb4e80cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.137+0000 7fb4e659c640 1 -- 172.21.15.77:0/2115329865 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e815f890 con 0x7fb4e815ae40 2023-11-04T01:42:21.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.137+0000 7fb4e6d9d640 1 --2- 172.21.15.77:0/2115329865 >> v2:172.21.15.122:3300/0 conn(0x7fb4e80cda30 0x7fb4e80ced70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:21.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.138+0000 7fb4e659c640 1 --2- 172.21.15.77:0/2115329865 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4e815ae40 0x7fb4e815bfb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb4d80097a0 tx=0x7fb4d802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c741c99e434da6b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.138+0000 7fb4e5d9b640 1 -- 172.21.15.77:0/2115329865 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d8031830 con 0x7fb4e815ae40 2023-11-04T01:42:21.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.138+0000 7fb4e5d9b640 1 -- 172.21.15.77:0/2115329865 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d8031990 con 0x7fb4e815ae40 2023-11-04T01:42:21.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.138+0000 7fb4e5d9b640 1 -- 172.21.15.77:0/2115329865 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d8031d20 con 0x7fb4e815ae40 2023-11-04T01:42:21.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.139+0000 7fb4ecbf5640 1 -- 172.21.15.77:0/2115329865 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4e815ae40 msgr2=0x7fb4e815bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.139+0000 7fb4ecbf5640 1 --2- 172.21.15.77:0/2115329865 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4e815ae40 0x7fb4e815bfb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb4d80097a0 tx=0x7fb4d802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.139+0000 7fb4ecbf5640 1 -- 172.21.15.77:0/2115329865 shutdown_connections 2023-11-04T01:42:21.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.139+0000 7fb4ecbf5640 1 --2- 172.21.15.77:0/2115329865 >> v2:172.21.15.122:3300/0 conn(0x7fb4e80cda30 0x7fb4e80ced70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.139+0000 7fb4ecbf5640 1 --2- 172.21.15.77:0/2115329865 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4e815ae40 0x7fb4e815bfb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.139+0000 7fb4ecbf5640 1 -- 172.21.15.77:0/2115329865 >> 172.21.15.77:0/2115329865 conn(0x7fb4e806ea90 msgr2=0x7fb4e806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:21.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.139+0000 7fb4ecbf5640 1 -- 172.21.15.77:0/2115329865 shutdown_connections 2023-11-04T01:42:21.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.139+0000 7fb4ecbf5640 1 -- 172.21.15.77:0/2115329865 wait complete. 2023-11-04T01:42:21.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.140+0000 7fb4ecbf5640 1 Processor -- start 2023-11-04T01:42:21.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.140+0000 7fb4ecbf5640 1 -- start start 2023-11-04T01:42:21.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.141+0000 7fb4ecbf5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4e80cbc00 0x7fb4e8151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.141+0000 7fb4ecbf5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4e80cda30 0x7fb4e80c50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.141+0000 7fb4ecbf5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4e815ae40 0x7fb4e814bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.141+0000 7fb4ecbf5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e80c7e80 con 0x7fb4e815ae40 2023-11-04T01:42:21.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.141+0000 7fb4ecbf5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e80c5910 con 0x7fb4e80cda30 2023-11-04T01:42:21.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.141+0000 7fb4ecbf5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e80c5bf0 con 0x7fb4e80cbc00 2023-11-04T01:42:21.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.141+0000 7fb4e6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4e815ae40 0x7fb4e814bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.141+0000 7fb4e6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4e815ae40 0x7fb4e814bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58194/0 (socket says 172.21.15.77:58194) 2023-11-04T01:42:21.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.141+0000 7fb4e6d9d640 1 -- 172.21.15.77:0/4086369079 learned_addr learned my addr 172.21.15.77:0/4086369079 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:21.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.141+0000 7fb4e659c640 1 --2- 172.21.15.77:0/4086369079 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4e80cbc00 0x7fb4e8151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.141+0000 7fb4dffff640 1 --2- 172.21.15.77:0/4086369079 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4e80cda30 0x7fb4e80c50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.141+0000 7fb4e6d9d640 1 -- 172.21.15.77:0/4086369079 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4e80cbc00 msgr2=0x7fb4e8151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.141+0000 7fb4e6d9d640 1 --2- 172.21.15.77:0/4086369079 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4e80cbc00 0x7fb4e8151a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.141+0000 7fb4e6d9d640 1 -- 172.21.15.77:0/4086369079 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4e80cda30 msgr2=0x7fb4e80c50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.141+0000 7fb4e6d9d640 1 --2- 172.21.15.77:0/4086369079 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4e80cda30 0x7fb4e80c50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.141+0000 7fb4e6d9d640 1 -- 172.21.15.77:0/4086369079 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e0009b30 con 0x7fb4e815ae40 2023-11-04T01:42:21.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.141+0000 7fb4e6d9d640 1 --2- 172.21.15.77:0/4086369079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4e815ae40 0x7fb4e814bba0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb4e000efc0 tx=0x7fb4e000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.141+0000 7fb4deffd640 1 -- 172.21.15.77:0/4086369079 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e0018070 con 0x7fb4e815ae40 2023-11-04T01:42:21.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.141+0000 7fb4deffd640 1 -- 172.21.15.77:0/4086369079 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e000f040 con 0x7fb4e815ae40 2023-11-04T01:42:21.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.142+0000 7fb4deffd640 1 -- 172.21.15.77:0/4086369079 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e000ce00 con 0x7fb4e815ae40 2023-11-04T01:42:21.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.142+0000 7fb4ecbf5640 1 -- 172.21.15.77:0/4086369079 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4d8009400 con 0x7fb4e815ae40 2023-11-04T01:42:21.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.142+0000 7fb4ecbf5640 1 -- 172.21.15.77:0/4086369079 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e80c61b0 con 0x7fb4e815ae40 2023-11-04T01:42:21.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.142+0000 7fb4ecbf5640 1 -- 172.21.15.77:0/4086369079 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e80ce2d0 con 0x7fb4e815ae40 2023-11-04T01:42:21.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.143+0000 7fb4deffd640 1 -- 172.21.15.77:0/4086369079 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb4e0014480 con 0x7fb4e815ae40 2023-11-04T01:42:21.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.143+0000 7fb4deffd640 1 --2- 172.21.15.77:0/4086369079 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb4c806aea0 0x7fb4c806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.143+0000 7fb4deffd640 1 -- 172.21.15.77:0/4086369079 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fb4e00897d0 con 0x7fb4e815ae40 2023-11-04T01:42:21.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.144+0000 7fb4e659c640 1 --2- 172.21.15.77:0/4086369079 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb4c806aea0 0x7fb4c806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.144+0000 7fb4e659c640 1 --2- 172.21.15.77:0/4086369079 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb4c806aea0 0x7fb4c806d360 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8036000 tx=0x7fb4d803c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.147+0000 7fb4deffd640 1 -- 172.21.15.77:0/4086369079 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb4e00549c0 con 0x7fb4e815ae40 2023-11-04T01:42:21.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.314+0000 7fb4ecbf5640 1 -- 172.21.15.77:0/4086369079 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4e8074290 con 0x7fb4e815ae40 2023-11-04T01:42:21.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.315+0000 7fb4deffd640 1 -- 172.21.15.77:0/4086369079 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+14803 (secure 0 0 0) 0x7fb4e0057fe0 con 0x7fb4e815ae40 2023-11-04T01:42:21.319 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:21.319 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":62,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:42:20.631741+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:21.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.317+0000 7fb4ecbf5640 1 -- 172.21.15.77:0/4086369079 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb4c806aea0 msgr2=0x7fb4c806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.317+0000 7fb4ecbf5640 1 --2- 172.21.15.77:0/4086369079 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb4c806aea0 0x7fb4c806d360 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8036000 tx=0x7fb4d803c040 comp rx=0 tx=0).stop 2023-11-04T01:42:21.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.317+0000 7fb4ecbf5640 1 -- 172.21.15.77:0/4086369079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4e815ae40 msgr2=0x7fb4e814bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.317+0000 7fb4ecbf5640 1 --2- 172.21.15.77:0/4086369079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4e815ae40 0x7fb4e814bba0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb4e000efc0 tx=0x7fb4e000c490 comp rx=0 tx=0).stop 2023-11-04T01:42:21.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.317+0000 7fb4ecbf5640 1 -- 172.21.15.77:0/4086369079 shutdown_connections 2023-11-04T01:42:21.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.317+0000 7fb4ecbf5640 1 --2- 172.21.15.77:0/4086369079 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb4c806aea0 0x7fb4c806d360 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.317+0000 7fb4ecbf5640 1 --2- 172.21.15.77:0/4086369079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4e815ae40 0x7fb4e814bba0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.317+0000 7fb4ecbf5640 1 --2- 172.21.15.77:0/4086369079 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4e80cda30 0x7fb4e80c50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.317+0000 7fb4ecbf5640 1 --2- 172.21.15.77:0/4086369079 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4e80cbc00 0x7fb4e8151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.317+0000 7fb4ecbf5640 1 -- 172.21.15.77:0/4086369079 >> 172.21.15.77:0/4086369079 conn(0x7fb4e806ea90 msgr2=0x7fb4e80b6340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:21.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.317+0000 7fb4ecbf5640 1 -- 172.21.15.77:0/4086369079 shutdown_connections 2023-11-04T01:42:21.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.317+0000 7fb4ecbf5640 1 -- 172.21.15.77:0/4086369079 wait complete. 2023-11-04T01:42:21.329 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:33.142176+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:42:21.330 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:42:21.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.431+0000 7f79a1d39640 1 Processor -- start 2023-11-04T01:42:21.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.431+0000 7f79a1d39640 1 -- start start 2023-11-04T01:42:21.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.431+0000 7f79a1d39640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f799c153e60 0x7f799c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.431+0000 7f79a1d39640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f799c0cd6d0 0x7f799c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.431+0000 7f79a1d39640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f799c0cde60 con 0x7f799c0b4880 2023-11-04T01:42:21.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.431+0000 7f79a1d39640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f799c160f90 con 0x7f799c0cd6d0 2023-11-04T01:42:21.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.431+0000 7f79a1d39640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f799c15e400 con 0x7f799c153e60 2023-11-04T01:42:21.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.432+0000 7f799affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f799c0cd6d0 0x7f799c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.432+0000 7f799affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f799c0cd6d0 0x7f799c161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58208/0 (socket says 172.21.15.77:58208) 2023-11-04T01:42:21.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.432+0000 7f799affd640 1 -- 172.21.15.77:0/4028278043 learned_addr learned my addr 172.21.15.77:0/4028278043 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:21.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.432+0000 7f799b7fe640 1 --2- 172.21.15.77:0/4028278043 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f799c153e60 0x7f799c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.432+0000 7f799affd640 1 -- 172.21.15.77:0/4028278043 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f799c153e60 msgr2=0x7f799c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:21.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.432+0000 7f799affd640 1 --2- 172.21.15.77:0/4028278043 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f799c153e60 0x7f799c15dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.432+0000 7f799affd640 1 -- 172.21.15.77:0/4028278043 >> v1:172.21.15.122:6789/0 conn(0x7f799c0b4880 legacy=0x7f799c06b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:21.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.432+0000 7f799affd640 1 -- 172.21.15.77:0/4028278043 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799c161960 con 0x7f799c0cd6d0 2023-11-04T01:42:21.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.432+0000 7f799b7fe640 1 --2- 172.21.15.77:0/4028278043 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f799c153e60 0x7f799c15dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:21.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.433+0000 7f799affd640 1 --2- 172.21.15.77:0/4028278043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f799c0cd6d0 0x7f799c161420 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f7990009870 tx=0x7f799002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f516422f3f9efb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.433+0000 7f799a7fc640 1 -- 172.21.15.77:0/4028278043 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7990031640 con 0x7f799c0cd6d0 2023-11-04T01:42:21.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.433+0000 7f799a7fc640 1 -- 172.21.15.77:0/4028278043 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79900317a0 con 0x7f799c0cd6d0 2023-11-04T01:42:21.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.433+0000 7f799a7fc640 1 -- 172.21.15.77:0/4028278043 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7990031b30 con 0x7f799c0cd6d0 2023-11-04T01:42:21.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.433+0000 7f79a1d39640 1 -- 172.21.15.77:0/4028278043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f799c0cd6d0 msgr2=0x7f799c161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.433+0000 7f79a1d39640 1 --2- 172.21.15.77:0/4028278043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f799c0cd6d0 0x7f799c161420 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f7990009870 tx=0x7f799002b8f0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.433+0000 7f79a1d39640 1 -- 172.21.15.77:0/4028278043 shutdown_connections 2023-11-04T01:42:21.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.433+0000 7f79a1d39640 1 --2- 172.21.15.77:0/4028278043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f799c0cd6d0 0x7f799c161420 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.433+0000 7f79a1d39640 1 --2- 172.21.15.77:0/4028278043 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f799c153e60 0x7f799c15dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.433+0000 7f79a1d39640 1 -- 172.21.15.77:0/4028278043 >> 172.21.15.77:0/4028278043 conn(0x7f799c0cf880 msgr2=0x7f799c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:21.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.433+0000 7f79a1d39640 1 -- 172.21.15.77:0/4028278043 shutdown_connections 2023-11-04T01:42:21.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.433+0000 7f79a1d39640 1 -- 172.21.15.77:0/4028278043 wait complete. 2023-11-04T01:42:21.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.434+0000 7f79a1d39640 1 Processor -- start 2023-11-04T01:42:21.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.435+0000 7f79a1d39640 1 -- start start 2023-11-04T01:42:21.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.435+0000 7f79a1d39640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f799c0b4880 0x7f799c1e6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.435+0000 7f79a1d39640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f799c0cd6d0 0x7f799c1e6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.435+0000 7f79a1d39640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f799c153e60 0x7f799c158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.435+0000 7f79a1d39640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c15a9b0 con 0x7f799c0cd6d0 2023-11-04T01:42:21.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.435+0000 7f79a1d39640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c159bc0 con 0x7f799c153e60 2023-11-04T01:42:21.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.435+0000 7f79a1d39640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f799c0c7640 con 0x7f799c0b4880 2023-11-04T01:42:21.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.435+0000 7f799affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f799c0cd6d0 0x7f799c1e6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.436+0000 7f799affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f799c0cd6d0 0x7f799c1e6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58210/0 (socket says 172.21.15.77:58210) 2023-11-04T01:42:21.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.436+0000 7f799affd640 1 -- 172.21.15.77:0/223343813 learned_addr learned my addr 172.21.15.77:0/223343813 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:21.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.436+0000 7f799b7fe640 1 --2- 172.21.15.77:0/223343813 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f799c0b4880 0x7f799c1e6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.436+0000 7f799affd640 1 -- 172.21.15.77:0/223343813 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f799c0b4880 msgr2=0x7f799c1e6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.436+0000 7f799affd640 1 --2- 172.21.15.77:0/223343813 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f799c0b4880 0x7f799c1e6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.436+0000 7f799bfff640 1 --2- 172.21.15.77:0/223343813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f799c153e60 0x7f799c158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.436+0000 7f799affd640 1 -- 172.21.15.77:0/223343813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f799c153e60 msgr2=0x7f799c158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.436+0000 7f799affd640 1 --2- 172.21.15.77:0/223343813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f799c153e60 0x7f799c158fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.436+0000 7f799affd640 1 -- 172.21.15.77:0/223343813 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79900094d0 con 0x7f799c0cd6d0 2023-11-04T01:42:21.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.436+0000 7f799affd640 1 --2- 172.21.15.77:0/223343813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f799c0cd6d0 0x7f799c1e6e40 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f7990009870 tx=0x7f79900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.436+0000 7f7983fff640 1 -- 172.21.15.77:0/223343813 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799003ac60 con 0x7f799c0cd6d0 2023-11-04T01:42:21.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.436+0000 7f7983fff640 1 -- 172.21.15.77:0/223343813 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799003ade0 con 0x7f799c0cd6d0 2023-11-04T01:42:21.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.436+0000 7f7983fff640 1 -- 172.21.15.77:0/223343813 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7990044630 con 0x7f799c0cd6d0 2023-11-04T01:42:21.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.436+0000 7f79a1d39640 1 -- 172.21.15.77:0/223343813 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f799c0c7920 con 0x7f799c0cd6d0 2023-11-04T01:42:21.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.436+0000 7f79a1d39640 1 -- 172.21.15.77:0/223343813 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f799c159500 con 0x7f799c0cd6d0 2023-11-04T01:42:21.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.437+0000 7f79a1d39640 1 -- 172.21.15.77:0/223343813 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f799c0c74a0 con 0x7f799c0cd6d0 2023-11-04T01:42:21.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.437+0000 7f7983fff640 1 -- 172.21.15.77:0/223343813 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f799002f050 con 0x7f799c0cd6d0 2023-11-04T01:42:21.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.438+0000 7f7983fff640 1 --2- 172.21.15.77:0/223343813 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f798806ae70 0x7f798806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.438+0000 7f7983fff640 1 -- 172.21.15.77:0/223343813 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f79900ab620 con 0x7f799c0cd6d0 2023-11-04T01:42:21.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.438+0000 7f799b7fe640 1 --2- 172.21.15.77:0/223343813 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f798806ae70 0x7f798806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.439+0000 7f799b7fe640 1 --2- 172.21.15.77:0/223343813 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f798806ae70 0x7f798806d330 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f798c00b840 tx=0x7f798c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.442+0000 7f7983fff640 1 -- 172.21.15.77:0/223343813 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f799c0c74a0 con 0x7f799c0cd6d0 2023-11-04T01:42:21.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.605+0000 7f79a1d39640 1 -- 172.21.15.77:0/223343813 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f799c0c7e40 con 0x7f799c0cd6d0 2023-11-04T01:42:21.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.605+0000 7f7983fff640 1 -- 172.21.15.77:0/223343813 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v62) v1 ==== 93+0+10 (secure 0 0 0) 0x7f799c0c7e40 con 0x7f799c0cd6d0 2023-11-04T01:42:21.608 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:42:21.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.607+0000 7f79a1d39640 1 -- 172.21.15.77:0/223343813 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f798806ae70 msgr2=0x7f798806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.607+0000 7f79a1d39640 1 --2- 172.21.15.77:0/223343813 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f798806ae70 0x7f798806d330 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f798c00b840 tx=0x7f798c008040 comp rx=0 tx=0).stop 2023-11-04T01:42:21.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.607+0000 7f79a1d39640 1 -- 172.21.15.77:0/223343813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f799c0cd6d0 msgr2=0x7f799c1e6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.607+0000 7f79a1d39640 1 --2- 172.21.15.77:0/223343813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f799c0cd6d0 0x7f799c1e6e40 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f7990009870 tx=0x7f79900046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.607+0000 7f79a1d39640 1 -- 172.21.15.77:0/223343813 shutdown_connections 2023-11-04T01:42:21.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.607+0000 7f79a1d39640 1 --2- 172.21.15.77:0/223343813 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f798806ae70 0x7f798806d330 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.607+0000 7f79a1d39640 1 --2- 172.21.15.77:0/223343813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f799c153e60 0x7f799c158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.607+0000 7f79a1d39640 1 --2- 172.21.15.77:0/223343813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f799c0cd6d0 0x7f799c1e6e40 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.607+0000 7f79a1d39640 1 --2- 172.21.15.77:0/223343813 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f799c0b4880 0x7f799c1e6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.607+0000 7f79a1d39640 1 -- 172.21.15.77:0/223343813 >> 172.21.15.77:0/223343813 conn(0x7f799c0cf880 msgr2=0x7f799c15fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:21.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.607+0000 7f79a1d39640 1 -- 172.21.15.77:0/223343813 shutdown_connections 2023-11-04T01:42:21.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.607+0000 7f79a1d39640 1 -- 172.21.15.77:0/223343813 wait complete. 2023-11-04T01:42:21.621 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:42:21.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.720+0000 7fef79c5d640 1 Processor -- start 2023-11-04T01:42:21.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.720+0000 7fef79c5d640 1 -- start start 2023-11-04T01:42:21.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.721+0000 7fef79c5d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fef74070ff0 0x7fef740cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.721+0000 7fef79c5d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fef74066000 0x7fef7406a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.721+0000 7fef79c5d640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef740c9bf0 con 0x7fef7415d1b0 2023-11-04T01:42:21.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.721+0000 7fef79c5d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef740cd890 con 0x7fef74070ff0 2023-11-04T01:42:21.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.721+0000 7fef79c5d640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef740cdb30 con 0x7fef74066000 2023-11-04T01:42:21.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.721+0000 7fef737fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fef74070ff0 0x7fef740cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.721+0000 7fef737fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fef74070ff0 0x7fef740cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58226/0 (socket says 172.21.15.77:58226) 2023-11-04T01:42:21.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.721+0000 7fef737fe640 1 -- 172.21.15.77:0/4056101632 learned_addr learned my addr 172.21.15.77:0/4056101632 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:21.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.721+0000 7fef73fff640 1 --2- 172.21.15.77:0/4056101632 >> v2:172.21.15.122:3300/0 conn(0x7fef74066000 0x7fef7406a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.721+0000 7fef737fe640 1 -- 172.21.15.77:0/4056101632 >> v2:172.21.15.122:3300/0 conn(0x7fef74066000 msgr2=0x7fef7406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:21.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.721+0000 7fef737fe640 1 --2- 172.21.15.77:0/4056101632 >> v2:172.21.15.122:3300/0 conn(0x7fef74066000 0x7fef7406a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.721+0000 7fef737fe640 1 -- 172.21.15.77:0/4056101632 >> v1:172.21.15.122:6789/0 conn(0x7fef7415d1b0 legacy=0x7fef740713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:21.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.721+0000 7fef737fe640 1 -- 172.21.15.77:0/4056101632 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef740cde10 con 0x7fef74070ff0 2023-11-04T01:42:21.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.722+0000 7fef737fe640 1 --2- 172.21.15.77:0/4056101632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef74070ff0 0x7fef740cb4e0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fef7406e960 tx=0x7fef6402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f38c568f3a2f04 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.722+0000 7fef727fc640 1 -- 172.21.15.77:0/4056101632 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef64031870 con 0x7fef74070ff0 2023-11-04T01:42:21.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.722+0000 7fef727fc640 1 -- 172.21.15.77:0/4056101632 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef640319d0 con 0x7fef74070ff0 2023-11-04T01:42:21.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.722+0000 7fef727fc640 1 -- 172.21.15.77:0/4056101632 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef64031d60 con 0x7fef74070ff0 2023-11-04T01:42:21.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.723+0000 7fef79c5d640 1 -- 172.21.15.77:0/4056101632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef74070ff0 msgr2=0x7fef740cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.723+0000 7fef79c5d640 1 --2- 172.21.15.77:0/4056101632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef74070ff0 0x7fef740cb4e0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fef7406e960 tx=0x7fef6402b910 comp rx=0 tx=0).stop 2023-11-04T01:42:21.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.723+0000 7fef79c5d640 1 -- 172.21.15.77:0/4056101632 shutdown_connections 2023-11-04T01:42:21.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.723+0000 7fef79c5d640 1 --2- 172.21.15.77:0/4056101632 >> v2:172.21.15.122:3300/0 conn(0x7fef74066000 0x7fef7406a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.723+0000 7fef79c5d640 1 --2- 172.21.15.77:0/4056101632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef74070ff0 0x7fef740cb4e0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.723+0000 7fef79c5d640 1 -- 172.21.15.77:0/4056101632 >> 172.21.15.77:0/4056101632 conn(0x7fef740cbc90 msgr2=0x7fef740cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:21.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.723+0000 7fef79c5d640 1 -- 172.21.15.77:0/4056101632 shutdown_connections 2023-11-04T01:42:21.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.723+0000 7fef79c5d640 1 -- 172.21.15.77:0/4056101632 wait complete. 2023-11-04T01:42:21.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.724+0000 7fef79c5d640 1 Processor -- start 2023-11-04T01:42:21.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.724+0000 7fef79c5d640 1 -- start start 2023-11-04T01:42:21.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.725+0000 7fef79c5d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fef74066000 0x7fef740c5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.725+0000 7fef79c5d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef74070ff0 0x7fef740b4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.725+0000 7fef79c5d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef7415d1b0 0x7fef7414e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.725+0000 7fef79c5d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef740c4170 con 0x7fef7415d1b0 2023-11-04T01:42:21.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.725+0000 7fef79c5d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef740c4450 con 0x7fef74070ff0 2023-11-04T01:42:21.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.725+0000 7fef79c5d640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef740c4730 con 0x7fef74066000 2023-11-04T01:42:21.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.725+0000 7fef73fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef7415d1b0 0x7fef7414e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.725+0000 7fef73fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef7415d1b0 0x7fef7414e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58240/0 (socket says 172.21.15.77:58240) 2023-11-04T01:42:21.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.725+0000 7fef73fff640 1 -- 172.21.15.77:0/3318569447 learned_addr learned my addr 172.21.15.77:0/3318569447 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:21.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.725+0000 7fef737fe640 1 --2- 172.21.15.77:0/3318569447 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fef74066000 0x7fef740c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.725+0000 7fef72ffd640 1 --2- 172.21.15.77:0/3318569447 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef74070ff0 0x7fef740b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.725+0000 7fef73fff640 1 -- 172.21.15.77:0/3318569447 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fef74066000 msgr2=0x7fef740c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.725+0000 7fef73fff640 1 --2- 172.21.15.77:0/3318569447 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fef74066000 0x7fef740c5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.725+0000 7fef73fff640 1 -- 172.21.15.77:0/3318569447 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef74070ff0 msgr2=0x7fef740b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.725+0000 7fef73fff640 1 --2- 172.21.15.77:0/3318569447 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef74070ff0 0x7fef740b4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.725+0000 7fef73fff640 1 -- 172.21.15.77:0/3318569447 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef640094d0 con 0x7fef7415d1b0 2023-11-04T01:42:21.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.726+0000 7fef73fff640 1 --2- 172.21.15.77:0/3318569447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef7415d1b0 0x7fef7414e270 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fef6c00cc30 tx=0x7fef6c00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.726+0000 7fef5bfff640 1 -- 172.21.15.77:0/3318569447 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c00ce40 con 0x7fef7415d1b0 2023-11-04T01:42:21.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.726+0000 7fef5bfff640 1 -- 172.21.15.77:0/3318569447 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6c003990 con 0x7fef7415d1b0 2023-11-04T01:42:21.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.726+0000 7fef79c5d640 1 -- 172.21.15.77:0/3318569447 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef740c4a10 con 0x7fef7415d1b0 2023-11-04T01:42:21.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.726+0000 7fef5bfff640 1 -- 172.21.15.77:0/3318569447 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c003d20 con 0x7fef7415d1b0 2023-11-04T01:42:21.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.726+0000 7fef79c5d640 1 -- 172.21.15.77:0/3318569447 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef740c5750 con 0x7fef7415d1b0 2023-11-04T01:42:21.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.727+0000 7fef79c5d640 1 -- 172.21.15.77:0/3318569447 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef740c4f30 con 0x7fef7415d1b0 2023-11-04T01:42:21.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.727+0000 7fef5bfff640 1 -- 172.21.15.77:0/3318569447 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fef6c003e80 con 0x7fef7415d1b0 2023-11-04T01:42:21.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.727+0000 7fef5bfff640 1 --2- 172.21.15.77:0/3318569447 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fef6006ae70 0x7fef6006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.728+0000 7fef5bfff640 1 -- 172.21.15.77:0/3318569447 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fef6c089a00 con 0x7fef7415d1b0 2023-11-04T01:42:21.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.728+0000 7fef737fe640 1 --2- 172.21.15.77:0/3318569447 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fef6006ae70 0x7fef6006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.728+0000 7fef737fe640 1 --2- 172.21.15.77:0/3318569447 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fef6006ae70 0x7fef6006d330 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fef64036000 tx=0x7fef6403c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.732+0000 7fef5bfff640 1 -- 172.21.15.77:0/3318569447 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fef740c4f30 con 0x7fef7415d1b0 2023-11-04T01:42:21.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.896+0000 7fef79c5d640 1 -- 172.21.15.77:0/3318569447 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fef740c4f30 con 0x7fef7415d1b0 2023-11-04T01:42:21.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.897+0000 7fef5bfff640 1 -- 172.21.15.77:0/3318569447 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v62) v1 ==== 103+0+11 (secure 0 0 0) 0x7fef740c4f30 con 0x7fef7415d1b0 2023-11-04T01:42:21.900 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:42:21.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.898+0000 7fef79c5d640 1 -- 172.21.15.77:0/3318569447 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fef6006ae70 msgr2=0x7fef6006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.898+0000 7fef79c5d640 1 --2- 172.21.15.77:0/3318569447 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fef6006ae70 0x7fef6006d330 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fef64036000 tx=0x7fef6403c040 comp rx=0 tx=0).stop 2023-11-04T01:42:21.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.898+0000 7fef79c5d640 1 -- 172.21.15.77:0/3318569447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef7415d1b0 msgr2=0x7fef7414e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.898+0000 7fef79c5d640 1 --2- 172.21.15.77:0/3318569447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef7415d1b0 0x7fef7414e270 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fef6c00cc30 tx=0x7fef6c00a5c0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.899+0000 7fef79c5d640 1 -- 172.21.15.77:0/3318569447 shutdown_connections 2023-11-04T01:42:21.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.899+0000 7fef79c5d640 1 --2- 172.21.15.77:0/3318569447 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fef6006ae70 0x7fef6006d330 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.899+0000 7fef79c5d640 1 --2- 172.21.15.77:0/3318569447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef7415d1b0 0x7fef7414e270 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.899+0000 7fef79c5d640 1 --2- 172.21.15.77:0/3318569447 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef74070ff0 0x7fef740b4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.899+0000 7fef79c5d640 1 --2- 172.21.15.77:0/3318569447 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fef74066000 0x7fef740c5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.899+0000 7fef79c5d640 1 -- 172.21.15.77:0/3318569447 >> 172.21.15.77:0/3318569447 conn(0x7fef740cbc90 msgr2=0x7fef7406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:21.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.899+0000 7fef79c5d640 1 -- 172.21.15.77:0/3318569447 shutdown_connections 2023-11-04T01:42:21.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:21.899+0000 7fef79c5d640 1 -- 172.21.15.77:0/3318569447 wait complete. 2023-11-04T01:42:21.912 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T01:42:22.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.008+0000 7f81cb6f2640 1 Processor -- start 2023-11-04T01:42:22.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.008+0000 7f81cb6f2640 1 -- start start 2023-11-04T01:42:22.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.009+0000 7f81cb6f2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f81c4160b10 0x7f81c4160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.009+0000 7f81cb6f2640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c406bf00 con 0x7f81c40cf160 2023-11-04T01:42:22.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.009+0000 7f81cb6f2640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c41615d0 con 0x7f81c415ce60 2023-11-04T01:42:22.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.009+0000 7f81cb6f2640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c40cbde0 con 0x7f81c4160b10 2023-11-04T01:42:22.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.009+0000 7f81c8c8d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f81c4160b10 0x7f81c4160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.009+0000 7f81c9c8f640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f81c40cf160 0x7f81c40cc200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35722/0 (socket says 172.21.15.77:35722) 2023-11-04T01:42:22.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.009+0000 7f81c9c8f640 1 -- 172.21.15.77:0/819419609 learned_addr learned my addr 172.21.15.77:0/819419609 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:22.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.009+0000 7f81c8c8d640 1 -- 172.21.15.77:0/819419609 >> v1:172.21.15.122:6789/0 conn(0x7f81c415ce60 legacy=0x7f81c406b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:22.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.009+0000 7f81c8c8d640 1 -- 172.21.15.77:0/819419609 >> v1:172.21.15.77:6789/0 conn(0x7f81c40cf160 legacy=0x7f81c40cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.009+0000 7f81bbfff640 1 -- 172.21.15.77:0/819419609 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 603094573 0 0) 0x7f81c406bf00 con 0x7f81c40cf160 2023-11-04T01:42:22.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.009+0000 7f81c8c8d640 1 -- 172.21.15.77:0/819419609 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c41618b0 con 0x7f81c4160b10 2023-11-04T01:42:22.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.010+0000 7f81c8c8d640 1 --2- 172.21.15.77:0/819419609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81c4160b10 0x7f81c4160f90 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f81b40097a0 tx=0x7f81b402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b95074d3bd0d0c8f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:22.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.010+0000 7f81bbfff640 1 -- 172.21.15.77:0/819419609 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b4031830 con 0x7f81c4160b10 2023-11-04T01:42:22.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.010+0000 7f81bbfff640 1 -- 172.21.15.77:0/819419609 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b4031990 con 0x7f81c4160b10 2023-11-04T01:42:22.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.010+0000 7f81bbfff640 1 -- 172.21.15.77:0/819419609 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b4031d20 con 0x7f81c4160b10 2023-11-04T01:42:22.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.010+0000 7f81cb6f2640 1 -- 172.21.15.77:0/819419609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81c4160b10 msgr2=0x7f81c4160f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.010+0000 7f81cb6f2640 1 --2- 172.21.15.77:0/819419609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81c4160b10 0x7f81c4160f90 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f81b40097a0 tx=0x7f81b402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.010+0000 7f81cb6f2640 1 -- 172.21.15.77:0/819419609 shutdown_connections 2023-11-04T01:42:22.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.010+0000 7f81cb6f2640 1 --2- 172.21.15.77:0/819419609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81c4160b10 0x7f81c4160f90 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.010+0000 7f81cb6f2640 1 -- 172.21.15.77:0/819419609 >> 172.21.15.77:0/819419609 conn(0x7f81c406ea90 msgr2=0x7f81c406ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:22.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.011+0000 7f81cb6f2640 1 -- 172.21.15.77:0/819419609 shutdown_connections 2023-11-04T01:42:22.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.011+0000 7f81cb6f2640 1 -- 172.21.15.77:0/819419609 wait complete. 2023-11-04T01:42:22.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.012+0000 7f81cb6f2640 1 Processor -- start 2023-11-04T01:42:22.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.012+0000 7f81cb6f2640 1 -- start start 2023-11-04T01:42:22.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.012+0000 7f81cb6f2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f81c40cf160 0x7f81c4150130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.012+0000 7f81cb6f2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81c415ce60 0x7f81c40b3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.012+0000 7f81cb6f2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81c4160b10 0x7f81c40cc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.012+0000 7f81cb6f2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c4150670 con 0x7f81c415ce60 2023-11-04T01:42:22.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.012+0000 7f81cb6f2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c40abf40 con 0x7f81c4160b10 2023-11-04T01:42:22.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.012+0000 7f81cb6f2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c40b41f0 con 0x7f81c40cf160 2023-11-04T01:42:22.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.012+0000 7f81c8c8d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81c415ce60 0x7f81c40b3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.012+0000 7f81c8c8d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81c415ce60 0x7f81c40b3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58248/0 (socket says 172.21.15.77:58248) 2023-11-04T01:42:22.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.012+0000 7f81c8c8d640 1 -- 172.21.15.77:0/949865925 learned_addr learned my addr 172.21.15.77:0/949865925 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:22.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.013+0000 7f81c948e640 1 --2- 172.21.15.77:0/949865925 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f81c40cf160 0x7f81c4150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.013+0000 7f81c9c8f640 1 --2- 172.21.15.77:0/949865925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81c4160b10 0x7f81c40cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.013+0000 7f81c8c8d640 1 -- 172.21.15.77:0/949865925 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f81c40cf160 msgr2=0x7f81c4150130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.013+0000 7f81c8c8d640 1 --2- 172.21.15.77:0/949865925 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f81c40cf160 0x7f81c4150130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.013+0000 7f81c8c8d640 1 -- 172.21.15.77:0/949865925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81c4160b10 msgr2=0x7f81c40cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.013+0000 7f81c8c8d640 1 --2- 172.21.15.77:0/949865925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81c4160b10 0x7f81c40cc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.013+0000 7f81c8c8d640 1 -- 172.21.15.77:0/949865925 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b4009400 con 0x7f81c415ce60 2023-11-04T01:42:22.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.013+0000 7f81c9c8f640 1 --2- 172.21.15.77:0/949865925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81c4160b10 0x7f81c40cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:22.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.013+0000 7f81c8c8d640 1 --2- 172.21.15.77:0/949865925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81c415ce60 0x7f81c40b3770 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f81b40098c0 tx=0x7f81b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:22.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.013+0000 7f81b9ffb640 1 -- 172.21.15.77:0/949865925 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b403ba70 con 0x7f81c415ce60 2023-11-04T01:42:22.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.013+0000 7f81b9ffb640 1 -- 172.21.15.77:0/949865925 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b403bbf0 con 0x7f81c415ce60 2023-11-04T01:42:22.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.013+0000 7f81cb6f2640 1 -- 172.21.15.77:0/949865925 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c40b44d0 con 0x7f81c415ce60 2023-11-04T01:42:22.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.013+0000 7f81b9ffb640 1 -- 172.21.15.77:0/949865925 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b40453f0 con 0x7f81c415ce60 2023-11-04T01:42:22.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.013+0000 7f81cb6f2640 1 -- 172.21.15.77:0/949865925 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c40b4a90 con 0x7f81c415ce60 2023-11-04T01:42:22.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.014+0000 7f81cb6f2640 1 -- 172.21.15.77:0/949865925 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c4074290 con 0x7f81c415ce60 2023-11-04T01:42:22.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.014+0000 7f81b9ffb640 1 -- 172.21.15.77:0/949865925 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f81b404e450 con 0x7f81c415ce60 2023-11-04T01:42:22.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.015+0000 7f81b9ffb640 1 --2- 172.21.15.77:0/949865925 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f81a806aea0 0x7f81a806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.015+0000 7f81b9ffb640 1 -- 172.21.15.77:0/949865925 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f81b40ab6c0 con 0x7f81c415ce60 2023-11-04T01:42:22.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.015+0000 7f81c948e640 1 --2- 172.21.15.77:0/949865925 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f81a806aea0 0x7f81a806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.015+0000 7f81c948e640 1 --2- 172.21.15.77:0/949865925 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f81a806aea0 0x7f81a806d360 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f81c40b1680 tx=0x7f81bc009060 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:22.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.019+0000 7f81b9ffb640 1 -- 172.21.15.77:0/949865925 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f81b40769d0 con 0x7f81c415ce60 2023-11-04T01:42:22.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.186+0000 7f81cb6f2640 1 -- 172.21.15.77:0/949865925 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f81c406b3e0 con 0x7f81c415ce60 2023-11-04T01:42:22.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.187+0000 7f81b9ffb640 1 -- 172.21.15.77:0/949865925 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v62) v1 ==== 84+0+137 (secure 0 0 0) 0x7f81b4035090 con 0x7f81c415ce60 2023-11-04T01:42:22.190 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:22.190 INFO:teuthology.orchestra.run.smithi077.stdout:[ 2023-11-04T01:42:22.190 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:22.191 INFO:teuthology.orchestra.run.smithi077.stdout: "poolnum": 1, 2023-11-04T01:42:22.191 INFO:teuthology.orchestra.run.smithi077.stdout: "poolname": ".mgr" 2023-11-04T01:42:22.191 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:22.191 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:22.191 INFO:teuthology.orchestra.run.smithi077.stdout: "poolnum": 7, 2023-11-04T01:42:22.191 INFO:teuthology.orchestra.run.smithi077.stdout: "poolname": "snap-test-pool" 2023-11-04T01:42:22.192 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:22.192 INFO:teuthology.orchestra.run.smithi077.stdout:] 2023-11-04T01:42:22.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.189+0000 7f81cb6f2640 1 -- 172.21.15.77:0/949865925 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f81a806aea0 msgr2=0x7f81a806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.189+0000 7f81cb6f2640 1 --2- 172.21.15.77:0/949865925 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f81a806aea0 0x7f81a806d360 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f81c40b1680 tx=0x7f81bc009060 comp rx=0 tx=0).stop 2023-11-04T01:42:22.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.189+0000 7f81cb6f2640 1 -- 172.21.15.77:0/949865925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81c415ce60 msgr2=0x7f81c40b3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.189+0000 7f81cb6f2640 1 --2- 172.21.15.77:0/949865925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81c415ce60 0x7f81c40b3770 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f81b40098c0 tx=0x7f81b40046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.189+0000 7f81cb6f2640 1 -- 172.21.15.77:0/949865925 shutdown_connections 2023-11-04T01:42:22.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.189+0000 7f81cb6f2640 1 --2- 172.21.15.77:0/949865925 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f81a806aea0 0x7f81a806d360 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.189+0000 7f81cb6f2640 1 --2- 172.21.15.77:0/949865925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81c4160b10 0x7f81c40cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.189+0000 7f81cb6f2640 1 --2- 172.21.15.77:0/949865925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81c415ce60 0x7f81c40b3770 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.189+0000 7f81cb6f2640 1 --2- 172.21.15.77:0/949865925 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f81c40cf160 0x7f81c4150130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.189+0000 7f81cb6f2640 1 -- 172.21.15.77:0/949865925 >> 172.21.15.77:0/949865925 conn(0x7f81c406ea90 msgr2=0x7f81c40b19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:22.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.189+0000 7f81cb6f2640 1 -- 172.21.15.77:0/949865925 shutdown_connections 2023-11-04T01:42:22.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.189+0000 7f81cb6f2640 1 -- 172.21.15.77:0/949865925 wait complete. 2023-11-04T01:42:22.202 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T01:42:22.202 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T01:42:22.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.303+0000 7f03ba5dc640 1 Processor -- start 2023-11-04T01:42:22.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.303+0000 7f03ba5dc640 1 -- start start 2023-11-04T01:42:22.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.304+0000 7f03ba5dc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f03b40cd9f0 0x7f03b40cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.304+0000 7f03ba5dc640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f03b40d27c0 0x7f03b415d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.304+0000 7f03ba5dc640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b40d1320 con 0x7f03b415d4b0 2023-11-04T01:42:22.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.304+0000 7f03ba5dc640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03b415e4d0 con 0x7f03b40cd9f0 2023-11-04T01:42:22.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.304+0000 7f03ba5dc640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b40ce310 con 0x7f03b40d27c0 2023-11-04T01:42:22.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.304+0000 7f03b3fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f03b40cd9f0 0x7f03b40cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.304+0000 7f03b37fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f03b415d4b0 0x7f03b40b47e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35728/0 (socket says 172.21.15.77:35728) 2023-11-04T01:42:22.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.304+0000 7f03b37fe640 1 -- 172.21.15.77:0/3321718958 learned_addr learned my addr 172.21.15.77:0/3321718958 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:22.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.305+0000 7f03b8b79640 1 --2- 172.21.15.77:0/3321718958 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f03b40d27c0 0x7f03b415d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.305+0000 7f03b3fff640 1 -- 172.21.15.77:0/3321718958 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f03b40d27c0 msgr2=0x7f03b415d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:22.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.305+0000 7f03b3fff640 1 --2- 172.21.15.77:0/3321718958 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f03b40d27c0 0x7f03b415d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.305+0000 7f03b3fff640 1 -- 172.21.15.77:0/3321718958 >> v1:172.21.15.77:6789/0 conn(0x7f03b415d4b0 legacy=0x7f03b40b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.305+0000 7f03b2ffd640 1 -- 172.21.15.77:0/3321718958 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3918586197 0 0) 0x7f03b40d1320 con 0x7f03b415d4b0 2023-11-04T01:42:22.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.305+0000 7f03b3fff640 1 -- 172.21.15.77:0/3321718958 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b415df10 con 0x7f03b40cd9f0 2023-11-04T01:42:22.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.305+0000 7f03b3fff640 1 --2- 172.21.15.77:0/3321718958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03b40cd9f0 0x7f03b40cddd0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f03a40097a0 tx=0x7f03a402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f231802b56f3dee server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:22.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.305+0000 7f03b2ffd640 1 -- 172.21.15.77:0/3321718958 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a4030610 con 0x7f03b40cd9f0 2023-11-04T01:42:22.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.306+0000 7f03b2ffd640 1 -- 172.21.15.77:0/3321718958 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a4030770 con 0x7f03b40cd9f0 2023-11-04T01:42:22.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.306+0000 7f03b2ffd640 1 -- 172.21.15.77:0/3321718958 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a4030b00 con 0x7f03b40cd9f0 2023-11-04T01:42:22.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.306+0000 7f03ba5dc640 1 -- 172.21.15.77:0/3321718958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03b40cd9f0 msgr2=0x7f03b40cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.306+0000 7f03ba5dc640 1 --2- 172.21.15.77:0/3321718958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03b40cd9f0 0x7f03b40cddd0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f03a40097a0 tx=0x7f03a402b960 comp rx=0 tx=0).stop 2023-11-04T01:42:22.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.306+0000 7f03ba5dc640 1 -- 172.21.15.77:0/3321718958 shutdown_connections 2023-11-04T01:42:22.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.306+0000 7f03ba5dc640 1 --2- 172.21.15.77:0/3321718958 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f03b40d27c0 0x7f03b415d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.306+0000 7f03ba5dc640 1 --2- 172.21.15.77:0/3321718958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03b40cd9f0 0x7f03b40cddd0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.306+0000 7f03ba5dc640 1 -- 172.21.15.77:0/3321718958 >> 172.21.15.77:0/3321718958 conn(0x7f03b4071c40 msgr2=0x7f03b4072050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:22.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.306+0000 7f03ba5dc640 1 -- 172.21.15.77:0/3321718958 shutdown_connections 2023-11-04T01:42:22.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.306+0000 7f03ba5dc640 1 -- 172.21.15.77:0/3321718958 wait complete. 2023-11-04T01:42:22.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.307+0000 7f03ba5dc640 1 Processor -- start 2023-11-04T01:42:22.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.307+0000 7f03ba5dc640 1 -- start start 2023-11-04T01:42:22.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.308+0000 7f03ba5dc640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f03b40cd9f0 0x7f03b414afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.308+0000 7f03ba5dc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03b40d27c0 0x7f03b40b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.308+0000 7f03ba5dc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03b415d4b0 0x7f03b415e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.308+0000 7f03ba5dc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b40ccdb0 con 0x7f03b415d4b0 2023-11-04T01:42:22.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.308+0000 7f03ba5dc640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b40cc1a0 con 0x7f03b40d27c0 2023-11-04T01:42:22.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.308+0000 7f03ba5dc640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b40cc480 con 0x7f03b40cd9f0 2023-11-04T01:42:22.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.308+0000 7f03b8b79640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03b415d4b0 0x7f03b415e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.308+0000 7f03b8b79640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03b415d4b0 0x7f03b415e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58272/0 (socket says 172.21.15.77:58272) 2023-11-04T01:42:22.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.308+0000 7f03b8b79640 1 -- 172.21.15.77:0/2602111938 learned_addr learned my addr 172.21.15.77:0/2602111938 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:22.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.308+0000 7f03b3fff640 1 --2- 172.21.15.77:0/2602111938 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f03b40cd9f0 0x7f03b414afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.308+0000 7f03b37fe640 1 --2- 172.21.15.77:0/2602111938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03b40d27c0 0x7f03b40b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.308+0000 7f03b8b79640 1 -- 172.21.15.77:0/2602111938 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f03b40cd9f0 msgr2=0x7f03b414afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.308+0000 7f03b8b79640 1 --2- 172.21.15.77:0/2602111938 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f03b40cd9f0 0x7f03b414afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.309+0000 7f03b8b79640 1 -- 172.21.15.77:0/2602111938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03b40d27c0 msgr2=0x7f03b40b4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.309+0000 7f03b8b79640 1 --2- 172.21.15.77:0/2602111938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03b40d27c0 0x7f03b40b4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.309+0000 7f03b8b79640 1 -- 172.21.15.77:0/2602111938 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a4009400 con 0x7f03b415d4b0 2023-11-04T01:42:22.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.309+0000 7f03b8b79640 1 --2- 172.21.15.77:0/2602111938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03b415d4b0 0x7f03b415e9d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f03ac007e60 tx=0x7f03ac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:22.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.309+0000 7f03b0ff9640 1 -- 172.21.15.77:0/2602111938 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac014420 con 0x7f03b415d4b0 2023-11-04T01:42:22.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.309+0000 7f03b0ff9640 1 -- 172.21.15.77:0/2602111938 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ac0145a0 con 0x7f03b415d4b0 2023-11-04T01:42:22.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.309+0000 7f03ba5dc640 1 -- 172.21.15.77:0/2602111938 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03b40cc760 con 0x7f03b415d4b0 2023-11-04T01:42:22.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.309+0000 7f03b0ff9640 1 -- 172.21.15.77:0/2602111938 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac014950 con 0x7f03b415d4b0 2023-11-04T01:42:22.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.309+0000 7f03ba5dc640 1 -- 172.21.15.77:0/2602111938 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b414b520 con 0x7f03b415d4b0 2023-11-04T01:42:22.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.310+0000 7f03ba5dc640 1 -- 172.21.15.77:0/2602111938 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03b40b27c0 con 0x7f03b415d4b0 2023-11-04T01:42:22.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.310+0000 7f03b0ff9640 1 -- 172.21.15.77:0/2602111938 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f03ac014ab0 con 0x7f03b415d4b0 2023-11-04T01:42:22.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.310+0000 7f03b0ff9640 1 --2- 172.21.15.77:0/2602111938 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f03a006aea0 0x7f03a006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.311+0000 7f03b0ff9640 1 -- 172.21.15.77:0/2602111938 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f03ac089e70 con 0x7f03b415d4b0 2023-11-04T01:42:22.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.311+0000 7f03b3fff640 1 --2- 172.21.15.77:0/2602111938 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f03a006aea0 0x7f03a006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.311+0000 7f03b3fff640 1 --2- 172.21.15.77:0/2602111938 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f03a006aea0 0x7f03a006d360 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f03a4036000 tx=0x7f03a403b040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:22.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.315+0000 7f03b0ff9640 1 -- 172.21.15.77:0/2602111938 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f03b40b27c0 con 0x7f03b415d4b0 2023-11-04T01:42:22.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.480+0000 7f03ba5dc640 1 -- 172.21.15.77:0/2602111938 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f03b40b27c0 con 0x7f03b415d4b0 2023-11-04T01:42:22.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.643+0000 7f03b0ff9640 1 -- 172.21.15.77:0/2602111938 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v63) v1 ==== 138+0+0 (secure 0 0 0) 0x7f03b40b27c0 con 0x7f03b415d4b0 2023-11-04T01:42:22.646 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_metadata' created 2023-11-04T01:42:22.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.645+0000 7f03ba5dc640 1 -- 172.21.15.77:0/2602111938 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f03a006aea0 msgr2=0x7f03a006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.645+0000 7f03ba5dc640 1 --2- 172.21.15.77:0/2602111938 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f03a006aea0 0x7f03a006d360 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f03a4036000 tx=0x7f03a403b040 comp rx=0 tx=0).stop 2023-11-04T01:42:22.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.645+0000 7f03ba5dc640 1 -- 172.21.15.77:0/2602111938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03b415d4b0 msgr2=0x7f03b415e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.645+0000 7f03ba5dc640 1 --2- 172.21.15.77:0/2602111938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03b415d4b0 0x7f03b415e9d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f03ac007e60 tx=0x7f03ac00e4b0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.645+0000 7f03ba5dc640 1 -- 172.21.15.77:0/2602111938 shutdown_connections 2023-11-04T01:42:22.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.645+0000 7f03ba5dc640 1 --2- 172.21.15.77:0/2602111938 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f03a006aea0 0x7f03a006d360 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.645+0000 7f03ba5dc640 1 --2- 172.21.15.77:0/2602111938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03b415d4b0 0x7f03b415e9d0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.645+0000 7f03ba5dc640 1 --2- 172.21.15.77:0/2602111938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03b40d27c0 0x7f03b40b4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.645+0000 7f03ba5dc640 1 --2- 172.21.15.77:0/2602111938 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f03b40cd9f0 0x7f03b414afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.645+0000 7f03ba5dc640 1 -- 172.21.15.77:0/2602111938 >> 172.21.15.77:0/2602111938 conn(0x7f03b4071c40 msgr2=0x7f03b415fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:22.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.645+0000 7f03ba5dc640 1 -- 172.21.15.77:0/2602111938 shutdown_connections 2023-11-04T01:42:22.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.645+0000 7f03ba5dc640 1 -- 172.21.15.77:0/2602111938 wait complete. 2023-11-04T01:42:22.661 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T01:42:22.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.767+0000 7f39fa426640 1 Processor -- start 2023-11-04T01:42:22.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.767+0000 7f39fa426640 1 -- start start 2023-11-04T01:42:22.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.767+0000 7f39fa426640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f39f40cd6d0 0x7f39f4161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.767+0000 7f39fa426640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f39f40b4880 0x7f39f40b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.767+0000 7f39fa426640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39f40cde60 con 0x7f39f4153e60 2023-11-04T01:42:22.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.767+0000 7f39fa426640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39f4160f90 con 0x7f39f40b4880 2023-11-04T01:42:22.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.767+0000 7f39fa426640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39f4161960 con 0x7f39f40cd6d0 2023-11-04T01:42:22.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.767+0000 7f39f89c3640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f39f40b4880 0x7f39f40b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.768+0000 7f39f89c3640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f39f40b4880 0x7f39f40b4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58286/0 (socket says 172.21.15.77:58286) 2023-11-04T01:42:22.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.768+0000 7f39f89c3640 1 -- 172.21.15.77:0/2129938457 learned_addr learned my addr 172.21.15.77:0/2129938457 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:22.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.768+0000 7f39f37fe640 1 --2- 172.21.15.77:0/2129938457 >> v2:172.21.15.122:3300/0 conn(0x7f39f40cd6d0 0x7f39f4161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.768+0000 7f39f89c3640 1 -- 172.21.15.77:0/2129938457 >> v2:172.21.15.122:3300/0 conn(0x7f39f40cd6d0 msgr2=0x7f39f4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:22.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.768+0000 7f39f89c3640 1 --2- 172.21.15.77:0/2129938457 >> v2:172.21.15.122:3300/0 conn(0x7f39f40cd6d0 0x7f39f4161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.768+0000 7f39f89c3640 1 -- 172.21.15.77:0/2129938457 >> v1:172.21.15.122:6789/0 conn(0x7f39f4153e60 legacy=0x7f39f415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:22.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.768+0000 7f39f89c3640 1 -- 172.21.15.77:0/2129938457 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f40b5220 con 0x7f39f40b4880 2023-11-04T01:42:22.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.768+0000 7f39f37fe640 1 --2- 172.21.15.77:0/2129938457 >> v2:172.21.15.122:3300/0 conn(0x7f39f40cd6d0 0x7f39f4161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:22.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.769+0000 7f39f89c3640 1 --2- 172.21.15.77:0/2129938457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39f40b4880 0x7f39f40b4ce0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f39f40c9e80 tx=0x7f39ec02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73cc1f6f6d18e3c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:22.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.769+0000 7f39f2ffd640 1 -- 172.21.15.77:0/2129938457 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec02ca80 con 0x7f39f40b4880 2023-11-04T01:42:22.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.769+0000 7f39f2ffd640 1 -- 172.21.15.77:0/2129938457 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ec02cbe0 con 0x7f39f40b4880 2023-11-04T01:42:22.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.769+0000 7f39f2ffd640 1 -- 172.21.15.77:0/2129938457 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec0343f0 con 0x7f39f40b4880 2023-11-04T01:42:22.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.769+0000 7f39fa426640 1 -- 172.21.15.77:0/2129938457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39f40b4880 msgr2=0x7f39f40b4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.769+0000 7f39fa426640 1 --2- 172.21.15.77:0/2129938457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39f40b4880 0x7f39f40b4ce0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f39f40c9e80 tx=0x7f39ec02bee0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.769+0000 7f39fa426640 1 -- 172.21.15.77:0/2129938457 shutdown_connections 2023-11-04T01:42:22.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.769+0000 7f39fa426640 1 --2- 172.21.15.77:0/2129938457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39f40b4880 0x7f39f40b4ce0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.769+0000 7f39fa426640 1 --2- 172.21.15.77:0/2129938457 >> v2:172.21.15.122:3300/0 conn(0x7f39f40cd6d0 0x7f39f4161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.769+0000 7f39fa426640 1 -- 172.21.15.77:0/2129938457 >> 172.21.15.77:0/2129938457 conn(0x7f39f40cf880 msgr2=0x7f39f40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:22.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.769+0000 7f39fa426640 1 -- 172.21.15.77:0/2129938457 shutdown_connections 2023-11-04T01:42:22.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.769+0000 7f39fa426640 1 -- 172.21.15.77:0/2129938457 wait complete. 2023-11-04T01:42:22.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.770+0000 7f39fa426640 1 Processor -- start 2023-11-04T01:42:22.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.771+0000 7f39fa426640 1 -- start start 2023-11-04T01:42:22.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.771+0000 7f39fa426640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39f40b4880 0x7f39f40c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.771+0000 7f39fa426640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39f40cd6d0 0x7f39f4156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.771+0000 7f39fa426640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39f4153e60 0x7f39f41565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.771+0000 7f39fa426640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f40c7bd0 con 0x7f39f4153e60 2023-11-04T01:42:22.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.771+0000 7f39fa426640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f40c6280 con 0x7f39f40b4880 2023-11-04T01:42:22.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.771+0000 7f39fa426640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f4156c30 con 0x7f39f40cd6d0 2023-11-04T01:42:22.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.771+0000 7f39f89c3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39f4153e60 0x7f39f41565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.771+0000 7f39f89c3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39f4153e60 0x7f39f41565d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58300/0 (socket says 172.21.15.77:58300) 2023-11-04T01:42:22.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.771+0000 7f39f89c3640 1 -- 172.21.15.77:0/3700108085 learned_addr learned my addr 172.21.15.77:0/3700108085 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:22.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.772+0000 7f39f3fff640 1 --2- 172.21.15.77:0/3700108085 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39f40b4880 0x7f39f40c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.772+0000 7f39f37fe640 1 --2- 172.21.15.77:0/3700108085 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39f40cd6d0 0x7f39f4156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.772+0000 7f39f89c3640 1 -- 172.21.15.77:0/3700108085 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39f40cd6d0 msgr2=0x7f39f4156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.772+0000 7f39f89c3640 1 --2- 172.21.15.77:0/3700108085 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39f40cd6d0 0x7f39f4156090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.772+0000 7f39f89c3640 1 -- 172.21.15.77:0/3700108085 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39f40b4880 msgr2=0x7f39f40c5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.772+0000 7f39f89c3640 1 --2- 172.21.15.77:0/3700108085 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39f40b4880 0x7f39f40c5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.772+0000 7f39f89c3640 1 -- 172.21.15.77:0/3700108085 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ec009b30 con 0x7f39f4153e60 2023-11-04T01:42:22.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.772+0000 7f39f3fff640 1 --2- 172.21.15.77:0/3700108085 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39f40b4880 0x7f39f40c5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:22.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.772+0000 7f39f89c3640 1 --2- 172.21.15.77:0/3700108085 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39f4153e60 0x7f39f41565d0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f39ec036040 tx=0x7f39ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:22.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.772+0000 7f39f0ff9640 1 -- 172.21.15.77:0/3700108085 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec03e450 con 0x7f39f4153e60 2023-11-04T01:42:22.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.772+0000 7f39f0ff9640 1 -- 172.21.15.77:0/3700108085 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ec03e5d0 con 0x7f39f4153e60 2023-11-04T01:42:22.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.772+0000 7f39f0ff9640 1 -- 172.21.15.77:0/3700108085 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec03e980 con 0x7f39f4153e60 2023-11-04T01:42:22.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.772+0000 7f39fa426640 1 -- 172.21.15.77:0/3700108085 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f4156f10 con 0x7f39f4153e60 2023-11-04T01:42:22.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.772+0000 7f39fa426640 1 -- 172.21.15.77:0/3700108085 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39f41583b0 con 0x7f39f4153e60 2023-11-04T01:42:22.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.773+0000 7f39fa426640 1 -- 172.21.15.77:0/3700108085 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39f40c7d80 con 0x7f39f4153e60 2023-11-04T01:42:22.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.774+0000 7f39f0ff9640 1 -- 172.21.15.77:0/3700108085 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f39ec02cd50 con 0x7f39f4153e60 2023-11-04T01:42:22.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.774+0000 7f39f0ff9640 1 --2- 172.21.15.77:0/3700108085 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f39e006aea0 0x7f39e006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.774+0000 7f39f0ff9640 1 -- 172.21.15.77:0/3700108085 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f39ec0abf00 con 0x7f39f4153e60 2023-11-04T01:42:22.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.774+0000 7f39f3fff640 1 --2- 172.21.15.77:0/3700108085 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f39e006aea0 0x7f39e006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.775+0000 7f39f3fff640 1 --2- 172.21.15.77:0/3700108085 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f39e006aea0 0x7f39e006d360 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f39e4006fd0 tx=0x7f39e4008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:22.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.779+0000 7f39f0ff9640 1 -- 172.21.15.77:0/3700108085 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f39f40c7d80 con 0x7f39f4153e60 2023-11-04T01:42:22.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:22.947+0000 7f39fa426640 1 -- 172.21.15.77:0/3700108085 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f39f4157430 con 0x7f39f4153e60 2023-11-04T01:42:23.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.645+0000 7f39f0ff9640 1 -- 172.21.15.77:0/3700108085 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v64) v1 ==== 170+0+0 (secure 0 0 0) 0x7f39ec076f80 con 0x7f39f4153e60 2023-11-04T01:42:23.648 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data' created 2023-11-04T01:42:23.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.649+0000 7f39fa426640 1 -- 172.21.15.77:0/3700108085 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f39e006aea0 msgr2=0x7f39e006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.649+0000 7f39fa426640 1 --2- 172.21.15.77:0/3700108085 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f39e006aea0 0x7f39e006d360 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f39e4006fd0 tx=0x7f39e4008040 comp rx=0 tx=0).stop 2023-11-04T01:42:23.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.649+0000 7f39fa426640 1 -- 172.21.15.77:0/3700108085 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39f4153e60 msgr2=0x7f39f41565d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.649+0000 7f39fa426640 1 --2- 172.21.15.77:0/3700108085 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39f4153e60 0x7f39f41565d0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f39ec036040 tx=0x7f39ec004a40 comp rx=0 tx=0).stop 2023-11-04T01:42:23.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.649+0000 7f39fa426640 1 -- 172.21.15.77:0/3700108085 shutdown_connections 2023-11-04T01:42:23.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.649+0000 7f39fa426640 1 --2- 172.21.15.77:0/3700108085 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f39e006aea0 0x7f39e006d360 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.649+0000 7f39fa426640 1 --2- 172.21.15.77:0/3700108085 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39f4153e60 0x7f39f41565d0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.649+0000 7f39fa426640 1 --2- 172.21.15.77:0/3700108085 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39f40cd6d0 0x7f39f4156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.649+0000 7f39fa426640 1 --2- 172.21.15.77:0/3700108085 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39f40b4880 0x7f39f40c5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.649+0000 7f39fa426640 1 -- 172.21.15.77:0/3700108085 >> 172.21.15.77:0/3700108085 conn(0x7f39f40cf880 msgr2=0x7f39f40d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:23.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.649+0000 7f39fa426640 1 -- 172.21.15.77:0/3700108085 shutdown_connections 2023-11-04T01:42:23.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.650+0000 7f39fa426640 1 -- 172.21.15.77:0/3700108085 wait complete. 2023-11-04T01:42:23.679 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T01:42:23.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.784+0000 7f753398a640 1 Processor -- start 2023-11-04T01:42:23.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.784+0000 7f753398a640 1 -- start start 2023-11-04T01:42:23.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.785+0000 7f753398a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f752c0c4ff0 0x7f752c0cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.785+0000 7f753398a640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f752c0adac0 0x7f752c0adf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.785+0000 7f753398a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f752c15aff0 con 0x7f752c159c00 2023-11-04T01:42:23.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.785+0000 7f753398a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f752c0ae460 con 0x7f752c0c4ff0 2023-11-04T01:42:23.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.785+0000 7f753398a640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752c15a3e0 con 0x7f752c0adac0 2023-11-04T01:42:23.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.785+0000 7f7531726640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f752c159c00 0x7f752c0c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35732/0 (socket says 172.21.15.77:35732) 2023-11-04T01:42:23.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.785+0000 7f7531726640 1 -- 172.21.15.77:0/1147675100 learned_addr learned my addr 172.21.15.77:0/1147675100 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:23.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.785+0000 7f7530f25640 1 --2- 172.21.15.77:0/1147675100 >> v2:172.21.15.77:3300/0 conn(0x7f752c0c4ff0 0x7f752c0cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.786+0000 7f7531f27640 1 --2- 172.21.15.77:0/1147675100 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f752c0adac0 0x7f752c0adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.786+0000 7f7530f25640 1 -- 172.21.15.77:0/1147675100 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f752c0adac0 msgr2=0x7f752c0adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:23.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.786+0000 7f7530f25640 1 --2- 172.21.15.77:0/1147675100 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f752c0adac0 0x7f752c0adf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.786+0000 7f7530f25640 1 -- 172.21.15.77:0/1147675100 >> v1:172.21.15.77:6789/0 conn(0x7f752c159c00 legacy=0x7f752c0c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.786+0000 7f7530f25640 1 -- 172.21.15.77:0/1147675100 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752c15a6c0 con 0x7f752c0c4ff0 2023-11-04T01:42:23.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.786+0000 7f7523fff640 1 -- 172.21.15.77:0/1147675100 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1027918204 0 0) 0x7f752c15aff0 con 0x7f752c159c00 2023-11-04T01:42:23.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.786+0000 7f7530f25640 1 --2- 172.21.15.77:0/1147675100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f752c0c4ff0 0x7f752c0cc890 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f751c0097a0 tx=0x7f751c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d2739d29ff0b08 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:23.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.787+0000 7f7523fff640 1 -- 172.21.15.77:0/1147675100 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c031830 con 0x7f752c0c4ff0 2023-11-04T01:42:23.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.787+0000 7f7523fff640 1 -- 172.21.15.77:0/1147675100 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751c031990 con 0x7f752c0c4ff0 2023-11-04T01:42:23.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.787+0000 7f7523fff640 1 -- 172.21.15.77:0/1147675100 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c031d20 con 0x7f752c0c4ff0 2023-11-04T01:42:23.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.787+0000 7f753398a640 1 -- 172.21.15.77:0/1147675100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f752c0c4ff0 msgr2=0x7f752c0cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.787+0000 7f753398a640 1 --2- 172.21.15.77:0/1147675100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f752c0c4ff0 0x7f752c0cc890 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f751c0097a0 tx=0x7f751c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.787+0000 7f753398a640 1 -- 172.21.15.77:0/1147675100 shutdown_connections 2023-11-04T01:42:23.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.787+0000 7f753398a640 1 --2- 172.21.15.77:0/1147675100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f752c0c4ff0 0x7f752c0cc890 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.787+0000 7f753398a640 1 --2- 172.21.15.77:0/1147675100 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f752c0adac0 0x7f752c0adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.787+0000 7f753398a640 1 -- 172.21.15.77:0/1147675100 >> 172.21.15.77:0/1147675100 conn(0x7f752c0ce950 msgr2=0x7f752c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:23.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.787+0000 7f753398a640 1 -- 172.21.15.77:0/1147675100 shutdown_connections 2023-11-04T01:42:23.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.787+0000 7f753398a640 1 -- 172.21.15.77:0/1147675100 wait complete. 2023-11-04T01:42:23.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.788+0000 7f753398a640 1 Processor -- start 2023-11-04T01:42:23.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.788+0000 7f753398a640 1 -- start start 2023-11-04T01:42:23.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.789+0000 7f753398a640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f752c0adac0 0x7f752c0c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.789+0000 7f753398a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f752c0c4ff0 0x7f752c1f3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.789+0000 7f753398a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f752c159c00 0x7f752c15c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.789+0000 7f753398a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752c151d50 con 0x7f752c159c00 2023-11-04T01:42:23.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.789+0000 7f753398a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752c0c88f0 con 0x7f752c0c4ff0 2023-11-04T01:42:23.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.789+0000 7f753398a640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752c15c4e0 con 0x7f752c0adac0 2023-11-04T01:42:23.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.789+0000 7f7531f27640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f752c159c00 0x7f752c15c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.789+0000 7f7531f27640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f752c159c00 0x7f752c15c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58314/0 (socket says 172.21.15.77:58314) 2023-11-04T01:42:23.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.789+0000 7f7531f27640 1 -- 172.21.15.77:0/428436600 learned_addr learned my addr 172.21.15.77:0/428436600 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:23.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.789+0000 7f7531726640 1 --2- 172.21.15.77:0/428436600 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f752c0adac0 0x7f752c0c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.789+0000 7f7530f25640 1 --2- 172.21.15.77:0/428436600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f752c0c4ff0 0x7f752c1f3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.789+0000 7f7531f27640 1 -- 172.21.15.77:0/428436600 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f752c0adac0 msgr2=0x7f752c0c83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.789+0000 7f7531f27640 1 --2- 172.21.15.77:0/428436600 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f752c0adac0 0x7f752c0c83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.790+0000 7f7531f27640 1 -- 172.21.15.77:0/428436600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f752c0c4ff0 msgr2=0x7f752c1f3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.790+0000 7f7531f27640 1 --2- 172.21.15.77:0/428436600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f752c0c4ff0 0x7f752c1f3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.790+0000 7f7531f27640 1 -- 172.21.15.77:0/428436600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751c009400 con 0x7f752c159c00 2023-11-04T01:42:23.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.790+0000 7f7531726640 1 --2- 172.21.15.77:0/428436600 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f752c0adac0 0x7f752c0c83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:23.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.790+0000 7f7530f25640 1 --2- 172.21.15.77:0/428436600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f752c0c4ff0 0x7f752c1f3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:23.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.790+0000 7f7531f27640 1 --2- 172.21.15.77:0/428436600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f752c159c00 0x7f752c15c820 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f7524007ea0 tx=0x7f7524007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:23.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.790+0000 7f7521ffb640 1 -- 172.21.15.77:0/428436600 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7524014620 con 0x7f752c159c00 2023-11-04T01:42:23.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.790+0000 7f7521ffb640 1 -- 172.21.15.77:0/428436600 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75240147a0 con 0x7f752c159c00 2023-11-04T01:42:23.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.790+0000 7f753398a640 1 -- 172.21.15.77:0/428436600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f752c15c050 con 0x7f752c159c00 2023-11-04T01:42:23.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.790+0000 7f7521ffb640 1 -- 172.21.15.77:0/428436600 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7524014b50 con 0x7f752c159c00 2023-11-04T01:42:23.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.790+0000 7f753398a640 1 -- 172.21.15.77:0/428436600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f752c15b440 con 0x7f752c159c00 2023-11-04T01:42:23.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.791+0000 7f753398a640 1 -- 172.21.15.77:0/428436600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f752c15c1e0 con 0x7f752c159c00 2023-11-04T01:42:23.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.791+0000 7f7521ffb640 1 -- 172.21.15.77:0/428436600 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7524014cb0 con 0x7f752c159c00 2023-11-04T01:42:23.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.792+0000 7f7521ffb640 1 --2- 172.21.15.77:0/428436600 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f751006ae70 0x7f751006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:23.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.792+0000 7f7521ffb640 1 -- 172.21.15.77:0/428436600 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f752408a220 con 0x7f752c159c00 2023-11-04T01:42:23.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.792+0000 7f7531726640 1 --2- 172.21.15.77:0/428436600 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f751006ae70 0x7f751006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:23.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.792+0000 7f7531726640 1 --2- 172.21.15.77:0/428436600 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f751006ae70 0x7f751006d330 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7528000f60 tx=0x7f7528009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:23.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.796+0000 7f7521ffb640 1 -- 172.21.15.77:0/428436600 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7524055090 con 0x7f752c159c00 2023-11-04T01:42:24.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:23.997+0000 7f753398a640 1 -- 172.21.15.77:0/428436600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f752c074290 con 0x7f752c159c00 2023-11-04T01:42:24.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.655+0000 7f7521ffb640 1 -- 172.21.15.77:0/428436600 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v26) v1 ==== 174+0+0 (secure 0 0 0) 0x7f75240586b0 con 0x7f752c159c00 2023-11-04T01:42:24.658 INFO:teuthology.orchestra.run.smithi077.stderr:new fs with metadata pool 10 and data pool 11 2023-11-04T01:42:24.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.659+0000 7f753398a640 1 -- 172.21.15.77:0/428436600 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f751006ae70 msgr2=0x7f751006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.659+0000 7f753398a640 1 --2- 172.21.15.77:0/428436600 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f751006ae70 0x7f751006d330 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7528000f60 tx=0x7f7528009040 comp rx=0 tx=0).stop 2023-11-04T01:42:24.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.659+0000 7f753398a640 1 -- 172.21.15.77:0/428436600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f752c159c00 msgr2=0x7f752c15c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.659+0000 7f753398a640 1 --2- 172.21.15.77:0/428436600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f752c159c00 0x7f752c15c820 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f7524007ea0 tx=0x7f7524007f90 comp rx=0 tx=0).stop 2023-11-04T01:42:24.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.659+0000 7f753398a640 1 -- 172.21.15.77:0/428436600 shutdown_connections 2023-11-04T01:42:24.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.659+0000 7f753398a640 1 --2- 172.21.15.77:0/428436600 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f751006ae70 0x7f751006d330 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.659+0000 7f753398a640 1 --2- 172.21.15.77:0/428436600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f752c159c00 0x7f752c15c820 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.659+0000 7f753398a640 1 --2- 172.21.15.77:0/428436600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f752c0c4ff0 0x7f752c1f3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.659+0000 7f753398a640 1 --2- 172.21.15.77:0/428436600 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f752c0adac0 0x7f752c0c83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.659+0000 7f753398a640 1 -- 172.21.15.77:0/428436600 >> 172.21.15.77:0/428436600 conn(0x7f752c0ce950 msgr2=0x7f752c06cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:24.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.659+0000 7f753398a640 1 -- 172.21.15.77:0/428436600 shutdown_connections 2023-11-04T01:42:24.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.659+0000 7f753398a640 1 -- 172.21.15.77:0/428436600 wait complete. 2023-11-04T01:42:24.689 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:24.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.788+0000 7f8b68b33640 1 Processor -- start 2023-11-04T01:42:24.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.788+0000 7f8b68b33640 1 -- start start 2023-11-04T01:42:24.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.789+0000 7f8b68b33640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8b640cde60 0x7f8b6415d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.789+0000 7f8b68b33640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8b640ce240 0x7f8b640d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.789+0000 7f8b68b33640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b6415e000 con 0x7f8b6415daa0 2023-11-04T01:42:24.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.789+0000 7f8b68b33640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b6415e5c0 con 0x7f8b640cde60 2023-11-04T01:42:24.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.789+0000 7f8b68b33640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b6415e2e0 con 0x7f8b640ce240 2023-11-04T01:42:24.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.789+0000 7f8b6259c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8b640cde60 0x7f8b6415d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.789+0000 7f8b61d9b640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f8b6415daa0 0x7f8b64157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35734/0 (socket says 172.21.15.77:35734) 2023-11-04T01:42:24.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.789+0000 7f8b61d9b640 1 -- 172.21.15.77:0/3035849594 learned_addr learned my addr 172.21.15.77:0/3035849594 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:24.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.789+0000 7f8b6259c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8b640cde60 0x7f8b6415d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58328/0 (socket says 172.21.15.77:58328) 2023-11-04T01:42:24.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.789+0000 7f8b62d9d640 1 --2- 172.21.15.77:0/3035849594 >> v2:172.21.15.122:3300/0 conn(0x7f8b640ce240 0x7f8b640d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.790+0000 7f8b6259c640 1 -- 172.21.15.77:0/3035849594 >> v2:172.21.15.122:3300/0 conn(0x7f8b640ce240 msgr2=0x7f8b640d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:24.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.790+0000 7f8b6259c640 1 --2- 172.21.15.77:0/3035849594 >> v2:172.21.15.122:3300/0 conn(0x7f8b640ce240 0x7f8b640d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.790+0000 7f8b6259c640 1 -- 172.21.15.77:0/3035849594 >> v1:172.21.15.77:6789/0 conn(0x7f8b6415daa0 legacy=0x7f8b64157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.790+0000 7f8b6259c640 1 -- 172.21.15.77:0/3035849594 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b640d1120 con 0x7f8b640cde60 2023-11-04T01:42:24.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.790+0000 7f8b6159a640 1 -- 172.21.15.77:0/3035849594 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1866623782 0 0) 0x7f8b6415e000 con 0x7f8b6415daa0 2023-11-04T01:42:24.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.790+0000 7f8b62d9d640 1 --2- 172.21.15.77:0/3035849594 >> v2:172.21.15.122:3300/0 conn(0x7f8b640ce240 0x7f8b640d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:24.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.790+0000 7f8b6259c640 1 --2- 172.21.15.77:0/3035849594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b640cde60 0x7f8b6415d560 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f8b640cf2e0 tx=0x7f8b5402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890cd9e6b13a4840 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:24.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.790+0000 7f8b6159a640 1 -- 172.21.15.77:0/3035849594 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5402cc80 con 0x7f8b640cde60 2023-11-04T01:42:24.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.791+0000 7f8b6159a640 1 -- 172.21.15.77:0/3035849594 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5402cde0 con 0x7f8b640cde60 2023-11-04T01:42:24.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.791+0000 7f8b6159a640 1 -- 172.21.15.77:0/3035849594 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b54034660 con 0x7f8b640cde60 2023-11-04T01:42:24.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.791+0000 7f8b68b33640 1 -- 172.21.15.77:0/3035849594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b640cde60 msgr2=0x7f8b6415d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.791+0000 7f8b68b33640 1 --2- 172.21.15.77:0/3035849594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b640cde60 0x7f8b6415d560 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f8b640cf2e0 tx=0x7f8b5402bed0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.791+0000 7f8b68b33640 1 -- 172.21.15.77:0/3035849594 shutdown_connections 2023-11-04T01:42:24.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.791+0000 7f8b68b33640 1 --2- 172.21.15.77:0/3035849594 >> v2:172.21.15.122:3300/0 conn(0x7f8b640ce240 0x7f8b640d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.791+0000 7f8b68b33640 1 --2- 172.21.15.77:0/3035849594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b640cde60 0x7f8b6415d560 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.791+0000 7f8b68b33640 1 -- 172.21.15.77:0/3035849594 >> 172.21.15.77:0/3035849594 conn(0x7f8b64071f30 msgr2=0x7f8b640cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:24.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.791+0000 7f8b68b33640 1 -- 172.21.15.77:0/3035849594 shutdown_connections 2023-11-04T01:42:24.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.791+0000 7f8b68b33640 1 -- 172.21.15.77:0/3035849594 wait complete. 2023-11-04T01:42:24.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.793+0000 7f8b68b33640 1 Processor -- start 2023-11-04T01:42:24.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.793+0000 7f8b68b33640 1 -- start start 2023-11-04T01:42:24.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.793+0000 7f8b68b33640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b640cde60 0x7f8b6414d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.793+0000 7f8b68b33640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b640ce240 0x7f8b640cc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.793+0000 7f8b68b33640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b6415daa0 0x7f8b640ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.793+0000 7f8b68b33640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b640ca690 con 0x7f8b640cde60 2023-11-04T01:42:24.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.793+0000 7f8b68b33640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b641e4540 con 0x7f8b640ce240 2023-11-04T01:42:24.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.793+0000 7f8b68b33640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b641e4820 con 0x7f8b6415daa0 2023-11-04T01:42:24.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.793+0000 7f8b6259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b640cde60 0x7f8b6414d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.794+0000 7f8b6259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b640cde60 0x7f8b6414d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58342/0 (socket says 172.21.15.77:58342) 2023-11-04T01:42:24.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.794+0000 7f8b6259c640 1 -- 172.21.15.77:0/3012333261 learned_addr learned my addr 172.21.15.77:0/3012333261 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:24.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.794+0000 7f8b61d9b640 1 --2- 172.21.15.77:0/3012333261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b640ce240 0x7f8b640cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.794+0000 7f8b62d9d640 1 --2- 172.21.15.77:0/3012333261 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b6415daa0 0x7f8b640ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.794+0000 7f8b6259c640 1 -- 172.21.15.77:0/3012333261 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b6415daa0 msgr2=0x7f8b640ca900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.794+0000 7f8b6259c640 1 --2- 172.21.15.77:0/3012333261 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b6415daa0 0x7f8b640ca900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.794+0000 7f8b6259c640 1 -- 172.21.15.77:0/3012333261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b640ce240 msgr2=0x7f8b640cc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.794+0000 7f8b6259c640 1 --2- 172.21.15.77:0/3012333261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b640ce240 0x7f8b640cc770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.794+0000 7f8b6259c640 1 -- 172.21.15.77:0/3012333261 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b54009a70 con 0x7f8b640cde60 2023-11-04T01:42:24.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.794+0000 7f8b62d9d640 1 --2- 172.21.15.77:0/3012333261 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b6415daa0 0x7f8b640ca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:24.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.794+0000 7f8b61d9b640 1 --2- 172.21.15.77:0/3012333261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b640ce240 0x7f8b640cc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:24.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.794+0000 7f8b6259c640 1 --2- 172.21.15.77:0/3012333261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b640cde60 0x7f8b6414d820 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f8b54009e80 tx=0x7f8b54004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:24.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.794+0000 7f8b52ffd640 1 -- 172.21.15.77:0/3012333261 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b54003b90 con 0x7f8b640cde60 2023-11-04T01:42:24.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.794+0000 7f8b52ffd640 1 -- 172.21.15.77:0/3012333261 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b54003cf0 con 0x7f8b640cde60 2023-11-04T01:42:24.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.794+0000 7f8b68b33640 1 -- 172.21.15.77:0/3012333261 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b641e4b00 con 0x7f8b640cde60 2023-11-04T01:42:24.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.794+0000 7f8b52ffd640 1 -- 172.21.15.77:0/3012333261 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b54004220 con 0x7f8b640cde60 2023-11-04T01:42:24.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.794+0000 7f8b68b33640 1 -- 172.21.15.77:0/3012333261 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b641e50c0 con 0x7f8b640cde60 2023-11-04T01:42:24.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.795+0000 7f8b68b33640 1 -- 172.21.15.77:0/3012333261 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b640d2b10 con 0x7f8b640cde60 2023-11-04T01:42:24.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.796+0000 7f8b52ffd640 1 -- 172.21.15.77:0/3012333261 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8b5403b050 con 0x7f8b640cde60 2023-11-04T01:42:24.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.796+0000 7f8b52ffd640 1 --2- 172.21.15.77:0/3012333261 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8b4406aea0 0x7f8b4406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.796+0000 7f8b52ffd640 1 -- 172.21.15.77:0/3012333261 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8b540ac070 con 0x7f8b640cde60 2023-11-04T01:42:24.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.796+0000 7f8b61d9b640 1 --2- 172.21.15.77:0/3012333261 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8b4406aea0 0x7f8b4406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.797+0000 7f8b61d9b640 1 --2- 172.21.15.77:0/3012333261 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8b4406aea0 0x7f8b4406d360 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8b640b50b0 tx=0x7f8b58007ca0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:24.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.800+0000 7f8b52ffd640 1 -- 172.21.15.77:0/3012333261 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8b54076f10 con 0x7f8b640cde60 2023-11-04T01:42:24.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.968+0000 7f8b68b33640 1 -- 172.21.15.77:0/3012333261 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b64074290 con 0x7f8b640cde60 2023-11-04T01:42:24.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.970+0000 7f8b52ffd640 1 -- 172.21.15.77:0/3012333261 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+18527 (secure 0 0 0) 0x7f8b5404d090 con 0x7f8b640cde60 2023-11-04T01:42:24.973 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:24.973 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":65,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:42:23.999677+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:22.500204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:22.966681+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:24.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.972+0000 7f8b68b33640 1 -- 172.21.15.77:0/3012333261 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8b4406aea0 msgr2=0x7f8b4406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.972+0000 7f8b68b33640 1 --2- 172.21.15.77:0/3012333261 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8b4406aea0 0x7f8b4406d360 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8b640b50b0 tx=0x7f8b58007ca0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.972+0000 7f8b68b33640 1 -- 172.21.15.77:0/3012333261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b640cde60 msgr2=0x7f8b6414d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.972+0000 7f8b68b33640 1 --2- 172.21.15.77:0/3012333261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b640cde60 0x7f8b6414d820 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f8b54009e80 tx=0x7f8b54004a40 comp rx=0 tx=0).stop 2023-11-04T01:42:24.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.972+0000 7f8b68b33640 1 -- 172.21.15.77:0/3012333261 shutdown_connections 2023-11-04T01:42:24.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.972+0000 7f8b68b33640 1 --2- 172.21.15.77:0/3012333261 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8b4406aea0 0x7f8b4406d360 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.972+0000 7f8b68b33640 1 --2- 172.21.15.77:0/3012333261 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b6415daa0 0x7f8b640ca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.972+0000 7f8b68b33640 1 --2- 172.21.15.77:0/3012333261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b640ce240 0x7f8b640cc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.972+0000 7f8b68b33640 1 --2- 172.21.15.77:0/3012333261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b640cde60 0x7f8b6414d820 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.972+0000 7f8b68b33640 1 -- 172.21.15.77:0/3012333261 >> 172.21.15.77:0/3012333261 conn(0x7f8b64071f30 msgr2=0x7f8b64156530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:24.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.972+0000 7f8b68b33640 1 -- 172.21.15.77:0/3012333261 shutdown_connections 2023-11-04T01:42:24.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:24.972+0000 7f8b68b33640 1 -- 172.21.15.77:0/3012333261 wait complete. 2023-11-04T01:42:24.985 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:25.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.082+0000 7f7d2871d640 1 Processor -- start 2023-11-04T01:42:25.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.082+0000 7f7d2871d640 1 -- start start 2023-11-04T01:42:25.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.083+0000 7f7d2871d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7d200cda60 0x7f7d200ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.083+0000 7f7d2871d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d200cc990 con 0x7f7d20070d40 2023-11-04T01:42:25.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.083+0000 7f7d2871d640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d200ccc70 con 0x7f7d200b0cd0 2023-11-04T01:42:25.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.083+0000 7f7d2871d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d200c9ce0 con 0x7f7d200cda60 2023-11-04T01:42:25.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.083+0000 7f7d264b9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7d200cda60 0x7f7d200ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.083+0000 7f7d26cba640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f7d20070d40 0x7f7d2006c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35742/0 (socket says 172.21.15.77:35742) 2023-11-04T01:42:25.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.083+0000 7f7d26cba640 1 -- 172.21.15.77:0/2462866103 learned_addr learned my addr 172.21.15.77:0/2462866103 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:25.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.083+0000 7f7d264b9640 1 -- 172.21.15.77:0/2462866103 >> v1:172.21.15.122:6789/0 conn(0x7f7d200b0cd0 legacy=0x7f7d20070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:25.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.083+0000 7f7d264b9640 1 -- 172.21.15.77:0/2462866103 >> v1:172.21.15.77:6789/0 conn(0x7f7d20070d40 legacy=0x7f7d2006c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.083+0000 7f7d254b7640 1 -- 172.21.15.77:0/2462866103 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2224394975 0 0) 0x7f7d200cc990 con 0x7f7d20070d40 2023-11-04T01:42:25.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.083+0000 7f7d264b9640 1 -- 172.21.15.77:0/2462866103 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d200c9fc0 con 0x7f7d200cda60 2023-11-04T01:42:25.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.084+0000 7f7d264b9640 1 --2- 172.21.15.77:0/2462866103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d200cda60 0x7f7d200ca7a0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c009d90 tx=0x7f7d1c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91f553dabae6df server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:25.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.084+0000 7f7d254b7640 1 -- 172.21.15.77:0/2462866103 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c02cc60 con 0x7f7d200cda60 2023-11-04T01:42:25.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.084+0000 7f7d254b7640 1 -- 172.21.15.77:0/2462866103 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d1c02cdc0 con 0x7f7d200cda60 2023-11-04T01:42:25.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.084+0000 7f7d254b7640 1 -- 172.21.15.77:0/2462866103 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c034660 con 0x7f7d200cda60 2023-11-04T01:42:25.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.085+0000 7f7d2871d640 1 -- 172.21.15.77:0/2462866103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d200cda60 msgr2=0x7f7d200ca7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.085+0000 7f7d2871d640 1 --2- 172.21.15.77:0/2462866103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d200cda60 0x7f7d200ca7a0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c009d90 tx=0x7f7d1c02beb0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.085+0000 7f7d2871d640 1 -- 172.21.15.77:0/2462866103 shutdown_connections 2023-11-04T01:42:25.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.085+0000 7f7d2871d640 1 --2- 172.21.15.77:0/2462866103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d200cda60 0x7f7d200ca7a0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.085+0000 7f7d2871d640 1 -- 172.21.15.77:0/2462866103 >> 172.21.15.77:0/2462866103 conn(0x7f7d200ce950 msgr2=0x7f7d200ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:25.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.085+0000 7f7d2871d640 1 -- 172.21.15.77:0/2462866103 shutdown_connections 2023-11-04T01:42:25.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.085+0000 7f7d2871d640 1 -- 172.21.15.77:0/2462866103 wait complete. 2023-11-04T01:42:25.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.086+0000 7f7d2871d640 1 Processor -- start 2023-11-04T01:42:25.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.086+0000 7f7d2871d640 1 -- start start 2023-11-04T01:42:25.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.087+0000 7f7d2871d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d20070d40 0x7f7d20149b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.087+0000 7f7d2871d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d200b0cd0 0x7f7d200c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.087+0000 7f7d2871d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7d200cda60 0x7f7d200c2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.087+0000 7f7d2871d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d200c4230 con 0x7f7d20070d40 2023-11-04T01:42:25.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.087+0000 7f7d2871d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d200c1dd0 con 0x7f7d200b0cd0 2023-11-04T01:42:25.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.087+0000 7f7d2871d640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d200c3f50 con 0x7f7d200cda60 2023-11-04T01:42:25.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.087+0000 7f7d264b9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d20070d40 0x7f7d20149b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.087+0000 7f7d264b9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d20070d40 0x7f7d20149b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58350/0 (socket says 172.21.15.77:58350) 2023-11-04T01:42:25.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.087+0000 7f7d264b9640 1 -- 172.21.15.77:0/2128808356 learned_addr learned my addr 172.21.15.77:0/2128808356 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:25.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.087+0000 7f7d26cba640 1 --2- 172.21.15.77:0/2128808356 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7d200cda60 0x7f7d200c2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.087+0000 7f7d25cb8640 1 --2- 172.21.15.77:0/2128808356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d200b0cd0 0x7f7d200c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.087+0000 7f7d264b9640 1 -- 172.21.15.77:0/2128808356 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7d200cda60 msgr2=0x7f7d200c2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.087+0000 7f7d264b9640 1 --2- 172.21.15.77:0/2128808356 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7d200cda60 0x7f7d200c2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.087+0000 7f7d264b9640 1 -- 172.21.15.77:0/2128808356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d200b0cd0 msgr2=0x7f7d200c35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.087+0000 7f7d264b9640 1 --2- 172.21.15.77:0/2128808356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d200b0cd0 0x7f7d200c35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.087+0000 7f7d264b9640 1 -- 172.21.15.77:0/2128808356 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d1c009a70 con 0x7f7d20070d40 2023-11-04T01:42:25.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.087+0000 7f7d25cb8640 1 --2- 172.21.15.77:0/2128808356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d200b0cd0 0x7f7d200c35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:25.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.087+0000 7f7d264b9640 1 --2- 172.21.15.77:0/2128808356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d20070d40 0x7f7d20149b70 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c009d90 tx=0x7f7d1c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:25.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.087+0000 7f7d16ffd640 1 -- 172.21.15.77:0/2128808356 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c03e610 con 0x7f7d20070d40 2023-11-04T01:42:25.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.087+0000 7f7d16ffd640 1 -- 172.21.15.77:0/2128808356 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d1c03e770 con 0x7f7d20070d40 2023-11-04T01:42:25.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.087+0000 7f7d2871d640 1 -- 172.21.15.77:0/2128808356 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d200c1fe0 con 0x7f7d20070d40 2023-11-04T01:42:25.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.087+0000 7f7d16ffd640 1 -- 172.21.15.77:0/2128808356 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c03eb20 con 0x7f7d20070d40 2023-11-04T01:42:25.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.088+0000 7f7d2871d640 1 -- 172.21.15.77:0/2128808356 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d200c25a0 con 0x7f7d20070d40 2023-11-04T01:42:25.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.088+0000 7f7d2871d640 1 -- 172.21.15.77:0/2128808356 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d200ad630 con 0x7f7d20070d40 2023-11-04T01:42:25.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.089+0000 7f7d16ffd640 1 -- 172.21.15.77:0/2128808356 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7d1c03b050 con 0x7f7d20070d40 2023-11-04T01:42:25.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.089+0000 7f7d16ffd640 1 --2- 172.21.15.77:0/2128808356 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7d0406ae70 0x7f7d0406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.089+0000 7f7d16ffd640 1 -- 172.21.15.77:0/2128808356 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7d1c0ac360 con 0x7f7d20070d40 2023-11-04T01:42:25.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.089+0000 7f7d25cb8640 1 --2- 172.21.15.77:0/2128808356 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7d0406ae70 0x7f7d0406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.090+0000 7f7d25cb8640 1 --2- 172.21.15.77:0/2128808356 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7d0406ae70 0x7f7d0406d330 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7d2014fe20 tx=0x7f7d10009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:25.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.093+0000 7f7d16ffd640 1 -- 172.21.15.77:0/2128808356 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7d1c0773d0 con 0x7f7d20070d40 2023-11-04T01:42:25.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.263+0000 7f7d2871d640 1 -- 172.21.15.77:0/2128808356 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d200c2790 con 0x7f7d20070d40 2023-11-04T01:42:25.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.264+0000 7f7d16ffd640 1 -- 172.21.15.77:0/2128808356 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+18527 (secure 0 0 0) 0x7f7d1c07a9f0 con 0x7f7d20070d40 2023-11-04T01:42:25.267 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:25.268 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":65,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:42:23.999677+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:22.500204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:22.966681+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:25.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.266+0000 7f7d2871d640 1 -- 172.21.15.77:0/2128808356 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7d0406ae70 msgr2=0x7f7d0406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.266+0000 7f7d2871d640 1 --2- 172.21.15.77:0/2128808356 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7d0406ae70 0x7f7d0406d330 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7d2014fe20 tx=0x7f7d10009040 comp rx=0 tx=0).stop 2023-11-04T01:42:25.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.266+0000 7f7d2871d640 1 -- 172.21.15.77:0/2128808356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d20070d40 msgr2=0x7f7d20149b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.266+0000 7f7d2871d640 1 --2- 172.21.15.77:0/2128808356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d20070d40 0x7f7d20149b70 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c009d90 tx=0x7f7d1c004a40 comp rx=0 tx=0).stop 2023-11-04T01:42:25.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.266+0000 7f7d2871d640 1 -- 172.21.15.77:0/2128808356 shutdown_connections 2023-11-04T01:42:25.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.266+0000 7f7d2871d640 1 --2- 172.21.15.77:0/2128808356 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7d0406ae70 0x7f7d0406d330 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.267+0000 7f7d2871d640 1 --2- 172.21.15.77:0/2128808356 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7d200cda60 0x7f7d200c2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.267+0000 7f7d2871d640 1 --2- 172.21.15.77:0/2128808356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d200b0cd0 0x7f7d200c35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.267+0000 7f7d2871d640 1 --2- 172.21.15.77:0/2128808356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d20070d40 0x7f7d20149b70 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.267+0000 7f7d2871d640 1 -- 172.21.15.77:0/2128808356 >> 172.21.15.77:0/2128808356 conn(0x7f7d200ce950 msgr2=0x7f7d20152a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:25.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.267+0000 7f7d2871d640 1 -- 172.21.15.77:0/2128808356 shutdown_connections 2023-11-04T01:42:25.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.267+0000 7f7d2871d640 1 -- 172.21.15.77:0/2128808356 wait complete. 2023-11-04T01:42:25.280 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T01:42:25.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.379+0000 7fa78fee1640 1 Processor -- start 2023-11-04T01:42:25.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.380+0000 7fa78fee1640 1 -- start start 2023-11-04T01:42:25.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.380+0000 7fa78fee1640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa7880cd6d0 0x7fa788161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.380+0000 7fa78fee1640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7880b4880 0x7fa7880b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.380+0000 7fa78fee1640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7880cde60 con 0x7fa788153e60 2023-11-04T01:42:25.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.380+0000 7fa78fee1640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa788160f90 con 0x7fa7880cd6d0 2023-11-04T01:42:25.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.380+0000 7fa78fee1640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa788161960 con 0x7fa7880b4880 2023-11-04T01:42:25.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.381+0000 7fa78d47c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa7880cd6d0 0x7fa788161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.381+0000 7fa78d47c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa7880cd6d0 0x7fa788161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58364/0 (socket says 172.21.15.77:58364) 2023-11-04T01:42:25.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.381+0000 7fa78d47c640 1 -- 172.21.15.77:0/1728360639 learned_addr learned my addr 172.21.15.77:0/1728360639 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:25.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.381+0000 7fa78d47c640 1 -- 172.21.15.77:0/1728360639 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7880b4880 msgr2=0x7fa7880b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:25.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.381+0000 7fa78d47c640 1 --2- 172.21.15.77:0/1728360639 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7880b4880 0x7fa7880b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.381+0000 7fa78d47c640 1 -- 172.21.15.77:0/1728360639 >> v1:172.21.15.122:6789/0 conn(0x7fa788153e60 legacy=0x7fa78815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:25.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.381+0000 7fa78d47c640 1 -- 172.21.15.77:0/1728360639 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7880b5220 con 0x7fa7880cd6d0 2023-11-04T01:42:25.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.381+0000 7fa78d47c640 1 --2- 172.21.15.77:0/1728360639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7880cd6d0 0x7fa788161420 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fa778009870 tx=0x7fa77802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd08809dbe497ae3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:25.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.382+0000 7fa78cc7b640 1 -- 172.21.15.77:0/1728360639 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa778031640 con 0x7fa7880cd6d0 2023-11-04T01:42:25.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.382+0000 7fa78cc7b640 1 -- 172.21.15.77:0/1728360639 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7780317a0 con 0x7fa7880cd6d0 2023-11-04T01:42:25.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.382+0000 7fa78cc7b640 1 -- 172.21.15.77:0/1728360639 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa778031b30 con 0x7fa7880cd6d0 2023-11-04T01:42:25.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.382+0000 7fa78fee1640 1 -- 172.21.15.77:0/1728360639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7880cd6d0 msgr2=0x7fa788161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.382+0000 7fa78fee1640 1 --2- 172.21.15.77:0/1728360639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7880cd6d0 0x7fa788161420 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fa778009870 tx=0x7fa77802b8f0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.382+0000 7fa78fee1640 1 -- 172.21.15.77:0/1728360639 shutdown_connections 2023-11-04T01:42:25.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.382+0000 7fa78fee1640 1 --2- 172.21.15.77:0/1728360639 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7880b4880 0x7fa7880b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.382+0000 7fa78fee1640 1 --2- 172.21.15.77:0/1728360639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7880cd6d0 0x7fa788161420 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.382+0000 7fa78fee1640 1 -- 172.21.15.77:0/1728360639 >> 172.21.15.77:0/1728360639 conn(0x7fa7880cf880 msgr2=0x7fa7880cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:25.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.382+0000 7fa78fee1640 1 -- 172.21.15.77:0/1728360639 shutdown_connections 2023-11-04T01:42:25.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.382+0000 7fa78fee1640 1 -- 172.21.15.77:0/1728360639 wait complete. 2023-11-04T01:42:25.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.383+0000 7fa78fee1640 1 Processor -- start 2023-11-04T01:42:25.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.383+0000 7fa78fee1640 1 -- start start 2023-11-04T01:42:25.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.384+0000 7fa78fee1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7880b4880 0x7fa78815a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.384+0000 7fa78fee1640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7880cd6d0 0x7fa7881e8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.384+0000 7fa78fee1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa788153e60 0x7fa78813fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.384+0000 7fa78fee1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7881e79f0 con 0x7fa7880b4880 2023-11-04T01:42:25.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.384+0000 7fa78fee1640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7881e7cd0 con 0x7fa788153e60 2023-11-04T01:42:25.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.384+0000 7fa78fee1640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7881e7fb0 con 0x7fa7880cd6d0 2023-11-04T01:42:25.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.384+0000 7fa78dc7d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7880b4880 0x7fa78815a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.384+0000 7fa78dc7d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7880b4880 0x7fa78815a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58380/0 (socket says 172.21.15.77:58380) 2023-11-04T01:42:25.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.384+0000 7fa78dc7d640 1 -- 172.21.15.77:0/2125145251 learned_addr learned my addr 172.21.15.77:0/2125145251 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:25.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.384+0000 7fa78d47c640 1 --2- 172.21.15.77:0/2125145251 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7880cd6d0 0x7fa7881e8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.384+0000 7fa78e47e640 1 --2- 172.21.15.77:0/2125145251 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa788153e60 0x7fa78813fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.384+0000 7fa78dc7d640 1 -- 172.21.15.77:0/2125145251 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7880cd6d0 msgr2=0x7fa7881e8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.384+0000 7fa78dc7d640 1 --2- 172.21.15.77:0/2125145251 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7880cd6d0 0x7fa7881e8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.385+0000 7fa78dc7d640 1 -- 172.21.15.77:0/2125145251 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa788153e60 msgr2=0x7fa78813fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.385+0000 7fa78dc7d640 1 --2- 172.21.15.77:0/2125145251 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa788153e60 0x7fa78813fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.385+0000 7fa78dc7d640 1 -- 172.21.15.77:0/2125145251 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7780094d0 con 0x7fa7880b4880 2023-11-04T01:42:25.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.385+0000 7fa78e47e640 1 --2- 172.21.15.77:0/2125145251 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa788153e60 0x7fa78813fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:25.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.385+0000 7fa78dc7d640 1 --2- 172.21.15.77:0/2125145251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7880b4880 0x7fa78815a660 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fa78400ba50 tx=0x7fa78400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:25.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.385+0000 7fa77e7fc640 1 -- 172.21.15.77:0/2125145251 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78400cc10 con 0x7fa7880b4880 2023-11-04T01:42:25.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.385+0000 7fa77e7fc640 1 -- 172.21.15.77:0/2125145251 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78400cd70 con 0x7fa7880b4880 2023-11-04T01:42:25.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.385+0000 7fa78fee1640 1 -- 172.21.15.77:0/2125145251 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7881e8290 con 0x7fa7880b4880 2023-11-04T01:42:25.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.385+0000 7fa77e7fc640 1 -- 172.21.15.77:0/2125145251 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa784014680 con 0x7fa7880b4880 2023-11-04T01:42:25.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.385+0000 7fa78fee1640 1 -- 172.21.15.77:0/2125145251 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7881e8fd0 con 0x7fa7880b4880 2023-11-04T01:42:25.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.386+0000 7fa78fee1640 1 -- 172.21.15.77:0/2125145251 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa788074290 con 0x7fa7880b4880 2023-11-04T01:42:25.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.386+0000 7fa77e7fc640 1 -- 172.21.15.77:0/2125145251 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa78401d3b0 con 0x7fa7880b4880 2023-11-04T01:42:25.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.387+0000 7fa77e7fc640 1 --2- 172.21.15.77:0/2125145251 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa76c06ae70 0x7fa76c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.387+0000 7fa77e7fc640 1 -- 172.21.15.77:0/2125145251 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa7840897b0 con 0x7fa7880b4880 2023-11-04T01:42:25.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.387+0000 7fa78d47c640 1 --2- 172.21.15.77:0/2125145251 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa76c06ae70 0x7fa76c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.387+0000 7fa78d47c640 1 --2- 172.21.15.77:0/2125145251 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa76c06ae70 0x7fa76c06d330 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa778036000 tx=0x7fa77803c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:25.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.391+0000 7fa77e7fc640 1 -- 172.21.15.77:0/2125145251 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa784054700 con 0x7fa7880b4880 2023-11-04T01:42:25.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:25.594+0000 7fa78fee1640 1 -- 172.21.15.77:0/2125145251 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa788160bf0 con 0x7fa7880b4880 2023-11-04T01:42:26.393 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-11-04T01:42:26.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.574+0000 7fa77e7fc640 1 -- 172.21.15.77:0/2125145251 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v28) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa784087e60 con 0x7fa7880b4880 2023-11-04T01:42:26.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.577+0000 7fa78fee1640 1 -- 172.21.15.77:0/2125145251 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa76c06ae70 msgr2=0x7fa76c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:26.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.577+0000 7fa78fee1640 1 --2- 172.21.15.77:0/2125145251 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa76c06ae70 0x7fa76c06d330 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa778036000 tx=0x7fa77803c040 comp rx=0 tx=0).stop 2023-11-04T01:42:26.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.577+0000 7fa78fee1640 1 -- 172.21.15.77:0/2125145251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7880b4880 msgr2=0x7fa78815a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:26.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.577+0000 7fa78fee1640 1 --2- 172.21.15.77:0/2125145251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7880b4880 0x7fa78815a660 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fa78400ba50 tx=0x7fa78400bf10 comp rx=0 tx=0).stop 2023-11-04T01:42:26.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.577+0000 7fa78fee1640 1 -- 172.21.15.77:0/2125145251 shutdown_connections 2023-11-04T01:42:26.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.577+0000 7fa78fee1640 1 --2- 172.21.15.77:0/2125145251 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa76c06ae70 0x7fa76c06d330 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.577+0000 7fa78fee1640 1 --2- 172.21.15.77:0/2125145251 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa788153e60 0x7fa78813fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.577+0000 7fa78fee1640 1 --2- 172.21.15.77:0/2125145251 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7880cd6d0 0x7fa7881e8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.577+0000 7fa78fee1640 1 --2- 172.21.15.77:0/2125145251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7880b4880 0x7fa78815a660 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.577+0000 7fa78fee1640 1 -- 172.21.15.77:0/2125145251 >> 172.21.15.77:0/2125145251 conn(0x7fa7880cf880 msgr2=0x7fa7880d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:26.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.578+0000 7fa78fee1640 1 -- 172.21.15.77:0/2125145251 shutdown_connections 2023-11-04T01:42:26.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.578+0000 7fa78fee1640 1 -- 172.21.15.77:0/2125145251 wait complete. 2023-11-04T01:42:26.593 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-04T01:42:26.594 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T01:42:26.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.700+0000 7f351c4c9640 1 Processor -- start 2023-11-04T01:42:26.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.700+0000 7f351c4c9640 1 -- start start 2023-11-04T01:42:26.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.701+0000 7f351c4c9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f35140b2d30 0x7f351406bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:26.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.701+0000 7f351c4c9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f351406c1d0 0x7f35140cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:26.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.701+0000 7f351c4c9640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f351406ca40 con 0x7f3514160430 2023-11-04T01:42:26.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.701+0000 7f351c4c9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35140cb580 con 0x7f35140b2d30 2023-11-04T01:42:26.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.701+0000 7f351c4c9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351406cd20 con 0x7f351406c1d0 2023-11-04T01:42:26.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.701+0000 7f3519a64640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f35140b2d30 0x7f351406bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:26.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.701+0000 7f3519a64640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f35140b2d30 0x7f351406bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58384/0 (socket says 172.21.15.77:58384) 2023-11-04T01:42:26.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.701+0000 7f3519a64640 1 -- 172.21.15.77:0/299846943 learned_addr learned my addr 172.21.15.77:0/299846943 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:26.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.701+0000 7f351aa66640 1 --2- 172.21.15.77:0/299846943 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f351406c1d0 0x7f35140cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:26.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.701+0000 7f3519a64640 1 -- 172.21.15.77:0/299846943 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f351406c1d0 msgr2=0x7f35140cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:26.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.701+0000 7f3519a64640 1 --2- 172.21.15.77:0/299846943 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f351406c1d0 0x7f35140cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.701+0000 7f3519a64640 1 -- 172.21.15.77:0/299846943 >> v1:172.21.15.122:6789/0 conn(0x7f3514160430 legacy=0x7f35140b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:26.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.701+0000 7f3519a64640 1 -- 172.21.15.77:0/299846943 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f351406d000 con 0x7f35140b2d30 2023-11-04T01:42:26.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.701+0000 7f351aa66640 1 --2- 172.21.15.77:0/299846943 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f351406c1d0 0x7f35140cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:26.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.702+0000 7f3519a64640 1 --2- 172.21.15.77:0/299846943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35140b2d30 0x7f351406bc90 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f3508009870 tx=0x7f350802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3632d6eeaeaf28fb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:26.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.702+0000 7f3519263640 1 -- 172.21.15.77:0/299846943 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3508030840 con 0x7f35140b2d30 2023-11-04T01:42:26.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.702+0000 7f3519263640 1 -- 172.21.15.77:0/299846943 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35080309a0 con 0x7f35140b2d30 2023-11-04T01:42:26.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.702+0000 7f3519263640 1 -- 172.21.15.77:0/299846943 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3508030d30 con 0x7f35140b2d30 2023-11-04T01:42:26.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.702+0000 7f351c4c9640 1 -- 172.21.15.77:0/299846943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35140b2d30 msgr2=0x7f351406bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:26.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.702+0000 7f351c4c9640 1 --2- 172.21.15.77:0/299846943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35140b2d30 0x7f351406bc90 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f3508009870 tx=0x7f350802b980 comp rx=0 tx=0).stop 2023-11-04T01:42:26.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.703+0000 7f351c4c9640 1 -- 172.21.15.77:0/299846943 shutdown_connections 2023-11-04T01:42:26.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.703+0000 7f351c4c9640 1 --2- 172.21.15.77:0/299846943 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f351406c1d0 0x7f35140cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.703+0000 7f351c4c9640 1 --2- 172.21.15.77:0/299846943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35140b2d30 0x7f351406bc90 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.703+0000 7f351c4c9640 1 -- 172.21.15.77:0/299846943 >> 172.21.15.77:0/299846943 conn(0x7f351406ea20 msgr2=0x7f351406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:26.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.703+0000 7f351c4c9640 1 -- 172.21.15.77:0/299846943 shutdown_connections 2023-11-04T01:42:26.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.703+0000 7f351c4c9640 1 -- 172.21.15.77:0/299846943 wait complete. 2023-11-04T01:42:26.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.704+0000 7f351c4c9640 1 Processor -- start 2023-11-04T01:42:26.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.704+0000 7f351c4c9640 1 -- start start 2023-11-04T01:42:26.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.704+0000 7f351c4c9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f351406c1d0 0x7f35141f6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:26.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.704+0000 7f351c4c9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35140b2d30 0x7f35140c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:26.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.704+0000 7f351c4c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3514160430 0x7f35140ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:26.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.704+0000 7f351c4c9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35141f6e90 con 0x7f3514160430 2023-11-04T01:42:26.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.704+0000 7f351c4c9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35141f64c0 con 0x7f35140b2d30 2023-11-04T01:42:26.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.704+0000 7f351c4c9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35140c7210 con 0x7f351406c1d0 2023-11-04T01:42:26.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.705+0000 7f351aa66640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3514160430 0x7f35140ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:26.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.705+0000 7f351aa66640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3514160430 0x7f35140ca0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58390/0 (socket says 172.21.15.77:58390) 2023-11-04T01:42:26.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.705+0000 7f351aa66640 1 -- 172.21.15.77:0/899060230 learned_addr learned my addr 172.21.15.77:0/899060230 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:26.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.705+0000 7f351aa66640 1 -- 172.21.15.77:0/899060230 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f351406c1d0 msgr2=0x7f35141f6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:26.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.705+0000 7f3519a64640 1 --2- 172.21.15.77:0/899060230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35140b2d30 0x7f35140c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:26.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.705+0000 7f351a265640 1 --2- 172.21.15.77:0/899060230 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f351406c1d0 0x7f35141f6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:26.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.705+0000 7f351aa66640 1 --2- 172.21.15.77:0/899060230 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f351406c1d0 0x7f35141f6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.705+0000 7f351aa66640 1 -- 172.21.15.77:0/899060230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35140b2d30 msgr2=0x7f35140c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:26.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.705+0000 7f351aa66640 1 --2- 172.21.15.77:0/899060230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35140b2d30 0x7f35140c6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.705+0000 7f351aa66640 1 -- 172.21.15.77:0/899060230 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35080094d0 con 0x7f3514160430 2023-11-04T01:42:26.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.705+0000 7f351aa66640 1 --2- 172.21.15.77:0/899060230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3514160430 0x7f35140ca0b0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f350c007f20 tx=0x7f350c00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:26.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.705+0000 7f3506ffd640 1 -- 172.21.15.77:0/899060230 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c00dee0 con 0x7f3514160430 2023-11-04T01:42:26.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.705+0000 7f3506ffd640 1 -- 172.21.15.77:0/899060230 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350c00f040 con 0x7f3514160430 2023-11-04T01:42:26.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.705+0000 7f351c4c9640 1 -- 172.21.15.77:0/899060230 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35140c74f0 con 0x7f3514160430 2023-11-04T01:42:26.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.705+0000 7f3506ffd640 1 -- 172.21.15.77:0/899060230 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c003dd0 con 0x7f3514160430 2023-11-04T01:42:26.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.705+0000 7f351c4c9640 1 -- 172.21.15.77:0/899060230 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35140c6e50 con 0x7f3514160430 2023-11-04T01:42:26.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.706+0000 7f351c4c9640 1 -- 172.21.15.77:0/899060230 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35140c7730 con 0x7f3514160430 2023-11-04T01:42:26.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.707+0000 7f3506ffd640 1 -- 172.21.15.77:0/899060230 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f350c004030 con 0x7f3514160430 2023-11-04T01:42:26.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.707+0000 7f3506ffd640 1 --2- 172.21.15.77:0/899060230 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f34f806ae70 0x7f34f806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:26.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.707+0000 7f3506ffd640 1 -- 172.21.15.77:0/899060230 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f350c089c10 con 0x7f3514160430 2023-11-04T01:42:26.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.707+0000 7f351a265640 1 --2- 172.21.15.77:0/899060230 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f34f806ae70 0x7f34f806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:26.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.708+0000 7f351a265640 1 --2- 172.21.15.77:0/899060230 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f34f806ae70 0x7f34f806d330 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3510000f60 tx=0x7f3510009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:26.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.711+0000 7f3506ffd640 1 -- 172.21.15.77:0/899060230 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f35140c7730 con 0x7f3514160430 2023-11-04T01:42:26.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:26.914+0000 7f351c4c9640 1 -- 172.21.15.77:0/899060230 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f35140c7730 con 0x7f3514160430 2023-11-04T01:42:27.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.659+0000 7f3506ffd640 1 -- 172.21.15.77:0/899060230 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v29) v1 ==== 122+0+0 (secure 0 0 0) 0x7f35140c7730 con 0x7f3514160430 2023-11-04T01:42:27.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.661+0000 7f351c4c9640 1 -- 172.21.15.77:0/899060230 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f34f806ae70 msgr2=0x7f34f806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.661+0000 7f351c4c9640 1 --2- 172.21.15.77:0/899060230 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f34f806ae70 0x7f34f806d330 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3510000f60 tx=0x7f3510009040 comp rx=0 tx=0).stop 2023-11-04T01:42:27.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.661+0000 7f351c4c9640 1 -- 172.21.15.77:0/899060230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3514160430 msgr2=0x7f35140ca0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.661+0000 7f351c4c9640 1 --2- 172.21.15.77:0/899060230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3514160430 0x7f35140ca0b0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f350c007f20 tx=0x7f350c00d560 comp rx=0 tx=0).stop 2023-11-04T01:42:27.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.661+0000 7f351c4c9640 1 -- 172.21.15.77:0/899060230 shutdown_connections 2023-11-04T01:42:27.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.661+0000 7f351c4c9640 1 --2- 172.21.15.77:0/899060230 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f34f806ae70 0x7f34f806d330 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.661+0000 7f351c4c9640 1 --2- 172.21.15.77:0/899060230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3514160430 0x7f35140ca0b0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.661+0000 7f351c4c9640 1 --2- 172.21.15.77:0/899060230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35140b2d30 0x7f35140c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.661+0000 7f351c4c9640 1 --2- 172.21.15.77:0/899060230 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f351406c1d0 0x7f35141f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.661+0000 7f351c4c9640 1 -- 172.21.15.77:0/899060230 >> 172.21.15.77:0/899060230 conn(0x7f351406ea20 msgr2=0x7f35140d0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:27.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.661+0000 7f351c4c9640 1 -- 172.21.15.77:0/899060230 shutdown_connections 2023-11-04T01:42:27.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.661+0000 7f351c4c9640 1 -- 172.21.15.77:0/899060230 wait complete. 2023-11-04T01:42:27.676 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T01:42:27.676 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:27.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.775+0000 7f22c07fb640 1 Processor -- start 2023-11-04T01:42:27.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.775+0000 7f22c07fb640 1 -- start start 2023-11-04T01:42:27.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.776+0000 7f22c07fb640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f22b80cde60 0x7f22b815d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.776+0000 7f22c07fb640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f22b80ce240 0x7f22b80d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.776+0000 7f22c07fb640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b815e000 con 0x7f22b815daa0 2023-11-04T01:42:27.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.776+0000 7f22c07fb640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b815e5c0 con 0x7f22b80cde60 2023-11-04T01:42:27.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.776+0000 7f22c07fb640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b815e2e0 con 0x7f22b80ce240 2023-11-04T01:42:27.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.776+0000 7f22be597640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f22b80cde60 0x7f22b815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.776+0000 7f22bdd96640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f22b815daa0 0x7f22b8157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:60752/0 (socket says 172.21.15.77:60752) 2023-11-04T01:42:27.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.776+0000 7f22bdd96640 1 -- 172.21.15.77:0/1882376805 learned_addr learned my addr 172.21.15.77:0/1882376805 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:27.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.776+0000 7f22bed98640 1 --2- 172.21.15.77:0/1882376805 >> v2:172.21.15.122:3300/0 conn(0x7f22b80ce240 0x7f22b80d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.777+0000 7f22be597640 1 -- 172.21.15.77:0/1882376805 >> v2:172.21.15.122:3300/0 conn(0x7f22b80ce240 msgr2=0x7f22b80d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:27.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.777+0000 7f22be597640 1 --2- 172.21.15.77:0/1882376805 >> v2:172.21.15.122:3300/0 conn(0x7f22b80ce240 0x7f22b80d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.777+0000 7f22be597640 1 -- 172.21.15.77:0/1882376805 >> v1:172.21.15.77:6789/0 conn(0x7f22b815daa0 legacy=0x7f22b8157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.777+0000 7f22be597640 1 -- 172.21.15.77:0/1882376805 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b80d1120 con 0x7f22b80cde60 2023-11-04T01:42:27.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.777+0000 7f22bd595640 1 -- 172.21.15.77:0/1882376805 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 836512809 0 0) 0x7f22b815e000 con 0x7f22b815daa0 2023-11-04T01:42:27.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.777+0000 7f22be597640 1 --2- 172.21.15.77:0/1882376805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22b80cde60 0x7f22b815d560 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f22b80cf2e0 tx=0x7f22b402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cecd0beab461d5e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.777+0000 7f22bd595640 1 -- 172.21.15.77:0/1882376805 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b4031830 con 0x7f22b80cde60 2023-11-04T01:42:27.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.777+0000 7f22bd595640 1 -- 172.21.15.77:0/1882376805 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b4031990 con 0x7f22b80cde60 2023-11-04T01:42:27.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.777+0000 7f22bd595640 1 -- 172.21.15.77:0/1882376805 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b4031d20 con 0x7f22b80cde60 2023-11-04T01:42:27.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.778+0000 7f22c07fb640 1 -- 172.21.15.77:0/1882376805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22b80cde60 msgr2=0x7f22b815d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.778+0000 7f22c07fb640 1 --2- 172.21.15.77:0/1882376805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22b80cde60 0x7f22b815d560 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f22b80cf2e0 tx=0x7f22b402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.778+0000 7f22c07fb640 1 -- 172.21.15.77:0/1882376805 shutdown_connections 2023-11-04T01:42:27.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.778+0000 7f22c07fb640 1 --2- 172.21.15.77:0/1882376805 >> v2:172.21.15.122:3300/0 conn(0x7f22b80ce240 0x7f22b80d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.778+0000 7f22c07fb640 1 --2- 172.21.15.77:0/1882376805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22b80cde60 0x7f22b815d560 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.778+0000 7f22c07fb640 1 -- 172.21.15.77:0/1882376805 >> 172.21.15.77:0/1882376805 conn(0x7f22b8071f30 msgr2=0x7f22b80cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:27.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.778+0000 7f22c07fb640 1 -- 172.21.15.77:0/1882376805 shutdown_connections 2023-11-04T01:42:27.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.778+0000 7f22c07fb640 1 -- 172.21.15.77:0/1882376805 wait complete. 2023-11-04T01:42:27.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.779+0000 7f22c07fb640 1 Processor -- start 2023-11-04T01:42:27.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.779+0000 7f22c07fb640 1 -- start start 2023-11-04T01:42:27.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.780+0000 7f22c07fb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22b80cde60 0x7f22b8156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.780+0000 7f22c07fb640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f22b80ce240 0x7f22b815c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.780+0000 7f22c07fb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22b815daa0 0x7f22b81f04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.780+0000 7f22c07fb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b815cbd0 con 0x7f22b80cde60 2023-11-04T01:42:27.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.780+0000 7f22c07fb640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b81f44d0 con 0x7f22b815daa0 2023-11-04T01:42:27.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.780+0000 7f22c07fb640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b81f47b0 con 0x7f22b80ce240 2023-11-04T01:42:27.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.780+0000 7f22be597640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22b80cde60 0x7f22b8156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.780+0000 7f22be597640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22b80cde60 0x7f22b8156720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:32862/0 (socket says 172.21.15.77:32862) 2023-11-04T01:42:27.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.780+0000 7f22be597640 1 -- 172.21.15.77:0/1456915221 learned_addr learned my addr 172.21.15.77:0/1456915221 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:27.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.780+0000 7f22bdd96640 1 --2- 172.21.15.77:0/1456915221 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f22b80ce240 0x7f22b815c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.780+0000 7f22bed98640 1 --2- 172.21.15.77:0/1456915221 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22b815daa0 0x7f22b81f04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.780+0000 7f22be597640 1 -- 172.21.15.77:0/1456915221 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f22b80ce240 msgr2=0x7f22b815c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.780+0000 7f22be597640 1 --2- 172.21.15.77:0/1456915221 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f22b80ce240 0x7f22b815c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.780+0000 7f22be597640 1 -- 172.21.15.77:0/1456915221 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22b815daa0 msgr2=0x7f22b81f04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.780+0000 7f22be597640 1 --2- 172.21.15.77:0/1456915221 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22b815daa0 0x7f22b81f04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.780+0000 7f22be597640 1 -- 172.21.15.77:0/1456915221 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b4009400 con 0x7f22b80cde60 2023-11-04T01:42:27.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.780+0000 7f22bdd96640 1 --2- 172.21.15.77:0/1456915221 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f22b80ce240 0x7f22b815c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:27.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.780+0000 7f22bed98640 1 --2- 172.21.15.77:0/1456915221 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22b815daa0 0x7f22b81f04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:27.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.781+0000 7f22be597640 1 --2- 172.21.15.77:0/1456915221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22b80cde60 0x7f22b8156720 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f22b4009890 tx=0x7f22b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.781+0000 7f22aeffd640 1 -- 172.21.15.77:0/1456915221 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b40317d0 con 0x7f22b80cde60 2023-11-04T01:42:27.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.781+0000 7f22aeffd640 1 -- 172.21.15.77:0/1456915221 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b403ba70 con 0x7f22b80cde60 2023-11-04T01:42:27.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.781+0000 7f22c07fb640 1 -- 172.21.15.77:0/1456915221 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b81f4a90 con 0x7f22b80cde60 2023-11-04T01:42:27.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.781+0000 7f22aeffd640 1 -- 172.21.15.77:0/1456915221 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b403be20 con 0x7f22b80cde60 2023-11-04T01:42:27.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.781+0000 7f22c07fb640 1 -- 172.21.15.77:0/1456915221 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b81f0200 con 0x7f22b80cde60 2023-11-04T01:42:27.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.782+0000 7f22c07fb640 1 -- 172.21.15.77:0/1456915221 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b8074290 con 0x7f22b80cde60 2023-11-04T01:42:27.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.782+0000 7f22aeffd640 1 -- 172.21.15.77:0/1456915221 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f22b40453f0 con 0x7f22b80cde60 2023-11-04T01:42:27.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.783+0000 7f22aeffd640 1 --2- 172.21.15.77:0/1456915221 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f229c06aea0 0x7f229c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.783+0000 7f22aeffd640 1 -- 172.21.15.77:0/1456915221 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f22b40abbb0 con 0x7f22b80cde60 2023-11-04T01:42:27.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.783+0000 7f22bdd96640 1 --2- 172.21.15.77:0/1456915221 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f229c06aea0 0x7f229c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.783+0000 7f22bdd96640 1 --2- 172.21.15.77:0/1456915221 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f229c06aea0 0x7f229c06d360 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f22b80c6ab0 tx=0x7f22a8009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.787+0000 7f22aeffd640 1 -- 172.21.15.77:0/1456915221 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f22b4076ae0 con 0x7f22b80cde60 2023-11-04T01:42:27.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.987+0000 7f22c07fb640 1 -- 172.21.15.77:0/1456915221 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22b815cfa0 con 0x7f22b80cde60 2023-11-04T01:42:27.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.988+0000 7f22aeffd640 1 -- 172.21.15.77:0/1456915221 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f22b4035090 con 0x7f22b80cde60 2023-11-04T01:42:27.991 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:27.991 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6396,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/20625239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":20625239},{"type":"v1","addr":"172.21.15.77:6834","nonce":20625239}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6399,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3909793035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3909793035},{"type":"v1","addr":"172.21.15.77:6835","nonce":3909793035}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":35252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/1714919040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1714919040},{"type":"v1","addr":"172.21.15.122:6836","nonce":1714919040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:42:23.999994+0000","modified":"2023-11-04T01:42:26.916361+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":35255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35255":{"gid":35255,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/1606545578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1606545578},{"type":"v1","addr":"172.21.15.122:6837","nonce":1606545578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-04T01:42:27.992 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 29 2023-11-04T01:42:27.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.990+0000 7f22c07fb640 1 -- 172.21.15.77:0/1456915221 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f229c06aea0 msgr2=0x7f229c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.990+0000 7f22c07fb640 1 --2- 172.21.15.77:0/1456915221 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f229c06aea0 0x7f229c06d360 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f22b80c6ab0 tx=0x7f22a8009040 comp rx=0 tx=0).stop 2023-11-04T01:42:27.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.990+0000 7f22c07fb640 1 -- 172.21.15.77:0/1456915221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22b80cde60 msgr2=0x7f22b8156720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.990+0000 7f22c07fb640 1 --2- 172.21.15.77:0/1456915221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22b80cde60 0x7f22b8156720 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f22b4009890 tx=0x7f22b40046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.990+0000 7f22c07fb640 1 -- 172.21.15.77:0/1456915221 shutdown_connections 2023-11-04T01:42:27.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.990+0000 7f22c07fb640 1 --2- 172.21.15.77:0/1456915221 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f229c06aea0 0x7f229c06d360 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.990+0000 7f22c07fb640 1 --2- 172.21.15.77:0/1456915221 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22b815daa0 0x7f22b81f04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.990+0000 7f22c07fb640 1 --2- 172.21.15.77:0/1456915221 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f22b80ce240 0x7f22b815c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.990+0000 7f22c07fb640 1 --2- 172.21.15.77:0/1456915221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22b80cde60 0x7f22b8156720 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.990+0000 7f22c07fb640 1 -- 172.21.15.77:0/1456915221 >> 172.21.15.77:0/1456915221 conn(0x7f22b8071f30 msgr2=0x7f22b80d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:27.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.990+0000 7f22c07fb640 1 -- 172.21.15.77:0/1456915221 shutdown_connections 2023-11-04T01:42:27.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:27.990+0000 7f22c07fb640 1 -- 172.21.15.77:0/1456915221 wait complete. 2023-11-04T01:42:28.004 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:28.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.101+0000 7fb547f33640 1 Processor -- start 2023-11-04T01:42:28.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.102+0000 7fb547f33640 1 -- start start 2023-11-04T01:42:28.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.102+0000 7fb547f33640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb5400ce240 0x7fb540157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.102+0000 7fb547f33640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb54015e000 con 0x7fb540157540 2023-11-04T01:42:28.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.102+0000 7fb547f33640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb54015e2e0 con 0x7fb5400cde60 2023-11-04T01:42:28.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.102+0000 7fb547f33640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb54015e5c0 con 0x7fb5400ce240 2023-11-04T01:42:28.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.102+0000 7fb5464d0640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb540157540 0x7fb5400d1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:60766/0 (socket says 172.21.15.77:60766) 2023-11-04T01:42:28.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.102+0000 7fb5464d0640 1 -- 172.21.15.77:0/2525162025 learned_addr learned my addr 172.21.15.77:0/2525162025 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:28.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.103+0000 7fb5454ce640 1 --2- 172.21.15.77:0/2525162025 >> v2:172.21.15.122:3300/0 conn(0x7fb5400ce240 0x7fb540157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.103+0000 7fb544ccd640 1 -- 172.21.15.77:0/2525162025 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1687222087 0 0) 0x7fb54015e000 con 0x7fb540157540 2023-11-04T01:42:28.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.103+0000 7fb544ccd640 1 -- 172.21.15.77:0/2525162025 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb52c003520 con 0x7fb540157540 2023-11-04T01:42:28.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.103+0000 7fb544ccd640 1 -- 172.21.15.77:0/2525162025 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 26660562 0 0) 0x7fb52c003520 con 0x7fb540157540 2023-11-04T01:42:28.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.103+0000 7fb544ccd640 1 -- 172.21.15.77:0/2525162025 >> v2:172.21.15.122:3300/0 conn(0x7fb5400ce240 msgr2=0x7fb540157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:28.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.103+0000 7fb544ccd640 1 --2- 172.21.15.77:0/2525162025 >> v2:172.21.15.122:3300/0 conn(0x7fb5400ce240 0x7fb540157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.103+0000 7fb544ccd640 1 -- 172.21.15.77:0/2525162025 >> v1:172.21.15.122:6789/0 conn(0x7fb5400cde60 legacy=0x7fb54015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.103+0000 7fb544ccd640 1 -- 172.21.15.77:0/2525162025 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5400d1120 con 0x7fb540157540 2023-11-04T01:42:28.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.103+0000 7fb544ccd640 1 -- 172.21.15.77:0/2525162025 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7fb538001670 con 0x7fb540157540 2023-11-04T01:42:28.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.103+0000 7fb544ccd640 1 -- 172.21.15.77:0/2525162025 >> v1:172.21.15.77:6789/0 conn(0x7fb540157540 legacy=0x7fb5400d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.103+0000 7fb544ccd640 1 --2- 172.21.15.77:0/2525162025 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb52c003970 0x7fb52c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.103+0000 7fb544ccd640 1 --2- 172.21.15.77:0/2525162025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb52c0047c0 0x7fb52c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.103+0000 7fb544ccd640 1 --2- 172.21.15.77:0/2525162025 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb52c005180 0x7fb52c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.103+0000 7fb544ccd640 1 -- 172.21.15.77:0/2525162025 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54015e5c0 con 0x7fb52c0047c0 2023-11-04T01:42:28.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.103+0000 7fb544ccd640 1 -- 172.21.15.77:0/2525162025 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb52c00c020 con 0x7fb52c005180 2023-11-04T01:42:28.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.103+0000 7fb544ccd640 1 -- 172.21.15.77:0/2525162025 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb52c00c1e0 con 0x7fb52c003970 2023-11-04T01:42:28.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.103+0000 7fb5454ce640 1 --2- 172.21.15.77:0/2525162025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb52c0047c0 0x7fb52c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.103+0000 7fb545ccf640 1 --2- 172.21.15.77:0/2525162025 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb52c003970 0x7fb52c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.103+0000 7fb5464d0640 1 --2- 172.21.15.77:0/2525162025 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb52c005180 0x7fb52c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.103+0000 7fb5454ce640 1 -- 172.21.15.77:0/2525162025 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb52c003970 msgr2=0x7fb52c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:28.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.103+0000 7fb5454ce640 1 --2- 172.21.15.77:0/2525162025 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb52c003970 0x7fb52c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.103+0000 7fb5454ce640 1 -- 172.21.15.77:0/2525162025 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb52c005180 msgr2=0x7fb52c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:28.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.103+0000 7fb5454ce640 1 --2- 172.21.15.77:0/2525162025 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb52c005180 0x7fb52c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.103+0000 7fb5454ce640 1 -- 172.21.15.77:0/2525162025 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb52c003520 con 0x7fb52c0047c0 2023-11-04T01:42:28.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.103+0000 7fb5464d0640 1 --2- 172.21.15.77:0/2525162025 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb52c005180 0x7fb52c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:28.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.104+0000 7fb5464d0640 1 -- 172.21.15.77:0/2525162025 reap_dead start 2023-11-04T01:42:28.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.104+0000 7fb5454ce640 1 --2- 172.21.15.77:0/2525162025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb52c0047c0 0x7fb52c004c40 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fb530009ac0 tx=0x7fb52c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac783a3160a7df3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.104+0000 7fb544ccd640 1 -- 172.21.15.77:0/2525162025 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53002c6b0 con 0x7fb52c0047c0 2023-11-04T01:42:28.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.104+0000 7fb544ccd640 1 -- 172.21.15.77:0/2525162025 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb53002c810 con 0x7fb52c0047c0 2023-11-04T01:42:28.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.104+0000 7fb544ccd640 1 -- 172.21.15.77:0/2525162025 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53002cba0 con 0x7fb52c0047c0 2023-11-04T01:42:28.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.105+0000 7fb547f33640 1 -- 172.21.15.77:0/2525162025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb52c0047c0 msgr2=0x7fb52c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.105+0000 7fb547f33640 1 --2- 172.21.15.77:0/2525162025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb52c0047c0 0x7fb52c004c40 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fb530009ac0 tx=0x7fb52c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.105+0000 7fb547f33640 1 -- 172.21.15.77:0/2525162025 shutdown_connections 2023-11-04T01:42:28.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.105+0000 7fb547f33640 1 --2- 172.21.15.77:0/2525162025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb52c0047c0 0x7fb52c004c40 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.105+0000 7fb547f33640 1 -- 172.21.15.77:0/2525162025 >> 172.21.15.77:0/2525162025 conn(0x7fb540071f30 msgr2=0x7fb5400cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:28.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.105+0000 7fb547f33640 1 -- 172.21.15.77:0/2525162025 shutdown_connections 2023-11-04T01:42:28.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.105+0000 7fb547f33640 1 -- 172.21.15.77:0/2525162025 wait complete. 2023-11-04T01:42:28.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.106+0000 7fb547f33640 1 Processor -- start 2023-11-04T01:42:28.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.106+0000 7fb547f33640 1 -- start start 2023-11-04T01:42:28.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.107+0000 7fb547f33640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb52c0047c0 0x7fb5400c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.107+0000 7fb547f33640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb5401f2e70 0x7fb5400c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.107+0000 7fb547f33640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb540153150 0x7fb5401535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.107+0000 7fb547f33640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb540153b20 con 0x7fb540153150 2023-11-04T01:42:28.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.107+0000 7fb547f33640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54015b190 con 0x7fb52c0047c0 2023-11-04T01:42:28.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.107+0000 7fb547f33640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5401f32f0 con 0x7fb5401f2e70 2023-11-04T01:42:28.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.107+0000 7fb5464d0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb540153150 0x7fb5401535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.107+0000 7fb5464d0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb540153150 0x7fb5401535e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:32890/0 (socket says 172.21.15.77:32890) 2023-11-04T01:42:28.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.107+0000 7fb5464d0640 1 -- 172.21.15.77:0/4259698976 learned_addr learned my addr 172.21.15.77:0/4259698976 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:28.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.107+0000 7fb545ccf640 1 --2- 172.21.15.77:0/4259698976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb52c0047c0 0x7fb5400c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.107+0000 7fb5454ce640 1 --2- 172.21.15.77:0/4259698976 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb5401f2e70 0x7fb5400c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.107+0000 7fb5464d0640 1 -- 172.21.15.77:0/4259698976 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb5401f2e70 msgr2=0x7fb5400c8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.107+0000 7fb5464d0640 1 --2- 172.21.15.77:0/4259698976 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb5401f2e70 0x7fb5400c8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.107+0000 7fb5464d0640 1 -- 172.21.15.77:0/4259698976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb52c0047c0 msgr2=0x7fb5400c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.107+0000 7fb5464d0640 1 --2- 172.21.15.77:0/4259698976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb52c0047c0 0x7fb5400c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.107+0000 7fb5464d0640 1 -- 172.21.15.77:0/4259698976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5400ca580 con 0x7fb540153150 2023-11-04T01:42:28.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.107+0000 7fb5454ce640 1 --2- 172.21.15.77:0/4259698976 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb5401f2e70 0x7fb5400c8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:28.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.107+0000 7fb5464d0640 1 --2- 172.21.15.77:0/4259698976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb540153150 0x7fb5401535e0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fb5400cf5c0 tx=0x7fb53800ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.108+0000 7fb5367fc640 1 -- 172.21.15.77:0/4259698976 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb538010510 con 0x7fb540153150 2023-11-04T01:42:28.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.108+0000 7fb5367fc640 1 -- 172.21.15.77:0/4259698976 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb538010670 con 0x7fb540153150 2023-11-04T01:42:28.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.108+0000 7fb547f33640 1 -- 172.21.15.77:0/4259698976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5400ca860 con 0x7fb540153150 2023-11-04T01:42:28.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.108+0000 7fb5367fc640 1 -- 172.21.15.77:0/4259698976 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb538010a20 con 0x7fb540153150 2023-11-04T01:42:28.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.108+0000 7fb547f33640 1 -- 172.21.15.77:0/4259698976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5400cae20 con 0x7fb540153150 2023-11-04T01:42:28.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.108+0000 7fb547f33640 1 -- 172.21.15.77:0/4259698976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb540074290 con 0x7fb540153150 2023-11-04T01:42:28.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.109+0000 7fb5367fc640 1 -- 172.21.15.77:0/4259698976 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb538010b80 con 0x7fb540153150 2023-11-04T01:42:28.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.109+0000 7fb5367fc640 1 --2- 172.21.15.77:0/4259698976 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb52406ae70 0x7fb52406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.110+0000 7fb5367fc640 1 -- 172.21.15.77:0/4259698976 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb538089070 con 0x7fb540153150 2023-11-04T01:42:28.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.110+0000 7fb545ccf640 1 --2- 172.21.15.77:0/4259698976 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb52406ae70 0x7fb52406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.110+0000 7fb545ccf640 1 --2- 172.21.15.77:0/4259698976 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb52406ae70 0x7fb52406d330 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb5400b6d70 tx=0x7fb53c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.114+0000 7fb5367fc640 1 -- 172.21.15.77:0/4259698976 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb538053e80 con 0x7fb540153150 2023-11-04T01:42:28.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.280+0000 7fb547f33640 1 -- 172.21.15.77:0/4259698976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb54015b390 con 0x7fb540153150 2023-11-04T01:42:28.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.281+0000 7fb5367fc640 1 -- 172.21.15.77:0/4259698976 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+18514 (secure 0 0 0) 0x7fb538019020 con 0x7fb540153150 2023-11-04T01:42:28.284 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:28.284 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":66,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:42:25.656978+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:22.500204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:22.966681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:28.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.284+0000 7fb547f33640 1 -- 172.21.15.77:0/4259698976 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb52406ae70 msgr2=0x7fb52406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.284+0000 7fb547f33640 1 --2- 172.21.15.77:0/4259698976 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb52406ae70 0x7fb52406d330 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb5400b6d70 tx=0x7fb53c009040 comp rx=0 tx=0).stop 2023-11-04T01:42:28.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.284+0000 7fb547f33640 1 -- 172.21.15.77:0/4259698976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb540153150 msgr2=0x7fb5401535e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.284+0000 7fb547f33640 1 --2- 172.21.15.77:0/4259698976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb540153150 0x7fb5401535e0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fb5400cf5c0 tx=0x7fb53800ead0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.284+0000 7fb547f33640 1 -- 172.21.15.77:0/4259698976 shutdown_connections 2023-11-04T01:42:28.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.284+0000 7fb547f33640 1 --2- 172.21.15.77:0/4259698976 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb52406ae70 0x7fb52406d330 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.284+0000 7fb547f33640 1 --2- 172.21.15.77:0/4259698976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb540153150 0x7fb5401535e0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.284+0000 7fb547f33640 1 --2- 172.21.15.77:0/4259698976 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb5401f2e70 0x7fb5400c8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.284+0000 7fb547f33640 1 --2- 172.21.15.77:0/4259698976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb52c0047c0 0x7fb5400c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.284+0000 7fb547f33640 1 -- 172.21.15.77:0/4259698976 >> 172.21.15.77:0/4259698976 conn(0x7fb540071f30 msgr2=0x7fb5400d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:28.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.284+0000 7fb547f33640 1 -- 172.21.15.77:0/4259698976 shutdown_connections 2023-11-04T01:42:28.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.284+0000 7fb547f33640 1 -- 172.21.15.77:0/4259698976 wait complete. 2023-11-04T01:42:28.297 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T01:42:28.298 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:42:28.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.394+0000 7f987cfee640 1 Processor -- start 2023-11-04T01:42:28.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.394+0000 7f987cfee640 1 -- start start 2023-11-04T01:42:28.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.395+0000 7f987cfee640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f987815ad80 0x7f98780abe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.395+0000 7f987cfee640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f987806a1b0 0x7f987806b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.395+0000 7f987cfee640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f987806cf60 con 0x7f98780c9a40 2023-11-04T01:42:28.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.395+0000 7f987cfee640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98780ac390 con 0x7f987815ad80 2023-11-04T01:42:28.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.395+0000 7f987cfee640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f987815b160 con 0x7f987806a1b0 2023-11-04T01:42:28.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.395+0000 7f987659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f987815ad80 0x7f98780abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.395+0000 7f9876d9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f98780c9a40 0x7f987806dce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:60774/0 (socket says 172.21.15.77:60774) 2023-11-04T01:42:28.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.395+0000 7f9876d9d640 1 -- 172.21.15.77:0/3637122503 learned_addr learned my addr 172.21.15.77:0/3637122503 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:28.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.395+0000 7f9875d9b640 1 --2- 172.21.15.77:0/3637122503 >> v2:172.21.15.122:3300/0 conn(0x7f987806a1b0 0x7f987806b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.396+0000 7f987559a640 1 -- 172.21.15.77:0/3637122503 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041942824 0 0) 0x7f987806cf60 con 0x7f98780c9a40 2023-11-04T01:42:28.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.396+0000 7f987559a640 1 -- 172.21.15.77:0/3637122503 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9860003520 con 0x7f98780c9a40 2023-11-04T01:42:28.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.396+0000 7f987659c640 1 -- 172.21.15.77:0/3637122503 >> v2:172.21.15.122:3300/0 conn(0x7f987806a1b0 msgr2=0x7f987806b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:28.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.396+0000 7f987659c640 1 --2- 172.21.15.77:0/3637122503 >> v2:172.21.15.122:3300/0 conn(0x7f987806a1b0 0x7f987806b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.396+0000 7f987659c640 1 -- 172.21.15.77:0/3637122503 >> v1:172.21.15.77:6789/0 conn(0x7f98780c9a40 legacy=0x7f987806dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.396+0000 7f987659c640 1 -- 172.21.15.77:0/3637122503 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f987806b9b0 con 0x7f987815ad80 2023-11-04T01:42:28.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.396+0000 7f987659c640 1 --2- 172.21.15.77:0/3637122503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f987815ad80 0x7f98780abe50 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f98780cab10 tx=0x7f986802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8eb03cf96e502f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.396+0000 7f987559a640 1 -- 172.21.15.77:0/3637122503 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986802cc80 con 0x7f987815ad80 2023-11-04T01:42:28.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.396+0000 7f987559a640 1 -- 172.21.15.77:0/3637122503 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986802cde0 con 0x7f987815ad80 2023-11-04T01:42:28.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.396+0000 7f987559a640 1 -- 172.21.15.77:0/3637122503 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9868034660 con 0x7f987815ad80 2023-11-04T01:42:28.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.397+0000 7f987cfee640 1 -- 172.21.15.77:0/3637122503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f987815ad80 msgr2=0x7f98780abe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.397+0000 7f987cfee640 1 --2- 172.21.15.77:0/3637122503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f987815ad80 0x7f98780abe50 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f98780cab10 tx=0x7f986802bed0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.397+0000 7f987cfee640 1 -- 172.21.15.77:0/3637122503 shutdown_connections 2023-11-04T01:42:28.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.397+0000 7f987cfee640 1 --2- 172.21.15.77:0/3637122503 >> v2:172.21.15.122:3300/0 conn(0x7f987806a1b0 0x7f987806b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.397+0000 7f987cfee640 1 --2- 172.21.15.77:0/3637122503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f987815ad80 0x7f98780abe50 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.397+0000 7f987cfee640 1 -- 172.21.15.77:0/3637122503 >> 172.21.15.77:0/3637122503 conn(0x7f98780b0cd0 msgr2=0x7f98780b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:28.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.397+0000 7f987cfee640 1 -- 172.21.15.77:0/3637122503 shutdown_connections 2023-11-04T01:42:28.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.397+0000 7f987cfee640 1 -- 172.21.15.77:0/3637122503 wait complete. 2023-11-04T01:42:28.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.398+0000 7f987cfee640 1 Processor -- start 2023-11-04T01:42:28.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.399+0000 7f987cfee640 1 -- start start 2023-11-04T01:42:28.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.399+0000 7f987cfee640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f987806a1b0 0x7f98781f1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.399+0000 7f987cfee640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98780c9a40 0x7f98780aed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.399+0000 7f987cfee640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f987815ad80 0x7f98780af290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.399+0000 7f987cfee640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9878146b30 con 0x7f987815ad80 2023-11-04T01:42:28.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.399+0000 7f987cfee640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98780c5eb0 con 0x7f98780c9a40 2023-11-04T01:42:28.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.399+0000 7f987cfee640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98781464b0 con 0x7f987806a1b0 2023-11-04T01:42:28.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.399+0000 7f9876d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f987815ad80 0x7f98780af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.399+0000 7f9876d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f987815ad80 0x7f98780af290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:32914/0 (socket says 172.21.15.77:32914) 2023-11-04T01:42:28.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.399+0000 7f9876d9d640 1 -- 172.21.15.77:0/3782181241 learned_addr learned my addr 172.21.15.77:0/3782181241 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:28.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.400+0000 7f9875d9b640 1 --2- 172.21.15.77:0/3782181241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98780c9a40 0x7f98780aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.400+0000 7f987659c640 1 --2- 172.21.15.77:0/3782181241 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f987806a1b0 0x7f98781f1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.400+0000 7f9876d9d640 1 -- 172.21.15.77:0/3782181241 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f987806a1b0 msgr2=0x7f98781f1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.400+0000 7f9876d9d640 1 --2- 172.21.15.77:0/3782181241 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f987806a1b0 0x7f98781f1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.400+0000 7f9876d9d640 1 -- 172.21.15.77:0/3782181241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98780c9a40 msgr2=0x7f98780aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.400+0000 7f9876d9d640 1 --2- 172.21.15.77:0/3782181241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98780c9a40 0x7f98780aed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.400+0000 7f9876d9d640 1 -- 172.21.15.77:0/3782181241 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9868009a70 con 0x7f987815ad80 2023-11-04T01:42:28.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.400+0000 7f9875d9b640 1 --2- 172.21.15.77:0/3782181241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98780c9a40 0x7f98780aed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:28.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.400+0000 7f9876d9d640 1 --2- 172.21.15.77:0/3782181241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f987815ad80 0x7f98780af290 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f987000c430 tx=0x7f987000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.400+0000 7f9866ffd640 1 -- 172.21.15.77:0/3782181241 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9870005ce0 con 0x7f987815ad80 2023-11-04T01:42:28.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.400+0000 7f9866ffd640 1 -- 172.21.15.77:0/3782181241 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9870005e40 con 0x7f987815ad80 2023-11-04T01:42:28.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.400+0000 7f987cfee640 1 -- 172.21.15.77:0/3782181241 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98780c5bd0 con 0x7f987815ad80 2023-11-04T01:42:28.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.400+0000 7f9866ffd640 1 -- 172.21.15.77:0/3782181241 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9870007310 con 0x7f987815ad80 2023-11-04T01:42:28.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.400+0000 7f987cfee640 1 -- 172.21.15.77:0/3782181241 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98781f2390 con 0x7f987815ad80 2023-11-04T01:42:28.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.401+0000 7f987cfee640 1 -- 172.21.15.77:0/3782181241 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98781f25b0 con 0x7f987815ad80 2023-11-04T01:42:28.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.401+0000 7f9866ffd640 1 -- 172.21.15.77:0/3782181241 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9870007470 con 0x7f987815ad80 2023-11-04T01:42:28.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.402+0000 7f9866ffd640 1 --2- 172.21.15.77:0/3782181241 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f985806ae70 0x7f985806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.402+0000 7f9866ffd640 1 -- 172.21.15.77:0/3782181241 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9870088ea0 con 0x7f987815ad80 2023-11-04T01:42:28.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.402+0000 7f987659c640 1 --2- 172.21.15.77:0/3782181241 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f985806ae70 0x7f985806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.403+0000 7f987659c640 1 --2- 172.21.15.77:0/3782181241 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f985806ae70 0x7f985806d330 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9868036000 tx=0x7f9868030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.407+0000 7f9866ffd640 1 -- 172.21.15.77:0/3782181241 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f98700577d0 con 0x7f987815ad80 2023-11-04T01:42:28.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.572+0000 7f987cfee640 1 -- 172.21.15.77:0/3782181241 --> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f987806d4e0 con 0x7f985806ae70 2023-11-04T01:42:28.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.581+0000 7f9866ffd640 1 -- 172.21.15.77:0/3782181241 <== mgr.4123 v2:172.21.15.122:6832/2275325762 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370280 (secure 0 0 0) 0x7f986803e380 con 0x7f985806ae70 2023-11-04T01:42:28.588 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:28.590 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-04T01:42:28.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.586+0000 7f987cfee640 1 -- 172.21.15.77:0/3782181241 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f985806ae70 msgr2=0x7f985806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.586+0000 7f987cfee640 1 --2- 172.21.15.77:0/3782181241 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f985806ae70 0x7f985806d330 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9868036000 tx=0x7f9868030000 comp rx=0 tx=0).stop 2023-11-04T01:42:28.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.586+0000 7f987cfee640 1 -- 172.21.15.77:0/3782181241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f987815ad80 msgr2=0x7f98780af290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.586+0000 7f987cfee640 1 --2- 172.21.15.77:0/3782181241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f987815ad80 0x7f98780af290 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f987000c430 tx=0x7f987000c8f0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.586+0000 7f987cfee640 1 -- 172.21.15.77:0/3782181241 shutdown_connections 2023-11-04T01:42:28.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.586+0000 7f987cfee640 1 --2- 172.21.15.77:0/3782181241 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f985806ae70 0x7f985806d330 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.586+0000 7f987cfee640 1 --2- 172.21.15.77:0/3782181241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f987815ad80 0x7f98780af290 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.586+0000 7f987cfee640 1 --2- 172.21.15.77:0/3782181241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98780c9a40 0x7f98780aed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.586+0000 7f987cfee640 1 --2- 172.21.15.77:0/3782181241 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f987806a1b0 0x7f98781f1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.586+0000 7f987cfee640 1 -- 172.21.15.77:0/3782181241 >> 172.21.15.77:0/3782181241 conn(0x7f98780b0cd0 msgr2=0x7f98781568a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:28.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.586+0000 7f987cfee640 1 -- 172.21.15.77:0/3782181241 shutdown_connections 2023-11-04T01:42:28.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.586+0000 7f987cfee640 1 -- 172.21.15.77:0/3782181241 wait complete. 2023-11-04T01:42:28.598 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2023-11-04T01:42:27.662194+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":255,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227792,"kb_used_data":7436,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754746928,"statfs":{"total":773094113280,"available":772860854272,"internally_reserved":0,"allocated":7614464,"data_stored":4131431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.016117"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.661565+0000","last_change":"2023-11-04T01:42:24.676349+0000","last_active":"2023-11-04T01:42:25.661565+0000","last_peered":"2023-11-04T01:42:25.661565+0000","last_clean":"2023-11-04T01:42:25.661565+0000","last_became_active":"2023-11-04T01:42:24.676061+0000","last_became_peered":"2023-11-04T01:42:24.676061+0000","last_unstale":"2023-11-04T01:42:25.661565+0000","last_undegraded":"2023-11-04T01:42:25.661565+0000","last_fullsized":"2023-11-04T01:42:25.661565+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:19:01.412412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.237317+0000","last_change":"2023-11-04T01:42:24.689379+0000","last_active":"2023-11-04T01:42:26.237317+0000","last_peered":"2023-11-04T01:42:26.237317+0000","last_clean":"2023-11-04T01:42:26.237317+0000","last_became_active":"2023-11-04T01:42:24.689077+0000","last_became_peered":"2023-11-04T01:42:24.689077+0000","last_unstale":"2023-11-04T01:42:26.237317+0000","last_undegraded":"2023-11-04T01:42:26.237317+0000","last_fullsized":"2023-11-04T01:42:26.237317+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:13.730862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.270950+0000","last_change":"2023-11-04T01:42:24.666557+0000","last_active":"2023-11-04T01:42:26.270950+0000","last_peered":"2023-11-04T01:42:26.270950+0000","last_clean":"2023-11-04T01:42:26.270950+0000","last_became_active":"2023-11-04T01:42:24.666284+0000","last_became_peered":"2023-11-04T01:42:24.666284+0000","last_unstale":"2023-11-04T01:42:26.270950+0000","last_undegraded":"2023-11-04T01:42:26.270950+0000","last_fullsized":"2023-11-04T01:42:26.270950+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:27.888669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.740500+0000","last_change":"2023-11-04T01:42:24.681954+0000","last_active":"2023-11-04T01:42:25.740500+0000","last_peered":"2023-11-04T01:42:25.740500+0000","last_clean":"2023-11-04T01:42:25.740500+0000","last_became_active":"2023-11-04T01:42:24.681557+0000","last_became_peered":"2023-11-04T01:42:24.681557+0000","last_unstale":"2023-11-04T01:42:25.740500+0000","last_undegraded":"2023-11-04T01:42:25.740500+0000","last_fullsized":"2023-11-04T01:42:25.740500+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:18:20.009445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.660847+0000","last_change":"2023-11-04T01:42:24.674094+0000","last_active":"2023-11-04T01:42:25.660847+0000","last_peered":"2023-11-04T01:42:25.660847+0000","last_clean":"2023-11-04T01:42:25.660847+0000","last_became_active":"2023-11-04T01:42:24.673763+0000","last_became_peered":"2023-11-04T01:42:24.673763+0000","last_unstale":"2023-11-04T01:42:25.660847+0000","last_undegraded":"2023-11-04T01:42:25.660847+0000","last_fullsized":"2023-11-04T01:42:25.660847+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:53:56.975140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.236637+0000","last_change":"2023-11-04T01:42:24.693563+0000","last_active":"2023-11-04T01:42:26.236637+0000","last_peered":"2023-11-04T01:42:26.236637+0000","last_clean":"2023-11-04T01:42:26.236637+0000","last_became_active":"2023-11-04T01:42:24.692795+0000","last_became_peered":"2023-11-04T01:42:24.692795+0000","last_unstale":"2023-11-04T01:42:26.236637+0000","last_undegraded":"2023-11-04T01:42:26.236637+0000","last_fullsized":"2023-11-04T01:42:26.236637+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:44:43.162870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.281232+0000","last_change":"2023-11-04T01:42:24.675794+0000","last_active":"2023-11-04T01:42:26.281232+0000","last_peered":"2023-11-04T01:42:26.281232+0000","last_clean":"2023-11-04T01:42:26.281232+0000","last_became_active":"2023-11-04T01:42:24.675532+0000","last_became_peered":"2023-11-04T01:42:24.675532+0000","last_unstale":"2023-11-04T01:42:26.281232+0000","last_undegraded":"2023-11-04T01:42:26.281232+0000","last_fullsized":"2023-11-04T01:42:26.281232+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:01:25.167031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.236644+0000","last_change":"2023-11-04T01:42:24.675990+0000","last_active":"2023-11-04T01:42:26.236644+0000","last_peered":"2023-11-04T01:42:26.236644+0000","last_clean":"2023-11-04T01:42:26.236644+0000","last_became_active":"2023-11-04T01:42:24.675697+0000","last_became_peered":"2023-11-04T01:42:24.675697+0000","last_unstale":"2023-11-04T01:42:26.236644+0000","last_undegraded":"2023-11-04T01:42:26.236644+0000","last_fullsized":"2023-11-04T01:42:26.236644+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:36:02.307558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.661232+0000","last_change":"2023-11-04T01:42:24.680425+0000","last_active":"2023-11-04T01:42:25.661232+0000","last_peered":"2023-11-04T01:42:25.661232+0000","last_clean":"2023-11-04T01:42:25.661232+0000","last_became_active":"2023-11-04T01:42:24.680175+0000","last_became_peered":"2023-11-04T01:42:24.680175+0000","last_unstale":"2023-11-04T01:42:25.661232+0000","last_undegraded":"2023-11-04T01:42:25.661232+0000","last_fullsized":"2023-11-04T01:42:25.661232+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:40:26.606733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.281850+0000","last_change":"2023-11-04T01:42:24.687736+0000","last_active":"2023-11-04T01:42:26.281850+0000","last_peered":"2023-11-04T01:42:26.281850+0000","last_clean":"2023-11-04T01:42:26.281850+0000","last_became_active":"2023-11-04T01:42:24.687422+0000","last_became_peered":"2023-11-04T01:42:24.687422+0000","last_unstale":"2023-11-04T01:42:26.281850+0000","last_undegraded":"2023-11-04T01:42:26.281850+0000","last_fullsized":"2023-11-04T01:42:26.281850+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:44:43.162870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.661343+0000","last_change":"2023-11-04T01:42:24.675694+0000","last_active":"2023-11-04T01:42:25.661343+0000","last_peered":"2023-11-04T01:42:25.661343+0000","last_clean":"2023-11-04T01:42:25.661343+0000","last_became_active":"2023-11-04T01:42:24.675426+0000","last_became_peered":"2023-11-04T01:42:24.675426+0000","last_unstale":"2023-11-04T01:42:25.661343+0000","last_undegraded":"2023-11-04T01:42:25.661343+0000","last_fullsized":"2023-11-04T01:42:25.661343+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:28:35.314279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.740625+0000","last_change":"2023-11-04T01:42:24.675084+0000","last_active":"2023-11-04T01:42:25.740625+0000","last_peered":"2023-11-04T01:42:25.740625+0000","last_clean":"2023-11-04T01:42:25.740625+0000","last_became_active":"2023-11-04T01:42:24.674824+0000","last_became_peered":"2023-11-04T01:42:24.674824+0000","last_unstale":"2023-11-04T01:42:25.740625+0000","last_undegraded":"2023-11-04T01:42:25.740625+0000","last_fullsized":"2023-11-04T01:42:25.740625+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:50:44.007615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.660153+0000","last_change":"2023-11-04T01:42:24.677217+0000","last_active":"2023-11-04T01:42:25.660153+0000","last_peered":"2023-11-04T01:42:25.660153+0000","last_clean":"2023-11-04T01:42:25.660153+0000","last_became_active":"2023-11-04T01:42:24.676951+0000","last_became_peered":"2023-11-04T01:42:24.676951+0000","last_unstale":"2023-11-04T01:42:25.660153+0000","last_undegraded":"2023-11-04T01:42:25.660153+0000","last_fullsized":"2023-11-04T01:42:25.660153+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:21.018644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.660858+0000","last_change":"2023-11-04T01:42:24.681303+0000","last_active":"2023-11-04T01:42:25.660858+0000","last_peered":"2023-11-04T01:42:25.660858+0000","last_clean":"2023-11-04T01:42:25.660858+0000","last_became_active":"2023-11-04T01:42:24.681055+0000","last_became_peered":"2023-11-04T01:42:24.681055+0000","last_unstale":"2023-11-04T01:42:25.660858+0000","last_undegraded":"2023-11-04T01:42:25.660858+0000","last_fullsized":"2023-11-04T01:42:25.660858+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:14:47.643085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.659821+0000","last_change":"2023-11-04T01:42:24.670303+0000","last_active":"2023-11-04T01:42:25.659821+0000","last_peered":"2023-11-04T01:42:25.659821+0000","last_clean":"2023-11-04T01:42:25.659821+0000","last_became_active":"2023-11-04T01:42:24.669942+0000","last_became_peered":"2023-11-04T01:42:24.669942+0000","last_unstale":"2023-11-04T01:42:25.659821+0000","last_undegraded":"2023-11-04T01:42:25.659821+0000","last_fullsized":"2023-11-04T01:42:25.659821+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:23:37.634543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.281279+0000","last_change":"2023-11-04T01:42:24.695676+0000","last_active":"2023-11-04T01:42:26.281279+0000","last_peered":"2023-11-04T01:42:26.281279+0000","last_clean":"2023-11-04T01:42:26.281279+0000","last_became_active":"2023-11-04T01:42:24.695423+0000","last_became_peered":"2023-11-04T01:42:24.695423+0000","last_unstale":"2023-11-04T01:42:26.281279+0000","last_undegraded":"2023-11-04T01:42:26.281279+0000","last_fullsized":"2023-11-04T01:42:26.281279+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:50:44.007615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.661256+0000","last_change":"2023-11-04T01:42:24.679136+0000","last_active":"2023-11-04T01:42:25.661256+0000","last_peered":"2023-11-04T01:42:25.661256+0000","last_clean":"2023-11-04T01:42:25.661256+0000","last_became_active":"2023-11-04T01:42:24.678857+0000","last_became_peered":"2023-11-04T01:42:24.678857+0000","last_unstale":"2023-11-04T01:42:25.661256+0000","last_undegraded":"2023-11-04T01:42:25.661256+0000","last_fullsized":"2023-11-04T01:42:25.661256+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:49:03.072325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.740618+0000","last_change":"2023-11-04T01:42:24.677756+0000","last_active":"2023-11-04T01:42:25.740618+0000","last_peered":"2023-11-04T01:42:25.740618+0000","last_clean":"2023-11-04T01:42:25.740618+0000","last_became_active":"2023-11-04T01:42:24.677416+0000","last_became_peered":"2023-11-04T01:42:24.677416+0000","last_unstale":"2023-11-04T01:42:25.740618+0000","last_undegraded":"2023-11-04T01:42:25.740618+0000","last_fullsized":"2023-11-04T01:42:25.740618+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:47:39.653350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.237019+0000","last_change":"2023-11-04T01:42:24.675346+0000","last_active":"2023-11-04T01:42:26.237019+0000","last_peered":"2023-11-04T01:42:26.237019+0000","last_clean":"2023-11-04T01:42:26.237019+0000","last_became_active":"2023-11-04T01:42:24.675003+0000","last_became_peered":"2023-11-04T01:42:24.675003+0000","last_unstale":"2023-11-04T01:42:26.237019+0000","last_undegraded":"2023-11-04T01:42:26.237019+0000","last_fullsized":"2023-11-04T01:42:26.237019+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:29.663281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.659983+0000","last_change":"2023-11-04T01:42:24.681147+0000","last_active":"2023-11-04T01:42:25.659983+0000","last_peered":"2023-11-04T01:42:25.659983+0000","last_clean":"2023-11-04T01:42:25.659983+0000","last_became_active":"2023-11-04T01:42:24.680890+0000","last_became_peered":"2023-11-04T01:42:24.680890+0000","last_unstale":"2023-11-04T01:42:25.659983+0000","last_undegraded":"2023-11-04T01:42:25.659983+0000","last_fullsized":"2023-11-04T01:42:25.659983+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:59:33.999093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.281790+0000","last_change":"2023-11-04T01:42:24.690026+0000","last_active":"2023-11-04T01:42:26.281790+0000","last_peered":"2023-11-04T01:42:26.281790+0000","last_clean":"2023-11-04T01:42:26.281790+0000","last_became_active":"2023-11-04T01:42:24.689756+0000","last_became_peered":"2023-11-04T01:42:24.689756+0000","last_unstale":"2023-11-04T01:42:26.281790+0000","last_undegraded":"2023-11-04T01:42:26.281790+0000","last_fullsized":"2023-11-04T01:42:26.281790+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:49:08.332268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.281582+0000","last_change":"2023-11-04T01:42:24.687303+0000","last_active":"2023-11-04T01:42:26.281582+0000","last_peered":"2023-11-04T01:42:26.281582+0000","last_clean":"2023-11-04T01:42:26.281582+0000","last_became_active":"2023-11-04T01:42:24.686982+0000","last_became_peered":"2023-11-04T01:42:24.686982+0000","last_unstale":"2023-11-04T01:42:26.281582+0000","last_undegraded":"2023-11-04T01:42:26.281582+0000","last_fullsized":"2023-11-04T01:42:26.281582+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:37:59.345720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.661058+0000","last_change":"2023-11-04T01:42:24.684519+0000","last_active":"2023-11-04T01:42:25.661058+0000","last_peered":"2023-11-04T01:42:25.661058+0000","last_clean":"2023-11-04T01:42:25.661058+0000","last_became_active":"2023-11-04T01:42:24.684104+0000","last_became_peered":"2023-11-04T01:42:24.684104+0000","last_unstale":"2023-11-04T01:42:25.661058+0000","last_undegraded":"2023-11-04T01:42:25.661058+0000","last_fullsized":"2023-11-04T01:42:25.661058+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:37.772749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.660899+0000","last_change":"2023-11-04T01:42:24.678560+0000","last_active":"2023-11-04T01:42:25.660899+0000","last_peered":"2023-11-04T01:42:25.660899+0000","last_clean":"2023-11-04T01:42:25.660899+0000","last_became_active":"2023-11-04T01:42:24.678281+0000","last_became_peered":"2023-11-04T01:42:24.678281+0000","last_unstale":"2023-11-04T01:42:25.660899+0000","last_undegraded":"2023-11-04T01:42:25.660899+0000","last_fullsized":"2023-11-04T01:42:25.660899+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:05:41.792046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.281857+0000","last_change":"2023-11-04T01:42:24.693223+0000","last_active":"2023-11-04T01:42:26.281857+0000","last_peered":"2023-11-04T01:42:26.281857+0000","last_clean":"2023-11-04T01:42:26.281857+0000","last_became_active":"2023-11-04T01:42:24.692794+0000","last_became_peered":"2023-11-04T01:42:24.692794+0000","last_unstale":"2023-11-04T01:42:26.281857+0000","last_undegraded":"2023-11-04T01:42:26.281857+0000","last_fullsized":"2023-11-04T01:42:26.281857+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:36:02.307558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.282079+0000","last_change":"2023-11-04T01:42:24.690638+0000","last_active":"2023-11-04T01:42:26.282079+0000","last_peered":"2023-11-04T01:42:26.282079+0000","last_clean":"2023-11-04T01:42:26.282079+0000","last_became_active":"2023-11-04T01:42:24.690374+0000","last_became_peered":"2023-11-04T01:42:24.690374+0000","last_unstale":"2023-11-04T01:42:26.282079+0000","last_undegraded":"2023-11-04T01:42:26.282079+0000","last_fullsized":"2023-11-04T01:42:26.282079+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:44:09.067211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.271001+0000","last_change":"2023-11-04T01:42:24.669780+0000","last_active":"2023-11-04T01:42:26.271001+0000","last_peered":"2023-11-04T01:42:26.271001+0000","last_clean":"2023-11-04T01:42:26.271001+0000","last_became_active":"2023-11-04T01:42:24.669501+0000","last_became_peered":"2023-11-04T01:42:24.669501+0000","last_unstale":"2023-11-04T01:42:26.271001+0000","last_undegraded":"2023-11-04T01:42:26.271001+0000","last_fullsized":"2023-11-04T01:42:26.271001+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:24.209022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.282225+0000","last_change":"2023-11-04T01:42:24.689389+0000","last_active":"2023-11-04T01:42:26.282225+0000","last_peered":"2023-11-04T01:42:26.282225+0000","last_clean":"2023-11-04T01:42:26.282225+0000","last_became_active":"2023-11-04T01:42:24.689026+0000","last_became_peered":"2023-11-04T01:42:24.689026+0000","last_unstale":"2023-11-04T01:42:26.282225+0000","last_undegraded":"2023-11-04T01:42:26.282225+0000","last_fullsized":"2023-11-04T01:42:26.282225+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:29.663281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.270685+0000","last_change":"2023-11-04T01:42:24.681834+0000","last_active":"2023-11-04T01:42:26.270685+0000","last_peered":"2023-11-04T01:42:26.270685+0000","last_clean":"2023-11-04T01:42:26.270685+0000","last_became_active":"2023-11-04T01:42:24.681561+0000","last_became_peered":"2023-11-04T01:42:24.681561+0000","last_unstale":"2023-11-04T01:42:26.270685+0000","last_undegraded":"2023-11-04T01:42:26.270685+0000","last_fullsized":"2023-11-04T01:42:26.270685+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:34:37.802722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.281352+0000","last_change":"2023-11-04T01:42:24.682917+0000","last_active":"2023-11-04T01:42:26.281352+0000","last_peered":"2023-11-04T01:42:26.281352+0000","last_clean":"2023-11-04T01:42:26.281352+0000","last_became_active":"2023-11-04T01:42:24.682645+0000","last_became_peered":"2023-11-04T01:42:24.682645+0000","last_unstale":"2023-11-04T01:42:26.281352+0000","last_undegraded":"2023-11-04T01:42:26.281352+0000","last_fullsized":"2023-11-04T01:42:26.281352+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:20:52.969676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.281458+0000","last_change":"2023-11-04T01:42:24.676621+0000","last_active":"2023-11-04T01:42:26.281458+0000","last_peered":"2023-11-04T01:42:26.281458+0000","last_clean":"2023-11-04T01:42:26.281458+0000","last_became_active":"2023-11-04T01:42:24.676370+0000","last_became_peered":"2023-11-04T01:42:24.676370+0000","last_unstale":"2023-11-04T01:42:26.281458+0000","last_undegraded":"2023-11-04T01:42:26.281458+0000","last_fullsized":"2023-11-04T01:42:26.281458+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:54.837882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.236684+0000","last_change":"2023-11-04T01:42:24.686171+0000","last_active":"2023-11-04T01:42:26.236684+0000","last_peered":"2023-11-04T01:42:26.236684+0000","last_clean":"2023-11-04T01:42:26.236684+0000","last_became_active":"2023-11-04T01:42:24.685900+0000","last_became_peered":"2023-11-04T01:42:24.685900+0000","last_unstale":"2023-11-04T01:42:26.236684+0000","last_undegraded":"2023-11-04T01:42:26.236684+0000","last_fullsized":"2023-11-04T01:42:26.236684+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:55:47.759698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.660760+0000","last_change":"2023-11-04T01:42:24.675141+0000","last_active":"2023-11-04T01:42:25.660760+0000","last_peered":"2023-11-04T01:42:25.660760+0000","last_clean":"2023-11-04T01:42:25.660760+0000","last_became_active":"2023-11-04T01:42:24.674854+0000","last_became_peered":"2023-11-04T01:42:24.674854+0000","last_unstale":"2023-11-04T01:42:25.660760+0000","last_undegraded":"2023-11-04T01:42:25.660760+0000","last_fullsized":"2023-11-04T01:42:25.660760+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:12:47.308128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"65'8","reported_seq":20,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.281238+0000","last_change":"2023-11-04T01:42:23.672912+0000","last_active":"2023-11-04T01:42:26.281238+0000","last_peered":"2023-11-04T01:42:26.281238+0000","last_clean":"2023-11-04T01:42:26.281238+0000","last_became_active":"2023-11-04T01:42:23.672636+0000","last_became_peered":"2023-11-04T01:42:23.672636+0000","last_unstale":"2023-11-04T01:42:26.281238+0000","last_undegraded":"2023-11-04T01:42:26.281238+0000","last_fullsized":"2023-11-04T01:42:26.281238+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:44:32.155572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.664053+0000","last_change":"2023-11-04T01:41:36.067943+0000","last_active":"2023-11-04T01:42:24.664053+0000","last_peered":"2023-11-04T01:42:24.664053+0000","last_clean":"2023-11-04T01:42:24.664053+0000","last_became_active":"2023-11-04T01:41:34.734305+0000","last_became_peered":"2023-11-04T01:41:34.734305+0000","last_unstale":"2023-11-04T01:42:24.664053+0000","last_undegraded":"2023-11-04T01:42:24.664053+0000","last_fullsized":"2023-11-04T01:42:24.664053+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:48.121273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033780399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.659860+0000","last_change":"2023-11-04T01:42:24.678086+0000","last_active":"2023-11-04T01:42:25.659860+0000","last_peered":"2023-11-04T01:42:25.659860+0000","last_clean":"2023-11-04T01:42:25.659860+0000","last_became_active":"2023-11-04T01:42:24.677837+0000","last_became_peered":"2023-11-04T01:42:24.677837+0000","last_unstale":"2023-11-04T01:42:25.659860+0000","last_undegraded":"2023-11-04T01:42:25.659860+0000","last_fullsized":"2023-11-04T01:42:25.659860+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:19:11.501349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.670736+0000","last_change":"2023-11-04T01:42:23.667570+0000","last_active":"2023-11-04T01:42:24.670736+0000","last_peered":"2023-11-04T01:42:24.670736+0000","last_clean":"2023-11-04T01:42:24.670736+0000","last_became_active":"2023-11-04T01:42:23.667328+0000","last_became_peered":"2023-11-04T01:42:23.667328+0000","last_unstale":"2023-11-04T01:42:24.670736+0000","last_undegraded":"2023-11-04T01:42:24.670736+0000","last_fullsized":"2023-11-04T01:42:24.670736+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:44:55.835030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":34,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.671287+0000","last_change":"2023-11-04T01:41:35.728832+0000","last_active":"2023-11-04T01:42:24.671287+0000","last_peered":"2023-11-04T01:42:24.671287+0000","last_clean":"2023-11-04T01:42:24.671287+0000","last_became_active":"2023-11-04T01:41:34.733517+0000","last_became_peered":"2023-11-04T01:41:34.733517+0000","last_unstale":"2023-11-04T01:42:24.671287+0000","last_undegraded":"2023-11-04T01:42:24.671287+0000","last_fullsized":"2023-11-04T01:42:24.671287+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:19.350812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042545700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.281637+0000","last_change":"2023-11-04T01:42:24.691848+0000","last_active":"2023-11-04T01:42:26.281637+0000","last_peered":"2023-11-04T01:42:26.281637+0000","last_clean":"2023-11-04T01:42:26.281637+0000","last_became_active":"2023-11-04T01:42:24.691546+0000","last_became_peered":"2023-11-04T01:42:24.691546+0000","last_unstale":"2023-11-04T01:42:26.281637+0000","last_undegraded":"2023-11-04T01:42:26.281637+0000","last_fullsized":"2023-11-04T01:42:26.281637+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:37.772749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.236617+0000","last_change":"2023-11-04T01:42:23.668345+0000","last_active":"2023-11-04T01:42:26.236617+0000","last_peered":"2023-11-04T01:42:26.236617+0000","last_clean":"2023-11-04T01:42:26.236617+0000","last_became_active":"2023-11-04T01:42:23.667972+0000","last_became_peered":"2023-11-04T01:42:23.667972+0000","last_unstale":"2023-11-04T01:42:26.236617+0000","last_undegraded":"2023-11-04T01:42:26.236617+0000","last_fullsized":"2023-11-04T01:42:26.236617+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:48:20.179786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":35,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.669826+0000","last_change":"2023-11-04T01:41:35.906660+0000","last_active":"2023-11-04T01:42:24.669826+0000","last_peered":"2023-11-04T01:42:24.669826+0000","last_clean":"2023-11-04T01:42:24.669826+0000","last_became_active":"2023-11-04T01:41:34.737209+0000","last_became_peered":"2023-11-04T01:41:34.737209+0000","last_unstale":"2023-11-04T01:42:24.669826+0000","last_undegraded":"2023-11-04T01:42:24.669826+0000","last_fullsized":"2023-11-04T01:42:24.669826+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:59.608410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068889500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.661126+0000","last_change":"2023-11-04T01:42:24.675636+0000","last_active":"2023-11-04T01:42:25.661126+0000","last_peered":"2023-11-04T01:42:25.661126+0000","last_clean":"2023-11-04T01:42:25.661126+0000","last_became_active":"2023-11-04T01:42:24.675357+0000","last_became_peered":"2023-11-04T01:42:24.675357+0000","last_unstale":"2023-11-04T01:42:25.661126+0000","last_undegraded":"2023-11-04T01:42:25.661126+0000","last_fullsized":"2023-11-04T01:42:25.661126+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:19:01.258080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"65'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.740394+0000","last_change":"2023-11-04T01:42:23.658552+0000","last_active":"2023-11-04T01:42:25.740394+0000","last_peered":"2023-11-04T01:42:25.740394+0000","last_clean":"2023-11-04T01:42:25.740394+0000","last_became_active":"2023-11-04T01:42:23.658274+0000","last_became_peered":"2023-11-04T01:42:23.658274+0000","last_unstale":"2023-11-04T01:42:25.740394+0000","last_undegraded":"2023-11-04T01:42:25.740394+0000","last_fullsized":"2023-11-04T01:42:25.740394+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:48:20.179786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.664028+0000","last_change":"2023-11-04T01:41:36.067946+0000","last_active":"2023-11-04T01:42:24.664028+0000","last_peered":"2023-11-04T01:42:24.664028+0000","last_clean":"2023-11-04T01:42:24.664028+0000","last_became_active":"2023-11-04T01:41:34.729591+0000","last_became_peered":"2023-11-04T01:41:34.729591+0000","last_unstale":"2023-11-04T01:42:24.664028+0000","last_undegraded":"2023-11-04T01:42:24.664028+0000","last_fullsized":"2023-11-04T01:42:24.664028+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:59.608410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032681099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.661093+0000","last_change":"2023-11-04T01:42:24.669813+0000","last_active":"2023-11-04T01:42:25.661093+0000","last_peered":"2023-11-04T01:42:25.661093+0000","last_clean":"2023-11-04T01:42:25.661093+0000","last_became_active":"2023-11-04T01:42:24.669568+0000","last_became_peered":"2023-11-04T01:42:24.669568+0000","last_unstale":"2023-11-04T01:42:25.661093+0000","last_undegraded":"2023-11-04T01:42:25.661093+0000","last_fullsized":"2023-11-04T01:42:25.661093+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:46:58.814972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"65'6","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.740694+0000","last_change":"2023-11-04T01:42:23.659092+0000","last_active":"2023-11-04T01:42:25.740694+0000","last_peered":"2023-11-04T01:42:25.740694+0000","last_clean":"2023-11-04T01:42:25.740694+0000","last_became_active":"2023-11-04T01:42:23.658851+0000","last_became_peered":"2023-11-04T01:42:23.658851+0000","last_unstale":"2023-11-04T01:42:25.740694+0000","last_undegraded":"2023-11-04T01:42:25.740694+0000","last_fullsized":"2023-11-04T01:42:25.740694+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:46:59.014740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":35,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.671768+0000","last_change":"2023-11-04T01:41:35.905999+0000","last_active":"2023-11-04T01:42:24.671768+0000","last_peered":"2023-11-04T01:42:24.671768+0000","last_clean":"2023-11-04T01:42:24.671768+0000","last_became_active":"2023-11-04T01:41:34.735286+0000","last_became_peered":"2023-11-04T01:41:34.735286+0000","last_unstale":"2023-11-04T01:42:24.671768+0000","last_undegraded":"2023-11-04T01:42:24.671768+0000","last_fullsized":"2023-11-04T01:42:24.671768+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:14:22.019781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051880100000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.237108+0000","last_change":"2023-11-04T01:42:24.692286+0000","last_active":"2023-11-04T01:42:26.237108+0000","last_peered":"2023-11-04T01:42:26.237108+0000","last_clean":"2023-11-04T01:42:26.237108+0000","last_became_active":"2023-11-04T01:42:24.692005+0000","last_became_peered":"2023-11-04T01:42:24.692005+0000","last_unstale":"2023-11-04T01:42:26.237108+0000","last_undegraded":"2023-11-04T01:42:26.237108+0000","last_fullsized":"2023-11-04T01:42:26.237108+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:00:24.351824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"65'3","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.271056+0000","last_change":"2023-11-04T01:42:23.661491+0000","last_active":"2023-11-04T01:42:26.271056+0000","last_peered":"2023-11-04T01:42:26.271056+0000","last_clean":"2023-11-04T01:42:26.271056+0000","last_became_active":"2023-11-04T01:42:23.661239+0000","last_became_peered":"2023-11-04T01:42:23.661239+0000","last_unstale":"2023-11-04T01:42:26.271056+0000","last_undegraded":"2023-11-04T01:42:26.271056+0000","last_fullsized":"2023-11-04T01:42:26.271056+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:04.699379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.659030+0000","last_change":"2023-11-04T01:41:36.344205+0000","last_active":"2023-11-04T01:42:24.659030+0000","last_peered":"2023-11-04T01:42:24.659030+0000","last_clean":"2023-11-04T01:42:24.659030+0000","last_became_active":"2023-11-04T01:41:34.733205+0000","last_became_peered":"2023-11-04T01:41:34.733205+0000","last_unstale":"2023-11-04T01:42:24.659030+0000","last_undegraded":"2023-11-04T01:42:24.659030+0000","last_fullsized":"2023-11-04T01:42:24.659030+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:37.958719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011584760000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.661718+0000","last_change":"2023-11-04T01:42:24.675765+0000","last_active":"2023-11-04T01:42:25.661718+0000","last_peered":"2023-11-04T01:42:25.661718+0000","last_clean":"2023-11-04T01:42:25.661718+0000","last_became_active":"2023-11-04T01:42:24.675460+0000","last_became_peered":"2023-11-04T01:42:24.675460+0000","last_unstale":"2023-11-04T01:42:25.661718+0000","last_undegraded":"2023-11-04T01:42:25.661718+0000","last_fullsized":"2023-11-04T01:42:25.661718+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:19:11.501349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.237286+0000","last_change":"2023-11-04T01:42:23.666334+0000","last_active":"2023-11-04T01:42:26.237286+0000","last_peered":"2023-11-04T01:42:26.237286+0000","last_clean":"2023-11-04T01:42:26.237286+0000","last_became_active":"2023-11-04T01:42:23.665556+0000","last_became_peered":"2023-11-04T01:42:23.665556+0000","last_unstale":"2023-11-04T01:42:26.237286+0000","last_undegraded":"2023-11-04T01:42:26.237286+0000","last_fullsized":"2023-11-04T01:42:26.237286+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:47:38.646711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.659394+0000","last_change":"2023-11-04T01:41:36.343728+0000","last_active":"2023-11-04T01:42:24.659394+0000","last_peered":"2023-11-04T01:42:24.659394+0000","last_clean":"2023-11-04T01:42:24.659394+0000","last_became_active":"2023-11-04T01:41:34.731106+0000","last_became_peered":"2023-11-04T01:41:34.731106+0000","last_unstale":"2023-11-04T01:42:24.659394+0000","last_undegraded":"2023-11-04T01:42:24.659394+0000","last_fullsized":"2023-11-04T01:42:24.659394+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:29.730483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058974500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.282185+0000","last_change":"2023-11-04T01:42:24.679662+0000","last_active":"2023-11-04T01:42:26.282185+0000","last_peered":"2023-11-04T01:42:26.282185+0000","last_clean":"2023-11-04T01:42:26.282185+0000","last_became_active":"2023-11-04T01:42:24.679401+0000","last_became_peered":"2023-11-04T01:42:24.679401+0000","last_unstale":"2023-11-04T01:42:26.282185+0000","last_undegraded":"2023-11-04T01:42:26.282185+0000","last_fullsized":"2023-11-04T01:42:26.282185+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:28:35.314279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.281945+0000","last_change":"2023-11-04T01:42:23.671927+0000","last_active":"2023-11-04T01:42:26.281945+0000","last_peered":"2023-11-04T01:42:26.281945+0000","last_clean":"2023-11-04T01:42:26.281945+0000","last_became_active":"2023-11-04T01:42:23.671604+0000","last_became_peered":"2023-11-04T01:42:23.671604+0000","last_unstale":"2023-11-04T01:42:26.281945+0000","last_undegraded":"2023-11-04T01:42:26.281945+0000","last_fullsized":"2023-11-04T01:42:26.281945+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:47:38.646711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":35,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.677837+0000","last_change":"2023-11-04T01:41:35.931778+0000","last_active":"2023-11-04T01:42:24.677837+0000","last_peered":"2023-11-04T01:42:24.677837+0000","last_clean":"2023-11-04T01:42:24.677837+0000","last_became_active":"2023-11-04T01:41:34.736897+0000","last_became_peered":"2023-11-04T01:41:34.736897+0000","last_unstale":"2023-11-04T01:42:24.677837+0000","last_undegraded":"2023-11-04T01:42:24.677837+0000","last_fullsized":"2023-11-04T01:42:24.677837+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:20.089706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071523300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.659839+0000","last_change":"2023-11-04T01:42:24.670206+0000","last_active":"2023-11-04T01:42:25.659839+0000","last_peered":"2023-11-04T01:42:25.659839+0000","last_clean":"2023-11-04T01:42:25.659839+0000","last_became_active":"2023-11-04T01:42:24.669582+0000","last_became_peered":"2023-11-04T01:42:24.669582+0000","last_unstale":"2023-11-04T01:42:25.659839+0000","last_undegraded":"2023-11-04T01:42:25.659839+0000","last_fullsized":"2023-11-04T01:42:25.659839+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:19:01.412412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.660556+0000","last_change":"2023-11-04T01:42:23.658417+0000","last_active":"2023-11-04T01:42:25.660556+0000","last_peered":"2023-11-04T01:42:25.660556+0000","last_clean":"2023-11-04T01:42:25.660556+0000","last_became_active":"2023-11-04T01:42:23.657807+0000","last_became_peered":"2023-11-04T01:42:23.657807+0000","last_unstale":"2023-11-04T01:42:25.660556+0000","last_undegraded":"2023-11-04T01:42:25.660556+0000","last_fullsized":"2023-11-04T01:42:25.660556+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:35.376713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":41,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.664626+0000","last_change":"2023-11-04T01:41:35.729017+0000","last_active":"2023-11-04T01:42:24.664626+0000","last_peered":"2023-11-04T01:42:24.664626+0000","last_clean":"2023-11-04T01:42:24.664626+0000","last_became_active":"2023-11-04T01:41:34.730592+0000","last_became_peered":"2023-11-04T01:41:34.730592+0000","last_unstale":"2023-11-04T01:42:24.664626+0000","last_undegraded":"2023-11-04T01:42:24.664626+0000","last_fullsized":"2023-11-04T01:42:24.664626+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:08.858430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088820999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.660599+0000","last_change":"2023-11-04T01:42:24.692253+0000","last_active":"2023-11-04T01:42:25.660599+0000","last_peered":"2023-11-04T01:42:25.660599+0000","last_clean":"2023-11-04T01:42:25.660599+0000","last_became_active":"2023-11-04T01:42:24.691946+0000","last_became_peered":"2023-11-04T01:42:24.691946+0000","last_unstale":"2023-11-04T01:42:25.660599+0000","last_undegraded":"2023-11-04T01:42:25.660599+0000","last_fullsized":"2023-11-04T01:42:25.660599+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:13:43.632962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.740325+0000","last_change":"2023-11-04T01:42:23.660357+0000","last_active":"2023-11-04T01:42:25.740325+0000","last_peered":"2023-11-04T01:42:25.740325+0000","last_clean":"2023-11-04T01:42:25.740325+0000","last_became_active":"2023-11-04T01:42:23.660086+0000","last_became_peered":"2023-11-04T01:42:23.660086+0000","last_unstale":"2023-11-04T01:42:25.740325+0000","last_undegraded":"2023-11-04T01:42:25.740325+0000","last_fullsized":"2023-11-04T01:42:25.740325+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:57:29.058454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.662179+0000","last_change":"2023-11-04T01:41:35.729378+0000","last_active":"2023-11-04T01:42:24.662179+0000","last_peered":"2023-11-04T01:42:24.662179+0000","last_clean":"2023-11-04T01:42:24.662179+0000","last_became_active":"2023-11-04T01:41:34.730387+0000","last_became_peered":"2023-11-04T01:41:34.730387+0000","last_unstale":"2023-11-04T01:42:24.662179+0000","last_undegraded":"2023-11-04T01:42:24.662179+0000","last_fullsized":"2023-11-04T01:42:24.662179+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:12.653602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072268699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.281936+0000","last_change":"2023-11-04T01:42:24.689718+0000","last_active":"2023-11-04T01:42:26.281936+0000","last_peered":"2023-11-04T01:42:26.281936+0000","last_clean":"2023-11-04T01:42:26.281936+0000","last_became_active":"2023-11-04T01:42:24.689419+0000","last_became_peered":"2023-11-04T01:42:24.689419+0000","last_unstale":"2023-11-04T01:42:26.281936+0000","last_undegraded":"2023-11-04T01:42:26.281936+0000","last_fullsized":"2023-11-04T01:42:26.281936+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:55:47.759698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"65'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.236784+0000","last_change":"2023-11-04T01:42:23.670594+0000","last_active":"2023-11-04T01:42:26.236784+0000","last_peered":"2023-11-04T01:42:26.236784+0000","last_clean":"2023-11-04T01:42:26.236784+0000","last_became_active":"2023-11-04T01:42:23.670318+0000","last_became_peered":"2023-11-04T01:42:23.670318+0000","last_unstale":"2023-11-04T01:42:26.236784+0000","last_undegraded":"2023-11-04T01:42:26.236784+0000","last_fullsized":"2023-11-04T01:42:26.236784+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:17:14.983458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":41,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.664592+0000","last_change":"2023-11-04T01:41:35.729318+0000","last_active":"2023-11-04T01:42:24.664592+0000","last_peered":"2023-11-04T01:42:24.664592+0000","last_clean":"2023-11-04T01:42:24.664592+0000","last_became_active":"2023-11-04T01:41:34.733796+0000","last_became_peered":"2023-11-04T01:41:34.733796+0000","last_unstale":"2023-11-04T01:42:24.664592+0000","last_undegraded":"2023-11-04T01:42:24.664592+0000","last_fullsized":"2023-11-04T01:42:24.664592+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:19.350812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053712200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.281467+0000","last_change":"2023-11-04T01:42:24.680083+0000","last_active":"2023-11-04T01:42:26.281467+0000","last_peered":"2023-11-04T01:42:26.281467+0000","last_clean":"2023-11-04T01:42:26.281467+0000","last_became_active":"2023-11-04T01:42:24.679830+0000","last_became_peered":"2023-11-04T01:42:24.679830+0000","last_unstale":"2023-11-04T01:42:26.281467+0000","last_undegraded":"2023-11-04T01:42:26.281467+0000","last_fullsized":"2023-11-04T01:42:26.281467+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:05:41.792046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"65'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.270797+0000","last_change":"2023-11-04T01:42:23.667634+0000","last_active":"2023-11-04T01:42:26.270797+0000","last_peered":"2023-11-04T01:42:26.270797+0000","last_clean":"2023-11-04T01:42:26.270797+0000","last_became_active":"2023-11-04T01:42:23.667348+0000","last_became_peered":"2023-11-04T01:42:23.667348+0000","last_unstale":"2023-11-04T01:42:26.270797+0000","last_undegraded":"2023-11-04T01:42:26.270797+0000","last_fullsized":"2023-11-04T01:42:26.270797+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:20.012006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":35,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.677472+0000","last_change":"2023-11-04T01:41:35.931929+0000","last_active":"2023-11-04T01:42:24.677472+0000","last_peered":"2023-11-04T01:42:24.677472+0000","last_clean":"2023-11-04T01:42:24.677472+0000","last_became_active":"2023-11-04T01:41:34.738795+0000","last_became_peered":"2023-11-04T01:41:34.738795+0000","last_unstale":"2023-11-04T01:42:24.677472+0000","last_undegraded":"2023-11-04T01:42:24.677472+0000","last_fullsized":"2023-11-04T01:42:24.677472+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:59.608410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046204999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.661707+0000","last_change":"2023-11-04T01:42:24.675053+0000","last_active":"2023-11-04T01:42:25.661707+0000","last_peered":"2023-11-04T01:42:25.661707+0000","last_clean":"2023-11-04T01:42:25.661707+0000","last_became_active":"2023-11-04T01:42:24.674699+0000","last_became_peered":"2023-11-04T01:42:24.674699+0000","last_unstale":"2023-11-04T01:42:25.661707+0000","last_undegraded":"2023-11-04T01:42:25.661707+0000","last_fullsized":"2023-11-04T01:42:25.661707+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:24:17.420867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"65'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.237180+0000","last_change":"2023-11-04T01:42:23.671431+0000","last_active":"2023-11-04T01:42:26.237180+0000","last_peered":"2023-11-04T01:42:26.237180+0000","last_clean":"2023-11-04T01:42:26.237180+0000","last_became_active":"2023-11-04T01:42:23.671121+0000","last_became_peered":"2023-11-04T01:42:23.671121+0000","last_unstale":"2023-11-04T01:42:26.237180+0000","last_undegraded":"2023-11-04T01:42:26.237180+0000","last_fullsized":"2023-11-04T01:42:26.237180+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:18:19.002807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":41,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.664005+0000","last_change":"2023-11-04T01:41:35.728945+0000","last_active":"2023-11-04T01:42:24.664005+0000","last_peered":"2023-11-04T01:42:24.664005+0000","last_clean":"2023-11-04T01:42:24.664005+0000","last_became_active":"2023-11-04T01:41:34.735082+0000","last_became_peered":"2023-11-04T01:41:34.735082+0000","last_unstale":"2023-11-04T01:42:24.664005+0000","last_undegraded":"2023-11-04T01:42:24.664005+0000","last_fullsized":"2023-11-04T01:42:24.664005+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:16.970814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079093000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.237043+0000","last_change":"2023-11-04T01:42:24.681501+0000","last_active":"2023-11-04T01:42:26.237043+0000","last_peered":"2023-11-04T01:42:26.237043+0000","last_clean":"2023-11-04T01:42:26.237043+0000","last_became_active":"2023-11-04T01:42:24.681199+0000","last_became_peered":"2023-11-04T01:42:24.681199+0000","last_unstale":"2023-11-04T01:42:26.237043+0000","last_undegraded":"2023-11-04T01:42:26.237043+0000","last_fullsized":"2023-11-04T01:42:26.237043+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:23:00.670603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"65'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.281835+0000","last_change":"2023-11-04T01:42:23.670257+0000","last_active":"2023-11-04T01:42:26.281835+0000","last_peered":"2023-11-04T01:42:26.281835+0000","last_clean":"2023-11-04T01:42:26.281835+0000","last_became_active":"2023-11-04T01:42:23.669974+0000","last_became_peered":"2023-11-04T01:42:23.669974+0000","last_unstale":"2023-11-04T01:42:26.281835+0000","last_undegraded":"2023-11-04T01:42:26.281835+0000","last_fullsized":"2023-11-04T01:42:26.281835+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:45.490508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.662322+0000","last_change":"2023-11-04T01:41:35.728625+0000","last_active":"2023-11-04T01:42:24.662322+0000","last_peered":"2023-11-04T01:42:24.662322+0000","last_clean":"2023-11-04T01:42:24.662322+0000","last_became_active":"2023-11-04T01:41:34.731514+0000","last_became_peered":"2023-11-04T01:41:34.731514+0000","last_unstale":"2023-11-04T01:42:24.662322+0000","last_undegraded":"2023-11-04T01:42:24.662322+0000","last_fullsized":"2023-11-04T01:42:24.662322+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:51:50.413223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047686400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.661314+0000","last_change":"2023-11-04T01:42:24.680590+0000","last_active":"2023-11-04T01:42:25.661314+0000","last_peered":"2023-11-04T01:42:25.661314+0000","last_clean":"2023-11-04T01:42:25.661314+0000","last_became_active":"2023-11-04T01:42:24.680294+0000","last_became_peered":"2023-11-04T01:42:24.680294+0000","last_unstale":"2023-11-04T01:42:25.661314+0000","last_undegraded":"2023-11-04T01:42:25.661314+0000","last_fullsized":"2023-11-04T01:42:25.661314+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:38:08.449615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"65'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.660041+0000","last_change":"2023-11-04T01:42:23.669215+0000","last_active":"2023-11-04T01:42:25.660041+0000","last_peered":"2023-11-04T01:42:25.660041+0000","last_clean":"2023-11-04T01:42:25.660041+0000","last_became_active":"2023-11-04T01:42:23.668942+0000","last_became_peered":"2023-11-04T01:42:23.668942+0000","last_unstale":"2023-11-04T01:42:25.660041+0000","last_undegraded":"2023-11-04T01:42:25.660041+0000","last_fullsized":"2023-11-04T01:42:25.660041+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:44:08.060572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.659485+0000","last_change":"2023-11-04T01:41:36.343762+0000","last_active":"2023-11-04T01:42:24.659485+0000","last_peered":"2023-11-04T01:42:24.659485+0000","last_clean":"2023-11-04T01:42:24.659485+0000","last_became_active":"2023-11-04T01:41:34.733406+0000","last_became_peered":"2023-11-04T01:41:34.733406+0000","last_unstale":"2023-11-04T01:42:24.659485+0000","last_undegraded":"2023-11-04T01:42:24.659485+0000","last_fullsized":"2023-11-04T01:42:24.659485+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:34:35.541159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058533399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.661651+0000","last_change":"2023-11-04T01:42:24.677694+0000","last_active":"2023-11-04T01:42:25.661651+0000","last_peered":"2023-11-04T01:42:25.661651+0000","last_clean":"2023-11-04T01:42:25.661651+0000","last_became_active":"2023-11-04T01:42:24.677419+0000","last_became_peered":"2023-11-04T01:42:24.677419+0000","last_unstale":"2023-11-04T01:42:25.661651+0000","last_undegraded":"2023-11-04T01:42:25.661651+0000","last_fullsized":"2023-11-04T01:42:25.661651+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:59:33.999093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"65'4","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.661826+0000","last_change":"2023-11-04T01:42:23.662871+0000","last_active":"2023-11-04T01:42:25.661826+0000","last_peered":"2023-11-04T01:42:25.661826+0000","last_clean":"2023-11-04T01:42:25.661826+0000","last_became_active":"2023-11-04T01:42:23.662572+0000","last_became_peered":"2023-11-04T01:42:23.662572+0000","last_unstale":"2023-11-04T01:42:25.661826+0000","last_undegraded":"2023-11-04T01:42:25.661826+0000","last_fullsized":"2023-11-04T01:42:25.661826+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:01:24.160393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":35,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.672954+0000","last_change":"2023-11-04T01:41:35.906297+0000","last_active":"2023-11-04T01:42:24.672954+0000","last_peered":"2023-11-04T01:42:24.672954+0000","last_clean":"2023-11-04T01:42:24.672954+0000","last_became_active":"2023-11-04T01:41:34.734134+0000","last_became_peered":"2023-11-04T01:41:34.734134+0000","last_unstale":"2023-11-04T01:42:24.672954+0000","last_undegraded":"2023-11-04T01:42:24.672954+0000","last_fullsized":"2023-11-04T01:42:24.672954+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:52.597063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087104900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.236491+0000","last_change":"2023-11-04T01:42:24.686615+0000","last_active":"2023-11-04T01:42:26.236491+0000","last_peered":"2023-11-04T01:42:26.236491+0000","last_clean":"2023-11-04T01:42:26.236491+0000","last_became_active":"2023-11-04T01:42:24.686183+0000","last_became_peered":"2023-11-04T01:42:24.686183+0000","last_unstale":"2023-11-04T01:42:26.236491+0000","last_undegraded":"2023-11-04T01:42:26.236491+0000","last_fullsized":"2023-11-04T01:42:26.236491+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:49:08.332268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.236856+0000","last_change":"2023-11-04T01:42:23.667567+0000","last_active":"2023-11-04T01:42:26.236856+0000","last_peered":"2023-11-04T01:42:26.236856+0000","last_clean":"2023-11-04T01:42:26.236856+0000","last_became_active":"2023-11-04T01:42:23.667207+0000","last_became_peered":"2023-11-04T01:42:23.667207+0000","last_unstale":"2023-11-04T01:42:26.236856+0000","last_undegraded":"2023-11-04T01:42:26.236856+0000","last_fullsized":"2023-11-04T01:42:26.236856+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:44:32.155572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":35,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.670486+0000","last_change":"2023-11-04T01:41:35.906596+0000","last_active":"2023-11-04T01:42:24.670486+0000","last_peered":"2023-11-04T01:42:24.670486+0000","last_clean":"2023-11-04T01:42:24.670486+0000","last_became_active":"2023-11-04T01:41:34.738529+0000","last_became_peered":"2023-11-04T01:41:34.738529+0000","last_unstale":"2023-11-04T01:42:24.670486+0000","last_undegraded":"2023-11-04T01:42:24.670486+0000","last_fullsized":"2023-11-04T01:42:24.670486+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:48.121273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086660600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.740425+0000","last_change":"2023-11-04T01:42:24.675167+0000","last_active":"2023-11-04T01:42:25.740425+0000","last_peered":"2023-11-04T01:42:25.740425+0000","last_clean":"2023-11-04T01:42:25.740425+0000","last_became_active":"2023-11-04T01:42:24.674923+0000","last_became_peered":"2023-11-04T01:42:24.674923+0000","last_unstale":"2023-11-04T01:42:25.740425+0000","last_undegraded":"2023-11-04T01:42:25.740425+0000","last_fullsized":"2023-11-04T01:42:25.740425+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:32:59.831945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.281205+0000","last_change":"2023-11-04T01:42:23.672875+0000","last_active":"2023-11-04T01:42:26.281205+0000","last_peered":"2023-11-04T01:42:26.281205+0000","last_clean":"2023-11-04T01:42:26.281205+0000","last_became_active":"2023-11-04T01:42:23.672421+0000","last_became_peered":"2023-11-04T01:42:23.672421+0000","last_unstale":"2023-11-04T01:42:26.281205+0000","last_undegraded":"2023-11-04T01:42:26.281205+0000","last_fullsized":"2023-11-04T01:42:26.281205+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:46:59.014740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":35,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.672972+0000","last_change":"2023-11-04T01:41:35.906430+0000","last_active":"2023-11-04T01:42:24.672972+0000","last_peered":"2023-11-04T01:42:24.672972+0000","last_clean":"2023-11-04T01:42:24.672972+0000","last_became_active":"2023-11-04T01:41:34.741147+0000","last_became_peered":"2023-11-04T01:41:34.741147+0000","last_unstale":"2023-11-04T01:42:24.672972+0000","last_undegraded":"2023-11-04T01:42:24.672972+0000","last_fullsized":"2023-11-04T01:42:24.672972+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:20.089706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090504400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.236763+0000","last_change":"2023-11-04T01:42:24.680481+0000","last_active":"2023-11-04T01:42:26.236763+0000","last_peered":"2023-11-04T01:42:26.236763+0000","last_clean":"2023-11-04T01:42:26.236763+0000","last_became_active":"2023-11-04T01:42:24.680193+0000","last_became_peered":"2023-11-04T01:42:24.680193+0000","last_unstale":"2023-11-04T01:42:26.236763+0000","last_undegraded":"2023-11-04T01:42:26.236763+0000","last_fullsized":"2023-11-04T01:42:26.236763+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:40:27.967590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.740297+0000","last_change":"2023-11-04T01:42:23.665691+0000","last_active":"2023-11-04T01:42:25.740297+0000","last_peered":"2023-11-04T01:42:25.740297+0000","last_clean":"2023-11-04T01:42:25.740297+0000","last_became_active":"2023-11-04T01:42:23.665391+0000","last_became_peered":"2023-11-04T01:42:23.665391+0000","last_unstale":"2023-11-04T01:42:25.740297+0000","last_undegraded":"2023-11-04T01:42:25.740297+0000","last_fullsized":"2023-11-04T01:42:25.740297+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:20:49.913421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.659436+0000","last_change":"2023-11-04T01:41:36.344408+0000","last_active":"2023-11-04T01:42:24.659436+0000","last_peered":"2023-11-04T01:42:24.659436+0000","last_clean":"2023-11-04T01:42:24.659436+0000","last_became_active":"2023-11-04T01:41:34.730735+0000","last_became_peered":"2023-11-04T01:41:34.730735+0000","last_unstale":"2023-11-04T01:42:24.659436+0000","last_undegraded":"2023-11-04T01:42:24.659436+0000","last_fullsized":"2023-11-04T01:42:24.659436+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:10:58.095232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081464299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.660940+0000","last_change":"2023-11-04T01:42:24.675335+0000","last_active":"2023-11-04T01:42:25.660940+0000","last_peered":"2023-11-04T01:42:25.660940+0000","last_clean":"2023-11-04T01:42:25.660940+0000","last_became_active":"2023-11-04T01:42:24.675064+0000","last_became_peered":"2023-11-04T01:42:24.675064+0000","last_unstale":"2023-11-04T01:42:25.660940+0000","last_undegraded":"2023-11-04T01:42:25.660940+0000","last_fullsized":"2023-11-04T01:42:25.660940+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:32:43.337265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.660852+0000","last_change":"2023-11-04T01:42:23.664478+0000","last_active":"2023-11-04T01:42:25.660852+0000","last_peered":"2023-11-04T01:42:25.660852+0000","last_clean":"2023-11-04T01:42:25.660852+0000","last_became_active":"2023-11-04T01:42:23.664202+0000","last_became_peered":"2023-11-04T01:42:23.664202+0000","last_unstale":"2023-11-04T01:42:25.660852+0000","last_undegraded":"2023-11-04T01:42:25.660852+0000","last_fullsized":"2023-11-04T01:42:25.660852+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:38:47.708313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":39,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.668237+0000","last_change":"2023-11-04T01:41:36.244245+0000","last_active":"2023-11-04T01:42:24.668237+0000","last_peered":"2023-11-04T01:42:24.668237+0000","last_clean":"2023-11-04T01:42:24.668237+0000","last_became_active":"2023-11-04T01:41:34.734925+0000","last_became_peered":"2023-11-04T01:41:34.734925+0000","last_unstale":"2023-11-04T01:42:24.668237+0000","last_undegraded":"2023-11-04T01:42:24.668237+0000","last_fullsized":"2023-11-04T01:42:24.668237+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:44.193748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025350200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.661491+0000","last_change":"2023-11-04T01:42:24.683850+0000","last_active":"2023-11-04T01:42:25.661491+0000","last_peered":"2023-11-04T01:42:25.661491+0000","last_clean":"2023-11-04T01:42:25.661491+0000","last_became_active":"2023-11-04T01:42:24.683471+0000","last_became_peered":"2023-11-04T01:42:24.683471+0000","last_unstale":"2023-11-04T01:42:25.661491+0000","last_undegraded":"2023-11-04T01:42:25.661491+0000","last_fullsized":"2023-11-04T01:42:25.661491+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:23:37.634543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.660012+0000","last_change":"2023-11-04T01:42:23.669866+0000","last_active":"2023-11-04T01:42:25.660012+0000","last_peered":"2023-11-04T01:42:25.660012+0000","last_clean":"2023-11-04T01:42:25.660012+0000","last_became_active":"2023-11-04T01:42:23.669608+0000","last_became_peered":"2023-11-04T01:42:23.669608+0000","last_unstale":"2023-11-04T01:42:25.660012+0000","last_undegraded":"2023-11-04T01:42:25.660012+0000","last_fullsized":"2023-11-04T01:42:25.660012+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:36.766111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.659674+0000","last_change":"2023-11-04T01:41:36.343956+0000","last_active":"2023-11-04T01:42:24.659674+0000","last_peered":"2023-11-04T01:42:24.659674+0000","last_clean":"2023-11-04T01:42:24.659674+0000","last_became_active":"2023-11-04T01:41:34.736013+0000","last_became_peered":"2023-11-04T01:41:34.736013+0000","last_unstale":"2023-11-04T01:42:24.659674+0000","last_undegraded":"2023-11-04T01:42:24.659674+0000","last_fullsized":"2023-11-04T01:42:24.659674+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:08.858430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081427799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.661299+0000","last_change":"2023-11-04T01:42:24.679629+0000","last_active":"2023-11-04T01:42:25.661299+0000","last_peered":"2023-11-04T01:42:25.661299+0000","last_clean":"2023-11-04T01:42:25.661299+0000","last_became_active":"2023-11-04T01:42:24.679284+0000","last_became_peered":"2023-11-04T01:42:24.679284+0000","last_unstale":"2023-11-04T01:42:25.661299+0000","last_undegraded":"2023-11-04T01:42:25.661299+0000","last_fullsized":"2023-11-04T01:42:25.661299+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:44:09.067211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.661176+0000","last_change":"2023-11-04T01:42:23.667062+0000","last_active":"2023-11-04T01:42:25.661176+0000","last_peered":"2023-11-04T01:42:25.661176+0000","last_clean":"2023-11-04T01:42:25.661176+0000","last_became_active":"2023-11-04T01:42:23.666763+0000","last_became_peered":"2023-11-04T01:42:23.666763+0000","last_unstale":"2023-11-04T01:42:25.661176+0000","last_undegraded":"2023-11-04T01:42:25.661176+0000","last_fullsized":"2023-11-04T01:42:25.661176+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:31:52.594542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":39,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.667411+0000","last_change":"2023-11-04T01:41:36.243977+0000","last_active":"2023-11-04T01:42:24.667411+0000","last_peered":"2023-11-04T01:42:24.667411+0000","last_clean":"2023-11-04T01:42:24.667411+0000","last_became_active":"2023-11-04T01:41:34.733127+0000","last_became_peered":"2023-11-04T01:41:34.733127+0000","last_unstale":"2023-11-04T01:42:24.667411+0000","last_undegraded":"2023-11-04T01:42:24.667411+0000","last_fullsized":"2023-11-04T01:42:24.667411+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:36.118907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051788300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.281976+0000","last_change":"2023-11-04T01:42:24.679074+0000","last_active":"2023-11-04T01:42:26.281976+0000","last_peered":"2023-11-04T01:42:26.281976+0000","last_clean":"2023-11-04T01:42:26.281976+0000","last_became_active":"2023-11-04T01:42:24.678812+0000","last_became_peered":"2023-11-04T01:42:24.678812+0000","last_unstale":"2023-11-04T01:42:26.281976+0000","last_undegraded":"2023-11-04T01:42:26.281976+0000","last_fullsized":"2023-11-04T01:42:26.281976+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:19:01.258080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.674300+0000","last_change":"2023-11-04T01:42:23.665020+0000","last_active":"2023-11-04T01:42:24.674300+0000","last_peered":"2023-11-04T01:42:24.674300+0000","last_clean":"2023-11-04T01:42:24.674300+0000","last_became_active":"2023-11-04T01:42:23.664751+0000","last_became_peered":"2023-11-04T01:42:23.664751+0000","last_unstale":"2023-11-04T01:42:24.674300+0000","last_undegraded":"2023-11-04T01:42:24.674300+0000","last_fullsized":"2023-11-04T01:42:24.674300+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:50:31.579987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.664212+0000","last_change":"2023-11-04T01:41:36.067797+0000","last_active":"2023-11-04T01:42:24.664212+0000","last_peered":"2023-11-04T01:42:24.664212+0000","last_clean":"2023-11-04T01:42:24.664212+0000","last_became_active":"2023-11-04T01:41:34.734880+0000","last_became_peered":"2023-11-04T01:41:34.734880+0000","last_unstale":"2023-11-04T01:42:24.664212+0000","last_undegraded":"2023-11-04T01:42:24.664212+0000","last_fullsized":"2023-11-04T01:42:24.664212+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:20.089706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036003499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.660037+0000","last_change":"2023-11-04T01:42:24.670000+0000","last_active":"2023-11-04T01:42:25.660037+0000","last_peered":"2023-11-04T01:42:25.660037+0000","last_clean":"2023-11-04T01:42:25.660037+0000","last_became_active":"2023-11-04T01:42:24.669694+0000","last_became_peered":"2023-11-04T01:42:24.669694+0000","last_unstale":"2023-11-04T01:42:25.660037+0000","last_undegraded":"2023-11-04T01:42:25.660037+0000","last_fullsized":"2023-11-04T01:42:25.660037+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:24:17.420867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"65'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.237277+0000","last_change":"2023-11-04T01:42:23.663209+0000","last_active":"2023-11-04T01:42:26.237277+0000","last_peered":"2023-11-04T01:42:26.237277+0000","last_clean":"2023-11-04T01:42:26.237277+0000","last_became_active":"2023-11-04T01:42:23.662949+0000","last_became_peered":"2023-11-04T01:42:23.662949+0000","last_unstale":"2023-11-04T01:42:26.237277+0000","last_undegraded":"2023-11-04T01:42:26.237277+0000","last_fullsized":"2023-11-04T01:42:26.237277+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:12:43.021307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.663055+0000","last_change":"2023-11-04T01:41:35.729089+0000","last_active":"2023-11-04T01:42:24.663055+0000","last_peered":"2023-11-04T01:42:24.663055+0000","last_clean":"2023-11-04T01:42:24.663055+0000","last_became_active":"2023-11-04T01:41:34.731063+0000","last_became_peered":"2023-11-04T01:41:34.731063+0000","last_unstale":"2023-11-04T01:42:24.663055+0000","last_undegraded":"2023-11-04T01:42:24.663055+0000","last_fullsized":"2023-11-04T01:42:24.663055+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:38:46.633175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083653600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.270675+0000","last_change":"2023-11-04T01:42:24.682590+0000","last_active":"2023-11-04T01:42:26.270675+0000","last_peered":"2023-11-04T01:42:26.270675+0000","last_clean":"2023-11-04T01:42:26.270675+0000","last_became_active":"2023-11-04T01:42:24.682309+0000","last_became_peered":"2023-11-04T01:42:24.682309+0000","last_unstale":"2023-11-04T01:42:26.270675+0000","last_undegraded":"2023-11-04T01:42:26.270675+0000","last_fullsized":"2023-11-04T01:42:26.270675+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:08:18.202465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.659740+0000","last_change":"2023-11-04T01:42:23.667693+0000","last_active":"2023-11-04T01:42:25.659740+0000","last_peered":"2023-11-04T01:42:25.659740+0000","last_clean":"2023-11-04T01:42:25.659740+0000","last_became_active":"2023-11-04T01:42:23.667442+0000","last_became_peered":"2023-11-04T01:42:23.667442+0000","last_unstale":"2023-11-04T01:42:25.659740+0000","last_undegraded":"2023-11-04T01:42:25.659740+0000","last_fullsized":"2023-11-04T01:42:25.659740+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:39:30.978971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":41,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.665489+0000","last_change":"2023-11-04T01:41:35.729232+0000","last_active":"2023-11-04T01:42:24.665489+0000","last_peered":"2023-11-04T01:42:24.665489+0000","last_clean":"2023-11-04T01:42:24.665489+0000","last_became_active":"2023-11-04T01:41:34.731490+0000","last_became_peered":"2023-11-04T01:41:34.731490+0000","last_unstale":"2023-11-04T01:42:24.665489+0000","last_undegraded":"2023-11-04T01:42:24.665489+0000","last_fullsized":"2023-11-04T01:42:24.665489+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:37.958719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089653699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.270622+0000","last_change":"2023-11-04T01:42:24.683167+0000","last_active":"2023-11-04T01:42:26.270622+0000","last_peered":"2023-11-04T01:42:26.270622+0000","last_clean":"2023-11-04T01:42:26.270622+0000","last_became_active":"2023-11-04T01:42:24.682922+0000","last_became_peered":"2023-11-04T01:42:24.682922+0000","last_unstale":"2023-11-04T01:42:26.270622+0000","last_undegraded":"2023-11-04T01:42:26.270622+0000","last_fullsized":"2023-11-04T01:42:26.270622+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:41:29.820820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.670871+0000","last_change":"2023-11-04T01:42:23.660971+0000","last_active":"2023-11-04T01:42:24.670871+0000","last_peered":"2023-11-04T01:42:24.670871+0000","last_clean":"2023-11-04T01:42:24.670871+0000","last_became_active":"2023-11-04T01:42:23.660570+0000","last_became_peered":"2023-11-04T01:42:23.660570+0000","last_unstale":"2023-11-04T01:42:24.670871+0000","last_undegraded":"2023-11-04T01:42:24.670871+0000","last_fullsized":"2023-11-04T01:42:24.670871+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:50:59.289771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.659850+0000","last_change":"2023-11-04T01:41:36.344018+0000","last_active":"2023-11-04T01:42:24.659850+0000","last_peered":"2023-11-04T01:42:24.659850+0000","last_clean":"2023-11-04T01:42:24.659850+0000","last_became_active":"2023-11-04T01:41:34.734178+0000","last_became_peered":"2023-11-04T01:41:34.734178+0000","last_unstale":"2023-11-04T01:42:24.659850+0000","last_undegraded":"2023-11-04T01:42:24.659850+0000","last_fullsized":"2023-11-04T01:42:24.659850+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:16.970814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077338299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.270707+0000","last_change":"2023-11-04T01:42:24.669973+0000","last_active":"2023-11-04T01:42:26.270707+0000","last_peered":"2023-11-04T01:42:26.270707+0000","last_clean":"2023-11-04T01:42:26.270707+0000","last_became_active":"2023-11-04T01:42:24.669702+0000","last_became_peered":"2023-11-04T01:42:24.669702+0000","last_unstale":"2023-11-04T01:42:26.270707+0000","last_undegraded":"2023-11-04T01:42:26.270707+0000","last_fullsized":"2023-11-04T01:42:26.270707+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:18.909394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.236747+0000","last_change":"2023-11-04T01:42:23.670382+0000","last_active":"2023-11-04T01:42:26.236747+0000","last_peered":"2023-11-04T01:42:26.236747+0000","last_clean":"2023-11-04T01:42:26.236747+0000","last_became_active":"2023-11-04T01:42:23.669480+0000","last_became_peered":"2023-11-04T01:42:23.669480+0000","last_unstale":"2023-11-04T01:42:26.236747+0000","last_undegraded":"2023-11-04T01:42:26.236747+0000","last_fullsized":"2023-11-04T01:42:26.236747+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:46:59.014740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":35,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.670060+0000","last_change":"2023-11-04T01:41:35.906788+0000","last_active":"2023-11-04T01:42:24.670060+0000","last_peered":"2023-11-04T01:42:24.670060+0000","last_clean":"2023-11-04T01:42:24.670060+0000","last_became_active":"2023-11-04T01:41:34.734386+0000","last_became_peered":"2023-11-04T01:41:34.734386+0000","last_unstale":"2023-11-04T01:42:24.670060+0000","last_undegraded":"2023-11-04T01:42:24.670060+0000","last_fullsized":"2023-11-04T01:42:24.670060+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:23:23.733128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060435600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.661110+0000","last_change":"2023-11-04T01:42:24.688196+0000","last_active":"2023-11-04T01:42:25.661110+0000","last_peered":"2023-11-04T01:42:25.661110+0000","last_clean":"2023-11-04T01:42:25.661110+0000","last_became_active":"2023-11-04T01:42:24.687882+0000","last_became_peered":"2023-11-04T01:42:24.687882+0000","last_unstale":"2023-11-04T01:42:25.661110+0000","last_undegraded":"2023-11-04T01:42:25.661110+0000","last_fullsized":"2023-11-04T01:42:25.661110+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:36:22.800149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.661385+0000","last_change":"2023-11-04T01:42:23.666898+0000","last_active":"2023-11-04T01:42:25.661385+0000","last_peered":"2023-11-04T01:42:25.661385+0000","last_clean":"2023-11-04T01:42:25.661385+0000","last_became_active":"2023-11-04T01:42:23.666589+0000","last_became_peered":"2023-11-04T01:42:23.666589+0000","last_unstale":"2023-11-04T01:42:25.661385+0000","last_undegraded":"2023-11-04T01:42:25.661385+0000","last_fullsized":"2023-11-04T01:42:25.661385+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:00:23.345186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":35,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.678459+0000","last_change":"2023-11-04T01:41:35.931718+0000","last_active":"2023-11-04T01:42:24.678459+0000","last_peered":"2023-11-04T01:42:24.678459+0000","last_clean":"2023-11-04T01:42:24.678459+0000","last_became_active":"2023-11-04T01:41:34.741033+0000","last_became_peered":"2023-11-04T01:41:34.741033+0000","last_unstale":"2023-11-04T01:42:24.678459+0000","last_undegraded":"2023-11-04T01:42:24.678459+0000","last_fullsized":"2023-11-04T01:42:24.678459+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:48.121273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065858400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.740619+0000","last_change":"2023-11-04T01:42:24.674522+0000","last_active":"2023-11-04T01:42:25.740619+0000","last_peered":"2023-11-04T01:42:25.740619+0000","last_clean":"2023-11-04T01:42:25.740619+0000","last_became_active":"2023-11-04T01:42:24.674206+0000","last_became_peered":"2023-11-04T01:42:24.674206+0000","last_unstale":"2023-11-04T01:42:25.740619+0000","last_undegraded":"2023-11-04T01:42:25.740619+0000","last_fullsized":"2023-11-04T01:42:25.740619+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:44:33.162210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"65'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.236912+0000","last_change":"2023-11-04T01:42:23.666159+0000","last_active":"2023-11-04T01:42:26.236912+0000","last_peered":"2023-11-04T01:42:26.236912+0000","last_clean":"2023-11-04T01:42:26.236912+0000","last_became_active":"2023-11-04T01:42:23.665886+0000","last_became_peered":"2023-11-04T01:42:23.665886+0000","last_unstale":"2023-11-04T01:42:26.236912+0000","last_undegraded":"2023-11-04T01:42:26.236912+0000","last_fullsized":"2023-11-04T01:42:26.236912+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:57:29.058454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":34,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.670278+0000","last_change":"2023-11-04T01:41:35.728094+0000","last_active":"2023-11-04T01:42:24.670278+0000","last_peered":"2023-11-04T01:42:24.670278+0000","last_clean":"2023-11-04T01:42:24.670278+0000","last_became_active":"2023-11-04T01:41:34.738687+0000","last_became_peered":"2023-11-04T01:41:34.738687+0000","last_unstale":"2023-11-04T01:42:24.670278+0000","last_undegraded":"2023-11-04T01:42:24.670278+0000","last_fullsized":"2023-11-04T01:42:24.670278+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:37.958719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068772699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.661710+0000","last_change":"2023-11-04T01:42:24.669907+0000","last_active":"2023-11-04T01:42:25.661710+0000","last_peered":"2023-11-04T01:42:25.661710+0000","last_clean":"2023-11-04T01:42:25.661710+0000","last_became_active":"2023-11-04T01:42:24.669623+0000","last_became_peered":"2023-11-04T01:42:24.669623+0000","last_unstale":"2023-11-04T01:42:25.661710+0000","last_undegraded":"2023-11-04T01:42:25.661710+0000","last_fullsized":"2023-11-04T01:42:25.661710+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:21.018644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"65'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.281952+0000","last_change":"2023-11-04T01:42:23.670000+0000","last_active":"2023-11-04T01:42:26.281952+0000","last_peered":"2023-11-04T01:42:26.281952+0000","last_clean":"2023-11-04T01:42:26.281952+0000","last_became_active":"2023-11-04T01:42:23.669688+0000","last_became_peered":"2023-11-04T01:42:23.669688+0000","last_unstale":"2023-11-04T01:42:26.281952+0000","last_undegraded":"2023-11-04T01:42:26.281952+0000","last_fullsized":"2023-11-04T01:42:26.281952+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:57:29.058454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.662854+0000","last_change":"2023-11-04T01:41:35.729106+0000","last_active":"2023-11-04T01:42:24.662854+0000","last_peered":"2023-11-04T01:42:24.662854+0000","last_clean":"2023-11-04T01:42:24.662854+0000","last_became_active":"2023-11-04T01:41:34.731230+0000","last_became_peered":"2023-11-04T01:41:34.731230+0000","last_unstale":"2023-11-04T01:42:24.662854+0000","last_undegraded":"2023-11-04T01:42:24.662854+0000","last_fullsized":"2023-11-04T01:42:24.662854+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:07:32.744572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078592199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.282100+0000","last_change":"2023-11-04T01:42:24.687435+0000","last_active":"2023-11-04T01:42:26.282100+0000","last_peered":"2023-11-04T01:42:26.282100+0000","last_clean":"2023-11-04T01:42:26.282100+0000","last_became_active":"2023-11-04T01:42:24.687060+0000","last_became_peered":"2023-11-04T01:42:24.687060+0000","last_unstale":"2023-11-04T01:42:26.282100+0000","last_undegraded":"2023-11-04T01:42:26.282100+0000","last_fullsized":"2023-11-04T01:42:26.282100+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:40:27.967590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"65'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.237142+0000","last_change":"2023-11-04T01:42:23.663997+0000","last_active":"2023-11-04T01:42:26.237142+0000","last_peered":"2023-11-04T01:42:26.237142+0000","last_clean":"2023-11-04T01:42:26.237142+0000","last_became_active":"2023-11-04T01:42:23.663752+0000","last_became_peered":"2023-11-04T01:42:23.663752+0000","last_unstale":"2023-11-04T01:42:26.237142+0000","last_undegraded":"2023-11-04T01:42:26.237142+0000","last_fullsized":"2023-11-04T01:42:26.237142+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:52:47.508878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.663127+0000","last_change":"2023-11-04T01:41:35.728672+0000","last_active":"2023-11-04T01:42:24.663127+0000","last_peered":"2023-11-04T01:42:24.663127+0000","last_clean":"2023-11-04T01:42:24.663127+0000","last_became_active":"2023-11-04T01:41:34.727419+0000","last_became_peered":"2023-11-04T01:41:34.727419+0000","last_unstale":"2023-11-04T01:42:24.663127+0000","last_undegraded":"2023-11-04T01:42:24.663127+0000","last_fullsized":"2023-11-04T01:42:24.663127+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:35:01.127206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044278299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.270693+0000","last_change":"2023-11-04T01:42:24.677302+0000","last_active":"2023-11-04T01:42:26.270693+0000","last_peered":"2023-11-04T01:42:26.270693+0000","last_clean":"2023-11-04T01:42:26.270693+0000","last_became_active":"2023-11-04T01:42:24.677025+0000","last_became_peered":"2023-11-04T01:42:24.677025+0000","last_unstale":"2023-11-04T01:42:26.270693+0000","last_undegraded":"2023-11-04T01:42:26.270693+0000","last_fullsized":"2023-11-04T01:42:26.270693+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:22:06.846529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"65'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.236739+0000","last_change":"2023-11-04T01:42:23.671562+0000","last_active":"2023-11-04T01:42:26.236739+0000","last_peered":"2023-11-04T01:42:26.236739+0000","last_clean":"2023-11-04T01:42:26.236739+0000","last_became_active":"2023-11-04T01:42:23.671333+0000","last_became_peered":"2023-11-04T01:42:23.671333+0000","last_unstale":"2023-11-04T01:42:26.236739+0000","last_undegraded":"2023-11-04T01:42:26.236739+0000","last_fullsized":"2023-11-04T01:42:26.236739+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:32:58.825306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.659908+0000","last_change":"2023-11-04T01:41:36.344271+0000","last_active":"2023-11-04T01:42:24.659908+0000","last_peered":"2023-11-04T01:42:24.659908+0000","last_clean":"2023-11-04T01:42:24.659908+0000","last_became_active":"2023-11-04T01:41:34.732524+0000","last_became_peered":"2023-11-04T01:41:34.732524+0000","last_unstale":"2023-11-04T01:42:24.659908+0000","last_undegraded":"2023-11-04T01:42:24.659908+0000","last_fullsized":"2023-11-04T01:42:24.659908+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:19.350812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081160599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":212,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.662799+0000","last_change":"2023-11-04T01:39:54.204460+0000","last_active":"2023-11-04T01:42:24.662799+0000","last_peered":"2023-11-04T01:42:24.662799+0000","last_clean":"2023-11-04T01:42:24.662799+0000","last_became_active":"2023-11-04T01:39:54.203352+0000","last_became_peered":"2023-11-04T01:39:54.203352+0000","last_unstale":"2023-11-04T01:42:24.662799+0000","last_undegraded":"2023-11-04T01:42:24.662799+0000","last_fullsized":"2023-11-04T01:42:24.662799+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:52.627032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:52.627032+0000","last_clean_scrub_stamp":"2023-11-04T01:39:52.627032+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:17:18.474768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":370195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53500000000000003,"15min":0.53800000000000003},"min":{"1min":0.40400000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.70199999999999996,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.499,"15min":0.497},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.56599999999999995}]},{"osd":1,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55300000000000005,"15min":0.55200000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.71999999999999997,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.66500000000000004}]},{"osd":2,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57099999999999995,"15min":0.57499999999999996},"min":{"1min":0.375,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.752,"5min":1.177,"15min":1.177},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55000000000000004,"15min":0.55400000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.55000000000000004}]},{"osd":3,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.76200000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.63100000000000001,"15min":0.63600000000000001},"min":{"1min":0.49199999999999999,"5min":0.435,"15min":0.435},"max":{"1min":0.79800000000000004,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.629}]},{"osd":4,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.318,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77400000000000002,"5min":1.048,"15min":1.048},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.32900000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.60899999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.39100000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.438,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.71399999999999997,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.498}]},{"osd":7,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.56999999999999995,"15min":0.55900000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.442},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.627,"15min":0.624},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.47799999999999998}]}]},{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32548,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339292,"statfs":{"total":96636764160,"available":96603435008,"internally_reserved":0,"allocated":1400832,"data_stored":961089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.53200000000000003,"15min":0.51600000000000001},"min":{"1min":0.38100000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.67800000000000005}]},{"osd":1,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.42399999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83599999999999997,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.63200000000000001,"15min":0.61599999999999999},"min":{"1min":0.46800000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.5049999999999999,"5min":2.5049999999999999,"15min":2.5049999999999999},"last":0.59499999999999997}]},{"osd":2,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.59299999999999997,"15min":0.58499999999999996},"min":{"1min":0.42799999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.621,"15min":0.60399999999999998},"min":{"1min":0.50800000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.77500000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.58599999999999997,"15min":0.56499999999999995},"min":{"1min":0.40100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":3.2349999999999999,"5min":3.2349999999999999,"15min":3.2349999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.37,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79200000000000004,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.64800000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.5,"15min":0.48599999999999999},"min":{"1min":0.308,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.47999999999999998,"15min":0.46999999999999997},"min":{"1min":0.36599999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.436}]},{"osd":5,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.52400000000000002,"15min":0.503},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.55200000000000005,"15min":0.53000000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":2.4500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.46300000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.623,"15min":0.58899999999999997},"min":{"1min":0.39700000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":3.7850000000000001,"5min":3.7850000000000001,"15min":3.7850000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.56999999999999995,"15min":0.55400000000000005},"min":{"1min":0.39200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.53300000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":794624,"data_stored":363224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.40200000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.67100000000000004,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40000000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.64900000000000002,"5min":0.752,"15min":0.752},"last":0.54900000000000004}]},{"osd":1,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56100000000000005,"15min":0.56599999999999995},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.72899999999999998,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.38,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.53400000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.35299999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.69499999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57399999999999995,"15min":0.57899999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.67900000000000005,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.503}]},{"osd":3,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.47299999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.67400000000000004,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57999999999999996,"15min":0.57899999999999996},"min":{"1min":0.434,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.72799999999999998,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.64900000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.746,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.59999999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78800000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58499999999999996,"15min":0.58599999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77600000000000002,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.47699999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.749,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61599999999999999,"15min":0.621},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82399999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.626}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":370175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.505,"15min":0.502},"min":{"1min":0.32000000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66200000000000003,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51200000000000001,"15min":0.50800000000000001},"min":{"1min":0.33900000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.68700000000000006,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.495}]},{"osd":1,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.49099999999999999,"15min":0.48299999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.69899999999999995,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.42299999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.67300000000000004,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.60899999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.53900000000000003},"min":{"1min":0.40300000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71099999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53400000000000003,"15min":0.53500000000000003},"min":{"1min":0.41499999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.67700000000000005,"5min":0.873,"15min":0.873},"last":0.47999999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53300000000000003,"15min":0.53400000000000003},"min":{"1min":0.39200000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.69299999999999995,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.74299999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.41499999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.47999999999999998,"15min":0.48299999999999998},"min":{"1min":0.34100000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.50600000000000001,"15min":0.50900000000000001},"min":{"1min":0.371,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66500000000000004,"5min":0.745,"15min":0.745},"last":0.32600000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.49299999999999999,"15min":0.497},"min":{"1min":0.34499999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.72399999999999998,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.621},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.755,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.53900000000000003}]},{"osd":7,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.40699999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.751,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.378},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.34899999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.747,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.51100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574882,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":794624,"data_stored":363244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.31900000000000001,"15min":0.317},"min":{"1min":0.20599999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.32800000000000001,"15min":0.32200000000000001},"min":{"1min":0.23699999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.443}]},{"osd":1,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.36599999999999999,"15min":0.372},"min":{"1min":0.23899999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.48499999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.5},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.58699999999999997,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.48099999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.36799999999999999,"15min":0.36699999999999999},"min":{"1min":0.28199999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.52700000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.42199999999999999,"15min":0.42699999999999999},"min":{"1min":0.30299999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.50900000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.51800000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.81599999999999995,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58399999999999996,"15min":0.58799999999999997},"min":{"1min":0.40500000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.92300000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58699999999999997,"15min":0.59399999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79400000000000004,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.77900000000000003}]},{"osd":6,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57699999999999996,"15min":0.58099999999999996},"min":{"1min":0.373,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77100000000000002,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60999999999999999,"15min":0.61599999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85199999999999998,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.89900000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.626,"15min":0.628},"min":{"1min":0.46400000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58599999999999997,"15min":0.58899999999999997},"min":{"1min":0.40000000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83199999999999996,"5min":0.87,"15min":0.87},"last":0.73699999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":811008,"data_stored":371717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.32000000000000001,"15min":0.32200000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"last":0.498},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.311}]},{"osd":1,"last update":"Sat Nov 4 01:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.36899999999999999,"15min":0.371},"min":{"1min":0.245,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.373,"15min":0.378},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.42199999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.42199999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.34999999999999998,"15min":0.35499999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.46600000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.371},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.29499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.44900000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.55500000000000005,"15min":0.54700000000000004},"min":{"1min":0.41599999999999998,"5min":0.374,"15min":0.374},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.64000000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.378,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.622},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.41499999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.75}]},{"osd":6,"last update":"Sat Nov 4 01:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58299999999999996,"15min":0.57999999999999996},"min":{"1min":0.43099999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.55900000000000005,"15min":0.55400000000000005},"min":{"1min":0.42199999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.73799999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60099999999999998,"15min":0.59999999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.84599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":819200,"data_stored":372333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.27900000000000003,"5min":0.30299999999999999,"15min":0.307},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.42999999999999999,"5min":0.443,"15min":0.443},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.29399999999999998,"5min":0.312,"15min":0.315},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.27800000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.32700000000000001,"15min":0.33100000000000002},"min":{"1min":0.23400000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.43099999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.373,"15min":0.378},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.52200000000000002,"5min":0.621,"15min":0.621},"last":0.34999999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.371,"15min":0.375},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.46400000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.317},{"interface":"front","average":{"1min":0.371,"5min":0.40200000000000002,"15min":0.40699999999999997},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.24099999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.57899999999999996,"15min":0.58999999999999997},"min":{"1min":0.36699999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.65100000000000002,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56299999999999994,"15min":0.56599999999999995},"min":{"1min":0.38500000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.58299999999999996}]},{"osd":5,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53900000000000003,"15min":0.54000000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59799999999999998,"15min":0.60699999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.71699999999999997,"5min":0.87,"15min":0.87},"last":0.55400000000000005}]},{"osd":6,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56299999999999994,"15min":0.56599999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77800000000000002,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.60399999999999998,"15min":0.61399999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72499999999999998,"5min":1.129,"15min":1.129},"last":0.621}]},{"osd":7,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.629,"15min":0.63700000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.75600000000000001,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.625,"15min":0.63300000000000001},"min":{"1min":0.42399999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82799999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.68100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28384,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343456,"statfs":{"total":96636764160,"available":96607698944,"internally_reserved":0,"allocated":1388544,"data_stored":959454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.33000000000000002,"15min":0.33400000000000002},"min":{"1min":0.20799999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.40000000000000002,"5min":0.874,"15min":0.874},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.38500000000000001,"15min":0.39200000000000002},"min":{"1min":0.28799999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.496,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.29099999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.36799999999999999,"15min":0.379},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.44900000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.312},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.37,"15min":0.377},"min":{"1min":0.27100000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.41999999999999998,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.26200000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.35599999999999998,"15min":0.35999999999999999},"min":{"1min":0.248,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.44600000000000001,"5min":1.278,"15min":1.278},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.434,"15min":0.442},"min":{"1min":0.33000000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.52900000000000003,"5min":1.304,"15min":1.304},"last":0.37}]},{"osd":4,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81799999999999995,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.437},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.629,"15min":0.627},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.83399999999999996,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.499}]},{"osd":5,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.378,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.59899999999999998,"15min":0.60499999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.873,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.52800000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.622,"15min":0.621},"min":{"1min":0.41799999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90200000000000002,"5min":1.248,"15min":1.248},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42899999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.47299999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.62,"15min":0.622},"min":{"1min":0.42999999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.54500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:42:28.607 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:42:28.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.737+0000 7f8b4172c640 1 Processor -- start 2023-11-04T01:42:28.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.737+0000 7f8b4172c640 1 -- start start 2023-11-04T01:42:28.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.738+0000 7f8b4172c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8b3c0ce240 0x7f8b3c157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.738+0000 7f8b4172c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b3c157540 0x7f8b3c0d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.738+0000 7f8b4172c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b3c15e000 con 0x7f8b3c0cde60 2023-11-04T01:42:28.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.738+0000 7f8b4172c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b3c15e5c0 con 0x7f8b3c0ce240 2023-11-04T01:42:28.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.738+0000 7f8b4172c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c15e2e0 con 0x7f8b3c157540 2023-11-04T01:42:28.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.738+0000 7f8b3b7fe640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b3c157540 0x7f8b3c0d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.738+0000 7f8b3a7fc640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8b3c0ce240 0x7f8b3c157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.738+0000 7f8b3b7fe640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b3c157540 0x7f8b3c0d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:51618/0 (socket says 172.21.15.77:51618) 2023-11-04T01:42:28.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.738+0000 7f8b3b7fe640 1 -- 172.21.15.77:0/3858951648 learned_addr learned my addr 172.21.15.77:0/3858951648 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:28.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.738+0000 7f8b3b7fe640 1 -- 172.21.15.77:0/3858951648 >> v2:172.21.15.122:3300/0 conn(0x7f8b3c0ce240 msgr2=0x7f8b3c157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:28.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.738+0000 7f8b3b7fe640 1 --2- 172.21.15.77:0/3858951648 >> v2:172.21.15.122:3300/0 conn(0x7f8b3c0ce240 0x7f8b3c157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.738+0000 7f8b3b7fe640 1 -- 172.21.15.77:0/3858951648 >> v1:172.21.15.122:6789/0 conn(0x7f8b3c0cde60 legacy=0x7f8b3c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.739+0000 7f8b3b7fe640 1 -- 172.21.15.77:0/3858951648 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3c0d1120 con 0x7f8b3c157540 2023-11-04T01:42:28.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.739+0000 7f8b3b7fe640 1 --2- 172.21.15.77:0/3858951648 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b3c157540 0x7f8b3c0d1920 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8b34009870 tx=0x7f8b3402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8f15e635915b2b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.739+0000 7f8b39ffb640 1 -- 172.21.15.77:0/3858951648 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b34030840 con 0x7f8b3c157540 2023-11-04T01:42:28.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.740+0000 7f8b39ffb640 1 -- 172.21.15.77:0/3858951648 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b340309a0 con 0x7f8b3c157540 2023-11-04T01:42:28.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.740+0000 7f8b39ffb640 1 -- 172.21.15.77:0/3858951648 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b34030d30 con 0x7f8b3c157540 2023-11-04T01:42:28.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.740+0000 7f8b4172c640 1 -- 172.21.15.77:0/3858951648 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b3c157540 msgr2=0x7f8b3c0d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.740+0000 7f8b4172c640 1 --2- 172.21.15.77:0/3858951648 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b3c157540 0x7f8b3c0d1920 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8b34009870 tx=0x7f8b3402b980 comp rx=0 tx=0).stop 2023-11-04T01:42:28.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.740+0000 7f8b4172c640 1 -- 172.21.15.77:0/3858951648 shutdown_connections 2023-11-04T01:42:28.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.740+0000 7f8b4172c640 1 --2- 172.21.15.77:0/3858951648 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b3c157540 0x7f8b3c0d1920 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.740+0000 7f8b4172c640 1 --2- 172.21.15.77:0/3858951648 >> v2:172.21.15.122:3300/0 conn(0x7f8b3c0ce240 0x7f8b3c157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.740+0000 7f8b4172c640 1 -- 172.21.15.77:0/3858951648 >> 172.21.15.77:0/3858951648 conn(0x7f8b3c071f30 msgr2=0x7f8b3c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:28.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.740+0000 7f8b4172c640 1 -- 172.21.15.77:0/3858951648 shutdown_connections 2023-11-04T01:42:28.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.740+0000 7f8b4172c640 1 -- 172.21.15.77:0/3858951648 wait complete. 2023-11-04T01:42:28.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.741+0000 7f8b4172c640 1 Processor -- start 2023-11-04T01:42:28.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.741+0000 7f8b4172c640 1 -- start start 2023-11-04T01:42:28.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.742+0000 7f8b4172c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b3c0cde60 0x7f8b3c15b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.742+0000 7f8b4172c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b3c0ce240 0x7f8b3c0c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.742+0000 7f8b4172c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b3c157540 0x7f8b3c0c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.742+0000 7f8b4172c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c0a9740 con 0x7f8b3c0cde60 2023-11-04T01:42:28.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.742+0000 7f8b4172c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c15bd70 con 0x7f8b3c0ce240 2023-11-04T01:42:28.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.742+0000 7f8b4172c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c148560 con 0x7f8b3c157540 2023-11-04T01:42:28.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.742+0000 7f8b3affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b3c0cde60 0x7f8b3c15b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.742+0000 7f8b3affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b3c0cde60 0x7f8b3c15b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:32930/0 (socket says 172.21.15.77:32930) 2023-11-04T01:42:28.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.742+0000 7f8b3affd640 1 -- 172.21.15.77:0/3047044843 learned_addr learned my addr 172.21.15.77:0/3047044843 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:28.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.743+0000 7f8b3b7fe640 1 --2- 172.21.15.77:0/3047044843 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b3c157540 0x7f8b3c0c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.743+0000 7f8b3affd640 1 -- 172.21.15.77:0/3047044843 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b3c157540 msgr2=0x7f8b3c0c7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.743+0000 7f8b3a7fc640 1 --2- 172.21.15.77:0/3047044843 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b3c0ce240 0x7f8b3c0c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.743+0000 7f8b3affd640 1 --2- 172.21.15.77:0/3047044843 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b3c157540 0x7f8b3c0c7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.743+0000 7f8b3affd640 1 -- 172.21.15.77:0/3047044843 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b3c0ce240 msgr2=0x7f8b3c0c79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.743+0000 7f8b3affd640 1 --2- 172.21.15.77:0/3047044843 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b3c0ce240 0x7f8b3c0c79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.743+0000 7f8b3affd640 1 -- 172.21.15.77:0/3047044843 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b340094d0 con 0x7f8b3c0cde60 2023-11-04T01:42:28.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.743+0000 7f8b3b7fe640 1 --2- 172.21.15.77:0/3047044843 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b3c157540 0x7f8b3c0c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:28.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.743+0000 7f8b3a7fc640 1 --2- 172.21.15.77:0/3047044843 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b3c0ce240 0x7f8b3c0c79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:28.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.743+0000 7f8b3affd640 1 --2- 172.21.15.77:0/3047044843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b3c0cde60 0x7f8b3c15b830 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c00c870 tx=0x7f8b2c00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.743+0000 7f8b337fe640 1 -- 172.21.15.77:0/3047044843 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c003b70 con 0x7f8b3c0cde60 2023-11-04T01:42:28.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.743+0000 7f8b337fe640 1 -- 172.21.15.77:0/3047044843 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2c003cf0 con 0x7f8b3c0cde60 2023-11-04T01:42:28.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.743+0000 7f8b4172c640 1 -- 172.21.15.77:0/3047044843 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b3c14b1a0 con 0x7f8b3c0cde60 2023-11-04T01:42:28.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.743+0000 7f8b337fe640 1 -- 172.21.15.77:0/3047044843 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c00aa90 con 0x7f8b3c0cde60 2023-11-04T01:42:28.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.743+0000 7f8b4172c640 1 -- 172.21.15.77:0/3047044843 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b3c148b00 con 0x7f8b3c0cde60 2023-11-04T01:42:28.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.744+0000 7f8b4172c640 1 -- 172.21.15.77:0/3047044843 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b3c074290 con 0x7f8b3c0cde60 2023-11-04T01:42:28.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.744+0000 7f8b337fe640 1 -- 172.21.15.77:0/3047044843 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8b2c00abf0 con 0x7f8b3c0cde60 2023-11-04T01:42:28.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.745+0000 7f8b337fe640 1 --2- 172.21.15.77:0/3047044843 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8b1c06ae70 0x7f8b1c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.745+0000 7f8b337fe640 1 -- 172.21.15.77:0/3047044843 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8b2c0896f0 con 0x7f8b3c0cde60 2023-11-04T01:42:28.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.745+0000 7f8b3a7fc640 1 --2- 172.21.15.77:0/3047044843 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8b1c06ae70 0x7f8b1c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.745+0000 7f8b3a7fc640 1 --2- 172.21.15.77:0/3047044843 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8b1c06ae70 0x7f8b1c06d330 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c0b7fb0 tx=0x7f8b24008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.749+0000 7f8b337fe640 1 -- 172.21.15.77:0/3047044843 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8b2c054590 con 0x7f8b3c0cde60 2023-11-04T01:42:28.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.912+0000 7f8b4172c640 1 -- 172.21.15.77:0/3047044843 --> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b3c1483e0 con 0x7f8b1c06ae70 2023-11-04T01:42:28.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.921+0000 7f8b337fe640 1 -- 172.21.15.77:0/3047044843 <== mgr.4123 v2:172.21.15.122:6832/2275325762 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370280 (secure 0 0 0) 0x7f8b24010900 con 0x7f8b1c06ae70 2023-11-04T01:42:28.927 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:28.929 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-04T01:42:28.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.925+0000 7f8b4172c640 1 -- 172.21.15.77:0/3047044843 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8b1c06ae70 msgr2=0x7f8b1c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.925+0000 7f8b4172c640 1 --2- 172.21.15.77:0/3047044843 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8b1c06ae70 0x7f8b1c06d330 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c0b7fb0 tx=0x7f8b24008040 comp rx=0 tx=0).stop 2023-11-04T01:42:28.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.925+0000 7f8b4172c640 1 -- 172.21.15.77:0/3047044843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b3c0cde60 msgr2=0x7f8b3c15b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.925+0000 7f8b4172c640 1 --2- 172.21.15.77:0/3047044843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b3c0cde60 0x7f8b3c15b830 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c00c870 tx=0x7f8b2c00cd30 comp rx=0 tx=0).stop 2023-11-04T01:42:28.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.925+0000 7f8b4172c640 1 -- 172.21.15.77:0/3047044843 shutdown_connections 2023-11-04T01:42:28.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.925+0000 7f8b4172c640 1 --2- 172.21.15.77:0/3047044843 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8b1c06ae70 0x7f8b1c06d330 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.925+0000 7f8b4172c640 1 --2- 172.21.15.77:0/3047044843 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8b3c157540 0x7f8b3c0c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.925+0000 7f8b4172c640 1 --2- 172.21.15.77:0/3047044843 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b3c0ce240 0x7f8b3c0c79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.925+0000 7f8b4172c640 1 --2- 172.21.15.77:0/3047044843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b3c0cde60 0x7f8b3c15b830 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.925+0000 7f8b4172c640 1 -- 172.21.15.77:0/3047044843 >> 172.21.15.77:0/3047044843 conn(0x7f8b3c071f30 msgr2=0x7f8b3c0b6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:28.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.925+0000 7f8b4172c640 1 -- 172.21.15.77:0/3047044843 shutdown_connections 2023-11-04T01:42:28.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:28.925+0000 7f8b4172c640 1 -- 172.21.15.77:0/3047044843 wait complete. 2023-11-04T01:42:28.937 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2023-11-04T01:42:27.662194+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":255,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227792,"kb_used_data":7436,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754746928,"statfs":{"total":773094113280,"available":772860854272,"internally_reserved":0,"allocated":7614464,"data_stored":4131431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.016117"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.661565+0000","last_change":"2023-11-04T01:42:24.676349+0000","last_active":"2023-11-04T01:42:25.661565+0000","last_peered":"2023-11-04T01:42:25.661565+0000","last_clean":"2023-11-04T01:42:25.661565+0000","last_became_active":"2023-11-04T01:42:24.676061+0000","last_became_peered":"2023-11-04T01:42:24.676061+0000","last_unstale":"2023-11-04T01:42:25.661565+0000","last_undegraded":"2023-11-04T01:42:25.661565+0000","last_fullsized":"2023-11-04T01:42:25.661565+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:19:01.412412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.237317+0000","last_change":"2023-11-04T01:42:24.689379+0000","last_active":"2023-11-04T01:42:26.237317+0000","last_peered":"2023-11-04T01:42:26.237317+0000","last_clean":"2023-11-04T01:42:26.237317+0000","last_became_active":"2023-11-04T01:42:24.689077+0000","last_became_peered":"2023-11-04T01:42:24.689077+0000","last_unstale":"2023-11-04T01:42:26.237317+0000","last_undegraded":"2023-11-04T01:42:26.237317+0000","last_fullsized":"2023-11-04T01:42:26.237317+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:13.730862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.270950+0000","last_change":"2023-11-04T01:42:24.666557+0000","last_active":"2023-11-04T01:42:26.270950+0000","last_peered":"2023-11-04T01:42:26.270950+0000","last_clean":"2023-11-04T01:42:26.270950+0000","last_became_active":"2023-11-04T01:42:24.666284+0000","last_became_peered":"2023-11-04T01:42:24.666284+0000","last_unstale":"2023-11-04T01:42:26.270950+0000","last_undegraded":"2023-11-04T01:42:26.270950+0000","last_fullsized":"2023-11-04T01:42:26.270950+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:27.888669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.740500+0000","last_change":"2023-11-04T01:42:24.681954+0000","last_active":"2023-11-04T01:42:25.740500+0000","last_peered":"2023-11-04T01:42:25.740500+0000","last_clean":"2023-11-04T01:42:25.740500+0000","last_became_active":"2023-11-04T01:42:24.681557+0000","last_became_peered":"2023-11-04T01:42:24.681557+0000","last_unstale":"2023-11-04T01:42:25.740500+0000","last_undegraded":"2023-11-04T01:42:25.740500+0000","last_fullsized":"2023-11-04T01:42:25.740500+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:18:20.009445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.660847+0000","last_change":"2023-11-04T01:42:24.674094+0000","last_active":"2023-11-04T01:42:25.660847+0000","last_peered":"2023-11-04T01:42:25.660847+0000","last_clean":"2023-11-04T01:42:25.660847+0000","last_became_active":"2023-11-04T01:42:24.673763+0000","last_became_peered":"2023-11-04T01:42:24.673763+0000","last_unstale":"2023-11-04T01:42:25.660847+0000","last_undegraded":"2023-11-04T01:42:25.660847+0000","last_fullsized":"2023-11-04T01:42:25.660847+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:53:56.975140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.236637+0000","last_change":"2023-11-04T01:42:24.693563+0000","last_active":"2023-11-04T01:42:26.236637+0000","last_peered":"2023-11-04T01:42:26.236637+0000","last_clean":"2023-11-04T01:42:26.236637+0000","last_became_active":"2023-11-04T01:42:24.692795+0000","last_became_peered":"2023-11-04T01:42:24.692795+0000","last_unstale":"2023-11-04T01:42:26.236637+0000","last_undegraded":"2023-11-04T01:42:26.236637+0000","last_fullsized":"2023-11-04T01:42:26.236637+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:44:43.162870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.281232+0000","last_change":"2023-11-04T01:42:24.675794+0000","last_active":"2023-11-04T01:42:26.281232+0000","last_peered":"2023-11-04T01:42:26.281232+0000","last_clean":"2023-11-04T01:42:26.281232+0000","last_became_active":"2023-11-04T01:42:24.675532+0000","last_became_peered":"2023-11-04T01:42:24.675532+0000","last_unstale":"2023-11-04T01:42:26.281232+0000","last_undegraded":"2023-11-04T01:42:26.281232+0000","last_fullsized":"2023-11-04T01:42:26.281232+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:01:25.167031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.236644+0000","last_change":"2023-11-04T01:42:24.675990+0000","last_active":"2023-11-04T01:42:26.236644+0000","last_peered":"2023-11-04T01:42:26.236644+0000","last_clean":"2023-11-04T01:42:26.236644+0000","last_became_active":"2023-11-04T01:42:24.675697+0000","last_became_peered":"2023-11-04T01:42:24.675697+0000","last_unstale":"2023-11-04T01:42:26.236644+0000","last_undegraded":"2023-11-04T01:42:26.236644+0000","last_fullsized":"2023-11-04T01:42:26.236644+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:36:02.307558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.661232+0000","last_change":"2023-11-04T01:42:24.680425+0000","last_active":"2023-11-04T01:42:25.661232+0000","last_peered":"2023-11-04T01:42:25.661232+0000","last_clean":"2023-11-04T01:42:25.661232+0000","last_became_active":"2023-11-04T01:42:24.680175+0000","last_became_peered":"2023-11-04T01:42:24.680175+0000","last_unstale":"2023-11-04T01:42:25.661232+0000","last_undegraded":"2023-11-04T01:42:25.661232+0000","last_fullsized":"2023-11-04T01:42:25.661232+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:40:26.606733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.281850+0000","last_change":"2023-11-04T01:42:24.687736+0000","last_active":"2023-11-04T01:42:26.281850+0000","last_peered":"2023-11-04T01:42:26.281850+0000","last_clean":"2023-11-04T01:42:26.281850+0000","last_became_active":"2023-11-04T01:42:24.687422+0000","last_became_peered":"2023-11-04T01:42:24.687422+0000","last_unstale":"2023-11-04T01:42:26.281850+0000","last_undegraded":"2023-11-04T01:42:26.281850+0000","last_fullsized":"2023-11-04T01:42:26.281850+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:44:43.162870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.661343+0000","last_change":"2023-11-04T01:42:24.675694+0000","last_active":"2023-11-04T01:42:25.661343+0000","last_peered":"2023-11-04T01:42:25.661343+0000","last_clean":"2023-11-04T01:42:25.661343+0000","last_became_active":"2023-11-04T01:42:24.675426+0000","last_became_peered":"2023-11-04T01:42:24.675426+0000","last_unstale":"2023-11-04T01:42:25.661343+0000","last_undegraded":"2023-11-04T01:42:25.661343+0000","last_fullsized":"2023-11-04T01:42:25.661343+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:28:35.314279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.740625+0000","last_change":"2023-11-04T01:42:24.675084+0000","last_active":"2023-11-04T01:42:25.740625+0000","last_peered":"2023-11-04T01:42:25.740625+0000","last_clean":"2023-11-04T01:42:25.740625+0000","last_became_active":"2023-11-04T01:42:24.674824+0000","last_became_peered":"2023-11-04T01:42:24.674824+0000","last_unstale":"2023-11-04T01:42:25.740625+0000","last_undegraded":"2023-11-04T01:42:25.740625+0000","last_fullsized":"2023-11-04T01:42:25.740625+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:50:44.007615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.660153+0000","last_change":"2023-11-04T01:42:24.677217+0000","last_active":"2023-11-04T01:42:25.660153+0000","last_peered":"2023-11-04T01:42:25.660153+0000","last_clean":"2023-11-04T01:42:25.660153+0000","last_became_active":"2023-11-04T01:42:24.676951+0000","last_became_peered":"2023-11-04T01:42:24.676951+0000","last_unstale":"2023-11-04T01:42:25.660153+0000","last_undegraded":"2023-11-04T01:42:25.660153+0000","last_fullsized":"2023-11-04T01:42:25.660153+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:21.018644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.660858+0000","last_change":"2023-11-04T01:42:24.681303+0000","last_active":"2023-11-04T01:42:25.660858+0000","last_peered":"2023-11-04T01:42:25.660858+0000","last_clean":"2023-11-04T01:42:25.660858+0000","last_became_active":"2023-11-04T01:42:24.681055+0000","last_became_peered":"2023-11-04T01:42:24.681055+0000","last_unstale":"2023-11-04T01:42:25.660858+0000","last_undegraded":"2023-11-04T01:42:25.660858+0000","last_fullsized":"2023-11-04T01:42:25.660858+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:14:47.643085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.659821+0000","last_change":"2023-11-04T01:42:24.670303+0000","last_active":"2023-11-04T01:42:25.659821+0000","last_peered":"2023-11-04T01:42:25.659821+0000","last_clean":"2023-11-04T01:42:25.659821+0000","last_became_active":"2023-11-04T01:42:24.669942+0000","last_became_peered":"2023-11-04T01:42:24.669942+0000","last_unstale":"2023-11-04T01:42:25.659821+0000","last_undegraded":"2023-11-04T01:42:25.659821+0000","last_fullsized":"2023-11-04T01:42:25.659821+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:23:37.634543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.281279+0000","last_change":"2023-11-04T01:42:24.695676+0000","last_active":"2023-11-04T01:42:26.281279+0000","last_peered":"2023-11-04T01:42:26.281279+0000","last_clean":"2023-11-04T01:42:26.281279+0000","last_became_active":"2023-11-04T01:42:24.695423+0000","last_became_peered":"2023-11-04T01:42:24.695423+0000","last_unstale":"2023-11-04T01:42:26.281279+0000","last_undegraded":"2023-11-04T01:42:26.281279+0000","last_fullsized":"2023-11-04T01:42:26.281279+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:50:44.007615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.661256+0000","last_change":"2023-11-04T01:42:24.679136+0000","last_active":"2023-11-04T01:42:25.661256+0000","last_peered":"2023-11-04T01:42:25.661256+0000","last_clean":"2023-11-04T01:42:25.661256+0000","last_became_active":"2023-11-04T01:42:24.678857+0000","last_became_peered":"2023-11-04T01:42:24.678857+0000","last_unstale":"2023-11-04T01:42:25.661256+0000","last_undegraded":"2023-11-04T01:42:25.661256+0000","last_fullsized":"2023-11-04T01:42:25.661256+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:49:03.072325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.740618+0000","last_change":"2023-11-04T01:42:24.677756+0000","last_active":"2023-11-04T01:42:25.740618+0000","last_peered":"2023-11-04T01:42:25.740618+0000","last_clean":"2023-11-04T01:42:25.740618+0000","last_became_active":"2023-11-04T01:42:24.677416+0000","last_became_peered":"2023-11-04T01:42:24.677416+0000","last_unstale":"2023-11-04T01:42:25.740618+0000","last_undegraded":"2023-11-04T01:42:25.740618+0000","last_fullsized":"2023-11-04T01:42:25.740618+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:47:39.653350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.237019+0000","last_change":"2023-11-04T01:42:24.675346+0000","last_active":"2023-11-04T01:42:26.237019+0000","last_peered":"2023-11-04T01:42:26.237019+0000","last_clean":"2023-11-04T01:42:26.237019+0000","last_became_active":"2023-11-04T01:42:24.675003+0000","last_became_peered":"2023-11-04T01:42:24.675003+0000","last_unstale":"2023-11-04T01:42:26.237019+0000","last_undegraded":"2023-11-04T01:42:26.237019+0000","last_fullsized":"2023-11-04T01:42:26.237019+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:29.663281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.659983+0000","last_change":"2023-11-04T01:42:24.681147+0000","last_active":"2023-11-04T01:42:25.659983+0000","last_peered":"2023-11-04T01:42:25.659983+0000","last_clean":"2023-11-04T01:42:25.659983+0000","last_became_active":"2023-11-04T01:42:24.680890+0000","last_became_peered":"2023-11-04T01:42:24.680890+0000","last_unstale":"2023-11-04T01:42:25.659983+0000","last_undegraded":"2023-11-04T01:42:25.659983+0000","last_fullsized":"2023-11-04T01:42:25.659983+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:59:33.999093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.281790+0000","last_change":"2023-11-04T01:42:24.690026+0000","last_active":"2023-11-04T01:42:26.281790+0000","last_peered":"2023-11-04T01:42:26.281790+0000","last_clean":"2023-11-04T01:42:26.281790+0000","last_became_active":"2023-11-04T01:42:24.689756+0000","last_became_peered":"2023-11-04T01:42:24.689756+0000","last_unstale":"2023-11-04T01:42:26.281790+0000","last_undegraded":"2023-11-04T01:42:26.281790+0000","last_fullsized":"2023-11-04T01:42:26.281790+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:49:08.332268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.281582+0000","last_change":"2023-11-04T01:42:24.687303+0000","last_active":"2023-11-04T01:42:26.281582+0000","last_peered":"2023-11-04T01:42:26.281582+0000","last_clean":"2023-11-04T01:42:26.281582+0000","last_became_active":"2023-11-04T01:42:24.686982+0000","last_became_peered":"2023-11-04T01:42:24.686982+0000","last_unstale":"2023-11-04T01:42:26.281582+0000","last_undegraded":"2023-11-04T01:42:26.281582+0000","last_fullsized":"2023-11-04T01:42:26.281582+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:37:59.345720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.661058+0000","last_change":"2023-11-04T01:42:24.684519+0000","last_active":"2023-11-04T01:42:25.661058+0000","last_peered":"2023-11-04T01:42:25.661058+0000","last_clean":"2023-11-04T01:42:25.661058+0000","last_became_active":"2023-11-04T01:42:24.684104+0000","last_became_peered":"2023-11-04T01:42:24.684104+0000","last_unstale":"2023-11-04T01:42:25.661058+0000","last_undegraded":"2023-11-04T01:42:25.661058+0000","last_fullsized":"2023-11-04T01:42:25.661058+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:37.772749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.660899+0000","last_change":"2023-11-04T01:42:24.678560+0000","last_active":"2023-11-04T01:42:25.660899+0000","last_peered":"2023-11-04T01:42:25.660899+0000","last_clean":"2023-11-04T01:42:25.660899+0000","last_became_active":"2023-11-04T01:42:24.678281+0000","last_became_peered":"2023-11-04T01:42:24.678281+0000","last_unstale":"2023-11-04T01:42:25.660899+0000","last_undegraded":"2023-11-04T01:42:25.660899+0000","last_fullsized":"2023-11-04T01:42:25.660899+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:05:41.792046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.281857+0000","last_change":"2023-11-04T01:42:24.693223+0000","last_active":"2023-11-04T01:42:26.281857+0000","last_peered":"2023-11-04T01:42:26.281857+0000","last_clean":"2023-11-04T01:42:26.281857+0000","last_became_active":"2023-11-04T01:42:24.692794+0000","last_became_peered":"2023-11-04T01:42:24.692794+0000","last_unstale":"2023-11-04T01:42:26.281857+0000","last_undegraded":"2023-11-04T01:42:26.281857+0000","last_fullsized":"2023-11-04T01:42:26.281857+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:36:02.307558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.282079+0000","last_change":"2023-11-04T01:42:24.690638+0000","last_active":"2023-11-04T01:42:26.282079+0000","last_peered":"2023-11-04T01:42:26.282079+0000","last_clean":"2023-11-04T01:42:26.282079+0000","last_became_active":"2023-11-04T01:42:24.690374+0000","last_became_peered":"2023-11-04T01:42:24.690374+0000","last_unstale":"2023-11-04T01:42:26.282079+0000","last_undegraded":"2023-11-04T01:42:26.282079+0000","last_fullsized":"2023-11-04T01:42:26.282079+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:44:09.067211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.271001+0000","last_change":"2023-11-04T01:42:24.669780+0000","last_active":"2023-11-04T01:42:26.271001+0000","last_peered":"2023-11-04T01:42:26.271001+0000","last_clean":"2023-11-04T01:42:26.271001+0000","last_became_active":"2023-11-04T01:42:24.669501+0000","last_became_peered":"2023-11-04T01:42:24.669501+0000","last_unstale":"2023-11-04T01:42:26.271001+0000","last_undegraded":"2023-11-04T01:42:26.271001+0000","last_fullsized":"2023-11-04T01:42:26.271001+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:24.209022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.282225+0000","last_change":"2023-11-04T01:42:24.689389+0000","last_active":"2023-11-04T01:42:26.282225+0000","last_peered":"2023-11-04T01:42:26.282225+0000","last_clean":"2023-11-04T01:42:26.282225+0000","last_became_active":"2023-11-04T01:42:24.689026+0000","last_became_peered":"2023-11-04T01:42:24.689026+0000","last_unstale":"2023-11-04T01:42:26.282225+0000","last_undegraded":"2023-11-04T01:42:26.282225+0000","last_fullsized":"2023-11-04T01:42:26.282225+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:29.663281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.270685+0000","last_change":"2023-11-04T01:42:24.681834+0000","last_active":"2023-11-04T01:42:26.270685+0000","last_peered":"2023-11-04T01:42:26.270685+0000","last_clean":"2023-11-04T01:42:26.270685+0000","last_became_active":"2023-11-04T01:42:24.681561+0000","last_became_peered":"2023-11-04T01:42:24.681561+0000","last_unstale":"2023-11-04T01:42:26.270685+0000","last_undegraded":"2023-11-04T01:42:26.270685+0000","last_fullsized":"2023-11-04T01:42:26.270685+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:34:37.802722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.281352+0000","last_change":"2023-11-04T01:42:24.682917+0000","last_active":"2023-11-04T01:42:26.281352+0000","last_peered":"2023-11-04T01:42:26.281352+0000","last_clean":"2023-11-04T01:42:26.281352+0000","last_became_active":"2023-11-04T01:42:24.682645+0000","last_became_peered":"2023-11-04T01:42:24.682645+0000","last_unstale":"2023-11-04T01:42:26.281352+0000","last_undegraded":"2023-11-04T01:42:26.281352+0000","last_fullsized":"2023-11-04T01:42:26.281352+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:20:52.969676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.281458+0000","last_change":"2023-11-04T01:42:24.676621+0000","last_active":"2023-11-04T01:42:26.281458+0000","last_peered":"2023-11-04T01:42:26.281458+0000","last_clean":"2023-11-04T01:42:26.281458+0000","last_became_active":"2023-11-04T01:42:24.676370+0000","last_became_peered":"2023-11-04T01:42:24.676370+0000","last_unstale":"2023-11-04T01:42:26.281458+0000","last_undegraded":"2023-11-04T01:42:26.281458+0000","last_fullsized":"2023-11-04T01:42:26.281458+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:54.837882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.236684+0000","last_change":"2023-11-04T01:42:24.686171+0000","last_active":"2023-11-04T01:42:26.236684+0000","last_peered":"2023-11-04T01:42:26.236684+0000","last_clean":"2023-11-04T01:42:26.236684+0000","last_became_active":"2023-11-04T01:42:24.685900+0000","last_became_peered":"2023-11-04T01:42:24.685900+0000","last_unstale":"2023-11-04T01:42:26.236684+0000","last_undegraded":"2023-11-04T01:42:26.236684+0000","last_fullsized":"2023-11-04T01:42:26.236684+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:55:47.759698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.660760+0000","last_change":"2023-11-04T01:42:24.675141+0000","last_active":"2023-11-04T01:42:25.660760+0000","last_peered":"2023-11-04T01:42:25.660760+0000","last_clean":"2023-11-04T01:42:25.660760+0000","last_became_active":"2023-11-04T01:42:24.674854+0000","last_became_peered":"2023-11-04T01:42:24.674854+0000","last_unstale":"2023-11-04T01:42:25.660760+0000","last_undegraded":"2023-11-04T01:42:25.660760+0000","last_fullsized":"2023-11-04T01:42:25.660760+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:12:47.308128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"65'8","reported_seq":20,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.281238+0000","last_change":"2023-11-04T01:42:23.672912+0000","last_active":"2023-11-04T01:42:26.281238+0000","last_peered":"2023-11-04T01:42:26.281238+0000","last_clean":"2023-11-04T01:42:26.281238+0000","last_became_active":"2023-11-04T01:42:23.672636+0000","last_became_peered":"2023-11-04T01:42:23.672636+0000","last_unstale":"2023-11-04T01:42:26.281238+0000","last_undegraded":"2023-11-04T01:42:26.281238+0000","last_fullsized":"2023-11-04T01:42:26.281238+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:44:32.155572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.664053+0000","last_change":"2023-11-04T01:41:36.067943+0000","last_active":"2023-11-04T01:42:24.664053+0000","last_peered":"2023-11-04T01:42:24.664053+0000","last_clean":"2023-11-04T01:42:24.664053+0000","last_became_active":"2023-11-04T01:41:34.734305+0000","last_became_peered":"2023-11-04T01:41:34.734305+0000","last_unstale":"2023-11-04T01:42:24.664053+0000","last_undegraded":"2023-11-04T01:42:24.664053+0000","last_fullsized":"2023-11-04T01:42:24.664053+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:48.121273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033780399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.659860+0000","last_change":"2023-11-04T01:42:24.678086+0000","last_active":"2023-11-04T01:42:25.659860+0000","last_peered":"2023-11-04T01:42:25.659860+0000","last_clean":"2023-11-04T01:42:25.659860+0000","last_became_active":"2023-11-04T01:42:24.677837+0000","last_became_peered":"2023-11-04T01:42:24.677837+0000","last_unstale":"2023-11-04T01:42:25.659860+0000","last_undegraded":"2023-11-04T01:42:25.659860+0000","last_fullsized":"2023-11-04T01:42:25.659860+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:19:11.501349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.670736+0000","last_change":"2023-11-04T01:42:23.667570+0000","last_active":"2023-11-04T01:42:24.670736+0000","last_peered":"2023-11-04T01:42:24.670736+0000","last_clean":"2023-11-04T01:42:24.670736+0000","last_became_active":"2023-11-04T01:42:23.667328+0000","last_became_peered":"2023-11-04T01:42:23.667328+0000","last_unstale":"2023-11-04T01:42:24.670736+0000","last_undegraded":"2023-11-04T01:42:24.670736+0000","last_fullsized":"2023-11-04T01:42:24.670736+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:44:55.835030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":34,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.671287+0000","last_change":"2023-11-04T01:41:35.728832+0000","last_active":"2023-11-04T01:42:24.671287+0000","last_peered":"2023-11-04T01:42:24.671287+0000","last_clean":"2023-11-04T01:42:24.671287+0000","last_became_active":"2023-11-04T01:41:34.733517+0000","last_became_peered":"2023-11-04T01:41:34.733517+0000","last_unstale":"2023-11-04T01:42:24.671287+0000","last_undegraded":"2023-11-04T01:42:24.671287+0000","last_fullsized":"2023-11-04T01:42:24.671287+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:19.350812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042545700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.281637+0000","last_change":"2023-11-04T01:42:24.691848+0000","last_active":"2023-11-04T01:42:26.281637+0000","last_peered":"2023-11-04T01:42:26.281637+0000","last_clean":"2023-11-04T01:42:26.281637+0000","last_became_active":"2023-11-04T01:42:24.691546+0000","last_became_peered":"2023-11-04T01:42:24.691546+0000","last_unstale":"2023-11-04T01:42:26.281637+0000","last_undegraded":"2023-11-04T01:42:26.281637+0000","last_fullsized":"2023-11-04T01:42:26.281637+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:37.772749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.236617+0000","last_change":"2023-11-04T01:42:23.668345+0000","last_active":"2023-11-04T01:42:26.236617+0000","last_peered":"2023-11-04T01:42:26.236617+0000","last_clean":"2023-11-04T01:42:26.236617+0000","last_became_active":"2023-11-04T01:42:23.667972+0000","last_became_peered":"2023-11-04T01:42:23.667972+0000","last_unstale":"2023-11-04T01:42:26.236617+0000","last_undegraded":"2023-11-04T01:42:26.236617+0000","last_fullsized":"2023-11-04T01:42:26.236617+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:48:20.179786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":35,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.669826+0000","last_change":"2023-11-04T01:41:35.906660+0000","last_active":"2023-11-04T01:42:24.669826+0000","last_peered":"2023-11-04T01:42:24.669826+0000","last_clean":"2023-11-04T01:42:24.669826+0000","last_became_active":"2023-11-04T01:41:34.737209+0000","last_became_peered":"2023-11-04T01:41:34.737209+0000","last_unstale":"2023-11-04T01:42:24.669826+0000","last_undegraded":"2023-11-04T01:42:24.669826+0000","last_fullsized":"2023-11-04T01:42:24.669826+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:59.608410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068889500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.661126+0000","last_change":"2023-11-04T01:42:24.675636+0000","last_active":"2023-11-04T01:42:25.661126+0000","last_peered":"2023-11-04T01:42:25.661126+0000","last_clean":"2023-11-04T01:42:25.661126+0000","last_became_active":"2023-11-04T01:42:24.675357+0000","last_became_peered":"2023-11-04T01:42:24.675357+0000","last_unstale":"2023-11-04T01:42:25.661126+0000","last_undegraded":"2023-11-04T01:42:25.661126+0000","last_fullsized":"2023-11-04T01:42:25.661126+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:19:01.258080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"65'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.740394+0000","last_change":"2023-11-04T01:42:23.658552+0000","last_active":"2023-11-04T01:42:25.740394+0000","last_peered":"2023-11-04T01:42:25.740394+0000","last_clean":"2023-11-04T01:42:25.740394+0000","last_became_active":"2023-11-04T01:42:23.658274+0000","last_became_peered":"2023-11-04T01:42:23.658274+0000","last_unstale":"2023-11-04T01:42:25.740394+0000","last_undegraded":"2023-11-04T01:42:25.740394+0000","last_fullsized":"2023-11-04T01:42:25.740394+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:48:20.179786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.664028+0000","last_change":"2023-11-04T01:41:36.067946+0000","last_active":"2023-11-04T01:42:24.664028+0000","last_peered":"2023-11-04T01:42:24.664028+0000","last_clean":"2023-11-04T01:42:24.664028+0000","last_became_active":"2023-11-04T01:41:34.729591+0000","last_became_peered":"2023-11-04T01:41:34.729591+0000","last_unstale":"2023-11-04T01:42:24.664028+0000","last_undegraded":"2023-11-04T01:42:24.664028+0000","last_fullsized":"2023-11-04T01:42:24.664028+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:59.608410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032681099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.661093+0000","last_change":"2023-11-04T01:42:24.669813+0000","last_active":"2023-11-04T01:42:25.661093+0000","last_peered":"2023-11-04T01:42:25.661093+0000","last_clean":"2023-11-04T01:42:25.661093+0000","last_became_active":"2023-11-04T01:42:24.669568+0000","last_became_peered":"2023-11-04T01:42:24.669568+0000","last_unstale":"2023-11-04T01:42:25.661093+0000","last_undegraded":"2023-11-04T01:42:25.661093+0000","last_fullsized":"2023-11-04T01:42:25.661093+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:46:58.814972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"65'6","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.740694+0000","last_change":"2023-11-04T01:42:23.659092+0000","last_active":"2023-11-04T01:42:25.740694+0000","last_peered":"2023-11-04T01:42:25.740694+0000","last_clean":"2023-11-04T01:42:25.740694+0000","last_became_active":"2023-11-04T01:42:23.658851+0000","last_became_peered":"2023-11-04T01:42:23.658851+0000","last_unstale":"2023-11-04T01:42:25.740694+0000","last_undegraded":"2023-11-04T01:42:25.740694+0000","last_fullsized":"2023-11-04T01:42:25.740694+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:46:59.014740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":35,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.671768+0000","last_change":"2023-11-04T01:41:35.905999+0000","last_active":"2023-11-04T01:42:24.671768+0000","last_peered":"2023-11-04T01:42:24.671768+0000","last_clean":"2023-11-04T01:42:24.671768+0000","last_became_active":"2023-11-04T01:41:34.735286+0000","last_became_peered":"2023-11-04T01:41:34.735286+0000","last_unstale":"2023-11-04T01:42:24.671768+0000","last_undegraded":"2023-11-04T01:42:24.671768+0000","last_fullsized":"2023-11-04T01:42:24.671768+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:14:22.019781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051880100000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.237108+0000","last_change":"2023-11-04T01:42:24.692286+0000","last_active":"2023-11-04T01:42:26.237108+0000","last_peered":"2023-11-04T01:42:26.237108+0000","last_clean":"2023-11-04T01:42:26.237108+0000","last_became_active":"2023-11-04T01:42:24.692005+0000","last_became_peered":"2023-11-04T01:42:24.692005+0000","last_unstale":"2023-11-04T01:42:26.237108+0000","last_undegraded":"2023-11-04T01:42:26.237108+0000","last_fullsized":"2023-11-04T01:42:26.237108+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:00:24.351824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"65'3","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.271056+0000","last_change":"2023-11-04T01:42:23.661491+0000","last_active":"2023-11-04T01:42:26.271056+0000","last_peered":"2023-11-04T01:42:26.271056+0000","last_clean":"2023-11-04T01:42:26.271056+0000","last_became_active":"2023-11-04T01:42:23.661239+0000","last_became_peered":"2023-11-04T01:42:23.661239+0000","last_unstale":"2023-11-04T01:42:26.271056+0000","last_undegraded":"2023-11-04T01:42:26.271056+0000","last_fullsized":"2023-11-04T01:42:26.271056+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:04.699379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.659030+0000","last_change":"2023-11-04T01:41:36.344205+0000","last_active":"2023-11-04T01:42:24.659030+0000","last_peered":"2023-11-04T01:42:24.659030+0000","last_clean":"2023-11-04T01:42:24.659030+0000","last_became_active":"2023-11-04T01:41:34.733205+0000","last_became_peered":"2023-11-04T01:41:34.733205+0000","last_unstale":"2023-11-04T01:42:24.659030+0000","last_undegraded":"2023-11-04T01:42:24.659030+0000","last_fullsized":"2023-11-04T01:42:24.659030+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:37.958719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011584760000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.661718+0000","last_change":"2023-11-04T01:42:24.675765+0000","last_active":"2023-11-04T01:42:25.661718+0000","last_peered":"2023-11-04T01:42:25.661718+0000","last_clean":"2023-11-04T01:42:25.661718+0000","last_became_active":"2023-11-04T01:42:24.675460+0000","last_became_peered":"2023-11-04T01:42:24.675460+0000","last_unstale":"2023-11-04T01:42:25.661718+0000","last_undegraded":"2023-11-04T01:42:25.661718+0000","last_fullsized":"2023-11-04T01:42:25.661718+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:19:11.501349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.237286+0000","last_change":"2023-11-04T01:42:23.666334+0000","last_active":"2023-11-04T01:42:26.237286+0000","last_peered":"2023-11-04T01:42:26.237286+0000","last_clean":"2023-11-04T01:42:26.237286+0000","last_became_active":"2023-11-04T01:42:23.665556+0000","last_became_peered":"2023-11-04T01:42:23.665556+0000","last_unstale":"2023-11-04T01:42:26.237286+0000","last_undegraded":"2023-11-04T01:42:26.237286+0000","last_fullsized":"2023-11-04T01:42:26.237286+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:47:38.646711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.659394+0000","last_change":"2023-11-04T01:41:36.343728+0000","last_active":"2023-11-04T01:42:24.659394+0000","last_peered":"2023-11-04T01:42:24.659394+0000","last_clean":"2023-11-04T01:42:24.659394+0000","last_became_active":"2023-11-04T01:41:34.731106+0000","last_became_peered":"2023-11-04T01:41:34.731106+0000","last_unstale":"2023-11-04T01:42:24.659394+0000","last_undegraded":"2023-11-04T01:42:24.659394+0000","last_fullsized":"2023-11-04T01:42:24.659394+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:29.730483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058974500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.282185+0000","last_change":"2023-11-04T01:42:24.679662+0000","last_active":"2023-11-04T01:42:26.282185+0000","last_peered":"2023-11-04T01:42:26.282185+0000","last_clean":"2023-11-04T01:42:26.282185+0000","last_became_active":"2023-11-04T01:42:24.679401+0000","last_became_peered":"2023-11-04T01:42:24.679401+0000","last_unstale":"2023-11-04T01:42:26.282185+0000","last_undegraded":"2023-11-04T01:42:26.282185+0000","last_fullsized":"2023-11-04T01:42:26.282185+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:28:35.314279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.281945+0000","last_change":"2023-11-04T01:42:23.671927+0000","last_active":"2023-11-04T01:42:26.281945+0000","last_peered":"2023-11-04T01:42:26.281945+0000","last_clean":"2023-11-04T01:42:26.281945+0000","last_became_active":"2023-11-04T01:42:23.671604+0000","last_became_peered":"2023-11-04T01:42:23.671604+0000","last_unstale":"2023-11-04T01:42:26.281945+0000","last_undegraded":"2023-11-04T01:42:26.281945+0000","last_fullsized":"2023-11-04T01:42:26.281945+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:47:38.646711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":35,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.677837+0000","last_change":"2023-11-04T01:41:35.931778+0000","last_active":"2023-11-04T01:42:24.677837+0000","last_peered":"2023-11-04T01:42:24.677837+0000","last_clean":"2023-11-04T01:42:24.677837+0000","last_became_active":"2023-11-04T01:41:34.736897+0000","last_became_peered":"2023-11-04T01:41:34.736897+0000","last_unstale":"2023-11-04T01:42:24.677837+0000","last_undegraded":"2023-11-04T01:42:24.677837+0000","last_fullsized":"2023-11-04T01:42:24.677837+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:20.089706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071523300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.659839+0000","last_change":"2023-11-04T01:42:24.670206+0000","last_active":"2023-11-04T01:42:25.659839+0000","last_peered":"2023-11-04T01:42:25.659839+0000","last_clean":"2023-11-04T01:42:25.659839+0000","last_became_active":"2023-11-04T01:42:24.669582+0000","last_became_peered":"2023-11-04T01:42:24.669582+0000","last_unstale":"2023-11-04T01:42:25.659839+0000","last_undegraded":"2023-11-04T01:42:25.659839+0000","last_fullsized":"2023-11-04T01:42:25.659839+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:19:01.412412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.660556+0000","last_change":"2023-11-04T01:42:23.658417+0000","last_active":"2023-11-04T01:42:25.660556+0000","last_peered":"2023-11-04T01:42:25.660556+0000","last_clean":"2023-11-04T01:42:25.660556+0000","last_became_active":"2023-11-04T01:42:23.657807+0000","last_became_peered":"2023-11-04T01:42:23.657807+0000","last_unstale":"2023-11-04T01:42:25.660556+0000","last_undegraded":"2023-11-04T01:42:25.660556+0000","last_fullsized":"2023-11-04T01:42:25.660556+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:46:35.376713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":41,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.664626+0000","last_change":"2023-11-04T01:41:35.729017+0000","last_active":"2023-11-04T01:42:24.664626+0000","last_peered":"2023-11-04T01:42:24.664626+0000","last_clean":"2023-11-04T01:42:24.664626+0000","last_became_active":"2023-11-04T01:41:34.730592+0000","last_became_peered":"2023-11-04T01:41:34.730592+0000","last_unstale":"2023-11-04T01:42:24.664626+0000","last_undegraded":"2023-11-04T01:42:24.664626+0000","last_fullsized":"2023-11-04T01:42:24.664626+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:08.858430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088820999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.660599+0000","last_change":"2023-11-04T01:42:24.692253+0000","last_active":"2023-11-04T01:42:25.660599+0000","last_peered":"2023-11-04T01:42:25.660599+0000","last_clean":"2023-11-04T01:42:25.660599+0000","last_became_active":"2023-11-04T01:42:24.691946+0000","last_became_peered":"2023-11-04T01:42:24.691946+0000","last_unstale":"2023-11-04T01:42:25.660599+0000","last_undegraded":"2023-11-04T01:42:25.660599+0000","last_fullsized":"2023-11-04T01:42:25.660599+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:13:43.632962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.740325+0000","last_change":"2023-11-04T01:42:23.660357+0000","last_active":"2023-11-04T01:42:25.740325+0000","last_peered":"2023-11-04T01:42:25.740325+0000","last_clean":"2023-11-04T01:42:25.740325+0000","last_became_active":"2023-11-04T01:42:23.660086+0000","last_became_peered":"2023-11-04T01:42:23.660086+0000","last_unstale":"2023-11-04T01:42:25.740325+0000","last_undegraded":"2023-11-04T01:42:25.740325+0000","last_fullsized":"2023-11-04T01:42:25.740325+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:57:29.058454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.662179+0000","last_change":"2023-11-04T01:41:35.729378+0000","last_active":"2023-11-04T01:42:24.662179+0000","last_peered":"2023-11-04T01:42:24.662179+0000","last_clean":"2023-11-04T01:42:24.662179+0000","last_became_active":"2023-11-04T01:41:34.730387+0000","last_became_peered":"2023-11-04T01:41:34.730387+0000","last_unstale":"2023-11-04T01:42:24.662179+0000","last_undegraded":"2023-11-04T01:42:24.662179+0000","last_fullsized":"2023-11-04T01:42:24.662179+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:12.653602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072268699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.281936+0000","last_change":"2023-11-04T01:42:24.689718+0000","last_active":"2023-11-04T01:42:26.281936+0000","last_peered":"2023-11-04T01:42:26.281936+0000","last_clean":"2023-11-04T01:42:26.281936+0000","last_became_active":"2023-11-04T01:42:24.689419+0000","last_became_peered":"2023-11-04T01:42:24.689419+0000","last_unstale":"2023-11-04T01:42:26.281936+0000","last_undegraded":"2023-11-04T01:42:26.281936+0000","last_fullsized":"2023-11-04T01:42:26.281936+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:55:47.759698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"65'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.236784+0000","last_change":"2023-11-04T01:42:23.670594+0000","last_active":"2023-11-04T01:42:26.236784+0000","last_peered":"2023-11-04T01:42:26.236784+0000","last_clean":"2023-11-04T01:42:26.236784+0000","last_became_active":"2023-11-04T01:42:23.670318+0000","last_became_peered":"2023-11-04T01:42:23.670318+0000","last_unstale":"2023-11-04T01:42:26.236784+0000","last_undegraded":"2023-11-04T01:42:26.236784+0000","last_fullsized":"2023-11-04T01:42:26.236784+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:17:14.983458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":41,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.664592+0000","last_change":"2023-11-04T01:41:35.729318+0000","last_active":"2023-11-04T01:42:24.664592+0000","last_peered":"2023-11-04T01:42:24.664592+0000","last_clean":"2023-11-04T01:42:24.664592+0000","last_became_active":"2023-11-04T01:41:34.733796+0000","last_became_peered":"2023-11-04T01:41:34.733796+0000","last_unstale":"2023-11-04T01:42:24.664592+0000","last_undegraded":"2023-11-04T01:42:24.664592+0000","last_fullsized":"2023-11-04T01:42:24.664592+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:19.350812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053712200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.281467+0000","last_change":"2023-11-04T01:42:24.680083+0000","last_active":"2023-11-04T01:42:26.281467+0000","last_peered":"2023-11-04T01:42:26.281467+0000","last_clean":"2023-11-04T01:42:26.281467+0000","last_became_active":"2023-11-04T01:42:24.679830+0000","last_became_peered":"2023-11-04T01:42:24.679830+0000","last_unstale":"2023-11-04T01:42:26.281467+0000","last_undegraded":"2023-11-04T01:42:26.281467+0000","last_fullsized":"2023-11-04T01:42:26.281467+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:05:41.792046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"65'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.270797+0000","last_change":"2023-11-04T01:42:23.667634+0000","last_active":"2023-11-04T01:42:26.270797+0000","last_peered":"2023-11-04T01:42:26.270797+0000","last_clean":"2023-11-04T01:42:26.270797+0000","last_became_active":"2023-11-04T01:42:23.667348+0000","last_became_peered":"2023-11-04T01:42:23.667348+0000","last_unstale":"2023-11-04T01:42:26.270797+0000","last_undegraded":"2023-11-04T01:42:26.270797+0000","last_fullsized":"2023-11-04T01:42:26.270797+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:20.012006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":35,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.677472+0000","last_change":"2023-11-04T01:41:35.931929+0000","last_active":"2023-11-04T01:42:24.677472+0000","last_peered":"2023-11-04T01:42:24.677472+0000","last_clean":"2023-11-04T01:42:24.677472+0000","last_became_active":"2023-11-04T01:41:34.738795+0000","last_became_peered":"2023-11-04T01:41:34.738795+0000","last_unstale":"2023-11-04T01:42:24.677472+0000","last_undegraded":"2023-11-04T01:42:24.677472+0000","last_fullsized":"2023-11-04T01:42:24.677472+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:59.608410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046204999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.661707+0000","last_change":"2023-11-04T01:42:24.675053+0000","last_active":"2023-11-04T01:42:25.661707+0000","last_peered":"2023-11-04T01:42:25.661707+0000","last_clean":"2023-11-04T01:42:25.661707+0000","last_became_active":"2023-11-04T01:42:24.674699+0000","last_became_peered":"2023-11-04T01:42:24.674699+0000","last_unstale":"2023-11-04T01:42:25.661707+0000","last_undegraded":"2023-11-04T01:42:25.661707+0000","last_fullsized":"2023-11-04T01:42:25.661707+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:24:17.420867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"65'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.237180+0000","last_change":"2023-11-04T01:42:23.671431+0000","last_active":"2023-11-04T01:42:26.237180+0000","last_peered":"2023-11-04T01:42:26.237180+0000","last_clean":"2023-11-04T01:42:26.237180+0000","last_became_active":"2023-11-04T01:42:23.671121+0000","last_became_peered":"2023-11-04T01:42:23.671121+0000","last_unstale":"2023-11-04T01:42:26.237180+0000","last_undegraded":"2023-11-04T01:42:26.237180+0000","last_fullsized":"2023-11-04T01:42:26.237180+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:18:19.002807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":41,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.664005+0000","last_change":"2023-11-04T01:41:35.728945+0000","last_active":"2023-11-04T01:42:24.664005+0000","last_peered":"2023-11-04T01:42:24.664005+0000","last_clean":"2023-11-04T01:42:24.664005+0000","last_became_active":"2023-11-04T01:41:34.735082+0000","last_became_peered":"2023-11-04T01:41:34.735082+0000","last_unstale":"2023-11-04T01:42:24.664005+0000","last_undegraded":"2023-11-04T01:42:24.664005+0000","last_fullsized":"2023-11-04T01:42:24.664005+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:16.970814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079093000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.237043+0000","last_change":"2023-11-04T01:42:24.681501+0000","last_active":"2023-11-04T01:42:26.237043+0000","last_peered":"2023-11-04T01:42:26.237043+0000","last_clean":"2023-11-04T01:42:26.237043+0000","last_became_active":"2023-11-04T01:42:24.681199+0000","last_became_peered":"2023-11-04T01:42:24.681199+0000","last_unstale":"2023-11-04T01:42:26.237043+0000","last_undegraded":"2023-11-04T01:42:26.237043+0000","last_fullsized":"2023-11-04T01:42:26.237043+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:23:00.670603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"65'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.281835+0000","last_change":"2023-11-04T01:42:23.670257+0000","last_active":"2023-11-04T01:42:26.281835+0000","last_peered":"2023-11-04T01:42:26.281835+0000","last_clean":"2023-11-04T01:42:26.281835+0000","last_became_active":"2023-11-04T01:42:23.669974+0000","last_became_peered":"2023-11-04T01:42:23.669974+0000","last_unstale":"2023-11-04T01:42:26.281835+0000","last_undegraded":"2023-11-04T01:42:26.281835+0000","last_fullsized":"2023-11-04T01:42:26.281835+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:45.490508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.662322+0000","last_change":"2023-11-04T01:41:35.728625+0000","last_active":"2023-11-04T01:42:24.662322+0000","last_peered":"2023-11-04T01:42:24.662322+0000","last_clean":"2023-11-04T01:42:24.662322+0000","last_became_active":"2023-11-04T01:41:34.731514+0000","last_became_peered":"2023-11-04T01:41:34.731514+0000","last_unstale":"2023-11-04T01:42:24.662322+0000","last_undegraded":"2023-11-04T01:42:24.662322+0000","last_fullsized":"2023-11-04T01:42:24.662322+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:51:50.413223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047686400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.661314+0000","last_change":"2023-11-04T01:42:24.680590+0000","last_active":"2023-11-04T01:42:25.661314+0000","last_peered":"2023-11-04T01:42:25.661314+0000","last_clean":"2023-11-04T01:42:25.661314+0000","last_became_active":"2023-11-04T01:42:24.680294+0000","last_became_peered":"2023-11-04T01:42:24.680294+0000","last_unstale":"2023-11-04T01:42:25.661314+0000","last_undegraded":"2023-11-04T01:42:25.661314+0000","last_fullsized":"2023-11-04T01:42:25.661314+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:38:08.449615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"65'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.660041+0000","last_change":"2023-11-04T01:42:23.669215+0000","last_active":"2023-11-04T01:42:25.660041+0000","last_peered":"2023-11-04T01:42:25.660041+0000","last_clean":"2023-11-04T01:42:25.660041+0000","last_became_active":"2023-11-04T01:42:23.668942+0000","last_became_peered":"2023-11-04T01:42:23.668942+0000","last_unstale":"2023-11-04T01:42:25.660041+0000","last_undegraded":"2023-11-04T01:42:25.660041+0000","last_fullsized":"2023-11-04T01:42:25.660041+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:44:08.060572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.659485+0000","last_change":"2023-11-04T01:41:36.343762+0000","last_active":"2023-11-04T01:42:24.659485+0000","last_peered":"2023-11-04T01:42:24.659485+0000","last_clean":"2023-11-04T01:42:24.659485+0000","last_became_active":"2023-11-04T01:41:34.733406+0000","last_became_peered":"2023-11-04T01:41:34.733406+0000","last_unstale":"2023-11-04T01:42:24.659485+0000","last_undegraded":"2023-11-04T01:42:24.659485+0000","last_fullsized":"2023-11-04T01:42:24.659485+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:34:35.541159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058533399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.661651+0000","last_change":"2023-11-04T01:42:24.677694+0000","last_active":"2023-11-04T01:42:25.661651+0000","last_peered":"2023-11-04T01:42:25.661651+0000","last_clean":"2023-11-04T01:42:25.661651+0000","last_became_active":"2023-11-04T01:42:24.677419+0000","last_became_peered":"2023-11-04T01:42:24.677419+0000","last_unstale":"2023-11-04T01:42:25.661651+0000","last_undegraded":"2023-11-04T01:42:25.661651+0000","last_fullsized":"2023-11-04T01:42:25.661651+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:59:33.999093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"65'4","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.661826+0000","last_change":"2023-11-04T01:42:23.662871+0000","last_active":"2023-11-04T01:42:25.661826+0000","last_peered":"2023-11-04T01:42:25.661826+0000","last_clean":"2023-11-04T01:42:25.661826+0000","last_became_active":"2023-11-04T01:42:23.662572+0000","last_became_peered":"2023-11-04T01:42:23.662572+0000","last_unstale":"2023-11-04T01:42:25.661826+0000","last_undegraded":"2023-11-04T01:42:25.661826+0000","last_fullsized":"2023-11-04T01:42:25.661826+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:01:24.160393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":35,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.672954+0000","last_change":"2023-11-04T01:41:35.906297+0000","last_active":"2023-11-04T01:42:24.672954+0000","last_peered":"2023-11-04T01:42:24.672954+0000","last_clean":"2023-11-04T01:42:24.672954+0000","last_became_active":"2023-11-04T01:41:34.734134+0000","last_became_peered":"2023-11-04T01:41:34.734134+0000","last_unstale":"2023-11-04T01:42:24.672954+0000","last_undegraded":"2023-11-04T01:42:24.672954+0000","last_fullsized":"2023-11-04T01:42:24.672954+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:52.597063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087104900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.236491+0000","last_change":"2023-11-04T01:42:24.686615+0000","last_active":"2023-11-04T01:42:26.236491+0000","last_peered":"2023-11-04T01:42:26.236491+0000","last_clean":"2023-11-04T01:42:26.236491+0000","last_became_active":"2023-11-04T01:42:24.686183+0000","last_became_peered":"2023-11-04T01:42:24.686183+0000","last_unstale":"2023-11-04T01:42:26.236491+0000","last_undegraded":"2023-11-04T01:42:26.236491+0000","last_fullsized":"2023-11-04T01:42:26.236491+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:49:08.332268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.236856+0000","last_change":"2023-11-04T01:42:23.667567+0000","last_active":"2023-11-04T01:42:26.236856+0000","last_peered":"2023-11-04T01:42:26.236856+0000","last_clean":"2023-11-04T01:42:26.236856+0000","last_became_active":"2023-11-04T01:42:23.667207+0000","last_became_peered":"2023-11-04T01:42:23.667207+0000","last_unstale":"2023-11-04T01:42:26.236856+0000","last_undegraded":"2023-11-04T01:42:26.236856+0000","last_fullsized":"2023-11-04T01:42:26.236856+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:44:32.155572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":35,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.670486+0000","last_change":"2023-11-04T01:41:35.906596+0000","last_active":"2023-11-04T01:42:24.670486+0000","last_peered":"2023-11-04T01:42:24.670486+0000","last_clean":"2023-11-04T01:42:24.670486+0000","last_became_active":"2023-11-04T01:41:34.738529+0000","last_became_peered":"2023-11-04T01:41:34.738529+0000","last_unstale":"2023-11-04T01:42:24.670486+0000","last_undegraded":"2023-11-04T01:42:24.670486+0000","last_fullsized":"2023-11-04T01:42:24.670486+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:48.121273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086660600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.740425+0000","last_change":"2023-11-04T01:42:24.675167+0000","last_active":"2023-11-04T01:42:25.740425+0000","last_peered":"2023-11-04T01:42:25.740425+0000","last_clean":"2023-11-04T01:42:25.740425+0000","last_became_active":"2023-11-04T01:42:24.674923+0000","last_became_peered":"2023-11-04T01:42:24.674923+0000","last_unstale":"2023-11-04T01:42:25.740425+0000","last_undegraded":"2023-11-04T01:42:25.740425+0000","last_fullsized":"2023-11-04T01:42:25.740425+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:32:59.831945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.281205+0000","last_change":"2023-11-04T01:42:23.672875+0000","last_active":"2023-11-04T01:42:26.281205+0000","last_peered":"2023-11-04T01:42:26.281205+0000","last_clean":"2023-11-04T01:42:26.281205+0000","last_became_active":"2023-11-04T01:42:23.672421+0000","last_became_peered":"2023-11-04T01:42:23.672421+0000","last_unstale":"2023-11-04T01:42:26.281205+0000","last_undegraded":"2023-11-04T01:42:26.281205+0000","last_fullsized":"2023-11-04T01:42:26.281205+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:46:59.014740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":35,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.672972+0000","last_change":"2023-11-04T01:41:35.906430+0000","last_active":"2023-11-04T01:42:24.672972+0000","last_peered":"2023-11-04T01:42:24.672972+0000","last_clean":"2023-11-04T01:42:24.672972+0000","last_became_active":"2023-11-04T01:41:34.741147+0000","last_became_peered":"2023-11-04T01:41:34.741147+0000","last_unstale":"2023-11-04T01:42:24.672972+0000","last_undegraded":"2023-11-04T01:42:24.672972+0000","last_fullsized":"2023-11-04T01:42:24.672972+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:20.089706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090504400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.236763+0000","last_change":"2023-11-04T01:42:24.680481+0000","last_active":"2023-11-04T01:42:26.236763+0000","last_peered":"2023-11-04T01:42:26.236763+0000","last_clean":"2023-11-04T01:42:26.236763+0000","last_became_active":"2023-11-04T01:42:24.680193+0000","last_became_peered":"2023-11-04T01:42:24.680193+0000","last_unstale":"2023-11-04T01:42:26.236763+0000","last_undegraded":"2023-11-04T01:42:26.236763+0000","last_fullsized":"2023-11-04T01:42:26.236763+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:40:27.967590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.740297+0000","last_change":"2023-11-04T01:42:23.665691+0000","last_active":"2023-11-04T01:42:25.740297+0000","last_peered":"2023-11-04T01:42:25.740297+0000","last_clean":"2023-11-04T01:42:25.740297+0000","last_became_active":"2023-11-04T01:42:23.665391+0000","last_became_peered":"2023-11-04T01:42:23.665391+0000","last_unstale":"2023-11-04T01:42:25.740297+0000","last_undegraded":"2023-11-04T01:42:25.740297+0000","last_fullsized":"2023-11-04T01:42:25.740297+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:20:49.913421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.659436+0000","last_change":"2023-11-04T01:41:36.344408+0000","last_active":"2023-11-04T01:42:24.659436+0000","last_peered":"2023-11-04T01:42:24.659436+0000","last_clean":"2023-11-04T01:42:24.659436+0000","last_became_active":"2023-11-04T01:41:34.730735+0000","last_became_peered":"2023-11-04T01:41:34.730735+0000","last_unstale":"2023-11-04T01:42:24.659436+0000","last_undegraded":"2023-11-04T01:42:24.659436+0000","last_fullsized":"2023-11-04T01:42:24.659436+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:10:58.095232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081464299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.660940+0000","last_change":"2023-11-04T01:42:24.675335+0000","last_active":"2023-11-04T01:42:25.660940+0000","last_peered":"2023-11-04T01:42:25.660940+0000","last_clean":"2023-11-04T01:42:25.660940+0000","last_became_active":"2023-11-04T01:42:24.675064+0000","last_became_peered":"2023-11-04T01:42:24.675064+0000","last_unstale":"2023-11-04T01:42:25.660940+0000","last_undegraded":"2023-11-04T01:42:25.660940+0000","last_fullsized":"2023-11-04T01:42:25.660940+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:32:43.337265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.660852+0000","last_change":"2023-11-04T01:42:23.664478+0000","last_active":"2023-11-04T01:42:25.660852+0000","last_peered":"2023-11-04T01:42:25.660852+0000","last_clean":"2023-11-04T01:42:25.660852+0000","last_became_active":"2023-11-04T01:42:23.664202+0000","last_became_peered":"2023-11-04T01:42:23.664202+0000","last_unstale":"2023-11-04T01:42:25.660852+0000","last_undegraded":"2023-11-04T01:42:25.660852+0000","last_fullsized":"2023-11-04T01:42:25.660852+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:38:47.708313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":39,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.668237+0000","last_change":"2023-11-04T01:41:36.244245+0000","last_active":"2023-11-04T01:42:24.668237+0000","last_peered":"2023-11-04T01:42:24.668237+0000","last_clean":"2023-11-04T01:42:24.668237+0000","last_became_active":"2023-11-04T01:41:34.734925+0000","last_became_peered":"2023-11-04T01:41:34.734925+0000","last_unstale":"2023-11-04T01:42:24.668237+0000","last_undegraded":"2023-11-04T01:42:24.668237+0000","last_fullsized":"2023-11-04T01:42:24.668237+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:44.193748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025350200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.661491+0000","last_change":"2023-11-04T01:42:24.683850+0000","last_active":"2023-11-04T01:42:25.661491+0000","last_peered":"2023-11-04T01:42:25.661491+0000","last_clean":"2023-11-04T01:42:25.661491+0000","last_became_active":"2023-11-04T01:42:24.683471+0000","last_became_peered":"2023-11-04T01:42:24.683471+0000","last_unstale":"2023-11-04T01:42:25.661491+0000","last_undegraded":"2023-11-04T01:42:25.661491+0000","last_fullsized":"2023-11-04T01:42:25.661491+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:23:37.634543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.660012+0000","last_change":"2023-11-04T01:42:23.669866+0000","last_active":"2023-11-04T01:42:25.660012+0000","last_peered":"2023-11-04T01:42:25.660012+0000","last_clean":"2023-11-04T01:42:25.660012+0000","last_became_active":"2023-11-04T01:42:23.669608+0000","last_became_peered":"2023-11-04T01:42:23.669608+0000","last_unstale":"2023-11-04T01:42:25.660012+0000","last_undegraded":"2023-11-04T01:42:25.660012+0000","last_fullsized":"2023-11-04T01:42:25.660012+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:36.766111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.659674+0000","last_change":"2023-11-04T01:41:36.343956+0000","last_active":"2023-11-04T01:42:24.659674+0000","last_peered":"2023-11-04T01:42:24.659674+0000","last_clean":"2023-11-04T01:42:24.659674+0000","last_became_active":"2023-11-04T01:41:34.736013+0000","last_became_peered":"2023-11-04T01:41:34.736013+0000","last_unstale":"2023-11-04T01:42:24.659674+0000","last_undegraded":"2023-11-04T01:42:24.659674+0000","last_fullsized":"2023-11-04T01:42:24.659674+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:08.858430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081427799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.661299+0000","last_change":"2023-11-04T01:42:24.679629+0000","last_active":"2023-11-04T01:42:25.661299+0000","last_peered":"2023-11-04T01:42:25.661299+0000","last_clean":"2023-11-04T01:42:25.661299+0000","last_became_active":"2023-11-04T01:42:24.679284+0000","last_became_peered":"2023-11-04T01:42:24.679284+0000","last_unstale":"2023-11-04T01:42:25.661299+0000","last_undegraded":"2023-11-04T01:42:25.661299+0000","last_fullsized":"2023-11-04T01:42:25.661299+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:44:09.067211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.661176+0000","last_change":"2023-11-04T01:42:23.667062+0000","last_active":"2023-11-04T01:42:25.661176+0000","last_peered":"2023-11-04T01:42:25.661176+0000","last_clean":"2023-11-04T01:42:25.661176+0000","last_became_active":"2023-11-04T01:42:23.666763+0000","last_became_peered":"2023-11-04T01:42:23.666763+0000","last_unstale":"2023-11-04T01:42:25.661176+0000","last_undegraded":"2023-11-04T01:42:25.661176+0000","last_fullsized":"2023-11-04T01:42:25.661176+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:31:52.594542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":39,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.667411+0000","last_change":"2023-11-04T01:41:36.243977+0000","last_active":"2023-11-04T01:42:24.667411+0000","last_peered":"2023-11-04T01:42:24.667411+0000","last_clean":"2023-11-04T01:42:24.667411+0000","last_became_active":"2023-11-04T01:41:34.733127+0000","last_became_peered":"2023-11-04T01:41:34.733127+0000","last_unstale":"2023-11-04T01:42:24.667411+0000","last_undegraded":"2023-11-04T01:42:24.667411+0000","last_fullsized":"2023-11-04T01:42:24.667411+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:36.118907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051788300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.281976+0000","last_change":"2023-11-04T01:42:24.679074+0000","last_active":"2023-11-04T01:42:26.281976+0000","last_peered":"2023-11-04T01:42:26.281976+0000","last_clean":"2023-11-04T01:42:26.281976+0000","last_became_active":"2023-11-04T01:42:24.678812+0000","last_became_peered":"2023-11-04T01:42:24.678812+0000","last_unstale":"2023-11-04T01:42:26.281976+0000","last_undegraded":"2023-11-04T01:42:26.281976+0000","last_fullsized":"2023-11-04T01:42:26.281976+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:19:01.258080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.674300+0000","last_change":"2023-11-04T01:42:23.665020+0000","last_active":"2023-11-04T01:42:24.674300+0000","last_peered":"2023-11-04T01:42:24.674300+0000","last_clean":"2023-11-04T01:42:24.674300+0000","last_became_active":"2023-11-04T01:42:23.664751+0000","last_became_peered":"2023-11-04T01:42:23.664751+0000","last_unstale":"2023-11-04T01:42:24.674300+0000","last_undegraded":"2023-11-04T01:42:24.674300+0000","last_fullsized":"2023-11-04T01:42:24.674300+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:50:31.579987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.664212+0000","last_change":"2023-11-04T01:41:36.067797+0000","last_active":"2023-11-04T01:42:24.664212+0000","last_peered":"2023-11-04T01:42:24.664212+0000","last_clean":"2023-11-04T01:42:24.664212+0000","last_became_active":"2023-11-04T01:41:34.734880+0000","last_became_peered":"2023-11-04T01:41:34.734880+0000","last_unstale":"2023-11-04T01:42:24.664212+0000","last_undegraded":"2023-11-04T01:42:24.664212+0000","last_fullsized":"2023-11-04T01:42:24.664212+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:20.089706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036003499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.660037+0000","last_change":"2023-11-04T01:42:24.670000+0000","last_active":"2023-11-04T01:42:25.660037+0000","last_peered":"2023-11-04T01:42:25.660037+0000","last_clean":"2023-11-04T01:42:25.660037+0000","last_became_active":"2023-11-04T01:42:24.669694+0000","last_became_peered":"2023-11-04T01:42:24.669694+0000","last_unstale":"2023-11-04T01:42:25.660037+0000","last_undegraded":"2023-11-04T01:42:25.660037+0000","last_fullsized":"2023-11-04T01:42:25.660037+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:24:17.420867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"65'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.237277+0000","last_change":"2023-11-04T01:42:23.663209+0000","last_active":"2023-11-04T01:42:26.237277+0000","last_peered":"2023-11-04T01:42:26.237277+0000","last_clean":"2023-11-04T01:42:26.237277+0000","last_became_active":"2023-11-04T01:42:23.662949+0000","last_became_peered":"2023-11-04T01:42:23.662949+0000","last_unstale":"2023-11-04T01:42:26.237277+0000","last_undegraded":"2023-11-04T01:42:26.237277+0000","last_fullsized":"2023-11-04T01:42:26.237277+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:12:43.021307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.663055+0000","last_change":"2023-11-04T01:41:35.729089+0000","last_active":"2023-11-04T01:42:24.663055+0000","last_peered":"2023-11-04T01:42:24.663055+0000","last_clean":"2023-11-04T01:42:24.663055+0000","last_became_active":"2023-11-04T01:41:34.731063+0000","last_became_peered":"2023-11-04T01:41:34.731063+0000","last_unstale":"2023-11-04T01:42:24.663055+0000","last_undegraded":"2023-11-04T01:42:24.663055+0000","last_fullsized":"2023-11-04T01:42:24.663055+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:38:46.633175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083653600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.270675+0000","last_change":"2023-11-04T01:42:24.682590+0000","last_active":"2023-11-04T01:42:26.270675+0000","last_peered":"2023-11-04T01:42:26.270675+0000","last_clean":"2023-11-04T01:42:26.270675+0000","last_became_active":"2023-11-04T01:42:24.682309+0000","last_became_peered":"2023-11-04T01:42:24.682309+0000","last_unstale":"2023-11-04T01:42:26.270675+0000","last_undegraded":"2023-11-04T01:42:26.270675+0000","last_fullsized":"2023-11-04T01:42:26.270675+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:08:18.202465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.659740+0000","last_change":"2023-11-04T01:42:23.667693+0000","last_active":"2023-11-04T01:42:25.659740+0000","last_peered":"2023-11-04T01:42:25.659740+0000","last_clean":"2023-11-04T01:42:25.659740+0000","last_became_active":"2023-11-04T01:42:23.667442+0000","last_became_peered":"2023-11-04T01:42:23.667442+0000","last_unstale":"2023-11-04T01:42:25.659740+0000","last_undegraded":"2023-11-04T01:42:25.659740+0000","last_fullsized":"2023-11-04T01:42:25.659740+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:39:30.978971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":41,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.665489+0000","last_change":"2023-11-04T01:41:35.729232+0000","last_active":"2023-11-04T01:42:24.665489+0000","last_peered":"2023-11-04T01:42:24.665489+0000","last_clean":"2023-11-04T01:42:24.665489+0000","last_became_active":"2023-11-04T01:41:34.731490+0000","last_became_peered":"2023-11-04T01:41:34.731490+0000","last_unstale":"2023-11-04T01:42:24.665489+0000","last_undegraded":"2023-11-04T01:42:24.665489+0000","last_fullsized":"2023-11-04T01:42:24.665489+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:37.958719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089653699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.270622+0000","last_change":"2023-11-04T01:42:24.683167+0000","last_active":"2023-11-04T01:42:26.270622+0000","last_peered":"2023-11-04T01:42:26.270622+0000","last_clean":"2023-11-04T01:42:26.270622+0000","last_became_active":"2023-11-04T01:42:24.682922+0000","last_became_peered":"2023-11-04T01:42:24.682922+0000","last_unstale":"2023-11-04T01:42:26.270622+0000","last_undegraded":"2023-11-04T01:42:26.270622+0000","last_fullsized":"2023-11-04T01:42:26.270622+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:41:29.820820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.670871+0000","last_change":"2023-11-04T01:42:23.660971+0000","last_active":"2023-11-04T01:42:24.670871+0000","last_peered":"2023-11-04T01:42:24.670871+0000","last_clean":"2023-11-04T01:42:24.670871+0000","last_became_active":"2023-11-04T01:42:23.660570+0000","last_became_peered":"2023-11-04T01:42:23.660570+0000","last_unstale":"2023-11-04T01:42:24.670871+0000","last_undegraded":"2023-11-04T01:42:24.670871+0000","last_fullsized":"2023-11-04T01:42:24.670871+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:50:59.289771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.659850+0000","last_change":"2023-11-04T01:41:36.344018+0000","last_active":"2023-11-04T01:42:24.659850+0000","last_peered":"2023-11-04T01:42:24.659850+0000","last_clean":"2023-11-04T01:42:24.659850+0000","last_became_active":"2023-11-04T01:41:34.734178+0000","last_became_peered":"2023-11-04T01:41:34.734178+0000","last_unstale":"2023-11-04T01:42:24.659850+0000","last_undegraded":"2023-11-04T01:42:24.659850+0000","last_fullsized":"2023-11-04T01:42:24.659850+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:16.970814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077338299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.270707+0000","last_change":"2023-11-04T01:42:24.669973+0000","last_active":"2023-11-04T01:42:26.270707+0000","last_peered":"2023-11-04T01:42:26.270707+0000","last_clean":"2023-11-04T01:42:26.270707+0000","last_became_active":"2023-11-04T01:42:24.669702+0000","last_became_peered":"2023-11-04T01:42:24.669702+0000","last_unstale":"2023-11-04T01:42:26.270707+0000","last_undegraded":"2023-11-04T01:42:26.270707+0000","last_fullsized":"2023-11-04T01:42:26.270707+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:18.909394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.236747+0000","last_change":"2023-11-04T01:42:23.670382+0000","last_active":"2023-11-04T01:42:26.236747+0000","last_peered":"2023-11-04T01:42:26.236747+0000","last_clean":"2023-11-04T01:42:26.236747+0000","last_became_active":"2023-11-04T01:42:23.669480+0000","last_became_peered":"2023-11-04T01:42:23.669480+0000","last_unstale":"2023-11-04T01:42:26.236747+0000","last_undegraded":"2023-11-04T01:42:26.236747+0000","last_fullsized":"2023-11-04T01:42:26.236747+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:46:59.014740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":35,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.670060+0000","last_change":"2023-11-04T01:41:35.906788+0000","last_active":"2023-11-04T01:42:24.670060+0000","last_peered":"2023-11-04T01:42:24.670060+0000","last_clean":"2023-11-04T01:42:24.670060+0000","last_became_active":"2023-11-04T01:41:34.734386+0000","last_became_peered":"2023-11-04T01:41:34.734386+0000","last_unstale":"2023-11-04T01:42:24.670060+0000","last_undegraded":"2023-11-04T01:42:24.670060+0000","last_fullsized":"2023-11-04T01:42:24.670060+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:23:23.733128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060435600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.661110+0000","last_change":"2023-11-04T01:42:24.688196+0000","last_active":"2023-11-04T01:42:25.661110+0000","last_peered":"2023-11-04T01:42:25.661110+0000","last_clean":"2023-11-04T01:42:25.661110+0000","last_became_active":"2023-11-04T01:42:24.687882+0000","last_became_peered":"2023-11-04T01:42:24.687882+0000","last_unstale":"2023-11-04T01:42:25.661110+0000","last_undegraded":"2023-11-04T01:42:25.661110+0000","last_fullsized":"2023-11-04T01:42:25.661110+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:36:22.800149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.661385+0000","last_change":"2023-11-04T01:42:23.666898+0000","last_active":"2023-11-04T01:42:25.661385+0000","last_peered":"2023-11-04T01:42:25.661385+0000","last_clean":"2023-11-04T01:42:25.661385+0000","last_became_active":"2023-11-04T01:42:23.666589+0000","last_became_peered":"2023-11-04T01:42:23.666589+0000","last_unstale":"2023-11-04T01:42:25.661385+0000","last_undegraded":"2023-11-04T01:42:25.661385+0000","last_fullsized":"2023-11-04T01:42:25.661385+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:00:23.345186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":35,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.678459+0000","last_change":"2023-11-04T01:41:35.931718+0000","last_active":"2023-11-04T01:42:24.678459+0000","last_peered":"2023-11-04T01:42:24.678459+0000","last_clean":"2023-11-04T01:42:24.678459+0000","last_became_active":"2023-11-04T01:41:34.741033+0000","last_became_peered":"2023-11-04T01:41:34.741033+0000","last_unstale":"2023-11-04T01:42:24.678459+0000","last_undegraded":"2023-11-04T01:42:24.678459+0000","last_fullsized":"2023-11-04T01:42:24.678459+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:48.121273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065858400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.740619+0000","last_change":"2023-11-04T01:42:24.674522+0000","last_active":"2023-11-04T01:42:25.740619+0000","last_peered":"2023-11-04T01:42:25.740619+0000","last_clean":"2023-11-04T01:42:25.740619+0000","last_became_active":"2023-11-04T01:42:24.674206+0000","last_became_peered":"2023-11-04T01:42:24.674206+0000","last_unstale":"2023-11-04T01:42:25.740619+0000","last_undegraded":"2023-11-04T01:42:25.740619+0000","last_fullsized":"2023-11-04T01:42:25.740619+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:44:33.162210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"65'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.236912+0000","last_change":"2023-11-04T01:42:23.666159+0000","last_active":"2023-11-04T01:42:26.236912+0000","last_peered":"2023-11-04T01:42:26.236912+0000","last_clean":"2023-11-04T01:42:26.236912+0000","last_became_active":"2023-11-04T01:42:23.665886+0000","last_became_peered":"2023-11-04T01:42:23.665886+0000","last_unstale":"2023-11-04T01:42:26.236912+0000","last_undegraded":"2023-11-04T01:42:26.236912+0000","last_fullsized":"2023-11-04T01:42:26.236912+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:57:29.058454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":34,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.670278+0000","last_change":"2023-11-04T01:41:35.728094+0000","last_active":"2023-11-04T01:42:24.670278+0000","last_peered":"2023-11-04T01:42:24.670278+0000","last_clean":"2023-11-04T01:42:24.670278+0000","last_became_active":"2023-11-04T01:41:34.738687+0000","last_became_peered":"2023-11-04T01:41:34.738687+0000","last_unstale":"2023-11-04T01:42:24.670278+0000","last_undegraded":"2023-11-04T01:42:24.670278+0000","last_fullsized":"2023-11-04T01:42:24.670278+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:37.958719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068772699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.661710+0000","last_change":"2023-11-04T01:42:24.669907+0000","last_active":"2023-11-04T01:42:25.661710+0000","last_peered":"2023-11-04T01:42:25.661710+0000","last_clean":"2023-11-04T01:42:25.661710+0000","last_became_active":"2023-11-04T01:42:24.669623+0000","last_became_peered":"2023-11-04T01:42:24.669623+0000","last_unstale":"2023-11-04T01:42:25.661710+0000","last_undegraded":"2023-11-04T01:42:25.661710+0000","last_fullsized":"2023-11-04T01:42:25.661710+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:21.018644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"65'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.281952+0000","last_change":"2023-11-04T01:42:23.670000+0000","last_active":"2023-11-04T01:42:26.281952+0000","last_peered":"2023-11-04T01:42:26.281952+0000","last_clean":"2023-11-04T01:42:26.281952+0000","last_became_active":"2023-11-04T01:42:23.669688+0000","last_became_peered":"2023-11-04T01:42:23.669688+0000","last_unstale":"2023-11-04T01:42:26.281952+0000","last_undegraded":"2023-11-04T01:42:26.281952+0000","last_fullsized":"2023-11-04T01:42:26.281952+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:57:29.058454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.662854+0000","last_change":"2023-11-04T01:41:35.729106+0000","last_active":"2023-11-04T01:42:24.662854+0000","last_peered":"2023-11-04T01:42:24.662854+0000","last_clean":"2023-11-04T01:42:24.662854+0000","last_became_active":"2023-11-04T01:41:34.731230+0000","last_became_peered":"2023-11-04T01:41:34.731230+0000","last_unstale":"2023-11-04T01:42:24.662854+0000","last_undegraded":"2023-11-04T01:42:24.662854+0000","last_fullsized":"2023-11-04T01:42:24.662854+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:07:32.744572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078592199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.282100+0000","last_change":"2023-11-04T01:42:24.687435+0000","last_active":"2023-11-04T01:42:26.282100+0000","last_peered":"2023-11-04T01:42:26.282100+0000","last_clean":"2023-11-04T01:42:26.282100+0000","last_became_active":"2023-11-04T01:42:24.687060+0000","last_became_peered":"2023-11-04T01:42:24.687060+0000","last_unstale":"2023-11-04T01:42:26.282100+0000","last_undegraded":"2023-11-04T01:42:26.282100+0000","last_fullsized":"2023-11-04T01:42:26.282100+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:40:27.967590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"65'1","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.237142+0000","last_change":"2023-11-04T01:42:23.663997+0000","last_active":"2023-11-04T01:42:26.237142+0000","last_peered":"2023-11-04T01:42:26.237142+0000","last_clean":"2023-11-04T01:42:26.237142+0000","last_became_active":"2023-11-04T01:42:23.663752+0000","last_became_peered":"2023-11-04T01:42:23.663752+0000","last_unstale":"2023-11-04T01:42:26.237142+0000","last_undegraded":"2023-11-04T01:42:26.237142+0000","last_fullsized":"2023-11-04T01:42:26.237142+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:52:47.508878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":37,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.663127+0000","last_change":"2023-11-04T01:41:35.728672+0000","last_active":"2023-11-04T01:42:24.663127+0000","last_peered":"2023-11-04T01:42:24.663127+0000","last_clean":"2023-11-04T01:42:24.663127+0000","last_became_active":"2023-11-04T01:41:34.727419+0000","last_became_peered":"2023-11-04T01:41:34.727419+0000","last_unstale":"2023-11-04T01:42:24.663127+0000","last_undegraded":"2023-11-04T01:42:24.663127+0000","last_fullsized":"2023-11-04T01:42:24.663127+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:35:01.127206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044278299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.270693+0000","last_change":"2023-11-04T01:42:24.677302+0000","last_active":"2023-11-04T01:42:26.270693+0000","last_peered":"2023-11-04T01:42:26.270693+0000","last_clean":"2023-11-04T01:42:26.270693+0000","last_became_active":"2023-11-04T01:42:24.677025+0000","last_became_peered":"2023-11-04T01:42:24.677025+0000","last_unstale":"2023-11-04T01:42:26.270693+0000","last_undegraded":"2023-11-04T01:42:26.270693+0000","last_fullsized":"2023-11-04T01:42:26.270693+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.644895+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.644895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:22:06.846529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"65'2","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.236739+0000","last_change":"2023-11-04T01:42:23.671562+0000","last_active":"2023-11-04T01:42:26.236739+0000","last_peered":"2023-11-04T01:42:26.236739+0000","last_clean":"2023-11-04T01:42:26.236739+0000","last_became_active":"2023-11-04T01:42:23.671333+0000","last_became_peered":"2023-11-04T01:42:23.671333+0000","last_unstale":"2023-11-04T01:42:26.236739+0000","last_undegraded":"2023-11-04T01:42:26.236739+0000","last_fullsized":"2023-11-04T01:42:26.236739+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.638256+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.638256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:32:58.825306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":36,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.659908+0000","last_change":"2023-11-04T01:41:36.344271+0000","last_active":"2023-11-04T01:42:24.659908+0000","last_peered":"2023-11-04T01:42:24.659908+0000","last_clean":"2023-11-04T01:42:24.659908+0000","last_became_active":"2023-11-04T01:41:34.732524+0000","last_became_peered":"2023-11-04T01:41:34.732524+0000","last_unstale":"2023-11-04T01:42:24.659908+0000","last_undegraded":"2023-11-04T01:42:24.659908+0000","last_fullsized":"2023-11-04T01:42:24.659908+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:19.350812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081160599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":212,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.662799+0000","last_change":"2023-11-04T01:39:54.204460+0000","last_active":"2023-11-04T01:42:24.662799+0000","last_peered":"2023-11-04T01:42:24.662799+0000","last_clean":"2023-11-04T01:42:24.662799+0000","last_became_active":"2023-11-04T01:39:54.203352+0000","last_became_peered":"2023-11-04T01:39:54.203352+0000","last_unstale":"2023-11-04T01:42:24.662799+0000","last_undegraded":"2023-11-04T01:42:24.662799+0000","last_fullsized":"2023-11-04T01:42:24.662799+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:52.627032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:52.627032+0000","last_clean_scrub_stamp":"2023-11-04T01:39:52.627032+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:17:18.474768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":370195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53500000000000003,"15min":0.53800000000000003},"min":{"1min":0.40400000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.70199999999999996,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.499,"15min":0.497},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.56599999999999995}]},{"osd":1,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55300000000000005,"15min":0.55200000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.71999999999999997,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.66500000000000004}]},{"osd":2,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57099999999999995,"15min":0.57499999999999996},"min":{"1min":0.375,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.752,"5min":1.177,"15min":1.177},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55000000000000004,"15min":0.55400000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.55000000000000004}]},{"osd":3,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.76200000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.63100000000000001,"15min":0.63600000000000001},"min":{"1min":0.49199999999999999,"5min":0.435,"15min":0.435},"max":{"1min":0.79800000000000004,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.629}]},{"osd":4,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.318,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77400000000000002,"5min":1.048,"15min":1.048},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.32900000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.60899999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.39100000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.438,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.71399999999999997,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.498}]},{"osd":7,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.56999999999999995,"15min":0.55900000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.442},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.627,"15min":0.624},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.47799999999999998}]}]},{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32548,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339292,"statfs":{"total":96636764160,"available":96603435008,"internally_reserved":0,"allocated":1400832,"data_stored":961089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.53200000000000003,"15min":0.51600000000000001},"min":{"1min":0.38100000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.67800000000000005}]},{"osd":1,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.42399999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83599999999999997,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.63200000000000001,"15min":0.61599999999999999},"min":{"1min":0.46800000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.5049999999999999,"5min":2.5049999999999999,"15min":2.5049999999999999},"last":0.59499999999999997}]},{"osd":2,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.59299999999999997,"15min":0.58499999999999996},"min":{"1min":0.42799999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.621,"15min":0.60399999999999998},"min":{"1min":0.50800000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.77500000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.58599999999999997,"15min":0.56499999999999995},"min":{"1min":0.40100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":3.2349999999999999,"5min":3.2349999999999999,"15min":3.2349999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.37,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79200000000000004,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.64800000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.5,"15min":0.48599999999999999},"min":{"1min":0.308,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.47999999999999998,"15min":0.46999999999999997},"min":{"1min":0.36599999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.436}]},{"osd":5,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.52400000000000002,"15min":0.503},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.55200000000000005,"15min":0.53000000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":2.4500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.46300000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.623,"15min":0.58899999999999997},"min":{"1min":0.39700000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":3.7850000000000001,"5min":3.7850000000000001,"15min":3.7850000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.56999999999999995,"15min":0.55400000000000005},"min":{"1min":0.39200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.53300000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":794624,"data_stored":363224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.40200000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.67100000000000004,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40000000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.64900000000000002,"5min":0.752,"15min":0.752},"last":0.54900000000000004}]},{"osd":1,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56100000000000005,"15min":0.56599999999999995},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.72899999999999998,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.38,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.53400000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.35299999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.69499999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57399999999999995,"15min":0.57899999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.67900000000000005,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.503}]},{"osd":3,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.47299999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.67400000000000004,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57999999999999996,"15min":0.57899999999999996},"min":{"1min":0.434,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.72799999999999998,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.64900000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.746,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.59999999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78800000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58499999999999996,"15min":0.58599999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77600000000000002,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.47699999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.749,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61599999999999999,"15min":0.621},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82399999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.626}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":370175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.505,"15min":0.502},"min":{"1min":0.32000000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66200000000000003,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51200000000000001,"15min":0.50800000000000001},"min":{"1min":0.33900000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.68700000000000006,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.495}]},{"osd":1,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.49099999999999999,"15min":0.48299999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.69899999999999995,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.42299999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.67300000000000004,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.60899999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.53900000000000003},"min":{"1min":0.40300000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71099999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53400000000000003,"15min":0.53500000000000003},"min":{"1min":0.41499999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.67700000000000005,"5min":0.873,"15min":0.873},"last":0.47999999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53300000000000003,"15min":0.53400000000000003},"min":{"1min":0.39200000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.69299999999999995,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.74299999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.41499999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.47999999999999998,"15min":0.48299999999999998},"min":{"1min":0.34100000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.50600000000000001,"15min":0.50900000000000001},"min":{"1min":0.371,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66500000000000004,"5min":0.745,"15min":0.745},"last":0.32600000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.49299999999999999,"15min":0.497},"min":{"1min":0.34499999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.72399999999999998,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.621},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.755,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.53900000000000003}]},{"osd":7,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.40699999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.751,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.378},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.34899999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.747,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.51100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574882,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":794624,"data_stored":363244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.31900000000000001,"15min":0.317},"min":{"1min":0.20599999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.32800000000000001,"15min":0.32200000000000001},"min":{"1min":0.23699999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.443}]},{"osd":1,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.36599999999999999,"15min":0.372},"min":{"1min":0.23899999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.48499999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.5},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.58699999999999997,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.48099999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.36799999999999999,"15min":0.36699999999999999},"min":{"1min":0.28199999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.52700000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.42199999999999999,"15min":0.42699999999999999},"min":{"1min":0.30299999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.50900000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.51800000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.81599999999999995,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58399999999999996,"15min":0.58799999999999997},"min":{"1min":0.40500000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.92300000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58699999999999997,"15min":0.59399999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79400000000000004,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.77900000000000003}]},{"osd":6,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57699999999999996,"15min":0.58099999999999996},"min":{"1min":0.373,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77100000000000002,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60999999999999999,"15min":0.61599999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85199999999999998,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.89900000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.626,"15min":0.628},"min":{"1min":0.46400000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58599999999999997,"15min":0.58899999999999997},"min":{"1min":0.40000000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83199999999999996,"5min":0.87,"15min":0.87},"last":0.73699999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":811008,"data_stored":371717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.32000000000000001,"15min":0.32200000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"last":0.498},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.311}]},{"osd":1,"last update":"Sat Nov 4 01:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.36899999999999999,"15min":0.371},"min":{"1min":0.245,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.373,"15min":0.378},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.42199999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.42199999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.34999999999999998,"15min":0.35499999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.46600000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.371},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.29499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.44900000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.55500000000000005,"15min":0.54700000000000004},"min":{"1min":0.41599999999999998,"5min":0.374,"15min":0.374},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.64000000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.378,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.622},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.41499999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.75}]},{"osd":6,"last update":"Sat Nov 4 01:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58299999999999996,"15min":0.57999999999999996},"min":{"1min":0.43099999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.55900000000000005,"15min":0.55400000000000005},"min":{"1min":0.42199999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.73799999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60099999999999998,"15min":0.59999999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.84599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":819200,"data_stored":372333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.27900000000000003,"5min":0.30299999999999999,"15min":0.307},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.42999999999999999,"5min":0.443,"15min":0.443},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.29399999999999998,"5min":0.312,"15min":0.315},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.27800000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.32700000000000001,"15min":0.33100000000000002},"min":{"1min":0.23400000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.43099999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.373,"15min":0.378},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.52200000000000002,"5min":0.621,"15min":0.621},"last":0.34999999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.371,"15min":0.375},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.46400000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.317},{"interface":"front","average":{"1min":0.371,"5min":0.40200000000000002,"15min":0.40699999999999997},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.24099999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.57899999999999996,"15min":0.58999999999999997},"min":{"1min":0.36699999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.65100000000000002,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56299999999999994,"15min":0.56599999999999995},"min":{"1min":0.38500000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.58299999999999996}]},{"osd":5,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53900000000000003,"15min":0.54000000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59799999999999998,"15min":0.60699999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.71699999999999997,"5min":0.87,"15min":0.87},"last":0.55400000000000005}]},{"osd":6,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56299999999999994,"15min":0.56599999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77800000000000002,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.60399999999999998,"15min":0.61399999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72499999999999998,"5min":1.129,"15min":1.129},"last":0.621}]},{"osd":7,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.629,"15min":0.63700000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.75600000000000001,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.625,"15min":0.63300000000000001},"min":{"1min":0.42399999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82799999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.68100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28384,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343456,"statfs":{"total":96636764160,"available":96607698944,"internally_reserved":0,"allocated":1388544,"data_stored":959454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.33000000000000002,"15min":0.33400000000000002},"min":{"1min":0.20799999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.40000000000000002,"5min":0.874,"15min":0.874},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.38500000000000001,"15min":0.39200000000000002},"min":{"1min":0.28799999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.496,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.29099999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.36799999999999999,"15min":0.379},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.44900000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.312},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.37,"15min":0.377},"min":{"1min":0.27100000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.41999999999999998,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.26200000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.35599999999999998,"15min":0.35999999999999999},"min":{"1min":0.248,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.44600000000000001,"5min":1.278,"15min":1.278},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.434,"15min":0.442},"min":{"1min":0.33000000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.52900000000000003,"5min":1.304,"15min":1.304},"last":0.37}]},{"osd":4,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81799999999999995,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.437},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.629,"15min":0.627},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.83399999999999996,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.499}]},{"osd":5,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.378,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.59899999999999998,"15min":0.60499999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.873,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.52800000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.622,"15min":0.621},"min":{"1min":0.41799999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90200000000000002,"5min":1.248,"15min":1.248},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42899999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.47299999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.62,"15min":0.622},"min":{"1min":0.42999999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.54500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:42:28.945 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T01:42:28.945 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-04T01:42:29.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.082+0000 7f0408689640 1 Processor -- start 2023-11-04T01:42:29.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.082+0000 7f0408689640 1 -- start start 2023-11-04T01:42:29.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.083+0000 7f0408689640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0400153e60 0x7f040015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.083+0000 7f0408689640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f04000cd6d0 0x7f0400161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.083+0000 7f0408689640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04000b4880 0x7f04000b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.083+0000 7f0408689640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04000cde60 con 0x7f0400153e60 2023-11-04T01:42:29.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.083+0000 7f0408689640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04000b5220 con 0x7f04000cd6d0 2023-11-04T01:42:29.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.083+0000 7f0408689640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0400160f90 con 0x7f04000b4880 2023-11-04T01:42:29.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.083+0000 7f0406425640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0400153e60 0x7f040015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.084+0000 7f0406425640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0400153e60 0x7f040015dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:32934/0 (socket says 172.21.15.77:32934) 2023-11-04T01:42:29.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.084+0000 7f0406425640 1 -- 172.21.15.77:0/1970447334 learned_addr learned my addr 172.21.15.77:0/1970447334 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:29.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.084+0000 7f0406c26640 1 --2- 172.21.15.77:0/1970447334 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04000b4880 0x7f04000b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.084+0000 7f0405c24640 1 --2- 172.21.15.77:0/1970447334 >> v2:172.21.15.122:3300/0 conn(0x7f04000cd6d0 0x7f0400161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.084+0000 7f0406425640 1 -- 172.21.15.77:0/1970447334 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04000b4880 msgr2=0x7f04000b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:29.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.084+0000 7f0406425640 1 --2- 172.21.15.77:0/1970447334 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04000b4880 0x7f04000b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.084+0000 7f0406425640 1 -- 172.21.15.77:0/1970447334 >> v2:172.21.15.122:3300/0 conn(0x7f04000cd6d0 msgr2=0x7f0400161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:29.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.084+0000 7f0406425640 1 --2- 172.21.15.77:0/1970447334 >> v2:172.21.15.122:3300/0 conn(0x7f04000cd6d0 0x7f0400161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.084+0000 7f0406425640 1 -- 172.21.15.77:0/1970447334 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f040015e400 con 0x7f0400153e60 2023-11-04T01:42:29.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.084+0000 7f0406c26640 1 --2- 172.21.15.77:0/1970447334 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04000b4880 0x7f04000b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:29.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.084+0000 7f0405c24640 1 --2- 172.21.15.77:0/1970447334 >> v2:172.21.15.122:3300/0 conn(0x7f04000cd6d0 0x7f0400161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:29.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.085+0000 7f0406425640 1 --2- 172.21.15.77:0/1970447334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0400153e60 0x7f040015dec0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f04000c9e80 tx=0x7f03f002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=176cab1b60f8e221 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:29.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.085+0000 7f0405423640 1 -- 172.21.15.77:0/1970447334 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f0031640 con 0x7f0400153e60 2023-11-04T01:42:29.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.085+0000 7f0405423640 1 -- 172.21.15.77:0/1970447334 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f00317a0 con 0x7f0400153e60 2023-11-04T01:42:29.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.085+0000 7f0405423640 1 -- 172.21.15.77:0/1970447334 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f0031b30 con 0x7f0400153e60 2023-11-04T01:42:29.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.085+0000 7f0408689640 1 -- 172.21.15.77:0/1970447334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0400153e60 msgr2=0x7f040015dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:29.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.085+0000 7f0408689640 1 --2- 172.21.15.77:0/1970447334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0400153e60 0x7f040015dec0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f04000c9e80 tx=0x7f03f002b8f0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.085+0000 7f0408689640 1 -- 172.21.15.77:0/1970447334 shutdown_connections 2023-11-04T01:42:29.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.085+0000 7f0408689640 1 --2- 172.21.15.77:0/1970447334 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04000b4880 0x7f04000b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.085+0000 7f0408689640 1 --2- 172.21.15.77:0/1970447334 >> v2:172.21.15.122:3300/0 conn(0x7f04000cd6d0 0x7f0400161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.085+0000 7f0408689640 1 --2- 172.21.15.77:0/1970447334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0400153e60 0x7f040015dec0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.085+0000 7f0408689640 1 -- 172.21.15.77:0/1970447334 >> 172.21.15.77:0/1970447334 conn(0x7f04000cf880 msgr2=0x7f04000cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:29.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.085+0000 7f0408689640 1 -- 172.21.15.77:0/1970447334 shutdown_connections 2023-11-04T01:42:29.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.085+0000 7f0408689640 1 -- 172.21.15.77:0/1970447334 wait complete. 2023-11-04T01:42:29.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.086+0000 7f0408689640 1 Processor -- start 2023-11-04T01:42:29.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.087+0000 7f0408689640 1 -- start start 2023-11-04T01:42:29.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.087+0000 7f0408689640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04000b4880 0x7f0400157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.087+0000 7f0408689640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04000cd6d0 0x7f04001f2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.087+0000 7f0408689640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0400153e60 0x7f04000b7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.087+0000 7f0408689640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04001f3520 con 0x7f04000cd6d0 2023-11-04T01:42:29.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.087+0000 7f0408689640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0400158580 con 0x7f0400153e60 2023-11-04T01:42:29.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.087+0000 7f0408689640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0400158860 con 0x7f04000b4880 2023-11-04T01:42:29.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.087+0000 7f0405c24640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04000cd6d0 0x7f04001f2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.087+0000 7f0405c24640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04000cd6d0 0x7f04001f2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:32938/0 (socket says 172.21.15.77:32938) 2023-11-04T01:42:29.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.087+0000 7f0405c24640 1 -- 172.21.15.77:0/2403809515 learned_addr learned my addr 172.21.15.77:0/2403809515 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:29.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.088+0000 7f0406425640 1 --2- 172.21.15.77:0/2403809515 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04000b4880 0x7f0400157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.088+0000 7f0405c24640 1 -- 172.21.15.77:0/2403809515 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04000b4880 msgr2=0x7f0400157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:29.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.088+0000 7f0406c26640 1 --2- 172.21.15.77:0/2403809515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0400153e60 0x7f04000b7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.088+0000 7f0405c24640 1 --2- 172.21.15.77:0/2403809515 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04000b4880 0x7f0400157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.088+0000 7f0405c24640 1 -- 172.21.15.77:0/2403809515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0400153e60 msgr2=0x7f04000b7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:29.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.088+0000 7f0405c24640 1 --2- 172.21.15.77:0/2403809515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0400153e60 0x7f04000b7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.088+0000 7f0405c24640 1 -- 172.21.15.77:0/2403809515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f00094d0 con 0x7f04000cd6d0 2023-11-04T01:42:29.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.088+0000 7f0406425640 1 --2- 172.21.15.77:0/2403809515 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04000b4880 0x7f0400157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:29.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.088+0000 7f0405c24640 1 --2- 172.21.15.77:0/2403809515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04000cd6d0 0x7f04001f2fe0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f03f400c7f0 tx=0x7f03f400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:29.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.088+0000 7f03feffd640 1 -- 172.21.15.77:0/2403809515 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f4007a30 con 0x7f04000cd6d0 2023-11-04T01:42:29.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.088+0000 7f03feffd640 1 -- 172.21.15.77:0/2403809515 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f4007b90 con 0x7f04000cd6d0 2023-11-04T01:42:29.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.088+0000 7f0408689640 1 -- 172.21.15.77:0/2403809515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04001555b0 con 0x7f04000cd6d0 2023-11-04T01:42:29.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.088+0000 7f03feffd640 1 -- 172.21.15.77:0/2403809515 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f400ce40 con 0x7f04000cd6d0 2023-11-04T01:42:29.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.088+0000 7f0408689640 1 -- 172.21.15.77:0/2403809515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0400158b40 con 0x7f04000cd6d0 2023-11-04T01:42:29.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.089+0000 7f0408689640 1 -- 172.21.15.77:0/2403809515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0400155ad0 con 0x7f04000cd6d0 2023-11-04T01:42:29.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.089+0000 7f03feffd640 1 -- 172.21.15.77:0/2403809515 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f03f40113f0 con 0x7f04000cd6d0 2023-11-04T01:42:29.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.090+0000 7f03feffd640 1 --2- 172.21.15.77:0/2403809515 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f03ec06aea0 0x7f03ec06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.090+0000 7f03feffd640 1 -- 172.21.15.77:0/2403809515 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f03f4089970 con 0x7f04000cd6d0 2023-11-04T01:42:29.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.090+0000 7f0406425640 1 --2- 172.21.15.77:0/2403809515 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f03ec06aea0 0x7f03ec06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.090+0000 7f0406425640 1 --2- 172.21.15.77:0/2403809515 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f03ec06aea0 0x7f03ec06d360 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f03f0036000 tx=0x7f03f003c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:29.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.094+0000 7f03feffd640 1 -- 172.21.15.77:0/2403809515 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0400155ad0 con 0x7f04000cd6d0 2023-11-04T01:42:29.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.321+0000 7f0408689640 1 -- 172.21.15.77:0/2403809515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f0400155ad0 con 0x7f04000cd6d0 2023-11-04T01:42:29.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.323+0000 7f03feffd640 1 -- 172.21.15.77:0/2403809515 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+147 (secure 0 0 0) 0x7f0400155ad0 con 0x7f04000cd6d0 2023-11-04T01:42:29.325 INFO:teuthology.orchestra.run.smithi077.stdout:[client.0] 2023-11-04T01:42:29.325 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQC2oEVlChU2FxAAt1/aJZOrufjVZhraPqv1Gw== 2023-11-04T01:42:29.325 INFO:teuthology.orchestra.run.smithi077.stdout: caps mds = "allow" 2023-11-04T01:42:29.326 INFO:teuthology.orchestra.run.smithi077.stdout: caps mon = "allow r" 2023-11-04T01:42:29.326 INFO:teuthology.orchestra.run.smithi077.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-04T01:42:29.326 INFO:teuthology.orchestra.run.smithi077.stderr:updated caps for client.0 2023-11-04T01:42:29.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.326+0000 7f0408689640 1 -- 172.21.15.77:0/2403809515 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f03ec06aea0 msgr2=0x7f03ec06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:29.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.326+0000 7f0408689640 1 --2- 172.21.15.77:0/2403809515 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f03ec06aea0 0x7f03ec06d360 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f03f0036000 tx=0x7f03f003c040 comp rx=0 tx=0).stop 2023-11-04T01:42:29.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.326+0000 7f0408689640 1 -- 172.21.15.77:0/2403809515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04000cd6d0 msgr2=0x7f04001f2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:29.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.326+0000 7f0408689640 1 --2- 172.21.15.77:0/2403809515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04000cd6d0 0x7f04001f2fe0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f03f400c7f0 tx=0x7f03f400cbf0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.326+0000 7f0408689640 1 -- 172.21.15.77:0/2403809515 shutdown_connections 2023-11-04T01:42:29.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.326+0000 7f0408689640 1 --2- 172.21.15.77:0/2403809515 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f03ec06aea0 0x7f03ec06d360 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.326+0000 7f0408689640 1 --2- 172.21.15.77:0/2403809515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0400153e60 0x7f04000b7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.326+0000 7f0408689640 1 --2- 172.21.15.77:0/2403809515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04000cd6d0 0x7f04001f2fe0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.326+0000 7f0408689640 1 --2- 172.21.15.77:0/2403809515 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04000b4880 0x7f0400157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.326+0000 7f0408689640 1 -- 172.21.15.77:0/2403809515 >> 172.21.15.77:0/2403809515 conn(0x7f04000cf880 msgr2=0x7f040015f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:29.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.326+0000 7f0408689640 1 -- 172.21.15.77:0/2403809515 shutdown_connections 2023-11-04T01:42:29.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.326+0000 7f0408689640 1 -- 172.21.15.77:0/2403809515 wait complete. 2023-11-04T01:42:29.338 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:29.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.436+0000 7f3c5aa32640 1 Processor -- start 2023-11-04T01:42:29.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.436+0000 7f3c5aa32640 1 -- start start 2023-11-04T01:42:29.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.436+0000 7f3c5aa32640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3c540cde60 0x7f3c5415d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.436+0000 7f3c5aa32640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3c5415daa0 0x7f3c54157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.436+0000 7f3c5aa32640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c5415e000 con 0x7f3c540ce240 2023-11-04T01:42:29.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.436+0000 7f3c5aa32640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c5415e5c0 con 0x7f3c540cde60 2023-11-04T01:42:29.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.436+0000 7f3c5aa32640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5415e2e0 con 0x7f3c5415daa0 2023-11-04T01:42:29.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.437+0000 7f3c58fcf640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f3c540ce240 0x7f3c5406b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:60782/0 (socket says 172.21.15.77:60782) 2023-11-04T01:42:29.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.437+0000 7f3c58fcf640 1 -- 172.21.15.77:0/1577387016 learned_addr learned my addr 172.21.15.77:0/1577387016 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:29.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.437+0000 7f3c537fe640 1 --2- 172.21.15.77:0/1577387016 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3c5415daa0 0x7f3c54157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.437+0000 7f3c52ffd640 1 -- 172.21.15.77:0/1577387016 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2985420057 0 0) 0x7f3c5415e000 con 0x7f3c540ce240 2023-11-04T01:42:29.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.437+0000 7f3c52ffd640 1 -- 172.21.15.77:0/1577387016 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c40003520 con 0x7f3c540ce240 2023-11-04T01:42:29.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.437+0000 7f3c53fff640 1 --2- 172.21.15.77:0/1577387016 >> v2:172.21.15.122:3300/0 conn(0x7f3c540cde60 0x7f3c5415d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.437+0000 7f3c52ffd640 1 -- 172.21.15.77:0/1577387016 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1109274388 0 0) 0x7f3c40003520 con 0x7f3c540ce240 2023-11-04T01:42:29.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.437+0000 7f3c52ffd640 1 -- 172.21.15.77:0/1577387016 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3c5415daa0 msgr2=0x7f3c54157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:29.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.437+0000 7f3c52ffd640 1 --2- 172.21.15.77:0/1577387016 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3c5415daa0 0x7f3c54157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.437+0000 7f3c52ffd640 1 -- 172.21.15.77:0/1577387016 >> v2:172.21.15.122:3300/0 conn(0x7f3c540cde60 msgr2=0x7f3c5415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:29.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.437+0000 7f3c52ffd640 1 --2- 172.21.15.77:0/1577387016 >> v2:172.21.15.122:3300/0 conn(0x7f3c540cde60 0x7f3c5415d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.437+0000 7f3c52ffd640 1 -- 172.21.15.77:0/1577387016 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c540d1120 con 0x7f3c540ce240 2023-11-04T01:42:29.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.437+0000 7f3c52ffd640 1 -- 172.21.15.77:0/1577387016 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f3c4c0019f0 con 0x7f3c540ce240 2023-11-04T01:42:29.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.437+0000 7f3c52ffd640 1 -- 172.21.15.77:0/1577387016 >> v1:172.21.15.77:6789/0 conn(0x7f3c540ce240 legacy=0x7f3c5406b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:29.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.437+0000 7f3c52ffd640 1 --2- 172.21.15.77:0/1577387016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c40003970 0x7f3c40003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.437+0000 7f3c52ffd640 1 --2- 172.21.15.77:0/1577387016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c400047c0 0x7f3c40004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.437+0000 7f3c52ffd640 1 --2- 172.21.15.77:0/1577387016 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3c5415daa0 0x7f3c40005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.437+0000 7f3c52ffd640 1 -- 172.21.15.77:0/1577387016 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5415e5c0 con 0x7f3c400047c0 2023-11-04T01:42:29.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.437+0000 7f3c52ffd640 1 -- 172.21.15.77:0/1577387016 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5415e2e0 con 0x7f3c40003970 2023-11-04T01:42:29.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.437+0000 7f3c52ffd640 1 -- 172.21.15.77:0/1577387016 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4000b980 con 0x7f3c5415daa0 2023-11-04T01:42:29.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.437+0000 7f3c537fe640 1 --2- 172.21.15.77:0/1577387016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c400047c0 0x7f3c40004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.437+0000 7f3c53fff640 1 --2- 172.21.15.77:0/1577387016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c40003970 0x7f3c40003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.437+0000 7f3c58fcf640 1 --2- 172.21.15.77:0/1577387016 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3c5415daa0 0x7f3c40005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.438+0000 7f3c537fe640 1 -- 172.21.15.77:0/1577387016 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3c5415daa0 msgr2=0x7f3c40005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:29.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.438+0000 7f3c537fe640 1 --2- 172.21.15.77:0/1577387016 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3c5415daa0 0x7f3c40005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.438+0000 7f3c537fe640 1 -- 172.21.15.77:0/1577387016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c40003970 msgr2=0x7f3c40003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:29.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.438+0000 7f3c537fe640 1 --2- 172.21.15.77:0/1577387016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c40003970 0x7f3c40003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.438+0000 7f3c537fe640 1 -- 172.21.15.77:0/1577387016 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c40003520 con 0x7f3c400047c0 2023-11-04T01:42:29.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.438+0000 7f3c53fff640 1 --2- 172.21.15.77:0/1577387016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c40003970 0x7f3c40003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:29.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.438+0000 7f3c537fe640 1 --2- 172.21.15.77:0/1577387016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c400047c0 0x7f3c40004c40 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f3c44009ac0 tx=0x7f3c400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e242e352a1aca792 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:29.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.438+0000 7f3c52ffd640 1 -- 172.21.15.77:0/1577387016 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4402c6b0 con 0x7f3c400047c0 2023-11-04T01:42:29.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.439+0000 7f3c52ffd640 1 -- 172.21.15.77:0/1577387016 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4402c810 con 0x7f3c400047c0 2023-11-04T01:42:29.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.439+0000 7f3c52ffd640 1 -- 172.21.15.77:0/1577387016 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4402cba0 con 0x7f3c400047c0 2023-11-04T01:42:29.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.439+0000 7f3c5aa32640 1 -- 172.21.15.77:0/1577387016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c400047c0 msgr2=0x7f3c40004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:29.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.439+0000 7f3c5aa32640 1 --2- 172.21.15.77:0/1577387016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c400047c0 0x7f3c40004c40 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f3c44009ac0 tx=0x7f3c400057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.439+0000 7f3c58fcf640 1 -- 172.21.15.77:0/1577387016 reap_dead start 2023-11-04T01:42:29.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.439+0000 7f3c5aa32640 1 -- 172.21.15.77:0/1577387016 shutdown_connections 2023-11-04T01:42:29.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.439+0000 7f3c5aa32640 1 -- 172.21.15.77:0/1577387016 >> 172.21.15.77:0/1577387016 conn(0x7f3c54071f30 msgr2=0x7f3c540cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:29.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.439+0000 7f3c5aa32640 1 -- 172.21.15.77:0/1577387016 shutdown_connections 2023-11-04T01:42:29.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.439+0000 7f3c5aa32640 1 -- 172.21.15.77:0/1577387016 wait complete. 2023-11-04T01:42:29.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.440+0000 7f3c5aa32640 1 Processor -- start 2023-11-04T01:42:29.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.440+0000 7f3c5aa32640 1 -- start start 2023-11-04T01:42:29.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.441+0000 7f3c5aa32640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c400047c0 0x7f3c540bc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.441+0000 7f3c5aa32640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3c540cb9f0 0x7f3c540b8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.441+0000 7f3c5aa32640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c540b9400 0x7f3c540b7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.441+0000 7f3c5aa32640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c541e4590 con 0x7f3c400047c0 2023-11-04T01:42:29.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.441+0000 7f3c5aa32640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c540b9880 con 0x7f3c540b9400 2023-11-04T01:42:29.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.441+0000 7f3c5aa32640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c540bcc00 con 0x7f3c540cb9f0 2023-11-04T01:42:29.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.441+0000 7f3c53fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c400047c0 0x7f3c540bc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.441+0000 7f3c53fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c400047c0 0x7f3c540bc6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:32970/0 (socket says 172.21.15.77:32970) 2023-11-04T01:42:29.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.441+0000 7f3c53fff640 1 -- 172.21.15.77:0/2446592674 learned_addr learned my addr 172.21.15.77:0/2446592674 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:29.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.441+0000 7f3c537fe640 1 --2- 172.21.15.77:0/2446592674 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3c540cb9f0 0x7f3c540b8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.441+0000 7f3c58fcf640 1 --2- 172.21.15.77:0/2446592674 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c540b9400 0x7f3c540b7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.441+0000 7f3c53fff640 1 -- 172.21.15.77:0/2446592674 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3c540cb9f0 msgr2=0x7f3c540b8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:29.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.441+0000 7f3c53fff640 1 --2- 172.21.15.77:0/2446592674 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3c540cb9f0 0x7f3c540b8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.441+0000 7f3c53fff640 1 -- 172.21.15.77:0/2446592674 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c540b9400 msgr2=0x7f3c540b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:29.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.441+0000 7f3c53fff640 1 --2- 172.21.15.77:0/2446592674 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c540b9400 0x7f3c540b7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.442+0000 7f3c53fff640 1 -- 172.21.15.77:0/2446592674 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c540ccb80 con 0x7f3c400047c0 2023-11-04T01:42:29.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.442+0000 7f3c53fff640 1 --2- 172.21.15.77:0/2446592674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c400047c0 0x7f3c540bc6c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c011cd0 tx=0x7f3c3c00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:29.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.442+0000 7f3c50ff9640 1 -- 172.21.15.77:0/2446592674 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c00fd20 con 0x7f3c400047c0 2023-11-04T01:42:29.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.442+0000 7f3c50ff9640 1 -- 172.21.15.77:0/2446592674 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3c00fe80 con 0x7f3c400047c0 2023-11-04T01:42:29.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.442+0000 7f3c5aa32640 1 -- 172.21.15.77:0/2446592674 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c540cce60 con 0x7f3c400047c0 2023-11-04T01:42:29.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.442+0000 7f3c50ff9640 1 -- 172.21.15.77:0/2446592674 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c014660 con 0x7f3c400047c0 2023-11-04T01:42:29.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.442+0000 7f3c5aa32640 1 -- 172.21.15.77:0/2446592674 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c540cd420 con 0x7f3c400047c0 2023-11-04T01:42:29.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.443+0000 7f3c5aa32640 1 -- 172.21.15.77:0/2446592674 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c540cd5e0 con 0x7f3c400047c0 2023-11-04T01:42:29.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.443+0000 7f3c50ff9640 1 -- 172.21.15.77:0/2446592674 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3c3c0147c0 con 0x7f3c400047c0 2023-11-04T01:42:29.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.444+0000 7f3c50ff9640 1 --2- 172.21.15.77:0/2446592674 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3c3406ae70 0x7f3c3406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.444+0000 7f3c50ff9640 1 -- 172.21.15.77:0/2446592674 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3c3c08a380 con 0x7f3c400047c0 2023-11-04T01:42:29.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.444+0000 7f3c537fe640 1 --2- 172.21.15.77:0/2446592674 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3c3406ae70 0x7f3c3406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.444+0000 7f3c537fe640 1 --2- 172.21.15.77:0/2446592674 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3c3406ae70 0x7f3c3406d330 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3c44036000 tx=0x7f3c44030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:29.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.448+0000 7f3c50ff9640 1 -- 172.21.15.77:0/2446592674 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3c3c055100 con 0x7f3c400047c0 2023-11-04T01:42:29.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.649+0000 7f3c5aa32640 1 -- 172.21.15.77:0/2446592674 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c54074290 con 0x7f3c400047c0 2023-11-04T01:42:29.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.649+0000 7f3c50ff9640 1 -- 172.21.15.77:0/2446592674 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f3c3c058720 con 0x7f3c400047c0 2023-11-04T01:42:29.652 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:29.652 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6396,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/20625239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":20625239},{"type":"v1","addr":"172.21.15.77:6834","nonce":20625239}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6399,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3909793035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3909793035},{"type":"v1","addr":"172.21.15.77:6835","nonce":3909793035}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":35252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/1714919040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1714919040},{"type":"v1","addr":"172.21.15.122:6836","nonce":1714919040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:42:23.999994+0000","modified":"2023-11-04T01:42:26.916361+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":35255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35255":{"gid":35255,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/1606545578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1606545578},{"type":"v1","addr":"172.21.15.122:6837","nonce":1606545578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-04T01:42:29.653 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 29 2023-11-04T01:42:29.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.651+0000 7f3c5aa32640 1 -- 172.21.15.77:0/2446592674 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3c3406ae70 msgr2=0x7f3c3406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:29.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.651+0000 7f3c5aa32640 1 --2- 172.21.15.77:0/2446592674 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3c3406ae70 0x7f3c3406d330 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3c44036000 tx=0x7f3c44030000 comp rx=0 tx=0).stop 2023-11-04T01:42:29.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.651+0000 7f3c5aa32640 1 -- 172.21.15.77:0/2446592674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c400047c0 msgr2=0x7f3c540bc6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:29.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.651+0000 7f3c5aa32640 1 --2- 172.21.15.77:0/2446592674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c400047c0 0x7f3c540bc6c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c011cd0 tx=0x7f3c3c00f610 comp rx=0 tx=0).stop 2023-11-04T01:42:29.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.651+0000 7f3c5aa32640 1 -- 172.21.15.77:0/2446592674 shutdown_connections 2023-11-04T01:42:29.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.651+0000 7f3c5aa32640 1 --2- 172.21.15.77:0/2446592674 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3c3406ae70 0x7f3c3406d330 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.651+0000 7f3c5aa32640 1 --2- 172.21.15.77:0/2446592674 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c540b9400 0x7f3c540b7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.651+0000 7f3c5aa32640 1 --2- 172.21.15.77:0/2446592674 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3c540cb9f0 0x7f3c540b8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.651+0000 7f3c5aa32640 1 --2- 172.21.15.77:0/2446592674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c400047c0 0x7f3c540bc6c0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.651+0000 7f3c5aa32640 1 -- 172.21.15.77:0/2446592674 >> 172.21.15.77:0/2446592674 conn(0x7f3c54071f30 msgr2=0x7f3c5414e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:29.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.651+0000 7f3c5aa32640 1 -- 172.21.15.77:0/2446592674 shutdown_connections 2023-11-04T01:42:29.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:29.651+0000 7f3c5aa32640 1 -- 172.21.15.77:0/2446592674 wait complete. 2023-11-04T01:42:29.930 INFO:tasks.ceph.mds.b.smithi122.stderr:2023-11-04T01:42:29.928+0000 7efda30c6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:42:30.065 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:42:23.999994+0000', 'modified': '2023-11-04T01:42:26.916361+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 35255}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_35255': {'gid': 35255, 'name': 'b', 'rank': 0, 'incarnation': 26, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.122:6837/1606545578', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6835', 'nonce': 1606545578}, {'type': 'v1', 'addr': '172.21.15.122:6837', 'nonce': 1606545578}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:42:30.066 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:42:30.066 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-04T01:42:30.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.166+0000 7f37ca91d640 1 Processor -- start 2023-11-04T01:42:30.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.166+0000 7f37ca91d640 1 -- start start 2023-11-04T01:42:30.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.167+0000 7f37ca91d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f37c415ad40 0x7f37c406b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.167+0000 7f37ca91d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c4065df0 con 0x7f37c415b120 2023-11-04T01:42:30.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.167+0000 7f37ca91d640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c4066040 con 0x7f37c40c9b60 2023-11-04T01:42:30.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.167+0000 7f37ca91d640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37c406bc40 con 0x7f37c415ad40 2023-11-04T01:42:30.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.167+0000 7f37c37fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f37c415b120 0x7f37c415f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:60788/0 (socket says 172.21.15.77:60788) 2023-11-04T01:42:30.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.167+0000 7f37c37fe640 1 -- 172.21.15.77:0/1014026666 learned_addr learned my addr 172.21.15.77:0/1014026666 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:30.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.167+0000 7f37c3fff640 1 --2- 172.21.15.77:0/1014026666 >> v2:172.21.15.122:3300/0 conn(0x7f37c415ad40 0x7f37c406b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.167+0000 7f37c2ffd640 1 -- 172.21.15.77:0/1014026666 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3977688876 0 0) 0x7f37c4065df0 con 0x7f37c415b120 2023-11-04T01:42:30.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.167+0000 7f37c2ffd640 1 -- 172.21.15.77:0/1014026666 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37ac003520 con 0x7f37c415b120 2023-11-04T01:42:30.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.168+0000 7f37c2ffd640 1 -- 172.21.15.77:0/1014026666 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1601354352 0 0) 0x7f37ac003520 con 0x7f37c415b120 2023-11-04T01:42:30.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.168+0000 7f37c2ffd640 1 -- 172.21.15.77:0/1014026666 >> v2:172.21.15.122:3300/0 conn(0x7f37c415ad40 msgr2=0x7f37c406b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:30.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.168+0000 7f37c2ffd640 1 --2- 172.21.15.77:0/1014026666 >> v2:172.21.15.122:3300/0 conn(0x7f37c415ad40 0x7f37c406b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.168+0000 7f37c2ffd640 1 -- 172.21.15.77:0/1014026666 >> v1:172.21.15.122:6789/0 conn(0x7f37c40c9b60 legacy=0x7f37c4070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:30.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.168+0000 7f37c2ffd640 1 -- 172.21.15.77:0/1014026666 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c4066320 con 0x7f37c415b120 2023-11-04T01:42:30.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.168+0000 7f37c2ffd640 1 -- 172.21.15.77:0/1014026666 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f37b8001670 con 0x7f37c415b120 2023-11-04T01:42:30.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.168+0000 7f37c2ffd640 1 -- 172.21.15.77:0/1014026666 >> v1:172.21.15.77:6789/0 conn(0x7f37c415b120 legacy=0x7f37c415f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:30.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.168+0000 7f37c2ffd640 1 --2- 172.21.15.77:0/1014026666 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37ac003970 0x7f37ac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.168+0000 7f37c2ffd640 1 --2- 172.21.15.77:0/1014026666 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f37ac0047c0 0x7f37ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.168+0000 7f37c2ffd640 1 --2- 172.21.15.77:0/1014026666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37ac005180 0x7f37ac00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.168+0000 7f37c2ffd640 1 -- 172.21.15.77:0/1014026666 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c406bc40 con 0x7f37ac003970 2023-11-04T01:42:30.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.168+0000 7f37c2ffd640 1 -- 172.21.15.77:0/1014026666 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37ac00c020 con 0x7f37ac005180 2023-11-04T01:42:30.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.168+0000 7f37c2ffd640 1 -- 172.21.15.77:0/1014026666 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37ac00c1e0 con 0x7f37ac0047c0 2023-11-04T01:42:30.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.168+0000 7f37c3fff640 1 --2- 172.21.15.77:0/1014026666 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37ac003970 0x7f37ac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.168+0000 7f37c37fe640 1 --2- 172.21.15.77:0/1014026666 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f37ac0047c0 0x7f37ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.168+0000 7f37c8eba640 1 --2- 172.21.15.77:0/1014026666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37ac005180 0x7f37ac00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.168+0000 7f37c3fff640 1 -- 172.21.15.77:0/1014026666 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f37ac0047c0 msgr2=0x7f37ac004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:30.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.168+0000 7f37c3fff640 1 --2- 172.21.15.77:0/1014026666 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f37ac0047c0 0x7f37ac004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.168+0000 7f37c3fff640 1 -- 172.21.15.77:0/1014026666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37ac005180 msgr2=0x7f37ac00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:30.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.168+0000 7f37c3fff640 1 --2- 172.21.15.77:0/1014026666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37ac005180 0x7f37ac00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.168+0000 7f37c3fff640 1 -- 172.21.15.77:0/1014026666 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ac003520 con 0x7f37ac003970 2023-11-04T01:42:30.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.168+0000 7f37c8eba640 1 --2- 172.21.15.77:0/1014026666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37ac005180 0x7f37ac00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:30.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.168+0000 7f37c8eba640 1 -- 172.21.15.77:0/1014026666 reap_dead start 2023-11-04T01:42:30.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.169+0000 7f37c3fff640 1 --2- 172.21.15.77:0/1014026666 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37ac003970 0x7f37ac003d90 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f37b4009ac0 tx=0x7f37ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd9e072f2d67f09 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:30.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.169+0000 7f37c2ffd640 1 -- 172.21.15.77:0/1014026666 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b402c6b0 con 0x7f37ac003970 2023-11-04T01:42:30.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.169+0000 7f37c2ffd640 1 -- 172.21.15.77:0/1014026666 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b402c810 con 0x7f37ac003970 2023-11-04T01:42:30.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.169+0000 7f37c2ffd640 1 -- 172.21.15.77:0/1014026666 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b402cba0 con 0x7f37ac003970 2023-11-04T01:42:30.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.170+0000 7f37ca91d640 1 -- 172.21.15.77:0/1014026666 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37ac003970 msgr2=0x7f37ac003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:30.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.170+0000 7f37ca91d640 1 --2- 172.21.15.77:0/1014026666 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37ac003970 0x7f37ac003d90 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f37b4009ac0 tx=0x7f37ac0057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.170+0000 7f37ca91d640 1 -- 172.21.15.77:0/1014026666 shutdown_connections 2023-11-04T01:42:30.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.170+0000 7f37ca91d640 1 --2- 172.21.15.77:0/1014026666 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37ac003970 0x7f37ac003d90 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.170+0000 7f37ca91d640 1 -- 172.21.15.77:0/1014026666 >> 172.21.15.77:0/1014026666 conn(0x7f37c40cbc90 msgr2=0x7f37c40cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:30.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.170+0000 7f37ca91d640 1 -- 172.21.15.77:0/1014026666 shutdown_connections 2023-11-04T01:42:30.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.170+0000 7f37ca91d640 1 -- 172.21.15.77:0/1014026666 wait complete. 2023-11-04T01:42:30.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.171+0000 7f37ca91d640 1 Processor -- start 2023-11-04T01:42:30.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.171+0000 7f37ca91d640 1 -- start start 2023-11-04T01:42:30.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.172+0000 7f37ca91d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37ac003970 0x7f37c414cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.172+0000 7f37ca91d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f37c41f0a40 0x7f37c41f0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.172+0000 7f37ca91d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37c4159970 0x7f37c4159e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.172+0000 7f37ca91d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c40c4680 con 0x7f37ac003970 2023-11-04T01:42:30.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.172+0000 7f37ca91d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c41f1400 con 0x7f37c4159970 2023-11-04T01:42:30.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.172+0000 7f37ca91d640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c414c670 con 0x7f37c41f0a40 2023-11-04T01:42:30.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.172+0000 7f37c3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37ac003970 0x7f37c414cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.172+0000 7f37c3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37ac003970 0x7f37c414cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:32992/0 (socket says 172.21.15.77:32992) 2023-11-04T01:42:30.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.172+0000 7f37c3fff640 1 -- 172.21.15.77:0/3028959928 learned_addr learned my addr 172.21.15.77:0/3028959928 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:30.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.172+0000 7f37c3fff640 1 -- 172.21.15.77:0/3028959928 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f37c41f0a40 msgr2=0x7f37c41f0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:30.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.172+0000 7f37c37fe640 1 --2- 172.21.15.77:0/3028959928 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f37c41f0a40 0x7f37c41f0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.172+0000 7f37c3fff640 1 --2- 172.21.15.77:0/3028959928 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f37c41f0a40 0x7f37c41f0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.172+0000 7f37c8eba640 1 --2- 172.21.15.77:0/3028959928 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37c4159970 0x7f37c4159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.172+0000 7f37c3fff640 1 -- 172.21.15.77:0/3028959928 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37c4159970 msgr2=0x7f37c4159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:30.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.172+0000 7f37c3fff640 1 --2- 172.21.15.77:0/3028959928 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37c4159970 0x7f37c4159e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.172+0000 7f37c3fff640 1 -- 172.21.15.77:0/3028959928 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c41f1650 con 0x7f37ac003970 2023-11-04T01:42:30.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.172+0000 7f37c3fff640 1 --2- 172.21.15.77:0/3028959928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37ac003970 0x7f37c414cf80 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f37b402c250 tx=0x7f37b4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:30.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.172+0000 7f37c0ff9640 1 -- 172.21.15.77:0/3028959928 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b4003810 con 0x7f37ac003970 2023-11-04T01:42:30.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.172+0000 7f37c0ff9640 1 -- 172.21.15.77:0/3028959928 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b4003970 con 0x7f37ac003970 2023-11-04T01:42:30.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.172+0000 7f37c0ff9640 1 -- 172.21.15.77:0/3028959928 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b4003d00 con 0x7f37ac003970 2023-11-04T01:42:30.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.172+0000 7f37ca91d640 1 -- 172.21.15.77:0/3028959928 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c41f1930 con 0x7f37ac003970 2023-11-04T01:42:30.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.172+0000 7f37ca91d640 1 -- 172.21.15.77:0/3028959928 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c40c4310 con 0x7f37ac003970 2023-11-04T01:42:30.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.174+0000 7f37c0ff9640 1 -- 172.21.15.77:0/3028959928 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f37b4034440 con 0x7f37ac003970 2023-11-04T01:42:30.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.174+0000 7f37c0ff9640 1 --2- 172.21.15.77:0/3028959928 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f37b006ae70 0x7f37b006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.174+0000 7f37c0ff9640 1 -- 172.21.15.77:0/3028959928 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f37b40aba90 con 0x7f37ac003970 2023-11-04T01:42:30.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.175+0000 7f37c37fe640 1 --2- 172.21.15.77:0/3028959928 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f37b006ae70 0x7f37b006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.175+0000 7f37c37fe640 1 --2- 172.21.15.77:0/3028959928 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f37b006ae70 0x7f37b006d330 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f37c415b500 tx=0x7f37b8009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:30.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.175+0000 7f37cd588740 1 Processor -- start 2023-11-04T01:42:30.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.175+0000 7f37cd588740 1 -- start start 2023-11-04T01:42:30.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.176+0000 7f37cd588740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650126c3850 0x565012696750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.176+0000 7f37cd588740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650126c3c30 0x5650126c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.176+0000 7f37cd588740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x565012696c90 0x5650126c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.176+0000 7f37cd588740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650125a7740 con 0x5650126c3850 2023-11-04T01:42:30.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.176+0000 7f37cd588740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650126098d0 con 0x5650126c3c30 2023-11-04T01:42:30.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.176+0000 7f37cd588740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x565012606fc0 con 0x565012696c90 2023-11-04T01:42:30.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.176+0000 7f37c3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650126c3850 0x565012696750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.176+0000 7f37c3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650126c3850 0x565012696750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33008/0 (socket says 172.21.15.77:33008) 2023-11-04T01:42:30.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.176+0000 7f37c3fff640 1 -- 172.21.15.77:0/1589093158 learned_addr learned my addr 172.21.15.77:0/1589093158 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:30.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.176+0000 7f37c3fff640 1 -- 172.21.15.77:0/1589093158 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x565012696c90 msgr2=0x5650126c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:30.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.176+0000 7f37c8eba640 1 --2- 172.21.15.77:0/1589093158 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x565012696c90 0x5650126c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.176+0000 7f37c3fff640 1 --2- 172.21.15.77:0/1589093158 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x565012696c90 0x5650126c6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.176+0000 7f37c37fe640 1 --2- 172.21.15.77:0/1589093158 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650126c3c30 0x5650126c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.176+0000 7f37c3fff640 1 -- 172.21.15.77:0/1589093158 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650126c3c30 msgr2=0x5650126c65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:30.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.176+0000 7f37c3fff640 1 --2- 172.21.15.77:0/1589093158 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650126c3c30 0x5650126c65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.176+0000 7f37c3fff640 1 -- 172.21.15.77:0/1589093158 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650125c5ca0 con 0x5650126c3850 2023-11-04T01:42:30.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.176+0000 7f37c3fff640 1 --2- 172.21.15.77:0/1589093158 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650126c3850 0x565012696750 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f37b4082330 tx=0x7f37b407a030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b6bc567d367452 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:30.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.177+0000 7f37a9ffb640 1 -- 172.21.15.77:0/1589093158 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b4082860 con 0x5650126c3850 2023-11-04T01:42:30.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.177+0000 7f37a9ffb640 1 -- 172.21.15.77:0/1589093158 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b40ab050 con 0x5650126c3850 2023-11-04T01:42:30.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.177+0000 7f37a9ffb640 1 -- 172.21.15.77:0/1589093158 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b4009690 con 0x5650126c3850 2023-11-04T01:42:30.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.177+0000 7f37cd588740 1 -- 172.21.15.77:0/1589093158 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650126c3850 msgr2=0x565012696750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:30.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.177+0000 7f37cd588740 1 --2- 172.21.15.77:0/1589093158 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650126c3850 0x565012696750 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f37b4082330 tx=0x7f37b407a030 comp rx=0 tx=0).stop 2023-11-04T01:42:30.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.177+0000 7f37cd588740 1 -- 172.21.15.77:0/1589093158 shutdown_connections 2023-11-04T01:42:30.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.177+0000 7f37cd588740 1 --2- 172.21.15.77:0/1589093158 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x565012696c90 0x5650126c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.177+0000 7f37cd588740 1 --2- 172.21.15.77:0/1589093158 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650126c3c30 0x5650126c65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.177+0000 7f37cd588740 1 --2- 172.21.15.77:0/1589093158 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650126c3850 0x565012696750 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.177+0000 7f37cd588740 1 -- 172.21.15.77:0/1589093158 >> 172.21.15.77:0/1589093158 conn(0x565012698a60 msgr2=0x5650126e15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:30.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.177+0000 7f37cd588740 1 -- 172.21.15.77:0/1589093158 shutdown_connections 2023-11-04T01:42:30.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.177+0000 7f37cd588740 1 -- 172.21.15.77:0/1589093158 wait complete. 2023-11-04T01:42:30.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.178+0000 7f37cd588740 1 -- start start 2023-11-04T01:42:30.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.178+0000 7f37cd588740 1 Processor -- start 2023-11-04T01:42:30.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.179+0000 7f37cd588740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650126c3850 0x5650126dbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.179+0000 7f37cd588740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5650126c3c30 0x5650126b1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.179+0000 7f37cd588740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650126b3eb0 0x5650126b4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.179+0000 7f37cd588740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650126028b0 con 0x5650126c3850 2023-11-04T01:42:30.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.179+0000 7f37cd588740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650125bcc80 con 0x5650126b3eb0 2023-11-04T01:42:30.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.179+0000 7f37cd588740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x5650125bc920 con 0x5650126c3c30 2023-11-04T01:42:30.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.179+0000 7f37cd588740 10 client.0 _ll_register_callbacks cb 0x565012314ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:42:30.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.179+0000 7f37c3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650126c3850 0x5650126dbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.179+0000 7f37c3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650126c3850 0x5650126dbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33024/0 (socket says 172.21.15.77:33024) 2023-11-04T01:42:30.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.179+0000 7f37c3fff640 1 -- 172.21.15.77:0/675239753 learned_addr learned my addr 172.21.15.77:0/675239753 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:30.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.179+0000 7f37c37fe640 1 --2- 172.21.15.77:0/675239753 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5650126c3c30 0x5650126b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.179+0000 7f37c8eba640 1 --2- 172.21.15.77:0/675239753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650126b3eb0 0x5650126b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.179+0000 7f37c3fff640 1 -- 172.21.15.77:0/675239753 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5650126c3c30 msgr2=0x5650126b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:30.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.179+0000 7f37c3fff640 1 --2- 172.21.15.77:0/675239753 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5650126c3c30 0x5650126b1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.179+0000 7f37c3fff640 1 -- 172.21.15.77:0/675239753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650126b3eb0 msgr2=0x5650126b4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:30.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.179+0000 7f37c3fff640 1 --2- 172.21.15.77:0/675239753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650126b3eb0 0x5650126b4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.179+0000 7f37c3fff640 1 -- 172.21.15.77:0/675239753 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c40c4310 con 0x5650126c3850 2023-11-04T01:42:30.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.179+0000 7f37c3fff640 1 --2- 172.21.15.77:0/675239753 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650126c3850 0x5650126dbc10 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f37b407a310 tx=0x7f37b4009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=100de1b23e81a592 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:30.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.179+0000 7f37a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:42:30.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.179+0000 7f37a2ffd640 1 -- 172.21.15.77:0/675239753 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b40828e0 con 0x5650126c3850 2023-11-04T01:42:30.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.179+0000 7f37a2ffd640 1 -- 172.21.15.77:0/675239753 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f37b407a870 con 0x5650126c3850 2023-11-04T01:42:30.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.179+0000 7f37cd588740 1 -- 172.21.15.77:0/675239753 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5650125aebf0 con 0x5650126c3850 2023-11-04T01:42:30.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.180+0000 7f37a2ffd640 1 -- 172.21.15.77:0/675239753 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37b407aa30 con 0x5650126c3850 2023-11-04T01:42:30.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.180+0000 7f37cd588740 10 client.6546 fetch_fsmap learned FSMap version 29 2023-11-04T01:42:30.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.180+0000 7f37cd588740 1 -- 172.21.15.77:0/675239753 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0x565012600f30 con 0x5650126c3850 2023-11-04T01:42:30.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.180+0000 7f37a2ffd640 1 -- 172.21.15.77:0/675239753 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5650125aebf0 con 0x5650126c3850 2023-11-04T01:42:30.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.180+0000 7f37a2ffd640 1 -- 172.21.15.77:0/675239753 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f37b408f020 con 0x5650126c3850 2023-11-04T01:42:30.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.180+0000 7f37cd588740 10 client.6546 fetch_fsmap finished waiting for FSMap version 29 2023-11-04T01:42:30.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.180+0000 7f37cd588740 10 client.6546 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:42:30.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.180+0000 7f37cd588740 20 client.6546 populate_metadata read hostname 'smithi077' 2023-11-04T01:42:30.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.180+0000 7f37cd588740 1 --2- 172.21.15.77:0/675239753 >> [v2:172.21.15.122:6835/1606545578,v1:172.21.15.122:6837/1606545578] conn(0x5650126c90c0 0x5650126b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.180+0000 7f37cd588740 4 client.6546 mds_command: new command op to 35255 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:42:30.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.180+0000 7f37cd588740 1 -- 172.21.15.77:0/675239753 --> [v2:172.21.15.122:6835/1606545578,v1:172.21.15.122:6837/1606545578] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5650125fb890 con 0x5650126c90c0 2023-11-04T01:42:30.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.180+0000 7f37c37fe640 1 --2- 172.21.15.77:0/675239753 >> [v2:172.21.15.122:6835/1606545578,v1:172.21.15.122:6837/1606545578] conn(0x5650126c90c0 0x5650126b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.180+0000 7f37a2ffd640 10 client.6546 ms_handle_connect on v2:172.21.15.122:6835/1606545578 2023-11-04T01:42:30.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.180+0000 7f37c37fe640 1 --2- 172.21.15.77:0/675239753 >> [v2:172.21.15.122:6835/1606545578,v1:172.21.15.122:6837/1606545578] conn(0x5650126c90c0 0x5650126b2d60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f131cfd8b5c5a79f server_cookie=f1defc9e05bda9e8 in_seq=0 out_seq=0 2023-11-04T01:42:30.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.181+0000 7f37a2ffd640 1 -- 172.21.15.77:0/675239753 <== mds.0 v2:172.21.15.122:6835/1606545578 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5650125fb890 con 0x5650126c90c0 2023-11-04T01:42:30.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.181+0000 7f37a2ffd640 10 client.6546 handle_command_reply: tid=0 2023-11-04T01:42:30.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.181+0000 7f37cd588740 1 client.6546 shutdown 2023-11-04T01:42:30.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.181+0000 7f37cd588740 1 -- 172.21.15.77:0/675239753 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650126c3850 msgr2=0x5650126dbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:30.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.181+0000 7f37cd588740 1 --2- 172.21.15.77:0/675239753 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650126c3850 0x5650126dbc10 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f37b407a310 tx=0x7f37b4009190 comp rx=0 tx=0).stop 2023-11-04T01:42:30.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.181+0000 7f37cd588740 1 -- 172.21.15.77:0/675239753 shutdown_connections 2023-11-04T01:42:30.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.181+0000 7f37cd588740 1 --2- 172.21.15.77:0/675239753 >> [v2:172.21.15.122:6835/1606545578,v1:172.21.15.122:6837/1606545578] conn(0x5650126c90c0 0x5650126b2d60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.181+0000 7f37cd588740 1 --2- 172.21.15.77:0/675239753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650126b3eb0 0x5650126b4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.181+0000 7f37cd588740 1 --2- 172.21.15.77:0/675239753 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5650126c3c30 0x5650126b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.181+0000 7f37cd588740 1 --2- 172.21.15.77:0/675239753 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650126c3850 0x5650126dbc10 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.181+0000 7f37a2ffd640 0 client.6546 ms_handle_reset on v2:172.21.15.122:6835/1606545578 2023-11-04T01:42:30.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.181+0000 7f37cd588740 1 -- 172.21.15.77:0/675239753 >> 172.21.15.77:0/675239753 conn(0x565012696c90 msgr2=0x5650126c65d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:30.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.181+0000 7f37cd588740 1 -- 172.21.15.77:0/675239753 shutdown_connections 2023-11-04T01:42:30.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.181+0000 7f37cd588740 1 -- 172.21.15.77:0/675239753 wait complete. 2023-11-04T01:42:30.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.181+0000 7f37cd588740 20 client.6546 trim_cache size 0 max 16384 2023-11-04T01:42:30.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.197+0000 7f37cd588740 1 Processor -- start 2023-11-04T01:42:30.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.197+0000 7f37cd588740 1 -- start start 2023-11-04T01:42:30.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.198+0000 7f37cd588740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650126b3eb0 0x5650126f3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.198+0000 7f37cd588740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650126c3850 0x5650126f4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.198+0000 7f37cd588740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5650126c3c30 0x56501269a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.198+0000 7f37cd588740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x565012582280 con 0x5650126c3850 2023-11-04T01:42:30.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.198+0000 7f37cd588740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650126c8bb0 con 0x5650126b3eb0 2023-11-04T01:42:30.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.198+0000 7f37cd588740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x5650126c65d0 con 0x5650126c3c30 2023-11-04T01:42:30.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.198+0000 7f37c37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650126c3850 0x5650126f4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.198+0000 7f37c37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650126c3850 0x5650126f4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33038/0 (socket says 172.21.15.77:33038) 2023-11-04T01:42:30.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.198+0000 7f37c37fe640 1 -- 172.21.15.77:0/3436150109 learned_addr learned my addr 172.21.15.77:0/3436150109 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:30.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.198+0000 7f37c8eba640 1 --2- 172.21.15.77:0/3436150109 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5650126c3c30 0x56501269a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.198+0000 7f37c3fff640 1 --2- 172.21.15.77:0/3436150109 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650126b3eb0 0x5650126f3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.198+0000 7f37c37fe640 1 -- 172.21.15.77:0/3436150109 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5650126c3c30 msgr2=0x56501269a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:30.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.198+0000 7f37c37fe640 1 --2- 172.21.15.77:0/3436150109 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5650126c3c30 0x56501269a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.198+0000 7f37c37fe640 1 -- 172.21.15.77:0/3436150109 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650126b3eb0 msgr2=0x5650126f3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:30.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.198+0000 7f37c37fe640 1 --2- 172.21.15.77:0/3436150109 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650126b3eb0 0x5650126f3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.198+0000 7f37c37fe640 1 -- 172.21.15.77:0/3436150109 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56501259ed10 con 0x5650126c3850 2023-11-04T01:42:30.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.198+0000 7f37c8eba640 1 --2- 172.21.15.77:0/3436150109 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5650126c3c30 0x56501269a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:30.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.198+0000 7f37c37fe640 1 --2- 172.21.15.77:0/3436150109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650126c3850 0x5650126f4120 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x5650126c32a0 tx=0x7f37b8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75f1417d0c41a65b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:30.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.198+0000 7f37aa7fc640 1 -- 172.21.15.77:0/3436150109 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b8015660 con 0x5650126c3850 2023-11-04T01:42:30.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.198+0000 7f37aa7fc640 1 -- 172.21.15.77:0/3436150109 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b80157c0 con 0x5650126c3850 2023-11-04T01:42:30.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.198+0000 7f37aa7fc640 1 -- 172.21.15.77:0/3436150109 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b8015b30 con 0x5650126c3850 2023-11-04T01:42:30.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.199+0000 7f37cd588740 1 -- 172.21.15.77:0/3436150109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650126c3850 msgr2=0x5650126f4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:30.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.199+0000 7f37cd588740 1 --2- 172.21.15.77:0/3436150109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650126c3850 0x5650126f4120 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x5650126c32a0 tx=0x7f37b8013000 comp rx=0 tx=0).stop 2023-11-04T01:42:30.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.199+0000 7f37cd588740 1 -- 172.21.15.77:0/3436150109 shutdown_connections 2023-11-04T01:42:30.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.199+0000 7f37cd588740 1 --2- 172.21.15.77:0/3436150109 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5650126c3c30 0x56501269a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.199+0000 7f37cd588740 1 --2- 172.21.15.77:0/3436150109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650126c3850 0x5650126f4120 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.199+0000 7f37cd588740 1 --2- 172.21.15.77:0/3436150109 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650126b3eb0 0x5650126f3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.199+0000 7f37cd588740 1 -- 172.21.15.77:0/3436150109 >> 172.21.15.77:0/3436150109 conn(0x565012696c90 msgr2=0x565012703fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:30.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.199+0000 7f37cd588740 1 -- 172.21.15.77:0/3436150109 shutdown_connections 2023-11-04T01:42:30.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.199+0000 7f37cd588740 1 -- 172.21.15.77:0/3436150109 wait complete. 2023-11-04T01:42:30.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.199+0000 7f37cd588740 1 -- start start 2023-11-04T01:42:30.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.200+0000 7f37cd588740 1 Processor -- start 2023-11-04T01:42:30.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.200+0000 7f37cd588740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650126b3eb0 0x56501269a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.200+0000 7f37cd588740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5650126c3850 0x56501269a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.200+0000 7f37cd588740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650126c3c30 0x5650126b2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.200+0000 7f37cd588740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650126b02e0 con 0x5650126b3eb0 2023-11-04T01:42:30.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.200+0000 7f37cd588740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650126d7000 con 0x5650126c3c30 2023-11-04T01:42:30.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.200+0000 7f37cd588740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x5650126f4330 con 0x5650126c3850 2023-11-04T01:42:30.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.200+0000 7f37cd588740 10 client.0 _ll_register_callbacks cb 0x7f37b40045a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:42:30.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.200+0000 7f37c3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650126b3eb0 0x56501269a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.200+0000 7f37c3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650126b3eb0 0x56501269a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33040/0 (socket says 172.21.15.77:33040) 2023-11-04T01:42:30.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.200+0000 7f37c3fff640 1 -- 172.21.15.77:0/1240776907 learned_addr learned my addr 172.21.15.77:0/1240776907 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:30.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.200+0000 7f37c37fe640 1 --2- 172.21.15.77:0/1240776907 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5650126c3850 0x56501269a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.200+0000 7f37c8eba640 1 --2- 172.21.15.77:0/1240776907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650126c3c30 0x5650126b2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.201+0000 7f37c3fff640 1 -- 172.21.15.77:0/1240776907 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5650126c3850 msgr2=0x56501269a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:30.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.201+0000 7f37c3fff640 1 --2- 172.21.15.77:0/1240776907 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5650126c3850 0x56501269a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.201+0000 7f37c3fff640 1 -- 172.21.15.77:0/1240776907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650126c3c30 msgr2=0x5650126b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:30.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.201+0000 7f37c3fff640 1 --2- 172.21.15.77:0/1240776907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650126c3c30 0x5650126b2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.201+0000 7f37c3fff640 1 -- 172.21.15.77:0/1240776907 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b801a040 con 0x5650126b3eb0 2023-11-04T01:42:30.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.201+0000 7f37c37fe640 1 --2- 172.21.15.77:0/1240776907 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5650126c3850 0x56501269a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:30.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.201+0000 7f37c3fff640 1 --2- 172.21.15.77:0/1240776907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650126b3eb0 0x56501269a160 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f37b40a9d70 tx=0x7f37b4008000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5147c35337b348f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:30.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.201+0000 7f37a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:42:30.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.201+0000 7f37a2ffd640 1 -- 172.21.15.77:0/1240776907 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b40825d0 con 0x5650126b3eb0 2023-11-04T01:42:30.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.201+0000 7f37a2ffd640 1 -- 172.21.15.77:0/1240776907 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f37b4082860 con 0x5650126b3eb0 2023-11-04T01:42:30.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.201+0000 7f37cd588740 1 -- 172.21.15.77:0/1240776907 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f37b40ab050 con 0x5650126b3eb0 2023-11-04T01:42:30.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.201+0000 7f37a2ffd640 1 -- 172.21.15.77:0/1240776907 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37b4079dd0 con 0x5650126b3eb0 2023-11-04T01:42:30.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.201+0000 7f37cd588740 10 client.6552 fetch_fsmap learned FSMap version 29 2023-11-04T01:42:30.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.201+0000 7f37cd588740 1 -- 172.21.15.77:0/1240776907 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0x5650125c4500 con 0x5650126b3eb0 2023-11-04T01:42:30.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.201+0000 7f37a2ffd640 1 -- 172.21.15.77:0/1240776907 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b40ab050 con 0x5650126b3eb0 2023-11-04T01:42:30.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.201+0000 7f37a2ffd640 1 -- 172.21.15.77:0/1240776907 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f37b408f040 con 0x5650126b3eb0 2023-11-04T01:42:30.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.201+0000 7f37cd588740 10 client.6552 fetch_fsmap finished waiting for FSMap version 29 2023-11-04T01:42:30.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.201+0000 7f37cd588740 10 client.6552 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:42:30.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.201+0000 7f37cd588740 20 client.6552 populate_metadata read hostname 'smithi077' 2023-11-04T01:42:30.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.201+0000 7f37cd588740 1 --2- 172.21.15.77:0/1240776907 >> [v2:172.21.15.122:6835/1606545578,v1:172.21.15.122:6837/1606545578] conn(0x5650126b3110 0x5650126b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.201+0000 7f37cd588740 4 client.6552 mds_command: new command op to 35255 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:42:30.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.201+0000 7f37cd588740 1 -- 172.21.15.77:0/1240776907 --> [v2:172.21.15.122:6835/1606545578,v1:172.21.15.122:6837/1606545578] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5650125fb5b0 con 0x5650126b3110 2023-11-04T01:42:30.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.202+0000 7f37c37fe640 1 --2- 172.21.15.77:0/1240776907 >> [v2:172.21.15.122:6835/1606545578,v1:172.21.15.122:6837/1606545578] conn(0x5650126b3110 0x5650126b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.202+0000 7f37c37fe640 1 --2- 172.21.15.77:0/1240776907 >> [v2:172.21.15.122:6835/1606545578,v1:172.21.15.122:6837/1606545578] conn(0x5650126b3110 0x5650126b34f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4092e17ad3d825be server_cookie=3764d17d1a584140 in_seq=0 out_seq=0 2023-11-04T01:42:30.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.202+0000 7f37a2ffd640 10 client.6552 ms_handle_connect on v2:172.21.15.122:6835/1606545578 2023-11-04T01:42:30.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.202+0000 7f37a2ffd640 1 -- 172.21.15.77:0/1240776907 <== mds.0 v2:172.21.15.122:6835/1606545578 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5650125fb5b0 con 0x5650126b3110 2023-11-04T01:42:30.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.202+0000 7f37a2ffd640 10 client.6552 handle_command_reply: tid=0 2023-11-04T01:42:30.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.202+0000 7f37cd588740 1 client.6552 shutdown 2023-11-04T01:42:30.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.202+0000 7f37cd588740 1 -- 172.21.15.77:0/1240776907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650126b3eb0 msgr2=0x56501269a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:30.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.202+0000 7f37cd588740 1 --2- 172.21.15.77:0/1240776907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650126b3eb0 0x56501269a160 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f37b40a9d70 tx=0x7f37b4008000 comp rx=0 tx=0).stop 2023-11-04T01:42:30.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.202+0000 7f37cd588740 1 -- 172.21.15.77:0/1240776907 shutdown_connections 2023-11-04T01:42:30.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.202+0000 7f37cd588740 1 --2- 172.21.15.77:0/1240776907 >> [v2:172.21.15.122:6835/1606545578,v1:172.21.15.122:6837/1606545578] conn(0x5650126b3110 0x5650126b34f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.202+0000 7f37cd588740 1 --2- 172.21.15.77:0/1240776907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5650126c3c30 0x5650126b2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.202+0000 7f37cd588740 1 --2- 172.21.15.77:0/1240776907 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5650126c3850 0x56501269a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.202+0000 7f37a2ffd640 0 client.6552 ms_handle_reset on v2:172.21.15.122:6835/1606545578 2023-11-04T01:42:30.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.202+0000 7f37cd588740 1 --2- 172.21.15.77:0/1240776907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5650126b3eb0 0x56501269a160 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.202+0000 7f37cd588740 1 -- 172.21.15.77:0/1240776907 >> 172.21.15.77:0/1240776907 conn(0x565012696c90 msgr2=0x5650126d8310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:30.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.202+0000 7f37cd588740 1 -- 172.21.15.77:0/1240776907 shutdown_connections 2023-11-04T01:42:30.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.202+0000 7f37cd588740 1 -- 172.21.15.77:0/1240776907 wait complete. 2023-11-04T01:42:30.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.202+0000 7f37cd588740 20 client.6552 trim_cache size 0 max 16384 2023-11-04T01:42:30.241 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-04T01:42:30.242 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "0c22c75d-0169-41ef-b663-6ac1c5b0f71f", 2023-11-04T01:42:30.242 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 0, 2023-11-04T01:42:30.242 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 35255, 2023-11-04T01:42:30.242 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2023-11-04T01:42:30.243 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2023-11-04T01:42:30.243 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2023-11-04T01:42:30.243 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 5.5453601470000002, 2023-11-04T01:42:30.243 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 29, 2023-11-04T01:42:30.243 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 66, 2023-11-04T01:42:30.243 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 66, 2023-11-04T01:42:30.244 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 10.596344519000001 2023-11-04T01:42:30.244 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-04T01:42:30.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.203+0000 7f37ca91d640 1 -- 172.21.15.77:0/3028959928 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f37b006ae70 msgr2=0x7f37b006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:30.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.203+0000 7f37ca91d640 1 --2- 172.21.15.77:0/3028959928 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f37b006ae70 0x7f37b006d330 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f37c415b500 tx=0x7f37b8009040 comp rx=0 tx=0).stop 2023-11-04T01:42:30.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.203+0000 7f37ca91d640 1 -- 172.21.15.77:0/3028959928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37ac003970 msgr2=0x7f37c414cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:30.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.203+0000 7f37ca91d640 1 --2- 172.21.15.77:0/3028959928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37ac003970 0x7f37c414cf80 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f37b402c250 tx=0x7f37b4004730 comp rx=0 tx=0).stop 2023-11-04T01:42:30.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.203+0000 7f37ca91d640 1 -- 172.21.15.77:0/3028959928 shutdown_connections 2023-11-04T01:42:30.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.203+0000 7f37ca91d640 1 --2- 172.21.15.77:0/3028959928 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f37b006ae70 0x7f37b006d330 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.203+0000 7f37ca91d640 1 --2- 172.21.15.77:0/3028959928 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37c4159970 0x7f37c4159e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.203+0000 7f37ca91d640 1 --2- 172.21.15.77:0/3028959928 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f37c41f0a40 0x7f37c41f0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.203+0000 7f37ca91d640 1 --2- 172.21.15.77:0/3028959928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37ac003970 0x7f37c414cf80 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.203+0000 7f37ca91d640 1 -- 172.21.15.77:0/3028959928 >> 172.21.15.77:0/3028959928 conn(0x7f37c40cbc90 msgr2=0x7f37c415db30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:30.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.203+0000 7f37ca91d640 1 -- 172.21.15.77:0/3028959928 shutdown_connections 2023-11-04T01:42:30.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.203+0000 7f37ca91d640 1 -- 172.21.15.77:0/3028959928 wait complete. 2023-11-04T01:42:30.249 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:42:30.258 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:42:30.295 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:42:30.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.349+0000 7fb9fc373640 1 Processor -- start 2023-11-04T01:42:30.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.349+0000 7fb9fc373640 1 -- start start 2023-11-04T01:42:30.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.350+0000 7fb9fc373640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb9f415ce60 0x7fb9f406b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.350+0000 7fb9fc373640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f41615d0 con 0x7fb9f406bd30 2023-11-04T01:42:30.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.350+0000 7fb9fc373640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f41618b0 con 0x7fb9f40cf160 2023-11-04T01:42:30.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.350+0000 7fb9fc373640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f40cbde0 con 0x7fb9f415ce60 2023-11-04T01:42:30.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.350+0000 7fb9f990e640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb9f406bd30 0x7fb9f4160b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:60792/0 (socket says 172.21.15.77:60792) 2023-11-04T01:42:30.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.350+0000 7fb9f990e640 1 -- 172.21.15.77:0/3469661756 learned_addr learned my addr 172.21.15.77:0/3469661756 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:30.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.350+0000 7fb9fa10f640 1 --2- 172.21.15.77:0/3469661756 >> v2:172.21.15.122:3300/0 conn(0x7fb9f415ce60 0x7fb9f406b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.350+0000 7fb9f910d640 1 -- 172.21.15.77:0/3469661756 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3628476883 0 0) 0x7fb9f41615d0 con 0x7fb9f406bd30 2023-11-04T01:42:30.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.350+0000 7fb9f910d640 1 -- 172.21.15.77:0/3469661756 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9e0003520 con 0x7fb9f406bd30 2023-11-04T01:42:30.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.351+0000 7fb9f910d640 1 -- 172.21.15.77:0/3469661756 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3928687571 0 0) 0x7fb9e0003520 con 0x7fb9f406bd30 2023-11-04T01:42:30.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.351+0000 7fb9f910d640 1 -- 172.21.15.77:0/3469661756 >> v2:172.21.15.122:3300/0 conn(0x7fb9f415ce60 msgr2=0x7fb9f406b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:30.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.351+0000 7fb9f910d640 1 --2- 172.21.15.77:0/3469661756 >> v2:172.21.15.122:3300/0 conn(0x7fb9f415ce60 0x7fb9f406b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.351+0000 7fb9f910d640 1 -- 172.21.15.77:0/3469661756 >> v1:172.21.15.122:6789/0 conn(0x7fb9f40cf160 legacy=0x7fb9f40cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:30.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.351+0000 7fb9f910d640 1 -- 172.21.15.77:0/3469661756 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f40cba00 con 0x7fb9f406bd30 2023-11-04T01:42:30.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.351+0000 7fb9f910d640 1 -- 172.21.15.77:0/3469661756 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7fb9f0001670 con 0x7fb9f406bd30 2023-11-04T01:42:30.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.351+0000 7fb9f910d640 1 -- 172.21.15.77:0/3469661756 >> v1:172.21.15.77:6789/0 conn(0x7fb9f406bd30 legacy=0x7fb9f4160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:30.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.351+0000 7fb9f910d640 1 --2- 172.21.15.77:0/3469661756 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9e0003970 0x7fb9e0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.351+0000 7fb9f910d640 1 --2- 172.21.15.77:0/3469661756 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb9e00047c0 0x7fb9e0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.351+0000 7fb9f910d640 1 --2- 172.21.15.77:0/3469661756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9e0005180 0x7fb9e000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.351+0000 7fb9f910d640 1 -- 172.21.15.77:0/3469661756 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f40cbde0 con 0x7fb9e0005180 2023-11-04T01:42:30.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.351+0000 7fb9f910d640 1 -- 172.21.15.77:0/3469661756 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e000c020 con 0x7fb9e0003970 2023-11-04T01:42:30.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.351+0000 7fb9f910d640 1 -- 172.21.15.77:0/3469661756 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e000c1e0 con 0x7fb9e00047c0 2023-11-04T01:42:30.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.351+0000 7fb9fa910640 1 --2- 172.21.15.77:0/3469661756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9e0005180 0x7fb9e000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.351+0000 7fb9fa10f640 1 --2- 172.21.15.77:0/3469661756 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9e0003970 0x7fb9e0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.351+0000 7fb9f990e640 1 --2- 172.21.15.77:0/3469661756 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb9e00047c0 0x7fb9e0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.351+0000 7fb9fa910640 1 -- 172.21.15.77:0/3469661756 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb9e00047c0 msgr2=0x7fb9e0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:30.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.351+0000 7fb9fa910640 1 --2- 172.21.15.77:0/3469661756 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb9e00047c0 0x7fb9e0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.351+0000 7fb9fa910640 1 -- 172.21.15.77:0/3469661756 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9e0003970 msgr2=0x7fb9e0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:30.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.351+0000 7fb9fa910640 1 --2- 172.21.15.77:0/3469661756 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9e0003970 0x7fb9e0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.351+0000 7fb9fa910640 1 -- 172.21.15.77:0/3469661756 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e0003520 con 0x7fb9e0005180 2023-11-04T01:42:30.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.352+0000 7fb9fa910640 1 -- 172.21.15.77:0/3469661756 reap_dead start 2023-11-04T01:42:30.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.352+0000 7fb9fa910640 1 --2- 172.21.15.77:0/3469661756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9e0005180 0x7fb9e000b980 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec001e50 tx=0x7fb9e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f1e401d799f72c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:30.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.352+0000 7fb9f910d640 1 -- 172.21.15.77:0/3469661756 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec003b70 con 0x7fb9e0005180 2023-11-04T01:42:30.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.352+0000 7fb9f910d640 1 -- 172.21.15.77:0/3469661756 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ec003d10 con 0x7fb9e0005180 2023-11-04T01:42:30.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.352+0000 7fb9f910d640 1 -- 172.21.15.77:0/3469661756 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec005310 con 0x7fb9e0005180 2023-11-04T01:42:30.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.353+0000 7fb9fc373640 1 -- 172.21.15.77:0/3469661756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9e0005180 msgr2=0x7fb9e000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:30.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.353+0000 7fb9fc373640 1 --2- 172.21.15.77:0/3469661756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9e0005180 0x7fb9e000b980 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec001e50 tx=0x7fb9e00057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.353+0000 7fb9fc373640 1 -- 172.21.15.77:0/3469661756 shutdown_connections 2023-11-04T01:42:30.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.353+0000 7fb9fc373640 1 --2- 172.21.15.77:0/3469661756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9e0005180 0x7fb9e000b980 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.353+0000 7fb9fc373640 1 -- 172.21.15.77:0/3469661756 >> 172.21.15.77:0/3469661756 conn(0x7fb9f406ea90 msgr2=0x7fb9f406ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:30.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.353+0000 7fb9fc373640 1 -- 172.21.15.77:0/3469661756 shutdown_connections 2023-11-04T01:42:30.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.353+0000 7fb9fc373640 1 -- 172.21.15.77:0/3469661756 wait complete. 2023-11-04T01:42:30.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.354+0000 7fb9fc373640 1 Processor -- start 2023-11-04T01:42:30.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.354+0000 7fb9fc373640 1 -- start start 2023-11-04T01:42:30.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.354+0000 7fb9fc373640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9e0005180 0x7fb9f4151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.355+0000 7fb9fc373640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9f40c86f0 0x7fb9f40b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.355+0000 7fb9fc373640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb9f40c5410 0x7fb9f40c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.355+0000 7fb9fc373640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f40c5dd0 con 0x7fb9e0005180 2023-11-04T01:42:30.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.355+0000 7fb9fc373640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f41f5ce0 con 0x7fb9f40c86f0 2023-11-04T01:42:30.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.355+0000 7fb9fc373640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f41f5f30 con 0x7fb9f40c5410 2023-11-04T01:42:30.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.355+0000 7fb9fa10f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9e0005180 0x7fb9f4151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.355+0000 7fb9fa10f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9e0005180 0x7fb9f4151020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33062/0 (socket says 172.21.15.77:33062) 2023-11-04T01:42:30.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.355+0000 7fb9fa10f640 1 -- 172.21.15.77:0/1682228730 learned_addr learned my addr 172.21.15.77:0/1682228730 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:30.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.355+0000 7fb9fa10f640 1 -- 172.21.15.77:0/1682228730 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb9f40c5410 msgr2=0x7fb9f40c5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:30.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.355+0000 7fb9fa10f640 1 --2- 172.21.15.77:0/1682228730 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb9f40c5410 0x7fb9f40c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.355+0000 7fb9fa10f640 1 -- 172.21.15.77:0/1682228730 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9f40c86f0 msgr2=0x7fb9f40b2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:30.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.355+0000 7fb9fa10f640 1 --2- 172.21.15.77:0/1682228730 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9f40c86f0 0x7fb9f40b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.355+0000 7fb9fa10f640 1 -- 172.21.15.77:0/1682228730 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f41f6210 con 0x7fb9e0005180 2023-11-04T01:42:30.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.355+0000 7fb9fa10f640 1 --2- 172.21.15.77:0/1682228730 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9e0005180 0x7fb9f4151020 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4011910 tx=0x7fb9e4011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:30.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.355+0000 7fb9eaffd640 1 -- 172.21.15.77:0/1682228730 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e400faf0 con 0x7fb9e0005180 2023-11-04T01:42:30.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.355+0000 7fb9eaffd640 1 -- 172.21.15.77:0/1682228730 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e400fc50 con 0x7fb9e0005180 2023-11-04T01:42:30.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.355+0000 7fb9eaffd640 1 -- 172.21.15.77:0/1682228730 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e4014440 con 0x7fb9e0005180 2023-11-04T01:42:30.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.355+0000 7fb9fc373640 1 -- 172.21.15.77:0/1682228730 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f41f64f0 con 0x7fb9e0005180 2023-11-04T01:42:30.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.355+0000 7fb9fc373640 1 -- 172.21.15.77:0/1682228730 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f41f6ab0 con 0x7fb9e0005180 2023-11-04T01:42:30.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.356+0000 7fb9fc373640 1 -- 172.21.15.77:0/1682228730 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9f4074290 con 0x7fb9e0005180 2023-11-04T01:42:30.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.357+0000 7fb9eaffd640 1 -- 172.21.15.77:0/1682228730 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb9e40145a0 con 0x7fb9e0005180 2023-11-04T01:42:30.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.357+0000 7fb9eaffd640 1 --2- 172.21.15.77:0/1682228730 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb9d806ae70 0x7fb9d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:30.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.357+0000 7fb9eaffd640 1 -- 172.21.15.77:0/1682228730 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb9e408a080 con 0x7fb9e0005180 2023-11-04T01:42:30.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.357+0000 7fb9f990e640 1 --2- 172.21.15.77:0/1682228730 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb9d806ae70 0x7fb9d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:30.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.358+0000 7fb9f990e640 1 --2- 172.21.15.77:0/1682228730 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb9d806ae70 0x7fb9d806d330 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0000f60 tx=0x7fb9f0000ed0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:30.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.361+0000 7fb9eaffd640 1 -- 172.21.15.77:0/1682228730 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb9e4054e90 con 0x7fb9e0005180 2023-11-04T01:42:30.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.564+0000 7fb9fc373640 1 -- 172.21.15.77:0/1682228730 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb9f406b3e0 con 0x7fb9e0005180 2023-11-04T01:42:30.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.564+0000 7fb9eaffd640 1 -- 172.21.15.77:0/1682228730 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v29) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb9e40584b0 con 0x7fb9e0005180 2023-11-04T01:42:30.566 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:42:30.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.566+0000 7fb9fc373640 1 -- 172.21.15.77:0/1682228730 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb9d806ae70 msgr2=0x7fb9d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:30.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.566+0000 7fb9fc373640 1 --2- 172.21.15.77:0/1682228730 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb9d806ae70 0x7fb9d806d330 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0000f60 tx=0x7fb9f0000ed0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.566+0000 7fb9fc373640 1 -- 172.21.15.77:0/1682228730 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9e0005180 msgr2=0x7fb9f4151020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:30.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.566+0000 7fb9fc373640 1 --2- 172.21.15.77:0/1682228730 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9e0005180 0x7fb9f4151020 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4011910 tx=0x7fb9e4011dd0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.566+0000 7fb9fc373640 1 -- 172.21.15.77:0/1682228730 shutdown_connections 2023-11-04T01:42:30.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.566+0000 7fb9fc373640 1 --2- 172.21.15.77:0/1682228730 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb9d806ae70 0x7fb9d806d330 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.566+0000 7fb9fc373640 1 --2- 172.21.15.77:0/1682228730 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb9f40c5410 0x7fb9f40c5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.566+0000 7fb9fc373640 1 --2- 172.21.15.77:0/1682228730 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9f40c86f0 0x7fb9f40b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.566+0000 7fb9fc373640 1 --2- 172.21.15.77:0/1682228730 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9e0005180 0x7fb9f4151020 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:30.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.566+0000 7fb9fc373640 1 -- 172.21.15.77:0/1682228730 >> 172.21.15.77:0/1682228730 conn(0x7fb9f406ea90 msgr2=0x7fb9f41608e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:30.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.566+0000 7fb9fc373640 1 -- 172.21.15.77:0/1682228730 shutdown_connections 2023-11-04T01:42:30.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:30.566+0000 7fb9fc373640 1 -- 172.21.15.77:0/1682228730 wait complete. 2023-11-04T01:42:30.578 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:42:30.579 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:42:30.579 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2023-11-04T01:42:30.579 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:42:30.580 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:30.580 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:42:30.580 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:42:30.581 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:42:30.581 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:42:30.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:30.582 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2023-11-04T01:42:30.598 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:42:30.598 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:42:30.598 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:42:30.599 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:30.599 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2023-11-04T01:42:30.599 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:30.599 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:42:30.599 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:30.600 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f0 2023-11-04T01:42:30.600 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:42:30.600 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:30.600 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f1 2023-11-04T01:42:30.600 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:42:30.600 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:30.601 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:42:30.601 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:30.601 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:42:30.601 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 42255sec preferred_lft 42255sec 2023-11-04T01:42:30.602 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::ec4:7aff:fe8f:d3d3/64 scope link 2023-11-04T01:42:30.602 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:30.602 INFO:teuthology.orchestra.run.smithi077.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:42:30.602 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 06:3a:02:11:c4:57 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:30.602 INFO:teuthology.orchestra.run.smithi077.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:42:30.603 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:30.603 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::8039:1aff:fee2:109f/64 scope link 2023-11-04T01:42:30.603 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:30.603 INFO:teuthology.orchestra.run.smithi077.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:42:30.603 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 06:3a:02:11:c4:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:30.604 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::43a:2ff:fe11:c457/64 scope link 2023-11-04T01:42:30.604 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:30.604 INFO:teuthology.orchestra.run.smithi077.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:42:30.604 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether c2:4f:2a:69:4f:38 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:30.604 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::c04f:2aff:fe69:4f38/64 scope link 2023-11-04T01:42:30.605 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:30.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:30.605 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:42:30.663 INFO:teuthology.orchestra.run.smithi077.stdout:1 2023-11-04T01:42:30.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:30.665 DEBUG:teuthology.orchestra.run.smithi077:> route 2023-11-04T01:42:30.721 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2023-11-04T01:42:30.721 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:42:30.721 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:42:30.721 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:42:30.722 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:42:30.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:30.726 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-11-04T01:42:30.727 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-11-04T01:42:30.727 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:42:30.727 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:42:30.728 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:42:30.728 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-11-04T01:42:30.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:30.816 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2023-11-04T01:42:30.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:42:30.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:42:30.832 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:42:30.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:30.832 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 up 2023-11-04T01:42:30.898 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:42:30.898 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:42:30.899 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:30.952 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:42:30.952 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:42:30.953 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:31.007 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:42:31.063 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2023-11-04T01:42:31.063 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2023-11-04T01:42:31.063 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2023-11-04T01:42:31.063 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2023-11-04T01:42:31.064 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2023-11-04T01:42:31.064 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2023-11-04T01:42:31.064 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2023-11-04T01:42:31.064 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2023-11-04T01:42:31.064 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2023-11-04T01:42:31.065 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2023-11-04T01:42:31.065 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2023-11-04T01:42:31.065 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2023-11-04T01:42:31.065 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:42:31.065 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2023-11-04T01:42:31.066 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2023-11-04T01:42:31.066 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2023-11-04T01:42:31.066 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2023-11-04T01:42:31.066 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2023-11-04T01:42:31.067 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2023-11-04T01:42:31.067 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:42:31.067 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:42:31.067 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:42:31.067 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:42:31.068 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2023-11-04T01:42:31.068 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2023-11-04T01:42:31.068 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:42:31.068 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:42:31.069 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:42:31.069 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:42:31.069 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2023-11-04T01:42:31.069 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:31.069 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:31.070 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:31.070 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:31.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:31.071 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-11-04T01:42:31.118 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:42:31.118 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:42:31.161 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:42:31.176 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2023-11-04T01:42:31.176 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2023-11-04T01:42:31.176 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2023-11-04T01:42:31.177 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2023-11-04T01:42:31.177 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2023-11-04T01:42:31.177 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2023-11-04T01:42:31.177 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2023-11-04T01:42:31.177 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2023-11-04T01:42:31.178 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2023-11-04T01:42:31.178 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2023-11-04T01:42:31.178 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2023-11-04T01:42:31.178 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2023-11-04T01:42:31.179 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:42:31.179 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2023-11-04T01:42:31.179 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2023-11-04T01:42:31.179 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2023-11-04T01:42:31.179 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2023-11-04T01:42:31.180 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2023-11-04T01:42:31.180 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2023-11-04T01:42:31.180 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:42:31.180 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:42:31.180 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:42:31.181 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:42:31.181 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2023-11-04T01:42:31.181 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2023-11-04T01:42:31.181 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:42:31.181 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:42:31.181 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:42:31.182 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:42:31.182 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2023-11-04T01:42:31.182 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:31.182 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:31.182 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:31.183 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:31.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:31.183 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-11-04T01:42:31.250 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:2023-11-04T01:42:31.249+0000 7f8b42e0e480 -1 init, newargv = 0x55ca2e530f30 newargc=15 2023-11-04T01:42:31.251 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[141280]: starting ceph client 2023-11-04T01:42:31.254 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[141280]: starting fuse 2023-11-04T01:42:32.333 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:42:32.351 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2023-11-04T01:42:32.352 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2023-11-04T01:42:32.352 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2023-11-04T01:42:32.352 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2023-11-04T01:42:32.352 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2023-11-04T01:42:32.352 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2023-11-04T01:42:32.353 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2023-11-04T01:42:32.353 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2023-11-04T01:42:32.353 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2023-11-04T01:42:32.353 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2023-11-04T01:42:32.353 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2023-11-04T01:42:32.354 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2023-11-04T01:42:32.354 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:42:32.354 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2023-11-04T01:42:32.354 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2023-11-04T01:42:32.354 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2023-11-04T01:42:32.355 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2023-11-04T01:42:32.355 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2023-11-04T01:42:32.355 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2023-11-04T01:42:32.355 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:42:32.355 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:42:32.356 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:42:32.356 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:42:32.356 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2023-11-04T01:42:32.356 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2023-11-04T01:42:32.356 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:42:32.357 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:42:32.357 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:42:32.357 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:42:32.357 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2023-11-04T01:42:32.357 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:32.357 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:32.358 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:32.358 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:32.358 INFO:teuthology.orchestra.run.smithi077.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:32.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:32.359 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-11-04T01:42:32.408 INFO:teuthology.orchestra.run.smithi077.stdout:42 2023-11-04T01:42:32.408 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-11-04T01:42:32.409 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:42:32.409 DEBUG:teuthology.orchestra.run.smithi077:> import glob 2023-11-04T01:42:32.409 DEBUG:teuthology.orchestra.run.smithi077:> import re 2023-11-04T01:42:32.410 DEBUG:teuthology.orchestra.run.smithi077:> import os 2023-11-04T01:42:32.410 DEBUG:teuthology.orchestra.run.smithi077:> import subprocess 2023-11-04T01:42:32.410 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:42:32.411 DEBUG:teuthology.orchestra.run.smithi077:> def _find_admin_socket(client_name): 2023-11-04T01:42:32.411 DEBUG:teuthology.orchestra.run.smithi077:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:42:32.412 DEBUG:teuthology.orchestra.run.smithi077:> files = glob.glob(asok_path) 2023-11-04T01:42:32.412 DEBUG:teuthology.orchestra.run.smithi077:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:42:32.412 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:42:32.413 DEBUG:teuthology.orchestra.run.smithi077:> # Given a non-glob path, it better be there 2023-11-04T01:42:32.413 DEBUG:teuthology.orchestra.run.smithi077:> if "*" not in asok_path: 2023-11-04T01:42:32.413 DEBUG:teuthology.orchestra.run.smithi077:> assert(len(files) == 1) 2023-11-04T01:42:32.414 DEBUG:teuthology.orchestra.run.smithi077:> return files[0] 2023-11-04T01:42:32.414 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:42:32.415 DEBUG:teuthology.orchestra.run.smithi077:> for f in files: 2023-11-04T01:42:32.415 DEBUG:teuthology.orchestra.run.smithi077:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:42:32.416 DEBUG:teuthology.orchestra.run.smithi077:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:42:32.416 DEBUG:teuthology.orchestra.run.smithi077:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:42:32.416 DEBUG:teuthology.orchestra.run.smithi077:> contents = proc_f.read() 2023-11-04T01:42:32.417 DEBUG:teuthology.orchestra.run.smithi077:> if mountpoint in contents: 2023-11-04T01:42:32.417 DEBUG:teuthology.orchestra.run.smithi077:> return f 2023-11-04T01:42:32.417 DEBUG:teuthology.orchestra.run.smithi077:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:42:32.418 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:42:32.418 DEBUG:teuthology.orchestra.run.smithi077:> print(_find_admin_socket("client.0")) 2023-11-04T01:42:32.418 DEBUG:teuthology.orchestra.run.smithi077:> ' 2023-11-04T01:42:32.533 INFO:teuthology.orchestra.run.smithi077.stdout:/var/run/ceph/ceph-client.0.141280.asok 2023-11-04T01:42:32.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:32.544 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.141280.asok 2023-11-04T01:42:32.544 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:32.545 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.141280.asok status 2023-11-04T01:42:32.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:32.715 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-04T01:42:32.716 INFO:teuthology.orchestra.run.smithi077.stdout: "metadata": { 2023-11-04T01:42:32.716 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:42:32.716 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:42:32.716 INFO:teuthology.orchestra.run.smithi077.stdout: "entity_id": "0", 2023-11-04T01:42:32.717 INFO:teuthology.orchestra.run.smithi077.stdout: "hostname": "smithi077", 2023-11-04T01:42:32.717 INFO:teuthology.orchestra.run.smithi077.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:42:32.717 INFO:teuthology.orchestra.run.smithi077.stdout: "pid": "141280", 2023-11-04T01:42:32.717 INFO:teuthology.orchestra.run.smithi077.stdout: "root": "/" 2023-11-04T01:42:32.717 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:32.717 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_count": 0, 2023-11-04T01:42:32.718 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_pinned_count": 0, 2023-11-04T01:42:32.718 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 6564, 2023-11-04T01:42:32.718 INFO:teuthology.orchestra.run.smithi077.stdout: "inst": { 2023-11-04T01:42:32.718 INFO:teuthology.orchestra.run.smithi077.stdout: "name": { 2023-11-04T01:42:32.718 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "client", 2023-11-04T01:42:32.719 INFO:teuthology.orchestra.run.smithi077.stdout: "num": 6564 2023-11-04T01:42:32.719 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:32.719 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2023-11-04T01:42:32.719 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2023-11-04T01:42:32.720 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:42:32.720 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 4205152445 2023-11-04T01:42:32.720 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:32.720 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:32.720 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2023-11-04T01:42:32.720 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2023-11-04T01:42:32.721 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:42:32.721 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 4205152445 2023-11-04T01:42:32.721 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:32.721 INFO:teuthology.orchestra.run.smithi077.stdout: "inst_str": "client.6564 192.168.0.1:0/4205152445", 2023-11-04T01:42:32.722 INFO:teuthology.orchestra.run.smithi077.stdout: "addr_str": "192.168.0.1:0/4205152445", 2023-11-04T01:42:32.722 INFO:teuthology.orchestra.run.smithi077.stdout: "inode_count": 1, 2023-11-04T01:42:32.722 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_epoch": 29, 2023-11-04T01:42:32.722 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch": 66, 2023-11-04T01:42:32.723 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:42:32.723 INFO:teuthology.orchestra.run.smithi077.stdout: "blocklisted": false, 2023-11-04T01:42:32.723 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs" 2023-11-04T01:42:32.723 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-04T01:42:32.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:32.729 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:32.730 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:42:32.730 DEBUG:teuthology.orchestra.run.smithi077:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:32.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:32.789 INFO:teuthology.orchestra.run.smithi077.stdout:fuseblk 2023-11-04T01:42:32.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:32.795 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:32.796 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:32.796 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:32.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:32.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:32.862 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create test_data_pool 2023-11-04T01:42:32.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.961+0000 7fe2e0189640 1 Processor -- start 2023-11-04T01:42:32.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.961+0000 7fe2e0189640 1 -- start start 2023-11-04T01:42:32.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.962+0000 7fe2e0189640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe2d8070e20 0x7fe2d80adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:32.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.962+0000 7fe2e0189640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d80c3900 con 0x7fe2d80ad730 2023-11-04T01:42:32.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.962+0000 7fe2e0189640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d80c3be0 con 0x7fe2d815ad30 2023-11-04T01:42:32.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.962+0000 7fe2e0189640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2d80ae260 con 0x7fe2d8070e20 2023-11-04T01:42:32.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.962+0000 7fe2dd724640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe2d8070e20 0x7fe2d80adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:32.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.962+0000 7fe2de726640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe2d80ad730 0x7fe2d815e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:60802/0 (socket says 172.21.15.77:60802) 2023-11-04T01:42:32.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.962+0000 7fe2de726640 1 -- 172.21.15.77:0/3719759781 learned_addr learned my addr 172.21.15.77:0/3719759781 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:32.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.962+0000 7fe2dd724640 1 -- 172.21.15.77:0/3719759781 >> v1:172.21.15.122:6789/0 conn(0x7fe2d815ad30 legacy=0x7fe2d8070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:32.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.962+0000 7fe2dd724640 1 -- 172.21.15.77:0/3719759781 >> v1:172.21.15.77:6789/0 conn(0x7fe2d80ad730 legacy=0x7fe2d815e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:32.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.962+0000 7fe2dd724640 1 -- 172.21.15.77:0/3719759781 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d80c3ec0 con 0x7fe2d8070e20 2023-11-04T01:42:32.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.963+0000 7fe2dd724640 1 --2- 172.21.15.77:0/3719759781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2d8070e20 0x7fe2d80adc80 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc0097a0 tx=0x7fe2cc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e922ed5243a31d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:32.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.963+0000 7fe2dcf23640 1 -- 172.21.15.77:0/3719759781 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc02e070 con 0x7fe2d8070e20 2023-11-04T01:42:32.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.963+0000 7fe2dcf23640 1 -- 172.21.15.77:0/3719759781 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2cc0315a0 con 0x7fe2d8070e20 2023-11-04T01:42:32.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.963+0000 7fe2dcf23640 1 -- 172.21.15.77:0/3719759781 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc031930 con 0x7fe2d8070e20 2023-11-04T01:42:32.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.964+0000 7fe2e0189640 1 -- 172.21.15.77:0/3719759781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2d8070e20 msgr2=0x7fe2d80adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:32.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.964+0000 7fe2e0189640 1 --2- 172.21.15.77:0/3719759781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2d8070e20 0x7fe2d80adc80 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc0097a0 tx=0x7fe2cc02b840 comp rx=0 tx=0).stop 2023-11-04T01:42:32.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.964+0000 7fe2e0189640 1 -- 172.21.15.77:0/3719759781 shutdown_connections 2023-11-04T01:42:32.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.964+0000 7fe2e0189640 1 --2- 172.21.15.77:0/3719759781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2d8070e20 0x7fe2d80adc80 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.964+0000 7fe2e0189640 1 -- 172.21.15.77:0/3719759781 >> 172.21.15.77:0/3719759781 conn(0x7fe2d80ce950 msgr2=0x7fe2d80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:32.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.964+0000 7fe2e0189640 1 -- 172.21.15.77:0/3719759781 shutdown_connections 2023-11-04T01:42:32.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.964+0000 7fe2e0189640 1 -- 172.21.15.77:0/3719759781 wait complete. 2023-11-04T01:42:32.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.965+0000 7fe2e0189640 1 Processor -- start 2023-11-04T01:42:32.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.965+0000 7fe2e0189640 1 -- start start 2023-11-04T01:42:32.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.966+0000 7fe2e0189640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe2d8070e20 0x7fe2d8151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:32.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.966+0000 7fe2e0189640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2d80ad730 0x7fe2d8156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:32.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.966+0000 7fe2e0189640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2d815ad30 0x7fe2d81599b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:32.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.966+0000 7fe2e0189640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d815be80 con 0x7fe2d815ad30 2023-11-04T01:42:32.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.966+0000 7fe2e0189640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d8151ac0 con 0x7fe2d80ad730 2023-11-04T01:42:32.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.966+0000 7fe2e0189640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d81571f0 con 0x7fe2d8070e20 2023-11-04T01:42:32.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.966+0000 7fe2de726640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2d815ad30 0x7fe2d81599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:32.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.966+0000 7fe2de726640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2d815ad30 0x7fe2d81599b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33066/0 (socket says 172.21.15.77:33066) 2023-11-04T01:42:32.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.966+0000 7fe2de726640 1 -- 172.21.15.77:0/1644518624 learned_addr learned my addr 172.21.15.77:0/1644518624 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:32.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.966+0000 7fe2de726640 1 -- 172.21.15.77:0/1644518624 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe2d8070e20 msgr2=0x7fe2d8151580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:32.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.966+0000 7fe2de726640 1 --2- 172.21.15.77:0/1644518624 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe2d8070e20 0x7fe2d8151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.966+0000 7fe2de726640 1 -- 172.21.15.77:0/1644518624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2d80ad730 msgr2=0x7fe2d8156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:32.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.966+0000 7fe2de726640 1 --2- 172.21.15.77:0/1644518624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2d80ad730 0x7fe2d8156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.966+0000 7fe2de726640 1 -- 172.21.15.77:0/1644518624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2cc009400 con 0x7fe2d815ad30 2023-11-04T01:42:32.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.966+0000 7fe2de726640 1 --2- 172.21.15.77:0/1644518624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2d815ad30 0x7fe2d81599b0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fe2c800c420 tx=0x7fe2c800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:32.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.966+0000 7fe2d67fc640 1 -- 172.21.15.77:0/1644518624 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8005ce0 con 0x7fe2d815ad30 2023-11-04T01:42:32.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.966+0000 7fe2d67fc640 1 -- 172.21.15.77:0/1644518624 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c8005e40 con 0x7fe2d815ad30 2023-11-04T01:42:32.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.966+0000 7fe2e0189640 1 -- 172.21.15.77:0/1644518624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2d81574d0 con 0x7fe2d815ad30 2023-11-04T01:42:32.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.966+0000 7fe2d67fc640 1 -- 172.21.15.77:0/1644518624 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c80072d0 con 0x7fe2d815ad30 2023-11-04T01:42:32.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.966+0000 7fe2e0189640 1 -- 172.21.15.77:0/1644518624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d8157a90 con 0x7fe2d815ad30 2023-11-04T01:42:32.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.967+0000 7fe2e0189640 1 -- 172.21.15.77:0/1644518624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2d815bfc0 con 0x7fe2d815ad30 2023-11-04T01:42:32.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.968+0000 7fe2d67fc640 1 -- 172.21.15.77:0/1644518624 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe2c80074f0 con 0x7fe2d815ad30 2023-11-04T01:42:32.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.968+0000 7fe2d67fc640 1 --2- 172.21.15.77:0/1644518624 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe2c406ae70 0x7fe2c406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:32.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.968+0000 7fe2d67fc640 1 -- 172.21.15.77:0/1644518624 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe2c8088ce0 con 0x7fe2d815ad30 2023-11-04T01:42:32.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.968+0000 7fe2ddf25640 1 --2- 172.21.15.77:0/1644518624 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe2c406ae70 0x7fe2c406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:32.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.969+0000 7fe2ddf25640 1 --2- 172.21.15.77:0/1644518624 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe2c406ae70 0x7fe2c406d330 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe2d000abb0 tx=0x7fe2d0009250 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:32.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:32.972+0000 7fe2d67fc640 1 -- 172.21.15.77:0/1644518624 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe2d815bfc0 con 0x7fe2d815ad30 2023-11-04T01:42:33.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.140+0000 7fe2e0189640 1 -- 172.21.15.77:0/1644518624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "test_data_pool"} v 0) v1 -- 0x7fe2d815bfc0 con 0x7fe2d815ad30 2023-11-04T01:42:33.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.329+0000 7fe2d67fc640 1 -- 172.21.15.77:0/1644518624 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "test_data_pool"}]=0 pool 'test_data_pool' created v67) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe2d815bfc0 con 0x7fe2d815ad30 2023-11-04T01:42:33.331 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'test_data_pool' created 2023-11-04T01:42:33.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.332+0000 7fe2e0189640 1 -- 172.21.15.77:0/1644518624 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe2c406ae70 msgr2=0x7fe2c406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.332+0000 7fe2e0189640 1 --2- 172.21.15.77:0/1644518624 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe2c406ae70 0x7fe2c406d330 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe2d000abb0 tx=0x7fe2d0009250 comp rx=0 tx=0).stop 2023-11-04T01:42:33.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.332+0000 7fe2e0189640 1 -- 172.21.15.77:0/1644518624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2d815ad30 msgr2=0x7fe2d81599b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.332+0000 7fe2e0189640 1 --2- 172.21.15.77:0/1644518624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2d815ad30 0x7fe2d81599b0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fe2c800c420 tx=0x7fe2c800c8e0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.333+0000 7fe2e0189640 1 -- 172.21.15.77:0/1644518624 shutdown_connections 2023-11-04T01:42:33.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.333+0000 7fe2e0189640 1 --2- 172.21.15.77:0/1644518624 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe2c406ae70 0x7fe2c406d330 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.333+0000 7fe2e0189640 1 --2- 172.21.15.77:0/1644518624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2d815ad30 0x7fe2d81599b0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.333+0000 7fe2e0189640 1 --2- 172.21.15.77:0/1644518624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2d80ad730 0x7fe2d8156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.333+0000 7fe2e0189640 1 --2- 172.21.15.77:0/1644518624 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe2d8070e20 0x7fe2d8151580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.333+0000 7fe2e0189640 1 -- 172.21.15.77:0/1644518624 >> 172.21.15.77:0/1644518624 conn(0x7fe2d80ce950 msgr2=0x7fe2d80ca3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:33.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.333+0000 7fe2e0189640 1 -- 172.21.15.77:0/1644518624 shutdown_connections 2023-11-04T01:42:33.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.333+0000 7fe2e0189640 1 -- 172.21.15.77:0/1644518624 wait complete. 2023-11-04T01:42:33.349 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create test_metadata_pool 2023-11-04T01:42:33.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.449+0000 7f8e2974c640 1 Processor -- start 2023-11-04T01:42:33.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.449+0000 7f8e2974c640 1 -- start start 2023-11-04T01:42:33.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.450+0000 7f8e2974c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8e241603d0 0x7f8e240b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.450+0000 7f8e2974c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8e2406a830 0x7f8e240ca380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.450+0000 7f8e2974c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e240cdf80 con 0x7f8e240722a0 2023-11-04T01:42:33.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.450+0000 7f8e2974c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e240b19d0 con 0x7f8e241603d0 2023-11-04T01:42:33.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.450+0000 7f8e2974c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e240ce6f0 con 0x7f8e2406a830 2023-11-04T01:42:33.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.450+0000 7f8e22ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8e241603d0 0x7f8e240b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.450+0000 7f8e22ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8e241603d0 0x7f8e240b1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33078/0 (socket says 172.21.15.77:33078) 2023-11-04T01:42:33.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.450+0000 7f8e22ffd640 1 -- 172.21.15.77:0/1254335347 learned_addr learned my addr 172.21.15.77:0/1254335347 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:33.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.451+0000 7f8e237fe640 1 --2- 172.21.15.77:0/1254335347 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8e2406a830 0x7f8e240ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.451+0000 7f8e22ffd640 1 -- 172.21.15.77:0/1254335347 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8e2406a830 msgr2=0x7f8e240ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:33.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.451+0000 7f8e22ffd640 1 --2- 172.21.15.77:0/1254335347 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8e2406a830 0x7f8e240ca380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.451+0000 7f8e22ffd640 1 -- 172.21.15.77:0/1254335347 >> v1:172.21.15.122:6789/0 conn(0x7f8e240722a0 legacy=0x7f8e2406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:33.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.451+0000 7f8e22ffd640 1 -- 172.21.15.77:0/1254335347 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e24072700 con 0x7f8e241603d0 2023-11-04T01:42:33.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.451+0000 7f8e22ffd640 1 --2- 172.21.15.77:0/1254335347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e241603d0 0x7f8e240b1490 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f8e14009e50 tx=0x7f8e1402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a71e0fc8b0c6e211 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:33.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.451+0000 7f8e21ffb640 1 -- 172.21.15.77:0/1254335347 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1402c9e0 con 0x7f8e241603d0 2023-11-04T01:42:33.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.452+0000 7f8e21ffb640 1 -- 172.21.15.77:0/1254335347 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1402cb40 con 0x7f8e241603d0 2023-11-04T01:42:33.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.452+0000 7f8e21ffb640 1 -- 172.21.15.77:0/1254335347 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e140343f0 con 0x7f8e241603d0 2023-11-04T01:42:33.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.452+0000 7f8e2974c640 1 -- 172.21.15.77:0/1254335347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e241603d0 msgr2=0x7f8e240b1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.452+0000 7f8e2974c640 1 --2- 172.21.15.77:0/1254335347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e241603d0 0x7f8e240b1490 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f8e14009e50 tx=0x7f8e1402be40 comp rx=0 tx=0).stop 2023-11-04T01:42:33.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.452+0000 7f8e2974c640 1 -- 172.21.15.77:0/1254335347 shutdown_connections 2023-11-04T01:42:33.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.452+0000 7f8e2974c640 1 --2- 172.21.15.77:0/1254335347 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8e2406a830 0x7f8e240ca380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.452+0000 7f8e2974c640 1 --2- 172.21.15.77:0/1254335347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e241603d0 0x7f8e240b1490 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.452+0000 7f8e2974c640 1 -- 172.21.15.77:0/1254335347 >> 172.21.15.77:0/1254335347 conn(0x7f8e2406d800 msgr2=0x7f8e2406dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:33.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.452+0000 7f8e2974c640 1 -- 172.21.15.77:0/1254335347 shutdown_connections 2023-11-04T01:42:33.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.452+0000 7f8e2974c640 1 -- 172.21.15.77:0/1254335347 wait complete. 2023-11-04T01:42:33.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.453+0000 7f8e2974c640 1 Processor -- start 2023-11-04T01:42:33.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.453+0000 7f8e2974c640 1 -- start start 2023-11-04T01:42:33.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.454+0000 7f8e2974c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e2406a830 0x7f8e24148eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.454+0000 7f8e2974c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e240722a0 0x7f8e240b2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.454+0000 7f8e2974c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8e241603d0 0x7f8e24155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.454+0000 7f8e2974c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e240b2a90 con 0x7f8e2406a830 2023-11-04T01:42:33.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.454+0000 7f8e2974c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e241545d0 con 0x7f8e240722a0 2023-11-04T01:42:33.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.454+0000 7f8e2974c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e241548b0 con 0x7f8e241603d0 2023-11-04T01:42:33.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.454+0000 7f8e22ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e2406a830 0x7f8e24148eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.454+0000 7f8e22ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e2406a830 0x7f8e24148eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33094/0 (socket says 172.21.15.77:33094) 2023-11-04T01:42:33.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.454+0000 7f8e22ffd640 1 -- 172.21.15.77:0/3648349805 learned_addr learned my addr 172.21.15.77:0/3648349805 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:33.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.454+0000 7f8e237fe640 1 --2- 172.21.15.77:0/3648349805 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8e241603d0 0x7f8e24155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.454+0000 7f8e227fc640 1 --2- 172.21.15.77:0/3648349805 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e240722a0 0x7f8e240b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.455+0000 7f8e22ffd640 1 -- 172.21.15.77:0/3648349805 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8e241603d0 msgr2=0x7f8e24155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.455+0000 7f8e22ffd640 1 --2- 172.21.15.77:0/3648349805 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8e241603d0 0x7f8e24155670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.455+0000 7f8e22ffd640 1 -- 172.21.15.77:0/3648349805 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e240722a0 msgr2=0x7f8e240b2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.455+0000 7f8e22ffd640 1 --2- 172.21.15.77:0/3648349805 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e240722a0 0x7f8e240b2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.455+0000 7f8e22ffd640 1 -- 172.21.15.77:0/3648349805 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e14009b30 con 0x7f8e2406a830 2023-11-04T01:42:33.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.455+0000 7f8e22ffd640 1 --2- 172.21.15.77:0/3648349805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e2406a830 0x7f8e24148eb0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f8e14009e50 tx=0x7f8e14004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:33.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.455+0000 7f8e1b7fe640 1 -- 172.21.15.77:0/3648349805 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e14009510 con 0x7f8e2406a830 2023-11-04T01:42:33.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.455+0000 7f8e1b7fe640 1 -- 172.21.15.77:0/3648349805 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1403e450 con 0x7f8e2406a830 2023-11-04T01:42:33.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.455+0000 7f8e2974c640 1 -- 172.21.15.77:0/3648349805 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e24154b90 con 0x7f8e2406a830 2023-11-04T01:42:33.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.455+0000 7f8e1b7fe640 1 -- 172.21.15.77:0/3648349805 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1403e800 con 0x7f8e2406a830 2023-11-04T01:42:33.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.455+0000 7f8e2974c640 1 -- 172.21.15.77:0/3648349805 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e24155150 con 0x7f8e2406a830 2023-11-04T01:42:33.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.456+0000 7f8e2974c640 1 -- 172.21.15.77:0/3648349805 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e240b5990 con 0x7f8e2406a830 2023-11-04T01:42:33.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.456+0000 7f8e1b7fe640 1 -- 172.21.15.77:0/3648349805 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8e1403e960 con 0x7f8e2406a830 2023-11-04T01:42:33.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.457+0000 7f8e1b7fe640 1 --2- 172.21.15.77:0/3648349805 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8e0406ae70 0x7f8e0406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.457+0000 7f8e1b7fe640 1 -- 172.21.15.77:0/3648349805 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f8e140ac650 con 0x7f8e2406a830 2023-11-04T01:42:33.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.457+0000 7f8e227fc640 1 --2- 172.21.15.77:0/3648349805 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8e0406ae70 0x7f8e0406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.458+0000 7f8e227fc640 1 --2- 172.21.15.77:0/3648349805 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8e0406ae70 0x7f8e0406d330 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8e240cc040 tx=0x7f8e0c007e30 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:33.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.461+0000 7f8e1b7fe640 1 -- 172.21.15.77:0/3648349805 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8e14077440 con 0x7f8e2406a830 2023-11-04T01:42:33.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:33.628+0000 7f8e2974c640 1 -- 172.21.15.77:0/3648349805 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "test_metadata_pool"} v 0) v1 -- 0x7f8e240c77b0 con 0x7f8e2406a830 2023-11-04T01:42:34.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.331+0000 7f8e1b7fe640 1 -- 172.21.15.77:0/3648349805 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "test_metadata_pool"}]=0 pool 'test_metadata_pool' created v68) v1 ==== 126+0+0 (secure 0 0 0) 0x7f8e1407aa60 con 0x7f8e2406a830 2023-11-04T01:42:34.333 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'test_metadata_pool' created 2023-11-04T01:42:34.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.334+0000 7f8e2974c640 1 -- 172.21.15.77:0/3648349805 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8e0406ae70 msgr2=0x7f8e0406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.334+0000 7f8e2974c640 1 --2- 172.21.15.77:0/3648349805 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8e0406ae70 0x7f8e0406d330 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8e240cc040 tx=0x7f8e0c007e30 comp rx=0 tx=0).stop 2023-11-04T01:42:34.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.334+0000 7f8e2974c640 1 -- 172.21.15.77:0/3648349805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e2406a830 msgr2=0x7f8e24148eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.334+0000 7f8e2974c640 1 --2- 172.21.15.77:0/3648349805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e2406a830 0x7f8e24148eb0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f8e14009e50 tx=0x7f8e14004a40 comp rx=0 tx=0).stop 2023-11-04T01:42:34.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.335+0000 7f8e2974c640 1 -- 172.21.15.77:0/3648349805 shutdown_connections 2023-11-04T01:42:34.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.335+0000 7f8e2974c640 1 --2- 172.21.15.77:0/3648349805 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8e0406ae70 0x7f8e0406d330 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.335+0000 7f8e2974c640 1 --2- 172.21.15.77:0/3648349805 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8e241603d0 0x7f8e24155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.335+0000 7f8e2974c640 1 --2- 172.21.15.77:0/3648349805 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8e240722a0 0x7f8e240b2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.335+0000 7f8e2974c640 1 --2- 172.21.15.77:0/3648349805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e2406a830 0x7f8e24148eb0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.335+0000 7f8e2974c640 1 -- 172.21.15.77:0/3648349805 >> 172.21.15.77:0/3648349805 conn(0x7f8e2406d800 msgr2=0x7f8e2415b280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.335+0000 7f8e2974c640 1 -- 172.21.15.77:0/3648349805 shutdown_connections 2023-11-04T01:42:34.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.336+0000 7f8e2974c640 1 -- 172.21.15.77:0/3648349805 wait complete. 2023-11-04T01:42:34.357 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool test_data_pool mksnap snap4 2023-11-04T01:42:34.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.397+0000 7f0290c41f40 1 Processor -- start 2023-11-04T01:42:34.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.397+0000 7f0290c41f40 1 -- start start 2023-11-04T01:42:34.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.397+0000 7f0290c41f40 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560de85d9c50 0x560de8624560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.397+0000 7f0290c41f40 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560de860a780 0x560de86b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.397+0000 7f0290c41f40 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560de8698d30 0x560de8697aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.397+0000 7f0290c41f40 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x560de8524650 con 0x560de8698d30 2023-11-04T01:42:34.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.397+0000 7f0290c41f40 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x560de85242f0 con 0x560de860a780 2023-11-04T01:42:34.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.397+0000 7f0290c41f40 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x560de85044f0 con 0x560de85d9c50 2023-11-04T01:42:34.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.397+0000 7f028ef46640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560de8698d30 0x560de8697aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.398+0000 7f028ef46640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560de8698d30 0x560de8697aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33108/0 (socket says 172.21.15.77:33108) 2023-11-04T01:42:34.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.398+0000 7f028ef46640 1 -- 172.21.15.77:0/2733529983 learned_addr learned my addr 172.21.15.77:0/2733529983 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:34.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.398+0000 7f028e745640 1 --2- 172.21.15.77:0/2733529983 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560de85d9c50 0x560de8624560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.398+0000 7f028df44640 1 --2- 172.21.15.77:0/2733529983 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560de860a780 0x560de86b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.398+0000 7f028ef46640 1 -- 172.21.15.77:0/2733529983 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560de85d9c50 msgr2=0x560de8624560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:34.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.398+0000 7f028ef46640 1 --2- 172.21.15.77:0/2733529983 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560de85d9c50 0x560de8624560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.398+0000 7f028ef46640 1 -- 172.21.15.77:0/2733529983 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560de860a780 msgr2=0x560de86b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:34.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.398+0000 7f028ef46640 1 --2- 172.21.15.77:0/2733529983 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560de860a780 0x560de86b15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.398+0000 7f028ef46640 1 -- 172.21.15.77:0/2733529983 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f028800a1c0 con 0x560de8698d30 2023-11-04T01:42:34.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.398+0000 7f028ef46640 1 --2- 172.21.15.77:0/2733529983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560de8698d30 0x560de8697aa0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f028800a4b0 tx=0x7f028804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e2321e7d0bd748 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.398+0000 7f028cf42640 1 -- 172.21.15.77:0/2733529983 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0288052580 con 0x560de8698d30 2023-11-04T01:42:34.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.398+0000 7f028cf42640 1 -- 172.21.15.77:0/2733529983 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02880526e0 con 0x560de8698d30 2023-11-04T01:42:34.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.398+0000 7f028cf42640 1 -- 172.21.15.77:0/2733529983 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0288052a70 con 0x560de8698d30 2023-11-04T01:42:34.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.399+0000 7f0290c41f40 1 -- 172.21.15.77:0/2733529983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560de8698d30 msgr2=0x560de8697aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.399+0000 7f0290c41f40 1 --2- 172.21.15.77:0/2733529983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560de8698d30 0x560de8697aa0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f028800a4b0 tx=0x7f028804c000 comp rx=0 tx=0).stop 2023-11-04T01:42:34.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.399+0000 7f0290c41f40 1 -- 172.21.15.77:0/2733529983 shutdown_connections 2023-11-04T01:42:34.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.399+0000 7f0290c41f40 1 --2- 172.21.15.77:0/2733529983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560de8698d30 0x560de8697aa0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.399+0000 7f0290c41f40 1 --2- 172.21.15.77:0/2733529983 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560de860a780 0x560de86b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.399+0000 7f0290c41f40 1 --2- 172.21.15.77:0/2733529983 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560de85d9c50 0x560de8624560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.399+0000 7f0290c41f40 1 -- 172.21.15.77:0/2733529983 >> 172.21.15.77:0/2733529983 conn(0x560de8606f40 msgr2=0x560de86b0430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.399+0000 7f0290c41f40 1 -- 172.21.15.77:0/2733529983 shutdown_connections 2023-11-04T01:42:34.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.399+0000 7f0290c41f40 1 -- 172.21.15.77:0/2733529983 wait complete. 2023-11-04T01:42:34.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.399+0000 7f0290c41f40 1 Processor -- start 2023-11-04T01:42:34.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.399+0000 7f0290c41f40 1 -- start start 2023-11-04T01:42:34.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.400+0000 7f0290c41f40 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560de85d9c50 0x560de8690d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.400+0000 7f0290c41f40 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560de860a780 0x560de86b1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.400+0000 7f0290c41f40 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560de8698d30 0x560de86a87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.400+0000 7f0290c41f40 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x560de8690590 con 0x560de85d9c50 2023-11-04T01:42:34.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.400+0000 7f0290c41f40 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x560de8690870 con 0x560de8698d30 2023-11-04T01:42:34.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.400+0000 7f0290c41f40 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x560de86a94d0 con 0x560de860a780 2023-11-04T01:42:34.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.400+0000 7f028e745640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560de85d9c50 0x560de8690d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.400+0000 7f028e745640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560de85d9c50 0x560de8690d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33124/0 (socket says 172.21.15.77:33124) 2023-11-04T01:42:34.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.400+0000 7f028e745640 1 -- 172.21.15.77:0/4200529967 learned_addr learned my addr 172.21.15.77:0/4200529967 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:34.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.400+0000 7f028df44640 1 --2- 172.21.15.77:0/4200529967 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560de860a780 0x560de86b1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.400+0000 7f028ef46640 1 --2- 172.21.15.77:0/4200529967 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560de8698d30 0x560de86a87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.400+0000 7f028e745640 1 -- 172.21.15.77:0/4200529967 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560de860a780 msgr2=0x560de86b1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.400+0000 7f028e745640 1 --2- 172.21.15.77:0/4200529967 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560de860a780 0x560de86b1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.400+0000 7f028e745640 1 -- 172.21.15.77:0/4200529967 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560de8698d30 msgr2=0x560de86a87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.400+0000 7f028e745640 1 --2- 172.21.15.77:0/4200529967 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560de8698d30 0x560de86a87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.400+0000 7f028e745640 1 -- 172.21.15.77:0/4200529967 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560de85235a0 con 0x560de85d9c50 2023-11-04T01:42:34.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.400+0000 7f028e745640 1 --2- 172.21.15.77:0/4200529967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560de85d9c50 0x560de8690d00 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f0280009ee0 tx=0x7f0280008400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.401+0000 7f027f7fe640 1 -- 172.21.15.77:0/4200529967 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0280005e30 con 0x560de85d9c50 2023-11-04T01:42:34.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.401+0000 7f027f7fe640 1 -- 172.21.15.77:0/4200529967 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0280010040 con 0x560de85d9c50 2023-11-04T01:42:34.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.401+0000 7f0290c41f40 1 -- 172.21.15.77:0/4200529967 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560de854a770 con 0x560de85d9c50 2023-11-04T01:42:34.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.401+0000 7f027f7fe640 1 -- 172.21.15.77:0/4200529967 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0280014830 con 0x560de85d9c50 2023-11-04T01:42:34.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.401+0000 7f0290c41f40 1 -- 172.21.15.77:0/4200529967 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560de8530780 con 0x560de85d9c50 2023-11-04T01:42:34.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.402+0000 7f027f7fe640 1 -- 172.21.15.77:0/4200529967 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0280005020 con 0x560de85d9c50 2023-11-04T01:42:34.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.402+0000 7f027f7fe640 1 --2- 172.21.15.77:0/4200529967 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0270069820 0x7f027006bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.403+0000 7f027f7fe640 1 -- 172.21.15.77:0/4200529967 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f02800880b0 con 0x560de85d9c50 2023-11-04T01:42:34.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.403+0000 7f0290c41f40 1 -- 172.21.15.77:0/4200529967 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- pool_op(create snap pool 12 tid 1 name snap4 v0) v4 -- 0x560de8594330 con 0x560de85d9c50 2023-11-04T01:42:34.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.403+0000 7f028df44640 1 --2- 172.21.15.77:0/4200529967 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0270069820 0x7f027006bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:34.403+0000 7f028df44640 1 --2- 172.21.15.77:0/4200529967 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0270069820 0x7f027006bce0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x560de86250e0 tx=0x7f0284005a00 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.336+0000 7f027f7fe640 1 -- 172.21.15.77:0/4200529967 <== mon.0 v2:172.21.15.77:3300/0 6 ==== pool_op_reply(tid 1 (0) Success v69) v1 ==== 43+0+0 (secure 0 0 0) 0x7f0280052d30 con 0x560de85d9c50 2023-11-04T01:42:35.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.336+0000 7f027f7fe640 1 -- 172.21.15.77:0/4200529967 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=69}) v3 -- 0x7f0270073f00 con 0x560de85d9c50 2023-11-04T01:42:35.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.336+0000 7f027f7fe640 1 -- 172.21.15.77:0/4200529967 <== mon.0 v2:172.21.15.77:3300/0 7 ==== osd_map(69..69 src has 1..69) v4 ==== 718+0+0 (secure 0 0 0) 0x7f02800569f0 con 0x560de85d9c50 2023-11-04T01:42:35.339 INFO:teuthology.orchestra.run.smithi077.stdout:created pool test_data_pool snap snap4 2023-11-04T01:42:35.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.337+0000 7f0290c41f40 1 -- 172.21.15.77:0/4200529967 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0270069820 msgr2=0x7f027006bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.337+0000 7f0290c41f40 1 --2- 172.21.15.77:0/4200529967 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0270069820 0x7f027006bce0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x560de86250e0 tx=0x7f0284005a00 comp rx=0 tx=0).stop 2023-11-04T01:42:35.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.337+0000 7f0290c41f40 1 -- 172.21.15.77:0/4200529967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560de85d9c50 msgr2=0x560de8690d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.337+0000 7f0290c41f40 1 --2- 172.21.15.77:0/4200529967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560de85d9c50 0x560de8690d00 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f0280009ee0 tx=0x7f0280008400 comp rx=0 tx=0).stop 2023-11-04T01:42:35.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.337+0000 7f0290c41f40 1 -- 172.21.15.77:0/4200529967 shutdown_connections 2023-11-04T01:42:35.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.337+0000 7f0290c41f40 1 --2- 172.21.15.77:0/4200529967 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0270069820 0x7f027006bce0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.337+0000 7f0290c41f40 1 --2- 172.21.15.77:0/4200529967 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560de8698d30 0x560de86a87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.337+0000 7f0290c41f40 1 --2- 172.21.15.77:0/4200529967 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560de860a780 0x560de86b1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.337+0000 7f0290c41f40 1 --2- 172.21.15.77:0/4200529967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560de85d9c50 0x560de8690d00 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.337+0000 7f0290c41f40 1 -- 172.21.15.77:0/4200529967 >> 172.21.15.77:0/4200529967 conn(0x560de8606f40 msgr2=0x560de86b1560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:35.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.337+0000 7f0290c41f40 1 -- 172.21.15.77:0/4200529967 shutdown_connections 2023-11-04T01:42:35.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.337+0000 7f0290c41f40 1 -- 172.21.15.77:0/4200529967 wait complete. 2023-11-04T01:42:35.346 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new testfs test_metadata_pool test_data_pool 2023-11-04T01:42:35.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.494+0000 7f284d597640 1 Processor -- start 2023-11-04T01:42:35.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.494+0000 7f284d597640 1 -- start start 2023-11-04T01:42:35.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.495+0000 7f284d597640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f284815ad30 0x7f28480adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.495+0000 7f284d597640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f28480ad730 0x7f2848070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.495+0000 7f284d597640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28480c3900 con 0x7f2848070c50 2023-11-04T01:42:35.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.495+0000 7f284d597640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28480ae260 con 0x7f284815ad30 2023-11-04T01:42:35.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.495+0000 7f284d597640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f284815f750 con 0x7f28480ad730 2023-11-04T01:42:35.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.495+0000 7f2846ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f284815ad30 0x7f28480adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.495+0000 7f2846ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f284815ad30 0x7f28480adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33130/0 (socket says 172.21.15.77:33130) 2023-11-04T01:42:35.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.495+0000 7f2846ffd640 1 -- 172.21.15.77:0/856039555 learned_addr learned my addr 172.21.15.77:0/856039555 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:35.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.495+0000 7f2846ffd640 1 -- 172.21.15.77:0/856039555 >> v2:172.21.15.122:3300/0 conn(0x7f28480ad730 msgr2=0x7f2848070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:35.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.495+0000 7f283e7fc640 1 --2- 172.21.15.77:0/856039555 >> v2:172.21.15.122:3300/0 conn(0x7f28480ad730 0x7f2848070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.495+0000 7f2846ffd640 1 --2- 172.21.15.77:0/856039555 >> v2:172.21.15.122:3300/0 conn(0x7f28480ad730 0x7f2848070710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.495+0000 7f2846ffd640 1 -- 172.21.15.77:0/856039555 >> v1:172.21.15.122:6789/0 conn(0x7f2848070c50 legacy=0x7f28480c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:35.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.495+0000 7f2846ffd640 1 -- 172.21.15.77:0/856039555 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28480c3be0 con 0x7f284815ad30 2023-11-04T01:42:35.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.496+0000 7f2846ffd640 1 --2- 172.21.15.77:0/856039555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f284815ad30 0x7f28480adc80 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f28480ce7f0 tx=0x7f283802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a5c419c145bc63 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.496+0000 7f28467fc640 1 -- 172.21.15.77:0/856039555 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28380317e0 con 0x7f284815ad30 2023-11-04T01:42:35.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.496+0000 7f28467fc640 1 -- 172.21.15.77:0/856039555 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2838031940 con 0x7f284815ad30 2023-11-04T01:42:35.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.496+0000 7f28467fc640 1 -- 172.21.15.77:0/856039555 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2838031cd0 con 0x7f284815ad30 2023-11-04T01:42:35.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.497+0000 7f284d597640 1 -- 172.21.15.77:0/856039555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f284815ad30 msgr2=0x7f28480adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.497+0000 7f284d597640 1 --2- 172.21.15.77:0/856039555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f284815ad30 0x7f28480adc80 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f28480ce7f0 tx=0x7f283802b880 comp rx=0 tx=0).stop 2023-11-04T01:42:35.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.497+0000 7f284d597640 1 -- 172.21.15.77:0/856039555 shutdown_connections 2023-11-04T01:42:35.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.497+0000 7f284d597640 1 --2- 172.21.15.77:0/856039555 >> v2:172.21.15.122:3300/0 conn(0x7f28480ad730 0x7f2848070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.497+0000 7f284d597640 1 --2- 172.21.15.77:0/856039555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f284815ad30 0x7f28480adc80 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.497+0000 7f284d597640 1 -- 172.21.15.77:0/856039555 >> 172.21.15.77:0/856039555 conn(0x7f28480ce950 msgr2=0x7f28480ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:35.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.497+0000 7f284d597640 1 -- 172.21.15.77:0/856039555 shutdown_connections 2023-11-04T01:42:35.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.497+0000 7f284d597640 1 -- 172.21.15.77:0/856039555 wait complete. 2023-11-04T01:42:35.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.498+0000 7f284d597640 1 Processor -- start 2023-11-04T01:42:35.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.498+0000 7f284d597640 1 -- start start 2023-11-04T01:42:35.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.499+0000 7f284d597640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2848070c50 0x7f28480cce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.499+0000 7f284d597640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28480ad730 0x7f2848152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.499+0000 7f284d597640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f284815ad30 0x7f28481583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.499+0000 7f284d597640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2848158930 con 0x7f28480ad730 2023-11-04T01:42:35.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.499+0000 7f284d597640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284815cbd0 con 0x7f284815ad30 2023-11-04T01:42:35.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.499+0000 7f284d597640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2848158b60 con 0x7f2848070c50 2023-11-04T01:42:35.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.499+0000 7f283e7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28480ad730 0x7f2848152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.499+0000 7f283e7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28480ad730 0x7f2848152860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33140/0 (socket says 172.21.15.77:33140) 2023-11-04T01:42:35.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.499+0000 7f283e7fc640 1 -- 172.21.15.77:0/3174476076 learned_addr learned my addr 172.21.15.77:0/3174476076 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:35.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.499+0000 7f28477fe640 1 --2- 172.21.15.77:0/3174476076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f284815ad30 0x7f28481583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.499+0000 7f2846ffd640 1 --2- 172.21.15.77:0/3174476076 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2848070c50 0x7f28480cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.499+0000 7f283e7fc640 1 -- 172.21.15.77:0/3174476076 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2848070c50 msgr2=0x7f28480cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.499+0000 7f283e7fc640 1 --2- 172.21.15.77:0/3174476076 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2848070c50 0x7f28480cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.499+0000 7f283e7fc640 1 -- 172.21.15.77:0/3174476076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f284815ad30 msgr2=0x7f28481583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.499+0000 7f283e7fc640 1 --2- 172.21.15.77:0/3174476076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f284815ad30 0x7f28481583f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.500+0000 7f283e7fc640 1 -- 172.21.15.77:0/3174476076 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28380094d0 con 0x7f28480ad730 2023-11-04T01:42:35.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.500+0000 7f283e7fc640 1 --2- 172.21.15.77:0/3174476076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28480ad730 0x7f2848152860 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f283000c7f0 tx=0x7f283000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.500+0000 7f283ffff640 1 -- 172.21.15.77:0/3174476076 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2830004220 con 0x7f28480ad730 2023-11-04T01:42:35.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.500+0000 7f283ffff640 1 -- 172.21.15.77:0/3174476076 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28300043a0 con 0x7f28480ad730 2023-11-04T01:42:35.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.500+0000 7f284d597640 1 -- 172.21.15.77:0/3174476076 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2848158e40 con 0x7f28480ad730 2023-11-04T01:42:35.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.500+0000 7f283ffff640 1 -- 172.21.15.77:0/3174476076 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2830007860 con 0x7f28480ad730 2023-11-04T01:42:35.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.500+0000 7f284d597640 1 -- 172.21.15.77:0/3174476076 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2848159120 con 0x7f28480ad730 2023-11-04T01:42:35.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.501+0000 7f284d597640 1 -- 172.21.15.77:0/3174476076 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2848074290 con 0x7f28480ad730 2023-11-04T01:42:35.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.501+0000 7f283ffff640 1 -- 172.21.15.77:0/3174476076 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2830007bd0 con 0x7f28480ad730 2023-11-04T01:42:35.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.502+0000 7f283ffff640 1 --2- 172.21.15.77:0/3174476076 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f282806ae70 0x7f282806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.502+0000 7f283ffff640 1 -- 172.21.15.77:0/3174476076 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 7131+0+0 (secure 0 0 0) 0x7f2830089af0 con 0x7f28480ad730 2023-11-04T01:42:35.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.502+0000 7f2846ffd640 1 --2- 172.21.15.77:0/3174476076 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f282806ae70 0x7f282806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.503+0000 7f2846ffd640 1 --2- 172.21.15.77:0/3174476076 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f282806ae70 0x7f282806d330 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2838036000 tx=0x7f283803d040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.506+0000 7f283ffff640 1 -- 172.21.15.77:0/3174476076 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2830054610 con 0x7f28480ad730 2023-11-04T01:42:35.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.710+0000 7f284d597640 1 -- 172.21.15.77:0/3174476076 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "testfs", "metadata": "test_metadata_pool", "data": "test_data_pool"} v 0) v1 -- 0x7f2848071970 con 0x7f28480ad730 2023-11-04T01:42:35.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.710+0000 7f283ffff640 1 -- 172.21.15.77:0/3174476076 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "testfs", "metadata": "test_metadata_pool", "data": "test_data_pool"}]=-95 pool(12) already has mon-managed snaps; can't attach pool to fs v29) v1 ==== 198+0+0 (secure 0 0 0) 0x7f283001e0c0 con 0x7f28480ad730 2023-11-04T01:42:35.712 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENOTSUP: pool(12) already has mon-managed snaps; can't attach pool to fs 2023-11-04T01:42:35.716 DEBUG:teuthology.orchestra.run:got remote process result: 95 2023-11-04T01:42:35.717 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool test_data_pool rmsnap snap4 2023-11-04T01:42:35.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.756+0000 7f3d93453f40 1 Processor -- start 2023-11-04T01:42:35.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.756+0000 7f3d93453f40 1 -- start start 2023-11-04T01:42:35.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.757+0000 7f3d93453f40 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3d78002260 0x56421f00a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.757+0000 7f3d93453f40 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56421f00add0 0x56421ef5ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.757+0000 7f3d93453f40 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421ef2f880 0x56421ef604d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.757+0000 7f3d93453f40 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x56421eee03b0 con 0x56421ef2f880 2023-11-04T01:42:35.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.757+0000 7f3d93453f40 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x56421ee7a650 con 0x56421f00add0 2023-11-04T01:42:35.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.757+0000 7f3d93453f40 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x56421ee7a2f0 con 0x7f3d78002260 2023-11-04T01:42:35.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.757+0000 7f3d91756640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421ef2f880 0x56421ef604d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.757+0000 7f3d91756640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421ef2f880 0x56421ef604d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33164/0 (socket says 172.21.15.77:33164) 2023-11-04T01:42:35.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.757+0000 7f3d91756640 1 -- 172.21.15.77:0/2266941697 learned_addr learned my addr 172.21.15.77:0/2266941697 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:35.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.757+0000 7f3d91756640 1 -- 172.21.15.77:0/2266941697 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3d78002260 msgr2=0x56421f00a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:35.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.757+0000 7f3d91756640 1 --2- 172.21.15.77:0/2266941697 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3d78002260 0x56421f00a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.757+0000 7f3d91756640 1 -- 172.21.15.77:0/2266941697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56421f00add0 msgr2=0x56421ef5ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:35.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.757+0000 7f3d91756640 1 --2- 172.21.15.77:0/2266941697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56421f00add0 0x56421ef5ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.757+0000 7f3d91756640 1 -- 172.21.15.77:0/2266941697 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56421ee86780 con 0x56421ef2f880 2023-11-04T01:42:35.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.757+0000 7f3d91756640 1 --2- 172.21.15.77:0/2266941697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421ef2f880 0x56421ef604d0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f3d880024f0 tx=0x7f3d88005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18803aa6b314c40f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.757+0000 7f3d8f752640 1 -- 172.21.15.77:0/2266941697 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d88013740 con 0x56421ef2f880 2023-11-04T01:42:35.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.757+0000 7f3d8f752640 1 -- 172.21.15.77:0/2266941697 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d880138c0 con 0x56421ef2f880 2023-11-04T01:42:35.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.757+0000 7f3d8f752640 1 -- 172.21.15.77:0/2266941697 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d88013c70 con 0x56421ef2f880 2023-11-04T01:42:35.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.758+0000 7f3d93453f40 1 -- 172.21.15.77:0/2266941697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421ef2f880 msgr2=0x56421ef604d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.758+0000 7f3d93453f40 1 --2- 172.21.15.77:0/2266941697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421ef2f880 0x56421ef604d0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f3d880024f0 tx=0x7f3d88005d80 comp rx=0 tx=0).stop 2023-11-04T01:42:35.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.758+0000 7f3d93453f40 1 -- 172.21.15.77:0/2266941697 shutdown_connections 2023-11-04T01:42:35.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.758+0000 7f3d93453f40 1 --2- 172.21.15.77:0/2266941697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421ef2f880 0x56421ef604d0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.758+0000 7f3d93453f40 1 --2- 172.21.15.77:0/2266941697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56421f00add0 0x56421ef5ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.758+0000 7f3d93453f40 1 --2- 172.21.15.77:0/2266941697 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3d78002260 0x56421f00a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.758+0000 7f3d93453f40 1 -- 172.21.15.77:0/2266941697 >> 172.21.15.77:0/2266941697 conn(0x56421ef5cf40 msgr2=0x56421ef5c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:35.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.758+0000 7f3d93453f40 1 -- 172.21.15.77:0/2266941697 shutdown_connections 2023-11-04T01:42:35.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.758+0000 7f3d93453f40 1 -- 172.21.15.77:0/2266941697 wait complete. 2023-11-04T01:42:35.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.758+0000 7f3d93453f40 1 Processor -- start 2023-11-04T01:42:35.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.758+0000 7f3d93453f40 1 -- start start 2023-11-04T01:42:35.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.759+0000 7f3d93453f40 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56421ef2f880 0x56421eff9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.759+0000 7f3d93453f40 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3d78002260 0x56421eff5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.759+0000 7f3d93453f40 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421effaea0 0x56421eff60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.759+0000 7f3d93453f40 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x56421ee5a4f0 con 0x56421effaea0 2023-11-04T01:42:35.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.759+0000 7f3d93453f40 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x56421f008c70 con 0x56421ef2f880 2023-11-04T01:42:35.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.759+0000 7f3d93453f40 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x56421eff6610 con 0x7f3d78002260 2023-11-04T01:42:35.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.759+0000 7f3d91756640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421effaea0 0x56421eff60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.759+0000 7f3d91756640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421effaea0 0x56421eff60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33176/0 (socket says 172.21.15.77:33176) 2023-11-04T01:42:35.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.759+0000 7f3d91756640 1 -- 172.21.15.77:0/1820700519 learned_addr learned my addr 172.21.15.77:0/1820700519 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:35.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.759+0000 7f3d90f55640 1 --2- 172.21.15.77:0/1820700519 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56421ef2f880 0x56421eff9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.759+0000 7f3d90754640 1 --2- 172.21.15.77:0/1820700519 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3d78002260 0x56421eff5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.760+0000 7f3d91756640 1 -- 172.21.15.77:0/1820700519 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3d78002260 msgr2=0x56421eff5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.760+0000 7f3d91756640 1 --2- 172.21.15.77:0/1820700519 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3d78002260 0x56421eff5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.760+0000 7f3d91756640 1 -- 172.21.15.77:0/1820700519 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56421ef2f880 msgr2=0x56421eff9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.760+0000 7f3d91756640 1 --2- 172.21.15.77:0/1820700519 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56421ef2f880 0x56421eff9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.760+0000 7f3d91756640 1 -- 172.21.15.77:0/1820700519 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d84005d20 con 0x56421effaea0 2023-11-04T01:42:35.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.760+0000 7f3d91756640 1 --2- 172.21.15.77:0/1820700519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421effaea0 0x56421eff60d0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f3d88002e40 tx=0x7f3d88003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.760+0000 7f3d8e750640 1 -- 172.21.15.77:0/1820700519 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d88011c50 con 0x56421effaea0 2023-11-04T01:42:35.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.760+0000 7f3d8e750640 1 -- 172.21.15.77:0/1820700519 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d88022070 con 0x56421effaea0 2023-11-04T01:42:35.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.760+0000 7f3d93453f40 1 -- 172.21.15.77:0/1820700519 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56421ee79930 con 0x56421effaea0 2023-11-04T01:42:35.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.760+0000 7f3d8e750640 1 -- 172.21.15.77:0/1820700519 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d88013740 con 0x56421effaea0 2023-11-04T01:42:35.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.760+0000 7f3d93453f40 1 -- 172.21.15.77:0/1820700519 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56421ee79390 con 0x56421effaea0 2023-11-04T01:42:35.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.761+0000 7f3d8e750640 1 -- 172.21.15.77:0/1820700519 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3d88024030 con 0x56421effaea0 2023-11-04T01:42:35.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.762+0000 7f3d8e750640 1 --2- 172.21.15.77:0/1820700519 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3d7c069820 0x7f3d7c06bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.762+0000 7f3d8e750640 1 -- 172.21.15.77:0/1820700519 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 7131+0+0 (secure 0 0 0) 0x7f3d88089ab0 con 0x56421effaea0 2023-11-04T01:42:35.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.762+0000 7f3d90f55640 1 --2- 172.21.15.77:0/1820700519 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3d7c069820 0x7f3d7c06bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.762+0000 7f3d93453f40 1 -- 172.21.15.77:0/1820700519 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- pool_op(delete snap pool 12 tid 1 name snap4 v0) v4 -- 0x56421eeea330 con 0x56421effaea0 2023-11-04T01:42:35.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:35.762+0000 7f3d90f55640 1 --2- 172.21.15.77:0/1820700519 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3d7c069820 0x7f3d7c06bce0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3d80054000 tx=0x7f3d8004d000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:36.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.340+0000 7f3d8e750640 1 -- 172.21.15.77:0/1820700519 <== mon.0 v2:172.21.15.77:3300/0 6 ==== pool_op_reply(tid 1 (0) Success v70) v1 ==== 43+0+0 (secure 0 0 0) 0x7f3d88054710 con 0x56421effaea0 2023-11-04T01:42:36.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.340+0000 7f3d8e750640 1 -- 172.21.15.77:0/1820700519 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7f3d7c073f60 con 0x56421effaea0 2023-11-04T01:42:36.343 INFO:teuthology.orchestra.run.smithi077.stdout:removed pool test_data_pool snap snap4 2023-11-04T01:42:36.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.341+0000 7f3d8e750640 1 -- 172.21.15.77:0/1820700519 <== mon.0 v2:172.21.15.77:3300/0 7 ==== osd_map(70..70 src has 1..70) v4 ==== 970+0+0 (secure 0 0 0) 0x7f3d8805c470 con 0x56421effaea0 2023-11-04T01:42:36.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.341+0000 7f3d93453f40 1 -- 172.21.15.77:0/1820700519 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3d7c069820 msgr2=0x7f3d7c06bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.341+0000 7f3d93453f40 1 --2- 172.21.15.77:0/1820700519 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3d7c069820 0x7f3d7c06bce0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3d80054000 tx=0x7f3d8004d000 comp rx=0 tx=0).stop 2023-11-04T01:42:36.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.341+0000 7f3d93453f40 1 -- 172.21.15.77:0/1820700519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421effaea0 msgr2=0x56421eff60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.341+0000 7f3d93453f40 1 --2- 172.21.15.77:0/1820700519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421effaea0 0x56421eff60d0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f3d88002e40 tx=0x7f3d88003330 comp rx=0 tx=0).stop 2023-11-04T01:42:36.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.341+0000 7f3d93453f40 1 -- 172.21.15.77:0/1820700519 shutdown_connections 2023-11-04T01:42:36.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.341+0000 7f3d93453f40 1 --2- 172.21.15.77:0/1820700519 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3d7c069820 0x7f3d7c06bce0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.341+0000 7f3d93453f40 1 --2- 172.21.15.77:0/1820700519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421effaea0 0x56421eff60d0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.341+0000 7f3d93453f40 1 --2- 172.21.15.77:0/1820700519 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3d78002260 0x56421eff5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.341+0000 7f3d93453f40 1 --2- 172.21.15.77:0/1820700519 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56421ef2f880 0x56421eff9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.341+0000 7f3d93453f40 1 -- 172.21.15.77:0/1820700519 >> 172.21.15.77:0/1820700519 conn(0x56421ef5cf40 msgr2=0x56421effdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:36.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.342+0000 7f3d93453f40 1 -- 172.21.15.77:0/1820700519 shutdown_connections 2023-11-04T01:42:36.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.342+0000 7f3d93453f40 1 -- 172.21.15.77:0/1820700519 wait complete. 2023-11-04T01:42:36.348 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete test_data_pool 2023-11-04T01:42:36.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.496+0000 7f6f4a1bb640 1 Processor -- start 2023-11-04T01:42:36.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.496+0000 7f6f4a1bb640 1 -- start start 2023-11-04T01:42:36.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.497+0000 7f6f4a1bb640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f44160430 0x7f6f440b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.497+0000 7f6f4a1bb640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f440b2fc0 con 0x7f6f4406c3a0 2023-11-04T01:42:36.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.497+0000 7f6f4a1bb640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f4406c810 con 0x7f6f440b2b60 2023-11-04T01:42:36.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.497+0000 7f6f4a1bb640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f440cb580 con 0x7f6f44160430 2023-11-04T01:42:36.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.497+0000 7f6f43fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6f4406c3a0 0x7f6f440cbcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:60810/0 (socket says 172.21.15.77:60810) 2023-11-04T01:42:36.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.497+0000 7f6f43fff640 1 -- 172.21.15.77:0/529186398 learned_addr learned my addr 172.21.15.77:0/529186398 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:36.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.497+0000 7f6f437fe640 1 --2- 172.21.15.77:0/529186398 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f44160430 0x7f6f440b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.497+0000 7f6f427fc640 1 -- 172.21.15.77:0/529186398 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2241016728 0 0) 0x7f6f440b2fc0 con 0x7f6f4406c3a0 2023-11-04T01:42:36.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.497+0000 7f6f427fc640 1 -- 172.21.15.77:0/529186398 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f2c003520 con 0x7f6f4406c3a0 2023-11-04T01:42:36.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.497+0000 7f6f427fc640 1 -- 172.21.15.77:0/529186398 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2305898564 0 0) 0x7f6f2c003520 con 0x7f6f4406c3a0 2023-11-04T01:42:36.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.497+0000 7f6f427fc640 1 -- 172.21.15.77:0/529186398 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f44160430 msgr2=0x7f6f440b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:36.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.497+0000 7f6f427fc640 1 --2- 172.21.15.77:0/529186398 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f44160430 0x7f6f440b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.497+0000 7f6f427fc640 1 -- 172.21.15.77:0/529186398 >> v1:172.21.15.122:6789/0 conn(0x7f6f440b2b60 legacy=0x7f6f4406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.497+0000 7f6f427fc640 1 -- 172.21.15.77:0/529186398 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4406ca40 con 0x7f6f4406c3a0 2023-11-04T01:42:36.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.497+0000 7f6f427fc640 1 -- 172.21.15.77:0/529186398 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f6f3c0019f0 con 0x7f6f4406c3a0 2023-11-04T01:42:36.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.497+0000 7f6f427fc640 1 -- 172.21.15.77:0/529186398 >> v1:172.21.15.77:6789/0 conn(0x7f6f4406c3a0 legacy=0x7f6f440cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.497+0000 7f6f427fc640 1 --2- 172.21.15.77:0/529186398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f2c0039a0 0x7f6f2c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.497+0000 7f6f427fc640 1 --2- 172.21.15.77:0/529186398 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f44160430 0x7f6f2c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.497+0000 7f6f427fc640 1 --2- 172.21.15.77:0/529186398 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f2c004d00 0x7f6f2c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.498+0000 7f6f427fc640 1 -- 172.21.15.77:0/529186398 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f440cb580 con 0x7f6f2c0039a0 2023-11-04T01:42:36.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.498+0000 7f6f427fc640 1 -- 172.21.15.77:0/529186398 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c00ba30 con 0x7f6f2c004d00 2023-11-04T01:42:36.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.498+0000 7f6f427fc640 1 -- 172.21.15.77:0/529186398 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c00bbf0 con 0x7f6f44160430 2023-11-04T01:42:36.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.498+0000 7f6f437fe640 1 --2- 172.21.15.77:0/529186398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f2c0039a0 0x7f6f2c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.498+0000 7f6f42ffd640 1 --2- 172.21.15.77:0/529186398 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f44160430 0x7f6f2c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.498+0000 7f6f43fff640 1 --2- 172.21.15.77:0/529186398 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f2c004d00 0x7f6f2c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.498+0000 7f6f437fe640 1 -- 172.21.15.77:0/529186398 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f44160430 msgr2=0x7f6f2c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:36.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.498+0000 7f6f437fe640 1 --2- 172.21.15.77:0/529186398 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f44160430 0x7f6f2c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.498+0000 7f6f437fe640 1 -- 172.21.15.77:0/529186398 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f2c004d00 msgr2=0x7f6f2c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:36.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.498+0000 7f6f437fe640 1 --2- 172.21.15.77:0/529186398 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f2c004d00 0x7f6f2c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.498+0000 7f6f437fe640 1 -- 172.21.15.77:0/529186398 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f2c003520 con 0x7f6f2c0039a0 2023-11-04T01:42:36.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.498+0000 7f6f42ffd640 1 --2- 172.21.15.77:0/529186398 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f44160430 0x7f6f2c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:36.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.499+0000 7f6f437fe640 1 --2- 172.21.15.77:0/529186398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f2c0039a0 0x7f6f2c003dc0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f6f34009a90 tx=0x7f6f2c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e00a8e74a9f6831f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:36.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.499+0000 7f6f427fc640 1 -- 172.21.15.77:0/529186398 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3402c680 con 0x7f6f2c0039a0 2023-11-04T01:42:36.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.499+0000 7f6f427fc640 1 -- 172.21.15.77:0/529186398 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f3402c7e0 con 0x7f6f2c0039a0 2023-11-04T01:42:36.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.499+0000 7f6f427fc640 1 -- 172.21.15.77:0/529186398 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3402cb70 con 0x7f6f2c0039a0 2023-11-04T01:42:36.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.499+0000 7f6f4a1bb640 1 -- 172.21.15.77:0/529186398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f2c0039a0 msgr2=0x7f6f2c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.499+0000 7f6f4a1bb640 1 --2- 172.21.15.77:0/529186398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f2c0039a0 0x7f6f2c003dc0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f6f34009a90 tx=0x7f6f2c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.499+0000 7f6f43fff640 1 -- 172.21.15.77:0/529186398 reap_dead start 2023-11-04T01:42:36.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.499+0000 7f6f4a1bb640 1 -- 172.21.15.77:0/529186398 shutdown_connections 2023-11-04T01:42:36.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.499+0000 7f6f4a1bb640 1 -- 172.21.15.77:0/529186398 >> 172.21.15.77:0/529186398 conn(0x7f6f4406ea20 msgr2=0x7f6f4406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:36.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.499+0000 7f6f4a1bb640 1 -- 172.21.15.77:0/529186398 shutdown_connections 2023-11-04T01:42:36.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.499+0000 7f6f4a1bb640 1 -- 172.21.15.77:0/529186398 wait complete. 2023-11-04T01:42:36.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.500+0000 7f6f4a1bb640 1 Processor -- start 2023-11-04T01:42:36.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.501+0000 7f6f4a1bb640 1 -- start start 2023-11-04T01:42:36.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.501+0000 7f6f4a1bb640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f2c0039a0 0x7f6f44150130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.501+0000 7f6f4a1bb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f440b5780 0x7f6f441f6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.501+0000 7f6f4a1bb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f440c90c0 0x7f6f440c9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.501+0000 7f6f4a1bb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f44150670 con 0x7f6f440c90c0 2023-11-04T01:42:36.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.501+0000 7f6f4a1bb640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f440c9a80 con 0x7f6f440b5780 2023-11-04T01:42:36.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.501+0000 7f6f4a1bb640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f441f7150 con 0x7f6f2c0039a0 2023-11-04T01:42:36.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.501+0000 7f6f43fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f440c90c0 0x7f6f440c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.501+0000 7f6f43fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f440c90c0 0x7f6f440c9540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33202/0 (socket says 172.21.15.77:33202) 2023-11-04T01:42:36.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.501+0000 7f6f43fff640 1 -- 172.21.15.77:0/538607035 learned_addr learned my addr 172.21.15.77:0/538607035 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:36.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.502+0000 7f6f42ffd640 1 --2- 172.21.15.77:0/538607035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f440b5780 0x7f6f441f6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.502+0000 7f6f437fe640 1 --2- 172.21.15.77:0/538607035 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f2c0039a0 0x7f6f44150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.502+0000 7f6f43fff640 1 -- 172.21.15.77:0/538607035 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f2c0039a0 msgr2=0x7f6f44150130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.502+0000 7f6f43fff640 1 --2- 172.21.15.77:0/538607035 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6f2c0039a0 0x7f6f44150130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.502+0000 7f6f43fff640 1 -- 172.21.15.77:0/538607035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f440b5780 msgr2=0x7f6f441f6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.502+0000 7f6f43fff640 1 --2- 172.21.15.77:0/538607035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6f440b5780 0x7f6f441f6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.502+0000 7f6f43fff640 1 -- 172.21.15.77:0/538607035 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f440b6960 con 0x7f6f440c90c0 2023-11-04T01:42:36.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.502+0000 7f6f43fff640 1 --2- 172.21.15.77:0/538607035 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f440c90c0 0x7f6f440c9540 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f6f4406f5f0 tx=0x7f6f3c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:36.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.502+0000 7f6f2bfff640 1 -- 172.21.15.77:0/538607035 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c00eb30 con 0x7f6f440c90c0 2023-11-04T01:42:36.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.502+0000 7f6f2bfff640 1 -- 172.21.15.77:0/538607035 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f3c00ec90 con 0x7f6f440c90c0 2023-11-04T01:42:36.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.502+0000 7f6f4a1bb640 1 -- 172.21.15.77:0/538607035 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f44152df0 con 0x7f6f440c90c0 2023-11-04T01:42:36.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.502+0000 7f6f2bfff640 1 -- 172.21.15.77:0/538607035 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c014430 con 0x7f6f440c90c0 2023-11-04T01:42:36.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.502+0000 7f6f4a1bb640 1 -- 172.21.15.77:0/538607035 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f441533b0 con 0x7f6f440c90c0 2023-11-04T01:42:36.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.503+0000 7f6f4a1bb640 1 -- 172.21.15.77:0/538607035 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f44074290 con 0x7f6f440c90c0 2023-11-04T01:42:36.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.503+0000 7f6f2bfff640 1 -- 172.21.15.77:0/538607035 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6f3c014590 con 0x7f6f440c90c0 2023-11-04T01:42:36.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.504+0000 7f6f2bfff640 1 --2- 172.21.15.77:0/538607035 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6f3006ae70 0x7f6f3006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.504+0000 7f6f2bfff640 1 -- 172.21.15.77:0/538607035 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f6f3c089870 con 0x7f6f440c90c0 2023-11-04T01:42:36.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.504+0000 7f6f437fe640 1 --2- 172.21.15.77:0/538607035 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6f3006ae70 0x7f6f3006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.505+0000 7f6f437fe640 1 --2- 172.21.15.77:0/538607035 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6f3006ae70 0x7f6f3006d330 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6f34036000 tx=0x7f6f34030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:36.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.508+0000 7f6f2bfff640 1 -- 172.21.15.77:0/538607035 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6f3c054380 con 0x7f6f440c90c0 2023-11-04T01:42:36.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.676+0000 7f6f4a1bb640 1 -- 172.21.15.77:0/538607035 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "test_data_pool"} v 0) v1 -- 0x7f6f44066160 con 0x7f6f440c90c0 2023-11-04T01:42:36.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.677+0000 7f6f2bfff640 1 -- 172.21.15.77:0/538607035 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "test_data_pool"}]=-1 WARNING: this will *PERMANENTLY DESTROY* all data stored in pool test_data_pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. v70) v1 ==== 296+0+0 (secure 0 0 0) 0x7f6f3c0579a0 con 0x7f6f440c90c0 2023-11-04T01:42:36.679 INFO:teuthology.orchestra.run.smithi077.stderr:Error EPERM: WARNING: this will *PERMANENTLY DESTROY* all data stored in pool test_data_pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. 2023-11-04T01:42:36.684 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:42:36.684 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete test_metadata_pool 2023-11-04T01:42:36.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.783+0000 7f4a0ebc9640 1 Processor -- start 2023-11-04T01:42:36.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.783+0000 7f4a0ebc9640 1 -- start start 2023-11-04T01:42:36.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.784+0000 7f4a0ebc9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4a08070ff0 0x7f4a080cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.784+0000 7f4a0ebc9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4a08066000 0x7f4a0806a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.784+0000 7f4a0ebc9640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a080c9bf0 con 0x7f4a0815d1b0 2023-11-04T01:42:36.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.784+0000 7f4a0ebc9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a080cd890 con 0x7f4a08070ff0 2023-11-04T01:42:36.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.784+0000 7f4a0ebc9640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a080cdb30 con 0x7f4a08066000 2023-11-04T01:42:36.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.784+0000 7f4a0c965640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4a08070ff0 0x7f4a080cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.784+0000 7f4a0c965640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4a08070ff0 0x7f4a080cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33218/0 (socket says 172.21.15.77:33218) 2023-11-04T01:42:36.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.784+0000 7f4a0c965640 1 -- 172.21.15.77:0/4039118934 learned_addr learned my addr 172.21.15.77:0/4039118934 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:36.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.785+0000 7f4a0d166640 1 --2- 172.21.15.77:0/4039118934 >> v2:172.21.15.122:3300/0 conn(0x7f4a08066000 0x7f4a0806a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.785+0000 7f4a0c965640 1 -- 172.21.15.77:0/4039118934 >> v2:172.21.15.122:3300/0 conn(0x7f4a08066000 msgr2=0x7f4a0806a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:36.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.785+0000 7f4a0c965640 1 --2- 172.21.15.77:0/4039118934 >> v2:172.21.15.122:3300/0 conn(0x7f4a08066000 0x7f4a0806a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.785+0000 7f4a0c965640 1 -- 172.21.15.77:0/4039118934 >> v1:172.21.15.122:6789/0 conn(0x7f4a0815d1b0 legacy=0x7f4a080713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:36.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.785+0000 7f4a0c965640 1 -- 172.21.15.77:0/4039118934 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a080cde10 con 0x7f4a08070ff0 2023-11-04T01:42:36.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.785+0000 7f4a0d166640 1 --2- 172.21.15.77:0/4039118934 >> v2:172.21.15.122:3300/0 conn(0x7f4a08066000 0x7f4a0806a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:36.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.785+0000 7f4a0c965640 1 --2- 172.21.15.77:0/4039118934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a08070ff0 0x7f4a080cb4e0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f4a0806e960 tx=0x7f49f802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5692220acdaad794 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:36.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.785+0000 7f4a077fe640 1 -- 172.21.15.77:0/4039118934 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f8031870 con 0x7f4a08070ff0 2023-11-04T01:42:36.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.785+0000 7f4a077fe640 1 -- 172.21.15.77:0/4039118934 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f80319d0 con 0x7f4a08070ff0 2023-11-04T01:42:36.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.786+0000 7f4a077fe640 1 -- 172.21.15.77:0/4039118934 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f8031d60 con 0x7f4a08070ff0 2023-11-04T01:42:36.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.786+0000 7f4a0ebc9640 1 -- 172.21.15.77:0/4039118934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a08070ff0 msgr2=0x7f4a080cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.786+0000 7f4a0ebc9640 1 --2- 172.21.15.77:0/4039118934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a08070ff0 0x7f4a080cb4e0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f4a0806e960 tx=0x7f49f802b910 comp rx=0 tx=0).stop 2023-11-04T01:42:36.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.786+0000 7f4a0ebc9640 1 -- 172.21.15.77:0/4039118934 shutdown_connections 2023-11-04T01:42:36.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.786+0000 7f4a0ebc9640 1 --2- 172.21.15.77:0/4039118934 >> v2:172.21.15.122:3300/0 conn(0x7f4a08066000 0x7f4a0806a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.786+0000 7f4a0ebc9640 1 --2- 172.21.15.77:0/4039118934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a08070ff0 0x7f4a080cb4e0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.786+0000 7f4a0ebc9640 1 -- 172.21.15.77:0/4039118934 >> 172.21.15.77:0/4039118934 conn(0x7f4a080cbc90 msgr2=0x7f4a080cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:36.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.786+0000 7f4a0ebc9640 1 -- 172.21.15.77:0/4039118934 shutdown_connections 2023-11-04T01:42:36.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.786+0000 7f4a0ebc9640 1 -- 172.21.15.77:0/4039118934 wait complete. 2023-11-04T01:42:36.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.787+0000 7f4a0ebc9640 1 Processor -- start 2023-11-04T01:42:36.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.787+0000 7f4a0ebc9640 1 -- start start 2023-11-04T01:42:36.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.788+0000 7f4a0ebc9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4a08066000 0x7f4a080c4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.788+0000 7f4a0ebc9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a08070ff0 0x7f4a08158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.788+0000 7f4a0ebc9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a0815d1b0 0x7f4a0815b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.788+0000 7f4a0ebc9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a080b35d0 con 0x7f4a08070ff0 2023-11-04T01:42:36.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.788+0000 7f4a0ebc9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a080c4910 con 0x7f4a0815d1b0 2023-11-04T01:42:36.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.788+0000 7f4a0ebc9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a080c4bf0 con 0x7f4a08066000 2023-11-04T01:42:36.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.788+0000 7f4a07fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a08070ff0 0x7f4a08158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.788+0000 7f4a07fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a08070ff0 0x7f4a08158610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33230/0 (socket says 172.21.15.77:33230) 2023-11-04T01:42:36.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.788+0000 7f4a07fff640 1 -- 172.21.15.77:0/4113068807 learned_addr learned my addr 172.21.15.77:0/4113068807 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:36.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.788+0000 7f4a07fff640 1 -- 172.21.15.77:0/4113068807 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4a08066000 msgr2=0x7f4a080c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.788+0000 7f4a07fff640 1 --2- 172.21.15.77:0/4113068807 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4a08066000 0x7f4a080c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.788+0000 7f4a07fff640 1 -- 172.21.15.77:0/4113068807 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a0815d1b0 msgr2=0x7f4a0815b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.788+0000 7f4a07fff640 1 --2- 172.21.15.77:0/4113068807 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a0815d1b0 0x7f4a0815b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.788+0000 7f4a07fff640 1 -- 172.21.15.77:0/4113068807 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f80094d0 con 0x7f4a08070ff0 2023-11-04T01:42:36.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.789+0000 7f4a07fff640 1 --2- 172.21.15.77:0/4113068807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a08070ff0 0x7f4a08158610 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f49fc00c400 tx=0x7f49fc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:36.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.789+0000 7f4a057fa640 1 -- 172.21.15.77:0/4113068807 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc011790 con 0x7f4a08070ff0 2023-11-04T01:42:36.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.789+0000 7f4a057fa640 1 -- 172.21.15.77:0/4113068807 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49fc011930 con 0x7f4a08070ff0 2023-11-04T01:42:36.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.789+0000 7f4a057fa640 1 -- 172.21.15.77:0/4113068807 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc011ce0 con 0x7f4a08070ff0 2023-11-04T01:42:36.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.789+0000 7f4a0ebc9640 1 -- 172.21.15.77:0/4113068807 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a080c4ed0 con 0x7f4a08070ff0 2023-11-04T01:42:36.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.789+0000 7f4a0ebc9640 1 -- 172.21.15.77:0/4113068807 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a08158b50 con 0x7f4a08070ff0 2023-11-04T01:42:36.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.790+0000 7f4a0ebc9640 1 -- 172.21.15.77:0/4113068807 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a080b3790 con 0x7f4a08070ff0 2023-11-04T01:42:36.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.790+0000 7f4a057fa640 1 -- 172.21.15.77:0/4113068807 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f49fc01c460 con 0x7f4a08070ff0 2023-11-04T01:42:36.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.791+0000 7f4a057fa640 1 --2- 172.21.15.77:0/4113068807 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f49f406ae70 0x7f49f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.791+0000 7f4a057fa640 1 -- 172.21.15.77:0/4113068807 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f49fc089a40 con 0x7f4a08070ff0 2023-11-04T01:42:36.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.791+0000 7f4a0c965640 1 --2- 172.21.15.77:0/4113068807 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f49f406ae70 0x7f49f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.792+0000 7f4a0c965640 1 --2- 172.21.15.77:0/4113068807 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f49f406ae70 0x7f49f406d330 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f49f8036000 tx=0x7f49f8030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:36.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.795+0000 7f4a057fa640 1 -- 172.21.15.77:0/4113068807 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4a080b3790 con 0x7f4a08070ff0 2023-11-04T01:42:36.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.961+0000 7f4a0ebc9640 1 -- 172.21.15.77:0/4113068807 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "test_metadata_pool"} v 0) v1 -- 0x7f4a08074290 con 0x7f4a08070ff0 2023-11-04T01:42:36.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:36.962+0000 7f4a057fa640 1 -- 172.21.15.77:0/4113068807 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "test_metadata_pool"}]=-1 WARNING: this will *PERMANENTLY DESTROY* all data stored in pool test_metadata_pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. v70) v1 ==== 304+0+0 (secure 0 0 0) 0x7f49fc08be60 con 0x7f4a08070ff0 2023-11-04T01:42:36.964 INFO:teuthology.orchestra.run.smithi077.stderr:Error EPERM: WARNING: this will *PERMANENTLY DESTROY* all data stored in pool test_metadata_pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. 2023-11-04T01:42:36.968 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:42:36.969 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:42:36.969 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:42:37.006 DEBUG:teuthology.orchestra.run.smithi122:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:42:37.048 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:42:37.049 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:42:37.049 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:42:37.065 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:37.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.202+0000 7fd84d890640 1 Processor -- start 2023-11-04T01:42:37.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.202+0000 7fd84d890640 1 -- start start 2023-11-04T01:42:37.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.203+0000 7fd84d890640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd84815e1c0 0x7fd84806a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.203+0000 7fd84d890640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd8480b14a0 0x7fd84806a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.203+0000 7fd84d890640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd84806fe80 0x7fd8480cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.203+0000 7fd84d890640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8480b1b80 con 0x7fd84806fe80 2023-11-04T01:42:37.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.203+0000 7fd84d890640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8480b1e60 con 0x7fd8480b14a0 2023-11-04T01:42:37.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.203+0000 7fd84d890640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8480b2140 con 0x7fd84815e1c0 2023-11-04T01:42:37.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.203+0000 7fd8477fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd84806fe80 0x7fd8480cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.203+0000 7fd8477fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd84806fe80 0x7fd8480cc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33240/0 (socket says 172.21.15.77:33240) 2023-11-04T01:42:37.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.203+0000 7fd8477fe640 1 -- 172.21.15.77:0/1306672506 learned_addr learned my addr 172.21.15.77:0/1306672506 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:37.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.203+0000 7fd846ffd640 1 --2- 172.21.15.77:0/1306672506 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd84815e1c0 0x7fd84806a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.203+0000 7fd8477fe640 1 -- 172.21.15.77:0/1306672506 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd84815e1c0 msgr2=0x7fd84806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:37.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.203+0000 7fd8467fc640 1 --2- 172.21.15.77:0/1306672506 >> v2:172.21.15.122:3300/0 conn(0x7fd8480b14a0 0x7fd84806a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.203+0000 7fd8477fe640 1 --2- 172.21.15.77:0/1306672506 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd84815e1c0 0x7fd84806a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.203+0000 7fd8477fe640 1 -- 172.21.15.77:0/1306672506 >> v2:172.21.15.122:3300/0 conn(0x7fd8480b14a0 msgr2=0x7fd84806a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:37.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.203+0000 7fd8477fe640 1 --2- 172.21.15.77:0/1306672506 >> v2:172.21.15.122:3300/0 conn(0x7fd8480b14a0 0x7fd84806a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.204+0000 7fd8477fe640 1 -- 172.21.15.77:0/1306672506 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8480ca990 con 0x7fd84806fe80 2023-11-04T01:42:37.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.204+0000 7fd8467fc640 1 --2- 172.21.15.77:0/1306672506 >> v2:172.21.15.122:3300/0 conn(0x7fd8480b14a0 0x7fd84806a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:37.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.204+0000 7fd8477fe640 1 --2- 172.21.15.77:0/1306672506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd84806fe80 0x7fd8480cc430 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fd8480cf910 tx=0x7fd84002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd29e93120748c09 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:37.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.204+0000 7fd845ffb640 1 -- 172.21.15.77:0/1306672506 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd840031870 con 0x7fd84806fe80 2023-11-04T01:42:37.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.204+0000 7fd845ffb640 1 -- 172.21.15.77:0/1306672506 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8400319d0 con 0x7fd84806fe80 2023-11-04T01:42:37.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.204+0000 7fd845ffb640 1 -- 172.21.15.77:0/1306672506 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd840031d60 con 0x7fd84806fe80 2023-11-04T01:42:37.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.205+0000 7fd84d890640 1 -- 172.21.15.77:0/1306672506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd84806fe80 msgr2=0x7fd8480cc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.205+0000 7fd84d890640 1 --2- 172.21.15.77:0/1306672506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd84806fe80 0x7fd8480cc430 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fd8480cf910 tx=0x7fd84002b910 comp rx=0 tx=0).stop 2023-11-04T01:42:37.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.205+0000 7fd84d890640 1 -- 172.21.15.77:0/1306672506 shutdown_connections 2023-11-04T01:42:37.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.205+0000 7fd84d890640 1 --2- 172.21.15.77:0/1306672506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd84806fe80 0x7fd8480cc430 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.205+0000 7fd84d890640 1 --2- 172.21.15.77:0/1306672506 >> v2:172.21.15.122:3300/0 conn(0x7fd8480b14a0 0x7fd84806a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.205+0000 7fd84d890640 1 --2- 172.21.15.77:0/1306672506 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd84815e1c0 0x7fd84806a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.205+0000 7fd84d890640 1 -- 172.21.15.77:0/1306672506 >> 172.21.15.77:0/1306672506 conn(0x7fd84806d8b0 msgr2=0x7fd84806dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:37.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.205+0000 7fd84d890640 1 -- 172.21.15.77:0/1306672506 shutdown_connections 2023-11-04T01:42:37.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.205+0000 7fd84d890640 1 -- 172.21.15.77:0/1306672506 wait complete. 2023-11-04T01:42:37.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.206+0000 7fd84d890640 1 Processor -- start 2023-11-04T01:42:37.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.206+0000 7fd84d890640 1 -- start start 2023-11-04T01:42:37.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.207+0000 7fd84d890640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd84806fe80 0x7fd848151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.207+0000 7fd84d890640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd8480b14a0 0x7fd8480c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.207+0000 7fd84d890640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd84815e1c0 0x7fd8480c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.207+0000 7fd84d890640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8480c3680 con 0x7fd84806fe80 2023-11-04T01:42:37.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.207+0000 7fd84d890640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8480c3960 con 0x7fd84815e1c0 2023-11-04T01:42:37.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.207+0000 7fd84d890640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8480c3c40 con 0x7fd8480b14a0 2023-11-04T01:42:37.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.207+0000 7fd846ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd84806fe80 0x7fd848151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.207+0000 7fd846ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd84806fe80 0x7fd848151d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33254/0 (socket says 172.21.15.77:33254) 2023-11-04T01:42:37.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.207+0000 7fd846ffd640 1 -- 172.21.15.77:0/2446819844 learned_addr learned my addr 172.21.15.77:0/2446819844 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:37.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.207+0000 7fd8467fc640 1 --2- 172.21.15.77:0/2446819844 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd8480b14a0 0x7fd8480c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.207+0000 7fd8477fe640 1 --2- 172.21.15.77:0/2446819844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd84815e1c0 0x7fd8480c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.207+0000 7fd846ffd640 1 -- 172.21.15.77:0/2446819844 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd8480b14a0 msgr2=0x7fd8480c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.207+0000 7fd846ffd640 1 --2- 172.21.15.77:0/2446819844 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd8480b14a0 0x7fd8480c8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.207+0000 7fd846ffd640 1 -- 172.21.15.77:0/2446819844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd84815e1c0 msgr2=0x7fd8480c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.207+0000 7fd846ffd640 1 --2- 172.21.15.77:0/2446819844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd84815e1c0 0x7fd8480c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.207+0000 7fd846ffd640 1 -- 172.21.15.77:0/2446819844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8400094d0 con 0x7fd84806fe80 2023-11-04T01:42:37.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.208+0000 7fd846ffd640 1 --2- 172.21.15.77:0/2446819844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd84806fe80 0x7fd848151d40 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fd83800ce10 tx=0x7fd83800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:37.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.208+0000 7fd82ffff640 1 -- 172.21.15.77:0/2446819844 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd838003b90 con 0x7fd84806fe80 2023-11-04T01:42:37.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.208+0000 7fd82ffff640 1 -- 172.21.15.77:0/2446819844 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd838003cf0 con 0x7fd84806fe80 2023-11-04T01:42:37.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.208+0000 7fd84d890640 1 -- 172.21.15.77:0/2446819844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8480c3f20 con 0x7fd84806fe80 2023-11-04T01:42:37.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.208+0000 7fd82ffff640 1 -- 172.21.15.77:0/2446819844 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd838003ea0 con 0x7fd84806fe80 2023-11-04T01:42:37.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.208+0000 7fd84d890640 1 -- 172.21.15.77:0/2446819844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd848152280 con 0x7fd84806fe80 2023-11-04T01:42:37.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.209+0000 7fd84d890640 1 -- 172.21.15.77:0/2446819844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8480c4440 con 0x7fd84806fe80 2023-11-04T01:42:37.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.209+0000 7fd82ffff640 1 -- 172.21.15.77:0/2446819844 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd838004240 con 0x7fd84806fe80 2023-11-04T01:42:37.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.209+0000 7fd82ffff640 1 --2- 172.21.15.77:0/2446819844 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd83406ae70 0x7fd83406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.210+0000 7fd82ffff640 1 -- 172.21.15.77:0/2446819844 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7148+0+0 (secure 0 0 0) 0x7fd838012070 con 0x7fd84806fe80 2023-11-04T01:42:37.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.210+0000 7fd8467fc640 1 --2- 172.21.15.77:0/2446819844 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd83406ae70 0x7fd83406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.210+0000 7fd8467fc640 1 --2- 172.21.15.77:0/2446819844 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd83406ae70 0x7fd83406d330 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd8480c2db0 tx=0x7fd83c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:37.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.214+0000 7fd82ffff640 1 -- 172.21.15.77:0/2446819844 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd8480c4440 con 0x7fd84806fe80 2023-11-04T01:42:37.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.382+0000 7fd84d890640 1 -- 172.21.15.77:0/2446819844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8480c4440 con 0x7fd84806fe80 2023-11-04T01:42:37.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.384+0000 7fd82ffff640 1 -- 172.21.15.77:0/2446819844 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+22089 (secure 0 0 0) 0x7fd8480c4440 con 0x7fd84806fe80 2023-11-04T01:42:37.386 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:37.387 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":70,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:42:36.334157+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:22.500204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:22.966681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:33.159064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:33.647358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":12,"snaps":[{"begin":1,"length":1}]}],"new_removed_snaps":[{"pool":12,"snaps":[{"begin":1,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:37.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.386+0000 7fd84d890640 1 -- 172.21.15.77:0/2446819844 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd83406ae70 msgr2=0x7fd83406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.386+0000 7fd84d890640 1 --2- 172.21.15.77:0/2446819844 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd83406ae70 0x7fd83406d330 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd8480c2db0 tx=0x7fd83c008040 comp rx=0 tx=0).stop 2023-11-04T01:42:37.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.386+0000 7fd84d890640 1 -- 172.21.15.77:0/2446819844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd84806fe80 msgr2=0x7fd848151d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.386+0000 7fd84d890640 1 --2- 172.21.15.77:0/2446819844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd84806fe80 0x7fd848151d40 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fd83800ce10 tx=0x7fd83800a660 comp rx=0 tx=0).stop 2023-11-04T01:42:37.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.386+0000 7fd84d890640 1 -- 172.21.15.77:0/2446819844 shutdown_connections 2023-11-04T01:42:37.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.386+0000 7fd84d890640 1 --2- 172.21.15.77:0/2446819844 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd83406ae70 0x7fd83406d330 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.386+0000 7fd84d890640 1 --2- 172.21.15.77:0/2446819844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd84815e1c0 0x7fd8480c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.386+0000 7fd84d890640 1 --2- 172.21.15.77:0/2446819844 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd8480b14a0 0x7fd8480c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.386+0000 7fd84d890640 1 --2- 172.21.15.77:0/2446819844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd84806fe80 0x7fd848151d40 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.386+0000 7fd84d890640 1 -- 172.21.15.77:0/2446819844 >> 172.21.15.77:0/2446819844 conn(0x7fd84806d8b0 msgr2=0x7fd84815c330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:37.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.386+0000 7fd84d890640 1 -- 172.21.15.77:0/2446819844 shutdown_connections 2023-11-04T01:42:37.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.386+0000 7fd84d890640 1 -- 172.21.15.77:0/2446819844 wait complete. 2023-11-04T01:42:37.400 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:33.142176+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:42:22.500204+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:42:22.966681+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:42:33.159064+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:42:33.647358+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:42:37.401 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:42:37.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.501+0000 7fa9bb810640 1 Processor -- start 2023-11-04T01:42:37.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.501+0000 7fa9bb810640 1 -- start start 2023-11-04T01:42:37.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.502+0000 7fa9bb810640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa9b415ad30 0x7fa9b40adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.502+0000 7fa9bb810640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9b40c3900 con 0x7fa9b4070e20 2023-11-04T01:42:37.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.502+0000 7fa9bb810640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9b40c3be0 con 0x7fa9b40ad730 2023-11-04T01:42:37.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.502+0000 7fa9bb810640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b40ae260 con 0x7fa9b415ad30 2023-11-04T01:42:37.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.502+0000 7fa9b9dad640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fa9b4070e20 0x7fa9b415e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:38810/0 (socket says 172.21.15.77:38810) 2023-11-04T01:42:37.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.502+0000 7fa9b9dad640 1 -- 172.21.15.77:0/3495946114 learned_addr learned my addr 172.21.15.77:0/3495946114 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:37.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.503+0000 7fa9b95ac640 1 --2- 172.21.15.77:0/3495946114 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa9b415ad30 0x7fa9b40adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.503+0000 7fa9abfff640 1 -- 172.21.15.77:0/3495946114 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2831891681 0 0) 0x7fa9b40c3900 con 0x7fa9b4070e20 2023-11-04T01:42:37.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.503+0000 7fa9abfff640 1 -- 172.21.15.77:0/3495946114 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9a0003520 con 0x7fa9b4070e20 2023-11-04T01:42:37.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.503+0000 7fa9abfff640 1 -- 172.21.15.77:0/3495946114 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 782751865 0 0) 0x7fa9a0003520 con 0x7fa9b4070e20 2023-11-04T01:42:37.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.503+0000 7fa9abfff640 1 -- 172.21.15.77:0/3495946114 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa9b415ad30 msgr2=0x7fa9b40adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:37.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.503+0000 7fa9abfff640 1 --2- 172.21.15.77:0/3495946114 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa9b415ad30 0x7fa9b40adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.503+0000 7fa9abfff640 1 -- 172.21.15.77:0/3495946114 >> v1:172.21.15.122:6789/0 conn(0x7fa9b40ad730 legacy=0x7fa9b4070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.503+0000 7fa9abfff640 1 -- 172.21.15.77:0/3495946114 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b40c3ec0 con 0x7fa9b4070e20 2023-11-04T01:42:37.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.503+0000 7fa9abfff640 1 -- 172.21.15.77:0/3495946114 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7fa9ac001670 con 0x7fa9b4070e20 2023-11-04T01:42:37.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.503+0000 7fa9abfff640 1 -- 172.21.15.77:0/3495946114 >> v1:172.21.15.77:6789/0 conn(0x7fa9b4070e20 legacy=0x7fa9b415e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.503+0000 7fa9abfff640 1 --2- 172.21.15.77:0/3495946114 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa9b415ad30 0x7fa9a00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.503+0000 7fa9abfff640 1 --2- 172.21.15.77:0/3495946114 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9a0003f20 0x7fa9a00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.503+0000 7fa9abfff640 1 --2- 172.21.15.77:0/3495946114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9a0004d00 0x7fa9a0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.503+0000 7fa9abfff640 1 -- 172.21.15.77:0/3495946114 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b40ae260 con 0x7fa9a0003f20 2023-11-04T01:42:37.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.503+0000 7fa9abfff640 1 -- 172.21.15.77:0/3495946114 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a000bb10 con 0x7fa9a0004d00 2023-11-04T01:42:37.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.503+0000 7fa9abfff640 1 -- 172.21.15.77:0/3495946114 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a000bcd0 con 0x7fa9b415ad30 2023-11-04T01:42:37.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.503+0000 7fa9b8dab640 1 --2- 172.21.15.77:0/3495946114 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9a0003f20 0x7fa9a00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.503+0000 7fa9b95ac640 1 --2- 172.21.15.77:0/3495946114 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa9b415ad30 0x7fa9a00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.503+0000 7fa9b9dad640 1 --2- 172.21.15.77:0/3495946114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9a0004d00 0x7fa9a0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.503+0000 7fa9b8dab640 1 -- 172.21.15.77:0/3495946114 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa9b415ad30 msgr2=0x7fa9a00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:37.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.503+0000 7fa9b8dab640 1 --2- 172.21.15.77:0/3495946114 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa9b415ad30 0x7fa9a00039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.503+0000 7fa9b8dab640 1 -- 172.21.15.77:0/3495946114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9a0004d00 msgr2=0x7fa9a0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:37.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.503+0000 7fa9b8dab640 1 --2- 172.21.15.77:0/3495946114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9a0004d00 0x7fa9a0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.503+0000 7fa9b8dab640 1 -- 172.21.15.77:0/3495946114 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a0003520 con 0x7fa9a0003f20 2023-11-04T01:42:37.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.503+0000 7fa9b9dad640 1 --2- 172.21.15.77:0/3495946114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9a0004d00 0x7fa9a0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:37.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.504+0000 7fa9b8dab640 1 --2- 172.21.15.77:0/3495946114 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9a0003f20 0x7fa9a00047c0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fa9a4001750 tx=0x7fa9a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c167fd381ea7bb0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:37.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.504+0000 7fa9abfff640 1 -- 172.21.15.77:0/3495946114 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a40052d0 con 0x7fa9a0003f20 2023-11-04T01:42:37.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.504+0000 7fa9abfff640 1 -- 172.21.15.77:0/3495946114 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a402e050 con 0x7fa9a0003f20 2023-11-04T01:42:37.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.504+0000 7fa9abfff640 1 -- 172.21.15.77:0/3495946114 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a40035f0 con 0x7fa9a0003f20 2023-11-04T01:42:37.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.505+0000 7fa9bb810640 1 -- 172.21.15.77:0/3495946114 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9a0003f20 msgr2=0x7fa9a00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.505+0000 7fa9bb810640 1 --2- 172.21.15.77:0/3495946114 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9a0003f20 0x7fa9a00047c0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fa9a4001750 tx=0x7fa9a00057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.505+0000 7fa9b9dad640 1 -- 172.21.15.77:0/3495946114 reap_dead start 2023-11-04T01:42:37.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.505+0000 7fa9bb810640 1 -- 172.21.15.77:0/3495946114 shutdown_connections 2023-11-04T01:42:37.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.505+0000 7fa9bb810640 1 -- 172.21.15.77:0/3495946114 >> 172.21.15.77:0/3495946114 conn(0x7fa9b40ce950 msgr2=0x7fa9b40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:37.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.505+0000 7fa9bb810640 1 -- 172.21.15.77:0/3495946114 shutdown_connections 2023-11-04T01:42:37.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.505+0000 7fa9bb810640 1 -- 172.21.15.77:0/3495946114 wait complete. 2023-11-04T01:42:37.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.506+0000 7fa9bb810640 1 Processor -- start 2023-11-04T01:42:37.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.506+0000 7fa9bb810640 1 -- start start 2023-11-04T01:42:37.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.507+0000 7fa9bb810640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa9a0003f20 0x7fa9b414b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.507+0000 7fa9bb810640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9b40c8460 0x7fa9b414e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.507+0000 7fa9bb810640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9b40c6b60 0x7fa9b41f17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.507+0000 7fa9bb810640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b40c66d0 con 0x7fa9b40c8460 2023-11-04T01:42:37.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.507+0000 7fa9bb810640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b40c5ac0 con 0x7fa9b40c6b60 2023-11-04T01:42:37.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.507+0000 7fa9bb810640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b40c5da0 con 0x7fa9a0003f20 2023-11-04T01:42:37.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.507+0000 7fa9b8dab640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9b40c8460 0x7fa9b414e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.507+0000 7fa9b8dab640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9b40c8460 0x7fa9b414e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59010/0 (socket says 172.21.15.77:59010) 2023-11-04T01:42:37.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.507+0000 7fa9b8dab640 1 -- 172.21.15.77:0/1098146963 learned_addr learned my addr 172.21.15.77:0/1098146963 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:37.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.507+0000 7fa9b95ac640 1 --2- 172.21.15.77:0/1098146963 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa9a0003f20 0x7fa9b414b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.507+0000 7fa9b8dab640 1 -- 172.21.15.77:0/1098146963 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa9a0003f20 msgr2=0x7fa9b414b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.507+0000 7fa9b8dab640 1 --2- 172.21.15.77:0/1098146963 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa9a0003f20 0x7fa9b414b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.507+0000 7fa9b9dad640 1 --2- 172.21.15.77:0/1098146963 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9b40c6b60 0x7fa9b41f17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.507+0000 7fa9b8dab640 1 -- 172.21.15.77:0/1098146963 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9b40c6b60 msgr2=0x7fa9b41f17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.507+0000 7fa9b8dab640 1 --2- 172.21.15.77:0/1098146963 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9b40c6b60 0x7fa9b41f17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.507+0000 7fa9b8dab640 1 -- 172.21.15.77:0/1098146963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b40c6080 con 0x7fa9b40c8460 2023-11-04T01:42:37.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.507+0000 7fa9b95ac640 1 --2- 172.21.15.77:0/1098146963 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa9a0003f20 0x7fa9b414b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:37.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.507+0000 7fa9b8dab640 1 --2- 172.21.15.77:0/1098146963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9b40c8460 0x7fa9b414e580 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fa9a402bc30 tx=0x7fa9a4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:37.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.507+0000 7fa9a9ffb640 1 -- 172.21.15.77:0/1098146963 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a40076c0 con 0x7fa9b40c8460 2023-11-04T01:42:37.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.507+0000 7fa9a9ffb640 1 -- 172.21.15.77:0/1098146963 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a4007a30 con 0x7fa9b40c8460 2023-11-04T01:42:37.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.507+0000 7fa9bb810640 1 -- 172.21.15.77:0/1098146963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9b40c6360 con 0x7fa9b40c8460 2023-11-04T01:42:37.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.507+0000 7fa9a9ffb640 1 -- 172.21.15.77:0/1098146963 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a4006be0 con 0x7fa9b40c8460 2023-11-04T01:42:37.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.508+0000 7fa9bb810640 1 -- 172.21.15.77:0/1098146963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9b414eca0 con 0x7fa9b40c8460 2023-11-04T01:42:37.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.509+0000 7fa9bb810640 1 -- 172.21.15.77:0/1098146963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9b40c6880 con 0x7fa9b40c8460 2023-11-04T01:42:37.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.509+0000 7fa9a9ffb640 1 -- 172.21.15.77:0/1098146963 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa9a4006d40 con 0x7fa9b40c8460 2023-11-04T01:42:37.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.509+0000 7fa9a9ffb640 1 --2- 172.21.15.77:0/1098146963 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa99806aea0 0x7fa99806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.509+0000 7fa9a9ffb640 1 -- 172.21.15.77:0/1098146963 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7148+0+0 (secure 0 0 0) 0x7fa9a40ab800 con 0x7fa9b40c8460 2023-11-04T01:42:37.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.510+0000 7fa9b95ac640 1 --2- 172.21.15.77:0/1098146963 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa99806aea0 0x7fa99806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.510+0000 7fa9b95ac640 1 --2- 172.21.15.77:0/1098146963 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa99806aea0 0x7fa99806d360 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0007440 tx=0x7fa9b000b040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:37.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.514+0000 7fa9a9ffb640 1 -- 172.21.15.77:0/1098146963 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa9b40c6880 con 0x7fa9b40c8460 2023-11-04T01:42:37.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.681+0000 7fa9bb810640 1 -- 172.21.15.77:0/1098146963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa9b4074290 con 0x7fa9b40c8460 2023-11-04T01:42:37.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.682+0000 7fa9a9ffb640 1 -- 172.21.15.77:0/1098146963 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa9a407ee60 con 0x7fa9b40c8460 2023-11-04T01:42:37.684 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:42:37.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.683+0000 7fa9bb810640 1 -- 172.21.15.77:0/1098146963 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa99806aea0 msgr2=0x7fa99806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.683+0000 7fa9bb810640 1 --2- 172.21.15.77:0/1098146963 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa99806aea0 0x7fa99806d360 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0007440 tx=0x7fa9b000b040 comp rx=0 tx=0).stop 2023-11-04T01:42:37.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.683+0000 7fa9bb810640 1 -- 172.21.15.77:0/1098146963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9b40c8460 msgr2=0x7fa9b414e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.683+0000 7fa9bb810640 1 --2- 172.21.15.77:0/1098146963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9b40c8460 0x7fa9b414e580 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fa9a402bc30 tx=0x7fa9a4001120 comp rx=0 tx=0).stop 2023-11-04T01:42:37.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.683+0000 7fa9bb810640 1 -- 172.21.15.77:0/1098146963 shutdown_connections 2023-11-04T01:42:37.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.683+0000 7fa9bb810640 1 --2- 172.21.15.77:0/1098146963 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa99806aea0 0x7fa99806d360 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.683+0000 7fa9bb810640 1 --2- 172.21.15.77:0/1098146963 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9b40c6b60 0x7fa9b41f17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.683+0000 7fa9bb810640 1 --2- 172.21.15.77:0/1098146963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9b40c8460 0x7fa9b414e580 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.683+0000 7fa9bb810640 1 --2- 172.21.15.77:0/1098146963 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa9a0003f20 0x7fa9b414b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.683+0000 7fa9bb810640 1 -- 172.21.15.77:0/1098146963 >> 172.21.15.77:0/1098146963 conn(0x7fa9b40ce950 msgr2=0x7fa9b415bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:37.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.683+0000 7fa9bb810640 1 -- 172.21.15.77:0/1098146963 shutdown_connections 2023-11-04T01:42:37.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.684+0000 7fa9bb810640 1 -- 172.21.15.77:0/1098146963 wait complete. 2023-11-04T01:42:37.696 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:42:37.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.797+0000 7ffb76789640 1 Processor -- start 2023-11-04T01:42:37.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.797+0000 7ffb76789640 1 -- start start 2023-11-04T01:42:37.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.797+0000 7ffb76789640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ffb70153e60 0x7ffb7015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.797+0000 7ffb76789640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ffb700b4880 0x7ffb700b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.797+0000 7ffb76789640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb700cde60 con 0x7ffb700cd6d0 2023-11-04T01:42:37.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.797+0000 7ffb76789640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb70160f90 con 0x7ffb70153e60 2023-11-04T01:42:37.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.797+0000 7ffb76789640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb700b5200 con 0x7ffb700b4880 2023-11-04T01:42:37.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.798+0000 7ffb6ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ffb70153e60 0x7ffb7015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.798+0000 7ffb6f7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ffb700cd6d0 0x7ffb70161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:38814/0 (socket says 172.21.15.77:38814) 2023-11-04T01:42:37.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.798+0000 7ffb6f7fe640 1 -- 172.21.15.77:0/3756772901 learned_addr learned my addr 172.21.15.77:0/3756772901 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:37.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.798+0000 7ffb6ffff640 1 -- 172.21.15.77:0/3756772901 >> v2:172.21.15.122:3300/0 conn(0x7ffb700b4880 msgr2=0x7ffb700b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:37.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.798+0000 7ffb6ffff640 1 --2- 172.21.15.77:0/3756772901 >> v2:172.21.15.122:3300/0 conn(0x7ffb700b4880 0x7ffb700b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.798+0000 7ffb6ffff640 1 -- 172.21.15.77:0/3756772901 >> v1:172.21.15.77:6789/0 conn(0x7ffb700cd6d0 legacy=0x7ffb70161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.798+0000 7ffb6ffff640 1 -- 172.21.15.77:0/3756772901 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7015e400 con 0x7ffb70153e60 2023-11-04T01:42:37.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.798+0000 7ffb6effd640 1 -- 172.21.15.77:0/3756772901 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3693634196 0 0) 0x7ffb700cde60 con 0x7ffb700cd6d0 2023-11-04T01:42:37.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.799+0000 7ffb6ffff640 1 --2- 172.21.15.77:0/3756772901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb70153e60 0x7ffb7015dec0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7ffb700b8f40 tx=0x7ffb6002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed4ac18dd8e5158 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:37.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.799+0000 7ffb6effd640 1 -- 172.21.15.77:0/3756772901 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb60031830 con 0x7ffb70153e60 2023-11-04T01:42:37.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.799+0000 7ffb6effd640 1 -- 172.21.15.77:0/3756772901 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb60031990 con 0x7ffb70153e60 2023-11-04T01:42:37.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.799+0000 7ffb6effd640 1 -- 172.21.15.77:0/3756772901 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb60031d20 con 0x7ffb70153e60 2023-11-04T01:42:37.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.799+0000 7ffb76789640 1 -- 172.21.15.77:0/3756772901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb70153e60 msgr2=0x7ffb7015dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.799+0000 7ffb76789640 1 --2- 172.21.15.77:0/3756772901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb70153e60 0x7ffb7015dec0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7ffb700b8f40 tx=0x7ffb6002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.799+0000 7ffb76789640 1 -- 172.21.15.77:0/3756772901 shutdown_connections 2023-11-04T01:42:37.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.799+0000 7ffb76789640 1 --2- 172.21.15.77:0/3756772901 >> v2:172.21.15.122:3300/0 conn(0x7ffb700b4880 0x7ffb700b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.799+0000 7ffb76789640 1 --2- 172.21.15.77:0/3756772901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb70153e60 0x7ffb7015dec0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.799+0000 7ffb76789640 1 -- 172.21.15.77:0/3756772901 >> 172.21.15.77:0/3756772901 conn(0x7ffb700cf880 msgr2=0x7ffb700cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:37.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.799+0000 7ffb76789640 1 -- 172.21.15.77:0/3756772901 shutdown_connections 2023-11-04T01:42:37.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.799+0000 7ffb76789640 1 -- 172.21.15.77:0/3756772901 wait complete. 2023-11-04T01:42:37.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.800+0000 7ffb76789640 1 Processor -- start 2023-11-04T01:42:37.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.801+0000 7ffb76789640 1 -- start start 2023-11-04T01:42:37.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.801+0000 7ffb76789640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffb700b4880 0x7ffb701f5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.801+0000 7ffb76789640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb700cd6d0 0x7ffb70156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.801+0000 7ffb76789640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb70153e60 0x7ffb70150250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.801+0000 7ffb76789640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb701f6e90 con 0x7ffb70153e60 2023-11-04T01:42:37.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.801+0000 7ffb76789640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb700cc6b0 con 0x7ffb700cd6d0 2023-11-04T01:42:37.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.801+0000 7ffb76789640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb701f65f0 con 0x7ffb700b4880 2023-11-04T01:42:37.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.802+0000 7ffb74d26640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb70153e60 0x7ffb70150250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.802+0000 7ffb74d26640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb70153e60 0x7ffb70150250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59020/0 (socket says 172.21.15.77:59020) 2023-11-04T01:42:37.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.802+0000 7ffb74d26640 1 -- 172.21.15.77:0/2114063245 learned_addr learned my addr 172.21.15.77:0/2114063245 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:37.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.802+0000 7ffb6ffff640 1 --2- 172.21.15.77:0/2114063245 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffb700b4880 0x7ffb701f5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.802+0000 7ffb6f7fe640 1 --2- 172.21.15.77:0/2114063245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb700cd6d0 0x7ffb70156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.802+0000 7ffb74d26640 1 -- 172.21.15.77:0/2114063245 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffb700b4880 msgr2=0x7ffb701f5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.802+0000 7ffb74d26640 1 --2- 172.21.15.77:0/2114063245 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffb700b4880 0x7ffb701f5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.802+0000 7ffb74d26640 1 -- 172.21.15.77:0/2114063245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb700cd6d0 msgr2=0x7ffb70156850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.802+0000 7ffb74d26640 1 --2- 172.21.15.77:0/2114063245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb700cd6d0 0x7ffb70156850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.802+0000 7ffb74d26640 1 -- 172.21.15.77:0/2114063245 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb60009400 con 0x7ffb70153e60 2023-11-04T01:42:37.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.802+0000 7ffb6ffff640 1 --2- 172.21.15.77:0/2114063245 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffb700b4880 0x7ffb701f5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:37.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.802+0000 7ffb74d26640 1 --2- 172.21.15.77:0/2114063245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb70153e60 0x7ffb70150250 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7ffb6800b970 tx=0x7ffb6800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:37.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.802+0000 7ffb6cff9640 1 -- 172.21.15.77:0/2114063245 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6800cb40 con 0x7ffb70153e60 2023-11-04T01:42:37.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.802+0000 7ffb6cff9640 1 -- 172.21.15.77:0/2114063245 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6800ccc0 con 0x7ffb70153e60 2023-11-04T01:42:37.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.802+0000 7ffb76789640 1 -- 172.21.15.77:0/2114063245 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb701f68d0 con 0x7ffb70153e60 2023-11-04T01:42:37.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.802+0000 7ffb6cff9640 1 -- 172.21.15.77:0/2114063245 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb68014680 con 0x7ffb70153e60 2023-11-04T01:42:37.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.802+0000 7ffb76789640 1 -- 172.21.15.77:0/2114063245 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb701f2b30 con 0x7ffb70153e60 2023-11-04T01:42:37.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.803+0000 7ffb76789640 1 -- 172.21.15.77:0/2114063245 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb701f2d50 con 0x7ffb70153e60 2023-11-04T01:42:37.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.804+0000 7ffb6cff9640 1 -- 172.21.15.77:0/2114063245 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffb6801d3b0 con 0x7ffb70153e60 2023-11-04T01:42:37.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.804+0000 7ffb6cff9640 1 --2- 172.21.15.77:0/2114063245 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ffb5c06ae70 0x7ffb5c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.804+0000 7ffb6cff9640 1 -- 172.21.15.77:0/2114063245 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7148+0+0 (secure 0 0 0) 0x7ffb68089b60 con 0x7ffb70153e60 2023-11-04T01:42:37.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.804+0000 7ffb6ffff640 1 --2- 172.21.15.77:0/2114063245 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ffb5c06ae70 0x7ffb5c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.805+0000 7ffb6ffff640 1 --2- 172.21.15.77:0/2114063245 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ffb5c06ae70 0x7ffb5c06d330 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ffb60036000 tx=0x7ffb6003c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:37.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.808+0000 7ffb6cff9640 1 -- 172.21.15.77:0/2114063245 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffb68054670 con 0x7ffb70153e60 2023-11-04T01:42:37.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.973+0000 7ffb76789640 1 -- 172.21.15.77:0/2114063245 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7ffb70074290 con 0x7ffb70153e60 2023-11-04T01:42:37.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.973+0000 7ffb6cff9640 1 -- 172.21.15.77:0/2114063245 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v70) v1 ==== 103+0+11 (secure 0 0 0) 0x7ffb680190a0 con 0x7ffb70153e60 2023-11-04T01:42:37.975 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:42:37.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.975+0000 7ffb76789640 1 -- 172.21.15.77:0/2114063245 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ffb5c06ae70 msgr2=0x7ffb5c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.975+0000 7ffb76789640 1 --2- 172.21.15.77:0/2114063245 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ffb5c06ae70 0x7ffb5c06d330 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ffb60036000 tx=0x7ffb6003c040 comp rx=0 tx=0).stop 2023-11-04T01:42:37.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.975+0000 7ffb76789640 1 -- 172.21.15.77:0/2114063245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb70153e60 msgr2=0x7ffb70150250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.975+0000 7ffb76789640 1 --2- 172.21.15.77:0/2114063245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb70153e60 0x7ffb70150250 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7ffb6800b970 tx=0x7ffb6800be30 comp rx=0 tx=0).stop 2023-11-04T01:42:37.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.975+0000 7ffb76789640 1 -- 172.21.15.77:0/2114063245 shutdown_connections 2023-11-04T01:42:37.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.975+0000 7ffb76789640 1 --2- 172.21.15.77:0/2114063245 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ffb5c06ae70 0x7ffb5c06d330 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.975+0000 7ffb76789640 1 --2- 172.21.15.77:0/2114063245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb70153e60 0x7ffb70150250 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.975+0000 7ffb76789640 1 --2- 172.21.15.77:0/2114063245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb700cd6d0 0x7ffb70156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.975+0000 7ffb76789640 1 --2- 172.21.15.77:0/2114063245 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffb700b4880 0x7ffb701f5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.975+0000 7ffb76789640 1 -- 172.21.15.77:0/2114063245 >> 172.21.15.77:0/2114063245 conn(0x7ffb700cf880 msgr2=0x7ffb7015f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:37.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.975+0000 7ffb76789640 1 -- 172.21.15.77:0/2114063245 shutdown_connections 2023-11-04T01:42:37.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:37.975+0000 7ffb76789640 1 -- 172.21.15.77:0/2114063245 wait complete. 2023-11-04T01:42:37.987 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:42:38.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.088+0000 7f7dd854c640 1 Processor -- start 2023-11-04T01:42:38.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.088+0000 7f7dd854c640 1 -- start start 2023-11-04T01:42:38.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.089+0000 7f7dd854c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7dd0153e60 0x7f7dd015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.089+0000 7f7dd854c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7dd00b4880 0x7f7dd00b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.089+0000 7f7dd854c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd00cde60 con 0x7f7dd00cd6d0 2023-11-04T01:42:38.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.089+0000 7f7dd854c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd0160f90 con 0x7f7dd0153e60 2023-11-04T01:42:38.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.089+0000 7f7dd854c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd00b5200 con 0x7f7dd00b4880 2023-11-04T01:42:38.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.090+0000 7f7dd62e8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7dd0153e60 0x7f7dd015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.090+0000 7f7dd5ae7640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f7dd00cd6d0 0x7f7dd0161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:38818/0 (socket says 172.21.15.77:38818) 2023-11-04T01:42:38.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.090+0000 7f7dd5ae7640 1 -- 172.21.15.77:0/4252276863 learned_addr learned my addr 172.21.15.77:0/4252276863 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:38.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.090+0000 7f7dd6ae9640 1 --2- 172.21.15.77:0/4252276863 >> v2:172.21.15.122:3300/0 conn(0x7f7dd00b4880 0x7f7dd00b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.090+0000 7f7dd62e8640 1 -- 172.21.15.77:0/4252276863 >> v2:172.21.15.122:3300/0 conn(0x7f7dd00b4880 msgr2=0x7f7dd00b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:38.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.090+0000 7f7dd62e8640 1 --2- 172.21.15.77:0/4252276863 >> v2:172.21.15.122:3300/0 conn(0x7f7dd00b4880 0x7f7dd00b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.090+0000 7f7dd62e8640 1 -- 172.21.15.77:0/4252276863 >> v1:172.21.15.77:6789/0 conn(0x7f7dd00cd6d0 legacy=0x7f7dd0161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.090+0000 7f7dd52e6640 1 -- 172.21.15.77:0/4252276863 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2209104640 0 0) 0x7f7dd00cde60 con 0x7f7dd00cd6d0 2023-11-04T01:42:38.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.090+0000 7f7dd62e8640 1 -- 172.21.15.77:0/4252276863 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd015e400 con 0x7f7dd0153e60 2023-11-04T01:42:38.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.091+0000 7f7dd62e8640 1 --2- 172.21.15.77:0/4252276863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dd0153e60 0x7f7dd015dec0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f7dd00b8f40 tx=0x7f7dc402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b514499db99f65f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:38.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.091+0000 7f7dd52e6640 1 -- 172.21.15.77:0/4252276863 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc4031830 con 0x7f7dd0153e60 2023-11-04T01:42:38.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.091+0000 7f7dd52e6640 1 -- 172.21.15.77:0/4252276863 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc4031990 con 0x7f7dd0153e60 2023-11-04T01:42:38.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.091+0000 7f7dd52e6640 1 -- 172.21.15.77:0/4252276863 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc4031d20 con 0x7f7dd0153e60 2023-11-04T01:42:38.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.091+0000 7f7dd854c640 1 -- 172.21.15.77:0/4252276863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dd0153e60 msgr2=0x7f7dd015dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.091+0000 7f7dd854c640 1 --2- 172.21.15.77:0/4252276863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dd0153e60 0x7f7dd015dec0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f7dd00b8f40 tx=0x7f7dc402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.091+0000 7f7dd854c640 1 -- 172.21.15.77:0/4252276863 shutdown_connections 2023-11-04T01:42:38.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.091+0000 7f7dd854c640 1 --2- 172.21.15.77:0/4252276863 >> v2:172.21.15.122:3300/0 conn(0x7f7dd00b4880 0x7f7dd00b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.091+0000 7f7dd854c640 1 --2- 172.21.15.77:0/4252276863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dd0153e60 0x7f7dd015dec0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.091+0000 7f7dd854c640 1 -- 172.21.15.77:0/4252276863 >> 172.21.15.77:0/4252276863 conn(0x7f7dd00cf880 msgr2=0x7f7dd00cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:38.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.091+0000 7f7dd854c640 1 -- 172.21.15.77:0/4252276863 shutdown_connections 2023-11-04T01:42:38.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.091+0000 7f7dd854c640 1 -- 172.21.15.77:0/4252276863 wait complete. 2023-11-04T01:42:38.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.092+0000 7f7dd854c640 1 Processor -- start 2023-11-04T01:42:38.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.093+0000 7f7dd854c640 1 -- start start 2023-11-04T01:42:38.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.093+0000 7f7dd854c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7dd00b4880 0x7f7dd00c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.093+0000 7f7dd854c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dd00cd6d0 0x7f7dd0147d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.093+0000 7f7dd854c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7dd0153e60 0x7f7dd015ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.093+0000 7f7dd854c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd00cb4b0 con 0x7f7dd00cd6d0 2023-11-04T01:42:38.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.093+0000 7f7dd854c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd00cced0 con 0x7f7dd00b4880 2023-11-04T01:42:38.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.093+0000 7f7dd854c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd00ca720 con 0x7f7dd0153e60 2023-11-04T01:42:38.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.093+0000 7f7dd5ae7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dd00cd6d0 0x7f7dd0147d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.093+0000 7f7dd5ae7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dd00cd6d0 0x7f7dd0147d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59042/0 (socket says 172.21.15.77:59042) 2023-11-04T01:42:38.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.093+0000 7f7dd5ae7640 1 -- 172.21.15.77:0/1852814969 learned_addr learned my addr 172.21.15.77:0/1852814969 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:38.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.094+0000 7f7dd5ae7640 1 -- 172.21.15.77:0/1852814969 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7dd0153e60 msgr2=0x7f7dd015ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.094+0000 7f7dd6ae9640 1 --2- 172.21.15.77:0/1852814969 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7dd0153e60 0x7f7dd015ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.094+0000 7f7dd62e8640 1 --2- 172.21.15.77:0/1852814969 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7dd00b4880 0x7f7dd00c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.094+0000 7f7dd5ae7640 1 --2- 172.21.15.77:0/1852814969 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7dd0153e60 0x7f7dd015ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.094+0000 7f7dd5ae7640 1 -- 172.21.15.77:0/1852814969 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7dd00b4880 msgr2=0x7f7dd00c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.094+0000 7f7dd5ae7640 1 --2- 172.21.15.77:0/1852814969 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7dd00b4880 0x7f7dd00c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.094+0000 7f7dd5ae7640 1 -- 172.21.15.77:0/1852814969 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc4009400 con 0x7f7dd00cd6d0 2023-11-04T01:42:38.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.094+0000 7f7dd6ae9640 1 --2- 172.21.15.77:0/1852814969 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7dd0153e60 0x7f7dd015ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:38.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.094+0000 7f7dd62e8640 1 --2- 172.21.15.77:0/1852814969 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7dd00b4880 0x7f7dd00c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:38.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.094+0000 7f7dd5ae7640 1 --2- 172.21.15.77:0/1852814969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dd00cd6d0 0x7f7dd0147d40 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00c4b0 tx=0x7f7dcc00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:38.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.094+0000 7f7dc2ffd640 1 -- 172.21.15.77:0/1852814969 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc0074e0 con 0x7f7dd00cd6d0 2023-11-04T01:42:38.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.094+0000 7f7dc2ffd640 1 -- 172.21.15.77:0/1852814969 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dcc007660 con 0x7f7dd00cd6d0 2023-11-04T01:42:38.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.094+0000 7f7dd854c640 1 -- 172.21.15.77:0/1852814969 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd00caa00 con 0x7f7dd00cd6d0 2023-11-04T01:42:38.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.094+0000 7f7dc2ffd640 1 -- 172.21.15.77:0/1852814969 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc004a20 con 0x7f7dd00cd6d0 2023-11-04T01:42:38.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.094+0000 7f7dd854c640 1 -- 172.21.15.77:0/1852814969 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd00cb700 con 0x7f7dd00cd6d0 2023-11-04T01:42:38.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.095+0000 7f7dd854c640 1 -- 172.21.15.77:0/1852814969 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd0074290 con 0x7f7dd00cd6d0 2023-11-04T01:42:38.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.095+0000 7f7dc2ffd640 1 -- 172.21.15.77:0/1852814969 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7dcc004b80 con 0x7f7dd00cd6d0 2023-11-04T01:42:38.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.096+0000 7f7dc2ffd640 1 --2- 172.21.15.77:0/1852814969 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7db406ae70 0x7f7db406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.096+0000 7f7dc2ffd640 1 -- 172.21.15.77:0/1852814969 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f7dcc0890d0 con 0x7f7dd00cd6d0 2023-11-04T01:42:38.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.096+0000 7f7dd62e8640 1 --2- 172.21.15.77:0/1852814969 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7db406ae70 0x7f7db406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.096+0000 7f7dd62e8640 1 --2- 172.21.15.77:0/1852814969 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7db406ae70 0x7f7db406d330 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4036000 tx=0x7f7dc4008030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:38.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.100+0000 7f7dc2ffd640 1 -- 172.21.15.77:0/1852814969 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7dcc053ca0 con 0x7f7dd00cd6d0 2023-11-04T01:42:38.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.265+0000 7f7dd854c640 1 -- 172.21.15.77:0/1852814969 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7dd00d0b80 con 0x7f7dd00cd6d0 2023-11-04T01:42:38.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.266+0000 7f7dc2ffd640 1 -- 172.21.15.77:0/1852814969 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v70) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7dcc018020 con 0x7f7dd00cd6d0 2023-11-04T01:42:38.268 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:42:38.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.268+0000 7f7dd854c640 1 -- 172.21.15.77:0/1852814969 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7db406ae70 msgr2=0x7f7db406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.268+0000 7f7dd854c640 1 --2- 172.21.15.77:0/1852814969 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7db406ae70 0x7f7db406d330 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4036000 tx=0x7f7dc4008030 comp rx=0 tx=0).stop 2023-11-04T01:42:38.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.268+0000 7f7dd854c640 1 -- 172.21.15.77:0/1852814969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dd00cd6d0 msgr2=0x7f7dd0147d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.268+0000 7f7dd854c640 1 --2- 172.21.15.77:0/1852814969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dd00cd6d0 0x7f7dd0147d40 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00c4b0 tx=0x7f7dcc00c970 comp rx=0 tx=0).stop 2023-11-04T01:42:38.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.268+0000 7f7dd854c640 1 -- 172.21.15.77:0/1852814969 shutdown_connections 2023-11-04T01:42:38.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.268+0000 7f7dd854c640 1 --2- 172.21.15.77:0/1852814969 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7db406ae70 0x7f7db406d330 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.268+0000 7f7dd854c640 1 --2- 172.21.15.77:0/1852814969 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7dd0153e60 0x7f7dd015ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.268+0000 7f7dd854c640 1 --2- 172.21.15.77:0/1852814969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dd00cd6d0 0x7f7dd0147d40 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.268+0000 7f7dd854c640 1 --2- 172.21.15.77:0/1852814969 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7dd00b4880 0x7f7dd00c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.268+0000 7f7dd854c640 1 -- 172.21.15.77:0/1852814969 >> 172.21.15.77:0/1852814969 conn(0x7f7dd00cf880 msgr2=0x7f7dd00cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:38.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.268+0000 7f7dd854c640 1 -- 172.21.15.77:0/1852814969 shutdown_connections 2023-11-04T01:42:38.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.268+0000 7f7dd854c640 1 -- 172.21.15.77:0/1852814969 wait complete. 2023-11-04T01:42:38.280 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:42:38.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.380+0000 7f4decc6f640 1 Processor -- start 2023-11-04T01:42:38.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.380+0000 7f4decc6f640 1 -- start start 2023-11-04T01:42:38.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.381+0000 7f4decc6f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4de815b120 0x7f4de806b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.381+0000 7f4decc6f640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4de80c9b60 0x7f4de8070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.381+0000 7f4decc6f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4de8065df0 con 0x7f4de815ad40 2023-11-04T01:42:38.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.381+0000 7f4decc6f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4de806bc40 con 0x7f4de815b120 2023-11-04T01:42:38.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.381+0000 7f4decc6f640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de8066040 con 0x7f4de80c9b60 2023-11-04T01:42:38.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.381+0000 7f4ddffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4de815b120 0x7f4de806b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.381+0000 7f4de659c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f4de815ad40 0x7f4de815f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:38824/0 (socket says 172.21.15.77:38824) 2023-11-04T01:42:38.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.381+0000 7f4de659c640 1 -- 172.21.15.77:0/3921262506 learned_addr learned my addr 172.21.15.77:0/3921262506 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:38.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.381+0000 7f4de6d9d640 1 --2- 172.21.15.77:0/3921262506 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4de80c9b60 0x7f4de8070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.381+0000 7f4ddffff640 1 -- 172.21.15.77:0/3921262506 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4de80c9b60 msgr2=0x7f4de8070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:38.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.381+0000 7f4ddffff640 1 --2- 172.21.15.77:0/3921262506 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4de80c9b60 0x7f4de8070ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.381+0000 7f4ddffff640 1 -- 172.21.15.77:0/3921262506 >> v1:172.21.15.77:6789/0 conn(0x7f4de815ad40 legacy=0x7f4de815f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.381+0000 7f4ddffff640 1 -- 172.21.15.77:0/3921262506 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de8066320 con 0x7f4de815b120 2023-11-04T01:42:38.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.381+0000 7f4de5d9b640 1 -- 172.21.15.77:0/3921262506 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 228243033 0 0) 0x7f4de8065df0 con 0x7f4de815ad40 2023-11-04T01:42:38.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.382+0000 7f4ddffff640 1 --2- 172.21.15.77:0/3921262506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4de815b120 0x7f4de806b700 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f4dd00097a0 tx=0x7f4dd002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=685e96e0128df00d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:38.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.382+0000 7f4de5d9b640 1 -- 172.21.15.77:0/3921262506 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd0031830 con 0x7f4de815b120 2023-11-04T01:42:38.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.382+0000 7f4de5d9b640 1 -- 172.21.15.77:0/3921262506 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd0031990 con 0x7f4de815b120 2023-11-04T01:42:38.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.382+0000 7f4de5d9b640 1 -- 172.21.15.77:0/3921262506 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd0031d20 con 0x7f4de815b120 2023-11-04T01:42:38.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.383+0000 7f4decc6f640 1 -- 172.21.15.77:0/3921262506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4de815b120 msgr2=0x7f4de806b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.383+0000 7f4decc6f640 1 --2- 172.21.15.77:0/3921262506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4de815b120 0x7f4de806b700 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f4dd00097a0 tx=0x7f4dd002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.383+0000 7f4decc6f640 1 -- 172.21.15.77:0/3921262506 shutdown_connections 2023-11-04T01:42:38.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.383+0000 7f4decc6f640 1 --2- 172.21.15.77:0/3921262506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4de815b120 0x7f4de806b700 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.383+0000 7f4decc6f640 1 --2- 172.21.15.77:0/3921262506 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4de80c9b60 0x7f4de8070ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.383+0000 7f4decc6f640 1 -- 172.21.15.77:0/3921262506 >> 172.21.15.77:0/3921262506 conn(0x7f4de80cbc90 msgr2=0x7f4de80cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:38.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.383+0000 7f4decc6f640 1 -- 172.21.15.77:0/3921262506 shutdown_connections 2023-11-04T01:42:38.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.383+0000 7f4decc6f640 1 -- 172.21.15.77:0/3921262506 wait complete. 2023-11-04T01:42:38.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.384+0000 7f4decc6f640 1 Processor -- start 2023-11-04T01:42:38.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.384+0000 7f4decc6f640 1 -- start start 2023-11-04T01:42:38.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.385+0000 7f4decc6f640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4de80c9b60 0x7f4de814d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.385+0000 7f4decc6f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4de815ad40 0x7f4de80c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.385+0000 7f4decc6f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4de815b120 0x7f4de80c6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.385+0000 7f4decc6f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de81f0960 con 0x7f4de815ad40 2023-11-04T01:42:38.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.385+0000 7f4decc6f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de81f0c20 con 0x7f4de815b120 2023-11-04T01:42:38.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.385+0000 7f4decc6f640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de81f0f00 con 0x7f4de80c9b60 2023-11-04T01:42:38.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.385+0000 7f4ddffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4de815ad40 0x7f4de80c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.385+0000 7f4ddffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4de815ad40 0x7f4de80c62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59066/0 (socket says 172.21.15.77:59066) 2023-11-04T01:42:38.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.385+0000 7f4ddffff640 1 -- 172.21.15.77:0/4178519720 learned_addr learned my addr 172.21.15.77:0/4178519720 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:38.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.385+0000 7f4ddffff640 1 -- 172.21.15.77:0/4178519720 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4de80c9b60 msgr2=0x7f4de814d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.385+0000 7f4ddffff640 1 --2- 172.21.15.77:0/4178519720 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4de80c9b60 0x7f4de814d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.385+0000 7f4ddffff640 1 -- 172.21.15.77:0/4178519720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4de815b120 msgr2=0x7f4de80c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.385+0000 7f4ddffff640 1 --2- 172.21.15.77:0/4178519720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4de815b120 0x7f4de80c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.385+0000 7f4ddffff640 1 -- 172.21.15.77:0/4178519720 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd0009400 con 0x7f4de815ad40 2023-11-04T01:42:38.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.385+0000 7f4ddffff640 1 --2- 172.21.15.77:0/4178519720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4de815ad40 0x7f4de80c62e0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0000c00 tx=0x7f4dd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:38.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.385+0000 7f4ddeffd640 1 -- 172.21.15.77:0/4178519720 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd00317d0 con 0x7f4de815ad40 2023-11-04T01:42:38.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.385+0000 7f4ddeffd640 1 -- 172.21.15.77:0/4178519720 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd003aa60 con 0x7f4de815ad40 2023-11-04T01:42:38.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.385+0000 7f4decc6f640 1 -- 172.21.15.77:0/4178519720 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de81f11e0 con 0x7f4de815ad40 2023-11-04T01:42:38.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.385+0000 7f4ddeffd640 1 -- 172.21.15.77:0/4178519720 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd003ae10 con 0x7f4de815ad40 2023-11-04T01:42:38.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.385+0000 7f4decc6f640 1 -- 172.21.15.77:0/4178519720 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de81f39f0 con 0x7f4de815ad40 2023-11-04T01:42:38.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.386+0000 7f4decc6f640 1 -- 172.21.15.77:0/4178519720 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4de81f1700 con 0x7f4de815ad40 2023-11-04T01:42:38.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.387+0000 7f4ddeffd640 1 -- 172.21.15.77:0/4178519720 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4dd004d450 con 0x7f4de815ad40 2023-11-04T01:42:38.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.387+0000 7f4ddeffd640 1 --2- 172.21.15.77:0/4178519720 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4dc806ae70 0x7f4dc806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.387+0000 7f4ddeffd640 1 -- 172.21.15.77:0/4178519720 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f4dd00abcf0 con 0x7f4de815ad40 2023-11-04T01:42:38.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.388+0000 7f4de659c640 1 --2- 172.21.15.77:0/4178519720 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4dc806ae70 0x7f4dc806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.388+0000 7f4de659c640 1 --2- 172.21.15.77:0/4178519720 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4dc806ae70 0x7f4dc806d330 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8007fd0 tx=0x7f4dd8007920 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:38.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.391+0000 7f4ddeffd640 1 -- 172.21.15.77:0/4178519720 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4de81f1700 con 0x7f4de815ad40 2023-11-04T01:42:38.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.557+0000 7f4decc6f640 1 -- 172.21.15.77:0/4178519720 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4de81f1700 con 0x7f4de815ad40 2023-11-04T01:42:38.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.557+0000 7f4ddeffd640 1 -- 172.21.15.77:0/4178519720 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v70) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4de81f1700 con 0x7f4de815ad40 2023-11-04T01:42:38.559 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-04T01:42:38.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.559+0000 7f4decc6f640 1 -- 172.21.15.77:0/4178519720 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4dc806ae70 msgr2=0x7f4dc806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.559+0000 7f4decc6f640 1 --2- 172.21.15.77:0/4178519720 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4dc806ae70 0x7f4dc806d330 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8007fd0 tx=0x7f4dd8007920 comp rx=0 tx=0).stop 2023-11-04T01:42:38.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.559+0000 7f4decc6f640 1 -- 172.21.15.77:0/4178519720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4de815ad40 msgr2=0x7f4de80c62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.559+0000 7f4decc6f640 1 --2- 172.21.15.77:0/4178519720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4de815ad40 0x7f4de80c62e0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0000c00 tx=0x7f4dd00046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.559+0000 7f4decc6f640 1 -- 172.21.15.77:0/4178519720 shutdown_connections 2023-11-04T01:42:38.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.559+0000 7f4decc6f640 1 --2- 172.21.15.77:0/4178519720 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4dc806ae70 0x7f4dc806d330 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.559+0000 7f4decc6f640 1 --2- 172.21.15.77:0/4178519720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4de815b120 0x7f4de80c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.559+0000 7f4decc6f640 1 --2- 172.21.15.77:0/4178519720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4de815ad40 0x7f4de80c62e0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.559+0000 7f4decc6f640 1 --2- 172.21.15.77:0/4178519720 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4de80c9b60 0x7f4de814d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.559+0000 7f4decc6f640 1 -- 172.21.15.77:0/4178519720 >> 172.21.15.77:0/4178519720 conn(0x7f4de80cbc90 msgr2=0x7f4de8159430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:38.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.559+0000 7f4decc6f640 1 -- 172.21.15.77:0/4178519720 shutdown_connections 2023-11-04T01:42:38.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.559+0000 7f4decc6f640 1 -- 172.21.15.77:0/4178519720 wait complete. 2023-11-04T01:42:38.571 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:42:38.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.673+0000 7f4e074da640 1 Processor -- start 2023-11-04T01:42:38.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.673+0000 7f4e074da640 1 -- start start 2023-11-04T01:42:38.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.674+0000 7f4e074da640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4e0006cbd0 0x7f4e0006e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.674+0000 7f4e074da640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e000b24f0 con 0x7f4e0015b140 2023-11-04T01:42:38.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.674+0000 7f4e074da640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e000ce220 con 0x7f4e00067090 2023-11-04T01:42:38.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.674+0000 7f4e074da640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e000cdc60 con 0x7f4e0006cbd0 2023-11-04T01:42:38.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.674+0000 7f4e04a75640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f4e0015b140 0x7f4e0006cfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:38838/0 (socket says 172.21.15.77:38838) 2023-11-04T01:42:38.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.674+0000 7f4e04a75640 1 -- 172.21.15.77:0/1341008300 learned_addr learned my addr 172.21.15.77:0/1341008300 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:38.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.674+0000 7f4e05276640 1 --2- 172.21.15.77:0/1341008300 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4e0006cbd0 0x7f4e0006e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.674+0000 7f4df7fff640 1 -- 172.21.15.77:0/1341008300 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3390263747 0 0) 0x7f4e000b24f0 con 0x7f4e0015b140 2023-11-04T01:42:38.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.674+0000 7f4df7fff640 1 -- 172.21.15.77:0/1341008300 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dec003520 con 0x7f4e0015b140 2023-11-04T01:42:38.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.674+0000 7f4df7fff640 1 -- 172.21.15.77:0/1341008300 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3509559014 0 0) 0x7f4dec003520 con 0x7f4e0015b140 2023-11-04T01:42:38.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.674+0000 7f4df7fff640 1 -- 172.21.15.77:0/1341008300 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4e0006cbd0 msgr2=0x7f4e0006e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:38.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.674+0000 7f4df7fff640 1 --2- 172.21.15.77:0/1341008300 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4e0006cbd0 0x7f4e0006e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.674+0000 7f4df7fff640 1 -- 172.21.15.77:0/1341008300 >> v1:172.21.15.122:6789/0 conn(0x7f4e00067090 legacy=0x7f4e000b2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.674+0000 7f4df7fff640 1 -- 172.21.15.77:0/1341008300 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e000cdf40 con 0x7f4e0015b140 2023-11-04T01:42:38.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.674+0000 7f4df7fff640 1 -- 172.21.15.77:0/1341008300 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f4df0001670 con 0x7f4e0015b140 2023-11-04T01:42:38.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.674+0000 7f4e05276640 1 --2- 172.21.15.77:0/1341008300 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4e0006cbd0 0x7f4e0006e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:38.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.674+0000 7f4df7fff640 1 -- 172.21.15.77:0/1341008300 >> v1:172.21.15.77:6789/0 conn(0x7f4e0015b140 legacy=0x7f4e0006cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.674+0000 7f4df7fff640 1 --2- 172.21.15.77:0/1341008300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4dec0039a0 0x7f4dec003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.674+0000 7f4df7fff640 1 --2- 172.21.15.77:0/1341008300 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4e0006cbd0 0x7f4dec0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.674+0000 7f4df7fff640 1 --2- 172.21.15.77:0/1341008300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4dec004d00 0x7f4dec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.674+0000 7f4df7fff640 1 -- 172.21.15.77:0/1341008300 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e000cdc60 con 0x7f4dec0039a0 2023-11-04T01:42:38.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.674+0000 7f4df7fff640 1 -- 172.21.15.77:0/1341008300 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec00b9d0 con 0x7f4dec004d00 2023-11-04T01:42:38.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.674+0000 7f4df7fff640 1 -- 172.21.15.77:0/1341008300 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec00bb90 con 0x7f4e0006cbd0 2023-11-04T01:42:38.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.674+0000 7f4e05276640 1 --2- 172.21.15.77:0/1341008300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4dec0039a0 0x7f4dec003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.675+0000 7f4e04a75640 1 --2- 172.21.15.77:0/1341008300 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4e0006cbd0 0x7f4dec0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.675+0000 7f4e05a77640 1 --2- 172.21.15.77:0/1341008300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4dec004d00 0x7f4dec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.675+0000 7f4e05276640 1 -- 172.21.15.77:0/1341008300 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4e0006cbd0 msgr2=0x7f4dec0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:38.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.675+0000 7f4e05276640 1 --2- 172.21.15.77:0/1341008300 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4e0006cbd0 0x7f4dec0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.675+0000 7f4e05276640 1 -- 172.21.15.77:0/1341008300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4dec004d00 msgr2=0x7f4dec005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:38.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.675+0000 7f4e05276640 1 --2- 172.21.15.77:0/1341008300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4dec004d00 0x7f4dec005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.675+0000 7f4e05276640 1 -- 172.21.15.77:0/1341008300 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dfc009400 con 0x7f4dec0039a0 2023-11-04T01:42:38.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.675+0000 7f4e05a77640 1 --2- 172.21.15.77:0/1341008300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4dec004d00 0x7f4dec005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:38.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.675+0000 7f4e05276640 1 --2- 172.21.15.77:0/1341008300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4dec0039a0 0x7f4dec003d80 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc009c90 tx=0x7f4dec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=529b0496b429b255 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:38.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.676+0000 7f4df7fff640 1 -- 172.21.15.77:0/1341008300 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc02c8f0 con 0x7f4dec0039a0 2023-11-04T01:42:38.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.676+0000 7f4df7fff640 1 -- 172.21.15.77:0/1341008300 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dfc02ca50 con 0x7f4dec0039a0 2023-11-04T01:42:38.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.676+0000 7f4df7fff640 1 -- 172.21.15.77:0/1341008300 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc02ce00 con 0x7f4dec0039a0 2023-11-04T01:42:38.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.676+0000 7f4e074da640 1 -- 172.21.15.77:0/1341008300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4dec0039a0 msgr2=0x7f4dec003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.676+0000 7f4e074da640 1 --2- 172.21.15.77:0/1341008300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4dec0039a0 0x7f4dec003d80 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc009c90 tx=0x7f4dec0057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.676+0000 7f4e05a77640 1 -- 172.21.15.77:0/1341008300 reap_dead start 2023-11-04T01:42:38.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.676+0000 7f4e074da640 1 -- 172.21.15.77:0/1341008300 shutdown_connections 2023-11-04T01:42:38.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.676+0000 7f4e074da640 1 -- 172.21.15.77:0/1341008300 >> 172.21.15.77:0/1341008300 conn(0x7f4e0006a120 msgr2=0x7f4e0006a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:38.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.676+0000 7f4e074da640 1 -- 172.21.15.77:0/1341008300 shutdown_connections 2023-11-04T01:42:38.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.676+0000 7f4e074da640 1 -- 172.21.15.77:0/1341008300 wait complete. 2023-11-04T01:42:38.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.677+0000 7f4e074da640 1 Processor -- start 2023-11-04T01:42:38.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.677+0000 7f4e074da640 1 -- start start 2023-11-04T01:42:38.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.678+0000 7f4e074da640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4dec0039a0 0x7f4e000c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.678+0000 7f4e074da640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e0015df40 0x7f4e000ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.678+0000 7f4e074da640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4e000caa00 0x7f4e0015b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.678+0000 7f4e074da640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e000c6750 con 0x7f4e0015df40 2023-11-04T01:42:38.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.678+0000 7f4e074da640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e000c9d90 con 0x7f4dec0039a0 2023-11-04T01:42:38.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.678+0000 7f4e074da640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0014f7b0 con 0x7f4e000caa00 2023-11-04T01:42:38.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.678+0000 7f4e04a75640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e0015df40 0x7f4e000ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.678+0000 7f4e04a75640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e0015df40 0x7f4e000ca4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59092/0 (socket says 172.21.15.77:59092) 2023-11-04T01:42:38.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.678+0000 7f4e04a75640 1 -- 172.21.15.77:0/19841185 learned_addr learned my addr 172.21.15.77:0/19841185 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:38.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.678+0000 7f4e05276640 1 --2- 172.21.15.77:0/19841185 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4dec0039a0 0x7f4e000c5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.678+0000 7f4e05a77640 1 --2- 172.21.15.77:0/19841185 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4e000caa00 0x7f4e0015b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.678+0000 7f4e04a75640 1 -- 172.21.15.77:0/19841185 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4e000caa00 msgr2=0x7f4e0015b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.678+0000 7f4e04a75640 1 --2- 172.21.15.77:0/19841185 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4e000caa00 0x7f4e0015b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.678+0000 7f4e04a75640 1 -- 172.21.15.77:0/19841185 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4dec0039a0 msgr2=0x7f4e000c5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.678+0000 7f4e04a75640 1 --2- 172.21.15.77:0/19841185 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4dec0039a0 0x7f4e000c5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.678+0000 7f4e04a75640 1 -- 172.21.15.77:0/19841185 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0015e500 con 0x7f4e0015df40 2023-11-04T01:42:38.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.679+0000 7f4e04a75640 1 --2- 172.21.15.77:0/19841185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e0015df40 0x7f4e000ca4c0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f4df00017a0 tx=0x7f4df0007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:38.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.679+0000 7f4df5ffb640 1 -- 172.21.15.77:0/19841185 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df000f6d0 con 0x7f4e0015df40 2023-11-04T01:42:38.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.679+0000 7f4df5ffb640 1 -- 172.21.15.77:0/19841185 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df000f870 con 0x7f4e0015df40 2023-11-04T01:42:38.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.679+0000 7f4e074da640 1 -- 172.21.15.77:0/19841185 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e0015d890 con 0x7f4e0015df40 2023-11-04T01:42:38.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.679+0000 7f4df5ffb640 1 -- 172.21.15.77:0/19841185 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df000fc20 con 0x7f4e0015df40 2023-11-04T01:42:38.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.679+0000 7f4e074da640 1 -- 172.21.15.77:0/19841185 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e000c9fa0 con 0x7f4e0015df40 2023-11-04T01:42:38.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.680+0000 7f4e074da640 1 -- 172.21.15.77:0/19841185 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e00074290 con 0x7f4e0015df40 2023-11-04T01:42:38.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.680+0000 7f4df5ffb640 1 -- 172.21.15.77:0/19841185 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4df000fd80 con 0x7f4e0015df40 2023-11-04T01:42:38.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.681+0000 7f4df5ffb640 1 --2- 172.21.15.77:0/19841185 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4de406aea0 0x7f4de406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.681+0000 7f4df5ffb640 1 -- 172.21.15.77:0/19841185 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f4df0089af0 con 0x7f4e0015df40 2023-11-04T01:42:38.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.681+0000 7f4e05276640 1 --2- 172.21.15.77:0/19841185 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4de406aea0 0x7f4de406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.681+0000 7f4e05276640 1 --2- 172.21.15.77:0/19841185 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4de406aea0 0x7f4de406d360 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc036000 tx=0x7f4dfc030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:38.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.685+0000 7f4df5ffb640 1 -- 172.21.15.77:0/19841185 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4df0054750 con 0x7f4e0015df40 2023-11-04T01:42:38.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.850+0000 7f4e074da640 1 -- 172.21.15.77:0/19841185 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f4e0015a6c0 con 0x7f4e0015df40 2023-11-04T01:42:38.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.850+0000 7f4df5ffb640 1 -- 172.21.15.77:0/19841185 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v70) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4df0057d70 con 0x7f4e0015df40 2023-11-04T01:42:38.853 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:42:38.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.852+0000 7f4e074da640 1 -- 172.21.15.77:0/19841185 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4de406aea0 msgr2=0x7f4de406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.852+0000 7f4e074da640 1 --2- 172.21.15.77:0/19841185 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4de406aea0 0x7f4de406d360 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc036000 tx=0x7f4dfc030000 comp rx=0 tx=0).stop 2023-11-04T01:42:38.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.852+0000 7f4e074da640 1 -- 172.21.15.77:0/19841185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e0015df40 msgr2=0x7f4e000ca4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.852+0000 7f4e074da640 1 --2- 172.21.15.77:0/19841185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e0015df40 0x7f4e000ca4c0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f4df00017a0 tx=0x7f4df0007430 comp rx=0 tx=0).stop 2023-11-04T01:42:38.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.852+0000 7f4e074da640 1 -- 172.21.15.77:0/19841185 shutdown_connections 2023-11-04T01:42:38.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.852+0000 7f4e074da640 1 --2- 172.21.15.77:0/19841185 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4de406aea0 0x7f4de406d360 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.852+0000 7f4e074da640 1 --2- 172.21.15.77:0/19841185 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4e000caa00 0x7f4e0015b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.852+0000 7f4e074da640 1 --2- 172.21.15.77:0/19841185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e0015df40 0x7f4e000ca4c0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.852+0000 7f4e074da640 1 --2- 172.21.15.77:0/19841185 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4dec0039a0 0x7f4e000c5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.852+0000 7f4e074da640 1 -- 172.21.15.77:0/19841185 >> 172.21.15.77:0/19841185 conn(0x7f4e0006a120 msgr2=0x7f4e000b34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:38.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.852+0000 7f4e074da640 1 -- 172.21.15.77:0/19841185 shutdown_connections 2023-11-04T01:42:38.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.852+0000 7f4e074da640 1 -- 172.21.15.77:0/19841185 wait complete. 2023-11-04T01:42:38.864 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:42:38.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.965+0000 7ff01444b640 1 Processor -- start 2023-11-04T01:42:38.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.965+0000 7ff01444b640 1 -- start start 2023-11-04T01:42:38.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.966+0000 7ff01444b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff00c15e430 0x7ff00c0cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.966+0000 7ff01444b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff00c0d0280 con 0x7ff00c0cf160 2023-11-04T01:42:38.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.966+0000 7ff01444b640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff00c0cf670 con 0x7ff00c0d0710 2023-11-04T01:42:38.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.966+0000 7ff01444b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff00c0cf950 con 0x7ff00c15e430 2023-11-04T01:42:38.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.967+0000 7ff0121e7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff00c15e430 0x7ff00c0cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.967+0000 7ff0119e6640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ff00c0cf160 0x7ff00c0cd510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:38850/0 (socket says 172.21.15.77:38850) 2023-11-04T01:42:38.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.967+0000 7ff0119e6640 1 -- 172.21.15.77:0/4103872695 learned_addr learned my addr 172.21.15.77:0/4103872695 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:38.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.967+0000 7ff0121e7640 1 -- 172.21.15.77:0/4103872695 >> v1:172.21.15.122:6789/0 conn(0x7ff00c0d0710 legacy=0x7ff00c0b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:38.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.967+0000 7ff0121e7640 1 -- 172.21.15.77:0/4103872695 >> v1:172.21.15.77:6789/0 conn(0x7ff00c0cf160 legacy=0x7ff00c0cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.967+0000 7ff0111e5640 1 -- 172.21.15.77:0/4103872695 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491492725 0 0) 0x7ff00c0d0280 con 0x7ff00c0cf160 2023-11-04T01:42:38.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.967+0000 7ff0121e7640 1 -- 172.21.15.77:0/4103872695 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff00c0cfc30 con 0x7ff00c15e430 2023-11-04T01:42:38.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.968+0000 7ff0121e7640 1 --2- 172.21.15.77:0/4103872695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff00c15e430 0x7ff00c0cec20 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7ff0080097a0 tx=0x7ff00802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a719d3ee04ecc564 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:38.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.968+0000 7ff0111e5640 1 -- 172.21.15.77:0/4103872695 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff008031830 con 0x7ff00c15e430 2023-11-04T01:42:38.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.968+0000 7ff0111e5640 1 -- 172.21.15.77:0/4103872695 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff008031990 con 0x7ff00c15e430 2023-11-04T01:42:38.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.968+0000 7ff0111e5640 1 -- 172.21.15.77:0/4103872695 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff008031d20 con 0x7ff00c15e430 2023-11-04T01:42:38.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.968+0000 7ff01444b640 1 -- 172.21.15.77:0/4103872695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff00c15e430 msgr2=0x7ff00c0cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.968+0000 7ff01444b640 1 --2- 172.21.15.77:0/4103872695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff00c15e430 0x7ff00c0cec20 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7ff0080097a0 tx=0x7ff00802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.968+0000 7ff01444b640 1 -- 172.21.15.77:0/4103872695 shutdown_connections 2023-11-04T01:42:38.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.968+0000 7ff01444b640 1 --2- 172.21.15.77:0/4103872695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff00c15e430 0x7ff00c0cec20 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.968+0000 7ff01444b640 1 -- 172.21.15.77:0/4103872695 >> 172.21.15.77:0/4103872695 conn(0x7ff00c06ea20 msgr2=0x7ff00c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:38.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.968+0000 7ff01444b640 1 -- 172.21.15.77:0/4103872695 shutdown_connections 2023-11-04T01:42:38.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.968+0000 7ff01444b640 1 -- 172.21.15.77:0/4103872695 wait complete. 2023-11-04T01:42:38.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.970+0000 7ff01444b640 1 Processor -- start 2023-11-04T01:42:38.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.970+0000 7ff01444b640 1 -- start start 2023-11-04T01:42:38.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.970+0000 7ff01444b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff00c0cf160 0x7ff00c0b1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.970+0000 7ff01444b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff00c0d0710 0x7ff00c15c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.970+0000 7ff01444b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff00c15e430 0x7ff00c15c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.970+0000 7ff01444b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00c0c84d0 con 0x7ff00c0cf160 2023-11-04T01:42:38.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.970+0000 7ff01444b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00c0b3450 con 0x7ff00c15e430 2023-11-04T01:42:38.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.970+0000 7ff01444b640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff00c0b3170 con 0x7ff00c0d0710 2023-11-04T01:42:38.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.970+0000 7ff0121e7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff00c0cf160 0x7ff00c0b1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.970+0000 7ff0121e7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff00c0cf160 0x7ff00c0b1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59110/0 (socket says 172.21.15.77:59110) 2023-11-04T01:42:38.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.970+0000 7ff0121e7640 1 -- 172.21.15.77:0/3038421292 learned_addr learned my addr 172.21.15.77:0/3038421292 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:38.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.971+0000 7ff0119e6640 1 --2- 172.21.15.77:0/3038421292 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff00c0d0710 0x7ff00c15c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.971+0000 7ff0129e8640 1 --2- 172.21.15.77:0/3038421292 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff00c15e430 0x7ff00c15c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.971+0000 7ff0121e7640 1 -- 172.21.15.77:0/3038421292 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff00c0d0710 msgr2=0x7ff00c15c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.971+0000 7ff0121e7640 1 --2- 172.21.15.77:0/3038421292 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff00c0d0710 0x7ff00c15c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.971+0000 7ff0121e7640 1 -- 172.21.15.77:0/3038421292 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff00c15e430 msgr2=0x7ff00c15c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.971+0000 7ff0121e7640 1 --2- 172.21.15.77:0/3038421292 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff00c15e430 0x7ff00c15c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.971+0000 7ff0121e7640 1 -- 172.21.15.77:0/3038421292 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff008009400 con 0x7ff00c0cf160 2023-11-04T01:42:38.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.971+0000 7ff0119e6640 1 --2- 172.21.15.77:0/3038421292 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff00c0d0710 0x7ff00c15c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:38.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.971+0000 7ff0129e8640 1 --2- 172.21.15.77:0/3038421292 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff00c15e430 0x7ff00c15c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:38.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.971+0000 7ff0121e7640 1 --2- 172.21.15.77:0/3038421292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff00c0cf160 0x7ff00c0b1180 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7ff008034040 tx=0x7ff0080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:38.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.971+0000 7ff002ffd640 1 -- 172.21.15.77:0/3038421292 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0080317d0 con 0x7ff00c0cf160 2023-11-04T01:42:38.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.971+0000 7ff002ffd640 1 -- 172.21.15.77:0/3038421292 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff008004030 con 0x7ff00c0cf160 2023-11-04T01:42:38.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.971+0000 7ff002ffd640 1 -- 172.21.15.77:0/3038421292 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0080043e0 con 0x7ff00c0cf160 2023-11-04T01:42:38.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.971+0000 7ff01444b640 1 -- 172.21.15.77:0/3038421292 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff00c0c7e10 con 0x7ff00c0cf160 2023-11-04T01:42:38.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.971+0000 7ff01444b640 1 -- 172.21.15.77:0/3038421292 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff00c0b16c0 con 0x7ff00c0cf160 2023-11-04T01:42:38.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.972+0000 7ff01444b640 1 -- 172.21.15.77:0/3038421292 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff00c0c8610 con 0x7ff00c0cf160 2023-11-04T01:42:38.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.972+0000 7ff002ffd640 1 -- 172.21.15.77:0/3038421292 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff008043070 con 0x7ff00c0cf160 2023-11-04T01:42:38.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.973+0000 7ff002ffd640 1 --2- 172.21.15.77:0/3038421292 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7feff006ae70 0x7feff006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.973+0000 7ff002ffd640 1 -- 172.21.15.77:0/3038421292 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7148+0+0 (secure 0 0 0) 0x7ff0080ab900 con 0x7ff00c0cf160 2023-11-04T01:42:38.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.973+0000 7ff0119e6640 1 --2- 172.21.15.77:0/3038421292 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7feff006ae70 0x7feff006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.973+0000 7ff0119e6640 1 --2- 172.21.15.77:0/3038421292 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7feff006ae70 0x7feff006d330 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff00c15a010 tx=0x7feffc009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:38.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:38.977+0000 7ff002ffd640 1 -- 172.21.15.77:0/3038421292 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff00c0c8610 con 0x7ff00c0cf160 2023-11-04T01:42:39.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.140+0000 7ff01444b640 1 -- 172.21.15.77:0/3038421292 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7ff00c0c8610 con 0x7ff00c0cf160 2023-11-04T01:42:39.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.140+0000 7ff002ffd640 1 -- 172.21.15.77:0/3038421292 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v70) v1 ==== 107+0+11 (secure 0 0 0) 0x7ff00c0c8610 con 0x7ff00c0cf160 2023-11-04T01:42:39.142 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:42:39.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.142+0000 7ff01444b640 1 -- 172.21.15.77:0/3038421292 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7feff006ae70 msgr2=0x7feff006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.142+0000 7ff01444b640 1 --2- 172.21.15.77:0/3038421292 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7feff006ae70 0x7feff006d330 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff00c15a010 tx=0x7feffc009040 comp rx=0 tx=0).stop 2023-11-04T01:42:39.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.142+0000 7ff01444b640 1 -- 172.21.15.77:0/3038421292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff00c0cf160 msgr2=0x7ff00c0b1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.142+0000 7ff01444b640 1 --2- 172.21.15.77:0/3038421292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff00c0cf160 0x7ff00c0b1180 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7ff008034040 tx=0x7ff0080046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.142+0000 7ff01444b640 1 -- 172.21.15.77:0/3038421292 shutdown_connections 2023-11-04T01:42:39.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.142+0000 7ff01444b640 1 --2- 172.21.15.77:0/3038421292 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7feff006ae70 0x7feff006d330 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.142+0000 7ff01444b640 1 --2- 172.21.15.77:0/3038421292 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff00c15e430 0x7ff00c15c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.142+0000 7ff01444b640 1 --2- 172.21.15.77:0/3038421292 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff00c0d0710 0x7ff00c15c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.142+0000 7ff01444b640 1 --2- 172.21.15.77:0/3038421292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff00c0cf160 0x7ff00c0b1180 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.142+0000 7ff01444b640 1 -- 172.21.15.77:0/3038421292 >> 172.21.15.77:0/3038421292 conn(0x7ff00c06ea20 msgr2=0x7ff00c0c6680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:39.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.142+0000 7ff01444b640 1 -- 172.21.15.77:0/3038421292 shutdown_connections 2023-11-04T01:42:39.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.142+0000 7ff01444b640 1 -- 172.21.15.77:0/3038421292 wait complete. 2023-11-04T01:42:39.154 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:42:39.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.253+0000 7fbb61c90640 1 Processor -- start 2023-11-04T01:42:39.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.253+0000 7fbb61c90640 1 -- start start 2023-11-04T01:42:39.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.253+0000 7fbb61c90640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fbb5c153e60 0x7fbb5c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.253+0000 7fbb61c90640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbb5c0cd6d0 0x7fbb5c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.253+0000 7fbb61c90640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb5c0cde60 con 0x7fbb5c0b4880 2023-11-04T01:42:39.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.253+0000 7fbb61c90640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb5c160f90 con 0x7fbb5c0cd6d0 2023-11-04T01:42:39.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.253+0000 7fbb61c90640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb5c15e400 con 0x7fbb5c153e60 2023-11-04T01:42:39.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.254+0000 7fbb5affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbb5c0cd6d0 0x7fbb5c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.254+0000 7fbb5bfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fbb5c0b4880 0x7fbb5c06b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:38852/0 (socket says 172.21.15.77:38852) 2023-11-04T01:42:39.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.254+0000 7fbb5bfff640 1 -- 172.21.15.77:0/701709516 learned_addr learned my addr 172.21.15.77:0/701709516 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:39.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.254+0000 7fbb5b7fe640 1 --2- 172.21.15.77:0/701709516 >> v2:172.21.15.122:3300/0 conn(0x7fbb5c153e60 0x7fbb5c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.254+0000 7fbb5affd640 1 -- 172.21.15.77:0/701709516 >> v2:172.21.15.122:3300/0 conn(0x7fbb5c153e60 msgr2=0x7fbb5c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:39.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.254+0000 7fbb5affd640 1 --2- 172.21.15.77:0/701709516 >> v2:172.21.15.122:3300/0 conn(0x7fbb5c153e60 0x7fbb5c15dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.254+0000 7fbb5affd640 1 -- 172.21.15.77:0/701709516 >> v1:172.21.15.77:6789/0 conn(0x7fbb5c0b4880 legacy=0x7fbb5c06b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.254+0000 7fbb5affd640 1 -- 172.21.15.77:0/701709516 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb5c161960 con 0x7fbb5c0cd6d0 2023-11-04T01:42:39.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.254+0000 7fbb5b7fe640 1 --2- 172.21.15.77:0/701709516 >> v2:172.21.15.122:3300/0 conn(0x7fbb5c153e60 0x7fbb5c15dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:39.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.255+0000 7fbb5affd640 1 --2- 172.21.15.77:0/701709516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb5c0cd6d0 0x7fbb5c161420 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c08abe0 tx=0x7fbb5002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96bcd058b1342ae4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:39.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.255+0000 7fbb5a7fc640 1 -- 172.21.15.77:0/701709516 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb50031830 con 0x7fbb5c0cd6d0 2023-11-04T01:42:39.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.255+0000 7fbb5a7fc640 1 -- 172.21.15.77:0/701709516 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb50031990 con 0x7fbb5c0cd6d0 2023-11-04T01:42:39.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.255+0000 7fbb5a7fc640 1 -- 172.21.15.77:0/701709516 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb50031d20 con 0x7fbb5c0cd6d0 2023-11-04T01:42:39.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.255+0000 7fbb61c90640 1 -- 172.21.15.77:0/701709516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb5c0cd6d0 msgr2=0x7fbb5c161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.255+0000 7fbb61c90640 1 --2- 172.21.15.77:0/701709516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb5c0cd6d0 0x7fbb5c161420 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c08abe0 tx=0x7fbb5002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.255+0000 7fbb61c90640 1 -- 172.21.15.77:0/701709516 shutdown_connections 2023-11-04T01:42:39.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.255+0000 7fbb61c90640 1 --2- 172.21.15.77:0/701709516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb5c0cd6d0 0x7fbb5c161420 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.255+0000 7fbb61c90640 1 --2- 172.21.15.77:0/701709516 >> v2:172.21.15.122:3300/0 conn(0x7fbb5c153e60 0x7fbb5c15dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.255+0000 7fbb61c90640 1 -- 172.21.15.77:0/701709516 >> 172.21.15.77:0/701709516 conn(0x7fbb5c0cf880 msgr2=0x7fbb5c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:39.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.255+0000 7fbb61c90640 1 -- 172.21.15.77:0/701709516 shutdown_connections 2023-11-04T01:42:39.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.255+0000 7fbb61c90640 1 -- 172.21.15.77:0/701709516 wait complete. 2023-11-04T01:42:39.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.256+0000 7fbb61c90640 1 Processor -- start 2023-11-04T01:42:39.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.257+0000 7fbb61c90640 1 -- start start 2023-11-04T01:42:39.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.257+0000 7fbb61c90640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbb5c0b4880 0x7fbb5c0c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.257+0000 7fbb61c90640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb5c0cd6d0 0x7fbb5c0b73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.257+0000 7fbb61c90640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbb5c153e60 0x7fbb5c1f2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.257+0000 7fbb61c90640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c0c8950 con 0x7fbb5c0cd6d0 2023-11-04T01:42:39.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.257+0000 7fbb61c90640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c0c7950 con 0x7fbb5c153e60 2023-11-04T01:42:39.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.257+0000 7fbb61c90640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c1f3060 con 0x7fbb5c0b4880 2023-11-04T01:42:39.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.257+0000 7fbb5affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb5c0cd6d0 0x7fbb5c0b73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.257+0000 7fbb5affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb5c0cd6d0 0x7fbb5c0b73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59122/0 (socket says 172.21.15.77:59122) 2023-11-04T01:42:39.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.257+0000 7fbb5affd640 1 -- 172.21.15.77:0/266401639 learned_addr learned my addr 172.21.15.77:0/266401639 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:39.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.257+0000 7fbb5bfff640 1 --2- 172.21.15.77:0/266401639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbb5c153e60 0x7fbb5c1f2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.257+0000 7fbb5b7fe640 1 --2- 172.21.15.77:0/266401639 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbb5c0b4880 0x7fbb5c0c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.258+0000 7fbb5affd640 1 -- 172.21.15.77:0/266401639 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbb5c0b4880 msgr2=0x7fbb5c0c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.258+0000 7fbb5affd640 1 --2- 172.21.15.77:0/266401639 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbb5c0b4880 0x7fbb5c0c8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.258+0000 7fbb5affd640 1 -- 172.21.15.77:0/266401639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbb5c153e60 msgr2=0x7fbb5c1f2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.258+0000 7fbb5affd640 1 --2- 172.21.15.77:0/266401639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbb5c153e60 0x7fbb5c1f2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.258+0000 7fbb5affd640 1 -- 172.21.15.77:0/266401639 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb50009400 con 0x7fbb5c0cd6d0 2023-11-04T01:42:39.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.258+0000 7fbb5affd640 1 --2- 172.21.15.77:0/266401639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb5c0cd6d0 0x7fbb5c0b73c0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fbb50009890 tx=0x7fbb500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:39.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.258+0000 7fbb43fff640 1 -- 172.21.15.77:0/266401639 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5003ba70 con 0x7fbb5c0cd6d0 2023-11-04T01:42:39.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.258+0000 7fbb43fff640 1 -- 172.21.15.77:0/266401639 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5003bbf0 con 0x7fbb5c0cd6d0 2023-11-04T01:42:39.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.258+0000 7fbb61c90640 1 -- 172.21.15.77:0/266401639 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb5c1f3340 con 0x7fbb5c0cd6d0 2023-11-04T01:42:39.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.258+0000 7fbb43fff640 1 -- 172.21.15.77:0/266401639 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb50045400 con 0x7fbb5c0cd6d0 2023-11-04T01:42:39.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.258+0000 7fbb61c90640 1 -- 172.21.15.77:0/266401639 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb5c0c7ef0 con 0x7fbb5c0cd6d0 2023-11-04T01:42:39.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.259+0000 7fbb61c90640 1 -- 172.21.15.77:0/266401639 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb5c074290 con 0x7fbb5c0cd6d0 2023-11-04T01:42:39.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.259+0000 7fbb43fff640 1 -- 172.21.15.77:0/266401639 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbb5004e440 con 0x7fbb5c0cd6d0 2023-11-04T01:42:39.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.260+0000 7fbb43fff640 1 --2- 172.21.15.77:0/266401639 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbb4806ae70 0x7fbb4806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.260+0000 7fbb43fff640 1 -- 172.21.15.77:0/266401639 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7148+0+0 (secure 0 0 0) 0x7fbb500abe20 con 0x7fbb5c0cd6d0 2023-11-04T01:42:39.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.260+0000 7fbb5b7fe640 1 --2- 172.21.15.77:0/266401639 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbb4806ae70 0x7fbb4806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.260+0000 7fbb5b7fe640 1 --2- 172.21.15.77:0/266401639 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbb4806ae70 0x7fbb4806d330 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c00a950 tx=0x7fbb4c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:39.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.264+0000 7fbb43fff640 1 -- 172.21.15.77:0/266401639 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbb500769c0 con 0x7fbb5c0cd6d0 2023-11-04T01:42:39.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.443+0000 7fbb61c90640 1 -- 172.21.15.77:0/266401639 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbb5c0d0b80 con 0x7fbb5c0cd6d0 2023-11-04T01:42:39.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.443+0000 7fbb43fff640 1 -- 172.21.15.77:0/266401639 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v70) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbb50035080 con 0x7fbb5c0cd6d0 2023-11-04T01:42:39.445 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-11-04T01:42:39.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.445+0000 7fbb61c90640 1 -- 172.21.15.77:0/266401639 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbb4806ae70 msgr2=0x7fbb4806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.445+0000 7fbb61c90640 1 --2- 172.21.15.77:0/266401639 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbb4806ae70 0x7fbb4806d330 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c00a950 tx=0x7fbb4c008040 comp rx=0 tx=0).stop 2023-11-04T01:42:39.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.445+0000 7fbb61c90640 1 -- 172.21.15.77:0/266401639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb5c0cd6d0 msgr2=0x7fbb5c0b73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.445+0000 7fbb61c90640 1 --2- 172.21.15.77:0/266401639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb5c0cd6d0 0x7fbb5c0b73c0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fbb50009890 tx=0x7fbb500046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.445+0000 7fbb61c90640 1 -- 172.21.15.77:0/266401639 shutdown_connections 2023-11-04T01:42:39.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.445+0000 7fbb61c90640 1 --2- 172.21.15.77:0/266401639 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbb4806ae70 0x7fbb4806d330 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.445+0000 7fbb61c90640 1 --2- 172.21.15.77:0/266401639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbb5c153e60 0x7fbb5c1f2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.445+0000 7fbb61c90640 1 --2- 172.21.15.77:0/266401639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb5c0cd6d0 0x7fbb5c0b73c0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.445+0000 7fbb61c90640 1 --2- 172.21.15.77:0/266401639 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbb5c0b4880 0x7fbb5c0c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.445+0000 7fbb61c90640 1 -- 172.21.15.77:0/266401639 >> 172.21.15.77:0/266401639 conn(0x7fbb5c0cf880 msgr2=0x7fbb5c0b4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:39.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.445+0000 7fbb61c90640 1 -- 172.21.15.77:0/266401639 shutdown_connections 2023-11-04T01:42:39.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.445+0000 7fbb61c90640 1 -- 172.21.15.77:0/266401639 wait complete. 2023-11-04T01:42:39.457 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi077.front.sepia.ceph.com... 2023-11-04T01:42:39.458 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:39.458 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:39.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:39.516 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[141280]: fuse finished with error 0 and tester_r 0 2023-11-04T01:42:39.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:39.522 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:2023-11-04T01:42:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:39.523 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2023-11-04T01:42:39.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:39.524 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:42:39.539 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:42:39.539 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:42:39.558 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056339,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13650 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:42:39.558 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi122.front.sepia.ceph.com 2023-11-04T01:42:39.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:39.559 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:42:39.615 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:42:39.616 INFO:teuthology.orchestra.run.smithi122.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-04T01:42:39.616 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:42:39.617 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:42:39.632 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19534 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:42:39.633 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2023-11-04T01:42:39.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:39.633 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:42:39.687 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:42:39.687 INFO:teuthology.orchestra.run.smithi077.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-04T01:42:39.688 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:42:39.688 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:42:39.707 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056339,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13650 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:42:39.707 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi122.front.sepia.ceph.com 2023-11-04T01:42:39.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:39.708 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:42:39.763 INFO:teuthology.orchestra.run.smithi122.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-04T01:42:39.764 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:42:39.764 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:39.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.862+0000 7f9a8a8c9640 1 Processor -- start 2023-11-04T01:42:39.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.862+0000 7f9a8a8c9640 1 -- start start 2023-11-04T01:42:39.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.863+0000 7f9a8a8c9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9a84159c70 0x7f9a840ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.863+0000 7f9a8a8c9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9a8406db20 0x7f9a840b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.863+0000 7f9a8a8c9640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a840b4110 con 0x7f9a840b0910 2023-11-04T01:42:39.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.863+0000 7f9a8a8c9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a840b49b0 con 0x7f9a84159c70 2023-11-04T01:42:39.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.863+0000 7f9a8a8c9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a840b0da0 con 0x7f9a8406db20 2023-11-04T01:42:39.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.863+0000 7f9a83fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9a84159c70 0x7f9a840ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.863+0000 7f9a83fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9a84159c70 0x7f9a840ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59134/0 (socket says 172.21.15.77:59134) 2023-11-04T01:42:39.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.863+0000 7f9a83fff640 1 -- 172.21.15.77:0/3473479089 learned_addr learned my addr 172.21.15.77:0/3473479089 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:39.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.863+0000 7f9a837fe640 1 --2- 172.21.15.77:0/3473479089 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9a8406db20 0x7f9a840b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.863+0000 7f9a83fff640 1 -- 172.21.15.77:0/3473479089 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9a8406db20 msgr2=0x7f9a840b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:39.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.863+0000 7f9a83fff640 1 --2- 172.21.15.77:0/3473479089 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9a8406db20 0x7f9a840b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.863+0000 7f9a83fff640 1 -- 172.21.15.77:0/3473479089 >> v1:172.21.15.122:6789/0 conn(0x7f9a840b0910 legacy=0x7f9a8415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.863+0000 7f9a83fff640 1 -- 172.21.15.77:0/3473479089 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a840b43f0 con 0x7f9a84159c70 2023-11-04T01:42:39.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.864+0000 7f9a83fff640 1 --2- 172.21.15.77:0/3473479089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a84159c70 0x7f9a840ce370 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f9a74009870 tx=0x7f9a7402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f371ee4babf8576 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:39.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.864+0000 7f9a82ffd640 1 -- 172.21.15.77:0/3473479089 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a74030840 con 0x7f9a84159c70 2023-11-04T01:42:39.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.864+0000 7f9a82ffd640 1 -- 172.21.15.77:0/3473479089 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a740309a0 con 0x7f9a84159c70 2023-11-04T01:42:39.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.864+0000 7f9a82ffd640 1 -- 172.21.15.77:0/3473479089 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a74030d30 con 0x7f9a84159c70 2023-11-04T01:42:39.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.865+0000 7f9a8a8c9640 1 -- 172.21.15.77:0/3473479089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a84159c70 msgr2=0x7f9a840ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.865+0000 7f9a8a8c9640 1 --2- 172.21.15.77:0/3473479089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a84159c70 0x7f9a840ce370 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f9a74009870 tx=0x7f9a7402b980 comp rx=0 tx=0).stop 2023-11-04T01:42:39.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.865+0000 7f9a8a8c9640 1 -- 172.21.15.77:0/3473479089 shutdown_connections 2023-11-04T01:42:39.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.865+0000 7f9a8a8c9640 1 --2- 172.21.15.77:0/3473479089 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9a8406db20 0x7f9a840b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.865+0000 7f9a8a8c9640 1 --2- 172.21.15.77:0/3473479089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a84159c70 0x7f9a840ce370 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.865+0000 7f9a8a8c9640 1 -- 172.21.15.77:0/3473479089 >> 172.21.15.77:0/3473479089 conn(0x7f9a840ce950 msgr2=0x7f9a840ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:39.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.865+0000 7f9a8a8c9640 1 -- 172.21.15.77:0/3473479089 shutdown_connections 2023-11-04T01:42:39.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.865+0000 7f9a8a8c9640 1 -- 172.21.15.77:0/3473479089 wait complete. 2023-11-04T01:42:39.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.866+0000 7f9a8a8c9640 1 Processor -- start 2023-11-04T01:42:39.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.866+0000 7f9a8a8c9640 1 -- start start 2023-11-04T01:42:39.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.867+0000 7f9a8a8c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a8406db20 0x7f9a840af200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.867+0000 7f9a8a8c9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a840b0910 0x7f9a841454e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.867+0000 7f9a8a8c9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9a84159c70 0x7f9a841f5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.867+0000 7f9a8a8c9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a840af740 con 0x7f9a8406db20 2023-11-04T01:42:39.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.867+0000 7f9a8a8c9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a841f6ee0 con 0x7f9a840b0910 2023-11-04T01:42:39.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.867+0000 7f9a8a8c9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a841f6920 con 0x7f9a84159c70 2023-11-04T01:42:39.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.867+0000 7f9a83fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a8406db20 0x7f9a840af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.867+0000 7f9a83fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a8406db20 0x7f9a840af200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59144/0 (socket says 172.21.15.77:59144) 2023-11-04T01:42:39.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.867+0000 7f9a83fff640 1 -- 172.21.15.77:0/1916238836 learned_addr learned my addr 172.21.15.77:0/1916238836 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:39.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.867+0000 7f9a88e66640 1 --2- 172.21.15.77:0/1916238836 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9a84159c70 0x7f9a841f5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.867+0000 7f9a837fe640 1 --2- 172.21.15.77:0/1916238836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a840b0910 0x7f9a841454e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.867+0000 7f9a83fff640 1 -- 172.21.15.77:0/1916238836 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9a84159c70 msgr2=0x7f9a841f5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.867+0000 7f9a83fff640 1 --2- 172.21.15.77:0/1916238836 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9a84159c70 0x7f9a841f5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.867+0000 7f9a83fff640 1 -- 172.21.15.77:0/1916238836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a840b0910 msgr2=0x7f9a841454e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.867+0000 7f9a83fff640 1 --2- 172.21.15.77:0/1916238836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a840b0910 0x7f9a841454e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.867+0000 7f9a83fff640 1 -- 172.21.15.77:0/1916238836 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a740094d0 con 0x7f9a8406db20 2023-11-04T01:42:39.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.867+0000 7f9a83fff640 1 --2- 172.21.15.77:0/1916238836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a8406db20 0x7f9a840af200 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f9a74000c00 tx=0x7f9a74004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:39.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.868+0000 7f9a80ff9640 1 -- 172.21.15.77:0/1916238836 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a74039c90 con 0x7f9a8406db20 2023-11-04T01:42:39.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.868+0000 7f9a80ff9640 1 -- 172.21.15.77:0/1916238836 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a74039df0 con 0x7f9a8406db20 2023-11-04T01:42:39.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.868+0000 7f9a8a8c9640 1 -- 172.21.15.77:0/1916238836 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a841f6c00 con 0x7f9a8406db20 2023-11-04T01:42:39.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.868+0000 7f9a80ff9640 1 -- 172.21.15.77:0/1916238836 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a74043640 con 0x7f9a8406db20 2023-11-04T01:42:39.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.868+0000 7f9a8a8c9640 1 -- 172.21.15.77:0/1916238836 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a84144fc0 con 0x7f9a8406db20 2023-11-04T01:42:39.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.869+0000 7f9a8a8c9640 1 -- 172.21.15.77:0/1916238836 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a84074290 con 0x7f9a8406db20 2023-11-04T01:42:39.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.869+0000 7f9a80ff9640 1 -- 172.21.15.77:0/1916238836 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9a740437a0 con 0x7f9a8406db20 2023-11-04T01:42:39.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.869+0000 7f9a80ff9640 1 --2- 172.21.15.77:0/1916238836 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9a7006ae70 0x7f9a7006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.869+0000 7f9a80ff9640 1 -- 172.21.15.77:0/1916238836 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f9a7403e070 con 0x7f9a8406db20 2023-11-04T01:42:39.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.870+0000 7f9a837fe640 1 --2- 172.21.15.77:0/1916238836 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9a7006ae70 0x7f9a7006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.870+0000 7f9a837fe640 1 --2- 172.21.15.77:0/1916238836 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9a7006ae70 0x7f9a7006d330 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9a78006fd0 tx=0x7f9a78008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:39.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:39.873+0000 7f9a80ff9640 1 -- 172.21.15.77:0/1916238836 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9a740777b0 con 0x7f9a8406db20 2023-11-04T01:42:40.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.071+0000 7f9a8a8c9640 1 -- 172.21.15.77:0/1916238836 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a8406d3f0 con 0x7f9a8406db20 2023-11-04T01:42:40.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.072+0000 7f9a80ff9640 1 -- 172.21.15.77:0/1916238836 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f9a7407add0 con 0x7f9a8406db20 2023-11-04T01:42:40.074 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:40.074 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6396,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/20625239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":20625239},{"type":"v1","addr":"172.21.15.77:6834","nonce":20625239}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6399,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3909793035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3909793035},{"type":"v1","addr":"172.21.15.77:6835","nonce":3909793035}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":35252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/1714919040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1714919040},{"type":"v1","addr":"172.21.15.122:6836","nonce":1714919040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:42:23.999994+0000","modified":"2023-11-04T01:42:26.916361+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":35255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35255":{"gid":35255,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/1606545578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1606545578},{"type":"v1","addr":"172.21.15.122:6837","nonce":1606545578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-04T01:42:40.075 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 29 2023-11-04T01:42:40.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.074+0000 7f9a8a8c9640 1 -- 172.21.15.77:0/1916238836 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9a7006ae70 msgr2=0x7f9a7006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.074+0000 7f9a8a8c9640 1 --2- 172.21.15.77:0/1916238836 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9a7006ae70 0x7f9a7006d330 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9a78006fd0 tx=0x7f9a78008040 comp rx=0 tx=0).stop 2023-11-04T01:42:40.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.074+0000 7f9a8a8c9640 1 -- 172.21.15.77:0/1916238836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a8406db20 msgr2=0x7f9a840af200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.074+0000 7f9a8a8c9640 1 --2- 172.21.15.77:0/1916238836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a8406db20 0x7f9a840af200 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f9a74000c00 tx=0x7f9a74004730 comp rx=0 tx=0).stop 2023-11-04T01:42:40.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.074+0000 7f9a8a8c9640 1 -- 172.21.15.77:0/1916238836 shutdown_connections 2023-11-04T01:42:40.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.074+0000 7f9a8a8c9640 1 --2- 172.21.15.77:0/1916238836 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9a7006ae70 0x7f9a7006d330 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.074+0000 7f9a8a8c9640 1 --2- 172.21.15.77:0/1916238836 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9a84159c70 0x7f9a841f5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.074+0000 7f9a8a8c9640 1 --2- 172.21.15.77:0/1916238836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a840b0910 0x7f9a841454e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.074+0000 7f9a8a8c9640 1 --2- 172.21.15.77:0/1916238836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a8406db20 0x7f9a840af200 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.074+0000 7f9a8a8c9640 1 -- 172.21.15.77:0/1916238836 >> 172.21.15.77:0/1916238836 conn(0x7f9a840ce950 msgr2=0x7f9a840b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:40.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.074+0000 7f9a8a8c9640 1 -- 172.21.15.77:0/1916238836 shutdown_connections 2023-11-04T01:42:40.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.074+0000 7f9a8a8c9640 1 -- 172.21.15.77:0/1916238836 wait complete. 2023-11-04T01:42:40.086 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:40.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.185+0000 7fa76dea9640 1 Processor -- start 2023-11-04T01:42:40.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.185+0000 7fa76dea9640 1 -- start start 2023-11-04T01:42:40.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.185+0000 7fa76dea9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa7680cde60 0x7fa76815d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.185+0000 7fa76dea9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa76815daa0 0x7fa768157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.186+0000 7fa76dea9640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa76815e000 con 0x7fa7680ce240 2023-11-04T01:42:40.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.186+0000 7fa76dea9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa76815e5c0 con 0x7fa76815daa0 2023-11-04T01:42:40.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.186+0000 7fa76dea9640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa76815e2e0 con 0x7fa7680cde60 2023-11-04T01:42:40.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.186+0000 7fa75ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa76815daa0 0x7fa768157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.186+0000 7fa75ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa76815daa0 0x7fa768157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59148/0 (socket says 172.21.15.77:59148) 2023-11-04T01:42:40.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.186+0000 7fa75ffff640 1 -- 172.21.15.77:0/3976605151 learned_addr learned my addr 172.21.15.77:0/3976605151 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:40.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.186+0000 7fa7677fe640 1 --2- 172.21.15.77:0/3976605151 >> v2:172.21.15.122:3300/0 conn(0x7fa7680cde60 0x7fa76815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.186+0000 7fa75ffff640 1 -- 172.21.15.77:0/3976605151 >> v2:172.21.15.122:3300/0 conn(0x7fa7680cde60 msgr2=0x7fa76815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:40.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.186+0000 7fa75ffff640 1 --2- 172.21.15.77:0/3976605151 >> v2:172.21.15.122:3300/0 conn(0x7fa7680cde60 0x7fa76815d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.186+0000 7fa75ffff640 1 -- 172.21.15.77:0/3976605151 >> v1:172.21.15.122:6789/0 conn(0x7fa7680ce240 legacy=0x7fa76806b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:40.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.186+0000 7fa75ffff640 1 -- 172.21.15.77:0/3976605151 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7680d1120 con 0x7fa76815daa0 2023-11-04T01:42:40.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.187+0000 7fa75ffff640 1 --2- 172.21.15.77:0/3976605151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa76815daa0 0x7fa768157000 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fa7680b5550 tx=0x7fa75002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ca46482c72d952 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.187+0000 7fa766ffd640 1 -- 172.21.15.77:0/3976605151 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa750031870 con 0x7fa76815daa0 2023-11-04T01:42:40.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.187+0000 7fa766ffd640 1 -- 172.21.15.77:0/3976605151 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7500319d0 con 0x7fa76815daa0 2023-11-04T01:42:40.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.187+0000 7fa766ffd640 1 -- 172.21.15.77:0/3976605151 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa750031d60 con 0x7fa76815daa0 2023-11-04T01:42:40.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.187+0000 7fa76dea9640 1 -- 172.21.15.77:0/3976605151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa76815daa0 msgr2=0x7fa768157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.187+0000 7fa76dea9640 1 --2- 172.21.15.77:0/3976605151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa76815daa0 0x7fa768157000 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fa7680b5550 tx=0x7fa75002b910 comp rx=0 tx=0).stop 2023-11-04T01:42:40.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.187+0000 7fa76dea9640 1 -- 172.21.15.77:0/3976605151 shutdown_connections 2023-11-04T01:42:40.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.187+0000 7fa76dea9640 1 --2- 172.21.15.77:0/3976605151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa76815daa0 0x7fa768157000 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.187+0000 7fa76dea9640 1 --2- 172.21.15.77:0/3976605151 >> v2:172.21.15.122:3300/0 conn(0x7fa7680cde60 0x7fa76815d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.187+0000 7fa76dea9640 1 -- 172.21.15.77:0/3976605151 >> 172.21.15.77:0/3976605151 conn(0x7fa768071f30 msgr2=0x7fa7680cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:40.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.187+0000 7fa76dea9640 1 -- 172.21.15.77:0/3976605151 shutdown_connections 2023-11-04T01:42:40.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.187+0000 7fa76dea9640 1 -- 172.21.15.77:0/3976605151 wait complete. 2023-11-04T01:42:40.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.189+0000 7fa76dea9640 1 Processor -- start 2023-11-04T01:42:40.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.189+0000 7fa76dea9640 1 -- start start 2023-11-04T01:42:40.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.189+0000 7fa76dea9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7680cde60 0x7fa76814d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.189+0000 7fa76dea9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7680ce240 0x7fa768152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.189+0000 7fa76dea9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa76815daa0 0x7fa768152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.189+0000 7fa76dea9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7680c9ef0 con 0x7fa7680cde60 2023-11-04T01:42:40.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.189+0000 7fa76dea9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7680ca1d0 con 0x7fa76815daa0 2023-11-04T01:42:40.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.189+0000 7fa76dea9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa768151fb0 con 0x7fa7680ce240 2023-11-04T01:42:40.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.189+0000 7fa7677fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7680cde60 0x7fa76814d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.189+0000 7fa7677fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7680cde60 0x7fa76814d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59158/0 (socket says 172.21.15.77:59158) 2023-11-04T01:42:40.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.189+0000 7fa7677fe640 1 -- 172.21.15.77:0/676745408 learned_addr learned my addr 172.21.15.77:0/676745408 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:40.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.190+0000 7fa7677fe640 1 -- 172.21.15.77:0/676745408 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7680ce240 msgr2=0x7fa768152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.190+0000 7fa7677fe640 1 --2- 172.21.15.77:0/676745408 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7680ce240 0x7fa768152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.190+0000 7fa7677fe640 1 -- 172.21.15.77:0/676745408 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa76815daa0 msgr2=0x7fa768152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.190+0000 7fa767fff640 1 --2- 172.21.15.77:0/676745408 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa76815daa0 0x7fa768152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.190+0000 7fa7677fe640 1 --2- 172.21.15.77:0/676745408 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa76815daa0 0x7fa768152bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.190+0000 7fa7677fe640 1 -- 172.21.15.77:0/676745408 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7500094d0 con 0x7fa7680cde60 2023-11-04T01:42:40.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.190+0000 7fa7677fe640 1 --2- 172.21.15.77:0/676745408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7680cde60 0x7fa76814d2f0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fa75800d800 tx=0x7fa75800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.190+0000 7fa764ff9640 1 -- 172.21.15.77:0/676745408 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75800b6c0 con 0x7fa7680cde60 2023-11-04T01:42:40.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.190+0000 7fa764ff9640 1 -- 172.21.15.77:0/676745408 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75800b820 con 0x7fa7680cde60 2023-11-04T01:42:40.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.190+0000 7fa76dea9640 1 -- 172.21.15.77:0/676745408 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa768152290 con 0x7fa7680cde60 2023-11-04T01:42:40.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.190+0000 7fa764ff9640 1 -- 172.21.15.77:0/676745408 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75800bbb0 con 0x7fa7680cde60 2023-11-04T01:42:40.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.190+0000 7fa76dea9640 1 -- 172.21.15.77:0/676745408 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa76814d830 con 0x7fa7680cde60 2023-11-04T01:42:40.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.191+0000 7fa76dea9640 1 -- 172.21.15.77:0/676745408 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa768151e10 con 0x7fa7680cde60 2023-11-04T01:42:40.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.191+0000 7fa764ff9640 1 -- 172.21.15.77:0/676745408 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa75800bd10 con 0x7fa7680cde60 2023-11-04T01:42:40.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.192+0000 7fa764ff9640 1 --2- 172.21.15.77:0/676745408 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa74806ae70 0x7fa74806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.192+0000 7fa764ff9640 1 -- 172.21.15.77:0/676745408 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7148+0+0 (secure 0 0 0) 0x7fa75808a150 con 0x7fa7680cde60 2023-11-04T01:42:40.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.192+0000 7fa75ffff640 1 --2- 172.21.15.77:0/676745408 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa74806ae70 0x7fa74806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.193+0000 7fa75ffff640 1 --2- 172.21.15.77:0/676745408 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa74806ae70 0x7fa74806d330 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa750036000 tx=0x7fa750030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.196+0000 7fa764ff9640 1 -- 172.21.15.77:0/676745408 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa768151e10 con 0x7fa7680cde60 2023-11-04T01:42:40.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.363+0000 7fa76dea9640 1 -- 172.21.15.77:0/676745408 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa768151e10 con 0x7fa7680cde60 2023-11-04T01:42:40.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.364+0000 7fa764ff9640 1 -- 172.21.15.77:0/676745408 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+22089 (secure 0 0 0) 0x7fa768151e10 con 0x7fa7680cde60 2023-11-04T01:42:40.367 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:40.367 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":70,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:42:36.334157+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:22.500204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:22.966681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:33.159064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:33.647358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":12,"snaps":[{"begin":1,"length":1}]}],"new_removed_snaps":[{"pool":12,"snaps":[{"begin":1,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:40.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.366+0000 7fa76dea9640 1 -- 172.21.15.77:0/676745408 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa74806ae70 msgr2=0x7fa74806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.366+0000 7fa76dea9640 1 --2- 172.21.15.77:0/676745408 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa74806ae70 0x7fa74806d330 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa750036000 tx=0x7fa750030000 comp rx=0 tx=0).stop 2023-11-04T01:42:40.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.366+0000 7fa76dea9640 1 -- 172.21.15.77:0/676745408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7680cde60 msgr2=0x7fa76814d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.366+0000 7fa76dea9640 1 --2- 172.21.15.77:0/676745408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7680cde60 0x7fa76814d2f0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fa75800d800 tx=0x7fa75800dcc0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.366+0000 7fa76dea9640 1 -- 172.21.15.77:0/676745408 shutdown_connections 2023-11-04T01:42:40.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.366+0000 7fa76dea9640 1 --2- 172.21.15.77:0/676745408 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa74806ae70 0x7fa74806d330 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.366+0000 7fa76dea9640 1 --2- 172.21.15.77:0/676745408 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa76815daa0 0x7fa768152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.366+0000 7fa76dea9640 1 --2- 172.21.15.77:0/676745408 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7680ce240 0x7fa768152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.366+0000 7fa76dea9640 1 --2- 172.21.15.77:0/676745408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7680cde60 0x7fa76814d2f0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.366+0000 7fa76dea9640 1 -- 172.21.15.77:0/676745408 >> 172.21.15.77:0/676745408 conn(0x7fa768071f30 msgr2=0x7fa7680b7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:40.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.366+0000 7fa76dea9640 1 -- 172.21.15.77:0/676745408 shutdown_connections 2023-11-04T01:42:40.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.366+0000 7fa76dea9640 1 -- 172.21.15.77:0/676745408 wait complete. 2023-11-04T01:42:40.379 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:33.142176+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:42:22.500204+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:42:22.966681+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:42:33.159064+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:42:33.647358+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:42:40.380 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:42:40.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.481+0000 7f1d4e1ee640 1 Processor -- start 2023-11-04T01:42:40.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.481+0000 7f1d4e1ee640 1 -- start start 2023-11-04T01:42:40.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.481+0000 7f1d4e1ee640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1d48070e20 0x7f1d480adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.481+0000 7f1d4e1ee640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1d480ad730 0x7f1d4815e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.481+0000 7f1d4e1ee640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d480c3900 con 0x7f1d4815ad30 2023-11-04T01:42:40.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.481+0000 7f1d4e1ee640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d480ae260 con 0x7f1d48070e20 2023-11-04T01:42:40.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.481+0000 7f1d4e1ee640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d480c3be0 con 0x7f1d480ad730 2023-11-04T01:42:40.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.481+0000 7f1d46ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1d48070e20 0x7f1d480adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.482+0000 7f1d46ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1d48070e20 0x7f1d480adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59170/0 (socket says 172.21.15.77:59170) 2023-11-04T01:42:40.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.482+0000 7f1d46ffd640 1 -- 172.21.15.77:0/220089817 learned_addr learned my addr 172.21.15.77:0/220089817 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:40.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.482+0000 7f1d47fff640 1 --2- 172.21.15.77:0/220089817 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1d480ad730 0x7f1d4815e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.482+0000 7f1d46ffd640 1 -- 172.21.15.77:0/220089817 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1d480ad730 msgr2=0x7f1d4815e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:40.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.482+0000 7f1d46ffd640 1 --2- 172.21.15.77:0/220089817 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1d480ad730 0x7f1d4815e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.482+0000 7f1d46ffd640 1 -- 172.21.15.77:0/220089817 >> v1:172.21.15.122:6789/0 conn(0x7f1d4815ad30 legacy=0x7f1d48070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:40.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.482+0000 7f1d46ffd640 1 -- 172.21.15.77:0/220089817 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d480c3ec0 con 0x7f1d48070e20 2023-11-04T01:42:40.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.482+0000 7f1d46ffd640 1 --2- 172.21.15.77:0/220089817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d48070e20 0x7f1d480adc80 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009870 tx=0x7f1d3c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee2ba7d92f86562a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.483+0000 7f1d467fc640 1 -- 172.21.15.77:0/220089817 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c0317c0 con 0x7f1d48070e20 2023-11-04T01:42:40.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.483+0000 7f1d467fc640 1 -- 172.21.15.77:0/220089817 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3c031920 con 0x7f1d48070e20 2023-11-04T01:42:40.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.483+0000 7f1d467fc640 1 -- 172.21.15.77:0/220089817 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c031cb0 con 0x7f1d48070e20 2023-11-04T01:42:40.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.483+0000 7f1d4e1ee640 1 -- 172.21.15.77:0/220089817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d48070e20 msgr2=0x7f1d480adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.483+0000 7f1d4e1ee640 1 --2- 172.21.15.77:0/220089817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d48070e20 0x7f1d480adc80 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009870 tx=0x7f1d3c02b860 comp rx=0 tx=0).stop 2023-11-04T01:42:40.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.483+0000 7f1d4e1ee640 1 -- 172.21.15.77:0/220089817 shutdown_connections 2023-11-04T01:42:40.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.483+0000 7f1d4e1ee640 1 --2- 172.21.15.77:0/220089817 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1d480ad730 0x7f1d4815e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.483+0000 7f1d4e1ee640 1 --2- 172.21.15.77:0/220089817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d48070e20 0x7f1d480adc80 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.483+0000 7f1d4e1ee640 1 -- 172.21.15.77:0/220089817 >> 172.21.15.77:0/220089817 conn(0x7f1d480ce950 msgr2=0x7f1d480ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:40.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.483+0000 7f1d4e1ee640 1 -- 172.21.15.77:0/220089817 shutdown_connections 2023-11-04T01:42:40.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.483+0000 7f1d4e1ee640 1 -- 172.21.15.77:0/220089817 wait complete. 2023-11-04T01:42:40.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.484+0000 7f1d4e1ee640 1 Processor -- start 2023-11-04T01:42:40.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.485+0000 7f1d4e1ee640 1 -- start start 2023-11-04T01:42:40.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.485+0000 7f1d4e1ee640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d48070e20 0x7f1d48156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.485+0000 7f1d4e1ee640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d480ad730 0x7f1d4815c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.485+0000 7f1d4e1ee640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1d4815ad30 0x7f1d481f31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.485+0000 7f1d4e1ee640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d48157510 con 0x7f1d48070e20 2023-11-04T01:42:40.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.485+0000 7f1d4e1ee640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d48155f30 con 0x7f1d480ad730 2023-11-04T01:42:40.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.485+0000 7f1d4e1ee640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d48156210 con 0x7f1d4815ad30 2023-11-04T01:42:40.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.485+0000 7f1d477fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d48070e20 0x7f1d48156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.485+0000 7f1d477fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d48070e20 0x7f1d48156fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59184/0 (socket says 172.21.15.77:59184) 2023-11-04T01:42:40.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.485+0000 7f1d477fe640 1 -- 172.21.15.77:0/1585397850 learned_addr learned my addr 172.21.15.77:0/1585397850 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:40.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.485+0000 7f1d47fff640 1 --2- 172.21.15.77:0/1585397850 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1d4815ad30 0x7f1d481f31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.485+0000 7f1d46ffd640 1 --2- 172.21.15.77:0/1585397850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d480ad730 0x7f1d4815c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.486+0000 7f1d477fe640 1 -- 172.21.15.77:0/1585397850 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1d4815ad30 msgr2=0x7f1d481f31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.486+0000 7f1d477fe640 1 --2- 172.21.15.77:0/1585397850 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1d4815ad30 0x7f1d481f31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.486+0000 7f1d477fe640 1 -- 172.21.15.77:0/1585397850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d480ad730 msgr2=0x7f1d4815c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.486+0000 7f1d477fe640 1 --2- 172.21.15.77:0/1585397850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d480ad730 0x7f1d4815c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.486+0000 7f1d477fe640 1 -- 172.21.15.77:0/1585397850 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3c0094d0 con 0x7f1d48070e20 2023-11-04T01:42:40.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.486+0000 7f1d47fff640 1 --2- 172.21.15.77:0/1585397850 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1d4815ad30 0x7f1d481f31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:40.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.486+0000 7f1d477fe640 1 --2- 172.21.15.77:0/1585397850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d48070e20 0x7f1d48156fd0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f1d3800b3e0 tx=0x7f1d3800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.486+0000 7f1d2ffff640 1 -- 172.21.15.77:0/1585397850 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d38011830 con 0x7f1d48070e20 2023-11-04T01:42:40.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.486+0000 7f1d2ffff640 1 -- 172.21.15.77:0/1585397850 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d380119b0 con 0x7f1d48070e20 2023-11-04T01:42:40.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.486+0000 7f1d4e1ee640 1 -- 172.21.15.77:0/1585397850 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d481564f0 con 0x7f1d48070e20 2023-11-04T01:42:40.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.486+0000 7f1d2ffff640 1 -- 172.21.15.77:0/1585397850 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d38011d60 con 0x7f1d48070e20 2023-11-04T01:42:40.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.486+0000 7f1d4e1ee640 1 -- 172.21.15.77:0/1585397850 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d48156ab0 con 0x7f1d48070e20 2023-11-04T01:42:40.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.487+0000 7f1d4e1ee640 1 -- 172.21.15.77:0/1585397850 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d48156ca0 con 0x7f1d48070e20 2023-11-04T01:42:40.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.487+0000 7f1d2ffff640 1 -- 172.21.15.77:0/1585397850 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1d3801a400 con 0x7f1d48070e20 2023-11-04T01:42:40.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.488+0000 7f1d2ffff640 1 --2- 172.21.15.77:0/1585397850 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1d3406ae70 0x7f1d3406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.488+0000 7f1d2ffff640 1 -- 172.21.15.77:0/1585397850 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f1d38089d20 con 0x7f1d48070e20 2023-11-04T01:42:40.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.488+0000 7f1d46ffd640 1 --2- 172.21.15.77:0/1585397850 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1d3406ae70 0x7f1d3406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.488+0000 7f1d46ffd640 1 --2- 172.21.15.77:0/1585397850 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1d3406ae70 0x7f1d3406d330 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c036000 tx=0x7f1d3c03d040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.492+0000 7f1d2ffff640 1 -- 172.21.15.77:0/1585397850 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1d38054830 con 0x7f1d48070e20 2023-11-04T01:42:40.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.663+0000 7f1d4e1ee640 1 -- 172.21.15.77:0/1585397850 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1d48074290 con 0x7f1d48070e20 2023-11-04T01:42:40.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.663+0000 7f1d2ffff640 1 -- 172.21.15.77:0/1585397850 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1d38015020 con 0x7f1d48070e20 2023-11-04T01:42:40.666 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:42:40.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.665+0000 7f1d4e1ee640 1 -- 172.21.15.77:0/1585397850 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1d3406ae70 msgr2=0x7f1d3406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.665+0000 7f1d4e1ee640 1 --2- 172.21.15.77:0/1585397850 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1d3406ae70 0x7f1d3406d330 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c036000 tx=0x7f1d3c03d040 comp rx=0 tx=0).stop 2023-11-04T01:42:40.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.665+0000 7f1d4e1ee640 1 -- 172.21.15.77:0/1585397850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d48070e20 msgr2=0x7f1d48156fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.665+0000 7f1d4e1ee640 1 --2- 172.21.15.77:0/1585397850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d48070e20 0x7f1d48156fd0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f1d3800b3e0 tx=0x7f1d3800b8a0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.665+0000 7f1d4e1ee640 1 -- 172.21.15.77:0/1585397850 shutdown_connections 2023-11-04T01:42:40.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.665+0000 7f1d4e1ee640 1 --2- 172.21.15.77:0/1585397850 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1d3406ae70 0x7f1d3406d330 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.665+0000 7f1d4e1ee640 1 --2- 172.21.15.77:0/1585397850 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1d4815ad30 0x7f1d481f31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.665+0000 7f1d4e1ee640 1 --2- 172.21.15.77:0/1585397850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d480ad730 0x7f1d4815c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.665+0000 7f1d4e1ee640 1 --2- 172.21.15.77:0/1585397850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d48070e20 0x7f1d48156fd0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.665+0000 7f1d4e1ee640 1 -- 172.21.15.77:0/1585397850 >> 172.21.15.77:0/1585397850 conn(0x7f1d480ce950 msgr2=0x7f1d480c9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:40.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.666+0000 7f1d4e1ee640 1 -- 172.21.15.77:0/1585397850 shutdown_connections 2023-11-04T01:42:40.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.666+0000 7f1d4e1ee640 1 -- 172.21.15.77:0/1585397850 wait complete. 2023-11-04T01:42:40.678 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:42:40.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.779+0000 7f0adc3ee640 1 Processor -- start 2023-11-04T01:42:40.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.779+0000 7f0adc3ee640 1 -- start start 2023-11-04T01:42:40.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.780+0000 7f0adc3ee640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0ad41605b0 0x7f0ad40ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.780+0000 7f0adc3ee640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0ad40b1a40 0x7f0ad406a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.780+0000 7f0adc3ee640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ad4160990 con 0x7f0ad40ca560 2023-11-04T01:42:40.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.780+0000 7f0adc3ee640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ad40cc7c0 con 0x7f0ad40b1a40 2023-11-04T01:42:40.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.780+0000 7f0adc3ee640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad40cd750 con 0x7f0ad41605b0 2023-11-04T01:42:40.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.780+0000 7f0ad9989640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0ad40b1a40 0x7f0ad406a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.780+0000 7f0ad9989640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0ad40b1a40 0x7f0ad406a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59190/0 (socket says 172.21.15.77:59190) 2023-11-04T01:42:40.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.780+0000 7f0ad9989640 1 -- 172.21.15.77:0/1187797915 learned_addr learned my addr 172.21.15.77:0/1187797915 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:40.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.781+0000 7f0ada18a640 1 --2- 172.21.15.77:0/1187797915 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0ad41605b0 0x7f0ad40ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.781+0000 7f0ad9989640 1 -- 172.21.15.77:0/1187797915 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0ad41605b0 msgr2=0x7f0ad40ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:40.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.781+0000 7f0ad9989640 1 --2- 172.21.15.77:0/1187797915 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0ad41605b0 0x7f0ad40ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.781+0000 7f0ad9989640 1 -- 172.21.15.77:0/1187797915 >> v1:172.21.15.122:6789/0 conn(0x7f0ad40ca560 legacy=0x7f0ad4160be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:40.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.781+0000 7f0ad9989640 1 -- 172.21.15.77:0/1187797915 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad40cc4e0 con 0x7f0ad40b1a40 2023-11-04T01:42:40.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.781+0000 7f0ad9989640 1 --2- 172.21.15.77:0/1187797915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ad40b1a40 0x7f0ad406a120 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0009870 tx=0x7f0ad002b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53105d5a6281a776 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.782+0000 7f0ad9188640 1 -- 172.21.15.77:0/1187797915 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0031740 con 0x7f0ad40b1a40 2023-11-04T01:42:40.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.782+0000 7f0ad9188640 1 -- 172.21.15.77:0/1187797915 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad00318a0 con 0x7f0ad40b1a40 2023-11-04T01:42:40.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.782+0000 7f0ad9188640 1 -- 172.21.15.77:0/1187797915 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0031c30 con 0x7f0ad40b1a40 2023-11-04T01:42:40.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.782+0000 7f0adc3ee640 1 -- 172.21.15.77:0/1187797915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ad40b1a40 msgr2=0x7f0ad406a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.782+0000 7f0adc3ee640 1 --2- 172.21.15.77:0/1187797915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ad40b1a40 0x7f0ad406a120 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0009870 tx=0x7f0ad002b7e0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.782+0000 7f0adc3ee640 1 -- 172.21.15.77:0/1187797915 shutdown_connections 2023-11-04T01:42:40.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.782+0000 7f0adc3ee640 1 --2- 172.21.15.77:0/1187797915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ad40b1a40 0x7f0ad406a120 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.782+0000 7f0adc3ee640 1 --2- 172.21.15.77:0/1187797915 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0ad41605b0 0x7f0ad40ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.782+0000 7f0adc3ee640 1 -- 172.21.15.77:0/1187797915 >> 172.21.15.77:0/1187797915 conn(0x7f0ad4071820 msgr2=0x7f0ad4071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:40.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.782+0000 7f0adc3ee640 1 -- 172.21.15.77:0/1187797915 shutdown_connections 2023-11-04T01:42:40.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.782+0000 7f0adc3ee640 1 -- 172.21.15.77:0/1187797915 wait complete. 2023-11-04T01:42:40.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.783+0000 7f0adc3ee640 1 Processor -- start 2023-11-04T01:42:40.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.783+0000 7f0adc3ee640 1 -- start start 2023-11-04T01:42:40.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.784+0000 7f0adc3ee640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ad40ca560 0x7f0ad41f1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.784+0000 7f0adc3ee640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ad41605b0 0x7f0ad415cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.784+0000 7f0adc3ee640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0ad40ab8e0 0x7f0ad415d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.784+0000 7f0adc3ee640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad41f24b0 con 0x7f0ad40ca560 2023-11-04T01:42:40.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.784+0000 7f0adc3ee640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad41f2770 con 0x7f0ad41605b0 2023-11-04T01:42:40.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.784+0000 7f0adc3ee640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad41f2a50 con 0x7f0ad40ab8e0 2023-11-04T01:42:40.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.784+0000 7f0ada18a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ad40ca560 0x7f0ad41f1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.784+0000 7f0ada18a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ad40ca560 0x7f0ad41f1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59206/0 (socket says 172.21.15.77:59206) 2023-11-04T01:42:40.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.784+0000 7f0ada18a640 1 -- 172.21.15.77:0/4149118496 learned_addr learned my addr 172.21.15.77:0/4149118496 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:40.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.785+0000 7f0ada18a640 1 -- 172.21.15.77:0/4149118496 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0ad40ab8e0 msgr2=0x7f0ad415d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.785+0000 7f0ada18a640 1 --2- 172.21.15.77:0/4149118496 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0ad40ab8e0 0x7f0ad415d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.785+0000 7f0ada18a640 1 -- 172.21.15.77:0/4149118496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ad41605b0 msgr2=0x7f0ad415cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.785+0000 7f0ada18a640 1 --2- 172.21.15.77:0/4149118496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ad41605b0 0x7f0ad415cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.785+0000 7f0ada18a640 1 -- 172.21.15.77:0/4149118496 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad00094d0 con 0x7f0ad40ca560 2023-11-04T01:42:40.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.785+0000 7f0ada18a640 1 --2- 172.21.15.77:0/4149118496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ad40ca560 0x7f0ad41f1f70 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f0acc00ce10 tx=0x7f0acc00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.785+0000 7f0ac6ffd640 1 -- 172.21.15.77:0/4149118496 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0acc003b90 con 0x7f0ad40ca560 2023-11-04T01:42:40.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.785+0000 7f0ac6ffd640 1 -- 172.21.15.77:0/4149118496 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0acc003cf0 con 0x7f0ad40ca560 2023-11-04T01:42:40.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.785+0000 7f0adc3ee640 1 -- 172.21.15.77:0/4149118496 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad41f2d30 con 0x7f0ad40ca560 2023-11-04T01:42:40.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.785+0000 7f0ac6ffd640 1 -- 172.21.15.77:0/4149118496 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0acc003ea0 con 0x7f0ad40ca560 2023-11-04T01:42:40.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.785+0000 7f0adc3ee640 1 -- 172.21.15.77:0/4149118496 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad41f32f0 con 0x7f0ad40ca560 2023-11-04T01:42:40.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.786+0000 7f0adc3ee640 1 -- 172.21.15.77:0/4149118496 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ad40672a0 con 0x7f0ad40ca560 2023-11-04T01:42:40.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.786+0000 7f0ac6ffd640 1 -- 172.21.15.77:0/4149118496 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0acc004240 con 0x7f0ad40ca560 2023-11-04T01:42:40.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.787+0000 7f0ac6ffd640 1 --2- 172.21.15.77:0/4149118496 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0ab806ae70 0x7f0ab806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.787+0000 7f0ac6ffd640 1 -- 172.21.15.77:0/4149118496 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f0acc012070 con 0x7f0ad40ca560 2023-11-04T01:42:40.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.787+0000 7f0ad9989640 1 --2- 172.21.15.77:0/4149118496 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0ab806ae70 0x7f0ab806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.787+0000 7f0ad9989640 1 --2- 172.21.15.77:0/4149118496 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0ab806ae70 0x7f0ab806d330 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0035000 tx=0x7f0ad0030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.791+0000 7f0ac6ffd640 1 -- 172.21.15.77:0/4149118496 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0acc055120 con 0x7f0ad40ca560 2023-11-04T01:42:40.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.960+0000 7f0adc3ee640 1 -- 172.21.15.77:0/4149118496 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f0ad4074290 con 0x7f0ad40ca560 2023-11-04T01:42:40.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.960+0000 7f0ac6ffd640 1 -- 172.21.15.77:0/4149118496 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v71) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0acc058740 con 0x7f0ad40ca560 2023-11-04T01:42:40.962 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:42:40.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.962+0000 7f0adc3ee640 1 -- 172.21.15.77:0/4149118496 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0ab806ae70 msgr2=0x7f0ab806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.962+0000 7f0adc3ee640 1 --2- 172.21.15.77:0/4149118496 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0ab806ae70 0x7f0ab806d330 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0035000 tx=0x7f0ad0030000 comp rx=0 tx=0).stop 2023-11-04T01:42:40.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.962+0000 7f0adc3ee640 1 -- 172.21.15.77:0/4149118496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ad40ca560 msgr2=0x7f0ad41f1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.962+0000 7f0adc3ee640 1 --2- 172.21.15.77:0/4149118496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ad40ca560 0x7f0ad41f1f70 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f0acc00ce10 tx=0x7f0acc00a660 comp rx=0 tx=0).stop 2023-11-04T01:42:40.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.962+0000 7f0adc3ee640 1 -- 172.21.15.77:0/4149118496 shutdown_connections 2023-11-04T01:42:40.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.962+0000 7f0adc3ee640 1 --2- 172.21.15.77:0/4149118496 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0ab806ae70 0x7f0ab806d330 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.962+0000 7f0adc3ee640 1 --2- 172.21.15.77:0/4149118496 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0ad40ab8e0 0x7f0ad415d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.962+0000 7f0adc3ee640 1 --2- 172.21.15.77:0/4149118496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0ad41605b0 0x7f0ad415cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.962+0000 7f0adc3ee640 1 --2- 172.21.15.77:0/4149118496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ad40ca560 0x7f0ad41f1f70 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.962+0000 7f0adc3ee640 1 -- 172.21.15.77:0/4149118496 >> 172.21.15.77:0/4149118496 conn(0x7f0ad4071820 msgr2=0x7f0ad40af9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:40.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.962+0000 7f0adc3ee640 1 -- 172.21.15.77:0/4149118496 shutdown_connections 2023-11-04T01:42:40.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:40.962+0000 7f0adc3ee640 1 -- 172.21.15.77:0/4149118496 wait complete. 2023-11-04T01:42:40.974 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:42:41.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.075+0000 7f378c094640 1 Processor -- start 2023-11-04T01:42:41.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.075+0000 7f378c094640 1 -- start start 2023-11-04T01:42:41.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.076+0000 7f378c094640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3784153e60 0x7f378415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.076+0000 7f378c094640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f37840cd6d0 0x7f3784161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.076+0000 7f378c094640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37840cde60 con 0x7f37840b4880 2023-11-04T01:42:41.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.076+0000 7f378c094640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3784160f90 con 0x7f3784153e60 2023-11-04T01:42:41.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.076+0000 7f378c094640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f378415e400 con 0x7f37840cd6d0 2023-11-04T01:42:41.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.077+0000 7f3789e30640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3784153e60 0x7f378415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.077+0000 7f378962f640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f37840cd6d0 0x7f3784161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.077+0000 7f3789e30640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3784153e60 0x7f378415dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:39056/0 (socket says 172.21.15.77:39056) 2023-11-04T01:42:41.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.077+0000 7f378962f640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f37840cd6d0 0x7f3784161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:49500/0 (socket says 172.21.15.77:49500) 2023-11-04T01:42:41.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.077+0000 7f3789e30640 1 -- 172.21.15.77:0/3103495250 learned_addr learned my addr 172.21.15.77:0/3103495250 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:41.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.077+0000 7f378a631640 1 --1- 172.21.15.77:0/3103495250 >> v1:172.21.15.122:6789/0 conn(0x7f37840b4880 0x7f37840b4ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:46668/0 (socket says 172.21.15.77:46668) 2023-11-04T01:42:41.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.077+0000 7f3789e30640 1 -- 172.21.15.77:0/3103495250 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f37840cd6d0 msgr2=0x7f3784161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:41.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.077+0000 7f3789e30640 1 --2- 172.21.15.77:0/3103495250 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f37840cd6d0 0x7f3784161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.077+0000 7f3789e30640 1 -- 172.21.15.77:0/3103495250 >> v1:172.21.15.122:6789/0 conn(0x7f37840b4880 legacy=0x7f37840b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.077+0000 7f3789e30640 1 -- 172.21.15.77:0/3103495250 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3784161960 con 0x7f3784153e60 2023-11-04T01:42:41.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.077+0000 7f378962f640 1 --2- 172.21.15.77:0/3103495250 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f37840cd6d0 0x7f3784161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:41.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.078+0000 7f3789e30640 1 --2- 172.21.15.77:0/3103495250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3784153e60 0x7f378415dec0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3774009e50 tx=0x7f377402bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a12e83c7e4e3e0b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.078+0000 7f3788e2e640 1 -- 172.21.15.77:0/3103495250 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377402caf0 con 0x7f3784153e60 2023-11-04T01:42:41.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.078+0000 7f3788e2e640 1 -- 172.21.15.77:0/3103495250 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377402cc50 con 0x7f3784153e60 2023-11-04T01:42:41.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.078+0000 7f3788e2e640 1 -- 172.21.15.77:0/3103495250 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37740343f0 con 0x7f3784153e60 2023-11-04T01:42:41.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.079+0000 7f378c094640 1 -- 172.21.15.77:0/3103495250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3784153e60 msgr2=0x7f378415dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.079+0000 7f378c094640 1 --2- 172.21.15.77:0/3103495250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3784153e60 0x7f378415dec0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3774009e50 tx=0x7f377402bf50 comp rx=0 tx=0).stop 2023-11-04T01:42:41.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.079+0000 7f378c094640 1 -- 172.21.15.77:0/3103495250 shutdown_connections 2023-11-04T01:42:41.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.079+0000 7f378c094640 1 --2- 172.21.15.77:0/3103495250 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f37840cd6d0 0x7f3784161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.079+0000 7f378c094640 1 --2- 172.21.15.77:0/3103495250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3784153e60 0x7f378415dec0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.079+0000 7f378c094640 1 -- 172.21.15.77:0/3103495250 >> 172.21.15.77:0/3103495250 conn(0x7f37840cf880 msgr2=0x7f37840cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:41.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.079+0000 7f378c094640 1 -- 172.21.15.77:0/3103495250 shutdown_connections 2023-11-04T01:42:41.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.079+0000 7f378c094640 1 -- 172.21.15.77:0/3103495250 wait complete. 2023-11-04T01:42:41.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.080+0000 7f378c094640 1 Processor -- start 2023-11-04T01:42:41.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.080+0000 7f378c094640 1 -- start start 2023-11-04T01:42:41.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.081+0000 7f378c094640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37840b4880 0x7f3784158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.081+0000 7f378c094640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f37840cd6d0 0x7f37840d1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.081+0000 7f378c094640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3784153e60 0x7f37840d1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.081+0000 7f378c094640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37840cc960 con 0x7f3784153e60 2023-11-04T01:42:41.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.081+0000 7f378c094640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37840cbd50 con 0x7f37840b4880 2023-11-04T01:42:41.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.081+0000 7f378c094640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37840cc030 con 0x7f37840cd6d0 2023-11-04T01:42:41.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.081+0000 7f378a631640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3784153e60 0x7f37840d1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.081+0000 7f378a631640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3784153e60 0x7f37840d1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59212/0 (socket says 172.21.15.77:59212) 2023-11-04T01:42:41.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.081+0000 7f378a631640 1 -- 172.21.15.77:0/2089341309 learned_addr learned my addr 172.21.15.77:0/2089341309 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:41.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.081+0000 7f3789e30640 1 --2- 172.21.15.77:0/2089341309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37840b4880 0x7f3784158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.081+0000 7f378962f640 1 --2- 172.21.15.77:0/2089341309 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f37840cd6d0 0x7f37840d1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.081+0000 7f378a631640 1 -- 172.21.15.77:0/2089341309 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f37840cd6d0 msgr2=0x7f37840d1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.081+0000 7f378a631640 1 --2- 172.21.15.77:0/2089341309 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f37840cd6d0 0x7f37840d1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.081+0000 7f378a631640 1 -- 172.21.15.77:0/2089341309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37840b4880 msgr2=0x7f3784158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.081+0000 7f378a631640 1 --2- 172.21.15.77:0/2089341309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37840b4880 0x7f3784158900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.081+0000 7f378a631640 1 -- 172.21.15.77:0/2089341309 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3778009400 con 0x7f3784153e60 2023-11-04T01:42:41.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.081+0000 7f378a631640 1 --2- 172.21.15.77:0/2089341309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3784153e60 0x7f37840d1880 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f377c00c400 tx=0x7f377c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.082+0000 7f37827fc640 1 -- 172.21.15.77:0/2089341309 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c0074e0 con 0x7f3784153e60 2023-11-04T01:42:41.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.082+0000 7f37827fc640 1 -- 172.21.15.77:0/2089341309 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377c007640 con 0x7f3784153e60 2023-11-04T01:42:41.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.082+0000 7f378c094640 1 -- 172.21.15.77:0/2089341309 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3774009b30 con 0x7f3784153e60 2023-11-04T01:42:41.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.082+0000 7f37827fc640 1 -- 172.21.15.77:0/2089341309 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c0049e0 con 0x7f3784153e60 2023-11-04T01:42:41.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.082+0000 7f378c094640 1 -- 172.21.15.77:0/2089341309 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37840cc5f0 con 0x7f3784153e60 2023-11-04T01:42:41.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.083+0000 7f378c094640 1 -- 172.21.15.77:0/2089341309 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37840ccad0 con 0x7f3784153e60 2023-11-04T01:42:41.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.083+0000 7f37827fc640 1 -- 172.21.15.77:0/2089341309 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f377c004b40 con 0x7f3784153e60 2023-11-04T01:42:41.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.083+0000 7f37827fc640 1 --2- 172.21.15.77:0/2089341309 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f377006ae70 0x7f377006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.083+0000 7f37827fc640 1 -- 172.21.15.77:0/2089341309 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f377c0894b0 con 0x7f3784153e60 2023-11-04T01:42:41.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.083+0000 7f3789e30640 1 --2- 172.21.15.77:0/2089341309 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f377006ae70 0x7f377006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.084+0000 7f3789e30640 1 --2- 172.21.15.77:0/2089341309 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f377006ae70 0x7f377006d330 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3774035000 tx=0x7f3774030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.087+0000 7f37827fc640 1 -- 172.21.15.77:0/2089341309 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f377c054000 con 0x7f3784153e60 2023-11-04T01:42:41.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.251+0000 7f378c094640 1 -- 172.21.15.77:0/2089341309 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3784074290 con 0x7f3784153e60 2023-11-04T01:42:41.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.252+0000 7f37827fc640 1 -- 172.21.15.77:0/2089341309 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v71) v1 ==== 104+0+11 (secure 0 0 0) 0x7f377c057620 con 0x7f3784153e60 2023-11-04T01:42:41.254 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:42:41.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.253+0000 7f378c094640 1 -- 172.21.15.77:0/2089341309 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f377006ae70 msgr2=0x7f377006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.253+0000 7f378c094640 1 --2- 172.21.15.77:0/2089341309 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f377006ae70 0x7f377006d330 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3774035000 tx=0x7f3774030000 comp rx=0 tx=0).stop 2023-11-04T01:42:41.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.253+0000 7f378c094640 1 -- 172.21.15.77:0/2089341309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3784153e60 msgr2=0x7f37840d1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.253+0000 7f378c094640 1 --2- 172.21.15.77:0/2089341309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3784153e60 0x7f37840d1880 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f377c00c400 tx=0x7f377c00c8c0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.253+0000 7f378c094640 1 -- 172.21.15.77:0/2089341309 shutdown_connections 2023-11-04T01:42:41.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.253+0000 7f378c094640 1 --2- 172.21.15.77:0/2089341309 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f377006ae70 0x7f377006d330 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.253+0000 7f378c094640 1 --2- 172.21.15.77:0/2089341309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3784153e60 0x7f37840d1880 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.253+0000 7f378c094640 1 --2- 172.21.15.77:0/2089341309 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f37840cd6d0 0x7f37840d1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.253+0000 7f378c094640 1 --2- 172.21.15.77:0/2089341309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37840b4880 0x7f3784158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.254+0000 7f378c094640 1 -- 172.21.15.77:0/2089341309 >> 172.21.15.77:0/2089341309 conn(0x7f37840cf880 msgr2=0x7f37840cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:41.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.254+0000 7f378c094640 1 -- 172.21.15.77:0/2089341309 shutdown_connections 2023-11-04T01:42:41.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.254+0000 7f378c094640 1 -- 172.21.15.77:0/2089341309 wait complete. 2023-11-04T01:42:41.266 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:42:41.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.366+0000 7f47e75c9640 1 Processor -- start 2023-11-04T01:42:41.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.366+0000 7f47e75c9640 1 -- start start 2023-11-04T01:42:41.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.367+0000 7f47e75c9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f47e015ad30 0x7f47e00adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.367+0000 7f47e75c9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f47e00ad730 0x7f47e0070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.367+0000 7f47e75c9640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e00c3900 con 0x7f47e0070c50 2023-11-04T01:42:41.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.367+0000 7f47e75c9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e00ae260 con 0x7f47e00ad730 2023-11-04T01:42:41.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.367+0000 7f47e75c9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e015f750 con 0x7f47e015ad30 2023-11-04T01:42:41.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.367+0000 7f47e4b64640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f47e00ad730 0x7f47e0070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.367+0000 7f47e4b64640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f47e00ad730 0x7f47e0070710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59220/0 (socket says 172.21.15.77:59220) 2023-11-04T01:42:41.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.367+0000 7f47e4b64640 1 -- 172.21.15.77:0/2902659923 learned_addr learned my addr 172.21.15.77:0/2902659923 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:41.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.367+0000 7f47e5365640 1 --2- 172.21.15.77:0/2902659923 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f47e015ad30 0x7f47e00adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.367+0000 7f47e4b64640 1 -- 172.21.15.77:0/2902659923 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f47e015ad30 msgr2=0x7f47e00adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:41.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.367+0000 7f47e4b64640 1 --2- 172.21.15.77:0/2902659923 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f47e015ad30 0x7f47e00adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.367+0000 7f47e4b64640 1 -- 172.21.15.77:0/2902659923 >> v1:172.21.15.122:6789/0 conn(0x7f47e0070c50 legacy=0x7f47e00c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:41.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.367+0000 7f47e4b64640 1 -- 172.21.15.77:0/2902659923 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e00c3be0 con 0x7f47e00ad730 2023-11-04T01:42:41.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.368+0000 7f47e4b64640 1 --2- 172.21.15.77:0/2902659923 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47e00ad730 0x7f47e0070710 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f47d00098a0 tx=0x7f47d002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eedbf8369b9d6a66 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.368+0000 7f47d7fff640 1 -- 172.21.15.77:0/2902659923 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d00317c0 con 0x7f47e00ad730 2023-11-04T01:42:41.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.368+0000 7f47d7fff640 1 -- 172.21.15.77:0/2902659923 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d0031920 con 0x7f47e00ad730 2023-11-04T01:42:41.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.368+0000 7f47d7fff640 1 -- 172.21.15.77:0/2902659923 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d0031cb0 con 0x7f47e00ad730 2023-11-04T01:42:41.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.369+0000 7f47e75c9640 1 -- 172.21.15.77:0/2902659923 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47e00ad730 msgr2=0x7f47e0070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.369+0000 7f47e75c9640 1 --2- 172.21.15.77:0/2902659923 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47e00ad730 0x7f47e0070710 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f47d00098a0 tx=0x7f47d002b860 comp rx=0 tx=0).stop 2023-11-04T01:42:41.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.369+0000 7f47e75c9640 1 -- 172.21.15.77:0/2902659923 shutdown_connections 2023-11-04T01:42:41.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.369+0000 7f47e75c9640 1 --2- 172.21.15.77:0/2902659923 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47e00ad730 0x7f47e0070710 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.369+0000 7f47e75c9640 1 --2- 172.21.15.77:0/2902659923 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f47e015ad30 0x7f47e00adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.369+0000 7f47e75c9640 1 -- 172.21.15.77:0/2902659923 >> 172.21.15.77:0/2902659923 conn(0x7f47e00ce950 msgr2=0x7f47e00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:41.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.369+0000 7f47e75c9640 1 -- 172.21.15.77:0/2902659923 shutdown_connections 2023-11-04T01:42:41.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.369+0000 7f47e75c9640 1 -- 172.21.15.77:0/2902659923 wait complete. 2023-11-04T01:42:41.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.370+0000 7f47e75c9640 1 Processor -- start 2023-11-04T01:42:41.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.370+0000 7f47e75c9640 1 -- start start 2023-11-04T01:42:41.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.371+0000 7f47e75c9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f47e0070c50 0x7f47e0154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.371+0000 7f47e75c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47e00ad730 0x7f47e0153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.371+0000 7f47e75c9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47e015ad30 0x7f47e014f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.371+0000 7f47e75c9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e00b1a70 con 0x7f47e00ad730 2023-11-04T01:42:41.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.371+0000 7f47e75c9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e01552e0 con 0x7f47e015ad30 2023-11-04T01:42:41.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.371+0000 7f47e75c9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e00b1740 con 0x7f47e0070c50 2023-11-04T01:42:41.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.371+0000 7f47e4b64640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47e00ad730 0x7f47e0153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.371+0000 7f47e4b64640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47e00ad730 0x7f47e0153400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59226/0 (socket says 172.21.15.77:59226) 2023-11-04T01:42:41.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.371+0000 7f47e4b64640 1 -- 172.21.15.77:0/2210548372 learned_addr learned my addr 172.21.15.77:0/2210548372 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:41.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.371+0000 7f47e4b64640 1 -- 172.21.15.77:0/2210548372 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f47e0070c50 msgr2=0x7f47e0154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.371+0000 7f47e4b64640 1 --2- 172.21.15.77:0/2210548372 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f47e0070c50 0x7f47e0154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.371+0000 7f47e4b64640 1 -- 172.21.15.77:0/2210548372 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47e015ad30 msgr2=0x7f47e014f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.371+0000 7f47e5b66640 1 --2- 172.21.15.77:0/2210548372 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47e015ad30 0x7f47e014f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.371+0000 7f47e4b64640 1 --2- 172.21.15.77:0/2210548372 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47e015ad30 0x7f47e014f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.371+0000 7f47e4b64640 1 -- 172.21.15.77:0/2210548372 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d00094d0 con 0x7f47e00ad730 2023-11-04T01:42:41.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.371+0000 7f47e4b64640 1 --2- 172.21.15.77:0/2210548372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47e00ad730 0x7f47e0153400 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f47d002b8a0 tx=0x7f47d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.371+0000 7f47d5ffb640 1 -- 172.21.15.77:0/2210548372 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d00329a0 con 0x7f47e00ad730 2023-11-04T01:42:41.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.371+0000 7f47d5ffb640 1 -- 172.21.15.77:0/2210548372 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d0032b20 con 0x7f47e00ad730 2023-11-04T01:42:41.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.371+0000 7f47e75c9640 1 -- 172.21.15.77:0/2210548372 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e0155560 con 0x7f47e00ad730 2023-11-04T01:42:41.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.371+0000 7f47d5ffb640 1 -- 172.21.15.77:0/2210548372 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d00453f0 con 0x7f47e00ad730 2023-11-04T01:42:41.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.372+0000 7f47e75c9640 1 -- 172.21.15.77:0/2210548372 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e0155b20 con 0x7f47e00ad730 2023-11-04T01:42:41.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.373+0000 7f47e75c9640 1 -- 172.21.15.77:0/2210548372 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e0074290 con 0x7f47e00ad730 2023-11-04T01:42:41.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.373+0000 7f47d5ffb640 1 -- 172.21.15.77:0/2210548372 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f47d004d3f0 con 0x7f47e00ad730 2023-11-04T01:42:41.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.373+0000 7f47d5ffb640 1 --2- 172.21.15.77:0/2210548372 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f47c406aea0 0x7f47c406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.374+0000 7f47d5ffb640 1 -- 172.21.15.77:0/2210548372 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f47d00abb10 con 0x7f47e00ad730 2023-11-04T01:42:41.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.374+0000 7f47e5365640 1 --2- 172.21.15.77:0/2210548372 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f47c406aea0 0x7f47c406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.374+0000 7f47e5365640 1 --2- 172.21.15.77:0/2210548372 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f47c406aea0 0x7f47c406d360 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f47dc00a810 tx=0x7f47dc008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.378+0000 7f47d5ffb640 1 -- 172.21.15.77:0/2210548372 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f47d0076640 con 0x7f47e00ad730 2023-11-04T01:42:41.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.543+0000 7f47e75c9640 1 -- 172.21.15.77:0/2210548372 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f47e0150b00 con 0x7f47e00ad730 2023-11-04T01:42:41.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.544+0000 7f47d5ffb640 1 -- 172.21.15.77:0/2210548372 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v71) v1 ==== 100+0+11 (secure 0 0 0) 0x7f47d0079c60 con 0x7f47e00ad730 2023-11-04T01:42:41.546 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-04T01:42:41.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.546+0000 7f47e75c9640 1 -- 172.21.15.77:0/2210548372 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f47c406aea0 msgr2=0x7f47c406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.546+0000 7f47e75c9640 1 --2- 172.21.15.77:0/2210548372 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f47c406aea0 0x7f47c406d360 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f47dc00a810 tx=0x7f47dc008040 comp rx=0 tx=0).stop 2023-11-04T01:42:41.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.546+0000 7f47e75c9640 1 -- 172.21.15.77:0/2210548372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47e00ad730 msgr2=0x7f47e0153400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.546+0000 7f47e75c9640 1 --2- 172.21.15.77:0/2210548372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47e00ad730 0x7f47e0153400 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f47d002b8a0 tx=0x7f47d00046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.546+0000 7f47e75c9640 1 -- 172.21.15.77:0/2210548372 shutdown_connections 2023-11-04T01:42:41.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.546+0000 7f47e75c9640 1 --2- 172.21.15.77:0/2210548372 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f47c406aea0 0x7f47c406d360 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.546+0000 7f47e75c9640 1 --2- 172.21.15.77:0/2210548372 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47e015ad30 0x7f47e014f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.546+0000 7f47e75c9640 1 --2- 172.21.15.77:0/2210548372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47e00ad730 0x7f47e0153400 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.546+0000 7f47e75c9640 1 --2- 172.21.15.77:0/2210548372 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f47e0070c50 0x7f47e0154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.546+0000 7f47e75c9640 1 -- 172.21.15.77:0/2210548372 >> 172.21.15.77:0/2210548372 conn(0x7f47e00ce950 msgr2=0x7f47e00c9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:41.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.546+0000 7f47e75c9640 1 -- 172.21.15.77:0/2210548372 shutdown_connections 2023-11-04T01:42:41.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.546+0000 7f47e75c9640 1 -- 172.21.15.77:0/2210548372 wait complete. 2023-11-04T01:42:41.561 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:42:41.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.662+0000 7f8eeff8a640 1 Processor -- start 2023-11-04T01:42:41.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.663+0000 7f8eeff8a640 1 -- start start 2023-11-04T01:42:41.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.664+0000 7f8eeff8a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8ee815ad30 0x7f8ee80adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.664+0000 7f8eeff8a640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ee80ad730 0x7f8ee8070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.664+0000 7f8eeff8a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ee80c3900 con 0x7f8ee8070c50 2023-11-04T01:42:41.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.664+0000 7f8eeff8a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ee80ae260 con 0x7f8ee815ad30 2023-11-04T01:42:41.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.664+0000 7f8eeff8a640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee815f750 con 0x7f8ee80ad730 2023-11-04T01:42:41.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.664+0000 7f8eedd26640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8ee815ad30 0x7f8ee80adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.664+0000 7f8eedd26640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8ee815ad30 0x7f8ee80adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59234/0 (socket says 172.21.15.77:59234) 2023-11-04T01:42:41.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.664+0000 7f8eee527640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f8ee8070c50 0x7f8ee80c8fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:38860/0 (socket says 172.21.15.77:38860) 2023-11-04T01:42:41.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.664+0000 7f8eedd26640 1 -- 172.21.15.77:0/2466603173 learned_addr learned my addr 172.21.15.77:0/2466603173 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:41.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.664+0000 7f8eed525640 1 --2- 172.21.15.77:0/2466603173 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ee80ad730 0x7f8ee8070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.664+0000 7f8eedd26640 1 -- 172.21.15.77:0/2466603173 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ee80ad730 msgr2=0x7f8ee8070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:41.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.664+0000 7f8eedd26640 1 --2- 172.21.15.77:0/2466603173 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ee80ad730 0x7f8ee8070710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.664+0000 7f8eedd26640 1 -- 172.21.15.77:0/2466603173 >> v1:172.21.15.77:6789/0 conn(0x7f8ee8070c50 legacy=0x7f8ee80c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.664+0000 7f8eedd26640 1 -- 172.21.15.77:0/2466603173 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee80c3be0 con 0x7f8ee815ad30 2023-11-04T01:42:41.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.664+0000 7f8eecd24640 1 -- 172.21.15.77:0/2466603173 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2326322527 0 0) 0x7f8ee80c3900 con 0x7f8ee8070c50 2023-11-04T01:42:41.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.665+0000 7f8eedd26640 1 --2- 172.21.15.77:0/2466603173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ee815ad30 0x7f8ee80adc80 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f8ee40098a0 tx=0x7f8ee402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bdaba871aadb04e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.665+0000 7f8eecd24640 1 -- 172.21.15.77:0/2466603173 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee4031640 con 0x7f8ee815ad30 2023-11-04T01:42:41.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.665+0000 7f8eecd24640 1 -- 172.21.15.77:0/2466603173 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee40317a0 con 0x7f8ee815ad30 2023-11-04T01:42:41.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.665+0000 7f8eecd24640 1 -- 172.21.15.77:0/2466603173 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee4031b30 con 0x7f8ee815ad30 2023-11-04T01:42:41.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.665+0000 7f8eeff8a640 1 -- 172.21.15.77:0/2466603173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ee815ad30 msgr2=0x7f8ee80adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.665+0000 7f8eeff8a640 1 --2- 172.21.15.77:0/2466603173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ee815ad30 0x7f8ee80adc80 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f8ee40098a0 tx=0x7f8ee402b8f0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.665+0000 7f8eeff8a640 1 -- 172.21.15.77:0/2466603173 shutdown_connections 2023-11-04T01:42:41.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.665+0000 7f8eeff8a640 1 --2- 172.21.15.77:0/2466603173 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ee80ad730 0x7f8ee8070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.665+0000 7f8eeff8a640 1 --2- 172.21.15.77:0/2466603173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ee815ad30 0x7f8ee80adc80 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.665+0000 7f8eeff8a640 1 -- 172.21.15.77:0/2466603173 >> 172.21.15.77:0/2466603173 conn(0x7f8ee80ce950 msgr2=0x7f8ee80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:41.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.666+0000 7f8eeff8a640 1 -- 172.21.15.77:0/2466603173 shutdown_connections 2023-11-04T01:42:41.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.666+0000 7f8eeff8a640 1 -- 172.21.15.77:0/2466603173 wait complete. 2023-11-04T01:42:41.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.667+0000 7f8eeff8a640 1 Processor -- start 2023-11-04T01:42:41.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.667+0000 7f8eeff8a640 1 -- start start 2023-11-04T01:42:41.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.667+0000 7f8eeff8a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ee8070c50 0x7f8ee81521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.667+0000 7f8eeff8a640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ee80ad730 0x7f8ee8142130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.667+0000 7f8eeff8a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ee815ad30 0x7f8ee80c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.667+0000 7f8eeff8a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee80c8c30 con 0x7f8ee8070c50 2023-11-04T01:42:41.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.667+0000 7f8eeff8a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee815c200 con 0x7f8ee815ad30 2023-11-04T01:42:41.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.667+0000 7f8eeff8a640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee815c4e0 con 0x7f8ee80ad730 2023-11-04T01:42:41.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.667+0000 7f8eedd26640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ee8070c50 0x7f8ee81521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.667+0000 7f8eedd26640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ee8070c50 0x7f8ee81521d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59244/0 (socket says 172.21.15.77:59244) 2023-11-04T01:42:41.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.668+0000 7f8eedd26640 1 -- 172.21.15.77:0/2088898219 learned_addr learned my addr 172.21.15.77:0/2088898219 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:41.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.668+0000 7f8eed525640 1 --2- 172.21.15.77:0/2088898219 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ee80ad730 0x7f8ee8142130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.668+0000 7f8eee527640 1 --2- 172.21.15.77:0/2088898219 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ee815ad30 0x7f8ee80c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.668+0000 7f8eedd26640 1 -- 172.21.15.77:0/2088898219 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ee80ad730 msgr2=0x7f8ee8142130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.668+0000 7f8eedd26640 1 --2- 172.21.15.77:0/2088898219 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ee80ad730 0x7f8ee8142130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.668+0000 7f8eedd26640 1 -- 172.21.15.77:0/2088898219 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ee815ad30 msgr2=0x7f8ee80c82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.668+0000 7f8eedd26640 1 --2- 172.21.15.77:0/2088898219 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ee815ad30 0x7f8ee80c82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.668+0000 7f8eedd26640 1 -- 172.21.15.77:0/2088898219 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee40094d0 con 0x7f8ee8070c50 2023-11-04T01:42:41.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.668+0000 7f8eed525640 1 --2- 172.21.15.77:0/2088898219 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ee80ad730 0x7f8ee8142130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:41.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.668+0000 7f8eedd26640 1 --2- 172.21.15.77:0/2088898219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ee8070c50 0x7f8ee81521d0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4000c00 tx=0x7f8ee40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.668+0000 7f8eda7fc640 1 -- 172.21.15.77:0/2088898219 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee403ac60 con 0x7f8ee8070c50 2023-11-04T01:42:41.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.668+0000 7f8eda7fc640 1 -- 172.21.15.77:0/2088898219 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee403ade0 con 0x7f8ee8070c50 2023-11-04T01:42:41.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.668+0000 7f8eeff8a640 1 -- 172.21.15.77:0/2088898219 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ee815c7c0 con 0x7f8ee8070c50 2023-11-04T01:42:41.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.668+0000 7f8eda7fc640 1 -- 172.21.15.77:0/2088898219 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee4044630 con 0x7f8ee8070c50 2023-11-04T01:42:41.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.668+0000 7f8eeff8a640 1 -- 172.21.15.77:0/2088898219 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ee8142670 con 0x7f8ee8070c50 2023-11-04T01:42:41.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.669+0000 7f8eeff8a640 1 -- 172.21.15.77:0/2088898219 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ee80c8da0 con 0x7f8ee8070c50 2023-11-04T01:42:41.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.669+0000 7f8eda7fc640 1 -- 172.21.15.77:0/2088898219 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8ee402f050 con 0x7f8ee8070c50 2023-11-04T01:42:41.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.670+0000 7f8eda7fc640 1 --2- 172.21.15.77:0/2088898219 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8ecc06ae70 0x7f8ecc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.670+0000 7f8eda7fc640 1 -- 172.21.15.77:0/2088898219 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f8ee40abcb0 con 0x7f8ee8070c50 2023-11-04T01:42:41.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.670+0000 7f8eed525640 1 --2- 172.21.15.77:0/2088898219 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8ecc06ae70 0x7f8ecc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.670+0000 7f8eed525640 1 --2- 172.21.15.77:0/2088898219 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8ecc06ae70 0x7f8ecc06d330 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8ee815dd80 tx=0x7f8edc008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.674+0000 7f8eda7fc640 1 -- 172.21.15.77:0/2088898219 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8ee40767e0 con 0x7f8ee8070c50 2023-11-04T01:42:41.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.839+0000 7f8eeff8a640 1 -- 172.21.15.77:0/2088898219 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f8ee8066a40 con 0x7f8ee8070c50 2023-11-04T01:42:41.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.840+0000 7f8eda7fc640 1 -- 172.21.15.77:0/2088898219 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v71) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8ee40350a0 con 0x7f8ee8070c50 2023-11-04T01:42:41.842 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:42:41.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.842+0000 7f8eeff8a640 1 -- 172.21.15.77:0/2088898219 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8ecc06ae70 msgr2=0x7f8ecc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.842+0000 7f8eeff8a640 1 --2- 172.21.15.77:0/2088898219 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8ecc06ae70 0x7f8ecc06d330 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8ee815dd80 tx=0x7f8edc008040 comp rx=0 tx=0).stop 2023-11-04T01:42:41.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.842+0000 7f8eeff8a640 1 -- 172.21.15.77:0/2088898219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ee8070c50 msgr2=0x7f8ee81521d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.842+0000 7f8eeff8a640 1 --2- 172.21.15.77:0/2088898219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ee8070c50 0x7f8ee81521d0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4000c00 tx=0x7f8ee40046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.842+0000 7f8eeff8a640 1 -- 172.21.15.77:0/2088898219 shutdown_connections 2023-11-04T01:42:41.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.842+0000 7f8eeff8a640 1 --2- 172.21.15.77:0/2088898219 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8ecc06ae70 0x7f8ecc06d330 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.842+0000 7f8eeff8a640 1 --2- 172.21.15.77:0/2088898219 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ee815ad30 0x7f8ee80c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.842+0000 7f8eeff8a640 1 --2- 172.21.15.77:0/2088898219 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ee80ad730 0x7f8ee8142130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.842+0000 7f8eeff8a640 1 --2- 172.21.15.77:0/2088898219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ee8070c50 0x7f8ee81521d0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.842+0000 7f8eeff8a640 1 -- 172.21.15.77:0/2088898219 >> 172.21.15.77:0/2088898219 conn(0x7f8ee80ce950 msgr2=0x7f8ee80ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:41.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.842+0000 7f8eeff8a640 1 -- 172.21.15.77:0/2088898219 shutdown_connections 2023-11-04T01:42:41.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.842+0000 7f8eeff8a640 1 -- 172.21.15.77:0/2088898219 wait complete. 2023-11-04T01:42:41.854 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:42:41.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.954+0000 7fc8207c9640 1 Processor -- start 2023-11-04T01:42:41.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.955+0000 7fc8207c9640 1 -- start start 2023-11-04T01:42:41.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.955+0000 7fc8207c9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc818153e60 0x7fc81815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.955+0000 7fc8207c9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc8180b4880 0x7fc8180b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.955+0000 7fc8207c9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8180cde60 con 0x7fc8180cd6d0 2023-11-04T01:42:41.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.955+0000 7fc8207c9640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8180b5230 con 0x7fc8180b4880 2023-11-04T01:42:41.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.955+0000 7fc8207c9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc818160f90 con 0x7fc818153e60 2023-11-04T01:42:41.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.956+0000 7fc81dd64640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc8180cd6d0 0x7fc818161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:38874/0 (socket says 172.21.15.77:38874) 2023-11-04T01:42:41.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.956+0000 7fc81dd64640 1 -- 172.21.15.77:0/2962934218 learned_addr learned my addr 172.21.15.77:0/2962934218 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:41.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.956+0000 7fc81d563640 1 -- 172.21.15.77:0/2962934218 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1912122664 0 0) 0x7fc8180cde60 con 0x7fc8180cd6d0 2023-11-04T01:42:41.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.956+0000 7fc81d563640 1 -- 172.21.15.77:0/2962934218 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc804003520 con 0x7fc8180cd6d0 2023-11-04T01:42:41.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.956+0000 7fc81e565640 1 --2- 172.21.15.77:0/2962934218 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc818153e60 0x7fc81815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.956+0000 7fc81ed66640 1 --2- 172.21.15.77:0/2962934218 >> v2:172.21.15.122:3300/0 conn(0x7fc8180b4880 0x7fc8180b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.956+0000 7fc81d563640 1 -- 172.21.15.77:0/2962934218 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1839624212 0 0) 0x7fc804003520 con 0x7fc8180cd6d0 2023-11-04T01:42:41.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.956+0000 7fc81d563640 1 -- 172.21.15.77:0/2962934218 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc818153e60 msgr2=0x7fc81815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:41.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.956+0000 7fc81d563640 1 --2- 172.21.15.77:0/2962934218 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc818153e60 0x7fc81815dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.956+0000 7fc81d563640 1 -- 172.21.15.77:0/2962934218 >> v2:172.21.15.122:3300/0 conn(0x7fc8180b4880 msgr2=0x7fc8180b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:41.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.956+0000 7fc81d563640 1 --2- 172.21.15.77:0/2962934218 >> v2:172.21.15.122:3300/0 conn(0x7fc8180b4880 0x7fc8180b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.956+0000 7fc81d563640 1 -- 172.21.15.77:0/2962934218 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81815e400 con 0x7fc8180cd6d0 2023-11-04T01:42:41.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.956+0000 7fc81d563640 1 -- 172.21.15.77:0/2962934218 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7fc808001670 con 0x7fc8180cd6d0 2023-11-04T01:42:41.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.956+0000 7fc81d563640 1 -- 172.21.15.77:0/2962934218 >> v1:172.21.15.77:6789/0 conn(0x7fc8180cd6d0 legacy=0x7fc818161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.956+0000 7fc81d563640 1 --2- 172.21.15.77:0/2962934218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc804003970 0x7fc804003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.956+0000 7fc81d563640 1 --2- 172.21.15.77:0/2962934218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8040047c0 0x7fc804004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.956+0000 7fc81d563640 1 --2- 172.21.15.77:0/2962934218 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc818153e60 0x7fc804005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.956+0000 7fc81d563640 1 -- 172.21.15.77:0/2962934218 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8180b5230 con 0x7fc804003970 2023-11-04T01:42:41.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.956+0000 7fc81d563640 1 -- 172.21.15.77:0/2962934218 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc818160f90 con 0x7fc8040047c0 2023-11-04T01:42:41.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.956+0000 7fc81d563640 1 -- 172.21.15.77:0/2962934218 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc80400b980 con 0x7fc818153e60 2023-11-04T01:42:41.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.956+0000 7fc81e565640 1 --2- 172.21.15.77:0/2962934218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc804003970 0x7fc804003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.956+0000 7fc81dd64640 1 --2- 172.21.15.77:0/2962934218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8040047c0 0x7fc804004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.956+0000 7fc81ed66640 1 --2- 172.21.15.77:0/2962934218 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc818153e60 0x7fc804005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.957+0000 7fc81e565640 1 -- 172.21.15.77:0/2962934218 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc818153e60 msgr2=0x7fc804005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:41.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.957+0000 7fc81e565640 1 --2- 172.21.15.77:0/2962934218 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc818153e60 0x7fc804005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.957+0000 7fc81e565640 1 -- 172.21.15.77:0/2962934218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8040047c0 msgr2=0x7fc804004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:41.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.957+0000 7fc81e565640 1 --2- 172.21.15.77:0/2962934218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8040047c0 0x7fc804004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.957+0000 7fc81e565640 1 -- 172.21.15.77:0/2962934218 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc804003520 con 0x7fc804003970 2023-11-04T01:42:41.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.957+0000 7fc81dd64640 1 --2- 172.21.15.77:0/2962934218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8040047c0 0x7fc804004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:41.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.957+0000 7fc81e565640 1 --2- 172.21.15.77:0/2962934218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc804003970 0x7fc804003d90 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fc814009ac0 tx=0x7fc8040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e680f74d9fd7e37a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.957+0000 7fc81d563640 1 -- 172.21.15.77:0/2962934218 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81402c6b0 con 0x7fc804003970 2023-11-04T01:42:41.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.957+0000 7fc81d563640 1 -- 172.21.15.77:0/2962934218 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81402c810 con 0x7fc804003970 2023-11-04T01:42:41.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.957+0000 7fc81d563640 1 -- 172.21.15.77:0/2962934218 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81402cba0 con 0x7fc804003970 2023-11-04T01:42:41.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.958+0000 7fc8207c9640 1 -- 172.21.15.77:0/2962934218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc804003970 msgr2=0x7fc804003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.958+0000 7fc8207c9640 1 --2- 172.21.15.77:0/2962934218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc804003970 0x7fc804003d90 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fc814009ac0 tx=0x7fc8040057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.958+0000 7fc81ed66640 1 -- 172.21.15.77:0/2962934218 reap_dead start 2023-11-04T01:42:41.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.958+0000 7fc8207c9640 1 -- 172.21.15.77:0/2962934218 shutdown_connections 2023-11-04T01:42:41.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.958+0000 7fc8207c9640 1 -- 172.21.15.77:0/2962934218 >> 172.21.15.77:0/2962934218 conn(0x7fc8180cf880 msgr2=0x7fc8180cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:41.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.958+0000 7fc8207c9640 1 -- 172.21.15.77:0/2962934218 shutdown_connections 2023-11-04T01:42:41.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.958+0000 7fc8207c9640 1 -- 172.21.15.77:0/2962934218 wait complete. 2023-11-04T01:42:41.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.959+0000 7fc8207c9640 1 Processor -- start 2023-11-04T01:42:41.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.959+0000 7fc8207c9640 1 -- start start 2023-11-04T01:42:41.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.960+0000 7fc8207c9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc804003970 0x7fc818152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.960+0000 7fc8207c9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8180c8b00 0x7fc8180c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.960+0000 7fc8207c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8181f2d60 0x7fc8181f31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.960+0000 7fc8207c9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc818154d10 con 0x7fc8181f2d60 2023-11-04T01:42:41.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.960+0000 7fc8207c9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8180c94c0 con 0x7fc8180c8b00 2023-11-04T01:42:41.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.960+0000 7fc8207c9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8181f3a90 con 0x7fc804003970 2023-11-04T01:42:41.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.960+0000 7fc81ed66640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8181f2d60 0x7fc8181f31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.960+0000 7fc81ed66640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8181f2d60 0x7fc8181f31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59260/0 (socket says 172.21.15.77:59260) 2023-11-04T01:42:41.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.960+0000 7fc81ed66640 1 -- 172.21.15.77:0/3032585209 learned_addr learned my addr 172.21.15.77:0/3032585209 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:41.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.960+0000 7fc81dd64640 1 --2- 172.21.15.77:0/3032585209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8180c8b00 0x7fc8180c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.960+0000 7fc81e565640 1 --2- 172.21.15.77:0/3032585209 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc804003970 0x7fc818152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.960+0000 7fc81ed66640 1 -- 172.21.15.77:0/3032585209 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc804003970 msgr2=0x7fc818152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.960+0000 7fc81ed66640 1 --2- 172.21.15.77:0/3032585209 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc804003970 0x7fc818152d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.960+0000 7fc81ed66640 1 -- 172.21.15.77:0/3032585209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8180c8b00 msgr2=0x7fc8180c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.960+0000 7fc81ed66640 1 --2- 172.21.15.77:0/3032585209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8180c8b00 0x7fc8180c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.960+0000 7fc81ed66640 1 -- 172.21.15.77:0/3032585209 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc818154370 con 0x7fc8181f2d60 2023-11-04T01:42:41.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.960+0000 7fc81ed66640 1 --2- 172.21.15.77:0/3032585209 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8181f2d60 0x7fc8181f31e0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fc8180c6900 tx=0x7fc8100115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.961+0000 7fc80effd640 1 -- 172.21.15.77:0/3032585209 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81000e070 con 0x7fc8181f2d60 2023-11-04T01:42:41.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.961+0000 7fc80effd640 1 -- 172.21.15.77:0/3032585209 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc810003990 con 0x7fc8181f2d60 2023-11-04T01:42:41.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.961+0000 7fc80effd640 1 -- 172.21.15.77:0/3032585209 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc810003b40 con 0x7fc8181f2d60 2023-11-04T01:42:41.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.961+0000 7fc8207c9640 1 -- 172.21.15.77:0/3032585209 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc818154650 con 0x7fc8181f2d60 2023-11-04T01:42:41.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.961+0000 7fc8207c9640 1 -- 172.21.15.77:0/3032585209 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8181f3720 con 0x7fc8181f2d60 2023-11-04T01:42:41.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.962+0000 7fc8207c9640 1 -- 172.21.15.77:0/3032585209 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc818154e50 con 0x7fc8181f2d60 2023-11-04T01:42:41.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.962+0000 7fc80effd640 1 -- 172.21.15.77:0/3032585209 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc810003ca0 con 0x7fc8181f2d60 2023-11-04T01:42:41.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.962+0000 7fc80effd640 1 --2- 172.21.15.77:0/3032585209 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc7fc06aea0 0x7fc7fc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.962+0000 7fc80effd640 1 -- 172.21.15.77:0/3032585209 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fc810089fa0 con 0x7fc8181f2d60 2023-11-04T01:42:41.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.963+0000 7fc81e565640 1 --2- 172.21.15.77:0/3032585209 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc7fc06aea0 0x7fc7fc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.963+0000 7fc81e565640 1 --2- 172.21.15.77:0/3032585209 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc7fc06aea0 0x7fc7fc06d360 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc814036000 tx=0x7fc814030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:41.967+0000 7fc80effd640 1 -- 172.21.15.77:0/3032585209 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc8100bcca0 con 0x7fc8181f2d60 2023-11-04T01:42:42.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.130+0000 7fc8207c9640 1 -- 172.21.15.77:0/3032585209 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7fc818074290 con 0x7fc8181f2d60 2023-11-04T01:42:42.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.131+0000 7fc80effd640 1 -- 172.21.15.77:0/3032585209 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v71) v1 ==== 107+0+11 (secure 0 0 0) 0x7fc818154e50 con 0x7fc8181f2d60 2023-11-04T01:42:42.133 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:42:42.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.133+0000 7fc8207c9640 1 -- 172.21.15.77:0/3032585209 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc7fc06aea0 msgr2=0x7fc7fc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.133+0000 7fc8207c9640 1 --2- 172.21.15.77:0/3032585209 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc7fc06aea0 0x7fc7fc06d360 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc814036000 tx=0x7fc814030000 comp rx=0 tx=0).stop 2023-11-04T01:42:42.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.133+0000 7fc8207c9640 1 -- 172.21.15.77:0/3032585209 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8181f2d60 msgr2=0x7fc8181f31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.133+0000 7fc8207c9640 1 --2- 172.21.15.77:0/3032585209 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8181f2d60 0x7fc8181f31e0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fc8180c6900 tx=0x7fc8100115a0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.133+0000 7fc8207c9640 1 -- 172.21.15.77:0/3032585209 shutdown_connections 2023-11-04T01:42:42.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.133+0000 7fc8207c9640 1 --2- 172.21.15.77:0/3032585209 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc7fc06aea0 0x7fc7fc06d360 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.133+0000 7fc8207c9640 1 --2- 172.21.15.77:0/3032585209 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8181f2d60 0x7fc8181f31e0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.133+0000 7fc8207c9640 1 --2- 172.21.15.77:0/3032585209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8180c8b00 0x7fc8180c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.133+0000 7fc8207c9640 1 --2- 172.21.15.77:0/3032585209 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc804003970 0x7fc818152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.133+0000 7fc8207c9640 1 -- 172.21.15.77:0/3032585209 >> 172.21.15.77:0/3032585209 conn(0x7fc8180cf880 msgr2=0x7fc8180b7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:42.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.133+0000 7fc8207c9640 1 -- 172.21.15.77:0/3032585209 shutdown_connections 2023-11-04T01:42:42.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.133+0000 7fc8207c9640 1 -- 172.21.15.77:0/3032585209 wait complete. 2023-11-04T01:42:42.145 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:42.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.242+0000 7f134901a640 1 Processor -- start 2023-11-04T01:42:42.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.243+0000 7f134901a640 1 -- start start 2023-11-04T01:42:42.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.243+0000 7f134901a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f13440b42c0 0x7f13440c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.243+0000 7f134901a640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f13440c9c40 0x7f13440b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.243+0000 7f134901a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13440ca090 con 0x7f134415ad80 2023-11-04T01:42:42.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.243+0000 7f134901a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f134406cfa0 con 0x7f13440b42c0 2023-11-04T01:42:42.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.243+0000 7f134901a640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f134406d280 con 0x7f13440c9c40 2023-11-04T01:42:42.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.243+0000 7f134259c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f13440b42c0 0x7f13440c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.243+0000 7f1342d9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f134415ad80 0x7f134406c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:38876/0 (socket says 172.21.15.77:38876) 2023-11-04T01:42:42.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.243+0000 7f1342d9d640 1 -- 172.21.15.77:0/415697419 learned_addr learned my addr 172.21.15.77:0/415697419 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:42.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.244+0000 7f134359e640 1 --2- 172.21.15.77:0/415697419 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f13440c9c40 0x7f13440b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.244+0000 7f134259c640 1 -- 172.21.15.77:0/415697419 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f13440c9c40 msgr2=0x7f13440b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:42.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.244+0000 7f134259c640 1 --2- 172.21.15.77:0/415697419 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f13440c9c40 0x7f13440b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.244+0000 7f134259c640 1 -- 172.21.15.77:0/415697419 >> v1:172.21.15.77:6789/0 conn(0x7f134415ad80 legacy=0x7f134406c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.244+0000 7f1341d9b640 1 -- 172.21.15.77:0/415697419 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2467800191 0 0) 0x7f1334001110 con 0x7f134415ad80 2023-11-04T01:42:42.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.244+0000 7f134259c640 1 -- 172.21.15.77:0/415697419 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f134406d560 con 0x7f13440b42c0 2023-11-04T01:42:42.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.244+0000 7f134259c640 1 --2- 172.21.15.77:0/415697419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13440b42c0 0x7f13440c9700 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f132c0097a0 tx=0x7f132c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=200bc809cac5536a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:42.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.245+0000 7f1341d9b640 1 -- 172.21.15.77:0/415697419 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c030610 con 0x7f13440b42c0 2023-11-04T01:42:42.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.245+0000 7f1341d9b640 1 -- 172.21.15.77:0/415697419 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132c030770 con 0x7f13440b42c0 2023-11-04T01:42:42.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.245+0000 7f1341d9b640 1 -- 172.21.15.77:0/415697419 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c030b00 con 0x7f13440b42c0 2023-11-04T01:42:42.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.245+0000 7f134901a640 1 -- 172.21.15.77:0/415697419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13440b42c0 msgr2=0x7f13440c9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.245+0000 7f134901a640 1 --2- 172.21.15.77:0/415697419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13440b42c0 0x7f13440c9700 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f132c0097a0 tx=0x7f132c02b960 comp rx=0 tx=0).stop 2023-11-04T01:42:42.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.245+0000 7f134901a640 1 -- 172.21.15.77:0/415697419 shutdown_connections 2023-11-04T01:42:42.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.245+0000 7f134901a640 1 --2- 172.21.15.77:0/415697419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13440b42c0 0x7f13440c9700 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.245+0000 7f134901a640 1 --2- 172.21.15.77:0/415697419 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f13440c9c40 0x7f13440b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.245+0000 7f134901a640 1 -- 172.21.15.77:0/415697419 >> 172.21.15.77:0/415697419 conn(0x7f13440ce950 msgr2=0x7f13440ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:42.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.245+0000 7f134901a640 1 -- 172.21.15.77:0/415697419 shutdown_connections 2023-11-04T01:42:42.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.245+0000 7f134901a640 1 -- 172.21.15.77:0/415697419 wait complete. 2023-11-04T01:42:42.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.247+0000 7f134901a640 1 Processor -- start 2023-11-04T01:42:42.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.247+0000 7f134901a640 1 -- start start 2023-11-04T01:42:42.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.247+0000 7f134901a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13440b42c0 0x7f134415dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.247+0000 7f134901a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13440c9c40 0x7f1344149ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.247+0000 7f134901a640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f134415ad80 0x7f134415c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.247+0000 7f134901a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134415d810 con 0x7f13440c9c40 2023-11-04T01:42:42.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.247+0000 7f134901a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134414a020 con 0x7f13440b42c0 2023-11-04T01:42:42.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.247+0000 7f134901a640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f134415cb90 con 0x7f134415ad80 2023-11-04T01:42:42.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.248+0000 7f134259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13440c9c40 0x7f1344149ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.248+0000 7f134259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13440c9c40 0x7f1344149ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59270/0 (socket says 172.21.15.77:59270) 2023-11-04T01:42:42.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.248+0000 7f134259c640 1 -- 172.21.15.77:0/1423965280 learned_addr learned my addr 172.21.15.77:0/1423965280 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:42.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.248+0000 7f134359e640 1 --2- 172.21.15.77:0/1423965280 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f134415ad80 0x7f134415c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.248+0000 7f1342d9d640 1 --2- 172.21.15.77:0/1423965280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13440b42c0 0x7f134415dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.248+0000 7f134259c640 1 -- 172.21.15.77:0/1423965280 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f134415ad80 msgr2=0x7f134415c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.248+0000 7f134259c640 1 --2- 172.21.15.77:0/1423965280 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f134415ad80 0x7f134415c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.248+0000 7f134259c640 1 -- 172.21.15.77:0/1423965280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13440b42c0 msgr2=0x7f134415dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.248+0000 7f134259c640 1 --2- 172.21.15.77:0/1423965280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13440b42c0 0x7f134415dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.248+0000 7f134259c640 1 -- 172.21.15.77:0/1423965280 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132c009400 con 0x7f13440c9c40 2023-11-04T01:42:42.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.248+0000 7f134359e640 1 --2- 172.21.15.77:0/1423965280 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f134415ad80 0x7f134415c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:42.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.248+0000 7f1342d9d640 1 --2- 172.21.15.77:0/1423965280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13440b42c0 0x7f134415dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:42.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.248+0000 7f134259c640 1 --2- 172.21.15.77:0/1423965280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13440c9c40 0x7f1344149ae0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f132c000c00 tx=0x7f132c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:42.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.248+0000 7f133b7fe640 1 -- 172.21.15.77:0/1423965280 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c039c90 con 0x7f13440c9c40 2023-11-04T01:42:42.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.248+0000 7f133b7fe640 1 -- 172.21.15.77:0/1423965280 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132c03f040 con 0x7f13440c9c40 2023-11-04T01:42:42.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.248+0000 7f134901a640 1 -- 172.21.15.77:0/1423965280 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f134415ce70 con 0x7f13440c9c40 2023-11-04T01:42:42.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.248+0000 7f133b7fe640 1 -- 172.21.15.77:0/1423965280 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c006e10 con 0x7f13440c9c40 2023-11-04T01:42:42.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.248+0000 7f134901a640 1 -- 172.21.15.77:0/1423965280 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f134415d430 con 0x7f13440c9c40 2023-11-04T01:42:42.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.249+0000 7f134901a640 1 -- 172.21.15.77:0/1423965280 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1344074290 con 0x7f13440c9c40 2023-11-04T01:42:42.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.250+0000 7f133b7fe640 1 -- 172.21.15.77:0/1423965280 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f132c004030 con 0x7f13440c9c40 2023-11-04T01:42:42.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.250+0000 7f133b7fe640 1 --2- 172.21.15.77:0/1423965280 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f132406ae70 0x7f132406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.250+0000 7f133b7fe640 1 -- 172.21.15.77:0/1423965280 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f132c0aba60 con 0x7f13440c9c40 2023-11-04T01:42:42.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.250+0000 7f1342d9d640 1 --2- 172.21.15.77:0/1423965280 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f132406ae70 0x7f132406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.251+0000 7f1342d9d640 1 --2- 172.21.15.77:0/1423965280 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f132406ae70 0x7f132406d330 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1334000f60 tx=0x7f1334009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:42.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.254+0000 7f133b7fe640 1 -- 172.21.15.77:0/1423965280 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f132c076500 con 0x7f13440c9c40 2023-11-04T01:42:42.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.457+0000 7f134901a640 1 -- 172.21.15.77:0/1423965280 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f13440ad870 con 0x7f13440c9c40 2023-11-04T01:42:42.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.458+0000 7f133b7fe640 1 -- 172.21.15.77:0/1423965280 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f132c079b20 con 0x7f13440c9c40 2023-11-04T01:42:42.460 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:42.460 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6396,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/20625239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":20625239},{"type":"v1","addr":"172.21.15.77:6834","nonce":20625239}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6399,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3909793035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3909793035},{"type":"v1","addr":"172.21.15.77:6835","nonce":3909793035}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":35252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/1714919040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1714919040},{"type":"v1","addr":"172.21.15.122:6836","nonce":1714919040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:42:23.999994+0000","modified":"2023-11-04T01:42:26.916361+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":35255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35255":{"gid":35255,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/1606545578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1606545578},{"type":"v1","addr":"172.21.15.122:6837","nonce":1606545578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-04T01:42:42.461 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 29 2023-11-04T01:42:42.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.460+0000 7f134901a640 1 -- 172.21.15.77:0/1423965280 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f132406ae70 msgr2=0x7f132406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.460+0000 7f134901a640 1 --2- 172.21.15.77:0/1423965280 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f132406ae70 0x7f132406d330 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1334000f60 tx=0x7f1334009040 comp rx=0 tx=0).stop 2023-11-04T01:42:42.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.460+0000 7f134901a640 1 -- 172.21.15.77:0/1423965280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13440c9c40 msgr2=0x7f1344149ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.460+0000 7f134901a640 1 --2- 172.21.15.77:0/1423965280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13440c9c40 0x7f1344149ae0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f132c000c00 tx=0x7f132c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.460+0000 7f134901a640 1 -- 172.21.15.77:0/1423965280 shutdown_connections 2023-11-04T01:42:42.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.460+0000 7f134901a640 1 --2- 172.21.15.77:0/1423965280 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f132406ae70 0x7f132406d330 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.460+0000 7f134901a640 1 --2- 172.21.15.77:0/1423965280 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f134415ad80 0x7f134415c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.460+0000 7f134901a640 1 --2- 172.21.15.77:0/1423965280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13440c9c40 0x7f1344149ae0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.460+0000 7f134901a640 1 --2- 172.21.15.77:0/1423965280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13440b42c0 0x7f134415dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.460+0000 7f134901a640 1 -- 172.21.15.77:0/1423965280 >> 172.21.15.77:0/1423965280 conn(0x7f13440ce950 msgr2=0x7f13440ae160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:42.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.460+0000 7f134901a640 1 -- 172.21.15.77:0/1423965280 shutdown_connections 2023-11-04T01:42:42.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.460+0000 7f134901a640 1 -- 172.21.15.77:0/1423965280 wait complete. 2023-11-04T01:42:42.472 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:42.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.570+0000 7f496e410640 1 Processor -- start 2023-11-04T01:42:42.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.570+0000 7f496e410640 1 -- start start 2023-11-04T01:42:42.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.571+0000 7f496e410640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f496815e1c0 0x7f496806a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.571+0000 7f496e410640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49680cd250 con 0x7f49680b3da0 2023-11-04T01:42:42.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.571+0000 7f496e410640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49680b1b80 con 0x7f49680b14a0 2023-11-04T01:42:42.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.571+0000 7f496e410640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49680b1e60 con 0x7f496815e1c0 2023-11-04T01:42:42.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.571+0000 7f496c9ad640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f49680b3da0 0x7f49680ccb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:38878/0 (socket says 172.21.15.77:38878) 2023-11-04T01:42:42.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.571+0000 7f496c9ad640 1 -- 172.21.15.77:0/893308429 learned_addr learned my addr 172.21.15.77:0/893308429 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:42.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.572+0000 7f4966ffd640 1 -- 172.21.15.77:0/893308429 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 158820642 0 0) 0x7f49680cd250 con 0x7f49680b3da0 2023-11-04T01:42:42.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.572+0000 7f4967fff640 1 --2- 172.21.15.77:0/893308429 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f496815e1c0 0x7f496806a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.572+0000 7f4966ffd640 1 -- 172.21.15.77:0/893308429 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4950003520 con 0x7f49680b3da0 2023-11-04T01:42:42.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.572+0000 7f4966ffd640 1 -- 172.21.15.77:0/893308429 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2755736345 0 0) 0x7f4950003520 con 0x7f49680b3da0 2023-11-04T01:42:42.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.572+0000 7f4966ffd640 1 -- 172.21.15.77:0/893308429 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f496815e1c0 msgr2=0x7f496806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:42.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.572+0000 7f4966ffd640 1 --2- 172.21.15.77:0/893308429 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f496815e1c0 0x7f496806a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.572+0000 7f4966ffd640 1 -- 172.21.15.77:0/893308429 >> v1:172.21.15.122:6789/0 conn(0x7f49680b14a0 legacy=0x7f49680cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.572+0000 7f4966ffd640 1 -- 172.21.15.77:0/893308429 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49680b2140 con 0x7f49680b3da0 2023-11-04T01:42:42.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.572+0000 7f4966ffd640 1 -- 172.21.15.77:0/893308429 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f49600019f0 con 0x7f49680b3da0 2023-11-04T01:42:42.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.572+0000 7f4966ffd640 1 -- 172.21.15.77:0/893308429 >> v1:172.21.15.77:6789/0 conn(0x7f49680b3da0 legacy=0x7f49680ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.572+0000 7f4966ffd640 1 --2- 172.21.15.77:0/893308429 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f496815e1c0 0x7f49500039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.572+0000 7f4966ffd640 1 --2- 172.21.15.77:0/893308429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4950003f20 0x7f49500047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.572+0000 7f4966ffd640 1 --2- 172.21.15.77:0/893308429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4950004d00 0x7f4950005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.572+0000 7f4966ffd640 1 -- 172.21.15.77:0/893308429 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49680b1e60 con 0x7f4950004d00 2023-11-04T01:42:42.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.572+0000 7f4966ffd640 1 -- 172.21.15.77:0/893308429 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495000ba60 con 0x7f4950003f20 2023-11-04T01:42:42.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.572+0000 7f4966ffd640 1 -- 172.21.15.77:0/893308429 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f495000bc20 con 0x7f496815e1c0 2023-11-04T01:42:42.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.572+0000 7f496c9ad640 1 --2- 172.21.15.77:0/893308429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4950004d00 0x7f4950005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.572+0000 7f4967fff640 1 --2- 172.21.15.77:0/893308429 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f496815e1c0 0x7f49500039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.572+0000 7f49677fe640 1 --2- 172.21.15.77:0/893308429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4950003f20 0x7f49500047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.572+0000 7f496c9ad640 1 -- 172.21.15.77:0/893308429 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f496815e1c0 msgr2=0x7f49500039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:42.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.572+0000 7f496c9ad640 1 --2- 172.21.15.77:0/893308429 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f496815e1c0 0x7f49500039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.572+0000 7f496c9ad640 1 -- 172.21.15.77:0/893308429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4950003f20 msgr2=0x7f49500047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:42.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.572+0000 7f496c9ad640 1 --2- 172.21.15.77:0/893308429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4950003f20 0x7f49500047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.572+0000 7f496c9ad640 1 -- 172.21.15.77:0/893308429 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4950003520 con 0x7f4950004d00 2023-11-04T01:42:42.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.573+0000 7f496c9ad640 1 --2- 172.21.15.77:0/893308429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4950004d00 0x7f4950005180 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f496000a800 tx=0x7f49500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4cfd35e1d3ef9d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:42.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.573+0000 7f4966ffd640 1 -- 172.21.15.77:0/893308429 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49600072d0 con 0x7f4950004d00 2023-11-04T01:42:42.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.573+0000 7f4966ffd640 1 -- 172.21.15.77:0/893308429 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496002f070 con 0x7f4950004d00 2023-11-04T01:42:42.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.573+0000 7f4966ffd640 1 -- 172.21.15.77:0/893308429 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4960007690 con 0x7f4950004d00 2023-11-04T01:42:42.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.574+0000 7f496e410640 1 -- 172.21.15.77:0/893308429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4950004d00 msgr2=0x7f4950005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.574+0000 7f496e410640 1 --2- 172.21.15.77:0/893308429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4950004d00 0x7f4950005180 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f496000a800 tx=0x7f49500057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.574+0000 7f496c9ad640 1 -- 172.21.15.77:0/893308429 reap_dead start 2023-11-04T01:42:42.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.574+0000 7f496e410640 1 -- 172.21.15.77:0/893308429 shutdown_connections 2023-11-04T01:42:42.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.574+0000 7f496e410640 1 -- 172.21.15.77:0/893308429 >> 172.21.15.77:0/893308429 conn(0x7f496806d8b0 msgr2=0x7f496806dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:42.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.574+0000 7f496e410640 1 -- 172.21.15.77:0/893308429 shutdown_connections 2023-11-04T01:42:42.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.574+0000 7f496e410640 1 -- 172.21.15.77:0/893308429 wait complete. 2023-11-04T01:42:42.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.575+0000 7f496e410640 1 Processor -- start 2023-11-04T01:42:42.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.575+0000 7f496e410640 1 -- start start 2023-11-04T01:42:42.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.576+0000 7f496e410640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4950004d00 0x7f49680c3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.576+0000 7f496e410640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49680c6af0 0x7f49680af460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.576+0000 7f496e410640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f49680af9a0 0x7f49680c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.576+0000 7f496e410640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49680afe20 con 0x7f49680c6af0 2023-11-04T01:42:42.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.576+0000 7f496e410640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49680c72b0 con 0x7f4950004d00 2023-11-04T01:42:42.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.576+0000 7f496e410640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49680c7590 con 0x7f49680af9a0 2023-11-04T01:42:42.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.576+0000 7f49677fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49680c6af0 0x7f49680af460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.576+0000 7f49677fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49680c6af0 0x7f49680af460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59302/0 (socket says 172.21.15.77:59302) 2023-11-04T01:42:42.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.576+0000 7f49677fe640 1 -- 172.21.15.77:0/3727192933 learned_addr learned my addr 172.21.15.77:0/3727192933 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:42.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.576+0000 7f4967fff640 1 --2- 172.21.15.77:0/3727192933 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4950004d00 0x7f49680c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.576+0000 7f496c9ad640 1 --2- 172.21.15.77:0/3727192933 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f49680af9a0 0x7f49680c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.576+0000 7f49677fe640 1 -- 172.21.15.77:0/3727192933 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f49680af9a0 msgr2=0x7f49680c8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.576+0000 7f49677fe640 1 --2- 172.21.15.77:0/3727192933 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f49680af9a0 0x7f49680c8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.576+0000 7f49677fe640 1 -- 172.21.15.77:0/3727192933 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4950004d00 msgr2=0x7f49680c3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.576+0000 7f49677fe640 1 --2- 172.21.15.77:0/3727192933 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4950004d00 0x7f49680c3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.576+0000 7f49677fe640 1 -- 172.21.15.77:0/3727192933 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49680c7870 con 0x7f49680c6af0 2023-11-04T01:42:42.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.576+0000 7f4967fff640 1 --2- 172.21.15.77:0/3727192933 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4950004d00 0x7f49680c3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:42.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.576+0000 7f496c9ad640 1 --2- 172.21.15.77:0/3727192933 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f49680af9a0 0x7f49680c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:42.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.576+0000 7f49677fe640 1 --2- 172.21.15.77:0/3727192933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49680c6af0 0x7f49680af460 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f495c00f820 tx=0x7f495c00fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:42.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.576+0000 7f4964ff9640 1 -- 172.21.15.77:0/3727192933 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c0050d0 con 0x7f49680c6af0 2023-11-04T01:42:42.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.577+0000 7f4964ff9640 1 -- 172.21.15.77:0/3727192933 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495c005230 con 0x7f49680c6af0 2023-11-04T01:42:42.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.577+0000 7f4964ff9640 1 -- 172.21.15.77:0/3727192933 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c00d730 con 0x7f49680c6af0 2023-11-04T01:42:42.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.577+0000 7f496e410640 1 -- 172.21.15.77:0/3727192933 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49681f0600 con 0x7f49680c6af0 2023-11-04T01:42:42.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.577+0000 7f496e410640 1 -- 172.21.15.77:0/3727192933 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49680c6f70 con 0x7f49680c6af0 2023-11-04T01:42:42.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.577+0000 7f496e410640 1 -- 172.21.15.77:0/3727192933 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49680c7ab0 con 0x7f49680c6af0 2023-11-04T01:42:42.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.578+0000 7f4964ff9640 1 -- 172.21.15.77:0/3727192933 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f495c00d890 con 0x7f49680c6af0 2023-11-04T01:42:42.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.578+0000 7f4964ff9640 1 --2- 172.21.15.77:0/3727192933 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f495406ae70 0x7f495406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.578+0000 7f4964ff9640 1 -- 172.21.15.77:0/3727192933 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f495c089a60 con 0x7f49680c6af0 2023-11-04T01:42:42.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.579+0000 7f4967fff640 1 --2- 172.21.15.77:0/3727192933 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f495406ae70 0x7f495406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.579+0000 7f4967fff640 1 --2- 172.21.15.77:0/3727192933 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f495406ae70 0x7f495406d330 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4958009ab0 tx=0x7f4958008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:42.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.583+0000 7f4964ff9640 1 -- 172.21.15.77:0/3727192933 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f49680c7ab0 con 0x7f49680c6af0 2023-11-04T01:42:42.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.752+0000 7f496e410640 1 -- 172.21.15.77:0/3727192933 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49680c7ab0 con 0x7f49680c6af0 2023-11-04T01:42:42.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.754+0000 7f4964ff9640 1 -- 172.21.15.77:0/3727192933 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+22045 (secure 0 0 0) 0x7f49680c7ab0 con 0x7f49680c6af0 2023-11-04T01:42:42.756 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:42.756 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":71,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:42:40.572098+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:22.500204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:22.966681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:33.159064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:33.647358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":12,"snaps":[{"begin":1,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:42.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.755+0000 7f496e410640 1 -- 172.21.15.77:0/3727192933 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f495406ae70 msgr2=0x7f495406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.755+0000 7f496e410640 1 --2- 172.21.15.77:0/3727192933 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f495406ae70 0x7f495406d330 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4958009ab0 tx=0x7f4958008040 comp rx=0 tx=0).stop 2023-11-04T01:42:42.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.755+0000 7f496e410640 1 -- 172.21.15.77:0/3727192933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49680c6af0 msgr2=0x7f49680af460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.755+0000 7f496e410640 1 --2- 172.21.15.77:0/3727192933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49680c6af0 0x7f49680af460 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f495c00f820 tx=0x7f495c00fce0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.756+0000 7f496e410640 1 -- 172.21.15.77:0/3727192933 shutdown_connections 2023-11-04T01:42:42.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.756+0000 7f496e410640 1 --2- 172.21.15.77:0/3727192933 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f495406ae70 0x7f495406d330 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.756+0000 7f496e410640 1 --2- 172.21.15.77:0/3727192933 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f49680af9a0 0x7f49680c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.756+0000 7f496e410640 1 --2- 172.21.15.77:0/3727192933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49680c6af0 0x7f49680af460 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.756+0000 7f496e410640 1 --2- 172.21.15.77:0/3727192933 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4950004d00 0x7f49680c3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.756+0000 7f496e410640 1 -- 172.21.15.77:0/3727192933 >> 172.21.15.77:0/3727192933 conn(0x7f496806d8b0 msgr2=0x7f496815d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:42.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.756+0000 7f496e410640 1 -- 172.21.15.77:0/3727192933 shutdown_connections 2023-11-04T01:42:42.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.756+0000 7f496e410640 1 -- 172.21.15.77:0/3727192933 wait complete. 2023-11-04T01:42:42.768 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-04T01:42:42.769 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:42.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.866+0000 7f472adb0640 1 Processor -- start 2023-11-04T01:42:42.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.866+0000 7f472adb0640 1 -- start start 2023-11-04T01:42:42.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.867+0000 7f472adb0640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4724159c70 0x7f47240ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.867+0000 7f472adb0640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f472406db20 0x7f47240b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.867+0000 7f472adb0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f47240b0910 0x7f472415d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.867+0000 7f472adb0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47240b49b0 con 0x7f47240b0910 2023-11-04T01:42:42.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.867+0000 7f472adb0640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47240b0da0 con 0x7f4724159c70 2023-11-04T01:42:42.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.867+0000 7f472adb0640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47240b4110 con 0x7f472406db20 2023-11-04T01:42:42.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.867+0000 7f472934d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f47240b0910 0x7f472415d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.867+0000 7f472934d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f47240b0910 0x7f472415d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59308/0 (socket says 172.21.15.77:59308) 2023-11-04T01:42:42.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.867+0000 7f472934d640 1 -- 172.21.15.77:0/3188592860 learned_addr learned my addr 172.21.15.77:0/3188592860 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:42.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.867+0000 7f4723fff640 1 --2- 172.21.15.77:0/3188592860 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f472406db20 0x7f47240b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.867+0000 7f4728b4c640 1 --2- 172.21.15.77:0/3188592860 >> v2:172.21.15.122:3300/0 conn(0x7f4724159c70 0x7f47240ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.867+0000 7f472934d640 1 -- 172.21.15.77:0/3188592860 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f472406db20 msgr2=0x7f47240b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:42.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.867+0000 7f472934d640 1 --2- 172.21.15.77:0/3188592860 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f472406db20 0x7f47240b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.867+0000 7f472934d640 1 -- 172.21.15.77:0/3188592860 >> v2:172.21.15.122:3300/0 conn(0x7f4724159c70 msgr2=0x7f47240ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:42.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.867+0000 7f472934d640 1 --2- 172.21.15.77:0/3188592860 >> v2:172.21.15.122:3300/0 conn(0x7f4724159c70 0x7f47240ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.867+0000 7f472934d640 1 -- 172.21.15.77:0/3188592860 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47240b43f0 con 0x7f47240b0910 2023-11-04T01:42:42.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.867+0000 7f4723fff640 1 --2- 172.21.15.77:0/3188592860 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f472406db20 0x7f47240b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:42.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.867+0000 7f4728b4c640 1 --2- 172.21.15.77:0/3188592860 >> v2:172.21.15.122:3300/0 conn(0x7f4724159c70 0x7f47240ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:42.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.868+0000 7f472934d640 1 --2- 172.21.15.77:0/3188592860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47240b0910 0x7f472415d7d0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f47240cc440 tx=0x7f471c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49d6903023cf9036 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:42.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.868+0000 7f47237fe640 1 -- 172.21.15.77:0/3188592860 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c02ca70 con 0x7f47240b0910 2023-11-04T01:42:42.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.868+0000 7f47237fe640 1 -- 172.21.15.77:0/3188592860 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471c02cbd0 con 0x7f47240b0910 2023-11-04T01:42:42.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.868+0000 7f47237fe640 1 -- 172.21.15.77:0/3188592860 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c0343f0 con 0x7f47240b0910 2023-11-04T01:42:42.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.869+0000 7f472adb0640 1 -- 172.21.15.77:0/3188592860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47240b0910 msgr2=0x7f472415d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.869+0000 7f472adb0640 1 --2- 172.21.15.77:0/3188592860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47240b0910 0x7f472415d7d0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f47240cc440 tx=0x7f471c02bed0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.869+0000 7f472adb0640 1 -- 172.21.15.77:0/3188592860 shutdown_connections 2023-11-04T01:42:42.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.869+0000 7f472adb0640 1 --2- 172.21.15.77:0/3188592860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47240b0910 0x7f472415d7d0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.869+0000 7f472adb0640 1 --2- 172.21.15.77:0/3188592860 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f472406db20 0x7f47240b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.869+0000 7f472adb0640 1 --2- 172.21.15.77:0/3188592860 >> v2:172.21.15.122:3300/0 conn(0x7f4724159c70 0x7f47240ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.869+0000 7f472adb0640 1 -- 172.21.15.77:0/3188592860 >> 172.21.15.77:0/3188592860 conn(0x7f47240ce950 msgr2=0x7f47240ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:42.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.869+0000 7f472adb0640 1 -- 172.21.15.77:0/3188592860 shutdown_connections 2023-11-04T01:42:42.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.869+0000 7f472adb0640 1 -- 172.21.15.77:0/3188592860 wait complete. 2023-11-04T01:42:42.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.870+0000 7f472adb0640 1 Processor -- start 2023-11-04T01:42:42.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.870+0000 7f472adb0640 1 -- start start 2023-11-04T01:42:42.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.871+0000 7f472adb0640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f472406db20 0x7f472414dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.871+0000 7f472adb0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47240b0910 0x7f4724155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.871+0000 7f472adb0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4724159c70 0x7f4724070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.871+0000 7f472adb0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472415b950 con 0x7f47240b0910 2023-11-04T01:42:42.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.871+0000 7f472adb0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4724156520 con 0x7f4724159c70 2023-11-04T01:42:42.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.871+0000 7f472adb0640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4724156800 con 0x7f472406db20 2023-11-04T01:42:42.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.871+0000 7f4723fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47240b0910 0x7f4724155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.871+0000 7f4723fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47240b0910 0x7f4724155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59312/0 (socket says 172.21.15.77:59312) 2023-11-04T01:42:42.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.871+0000 7f4723fff640 1 -- 172.21.15.77:0/610400544 learned_addr learned my addr 172.21.15.77:0/610400544 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:42.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.871+0000 7f472934d640 1 --2- 172.21.15.77:0/610400544 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4724159c70 0x7f4724070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.871+0000 7f4728b4c640 1 --2- 172.21.15.77:0/610400544 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f472406db20 0x7f472414dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.871+0000 7f4723fff640 1 -- 172.21.15.77:0/610400544 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f472406db20 msgr2=0x7f472414dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.871+0000 7f4723fff640 1 --2- 172.21.15.77:0/610400544 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f472406db20 0x7f472414dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.871+0000 7f4723fff640 1 -- 172.21.15.77:0/610400544 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4724159c70 msgr2=0x7f4724070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.871+0000 7f4723fff640 1 --2- 172.21.15.77:0/610400544 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4724159c70 0x7f4724070710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.871+0000 7f4723fff640 1 -- 172.21.15.77:0/610400544 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f471c009b30 con 0x7f47240b0910 2023-11-04T01:42:42.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.871+0000 7f4723fff640 1 --2- 172.21.15.77:0/610400544 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47240b0910 0x7f4724155cd0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f471000c7c0 tx=0x7f471000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:42.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.871+0000 7f47217fa640 1 -- 172.21.15.77:0/610400544 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4710007a30 con 0x7f47240b0910 2023-11-04T01:42:42.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.871+0000 7f47217fa640 1 -- 172.21.15.77:0/610400544 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4710007b90 con 0x7f47240b0910 2023-11-04T01:42:42.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.871+0000 7f472adb0640 1 -- 172.21.15.77:0/610400544 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4724156ae0 con 0x7f47240b0910 2023-11-04T01:42:42.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.871+0000 7f47217fa640 1 -- 172.21.15.77:0/610400544 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471000ce70 con 0x7f47240b0910 2023-11-04T01:42:42.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.871+0000 7f472adb0640 1 -- 172.21.15.77:0/610400544 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f472414e420 con 0x7f47240b0910 2023-11-04T01:42:42.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.872+0000 7f472adb0640 1 -- 172.21.15.77:0/610400544 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f472415bde0 con 0x7f47240b0910 2023-11-04T01:42:42.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.873+0000 7f47217fa640 1 -- 172.21.15.77:0/610400544 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f47100113f0 con 0x7f47240b0910 2023-11-04T01:42:42.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.873+0000 7f47217fa640 1 --2- 172.21.15.77:0/610400544 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f470806ae70 0x7f470806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.873+0000 7f47217fa640 1 -- 172.21.15.77:0/610400544 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f4710089cc0 con 0x7f47240b0910 2023-11-04T01:42:42.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.873+0000 7f4728b4c640 1 --2- 172.21.15.77:0/610400544 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f470806ae70 0x7f470806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.874+0000 7f4728b4c640 1 --2- 172.21.15.77:0/610400544 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f470806ae70 0x7f470806d330 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f472415b8e0 tx=0x7f4718008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:42.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:42.877+0000 7f47217fa640 1 -- 172.21.15.77:0/610400544 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f472415bde0 con 0x7f47240b0910 2023-11-04T01:42:43.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.076+0000 7f472adb0640 1 -- 172.21.15.77:0/610400544 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f472415bde0 con 0x7f47240b0910 2023-11-04T01:42:43.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.076+0000 7f47217fa640 1 -- 172.21.15.77:0/610400544 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f472415bde0 con 0x7f47240b0910 2023-11-04T01:42:43.078 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:43.079 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6396,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/20625239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":20625239},{"type":"v1","addr":"172.21.15.77:6834","nonce":20625239}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6399,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3909793035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3909793035},{"type":"v1","addr":"172.21.15.77:6835","nonce":3909793035}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":35252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/1714919040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1714919040},{"type":"v1","addr":"172.21.15.122:6836","nonce":1714919040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:42:23.999994+0000","modified":"2023-11-04T01:42:26.916361+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":35255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35255":{"gid":35255,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/1606545578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1606545578},{"type":"v1","addr":"172.21.15.122:6837","nonce":1606545578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-04T01:42:43.079 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 29 2023-11-04T01:42:43.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.078+0000 7f472adb0640 1 -- 172.21.15.77:0/610400544 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f470806ae70 msgr2=0x7f470806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.078+0000 7f472adb0640 1 --2- 172.21.15.77:0/610400544 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f470806ae70 0x7f470806d330 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f472415b8e0 tx=0x7f4718008040 comp rx=0 tx=0).stop 2023-11-04T01:42:43.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.078+0000 7f472adb0640 1 -- 172.21.15.77:0/610400544 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47240b0910 msgr2=0x7f4724155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.078+0000 7f472adb0640 1 --2- 172.21.15.77:0/610400544 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47240b0910 0x7f4724155cd0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f471000c7c0 tx=0x7f471000cc80 comp rx=0 tx=0).stop 2023-11-04T01:42:43.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.078+0000 7f472adb0640 1 -- 172.21.15.77:0/610400544 shutdown_connections 2023-11-04T01:42:43.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.078+0000 7f472adb0640 1 --2- 172.21.15.77:0/610400544 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f470806ae70 0x7f470806d330 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.078+0000 7f472adb0640 1 --2- 172.21.15.77:0/610400544 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4724159c70 0x7f4724070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.078+0000 7f472adb0640 1 --2- 172.21.15.77:0/610400544 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47240b0910 0x7f4724155cd0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.078+0000 7f472adb0640 1 --2- 172.21.15.77:0/610400544 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f472406db20 0x7f472414dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.078+0000 7f472adb0640 1 -- 172.21.15.77:0/610400544 >> 172.21.15.77:0/610400544 conn(0x7f47240ce950 msgr2=0x7f47240c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:43.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.078+0000 7f472adb0640 1 -- 172.21.15.77:0/610400544 shutdown_connections 2023-11-04T01:42:43.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.078+0000 7f472adb0640 1 -- 172.21.15.77:0/610400544 wait complete. 2023-11-04T01:42:43.091 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:43.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.188+0000 7fb513626640 1 Processor -- start 2023-11-04T01:42:43.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.188+0000 7fb513626640 1 -- start start 2023-11-04T01:42:43.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.189+0000 7fb513626640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb50c159c70 0x7fb50c0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.189+0000 7fb513626640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb50c0b0ae0 0x7fb50c15d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.189+0000 7fb513626640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb50c0b4110 con 0x7fb50c06db20 2023-11-04T01:42:43.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.189+0000 7fb513626640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb50c0b49b0 con 0x7fb50c0b0ae0 2023-11-04T01:42:43.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.189+0000 7fb513626640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c0b43f0 con 0x7fb50c159c70 2023-11-04T01:42:43.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.189+0000 7fb511bc3640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb50c0b0ae0 0x7fb50c15d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.189+0000 7fb511bc3640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb50c0b0ae0 0x7fb50c15d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59322/0 (socket says 172.21.15.77:59322) 2023-11-04T01:42:43.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.189+0000 7fb511bc3640 1 -- 172.21.15.77:0/84071382 learned_addr learned my addr 172.21.15.77:0/84071382 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:43.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.189+0000 7fb5113c2640 1 --2- 172.21.15.77:0/84071382 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb50c159c70 0x7fb50c0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.189+0000 7fb511bc3640 1 -- 172.21.15.77:0/84071382 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb50c159c70 msgr2=0x7fb50c0ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:43.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.189+0000 7fb511bc3640 1 --2- 172.21.15.77:0/84071382 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb50c159c70 0x7fb50c0ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.189+0000 7fb511bc3640 1 -- 172.21.15.77:0/84071382 >> v1:172.21.15.122:6789/0 conn(0x7fb50c06db20 legacy=0x7fb50c0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:43.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.189+0000 7fb511bc3640 1 -- 172.21.15.77:0/84071382 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb50c0b46d0 con 0x7fb50c0b0ae0 2023-11-04T01:42:43.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.190+0000 7fb511bc3640 1 --2- 172.21.15.77:0/84071382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb50c0b0ae0 0x7fb50c15d7d0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fb504009870 tx=0x7fb50402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af485d77b2c1ec07 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:43.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.190+0000 7fb503fff640 1 -- 172.21.15.77:0/84071382 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb504031640 con 0x7fb50c0b0ae0 2023-11-04T01:42:43.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.190+0000 7fb503fff640 1 -- 172.21.15.77:0/84071382 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5040317a0 con 0x7fb50c0b0ae0 2023-11-04T01:42:43.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.190+0000 7fb503fff640 1 -- 172.21.15.77:0/84071382 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb504031b30 con 0x7fb50c0b0ae0 2023-11-04T01:42:43.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.191+0000 7fb513626640 1 -- 172.21.15.77:0/84071382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb50c0b0ae0 msgr2=0x7fb50c15d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.191+0000 7fb513626640 1 --2- 172.21.15.77:0/84071382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb50c0b0ae0 0x7fb50c15d7d0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fb504009870 tx=0x7fb50402b8f0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.191+0000 7fb513626640 1 -- 172.21.15.77:0/84071382 shutdown_connections 2023-11-04T01:42:43.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.191+0000 7fb513626640 1 --2- 172.21.15.77:0/84071382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb50c0b0ae0 0x7fb50c15d7d0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.191+0000 7fb513626640 1 --2- 172.21.15.77:0/84071382 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb50c159c70 0x7fb50c0ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.191+0000 7fb513626640 1 -- 172.21.15.77:0/84071382 >> 172.21.15.77:0/84071382 conn(0x7fb50c0ce950 msgr2=0x7fb50c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:43.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.191+0000 7fb513626640 1 -- 172.21.15.77:0/84071382 shutdown_connections 2023-11-04T01:42:43.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.191+0000 7fb513626640 1 -- 172.21.15.77:0/84071382 wait complete. 2023-11-04T01:42:43.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.192+0000 7fb513626640 1 Processor -- start 2023-11-04T01:42:43.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.192+0000 7fb513626640 1 -- start start 2023-11-04T01:42:43.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.193+0000 7fb513626640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb50c06db20 0x7fb50c153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.193+0000 7fb513626640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb50c0b0ae0 0x7fb50c15bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.193+0000 7fb513626640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb50c159c70 0x7fb50c0c6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.193+0000 7fb513626640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c15c440 con 0x7fb50c0b0ae0 2023-11-04T01:42:43.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.193+0000 7fb513626640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c15c720 con 0x7fb50c159c70 2023-11-04T01:42:43.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.193+0000 7fb513626640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c0c5a30 con 0x7fb50c06db20 2023-11-04T01:42:43.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.193+0000 7fb510bc1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb50c0b0ae0 0x7fb50c15bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.193+0000 7fb510bc1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb50c0b0ae0 0x7fb50c15bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59326/0 (socket says 172.21.15.77:59326) 2023-11-04T01:42:43.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.193+0000 7fb510bc1640 1 -- 172.21.15.77:0/2373006382 learned_addr learned my addr 172.21.15.77:0/2373006382 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:43.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.193+0000 7fb5113c2640 1 --2- 172.21.15.77:0/2373006382 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb50c06db20 0x7fb50c153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.193+0000 7fb511bc3640 1 --2- 172.21.15.77:0/2373006382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb50c159c70 0x7fb50c0c6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.193+0000 7fb510bc1640 1 -- 172.21.15.77:0/2373006382 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb50c06db20 msgr2=0x7fb50c153fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.193+0000 7fb510bc1640 1 --2- 172.21.15.77:0/2373006382 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb50c06db20 0x7fb50c153fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.193+0000 7fb510bc1640 1 -- 172.21.15.77:0/2373006382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb50c159c70 msgr2=0x7fb50c0c6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.193+0000 7fb510bc1640 1 --2- 172.21.15.77:0/2373006382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb50c159c70 0x7fb50c0c6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.193+0000 7fb510bc1640 1 -- 172.21.15.77:0/2373006382 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5040094d0 con 0x7fb50c0b0ae0 2023-11-04T01:42:43.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.193+0000 7fb5113c2640 1 --2- 172.21.15.77:0/2373006382 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb50c06db20 0x7fb50c153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:43.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.193+0000 7fb510bc1640 1 --2- 172.21.15.77:0/2373006382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb50c0b0ae0 0x7fb50c15bbf0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00c430 tx=0x7fb4fc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:43.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.193+0000 7fb501ffb640 1 -- 172.21.15.77:0/2373006382 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc011790 con 0x7fb50c0b0ae0 2023-11-04T01:42:43.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.193+0000 7fb501ffb640 1 -- 172.21.15.77:0/2373006382 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4fc0118f0 con 0x7fb50c0b0ae0 2023-11-04T01:42:43.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.193+0000 7fb513626640 1 -- 172.21.15.77:0/2373006382 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb50c0c5d10 con 0x7fb50c0b0ae0 2023-11-04T01:42:43.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.193+0000 7fb501ffb640 1 -- 172.21.15.77:0/2373006382 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc011ce0 con 0x7fb50c0b0ae0 2023-11-04T01:42:43.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.194+0000 7fb513626640 1 -- 172.21.15.77:0/2373006382 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb50c15ca00 con 0x7fb50c0b0ae0 2023-11-04T01:42:43.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.195+0000 7fb513626640 1 -- 172.21.15.77:0/2373006382 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb50c0cc470 con 0x7fb50c0b0ae0 2023-11-04T01:42:43.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.195+0000 7fb501ffb640 1 -- 172.21.15.77:0/2373006382 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb4fc01c460 con 0x7fb50c0b0ae0 2023-11-04T01:42:43.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.195+0000 7fb501ffb640 1 --2- 172.21.15.77:0/2373006382 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb4f006aea0 0x7fb4f006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.196+0000 7fb501ffb640 1 -- 172.21.15.77:0/2373006382 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fb4fc089a90 con 0x7fb50c0b0ae0 2023-11-04T01:42:43.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.196+0000 7fb5113c2640 1 --2- 172.21.15.77:0/2373006382 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb4f006aea0 0x7fb4f006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.196+0000 7fb5113c2640 1 --2- 172.21.15.77:0/2373006382 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb4f006aea0 0x7fb4f006d360 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb508009a80 tx=0x7fb5080039d0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:43.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.200+0000 7fb501ffb640 1 -- 172.21.15.77:0/2373006382 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb4fc0545c0 con 0x7fb50c0b0ae0 2023-11-04T01:42:43.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.401+0000 7fb513626640 1 -- 172.21.15.77:0/2373006382 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb50c0c5f00 con 0x7fb50c0b0ae0 2023-11-04T01:42:43.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.402+0000 7fb501ffb640 1 -- 172.21.15.77:0/2373006382 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+4919 (secure 0 0 0) 0x7fb4fc087e60 con 0x7fb50c0b0ae0 2023-11-04T01:42:43.404 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:43.404 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6396,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/20625239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":20625239},{"type":"v1","addr":"172.21.15.77:6834","nonce":20625239}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6399,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3909793035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3909793035},{"type":"v1","addr":"172.21.15.77:6835","nonce":3909793035}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":35252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/1714919040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1714919040},{"type":"v1","addr":"172.21.15.122:6836","nonce":1714919040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:42:23.999994+0000","modified":"2023-11-04T01:42:26.916361+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":35255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35255":{"gid":35255,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/1606545578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1606545578},{"type":"v1","addr":"172.21.15.122:6837","nonce":1606545578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-04T01:42:43.405 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 29 2023-11-04T01:42:43.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.404+0000 7fb513626640 1 -- 172.21.15.77:0/2373006382 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb4f006aea0 msgr2=0x7fb4f006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.404+0000 7fb513626640 1 --2- 172.21.15.77:0/2373006382 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb4f006aea0 0x7fb4f006d360 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb508009a80 tx=0x7fb5080039d0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.404+0000 7fb513626640 1 -- 172.21.15.77:0/2373006382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb50c0b0ae0 msgr2=0x7fb50c15bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.404+0000 7fb513626640 1 --2- 172.21.15.77:0/2373006382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb50c0b0ae0 0x7fb50c15bbf0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00c430 tx=0x7fb4fc00c8f0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.404+0000 7fb513626640 1 -- 172.21.15.77:0/2373006382 shutdown_connections 2023-11-04T01:42:43.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.404+0000 7fb513626640 1 --2- 172.21.15.77:0/2373006382 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb4f006aea0 0x7fb4f006d360 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.404+0000 7fb513626640 1 --2- 172.21.15.77:0/2373006382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb50c159c70 0x7fb50c0c6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.404+0000 7fb513626640 1 --2- 172.21.15.77:0/2373006382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb50c0b0ae0 0x7fb50c15bbf0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.404+0000 7fb513626640 1 --2- 172.21.15.77:0/2373006382 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb50c06db20 0x7fb50c153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.404+0000 7fb513626640 1 -- 172.21.15.77:0/2373006382 >> 172.21.15.77:0/2373006382 conn(0x7fb50c0ce950 msgr2=0x7fb50c0b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:43.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.404+0000 7fb513626640 1 -- 172.21.15.77:0/2373006382 shutdown_connections 2023-11-04T01:42:43.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.404+0000 7fb513626640 1 -- 172.21.15.77:0/2373006382 wait complete. 2023-11-04T01:42:43.416 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:43.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.514+0000 7f5987634640 1 Processor -- start 2023-11-04T01:42:43.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.514+0000 7f5987634640 1 -- start start 2023-11-04T01:42:43.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.515+0000 7f5987634640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f59800b42c0 0x7f59800c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.515+0000 7f5987634640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f59800c9c40 0x7f59800b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.515+0000 7f5987634640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59800ca090 con 0x7f598015ad80 2023-11-04T01:42:43.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.515+0000 7f5987634640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f598006cfa0 con 0x7f59800c9c40 2023-11-04T01:42:43.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.515+0000 7f5987634640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f598006d280 con 0x7f59800b42c0 2023-11-04T01:42:43.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.515+0000 7f59853d0640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f598015ad80 0x7f598006c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:38882/0 (socket says 172.21.15.77:38882) 2023-11-04T01:42:43.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.515+0000 7f59853d0640 1 -- 172.21.15.77:0/1719945982 learned_addr learned my addr 172.21.15.77:0/1719945982 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:43.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.515+0000 7f5984bcf640 1 --2- 172.21.15.77:0/1719945982 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f59800b42c0 0x7f59800c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.515+0000 7f5985bd1640 1 --2- 172.21.15.77:0/1719945982 >> v2:172.21.15.122:3300/0 conn(0x7f59800c9c40 0x7f59800b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.515+0000 7f5977fff640 1 -- 172.21.15.77:0/1719945982 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4224693438 0 0) 0x7f597c001490 con 0x7f598015ad80 2023-11-04T01:42:43.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.516+0000 7f5977fff640 1 -- 172.21.15.77:0/1719945982 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f596c003520 con 0x7f598015ad80 2023-11-04T01:42:43.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.516+0000 7f5977fff640 1 -- 172.21.15.77:0/1719945982 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3285095102 0 0) 0x7f596c003520 con 0x7f598015ad80 2023-11-04T01:42:43.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.516+0000 7f5977fff640 1 -- 172.21.15.77:0/1719945982 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f59800b42c0 msgr2=0x7f59800c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:43.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.516+0000 7f5977fff640 1 --2- 172.21.15.77:0/1719945982 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f59800b42c0 0x7f59800c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.516+0000 7f5977fff640 1 -- 172.21.15.77:0/1719945982 >> v2:172.21.15.122:3300/0 conn(0x7f59800c9c40 msgr2=0x7f59800b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:43.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.516+0000 7f5977fff640 1 --2- 172.21.15.77:0/1719945982 >> v2:172.21.15.122:3300/0 conn(0x7f59800c9c40 0x7f59800b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.516+0000 7f5977fff640 1 -- 172.21.15.77:0/1719945982 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f598006d560 con 0x7f598015ad80 2023-11-04T01:42:43.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.516+0000 7f5977fff640 1 -- 172.21.15.77:0/1719945982 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f597c001b80 con 0x7f598015ad80 2023-11-04T01:42:43.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.516+0000 7f5977fff640 1 -- 172.21.15.77:0/1719945982 >> v1:172.21.15.77:6789/0 conn(0x7f598015ad80 legacy=0x7f598006c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.516+0000 7f5977fff640 1 --2- 172.21.15.77:0/1719945982 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f596c003970 0x7f596c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.516+0000 7f5977fff640 1 --2- 172.21.15.77:0/1719945982 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f596c0047c0 0x7f596c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.516+0000 7f5977fff640 1 --2- 172.21.15.77:0/1719945982 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f59800b42c0 0x7f596c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.516+0000 7f5977fff640 1 -- 172.21.15.77:0/1719945982 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598006cfa0 con 0x7f596c003970 2023-11-04T01:42:43.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.516+0000 7f5977fff640 1 -- 172.21.15.77:0/1719945982 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598006d280 con 0x7f596c0047c0 2023-11-04T01:42:43.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.516+0000 7f5977fff640 1 -- 172.21.15.77:0/1719945982 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596c00b980 con 0x7f59800b42c0 2023-11-04T01:42:43.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.516+0000 7f59853d0640 1 --2- 172.21.15.77:0/1719945982 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f596c003970 0x7f596c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.516+0000 7f5984bcf640 1 --2- 172.21.15.77:0/1719945982 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f596c0047c0 0x7f596c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.516+0000 7f5985bd1640 1 --2- 172.21.15.77:0/1719945982 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f59800b42c0 0x7f596c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.516+0000 7f59853d0640 1 -- 172.21.15.77:0/1719945982 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f59800b42c0 msgr2=0x7f596c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:43.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.516+0000 7f59853d0640 1 --2- 172.21.15.77:0/1719945982 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f59800b42c0 0x7f596c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.516+0000 7f59853d0640 1 -- 172.21.15.77:0/1719945982 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f596c0047c0 msgr2=0x7f596c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:43.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.516+0000 7f59853d0640 1 --2- 172.21.15.77:0/1719945982 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f596c0047c0 0x7f596c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.516+0000 7f59853d0640 1 -- 172.21.15.77:0/1719945982 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f596c003520 con 0x7f596c003970 2023-11-04T01:42:43.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.516+0000 7f5984bcf640 1 --2- 172.21.15.77:0/1719945982 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f596c0047c0 0x7f596c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:43.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.517+0000 7f59853d0640 1 --2- 172.21.15.77:0/1719945982 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f596c003970 0x7f596c003d90 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f597c00a5e0 tx=0x7f596c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a42812ae2d4b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:43.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.517+0000 7f5977fff640 1 -- 172.21.15.77:0/1719945982 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597c034670 con 0x7f596c003970 2023-11-04T01:42:43.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.517+0000 7f5977fff640 1 -- 172.21.15.77:0/1719945982 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597c0347d0 con 0x7f596c003970 2023-11-04T01:42:43.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.517+0000 7f5977fff640 1 -- 172.21.15.77:0/1719945982 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597c034b80 con 0x7f596c003970 2023-11-04T01:42:43.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.518+0000 7f5987634640 1 -- 172.21.15.77:0/1719945982 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f596c003970 msgr2=0x7f596c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.518+0000 7f5987634640 1 --2- 172.21.15.77:0/1719945982 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f596c003970 0x7f596c003d90 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f597c00a5e0 tx=0x7f596c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.518+0000 7f5985bd1640 1 -- 172.21.15.77:0/1719945982 reap_dead start 2023-11-04T01:42:43.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.518+0000 7f5987634640 1 -- 172.21.15.77:0/1719945982 shutdown_connections 2023-11-04T01:42:43.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.518+0000 7f5987634640 1 -- 172.21.15.77:0/1719945982 >> 172.21.15.77:0/1719945982 conn(0x7f59800ce950 msgr2=0x7f59800ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:43.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.518+0000 7f5987634640 1 -- 172.21.15.77:0/1719945982 shutdown_connections 2023-11-04T01:42:43.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.518+0000 7f5987634640 1 -- 172.21.15.77:0/1719945982 wait complete. 2023-11-04T01:42:43.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.519+0000 7f5987634640 1 Processor -- start 2023-11-04T01:42:43.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.519+0000 7f5987634640 1 -- start start 2023-11-04T01:42:43.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.520+0000 7f5987634640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f596c003970 0x7f59800c5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.520+0000 7f5987634640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f59801469d0 0x7f5980146e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.520+0000 7f5987634640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59800c7900 0x7f59800c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.520+0000 7f5987634640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5980147390 con 0x7f59800c7900 2023-11-04T01:42:43.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.520+0000 7f5987634640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59800c8c80 con 0x7f596c003970 2023-11-04T01:42:43.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.520+0000 7f5987634640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59800c86c0 con 0x7f59801469d0 2023-11-04T01:42:43.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.520+0000 7f5985bd1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59800c7900 0x7f59800c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.520+0000 7f5985bd1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59800c7900 0x7f59800c7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59342/0 (socket says 172.21.15.77:59342) 2023-11-04T01:42:43.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.520+0000 7f5985bd1640 1 -- 172.21.15.77:0/1284035373 learned_addr learned my addr 172.21.15.77:0/1284035373 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:43.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.520+0000 7f5984bcf640 1 --2- 172.21.15.77:0/1284035373 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f59801469d0 0x7f5980146e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.520+0000 7f59853d0640 1 --2- 172.21.15.77:0/1284035373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f596c003970 0x7f59800c5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.520+0000 7f5985bd1640 1 -- 172.21.15.77:0/1284035373 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f59801469d0 msgr2=0x7f5980146e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.520+0000 7f5985bd1640 1 --2- 172.21.15.77:0/1284035373 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f59801469d0 0x7f5980146e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.520+0000 7f5985bd1640 1 -- 172.21.15.77:0/1284035373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f596c003970 msgr2=0x7f59800c5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.520+0000 7f5985bd1640 1 --2- 172.21.15.77:0/1284035373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f596c003970 0x7f59800c5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.520+0000 7f5985bd1640 1 -- 172.21.15.77:0/1284035373 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59800c89a0 con 0x7f59800c7900 2023-11-04T01:42:43.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.520+0000 7f59853d0640 1 --2- 172.21.15.77:0/1284035373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f596c003970 0x7f59800c5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:43.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.520+0000 7f5985bd1640 1 --2- 172.21.15.77:0/1284035373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59800c7900 0x7f59800c7db0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f59800ce730 tx=0x7f5978009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:43.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.520+0000 7f5975ffb640 1 -- 172.21.15.77:0/1284035373 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5978004440 con 0x7f59800c7900 2023-11-04T01:42:43.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.520+0000 7f5975ffb640 1 -- 172.21.15.77:0/1284035373 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5978003610 con 0x7f59800c7900 2023-11-04T01:42:43.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.520+0000 7f5987634640 1 -- 172.21.15.77:0/1284035373 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f598015b810 con 0x7f59800c7900 2023-11-04T01:42:43.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.520+0000 7f5975ffb640 1 -- 172.21.15.77:0/1284035373 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5978003a00 con 0x7f59800c7900 2023-11-04T01:42:43.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.521+0000 7f5987634640 1 -- 172.21.15.77:0/1284035373 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59800c82f0 con 0x7f59800c7900 2023-11-04T01:42:43.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.522+0000 7f5987634640 1 -- 172.21.15.77:0/1284035373 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f598015bd30 con 0x7f59800c7900 2023-11-04T01:42:43.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.522+0000 7f5975ffb640 1 -- 172.21.15.77:0/1284035373 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5978003b60 con 0x7f59800c7900 2023-11-04T01:42:43.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.522+0000 7f5975ffb640 1 --2- 172.21.15.77:0/1284035373 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f596406ae70 0x7f596406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.522+0000 7f5975ffb640 1 -- 172.21.15.77:0/1284035373 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f5978089fc0 con 0x7f59800c7900 2023-11-04T01:42:43.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.523+0000 7f59853d0640 1 --2- 172.21.15.77:0/1284035373 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f596406ae70 0x7f596406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.523+0000 7f59853d0640 1 --2- 172.21.15.77:0/1284035373 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f596406ae70 0x7f596406d330 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f597c039000 tx=0x7f597c009030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:43.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.526+0000 7f5975ffb640 1 -- 172.21.15.77:0/1284035373 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f598015bd30 con 0x7f59800c7900 2023-11-04T01:42:43.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.696+0000 7f5987634640 1 -- 172.21.15.77:0/1284035373 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f598015bd30 con 0x7f59800c7900 2023-11-04T01:42:43.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.697+0000 7f5975ffb640 1 -- 172.21.15.77:0/1284035373 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+22045 (secure 0 0 0) 0x7f598015bd30 con 0x7f59800c7900 2023-11-04T01:42:43.699 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:43.700 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":71,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:42:40.572098+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:22.500204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:22.966681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:33.159064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:33.647358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":12,"snaps":[{"begin":1,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:43.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.699+0000 7f5987634640 1 -- 172.21.15.77:0/1284035373 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f596406ae70 msgr2=0x7f596406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.699+0000 7f5987634640 1 --2- 172.21.15.77:0/1284035373 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f596406ae70 0x7f596406d330 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f597c039000 tx=0x7f597c009030 comp rx=0 tx=0).stop 2023-11-04T01:42:43.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.699+0000 7f5987634640 1 -- 172.21.15.77:0/1284035373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59800c7900 msgr2=0x7f59800c7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.699+0000 7f5987634640 1 --2- 172.21.15.77:0/1284035373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59800c7900 0x7f59800c7db0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f59800ce730 tx=0x7f5978009f90 comp rx=0 tx=0).stop 2023-11-04T01:42:43.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.699+0000 7f5987634640 1 -- 172.21.15.77:0/1284035373 shutdown_connections 2023-11-04T01:42:43.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.699+0000 7f5987634640 1 --2- 172.21.15.77:0/1284035373 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f596406ae70 0x7f596406d330 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.699+0000 7f5987634640 1 --2- 172.21.15.77:0/1284035373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59800c7900 0x7f59800c7db0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.699+0000 7f5987634640 1 --2- 172.21.15.77:0/1284035373 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f59801469d0 0x7f5980146e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.699+0000 7f5987634640 1 --2- 172.21.15.77:0/1284035373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f596c003970 0x7f59800c5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.699+0000 7f5987634640 1 -- 172.21.15.77:0/1284035373 >> 172.21.15.77:0/1284035373 conn(0x7f59800ce950 msgr2=0x7f59800b19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:43.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.699+0000 7f5987634640 1 -- 172.21.15.77:0/1284035373 shutdown_connections 2023-11-04T01:42:43.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.699+0000 7f5987634640 1 -- 172.21.15.77:0/1284035373 wait complete. 2023-11-04T01:42:43.712 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-04T01:42:43.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.812+0000 7f89a2832640 1 Processor -- start 2023-11-04T01:42:43.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.812+0000 7f89a2832640 1 -- start start 2023-11-04T01:42:43.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.812+0000 7f89a2832640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f899c0cdc20 0x7f899c165950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.812+0000 7f89a2832640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f899c0d0280 con 0x7f899c15e430 2023-11-04T01:42:43.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.812+0000 7f89a2832640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f899c0cf670 con 0x7f899c0d0710 2023-11-04T01:42:43.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.812+0000 7f89a2832640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f899c0cf950 con 0x7f899c0cdc20 2023-11-04T01:42:43.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.812+0000 7f89a0dcf640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f899c0cdc20 0x7f899c165950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.812+0000 7f899bfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f899c15e430 0x7f899c0cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:38890/0 (socket says 172.21.15.77:38890) 2023-11-04T01:42:43.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.812+0000 7f899bfff640 1 -- 172.21.15.77:0/2917829609 learned_addr learned my addr 172.21.15.77:0/2917829609 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:43.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.813+0000 7f89a0dcf640 1 -- 172.21.15.77:0/2917829609 >> v1:172.21.15.122:6789/0 conn(0x7f899c0d0710 legacy=0x7f899c0cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:43.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.813+0000 7f89a0dcf640 1 -- 172.21.15.77:0/2917829609 >> v1:172.21.15.77:6789/0 conn(0x7f899c15e430 legacy=0x7f899c0cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.813+0000 7f89a0dcf640 1 -- 172.21.15.77:0/2917829609 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899c0cfc30 con 0x7f899c0cdc20 2023-11-04T01:42:43.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.813+0000 7f89a0dcf640 1 --2- 172.21.15.77:0/2917829609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f899c0cdc20 0x7f899c165950 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f8994009d90 tx=0x7f899402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4388d7a88c2618e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:43.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.814+0000 7f899affd640 1 -- 172.21.15.77:0/2917829609 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899402cc60 con 0x7f899c0cdc20 2023-11-04T01:42:43.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.814+0000 7f899affd640 1 -- 172.21.15.77:0/2917829609 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899402cdc0 con 0x7f899c0cdc20 2023-11-04T01:42:43.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.814+0000 7f899affd640 1 -- 172.21.15.77:0/2917829609 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8994034660 con 0x7f899c0cdc20 2023-11-04T01:42:43.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.814+0000 7f89a2832640 1 -- 172.21.15.77:0/2917829609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f899c0cdc20 msgr2=0x7f899c165950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.814+0000 7f89a2832640 1 --2- 172.21.15.77:0/2917829609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f899c0cdc20 0x7f899c165950 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f8994009d90 tx=0x7f899402beb0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.814+0000 7f89a2832640 1 -- 172.21.15.77:0/2917829609 shutdown_connections 2023-11-04T01:42:43.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.814+0000 7f89a2832640 1 --2- 172.21.15.77:0/2917829609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f899c0cdc20 0x7f899c165950 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.814+0000 7f89a2832640 1 -- 172.21.15.77:0/2917829609 >> 172.21.15.77:0/2917829609 conn(0x7f899c06ea20 msgr2=0x7f899c06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:43.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.814+0000 7f89a2832640 1 -- 172.21.15.77:0/2917829609 shutdown_connections 2023-11-04T01:42:43.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.814+0000 7f89a2832640 1 -- 172.21.15.77:0/2917829609 wait complete. 2023-11-04T01:42:43.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.815+0000 7f89a2832640 1 Processor -- start 2023-11-04T01:42:43.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.815+0000 7f89a2832640 1 -- start start 2023-11-04T01:42:43.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.816+0000 7f89a2832640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f899c0cdc20 0x7f899c158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.816+0000 7f89a2832640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f899c0d0710 0x7f899c1f2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.816+0000 7f89a2832640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f899c15e430 0x7f899c0b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.816+0000 7f89a2832640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899c1f3b80 con 0x7f899c15e430 2023-11-04T01:42:43.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.816+0000 7f89a2832640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899c1f35c0 con 0x7f899c0cdc20 2023-11-04T01:42:43.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.816+0000 7f89a2832640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f899c1f38a0 con 0x7f899c0d0710 2023-11-04T01:42:43.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.816+0000 7f89a0dcf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f899c15e430 0x7f899c0b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.816+0000 7f89a0dcf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f899c15e430 0x7f899c0b05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59366/0 (socket says 172.21.15.77:59366) 2023-11-04T01:42:43.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.816+0000 7f89a0dcf640 1 -- 172.21.15.77:0/1136911280 learned_addr learned my addr 172.21.15.77:0/1136911280 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:43.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.816+0000 7f899bfff640 1 --2- 172.21.15.77:0/1136911280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f899c0cdc20 0x7f899c158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.816+0000 7f899b7fe640 1 --2- 172.21.15.77:0/1136911280 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f899c0d0710 0x7f899c1f2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.816+0000 7f89a0dcf640 1 -- 172.21.15.77:0/1136911280 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f899c0d0710 msgr2=0x7f899c1f2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.816+0000 7f89a0dcf640 1 --2- 172.21.15.77:0/1136911280 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f899c0d0710 0x7f899c1f2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.816+0000 7f89a0dcf640 1 -- 172.21.15.77:0/1136911280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f899c0cdc20 msgr2=0x7f899c158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:43.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.816+0000 7f89a0dcf640 1 --2- 172.21.15.77:0/1136911280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f899c0cdc20 0x7f899c158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:43.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.817+0000 7f89a0dcf640 1 -- 172.21.15.77:0/1136911280 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8994009a70 con 0x7f899c15e430 2023-11-04T01:42:43.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.817+0000 7f899bfff640 1 --2- 172.21.15.77:0/1136911280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f899c0cdc20 0x7f899c158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:43.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.817+0000 7f89a0dcf640 1 --2- 172.21.15.77:0/1136911280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f899c15e430 0x7f899c0b05e0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f8994009d90 tx=0x7f8994004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:43.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.817+0000 7f8998ff9640 1 -- 172.21.15.77:0/1136911280 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8994040450 con 0x7f899c15e430 2023-11-04T01:42:43.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.817+0000 7f8998ff9640 1 -- 172.21.15.77:0/1136911280 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89940405d0 con 0x7f899c15e430 2023-11-04T01:42:43.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.817+0000 7f8998ff9640 1 -- 172.21.15.77:0/1136911280 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8994040980 con 0x7f899c15e430 2023-11-04T01:42:43.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.817+0000 7f89a2832640 1 -- 172.21.15.77:0/1136911280 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f899c0b2320 con 0x7f899c15e430 2023-11-04T01:42:43.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.817+0000 7f89a2832640 1 -- 172.21.15.77:0/1136911280 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f899c1589a0 con 0x7f899c15e430 2023-11-04T01:42:43.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.818+0000 7f89a2832640 1 -- 172.21.15.77:0/1136911280 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f899c0b2840 con 0x7f899c15e430 2023-11-04T01:42:43.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.818+0000 7f8998ff9640 1 -- 172.21.15.77:0/1136911280 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8994040ae0 con 0x7f899c15e430 2023-11-04T01:42:43.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.819+0000 7f8998ff9640 1 --2- 172.21.15.77:0/1136911280 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f898806ae70 0x7f898806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:43.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.819+0000 7f8998ff9640 1 -- 172.21.15.77:0/1136911280 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f89940ac680 con 0x7f899c15e430 2023-11-04T01:42:43.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.819+0000 7f899bfff640 1 --2- 172.21.15.77:0/1136911280 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f898806ae70 0x7f898806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:43.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.819+0000 7f899bfff640 1 --2- 172.21.15.77:0/1136911280 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f898806ae70 0x7f898806d330 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f898c007fd0 tx=0x7f898c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:43.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:43.823+0000 7f8998ff9640 1 -- 172.21.15.77:0/1136911280 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f899c0b2840 con 0x7f899c15e430 2023-11-04T01:42:44.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.023+0000 7f89a2832640 1 -- 172.21.15.77:0/1136911280 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f899c0b2840 con 0x7f899c15e430 2023-11-04T01:42:44.025 INFO:tasks.ceph.mon.a.smithi077.stderr:2023-11-04T01:42:44.023+0000 7f1217737640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-04T01:42:44.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.027+0000 7f8998ff9640 1 -- 172.21.15.77:0/1136911280 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v30) v1 ==== 161+0+0 (secure 0 0 0) 0x7f899c0b2840 con 0x7f899c15e430 2023-11-04T01:42:44.028 INFO:teuthology.orchestra.run.smithi077.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-04T01:42:44.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.029+0000 7f89a2832640 1 -- 172.21.15.77:0/1136911280 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f898806ae70 msgr2=0x7f898806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:44.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.029+0000 7f89a2832640 1 --2- 172.21.15.77:0/1136911280 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f898806ae70 0x7f898806d330 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f898c007fd0 tx=0x7f898c009040 comp rx=0 tx=0).stop 2023-11-04T01:42:44.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.029+0000 7f89a2832640 1 -- 172.21.15.77:0/1136911280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f899c15e430 msgr2=0x7f899c0b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:44.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.029+0000 7f89a2832640 1 --2- 172.21.15.77:0/1136911280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f899c15e430 0x7f899c0b05e0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f8994009d90 tx=0x7f8994004a40 comp rx=0 tx=0).stop 2023-11-04T01:42:44.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.029+0000 7f89a2832640 1 -- 172.21.15.77:0/1136911280 shutdown_connections 2023-11-04T01:42:44.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.029+0000 7f89a2832640 1 --2- 172.21.15.77:0/1136911280 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f898806ae70 0x7f898806d330 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.029+0000 7f89a2832640 1 --2- 172.21.15.77:0/1136911280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f899c15e430 0x7f899c0b05e0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.029+0000 7f89a2832640 1 --2- 172.21.15.77:0/1136911280 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f899c0d0710 0x7f899c1f2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.029+0000 7f89a2832640 1 --2- 172.21.15.77:0/1136911280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f899c0cdc20 0x7f899c158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.029+0000 7f89a2832640 1 -- 172.21.15.77:0/1136911280 >> 172.21.15.77:0/1136911280 conn(0x7f899c06ea20 msgr2=0x7f899c0c6760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:44.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.029+0000 7f89a2832640 1 -- 172.21.15.77:0/1136911280 shutdown_connections 2023-11-04T01:42:44.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.029+0000 7f89a2832640 1 -- 172.21.15.77:0/1136911280 wait complete. 2023-11-04T01:42:44.033 INFO:tasks.ceph.mds.b.smithi122.stderr: -733> 2023-11-04T01:42:29.928+0000 7efda30c6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:42:44.042 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-04T01:42:44.061 INFO:tasks.ceph.mds.b.smithi122.stdout:starting mds.b at 2023-11-04T01:42:44.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.143+0000 7f069e3c0640 1 Processor -- start 2023-11-04T01:42:44.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.143+0000 7f069e3c0640 1 -- start start 2023-11-04T01:42:44.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.144+0000 7f069e3c0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f069815ad30 0x7f06980adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.144+0000 7f069e3c0640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f06980ad730 0x7f0698070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.144+0000 7f069e3c0640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f0698070c50 0x7f06980c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.144+0000 7f069e3c0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06980ae260 con 0x7f069815ad30 2023-11-04T01:42:44.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.144+0000 7f069e3c0640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06980710e0 con 0x7f0698070c50 2023-11-04T01:42:44.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.144+0000 7f069e3c0640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06980c3900 con 0x7f06980ad730 2023-11-04T01:42:44.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.144+0000 7f0697fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f069815ad30 0x7f06980adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.144+0000 7f0697fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f069815ad30 0x7f06980adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59378/0 (socket says 172.21.15.77:59378) 2023-11-04T01:42:44.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.144+0000 7f0697fff640 1 -- 172.21.15.77:0/562198574 learned_addr learned my addr 172.21.15.77:0/562198574 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:44.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.144+0000 7f06977fe640 1 --2- 172.21.15.77:0/562198574 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f06980ad730 0x7f0698070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.144+0000 7f069c95d640 1 --2- 172.21.15.77:0/562198574 >> v2:172.21.15.122:3300/0 conn(0x7f0698070c50 0x7f06980c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.144+0000 7f0697fff640 1 -- 172.21.15.77:0/562198574 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f06980ad730 msgr2=0x7f0698070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:44.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.144+0000 7f0697fff640 1 --2- 172.21.15.77:0/562198574 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f06980ad730 0x7f0698070710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.144+0000 7f0697fff640 1 -- 172.21.15.77:0/562198574 >> v2:172.21.15.122:3300/0 conn(0x7f0698070c50 msgr2=0x7f06980c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:44.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.144+0000 7f0697fff640 1 --2- 172.21.15.77:0/562198574 >> v2:172.21.15.122:3300/0 conn(0x7f0698070c50 0x7f06980c8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.144+0000 7f0697fff640 1 -- 172.21.15.77:0/562198574 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06980c3be0 con 0x7f069815ad30 2023-11-04T01:42:44.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.144+0000 7f06977fe640 1 --2- 172.21.15.77:0/562198574 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f06980ad730 0x7f0698070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:44.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.145+0000 7f0697fff640 1 --2- 172.21.15.77:0/562198574 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f069815ad30 0x7f06980adc80 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f0688009870 tx=0x7f068802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9366407beec8205 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:44.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.145+0000 7f0696ffd640 1 -- 172.21.15.77:0/562198574 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06880317c0 con 0x7f069815ad30 2023-11-04T01:42:44.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.145+0000 7f0696ffd640 1 -- 172.21.15.77:0/562198574 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0688031920 con 0x7f069815ad30 2023-11-04T01:42:44.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.145+0000 7f0696ffd640 1 -- 172.21.15.77:0/562198574 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0688031cb0 con 0x7f069815ad30 2023-11-04T01:42:44.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.145+0000 7f069e3c0640 1 -- 172.21.15.77:0/562198574 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f069815ad30 msgr2=0x7f06980adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:44.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.145+0000 7f069e3c0640 1 --2- 172.21.15.77:0/562198574 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f069815ad30 0x7f06980adc80 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f0688009870 tx=0x7f068802b860 comp rx=0 tx=0).stop 2023-11-04T01:42:44.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.145+0000 7f069e3c0640 1 -- 172.21.15.77:0/562198574 shutdown_connections 2023-11-04T01:42:44.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.145+0000 7f069e3c0640 1 --2- 172.21.15.77:0/562198574 >> v2:172.21.15.122:3300/0 conn(0x7f0698070c50 0x7f06980c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.145+0000 7f069e3c0640 1 --2- 172.21.15.77:0/562198574 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f06980ad730 0x7f0698070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.145+0000 7f069e3c0640 1 --2- 172.21.15.77:0/562198574 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f069815ad30 0x7f06980adc80 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.145+0000 7f069e3c0640 1 -- 172.21.15.77:0/562198574 >> 172.21.15.77:0/562198574 conn(0x7f06980ce950 msgr2=0x7f06980ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:44.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.146+0000 7f069e3c0640 1 -- 172.21.15.77:0/562198574 shutdown_connections 2023-11-04T01:42:44.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.146+0000 7f069e3c0640 1 -- 172.21.15.77:0/562198574 wait complete. 2023-11-04T01:42:44.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.147+0000 7f069e3c0640 1 Processor -- start 2023-11-04T01:42:44.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.147+0000 7f069e3c0640 1 -- start start 2023-11-04T01:42:44.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.147+0000 7f069e3c0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0698070c50 0x7f06980c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.147+0000 7f069e3c0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06980ad730 0x7f0698151e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.147+0000 7f069e3c0640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f069815ad30 0x7f0698152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.148+0000 7f069e3c0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06980c7150 con 0x7f0698070c50 2023-11-04T01:42:44.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.148+0000 7f069e3c0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06980c7430 con 0x7f06980ad730 2023-11-04T01:42:44.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.148+0000 7f069e3c0640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06980c7710 con 0x7f069815ad30 2023-11-04T01:42:44.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.148+0000 7f0697fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0698070c50 0x7f06980c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.148+0000 7f0697fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0698070c50 0x7f06980c6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59384/0 (socket says 172.21.15.77:59384) 2023-11-04T01:42:44.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.148+0000 7f0697fff640 1 -- 172.21.15.77:0/3960841027 learned_addr learned my addr 172.21.15.77:0/3960841027 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:44.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.148+0000 7f06977fe640 1 --2- 172.21.15.77:0/3960841027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06980ad730 0x7f0698151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.148+0000 7f069c95d640 1 --2- 172.21.15.77:0/3960841027 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f069815ad30 0x7f0698152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.148+0000 7f0697fff640 1 -- 172.21.15.77:0/3960841027 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f069815ad30 msgr2=0x7f0698152390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:44.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.148+0000 7f0697fff640 1 --2- 172.21.15.77:0/3960841027 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f069815ad30 0x7f0698152390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.148+0000 7f0697fff640 1 -- 172.21.15.77:0/3960841027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06980ad730 msgr2=0x7f0698151e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:44.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.148+0000 7f0697fff640 1 --2- 172.21.15.77:0/3960841027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06980ad730 0x7f0698151e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.148+0000 7f0697fff640 1 -- 172.21.15.77:0/3960841027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06880094d0 con 0x7f0698070c50 2023-11-04T01:42:44.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.148+0000 7f0697fff640 1 --2- 172.21.15.77:0/3960841027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0698070c50 0x7f06980c6a70 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f068802b8a0 tx=0x7f06880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:44.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.148+0000 7f0694ff9640 1 -- 172.21.15.77:0/3960841027 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0688032860 con 0x7f0698070c50 2023-11-04T01:42:44.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.148+0000 7f0694ff9640 1 -- 172.21.15.77:0/3960841027 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06880329e0 con 0x7f0698070c50 2023-11-04T01:42:44.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.148+0000 7f0694ff9640 1 -- 172.21.15.77:0/3960841027 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0688032d90 con 0x7f0698070c50 2023-11-04T01:42:44.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.148+0000 7f069e3c0640 1 -- 172.21.15.77:0/3960841027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06980c79f0 con 0x7f0698070c50 2023-11-04T01:42:44.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.148+0000 7f069e3c0640 1 -- 172.21.15.77:0/3960841027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06980c81f0 con 0x7f0698070c50 2023-11-04T01:42:44.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.149+0000 7f069e3c0640 1 -- 172.21.15.77:0/3960841027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0698074290 con 0x7f0698070c50 2023-11-04T01:42:44.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.150+0000 7f0694ff9640 1 -- 172.21.15.77:0/3960841027 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f068804e450 con 0x7f0698070c50 2023-11-04T01:42:44.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.150+0000 7f0694ff9640 1 --2- 172.21.15.77:0/3960841027 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f068406ae70 0x7f068406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.150+0000 7f0694ff9640 1 -- 172.21.15.77:0/3960841027 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7178+0+0 (secure 0 0 0) 0x7f06880abca0 con 0x7f0698070c50 2023-11-04T01:42:44.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.150+0000 7f06977fe640 1 --2- 172.21.15.77:0/3960841027 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f068406ae70 0x7f068406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.151+0000 7f06977fe640 1 --2- 172.21.15.77:0/3960841027 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f068406ae70 0x7f068406d330 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f06980ca640 tx=0x7f068c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:44.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.154+0000 7f0694ff9640 1 -- 172.21.15.77:0/3960841027 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0688076820 con 0x7f0698070c50 2023-11-04T01:42:44.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:44.355+0000 7f069e3c0640 1 -- 172.21.15.77:0/3960841027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0698071970 con 0x7f0698070c50 2023-11-04T01:42:45.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.028+0000 7f0694ff9640 1 -- 172.21.15.77:0/3960841027 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v31) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0688079e40 con 0x7f0698070c50 2023-11-04T01:42:45.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.031+0000 7f069e3c0640 1 -- 172.21.15.77:0/3960841027 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f068406ae70 msgr2=0x7f068406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:45.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.031+0000 7f069e3c0640 1 --2- 172.21.15.77:0/3960841027 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f068406ae70 0x7f068406d330 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f06980ca640 tx=0x7f068c008040 comp rx=0 tx=0).stop 2023-11-04T01:42:45.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.031+0000 7f069e3c0640 1 -- 172.21.15.77:0/3960841027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0698070c50 msgr2=0x7f06980c6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:45.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.031+0000 7f069e3c0640 1 --2- 172.21.15.77:0/3960841027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0698070c50 0x7f06980c6a70 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f068802b8a0 tx=0x7f06880046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:45.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.031+0000 7f069e3c0640 1 -- 172.21.15.77:0/3960841027 shutdown_connections 2023-11-04T01:42:45.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.031+0000 7f069e3c0640 1 --2- 172.21.15.77:0/3960841027 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f068406ae70 0x7f068406d330 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:45.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.031+0000 7f069e3c0640 1 --2- 172.21.15.77:0/3960841027 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f069815ad30 0x7f0698152390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:45.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.031+0000 7f069e3c0640 1 --2- 172.21.15.77:0/3960841027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06980ad730 0x7f0698151e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:45.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.031+0000 7f069e3c0640 1 --2- 172.21.15.77:0/3960841027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0698070c50 0x7f06980c6a70 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:45.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.031+0000 7f069e3c0640 1 -- 172.21.15.77:0/3960841027 >> 172.21.15.77:0/3960841027 conn(0x7f06980ce950 msgr2=0x7f06980afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:45.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.031+0000 7f069e3c0640 1 -- 172.21.15.77:0/3960841027 shutdown_connections 2023-11-04T01:42:45.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.031+0000 7f069e3c0640 1 -- 172.21.15.77:0/3960841027 wait complete. 2023-11-04T01:42:45.045 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-04T01:42:45.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.151+0000 7f5737955640 1 Processor -- start 2023-11-04T01:42:45.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.151+0000 7f5737955640 1 -- start start 2023-11-04T01:42:45.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.152+0000 7f5737955640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f573015d1b0 0x7f57300ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:45.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.152+0000 7f5737955640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5730161870 con 0x7f57300cecf0 2023-11-04T01:42:45.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.152+0000 7f5737955640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5730160c60 con 0x7f57300cdc50 2023-11-04T01:42:45.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.152+0000 7f5737955640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5730160f40 con 0x7f573015d1b0 2023-11-04T01:42:45.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.152+0000 7f5734ef0640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f57300cecf0 0x7f57300cd540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:38892/0 (socket says 172.21.15.77:38892) 2023-11-04T01:42:45.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.152+0000 7f5734ef0640 1 -- 172.21.15.77:0/3997655685 learned_addr learned my addr 172.21.15.77:0/3997655685 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:45.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.152+0000 7f57356f1640 1 --2- 172.21.15.77:0/3997655685 >> v2:172.21.15.122:3300/0 conn(0x7f573015d1b0 0x7f57300ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:45.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.152+0000 7f5727fff640 1 -- 172.21.15.77:0/3997655685 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376331600 0 0) 0x7f5730161870 con 0x7f57300cecf0 2023-11-04T01:42:45.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.152+0000 7f5727fff640 1 -- 172.21.15.77:0/3997655685 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f571c003520 con 0x7f57300cecf0 2023-11-04T01:42:45.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.152+0000 7f5727fff640 1 -- 172.21.15.77:0/3997655685 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1783876973 0 0) 0x7f571c003520 con 0x7f57300cecf0 2023-11-04T01:42:45.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.152+0000 7f5727fff640 1 -- 172.21.15.77:0/3997655685 >> v2:172.21.15.122:3300/0 conn(0x7f573015d1b0 msgr2=0x7f57300ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:45.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.152+0000 7f5727fff640 1 --2- 172.21.15.77:0/3997655685 >> v2:172.21.15.122:3300/0 conn(0x7f573015d1b0 0x7f57300ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:45.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.152+0000 7f5727fff640 1 -- 172.21.15.77:0/3997655685 >> v1:172.21.15.122:6789/0 conn(0x7f57300cdc50 legacy=0x7f573015d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:45.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.152+0000 7f5727fff640 1 -- 172.21.15.77:0/3997655685 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5730161220 con 0x7f57300cecf0 2023-11-04T01:42:45.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.152+0000 7f5727fff640 1 -- 172.21.15.77:0/3997655685 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f5720001670 con 0x7f57300cecf0 2023-11-04T01:42:45.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.152+0000 7f5727fff640 1 -- 172.21.15.77:0/3997655685 >> v1:172.21.15.77:6789/0 conn(0x7f57300cecf0 legacy=0x7f57300cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:45.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.152+0000 7f5727fff640 1 --2- 172.21.15.77:0/3997655685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f571c003970 0x7f571c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:45.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.152+0000 7f5727fff640 1 --2- 172.21.15.77:0/3997655685 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f571c0047c0 0x7f571c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:45.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.152+0000 7f5727fff640 1 --2- 172.21.15.77:0/3997655685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f571c005180 0x7f571c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:45.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.152+0000 7f5727fff640 1 -- 172.21.15.77:0/3997655685 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5730160f40 con 0x7f571c005180 2023-11-04T01:42:45.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.152+0000 7f5727fff640 1 -- 172.21.15.77:0/3997655685 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c00c020 con 0x7f571c003970 2023-11-04T01:42:45.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.152+0000 7f5727fff640 1 -- 172.21.15.77:0/3997655685 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f571c00c1e0 con 0x7f571c0047c0 2023-11-04T01:42:45.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.152+0000 7f5735ef2640 1 --2- 172.21.15.77:0/3997655685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f571c005180 0x7f571c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:45.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.152+0000 7f5734ef0640 1 --2- 172.21.15.77:0/3997655685 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f571c0047c0 0x7f571c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:45.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.152+0000 7f57356f1640 1 --2- 172.21.15.77:0/3997655685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f571c003970 0x7f571c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:45.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.153+0000 7f5735ef2640 1 -- 172.21.15.77:0/3997655685 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f571c0047c0 msgr2=0x7f571c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:45.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.153+0000 7f5735ef2640 1 --2- 172.21.15.77:0/3997655685 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f571c0047c0 0x7f571c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:45.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.153+0000 7f5735ef2640 1 -- 172.21.15.77:0/3997655685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f571c003970 msgr2=0x7f571c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:45.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.153+0000 7f5735ef2640 1 --2- 172.21.15.77:0/3997655685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f571c003970 0x7f571c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:45.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.153+0000 7f5735ef2640 1 -- 172.21.15.77:0/3997655685 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571c003520 con 0x7f571c005180 2023-11-04T01:42:45.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.153+0000 7f57356f1640 1 --2- 172.21.15.77:0/3997655685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f571c003970 0x7f571c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:45.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.153+0000 7f5734ef0640 1 --2- 172.21.15.77:0/3997655685 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f571c0047c0 0x7f571c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:45.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.153+0000 7f5735ef2640 1 -- 172.21.15.77:0/3997655685 reap_dead start 2023-11-04T01:42:45.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.153+0000 7f5735ef2640 1 --2- 172.21.15.77:0/3997655685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f571c005180 0x7f571c00b980 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f573006b2e0 tx=0x7f571c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5a64b9b7ac62b26 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:45.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.153+0000 7f5727fff640 1 -- 172.21.15.77:0/3997655685 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5728003b70 con 0x7f571c005180 2023-11-04T01:42:45.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.153+0000 7f5727fff640 1 -- 172.21.15.77:0/3997655685 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5728003cd0 con 0x7f571c005180 2023-11-04T01:42:45.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.154+0000 7f5727fff640 1 -- 172.21.15.77:0/3997655685 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5728005310 con 0x7f571c005180 2023-11-04T01:42:45.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.154+0000 7f5737955640 1 -- 172.21.15.77:0/3997655685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f571c005180 msgr2=0x7f571c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:45.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.154+0000 7f5737955640 1 --2- 172.21.15.77:0/3997655685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f571c005180 0x7f571c00b980 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f573006b2e0 tx=0x7f571c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:45.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.154+0000 7f5737955640 1 -- 172.21.15.77:0/3997655685 shutdown_connections 2023-11-04T01:42:45.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.154+0000 7f5737955640 1 --2- 172.21.15.77:0/3997655685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f571c005180 0x7f571c00b980 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:45.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.154+0000 7f5737955640 1 -- 172.21.15.77:0/3997655685 >> 172.21.15.77:0/3997655685 conn(0x7f573006ea20 msgr2=0x7f573006ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:45.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.154+0000 7f5737955640 1 -- 172.21.15.77:0/3997655685 shutdown_connections 2023-11-04T01:42:45.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.154+0000 7f5737955640 1 -- 172.21.15.77:0/3997655685 wait complete. 2023-11-04T01:42:45.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.155+0000 7f5737955640 1 Processor -- start 2023-11-04T01:42:45.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.155+0000 7f5737955640 1 -- start start 2023-11-04T01:42:45.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.156+0000 7f5737955640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f571c005180 0x7f573015a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:45.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.156+0000 7f5737955640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f57301f3640 0x7f57301f3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:45.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.156+0000 7f5737955640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57301f42f0 0x7f573006baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:45.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.156+0000 7f5737955640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57300b3910 con 0x7f57301f42f0 2023-11-04T01:42:45.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.156+0000 7f5737955640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573015d930 con 0x7f571c005180 2023-11-04T01:42:45.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.156+0000 7f5737955640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f573015dc10 con 0x7f57301f3640 2023-11-04T01:42:45.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.156+0000 7f5735ef2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57301f42f0 0x7f573006baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:45.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.156+0000 7f5735ef2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57301f42f0 0x7f573006baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59410/0 (socket says 172.21.15.77:59410) 2023-11-04T01:42:45.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.156+0000 7f5735ef2640 1 -- 172.21.15.77:0/1769958735 learned_addr learned my addr 172.21.15.77:0/1769958735 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:45.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.156+0000 7f5734ef0640 1 --2- 172.21.15.77:0/1769958735 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f57301f3640 0x7f57301f3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:45.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.156+0000 7f57356f1640 1 --2- 172.21.15.77:0/1769958735 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f571c005180 0x7f573015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:45.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.156+0000 7f5735ef2640 1 -- 172.21.15.77:0/1769958735 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f57301f3640 msgr2=0x7f57301f3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:45.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.156+0000 7f5735ef2640 1 --2- 172.21.15.77:0/1769958735 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f57301f3640 0x7f57301f3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:45.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.156+0000 7f5735ef2640 1 -- 172.21.15.77:0/1769958735 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f571c005180 msgr2=0x7f573015a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:45.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.156+0000 7f5735ef2640 1 --2- 172.21.15.77:0/1769958735 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f571c005180 0x7f573015a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:45.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.156+0000 7f5735ef2640 1 -- 172.21.15.77:0/1769958735 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573015def0 con 0x7f57301f42f0 2023-11-04T01:42:45.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.156+0000 7f5734ef0640 1 --2- 172.21.15.77:0/1769958735 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f57301f3640 0x7f57301f3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:45.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.157+0000 7f5735ef2640 1 --2- 172.21.15.77:0/1769958735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57301f42f0 0x7f573006baf0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f5728001f10 tx=0x7f57280014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:45.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.157+0000 7f5725ffb640 1 -- 172.21.15.77:0/1769958735 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5728006d50 con 0x7f57301f42f0 2023-11-04T01:42:45.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.157+0000 7f5725ffb640 1 -- 172.21.15.77:0/1769958735 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5728007030 con 0x7f57301f42f0 2023-11-04T01:42:45.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.157+0000 7f5737955640 1 -- 172.21.15.77:0/1769958735 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f573015e1d0 con 0x7f57301f42f0 2023-11-04T01:42:45.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.157+0000 7f5725ffb640 1 -- 172.21.15.77:0/1769958735 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57280073c0 con 0x7f57301f42f0 2023-11-04T01:42:45.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.157+0000 7f5737955640 1 -- 172.21.15.77:0/1769958735 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57300b2700 con 0x7f57301f42f0 2023-11-04T01:42:45.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.158+0000 7f5737955640 1 -- 172.21.15.77:0/1769958735 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57300b3910 con 0x7f57301f42f0 2023-11-04T01:42:45.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.158+0000 7f5725ffb640 1 -- 172.21.15.77:0/1769958735 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5728007520 con 0x7f57301f42f0 2023-11-04T01:42:45.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.159+0000 7f5725ffb640 1 --2- 172.21.15.77:0/1769958735 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f571406ae70 0x7f571406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:45.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.159+0000 7f5725ffb640 1 -- 172.21.15.77:0/1769958735 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7178+0+0 (secure 0 0 0) 0x7f57280aa9e0 con 0x7f57301f42f0 2023-11-04T01:42:45.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.159+0000 7f57356f1640 1 --2- 172.21.15.77:0/1769958735 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f571406ae70 0x7f571406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:45.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.159+0000 7f57356f1640 1 --2- 172.21.15.77:0/1769958735 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f571406ae70 0x7f571406d330 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f573006c7f0 tx=0x7f572c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:45.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.163+0000 7f5725ffb640 1 -- 172.21.15.77:0/1769958735 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5728075670 con 0x7f57301f42f0 2023-11-04T01:42:45.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:45.327+0000 7f5737955640 1 -- 172.21.15.77:0/1769958735 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f573015e6f0 con 0x7f57301f42f0 2023-11-04T01:42:46.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.030+0000 7f5725ffb640 1 -- 172.21.15.77:0/1769958735 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v73) v1 ==== 181+0+0 (secure 0 0 0) 0x7f573015e6f0 con 0x7f57301f42f0 2023-11-04T01:42:46.032 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_metadata' removed 2023-11-04T01:42:46.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.033+0000 7f5737955640 1 -- 172.21.15.77:0/1769958735 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f571406ae70 msgr2=0x7f571406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.033+0000 7f5737955640 1 --2- 172.21.15.77:0/1769958735 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f571406ae70 0x7f571406d330 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f573006c7f0 tx=0x7f572c008040 comp rx=0 tx=0).stop 2023-11-04T01:42:46.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.034+0000 7f5737955640 1 -- 172.21.15.77:0/1769958735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57301f42f0 msgr2=0x7f573006baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.034+0000 7f5737955640 1 --2- 172.21.15.77:0/1769958735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57301f42f0 0x7f573006baf0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f5728001f10 tx=0x7f57280014a0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.034+0000 7f5737955640 1 -- 172.21.15.77:0/1769958735 shutdown_connections 2023-11-04T01:42:46.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.034+0000 7f5737955640 1 --2- 172.21.15.77:0/1769958735 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f571406ae70 0x7f571406d330 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.034+0000 7f5737955640 1 --2- 172.21.15.77:0/1769958735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57301f42f0 0x7f573006baf0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.034+0000 7f5737955640 1 --2- 172.21.15.77:0/1769958735 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f57301f3640 0x7f57301f3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.034+0000 7f5737955640 1 --2- 172.21.15.77:0/1769958735 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f571c005180 0x7f573015a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.034+0000 7f5737955640 1 -- 172.21.15.77:0/1769958735 >> 172.21.15.77:0/1769958735 conn(0x7f573006ea20 msgr2=0x7f57300c88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:46.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.034+0000 7f5737955640 1 -- 172.21.15.77:0/1769958735 shutdown_connections 2023-11-04T01:42:46.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.034+0000 7f5737955640 1 -- 172.21.15.77:0/1769958735 wait complete. 2023-11-04T01:42:46.050 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-04T01:42:46.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.156+0000 7f1a166a9640 1 Processor -- start 2023-11-04T01:42:46.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.156+0000 7f1a166a9640 1 -- start start 2023-11-04T01:42:46.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.157+0000 7f1a166a9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a1015e420 0x7f1a100ad730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.157+0000 7f1a166a9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1a100adc70 0x7f1a100c3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.157+0000 7f1a166a9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a100c5890 con 0x7f1a10159be0 2023-11-04T01:42:46.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.157+0000 7f1a166a9640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a100ae100 con 0x7f1a100adc70 2023-11-04T01:42:46.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.157+0000 7f1a166a9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a100c5670 con 0x7f1a1015e420 2023-11-04T01:42:46.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.157+0000 7f1a0ffff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f1a10159be0 0x7f1a100c4f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:38906/0 (socket says 172.21.15.77:38906) 2023-11-04T01:42:46.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.157+0000 7f1a0ffff640 1 -- 172.21.15.77:0/1865692997 learned_addr learned my addr 172.21.15.77:0/1865692997 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:46.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.157+0000 7f1a0effd640 1 -- 172.21.15.77:0/1865692997 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 282935323 0 0) 0x7f1a100c5890 con 0x7f1a10159be0 2023-11-04T01:42:46.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.157+0000 7f1a0effd640 1 -- 172.21.15.77:0/1865692997 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19f8003520 con 0x7f1a10159be0 2023-11-04T01:42:46.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.157+0000 7f1a14c46640 1 --2- 172.21.15.77:0/1865692997 >> v2:172.21.15.122:3300/0 conn(0x7f1a100adc70 0x7f1a100c3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.157+0000 7f1a0f7fe640 1 --2- 172.21.15.77:0/1865692997 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a1015e420 0x7f1a100ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.157+0000 7f1a0effd640 1 -- 172.21.15.77:0/1865692997 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2002530316 0 0) 0x7f19f8003520 con 0x7f1a10159be0 2023-11-04T01:42:46.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.158+0000 7f1a0effd640 1 -- 172.21.15.77:0/1865692997 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a1015e420 msgr2=0x7f1a100ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:46.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.158+0000 7f1a0effd640 1 --2- 172.21.15.77:0/1865692997 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a1015e420 0x7f1a100ad730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.158+0000 7f1a0effd640 1 -- 172.21.15.77:0/1865692997 >> v2:172.21.15.122:3300/0 conn(0x7f1a100adc70 msgr2=0x7f1a100c3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:46.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.158+0000 7f1a0effd640 1 --2- 172.21.15.77:0/1865692997 >> v2:172.21.15.122:3300/0 conn(0x7f1a100adc70 0x7f1a100c3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.158+0000 7f1a0effd640 1 -- 172.21.15.77:0/1865692997 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a100cd8e0 con 0x7f1a10159be0 2023-11-04T01:42:46.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.158+0000 7f1a0effd640 1 -- 172.21.15.77:0/1865692997 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f1a00001670 con 0x7f1a10159be0 2023-11-04T01:42:46.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.158+0000 7f1a0effd640 1 -- 172.21.15.77:0/1865692997 >> v1:172.21.15.77:6789/0 conn(0x7f1a10159be0 legacy=0x7f1a100c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.158+0000 7f1a0effd640 1 --2- 172.21.15.77:0/1865692997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19f80039a0 0x7f19f8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.158+0000 7f1a0effd640 1 --2- 172.21.15.77:0/1865692997 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a1015e420 0x7f19f80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.158+0000 7f1a0effd640 1 --2- 172.21.15.77:0/1865692997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19f8004d00 0x7f19f8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.158+0000 7f1a0effd640 1 -- 172.21.15.77:0/1865692997 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a100ae100 con 0x7f19f8004d00 2023-11-04T01:42:46.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.158+0000 7f1a0effd640 1 -- 172.21.15.77:0/1865692997 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a100c5670 con 0x7f19f80039a0 2023-11-04T01:42:46.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.158+0000 7f1a0effd640 1 -- 172.21.15.77:0/1865692997 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f800dbc0 con 0x7f1a1015e420 2023-11-04T01:42:46.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.158+0000 7f1a14c46640 1 --2- 172.21.15.77:0/1865692997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19f8004d00 0x7f19f8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.158+0000 7f1a0ffff640 1 --2- 172.21.15.77:0/1865692997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19f80039a0 0x7f19f8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.158+0000 7f1a0f7fe640 1 --2- 172.21.15.77:0/1865692997 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a1015e420 0x7f19f80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.158+0000 7f1a14c46640 1 -- 172.21.15.77:0/1865692997 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a1015e420 msgr2=0x7f19f80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:46.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.158+0000 7f1a14c46640 1 --2- 172.21.15.77:0/1865692997 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a1015e420 0x7f19f80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.158+0000 7f1a14c46640 1 -- 172.21.15.77:0/1865692997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19f80039a0 msgr2=0x7f19f8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:46.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.158+0000 7f1a14c46640 1 --2- 172.21.15.77:0/1865692997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19f80039a0 0x7f19f8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.158+0000 7f1a14c46640 1 -- 172.21.15.77:0/1865692997 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f8003520 con 0x7f19f8004d00 2023-11-04T01:42:46.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.159+0000 7f1a14c46640 1 --2- 172.21.15.77:0/1865692997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19f8004d00 0x7f19f8005180 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f1a08009fc0 tx=0x7f19f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e613901f046b4419 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:46.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.159+0000 7f1a0effd640 1 -- 172.21.15.77:0/1865692997 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0802cc60 con 0x7f19f8004d00 2023-11-04T01:42:46.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.159+0000 7f1a0effd640 1 -- 172.21.15.77:0/1865692997 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0800f040 con 0x7f19f8004d00 2023-11-04T01:42:46.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.159+0000 7f1a0effd640 1 -- 172.21.15.77:0/1865692997 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a08034440 con 0x7f19f8004d00 2023-11-04T01:42:46.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.159+0000 7f1a166a9640 1 -- 172.21.15.77:0/1865692997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19f8004d00 msgr2=0x7f19f8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.159+0000 7f1a166a9640 1 --2- 172.21.15.77:0/1865692997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19f8004d00 0x7f19f8005180 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f1a08009fc0 tx=0x7f19f80057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.159+0000 7f1a14c46640 1 -- 172.21.15.77:0/1865692997 reap_dead start 2023-11-04T01:42:46.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.159+0000 7f1a166a9640 1 -- 172.21.15.77:0/1865692997 shutdown_connections 2023-11-04T01:42:46.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.159+0000 7f1a166a9640 1 -- 172.21.15.77:0/1865692997 >> 172.21.15.77:0/1865692997 conn(0x7f1a100b05d0 msgr2=0x7f1a100b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:46.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.159+0000 7f1a166a9640 1 -- 172.21.15.77:0/1865692997 shutdown_connections 2023-11-04T01:42:46.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.159+0000 7f1a166a9640 1 -- 172.21.15.77:0/1865692997 wait complete. 2023-11-04T01:42:46.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.161+0000 7f1a166a9640 1 Processor -- start 2023-11-04T01:42:46.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.161+0000 7f1a166a9640 1 -- start start 2023-11-04T01:42:46.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.161+0000 7f1a166a9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a1014e930 0x7f1a100c6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.161+0000 7f1a166a9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a100c6ea0 0x7f1a10151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.161+0000 7f1a166a9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a10152010 0x7f1a10150130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.161+0000 7f1a166a9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a10152490 con 0x7f1a10152010 2023-11-04T01:42:46.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.161+0000 7f1a166a9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a101545a0 con 0x7f1a1014e930 2023-11-04T01:42:46.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.161+0000 7f1a166a9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a10154880 con 0x7f1a100c6ea0 2023-11-04T01:42:46.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.162+0000 7f1a14c46640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a10152010 0x7f1a10150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.162+0000 7f1a14c46640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a10152010 0x7f1a10150130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59438/0 (socket says 172.21.15.77:59438) 2023-11-04T01:42:46.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.162+0000 7f1a14c46640 1 -- 172.21.15.77:0/3873080429 learned_addr learned my addr 172.21.15.77:0/3873080429 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:46.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.162+0000 7f1a0ffff640 1 --2- 172.21.15.77:0/3873080429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a1014e930 0x7f1a100c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.162+0000 7f1a0f7fe640 1 --2- 172.21.15.77:0/3873080429 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a100c6ea0 0x7f1a10151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.162+0000 7f1a14c46640 1 -- 172.21.15.77:0/3873080429 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a100c6ea0 msgr2=0x7f1a10151ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.162+0000 7f1a14c46640 1 --2- 172.21.15.77:0/3873080429 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a100c6ea0 0x7f1a10151ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.162+0000 7f1a14c46640 1 -- 172.21.15.77:0/3873080429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a1014e930 msgr2=0x7f1a100c6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:46.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.162+0000 7f1a14c46640 1 --2- 172.21.15.77:0/3873080429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a1014e930 0x7f1a100c6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:46.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.162+0000 7f1a14c46640 1 -- 172.21.15.77:0/3873080429 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a10154b60 con 0x7f1a10152010 2023-11-04T01:42:46.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.162+0000 7f1a0ffff640 1 --2- 172.21.15.77:0/3873080429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a1014e930 0x7f1a100c6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:46.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.162+0000 7f1a14c46640 1 --2- 172.21.15.77:0/3873080429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a10152010 0x7f1a10150130 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f1a08037040 tx=0x7f1a08009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:46.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.162+0000 7f1a0cff9640 1 -- 172.21.15.77:0/3873080429 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a08034d50 con 0x7f1a10152010 2023-11-04T01:42:46.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.162+0000 7f1a0cff9640 1 -- 172.21.15.77:0/3873080429 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a08003990 con 0x7f1a10152010 2023-11-04T01:42:46.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.162+0000 7f1a166a9640 1 -- 172.21.15.77:0/3873080429 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a10154e40 con 0x7f1a10152010 2023-11-04T01:42:46.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.162+0000 7f1a0cff9640 1 -- 172.21.15.77:0/3873080429 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a08003d40 con 0x7f1a10152010 2023-11-04T01:42:46.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.162+0000 7f1a166a9640 1 -- 172.21.15.77:0/3873080429 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a101541c0 con 0x7f1a10152010 2023-11-04T01:42:46.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.163+0000 7f1a166a9640 1 -- 172.21.15.77:0/3873080429 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a10155360 con 0x7f1a10152010 2023-11-04T01:42:46.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.164+0000 7f1a0cff9640 1 -- 172.21.15.77:0/3873080429 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1a08004030 con 0x7f1a10152010 2023-11-04T01:42:46.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.164+0000 7f1a0cff9640 1 --2- 172.21.15.77:0/3873080429 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f19fc06ae70 0x7f19fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:46.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.164+0000 7f1a0cff9640 1 -- 172.21.15.77:0/3873080429 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6740+0+0 (secure 0 0 0) 0x7f1a080ab220 con 0x7f1a10152010 2023-11-04T01:42:46.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.164+0000 7f1a0ffff640 1 --2- 172.21.15.77:0/3873080429 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f19fc06ae70 0x7f19fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:46.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.165+0000 7f1a0ffff640 1 --2- 172.21.15.77:0/3873080429 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f19fc06ae70 0x7f19fc06d330 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1a00000c00 tx=0x7f1a00009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:46.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.168+0000 7f1a0cff9640 1 -- 172.21.15.77:0/3873080429 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1a10155360 con 0x7f1a10152010 2023-11-04T01:42:46.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:46.334+0000 7f1a166a9640 1 -- 172.21.15.77:0/3873080429 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1a10155360 con 0x7f1a10152010 2023-11-04T01:42:47.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.031+0000 7f1a0cff9640 1 -- 172.21.15.77:0/3873080429 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v74) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1a10155360 con 0x7f1a10152010 2023-11-04T01:42:47.033 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data' removed 2023-11-04T01:42:47.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.034+0000 7f1a166a9640 1 -- 172.21.15.77:0/3873080429 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f19fc06ae70 msgr2=0x7f19fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.034+0000 7f1a166a9640 1 --2- 172.21.15.77:0/3873080429 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f19fc06ae70 0x7f19fc06d330 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1a00000c00 tx=0x7f1a00009040 comp rx=0 tx=0).stop 2023-11-04T01:42:47.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.034+0000 7f1a166a9640 1 -- 172.21.15.77:0/3873080429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a10152010 msgr2=0x7f1a10150130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.034+0000 7f1a166a9640 1 --2- 172.21.15.77:0/3873080429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a10152010 0x7f1a10150130 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f1a08037040 tx=0x7f1a08009750 comp rx=0 tx=0).stop 2023-11-04T01:42:47.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.034+0000 7f1a166a9640 1 -- 172.21.15.77:0/3873080429 shutdown_connections 2023-11-04T01:42:47.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.034+0000 7f1a166a9640 1 --2- 172.21.15.77:0/3873080429 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f19fc06ae70 0x7f19fc06d330 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.034+0000 7f1a166a9640 1 --2- 172.21.15.77:0/3873080429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a10152010 0x7f1a10150130 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.034+0000 7f1a166a9640 1 --2- 172.21.15.77:0/3873080429 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1a100c6ea0 0x7f1a10151ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.034+0000 7f1a166a9640 1 --2- 172.21.15.77:0/3873080429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a1014e930 0x7f1a100c6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.034+0000 7f1a166a9640 1 -- 172.21.15.77:0/3873080429 >> 172.21.15.77:0/3873080429 conn(0x7f1a100b05d0 msgr2=0x7f1a100cc570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:47.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.035+0000 7f1a166a9640 1 -- 172.21.15.77:0/3873080429 shutdown_connections 2023-11-04T01:42:47.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.035+0000 7f1a166a9640 1 -- 172.21.15.77:0/3873080429 wait complete. 2023-11-04T01:42:47.050 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-04T01:42:47.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.151+0000 7f1b6094c640 1 Processor -- start 2023-11-04T01:42:47.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.151+0000 7f1b6094c640 1 -- start start 2023-11-04T01:42:47.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.152+0000 7f1b6094c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1b5c15ad30 0x7f1b5c0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.152+0000 7f1b6094c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1b5c0ad730 0x7f1b5c070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.152+0000 7f1b6094c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b5c0c3900 con 0x7f1b5c070c50 2023-11-04T01:42:47.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.152+0000 7f1b6094c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b5c0ae260 con 0x7f1b5c0ad730 2023-11-04T01:42:47.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.152+0000 7f1b6094c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c15f750 con 0x7f1b5c15ad30 2023-11-04T01:42:47.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.152+0000 7f1b53fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1b5c0ad730 0x7f1b5c070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.152+0000 7f1b5a59c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1b5c15ad30 0x7f1b5c0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.152+0000 7f1b53fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1b5c0ad730 0x7f1b5c070710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:39298/0 (socket says 172.21.15.77:39298) 2023-11-04T01:42:47.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.152+0000 7f1b53fff640 1 -- 172.21.15.77:0/3191252971 learned_addr learned my addr 172.21.15.77:0/3191252971 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:47.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.152+0000 7f1b5ad9d640 1 --1- 172.21.15.77:0/3191252971 >> v1:172.21.15.122:6789/0 conn(0x7f1b5c070c50 0x7f1b5c0c8fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:46738/0 (socket says 172.21.15.77:46738) 2023-11-04T01:42:47.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.152+0000 7f1b53fff640 1 -- 172.21.15.77:0/3191252971 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1b5c15ad30 msgr2=0x7f1b5c0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:47.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.152+0000 7f1b53fff640 1 --2- 172.21.15.77:0/3191252971 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1b5c15ad30 0x7f1b5c0adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.152+0000 7f1b53fff640 1 -- 172.21.15.77:0/3191252971 >> v1:172.21.15.122:6789/0 conn(0x7f1b5c070c50 legacy=0x7f1b5c0c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.152+0000 7f1b53fff640 1 -- 172.21.15.77:0/3191252971 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5c0c3be0 con 0x7f1b5c0ad730 2023-11-04T01:42:47.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.152+0000 7f1b59d9b640 1 -- 172.21.15.77:0/3191252971 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3094941194 0 0) 0x7f1b5c0c3900 con 0x7f1b5c070c50 2023-11-04T01:42:47.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.153+0000 7f1b5a59c640 1 --2- 172.21.15.77:0/3191252971 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1b5c15ad30 0x7f1b5c0adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:47.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.153+0000 7f1b53fff640 1 --2- 172.21.15.77:0/3191252971 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b5c0ad730 0x7f1b5c070710 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1b440098a0 tx=0x7f1b4402b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=291b93197e3f3f56 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:47.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.153+0000 7f1b59d9b640 1 -- 172.21.15.77:0/3191252971 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b44031640 con 0x7f1b5c0ad730 2023-11-04T01:42:47.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.154+0000 7f1b59d9b640 1 -- 172.21.15.77:0/3191252971 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b440317a0 con 0x7f1b5c0ad730 2023-11-04T01:42:47.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.154+0000 7f1b59d9b640 1 -- 172.21.15.77:0/3191252971 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b44031b30 con 0x7f1b5c0ad730 2023-11-04T01:42:47.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.154+0000 7f1b6094c640 1 -- 172.21.15.77:0/3191252971 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b5c0ad730 msgr2=0x7f1b5c070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.154+0000 7f1b6094c640 1 --2- 172.21.15.77:0/3191252971 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b5c0ad730 0x7f1b5c070710 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1b440098a0 tx=0x7f1b4402b8f0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.154+0000 7f1b6094c640 1 -- 172.21.15.77:0/3191252971 shutdown_connections 2023-11-04T01:42:47.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.154+0000 7f1b6094c640 1 --2- 172.21.15.77:0/3191252971 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b5c0ad730 0x7f1b5c070710 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.154+0000 7f1b6094c640 1 --2- 172.21.15.77:0/3191252971 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1b5c15ad30 0x7f1b5c0adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.154+0000 7f1b6094c640 1 -- 172.21.15.77:0/3191252971 >> 172.21.15.77:0/3191252971 conn(0x7f1b5c0ce950 msgr2=0x7f1b5c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:47.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.154+0000 7f1b6094c640 1 -- 172.21.15.77:0/3191252971 shutdown_connections 2023-11-04T01:42:47.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.154+0000 7f1b6094c640 1 -- 172.21.15.77:0/3191252971 wait complete. 2023-11-04T01:42:47.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.156+0000 7f1b6094c640 1 Processor -- start 2023-11-04T01:42:47.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.156+0000 7f1b6094c640 1 -- start start 2023-11-04T01:42:47.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.156+0000 7f1b6094c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b5c070c50 0x7f1b5c0c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.156+0000 7f1b6094c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b5c0ad730 0x7f1b5c145450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.156+0000 7f1b6094c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1b5c15ad30 0x7f1b5c155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.156+0000 7f1b6094c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c0c7580 con 0x7f1b5c0ad730 2023-11-04T01:42:47.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.156+0000 7f1b6094c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c1f4c70 con 0x7f1b5c070c50 2023-11-04T01:42:47.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.156+0000 7f1b6094c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c1f40f0 con 0x7f1b5c15ad30 2023-11-04T01:42:47.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.157+0000 7f1b53fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b5c0ad730 0x7f1b5c145450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.157+0000 7f1b53fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b5c0ad730 0x7f1b5c145450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59448/0 (socket says 172.21.15.77:59448) 2023-11-04T01:42:47.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.157+0000 7f1b53fff640 1 -- 172.21.15.77:0/576871822 learned_addr learned my addr 172.21.15.77:0/576871822 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:47.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.157+0000 7f1b5a59c640 1 --2- 172.21.15.77:0/576871822 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b5c070c50 0x7f1b5c0c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.157+0000 7f1b5ad9d640 1 --2- 172.21.15.77:0/576871822 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1b5c15ad30 0x7f1b5c155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.157+0000 7f1b53fff640 1 -- 172.21.15.77:0/576871822 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1b5c15ad30 msgr2=0x7f1b5c155df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.157+0000 7f1b53fff640 1 --2- 172.21.15.77:0/576871822 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1b5c15ad30 0x7f1b5c155df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.157+0000 7f1b53fff640 1 -- 172.21.15.77:0/576871822 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b5c070c50 msgr2=0x7f1b5c0c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.157+0000 7f1b53fff640 1 --2- 172.21.15.77:0/576871822 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b5c070c50 0x7f1b5c0c5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.157+0000 7f1b53fff640 1 -- 172.21.15.77:0/576871822 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4c009400 con 0x7f1b5c0ad730 2023-11-04T01:42:47.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.157+0000 7f1b53fff640 1 --2- 172.21.15.77:0/576871822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b5c0ad730 0x7f1b5c145450 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f1b44000c00 tx=0x7f1b440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:47.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.157+0000 7f1b52ffd640 1 -- 172.21.15.77:0/576871822 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4403a930 con 0x7f1b5c0ad730 2023-11-04T01:42:47.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.157+0000 7f1b52ffd640 1 -- 172.21.15.77:0/576871822 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4403aa90 con 0x7f1b5c0ad730 2023-11-04T01:42:47.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.157+0000 7f1b6094c640 1 -- 172.21.15.77:0/576871822 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b440094d0 con 0x7f1b5c0ad730 2023-11-04T01:42:47.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.157+0000 7f1b52ffd640 1 -- 172.21.15.77:0/576871822 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4403ae40 con 0x7f1b5c0ad730 2023-11-04T01:42:47.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.157+0000 7f1b6094c640 1 -- 172.21.15.77:0/576871822 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b5c1f46b0 con 0x7f1b5c0ad730 2023-11-04T01:42:47.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.158+0000 7f1b6094c640 1 -- 172.21.15.77:0/576871822 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b5c0c76f0 con 0x7f1b5c0ad730 2023-11-04T01:42:47.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.159+0000 7f1b52ffd640 1 -- 172.21.15.77:0/576871822 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1b4402f050 con 0x7f1b5c0ad730 2023-11-04T01:42:47.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.159+0000 7f1b52ffd640 1 --2- 172.21.15.77:0/576871822 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1b3c06aea0 0x7f1b3c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.159+0000 7f1b52ffd640 1 -- 172.21.15.77:0/576871822 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f1b440ab440 con 0x7f1b5c0ad730 2023-11-04T01:42:47.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.160+0000 7f1b5a59c640 1 --2- 172.21.15.77:0/576871822 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1b3c06aea0 0x7f1b3c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.160+0000 7f1b5a59c640 1 --2- 172.21.15.77:0/576871822 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1b3c06aea0 0x7f1b3c06d360 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c009c30 tx=0x7f1b4c009190 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:47.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.163+0000 7f1b52ffd640 1 -- 172.21.15.77:0/576871822 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1b5c0c76f0 con 0x7f1b5c0ad730 2023-11-04T01:42:47.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.335+0000 7f1b6094c640 1 -- 172.21.15.77:0/576871822 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f1b5c0c76c0 con 0x7f1b5c0ad730 2023-11-04T01:42:47.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.342+0000 7f1b52ffd640 1 -- 172.21.15.77:0/576871822 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v16) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1b4407ee60 con 0x7f1b5c0ad730 2023-11-04T01:42:47.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.344+0000 7f1b6094c640 1 -- 172.21.15.77:0/576871822 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1b3c06aea0 msgr2=0x7f1b3c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.344+0000 7f1b6094c640 1 --2- 172.21.15.77:0/576871822 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1b3c06aea0 0x7f1b3c06d360 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c009c30 tx=0x7f1b4c009190 comp rx=0 tx=0).stop 2023-11-04T01:42:47.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.344+0000 7f1b6094c640 1 -- 172.21.15.77:0/576871822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b5c0ad730 msgr2=0x7f1b5c145450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.344+0000 7f1b6094c640 1 --2- 172.21.15.77:0/576871822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b5c0ad730 0x7f1b5c145450 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f1b44000c00 tx=0x7f1b440046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.344+0000 7f1b6094c640 1 -- 172.21.15.77:0/576871822 shutdown_connections 2023-11-04T01:42:47.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.344+0000 7f1b6094c640 1 --2- 172.21.15.77:0/576871822 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1b3c06aea0 0x7f1b3c06d360 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.344+0000 7f1b6094c640 1 --2- 172.21.15.77:0/576871822 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1b5c15ad30 0x7f1b5c155df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.344+0000 7f1b6094c640 1 --2- 172.21.15.77:0/576871822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b5c0ad730 0x7f1b5c145450 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.344+0000 7f1b6094c640 1 --2- 172.21.15.77:0/576871822 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b5c070c50 0x7f1b5c0c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.344+0000 7f1b6094c640 1 -- 172.21.15.77:0/576871822 >> 172.21.15.77:0/576871822 conn(0x7f1b5c0ce950 msgr2=0x7f1b5c157180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:47.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.344+0000 7f1b6094c640 1 -- 172.21.15.77:0/576871822 shutdown_connections 2023-11-04T01:42:47.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.344+0000 7f1b6094c640 1 -- 172.21.15.77:0/576871822 wait complete. 2023-11-04T01:42:47.356 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation' 2023-11-04T01:42:47.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.457+0000 7fcf7f075640 1 Processor -- start 2023-11-04T01:42:47.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.457+0000 7fcf7f075640 1 -- start start 2023-11-04T01:42:47.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.458+0000 7fcf7f075640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fcf780b42c0 0x7fcf780c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.458+0000 7fcf7f075640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcf780c9c40 0x7fcf780b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.458+0000 7fcf7f075640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf780ca090 con 0x7fcf7815ad80 2023-11-04T01:42:47.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.458+0000 7fcf7f075640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf7806cfa0 con 0x7fcf780b42c0 2023-11-04T01:42:47.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.458+0000 7fcf7f075640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7806d280 con 0x7fcf780c9c40 2023-11-04T01:42:47.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.458+0000 7fcf77fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fcf780b42c0 0x7fcf780c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.458+0000 7fcf7d612640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcf780c9c40 0x7fcf780b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.458+0000 7fcf77fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fcf780b42c0 0x7fcf780c9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:43420/0 (socket says 172.21.15.77:43420) 2023-11-04T01:42:47.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.458+0000 7fcf77fff640 1 -- 172.21.15.77:0/2664073706 learned_addr learned my addr 172.21.15.77:0/2664073706 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:47.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.458+0000 7fcf7ce11640 1 --1- 172.21.15.77:0/2664073706 >> v1:172.21.15.122:6789/0 conn(0x7fcf7815ad80 0x7fcf7806c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:57322/0 (socket says 172.21.15.77:57322) 2023-11-04T01:42:47.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.458+0000 7fcf777fe640 1 -- 172.21.15.77:0/2664073706 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3626660962 0 0) 0x7fcf6c001110 con 0x7fcf7815ad80 2023-11-04T01:42:47.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.458+0000 7fcf777fe640 1 -- 172.21.15.77:0/2664073706 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf68003520 con 0x7fcf7815ad80 2023-11-04T01:42:47.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.458+0000 7fcf7d612640 1 -- 172.21.15.77:0/2664073706 >> v2:172.21.15.122:3300/0 conn(0x7fcf780b42c0 msgr2=0x7fcf780c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:47.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.458+0000 7fcf7d612640 1 --2- 172.21.15.77:0/2664073706 >> v2:172.21.15.122:3300/0 conn(0x7fcf780b42c0 0x7fcf780c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.458+0000 7fcf7d612640 1 -- 172.21.15.77:0/2664073706 >> v1:172.21.15.122:6789/0 conn(0x7fcf7815ad80 legacy=0x7fcf7806c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.458+0000 7fcf7d612640 1 -- 172.21.15.77:0/2664073706 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf7806d560 con 0x7fcf780c9c40 2023-11-04T01:42:47.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.458+0000 7fcf77fff640 1 --2- 172.21.15.77:0/2664073706 >> v2:172.21.15.122:3300/0 conn(0x7fcf780b42c0 0x7fcf780c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:47.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.459+0000 7fcf7d612640 1 --2- 172.21.15.77:0/2664073706 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcf780c9c40 0x7fcf780b1a40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcf70009d90 tx=0x7fcf7002bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27d0f0f66db476e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:47.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.459+0000 7fcf777fe640 1 -- 172.21.15.77:0/2664073706 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7002cce0 con 0x7fcf780c9c40 2023-11-04T01:42:47.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.459+0000 7fcf777fe640 1 -- 172.21.15.77:0/2664073706 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7002ce40 con 0x7fcf780c9c40 2023-11-04T01:42:47.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.459+0000 7fcf777fe640 1 -- 172.21.15.77:0/2664073706 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf70034640 con 0x7fcf780c9c40 2023-11-04T01:42:47.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.460+0000 7fcf7f075640 1 -- 172.21.15.77:0/2664073706 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcf780c9c40 msgr2=0x7fcf780b1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.460+0000 7fcf7f075640 1 --2- 172.21.15.77:0/2664073706 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcf780c9c40 0x7fcf780b1a40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcf70009d90 tx=0x7fcf7002bf30 comp rx=0 tx=0).stop 2023-11-04T01:42:47.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.460+0000 7fcf7f075640 1 -- 172.21.15.77:0/2664073706 shutdown_connections 2023-11-04T01:42:47.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.460+0000 7fcf7f075640 1 --2- 172.21.15.77:0/2664073706 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcf780c9c40 0x7fcf780b1a40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.460+0000 7fcf7f075640 1 --2- 172.21.15.77:0/2664073706 >> v2:172.21.15.122:3300/0 conn(0x7fcf780b42c0 0x7fcf780c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.460+0000 7fcf7f075640 1 -- 172.21.15.77:0/2664073706 >> 172.21.15.77:0/2664073706 conn(0x7fcf780ce950 msgr2=0x7fcf780ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:47.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.460+0000 7fcf7f075640 1 -- 172.21.15.77:0/2664073706 shutdown_connections 2023-11-04T01:42:47.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.460+0000 7fcf7f075640 1 -- 172.21.15.77:0/2664073706 wait complete. 2023-11-04T01:42:47.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.461+0000 7fcf7f075640 1 Processor -- start 2023-11-04T01:42:47.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.461+0000 7fcf7f075640 1 -- start start 2023-11-04T01:42:47.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.462+0000 7fcf7f075640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf780b42c0 0x7fcf78155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.462+0000 7fcf7f075640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcf780c9c40 0x7fcf781539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.462+0000 7fcf7f075640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf7815ad80 0x7fcf78154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.462+0000 7fcf7f075640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf78153f30 con 0x7fcf780b42c0 2023-11-04T01:42:47.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.462+0000 7fcf7f075640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf78154a30 con 0x7fcf7815ad80 2023-11-04T01:42:47.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.462+0000 7fcf7f075640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf78154d10 con 0x7fcf780c9c40 2023-11-04T01:42:47.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.462+0000 7fcf7ce11640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf780b42c0 0x7fcf78155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.462+0000 7fcf7ce11640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf780b42c0 0x7fcf78155ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38460/0 (socket says 172.21.15.77:38460) 2023-11-04T01:42:47.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.462+0000 7fcf7ce11640 1 -- 172.21.15.77:0/1164977737 learned_addr learned my addr 172.21.15.77:0/1164977737 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:47.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.462+0000 7fcf77fff640 1 --2- 172.21.15.77:0/1164977737 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcf780c9c40 0x7fcf781539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.462+0000 7fcf7d612640 1 --2- 172.21.15.77:0/1164977737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf7815ad80 0x7fcf78154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.462+0000 7fcf7ce11640 1 -- 172.21.15.77:0/1164977737 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcf780c9c40 msgr2=0x7fcf781539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.462+0000 7fcf7ce11640 1 --2- 172.21.15.77:0/1164977737 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcf780c9c40 0x7fcf781539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.462+0000 7fcf7ce11640 1 -- 172.21.15.77:0/1164977737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf7815ad80 msgr2=0x7fcf78154110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.462+0000 7fcf7ce11640 1 --2- 172.21.15.77:0/1164977737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf7815ad80 0x7fcf78154110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.462+0000 7fcf7ce11640 1 -- 172.21.15.77:0/1164977737 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf640094d0 con 0x7fcf780b42c0 2023-11-04T01:42:47.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.463+0000 7fcf7ce11640 1 --2- 172.21.15.77:0/1164977737 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf780b42c0 0x7fcf78155ad0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c00c730 tx=0x7fcf6c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:47.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.463+0000 7fcf757fa640 1 -- 172.21.15.77:0/1164977737 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c007270 con 0x7fcf780b42c0 2023-11-04T01:42:47.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.463+0000 7fcf757fa640 1 -- 172.21.15.77:0/1164977737 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf6c0073d0 con 0x7fcf780b42c0 2023-11-04T01:42:47.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.463+0000 7fcf7f075640 1 -- 172.21.15.77:0/1164977737 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf70009a70 con 0x7fcf780b42c0 2023-11-04T01:42:47.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.463+0000 7fcf757fa640 1 -- 172.21.15.77:0/1164977737 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c001d30 con 0x7fcf780b42c0 2023-11-04T01:42:47.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.463+0000 7fcf7f075640 1 -- 172.21.15.77:0/1164977737 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf781552d0 con 0x7fcf780b42c0 2023-11-04T01:42:47.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.464+0000 7fcf7f075640 1 -- 172.21.15.77:0/1164977737 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf78074290 con 0x7fcf780b42c0 2023-11-04T01:42:47.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.464+0000 7fcf757fa640 1 -- 172.21.15.77:0/1164977737 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcf6c0047e0 con 0x7fcf780b42c0 2023-11-04T01:42:47.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.465+0000 7fcf757fa640 1 --2- 172.21.15.77:0/1164977737 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcf5c06aea0 0x7fcf5c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.465+0000 7fcf757fa640 1 -- 172.21.15.77:0/1164977737 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6326+0+0 (secure 0 0 0) 0x7fcf6c088a10 con 0x7fcf780b42c0 2023-11-04T01:42:47.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.465+0000 7fcf77fff640 1 --2- 172.21.15.77:0/1164977737 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcf5c06aea0 0x7fcf5c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.465+0000 7fcf77fff640 1 --2- 172.21.15.77:0/1164977737 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcf5c06aea0 0x7fcf5c06d360 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fcf780c5410 tx=0x7fcf64009240 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:47.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.469+0000 7fcf757fa640 1 -- 172.21.15.77:0/1164977737 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcf6c053990 con 0x7fcf780b42c0 2023-11-04T01:42:47.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:47.701+0000 7fcf7f075640 1 -- 172.21.15.77:0/1164977737 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation"]} v 0) v1 -- 0x7fcf780ca090 con 0x7fcf780b42c0 2023-11-04T01:42:48.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.041+0000 7fcf757fa640 1 -- 172.21.15.77:0/1164977737 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation"]}]=0 v172) v1 ==== 173+0+0 (secure 0 0 0) 0x7fcf780ca090 con 0x7fcf780b42c0 2023-11-04T01:42:48.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.043+0000 7fcf7f075640 1 -- 172.21.15.77:0/1164977737 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcf5c06aea0 msgr2=0x7fcf5c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.043+0000 7fcf7f075640 1 --2- 172.21.15.77:0/1164977737 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcf5c06aea0 0x7fcf5c06d360 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fcf780c5410 tx=0x7fcf64009240 comp rx=0 tx=0).stop 2023-11-04T01:42:48.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.043+0000 7fcf7f075640 1 -- 172.21.15.77:0/1164977737 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf780b42c0 msgr2=0x7fcf78155ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.043+0000 7fcf7f075640 1 --2- 172.21.15.77:0/1164977737 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf780b42c0 0x7fcf78155ad0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c00c730 tx=0x7fcf6c00cbf0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.043+0000 7fcf7f075640 1 -- 172.21.15.77:0/1164977737 shutdown_connections 2023-11-04T01:42:48.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.043+0000 7fcf7f075640 1 --2- 172.21.15.77:0/1164977737 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcf5c06aea0 0x7fcf5c06d360 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.043+0000 7fcf7f075640 1 --2- 172.21.15.77:0/1164977737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf7815ad80 0x7fcf78154110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.043+0000 7fcf7f075640 1 --2- 172.21.15.77:0/1164977737 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcf780c9c40 0x7fcf781539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.043+0000 7fcf7f075640 1 --2- 172.21.15.77:0/1164977737 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf780b42c0 0x7fcf78155ad0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.043+0000 7fcf7f075640 1 -- 172.21.15.77:0/1164977737 >> 172.21.15.77:0/1164977737 conn(0x7fcf780ce950 msgr2=0x7fcf78070630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:48.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.043+0000 7fcf7f075640 1 -- 172.21.15.77:0/1164977737 shutdown_connections 2023-11-04T01:42:48.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.043+0000 7fcf7f075640 1 -- 172.21.15.77:0/1164977737 wait complete. 2023-11-04T01:42:48.056 INFO:tasks.cephfs_test_runner:Test that using a pool with snaps for fs creation fails ... ok 2023-11-04T01:42:48.057 INFO:tasks.cephfs_test_runner:Starting test: test_allow_new_snaps_config (tasks.cephfs.test_snapshots.TestSnapshots) Check whether 'allow_new_snaps' setting works 2023-11-04T01:42:48.057 INFO:tasks.cephfs_test_runner:test_allow_new_snaps_config (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:42:48.058 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:48.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.156+0000 7fa55e590640 1 Processor -- start 2023-11-04T01:42:48.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.156+0000 7fa55e590640 1 -- start start 2023-11-04T01:42:48.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.157+0000 7fa55e590640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa5580c1e80 0x7fa55806c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.157+0000 7fa55e590640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa5580cce10 0x7fa5580cd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.157+0000 7fa55e590640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5580cd7a0 con 0x7fa5580ade20 2023-11-04T01:42:48.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.157+0000 7fa55e590640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5581617c0 con 0x7fa5580cce10 2023-11-04T01:42:48.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.157+0000 7fa55e590640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5580ae200 con 0x7fa5580c1e80 2023-11-04T01:42:48.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.157+0000 7fa557fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fa5580ade20 0x7fa5580c92a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:46928/0 (socket says 172.21.15.77:46928) 2023-11-04T01:42:48.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.157+0000 7fa557fff640 1 -- 172.21.15.77:0/569220400 learned_addr learned my addr 172.21.15.77:0/569220400 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:48.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.157+0000 7fa55cb2d640 1 --2- 172.21.15.77:0/569220400 >> v2:172.21.15.122:3300/0 conn(0x7fa5580cce10 0x7fa5580cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.157+0000 7fa5577fe640 1 --2- 172.21.15.77:0/569220400 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa5580c1e80 0x7fa55806c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.157+0000 7fa556ffd640 1 -- 172.21.15.77:0/569220400 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1922480354 0 0) 0x7fa548001110 con 0x7fa5580ade20 2023-11-04T01:42:48.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.157+0000 7fa556ffd640 1 -- 172.21.15.77:0/569220400 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa540003520 con 0x7fa5580ade20 2023-11-04T01:42:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.157+0000 7fa556ffd640 1 -- 172.21.15.77:0/569220400 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4178384109 0 0) 0x7fa540003520 con 0x7fa5580ade20 2023-11-04T01:42:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.157+0000 7fa556ffd640 1 -- 172.21.15.77:0/569220400 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa5580c1e80 msgr2=0x7fa55806c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.157+0000 7fa556ffd640 1 --2- 172.21.15.77:0/569220400 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa5580c1e80 0x7fa55806c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.157+0000 7fa556ffd640 1 -- 172.21.15.77:0/569220400 >> v2:172.21.15.122:3300/0 conn(0x7fa5580cce10 msgr2=0x7fa5580cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:48.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.157+0000 7fa556ffd640 1 --2- 172.21.15.77:0/569220400 >> v2:172.21.15.122:3300/0 conn(0x7fa5580cce10 0x7fa5580cd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.157+0000 7fa556ffd640 1 -- 172.21.15.77:0/569220400 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5580c9d10 con 0x7fa5580ade20 2023-11-04T01:42:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.157+0000 7fa556ffd640 1 -- 172.21.15.77:0/569220400 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7fa548001800 con 0x7fa5580ade20 2023-11-04T01:42:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.157+0000 7fa556ffd640 1 -- 172.21.15.77:0/569220400 >> v1:172.21.15.77:6789/0 conn(0x7fa5580ade20 legacy=0x7fa5580c92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.158+0000 7fa556ffd640 1 --2- 172.21.15.77:0/569220400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa540003970 0x7fa540003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.158+0000 7fa556ffd640 1 --2- 172.21.15.77:0/569220400 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa5580c1e80 0x7fa5400047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.158+0000 7fa556ffd640 1 --2- 172.21.15.77:0/569220400 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa540004d00 0x7fa540005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.158+0000 7fa556ffd640 1 -- 172.21.15.77:0/569220400 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5581617c0 con 0x7fa540003970 2023-11-04T01:42:48.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.158+0000 7fa556ffd640 1 -- 172.21.15.77:0/569220400 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5580ae200 con 0x7fa540004d00 2023-11-04T01:42:48.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.158+0000 7fa556ffd640 1 -- 172.21.15.77:0/569220400 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa54000b980 con 0x7fa5580c1e80 2023-11-04T01:42:48.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.158+0000 7fa557fff640 1 --2- 172.21.15.77:0/569220400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa540003970 0x7fa540003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.158+0000 7fa5577fe640 1 --2- 172.21.15.77:0/569220400 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa5580c1e80 0x7fa5400047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.158+0000 7fa55cb2d640 1 --2- 172.21.15.77:0/569220400 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa540004d00 0x7fa540005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.158+0000 7fa557fff640 1 -- 172.21.15.77:0/569220400 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa5580c1e80 msgr2=0x7fa5400047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:48.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.158+0000 7fa557fff640 1 --2- 172.21.15.77:0/569220400 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa5580c1e80 0x7fa5400047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.158+0000 7fa557fff640 1 -- 172.21.15.77:0/569220400 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa540004d00 msgr2=0x7fa540005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:48.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.158+0000 7fa557fff640 1 --2- 172.21.15.77:0/569220400 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa540004d00 0x7fa540005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.158+0000 7fa557fff640 1 -- 172.21.15.77:0/569220400 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa540003520 con 0x7fa540003970 2023-11-04T01:42:48.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.158+0000 7fa55cb2d640 1 --2- 172.21.15.77:0/569220400 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa540004d00 0x7fa540005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:48.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.158+0000 7fa5577fe640 1 --2- 172.21.15.77:0/569220400 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa5580c1e80 0x7fa5400047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:48.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.159+0000 7fa557fff640 1 --2- 172.21.15.77:0/569220400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa540003970 0x7fa540003d90 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fa54800c210 tx=0x7fa5400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=668c8b8f100c35c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:48.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.159+0000 7fa556ffd640 1 -- 172.21.15.77:0/569220400 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa548005ad0 con 0x7fa540003970 2023-11-04T01:42:48.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.159+0000 7fa556ffd640 1 -- 172.21.15.77:0/569220400 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa548005c50 con 0x7fa540003970 2023-11-04T01:42:48.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.159+0000 7fa556ffd640 1 -- 172.21.15.77:0/569220400 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54802c8d0 con 0x7fa540003970 2023-11-04T01:42:48.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.159+0000 7fa55e590640 1 -- 172.21.15.77:0/569220400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa540003970 msgr2=0x7fa540003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.159+0000 7fa55e590640 1 --2- 172.21.15.77:0/569220400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa540003970 0x7fa540003d90 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fa54800c210 tx=0x7fa5400057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.159+0000 7fa55cb2d640 1 -- 172.21.15.77:0/569220400 reap_dead start 2023-11-04T01:42:48.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.159+0000 7fa55e590640 1 -- 172.21.15.77:0/569220400 shutdown_connections 2023-11-04T01:42:48.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.159+0000 7fa55e590640 1 -- 172.21.15.77:0/569220400 >> 172.21.15.77:0/569220400 conn(0x7fa5580ce950 msgr2=0x7fa5580ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:48.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.159+0000 7fa55e590640 1 -- 172.21.15.77:0/569220400 shutdown_connections 2023-11-04T01:42:48.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.159+0000 7fa55e590640 1 -- 172.21.15.77:0/569220400 wait complete. 2023-11-04T01:42:48.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.160+0000 7fa55e590640 1 Processor -- start 2023-11-04T01:42:48.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.161+0000 7fa55e590640 1 -- start start 2023-11-04T01:42:48.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.161+0000 7fa55e590640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa540003970 0x7fa5580c2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.161+0000 7fa55e590640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa5581564a0 0x7fa55815ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.161+0000 7fa55e590640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa558156920 0x7fa55815f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.161+0000 7fa55e590640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa558162f90 con 0x7fa540003970 2023-11-04T01:42:48.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.161+0000 7fa55e590640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa558163270 con 0x7fa558156920 2023-11-04T01:42:48.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.161+0000 7fa55e590640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5580b29a0 con 0x7fa5581564a0 2023-11-04T01:42:48.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.161+0000 7fa557fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa540003970 0x7fa5580c2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.161+0000 7fa557fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa540003970 0x7fa5580c2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38488/0 (socket says 172.21.15.77:38488) 2023-11-04T01:42:48.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.161+0000 7fa557fff640 1 -- 172.21.15.77:0/2594919939 learned_addr learned my addr 172.21.15.77:0/2594919939 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:48.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.162+0000 7fa557fff640 1 -- 172.21.15.77:0/2594919939 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa5581564a0 msgr2=0x7fa55815ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.162+0000 7fa557fff640 1 --2- 172.21.15.77:0/2594919939 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa5581564a0 0x7fa55815ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.162+0000 7fa557fff640 1 -- 172.21.15.77:0/2594919939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa558156920 msgr2=0x7fa55815f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.162+0000 7fa557fff640 1 --2- 172.21.15.77:0/2594919939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa558156920 0x7fa55815f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.162+0000 7fa557fff640 1 -- 172.21.15.77:0/2594919939 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5580b2c80 con 0x7fa540003970 2023-11-04T01:42:48.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.162+0000 7fa557fff640 1 --2- 172.21.15.77:0/2594919939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa540003970 0x7fa5580c2260 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fa54802c470 tx=0x7fa548000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:48.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.162+0000 7fa554ff9640 1 -- 172.21.15.77:0/2594919939 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54802cce0 con 0x7fa540003970 2023-11-04T01:42:48.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.162+0000 7fa554ff9640 1 -- 172.21.15.77:0/2594919939 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54802ce60 con 0x7fa540003970 2023-11-04T01:42:48.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.162+0000 7fa554ff9640 1 -- 172.21.15.77:0/2594919939 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5480072b0 con 0x7fa540003970 2023-11-04T01:42:48.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.162+0000 7fa55e590640 1 -- 172.21.15.77:0/2594919939 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5580b2f60 con 0x7fa540003970 2023-11-04T01:42:48.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.162+0000 7fa55e590640 1 -- 172.21.15.77:0/2594919939 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5581624b0 con 0x7fa540003970 2023-11-04T01:42:48.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.163+0000 7fa55e590640 1 -- 172.21.15.77:0/2594919939 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5580b2800 con 0x7fa540003970 2023-11-04T01:42:48.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.163+0000 7fa554ff9640 1 -- 172.21.15.77:0/2594919939 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa548032070 con 0x7fa540003970 2023-11-04T01:42:48.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.164+0000 7fa554ff9640 1 --2- 172.21.15.77:0/2594919939 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa54406aea0 0x7fa54406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.164+0000 7fa554ff9640 1 -- 172.21.15.77:0/2594919939 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6326+0+0 (secure 0 0 0) 0x7fa5480aa700 con 0x7fa540003970 2023-11-04T01:42:48.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.164+0000 7fa5577fe640 1 --2- 172.21.15.77:0/2594919939 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa54406aea0 0x7fa54406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.164+0000 7fa5577fe640 1 --2- 172.21.15.77:0/2594919939 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa54406aea0 0x7fa54406d360 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa5580b2790 tx=0x7fa54c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:48.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.168+0000 7fa554ff9640 1 -- 172.21.15.77:0/2594919939 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa5580b2800 con 0x7fa540003970 2023-11-04T01:42:48.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.334+0000 7fa55e590640 1 -- 172.21.15.77:0/2594919939 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5580cd7a0 con 0x7fa540003970 2023-11-04T01:42:48.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.335+0000 7fa554ff9640 1 -- 172.21.15.77:0/2594919939 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+18422 (secure 0 0 0) 0x7fa5580cd7a0 con 0x7fa540003970 2023-11-04T01:42:48.337 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:48.337 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":74,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:42:47.030825+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:33.159064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:33.647358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.122:6837/1606545578":"2023-11-05T01:42:44.024229+0000","172.21.15.122:6835/1606545578":"2023-11-05T01:42:44.024229+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:48.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.337+0000 7fa55e590640 1 -- 172.21.15.77:0/2594919939 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa54406aea0 msgr2=0x7fa54406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.337+0000 7fa55e590640 1 --2- 172.21.15.77:0/2594919939 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa54406aea0 0x7fa54406d360 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa5580b2790 tx=0x7fa54c008040 comp rx=0 tx=0).stop 2023-11-04T01:42:48.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.337+0000 7fa55e590640 1 -- 172.21.15.77:0/2594919939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa540003970 msgr2=0x7fa5580c2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.337+0000 7fa55e590640 1 --2- 172.21.15.77:0/2594919939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa540003970 0x7fa5580c2260 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fa54802c470 tx=0x7fa548000fe0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.337+0000 7fa55e590640 1 -- 172.21.15.77:0/2594919939 shutdown_connections 2023-11-04T01:42:48.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.337+0000 7fa55e590640 1 --2- 172.21.15.77:0/2594919939 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa54406aea0 0x7fa54406d360 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.337+0000 7fa55e590640 1 --2- 172.21.15.77:0/2594919939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa558156920 0x7fa55815f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.337+0000 7fa55e590640 1 --2- 172.21.15.77:0/2594919939 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa5581564a0 0x7fa55815ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.337+0000 7fa55e590640 1 --2- 172.21.15.77:0/2594919939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa540003970 0x7fa5580c2260 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.337+0000 7fa55e590640 1 -- 172.21.15.77:0/2594919939 >> 172.21.15.77:0/2594919939 conn(0x7fa5580ce950 msgr2=0x7fa5580cbac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:48.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.337+0000 7fa55e590640 1 -- 172.21.15.77:0/2594919939 shutdown_connections 2023-11-04T01:42:48.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.337+0000 7fa55e590640 1 -- 172.21.15.77:0/2594919939 wait complete. 2023-11-04T01:42:48.349 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:33.142176+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:42:33.159064+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:42:33.647358+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:42:48.350 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:42:48.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.451+0000 7f9c14e1a640 1 Processor -- start 2023-11-04T01:42:48.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.451+0000 7f9c14e1a640 1 -- start start 2023-11-04T01:42:48.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.452+0000 7f9c14e1a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9c1015e3f0 0x7f9c100b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.452+0000 7f9c14e1a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c100caa20 con 0x7f9c100ca0a0 2023-11-04T01:42:48.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.452+0000 7f9c14e1a640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c100cb230 con 0x7f9c100cc300 2023-11-04T01:42:48.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.452+0000 7f9c14e1a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c100ca530 con 0x7f9c1015e3f0 2023-11-04T01:42:48.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.452+0000 7f9c0e59c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9c1015e3f0 0x7f9c100b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.452+0000 7f9c07fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f9c100ca0a0 0x7f9c100cc920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:46938/0 (socket says 172.21.15.77:46938) 2023-11-04T01:42:48.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.452+0000 7f9c07fff640 1 -- 172.21.15.77:0/2953971793 learned_addr learned my addr 172.21.15.77:0/2953971793 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:48.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.452+0000 7f9c0e59c640 1 -- 172.21.15.77:0/2953971793 >> v1:172.21.15.122:6789/0 conn(0x7f9c100cc300 legacy=0x7f9c100b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:48.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.452+0000 7f9c0e59c640 1 -- 172.21.15.77:0/2953971793 >> v1:172.21.15.77:6789/0 conn(0x7f9c100ca0a0 legacy=0x7f9c100cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.452+0000 7f9c0e59c640 1 -- 172.21.15.77:0/2953971793 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c100cac70 con 0x7f9c1015e3f0 2023-11-04T01:42:48.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.452+0000 7f9c0dd9b640 1 -- 172.21.15.77:0/2953971793 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1014648735 0 0) 0x7f9c100caa20 con 0x7f9c100ca0a0 2023-11-04T01:42:48.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.453+0000 7f9c0e59c640 1 --2- 172.21.15.77:0/2953971793 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c1015e3f0 0x7f9c100b2bf0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f9c000097a0 tx=0x7f9c0002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b4380d88cd7c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:48.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.453+0000 7f9c0dd9b640 1 -- 172.21.15.77:0/2953971793 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c00031830 con 0x7f9c1015e3f0 2023-11-04T01:42:48.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.453+0000 7f9c0dd9b640 1 -- 172.21.15.77:0/2953971793 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c00031990 con 0x7f9c1015e3f0 2023-11-04T01:42:48.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.453+0000 7f9c0dd9b640 1 -- 172.21.15.77:0/2953971793 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c00031d20 con 0x7f9c1015e3f0 2023-11-04T01:42:48.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.453+0000 7f9c14e1a640 1 -- 172.21.15.77:0/2953971793 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c1015e3f0 msgr2=0x7f9c100b2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.453+0000 7f9c14e1a640 1 --2- 172.21.15.77:0/2953971793 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c1015e3f0 0x7f9c100b2bf0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f9c000097a0 tx=0x7f9c0002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.454+0000 7f9c14e1a640 1 -- 172.21.15.77:0/2953971793 shutdown_connections 2023-11-04T01:42:48.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.454+0000 7f9c14e1a640 1 --2- 172.21.15.77:0/2953971793 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c1015e3f0 0x7f9c100b2bf0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.454+0000 7f9c14e1a640 1 -- 172.21.15.77:0/2953971793 >> 172.21.15.77:0/2953971793 conn(0x7f9c10071820 msgr2=0x7f9c10071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:48.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.454+0000 7f9c14e1a640 1 -- 172.21.15.77:0/2953971793 shutdown_connections 2023-11-04T01:42:48.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.454+0000 7f9c14e1a640 1 -- 172.21.15.77:0/2953971793 wait complete. 2023-11-04T01:42:48.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.455+0000 7f9c14e1a640 1 Processor -- start 2023-11-04T01:42:48.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.455+0000 7f9c14e1a640 1 -- start start 2023-11-04T01:42:48.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.456+0000 7f9c14e1a640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9c100cc300 0x7f9c100b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.456+0000 7f9c14e1a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c1015e3f0 0x7f9c100c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.456+0000 7f9c14e1a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c101effb0 0x7f9c1015c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.456+0000 7f9c14e1a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c100c3720 con 0x7f9c101effb0 2023-11-04T01:42:48.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.456+0000 7f9c14e1a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c100c9980 con 0x7f9c1015e3f0 2023-11-04T01:42:48.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.456+0000 7f9c14e1a640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c100c8e40 con 0x7f9c100cc300 2023-11-04T01:42:48.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.456+0000 7f9c0ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c101effb0 0x7f9c1015c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.456+0000 7f9c0ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c101effb0 0x7f9c1015c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38518/0 (socket says 172.21.15.77:38518) 2023-11-04T01:42:48.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.456+0000 7f9c0ed9d640 1 -- 172.21.15.77:0/1918979276 learned_addr learned my addr 172.21.15.77:0/1918979276 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:48.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.456+0000 7f9c0ed9d640 1 -- 172.21.15.77:0/1918979276 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9c100cc300 msgr2=0x7f9c100b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.456+0000 7f9c0ed9d640 1 --2- 172.21.15.77:0/1918979276 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9c100cc300 0x7f9c100b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.456+0000 7f9c0ed9d640 1 -- 172.21.15.77:0/1918979276 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c1015e3f0 msgr2=0x7f9c100c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.456+0000 7f9c0ed9d640 1 --2- 172.21.15.77:0/1918979276 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c1015e3f0 0x7f9c100c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.456+0000 7f9c0ed9d640 1 -- 172.21.15.77:0/1918979276 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c00009400 con 0x7f9c101effb0 2023-11-04T01:42:48.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.456+0000 7f9c0ed9d640 1 --2- 172.21.15.77:0/1918979276 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c101effb0 0x7f9c1015c8a0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f9c0800c7b0 tx=0x7f9c0800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:48.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.456+0000 7f9c06ffd640 1 -- 172.21.15.77:0/1918979276 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c08003d80 con 0x7f9c101effb0 2023-11-04T01:42:48.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.456+0000 7f9c06ffd640 1 -- 172.21.15.77:0/1918979276 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c08005070 con 0x7f9c101effb0 2023-11-04T01:42:48.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.456+0000 7f9c14e1a640 1 -- 172.21.15.77:0/1918979276 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c100c90e0 con 0x7f9c101effb0 2023-11-04T01:42:48.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.456+0000 7f9c06ffd640 1 -- 172.21.15.77:0/1918979276 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c08005420 con 0x7f9c101effb0 2023-11-04T01:42:48.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.456+0000 7f9c14e1a640 1 -- 172.21.15.77:0/1918979276 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c100c96a0 con 0x7f9c101effb0 2023-11-04T01:42:48.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.457+0000 7f9c14e1a640 1 -- 172.21.15.77:0/1918979276 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c10074290 con 0x7f9c101effb0 2023-11-04T01:42:48.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.457+0000 7f9c06ffd640 1 -- 172.21.15.77:0/1918979276 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9c08005580 con 0x7f9c101effb0 2023-11-04T01:42:48.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.458+0000 7f9c06ffd640 1 --2- 172.21.15.77:0/1918979276 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9bf006ae70 0x7f9bf006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.458+0000 7f9c06ffd640 1 -- 172.21.15.77:0/1918979276 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f9c08089050 con 0x7f9c101effb0 2023-11-04T01:42:48.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.458+0000 7f9c0e59c640 1 --2- 172.21.15.77:0/1918979276 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9bf006ae70 0x7f9bf006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.458+0000 7f9c0e59c640 1 --2- 172.21.15.77:0/1918979276 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9bf006ae70 0x7f9bf006d330 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9c00036000 tx=0x7f9c00030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:48.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.462+0000 7f9c06ffd640 1 -- 172.21.15.77:0/1918979276 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9c08053f20 con 0x7f9c101effb0 2023-11-04T01:42:48.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.626+0000 7f9c14e1a640 1 -- 172.21.15.77:0/1918979276 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9c100c3860 con 0x7f9c101effb0 2023-11-04T01:42:48.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.627+0000 7f9c06ffd640 1 -- 172.21.15.77:0/1918979276 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9c08017020 con 0x7f9c101effb0 2023-11-04T01:42:48.629 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:42:48.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.629+0000 7f9c14e1a640 1 -- 172.21.15.77:0/1918979276 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9bf006ae70 msgr2=0x7f9bf006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.629+0000 7f9c14e1a640 1 --2- 172.21.15.77:0/1918979276 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9bf006ae70 0x7f9bf006d330 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9c00036000 tx=0x7f9c00030000 comp rx=0 tx=0).stop 2023-11-04T01:42:48.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.629+0000 7f9c14e1a640 1 -- 172.21.15.77:0/1918979276 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c101effb0 msgr2=0x7f9c1015c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.629+0000 7f9c14e1a640 1 --2- 172.21.15.77:0/1918979276 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c101effb0 0x7f9c1015c8a0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f9c0800c7b0 tx=0x7f9c0800cc70 comp rx=0 tx=0).stop 2023-11-04T01:42:48.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.629+0000 7f9c14e1a640 1 -- 172.21.15.77:0/1918979276 shutdown_connections 2023-11-04T01:42:48.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.629+0000 7f9c14e1a640 1 --2- 172.21.15.77:0/1918979276 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9bf006ae70 0x7f9bf006d330 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.629+0000 7f9c14e1a640 1 --2- 172.21.15.77:0/1918979276 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c101effb0 0x7f9c1015c8a0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.629+0000 7f9c14e1a640 1 --2- 172.21.15.77:0/1918979276 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c1015e3f0 0x7f9c100c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.629+0000 7f9c14e1a640 1 --2- 172.21.15.77:0/1918979276 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9c100cc300 0x7f9c100b0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.629+0000 7f9c14e1a640 1 -- 172.21.15.77:0/1918979276 >> 172.21.15.77:0/1918979276 conn(0x7f9c10071820 msgr2=0x7f9c100cc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:48.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.629+0000 7f9c14e1a640 1 -- 172.21.15.77:0/1918979276 shutdown_connections 2023-11-04T01:42:48.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.629+0000 7f9c14e1a640 1 -- 172.21.15.77:0/1918979276 wait complete. 2023-11-04T01:42:48.641 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:42:48.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.744+0000 7f0e147ce640 1 Processor -- start 2023-11-04T01:42:48.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.744+0000 7f0e147ce640 1 -- start start 2023-11-04T01:42:48.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.745+0000 7f0e147ce640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e0c15ad30 0x7f0e0c0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.745+0000 7f0e147ce640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0e0c0ad730 0x7f0e0c070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.745+0000 7f0e147ce640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e0c0c3900 con 0x7f0e0c070c50 2023-11-04T01:42:48.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.745+0000 7f0e147ce640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e0c0ae260 con 0x7f0e0c0ad730 2023-11-04T01:42:48.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.745+0000 7f0e147ce640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0c15f750 con 0x7f0e0c15ad30 2023-11-04T01:42:48.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.745+0000 7f0e11d69640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0e0c0ad730 0x7f0e0c070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.745+0000 7f0e12d6b640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f0e0c070c50 0x7f0e0c0c8fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:46944/0 (socket says 172.21.15.77:46944) 2023-11-04T01:42:48.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.745+0000 7f0e12d6b640 1 -- 172.21.15.77:0/3091235140 learned_addr learned my addr 172.21.15.77:0/3091235140 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:48.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.745+0000 7f0e1256a640 1 --2- 172.21.15.77:0/3091235140 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e0c15ad30 0x7f0e0c0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.745+0000 7f0e11d69640 1 -- 172.21.15.77:0/3091235140 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e0c15ad30 msgr2=0x7f0e0c0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:48.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.745+0000 7f0e11d69640 1 --2- 172.21.15.77:0/3091235140 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e0c15ad30 0x7f0e0c0adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.745+0000 7f0e11d69640 1 -- 172.21.15.77:0/3091235140 >> v1:172.21.15.77:6789/0 conn(0x7f0e0c070c50 legacy=0x7f0e0c0c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.745+0000 7f0e11568640 1 -- 172.21.15.77:0/3091235140 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2163548968 0 0) 0x7f0e0c0c3900 con 0x7f0e0c070c50 2023-11-04T01:42:48.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.746+0000 7f0e11d69640 1 -- 172.21.15.77:0/3091235140 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e0c0c3be0 con 0x7f0e0c0ad730 2023-11-04T01:42:48.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.746+0000 7f0e11d69640 1 --2- 172.21.15.77:0/3091235140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e0c0ad730 0x7f0e0c070710 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc0097d0 tx=0x7f0dfc02b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9af1e0c30ff12bd8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:48.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.746+0000 7f0e11568640 1 -- 172.21.15.77:0/3091235140 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc031770 con 0x7f0e0c0ad730 2023-11-04T01:42:48.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.746+0000 7f0e11568640 1 -- 172.21.15.77:0/3091235140 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dfc0318d0 con 0x7f0e0c0ad730 2023-11-04T01:42:48.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.746+0000 7f0e11568640 1 -- 172.21.15.77:0/3091235140 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc031c60 con 0x7f0e0c0ad730 2023-11-04T01:42:48.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.747+0000 7f0e147ce640 1 -- 172.21.15.77:0/3091235140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e0c0ad730 msgr2=0x7f0e0c070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.747+0000 7f0e147ce640 1 --2- 172.21.15.77:0/3091235140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e0c0ad730 0x7f0e0c070710 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc0097d0 tx=0x7f0dfc02b810 comp rx=0 tx=0).stop 2023-11-04T01:42:48.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.747+0000 7f0e147ce640 1 -- 172.21.15.77:0/3091235140 shutdown_connections 2023-11-04T01:42:48.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.747+0000 7f0e147ce640 1 --2- 172.21.15.77:0/3091235140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e0c0ad730 0x7f0e0c070710 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.747+0000 7f0e147ce640 1 --2- 172.21.15.77:0/3091235140 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e0c15ad30 0x7f0e0c0adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.747+0000 7f0e147ce640 1 -- 172.21.15.77:0/3091235140 >> 172.21.15.77:0/3091235140 conn(0x7f0e0c0ce950 msgr2=0x7f0e0c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:48.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.747+0000 7f0e147ce640 1 -- 172.21.15.77:0/3091235140 shutdown_connections 2023-11-04T01:42:48.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.747+0000 7f0e147ce640 1 -- 172.21.15.77:0/3091235140 wait complete. 2023-11-04T01:42:48.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.748+0000 7f0e147ce640 1 Processor -- start 2023-11-04T01:42:48.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.748+0000 7f0e147ce640 1 -- start start 2023-11-04T01:42:48.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.749+0000 7f0e147ce640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e0c070c50 0x7f0e0c1f4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.749+0000 7f0e147ce640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e0c0ad730 0x7f0e0c0c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.749+0000 7f0e147ce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e0c15ad30 0x7f0e0c0b4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.749+0000 7f0e147ce640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0c1f4aa0 con 0x7f0e0c15ad30 2023-11-04T01:42:48.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.749+0000 7f0e147ce640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0c0c7e30 con 0x7f0e0c0ad730 2023-11-04T01:42:48.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.749+0000 7f0e147ce640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0c0c80b0 con 0x7f0e0c070c50 2023-11-04T01:42:48.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.749+0000 7f0e12d6b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e0c15ad30 0x7f0e0c0b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.749+0000 7f0e12d6b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e0c15ad30 0x7f0e0c0b4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38548/0 (socket says 172.21.15.77:38548) 2023-11-04T01:42:48.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.749+0000 7f0e12d6b640 1 -- 172.21.15.77:0/873331591 learned_addr learned my addr 172.21.15.77:0/873331591 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:48.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.749+0000 7f0e11d69640 1 --2- 172.21.15.77:0/873331591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e0c0ad730 0x7f0e0c0c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.749+0000 7f0e1256a640 1 --2- 172.21.15.77:0/873331591 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e0c070c50 0x7f0e0c1f4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.749+0000 7f0e12d6b640 1 -- 172.21.15.77:0/873331591 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e0c070c50 msgr2=0x7f0e0c1f4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.749+0000 7f0e12d6b640 1 --2- 172.21.15.77:0/873331591 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e0c070c50 0x7f0e0c1f4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.749+0000 7f0e12d6b640 1 -- 172.21.15.77:0/873331591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e0c0ad730 msgr2=0x7f0e0c0c78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.749+0000 7f0e12d6b640 1 --2- 172.21.15.77:0/873331591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e0c0ad730 0x7f0e0c0c78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.749+0000 7f0e12d6b640 1 -- 172.21.15.77:0/873331591 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dfc009400 con 0x7f0e0c15ad30 2023-11-04T01:42:48.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.749+0000 7f0e11d69640 1 --2- 172.21.15.77:0/873331591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e0c0ad730 0x7f0e0c0c78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:48.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.749+0000 7f0e1256a640 1 --2- 172.21.15.77:0/873331591 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e0c070c50 0x7f0e0c1f4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:48.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.750+0000 7f0e12d6b640 1 --2- 172.21.15.77:0/873331591 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e0c15ad30 0x7f0e0c0b4100 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f0e0400c450 tx=0x7f0e0400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:48.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.750+0000 7f0e02ffd640 1 -- 172.21.15.77:0/873331591 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e040074e0 con 0x7f0e0c15ad30 2023-11-04T01:42:48.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.750+0000 7f0e02ffd640 1 -- 172.21.15.77:0/873331591 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e04007660 con 0x7f0e0c15ad30 2023-11-04T01:42:48.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.750+0000 7f0e147ce640 1 -- 172.21.15.77:0/873331591 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e0c0c8390 con 0x7f0e0c15ad30 2023-11-04T01:42:48.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.750+0000 7f0e02ffd640 1 -- 172.21.15.77:0/873331591 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e04004a20 con 0x7f0e0c15ad30 2023-11-04T01:42:48.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.750+0000 7f0e147ce640 1 -- 172.21.15.77:0/873331591 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e0c0c8950 con 0x7f0e0c15ad30 2023-11-04T01:42:48.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.751+0000 7f0e147ce640 1 -- 172.21.15.77:0/873331591 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e0c15c160 con 0x7f0e0c15ad30 2023-11-04T01:42:48.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.751+0000 7f0e02ffd640 1 -- 172.21.15.77:0/873331591 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0e04004b80 con 0x7f0e0c15ad30 2023-11-04T01:42:48.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.751+0000 7f0e02ffd640 1 --2- 172.21.15.77:0/873331591 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0df006ae70 0x7f0df006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:48.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.751+0000 7f0e02ffd640 1 -- 172.21.15.77:0/873331591 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f0e04088d10 con 0x7f0e0c15ad30 2023-11-04T01:42:48.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.752+0000 7f0e1256a640 1 --2- 172.21.15.77:0/873331591 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0df006ae70 0x7f0df006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:48.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.752+0000 7f0e1256a640 1 --2- 172.21.15.77:0/873331591 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0df006ae70 0x7f0df006d330 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0e08007eb0 tx=0x7f0e08007400 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:48.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.755+0000 7f0e02ffd640 1 -- 172.21.15.77:0/873331591 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0e0c15c160 con 0x7f0e0c15ad30 2023-11-04T01:42:48.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.920+0000 7f0e147ce640 1 -- 172.21.15.77:0/873331591 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f0e0c15c160 con 0x7f0e0c15ad30 2023-11-04T01:42:48.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.920+0000 7f0e02ffd640 1 -- 172.21.15.77:0/873331591 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v74) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0e0c15c160 con 0x7f0e0c15ad30 2023-11-04T01:42:48.922 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:42:48.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.922+0000 7f0e147ce640 1 -- 172.21.15.77:0/873331591 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0df006ae70 msgr2=0x7f0df006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.922+0000 7f0e147ce640 1 --2- 172.21.15.77:0/873331591 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0df006ae70 0x7f0df006d330 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0e08007eb0 tx=0x7f0e08007400 comp rx=0 tx=0).stop 2023-11-04T01:42:48.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.922+0000 7f0e147ce640 1 -- 172.21.15.77:0/873331591 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e0c15ad30 msgr2=0x7f0e0c0b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:48.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.922+0000 7f0e147ce640 1 --2- 172.21.15.77:0/873331591 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e0c15ad30 0x7f0e0c0b4100 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f0e0400c450 tx=0x7f0e0400c910 comp rx=0 tx=0).stop 2023-11-04T01:42:48.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.922+0000 7f0e147ce640 1 -- 172.21.15.77:0/873331591 shutdown_connections 2023-11-04T01:42:48.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.922+0000 7f0e147ce640 1 --2- 172.21.15.77:0/873331591 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0df006ae70 0x7f0df006d330 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.922+0000 7f0e147ce640 1 --2- 172.21.15.77:0/873331591 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e0c15ad30 0x7f0e0c0b4100 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.922+0000 7f0e147ce640 1 --2- 172.21.15.77:0/873331591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e0c0ad730 0x7f0e0c0c78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.922+0000 7f0e147ce640 1 --2- 172.21.15.77:0/873331591 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e0c070c50 0x7f0e0c1f4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:48.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.922+0000 7f0e147ce640 1 -- 172.21.15.77:0/873331591 >> 172.21.15.77:0/873331591 conn(0x7f0e0c0ce950 msgr2=0x7f0e0c153890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:48.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.922+0000 7f0e147ce640 1 -- 172.21.15.77:0/873331591 shutdown_connections 2023-11-04T01:42:48.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:48.922+0000 7f0e147ce640 1 -- 172.21.15.77:0/873331591 wait complete. 2023-11-04T01:42:48.937 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:42:49.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.042+0000 7fc77d22b640 1 Processor -- start 2023-11-04T01:42:49.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.042+0000 7fc77d22b640 1 -- start start 2023-11-04T01:42:49.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.043+0000 7fc77d22b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc778153e60 0x7fc77815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.043+0000 7fc77d22b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc7780cd6d0 0x7fc778161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.043+0000 7fc77d22b640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7780cde60 con 0x7fc7780b4880 2023-11-04T01:42:49.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.043+0000 7fc77d22b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc778160f90 con 0x7fc7780cd6d0 2023-11-04T01:42:49.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.043+0000 7fc77d22b640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc77815e400 con 0x7fc778153e60 2023-11-04T01:42:49.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.043+0000 7fc76ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc7780cd6d0 0x7fc778161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.043+0000 7fc76ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc7780cd6d0 0x7fc778161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38554/0 (socket says 172.21.15.77:38554) 2023-11-04T01:42:49.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.043+0000 7fc76ffff640 1 -- 172.21.15.77:0/2352099515 learned_addr learned my addr 172.21.15.77:0/2352099515 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:49.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.043+0000 7fc776d9d640 1 --2- 172.21.15.77:0/2352099515 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc778153e60 0x7fc77815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.043+0000 7fc76ffff640 1 -- 172.21.15.77:0/2352099515 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc778153e60 msgr2=0x7fc77815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:49.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.043+0000 7fc76ffff640 1 --2- 172.21.15.77:0/2352099515 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc778153e60 0x7fc77815dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.043+0000 7fc76ffff640 1 -- 172.21.15.77:0/2352099515 >> v1:172.21.15.122:6789/0 conn(0x7fc7780b4880 legacy=0x7fc77806b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.043+0000 7fc76ffff640 1 -- 172.21.15.77:0/2352099515 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc778161960 con 0x7fc7780cd6d0 2023-11-04T01:42:49.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.044+0000 7fc76ffff640 1 --2- 172.21.15.77:0/2352099515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7780cd6d0 0x7fc778161420 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fc760009870 tx=0x7fc76002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9000d9660f8068bd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:49.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.044+0000 7fc77659c640 1 -- 172.21.15.77:0/2352099515 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc760030840 con 0x7fc7780cd6d0 2023-11-04T01:42:49.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.044+0000 7fc77659c640 1 -- 172.21.15.77:0/2352099515 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7600309a0 con 0x7fc7780cd6d0 2023-11-04T01:42:49.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.044+0000 7fc77659c640 1 -- 172.21.15.77:0/2352099515 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc760030d30 con 0x7fc7780cd6d0 2023-11-04T01:42:49.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.045+0000 7fc77d22b640 1 -- 172.21.15.77:0/2352099515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7780cd6d0 msgr2=0x7fc778161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.045+0000 7fc77d22b640 1 --2- 172.21.15.77:0/2352099515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7780cd6d0 0x7fc778161420 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fc760009870 tx=0x7fc76002b980 comp rx=0 tx=0).stop 2023-11-04T01:42:49.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.045+0000 7fc77d22b640 1 -- 172.21.15.77:0/2352099515 shutdown_connections 2023-11-04T01:42:49.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.045+0000 7fc77d22b640 1 --2- 172.21.15.77:0/2352099515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7780cd6d0 0x7fc778161420 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.045+0000 7fc77d22b640 1 --2- 172.21.15.77:0/2352099515 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc778153e60 0x7fc77815dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.045+0000 7fc77d22b640 1 -- 172.21.15.77:0/2352099515 >> 172.21.15.77:0/2352099515 conn(0x7fc7780cf880 msgr2=0x7fc7780cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:49.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.045+0000 7fc77d22b640 1 -- 172.21.15.77:0/2352099515 shutdown_connections 2023-11-04T01:42:49.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.045+0000 7fc77d22b640 1 -- 172.21.15.77:0/2352099515 wait complete. 2023-11-04T01:42:49.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.046+0000 7fc77d22b640 1 Processor -- start 2023-11-04T01:42:49.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.046+0000 7fc77d22b640 1 -- start start 2023-11-04T01:42:49.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.047+0000 7fc77d22b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7780b4880 0x7fc7780c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.047+0000 7fc77d22b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7780cd6d0 0x7fc778155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.047+0000 7fc77d22b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc778153e60 0x7fc7780cc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.047+0000 7fc77d22b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc778157980 con 0x7fc7780b4880 2023-11-04T01:42:49.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.047+0000 7fc77d22b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7781574f0 con 0x7fc7780cd6d0 2023-11-04T01:42:49.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.047+0000 7fc77d22b640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7780c8d00 con 0x7fc778153e60 2023-11-04T01:42:49.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.047+0000 7fc776d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7780b4880 0x7fc7780c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.047+0000 7fc776d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7780b4880 0x7fc7780c87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38566/0 (socket says 172.21.15.77:38566) 2023-11-04T01:42:49.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.047+0000 7fc776d9d640 1 -- 172.21.15.77:0/714520334 learned_addr learned my addr 172.21.15.77:0/714520334 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:49.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.047+0000 7fc77759e640 1 --2- 172.21.15.77:0/714520334 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc778153e60 0x7fc7780cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.047+0000 7fc76ffff640 1 --2- 172.21.15.77:0/714520334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7780cd6d0 0x7fc778155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.047+0000 7fc776d9d640 1 -- 172.21.15.77:0/714520334 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc778153e60 msgr2=0x7fc7780cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.047+0000 7fc776d9d640 1 --2- 172.21.15.77:0/714520334 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc778153e60 0x7fc7780cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.047+0000 7fc776d9d640 1 -- 172.21.15.77:0/714520334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7780cd6d0 msgr2=0x7fc778155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.047+0000 7fc776d9d640 1 --2- 172.21.15.77:0/714520334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7780cd6d0 0x7fc778155e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.047+0000 7fc776d9d640 1 -- 172.21.15.77:0/714520334 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7600094d0 con 0x7fc7780b4880 2023-11-04T01:42:49.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.048+0000 7fc776d9d640 1 --2- 172.21.15.77:0/714520334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7780b4880 0x7fc7780c87c0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fc76800e8a0 tx=0x7fc76800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:49.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.048+0000 7fc76f7fe640 1 -- 172.21.15.77:0/714520334 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7680094f0 con 0x7fc7780b4880 2023-11-04T01:42:49.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.048+0000 7fc76f7fe640 1 -- 172.21.15.77:0/714520334 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76800c940 con 0x7fc7780b4880 2023-11-04T01:42:49.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.048+0000 7fc76f7fe640 1 -- 172.21.15.77:0/714520334 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76800ccf0 con 0x7fc7780b4880 2023-11-04T01:42:49.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.048+0000 7fc77d22b640 1 -- 172.21.15.77:0/714520334 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7781568e0 con 0x7fc7780b4880 2023-11-04T01:42:49.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.048+0000 7fc77d22b640 1 -- 172.21.15.77:0/714520334 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc778156ea0 con 0x7fc7780b4880 2023-11-04T01:42:49.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.049+0000 7fc77d22b640 1 -- 172.21.15.77:0/714520334 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc778074290 con 0x7fc7780b4880 2023-11-04T01:42:49.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.049+0000 7fc76f7fe640 1 -- 172.21.15.77:0/714520334 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc768013470 con 0x7fc7780b4880 2023-11-04T01:42:49.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.049+0000 7fc76f7fe640 1 --2- 172.21.15.77:0/714520334 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc75806ae70 0x7fc75806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.049+0000 7fc76f7fe640 1 -- 172.21.15.77:0/714520334 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6326+0+0 (secure 0 0 0) 0x7fc7680897e0 con 0x7fc7780b4880 2023-11-04T01:42:49.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.050+0000 7fc76ffff640 1 --2- 172.21.15.77:0/714520334 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc75806ae70 0x7fc75806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.050+0000 7fc76ffff640 1 --2- 172.21.15.77:0/714520334 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc75806ae70 0x7fc75806d330 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc760036000 tx=0x7fc760008030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:49.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.054+0000 7fc76f7fe640 1 -- 172.21.15.77:0/714520334 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc768054760 con 0x7fc7780b4880 2023-11-04T01:42:49.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.218+0000 7fc77d22b640 1 -- 172.21.15.77:0/714520334 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7fc7780d0b80 con 0x7fc7780b4880 2023-11-04T01:42:49.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.219+0000 7fc76f7fe640 1 -- 172.21.15.77:0/714520334 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v74) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc768057d80 con 0x7fc7780b4880 2023-11-04T01:42:49.221 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:42:49.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.221+0000 7fc77d22b640 1 -- 172.21.15.77:0/714520334 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc75806ae70 msgr2=0x7fc75806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.221+0000 7fc77d22b640 1 --2- 172.21.15.77:0/714520334 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc75806ae70 0x7fc75806d330 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc760036000 tx=0x7fc760008030 comp rx=0 tx=0).stop 2023-11-04T01:42:49.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.221+0000 7fc77d22b640 1 -- 172.21.15.77:0/714520334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7780b4880 msgr2=0x7fc7780c87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.221+0000 7fc77d22b640 1 --2- 172.21.15.77:0/714520334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7780b4880 0x7fc7780c87c0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fc76800e8a0 tx=0x7fc76800ed60 comp rx=0 tx=0).stop 2023-11-04T01:42:49.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.221+0000 7fc77d22b640 1 -- 172.21.15.77:0/714520334 shutdown_connections 2023-11-04T01:42:49.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.221+0000 7fc77d22b640 1 --2- 172.21.15.77:0/714520334 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc75806ae70 0x7fc75806d330 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.221+0000 7fc77d22b640 1 --2- 172.21.15.77:0/714520334 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc778153e60 0x7fc7780cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.221+0000 7fc77d22b640 1 --2- 172.21.15.77:0/714520334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7780cd6d0 0x7fc778155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.221+0000 7fc77d22b640 1 --2- 172.21.15.77:0/714520334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7780b4880 0x7fc7780c87c0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.221+0000 7fc77d22b640 1 -- 172.21.15.77:0/714520334 >> 172.21.15.77:0/714520334 conn(0x7fc7780cf880 msgr2=0x7fc77815efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:49.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.221+0000 7fc77d22b640 1 -- 172.21.15.77:0/714520334 shutdown_connections 2023-11-04T01:42:49.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.221+0000 7fc77d22b640 1 -- 172.21.15.77:0/714520334 wait complete. 2023-11-04T01:42:49.233 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:42:49.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.334+0000 7efc70207640 1 Processor -- start 2023-11-04T01:42:49.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.334+0000 7efc70207640 1 -- start start 2023-11-04T01:42:49.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.335+0000 7efc70207640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efc68153e60 0x7efc6815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.335+0000 7efc70207640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc680b4880 0x7efc680b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.335+0000 7efc70207640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc680cde60 con 0x7efc680cd6d0 2023-11-04T01:42:49.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.335+0000 7efc70207640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc68160f90 con 0x7efc68153e60 2023-11-04T01:42:49.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.335+0000 7efc70207640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc680b5200 con 0x7efc680b4880 2023-11-04T01:42:49.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.335+0000 7efc6dfa3640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efc68153e60 0x7efc6815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.335+0000 7efc6dfa3640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efc68153e60 0x7efc6815dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38572/0 (socket says 172.21.15.77:38572) 2023-11-04T01:42:49.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.335+0000 7efc6dfa3640 1 -- 172.21.15.77:0/202557894 learned_addr learned my addr 172.21.15.77:0/202557894 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:49.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.336+0000 7efc6e7a4640 1 --2- 172.21.15.77:0/202557894 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc680b4880 0x7efc680b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.336+0000 7efc6dfa3640 1 -- 172.21.15.77:0/202557894 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc680b4880 msgr2=0x7efc680b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:49.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.336+0000 7efc6dfa3640 1 --2- 172.21.15.77:0/202557894 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc680b4880 0x7efc680b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.336+0000 7efc6dfa3640 1 -- 172.21.15.77:0/202557894 >> v1:172.21.15.122:6789/0 conn(0x7efc680cd6d0 legacy=0x7efc68161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:49.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.336+0000 7efc6dfa3640 1 -- 172.21.15.77:0/202557894 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6815e400 con 0x7efc68153e60 2023-11-04T01:42:49.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.336+0000 7efc6e7a4640 1 --2- 172.21.15.77:0/202557894 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc680b4880 0x7efc680b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:49.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.336+0000 7efc6dfa3640 1 --2- 172.21.15.77:0/202557894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc68153e60 0x7efc6815dec0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7efc64009e50 tx=0x7efc6402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=587ae7e77833e0c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:49.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.337+0000 7efc6cfa1640 1 -- 172.21.15.77:0/202557894 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6402ca70 con 0x7efc68153e60 2023-11-04T01:42:49.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.337+0000 7efc6cfa1640 1 -- 172.21.15.77:0/202557894 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6402cbd0 con 0x7efc68153e60 2023-11-04T01:42:49.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.337+0000 7efc6cfa1640 1 -- 172.21.15.77:0/202557894 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc640343f0 con 0x7efc68153e60 2023-11-04T01:42:49.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.337+0000 7efc70207640 1 -- 172.21.15.77:0/202557894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc68153e60 msgr2=0x7efc6815dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.337+0000 7efc70207640 1 --2- 172.21.15.77:0/202557894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc68153e60 0x7efc6815dec0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7efc64009e50 tx=0x7efc6402bed0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.337+0000 7efc70207640 1 -- 172.21.15.77:0/202557894 shutdown_connections 2023-11-04T01:42:49.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.337+0000 7efc70207640 1 --2- 172.21.15.77:0/202557894 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc680b4880 0x7efc680b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.337+0000 7efc70207640 1 --2- 172.21.15.77:0/202557894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc68153e60 0x7efc6815dec0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.337+0000 7efc70207640 1 -- 172.21.15.77:0/202557894 >> 172.21.15.77:0/202557894 conn(0x7efc680cf880 msgr2=0x7efc680cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:49.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.337+0000 7efc70207640 1 -- 172.21.15.77:0/202557894 shutdown_connections 2023-11-04T01:42:49.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.337+0000 7efc70207640 1 -- 172.21.15.77:0/202557894 wait complete. 2023-11-04T01:42:49.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.338+0000 7efc70207640 1 Processor -- start 2023-11-04T01:42:49.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.338+0000 7efc70207640 1 -- start start 2023-11-04T01:42:49.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.339+0000 7efc70207640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc680b4880 0x7efc68158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.339+0000 7efc70207640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc680cd6d0 0x7efc6814c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.339+0000 7efc70207640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc68153e60 0x7efc680cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.339+0000 7efc70207640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc68158dd0 con 0x7efc680b4880 2023-11-04T01:42:49.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.339+0000 7efc70207640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc681590b0 con 0x7efc68153e60 2023-11-04T01:42:49.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.339+0000 7efc70207640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc68159390 con 0x7efc680cd6d0 2023-11-04T01:42:49.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.339+0000 7efc6dfa3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc680b4880 0x7efc68158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.339+0000 7efc6dfa3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc680b4880 0x7efc68158580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38582/0 (socket says 172.21.15.77:38582) 2023-11-04T01:42:49.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.339+0000 7efc6dfa3640 1 -- 172.21.15.77:0/3018940220 learned_addr learned my addr 172.21.15.77:0/3018940220 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:49.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.339+0000 7efc6e7a4640 1 --2- 172.21.15.77:0/3018940220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc68153e60 0x7efc680cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.339+0000 7efc6d7a2640 1 --2- 172.21.15.77:0/3018940220 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc680cd6d0 0x7efc6814c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.339+0000 7efc6dfa3640 1 -- 172.21.15.77:0/3018940220 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc680cd6d0 msgr2=0x7efc6814c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.339+0000 7efc6dfa3640 1 --2- 172.21.15.77:0/3018940220 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc680cd6d0 0x7efc6814c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.339+0000 7efc6dfa3640 1 -- 172.21.15.77:0/3018940220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc68153e60 msgr2=0x7efc680cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.339+0000 7efc6dfa3640 1 --2- 172.21.15.77:0/3018940220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc68153e60 0x7efc680cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.339+0000 7efc6dfa3640 1 -- 172.21.15.77:0/3018940220 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc64009b30 con 0x7efc680b4880 2023-11-04T01:42:49.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.339+0000 7efc6e7a4640 1 --2- 172.21.15.77:0/3018940220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc68153e60 0x7efc680cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:49.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.340+0000 7efc6dfa3640 1 --2- 172.21.15.77:0/3018940220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc680b4880 0x7efc68158580 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7efc64009e50 tx=0x7efc64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:49.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.340+0000 7efc5e7fc640 1 -- 172.21.15.77:0/3018940220 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc64009510 con 0x7efc680b4880 2023-11-04T01:42:49.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.340+0000 7efc5e7fc640 1 -- 172.21.15.77:0/3018940220 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6403e450 con 0x7efc680b4880 2023-11-04T01:42:49.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.340+0000 7efc70207640 1 -- 172.21.15.77:0/3018940220 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc6815ad70 con 0x7efc680b4880 2023-11-04T01:42:49.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.340+0000 7efc5e7fc640 1 -- 172.21.15.77:0/3018940220 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6403e800 con 0x7efc680b4880 2023-11-04T01:42:49.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.340+0000 7efc70207640 1 -- 172.21.15.77:0/3018940220 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc6814c850 con 0x7efc680b4880 2023-11-04T01:42:49.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.341+0000 7efc70207640 1 -- 172.21.15.77:0/3018940220 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc6815abd0 con 0x7efc680b4880 2023-11-04T01:42:49.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.341+0000 7efc5e7fc640 1 -- 172.21.15.77:0/3018940220 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efc6403e960 con 0x7efc680b4880 2023-11-04T01:42:49.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.341+0000 7efc5e7fc640 1 --2- 172.21.15.77:0/3018940220 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efc4c06ae70 0x7efc4c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.341+0000 7efc5e7fc640 1 -- 172.21.15.77:0/3018940220 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6326+0+0 (secure 0 0 0) 0x7efc640ac750 con 0x7efc680b4880 2023-11-04T01:42:49.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.342+0000 7efc6d7a2640 1 --2- 172.21.15.77:0/3018940220 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efc4c06ae70 0x7efc4c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.342+0000 7efc6d7a2640 1 --2- 172.21.15.77:0/3018940220 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efc4c06ae70 0x7efc4c06d330 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7efc68156bb0 tx=0x7efc58009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:49.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.346+0000 7efc5e7fc640 1 -- 172.21.15.77:0/3018940220 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efc6815abd0 con 0x7efc680b4880 2023-11-04T01:42:49.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.510+0000 7efc70207640 1 -- 172.21.15.77:0/3018940220 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7efc6815abd0 con 0x7efc680b4880 2023-11-04T01:42:49.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.510+0000 7efc5e7fc640 1 -- 172.21.15.77:0/3018940220 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v74) v1 ==== 107+0+11 (secure 0 0 0) 0x7efc6815abd0 con 0x7efc680b4880 2023-11-04T01:42:49.512 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:42:49.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.512+0000 7efc70207640 1 -- 172.21.15.77:0/3018940220 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efc4c06ae70 msgr2=0x7efc4c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.512+0000 7efc70207640 1 --2- 172.21.15.77:0/3018940220 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efc4c06ae70 0x7efc4c06d330 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7efc68156bb0 tx=0x7efc58009040 comp rx=0 tx=0).stop 2023-11-04T01:42:49.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.512+0000 7efc70207640 1 -- 172.21.15.77:0/3018940220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc680b4880 msgr2=0x7efc68158580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.512+0000 7efc70207640 1 --2- 172.21.15.77:0/3018940220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc680b4880 0x7efc68158580 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7efc64009e50 tx=0x7efc64004a40 comp rx=0 tx=0).stop 2023-11-04T01:42:49.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.512+0000 7efc70207640 1 -- 172.21.15.77:0/3018940220 shutdown_connections 2023-11-04T01:42:49.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.512+0000 7efc70207640 1 --2- 172.21.15.77:0/3018940220 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efc4c06ae70 0x7efc4c06d330 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.512+0000 7efc70207640 1 --2- 172.21.15.77:0/3018940220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc68153e60 0x7efc680cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.512+0000 7efc70207640 1 --2- 172.21.15.77:0/3018940220 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc680cd6d0 0x7efc6814c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.512+0000 7efc70207640 1 --2- 172.21.15.77:0/3018940220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc680b4880 0x7efc68158580 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.512+0000 7efc70207640 1 -- 172.21.15.77:0/3018940220 >> 172.21.15.77:0/3018940220 conn(0x7efc680cf880 msgr2=0x7efc680b84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:49.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.512+0000 7efc70207640 1 -- 172.21.15.77:0/3018940220 shutdown_connections 2023-11-04T01:42:49.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.512+0000 7efc70207640 1 -- 172.21.15.77:0/3018940220 wait complete. 2023-11-04T01:42:49.525 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config' 2023-11-04T01:42:49.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.621+0000 7f76340d4640 1 Processor -- start 2023-11-04T01:42:49.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.621+0000 7f76340d4640 1 -- start start 2023-11-04T01:42:49.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.622+0000 7f76340d4640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f762c159b80 0x7f762c0b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.622+0000 7f76340d4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f762c0ade60 con 0x7f762c159f60 2023-11-04T01:42:49.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.622+0000 7f76340d4640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f762c0ae140 con 0x7f762c0ad910 2023-11-04T01:42:49.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.622+0000 7f76340d4640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f762c06dc70 con 0x7f762c159b80 2023-11-04T01:42:49.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.622+0000 7f7632671640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f762c159f60 0x7f762c0ca6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:46956/0 (socket says 172.21.15.77:46956) 2023-11-04T01:42:49.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.622+0000 7f7632671640 1 -- 172.21.15.77:0/785761882 learned_addr learned my addr 172.21.15.77:0/785761882 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:49.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.622+0000 7f7631e70640 1 --2- 172.21.15.77:0/785761882 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f762c159b80 0x7f762c0b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.623+0000 7f7630e6e640 1 -- 172.21.15.77:0/785761882 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2699372324 0 0) 0x7f762c0ade60 con 0x7f762c159f60 2023-11-04T01:42:49.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.623+0000 7f7630e6e640 1 -- 172.21.15.77:0/785761882 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7618003520 con 0x7f762c159f60 2023-11-04T01:42:49.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.623+0000 7f7630e6e640 1 -- 172.21.15.77:0/785761882 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3718991341 0 0) 0x7f762c0ae140 con 0x7f762c0ad910 2023-11-04T01:42:49.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.623+0000 7f7631e70640 1 -- 172.21.15.77:0/785761882 >> v1:172.21.15.122:6789/0 conn(0x7f762c0ad910 legacy=0x7f762c0ce1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.623+0000 7f7631e70640 1 -- 172.21.15.77:0/785761882 >> v1:172.21.15.77:6789/0 conn(0x7f762c159f60 legacy=0x7f762c0ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.623+0000 7f7631e70640 1 -- 172.21.15.77:0/785761882 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f762c06df50 con 0x7f762c159b80 2023-11-04T01:42:49.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.624+0000 7f7631e70640 1 --2- 172.21.15.77:0/785761882 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f762c159b80 0x7f762c0b4420 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f76280097d0 tx=0x7f762802b7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51447e258a5b430 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:49.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.624+0000 7f7630e6e640 1 -- 172.21.15.77:0/785761882 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76240019f0 con 0x7f762c159b80 2023-11-04T01:42:49.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.624+0000 7f7630e6e640 1 -- 172.21.15.77:0/785761882 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762802e050 con 0x7f762c159b80 2023-11-04T01:42:49.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.624+0000 7f7630e6e640 1 -- 172.21.15.77:0/785761882 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7628030730 con 0x7f762c159b80 2023-11-04T01:42:49.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.624+0000 7f76340d4640 1 -- 172.21.15.77:0/785761882 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f762c159b80 msgr2=0x7f762c0b4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.624+0000 7f76340d4640 1 --2- 172.21.15.77:0/785761882 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f762c159b80 0x7f762c0b4420 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f76280097d0 tx=0x7f762802b7b0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.624+0000 7f76340d4640 1 -- 172.21.15.77:0/785761882 shutdown_connections 2023-11-04T01:42:49.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.624+0000 7f76340d4640 1 --2- 172.21.15.77:0/785761882 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f762c159b80 0x7f762c0b4420 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.624+0000 7f76340d4640 1 -- 172.21.15.77:0/785761882 >> 172.21.15.77:0/785761882 conn(0x7f762c0cb490 msgr2=0x7f762c0cb870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:49.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.624+0000 7f76340d4640 1 -- 172.21.15.77:0/785761882 shutdown_connections 2023-11-04T01:42:49.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.624+0000 7f76340d4640 1 -- 172.21.15.77:0/785761882 wait complete. 2023-11-04T01:42:49.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.625+0000 7f76340d4640 1 Processor -- start 2023-11-04T01:42:49.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.625+0000 7f76340d4640 1 -- start start 2023-11-04T01:42:49.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.626+0000 7f76340d4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f762c0ad910 0x7f762c1f1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.626+0000 7f76340d4640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f762c159b80 0x7f762c0c4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.626+0000 7f76340d4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f762c159f60 0x7f762c0af010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.626+0000 7f76340d4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762c1f2530 con 0x7f762c159f60 2023-11-04T01:42:49.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.626+0000 7f76340d4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762c0c3080 con 0x7f762c0ad910 2023-11-04T01:42:49.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.626+0000 7f76340d4640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f762c0ab980 con 0x7f762c159b80 2023-11-04T01:42:49.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.626+0000 7f7632671640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f762c159f60 0x7f762c0af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.626+0000 7f7632671640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f762c159f60 0x7f762c0af010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38584/0 (socket says 172.21.15.77:38584) 2023-11-04T01:42:49.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.626+0000 7f7632671640 1 -- 172.21.15.77:0/1086573127 learned_addr learned my addr 172.21.15.77:0/1086573127 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:49.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.626+0000 7f763166f640 1 --2- 172.21.15.77:0/1086573127 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f762c159b80 0x7f762c0c4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.626+0000 7f7631e70640 1 --2- 172.21.15.77:0/1086573127 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f762c0ad910 0x7f762c1f1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.627+0000 7f7632671640 1 -- 172.21.15.77:0/1086573127 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f762c159b80 msgr2=0x7f762c0c4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.627+0000 7f7632671640 1 --2- 172.21.15.77:0/1086573127 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f762c159b80 0x7f762c0c4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.627+0000 7f7632671640 1 -- 172.21.15.77:0/1086573127 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f762c0ad910 msgr2=0x7f762c1f1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:49.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.627+0000 7f7632671640 1 --2- 172.21.15.77:0/1086573127 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f762c0ad910 0x7f762c1f1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:49.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.627+0000 7f7632671640 1 -- 172.21.15.77:0/1086573127 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7628009400 con 0x7f762c159f60 2023-11-04T01:42:49.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.627+0000 7f763166f640 1 --2- 172.21.15.77:0/1086573127 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f762c159b80 0x7f762c0c4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:49.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.627+0000 7f7631e70640 1 --2- 172.21.15.77:0/1086573127 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f762c0ad910 0x7f762c1f1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:49.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.627+0000 7f7632671640 1 --2- 172.21.15.77:0/1086573127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f762c159f60 0x7f762c0af010 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f762400cb10 tx=0x7f762400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:49.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.627+0000 7f76227fc640 1 -- 172.21.15.77:0/1086573127 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762400aa60 con 0x7f762c159f60 2023-11-04T01:42:49.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.627+0000 7f76227fc640 1 -- 172.21.15.77:0/1086573127 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762400abc0 con 0x7f762c159f60 2023-11-04T01:42:49.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.627+0000 7f76340d4640 1 -- 172.21.15.77:0/1086573127 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f762c0c3320 con 0x7f762c159f60 2023-11-04T01:42:49.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.627+0000 7f76227fc640 1 -- 172.21.15.77:0/1086573127 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7624004e30 con 0x7f762c159f60 2023-11-04T01:42:49.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.627+0000 7f76340d4640 1 -- 172.21.15.77:0/1086573127 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f762c0c3600 con 0x7f762c159f60 2023-11-04T01:42:49.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.628+0000 7f76340d4640 1 -- 172.21.15.77:0/1086573127 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f762c0abe60 con 0x7f762c159f60 2023-11-04T01:42:49.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.628+0000 7f76227fc640 1 -- 172.21.15.77:0/1086573127 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f76240070d0 con 0x7f762c159f60 2023-11-04T01:42:49.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.629+0000 7f76227fc640 1 --2- 172.21.15.77:0/1086573127 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f761006aea0 0x7f761006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:49.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.629+0000 7f76227fc640 1 -- 172.21.15.77:0/1086573127 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f7624089000 con 0x7f762c159f60 2023-11-04T01:42:49.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.629+0000 7f7631e70640 1 --2- 172.21.15.77:0/1086573127 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f761006aea0 0x7f761006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:49.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.629+0000 7f7631e70640 1 --2- 172.21.15.77:0/1086573127 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f761006aea0 0x7f761006d360 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7628034000 tx=0x7f7628008030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:49.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.633+0000 7f76227fc640 1 -- 172.21.15.77:0/1086573127 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f762c0abe60 con 0x7f762c159f60 2023-11-04T01:42:49.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:49.864+0000 7f76340d4640 1 -- 172.21.15.77:0/1086573127 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config"]} v 0) v1 -- 0x7f762c0abe60 con 0x7f762c159f60 2023-11-04T01:42:50.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.046+0000 7f76227fc640 1 -- 172.21.15.77:0/1086573127 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config"]}]=0 v174) v1 ==== 151+0+0 (secure 0 0 0) 0x7f762c0abe60 con 0x7f762c159f60 2023-11-04T01:42:50.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.048+0000 7f76340d4640 1 -- 172.21.15.77:0/1086573127 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f761006aea0 msgr2=0x7f761006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.048+0000 7f76340d4640 1 --2- 172.21.15.77:0/1086573127 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f761006aea0 0x7f761006d360 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7628034000 tx=0x7f7628008030 comp rx=0 tx=0).stop 2023-11-04T01:42:50.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.048+0000 7f76340d4640 1 -- 172.21.15.77:0/1086573127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f762c159f60 msgr2=0x7f762c0af010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.048+0000 7f76340d4640 1 --2- 172.21.15.77:0/1086573127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f762c159f60 0x7f762c0af010 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f762400cb10 tx=0x7f762400a060 comp rx=0 tx=0).stop 2023-11-04T01:42:50.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.048+0000 7f76340d4640 1 -- 172.21.15.77:0/1086573127 shutdown_connections 2023-11-04T01:42:50.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.048+0000 7f76340d4640 1 --2- 172.21.15.77:0/1086573127 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f761006aea0 0x7f761006d360 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.048+0000 7f76340d4640 1 --2- 172.21.15.77:0/1086573127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f762c159f60 0x7f762c0af010 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.048+0000 7f76340d4640 1 --2- 172.21.15.77:0/1086573127 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f762c159b80 0x7f762c0c4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.048+0000 7f76340d4640 1 --2- 172.21.15.77:0/1086573127 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f762c0ad910 0x7f762c1f1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.048+0000 7f76340d4640 1 -- 172.21.15.77:0/1086573127 >> 172.21.15.77:0/1086573127 conn(0x7f762c0cb490 msgr2=0x7f762c0ca6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:50.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.049+0000 7f76340d4640 1 -- 172.21.15.77:0/1086573127 shutdown_connections 2023-11-04T01:42:50.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.049+0000 7f76340d4640 1 -- 172.21.15.77:0/1086573127 wait complete. 2023-11-04T01:42:50.061 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-04T01:42:50.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.161+0000 7f72132c9640 1 Processor -- start 2023-11-04T01:42:50.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.162+0000 7f72132c9640 1 -- start start 2023-11-04T01:42:50.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.162+0000 7f72132c9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f720c153e60 0x7f720c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.162+0000 7f72132c9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f720c0cd6d0 0x7f720c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.162+0000 7f72132c9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f720c0cde60 con 0x7f720c0b4880 2023-11-04T01:42:50.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.162+0000 7f72132c9640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f720c160f90 con 0x7f720c153e60 2023-11-04T01:42:50.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.162+0000 7f72132c9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f720c15e400 con 0x7f720c0cd6d0 2023-11-04T01:42:50.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.163+0000 7f7211866640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f720c0b4880 0x7f720c0b4ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:46960/0 (socket says 172.21.15.77:46960) 2023-11-04T01:42:50.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.163+0000 7f7211866640 1 -- 172.21.15.77:0/1586389297 learned_addr learned my addr 172.21.15.77:0/1586389297 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:50.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.163+0000 7f7211065640 1 --2- 172.21.15.77:0/1586389297 >> v2:172.21.15.122:3300/0 conn(0x7f720c153e60 0x7f720c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:50.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.163+0000 7f7210864640 1 --2- 172.21.15.77:0/1586389297 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f720c0cd6d0 0x7f720c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:50.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.163+0000 7f7203fff640 1 -- 172.21.15.77:0/1586389297 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4036187381 0 0) 0x7f720c0cde60 con 0x7f720c0b4880 2023-11-04T01:42:50.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.163+0000 7f7203fff640 1 -- 172.21.15.77:0/1586389297 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71f8003520 con 0x7f720c0b4880 2023-11-04T01:42:50.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.163+0000 7f7203fff640 1 -- 172.21.15.77:0/1586389297 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2817642192 0 0) 0x7f71f8003520 con 0x7f720c0b4880 2023-11-04T01:42:50.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.163+0000 7f7203fff640 1 -- 172.21.15.77:0/1586389297 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f720c0cd6d0 msgr2=0x7f720c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:50.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.163+0000 7f7203fff640 1 --2- 172.21.15.77:0/1586389297 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f720c0cd6d0 0x7f720c161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.163+0000 7f7203fff640 1 -- 172.21.15.77:0/1586389297 >> v2:172.21.15.122:3300/0 conn(0x7f720c153e60 msgr2=0x7f720c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:50.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.163+0000 7f7203fff640 1 --2- 172.21.15.77:0/1586389297 >> v2:172.21.15.122:3300/0 conn(0x7f720c153e60 0x7f720c15dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.163+0000 7f7203fff640 1 -- 172.21.15.77:0/1586389297 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f720c161960 con 0x7f720c0b4880 2023-11-04T01:42:50.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.163+0000 7f7203fff640 1 -- 172.21.15.77:0/1586389297 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f72040019f0 con 0x7f720c0b4880 2023-11-04T01:42:50.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.163+0000 7f7203fff640 1 -- 172.21.15.77:0/1586389297 >> v1:172.21.15.77:6789/0 conn(0x7f720c0b4880 legacy=0x7f720c0b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.163+0000 7f7203fff640 1 --2- 172.21.15.77:0/1586389297 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71f8003970 0x7f71f8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.163+0000 7f7203fff640 1 --2- 172.21.15.77:0/1586389297 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f720c0cd6d0 0x7f71f80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.163+0000 7f7203fff640 1 --2- 172.21.15.77:0/1586389297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71f8004d00 0x7f71f8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.163+0000 7f7203fff640 1 -- 172.21.15.77:0/1586389297 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720c160f90 con 0x7f71f8004d00 2023-11-04T01:42:50.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.163+0000 7f7203fff640 1 -- 172.21.15.77:0/1586389297 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720c15e400 con 0x7f71f8003970 2023-11-04T01:42:50.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.163+0000 7f7203fff640 1 -- 172.21.15.77:0/1586389297 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f800b980 con 0x7f720c0cd6d0 2023-11-04T01:42:50.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.163+0000 7f7211065640 1 --2- 172.21.15.77:0/1586389297 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71f8003970 0x7f71f8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:50.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.163+0000 7f7211866640 1 --2- 172.21.15.77:0/1586389297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71f8004d00 0x7f71f8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:50.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.163+0000 7f7210864640 1 --2- 172.21.15.77:0/1586389297 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f720c0cd6d0 0x7f71f80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:50.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.164+0000 7f7211866640 1 -- 172.21.15.77:0/1586389297 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f720c0cd6d0 msgr2=0x7f71f80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:50.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.164+0000 7f7211866640 1 --2- 172.21.15.77:0/1586389297 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f720c0cd6d0 0x7f71f80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.164+0000 7f7211866640 1 -- 172.21.15.77:0/1586389297 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71f8003970 msgr2=0x7f71f8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:50.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.164+0000 7f7211866640 1 --2- 172.21.15.77:0/1586389297 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71f8003970 0x7f71f8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.164+0000 7f7211866640 1 -- 172.21.15.77:0/1586389297 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f8003520 con 0x7f71f8004d00 2023-11-04T01:42:50.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.164+0000 7f7211866640 1 --2- 172.21.15.77:0/1586389297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71f8004d00 0x7f71f8005180 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f720400a870 tx=0x7f71f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a6d5ce21a49c98 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:50.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.164+0000 7f7203fff640 1 -- 172.21.15.77:0/1586389297 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7204034630 con 0x7f71f8004d00 2023-11-04T01:42:50.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.164+0000 7f7203fff640 1 -- 172.21.15.77:0/1586389297 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720402f070 con 0x7f71f8004d00 2023-11-04T01:42:50.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.164+0000 7f7203fff640 1 -- 172.21.15.77:0/1586389297 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72040349f0 con 0x7f71f8004d00 2023-11-04T01:42:50.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.165+0000 7f72132c9640 1 -- 172.21.15.77:0/1586389297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71f8004d00 msgr2=0x7f71f8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.165+0000 7f72132c9640 1 --2- 172.21.15.77:0/1586389297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71f8004d00 0x7f71f8005180 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f720400a870 tx=0x7f71f80057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.165+0000 7f7211866640 1 -- 172.21.15.77:0/1586389297 reap_dead start 2023-11-04T01:42:50.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.165+0000 7f72132c9640 1 -- 172.21.15.77:0/1586389297 shutdown_connections 2023-11-04T01:42:50.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.165+0000 7f72132c9640 1 -- 172.21.15.77:0/1586389297 >> 172.21.15.77:0/1586389297 conn(0x7f720c0cf880 msgr2=0x7f720c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:50.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.165+0000 7f72132c9640 1 -- 172.21.15.77:0/1586389297 shutdown_connections 2023-11-04T01:42:50.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.165+0000 7f72132c9640 1 -- 172.21.15.77:0/1586389297 wait complete. 2023-11-04T01:42:50.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.166+0000 7f72132c9640 1 Processor -- start 2023-11-04T01:42:50.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.166+0000 7f72132c9640 1 -- start start 2023-11-04T01:42:50.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.167+0000 7f72132c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71f8004d00 0x7f720c0c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.167+0000 7f72132c9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f720c0c8fb0 0x7f720c0c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.167+0000 7f72132c9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f720c0cbc40 0x7f720c0cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.167+0000 7f72132c9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720c0cc610 con 0x7f71f8004d00 2023-11-04T01:42:50.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.167+0000 7f72132c9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720c0c6050 con 0x7f720c0cbc40 2023-11-04T01:42:50.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.167+0000 7f72132c9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f720c150b20 con 0x7f720c0c8fb0 2023-11-04T01:42:50.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.167+0000 7f7211065640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71f8004d00 0x7f720c0c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:50.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.167+0000 7f7211065640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71f8004d00 0x7f720c0c5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38610/0 (socket says 172.21.15.77:38610) 2023-11-04T01:42:50.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.167+0000 7f7211065640 1 -- 172.21.15.77:0/757643676 learned_addr learned my addr 172.21.15.77:0/757643676 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:50.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.167+0000 7f7210864640 1 --2- 172.21.15.77:0/757643676 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f720c0c8fb0 0x7f720c0c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:50.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.167+0000 7f7211866640 1 --2- 172.21.15.77:0/757643676 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f720c0cbc40 0x7f720c0cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:50.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.167+0000 7f7211065640 1 -- 172.21.15.77:0/757643676 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f720c0c8fb0 msgr2=0x7f720c0c7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.167+0000 7f7211065640 1 --2- 172.21.15.77:0/757643676 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f720c0c8fb0 0x7f720c0c7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.167+0000 7f7211065640 1 -- 172.21.15.77:0/757643676 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f720c0cbc40 msgr2=0x7f720c0cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.167+0000 7f7211065640 1 --2- 172.21.15.77:0/757643676 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f720c0cbc40 0x7f720c0cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.167+0000 7f7211065640 1 -- 172.21.15.77:0/757643676 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f720c0c7a30 con 0x7f71f8004d00 2023-11-04T01:42:50.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.168+0000 7f7211065640 1 --2- 172.21.15.77:0/757643676 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71f8004d00 0x7f720c0c5b10 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f71fc011990 tx=0x7f71fc011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:50.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.168+0000 7f7201ffb640 1 -- 172.21.15.77:0/757643676 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc00fad0 con 0x7f71f8004d00 2023-11-04T01:42:50.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.168+0000 7f7201ffb640 1 -- 172.21.15.77:0/757643676 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71fc00fc30 con 0x7f71f8004d00 2023-11-04T01:42:50.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.168+0000 7f72132c9640 1 -- 172.21.15.77:0/757643676 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f720c0c9730 con 0x7f71f8004d00 2023-11-04T01:42:50.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.168+0000 7f7201ffb640 1 -- 172.21.15.77:0/757643676 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc014440 con 0x7f71f8004d00 2023-11-04T01:42:50.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.168+0000 7f72132c9640 1 -- 172.21.15.77:0/757643676 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f720c0c9450 con 0x7f71f8004d00 2023-11-04T01:42:50.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.169+0000 7f72132c9640 1 -- 172.21.15.77:0/757643676 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f720c074290 con 0x7f71f8004d00 2023-11-04T01:42:50.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.169+0000 7f7201ffb640 1 -- 172.21.15.77:0/757643676 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f71fc01d400 con 0x7f71f8004d00 2023-11-04T01:42:50.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.170+0000 7f7201ffb640 1 --2- 172.21.15.77:0/757643676 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f71f006ae70 0x7f71f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.170+0000 7f7201ffb640 1 -- 172.21.15.77:0/757643676 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f71fc08a090 con 0x7f71f8004d00 2023-11-04T01:42:50.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.170+0000 7f7210864640 1 --2- 172.21.15.77:0/757643676 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f71f006ae70 0x7f71f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:50.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.171+0000 7f7210864640 1 --2- 172.21.15.77:0/757643676 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f71f006ae70 0x7f71f006d330 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f720c15e250 tx=0x7f7208008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:50.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.174+0000 7f7201ffb640 1 -- 172.21.15.77:0/757643676 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f71fc054f60 con 0x7f71f8004d00 2023-11-04T01:42:50.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.340+0000 7f72132c9640 1 -- 172.21.15.77:0/757643676 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f720c0d0b80 con 0x7f71f8004d00 2023-11-04T01:42:50.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.343+0000 7f7201ffb640 1 -- 172.21.15.77:0/757643676 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v17)=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f71fc058580 con 0x7f71f8004d00 2023-11-04T01:42:50.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.345+0000 7f72132c9640 1 -- 172.21.15.77:0/757643676 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f71f006ae70 msgr2=0x7f71f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.345+0000 7f72132c9640 1 --2- 172.21.15.77:0/757643676 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f71f006ae70 0x7f71f006d330 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f720c15e250 tx=0x7f7208008040 comp rx=0 tx=0).stop 2023-11-04T01:42:50.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.345+0000 7f72132c9640 1 -- 172.21.15.77:0/757643676 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71f8004d00 msgr2=0x7f720c0c5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.345+0000 7f72132c9640 1 --2- 172.21.15.77:0/757643676 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71f8004d00 0x7f720c0c5b10 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f71fc011990 tx=0x7f71fc011e50 comp rx=0 tx=0).stop 2023-11-04T01:42:50.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.345+0000 7f72132c9640 1 -- 172.21.15.77:0/757643676 shutdown_connections 2023-11-04T01:42:50.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.345+0000 7f72132c9640 1 --2- 172.21.15.77:0/757643676 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f71f006ae70 0x7f71f006d330 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.346+0000 7f72132c9640 1 --2- 172.21.15.77:0/757643676 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f720c0cbc40 0x7f720c0cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.346+0000 7f72132c9640 1 --2- 172.21.15.77:0/757643676 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f720c0c8fb0 0x7f720c0c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.346+0000 7f72132c9640 1 --2- 172.21.15.77:0/757643676 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71f8004d00 0x7f720c0c5b10 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.346+0000 7f72132c9640 1 -- 172.21.15.77:0/757643676 >> 172.21.15.77:0/757643676 conn(0x7f720c0cf880 msgr2=0x7f720c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:50.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.346+0000 7f72132c9640 1 -- 172.21.15.77:0/757643676 shutdown_connections 2023-11-04T01:42:50.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.346+0000 7f72132c9640 1 -- 172.21.15.77:0/757643676 wait complete. 2023-11-04T01:42:50.358 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:42:50.359 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:42:50.403 DEBUG:teuthology.orchestra.run.smithi122:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:42:50.451 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:42:50.452 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:42:50.452 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:42:50.467 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19534 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:42:50.468 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:42:50.468 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:42:50.485 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056339,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13650 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:42:50.485 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:42:50.486 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:42:50.522 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19534 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:42:50.522 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:42:50.523 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:42:50.542 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056339,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13650 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:42:50.542 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-04T01:42:50.543 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:50.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.660+0000 7f8aa88ec640 1 Processor -- start 2023-11-04T01:42:50.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.660+0000 7f8aa88ec640 1 -- start start 2023-11-04T01:42:50.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.661+0000 7f8aa88ec640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8aa4160440 0x7f8aa40b4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.661+0000 7f8aa88ec640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8aa40b6160 0x7f8aa40b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.661+0000 7f8aa88ec640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa40ce3a0 con 0x7f8aa40cd6e0 2023-11-04T01:42:50.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.661+0000 7f8aa88ec640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aa40d2c10 con 0x7f8aa40b6160 2023-11-04T01:42:50.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.661+0000 7f8aa88ec640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa40d1120 con 0x7f8aa4160440 2023-11-04T01:42:50.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.662+0000 7f8aa2d9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f8aa40cd6e0 0x7f8aa40cdb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:46962/0 (socket says 172.21.15.77:46962) 2023-11-04T01:42:50.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.662+0000 7f8aa2d9d640 1 -- 172.21.15.77:0/1843561654 learned_addr learned my addr 172.21.15.77:0/1843561654 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:50.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.662+0000 7f8aa159a640 1 -- 172.21.15.77:0/1843561654 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 388068422 0 0) 0x7f8aa40ce3a0 con 0x7f8aa40cd6e0 2023-11-04T01:42:50.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.662+0000 7f8aa159a640 1 -- 172.21.15.77:0/1843561654 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a90003520 con 0x7f8aa40cd6e0 2023-11-04T01:42:50.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.662+0000 7f8aa259c640 1 --2- 172.21.15.77:0/1843561654 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8aa4160440 0x7f8aa40b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:50.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.662+0000 7f8aa1d9b640 1 --2- 172.21.15.77:0/1843561654 >> v2:172.21.15.122:3300/0 conn(0x7f8aa40b6160 0x7f8aa40b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:50.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.662+0000 7f8aa159a640 1 -- 172.21.15.77:0/1843561654 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1980720898 0 0) 0x7f8a90003520 con 0x7f8aa40cd6e0 2023-11-04T01:42:50.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.662+0000 7f8aa159a640 1 -- 172.21.15.77:0/1843561654 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8aa4160440 msgr2=0x7f8aa40b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:50.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.662+0000 7f8aa159a640 1 --2- 172.21.15.77:0/1843561654 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8aa4160440 0x7f8aa40b4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.662+0000 7f8aa159a640 1 -- 172.21.15.77:0/1843561654 >> v2:172.21.15.122:3300/0 conn(0x7f8aa40b6160 msgr2=0x7f8aa40b4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:50.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.662+0000 7f8aa159a640 1 --2- 172.21.15.77:0/1843561654 >> v2:172.21.15.122:3300/0 conn(0x7f8aa40b6160 0x7f8aa40b4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.662+0000 7f8aa159a640 1 -- 172.21.15.77:0/1843561654 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa40d1400 con 0x7f8aa40cd6e0 2023-11-04T01:42:50.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.662+0000 7f8aa159a640 1 -- 172.21.15.77:0/1843561654 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f8a940019f0 con 0x7f8aa40cd6e0 2023-11-04T01:42:50.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.662+0000 7f8aa159a640 1 -- 172.21.15.77:0/1843561654 >> v1:172.21.15.77:6789/0 conn(0x7f8aa40cd6e0 legacy=0x7f8aa40cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.662+0000 7f8aa159a640 1 --2- 172.21.15.77:0/1843561654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a90003970 0x7f8a90003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.662+0000 7f8aa159a640 1 --2- 172.21.15.77:0/1843561654 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a900047c0 0x7f8a90004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.662+0000 7f8aa159a640 1 --2- 172.21.15.77:0/1843561654 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8aa4160440 0x7f8a90005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.662+0000 7f8aa159a640 1 -- 172.21.15.77:0/1843561654 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa40d2c10 con 0x7f8a90003970 2023-11-04T01:42:50.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.662+0000 7f8aa159a640 1 -- 172.21.15.77:0/1843561654 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa40d1120 con 0x7f8a900047c0 2023-11-04T01:42:50.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.662+0000 7f8aa159a640 1 -- 172.21.15.77:0/1843561654 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9000b980 con 0x7f8aa4160440 2023-11-04T01:42:50.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.662+0000 7f8aa259c640 1 --2- 172.21.15.77:0/1843561654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a90003970 0x7f8a90003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:50.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.662+0000 7f8aa1d9b640 1 --2- 172.21.15.77:0/1843561654 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a900047c0 0x7f8a90004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:50.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.662+0000 7f8aa2d9d640 1 --2- 172.21.15.77:0/1843561654 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8aa4160440 0x7f8a90005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:50.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.662+0000 7f8aa259c640 1 -- 172.21.15.77:0/1843561654 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8aa4160440 msgr2=0x7f8a90005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:50.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.662+0000 7f8aa259c640 1 --2- 172.21.15.77:0/1843561654 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8aa4160440 0x7f8a90005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.662+0000 7f8aa259c640 1 -- 172.21.15.77:0/1843561654 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a900047c0 msgr2=0x7f8a90004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:50.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.662+0000 7f8aa259c640 1 --2- 172.21.15.77:0/1843561654 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a900047c0 0x7f8a90004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.662+0000 7f8aa259c640 1 -- 172.21.15.77:0/1843561654 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a90003520 con 0x7f8a90003970 2023-11-04T01:42:50.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.662+0000 7f8aa2d9d640 1 --2- 172.21.15.77:0/1843561654 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8aa4160440 0x7f8a90005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:50.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.663+0000 7f8aa259c640 1 --2- 172.21.15.77:0/1843561654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a90003970 0x7f8a90003d90 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c009ac0 tx=0x7f8a900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a53eb83edc6ec67 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:50.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.663+0000 7f8aa159a640 1 -- 172.21.15.77:0/1843561654 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c02c6b0 con 0x7f8a90003970 2023-11-04T01:42:50.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.663+0000 7f8aa159a640 1 -- 172.21.15.77:0/1843561654 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9c02c810 con 0x7f8a90003970 2023-11-04T01:42:50.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.663+0000 7f8aa159a640 1 -- 172.21.15.77:0/1843561654 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c02cba0 con 0x7f8a90003970 2023-11-04T01:42:50.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.664+0000 7f8aa88ec640 1 -- 172.21.15.77:0/1843561654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a90003970 msgr2=0x7f8a90003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.664+0000 7f8aa88ec640 1 --2- 172.21.15.77:0/1843561654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a90003970 0x7f8a90003d90 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c009ac0 tx=0x7f8a900057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.664+0000 7f8aa2d9d640 1 -- 172.21.15.77:0/1843561654 reap_dead start 2023-11-04T01:42:50.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.664+0000 7f8aa88ec640 1 -- 172.21.15.77:0/1843561654 shutdown_connections 2023-11-04T01:42:50.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.664+0000 7f8aa88ec640 1 -- 172.21.15.77:0/1843561654 >> 172.21.15.77:0/1843561654 conn(0x7f8aa40cf900 msgr2=0x7f8aa40cfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:50.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.664+0000 7f8aa88ec640 1 -- 172.21.15.77:0/1843561654 shutdown_connections 2023-11-04T01:42:50.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.664+0000 7f8aa88ec640 1 -- 172.21.15.77:0/1843561654 wait complete. 2023-11-04T01:42:50.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.665+0000 7f8aa88ec640 1 Processor -- start 2023-11-04T01:42:50.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.665+0000 7f8aa88ec640 1 -- start start 2023-11-04T01:42:50.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.666+0000 7f8aa88ec640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a90003970 0x7f8aa41467a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.666+0000 7f8aa88ec640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8aa40c8ee0 0x7f8aa4143d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.666+0000 7f8aa88ec640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8aa40c5520 0x7f8aa415a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.666+0000 7f8aa88ec640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa4157000 con 0x7f8aa40c8ee0 2023-11-04T01:42:50.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.666+0000 7f8aa88ec640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa4146ce0 con 0x7f8a90003970 2023-11-04T01:42:50.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.666+0000 7f8aa88ec640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa4144240 con 0x7f8aa40c5520 2023-11-04T01:42:50.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.666+0000 7f8aa1d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8aa40c8ee0 0x7f8aa4143d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:50.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.666+0000 7f8aa1d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8aa40c8ee0 0x7f8aa4143d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38626/0 (socket says 172.21.15.77:38626) 2023-11-04T01:42:50.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.666+0000 7f8aa1d9b640 1 -- 172.21.15.77:0/50350843 learned_addr learned my addr 172.21.15.77:0/50350843 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:50.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.666+0000 7f8aa259c640 1 --2- 172.21.15.77:0/50350843 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a90003970 0x7f8aa41467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:50.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.666+0000 7f8aa2d9d640 1 --2- 172.21.15.77:0/50350843 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8aa40c5520 0x7f8aa415a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:50.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.666+0000 7f8aa1d9b640 1 -- 172.21.15.77:0/50350843 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8aa40c5520 msgr2=0x7f8aa415a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.666+0000 7f8aa1d9b640 1 --2- 172.21.15.77:0/50350843 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8aa40c5520 0x7f8aa415a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.666+0000 7f8aa1d9b640 1 -- 172.21.15.77:0/50350843 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a90003970 msgr2=0x7f8aa41467a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.666+0000 7f8aa1d9b640 1 --2- 172.21.15.77:0/50350843 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a90003970 0x7f8aa41467a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.666+0000 7f8aa1d9b640 1 -- 172.21.15.77:0/50350843 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa4156380 con 0x7f8aa40c8ee0 2023-11-04T01:42:50.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.667+0000 7f8aa1d9b640 1 --2- 172.21.15.77:0/50350843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8aa40c8ee0 0x7f8aa4143d00 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c011a70 tx=0x7f8a8c011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:50.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.667+0000 7f8a9affd640 1 -- 172.21.15.77:0/50350843 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c009680 con 0x7f8aa40c8ee0 2023-11-04T01:42:50.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.667+0000 7f8a9affd640 1 -- 172.21.15.77:0/50350843 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a8c00fb50 con 0x7f8aa40c8ee0 2023-11-04T01:42:50.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.667+0000 7f8aa88ec640 1 -- 172.21.15.77:0/50350843 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa4156660 con 0x7f8aa40c8ee0 2023-11-04T01:42:50.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.667+0000 7f8a9affd640 1 -- 172.21.15.77:0/50350843 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c00fee0 con 0x7f8aa40c8ee0 2023-11-04T01:42:50.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.667+0000 7f8aa88ec640 1 -- 172.21.15.77:0/50350843 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa4156c20 con 0x7f8aa40c8ee0 2023-11-04T01:42:50.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.668+0000 7f8aa88ec640 1 -- 172.21.15.77:0/50350843 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aa4157140 con 0x7f8aa40c8ee0 2023-11-04T01:42:50.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.668+0000 7f8a9affd640 1 -- 172.21.15.77:0/50350843 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8a8c014440 con 0x7f8aa40c8ee0 2023-11-04T01:42:50.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.668+0000 7f8a9affd640 1 --2- 172.21.15.77:0/50350843 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8a8406ae70 0x7f8a8406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.669+0000 7f8a9affd640 1 -- 172.21.15.77:0/50350843 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f8a8c08a0d0 con 0x7f8aa40c8ee0 2023-11-04T01:42:50.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.669+0000 7f8aa259c640 1 --2- 172.21.15.77:0/50350843 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8a8406ae70 0x7f8a8406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:50.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.669+0000 7f8aa259c640 1 --2- 172.21.15.77:0/50350843 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8a8406ae70 0x7f8a8406d330 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c036000 tx=0x7f8a9c030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:50.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.673+0000 7f8a9affd640 1 -- 172.21.15.77:0/50350843 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8aa4157140 con 0x7f8aa40c8ee0 2023-11-04T01:42:50.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.874+0000 7f8aa88ec640 1 -- 172.21.15.77:0/50350843 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8aa4157140 con 0x7f8aa40c8ee0 2023-11-04T01:42:50.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.874+0000 7f8a9affd640 1 -- 172.21.15.77:0/50350843 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+3701 (secure 0 0 0) 0x7f8a8c022e90 con 0x7f8aa40c8ee0 2023-11-04T01:42:50.877 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:50.877 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":31,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6396,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/20625239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":20625239},{"type":"v1","addr":"172.21.15.77:6834","nonce":20625239}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6399,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3909793035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3909793035},{"type":"v1","addr":"172.21.15.77:6835","nonce":3909793035}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":35252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/1714919040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1714919040},{"type":"v1","addr":"172.21.15.122:6836","nonce":1714919040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":35420,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/4004576279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":4004576279},{"type":"v1","addr":"172.21.15.122:6837","nonce":4004576279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[]} 2023-11-04T01:42:50.877 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 31 2023-11-04T01:42:50.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.876+0000 7f8aa88ec640 1 -- 172.21.15.77:0/50350843 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8a8406ae70 msgr2=0x7f8a8406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.876+0000 7f8aa88ec640 1 --2- 172.21.15.77:0/50350843 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8a8406ae70 0x7f8a8406d330 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c036000 tx=0x7f8a9c030000 comp rx=0 tx=0).stop 2023-11-04T01:42:50.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.876+0000 7f8aa88ec640 1 -- 172.21.15.77:0/50350843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8aa40c8ee0 msgr2=0x7f8aa4143d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.876+0000 7f8aa88ec640 1 --2- 172.21.15.77:0/50350843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8aa40c8ee0 0x7f8aa4143d00 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c011a70 tx=0x7f8a8c011f30 comp rx=0 tx=0).stop 2023-11-04T01:42:50.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.876+0000 7f8aa88ec640 1 -- 172.21.15.77:0/50350843 shutdown_connections 2023-11-04T01:42:50.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.876+0000 7f8aa88ec640 1 --2- 172.21.15.77:0/50350843 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8a8406ae70 0x7f8a8406d330 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.876+0000 7f8aa88ec640 1 --2- 172.21.15.77:0/50350843 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8aa40c5520 0x7f8aa415a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.876+0000 7f8aa88ec640 1 --2- 172.21.15.77:0/50350843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8aa40c8ee0 0x7f8aa4143d00 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.876+0000 7f8aa88ec640 1 --2- 172.21.15.77:0/50350843 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a90003970 0x7f8aa41467a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.876+0000 7f8aa88ec640 1 -- 172.21.15.77:0/50350843 >> 172.21.15.77:0/50350843 conn(0x7f8aa40cf900 msgr2=0x7f8aa40b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:50.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.876+0000 7f8aa88ec640 1 -- 172.21.15.77:0/50350843 shutdown_connections 2023-11-04T01:42:50.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:50.876+0000 7f8aa88ec640 1 -- 172.21.15.77:0/50350843 wait complete. 2023-11-04T01:42:50.889 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:42:50.889 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:42:50.890 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:42:50.890 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:42:50.890 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:42:50.890 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:42:50.891 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:42:50.891 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:42:50.891 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:42:50.891 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:42:50.892 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:42:50.892 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:42:50.892 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:42:50.893 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:42:50.893 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:42:50.893 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:42:50.899 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:42:50.899 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:42:50.900 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:42:50.900 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:42:50.904 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:42:50.904 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:42:50.905 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:42:50.905 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:42:50.942 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:42:50.942 DEBUG:teuthology.parallel:result is None 2023-11-04T01:42:50.943 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:42:50.943 DEBUG:teuthology.parallel:result is None 2023-11-04T01:42:50.946 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:42:50.947 DEBUG:teuthology.parallel:result is None 2023-11-04T01:42:50.948 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:42:50.948 DEBUG:teuthology.parallel:result is None 2023-11-04T01:42:50.948 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-04T01:42:51.017 INFO:tasks.ceph.mds.c.smithi077.stdout:starting mds.c at 2023-11-04T01:42:51.017 INFO:tasks.ceph.mds.a.smithi077.stdout:starting mds.a at 2023-11-04T01:42:51.029 INFO:tasks.ceph.mds.b.smithi122.stdout:starting mds.b at 2023-11-04T01:42:51.029 INFO:tasks.ceph.mds.d.smithi122.stdout:starting mds.d at 2023-11-04T01:42:51.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.052+0000 7fcdcdaa9640 1 Processor -- start 2023-11-04T01:42:51.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.052+0000 7fcdcdaa9640 1 -- start start 2023-11-04T01:42:51.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.053+0000 7fcdcdaa9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fcdc815cfd0 0x7fcdc806c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:51.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.053+0000 7fcdcdaa9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcdc80cd570 0x7fcdc80cd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:51.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.053+0000 7fcdcdaa9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdc80cdf20 con 0x7fcdc80cf180 2023-11-04T01:42:51.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.053+0000 7fcdcdaa9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdc815d3b0 con 0x7fcdc80cd570 2023-11-04T01:42:51.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.053+0000 7fcdcdaa9640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdc80cea20 con 0x7fcdc815cfd0 2023-11-04T01:42:51.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.053+0000 7fcdc7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcdc80cd570 0x7fcdc80cd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:51.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.053+0000 7fcdc6ffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fcdc80cf180 0x7fcdc8161440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:46966/0 (socket says 172.21.15.77:46966) 2023-11-04T01:42:51.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.053+0000 7fcdc7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcdc80cd570 0x7fcdc80cd9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38674/0 (socket says 172.21.15.77:38674) 2023-11-04T01:42:51.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.053+0000 7fcdc6ffd640 1 -- 172.21.15.77:0/2221298719 learned_addr learned my addr 172.21.15.77:0/2221298719 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:51.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.053+0000 7fcdc77fe640 1 --2- 172.21.15.77:0/2221298719 >> v2:172.21.15.122:3300/0 conn(0x7fcdc815cfd0 0x7fcdc806c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:51.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.053+0000 7fcdc7fff640 1 -- 172.21.15.77:0/2221298719 >> v2:172.21.15.122:3300/0 conn(0x7fcdc815cfd0 msgr2=0x7fcdc806c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:51.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.053+0000 7fcdc7fff640 1 --2- 172.21.15.77:0/2221298719 >> v2:172.21.15.122:3300/0 conn(0x7fcdc815cfd0 0x7fcdc806c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:51.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.053+0000 7fcdc7fff640 1 -- 172.21.15.77:0/2221298719 >> v1:172.21.15.77:6789/0 conn(0x7fcdc80cf180 legacy=0x7fcdc8161440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:51.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.053+0000 7fcdc7fff640 1 -- 172.21.15.77:0/2221298719 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc80cf610 con 0x7fcdc80cd570 2023-11-04T01:42:51.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.054+0000 7fcdc7fff640 1 --2- 172.21.15.77:0/2221298719 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdc80cd570 0x7fcdc80cd9e0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80d1ca0 tx=0x7fcdc002be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=837fda62efb7da66 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:51.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.056+0000 7fcdc67fc640 1 -- 172.21.15.77:0/2221298719 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc002cbe0 con 0x7fcdc80cd570 2023-11-04T01:42:51.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.056+0000 7fcdc67fc640 1 -- 172.21.15.77:0/2221298719 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc002cd40 con 0x7fcdc80cd570 2023-11-04T01:42:51.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.056+0000 7fcdc67fc640 1 -- 172.21.15.77:0/2221298719 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc0034660 con 0x7fcdc80cd570 2023-11-04T01:42:51.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.056+0000 7fcdcdaa9640 1 -- 172.21.15.77:0/2221298719 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdc80cd570 msgr2=0x7fcdc80cd9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:51.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.056+0000 7fcdcdaa9640 1 --2- 172.21.15.77:0/2221298719 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdc80cd570 0x7fcdc80cd9e0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80d1ca0 tx=0x7fcdc002be30 comp rx=0 tx=0).stop 2023-11-04T01:42:51.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.056+0000 7fcdcdaa9640 1 -- 172.21.15.77:0/2221298719 shutdown_connections 2023-11-04T01:42:51.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.056+0000 7fcdcdaa9640 1 --2- 172.21.15.77:0/2221298719 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdc80cd570 0x7fcdc80cd9e0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:51.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.056+0000 7fcdcdaa9640 1 --2- 172.21.15.77:0/2221298719 >> v2:172.21.15.122:3300/0 conn(0x7fcdc815cfd0 0x7fcdc806c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:51.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.056+0000 7fcdcdaa9640 1 -- 172.21.15.77:0/2221298719 >> 172.21.15.77:0/2221298719 conn(0x7fcdc806ea20 msgr2=0x7fcdc806ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:51.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.056+0000 7fcdcdaa9640 1 -- 172.21.15.77:0/2221298719 shutdown_connections 2023-11-04T01:42:51.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.056+0000 7fcdcdaa9640 1 -- 172.21.15.77:0/2221298719 wait complete. 2023-11-04T01:42:51.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.058+0000 7fcdcdaa9640 1 Processor -- start 2023-11-04T01:42:51.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.058+0000 7fcdcdaa9640 1 -- start start 2023-11-04T01:42:51.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.059+0000 7fcdcdaa9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdc80cd570 0x7fcdc80c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:51.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.059+0000 7fcdcdaa9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcdc815cfd0 0x7fcdc80b26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:51.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.059+0000 7fcdc77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdc80cd570 0x7fcdc80c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:51.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.059+0000 7fcdc77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdc80cd570 0x7fcdc80c55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38678/0 (socket says 172.21.15.77:38678) 2023-11-04T01:42:51.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.059+0000 7fcdc77fe640 1 -- 172.21.15.77:0/368775399 learned_addr learned my addr 172.21.15.77:0/368775399 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:51.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.059+0000 7fcdcdaa9640 1 --2- 172.21.15.77:0/368775399 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcdc81f71c0 0x7fcdc81f6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:51.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.059+0000 7fcdcdaa9640 1 -- 172.21.15.77:0/368775399 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc80b2210 con 0x7fcdc80cd570 2023-11-04T01:42:51.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.059+0000 7fcdcdaa9640 1 -- 172.21.15.77:0/368775399 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc80b1320 con 0x7fcdc815cfd0 2023-11-04T01:42:51.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.059+0000 7fcdcdaa9640 1 -- 172.21.15.77:0/368775399 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc80b1600 con 0x7fcdc81f71c0 2023-11-04T01:42:51.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.059+0000 7fcdc6ffd640 1 --2- 172.21.15.77:0/368775399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcdc815cfd0 0x7fcdc80b26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:51.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.059+0000 7fcdc7fff640 1 --2- 172.21.15.77:0/368775399 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcdc81f71c0 0x7fcdc81f6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:51.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.059+0000 7fcdc77fe640 1 -- 172.21.15.77:0/368775399 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcdc81f71c0 msgr2=0x7fcdc81f6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:51.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.059+0000 7fcdc77fe640 1 --2- 172.21.15.77:0/368775399 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcdc81f71c0 0x7fcdc81f6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:51.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.059+0000 7fcdc77fe640 1 -- 172.21.15.77:0/368775399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcdc815cfd0 msgr2=0x7fcdc80b26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:51.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.059+0000 7fcdc77fe640 1 --2- 172.21.15.77:0/368775399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcdc815cfd0 0x7fcdc80b26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:51.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.059+0000 7fcdc77fe640 1 -- 172.21.15.77:0/368775399 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc0009a70 con 0x7fcdc80cd570 2023-11-04T01:42:51.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.059+0000 7fcdc77fe640 1 --2- 172.21.15.77:0/368775399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdc80cd570 0x7fcdc80c55a0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc00e870 tx=0x7fcdbc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:51.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.060+0000 7fcdaffff640 1 -- 172.21.15.77:0/368775399 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc0094f0 con 0x7fcdc80cd570 2023-11-04T01:42:51.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.060+0000 7fcdaffff640 1 -- 172.21.15.77:0/368775399 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdbc00c940 con 0x7fcdc80cd570 2023-11-04T01:42:51.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.060+0000 7fcdcdaa9640 1 -- 172.21.15.77:0/368775399 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdc80b18e0 con 0x7fcdc80cd570 2023-11-04T01:42:51.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.060+0000 7fcdaffff640 1 -- 172.21.15.77:0/368775399 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc00ccf0 con 0x7fcdc80cd570 2023-11-04T01:42:51.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.060+0000 7fcdcdaa9640 1 -- 172.21.15.77:0/368775399 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdc80b1ea0 con 0x7fcdc80cd570 2023-11-04T01:42:51.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.061+0000 7fcdcdaa9640 1 -- 172.21.15.77:0/368775399 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdc806b300 con 0x7fcdc80cd570 2023-11-04T01:42:51.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.062+0000 7fcdaffff640 1 -- 172.21.15.77:0/368775399 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcdbc013470 con 0x7fcdc80cd570 2023-11-04T01:42:51.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.062+0000 7fcdaffff640 1 --2- 172.21.15.77:0/368775399 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcdb406ae70 0x7fcdb406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:51.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.062+0000 7fcdaffff640 1 -- 172.21.15.77:0/368775399 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6326+0+0 (secure 0 0 0) 0x7fcdbc089960 con 0x7fcdc80cd570 2023-11-04T01:42:51.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.063+0000 7fcdc6ffd640 1 --2- 172.21.15.77:0/368775399 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcdb406ae70 0x7fcdb406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:51.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.063+0000 7fcdc6ffd640 1 --2- 172.21.15.77:0/368775399 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcdb406ae70 0x7fcdb406d330 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80b6530 tx=0x7fcdb8009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:51.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.068+0000 7fcdaffff640 1 -- 172.21.15.77:0/368775399 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcdbc0547a0 con 0x7fcdc80cd570 2023-11-04T01:42:51.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:51.247+0000 7fcdcdaa9640 1 -- 172.21.15.77:0/368775399 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fcdc80d0170 con 0x7fcdc80cd570 2023-11-04T01:42:52.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.063+0000 7fcdaffff640 1 -- 172.21.15.77:0/368775399 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v79) v1 ==== 97+0+0 (secure 0 0 0) 0x7fcdbc021080 con 0x7fcdc80cd570 2023-11-04T01:42:52.065 INFO:teuthology.orchestra.run.smithi077.stderr: removed all blocklist entries 2023-11-04T01:42:52.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.066+0000 7fcdcdaa9640 1 -- 172.21.15.77:0/368775399 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcdb406ae70 msgr2=0x7fcdb406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:52.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.066+0000 7fcdcdaa9640 1 --2- 172.21.15.77:0/368775399 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcdb406ae70 0x7fcdb406d330 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80b6530 tx=0x7fcdb8009040 comp rx=0 tx=0).stop 2023-11-04T01:42:52.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.066+0000 7fcdcdaa9640 1 -- 172.21.15.77:0/368775399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdc80cd570 msgr2=0x7fcdc80c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:52.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.066+0000 7fcdcdaa9640 1 --2- 172.21.15.77:0/368775399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdc80cd570 0x7fcdc80c55a0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc00e870 tx=0x7fcdbc00ed30 comp rx=0 tx=0).stop 2023-11-04T01:42:52.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.066+0000 7fcdcdaa9640 1 -- 172.21.15.77:0/368775399 shutdown_connections 2023-11-04T01:42:52.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.067+0000 7fcdcdaa9640 1 --2- 172.21.15.77:0/368775399 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcdb406ae70 0x7fcdb406d330 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:52.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.067+0000 7fcdcdaa9640 1 --2- 172.21.15.77:0/368775399 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcdc81f71c0 0x7fcdc81f6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:52.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.067+0000 7fcdcdaa9640 1 --2- 172.21.15.77:0/368775399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcdc815cfd0 0x7fcdc80b26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:52.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.067+0000 7fcdcdaa9640 1 --2- 172.21.15.77:0/368775399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdc80cd570 0x7fcdc80c55a0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:52.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.067+0000 7fcdcdaa9640 1 -- 172.21.15.77:0/368775399 >> 172.21.15.77:0/368775399 conn(0x7fcdc806ea20 msgr2=0x7fcdc815ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:52.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.067+0000 7fcdcdaa9640 1 -- 172.21.15.77:0/368775399 shutdown_connections 2023-11-04T01:42:52.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.067+0000 7fcdcdaa9640 1 -- 172.21.15.77:0/368775399 wait complete. 2023-11-04T01:42:52.082 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-04T01:42:52.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.184+0000 7f1b004c2640 1 Processor -- start 2023-11-04T01:42:52.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.184+0000 7f1b004c2640 1 -- start start 2023-11-04T01:42:52.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.185+0000 7f1b004c2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1af80b0ae0 0x7f1af80ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:52.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.185+0000 7f1b004c2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1af806db20 0x7f1af815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:52.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.185+0000 7f1b004c2640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1af80b4110 con 0x7f1af8159c70 2023-11-04T01:42:52.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.185+0000 7f1b004c2640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1af80b49b0 con 0x7f1af80b0ae0 2023-11-04T01:42:52.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.185+0000 7f1b004c2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af80b43f0 con 0x7f1af806db20 2023-11-04T01:42:52.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.185+0000 7f1afda5d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1af80b0ae0 0x7f1af80ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:52.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.185+0000 7f1afda5d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1af80b0ae0 0x7f1af80ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38680/0 (socket says 172.21.15.77:38680) 2023-11-04T01:42:52.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.185+0000 7f1afda5d640 1 -- 172.21.15.77:0/4199403799 learned_addr learned my addr 172.21.15.77:0/4199403799 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:52.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.185+0000 7f1afea5f640 1 --2- 172.21.15.77:0/4199403799 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1af806db20 0x7f1af815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:52.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.186+0000 7f1afda5d640 1 -- 172.21.15.77:0/4199403799 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1af806db20 msgr2=0x7f1af815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:52.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.186+0000 7f1afda5d640 1 --2- 172.21.15.77:0/4199403799 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1af806db20 0x7f1af815d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:52.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.186+0000 7f1afda5d640 1 -- 172.21.15.77:0/4199403799 >> v1:172.21.15.122:6789/0 conn(0x7f1af8159c70 legacy=0x7f1af80b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:52.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.186+0000 7f1afda5d640 1 -- 172.21.15.77:0/4199403799 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af80b46d0 con 0x7f1af80b0ae0 2023-11-04T01:42:52.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.186+0000 7f1afda5d640 1 --2- 172.21.15.77:0/4199403799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1af80b0ae0 0x7f1af80ce370 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8009870 tx=0x7f1ae802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9019558e9e2019e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:52.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.186+0000 7f1afd25c640 1 -- 172.21.15.77:0/4199403799 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae8030840 con 0x7f1af80b0ae0 2023-11-04T01:42:52.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.186+0000 7f1afd25c640 1 -- 172.21.15.77:0/4199403799 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae80309a0 con 0x7f1af80b0ae0 2023-11-04T01:42:52.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.186+0000 7f1afd25c640 1 -- 172.21.15.77:0/4199403799 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae8030d30 con 0x7f1af80b0ae0 2023-11-04T01:42:52.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.187+0000 7f1b004c2640 1 -- 172.21.15.77:0/4199403799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1af80b0ae0 msgr2=0x7f1af80ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:52.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.187+0000 7f1b004c2640 1 --2- 172.21.15.77:0/4199403799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1af80b0ae0 0x7f1af80ce370 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8009870 tx=0x7f1ae802b980 comp rx=0 tx=0).stop 2023-11-04T01:42:52.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.187+0000 7f1b004c2640 1 -- 172.21.15.77:0/4199403799 shutdown_connections 2023-11-04T01:42:52.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.187+0000 7f1b004c2640 1 --2- 172.21.15.77:0/4199403799 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1af806db20 0x7f1af815d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:52.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.187+0000 7f1b004c2640 1 --2- 172.21.15.77:0/4199403799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1af80b0ae0 0x7f1af80ce370 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:52.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.187+0000 7f1b004c2640 1 -- 172.21.15.77:0/4199403799 >> 172.21.15.77:0/4199403799 conn(0x7f1af80ce950 msgr2=0x7f1af80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:52.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.187+0000 7f1b004c2640 1 -- 172.21.15.77:0/4199403799 shutdown_connections 2023-11-04T01:42:52.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.187+0000 7f1b004c2640 1 -- 172.21.15.77:0/4199403799 wait complete. 2023-11-04T01:42:52.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.188+0000 7f1b004c2640 1 Processor -- start 2023-11-04T01:42:52.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.188+0000 7f1b004c2640 1 -- start start 2023-11-04T01:42:52.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.189+0000 7f1b004c2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1af806db20 0x7f1af80cd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:52.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.189+0000 7f1b004c2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1af80b0ae0 0x7f1af80c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:52.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.189+0000 7f1b004c2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1af8159c70 0x7f1af814bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:52.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.189+0000 7f1b004c2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af80b2d60 con 0x7f1af80b0ae0 2023-11-04T01:42:52.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.189+0000 7f1b004c2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af80c7520 con 0x7f1af8159c70 2023-11-04T01:42:52.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.189+0000 7f1b004c2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af80c77c0 con 0x7f1af806db20 2023-11-04T01:42:52.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.189+0000 7f1afda5d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1af80b0ae0 0x7f1af80c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:52.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.189+0000 7f1afda5d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1af80b0ae0 0x7f1af80c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38684/0 (socket says 172.21.15.77:38684) 2023-11-04T01:42:52.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.189+0000 7f1afda5d640 1 -- 172.21.15.77:0/2959643726 learned_addr learned my addr 172.21.15.77:0/2959643726 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:52.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.189+0000 7f1afda5d640 1 -- 172.21.15.77:0/2959643726 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1af806db20 msgr2=0x7f1af80cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:52.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.189+0000 7f1afda5d640 1 --2- 172.21.15.77:0/2959643726 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1af806db20 0x7f1af80cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:52.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.189+0000 7f1afda5d640 1 -- 172.21.15.77:0/2959643726 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1af8159c70 msgr2=0x7f1af814bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:52.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.189+0000 7f1afda5d640 1 --2- 172.21.15.77:0/2959643726 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1af8159c70 0x7f1af814bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:52.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.189+0000 7f1afda5d640 1 -- 172.21.15.77:0/2959643726 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae80094d0 con 0x7f1af80b0ae0 2023-11-04T01:42:52.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.190+0000 7f1afda5d640 1 --2- 172.21.15.77:0/2959643726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1af80b0ae0 0x7f1af80c82a0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8000c00 tx=0x7f1ae8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:52.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.190+0000 7f1aeeffd640 1 -- 172.21.15.77:0/2959643726 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae8039c90 con 0x7f1af80b0ae0 2023-11-04T01:42:52.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.190+0000 7f1aeeffd640 1 -- 172.21.15.77:0/2959643726 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae8039df0 con 0x7f1af80b0ae0 2023-11-04T01:42:52.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.190+0000 7f1b004c2640 1 -- 172.21.15.77:0/2959643726 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1af80c7aa0 con 0x7f1af80b0ae0 2023-11-04T01:42:52.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.190+0000 7f1aeeffd640 1 -- 172.21.15.77:0/2959643726 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae8043640 con 0x7f1af80b0ae0 2023-11-04T01:42:52.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.190+0000 7f1b004c2640 1 -- 172.21.15.77:0/2959643726 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1af814c160 con 0x7f1af80b0ae0 2023-11-04T01:42:52.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.191+0000 7f1b004c2640 1 -- 172.21.15.77:0/2959643726 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af80c7f60 con 0x7f1af80b0ae0 2023-11-04T01:42:52.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.191+0000 7f1aeeffd640 1 -- 172.21.15.77:0/2959643726 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1ae80437a0 con 0x7f1af80b0ae0 2023-11-04T01:42:52.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.191+0000 7f1aeeffd640 1 --2- 172.21.15.77:0/2959643726 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1adc06ae70 0x7f1adc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:52.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.192+0000 7f1aeeffd640 1 -- 172.21.15.77:0/2959643726 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6240+0+0 (secure 0 0 0) 0x7f1ae803e070 con 0x7f1af80b0ae0 2023-11-04T01:42:52.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.192+0000 7f1afe25e640 1 --2- 172.21.15.77:0/2959643726 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1adc06ae70 0x7f1adc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:52.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.192+0000 7f1afe25e640 1 --2- 172.21.15.77:0/2959643726 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1adc06ae70 0x7f1adc06d330 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1af40012e0 tx=0x7f1af4007d30 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:52.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.196+0000 7f1aeeffd640 1 -- 172.21.15.77:0/2959643726 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1ae80777b0 con 0x7f1af80b0ae0 2023-11-04T01:42:52.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.422+0000 7f1b004c2640 1 -- 172.21.15.77:0/2959643726 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f1af8074290 con 0x7f1af80b0ae0 2023-11-04T01:42:52.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.423+0000 7f1aeeffd640 1 -- 172.21.15.77:0/2959643726 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f1ae807add0 con 0x7f1af80b0ae0 2023-11-04T01:42:52.425 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:52.425 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-04T01:42:52.425 INFO:teuthology.orchestra.run.smithi077.stdout: "auth_dump": [ 2023-11-04T01:42:52.425 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:52.426 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.a", 2023-11-04T01:42:52.426 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC1oEVl/r6uOhAA9u5Hcsr4T+QfSgBmS6M2Cw==", 2023-11-04T01:42:52.426 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:52.426 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:42:52.426 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-04T01:42:52.427 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-04T01:42:52.427 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:42:52.427 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:52.427 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:52.428 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:52.428 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.b", 2023-11-04T01:42:52.428 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC2oEVlOr56CxAAxOke25BrKTy0Vozn/aPYVw==", 2023-11-04T01:42:52.428 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:52.428 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:42:52.429 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-04T01:42:52.429 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-04T01:42:52.429 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:42:52.429 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:52.429 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:52.430 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:52.430 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.c", 2023-11-04T01:42:52.430 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC2oEVlvLxtBhAAuxQpEPrSlVc/YBdqJJn7iA==", 2023-11-04T01:42:52.430 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:52.430 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:42:52.431 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-04T01:42:52.431 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-04T01:42:52.431 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:42:52.431 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:52.431 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:52.432 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:52.432 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.d", 2023-11-04T01:42:52.432 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC2oEVlB3PUEhAA0GaPLq/SwHPPHriYNnan9w==", 2023-11-04T01:42:52.432 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:52.432 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:42:52.432 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-04T01:42:52.433 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-04T01:42:52.433 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:42:52.433 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:52.433 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:52.433 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:52.434 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.0", 2023-11-04T01:42:52.434 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC5oEVl4pfcMxAATPwL4pgDM0ywnmsufp74lw==", 2023-11-04T01:42:52.434 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:52.434 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:42:52.434 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:42:52.435 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:42:52.435 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:52.435 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:52.435 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:52.435 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.1", 2023-11-04T01:42:52.436 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC8oEVl+qN4MhAAXZweqA2M4vvc4B04adonzQ==", 2023-11-04T01:42:52.436 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:52.436 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:42:52.436 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:42:52.436 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:42:52.436 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:52.437 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:52.437 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:52.437 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.2", 2023-11-04T01:42:52.437 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC/oEVlRuD4MBAAQPQL0SzC7Cj9bzR/Cj+maA==", 2023-11-04T01:42:52.437 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:52.438 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:42:52.438 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:42:52.438 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:42:52.438 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:52.438 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:52.439 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:52.439 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.3", 2023-11-04T01:42:52.439 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDCoEVlDO4fLxAASTTEpVp1dzEEci56OfSEMA==", 2023-11-04T01:42:52.439 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:52.439 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:42:52.440 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:42:52.440 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:42:52.440 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:52.440 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:52.440 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:52.441 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.4", 2023-11-04T01:42:52.441 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDIoEVlQGrxOBAACkSdOwyqhcMBPhXbpdXFKw==", 2023-11-04T01:42:52.441 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:52.441 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:42:52.441 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:42:52.441 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:42:52.442 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:52.442 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:52.442 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:52.442 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.5", 2023-11-04T01:42:52.442 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDLoEVlTrCoNhAAoLM/rpHPTO6H6eXr8so/pA==", 2023-11-04T01:42:52.443 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:52.443 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:42:52.443 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:42:52.443 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:42:52.443 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:52.444 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:52.444 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:52.444 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.6", 2023-11-04T01:42:52.444 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDOoEVlb81bNRAAp8gIPrPxc9T8yp9Z8JJm8g==", 2023-11-04T01:42:52.444 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:52.445 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:42:52.445 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:42:52.445 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:42:52.445 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:52.445 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:52.445 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:52.446 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.7", 2023-11-04T01:42:52.446 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDRoEVl2aM/NBAAbi6ZxsZ51qe78O1oaSpF8Q==", 2023-11-04T01:42:52.446 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:52.446 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:42:52.446 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:42:52.447 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:42:52.447 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:52.447 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:52.447 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:52.447 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.0", 2023-11-04T01:42:52.448 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC2oEVlChU2FxAAt1/aJZOrufjVZhraPqv1Gw==", 2023-11-04T01:42:52.448 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:52.448 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:42:52.448 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow r", 2023-11-04T01:42:52.448 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-04T01:42:52.448 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:52.449 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:52.449 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:52.449 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.1", 2023-11-04T01:42:52.449 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC2oEVlVY9FIBAAUiGoYvAgEDfoAKIJ9e/SOg==", 2023-11-04T01:42:52.449 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:52.450 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:42:52.450 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-11-04T01:42:52.450 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-11-04T01:42:52.450 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-11-04T01:42:52.451 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:52.451 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:52.451 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:52.451 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.2", 2023-11-04T01:42:52.451 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC2oEVliWLuHBAA7ElluXYK9/XvMXk4S1njJw==", 2023-11-04T01:42:52.452 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:52.452 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:42:52.452 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-11-04T01:42:52.452 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-11-04T01:42:52.452 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-11-04T01:42:52.452 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:52.453 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:52.453 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:52.453 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.3", 2023-11-04T01:42:52.453 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC2oEVlQ3QIJhAA5Fq/oI3qpJseGhwXV66eMA==", 2023-11-04T01:42:52.453 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:52.454 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:42:52.454 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-11-04T01:42:52.454 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-11-04T01:42:52.454 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-11-04T01:42:52.454 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:52.455 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:52.455 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:52.455 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.admin", 2023-11-04T01:42:52.455 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC1oEVlhrFGHhAA5nkKwuaaUv+zDDAG4XaBRQ==", 2023-11-04T01:42:52.455 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:52.456 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow *", 2023-11-04T01:42:52.456 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-04T01:42:52.456 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-04T01:42:52.456 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:42:52.456 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:52.457 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:52.457 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:52.457 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mgr.x", 2023-11-04T01:42:52.457 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC1oEVlvoNGNxAAB5/uyqV4Pf/HdyGcr8rVdw==", 2023-11-04T01:42:52.457 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:52.458 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow *", 2023-11-04T01:42:52.458 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile mgr", 2023-11-04T01:42:52.458 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:42:52.458 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:52.458 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:52.459 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:52.459 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mgr.y", 2023-11-04T01:42:52.459 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC1oEVlXDKNMxAAVhq0CA3RveLfU4A6oIO4jQ==", 2023-11-04T01:42:52.459 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:42:52.459 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow *", 2023-11-04T01:42:52.460 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile mgr", 2023-11-04T01:42:52.460 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:42:52.460 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:52.460 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:52.460 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2023-11-04T01:42:52.460 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-04T01:42:52.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.424+0000 7f1b004c2640 1 -- 172.21.15.77:0/2959643726 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1adc06ae70 msgr2=0x7f1adc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:52.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.424+0000 7f1b004c2640 1 --2- 172.21.15.77:0/2959643726 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1adc06ae70 0x7f1adc06d330 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1af40012e0 tx=0x7f1af4007d30 comp rx=0 tx=0).stop 2023-11-04T01:42:52.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.425+0000 7f1b004c2640 1 -- 172.21.15.77:0/2959643726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1af80b0ae0 msgr2=0x7f1af80c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:52.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.425+0000 7f1b004c2640 1 --2- 172.21.15.77:0/2959643726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1af80b0ae0 0x7f1af80c82a0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8000c00 tx=0x7f1ae8004730 comp rx=0 tx=0).stop 2023-11-04T01:42:52.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.425+0000 7f1b004c2640 1 -- 172.21.15.77:0/2959643726 shutdown_connections 2023-11-04T01:42:52.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.425+0000 7f1b004c2640 1 --2- 172.21.15.77:0/2959643726 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1adc06ae70 0x7f1adc06d330 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:52.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.425+0000 7f1b004c2640 1 --2- 172.21.15.77:0/2959643726 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1af8159c70 0x7f1af814bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:52.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.425+0000 7f1b004c2640 1 --2- 172.21.15.77:0/2959643726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1af80b0ae0 0x7f1af80c82a0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:52.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.425+0000 7f1b004c2640 1 --2- 172.21.15.77:0/2959643726 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1af806db20 0x7f1af80cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:52.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.425+0000 7f1b004c2640 1 -- 172.21.15.77:0/2959643726 >> 172.21.15.77:0/2959643726 conn(0x7f1af80ce950 msgr2=0x7f1af815aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:52.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.425+0000 7f1b004c2640 1 -- 172.21.15.77:0/2959643726 shutdown_connections 2023-11-04T01:42:52.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.425+0000 7f1b004c2640 1 -- 172.21.15.77:0/2959643726 wait complete. 2023-11-04T01:42:52.465 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:52.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.564+0000 7fa452124640 1 Processor -- start 2023-11-04T01:42:52.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.564+0000 7fa452124640 1 -- start start 2023-11-04T01:42:52.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.565+0000 7fa452124640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa44c0b0cd0 0x7fa44c070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:52.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.565+0000 7fa452124640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa44c0cc990 con 0x7fa44c0cde40 2023-11-04T01:42:52.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.565+0000 7fa452124640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa44c0ccc70 con 0x7fa44c0cda60 2023-11-04T01:42:52.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.565+0000 7fa452124640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c0c9ce0 con 0x7fa44c0b0cd0 2023-11-04T01:42:52.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.565+0000 7fa44bfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fa44c0cde40 0x7fa44c06c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:46978/0 (socket says 172.21.15.77:46978) 2023-11-04T01:42:52.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.565+0000 7fa44bfff640 1 -- 172.21.15.77:0/3222131754 learned_addr learned my addr 172.21.15.77:0/3222131754 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:52.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.565+0000 7fa44a7fc640 1 -- 172.21.15.77:0/3222131754 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 75927263 0 0) 0x7fa44c0cc990 con 0x7fa44c0cde40 2023-11-04T01:42:52.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.565+0000 7fa44affd640 1 --2- 172.21.15.77:0/3222131754 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa44c0b0cd0 0x7fa44c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:52.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.565+0000 7fa44a7fc640 1 -- 172.21.15.77:0/3222131754 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa434003520 con 0x7fa44c0cde40 2023-11-04T01:42:52.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.565+0000 7fa44a7fc640 1 -- 172.21.15.77:0/3222131754 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2623187116 0 0) 0x7fa434003520 con 0x7fa44c0cde40 2023-11-04T01:42:52.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.565+0000 7fa44a7fc640 1 -- 172.21.15.77:0/3222131754 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa44c0b0cd0 msgr2=0x7fa44c070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:52.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.565+0000 7fa44a7fc640 1 --2- 172.21.15.77:0/3222131754 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa44c0b0cd0 0x7fa44c070630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:52.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.565+0000 7fa44a7fc640 1 -- 172.21.15.77:0/3222131754 >> v1:172.21.15.122:6789/0 conn(0x7fa44c0cda60 legacy=0x7fa44c0ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:52.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.565+0000 7fa44a7fc640 1 -- 172.21.15.77:0/3222131754 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa44c0c9fc0 con 0x7fa44c0cde40 2023-11-04T01:42:52.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.565+0000 7fa44a7fc640 1 -- 172.21.15.77:0/3222131754 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7fa4440019f0 con 0x7fa44c0cde40 2023-11-04T01:42:52.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.565+0000 7fa44a7fc640 1 -- 172.21.15.77:0/3222131754 >> v1:172.21.15.77:6789/0 conn(0x7fa44c0cde40 legacy=0x7fa44c06c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:52.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.565+0000 7fa44a7fc640 1 --2- 172.21.15.77:0/3222131754 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa44c0b0cd0 0x7fa4340039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:52.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.565+0000 7fa44a7fc640 1 --2- 172.21.15.77:0/3222131754 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa434003ee0 0x7fa4340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:52.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.565+0000 7fa44a7fc640 1 --2- 172.21.15.77:0/3222131754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa434004d00 0x7fa434005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:52.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.565+0000 7fa44a7fc640 1 -- 172.21.15.77:0/3222131754 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c0c9ce0 con 0x7fa434004d00 2023-11-04T01:42:52.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.565+0000 7fa44a7fc640 1 -- 172.21.15.77:0/3222131754 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43400b9e0 con 0x7fa434003ee0 2023-11-04T01:42:52.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.565+0000 7fa44a7fc640 1 -- 172.21.15.77:0/3222131754 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43400bba0 con 0x7fa44c0b0cd0 2023-11-04T01:42:52.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.565+0000 7fa44bfff640 1 --2- 172.21.15.77:0/3222131754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa434004d00 0x7fa434005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:52.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.565+0000 7fa44affd640 1 --2- 172.21.15.77:0/3222131754 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa434003ee0 0x7fa4340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:52.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.565+0000 7fa44b7fe640 1 --2- 172.21.15.77:0/3222131754 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa44c0b0cd0 0x7fa4340039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:52.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.566+0000 7fa44bfff640 1 -- 172.21.15.77:0/3222131754 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa44c0b0cd0 msgr2=0x7fa4340039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:52.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.566+0000 7fa44bfff640 1 --2- 172.21.15.77:0/3222131754 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa44c0b0cd0 0x7fa4340039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:52.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.566+0000 7fa44bfff640 1 -- 172.21.15.77:0/3222131754 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa434003ee0 msgr2=0x7fa4340047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:52.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.566+0000 7fa44bfff640 1 --2- 172.21.15.77:0/3222131754 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa434003ee0 0x7fa4340047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:52.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.566+0000 7fa44bfff640 1 -- 172.21.15.77:0/3222131754 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa434003520 con 0x7fa434004d00 2023-11-04T01:42:52.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.566+0000 7fa44bfff640 1 --2- 172.21.15.77:0/3222131754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa434004d00 0x7fa434005180 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fa44c0ce260 tx=0x7fa4340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c29efbc99ce68c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:52.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.567+0000 7fa44a7fc640 1 -- 172.21.15.77:0/3222131754 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa444034630 con 0x7fa434004d00 2023-11-04T01:42:52.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.567+0000 7fa44a7fc640 1 -- 172.21.15.77:0/3222131754 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44402f070 con 0x7fa434004d00 2023-11-04T01:42:52.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.567+0000 7fa44a7fc640 1 -- 172.21.15.77:0/3222131754 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa444034a30 con 0x7fa434004d00 2023-11-04T01:42:52.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.567+0000 7fa452124640 1 -- 172.21.15.77:0/3222131754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa434004d00 msgr2=0x7fa434005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:52.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.567+0000 7fa452124640 1 --2- 172.21.15.77:0/3222131754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa434004d00 0x7fa434005180 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fa44c0ce260 tx=0x7fa4340057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:52.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.567+0000 7fa44bfff640 1 -- 172.21.15.77:0/3222131754 reap_dead start 2023-11-04T01:42:52.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.567+0000 7fa452124640 1 -- 172.21.15.77:0/3222131754 shutdown_connections 2023-11-04T01:42:52.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.567+0000 7fa452124640 1 -- 172.21.15.77:0/3222131754 >> 172.21.15.77:0/3222131754 conn(0x7fa44c0ce950 msgr2=0x7fa44c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:52.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.567+0000 7fa452124640 1 -- 172.21.15.77:0/3222131754 shutdown_connections 2023-11-04T01:42:52.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.567+0000 7fa452124640 1 -- 172.21.15.77:0/3222131754 wait complete. 2023-11-04T01:42:52.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.568+0000 7fa452124640 1 Processor -- start 2023-11-04T01:42:52.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.568+0000 7fa452124640 1 -- start start 2023-11-04T01:42:52.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.569+0000 7fa452124640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa44c156e00 0x7fa44c0a7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:52.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.569+0000 7fa452124640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa44c0a7e40 0x7fa44c1e2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:52.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.569+0000 7fa452124640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa44c1e1b90 0x7fa44c1e3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:52.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.569+0000 7fa452124640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c1f0200 con 0x7fa44c1e1b90 2023-11-04T01:42:52.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.569+0000 7fa452124640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c1de720 con 0x7fa44c156e00 2023-11-04T01:42:52.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.569+0000 7fa452124640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c1e2150 con 0x7fa44c0a7e40 2023-11-04T01:42:52.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.569+0000 7fa44bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa44c1e1b90 0x7fa44c1e3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:52.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.569+0000 7fa44bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa44c1e1b90 0x7fa44c1e3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38712/0 (socket says 172.21.15.77:38712) 2023-11-04T01:42:52.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.569+0000 7fa44bfff640 1 -- 172.21.15.77:0/3441096908 learned_addr learned my addr 172.21.15.77:0/3441096908 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:52.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.569+0000 7fa44affd640 1 --2- 172.21.15.77:0/3441096908 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa44c0a7e40 0x7fa44c1e2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:52.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.569+0000 7fa44b7fe640 1 --2- 172.21.15.77:0/3441096908 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa44c156e00 0x7fa44c0a7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:52.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.570+0000 7fa44bfff640 1 -- 172.21.15.77:0/3441096908 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa44c0a7e40 msgr2=0x7fa44c1e2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:52.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.570+0000 7fa44bfff640 1 --2- 172.21.15.77:0/3441096908 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa44c0a7e40 0x7fa44c1e2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:52.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.570+0000 7fa44bfff640 1 -- 172.21.15.77:0/3441096908 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa44c156e00 msgr2=0x7fa44c0a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:52.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.570+0000 7fa44bfff640 1 --2- 172.21.15.77:0/3441096908 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa44c156e00 0x7fa44c0a7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:52.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.570+0000 7fa44bfff640 1 -- 172.21.15.77:0/3441096908 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa44c1e2430 con 0x7fa44c1e1b90 2023-11-04T01:42:52.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.570+0000 7fa44bfff640 1 --2- 172.21.15.77:0/3441096908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa44c1e1b90 0x7fa44c1e3180 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fa444001cb0 tx=0x7fa444001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:52.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.570+0000 7fa433fff640 1 -- 172.21.15.77:0/3441096908 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa444034840 con 0x7fa44c1e1b90 2023-11-04T01:42:52.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.570+0000 7fa433fff640 1 -- 172.21.15.77:0/3441096908 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4440349a0 con 0x7fa44c1e1b90 2023-11-04T01:42:52.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.570+0000 7fa452124640 1 -- 172.21.15.77:0/3441096908 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa44c1e2710 con 0x7fa44c1e1b90 2023-11-04T01:42:52.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.570+0000 7fa433fff640 1 -- 172.21.15.77:0/3441096908 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa444034d10 con 0x7fa44c1e1b90 2023-11-04T01:42:52.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.570+0000 7fa452124640 1 -- 172.21.15.77:0/3441096908 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa44c1571e0 con 0x7fa44c1e1b90 2023-11-04T01:42:52.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.571+0000 7fa452124640 1 -- 172.21.15.77:0/3441096908 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa44c1571e0 con 0x7fa44c1e1b90 2023-11-04T01:42:52.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.571+0000 7fa433fff640 1 -- 172.21.15.77:0/3441096908 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa444031030 con 0x7fa44c1e1b90 2023-11-04T01:42:52.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.572+0000 7fa433fff640 1 --2- 172.21.15.77:0/3441096908 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa43806aea0 0x7fa43806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:52.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.572+0000 7fa433fff640 1 -- 172.21.15.77:0/3441096908 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6240+0+0 (secure 0 0 0) 0x7fa4440ab8d0 con 0x7fa44c1e1b90 2023-11-04T01:42:52.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.572+0000 7fa44b7fe640 1 --2- 172.21.15.77:0/3441096908 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa43806aea0 0x7fa43806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:52.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.572+0000 7fa44b7fe640 1 --2- 172.21.15.77:0/3441096908 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa43806aea0 0x7fa43806d360 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa44c0afc60 tx=0x7fa440009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:52.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.576+0000 7fa433fff640 1 -- 172.21.15.77:0/3441096908 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa4440769e0 con 0x7fa44c1e1b90 2023-11-04T01:42:52.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.742+0000 7fa452124640 1 -- 172.21.15.77:0/3441096908 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa44c1571e0 con 0x7fa44c1e1b90 2023-11-04T01:42:52.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.743+0000 7fa433fff640 1 -- 172.21.15.77:0/3441096908 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+18291 (secure 0 0 0) 0x7fa44407a000 con 0x7fa44c1e1b90 2023-11-04T01:42:52.745 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:52.746 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":79,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:42:52.062856+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:33.159064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:33.647358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:52.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.745+0000 7fa452124640 1 -- 172.21.15.77:0/3441096908 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa43806aea0 msgr2=0x7fa43806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:52.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.745+0000 7fa452124640 1 --2- 172.21.15.77:0/3441096908 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa43806aea0 0x7fa43806d360 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa44c0afc60 tx=0x7fa440009040 comp rx=0 tx=0).stop 2023-11-04T01:42:52.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.745+0000 7fa452124640 1 -- 172.21.15.77:0/3441096908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa44c1e1b90 msgr2=0x7fa44c1e3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:52.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.745+0000 7fa452124640 1 --2- 172.21.15.77:0/3441096908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa44c1e1b90 0x7fa44c1e3180 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fa444001cb0 tx=0x7fa444001d80 comp rx=0 tx=0).stop 2023-11-04T01:42:52.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.745+0000 7fa452124640 1 -- 172.21.15.77:0/3441096908 shutdown_connections 2023-11-04T01:42:52.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.745+0000 7fa452124640 1 --2- 172.21.15.77:0/3441096908 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa43806aea0 0x7fa43806d360 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:52.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.745+0000 7fa452124640 1 --2- 172.21.15.77:0/3441096908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa44c1e1b90 0x7fa44c1e3180 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:52.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.745+0000 7fa452124640 1 --2- 172.21.15.77:0/3441096908 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa44c0a7e40 0x7fa44c1e2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:52.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.745+0000 7fa452124640 1 --2- 172.21.15.77:0/3441096908 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa44c156e00 0x7fa44c0a7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:52.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.745+0000 7fa452124640 1 -- 172.21.15.77:0/3441096908 >> 172.21.15.77:0/3441096908 conn(0x7fa44c0ce950 msgr2=0x7fa44c0b38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:52.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.745+0000 7fa452124640 1 -- 172.21.15.77:0/3441096908 shutdown_connections 2023-11-04T01:42:52.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.745+0000 7fa452124640 1 -- 172.21.15.77:0/3441096908 wait complete. 2023-11-04T01:42:52.758 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:33.142176+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:42:33.159064+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:42:33.647358+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:42:52.758 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:42:52.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.860+0000 7fe88ae07640 1 Processor -- start 2023-11-04T01:42:52.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.860+0000 7fe88ae07640 1 -- start start 2023-11-04T01:42:52.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.860+0000 7fe88ae07640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe8840cd6d0 0x7fe884161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:52.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.860+0000 7fe88ae07640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8840cde60 con 0x7fe8840b4880 2023-11-04T01:42:52.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.860+0000 7fe88ae07640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe884160f90 con 0x7fe884153e60 2023-11-04T01:42:52.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.860+0000 7fe88ae07640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe884161960 con 0x7fe8840cd6d0 2023-11-04T01:42:52.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.860+0000 7fe8893a4640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe8840b4880 0x7fe8840d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:46990/0 (socket says 172.21.15.77:46990) 2023-11-04T01:42:52.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.860+0000 7fe8893a4640 1 -- 172.21.15.77:0/701353403 learned_addr learned my addr 172.21.15.77:0/701353403 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:52.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.861+0000 7fe8837fe640 1 -- 172.21.15.77:0/701353403 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1365182156 0 0) 0x7fe8840cde60 con 0x7fe8840b4880 2023-11-04T01:42:52.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.861+0000 7fe8837fe640 1 -- 172.21.15.77:0/701353403 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe874003520 con 0x7fe8840b4880 2023-11-04T01:42:52.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.861+0000 7fe883fff640 1 --2- 172.21.15.77:0/701353403 >> v2:172.21.15.122:3300/0 conn(0x7fe8840cd6d0 0x7fe884161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:52.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.861+0000 7fe8837fe640 1 -- 172.21.15.77:0/701353403 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1876975268 0 0) 0x7fe874003520 con 0x7fe8840b4880 2023-11-04T01:42:52.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.861+0000 7fe8837fe640 1 -- 172.21.15.77:0/701353403 >> v2:172.21.15.122:3300/0 conn(0x7fe8840cd6d0 msgr2=0x7fe884161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:52.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.861+0000 7fe8837fe640 1 --2- 172.21.15.77:0/701353403 >> v2:172.21.15.122:3300/0 conn(0x7fe8840cd6d0 0x7fe884161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:52.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.861+0000 7fe8837fe640 1 -- 172.21.15.77:0/701353403 >> v1:172.21.15.122:6789/0 conn(0x7fe884153e60 legacy=0x7fe88415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:52.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.861+0000 7fe8837fe640 1 -- 172.21.15.77:0/701353403 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8840ce090 con 0x7fe8840b4880 2023-11-04T01:42:52.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.861+0000 7fe8837fe640 1 -- 172.21.15.77:0/701353403 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7fe87c0019f0 con 0x7fe8840b4880 2023-11-04T01:42:52.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.861+0000 7fe8837fe640 1 -- 172.21.15.77:0/701353403 >> v1:172.21.15.77:6789/0 conn(0x7fe8840b4880 legacy=0x7fe8840d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:52.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.861+0000 7fe8837fe640 1 --2- 172.21.15.77:0/701353403 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe874003970 0x7fe874003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:52.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.861+0000 7fe8837fe640 1 --2- 172.21.15.77:0/701353403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8740047c0 0x7fe874004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:52.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.861+0000 7fe8837fe640 1 --2- 172.21.15.77:0/701353403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe874005180 0x7fe87400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:52.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.861+0000 7fe8837fe640 1 -- 172.21.15.77:0/701353403 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe884161960 con 0x7fe8740047c0 2023-11-04T01:42:52.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.861+0000 7fe8837fe640 1 -- 172.21.15.77:0/701353403 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe87400c020 con 0x7fe874005180 2023-11-04T01:42:52.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.861+0000 7fe8837fe640 1 -- 172.21.15.77:0/701353403 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe87400c1e0 con 0x7fe874003970 2023-11-04T01:42:52.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.861+0000 7fe883fff640 1 --2- 172.21.15.77:0/701353403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8740047c0 0x7fe874004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:52.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.861+0000 7fe8893a4640 1 --2- 172.21.15.77:0/701353403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe874005180 0x7fe87400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:52.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.861+0000 7fe888ba3640 1 --2- 172.21.15.77:0/701353403 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe874003970 0x7fe874003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:52.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.861+0000 7fe883fff640 1 -- 172.21.15.77:0/701353403 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe874003970 msgr2=0x7fe874003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:52.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.861+0000 7fe883fff640 1 --2- 172.21.15.77:0/701353403 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe874003970 0x7fe874003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:52.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.861+0000 7fe883fff640 1 -- 172.21.15.77:0/701353403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe874005180 msgr2=0x7fe87400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:52.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.861+0000 7fe883fff640 1 --2- 172.21.15.77:0/701353403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe874005180 0x7fe87400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:52.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.861+0000 7fe883fff640 1 -- 172.21.15.77:0/701353403 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe874003520 con 0x7fe8740047c0 2023-11-04T01:42:52.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.861+0000 7fe8893a4640 1 -- 172.21.15.77:0/701353403 reap_dead start 2023-11-04T01:42:52.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.861+0000 7fe888ba3640 1 --2- 172.21.15.77:0/701353403 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe874003970 0x7fe874003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:52.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.862+0000 7fe883fff640 1 --2- 172.21.15.77:0/701353403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8740047c0 0x7fe874004c40 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fe870009ac0 tx=0x7fe8740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34005a963675eba5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:52.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.862+0000 7fe8837fe640 1 -- 172.21.15.77:0/701353403 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87002c6b0 con 0x7fe8740047c0 2023-11-04T01:42:52.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.862+0000 7fe8837fe640 1 -- 172.21.15.77:0/701353403 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87002c810 con 0x7fe8740047c0 2023-11-04T01:42:52.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.862+0000 7fe8837fe640 1 -- 172.21.15.77:0/701353403 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87002cba0 con 0x7fe8740047c0 2023-11-04T01:42:52.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.863+0000 7fe88ae07640 1 -- 172.21.15.77:0/701353403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8740047c0 msgr2=0x7fe874004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:52.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.863+0000 7fe88ae07640 1 --2- 172.21.15.77:0/701353403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8740047c0 0x7fe874004c40 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fe870009ac0 tx=0x7fe8740057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:52.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.863+0000 7fe88ae07640 1 -- 172.21.15.77:0/701353403 shutdown_connections 2023-11-04T01:42:52.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.863+0000 7fe88ae07640 1 --2- 172.21.15.77:0/701353403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8740047c0 0x7fe874004c40 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:52.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.863+0000 7fe88ae07640 1 -- 172.21.15.77:0/701353403 >> 172.21.15.77:0/701353403 conn(0x7fe8840cf880 msgr2=0x7fe8840cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:52.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.863+0000 7fe88ae07640 1 -- 172.21.15.77:0/701353403 shutdown_connections 2023-11-04T01:42:52.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.863+0000 7fe88ae07640 1 -- 172.21.15.77:0/701353403 wait complete. 2023-11-04T01:42:52.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.864+0000 7fe88ae07640 1 Processor -- start 2023-11-04T01:42:52.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.864+0000 7fe88ae07640 1 -- start start 2023-11-04T01:42:52.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.865+0000 7fe88ae07640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe8740047c0 0x7fe884154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:52.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.865+0000 7fe88ae07640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8841f2520 0x7fe88415ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:52.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.865+0000 7fe88ae07640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe884152680 0x7fe884152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:52.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.865+0000 7fe88ae07640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe884153070 con 0x7fe884152680 2023-11-04T01:42:52.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.865+0000 7fe88ae07640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8840c6900 con 0x7fe8841f2520 2023-11-04T01:42:52.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.865+0000 7fe88ae07640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8840c6ba0 con 0x7fe8740047c0 2023-11-04T01:42:52.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.865+0000 7fe8893a4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe884152680 0x7fe884152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:52.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.865+0000 7fe8893a4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe884152680 0x7fe884152b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38740/0 (socket says 172.21.15.77:38740) 2023-11-04T01:42:52.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.865+0000 7fe8893a4640 1 -- 172.21.15.77:0/1149306065 learned_addr learned my addr 172.21.15.77:0/1149306065 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:52.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.865+0000 7fe888ba3640 1 --2- 172.21.15.77:0/1149306065 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe8740047c0 0x7fe884154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:52.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.865+0000 7fe883fff640 1 --2- 172.21.15.77:0/1149306065 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8841f2520 0x7fe88415ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:52.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.865+0000 7fe8893a4640 1 -- 172.21.15.77:0/1149306065 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe8740047c0 msgr2=0x7fe884154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:52.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.865+0000 7fe8893a4640 1 --2- 172.21.15.77:0/1149306065 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe8740047c0 0x7fe884154f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:52.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.865+0000 7fe8893a4640 1 -- 172.21.15.77:0/1149306065 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8841f2520 msgr2=0x7fe88415ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:52.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.865+0000 7fe8893a4640 1 --2- 172.21.15.77:0/1149306065 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8841f2520 0x7fe88415ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:52.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.865+0000 7fe8893a4640 1 -- 172.21.15.77:0/1149306065 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8840c6e80 con 0x7fe884152680 2023-11-04T01:42:52.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.865+0000 7fe8893a4640 1 --2- 172.21.15.77:0/1149306065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe884152680 0x7fe884152b30 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fe8840c9e50 tx=0x7fe87c007b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:52.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.866+0000 7fe8817fa640 1 -- 172.21.15.77:0/1149306065 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c001ee0 con 0x7fe884152680 2023-11-04T01:42:52.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.866+0000 7fe8817fa640 1 -- 172.21.15.77:0/1149306065 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87c00aba0 con 0x7fe884152680 2023-11-04T01:42:52.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.866+0000 7fe88ae07640 1 -- 172.21.15.77:0/1149306065 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8840c7160 con 0x7fe884152680 2023-11-04T01:42:52.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.866+0000 7fe8817fa640 1 -- 172.21.15.77:0/1149306065 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c0133f0 con 0x7fe884152680 2023-11-04T01:42:52.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.866+0000 7fe88ae07640 1 -- 172.21.15.77:0/1149306065 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8840c7720 con 0x7fe884152680 2023-11-04T01:42:52.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.867+0000 7fe88ae07640 1 -- 172.21.15.77:0/1149306065 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8840c78b0 con 0x7fe884152680 2023-11-04T01:42:52.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.867+0000 7fe8817fa640 1 -- 172.21.15.77:0/1149306065 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe87c013550 con 0x7fe884152680 2023-11-04T01:42:52.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.868+0000 7fe8817fa640 1 --2- 172.21.15.77:0/1149306065 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe86806aea0 0x7fe86806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:52.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.868+0000 7fe8817fa640 1 -- 172.21.15.77:0/1149306065 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6240+0+0 (secure 0 0 0) 0x7fe87c08a050 con 0x7fe884152680 2023-11-04T01:42:52.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.868+0000 7fe888ba3640 1 --2- 172.21.15.77:0/1149306065 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe86806aea0 0x7fe86806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:52.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.868+0000 7fe888ba3640 1 --2- 172.21.15.77:0/1149306065 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe86806aea0 0x7fe86806d360 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe878000c00 tx=0x7fe878009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:52.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:52.872+0000 7fe8817fa640 1 -- 172.21.15.77:0/1149306065 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe87c054fa0 con 0x7fe884152680 2023-11-04T01:42:53.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.036+0000 7fe88ae07640 1 -- 172.21.15.77:0/1149306065 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe884074290 con 0x7fe884152680 2023-11-04T01:42:53.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.037+0000 7fe8817fa640 1 -- 172.21.15.77:0/1149306065 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe87c017020 con 0x7fe884152680 2023-11-04T01:42:53.039 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:42:53.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.039+0000 7fe88ae07640 1 -- 172.21.15.77:0/1149306065 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe86806aea0 msgr2=0x7fe86806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:53.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.039+0000 7fe88ae07640 1 --2- 172.21.15.77:0/1149306065 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe86806aea0 0x7fe86806d360 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe878000c00 tx=0x7fe878009040 comp rx=0 tx=0).stop 2023-11-04T01:42:53.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.039+0000 7fe88ae07640 1 -- 172.21.15.77:0/1149306065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe884152680 msgr2=0x7fe884152b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:53.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.039+0000 7fe88ae07640 1 --2- 172.21.15.77:0/1149306065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe884152680 0x7fe884152b30 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fe8840c9e50 tx=0x7fe87c007b20 comp rx=0 tx=0).stop 2023-11-04T01:42:53.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.039+0000 7fe88ae07640 1 -- 172.21.15.77:0/1149306065 shutdown_connections 2023-11-04T01:42:53.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.039+0000 7fe88ae07640 1 --2- 172.21.15.77:0/1149306065 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe86806aea0 0x7fe86806d360 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.039+0000 7fe88ae07640 1 --2- 172.21.15.77:0/1149306065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe884152680 0x7fe884152b30 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.039+0000 7fe88ae07640 1 --2- 172.21.15.77:0/1149306065 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8841f2520 0x7fe88415ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.039+0000 7fe88ae07640 1 --2- 172.21.15.77:0/1149306065 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe8740047c0 0x7fe884154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.039+0000 7fe88ae07640 1 -- 172.21.15.77:0/1149306065 >> 172.21.15.77:0/1149306065 conn(0x7fe8840cf880 msgr2=0x7fe8840d24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:53.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.039+0000 7fe88ae07640 1 -- 172.21.15.77:0/1149306065 shutdown_connections 2023-11-04T01:42:53.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.039+0000 7fe88ae07640 1 -- 172.21.15.77:0/1149306065 wait complete. 2023-11-04T01:42:53.051 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:42:53.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.152+0000 7f8830f5e640 1 Processor -- start 2023-11-04T01:42:53.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.152+0000 7f8830f5e640 1 -- start start 2023-11-04T01:42:53.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.153+0000 7f8830f5e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f882c15d1b0 0x7f882c0cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:53.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.153+0000 7f8830f5e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f882c066000 0x7f882c06a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:53.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.153+0000 7f8830f5e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f882c0c9bf0 con 0x7f882c070ff0 2023-11-04T01:42:53.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.153+0000 7f8830f5e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f882c0cd890 con 0x7f882c15d1b0 2023-11-04T01:42:53.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.153+0000 7f8830f5e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f882c0cdb30 con 0x7f882c066000 2023-11-04T01:42:53.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.153+0000 7f8829d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f882c15d1b0 0x7f882c0cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:53.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.153+0000 7f8829d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f882c15d1b0 0x7f882c0cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38748/0 (socket says 172.21.15.77:38748) 2023-11-04T01:42:53.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.153+0000 7f882a59c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f882c070ff0 0x7f882c0713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:46994/0 (socket says 172.21.15.77:46994) 2023-11-04T01:42:53.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.153+0000 7f8829d9b640 1 -- 172.21.15.77:0/4223458568 learned_addr learned my addr 172.21.15.77:0/4223458568 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:53.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.154+0000 7f8829d9b640 1 -- 172.21.15.77:0/4223458568 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f882c066000 msgr2=0x7f882c06a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:53.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.154+0000 7f882ad9d640 1 --2- 172.21.15.77:0/4223458568 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f882c066000 0x7f882c06a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:53.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.154+0000 7f8829d9b640 1 --2- 172.21.15.77:0/4223458568 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f882c066000 0x7f882c06a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.154+0000 7f8829d9b640 1 -- 172.21.15.77:0/4223458568 >> v1:172.21.15.77:6789/0 conn(0x7f882c070ff0 legacy=0x7f882c0713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:53.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.154+0000 7f882959a640 1 -- 172.21.15.77:0/4223458568 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2272036526 0 0) 0x7f882c0c9bf0 con 0x7f882c070ff0 2023-11-04T01:42:53.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.154+0000 7f8829d9b640 1 -- 172.21.15.77:0/4223458568 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882c0cde10 con 0x7f882c15d1b0 2023-11-04T01:42:53.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.154+0000 7f8829d9b640 1 --2- 172.21.15.77:0/4223458568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f882c15d1b0 0x7f882c0cb4e0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f8820009870 tx=0x7f882002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b1ac0d586a1431 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:53.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.154+0000 7f882959a640 1 -- 172.21.15.77:0/4223458568 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8820030840 con 0x7f882c15d1b0 2023-11-04T01:42:53.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.154+0000 7f882959a640 1 -- 172.21.15.77:0/4223458568 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88200309a0 con 0x7f882c15d1b0 2023-11-04T01:42:53.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.154+0000 7f882959a640 1 -- 172.21.15.77:0/4223458568 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8820030d30 con 0x7f882c15d1b0 2023-11-04T01:42:53.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.155+0000 7f8830f5e640 1 -- 172.21.15.77:0/4223458568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f882c15d1b0 msgr2=0x7f882c0cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:53.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.155+0000 7f8830f5e640 1 --2- 172.21.15.77:0/4223458568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f882c15d1b0 0x7f882c0cb4e0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f8820009870 tx=0x7f882002b980 comp rx=0 tx=0).stop 2023-11-04T01:42:53.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.155+0000 7f8830f5e640 1 -- 172.21.15.77:0/4223458568 shutdown_connections 2023-11-04T01:42:53.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.155+0000 7f8830f5e640 1 --2- 172.21.15.77:0/4223458568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f882c15d1b0 0x7f882c0cb4e0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.155+0000 7f8830f5e640 1 --2- 172.21.15.77:0/4223458568 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f882c066000 0x7f882c06a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.155+0000 7f8830f5e640 1 -- 172.21.15.77:0/4223458568 >> 172.21.15.77:0/4223458568 conn(0x7f882c0cbc90 msgr2=0x7f882c0cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:53.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.155+0000 7f8830f5e640 1 -- 172.21.15.77:0/4223458568 shutdown_connections 2023-11-04T01:42:53.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.155+0000 7f8830f5e640 1 -- 172.21.15.77:0/4223458568 wait complete. 2023-11-04T01:42:53.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.156+0000 7f8830f5e640 1 Processor -- start 2023-11-04T01:42:53.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.156+0000 7f8830f5e640 1 -- start start 2023-11-04T01:42:53.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.157+0000 7f8830f5e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f882c066000 0x7f882c1484f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:53.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.157+0000 7f8830f5e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f882c070ff0 0x7f882c0c2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:53.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.157+0000 7f8830f5e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f882c15d1b0 0x7f882c0c4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:53.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.157+0000 7f8830f5e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882c0b2330 con 0x7f882c15d1b0 2023-11-04T01:42:53.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.157+0000 7f8830f5e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882c0b2610 con 0x7f882c070ff0 2023-11-04T01:42:53.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.157+0000 7f8830f5e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f882c0b28f0 con 0x7f882c066000 2023-11-04T01:42:53.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.157+0000 7f882ad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f882c15d1b0 0x7f882c0c4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:53.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.157+0000 7f882ad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f882c15d1b0 0x7f882c0c4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38764/0 (socket says 172.21.15.77:38764) 2023-11-04T01:42:53.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.157+0000 7f882ad9d640 1 -- 172.21.15.77:0/3831535353 learned_addr learned my addr 172.21.15.77:0/3831535353 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:53.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.157+0000 7f882ad9d640 1 -- 172.21.15.77:0/3831535353 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f882c066000 msgr2=0x7f882c1484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:53.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.157+0000 7f882ad9d640 1 --2- 172.21.15.77:0/3831535353 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f882c066000 0x7f882c1484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.158+0000 7f882ad9d640 1 -- 172.21.15.77:0/3831535353 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f882c070ff0 msgr2=0x7f882c0c2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:53.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.158+0000 7f882ad9d640 1 --2- 172.21.15.77:0/3831535353 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f882c070ff0 0x7f882c0c2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.158+0000 7f882ad9d640 1 -- 172.21.15.77:0/3831535353 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88200094d0 con 0x7f882c15d1b0 2023-11-04T01:42:53.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.158+0000 7f882ad9d640 1 --2- 172.21.15.77:0/3831535353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f882c15d1b0 0x7f882c0c4a60 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f882400c550 tx=0x7f882400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:53.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.158+0000 7f881affd640 1 -- 172.21.15.77:0/3831535353 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8824004220 con 0x7f882c15d1b0 2023-11-04T01:42:53.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.158+0000 7f881affd640 1 -- 172.21.15.77:0/3831535353 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8824004380 con 0x7f882c15d1b0 2023-11-04T01:42:53.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.158+0000 7f8830f5e640 1 -- 172.21.15.77:0/3831535353 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f882c0b2bd0 con 0x7f882c15d1b0 2023-11-04T01:42:53.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.158+0000 7f881affd640 1 -- 172.21.15.77:0/3831535353 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8824003830 con 0x7f882c15d1b0 2023-11-04T01:42:53.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.158+0000 7f8830f5e640 1 -- 172.21.15.77:0/3831535353 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f882c148a30 con 0x7f882c15d1b0 2023-11-04T01:42:53.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.159+0000 7f8830f5e640 1 -- 172.21.15.77:0/3831535353 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f882c0b30f0 con 0x7f882c15d1b0 2023-11-04T01:42:53.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.159+0000 7f881affd640 1 -- 172.21.15.77:0/3831535353 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8824003990 con 0x7f882c15d1b0 2023-11-04T01:42:53.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.160+0000 7f881affd640 1 --2- 172.21.15.77:0/3831535353 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f880c06aea0 0x7f880c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:53.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.160+0000 7f881affd640 1 -- 172.21.15.77:0/3831535353 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6240+0+0 (secure 0 0 0) 0x7f88240894c0 con 0x7f882c15d1b0 2023-11-04T01:42:53.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.160+0000 7f882a59c640 1 --2- 172.21.15.77:0/3831535353 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f880c06aea0 0x7f880c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:53.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.160+0000 7f882a59c640 1 --2- 172.21.15.77:0/3831535353 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f880c06aea0 0x7f880c06d360 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f881c001560 tx=0x7f881c007ca0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:53.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.164+0000 7f881affd640 1 -- 172.21.15.77:0/3831535353 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f882c0b30f0 con 0x7f882c15d1b0 2023-11-04T01:42:53.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.330+0000 7f8830f5e640 1 -- 172.21.15.77:0/3831535353 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f882c0b30f0 con 0x7f882c15d1b0 2023-11-04T01:42:53.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.330+0000 7f881affd640 1 -- 172.21.15.77:0/3831535353 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v79) v1 ==== 103+0+11 (secure 0 0 0) 0x7f882c0b30f0 con 0x7f882c15d1b0 2023-11-04T01:42:53.332 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:42:53.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.332+0000 7f8830f5e640 1 -- 172.21.15.77:0/3831535353 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f880c06aea0 msgr2=0x7f880c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:53.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.332+0000 7f8830f5e640 1 --2- 172.21.15.77:0/3831535353 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f880c06aea0 0x7f880c06d360 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f881c001560 tx=0x7f881c007ca0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.332+0000 7f8830f5e640 1 -- 172.21.15.77:0/3831535353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f882c15d1b0 msgr2=0x7f882c0c4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:53.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.332+0000 7f8830f5e640 1 --2- 172.21.15.77:0/3831535353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f882c15d1b0 0x7f882c0c4a60 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f882400c550 tx=0x7f882400ca10 comp rx=0 tx=0).stop 2023-11-04T01:42:53.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.332+0000 7f8830f5e640 1 -- 172.21.15.77:0/3831535353 shutdown_connections 2023-11-04T01:42:53.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.332+0000 7f8830f5e640 1 --2- 172.21.15.77:0/3831535353 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f880c06aea0 0x7f880c06d360 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.332+0000 7f8830f5e640 1 --2- 172.21.15.77:0/3831535353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f882c15d1b0 0x7f882c0c4a60 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.332+0000 7f8830f5e640 1 --2- 172.21.15.77:0/3831535353 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f882c070ff0 0x7f882c0c2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.332+0000 7f8830f5e640 1 --2- 172.21.15.77:0/3831535353 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f882c066000 0x7f882c1484f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.332+0000 7f8830f5e640 1 -- 172.21.15.77:0/3831535353 >> 172.21.15.77:0/3831535353 conn(0x7f882c0cbc90 msgr2=0x7f882c155570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:53.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.332+0000 7f8830f5e640 1 -- 172.21.15.77:0/3831535353 shutdown_connections 2023-11-04T01:42:53.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.332+0000 7f8830f5e640 1 -- 172.21.15.77:0/3831535353 wait complete. 2023-11-04T01:42:53.344 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:42:53.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.444+0000 7f4f909b6640 1 Processor -- start 2023-11-04T01:42:53.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.444+0000 7f4f909b6640 1 -- start start 2023-11-04T01:42:53.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.445+0000 7f4f909b6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4f8c15ad40 0x7f4f8c06b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:53.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.445+0000 7f4f909b6640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4f8c15b120 0x7f4f8c15f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:53.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.445+0000 7f4f909b6640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f8c065df0 con 0x7f4f8c0c9b60 2023-11-04T01:42:53.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.445+0000 7f4f909b6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f8c06bc40 con 0x7f4f8c15ad40 2023-11-04T01:42:53.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.445+0000 7f4f909b6640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f8c15f910 con 0x7f4f8c15b120 2023-11-04T01:42:53.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.445+0000 7f4f8a59c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4f8c15ad40 0x7f4f8c06b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:53.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.445+0000 7f4f8a59c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4f8c15ad40 0x7f4f8c06b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38778/0 (socket says 172.21.15.77:38778) 2023-11-04T01:42:53.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.445+0000 7f4f8a59c640 1 -- 172.21.15.77:0/1435970949 learned_addr learned my addr 172.21.15.77:0/1435970949 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:53.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.445+0000 7f4f89d9b640 1 --2- 172.21.15.77:0/1435970949 >> v2:172.21.15.122:3300/0 conn(0x7f4f8c15b120 0x7f4f8c15f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:53.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.445+0000 7f4f8a59c640 1 -- 172.21.15.77:0/1435970949 >> v2:172.21.15.122:3300/0 conn(0x7f4f8c15b120 msgr2=0x7f4f8c15f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:53.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.445+0000 7f4f8a59c640 1 --2- 172.21.15.77:0/1435970949 >> v2:172.21.15.122:3300/0 conn(0x7f4f8c15b120 0x7f4f8c15f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.445+0000 7f4f8a59c640 1 -- 172.21.15.77:0/1435970949 >> v1:172.21.15.122:6789/0 conn(0x7f4f8c0c9b60 legacy=0x7f4f8c070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:53.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.445+0000 7f4f8a59c640 1 -- 172.21.15.77:0/1435970949 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f8c066040 con 0x7f4f8c15ad40 2023-11-04T01:42:53.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.445+0000 7f4f89d9b640 1 --2- 172.21.15.77:0/1435970949 >> v2:172.21.15.122:3300/0 conn(0x7f4f8c15b120 0x7f4f8c15f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:53.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.446+0000 7f4f8a59c640 1 --2- 172.21.15.77:0/1435970949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f8c15ad40 0x7f4f8c06b700 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c0cf060 tx=0x7f4f7c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=408594a701b34d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:53.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.446+0000 7f4f8959a640 1 -- 172.21.15.77:0/1435970949 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c02ca80 con 0x7f4f8c15ad40 2023-11-04T01:42:53.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.446+0000 7f4f8959a640 1 -- 172.21.15.77:0/1435970949 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f7c02cbe0 con 0x7f4f8c15ad40 2023-11-04T01:42:53.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.446+0000 7f4f8959a640 1 -- 172.21.15.77:0/1435970949 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c0343f0 con 0x7f4f8c15ad40 2023-11-04T01:42:53.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.447+0000 7f4f909b6640 1 -- 172.21.15.77:0/1435970949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f8c15ad40 msgr2=0x7f4f8c06b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:53.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.447+0000 7f4f909b6640 1 --2- 172.21.15.77:0/1435970949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f8c15ad40 0x7f4f8c06b700 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c0cf060 tx=0x7f4f7c02bee0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.447+0000 7f4f909b6640 1 -- 172.21.15.77:0/1435970949 shutdown_connections 2023-11-04T01:42:53.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.447+0000 7f4f909b6640 1 --2- 172.21.15.77:0/1435970949 >> v2:172.21.15.122:3300/0 conn(0x7f4f8c15b120 0x7f4f8c15f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.447+0000 7f4f909b6640 1 --2- 172.21.15.77:0/1435970949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f8c15ad40 0x7f4f8c06b700 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.447+0000 7f4f909b6640 1 -- 172.21.15.77:0/1435970949 >> 172.21.15.77:0/1435970949 conn(0x7f4f8c0cbc90 msgr2=0x7f4f8c0cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:53.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.447+0000 7f4f909b6640 1 -- 172.21.15.77:0/1435970949 shutdown_connections 2023-11-04T01:42:53.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.447+0000 7f4f909b6640 1 -- 172.21.15.77:0/1435970949 wait complete. 2023-11-04T01:42:53.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.448+0000 7f4f909b6640 1 Processor -- start 2023-11-04T01:42:53.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.448+0000 7f4f909b6640 1 -- start start 2023-11-04T01:42:53.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.449+0000 7f4f909b6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f8c0c9b60 0x7f4f8c14b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:53.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.449+0000 7f4f909b6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f8c15ad40 0x7f4f8c14ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:53.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.449+0000 7f4f909b6640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4f8c15b120 0x7f4f8c0c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:53.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.449+0000 7f4f909b6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c14c630 con 0x7f4f8c15ad40 2023-11-04T01:42:53.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.449+0000 7f4f909b6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c14c880 con 0x7f4f8c0c9b60 2023-11-04T01:42:53.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.449+0000 7f4f909b6640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c14cb60 con 0x7f4f8c15b120 2023-11-04T01:42:53.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.449+0000 7f4f89d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f8c15ad40 0x7f4f8c14ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:53.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.449+0000 7f4f89d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f8c15ad40 0x7f4f8c14ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38788/0 (socket says 172.21.15.77:38788) 2023-11-04T01:42:53.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.449+0000 7f4f89d9b640 1 -- 172.21.15.77:0/1661057729 learned_addr learned my addr 172.21.15.77:0/1661057729 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:53.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.449+0000 7f4f8a59c640 1 --2- 172.21.15.77:0/1661057729 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f8c0c9b60 0x7f4f8c14b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:53.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.449+0000 7f4f8ad9d640 1 --2- 172.21.15.77:0/1661057729 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4f8c15b120 0x7f4f8c0c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:53.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.449+0000 7f4f89d9b640 1 -- 172.21.15.77:0/1661057729 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4f8c15b120 msgr2=0x7f4f8c0c79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:53.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.449+0000 7f4f89d9b640 1 --2- 172.21.15.77:0/1661057729 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4f8c15b120 0x7f4f8c0c79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.449+0000 7f4f89d9b640 1 -- 172.21.15.77:0/1661057729 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f8c0c9b60 msgr2=0x7f4f8c14b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:53.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.449+0000 7f4f89d9b640 1 --2- 172.21.15.77:0/1661057729 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f8c0c9b60 0x7f4f8c14b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.449+0000 7f4f89d9b640 1 -- 172.21.15.77:0/1661057729 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f7c009b30 con 0x7f4f8c15ad40 2023-11-04T01:42:53.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.449+0000 7f4f89d9b640 1 --2- 172.21.15.77:0/1661057729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f8c15ad40 0x7f4f8c14ed20 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f4f8000c7c0 tx=0x7f4f8000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:53.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.450+0000 7f4f7affd640 1 -- 172.21.15.77:0/1661057729 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f80007820 con 0x7f4f8c15ad40 2023-11-04T01:42:53.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.450+0000 7f4f7affd640 1 -- 172.21.15.77:0/1661057729 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f80007980 con 0x7f4f8c15ad40 2023-11-04T01:42:53.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.450+0000 7f4f909b6640 1 -- 172.21.15.77:0/1661057729 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f8c14ce40 con 0x7f4f8c15ad40 2023-11-04T01:42:53.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.450+0000 7f4f7affd640 1 -- 172.21.15.77:0/1661057729 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f80007d10 con 0x7f4f8c15ad40 2023-11-04T01:42:53.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.450+0000 7f4f909b6640 1 -- 172.21.15.77:0/1661057729 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f8c14bb20 con 0x7f4f8c15ad40 2023-11-04T01:42:53.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.451+0000 7f4f909b6640 1 -- 172.21.15.77:0/1661057729 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f8c074290 con 0x7f4f8c15ad40 2023-11-04T01:42:53.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.451+0000 7f4f7affd640 1 -- 172.21.15.77:0/1661057729 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4f800113f0 con 0x7f4f8c15ad40 2023-11-04T01:42:53.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.451+0000 7f4f7affd640 1 --2- 172.21.15.77:0/1661057729 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4f6c06ae70 0x7f4f6c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:53.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.451+0000 7f4f7affd640 1 -- 172.21.15.77:0/1661057729 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6240+0+0 (secure 0 0 0) 0x7f4f80089860 con 0x7f4f8c15ad40 2023-11-04T01:42:53.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.451+0000 7f4f8a59c640 1 --2- 172.21.15.77:0/1661057729 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4f6c06ae70 0x7f4f6c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:53.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.452+0000 7f4f8a59c640 1 --2- 172.21.15.77:0/1661057729 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4f6c06ae70 0x7f4f6c06d330 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c035000 tx=0x7f4f7c030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:53.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.455+0000 7f4f7affd640 1 -- 172.21.15.77:0/1661057729 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4f80054700 con 0x7f4f8c15ad40 2023-11-04T01:42:53.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.619+0000 7f4f909b6640 1 -- 172.21.15.77:0/1661057729 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f4f8c0ccac0 con 0x7f4f8c15ad40 2023-11-04T01:42:53.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.619+0000 7f4f7affd640 1 -- 172.21.15.77:0/1661057729 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v79) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4f80057d20 con 0x7f4f8c15ad40 2023-11-04T01:42:53.621 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:42:53.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.621+0000 7f4f909b6640 1 -- 172.21.15.77:0/1661057729 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4f6c06ae70 msgr2=0x7f4f6c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:53.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.621+0000 7f4f909b6640 1 --2- 172.21.15.77:0/1661057729 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4f6c06ae70 0x7f4f6c06d330 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c035000 tx=0x7f4f7c030000 comp rx=0 tx=0).stop 2023-11-04T01:42:53.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.621+0000 7f4f909b6640 1 -- 172.21.15.77:0/1661057729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f8c15ad40 msgr2=0x7f4f8c14ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:53.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.621+0000 7f4f909b6640 1 --2- 172.21.15.77:0/1661057729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f8c15ad40 0x7f4f8c14ed20 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f4f8000c7c0 tx=0x7f4f8000cc80 comp rx=0 tx=0).stop 2023-11-04T01:42:53.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.621+0000 7f4f909b6640 1 -- 172.21.15.77:0/1661057729 shutdown_connections 2023-11-04T01:42:53.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.621+0000 7f4f909b6640 1 --2- 172.21.15.77:0/1661057729 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4f6c06ae70 0x7f4f6c06d330 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.621+0000 7f4f909b6640 1 --2- 172.21.15.77:0/1661057729 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4f8c15b120 0x7f4f8c0c79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.621+0000 7f4f909b6640 1 --2- 172.21.15.77:0/1661057729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f8c15ad40 0x7f4f8c14ed20 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.621+0000 7f4f909b6640 1 --2- 172.21.15.77:0/1661057729 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4f8c0c9b60 0x7f4f8c14b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.621+0000 7f4f909b6640 1 -- 172.21.15.77:0/1661057729 >> 172.21.15.77:0/1661057729 conn(0x7f4f8c0cbc90 msgr2=0x7f4f8c15b980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:53.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.621+0000 7f4f909b6640 1 -- 172.21.15.77:0/1661057729 shutdown_connections 2023-11-04T01:42:53.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.621+0000 7f4f909b6640 1 -- 172.21.15.77:0/1661057729 wait complete. 2023-11-04T01:42:53.633 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:42:53.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.733+0000 7f4b203c9640 1 Processor -- start 2023-11-04T01:42:53.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.734+0000 7f4b203c9640 1 -- start start 2023-11-04T01:42:53.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.734+0000 7f4b203c9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b1815ad30 0x7f4b180adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:53.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.735+0000 7f4b203c9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4b18070e20 0x7f4b1815e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:53.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.735+0000 7f4b203c9640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b180c3900 con 0x7f4b180ad730 2023-11-04T01:42:53.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.735+0000 7f4b203c9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b180ae260 con 0x7f4b18070e20 2023-11-04T01:42:53.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.735+0000 7f4b203c9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b180c3be0 con 0x7f4b1815ad30 2023-11-04T01:42:53.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.735+0000 7f4b1e966640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4b18070e20 0x7f4b1815e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:53.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.735+0000 7f4b1e966640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4b18070e20 0x7f4b1815e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38804/0 (socket says 172.21.15.77:38804) 2023-11-04T01:42:53.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.735+0000 7f4b1e966640 1 -- 172.21.15.77:0/2314384421 learned_addr learned my addr 172.21.15.77:0/2314384421 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:53.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.735+0000 7f4b1e966640 1 -- 172.21.15.77:0/2314384421 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b1815ad30 msgr2=0x7f4b180adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:53.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.735+0000 7f4b1e165640 1 --2- 172.21.15.77:0/2314384421 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b1815ad30 0x7f4b180adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:53.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.735+0000 7f4b1e966640 1 --2- 172.21.15.77:0/2314384421 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b1815ad30 0x7f4b180adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.735+0000 7f4b1e966640 1 -- 172.21.15.77:0/2314384421 >> v1:172.21.15.122:6789/0 conn(0x7f4b180ad730 legacy=0x7f4b18070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:53.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.735+0000 7f4b1e966640 1 -- 172.21.15.77:0/2314384421 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b180c3ec0 con 0x7f4b18070e20 2023-11-04T01:42:53.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.735+0000 7f4b1e165640 1 --2- 172.21.15.77:0/2314384421 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b1815ad30 0x7f4b180adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:53.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.736+0000 7f4b1e966640 1 --2- 172.21.15.77:0/2314384421 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b18070e20 0x7f4b1815e740 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f4b14009870 tx=0x7f4b1402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd0afaf7e3aec9f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:53.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.736+0000 7f4b1d163640 1 -- 172.21.15.77:0/2314384421 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b140317c0 con 0x7f4b18070e20 2023-11-04T01:42:53.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.736+0000 7f4b1d163640 1 -- 172.21.15.77:0/2314384421 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b14031920 con 0x7f4b18070e20 2023-11-04T01:42:53.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.736+0000 7f4b1d163640 1 -- 172.21.15.77:0/2314384421 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b14031cb0 con 0x7f4b18070e20 2023-11-04T01:42:53.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.736+0000 7f4b203c9640 1 -- 172.21.15.77:0/2314384421 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b18070e20 msgr2=0x7f4b1815e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:53.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.736+0000 7f4b203c9640 1 --2- 172.21.15.77:0/2314384421 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b18070e20 0x7f4b1815e740 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f4b14009870 tx=0x7f4b1402b860 comp rx=0 tx=0).stop 2023-11-04T01:42:53.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.736+0000 7f4b203c9640 1 -- 172.21.15.77:0/2314384421 shutdown_connections 2023-11-04T01:42:53.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.736+0000 7f4b203c9640 1 --2- 172.21.15.77:0/2314384421 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b18070e20 0x7f4b1815e740 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.737+0000 7f4b203c9640 1 --2- 172.21.15.77:0/2314384421 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b1815ad30 0x7f4b180adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.737+0000 7f4b203c9640 1 -- 172.21.15.77:0/2314384421 >> 172.21.15.77:0/2314384421 conn(0x7f4b180ce950 msgr2=0x7f4b180ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:53.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.737+0000 7f4b203c9640 1 -- 172.21.15.77:0/2314384421 shutdown_connections 2023-11-04T01:42:53.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.737+0000 7f4b203c9640 1 -- 172.21.15.77:0/2314384421 wait complete. 2023-11-04T01:42:53.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.738+0000 7f4b203c9640 1 Processor -- start 2023-11-04T01:42:53.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.738+0000 7f4b203c9640 1 -- start start 2023-11-04T01:42:53.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.738+0000 7f4b203c9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b18070e20 0x7f4b180c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:53.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.738+0000 7f4b203c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b180ad730 0x7f4b181f2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:53.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.738+0000 7f4b203c9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b1815ad30 0x7f4b180cd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:53.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.738+0000 7f4b203c9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b18158320 con 0x7f4b180ad730 2023-11-04T01:42:53.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.738+0000 7f4b203c9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b180ac7e0 con 0x7f4b1815ad30 2023-11-04T01:42:53.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.738+0000 7f4b203c9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b180acac0 con 0x7f4b18070e20 2023-11-04T01:42:53.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.739+0000 7f4b1d964640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b180ad730 0x7f4b181f2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:53.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.739+0000 7f4b1d964640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b180ad730 0x7f4b181f2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38820/0 (socket says 172.21.15.77:38820) 2023-11-04T01:42:53.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.739+0000 7f4b1d964640 1 -- 172.21.15.77:0/1243905194 learned_addr learned my addr 172.21.15.77:0/1243905194 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:53.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.739+0000 7f4b1d964640 1 -- 172.21.15.77:0/1243905194 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b18070e20 msgr2=0x7f4b180c8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:53.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.739+0000 7f4b1d964640 1 --2- 172.21.15.77:0/1243905194 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b18070e20 0x7f4b180c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.739+0000 7f4b1d964640 1 -- 172.21.15.77:0/1243905194 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b1815ad30 msgr2=0x7f4b180cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:53.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.739+0000 7f4b1d964640 1 --2- 172.21.15.77:0/1243905194 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b1815ad30 0x7f4b180cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.739+0000 7f4b1d964640 1 -- 172.21.15.77:0/1243905194 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b140094d0 con 0x7f4b180ad730 2023-11-04T01:42:53.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.739+0000 7f4b1d964640 1 --2- 172.21.15.77:0/1243905194 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b180ad730 0x7f4b181f2740 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f4b0800c430 tx=0x7f4b0800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:53.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.739+0000 7f4b0effd640 1 -- 172.21.15.77:0/1243905194 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b08011790 con 0x7f4b180ad730 2023-11-04T01:42:53.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.739+0000 7f4b0effd640 1 -- 172.21.15.77:0/1243905194 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b080118f0 con 0x7f4b180ad730 2023-11-04T01:42:53.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.739+0000 7f4b203c9640 1 -- 172.21.15.77:0/1243905194 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b180acda0 con 0x7f4b180ad730 2023-11-04T01:42:53.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.739+0000 7f4b0effd640 1 -- 172.21.15.77:0/1243905194 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b08011ce0 con 0x7f4b180ad730 2023-11-04T01:42:53.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.739+0000 7f4b203c9640 1 -- 172.21.15.77:0/1243905194 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b180c8750 con 0x7f4b180ad730 2023-11-04T01:42:53.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.740+0000 7f4b203c9640 1 -- 172.21.15.77:0/1243905194 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b18074290 con 0x7f4b180ad730 2023-11-04T01:42:53.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.740+0000 7f4b0effd640 1 -- 172.21.15.77:0/1243905194 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4b0801c460 con 0x7f4b180ad730 2023-11-04T01:42:53.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.741+0000 7f4b0effd640 1 --2- 172.21.15.77:0/1243905194 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4afc06ae70 0x7f4afc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:53.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.741+0000 7f4b0effd640 1 -- 172.21.15.77:0/1243905194 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6240+0+0 (secure 0 0 0) 0x7f4b08089760 con 0x7f4b180ad730 2023-11-04T01:42:53.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.741+0000 7f4b1e165640 1 --2- 172.21.15.77:0/1243905194 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4afc06ae70 0x7f4afc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:53.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.741+0000 7f4b1e165640 1 --2- 172.21.15.77:0/1243905194 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4afc06ae70 0x7f4afc06d330 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4b10008e00 tx=0x7f4b10008330 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:53.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.745+0000 7f4b0effd640 1 -- 172.21.15.77:0/1243905194 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4b08054610 con 0x7f4b180ad730 2023-11-04T01:42:53.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.909+0000 7f4b203c9640 1 -- 172.21.15.77:0/1243905194 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f4b18158490 con 0x7f4b180ad730 2023-11-04T01:42:53.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.910+0000 7f4b0effd640 1 -- 172.21.15.77:0/1243905194 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v79) v1 ==== 107+0+11 (secure 0 0 0) 0x7f4b18158490 con 0x7f4b180ad730 2023-11-04T01:42:53.912 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:42:53.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.912+0000 7f4b203c9640 1 -- 172.21.15.77:0/1243905194 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4afc06ae70 msgr2=0x7f4afc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:53.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.912+0000 7f4b203c9640 1 --2- 172.21.15.77:0/1243905194 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4afc06ae70 0x7f4afc06d330 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4b10008e00 tx=0x7f4b10008330 comp rx=0 tx=0).stop 2023-11-04T01:42:53.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.912+0000 7f4b203c9640 1 -- 172.21.15.77:0/1243905194 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b180ad730 msgr2=0x7f4b181f2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:53.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.912+0000 7f4b203c9640 1 --2- 172.21.15.77:0/1243905194 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b180ad730 0x7f4b181f2740 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f4b0800c430 tx=0x7f4b0800c8f0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.912+0000 7f4b203c9640 1 -- 172.21.15.77:0/1243905194 shutdown_connections 2023-11-04T01:42:53.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.912+0000 7f4b203c9640 1 --2- 172.21.15.77:0/1243905194 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4afc06ae70 0x7f4afc06d330 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.912+0000 7f4b203c9640 1 --2- 172.21.15.77:0/1243905194 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b1815ad30 0x7f4b180cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.912+0000 7f4b203c9640 1 --2- 172.21.15.77:0/1243905194 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b180ad730 0x7f4b181f2740 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.912+0000 7f4b203c9640 1 --2- 172.21.15.77:0/1243905194 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b18070e20 0x7f4b180c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.912+0000 7f4b203c9640 1 -- 172.21.15.77:0/1243905194 >> 172.21.15.77:0/1243905194 conn(0x7f4b180ce950 msgr2=0x7f4b1806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:53.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.912+0000 7f4b203c9640 1 -- 172.21.15.77:0/1243905194 shutdown_connections 2023-11-04T01:42:53.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:53.912+0000 7f4b203c9640 1 -- 172.21.15.77:0/1243905194 wait complete. 2023-11-04T01:42:53.924 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T01:42:54.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.023+0000 7fdc3c232640 1 Processor -- start 2023-11-04T01:42:54.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.023+0000 7fdc3c232640 1 -- start start 2023-11-04T01:42:54.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.024+0000 7fdc3c232640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc34159c70 0x7fdc340ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.024+0000 7fdc3c232640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc340b4110 con 0x7fdc3406db20 2023-11-04T01:42:54.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.024+0000 7fdc3c232640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc340b43f0 con 0x7fdc340b0ae0 2023-11-04T01:42:54.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.024+0000 7fdc3c232640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc340b49b0 con 0x7fdc34159c70 2023-11-04T01:42:54.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.024+0000 7fdc397cd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fdc3406db20 0x7fdc340b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:47006/0 (socket says 172.21.15.77:47006) 2023-11-04T01:42:54.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.024+0000 7fdc397cd640 1 -- 172.21.15.77:0/2567994984 learned_addr learned my addr 172.21.15.77:0/2567994984 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:54.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.024+0000 7fdc39fce640 1 --2- 172.21.15.77:0/2567994984 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc34159c70 0x7fdc340ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.024+0000 7fdc38fcc640 1 -- 172.21.15.77:0/2567994984 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2762311789 0 0) 0x7fdc340b4110 con 0x7fdc3406db20 2023-11-04T01:42:54.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.024+0000 7fdc38fcc640 1 -- 172.21.15.77:0/2567994984 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc20003520 con 0x7fdc3406db20 2023-11-04T01:42:54.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.024+0000 7fdc38fcc640 1 -- 172.21.15.77:0/2567994984 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2836200130 0 0) 0x7fdc20003520 con 0x7fdc3406db20 2023-11-04T01:42:54.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.024+0000 7fdc38fcc640 1 -- 172.21.15.77:0/2567994984 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc34159c70 msgr2=0x7fdc340ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:54.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.024+0000 7fdc38fcc640 1 --2- 172.21.15.77:0/2567994984 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc34159c70 0x7fdc340ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.024+0000 7fdc38fcc640 1 -- 172.21.15.77:0/2567994984 >> v1:172.21.15.122:6789/0 conn(0x7fdc340b0ae0 legacy=0x7fdc3415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.024+0000 7fdc38fcc640 1 -- 172.21.15.77:0/2567994984 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc340b46d0 con 0x7fdc3406db20 2023-11-04T01:42:54.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.024+0000 7fdc38fcc640 1 -- 172.21.15.77:0/2567994984 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7fdc24001670 con 0x7fdc3406db20 2023-11-04T01:42:54.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.024+0000 7fdc38fcc640 1 -- 172.21.15.77:0/2567994984 >> v1:172.21.15.77:6789/0 conn(0x7fdc3406db20 legacy=0x7fdc340b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.024+0000 7fdc38fcc640 1 --2- 172.21.15.77:0/2567994984 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc34159c70 0x7fdc200039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.024+0000 7fdc38fcc640 1 --2- 172.21.15.77:0/2567994984 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc20003ee0 0x7fdc200047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.024+0000 7fdc38fcc640 1 --2- 172.21.15.77:0/2567994984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc20004d00 0x7fdc20005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.024+0000 7fdc38fcc640 1 -- 172.21.15.77:0/2567994984 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc340b49b0 con 0x7fdc20004d00 2023-11-04T01:42:54.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.024+0000 7fdc38fcc640 1 -- 172.21.15.77:0/2567994984 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2000b9e0 con 0x7fdc20003ee0 2023-11-04T01:42:54.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.024+0000 7fdc38fcc640 1 -- 172.21.15.77:0/2567994984 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2000bba0 con 0x7fdc34159c70 2023-11-04T01:42:54.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.025+0000 7fdc3a7cf640 1 --2- 172.21.15.77:0/2567994984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc20004d00 0x7fdc20005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.025+0000 7fdc397cd640 1 --2- 172.21.15.77:0/2567994984 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc20003ee0 0x7fdc200047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.025+0000 7fdc39fce640 1 --2- 172.21.15.77:0/2567994984 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc34159c70 0x7fdc200039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.025+0000 7fdc3a7cf640 1 -- 172.21.15.77:0/2567994984 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc34159c70 msgr2=0x7fdc200039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:54.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.025+0000 7fdc3a7cf640 1 --2- 172.21.15.77:0/2567994984 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc34159c70 0x7fdc200039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.025+0000 7fdc3a7cf640 1 -- 172.21.15.77:0/2567994984 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc20003ee0 msgr2=0x7fdc200047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:54.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.025+0000 7fdc3a7cf640 1 --2- 172.21.15.77:0/2567994984 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc20003ee0 0x7fdc200047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.025+0000 7fdc3a7cf640 1 -- 172.21.15.77:0/2567994984 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc20003520 con 0x7fdc20004d00 2023-11-04T01:42:54.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.026+0000 7fdc3a7cf640 1 --2- 172.21.15.77:0/2567994984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc20004d00 0x7fdc20005180 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c001f60 tx=0x7fdc200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe39e1c11b451d58 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:54.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.026+0000 7fdc38fcc640 1 -- 172.21.15.77:0/2567994984 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c02d6f0 con 0x7fdc20004d00 2023-11-04T01:42:54.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.026+0000 7fdc38fcc640 1 -- 172.21.15.77:0/2567994984 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2c02d870 con 0x7fdc20004d00 2023-11-04T01:42:54.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.026+0000 7fdc38fcc640 1 -- 172.21.15.77:0/2567994984 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c02dc20 con 0x7fdc20004d00 2023-11-04T01:42:54.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.026+0000 7fdc3c232640 1 -- 172.21.15.77:0/2567994984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc20004d00 msgr2=0x7fdc20005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.026+0000 7fdc3c232640 1 --2- 172.21.15.77:0/2567994984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc20004d00 0x7fdc20005180 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c001f60 tx=0x7fdc200057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.026+0000 7fdc3a7cf640 1 -- 172.21.15.77:0/2567994984 reap_dead start 2023-11-04T01:42:54.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.026+0000 7fdc3c232640 1 -- 172.21.15.77:0/2567994984 shutdown_connections 2023-11-04T01:42:54.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.026+0000 7fdc3c232640 1 -- 172.21.15.77:0/2567994984 >> 172.21.15.77:0/2567994984 conn(0x7fdc340ce950 msgr2=0x7fdc340ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:54.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.026+0000 7fdc3c232640 1 -- 172.21.15.77:0/2567994984 shutdown_connections 2023-11-04T01:42:54.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.026+0000 7fdc3c232640 1 -- 172.21.15.77:0/2567994984 wait complete. 2023-11-04T01:42:54.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.028+0000 7fdc3c232640 1 Processor -- start 2023-11-04T01:42:54.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.028+0000 7fdc3c232640 1 -- start start 2023-11-04T01:42:54.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.028+0000 7fdc3c232640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc20004d00 0x7fdc34155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.028+0000 7fdc3c232640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc3414ed80 0x7fdc3414fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.028+0000 7fdc3c232640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc3414ffa0 0x7fdc34151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.028+0000 7fdc3c232640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc34150420 con 0x7fdc3414ed80 2023-11-04T01:42:54.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.028+0000 7fdc3c232640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc34155650 con 0x7fdc3414ffa0 2023-11-04T01:42:54.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.028+0000 7fdc3c232640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc34153db0 con 0x7fdc20004d00 2023-11-04T01:42:54.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.028+0000 7fdc397cd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc3414ed80 0x7fdc3414fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.028+0000 7fdc397cd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc3414ed80 0x7fdc3414fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38838/0 (socket says 172.21.15.77:38838) 2023-11-04T01:42:54.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.028+0000 7fdc397cd640 1 -- 172.21.15.77:0/29491893 learned_addr learned my addr 172.21.15.77:0/29491893 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:54.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.029+0000 7fdc39fce640 1 --2- 172.21.15.77:0/29491893 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc20004d00 0x7fdc34155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.029+0000 7fdc3a7cf640 1 --2- 172.21.15.77:0/29491893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc3414ffa0 0x7fdc34151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.029+0000 7fdc397cd640 1 -- 172.21.15.77:0/29491893 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc20004d00 msgr2=0x7fdc34155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.029+0000 7fdc397cd640 1 --2- 172.21.15.77:0/29491893 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc20004d00 0x7fdc34155110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.029+0000 7fdc397cd640 1 -- 172.21.15.77:0/29491893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc3414ffa0 msgr2=0x7fdc34151140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.029+0000 7fdc397cd640 1 --2- 172.21.15.77:0/29491893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc3414ffa0 0x7fdc34151140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.029+0000 7fdc397cd640 1 -- 172.21.15.77:0/29491893 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc34154090 con 0x7fdc3414ed80 2023-11-04T01:42:54.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.029+0000 7fdc3a7cf640 1 --2- 172.21.15.77:0/29491893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc3414ffa0 0x7fdc34151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:54.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.029+0000 7fdc397cd640 1 --2- 172.21.15.77:0/29491893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc3414ed80 0x7fdc3414fa60 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fdc24004ab0 tx=0x7fdc24004f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:54.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.029+0000 7fdc2a7fc640 1 -- 172.21.15.77:0/29491893 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc24011dc0 con 0x7fdc3414ed80 2023-11-04T01:42:54.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.029+0000 7fdc2a7fc640 1 -- 172.21.15.77:0/29491893 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc24014370 con 0x7fdc3414ed80 2023-11-04T01:42:54.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.029+0000 7fdc3c232640 1 -- 172.21.15.77:0/29491893 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc34154370 con 0x7fdc3414ed80 2023-11-04T01:42:54.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.029+0000 7fdc2a7fc640 1 -- 172.21.15.77:0/29491893 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc24014720 con 0x7fdc3414ed80 2023-11-04T01:42:54.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.029+0000 7fdc3c232640 1 -- 172.21.15.77:0/29491893 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc34154930 con 0x7fdc3414ed80 2023-11-04T01:42:54.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.030+0000 7fdc3c232640 1 -- 172.21.15.77:0/29491893 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc340ced30 con 0x7fdc3414ed80 2023-11-04T01:42:54.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.030+0000 7fdc2a7fc640 1 -- 172.21.15.77:0/29491893 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdc24014880 con 0x7fdc3414ed80 2023-11-04T01:42:54.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.031+0000 7fdc2a7fc640 1 --2- 172.21.15.77:0/29491893 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdc1806ae70 0x7fdc1806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.031+0000 7fdc2a7fc640 1 -- 172.21.15.77:0/29491893 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6240+0+0 (secure 0 0 0) 0x7fdc2408baa0 con 0x7fdc3414ed80 2023-11-04T01:42:54.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.031+0000 7fdc39fce640 1 --2- 172.21.15.77:0/29491893 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdc1806ae70 0x7fdc1806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.031+0000 7fdc39fce640 1 --2- 172.21.15.77:0/29491893 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdc1806ae70 0x7fdc1806d330 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fdc30009b00 tx=0x7fdc30008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:54.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.035+0000 7fdc2a7fc640 1 -- 172.21.15.77:0/29491893 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdc24056940 con 0x7fdc3414ed80 2023-11-04T01:42:54.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.205+0000 7fdc3c232640 1 -- 172.21.15.77:0/29491893 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fdc34074290 con 0x7fdc3414ed80 2023-11-04T01:42:54.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.206+0000 7fdc2a7fc640 1 -- 172.21.15.77:0/29491893 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v79) v1 ==== 84+0+287 (secure 0 0 0) 0x7fdc2401c070 con 0x7fdc3414ed80 2023-11-04T01:42:54.208 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:54.208 INFO:teuthology.orchestra.run.smithi077.stdout:[ 2023-11-04T01:42:54.208 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:54.209 INFO:teuthology.orchestra.run.smithi077.stdout: "poolnum": 1, 2023-11-04T01:42:54.209 INFO:teuthology.orchestra.run.smithi077.stdout: "poolname": ".mgr" 2023-11-04T01:42:54.209 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:54.209 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:54.209 INFO:teuthology.orchestra.run.smithi077.stdout: "poolnum": 7, 2023-11-04T01:42:54.209 INFO:teuthology.orchestra.run.smithi077.stdout: "poolname": "snap-test-pool" 2023-11-04T01:42:54.210 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:54.210 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:54.210 INFO:teuthology.orchestra.run.smithi077.stdout: "poolnum": 12, 2023-11-04T01:42:54.210 INFO:teuthology.orchestra.run.smithi077.stdout: "poolname": "test_data_pool" 2023-11-04T01:42:54.210 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:42:54.211 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:42:54.211 INFO:teuthology.orchestra.run.smithi077.stdout: "poolnum": 13, 2023-11-04T01:42:54.211 INFO:teuthology.orchestra.run.smithi077.stdout: "poolname": "test_metadata_pool" 2023-11-04T01:42:54.211 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:42:54.212 INFO:teuthology.orchestra.run.smithi077.stdout:] 2023-11-04T01:42:54.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.208+0000 7fdc3c232640 1 -- 172.21.15.77:0/29491893 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdc1806ae70 msgr2=0x7fdc1806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.208+0000 7fdc3c232640 1 --2- 172.21.15.77:0/29491893 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdc1806ae70 0x7fdc1806d330 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fdc30009b00 tx=0x7fdc30008040 comp rx=0 tx=0).stop 2023-11-04T01:42:54.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.208+0000 7fdc3c232640 1 -- 172.21.15.77:0/29491893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc3414ed80 msgr2=0x7fdc3414fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.208+0000 7fdc3c232640 1 --2- 172.21.15.77:0/29491893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc3414ed80 0x7fdc3414fa60 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fdc24004ab0 tx=0x7fdc24004f70 comp rx=0 tx=0).stop 2023-11-04T01:42:54.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.208+0000 7fdc3c232640 1 -- 172.21.15.77:0/29491893 shutdown_connections 2023-11-04T01:42:54.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.208+0000 7fdc3c232640 1 --2- 172.21.15.77:0/29491893 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdc1806ae70 0x7fdc1806d330 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.208+0000 7fdc3c232640 1 --2- 172.21.15.77:0/29491893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc3414ffa0 0x7fdc34151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.208+0000 7fdc3c232640 1 --2- 172.21.15.77:0/29491893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc3414ed80 0x7fdc3414fa60 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.208+0000 7fdc3c232640 1 --2- 172.21.15.77:0/29491893 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdc20004d00 0x7fdc34155110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.208+0000 7fdc3c232640 1 -- 172.21.15.77:0/29491893 >> 172.21.15.77:0/29491893 conn(0x7fdc340ce950 msgr2=0x7fdc340b3020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:54.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.208+0000 7fdc3c232640 1 -- 172.21.15.77:0/29491893 shutdown_connections 2023-11-04T01:42:54.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.208+0000 7fdc3c232640 1 -- 172.21.15.77:0/29491893 wait complete. 2023-11-04T01:42:54.220 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T01:42:54.221 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T01:42:54.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.322+0000 7fed6e17c640 1 Processor -- start 2023-11-04T01:42:54.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.323+0000 7fed6e17c640 1 -- start start 2023-11-04T01:42:54.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.323+0000 7fed6e17c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fed6806ded0 0x7fed680b0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.323+0000 7fed6e17c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fed680b08a0 0x7fed68164960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.323+0000 7fed6e17c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed6806c470 con 0x7fed6815ae40 2023-11-04T01:42:54.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.323+0000 7fed6e17c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed680b0d50 con 0x7fed680b08a0 2023-11-04T01:42:54.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.323+0000 7fed6e17c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed680b1a10 con 0x7fed6806ded0 2023-11-04T01:42:54.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.323+0000 7fed677fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fed6815ae40 0x7fed680706e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:47010/0 (socket says 172.21.15.77:47010) 2023-11-04T01:42:54.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.323+0000 7fed677fe640 1 -- 172.21.15.77:0/4288107014 learned_addr learned my addr 172.21.15.77:0/4288107014 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:54.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.324+0000 7fed67fff640 1 --2- 172.21.15.77:0/4288107014 >> v2:172.21.15.122:3300/0 conn(0x7fed680b08a0 0x7fed68164960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.324+0000 7fed66ffd640 1 --2- 172.21.15.77:0/4288107014 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fed6806ded0 0x7fed680b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.324+0000 7fed667fc640 1 -- 172.21.15.77:0/4288107014 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2554925419 0 0) 0x7fed6806c470 con 0x7fed6815ae40 2023-11-04T01:42:54.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.324+0000 7fed667fc640 1 -- 172.21.15.77:0/4288107014 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed50003520 con 0x7fed6815ae40 2023-11-04T01:42:54.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.324+0000 7fed667fc640 1 -- 172.21.15.77:0/4288107014 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3039493678 0 0) 0x7fed50003520 con 0x7fed6815ae40 2023-11-04T01:42:54.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.324+0000 7fed667fc640 1 -- 172.21.15.77:0/4288107014 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fed6806ded0 msgr2=0x7fed680b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:54.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.324+0000 7fed667fc640 1 --2- 172.21.15.77:0/4288107014 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fed6806ded0 0x7fed680b0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.324+0000 7fed667fc640 1 -- 172.21.15.77:0/4288107014 >> v2:172.21.15.122:3300/0 conn(0x7fed680b08a0 msgr2=0x7fed68164960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:54.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.324+0000 7fed667fc640 1 --2- 172.21.15.77:0/4288107014 >> v2:172.21.15.122:3300/0 conn(0x7fed680b08a0 0x7fed68164960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.324+0000 7fed667fc640 1 -- 172.21.15.77:0/4288107014 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6815b220 con 0x7fed6815ae40 2023-11-04T01:42:54.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.324+0000 7fed667fc640 1 -- 172.21.15.77:0/4288107014 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7fed58001670 con 0x7fed6815ae40 2023-11-04T01:42:54.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.324+0000 7fed667fc640 1 -- 172.21.15.77:0/4288107014 >> v1:172.21.15.77:6789/0 conn(0x7fed6815ae40 legacy=0x7fed680706e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.324+0000 7fed667fc640 1 --2- 172.21.15.77:0/4288107014 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed50003970 0x7fed50003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.324+0000 7fed667fc640 1 --2- 172.21.15.77:0/4288107014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed500047c0 0x7fed50004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.324+0000 7fed667fc640 1 --2- 172.21.15.77:0/4288107014 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fed6806ded0 0x7fed50005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.324+0000 7fed667fc640 1 -- 172.21.15.77:0/4288107014 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed680b0d50 con 0x7fed500047c0 2023-11-04T01:42:54.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.324+0000 7fed667fc640 1 -- 172.21.15.77:0/4288107014 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed680b1a10 con 0x7fed50003970 2023-11-04T01:42:54.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.324+0000 7fed667fc640 1 -- 172.21.15.77:0/4288107014 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed5000b980 con 0x7fed6806ded0 2023-11-04T01:42:54.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.324+0000 7fed66ffd640 1 --2- 172.21.15.77:0/4288107014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed500047c0 0x7fed50004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.324+0000 7fed677fe640 1 --2- 172.21.15.77:0/4288107014 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed50003970 0x7fed50003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.324+0000 7fed67fff640 1 --2- 172.21.15.77:0/4288107014 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fed6806ded0 0x7fed50005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.324+0000 7fed66ffd640 1 -- 172.21.15.77:0/4288107014 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fed6806ded0 msgr2=0x7fed50005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:54.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.324+0000 7fed66ffd640 1 --2- 172.21.15.77:0/4288107014 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fed6806ded0 0x7fed50005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.324+0000 7fed66ffd640 1 -- 172.21.15.77:0/4288107014 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed50003970 msgr2=0x7fed50003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:54.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.324+0000 7fed66ffd640 1 --2- 172.21.15.77:0/4288107014 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed50003970 0x7fed50003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.324+0000 7fed66ffd640 1 -- 172.21.15.77:0/4288107014 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed50003520 con 0x7fed500047c0 2023-11-04T01:42:54.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.325+0000 7fed66ffd640 1 --2- 172.21.15.77:0/4288107014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed500047c0 0x7fed50004c40 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fed5c009ac0 tx=0x7fed500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47083f25c0b4028 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:54.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.325+0000 7fed667fc640 1 -- 172.21.15.77:0/4288107014 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c02c6b0 con 0x7fed500047c0 2023-11-04T01:42:54.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.325+0000 7fed667fc640 1 -- 172.21.15.77:0/4288107014 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5c02c810 con 0x7fed500047c0 2023-11-04T01:42:54.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.325+0000 7fed667fc640 1 -- 172.21.15.77:0/4288107014 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c02cba0 con 0x7fed500047c0 2023-11-04T01:42:54.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.326+0000 7fed6e17c640 1 -- 172.21.15.77:0/4288107014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed500047c0 msgr2=0x7fed50004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.326+0000 7fed6e17c640 1 --2- 172.21.15.77:0/4288107014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed500047c0 0x7fed50004c40 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fed5c009ac0 tx=0x7fed500057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.326+0000 7fed67fff640 1 -- 172.21.15.77:0/4288107014 reap_dead start 2023-11-04T01:42:54.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.326+0000 7fed6e17c640 1 -- 172.21.15.77:0/4288107014 shutdown_connections 2023-11-04T01:42:54.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.326+0000 7fed6e17c640 1 -- 172.21.15.77:0/4288107014 >> 172.21.15.77:0/4288107014 conn(0x7fed680cb360 msgr2=0x7fed680cb740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:54.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.326+0000 7fed6e17c640 1 -- 172.21.15.77:0/4288107014 shutdown_connections 2023-11-04T01:42:54.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.326+0000 7fed6e17c640 1 -- 172.21.15.77:0/4288107014 wait complete. 2023-11-04T01:42:54.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.327+0000 7fed6e17c640 1 Processor -- start 2023-11-04T01:42:54.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.327+0000 7fed6e17c640 1 -- start start 2023-11-04T01:42:54.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.328+0000 7fed6e17c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed500047c0 0x7fed680c4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.328+0000 7fed6e17c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fed68156600 0x7fed6815be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.328+0000 7fed6e17c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed6814ff20 0x7fed681e49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.328+0000 7fed6e17c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6815b410 con 0x7fed6814ff20 2023-11-04T01:42:54.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.328+0000 7fed6e17c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed680c4370 con 0x7fed500047c0 2023-11-04T01:42:54.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.328+0000 7fed6e17c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed680c4650 con 0x7fed68156600 2023-11-04T01:42:54.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.328+0000 7fed67fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed6814ff20 0x7fed681e49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.328+0000 7fed67fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed6814ff20 0x7fed681e49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38852/0 (socket says 172.21.15.77:38852) 2023-11-04T01:42:54.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.328+0000 7fed67fff640 1 -- 172.21.15.77:0/3406278491 learned_addr learned my addr 172.21.15.77:0/3406278491 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:54.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.328+0000 7fed677fe640 1 --2- 172.21.15.77:0/3406278491 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed500047c0 0x7fed680c4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.328+0000 7fed66ffd640 1 --2- 172.21.15.77:0/3406278491 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fed68156600 0x7fed6815be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.328+0000 7fed67fff640 1 -- 172.21.15.77:0/3406278491 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fed68156600 msgr2=0x7fed6815be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.328+0000 7fed67fff640 1 --2- 172.21.15.77:0/3406278491 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fed68156600 0x7fed6815be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.328+0000 7fed67fff640 1 -- 172.21.15.77:0/3406278491 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed500047c0 msgr2=0x7fed680c4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.328+0000 7fed67fff640 1 --2- 172.21.15.77:0/3406278491 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed500047c0 0x7fed680c4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.328+0000 7fed67fff640 1 -- 172.21.15.77:0/3406278491 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6815b660 con 0x7fed6814ff20 2023-11-04T01:42:54.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.328+0000 7fed677fe640 1 --2- 172.21.15.77:0/3406278491 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed500047c0 0x7fed680c4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:54.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.329+0000 7fed67fff640 1 --2- 172.21.15.77:0/3406278491 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed6814ff20 0x7fed681e49b0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fed6815e890 tx=0x7fed6000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:54.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.329+0000 7fed4ffff640 1 -- 172.21.15.77:0/3406278491 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6000e040 con 0x7fed6814ff20 2023-11-04T01:42:54.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.329+0000 7fed4ffff640 1 -- 172.21.15.77:0/3406278491 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed6000f040 con 0x7fed6814ff20 2023-11-04T01:42:54.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.329+0000 7fed6e17c640 1 -- 172.21.15.77:0/3406278491 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed6815b940 con 0x7fed6814ff20 2023-11-04T01:42:54.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.329+0000 7fed4ffff640 1 -- 172.21.15.77:0/3406278491 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed60015430 con 0x7fed6814ff20 2023-11-04T01:42:54.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.329+0000 7fed6e17c640 1 -- 172.21.15.77:0/3406278491 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed680c3fd0 con 0x7fed6814ff20 2023-11-04T01:42:54.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.329+0000 7fed6e17c640 1 -- 172.21.15.77:0/3406278491 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed680c4810 con 0x7fed6814ff20 2023-11-04T01:42:54.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.330+0000 7fed4ffff640 1 -- 172.21.15.77:0/3406278491 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fed60015590 con 0x7fed6814ff20 2023-11-04T01:42:54.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.330+0000 7fed4ffff640 1 --2- 172.21.15.77:0/3406278491 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fed5406aea0 0x7fed5406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.331+0000 7fed4ffff640 1 -- 172.21.15.77:0/3406278491 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6240+0+0 (secure 0 0 0) 0x7fed60089f00 con 0x7fed6814ff20 2023-11-04T01:42:54.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.331+0000 7fed677fe640 1 --2- 172.21.15.77:0/3406278491 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fed5406aea0 0x7fed5406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.331+0000 7fed677fe640 1 --2- 172.21.15.77:0/3406278491 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fed5406aea0 0x7fed5406d360 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fed58007d50 tx=0x7fed58009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:54.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.335+0000 7fed4ffff640 1 -- 172.21.15.77:0/3406278491 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fed60054e30 con 0x7fed6814ff20 2023-11-04T01:42:54.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:54.500+0000 7fed6e17c640 1 -- 172.21.15.77:0/3406278491 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fed680cb970 con 0x7fed6814ff20 2023-11-04T01:42:55.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.075+0000 7fed4ffff640 1 -- 172.21.15.77:0/3406278491 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v80) v1 ==== 138+0+0 (secure 0 0 0) 0x7fed60058450 con 0x7fed6814ff20 2023-11-04T01:42:55.077 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_metadata' created 2023-11-04T01:42:55.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.077+0000 7fed6e17c640 1 -- 172.21.15.77:0/3406278491 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fed5406aea0 msgr2=0x7fed5406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.077+0000 7fed6e17c640 1 --2- 172.21.15.77:0/3406278491 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fed5406aea0 0x7fed5406d360 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fed58007d50 tx=0x7fed58009040 comp rx=0 tx=0).stop 2023-11-04T01:42:55.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.077+0000 7fed6e17c640 1 -- 172.21.15.77:0/3406278491 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed6814ff20 msgr2=0x7fed681e49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.077+0000 7fed6e17c640 1 --2- 172.21.15.77:0/3406278491 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed6814ff20 0x7fed681e49b0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fed6815e890 tx=0x7fed6000f580 comp rx=0 tx=0).stop 2023-11-04T01:42:55.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.077+0000 7fed6e17c640 1 -- 172.21.15.77:0/3406278491 shutdown_connections 2023-11-04T01:42:55.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.077+0000 7fed6e17c640 1 --2- 172.21.15.77:0/3406278491 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fed5406aea0 0x7fed5406d360 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.077+0000 7fed6e17c640 1 --2- 172.21.15.77:0/3406278491 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed6814ff20 0x7fed681e49b0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.077+0000 7fed6e17c640 1 --2- 172.21.15.77:0/3406278491 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fed68156600 0x7fed6815be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.077+0000 7fed6e17c640 1 --2- 172.21.15.77:0/3406278491 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed500047c0 0x7fed680c4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.077+0000 7fed6e17c640 1 -- 172.21.15.77:0/3406278491 >> 172.21.15.77:0/3406278491 conn(0x7fed680cb360 msgr2=0x7fed680b31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:55.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.077+0000 7fed6e17c640 1 -- 172.21.15.77:0/3406278491 shutdown_connections 2023-11-04T01:42:55.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.078+0000 7fed6e17c640 1 -- 172.21.15.77:0/3406278491 wait complete. 2023-11-04T01:42:55.095 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T01:42:55.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.200+0000 7f8a603fb640 1 Processor -- start 2023-11-04T01:42:55.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.200+0000 7f8a603fb640 1 -- start start 2023-11-04T01:42:55.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.201+0000 7f8a603fb640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8a58070e20 0x7f8a580adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.201+0000 7f8a603fb640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8a580ad730 0x7f8a5815e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.201+0000 7f8a603fb640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a580c3900 con 0x7f8a5815ad30 2023-11-04T01:42:55.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.201+0000 7f8a603fb640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a580ae260 con 0x7f8a58070e20 2023-11-04T01:42:55.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.201+0000 7f8a603fb640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a580c3be0 con 0x7f8a580ad730 2023-11-04T01:42:55.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.201+0000 7f8a5e197640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f8a5815ad30 0x7f8a58070710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:47014/0 (socket says 172.21.15.77:47014) 2023-11-04T01:42:55.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.201+0000 7f8a5e197640 1 -- 172.21.15.77:0/1774273842 learned_addr learned my addr 172.21.15.77:0/1774273842 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:55.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.201+0000 7f8a5d996640 1 --2- 172.21.15.77:0/1774273842 >> v2:172.21.15.122:3300/0 conn(0x7f8a58070e20 0x7f8a580adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.201+0000 7f8a5e998640 1 --2- 172.21.15.77:0/1774273842 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8a580ad730 0x7f8a5815e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.201+0000 7f8a5d195640 1 -- 172.21.15.77:0/1774273842 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 36366322 0 0) 0x7f8a580c3900 con 0x7f8a5815ad30 2023-11-04T01:42:55.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.201+0000 7f8a5d195640 1 -- 172.21.15.77:0/1774273842 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a44003520 con 0x7f8a5815ad30 2023-11-04T01:42:55.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.201+0000 7f8a5d195640 1 -- 172.21.15.77:0/1774273842 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1703484890 0 0) 0x7f8a44003520 con 0x7f8a5815ad30 2023-11-04T01:42:55.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.201+0000 7f8a5d195640 1 -- 172.21.15.77:0/1774273842 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8a580ad730 msgr2=0x7f8a5815e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:55.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.201+0000 7f8a5d195640 1 --2- 172.21.15.77:0/1774273842 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8a580ad730 0x7f8a5815e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.201+0000 7f8a5d195640 1 -- 172.21.15.77:0/1774273842 >> v2:172.21.15.122:3300/0 conn(0x7f8a58070e20 msgr2=0x7f8a580adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:55.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.201+0000 7f8a5d195640 1 --2- 172.21.15.77:0/1774273842 >> v2:172.21.15.122:3300/0 conn(0x7f8a58070e20 0x7f8a580adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.201+0000 7f8a5d195640 1 -- 172.21.15.77:0/1774273842 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a580c3ec0 con 0x7f8a5815ad30 2023-11-04T01:42:55.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.201+0000 7f8a5d195640 1 -- 172.21.15.77:0/1774273842 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f8a54001670 con 0x7f8a5815ad30 2023-11-04T01:42:55.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.201+0000 7f8a5d195640 1 -- 172.21.15.77:0/1774273842 >> v1:172.21.15.77:6789/0 conn(0x7f8a5815ad30 legacy=0x7f8a58070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.201+0000 7f8a5d195640 1 --2- 172.21.15.77:0/1774273842 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8a580ad730 0x7f8a44003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.201+0000 7f8a5d195640 1 --2- 172.21.15.77:0/1774273842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a44003ef0 0x7f8a440047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.201+0000 7f8a5d195640 1 --2- 172.21.15.77:0/1774273842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a44004d00 0x7f8a44005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.202+0000 7f8a5d195640 1 -- 172.21.15.77:0/1774273842 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a580ae260 con 0x7f8a44004d00 2023-11-04T01:42:55.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.202+0000 7f8a5d195640 1 -- 172.21.15.77:0/1774273842 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a580c3be0 con 0x7f8a44003ef0 2023-11-04T01:42:55.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.202+0000 7f8a5d195640 1 -- 172.21.15.77:0/1774273842 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4400b9d0 con 0x7f8a580ad730 2023-11-04T01:42:55.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.202+0000 7f8a5e998640 1 --2- 172.21.15.77:0/1774273842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a44004d00 0x7f8a44005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.202+0000 7f8a5d996640 1 --2- 172.21.15.77:0/1774273842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a44003ef0 0x7f8a440047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.202+0000 7f8a5e197640 1 --2- 172.21.15.77:0/1774273842 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8a580ad730 0x7f8a44003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.202+0000 7f8a5e998640 1 -- 172.21.15.77:0/1774273842 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8a580ad730 msgr2=0x7f8a44003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:55.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.202+0000 7f8a5e998640 1 --2- 172.21.15.77:0/1774273842 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8a580ad730 0x7f8a44003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.202+0000 7f8a5e998640 1 -- 172.21.15.77:0/1774273842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a44003ef0 msgr2=0x7f8a440047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:55.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.202+0000 7f8a5e998640 1 --2- 172.21.15.77:0/1774273842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a44003ef0 0x7f8a440047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.202+0000 7f8a5e998640 1 -- 172.21.15.77:0/1774273842 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a44003520 con 0x7f8a44004d00 2023-11-04T01:42:55.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.203+0000 7f8a5e998640 1 --2- 172.21.15.77:0/1774273842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a44004d00 0x7f8a44005180 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000e170 tx=0x7f8a440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=285faf78a2740f0b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:55.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.203+0000 7f8a5d195640 1 -- 172.21.15.77:0/1774273842 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5002cbf0 con 0x7f8a44004d00 2023-11-04T01:42:55.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.203+0000 7f8a5d195640 1 -- 172.21.15.77:0/1774273842 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5000f040 con 0x7f8a44004d00 2023-11-04T01:42:55.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.203+0000 7f8a5d195640 1 -- 172.21.15.77:0/1774273842 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a50034440 con 0x7f8a44004d00 2023-11-04T01:42:55.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.203+0000 7f8a603fb640 1 -- 172.21.15.77:0/1774273842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a44004d00 msgr2=0x7f8a44005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.203+0000 7f8a603fb640 1 --2- 172.21.15.77:0/1774273842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a44004d00 0x7f8a44005180 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000e170 tx=0x7f8a440057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.203+0000 7f8a5e998640 1 -- 172.21.15.77:0/1774273842 reap_dead start 2023-11-04T01:42:55.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.203+0000 7f8a603fb640 1 -- 172.21.15.77:0/1774273842 shutdown_connections 2023-11-04T01:42:55.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.203+0000 7f8a603fb640 1 -- 172.21.15.77:0/1774273842 >> 172.21.15.77:0/1774273842 conn(0x7f8a580ce950 msgr2=0x7f8a580ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:55.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.203+0000 7f8a603fb640 1 -- 172.21.15.77:0/1774273842 shutdown_connections 2023-11-04T01:42:55.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.203+0000 7f8a603fb640 1 -- 172.21.15.77:0/1774273842 wait complete. 2023-11-04T01:42:55.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.204+0000 7f8a603fb640 1 Processor -- start 2023-11-04T01:42:55.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.205+0000 7f8a603fb640 1 -- start start 2023-11-04T01:42:55.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.205+0000 7f8a603fb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a44004d00 0x7f8a581421a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.205+0000 7f8a603fb640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8a581426e0 0x7f8a580c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.205+0000 7f8a603fb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a580c7fc0 0x7f8a58151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.205+0000 7f8a603fb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a580c8470 con 0x7f8a44004d00 2023-11-04T01:42:55.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.205+0000 7f8a603fb640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a58141f10 con 0x7f8a580c7fc0 2023-11-04T01:42:55.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.205+0000 7f8a603fb640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a580c6a70 con 0x7f8a581426e0 2023-11-04T01:42:55.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.205+0000 7f8a5e197640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a44004d00 0x7f8a581421a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.205+0000 7f8a5e197640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a44004d00 0x7f8a581421a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38868/0 (socket says 172.21.15.77:38868) 2023-11-04T01:42:55.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.205+0000 7f8a5e197640 1 -- 172.21.15.77:0/1851565908 learned_addr learned my addr 172.21.15.77:0/1851565908 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:55.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.206+0000 7f8a5e197640 1 -- 172.21.15.77:0/1851565908 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8a581426e0 msgr2=0x7f8a580c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.206+0000 7f8a5e197640 1 --2- 172.21.15.77:0/1851565908 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8a581426e0 0x7f8a580c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.206+0000 7f8a5e998640 1 --2- 172.21.15.77:0/1851565908 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a580c7fc0 0x7f8a58151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.206+0000 7f8a5e197640 1 -- 172.21.15.77:0/1851565908 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a580c7fc0 msgr2=0x7f8a58151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.206+0000 7f8a5e197640 1 --2- 172.21.15.77:0/1851565908 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a580c7fc0 0x7f8a58151ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.206+0000 7f8a5e197640 1 -- 172.21.15.77:0/1851565908 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a580c6cc0 con 0x7f8a44004d00 2023-11-04T01:42:55.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.206+0000 7f8a5e197640 1 --2- 172.21.15.77:0/1851565908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a44004d00 0x7f8a581421a0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f8a54007310 tx=0x7f8a540077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:55.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.206+0000 7f8a4effd640 1 -- 172.21.15.77:0/1851565908 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5400fa20 con 0x7f8a44004d00 2023-11-04T01:42:55.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.206+0000 7f8a4effd640 1 -- 172.21.15.77:0/1851565908 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5400fb80 con 0x7f8a44004d00 2023-11-04T01:42:55.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.206+0000 7f8a603fb640 1 -- 172.21.15.77:0/1851565908 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a580c6fa0 con 0x7f8a44004d00 2023-11-04T01:42:55.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.206+0000 7f8a4effd640 1 -- 172.21.15.77:0/1851565908 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a540133f0 con 0x7f8a44004d00 2023-11-04T01:42:55.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.206+0000 7f8a603fb640 1 -- 172.21.15.77:0/1851565908 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a580c7560 con 0x7f8a44004d00 2023-11-04T01:42:55.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.207+0000 7f8a603fb640 1 -- 172.21.15.77:0/1851565908 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a58074290 con 0x7f8a44004d00 2023-11-04T01:42:55.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.207+0000 7f8a4effd640 1 -- 172.21.15.77:0/1851565908 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8a54013550 con 0x7f8a44004d00 2023-11-04T01:42:55.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.208+0000 7f8a4effd640 1 --2- 172.21.15.77:0/1851565908 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8a3c06ae70 0x7f8a3c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.208+0000 7f8a4effd640 1 -- 172.21.15.77:0/1851565908 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6610+0+0 (secure 0 0 0) 0x7f8a54089d50 con 0x7f8a44004d00 2023-11-04T01:42:55.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.208+0000 7f8a5d996640 1 --2- 172.21.15.77:0/1851565908 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8a3c06ae70 0x7f8a3c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.209+0000 7f8a5d996640 1 --2- 172.21.15.77:0/1851565908 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8a3c06ae70 0x7f8a3c06d330 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8a48006b10 tx=0x7f8a48006aa0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:55.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.212+0000 7f8a4effd640 1 -- 172.21.15.77:0/1851565908 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8a5408d030 con 0x7f8a44004d00 2023-11-04T01:42:55.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:55.377+0000 7f8a603fb640 1 -- 172.21.15.77:0/1851565908 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8a58071970 con 0x7f8a44004d00 2023-11-04T01:42:56.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.078+0000 7f8a4effd640 1 -- 172.21.15.77:0/1851565908 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v81) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8a54054a70 con 0x7f8a44004d00 2023-11-04T01:42:56.081 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data' created 2023-11-04T01:42:56.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.081+0000 7f8a603fb640 1 -- 172.21.15.77:0/1851565908 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8a3c06ae70 msgr2=0x7f8a3c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.081+0000 7f8a603fb640 1 --2- 172.21.15.77:0/1851565908 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8a3c06ae70 0x7f8a3c06d330 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8a48006b10 tx=0x7f8a48006aa0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.081+0000 7f8a603fb640 1 -- 172.21.15.77:0/1851565908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a44004d00 msgr2=0x7f8a581421a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.081+0000 7f8a603fb640 1 --2- 172.21.15.77:0/1851565908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a44004d00 0x7f8a581421a0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f8a54007310 tx=0x7f8a540077d0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.081+0000 7f8a603fb640 1 -- 172.21.15.77:0/1851565908 shutdown_connections 2023-11-04T01:42:56.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.081+0000 7f8a603fb640 1 --2- 172.21.15.77:0/1851565908 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8a3c06ae70 0x7f8a3c06d330 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.081+0000 7f8a603fb640 1 --2- 172.21.15.77:0/1851565908 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a580c7fc0 0x7f8a58151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.081+0000 7f8a603fb640 1 --2- 172.21.15.77:0/1851565908 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8a581426e0 0x7f8a580c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.081+0000 7f8a603fb640 1 --2- 172.21.15.77:0/1851565908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a44004d00 0x7f8a581421a0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.081+0000 7f8a603fb640 1 -- 172.21.15.77:0/1851565908 >> 172.21.15.77:0/1851565908 conn(0x7f8a580ce950 msgr2=0x7f8a580ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:56.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.081+0000 7f8a603fb640 1 -- 172.21.15.77:0/1851565908 shutdown_connections 2023-11-04T01:42:56.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.081+0000 7f8a603fb640 1 -- 172.21.15.77:0/1851565908 wait complete. 2023-11-04T01:42:56.109 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T01:42:56.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.211+0000 7f787c4ec640 1 Processor -- start 2023-11-04T01:42:56.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.212+0000 7f787c4ec640 1 -- start start 2023-11-04T01:42:56.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.213+0000 7f787c4ec640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f78740c4ff0 0x7f78740cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.213+0000 7f787c4ec640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f78740adac0 0x7f78740adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.213+0000 7f787c4ec640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f787415aff0 con 0x7f7874159c00 2023-11-04T01:42:56.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.213+0000 7f787c4ec640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78740ae450 con 0x7f78740adac0 2023-11-04T01:42:56.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.213+0000 7f787c4ec640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787415a3e0 con 0x7f78740c4ff0 2023-11-04T01:42:56.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.213+0000 7f787a288640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f7874159c00 0x7f78740c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:47020/0 (socket says 172.21.15.77:47020) 2023-11-04T01:42:56.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.213+0000 7f787a288640 1 -- 172.21.15.77:0/3911663525 learned_addr learned my addr 172.21.15.77:0/3911663525 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:56.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.213+0000 7f7879a87640 1 --2- 172.21.15.77:0/3911663525 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f78740c4ff0 0x7f78740cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.213+0000 7f787aa89640 1 --2- 172.21.15.77:0/3911663525 >> v2:172.21.15.122:3300/0 conn(0x7f78740adac0 0x7f78740adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.213+0000 7f7879286640 1 -- 172.21.15.77:0/3911663525 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1190445562 0 0) 0x7f787415aff0 con 0x7f7874159c00 2023-11-04T01:42:56.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.213+0000 7f7879286640 1 -- 172.21.15.77:0/3911663525 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7860003520 con 0x7f7874159c00 2023-11-04T01:42:56.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.213+0000 7f7879286640 1 -- 172.21.15.77:0/3911663525 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 552606786 0 0) 0x7f7860003520 con 0x7f7874159c00 2023-11-04T01:42:56.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.213+0000 7f7879286640 1 -- 172.21.15.77:0/3911663525 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f78740c4ff0 msgr2=0x7f78740cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:56.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.213+0000 7f7879286640 1 --2- 172.21.15.77:0/3911663525 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f78740c4ff0 0x7f78740cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.213+0000 7f7879286640 1 -- 172.21.15.77:0/3911663525 >> v2:172.21.15.122:3300/0 conn(0x7f78740adac0 msgr2=0x7f78740adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:56.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.213+0000 7f7879286640 1 --2- 172.21.15.77:0/3911663525 >> v2:172.21.15.122:3300/0 conn(0x7f78740adac0 0x7f78740adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.213+0000 7f7879286640 1 -- 172.21.15.77:0/3911663525 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787415a6c0 con 0x7f7874159c00 2023-11-04T01:42:56.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.213+0000 7f7879286640 1 -- 172.21.15.77:0/3911663525 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f7870001670 con 0x7f7874159c00 2023-11-04T01:42:56.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.213+0000 7f787aa89640 1 --2- 172.21.15.77:0/3911663525 >> v2:172.21.15.122:3300/0 conn(0x7f78740adac0 0x7f78740adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:56.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.213+0000 7f7879286640 1 -- 172.21.15.77:0/3911663525 >> v1:172.21.15.77:6789/0 conn(0x7f7874159c00 legacy=0x7f78740c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.213+0000 7f7879286640 1 --2- 172.21.15.77:0/3911663525 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f78740c4ff0 0x7f7860003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.213+0000 7f7879286640 1 --2- 172.21.15.77:0/3911663525 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7860003ef0 0x7f78600047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.213+0000 7f7879286640 1 --2- 172.21.15.77:0/3911663525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7860004d00 0x7f7860005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.213+0000 7f7879286640 1 -- 172.21.15.77:0/3911663525 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78740ae450 con 0x7f7860004d00 2023-11-04T01:42:56.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.213+0000 7f7879286640 1 -- 172.21.15.77:0/3911663525 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787415a3e0 con 0x7f7860003ef0 2023-11-04T01:42:56.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.213+0000 7f7879286640 1 -- 172.21.15.77:0/3911663525 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f786000b980 con 0x7f78740c4ff0 2023-11-04T01:42:56.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.213+0000 7f787aa89640 1 --2- 172.21.15.77:0/3911663525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7860004d00 0x7f7860005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.213+0000 7f7879a87640 1 --2- 172.21.15.77:0/3911663525 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7860003ef0 0x7f78600047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.213+0000 7f787a288640 1 --2- 172.21.15.77:0/3911663525 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f78740c4ff0 0x7f7860003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.214+0000 7f787aa89640 1 -- 172.21.15.77:0/3911663525 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f78740c4ff0 msgr2=0x7f7860003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:56.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.214+0000 7f787aa89640 1 --2- 172.21.15.77:0/3911663525 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f78740c4ff0 0x7f7860003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.214+0000 7f787aa89640 1 -- 172.21.15.77:0/3911663525 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7860003ef0 msgr2=0x7f78600047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:56.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.214+0000 7f787aa89640 1 --2- 172.21.15.77:0/3911663525 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7860003ef0 0x7f78600047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.214+0000 7f787aa89640 1 -- 172.21.15.77:0/3911663525 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7860003520 con 0x7f7860004d00 2023-11-04T01:42:56.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.214+0000 7f787aa89640 1 --2- 172.21.15.77:0/3911663525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7860004d00 0x7f7860005180 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f786c00e350 tx=0x7f78600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=224989ed8ad70d9f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:56.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.214+0000 7f7879286640 1 -- 172.21.15.77:0/3911663525 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c02cdf0 con 0x7f7860004d00 2023-11-04T01:42:56.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.215+0000 7f7879286640 1 -- 172.21.15.77:0/3911663525 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786c00f040 con 0x7f7860004d00 2023-11-04T01:42:56.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.215+0000 7f7879286640 1 -- 172.21.15.77:0/3911663525 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c034640 con 0x7f7860004d00 2023-11-04T01:42:56.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.215+0000 7f787c4ec640 1 -- 172.21.15.77:0/3911663525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7860004d00 msgr2=0x7f7860005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.215+0000 7f787c4ec640 1 --2- 172.21.15.77:0/3911663525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7860004d00 0x7f7860005180 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f786c00e350 tx=0x7f78600057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.215+0000 7f787aa89640 1 -- 172.21.15.77:0/3911663525 reap_dead start 2023-11-04T01:42:56.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.215+0000 7f787c4ec640 1 -- 172.21.15.77:0/3911663525 shutdown_connections 2023-11-04T01:42:56.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.215+0000 7f787c4ec640 1 -- 172.21.15.77:0/3911663525 >> 172.21.15.77:0/3911663525 conn(0x7f78740ce950 msgr2=0x7f78740ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:56.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.215+0000 7f787c4ec640 1 -- 172.21.15.77:0/3911663525 shutdown_connections 2023-11-04T01:42:56.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.215+0000 7f787c4ec640 1 -- 172.21.15.77:0/3911663525 wait complete. 2023-11-04T01:42:56.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.216+0000 7f787c4ec640 1 Processor -- start 2023-11-04T01:42:56.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.216+0000 7f787c4ec640 1 -- start start 2023-11-04T01:42:56.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.217+0000 7f787c4ec640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7860004d00 0x7f7874151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.217+0000 7f787c4ec640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78741f1010 0x7f7874154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.217+0000 7f787c4ec640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7874140fe0 0x7f78740c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.217+0000 7f787c4ec640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78741f02f0 con 0x7f7860004d00 2023-11-04T01:42:56.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.217+0000 7f787c4ec640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7874155aa0 con 0x7f78741f1010 2023-11-04T01:42:56.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.217+0000 7f787c4ec640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7874152670 con 0x7f7874140fe0 2023-11-04T01:42:56.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.217+0000 7f787a288640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7860004d00 0x7f7874151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.217+0000 7f787a288640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7860004d00 0x7f7874151fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38886/0 (socket says 172.21.15.77:38886) 2023-11-04T01:42:56.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.217+0000 7f787a288640 1 -- 172.21.15.77:0/648316766 learned_addr learned my addr 172.21.15.77:0/648316766 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:56.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.217+0000 7f7879a87640 1 --2- 172.21.15.77:0/648316766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78741f1010 0x7f7874154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.217+0000 7f787aa89640 1 --2- 172.21.15.77:0/648316766 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7874140fe0 0x7f78740c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.217+0000 7f787a288640 1 -- 172.21.15.77:0/648316766 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7874140fe0 msgr2=0x7f78740c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.217+0000 7f787a288640 1 --2- 172.21.15.77:0/648316766 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7874140fe0 0x7f78740c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.217+0000 7f787a288640 1 -- 172.21.15.77:0/648316766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78741f1010 msgr2=0x7f7874154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.217+0000 7f787a288640 1 --2- 172.21.15.77:0/648316766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78741f1010 0x7f7874154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.217+0000 7f787a288640 1 -- 172.21.15.77:0/648316766 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78741f0530 con 0x7f7860004d00 2023-11-04T01:42:56.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.217+0000 7f787aa89640 1 --2- 172.21.15.77:0/648316766 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7874140fe0 0x7f78740c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:56.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.218+0000 7f787a288640 1 --2- 172.21.15.77:0/648316766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7860004d00 0x7f7874151fd0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f7870007340 tx=0x7f7870007740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:56.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.218+0000 7f786affd640 1 -- 172.21.15.77:0/648316766 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787000f8e0 con 0x7f7860004d00 2023-11-04T01:42:56.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.218+0000 7f786affd640 1 -- 172.21.15.77:0/648316766 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787000fa60 con 0x7f7860004d00 2023-11-04T01:42:56.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.218+0000 7f787c4ec640 1 -- 172.21.15.77:0/648316766 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78741f0810 con 0x7f7860004d00 2023-11-04T01:42:56.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.218+0000 7f786affd640 1 -- 172.21.15.77:0/648316766 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787000fe10 con 0x7f7860004d00 2023-11-04T01:42:56.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.218+0000 7f787c4ec640 1 -- 172.21.15.77:0/648316766 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7874141460 con 0x7f7860004d00 2023-11-04T01:42:56.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.219+0000 7f787c4ec640 1 -- 172.21.15.77:0/648316766 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78741f0d30 con 0x7f7860004d00 2023-11-04T01:42:56.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.219+0000 7f786affd640 1 -- 172.21.15.77:0/648316766 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f787001d460 con 0x7f7860004d00 2023-11-04T01:42:56.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.220+0000 7f786affd640 1 --2- 172.21.15.77:0/648316766 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f785806ae70 0x7f785806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.220+0000 7f786affd640 1 -- 172.21.15.77:0/648316766 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6992+0+0 (secure 0 0 0) 0x7f7870089d80 con 0x7f7860004d00 2023-11-04T01:42:56.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.220+0000 7f7879a87640 1 --2- 172.21.15.77:0/648316766 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f785806ae70 0x7f785806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.220+0000 7f7879a87640 1 --2- 172.21.15.77:0/648316766 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f785806ae70 0x7f785806d330 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f78741edf30 tx=0x7f7864009190 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:56.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.224+0000 7f786affd640 1 -- 172.21.15.77:0/648316766 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f78741f0d30 con 0x7f7860004d00 2023-11-04T01:42:56.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:56.425+0000 7f787c4ec640 1 -- 172.21.15.77:0/648316766 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f78741f0d30 con 0x7f7860004d00 2023-11-04T01:42:57.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.091+0000 7f786affd640 1 -- 172.21.15.77:0/648316766 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v33) v1 ==== 174+0+0 (secure 0 0 0) 0x7f78741f0d30 con 0x7f7860004d00 2023-11-04T01:42:57.094 INFO:teuthology.orchestra.run.smithi077.stderr:new fs with metadata pool 14 and data pool 15 2023-11-04T01:42:57.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.093+0000 7f787c4ec640 1 -- 172.21.15.77:0/648316766 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f785806ae70 msgr2=0x7f785806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.093+0000 7f787c4ec640 1 --2- 172.21.15.77:0/648316766 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f785806ae70 0x7f785806d330 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f78741edf30 tx=0x7f7864009190 comp rx=0 tx=0).stop 2023-11-04T01:42:57.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.093+0000 7f787c4ec640 1 -- 172.21.15.77:0/648316766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7860004d00 msgr2=0x7f7874151fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.093+0000 7f787c4ec640 1 --2- 172.21.15.77:0/648316766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7860004d00 0x7f7874151fd0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f7870007340 tx=0x7f7870007740 comp rx=0 tx=0).stop 2023-11-04T01:42:57.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.093+0000 7f787c4ec640 1 -- 172.21.15.77:0/648316766 shutdown_connections 2023-11-04T01:42:57.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.093+0000 7f787c4ec640 1 --2- 172.21.15.77:0/648316766 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f785806ae70 0x7f785806d330 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.093+0000 7f787c4ec640 1 --2- 172.21.15.77:0/648316766 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7874140fe0 0x7f78740c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.093+0000 7f787c4ec640 1 --2- 172.21.15.77:0/648316766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78741f1010 0x7f7874154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.093+0000 7f787c4ec640 1 --2- 172.21.15.77:0/648316766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7860004d00 0x7f7874151fd0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.094+0000 7f787c4ec640 1 -- 172.21.15.77:0/648316766 >> 172.21.15.77:0/648316766 conn(0x7f78740ce950 msgr2=0x7f78740711e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:57.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.094+0000 7f787c4ec640 1 -- 172.21.15.77:0/648316766 shutdown_connections 2023-11-04T01:42:57.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.094+0000 7f787c4ec640 1 -- 172.21.15.77:0/648316766 wait complete. 2023-11-04T01:42:57.110 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:57.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.209+0000 7f8c4cf25640 1 Processor -- start 2023-11-04T01:42:57.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.209+0000 7f8c4cf25640 1 -- start start 2023-11-04T01:42:57.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.209+0000 7f8c4cf25640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8c48159c70 0x7f8c480ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.209+0000 7f8c4cf25640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8c4806db20 0x7f8c480b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.209+0000 7f8c4cf25640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8c480b0910 0x7f8c4815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.209+0000 7f8c4cf25640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c480b49b0 con 0x7f8c480b0910 2023-11-04T01:42:57.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.209+0000 7f8c4cf25640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c480b0da0 con 0x7f8c48159c70 2023-11-04T01:42:57.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.209+0000 7f8c4cf25640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c480b4110 con 0x7f8c4806db20 2023-11-04T01:42:57.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.210+0000 7f8c46d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8c480b0910 0x7f8c4815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.210+0000 7f8c46d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8c480b0910 0x7f8c4815d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38898/0 (socket says 172.21.15.77:38898) 2023-11-04T01:42:57.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.210+0000 7f8c46d9d640 1 -- 172.21.15.77:0/3999677697 learned_addr learned my addr 172.21.15.77:0/3999677697 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:57.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.210+0000 7f8c4659c640 1 --2- 172.21.15.77:0/3999677697 >> v2:172.21.15.122:3300/0 conn(0x7f8c48159c70 0x7f8c480ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.210+0000 7f8c45d9b640 1 --2- 172.21.15.77:0/3999677697 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8c4806db20 0x7f8c480b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.210+0000 7f8c46d9d640 1 -- 172.21.15.77:0/3999677697 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8c4806db20 msgr2=0x7f8c480b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:57.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.210+0000 7f8c46d9d640 1 --2- 172.21.15.77:0/3999677697 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8c4806db20 0x7f8c480b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.210+0000 7f8c46d9d640 1 -- 172.21.15.77:0/3999677697 >> v2:172.21.15.122:3300/0 conn(0x7f8c48159c70 msgr2=0x7f8c480ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:57.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.210+0000 7f8c46d9d640 1 --2- 172.21.15.77:0/3999677697 >> v2:172.21.15.122:3300/0 conn(0x7f8c48159c70 0x7f8c480ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.210+0000 7f8c46d9d640 1 -- 172.21.15.77:0/3999677697 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c480b43f0 con 0x7f8c480b0910 2023-11-04T01:42:57.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.211+0000 7f8c46d9d640 1 --2- 172.21.15.77:0/3999677697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c480b0910 0x7f8c4815d7d0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f8c480cc440 tx=0x7f8c3802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fee9aa6641c18cbe server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:57.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.211+0000 7f8c4559a640 1 -- 172.21.15.77:0/3999677697 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c38031870 con 0x7f8c480b0910 2023-11-04T01:42:57.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.211+0000 7f8c4559a640 1 -- 172.21.15.77:0/3999677697 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c380319d0 con 0x7f8c480b0910 2023-11-04T01:42:57.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.211+0000 7f8c4559a640 1 -- 172.21.15.77:0/3999677697 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c38031d60 con 0x7f8c480b0910 2023-11-04T01:42:57.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.211+0000 7f8c4cf25640 1 -- 172.21.15.77:0/3999677697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c480b0910 msgr2=0x7f8c4815d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.211+0000 7f8c4cf25640 1 --2- 172.21.15.77:0/3999677697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c480b0910 0x7f8c4815d7d0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f8c480cc440 tx=0x7f8c3802b910 comp rx=0 tx=0).stop 2023-11-04T01:42:57.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.211+0000 7f8c4cf25640 1 -- 172.21.15.77:0/3999677697 shutdown_connections 2023-11-04T01:42:57.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.211+0000 7f8c4cf25640 1 --2- 172.21.15.77:0/3999677697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c480b0910 0x7f8c4815d7d0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.211+0000 7f8c4cf25640 1 --2- 172.21.15.77:0/3999677697 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8c4806db20 0x7f8c480b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.211+0000 7f8c4cf25640 1 --2- 172.21.15.77:0/3999677697 >> v2:172.21.15.122:3300/0 conn(0x7f8c48159c70 0x7f8c480ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.211+0000 7f8c4cf25640 1 -- 172.21.15.77:0/3999677697 >> 172.21.15.77:0/3999677697 conn(0x7f8c480ce950 msgr2=0x7f8c480ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:57.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.211+0000 7f8c4cf25640 1 -- 172.21.15.77:0/3999677697 shutdown_connections 2023-11-04T01:42:57.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.212+0000 7f8c4cf25640 1 -- 172.21.15.77:0/3999677697 wait complete. 2023-11-04T01:42:57.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.213+0000 7f8c4cf25640 1 Processor -- start 2023-11-04T01:42:57.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.213+0000 7f8c4cf25640 1 -- start start 2023-11-04T01:42:57.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.213+0000 7f8c4cf25640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c4806db20 0x7f8c481f6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.213+0000 7f8c4cf25640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c480b0910 0x7f8c4814df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.213+0000 7f8c4cf25640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8c48159c70 0x7f8c4815b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.213+0000 7f8c4cf25640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4815c100 con 0x7f8c480b0910 2023-11-04T01:42:57.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.213+0000 7f8c4cf25640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4815c3e0 con 0x7f8c4806db20 2023-11-04T01:42:57.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.213+0000 7f8c4cf25640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c481f5f50 con 0x7f8c48159c70 2023-11-04T01:42:57.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.214+0000 7f8c45d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c480b0910 0x7f8c4814df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.214+0000 7f8c45d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c480b0910 0x7f8c4814df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38910/0 (socket says 172.21.15.77:38910) 2023-11-04T01:42:57.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.214+0000 7f8c45d9b640 1 -- 172.21.15.77:0/1398350125 learned_addr learned my addr 172.21.15.77:0/1398350125 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:57.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.214+0000 7f8c46d9d640 1 --2- 172.21.15.77:0/1398350125 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8c48159c70 0x7f8c4815b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.214+0000 7f8c45d9b640 1 -- 172.21.15.77:0/1398350125 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8c48159c70 msgr2=0x7f8c4815b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.214+0000 7f8c45d9b640 1 --2- 172.21.15.77:0/1398350125 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8c48159c70 0x7f8c4815b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.214+0000 7f8c45d9b640 1 -- 172.21.15.77:0/1398350125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c4806db20 msgr2=0x7f8c481f6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.214+0000 7f8c45d9b640 1 --2- 172.21.15.77:0/1398350125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c4806db20 0x7f8c481f6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.214+0000 7f8c45d9b640 1 -- 172.21.15.77:0/1398350125 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c380094d0 con 0x7f8c480b0910 2023-11-04T01:42:57.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.214+0000 7f8c45d9b640 1 --2- 172.21.15.77:0/1398350125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c480b0910 0x7f8c4814df70 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f8c3000d5f0 tx=0x7f8c3000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:57.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.214+0000 7f8c3effd640 1 -- 172.21.15.77:0/1398350125 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c30014620 con 0x7f8c480b0910 2023-11-04T01:42:57.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.214+0000 7f8c3effd640 1 -- 172.21.15.77:0/1398350125 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c30014780 con 0x7f8c480b0910 2023-11-04T01:42:57.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.214+0000 7f8c4cf25640 1 -- 172.21.15.77:0/1398350125 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c481f6230 con 0x7f8c480b0910 2023-11-04T01:42:57.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.214+0000 7f8c3effd640 1 -- 172.21.15.77:0/1398350125 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c30014b30 con 0x7f8c480b0910 2023-11-04T01:42:57.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.214+0000 7f8c4cf25640 1 -- 172.21.15.77:0/1398350125 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c4815b340 con 0x7f8c480b0910 2023-11-04T01:42:57.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.215+0000 7f8c4cf25640 1 -- 172.21.15.77:0/1398350125 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c481f6750 con 0x7f8c480b0910 2023-11-04T01:42:57.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.216+0000 7f8c3effd640 1 -- 172.21.15.77:0/1398350125 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8c30014c90 con 0x7f8c480b0910 2023-11-04T01:42:57.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.216+0000 7f8c3effd640 1 --2- 172.21.15.77:0/1398350125 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8c2806ae70 0x7f8c2806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.216+0000 7f8c3effd640 1 -- 172.21.15.77:0/1398350125 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f8c30089ff0 con 0x7f8c480b0910 2023-11-04T01:42:57.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.216+0000 7f8c4659c640 1 --2- 172.21.15.77:0/1398350125 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8c2806ae70 0x7f8c2806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.217+0000 7f8c4659c640 1 --2- 172.21.15.77:0/1398350125 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8c2806ae70 0x7f8c2806d330 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8c400070b0 tx=0x7f8c40007040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:57.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.220+0000 7f8c3effd640 1 -- 172.21.15.77:0/1398350125 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8c481f6750 con 0x7f8c480b0910 2023-11-04T01:42:57.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.385+0000 7f8c4cf25640 1 -- 172.21.15.77:0/1398350125 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c481f6750 con 0x7f8c480b0910 2023-11-04T01:42:57.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.386+0000 7f8c3effd640 1 -- 172.21.15.77:0/1398350125 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+21954 (secure 0 0 0) 0x7f8c481f6750 con 0x7f8c480b0910 2023-11-04T01:42:57.388 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:57.389 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":82,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:42:56.426940+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:33.159064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:33.647358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:54.519050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:55.395781+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:57.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.388+0000 7f8c4cf25640 1 -- 172.21.15.77:0/1398350125 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8c2806ae70 msgr2=0x7f8c2806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.388+0000 7f8c4cf25640 1 --2- 172.21.15.77:0/1398350125 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8c2806ae70 0x7f8c2806d330 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8c400070b0 tx=0x7f8c40007040 comp rx=0 tx=0).stop 2023-11-04T01:42:57.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.388+0000 7f8c4cf25640 1 -- 172.21.15.77:0/1398350125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c480b0910 msgr2=0x7f8c4814df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.388+0000 7f8c4cf25640 1 --2- 172.21.15.77:0/1398350125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c480b0910 0x7f8c4814df70 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f8c3000d5f0 tx=0x7f8c3000dab0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.388+0000 7f8c4cf25640 1 -- 172.21.15.77:0/1398350125 shutdown_connections 2023-11-04T01:42:57.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.388+0000 7f8c4cf25640 1 --2- 172.21.15.77:0/1398350125 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8c2806ae70 0x7f8c2806d330 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.388+0000 7f8c4cf25640 1 --2- 172.21.15.77:0/1398350125 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8c48159c70 0x7f8c4815b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.388+0000 7f8c4cf25640 1 --2- 172.21.15.77:0/1398350125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c480b0910 0x7f8c4814df70 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.388+0000 7f8c4cf25640 1 --2- 172.21.15.77:0/1398350125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c4806db20 0x7f8c481f6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.388+0000 7f8c4cf25640 1 -- 172.21.15.77:0/1398350125 >> 172.21.15.77:0/1398350125 conn(0x7f8c480ce950 msgr2=0x7f8c4806c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:57.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.388+0000 7f8c4cf25640 1 -- 172.21.15.77:0/1398350125 shutdown_connections 2023-11-04T01:42:57.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.388+0000 7f8c4cf25640 1 -- 172.21.15.77:0/1398350125 wait complete. 2023-11-04T01:42:57.401 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:57.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.498+0000 7feaef989640 1 Processor -- start 2023-11-04T01:42:57.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.499+0000 7feaef989640 1 -- start start 2023-11-04T01:42:57.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.499+0000 7feaef989640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7feae80b0cd0 0x7feae8070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.499+0000 7feaef989640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7feae80cde40 0x7feae8070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.499+0000 7feaef989640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae80cc990 con 0x7feae80cda60 2023-11-04T01:42:57.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.499+0000 7feaef989640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae80ccc70 con 0x7feae80b0cd0 2023-11-04T01:42:57.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.499+0000 7feaef989640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae80c9ce0 con 0x7feae80cde40 2023-11-04T01:42:57.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.500+0000 7feaecf24640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7feae80b0cd0 0x7feae8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.500+0000 7feaed725640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7feae80cda60 0x7feae80ca7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49734/0 (socket says 172.21.15.77:49734) 2023-11-04T01:42:57.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.500+0000 7feaecf24640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7feae80b0cd0 0x7feae8070630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44994/0 (socket says 172.21.15.77:44994) 2023-11-04T01:42:57.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.500+0000 7feaed725640 1 -- 172.21.15.77:0/3781316094 learned_addr learned my addr 172.21.15.77:0/3781316094 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:57.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.500+0000 7feaedf26640 1 --2- 172.21.15.77:0/3781316094 >> v2:172.21.15.122:3300/0 conn(0x7feae80cde40 0x7feae8070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.500+0000 7feaecf24640 1 -- 172.21.15.77:0/3781316094 >> v2:172.21.15.122:3300/0 conn(0x7feae80cde40 msgr2=0x7feae8070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:57.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.500+0000 7feaecf24640 1 --2- 172.21.15.77:0/3781316094 >> v2:172.21.15.122:3300/0 conn(0x7feae80cde40 0x7feae8070b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.500+0000 7feaecf24640 1 -- 172.21.15.77:0/3781316094 >> v1:172.21.15.77:6789/0 conn(0x7feae80cda60 legacy=0x7feae80ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.500+0000 7feaecf24640 1 -- 172.21.15.77:0/3781316094 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae80c9fc0 con 0x7feae80b0cd0 2023-11-04T01:42:57.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.500+0000 7feae7fff640 1 -- 172.21.15.77:0/3781316094 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3017425345 0 0) 0x7feae80cc990 con 0x7feae80cda60 2023-11-04T01:42:57.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.501+0000 7feaecf24640 1 --2- 172.21.15.77:0/3781316094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feae80b0cd0 0x7feae8070630 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7feae80c93d0 tx=0x7feadc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6675471f214d1d4d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:57.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.501+0000 7feae7fff640 1 -- 172.21.15.77:0/3781316094 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc031830 con 0x7feae80b0cd0 2023-11-04T01:42:57.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.501+0000 7feae7fff640 1 -- 172.21.15.77:0/3781316094 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feadc031990 con 0x7feae80b0cd0 2023-11-04T01:42:57.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.501+0000 7feae7fff640 1 -- 172.21.15.77:0/3781316094 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc031d20 con 0x7feae80b0cd0 2023-11-04T01:42:57.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.501+0000 7feaef989640 1 -- 172.21.15.77:0/3781316094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feae80b0cd0 msgr2=0x7feae8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.501+0000 7feaef989640 1 --2- 172.21.15.77:0/3781316094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feae80b0cd0 0x7feae8070630 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7feae80c93d0 tx=0x7feadc02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.501+0000 7feaef989640 1 -- 172.21.15.77:0/3781316094 shutdown_connections 2023-11-04T01:42:57.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.501+0000 7feaef989640 1 --2- 172.21.15.77:0/3781316094 >> v2:172.21.15.122:3300/0 conn(0x7feae80cde40 0x7feae8070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.501+0000 7feaef989640 1 --2- 172.21.15.77:0/3781316094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feae80b0cd0 0x7feae8070630 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.501+0000 7feaef989640 1 -- 172.21.15.77:0/3781316094 >> 172.21.15.77:0/3781316094 conn(0x7feae80ce950 msgr2=0x7feae80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:57.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.501+0000 7feaef989640 1 -- 172.21.15.77:0/3781316094 shutdown_connections 2023-11-04T01:42:57.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.501+0000 7feaef989640 1 -- 172.21.15.77:0/3781316094 wait complete. 2023-11-04T01:42:57.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.503+0000 7feaef989640 1 Processor -- start 2023-11-04T01:42:57.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.503+0000 7feaef989640 1 -- start start 2023-11-04T01:42:57.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.503+0000 7feaef989640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feae80b0cd0 0x7feae81549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.503+0000 7feaef989640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feae80cda60 0x7feae80c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.503+0000 7feaef989640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feae80cde40 0x7feae815ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.503+0000 7feaef989640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae80c8a90 con 0x7feae80cde40 2023-11-04T01:42:57.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.503+0000 7feaef989640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae81552b0 con 0x7feae80cda60 2023-11-04T01:42:57.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.503+0000 7feaef989640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae80c6af0 con 0x7feae80b0cd0 2023-11-04T01:42:57.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.503+0000 7feaedf26640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feae80cde40 0x7feae815ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.503+0000 7feaedf26640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feae80cde40 0x7feae815ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45010/0 (socket says 172.21.15.77:45010) 2023-11-04T01:42:57.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.503+0000 7feaedf26640 1 -- 172.21.15.77:0/2708661031 learned_addr learned my addr 172.21.15.77:0/2708661031 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:57.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.504+0000 7feaecf24640 1 --2- 172.21.15.77:0/2708661031 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feae80cda60 0x7feae80c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.504+0000 7feaed725640 1 --2- 172.21.15.77:0/2708661031 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feae80b0cd0 0x7feae81549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.504+0000 7feaedf26640 1 -- 172.21.15.77:0/2708661031 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feae80b0cd0 msgr2=0x7feae81549e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.504+0000 7feaedf26640 1 --2- 172.21.15.77:0/2708661031 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feae80b0cd0 0x7feae81549e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.504+0000 7feaedf26640 1 -- 172.21.15.77:0/2708661031 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feae80cda60 msgr2=0x7feae80c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.504+0000 7feaedf26640 1 --2- 172.21.15.77:0/2708661031 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feae80cda60 0x7feae80c8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.504+0000 7feaedf26640 1 -- 172.21.15.77:0/2708661031 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feadc009400 con 0x7feae80cde40 2023-11-04T01:42:57.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.504+0000 7feaedf26640 1 --2- 172.21.15.77:0/2708661031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feae80cde40 0x7feae815ab90 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fead800d5d0 tx=0x7fead800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:57.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.504+0000 7feae5ffb640 1 -- 172.21.15.77:0/2708661031 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead80125f0 con 0x7feae80cde40 2023-11-04T01:42:57.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.504+0000 7feae5ffb640 1 -- 172.21.15.77:0/2708661031 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead8012770 con 0x7feae80cde40 2023-11-04T01:42:57.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.504+0000 7feaef989640 1 -- 172.21.15.77:0/2708661031 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae80c6dd0 con 0x7feae80cde40 2023-11-04T01:42:57.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.504+0000 7feae5ffb640 1 -- 172.21.15.77:0/2708661031 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead8012b20 con 0x7feae80cde40 2023-11-04T01:42:57.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.504+0000 7feaef989640 1 -- 172.21.15.77:0/2708661031 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae80c7390 con 0x7feae80cde40 2023-11-04T01:42:57.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.505+0000 7feaef989640 1 -- 172.21.15.77:0/2708661031 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae8074290 con 0x7feae80cde40 2023-11-04T01:42:57.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.505+0000 7feae5ffb640 1 -- 172.21.15.77:0/2708661031 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fead8012c80 con 0x7feae80cde40 2023-11-04T01:42:57.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.506+0000 7feae5ffb640 1 --2- 172.21.15.77:0/2708661031 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fead406ae70 0x7fead406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.506+0000 7feae5ffb640 1 -- 172.21.15.77:0/2708661031 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fead808a060 con 0x7feae80cde40 2023-11-04T01:42:57.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.506+0000 7feaed725640 1 --2- 172.21.15.77:0/2708661031 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fead406ae70 0x7fead406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.506+0000 7feaed725640 1 --2- 172.21.15.77:0/2708661031 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fead406ae70 0x7fead406d330 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7feae00012e0 tx=0x7feae0009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:57.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.510+0000 7feae5ffb640 1 -- 172.21.15.77:0/2708661031 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fead8054bb0 con 0x7feae80cde40 2023-11-04T01:42:57.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.679+0000 7feaef989640 1 -- 172.21.15.77:0/2708661031 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feae80b48d0 con 0x7feae80cde40 2023-11-04T01:42:57.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.681+0000 7feae5ffb640 1 -- 172.21.15.77:0/2708661031 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+21941 (secure 0 0 0) 0x7fead80581d0 con 0x7feae80cde40 2023-11-04T01:42:57.683 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:57.683 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":83,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:42:57.578138+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:33.159064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:33.647358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:54.519050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:55.395781+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:57.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.683+0000 7feaef989640 1 -- 172.21.15.77:0/2708661031 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fead406ae70 msgr2=0x7fead406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.683+0000 7feaef989640 1 --2- 172.21.15.77:0/2708661031 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fead406ae70 0x7fead406d330 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7feae00012e0 tx=0x7feae0009040 comp rx=0 tx=0).stop 2023-11-04T01:42:57.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.683+0000 7feaef989640 1 -- 172.21.15.77:0/2708661031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feae80cde40 msgr2=0x7feae815ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.683+0000 7feaef989640 1 --2- 172.21.15.77:0/2708661031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feae80cde40 0x7feae815ab90 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fead800d5d0 tx=0x7fead800da90 comp rx=0 tx=0).stop 2023-11-04T01:42:57.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.683+0000 7feaef989640 1 -- 172.21.15.77:0/2708661031 shutdown_connections 2023-11-04T01:42:57.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.683+0000 7feaef989640 1 --2- 172.21.15.77:0/2708661031 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fead406ae70 0x7fead406d330 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.683+0000 7feaef989640 1 --2- 172.21.15.77:0/2708661031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feae80cde40 0x7feae815ab90 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.683+0000 7feaef989640 1 --2- 172.21.15.77:0/2708661031 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feae80cda60 0x7feae80c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.683+0000 7feaef989640 1 --2- 172.21.15.77:0/2708661031 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feae80b0cd0 0x7feae81549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.683+0000 7feaef989640 1 -- 172.21.15.77:0/2708661031 >> 172.21.15.77:0/2708661031 conn(0x7feae80ce950 msgr2=0x7feae806d760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:57.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.683+0000 7feaef989640 1 -- 172.21.15.77:0/2708661031 shutdown_connections 2023-11-04T01:42:57.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.683+0000 7feaef989640 1 -- 172.21.15.77:0/2708661031 wait complete. 2023-11-04T01:42:57.695 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T01:42:57.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.798+0000 7efc54eec640 1 Processor -- start 2023-11-04T01:42:57.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.798+0000 7efc54eec640 1 -- start start 2023-11-04T01:42:57.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.799+0000 7efc54eec640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc5015e430 0x7efc500cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.799+0000 7efc54eec640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efc500cf160 0x7efc500cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.799+0000 7efc54eec640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc500d0280 con 0x7efc500d0710 2023-11-04T01:42:57.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.799+0000 7efc54eec640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc500cf670 con 0x7efc500cf160 2023-11-04T01:42:57.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.799+0000 7efc54eec640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc500cf950 con 0x7efc5015e430 2023-11-04T01:42:57.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.799+0000 7efc4dd9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efc500cf160 0x7efc500cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.800+0000 7efc4dd9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efc500cf160 0x7efc500cd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45020/0 (socket says 172.21.15.77:45020) 2023-11-04T01:42:57.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.800+0000 7efc4dd9b640 1 -- 172.21.15.77:0/1426238008 learned_addr learned my addr 172.21.15.77:0/1426238008 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:57.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.800+0000 7efc4e59c640 1 --2- 172.21.15.77:0/1426238008 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc5015e430 0x7efc500cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.800+0000 7efc4dd9b640 1 -- 172.21.15.77:0/1426238008 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc5015e430 msgr2=0x7efc500cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:57.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.800+0000 7efc4dd9b640 1 --2- 172.21.15.77:0/1426238008 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc5015e430 0x7efc500cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.800+0000 7efc4dd9b640 1 -- 172.21.15.77:0/1426238008 >> v1:172.21.15.122:6789/0 conn(0x7efc500d0710 legacy=0x7efc500b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:57.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.800+0000 7efc4dd9b640 1 -- 172.21.15.77:0/1426238008 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc500cfc30 con 0x7efc500cf160 2023-11-04T01:42:57.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.800+0000 7efc4e59c640 1 --2- 172.21.15.77:0/1426238008 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc5015e430 0x7efc500cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:57.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.800+0000 7efc4dd9b640 1 --2- 172.21.15.77:0/1426238008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc500cf160 0x7efc500cd510 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7efc44009870 tx=0x7efc4402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b32058bf54ea934 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:57.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.801+0000 7efc4d59a640 1 -- 172.21.15.77:0/1426238008 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc44031640 con 0x7efc500cf160 2023-11-04T01:42:57.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.801+0000 7efc4d59a640 1 -- 172.21.15.77:0/1426238008 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc440317a0 con 0x7efc500cf160 2023-11-04T01:42:57.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.801+0000 7efc4d59a640 1 -- 172.21.15.77:0/1426238008 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc44031b30 con 0x7efc500cf160 2023-11-04T01:42:57.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.801+0000 7efc54eec640 1 -- 172.21.15.77:0/1426238008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc500cf160 msgr2=0x7efc500cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.801+0000 7efc54eec640 1 --2- 172.21.15.77:0/1426238008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc500cf160 0x7efc500cd510 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7efc44009870 tx=0x7efc4402b8f0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.801+0000 7efc54eec640 1 -- 172.21.15.77:0/1426238008 shutdown_connections 2023-11-04T01:42:57.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.801+0000 7efc54eec640 1 --2- 172.21.15.77:0/1426238008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc500cf160 0x7efc500cd510 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.801+0000 7efc54eec640 1 --2- 172.21.15.77:0/1426238008 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc5015e430 0x7efc500cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.801+0000 7efc54eec640 1 -- 172.21.15.77:0/1426238008 >> 172.21.15.77:0/1426238008 conn(0x7efc5006ea20 msgr2=0x7efc5006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:57.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.801+0000 7efc54eec640 1 -- 172.21.15.77:0/1426238008 shutdown_connections 2023-11-04T01:42:57.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.801+0000 7efc54eec640 1 -- 172.21.15.77:0/1426238008 wait complete. 2023-11-04T01:42:57.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.803+0000 7efc54eec640 1 Processor -- start 2023-11-04T01:42:57.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.803+0000 7efc54eec640 1 -- start start 2023-11-04T01:42:57.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.803+0000 7efc54eec640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc500cf160 0x7efc501f04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.803+0000 7efc54eec640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc500d0710 0x7efc50157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.803+0000 7efc54eec640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc5015e430 0x7efc500c9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.803+0000 7efc54eec640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc500b1200 con 0x7efc500d0710 2023-11-04T01:42:57.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.803+0000 7efc54eec640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc500b0630 con 0x7efc500cf160 2023-11-04T01:42:57.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.803+0000 7efc54eec640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc500b08d0 con 0x7efc5015e430 2023-11-04T01:42:57.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.803+0000 7efc4dd9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc500d0710 0x7efc50157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.803+0000 7efc4dd9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc500d0710 0x7efc50157e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45028/0 (socket says 172.21.15.77:45028) 2023-11-04T01:42:57.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.803+0000 7efc4dd9b640 1 -- 172.21.15.77:0/2159486270 learned_addr learned my addr 172.21.15.77:0/2159486270 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:57.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.804+0000 7efc4ed9d640 1 --2- 172.21.15.77:0/2159486270 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc5015e430 0x7efc500c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.804+0000 7efc4e59c640 1 --2- 172.21.15.77:0/2159486270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc500cf160 0x7efc501f04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.804+0000 7efc4dd9b640 1 -- 172.21.15.77:0/2159486270 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc5015e430 msgr2=0x7efc500c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.804+0000 7efc4dd9b640 1 --2- 172.21.15.77:0/2159486270 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc5015e430 0x7efc500c9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.804+0000 7efc4dd9b640 1 -- 172.21.15.77:0/2159486270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc500cf160 msgr2=0x7efc501f04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.804+0000 7efc4dd9b640 1 --2- 172.21.15.77:0/2159486270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc500cf160 0x7efc501f04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.804+0000 7efc4dd9b640 1 -- 172.21.15.77:0/2159486270 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc440094d0 con 0x7efc500d0710 2023-11-04T01:42:57.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.804+0000 7efc4dd9b640 1 --2- 172.21.15.77:0/2159486270 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc500d0710 0x7efc50157e80 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7efc44009870 tx=0x7efc440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:57.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.804+0000 7efc3effd640 1 -- 172.21.15.77:0/2159486270 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4403ac60 con 0x7efc500d0710 2023-11-04T01:42:57.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.804+0000 7efc3effd640 1 -- 172.21.15.77:0/2159486270 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4403ade0 con 0x7efc500d0710 2023-11-04T01:42:57.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.804+0000 7efc54eec640 1 -- 172.21.15.77:0/2159486270 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc500b0bb0 con 0x7efc500d0710 2023-11-04T01:42:57.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.804+0000 7efc3effd640 1 -- 172.21.15.77:0/2159486270 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc44044630 con 0x7efc500d0710 2023-11-04T01:42:57.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.804+0000 7efc54eec640 1 -- 172.21.15.77:0/2159486270 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc500c8ad0 con 0x7efc500d0710 2023-11-04T01:42:57.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.805+0000 7efc54eec640 1 -- 172.21.15.77:0/2159486270 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc500b37c0 con 0x7efc500d0710 2023-11-04T01:42:57.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.806+0000 7efc3effd640 1 -- 172.21.15.77:0/2159486270 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efc4402f050 con 0x7efc500d0710 2023-11-04T01:42:57.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.806+0000 7efc3effd640 1 --2- 172.21.15.77:0/2159486270 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efc3006ae70 0x7efc3006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.806+0000 7efc3effd640 1 -- 172.21.15.77:0/2159486270 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7efc440abc10 con 0x7efc500d0710 2023-11-04T01:42:57.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.806+0000 7efc4e59c640 1 --2- 172.21.15.77:0/2159486270 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efc3006ae70 0x7efc3006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.807+0000 7efc4e59c640 1 --2- 172.21.15.77:0/2159486270 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efc3006ae70 0x7efc3006d330 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7efc400075b0 tx=0x7efc40007540 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:57.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:57.810+0000 7efc3effd640 1 -- 172.21.15.77:0/2159486270 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efc440767e0 con 0x7efc500d0710 2023-11-04T01:42:58.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.011+0000 7efc54eec640 1 -- 172.21.15.77:0/2159486270 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7efc50074290 con 0x7efc500d0710 2023-11-04T01:42:58.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.101+0000 7efc3effd640 1 -- 172.21.15.77:0/2159486270 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v34) v1 ==== 118+0+0 (secure 0 0 0) 0x7efc44079e00 con 0x7efc500d0710 2023-11-04T01:42:58.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.103+0000 7efc54eec640 1 -- 172.21.15.77:0/2159486270 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efc3006ae70 msgr2=0x7efc3006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.103+0000 7efc54eec640 1 --2- 172.21.15.77:0/2159486270 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efc3006ae70 0x7efc3006d330 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7efc400075b0 tx=0x7efc40007540 comp rx=0 tx=0).stop 2023-11-04T01:42:58.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.103+0000 7efc54eec640 1 -- 172.21.15.77:0/2159486270 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc500d0710 msgr2=0x7efc50157e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.103+0000 7efc54eec640 1 --2- 172.21.15.77:0/2159486270 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc500d0710 0x7efc50157e80 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7efc44009870 tx=0x7efc440046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.103+0000 7efc54eec640 1 -- 172.21.15.77:0/2159486270 shutdown_connections 2023-11-04T01:42:58.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.103+0000 7efc54eec640 1 --2- 172.21.15.77:0/2159486270 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efc3006ae70 0x7efc3006d330 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.103+0000 7efc54eec640 1 --2- 172.21.15.77:0/2159486270 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efc5015e430 0x7efc500c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.103+0000 7efc54eec640 1 --2- 172.21.15.77:0/2159486270 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc500d0710 0x7efc50157e80 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.103+0000 7efc54eec640 1 --2- 172.21.15.77:0/2159486270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc500cf160 0x7efc501f04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.103+0000 7efc54eec640 1 -- 172.21.15.77:0/2159486270 >> 172.21.15.77:0/2159486270 conn(0x7efc5006ea20 msgr2=0x7efc500c67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:58.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.103+0000 7efc54eec640 1 -- 172.21.15.77:0/2159486270 shutdown_connections 2023-11-04T01:42:58.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.103+0000 7efc54eec640 1 -- 172.21.15.77:0/2159486270 wait complete. 2023-11-04T01:42:58.115 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-04T01:42:58.116 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T01:42:58.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.216+0000 7ff348e87640 1 Processor -- start 2023-11-04T01:42:58.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.216+0000 7ff348e87640 1 -- start start 2023-11-04T01:42:58.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.217+0000 7ff348e87640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff3440b2d30 0x7ff34406bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.217+0000 7ff348e87640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff34406c1d0 0x7ff3440cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.217+0000 7ff348e87640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff34406ca40 con 0x7ff344160430 2023-11-04T01:42:58.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.217+0000 7ff348e87640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3440cb580 con 0x7ff34406c1d0 2023-11-04T01:42:58.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.217+0000 7ff348e87640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff34406cd20 con 0x7ff3440b2d30 2023-11-04T01:42:58.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.217+0000 7ff34259c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ff344160430 0x7ff3440b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49744/0 (socket says 172.21.15.77:49744) 2023-11-04T01:42:58.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.217+0000 7ff34259c640 1 -- 172.21.15.77:0/3731431290 learned_addr learned my addr 172.21.15.77:0/3731431290 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:58.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.217+0000 7ff342d9d640 1 --2- 172.21.15.77:0/3731431290 >> v2:172.21.15.122:3300/0 conn(0x7ff34406c1d0 0x7ff3440cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.217+0000 7ff33bfff640 1 --2- 172.21.15.77:0/3731431290 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff3440b2d30 0x7ff34406bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.217+0000 7ff341d9b640 1 -- 172.21.15.77:0/3731431290 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2215795053 0 0) 0x7ff34406ca40 con 0x7ff344160430 2023-11-04T01:42:58.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.217+0000 7ff341d9b640 1 -- 172.21.15.77:0/3731431290 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff330003520 con 0x7ff344160430 2023-11-04T01:42:58.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.217+0000 7ff341d9b640 1 -- 172.21.15.77:0/3731431290 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1428953775 0 0) 0x7ff330003520 con 0x7ff344160430 2023-11-04T01:42:58.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.217+0000 7ff341d9b640 1 -- 172.21.15.77:0/3731431290 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff3440b2d30 msgr2=0x7ff34406bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:58.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.217+0000 7ff341d9b640 1 --2- 172.21.15.77:0/3731431290 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff3440b2d30 0x7ff34406bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.217+0000 7ff341d9b640 1 -- 172.21.15.77:0/3731431290 >> v2:172.21.15.122:3300/0 conn(0x7ff34406c1d0 msgr2=0x7ff3440cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:58.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.217+0000 7ff341d9b640 1 --2- 172.21.15.77:0/3731431290 >> v2:172.21.15.122:3300/0 conn(0x7ff34406c1d0 0x7ff3440cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.217+0000 7ff341d9b640 1 -- 172.21.15.77:0/3731431290 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff34406d000 con 0x7ff344160430 2023-11-04T01:42:58.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.217+0000 7ff341d9b640 1 -- 172.21.15.77:0/3731431290 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7ff334001670 con 0x7ff344160430 2023-11-04T01:42:58.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.217+0000 7ff341d9b640 1 -- 172.21.15.77:0/3731431290 >> v1:172.21.15.77:6789/0 conn(0x7ff344160430 legacy=0x7ff3440b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.217+0000 7ff341d9b640 1 --2- 172.21.15.77:0/3731431290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff330003970 0x7ff330003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.218+0000 7ff341d9b640 1 --2- 172.21.15.77:0/3731431290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3300047c0 0x7ff330004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.218+0000 7ff341d9b640 1 --2- 172.21.15.77:0/3731431290 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff3440b2d30 0x7ff330005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.218+0000 7ff341d9b640 1 -- 172.21.15.77:0/3731431290 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3440cb580 con 0x7ff330003970 2023-11-04T01:42:58.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.218+0000 7ff341d9b640 1 -- 172.21.15.77:0/3731431290 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34406cd20 con 0x7ff3300047c0 2023-11-04T01:42:58.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.218+0000 7ff341d9b640 1 -- 172.21.15.77:0/3731431290 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33000b980 con 0x7ff3440b2d30 2023-11-04T01:42:58.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.218+0000 7ff34259c640 1 --2- 172.21.15.77:0/3731431290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff330003970 0x7ff330003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.218+0000 7ff33bfff640 1 --2- 172.21.15.77:0/3731431290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3300047c0 0x7ff330004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.218+0000 7ff342d9d640 1 --2- 172.21.15.77:0/3731431290 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff3440b2d30 0x7ff330005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.218+0000 7ff34259c640 1 -- 172.21.15.77:0/3731431290 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff3440b2d30 msgr2=0x7ff330005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:58.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.218+0000 7ff34259c640 1 --2- 172.21.15.77:0/3731431290 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff3440b2d30 0x7ff330005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.218+0000 7ff34259c640 1 -- 172.21.15.77:0/3731431290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3300047c0 msgr2=0x7ff330004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:58.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.218+0000 7ff34259c640 1 --2- 172.21.15.77:0/3731431290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3300047c0 0x7ff330004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.218+0000 7ff34259c640 1 -- 172.21.15.77:0/3731431290 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff330003520 con 0x7ff330003970 2023-11-04T01:42:58.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.218+0000 7ff33bfff640 1 --2- 172.21.15.77:0/3731431290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3300047c0 0x7ff330004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:58.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.218+0000 7ff342d9d640 1 --2- 172.21.15.77:0/3731431290 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff3440b2d30 0x7ff330005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:58.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.219+0000 7ff34259c640 1 --2- 172.21.15.77:0/3731431290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff330003970 0x7ff330003d90 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7ff33400c290 tx=0x7ff3300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e06d0e4cb053e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:58.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.219+0000 7ff341d9b640 1 -- 172.21.15.77:0/3731431290 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff334005ad0 con 0x7ff330003970 2023-11-04T01:42:58.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.219+0000 7ff341d9b640 1 -- 172.21.15.77:0/3731431290 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff334005c30 con 0x7ff330003970 2023-11-04T01:42:58.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.219+0000 7ff341d9b640 1 -- 172.21.15.77:0/3731431290 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33402c8d0 con 0x7ff330003970 2023-11-04T01:42:58.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.219+0000 7ff348e87640 1 -- 172.21.15.77:0/3731431290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff330003970 msgr2=0x7ff330003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.219+0000 7ff348e87640 1 --2- 172.21.15.77:0/3731431290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff330003970 0x7ff330003d90 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7ff33400c290 tx=0x7ff3300057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.219+0000 7ff342d9d640 1 -- 172.21.15.77:0/3731431290 reap_dead start 2023-11-04T01:42:58.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.219+0000 7ff348e87640 1 -- 172.21.15.77:0/3731431290 shutdown_connections 2023-11-04T01:42:58.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.219+0000 7ff348e87640 1 -- 172.21.15.77:0/3731431290 >> 172.21.15.77:0/3731431290 conn(0x7ff34406ea20 msgr2=0x7ff34406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:58.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.219+0000 7ff348e87640 1 -- 172.21.15.77:0/3731431290 shutdown_connections 2023-11-04T01:42:58.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.219+0000 7ff348e87640 1 -- 172.21.15.77:0/3731431290 wait complete. 2023-11-04T01:42:58.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.221+0000 7ff348e87640 1 Processor -- start 2023-11-04T01:42:58.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.221+0000 7ff348e87640 1 -- start start 2023-11-04T01:42:58.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.221+0000 7ff348e87640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff330003970 0x7ff3440b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.221+0000 7ff348e87640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff3440b41d0 0x7ff3441f5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.221+0000 7ff348e87640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff344157c60 0x7ff344158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.221+0000 7ff348e87640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff344158650 con 0x7ff344157c60 2023-11-04T01:42:58.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.221+0000 7ff348e87640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3440b46d0 con 0x7ff330003970 2023-11-04T01:42:58.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.221+0000 7ff348e87640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3440b49b0 con 0x7ff3440b41d0 2023-11-04T01:42:58.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.222+0000 7ff342d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff344157c60 0x7ff344158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.222+0000 7ff342d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff344157c60 0x7ff344158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45052/0 (socket says 172.21.15.77:45052) 2023-11-04T01:42:58.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.222+0000 7ff342d9d640 1 -- 172.21.15.77:0/3378045999 learned_addr learned my addr 172.21.15.77:0/3378045999 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:58.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.222+0000 7ff34259c640 1 --2- 172.21.15.77:0/3378045999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff330003970 0x7ff3440b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.222+0000 7ff33bfff640 1 --2- 172.21.15.77:0/3378045999 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff3440b41d0 0x7ff3441f5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.222+0000 7ff342d9d640 1 -- 172.21.15.77:0/3378045999 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff3440b41d0 msgr2=0x7ff3441f5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.222+0000 7ff342d9d640 1 --2- 172.21.15.77:0/3378045999 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff3440b41d0 0x7ff3441f5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.222+0000 7ff342d9d640 1 -- 172.21.15.77:0/3378045999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff330003970 msgr2=0x7ff3440b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.222+0000 7ff342d9d640 1 --2- 172.21.15.77:0/3378045999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff330003970 0x7ff3440b5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.222+0000 7ff342d9d640 1 -- 172.21.15.77:0/3378045999 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3440b4c90 con 0x7ff344157c60 2023-11-04T01:42:58.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.222+0000 7ff34259c640 1 --2- 172.21.15.77:0/3378045999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff330003970 0x7ff3440b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:58.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.222+0000 7ff342d9d640 1 --2- 172.21.15.77:0/3378045999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff344157c60 0x7ff344158110 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7ff3440b3730 tx=0x7ff33c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:58.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.222+0000 7ff33affd640 1 -- 172.21.15.77:0/3378045999 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c01b070 con 0x7ff344157c60 2023-11-04T01:42:58.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.222+0000 7ff33affd640 1 -- 172.21.15.77:0/3378045999 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33c00f040 con 0x7ff344157c60 2023-11-04T01:42:58.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.222+0000 7ff348e87640 1 -- 172.21.15.77:0/3378045999 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3440b4f70 con 0x7ff344157c60 2023-11-04T01:42:58.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.222+0000 7ff33affd640 1 -- 172.21.15.77:0/3378045999 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c00e050 con 0x7ff344157c60 2023-11-04T01:42:58.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.222+0000 7ff348e87640 1 -- 172.21.15.77:0/3378045999 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3441f61f0 con 0x7ff344157c60 2023-11-04T01:42:58.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.223+0000 7ff348e87640 1 -- 172.21.15.77:0/3378045999 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3441f3050 con 0x7ff344157c60 2023-11-04T01:42:58.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.223+0000 7ff33affd640 1 -- 172.21.15.77:0/3378045999 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff33c015440 con 0x7ff344157c60 2023-11-04T01:42:58.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.224+0000 7ff33affd640 1 --2- 172.21.15.77:0/3378045999 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff32406aea0 0x7ff32406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.224+0000 7ff33affd640 1 -- 172.21.15.77:0/3378045999 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7ff33c08a030 con 0x7ff344157c60 2023-11-04T01:42:58.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.224+0000 7ff34259c640 1 --2- 172.21.15.77:0/3378045999 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff32406aea0 0x7ff32406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.225+0000 7ff34259c640 1 --2- 172.21.15.77:0/3378045999 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff32406aea0 0x7ff32406d360 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff334034000 tx=0x7ff334007000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:58.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.228+0000 7ff33affd640 1 -- 172.21.15.77:0/3378045999 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff3441f3050 con 0x7ff344157c60 2023-11-04T01:42:58.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:58.430+0000 7ff348e87640 1 -- 172.21.15.77:0/3378045999 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff3441f3050 con 0x7ff344157c60 2023-11-04T01:42:59.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.110+0000 7ff33affd640 1 -- 172.21.15.77:0/3378045999 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v35) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff3441f3050 con 0x7ff344157c60 2023-11-04T01:42:59.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.113+0000 7ff348e87640 1 -- 172.21.15.77:0/3378045999 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff32406aea0 msgr2=0x7ff32406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.113+0000 7ff348e87640 1 --2- 172.21.15.77:0/3378045999 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff32406aea0 0x7ff32406d360 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff334034000 tx=0x7ff334007000 comp rx=0 tx=0).stop 2023-11-04T01:42:59.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.113+0000 7ff348e87640 1 -- 172.21.15.77:0/3378045999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff344157c60 msgr2=0x7ff344158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.113+0000 7ff348e87640 1 --2- 172.21.15.77:0/3378045999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff344157c60 0x7ff344158110 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7ff3440b3730 tx=0x7ff33c009f90 comp rx=0 tx=0).stop 2023-11-04T01:42:59.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.113+0000 7ff348e87640 1 -- 172.21.15.77:0/3378045999 shutdown_connections 2023-11-04T01:42:59.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.113+0000 7ff348e87640 1 --2- 172.21.15.77:0/3378045999 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff32406aea0 0x7ff32406d360 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.113+0000 7ff348e87640 1 --2- 172.21.15.77:0/3378045999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff344157c60 0x7ff344158110 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.113+0000 7ff348e87640 1 --2- 172.21.15.77:0/3378045999 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff3440b41d0 0x7ff3441f5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.113+0000 7ff348e87640 1 --2- 172.21.15.77:0/3378045999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff330003970 0x7ff3440b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.113+0000 7ff348e87640 1 -- 172.21.15.77:0/3378045999 >> 172.21.15.77:0/3378045999 conn(0x7ff34406ea20 msgr2=0x7ff3440ca470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:59.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.113+0000 7ff348e87640 1 -- 172.21.15.77:0/3378045999 shutdown_connections 2023-11-04T01:42:59.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.113+0000 7ff348e87640 1 -- 172.21.15.77:0/3378045999 wait complete. 2023-11-04T01:42:59.126 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T01:42:59.126 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:59.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.225+0000 7f66bb5e2640 1 Processor -- start 2023-11-04T01:42:59.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.225+0000 7f66bb5e2640 1 -- start start 2023-11-04T01:42:59.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.226+0000 7f66bb5e2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f66b40b0ae0 0x7f66b40ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.226+0000 7f66bb5e2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f66b406db20 0x7f66b415d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.226+0000 7f66bb5e2640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66b40b4110 con 0x7f66b4159c70 2023-11-04T01:42:59.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.226+0000 7f66bb5e2640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66b40b49b0 con 0x7f66b40b0ae0 2023-11-04T01:42:59.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.226+0000 7f66bb5e2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66b40b43f0 con 0x7f66b406db20 2023-11-04T01:42:59.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.226+0000 7f66b8b7d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f66b40b0ae0 0x7f66b40ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.226+0000 7f66b8b7d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f66b40b0ae0 0x7f66b40ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45064/0 (socket says 172.21.15.77:45064) 2023-11-04T01:42:59.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.226+0000 7f66b8b7d640 1 -- 172.21.15.77:0/4201197813 learned_addr learned my addr 172.21.15.77:0/4201197813 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:59.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.226+0000 7f66b8b7d640 1 -- 172.21.15.77:0/4201197813 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f66b406db20 msgr2=0x7f66b415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:59.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.226+0000 7f66b8b7d640 1 --2- 172.21.15.77:0/4201197813 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f66b406db20 0x7f66b415d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.226+0000 7f66b8b7d640 1 -- 172.21.15.77:0/4201197813 >> v1:172.21.15.122:6789/0 conn(0x7f66b4159c70 legacy=0x7f66b40b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:59.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.226+0000 7f66b8b7d640 1 -- 172.21.15.77:0/4201197813 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b40b46d0 con 0x7f66b40b0ae0 2023-11-04T01:42:59.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.227+0000 7f66b8b7d640 1 --2- 172.21.15.77:0/4201197813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66b40b0ae0 0x7f66b40ce370 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f66a4009870 tx=0x7f66a402db00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae4be8ceba15b72a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:59.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.227+0000 7f66abfff640 1 -- 172.21.15.77:0/4201197813 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a402f8c0 con 0x7f66b40b0ae0 2023-11-04T01:42:59.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.227+0000 7f66abfff640 1 -- 172.21.15.77:0/4201197813 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a402fa20 con 0x7f66b40b0ae0 2023-11-04T01:42:59.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.227+0000 7f66abfff640 1 -- 172.21.15.77:0/4201197813 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a402fdb0 con 0x7f66b40b0ae0 2023-11-04T01:42:59.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.227+0000 7f66bb5e2640 1 -- 172.21.15.77:0/4201197813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66b40b0ae0 msgr2=0x7f66b40ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.227+0000 7f66bb5e2640 1 --2- 172.21.15.77:0/4201197813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66b40b0ae0 0x7f66b40ce370 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f66a4009870 tx=0x7f66a402db00 comp rx=0 tx=0).stop 2023-11-04T01:42:59.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.228+0000 7f66bb5e2640 1 -- 172.21.15.77:0/4201197813 shutdown_connections 2023-11-04T01:42:59.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.228+0000 7f66bb5e2640 1 --2- 172.21.15.77:0/4201197813 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f66b406db20 0x7f66b415d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.228+0000 7f66bb5e2640 1 --2- 172.21.15.77:0/4201197813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66b40b0ae0 0x7f66b40ce370 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.228+0000 7f66bb5e2640 1 -- 172.21.15.77:0/4201197813 >> 172.21.15.77:0/4201197813 conn(0x7f66b40ce950 msgr2=0x7f66b40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:59.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.228+0000 7f66bb5e2640 1 -- 172.21.15.77:0/4201197813 shutdown_connections 2023-11-04T01:42:59.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.228+0000 7f66bb5e2640 1 -- 172.21.15.77:0/4201197813 wait complete. 2023-11-04T01:42:59.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.229+0000 7f66bb5e2640 1 Processor -- start 2023-11-04T01:42:59.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.229+0000 7f66bb5e2640 1 -- start start 2023-11-04T01:42:59.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.229+0000 7f66bb5e2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f66b406db20 0x7f66b41e2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.229+0000 7f66bb5e2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66b40b0ae0 0x7f66b40c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.229+0000 7f66bb5e2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66b4159c70 0x7f66b41e39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.229+0000 7f66bb5e2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b40c8870 con 0x7f66b40b0ae0 2023-11-04T01:42:59.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.229+0000 7f66bb5e2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b41e2900 con 0x7f66b4159c70 2023-11-04T01:42:59.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.229+0000 7f66bb5e2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66b41e2be0 con 0x7f66b406db20 2023-11-04T01:42:59.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.229+0000 7f66b8b7d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66b40b0ae0 0x7f66b40c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.230+0000 7f66b8b7d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66b40b0ae0 0x7f66b40c8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45070/0 (socket says 172.21.15.77:45070) 2023-11-04T01:42:59.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.230+0000 7f66b8b7d640 1 -- 172.21.15.77:0/3881999105 learned_addr learned my addr 172.21.15.77:0/3881999105 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:59.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.230+0000 7f66b937e640 1 --2- 172.21.15.77:0/3881999105 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f66b406db20 0x7f66b41e2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.230+0000 7f66b9b7f640 1 --2- 172.21.15.77:0/3881999105 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66b4159c70 0x7f66b41e39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.230+0000 7f66b8b7d640 1 -- 172.21.15.77:0/3881999105 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f66b406db20 msgr2=0x7f66b41e2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.230+0000 7f66b8b7d640 1 --2- 172.21.15.77:0/3881999105 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f66b406db20 0x7f66b41e2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.230+0000 7f66b8b7d640 1 -- 172.21.15.77:0/3881999105 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66b4159c70 msgr2=0x7f66b41e39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.230+0000 7f66b8b7d640 1 --2- 172.21.15.77:0/3881999105 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66b4159c70 0x7f66b41e39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.230+0000 7f66b8b7d640 1 -- 172.21.15.77:0/3881999105 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a40094d0 con 0x7f66b40b0ae0 2023-11-04T01:42:59.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.230+0000 7f66b8b7d640 1 --2- 172.21.15.77:0/3881999105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66b40b0ae0 0x7f66b40c8330 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f66a4000c00 tx=0x7f66a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:59.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.230+0000 7f66a9ffb640 1 -- 172.21.15.77:0/3881999105 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a4037c60 con 0x7f66b40b0ae0 2023-11-04T01:42:59.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.230+0000 7f66a9ffb640 1 -- 172.21.15.77:0/3881999105 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a402fe90 con 0x7f66b40b0ae0 2023-11-04T01:42:59.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.230+0000 7f66bb5e2640 1 -- 172.21.15.77:0/3881999105 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66b41e2ec0 con 0x7f66b40b0ae0 2023-11-04T01:42:59.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.230+0000 7f66a9ffb640 1 -- 172.21.15.77:0/3881999105 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a4040420 con 0x7f66b40b0ae0 2023-11-04T01:42:59.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.230+0000 7f66bb5e2640 1 -- 172.21.15.77:0/3881999105 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66b41e3480 con 0x7f66b40b0ae0 2023-11-04T01:42:59.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.231+0000 7f66bb5e2640 1 -- 172.21.15.77:0/3881999105 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66b406d8f0 con 0x7f66b40b0ae0 2023-11-04T01:42:59.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.232+0000 7f66a9ffb640 1 -- 172.21.15.77:0/3881999105 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f66a4040580 con 0x7f66b40b0ae0 2023-11-04T01:42:59.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.232+0000 7f66a9ffb640 1 --2- 172.21.15.77:0/3881999105 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f669806ae70 0x7f669806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.232+0000 7f66a9ffb640 1 -- 172.21.15.77:0/3881999105 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f66a4033070 con 0x7f66b40b0ae0 2023-11-04T01:42:59.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.232+0000 7f66b937e640 1 --2- 172.21.15.77:0/3881999105 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f669806ae70 0x7f669806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.233+0000 7f66b937e640 1 --2- 172.21.15.77:0/3881999105 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f669806ae70 0x7f669806d330 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f66b0006fd0 tx=0x7f66b0008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:59.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.236+0000 7f66a9ffb640 1 -- 172.21.15.77:0/3881999105 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f66a4078d90 con 0x7f66b40b0ae0 2023-11-04T01:42:59.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.437+0000 7f66bb5e2640 1 -- 172.21.15.77:0/3881999105 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f66b41e3670 con 0x7f66b40b0ae0 2023-11-04T01:42:59.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.438+0000 7f66a9ffb640 1 -- 172.21.15.77:0/3881999105 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4921 (secure 0 0 0) 0x7f66a407c3b0 con 0x7f66b40b0ae0 2023-11-04T01:42:59.440 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:59.440 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":35,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5992,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/301441031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":301441031},{"type":"v1","addr":"172.21.15.122:6836","nonce":301441031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6861,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/3789657703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3789657703},{"type":"v1","addr":"172.21.15.77:6834","nonce":3789657703}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6864,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3292881877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3292881877},{"type":"v1","addr":"172.21.15.77:6835","nonce":3292881877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:42:56.427282+0000","modified":"2023-11-04T01:42:58.432114+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":35495},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35495":{"gid":35495,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/1536301485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1536301485},{"type":"v1","addr":"172.21.15.122:6837","nonce":1536301485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-04T01:42:59.440 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 35 2023-11-04T01:42:59.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.439+0000 7f66bb5e2640 1 -- 172.21.15.77:0/3881999105 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f669806ae70 msgr2=0x7f669806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.439+0000 7f66bb5e2640 1 --2- 172.21.15.77:0/3881999105 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f669806ae70 0x7f669806d330 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f66b0006fd0 tx=0x7f66b0008040 comp rx=0 tx=0).stop 2023-11-04T01:42:59.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.439+0000 7f66bb5e2640 1 -- 172.21.15.77:0/3881999105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66b40b0ae0 msgr2=0x7f66b40c8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.439+0000 7f66bb5e2640 1 --2- 172.21.15.77:0/3881999105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66b40b0ae0 0x7f66b40c8330 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f66a4000c00 tx=0x7f66a40046c0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.440+0000 7f66bb5e2640 1 -- 172.21.15.77:0/3881999105 shutdown_connections 2023-11-04T01:42:59.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.440+0000 7f66bb5e2640 1 --2- 172.21.15.77:0/3881999105 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f669806ae70 0x7f669806d330 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.440+0000 7f66bb5e2640 1 --2- 172.21.15.77:0/3881999105 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66b4159c70 0x7f66b41e39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.440+0000 7f66bb5e2640 1 --2- 172.21.15.77:0/3881999105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66b40b0ae0 0x7f66b40c8330 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.440+0000 7f66bb5e2640 1 --2- 172.21.15.77:0/3881999105 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f66b406db20 0x7f66b41e2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.440+0000 7f66bb5e2640 1 -- 172.21.15.77:0/3881999105 >> 172.21.15.77:0/3881999105 conn(0x7f66b40ce950 msgr2=0x7f66b4157a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:59.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.440+0000 7f66bb5e2640 1 -- 172.21.15.77:0/3881999105 shutdown_connections 2023-11-04T01:42:59.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.440+0000 7f66bb5e2640 1 -- 172.21.15.77:0/3881999105 wait complete. 2023-11-04T01:42:59.452 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:59.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.549+0000 7f395f056640 1 Processor -- start 2023-11-04T01:42:59.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.550+0000 7f395f056640 1 -- start start 2023-11-04T01:42:59.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.550+0000 7f395f056640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39580ce370 0x7f395806db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.550+0000 7f395f056640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f395806e060 con 0x7f3958159c70 2023-11-04T01:42:59.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.550+0000 7f395f056640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39580b4110 con 0x7f39580b0ae0 2023-11-04T01:42:59.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.550+0000 7f395f056640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39580b49b0 con 0x7f39580ce370 2023-11-04T01:42:59.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.550+0000 7f395cdf2640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f3958159c70 0x7f39580b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49758/0 (socket says 172.21.15.77:49758) 2023-11-04T01:42:59.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.550+0000 7f395cdf2640 1 -- 172.21.15.77:0/3208530346 learned_addr learned my addr 172.21.15.77:0/3208530346 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:59.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.551+0000 7f395d5f3640 1 --2- 172.21.15.77:0/3208530346 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39580ce370 0x7f395806db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.551+0000 7f39577fe640 1 -- 172.21.15.77:0/3208530346 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4272627530 0 0) 0x7f395806e060 con 0x7f3958159c70 2023-11-04T01:42:59.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.551+0000 7f39577fe640 1 -- 172.21.15.77:0/3208530346 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3948003520 con 0x7f3958159c70 2023-11-04T01:42:59.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.551+0000 7f39577fe640 1 -- 172.21.15.77:0/3208530346 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 649962970 0 0) 0x7f3948003520 con 0x7f3958159c70 2023-11-04T01:42:59.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.551+0000 7f39577fe640 1 -- 172.21.15.77:0/3208530346 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39580ce370 msgr2=0x7f395806db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:59.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.551+0000 7f39577fe640 1 --2- 172.21.15.77:0/3208530346 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39580ce370 0x7f395806db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.551+0000 7f39577fe640 1 -- 172.21.15.77:0/3208530346 >> v1:172.21.15.122:6789/0 conn(0x7f39580b0ae0 legacy=0x7f395815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.551+0000 7f39577fe640 1 -- 172.21.15.77:0/3208530346 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39580b43f0 con 0x7f3958159c70 2023-11-04T01:42:59.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.551+0000 7f39577fe640 1 -- 172.21.15.77:0/3208530346 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f394c001670 con 0x7f3958159c70 2023-11-04T01:42:59.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.551+0000 7f39577fe640 1 -- 172.21.15.77:0/3208530346 >> v1:172.21.15.77:6789/0 conn(0x7f3958159c70 legacy=0x7f39580b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.551+0000 7f39577fe640 1 --2- 172.21.15.77:0/3208530346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39480039a0 0x7f3948003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.551+0000 7f39577fe640 1 --2- 172.21.15.77:0/3208530346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3948004350 0x7f3948004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.551+0000 7f39577fe640 1 --2- 172.21.15.77:0/3208530346 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39580ce370 0x7f3948005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.551+0000 7f39577fe640 1 -- 172.21.15.77:0/3208530346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39580b49b0 con 0x7f39480039a0 2023-11-04T01:42:59.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.551+0000 7f39577fe640 1 -- 172.21.15.77:0/3208530346 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394800b980 con 0x7f3948004350 2023-11-04T01:42:59.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.551+0000 7f39577fe640 1 -- 172.21.15.77:0/3208530346 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394800dd50 con 0x7f39580ce370 2023-11-04T01:42:59.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.551+0000 7f395cdf2640 1 --2- 172.21.15.77:0/3208530346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39480039a0 0x7f3948003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.551+0000 7f3957fff640 1 --2- 172.21.15.77:0/3208530346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3948004350 0x7f3948004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.551+0000 7f395d5f3640 1 --2- 172.21.15.77:0/3208530346 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39580ce370 0x7f3948005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.551+0000 7f395cdf2640 1 -- 172.21.15.77:0/3208530346 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39580ce370 msgr2=0x7f3948005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:59.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.551+0000 7f395cdf2640 1 --2- 172.21.15.77:0/3208530346 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39580ce370 0x7f3948005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.551+0000 7f395cdf2640 1 -- 172.21.15.77:0/3208530346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3948004350 msgr2=0x7f3948004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:59.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.551+0000 7f395cdf2640 1 --2- 172.21.15.77:0/3208530346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3948004350 0x7f3948004820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.551+0000 7f395cdf2640 1 -- 172.21.15.77:0/3208530346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3948003520 con 0x7f39480039a0 2023-11-04T01:42:59.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.552+0000 7f395cdf2640 1 --2- 172.21.15.77:0/3208530346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39480039a0 0x7f3948003d80 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f394c004fe0 tx=0x7f39480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b1fab310bc3f9d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:59.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.552+0000 7f39577fe640 1 -- 172.21.15.77:0/3208530346 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394c005b90 con 0x7f39480039a0 2023-11-04T01:42:59.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.552+0000 7f39577fe640 1 -- 172.21.15.77:0/3208530346 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f394c02f070 con 0x7f39480039a0 2023-11-04T01:42:59.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.552+0000 7f39577fe640 1 -- 172.21.15.77:0/3208530346 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394c0080d0 con 0x7f39480039a0 2023-11-04T01:42:59.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.553+0000 7f395f056640 1 -- 172.21.15.77:0/3208530346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39480039a0 msgr2=0x7f3948003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.553+0000 7f395f056640 1 --2- 172.21.15.77:0/3208530346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39480039a0 0x7f3948003d80 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f394c004fe0 tx=0x7f39480057f0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.553+0000 7f395d5f3640 1 -- 172.21.15.77:0/3208530346 reap_dead start 2023-11-04T01:42:59.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.553+0000 7f395f056640 1 -- 172.21.15.77:0/3208530346 shutdown_connections 2023-11-04T01:42:59.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.553+0000 7f395f056640 1 -- 172.21.15.77:0/3208530346 >> 172.21.15.77:0/3208530346 conn(0x7f39580ce950 msgr2=0x7f39580ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:59.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.553+0000 7f395f056640 1 -- 172.21.15.77:0/3208530346 shutdown_connections 2023-11-04T01:42:59.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.553+0000 7f395f056640 1 -- 172.21.15.77:0/3208530346 wait complete. 2023-11-04T01:42:59.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.554+0000 7f395f056640 1 Processor -- start 2023-11-04T01:42:59.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.554+0000 7f395f056640 1 -- start start 2023-11-04T01:42:59.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.555+0000 7f395f056640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39480039a0 0x7f395814d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.555+0000 7f395f056640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f395815c170 0x7f395815c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.555+0000 7f395f056640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39580af0b0 0x7f39580af530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.555+0000 7f395f056640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395815cb30 con 0x7f395815c170 2023-11-04T01:42:59.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.555+0000 7f395f056640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39580ab8e0 con 0x7f39480039a0 2023-11-04T01:42:59.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.555+0000 7f395f056640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39580b03e0 con 0x7f39580af0b0 2023-11-04T01:42:59.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.555+0000 7f3957fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f395815c170 0x7f395815c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.555+0000 7f3957fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f395815c170 0x7f395815c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45088/0 (socket says 172.21.15.77:45088) 2023-11-04T01:42:59.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.555+0000 7f3957fff640 1 -- 172.21.15.77:0/3136319352 learned_addr learned my addr 172.21.15.77:0/3136319352 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:59.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.555+0000 7f395cdf2640 1 --2- 172.21.15.77:0/3136319352 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39480039a0 0x7f395814d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.555+0000 7f3957fff640 1 -- 172.21.15.77:0/3136319352 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39580af0b0 msgr2=0x7f39580af530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.555+0000 7f395d5f3640 1 --2- 172.21.15.77:0/3136319352 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39580af0b0 0x7f39580af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.555+0000 7f3957fff640 1 --2- 172.21.15.77:0/3136319352 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39580af0b0 0x7f39580af530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.555+0000 7f3957fff640 1 -- 172.21.15.77:0/3136319352 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39480039a0 msgr2=0x7f395814d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.555+0000 7f3957fff640 1 --2- 172.21.15.77:0/3136319352 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39480039a0 0x7f395814d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.555+0000 7f3957fff640 1 -- 172.21.15.77:0/3136319352 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39580afe20 con 0x7f395815c170 2023-11-04T01:42:59.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.555+0000 7f395cdf2640 1 --2- 172.21.15.77:0/3136319352 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39480039a0 0x7f395814d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:59.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.556+0000 7f3957fff640 1 --2- 172.21.15.77:0/3136319352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f395815c170 0x7f395815c5f0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f394400f620 tx=0x7f394400fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:59.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.556+0000 7f39557fa640 1 -- 172.21.15.77:0/3136319352 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39440052e0 con 0x7f395815c170 2023-11-04T01:42:59.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.556+0000 7f39557fa640 1 -- 172.21.15.77:0/3136319352 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3944005440 con 0x7f395815c170 2023-11-04T01:42:59.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.556+0000 7f395f056640 1 -- 172.21.15.77:0/3136319352 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39580b0100 con 0x7f395815c170 2023-11-04T01:42:59.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.556+0000 7f39557fa640 1 -- 172.21.15.77:0/3136319352 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3944003810 con 0x7f395815c170 2023-11-04T01:42:59.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.556+0000 7f395f056640 1 -- 172.21.15.77:0/3136319352 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f395815a460 con 0x7f395815c170 2023-11-04T01:42:59.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.557+0000 7f395f056640 1 -- 172.21.15.77:0/3136319352 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f395815a620 con 0x7f395815c170 2023-11-04T01:42:59.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.557+0000 7f39557fa640 1 -- 172.21.15.77:0/3136319352 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3944003970 con 0x7f395815c170 2023-11-04T01:42:59.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.557+0000 7f39557fa640 1 --2- 172.21.15.77:0/3136319352 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f393c06aea0 0x7f393c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.558+0000 7f39557fa640 1 -- 172.21.15.77:0/3136319352 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f3944089970 con 0x7f395815c170 2023-11-04T01:42:59.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.558+0000 7f395cdf2640 1 --2- 172.21.15.77:0/3136319352 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f393c06aea0 0x7f393c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.558+0000 7f395cdf2640 1 --2- 172.21.15.77:0/3136319352 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f393c06aea0 0x7f393c06d360 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f394c001eb0 tx=0x7f394c038040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:59.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.562+0000 7f39557fa640 1 -- 172.21.15.77:0/3136319352 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3944054520 con 0x7f395815c170 2023-11-04T01:42:59.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.728+0000 7f395f056640 1 -- 172.21.15.77:0/3136319352 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3958074290 con 0x7f395815c170 2023-11-04T01:42:59.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.729+0000 7f39557fa640 1 -- 172.21.15.77:0/3136319352 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+21941 (secure 0 0 0) 0x7f3944057b40 con 0x7f395815c170 2023-11-04T01:42:59.731 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:42:59.731 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":83,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:42:57.578138+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:33.159064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:33.647358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:54.519050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:55.395781+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:59.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.731+0000 7f395f056640 1 -- 172.21.15.77:0/3136319352 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f393c06aea0 msgr2=0x7f393c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.731+0000 7f395f056640 1 --2- 172.21.15.77:0/3136319352 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f393c06aea0 0x7f393c06d360 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f394c001eb0 tx=0x7f394c038040 comp rx=0 tx=0).stop 2023-11-04T01:42:59.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.731+0000 7f395f056640 1 -- 172.21.15.77:0/3136319352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f395815c170 msgr2=0x7f395815c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.731+0000 7f395f056640 1 --2- 172.21.15.77:0/3136319352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f395815c170 0x7f395815c5f0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f394400f620 tx=0x7f394400fae0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.731+0000 7f395f056640 1 -- 172.21.15.77:0/3136319352 shutdown_connections 2023-11-04T01:42:59.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.731+0000 7f395f056640 1 --2- 172.21.15.77:0/3136319352 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f393c06aea0 0x7f393c06d360 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.731+0000 7f395f056640 1 --2- 172.21.15.77:0/3136319352 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39580af0b0 0x7f39580af530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.731+0000 7f395f056640 1 --2- 172.21.15.77:0/3136319352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f395815c170 0x7f395815c5f0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.731+0000 7f395f056640 1 --2- 172.21.15.77:0/3136319352 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39480039a0 0x7f395814d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.731+0000 7f395f056640 1 -- 172.21.15.77:0/3136319352 >> 172.21.15.77:0/3136319352 conn(0x7f39580ce950 msgr2=0x7f39580cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:59.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.731+0000 7f395f056640 1 -- 172.21.15.77:0/3136319352 shutdown_connections 2023-11-04T01:42:59.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.731+0000 7f395f056640 1 -- 172.21.15.77:0/3136319352 wait complete. 2023-11-04T01:42:59.743 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T01:42:59.744 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:42:59.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.842+0000 7f9991a7c640 1 Processor -- start 2023-11-04T01:42:59.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.842+0000 7f9991a7c640 1 -- start start 2023-11-04T01:42:59.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.843+0000 7f9991a7c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f998c159c70 0x7f998c0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.843+0000 7f9991a7c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f998c0b0ae0 0x7f998c15d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.843+0000 7f9991a7c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f998c0b4110 con 0x7f998c06db20 2023-11-04T01:42:59.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.843+0000 7f9991a7c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f998c0b49b0 con 0x7f998c0b0ae0 2023-11-04T01:42:59.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.843+0000 7f9991a7c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998c0b43f0 con 0x7f998c159c70 2023-11-04T01:42:59.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.843+0000 7f998bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f998c0b0ae0 0x7f998c15d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.843+0000 7f998affd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f998c06db20 0x7f998c0b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49774/0 (socket says 172.21.15.77:49774) 2023-11-04T01:42:59.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.843+0000 7f998affd640 1 -- 172.21.15.77:0/1907626814 learned_addr learned my addr 172.21.15.77:0/1907626814 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:42:59.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.843+0000 7f998bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f998c0b0ae0 0x7f998c15d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45090/0 (socket says 172.21.15.77:45090) 2023-11-04T01:42:59.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.844+0000 7f998b7fe640 1 --2- 172.21.15.77:0/1907626814 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f998c159c70 0x7f998c0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.844+0000 7f998bfff640 1 -- 172.21.15.77:0/1907626814 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f998c159c70 msgr2=0x7f998c0ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:59.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.844+0000 7f998bfff640 1 --2- 172.21.15.77:0/1907626814 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f998c159c70 0x7f998c0ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.844+0000 7f998bfff640 1 -- 172.21.15.77:0/1907626814 >> v1:172.21.15.77:6789/0 conn(0x7f998c06db20 legacy=0x7f998c0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.844+0000 7f998bfff640 1 -- 172.21.15.77:0/1907626814 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998c0b46d0 con 0x7f998c0b0ae0 2023-11-04T01:42:59.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.844+0000 7f998b7fe640 1 --2- 172.21.15.77:0/1907626814 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f998c159c70 0x7f998c0ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:59.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.844+0000 7f998bfff640 1 --2- 172.21.15.77:0/1907626814 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f998c0b0ae0 0x7f998c15d7d0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f9984009d90 tx=0x7f998402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4de9deb5329255d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:59.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.844+0000 7f998a7fc640 1 -- 172.21.15.77:0/1907626814 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998402cc50 con 0x7f998c0b0ae0 2023-11-04T01:42:59.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.845+0000 7f998a7fc640 1 -- 172.21.15.77:0/1907626814 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f998402cdb0 con 0x7f998c0b0ae0 2023-11-04T01:42:59.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.845+0000 7f998a7fc640 1 -- 172.21.15.77:0/1907626814 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9984034660 con 0x7f998c0b0ae0 2023-11-04T01:42:59.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.845+0000 7f9991a7c640 1 -- 172.21.15.77:0/1907626814 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f998c0b0ae0 msgr2=0x7f998c15d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.845+0000 7f9991a7c640 1 --2- 172.21.15.77:0/1907626814 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f998c0b0ae0 0x7f998c15d7d0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f9984009d90 tx=0x7f998402bea0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.845+0000 7f9991a7c640 1 -- 172.21.15.77:0/1907626814 shutdown_connections 2023-11-04T01:42:59.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.845+0000 7f9991a7c640 1 --2- 172.21.15.77:0/1907626814 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f998c0b0ae0 0x7f998c15d7d0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.845+0000 7f9991a7c640 1 --2- 172.21.15.77:0/1907626814 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f998c159c70 0x7f998c0ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.845+0000 7f9991a7c640 1 -- 172.21.15.77:0/1907626814 >> 172.21.15.77:0/1907626814 conn(0x7f998c0ce950 msgr2=0x7f998c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:59.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.845+0000 7f9991a7c640 1 -- 172.21.15.77:0/1907626814 shutdown_connections 2023-11-04T01:42:59.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.845+0000 7f9991a7c640 1 -- 172.21.15.77:0/1907626814 wait complete. 2023-11-04T01:42:59.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.846+0000 7f9991a7c640 1 Processor -- start 2023-11-04T01:42:59.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.846+0000 7f9991a7c640 1 -- start start 2023-11-04T01:42:59.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.847+0000 7f9991a7c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f998c06db20 0x7f998c0c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.847+0000 7f9991a7c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f998c0b0ae0 0x7f998c153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.847+0000 7f9991a7c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f998c159c70 0x7f998c0a7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.847+0000 7f9991a7c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998c1539b0 con 0x7f998c159c70 2023-11-04T01:42:59.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.847+0000 7f9991a7c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998c0c7450 con 0x7f998c0b0ae0 2023-11-04T01:42:59.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.847+0000 7f9991a7c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998c0c7730 con 0x7f998c06db20 2023-11-04T01:42:59.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.847+0000 7f998bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f998c159c70 0x7f998c0a7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.847+0000 7f998bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f998c159c70 0x7f998c0a7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45104/0 (socket says 172.21.15.77:45104) 2023-11-04T01:42:59.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.847+0000 7f998bfff640 1 -- 172.21.15.77:0/4003556995 learned_addr learned my addr 172.21.15.77:0/4003556995 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:42:59.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.847+0000 7f998affd640 1 --2- 172.21.15.77:0/4003556995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f998c0b0ae0 0x7f998c153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.847+0000 7f998bfff640 1 -- 172.21.15.77:0/4003556995 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f998c06db20 msgr2=0x7f998c0c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.847+0000 7f998b7fe640 1 --2- 172.21.15.77:0/4003556995 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f998c06db20 0x7f998c0c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.847+0000 7f998bfff640 1 --2- 172.21.15.77:0/4003556995 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f998c06db20 0x7f998c0c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.847+0000 7f998bfff640 1 -- 172.21.15.77:0/4003556995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f998c0b0ae0 msgr2=0x7f998c153470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.847+0000 7f998bfff640 1 --2- 172.21.15.77:0/4003556995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f998c0b0ae0 0x7f998c153470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.847+0000 7f998bfff640 1 -- 172.21.15.77:0/4003556995 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9984009a70 con 0x7f998c159c70 2023-11-04T01:42:59.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.848+0000 7f998bfff640 1 --2- 172.21.15.77:0/4003556995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f998c159c70 0x7f998c0a7e50 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f9984009d90 tx=0x7f9984004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:59.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.848+0000 7f9973fff640 1 -- 172.21.15.77:0/4003556995 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998403e610 con 0x7f998c159c70 2023-11-04T01:42:59.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.848+0000 7f9973fff640 1 -- 172.21.15.77:0/4003556995 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f998403e790 con 0x7f998c159c70 2023-11-04T01:42:59.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.848+0000 7f9973fff640 1 -- 172.21.15.77:0/4003556995 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998403eb40 con 0x7f998c159c70 2023-11-04T01:42:59.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.848+0000 7f9991a7c640 1 -- 172.21.15.77:0/4003556995 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f998c0c7a10 con 0x7f998c159c70 2023-11-04T01:42:59.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.848+0000 7f9991a7c640 1 -- 172.21.15.77:0/4003556995 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f998c0c7fd0 con 0x7f998c159c70 2023-11-04T01:42:59.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.849+0000 7f9991a7c640 1 -- 172.21.15.77:0/4003556995 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f998c0c8160 con 0x7f998c159c70 2023-11-04T01:42:59.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.849+0000 7f9973fff640 1 -- 172.21.15.77:0/4003556995 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f998403b050 con 0x7f998c159c70 2023-11-04T01:42:59.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.850+0000 7f9973fff640 1 --2- 172.21.15.77:0/4003556995 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f997806ae70 0x7f997806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.850+0000 7f9973fff640 1 -- 172.21.15.77:0/4003556995 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f99840ac480 con 0x7f998c159c70 2023-11-04T01:42:59.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.850+0000 7f998b7fe640 1 --2- 172.21.15.77:0/4003556995 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f997806ae70 0x7f997806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.850+0000 7f998b7fe640 1 --2- 172.21.15.77:0/4003556995 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f997806ae70 0x7f997806d330 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f998c157640 tx=0x7f997c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:59.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:42:59.854+0000 7f9973fff640 1 -- 172.21.15.77:0/4003556995 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9984077050 con 0x7f998c159c70 2023-11-04T01:43:00.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.015+0000 7f9991a7c640 1 -- 172.21.15.77:0/4003556995 --> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f998c0cde50 con 0x7f997806ae70 2023-11-04T01:43:00.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.028+0000 7f9973fff640 1 -- 172.21.15.77:0/4003556995 <== mgr.4123 v2:172.21.15.122:6832/2275325762 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+531968 (secure 0 0 0) 0x7f997c00c040 con 0x7f997806ae70 2023-11-04T01:43:00.035 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:43:00.039 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-04T01:43:00.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.032+0000 7f9991a7c640 1 -- 172.21.15.77:0/4003556995 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f997806ae70 msgr2=0x7f997806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.033+0000 7f9991a7c640 1 --2- 172.21.15.77:0/4003556995 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f997806ae70 0x7f997806d330 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f998c157640 tx=0x7f997c008040 comp rx=0 tx=0).stop 2023-11-04T01:43:00.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.033+0000 7f9991a7c640 1 -- 172.21.15.77:0/4003556995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f998c159c70 msgr2=0x7f998c0a7e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.033+0000 7f9991a7c640 1 --2- 172.21.15.77:0/4003556995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f998c159c70 0x7f998c0a7e50 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f9984009d90 tx=0x7f9984004a40 comp rx=0 tx=0).stop 2023-11-04T01:43:00.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.033+0000 7f9991a7c640 1 -- 172.21.15.77:0/4003556995 shutdown_connections 2023-11-04T01:43:00.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.033+0000 7f9991a7c640 1 --2- 172.21.15.77:0/4003556995 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f997806ae70 0x7f997806d330 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.033+0000 7f9991a7c640 1 --2- 172.21.15.77:0/4003556995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f998c159c70 0x7f998c0a7e50 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.033+0000 7f9991a7c640 1 --2- 172.21.15.77:0/4003556995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f998c0b0ae0 0x7f998c153470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.033+0000 7f9991a7c640 1 --2- 172.21.15.77:0/4003556995 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f998c06db20 0x7f998c0c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.033+0000 7f9991a7c640 1 -- 172.21.15.77:0/4003556995 >> 172.21.15.77:0/4003556995 conn(0x7f998c0ce950 msgr2=0x7f998c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:00.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.033+0000 7f9991a7c640 1 -- 172.21.15.77:0/4003556995 shutdown_connections 2023-11-04T01:43:00.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.033+0000 7f9991a7c640 1 -- 172.21.15.77:0/4003556995 wait complete. 2023-11-04T01:43:00.045 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":170,"stamp":"2023-11-04T01:42:59.671061+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":174,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":213,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233392,"kb_used_data":8888,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754741328,"statfs":{"total":773094113280,"available":772855119872,"internally_reserved":0,"allocated":9101312,"data_stored":4993499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":229756466},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.594150"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.596313+0000","last_change":"2023-11-04T01:42:56.590819+0000","last_active":"2023-11-04T01:42:56.596313+0000","last_peered":"2023-11-04T01:42:56.596313+0000","last_clean":"2023-11-04T01:42:56.596313+0000","last_became_active":"2023-11-04T01:42:56.590551+0000","last_became_peered":"2023-11-04T01:42:56.590551+0000","last_unstale":"2023-11-04T01:42:56.596313+0000","last_undegraded":"2023-11-04T01:42:56.596313+0000","last_fullsized":"2023-11-04T01:42:56.596313+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:42:02.251901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.593454+0000","last_change":"2023-11-04T01:42:56.590955+0000","last_active":"2023-11-04T01:42:56.593454+0000","last_peered":"2023-11-04T01:42:56.593454+0000","last_clean":"2023-11-04T01:42:56.593454+0000","last_became_active":"2023-11-04T01:42:56.590690+0000","last_became_peered":"2023-11-04T01:42:56.590690+0000","last_unstale":"2023-11-04T01:42:56.593454+0000","last_undegraded":"2023-11-04T01:42:56.593454+0000","last_fullsized":"2023-11-04T01:42:56.593454+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:46:47.134580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.596347+0000","last_change":"2023-11-04T01:42:56.590889+0000","last_active":"2023-11-04T01:42:56.596347+0000","last_peered":"2023-11-04T01:42:56.596347+0000","last_clean":"2023-11-04T01:42:56.596347+0000","last_became_active":"2023-11-04T01:42:56.590614+0000","last_became_peered":"2023-11-04T01:42:56.590614+0000","last_unstale":"2023-11-04T01:42:56.596347+0000","last_undegraded":"2023-11-04T01:42:56.596347+0000","last_fullsized":"2023-11-04T01:42:56.596347+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:38.137098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.604908+0000","last_change":"2023-11-04T01:42:56.601129+0000","last_active":"2023-11-04T01:42:56.604908+0000","last_peered":"2023-11-04T01:42:56.604908+0000","last_clean":"2023-11-04T01:42:56.604908+0000","last_became_active":"2023-11-04T01:42:56.600871+0000","last_became_peered":"2023-11-04T01:42:56.600871+0000","last_unstale":"2023-11-04T01:42:56.604908+0000","last_undegraded":"2023-11-04T01:42:56.604908+0000","last_fullsized":"2023-11-04T01:42:56.604908+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:55:22.096002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.605062+0000","last_change":"2023-11-04T01:42:56.601392+0000","last_active":"2023-11-04T01:42:56.605062+0000","last_peered":"2023-11-04T01:42:56.605062+0000","last_clean":"2023-11-04T01:42:56.605062+0000","last_became_active":"2023-11-04T01:42:56.601117+0000","last_became_peered":"2023-11-04T01:42:56.601117+0000","last_unstale":"2023-11-04T01:42:56.605062+0000","last_undegraded":"2023-11-04T01:42:56.605062+0000","last_fullsized":"2023-11-04T01:42:56.605062+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:53:16.150719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.599793+0000","last_change":"2023-11-04T01:42:56.595421+0000","last_active":"2023-11-04T01:42:56.599793+0000","last_peered":"2023-11-04T01:42:56.599793+0000","last_clean":"2023-11-04T01:42:56.599793+0000","last_became_active":"2023-11-04T01:42:56.595109+0000","last_became_peered":"2023-11-04T01:42:56.595109+0000","last_unstale":"2023-11-04T01:42:56.599793+0000","last_undegraded":"2023-11-04T01:42:56.599793+0000","last_fullsized":"2023-11-04T01:42:56.599793+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:49:30.516581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.599766+0000","last_change":"2023-11-04T01:42:56.596125+0000","last_active":"2023-11-04T01:42:56.599766+0000","last_peered":"2023-11-04T01:42:56.599766+0000","last_clean":"2023-11-04T01:42:56.599766+0000","last_became_active":"2023-11-04T01:42:56.595821+0000","last_became_peered":"2023-11-04T01:42:56.595821+0000","last_unstale":"2023-11-04T01:42:56.599766+0000","last_undegraded":"2023-11-04T01:42:56.599766+0000","last_fullsized":"2023-11-04T01:42:56.599766+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:30:15.007217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.590981+0000","last_change":"2023-11-04T01:42:56.587146+0000","last_active":"2023-11-04T01:42:56.590981+0000","last_peered":"2023-11-04T01:42:56.590981+0000","last_clean":"2023-11-04T01:42:56.590981+0000","last_became_active":"2023-11-04T01:42:56.586887+0000","last_became_peered":"2023-11-04T01:42:56.586887+0000","last_unstale":"2023-11-04T01:42:56.590981+0000","last_undegraded":"2023-11-04T01:42:56.590981+0000","last_fullsized":"2023-11-04T01:42:56.590981+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:06:35.498440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.606839+0000","last_change":"2023-11-04T01:42:56.601615+0000","last_active":"2023-11-04T01:42:56.606839+0000","last_peered":"2023-11-04T01:42:56.606839+0000","last_clean":"2023-11-04T01:42:56.606839+0000","last_became_active":"2023-11-04T01:42:56.601338+0000","last_became_peered":"2023-11-04T01:42:56.601338+0000","last_unstale":"2023-11-04T01:42:56.606839+0000","last_undegraded":"2023-11-04T01:42:56.606839+0000","last_fullsized":"2023-11-04T01:42:56.606839+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:16:38.383201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.604887+0000","last_change":"2023-11-04T01:42:56.601194+0000","last_active":"2023-11-04T01:42:56.604887+0000","last_peered":"2023-11-04T01:42:56.604887+0000","last_clean":"2023-11-04T01:42:56.604887+0000","last_became_active":"2023-11-04T01:42:56.600922+0000","last_became_peered":"2023-11-04T01:42:56.600922+0000","last_unstale":"2023-11-04T01:42:56.604887+0000","last_undegraded":"2023-11-04T01:42:56.604887+0000","last_fullsized":"2023-11-04T01:42:56.604887+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:55:45.724157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.604559+0000","last_change":"2023-11-04T01:42:56.600861+0000","last_active":"2023-11-04T01:42:56.604559+0000","last_peered":"2023-11-04T01:42:56.604559+0000","last_clean":"2023-11-04T01:42:56.604559+0000","last_became_active":"2023-11-04T01:42:56.600468+0000","last_became_peered":"2023-11-04T01:42:56.600468+0000","last_unstale":"2023-11-04T01:42:56.604559+0000","last_undegraded":"2023-11-04T01:42:56.604559+0000","last_fullsized":"2023-11-04T01:42:56.604559+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:12:39.403469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.606751+0000","last_change":"2023-11-04T01:42:56.601576+0000","last_active":"2023-11-04T01:42:56.606751+0000","last_peered":"2023-11-04T01:42:56.606751+0000","last_clean":"2023-11-04T01:42:56.606751+0000","last_became_active":"2023-11-04T01:42:56.601311+0000","last_became_peered":"2023-11-04T01:42:56.601311+0000","last_unstale":"2023-11-04T01:42:56.606751+0000","last_undegraded":"2023-11-04T01:42:56.606751+0000","last_fullsized":"2023-11-04T01:42:56.606751+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:53.757794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.600075+0000","last_change":"2023-11-04T01:42:56.599280+0000","last_active":"2023-11-04T01:42:56.600075+0000","last_peered":"2023-11-04T01:42:56.600075+0000","last_clean":"2023-11-04T01:42:56.600075+0000","last_became_active":"2023-11-04T01:42:56.599021+0000","last_became_peered":"2023-11-04T01:42:56.599021+0000","last_unstale":"2023-11-04T01:42:56.600075+0000","last_undegraded":"2023-11-04T01:42:56.600075+0000","last_fullsized":"2023-11-04T01:42:56.600075+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:33:25.781100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.607284+0000","last_change":"2023-11-04T01:42:56.602504+0000","last_active":"2023-11-04T01:42:56.607284+0000","last_peered":"2023-11-04T01:42:56.607284+0000","last_clean":"2023-11-04T01:42:56.607284+0000","last_became_active":"2023-11-04T01:42:56.602245+0000","last_became_peered":"2023-11-04T01:42:56.602245+0000","last_unstale":"2023-11-04T01:42:56.607284+0000","last_undegraded":"2023-11-04T01:42:56.607284+0000","last_fullsized":"2023-11-04T01:42:56.607284+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:56:20.190779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.599104+0000","last_change":"2023-11-04T01:42:56.592257+0000","last_active":"2023-11-04T01:42:56.599104+0000","last_peered":"2023-11-04T01:42:56.599104+0000","last_clean":"2023-11-04T01:42:56.599104+0000","last_became_active":"2023-11-04T01:42:56.592009+0000","last_became_peered":"2023-11-04T01:42:56.592009+0000","last_unstale":"2023-11-04T01:42:56.599104+0000","last_undegraded":"2023-11-04T01:42:56.599104+0000","last_fullsized":"2023-11-04T01:42:56.599104+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:15:38.894368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.593354+0000","last_change":"2023-11-04T01:42:56.592620+0000","last_active":"2023-11-04T01:42:56.593354+0000","last_peered":"2023-11-04T01:42:56.593354+0000","last_clean":"2023-11-04T01:42:56.593354+0000","last_became_active":"2023-11-04T01:42:56.592347+0000","last_became_peered":"2023-11-04T01:42:56.592347+0000","last_unstale":"2023-11-04T01:42:56.593354+0000","last_undegraded":"2023-11-04T01:42:56.593354+0000","last_fullsized":"2023-11-04T01:42:56.593354+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:51:53.283591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.594298+0000","last_change":"2023-11-04T01:42:56.592300+0000","last_active":"2023-11-04T01:42:56.594298+0000","last_peered":"2023-11-04T01:42:56.594298+0000","last_clean":"2023-11-04T01:42:56.594298+0000","last_became_active":"2023-11-04T01:42:56.592047+0000","last_became_peered":"2023-11-04T01:42:56.592047+0000","last_unstale":"2023-11-04T01:42:56.594298+0000","last_undegraded":"2023-11-04T01:42:56.594298+0000","last_fullsized":"2023-11-04T01:42:56.594298+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:13:26.525513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.604945+0000","last_change":"2023-11-04T01:42:56.602384+0000","last_active":"2023-11-04T01:42:56.604945+0000","last_peered":"2023-11-04T01:42:56.604945+0000","last_clean":"2023-11-04T01:42:56.604945+0000","last_became_active":"2023-11-04T01:42:56.601959+0000","last_became_peered":"2023-11-04T01:42:56.601959+0000","last_unstale":"2023-11-04T01:42:56.604945+0000","last_undegraded":"2023-11-04T01:42:56.604945+0000","last_fullsized":"2023-11-04T01:42:56.604945+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:27:05.944471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.605338+0000","last_change":"2023-11-04T01:42:56.601070+0000","last_active":"2023-11-04T01:42:56.605338+0000","last_peered":"2023-11-04T01:42:56.605338+0000","last_clean":"2023-11-04T01:42:56.605338+0000","last_became_active":"2023-11-04T01:42:56.600806+0000","last_became_peered":"2023-11-04T01:42:56.600806+0000","last_unstale":"2023-11-04T01:42:56.605338+0000","last_undegraded":"2023-11-04T01:42:56.605338+0000","last_fullsized":"2023-11-04T01:42:56.605338+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:46.161943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.606616+0000","last_change":"2023-11-04T01:42:56.600847+0000","last_active":"2023-11-04T01:42:56.606616+0000","last_peered":"2023-11-04T01:42:56.606616+0000","last_clean":"2023-11-04T01:42:56.606616+0000","last_became_active":"2023-11-04T01:42:56.600318+0000","last_became_peered":"2023-11-04T01:42:56.600318+0000","last_unstale":"2023-11-04T01:42:56.606616+0000","last_undegraded":"2023-11-04T01:42:56.606616+0000","last_fullsized":"2023-11-04T01:42:56.606616+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:31:50.663391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.605278+0000","last_change":"2023-11-04T01:42:56.600548+0000","last_active":"2023-11-04T01:42:56.605278+0000","last_peered":"2023-11-04T01:42:56.605278+0000","last_clean":"2023-11-04T01:42:56.605278+0000","last_became_active":"2023-11-04T01:42:56.600227+0000","last_became_peered":"2023-11-04T01:42:56.600227+0000","last_unstale":"2023-11-04T01:42:56.605278+0000","last_undegraded":"2023-11-04T01:42:56.605278+0000","last_fullsized":"2023-11-04T01:42:56.605278+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:18:06.098948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.593390+0000","last_change":"2023-11-04T01:42:56.590795+0000","last_active":"2023-11-04T01:42:56.593390+0000","last_peered":"2023-11-04T01:42:56.593390+0000","last_clean":"2023-11-04T01:42:56.593390+0000","last_became_active":"2023-11-04T01:42:56.590534+0000","last_became_peered":"2023-11-04T01:42:56.590534+0000","last_unstale":"2023-11-04T01:42:56.593390+0000","last_undegraded":"2023-11-04T01:42:56.593390+0000","last_fullsized":"2023-11-04T01:42:56.593390+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:17.805666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.593421+0000","last_change":"2023-11-04T01:42:56.590830+0000","last_active":"2023-11-04T01:42:56.593421+0000","last_peered":"2023-11-04T01:42:56.593421+0000","last_clean":"2023-11-04T01:42:56.593421+0000","last_became_active":"2023-11-04T01:42:56.590562+0000","last_became_peered":"2023-11-04T01:42:56.590562+0000","last_unstale":"2023-11-04T01:42:56.593421+0000","last_undegraded":"2023-11-04T01:42:56.593421+0000","last_fullsized":"2023-11-04T01:42:56.593421+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:40:27.673699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.599946+0000","last_change":"2023-11-04T01:42:56.597038+0000","last_active":"2023-11-04T01:42:56.599946+0000","last_peered":"2023-11-04T01:42:56.599946+0000","last_clean":"2023-11-04T01:42:56.599946+0000","last_became_active":"2023-11-04T01:42:56.596736+0000","last_became_peered":"2023-11-04T01:42:56.596736+0000","last_unstale":"2023-11-04T01:42:56.599946+0000","last_undegraded":"2023-11-04T01:42:56.599946+0000","last_fullsized":"2023-11-04T01:42:56.599946+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:30:50.657341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.607024+0000","last_change":"2023-11-04T01:42:56.602145+0000","last_active":"2023-11-04T01:42:56.607024+0000","last_peered":"2023-11-04T01:42:56.607024+0000","last_clean":"2023-11-04T01:42:56.607024+0000","last_became_active":"2023-11-04T01:42:56.601776+0000","last_became_peered":"2023-11-04T01:42:56.601776+0000","last_unstale":"2023-11-04T01:42:56.607024+0000","last_undegraded":"2023-11-04T01:42:56.607024+0000","last_fullsized":"2023-11-04T01:42:56.607024+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:43:47.542910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.591803+0000","last_change":"2023-11-04T01:42:56.589085+0000","last_active":"2023-11-04T01:42:56.591803+0000","last_peered":"2023-11-04T01:42:56.591803+0000","last_clean":"2023-11-04T01:42:56.591803+0000","last_became_active":"2023-11-04T01:42:56.588824+0000","last_became_peered":"2023-11-04T01:42:56.588824+0000","last_unstale":"2023-11-04T01:42:56.591803+0000","last_undegraded":"2023-11-04T01:42:56.591803+0000","last_fullsized":"2023-11-04T01:42:56.591803+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:30:12.207973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.604599+0000","last_change":"2023-11-04T01:42:56.601836+0000","last_active":"2023-11-04T01:42:56.604599+0000","last_peered":"2023-11-04T01:42:56.604599+0000","last_clean":"2023-11-04T01:42:56.604599+0000","last_became_active":"2023-11-04T01:42:56.601549+0000","last_became_peered":"2023-11-04T01:42:56.601549+0000","last_unstale":"2023-11-04T01:42:56.604599+0000","last_undegraded":"2023-11-04T01:42:56.604599+0000","last_fullsized":"2023-11-04T01:42:56.604599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:43:47.542910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.606998+0000","last_change":"2023-11-04T01:42:56.602836+0000","last_active":"2023-11-04T01:42:56.606998+0000","last_peered":"2023-11-04T01:42:56.606998+0000","last_clean":"2023-11-04T01:42:56.606998+0000","last_became_active":"2023-11-04T01:42:56.602589+0000","last_became_peered":"2023-11-04T01:42:56.602589+0000","last_unstale":"2023-11-04T01:42:56.606998+0000","last_undegraded":"2023-11-04T01:42:56.606998+0000","last_fullsized":"2023-11-04T01:42:56.606998+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:23:35.959031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.591004+0000","last_change":"2023-11-04T01:42:56.585586+0000","last_active":"2023-11-04T01:42:56.591004+0000","last_peered":"2023-11-04T01:42:56.591004+0000","last_clean":"2023-11-04T01:42:56.591004+0000","last_became_active":"2023-11-04T01:42:56.585325+0000","last_became_peered":"2023-11-04T01:42:56.585325+0000","last_unstale":"2023-11-04T01:42:56.591004+0000","last_undegraded":"2023-11-04T01:42:56.591004+0000","last_fullsized":"2023-11-04T01:42:56.591004+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:35.884718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.605340+0000","last_change":"2023-11-04T01:42:56.601394+0000","last_active":"2023-11-04T01:42:56.605340+0000","last_peered":"2023-11-04T01:42:56.605340+0000","last_clean":"2023-11-04T01:42:56.605340+0000","last_became_active":"2023-11-04T01:42:56.601146+0000","last_became_peered":"2023-11-04T01:42:56.601146+0000","last_unstale":"2023-11-04T01:42:56.605340+0000","last_undegraded":"2023-11-04T01:42:56.605340+0000","last_fullsized":"2023-11-04T01:42:56.605340+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:49:40.763349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.607608+0000","last_change":"2023-11-04T01:42:56.604358+0000","last_active":"2023-11-04T01:42:56.607608+0000","last_peered":"2023-11-04T01:42:56.607608+0000","last_clean":"2023-11-04T01:42:56.607608+0000","last_became_active":"2023-11-04T01:42:56.603975+0000","last_became_peered":"2023-11-04T01:42:56.603975+0000","last_unstale":"2023-11-04T01:42:56.607608+0000","last_undegraded":"2023-11-04T01:42:56.607608+0000","last_fullsized":"2023-11-04T01:42:56.607608+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:23:35.959031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.599986+0000","last_change":"2023-11-04T01:42:56.591662+0000","last_active":"2023-11-04T01:42:56.599986+0000","last_peered":"2023-11-04T01:42:56.599986+0000","last_clean":"2023-11-04T01:42:56.599986+0000","last_became_active":"2023-11-04T01:42:56.591407+0000","last_became_peered":"2023-11-04T01:42:56.591407+0000","last_unstale":"2023-11-04T01:42:56.599986+0000","last_undegraded":"2023-11-04T01:42:56.599986+0000","last_fullsized":"2023-11-04T01:42:56.599986+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:20:25.552753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.599864+0000","last_change":"2023-11-04T01:42:56.593762+0000","last_active":"2023-11-04T01:42:56.599864+0000","last_peered":"2023-11-04T01:42:56.599864+0000","last_clean":"2023-11-04T01:42:56.599864+0000","last_became_active":"2023-11-04T01:42:56.593420+0000","last_became_peered":"2023-11-04T01:42:56.593420+0000","last_unstale":"2023-11-04T01:42:56.599864+0000","last_undegraded":"2023-11-04T01:42:56.599864+0000","last_fullsized":"2023-11-04T01:42:56.599864+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:32.718463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.593868+0000","last_change":"2023-11-04T01:42:56.096984+0000","last_active":"2023-11-04T01:42:56.593868+0000","last_peered":"2023-11-04T01:42:56.593868+0000","last_clean":"2023-11-04T01:42:56.593868+0000","last_became_active":"2023-11-04T01:42:56.096725+0000","last_became_peered":"2023-11-04T01:42:56.096725+0000","last_unstale":"2023-11-04T01:42:56.593868+0000","last_undegraded":"2023-11-04T01:42:56.593868+0000","last_fullsized":"2023-11-04T01:42:56.593868+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:51:52.278839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.086887+0000","last_change":"2023-11-04T01:42:35.354740+0000","last_active":"2023-11-04T01:42:56.086887+0000","last_peered":"2023-11-04T01:42:56.086887+0000","last_clean":"2023-11-04T01:42:56.086887+0000","last_became_active":"2023-11-04T01:42:35.354383+0000","last_became_peered":"2023-11-04T01:42:35.354383+0000","last_unstale":"2023-11-04T01:42:56.086887+0000","last_undegraded":"2023-11-04T01:42:56.086887+0000","last_fullsized":"2023-11-04T01:42:56.086887+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:38.574240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.089467+0000","last_change":"2023-11-04T01:42:36.412560+0000","last_active":"2023-11-04T01:42:56.089467+0000","last_peered":"2023-11-04T01:42:56.089467+0000","last_clean":"2023-11-04T01:42:56.089467+0000","last_became_active":"2023-11-04T01:42:34.346736+0000","last_became_peered":"2023-11-04T01:42:34.346736+0000","last_unstale":"2023-11-04T01:42:56.089467+0000","last_undegraded":"2023-11-04T01:42:56.089467+0000","last_fullsized":"2023-11-04T01:42:56.089467+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:37.572320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071730100000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.091122+0000","last_change":"2023-11-04T01:41:36.067943+0000","last_active":"2023-11-04T01:42:56.091122+0000","last_peered":"2023-11-04T01:42:56.091122+0000","last_clean":"2023-11-04T01:42:56.091122+0000","last_became_active":"2023-11-04T01:41:34.734305+0000","last_became_peered":"2023-11-04T01:41:34.734305+0000","last_unstale":"2023-11-04T01:42:56.091122+0000","last_undegraded":"2023-11-04T01:42:56.091122+0000","last_fullsized":"2023-11-04T01:42:56.091122+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:48.121273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033780399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.608939+0000","last_change":"2023-11-04T01:42:56.605195+0000","last_active":"2023-11-04T01:42:56.608939+0000","last_peered":"2023-11-04T01:42:56.608939+0000","last_clean":"2023-11-04T01:42:56.608939+0000","last_became_active":"2023-11-04T01:42:56.604919+0000","last_became_peered":"2023-11-04T01:42:56.604919+0000","last_unstale":"2023-11-04T01:42:56.608939+0000","last_undegraded":"2023-11-04T01:42:56.608939+0000","last_fullsized":"2023-11-04T01:42:56.608939+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:15:38.894368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.588739+0000","last_change":"2023-11-04T01:42:56.097380+0000","last_active":"2023-11-04T01:42:56.588739+0000","last_peered":"2023-11-04T01:42:56.588739+0000","last_clean":"2023-11-04T01:42:56.588739+0000","last_became_active":"2023-11-04T01:42:56.097090+0000","last_became_peered":"2023-11-04T01:42:56.097090+0000","last_unstale":"2023-11-04T01:42:56.588739+0000","last_undegraded":"2023-11-04T01:42:56.588739+0000","last_fullsized":"2023-11-04T01:42:56.588739+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:15:37.889616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087863+0000","last_change":"2023-11-04T01:42:35.342778+0000","last_active":"2023-11-04T01:42:56.087863+0000","last_peered":"2023-11-04T01:42:56.087863+0000","last_clean":"2023-11-04T01:42:56.087863+0000","last_became_active":"2023-11-04T01:42:35.342368+0000","last_became_peered":"2023-11-04T01:42:35.342368+0000","last_unstale":"2023-11-04T01:42:56.087863+0000","last_undegraded":"2023-11-04T01:42:56.087863+0000","last_fullsized":"2023-11-04T01:42:56.087863+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:42.907508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.091370+0000","last_change":"2023-11-04T01:42:36.413379+0000","last_active":"2023-11-04T01:42:56.091370+0000","last_peered":"2023-11-04T01:42:56.091370+0000","last_clean":"2023-11-04T01:42:56.091370+0000","last_became_active":"2023-11-04T01:42:34.354671+0000","last_became_peered":"2023-11-04T01:42:34.354671+0000","last_unstale":"2023-11-04T01:42:56.091370+0000","last_undegraded":"2023-11-04T01:42:56.091370+0000","last_fullsized":"2023-11-04T01:42:56.091370+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:36:10.769073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071203900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087726+0000","last_change":"2023-11-04T01:41:35.728832+0000","last_active":"2023-11-04T01:42:56.087726+0000","last_peered":"2023-11-04T01:42:56.087726+0000","last_clean":"2023-11-04T01:42:56.087726+0000","last_became_active":"2023-11-04T01:41:34.733517+0000","last_became_peered":"2023-11-04T01:41:34.733517+0000","last_unstale":"2023-11-04T01:42:56.087726+0000","last_undegraded":"2023-11-04T01:42:56.087726+0000","last_fullsized":"2023-11-04T01:42:56.087726+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:19.350812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042545700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.606640+0000","last_change":"2023-11-04T01:42:56.600578+0000","last_active":"2023-11-04T01:42:56.606640+0000","last_peered":"2023-11-04T01:42:56.606640+0000","last_clean":"2023-11-04T01:42:56.606640+0000","last_became_active":"2023-11-04T01:42:56.599579+0000","last_became_peered":"2023-11-04T01:42:56.599579+0000","last_unstale":"2023-11-04T01:42:56.606640+0000","last_undegraded":"2023-11-04T01:42:56.606640+0000","last_fullsized":"2023-11-04T01:42:56.606640+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:55:13.050206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.585365+0000","last_change":"2023-11-04T01:42:56.104258+0000","last_active":"2023-11-04T01:42:56.585365+0000","last_peered":"2023-11-04T01:42:56.585365+0000","last_clean":"2023-11-04T01:42:56.585365+0000","last_became_active":"2023-11-04T01:42:56.104001+0000","last_became_peered":"2023-11-04T01:42:56.104001+0000","last_unstale":"2023-11-04T01:42:56.585365+0000","last_undegraded":"2023-11-04T01:42:56.585365+0000","last_fullsized":"2023-11-04T01:42:56.585365+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:36:21.655358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.090404+0000","last_change":"2023-11-04T01:42:35.348988+0000","last_active":"2023-11-04T01:42:56.090404+0000","last_peered":"2023-11-04T01:42:56.090404+0000","last_clean":"2023-11-04T01:42:56.090404+0000","last_became_active":"2023-11-04T01:42:35.348666+0000","last_became_peered":"2023-11-04T01:42:35.348666+0000","last_unstale":"2023-11-04T01:42:56.090404+0000","last_undegraded":"2023-11-04T01:42:56.090404+0000","last_fullsized":"2023-11-04T01:42:56.090404+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:08:28.888035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087551+0000","last_change":"2023-11-04T01:42:36.408544+0000","last_active":"2023-11-04T01:42:56.087551+0000","last_peered":"2023-11-04T01:42:56.087551+0000","last_clean":"2023-11-04T01:42:56.087551+0000","last_became_active":"2023-11-04T01:42:34.350627+0000","last_became_peered":"2023-11-04T01:42:34.350627+0000","last_unstale":"2023-11-04T01:42:56.087551+0000","last_undegraded":"2023-11-04T01:42:56.087551+0000","last_fullsized":"2023-11-04T01:42:56.087551+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:22:16.530179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059637199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.091673+0000","last_change":"2023-11-04T01:41:35.906660+0000","last_active":"2023-11-04T01:42:56.091673+0000","last_peered":"2023-11-04T01:42:56.091673+0000","last_clean":"2023-11-04T01:42:56.091673+0000","last_became_active":"2023-11-04T01:41:34.737209+0000","last_became_peered":"2023-11-04T01:41:34.737209+0000","last_unstale":"2023-11-04T01:42:56.091673+0000","last_undegraded":"2023-11-04T01:42:56.091673+0000","last_fullsized":"2023-11-04T01:42:56.091673+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:59.608410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068889500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.605356+0000","last_change":"2023-11-04T01:42:56.602906+0000","last_active":"2023-11-04T01:42:56.605356+0000","last_peered":"2023-11-04T01:42:56.605356+0000","last_clean":"2023-11-04T01:42:56.605356+0000","last_became_active":"2023-11-04T01:42:56.602639+0000","last_became_peered":"2023-11-04T01:42:56.602639+0000","last_unstale":"2023-11-04T01:42:56.605356+0000","last_undegraded":"2023-11-04T01:42:56.605356+0000","last_fullsized":"2023-11-04T01:42:56.605356+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:42:57.884333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.583893+0000","last_change":"2023-11-04T01:42:56.097961+0000","last_active":"2023-11-04T01:42:56.583893+0000","last_peered":"2023-11-04T01:42:56.583893+0000","last_clean":"2023-11-04T01:42:56.583893+0000","last_became_active":"2023-11-04T01:42:56.097674+0000","last_became_peered":"2023-11-04T01:42:56.097674+0000","last_unstale":"2023-11-04T01:42:56.583893+0000","last_undegraded":"2023-11-04T01:42:56.583893+0000","last_fullsized":"2023-11-04T01:42:56.583893+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:55.635351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.096333+0000","last_change":"2023-11-04T01:42:35.355495+0000","last_active":"2023-11-04T01:42:56.096333+0000","last_peered":"2023-11-04T01:42:56.096333+0000","last_clean":"2023-11-04T01:42:56.096333+0000","last_became_active":"2023-11-04T01:42:35.355032+0000","last_became_peered":"2023-11-04T01:42:35.355032+0000","last_unstale":"2023-11-04T01:42:56.096333+0000","last_undegraded":"2023-11-04T01:42:56.096333+0000","last_fullsized":"2023-11-04T01:42:56.096333+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:48.181161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.088370+0000","last_change":"2023-11-04T01:42:36.413121+0000","last_active":"2023-11-04T01:42:56.088370+0000","last_peered":"2023-11-04T01:42:56.088370+0000","last_clean":"2023-11-04T01:42:56.088370+0000","last_became_active":"2023-11-04T01:42:34.348018+0000","last_became_peered":"2023-11-04T01:42:34.348018+0000","last_unstale":"2023-11-04T01:42:56.088370+0000","last_undegraded":"2023-11-04T01:42:56.088370+0000","last_fullsized":"2023-11-04T01:42:56.088370+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:01:38.616017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088815699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.090893+0000","last_change":"2023-11-04T01:41:36.067946+0000","last_active":"2023-11-04T01:42:56.090893+0000","last_peered":"2023-11-04T01:42:56.090893+0000","last_clean":"2023-11-04T01:42:56.090893+0000","last_became_active":"2023-11-04T01:41:34.729591+0000","last_became_peered":"2023-11-04T01:41:34.729591+0000","last_unstale":"2023-11-04T01:42:56.090893+0000","last_undegraded":"2023-11-04T01:42:56.090893+0000","last_fullsized":"2023-11-04T01:42:56.090893+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:59.608410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032681099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.607358+0000","last_change":"2023-11-04T01:42:56.603951+0000","last_active":"2023-11-04T01:42:56.607358+0000","last_peered":"2023-11-04T01:42:56.607358+0000","last_clean":"2023-11-04T01:42:56.607358+0000","last_became_active":"2023-11-04T01:42:56.603707+0000","last_became_peered":"2023-11-04T01:42:56.603707+0000","last_unstale":"2023-11-04T01:42:56.607358+0000","last_undegraded":"2023-11-04T01:42:56.607358+0000","last_fullsized":"2023-11-04T01:42:56.607358+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:05.593291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"82'8","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:57.108627+0000","last_change":"2023-11-04T01:42:56.102773+0000","last_active":"2023-11-04T01:42:57.108627+0000","last_peered":"2023-11-04T01:42:57.108627+0000","last_clean":"2023-11-04T01:42:57.108627+0000","last_became_active":"2023-11-04T01:42:56.102535+0000","last_became_peered":"2023-11-04T01:42:56.102535+0000","last_unstale":"2023-11-04T01:42:57.108627+0000","last_undegraded":"2023-11-04T01:42:57.108627+0000","last_fullsized":"2023-11-04T01:42:57.108627+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:08:49.628793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087025+0000","last_change":"2023-11-04T01:42:35.345520+0000","last_active":"2023-11-04T01:42:56.087025+0000","last_peered":"2023-11-04T01:42:56.087025+0000","last_clean":"2023-11-04T01:42:56.087025+0000","last_became_active":"2023-11-04T01:42:35.345171+0000","last_became_peered":"2023-11-04T01:42:35.345171+0000","last_unstale":"2023-11-04T01:42:56.087025+0000","last_undegraded":"2023-11-04T01:42:56.087025+0000","last_fullsized":"2023-11-04T01:42:56.087025+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:09:48.559668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.086558+0000","last_change":"2023-11-04T01:42:36.408199+0000","last_active":"2023-11-04T01:42:56.086558+0000","last_peered":"2023-11-04T01:42:56.086558+0000","last_clean":"2023-11-04T01:42:56.086558+0000","last_became_active":"2023-11-04T01:42:34.346643+0000","last_became_peered":"2023-11-04T01:42:34.346643+0000","last_unstale":"2023-11-04T01:42:56.086558+0000","last_undegraded":"2023-11-04T01:42:56.086558+0000","last_fullsized":"2023-11-04T01:42:56.086558+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:16:15.635771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056985800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.088014+0000","last_change":"2023-11-04T01:41:35.905999+0000","last_active":"2023-11-04T01:42:56.088014+0000","last_peered":"2023-11-04T01:42:56.088014+0000","last_clean":"2023-11-04T01:42:56.088014+0000","last_became_active":"2023-11-04T01:41:34.735286+0000","last_became_peered":"2023-11-04T01:41:34.735286+0000","last_unstale":"2023-11-04T01:42:56.088014+0000","last_undegraded":"2023-11-04T01:42:56.088014+0000","last_fullsized":"2023-11-04T01:42:56.088014+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:14:22.019781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051880100000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.599829+0000","last_change":"2023-11-04T01:42:56.596070+0000","last_active":"2023-11-04T01:42:56.599829+0000","last_peered":"2023-11-04T01:42:56.599829+0000","last_clean":"2023-11-04T01:42:56.599829+0000","last_became_active":"2023-11-04T01:42:56.595784+0000","last_became_peered":"2023-11-04T01:42:56.595784+0000","last_unstale":"2023-11-04T01:42:56.599829+0000","last_undegraded":"2023-11-04T01:42:56.599829+0000","last_fullsized":"2023-11-04T01:42:56.599829+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:51:34.813734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.592414+0000","last_change":"2023-11-04T01:42:56.098826+0000","last_active":"2023-11-04T01:42:56.592414+0000","last_peered":"2023-11-04T01:42:56.592414+0000","last_clean":"2023-11-04T01:42:56.592414+0000","last_became_active":"2023-11-04T01:42:56.098568+0000","last_became_peered":"2023-11-04T01:42:56.098568+0000","last_unstale":"2023-11-04T01:42:56.592414+0000","last_undegraded":"2023-11-04T01:42:56.592414+0000","last_fullsized":"2023-11-04T01:42:56.592414+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:13:03.648267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087220+0000","last_change":"2023-11-04T01:42:35.347120+0000","last_active":"2023-11-04T01:42:56.087220+0000","last_peered":"2023-11-04T01:42:56.087220+0000","last_clean":"2023-11-04T01:42:56.087220+0000","last_became_active":"2023-11-04T01:42:35.346861+0000","last_became_peered":"2023-11-04T01:42:35.346861+0000","last_unstale":"2023-11-04T01:42:56.087220+0000","last_undegraded":"2023-11-04T01:42:56.087220+0000","last_fullsized":"2023-11-04T01:42:56.087220+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:51:31.538081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.090065+0000","last_change":"2023-11-04T01:42:36.409273+0000","last_active":"2023-11-04T01:42:56.090065+0000","last_peered":"2023-11-04T01:42:56.090065+0000","last_clean":"2023-11-04T01:42:56.090065+0000","last_became_active":"2023-11-04T01:42:34.349691+0000","last_became_peered":"2023-11-04T01:42:34.349691+0000","last_unstale":"2023-11-04T01:42:56.090065+0000","last_undegraded":"2023-11-04T01:42:56.090065+0000","last_fullsized":"2023-11-04T01:42:56.090065+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:04:04.521532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000397551,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.088339+0000","last_change":"2023-11-04T01:41:36.344205+0000","last_active":"2023-11-04T01:42:56.088339+0000","last_peered":"2023-11-04T01:42:56.088339+0000","last_clean":"2023-11-04T01:42:56.088339+0000","last_became_active":"2023-11-04T01:41:34.733205+0000","last_became_peered":"2023-11-04T01:41:34.733205+0000","last_unstale":"2023-11-04T01:42:56.088339+0000","last_undegraded":"2023-11-04T01:42:56.088339+0000","last_fullsized":"2023-11-04T01:42:56.088339+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:37.958719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011584760000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.607467+0000","last_change":"2023-11-04T01:42:56.600672+0000","last_active":"2023-11-04T01:42:56.607467+0000","last_peered":"2023-11-04T01:42:56.607467+0000","last_clean":"2023-11-04T01:42:56.607467+0000","last_became_active":"2023-11-04T01:42:56.600416+0000","last_became_peered":"2023-11-04T01:42:56.600416+0000","last_unstale":"2023-11-04T01:42:56.607467+0000","last_undegraded":"2023-11-04T01:42:56.607467+0000","last_fullsized":"2023-11-04T01:42:56.607467+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:51.340475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.593493+0000","last_change":"2023-11-04T01:42:56.098187+0000","last_active":"2023-11-04T01:42:56.593493+0000","last_peered":"2023-11-04T01:42:56.593493+0000","last_clean":"2023-11-04T01:42:56.593493+0000","last_became_active":"2023-11-04T01:42:56.097915+0000","last_became_peered":"2023-11-04T01:42:56.097915+0000","last_unstale":"2023-11-04T01:42:56.593493+0000","last_undegraded":"2023-11-04T01:42:56.593493+0000","last_fullsized":"2023-11-04T01:42:56.593493+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:40:59.393919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.088153+0000","last_change":"2023-11-04T01:42:35.355437+0000","last_active":"2023-11-04T01:42:56.088153+0000","last_peered":"2023-11-04T01:42:56.088153+0000","last_clean":"2023-11-04T01:42:56.088153+0000","last_became_active":"2023-11-04T01:42:35.355084+0000","last_became_peered":"2023-11-04T01:42:35.355084+0000","last_unstale":"2023-11-04T01:42:56.088153+0000","last_undegraded":"2023-11-04T01:42:56.088153+0000","last_fullsized":"2023-11-04T01:42:56.088153+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:39:42.671180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.088277+0000","last_change":"2023-11-04T01:42:36.341135+0000","last_active":"2023-11-04T01:42:56.088277+0000","last_peered":"2023-11-04T01:42:56.088277+0000","last_clean":"2023-11-04T01:42:56.088277+0000","last_became_active":"2023-11-04T01:42:34.344383+0000","last_became_peered":"2023-11-04T01:42:34.344383+0000","last_unstale":"2023-11-04T01:42:56.088277+0000","last_undegraded":"2023-11-04T01:42:56.088277+0000","last_fullsized":"2023-11-04T01:42:56.088277+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:31:27.915960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011027179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.092560+0000","last_change":"2023-11-04T01:41:36.343728+0000","last_active":"2023-11-04T01:42:56.092560+0000","last_peered":"2023-11-04T01:42:56.092560+0000","last_clean":"2023-11-04T01:42:56.092560+0000","last_became_active":"2023-11-04T01:41:34.731106+0000","last_became_peered":"2023-11-04T01:41:34.731106+0000","last_unstale":"2023-11-04T01:42:56.092560+0000","last_undegraded":"2023-11-04T01:42:56.092560+0000","last_fullsized":"2023-11-04T01:42:56.092560+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:29.730483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058974500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.594256+0000","last_change":"2023-11-04T01:42:56.588676+0000","last_active":"2023-11-04T01:42:56.594256+0000","last_peered":"2023-11-04T01:42:56.594256+0000","last_clean":"2023-11-04T01:42:56.594256+0000","last_became_active":"2023-11-04T01:42:56.588303+0000","last_became_peered":"2023-11-04T01:42:56.588303+0000","last_unstale":"2023-11-04T01:42:56.594256+0000","last_undegraded":"2023-11-04T01:42:56.594256+0000","last_fullsized":"2023-11-04T01:42:56.594256+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:43:47.542910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.595580+0000","last_change":"2023-11-04T01:42:56.097458+0000","last_active":"2023-11-04T01:42:56.595580+0000","last_peered":"2023-11-04T01:42:56.595580+0000","last_clean":"2023-11-04T01:42:56.595580+0000","last_became_active":"2023-11-04T01:42:56.097195+0000","last_became_peered":"2023-11-04T01:42:56.097195+0000","last_unstale":"2023-11-04T01:42:56.595580+0000","last_undegraded":"2023-11-04T01:42:56.595580+0000","last_fullsized":"2023-11-04T01:42:56.595580+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:45:28.267997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.089000+0000","last_change":"2023-11-04T01:42:35.349178+0000","last_active":"2023-11-04T01:42:56.089000+0000","last_peered":"2023-11-04T01:42:56.089000+0000","last_clean":"2023-11-04T01:42:56.089000+0000","last_became_active":"2023-11-04T01:42:35.348762+0000","last_became_peered":"2023-11-04T01:42:35.348762+0000","last_unstale":"2023-11-04T01:42:56.089000+0000","last_undegraded":"2023-11-04T01:42:56.089000+0000","last_fullsized":"2023-11-04T01:42:56.089000+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:50:43.272196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.089661+0000","last_change":"2023-11-04T01:42:36.408535+0000","last_active":"2023-11-04T01:42:56.089661+0000","last_peered":"2023-11-04T01:42:56.089661+0000","last_clean":"2023-11-04T01:42:56.089661+0000","last_became_active":"2023-11-04T01:42:34.351574+0000","last_became_peered":"2023-11-04T01:42:34.351574+0000","last_unstale":"2023-11-04T01:42:56.089661+0000","last_undegraded":"2023-11-04T01:42:56.089661+0000","last_fullsized":"2023-11-04T01:42:56.089661+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:28.593045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053030500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087926+0000","last_change":"2023-11-04T01:41:35.931778+0000","last_active":"2023-11-04T01:42:56.087926+0000","last_peered":"2023-11-04T01:42:56.087926+0000","last_clean":"2023-11-04T01:42:56.087926+0000","last_became_active":"2023-11-04T01:41:34.736897+0000","last_became_peered":"2023-11-04T01:41:34.736897+0000","last_unstale":"2023-11-04T01:42:56.087926+0000","last_undegraded":"2023-11-04T01:42:56.087926+0000","last_fullsized":"2023-11-04T01:42:56.087926+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:20.089706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071523300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.602426+0000","last_change":"2023-11-04T01:42:56.599306+0000","last_active":"2023-11-04T01:42:56.602426+0000","last_peered":"2023-11-04T01:42:56.602426+0000","last_clean":"2023-11-04T01:42:56.602426+0000","last_became_active":"2023-11-04T01:42:56.598964+0000","last_became_peered":"2023-11-04T01:42:56.598964+0000","last_unstale":"2023-11-04T01:42:56.602426+0000","last_undegraded":"2023-11-04T01:42:56.602426+0000","last_fullsized":"2023-11-04T01:42:56.602426+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:52.960905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.580184+0000","last_change":"2023-11-04T01:42:56.106207+0000","last_active":"2023-11-04T01:42:56.580184+0000","last_peered":"2023-11-04T01:42:56.580184+0000","last_clean":"2023-11-04T01:42:56.580184+0000","last_became_active":"2023-11-04T01:42:56.106035+0000","last_became_peered":"2023-11-04T01:42:56.106035+0000","last_unstale":"2023-11-04T01:42:56.580184+0000","last_undegraded":"2023-11-04T01:42:56.580184+0000","last_fullsized":"2023-11-04T01:42:56.580184+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:50:36.875678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.091597+0000","last_change":"2023-11-04T01:42:35.353394+0000","last_active":"2023-11-04T01:42:56.091597+0000","last_peered":"2023-11-04T01:42:56.091597+0000","last_clean":"2023-11-04T01:42:56.091597+0000","last_became_active":"2023-11-04T01:42:35.353098+0000","last_became_peered":"2023-11-04T01:42:35.353098+0000","last_unstale":"2023-11-04T01:42:56.091597+0000","last_undegraded":"2023-11-04T01:42:56.091597+0000","last_fullsized":"2023-11-04T01:42:56.091597+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:51:13.068224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.089308+0000","last_change":"2023-11-04T01:42:36.412911+0000","last_active":"2023-11-04T01:42:56.089308+0000","last_peered":"2023-11-04T01:42:56.089308+0000","last_clean":"2023-11-04T01:42:56.089308+0000","last_became_active":"2023-11-04T01:42:34.349620+0000","last_became_peered":"2023-11-04T01:42:34.349620+0000","last_unstale":"2023-11-04T01:42:56.089308+0000","last_undegraded":"2023-11-04T01:42:56.089308+0000","last_fullsized":"2023-11-04T01:42:56.089308+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:22:16.530179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041040599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087806+0000","last_change":"2023-11-04T01:41:35.729017+0000","last_active":"2023-11-04T01:42:56.087806+0000","last_peered":"2023-11-04T01:42:56.087806+0000","last_clean":"2023-11-04T01:42:56.087806+0000","last_became_active":"2023-11-04T01:41:34.730592+0000","last_became_peered":"2023-11-04T01:41:34.730592+0000","last_unstale":"2023-11-04T01:42:56.087806+0000","last_undegraded":"2023-11-04T01:42:56.087806+0000","last_fullsized":"2023-11-04T01:42:56.087806+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:08.858430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088820999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.607506+0000","last_change":"2023-11-04T01:42:56.601679+0000","last_active":"2023-11-04T01:42:56.607506+0000","last_peered":"2023-11-04T01:42:56.607506+0000","last_clean":"2023-11-04T01:42:56.607506+0000","last_became_active":"2023-11-04T01:42:56.601437+0000","last_became_peered":"2023-11-04T01:42:56.601437+0000","last_unstale":"2023-11-04T01:42:56.607506+0000","last_undegraded":"2023-11-04T01:42:56.607506+0000","last_fullsized":"2023-11-04T01:42:56.607506+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:22:39.277610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.580219+0000","last_change":"2023-11-04T01:42:56.104057+0000","last_active":"2023-11-04T01:42:56.580219+0000","last_peered":"2023-11-04T01:42:56.580219+0000","last_clean":"2023-11-04T01:42:56.580219+0000","last_became_active":"2023-11-04T01:42:56.103688+0000","last_became_peered":"2023-11-04T01:42:56.103688+0000","last_unstale":"2023-11-04T01:42:56.580219+0000","last_undegraded":"2023-11-04T01:42:56.580219+0000","last_fullsized":"2023-11-04T01:42:56.580219+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:52:32.087602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.089148+0000","last_change":"2023-11-04T01:42:35.355799+0000","last_active":"2023-11-04T01:42:56.089148+0000","last_peered":"2023-11-04T01:42:56.089148+0000","last_clean":"2023-11-04T01:42:56.089148+0000","last_became_active":"2023-11-04T01:42:35.355542+0000","last_became_peered":"2023-11-04T01:42:35.355542+0000","last_unstale":"2023-11-04T01:42:56.089148+0000","last_undegraded":"2023-11-04T01:42:56.089148+0000","last_fullsized":"2023-11-04T01:42:56.089148+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:10:24.565360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.091815+0000","last_change":"2023-11-04T01:42:36.413447+0000","last_active":"2023-11-04T01:42:56.091815+0000","last_peered":"2023-11-04T01:42:56.091815+0000","last_clean":"2023-11-04T01:42:56.091815+0000","last_became_active":"2023-11-04T01:42:34.351191+0000","last_became_peered":"2023-11-04T01:42:34.351191+0000","last_unstale":"2023-11-04T01:42:56.091815+0000","last_undegraded":"2023-11-04T01:42:56.091815+0000","last_fullsized":"2023-11-04T01:42:56.091815+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:32:10.544188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082047100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087346+0000","last_change":"2023-11-04T01:41:35.729378+0000","last_active":"2023-11-04T01:42:56.087346+0000","last_peered":"2023-11-04T01:42:56.087346+0000","last_clean":"2023-11-04T01:42:56.087346+0000","last_became_active":"2023-11-04T01:41:34.730387+0000","last_became_peered":"2023-11-04T01:41:34.730387+0000","last_unstale":"2023-11-04T01:42:56.087346+0000","last_undegraded":"2023-11-04T01:42:56.087346+0000","last_fullsized":"2023-11-04T01:42:56.087346+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:12.653602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072268699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.607593+0000","last_change":"2023-11-04T01:42:56.604213+0000","last_active":"2023-11-04T01:42:56.607593+0000","last_peered":"2023-11-04T01:42:56.607593+0000","last_clean":"2023-11-04T01:42:56.607593+0000","last_became_active":"2023-11-04T01:42:56.603937+0000","last_became_peered":"2023-11-04T01:42:56.603937+0000","last_unstale":"2023-11-04T01:42:56.607593+0000","last_undegraded":"2023-11-04T01:42:56.607593+0000","last_fullsized":"2023-11-04T01:42:56.607593+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:49:30.516581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.588370+0000","last_change":"2023-11-04T01:42:56.102778+0000","last_active":"2023-11-04T01:42:56.588370+0000","last_peered":"2023-11-04T01:42:56.588370+0000","last_clean":"2023-11-04T01:42:56.588370+0000","last_became_active":"2023-11-04T01:42:56.102559+0000","last_became_peered":"2023-11-04T01:42:56.102559+0000","last_unstale":"2023-11-04T01:42:56.588370+0000","last_undegraded":"2023-11-04T01:42:56.588370+0000","last_fullsized":"2023-11-04T01:42:56.588370+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:23:34.954279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087304+0000","last_change":"2023-11-04T01:42:35.352317+0000","last_active":"2023-11-04T01:42:56.087304+0000","last_peered":"2023-11-04T01:42:56.087304+0000","last_clean":"2023-11-04T01:42:56.087304+0000","last_became_active":"2023-11-04T01:42:35.351486+0000","last_became_peered":"2023-11-04T01:42:35.351486+0000","last_unstale":"2023-11-04T01:42:56.087304+0000","last_undegraded":"2023-11-04T01:42:56.087304+0000","last_fullsized":"2023-11-04T01:42:56.087304+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:33:20.111728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.096500+0000","last_change":"2023-11-04T01:42:36.342710+0000","last_active":"2023-11-04T01:42:56.096500+0000","last_peered":"2023-11-04T01:42:56.096500+0000","last_clean":"2023-11-04T01:42:56.096500+0000","last_became_active":"2023-11-04T01:42:34.349773+0000","last_became_peered":"2023-11-04T01:42:34.349773+0000","last_unstale":"2023-11-04T01:42:56.096500+0000","last_undegraded":"2023-11-04T01:42:56.096500+0000","last_fullsized":"2023-11-04T01:42:56.096500+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:55:22.976726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077362500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087997+0000","last_change":"2023-11-04T01:41:35.729318+0000","last_active":"2023-11-04T01:42:56.087997+0000","last_peered":"2023-11-04T01:42:56.087997+0000","last_clean":"2023-11-04T01:42:56.087997+0000","last_became_active":"2023-11-04T01:41:34.733796+0000","last_became_peered":"2023-11-04T01:41:34.733796+0000","last_unstale":"2023-11-04T01:42:56.087997+0000","last_undegraded":"2023-11-04T01:42:56.087997+0000","last_fullsized":"2023-11-04T01:42:56.087997+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:19.350812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053712200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.605368+0000","last_change":"2023-11-04T01:42:56.601449+0000","last_active":"2023-11-04T01:42:56.605368+0000","last_peered":"2023-11-04T01:42:56.605368+0000","last_clean":"2023-11-04T01:42:56.605368+0000","last_became_active":"2023-11-04T01:42:56.601184+0000","last_became_peered":"2023-11-04T01:42:56.601184+0000","last_unstale":"2023-11-04T01:42:56.605368+0000","last_undegraded":"2023-11-04T01:42:56.605368+0000","last_fullsized":"2023-11-04T01:42:56.605368+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:13.438469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.581600+0000","last_change":"2023-11-04T01:42:56.100703+0000","last_active":"2023-11-04T01:42:56.581600+0000","last_peered":"2023-11-04T01:42:56.581600+0000","last_clean":"2023-11-04T01:42:56.581600+0000","last_became_active":"2023-11-04T01:42:56.100470+0000","last_became_peered":"2023-11-04T01:42:56.100470+0000","last_unstale":"2023-11-04T01:42:56.581600+0000","last_undegraded":"2023-11-04T01:42:56.581600+0000","last_fullsized":"2023-11-04T01:42:56.581600+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:14:03.311455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.090282+0000","last_change":"2023-11-04T01:42:35.355335+0000","last_active":"2023-11-04T01:42:56.090282+0000","last_peered":"2023-11-04T01:42:56.090282+0000","last_clean":"2023-11-04T01:42:56.090282+0000","last_became_active":"2023-11-04T01:42:35.355057+0000","last_became_peered":"2023-11-04T01:42:35.355057+0000","last_unstale":"2023-11-04T01:42:56.090282+0000","last_undegraded":"2023-11-04T01:42:56.090282+0000","last_fullsized":"2023-11-04T01:42:56.090282+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:34:48.488293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.095546+0000","last_change":"2023-11-04T01:42:36.342412+0000","last_active":"2023-11-04T01:42:56.095546+0000","last_peered":"2023-11-04T01:42:56.095546+0000","last_clean":"2023-11-04T01:42:56.095546+0000","last_became_active":"2023-11-04T01:42:34.344325+0000","last_became_peered":"2023-11-04T01:42:34.344325+0000","last_unstale":"2023-11-04T01:42:56.095546+0000","last_undegraded":"2023-11-04T01:42:56.095546+0000","last_fullsized":"2023-11-04T01:42:56.095546+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:29:52.259787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010133010000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.089408+0000","last_change":"2023-11-04T01:41:35.931929+0000","last_active":"2023-11-04T01:42:56.089408+0000","last_peered":"2023-11-04T01:42:56.089408+0000","last_clean":"2023-11-04T01:42:56.089408+0000","last_became_active":"2023-11-04T01:41:34.738795+0000","last_became_peered":"2023-11-04T01:41:34.738795+0000","last_unstale":"2023-11-04T01:42:56.089408+0000","last_undegraded":"2023-11-04T01:42:56.089408+0000","last_fullsized":"2023-11-04T01:42:56.089408+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:59.608410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046204999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.600717+0000","last_change":"2023-11-04T01:42:56.596072+0000","last_active":"2023-11-04T01:42:56.600717+0000","last_peered":"2023-11-04T01:42:56.600717+0000","last_clean":"2023-11-04T01:42:56.600717+0000","last_became_active":"2023-11-04T01:42:56.595799+0000","last_became_peered":"2023-11-04T01:42:56.595799+0000","last_unstale":"2023-11-04T01:42:56.600717+0000","last_undegraded":"2023-11-04T01:42:56.600717+0000","last_fullsized":"2023-11-04T01:42:56.600717+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:48:39.629960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.582340+0000","last_change":"2023-11-04T01:42:56.102091+0000","last_active":"2023-11-04T01:42:56.582340+0000","last_peered":"2023-11-04T01:42:56.582340+0000","last_clean":"2023-11-04T01:42:56.582340+0000","last_became_active":"2023-11-04T01:42:56.101856+0000","last_became_peered":"2023-11-04T01:42:56.101856+0000","last_unstale":"2023-11-04T01:42:56.582340+0000","last_undegraded":"2023-11-04T01:42:56.582340+0000","last_fullsized":"2023-11-04T01:42:56.582340+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:14:03.210664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087748+0000","last_change":"2023-11-04T01:42:35.352853+0000","last_active":"2023-11-04T01:42:56.087748+0000","last_peered":"2023-11-04T01:42:56.087748+0000","last_clean":"2023-11-04T01:42:56.087748+0000","last_became_active":"2023-11-04T01:42:35.351314+0000","last_became_peered":"2023-11-04T01:42:35.351314+0000","last_unstale":"2023-11-04T01:42:56.087748+0000","last_undegraded":"2023-11-04T01:42:56.087748+0000","last_fullsized":"2023-11-04T01:42:56.087748+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:24:28.106438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087771+0000","last_change":"2023-11-04T01:42:36.411957+0000","last_active":"2023-11-04T01:42:56.087771+0000","last_peered":"2023-11-04T01:42:56.087771+0000","last_clean":"2023-11-04T01:42:56.087771+0000","last_became_active":"2023-11-04T01:42:34.348584+0000","last_became_peered":"2023-11-04T01:42:34.348584+0000","last_unstale":"2023-11-04T01:42:56.087771+0000","last_undegraded":"2023-11-04T01:42:56.087771+0000","last_fullsized":"2023-11-04T01:42:56.087771+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:30.702295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089633200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.086020+0000","last_change":"2023-11-04T01:41:35.728945+0000","last_active":"2023-11-04T01:42:56.086020+0000","last_peered":"2023-11-04T01:42:56.086020+0000","last_clean":"2023-11-04T01:42:56.086020+0000","last_became_active":"2023-11-04T01:41:34.735082+0000","last_became_peered":"2023-11-04T01:41:34.735082+0000","last_unstale":"2023-11-04T01:42:56.086020+0000","last_undegraded":"2023-11-04T01:42:56.086020+0000","last_fullsized":"2023-11-04T01:42:56.086020+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:16.970814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079093000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.594291+0000","last_change":"2023-11-04T01:42:56.589270+0000","last_active":"2023-11-04T01:42:56.594291+0000","last_peered":"2023-11-04T01:42:56.594291+0000","last_clean":"2023-11-04T01:42:56.594291+0000","last_became_active":"2023-11-04T01:42:56.588986+0000","last_became_peered":"2023-11-04T01:42:56.588986+0000","last_unstale":"2023-11-04T01:42:56.594291+0000","last_undegraded":"2023-11-04T01:42:56.594291+0000","last_fullsized":"2023-11-04T01:42:56.594291+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:32.718463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.598181+0000","last_change":"2023-11-04T01:42:56.100834+0000","last_active":"2023-11-04T01:42:56.598181+0000","last_peered":"2023-11-04T01:42:56.598181+0000","last_clean":"2023-11-04T01:42:56.598181+0000","last_became_active":"2023-11-04T01:42:56.100515+0000","last_became_peered":"2023-11-04T01:42:56.100515+0000","last_unstale":"2023-11-04T01:42:56.598181+0000","last_undegraded":"2023-11-04T01:42:56.598181+0000","last_fullsized":"2023-11-04T01:42:56.598181+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:49:29.511829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.090698+0000","last_change":"2023-11-04T01:42:35.349043+0000","last_active":"2023-11-04T01:42:56.090698+0000","last_peered":"2023-11-04T01:42:56.090698+0000","last_clean":"2023-11-04T01:42:56.090698+0000","last_became_active":"2023-11-04T01:42:35.348696+0000","last_became_peered":"2023-11-04T01:42:35.348696+0000","last_unstale":"2023-11-04T01:42:56.090698+0000","last_undegraded":"2023-11-04T01:42:56.090698+0000","last_fullsized":"2023-11-04T01:42:56.090698+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:21:03.655247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087847+0000","last_change":"2023-11-04T01:42:36.412004+0000","last_active":"2023-11-04T01:42:56.087847+0000","last_peered":"2023-11-04T01:42:56.087847+0000","last_clean":"2023-11-04T01:42:56.087847+0000","last_became_active":"2023-11-04T01:42:34.347931+0000","last_became_peered":"2023-11-04T01:42:34.347931+0000","last_unstale":"2023-11-04T01:42:56.087847+0000","last_undegraded":"2023-11-04T01:42:56.087847+0000","last_fullsized":"2023-11-04T01:42:56.087847+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:04.045465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092725399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.086264+0000","last_change":"2023-11-04T01:41:35.728625+0000","last_active":"2023-11-04T01:42:56.086264+0000","last_peered":"2023-11-04T01:42:56.086264+0000","last_clean":"2023-11-04T01:42:56.086264+0000","last_became_active":"2023-11-04T01:41:34.731514+0000","last_became_peered":"2023-11-04T01:41:34.731514+0000","last_unstale":"2023-11-04T01:42:56.086264+0000","last_undegraded":"2023-11-04T01:42:56.086264+0000","last_fullsized":"2023-11-04T01:42:56.086264+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:51:50.413223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047686400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.608711+0000","last_change":"2023-11-04T01:42:56.602931+0000","last_active":"2023-11-04T01:42:56.608711+0000","last_peered":"2023-11-04T01:42:56.608711+0000","last_clean":"2023-11-04T01:42:56.608711+0000","last_became_active":"2023-11-04T01:42:56.602655+0000","last_became_peered":"2023-11-04T01:42:56.602655+0000","last_unstale":"2023-11-04T01:42:56.608711+0000","last_undegraded":"2023-11-04T01:42:56.608711+0000","last_fullsized":"2023-11-04T01:42:56.608711+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:55:45.724157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.579864+0000","last_change":"2023-11-04T01:42:56.097551+0000","last_active":"2023-11-04T01:42:56.579864+0000","last_peered":"2023-11-04T01:42:56.579864+0000","last_clean":"2023-11-04T01:42:56.579864+0000","last_became_active":"2023-11-04T01:42:56.097293+0000","last_became_peered":"2023-11-04T01:42:56.097293+0000","last_unstale":"2023-11-04T01:42:56.579864+0000","last_undegraded":"2023-11-04T01:42:56.579864+0000","last_fullsized":"2023-11-04T01:42:56.579864+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:12:39.723115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.086494+0000","last_change":"2023-11-04T01:42:35.344216+0000","last_active":"2023-11-04T01:42:56.086494+0000","last_peered":"2023-11-04T01:42:56.086494+0000","last_clean":"2023-11-04T01:42:56.086494+0000","last_became_active":"2023-11-04T01:42:35.343986+0000","last_became_peered":"2023-11-04T01:42:35.343986+0000","last_unstale":"2023-11-04T01:42:56.086494+0000","last_undegraded":"2023-11-04T01:42:56.086494+0000","last_fullsized":"2023-11-04T01:42:56.086494+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:32.012283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.089074+0000","last_change":"2023-11-04T01:42:36.408418+0000","last_active":"2023-11-04T01:42:56.089074+0000","last_peered":"2023-11-04T01:42:56.089074+0000","last_clean":"2023-11-04T01:42:56.089074+0000","last_became_active":"2023-11-04T01:42:34.345245+0000","last_became_peered":"2023-11-04T01:42:34.345245+0000","last_unstale":"2023-11-04T01:42:56.089074+0000","last_undegraded":"2023-11-04T01:42:56.089074+0000","last_fullsized":"2023-11-04T01:42:56.089074+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:01:34.850682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042992099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.092626+0000","last_change":"2023-11-04T01:41:36.343762+0000","last_active":"2023-11-04T01:42:56.092626+0000","last_peered":"2023-11-04T01:42:56.092626+0000","last_clean":"2023-11-04T01:42:56.092626+0000","last_became_active":"2023-11-04T01:41:34.733406+0000","last_became_peered":"2023-11-04T01:41:34.733406+0000","last_unstale":"2023-11-04T01:42:56.092626+0000","last_undegraded":"2023-11-04T01:42:56.092626+0000","last_fullsized":"2023-11-04T01:42:56.092626+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:34:35.541159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058533399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.605012+0000","last_change":"2023-11-04T01:42:56.604268+0000","last_active":"2023-11-04T01:42:56.605012+0000","last_peered":"2023-11-04T01:42:56.605012+0000","last_clean":"2023-11-04T01:42:56.605012+0000","last_became_active":"2023-11-04T01:42:56.603996+0000","last_became_peered":"2023-11-04T01:42:56.603996+0000","last_unstale":"2023-11-04T01:42:56.605012+0000","last_undegraded":"2023-11-04T01:42:56.605012+0000","last_fullsized":"2023-11-04T01:42:56.605012+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:52.960905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"82'1","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:57.108564+0000","last_change":"2023-11-04T01:42:56.099980+0000","last_active":"2023-11-04T01:42:57.108564+0000","last_peered":"2023-11-04T01:42:57.108564+0000","last_clean":"2023-11-04T01:42:57.108564+0000","last_became_active":"2023-11-04T01:42:56.099700+0000","last_became_peered":"2023-11-04T01:42:56.099700+0000","last_unstale":"2023-11-04T01:42:57.108564+0000","last_undegraded":"2023-11-04T01:42:57.108564+0000","last_fullsized":"2023-11-04T01:42:57.108564+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:59.314998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.085599+0000","last_change":"2023-11-04T01:42:35.345703+0000","last_active":"2023-11-04T01:42:56.085599+0000","last_peered":"2023-11-04T01:42:56.085599+0000","last_clean":"2023-11-04T01:42:56.085599+0000","last_became_active":"2023-11-04T01:42:35.345089+0000","last_became_peered":"2023-11-04T01:42:35.345089+0000","last_unstale":"2023-11-04T01:42:56.085599+0000","last_undegraded":"2023-11-04T01:42:56.085599+0000","last_fullsized":"2023-11-04T01:42:56.085599+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:36:11.770993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.086944+0000","last_change":"2023-11-04T01:42:36.341220+0000","last_active":"2023-11-04T01:42:56.086944+0000","last_peered":"2023-11-04T01:42:56.086944+0000","last_clean":"2023-11-04T01:42:56.086944+0000","last_became_active":"2023-11-04T01:42:34.350834+0000","last_became_peered":"2023-11-04T01:42:34.350834+0000","last_unstale":"2023-11-04T01:42:56.086944+0000","last_undegraded":"2023-11-04T01:42:56.086944+0000","last_fullsized":"2023-11-04T01:42:56.086944+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:16:15.635771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011584519999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.088518+0000","last_change":"2023-11-04T01:41:35.906297+0000","last_active":"2023-11-04T01:42:56.088518+0000","last_peered":"2023-11-04T01:42:56.088518+0000","last_clean":"2023-11-04T01:42:56.088518+0000","last_became_active":"2023-11-04T01:41:34.734134+0000","last_became_peered":"2023-11-04T01:41:34.734134+0000","last_unstale":"2023-11-04T01:42:56.088518+0000","last_undegraded":"2023-11-04T01:42:56.088518+0000","last_fullsized":"2023-11-04T01:42:56.088518+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:52.597063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087104900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.607045+0000","last_change":"2023-11-04T01:42:56.602275+0000","last_active":"2023-11-04T01:42:56.607045+0000","last_peered":"2023-11-04T01:42:56.607045+0000","last_clean":"2023-11-04T01:42:56.607045+0000","last_became_active":"2023-11-04T01:42:56.601996+0000","last_became_peered":"2023-11-04T01:42:56.601996+0000","last_unstale":"2023-11-04T01:42:56.607045+0000","last_undegraded":"2023-11-04T01:42:56.607045+0000","last_fullsized":"2023-11-04T01:42:56.607045+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:09.926671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.599207+0000","last_change":"2023-11-04T01:42:56.095318+0000","last_active":"2023-11-04T01:42:56.599207+0000","last_peered":"2023-11-04T01:42:56.599207+0000","last_clean":"2023-11-04T01:42:56.599207+0000","last_became_active":"2023-11-04T01:42:56.094911+0000","last_became_peered":"2023-11-04T01:42:56.094911+0000","last_unstale":"2023-11-04T01:42:56.599207+0000","last_undegraded":"2023-11-04T01:42:56.599207+0000","last_fullsized":"2023-11-04T01:42:56.599207+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:36:00.695965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087372+0000","last_change":"2023-11-04T01:42:35.355771+0000","last_active":"2023-11-04T01:42:56.087372+0000","last_peered":"2023-11-04T01:42:56.087372+0000","last_clean":"2023-11-04T01:42:56.087372+0000","last_became_active":"2023-11-04T01:42:35.355459+0000","last_became_peered":"2023-11-04T01:42:35.355459+0000","last_unstale":"2023-11-04T01:42:56.087372+0000","last_undegraded":"2023-11-04T01:42:56.087372+0000","last_fullsized":"2023-11-04T01:42:56.087372+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:48:17.884449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.090778+0000","last_change":"2023-11-04T01:42:36.410175+0000","last_active":"2023-11-04T01:42:56.090778+0000","last_peered":"2023-11-04T01:42:56.090778+0000","last_clean":"2023-11-04T01:42:56.090778+0000","last_became_active":"2023-11-04T01:42:34.353093+0000","last_became_peered":"2023-11-04T01:42:34.353093+0000","last_unstale":"2023-11-04T01:42:56.090778+0000","last_undegraded":"2023-11-04T01:42:56.090778+0000","last_fullsized":"2023-11-04T01:42:56.090778+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:19:10.941730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000299241,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.088447+0000","last_change":"2023-11-04T01:41:35.906596+0000","last_active":"2023-11-04T01:42:56.088447+0000","last_peered":"2023-11-04T01:42:56.088447+0000","last_clean":"2023-11-04T01:42:56.088447+0000","last_became_active":"2023-11-04T01:41:34.738529+0000","last_became_peered":"2023-11-04T01:41:34.738529+0000","last_unstale":"2023-11-04T01:42:56.088447+0000","last_undegraded":"2023-11-04T01:42:56.088447+0000","last_fullsized":"2023-11-04T01:42:56.088447+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:48.121273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086660600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.607571+0000","last_change":"2023-11-04T01:42:56.602656+0000","last_active":"2023-11-04T01:42:56.607571+0000","last_peered":"2023-11-04T01:42:56.607571+0000","last_clean":"2023-11-04T01:42:56.607571+0000","last_became_active":"2023-11-04T01:42:56.602361+0000","last_became_peered":"2023-11-04T01:42:56.602361+0000","last_unstale":"2023-11-04T01:42:56.607571+0000","last_undegraded":"2023-11-04T01:42:56.607571+0000","last_fullsized":"2023-11-04T01:42:56.607571+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:35:10.233803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.580554+0000","last_change":"2023-11-04T01:42:56.100068+0000","last_active":"2023-11-04T01:42:56.580554+0000","last_peered":"2023-11-04T01:42:56.580554+0000","last_clean":"2023-11-04T01:42:56.580554+0000","last_became_active":"2023-11-04T01:42:56.099787+0000","last_became_peered":"2023-11-04T01:42:56.099787+0000","last_unstale":"2023-11-04T01:42:56.580554+0000","last_undegraded":"2023-11-04T01:42:56.580554+0000","last_fullsized":"2023-11-04T01:42:56.580554+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:42:50.726373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.089233+0000","last_change":"2023-11-04T01:42:35.352467+0000","last_active":"2023-11-04T01:42:56.089233+0000","last_peered":"2023-11-04T01:42:56.089233+0000","last_clean":"2023-11-04T01:42:56.089233+0000","last_became_active":"2023-11-04T01:42:35.352199+0000","last_became_peered":"2023-11-04T01:42:35.352199+0000","last_unstale":"2023-11-04T01:42:56.089233+0000","last_undegraded":"2023-11-04T01:42:56.089233+0000","last_fullsized":"2023-11-04T01:42:56.089233+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:34:48.488293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.090764+0000","last_change":"2023-11-04T01:42:36.410094+0000","last_active":"2023-11-04T01:42:56.090764+0000","last_peered":"2023-11-04T01:42:56.090764+0000","last_clean":"2023-11-04T01:42:56.090764+0000","last_became_active":"2023-11-04T01:42:34.346812+0000","last_became_peered":"2023-11-04T01:42:34.346812+0000","last_unstale":"2023-11-04T01:42:56.090764+0000","last_undegraded":"2023-11-04T01:42:56.090764+0000","last_fullsized":"2023-11-04T01:42:56.090764+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:47.456400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034280500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.091030+0000","last_change":"2023-11-04T01:41:35.906430+0000","last_active":"2023-11-04T01:42:56.091030+0000","last_peered":"2023-11-04T01:42:56.091030+0000","last_clean":"2023-11-04T01:42:56.091030+0000","last_became_active":"2023-11-04T01:41:34.741147+0000","last_became_peered":"2023-11-04T01:41:34.741147+0000","last_unstale":"2023-11-04T01:42:56.091030+0000","last_undegraded":"2023-11-04T01:42:56.091030+0000","last_fullsized":"2023-11-04T01:42:56.091030+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:20.089706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090504400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.607438+0000","last_change":"2023-11-04T01:42:56.600639+0000","last_active":"2023-11-04T01:42:56.607438+0000","last_peered":"2023-11-04T01:42:56.607438+0000","last_clean":"2023-11-04T01:42:56.607438+0000","last_became_active":"2023-11-04T01:42:56.600384+0000","last_became_peered":"2023-11-04T01:42:56.600384+0000","last_unstale":"2023-11-04T01:42:56.607438+0000","last_undegraded":"2023-11-04T01:42:56.607438+0000","last_fullsized":"2023-11-04T01:42:56.607438+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:10:46.310870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.581692+0000","last_change":"2023-11-04T01:42:56.103838+0000","last_active":"2023-11-04T01:42:56.581692+0000","last_peered":"2023-11-04T01:42:56.581692+0000","last_clean":"2023-11-04T01:42:56.581692+0000","last_became_active":"2023-11-04T01:42:56.103567+0000","last_became_peered":"2023-11-04T01:42:56.103567+0000","last_unstale":"2023-11-04T01:42:56.581692+0000","last_undegraded":"2023-11-04T01:42:56.581692+0000","last_fullsized":"2023-11-04T01:42:56.581692+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:23:36.762616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.092010+0000","last_change":"2023-11-04T01:42:35.348600+0000","last_active":"2023-11-04T01:42:56.092010+0000","last_peered":"2023-11-04T01:42:56.092010+0000","last_clean":"2023-11-04T01:42:56.092010+0000","last_became_active":"2023-11-04T01:42:35.348315+0000","last_became_peered":"2023-11-04T01:42:35.348315+0000","last_unstale":"2023-11-04T01:42:56.092010+0000","last_undegraded":"2023-11-04T01:42:56.092010+0000","last_fullsized":"2023-11-04T01:42:56.092010+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:13:42.469906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.090368+0000","last_change":"2023-11-04T01:42:36.411537+0000","last_active":"2023-11-04T01:42:56.090368+0000","last_peered":"2023-11-04T01:42:56.090368+0000","last_clean":"2023-11-04T01:42:56.090368+0000","last_became_active":"2023-11-04T01:42:34.354741+0000","last_became_peered":"2023-11-04T01:42:34.354741+0000","last_unstale":"2023-11-04T01:42:56.090368+0000","last_undegraded":"2023-11-04T01:42:56.090368+0000","last_fullsized":"2023-11-04T01:42:56.090368+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:22:16.530179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000668952,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087462+0000","last_change":"2023-11-04T01:41:36.344408+0000","last_active":"2023-11-04T01:42:56.087462+0000","last_peered":"2023-11-04T01:42:56.087462+0000","last_clean":"2023-11-04T01:42:56.087462+0000","last_became_active":"2023-11-04T01:41:34.730735+0000","last_became_peered":"2023-11-04T01:41:34.730735+0000","last_unstale":"2023-11-04T01:42:56.087462+0000","last_undegraded":"2023-11-04T01:42:56.087462+0000","last_fullsized":"2023-11-04T01:42:56.087462+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:10:58.095232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081464299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.593470+0000","last_change":"2023-11-04T01:42:56.591223+0000","last_active":"2023-11-04T01:42:56.593470+0000","last_peered":"2023-11-04T01:42:56.593470+0000","last_clean":"2023-11-04T01:42:56.593470+0000","last_became_active":"2023-11-04T01:42:56.590951+0000","last_became_peered":"2023-11-04T01:42:56.590951+0000","last_unstale":"2023-11-04T01:42:56.593470+0000","last_undegraded":"2023-11-04T01:42:56.593470+0000","last_fullsized":"2023-11-04T01:42:56.593470+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:12:35.058599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"82'2","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:57.106291+0000","last_change":"2023-11-04T01:42:56.097788+0000","last_active":"2023-11-04T01:42:57.106291+0000","last_peered":"2023-11-04T01:42:57.106291+0000","last_clean":"2023-11-04T01:42:57.106291+0000","last_became_active":"2023-11-04T01:42:56.097528+0000","last_became_peered":"2023-11-04T01:42:56.097528+0000","last_unstale":"2023-11-04T01:42:57.106291+0000","last_undegraded":"2023-11-04T01:42:57.106291+0000","last_fullsized":"2023-11-04T01:42:57.106291+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:16:37.378449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.090453+0000","last_change":"2023-11-04T01:42:35.353952+0000","last_active":"2023-11-04T01:42:56.090453+0000","last_peered":"2023-11-04T01:42:56.090453+0000","last_clean":"2023-11-04T01:42:56.090453+0000","last_became_active":"2023-11-04T01:42:35.353703+0000","last_became_peered":"2023-11-04T01:42:35.353703+0000","last_unstale":"2023-11-04T01:42:56.090453+0000","last_undegraded":"2023-11-04T01:42:56.090453+0000","last_fullsized":"2023-11-04T01:42:56.090453+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:29.594965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.088294+0000","last_change":"2023-11-04T01:42:36.412751+0000","last_active":"2023-11-04T01:42:56.088294+0000","last_peered":"2023-11-04T01:42:56.088294+0000","last_clean":"2023-11-04T01:42:56.088294+0000","last_became_active":"2023-11-04T01:42:34.350389+0000","last_became_peered":"2023-11-04T01:42:34.350389+0000","last_unstale":"2023-11-04T01:42:56.088294+0000","last_undegraded":"2023-11-04T01:42:56.088294+0000","last_fullsized":"2023-11-04T01:42:56.088294+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:33.892673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057436599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.088869+0000","last_change":"2023-11-04T01:41:36.244245+0000","last_active":"2023-11-04T01:42:56.088869+0000","last_peered":"2023-11-04T01:42:56.088869+0000","last_clean":"2023-11-04T01:42:56.088869+0000","last_became_active":"2023-11-04T01:41:34.734925+0000","last_became_peered":"2023-11-04T01:41:34.734925+0000","last_unstale":"2023-11-04T01:42:56.088869+0000","last_undegraded":"2023-11-04T01:42:56.088869+0000","last_fullsized":"2023-11-04T01:42:56.088869+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:44.193748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025350200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.605012+0000","last_change":"2023-11-04T01:42:56.600764+0000","last_active":"2023-11-04T01:42:56.605012+0000","last_peered":"2023-11-04T01:42:56.605012+0000","last_clean":"2023-11-04T01:42:56.605012+0000","last_became_active":"2023-11-04T01:42:56.600498+0000","last_became_peered":"2023-11-04T01:42:56.600498+0000","last_unstale":"2023-11-04T01:42:56.605012+0000","last_undegraded":"2023-11-04T01:42:56.605012+0000","last_fullsized":"2023-11-04T01:42:56.605012+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:51:53.283591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.592948+0000","last_change":"2023-11-04T01:42:56.099653+0000","last_active":"2023-11-04T01:42:56.592948+0000","last_peered":"2023-11-04T01:42:56.592948+0000","last_clean":"2023-11-04T01:42:56.592948+0000","last_became_active":"2023-11-04T01:42:56.099388+0000","last_became_peered":"2023-11-04T01:42:56.099388+0000","last_unstale":"2023-11-04T01:42:56.592948+0000","last_undegraded":"2023-11-04T01:42:56.592948+0000","last_fullsized":"2023-11-04T01:42:56.592948+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:45:14.589199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.092368+0000","last_change":"2023-11-04T01:42:35.347267+0000","last_active":"2023-11-04T01:42:56.092368+0000","last_peered":"2023-11-04T01:42:56.092368+0000","last_clean":"2023-11-04T01:42:56.092368+0000","last_became_active":"2023-11-04T01:42:35.347025+0000","last_became_peered":"2023-11-04T01:42:35.347025+0000","last_unstale":"2023-11-04T01:42:56.092368+0000","last_undegraded":"2023-11-04T01:42:56.092368+0000","last_fullsized":"2023-11-04T01:42:56.092368+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:43.681647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087850+0000","last_change":"2023-11-04T01:42:36.412195+0000","last_active":"2023-11-04T01:42:56.087850+0000","last_peered":"2023-11-04T01:42:56.087850+0000","last_clean":"2023-11-04T01:42:56.087850+0000","last_became_active":"2023-11-04T01:42:34.348235+0000","last_became_peered":"2023-11-04T01:42:34.348235+0000","last_unstale":"2023-11-04T01:42:56.087850+0000","last_undegraded":"2023-11-04T01:42:56.087850+0000","last_fullsized":"2023-11-04T01:42:56.087850+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:41:39.504471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095507199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087030+0000","last_change":"2023-11-04T01:41:36.343956+0000","last_active":"2023-11-04T01:42:56.087030+0000","last_peered":"2023-11-04T01:42:56.087030+0000","last_clean":"2023-11-04T01:42:56.087030+0000","last_became_active":"2023-11-04T01:41:34.736013+0000","last_became_peered":"2023-11-04T01:41:34.736013+0000","last_unstale":"2023-11-04T01:42:56.087030+0000","last_undegraded":"2023-11-04T01:42:56.087030+0000","last_fullsized":"2023-11-04T01:42:56.087030+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:08.858430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081427799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.605213+0000","last_change":"2023-11-04T01:42:56.600532+0000","last_active":"2023-11-04T01:42:56.605213+0000","last_peered":"2023-11-04T01:42:56.605213+0000","last_clean":"2023-11-04T01:42:56.605213+0000","last_became_active":"2023-11-04T01:42:56.600277+0000","last_became_peered":"2023-11-04T01:42:56.600277+0000","last_unstale":"2023-11-04T01:42:56.605213+0000","last_undegraded":"2023-11-04T01:42:56.605213+0000","last_fullsized":"2023-11-04T01:42:56.605213+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:00:56.782905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.584410+0000","last_change":"2023-11-04T01:42:56.096547+0000","last_active":"2023-11-04T01:42:56.584410+0000","last_peered":"2023-11-04T01:42:56.584410+0000","last_clean":"2023-11-04T01:42:56.584410+0000","last_became_active":"2023-11-04T01:42:56.096307+0000","last_became_peered":"2023-11-04T01:42:56.096307+0000","last_unstale":"2023-11-04T01:42:56.584410+0000","last_undegraded":"2023-11-04T01:42:56.584410+0000","last_fullsized":"2023-11-04T01:42:56.584410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:36:00.695965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.088625+0000","last_change":"2023-11-04T01:42:35.354870+0000","last_active":"2023-11-04T01:42:56.088625+0000","last_peered":"2023-11-04T01:42:56.088625+0000","last_clean":"2023-11-04T01:42:56.088625+0000","last_became_active":"2023-11-04T01:42:35.354442+0000","last_became_peered":"2023-11-04T01:42:35.354442+0000","last_unstale":"2023-11-04T01:42:56.088625+0000","last_undegraded":"2023-11-04T01:42:56.088625+0000","last_fullsized":"2023-11-04T01:42:56.088625+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:08:28.888035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.092488+0000","last_change":"2023-11-04T01:42:36.342222+0000","last_active":"2023-11-04T01:42:56.092488+0000","last_peered":"2023-11-04T01:42:56.092488+0000","last_clean":"2023-11-04T01:42:56.092488+0000","last_became_active":"2023-11-04T01:42:34.347183+0000","last_became_peered":"2023-11-04T01:42:34.347183+0000","last_unstale":"2023-11-04T01:42:56.092488+0000","last_undegraded":"2023-11-04T01:42:56.092488+0000","last_fullsized":"2023-11-04T01:42:56.092488+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:52:53.403289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001441877,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.086525+0000","last_change":"2023-11-04T01:41:36.243977+0000","last_active":"2023-11-04T01:42:56.086525+0000","last_peered":"2023-11-04T01:42:56.086525+0000","last_clean":"2023-11-04T01:42:56.086525+0000","last_became_active":"2023-11-04T01:41:34.733127+0000","last_became_peered":"2023-11-04T01:41:34.733127+0000","last_unstale":"2023-11-04T01:42:56.086525+0000","last_undegraded":"2023-11-04T01:42:56.086525+0000","last_fullsized":"2023-11-04T01:42:56.086525+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:36.118907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051788300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.608841+0000","last_change":"2023-11-04T01:42:56.603179+0000","last_active":"2023-11-04T01:42:56.608841+0000","last_peered":"2023-11-04T01:42:56.608841+0000","last_clean":"2023-11-04T01:42:56.608841+0000","last_became_active":"2023-11-04T01:42:56.602890+0000","last_became_peered":"2023-11-04T01:42:56.602890+0000","last_unstale":"2023-11-04T01:42:56.608841+0000","last_undegraded":"2023-11-04T01:42:56.608841+0000","last_fullsized":"2023-11-04T01:42:56.608841+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:15:05.427157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.594961+0000","last_change":"2023-11-04T01:42:56.100191+0000","last_active":"2023-11-04T01:42:56.594961+0000","last_peered":"2023-11-04T01:42:56.594961+0000","last_clean":"2023-11-04T01:42:56.594961+0000","last_became_active":"2023-11-04T01:42:56.099892+0000","last_became_peered":"2023-11-04T01:42:56.099892+0000","last_unstale":"2023-11-04T01:42:56.594961+0000","last_undegraded":"2023-11-04T01:42:56.594961+0000","last_fullsized":"2023-11-04T01:42:56.594961+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:30:14.002465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087728+0000","last_change":"2023-11-04T01:42:35.354884+0000","last_active":"2023-11-04T01:42:56.087728+0000","last_peered":"2023-11-04T01:42:56.087728+0000","last_clean":"2023-11-04T01:42:56.087728+0000","last_became_active":"2023-11-04T01:42:35.354616+0000","last_became_peered":"2023-11-04T01:42:35.354616+0000","last_unstale":"2023-11-04T01:42:56.087728+0000","last_undegraded":"2023-11-04T01:42:56.087728+0000","last_fullsized":"2023-11-04T01:42:56.087728+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:41:40.506391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087496+0000","last_change":"2023-11-04T01:42:36.411716+0000","last_active":"2023-11-04T01:42:56.087496+0000","last_peered":"2023-11-04T01:42:56.087496+0000","last_clean":"2023-11-04T01:42:56.087496+0000","last_became_active":"2023-11-04T01:42:34.350215+0000","last_became_peered":"2023-11-04T01:42:34.350215+0000","last_unstale":"2023-11-04T01:42:56.087496+0000","last_undegraded":"2023-11-04T01:42:56.087496+0000","last_fullsized":"2023-11-04T01:42:56.087496+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:20:02.805323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076372199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.090143+0000","last_change":"2023-11-04T01:41:36.067797+0000","last_active":"2023-11-04T01:42:56.090143+0000","last_peered":"2023-11-04T01:42:56.090143+0000","last_clean":"2023-11-04T01:42:56.090143+0000","last_became_active":"2023-11-04T01:41:34.734880+0000","last_became_peered":"2023-11-04T01:41:34.734880+0000","last_unstale":"2023-11-04T01:42:56.090143+0000","last_undegraded":"2023-11-04T01:42:56.090143+0000","last_fullsized":"2023-11-04T01:42:56.090143+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:20.089706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036003499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.607418+0000","last_change":"2023-11-04T01:42:56.604105+0000","last_active":"2023-11-04T01:42:56.607418+0000","last_peered":"2023-11-04T01:42:56.607418+0000","last_clean":"2023-11-04T01:42:56.607418+0000","last_became_active":"2023-11-04T01:42:56.603823+0000","last_became_peered":"2023-11-04T01:42:56.603823+0000","last_unstale":"2023-11-04T01:42:56.607418+0000","last_undegraded":"2023-11-04T01:42:56.607418+0000","last_fullsized":"2023-11-04T01:42:56.607418+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:38:31.776800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.579852+0000","last_change":"2023-11-04T01:42:56.103359+0000","last_active":"2023-11-04T01:42:56.579852+0000","last_peered":"2023-11-04T01:42:56.579852+0000","last_clean":"2023-11-04T01:42:56.579852+0000","last_became_active":"2023-11-04T01:42:56.103084+0000","last_became_peered":"2023-11-04T01:42:56.103084+0000","last_unstale":"2023-11-04T01:42:56.579852+0000","last_undegraded":"2023-11-04T01:42:56.579852+0000","last_fullsized":"2023-11-04T01:42:56.579852+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:11:25.528784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.085707+0000","last_change":"2023-11-04T01:42:35.345946+0000","last_active":"2023-11-04T01:42:56.085707+0000","last_peered":"2023-11-04T01:42:56.085707+0000","last_clean":"2023-11-04T01:42:56.085707+0000","last_became_active":"2023-11-04T01:42:35.345033+0000","last_became_peered":"2023-11-04T01:42:35.345033+0000","last_unstale":"2023-11-04T01:42:56.085707+0000","last_undegraded":"2023-11-04T01:42:56.085707+0000","last_fullsized":"2023-11-04T01:42:56.085707+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:32:11.546107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087807+0000","last_change":"2023-11-04T01:42:36.410760+0000","last_active":"2023-11-04T01:42:56.087807+0000","last_peered":"2023-11-04T01:42:56.087807+0000","last_clean":"2023-11-04T01:42:56.087807+0000","last_became_active":"2023-11-04T01:42:34.349633+0000","last_became_peered":"2023-11-04T01:42:34.349633+0000","last_unstale":"2023-11-04T01:42:56.087807+0000","last_undegraded":"2023-11-04T01:42:56.087807+0000","last_fullsized":"2023-11-04T01:42:56.087807+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:08:27.886115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066417699999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.086730+0000","last_change":"2023-11-04T01:41:35.729089+0000","last_active":"2023-11-04T01:42:56.086730+0000","last_peered":"2023-11-04T01:42:56.086730+0000","last_clean":"2023-11-04T01:42:56.086730+0000","last_became_active":"2023-11-04T01:41:34.731063+0000","last_became_peered":"2023-11-04T01:41:34.731063+0000","last_unstale":"2023-11-04T01:42:56.086730+0000","last_undegraded":"2023-11-04T01:42:56.086730+0000","last_fullsized":"2023-11-04T01:42:56.086730+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:38:46.633175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083653600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.604579+0000","last_change":"2023-11-04T01:42:56.601056+0000","last_active":"2023-11-04T01:42:56.604579+0000","last_peered":"2023-11-04T01:42:56.604579+0000","last_clean":"2023-11-04T01:42:56.604579+0000","last_became_active":"2023-11-04T01:42:56.600446+0000","last_became_peered":"2023-11-04T01:42:56.600446+0000","last_unstale":"2023-11-04T01:42:56.604579+0000","last_undegraded":"2023-11-04T01:42:56.604579+0000","last_fullsized":"2023-11-04T01:42:56.604579+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:36:01.700717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.580229+0000","last_change":"2023-11-04T01:42:56.103019+0000","last_active":"2023-11-04T01:42:56.580229+0000","last_peered":"2023-11-04T01:42:56.580229+0000","last_clean":"2023-11-04T01:42:56.580229+0000","last_became_active":"2023-11-04T01:42:56.102742+0000","last_became_peered":"2023-11-04T01:42:56.102742+0000","last_unstale":"2023-11-04T01:42:56.580229+0000","last_undegraded":"2023-11-04T01:42:56.580229+0000","last_fullsized":"2023-11-04T01:42:56.580229+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:30:07.231420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.091523+0000","last_change":"2023-11-04T01:42:35.357455+0000","last_active":"2023-11-04T01:42:56.091523+0000","last_peered":"2023-11-04T01:42:56.091523+0000","last_clean":"2023-11-04T01:42:56.091523+0000","last_became_active":"2023-11-04T01:42:35.357198+0000","last_became_peered":"2023-11-04T01:42:35.357198+0000","last_unstale":"2023-11-04T01:42:56.091523+0000","last_undegraded":"2023-11-04T01:42:56.091523+0000","last_fullsized":"2023-11-04T01:42:56.091523+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:33:20.111728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.088892+0000","last_change":"2023-11-04T01:42:36.342203+0000","last_active":"2023-11-04T01:42:56.088892+0000","last_peered":"2023-11-04T01:42:56.088892+0000","last_clean":"2023-11-04T01:42:56.088892+0000","last_became_active":"2023-11-04T01:42:34.351883+0000","last_became_peered":"2023-11-04T01:42:34.351883+0000","last_unstale":"2023-11-04T01:42:56.088892+0000","last_undegraded":"2023-11-04T01:42:56.088892+0000","last_fullsized":"2023-11-04T01:42:56.088892+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:41.905588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016503290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087931+0000","last_change":"2023-11-04T01:41:35.729232+0000","last_active":"2023-11-04T01:42:56.087931+0000","last_peered":"2023-11-04T01:42:56.087931+0000","last_clean":"2023-11-04T01:42:56.087931+0000","last_became_active":"2023-11-04T01:41:34.731490+0000","last_became_peered":"2023-11-04T01:41:34.731490+0000","last_unstale":"2023-11-04T01:42:56.087931+0000","last_undegraded":"2023-11-04T01:42:56.087931+0000","last_fullsized":"2023-11-04T01:42:56.087931+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:37.958719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089653699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.606988+0000","last_change":"2023-11-04T01:42:56.605845+0000","last_active":"2023-11-04T01:42:56.606988+0000","last_peered":"2023-11-04T01:42:56.606988+0000","last_clean":"2023-11-04T01:42:56.606988+0000","last_became_active":"2023-11-04T01:42:56.605549+0000","last_became_peered":"2023-11-04T01:42:56.605549+0000","last_unstale":"2023-11-04T01:42:56.606988+0000","last_undegraded":"2023-11-04T01:42:56.606988+0000","last_fullsized":"2023-11-04T01:42:56.606988+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:55:13.050206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.595771+0000","last_change":"2023-11-04T01:42:56.098429+0000","last_active":"2023-11-04T01:42:56.595771+0000","last_peered":"2023-11-04T01:42:56.595771+0000","last_clean":"2023-11-04T01:42:56.595771+0000","last_became_active":"2023-11-04T01:42:56.098126+0000","last_became_peered":"2023-11-04T01:42:56.098126+0000","last_unstale":"2023-11-04T01:42:56.595771+0000","last_undegraded":"2023-11-04T01:42:56.595771+0000","last_fullsized":"2023-11-04T01:42:56.595771+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:12:38.398717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.086820+0000","last_change":"2023-11-04T01:42:35.353012+0000","last_active":"2023-11-04T01:42:56.086820+0000","last_peered":"2023-11-04T01:42:56.086820+0000","last_clean":"2023-11-04T01:42:56.086820+0000","last_became_active":"2023-11-04T01:42:35.352268+0000","last_became_peered":"2023-11-04T01:42:35.352268+0000","last_unstale":"2023-11-04T01:42:56.086820+0000","last_undegraded":"2023-11-04T01:42:56.086820+0000","last_fullsized":"2023-11-04T01:42:56.086820+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:51:13.068224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.091444+0000","last_change":"2023-11-04T01:42:36.413549+0000","last_active":"2023-11-04T01:42:56.091444+0000","last_peered":"2023-11-04T01:42:56.091444+0000","last_clean":"2023-11-04T01:42:56.091444+0000","last_became_active":"2023-11-04T01:42:34.355467+0000","last_became_peered":"2023-11-04T01:42:34.355467+0000","last_unstale":"2023-11-04T01:42:56.091444+0000","last_undegraded":"2023-11-04T01:42:56.091444+0000","last_fullsized":"2023-11-04T01:42:56.091444+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:09:47.557748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071579,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.096569+0000","last_change":"2023-11-04T01:41:36.344018+0000","last_active":"2023-11-04T01:42:56.096569+0000","last_peered":"2023-11-04T01:42:56.096569+0000","last_clean":"2023-11-04T01:42:56.096569+0000","last_became_active":"2023-11-04T01:41:34.734178+0000","last_became_peered":"2023-11-04T01:41:34.734178+0000","last_unstale":"2023-11-04T01:42:56.096569+0000","last_undegraded":"2023-11-04T01:42:56.096569+0000","last_fullsized":"2023-11-04T01:42:56.096569+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:16.970814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077338299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.608977+0000","last_change":"2023-11-04T01:42:56.604931+0000","last_active":"2023-11-04T01:42:56.608977+0000","last_peered":"2023-11-04T01:42:56.608977+0000","last_clean":"2023-11-04T01:42:56.608977+0000","last_became_active":"2023-11-04T01:42:56.603782+0000","last_became_peered":"2023-11-04T01:42:56.603782+0000","last_unstale":"2023-11-04T01:42:56.608977+0000","last_undegraded":"2023-11-04T01:42:56.608977+0000","last_fullsized":"2023-11-04T01:42:56.608977+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:32.718463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.592682+0000","last_change":"2023-11-04T01:42:56.098611+0000","last_active":"2023-11-04T01:42:56.592682+0000","last_peered":"2023-11-04T01:42:56.592682+0000","last_clean":"2023-11-04T01:42:56.592682+0000","last_became_active":"2023-11-04T01:42:56.098345+0000","last_became_peered":"2023-11-04T01:42:56.098345+0000","last_unstale":"2023-11-04T01:42:56.592682+0000","last_undegraded":"2023-11-04T01:42:56.592682+0000","last_fullsized":"2023-11-04T01:42:56.592682+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:53:15.145967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.090479+0000","last_change":"2023-11-04T01:42:35.351651+0000","last_active":"2023-11-04T01:42:56.090479+0000","last_peered":"2023-11-04T01:42:56.090479+0000","last_clean":"2023-11-04T01:42:56.090479+0000","last_became_active":"2023-11-04T01:42:35.351384+0000","last_became_peered":"2023-11-04T01:42:35.351384+0000","last_unstale":"2023-11-04T01:42:56.090479+0000","last_undegraded":"2023-11-04T01:42:56.090479+0000","last_fullsized":"2023-11-04T01:42:56.090479+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:16.391588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.096418+0000","last_change":"2023-11-04T01:42:36.342476+0000","last_active":"2023-11-04T01:42:56.096418+0000","last_peered":"2023-11-04T01:42:56.096418+0000","last_clean":"2023-11-04T01:42:56.096418+0000","last_became_active":"2023-11-04T01:42:34.350295+0000","last_became_peered":"2023-11-04T01:42:34.350295+0000","last_unstale":"2023-11-04T01:42:56.096418+0000","last_undegraded":"2023-11-04T01:42:56.096418+0000","last_fullsized":"2023-11-04T01:42:56.096418+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:30:27.909910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000695332,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.091748+0000","last_change":"2023-11-04T01:41:35.906788+0000","last_active":"2023-11-04T01:42:56.091748+0000","last_peered":"2023-11-04T01:42:56.091748+0000","last_clean":"2023-11-04T01:42:56.091748+0000","last_became_active":"2023-11-04T01:41:34.734386+0000","last_became_peered":"2023-11-04T01:41:34.734386+0000","last_unstale":"2023-11-04T01:42:56.091748+0000","last_undegraded":"2023-11-04T01:42:56.091748+0000","last_fullsized":"2023-11-04T01:42:56.091748+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:23:23.733128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060435600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.609004+0000","last_change":"2023-11-04T01:42:56.605869+0000","last_active":"2023-11-04T01:42:56.609004+0000","last_peered":"2023-11-04T01:42:56.609004+0000","last_clean":"2023-11-04T01:42:56.609004+0000","last_became_active":"2023-11-04T01:42:56.605556+0000","last_became_peered":"2023-11-04T01:42:56.605556+0000","last_unstale":"2023-11-04T01:42:56.609004+0000","last_undegraded":"2023-11-04T01:42:56.609004+0000","last_fullsized":"2023-11-04T01:42:56.609004+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:30:50.657341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.579692+0000","last_change":"2023-11-04T01:42:56.100307+0000","last_active":"2023-11-04T01:42:56.579692+0000","last_peered":"2023-11-04T01:42:56.579692+0000","last_clean":"2023-11-04T01:42:56.579692+0000","last_became_active":"2023-11-04T01:42:56.100028+0000","last_became_peered":"2023-11-04T01:42:56.100028+0000","last_unstale":"2023-11-04T01:42:56.579692+0000","last_undegraded":"2023-11-04T01:42:56.579692+0000","last_fullsized":"2023-11-04T01:42:56.579692+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:23:45.135720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.089000+0000","last_change":"2023-11-04T01:42:35.354173+0000","last_active":"2023-11-04T01:42:56.089000+0000","last_peered":"2023-11-04T01:42:56.089000+0000","last_clean":"2023-11-04T01:42:56.089000+0000","last_became_active":"2023-11-04T01:42:35.353832+0000","last_became_peered":"2023-11-04T01:42:35.353832+0000","last_unstale":"2023-11-04T01:42:56.089000+0000","last_undegraded":"2023-11-04T01:42:56.089000+0000","last_fullsized":"2023-11-04T01:42:56.089000+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:34:48.488293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.088440+0000","last_change":"2023-11-04T01:42:36.342247+0000","last_active":"2023-11-04T01:42:56.088440+0000","last_peered":"2023-11-04T01:42:56.088440+0000","last_clean":"2023-11-04T01:42:56.088440+0000","last_became_active":"2023-11-04T01:42:34.352917+0000","last_became_peered":"2023-11-04T01:42:34.352917+0000","last_unstale":"2023-11-04T01:42:56.088440+0000","last_undegraded":"2023-11-04T01:42:56.088440+0000","last_fullsized":"2023-11-04T01:42:56.088440+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:56.180797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014365140000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.093515+0000","last_change":"2023-11-04T01:41:35.931718+0000","last_active":"2023-11-04T01:42:56.093515+0000","last_peered":"2023-11-04T01:42:56.093515+0000","last_clean":"2023-11-04T01:42:56.093515+0000","last_became_active":"2023-11-04T01:41:34.741033+0000","last_became_peered":"2023-11-04T01:41:34.741033+0000","last_unstale":"2023-11-04T01:42:56.093515+0000","last_undegraded":"2023-11-04T01:42:56.093515+0000","last_fullsized":"2023-11-04T01:42:56.093515+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:48.121273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065858400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.602338+0000","last_change":"2023-11-04T01:42:56.599926+0000","last_active":"2023-11-04T01:42:56.602338+0000","last_peered":"2023-11-04T01:42:56.602338+0000","last_clean":"2023-11-04T01:42:56.602338+0000","last_became_active":"2023-11-04T01:42:56.599655+0000","last_became_peered":"2023-11-04T01:42:56.599655+0000","last_unstale":"2023-11-04T01:42:56.602338+0000","last_undegraded":"2023-11-04T01:42:56.602338+0000","last_fullsized":"2023-11-04T01:42:56.602338+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:51:16.438696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.588899+0000","last_change":"2023-11-04T01:42:56.096569+0000","last_active":"2023-11-04T01:42:56.588899+0000","last_peered":"2023-11-04T01:42:56.588899+0000","last_clean":"2023-11-04T01:42:56.588899+0000","last_became_active":"2023-11-04T01:42:56.096231+0000","last_became_peered":"2023-11-04T01:42:56.096231+0000","last_unstale":"2023-11-04T01:42:56.588899+0000","last_undegraded":"2023-11-04T01:42:56.588899+0000","last_fullsized":"2023-11-04T01:42:56.588899+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:31:49.658638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.088520+0000","last_change":"2023-11-04T01:42:35.351103+0000","last_active":"2023-11-04T01:42:56.088520+0000","last_peered":"2023-11-04T01:42:56.088520+0000","last_clean":"2023-11-04T01:42:56.088520+0000","last_became_active":"2023-11-04T01:42:35.350867+0000","last_became_peered":"2023-11-04T01:42:35.350867+0000","last_unstale":"2023-11-04T01:42:56.088520+0000","last_undegraded":"2023-11-04T01:42:56.088520+0000","last_fullsized":"2023-11-04T01:42:56.088520+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:12:54.713516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.086941+0000","last_change":"2023-11-04T01:42:36.408801+0000","last_active":"2023-11-04T01:42:56.086941+0000","last_peered":"2023-11-04T01:42:56.086941+0000","last_clean":"2023-11-04T01:42:56.086941+0000","last_became_active":"2023-11-04T01:42:34.345669+0000","last_became_peered":"2023-11-04T01:42:34.345669+0000","last_unstale":"2023-11-04T01:42:56.086941+0000","last_undegraded":"2023-11-04T01:42:56.086941+0000","last_fullsized":"2023-11-04T01:42:56.086941+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:42.679727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055359799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.086288+0000","last_change":"2023-11-04T01:41:35.728094+0000","last_active":"2023-11-04T01:42:56.086288+0000","last_peered":"2023-11-04T01:42:56.086288+0000","last_clean":"2023-11-04T01:42:56.086288+0000","last_became_active":"2023-11-04T01:41:34.738687+0000","last_became_peered":"2023-11-04T01:41:34.738687+0000","last_unstale":"2023-11-04T01:42:56.086288+0000","last_undegraded":"2023-11-04T01:42:56.086288+0000","last_fullsized":"2023-11-04T01:42:56.086288+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:37.958719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068772699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.605311+0000","last_change":"2023-11-04T01:42:56.600728+0000","last_active":"2023-11-04T01:42:56.605311+0000","last_peered":"2023-11-04T01:42:56.605311+0000","last_clean":"2023-11-04T01:42:56.605311+0000","last_became_active":"2023-11-04T01:42:56.600466+0000","last_became_peered":"2023-11-04T01:42:56.600466+0000","last_unstale":"2023-11-04T01:42:56.605311+0000","last_undegraded":"2023-11-04T01:42:56.605311+0000","last_fullsized":"2023-11-04T01:42:56.605311+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:04:02.094362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.588528+0000","last_change":"2023-11-04T01:42:56.101381+0000","last_active":"2023-11-04T01:42:56.588528+0000","last_peered":"2023-11-04T01:42:56.588528+0000","last_clean":"2023-11-04T01:42:56.588528+0000","last_became_active":"2023-11-04T01:42:56.101063+0000","last_became_peered":"2023-11-04T01:42:56.101063+0000","last_unstale":"2023-11-04T01:42:56.588528+0000","last_undegraded":"2023-11-04T01:42:56.588528+0000","last_fullsized":"2023-11-04T01:42:56.588528+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:52.753042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.089533+0000","last_change":"2023-11-04T01:42:35.354730+0000","last_active":"2023-11-04T01:42:56.089533+0000","last_peered":"2023-11-04T01:42:56.089533+0000","last_clean":"2023-11-04T01:42:56.089533+0000","last_became_active":"2023-11-04T01:42:35.354427+0000","last_became_peered":"2023-11-04T01:42:35.354427+0000","last_unstale":"2023-11-04T01:42:56.089533+0000","last_undegraded":"2023-11-04T01:42:56.089533+0000","last_fullsized":"2023-11-04T01:42:56.089533+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:41:40.506391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.086184+0000","last_change":"2023-11-04T01:42:36.407795+0000","last_active":"2023-11-04T01:42:56.086184+0000","last_peered":"2023-11-04T01:42:56.086184+0000","last_clean":"2023-11-04T01:42:56.086184+0000","last_became_active":"2023-11-04T01:42:34.349234+0000","last_became_peered":"2023-11-04T01:42:34.349234+0000","last_unstale":"2023-11-04T01:42:56.086184+0000","last_undegraded":"2023-11-04T01:42:56.086184+0000","last_fullsized":"2023-11-04T01:42:56.086184+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:31:27.915960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000451805,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087013+0000","last_change":"2023-11-04T01:41:35.729106+0000","last_active":"2023-11-04T01:42:56.087013+0000","last_peered":"2023-11-04T01:42:56.087013+0000","last_clean":"2023-11-04T01:42:56.087013+0000","last_became_active":"2023-11-04T01:41:34.731230+0000","last_became_peered":"2023-11-04T01:41:34.731230+0000","last_unstale":"2023-11-04T01:42:56.087013+0000","last_undegraded":"2023-11-04T01:42:56.087013+0000","last_fullsized":"2023-11-04T01:42:56.087013+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:07:32.744572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078592199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.602596+0000","last_change":"2023-11-04T01:42:56.600007+0000","last_active":"2023-11-04T01:42:56.602596+0000","last_peered":"2023-11-04T01:42:56.602596+0000","last_clean":"2023-11-04T01:42:56.602596+0000","last_became_active":"2023-11-04T01:42:56.599747+0000","last_became_peered":"2023-11-04T01:42:56.599747+0000","last_unstale":"2023-11-04T01:42:56.602596+0000","last_undegraded":"2023-11-04T01:42:56.602596+0000","last_fullsized":"2023-11-04T01:42:56.602596+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:36:34.738639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.580100+0000","last_change":"2023-11-04T01:42:56.103887+0000","last_active":"2023-11-04T01:42:56.580100+0000","last_peered":"2023-11-04T01:42:56.580100+0000","last_clean":"2023-11-04T01:42:56.580100+0000","last_became_active":"2023-11-04T01:42:56.103542+0000","last_became_peered":"2023-11-04T01:42:56.103542+0000","last_unstale":"2023-11-04T01:42:56.580100+0000","last_undegraded":"2023-11-04T01:42:56.580100+0000","last_fullsized":"2023-11-04T01:42:56.580100+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:42:48.300158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.086442+0000","last_change":"2023-11-04T01:42:35.352725+0000","last_active":"2023-11-04T01:42:56.086442+0000","last_peered":"2023-11-04T01:42:56.086442+0000","last_clean":"2023-11-04T01:42:56.086442+0000","last_became_active":"2023-11-04T01:42:35.352127+0000","last_became_peered":"2023-11-04T01:42:35.352127+0000","last_unstale":"2023-11-04T01:42:56.086442+0000","last_undegraded":"2023-11-04T01:42:56.086442+0000","last_fullsized":"2023-11-04T01:42:56.086442+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:52:59.201087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.088231+0000","last_change":"2023-11-04T01:42:36.342229+0000","last_active":"2023-11-04T01:42:56.088231+0000","last_peered":"2023-11-04T01:42:56.088231+0000","last_clean":"2023-11-04T01:42:56.088231+0000","last_became_active":"2023-11-04T01:42:34.351542+0000","last_became_peered":"2023-11-04T01:42:34.351542+0000","last_unstale":"2023-11-04T01:42:56.088231+0000","last_undegraded":"2023-11-04T01:42:56.088231+0000","last_fullsized":"2023-11-04T01:42:56.088231+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:37:08.472507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017924740000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.086798+0000","last_change":"2023-11-04T01:41:35.728672+0000","last_active":"2023-11-04T01:42:56.086798+0000","last_peered":"2023-11-04T01:42:56.086798+0000","last_clean":"2023-11-04T01:42:56.086798+0000","last_became_active":"2023-11-04T01:41:34.727419+0000","last_became_peered":"2023-11-04T01:41:34.727419+0000","last_unstale":"2023-11-04T01:42:56.086798+0000","last_undegraded":"2023-11-04T01:42:56.086798+0000","last_fullsized":"2023-11-04T01:42:56.086798+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:35:01.127206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044278299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.605239+0000","last_change":"2023-11-04T01:42:56.600875+0000","last_active":"2023-11-04T01:42:56.605239+0000","last_peered":"2023-11-04T01:42:56.605239+0000","last_clean":"2023-11-04T01:42:56.605239+0000","last_became_active":"2023-11-04T01:42:56.600601+0000","last_became_peered":"2023-11-04T01:42:56.600601+0000","last_unstale":"2023-11-04T01:42:56.605239+0000","last_undegraded":"2023-11-04T01:42:56.605239+0000","last_fullsized":"2023-11-04T01:42:56.605239+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:23:33.101684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.587501+0000","last_change":"2023-11-04T01:42:56.095725+0000","last_active":"2023-11-04T01:42:56.587501+0000","last_peered":"2023-11-04T01:42:56.587501+0000","last_clean":"2023-11-04T01:42:56.587501+0000","last_became_active":"2023-11-04T01:42:56.095389+0000","last_became_peered":"2023-11-04T01:42:56.095389+0000","last_unstale":"2023-11-04T01:42:56.587501+0000","last_undegraded":"2023-11-04T01:42:56.587501+0000","last_fullsized":"2023-11-04T01:42:56.587501+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:08.921919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.090232+0000","last_change":"2023-11-04T01:42:35.352519+0000","last_active":"2023-11-04T01:42:56.090232+0000","last_peered":"2023-11-04T01:42:56.090232+0000","last_clean":"2023-11-04T01:42:56.090232+0000","last_became_active":"2023-11-04T01:42:35.352163+0000","last_became_peered":"2023-11-04T01:42:35.352163+0000","last_unstale":"2023-11-04T01:42:56.090232+0000","last_undegraded":"2023-11-04T01:42:56.090232+0000","last_fullsized":"2023-11-04T01:42:56.090232+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:05:52.477616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087721+0000","last_change":"2023-11-04T01:42:36.342140+0000","last_active":"2023-11-04T01:42:56.087721+0000","last_peered":"2023-11-04T01:42:56.087721+0000","last_clean":"2023-11-04T01:42:56.087721+0000","last_became_active":"2023-11-04T01:42:34.354685+0000","last_became_peered":"2023-11-04T01:42:34.354685+0000","last_unstale":"2023-11-04T01:42:56.087721+0000","last_undegraded":"2023-11-04T01:42:56.087721+0000","last_fullsized":"2023-11-04T01:42:56.087721+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:54:50.302775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050039500000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.089008+0000","last_change":"2023-11-04T01:41:36.344271+0000","last_active":"2023-11-04T01:42:56.089008+0000","last_peered":"2023-11-04T01:42:56.089008+0000","last_clean":"2023-11-04T01:42:56.089008+0000","last_became_active":"2023-11-04T01:41:34.732524+0000","last_became_peered":"2023-11-04T01:41:34.732524+0000","last_unstale":"2023-11-04T01:42:56.089008+0000","last_undegraded":"2023-11-04T01:42:56.089008+0000","last_fullsized":"2023-11-04T01:42:56.089008+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:19.350812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081160599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":228,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.085788+0000","last_change":"2023-11-04T01:39:54.204460+0000","last_active":"2023-11-04T01:42:56.085788+0000","last_peered":"2023-11-04T01:42:56.085788+0000","last_clean":"2023-11-04T01:42:56.085788+0000","last_became_active":"2023-11-04T01:39:54.203352+0000","last_became_peered":"2023-11-04T01:39:54.203352+0000","last_unstale":"2023-11-04T01:42:56.085788+0000","last_undegraded":"2023-11-04T01:42:56.085788+0000","last_fullsized":"2023-11-04T01:42:56.085788+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:52.627032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:52.627032+0000","last_clean_scrub_stamp":"2023-11-04T01:39:52.627032+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:17:18.474768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1003520,"data_stored":485713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.52700000000000002,"15min":0.53500000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.65100000000000002,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.50600000000000001,"15min":0.499},"min":{"1min":0.376,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71499999999999997,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.376}]},{"osd":1,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54400000000000004,"15min":0.54700000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69899999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55500000000000005,"15min":0.55300000000000005},"min":{"1min":0.41099999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.73299999999999998,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.41699999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56699999999999995,"15min":0.57399999999999995},"min":{"1min":0.39400000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71499999999999997,"5min":1.177,"15min":1.177},"last":0.497},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.54200000000000004,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66300000000000003,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.39800000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.44600000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.73399999999999999,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.625,"15min":0.63400000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77300000000000002,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.54600000000000004}]},{"osd":4,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.52400000000000002,"15min":0.52600000000000002},"min":{"1min":0.30599999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68000000000000005,"5min":1.048,"15min":1.048},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.54600000000000004,"15min":0.53200000000000003},"min":{"1min":0.33000000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.52300000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.52900000000000003,"15min":0.51500000000000001},"min":{"1min":0.36899999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56499999999999995,"15min":0.56899999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.51200000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57699999999999996,"15min":0.56100000000000005},"min":{"1min":0.34200000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.626,"15min":0.624},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.58399999999999996}]}]},{"osd":7,"up_from":13,"seq":55834574887,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32728,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339112,"statfs":{"total":96636764160,"available":96603250688,"internally_reserved":0,"allocated":1585152,"data_stored":1067923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53700000000000003,"15min":0.51800000000000002},"min":{"1min":0.38500000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70399999999999996,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.41899999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.70699999999999996,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.51600000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60299999999999998,"15min":0.60999999999999999},"min":{"1min":0.45300000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73099999999999998,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.625},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.628,"15min":0.61399999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.75,"5min":2.5049999999999999,"15min":2.5049999999999999},"last":0.59299999999999997}]},{"osd":2,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59299999999999997,"15min":0.58499999999999996},"min":{"1min":0.45300000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.70099999999999996,"5min":1.708,"15min":1.708},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.627,"15min":0.60599999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77500000000000002,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.76600000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58599999999999997,"15min":0.56499999999999995},"min":{"1min":0.38300000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.67700000000000005,"5min":3.2349999999999999,"15min":3.2349999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82599999999999996,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.72499999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.50900000000000001,"15min":0.48899999999999999},"min":{"1min":0.35999999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.81100000000000005,"5min":1.454,"15min":1.454},"last":0.746},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.496,"15min":0.47499999999999998},"min":{"1min":0.34899999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.61099999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.54300000000000004,"15min":0.50900000000000001},"min":{"1min":0.39700000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.89400000000000002,"5min":1.629,"15min":1.629},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56499999999999995,"15min":0.53500000000000003},"min":{"1min":0.433,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.84399999999999997,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.65000000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63300000000000001,"15min":0.59199999999999997},"min":{"1min":0.41599999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.91500000000000004,"5min":3.7850000000000001,"15min":3.7850000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.58799999999999997,"15min":0.56000000000000005},"min":{"1min":0.41899999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.77200000000000002,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.69399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574887,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":978944,"data_stored":469897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.40200000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.67100000000000004,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40000000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.64900000000000002,"5min":0.752,"15min":0.752},"last":0.59199999999999997}]},{"osd":1,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56100000000000005,"15min":0.56599999999999995},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.72899999999999998,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.38,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.57899999999999996}]},{"osd":2,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.35299999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.69499999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.373},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57399999999999995,"15min":0.57899999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.67900000000000005,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.47799999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.47299999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.67400000000000004,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.624},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57999999999999996,"15min":0.57899999999999996},"min":{"1min":0.434,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.72799999999999998,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.503}]},{"osd":4,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.746,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.65000000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78800000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58499999999999996,"15min":0.58599999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77600000000000002,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.66700000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.749,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61599999999999999,"15min":0.621},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82399999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.63800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":469897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.505,"15min":0.502},"min":{"1min":0.32000000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66200000000000003,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51200000000000001,"15min":0.50800000000000001},"min":{"1min":0.33900000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.68700000000000006,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.84799999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.49099999999999999,"15min":0.48299999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.69899999999999995,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.749},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.42299999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.67300000000000004,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.68700000000000006}]},{"osd":2,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.53900000000000003},"min":{"1min":0.40300000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71099999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53400000000000003,"15min":0.53500000000000003},"min":{"1min":0.41499999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.67700000000000005,"5min":0.873,"15min":0.873},"last":0.86799999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53300000000000003,"15min":0.53400000000000003},"min":{"1min":0.39200000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.69299999999999995,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.74299999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.63100000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.47999999999999998,"15min":0.48299999999999998},"min":{"1min":0.34100000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.50600000000000001,"15min":0.50900000000000001},"min":{"1min":0.371,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66500000000000004,"5min":0.745,"15min":0.745},"last":0.77100000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.49299999999999999,"15min":0.497},"min":{"1min":0.34499999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.72399999999999998,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.755,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.89500000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.40699999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.751,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.34899999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.747,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.83399999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":991232,"data_stored":477555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.31900000000000001,"15min":0.317},"min":{"1min":0.20599999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.5},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.32800000000000001,"15min":0.32200000000000001},"min":{"1min":0.23699999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.32700000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.36599999999999999,"15min":0.372},"min":{"1min":0.23899999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.48499999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.58699999999999997,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.55400000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.36799999999999999,"15min":0.36699999999999999},"min":{"1min":0.28199999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.52700000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.42199999999999999,"15min":0.42699999999999999},"min":{"1min":0.30299999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.50900000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.35299999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.81599999999999995,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58399999999999996,"15min":0.58799999999999997},"min":{"1min":0.40500000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.60799999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58699999999999997,"15min":0.59399999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79400000000000004,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.58599999999999997}]},{"osd":6,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57699999999999996,"15min":0.58099999999999996},"min":{"1min":0.373,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77100000000000002,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60999999999999999,"15min":0.61599999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85199999999999998,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.56799999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.626,"15min":0.628},"min":{"1min":0.46400000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58599999999999997,"15min":0.58899999999999997},"min":{"1min":0.40000000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83199999999999996,"5min":0.87,"15min":0.87},"last":0.622}]}]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":978944,"data_stored":469897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.32000000000000001,"15min":0.32200000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.35299999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.36899999999999999,"15min":0.371},"min":{"1min":0.245,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.373,"15min":0.378},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.42199999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.313}]},{"osd":3,"last update":"Sat Nov 4 01:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.34999999999999998,"15min":0.35499999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.46600000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.378},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.29499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.36699999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.55500000000000005,"15min":0.54700000000000004},"min":{"1min":0.41599999999999998,"5min":0.374,"15min":0.374},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.58599999999999997}]},{"osd":5,"last update":"Sat Nov 4 01:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.378,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.41499999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.55000000000000004}]},{"osd":6,"last update":"Sat Nov 4 01:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58299999999999996,"15min":0.57999999999999996},"min":{"1min":0.43099999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.55900000000000005,"15min":0.55400000000000005},"min":{"1min":0.42199999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.57299999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60099999999999998,"15min":0.59999999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.497},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.60299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1003520,"data_stored":485713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.27900000000000003,"5min":0.30299999999999999,"15min":0.307},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.42999999999999999,"5min":0.443,"15min":0.443},"last":0.20000000000000001},{"interface":"front","average":{"1min":0.29399999999999998,"5min":0.312,"15min":0.315},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.252}]},{"osd":2,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.32700000000000001,"15min":0.33100000000000002},"min":{"1min":0.23400000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.43099999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.373,"15min":0.378},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.52200000000000002,"5min":0.621,"15min":0.621},"last":0.28399999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.371,"15min":0.375},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.46400000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.40200000000000002,"15min":0.40699999999999997},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.33200000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.57899999999999996,"15min":0.58999999999999997},"min":{"1min":0.36699999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.65100000000000002,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56299999999999994,"15min":0.56599999999999995},"min":{"1min":0.38500000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.59299999999999997}]},{"osd":5,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53900000000000003,"15min":0.54000000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.503},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59799999999999998,"15min":0.60699999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.71699999999999997,"5min":0.87,"15min":0.87},"last":0.56499999999999995}]},{"osd":6,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56299999999999994,"15min":0.56599999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77800000000000002,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.60399999999999998,"15min":0.61399999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72499999999999998,"5min":1.129,"15min":1.129},"last":0.48999999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.629,"15min":0.63700000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.75600000000000001,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.625,"15min":0.63300000000000001},"min":{"1min":0.42399999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82799999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.55200000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32732,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339108,"statfs":{"total":96636764160,"available":96603246592,"internally_reserved":0,"allocated":1581056,"data_stored":1066904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:42:53 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.32600000000000001,"15min":0.33200000000000002},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.53200000000000003,"5min":0.874,"15min":0.874},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.374,"15min":0.38800000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.502,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.32600000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:42:53 2023","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.34899999999999998,"15min":0.373},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.38100000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.35499999999999998,"15min":0.372},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.41699999999999998,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.33700000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:42:53 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.34699999999999998,"15min":0.35699999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.46600000000000003,"5min":1.278,"15min":1.278},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.42099999999999999,"15min":0.437},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.52100000000000002,"5min":1.304,"15min":1.304},"last":0.35399999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:42:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.58199999999999996,"15min":0.58699999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76800000000000002,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.622,"15min":0.625},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.82399999999999995,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.71699999999999997}]},{"osd":5,"last update":"Sat Nov 4 01:42:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38400000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73299999999999998,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.58599999999999997,"15min":0.60099999999999998},"min":{"1min":0.373,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.71399999999999997,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.78800000000000003}]},{"osd":6,"last update":"Sat Nov 4 01:42:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.1319999999999999,"5min":1.248,"15min":1.248},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.61499999999999999,"15min":0.626},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73699999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.82399999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:42:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.57899999999999996,"15min":0.58799999999999997},"min":{"1min":0.38300000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78300000000000003,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.61399999999999999,"15min":0.62},"min":{"1min":0.41199999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.74299999999999999,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.86299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:43:00.056 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:43:00.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.183+0000 7f7166cfc640 1 Processor -- start 2023-11-04T01:43:00.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.183+0000 7f7166cfc640 1 -- start start 2023-11-04T01:43:00.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.184+0000 7f7166cfc640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71600cde60 0x7f716015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.184+0000 7f7166cfc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f71600ce240 0x7f71600d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.184+0000 7f7166cfc640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f716015e000 con 0x7f716015daa0 2023-11-04T01:43:00.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.184+0000 7f7166cfc640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f716015e5c0 con 0x7f71600ce240 2023-11-04T01:43:00.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.184+0000 7f7166cfc640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f716015e2e0 con 0x7f71600cde60 2023-11-04T01:43:00.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.184+0000 7f7165299640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f71600ce240 0x7f71600d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.184+0000 7f715ffff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f716015daa0 0x7f7160157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49778/0 (socket says 172.21.15.77:49778) 2023-11-04T01:43:00.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.184+0000 7f715ffff640 1 -- 172.21.15.77:0/704032381 learned_addr learned my addr 172.21.15.77:0/704032381 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:00.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.185+0000 7f7164a98640 1 --2- 172.21.15.77:0/704032381 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71600cde60 0x7f716015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.185+0000 7f7165299640 1 -- 172.21.15.77:0/704032381 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71600cde60 msgr2=0x7f716015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:00.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.185+0000 7f7165299640 1 --2- 172.21.15.77:0/704032381 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71600cde60 0x7f716015d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.185+0000 7f7165299640 1 -- 172.21.15.77:0/704032381 >> v1:172.21.15.77:6789/0 conn(0x7f716015daa0 legacy=0x7f7160157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.185+0000 7f715f7fe640 1 -- 172.21.15.77:0/704032381 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1111791581 0 0) 0x7f716015e000 con 0x7f716015daa0 2023-11-04T01:43:00.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.185+0000 7f7165299640 1 -- 172.21.15.77:0/704032381 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71600d1120 con 0x7f71600ce240 2023-11-04T01:43:00.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.185+0000 7f7165299640 1 --2- 172.21.15.77:0/704032381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71600ce240 0x7f71600d1920 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f7158009d90 tx=0x7f715802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfc52d01f50a6e30 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:00.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.186+0000 7f715f7fe640 1 -- 172.21.15.77:0/704032381 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715802cc50 con 0x7f71600ce240 2023-11-04T01:43:00.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.186+0000 7f715f7fe640 1 -- 172.21.15.77:0/704032381 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f715802cdb0 con 0x7f71600ce240 2023-11-04T01:43:00.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.186+0000 7f715f7fe640 1 -- 172.21.15.77:0/704032381 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7158034660 con 0x7f71600ce240 2023-11-04T01:43:00.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.186+0000 7f7166cfc640 1 -- 172.21.15.77:0/704032381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71600ce240 msgr2=0x7f71600d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.186+0000 7f7166cfc640 1 --2- 172.21.15.77:0/704032381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71600ce240 0x7f71600d1920 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f7158009d90 tx=0x7f715802bea0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.186+0000 7f7166cfc640 1 -- 172.21.15.77:0/704032381 shutdown_connections 2023-11-04T01:43:00.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.186+0000 7f7166cfc640 1 --2- 172.21.15.77:0/704032381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71600ce240 0x7f71600d1920 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.186+0000 7f7166cfc640 1 --2- 172.21.15.77:0/704032381 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71600cde60 0x7f716015d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.186+0000 7f7166cfc640 1 -- 172.21.15.77:0/704032381 >> 172.21.15.77:0/704032381 conn(0x7f7160071f30 msgr2=0x7f71600cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:00.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.186+0000 7f7166cfc640 1 -- 172.21.15.77:0/704032381 shutdown_connections 2023-11-04T01:43:00.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.186+0000 7f7166cfc640 1 -- 172.21.15.77:0/704032381 wait complete. 2023-11-04T01:43:00.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.187+0000 7f7166cfc640 1 Processor -- start 2023-11-04T01:43:00.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.187+0000 7f7166cfc640 1 -- start start 2023-11-04T01:43:00.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.188+0000 7f7166cfc640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71600cde60 0x7f71600cd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.188+0000 7f7166cfc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71600ce240 0x7f7160152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.188+0000 7f7166cfc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f716015daa0 0x7f71601f1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.188+0000 7f7166cfc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7160153fc0 con 0x7f716015daa0 2023-11-04T01:43:00.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.188+0000 7f7166cfc640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71601529a0 con 0x7f71600ce240 2023-11-04T01:43:00.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.188+0000 7f7166cfc640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7160152c00 con 0x7f71600cde60 2023-11-04T01:43:00.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.188+0000 7f7165299640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f716015daa0 0x7f71601f1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.188+0000 7f7165299640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f716015daa0 0x7f71601f1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45116/0 (socket says 172.21.15.77:45116) 2023-11-04T01:43:00.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.188+0000 7f7165299640 1 -- 172.21.15.77:0/699298135 learned_addr learned my addr 172.21.15.77:0/699298135 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:00.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.189+0000 7f7165299640 1 -- 172.21.15.77:0/699298135 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71600cde60 msgr2=0x7f71600cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.189+0000 7f7165299640 1 --2- 172.21.15.77:0/699298135 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71600cde60 0x7f71600cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.189+0000 7f7165299640 1 -- 172.21.15.77:0/699298135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71600ce240 msgr2=0x7f7160152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.189+0000 7f7165299640 1 --2- 172.21.15.77:0/699298135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71600ce240 0x7f7160152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.189+0000 7f7165299640 1 -- 172.21.15.77:0/699298135 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7158009a70 con 0x7f716015daa0 2023-11-04T01:43:00.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.189+0000 7f7165299640 1 --2- 172.21.15.77:0/699298135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f716015daa0 0x7f71601f1d70 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f7158009d90 tx=0x7f7158004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:00.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.189+0000 7f715d7fa640 1 -- 172.21.15.77:0/699298135 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7158040650 con 0x7f716015daa0 2023-11-04T01:43:00.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.189+0000 7f715d7fa640 1 -- 172.21.15.77:0/699298135 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71580407d0 con 0x7f716015daa0 2023-11-04T01:43:00.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.189+0000 7f715d7fa640 1 -- 172.21.15.77:0/699298135 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7158040b80 con 0x7f716015daa0 2023-11-04T01:43:00.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.189+0000 7f7166cfc640 1 -- 172.21.15.77:0/699298135 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7160152ee0 con 0x7f716015daa0 2023-11-04T01:43:00.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.189+0000 7f7166cfc640 1 -- 172.21.15.77:0/699298135 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71601534a0 con 0x7f716015daa0 2023-11-04T01:43:00.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.190+0000 7f7166cfc640 1 -- 172.21.15.77:0/699298135 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7160074290 con 0x7f716015daa0 2023-11-04T01:43:00.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.190+0000 7f715d7fa640 1 -- 172.21.15.77:0/699298135 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7158040ce0 con 0x7f716015daa0 2023-11-04T01:43:00.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.191+0000 7f715d7fa640 1 --2- 172.21.15.77:0/699298135 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f714c06ae70 0x7f714c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.191+0000 7f715d7fa640 1 -- 172.21.15.77:0/699298135 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f71580ac950 con 0x7f716015daa0 2023-11-04T01:43:00.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.191+0000 7f7164a98640 1 --2- 172.21.15.77:0/699298135 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f714c06ae70 0x7f714c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.191+0000 7f7164a98640 1 --2- 172.21.15.77:0/699298135 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f714c06ae70 0x7f714c06d330 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f71500098f0 tx=0x7f7150008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:00.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.195+0000 7f715d7fa640 1 -- 172.21.15.77:0/699298135 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7158077520 con 0x7f716015daa0 2023-11-04T01:43:00.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.357+0000 7f7166cfc640 1 -- 172.21.15.77:0/699298135 --> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f71600d1400 con 0x7f714c06ae70 2023-11-04T01:43:00.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.370+0000 7f715d7fa640 1 -- 172.21.15.77:0/699298135 <== mgr.4123 v2:172.21.15.122:6832/2275325762 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+531968 (secure 0 0 0) 0x7f7150009e70 con 0x7f714c06ae70 2023-11-04T01:43:00.377 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:43:00.381 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-04T01:43:00.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.374+0000 7f7166cfc640 1 -- 172.21.15.77:0/699298135 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f714c06ae70 msgr2=0x7f714c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.374+0000 7f7166cfc640 1 --2- 172.21.15.77:0/699298135 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f714c06ae70 0x7f714c06d330 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f71500098f0 tx=0x7f7150008040 comp rx=0 tx=0).stop 2023-11-04T01:43:00.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.374+0000 7f7166cfc640 1 -- 172.21.15.77:0/699298135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f716015daa0 msgr2=0x7f71601f1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.374+0000 7f7166cfc640 1 --2- 172.21.15.77:0/699298135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f716015daa0 0x7f71601f1d70 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f7158009d90 tx=0x7f7158004a40 comp rx=0 tx=0).stop 2023-11-04T01:43:00.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.374+0000 7f7166cfc640 1 -- 172.21.15.77:0/699298135 shutdown_connections 2023-11-04T01:43:00.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.374+0000 7f7166cfc640 1 --2- 172.21.15.77:0/699298135 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f714c06ae70 0x7f714c06d330 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.374+0000 7f7166cfc640 1 --2- 172.21.15.77:0/699298135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f716015daa0 0x7f71601f1d70 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.374+0000 7f7166cfc640 1 --2- 172.21.15.77:0/699298135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71600ce240 0x7f7160152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.374+0000 7f7166cfc640 1 --2- 172.21.15.77:0/699298135 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71600cde60 0x7f71600cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.374+0000 7f7166cfc640 1 -- 172.21.15.77:0/699298135 >> 172.21.15.77:0/699298135 conn(0x7f7160071f30 msgr2=0x7f71600c9120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:00.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.374+0000 7f7166cfc640 1 -- 172.21.15.77:0/699298135 shutdown_connections 2023-11-04T01:43:00.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.374+0000 7f7166cfc640 1 -- 172.21.15.77:0/699298135 wait complete. 2023-11-04T01:43:00.389 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":170,"stamp":"2023-11-04T01:42:59.671061+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":174,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":213,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233392,"kb_used_data":8888,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754741328,"statfs":{"total":773094113280,"available":772855119872,"internally_reserved":0,"allocated":9101312,"data_stored":4993499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":229756466},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.594150"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.596313+0000","last_change":"2023-11-04T01:42:56.590819+0000","last_active":"2023-11-04T01:42:56.596313+0000","last_peered":"2023-11-04T01:42:56.596313+0000","last_clean":"2023-11-04T01:42:56.596313+0000","last_became_active":"2023-11-04T01:42:56.590551+0000","last_became_peered":"2023-11-04T01:42:56.590551+0000","last_unstale":"2023-11-04T01:42:56.596313+0000","last_undegraded":"2023-11-04T01:42:56.596313+0000","last_fullsized":"2023-11-04T01:42:56.596313+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:42:02.251901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.593454+0000","last_change":"2023-11-04T01:42:56.590955+0000","last_active":"2023-11-04T01:42:56.593454+0000","last_peered":"2023-11-04T01:42:56.593454+0000","last_clean":"2023-11-04T01:42:56.593454+0000","last_became_active":"2023-11-04T01:42:56.590690+0000","last_became_peered":"2023-11-04T01:42:56.590690+0000","last_unstale":"2023-11-04T01:42:56.593454+0000","last_undegraded":"2023-11-04T01:42:56.593454+0000","last_fullsized":"2023-11-04T01:42:56.593454+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:46:47.134580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.596347+0000","last_change":"2023-11-04T01:42:56.590889+0000","last_active":"2023-11-04T01:42:56.596347+0000","last_peered":"2023-11-04T01:42:56.596347+0000","last_clean":"2023-11-04T01:42:56.596347+0000","last_became_active":"2023-11-04T01:42:56.590614+0000","last_became_peered":"2023-11-04T01:42:56.590614+0000","last_unstale":"2023-11-04T01:42:56.596347+0000","last_undegraded":"2023-11-04T01:42:56.596347+0000","last_fullsized":"2023-11-04T01:42:56.596347+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:38.137098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.604908+0000","last_change":"2023-11-04T01:42:56.601129+0000","last_active":"2023-11-04T01:42:56.604908+0000","last_peered":"2023-11-04T01:42:56.604908+0000","last_clean":"2023-11-04T01:42:56.604908+0000","last_became_active":"2023-11-04T01:42:56.600871+0000","last_became_peered":"2023-11-04T01:42:56.600871+0000","last_unstale":"2023-11-04T01:42:56.604908+0000","last_undegraded":"2023-11-04T01:42:56.604908+0000","last_fullsized":"2023-11-04T01:42:56.604908+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:55:22.096002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.605062+0000","last_change":"2023-11-04T01:42:56.601392+0000","last_active":"2023-11-04T01:42:56.605062+0000","last_peered":"2023-11-04T01:42:56.605062+0000","last_clean":"2023-11-04T01:42:56.605062+0000","last_became_active":"2023-11-04T01:42:56.601117+0000","last_became_peered":"2023-11-04T01:42:56.601117+0000","last_unstale":"2023-11-04T01:42:56.605062+0000","last_undegraded":"2023-11-04T01:42:56.605062+0000","last_fullsized":"2023-11-04T01:42:56.605062+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:53:16.150719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.599793+0000","last_change":"2023-11-04T01:42:56.595421+0000","last_active":"2023-11-04T01:42:56.599793+0000","last_peered":"2023-11-04T01:42:56.599793+0000","last_clean":"2023-11-04T01:42:56.599793+0000","last_became_active":"2023-11-04T01:42:56.595109+0000","last_became_peered":"2023-11-04T01:42:56.595109+0000","last_unstale":"2023-11-04T01:42:56.599793+0000","last_undegraded":"2023-11-04T01:42:56.599793+0000","last_fullsized":"2023-11-04T01:42:56.599793+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:49:30.516581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.599766+0000","last_change":"2023-11-04T01:42:56.596125+0000","last_active":"2023-11-04T01:42:56.599766+0000","last_peered":"2023-11-04T01:42:56.599766+0000","last_clean":"2023-11-04T01:42:56.599766+0000","last_became_active":"2023-11-04T01:42:56.595821+0000","last_became_peered":"2023-11-04T01:42:56.595821+0000","last_unstale":"2023-11-04T01:42:56.599766+0000","last_undegraded":"2023-11-04T01:42:56.599766+0000","last_fullsized":"2023-11-04T01:42:56.599766+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:30:15.007217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.590981+0000","last_change":"2023-11-04T01:42:56.587146+0000","last_active":"2023-11-04T01:42:56.590981+0000","last_peered":"2023-11-04T01:42:56.590981+0000","last_clean":"2023-11-04T01:42:56.590981+0000","last_became_active":"2023-11-04T01:42:56.586887+0000","last_became_peered":"2023-11-04T01:42:56.586887+0000","last_unstale":"2023-11-04T01:42:56.590981+0000","last_undegraded":"2023-11-04T01:42:56.590981+0000","last_fullsized":"2023-11-04T01:42:56.590981+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:06:35.498440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.606839+0000","last_change":"2023-11-04T01:42:56.601615+0000","last_active":"2023-11-04T01:42:56.606839+0000","last_peered":"2023-11-04T01:42:56.606839+0000","last_clean":"2023-11-04T01:42:56.606839+0000","last_became_active":"2023-11-04T01:42:56.601338+0000","last_became_peered":"2023-11-04T01:42:56.601338+0000","last_unstale":"2023-11-04T01:42:56.606839+0000","last_undegraded":"2023-11-04T01:42:56.606839+0000","last_fullsized":"2023-11-04T01:42:56.606839+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:16:38.383201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.604887+0000","last_change":"2023-11-04T01:42:56.601194+0000","last_active":"2023-11-04T01:42:56.604887+0000","last_peered":"2023-11-04T01:42:56.604887+0000","last_clean":"2023-11-04T01:42:56.604887+0000","last_became_active":"2023-11-04T01:42:56.600922+0000","last_became_peered":"2023-11-04T01:42:56.600922+0000","last_unstale":"2023-11-04T01:42:56.604887+0000","last_undegraded":"2023-11-04T01:42:56.604887+0000","last_fullsized":"2023-11-04T01:42:56.604887+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:55:45.724157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.604559+0000","last_change":"2023-11-04T01:42:56.600861+0000","last_active":"2023-11-04T01:42:56.604559+0000","last_peered":"2023-11-04T01:42:56.604559+0000","last_clean":"2023-11-04T01:42:56.604559+0000","last_became_active":"2023-11-04T01:42:56.600468+0000","last_became_peered":"2023-11-04T01:42:56.600468+0000","last_unstale":"2023-11-04T01:42:56.604559+0000","last_undegraded":"2023-11-04T01:42:56.604559+0000","last_fullsized":"2023-11-04T01:42:56.604559+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:12:39.403469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.606751+0000","last_change":"2023-11-04T01:42:56.601576+0000","last_active":"2023-11-04T01:42:56.606751+0000","last_peered":"2023-11-04T01:42:56.606751+0000","last_clean":"2023-11-04T01:42:56.606751+0000","last_became_active":"2023-11-04T01:42:56.601311+0000","last_became_peered":"2023-11-04T01:42:56.601311+0000","last_unstale":"2023-11-04T01:42:56.606751+0000","last_undegraded":"2023-11-04T01:42:56.606751+0000","last_fullsized":"2023-11-04T01:42:56.606751+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:53.757794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.600075+0000","last_change":"2023-11-04T01:42:56.599280+0000","last_active":"2023-11-04T01:42:56.600075+0000","last_peered":"2023-11-04T01:42:56.600075+0000","last_clean":"2023-11-04T01:42:56.600075+0000","last_became_active":"2023-11-04T01:42:56.599021+0000","last_became_peered":"2023-11-04T01:42:56.599021+0000","last_unstale":"2023-11-04T01:42:56.600075+0000","last_undegraded":"2023-11-04T01:42:56.600075+0000","last_fullsized":"2023-11-04T01:42:56.600075+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:33:25.781100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.607284+0000","last_change":"2023-11-04T01:42:56.602504+0000","last_active":"2023-11-04T01:42:56.607284+0000","last_peered":"2023-11-04T01:42:56.607284+0000","last_clean":"2023-11-04T01:42:56.607284+0000","last_became_active":"2023-11-04T01:42:56.602245+0000","last_became_peered":"2023-11-04T01:42:56.602245+0000","last_unstale":"2023-11-04T01:42:56.607284+0000","last_undegraded":"2023-11-04T01:42:56.607284+0000","last_fullsized":"2023-11-04T01:42:56.607284+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:56:20.190779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.599104+0000","last_change":"2023-11-04T01:42:56.592257+0000","last_active":"2023-11-04T01:42:56.599104+0000","last_peered":"2023-11-04T01:42:56.599104+0000","last_clean":"2023-11-04T01:42:56.599104+0000","last_became_active":"2023-11-04T01:42:56.592009+0000","last_became_peered":"2023-11-04T01:42:56.592009+0000","last_unstale":"2023-11-04T01:42:56.599104+0000","last_undegraded":"2023-11-04T01:42:56.599104+0000","last_fullsized":"2023-11-04T01:42:56.599104+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:15:38.894368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.593354+0000","last_change":"2023-11-04T01:42:56.592620+0000","last_active":"2023-11-04T01:42:56.593354+0000","last_peered":"2023-11-04T01:42:56.593354+0000","last_clean":"2023-11-04T01:42:56.593354+0000","last_became_active":"2023-11-04T01:42:56.592347+0000","last_became_peered":"2023-11-04T01:42:56.592347+0000","last_unstale":"2023-11-04T01:42:56.593354+0000","last_undegraded":"2023-11-04T01:42:56.593354+0000","last_fullsized":"2023-11-04T01:42:56.593354+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:51:53.283591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.594298+0000","last_change":"2023-11-04T01:42:56.592300+0000","last_active":"2023-11-04T01:42:56.594298+0000","last_peered":"2023-11-04T01:42:56.594298+0000","last_clean":"2023-11-04T01:42:56.594298+0000","last_became_active":"2023-11-04T01:42:56.592047+0000","last_became_peered":"2023-11-04T01:42:56.592047+0000","last_unstale":"2023-11-04T01:42:56.594298+0000","last_undegraded":"2023-11-04T01:42:56.594298+0000","last_fullsized":"2023-11-04T01:42:56.594298+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:13:26.525513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.604945+0000","last_change":"2023-11-04T01:42:56.602384+0000","last_active":"2023-11-04T01:42:56.604945+0000","last_peered":"2023-11-04T01:42:56.604945+0000","last_clean":"2023-11-04T01:42:56.604945+0000","last_became_active":"2023-11-04T01:42:56.601959+0000","last_became_peered":"2023-11-04T01:42:56.601959+0000","last_unstale":"2023-11-04T01:42:56.604945+0000","last_undegraded":"2023-11-04T01:42:56.604945+0000","last_fullsized":"2023-11-04T01:42:56.604945+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:27:05.944471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.605338+0000","last_change":"2023-11-04T01:42:56.601070+0000","last_active":"2023-11-04T01:42:56.605338+0000","last_peered":"2023-11-04T01:42:56.605338+0000","last_clean":"2023-11-04T01:42:56.605338+0000","last_became_active":"2023-11-04T01:42:56.600806+0000","last_became_peered":"2023-11-04T01:42:56.600806+0000","last_unstale":"2023-11-04T01:42:56.605338+0000","last_undegraded":"2023-11-04T01:42:56.605338+0000","last_fullsized":"2023-11-04T01:42:56.605338+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:41:46.161943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.606616+0000","last_change":"2023-11-04T01:42:56.600847+0000","last_active":"2023-11-04T01:42:56.606616+0000","last_peered":"2023-11-04T01:42:56.606616+0000","last_clean":"2023-11-04T01:42:56.606616+0000","last_became_active":"2023-11-04T01:42:56.600318+0000","last_became_peered":"2023-11-04T01:42:56.600318+0000","last_unstale":"2023-11-04T01:42:56.606616+0000","last_undegraded":"2023-11-04T01:42:56.606616+0000","last_fullsized":"2023-11-04T01:42:56.606616+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:31:50.663391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.605278+0000","last_change":"2023-11-04T01:42:56.600548+0000","last_active":"2023-11-04T01:42:56.605278+0000","last_peered":"2023-11-04T01:42:56.605278+0000","last_clean":"2023-11-04T01:42:56.605278+0000","last_became_active":"2023-11-04T01:42:56.600227+0000","last_became_peered":"2023-11-04T01:42:56.600227+0000","last_unstale":"2023-11-04T01:42:56.605278+0000","last_undegraded":"2023-11-04T01:42:56.605278+0000","last_fullsized":"2023-11-04T01:42:56.605278+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:18:06.098948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.593390+0000","last_change":"2023-11-04T01:42:56.590795+0000","last_active":"2023-11-04T01:42:56.593390+0000","last_peered":"2023-11-04T01:42:56.593390+0000","last_clean":"2023-11-04T01:42:56.593390+0000","last_became_active":"2023-11-04T01:42:56.590534+0000","last_became_peered":"2023-11-04T01:42:56.590534+0000","last_unstale":"2023-11-04T01:42:56.593390+0000","last_undegraded":"2023-11-04T01:42:56.593390+0000","last_fullsized":"2023-11-04T01:42:56.593390+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:17.805666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.593421+0000","last_change":"2023-11-04T01:42:56.590830+0000","last_active":"2023-11-04T01:42:56.593421+0000","last_peered":"2023-11-04T01:42:56.593421+0000","last_clean":"2023-11-04T01:42:56.593421+0000","last_became_active":"2023-11-04T01:42:56.590562+0000","last_became_peered":"2023-11-04T01:42:56.590562+0000","last_unstale":"2023-11-04T01:42:56.593421+0000","last_undegraded":"2023-11-04T01:42:56.593421+0000","last_fullsized":"2023-11-04T01:42:56.593421+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:40:27.673699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.599946+0000","last_change":"2023-11-04T01:42:56.597038+0000","last_active":"2023-11-04T01:42:56.599946+0000","last_peered":"2023-11-04T01:42:56.599946+0000","last_clean":"2023-11-04T01:42:56.599946+0000","last_became_active":"2023-11-04T01:42:56.596736+0000","last_became_peered":"2023-11-04T01:42:56.596736+0000","last_unstale":"2023-11-04T01:42:56.599946+0000","last_undegraded":"2023-11-04T01:42:56.599946+0000","last_fullsized":"2023-11-04T01:42:56.599946+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:30:50.657341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.607024+0000","last_change":"2023-11-04T01:42:56.602145+0000","last_active":"2023-11-04T01:42:56.607024+0000","last_peered":"2023-11-04T01:42:56.607024+0000","last_clean":"2023-11-04T01:42:56.607024+0000","last_became_active":"2023-11-04T01:42:56.601776+0000","last_became_peered":"2023-11-04T01:42:56.601776+0000","last_unstale":"2023-11-04T01:42:56.607024+0000","last_undegraded":"2023-11-04T01:42:56.607024+0000","last_fullsized":"2023-11-04T01:42:56.607024+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:43:47.542910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.591803+0000","last_change":"2023-11-04T01:42:56.589085+0000","last_active":"2023-11-04T01:42:56.591803+0000","last_peered":"2023-11-04T01:42:56.591803+0000","last_clean":"2023-11-04T01:42:56.591803+0000","last_became_active":"2023-11-04T01:42:56.588824+0000","last_became_peered":"2023-11-04T01:42:56.588824+0000","last_unstale":"2023-11-04T01:42:56.591803+0000","last_undegraded":"2023-11-04T01:42:56.591803+0000","last_fullsized":"2023-11-04T01:42:56.591803+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:30:12.207973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.604599+0000","last_change":"2023-11-04T01:42:56.601836+0000","last_active":"2023-11-04T01:42:56.604599+0000","last_peered":"2023-11-04T01:42:56.604599+0000","last_clean":"2023-11-04T01:42:56.604599+0000","last_became_active":"2023-11-04T01:42:56.601549+0000","last_became_peered":"2023-11-04T01:42:56.601549+0000","last_unstale":"2023-11-04T01:42:56.604599+0000","last_undegraded":"2023-11-04T01:42:56.604599+0000","last_fullsized":"2023-11-04T01:42:56.604599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:43:47.542910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.606998+0000","last_change":"2023-11-04T01:42:56.602836+0000","last_active":"2023-11-04T01:42:56.606998+0000","last_peered":"2023-11-04T01:42:56.606998+0000","last_clean":"2023-11-04T01:42:56.606998+0000","last_became_active":"2023-11-04T01:42:56.602589+0000","last_became_peered":"2023-11-04T01:42:56.602589+0000","last_unstale":"2023-11-04T01:42:56.606998+0000","last_undegraded":"2023-11-04T01:42:56.606998+0000","last_fullsized":"2023-11-04T01:42:56.606998+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:23:35.959031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.591004+0000","last_change":"2023-11-04T01:42:56.585586+0000","last_active":"2023-11-04T01:42:56.591004+0000","last_peered":"2023-11-04T01:42:56.591004+0000","last_clean":"2023-11-04T01:42:56.591004+0000","last_became_active":"2023-11-04T01:42:56.585325+0000","last_became_peered":"2023-11-04T01:42:56.585325+0000","last_unstale":"2023-11-04T01:42:56.591004+0000","last_undegraded":"2023-11-04T01:42:56.591004+0000","last_fullsized":"2023-11-04T01:42:56.591004+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:35.884718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.605340+0000","last_change":"2023-11-04T01:42:56.601394+0000","last_active":"2023-11-04T01:42:56.605340+0000","last_peered":"2023-11-04T01:42:56.605340+0000","last_clean":"2023-11-04T01:42:56.605340+0000","last_became_active":"2023-11-04T01:42:56.601146+0000","last_became_peered":"2023-11-04T01:42:56.601146+0000","last_unstale":"2023-11-04T01:42:56.605340+0000","last_undegraded":"2023-11-04T01:42:56.605340+0000","last_fullsized":"2023-11-04T01:42:56.605340+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:49:40.763349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.607608+0000","last_change":"2023-11-04T01:42:56.604358+0000","last_active":"2023-11-04T01:42:56.607608+0000","last_peered":"2023-11-04T01:42:56.607608+0000","last_clean":"2023-11-04T01:42:56.607608+0000","last_became_active":"2023-11-04T01:42:56.603975+0000","last_became_peered":"2023-11-04T01:42:56.603975+0000","last_unstale":"2023-11-04T01:42:56.607608+0000","last_undegraded":"2023-11-04T01:42:56.607608+0000","last_fullsized":"2023-11-04T01:42:56.607608+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:23:35.959031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.599986+0000","last_change":"2023-11-04T01:42:56.591662+0000","last_active":"2023-11-04T01:42:56.599986+0000","last_peered":"2023-11-04T01:42:56.599986+0000","last_clean":"2023-11-04T01:42:56.599986+0000","last_became_active":"2023-11-04T01:42:56.591407+0000","last_became_peered":"2023-11-04T01:42:56.591407+0000","last_unstale":"2023-11-04T01:42:56.599986+0000","last_undegraded":"2023-11-04T01:42:56.599986+0000","last_fullsized":"2023-11-04T01:42:56.599986+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:20:25.552753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.599864+0000","last_change":"2023-11-04T01:42:56.593762+0000","last_active":"2023-11-04T01:42:56.599864+0000","last_peered":"2023-11-04T01:42:56.599864+0000","last_clean":"2023-11-04T01:42:56.599864+0000","last_became_active":"2023-11-04T01:42:56.593420+0000","last_became_peered":"2023-11-04T01:42:56.593420+0000","last_unstale":"2023-11-04T01:42:56.599864+0000","last_undegraded":"2023-11-04T01:42:56.599864+0000","last_fullsized":"2023-11-04T01:42:56.599864+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:32.718463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.593868+0000","last_change":"2023-11-04T01:42:56.096984+0000","last_active":"2023-11-04T01:42:56.593868+0000","last_peered":"2023-11-04T01:42:56.593868+0000","last_clean":"2023-11-04T01:42:56.593868+0000","last_became_active":"2023-11-04T01:42:56.096725+0000","last_became_peered":"2023-11-04T01:42:56.096725+0000","last_unstale":"2023-11-04T01:42:56.593868+0000","last_undegraded":"2023-11-04T01:42:56.593868+0000","last_fullsized":"2023-11-04T01:42:56.593868+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:51:52.278839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.086887+0000","last_change":"2023-11-04T01:42:35.354740+0000","last_active":"2023-11-04T01:42:56.086887+0000","last_peered":"2023-11-04T01:42:56.086887+0000","last_clean":"2023-11-04T01:42:56.086887+0000","last_became_active":"2023-11-04T01:42:35.354383+0000","last_became_peered":"2023-11-04T01:42:35.354383+0000","last_unstale":"2023-11-04T01:42:56.086887+0000","last_undegraded":"2023-11-04T01:42:56.086887+0000","last_fullsized":"2023-11-04T01:42:56.086887+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:38.574240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.089467+0000","last_change":"2023-11-04T01:42:36.412560+0000","last_active":"2023-11-04T01:42:56.089467+0000","last_peered":"2023-11-04T01:42:56.089467+0000","last_clean":"2023-11-04T01:42:56.089467+0000","last_became_active":"2023-11-04T01:42:34.346736+0000","last_became_peered":"2023-11-04T01:42:34.346736+0000","last_unstale":"2023-11-04T01:42:56.089467+0000","last_undegraded":"2023-11-04T01:42:56.089467+0000","last_fullsized":"2023-11-04T01:42:56.089467+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:37.572320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071730100000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.091122+0000","last_change":"2023-11-04T01:41:36.067943+0000","last_active":"2023-11-04T01:42:56.091122+0000","last_peered":"2023-11-04T01:42:56.091122+0000","last_clean":"2023-11-04T01:42:56.091122+0000","last_became_active":"2023-11-04T01:41:34.734305+0000","last_became_peered":"2023-11-04T01:41:34.734305+0000","last_unstale":"2023-11-04T01:42:56.091122+0000","last_undegraded":"2023-11-04T01:42:56.091122+0000","last_fullsized":"2023-11-04T01:42:56.091122+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:48.121273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033780399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.608939+0000","last_change":"2023-11-04T01:42:56.605195+0000","last_active":"2023-11-04T01:42:56.608939+0000","last_peered":"2023-11-04T01:42:56.608939+0000","last_clean":"2023-11-04T01:42:56.608939+0000","last_became_active":"2023-11-04T01:42:56.604919+0000","last_became_peered":"2023-11-04T01:42:56.604919+0000","last_unstale":"2023-11-04T01:42:56.608939+0000","last_undegraded":"2023-11-04T01:42:56.608939+0000","last_fullsized":"2023-11-04T01:42:56.608939+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:15:38.894368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.588739+0000","last_change":"2023-11-04T01:42:56.097380+0000","last_active":"2023-11-04T01:42:56.588739+0000","last_peered":"2023-11-04T01:42:56.588739+0000","last_clean":"2023-11-04T01:42:56.588739+0000","last_became_active":"2023-11-04T01:42:56.097090+0000","last_became_peered":"2023-11-04T01:42:56.097090+0000","last_unstale":"2023-11-04T01:42:56.588739+0000","last_undegraded":"2023-11-04T01:42:56.588739+0000","last_fullsized":"2023-11-04T01:42:56.588739+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:15:37.889616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087863+0000","last_change":"2023-11-04T01:42:35.342778+0000","last_active":"2023-11-04T01:42:56.087863+0000","last_peered":"2023-11-04T01:42:56.087863+0000","last_clean":"2023-11-04T01:42:56.087863+0000","last_became_active":"2023-11-04T01:42:35.342368+0000","last_became_peered":"2023-11-04T01:42:35.342368+0000","last_unstale":"2023-11-04T01:42:56.087863+0000","last_undegraded":"2023-11-04T01:42:56.087863+0000","last_fullsized":"2023-11-04T01:42:56.087863+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:42.907508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.091370+0000","last_change":"2023-11-04T01:42:36.413379+0000","last_active":"2023-11-04T01:42:56.091370+0000","last_peered":"2023-11-04T01:42:56.091370+0000","last_clean":"2023-11-04T01:42:56.091370+0000","last_became_active":"2023-11-04T01:42:34.354671+0000","last_became_peered":"2023-11-04T01:42:34.354671+0000","last_unstale":"2023-11-04T01:42:56.091370+0000","last_undegraded":"2023-11-04T01:42:56.091370+0000","last_fullsized":"2023-11-04T01:42:56.091370+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:36:10.769073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071203900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087726+0000","last_change":"2023-11-04T01:41:35.728832+0000","last_active":"2023-11-04T01:42:56.087726+0000","last_peered":"2023-11-04T01:42:56.087726+0000","last_clean":"2023-11-04T01:42:56.087726+0000","last_became_active":"2023-11-04T01:41:34.733517+0000","last_became_peered":"2023-11-04T01:41:34.733517+0000","last_unstale":"2023-11-04T01:42:56.087726+0000","last_undegraded":"2023-11-04T01:42:56.087726+0000","last_fullsized":"2023-11-04T01:42:56.087726+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:19.350812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042545700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.606640+0000","last_change":"2023-11-04T01:42:56.600578+0000","last_active":"2023-11-04T01:42:56.606640+0000","last_peered":"2023-11-04T01:42:56.606640+0000","last_clean":"2023-11-04T01:42:56.606640+0000","last_became_active":"2023-11-04T01:42:56.599579+0000","last_became_peered":"2023-11-04T01:42:56.599579+0000","last_unstale":"2023-11-04T01:42:56.606640+0000","last_undegraded":"2023-11-04T01:42:56.606640+0000","last_fullsized":"2023-11-04T01:42:56.606640+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:55:13.050206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.585365+0000","last_change":"2023-11-04T01:42:56.104258+0000","last_active":"2023-11-04T01:42:56.585365+0000","last_peered":"2023-11-04T01:42:56.585365+0000","last_clean":"2023-11-04T01:42:56.585365+0000","last_became_active":"2023-11-04T01:42:56.104001+0000","last_became_peered":"2023-11-04T01:42:56.104001+0000","last_unstale":"2023-11-04T01:42:56.585365+0000","last_undegraded":"2023-11-04T01:42:56.585365+0000","last_fullsized":"2023-11-04T01:42:56.585365+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:36:21.655358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.090404+0000","last_change":"2023-11-04T01:42:35.348988+0000","last_active":"2023-11-04T01:42:56.090404+0000","last_peered":"2023-11-04T01:42:56.090404+0000","last_clean":"2023-11-04T01:42:56.090404+0000","last_became_active":"2023-11-04T01:42:35.348666+0000","last_became_peered":"2023-11-04T01:42:35.348666+0000","last_unstale":"2023-11-04T01:42:56.090404+0000","last_undegraded":"2023-11-04T01:42:56.090404+0000","last_fullsized":"2023-11-04T01:42:56.090404+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:08:28.888035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087551+0000","last_change":"2023-11-04T01:42:36.408544+0000","last_active":"2023-11-04T01:42:56.087551+0000","last_peered":"2023-11-04T01:42:56.087551+0000","last_clean":"2023-11-04T01:42:56.087551+0000","last_became_active":"2023-11-04T01:42:34.350627+0000","last_became_peered":"2023-11-04T01:42:34.350627+0000","last_unstale":"2023-11-04T01:42:56.087551+0000","last_undegraded":"2023-11-04T01:42:56.087551+0000","last_fullsized":"2023-11-04T01:42:56.087551+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:22:16.530179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059637199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.091673+0000","last_change":"2023-11-04T01:41:35.906660+0000","last_active":"2023-11-04T01:42:56.091673+0000","last_peered":"2023-11-04T01:42:56.091673+0000","last_clean":"2023-11-04T01:42:56.091673+0000","last_became_active":"2023-11-04T01:41:34.737209+0000","last_became_peered":"2023-11-04T01:41:34.737209+0000","last_unstale":"2023-11-04T01:42:56.091673+0000","last_undegraded":"2023-11-04T01:42:56.091673+0000","last_fullsized":"2023-11-04T01:42:56.091673+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:59.608410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068889500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.605356+0000","last_change":"2023-11-04T01:42:56.602906+0000","last_active":"2023-11-04T01:42:56.605356+0000","last_peered":"2023-11-04T01:42:56.605356+0000","last_clean":"2023-11-04T01:42:56.605356+0000","last_became_active":"2023-11-04T01:42:56.602639+0000","last_became_peered":"2023-11-04T01:42:56.602639+0000","last_unstale":"2023-11-04T01:42:56.605356+0000","last_undegraded":"2023-11-04T01:42:56.605356+0000","last_fullsized":"2023-11-04T01:42:56.605356+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:42:57.884333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.583893+0000","last_change":"2023-11-04T01:42:56.097961+0000","last_active":"2023-11-04T01:42:56.583893+0000","last_peered":"2023-11-04T01:42:56.583893+0000","last_clean":"2023-11-04T01:42:56.583893+0000","last_became_active":"2023-11-04T01:42:56.097674+0000","last_became_peered":"2023-11-04T01:42:56.097674+0000","last_unstale":"2023-11-04T01:42:56.583893+0000","last_undegraded":"2023-11-04T01:42:56.583893+0000","last_fullsized":"2023-11-04T01:42:56.583893+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:55.635351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.096333+0000","last_change":"2023-11-04T01:42:35.355495+0000","last_active":"2023-11-04T01:42:56.096333+0000","last_peered":"2023-11-04T01:42:56.096333+0000","last_clean":"2023-11-04T01:42:56.096333+0000","last_became_active":"2023-11-04T01:42:35.355032+0000","last_became_peered":"2023-11-04T01:42:35.355032+0000","last_unstale":"2023-11-04T01:42:56.096333+0000","last_undegraded":"2023-11-04T01:42:56.096333+0000","last_fullsized":"2023-11-04T01:42:56.096333+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:48.181161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.088370+0000","last_change":"2023-11-04T01:42:36.413121+0000","last_active":"2023-11-04T01:42:56.088370+0000","last_peered":"2023-11-04T01:42:56.088370+0000","last_clean":"2023-11-04T01:42:56.088370+0000","last_became_active":"2023-11-04T01:42:34.348018+0000","last_became_peered":"2023-11-04T01:42:34.348018+0000","last_unstale":"2023-11-04T01:42:56.088370+0000","last_undegraded":"2023-11-04T01:42:56.088370+0000","last_fullsized":"2023-11-04T01:42:56.088370+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:01:38.616017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088815699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.090893+0000","last_change":"2023-11-04T01:41:36.067946+0000","last_active":"2023-11-04T01:42:56.090893+0000","last_peered":"2023-11-04T01:42:56.090893+0000","last_clean":"2023-11-04T01:42:56.090893+0000","last_became_active":"2023-11-04T01:41:34.729591+0000","last_became_peered":"2023-11-04T01:41:34.729591+0000","last_unstale":"2023-11-04T01:42:56.090893+0000","last_undegraded":"2023-11-04T01:42:56.090893+0000","last_fullsized":"2023-11-04T01:42:56.090893+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:59.608410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032681099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.607358+0000","last_change":"2023-11-04T01:42:56.603951+0000","last_active":"2023-11-04T01:42:56.607358+0000","last_peered":"2023-11-04T01:42:56.607358+0000","last_clean":"2023-11-04T01:42:56.607358+0000","last_became_active":"2023-11-04T01:42:56.603707+0000","last_became_peered":"2023-11-04T01:42:56.603707+0000","last_unstale":"2023-11-04T01:42:56.607358+0000","last_undegraded":"2023-11-04T01:42:56.607358+0000","last_fullsized":"2023-11-04T01:42:56.607358+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:45:05.593291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"82'8","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:57.108627+0000","last_change":"2023-11-04T01:42:56.102773+0000","last_active":"2023-11-04T01:42:57.108627+0000","last_peered":"2023-11-04T01:42:57.108627+0000","last_clean":"2023-11-04T01:42:57.108627+0000","last_became_active":"2023-11-04T01:42:56.102535+0000","last_became_peered":"2023-11-04T01:42:56.102535+0000","last_unstale":"2023-11-04T01:42:57.108627+0000","last_undegraded":"2023-11-04T01:42:57.108627+0000","last_fullsized":"2023-11-04T01:42:57.108627+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:08:49.628793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087025+0000","last_change":"2023-11-04T01:42:35.345520+0000","last_active":"2023-11-04T01:42:56.087025+0000","last_peered":"2023-11-04T01:42:56.087025+0000","last_clean":"2023-11-04T01:42:56.087025+0000","last_became_active":"2023-11-04T01:42:35.345171+0000","last_became_peered":"2023-11-04T01:42:35.345171+0000","last_unstale":"2023-11-04T01:42:56.087025+0000","last_undegraded":"2023-11-04T01:42:56.087025+0000","last_fullsized":"2023-11-04T01:42:56.087025+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:09:48.559668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.086558+0000","last_change":"2023-11-04T01:42:36.408199+0000","last_active":"2023-11-04T01:42:56.086558+0000","last_peered":"2023-11-04T01:42:56.086558+0000","last_clean":"2023-11-04T01:42:56.086558+0000","last_became_active":"2023-11-04T01:42:34.346643+0000","last_became_peered":"2023-11-04T01:42:34.346643+0000","last_unstale":"2023-11-04T01:42:56.086558+0000","last_undegraded":"2023-11-04T01:42:56.086558+0000","last_fullsized":"2023-11-04T01:42:56.086558+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:16:15.635771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056985800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.088014+0000","last_change":"2023-11-04T01:41:35.905999+0000","last_active":"2023-11-04T01:42:56.088014+0000","last_peered":"2023-11-04T01:42:56.088014+0000","last_clean":"2023-11-04T01:42:56.088014+0000","last_became_active":"2023-11-04T01:41:34.735286+0000","last_became_peered":"2023-11-04T01:41:34.735286+0000","last_unstale":"2023-11-04T01:42:56.088014+0000","last_undegraded":"2023-11-04T01:42:56.088014+0000","last_fullsized":"2023-11-04T01:42:56.088014+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:14:22.019781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051880100000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.599829+0000","last_change":"2023-11-04T01:42:56.596070+0000","last_active":"2023-11-04T01:42:56.599829+0000","last_peered":"2023-11-04T01:42:56.599829+0000","last_clean":"2023-11-04T01:42:56.599829+0000","last_became_active":"2023-11-04T01:42:56.595784+0000","last_became_peered":"2023-11-04T01:42:56.595784+0000","last_unstale":"2023-11-04T01:42:56.599829+0000","last_undegraded":"2023-11-04T01:42:56.599829+0000","last_fullsized":"2023-11-04T01:42:56.599829+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:51:34.813734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.592414+0000","last_change":"2023-11-04T01:42:56.098826+0000","last_active":"2023-11-04T01:42:56.592414+0000","last_peered":"2023-11-04T01:42:56.592414+0000","last_clean":"2023-11-04T01:42:56.592414+0000","last_became_active":"2023-11-04T01:42:56.098568+0000","last_became_peered":"2023-11-04T01:42:56.098568+0000","last_unstale":"2023-11-04T01:42:56.592414+0000","last_undegraded":"2023-11-04T01:42:56.592414+0000","last_fullsized":"2023-11-04T01:42:56.592414+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:13:03.648267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087220+0000","last_change":"2023-11-04T01:42:35.347120+0000","last_active":"2023-11-04T01:42:56.087220+0000","last_peered":"2023-11-04T01:42:56.087220+0000","last_clean":"2023-11-04T01:42:56.087220+0000","last_became_active":"2023-11-04T01:42:35.346861+0000","last_became_peered":"2023-11-04T01:42:35.346861+0000","last_unstale":"2023-11-04T01:42:56.087220+0000","last_undegraded":"2023-11-04T01:42:56.087220+0000","last_fullsized":"2023-11-04T01:42:56.087220+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:51:31.538081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.090065+0000","last_change":"2023-11-04T01:42:36.409273+0000","last_active":"2023-11-04T01:42:56.090065+0000","last_peered":"2023-11-04T01:42:56.090065+0000","last_clean":"2023-11-04T01:42:56.090065+0000","last_became_active":"2023-11-04T01:42:34.349691+0000","last_became_peered":"2023-11-04T01:42:34.349691+0000","last_unstale":"2023-11-04T01:42:56.090065+0000","last_undegraded":"2023-11-04T01:42:56.090065+0000","last_fullsized":"2023-11-04T01:42:56.090065+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:04:04.521532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000397551,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.088339+0000","last_change":"2023-11-04T01:41:36.344205+0000","last_active":"2023-11-04T01:42:56.088339+0000","last_peered":"2023-11-04T01:42:56.088339+0000","last_clean":"2023-11-04T01:42:56.088339+0000","last_became_active":"2023-11-04T01:41:34.733205+0000","last_became_peered":"2023-11-04T01:41:34.733205+0000","last_unstale":"2023-11-04T01:42:56.088339+0000","last_undegraded":"2023-11-04T01:42:56.088339+0000","last_fullsized":"2023-11-04T01:42:56.088339+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:37.958719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011584760000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.607467+0000","last_change":"2023-11-04T01:42:56.600672+0000","last_active":"2023-11-04T01:42:56.607467+0000","last_peered":"2023-11-04T01:42:56.607467+0000","last_clean":"2023-11-04T01:42:56.607467+0000","last_became_active":"2023-11-04T01:42:56.600416+0000","last_became_peered":"2023-11-04T01:42:56.600416+0000","last_unstale":"2023-11-04T01:42:56.607467+0000","last_undegraded":"2023-11-04T01:42:56.607467+0000","last_fullsized":"2023-11-04T01:42:56.607467+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:51.340475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.593493+0000","last_change":"2023-11-04T01:42:56.098187+0000","last_active":"2023-11-04T01:42:56.593493+0000","last_peered":"2023-11-04T01:42:56.593493+0000","last_clean":"2023-11-04T01:42:56.593493+0000","last_became_active":"2023-11-04T01:42:56.097915+0000","last_became_peered":"2023-11-04T01:42:56.097915+0000","last_unstale":"2023-11-04T01:42:56.593493+0000","last_undegraded":"2023-11-04T01:42:56.593493+0000","last_fullsized":"2023-11-04T01:42:56.593493+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:40:59.393919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.088153+0000","last_change":"2023-11-04T01:42:35.355437+0000","last_active":"2023-11-04T01:42:56.088153+0000","last_peered":"2023-11-04T01:42:56.088153+0000","last_clean":"2023-11-04T01:42:56.088153+0000","last_became_active":"2023-11-04T01:42:35.355084+0000","last_became_peered":"2023-11-04T01:42:35.355084+0000","last_unstale":"2023-11-04T01:42:56.088153+0000","last_undegraded":"2023-11-04T01:42:56.088153+0000","last_fullsized":"2023-11-04T01:42:56.088153+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:39:42.671180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.088277+0000","last_change":"2023-11-04T01:42:36.341135+0000","last_active":"2023-11-04T01:42:56.088277+0000","last_peered":"2023-11-04T01:42:56.088277+0000","last_clean":"2023-11-04T01:42:56.088277+0000","last_became_active":"2023-11-04T01:42:34.344383+0000","last_became_peered":"2023-11-04T01:42:34.344383+0000","last_unstale":"2023-11-04T01:42:56.088277+0000","last_undegraded":"2023-11-04T01:42:56.088277+0000","last_fullsized":"2023-11-04T01:42:56.088277+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:31:27.915960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011027179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.092560+0000","last_change":"2023-11-04T01:41:36.343728+0000","last_active":"2023-11-04T01:42:56.092560+0000","last_peered":"2023-11-04T01:42:56.092560+0000","last_clean":"2023-11-04T01:42:56.092560+0000","last_became_active":"2023-11-04T01:41:34.731106+0000","last_became_peered":"2023-11-04T01:41:34.731106+0000","last_unstale":"2023-11-04T01:42:56.092560+0000","last_undegraded":"2023-11-04T01:42:56.092560+0000","last_fullsized":"2023-11-04T01:42:56.092560+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:29.730483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058974500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.594256+0000","last_change":"2023-11-04T01:42:56.588676+0000","last_active":"2023-11-04T01:42:56.594256+0000","last_peered":"2023-11-04T01:42:56.594256+0000","last_clean":"2023-11-04T01:42:56.594256+0000","last_became_active":"2023-11-04T01:42:56.588303+0000","last_became_peered":"2023-11-04T01:42:56.588303+0000","last_unstale":"2023-11-04T01:42:56.594256+0000","last_undegraded":"2023-11-04T01:42:56.594256+0000","last_fullsized":"2023-11-04T01:42:56.594256+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:43:47.542910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.595580+0000","last_change":"2023-11-04T01:42:56.097458+0000","last_active":"2023-11-04T01:42:56.595580+0000","last_peered":"2023-11-04T01:42:56.595580+0000","last_clean":"2023-11-04T01:42:56.595580+0000","last_became_active":"2023-11-04T01:42:56.097195+0000","last_became_peered":"2023-11-04T01:42:56.097195+0000","last_unstale":"2023-11-04T01:42:56.595580+0000","last_undegraded":"2023-11-04T01:42:56.595580+0000","last_fullsized":"2023-11-04T01:42:56.595580+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:45:28.267997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.089000+0000","last_change":"2023-11-04T01:42:35.349178+0000","last_active":"2023-11-04T01:42:56.089000+0000","last_peered":"2023-11-04T01:42:56.089000+0000","last_clean":"2023-11-04T01:42:56.089000+0000","last_became_active":"2023-11-04T01:42:35.348762+0000","last_became_peered":"2023-11-04T01:42:35.348762+0000","last_unstale":"2023-11-04T01:42:56.089000+0000","last_undegraded":"2023-11-04T01:42:56.089000+0000","last_fullsized":"2023-11-04T01:42:56.089000+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:50:43.272196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.089661+0000","last_change":"2023-11-04T01:42:36.408535+0000","last_active":"2023-11-04T01:42:56.089661+0000","last_peered":"2023-11-04T01:42:56.089661+0000","last_clean":"2023-11-04T01:42:56.089661+0000","last_became_active":"2023-11-04T01:42:34.351574+0000","last_became_peered":"2023-11-04T01:42:34.351574+0000","last_unstale":"2023-11-04T01:42:56.089661+0000","last_undegraded":"2023-11-04T01:42:56.089661+0000","last_fullsized":"2023-11-04T01:42:56.089661+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:28.593045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053030500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087926+0000","last_change":"2023-11-04T01:41:35.931778+0000","last_active":"2023-11-04T01:42:56.087926+0000","last_peered":"2023-11-04T01:42:56.087926+0000","last_clean":"2023-11-04T01:42:56.087926+0000","last_became_active":"2023-11-04T01:41:34.736897+0000","last_became_peered":"2023-11-04T01:41:34.736897+0000","last_unstale":"2023-11-04T01:42:56.087926+0000","last_undegraded":"2023-11-04T01:42:56.087926+0000","last_fullsized":"2023-11-04T01:42:56.087926+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:20.089706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071523300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.602426+0000","last_change":"2023-11-04T01:42:56.599306+0000","last_active":"2023-11-04T01:42:56.602426+0000","last_peered":"2023-11-04T01:42:56.602426+0000","last_clean":"2023-11-04T01:42:56.602426+0000","last_became_active":"2023-11-04T01:42:56.598964+0000","last_became_peered":"2023-11-04T01:42:56.598964+0000","last_unstale":"2023-11-04T01:42:56.602426+0000","last_undegraded":"2023-11-04T01:42:56.602426+0000","last_fullsized":"2023-11-04T01:42:56.602426+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:52.960905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.580184+0000","last_change":"2023-11-04T01:42:56.106207+0000","last_active":"2023-11-04T01:42:56.580184+0000","last_peered":"2023-11-04T01:42:56.580184+0000","last_clean":"2023-11-04T01:42:56.580184+0000","last_became_active":"2023-11-04T01:42:56.106035+0000","last_became_peered":"2023-11-04T01:42:56.106035+0000","last_unstale":"2023-11-04T01:42:56.580184+0000","last_undegraded":"2023-11-04T01:42:56.580184+0000","last_fullsized":"2023-11-04T01:42:56.580184+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:50:36.875678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.091597+0000","last_change":"2023-11-04T01:42:35.353394+0000","last_active":"2023-11-04T01:42:56.091597+0000","last_peered":"2023-11-04T01:42:56.091597+0000","last_clean":"2023-11-04T01:42:56.091597+0000","last_became_active":"2023-11-04T01:42:35.353098+0000","last_became_peered":"2023-11-04T01:42:35.353098+0000","last_unstale":"2023-11-04T01:42:56.091597+0000","last_undegraded":"2023-11-04T01:42:56.091597+0000","last_fullsized":"2023-11-04T01:42:56.091597+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:51:13.068224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.089308+0000","last_change":"2023-11-04T01:42:36.412911+0000","last_active":"2023-11-04T01:42:56.089308+0000","last_peered":"2023-11-04T01:42:56.089308+0000","last_clean":"2023-11-04T01:42:56.089308+0000","last_became_active":"2023-11-04T01:42:34.349620+0000","last_became_peered":"2023-11-04T01:42:34.349620+0000","last_unstale":"2023-11-04T01:42:56.089308+0000","last_undegraded":"2023-11-04T01:42:56.089308+0000","last_fullsized":"2023-11-04T01:42:56.089308+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:22:16.530179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041040599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087806+0000","last_change":"2023-11-04T01:41:35.729017+0000","last_active":"2023-11-04T01:42:56.087806+0000","last_peered":"2023-11-04T01:42:56.087806+0000","last_clean":"2023-11-04T01:42:56.087806+0000","last_became_active":"2023-11-04T01:41:34.730592+0000","last_became_peered":"2023-11-04T01:41:34.730592+0000","last_unstale":"2023-11-04T01:42:56.087806+0000","last_undegraded":"2023-11-04T01:42:56.087806+0000","last_fullsized":"2023-11-04T01:42:56.087806+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:08.858430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088820999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.607506+0000","last_change":"2023-11-04T01:42:56.601679+0000","last_active":"2023-11-04T01:42:56.607506+0000","last_peered":"2023-11-04T01:42:56.607506+0000","last_clean":"2023-11-04T01:42:56.607506+0000","last_became_active":"2023-11-04T01:42:56.601437+0000","last_became_peered":"2023-11-04T01:42:56.601437+0000","last_unstale":"2023-11-04T01:42:56.607506+0000","last_undegraded":"2023-11-04T01:42:56.607506+0000","last_fullsized":"2023-11-04T01:42:56.607506+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:22:39.277610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.580219+0000","last_change":"2023-11-04T01:42:56.104057+0000","last_active":"2023-11-04T01:42:56.580219+0000","last_peered":"2023-11-04T01:42:56.580219+0000","last_clean":"2023-11-04T01:42:56.580219+0000","last_became_active":"2023-11-04T01:42:56.103688+0000","last_became_peered":"2023-11-04T01:42:56.103688+0000","last_unstale":"2023-11-04T01:42:56.580219+0000","last_undegraded":"2023-11-04T01:42:56.580219+0000","last_fullsized":"2023-11-04T01:42:56.580219+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:52:32.087602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.089148+0000","last_change":"2023-11-04T01:42:35.355799+0000","last_active":"2023-11-04T01:42:56.089148+0000","last_peered":"2023-11-04T01:42:56.089148+0000","last_clean":"2023-11-04T01:42:56.089148+0000","last_became_active":"2023-11-04T01:42:35.355542+0000","last_became_peered":"2023-11-04T01:42:35.355542+0000","last_unstale":"2023-11-04T01:42:56.089148+0000","last_undegraded":"2023-11-04T01:42:56.089148+0000","last_fullsized":"2023-11-04T01:42:56.089148+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:10:24.565360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.091815+0000","last_change":"2023-11-04T01:42:36.413447+0000","last_active":"2023-11-04T01:42:56.091815+0000","last_peered":"2023-11-04T01:42:56.091815+0000","last_clean":"2023-11-04T01:42:56.091815+0000","last_became_active":"2023-11-04T01:42:34.351191+0000","last_became_peered":"2023-11-04T01:42:34.351191+0000","last_unstale":"2023-11-04T01:42:56.091815+0000","last_undegraded":"2023-11-04T01:42:56.091815+0000","last_fullsized":"2023-11-04T01:42:56.091815+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:32:10.544188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082047100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087346+0000","last_change":"2023-11-04T01:41:35.729378+0000","last_active":"2023-11-04T01:42:56.087346+0000","last_peered":"2023-11-04T01:42:56.087346+0000","last_clean":"2023-11-04T01:42:56.087346+0000","last_became_active":"2023-11-04T01:41:34.730387+0000","last_became_peered":"2023-11-04T01:41:34.730387+0000","last_unstale":"2023-11-04T01:42:56.087346+0000","last_undegraded":"2023-11-04T01:42:56.087346+0000","last_fullsized":"2023-11-04T01:42:56.087346+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:12.653602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072268699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.607593+0000","last_change":"2023-11-04T01:42:56.604213+0000","last_active":"2023-11-04T01:42:56.607593+0000","last_peered":"2023-11-04T01:42:56.607593+0000","last_clean":"2023-11-04T01:42:56.607593+0000","last_became_active":"2023-11-04T01:42:56.603937+0000","last_became_peered":"2023-11-04T01:42:56.603937+0000","last_unstale":"2023-11-04T01:42:56.607593+0000","last_undegraded":"2023-11-04T01:42:56.607593+0000","last_fullsized":"2023-11-04T01:42:56.607593+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:49:30.516581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.588370+0000","last_change":"2023-11-04T01:42:56.102778+0000","last_active":"2023-11-04T01:42:56.588370+0000","last_peered":"2023-11-04T01:42:56.588370+0000","last_clean":"2023-11-04T01:42:56.588370+0000","last_became_active":"2023-11-04T01:42:56.102559+0000","last_became_peered":"2023-11-04T01:42:56.102559+0000","last_unstale":"2023-11-04T01:42:56.588370+0000","last_undegraded":"2023-11-04T01:42:56.588370+0000","last_fullsized":"2023-11-04T01:42:56.588370+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:23:34.954279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087304+0000","last_change":"2023-11-04T01:42:35.352317+0000","last_active":"2023-11-04T01:42:56.087304+0000","last_peered":"2023-11-04T01:42:56.087304+0000","last_clean":"2023-11-04T01:42:56.087304+0000","last_became_active":"2023-11-04T01:42:35.351486+0000","last_became_peered":"2023-11-04T01:42:35.351486+0000","last_unstale":"2023-11-04T01:42:56.087304+0000","last_undegraded":"2023-11-04T01:42:56.087304+0000","last_fullsized":"2023-11-04T01:42:56.087304+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:33:20.111728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.096500+0000","last_change":"2023-11-04T01:42:36.342710+0000","last_active":"2023-11-04T01:42:56.096500+0000","last_peered":"2023-11-04T01:42:56.096500+0000","last_clean":"2023-11-04T01:42:56.096500+0000","last_became_active":"2023-11-04T01:42:34.349773+0000","last_became_peered":"2023-11-04T01:42:34.349773+0000","last_unstale":"2023-11-04T01:42:56.096500+0000","last_undegraded":"2023-11-04T01:42:56.096500+0000","last_fullsized":"2023-11-04T01:42:56.096500+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:55:22.976726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077362500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087997+0000","last_change":"2023-11-04T01:41:35.729318+0000","last_active":"2023-11-04T01:42:56.087997+0000","last_peered":"2023-11-04T01:42:56.087997+0000","last_clean":"2023-11-04T01:42:56.087997+0000","last_became_active":"2023-11-04T01:41:34.733796+0000","last_became_peered":"2023-11-04T01:41:34.733796+0000","last_unstale":"2023-11-04T01:42:56.087997+0000","last_undegraded":"2023-11-04T01:42:56.087997+0000","last_fullsized":"2023-11-04T01:42:56.087997+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:19.350812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053712200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.605368+0000","last_change":"2023-11-04T01:42:56.601449+0000","last_active":"2023-11-04T01:42:56.605368+0000","last_peered":"2023-11-04T01:42:56.605368+0000","last_clean":"2023-11-04T01:42:56.605368+0000","last_became_active":"2023-11-04T01:42:56.601184+0000","last_became_peered":"2023-11-04T01:42:56.601184+0000","last_unstale":"2023-11-04T01:42:56.605368+0000","last_undegraded":"2023-11-04T01:42:56.605368+0000","last_fullsized":"2023-11-04T01:42:56.605368+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:13.438469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.581600+0000","last_change":"2023-11-04T01:42:56.100703+0000","last_active":"2023-11-04T01:42:56.581600+0000","last_peered":"2023-11-04T01:42:56.581600+0000","last_clean":"2023-11-04T01:42:56.581600+0000","last_became_active":"2023-11-04T01:42:56.100470+0000","last_became_peered":"2023-11-04T01:42:56.100470+0000","last_unstale":"2023-11-04T01:42:56.581600+0000","last_undegraded":"2023-11-04T01:42:56.581600+0000","last_fullsized":"2023-11-04T01:42:56.581600+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:14:03.311455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.090282+0000","last_change":"2023-11-04T01:42:35.355335+0000","last_active":"2023-11-04T01:42:56.090282+0000","last_peered":"2023-11-04T01:42:56.090282+0000","last_clean":"2023-11-04T01:42:56.090282+0000","last_became_active":"2023-11-04T01:42:35.355057+0000","last_became_peered":"2023-11-04T01:42:35.355057+0000","last_unstale":"2023-11-04T01:42:56.090282+0000","last_undegraded":"2023-11-04T01:42:56.090282+0000","last_fullsized":"2023-11-04T01:42:56.090282+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:34:48.488293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.095546+0000","last_change":"2023-11-04T01:42:36.342412+0000","last_active":"2023-11-04T01:42:56.095546+0000","last_peered":"2023-11-04T01:42:56.095546+0000","last_clean":"2023-11-04T01:42:56.095546+0000","last_became_active":"2023-11-04T01:42:34.344325+0000","last_became_peered":"2023-11-04T01:42:34.344325+0000","last_unstale":"2023-11-04T01:42:56.095546+0000","last_undegraded":"2023-11-04T01:42:56.095546+0000","last_fullsized":"2023-11-04T01:42:56.095546+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:29:52.259787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010133010000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.089408+0000","last_change":"2023-11-04T01:41:35.931929+0000","last_active":"2023-11-04T01:42:56.089408+0000","last_peered":"2023-11-04T01:42:56.089408+0000","last_clean":"2023-11-04T01:42:56.089408+0000","last_became_active":"2023-11-04T01:41:34.738795+0000","last_became_peered":"2023-11-04T01:41:34.738795+0000","last_unstale":"2023-11-04T01:42:56.089408+0000","last_undegraded":"2023-11-04T01:42:56.089408+0000","last_fullsized":"2023-11-04T01:42:56.089408+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:59.608410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046204999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.600717+0000","last_change":"2023-11-04T01:42:56.596072+0000","last_active":"2023-11-04T01:42:56.600717+0000","last_peered":"2023-11-04T01:42:56.600717+0000","last_clean":"2023-11-04T01:42:56.600717+0000","last_became_active":"2023-11-04T01:42:56.595799+0000","last_became_peered":"2023-11-04T01:42:56.595799+0000","last_unstale":"2023-11-04T01:42:56.600717+0000","last_undegraded":"2023-11-04T01:42:56.600717+0000","last_fullsized":"2023-11-04T01:42:56.600717+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:48:39.629960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.582340+0000","last_change":"2023-11-04T01:42:56.102091+0000","last_active":"2023-11-04T01:42:56.582340+0000","last_peered":"2023-11-04T01:42:56.582340+0000","last_clean":"2023-11-04T01:42:56.582340+0000","last_became_active":"2023-11-04T01:42:56.101856+0000","last_became_peered":"2023-11-04T01:42:56.101856+0000","last_unstale":"2023-11-04T01:42:56.582340+0000","last_undegraded":"2023-11-04T01:42:56.582340+0000","last_fullsized":"2023-11-04T01:42:56.582340+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:14:03.210664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087748+0000","last_change":"2023-11-04T01:42:35.352853+0000","last_active":"2023-11-04T01:42:56.087748+0000","last_peered":"2023-11-04T01:42:56.087748+0000","last_clean":"2023-11-04T01:42:56.087748+0000","last_became_active":"2023-11-04T01:42:35.351314+0000","last_became_peered":"2023-11-04T01:42:35.351314+0000","last_unstale":"2023-11-04T01:42:56.087748+0000","last_undegraded":"2023-11-04T01:42:56.087748+0000","last_fullsized":"2023-11-04T01:42:56.087748+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:24:28.106438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087771+0000","last_change":"2023-11-04T01:42:36.411957+0000","last_active":"2023-11-04T01:42:56.087771+0000","last_peered":"2023-11-04T01:42:56.087771+0000","last_clean":"2023-11-04T01:42:56.087771+0000","last_became_active":"2023-11-04T01:42:34.348584+0000","last_became_peered":"2023-11-04T01:42:34.348584+0000","last_unstale":"2023-11-04T01:42:56.087771+0000","last_undegraded":"2023-11-04T01:42:56.087771+0000","last_fullsized":"2023-11-04T01:42:56.087771+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:30.702295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089633200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.086020+0000","last_change":"2023-11-04T01:41:35.728945+0000","last_active":"2023-11-04T01:42:56.086020+0000","last_peered":"2023-11-04T01:42:56.086020+0000","last_clean":"2023-11-04T01:42:56.086020+0000","last_became_active":"2023-11-04T01:41:34.735082+0000","last_became_peered":"2023-11-04T01:41:34.735082+0000","last_unstale":"2023-11-04T01:42:56.086020+0000","last_undegraded":"2023-11-04T01:42:56.086020+0000","last_fullsized":"2023-11-04T01:42:56.086020+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:16.970814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079093000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.594291+0000","last_change":"2023-11-04T01:42:56.589270+0000","last_active":"2023-11-04T01:42:56.594291+0000","last_peered":"2023-11-04T01:42:56.594291+0000","last_clean":"2023-11-04T01:42:56.594291+0000","last_became_active":"2023-11-04T01:42:56.588986+0000","last_became_peered":"2023-11-04T01:42:56.588986+0000","last_unstale":"2023-11-04T01:42:56.594291+0000","last_undegraded":"2023-11-04T01:42:56.594291+0000","last_fullsized":"2023-11-04T01:42:56.594291+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:32.718463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.598181+0000","last_change":"2023-11-04T01:42:56.100834+0000","last_active":"2023-11-04T01:42:56.598181+0000","last_peered":"2023-11-04T01:42:56.598181+0000","last_clean":"2023-11-04T01:42:56.598181+0000","last_became_active":"2023-11-04T01:42:56.100515+0000","last_became_peered":"2023-11-04T01:42:56.100515+0000","last_unstale":"2023-11-04T01:42:56.598181+0000","last_undegraded":"2023-11-04T01:42:56.598181+0000","last_fullsized":"2023-11-04T01:42:56.598181+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:49:29.511829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.090698+0000","last_change":"2023-11-04T01:42:35.349043+0000","last_active":"2023-11-04T01:42:56.090698+0000","last_peered":"2023-11-04T01:42:56.090698+0000","last_clean":"2023-11-04T01:42:56.090698+0000","last_became_active":"2023-11-04T01:42:35.348696+0000","last_became_peered":"2023-11-04T01:42:35.348696+0000","last_unstale":"2023-11-04T01:42:56.090698+0000","last_undegraded":"2023-11-04T01:42:56.090698+0000","last_fullsized":"2023-11-04T01:42:56.090698+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:21:03.655247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087847+0000","last_change":"2023-11-04T01:42:36.412004+0000","last_active":"2023-11-04T01:42:56.087847+0000","last_peered":"2023-11-04T01:42:56.087847+0000","last_clean":"2023-11-04T01:42:56.087847+0000","last_became_active":"2023-11-04T01:42:34.347931+0000","last_became_peered":"2023-11-04T01:42:34.347931+0000","last_unstale":"2023-11-04T01:42:56.087847+0000","last_undegraded":"2023-11-04T01:42:56.087847+0000","last_fullsized":"2023-11-04T01:42:56.087847+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:04.045465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092725399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.086264+0000","last_change":"2023-11-04T01:41:35.728625+0000","last_active":"2023-11-04T01:42:56.086264+0000","last_peered":"2023-11-04T01:42:56.086264+0000","last_clean":"2023-11-04T01:42:56.086264+0000","last_became_active":"2023-11-04T01:41:34.731514+0000","last_became_peered":"2023-11-04T01:41:34.731514+0000","last_unstale":"2023-11-04T01:42:56.086264+0000","last_undegraded":"2023-11-04T01:42:56.086264+0000","last_fullsized":"2023-11-04T01:42:56.086264+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:51:50.413223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047686400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.608711+0000","last_change":"2023-11-04T01:42:56.602931+0000","last_active":"2023-11-04T01:42:56.608711+0000","last_peered":"2023-11-04T01:42:56.608711+0000","last_clean":"2023-11-04T01:42:56.608711+0000","last_became_active":"2023-11-04T01:42:56.602655+0000","last_became_peered":"2023-11-04T01:42:56.602655+0000","last_unstale":"2023-11-04T01:42:56.608711+0000","last_undegraded":"2023-11-04T01:42:56.608711+0000","last_fullsized":"2023-11-04T01:42:56.608711+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:55:45.724157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.579864+0000","last_change":"2023-11-04T01:42:56.097551+0000","last_active":"2023-11-04T01:42:56.579864+0000","last_peered":"2023-11-04T01:42:56.579864+0000","last_clean":"2023-11-04T01:42:56.579864+0000","last_became_active":"2023-11-04T01:42:56.097293+0000","last_became_peered":"2023-11-04T01:42:56.097293+0000","last_unstale":"2023-11-04T01:42:56.579864+0000","last_undegraded":"2023-11-04T01:42:56.579864+0000","last_fullsized":"2023-11-04T01:42:56.579864+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:12:39.723115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.086494+0000","last_change":"2023-11-04T01:42:35.344216+0000","last_active":"2023-11-04T01:42:56.086494+0000","last_peered":"2023-11-04T01:42:56.086494+0000","last_clean":"2023-11-04T01:42:56.086494+0000","last_became_active":"2023-11-04T01:42:35.343986+0000","last_became_peered":"2023-11-04T01:42:35.343986+0000","last_unstale":"2023-11-04T01:42:56.086494+0000","last_undegraded":"2023-11-04T01:42:56.086494+0000","last_fullsized":"2023-11-04T01:42:56.086494+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:32.012283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.089074+0000","last_change":"2023-11-04T01:42:36.408418+0000","last_active":"2023-11-04T01:42:56.089074+0000","last_peered":"2023-11-04T01:42:56.089074+0000","last_clean":"2023-11-04T01:42:56.089074+0000","last_became_active":"2023-11-04T01:42:34.345245+0000","last_became_peered":"2023-11-04T01:42:34.345245+0000","last_unstale":"2023-11-04T01:42:56.089074+0000","last_undegraded":"2023-11-04T01:42:56.089074+0000","last_fullsized":"2023-11-04T01:42:56.089074+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:01:34.850682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042992099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.092626+0000","last_change":"2023-11-04T01:41:36.343762+0000","last_active":"2023-11-04T01:42:56.092626+0000","last_peered":"2023-11-04T01:42:56.092626+0000","last_clean":"2023-11-04T01:42:56.092626+0000","last_became_active":"2023-11-04T01:41:34.733406+0000","last_became_peered":"2023-11-04T01:41:34.733406+0000","last_unstale":"2023-11-04T01:42:56.092626+0000","last_undegraded":"2023-11-04T01:42:56.092626+0000","last_fullsized":"2023-11-04T01:42:56.092626+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:34:35.541159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058533399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.605012+0000","last_change":"2023-11-04T01:42:56.604268+0000","last_active":"2023-11-04T01:42:56.605012+0000","last_peered":"2023-11-04T01:42:56.605012+0000","last_clean":"2023-11-04T01:42:56.605012+0000","last_became_active":"2023-11-04T01:42:56.603996+0000","last_became_peered":"2023-11-04T01:42:56.603996+0000","last_unstale":"2023-11-04T01:42:56.605012+0000","last_undegraded":"2023-11-04T01:42:56.605012+0000","last_fullsized":"2023-11-04T01:42:56.605012+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:52.960905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"82'1","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:57.108564+0000","last_change":"2023-11-04T01:42:56.099980+0000","last_active":"2023-11-04T01:42:57.108564+0000","last_peered":"2023-11-04T01:42:57.108564+0000","last_clean":"2023-11-04T01:42:57.108564+0000","last_became_active":"2023-11-04T01:42:56.099700+0000","last_became_peered":"2023-11-04T01:42:56.099700+0000","last_unstale":"2023-11-04T01:42:57.108564+0000","last_undegraded":"2023-11-04T01:42:57.108564+0000","last_fullsized":"2023-11-04T01:42:57.108564+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:59.314998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.085599+0000","last_change":"2023-11-04T01:42:35.345703+0000","last_active":"2023-11-04T01:42:56.085599+0000","last_peered":"2023-11-04T01:42:56.085599+0000","last_clean":"2023-11-04T01:42:56.085599+0000","last_became_active":"2023-11-04T01:42:35.345089+0000","last_became_peered":"2023-11-04T01:42:35.345089+0000","last_unstale":"2023-11-04T01:42:56.085599+0000","last_undegraded":"2023-11-04T01:42:56.085599+0000","last_fullsized":"2023-11-04T01:42:56.085599+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:36:11.770993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.086944+0000","last_change":"2023-11-04T01:42:36.341220+0000","last_active":"2023-11-04T01:42:56.086944+0000","last_peered":"2023-11-04T01:42:56.086944+0000","last_clean":"2023-11-04T01:42:56.086944+0000","last_became_active":"2023-11-04T01:42:34.350834+0000","last_became_peered":"2023-11-04T01:42:34.350834+0000","last_unstale":"2023-11-04T01:42:56.086944+0000","last_undegraded":"2023-11-04T01:42:56.086944+0000","last_fullsized":"2023-11-04T01:42:56.086944+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:16:15.635771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011584519999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.088518+0000","last_change":"2023-11-04T01:41:35.906297+0000","last_active":"2023-11-04T01:42:56.088518+0000","last_peered":"2023-11-04T01:42:56.088518+0000","last_clean":"2023-11-04T01:42:56.088518+0000","last_became_active":"2023-11-04T01:41:34.734134+0000","last_became_peered":"2023-11-04T01:41:34.734134+0000","last_unstale":"2023-11-04T01:42:56.088518+0000","last_undegraded":"2023-11-04T01:42:56.088518+0000","last_fullsized":"2023-11-04T01:42:56.088518+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:52.597063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087104900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.607045+0000","last_change":"2023-11-04T01:42:56.602275+0000","last_active":"2023-11-04T01:42:56.607045+0000","last_peered":"2023-11-04T01:42:56.607045+0000","last_clean":"2023-11-04T01:42:56.607045+0000","last_became_active":"2023-11-04T01:42:56.601996+0000","last_became_peered":"2023-11-04T01:42:56.601996+0000","last_unstale":"2023-11-04T01:42:56.607045+0000","last_undegraded":"2023-11-04T01:42:56.607045+0000","last_fullsized":"2023-11-04T01:42:56.607045+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:09.926671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.599207+0000","last_change":"2023-11-04T01:42:56.095318+0000","last_active":"2023-11-04T01:42:56.599207+0000","last_peered":"2023-11-04T01:42:56.599207+0000","last_clean":"2023-11-04T01:42:56.599207+0000","last_became_active":"2023-11-04T01:42:56.094911+0000","last_became_peered":"2023-11-04T01:42:56.094911+0000","last_unstale":"2023-11-04T01:42:56.599207+0000","last_undegraded":"2023-11-04T01:42:56.599207+0000","last_fullsized":"2023-11-04T01:42:56.599207+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:36:00.695965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087372+0000","last_change":"2023-11-04T01:42:35.355771+0000","last_active":"2023-11-04T01:42:56.087372+0000","last_peered":"2023-11-04T01:42:56.087372+0000","last_clean":"2023-11-04T01:42:56.087372+0000","last_became_active":"2023-11-04T01:42:35.355459+0000","last_became_peered":"2023-11-04T01:42:35.355459+0000","last_unstale":"2023-11-04T01:42:56.087372+0000","last_undegraded":"2023-11-04T01:42:56.087372+0000","last_fullsized":"2023-11-04T01:42:56.087372+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:48:17.884449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.090778+0000","last_change":"2023-11-04T01:42:36.410175+0000","last_active":"2023-11-04T01:42:56.090778+0000","last_peered":"2023-11-04T01:42:56.090778+0000","last_clean":"2023-11-04T01:42:56.090778+0000","last_became_active":"2023-11-04T01:42:34.353093+0000","last_became_peered":"2023-11-04T01:42:34.353093+0000","last_unstale":"2023-11-04T01:42:56.090778+0000","last_undegraded":"2023-11-04T01:42:56.090778+0000","last_fullsized":"2023-11-04T01:42:56.090778+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:19:10.941730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000299241,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.088447+0000","last_change":"2023-11-04T01:41:35.906596+0000","last_active":"2023-11-04T01:42:56.088447+0000","last_peered":"2023-11-04T01:42:56.088447+0000","last_clean":"2023-11-04T01:42:56.088447+0000","last_became_active":"2023-11-04T01:41:34.738529+0000","last_became_peered":"2023-11-04T01:41:34.738529+0000","last_unstale":"2023-11-04T01:42:56.088447+0000","last_undegraded":"2023-11-04T01:42:56.088447+0000","last_fullsized":"2023-11-04T01:42:56.088447+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:48.121273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086660600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.607571+0000","last_change":"2023-11-04T01:42:56.602656+0000","last_active":"2023-11-04T01:42:56.607571+0000","last_peered":"2023-11-04T01:42:56.607571+0000","last_clean":"2023-11-04T01:42:56.607571+0000","last_became_active":"2023-11-04T01:42:56.602361+0000","last_became_peered":"2023-11-04T01:42:56.602361+0000","last_unstale":"2023-11-04T01:42:56.607571+0000","last_undegraded":"2023-11-04T01:42:56.607571+0000","last_fullsized":"2023-11-04T01:42:56.607571+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:35:10.233803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.580554+0000","last_change":"2023-11-04T01:42:56.100068+0000","last_active":"2023-11-04T01:42:56.580554+0000","last_peered":"2023-11-04T01:42:56.580554+0000","last_clean":"2023-11-04T01:42:56.580554+0000","last_became_active":"2023-11-04T01:42:56.099787+0000","last_became_peered":"2023-11-04T01:42:56.099787+0000","last_unstale":"2023-11-04T01:42:56.580554+0000","last_undegraded":"2023-11-04T01:42:56.580554+0000","last_fullsized":"2023-11-04T01:42:56.580554+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:42:50.726373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.089233+0000","last_change":"2023-11-04T01:42:35.352467+0000","last_active":"2023-11-04T01:42:56.089233+0000","last_peered":"2023-11-04T01:42:56.089233+0000","last_clean":"2023-11-04T01:42:56.089233+0000","last_became_active":"2023-11-04T01:42:35.352199+0000","last_became_peered":"2023-11-04T01:42:35.352199+0000","last_unstale":"2023-11-04T01:42:56.089233+0000","last_undegraded":"2023-11-04T01:42:56.089233+0000","last_fullsized":"2023-11-04T01:42:56.089233+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:34:48.488293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.090764+0000","last_change":"2023-11-04T01:42:36.410094+0000","last_active":"2023-11-04T01:42:56.090764+0000","last_peered":"2023-11-04T01:42:56.090764+0000","last_clean":"2023-11-04T01:42:56.090764+0000","last_became_active":"2023-11-04T01:42:34.346812+0000","last_became_peered":"2023-11-04T01:42:34.346812+0000","last_unstale":"2023-11-04T01:42:56.090764+0000","last_undegraded":"2023-11-04T01:42:56.090764+0000","last_fullsized":"2023-11-04T01:42:56.090764+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:47.456400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034280500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.091030+0000","last_change":"2023-11-04T01:41:35.906430+0000","last_active":"2023-11-04T01:42:56.091030+0000","last_peered":"2023-11-04T01:42:56.091030+0000","last_clean":"2023-11-04T01:42:56.091030+0000","last_became_active":"2023-11-04T01:41:34.741147+0000","last_became_peered":"2023-11-04T01:41:34.741147+0000","last_unstale":"2023-11-04T01:42:56.091030+0000","last_undegraded":"2023-11-04T01:42:56.091030+0000","last_fullsized":"2023-11-04T01:42:56.091030+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:20.089706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090504400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.607438+0000","last_change":"2023-11-04T01:42:56.600639+0000","last_active":"2023-11-04T01:42:56.607438+0000","last_peered":"2023-11-04T01:42:56.607438+0000","last_clean":"2023-11-04T01:42:56.607438+0000","last_became_active":"2023-11-04T01:42:56.600384+0000","last_became_peered":"2023-11-04T01:42:56.600384+0000","last_unstale":"2023-11-04T01:42:56.607438+0000","last_undegraded":"2023-11-04T01:42:56.607438+0000","last_fullsized":"2023-11-04T01:42:56.607438+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:10:46.310870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.581692+0000","last_change":"2023-11-04T01:42:56.103838+0000","last_active":"2023-11-04T01:42:56.581692+0000","last_peered":"2023-11-04T01:42:56.581692+0000","last_clean":"2023-11-04T01:42:56.581692+0000","last_became_active":"2023-11-04T01:42:56.103567+0000","last_became_peered":"2023-11-04T01:42:56.103567+0000","last_unstale":"2023-11-04T01:42:56.581692+0000","last_undegraded":"2023-11-04T01:42:56.581692+0000","last_fullsized":"2023-11-04T01:42:56.581692+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:23:36.762616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.092010+0000","last_change":"2023-11-04T01:42:35.348600+0000","last_active":"2023-11-04T01:42:56.092010+0000","last_peered":"2023-11-04T01:42:56.092010+0000","last_clean":"2023-11-04T01:42:56.092010+0000","last_became_active":"2023-11-04T01:42:35.348315+0000","last_became_peered":"2023-11-04T01:42:35.348315+0000","last_unstale":"2023-11-04T01:42:56.092010+0000","last_undegraded":"2023-11-04T01:42:56.092010+0000","last_fullsized":"2023-11-04T01:42:56.092010+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:13:42.469906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.090368+0000","last_change":"2023-11-04T01:42:36.411537+0000","last_active":"2023-11-04T01:42:56.090368+0000","last_peered":"2023-11-04T01:42:56.090368+0000","last_clean":"2023-11-04T01:42:56.090368+0000","last_became_active":"2023-11-04T01:42:34.354741+0000","last_became_peered":"2023-11-04T01:42:34.354741+0000","last_unstale":"2023-11-04T01:42:56.090368+0000","last_undegraded":"2023-11-04T01:42:56.090368+0000","last_fullsized":"2023-11-04T01:42:56.090368+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:22:16.530179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000668952,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087462+0000","last_change":"2023-11-04T01:41:36.344408+0000","last_active":"2023-11-04T01:42:56.087462+0000","last_peered":"2023-11-04T01:42:56.087462+0000","last_clean":"2023-11-04T01:42:56.087462+0000","last_became_active":"2023-11-04T01:41:34.730735+0000","last_became_peered":"2023-11-04T01:41:34.730735+0000","last_unstale":"2023-11-04T01:42:56.087462+0000","last_undegraded":"2023-11-04T01:42:56.087462+0000","last_fullsized":"2023-11-04T01:42:56.087462+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:10:58.095232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081464299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.593470+0000","last_change":"2023-11-04T01:42:56.591223+0000","last_active":"2023-11-04T01:42:56.593470+0000","last_peered":"2023-11-04T01:42:56.593470+0000","last_clean":"2023-11-04T01:42:56.593470+0000","last_became_active":"2023-11-04T01:42:56.590951+0000","last_became_peered":"2023-11-04T01:42:56.590951+0000","last_unstale":"2023-11-04T01:42:56.593470+0000","last_undegraded":"2023-11-04T01:42:56.593470+0000","last_fullsized":"2023-11-04T01:42:56.593470+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:12:35.058599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"82'2","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:57.106291+0000","last_change":"2023-11-04T01:42:56.097788+0000","last_active":"2023-11-04T01:42:57.106291+0000","last_peered":"2023-11-04T01:42:57.106291+0000","last_clean":"2023-11-04T01:42:57.106291+0000","last_became_active":"2023-11-04T01:42:56.097528+0000","last_became_peered":"2023-11-04T01:42:56.097528+0000","last_unstale":"2023-11-04T01:42:57.106291+0000","last_undegraded":"2023-11-04T01:42:57.106291+0000","last_fullsized":"2023-11-04T01:42:57.106291+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:16:37.378449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.090453+0000","last_change":"2023-11-04T01:42:35.353952+0000","last_active":"2023-11-04T01:42:56.090453+0000","last_peered":"2023-11-04T01:42:56.090453+0000","last_clean":"2023-11-04T01:42:56.090453+0000","last_became_active":"2023-11-04T01:42:35.353703+0000","last_became_peered":"2023-11-04T01:42:35.353703+0000","last_unstale":"2023-11-04T01:42:56.090453+0000","last_undegraded":"2023-11-04T01:42:56.090453+0000","last_fullsized":"2023-11-04T01:42:56.090453+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:29.594965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.088294+0000","last_change":"2023-11-04T01:42:36.412751+0000","last_active":"2023-11-04T01:42:56.088294+0000","last_peered":"2023-11-04T01:42:56.088294+0000","last_clean":"2023-11-04T01:42:56.088294+0000","last_became_active":"2023-11-04T01:42:34.350389+0000","last_became_peered":"2023-11-04T01:42:34.350389+0000","last_unstale":"2023-11-04T01:42:56.088294+0000","last_undegraded":"2023-11-04T01:42:56.088294+0000","last_fullsized":"2023-11-04T01:42:56.088294+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:33.892673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057436599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.088869+0000","last_change":"2023-11-04T01:41:36.244245+0000","last_active":"2023-11-04T01:42:56.088869+0000","last_peered":"2023-11-04T01:42:56.088869+0000","last_clean":"2023-11-04T01:42:56.088869+0000","last_became_active":"2023-11-04T01:41:34.734925+0000","last_became_peered":"2023-11-04T01:41:34.734925+0000","last_unstale":"2023-11-04T01:42:56.088869+0000","last_undegraded":"2023-11-04T01:42:56.088869+0000","last_fullsized":"2023-11-04T01:42:56.088869+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:44.193748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025350200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.605012+0000","last_change":"2023-11-04T01:42:56.600764+0000","last_active":"2023-11-04T01:42:56.605012+0000","last_peered":"2023-11-04T01:42:56.605012+0000","last_clean":"2023-11-04T01:42:56.605012+0000","last_became_active":"2023-11-04T01:42:56.600498+0000","last_became_peered":"2023-11-04T01:42:56.600498+0000","last_unstale":"2023-11-04T01:42:56.605012+0000","last_undegraded":"2023-11-04T01:42:56.605012+0000","last_fullsized":"2023-11-04T01:42:56.605012+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:51:53.283591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.592948+0000","last_change":"2023-11-04T01:42:56.099653+0000","last_active":"2023-11-04T01:42:56.592948+0000","last_peered":"2023-11-04T01:42:56.592948+0000","last_clean":"2023-11-04T01:42:56.592948+0000","last_became_active":"2023-11-04T01:42:56.099388+0000","last_became_peered":"2023-11-04T01:42:56.099388+0000","last_unstale":"2023-11-04T01:42:56.592948+0000","last_undegraded":"2023-11-04T01:42:56.592948+0000","last_fullsized":"2023-11-04T01:42:56.592948+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:45:14.589199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.092368+0000","last_change":"2023-11-04T01:42:35.347267+0000","last_active":"2023-11-04T01:42:56.092368+0000","last_peered":"2023-11-04T01:42:56.092368+0000","last_clean":"2023-11-04T01:42:56.092368+0000","last_became_active":"2023-11-04T01:42:35.347025+0000","last_became_peered":"2023-11-04T01:42:35.347025+0000","last_unstale":"2023-11-04T01:42:56.092368+0000","last_undegraded":"2023-11-04T01:42:56.092368+0000","last_fullsized":"2023-11-04T01:42:56.092368+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:43.681647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087850+0000","last_change":"2023-11-04T01:42:36.412195+0000","last_active":"2023-11-04T01:42:56.087850+0000","last_peered":"2023-11-04T01:42:56.087850+0000","last_clean":"2023-11-04T01:42:56.087850+0000","last_became_active":"2023-11-04T01:42:34.348235+0000","last_became_peered":"2023-11-04T01:42:34.348235+0000","last_unstale":"2023-11-04T01:42:56.087850+0000","last_undegraded":"2023-11-04T01:42:56.087850+0000","last_fullsized":"2023-11-04T01:42:56.087850+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:41:39.504471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095507199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087030+0000","last_change":"2023-11-04T01:41:36.343956+0000","last_active":"2023-11-04T01:42:56.087030+0000","last_peered":"2023-11-04T01:42:56.087030+0000","last_clean":"2023-11-04T01:42:56.087030+0000","last_became_active":"2023-11-04T01:41:34.736013+0000","last_became_peered":"2023-11-04T01:41:34.736013+0000","last_unstale":"2023-11-04T01:42:56.087030+0000","last_undegraded":"2023-11-04T01:42:56.087030+0000","last_fullsized":"2023-11-04T01:42:56.087030+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:08.858430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081427799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.605213+0000","last_change":"2023-11-04T01:42:56.600532+0000","last_active":"2023-11-04T01:42:56.605213+0000","last_peered":"2023-11-04T01:42:56.605213+0000","last_clean":"2023-11-04T01:42:56.605213+0000","last_became_active":"2023-11-04T01:42:56.600277+0000","last_became_peered":"2023-11-04T01:42:56.600277+0000","last_unstale":"2023-11-04T01:42:56.605213+0000","last_undegraded":"2023-11-04T01:42:56.605213+0000","last_fullsized":"2023-11-04T01:42:56.605213+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:00:56.782905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.584410+0000","last_change":"2023-11-04T01:42:56.096547+0000","last_active":"2023-11-04T01:42:56.584410+0000","last_peered":"2023-11-04T01:42:56.584410+0000","last_clean":"2023-11-04T01:42:56.584410+0000","last_became_active":"2023-11-04T01:42:56.096307+0000","last_became_peered":"2023-11-04T01:42:56.096307+0000","last_unstale":"2023-11-04T01:42:56.584410+0000","last_undegraded":"2023-11-04T01:42:56.584410+0000","last_fullsized":"2023-11-04T01:42:56.584410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:36:00.695965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.088625+0000","last_change":"2023-11-04T01:42:35.354870+0000","last_active":"2023-11-04T01:42:56.088625+0000","last_peered":"2023-11-04T01:42:56.088625+0000","last_clean":"2023-11-04T01:42:56.088625+0000","last_became_active":"2023-11-04T01:42:35.354442+0000","last_became_peered":"2023-11-04T01:42:35.354442+0000","last_unstale":"2023-11-04T01:42:56.088625+0000","last_undegraded":"2023-11-04T01:42:56.088625+0000","last_fullsized":"2023-11-04T01:42:56.088625+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:08:28.888035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.092488+0000","last_change":"2023-11-04T01:42:36.342222+0000","last_active":"2023-11-04T01:42:56.092488+0000","last_peered":"2023-11-04T01:42:56.092488+0000","last_clean":"2023-11-04T01:42:56.092488+0000","last_became_active":"2023-11-04T01:42:34.347183+0000","last_became_peered":"2023-11-04T01:42:34.347183+0000","last_unstale":"2023-11-04T01:42:56.092488+0000","last_undegraded":"2023-11-04T01:42:56.092488+0000","last_fullsized":"2023-11-04T01:42:56.092488+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:52:53.403289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001441877,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.086525+0000","last_change":"2023-11-04T01:41:36.243977+0000","last_active":"2023-11-04T01:42:56.086525+0000","last_peered":"2023-11-04T01:42:56.086525+0000","last_clean":"2023-11-04T01:42:56.086525+0000","last_became_active":"2023-11-04T01:41:34.733127+0000","last_became_peered":"2023-11-04T01:41:34.733127+0000","last_unstale":"2023-11-04T01:42:56.086525+0000","last_undegraded":"2023-11-04T01:42:56.086525+0000","last_fullsized":"2023-11-04T01:42:56.086525+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:36.118907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051788300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.608841+0000","last_change":"2023-11-04T01:42:56.603179+0000","last_active":"2023-11-04T01:42:56.608841+0000","last_peered":"2023-11-04T01:42:56.608841+0000","last_clean":"2023-11-04T01:42:56.608841+0000","last_became_active":"2023-11-04T01:42:56.602890+0000","last_became_peered":"2023-11-04T01:42:56.602890+0000","last_unstale":"2023-11-04T01:42:56.608841+0000","last_undegraded":"2023-11-04T01:42:56.608841+0000","last_fullsized":"2023-11-04T01:42:56.608841+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:15:05.427157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.594961+0000","last_change":"2023-11-04T01:42:56.100191+0000","last_active":"2023-11-04T01:42:56.594961+0000","last_peered":"2023-11-04T01:42:56.594961+0000","last_clean":"2023-11-04T01:42:56.594961+0000","last_became_active":"2023-11-04T01:42:56.099892+0000","last_became_peered":"2023-11-04T01:42:56.099892+0000","last_unstale":"2023-11-04T01:42:56.594961+0000","last_undegraded":"2023-11-04T01:42:56.594961+0000","last_fullsized":"2023-11-04T01:42:56.594961+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:30:14.002465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087728+0000","last_change":"2023-11-04T01:42:35.354884+0000","last_active":"2023-11-04T01:42:56.087728+0000","last_peered":"2023-11-04T01:42:56.087728+0000","last_clean":"2023-11-04T01:42:56.087728+0000","last_became_active":"2023-11-04T01:42:35.354616+0000","last_became_peered":"2023-11-04T01:42:35.354616+0000","last_unstale":"2023-11-04T01:42:56.087728+0000","last_undegraded":"2023-11-04T01:42:56.087728+0000","last_fullsized":"2023-11-04T01:42:56.087728+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:41:40.506391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087496+0000","last_change":"2023-11-04T01:42:36.411716+0000","last_active":"2023-11-04T01:42:56.087496+0000","last_peered":"2023-11-04T01:42:56.087496+0000","last_clean":"2023-11-04T01:42:56.087496+0000","last_became_active":"2023-11-04T01:42:34.350215+0000","last_became_peered":"2023-11-04T01:42:34.350215+0000","last_unstale":"2023-11-04T01:42:56.087496+0000","last_undegraded":"2023-11-04T01:42:56.087496+0000","last_fullsized":"2023-11-04T01:42:56.087496+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:20:02.805323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076372199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.090143+0000","last_change":"2023-11-04T01:41:36.067797+0000","last_active":"2023-11-04T01:42:56.090143+0000","last_peered":"2023-11-04T01:42:56.090143+0000","last_clean":"2023-11-04T01:42:56.090143+0000","last_became_active":"2023-11-04T01:41:34.734880+0000","last_became_peered":"2023-11-04T01:41:34.734880+0000","last_unstale":"2023-11-04T01:42:56.090143+0000","last_undegraded":"2023-11-04T01:42:56.090143+0000","last_fullsized":"2023-11-04T01:42:56.090143+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:20.089706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036003499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.607418+0000","last_change":"2023-11-04T01:42:56.604105+0000","last_active":"2023-11-04T01:42:56.607418+0000","last_peered":"2023-11-04T01:42:56.607418+0000","last_clean":"2023-11-04T01:42:56.607418+0000","last_became_active":"2023-11-04T01:42:56.603823+0000","last_became_peered":"2023-11-04T01:42:56.603823+0000","last_unstale":"2023-11-04T01:42:56.607418+0000","last_undegraded":"2023-11-04T01:42:56.607418+0000","last_fullsized":"2023-11-04T01:42:56.607418+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:38:31.776800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.579852+0000","last_change":"2023-11-04T01:42:56.103359+0000","last_active":"2023-11-04T01:42:56.579852+0000","last_peered":"2023-11-04T01:42:56.579852+0000","last_clean":"2023-11-04T01:42:56.579852+0000","last_became_active":"2023-11-04T01:42:56.103084+0000","last_became_peered":"2023-11-04T01:42:56.103084+0000","last_unstale":"2023-11-04T01:42:56.579852+0000","last_undegraded":"2023-11-04T01:42:56.579852+0000","last_fullsized":"2023-11-04T01:42:56.579852+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:11:25.528784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.085707+0000","last_change":"2023-11-04T01:42:35.345946+0000","last_active":"2023-11-04T01:42:56.085707+0000","last_peered":"2023-11-04T01:42:56.085707+0000","last_clean":"2023-11-04T01:42:56.085707+0000","last_became_active":"2023-11-04T01:42:35.345033+0000","last_became_peered":"2023-11-04T01:42:35.345033+0000","last_unstale":"2023-11-04T01:42:56.085707+0000","last_undegraded":"2023-11-04T01:42:56.085707+0000","last_fullsized":"2023-11-04T01:42:56.085707+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:32:11.546107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087807+0000","last_change":"2023-11-04T01:42:36.410760+0000","last_active":"2023-11-04T01:42:56.087807+0000","last_peered":"2023-11-04T01:42:56.087807+0000","last_clean":"2023-11-04T01:42:56.087807+0000","last_became_active":"2023-11-04T01:42:34.349633+0000","last_became_peered":"2023-11-04T01:42:34.349633+0000","last_unstale":"2023-11-04T01:42:56.087807+0000","last_undegraded":"2023-11-04T01:42:56.087807+0000","last_fullsized":"2023-11-04T01:42:56.087807+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:08:27.886115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066417699999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.086730+0000","last_change":"2023-11-04T01:41:35.729089+0000","last_active":"2023-11-04T01:42:56.086730+0000","last_peered":"2023-11-04T01:42:56.086730+0000","last_clean":"2023-11-04T01:42:56.086730+0000","last_became_active":"2023-11-04T01:41:34.731063+0000","last_became_peered":"2023-11-04T01:41:34.731063+0000","last_unstale":"2023-11-04T01:42:56.086730+0000","last_undegraded":"2023-11-04T01:42:56.086730+0000","last_fullsized":"2023-11-04T01:42:56.086730+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:38:46.633175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083653600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.604579+0000","last_change":"2023-11-04T01:42:56.601056+0000","last_active":"2023-11-04T01:42:56.604579+0000","last_peered":"2023-11-04T01:42:56.604579+0000","last_clean":"2023-11-04T01:42:56.604579+0000","last_became_active":"2023-11-04T01:42:56.600446+0000","last_became_peered":"2023-11-04T01:42:56.600446+0000","last_unstale":"2023-11-04T01:42:56.604579+0000","last_undegraded":"2023-11-04T01:42:56.604579+0000","last_fullsized":"2023-11-04T01:42:56.604579+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:36:01.700717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.580229+0000","last_change":"2023-11-04T01:42:56.103019+0000","last_active":"2023-11-04T01:42:56.580229+0000","last_peered":"2023-11-04T01:42:56.580229+0000","last_clean":"2023-11-04T01:42:56.580229+0000","last_became_active":"2023-11-04T01:42:56.102742+0000","last_became_peered":"2023-11-04T01:42:56.102742+0000","last_unstale":"2023-11-04T01:42:56.580229+0000","last_undegraded":"2023-11-04T01:42:56.580229+0000","last_fullsized":"2023-11-04T01:42:56.580229+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:30:07.231420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.091523+0000","last_change":"2023-11-04T01:42:35.357455+0000","last_active":"2023-11-04T01:42:56.091523+0000","last_peered":"2023-11-04T01:42:56.091523+0000","last_clean":"2023-11-04T01:42:56.091523+0000","last_became_active":"2023-11-04T01:42:35.357198+0000","last_became_peered":"2023-11-04T01:42:35.357198+0000","last_unstale":"2023-11-04T01:42:56.091523+0000","last_undegraded":"2023-11-04T01:42:56.091523+0000","last_fullsized":"2023-11-04T01:42:56.091523+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:33:20.111728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.088892+0000","last_change":"2023-11-04T01:42:36.342203+0000","last_active":"2023-11-04T01:42:56.088892+0000","last_peered":"2023-11-04T01:42:56.088892+0000","last_clean":"2023-11-04T01:42:56.088892+0000","last_became_active":"2023-11-04T01:42:34.351883+0000","last_became_peered":"2023-11-04T01:42:34.351883+0000","last_unstale":"2023-11-04T01:42:56.088892+0000","last_undegraded":"2023-11-04T01:42:56.088892+0000","last_fullsized":"2023-11-04T01:42:56.088892+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:41.905588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016503290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087931+0000","last_change":"2023-11-04T01:41:35.729232+0000","last_active":"2023-11-04T01:42:56.087931+0000","last_peered":"2023-11-04T01:42:56.087931+0000","last_clean":"2023-11-04T01:42:56.087931+0000","last_became_active":"2023-11-04T01:41:34.731490+0000","last_became_peered":"2023-11-04T01:41:34.731490+0000","last_unstale":"2023-11-04T01:42:56.087931+0000","last_undegraded":"2023-11-04T01:42:56.087931+0000","last_fullsized":"2023-11-04T01:42:56.087931+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:37.958719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089653699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.606988+0000","last_change":"2023-11-04T01:42:56.605845+0000","last_active":"2023-11-04T01:42:56.606988+0000","last_peered":"2023-11-04T01:42:56.606988+0000","last_clean":"2023-11-04T01:42:56.606988+0000","last_became_active":"2023-11-04T01:42:56.605549+0000","last_became_peered":"2023-11-04T01:42:56.605549+0000","last_unstale":"2023-11-04T01:42:56.606988+0000","last_undegraded":"2023-11-04T01:42:56.606988+0000","last_fullsized":"2023-11-04T01:42:56.606988+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:55:13.050206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.595771+0000","last_change":"2023-11-04T01:42:56.098429+0000","last_active":"2023-11-04T01:42:56.595771+0000","last_peered":"2023-11-04T01:42:56.595771+0000","last_clean":"2023-11-04T01:42:56.595771+0000","last_became_active":"2023-11-04T01:42:56.098126+0000","last_became_peered":"2023-11-04T01:42:56.098126+0000","last_unstale":"2023-11-04T01:42:56.595771+0000","last_undegraded":"2023-11-04T01:42:56.595771+0000","last_fullsized":"2023-11-04T01:42:56.595771+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:12:38.398717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.086820+0000","last_change":"2023-11-04T01:42:35.353012+0000","last_active":"2023-11-04T01:42:56.086820+0000","last_peered":"2023-11-04T01:42:56.086820+0000","last_clean":"2023-11-04T01:42:56.086820+0000","last_became_active":"2023-11-04T01:42:35.352268+0000","last_became_peered":"2023-11-04T01:42:35.352268+0000","last_unstale":"2023-11-04T01:42:56.086820+0000","last_undegraded":"2023-11-04T01:42:56.086820+0000","last_fullsized":"2023-11-04T01:42:56.086820+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:51:13.068224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.091444+0000","last_change":"2023-11-04T01:42:36.413549+0000","last_active":"2023-11-04T01:42:56.091444+0000","last_peered":"2023-11-04T01:42:56.091444+0000","last_clean":"2023-11-04T01:42:56.091444+0000","last_became_active":"2023-11-04T01:42:34.355467+0000","last_became_peered":"2023-11-04T01:42:34.355467+0000","last_unstale":"2023-11-04T01:42:56.091444+0000","last_undegraded":"2023-11-04T01:42:56.091444+0000","last_fullsized":"2023-11-04T01:42:56.091444+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:09:47.557748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071579,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.096569+0000","last_change":"2023-11-04T01:41:36.344018+0000","last_active":"2023-11-04T01:42:56.096569+0000","last_peered":"2023-11-04T01:42:56.096569+0000","last_clean":"2023-11-04T01:42:56.096569+0000","last_became_active":"2023-11-04T01:41:34.734178+0000","last_became_peered":"2023-11-04T01:41:34.734178+0000","last_unstale":"2023-11-04T01:42:56.096569+0000","last_undegraded":"2023-11-04T01:42:56.096569+0000","last_fullsized":"2023-11-04T01:42:56.096569+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:16.970814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077338299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.608977+0000","last_change":"2023-11-04T01:42:56.604931+0000","last_active":"2023-11-04T01:42:56.608977+0000","last_peered":"2023-11-04T01:42:56.608977+0000","last_clean":"2023-11-04T01:42:56.608977+0000","last_became_active":"2023-11-04T01:42:56.603782+0000","last_became_peered":"2023-11-04T01:42:56.603782+0000","last_unstale":"2023-11-04T01:42:56.608977+0000","last_undegraded":"2023-11-04T01:42:56.608977+0000","last_fullsized":"2023-11-04T01:42:56.608977+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:16:32.718463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.592682+0000","last_change":"2023-11-04T01:42:56.098611+0000","last_active":"2023-11-04T01:42:56.592682+0000","last_peered":"2023-11-04T01:42:56.592682+0000","last_clean":"2023-11-04T01:42:56.592682+0000","last_became_active":"2023-11-04T01:42:56.098345+0000","last_became_peered":"2023-11-04T01:42:56.098345+0000","last_unstale":"2023-11-04T01:42:56.592682+0000","last_undegraded":"2023-11-04T01:42:56.592682+0000","last_fullsized":"2023-11-04T01:42:56.592682+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:53:15.145967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.090479+0000","last_change":"2023-11-04T01:42:35.351651+0000","last_active":"2023-11-04T01:42:56.090479+0000","last_peered":"2023-11-04T01:42:56.090479+0000","last_clean":"2023-11-04T01:42:56.090479+0000","last_became_active":"2023-11-04T01:42:35.351384+0000","last_became_peered":"2023-11-04T01:42:35.351384+0000","last_unstale":"2023-11-04T01:42:56.090479+0000","last_undegraded":"2023-11-04T01:42:56.090479+0000","last_fullsized":"2023-11-04T01:42:56.090479+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:16.391588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.096418+0000","last_change":"2023-11-04T01:42:36.342476+0000","last_active":"2023-11-04T01:42:56.096418+0000","last_peered":"2023-11-04T01:42:56.096418+0000","last_clean":"2023-11-04T01:42:56.096418+0000","last_became_active":"2023-11-04T01:42:34.350295+0000","last_became_peered":"2023-11-04T01:42:34.350295+0000","last_unstale":"2023-11-04T01:42:56.096418+0000","last_undegraded":"2023-11-04T01:42:56.096418+0000","last_fullsized":"2023-11-04T01:42:56.096418+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:30:27.909910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000695332,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.091748+0000","last_change":"2023-11-04T01:41:35.906788+0000","last_active":"2023-11-04T01:42:56.091748+0000","last_peered":"2023-11-04T01:42:56.091748+0000","last_clean":"2023-11-04T01:42:56.091748+0000","last_became_active":"2023-11-04T01:41:34.734386+0000","last_became_peered":"2023-11-04T01:41:34.734386+0000","last_unstale":"2023-11-04T01:42:56.091748+0000","last_undegraded":"2023-11-04T01:42:56.091748+0000","last_fullsized":"2023-11-04T01:42:56.091748+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:23:23.733128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060435600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.609004+0000","last_change":"2023-11-04T01:42:56.605869+0000","last_active":"2023-11-04T01:42:56.609004+0000","last_peered":"2023-11-04T01:42:56.609004+0000","last_clean":"2023-11-04T01:42:56.609004+0000","last_became_active":"2023-11-04T01:42:56.605556+0000","last_became_peered":"2023-11-04T01:42:56.605556+0000","last_unstale":"2023-11-04T01:42:56.609004+0000","last_undegraded":"2023-11-04T01:42:56.609004+0000","last_fullsized":"2023-11-04T01:42:56.609004+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:30:50.657341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.579692+0000","last_change":"2023-11-04T01:42:56.100307+0000","last_active":"2023-11-04T01:42:56.579692+0000","last_peered":"2023-11-04T01:42:56.579692+0000","last_clean":"2023-11-04T01:42:56.579692+0000","last_became_active":"2023-11-04T01:42:56.100028+0000","last_became_peered":"2023-11-04T01:42:56.100028+0000","last_unstale":"2023-11-04T01:42:56.579692+0000","last_undegraded":"2023-11-04T01:42:56.579692+0000","last_fullsized":"2023-11-04T01:42:56.579692+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:23:45.135720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.089000+0000","last_change":"2023-11-04T01:42:35.354173+0000","last_active":"2023-11-04T01:42:56.089000+0000","last_peered":"2023-11-04T01:42:56.089000+0000","last_clean":"2023-11-04T01:42:56.089000+0000","last_became_active":"2023-11-04T01:42:35.353832+0000","last_became_peered":"2023-11-04T01:42:35.353832+0000","last_unstale":"2023-11-04T01:42:56.089000+0000","last_undegraded":"2023-11-04T01:42:56.089000+0000","last_fullsized":"2023-11-04T01:42:56.089000+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:34:48.488293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.088440+0000","last_change":"2023-11-04T01:42:36.342247+0000","last_active":"2023-11-04T01:42:56.088440+0000","last_peered":"2023-11-04T01:42:56.088440+0000","last_clean":"2023-11-04T01:42:56.088440+0000","last_became_active":"2023-11-04T01:42:34.352917+0000","last_became_peered":"2023-11-04T01:42:34.352917+0000","last_unstale":"2023-11-04T01:42:56.088440+0000","last_undegraded":"2023-11-04T01:42:56.088440+0000","last_fullsized":"2023-11-04T01:42:56.088440+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:56.180797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014365140000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.093515+0000","last_change":"2023-11-04T01:41:35.931718+0000","last_active":"2023-11-04T01:42:56.093515+0000","last_peered":"2023-11-04T01:42:56.093515+0000","last_clean":"2023-11-04T01:42:56.093515+0000","last_became_active":"2023-11-04T01:41:34.741033+0000","last_became_peered":"2023-11-04T01:41:34.741033+0000","last_unstale":"2023-11-04T01:42:56.093515+0000","last_undegraded":"2023-11-04T01:42:56.093515+0000","last_fullsized":"2023-11-04T01:42:56.093515+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:48.121273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065858400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.602338+0000","last_change":"2023-11-04T01:42:56.599926+0000","last_active":"2023-11-04T01:42:56.602338+0000","last_peered":"2023-11-04T01:42:56.602338+0000","last_clean":"2023-11-04T01:42:56.602338+0000","last_became_active":"2023-11-04T01:42:56.599655+0000","last_became_peered":"2023-11-04T01:42:56.599655+0000","last_unstale":"2023-11-04T01:42:56.602338+0000","last_undegraded":"2023-11-04T01:42:56.602338+0000","last_fullsized":"2023-11-04T01:42:56.602338+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:51:16.438696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.588899+0000","last_change":"2023-11-04T01:42:56.096569+0000","last_active":"2023-11-04T01:42:56.588899+0000","last_peered":"2023-11-04T01:42:56.588899+0000","last_clean":"2023-11-04T01:42:56.588899+0000","last_became_active":"2023-11-04T01:42:56.096231+0000","last_became_peered":"2023-11-04T01:42:56.096231+0000","last_unstale":"2023-11-04T01:42:56.588899+0000","last_undegraded":"2023-11-04T01:42:56.588899+0000","last_fullsized":"2023-11-04T01:42:56.588899+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:31:49.658638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.088520+0000","last_change":"2023-11-04T01:42:35.351103+0000","last_active":"2023-11-04T01:42:56.088520+0000","last_peered":"2023-11-04T01:42:56.088520+0000","last_clean":"2023-11-04T01:42:56.088520+0000","last_became_active":"2023-11-04T01:42:35.350867+0000","last_became_peered":"2023-11-04T01:42:35.350867+0000","last_unstale":"2023-11-04T01:42:56.088520+0000","last_undegraded":"2023-11-04T01:42:56.088520+0000","last_fullsized":"2023-11-04T01:42:56.088520+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:12:54.713516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.086941+0000","last_change":"2023-11-04T01:42:36.408801+0000","last_active":"2023-11-04T01:42:56.086941+0000","last_peered":"2023-11-04T01:42:56.086941+0000","last_clean":"2023-11-04T01:42:56.086941+0000","last_became_active":"2023-11-04T01:42:34.345669+0000","last_became_peered":"2023-11-04T01:42:34.345669+0000","last_unstale":"2023-11-04T01:42:56.086941+0000","last_undegraded":"2023-11-04T01:42:56.086941+0000","last_fullsized":"2023-11-04T01:42:56.086941+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:42.679727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055359799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.086288+0000","last_change":"2023-11-04T01:41:35.728094+0000","last_active":"2023-11-04T01:42:56.086288+0000","last_peered":"2023-11-04T01:42:56.086288+0000","last_clean":"2023-11-04T01:42:56.086288+0000","last_became_active":"2023-11-04T01:41:34.738687+0000","last_became_peered":"2023-11-04T01:41:34.738687+0000","last_unstale":"2023-11-04T01:42:56.086288+0000","last_undegraded":"2023-11-04T01:42:56.086288+0000","last_fullsized":"2023-11-04T01:42:56.086288+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:37.958719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068772699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.605311+0000","last_change":"2023-11-04T01:42:56.600728+0000","last_active":"2023-11-04T01:42:56.605311+0000","last_peered":"2023-11-04T01:42:56.605311+0000","last_clean":"2023-11-04T01:42:56.605311+0000","last_became_active":"2023-11-04T01:42:56.600466+0000","last_became_peered":"2023-11-04T01:42:56.600466+0000","last_unstale":"2023-11-04T01:42:56.605311+0000","last_undegraded":"2023-11-04T01:42:56.605311+0000","last_fullsized":"2023-11-04T01:42:56.605311+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:04:02.094362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.588528+0000","last_change":"2023-11-04T01:42:56.101381+0000","last_active":"2023-11-04T01:42:56.588528+0000","last_peered":"2023-11-04T01:42:56.588528+0000","last_clean":"2023-11-04T01:42:56.588528+0000","last_became_active":"2023-11-04T01:42:56.101063+0000","last_became_peered":"2023-11-04T01:42:56.101063+0000","last_unstale":"2023-11-04T01:42:56.588528+0000","last_undegraded":"2023-11-04T01:42:56.588528+0000","last_fullsized":"2023-11-04T01:42:56.588528+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:52.753042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.089533+0000","last_change":"2023-11-04T01:42:35.354730+0000","last_active":"2023-11-04T01:42:56.089533+0000","last_peered":"2023-11-04T01:42:56.089533+0000","last_clean":"2023-11-04T01:42:56.089533+0000","last_became_active":"2023-11-04T01:42:35.354427+0000","last_became_peered":"2023-11-04T01:42:35.354427+0000","last_unstale":"2023-11-04T01:42:56.089533+0000","last_undegraded":"2023-11-04T01:42:56.089533+0000","last_fullsized":"2023-11-04T01:42:56.089533+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:41:40.506391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.086184+0000","last_change":"2023-11-04T01:42:36.407795+0000","last_active":"2023-11-04T01:42:56.086184+0000","last_peered":"2023-11-04T01:42:56.086184+0000","last_clean":"2023-11-04T01:42:56.086184+0000","last_became_active":"2023-11-04T01:42:34.349234+0000","last_became_peered":"2023-11-04T01:42:34.349234+0000","last_unstale":"2023-11-04T01:42:56.086184+0000","last_undegraded":"2023-11-04T01:42:56.086184+0000","last_fullsized":"2023-11-04T01:42:56.086184+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:31:27.915960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000451805,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087013+0000","last_change":"2023-11-04T01:41:35.729106+0000","last_active":"2023-11-04T01:42:56.087013+0000","last_peered":"2023-11-04T01:42:56.087013+0000","last_clean":"2023-11-04T01:42:56.087013+0000","last_became_active":"2023-11-04T01:41:34.731230+0000","last_became_peered":"2023-11-04T01:41:34.731230+0000","last_unstale":"2023-11-04T01:42:56.087013+0000","last_undegraded":"2023-11-04T01:42:56.087013+0000","last_fullsized":"2023-11-04T01:42:56.087013+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:07:32.744572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078592199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.602596+0000","last_change":"2023-11-04T01:42:56.600007+0000","last_active":"2023-11-04T01:42:56.602596+0000","last_peered":"2023-11-04T01:42:56.602596+0000","last_clean":"2023-11-04T01:42:56.602596+0000","last_became_active":"2023-11-04T01:42:56.599747+0000","last_became_peered":"2023-11-04T01:42:56.599747+0000","last_unstale":"2023-11-04T01:42:56.602596+0000","last_undegraded":"2023-11-04T01:42:56.602596+0000","last_fullsized":"2023-11-04T01:42:56.602596+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:36:34.738639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.580100+0000","last_change":"2023-11-04T01:42:56.103887+0000","last_active":"2023-11-04T01:42:56.580100+0000","last_peered":"2023-11-04T01:42:56.580100+0000","last_clean":"2023-11-04T01:42:56.580100+0000","last_became_active":"2023-11-04T01:42:56.103542+0000","last_became_peered":"2023-11-04T01:42:56.103542+0000","last_unstale":"2023-11-04T01:42:56.580100+0000","last_undegraded":"2023-11-04T01:42:56.580100+0000","last_fullsized":"2023-11-04T01:42:56.580100+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:42:48.300158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.086442+0000","last_change":"2023-11-04T01:42:35.352725+0000","last_active":"2023-11-04T01:42:56.086442+0000","last_peered":"2023-11-04T01:42:56.086442+0000","last_clean":"2023-11-04T01:42:56.086442+0000","last_became_active":"2023-11-04T01:42:35.352127+0000","last_became_peered":"2023-11-04T01:42:35.352127+0000","last_unstale":"2023-11-04T01:42:56.086442+0000","last_undegraded":"2023-11-04T01:42:56.086442+0000","last_fullsized":"2023-11-04T01:42:56.086442+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:52:59.201087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.088231+0000","last_change":"2023-11-04T01:42:36.342229+0000","last_active":"2023-11-04T01:42:56.088231+0000","last_peered":"2023-11-04T01:42:56.088231+0000","last_clean":"2023-11-04T01:42:56.088231+0000","last_became_active":"2023-11-04T01:42:34.351542+0000","last_became_peered":"2023-11-04T01:42:34.351542+0000","last_unstale":"2023-11-04T01:42:56.088231+0000","last_undegraded":"2023-11-04T01:42:56.088231+0000","last_fullsized":"2023-11-04T01:42:56.088231+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:37:08.472507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017924740000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.086798+0000","last_change":"2023-11-04T01:41:35.728672+0000","last_active":"2023-11-04T01:42:56.086798+0000","last_peered":"2023-11-04T01:42:56.086798+0000","last_clean":"2023-11-04T01:42:56.086798+0000","last_became_active":"2023-11-04T01:41:34.727419+0000","last_became_peered":"2023-11-04T01:41:34.727419+0000","last_unstale":"2023-11-04T01:42:56.086798+0000","last_undegraded":"2023-11-04T01:42:56.086798+0000","last_fullsized":"2023-11-04T01:42:56.086798+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:35:01.127206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044278299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.605239+0000","last_change":"2023-11-04T01:42:56.600875+0000","last_active":"2023-11-04T01:42:56.605239+0000","last_peered":"2023-11-04T01:42:56.605239+0000","last_clean":"2023-11-04T01:42:56.605239+0000","last_became_active":"2023-11-04T01:42:56.600601+0000","last_became_peered":"2023-11-04T01:42:56.600601+0000","last_unstale":"2023-11-04T01:42:56.605239+0000","last_undegraded":"2023-11-04T01:42:56.605239+0000","last_fullsized":"2023-11-04T01:42:56.605239+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:56.075976+0000","last_clean_scrub_stamp":"2023-11-04T01:42:56.075976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:23:33.101684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.587501+0000","last_change":"2023-11-04T01:42:56.095725+0000","last_active":"2023-11-04T01:42:56.587501+0000","last_peered":"2023-11-04T01:42:56.587501+0000","last_clean":"2023-11-04T01:42:56.587501+0000","last_became_active":"2023-11-04T01:42:56.095389+0000","last_became_peered":"2023-11-04T01:42:56.095389+0000","last_unstale":"2023-11-04T01:42:56.587501+0000","last_undegraded":"2023-11-04T01:42:56.587501+0000","last_fullsized":"2023-11-04T01:42:56.587501+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:55.071223+0000","last_clean_scrub_stamp":"2023-11-04T01:42:55.071223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:08.921919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.090232+0000","last_change":"2023-11-04T01:42:35.352519+0000","last_active":"2023-11-04T01:42:56.090232+0000","last_peered":"2023-11-04T01:42:56.090232+0000","last_clean":"2023-11-04T01:42:56.090232+0000","last_became_active":"2023-11-04T01:42:35.352163+0000","last_became_peered":"2023-11-04T01:42:35.352163+0000","last_unstale":"2023-11-04T01:42:56.090232+0000","last_undegraded":"2023-11-04T01:42:56.090232+0000","last_fullsized":"2023-11-04T01:42:56.090232+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:05:52.477616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.087721+0000","last_change":"2023-11-04T01:42:36.342140+0000","last_active":"2023-11-04T01:42:56.087721+0000","last_peered":"2023-11-04T01:42:56.087721+0000","last_clean":"2023-11-04T01:42:56.087721+0000","last_became_active":"2023-11-04T01:42:34.354685+0000","last_became_peered":"2023-11-04T01:42:34.354685+0000","last_unstale":"2023-11-04T01:42:56.087721+0000","last_undegraded":"2023-11-04T01:42:56.087721+0000","last_fullsized":"2023-11-04T01:42:56.087721+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:54:50.302775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050039500000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.089008+0000","last_change":"2023-11-04T01:41:36.344271+0000","last_active":"2023-11-04T01:42:56.089008+0000","last_peered":"2023-11-04T01:42:56.089008+0000","last_clean":"2023-11-04T01:42:56.089008+0000","last_became_active":"2023-11-04T01:41:34.732524+0000","last_became_peered":"2023-11-04T01:41:34.732524+0000","last_unstale":"2023-11-04T01:42:56.089008+0000","last_undegraded":"2023-11-04T01:42:56.089008+0000","last_fullsized":"2023-11-04T01:42:56.089008+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:19.350812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081160599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":228,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-11-04T01:42:56.085788+0000","last_change":"2023-11-04T01:39:54.204460+0000","last_active":"2023-11-04T01:42:56.085788+0000","last_peered":"2023-11-04T01:42:56.085788+0000","last_clean":"2023-11-04T01:42:56.085788+0000","last_became_active":"2023-11-04T01:39:54.203352+0000","last_became_peered":"2023-11-04T01:39:54.203352+0000","last_unstale":"2023-11-04T01:42:56.085788+0000","last_undegraded":"2023-11-04T01:42:56.085788+0000","last_fullsized":"2023-11-04T01:42:56.085788+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:52.627032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:52.627032+0000","last_clean_scrub_stamp":"2023-11-04T01:39:52.627032+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:17:18.474768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1003520,"data_stored":485713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.52700000000000002,"15min":0.53500000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.65100000000000002,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.50600000000000001,"15min":0.499},"min":{"1min":0.376,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71499999999999997,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.376}]},{"osd":1,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54400000000000004,"15min":0.54700000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69899999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55500000000000005,"15min":0.55300000000000005},"min":{"1min":0.41099999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.73299999999999998,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.41699999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56699999999999995,"15min":0.57399999999999995},"min":{"1min":0.39400000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71499999999999997,"5min":1.177,"15min":1.177},"last":0.497},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.54200000000000004,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66300000000000003,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.39800000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.44600000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.73399999999999999,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.625,"15min":0.63400000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77300000000000002,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.54600000000000004}]},{"osd":4,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.52400000000000002,"15min":0.52600000000000002},"min":{"1min":0.30599999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68000000000000005,"5min":1.048,"15min":1.048},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.54600000000000004,"15min":0.53200000000000003},"min":{"1min":0.33000000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.52300000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.52900000000000003,"15min":0.51500000000000001},"min":{"1min":0.36899999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56499999999999995,"15min":0.56899999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.51200000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57699999999999996,"15min":0.56100000000000005},"min":{"1min":0.34200000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.626,"15min":0.624},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.58399999999999996}]}]},{"osd":7,"up_from":13,"seq":55834574887,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32728,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339112,"statfs":{"total":96636764160,"available":96603250688,"internally_reserved":0,"allocated":1585152,"data_stored":1067923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53700000000000003,"15min":0.51800000000000002},"min":{"1min":0.38500000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70399999999999996,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.41899999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.70699999999999996,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.51600000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60299999999999998,"15min":0.60999999999999999},"min":{"1min":0.45300000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73099999999999998,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.625},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.628,"15min":0.61399999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.75,"5min":2.5049999999999999,"15min":2.5049999999999999},"last":0.59299999999999997}]},{"osd":2,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59299999999999997,"15min":0.58499999999999996},"min":{"1min":0.45300000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.70099999999999996,"5min":1.708,"15min":1.708},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.627,"15min":0.60599999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77500000000000002,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.76600000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58599999999999997,"15min":0.56499999999999995},"min":{"1min":0.38300000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.67700000000000005,"5min":3.2349999999999999,"15min":3.2349999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82599999999999996,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.72499999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.50900000000000001,"15min":0.48899999999999999},"min":{"1min":0.35999999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.81100000000000005,"5min":1.454,"15min":1.454},"last":0.746},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.496,"15min":0.47499999999999998},"min":{"1min":0.34899999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.61099999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.54300000000000004,"15min":0.50900000000000001},"min":{"1min":0.39700000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.89400000000000002,"5min":1.629,"15min":1.629},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56499999999999995,"15min":0.53500000000000003},"min":{"1min":0.433,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.84399999999999997,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.65000000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63300000000000001,"15min":0.59199999999999997},"min":{"1min":0.41599999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.91500000000000004,"5min":3.7850000000000001,"15min":3.7850000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.58799999999999997,"15min":0.56000000000000005},"min":{"1min":0.41899999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.77200000000000002,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.69399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574887,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":978944,"data_stored":469897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.40200000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.67100000000000004,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40000000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.64900000000000002,"5min":0.752,"15min":0.752},"last":0.59199999999999997}]},{"osd":1,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56100000000000005,"15min":0.56599999999999995},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.72899999999999998,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.38,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.57899999999999996}]},{"osd":2,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.35299999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.69499999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.373},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57399999999999995,"15min":0.57899999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.67900000000000005,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.47799999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.47299999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.67400000000000004,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.624},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57999999999999996,"15min":0.57899999999999996},"min":{"1min":0.434,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.72799999999999998,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.503}]},{"osd":4,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.746,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.65000000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78800000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58499999999999996,"15min":0.58599999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77600000000000002,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.66700000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:41:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.749,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61599999999999999,"15min":0.621},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82399999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.63800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":469897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.505,"15min":0.502},"min":{"1min":0.32000000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66200000000000003,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51200000000000001,"15min":0.50800000000000001},"min":{"1min":0.33900000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.68700000000000006,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.84799999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.49099999999999999,"15min":0.48299999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.69899999999999995,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.749},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.42299999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.67300000000000004,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.68700000000000006}]},{"osd":2,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.53900000000000003},"min":{"1min":0.40300000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71099999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53400000000000003,"15min":0.53500000000000003},"min":{"1min":0.41499999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.67700000000000005,"5min":0.873,"15min":0.873},"last":0.86799999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53300000000000003,"15min":0.53400000000000003},"min":{"1min":0.39200000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.69299999999999995,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.74299999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.63100000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.47999999999999998,"15min":0.48299999999999998},"min":{"1min":0.34100000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.50600000000000001,"15min":0.50900000000000001},"min":{"1min":0.371,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66500000000000004,"5min":0.745,"15min":0.745},"last":0.77100000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.49299999999999999,"15min":0.497},"min":{"1min":0.34499999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.72399999999999998,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.755,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.89500000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.40699999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.751,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.34899999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.747,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.83399999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":991232,"data_stored":477555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.31900000000000001,"15min":0.317},"min":{"1min":0.20599999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.5},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.32800000000000001,"15min":0.32200000000000001},"min":{"1min":0.23699999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.32700000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.36599999999999999,"15min":0.372},"min":{"1min":0.23899999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.48499999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.58699999999999997,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.55400000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.36799999999999999,"15min":0.36699999999999999},"min":{"1min":0.28199999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.52700000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.42199999999999999,"15min":0.42699999999999999},"min":{"1min":0.30299999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.50900000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.35299999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.81599999999999995,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58399999999999996,"15min":0.58799999999999997},"min":{"1min":0.40500000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.60799999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58699999999999997,"15min":0.59399999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79400000000000004,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.58599999999999997}]},{"osd":6,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57699999999999996,"15min":0.58099999999999996},"min":{"1min":0.373,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77100000000000002,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60999999999999999,"15min":0.61599999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85199999999999998,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.56799999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.626,"15min":0.628},"min":{"1min":0.46400000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58599999999999997,"15min":0.58899999999999997},"min":{"1min":0.40000000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83199999999999996,"5min":0.87,"15min":0.87},"last":0.622}]}]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":978944,"data_stored":469897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.32000000000000001,"15min":0.32200000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.35299999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.36899999999999999,"15min":0.371},"min":{"1min":0.245,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.373,"15min":0.378},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.42199999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.313}]},{"osd":3,"last update":"Sat Nov 4 01:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.34999999999999998,"15min":0.35499999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.46600000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.378},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.29499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.36699999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.55500000000000005,"15min":0.54700000000000004},"min":{"1min":0.41599999999999998,"5min":0.374,"15min":0.374},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.58599999999999997}]},{"osd":5,"last update":"Sat Nov 4 01:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.378,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.41499999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.55000000000000004}]},{"osd":6,"last update":"Sat Nov 4 01:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58299999999999996,"15min":0.57999999999999996},"min":{"1min":0.43099999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.55900000000000005,"15min":0.55400000000000005},"min":{"1min":0.42199999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.57299999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:41:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60099999999999998,"15min":0.59999999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.497},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.60299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1003520,"data_stored":485713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.27900000000000003,"5min":0.30299999999999999,"15min":0.307},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.42999999999999999,"5min":0.443,"15min":0.443},"last":0.20000000000000001},{"interface":"front","average":{"1min":0.29399999999999998,"5min":0.312,"15min":0.315},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.252}]},{"osd":2,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.32700000000000001,"15min":0.33100000000000002},"min":{"1min":0.23400000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.43099999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.373,"15min":0.378},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.52200000000000002,"5min":0.621,"15min":0.621},"last":0.28399999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.371,"15min":0.375},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.46400000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.40200000000000002,"15min":0.40699999999999997},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.33200000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.57899999999999996,"15min":0.58999999999999997},"min":{"1min":0.36699999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.65100000000000002,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56299999999999994,"15min":0.56599999999999995},"min":{"1min":0.38500000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.59299999999999997}]},{"osd":5,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53900000000000003,"15min":0.54000000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.503},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59799999999999998,"15min":0.60699999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.71699999999999997,"5min":0.87,"15min":0.87},"last":0.56499999999999995}]},{"osd":6,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56299999999999994,"15min":0.56599999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77800000000000002,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.60399999999999998,"15min":0.61399999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72499999999999998,"5min":1.129,"15min":1.129},"last":0.48999999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.629,"15min":0.63700000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.75600000000000001,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.625,"15min":0.63300000000000001},"min":{"1min":0.42399999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82799999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.55200000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32732,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339108,"statfs":{"total":96636764160,"available":96603246592,"internally_reserved":0,"allocated":1581056,"data_stored":1066904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:42:53 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.32600000000000001,"15min":0.33200000000000002},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.53200000000000003,"5min":0.874,"15min":0.874},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.374,"15min":0.38800000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.502,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.32600000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:42:53 2023","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.34899999999999998,"15min":0.373},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.38100000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.35499999999999998,"15min":0.372},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.41699999999999998,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.33700000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:42:53 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.34699999999999998,"15min":0.35699999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.46600000000000003,"5min":1.278,"15min":1.278},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.42099999999999999,"15min":0.437},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.52100000000000002,"5min":1.304,"15min":1.304},"last":0.35399999999999998}]},{"osd":4,"last update":"Sat Nov 4 01:42:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.58199999999999996,"15min":0.58699999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76800000000000002,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.622,"15min":0.625},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.82399999999999995,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.71699999999999997}]},{"osd":5,"last update":"Sat Nov 4 01:42:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38400000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73299999999999998,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.58599999999999997,"15min":0.60099999999999998},"min":{"1min":0.373,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.71399999999999997,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.78800000000000003}]},{"osd":6,"last update":"Sat Nov 4 01:42:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.1319999999999999,"5min":1.248,"15min":1.248},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.61499999999999999,"15min":0.626},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73699999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.82399999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:42:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.57899999999999996,"15min":0.58799999999999997},"min":{"1min":0.38300000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78300000000000003,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.61399999999999999,"15min":0.62},"min":{"1min":0.41199999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.74299999999999999,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.86299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:43:00.400 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T01:43:00.400 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-04T01:43:00.465 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:43:00.472 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:43:00.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.534+0000 7f31b62c9640 1 Processor -- start 2023-11-04T01:43:00.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.534+0000 7f31b62c9640 1 -- start start 2023-11-04T01:43:00.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.534+0000 7f31b62c9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f31b0153850 0x7f31b015a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.534+0000 7f31b62c9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f31b00cc9d0 0x7f31b00c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.534+0000 7f31b62c9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b00c3860 con 0x7f31b00cc520 2023-11-04T01:43:00.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.534+0000 7f31b62c9640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31b00c9250 con 0x7f31b0153850 2023-11-04T01:43:00.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.535+0000 7f31b62c9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b0153c30 con 0x7f31b00cc9d0 2023-11-04T01:43:00.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.535+0000 7f31af7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f31b00cc520 0x7f31b0070fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49794/0 (socket says 172.21.15.77:49794) 2023-11-04T01:43:00.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.535+0000 7f31af7fe640 1 -- 172.21.15.77:0/2821622747 learned_addr learned my addr 172.21.15.77:0/2821622747 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:00.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.535+0000 7f31aeffd640 1 -- 172.21.15.77:0/2821622747 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3365024044 0 0) 0x7f31b00c3860 con 0x7f31b00cc520 2023-11-04T01:43:00.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.535+0000 7f31aeffd640 1 -- 172.21.15.77:0/2821622747 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3198003520 con 0x7f31b00cc520 2023-11-04T01:43:00.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.535+0000 7f31affff640 1 --2- 172.21.15.77:0/2821622747 >> v2:172.21.15.122:3300/0 conn(0x7f31b0153850 0x7f31b015a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.535+0000 7f31b4866640 1 --2- 172.21.15.77:0/2821622747 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f31b00cc9d0 0x7f31b00c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.535+0000 7f31aeffd640 1 -- 172.21.15.77:0/2821622747 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1668212369 0 0) 0x7f3198003520 con 0x7f31b00cc520 2023-11-04T01:43:00.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.535+0000 7f31aeffd640 1 -- 172.21.15.77:0/2821622747 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f31b00cc9d0 msgr2=0x7f31b00c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:00.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.535+0000 7f31aeffd640 1 --2- 172.21.15.77:0/2821622747 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f31b00cc9d0 0x7f31b00c3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.535+0000 7f31aeffd640 1 -- 172.21.15.77:0/2821622747 >> v2:172.21.15.122:3300/0 conn(0x7f31b0153850 msgr2=0x7f31b015a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:00.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.535+0000 7f31aeffd640 1 --2- 172.21.15.77:0/2821622747 >> v2:172.21.15.122:3300/0 conn(0x7f31b0153850 0x7f31b015a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.535+0000 7f31aeffd640 1 -- 172.21.15.77:0/2821622747 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b015a700 con 0x7f31b00cc520 2023-11-04T01:43:00.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.535+0000 7f31aeffd640 1 -- 172.21.15.77:0/2821622747 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f31a4001670 con 0x7f31b00cc520 2023-11-04T01:43:00.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.535+0000 7f31aeffd640 1 -- 172.21.15.77:0/2821622747 >> v1:172.21.15.77:6789/0 conn(0x7f31b00cc520 legacy=0x7f31b0070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.535+0000 7f31aeffd640 1 --2- 172.21.15.77:0/2821622747 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f31b00cc9d0 0x7f3198003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.535+0000 7f31aeffd640 1 --2- 172.21.15.77:0/2821622747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3198003fa0 0x7f31980047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.535+0000 7f31aeffd640 1 --2- 172.21.15.77:0/2821622747 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3198004d00 0x7f3198005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.535+0000 7f31aeffd640 1 -- 172.21.15.77:0/2821622747 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b00c9250 con 0x7f3198003fa0 2023-11-04T01:43:00.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.535+0000 7f31aeffd640 1 -- 172.21.15.77:0/2821622747 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b0153c30 con 0x7f3198004d00 2023-11-04T01:43:00.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.535+0000 7f31aeffd640 1 -- 172.21.15.77:0/2821622747 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319800ba80 con 0x7f31b00cc9d0 2023-11-04T01:43:00.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.535+0000 7f31af7fe640 1 --2- 172.21.15.77:0/2821622747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3198003fa0 0x7f31980047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.535+0000 7f31affff640 1 --2- 172.21.15.77:0/2821622747 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f31b00cc9d0 0x7f3198003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.535+0000 7f31b4866640 1 --2- 172.21.15.77:0/2821622747 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3198004d00 0x7f3198005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.536+0000 7f31af7fe640 1 -- 172.21.15.77:0/2821622747 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f31b00cc9d0 msgr2=0x7f3198003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:00.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.536+0000 7f31af7fe640 1 --2- 172.21.15.77:0/2821622747 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f31b00cc9d0 0x7f3198003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.536+0000 7f31af7fe640 1 -- 172.21.15.77:0/2821622747 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3198004d00 msgr2=0x7f3198005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:00.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.536+0000 7f31af7fe640 1 --2- 172.21.15.77:0/2821622747 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3198004d00 0x7f3198005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.536+0000 7f31af7fe640 1 -- 172.21.15.77:0/2821622747 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3198003520 con 0x7f3198003fa0 2023-11-04T01:43:00.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.536+0000 7f31b4866640 1 --2- 172.21.15.77:0/2821622747 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3198004d00 0x7f3198005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:00.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.536+0000 7f31af7fe640 1 --2- 172.21.15.77:0/2821622747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3198003fa0 0x7f31980047c0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f31a400c290 tx=0x7f31980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61feaee6a7202ee4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:00.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.536+0000 7f31aeffd640 1 -- 172.21.15.77:0/2821622747 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a4005ad0 con 0x7f3198003fa0 2023-11-04T01:43:00.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.536+0000 7f31aeffd640 1 -- 172.21.15.77:0/2821622747 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a4005c30 con 0x7f3198003fa0 2023-11-04T01:43:00.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.536+0000 7f31aeffd640 1 -- 172.21.15.77:0/2821622747 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a402c8d0 con 0x7f3198003fa0 2023-11-04T01:43:00.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.537+0000 7f31b62c9640 1 -- 172.21.15.77:0/2821622747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3198003fa0 msgr2=0x7f31980047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.537+0000 7f31b62c9640 1 --2- 172.21.15.77:0/2821622747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3198003fa0 0x7f31980047c0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f31a400c290 tx=0x7f31980057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.537+0000 7f31b4866640 1 -- 172.21.15.77:0/2821622747 reap_dead start 2023-11-04T01:43:00.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.537+0000 7f31b62c9640 1 -- 172.21.15.77:0/2821622747 shutdown_connections 2023-11-04T01:43:00.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.537+0000 7f31b62c9640 1 -- 172.21.15.77:0/2821622747 >> 172.21.15.77:0/2821622747 conn(0x7f31b00ce950 msgr2=0x7f31b00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:00.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.537+0000 7f31b62c9640 1 -- 172.21.15.77:0/2821622747 shutdown_connections 2023-11-04T01:43:00.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.537+0000 7f31b62c9640 1 -- 172.21.15.77:0/2821622747 wait complete. 2023-11-04T01:43:00.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.538+0000 7f31b62c9640 1 Processor -- start 2023-11-04T01:43:00.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.538+0000 7f31b62c9640 1 -- start start 2023-11-04T01:43:00.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.539+0000 7f31b62c9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3198003fa0 0x7f31b00c7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.539+0000 7f31b62c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31b014d0c0 0x7f31b006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.539+0000 7f31b62c9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f31b006d690 0x7f31b0151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.539+0000 7f31b62c9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b006db10 con 0x7f31b014d0c0 2023-11-04T01:43:00.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.539+0000 7f31b62c9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b014c0b0 con 0x7f3198003fa0 2023-11-04T01:43:00.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.539+0000 7f31b62c9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b014cc30 con 0x7f31b006d690 2023-11-04T01:43:00.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.539+0000 7f31af7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31b014d0c0 0x7f31b006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.539+0000 7f31af7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31b014d0c0 0x7f31b006d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45142/0 (socket says 172.21.15.77:45142) 2023-11-04T01:43:00.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.539+0000 7f31af7fe640 1 -- 172.21.15.77:0/748524930 learned_addr learned my addr 172.21.15.77:0/748524930 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:00.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.539+0000 7f31affff640 1 --2- 172.21.15.77:0/748524930 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3198003fa0 0x7f31b00c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.539+0000 7f31b4866640 1 --2- 172.21.15.77:0/748524930 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f31b006d690 0x7f31b0151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.540+0000 7f31af7fe640 1 -- 172.21.15.77:0/748524930 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f31b006d690 msgr2=0x7f31b0151780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.540+0000 7f31af7fe640 1 --2- 172.21.15.77:0/748524930 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f31b006d690 0x7f31b0151780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.540+0000 7f31af7fe640 1 -- 172.21.15.77:0/748524930 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3198003fa0 msgr2=0x7f31b00c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.540+0000 7f31af7fe640 1 --2- 172.21.15.77:0/748524930 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3198003fa0 0x7f31b00c7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.540+0000 7f31af7fe640 1 -- 172.21.15.77:0/748524930 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b014c300 con 0x7f31b014d0c0 2023-11-04T01:43:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.540+0000 7f31affff640 1 --2- 172.21.15.77:0/748524930 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3198003fa0 0x7f31b00c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.540+0000 7f31af7fe640 1 --2- 172.21.15.77:0/748524930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31b014d0c0 0x7f31b006d150 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f31a402c470 tx=0x7f31a4000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:00.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.540+0000 7f31acff9640 1 -- 172.21.15.77:0/748524930 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a4039070 con 0x7f31b014d0c0 2023-11-04T01:43:00.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.540+0000 7f31acff9640 1 -- 172.21.15.77:0/748524930 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a402dd90 con 0x7f31b014d0c0 2023-11-04T01:43:00.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.540+0000 7f31b62c9640 1 -- 172.21.15.77:0/748524930 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b014c5e0 con 0x7f31b014d0c0 2023-11-04T01:43:00.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.540+0000 7f31acff9640 1 -- 172.21.15.77:0/748524930 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a40072b0 con 0x7f31b014d0c0 2023-11-04T01:43:00.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.540+0000 7f31b62c9640 1 -- 172.21.15.77:0/748524930 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b0151cc0 con 0x7f31b014d0c0 2023-11-04T01:43:00.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.541+0000 7f31b62c9640 1 -- 172.21.15.77:0/748524930 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31b0074290 con 0x7f31b014d0c0 2023-11-04T01:43:00.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.541+0000 7f31acff9640 1 -- 172.21.15.77:0/748524930 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f31a4032070 con 0x7f31b014d0c0 2023-11-04T01:43:00.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.542+0000 7f31acff9640 1 --2- 172.21.15.77:0/748524930 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f319c06aea0 0x7f319c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.542+0000 7f31acff9640 1 -- 172.21.15.77:0/748524930 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f31a403c040 con 0x7f31b014d0c0 2023-11-04T01:43:00.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.542+0000 7f31affff640 1 --2- 172.21.15.77:0/748524930 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f319c06aea0 0x7f319c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.542+0000 7f31affff640 1 --2- 172.21.15.77:0/748524930 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f319c06aea0 0x7f319c06d360 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f31a0006fd0 tx=0x7f31a0008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:00.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.546+0000 7f31acff9640 1 -- 172.21.15.77:0/748524930 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f31a4075af0 con 0x7f31b014d0c0 2023-11-04T01:43:00.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.776+0000 7f31b62c9640 1 -- 172.21.15.77:0/748524930 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f31b00cc240 con 0x7f31b014d0c0 2023-11-04T01:43:00.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.778+0000 7f31acff9640 1 -- 172.21.15.77:0/748524930 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7f31a4045020 con 0x7f31b014d0c0 2023-11-04T01:43:00.780 INFO:teuthology.orchestra.run.smithi077.stdout:[client.0] 2023-11-04T01:43:00.780 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQC2oEVlChU2FxAAt1/aJZOrufjVZhraPqv1Gw== 2023-11-04T01:43:00.780 INFO:teuthology.orchestra.run.smithi077.stdout: caps mds = "allow" 2023-11-04T01:43:00.780 INFO:teuthology.orchestra.run.smithi077.stdout: caps mon = "allow r" 2023-11-04T01:43:00.781 INFO:teuthology.orchestra.run.smithi077.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-04T01:43:00.781 INFO:teuthology.orchestra.run.smithi077.stderr:updated caps for client.0 2023-11-04T01:43:00.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.780+0000 7f31b62c9640 1 -- 172.21.15.77:0/748524930 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f319c06aea0 msgr2=0x7f319c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.780+0000 7f31b62c9640 1 --2- 172.21.15.77:0/748524930 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f319c06aea0 0x7f319c06d360 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f31a0006fd0 tx=0x7f31a0008040 comp rx=0 tx=0).stop 2023-11-04T01:43:00.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.780+0000 7f31b62c9640 1 -- 172.21.15.77:0/748524930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31b014d0c0 msgr2=0x7f31b006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.780+0000 7f31b62c9640 1 --2- 172.21.15.77:0/748524930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31b014d0c0 0x7f31b006d150 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f31a402c470 tx=0x7f31a4000fe0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.780+0000 7f31b62c9640 1 -- 172.21.15.77:0/748524930 shutdown_connections 2023-11-04T01:43:00.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.780+0000 7f31b62c9640 1 --2- 172.21.15.77:0/748524930 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f319c06aea0 0x7f319c06d360 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.780+0000 7f31b62c9640 1 --2- 172.21.15.77:0/748524930 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f31b006d690 0x7f31b0151780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.780+0000 7f31b62c9640 1 --2- 172.21.15.77:0/748524930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31b014d0c0 0x7f31b006d150 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.780+0000 7f31b62c9640 1 --2- 172.21.15.77:0/748524930 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3198003fa0 0x7f31b00c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.780+0000 7f31b62c9640 1 -- 172.21.15.77:0/748524930 >> 172.21.15.77:0/748524930 conn(0x7f31b00ce950 msgr2=0x7f31b00cd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:00.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.780+0000 7f31b62c9640 1 -- 172.21.15.77:0/748524930 shutdown_connections 2023-11-04T01:43:00.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.780+0000 7f31b62c9640 1 -- 172.21.15.77:0/748524930 wait complete. 2023-11-04T01:43:00.792 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:00.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.931+0000 7ff51d3e7640 1 Processor -- start 2023-11-04T01:43:00.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.931+0000 7ff51d3e7640 1 -- start start 2023-11-04T01:43:00.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.932+0000 7ff51d3e7640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff5180cde60 0x7ff51815d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.932+0000 7ff51d3e7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff51815daa0 0x7ff518157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.932+0000 7ff51d3e7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff51815e000 con 0x7ff5180ce240 2023-11-04T01:43:00.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.932+0000 7ff51d3e7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff51815e5c0 con 0x7ff51815daa0 2023-11-04T01:43:00.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.932+0000 7ff51d3e7640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff51815e2e0 con 0x7ff5180cde60 2023-11-04T01:43:00.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.932+0000 7ff50ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff51815daa0 0x7ff518157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.932+0000 7ff50ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff51815daa0 0x7ff518157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45152/0 (socket says 172.21.15.77:45152) 2023-11-04T01:43:00.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.932+0000 7ff5177fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ff5180ce240 0x7ff51806b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49796/0 (socket says 172.21.15.77:49796) 2023-11-04T01:43:00.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.932+0000 7ff50ffff640 1 -- 172.21.15.77:0/2732537437 learned_addr learned my addr 172.21.15.77:0/2732537437 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:00.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.932+0000 7ff50ffff640 1 -- 172.21.15.77:0/2732537437 >> v2:172.21.15.122:3300/0 conn(0x7ff5180cde60 msgr2=0x7ff51815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:00.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.932+0000 7ff516ffd640 1 --2- 172.21.15.77:0/2732537437 >> v2:172.21.15.122:3300/0 conn(0x7ff5180cde60 0x7ff51815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.932+0000 7ff50ffff640 1 --2- 172.21.15.77:0/2732537437 >> v2:172.21.15.122:3300/0 conn(0x7ff5180cde60 0x7ff51815d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.932+0000 7ff5167fc640 1 -- 172.21.15.77:0/2732537437 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2454134070 0 0) 0x7ff51815e000 con 0x7ff5180ce240 2023-11-04T01:43:00.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.932+0000 7ff50ffff640 1 -- 172.21.15.77:0/2732537437 >> v1:172.21.15.77:6789/0 conn(0x7ff5180ce240 legacy=0x7ff51806b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.932+0000 7ff50ffff640 1 -- 172.21.15.77:0/2732537437 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5180d1120 con 0x7ff51815daa0 2023-11-04T01:43:00.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.932+0000 7ff516ffd640 1 --2- 172.21.15.77:0/2732537437 >> v2:172.21.15.122:3300/0 conn(0x7ff5180cde60 0x7ff51815d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:00.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.933+0000 7ff50ffff640 1 --2- 172.21.15.77:0/2732537437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff51815daa0 0x7ff518157000 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7ff5180b5550 tx=0x7ff50002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84ffb9cece02b528 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:00.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.933+0000 7ff5167fc640 1 -- 172.21.15.77:0/2732537437 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff500030860 con 0x7ff51815daa0 2023-11-04T01:43:00.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.933+0000 7ff5167fc640 1 -- 172.21.15.77:0/2732537437 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5000309c0 con 0x7ff51815daa0 2023-11-04T01:43:00.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.933+0000 7ff5167fc640 1 -- 172.21.15.77:0/2732537437 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff500030d50 con 0x7ff51815daa0 2023-11-04T01:43:00.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.934+0000 7ff51d3e7640 1 -- 172.21.15.77:0/2732537437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff51815daa0 msgr2=0x7ff518157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.934+0000 7ff51d3e7640 1 --2- 172.21.15.77:0/2732537437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff51815daa0 0x7ff518157000 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7ff5180b5550 tx=0x7ff50002b9a0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.934+0000 7ff51d3e7640 1 -- 172.21.15.77:0/2732537437 shutdown_connections 2023-11-04T01:43:00.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.934+0000 7ff51d3e7640 1 --2- 172.21.15.77:0/2732537437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff51815daa0 0x7ff518157000 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.934+0000 7ff51d3e7640 1 --2- 172.21.15.77:0/2732537437 >> v2:172.21.15.122:3300/0 conn(0x7ff5180cde60 0x7ff51815d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.934+0000 7ff51d3e7640 1 -- 172.21.15.77:0/2732537437 >> 172.21.15.77:0/2732537437 conn(0x7ff518071f30 msgr2=0x7ff5180cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:00.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.934+0000 7ff51d3e7640 1 -- 172.21.15.77:0/2732537437 shutdown_connections 2023-11-04T01:43:00.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.934+0000 7ff51d3e7640 1 -- 172.21.15.77:0/2732537437 wait complete. 2023-11-04T01:43:00.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.935+0000 7ff51d3e7640 1 Processor -- start 2023-11-04T01:43:00.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.935+0000 7ff51d3e7640 1 -- start start 2023-11-04T01:43:00.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.935+0000 7ff51d3e7640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff5180cde60 0x7ff51814adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.935+0000 7ff51d3e7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5180ce240 0x7ff5180ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.935+0000 7ff51d3e7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff51815daa0 0x7ff518151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.935+0000 7ff51d3e7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5180cd350 con 0x7ff51815daa0 2023-11-04T01:43:00.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.935+0000 7ff51d3e7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51814b330 con 0x7ff5180ce240 2023-11-04T01:43:00.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.935+0000 7ff51d3e7640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5180cc740 con 0x7ff5180cde60 2023-11-04T01:43:00.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.936+0000 7ff5177fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff51815daa0 0x7ff518151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.936+0000 7ff5177fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff51815daa0 0x7ff518151140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45164/0 (socket says 172.21.15.77:45164) 2023-11-04T01:43:00.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.936+0000 7ff5177fe640 1 -- 172.21.15.77:0/1473320344 learned_addr learned my addr 172.21.15.77:0/1473320344 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:00.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.936+0000 7ff5177fe640 1 -- 172.21.15.77:0/1473320344 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff5180cde60 msgr2=0x7ff51814adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.936+0000 7ff5177fe640 1 --2- 172.21.15.77:0/1473320344 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff5180cde60 0x7ff51814adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.936+0000 7ff5177fe640 1 -- 172.21.15.77:0/1473320344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5180ce240 msgr2=0x7ff5180ca900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.936+0000 7ff5177fe640 1 --2- 172.21.15.77:0/1473320344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5180ce240 0x7ff5180ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.936+0000 7ff5177fe640 1 -- 172.21.15.77:0/1473320344 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5000094d0 con 0x7ff51815daa0 2023-11-04T01:43:00.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.936+0000 7ff5177fe640 1 --2- 172.21.15.77:0/1473320344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff51815daa0 0x7ff518151140 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7ff510001560 tx=0x7ff51000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:00.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.936+0000 7ff50f7fe640 1 -- 172.21.15.77:0/1473320344 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51000a640 con 0x7ff51815daa0 2023-11-04T01:43:00.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.936+0000 7ff50f7fe640 1 -- 172.21.15.77:0/1473320344 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51000a7a0 con 0x7ff51815daa0 2023-11-04T01:43:00.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.936+0000 7ff51d3e7640 1 -- 172.21.15.77:0/1473320344 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5180cca20 con 0x7ff51815daa0 2023-11-04T01:43:00.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.936+0000 7ff50f7fe640 1 -- 172.21.15.77:0/1473320344 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51000ab30 con 0x7ff51815daa0 2023-11-04T01:43:00.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.936+0000 7ff51d3e7640 1 -- 172.21.15.77:0/1473320344 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5180ccfe0 con 0x7ff51815daa0 2023-11-04T01:43:00.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.937+0000 7ff51d3e7640 1 -- 172.21.15.77:0/1473320344 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff518074290 con 0x7ff51815daa0 2023-11-04T01:43:00.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.938+0000 7ff50f7fe640 1 -- 172.21.15.77:0/1473320344 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff51000ac90 con 0x7ff51815daa0 2023-11-04T01:43:00.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.938+0000 7ff50f7fe640 1 --2- 172.21.15.77:0/1473320344 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff4f806ae70 0x7ff4f806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.938+0000 7ff50f7fe640 1 -- 172.21.15.77:0/1473320344 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7ff5100890a0 con 0x7ff51815daa0 2023-11-04T01:43:00.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.938+0000 7ff516ffd640 1 --2- 172.21.15.77:0/1473320344 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff4f806ae70 0x7ff4f806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.939+0000 7ff516ffd640 1 --2- 172.21.15.77:0/1473320344 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff4f806ae70 0x7ff4f806d330 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff508006fd0 tx=0x7ff508008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:00.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:00.942+0000 7ff50f7fe640 1 -- 172.21.15.77:0/1473320344 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff510053c70 con 0x7ff51815daa0 2023-11-04T01:43:01.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.143+0000 7ff51d3e7640 1 -- 172.21.15.77:0/1473320344 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5180cd490 con 0x7ff51815daa0 2023-11-04T01:43:01.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.143+0000 7ff50f7fe640 1 -- 172.21.15.77:0/1473320344 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4921 (secure 0 0 0) 0x7ff510018020 con 0x7ff51815daa0 2023-11-04T01:43:01.146 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:43:01.146 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":35,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5992,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/301441031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":301441031},{"type":"v1","addr":"172.21.15.122:6836","nonce":301441031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6861,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/3789657703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3789657703},{"type":"v1","addr":"172.21.15.77:6834","nonce":3789657703}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6864,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3292881877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3292881877},{"type":"v1","addr":"172.21.15.77:6835","nonce":3292881877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:42:56.427282+0000","modified":"2023-11-04T01:42:58.432114+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":35495},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35495":{"gid":35495,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/1536301485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1536301485},{"type":"v1","addr":"172.21.15.122:6837","nonce":1536301485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-04T01:43:01.147 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 35 2023-11-04T01:43:01.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.145+0000 7ff51d3e7640 1 -- 172.21.15.77:0/1473320344 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff4f806ae70 msgr2=0x7ff4f806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.145+0000 7ff51d3e7640 1 --2- 172.21.15.77:0/1473320344 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff4f806ae70 0x7ff4f806d330 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff508006fd0 tx=0x7ff508008040 comp rx=0 tx=0).stop 2023-11-04T01:43:01.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.145+0000 7ff51d3e7640 1 -- 172.21.15.77:0/1473320344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff51815daa0 msgr2=0x7ff518151140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.145+0000 7ff51d3e7640 1 --2- 172.21.15.77:0/1473320344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff51815daa0 0x7ff518151140 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7ff510001560 tx=0x7ff51000cc70 comp rx=0 tx=0).stop 2023-11-04T01:43:01.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.145+0000 7ff51d3e7640 1 -- 172.21.15.77:0/1473320344 shutdown_connections 2023-11-04T01:43:01.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.145+0000 7ff51d3e7640 1 --2- 172.21.15.77:0/1473320344 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff4f806ae70 0x7ff4f806d330 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.145+0000 7ff51d3e7640 1 --2- 172.21.15.77:0/1473320344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff51815daa0 0x7ff518151140 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.145+0000 7ff51d3e7640 1 --2- 172.21.15.77:0/1473320344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5180ce240 0x7ff5180ca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.145+0000 7ff51d3e7640 1 --2- 172.21.15.77:0/1473320344 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff5180cde60 0x7ff51814adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.145+0000 7ff51d3e7640 1 -- 172.21.15.77:0/1473320344 >> 172.21.15.77:0/1473320344 conn(0x7ff518071f30 msgr2=0x7ff5180d17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:01.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.145+0000 7ff51d3e7640 1 -- 172.21.15.77:0/1473320344 shutdown_connections 2023-11-04T01:43:01.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.145+0000 7ff51d3e7640 1 -- 172.21.15.77:0/1473320344 wait complete. 2023-11-04T01:43:01.560 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 35, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:42:56.427282+0000', 'modified': '2023-11-04T01:42:58.432114+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 35495}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_35495': {'gid': 35495, 'name': 'd', 'rank': 0, 'incarnation': 33, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.122:6837/1536301485', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6835', 'nonce': 1536301485}, {'type': 'v1', 'addr': '172.21.15.122:6837', 'nonce': 1536301485}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:43:01.561 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:43:01.561 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-04T01:43:01.584 INFO:tasks.ceph.mds.d.smithi122.stderr:2023-11-04T01:43:01.582+0000 7f5caafbf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:43:01.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.664+0000 7ff1f60af640 1 Processor -- start 2023-11-04T01:43:01.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.664+0000 7ff1f60af640 1 -- start start 2023-11-04T01:43:01.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.665+0000 7ff1f60af640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff1f00c4ff0 0x7ff1f00cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.665+0000 7ff1f60af640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff1f00adac0 0x7ff1f00adf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.665+0000 7ff1f60af640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1f015aff0 con 0x7ff1f0159c00 2023-11-04T01:43:01.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.665+0000 7ff1f60af640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1f00ae460 con 0x7ff1f00adac0 2023-11-04T01:43:01.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.665+0000 7ff1f60af640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1f015a3e0 con 0x7ff1f00c4ff0 2023-11-04T01:43:01.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.665+0000 7ff1effff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff1f00adac0 0x7ff1f00adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.665+0000 7ff1effff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff1f00adac0 0x7ff1f00adf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45166/0 (socket says 172.21.15.77:45166) 2023-11-04T01:43:01.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.665+0000 7ff1effff640 1 -- 172.21.15.77:0/3004095994 learned_addr learned my addr 172.21.15.77:0/3004095994 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:01.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.665+0000 7ff1eeffd640 1 --2- 172.21.15.77:0/3004095994 >> v2:172.21.15.122:3300/0 conn(0x7ff1f00c4ff0 0x7ff1f00cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.666+0000 7ff1effff640 1 -- 172.21.15.77:0/3004095994 >> v2:172.21.15.122:3300/0 conn(0x7ff1f00c4ff0 msgr2=0x7ff1f00cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:01.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.666+0000 7ff1effff640 1 --2- 172.21.15.77:0/3004095994 >> v2:172.21.15.122:3300/0 conn(0x7ff1f00c4ff0 0x7ff1f00cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.666+0000 7ff1effff640 1 -- 172.21.15.77:0/3004095994 >> v1:172.21.15.122:6789/0 conn(0x7ff1f0159c00 legacy=0x7ff1f00c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.666+0000 7ff1effff640 1 -- 172.21.15.77:0/3004095994 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f015a6c0 con 0x7ff1f00adac0 2023-11-04T01:43:01.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.666+0000 7ff1effff640 1 --2- 172.21.15.77:0/3004095994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1f00adac0 0x7ff1f00adf20 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00cde50 tx=0x7ff1e802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39c9ce6f78f9794e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:01.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.666+0000 7ff1ee7fc640 1 -- 172.21.15.77:0/3004095994 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e802cb20 con 0x7ff1f00adac0 2023-11-04T01:43:01.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.666+0000 7ff1ee7fc640 1 -- 172.21.15.77:0/3004095994 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e802cc80 con 0x7ff1f00adac0 2023-11-04T01:43:01.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.666+0000 7ff1ee7fc640 1 -- 172.21.15.77:0/3004095994 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e80343f0 con 0x7ff1f00adac0 2023-11-04T01:43:01.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.667+0000 7ff1f60af640 1 -- 172.21.15.77:0/3004095994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1f00adac0 msgr2=0x7ff1f00adf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.667+0000 7ff1f60af640 1 --2- 172.21.15.77:0/3004095994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1f00adac0 0x7ff1f00adf20 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00cde50 tx=0x7ff1e802bf80 comp rx=0 tx=0).stop 2023-11-04T01:43:01.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.667+0000 7ff1f60af640 1 -- 172.21.15.77:0/3004095994 shutdown_connections 2023-11-04T01:43:01.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.667+0000 7ff1f60af640 1 --2- 172.21.15.77:0/3004095994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1f00adac0 0x7ff1f00adf20 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.667+0000 7ff1f60af640 1 --2- 172.21.15.77:0/3004095994 >> v2:172.21.15.122:3300/0 conn(0x7ff1f00c4ff0 0x7ff1f00cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.667+0000 7ff1f60af640 1 -- 172.21.15.77:0/3004095994 >> 172.21.15.77:0/3004095994 conn(0x7ff1f00ce950 msgr2=0x7ff1f00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:01.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.667+0000 7ff1f60af640 1 -- 172.21.15.77:0/3004095994 shutdown_connections 2023-11-04T01:43:01.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.667+0000 7ff1f60af640 1 -- 172.21.15.77:0/3004095994 wait complete. 2023-11-04T01:43:01.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.668+0000 7ff1f60af640 1 Processor -- start 2023-11-04T01:43:01.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.668+0000 7ff1f60af640 1 -- start start 2023-11-04T01:43:01.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.669+0000 7ff1f60af640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1f00adac0 0x7ff1f0137400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.669+0000 7ff1f60af640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff1f00c4ff0 0x7ff1f006c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.669+0000 7ff1f60af640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1f0159c00 0x7ff1f006cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.669+0000 7ff1f60af640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f014c530 con 0x7ff1f00adac0 2023-11-04T01:43:01.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.669+0000 7ff1f60af640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f014c810 con 0x7ff1f0159c00 2023-11-04T01:43:01.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.669+0000 7ff1f60af640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f014caf0 con 0x7ff1f00c4ff0 2023-11-04T01:43:01.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.669+0000 7ff1ef7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1f00adac0 0x7ff1f0137400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.669+0000 7ff1ef7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1f00adac0 0x7ff1f0137400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45170/0 (socket says 172.21.15.77:45170) 2023-11-04T01:43:01.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.669+0000 7ff1ef7fe640 1 -- 172.21.15.77:0/299617061 learned_addr learned my addr 172.21.15.77:0/299617061 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:01.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.669+0000 7ff1eeffd640 1 --2- 172.21.15.77:0/299617061 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff1f00c4ff0 0x7ff1f006c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.669+0000 7ff1ef7fe640 1 -- 172.21.15.77:0/299617061 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff1f00c4ff0 msgr2=0x7ff1f006c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.669+0000 7ff1ef7fe640 1 --2- 172.21.15.77:0/299617061 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff1f00c4ff0 0x7ff1f006c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.669+0000 7ff1ef7fe640 1 -- 172.21.15.77:0/299617061 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1f0159c00 msgr2=0x7ff1f006cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.669+0000 7ff1ef7fe640 1 --2- 172.21.15.77:0/299617061 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1f0159c00 0x7ff1f006cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.669+0000 7ff1ef7fe640 1 -- 172.21.15.77:0/299617061 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e8009b30 con 0x7ff1f00adac0 2023-11-04T01:43:01.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.670+0000 7ff1ef7fe640 1 --2- 172.21.15.77:0/299617061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1f00adac0 0x7ff1f0137400 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7ff1e000c400 tx=0x7ff1e000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:01.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.670+0000 7ff1d7fff640 1 -- 172.21.15.77:0/299617061 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e00052d0 con 0x7ff1f00adac0 2023-11-04T01:43:01.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.670+0000 7ff1d7fff640 1 -- 172.21.15.77:0/299617061 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e0005430 con 0x7ff1f00adac0 2023-11-04T01:43:01.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.670+0000 7ff1d7fff640 1 -- 172.21.15.77:0/299617061 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0003830 con 0x7ff1f00adac0 2023-11-04T01:43:01.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.670+0000 7ff1f60af640 1 -- 172.21.15.77:0/299617061 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f00c5bc0 con 0x7ff1f00adac0 2023-11-04T01:43:01.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.670+0000 7ff1f60af640 1 -- 172.21.15.77:0/299617061 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1f014b9a0 con 0x7ff1f00adac0 2023-11-04T01:43:01.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.671+0000 7ff1d7fff640 1 -- 172.21.15.77:0/299617061 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff1e0003990 con 0x7ff1f00adac0 2023-11-04T01:43:01.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.672+0000 7ff1d7fff640 1 --2- 172.21.15.77:0/299617061 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff1dc06aea0 0x7ff1dc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.672+0000 7ff1d7fff640 1 -- 172.21.15.77:0/299617061 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7ff1e00890a0 con 0x7ff1f00adac0 2023-11-04T01:43:01.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.672+0000 7ff1eeffd640 1 --2- 172.21.15.77:0/299617061 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff1dc06aea0 0x7ff1dc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.672+0000 7ff1eeffd640 1 --2- 172.21.15.77:0/299617061 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff1dc06aea0 0x7ff1dc06d360 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff1f015d450 tx=0x7ff1e4008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:01.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.673+0000 7ff1f8c44740 1 Processor -- start 2023-11-04T01:43:01.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.673+0000 7ff1f8c44740 1 -- start start 2023-11-04T01:43:01.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.674+0000 7ff1f8c44740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a46e576850 0x55a46e549750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.674+0000 7ff1f8c44740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46e576c30 0x55a46e5795e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.674+0000 7ff1f8c44740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55a46e549c90 0x55a46e579b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.674+0000 7ff1f8c44740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a46e45a740 con 0x55a46e576c30 2023-11-04T01:43:01.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.674+0000 7ff1f8c44740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a46e4bc8d0 con 0x55a46e576850 2023-11-04T01:43:01.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.674+0000 7ff1f8c44740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a46e4b9fc0 con 0x55a46e549c90 2023-11-04T01:43:01.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.674+0000 7ff1eeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46e576c30 0x55a46e5795e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.674+0000 7ff1eeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46e576c30 0x55a46e5795e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45172/0 (socket says 172.21.15.77:45172) 2023-11-04T01:43:01.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.674+0000 7ff1eeffd640 1 -- 172.21.15.77:0/4081009232 learned_addr learned my addr 172.21.15.77:0/4081009232 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:01.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.674+0000 7ff1ef7fe640 1 --2- 172.21.15.77:0/4081009232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a46e576850 0x55a46e549750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.674+0000 7ff1effff640 1 --2- 172.21.15.77:0/4081009232 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55a46e549c90 0x55a46e579b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.674+0000 7ff1eeffd640 1 -- 172.21.15.77:0/4081009232 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55a46e549c90 msgr2=0x55a46e579b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:01.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.674+0000 7ff1eeffd640 1 --2- 172.21.15.77:0/4081009232 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55a46e549c90 0x55a46e579b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.674+0000 7ff1eeffd640 1 -- 172.21.15.77:0/4081009232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a46e576850 msgr2=0x55a46e549750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:01.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.674+0000 7ff1eeffd640 1 --2- 172.21.15.77:0/4081009232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a46e576850 0x55a46e549750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.674+0000 7ff1eeffd640 1 -- 172.21.15.77:0/4081009232 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a46e478ca0 con 0x55a46e576c30 2023-11-04T01:43:01.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.674+0000 7ff1eeffd640 1 --2- 172.21.15.77:0/4081009232 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46e576c30 0x55a46e5795e0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4010980 tx=0x7ff1e4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce9d3c482f5239c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:01.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.674+0000 7ff1d57fa640 1 -- 172.21.15.77:0/4081009232 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e4025070 con 0x55a46e576c30 2023-11-04T01:43:01.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.674+0000 7ff1d57fa640 1 -- 172.21.15.77:0/4081009232 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e401a070 con 0x55a46e576c30 2023-11-04T01:43:01.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.674+0000 7ff1d57fa640 1 -- 172.21.15.77:0/4081009232 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e4015e00 con 0x55a46e576c30 2023-11-04T01:43:01.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.675+0000 7ff1f8c44740 1 -- 172.21.15.77:0/4081009232 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46e576c30 msgr2=0x55a46e5795e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.675+0000 7ff1f8c44740 1 --2- 172.21.15.77:0/4081009232 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46e576c30 0x55a46e5795e0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4010980 tx=0x7ff1e4013000 comp rx=0 tx=0).stop 2023-11-04T01:43:01.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.675+0000 7ff1f8c44740 1 -- 172.21.15.77:0/4081009232 shutdown_connections 2023-11-04T01:43:01.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.675+0000 7ff1f8c44740 1 --2- 172.21.15.77:0/4081009232 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55a46e549c90 0x55a46e579b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.675+0000 7ff1f8c44740 1 --2- 172.21.15.77:0/4081009232 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46e576c30 0x55a46e5795e0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.675+0000 7ff1f8c44740 1 --2- 172.21.15.77:0/4081009232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a46e576850 0x55a46e549750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.675+0000 7ff1f8c44740 1 -- 172.21.15.77:0/4081009232 >> 172.21.15.77:0/4081009232 conn(0x55a46e54ba60 msgr2=0x55a46e5945e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:01.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.675+0000 7ff1f8c44740 1 -- 172.21.15.77:0/4081009232 shutdown_connections 2023-11-04T01:43:01.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.675+0000 7ff1f8c44740 1 -- 172.21.15.77:0/4081009232 wait complete. 2023-11-04T01:43:01.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.676+0000 7ff1f8c44740 1 -- start start 2023-11-04T01:43:01.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.676+0000 7ff1f8c44740 1 Processor -- start 2023-11-04T01:43:01.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.676+0000 7ff1f8c44740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55a46e576850 0x55a46e564560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.676+0000 7ff1f8c44740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46e576c30 0x55a46e564c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.676+0000 7ff1f8c44740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a46e5484f0 0x55a46e548970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.676+0000 7ff1f8c44740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a46e4b58b0 con 0x55a46e576c30 2023-11-04T01:43:01.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.676+0000 7ff1f8c44740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a46e46fc80 con 0x55a46e5484f0 2023-11-04T01:43:01.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.676+0000 7ff1f8c44740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a46e46f920 con 0x55a46e576850 2023-11-04T01:43:01.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.676+0000 7ff1f8c44740 10 client.0 _ll_register_callbacks cb 0x55a46e1c7ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:43:01.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.676+0000 7ff1eeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46e576c30 0x55a46e564c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.676+0000 7ff1eeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46e576c30 0x55a46e564c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45188/0 (socket says 172.21.15.77:45188) 2023-11-04T01:43:01.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.676+0000 7ff1eeffd640 1 -- 172.21.15.77:0/2774946751 learned_addr learned my addr 172.21.15.77:0/2774946751 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:01.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.676+0000 7ff1ef7fe640 1 --2- 172.21.15.77:0/2774946751 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55a46e576850 0x55a46e564560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.677+0000 7ff1effff640 1 --2- 172.21.15.77:0/2774946751 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a46e5484f0 0x55a46e548970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.677+0000 7ff1eeffd640 1 -- 172.21.15.77:0/2774946751 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55a46e576850 msgr2=0x55a46e564560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:01.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.677+0000 7ff1eeffd640 1 --2- 172.21.15.77:0/2774946751 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55a46e576850 0x55a46e564560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.677+0000 7ff1eeffd640 1 -- 172.21.15.77:0/2774946751 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a46e5484f0 msgr2=0x55a46e548970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:01.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.677+0000 7ff1eeffd640 1 --2- 172.21.15.77:0/2774946751 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a46e5484f0 0x55a46e548970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.677+0000 7ff1eeffd640 1 -- 172.21.15.77:0/2774946751 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e400e050 con 0x55a46e576c30 2023-11-04T01:43:01.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.677+0000 7ff1eeffd640 1 --2- 172.21.15.77:0/2774946751 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46e576c30 0x55a46e564c20 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4022000 tx=0x7ff1e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df5e69abe16bca9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:01.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.677+0000 7ff1ce7fc640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:43:01.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.677+0000 7ff1ce7fc640 1 -- 172.21.15.77:0/2774946751 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e4025040 con 0x55a46e576c30 2023-11-04T01:43:01.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.677+0000 7ff1ce7fc640 1 -- 172.21.15.77:0/2774946751 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7ff1e4003810 con 0x55a46e576c30 2023-11-04T01:43:01.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.677+0000 7ff1f8c44740 1 -- 172.21.15.77:0/2774946751 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a46e461bf0 con 0x55a46e576c30 2023-11-04T01:43:01.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.677+0000 7ff1ce7fc640 1 -- 172.21.15.77:0/2774946751 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1e40039d0 con 0x55a46e576c30 2023-11-04T01:43:01.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.677+0000 7ff1f8c44740 10 client.7032 fetch_fsmap learned FSMap version 35 2023-11-04T01:43:01.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.677+0000 7ff1f8c44740 1 -- 172.21.15.77:0/2774946751 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x55a46e4b3f30 con 0x55a46e576c30 2023-11-04T01:43:01.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.677+0000 7ff1ce7fc640 1 -- 172.21.15.77:0/2774946751 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a46e461bf0 con 0x55a46e576c30 2023-11-04T01:43:01.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.677+0000 7ff1ce7fc640 1 -- 172.21.15.77:0/2774946751 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 35) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff1e4003b30 con 0x55a46e576c30 2023-11-04T01:43:01.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.677+0000 7ff1f8c44740 10 client.7032 fetch_fsmap finished waiting for FSMap version 35 2023-11-04T01:43:01.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.677+0000 7ff1f8c44740 10 client.7032 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:43:01.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.677+0000 7ff1f8c44740 20 client.7032 populate_metadata read hostname 'smithi077' 2023-11-04T01:43:01.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.677+0000 7ff1f8c44740 1 --2- 172.21.15.77:0/2774946751 >> [v2:172.21.15.122:6835/1536301485,v1:172.21.15.122:6837/1536301485] conn(0x55a46e58c6e0 0x55a46e58cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.677+0000 7ff1f8c44740 4 client.7032 mds_command: new command op to 35495 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:43:01.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.677+0000 7ff1f8c44740 1 -- 172.21.15.77:0/2774946751 --> [v2:172.21.15.122:6835/1536301485,v1:172.21.15.122:6837/1536301485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a46e4ae890 con 0x55a46e58c6e0 2023-11-04T01:43:01.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.678+0000 7ff1ef7fe640 1 --2- 172.21.15.77:0/2774946751 >> [v2:172.21.15.122:6835/1536301485,v1:172.21.15.122:6837/1536301485] conn(0x55a46e58c6e0 0x55a46e58cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.678+0000 7ff1ef7fe640 1 --2- 172.21.15.77:0/2774946751 >> [v2:172.21.15.122:6835/1536301485,v1:172.21.15.122:6837/1536301485] conn(0x55a46e58c6e0 0x55a46e58cac0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5de16c547d99f4d2 server_cookie=40f3aaa0f6c0bd1d in_seq=0 out_seq=0 2023-11-04T01:43:01.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.678+0000 7ff1ce7fc640 10 client.7032 ms_handle_connect on v2:172.21.15.122:6835/1536301485 2023-11-04T01:43:01.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.679+0000 7ff1ce7fc640 1 -- 172.21.15.77:0/2774946751 <== mds.0 v2:172.21.15.122:6835/1536301485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a46e4ae890 con 0x55a46e58c6e0 2023-11-04T01:43:01.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.679+0000 7ff1ce7fc640 10 client.7032 handle_command_reply: tid=0 2023-11-04T01:43:01.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.679+0000 7ff1f8c44740 1 client.7032 shutdown 2023-11-04T01:43:01.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.679+0000 7ff1f8c44740 1 -- 172.21.15.77:0/2774946751 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46e576c30 msgr2=0x55a46e564c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.679+0000 7ff1f8c44740 1 --2- 172.21.15.77:0/2774946751 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46e576c30 0x55a46e564c20 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4022000 tx=0x7ff1e40046c0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.679+0000 7ff1f8c44740 1 -- 172.21.15.77:0/2774946751 shutdown_connections 2023-11-04T01:43:01.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.679+0000 7ff1f8c44740 1 --2- 172.21.15.77:0/2774946751 >> [v2:172.21.15.122:6835/1536301485,v1:172.21.15.122:6837/1536301485] conn(0x55a46e58c6e0 0x55a46e58cac0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.679+0000 7ff1f8c44740 1 --2- 172.21.15.77:0/2774946751 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a46e5484f0 0x55a46e548970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.679+0000 7ff1f8c44740 1 --2- 172.21.15.77:0/2774946751 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46e576c30 0x55a46e564c20 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.679+0000 7ff1f8c44740 1 --2- 172.21.15.77:0/2774946751 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55a46e576850 0x55a46e564560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.679+0000 7ff1ce7fc640 0 client.7032 ms_handle_reset on v2:172.21.15.122:6835/1536301485 2023-11-04T01:43:01.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.679+0000 7ff1f8c44740 1 -- 172.21.15.77:0/2774946751 >> 172.21.15.77:0/2774946751 conn(0x55a46e549c90 msgr2=0x55a46e598380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:01.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.679+0000 7ff1f8c44740 1 -- 172.21.15.77:0/2774946751 shutdown_connections 2023-11-04T01:43:01.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.679+0000 7ff1f8c44740 1 -- 172.21.15.77:0/2774946751 wait complete. 2023-11-04T01:43:01.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.679+0000 7ff1f8c44740 20 client.7032 trim_cache size 0 max 16384 2023-11-04T01:43:01.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.694+0000 7ff1f8c44740 1 Processor -- start 2023-11-04T01:43:01.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.694+0000 7ff1f8c44740 1 -- start start 2023-11-04T01:43:01.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.695+0000 7ff1f8c44740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46e5484f0 0x55a46e579790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.695+0000 7ff1f8c44740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55a46e576850 0x55a46e5fa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.695+0000 7ff1f8c44740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a46e576c30 0x55a46e5fabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.695+0000 7ff1f8c44740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a46e435280 con 0x55a46e5484f0 2023-11-04T01:43:01.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.695+0000 7ff1f8c44740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a46e5fb130 con 0x55a46e576c30 2023-11-04T01:43:01.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.695+0000 7ff1f8c44740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a46e58d600 con 0x55a46e576850 2023-11-04T01:43:01.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.695+0000 7ff1ef7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46e5484f0 0x55a46e579790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.695+0000 7ff1ef7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46e5484f0 0x55a46e579790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45204/0 (socket says 172.21.15.77:45204) 2023-11-04T01:43:01.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.695+0000 7ff1ef7fe640 1 -- 172.21.15.77:0/1184889350 learned_addr learned my addr 172.21.15.77:0/1184889350 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:01.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.696+0000 7ff1ef7fe640 1 -- 172.21.15.77:0/1184889350 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55a46e576850 msgr2=0x55a46e5fa6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:01.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.696+0000 7ff1ef7fe640 1 --2- 172.21.15.77:0/1184889350 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55a46e576850 0x55a46e5fa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.696+0000 7ff1ef7fe640 1 -- 172.21.15.77:0/1184889350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a46e576c30 msgr2=0x55a46e5fabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:01.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.696+0000 7ff1ef7fe640 1 --2- 172.21.15.77:0/1184889350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a46e576c30 0x55a46e5fabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.696+0000 7ff1ef7fe640 1 -- 172.21.15.77:0/1184889350 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a46e451d10 con 0x55a46e5484f0 2023-11-04T01:43:01.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.696+0000 7ff1ef7fe640 1 --2- 172.21.15.77:0/1184889350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46e5484f0 0x55a46e579790 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0087060 tx=0x7ff1e0014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca9479b70937342f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:01.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.696+0000 7ff1d5ffb640 1 -- 172.21.15.77:0/1184889350 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e00559e0 con 0x55a46e5484f0 2023-11-04T01:43:01.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.696+0000 7ff1d5ffb640 1 -- 172.21.15.77:0/1184889350 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e006f100 con 0x55a46e5484f0 2023-11-04T01:43:01.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.696+0000 7ff1d5ffb640 1 -- 172.21.15.77:0/1184889350 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0053fb0 con 0x55a46e5484f0 2023-11-04T01:43:01.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.696+0000 7ff1f8c44740 1 -- 172.21.15.77:0/1184889350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46e5484f0 msgr2=0x55a46e579790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.696+0000 7ff1f8c44740 1 --2- 172.21.15.77:0/1184889350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46e5484f0 0x55a46e579790 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0087060 tx=0x7ff1e0014040 comp rx=0 tx=0).stop 2023-11-04T01:43:01.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.697+0000 7ff1f8c44740 1 -- 172.21.15.77:0/1184889350 shutdown_connections 2023-11-04T01:43:01.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.697+0000 7ff1f8c44740 1 --2- 172.21.15.77:0/1184889350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a46e576c30 0x55a46e5fabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.697+0000 7ff1f8c44740 1 --2- 172.21.15.77:0/1184889350 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55a46e576850 0x55a46e5fa6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.697+0000 7ff1f8c44740 1 --2- 172.21.15.77:0/1184889350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46e5484f0 0x55a46e579790 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.697+0000 7ff1f8c44740 1 -- 172.21.15.77:0/1184889350 >> 172.21.15.77:0/1184889350 conn(0x55a46e549c90 msgr2=0x55a46e58ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:01.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.697+0000 7ff1f8c44740 1 -- 172.21.15.77:0/1184889350 shutdown_connections 2023-11-04T01:43:01.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.697+0000 7ff1f8c44740 1 -- 172.21.15.77:0/1184889350 wait complete. 2023-11-04T01:43:01.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.697+0000 7ff1f8c44740 1 -- start start 2023-11-04T01:43:01.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.697+0000 7ff1f8c44740 1 Processor -- start 2023-11-04T01:43:01.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.698+0000 7ff1f8c44740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55a46e5484f0 0x55a46e5fa360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.698+0000 7ff1f8c44740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46e576850 0x55a46e5fa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.698+0000 7ff1f8c44740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a46e576c30 0x55a46e58b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.698+0000 7ff1f8c44740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a46e5f8120 con 0x55a46e576850 2023-11-04T01:43:01.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.698+0000 7ff1f8c44740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a46e58dfa0 con 0x55a46e576c30 2023-11-04T01:43:01.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.698+0000 7ff1f8c44740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a46e564820 con 0x55a46e5484f0 2023-11-04T01:43:01.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.698+0000 7ff1f8c44740 10 client.0 _ll_register_callbacks cb 0x7ff1e4009680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:43:01.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.698+0000 7ff1eeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46e576850 0x55a46e5fa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.698+0000 7ff1eeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46e576850 0x55a46e5fa8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45208/0 (socket says 172.21.15.77:45208) 2023-11-04T01:43:01.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.698+0000 7ff1eeffd640 1 -- 172.21.15.77:0/4240774874 learned_addr learned my addr 172.21.15.77:0/4240774874 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:01.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.698+0000 7ff1ef7fe640 1 --2- 172.21.15.77:0/4240774874 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55a46e5484f0 0x55a46e5fa360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.698+0000 7ff1effff640 1 --2- 172.21.15.77:0/4240774874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a46e576c30 0x55a46e58b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.698+0000 7ff1eeffd640 1 -- 172.21.15.77:0/4240774874 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55a46e5484f0 msgr2=0x55a46e5fa360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:01.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.698+0000 7ff1eeffd640 1 --2- 172.21.15.77:0/4240774874 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55a46e5484f0 0x55a46e5fa360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.698+0000 7ff1eeffd640 1 -- 172.21.15.77:0/4240774874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a46e576c30 msgr2=0x55a46e58b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:01.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.698+0000 7ff1eeffd640 1 --2- 172.21.15.77:0/4240774874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a46e576c30 0x55a46e58b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.698+0000 7ff1eeffd640 1 -- 172.21.15.77:0/4240774874 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1f014b9a0 con 0x55a46e576850 2023-11-04T01:43:01.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.698+0000 7ff1effff640 1 --2- 172.21.15.77:0/4240774874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a46e576c30 0x55a46e58b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:01.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.698+0000 7ff1eeffd640 1 --2- 172.21.15.77:0/4240774874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46e576850 0x55a46e5fa8a0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7ff1e403b040 tx=0x7ff1e4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ab2607a3ef05903 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:01.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.698+0000 7ff1ce7fc640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:43:01.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.699+0000 7ff1ce7fc640 1 -- 172.21.15.77:0/4240774874 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e4025030 con 0x55a46e576850 2023-11-04T01:43:01.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.699+0000 7ff1ce7fc640 1 -- 172.21.15.77:0/4240774874 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7ff1e4006d70 con 0x55a46e576850 2023-11-04T01:43:01.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.699+0000 7ff1f8c44740 1 -- 172.21.15.77:0/4240774874 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff1e401a070 con 0x55a46e576850 2023-11-04T01:43:01.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.699+0000 7ff1ce7fc640 1 -- 172.21.15.77:0/4240774874 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1e4004250 con 0x55a46e576850 2023-11-04T01:43:01.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.699+0000 7ff1f8c44740 10 client.7038 fetch_fsmap learned FSMap version 35 2023-11-04T01:43:01.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.699+0000 7ff1f8c44740 1 -- 172.21.15.77:0/4240774874 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x55a46e477500 con 0x55a46e576850 2023-11-04T01:43:01.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.699+0000 7ff1ce7fc640 1 -- 172.21.15.77:0/4240774874 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e401a070 con 0x55a46e576850 2023-11-04T01:43:01.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.699+0000 7ff1ce7fc640 1 -- 172.21.15.77:0/4240774874 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 35) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff1e402b650 con 0x55a46e576850 2023-11-04T01:43:01.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.699+0000 7ff1f8c44740 10 client.7038 fetch_fsmap finished waiting for FSMap version 35 2023-11-04T01:43:01.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.699+0000 7ff1f8c44740 10 client.7038 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:43:01.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.699+0000 7ff1f8c44740 20 client.7038 populate_metadata read hostname 'smithi077' 2023-11-04T01:43:01.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.699+0000 7ff1f8c44740 1 --2- 172.21.15.77:0/4240774874 >> [v2:172.21.15.122:6835/1536301485,v1:172.21.15.122:6837/1536301485] conn(0x55a46e594ec0 0x55a46e58be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.699+0000 7ff1f8c44740 4 client.7038 mds_command: new command op to 35495 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:43:01.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.699+0000 7ff1f8c44740 1 -- 172.21.15.77:0/4240774874 --> [v2:172.21.15.122:6835/1536301485,v1:172.21.15.122:6837/1536301485] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a46e4ae5b0 con 0x55a46e594ec0 2023-11-04T01:43:01.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.699+0000 7ff1ef7fe640 1 --2- 172.21.15.77:0/4240774874 >> [v2:172.21.15.122:6835/1536301485,v1:172.21.15.122:6837/1536301485] conn(0x55a46e594ec0 0x55a46e58be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.700+0000 7ff1ef7fe640 1 --2- 172.21.15.77:0/4240774874 >> [v2:172.21.15.122:6835/1536301485,v1:172.21.15.122:6837/1536301485] conn(0x55a46e594ec0 0x55a46e58be10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e592bc3e72c5370 server_cookie=e06e45c54d97b24a in_seq=0 out_seq=0 2023-11-04T01:43:01.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.700+0000 7ff1ce7fc640 10 client.7038 ms_handle_connect on v2:172.21.15.122:6835/1536301485 2023-11-04T01:43:01.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.700+0000 7ff1ce7fc640 1 -- 172.21.15.77:0/4240774874 <== mds.0 v2:172.21.15.122:6835/1536301485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55a46e4ae5b0 con 0x55a46e594ec0 2023-11-04T01:43:01.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.700+0000 7ff1ce7fc640 10 client.7038 handle_command_reply: tid=0 2023-11-04T01:43:01.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.700+0000 7ff1f8c44740 1 client.7038 shutdown 2023-11-04T01:43:01.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.700+0000 7ff1f8c44740 1 -- 172.21.15.77:0/4240774874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46e576850 msgr2=0x55a46e5fa8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.700+0000 7ff1f8c44740 1 --2- 172.21.15.77:0/4240774874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46e576850 0x55a46e5fa8a0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7ff1e403b040 tx=0x7ff1e4016000 comp rx=0 tx=0).stop 2023-11-04T01:43:01.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.700+0000 7ff1f8c44740 1 -- 172.21.15.77:0/4240774874 shutdown_connections 2023-11-04T01:43:01.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.700+0000 7ff1f8c44740 1 --2- 172.21.15.77:0/4240774874 >> [v2:172.21.15.122:6835/1536301485,v1:172.21.15.122:6837/1536301485] conn(0x55a46e594ec0 0x55a46e58be10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.700+0000 7ff1f8c44740 1 --2- 172.21.15.77:0/4240774874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a46e576c30 0x55a46e58b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.700+0000 7ff1f8c44740 1 --2- 172.21.15.77:0/4240774874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46e576850 0x55a46e5fa8a0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.700+0000 7ff1ce7fc640 0 client.7038 ms_handle_reset on v2:172.21.15.122:6835/1536301485 2023-11-04T01:43:01.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.700+0000 7ff1f8c44740 1 --2- 172.21.15.77:0/4240774874 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55a46e5484f0 0x55a46e5fa360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.700+0000 7ff1f8c44740 1 -- 172.21.15.77:0/4240774874 >> 172.21.15.77:0/4240774874 conn(0x55a46e549c90 msgr2=0x55a46e5488d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:01.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.700+0000 7ff1f8c44740 1 -- 172.21.15.77:0/4240774874 shutdown_connections 2023-11-04T01:43:01.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.700+0000 7ff1f8c44740 1 -- 172.21.15.77:0/4240774874 wait complete. 2023-11-04T01:43:01.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.700+0000 7ff1f8c44740 20 client.7038 trim_cache size 0 max 16384 2023-11-04T01:43:01.727 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-04T01:43:01.728 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "0c22c75d-0169-41ef-b663-6ac1c5b0f71f", 2023-11-04T01:43:01.728 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 0, 2023-11-04T01:43:01.728 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 35495, 2023-11-04T01:43:01.728 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2023-11-04T01:43:01.728 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2023-11-04T01:43:01.729 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2023-11-04T01:43:01.729 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 4.6059489559999998, 2023-11-04T01:43:01.729 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 35, 2023-11-04T01:43:01.729 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 83, 2023-11-04T01:43:01.729 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 83, 2023-11-04T01:43:01.730 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 10.670413827999999 2023-11-04T01:43:01.730 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-04T01:43:01.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.700+0000 7ff1f60af640 1 -- 172.21.15.77:0/299617061 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff1dc06aea0 msgr2=0x7ff1dc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.700+0000 7ff1f60af640 1 --2- 172.21.15.77:0/299617061 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff1dc06aea0 0x7ff1dc06d360 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff1f015d450 tx=0x7ff1e4008040 comp rx=0 tx=0).stop 2023-11-04T01:43:01.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.700+0000 7ff1f60af640 1 -- 172.21.15.77:0/299617061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1f00adac0 msgr2=0x7ff1f0137400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.700+0000 7ff1f60af640 1 --2- 172.21.15.77:0/299617061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1f00adac0 0x7ff1f0137400 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7ff1e000c400 tx=0x7ff1e000c8c0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.700+0000 7ff1f60af640 1 -- 172.21.15.77:0/299617061 shutdown_connections 2023-11-04T01:43:01.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.700+0000 7ff1f60af640 1 --2- 172.21.15.77:0/299617061 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff1dc06aea0 0x7ff1dc06d360 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.700+0000 7ff1f60af640 1 --2- 172.21.15.77:0/299617061 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1f0159c00 0x7ff1f006cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.700+0000 7ff1f60af640 1 --2- 172.21.15.77:0/299617061 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff1f00c4ff0 0x7ff1f006c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.700+0000 7ff1f60af640 1 --2- 172.21.15.77:0/299617061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1f00adac0 0x7ff1f0137400 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.700+0000 7ff1f60af640 1 -- 172.21.15.77:0/299617061 >> 172.21.15.77:0/299617061 conn(0x7ff1f00ce950 msgr2=0x7ff1f006dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:01.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.701+0000 7ff1f60af640 1 -- 172.21.15.77:0/299617061 shutdown_connections 2023-11-04T01:43:01.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.701+0000 7ff1f60af640 1 -- 172.21.15.77:0/299617061 wait complete. 2023-11-04T01:43:01.734 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:43:01.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.833+0000 7fce86eaf640 1 Processor -- start 2023-11-04T01:43:01.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.833+0000 7fce86eaf640 1 -- start start 2023-11-04T01:43:01.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.834+0000 7fce86eaf640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fce800b0ae0 0x7fce800ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.834+0000 7fce86eaf640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fce8006db20 0x7fce8015d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.834+0000 7fce86eaf640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce800b4110 con 0x7fce80159c70 2023-11-04T01:43:01.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.834+0000 7fce86eaf640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce800b49b0 con 0x7fce800b0ae0 2023-11-04T01:43:01.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.834+0000 7fce86eaf640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce800b43f0 con 0x7fce8006db20 2023-11-04T01:43:01.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.834+0000 7fce7ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fce800b0ae0 0x7fce800ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.834+0000 7fce7ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fce800b0ae0 0x7fce800ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45224/0 (socket says 172.21.15.77:45224) 2023-11-04T01:43:01.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.834+0000 7fce7ffff640 1 -- 172.21.15.77:0/3217526304 learned_addr learned my addr 172.21.15.77:0/3217526304 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:01.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.834+0000 7fce8544c640 1 --2- 172.21.15.77:0/3217526304 >> v2:172.21.15.122:3300/0 conn(0x7fce8006db20 0x7fce8015d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.834+0000 7fce7ffff640 1 -- 172.21.15.77:0/3217526304 >> v2:172.21.15.122:3300/0 conn(0x7fce8006db20 msgr2=0x7fce8015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:01.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.834+0000 7fce7ffff640 1 --2- 172.21.15.77:0/3217526304 >> v2:172.21.15.122:3300/0 conn(0x7fce8006db20 0x7fce8015d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.834+0000 7fce7ffff640 1 -- 172.21.15.77:0/3217526304 >> v1:172.21.15.122:6789/0 conn(0x7fce80159c70 legacy=0x7fce800b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:01.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.834+0000 7fce7ffff640 1 -- 172.21.15.77:0/3217526304 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce800b46d0 con 0x7fce800b0ae0 2023-11-04T01:43:01.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.835+0000 7fce7ffff640 1 --2- 172.21.15.77:0/3217526304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce800b0ae0 0x7fce800ce370 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fce80070580 tx=0x7fce6c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e939486d3aa277df server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:01.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.835+0000 7fce7f7fe640 1 -- 172.21.15.77:0/3217526304 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c031870 con 0x7fce800b0ae0 2023-11-04T01:43:01.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.835+0000 7fce7f7fe640 1 -- 172.21.15.77:0/3217526304 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6c0319d0 con 0x7fce800b0ae0 2023-11-04T01:43:01.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.835+0000 7fce7f7fe640 1 -- 172.21.15.77:0/3217526304 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c031d60 con 0x7fce800b0ae0 2023-11-04T01:43:01.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.835+0000 7fce86eaf640 1 -- 172.21.15.77:0/3217526304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce800b0ae0 msgr2=0x7fce800ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.835+0000 7fce86eaf640 1 --2- 172.21.15.77:0/3217526304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce800b0ae0 0x7fce800ce370 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fce80070580 tx=0x7fce6c02b910 comp rx=0 tx=0).stop 2023-11-04T01:43:01.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.835+0000 7fce86eaf640 1 -- 172.21.15.77:0/3217526304 shutdown_connections 2023-11-04T01:43:01.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.835+0000 7fce86eaf640 1 --2- 172.21.15.77:0/3217526304 >> v2:172.21.15.122:3300/0 conn(0x7fce8006db20 0x7fce8015d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.835+0000 7fce86eaf640 1 --2- 172.21.15.77:0/3217526304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce800b0ae0 0x7fce800ce370 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.835+0000 7fce86eaf640 1 -- 172.21.15.77:0/3217526304 >> 172.21.15.77:0/3217526304 conn(0x7fce800ce950 msgr2=0x7fce800ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:01.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.835+0000 7fce86eaf640 1 -- 172.21.15.77:0/3217526304 shutdown_connections 2023-11-04T01:43:01.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.835+0000 7fce86eaf640 1 -- 172.21.15.77:0/3217526304 wait complete. 2023-11-04T01:43:01.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.837+0000 7fce86eaf640 1 Processor -- start 2023-11-04T01:43:01.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.837+0000 7fce86eaf640 1 -- start start 2023-11-04T01:43:01.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.837+0000 7fce86eaf640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce8006db20 0x7fce800b0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.837+0000 7fce86eaf640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fce800b0ae0 0x7fce80154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.837+0000 7fce86eaf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce80159c70 0x7fce800c4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.837+0000 7fce86eaf640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce80158150 con 0x7fce80159c70 2023-11-04T01:43:01.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.837+0000 7fce86eaf640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce80158430 con 0x7fce8006db20 2023-11-04T01:43:01.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.837+0000 7fce86eaf640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce80158710 con 0x7fce800b0ae0 2023-11-04T01:43:01.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.838+0000 7fce8544c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce80159c70 0x7fce800c4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.838+0000 7fce8544c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce80159c70 0x7fce800c4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45236/0 (socket says 172.21.15.77:45236) 2023-11-04T01:43:01.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.838+0000 7fce8544c640 1 -- 172.21.15.77:0/3062364888 learned_addr learned my addr 172.21.15.77:0/3062364888 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:01.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.838+0000 7fce7ffff640 1 --2- 172.21.15.77:0/3062364888 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fce800b0ae0 0x7fce80154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.838+0000 7fce84c4b640 1 --2- 172.21.15.77:0/3062364888 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce8006db20 0x7fce800b0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.838+0000 7fce8544c640 1 -- 172.21.15.77:0/3062364888 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fce800b0ae0 msgr2=0x7fce80154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.838+0000 7fce8544c640 1 --2- 172.21.15.77:0/3062364888 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fce800b0ae0 0x7fce80154e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.838+0000 7fce8544c640 1 -- 172.21.15.77:0/3062364888 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce8006db20 msgr2=0x7fce800b0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.838+0000 7fce8544c640 1 --2- 172.21.15.77:0/3062364888 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce8006db20 0x7fce800b0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.838+0000 7fce8544c640 1 -- 172.21.15.77:0/3062364888 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6c0094d0 con 0x7fce80159c70 2023-11-04T01:43:01.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.838+0000 7fce84c4b640 1 --2- 172.21.15.77:0/3062364888 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce8006db20 0x7fce800b0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:01.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.838+0000 7fce8544c640 1 --2- 172.21.15.77:0/3062364888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce80159c70 0x7fce800c4320 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fce78007e40 tx=0x7fce7800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:01.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.838+0000 7fce7d7fa640 1 -- 172.21.15.77:0/3062364888 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce78014620 con 0x7fce80159c70 2023-11-04T01:43:01.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.838+0000 7fce7d7fa640 1 -- 172.21.15.77:0/3062364888 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7800ee90 con 0x7fce80159c70 2023-11-04T01:43:01.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.838+0000 7fce86eaf640 1 -- 172.21.15.77:0/3062364888 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce801589f0 con 0x7fce80159c70 2023-11-04T01:43:01.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.838+0000 7fce7d7fa640 1 -- 172.21.15.77:0/3062364888 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce780149e0 con 0x7fce80159c70 2023-11-04T01:43:01.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.838+0000 7fce86eaf640 1 -- 172.21.15.77:0/3062364888 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce80155350 con 0x7fce80159c70 2023-11-04T01:43:01.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.839+0000 7fce86eaf640 1 -- 172.21.15.77:0/3062364888 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce80074290 con 0x7fce80159c70 2023-11-04T01:43:01.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.840+0000 7fce7d7fa640 1 -- 172.21.15.77:0/3062364888 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fce78014b40 con 0x7fce80159c70 2023-11-04T01:43:01.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.840+0000 7fce7d7fa640 1 --2- 172.21.15.77:0/3062364888 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fce6406ae70 0x7fce6406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.840+0000 7fce7d7fa640 1 -- 172.21.15.77:0/3062364888 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fce7808a4d0 con 0x7fce80159c70 2023-11-04T01:43:01.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.840+0000 7fce84c4b640 1 --2- 172.21.15.77:0/3062364888 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fce6406ae70 0x7fce6406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.841+0000 7fce84c4b640 1 --2- 172.21.15.77:0/3062364888 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fce6406ae70 0x7fce6406d330 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fce74006fd0 tx=0x7fce74008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:01.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:01.844+0000 7fce7d7fa640 1 -- 172.21.15.77:0/3062364888 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fce78055010 con 0x7fce80159c70 2023-11-04T01:43:02.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:02.045+0000 7fce86eaf640 1 -- 172.21.15.77:0/3062364888 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fce8006d3f0 con 0x7fce80159c70 2023-11-04T01:43:02.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:02.045+0000 7fce7d7fa640 1 -- 172.21.15.77:0/3062364888 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) v1 ==== 53+0+73 (secure 0 0 0) 0x7fce78058630 con 0x7fce80159c70 2023-11-04T01:43:02.047 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:43:02.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:02.047+0000 7fce86eaf640 1 -- 172.21.15.77:0/3062364888 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fce6406ae70 msgr2=0x7fce6406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:02.047+0000 7fce86eaf640 1 --2- 172.21.15.77:0/3062364888 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fce6406ae70 0x7fce6406d330 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fce74006fd0 tx=0x7fce74008040 comp rx=0 tx=0).stop 2023-11-04T01:43:02.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:02.047+0000 7fce86eaf640 1 -- 172.21.15.77:0/3062364888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce80159c70 msgr2=0x7fce800c4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:02.047+0000 7fce86eaf640 1 --2- 172.21.15.77:0/3062364888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce80159c70 0x7fce800c4320 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fce78007e40 tx=0x7fce7800e4b0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:02.047+0000 7fce86eaf640 1 -- 172.21.15.77:0/3062364888 shutdown_connections 2023-11-04T01:43:02.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:02.047+0000 7fce86eaf640 1 --2- 172.21.15.77:0/3062364888 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fce6406ae70 0x7fce6406d330 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:02.047+0000 7fce86eaf640 1 --2- 172.21.15.77:0/3062364888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce80159c70 0x7fce800c4320 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:02.047+0000 7fce86eaf640 1 --2- 172.21.15.77:0/3062364888 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fce800b0ae0 0x7fce80154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:02.047+0000 7fce86eaf640 1 --2- 172.21.15.77:0/3062364888 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce8006db20 0x7fce800b0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:02.047+0000 7fce86eaf640 1 -- 172.21.15.77:0/3062364888 >> 172.21.15.77:0/3062364888 conn(0x7fce800ce950 msgr2=0x7fce80070630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:02.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:02.047+0000 7fce86eaf640 1 -- 172.21.15.77:0/3062364888 shutdown_connections 2023-11-04T01:43:02.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:02.047+0000 7fce86eaf640 1 -- 172.21.15.77:0/3062364888 wait complete. 2023-11-04T01:43:02.059 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:43:02.060 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:43:02.060 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2023-11-04T01:43:02.060 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:43:02.061 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:02.061 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:43:02.061 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:43:02.062 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:43:02.062 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:43:02.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:02.063 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2023-11-04T01:43:02.078 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:43:02.078 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:43:02.078 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:43:02.079 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:02.079 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2023-11-04T01:43:02.079 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:02.079 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:43:02.080 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:02.080 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f0 2023-11-04T01:43:02.080 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:43:02.080 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:02.080 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f1 2023-11-04T01:43:02.081 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:43:02.081 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:02.081 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:43:02.081 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:02.081 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:43:02.082 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 42224sec preferred_lft 42224sec 2023-11-04T01:43:02.082 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::ec4:7aff:fe8f:d3d3/64 scope link 2023-11-04T01:43:02.082 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:02.082 INFO:teuthology.orchestra.run.smithi077.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:43:02.082 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 06:3a:02:11:c4:57 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:02.083 INFO:teuthology.orchestra.run.smithi077.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:43:02.083 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:02.083 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::8039:1aff:fee2:109f/64 scope link 2023-11-04T01:43:02.083 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:02.083 INFO:teuthology.orchestra.run.smithi077.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:43:02.083 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 06:3a:02:11:c4:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:02.084 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::43a:2ff:fe11:c457/64 scope link 2023-11-04T01:43:02.084 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:02.084 INFO:teuthology.orchestra.run.smithi077.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:43:02.084 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether c2:4f:2a:69:4f:38 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:02.084 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::c04f:2aff:fe69:4f38/64 scope link 2023-11-04T01:43:02.085 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:02.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:02.086 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:43:02.143 INFO:teuthology.orchestra.run.smithi077.stdout:1 2023-11-04T01:43:02.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:02.145 DEBUG:teuthology.orchestra.run.smithi077:> route 2023-11-04T01:43:02.201 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2023-11-04T01:43:02.201 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:43:02.201 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:43:02.202 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:43:02.202 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:43:02.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:02.203 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-11-04T01:43:02.203 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-11-04T01:43:02.204 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:43:02.204 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:43:02.204 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:43:02.205 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-11-04T01:43:02.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:02.297 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2023-11-04T01:43:02.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:43:02.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:43:02.312 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:43:02.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:02.313 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 up 2023-11-04T01:43:02.379 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:43:02.379 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:43:02.380 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:02.434 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:43:02.435 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:43:02.436 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:02.488 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:43:02.543 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2023-11-04T01:43:02.543 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2023-11-04T01:43:02.544 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2023-11-04T01:43:02.544 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2023-11-04T01:43:02.544 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2023-11-04T01:43:02.544 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2023-11-04T01:43:02.544 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2023-11-04T01:43:02.544 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2023-11-04T01:43:02.545 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2023-11-04T01:43:02.545 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2023-11-04T01:43:02.545 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2023-11-04T01:43:02.545 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2023-11-04T01:43:02.545 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:43:02.546 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2023-11-04T01:43:02.546 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2023-11-04T01:43:02.546 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2023-11-04T01:43:02.546 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2023-11-04T01:43:02.547 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2023-11-04T01:43:02.547 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2023-11-04T01:43:02.547 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:43:02.547 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:43:02.547 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:43:02.548 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:43:02.548 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2023-11-04T01:43:02.548 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2023-11-04T01:43:02.548 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:43:02.548 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:43:02.549 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:43:02.549 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:43:02.549 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2023-11-04T01:43:02.549 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:02.549 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:02.550 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:02.550 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:02.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:02.551 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-11-04T01:43:02.597 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:43:02.598 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:43:02.639 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:43:02.654 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2023-11-04T01:43:02.655 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2023-11-04T01:43:02.655 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2023-11-04T01:43:02.655 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2023-11-04T01:43:02.655 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2023-11-04T01:43:02.655 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2023-11-04T01:43:02.656 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2023-11-04T01:43:02.656 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2023-11-04T01:43:02.656 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2023-11-04T01:43:02.656 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2023-11-04T01:43:02.656 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2023-11-04T01:43:02.657 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2023-11-04T01:43:02.657 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:43:02.657 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2023-11-04T01:43:02.657 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2023-11-04T01:43:02.657 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2023-11-04T01:43:02.658 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2023-11-04T01:43:02.658 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2023-11-04T01:43:02.658 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2023-11-04T01:43:02.658 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:43:02.658 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:43:02.659 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:43:02.659 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:43:02.659 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2023-11-04T01:43:02.659 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2023-11-04T01:43:02.659 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:43:02.660 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:43:02.660 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:43:02.660 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:43:02.660 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2023-11-04T01:43:02.660 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:02.660 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:02.661 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:02.661 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:02.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:02.662 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-11-04T01:43:02.728 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:2023-11-04T01:43:02.727+0000 7f7a24834480 -1 init, newargv = 0x55c357c6d920 newargc=15 2023-11-04T01:43:02.729 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[144662]: starting ceph client 2023-11-04T01:43:02.733 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[144662]: starting fuse 2023-11-04T01:43:03.811 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:43:03.876 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2023-11-04T01:43:03.876 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2023-11-04T01:43:03.876 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2023-11-04T01:43:03.876 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2023-11-04T01:43:03.877 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2023-11-04T01:43:03.877 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2023-11-04T01:43:03.877 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2023-11-04T01:43:03.877 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2023-11-04T01:43:03.877 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2023-11-04T01:43:03.878 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2023-11-04T01:43:03.878 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2023-11-04T01:43:03.878 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2023-11-04T01:43:03.878 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:43:03.878 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2023-11-04T01:43:03.878 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2023-11-04T01:43:03.879 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2023-11-04T01:43:03.879 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2023-11-04T01:43:03.879 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2023-11-04T01:43:03.879 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2023-11-04T01:43:03.879 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:43:03.880 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:43:03.880 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:43:03.880 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:43:03.880 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2023-11-04T01:43:03.880 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2023-11-04T01:43:03.880 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:43:03.881 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:43:03.881 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:43:03.881 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:43:03.881 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2023-11-04T01:43:03.881 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:03.882 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:03.882 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:03.882 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:03.882 INFO:teuthology.orchestra.run.smithi077.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:03.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:03.883 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-11-04T01:43:03.940 INFO:teuthology.orchestra.run.smithi077.stdout:42 2023-11-04T01:43:03.940 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-11-04T01:43:03.941 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:43:03.941 DEBUG:teuthology.orchestra.run.smithi077:> import glob 2023-11-04T01:43:03.942 DEBUG:teuthology.orchestra.run.smithi077:> import re 2023-11-04T01:43:03.942 DEBUG:teuthology.orchestra.run.smithi077:> import os 2023-11-04T01:43:03.942 DEBUG:teuthology.orchestra.run.smithi077:> import subprocess 2023-11-04T01:43:03.943 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:43:03.943 DEBUG:teuthology.orchestra.run.smithi077:> def _find_admin_socket(client_name): 2023-11-04T01:43:03.943 DEBUG:teuthology.orchestra.run.smithi077:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:43:03.944 DEBUG:teuthology.orchestra.run.smithi077:> files = glob.glob(asok_path) 2023-11-04T01:43:03.944 DEBUG:teuthology.orchestra.run.smithi077:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:43:03.945 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:43:03.945 DEBUG:teuthology.orchestra.run.smithi077:> # Given a non-glob path, it better be there 2023-11-04T01:43:03.945 DEBUG:teuthology.orchestra.run.smithi077:> if "*" not in asok_path: 2023-11-04T01:43:03.946 DEBUG:teuthology.orchestra.run.smithi077:> assert(len(files) == 1) 2023-11-04T01:43:03.946 DEBUG:teuthology.orchestra.run.smithi077:> return files[0] 2023-11-04T01:43:03.946 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:43:03.947 DEBUG:teuthology.orchestra.run.smithi077:> for f in files: 2023-11-04T01:43:03.947 DEBUG:teuthology.orchestra.run.smithi077:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:43:03.947 DEBUG:teuthology.orchestra.run.smithi077:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:43:03.948 DEBUG:teuthology.orchestra.run.smithi077:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:43:03.948 DEBUG:teuthology.orchestra.run.smithi077:> contents = proc_f.read() 2023-11-04T01:43:03.949 DEBUG:teuthology.orchestra.run.smithi077:> if mountpoint in contents: 2023-11-04T01:43:03.949 DEBUG:teuthology.orchestra.run.smithi077:> return f 2023-11-04T01:43:03.949 DEBUG:teuthology.orchestra.run.smithi077:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:43:03.950 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:43:03.950 DEBUG:teuthology.orchestra.run.smithi077:> print(_find_admin_socket("client.0")) 2023-11-04T01:43:03.950 DEBUG:teuthology.orchestra.run.smithi077:> ' 2023-11-04T01:43:04.068 INFO:teuthology.orchestra.run.smithi077.stdout:/var/run/ceph/ceph-client.0.144662.asok 2023-11-04T01:43:04.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:04.079 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.144662.asok 2023-11-04T01:43:04.080 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:43:04.080 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.144662.asok status 2023-11-04T01:43:04.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:04.249 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-04T01:43:04.250 INFO:teuthology.orchestra.run.smithi077.stdout: "metadata": { 2023-11-04T01:43:04.250 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:43:04.250 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:43:04.250 INFO:teuthology.orchestra.run.smithi077.stdout: "entity_id": "0", 2023-11-04T01:43:04.251 INFO:teuthology.orchestra.run.smithi077.stdout: "hostname": "smithi077", 2023-11-04T01:43:04.251 INFO:teuthology.orchestra.run.smithi077.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:43:04.251 INFO:teuthology.orchestra.run.smithi077.stdout: "pid": "144662", 2023-11-04T01:43:04.251 INFO:teuthology.orchestra.run.smithi077.stdout: "root": "/" 2023-11-04T01:43:04.251 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:43:04.252 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_count": 0, 2023-11-04T01:43:04.252 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_pinned_count": 0, 2023-11-04T01:43:04.252 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 7050, 2023-11-04T01:43:04.252 INFO:teuthology.orchestra.run.smithi077.stdout: "inst": { 2023-11-04T01:43:04.252 INFO:teuthology.orchestra.run.smithi077.stdout: "name": { 2023-11-04T01:43:04.252 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "client", 2023-11-04T01:43:04.253 INFO:teuthology.orchestra.run.smithi077.stdout: "num": 7050 2023-11-04T01:43:04.253 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:43:04.253 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2023-11-04T01:43:04.253 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2023-11-04T01:43:04.253 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:43:04.254 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 3389978914 2023-11-04T01:43:04.254 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:43:04.254 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:43:04.254 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2023-11-04T01:43:04.254 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2023-11-04T01:43:04.255 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:43:04.255 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 3389978914 2023-11-04T01:43:04.255 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:43:04.255 INFO:teuthology.orchestra.run.smithi077.stdout: "inst_str": "client.7050 192.168.0.1:0/3389978914", 2023-11-04T01:43:04.255 INFO:teuthology.orchestra.run.smithi077.stdout: "addr_str": "192.168.0.1:0/3389978914", 2023-11-04T01:43:04.256 INFO:teuthology.orchestra.run.smithi077.stdout: "inode_count": 1, 2023-11-04T01:43:04.256 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_epoch": 35, 2023-11-04T01:43:04.256 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch": 83, 2023-11-04T01:43:04.256 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:43:04.256 INFO:teuthology.orchestra.run.smithi077.stdout: "blocklisted": false, 2023-11-04T01:43:04.256 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs" 2023-11-04T01:43:04.257 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-04T01:43:04.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:04.264 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:43:04.264 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:43:04.265 DEBUG:teuthology.orchestra.run.smithi077:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:04.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:04.323 INFO:teuthology.orchestra.run.smithi077.stdout:fuseblk 2023-11-04T01:43:04.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:04.329 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:04.330 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:43:04.330 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:04.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:04.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:04.396 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get mds_max_snaps_per_dir 2023-11-04T01:43:04.507 INFO:teuthology.orchestra.run.smithi077.stdout:{"mds_max_snaps_per_dir":"100"} 2023-11-04T01:43:04.507 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_max_snaps_per_dir": "100" } 2023-11-04T01:43:04.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:04.508 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test-allow-snaps) 2023-11-04T01:43:04.529 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps false --yes-i-really-mean-it 2023-11-04T01:43:04.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.672+0000 7fd6b7f6c640 1 Processor -- start 2023-11-04T01:43:04.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.672+0000 7fd6b7f6c640 1 -- start start 2023-11-04T01:43:04.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.673+0000 7fd6b7f6c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd6b0151ea0 0x7fd6b015b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.673+0000 7fd6b7f6c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd6b006dd50 0x7fd6b00c9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.673+0000 7fd6b7f6c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b006cf90 con 0x7fd6b015f510 2023-11-04T01:43:04.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.673+0000 7fd6b7f6c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6b006d270 con 0x7fd6b0151ea0 2023-11-04T01:43:04.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.673+0000 7fd6b7f6c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b006d550 con 0x7fd6b006dd50 2023-11-04T01:43:04.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.673+0000 7fd6b5507640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd6b015f510 0x7fd6b00cb150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49798/0 (socket says 172.21.15.77:49798) 2023-11-04T01:43:04.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.673+0000 7fd6b5507640 1 -- 172.21.15.77:0/1108854254 learned_addr learned my addr 172.21.15.77:0/1108854254 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:04.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.673+0000 7fd6b6509640 1 --2- 172.21.15.77:0/1108854254 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd6b006dd50 0x7fd6b00c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.673+0000 7fd6b4d06640 1 -- 172.21.15.77:0/1108854254 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1678216132 0 0) 0x7fd6b006cf90 con 0x7fd6b015f510 2023-11-04T01:43:04.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.673+0000 7fd6b5d08640 1 --2- 172.21.15.77:0/1108854254 >> v2:172.21.15.122:3300/0 conn(0x7fd6b0151ea0 0x7fd6b015b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.673+0000 7fd6b4d06640 1 -- 172.21.15.77:0/1108854254 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd69c003520 con 0x7fd6b015f510 2023-11-04T01:43:04.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.674+0000 7fd6b4d06640 1 -- 172.21.15.77:0/1108854254 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2456214253 0 0) 0x7fd69c003520 con 0x7fd6b015f510 2023-11-04T01:43:04.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.674+0000 7fd6b4d06640 1 -- 172.21.15.77:0/1108854254 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd6b006dd50 msgr2=0x7fd6b00c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:04.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.674+0000 7fd6b4d06640 1 --2- 172.21.15.77:0/1108854254 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd6b006dd50 0x7fd6b00c9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.674+0000 7fd6b4d06640 1 -- 172.21.15.77:0/1108854254 >> v2:172.21.15.122:3300/0 conn(0x7fd6b0151ea0 msgr2=0x7fd6b015b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:04.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.674+0000 7fd6b4d06640 1 --2- 172.21.15.77:0/1108854254 >> v2:172.21.15.122:3300/0 conn(0x7fd6b0151ea0 0x7fd6b015b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.674+0000 7fd6b4d06640 1 -- 172.21.15.77:0/1108854254 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b006d830 con 0x7fd6b015f510 2023-11-04T01:43:04.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.674+0000 7fd6b4d06640 1 -- 172.21.15.77:0/1108854254 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7fd6a0001670 con 0x7fd6b015f510 2023-11-04T01:43:04.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.674+0000 7fd6b4d06640 1 -- 172.21.15.77:0/1108854254 >> v1:172.21.15.77:6789/0 conn(0x7fd6b015f510 legacy=0x7fd6b00cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.674+0000 7fd6b4d06640 1 --2- 172.21.15.77:0/1108854254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd69c003970 0x7fd69c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.674+0000 7fd6b4d06640 1 --2- 172.21.15.77:0/1108854254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd69c0047c0 0x7fd69c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.674+0000 7fd6b4d06640 1 --2- 172.21.15.77:0/1108854254 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd6b006dd50 0x7fd69c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.674+0000 7fd6b4d06640 1 -- 172.21.15.77:0/1108854254 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b006d270 con 0x7fd69c0047c0 2023-11-04T01:43:04.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.674+0000 7fd6b4d06640 1 -- 172.21.15.77:0/1108854254 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b006d550 con 0x7fd69c003970 2023-11-04T01:43:04.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.674+0000 7fd6b4d06640 1 -- 172.21.15.77:0/1108854254 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd69c00b980 con 0x7fd6b006dd50 2023-11-04T01:43:04.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.674+0000 7fd6b5507640 1 --2- 172.21.15.77:0/1108854254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd69c0047c0 0x7fd69c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.674+0000 7fd6b5d08640 1 --2- 172.21.15.77:0/1108854254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd69c003970 0x7fd69c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.674+0000 7fd6b6509640 1 --2- 172.21.15.77:0/1108854254 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd6b006dd50 0x7fd69c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.674+0000 7fd6b5507640 1 -- 172.21.15.77:0/1108854254 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd6b006dd50 msgr2=0x7fd69c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:04.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.674+0000 7fd6b5507640 1 --2- 172.21.15.77:0/1108854254 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd6b006dd50 0x7fd69c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.674+0000 7fd6b5507640 1 -- 172.21.15.77:0/1108854254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd69c003970 msgr2=0x7fd69c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:04.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.674+0000 7fd6b5507640 1 --2- 172.21.15.77:0/1108854254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd69c003970 0x7fd69c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.674+0000 7fd6b5507640 1 -- 172.21.15.77:0/1108854254 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd69c003520 con 0x7fd69c0047c0 2023-11-04T01:43:04.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.675+0000 7fd6b5507640 1 --2- 172.21.15.77:0/1108854254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd69c0047c0 0x7fd69c004c40 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fd6a000c290 tx=0x7fd69c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c84b367b62a25024 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:04.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.675+0000 7fd6b4d06640 1 -- 172.21.15.77:0/1108854254 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a0005ad0 con 0x7fd69c0047c0 2023-11-04T01:43:04.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.675+0000 7fd6b4d06640 1 -- 172.21.15.77:0/1108854254 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a0005c30 con 0x7fd69c0047c0 2023-11-04T01:43:04.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.675+0000 7fd6b4d06640 1 -- 172.21.15.77:0/1108854254 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a002c8d0 con 0x7fd69c0047c0 2023-11-04T01:43:04.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.675+0000 7fd6b7f6c640 1 -- 172.21.15.77:0/1108854254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd69c0047c0 msgr2=0x7fd69c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.675+0000 7fd6b7f6c640 1 --2- 172.21.15.77:0/1108854254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd69c0047c0 0x7fd69c004c40 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fd6a000c290 tx=0x7fd69c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.675+0000 7fd6b6509640 1 -- 172.21.15.77:0/1108854254 reap_dead start 2023-11-04T01:43:04.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.676+0000 7fd6b7f6c640 1 -- 172.21.15.77:0/1108854254 shutdown_connections 2023-11-04T01:43:04.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.676+0000 7fd6b7f6c640 1 -- 172.21.15.77:0/1108854254 >> 172.21.15.77:0/1108854254 conn(0x7fd6b00b05d0 msgr2=0x7fd6b00b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:04.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.676+0000 7fd6b7f6c640 1 -- 172.21.15.77:0/1108854254 shutdown_connections 2023-11-04T01:43:04.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.676+0000 7fd6b7f6c640 1 -- 172.21.15.77:0/1108854254 wait complete. 2023-11-04T01:43:04.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.677+0000 7fd6b7f6c640 1 Processor -- start 2023-11-04T01:43:04.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.677+0000 7fd6b7f6c640 1 -- start start 2023-11-04T01:43:04.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.678+0000 7fd6b7f6c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd69c0047c0 0x7fd6b00b1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.678+0000 7fd6b7f6c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd6b0144fe0 0x7fd6b01f6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.678+0000 7fd6b7f6c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6b00b2e00 0x7fd6b00b3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.678+0000 7fd6b7f6c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b00c5f50 con 0x7fd6b00b2e00 2023-11-04T01:43:04.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.678+0000 7fd6b7f6c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b00c8960 con 0x7fd69c0047c0 2023-11-04T01:43:04.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.678+0000 7fd6b7f6c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b00c8680 con 0x7fd6b0144fe0 2023-11-04T01:43:04.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.678+0000 7fd6b6509640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6b00b2e00 0x7fd6b00b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.678+0000 7fd6b6509640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6b00b2e00 0x7fd6b00b3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45254/0 (socket says 172.21.15.77:45254) 2023-11-04T01:43:04.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.678+0000 7fd6b6509640 1 -- 172.21.15.77:0/441630672 learned_addr learned my addr 172.21.15.77:0/441630672 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:04.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.678+0000 7fd6b6509640 1 -- 172.21.15.77:0/441630672 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd6b0144fe0 msgr2=0x7fd6b01f6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.678+0000 7fd6b6509640 1 --2- 172.21.15.77:0/441630672 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd6b0144fe0 0x7fd6b01f6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.678+0000 7fd6b6509640 1 -- 172.21.15.77:0/441630672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd69c0047c0 msgr2=0x7fd6b00b1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.678+0000 7fd6b6509640 1 --2- 172.21.15.77:0/441630672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd69c0047c0 0x7fd6b00b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.678+0000 7fd6b6509640 1 -- 172.21.15.77:0/441630672 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b01455e0 con 0x7fd6b00b2e00 2023-11-04T01:43:04.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.678+0000 7fd6b6509640 1 --2- 172.21.15.77:0/441630672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6b00b2e00 0x7fd6b00b3280 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0067490 tx=0x7fd6a8011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:04.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.678+0000 7fd6a67fc640 1 -- 172.21.15.77:0/441630672 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a8011ee0 con 0x7fd6b00b2e00 2023-11-04T01:43:04.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.678+0000 7fd6a67fc640 1 -- 172.21.15.77:0/441630672 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a8004240 con 0x7fd6b00b2e00 2023-11-04T01:43:04.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.678+0000 7fd6b7f6c640 1 -- 172.21.15.77:0/441630672 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b01458c0 con 0x7fd6b00b2e00 2023-11-04T01:43:04.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.678+0000 7fd6a67fc640 1 -- 172.21.15.77:0/441630672 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a800f770 con 0x7fd6b00b2e00 2023-11-04T01:43:04.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.678+0000 7fd6b7f6c640 1 -- 172.21.15.77:0/441630672 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b00706a0 con 0x7fd6b00b2e00 2023-11-04T01:43:04.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.679+0000 7fd6b7f6c640 1 -- 172.21.15.77:0/441630672 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b004e490 con 0x7fd6b00b2e00 2023-11-04T01:43:04.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.680+0000 7fd6a67fc640 1 -- 172.21.15.77:0/441630672 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd6a800f8d0 con 0x7fd6b00b2e00 2023-11-04T01:43:04.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.680+0000 7fd6a67fc640 1 --2- 172.21.15.77:0/441630672 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd69406aea0 0x7fd69406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.680+0000 7fd6a67fc640 1 -- 172.21.15.77:0/441630672 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fd6a8089c90 con 0x7fd6b00b2e00 2023-11-04T01:43:04.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.680+0000 7fd6b5d08640 1 --2- 172.21.15.77:0/441630672 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd69406aea0 0x7fd69406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.681+0000 7fd6b5d08640 1 --2- 172.21.15.77:0/441630672 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd69406aea0 0x7fd69406d360 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac009f40 tx=0x7fd6ac009750 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:04.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.684+0000 7fd6a67fc640 1 -- 172.21.15.77:0/441630672 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd6a80547d0 con 0x7fd6b00b2e00 2023-11-04T01:43:04.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:04.886+0000 7fd6b7f6c640 1 -- 172.21.15.77:0/441630672 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "false", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd6b00c6110 con 0x7fd6b00b2e00 2023-11-04T01:43:05.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.586+0000 7fd6a67fc640 1 -- 172.21.15.77:0/441630672 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "false", "yes_i_really_mean_it": true}]=0 disabled new snapshots v36) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd6a8012330 con 0x7fd6b00b2e00 2023-11-04T01:43:05.588 INFO:teuthology.orchestra.run.smithi077.stderr:disabled new snapshots 2023-11-04T01:43:05.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.589+0000 7fd6b7f6c640 1 -- 172.21.15.77:0/441630672 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd69406aea0 msgr2=0x7fd69406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.589+0000 7fd6b7f6c640 1 --2- 172.21.15.77:0/441630672 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd69406aea0 0x7fd69406d360 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac009f40 tx=0x7fd6ac009750 comp rx=0 tx=0).stop 2023-11-04T01:43:05.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.589+0000 7fd6b7f6c640 1 -- 172.21.15.77:0/441630672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6b00b2e00 msgr2=0x7fd6b00b3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.589+0000 7fd6b7f6c640 1 --2- 172.21.15.77:0/441630672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6b00b2e00 0x7fd6b00b3280 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0067490 tx=0x7fd6a8011cf0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.589+0000 7fd6b7f6c640 1 -- 172.21.15.77:0/441630672 shutdown_connections 2023-11-04T01:43:05.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.589+0000 7fd6b7f6c640 1 --2- 172.21.15.77:0/441630672 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd69406aea0 0x7fd69406d360 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.589+0000 7fd6b7f6c640 1 --2- 172.21.15.77:0/441630672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6b00b2e00 0x7fd6b00b3280 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.589+0000 7fd6b7f6c640 1 --2- 172.21.15.77:0/441630672 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd6b0144fe0 0x7fd6b01f6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.589+0000 7fd6b7f6c640 1 --2- 172.21.15.77:0/441630672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd69c0047c0 0x7fd6b00b1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.589+0000 7fd6b7f6c640 1 -- 172.21.15.77:0/441630672 >> 172.21.15.77:0/441630672 conn(0x7fd6b00b05d0 msgr2=0x7fd6b00b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:05.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.589+0000 7fd6b7f6c640 1 -- 172.21.15.77:0/441630672 shutdown_connections 2023-11-04T01:43:05.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.589+0000 7fd6b7f6c640 1 -- 172.21.15.77:0/441630672 wait complete. 2023-11-04T01:43:05.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:05.604 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test-allow-snaps/.snap/snap00) 2023-11-04T01:43:05.624 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:43:05.625 INFO:teuthology.orchestra.run.smithi077.stderr:mkdir: cannot create directory ‘test-allow-snaps/.snap/snap00’: Operation not permitted 2023-11-04T01:43:05.625 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2023-11-04T01:43:05.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.771+0000 7fcef365d640 1 Processor -- start 2023-11-04T01:43:05.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.771+0000 7fcef365d640 1 -- start start 2023-11-04T01:43:05.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.772+0000 7fcef365d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fceec0cb680 0x7fceec0cd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.772+0000 7fcef365d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fceec0cda80 0x7fceec15d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.772+0000 7fcef365d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceec0cded0 con 0x7fceec15d1b0 2023-11-04T01:43:05.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.772+0000 7fcef365d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceec161870 con 0x7fceec0cda80 2023-11-04T01:43:05.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.772+0000 7fcef365d640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceec160c60 con 0x7fceec0cb680 2023-11-04T01:43:05.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.772+0000 7fcef1bfa640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fceec0cda80 0x7fceec15d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.772+0000 7fcef13f9640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fceec15d1b0 0x7fceec0ce7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49800/0 (socket says 172.21.15.77:49800) 2023-11-04T01:43:05.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.772+0000 7fcef13f9640 1 -- 172.21.15.77:0/1341152819 learned_addr learned my addr 172.21.15.77:0/1341152819 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:05.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.772+0000 7fcef0bf8640 1 --2- 172.21.15.77:0/1341152819 >> v2:172.21.15.122:3300/0 conn(0x7fceec0cb680 0x7fceec0cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.772+0000 7fcef1bfa640 1 -- 172.21.15.77:0/1341152819 >> v2:172.21.15.122:3300/0 conn(0x7fceec0cb680 msgr2=0x7fceec0cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:05.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.772+0000 7fcef1bfa640 1 --2- 172.21.15.77:0/1341152819 >> v2:172.21.15.122:3300/0 conn(0x7fceec0cb680 0x7fceec0cd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.772+0000 7fcef1bfa640 1 -- 172.21.15.77:0/1341152819 >> v1:172.21.15.77:6789/0 conn(0x7fceec15d1b0 legacy=0x7fceec0ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.772+0000 7fcee3fff640 1 -- 172.21.15.77:0/1341152819 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1603456514 0 0) 0x7fcee8001110 con 0x7fceec15d1b0 2023-11-04T01:43:05.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.772+0000 7fcef1bfa640 1 -- 172.21.15.77:0/1341152819 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceec160f40 con 0x7fceec0cda80 2023-11-04T01:43:05.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.773+0000 7fcef1bfa640 1 --2- 172.21.15.77:0/1341152819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fceec0cda80 0x7fceec15d750 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fceec06fb10 tx=0x7fcee402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e4cb6670384d619 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:05.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.773+0000 7fcee3fff640 1 -- 172.21.15.77:0/1341152819 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee402cc80 con 0x7fceec0cda80 2023-11-04T01:43:05.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.773+0000 7fcee3fff640 1 -- 172.21.15.77:0/1341152819 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee402cde0 con 0x7fceec0cda80 2023-11-04T01:43:05.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.773+0000 7fcee3fff640 1 -- 172.21.15.77:0/1341152819 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee4034660 con 0x7fceec0cda80 2023-11-04T01:43:05.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.773+0000 7fcef365d640 1 -- 172.21.15.77:0/1341152819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fceec0cda80 msgr2=0x7fceec15d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.773+0000 7fcef365d640 1 --2- 172.21.15.77:0/1341152819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fceec0cda80 0x7fceec15d750 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fceec06fb10 tx=0x7fcee402bed0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.774+0000 7fcef365d640 1 -- 172.21.15.77:0/1341152819 shutdown_connections 2023-11-04T01:43:05.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.774+0000 7fcef365d640 1 --2- 172.21.15.77:0/1341152819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fceec0cda80 0x7fceec15d750 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.774+0000 7fcef365d640 1 --2- 172.21.15.77:0/1341152819 >> v2:172.21.15.122:3300/0 conn(0x7fceec0cb680 0x7fceec0cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.774+0000 7fcef365d640 1 -- 172.21.15.77:0/1341152819 >> 172.21.15.77:0/1341152819 conn(0x7fceec06ea20 msgr2=0x7fceec06ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:05.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.774+0000 7fcef365d640 1 -- 172.21.15.77:0/1341152819 shutdown_connections 2023-11-04T01:43:05.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.774+0000 7fcef365d640 1 -- 172.21.15.77:0/1341152819 wait complete. 2023-11-04T01:43:05.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.775+0000 7fcef365d640 1 Processor -- start 2023-11-04T01:43:05.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.775+0000 7fcef365d640 1 -- start start 2023-11-04T01:43:05.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.775+0000 7fcef365d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fceec0cb680 0x7fceec151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.775+0000 7fcef365d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fceec0cda80 0x7fceec0b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.775+0000 7fcef365d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fceec15d1b0 0x7fceec0ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.775+0000 7fcef365d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec1516c0 con 0x7fceec15d1b0 2023-11-04T01:43:05.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.776+0000 7fcef365d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec0b2130 con 0x7fceec0cb680 2023-11-04T01:43:05.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.776+0000 7fcef365d640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceec0b5510 con 0x7fceec0cda80 2023-11-04T01:43:05.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.776+0000 7fcef1bfa640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fceec15d1b0 0x7fceec0ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.776+0000 7fcef1bfa640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fceec15d1b0 0x7fceec0ca0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45260/0 (socket says 172.21.15.77:45260) 2023-11-04T01:43:05.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.776+0000 7fcef1bfa640 1 -- 172.21.15.77:0/3391289533 learned_addr learned my addr 172.21.15.77:0/3391289533 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:05.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.776+0000 7fcef0bf8640 1 --2- 172.21.15.77:0/3391289533 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fceec0cda80 0x7fceec0b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.776+0000 7fcef13f9640 1 --2- 172.21.15.77:0/3391289533 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fceec0cb680 0x7fceec151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.776+0000 7fcef1bfa640 1 -- 172.21.15.77:0/3391289533 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fceec0cda80 msgr2=0x7fceec0b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.776+0000 7fcef1bfa640 1 --2- 172.21.15.77:0/3391289533 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fceec0cda80 0x7fceec0b25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.776+0000 7fcef1bfa640 1 -- 172.21.15.77:0/3391289533 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fceec0cb680 msgr2=0x7fceec151180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.776+0000 7fcef1bfa640 1 --2- 172.21.15.77:0/3391289533 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fceec0cb680 0x7fceec151180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.776+0000 7fcef1bfa640 1 -- 172.21.15.77:0/3391289533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee4009a70 con 0x7fceec15d1b0 2023-11-04T01:43:05.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.776+0000 7fcef1bfa640 1 --2- 172.21.15.77:0/3391289533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fceec15d1b0 0x7fceec0ca0c0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fcee4009e80 tx=0x7fcee4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:05.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.776+0000 7fcee1ffb640 1 -- 172.21.15.77:0/3391289533 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee4040650 con 0x7fceec15d1b0 2023-11-04T01:43:05.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.776+0000 7fcee1ffb640 1 -- 172.21.15.77:0/3391289533 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee40407b0 con 0x7fceec15d1b0 2023-11-04T01:43:05.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.776+0000 7fcee1ffb640 1 -- 172.21.15.77:0/3391289533 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee4040b60 con 0x7fceec15d1b0 2023-11-04T01:43:05.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.776+0000 7fcef365d640 1 -- 172.21.15.77:0/3391289533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceec0b57f0 con 0x7fceec15d1b0 2023-11-04T01:43:05.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.776+0000 7fcef365d640 1 -- 172.21.15.77:0/3391289533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceec0b1dc0 con 0x7fceec15d1b0 2023-11-04T01:43:05.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.777+0000 7fcef365d640 1 -- 172.21.15.77:0/3391289533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceec0b22c0 con 0x7fceec15d1b0 2023-11-04T01:43:05.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.778+0000 7fcee1ffb640 1 -- 172.21.15.77:0/3391289533 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcee4040cc0 con 0x7fceec15d1b0 2023-11-04T01:43:05.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.778+0000 7fcee1ffb640 1 --2- 172.21.15.77:0/3391289533 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fced006ae70 0x7fced006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.778+0000 7fcee1ffb640 1 -- 172.21.15.77:0/3391289533 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fcee40ac930 con 0x7fceec15d1b0 2023-11-04T01:43:05.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.778+0000 7fcef13f9640 1 --2- 172.21.15.77:0/3391289533 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fced006ae70 0x7fced006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.779+0000 7fcef13f9640 1 --2- 172.21.15.77:0/3391289533 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fced006ae70 0x7fced006d330 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fcee8000f60 tx=0x7fcee8007c00 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:05.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.783+0000 7fcee1ffb640 1 -- 172.21.15.77:0/3391289533 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcee4077470 con 0x7fceec15d1b0 2023-11-04T01:43:05.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:05.983+0000 7fcef365d640 1 -- 172.21.15.77:0/3391289533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fceec04e490 con 0x7fceec15d1b0 2023-11-04T01:43:06.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:06.598+0000 7fcee1ffb640 1 -- 172.21.15.77:0/3391289533 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v37) v1 ==== 167+0+0 (secure 0 0 0) 0x7fcee4009450 con 0x7fceec15d1b0 2023-11-04T01:43:06.600 INFO:teuthology.orchestra.run.smithi077.stderr:enabled new snapshots 2023-11-04T01:43:06.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:06.600+0000 7fcef365d640 1 -- 172.21.15.77:0/3391289533 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fced006ae70 msgr2=0x7fced006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:06.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:06.600+0000 7fcef365d640 1 --2- 172.21.15.77:0/3391289533 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fced006ae70 0x7fced006d330 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fcee8000f60 tx=0x7fcee8007c00 comp rx=0 tx=0).stop 2023-11-04T01:43:06.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:06.600+0000 7fcef365d640 1 -- 172.21.15.77:0/3391289533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fceec15d1b0 msgr2=0x7fceec0ca0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:06.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:06.600+0000 7fcef365d640 1 --2- 172.21.15.77:0/3391289533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fceec15d1b0 0x7fceec0ca0c0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fcee4009e80 tx=0x7fcee4004a40 comp rx=0 tx=0).stop 2023-11-04T01:43:06.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:06.600+0000 7fcef365d640 1 -- 172.21.15.77:0/3391289533 shutdown_connections 2023-11-04T01:43:06.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:06.600+0000 7fcef365d640 1 --2- 172.21.15.77:0/3391289533 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fced006ae70 0x7fced006d330 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:06.600+0000 7fcef365d640 1 --2- 172.21.15.77:0/3391289533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fceec15d1b0 0x7fceec0ca0c0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:06.600+0000 7fcef365d640 1 --2- 172.21.15.77:0/3391289533 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fceec0cda80 0x7fceec0b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:06.600+0000 7fcef365d640 1 --2- 172.21.15.77:0/3391289533 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fceec0cb680 0x7fceec151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:06.600+0000 7fcef365d640 1 -- 172.21.15.77:0/3391289533 >> 172.21.15.77:0/3391289533 conn(0x7fceec06ea20 msgr2=0x7fceec0c7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:06.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:06.600+0000 7fcef365d640 1 -- 172.21.15.77:0/3391289533 shutdown_connections 2023-11-04T01:43:06.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:06.600+0000 7fcef365d640 1 -- 172.21.15.77:0/3391289533 wait complete. 2023-11-04T01:43:06.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:06.614 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test-allow-snaps/.snap/snap00) 2023-11-04T01:43:06.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:06.637 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir test-allow-snaps/.snap/snap00) 2023-11-04T01:43:06.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:06.700 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir test-allow-snaps) 2023-11-04T01:43:06.758 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:43:06.758 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:43:06.842 DEBUG:teuthology.orchestra.run.smithi122:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:43:06.888 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:43:06.888 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:43:06.888 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:06.904 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:07.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.041+0000 7f969152c640 1 Processor -- start 2023-11-04T01:43:07.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.041+0000 7f969152c640 1 -- start start 2023-11-04T01:43:07.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.042+0000 7f969152c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f968c0ce240 0x7f968c157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.042+0000 7f969152c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f968c157540 0x7f968c0d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.042+0000 7f969152c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f968c15e000 con 0x7f968c0cde60 2023-11-04T01:43:07.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.042+0000 7f969152c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f968c15e5c0 con 0x7f968c157540 2023-11-04T01:43:07.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.042+0000 7f969152c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f968c15e2e0 con 0x7f968c0ce240 2023-11-04T01:43:07.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.042+0000 7f968affd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f968c0cde60 0x7f968c15d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49810/0 (socket says 172.21.15.77:49810) 2023-11-04T01:43:07.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.042+0000 7f968affd640 1 -- 172.21.15.77:0/4085945833 learned_addr learned my addr 172.21.15.77:0/4085945833 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:07.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.042+0000 7f968b7fe640 1 --2- 172.21.15.77:0/4085945833 >> v2:172.21.15.77:3300/0 conn(0x7f968c157540 0x7f968c0d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.042+0000 7f9689ffb640 1 -- 172.21.15.77:0/4085945833 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2940855190 0 0) 0x7f968c15e000 con 0x7f968c0cde60 2023-11-04T01:43:07.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.042+0000 7f9689ffb640 1 -- 172.21.15.77:0/4085945833 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9674003520 con 0x7f968c0cde60 2023-11-04T01:43:07.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.043+0000 7f968a7fc640 1 --2- 172.21.15.77:0/4085945833 >> v2:172.21.15.122:3300/0 conn(0x7f968c0ce240 0x7f968c157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.043+0000 7f968b7fe640 1 -- 172.21.15.77:0/4085945833 >> v2:172.21.15.122:3300/0 conn(0x7f968c0ce240 msgr2=0x7f968c157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:07.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.043+0000 7f968b7fe640 1 --2- 172.21.15.77:0/4085945833 >> v2:172.21.15.122:3300/0 conn(0x7f968c0ce240 0x7f968c157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.043+0000 7f968b7fe640 1 -- 172.21.15.77:0/4085945833 >> v1:172.21.15.77:6789/0 conn(0x7f968c0cde60 legacy=0x7f968c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.043+0000 7f968b7fe640 1 -- 172.21.15.77:0/4085945833 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968c0d1120 con 0x7f968c157540 2023-11-04T01:43:07.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.043+0000 7f968a7fc640 1 --2- 172.21.15.77:0/4085945833 >> v2:172.21.15.122:3300/0 conn(0x7f968c0ce240 0x7f968c157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:07.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.043+0000 7f968b7fe640 1 --2- 172.21.15.77:0/4085945833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f968c157540 0x7f968c0d1920 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f968c0cf5f0 tx=0x7f968402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4050da297703536b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:07.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.043+0000 7f9689ffb640 1 -- 172.21.15.77:0/4085945833 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9684031830 con 0x7f968c157540 2023-11-04T01:43:07.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.043+0000 7f9689ffb640 1 -- 172.21.15.77:0/4085945833 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9684031990 con 0x7f968c157540 2023-11-04T01:43:07.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.043+0000 7f9689ffb640 1 -- 172.21.15.77:0/4085945833 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9684031d20 con 0x7f968c157540 2023-11-04T01:43:07.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.044+0000 7f969152c640 1 -- 172.21.15.77:0/4085945833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f968c157540 msgr2=0x7f968c0d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.044+0000 7f969152c640 1 --2- 172.21.15.77:0/4085945833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f968c157540 0x7f968c0d1920 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f968c0cf5f0 tx=0x7f968402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.044+0000 7f969152c640 1 -- 172.21.15.77:0/4085945833 shutdown_connections 2023-11-04T01:43:07.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.044+0000 7f969152c640 1 --2- 172.21.15.77:0/4085945833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f968c157540 0x7f968c0d1920 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.044+0000 7f969152c640 1 --2- 172.21.15.77:0/4085945833 >> v2:172.21.15.122:3300/0 conn(0x7f968c0ce240 0x7f968c157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.044+0000 7f969152c640 1 -- 172.21.15.77:0/4085945833 >> 172.21.15.77:0/4085945833 conn(0x7f968c071f30 msgr2=0x7f968c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:07.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.044+0000 7f969152c640 1 -- 172.21.15.77:0/4085945833 shutdown_connections 2023-11-04T01:43:07.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.044+0000 7f969152c640 1 -- 172.21.15.77:0/4085945833 wait complete. 2023-11-04T01:43:07.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.045+0000 7f969152c640 1 Processor -- start 2023-11-04T01:43:07.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.045+0000 7f969152c640 1 -- start start 2023-11-04T01:43:07.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.046+0000 7f969152c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f968c0cde60 0x7f968c153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.046+0000 7f969152c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f968c0ce240 0x7f968c0cc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.046+0000 7f969152c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f968c157540 0x7f968c15c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.046+0000 7f969152c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968c15a3d0 con 0x7f968c0ce240 2023-11-04T01:43:07.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.046+0000 7f969152c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968c0caf40 con 0x7f968c157540 2023-11-04T01:43:07.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.046+0000 7f969152c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f968c0cbda0 con 0x7f968c0cde60 2023-11-04T01:43:07.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.046+0000 7f968a7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f968c0ce240 0x7f968c0cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.046+0000 7f968a7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f968c0ce240 0x7f968c0cc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45274/0 (socket says 172.21.15.77:45274) 2023-11-04T01:43:07.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.046+0000 7f968a7fc640 1 -- 172.21.15.77:0/3871343769 learned_addr learned my addr 172.21.15.77:0/3871343769 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:07.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.046+0000 7f968affd640 1 --2- 172.21.15.77:0/3871343769 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f968c0cde60 0x7f968c153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.046+0000 7f968b7fe640 1 --2- 172.21.15.77:0/3871343769 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f968c157540 0x7f968c15c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.046+0000 7f968a7fc640 1 -- 172.21.15.77:0/3871343769 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f968c0cde60 msgr2=0x7f968c153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.046+0000 7f968a7fc640 1 --2- 172.21.15.77:0/3871343769 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f968c0cde60 0x7f968c153e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.046+0000 7f968a7fc640 1 -- 172.21.15.77:0/3871343769 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f968c157540 msgr2=0x7f968c15c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.046+0000 7f968a7fc640 1 --2- 172.21.15.77:0/3871343769 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f968c157540 0x7f968c15c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.046+0000 7f968a7fc640 1 -- 172.21.15.77:0/3871343769 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9684009400 con 0x7f968c0ce240 2023-11-04T01:43:07.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.046+0000 7f968b7fe640 1 --2- 172.21.15.77:0/3871343769 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f968c157540 0x7f968c15c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:07.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.047+0000 7f968a7fc640 1 --2- 172.21.15.77:0/3871343769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f968c0ce240 0x7f968c0cc230 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f968000c7f0 tx=0x7f968000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:07.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.047+0000 7f96737fe640 1 -- 172.21.15.77:0/3871343769 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9680007a30 con 0x7f968c0ce240 2023-11-04T01:43:07.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.047+0000 7f96737fe640 1 -- 172.21.15.77:0/3871343769 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9680007b90 con 0x7f968c0ce240 2023-11-04T01:43:07.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.047+0000 7f969152c640 1 -- 172.21.15.77:0/3871343769 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f968c154950 con 0x7f968c0ce240 2023-11-04T01:43:07.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.047+0000 7f96737fe640 1 -- 172.21.15.77:0/3871343769 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968000ce40 con 0x7f968c0ce240 2023-11-04T01:43:07.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.047+0000 7f969152c640 1 -- 172.21.15.77:0/3871343769 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f968c0cb470 con 0x7f968c0ce240 2023-11-04T01:43:07.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.048+0000 7f969152c640 1 -- 172.21.15.77:0/3871343769 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f968c074290 con 0x7f968c0ce240 2023-11-04T01:43:07.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.048+0000 7f96737fe640 1 -- 172.21.15.77:0/3871343769 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f96800113f0 con 0x7f968c0ce240 2023-11-04T01:43:07.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.049+0000 7f96737fe640 1 --2- 172.21.15.77:0/3871343769 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f967806ae70 0x7f967806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.049+0000 7f96737fe640 1 -- 172.21.15.77:0/3871343769 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f9680089ce0 con 0x7f968c0ce240 2023-11-04T01:43:07.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.049+0000 7f968affd640 1 --2- 172.21.15.77:0/3871343769 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f967806ae70 0x7f967806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.049+0000 7f968affd640 1 --2- 172.21.15.77:0/3871343769 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f967806ae70 0x7f967806d330 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f967c001560 tx=0x7f967c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:07.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.053+0000 7f96737fe640 1 -- 172.21.15.77:0/3871343769 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f96800548b0 con 0x7f968c0ce240 2023-11-04T01:43:07.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.219+0000 7f969152c640 1 -- 172.21.15.77:0/3871343769 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f968c0cbee0 con 0x7f968c0ce240 2023-11-04T01:43:07.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.220+0000 7f96737fe640 1 -- 172.21.15.77:0/3871343769 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+21941 (secure 0 0 0) 0x7f968001f090 con 0x7f968c0ce240 2023-11-04T01:43:07.223 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:43:07.224 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":83,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:42:57.578138+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:33.159064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:33.647358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:54.519050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:55.395781+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:07.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.222+0000 7f969152c640 1 -- 172.21.15.77:0/3871343769 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f967806ae70 msgr2=0x7f967806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.222+0000 7f969152c640 1 --2- 172.21.15.77:0/3871343769 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f967806ae70 0x7f967806d330 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f967c001560 tx=0x7f967c009040 comp rx=0 tx=0).stop 2023-11-04T01:43:07.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.222+0000 7f969152c640 1 -- 172.21.15.77:0/3871343769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f968c0ce240 msgr2=0x7f968c0cc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.222+0000 7f969152c640 1 --2- 172.21.15.77:0/3871343769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f968c0ce240 0x7f968c0cc230 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f968000c7f0 tx=0x7f968000cbf0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.222+0000 7f969152c640 1 -- 172.21.15.77:0/3871343769 shutdown_connections 2023-11-04T01:43:07.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.222+0000 7f969152c640 1 --2- 172.21.15.77:0/3871343769 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f967806ae70 0x7f967806d330 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.222+0000 7f969152c640 1 --2- 172.21.15.77:0/3871343769 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f968c157540 0x7f968c15c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.222+0000 7f969152c640 1 --2- 172.21.15.77:0/3871343769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f968c0ce240 0x7f968c0cc230 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.222+0000 7f969152c640 1 --2- 172.21.15.77:0/3871343769 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f968c0cde60 0x7f968c153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.222+0000 7f969152c640 1 -- 172.21.15.77:0/3871343769 >> 172.21.15.77:0/3871343769 conn(0x7f968c071f30 msgr2=0x7f968c0c8920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:07.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.222+0000 7f969152c640 1 -- 172.21.15.77:0/3871343769 shutdown_connections 2023-11-04T01:43:07.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.222+0000 7f969152c640 1 -- 172.21.15.77:0/3871343769 wait complete. 2023-11-04T01:43:07.236 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:33.142176+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:42:33.159064+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:42:33.647358+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:42:54.519050+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:42:55.395781+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:43:07.237 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:43:07.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.336+0000 7f51fe0e5640 1 Processor -- start 2023-11-04T01:43:07.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.336+0000 7f51fe0e5640 1 -- start start 2023-11-04T01:43:07.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.337+0000 7f51fe0e5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f51f81460c0 0x7f51f80b1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.337+0000 7f51fe0e5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f51f80c37d0 0x7f51f80c3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.337+0000 7f51fe0e5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f8146950 con 0x7f51f8070710 2023-11-04T01:43:07.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.337+0000 7f51fe0e5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f81464a0 con 0x7f51f81460c0 2023-11-04T01:43:07.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.337+0000 7f51fe0e5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f80c4170 con 0x7f51f80c37d0 2023-11-04T01:43:07.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.337+0000 7f51f77fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f51f81460c0 0x7f51f80b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.337+0000 7f51f7fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f51f8070710 0x7f51f80ccd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49816/0 (socket says 172.21.15.77:49816) 2023-11-04T01:43:07.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.337+0000 7f51f7fff640 1 -- 172.21.15.77:0/1291609321 learned_addr learned my addr 172.21.15.77:0/1291609321 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:07.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.337+0000 7f51f6ffd640 1 --2- 172.21.15.77:0/1291609321 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f51f80c37d0 0x7f51f80c3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.337+0000 7f51f77fe640 1 -- 172.21.15.77:0/1291609321 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f51f80c37d0 msgr2=0x7f51f80c3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:07.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.337+0000 7f51f77fe640 1 --2- 172.21.15.77:0/1291609321 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f51f80c37d0 0x7f51f80c3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.337+0000 7f51f77fe640 1 -- 172.21.15.77:0/1291609321 >> v1:172.21.15.77:6789/0 conn(0x7f51f8070710 legacy=0x7f51f80ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.337+0000 7f51f77fe640 1 -- 172.21.15.77:0/1291609321 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f80cc5c0 con 0x7f51f81460c0 2023-11-04T01:43:07.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.337+0000 7f51f67fc640 1 -- 172.21.15.77:0/1291609321 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 136119886 0 0) 0x7f51f8146950 con 0x7f51f8070710 2023-11-04T01:43:07.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.338+0000 7f51f77fe640 1 --2- 172.21.15.77:0/1291609321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51f81460c0 0x7f51f80b1860 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f51e80097a0 tx=0x7f51e802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22a450ee18e9d5a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:07.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.338+0000 7f51f67fc640 1 -- 172.21.15.77:0/1291609321 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e8031830 con 0x7f51f81460c0 2023-11-04T01:43:07.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.338+0000 7f51f67fc640 1 -- 172.21.15.77:0/1291609321 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e8031990 con 0x7f51f81460c0 2023-11-04T01:43:07.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.338+0000 7f51f67fc640 1 -- 172.21.15.77:0/1291609321 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e8031d20 con 0x7f51f81460c0 2023-11-04T01:43:07.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.338+0000 7f51fe0e5640 1 -- 172.21.15.77:0/1291609321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51f81460c0 msgr2=0x7f51f80b1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.338+0000 7f51fe0e5640 1 --2- 172.21.15.77:0/1291609321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51f81460c0 0x7f51f80b1860 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f51e80097a0 tx=0x7f51e802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.339+0000 7f51fe0e5640 1 -- 172.21.15.77:0/1291609321 shutdown_connections 2023-11-04T01:43:07.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.339+0000 7f51fe0e5640 1 --2- 172.21.15.77:0/1291609321 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f51f80c37d0 0x7f51f80c3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.339+0000 7f51fe0e5640 1 --2- 172.21.15.77:0/1291609321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51f81460c0 0x7f51f80b1860 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.339+0000 7f51fe0e5640 1 -- 172.21.15.77:0/1291609321 >> 172.21.15.77:0/1291609321 conn(0x7f51f80ce950 msgr2=0x7f51f80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:07.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.339+0000 7f51fe0e5640 1 -- 172.21.15.77:0/1291609321 shutdown_connections 2023-11-04T01:43:07.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.339+0000 7f51fe0e5640 1 -- 172.21.15.77:0/1291609321 wait complete. 2023-11-04T01:43:07.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.340+0000 7f51fe0e5640 1 Processor -- start 2023-11-04T01:43:07.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.340+0000 7f51fe0e5640 1 -- start start 2023-11-04T01:43:07.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.341+0000 7f51fe0e5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51f8070710 0x7f51f815c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.341+0000 7f51fe0e5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51f80c37d0 0x7f51f806d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.341+0000 7f51fe0e5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f51f81460c0 0x7f51f806dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.341+0000 7f51fe0e5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f80b1e30 con 0x7f51f8070710 2023-11-04T01:43:07.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.341+0000 7f51fe0e5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f81f69f0 con 0x7f51f80c37d0 2023-11-04T01:43:07.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.341+0000 7f51fe0e5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f81f6150 con 0x7f51f81460c0 2023-11-04T01:43:07.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.341+0000 7f51f77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51f8070710 0x7f51f815c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.341+0000 7f51f77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51f8070710 0x7f51f815c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45292/0 (socket says 172.21.15.77:45292) 2023-11-04T01:43:07.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.341+0000 7f51f77fe640 1 -- 172.21.15.77:0/1311427824 learned_addr learned my addr 172.21.15.77:0/1311427824 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:07.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.341+0000 7f51f7fff640 1 --2- 172.21.15.77:0/1311427824 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f51f81460c0 0x7f51f806dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.341+0000 7f51f6ffd640 1 --2- 172.21.15.77:0/1311427824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51f80c37d0 0x7f51f806d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.341+0000 7f51f77fe640 1 -- 172.21.15.77:0/1311427824 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f51f81460c0 msgr2=0x7f51f806dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.341+0000 7f51f77fe640 1 --2- 172.21.15.77:0/1311427824 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f51f81460c0 0x7f51f806dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.341+0000 7f51f77fe640 1 -- 172.21.15.77:0/1311427824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51f80c37d0 msgr2=0x7f51f806d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.341+0000 7f51f77fe640 1 --2- 172.21.15.77:0/1311427824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51f80c37d0 0x7f51f806d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.341+0000 7f51f77fe640 1 -- 172.21.15.77:0/1311427824 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e8009400 con 0x7f51f8070710 2023-11-04T01:43:07.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.341+0000 7f51f6ffd640 1 --2- 172.21.15.77:0/1311427824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51f80c37d0 0x7f51f806d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:07.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.341+0000 7f51f77fe640 1 --2- 172.21.15.77:0/1311427824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51f8070710 0x7f51f815c830 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f51e8000c00 tx=0x7f51e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:07.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.341+0000 7f51dffff640 1 -- 172.21.15.77:0/1311427824 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e8004230 con 0x7f51f8070710 2023-11-04T01:43:07.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.341+0000 7f51dffff640 1 -- 172.21.15.77:0/1311427824 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e8004390 con 0x7f51f8070710 2023-11-04T01:43:07.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.341+0000 7f51fe0e5640 1 -- 172.21.15.77:0/1311427824 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f81f6430 con 0x7f51f8070710 2023-11-04T01:43:07.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.341+0000 7f51dffff640 1 -- 172.21.15.77:0/1311427824 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e803a860 con 0x7f51f8070710 2023-11-04T01:43:07.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.341+0000 7f51fe0e5640 1 -- 172.21.15.77:0/1311427824 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f815cd70 con 0x7f51f8070710 2023-11-04T01:43:07.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.342+0000 7f51fe0e5640 1 -- 172.21.15.77:0/1311427824 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f8074290 con 0x7f51f8070710 2023-11-04T01:43:07.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.343+0000 7f51dffff640 1 -- 172.21.15.77:0/1311427824 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f51e803a9c0 con 0x7f51f8070710 2023-11-04T01:43:07.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.343+0000 7f51dffff640 1 --2- 172.21.15.77:0/1311427824 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f51e406ae70 0x7f51e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.343+0000 7f51dffff640 1 -- 172.21.15.77:0/1311427824 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f51e80ac4b0 con 0x7f51f8070710 2023-11-04T01:43:07.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.343+0000 7f51f6ffd640 1 --2- 172.21.15.77:0/1311427824 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f51e406ae70 0x7f51e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.344+0000 7f51f6ffd640 1 --2- 172.21.15.77:0/1311427824 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f51e406ae70 0x7f51e406d330 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f51f80b1590 tx=0x7f51ec008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:07.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.348+0000 7f51dffff640 1 -- 172.21.15.77:0/1311427824 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f51e80771a0 con 0x7f51f8070710 2023-11-04T01:43:07.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.514+0000 7f51fe0e5640 1 -- 172.21.15.77:0/1311427824 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f51f80cd610 con 0x7f51f8070710 2023-11-04T01:43:07.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.514+0000 7f51dffff640 1 -- 172.21.15.77:0/1311427824 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7f51e807a7c0 con 0x7f51f8070710 2023-11-04T01:43:07.517 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:43:07.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.516+0000 7f51fe0e5640 1 -- 172.21.15.77:0/1311427824 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f51e406ae70 msgr2=0x7f51e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.516+0000 7f51fe0e5640 1 --2- 172.21.15.77:0/1311427824 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f51e406ae70 0x7f51e406d330 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f51f80b1590 tx=0x7f51ec008040 comp rx=0 tx=0).stop 2023-11-04T01:43:07.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.516+0000 7f51fe0e5640 1 -- 172.21.15.77:0/1311427824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51f8070710 msgr2=0x7f51f815c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.516+0000 7f51fe0e5640 1 --2- 172.21.15.77:0/1311427824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51f8070710 0x7f51f815c830 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f51e8000c00 tx=0x7f51e80046c0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.516+0000 7f51fe0e5640 1 -- 172.21.15.77:0/1311427824 shutdown_connections 2023-11-04T01:43:07.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.516+0000 7f51fe0e5640 1 --2- 172.21.15.77:0/1311427824 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f51e406ae70 0x7f51e406d330 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.516+0000 7f51fe0e5640 1 --2- 172.21.15.77:0/1311427824 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f51f81460c0 0x7f51f806dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.516+0000 7f51fe0e5640 1 --2- 172.21.15.77:0/1311427824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51f80c37d0 0x7f51f806d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.516+0000 7f51fe0e5640 1 --2- 172.21.15.77:0/1311427824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51f8070710 0x7f51f815c830 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.516+0000 7f51fe0e5640 1 -- 172.21.15.77:0/1311427824 >> 172.21.15.77:0/1311427824 conn(0x7f51f80ce950 msgr2=0x7f51f81452d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:07.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.516+0000 7f51fe0e5640 1 -- 172.21.15.77:0/1311427824 shutdown_connections 2023-11-04T01:43:07.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.516+0000 7f51fe0e5640 1 -- 172.21.15.77:0/1311427824 wait complete. 2023-11-04T01:43:07.529 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:43:07.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.630+0000 7f169bb7c640 1 Processor -- start 2023-11-04T01:43:07.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.630+0000 7f169bb7c640 1 -- start start 2023-11-04T01:43:07.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.631+0000 7f169bb7c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f169415ad40 0x7f169406b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.631+0000 7f169bb7c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f16940c9b60 0x7f1694070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.631+0000 7f169bb7c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1694065df0 con 0x7f169415b120 2023-11-04T01:43:07.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.631+0000 7f169bb7c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f169406bc40 con 0x7f169415ad40 2023-11-04T01:43:07.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.631+0000 7f169bb7c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1694066040 con 0x7f16940c9b60 2023-11-04T01:43:07.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.631+0000 7f169a119640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f16940c9b60 0x7f1694070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.631+0000 7f1699918640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f169415ad40 0x7f169406b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.631+0000 7f169a119640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f16940c9b60 0x7f1694070ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:48814/0 (socket says 172.21.15.77:48814) 2023-11-04T01:43:07.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.631+0000 7f1699117640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f169415b120 0x7f169415f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:33258/0 (socket says 172.21.15.77:33258) 2023-11-04T01:43:07.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.631+0000 7f1699918640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f169415ad40 0x7f169406b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:51918/0 (socket says 172.21.15.77:51918) 2023-11-04T01:43:07.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.631+0000 7f169a119640 1 -- 172.21.15.77:0/1012701808 learned_addr learned my addr 172.21.15.77:0/1012701808 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:07.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.632+0000 7f169a119640 1 -- 172.21.15.77:0/1012701808 >> v2:172.21.15.122:3300/0 conn(0x7f169415ad40 msgr2=0x7f169406b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:07.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.632+0000 7f169a119640 1 --2- 172.21.15.77:0/1012701808 >> v2:172.21.15.122:3300/0 conn(0x7f169415ad40 0x7f169406b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.632+0000 7f169a119640 1 -- 172.21.15.77:0/1012701808 >> v1:172.21.15.122:6789/0 conn(0x7f169415b120 legacy=0x7f169415f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.632+0000 7f169a119640 1 -- 172.21.15.77:0/1012701808 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1694066320 con 0x7f16940c9b60 2023-11-04T01:43:07.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.632+0000 7f1699918640 1 --2- 172.21.15.77:0/1012701808 >> v2:172.21.15.122:3300/0 conn(0x7f169415ad40 0x7f169406b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:43:07.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.632+0000 7f169a119640 1 --2- 172.21.15.77:0/1012701808 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f16940c9b60 0x7f1694070ff0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f168c009e50 tx=0x7f168c02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bb633fdbf476618 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:07.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.633+0000 7f1698916640 1 -- 172.21.15.77:0/1012701808 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c02cb00 con 0x7f16940c9b60 2023-11-04T01:43:07.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.633+0000 7f1698916640 1 -- 172.21.15.77:0/1012701808 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168c02cc60 con 0x7f16940c9b60 2023-11-04T01:43:07.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.633+0000 7f1698916640 1 -- 172.21.15.77:0/1012701808 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c0343f0 con 0x7f16940c9b60 2023-11-04T01:43:07.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.633+0000 7f169bb7c640 1 -- 172.21.15.77:0/1012701808 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f16940c9b60 msgr2=0x7f1694070ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.633+0000 7f169bb7c640 1 --2- 172.21.15.77:0/1012701808 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f16940c9b60 0x7f1694070ff0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f168c009e50 tx=0x7f168c02bf60 comp rx=0 tx=0).stop 2023-11-04T01:43:07.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.633+0000 7f169bb7c640 1 -- 172.21.15.77:0/1012701808 shutdown_connections 2023-11-04T01:43:07.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.633+0000 7f169bb7c640 1 --2- 172.21.15.77:0/1012701808 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f16940c9b60 0x7f1694070ff0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.633+0000 7f169bb7c640 1 --2- 172.21.15.77:0/1012701808 >> v2:172.21.15.122:3300/0 conn(0x7f169415ad40 0x7f169406b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.633+0000 7f169bb7c640 1 -- 172.21.15.77:0/1012701808 >> 172.21.15.77:0/1012701808 conn(0x7f16940cbc90 msgr2=0x7f16940cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:07.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.633+0000 7f169bb7c640 1 -- 172.21.15.77:0/1012701808 shutdown_connections 2023-11-04T01:43:07.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.633+0000 7f169bb7c640 1 -- 172.21.15.77:0/1012701808 wait complete. 2023-11-04T01:43:07.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.634+0000 7f169bb7c640 1 Processor -- start 2023-11-04T01:43:07.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.635+0000 7f169bb7c640 1 -- start start 2023-11-04T01:43:07.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.635+0000 7f169bb7c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f16940c9b60 0x7f16941f2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.635+0000 7f169bb7c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f169415ad40 0x7f1694156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.635+0000 7f169bb7c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f169415b120 0x7f16940c9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.635+0000 7f169bb7c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16941f3dd0 con 0x7f169415b120 2023-11-04T01:43:07.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.635+0000 7f169bb7c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16941f3250 con 0x7f16940c9b60 2023-11-04T01:43:07.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.635+0000 7f169bb7c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16941f3530 con 0x7f169415ad40 2023-11-04T01:43:07.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.635+0000 7f169a119640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f169415b120 0x7f16940c9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.635+0000 7f169a119640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f169415b120 0x7f16940c9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56684/0 (socket says 172.21.15.77:56684) 2023-11-04T01:43:07.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.635+0000 7f169a119640 1 -- 172.21.15.77:0/1357414589 learned_addr learned my addr 172.21.15.77:0/1357414589 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:07.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.635+0000 7f1699117640 1 --2- 172.21.15.77:0/1357414589 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f169415ad40 0x7f1694156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.635+0000 7f1699918640 1 --2- 172.21.15.77:0/1357414589 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f16940c9b60 0x7f16941f2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.636+0000 7f169a119640 1 -- 172.21.15.77:0/1357414589 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f169415ad40 msgr2=0x7f1694156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.636+0000 7f169a119640 1 --2- 172.21.15.77:0/1357414589 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f169415ad40 0x7f1694156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.636+0000 7f169a119640 1 -- 172.21.15.77:0/1357414589 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f16940c9b60 msgr2=0x7f16941f2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.636+0000 7f169a119640 1 --2- 172.21.15.77:0/1357414589 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f16940c9b60 0x7f16941f2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.636+0000 7f169a119640 1 -- 172.21.15.77:0/1357414589 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1690009400 con 0x7f169415b120 2023-11-04T01:43:07.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.636+0000 7f169a119640 1 --2- 172.21.15.77:0/1357414589 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f169415b120 0x7f16940c9150 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f168c009e50 tx=0x7f168c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:07.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.636+0000 7f168a7fc640 1 -- 172.21.15.77:0/1357414589 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c009510 con 0x7f169415b120 2023-11-04T01:43:07.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.636+0000 7f168a7fc640 1 -- 172.21.15.77:0/1357414589 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168c03e450 con 0x7f169415b120 2023-11-04T01:43:07.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.636+0000 7f168a7fc640 1 -- 172.21.15.77:0/1357414589 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c03e800 con 0x7f169415b120 2023-11-04T01:43:07.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.636+0000 7f169bb7c640 1 -- 172.21.15.77:0/1357414589 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f168c009b30 con 0x7f169415b120 2023-11-04T01:43:07.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.636+0000 7f169bb7c640 1 -- 172.21.15.77:0/1357414589 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16941f3af0 con 0x7f169415b120 2023-11-04T01:43:07.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.637+0000 7f169bb7c640 1 -- 172.21.15.77:0/1357414589 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1694074290 con 0x7f169415b120 2023-11-04T01:43:07.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.637+0000 7f168a7fc640 1 -- 172.21.15.77:0/1357414589 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f168c03e960 con 0x7f169415b120 2023-11-04T01:43:07.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.638+0000 7f168a7fc640 1 --2- 172.21.15.77:0/1357414589 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f167806ae70 0x7f167806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.638+0000 7f168a7fc640 1 -- 172.21.15.77:0/1357414589 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f168c0ac640 con 0x7f169415b120 2023-11-04T01:43:07.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.638+0000 7f1699918640 1 --2- 172.21.15.77:0/1357414589 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f167806ae70 0x7f167806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.638+0000 7f1699918640 1 --2- 172.21.15.77:0/1357414589 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f167806ae70 0x7f167806d330 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1690009cd0 tx=0x7f1690009190 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:07.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.642+0000 7f168a7fc640 1 -- 172.21.15.77:0/1357414589 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f168c0772c0 con 0x7f169415b120 2023-11-04T01:43:07.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.806+0000 7f169bb7c640 1 -- 172.21.15.77:0/1357414589 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f169406ddd0 con 0x7f169415b120 2023-11-04T01:43:07.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.807+0000 7f168a7fc640 1 -- 172.21.15.77:0/1357414589 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v83) v1 ==== 103+0+11 (secure 0 0 0) 0x7f168c07a8e0 con 0x7f169415b120 2023-11-04T01:43:07.809 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:43:07.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.808+0000 7f169bb7c640 1 -- 172.21.15.77:0/1357414589 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f167806ae70 msgr2=0x7f167806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.808+0000 7f169bb7c640 1 --2- 172.21.15.77:0/1357414589 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f167806ae70 0x7f167806d330 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1690009cd0 tx=0x7f1690009190 comp rx=0 tx=0).stop 2023-11-04T01:43:07.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.808+0000 7f169bb7c640 1 -- 172.21.15.77:0/1357414589 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f169415b120 msgr2=0x7f16940c9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.808+0000 7f169bb7c640 1 --2- 172.21.15.77:0/1357414589 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f169415b120 0x7f16940c9150 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f168c009e50 tx=0x7f168c004a40 comp rx=0 tx=0).stop 2023-11-04T01:43:07.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.808+0000 7f169bb7c640 1 -- 172.21.15.77:0/1357414589 shutdown_connections 2023-11-04T01:43:07.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.808+0000 7f169bb7c640 1 --2- 172.21.15.77:0/1357414589 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f167806ae70 0x7f167806d330 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.808+0000 7f169bb7c640 1 --2- 172.21.15.77:0/1357414589 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f169415b120 0x7f16940c9150 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.808+0000 7f169bb7c640 1 --2- 172.21.15.77:0/1357414589 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f169415ad40 0x7f1694156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.808+0000 7f169bb7c640 1 --2- 172.21.15.77:0/1357414589 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f16940c9b60 0x7f16941f2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.808+0000 7f169bb7c640 1 -- 172.21.15.77:0/1357414589 >> 172.21.15.77:0/1357414589 conn(0x7f16940cbc90 msgr2=0x7f1694158330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:07.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.808+0000 7f169bb7c640 1 -- 172.21.15.77:0/1357414589 shutdown_connections 2023-11-04T01:43:07.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.808+0000 7f169bb7c640 1 -- 172.21.15.77:0/1357414589 wait complete. 2023-11-04T01:43:07.821 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:43:07.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.921+0000 7ff60c978640 1 Processor -- start 2023-11-04T01:43:07.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.921+0000 7ff60c978640 1 -- start start 2023-11-04T01:43:07.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.922+0000 7ff60c978640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff608159c00 0x7ff6080cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.922+0000 7ff60c978640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff6080ae1d0 0x7ff6080c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.922+0000 7ff60c978640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff60815aff0 con 0x7ff6080c48e0 2023-11-04T01:43:07.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.922+0000 7ff60c978640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6080c52d0 con 0x7ff608159c00 2023-11-04T01:43:07.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.922+0000 7ff60c978640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60815a3e0 con 0x7ff6080ae1d0 2023-11-04T01:43:07.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.922+0000 7ff60659c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff608159c00 0x7ff6080cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.922+0000 7ff606d9d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff6080ae1d0 0x7ff6080c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.922+0000 7ff5fffff640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7ff6080c48e0 0x7ff6080adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:33266/0 (socket says 172.21.15.77:33266) 2023-11-04T01:43:07.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.922+0000 7ff5fffff640 1 -- 172.21.15.77:0/576627938 learned_addr learned my addr 172.21.15.77:0/576627938 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:07.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.922+0000 7ff605d9b640 1 -- 172.21.15.77:0/576627938 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1826452817 0 0) 0x7ff60815aff0 con 0x7ff6080c48e0 2023-11-04T01:43:07.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.922+0000 7ff605d9b640 1 -- 172.21.15.77:0/576627938 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5f4003520 con 0x7ff6080c48e0 2023-11-04T01:43:07.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.922+0000 7ff60659c640 1 -- 172.21.15.77:0/576627938 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff6080ae1d0 msgr2=0x7ff6080c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:07.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.922+0000 7ff60659c640 1 --2- 172.21.15.77:0/576627938 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff6080ae1d0 0x7ff6080c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.922+0000 7ff60659c640 1 -- 172.21.15.77:0/576627938 >> v1:172.21.15.122:6789/0 conn(0x7ff6080c48e0 legacy=0x7ff6080adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.922+0000 7ff60659c640 1 -- 172.21.15.77:0/576627938 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60815a6c0 con 0x7ff608159c00 2023-11-04T01:43:07.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.922+0000 7ff606d9d640 1 --2- 172.21.15.77:0/576627938 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff6080ae1d0 0x7ff6080c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:43:07.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.923+0000 7ff60659c640 1 --2- 172.21.15.77:0/576627938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff608159c00 0x7ff6080cc890 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff5f80097a0 tx=0x7ff5f802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de689fd8d40db45a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:07.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.923+0000 7ff605d9b640 1 -- 172.21.15.77:0/576627938 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f802e070 con 0x7ff608159c00 2023-11-04T01:43:07.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.923+0000 7ff605d9b640 1 -- 172.21.15.77:0/576627938 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f80315a0 con 0x7ff608159c00 2023-11-04T01:43:07.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.923+0000 7ff605d9b640 1 -- 172.21.15.77:0/576627938 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f8031930 con 0x7ff608159c00 2023-11-04T01:43:07.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.924+0000 7ff60c978640 1 -- 172.21.15.77:0/576627938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff608159c00 msgr2=0x7ff6080cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.924+0000 7ff60c978640 1 --2- 172.21.15.77:0/576627938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff608159c00 0x7ff6080cc890 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff5f80097a0 tx=0x7ff5f802b840 comp rx=0 tx=0).stop 2023-11-04T01:43:07.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.924+0000 7ff60c978640 1 -- 172.21.15.77:0/576627938 shutdown_connections 2023-11-04T01:43:07.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.924+0000 7ff60c978640 1 --2- 172.21.15.77:0/576627938 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff6080ae1d0 0x7ff6080c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.924+0000 7ff60c978640 1 --2- 172.21.15.77:0/576627938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff608159c00 0x7ff6080cc890 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.924+0000 7ff60c978640 1 -- 172.21.15.77:0/576627938 >> 172.21.15.77:0/576627938 conn(0x7ff6080ce950 msgr2=0x7ff6080ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:07.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.924+0000 7ff60c978640 1 -- 172.21.15.77:0/576627938 shutdown_connections 2023-11-04T01:43:07.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.924+0000 7ff60c978640 1 -- 172.21.15.77:0/576627938 wait complete. 2023-11-04T01:43:07.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.925+0000 7ff60c978640 1 Processor -- start 2023-11-04T01:43:07.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.925+0000 7ff60c978640 1 -- start start 2023-11-04T01:43:07.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.926+0000 7ff60c978640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6080ae1d0 0x7ff60815c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.926+0000 7ff60c978640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff6080c48e0 0x7ff6080c7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.926+0000 7ff60c978640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff608159c00 0x7ff6080c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.926+0000 7ff60c978640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60815c100 con 0x7ff608159c00 2023-11-04T01:43:07.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.926+0000 7ff60c978640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60815b1a0 con 0x7ff6080ae1d0 2023-11-04T01:43:07.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.926+0000 7ff60c978640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60815b480 con 0x7ff6080c48e0 2023-11-04T01:43:07.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.926+0000 7ff606d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff608159c00 0x7ff6080c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.926+0000 7ff606d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff608159c00 0x7ff6080c7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56686/0 (socket says 172.21.15.77:56686) 2023-11-04T01:43:07.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.926+0000 7ff606d9d640 1 -- 172.21.15.77:0/1266822922 learned_addr learned my addr 172.21.15.77:0/1266822922 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:07.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.926+0000 7ff60659c640 1 --2- 172.21.15.77:0/1266822922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6080ae1d0 0x7ff60815c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.926+0000 7ff5fffff640 1 --2- 172.21.15.77:0/1266822922 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff6080c48e0 0x7ff6080c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.926+0000 7ff606d9d640 1 -- 172.21.15.77:0/1266822922 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff6080c48e0 msgr2=0x7ff6080c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.926+0000 7ff606d9d640 1 --2- 172.21.15.77:0/1266822922 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff6080c48e0 0x7ff6080c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.926+0000 7ff606d9d640 1 -- 172.21.15.77:0/1266822922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6080ae1d0 msgr2=0x7ff60815c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.926+0000 7ff606d9d640 1 --2- 172.21.15.77:0/1266822922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6080ae1d0 0x7ff60815c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.926+0000 7ff606d9d640 1 -- 172.21.15.77:0/1266822922 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff600009a70 con 0x7ff608159c00 2023-11-04T01:43:07.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.926+0000 7ff606d9d640 1 --2- 172.21.15.77:0/1266822922 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff608159c00 0x7ff6080c7a60 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7ff60000efc0 tx=0x7ff600009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:07.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.927+0000 7ff5feffd640 1 -- 172.21.15.77:0/1266822922 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff600009d70 con 0x7ff608159c00 2023-11-04T01:43:07.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.927+0000 7ff60c978640 1 -- 172.21.15.77:0/1266822922 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f8009400 con 0x7ff608159c00 2023-11-04T01:43:07.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.927+0000 7ff5feffd640 1 -- 172.21.15.77:0/1266822922 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60000f040 con 0x7ff608159c00 2023-11-04T01:43:07.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.927+0000 7ff5feffd640 1 -- 172.21.15.77:0/1266822922 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff600003990 con 0x7ff608159c00 2023-11-04T01:43:07.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.927+0000 7ff60c978640 1 -- 172.21.15.77:0/1266822922 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff60815ba40 con 0x7ff608159c00 2023-11-04T01:43:07.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.928+0000 7ff60c978640 1 -- 172.21.15.77:0/1266822922 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff608141650 con 0x7ff608159c00 2023-11-04T01:43:07.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.928+0000 7ff5feffd640 1 -- 172.21.15.77:0/1266822922 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff6000144a0 con 0x7ff608159c00 2023-11-04T01:43:07.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.928+0000 7ff5feffd640 1 --2- 172.21.15.77:0/1266822922 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff5e806ae70 0x7ff5e806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.929+0000 7ff5feffd640 1 -- 172.21.15.77:0/1266822922 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7ff60008a620 con 0x7ff608159c00 2023-11-04T01:43:07.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.929+0000 7ff60659c640 1 --2- 172.21.15.77:0/1266822922 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff5e806ae70 0x7ff5e806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.929+0000 7ff60659c640 1 --2- 172.21.15.77:0/1266822922 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff5e806ae70 0x7ff5e806d330 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8036000 tx=0x7ff5f803d040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:07.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:07.933+0000 7ff5feffd640 1 -- 172.21.15.77:0/1266822922 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff600055220 con 0x7ff608159c00 2023-11-04T01:43:08.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.098+0000 7ff60c978640 1 -- 172.21.15.77:0/1266822922 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7ff608074290 con 0x7ff608159c00 2023-11-04T01:43:08.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.099+0000 7ff5feffd640 1 -- 172.21.15.77:0/1266822922 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v83) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff600058840 con 0x7ff608159c00 2023-11-04T01:43:08.102 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:43:08.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.100+0000 7ff60c978640 1 -- 172.21.15.77:0/1266822922 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff5e806ae70 msgr2=0x7ff5e806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.100+0000 7ff60c978640 1 --2- 172.21.15.77:0/1266822922 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff5e806ae70 0x7ff5e806d330 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8036000 tx=0x7ff5f803d040 comp rx=0 tx=0).stop 2023-11-04T01:43:08.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.101+0000 7ff60c978640 1 -- 172.21.15.77:0/1266822922 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff608159c00 msgr2=0x7ff6080c7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.101+0000 7ff60c978640 1 --2- 172.21.15.77:0/1266822922 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff608159c00 0x7ff6080c7a60 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7ff60000efc0 tx=0x7ff600009f90 comp rx=0 tx=0).stop 2023-11-04T01:43:08.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.101+0000 7ff60c978640 1 -- 172.21.15.77:0/1266822922 shutdown_connections 2023-11-04T01:43:08.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.101+0000 7ff60c978640 1 --2- 172.21.15.77:0/1266822922 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff5e806ae70 0x7ff5e806d330 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.101+0000 7ff60c978640 1 --2- 172.21.15.77:0/1266822922 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff608159c00 0x7ff6080c7a60 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.101+0000 7ff60c978640 1 --2- 172.21.15.77:0/1266822922 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff6080c48e0 0x7ff6080c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.101+0000 7ff60c978640 1 --2- 172.21.15.77:0/1266822922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6080ae1d0 0x7ff60815c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.101+0000 7ff60c978640 1 -- 172.21.15.77:0/1266822922 >> 172.21.15.77:0/1266822922 conn(0x7ff6080ce950 msgr2=0x7ff60814c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:08.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.101+0000 7ff60c978640 1 -- 172.21.15.77:0/1266822922 shutdown_connections 2023-11-04T01:43:08.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.101+0000 7ff60c978640 1 -- 172.21.15.77:0/1266822922 wait complete. 2023-11-04T01:43:08.114 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:43:08.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.214+0000 7ff18b6bb640 1 Processor -- start 2023-11-04T01:43:08.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.214+0000 7ff18b6bb640 1 -- start start 2023-11-04T01:43:08.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.215+0000 7ff18b6bb640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff184153850 0x7ff18415a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.215+0000 7ff18b6bb640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff1840cc520 0x7ff184070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.215+0000 7ff18b6bb640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1840c3860 con 0x7ff1840cc9a0 2023-11-04T01:43:08.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.215+0000 7ff18b6bb640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1840c9250 con 0x7ff1840cc520 2023-11-04T01:43:08.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.215+0000 7ff18b6bb640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff184153c30 con 0x7ff184153850 2023-11-04T01:43:08.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.215+0000 7ff188c56640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff1840cc520 0x7ff184070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.215+0000 7ff189457640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff184153850 0x7ff18415a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.215+0000 7ff189c58640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7ff1840cc9a0 0x7ff1840c3cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:33270/0 (socket says 172.21.15.77:33270) 2023-11-04T01:43:08.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.215+0000 7ff189c58640 1 -- 172.21.15.77:0/4190010241 learned_addr learned my addr 172.21.15.77:0/4190010241 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:08.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.216+0000 7ff17bfff640 1 -- 172.21.15.77:0/4190010241 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4079095838 0 0) 0x7ff1840c3860 con 0x7ff1840cc9a0 2023-11-04T01:43:08.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.216+0000 7ff17bfff640 1 -- 172.21.15.77:0/4190010241 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff170003520 con 0x7ff1840cc9a0 2023-11-04T01:43:08.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.216+0000 7ff188c56640 1 -- 172.21.15.77:0/4190010241 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff184153850 msgr2=0x7ff18415a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:08.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.216+0000 7ff188c56640 1 --2- 172.21.15.77:0/4190010241 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff184153850 0x7ff18415a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.216+0000 7ff188c56640 1 -- 172.21.15.77:0/4190010241 >> v1:172.21.15.122:6789/0 conn(0x7ff1840cc9a0 legacy=0x7ff1840c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.216+0000 7ff188c56640 1 -- 172.21.15.77:0/4190010241 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18415a700 con 0x7ff1840cc520 2023-11-04T01:43:08.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.216+0000 7ff189457640 1 --2- 172.21.15.77:0/4190010241 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff184153850 0x7ff18415a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:43:08.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.216+0000 7ff188c56640 1 --2- 172.21.15.77:0/4190010241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1840cc520 0x7ff184070fa0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff1740097a0 tx=0x7ff17402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d73266d4ff47a32 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:08.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.217+0000 7ff17bfff640 1 -- 172.21.15.77:0/4190010241 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff174031830 con 0x7ff1840cc520 2023-11-04T01:43:08.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.217+0000 7ff17bfff640 1 -- 172.21.15.77:0/4190010241 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff174031990 con 0x7ff1840cc520 2023-11-04T01:43:08.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.217+0000 7ff17bfff640 1 -- 172.21.15.77:0/4190010241 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff174031d20 con 0x7ff1840cc520 2023-11-04T01:43:08.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.217+0000 7ff18b6bb640 1 -- 172.21.15.77:0/4190010241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1840cc520 msgr2=0x7ff184070fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.217+0000 7ff18b6bb640 1 --2- 172.21.15.77:0/4190010241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1840cc520 0x7ff184070fa0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff1740097a0 tx=0x7ff17402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.217+0000 7ff18b6bb640 1 -- 172.21.15.77:0/4190010241 shutdown_connections 2023-11-04T01:43:08.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.217+0000 7ff18b6bb640 1 --2- 172.21.15.77:0/4190010241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1840cc520 0x7ff184070fa0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.217+0000 7ff18b6bb640 1 --2- 172.21.15.77:0/4190010241 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff184153850 0x7ff18415a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.217+0000 7ff18b6bb640 1 -- 172.21.15.77:0/4190010241 >> 172.21.15.77:0/4190010241 conn(0x7ff1840ce950 msgr2=0x7ff1840ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:08.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.218+0000 7ff18b6bb640 1 -- 172.21.15.77:0/4190010241 shutdown_connections 2023-11-04T01:43:08.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.218+0000 7ff18b6bb640 1 -- 172.21.15.77:0/4190010241 wait complete. 2023-11-04T01:43:08.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.219+0000 7ff18b6bb640 1 Processor -- start 2023-11-04T01:43:08.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.219+0000 7ff18b6bb640 1 -- start start 2023-11-04T01:43:08.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.219+0000 7ff18b6bb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1840cc520 0x7ff1840b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.219+0000 7ff18b6bb640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff1840cc9a0 0x7ff184152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.219+0000 7ff18b6bb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff184153850 0x7ff1840b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.219+0000 7ff18b6bb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1840b25d0 con 0x7ff184153850 2023-11-04T01:43:08.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.219+0000 7ff18b6bb640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1840b2870 con 0x7ff1840cc520 2023-11-04T01:43:08.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.219+0000 7ff18b6bb640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1840c6eb0 con 0x7ff1840cc9a0 2023-11-04T01:43:08.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.220+0000 7ff189c58640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff184153850 0x7ff1840b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.220+0000 7ff189c58640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff184153850 0x7ff1840b2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56688/0 (socket says 172.21.15.77:56688) 2023-11-04T01:43:08.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.220+0000 7ff189c58640 1 -- 172.21.15.77:0/2796005624 learned_addr learned my addr 172.21.15.77:0/2796005624 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:08.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.220+0000 7ff188c56640 1 --2- 172.21.15.77:0/2796005624 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff1840cc9a0 0x7ff184152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.220+0000 7ff189457640 1 --2- 172.21.15.77:0/2796005624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1840cc520 0x7ff1840b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.220+0000 7ff189c58640 1 -- 172.21.15.77:0/2796005624 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff1840cc9a0 msgr2=0x7ff184152840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.220+0000 7ff189c58640 1 --2- 172.21.15.77:0/2796005624 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff1840cc9a0 0x7ff184152840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.220+0000 7ff189c58640 1 -- 172.21.15.77:0/2796005624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1840cc520 msgr2=0x7ff1840b44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.220+0000 7ff189c58640 1 --2- 172.21.15.77:0/2796005624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1840cc520 0x7ff1840b44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.220+0000 7ff189c58640 1 -- 172.21.15.77:0/2796005624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff180009a70 con 0x7ff184153850 2023-11-04T01:43:08.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.220+0000 7ff189457640 1 --2- 172.21.15.77:0/2796005624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1840cc520 0x7ff1840b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:08.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.220+0000 7ff189c58640 1 --2- 172.21.15.77:0/2796005624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff184153850 0x7ff1840b2090 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7ff17c00c430 tx=0x7ff17c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:08.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.220+0000 7ff179ffb640 1 -- 172.21.15.77:0/2796005624 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c005ce0 con 0x7ff184153850 2023-11-04T01:43:08.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.220+0000 7ff179ffb640 1 -- 172.21.15.77:0/2796005624 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17c005e40 con 0x7ff184153850 2023-11-04T01:43:08.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.220+0000 7ff18b6bb640 1 -- 172.21.15.77:0/2796005624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff174009400 con 0x7ff184153850 2023-11-04T01:43:08.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.220+0000 7ff179ffb640 1 -- 172.21.15.77:0/2796005624 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c0072f0 con 0x7ff184153850 2023-11-04T01:43:08.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.220+0000 7ff18b6bb640 1 -- 172.21.15.77:0/2796005624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1840c7470 con 0x7ff184153850 2023-11-04T01:43:08.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.221+0000 7ff18b6bb640 1 -- 172.21.15.77:0/2796005624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff184074290 con 0x7ff184153850 2023-11-04T01:43:08.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.222+0000 7ff179ffb640 1 -- 172.21.15.77:0/2796005624 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff17c007450 con 0x7ff184153850 2023-11-04T01:43:08.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.222+0000 7ff179ffb640 1 --2- 172.21.15.77:0/2796005624 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff16806aea0 0x7ff16806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.222+0000 7ff179ffb640 1 -- 172.21.15.77:0/2796005624 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7ff17c0890c0 con 0x7ff184153850 2023-11-04T01:43:08.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.222+0000 7ff189457640 1 --2- 172.21.15.77:0/2796005624 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff16806aea0 0x7ff16806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.223+0000 7ff189457640 1 --2- 172.21.15.77:0/2796005624 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff16806aea0 0x7ff16806d360 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff1840c6860 tx=0x7ff18000b040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:08.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.226+0000 7ff179ffb640 1 -- 172.21.15.77:0/2796005624 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff17c053cc0 con 0x7ff184153850 2023-11-04T01:43:08.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.393+0000 7ff18b6bb640 1 -- 172.21.15.77:0/2796005624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7ff1840c5010 con 0x7ff184153850 2023-11-04T01:43:08.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.393+0000 7ff179ffb640 1 -- 172.21.15.77:0/2796005624 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v83) v1 ==== 107+0+11 (secure 0 0 0) 0x7ff17c0572e0 con 0x7ff184153850 2023-11-04T01:43:08.396 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:43:08.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.395+0000 7ff18b6bb640 1 -- 172.21.15.77:0/2796005624 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff16806aea0 msgr2=0x7ff16806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.395+0000 7ff18b6bb640 1 --2- 172.21.15.77:0/2796005624 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff16806aea0 0x7ff16806d360 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff1840c6860 tx=0x7ff18000b040 comp rx=0 tx=0).stop 2023-11-04T01:43:08.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.395+0000 7ff18b6bb640 1 -- 172.21.15.77:0/2796005624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff184153850 msgr2=0x7ff1840b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.395+0000 7ff18b6bb640 1 --2- 172.21.15.77:0/2796005624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff184153850 0x7ff1840b2090 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7ff17c00c430 tx=0x7ff17c00c8f0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.396+0000 7ff18b6bb640 1 -- 172.21.15.77:0/2796005624 shutdown_connections 2023-11-04T01:43:08.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.396+0000 7ff18b6bb640 1 --2- 172.21.15.77:0/2796005624 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff16806aea0 0x7ff16806d360 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.396+0000 7ff18b6bb640 1 --2- 172.21.15.77:0/2796005624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff184153850 0x7ff1840b2090 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.396+0000 7ff18b6bb640 1 --2- 172.21.15.77:0/2796005624 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff1840cc9a0 0x7ff184152840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.396+0000 7ff18b6bb640 1 --2- 172.21.15.77:0/2796005624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1840cc520 0x7ff1840b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.396+0000 7ff18b6bb640 1 -- 172.21.15.77:0/2796005624 >> 172.21.15.77:0/2796005624 conn(0x7ff1840ce950 msgr2=0x7ff18406d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:08.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.396+0000 7ff18b6bb640 1 -- 172.21.15.77:0/2796005624 shutdown_connections 2023-11-04T01:43:08.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.396+0000 7ff18b6bb640 1 -- 172.21.15.77:0/2796005624 wait complete. 2023-11-04T01:43:08.408 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:43:08.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.509+0000 7fb2f10c2640 1 Processor -- start 2023-11-04T01:43:08.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.509+0000 7fb2f10c2640 1 -- start start 2023-11-04T01:43:08.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.510+0000 7fb2f10c2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb2ec15e430 0x7fb2ec0cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.510+0000 7fb2f10c2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb2ec0cf160 0x7fb2ec0cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.510+0000 7fb2f10c2640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2ec0d0280 con 0x7fb2ec0d0710 2023-11-04T01:43:08.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.510+0000 7fb2f10c2640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2ec0cf670 con 0x7fb2ec15e430 2023-11-04T01:43:08.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.510+0000 7fb2f10c2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec0cf950 con 0x7fb2ec0cf160 2023-11-04T01:43:08.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.510+0000 7fb2ead9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb2ec15e430 0x7fb2ec0cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.510+0000 7fb2eb59e640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb2ec0d0710 0x7fb2ec0b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:56152/0 (socket says 172.21.15.77:56152) 2023-11-04T01:43:08.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.510+0000 7fb2eb59e640 1 -- 172.21.15.77:0/2723784900 learned_addr learned my addr 172.21.15.77:0/2723784900 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:08.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.511+0000 7fb2ea59c640 1 --2- 172.21.15.77:0/2723784900 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb2ec0cf160 0x7fb2ec0cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.511+0000 7fb2e9d9b640 1 -- 172.21.15.77:0/2723784900 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1956376899 0 0) 0x7fb2ec0d0280 con 0x7fb2ec0d0710 2023-11-04T01:43:08.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.511+0000 7fb2e9d9b640 1 -- 172.21.15.77:0/2723784900 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2d4003520 con 0x7fb2ec0d0710 2023-11-04T01:43:08.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.511+0000 7fb2ead9d640 1 -- 172.21.15.77:0/2723784900 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb2ec0cf160 msgr2=0x7fb2ec0cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:08.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.511+0000 7fb2ead9d640 1 --2- 172.21.15.77:0/2723784900 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb2ec0cf160 0x7fb2ec0cd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.511+0000 7fb2ead9d640 1 -- 172.21.15.77:0/2723784900 >> v1:172.21.15.77:6789/0 conn(0x7fb2ec0d0710 legacy=0x7fb2ec0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.511+0000 7fb2ead9d640 1 -- 172.21.15.77:0/2723784900 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ec0cfc30 con 0x7fb2ec15e430 2023-11-04T01:43:08.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.511+0000 7fb2ead9d640 1 --2- 172.21.15.77:0/2723784900 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2ec15e430 0x7fb2ec0cec20 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc0097a0 tx=0x7fb2dc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae6bcc2594d88c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:08.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.512+0000 7fb2e9d9b640 1 -- 172.21.15.77:0/2723784900 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc031830 con 0x7fb2ec15e430 2023-11-04T01:43:08.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.512+0000 7fb2e9d9b640 1 -- 172.21.15.77:0/2723784900 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2dc031990 con 0x7fb2ec15e430 2023-11-04T01:43:08.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.512+0000 7fb2e9d9b640 1 -- 172.21.15.77:0/2723784900 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc031d20 con 0x7fb2ec15e430 2023-11-04T01:43:08.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.512+0000 7fb2f10c2640 1 -- 172.21.15.77:0/2723784900 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2ec15e430 msgr2=0x7fb2ec0cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.512+0000 7fb2f10c2640 1 --2- 172.21.15.77:0/2723784900 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2ec15e430 0x7fb2ec0cec20 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc0097a0 tx=0x7fb2dc02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.512+0000 7fb2f10c2640 1 -- 172.21.15.77:0/2723784900 shutdown_connections 2023-11-04T01:43:08.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.512+0000 7fb2f10c2640 1 --2- 172.21.15.77:0/2723784900 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb2ec0cf160 0x7fb2ec0cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.512+0000 7fb2f10c2640 1 --2- 172.21.15.77:0/2723784900 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2ec15e430 0x7fb2ec0cec20 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.512+0000 7fb2f10c2640 1 -- 172.21.15.77:0/2723784900 >> 172.21.15.77:0/2723784900 conn(0x7fb2ec06ea20 msgr2=0x7fb2ec06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:08.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.512+0000 7fb2f10c2640 1 -- 172.21.15.77:0/2723784900 shutdown_connections 2023-11-04T01:43:08.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.512+0000 7fb2f10c2640 1 -- 172.21.15.77:0/2723784900 wait complete. 2023-11-04T01:43:08.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.514+0000 7fb2f10c2640 1 Processor -- start 2023-11-04T01:43:08.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.514+0000 7fb2f10c2640 1 -- start start 2023-11-04T01:43:08.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.514+0000 7fb2f10c2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2ec0cf160 0x7fb2ec0b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.514+0000 7fb2f10c2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb2ec0d0710 0x7fb2ec154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.514+0000 7fb2f10c2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2ec15e430 0x7fb2ec14ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.514+0000 7fb2f10c2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec0b3040 con 0x7fb2ec0cf160 2023-11-04T01:43:08.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.514+0000 7fb2f10c2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec14f360 con 0x7fb2ec15e430 2023-11-04T01:43:08.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.514+0000 7fb2f10c2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec0b24c0 con 0x7fb2ec0d0710 2023-11-04T01:43:08.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.514+0000 7fb2ead9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2ec0cf160 0x7fb2ec0b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.514+0000 7fb2ead9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2ec0cf160 0x7fb2ec0b1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56706/0 (socket says 172.21.15.77:56706) 2023-11-04T01:43:08.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.514+0000 7fb2ead9d640 1 -- 172.21.15.77:0/3624201635 learned_addr learned my addr 172.21.15.77:0/3624201635 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:08.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.515+0000 7fb2ead9d640 1 -- 172.21.15.77:0/3624201635 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb2ec0d0710 msgr2=0x7fb2ec154ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.515+0000 7fb2ea59c640 1 --2- 172.21.15.77:0/3624201635 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb2ec0d0710 0x7fb2ec154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.515+0000 7fb2ead9d640 1 --2- 172.21.15.77:0/3624201635 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb2ec0d0710 0x7fb2ec154ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.515+0000 7fb2ead9d640 1 -- 172.21.15.77:0/3624201635 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2ec15e430 msgr2=0x7fb2ec14ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.515+0000 7fb2ead9d640 1 --2- 172.21.15.77:0/3624201635 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2ec15e430 0x7fb2ec14ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.515+0000 7fb2ead9d640 1 -- 172.21.15.77:0/3624201635 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2dc009400 con 0x7fb2ec0cf160 2023-11-04T01:43:08.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.515+0000 7fb2ead9d640 1 --2- 172.21.15.77:0/3624201635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2ec0cf160 0x7fb2ec0b1ee0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc02bee0 tx=0x7fb2dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:08.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.515+0000 7fb2d37fe640 1 -- 172.21.15.77:0/3624201635 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc03a6f0 con 0x7fb2ec0cf160 2023-11-04T01:43:08.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.515+0000 7fb2d37fe640 1 -- 172.21.15.77:0/3624201635 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2dc03a870 con 0x7fb2ec0cf160 2023-11-04T01:43:08.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.515+0000 7fb2d37fe640 1 -- 172.21.15.77:0/3624201635 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc03ac20 con 0x7fb2ec0cf160 2023-11-04T01:43:08.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.515+0000 7fb2f10c2640 1 -- 172.21.15.77:0/3624201635 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2ec0b27a0 con 0x7fb2ec0cf160 2023-11-04T01:43:08.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.515+0000 7fb2f10c2640 1 -- 172.21.15.77:0/3624201635 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2ec0b2d60 con 0x7fb2ec0cf160 2023-11-04T01:43:08.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.516+0000 7fb2f10c2640 1 -- 172.21.15.77:0/3624201635 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2ec074290 con 0x7fb2ec0cf160 2023-11-04T01:43:08.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.516+0000 7fb2d37fe640 1 -- 172.21.15.77:0/3624201635 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb2dc030380 con 0x7fb2ec0cf160 2023-11-04T01:43:08.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.517+0000 7fb2d37fe640 1 --2- 172.21.15.77:0/3624201635 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb2d806ae70 0x7fb2d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.517+0000 7fb2d37fe640 1 -- 172.21.15.77:0/3624201635 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fb2dc0ab460 con 0x7fb2ec0cf160 2023-11-04T01:43:08.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.517+0000 7fb2ea59c640 1 --2- 172.21.15.77:0/3624201635 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb2d806ae70 0x7fb2d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.517+0000 7fb2ea59c640 1 --2- 172.21.15.77:0/3624201635 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb2d806ae70 0x7fb2d806d330 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0006fd0 tx=0x7fb2e0008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:08.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.521+0000 7fb2d37fe640 1 -- 172.21.15.77:0/3624201635 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb2dc076030 con 0x7fb2ec0cf160 2023-11-04T01:43:08.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.688+0000 7fb2f10c2640 1 -- 172.21.15.77:0/3624201635 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb2ec15c1d0 con 0x7fb2ec0cf160 2023-11-04T01:43:08.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.688+0000 7fb2d37fe640 1 -- 172.21.15.77:0/3624201635 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb2dc079650 con 0x7fb2ec0cf160 2023-11-04T01:43:08.691 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:43:08.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.690+0000 7fb2f10c2640 1 -- 172.21.15.77:0/3624201635 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb2d806ae70 msgr2=0x7fb2d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.690+0000 7fb2f10c2640 1 --2- 172.21.15.77:0/3624201635 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb2d806ae70 0x7fb2d806d330 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0006fd0 tx=0x7fb2e0008040 comp rx=0 tx=0).stop 2023-11-04T01:43:08.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.690+0000 7fb2f10c2640 1 -- 172.21.15.77:0/3624201635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2ec0cf160 msgr2=0x7fb2ec0b1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.690+0000 7fb2f10c2640 1 --2- 172.21.15.77:0/3624201635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2ec0cf160 0x7fb2ec0b1ee0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc02bee0 tx=0x7fb2dc0046c0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.690+0000 7fb2f10c2640 1 -- 172.21.15.77:0/3624201635 shutdown_connections 2023-11-04T01:43:08.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.690+0000 7fb2f10c2640 1 --2- 172.21.15.77:0/3624201635 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb2d806ae70 0x7fb2d806d330 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.690+0000 7fb2f10c2640 1 --2- 172.21.15.77:0/3624201635 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2ec15e430 0x7fb2ec14ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.690+0000 7fb2f10c2640 1 --2- 172.21.15.77:0/3624201635 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb2ec0d0710 0x7fb2ec154ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.690+0000 7fb2f10c2640 1 --2- 172.21.15.77:0/3624201635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2ec0cf160 0x7fb2ec0b1ee0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.690+0000 7fb2f10c2640 1 -- 172.21.15.77:0/3624201635 >> 172.21.15.77:0/3624201635 conn(0x7fb2ec06ea20 msgr2=0x7fb2ec15afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:08.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.690+0000 7fb2f10c2640 1 -- 172.21.15.77:0/3624201635 shutdown_connections 2023-11-04T01:43:08.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.690+0000 7fb2f10c2640 1 -- 172.21.15.77:0/3624201635 wait complete. 2023-11-04T01:43:08.703 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:43:08.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.803+0000 7f029b1bb640 1 Processor -- start 2023-11-04T01:43:08.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.803+0000 7f029b1bb640 1 -- start start 2023-11-04T01:43:08.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.804+0000 7f029b1bb640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0294159c00 0x7f02940cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.804+0000 7f029b1bb640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f02940ae1d0 0x7f02940c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.804+0000 7f029b1bb640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f029415aff0 con 0x7f02940c48e0 2023-11-04T01:43:08.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.804+0000 7f029b1bb640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02940c52a0 con 0x7f02940ae1d0 2023-11-04T01:43:08.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.804+0000 7f029b1bb640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029415a3e0 con 0x7f0294159c00 2023-11-04T01:43:08.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.804+0000 7f0298f57640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0294159c00 0x7f02940cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.804+0000 7f0299758640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f02940ae1d0 0x7f02940c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.804+0000 7f0293fff640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f02940c48e0 0x7f02940adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:33276/0 (socket says 172.21.15.77:33276) 2023-11-04T01:43:08.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.804+0000 7f0293fff640 1 -- 172.21.15.77:0/3022634870 learned_addr learned my addr 172.21.15.77:0/3022634870 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:08.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.804+0000 7f0298f57640 1 -- 172.21.15.77:0/3022634870 >> v2:172.21.15.122:3300/0 conn(0x7f02940ae1d0 msgr2=0x7f02940c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:08.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.804+0000 7f0298f57640 1 --2- 172.21.15.77:0/3022634870 >> v2:172.21.15.122:3300/0 conn(0x7f02940ae1d0 0x7f02940c4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.804+0000 7f0298f57640 1 -- 172.21.15.77:0/3022634870 >> v1:172.21.15.122:6789/0 conn(0x7f02940c48e0 legacy=0x7f02940adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.804+0000 7f0298f57640 1 -- 172.21.15.77:0/3022634870 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029415a6c0 con 0x7f0294159c00 2023-11-04T01:43:08.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.805+0000 7f0298f57640 1 --2- 172.21.15.77:0/3022634870 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0294159c00 0x7f02940cc890 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f02880097a0 tx=0x7f028802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a00a4ed489543847 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:08.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.805+0000 7f02937fe640 1 -- 172.21.15.77:0/3022634870 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0288031830 con 0x7f0294159c00 2023-11-04T01:43:08.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.805+0000 7f02937fe640 1 -- 172.21.15.77:0/3022634870 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0288031990 con 0x7f0294159c00 2023-11-04T01:43:08.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.805+0000 7f02937fe640 1 -- 172.21.15.77:0/3022634870 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0288031d20 con 0x7f0294159c00 2023-11-04T01:43:08.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.806+0000 7f029b1bb640 1 -- 172.21.15.77:0/3022634870 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0294159c00 msgr2=0x7f02940cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.806+0000 7f029b1bb640 1 --2- 172.21.15.77:0/3022634870 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0294159c00 0x7f02940cc890 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f02880097a0 tx=0x7f028802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.806+0000 7f029b1bb640 1 -- 172.21.15.77:0/3022634870 shutdown_connections 2023-11-04T01:43:08.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.806+0000 7f029b1bb640 1 --2- 172.21.15.77:0/3022634870 >> v2:172.21.15.122:3300/0 conn(0x7f02940ae1d0 0x7f02940c4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.806+0000 7f029b1bb640 1 --2- 172.21.15.77:0/3022634870 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0294159c00 0x7f02940cc890 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.806+0000 7f029b1bb640 1 -- 172.21.15.77:0/3022634870 >> 172.21.15.77:0/3022634870 conn(0x7f02940ce950 msgr2=0x7f02940ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:08.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.806+0000 7f029b1bb640 1 -- 172.21.15.77:0/3022634870 shutdown_connections 2023-11-04T01:43:08.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.806+0000 7f029b1bb640 1 -- 172.21.15.77:0/3022634870 wait complete. 2023-11-04T01:43:08.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.807+0000 7f029b1bb640 1 Processor -- start 2023-11-04T01:43:08.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.807+0000 7f029b1bb640 1 -- start start 2023-11-04T01:43:08.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.808+0000 7f029b1bb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02940ae1d0 0x7f02940c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.808+0000 7f029b1bb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02940c48e0 0x7f0294142900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.808+0000 7f029b1bb640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0294159c00 0x7f029414b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.808+0000 7f029b1bb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02940c7e30 con 0x7f02940c48e0 2023-11-04T01:43:08.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.808+0000 7f029b1bb640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02940c79a0 con 0x7f02940ae1d0 2023-11-04T01:43:08.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.808+0000 7f029b1bb640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02940c6cf0 con 0x7f0294159c00 2023-11-04T01:43:08.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.808+0000 7f0293fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02940c48e0 0x7f0294142900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.808+0000 7f0293fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02940c48e0 0x7f0294142900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56708/0 (socket says 172.21.15.77:56708) 2023-11-04T01:43:08.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.808+0000 7f0293fff640 1 -- 172.21.15.77:0/624188544 learned_addr learned my addr 172.21.15.77:0/624188544 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:08.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.808+0000 7f0299758640 1 --2- 172.21.15.77:0/624188544 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0294159c00 0x7f029414b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.808+0000 7f0298f57640 1 --2- 172.21.15.77:0/624188544 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02940ae1d0 0x7f02940c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.808+0000 7f0293fff640 1 -- 172.21.15.77:0/624188544 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0294159c00 msgr2=0x7f029414b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.808+0000 7f0293fff640 1 --2- 172.21.15.77:0/624188544 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0294159c00 0x7f029414b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.808+0000 7f0293fff640 1 -- 172.21.15.77:0/624188544 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02940ae1d0 msgr2=0x7f02940c6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.808+0000 7f0293fff640 1 --2- 172.21.15.77:0/624188544 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02940ae1d0 0x7f02940c6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.808+0000 7f0293fff640 1 -- 172.21.15.77:0/624188544 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0288009400 con 0x7f02940c48e0 2023-11-04T01:43:08.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.808+0000 7f0298f57640 1 --2- 172.21.15.77:0/624188544 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02940ae1d0 0x7f02940c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:08.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.809+0000 7f0293fff640 1 --2- 172.21.15.77:0/624188544 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02940c48e0 0x7f0294142900 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f028000c4a0 tx=0x7f028000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:08.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.809+0000 7f02917fa640 1 -- 172.21.15.77:0/624188544 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0280005ce0 con 0x7f02940c48e0 2023-11-04T01:43:08.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.809+0000 7f02917fa640 1 -- 172.21.15.77:0/624188544 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0280005e40 con 0x7f02940c48e0 2023-11-04T01:43:08.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.809+0000 7f02917fa640 1 -- 172.21.15.77:0/624188544 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0280007270 con 0x7f02940c48e0 2023-11-04T01:43:08.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.809+0000 7f029b1bb640 1 -- 172.21.15.77:0/624188544 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02940c6a10 con 0x7f02940c48e0 2023-11-04T01:43:08.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.809+0000 7f029b1bb640 1 -- 172.21.15.77:0/624188544 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02940c7630 con 0x7f02940c48e0 2023-11-04T01:43:08.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.810+0000 7f029b1bb640 1 -- 172.21.15.77:0/624188544 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02940c7b50 con 0x7f02940c48e0 2023-11-04T01:43:08.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.810+0000 7f02917fa640 1 -- 172.21.15.77:0/624188544 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f02800073d0 con 0x7f02940c48e0 2023-11-04T01:43:08.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.810+0000 7f02917fa640 1 --2- 172.21.15.77:0/624188544 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f027806aea0 0x7f027806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.810+0000 7f02917fa640 1 -- 172.21.15.77:0/624188544 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f0280088f70 con 0x7f02940c48e0 2023-11-04T01:43:08.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.810+0000 7f0298f57640 1 --2- 172.21.15.77:0/624188544 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f027806aea0 0x7f027806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.811+0000 7f0298f57640 1 --2- 172.21.15.77:0/624188544 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f027806aea0 0x7f027806d360 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f0288036000 tx=0x7f028803c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:08.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.814+0000 7f02917fa640 1 -- 172.21.15.77:0/624188544 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f02800bbca0 con 0x7f02940c48e0 2023-11-04T01:43:08.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.983+0000 7f029b1bb640 1 -- 172.21.15.77:0/624188544 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0294074290 con 0x7f02940c48e0 2023-11-04T01:43:08.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.983+0000 7f02917fa640 1 -- 172.21.15.77:0/624188544 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0280017020 con 0x7f02940c48e0 2023-11-04T01:43:08.986 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-04T01:43:08.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.985+0000 7f029b1bb640 1 -- 172.21.15.77:0/624188544 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f027806aea0 msgr2=0x7f027806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.985+0000 7f029b1bb640 1 --2- 172.21.15.77:0/624188544 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f027806aea0 0x7f027806d360 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f0288036000 tx=0x7f028803c040 comp rx=0 tx=0).stop 2023-11-04T01:43:08.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.985+0000 7f029b1bb640 1 -- 172.21.15.77:0/624188544 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02940c48e0 msgr2=0x7f0294142900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.985+0000 7f029b1bb640 1 --2- 172.21.15.77:0/624188544 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02940c48e0 0x7f0294142900 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f028000c4a0 tx=0x7f028000c960 comp rx=0 tx=0).stop 2023-11-04T01:43:08.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.985+0000 7f029b1bb640 1 -- 172.21.15.77:0/624188544 shutdown_connections 2023-11-04T01:43:08.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.985+0000 7f029b1bb640 1 --2- 172.21.15.77:0/624188544 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f027806aea0 0x7f027806d360 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.985+0000 7f029b1bb640 1 --2- 172.21.15.77:0/624188544 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0294159c00 0x7f029414b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.985+0000 7f029b1bb640 1 --2- 172.21.15.77:0/624188544 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02940c48e0 0x7f0294142900 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.985+0000 7f029b1bb640 1 --2- 172.21.15.77:0/624188544 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02940ae1d0 0x7f02940c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.985+0000 7f029b1bb640 1 -- 172.21.15.77:0/624188544 >> 172.21.15.77:0/624188544 conn(0x7f02940ce950 msgr2=0x7f029414ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:08.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.985+0000 7f029b1bb640 1 -- 172.21.15.77:0/624188544 shutdown_connections 2023-11-04T01:43:08.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:08.985+0000 7f029b1bb640 1 -- 172.21.15.77:0/624188544 wait complete. 2023-11-04T01:43:08.998 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:43:09.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.096+0000 7f4b69694640 1 Processor -- start 2023-11-04T01:43:09.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.096+0000 7f4b69694640 1 -- start start 2023-11-04T01:43:09.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.097+0000 7f4b69694640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4b640cc520 0x7f4b64070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.097+0000 7f4b69694640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4b640cc9d0 0x7f4b640714e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.097+0000 7f4b69694640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b640c3860 con 0x7f4b64153850 2023-11-04T01:43:09.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.097+0000 7f4b69694640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b640c9250 con 0x7f4b640cc9d0 2023-11-04T01:43:09.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.097+0000 7f4b69694640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b64153c30 con 0x7f4b640cc520 2023-11-04T01:43:09.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.097+0000 7f4b637fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4b640cc9d0 0x7f4b640714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.097+0000 7f4b62ffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f4b64153850 0x7f4b6415a1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:56154/0 (socket says 172.21.15.77:56154) 2023-11-04T01:43:09.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.097+0000 7f4b62ffd640 1 -- 172.21.15.77:0/982831264 learned_addr learned my addr 172.21.15.77:0/982831264 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:09.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.097+0000 7f4b627fc640 1 --2- 172.21.15.77:0/982831264 >> v2:172.21.15.122:3300/0 conn(0x7f4b640cc520 0x7f4b64070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.097+0000 7f4b637fe640 1 -- 172.21.15.77:0/982831264 >> v2:172.21.15.122:3300/0 conn(0x7f4b640cc520 msgr2=0x7f4b64070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:09.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.097+0000 7f4b637fe640 1 --2- 172.21.15.77:0/982831264 >> v2:172.21.15.122:3300/0 conn(0x7f4b640cc520 0x7f4b64070fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.097+0000 7f4b637fe640 1 -- 172.21.15.77:0/982831264 >> v1:172.21.15.77:6789/0 conn(0x7f4b64153850 legacy=0x7f4b6415a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.097+0000 7f4b61ffb640 1 -- 172.21.15.77:0/982831264 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1189981502 0 0) 0x7f4b640c3860 con 0x7f4b64153850 2023-11-04T01:43:09.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.097+0000 7f4b637fe640 1 -- 172.21.15.77:0/982831264 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b640ce590 con 0x7f4b640cc9d0 2023-11-04T01:43:09.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.098+0000 7f4b637fe640 1 --2- 172.21.15.77:0/982831264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b640cc9d0 0x7f4b640714e0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f4b64070560 tx=0x7f4b5c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6404cb02dd46a50f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:09.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.098+0000 7f4b61ffb640 1 -- 172.21.15.77:0/982831264 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c031830 con 0x7f4b640cc9d0 2023-11-04T01:43:09.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.098+0000 7f4b61ffb640 1 -- 172.21.15.77:0/982831264 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b5c031990 con 0x7f4b640cc9d0 2023-11-04T01:43:09.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.098+0000 7f4b61ffb640 1 -- 172.21.15.77:0/982831264 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c031d20 con 0x7f4b640cc9d0 2023-11-04T01:43:09.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.099+0000 7f4b69694640 1 -- 172.21.15.77:0/982831264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b640cc9d0 msgr2=0x7f4b640714e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.099+0000 7f4b69694640 1 --2- 172.21.15.77:0/982831264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b640cc9d0 0x7f4b640714e0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f4b64070560 tx=0x7f4b5c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.099+0000 7f4b69694640 1 -- 172.21.15.77:0/982831264 shutdown_connections 2023-11-04T01:43:09.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.099+0000 7f4b69694640 1 --2- 172.21.15.77:0/982831264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b640cc9d0 0x7f4b640714e0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.099+0000 7f4b69694640 1 --2- 172.21.15.77:0/982831264 >> v2:172.21.15.122:3300/0 conn(0x7f4b640cc520 0x7f4b64070fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.099+0000 7f4b69694640 1 -- 172.21.15.77:0/982831264 >> 172.21.15.77:0/982831264 conn(0x7f4b640ce950 msgr2=0x7f4b640ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:09.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.099+0000 7f4b69694640 1 -- 172.21.15.77:0/982831264 shutdown_connections 2023-11-04T01:43:09.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.099+0000 7f4b69694640 1 -- 172.21.15.77:0/982831264 wait complete. 2023-11-04T01:43:09.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.100+0000 7f4b69694640 1 Processor -- start 2023-11-04T01:43:09.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.100+0000 7f4b69694640 1 -- start start 2023-11-04T01:43:09.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.101+0000 7f4b69694640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b640cc520 0x7f4b6414a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.101+0000 7f4b69694640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b640cc9d0 0x7f4b640b0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.101+0000 7f4b69694640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b64153850 0x7f4b640b2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.101+0000 7f4b69694640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b640b2bd0 con 0x7f4b640cc9d0 2023-11-04T01:43:09.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.101+0000 7f4b69694640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b640b0990 con 0x7f4b64153850 2023-11-04T01:43:09.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.101+0000 7f4b69694640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b640af2a0 con 0x7f4b640cc520 2023-11-04T01:43:09.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.101+0000 7f4b627fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b640cc9d0 0x7f4b640b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.101+0000 7f4b627fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b640cc9d0 0x7f4b640b0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56726/0 (socket says 172.21.15.77:56726) 2023-11-04T01:43:09.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.101+0000 7f4b627fc640 1 -- 172.21.15.77:0/2881962877 learned_addr learned my addr 172.21.15.77:0/2881962877 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:09.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.101+0000 7f4b62ffd640 1 --2- 172.21.15.77:0/2881962877 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b640cc520 0x7f4b6414a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.101+0000 7f4b637fe640 1 --2- 172.21.15.77:0/2881962877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b64153850 0x7f4b640b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.101+0000 7f4b627fc640 1 -- 172.21.15.77:0/2881962877 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b640cc520 msgr2=0x7f4b6414a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.101+0000 7f4b627fc640 1 --2- 172.21.15.77:0/2881962877 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b640cc520 0x7f4b6414a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.101+0000 7f4b627fc640 1 -- 172.21.15.77:0/2881962877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b64153850 msgr2=0x7f4b640b2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.101+0000 7f4b627fc640 1 --2- 172.21.15.77:0/2881962877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b64153850 0x7f4b640b2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.101+0000 7f4b627fc640 1 -- 172.21.15.77:0/2881962877 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b5c009400 con 0x7f4b640cc9d0 2023-11-04T01:43:09.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.101+0000 7f4b627fc640 1 --2- 172.21.15.77:0/2881962877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b640cc9d0 0x7f4b640b0290 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800c820 tx=0x7f4b5800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:09.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.101+0000 7f4b4b7fe640 1 -- 172.21.15.77:0/2881962877 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b58004020 con 0x7f4b640cc9d0 2023-11-04T01:43:09.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.102+0000 7f4b4b7fe640 1 -- 172.21.15.77:0/2881962877 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b58004180 con 0x7f4b640cc9d0 2023-11-04T01:43:09.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.102+0000 7f4b4b7fe640 1 -- 172.21.15.77:0/2881962877 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b58007830 con 0x7f4b640cc9d0 2023-11-04T01:43:09.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.102+0000 7f4b69694640 1 -- 172.21.15.77:0/2881962877 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b640ae4e0 con 0x7f4b640cc9d0 2023-11-04T01:43:09.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.102+0000 7f4b69694640 1 -- 172.21.15.77:0/2881962877 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b640aeaa0 con 0x7f4b640cc9d0 2023-11-04T01:43:09.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.103+0000 7f4b69694640 1 -- 172.21.15.77:0/2881962877 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b64074290 con 0x7f4b640cc9d0 2023-11-04T01:43:09.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.103+0000 7f4b4b7fe640 1 -- 172.21.15.77:0/2881962877 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4b58007990 con 0x7f4b640cc9d0 2023-11-04T01:43:09.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.103+0000 7f4b4b7fe640 1 --2- 172.21.15.77:0/2881962877 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4b5006ae70 0x7f4b5006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.103+0000 7f4b4b7fe640 1 -- 172.21.15.77:0/2881962877 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f4b580897c0 con 0x7f4b640cc9d0 2023-11-04T01:43:09.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.103+0000 7f4b62ffd640 1 --2- 172.21.15.77:0/2881962877 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4b5006ae70 0x7f4b5006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.104+0000 7f4b62ffd640 1 --2- 172.21.15.77:0/2881962877 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4b5006ae70 0x7f4b5006d330 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4b540012e0 tx=0x7f4b54001700 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:09.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.107+0000 7f4b4b7fe640 1 -- 172.21.15.77:0/2881962877 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4b580543b0 con 0x7f4b640cc9d0 2023-11-04T01:43:09.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.286+0000 7f4b69694640 1 -- 172.21.15.77:0/2881962877 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4b640c5010 con 0x7f4b640cc9d0 2023-11-04T01:43:09.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.286+0000 7f4b4b7fe640 1 -- 172.21.15.77:0/2881962877 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v83) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4b580579d0 con 0x7f4b640cc9d0 2023-11-04T01:43:09.289 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-11-04T01:43:09.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.288+0000 7f4b69694640 1 -- 172.21.15.77:0/2881962877 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4b5006ae70 msgr2=0x7f4b5006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.288+0000 7f4b69694640 1 --2- 172.21.15.77:0/2881962877 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4b5006ae70 0x7f4b5006d330 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4b540012e0 tx=0x7f4b54001700 comp rx=0 tx=0).stop 2023-11-04T01:43:09.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.288+0000 7f4b69694640 1 -- 172.21.15.77:0/2881962877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b640cc9d0 msgr2=0x7f4b640b0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.288+0000 7f4b69694640 1 --2- 172.21.15.77:0/2881962877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b640cc9d0 0x7f4b640b0290 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800c820 tx=0x7f4b5800cce0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.288+0000 7f4b69694640 1 -- 172.21.15.77:0/2881962877 shutdown_connections 2023-11-04T01:43:09.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.288+0000 7f4b69694640 1 --2- 172.21.15.77:0/2881962877 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4b5006ae70 0x7f4b5006d330 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.288+0000 7f4b69694640 1 --2- 172.21.15.77:0/2881962877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b64153850 0x7f4b640b2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.288+0000 7f4b69694640 1 --2- 172.21.15.77:0/2881962877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b640cc9d0 0x7f4b640b0290 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.288+0000 7f4b69694640 1 --2- 172.21.15.77:0/2881962877 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b640cc520 0x7f4b6414a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.288+0000 7f4b69694640 1 -- 172.21.15.77:0/2881962877 >> 172.21.15.77:0/2881962877 conn(0x7f4b640ce950 msgr2=0x7f4b640cb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:09.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.288+0000 7f4b69694640 1 -- 172.21.15.77:0/2881962877 shutdown_connections 2023-11-04T01:43:09.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.288+0000 7f4b69694640 1 -- 172.21.15.77:0/2881962877 wait complete. 2023-11-04T01:43:09.301 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi077.front.sepia.ceph.com... 2023-11-04T01:43:09.302 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:43:09.302 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:09.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:09.361 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[144662]: fuse finished with error 0 and tester_r 0 2023-11-04T01:43:09.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:09.368 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2023-11-04T01:43:09.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:09.369 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:43:09.371 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:2023-11-04T01:43:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:09.383 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:43:09.383 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:09.401 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056339,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13650 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:43:09.402 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi122.front.sepia.ceph.com 2023-11-04T01:43:09.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:09.402 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:43:09.458 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:43:09.459 INFO:teuthology.orchestra.run.smithi122.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-04T01:43:09.459 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:43:09.459 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:09.474 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19534 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:43:09.475 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2023-11-04T01:43:09.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:09.475 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:43:09.529 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:43:09.531 INFO:teuthology.orchestra.run.smithi077.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-04T01:43:09.531 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:43:09.531 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:09.548 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056339,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13650 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:43:09.549 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi122.front.sepia.ceph.com 2023-11-04T01:43:09.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:09.549 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:43:09.605 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:43:09.606 INFO:teuthology.orchestra.run.smithi122.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-04T01:43:09.606 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:09.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.703+0000 7f5ee91b6640 1 Processor -- start 2023-11-04T01:43:09.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.703+0000 7f5ee91b6640 1 -- start start 2023-11-04T01:43:09.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.704+0000 7f5ee91b6640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5ee40b6160 0x7f5ee40cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.704+0000 7f5ee91b6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5ee40b5010 0x7f5ee40cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.704+0000 7f5ee91b6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee40ce160 con 0x7f5ee4160440 2023-11-04T01:43:09.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.704+0000 7f5ee91b6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee40d2c10 con 0x7f5ee40b5010 2023-11-04T01:43:09.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.704+0000 7f5ee91b6640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee40ce3a0 con 0x7f5ee40b6160 2023-11-04T01:43:09.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.704+0000 7f5ee359e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5ee40b5010 0x7f5ee40cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.704+0000 7f5ee359e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5ee40b5010 0x7f5ee40cdc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56732/0 (socket says 172.21.15.77:56732) 2023-11-04T01:43:09.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.704+0000 7f5ee359e640 1 -- 172.21.15.77:0/534641297 learned_addr learned my addr 172.21.15.77:0/534641297 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:09.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.704+0000 7f5ee2d9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f5ee4160440 0x7f5ee40b4900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:56158/0 (socket says 172.21.15.77:56158) 2023-11-04T01:43:09.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.704+0000 7f5ee359e640 1 -- 172.21.15.77:0/534641297 >> v2:172.21.15.122:3300/0 conn(0x7f5ee40b6160 msgr2=0x7f5ee40cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:09.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.704+0000 7f5ee359e640 1 --2- 172.21.15.77:0/534641297 >> v2:172.21.15.122:3300/0 conn(0x7f5ee40b6160 0x7f5ee40cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.704+0000 7f5ee359e640 1 -- 172.21.15.77:0/534641297 >> v1:172.21.15.77:6789/0 conn(0x7f5ee4160440 legacy=0x7f5ee40b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.704+0000 7f5ee359e640 1 -- 172.21.15.77:0/534641297 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee40d1120 con 0x7f5ee40b5010 2023-11-04T01:43:09.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.705+0000 7f5ee359e640 1 --2- 172.21.15.77:0/534641297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ee40b5010 0x7f5ee40cdc20 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f5ee40cf370 tx=0x7f5ed402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6af8ff1d56878d00 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:09.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.705+0000 7f5ee1d9b640 1 -- 172.21.15.77:0/534641297 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed4030860 con 0x7f5ee40b5010 2023-11-04T01:43:09.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.705+0000 7f5ee1d9b640 1 -- 172.21.15.77:0/534641297 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed40309c0 con 0x7f5ee40b5010 2023-11-04T01:43:09.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.705+0000 7f5ee1d9b640 1 -- 172.21.15.77:0/534641297 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed4030d50 con 0x7f5ee40b5010 2023-11-04T01:43:09.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.706+0000 7f5ee91b6640 1 -- 172.21.15.77:0/534641297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ee40b5010 msgr2=0x7f5ee40cdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.706+0000 7f5ee91b6640 1 --2- 172.21.15.77:0/534641297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ee40b5010 0x7f5ee40cdc20 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f5ee40cf370 tx=0x7f5ed402b9a0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.706+0000 7f5ee91b6640 1 -- 172.21.15.77:0/534641297 shutdown_connections 2023-11-04T01:43:09.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.706+0000 7f5ee91b6640 1 --2- 172.21.15.77:0/534641297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ee40b5010 0x7f5ee40cdc20 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.706+0000 7f5ee91b6640 1 --2- 172.21.15.77:0/534641297 >> v2:172.21.15.122:3300/0 conn(0x7f5ee40b6160 0x7f5ee40cd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.706+0000 7f5ee91b6640 1 -- 172.21.15.77:0/534641297 >> 172.21.15.77:0/534641297 conn(0x7f5ee40cf900 msgr2=0x7f5ee40cfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:09.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.706+0000 7f5ee91b6640 1 -- 172.21.15.77:0/534641297 shutdown_connections 2023-11-04T01:43:09.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.706+0000 7f5ee91b6640 1 -- 172.21.15.77:0/534641297 wait complete. 2023-11-04T01:43:09.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.707+0000 7f5ee91b6640 1 Processor -- start 2023-11-04T01:43:09.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.707+0000 7f5ee91b6640 1 -- start start 2023-11-04T01:43:09.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.708+0000 7f5ee91b6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ee40b5010 0x7f5ee41f21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.708+0000 7f5ee91b6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ee4160440 0x7f5ee40b6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.708+0000 7f5ee91b6640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ee4154a90 0x7f5ee40c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.708+0000 7f5ee91b6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee41f2700 con 0x7f5ee4160440 2023-11-04T01:43:09.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.708+0000 7f5ee91b6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee40b74a0 con 0x7f5ee40b5010 2023-11-04T01:43:09.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.708+0000 7f5ee91b6640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee415a4b0 con 0x7f5ee4154a90 2023-11-04T01:43:09.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.708+0000 7f5ee259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ee4160440 0x7f5ee40b6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.708+0000 7f5ee259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ee4160440 0x7f5ee40b6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56734/0 (socket says 172.21.15.77:56734) 2023-11-04T01:43:09.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.708+0000 7f5ee259c640 1 -- 172.21.15.77:0/1596900200 learned_addr learned my addr 172.21.15.77:0/1596900200 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:09.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.708+0000 7f5ee359e640 1 --2- 172.21.15.77:0/1596900200 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ee4154a90 0x7f5ee40c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.708+0000 7f5ee2d9d640 1 --2- 172.21.15.77:0/1596900200 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ee40b5010 0x7f5ee41f21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.708+0000 7f5ee259c640 1 -- 172.21.15.77:0/1596900200 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ee4154a90 msgr2=0x7f5ee40c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.708+0000 7f5ee259c640 1 --2- 172.21.15.77:0/1596900200 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ee4154a90 0x7f5ee40c7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.708+0000 7f5ee259c640 1 -- 172.21.15.77:0/1596900200 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ee40b5010 msgr2=0x7f5ee41f21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.708+0000 7f5ee259c640 1 --2- 172.21.15.77:0/1596900200 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ee40b5010 0x7f5ee41f21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.708+0000 7f5ee259c640 1 -- 172.21.15.77:0/1596900200 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed40094d0 con 0x7f5ee4160440 2023-11-04T01:43:09.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.709+0000 7f5ee259c640 1 --2- 172.21.15.77:0/1596900200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ee4160440 0x7f5ee40b6f60 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc00b4a0 tx=0x7f5ecc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:09.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.709+0000 7f5edb7fe640 1 -- 172.21.15.77:0/1596900200 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc010610 con 0x7f5ee4160440 2023-11-04T01:43:09.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.709+0000 7f5edb7fe640 1 -- 172.21.15.77:0/1596900200 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ecc010770 con 0x7f5ee4160440 2023-11-04T01:43:09.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.709+0000 7f5edb7fe640 1 -- 172.21.15.77:0/1596900200 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc010b20 con 0x7f5ee4160440 2023-11-04T01:43:09.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.709+0000 7f5ee91b6640 1 -- 172.21.15.77:0/1596900200 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee40b7740 con 0x7f5ee4160440 2023-11-04T01:43:09.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.709+0000 7f5ee91b6640 1 -- 172.21.15.77:0/1596900200 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee415aa50 con 0x7f5ee4160440 2023-11-04T01:43:09.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.710+0000 7f5ee91b6640 1 -- 172.21.15.77:0/1596900200 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ee4074290 con 0x7f5ee4160440 2023-11-04T01:43:09.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.710+0000 7f5edb7fe640 1 -- 172.21.15.77:0/1596900200 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5ecc010c80 con 0x7f5ee4160440 2023-11-04T01:43:09.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.711+0000 7f5edb7fe640 1 --2- 172.21.15.77:0/1596900200 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5ec406ae70 0x7f5ec406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.711+0000 7f5edb7fe640 1 -- 172.21.15.77:0/1596900200 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f5ecc0897f0 con 0x7f5ee4160440 2023-11-04T01:43:09.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.711+0000 7f5ee2d9d640 1 --2- 172.21.15.77:0/1596900200 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5ec406ae70 0x7f5ec406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.711+0000 7f5ee2d9d640 1 --2- 172.21.15.77:0/1596900200 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5ec406ae70 0x7f5ec406d330 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5edc007ef0 tx=0x7f5edc007e80 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:09.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.715+0000 7f5edb7fe640 1 -- 172.21.15.77:0/1596900200 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5ecc054330 con 0x7f5ee4160440 2023-11-04T01:43:09.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.916+0000 7f5ee91b6640 1 -- 172.21.15.77:0/1596900200 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ee40d0c30 con 0x7f5ee4160440 2023-11-04T01:43:09.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.916+0000 7f5edb7fe640 1 -- 172.21.15.77:0/1596900200 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4921 (secure 0 0 0) 0x7f5ecc057950 con 0x7f5ee4160440 2023-11-04T01:43:09.919 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:43:09.920 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":37,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5992,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/301441031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":301441031},{"type":"v1","addr":"172.21.15.122:6836","nonce":301441031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6861,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/3789657703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3789657703},{"type":"v1","addr":"172.21.15.77:6834","nonce":3789657703}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6864,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3292881877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3292881877},{"type":"v1","addr":"172.21.15.77:6835","nonce":3292881877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:42:56.427282+0000","modified":"2023-11-04T01:43:05.985050+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":35495},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35495":{"gid":35495,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/1536301485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1536301485},{"type":"v1","addr":"172.21.15.122:6837","nonce":1536301485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-04T01:43:09.920 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 37 2023-11-04T01:43:09.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.918+0000 7f5ee91b6640 1 -- 172.21.15.77:0/1596900200 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5ec406ae70 msgr2=0x7f5ec406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.918+0000 7f5ee91b6640 1 --2- 172.21.15.77:0/1596900200 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5ec406ae70 0x7f5ec406d330 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5edc007ef0 tx=0x7f5edc007e80 comp rx=0 tx=0).stop 2023-11-04T01:43:09.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.918+0000 7f5ee91b6640 1 -- 172.21.15.77:0/1596900200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ee4160440 msgr2=0x7f5ee40b6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.918+0000 7f5ee91b6640 1 --2- 172.21.15.77:0/1596900200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ee4160440 0x7f5ee40b6f60 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc00b4a0 tx=0x7f5ecc00b960 comp rx=0 tx=0).stop 2023-11-04T01:43:09.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.918+0000 7f5ee91b6640 1 -- 172.21.15.77:0/1596900200 shutdown_connections 2023-11-04T01:43:09.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.918+0000 7f5ee91b6640 1 --2- 172.21.15.77:0/1596900200 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5ec406ae70 0x7f5ec406d330 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.918+0000 7f5ee91b6640 1 --2- 172.21.15.77:0/1596900200 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ee4154a90 0x7f5ee40c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.918+0000 7f5ee91b6640 1 --2- 172.21.15.77:0/1596900200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ee4160440 0x7f5ee40b6f60 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.918+0000 7f5ee91b6640 1 --2- 172.21.15.77:0/1596900200 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ee40b5010 0x7f5ee41f21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.918+0000 7f5ee91b6640 1 -- 172.21.15.77:0/1596900200 >> 172.21.15.77:0/1596900200 conn(0x7f5ee40cf900 msgr2=0x7f5ee415f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:09.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.919+0000 7f5ee91b6640 1 -- 172.21.15.77:0/1596900200 shutdown_connections 2023-11-04T01:43:09.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:09.919+0000 7f5ee91b6640 1 -- 172.21.15.77:0/1596900200 wait complete. 2023-11-04T01:43:09.932 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:10.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.029+0000 7f4b5451d640 1 Processor -- start 2023-11-04T01:43:10.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.029+0000 7f4b5451d640 1 -- start start 2023-11-04T01:43:10.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.030+0000 7f4b5451d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b4c0b42c0 0x7f4b4c0c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.030+0000 7f4b5451d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4b4c0c9c40 0x7f4b4c0b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.030+0000 7f4b5451d640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b4c0ca090 con 0x7f4b4c15ad80 2023-11-04T01:43:10.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.030+0000 7f4b5451d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b4c06cfa0 con 0x7f4b4c0c9c40 2023-11-04T01:43:10.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.030+0000 7f4b5451d640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c06d280 con 0x7f4b4c0b42c0 2023-11-04T01:43:10.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.030+0000 7f4b52aba640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4b4c0c9c40 0x7f4b4c0b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.030+0000 7f4b52aba640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4b4c0c9c40 0x7f4b4c0b1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56748/0 (socket says 172.21.15.77:56748) 2023-11-04T01:43:10.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.030+0000 7f4b52aba640 1 -- 172.21.15.77:0/3839771558 learned_addr learned my addr 172.21.15.77:0/3839771558 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:10.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.030+0000 7f4b51ab8640 1 --2- 172.21.15.77:0/3839771558 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b4c0b42c0 0x7f4b4c0c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.030+0000 7f4b52aba640 1 -- 172.21.15.77:0/3839771558 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b4c0b42c0 msgr2=0x7f4b4c0c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:10.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.030+0000 7f4b52aba640 1 --2- 172.21.15.77:0/3839771558 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b4c0b42c0 0x7f4b4c0c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.030+0000 7f4b52aba640 1 -- 172.21.15.77:0/3839771558 >> v1:172.21.15.122:6789/0 conn(0x7f4b4c15ad80 legacy=0x7f4b4c06c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:10.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.030+0000 7f4b52aba640 1 -- 172.21.15.77:0/3839771558 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4c06d560 con 0x7f4b4c0c9c40 2023-11-04T01:43:10.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.031+0000 7f4b52aba640 1 --2- 172.21.15.77:0/3839771558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b4c0c9c40 0x7f4b4c0b1a40 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f4b44009e50 tx=0x7f4b4402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40c327ae95b90cf8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:10.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.031+0000 7f4b512b7640 1 -- 172.21.15.77:0/3839771558 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4402cb00 con 0x7f4b4c0c9c40 2023-11-04T01:43:10.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.031+0000 7f4b512b7640 1 -- 172.21.15.77:0/3839771558 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4402cc60 con 0x7f4b4c0c9c40 2023-11-04T01:43:10.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.031+0000 7f4b512b7640 1 -- 172.21.15.77:0/3839771558 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b440343f0 con 0x7f4b4c0c9c40 2023-11-04T01:43:10.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.032+0000 7f4b5451d640 1 -- 172.21.15.77:0/3839771558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b4c0c9c40 msgr2=0x7f4b4c0b1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.032+0000 7f4b5451d640 1 --2- 172.21.15.77:0/3839771558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b4c0c9c40 0x7f4b4c0b1a40 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f4b44009e50 tx=0x7f4b4402bf60 comp rx=0 tx=0).stop 2023-11-04T01:43:10.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.032+0000 7f4b5451d640 1 -- 172.21.15.77:0/3839771558 shutdown_connections 2023-11-04T01:43:10.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.032+0000 7f4b5451d640 1 --2- 172.21.15.77:0/3839771558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b4c0c9c40 0x7f4b4c0b1a40 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.032+0000 7f4b5451d640 1 --2- 172.21.15.77:0/3839771558 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b4c0b42c0 0x7f4b4c0c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.032+0000 7f4b5451d640 1 -- 172.21.15.77:0/3839771558 >> 172.21.15.77:0/3839771558 conn(0x7f4b4c0ce950 msgr2=0x7f4b4c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:10.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.032+0000 7f4b5451d640 1 -- 172.21.15.77:0/3839771558 shutdown_connections 2023-11-04T01:43:10.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.032+0000 7f4b5451d640 1 -- 172.21.15.77:0/3839771558 wait complete. 2023-11-04T01:43:10.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.033+0000 7f4b5451d640 1 Processor -- start 2023-11-04T01:43:10.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.033+0000 7f4b5451d640 1 -- start start 2023-11-04T01:43:10.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.034+0000 7f4b5451d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b4c0b42c0 0x7f4b4c0c6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.034+0000 7f4b5451d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b4c0c9c40 0x7f4b4c15b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.034+0000 7f4b5451d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b4c15ad80 0x7f4b4c0cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.034+0000 7f4b5451d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c0c6630 con 0x7f4b4c15ad80 2023-11-04T01:43:10.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.034+0000 7f4b5451d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c0c6910 con 0x7f4b4c0c9c40 2023-11-04T01:43:10.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.034+0000 7f4b5451d640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c0c6bf0 con 0x7f4b4c0b42c0 2023-11-04T01:43:10.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.034+0000 7f4b52aba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b4c15ad80 0x7f4b4c0cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.034+0000 7f4b52aba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b4c15ad80 0x7f4b4c0cdee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56760/0 (socket says 172.21.15.77:56760) 2023-11-04T01:43:10.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.034+0000 7f4b52aba640 1 -- 172.21.15.77:0/4136603629 learned_addr learned my addr 172.21.15.77:0/4136603629 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:10.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.034+0000 7f4b51ab8640 1 --2- 172.21.15.77:0/4136603629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b4c0c9c40 0x7f4b4c15b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.034+0000 7f4b522b9640 1 --2- 172.21.15.77:0/4136603629 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b4c0b42c0 0x7f4b4c0c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.034+0000 7f4b52aba640 1 -- 172.21.15.77:0/4136603629 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b4c0b42c0 msgr2=0x7f4b4c0c6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.034+0000 7f4b52aba640 1 --2- 172.21.15.77:0/4136603629 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b4c0b42c0 0x7f4b4c0c6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.034+0000 7f4b52aba640 1 -- 172.21.15.77:0/4136603629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b4c0c9c40 msgr2=0x7f4b4c15b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.034+0000 7f4b52aba640 1 --2- 172.21.15.77:0/4136603629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b4c0c9c40 0x7f4b4c15b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.034+0000 7f4b52aba640 1 -- 172.21.15.77:0/4136603629 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b44009b30 con 0x7f4b4c15ad80 2023-11-04T01:43:10.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.034+0000 7f4b522b9640 1 --2- 172.21.15.77:0/4136603629 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b4c0b42c0 0x7f4b4c0c6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:10.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.034+0000 7f4b52aba640 1 --2- 172.21.15.77:0/4136603629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b4c15ad80 0x7f4b4c0cdee0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f4b44036040 tx=0x7f4b44004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:10.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.034+0000 7f4b42ffd640 1 -- 172.21.15.77:0/4136603629 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b44009510 con 0x7f4b4c15ad80 2023-11-04T01:43:10.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.034+0000 7f4b42ffd640 1 -- 172.21.15.77:0/4136603629 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4403e450 con 0x7f4b4c15ad80 2023-11-04T01:43:10.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.034+0000 7f4b5451d640 1 -- 172.21.15.77:0/4136603629 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b4c0c6ed0 con 0x7f4b4c15ad80 2023-11-04T01:43:10.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.034+0000 7f4b42ffd640 1 -- 172.21.15.77:0/4136603629 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4403e7e0 con 0x7f4b4c15ad80 2023-11-04T01:43:10.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.034+0000 7f4b5451d640 1 -- 172.21.15.77:0/4136603629 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b4c0ce420 con 0x7f4b4c15ad80 2023-11-04T01:43:10.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.035+0000 7f4b5451d640 1 -- 172.21.15.77:0/4136603629 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b4c0c73f0 con 0x7f4b4c15ad80 2023-11-04T01:43:10.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.036+0000 7f4b42ffd640 1 -- 172.21.15.77:0/4136603629 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4b4403e940 con 0x7f4b4c15ad80 2023-11-04T01:43:10.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.036+0000 7f4b42ffd640 1 --2- 172.21.15.77:0/4136603629 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4b3006ae70 0x7f4b3006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.036+0000 7f4b42ffd640 1 -- 172.21.15.77:0/4136603629 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f4b440ac730 con 0x7f4b4c15ad80 2023-11-04T01:43:10.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.037+0000 7f4b522b9640 1 --2- 172.21.15.77:0/4136603629 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4b3006ae70 0x7f4b3006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.037+0000 7f4b522b9640 1 --2- 172.21.15.77:0/4136603629 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4b3006ae70 0x7f4b3006d330 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4b48003eb0 tx=0x7f4b48009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:10.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.041+0000 7f4b42ffd640 1 -- 172.21.15.77:0/4136603629 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4b4c0c73f0 con 0x7f4b4c15ad80 2023-11-04T01:43:10.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.206+0000 7f4b5451d640 1 -- 172.21.15.77:0/4136603629 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b4c0ca090 con 0x7f4b4c15ad80 2023-11-04T01:43:10.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.207+0000 7f4b42ffd640 1 -- 172.21.15.77:0/4136603629 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+21941 (secure 0 0 0) 0x7f4b4c0ca090 con 0x7f4b4c15ad80 2023-11-04T01:43:10.211 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:43:10.211 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":83,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:42:57.578138+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:33.159064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:33.647358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:54.519050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:55.395781+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:10.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.209+0000 7f4b5451d640 1 -- 172.21.15.77:0/4136603629 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4b3006ae70 msgr2=0x7f4b3006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.209+0000 7f4b5451d640 1 --2- 172.21.15.77:0/4136603629 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4b3006ae70 0x7f4b3006d330 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4b48003eb0 tx=0x7f4b48009040 comp rx=0 tx=0).stop 2023-11-04T01:43:10.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.209+0000 7f4b5451d640 1 -- 172.21.15.77:0/4136603629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b4c15ad80 msgr2=0x7f4b4c0cdee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.209+0000 7f4b5451d640 1 --2- 172.21.15.77:0/4136603629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b4c15ad80 0x7f4b4c0cdee0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f4b44036040 tx=0x7f4b44004a40 comp rx=0 tx=0).stop 2023-11-04T01:43:10.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.209+0000 7f4b5451d640 1 -- 172.21.15.77:0/4136603629 shutdown_connections 2023-11-04T01:43:10.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.209+0000 7f4b5451d640 1 --2- 172.21.15.77:0/4136603629 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4b3006ae70 0x7f4b3006d330 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.209+0000 7f4b5451d640 1 --2- 172.21.15.77:0/4136603629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b4c15ad80 0x7f4b4c0cdee0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.209+0000 7f4b5451d640 1 --2- 172.21.15.77:0/4136603629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b4c0c9c40 0x7f4b4c15b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.209+0000 7f4b5451d640 1 --2- 172.21.15.77:0/4136603629 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b4c0b42c0 0x7f4b4c0c6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.209+0000 7f4b5451d640 1 -- 172.21.15.77:0/4136603629 >> 172.21.15.77:0/4136603629 conn(0x7f4b4c0ce950 msgr2=0x7f4b4c0ae570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:10.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.209+0000 7f4b5451d640 1 -- 172.21.15.77:0/4136603629 shutdown_connections 2023-11-04T01:43:10.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.209+0000 7f4b5451d640 1 -- 172.21.15.77:0/4136603629 wait complete. 2023-11-04T01:43:10.223 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:33.142176+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:42:33.159064+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:42:33.647358+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:42:54.519050+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:42:55.395781+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:43:10.224 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:43:10.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.323+0000 7f89d82c2640 1 Processor -- start 2023-11-04T01:43:10.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.323+0000 7f89d82c2640 1 -- start start 2023-11-04T01:43:10.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.324+0000 7f89d82c2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f89d015ad40 0x7f89d006b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.324+0000 7f89d82c2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f89d015b120 0x7f89d015f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.324+0000 7f89d82c2640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89d0065df0 con 0x7f89d00c9b60 2023-11-04T01:43:10.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.324+0000 7f89d82c2640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89d006bc40 con 0x7f89d015ad40 2023-11-04T01:43:10.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.324+0000 7f89d82c2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d015f910 con 0x7f89d015b120 2023-11-04T01:43:10.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.324+0000 7f89d605e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f89d015ad40 0x7f89d006b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.324+0000 7f89d605e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f89d015ad40 0x7f89d006b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56762/0 (socket says 172.21.15.77:56762) 2023-11-04T01:43:10.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.324+0000 7f89d605e640 1 -- 172.21.15.77:0/4275406551 learned_addr learned my addr 172.21.15.77:0/4275406551 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:10.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.324+0000 7f89d685f640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f89d00c9b60 0x7f89d0070ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:56168/0 (socket says 172.21.15.77:56168) 2023-11-04T01:43:10.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.325+0000 7f89d605e640 1 -- 172.21.15.77:0/4275406551 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f89d015b120 msgr2=0x7f89d015f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:10.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.325+0000 7f89d605e640 1 --2- 172.21.15.77:0/4275406551 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f89d015b120 0x7f89d015f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.325+0000 7f89d605e640 1 -- 172.21.15.77:0/4275406551 >> v1:172.21.15.77:6789/0 conn(0x7f89d00c9b60 legacy=0x7f89d0070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.325+0000 7f89d605e640 1 -- 172.21.15.77:0/4275406551 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d0066040 con 0x7f89d015ad40 2023-11-04T01:43:10.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.325+0000 7f89d605e640 1 --2- 172.21.15.77:0/4275406551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89d015ad40 0x7f89d006b700 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f89cc009e50 tx=0x7f89cc02bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d918f3f68623d05 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:10.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.325+0000 7f89d505c640 1 -- 172.21.15.77:0/4275406551 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc02c8d0 con 0x7f89d015ad40 2023-11-04T01:43:10.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.325+0000 7f89d505c640 1 -- 172.21.15.77:0/4275406551 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89cc02ca30 con 0x7f89d015ad40 2023-11-04T01:43:10.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.325+0000 7f89d505c640 1 -- 172.21.15.77:0/4275406551 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc02cdc0 con 0x7f89d015ad40 2023-11-04T01:43:10.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.326+0000 7f89d82c2640 1 -- 172.21.15.77:0/4275406551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89d015ad40 msgr2=0x7f89d006b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.326+0000 7f89d82c2640 1 --2- 172.21.15.77:0/4275406551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89d015ad40 0x7f89d006b700 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f89cc009e50 tx=0x7f89cc02bdb0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.326+0000 7f89d82c2640 1 -- 172.21.15.77:0/4275406551 shutdown_connections 2023-11-04T01:43:10.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.326+0000 7f89d82c2640 1 --2- 172.21.15.77:0/4275406551 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f89d015b120 0x7f89d015f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.326+0000 7f89d82c2640 1 --2- 172.21.15.77:0/4275406551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89d015ad40 0x7f89d006b700 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.326+0000 7f89d82c2640 1 -- 172.21.15.77:0/4275406551 >> 172.21.15.77:0/4275406551 conn(0x7f89d00cbc90 msgr2=0x7f89d00cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:10.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.326+0000 7f89d82c2640 1 -- 172.21.15.77:0/4275406551 shutdown_connections 2023-11-04T01:43:10.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.326+0000 7f89d82c2640 1 -- 172.21.15.77:0/4275406551 wait complete. 2023-11-04T01:43:10.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.327+0000 7f89d82c2640 1 Processor -- start 2023-11-04T01:43:10.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.327+0000 7f89d82c2640 1 -- start start 2023-11-04T01:43:10.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.328+0000 7f89d82c2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f89d00c9b60 0x7f89d014b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.328+0000 7f89d82c2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f89d015ad40 0x7f89d00c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.328+0000 7f89d82c2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89d015b120 0x7f89d00c8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.328+0000 7f89d82c2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d00c3a60 con 0x7f89d015b120 2023-11-04T01:43:10.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.328+0000 7f89d82c2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d00c2de0 con 0x7f89d00c9b60 2023-11-04T01:43:10.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.328+0000 7f89d82c2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d00c30c0 con 0x7f89d015ad40 2023-11-04T01:43:10.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.328+0000 7f89d685f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89d015b120 0x7f89d00c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.328+0000 7f89d685f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89d015b120 0x7f89d00c8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56770/0 (socket says 172.21.15.77:56770) 2023-11-04T01:43:10.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.328+0000 7f89d685f640 1 -- 172.21.15.77:0/3088657410 learned_addr learned my addr 172.21.15.77:0/3088657410 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:10.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.328+0000 7f89d585d640 1 --2- 172.21.15.77:0/3088657410 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f89d015ad40 0x7f89d00c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.328+0000 7f89d685f640 1 -- 172.21.15.77:0/3088657410 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f89d015ad40 msgr2=0x7f89d00c7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.328+0000 7f89d685f640 1 --2- 172.21.15.77:0/3088657410 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f89d015ad40 0x7f89d00c7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.328+0000 7f89d605e640 1 --2- 172.21.15.77:0/3088657410 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f89d00c9b60 0x7f89d014b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.328+0000 7f89d685f640 1 -- 172.21.15.77:0/3088657410 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f89d00c9b60 msgr2=0x7f89d014b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.328+0000 7f89d685f640 1 --2- 172.21.15.77:0/3088657410 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f89d00c9b60 0x7f89d014b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.328+0000 7f89d685f640 1 -- 172.21.15.77:0/3088657410 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89cc009b30 con 0x7f89d015b120 2023-11-04T01:43:10.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.328+0000 7f89d585d640 1 --2- 172.21.15.77:0/3088657410 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f89d015ad40 0x7f89d00c7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:10.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.328+0000 7f89d685f640 1 --2- 172.21.15.77:0/3088657410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89d015b120 0x7f89d00c8320 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f89c800c780 tx=0x7f89c800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:10.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.329+0000 7f89c6ffd640 1 -- 172.21.15.77:0/3088657410 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c80072d0 con 0x7f89d015b120 2023-11-04T01:43:10.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.329+0000 7f89c6ffd640 1 -- 172.21.15.77:0/3088657410 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c8007430 con 0x7f89d015b120 2023-11-04T01:43:10.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.329+0000 7f89c6ffd640 1 -- 172.21.15.77:0/3088657410 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c80047e0 con 0x7f89d015b120 2023-11-04T01:43:10.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.329+0000 7f89d82c2640 1 -- 172.21.15.77:0/3088657410 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89d00c33a0 con 0x7f89d015b120 2023-11-04T01:43:10.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.329+0000 7f89d82c2640 1 -- 172.21.15.77:0/3088657410 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89d014bcb0 con 0x7f89d015b120 2023-11-04T01:43:10.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.330+0000 7f89d82c2640 1 -- 172.21.15.77:0/3088657410 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89d0074290 con 0x7f89d015b120 2023-11-04T01:43:10.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.330+0000 7f89c6ffd640 1 -- 172.21.15.77:0/3088657410 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f89c8004940 con 0x7f89d015b120 2023-11-04T01:43:10.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.330+0000 7f89c6ffd640 1 --2- 172.21.15.77:0/3088657410 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f89b406ae70 0x7f89b406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.330+0000 7f89c6ffd640 1 -- 172.21.15.77:0/3088657410 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f89c8088d90 con 0x7f89d015b120 2023-11-04T01:43:10.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.331+0000 7f89d605e640 1 --2- 172.21.15.77:0/3088657410 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f89b406ae70 0x7f89b406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.331+0000 7f89d605e640 1 --2- 172.21.15.77:0/3088657410 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f89b406ae70 0x7f89b406d330 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f89cc035000 tx=0x7f89cc030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:10.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.334+0000 7f89c6ffd640 1 -- 172.21.15.77:0/3088657410 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f89c80573f0 con 0x7f89d015b120 2023-11-04T01:43:10.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.500+0000 7f89d82c2640 1 -- 172.21.15.77:0/3088657410 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f89d00ccac0 con 0x7f89d015b120 2023-11-04T01:43:10.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.500+0000 7f89c6ffd640 1 -- 172.21.15.77:0/3088657410 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7f89c8018020 con 0x7f89d015b120 2023-11-04T01:43:10.503 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:43:10.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.502+0000 7f89d82c2640 1 -- 172.21.15.77:0/3088657410 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f89b406ae70 msgr2=0x7f89b406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.502+0000 7f89d82c2640 1 --2- 172.21.15.77:0/3088657410 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f89b406ae70 0x7f89b406d330 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f89cc035000 tx=0x7f89cc030000 comp rx=0 tx=0).stop 2023-11-04T01:43:10.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.502+0000 7f89d82c2640 1 -- 172.21.15.77:0/3088657410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89d015b120 msgr2=0x7f89d00c8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.502+0000 7f89d82c2640 1 --2- 172.21.15.77:0/3088657410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89d015b120 0x7f89d00c8320 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f89c800c780 tx=0x7f89c800cc40 comp rx=0 tx=0).stop 2023-11-04T01:43:10.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.502+0000 7f89d82c2640 1 -- 172.21.15.77:0/3088657410 shutdown_connections 2023-11-04T01:43:10.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.502+0000 7f89d82c2640 1 --2- 172.21.15.77:0/3088657410 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f89b406ae70 0x7f89b406d330 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.502+0000 7f89d82c2640 1 --2- 172.21.15.77:0/3088657410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89d015b120 0x7f89d00c8320 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.502+0000 7f89d82c2640 1 --2- 172.21.15.77:0/3088657410 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f89d015ad40 0x7f89d00c7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.502+0000 7f89d82c2640 1 --2- 172.21.15.77:0/3088657410 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f89d00c9b60 0x7f89d014b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.502+0000 7f89d82c2640 1 -- 172.21.15.77:0/3088657410 >> 172.21.15.77:0/3088657410 conn(0x7f89d00cbc90 msgr2=0x7f89d015b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:10.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.502+0000 7f89d82c2640 1 -- 172.21.15.77:0/3088657410 shutdown_connections 2023-11-04T01:43:10.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.502+0000 7f89d82c2640 1 -- 172.21.15.77:0/3088657410 wait complete. 2023-11-04T01:43:10.515 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:43:10.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.616+0000 7f463b965640 1 Processor -- start 2023-11-04T01:43:10.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.616+0000 7f463b965640 1 -- start start 2023-11-04T01:43:10.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.617+0000 7f463b965640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f46340b1a40 0x7f46340ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.617+0000 7f463b965640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4634160990 con 0x7f46341605b0 2023-11-04T01:43:10.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.617+0000 7f463b965640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46340cc7c0 con 0x7f463406a830 2023-11-04T01:43:10.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.617+0000 7f463b965640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46340cd750 con 0x7f46340b1a40 2023-11-04T01:43:10.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.617+0000 7f4639701640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f46341605b0 0x7f463406a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:56178/0 (socket says 172.21.15.77:56178) 2023-11-04T01:43:10.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.617+0000 7f4639701640 1 -- 172.21.15.77:0/1874306626 learned_addr learned my addr 172.21.15.77:0/1874306626 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:10.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.617+0000 7f4638f00640 1 --2- 172.21.15.77:0/1874306626 >> v2:172.21.15.122:3300/0 conn(0x7f46340b1a40 0x7f46340ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.618+0000 7f462bfff640 1 -- 172.21.15.77:0/1874306626 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2566061729 0 0) 0x7f4634160990 con 0x7f46341605b0 2023-11-04T01:43:10.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.618+0000 7f462bfff640 1 -- 172.21.15.77:0/1874306626 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4620003520 con 0x7f46341605b0 2023-11-04T01:43:10.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.618+0000 7f462bfff640 1 -- 172.21.15.77:0/1874306626 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1013633727 0 0) 0x7f4620003520 con 0x7f46341605b0 2023-11-04T01:43:10.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.618+0000 7f462bfff640 1 -- 172.21.15.77:0/1874306626 >> v2:172.21.15.122:3300/0 conn(0x7f46340b1a40 msgr2=0x7f46340ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:10.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.618+0000 7f462bfff640 1 --2- 172.21.15.77:0/1874306626 >> v2:172.21.15.122:3300/0 conn(0x7f46340b1a40 0x7f46340ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.618+0000 7f462bfff640 1 -- 172.21.15.77:0/1874306626 >> v1:172.21.15.122:6789/0 conn(0x7f463406a830 legacy=0x7f46340cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.618+0000 7f462bfff640 1 -- 172.21.15.77:0/1874306626 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46340cc4e0 con 0x7f46341605b0 2023-11-04T01:43:10.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.618+0000 7f462bfff640 1 -- 172.21.15.77:0/1874306626 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f46300019f0 con 0x7f46341605b0 2023-11-04T01:43:10.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.618+0000 7f462bfff640 1 -- 172.21.15.77:0/1874306626 >> v1:172.21.15.77:6789/0 conn(0x7f46341605b0 legacy=0x7f463406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.618+0000 7f462bfff640 1 --2- 172.21.15.77:0/1874306626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4620003970 0x7f4620003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.618+0000 7f462bfff640 1 --2- 172.21.15.77:0/1874306626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46200047c0 0x7f4620004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.618+0000 7f462bfff640 1 --2- 172.21.15.77:0/1874306626 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4620005180 0x7f462000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.618+0000 7f462bfff640 1 -- 172.21.15.77:0/1874306626 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46340cd750 con 0x7f4620003970 2023-11-04T01:43:10.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.618+0000 7f462bfff640 1 -- 172.21.15.77:0/1874306626 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462000c0d0 con 0x7f46200047c0 2023-11-04T01:43:10.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.618+0000 7f462bfff640 1 -- 172.21.15.77:0/1874306626 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462000c290 con 0x7f4620005180 2023-11-04T01:43:10.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.618+0000 7f4639701640 1 --2- 172.21.15.77:0/1874306626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4620003970 0x7f4620003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.618+0000 7f4638f00640 1 --2- 172.21.15.77:0/1874306626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46200047c0 0x7f4620004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.618+0000 7f4639f02640 1 --2- 172.21.15.77:0/1874306626 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4620005180 0x7f462000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.618+0000 7f4639701640 1 -- 172.21.15.77:0/1874306626 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4620005180 msgr2=0x7f462000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:10.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.618+0000 7f4639701640 1 --2- 172.21.15.77:0/1874306626 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4620005180 0x7f462000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.618+0000 7f4639701640 1 -- 172.21.15.77:0/1874306626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46200047c0 msgr2=0x7f4620004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:10.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.618+0000 7f4639701640 1 --2- 172.21.15.77:0/1874306626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46200047c0 0x7f4620004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.618+0000 7f4639701640 1 -- 172.21.15.77:0/1874306626 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4620003520 con 0x7f4620003970 2023-11-04T01:43:10.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.618+0000 7f4639f02640 1 --2- 172.21.15.77:0/1874306626 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4620005180 0x7f462000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:10.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.618+0000 7f4639f02640 1 -- 172.21.15.77:0/1874306626 reap_dead start 2023-11-04T01:43:10.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.619+0000 7f4639701640 1 --2- 172.21.15.77:0/1874306626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4620003970 0x7f4620003d50 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f463000a7d0 tx=0x7f46200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=465f680529cfef3a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:10.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.619+0000 7f462bfff640 1 -- 172.21.15.77:0/1874306626 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4630034630 con 0x7f4620003970 2023-11-04T01:43:10.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.619+0000 7f462bfff640 1 -- 172.21.15.77:0/1874306626 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463002f070 con 0x7f4620003970 2023-11-04T01:43:10.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.619+0000 7f462bfff640 1 -- 172.21.15.77:0/1874306626 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4630034a30 con 0x7f4620003970 2023-11-04T01:43:10.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.620+0000 7f463b965640 1 -- 172.21.15.77:0/1874306626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4620003970 msgr2=0x7f4620003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.620+0000 7f463b965640 1 --2- 172.21.15.77:0/1874306626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4620003970 0x7f4620003d50 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f463000a7d0 tx=0x7f46200057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.620+0000 7f463b965640 1 -- 172.21.15.77:0/1874306626 shutdown_connections 2023-11-04T01:43:10.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.620+0000 7f463b965640 1 --2- 172.21.15.77:0/1874306626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4620003970 0x7f4620003d50 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.620+0000 7f463b965640 1 -- 172.21.15.77:0/1874306626 >> 172.21.15.77:0/1874306626 conn(0x7f4634071820 msgr2=0x7f4634071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:10.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.620+0000 7f463b965640 1 -- 172.21.15.77:0/1874306626 shutdown_connections 2023-11-04T01:43:10.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.620+0000 7f463b965640 1 -- 172.21.15.77:0/1874306626 wait complete. 2023-11-04T01:43:10.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.621+0000 7f463b965640 1 Processor -- start 2023-11-04T01:43:10.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.621+0000 7f463b965640 1 -- start start 2023-11-04T01:43:10.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.622+0000 7f463b965640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4620003970 0x7f46341477f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.622+0000 7f463b965640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46340abef0 0x7f46340ac350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.622+0000 7f463b965640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f46340b2670 0x7f46340b2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.622+0000 7f463b965640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46340b3030 con 0x7f46340abef0 2023-11-04T01:43:10.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.622+0000 7f463b965640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4634147d30 con 0x7f4620003970 2023-11-04T01:43:10.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.622+0000 7f463b965640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46340ad5c0 con 0x7f46340b2670 2023-11-04T01:43:10.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.622+0000 7f4638f00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46340abef0 0x7f46340ac350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.622+0000 7f4638f00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46340abef0 0x7f46340ac350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56784/0 (socket says 172.21.15.77:56784) 2023-11-04T01:43:10.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.622+0000 7f4638f00640 1 -- 172.21.15.77:0/3740440617 learned_addr learned my addr 172.21.15.77:0/3740440617 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:10.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.622+0000 7f4639701640 1 --2- 172.21.15.77:0/3740440617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4620003970 0x7f46341477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.622+0000 7f4639f02640 1 --2- 172.21.15.77:0/3740440617 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f46340b2670 0x7f46340b2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.622+0000 7f4638f00640 1 -- 172.21.15.77:0/3740440617 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f46340b2670 msgr2=0x7f46340b2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.622+0000 7f4638f00640 1 --2- 172.21.15.77:0/3740440617 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f46340b2670 0x7f46340b2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.622+0000 7f4638f00640 1 -- 172.21.15.77:0/3740440617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4620003970 msgr2=0x7f46341477f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.622+0000 7f4638f00640 1 --2- 172.21.15.77:0/3740440617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4620003970 0x7f46341477f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.622+0000 7f4638f00640 1 -- 172.21.15.77:0/3740440617 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46340ac9b0 con 0x7f46340abef0 2023-11-04T01:43:10.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.622+0000 7f4638f00640 1 --2- 172.21.15.77:0/3740440617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46340abef0 0x7f46340ac350 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f4624011700 tx=0x7f4624011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:10.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.622+0000 7f4629ffb640 1 -- 172.21.15.77:0/3740440617 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462400f9c0 con 0x7f46340abef0 2023-11-04T01:43:10.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.622+0000 7f4629ffb640 1 -- 172.21.15.77:0/3740440617 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462400fb20 con 0x7f46340abef0 2023-11-04T01:43:10.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.622+0000 7f463b965640 1 -- 172.21.15.77:0/3740440617 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46340acc90 con 0x7f46340abef0 2023-11-04T01:43:10.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.622+0000 7f4629ffb640 1 -- 172.21.15.77:0/3740440617 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462400fe90 con 0x7f46340abef0 2023-11-04T01:43:10.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.623+0000 7f463b965640 1 -- 172.21.15.77:0/3740440617 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46340ad250 con 0x7f46340abef0 2023-11-04T01:43:10.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.624+0000 7f463b965640 1 -- 172.21.15.77:0/3740440617 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46340672a0 con 0x7f46340abef0 2023-11-04T01:43:10.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.624+0000 7f4629ffb640 1 -- 172.21.15.77:0/3740440617 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4624015460 con 0x7f46340abef0 2023-11-04T01:43:10.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.624+0000 7f4629ffb640 1 --2- 172.21.15.77:0/3740440617 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f461806aea0 0x7f461806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.624+0000 7f4629ffb640 1 -- 172.21.15.77:0/3740440617 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f462408a370 con 0x7f46340abef0 2023-11-04T01:43:10.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.624+0000 7f4639701640 1 --2- 172.21.15.77:0/3740440617 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f461806aea0 0x7f461806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.625+0000 7f4639701640 1 --2- 172.21.15.77:0/3740440617 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f461806aea0 0x7f461806d360 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4630034000 tx=0x7f463002f000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:10.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.628+0000 7f4629ffb640 1 -- 172.21.15.77:0/3740440617 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4624054eb0 con 0x7f46340abef0 2023-11-04T01:43:10.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.795+0000 7f463b965640 1 -- 172.21.15.77:0/3740440617 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f4634074290 con 0x7f46340abef0 2023-11-04T01:43:10.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.795+0000 7f4629ffb640 1 -- 172.21.15.77:0/3740440617 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v83) v1 ==== 103+0+11 (secure 0 0 0) 0x7f46240584d0 con 0x7f46340abef0 2023-11-04T01:43:10.798 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:43:10.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.797+0000 7f463b965640 1 -- 172.21.15.77:0/3740440617 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f461806aea0 msgr2=0x7f461806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.797+0000 7f463b965640 1 --2- 172.21.15.77:0/3740440617 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f461806aea0 0x7f461806d360 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4630034000 tx=0x7f463002f000 comp rx=0 tx=0).stop 2023-11-04T01:43:10.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.797+0000 7f463b965640 1 -- 172.21.15.77:0/3740440617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46340abef0 msgr2=0x7f46340ac350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.797+0000 7f463b965640 1 --2- 172.21.15.77:0/3740440617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46340abef0 0x7f46340ac350 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f4624011700 tx=0x7f4624011bc0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.797+0000 7f463b965640 1 -- 172.21.15.77:0/3740440617 shutdown_connections 2023-11-04T01:43:10.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.797+0000 7f463b965640 1 --2- 172.21.15.77:0/3740440617 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f461806aea0 0x7f461806d360 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.797+0000 7f463b965640 1 --2- 172.21.15.77:0/3740440617 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f46340b2670 0x7f46340b2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.797+0000 7f463b965640 1 --2- 172.21.15.77:0/3740440617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46340abef0 0x7f46340ac350 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.797+0000 7f463b965640 1 --2- 172.21.15.77:0/3740440617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4620003970 0x7f46341477f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.797+0000 7f463b965640 1 -- 172.21.15.77:0/3740440617 >> 172.21.15.77:0/3740440617 conn(0x7f4634071820 msgr2=0x7f46340c57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:10.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.797+0000 7f463b965640 1 -- 172.21.15.77:0/3740440617 shutdown_connections 2023-11-04T01:43:10.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.797+0000 7f463b965640 1 -- 172.21.15.77:0/3740440617 wait complete. 2023-11-04T01:43:10.811 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:43:10.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.910+0000 7f42c2a21640 1 Processor -- start 2023-11-04T01:43:10.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.910+0000 7f42c2a21640 1 -- start start 2023-11-04T01:43:10.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.911+0000 7f42c2a21640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f42bc0cc520 0x7f42bc070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.911+0000 7f42c2a21640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f42bc0cc9d0 0x7f42bc0714e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.911+0000 7f42c2a21640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42bc0c3860 con 0x7f42bc153850 2023-11-04T01:43:10.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.911+0000 7f42c2a21640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42bc0c9250 con 0x7f42bc0cc9d0 2023-11-04T01:43:10.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.911+0000 7f42c2a21640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42bc153c30 con 0x7f42bc0cc520 2023-11-04T01:43:10.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.911+0000 7f42c0fbe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f42bc0cc9d0 0x7f42bc0714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.911+0000 7f42c0fbe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f42bc0cc9d0 0x7f42bc0714e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56800/0 (socket says 172.21.15.77:56800) 2023-11-04T01:43:10.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.911+0000 7f42c0fbe640 1 -- 172.21.15.77:0/3891948 learned_addr learned my addr 172.21.15.77:0/3891948 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:10.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.911+0000 7f42c0fbe640 1 -- 172.21.15.77:0/3891948 >> v2:172.21.15.122:3300/0 conn(0x7f42bc0cc520 msgr2=0x7f42bc070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:10.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.911+0000 7f42c0fbe640 1 --2- 172.21.15.77:0/3891948 >> v2:172.21.15.122:3300/0 conn(0x7f42bc0cc520 0x7f42bc070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.911+0000 7f42c0fbe640 1 -- 172.21.15.77:0/3891948 >> v1:172.21.15.122:6789/0 conn(0x7f42bc153850 legacy=0x7f42bc15a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:10.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.911+0000 7f42c0fbe640 1 -- 172.21.15.77:0/3891948 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42bc0ce590 con 0x7f42bc0cc9d0 2023-11-04T01:43:10.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.912+0000 7f42c0fbe640 1 --2- 172.21.15.77:0/3891948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42bc0cc9d0 0x7f42bc0714e0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f42bc070560 tx=0x7f42b402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7158148ad5facdb0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:10.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.912+0000 7f42baffd640 1 -- 172.21.15.77:0/3891948 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b402ca80 con 0x7f42bc0cc9d0 2023-11-04T01:43:10.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.912+0000 7f42baffd640 1 -- 172.21.15.77:0/3891948 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b402cbe0 con 0x7f42bc0cc9d0 2023-11-04T01:43:10.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.912+0000 7f42baffd640 1 -- 172.21.15.77:0/3891948 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b40343f0 con 0x7f42bc0cc9d0 2023-11-04T01:43:10.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.912+0000 7f42c2a21640 1 -- 172.21.15.77:0/3891948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42bc0cc9d0 msgr2=0x7f42bc0714e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.912+0000 7f42c2a21640 1 --2- 172.21.15.77:0/3891948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42bc0cc9d0 0x7f42bc0714e0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f42bc070560 tx=0x7f42b402bee0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.912+0000 7f42c2a21640 1 -- 172.21.15.77:0/3891948 shutdown_connections 2023-11-04T01:43:10.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.912+0000 7f42c2a21640 1 --2- 172.21.15.77:0/3891948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42bc0cc9d0 0x7f42bc0714e0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.912+0000 7f42c2a21640 1 --2- 172.21.15.77:0/3891948 >> v2:172.21.15.122:3300/0 conn(0x7f42bc0cc520 0x7f42bc070fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.912+0000 7f42c2a21640 1 -- 172.21.15.77:0/3891948 >> 172.21.15.77:0/3891948 conn(0x7f42bc0ce950 msgr2=0x7f42bc0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:10.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.912+0000 7f42c2a21640 1 -- 172.21.15.77:0/3891948 shutdown_connections 2023-11-04T01:43:10.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.912+0000 7f42c2a21640 1 -- 172.21.15.77:0/3891948 wait complete. 2023-11-04T01:43:10.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.914+0000 7f42c2a21640 1 Processor -- start 2023-11-04T01:43:10.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.914+0000 7f42c2a21640 1 -- start start 2023-11-04T01:43:10.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.914+0000 7f42c2a21640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42bc0cc520 0x7f42bc14d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.914+0000 7f42c2a21640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42bc0cc9d0 0x7f42bc1e29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.914+0000 7f42c2a21640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42bc153850 0x7f42bc156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.914+0000 7f42c2a21640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42bc0c5a20 con 0x7f42bc153850 2023-11-04T01:43:10.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.914+0000 7f42c2a21640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42bc0c5c70 con 0x7f42bc0cc9d0 2023-11-04T01:43:10.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.914+0000 7f42c2a21640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42bc0c5f50 con 0x7f42bc0cc520 2023-11-04T01:43:10.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.915+0000 7f42c0fbe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42bc153850 0x7f42bc156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.915+0000 7f42c0fbe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42bc153850 0x7f42bc156040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56808/0 (socket says 172.21.15.77:56808) 2023-11-04T01:43:10.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.915+0000 7f42c0fbe640 1 -- 172.21.15.77:0/1717207656 learned_addr learned my addr 172.21.15.77:0/1717207656 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:10.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.915+0000 7f42bb7fe640 1 --2- 172.21.15.77:0/1717207656 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42bc0cc9d0 0x7f42bc1e29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.915+0000 7f42bbfff640 1 --2- 172.21.15.77:0/1717207656 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42bc0cc520 0x7f42bc14d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.915+0000 7f42c0fbe640 1 -- 172.21.15.77:0/1717207656 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42bc0cc520 msgr2=0x7f42bc14d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.915+0000 7f42c0fbe640 1 --2- 172.21.15.77:0/1717207656 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42bc0cc520 0x7f42bc14d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.915+0000 7f42c0fbe640 1 -- 172.21.15.77:0/1717207656 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42bc0cc9d0 msgr2=0x7f42bc1e29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.915+0000 7f42c0fbe640 1 --2- 172.21.15.77:0/1717207656 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42bc0cc9d0 0x7f42bc1e29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.915+0000 7f42c0fbe640 1 -- 172.21.15.77:0/1717207656 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b4009b30 con 0x7f42bc153850 2023-11-04T01:43:10.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.915+0000 7f42c0fbe640 1 --2- 172.21.15.77:0/1717207656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42bc153850 0x7f42bc156040 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f42b4009f40 tx=0x7f42b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:10.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.915+0000 7f42b8ff9640 1 -- 172.21.15.77:0/1717207656 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b4009510 con 0x7f42bc153850 2023-11-04T01:43:10.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.915+0000 7f42b8ff9640 1 -- 172.21.15.77:0/1717207656 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b403e450 con 0x7f42bc153850 2023-11-04T01:43:10.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.915+0000 7f42c2a21640 1 -- 172.21.15.77:0/1717207656 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42bc0c6230 con 0x7f42bc153850 2023-11-04T01:43:10.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.915+0000 7f42b8ff9640 1 -- 172.21.15.77:0/1717207656 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b403e7e0 con 0x7f42bc153850 2023-11-04T01:43:10.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.915+0000 7f42c2a21640 1 -- 172.21.15.77:0/1717207656 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42bc0c67f0 con 0x7f42bc153850 2023-11-04T01:43:10.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.916+0000 7f42c2a21640 1 -- 172.21.15.77:0/1717207656 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42bc0c6a10 con 0x7f42bc153850 2023-11-04T01:43:10.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.917+0000 7f42b8ff9640 1 -- 172.21.15.77:0/1717207656 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f42b402cd50 con 0x7f42bc153850 2023-11-04T01:43:10.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.917+0000 7f42b8ff9640 1 --2- 172.21.15.77:0/1717207656 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f42a806ae70 0x7f42a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.917+0000 7f42b8ff9640 1 -- 172.21.15.77:0/1717207656 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f42b40ac730 con 0x7f42bc153850 2023-11-04T01:43:10.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.917+0000 7f42bbfff640 1 --2- 172.21.15.77:0/1717207656 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f42a806ae70 0x7f42a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.918+0000 7f42bbfff640 1 --2- 172.21.15.77:0/1717207656 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f42a806ae70 0x7f42a806d330 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f42ac007fd0 tx=0x7f42ac009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:10.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:10.921+0000 7f42b8ff9640 1 -- 172.21.15.77:0/1717207656 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f42b40773b0 con 0x7f42bc153850 2023-11-04T01:43:11.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.087+0000 7f42c2a21640 1 -- 172.21.15.77:0/1717207656 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f42bc074290 con 0x7f42bc153850 2023-11-04T01:43:11.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.087+0000 7f42b8ff9640 1 -- 172.21.15.77:0/1717207656 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v83) v1 ==== 103+0+11 (secure 0 0 0) 0x7f42b407a9d0 con 0x7f42bc153850 2023-11-04T01:43:11.091 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:43:11.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.089+0000 7f42c2a21640 1 -- 172.21.15.77:0/1717207656 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f42a806ae70 msgr2=0x7f42a806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.089+0000 7f42c2a21640 1 --2- 172.21.15.77:0/1717207656 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f42a806ae70 0x7f42a806d330 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f42ac007fd0 tx=0x7f42ac009040 comp rx=0 tx=0).stop 2023-11-04T01:43:11.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.089+0000 7f42c2a21640 1 -- 172.21.15.77:0/1717207656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42bc153850 msgr2=0x7f42bc156040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.089+0000 7f42c2a21640 1 --2- 172.21.15.77:0/1717207656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42bc153850 0x7f42bc156040 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f42b4009f40 tx=0x7f42b4004a40 comp rx=0 tx=0).stop 2023-11-04T01:43:11.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.089+0000 7f42c2a21640 1 -- 172.21.15.77:0/1717207656 shutdown_connections 2023-11-04T01:43:11.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.089+0000 7f42c2a21640 1 --2- 172.21.15.77:0/1717207656 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f42a806ae70 0x7f42a806d330 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.089+0000 7f42c2a21640 1 --2- 172.21.15.77:0/1717207656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42bc153850 0x7f42bc156040 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.089+0000 7f42c2a21640 1 --2- 172.21.15.77:0/1717207656 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42bc0cc9d0 0x7f42bc1e29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.089+0000 7f42c2a21640 1 --2- 172.21.15.77:0/1717207656 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42bc0cc520 0x7f42bc14d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.089+0000 7f42c2a21640 1 -- 172.21.15.77:0/1717207656 >> 172.21.15.77:0/1717207656 conn(0x7f42bc0ce950 msgr2=0x7f42bc14f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:11.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.089+0000 7f42c2a21640 1 -- 172.21.15.77:0/1717207656 shutdown_connections 2023-11-04T01:43:11.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.089+0000 7f42c2a21640 1 -- 172.21.15.77:0/1717207656 wait complete. 2023-11-04T01:43:11.103 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:43:11.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.202+0000 7f1cee397640 1 Processor -- start 2023-11-04T01:43:11.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.202+0000 7f1cee397640 1 -- start start 2023-11-04T01:43:11.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.203+0000 7f1cee397640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1ce80c4ff0 0x7f1ce80cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.203+0000 7f1cee397640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1ce80adac0 0x7f1ce80adf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.203+0000 7f1cee397640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce815aff0 con 0x7f1ce8159c00 2023-11-04T01:43:11.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.203+0000 7f1cee397640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce80ae460 con 0x7f1ce80adac0 2023-11-04T01:43:11.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.203+0000 7f1cee397640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce815a3e0 con 0x7f1ce80c4ff0 2023-11-04T01:43:11.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.203+0000 7f1cec934640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1ce80adac0 0x7f1ce80adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.203+0000 7f1cec934640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1ce80adac0 0x7f1ce80adf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56820/0 (socket says 172.21.15.77:56820) 2023-11-04T01:43:11.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.203+0000 7f1cec934640 1 -- 172.21.15.77:0/1624748143 learned_addr learned my addr 172.21.15.77:0/1624748143 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:11.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.203+0000 7f1ce77fe640 1 --2- 172.21.15.77:0/1624748143 >> v2:172.21.15.122:3300/0 conn(0x7f1ce80c4ff0 0x7f1ce80cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.204+0000 7f1cec934640 1 -- 172.21.15.77:0/1624748143 >> v2:172.21.15.122:3300/0 conn(0x7f1ce80c4ff0 msgr2=0x7f1ce80cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:11.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.204+0000 7f1cec934640 1 --2- 172.21.15.77:0/1624748143 >> v2:172.21.15.122:3300/0 conn(0x7f1ce80c4ff0 0x7f1ce80cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.204+0000 7f1cec934640 1 -- 172.21.15.77:0/1624748143 >> v1:172.21.15.122:6789/0 conn(0x7f1ce8159c00 legacy=0x7f1ce80c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:11.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.204+0000 7f1cec934640 1 -- 172.21.15.77:0/1624748143 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce815a6c0 con 0x7f1ce80adac0 2023-11-04T01:43:11.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.204+0000 7f1ce77fe640 1 --2- 172.21.15.77:0/1624748143 >> v2:172.21.15.122:3300/0 conn(0x7f1ce80c4ff0 0x7f1ce80cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:11.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.204+0000 7f1cec934640 1 --2- 172.21.15.77:0/1624748143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ce80adac0 0x7f1ce80adf20 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f1ce80cde50 tx=0x7f1ce002e0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd25ab573394c120 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.204+0000 7f1ce6ffd640 1 -- 172.21.15.77:0/1624748143 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce002ea90 con 0x7f1ce80adac0 2023-11-04T01:43:11.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.204+0000 7f1ce6ffd640 1 -- 172.21.15.77:0/1624748143 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce002ebf0 con 0x7f1ce80adac0 2023-11-04T01:43:11.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.204+0000 7f1ce6ffd640 1 -- 172.21.15.77:0/1624748143 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0009600 con 0x7f1ce80adac0 2023-11-04T01:43:11.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.205+0000 7f1cee397640 1 -- 172.21.15.77:0/1624748143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ce80adac0 msgr2=0x7f1ce80adf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.205+0000 7f1cee397640 1 --2- 172.21.15.77:0/1624748143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ce80adac0 0x7f1ce80adf20 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f1ce80cde50 tx=0x7f1ce002e0f0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.205+0000 7f1cee397640 1 -- 172.21.15.77:0/1624748143 shutdown_connections 2023-11-04T01:43:11.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.205+0000 7f1cee397640 1 --2- 172.21.15.77:0/1624748143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ce80adac0 0x7f1ce80adf20 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.205+0000 7f1cee397640 1 --2- 172.21.15.77:0/1624748143 >> v2:172.21.15.122:3300/0 conn(0x7f1ce80c4ff0 0x7f1ce80cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.205+0000 7f1cee397640 1 -- 172.21.15.77:0/1624748143 >> 172.21.15.77:0/1624748143 conn(0x7f1ce80ce950 msgr2=0x7f1ce80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:11.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.205+0000 7f1cee397640 1 -- 172.21.15.77:0/1624748143 shutdown_connections 2023-11-04T01:43:11.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.205+0000 7f1cee397640 1 -- 172.21.15.77:0/1624748143 wait complete. 2023-11-04T01:43:11.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.206+0000 7f1cee397640 1 Processor -- start 2023-11-04T01:43:11.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.206+0000 7f1cee397640 1 -- start start 2023-11-04T01:43:11.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.207+0000 7f1cee397640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ce80adac0 0x7f1ce8143270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.207+0000 7f1cee397640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ce80c4ff0 0x7f1ce815c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.207+0000 7f1cee397640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ce8159c00 0x7f1ce815c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.207+0000 7f1cee397640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce814ea10 con 0x7f1ce80adac0 2023-11-04T01:43:11.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.207+0000 7f1cee397640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce80c6b10 con 0x7f1ce80c4ff0 2023-11-04T01:43:11.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.207+0000 7f1cee397640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce80c81f0 con 0x7f1ce8159c00 2023-11-04T01:43:11.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.207+0000 7f1ce7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ce80adac0 0x7f1ce8143270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.207+0000 7f1ce7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ce80adac0 0x7f1ce8143270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56832/0 (socket says 172.21.15.77:56832) 2023-11-04T01:43:11.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.207+0000 7f1ce7fff640 1 -- 172.21.15.77:0/3887978244 learned_addr learned my addr 172.21.15.77:0/3887978244 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:11.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.208+0000 7f1ce77fe640 1 --2- 172.21.15.77:0/3887978244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ce80c4ff0 0x7f1ce815c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.208+0000 7f1cec934640 1 --2- 172.21.15.77:0/3887978244 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ce8159c00 0x7f1ce815c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.208+0000 7f1ce7fff640 1 -- 172.21.15.77:0/3887978244 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ce8159c00 msgr2=0x7f1ce815c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.208+0000 7f1ce7fff640 1 --2- 172.21.15.77:0/3887978244 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ce8159c00 0x7f1ce815c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.208+0000 7f1ce7fff640 1 -- 172.21.15.77:0/3887978244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ce80c4ff0 msgr2=0x7f1ce815c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.208+0000 7f1ce7fff640 1 --2- 172.21.15.77:0/3887978244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ce80c4ff0 0x7f1ce815c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.208+0000 7f1ce7fff640 1 -- 172.21.15.77:0/3887978244 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce000bd40 con 0x7f1ce80adac0 2023-11-04T01:43:11.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.208+0000 7f1cec934640 1 --2- 172.21.15.77:0/3887978244 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ce8159c00 0x7f1ce815c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:11.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.208+0000 7f1ce7fff640 1 --2- 172.21.15.77:0/3887978244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ce80adac0 0x7f1ce8143270 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800b420 tx=0x7f1cd800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.208+0000 7f1ce4ff9640 1 -- 172.21.15.77:0/3887978244 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8011830 con 0x7f1ce80adac0 2023-11-04T01:43:11.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.208+0000 7f1ce4ff9640 1 -- 172.21.15.77:0/3887978244 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd8011990 con 0x7f1ce80adac0 2023-11-04T01:43:11.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.208+0000 7f1ce4ff9640 1 -- 172.21.15.77:0/3887978244 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8011d40 con 0x7f1ce80adac0 2023-11-04T01:43:11.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.208+0000 7f1cee397640 1 -- 172.21.15.77:0/3887978244 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce814e070 con 0x7f1ce80adac0 2023-11-04T01:43:11.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.208+0000 7f1cee397640 1 -- 172.21.15.77:0/3887978244 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce814e630 con 0x7f1ce80adac0 2023-11-04T01:43:11.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.209+0000 7f1cee397640 1 -- 172.21.15.77:0/3887978244 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce814eb50 con 0x7f1ce80adac0 2023-11-04T01:43:11.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.209+0000 7f1ce4ff9640 1 -- 172.21.15.77:0/3887978244 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1cd801b460 con 0x7f1ce80adac0 2023-11-04T01:43:11.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.210+0000 7f1ce4ff9640 1 --2- 172.21.15.77:0/3887978244 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1cd406ae70 0x7f1cd406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.210+0000 7f1ce4ff9640 1 -- 172.21.15.77:0/3887978244 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7f1cd8089650 con 0x7f1ce80adac0 2023-11-04T01:43:11.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.210+0000 7f1ce77fe640 1 --2- 172.21.15.77:0/3887978244 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1cd406ae70 0x7f1cd406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.210+0000 7f1ce77fe640 1 --2- 172.21.15.77:0/3887978244 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1cd406ae70 0x7f1cd406d330 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1ce814def0 tx=0x7f1cdc008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.214+0000 7f1ce4ff9640 1 -- 172.21.15.77:0/3887978244 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1ce814eb50 con 0x7f1ce80adac0 2023-11-04T01:43:11.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.378+0000 7f1cee397640 1 -- 172.21.15.77:0/3887978244 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f1ce814eb50 con 0x7f1ce80adac0 2023-11-04T01:43:11.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.378+0000 7f1ce4ff9640 1 -- 172.21.15.77:0/3887978244 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v83) v1 ==== 107+0+11 (secure 0 0 0) 0x7f1ce814eb50 con 0x7f1ce80adac0 2023-11-04T01:43:11.381 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:43:11.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.380+0000 7f1cee397640 1 -- 172.21.15.77:0/3887978244 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1cd406ae70 msgr2=0x7f1cd406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.380+0000 7f1cee397640 1 --2- 172.21.15.77:0/3887978244 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1cd406ae70 0x7f1cd406d330 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1ce814def0 tx=0x7f1cdc008040 comp rx=0 tx=0).stop 2023-11-04T01:43:11.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.380+0000 7f1cee397640 1 -- 172.21.15.77:0/3887978244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ce80adac0 msgr2=0x7f1ce8143270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.380+0000 7f1cee397640 1 --2- 172.21.15.77:0/3887978244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ce80adac0 0x7f1ce8143270 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800b420 tx=0x7f1cd800b8e0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.380+0000 7f1cee397640 1 -- 172.21.15.77:0/3887978244 shutdown_connections 2023-11-04T01:43:11.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.380+0000 7f1cee397640 1 --2- 172.21.15.77:0/3887978244 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1cd406ae70 0x7f1cd406d330 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.380+0000 7f1cee397640 1 --2- 172.21.15.77:0/3887978244 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ce8159c00 0x7f1ce815c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.380+0000 7f1cee397640 1 --2- 172.21.15.77:0/3887978244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ce80c4ff0 0x7f1ce815c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.380+0000 7f1cee397640 1 --2- 172.21.15.77:0/3887978244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ce80adac0 0x7f1ce8143270 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.380+0000 7f1cee397640 1 -- 172.21.15.77:0/3887978244 >> 172.21.15.77:0/3887978244 conn(0x7f1ce80ce950 msgr2=0x7f1ce80709f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:11.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.380+0000 7f1cee397640 1 -- 172.21.15.77:0/3887978244 shutdown_connections 2023-11-04T01:43:11.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.380+0000 7f1cee397640 1 -- 172.21.15.77:0/3887978244 wait complete. 2023-11-04T01:43:11.393 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:43:11.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.492+0000 7fe70aa32640 1 Processor -- start 2023-11-04T01:43:11.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.492+0000 7fe70aa32640 1 -- start start 2023-11-04T01:43:11.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.493+0000 7fe70aa32640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe7040b2d30 0x7fe70406bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.493+0000 7fe70aa32640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe70406c1d0 0x7fe7040cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.493+0000 7fe70aa32640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe70406ca40 con 0x7fe704160430 2023-11-04T01:43:11.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.493+0000 7fe70aa32640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7040cb580 con 0x7fe7040b2d30 2023-11-04T01:43:11.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.493+0000 7fe70aa32640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe70406cd20 con 0x7fe70406c1d0 2023-11-04T01:43:11.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.493+0000 7fe7037fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe7040b2d30 0x7fe70406bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.493+0000 7fe7037fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe7040b2d30 0x7fe70406bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56836/0 (socket says 172.21.15.77:56836) 2023-11-04T01:43:11.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.493+0000 7fe7037fe640 1 -- 172.21.15.77:0/375609213 learned_addr learned my addr 172.21.15.77:0/375609213 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:11.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.493+0000 7fe708fcf640 1 --2- 172.21.15.77:0/375609213 >> v2:172.21.15.122:3300/0 conn(0x7fe70406c1d0 0x7fe7040cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.493+0000 7fe7037fe640 1 -- 172.21.15.77:0/375609213 >> v2:172.21.15.122:3300/0 conn(0x7fe70406c1d0 msgr2=0x7fe7040cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:11.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.493+0000 7fe7037fe640 1 --2- 172.21.15.77:0/375609213 >> v2:172.21.15.122:3300/0 conn(0x7fe70406c1d0 0x7fe7040cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.493+0000 7fe7037fe640 1 -- 172.21.15.77:0/375609213 >> v1:172.21.15.122:6789/0 conn(0x7fe704160430 legacy=0x7fe7040b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:11.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.493+0000 7fe7037fe640 1 -- 172.21.15.77:0/375609213 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70406d000 con 0x7fe7040b2d30 2023-11-04T01:43:11.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.494+0000 7fe7037fe640 1 --2- 172.21.15.77:0/375609213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7040b2d30 0x7fe70406bc90 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8009870 tx=0x7fe6f802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1325e288ebdfebe5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.494+0000 7fe702ffd640 1 -- 172.21.15.77:0/375609213 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8031870 con 0x7fe7040b2d30 2023-11-04T01:43:11.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.494+0000 7fe702ffd640 1 -- 172.21.15.77:0/375609213 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f80319d0 con 0x7fe7040b2d30 2023-11-04T01:43:11.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.494+0000 7fe702ffd640 1 -- 172.21.15.77:0/375609213 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8031d60 con 0x7fe7040b2d30 2023-11-04T01:43:11.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.495+0000 7fe70aa32640 1 -- 172.21.15.77:0/375609213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7040b2d30 msgr2=0x7fe70406bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.495+0000 7fe70aa32640 1 --2- 172.21.15.77:0/375609213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7040b2d30 0x7fe70406bc90 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8009870 tx=0x7fe6f802b910 comp rx=0 tx=0).stop 2023-11-04T01:43:11.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.495+0000 7fe70aa32640 1 -- 172.21.15.77:0/375609213 shutdown_connections 2023-11-04T01:43:11.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.495+0000 7fe70aa32640 1 --2- 172.21.15.77:0/375609213 >> v2:172.21.15.122:3300/0 conn(0x7fe70406c1d0 0x7fe7040cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.495+0000 7fe70aa32640 1 --2- 172.21.15.77:0/375609213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7040b2d30 0x7fe70406bc90 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.495+0000 7fe70aa32640 1 -- 172.21.15.77:0/375609213 >> 172.21.15.77:0/375609213 conn(0x7fe70406ea20 msgr2=0x7fe70406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:11.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.495+0000 7fe70aa32640 1 -- 172.21.15.77:0/375609213 shutdown_connections 2023-11-04T01:43:11.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.495+0000 7fe70aa32640 1 -- 172.21.15.77:0/375609213 wait complete. 2023-11-04T01:43:11.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.496+0000 7fe70aa32640 1 Processor -- start 2023-11-04T01:43:11.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.496+0000 7fe70aa32640 1 -- start start 2023-11-04T01:43:11.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.497+0000 7fe70aa32640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe70406c1d0 0x7fe7040ca470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.497+0000 7fe70aa32640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe7040b2d30 0x7fe704152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.497+0000 7fe70aa32640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe704160430 0x7fe7041f6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.497+0000 7fe70aa32640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7040b52d0 con 0x7fe704160430 2023-11-04T01:43:11.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.497+0000 7fe70aa32640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7040b5520 con 0x7fe70406c1d0 2023-11-04T01:43:11.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.497+0000 7fe70aa32640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7040b5800 con 0x7fe7040b2d30 2023-11-04T01:43:11.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.497+0000 7fe708fcf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe704160430 0x7fe7041f6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.497+0000 7fe708fcf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe704160430 0x7fe7041f6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56850/0 (socket says 172.21.15.77:56850) 2023-11-04T01:43:11.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.497+0000 7fe708fcf640 1 -- 172.21.15.77:0/3500959387 learned_addr learned my addr 172.21.15.77:0/3500959387 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:11.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.497+0000 7fe703fff640 1 --2- 172.21.15.77:0/3500959387 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe70406c1d0 0x7fe7040ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.497+0000 7fe7037fe640 1 --2- 172.21.15.77:0/3500959387 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe7040b2d30 0x7fe704152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.497+0000 7fe708fcf640 1 -- 172.21.15.77:0/3500959387 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe7040b2d30 msgr2=0x7fe704152770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.497+0000 7fe708fcf640 1 --2- 172.21.15.77:0/3500959387 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe7040b2d30 0x7fe704152770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.497+0000 7fe708fcf640 1 -- 172.21.15.77:0/3500959387 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe70406c1d0 msgr2=0x7fe7040ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.497+0000 7fe708fcf640 1 --2- 172.21.15.77:0/3500959387 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe70406c1d0 0x7fe7040ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.497+0000 7fe708fcf640 1 -- 172.21.15.77:0/3500959387 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f80094d0 con 0x7fe704160430 2023-11-04T01:43:11.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.497+0000 7fe708fcf640 1 --2- 172.21.15.77:0/3500959387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe704160430 0x7fe7041f6310 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc00cc30 tx=0x7fe6fc00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.498+0000 7fe700ff9640 1 -- 172.21.15.77:0/3500959387 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc00ce40 con 0x7fe704160430 2023-11-04T01:43:11.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.498+0000 7fe700ff9640 1 -- 172.21.15.77:0/3500959387 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6fc003990 con 0x7fe704160430 2023-11-04T01:43:11.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.498+0000 7fe70aa32640 1 -- 172.21.15.77:0/3500959387 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7040b5ae0 con 0x7fe704160430 2023-11-04T01:43:11.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.498+0000 7fe700ff9640 1 -- 172.21.15.77:0/3500959387 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc003d20 con 0x7fe704160430 2023-11-04T01:43:11.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.498+0000 7fe70aa32640 1 -- 172.21.15.77:0/3500959387 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7040c7d10 con 0x7fe704160430 2023-11-04T01:43:11.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.499+0000 7fe70aa32640 1 -- 172.21.15.77:0/3500959387 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7040b2960 con 0x7fe704160430 2023-11-04T01:43:11.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.499+0000 7fe700ff9640 1 -- 172.21.15.77:0/3500959387 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe6fc003e80 con 0x7fe704160430 2023-11-04T01:43:11.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.499+0000 7fe700ff9640 1 --2- 172.21.15.77:0/3500959387 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe6f006ae70 0x7fe6f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.499+0000 7fe700ff9640 1 -- 172.21.15.77:0/3500959387 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7092+0+0 (secure 0 0 0) 0x7fe6fc089f50 con 0x7fe704160430 2023-11-04T01:43:11.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.499+0000 7fe703fff640 1 --2- 172.21.15.77:0/3500959387 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe6f006ae70 0x7fe6f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.500+0000 7fe703fff640 1 --2- 172.21.15.77:0/3500959387 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe6f006ae70 0x7fe6f006d330 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4003d90 tx=0x7fe6f4009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.503+0000 7fe700ff9640 1 -- 172.21.15.77:0/3500959387 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe6fc054a90 con 0x7fe704160430 2023-11-04T01:43:11.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.676+0000 7fe70aa32640 1 -- 172.21.15.77:0/3500959387 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe704074290 con 0x7fe704160430 2023-11-04T01:43:11.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.676+0000 7fe700ff9640 1 -- 172.21.15.77:0/3500959387 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe6fc01d020 con 0x7fe704160430 2023-11-04T01:43:11.679 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:43:11.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.678+0000 7fe70aa32640 1 -- 172.21.15.77:0/3500959387 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe6f006ae70 msgr2=0x7fe6f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.678+0000 7fe70aa32640 1 --2- 172.21.15.77:0/3500959387 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe6f006ae70 0x7fe6f006d330 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4003d90 tx=0x7fe6f4009040 comp rx=0 tx=0).stop 2023-11-04T01:43:11.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.678+0000 7fe70aa32640 1 -- 172.21.15.77:0/3500959387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe704160430 msgr2=0x7fe7041f6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.678+0000 7fe70aa32640 1 --2- 172.21.15.77:0/3500959387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe704160430 0x7fe7041f6310 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc00cc30 tx=0x7fe6fc00a5c0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.678+0000 7fe70aa32640 1 -- 172.21.15.77:0/3500959387 shutdown_connections 2023-11-04T01:43:11.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.678+0000 7fe70aa32640 1 --2- 172.21.15.77:0/3500959387 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe6f006ae70 0x7fe6f006d330 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.678+0000 7fe70aa32640 1 --2- 172.21.15.77:0/3500959387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe704160430 0x7fe7041f6310 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.678+0000 7fe70aa32640 1 --2- 172.21.15.77:0/3500959387 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe7040b2d30 0x7fe704152770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.678+0000 7fe70aa32640 1 --2- 172.21.15.77:0/3500959387 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe70406c1d0 0x7fe7040ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.678+0000 7fe70aa32640 1 -- 172.21.15.77:0/3500959387 >> 172.21.15.77:0/3500959387 conn(0x7fe70406ea20 msgr2=0x7fe7040cc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:11.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.678+0000 7fe70aa32640 1 -- 172.21.15.77:0/3500959387 shutdown_connections 2023-11-04T01:43:11.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.678+0000 7fe70aa32640 1 -- 172.21.15.77:0/3500959387 wait complete. 2023-11-04T01:43:11.692 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:43:11.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.794+0000 7f4b50361640 1 Processor -- start 2023-11-04T01:43:11.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.794+0000 7f4b50361640 1 -- start start 2023-11-04T01:43:11.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.795+0000 7f4b50361640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4b480b4880 0x7f4b480b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.795+0000 7f4b50361640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b480cde60 con 0x7f4b48153e60 2023-11-04T01:43:11.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.795+0000 7f4b50361640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b48160f90 con 0x7f4b480cd6d0 2023-11-04T01:43:11.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.795+0000 7f4b50361640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b480b5200 con 0x7f4b480b4880 2023-11-04T01:43:11.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.795+0000 7f4b4e0fd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f4b48153e60 0x7f4b4815dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:56184/0 (socket says 172.21.15.77:56184) 2023-11-04T01:43:11.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.795+0000 7f4b4e0fd640 1 -- 172.21.15.77:0/2205662646 learned_addr learned my addr 172.21.15.77:0/2205662646 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:11.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.795+0000 7f4b4e8fe640 1 --2- 172.21.15.77:0/2205662646 >> v2:172.21.15.122:3300/0 conn(0x7f4b480b4880 0x7f4b480b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.796+0000 7f4b4d0fb640 1 -- 172.21.15.77:0/2205662646 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1028563660 0 0) 0x7f4b480cde60 con 0x7f4b48153e60 2023-11-04T01:43:11.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.796+0000 7f4b4d0fb640 1 -- 172.21.15.77:0/2205662646 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b34003520 con 0x7f4b48153e60 2023-11-04T01:43:11.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.796+0000 7f4b4d0fb640 1 -- 172.21.15.77:0/2205662646 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 699421826 0 0) 0x7f4b48160f90 con 0x7f4b480cd6d0 2023-11-04T01:43:11.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.796+0000 7f4b4d0fb640 1 -- 172.21.15.77:0/2205662646 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b480cde60 con 0x7f4b480cd6d0 2023-11-04T01:43:11.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.796+0000 7f4b4d0fb640 1 -- 172.21.15.77:0/2205662646 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2090375110 0 0) 0x7f4b34003520 con 0x7f4b48153e60 2023-11-04T01:43:11.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.796+0000 7f4b4e8fe640 1 -- 172.21.15.77:0/2205662646 >> v1:172.21.15.122:6789/0 conn(0x7f4b480cd6d0 legacy=0x7f4b48161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.796+0000 7f4b4e8fe640 1 -- 172.21.15.77:0/2205662646 >> v1:172.21.15.77:6789/0 conn(0x7f4b48153e60 legacy=0x7f4b4815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.796+0000 7f4b4e8fe640 1 -- 172.21.15.77:0/2205662646 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b480ce090 con 0x7f4b480b4880 2023-11-04T01:43:11.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.797+0000 7f4b4e8fe640 1 --2- 172.21.15.77:0/2205662646 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b480b4880 0x7f4b480b4cc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4b40009d90 tx=0x7f4b4002be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2483695ccce772fd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.797+0000 7f4b4d0fb640 1 -- 172.21.15.77:0/2205662646 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b44001670 con 0x7f4b480b4880 2023-11-04T01:43:11.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.797+0000 7f4b4d0fb640 1 -- 172.21.15.77:0/2205662646 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4002c940 con 0x7f4b480b4880 2023-11-04T01:43:11.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.797+0000 7f4b4d0fb640 1 -- 172.21.15.77:0/2205662646 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4002ccb0 con 0x7f4b480b4880 2023-11-04T01:43:11.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.797+0000 7f4b50361640 1 -- 172.21.15.77:0/2205662646 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b480b4880 msgr2=0x7f4b480b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.797+0000 7f4b50361640 1 --2- 172.21.15.77:0/2205662646 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b480b4880 0x7f4b480b4cc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4b40009d90 tx=0x7f4b4002be10 comp rx=0 tx=0).stop 2023-11-04T01:43:11.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.797+0000 7f4b50361640 1 -- 172.21.15.77:0/2205662646 shutdown_connections 2023-11-04T01:43:11.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.797+0000 7f4b50361640 1 --2- 172.21.15.77:0/2205662646 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b480b4880 0x7f4b480b4cc0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.797+0000 7f4b50361640 1 -- 172.21.15.77:0/2205662646 >> 172.21.15.77:0/2205662646 conn(0x7f4b480cf880 msgr2=0x7f4b480cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:11.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.798+0000 7f4b50361640 1 -- 172.21.15.77:0/2205662646 shutdown_connections 2023-11-04T01:43:11.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.798+0000 7f4b50361640 1 -- 172.21.15.77:0/2205662646 wait complete. 2023-11-04T01:43:11.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.799+0000 7f4b50361640 1 Processor -- start 2023-11-04T01:43:11.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.799+0000 7f4b50361640 1 -- start start 2023-11-04T01:43:11.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.799+0000 7f4b50361640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b480b4880 0x7f4b481570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.799+0000 7f4b50361640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b480cd6d0 0x7f4b480c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.799+0000 7f4b50361640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b48153e60 0x7f4b480c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.799+0000 7f4b50361640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b48156cb0 con 0x7f4b480cd6d0 2023-11-04T01:43:11.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.799+0000 7f4b50361640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b48156030 con 0x7f4b480b4880 2023-11-04T01:43:11.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.799+0000 7f4b50361640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b48156310 con 0x7f4b48153e60 2023-11-04T01:43:11.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.799+0000 7f4b4d8fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b480cd6d0 0x7f4b480c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.799+0000 7f4b4d8fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b480cd6d0 0x7f4b480c7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56864/0 (socket says 172.21.15.77:56864) 2023-11-04T01:43:11.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.799+0000 7f4b4d8fc640 1 -- 172.21.15.77:0/3663403117 learned_addr learned my addr 172.21.15.77:0/3663403117 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:11.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.800+0000 7f4b4e0fd640 1 --2- 172.21.15.77:0/3663403117 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b480b4880 0x7f4b481570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.800+0000 7f4b4e8fe640 1 --2- 172.21.15.77:0/3663403117 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b48153e60 0x7f4b480c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.800+0000 7f4b4d8fc640 1 -- 172.21.15.77:0/3663403117 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b48153e60 msgr2=0x7f4b480c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.800+0000 7f4b4d8fc640 1 --2- 172.21.15.77:0/3663403117 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b48153e60 0x7f4b480c8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.800+0000 7f4b4d8fc640 1 -- 172.21.15.77:0/3663403117 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b480b4880 msgr2=0x7f4b481570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.800+0000 7f4b4d8fc640 1 --2- 172.21.15.77:0/3663403117 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b480b4880 0x7f4b481570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.800+0000 7f4b4d8fc640 1 -- 172.21.15.77:0/3663403117 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b40009a70 con 0x7f4b480cd6d0 2023-11-04T01:43:11.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.800+0000 7f4b4e0fd640 1 --2- 172.21.15.77:0/3663403117 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b480b4880 0x7f4b481570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:11.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.800+0000 7f4b4d8fc640 1 --2- 172.21.15.77:0/3663403117 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b480cd6d0 0x7f4b480c7ba0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f4b3800c450 tx=0x7f4b3800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.800+0000 7f4b3effd640 1 -- 172.21.15.77:0/3663403117 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b380052d0 con 0x7f4b480cd6d0 2023-11-04T01:43:11.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.800+0000 7f4b3effd640 1 -- 172.21.15.77:0/3663403117 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b38005430 con 0x7f4b480cd6d0 2023-11-04T01:43:11.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.800+0000 7f4b50361640 1 -- 172.21.15.77:0/3663403117 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b481565f0 con 0x7f4b480cd6d0 2023-11-04T01:43:11.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.800+0000 7f4b3effd640 1 -- 172.21.15.77:0/3663403117 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b38012870 con 0x7f4b480cd6d0 2023-11-04T01:43:11.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.800+0000 7f4b50361640 1 -- 172.21.15.77:0/3663403117 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b480c80e0 con 0x7f4b480cd6d0 2023-11-04T01:43:11.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.801+0000 7f4b50361640 1 -- 172.21.15.77:0/3663403117 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b48156df0 con 0x7f4b480cd6d0 2023-11-04T01:43:11.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.801+0000 7f4b3effd640 1 -- 172.21.15.77:0/3663403117 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4b380129d0 con 0x7f4b480cd6d0 2023-11-04T01:43:11.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.802+0000 7f4b3effd640 1 --2- 172.21.15.77:0/3663403117 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4b2c06ae70 0x7f4b2c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.802+0000 7f4b3effd640 1 -- 172.21.15.77:0/3663403117 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f4b380896a0 con 0x7f4b480cd6d0 2023-11-04T01:43:11.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.802+0000 7f4b4e0fd640 1 --2- 172.21.15.77:0/3663403117 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4b2c06ae70 0x7f4b2c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.803+0000 7f4b4e0fd640 1 --2- 172.21.15.77:0/3663403117 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4b2c06ae70 0x7f4b2c06d330 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4b440011e0 tx=0x7f4b44009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.806+0000 7f4b3effd640 1 -- 172.21.15.77:0/3663403117 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4b48156df0 con 0x7f4b480cd6d0 2023-11-04T01:43:11.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.971+0000 7f4b50361640 1 -- 172.21.15.77:0/3663403117 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4b48156df0 con 0x7f4b480cd6d0 2023-11-04T01:43:11.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.972+0000 7f4b3effd640 1 -- 172.21.15.77:0/3663403117 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4b48156df0 con 0x7f4b480cd6d0 2023-11-04T01:43:11.975 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-04T01:43:11.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.973+0000 7f4b50361640 1 -- 172.21.15.77:0/3663403117 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4b2c06ae70 msgr2=0x7f4b2c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.973+0000 7f4b50361640 1 --2- 172.21.15.77:0/3663403117 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4b2c06ae70 0x7f4b2c06d330 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4b440011e0 tx=0x7f4b44009040 comp rx=0 tx=0).stop 2023-11-04T01:43:11.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.973+0000 7f4b50361640 1 -- 172.21.15.77:0/3663403117 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b480cd6d0 msgr2=0x7f4b480c7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.973+0000 7f4b50361640 1 --2- 172.21.15.77:0/3663403117 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b480cd6d0 0x7f4b480c7ba0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f4b3800c450 tx=0x7f4b3800c910 comp rx=0 tx=0).stop 2023-11-04T01:43:11.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.973+0000 7f4b50361640 1 -- 172.21.15.77:0/3663403117 shutdown_connections 2023-11-04T01:43:11.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.973+0000 7f4b50361640 1 --2- 172.21.15.77:0/3663403117 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4b2c06ae70 0x7f4b2c06d330 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.973+0000 7f4b50361640 1 --2- 172.21.15.77:0/3663403117 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4b48153e60 0x7f4b480c8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.973+0000 7f4b50361640 1 --2- 172.21.15.77:0/3663403117 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b480cd6d0 0x7f4b480c7ba0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.973+0000 7f4b50361640 1 --2- 172.21.15.77:0/3663403117 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b480b4880 0x7f4b481570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.973+0000 7f4b50361640 1 -- 172.21.15.77:0/3663403117 >> 172.21.15.77:0/3663403117 conn(0x7f4b480cf880 msgr2=0x7f4b4815fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:11.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.974+0000 7f4b50361640 1 -- 172.21.15.77:0/3663403117 shutdown_connections 2023-11-04T01:43:11.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:11.974+0000 7f4b50361640 1 -- 172.21.15.77:0/3663403117 wait complete. 2023-11-04T01:43:11.987 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:12.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.083+0000 7f1aa8244640 1 Processor -- start 2023-11-04T01:43:12.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.083+0000 7f1aa8244640 1 -- start start 2023-11-04T01:43:12.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.084+0000 7f1aa8244640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1aa0159c70 0x7f1aa00ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.084+0000 7f1aa8244640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1aa006db20 0x7f1aa00b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.084+0000 7f1aa8244640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1aa00b0910 0x7f1aa015d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.084+0000 7f1aa8244640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa00b49b0 con 0x7f1aa006db20 2023-11-04T01:43:12.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.084+0000 7f1aa8244640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa00b0da0 con 0x7f1aa00b0910 2023-11-04T01:43:12.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.084+0000 7f1aa8244640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa00b4110 con 0x7f1aa0159c70 2023-11-04T01:43:12.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.084+0000 7f1aa57df640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1aa006db20 0x7f1aa00b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.084+0000 7f1aa57df640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1aa006db20 0x7f1aa00b03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56868/0 (socket says 172.21.15.77:56868) 2023-11-04T01:43:12.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.084+0000 7f1aa57df640 1 -- 172.21.15.77:0/3181293557 learned_addr learned my addr 172.21.15.77:0/3181293557 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:12.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.084+0000 7f1aa67e1640 1 --2- 172.21.15.77:0/3181293557 >> v2:172.21.15.122:3300/0 conn(0x7f1aa00b0910 0x7f1aa015d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.084+0000 7f1aa5fe0640 1 --2- 172.21.15.77:0/3181293557 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1aa0159c70 0x7f1aa00ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.084+0000 7f1aa57df640 1 -- 172.21.15.77:0/3181293557 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1aa0159c70 msgr2=0x7f1aa00ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:12.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.084+0000 7f1aa57df640 1 --2- 172.21.15.77:0/3181293557 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1aa0159c70 0x7f1aa00ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.084+0000 7f1aa57df640 1 -- 172.21.15.77:0/3181293557 >> v2:172.21.15.122:3300/0 conn(0x7f1aa00b0910 msgr2=0x7f1aa015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:12.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.084+0000 7f1aa57df640 1 --2- 172.21.15.77:0/3181293557 >> v2:172.21.15.122:3300/0 conn(0x7f1aa00b0910 0x7f1aa015d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.084+0000 7f1aa57df640 1 -- 172.21.15.77:0/3181293557 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa00b43f0 con 0x7f1aa006db20 2023-11-04T01:43:12.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.084+0000 7f1aa5fe0640 1 --2- 172.21.15.77:0/3181293557 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1aa0159c70 0x7f1aa00ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:12.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.085+0000 7f1aa57df640 1 --2- 172.21.15.77:0/3181293557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1aa006db20 0x7f1aa00b03d0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f1aa00ca130 tx=0x7f1a9002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22fc369d2d02c8c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:12.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.085+0000 7f1aa4fde640 1 -- 172.21.15.77:0/3181293557 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a90031870 con 0x7f1aa006db20 2023-11-04T01:43:12.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.085+0000 7f1aa4fde640 1 -- 172.21.15.77:0/3181293557 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a900319d0 con 0x7f1aa006db20 2023-11-04T01:43:12.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.085+0000 7f1aa4fde640 1 -- 172.21.15.77:0/3181293557 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a90031d60 con 0x7f1aa006db20 2023-11-04T01:43:12.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.086+0000 7f1aa8244640 1 -- 172.21.15.77:0/3181293557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1aa006db20 msgr2=0x7f1aa00b03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.086+0000 7f1aa8244640 1 --2- 172.21.15.77:0/3181293557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1aa006db20 0x7f1aa00b03d0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f1aa00ca130 tx=0x7f1a9002b910 comp rx=0 tx=0).stop 2023-11-04T01:43:12.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.086+0000 7f1aa8244640 1 -- 172.21.15.77:0/3181293557 shutdown_connections 2023-11-04T01:43:12.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.086+0000 7f1aa8244640 1 --2- 172.21.15.77:0/3181293557 >> v2:172.21.15.122:3300/0 conn(0x7f1aa00b0910 0x7f1aa015d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.086+0000 7f1aa8244640 1 --2- 172.21.15.77:0/3181293557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1aa006db20 0x7f1aa00b03d0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.086+0000 7f1aa8244640 1 --2- 172.21.15.77:0/3181293557 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1aa0159c70 0x7f1aa00ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.086+0000 7f1aa8244640 1 -- 172.21.15.77:0/3181293557 >> 172.21.15.77:0/3181293557 conn(0x7f1aa00ce950 msgr2=0x7f1aa00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:12.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.086+0000 7f1aa8244640 1 -- 172.21.15.77:0/3181293557 shutdown_connections 2023-11-04T01:43:12.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.086+0000 7f1aa8244640 1 -- 172.21.15.77:0/3181293557 wait complete. 2023-11-04T01:43:12.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.087+0000 7f1aa8244640 1 Processor -- start 2023-11-04T01:43:12.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.087+0000 7f1aa8244640 1 -- start start 2023-11-04T01:43:12.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.087+0000 7f1aa8244640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1aa006db20 0x7f1aa00afd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.088+0000 7f1aa8244640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1aa00b0910 0x7f1aa00c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.088+0000 7f1aa8244640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1aa0159c70 0x7f1aa00706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.088+0000 7f1aa8244640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa00c8190 con 0x7f1aa0159c70 2023-11-04T01:43:12.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.088+0000 7f1aa8244640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa00c7930 con 0x7f1aa00b0910 2023-11-04T01:43:12.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.088+0000 7f1aa8244640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa00a7940 con 0x7f1aa006db20 2023-11-04T01:43:12.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.088+0000 7f1aa67e1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1aa0159c70 0x7f1aa00706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.088+0000 7f1aa67e1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1aa0159c70 0x7f1aa00706f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56884/0 (socket says 172.21.15.77:56884) 2023-11-04T01:43:12.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.088+0000 7f1aa67e1640 1 -- 172.21.15.77:0/4009679125 learned_addr learned my addr 172.21.15.77:0/4009679125 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:12.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.088+0000 7f1aa5fe0640 1 --2- 172.21.15.77:0/4009679125 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1aa006db20 0x7f1aa00afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.088+0000 7f1aa57df640 1 --2- 172.21.15.77:0/4009679125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1aa00b0910 0x7f1aa00c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.088+0000 7f1aa67e1640 1 -- 172.21.15.77:0/4009679125 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1aa006db20 msgr2=0x7f1aa00afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.088+0000 7f1aa67e1640 1 --2- 172.21.15.77:0/4009679125 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1aa006db20 0x7f1aa00afd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.088+0000 7f1aa67e1640 1 -- 172.21.15.77:0/4009679125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1aa00b0910 msgr2=0x7f1aa00c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.088+0000 7f1aa67e1640 1 --2- 172.21.15.77:0/4009679125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1aa00b0910 0x7f1aa00c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.088+0000 7f1aa67e1640 1 -- 172.21.15.77:0/4009679125 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a900094d0 con 0x7f1aa0159c70 2023-11-04T01:43:12.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.088+0000 7f1aa5fe0640 1 --2- 172.21.15.77:0/4009679125 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1aa006db20 0x7f1aa00afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:12.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.088+0000 7f1aa67e1640 1 --2- 172.21.15.77:0/4009679125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1aa0159c70 0x7f1aa00706f0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f1a98007e60 tx=0x7f1a9800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:12.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.088+0000 7f1a967fc640 1 -- 172.21.15.77:0/4009679125 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a98014620 con 0x7f1aa0159c70 2023-11-04T01:43:12.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.088+0000 7f1a967fc640 1 -- 172.21.15.77:0/4009679125 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9800ee90 con 0x7f1aa0159c70 2023-11-04T01:43:12.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.088+0000 7f1aa8244640 1 -- 172.21.15.77:0/4009679125 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa00a7c20 con 0x7f1aa0159c70 2023-11-04T01:43:12.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.088+0000 7f1a967fc640 1 -- 172.21.15.77:0/4009679125 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a980149e0 con 0x7f1aa0159c70 2023-11-04T01:43:12.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.088+0000 7f1aa8244640 1 -- 172.21.15.77:0/4009679125 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa00a81e0 con 0x7f1aa0159c70 2023-11-04T01:43:12.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.089+0000 7f1aa8244640 1 -- 172.21.15.77:0/4009679125 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa01f0230 con 0x7f1aa0159c70 2023-11-04T01:43:12.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.090+0000 7f1a967fc640 1 -- 172.21.15.77:0/4009679125 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1a98014b40 con 0x7f1aa0159c70 2023-11-04T01:43:12.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.090+0000 7f1a967fc640 1 --2- 172.21.15.77:0/4009679125 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1a8406aea0 0x7f1a8406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.090+0000 7f1a967fc640 1 -- 172.21.15.77:0/4009679125 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7148+0+0 (secure 0 0 0) 0x7f1a9808a530 con 0x7f1aa0159c70 2023-11-04T01:43:12.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.090+0000 7f1aa5fe0640 1 --2- 172.21.15.77:0/4009679125 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1a8406aea0 0x7f1a8406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.091+0000 7f1aa5fe0640 1 --2- 172.21.15.77:0/4009679125 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1a8406aea0 0x7f1a8406d360 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f1aa015e150 tx=0x7f1a9c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:12.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.094+0000 7f1a967fc640 1 -- 172.21.15.77:0/4009679125 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1aa01f0230 con 0x7f1aa0159c70 2023-11-04T01:43:12.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.296+0000 7f1aa8244640 1 -- 172.21.15.77:0/4009679125 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1aa01f0230 con 0x7f1aa0159c70 2023-11-04T01:43:12.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.296+0000 7f1a967fc640 1 -- 172.21.15.77:0/4009679125 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4921 (secure 0 0 0) 0x7f1aa01f0230 con 0x7f1aa0159c70 2023-11-04T01:43:12.299 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:43:12.299 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":37,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5992,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/301441031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":301441031},{"type":"v1","addr":"172.21.15.122:6836","nonce":301441031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6861,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/3789657703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3789657703},{"type":"v1","addr":"172.21.15.77:6834","nonce":3789657703}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6864,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3292881877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3292881877},{"type":"v1","addr":"172.21.15.77:6835","nonce":3292881877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:42:56.427282+0000","modified":"2023-11-04T01:43:05.985050+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":35495},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35495":{"gid":35495,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/1536301485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1536301485},{"type":"v1","addr":"172.21.15.122:6837","nonce":1536301485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-04T01:43:12.300 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 37 2023-11-04T01:43:12.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.298+0000 7f1aa8244640 1 -- 172.21.15.77:0/4009679125 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1a8406aea0 msgr2=0x7f1a8406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.298+0000 7f1aa8244640 1 --2- 172.21.15.77:0/4009679125 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1a8406aea0 0x7f1a8406d360 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f1aa015e150 tx=0x7f1a9c008040 comp rx=0 tx=0).stop 2023-11-04T01:43:12.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.298+0000 7f1aa8244640 1 -- 172.21.15.77:0/4009679125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1aa0159c70 msgr2=0x7f1aa00706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.298+0000 7f1aa8244640 1 --2- 172.21.15.77:0/4009679125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1aa0159c70 0x7f1aa00706f0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f1a98007e60 tx=0x7f1a9800e4b0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.298+0000 7f1aa8244640 1 -- 172.21.15.77:0/4009679125 shutdown_connections 2023-11-04T01:43:12.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.298+0000 7f1aa8244640 1 --2- 172.21.15.77:0/4009679125 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1a8406aea0 0x7f1a8406d360 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.298+0000 7f1aa8244640 1 --2- 172.21.15.77:0/4009679125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1aa0159c70 0x7f1aa00706f0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.298+0000 7f1aa8244640 1 --2- 172.21.15.77:0/4009679125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1aa00b0910 0x7f1aa00c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.298+0000 7f1aa8244640 1 --2- 172.21.15.77:0/4009679125 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1aa006db20 0x7f1aa00afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.298+0000 7f1aa8244640 1 -- 172.21.15.77:0/4009679125 >> 172.21.15.77:0/4009679125 conn(0x7f1aa00ce950 msgr2=0x7f1aa00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:12.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.298+0000 7f1aa8244640 1 -- 172.21.15.77:0/4009679125 shutdown_connections 2023-11-04T01:43:12.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.298+0000 7f1aa8244640 1 -- 172.21.15.77:0/4009679125 wait complete. 2023-11-04T01:43:12.312 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:12.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.408+0000 7fe164578640 1 Processor -- start 2023-11-04T01:43:12.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.408+0000 7fe164578640 1 -- start start 2023-11-04T01:43:12.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.409+0000 7fe164578640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe15c0cda60 0x7fe15c0ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.409+0000 7fe164578640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe15c0cc990 con 0x7fe15c0b0cd0 2023-11-04T01:43:12.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.409+0000 7fe164578640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe15c0ccc70 con 0x7fe15c070d40 2023-11-04T01:43:12.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.409+0000 7fe164578640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe15c0c9ce0 con 0x7fe15c0cda60 2023-11-04T01:43:12.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.409+0000 7fe161b13640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe15c0b0cd0 0x7fe15c070630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:56188/0 (socket says 172.21.15.77:56188) 2023-11-04T01:43:12.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.409+0000 7fe161b13640 1 -- 172.21.15.77:0/3416612448 learned_addr learned my addr 172.21.15.77:0/3416612448 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:12.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.409+0000 7fe162314640 1 --2- 172.21.15.77:0/3416612448 >> v2:172.21.15.122:3300/0 conn(0x7fe15c0cda60 0x7fe15c0ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.409+0000 7fe161312640 1 -- 172.21.15.77:0/3416612448 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1061416964 0 0) 0x7fe15c0cc990 con 0x7fe15c0b0cd0 2023-11-04T01:43:12.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.409+0000 7fe161312640 1 -- 172.21.15.77:0/3416612448 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe148003520 con 0x7fe15c0b0cd0 2023-11-04T01:43:12.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.409+0000 7fe161312640 1 -- 172.21.15.77:0/3416612448 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2737156965 0 0) 0x7fe148003520 con 0x7fe15c0b0cd0 2023-11-04T01:43:12.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.409+0000 7fe161312640 1 -- 172.21.15.77:0/3416612448 >> v2:172.21.15.122:3300/0 conn(0x7fe15c0cda60 msgr2=0x7fe15c0ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:12.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.409+0000 7fe161312640 1 --2- 172.21.15.77:0/3416612448 >> v2:172.21.15.122:3300/0 conn(0x7fe15c0cda60 0x7fe15c0ca7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.409+0000 7fe161312640 1 -- 172.21.15.77:0/3416612448 >> v1:172.21.15.122:6789/0 conn(0x7fe15c070d40 legacy=0x7fe15c06c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.409+0000 7fe161312640 1 -- 172.21.15.77:0/3416612448 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe15c0c9fc0 con 0x7fe15c0b0cd0 2023-11-04T01:43:12.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.409+0000 7fe161312640 1 -- 172.21.15.77:0/3416612448 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7fe14c001670 con 0x7fe15c0b0cd0 2023-11-04T01:43:12.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.409+0000 7fe161312640 1 -- 172.21.15.77:0/3416612448 >> v1:172.21.15.77:6789/0 conn(0x7fe15c0b0cd0 legacy=0x7fe15c070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.409+0000 7fe161312640 1 --2- 172.21.15.77:0/3416612448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe148003970 0x7fe148003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.409+0000 7fe161312640 1 --2- 172.21.15.77:0/3416612448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1480047c0 0x7fe148004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.409+0000 7fe161312640 1 --2- 172.21.15.77:0/3416612448 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe148005180 0x7fe14800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.409+0000 7fe161312640 1 -- 172.21.15.77:0/3416612448 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c0c9ce0 con 0x7fe148003970 2023-11-04T01:43:12.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.409+0000 7fe161312640 1 -- 172.21.15.77:0/3416612448 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14800c020 con 0x7fe1480047c0 2023-11-04T01:43:12.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.409+0000 7fe161312640 1 -- 172.21.15.77:0/3416612448 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14800c1e0 con 0x7fe148005180 2023-11-04T01:43:12.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.410+0000 7fe162314640 1 --2- 172.21.15.77:0/3416612448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe148003970 0x7fe148003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.410+0000 7fe162b15640 1 --2- 172.21.15.77:0/3416612448 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe148005180 0x7fe14800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.410+0000 7fe161b13640 1 --2- 172.21.15.77:0/3416612448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1480047c0 0x7fe148004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.410+0000 7fe162314640 1 -- 172.21.15.77:0/3416612448 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe148005180 msgr2=0x7fe14800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:12.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.410+0000 7fe162314640 1 --2- 172.21.15.77:0/3416612448 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe148005180 0x7fe14800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.410+0000 7fe162314640 1 -- 172.21.15.77:0/3416612448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1480047c0 msgr2=0x7fe148004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:12.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.410+0000 7fe162314640 1 --2- 172.21.15.77:0/3416612448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1480047c0 0x7fe148004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.410+0000 7fe162314640 1 -- 172.21.15.77:0/3416612448 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe148003520 con 0x7fe148003970 2023-11-04T01:43:12.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.410+0000 7fe162b15640 1 -- 172.21.15.77:0/3416612448 reap_dead start 2023-11-04T01:43:12.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.410+0000 7fe161b13640 1 --2- 172.21.15.77:0/3416612448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe1480047c0 0x7fe148004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:12.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.410+0000 7fe162314640 1 --2- 172.21.15.77:0/3416612448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe148003970 0x7fe148003d90 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fe158009ac0 tx=0x7fe1480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=563c2aef375e56c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:12.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.411+0000 7fe161312640 1 -- 172.21.15.77:0/3416612448 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15802c6d0 con 0x7fe148003970 2023-11-04T01:43:12.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.411+0000 7fe161312640 1 -- 172.21.15.77:0/3416612448 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe15802c830 con 0x7fe148003970 2023-11-04T01:43:12.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.411+0000 7fe161312640 1 -- 172.21.15.77:0/3416612448 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15802cbc0 con 0x7fe148003970 2023-11-04T01:43:12.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.411+0000 7fe164578640 1 -- 172.21.15.77:0/3416612448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe148003970 msgr2=0x7fe148003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.411+0000 7fe164578640 1 --2- 172.21.15.77:0/3416612448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe148003970 0x7fe148003d90 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fe158009ac0 tx=0x7fe1480057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.411+0000 7fe164578640 1 -- 172.21.15.77:0/3416612448 shutdown_connections 2023-11-04T01:43:12.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.411+0000 7fe164578640 1 --2- 172.21.15.77:0/3416612448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe148003970 0x7fe148003d90 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.411+0000 7fe164578640 1 -- 172.21.15.77:0/3416612448 >> 172.21.15.77:0/3416612448 conn(0x7fe15c0ce950 msgr2=0x7fe15c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:12.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.411+0000 7fe164578640 1 -- 172.21.15.77:0/3416612448 shutdown_connections 2023-11-04T01:43:12.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.411+0000 7fe164578640 1 -- 172.21.15.77:0/3416612448 wait complete. 2023-11-04T01:43:12.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.412+0000 7fe164578640 1 Processor -- start 2023-11-04T01:43:12.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.412+0000 7fe164578640 1 -- start start 2023-11-04T01:43:12.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.413+0000 7fe164578640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe148003970 0x7fe15c0b2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.413+0000 7fe164578640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe15c148940 0x7fe15c0b2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.413+0000 7fe164578640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe15c0b2e90 0x7fe15c14d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.413+0000 7fe164578640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c0b1e80 con 0x7fe15c148940 2023-11-04T01:43:12.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.413+0000 7fe164578640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c0b1570 con 0x7fe15c0b2e90 2023-11-04T01:43:12.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.413+0000 7fe164578640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c0b3380 con 0x7fe148003970 2023-11-04T01:43:12.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.413+0000 7fe161b13640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe15c148940 0x7fe15c0b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.413+0000 7fe161b13640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe15c148940 0x7fe15c0b2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56904/0 (socket says 172.21.15.77:56904) 2023-11-04T01:43:12.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.413+0000 7fe161b13640 1 -- 172.21.15.77:0/3359050812 learned_addr learned my addr 172.21.15.77:0/3359050812 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:12.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.413+0000 7fe162314640 1 --2- 172.21.15.77:0/3359050812 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe148003970 0x7fe15c0b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.413+0000 7fe162b15640 1 --2- 172.21.15.77:0/3359050812 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe15c0b2e90 0x7fe15c14d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.413+0000 7fe161b13640 1 -- 172.21.15.77:0/3359050812 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe148003970 msgr2=0x7fe15c0b2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.413+0000 7fe161b13640 1 --2- 172.21.15.77:0/3359050812 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe148003970 0x7fe15c0b2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.413+0000 7fe161b13640 1 -- 172.21.15.77:0/3359050812 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe15c0b2e90 msgr2=0x7fe15c14d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.413+0000 7fe161b13640 1 --2- 172.21.15.77:0/3359050812 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe15c0b2e90 0x7fe15c14d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.413+0000 7fe161b13640 1 -- 172.21.15.77:0/3359050812 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe15c0b1830 con 0x7fe15c148940 2023-11-04T01:43:12.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.414+0000 7fe161b13640 1 --2- 172.21.15.77:0/3359050812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe15c148940 0x7fe15c0b2950 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fe14c00e730 tx=0x7fe14c00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:12.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.414+0000 7fe152ffd640 1 -- 172.21.15.77:0/3359050812 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c00ee40 con 0x7fe15c148940 2023-11-04T01:43:12.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.414+0000 7fe152ffd640 1 -- 172.21.15.77:0/3359050812 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14c00c8d0 con 0x7fe15c148940 2023-11-04T01:43:12.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.414+0000 7fe152ffd640 1 -- 172.21.15.77:0/3359050812 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c00cc40 con 0x7fe15c148940 2023-11-04T01:43:12.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.414+0000 7fe164578640 1 -- 172.21.15.77:0/3359050812 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe15c0b1b10 con 0x7fe15c148940 2023-11-04T01:43:12.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.414+0000 7fe164578640 1 -- 172.21.15.77:0/3359050812 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe15c0b4400 con 0x7fe15c148940 2023-11-04T01:43:12.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.415+0000 7fe164578640 1 -- 172.21.15.77:0/3359050812 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe15c0b1ff0 con 0x7fe15c148940 2023-11-04T01:43:12.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.415+0000 7fe152ffd640 1 -- 172.21.15.77:0/3359050812 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe14c01d460 con 0x7fe15c148940 2023-11-04T01:43:12.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.415+0000 7fe152ffd640 1 --2- 172.21.15.77:0/3359050812 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe14006aea0 0x7fe14006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.415+0000 7fe152ffd640 1 -- 172.21.15.77:0/3359050812 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7148+0+0 (secure 0 0 0) 0x7fe14c089a30 con 0x7fe15c148940 2023-11-04T01:43:12.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.416+0000 7fe162314640 1 --2- 172.21.15.77:0/3359050812 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe14006aea0 0x7fe14006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.416+0000 7fe162314640 1 --2- 172.21.15.77:0/3359050812 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe14006aea0 0x7fe14006d360 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe158036000 tx=0x7fe158030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:12.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.420+0000 7fe152ffd640 1 -- 172.21.15.77:0/3359050812 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe14c0545d0 con 0x7fe15c148940 2023-11-04T01:43:12.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.587+0000 7fe164578640 1 -- 172.21.15.77:0/3359050812 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe15c074290 con 0x7fe15c148940 2023-11-04T01:43:12.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.589+0000 7fe152ffd640 1 -- 172.21.15.77:0/3359050812 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22051 (secure 0 0 0) 0x7fe14c057bf0 con 0x7fe15c148940 2023-11-04T01:43:12.592 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:43:12.592 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":84,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:43:11.611192+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:33.159064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:33.647358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:54.519050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:55.395781+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":84,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:12.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.591+0000 7fe164578640 1 -- 172.21.15.77:0/3359050812 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe14006aea0 msgr2=0x7fe14006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.591+0000 7fe164578640 1 --2- 172.21.15.77:0/3359050812 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe14006aea0 0x7fe14006d360 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe158036000 tx=0x7fe158030000 comp rx=0 tx=0).stop 2023-11-04T01:43:12.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.591+0000 7fe164578640 1 -- 172.21.15.77:0/3359050812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe15c148940 msgr2=0x7fe15c0b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.591+0000 7fe164578640 1 --2- 172.21.15.77:0/3359050812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe15c148940 0x7fe15c0b2950 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fe14c00e730 tx=0x7fe14c00ebf0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.591+0000 7fe164578640 1 -- 172.21.15.77:0/3359050812 shutdown_connections 2023-11-04T01:43:12.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.591+0000 7fe164578640 1 --2- 172.21.15.77:0/3359050812 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe14006aea0 0x7fe14006d360 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.591+0000 7fe164578640 1 --2- 172.21.15.77:0/3359050812 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe15c0b2e90 0x7fe15c14d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.591+0000 7fe164578640 1 --2- 172.21.15.77:0/3359050812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe15c148940 0x7fe15c0b2950 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.591+0000 7fe164578640 1 --2- 172.21.15.77:0/3359050812 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe148003970 0x7fe15c0b2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.591+0000 7fe164578640 1 -- 172.21.15.77:0/3359050812 >> 172.21.15.77:0/3359050812 conn(0x7fe15c0ce950 msgr2=0x7fe15c06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:12.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.591+0000 7fe164578640 1 -- 172.21.15.77:0/3359050812 shutdown_connections 2023-11-04T01:43:12.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.591+0000 7fe164578640 1 -- 172.21.15.77:0/3359050812 wait complete. 2023-11-04T01:43:12.605 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-04T01:43:12.605 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:12.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.703+0000 7fbaa4b4c640 1 Processor -- start 2023-11-04T01:43:12.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.703+0000 7fbaa4b4c640 1 -- start start 2023-11-04T01:43:12.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.704+0000 7fbaa4b4c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbaa015ce60 0x7fbaa006b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.704+0000 7fbaa4b4c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fbaa006bd30 0x7fbaa0160b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.704+0000 7fbaa4b4c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbaa0161050 0x7fbaa00cf160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.704+0000 7fbaa4b4c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa00cbde0 con 0x7fbaa015ce60 2023-11-04T01:43:12.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.704+0000 7fbaa4b4c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa01615d0 con 0x7fbaa006bd30 2023-11-04T01:43:12.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.704+0000 7fbaa4b4c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa01618b0 con 0x7fbaa0161050 2023-11-04T01:43:12.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.704+0000 7fba9e59c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbaa015ce60 0x7fbaa006b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.704+0000 7fba9e59c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbaa015ce60 0x7fbaa006b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56908/0 (socket says 172.21.15.77:56908) 2023-11-04T01:43:12.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.704+0000 7fba9e59c640 1 -- 172.21.15.77:0/4064696519 learned_addr learned my addr 172.21.15.77:0/4064696519 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:12.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.705+0000 7fba9e59c640 1 -- 172.21.15.77:0/4064696519 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbaa0161050 msgr2=0x7fbaa00cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:12.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.705+0000 7fba9e59c640 1 --2- 172.21.15.77:0/4064696519 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbaa0161050 0x7fbaa00cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.705+0000 7fba9e59c640 1 -- 172.21.15.77:0/4064696519 >> v2:172.21.15.122:3300/0 conn(0x7fbaa006bd30 msgr2=0x7fbaa0160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:12.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.705+0000 7fba9e59c640 1 --2- 172.21.15.77:0/4064696519 >> v2:172.21.15.122:3300/0 conn(0x7fbaa006bd30 0x7fbaa0160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.705+0000 7fba9e59c640 1 -- 172.21.15.77:0/4064696519 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa00cba00 con 0x7fbaa015ce60 2023-11-04T01:43:12.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.705+0000 7fba9e59c640 1 --2- 172.21.15.77:0/4064696519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaa015ce60 0x7fbaa006b7f0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0072590 tx=0x7fba9002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e9e8a889ab99eab server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:12.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.705+0000 7fba9d59a640 1 -- 172.21.15.77:0/4064696519 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9002ca70 con 0x7fbaa015ce60 2023-11-04T01:43:12.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.706+0000 7fba9d59a640 1 -- 172.21.15.77:0/4064696519 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9002cbd0 con 0x7fbaa015ce60 2023-11-04T01:43:12.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.706+0000 7fba9d59a640 1 -- 172.21.15.77:0/4064696519 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba900343f0 con 0x7fbaa015ce60 2023-11-04T01:43:12.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.706+0000 7fbaa4b4c640 1 -- 172.21.15.77:0/4064696519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaa015ce60 msgr2=0x7fbaa006b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.706+0000 7fbaa4b4c640 1 --2- 172.21.15.77:0/4064696519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaa015ce60 0x7fbaa006b7f0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0072590 tx=0x7fba9002bed0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.706+0000 7fbaa4b4c640 1 -- 172.21.15.77:0/4064696519 shutdown_connections 2023-11-04T01:43:12.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.706+0000 7fbaa4b4c640 1 --2- 172.21.15.77:0/4064696519 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbaa0161050 0x7fbaa00cf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.706+0000 7fbaa4b4c640 1 --2- 172.21.15.77:0/4064696519 >> v2:172.21.15.122:3300/0 conn(0x7fbaa006bd30 0x7fbaa0160b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.706+0000 7fbaa4b4c640 1 --2- 172.21.15.77:0/4064696519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaa015ce60 0x7fbaa006b7f0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.706+0000 7fbaa4b4c640 1 -- 172.21.15.77:0/4064696519 >> 172.21.15.77:0/4064696519 conn(0x7fbaa006ea90 msgr2=0x7fbaa006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:12.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.706+0000 7fbaa4b4c640 1 -- 172.21.15.77:0/4064696519 shutdown_connections 2023-11-04T01:43:12.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.706+0000 7fbaa4b4c640 1 -- 172.21.15.77:0/4064696519 wait complete. 2023-11-04T01:43:12.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.707+0000 7fbaa4b4c640 1 Processor -- start 2023-11-04T01:43:12.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.708+0000 7fbaa4b4c640 1 -- start start 2023-11-04T01:43:12.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.708+0000 7fbaa4b4c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbaa015ce60 0x7fbaa00b2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.708+0000 7fbaa4b4c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbaa0161050 0x7fbaa00c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.708+0000 7fbaa4b4c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaa01f2bf0 0x7fbaa00c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.708+0000 7fbaa4b4c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa00b39a0 con 0x7fbaa01f2bf0 2023-11-04T01:43:12.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.708+0000 7fbaa4b4c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa00c9630 con 0x7fbaa0161050 2023-11-04T01:43:12.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.708+0000 7fbaa4b4c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa00c9910 con 0x7fbaa015ce60 2023-11-04T01:43:12.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.708+0000 7fba9ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaa01f2bf0 0x7fbaa00c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.708+0000 7fba9ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaa01f2bf0 0x7fbaa00c65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56918/0 (socket says 172.21.15.77:56918) 2023-11-04T01:43:12.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.708+0000 7fba9ed9d640 1 -- 172.21.15.77:0/1043786987 learned_addr learned my addr 172.21.15.77:0/1043786987 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:12.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.709+0000 7fba9e59c640 1 --2- 172.21.15.77:0/1043786987 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbaa015ce60 0x7fbaa00b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.709+0000 7fba9dd9b640 1 --2- 172.21.15.77:0/1043786987 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbaa0161050 0x7fbaa00c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.709+0000 7fba9ed9d640 1 -- 172.21.15.77:0/1043786987 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbaa015ce60 msgr2=0x7fbaa00b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.709+0000 7fba9ed9d640 1 --2- 172.21.15.77:0/1043786987 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbaa015ce60 0x7fbaa00b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.709+0000 7fba9ed9d640 1 -- 172.21.15.77:0/1043786987 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbaa0161050 msgr2=0x7fbaa00c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.709+0000 7fba9ed9d640 1 --2- 172.21.15.77:0/1043786987 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbaa0161050 0x7fbaa00c8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.709+0000 7fba9ed9d640 1 -- 172.21.15.77:0/1043786987 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba90009b30 con 0x7fbaa01f2bf0 2023-11-04T01:43:12.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.709+0000 7fba9ed9d640 1 --2- 172.21.15.77:0/1043786987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaa01f2bf0 0x7fbaa00c65a0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fba9800b3f0 tx=0x7fba9800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:12.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.709+0000 7fba8effd640 1 -- 172.21.15.77:0/1043786987 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba98011830 con 0x7fbaa01f2bf0 2023-11-04T01:43:12.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.709+0000 7fba8effd640 1 -- 172.21.15.77:0/1043786987 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba980119b0 con 0x7fbaa01f2bf0 2023-11-04T01:43:12.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.709+0000 7fbaa4b4c640 1 -- 172.21.15.77:0/1043786987 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa00c9bf0 con 0x7fbaa01f2bf0 2023-11-04T01:43:12.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.709+0000 7fba8effd640 1 -- 172.21.15.77:0/1043786987 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba98011d60 con 0x7fbaa01f2bf0 2023-11-04T01:43:12.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.709+0000 7fbaa4b4c640 1 -- 172.21.15.77:0/1043786987 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa00b2c50 con 0x7fbaa01f2bf0 2023-11-04T01:43:12.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.710+0000 7fbaa4b4c640 1 -- 172.21.15.77:0/1043786987 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaa00c9e30 con 0x7fbaa01f2bf0 2023-11-04T01:43:12.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.711+0000 7fba8effd640 1 -- 172.21.15.77:0/1043786987 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fba9801a400 con 0x7fbaa01f2bf0 2023-11-04T01:43:12.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.711+0000 7fba8effd640 1 --2- 172.21.15.77:0/1043786987 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fba8006ae70 0x7fba8006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.711+0000 7fba8effd640 1 -- 172.21.15.77:0/1043786987 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7148+0+0 (secure 0 0 0) 0x7fba98089b70 con 0x7fbaa01f2bf0 2023-11-04T01:43:12.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.711+0000 7fba9e59c640 1 --2- 172.21.15.77:0/1043786987 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fba8006ae70 0x7fba8006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.712+0000 7fba9e59c640 1 --2- 172.21.15.77:0/1043786987 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fba8006ae70 0x7fba8006d330 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fba90035000 tx=0x7fba90030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:12.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.715+0000 7fba8effd640 1 -- 172.21.15.77:0/1043786987 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbaa00c9e30 con 0x7fbaa01f2bf0 2023-11-04T01:43:12.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.916+0000 7fbaa4b4c640 1 -- 172.21.15.77:0/1043786987 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbaa00b3770 con 0x7fbaa01f2bf0 2023-11-04T01:43:12.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.916+0000 7fba8effd640 1 -- 172.21.15.77:0/1043786987 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4921 (secure 0 0 0) 0x7fbaa00b3770 con 0x7fbaa01f2bf0 2023-11-04T01:43:12.919 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:43:12.920 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":37,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5992,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/301441031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":301441031},{"type":"v1","addr":"172.21.15.122:6836","nonce":301441031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6861,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/3789657703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3789657703},{"type":"v1","addr":"172.21.15.77:6834","nonce":3789657703}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6864,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3292881877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3292881877},{"type":"v1","addr":"172.21.15.77:6835","nonce":3292881877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:42:56.427282+0000","modified":"2023-11-04T01:43:05.985050+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":35495},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35495":{"gid":35495,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/1536301485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1536301485},{"type":"v1","addr":"172.21.15.122:6837","nonce":1536301485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-04T01:43:12.920 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 37 2023-11-04T01:43:12.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.918+0000 7fbaa4b4c640 1 -- 172.21.15.77:0/1043786987 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fba8006ae70 msgr2=0x7fba8006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.918+0000 7fbaa4b4c640 1 --2- 172.21.15.77:0/1043786987 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fba8006ae70 0x7fba8006d330 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fba90035000 tx=0x7fba90030000 comp rx=0 tx=0).stop 2023-11-04T01:43:12.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.918+0000 7fbaa4b4c640 1 -- 172.21.15.77:0/1043786987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaa01f2bf0 msgr2=0x7fbaa00c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.918+0000 7fbaa4b4c640 1 --2- 172.21.15.77:0/1043786987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaa01f2bf0 0x7fbaa00c65a0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fba9800b3f0 tx=0x7fba9800b8b0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.918+0000 7fbaa4b4c640 1 -- 172.21.15.77:0/1043786987 shutdown_connections 2023-11-04T01:43:12.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.918+0000 7fbaa4b4c640 1 --2- 172.21.15.77:0/1043786987 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fba8006ae70 0x7fba8006d330 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.918+0000 7fbaa4b4c640 1 --2- 172.21.15.77:0/1043786987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaa01f2bf0 0x7fbaa00c65a0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.918+0000 7fbaa4b4c640 1 --2- 172.21.15.77:0/1043786987 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbaa0161050 0x7fbaa00c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.918+0000 7fbaa4b4c640 1 --2- 172.21.15.77:0/1043786987 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbaa015ce60 0x7fbaa00b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.918+0000 7fbaa4b4c640 1 -- 172.21.15.77:0/1043786987 >> 172.21.15.77:0/1043786987 conn(0x7fbaa006ea90 msgr2=0x7fbaa00b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:12.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.918+0000 7fbaa4b4c640 1 -- 172.21.15.77:0/1043786987 shutdown_connections 2023-11-04T01:43:12.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:12.918+0000 7fbaa4b4c640 1 -- 172.21.15.77:0/1043786987 wait complete. 2023-11-04T01:43:12.931 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:13.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.028+0000 7fa9db2b0640 1 Processor -- start 2023-11-04T01:43:13.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.028+0000 7fa9db2b0640 1 -- start start 2023-11-04T01:43:13.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.029+0000 7fa9db2b0640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa9d40cda60 0x7fa9d40ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.029+0000 7fa9db2b0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa9d40b0cd0 0x7fa9d4070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.029+0000 7fa9db2b0640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa9d40cace0 0x7fa9d4070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.029+0000 7fa9db2b0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9d40cc990 con 0x7fa9d40b0cd0 2023-11-04T01:43:13.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.029+0000 7fa9db2b0640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9d40ccc70 con 0x7fa9d40cace0 2023-11-04T01:43:13.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.029+0000 7fa9db2b0640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d40c9ce0 con 0x7fa9d40cda60 2023-11-04T01:43:13.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.029+0000 7fa9d884b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa9d40b0cd0 0x7fa9d4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.029+0000 7fa9d884b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa9d40b0cd0 0x7fa9d4070630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56928/0 (socket says 172.21.15.77:56928) 2023-11-04T01:43:13.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.029+0000 7fa9d884b640 1 -- 172.21.15.77:0/3116135291 learned_addr learned my addr 172.21.15.77:0/3116135291 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:13.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.029+0000 7fa9d984d640 1 --2- 172.21.15.77:0/3116135291 >> v2:172.21.15.122:3300/0 conn(0x7fa9d40cace0 0x7fa9d4070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.029+0000 7fa9d884b640 1 -- 172.21.15.77:0/3116135291 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa9d40cda60 msgr2=0x7fa9d40ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:13.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.029+0000 7fa9d884b640 1 --2- 172.21.15.77:0/3116135291 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa9d40cda60 0x7fa9d40ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.029+0000 7fa9d884b640 1 -- 172.21.15.77:0/3116135291 >> v2:172.21.15.122:3300/0 conn(0x7fa9d40cace0 msgr2=0x7fa9d4070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:13.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.029+0000 7fa9d884b640 1 --2- 172.21.15.77:0/3116135291 >> v2:172.21.15.122:3300/0 conn(0x7fa9d40cace0 0x7fa9d4070b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.029+0000 7fa9d884b640 1 -- 172.21.15.77:0/3116135291 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d40c9fc0 con 0x7fa9d40b0cd0 2023-11-04T01:43:13.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.030+0000 7fa9d884b640 1 --2- 172.21.15.77:0/3116135291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9d40b0cd0 0x7fa9d4070630 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4071ba0 tx=0x7fa9c402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896148277e0d6a61 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:13.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.030+0000 7fa9cbfff640 1 -- 172.21.15.77:0/3116135291 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c4031870 con 0x7fa9d40b0cd0 2023-11-04T01:43:13.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.030+0000 7fa9cbfff640 1 -- 172.21.15.77:0/3116135291 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c40319d0 con 0x7fa9d40b0cd0 2023-11-04T01:43:13.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.030+0000 7fa9cbfff640 1 -- 172.21.15.77:0/3116135291 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c4031d60 con 0x7fa9d40b0cd0 2023-11-04T01:43:13.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.030+0000 7fa9db2b0640 1 -- 172.21.15.77:0/3116135291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9d40b0cd0 msgr2=0x7fa9d4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.030+0000 7fa9db2b0640 1 --2- 172.21.15.77:0/3116135291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9d40b0cd0 0x7fa9d4070630 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4071ba0 tx=0x7fa9c402b910 comp rx=0 tx=0).stop 2023-11-04T01:43:13.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.031+0000 7fa9db2b0640 1 -- 172.21.15.77:0/3116135291 shutdown_connections 2023-11-04T01:43:13.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.031+0000 7fa9db2b0640 1 --2- 172.21.15.77:0/3116135291 >> v2:172.21.15.122:3300/0 conn(0x7fa9d40cace0 0x7fa9d4070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.031+0000 7fa9db2b0640 1 --2- 172.21.15.77:0/3116135291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9d40b0cd0 0x7fa9d4070630 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.031+0000 7fa9db2b0640 1 --2- 172.21.15.77:0/3116135291 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa9d40cda60 0x7fa9d40ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.031+0000 7fa9db2b0640 1 -- 172.21.15.77:0/3116135291 >> 172.21.15.77:0/3116135291 conn(0x7fa9d40ce950 msgr2=0x7fa9d40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:13.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.031+0000 7fa9db2b0640 1 -- 172.21.15.77:0/3116135291 shutdown_connections 2023-11-04T01:43:13.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.031+0000 7fa9db2b0640 1 -- 172.21.15.77:0/3116135291 wait complete. 2023-11-04T01:43:13.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.032+0000 7fa9db2b0640 1 Processor -- start 2023-11-04T01:43:13.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.032+0000 7fa9db2b0640 1 -- start start 2023-11-04T01:43:13.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.032+0000 7fa9db2b0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9d40b0cd0 0x7fa9d40c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.032+0000 7fa9db2b0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9d40cace0 0x7fa9d406c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.032+0000 7fa9db2b0640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa9d40cda60 0x7fa9d40aeb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.032+0000 7fa9db2b0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d40b3910 con 0x7fa9d40cace0 2023-11-04T01:43:13.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.032+0000 7fa9db2b0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d40b3bb0 con 0x7fa9d40b0cd0 2023-11-04T01:43:13.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.032+0000 7fa9db2b0640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d40b3e90 con 0x7fa9d40cda60 2023-11-04T01:43:13.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.033+0000 7fa9d884b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9d40cace0 0x7fa9d406c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.033+0000 7fa9d884b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9d40cace0 0x7fa9d406c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56944/0 (socket says 172.21.15.77:56944) 2023-11-04T01:43:13.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.033+0000 7fa9d884b640 1 -- 172.21.15.77:0/2154603422 learned_addr learned my addr 172.21.15.77:0/2154603422 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:13.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.033+0000 7fa9d904c640 1 --2- 172.21.15.77:0/2154603422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9d40b0cd0 0x7fa9d40c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.033+0000 7fa9d984d640 1 --2- 172.21.15.77:0/2154603422 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa9d40cda60 0x7fa9d40aeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.033+0000 7fa9d884b640 1 -- 172.21.15.77:0/2154603422 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa9d40cda60 msgr2=0x7fa9d40aeb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.033+0000 7fa9d884b640 1 --2- 172.21.15.77:0/2154603422 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa9d40cda60 0x7fa9d40aeb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.033+0000 7fa9d884b640 1 -- 172.21.15.77:0/2154603422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9d40b0cd0 msgr2=0x7fa9d40c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.033+0000 7fa9d884b640 1 --2- 172.21.15.77:0/2154603422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9d40b0cd0 0x7fa9d40c8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.033+0000 7fa9d884b640 1 -- 172.21.15.77:0/2154603422 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c40094d0 con 0x7fa9d40cace0 2023-11-04T01:43:13.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.033+0000 7fa9d904c640 1 --2- 172.21.15.77:0/2154603422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9d40b0cd0 0x7fa9d40c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:13.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.033+0000 7fa9d984d640 1 --2- 172.21.15.77:0/2154603422 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa9d40cda60 0x7fa9d40aeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:13.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.033+0000 7fa9d884b640 1 --2- 172.21.15.77:0/2154603422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9d40cace0 0x7fa9d406c470 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4000c00 tx=0x7fa9c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:13.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.033+0000 7fa9c9ffb640 1 -- 172.21.15.77:0/2154603422 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c4031840 con 0x7fa9d40cace0 2023-11-04T01:43:13.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.033+0000 7fa9c9ffb640 1 -- 172.21.15.77:0/2154603422 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c40443f0 con 0x7fa9d40cace0 2023-11-04T01:43:13.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.033+0000 7fa9db2b0640 1 -- 172.21.15.77:0/2154603422 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d40b4170 con 0x7fa9d40cace0 2023-11-04T01:43:13.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.033+0000 7fa9c9ffb640 1 -- 172.21.15.77:0/2154603422 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c40447a0 con 0x7fa9d40cace0 2023-11-04T01:43:13.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.033+0000 7fa9db2b0640 1 -- 172.21.15.77:0/2154603422 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d40c87c0 con 0x7fa9d40cace0 2023-11-04T01:43:13.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.034+0000 7fa9db2b0640 1 -- 172.21.15.77:0/2154603422 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d4074290 con 0x7fa9d40cace0 2023-11-04T01:43:13.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.035+0000 7fa9c9ffb640 1 -- 172.21.15.77:0/2154603422 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa9c404d450 con 0x7fa9d40cace0 2023-11-04T01:43:13.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.035+0000 7fa9c9ffb640 1 --2- 172.21.15.77:0/2154603422 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa9b806ae70 0x7fa9b806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.035+0000 7fa9c9ffb640 1 -- 172.21.15.77:0/2154603422 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7148+0+0 (secure 0 0 0) 0x7fa9c402d040 con 0x7fa9d40cace0 2023-11-04T01:43:13.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.035+0000 7fa9d904c640 1 --2- 172.21.15.77:0/2154603422 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa9b806ae70 0x7fa9b806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.036+0000 7fa9d904c640 1 --2- 172.21.15.77:0/2154603422 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa9b806ae70 0x7fa9b806d330 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa9d000a870 tx=0x7fa9d0008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:13.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.039+0000 7fa9c9ffb640 1 -- 172.21.15.77:0/2154603422 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa9c4076ec0 con 0x7fa9d40cace0 2023-11-04T01:43:13.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.241+0000 7fa9db2b0640 1 -- 172.21.15.77:0/2154603422 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9d40c5b40 con 0x7fa9d40cace0 2023-11-04T01:43:13.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.242+0000 7fa9c9ffb640 1 -- 172.21.15.77:0/2154603422 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4921 (secure 0 0 0) 0x7fa9c407a4e0 con 0x7fa9d40cace0 2023-11-04T01:43:13.245 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:43:13.245 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":37,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5992,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/301441031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":301441031},{"type":"v1","addr":"172.21.15.122:6836","nonce":301441031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6861,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/3789657703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3789657703},{"type":"v1","addr":"172.21.15.77:6834","nonce":3789657703}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6864,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3292881877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3292881877},{"type":"v1","addr":"172.21.15.77:6835","nonce":3292881877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:42:56.427282+0000","modified":"2023-11-04T01:43:05.985050+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":35495},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35495":{"gid":35495,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6837/1536301485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1536301485},{"type":"v1","addr":"172.21.15.122:6837","nonce":1536301485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-04T01:43:13.245 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 37 2023-11-04T01:43:13.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.243+0000 7fa9db2b0640 1 -- 172.21.15.77:0/2154603422 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa9b806ae70 msgr2=0x7fa9b806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.243+0000 7fa9db2b0640 1 --2- 172.21.15.77:0/2154603422 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa9b806ae70 0x7fa9b806d330 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa9d000a870 tx=0x7fa9d0008040 comp rx=0 tx=0).stop 2023-11-04T01:43:13.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.243+0000 7fa9db2b0640 1 -- 172.21.15.77:0/2154603422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9d40cace0 msgr2=0x7fa9d406c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.243+0000 7fa9db2b0640 1 --2- 172.21.15.77:0/2154603422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9d40cace0 0x7fa9d406c470 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4000c00 tx=0x7fa9c40046c0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.243+0000 7fa9db2b0640 1 -- 172.21.15.77:0/2154603422 shutdown_connections 2023-11-04T01:43:13.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.243+0000 7fa9db2b0640 1 --2- 172.21.15.77:0/2154603422 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa9b806ae70 0x7fa9b806d330 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.243+0000 7fa9db2b0640 1 --2- 172.21.15.77:0/2154603422 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa9d40cda60 0x7fa9d40aeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.243+0000 7fa9db2b0640 1 --2- 172.21.15.77:0/2154603422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9d40cace0 0x7fa9d406c470 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.243+0000 7fa9db2b0640 1 --2- 172.21.15.77:0/2154603422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa9d40b0cd0 0x7fa9d40c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.243+0000 7fa9db2b0640 1 -- 172.21.15.77:0/2154603422 >> 172.21.15.77:0/2154603422 conn(0x7fa9d40ce950 msgr2=0x7fa9d4156d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:13.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.244+0000 7fa9db2b0640 1 -- 172.21.15.77:0/2154603422 shutdown_connections 2023-11-04T01:43:13.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.244+0000 7fa9db2b0640 1 -- 172.21.15.77:0/2154603422 wait complete. 2023-11-04T01:43:13.257 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:13.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.353+0000 7fa7cb490640 1 Processor -- start 2023-11-04T01:43:13.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.354+0000 7fa7cb490640 1 -- start start 2023-11-04T01:43:13.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.354+0000 7fa7cb490640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa7c415ae40 0x7fa7c415bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.354+0000 7fa7cb490640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7c40cbc00 0x7fa7c40cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.354+0000 7fa7cb490640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7c40cc450 con 0x7fa7c40cd860 2023-11-04T01:43:13.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.354+0000 7fa7cb490640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7c415f400 con 0x7fa7c415ae40 2023-11-04T01:43:13.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.354+0000 7fa7cb490640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c415b220 con 0x7fa7c40cbc00 2023-11-04T01:43:13.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.355+0000 7fa7c8a2b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7c40cbc00 0x7fa7c40cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.355+0000 7fa7c9a2d640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fa7c40cd860 0x7fa7c40b2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:33334/0 (socket says 172.21.15.77:33334) 2023-11-04T01:43:13.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.355+0000 7fa7c9a2d640 1 -- 172.21.15.77:0/3927082174 learned_addr learned my addr 172.21.15.77:0/3927082174 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:13.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.355+0000 7fa7c922c640 1 --2- 172.21.15.77:0/3927082174 >> v2:172.21.15.122:3300/0 conn(0x7fa7c415ae40 0x7fa7c415bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.355+0000 7fa7bbfff640 1 -- 172.21.15.77:0/3927082174 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 391983909 0 0) 0x7fa7bc001110 con 0x7fa7c40cd860 2023-11-04T01:43:13.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.355+0000 7fa7bbfff640 1 -- 172.21.15.77:0/3927082174 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7b0003520 con 0x7fa7c40cd860 2023-11-04T01:43:13.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.355+0000 7fa7c8a2b640 1 -- 172.21.15.77:0/3927082174 >> v2:172.21.15.122:3300/0 conn(0x7fa7c415ae40 msgr2=0x7fa7c415bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:13.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.355+0000 7fa7c8a2b640 1 --2- 172.21.15.77:0/3927082174 >> v2:172.21.15.122:3300/0 conn(0x7fa7c415ae40 0x7fa7c415bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.355+0000 7fa7c8a2b640 1 -- 172.21.15.77:0/3927082174 >> v1:172.21.15.122:6789/0 conn(0x7fa7c40cd860 legacy=0x7fa7c40b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.355+0000 7fa7c8a2b640 1 -- 172.21.15.77:0/3927082174 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c415f890 con 0x7fa7c40cbc00 2023-11-04T01:43:13.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.355+0000 7fa7c922c640 1 --2- 172.21.15.77:0/3927082174 >> v2:172.21.15.122:3300/0 conn(0x7fa7c415ae40 0x7fa7c415bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:43:13.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.356+0000 7fa7c8a2b640 1 --2- 172.21.15.77:0/3927082174 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7c40cbc00 0x7fa7c40cd320 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa7b40097a0 tx=0x7fa7b402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=879a76233d1c65c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:13.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.356+0000 7fa7bbfff640 1 -- 172.21.15.77:0/3927082174 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b402d040 con 0x7fa7c40cbc00 2023-11-04T01:43:13.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.356+0000 7fa7bbfff640 1 -- 172.21.15.77:0/3927082174 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b4031810 con 0x7fa7c40cbc00 2023-11-04T01:43:13.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.356+0000 7fa7bbfff640 1 -- 172.21.15.77:0/3927082174 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4031ba0 con 0x7fa7c40cbc00 2023-11-04T01:43:13.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.356+0000 7fa7cb490640 1 -- 172.21.15.77:0/3927082174 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7c40cbc00 msgr2=0x7fa7c40cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.356+0000 7fa7cb490640 1 --2- 172.21.15.77:0/3927082174 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7c40cbc00 0x7fa7c40cd320 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa7b40097a0 tx=0x7fa7b402b8b0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.356+0000 7fa7cb490640 1 -- 172.21.15.77:0/3927082174 shutdown_connections 2023-11-04T01:43:13.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.356+0000 7fa7cb490640 1 --2- 172.21.15.77:0/3927082174 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7c40cbc00 0x7fa7c40cd320 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.356+0000 7fa7cb490640 1 --2- 172.21.15.77:0/3927082174 >> v2:172.21.15.122:3300/0 conn(0x7fa7c415ae40 0x7fa7c415bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.356+0000 7fa7cb490640 1 -- 172.21.15.77:0/3927082174 >> 172.21.15.77:0/3927082174 conn(0x7fa7c406ea90 msgr2=0x7fa7c406ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:13.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.357+0000 7fa7cb490640 1 -- 172.21.15.77:0/3927082174 shutdown_connections 2023-11-04T01:43:13.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.357+0000 7fa7cb490640 1 -- 172.21.15.77:0/3927082174 wait complete. 2023-11-04T01:43:13.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.358+0000 7fa7cb490640 1 Processor -- start 2023-11-04T01:43:13.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.358+0000 7fa7cb490640 1 -- start start 2023-11-04T01:43:13.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.358+0000 7fa7cb490640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7c40cbc00 0x7fa7c41f0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.358+0000 7fa7cb490640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7c40cd860 0x7fa7c41e4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.358+0000 7fa7cb490640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7c415ae40 0x7fa7c41e51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.358+0000 7fa7cb490640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c41e6380 con 0x7fa7c415ae40 2023-11-04T01:43:13.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.358+0000 7fa7cb490640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c41e5ae0 con 0x7fa7c40cbc00 2023-11-04T01:43:13.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.358+0000 7fa7cb490640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c41e5dc0 con 0x7fa7c40cd860 2023-11-04T01:43:13.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.359+0000 7fa7c9a2d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7c415ae40 0x7fa7c41e51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.359+0000 7fa7c9a2d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7c415ae40 0x7fa7c41e51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56954/0 (socket says 172.21.15.77:56954) 2023-11-04T01:43:13.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.359+0000 7fa7c9a2d640 1 -- 172.21.15.77:0/2228146809 learned_addr learned my addr 172.21.15.77:0/2228146809 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:13.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.359+0000 7fa7c922c640 1 --2- 172.21.15.77:0/2228146809 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7c40cbc00 0x7fa7c41f0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.359+0000 7fa7c8a2b640 1 --2- 172.21.15.77:0/2228146809 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7c40cd860 0x7fa7c41e4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.359+0000 7fa7c9a2d640 1 -- 172.21.15.77:0/2228146809 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7c40cd860 msgr2=0x7fa7c41e4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.359+0000 7fa7c9a2d640 1 --2- 172.21.15.77:0/2228146809 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7c40cd860 0x7fa7c41e4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.359+0000 7fa7c9a2d640 1 -- 172.21.15.77:0/2228146809 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7c40cbc00 msgr2=0x7fa7c41f0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.359+0000 7fa7c9a2d640 1 --2- 172.21.15.77:0/2228146809 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7c40cbc00 0x7fa7c41f0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.359+0000 7fa7c9a2d640 1 -- 172.21.15.77:0/2228146809 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c0009a70 con 0x7fa7c415ae40 2023-11-04T01:43:13.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.359+0000 7fa7c8a2b640 1 --2- 172.21.15.77:0/2228146809 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7c40cd860 0x7fa7c41e4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:13.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.359+0000 7fa7c9a2d640 1 --2- 172.21.15.77:0/2228146809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7c415ae40 0x7fa7c41e51a0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc00c700 tx=0x7fa7bc00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:13.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.359+0000 7fa7b9ffb640 1 -- 172.21.15.77:0/2228146809 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc005ab0 con 0x7fa7c415ae40 2023-11-04T01:43:13.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.359+0000 7fa7b9ffb640 1 -- 172.21.15.77:0/2228146809 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7bc005c10 con 0x7fa7c415ae40 2023-11-04T01:43:13.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.359+0000 7fa7cb490640 1 -- 172.21.15.77:0/2228146809 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7b4009400 con 0x7fa7c415ae40 2023-11-04T01:43:13.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.359+0000 7fa7b9ffb640 1 -- 172.21.15.77:0/2228146809 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc001d50 con 0x7fa7c415ae40 2023-11-04T01:43:13.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.359+0000 7fa7cb490640 1 -- 172.21.15.77:0/2228146809 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7c41f0c60 con 0x7fa7c415ae40 2023-11-04T01:43:13.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.360+0000 7fa7cb490640 1 -- 172.21.15.77:0/2228146809 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7c40ce2d0 con 0x7fa7c415ae40 2023-11-04T01:43:13.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.360+0000 7fa7b9ffb640 1 -- 172.21.15.77:0/2228146809 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa7bc007070 con 0x7fa7c415ae40 2023-11-04T01:43:13.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.361+0000 7fa7b9ffb640 1 --2- 172.21.15.77:0/2228146809 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa7a806aea0 0x7fa7a806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.361+0000 7fa7b9ffb640 1 -- 172.21.15.77:0/2228146809 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7148+0+0 (secure 0 0 0) 0x7fa7bc088f40 con 0x7fa7c415ae40 2023-11-04T01:43:13.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.361+0000 7fa7c922c640 1 --2- 172.21.15.77:0/2228146809 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa7a806aea0 0x7fa7a806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.361+0000 7fa7c922c640 1 --2- 172.21.15.77:0/2228146809 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa7a806aea0 0x7fa7a806d360 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa7c40cc380 tx=0x7fa7c000b040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:13.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.365+0000 7fa7b9ffb640 1 -- 172.21.15.77:0/2228146809 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa7bc053a50 con 0x7fa7c415ae40 2023-11-04T01:43:13.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.531+0000 7fa7cb490640 1 -- 172.21.15.77:0/2228146809 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7c40cc450 con 0x7fa7c415ae40 2023-11-04T01:43:13.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.533+0000 7fa7b9ffb640 1 -- 172.21.15.77:0/2228146809 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22051 (secure 0 0 0) 0x7fa7c40cc450 con 0x7fa7c415ae40 2023-11-04T01:43:13.536 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:43:13.536 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":84,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:43:11.611192+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:33.159064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:33.647358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:54.519050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:55.395781+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":84,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:13.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.535+0000 7fa7cb490640 1 -- 172.21.15.77:0/2228146809 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa7a806aea0 msgr2=0x7fa7a806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.535+0000 7fa7cb490640 1 --2- 172.21.15.77:0/2228146809 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa7a806aea0 0x7fa7a806d360 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa7c40cc380 tx=0x7fa7c000b040 comp rx=0 tx=0).stop 2023-11-04T01:43:13.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.535+0000 7fa7cb490640 1 -- 172.21.15.77:0/2228146809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7c415ae40 msgr2=0x7fa7c41e51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.535+0000 7fa7cb490640 1 --2- 172.21.15.77:0/2228146809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7c415ae40 0x7fa7c41e51a0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc00c700 tx=0x7fa7bc00cbc0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.535+0000 7fa7cb490640 1 -- 172.21.15.77:0/2228146809 shutdown_connections 2023-11-04T01:43:13.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.535+0000 7fa7cb490640 1 --2- 172.21.15.77:0/2228146809 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa7a806aea0 0x7fa7a806d360 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.535+0000 7fa7cb490640 1 --2- 172.21.15.77:0/2228146809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7c415ae40 0x7fa7c41e51a0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.535+0000 7fa7cb490640 1 --2- 172.21.15.77:0/2228146809 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7c40cd860 0x7fa7c41e4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.535+0000 7fa7cb490640 1 --2- 172.21.15.77:0/2228146809 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7c40cbc00 0x7fa7c41f0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.535+0000 7fa7cb490640 1 -- 172.21.15.77:0/2228146809 >> 172.21.15.77:0/2228146809 conn(0x7fa7c406ea90 msgr2=0x7fa7c415d850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:13.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.535+0000 7fa7cb490640 1 -- 172.21.15.77:0/2228146809 shutdown_connections 2023-11-04T01:43:13.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.535+0000 7fa7cb490640 1 -- 172.21.15.77:0/2228146809 wait complete. 2023-11-04T01:43:13.549 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-04T01:43:13.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.648+0000 7fcef275a640 1 Processor -- start 2023-11-04T01:43:13.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.648+0000 7fcef275a640 1 -- start start 2023-11-04T01:43:13.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.648+0000 7fcef275a640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fceec153e60 0x7fceec15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.648+0000 7fcef275a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fceec0b4880 0x7fceec0b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.648+0000 7fcef275a640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceec0cde60 con 0x7fceec0cd6d0 2023-11-04T01:43:13.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.648+0000 7fcef275a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceec160f90 con 0x7fceec0b4880 2023-11-04T01:43:13.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.648+0000 7fcef275a640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceec0b5200 con 0x7fceec153e60 2023-11-04T01:43:13.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.649+0000 7fcef0cf7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fceec0b4880 0x7fceec0b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.649+0000 7fcef0cf7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fceec0b4880 0x7fceec0b4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56956/0 (socket says 172.21.15.77:56956) 2023-11-04T01:43:13.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.649+0000 7fcef0cf7640 1 -- 172.21.15.77:0/2795639479 learned_addr learned my addr 172.21.15.77:0/2795639479 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:13.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.649+0000 7fceebfff640 1 --2- 172.21.15.77:0/2795639479 >> v2:172.21.15.122:3300/0 conn(0x7fceec153e60 0x7fceec15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.649+0000 7fcef0cf7640 1 -- 172.21.15.77:0/2795639479 >> v2:172.21.15.122:3300/0 conn(0x7fceec153e60 msgr2=0x7fceec15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:13.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.649+0000 7fcef0cf7640 1 --2- 172.21.15.77:0/2795639479 >> v2:172.21.15.122:3300/0 conn(0x7fceec153e60 0x7fceec15dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.649+0000 7fcef0cf7640 1 -- 172.21.15.77:0/2795639479 >> v1:172.21.15.122:6789/0 conn(0x7fceec0cd6d0 legacy=0x7fceec161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.649+0000 7fcef0cf7640 1 -- 172.21.15.77:0/2795639479 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceec15e400 con 0x7fceec0b4880 2023-11-04T01:43:13.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.650+0000 7fcef0cf7640 1 --2- 172.21.15.77:0/2795639479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fceec0b4880 0x7fceec0b4cc0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fceec08abe0 tx=0x7fcee402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d7d7dbd7db5a4c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:13.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.650+0000 7fceeaffd640 1 -- 172.21.15.77:0/2795639479 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee402cb20 con 0x7fceec0b4880 2023-11-04T01:43:13.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.650+0000 7fceeaffd640 1 -- 172.21.15.77:0/2795639479 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee402cc80 con 0x7fceec0b4880 2023-11-04T01:43:13.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.650+0000 7fceeaffd640 1 -- 172.21.15.77:0/2795639479 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee40343f0 con 0x7fceec0b4880 2023-11-04T01:43:13.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.650+0000 7fcef275a640 1 -- 172.21.15.77:0/2795639479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fceec0b4880 msgr2=0x7fceec0b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.650+0000 7fcef275a640 1 --2- 172.21.15.77:0/2795639479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fceec0b4880 0x7fceec0b4cc0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fceec08abe0 tx=0x7fcee402bf80 comp rx=0 tx=0).stop 2023-11-04T01:43:13.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.650+0000 7fcef275a640 1 -- 172.21.15.77:0/2795639479 shutdown_connections 2023-11-04T01:43:13.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.650+0000 7fcef275a640 1 --2- 172.21.15.77:0/2795639479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fceec0b4880 0x7fceec0b4cc0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.650+0000 7fcef275a640 1 --2- 172.21.15.77:0/2795639479 >> v2:172.21.15.122:3300/0 conn(0x7fceec153e60 0x7fceec15dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.650+0000 7fcef275a640 1 -- 172.21.15.77:0/2795639479 >> 172.21.15.77:0/2795639479 conn(0x7fceec0cf880 msgr2=0x7fceec0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:13.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.650+0000 7fcef275a640 1 -- 172.21.15.77:0/2795639479 shutdown_connections 2023-11-04T01:43:13.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.650+0000 7fcef275a640 1 -- 172.21.15.77:0/2795639479 wait complete. 2023-11-04T01:43:13.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.651+0000 7fcef275a640 1 Processor -- start 2023-11-04T01:43:13.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.652+0000 7fcef275a640 1 -- start start 2023-11-04T01:43:13.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.652+0000 7fcef275a640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fceec0b4880 0x7fceec1f3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.652+0000 7fcef275a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fceec0cd6d0 0x7fceec0cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.652+0000 7fcef275a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fceec153e60 0x7fceec0ca140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.652+0000 7fcef275a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec0c7f90 con 0x7fceec153e60 2023-11-04T01:43:13.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.652+0000 7fcef275a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec0c7980 con 0x7fceec0cd6d0 2023-11-04T01:43:13.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.652+0000 7fcef275a640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceec0cce30 con 0x7fceec0b4880 2023-11-04T01:43:13.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.652+0000 7fcef0cf7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fceec153e60 0x7fceec0ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.652+0000 7fcef0cf7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fceec153e60 0x7fceec0ca140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56970/0 (socket says 172.21.15.77:56970) 2023-11-04T01:43:13.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.652+0000 7fcef0cf7640 1 -- 172.21.15.77:0/4255695346 learned_addr learned my addr 172.21.15.77:0/4255695346 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:13.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.653+0000 7fceeb7fe640 1 --2- 172.21.15.77:0/4255695346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fceec0cd6d0 0x7fceec0cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.653+0000 7fcef0cf7640 1 -- 172.21.15.77:0/4255695346 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fceec0b4880 msgr2=0x7fceec1f3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.653+0000 7fceebfff640 1 --2- 172.21.15.77:0/4255695346 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fceec0b4880 0x7fceec1f3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.653+0000 7fcef0cf7640 1 --2- 172.21.15.77:0/4255695346 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fceec0b4880 0x7fceec1f3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.653+0000 7fcef0cf7640 1 -- 172.21.15.77:0/4255695346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fceec0cd6d0 msgr2=0x7fceec0cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.653+0000 7fcef0cf7640 1 --2- 172.21.15.77:0/4255695346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fceec0cd6d0 0x7fceec0cc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.653+0000 7fcef0cf7640 1 -- 172.21.15.77:0/4255695346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee4009b30 con 0x7fceec153e60 2023-11-04T01:43:13.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.653+0000 7fceeb7fe640 1 --2- 172.21.15.77:0/4255695346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fceec0cd6d0 0x7fceec0cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:13.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.653+0000 7fcef0cf7640 1 --2- 172.21.15.77:0/4255695346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fceec153e60 0x7fceec0ca140 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fcee4009f40 tx=0x7fcee4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:13.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.653+0000 7fcee8ff9640 1 -- 172.21.15.77:0/4255695346 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee4009510 con 0x7fceec153e60 2023-11-04T01:43:13.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.653+0000 7fcee8ff9640 1 -- 172.21.15.77:0/4255695346 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee4007e40 con 0x7fceec153e60 2023-11-04T01:43:13.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.653+0000 7fcef275a640 1 -- 172.21.15.77:0/4255695346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceec0cd0d0 con 0x7fceec153e60 2023-11-04T01:43:13.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.653+0000 7fcee8ff9640 1 -- 172.21.15.77:0/4255695346 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee403e690 con 0x7fceec153e60 2023-11-04T01:43:13.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.653+0000 7fcef275a640 1 -- 172.21.15.77:0/4255695346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceec0c7c20 con 0x7fceec153e60 2023-11-04T01:43:13.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.654+0000 7fcef275a640 1 -- 172.21.15.77:0/4255695346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceec0c8100 con 0x7fceec153e60 2023-11-04T01:43:13.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.655+0000 7fcee8ff9640 1 -- 172.21.15.77:0/4255695346 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcee403e7f0 con 0x7fceec153e60 2023-11-04T01:43:13.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.655+0000 7fcee8ff9640 1 --2- 172.21.15.77:0/4255695346 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fced806ae70 0x7fced806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.655+0000 7fcee8ff9640 1 -- 172.21.15.77:0/4255695346 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7148+0+0 (secure 0 0 0) 0x7fcee40ac710 con 0x7fceec153e60 2023-11-04T01:43:13.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.655+0000 7fceebfff640 1 --2- 172.21.15.77:0/4255695346 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fced806ae70 0x7fced806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.656+0000 7fceebfff640 1 --2- 172.21.15.77:0/4255695346 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fced806ae70 0x7fced806d330 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fcedc009970 tx=0x7fcedc008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:13.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.659+0000 7fcee8ff9640 1 -- 172.21.15.77:0/4255695346 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcee4077220 con 0x7fceec153e60 2023-11-04T01:43:13.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.861+0000 7fcef275a640 1 -- 172.21.15.77:0/4255695346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fceec074290 con 0x7fceec153e60 2023-11-04T01:43:13.864 INFO:tasks.ceph.mon.a.smithi077.stderr:2023-11-04T01:43:13.862+0000 7f1217737640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-04T01:43:13.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.866+0000 7fcee8ff9640 1 -- 172.21.15.77:0/4255695346 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v38) v1 ==== 161+0+0 (secure 0 0 0) 0x7fcee407a840 con 0x7fceec153e60 2023-11-04T01:43:13.868 INFO:teuthology.orchestra.run.smithi077.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-04T01:43:13.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.868+0000 7fcef275a640 1 -- 172.21.15.77:0/4255695346 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fced806ae70 msgr2=0x7fced806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.868+0000 7fcef275a640 1 --2- 172.21.15.77:0/4255695346 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fced806ae70 0x7fced806d330 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fcedc009970 tx=0x7fcedc008040 comp rx=0 tx=0).stop 2023-11-04T01:43:13.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.868+0000 7fcef275a640 1 -- 172.21.15.77:0/4255695346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fceec153e60 msgr2=0x7fceec0ca140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.868+0000 7fcef275a640 1 --2- 172.21.15.77:0/4255695346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fceec153e60 0x7fceec0ca140 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fcee4009f40 tx=0x7fcee4004a40 comp rx=0 tx=0).stop 2023-11-04T01:43:13.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.868+0000 7fcef275a640 1 -- 172.21.15.77:0/4255695346 shutdown_connections 2023-11-04T01:43:13.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.868+0000 7fcef275a640 1 --2- 172.21.15.77:0/4255695346 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fced806ae70 0x7fced806d330 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.868+0000 7fcef275a640 1 --2- 172.21.15.77:0/4255695346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fceec153e60 0x7fceec0ca140 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.868+0000 7fcef275a640 1 --2- 172.21.15.77:0/4255695346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fceec0cd6d0 0x7fceec0cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.868+0000 7fcef275a640 1 --2- 172.21.15.77:0/4255695346 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fceec0b4880 0x7fceec1f3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.868+0000 7fcef275a640 1 -- 172.21.15.77:0/4255695346 >> 172.21.15.77:0/4255695346 conn(0x7fceec0cf880 msgr2=0x7fceec0cfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:13.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.868+0000 7fcef275a640 1 -- 172.21.15.77:0/4255695346 shutdown_connections 2023-11-04T01:43:13.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.868+0000 7fcef275a640 1 -- 172.21.15.77:0/4255695346 wait complete. 2023-11-04T01:43:13.873 INFO:tasks.ceph.mds.d.smithi122.stderr: -2663> 2023-11-04T01:43:01.582+0000 7f5caafbf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:43:13.882 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-04T01:43:13.902 INFO:tasks.ceph.mds.d.smithi122.stdout:starting mds.d at 2023-11-04T01:43:13.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.981+0000 7f1d29305640 1 Processor -- start 2023-11-04T01:43:13.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.981+0000 7f1d29305640 1 -- start start 2023-11-04T01:43:13.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.981+0000 7f1d29305640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1d24153e60 0x7f1d2415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.981+0000 7f1d29305640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d240cde60 con 0x7f1d240cd6d0 2023-11-04T01:43:13.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.981+0000 7f1d29305640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d24160f90 con 0x7f1d240b4880 2023-11-04T01:43:13.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.981+0000 7f1d29305640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d2415e400 con 0x7f1d24153e60 2023-11-04T01:43:13.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.981+0000 7f1d227fc640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f1d240cd6d0 0x7f1d24161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:56194/0 (socket says 172.21.15.77:56194) 2023-11-04T01:43:13.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.981+0000 7f1d227fc640 1 -- 172.21.15.77:0/407671938 learned_addr learned my addr 172.21.15.77:0/407671938 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:13.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.982+0000 7f1d22ffd640 1 --2- 172.21.15.77:0/407671938 >> v2:172.21.15.122:3300/0 conn(0x7f1d24153e60 0x7f1d2415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.982+0000 7f1d21ffb640 1 -- 172.21.15.77:0/407671938 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2792240438 0 0) 0x7f1d240cde60 con 0x7f1d240cd6d0 2023-11-04T01:43:13.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.982+0000 7f1d21ffb640 1 -- 172.21.15.77:0/407671938 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d10003520 con 0x7f1d240cd6d0 2023-11-04T01:43:13.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.982+0000 7f1d21ffb640 1 -- 172.21.15.77:0/407671938 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3726906233 0 0) 0x7f1d24160f90 con 0x7f1d240b4880 2023-11-04T01:43:13.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.982+0000 7f1d21ffb640 1 -- 172.21.15.77:0/407671938 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d240cde60 con 0x7f1d240b4880 2023-11-04T01:43:13.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.982+0000 7f1d22ffd640 1 -- 172.21.15.77:0/407671938 >> v1:172.21.15.122:6789/0 conn(0x7f1d240b4880 legacy=0x7f1d240d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.982+0000 7f1d22ffd640 1 -- 172.21.15.77:0/407671938 >> v1:172.21.15.77:6789/0 conn(0x7f1d240cd6d0 legacy=0x7f1d24161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.982+0000 7f1d22ffd640 1 -- 172.21.15.77:0/407671938 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d240ce090 con 0x7f1d24153e60 2023-11-04T01:43:13.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.983+0000 7f1d22ffd640 1 --2- 172.21.15.77:0/407671938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d24153e60 0x7f1d2415dec0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c0097a0 tx=0x7f1d1c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f68d7675a89f4f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:13.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.983+0000 7f1d21ffb640 1 -- 172.21.15.77:0/407671938 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c030610 con 0x7f1d24153e60 2023-11-04T01:43:13.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.983+0000 7f1d21ffb640 1 -- 172.21.15.77:0/407671938 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1c030770 con 0x7f1d24153e60 2023-11-04T01:43:13.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.983+0000 7f1d21ffb640 1 -- 172.21.15.77:0/407671938 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c030b00 con 0x7f1d24153e60 2023-11-04T01:43:13.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.983+0000 7f1d29305640 1 -- 172.21.15.77:0/407671938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d24153e60 msgr2=0x7f1d2415dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.983+0000 7f1d29305640 1 --2- 172.21.15.77:0/407671938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d24153e60 0x7f1d2415dec0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c0097a0 tx=0x7f1d1c02b960 comp rx=0 tx=0).stop 2023-11-04T01:43:13.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.983+0000 7f1d29305640 1 -- 172.21.15.77:0/407671938 shutdown_connections 2023-11-04T01:43:13.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.983+0000 7f1d29305640 1 --2- 172.21.15.77:0/407671938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d24153e60 0x7f1d2415dec0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.983+0000 7f1d29305640 1 -- 172.21.15.77:0/407671938 >> 172.21.15.77:0/407671938 conn(0x7f1d240cf880 msgr2=0x7f1d240cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:13.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.983+0000 7f1d29305640 1 -- 172.21.15.77:0/407671938 shutdown_connections 2023-11-04T01:43:13.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.984+0000 7f1d29305640 1 -- 172.21.15.77:0/407671938 wait complete. 2023-11-04T01:43:13.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.985+0000 7f1d29305640 1 Processor -- start 2023-11-04T01:43:13.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.985+0000 7f1d29305640 1 -- start start 2023-11-04T01:43:13.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.985+0000 7f1d29305640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1d240b4880 0x7f1d2415eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.985+0000 7f1d29305640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d240cd6d0 0x7f1d241f5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.985+0000 7f1d29305640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d24153e60 0x7f1d241f61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.985+0000 7f1d29305640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d241f26c0 con 0x7f1d240cd6d0 2023-11-04T01:43:13.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.985+0000 7f1d29305640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d241f6730 con 0x7f1d24153e60 2023-11-04T01:43:13.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.985+0000 7f1d29305640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d241f2f00 con 0x7f1d240b4880 2023-11-04T01:43:13.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.986+0000 7f1d227fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d240cd6d0 0x7f1d241f5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.986+0000 7f1d227fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d240cd6d0 0x7f1d241f5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56972/0 (socket says 172.21.15.77:56972) 2023-11-04T01:43:13.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.986+0000 7f1d227fc640 1 -- 172.21.15.77:0/2690262397 learned_addr learned my addr 172.21.15.77:0/2690262397 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:13.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.986+0000 7f1d22ffd640 1 --2- 172.21.15.77:0/2690262397 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1d240b4880 0x7f1d2415eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.986+0000 7f1d237fe640 1 --2- 172.21.15.77:0/2690262397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d24153e60 0x7f1d241f61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.986+0000 7f1d227fc640 1 -- 172.21.15.77:0/2690262397 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1d240b4880 msgr2=0x7f1d2415eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.986+0000 7f1d227fc640 1 --2- 172.21.15.77:0/2690262397 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1d240b4880 0x7f1d2415eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.986+0000 7f1d227fc640 1 -- 172.21.15.77:0/2690262397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d24153e60 msgr2=0x7f1d241f61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.986+0000 7f1d227fc640 1 --2- 172.21.15.77:0/2690262397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d24153e60 0x7f1d241f61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.986+0000 7f1d227fc640 1 -- 172.21.15.77:0/2690262397 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1c009400 con 0x7f1d240cd6d0 2023-11-04T01:43:13.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.986+0000 7f1d22ffd640 1 --2- 172.21.15.77:0/2690262397 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1d240b4880 0x7f1d2415eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:13.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.986+0000 7f1d237fe640 1 --2- 172.21.15.77:0/2690262397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d24153e60 0x7f1d241f61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:13.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.986+0000 7f1d227fc640 1 --2- 172.21.15.77:0/2690262397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d240cd6d0 0x7f1d241f5cb0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c001eb0 tx=0x7f1d0c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:13.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.986+0000 7f1d1b7fe640 1 -- 172.21.15.77:0/2690262397 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c005ce0 con 0x7f1d240cd6d0 2023-11-04T01:43:13.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.986+0000 7f1d1b7fe640 1 -- 172.21.15.77:0/2690262397 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d0c005e40 con 0x7f1d240cd6d0 2023-11-04T01:43:13.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.986+0000 7f1d29305640 1 -- 172.21.15.77:0/2690262397 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d241f6970 con 0x7f1d240cd6d0 2023-11-04T01:43:13.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.986+0000 7f1d1b7fe640 1 -- 172.21.15.77:0/2690262397 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c007270 con 0x7f1d240cd6d0 2023-11-04T01:43:13.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.986+0000 7f1d29305640 1 -- 172.21.15.77:0/2690262397 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d241f2b90 con 0x7f1d240cd6d0 2023-11-04T01:43:13.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.987+0000 7f1d29305640 1 -- 172.21.15.77:0/2690262397 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d24074290 con 0x7f1d240cd6d0 2023-11-04T01:43:13.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.988+0000 7f1d1b7fe640 1 -- 172.21.15.77:0/2690262397 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1d0c0073d0 con 0x7f1d240cd6d0 2023-11-04T01:43:13.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.988+0000 7f1d1b7fe640 1 --2- 172.21.15.77:0/2690262397 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1d0406ae70 0x7f1d0406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.988+0000 7f1d1b7fe640 1 -- 172.21.15.77:0/2690262397 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7206+0+0 (secure 0 0 0) 0x7f1d0c089090 con 0x7f1d240cd6d0 2023-11-04T01:43:13.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.988+0000 7f1d22ffd640 1 --2- 172.21.15.77:0/2690262397 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1d0406ae70 0x7f1d0406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.989+0000 7f1d22ffd640 1 --2- 172.21.15.77:0/2690262397 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1d0406ae70 0x7f1d0406d330 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c036000 tx=0x7f1d1c03b040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:13.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:13.992+0000 7f1d1b7fe640 1 -- 172.21.15.77:0/2690262397 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1d0c053b80 con 0x7f1d240cd6d0 2023-11-04T01:43:14.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.193+0000 7f1d29305640 1 -- 172.21.15.77:0/2690262397 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1d240d0b80 con 0x7f1d240cd6d0 2023-11-04T01:43:14.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.868+0000 7f1d1b7fe640 1 -- 172.21.15.77:0/2690262397 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v39) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1d0c0170a0 con 0x7f1d240cd6d0 2023-11-04T01:43:14.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.870+0000 7f1d29305640 1 -- 172.21.15.77:0/2690262397 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1d0406ae70 msgr2=0x7f1d0406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:14.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.870+0000 7f1d29305640 1 --2- 172.21.15.77:0/2690262397 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1d0406ae70 0x7f1d0406d330 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c036000 tx=0x7f1d1c03b040 comp rx=0 tx=0).stop 2023-11-04T01:43:14.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.870+0000 7f1d29305640 1 -- 172.21.15.77:0/2690262397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d240cd6d0 msgr2=0x7f1d241f5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:14.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.870+0000 7f1d29305640 1 --2- 172.21.15.77:0/2690262397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d240cd6d0 0x7f1d241f5cb0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c001eb0 tx=0x7f1d0c00c960 comp rx=0 tx=0).stop 2023-11-04T01:43:14.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.870+0000 7f1d29305640 1 -- 172.21.15.77:0/2690262397 shutdown_connections 2023-11-04T01:43:14.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.870+0000 7f1d29305640 1 --2- 172.21.15.77:0/2690262397 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1d0406ae70 0x7f1d0406d330 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.870+0000 7f1d29305640 1 --2- 172.21.15.77:0/2690262397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d24153e60 0x7f1d241f61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.870+0000 7f1d29305640 1 --2- 172.21.15.77:0/2690262397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d240cd6d0 0x7f1d241f5cb0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.870+0000 7f1d29305640 1 --2- 172.21.15.77:0/2690262397 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1d240b4880 0x7f1d2415eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.870+0000 7f1d29305640 1 -- 172.21.15.77:0/2690262397 >> 172.21.15.77:0/2690262397 conn(0x7f1d240cf880 msgr2=0x7f1d240cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:14.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.870+0000 7f1d29305640 1 -- 172.21.15.77:0/2690262397 shutdown_connections 2023-11-04T01:43:14.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.870+0000 7f1d29305640 1 -- 172.21.15.77:0/2690262397 wait complete. 2023-11-04T01:43:14.883 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-04T01:43:14.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.987+0000 7f08784a9640 1 Processor -- start 2023-11-04T01:43:14.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.987+0000 7f08784a9640 1 -- start start 2023-11-04T01:43:14.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.988+0000 7f08784a9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f08700cd9f0 0x7f08700cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:14.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.988+0000 7f08784a9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f087015d4b0 0x7f087015d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:14.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.988+0000 7f08784a9640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08700d1320 con 0x7f08700b47e0 2023-11-04T01:43:14.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.988+0000 7f08784a9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f087015e4d0 con 0x7f08700cd9f0 2023-11-04T01:43:14.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.988+0000 7f08784a9640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08700ce310 con 0x7f087015d4b0 2023-11-04T01:43:14.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.988+0000 7f0876245640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f08700cd9f0 0x7f08700cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:14.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.989+0000 7f0876245640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f08700cd9f0 0x7f08700cddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56978/0 (socket says 172.21.15.77:56978) 2023-11-04T01:43:14.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.989+0000 7f0876245640 1 -- 172.21.15.77:0/3482835942 learned_addr learned my addr 172.21.15.77:0/3482835942 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:14.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.989+0000 7f0875a44640 1 --2- 172.21.15.77:0/3482835942 >> v2:172.21.15.122:3300/0 conn(0x7f087015d4b0 0x7f087015d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:14.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.989+0000 7f0876245640 1 -- 172.21.15.77:0/3482835942 >> v2:172.21.15.122:3300/0 conn(0x7f087015d4b0 msgr2=0x7f087015d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:14.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.989+0000 7f0876245640 1 --2- 172.21.15.77:0/3482835942 >> v2:172.21.15.122:3300/0 conn(0x7f087015d4b0 0x7f087015d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.989+0000 7f0876245640 1 -- 172.21.15.77:0/3482835942 >> v1:172.21.15.122:6789/0 conn(0x7f08700b47e0 legacy=0x7f08700b4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:14.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.989+0000 7f0876245640 1 -- 172.21.15.77:0/3482835942 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087015df10 con 0x7f08700cd9f0 2023-11-04T01:43:14.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.990+0000 7f0876245640 1 --2- 172.21.15.77:0/3482835942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08700cd9f0 0x7f08700cddd0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f086c009e50 tx=0x7f086c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb64adc93033aaa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:14.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.990+0000 7f0875243640 1 -- 172.21.15.77:0/3482835942 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086c02cb20 con 0x7f08700cd9f0 2023-11-04T01:43:14.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.990+0000 7f0875243640 1 -- 172.21.15.77:0/3482835942 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086c02cc80 con 0x7f08700cd9f0 2023-11-04T01:43:14.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.990+0000 7f0875243640 1 -- 172.21.15.77:0/3482835942 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086c0343f0 con 0x7f08700cd9f0 2023-11-04T01:43:14.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.990+0000 7f08784a9640 1 -- 172.21.15.77:0/3482835942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08700cd9f0 msgr2=0x7f08700cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:14.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.990+0000 7f08784a9640 1 --2- 172.21.15.77:0/3482835942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08700cd9f0 0x7f08700cddd0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f086c009e50 tx=0x7f086c02bf80 comp rx=0 tx=0).stop 2023-11-04T01:43:14.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.990+0000 7f08784a9640 1 -- 172.21.15.77:0/3482835942 shutdown_connections 2023-11-04T01:43:14.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.990+0000 7f08784a9640 1 --2- 172.21.15.77:0/3482835942 >> v2:172.21.15.122:3300/0 conn(0x7f087015d4b0 0x7f087015d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.990+0000 7f08784a9640 1 --2- 172.21.15.77:0/3482835942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08700cd9f0 0x7f08700cddd0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.990+0000 7f08784a9640 1 -- 172.21.15.77:0/3482835942 >> 172.21.15.77:0/3482835942 conn(0x7f0870071c40 msgr2=0x7f0870072050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:14.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.990+0000 7f08784a9640 1 -- 172.21.15.77:0/3482835942 shutdown_connections 2023-11-04T01:43:14.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.990+0000 7f08784a9640 1 -- 172.21.15.77:0/3482835942 wait complete. 2023-11-04T01:43:14.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.991+0000 7f08784a9640 1 Processor -- start 2023-11-04T01:43:14.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.992+0000 7f08784a9640 1 -- start start 2023-11-04T01:43:14.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.992+0000 7f08784a9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08700b47e0 0x7f087015c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:14.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.992+0000 7f08784a9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f08700cd9f0 0x7f08700a9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:15.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.992+0000 7f08784a9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f087015d4b0 0x7f0870157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:15.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.992+0000 7f08784a9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08700aa230 con 0x7f087015d4b0 2023-11-04T01:43:15.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.992+0000 7f08784a9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08700aa510 con 0x7f08700b47e0 2023-11-04T01:43:15.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.992+0000 7f08784a9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08700aa7f0 con 0x7f08700cd9f0 2023-11-04T01:43:15.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.992+0000 7f0876a46640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f087015d4b0 0x7f0870157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:15.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.992+0000 7f0876a46640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f087015d4b0 0x7f0870157f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56982/0 (socket says 172.21.15.77:56982) 2023-11-04T01:43:15.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.992+0000 7f0876a46640 1 -- 172.21.15.77:0/3427687598 learned_addr learned my addr 172.21.15.77:0/3427687598 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:15.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.993+0000 7f0875a44640 1 --2- 172.21.15.77:0/3427687598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f08700cd9f0 0x7f08700a9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:15.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.993+0000 7f0876245640 1 --2- 172.21.15.77:0/3427687598 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08700b47e0 0x7f087015c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:15.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.993+0000 7f0876a46640 1 -- 172.21.15.77:0/3427687598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f08700cd9f0 msgr2=0x7f08700a9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:15.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.993+0000 7f0876a46640 1 --2- 172.21.15.77:0/3427687598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f08700cd9f0 0x7f08700a9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.993+0000 7f0876a46640 1 -- 172.21.15.77:0/3427687598 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08700b47e0 msgr2=0x7f087015c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:15.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.993+0000 7f0876a46640 1 --2- 172.21.15.77:0/3427687598 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08700b47e0 0x7f087015c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.993+0000 7f0876a46640 1 -- 172.21.15.77:0/3427687598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086c009b30 con 0x7f087015d4b0 2023-11-04T01:43:15.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.993+0000 7f0875a44640 1 --2- 172.21.15.77:0/3427687598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f08700cd9f0 0x7f08700a9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:15.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.993+0000 7f0876245640 1 --2- 172.21.15.77:0/3427687598 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08700b47e0 0x7f087015c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:15.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.993+0000 7f0876a46640 1 --2- 172.21.15.77:0/3427687598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f087015d4b0 0x7f0870157f30 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f086800b410 tx=0x7f086800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:15.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.993+0000 7f0866ffd640 1 -- 172.21.15.77:0/3427687598 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0868004020 con 0x7f087015d4b0 2023-11-04T01:43:15.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.993+0000 7f0866ffd640 1 -- 172.21.15.77:0/3427687598 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0868004180 con 0x7f087015d4b0 2023-11-04T01:43:15.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.993+0000 7f08784a9640 1 -- 172.21.15.77:0/3427687598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08700aaad0 con 0x7f087015d4b0 2023-11-04T01:43:15.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.993+0000 7f0866ffd640 1 -- 172.21.15.77:0/3427687598 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0868011630 con 0x7f087015d4b0 2023-11-04T01:43:15.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.993+0000 7f08784a9640 1 -- 172.21.15.77:0/3427687598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f087015cb40 con 0x7f087015d4b0 2023-11-04T01:43:15.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.994+0000 7f08784a9640 1 -- 172.21.15.77:0/3427687598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08700ada60 con 0x7f087015d4b0 2023-11-04T01:43:15.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.994+0000 7f0866ffd640 1 -- 172.21.15.77:0/3427687598 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0868011790 con 0x7f087015d4b0 2023-11-04T01:43:15.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.995+0000 7f0866ffd640 1 --2- 172.21.15.77:0/3427687598 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f085406aea0 0x7f085406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:15.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.995+0000 7f0866ffd640 1 -- 172.21.15.77:0/3427687598 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7206+0+0 (secure 0 0 0) 0x7f08680897e0 con 0x7f087015d4b0 2023-11-04T01:43:15.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.995+0000 7f0876245640 1 --2- 172.21.15.77:0/3427687598 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f085406aea0 0x7f085406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:15.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.995+0000 7f0876245640 1 --2- 172.21.15.77:0/3427687598 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f085406aea0 0x7f085406d360 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f086c035000 tx=0x7f086c030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:15.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:14.999+0000 7f0866ffd640 1 -- 172.21.15.77:0/3427687598 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f08700ada60 con 0x7f087015d4b0 2023-11-04T01:43:15.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:15.165+0000 7f08784a9640 1 -- 172.21.15.77:0/3427687598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f08700ada60 con 0x7f087015d4b0 2023-11-04T01:43:15.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:15.869+0000 7f0866ffd640 1 -- 172.21.15.77:0/3427687598 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v86) v1 ==== 181+0+0 (secure 0 0 0) 0x7f08700ada60 con 0x7f087015d4b0 2023-11-04T01:43:15.871 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_metadata' removed 2023-11-04T01:43:15.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:15.872+0000 7f08784a9640 1 -- 172.21.15.77:0/3427687598 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f085406aea0 msgr2=0x7f085406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:15.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:15.872+0000 7f08784a9640 1 --2- 172.21.15.77:0/3427687598 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f085406aea0 0x7f085406d360 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f086c035000 tx=0x7f086c030000 comp rx=0 tx=0).stop 2023-11-04T01:43:15.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:15.872+0000 7f08784a9640 1 -- 172.21.15.77:0/3427687598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f087015d4b0 msgr2=0x7f0870157f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:15.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:15.872+0000 7f08784a9640 1 --2- 172.21.15.77:0/3427687598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f087015d4b0 0x7f0870157f30 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f086800b410 tx=0x7f086800b8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:15.872+0000 7f08784a9640 1 -- 172.21.15.77:0/3427687598 shutdown_connections 2023-11-04T01:43:15.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:15.872+0000 7f08784a9640 1 --2- 172.21.15.77:0/3427687598 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f085406aea0 0x7f085406d360 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:15.872+0000 7f08784a9640 1 --2- 172.21.15.77:0/3427687598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f087015d4b0 0x7f0870157f30 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:15.872+0000 7f08784a9640 1 --2- 172.21.15.77:0/3427687598 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f08700cd9f0 0x7f08700a9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:15.872+0000 7f08784a9640 1 --2- 172.21.15.77:0/3427687598 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08700b47e0 0x7f087015c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:15.872+0000 7f08784a9640 1 -- 172.21.15.77:0/3427687598 >> 172.21.15.77:0/3427687598 conn(0x7f0870071c40 msgr2=0x7f08700d2610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:15.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:15.872+0000 7f08784a9640 1 -- 172.21.15.77:0/3427687598 shutdown_connections 2023-11-04T01:43:15.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:15.872+0000 7f08784a9640 1 -- 172.21.15.77:0/3427687598 wait complete. 2023-11-04T01:43:15.887 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-04T01:43:16.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:15.998+0000 7fc2a1a1a640 1 Processor -- start 2023-11-04T01:43:16.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:15.998+0000 7fc2a1a1a640 1 -- start start 2023-11-04T01:43:16.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:15.999+0000 7fc2a1a1a640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc29c0cdc50 0x7fc29c167ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:15.999+0000 7fc2a1a1a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc29c161870 con 0x7fc29c0cb680 2023-11-04T01:43:16.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:15.999+0000 7fc2a1a1a640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc29c160c60 con 0x7fc29c15d1b0 2023-11-04T01:43:16.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:15.999+0000 7fc2a1a1a640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c160f40 con 0x7fc29c0cdc50 2023-11-04T01:43:16.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:15.999+0000 7fc29a7fc640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc29c0cb680 0x7fc29c0cd540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:56204/0 (socket says 172.21.15.77:56204) 2023-11-04T01:43:16.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:15.999+0000 7fc29a7fc640 1 -- 172.21.15.77:0/2985449732 learned_addr learned my addr 172.21.15.77:0/2985449732 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:16.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:15.999+0000 7fc299ffb640 1 -- 172.21.15.77:0/2985449732 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3335376036 0 0) 0x7fc29c161870 con 0x7fc29c0cb680 2023-11-04T01:43:16.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:15.999+0000 7fc299ffb640 1 -- 172.21.15.77:0/2985449732 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc284003520 con 0x7fc29c0cb680 2023-11-04T01:43:16.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:15.999+0000 7fc29b7fe640 1 --2- 172.21.15.77:0/2985449732 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc29c0cdc50 0x7fc29c167ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:15.999+0000 7fc299ffb640 1 -- 172.21.15.77:0/2985449732 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2089584986 0 0) 0x7fc284003520 con 0x7fc29c0cb680 2023-11-04T01:43:16.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:15.999+0000 7fc299ffb640 1 -- 172.21.15.77:0/2985449732 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc29c0cdc50 msgr2=0x7fc29c167ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:16.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:15.999+0000 7fc299ffb640 1 --2- 172.21.15.77:0/2985449732 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc29c0cdc50 0x7fc29c167ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:15.999+0000 7fc299ffb640 1 -- 172.21.15.77:0/2985449732 >> v1:172.21.15.122:6789/0 conn(0x7fc29c15d1b0 legacy=0x7fc29c0ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:15.999+0000 7fc299ffb640 1 -- 172.21.15.77:0/2985449732 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29c161220 con 0x7fc29c0cb680 2023-11-04T01:43:16.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:15.999+0000 7fc299ffb640 1 -- 172.21.15.77:0/2985449732 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7fc290001670 con 0x7fc29c0cb680 2023-11-04T01:43:16.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.000+0000 7fc299ffb640 1 -- 172.21.15.77:0/2985449732 >> v1:172.21.15.77:6789/0 conn(0x7fc29c0cb680 legacy=0x7fc29c0cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.000+0000 7fc299ffb640 1 --2- 172.21.15.77:0/2985449732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2840039a0 0x7fc284003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.000+0000 7fc299ffb640 1 --2- 172.21.15.77:0/2985449732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2840047c0 0x7fc284004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.000+0000 7fc299ffb640 1 --2- 172.21.15.77:0/2985449732 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc29c0cdc50 0x7fc284005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.000+0000 7fc299ffb640 1 -- 172.21.15.77:0/2985449732 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c160f40 con 0x7fc2840039a0 2023-11-04T01:43:16.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.000+0000 7fc299ffb640 1 -- 172.21.15.77:0/2985449732 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28400ba60 con 0x7fc2840047c0 2023-11-04T01:43:16.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.000+0000 7fc299ffb640 1 -- 172.21.15.77:0/2985449732 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc28400bc20 con 0x7fc29c0cdc50 2023-11-04T01:43:16.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.000+0000 7fc29affd640 1 --2- 172.21.15.77:0/2985449732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2840039a0 0x7fc284003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.000+0000 7fc29a7fc640 1 --2- 172.21.15.77:0/2985449732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2840047c0 0x7fc284004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.000+0000 7fc29b7fe640 1 --2- 172.21.15.77:0/2985449732 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc29c0cdc50 0x7fc284005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.000+0000 7fc29affd640 1 -- 172.21.15.77:0/2985449732 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc29c0cdc50 msgr2=0x7fc284005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:16.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.000+0000 7fc29affd640 1 --2- 172.21.15.77:0/2985449732 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc29c0cdc50 0x7fc284005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.000+0000 7fc29affd640 1 -- 172.21.15.77:0/2985449732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2840047c0 msgr2=0x7fc284004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:16.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.000+0000 7fc29affd640 1 --2- 172.21.15.77:0/2985449732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2840047c0 0x7fc284004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.000+0000 7fc29affd640 1 -- 172.21.15.77:0/2985449732 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc284003520 con 0x7fc2840039a0 2023-11-04T01:43:16.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.000+0000 7fc29a7fc640 1 --2- 172.21.15.77:0/2985449732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2840047c0 0x7fc284004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:16.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.001+0000 7fc29affd640 1 --2- 172.21.15.77:0/2985449732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2840039a0 0x7fc284003dc0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fc28c001e20 tx=0x7fc2840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a6892dce56350b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:16.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.001+0000 7fc299ffb640 1 -- 172.21.15.77:0/2985449732 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c003b70 con 0x7fc2840039a0 2023-11-04T01:43:16.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.001+0000 7fc299ffb640 1 -- 172.21.15.77:0/2985449732 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28c003cd0 con 0x7fc2840039a0 2023-11-04T01:43:16.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.001+0000 7fc299ffb640 1 -- 172.21.15.77:0/2985449732 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c005310 con 0x7fc2840039a0 2023-11-04T01:43:16.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.001+0000 7fc2a1a1a640 1 -- 172.21.15.77:0/2985449732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2840039a0 msgr2=0x7fc284003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.001+0000 7fc2a1a1a640 1 --2- 172.21.15.77:0/2985449732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2840039a0 0x7fc284003dc0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fc28c001e20 tx=0x7fc2840057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.001+0000 7fc29b7fe640 1 -- 172.21.15.77:0/2985449732 reap_dead start 2023-11-04T01:43:16.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.001+0000 7fc2a1a1a640 1 -- 172.21.15.77:0/2985449732 shutdown_connections 2023-11-04T01:43:16.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.001+0000 7fc2a1a1a640 1 -- 172.21.15.77:0/2985449732 >> 172.21.15.77:0/2985449732 conn(0x7fc29c06ea20 msgr2=0x7fc29c06ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:16.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.001+0000 7fc2a1a1a640 1 -- 172.21.15.77:0/2985449732 shutdown_connections 2023-11-04T01:43:16.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.001+0000 7fc2a1a1a640 1 -- 172.21.15.77:0/2985449732 wait complete. 2023-11-04T01:43:16.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.002+0000 7fc2a1a1a640 1 Processor -- start 2023-11-04T01:43:16.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.003+0000 7fc2a1a1a640 1 -- start start 2023-11-04T01:43:16.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.003+0000 7fc2a1a1a640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc2840039a0 0x7fc29c0b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.003+0000 7fc2a1a1a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc29c0c4710 0x7fc29c152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.003+0000 7fc2a1a1a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc29c0c6250 0x7fc29c0c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.003+0000 7fc2a1a1a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c0b08e0 con 0x7fc29c0c6250 2023-11-04T01:43:16.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.003+0000 7fc2a1a1a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c0c4e60 con 0x7fc29c0c4710 2023-11-04T01:43:16.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.003+0000 7fc2a1a1a640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c0c4b90 con 0x7fc2840039a0 2023-11-04T01:43:16.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.003+0000 7fc29b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc29c0c6250 0x7fc29c0c66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.003+0000 7fc29b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc29c0c6250 0x7fc29c0c66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56996/0 (socket says 172.21.15.77:56996) 2023-11-04T01:43:16.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.004+0000 7fc29b7fe640 1 -- 172.21.15.77:0/622987932 learned_addr learned my addr 172.21.15.77:0/622987932 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:16.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.004+0000 7fc29a7fc640 1 --2- 172.21.15.77:0/622987932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc29c0c4710 0x7fc29c152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.004+0000 7fc29affd640 1 --2- 172.21.15.77:0/622987932 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc2840039a0 0x7fc29c0b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.004+0000 7fc29b7fe640 1 -- 172.21.15.77:0/622987932 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc2840039a0 msgr2=0x7fc29c0b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.004+0000 7fc29b7fe640 1 --2- 172.21.15.77:0/622987932 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc2840039a0 0x7fc29c0b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.004+0000 7fc29b7fe640 1 -- 172.21.15.77:0/622987932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc29c0c4710 msgr2=0x7fc29c152420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.004+0000 7fc29b7fe640 1 --2- 172.21.15.77:0/622987932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc29c0c4710 0x7fc29c152420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.004+0000 7fc29b7fe640 1 -- 172.21.15.77:0/622987932 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29c0c7090 con 0x7fc29c0c6250 2023-11-04T01:43:16.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.004+0000 7fc29b7fe640 1 --2- 172.21.15.77:0/622987932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc29c0c6250 0x7fc29c0c66d0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fc29c06b2e0 tx=0x7fc294011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:16.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.004+0000 7fc283fff640 1 -- 172.21.15.77:0/622987932 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc294004440 con 0x7fc29c0c6250 2023-11-04T01:43:16.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.004+0000 7fc283fff640 1 -- 172.21.15.77:0/622987932 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc294003610 con 0x7fc29c0c6250 2023-11-04T01:43:16.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.004+0000 7fc2a1a1a640 1 -- 172.21.15.77:0/622987932 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc29c0c7370 con 0x7fc29c0c6250 2023-11-04T01:43:16.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.004+0000 7fc283fff640 1 -- 172.21.15.77:0/622987932 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2940039c0 con 0x7fc29c0c6250 2023-11-04T01:43:16.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.004+0000 7fc2a1a1a640 1 -- 172.21.15.77:0/622987932 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc29c0c6c10 con 0x7fc29c0c6250 2023-11-04T01:43:16.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.005+0000 7fc2a1a1a640 1 -- 172.21.15.77:0/622987932 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc29c0b0640 con 0x7fc29c0c6250 2023-11-04T01:43:16.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.006+0000 7fc283fff640 1 -- 172.21.15.77:0/622987932 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc294003b20 con 0x7fc29c0c6250 2023-11-04T01:43:16.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.006+0000 7fc283fff640 1 --2- 172.21.15.77:0/622987932 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc28806ae70 0x7fc28806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.006+0000 7fc283fff640 1 -- 172.21.15.77:0/622987932 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6768+0+0 (secure 0 0 0) 0x7fc294089d40 con 0x7fc29c0c6250 2023-11-04T01:43:16.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.006+0000 7fc29affd640 1 --2- 172.21.15.77:0/622987932 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc28806ae70 0x7fc28806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.007+0000 7fc29affd640 1 --2- 172.21.15.77:0/622987932 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc28806ae70 0x7fc28806d330 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc28c034000 tx=0x7fc28c009030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:16.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.010+0000 7fc283fff640 1 -- 172.21.15.77:0/622987932 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc29c0b0640 con 0x7fc29c0c6250 2023-11-04T01:43:16.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.179+0000 7fc2a1a1a640 1 -- 172.21.15.77:0/622987932 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc29c0b0a20 con 0x7fc29c0c6250 2023-11-04T01:43:16.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.870+0000 7fc283fff640 1 -- 172.21.15.77:0/622987932 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v87) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc29c0b0a20 con 0x7fc29c0c6250 2023-11-04T01:43:16.872 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data' removed 2023-11-04T01:43:16.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.877+0000 7fc2a1a1a640 1 -- 172.21.15.77:0/622987932 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc28806ae70 msgr2=0x7fc28806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.877+0000 7fc2a1a1a640 1 --2- 172.21.15.77:0/622987932 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc28806ae70 0x7fc28806d330 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc28c034000 tx=0x7fc28c009030 comp rx=0 tx=0).stop 2023-11-04T01:43:16.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.877+0000 7fc2a1a1a640 1 -- 172.21.15.77:0/622987932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc29c0c6250 msgr2=0x7fc29c0c66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.877+0000 7fc2a1a1a640 1 --2- 172.21.15.77:0/622987932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc29c0c6250 0x7fc29c0c66d0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fc29c06b2e0 tx=0x7fc294011920 comp rx=0 tx=0).stop 2023-11-04T01:43:16.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.878+0000 7fc2a1a1a640 1 -- 172.21.15.77:0/622987932 shutdown_connections 2023-11-04T01:43:16.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.878+0000 7fc2a1a1a640 1 --2- 172.21.15.77:0/622987932 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc28806ae70 0x7fc28806d330 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.878+0000 7fc2a1a1a640 1 --2- 172.21.15.77:0/622987932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc29c0c6250 0x7fc29c0c66d0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.878+0000 7fc2a1a1a640 1 --2- 172.21.15.77:0/622987932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc29c0c4710 0x7fc29c152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.878+0000 7fc2a1a1a640 1 --2- 172.21.15.77:0/622987932 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc2840039a0 0x7fc29c0b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.878+0000 7fc2a1a1a640 1 -- 172.21.15.77:0/622987932 >> 172.21.15.77:0/622987932 conn(0x7fc29c06ea20 msgr2=0x7fc29c15b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:16.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.878+0000 7fc2a1a1a640 1 -- 172.21.15.77:0/622987932 shutdown_connections 2023-11-04T01:43:16.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.878+0000 7fc2a1a1a640 1 -- 172.21.15.77:0/622987932 wait complete. 2023-11-04T01:43:16.895 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-04T01:43:17.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.998+0000 7fd0eb1a9640 1 Processor -- start 2023-11-04T01:43:17.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.998+0000 7fd0eb1a9640 1 -- start start 2023-11-04T01:43:17.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.999+0000 7fd0eb1a9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd0e40c4ff0 0x7fd0e40cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.999+0000 7fd0eb1a9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0e415aff0 con 0x7fd0e4159c00 2023-11-04T01:43:17.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.999+0000 7fd0eb1a9640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0e415a3e0 con 0x7fd0e40adac0 2023-11-04T01:43:17.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.999+0000 7fd0eb1a9640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0e415a6c0 con 0x7fd0e40c4ff0 2023-11-04T01:43:17.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.999+0000 7fd0e8f45640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd0e4159c00 0x7fd0e40c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:56212/0 (socket says 172.21.15.77:56212) 2023-11-04T01:43:17.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.999+0000 7fd0e8f45640 1 -- 172.21.15.77:0/2987468207 learned_addr learned my addr 172.21.15.77:0/2987468207 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:17.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:16.999+0000 7fd0e37fe640 1 -- 172.21.15.77:0/2987468207 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1341051676 0 0) 0x7fd0e415aff0 con 0x7fd0e4159c00 2023-11-04T01:43:17.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.000+0000 7fd0e37fe640 1 -- 172.21.15.77:0/2987468207 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0cc003520 con 0x7fd0e4159c00 2023-11-04T01:43:17.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.000+0000 7fd0e3fff640 1 --2- 172.21.15.77:0/2987468207 >> v2:172.21.15.122:3300/0 conn(0x7fd0e40c4ff0 0x7fd0e40cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.000+0000 7fd0e37fe640 1 -- 172.21.15.77:0/2987468207 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1192743486 0 0) 0x7fd0cc003520 con 0x7fd0e4159c00 2023-11-04T01:43:17.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.000+0000 7fd0e37fe640 1 -- 172.21.15.77:0/2987468207 >> v2:172.21.15.122:3300/0 conn(0x7fd0e40c4ff0 msgr2=0x7fd0e40cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:17.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.000+0000 7fd0e37fe640 1 --2- 172.21.15.77:0/2987468207 >> v2:172.21.15.122:3300/0 conn(0x7fd0e40c4ff0 0x7fd0e40cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.000+0000 7fd0e37fe640 1 -- 172.21.15.77:0/2987468207 >> v1:172.21.15.122:6789/0 conn(0x7fd0e40adac0 legacy=0x7fd0e40adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.000+0000 7fd0e37fe640 1 -- 172.21.15.77:0/2987468207 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e415a9a0 con 0x7fd0e4159c00 2023-11-04T01:43:17.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.000+0000 7fd0e37fe640 1 -- 172.21.15.77:0/2987468207 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7fd0d4001670 con 0x7fd0e4159c00 2023-11-04T01:43:17.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.000+0000 7fd0e37fe640 1 -- 172.21.15.77:0/2987468207 >> v1:172.21.15.77:6789/0 conn(0x7fd0e4159c00 legacy=0x7fd0e40c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.000+0000 7fd0e37fe640 1 --2- 172.21.15.77:0/2987468207 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0cc003970 0x7fd0cc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.000+0000 7fd0e37fe640 1 --2- 172.21.15.77:0/2987468207 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0cc0047c0 0x7fd0cc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.000+0000 7fd0e37fe640 1 --2- 172.21.15.77:0/2987468207 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0cc005180 0x7fd0cc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.000+0000 7fd0e37fe640 1 -- 172.21.15.77:0/2987468207 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e415a6c0 con 0x7fd0cc0047c0 2023-11-04T01:43:17.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.000+0000 7fd0e37fe640 1 -- 172.21.15.77:0/2987468207 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc00c020 con 0x7fd0cc005180 2023-11-04T01:43:17.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.000+0000 7fd0e37fe640 1 -- 172.21.15.77:0/2987468207 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc00e3f0 con 0x7fd0cc003970 2023-11-04T01:43:17.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.000+0000 7fd0e3fff640 1 --2- 172.21.15.77:0/2987468207 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0cc0047c0 0x7fd0cc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.000+0000 7fd0e8f45640 1 --2- 172.21.15.77:0/2987468207 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0cc003970 0x7fd0cc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.000+0000 7fd0e9746640 1 --2- 172.21.15.77:0/2987468207 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0cc005180 0x7fd0cc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.000+0000 7fd0e3fff640 1 -- 172.21.15.77:0/2987468207 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0cc003970 msgr2=0x7fd0cc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:17.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.000+0000 7fd0e3fff640 1 --2- 172.21.15.77:0/2987468207 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0cc003970 0x7fd0cc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.000+0000 7fd0e3fff640 1 -- 172.21.15.77:0/2987468207 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0cc005180 msgr2=0x7fd0cc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:17.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.000+0000 7fd0e3fff640 1 --2- 172.21.15.77:0/2987468207 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0cc005180 0x7fd0cc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.000+0000 7fd0e3fff640 1 -- 172.21.15.77:0/2987468207 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0cc003520 con 0x7fd0cc0047c0 2023-11-04T01:43:17.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.000+0000 7fd0e9746640 1 --2- 172.21.15.77:0/2987468207 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0cc005180 0x7fd0cc00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:17.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.000+0000 7fd0e8f45640 1 --2- 172.21.15.77:0/2987468207 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0cc003970 0x7fd0cc003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:17.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.000+0000 7fd0e9746640 1 -- 172.21.15.77:0/2987468207 reap_dead start 2023-11-04T01:43:17.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.001+0000 7fd0e3fff640 1 --2- 172.21.15.77:0/2987468207 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0cc0047c0 0x7fd0cc004c40 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fd0e40cfa50 tx=0x7fd0cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9555f7c228dcf52 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:17.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.001+0000 7fd0e37fe640 1 -- 172.21.15.77:0/2987468207 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d802c630 con 0x7fd0cc0047c0 2023-11-04T01:43:17.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.001+0000 7fd0e37fe640 1 -- 172.21.15.77:0/2987468207 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d802c790 con 0x7fd0cc0047c0 2023-11-04T01:43:17.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.001+0000 7fd0e37fe640 1 -- 172.21.15.77:0/2987468207 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d802cb40 con 0x7fd0cc0047c0 2023-11-04T01:43:17.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.002+0000 7fd0eb1a9640 1 -- 172.21.15.77:0/2987468207 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0cc0047c0 msgr2=0x7fd0cc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.002+0000 7fd0eb1a9640 1 --2- 172.21.15.77:0/2987468207 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0cc0047c0 0x7fd0cc004c40 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fd0e40cfa50 tx=0x7fd0cc0057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.002+0000 7fd0eb1a9640 1 -- 172.21.15.77:0/2987468207 shutdown_connections 2023-11-04T01:43:17.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.002+0000 7fd0eb1a9640 1 --2- 172.21.15.77:0/2987468207 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0cc0047c0 0x7fd0cc004c40 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.002+0000 7fd0eb1a9640 1 -- 172.21.15.77:0/2987468207 >> 172.21.15.77:0/2987468207 conn(0x7fd0e40ce950 msgr2=0x7fd0e40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:17.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.002+0000 7fd0eb1a9640 1 -- 172.21.15.77:0/2987468207 shutdown_connections 2023-11-04T01:43:17.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.002+0000 7fd0eb1a9640 1 -- 172.21.15.77:0/2987468207 wait complete. 2023-11-04T01:43:17.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.003+0000 7fd0eb1a9640 1 Processor -- start 2023-11-04T01:43:17.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.003+0000 7fd0eb1a9640 1 -- start start 2023-11-04T01:43:17.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.004+0000 7fd0eb1a9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0cc0047c0 0x7fd0e414d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.004+0000 7fd0eb1a9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0e40c5a20 0x7fd0e40cb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.004+0000 7fd0eb1a9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0e41f2440 0x7fd0e41ee650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.004+0000 7fd0eb1a9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e40c6200 con 0x7fd0e41f2440 2023-11-04T01:43:17.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.004+0000 7fd0eb1a9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e40c64e0 con 0x7fd0cc0047c0 2023-11-04T01:43:17.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.004+0000 7fd0eb1a9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e40c67c0 con 0x7fd0e40c5a20 2023-11-04T01:43:17.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.004+0000 7fd0e9746640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0e41f2440 0x7fd0e41ee650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.004+0000 7fd0e9746640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0e41f2440 0x7fd0e41ee650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57012/0 (socket says 172.21.15.77:57012) 2023-11-04T01:43:17.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.004+0000 7fd0e9746640 1 -- 172.21.15.77:0/1655078189 learned_addr learned my addr 172.21.15.77:0/1655078189 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:17.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.004+0000 7fd0e8f45640 1 --2- 172.21.15.77:0/1655078189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0cc0047c0 0x7fd0e414d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.004+0000 7fd0e3fff640 1 --2- 172.21.15.77:0/1655078189 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0e40c5a20 0x7fd0e40cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.004+0000 7fd0e9746640 1 -- 172.21.15.77:0/1655078189 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0e40c5a20 msgr2=0x7fd0e40cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.004+0000 7fd0e9746640 1 --2- 172.21.15.77:0/1655078189 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0e40c5a20 0x7fd0e40cb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.004+0000 7fd0e9746640 1 -- 172.21.15.77:0/1655078189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0cc0047c0 msgr2=0x7fd0e414d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.004+0000 7fd0e9746640 1 --2- 172.21.15.77:0/1655078189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0cc0047c0 0x7fd0e414d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.004+0000 7fd0e9746640 1 -- 172.21.15.77:0/1655078189 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e41f1c40 con 0x7fd0e41f2440 2023-11-04T01:43:17.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.004+0000 7fd0e8f45640 1 --2- 172.21.15.77:0/1655078189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0cc0047c0 0x7fd0e414d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:17.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.004+0000 7fd0e9746640 1 --2- 172.21.15.77:0/1655078189 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0e41f2440 0x7fd0e41ee650 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fd0e40cde20 tx=0x7fd0dc00e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:17.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.004+0000 7fd0e17fa640 1 -- 172.21.15.77:0/1655078189 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc003b80 con 0x7fd0e41f2440 2023-11-04T01:43:17.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.004+0000 7fd0e17fa640 1 -- 172.21.15.77:0/1655078189 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0dc003ce0 con 0x7fd0e41f2440 2023-11-04T01:43:17.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.004+0000 7fd0eb1a9640 1 -- 172.21.15.77:0/1655078189 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0e41f1f20 con 0x7fd0e41f2440 2023-11-04T01:43:17.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.004+0000 7fd0e17fa640 1 -- 172.21.15.77:0/1655078189 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc005310 con 0x7fd0e41f2440 2023-11-04T01:43:17.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.004+0000 7fd0eb1a9640 1 -- 172.21.15.77:0/1655078189 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0e40cbb80 con 0x7fd0e41f2440 2023-11-04T01:43:17.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.005+0000 7fd0eb1a9640 1 -- 172.21.15.77:0/1655078189 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0e4074290 con 0x7fd0e41f2440 2023-11-04T01:43:17.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.006+0000 7fd0e17fa640 1 -- 172.21.15.77:0/1655078189 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd0dc005470 con 0x7fd0e41f2440 2023-11-04T01:43:17.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.006+0000 7fd0e17fa640 1 --2- 172.21.15.77:0/1655078189 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd0d006aea0 0x7fd0d006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.006+0000 7fd0e17fa640 1 -- 172.21.15.77:0/1655078189 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6354+0+0 (secure 0 0 0) 0x7fd0dc089540 con 0x7fd0e41f2440 2023-11-04T01:43:17.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.006+0000 7fd0e8f45640 1 --2- 172.21.15.77:0/1655078189 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd0d006aea0 0x7fd0d006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.007+0000 7fd0e8f45640 1 --2- 172.21.15.77:0/1655078189 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd0d006aea0 0x7fd0d006d360 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd0e40687c0 tx=0x7fd0d4001580 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:17.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.010+0000 7fd0e17fa640 1 -- 172.21.15.77:0/1655078189 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd0dc054360 con 0x7fd0e41f2440 2023-11-04T01:43:17.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.175+0000 7fd0eb1a9640 1 -- 172.21.15.77:0/1655078189 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd0e40c8c60 con 0x7fd0e41f2440 2023-11-04T01:43:17.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.178+0000 7fd0e17fa640 1 -- 172.21.15.77:0/1655078189 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd0dc057980 con 0x7fd0e41f2440 2023-11-04T01:43:17.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.180+0000 7fd0eb1a9640 1 -- 172.21.15.77:0/1655078189 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd0d006aea0 msgr2=0x7fd0d006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.180+0000 7fd0eb1a9640 1 --2- 172.21.15.77:0/1655078189 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd0d006aea0 0x7fd0d006d360 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd0e40687c0 tx=0x7fd0d4001580 comp rx=0 tx=0).stop 2023-11-04T01:43:17.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.180+0000 7fd0eb1a9640 1 -- 172.21.15.77:0/1655078189 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0e41f2440 msgr2=0x7fd0e41ee650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.180+0000 7fd0eb1a9640 1 --2- 172.21.15.77:0/1655078189 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0e41f2440 0x7fd0e41ee650 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fd0e40cde20 tx=0x7fd0dc00e960 comp rx=0 tx=0).stop 2023-11-04T01:43:17.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.180+0000 7fd0eb1a9640 1 -- 172.21.15.77:0/1655078189 shutdown_connections 2023-11-04T01:43:17.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.180+0000 7fd0eb1a9640 1 --2- 172.21.15.77:0/1655078189 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd0d006aea0 0x7fd0d006d360 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.180+0000 7fd0eb1a9640 1 --2- 172.21.15.77:0/1655078189 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0e41f2440 0x7fd0e41ee650 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.180+0000 7fd0eb1a9640 1 --2- 172.21.15.77:0/1655078189 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0e40c5a20 0x7fd0e40cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.180+0000 7fd0eb1a9640 1 --2- 172.21.15.77:0/1655078189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0cc0047c0 0x7fd0e414d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.180+0000 7fd0eb1a9640 1 -- 172.21.15.77:0/1655078189 >> 172.21.15.77:0/1655078189 conn(0x7fd0e40ce950 msgr2=0x7fd0e40c4150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:17.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.180+0000 7fd0eb1a9640 1 -- 172.21.15.77:0/1655078189 shutdown_connections 2023-11-04T01:43:17.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.180+0000 7fd0eb1a9640 1 -- 172.21.15.77:0/1655078189 wait complete. 2023-11-04T01:43:17.193 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config' 2023-11-04T01:43:17.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.290+0000 7fe4e17f5640 1 Processor -- start 2023-11-04T01:43:17.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.290+0000 7fe4e17f5640 1 -- start start 2023-11-04T01:43:17.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.291+0000 7fe4e17f5640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe4dc0cde60 0x7fe4dc15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.291+0000 7fe4e17f5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4dc0ce240 0x7fe4dc0d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.291+0000 7fe4e17f5640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4dc15e000 con 0x7fe4dc15daa0 2023-11-04T01:43:17.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.291+0000 7fe4e17f5640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4dc15e5c0 con 0x7fe4dc0cde60 2023-11-04T01:43:17.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.291+0000 7fe4e17f5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc15e2e0 con 0x7fe4dc0ce240 2023-11-04T01:43:17.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.291+0000 7fe4db7fe640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4dc0ce240 0x7fe4dc0d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.291+0000 7fe4da7fc640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fe4dc15daa0 0x7fe4dc157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:33390/0 (socket says 172.21.15.77:33390) 2023-11-04T01:43:17.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.292+0000 7fe4daffd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe4dc0cde60 0x7fe4dc15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.292+0000 7fe4da7fc640 1 -- 172.21.15.77:0/3684932135 learned_addr learned my addr 172.21.15.77:0/3684932135 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:17.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.292+0000 7fe4d9ffb640 1 -- 172.21.15.77:0/3684932135 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2315997038 0 0) 0x7fe4dc15e000 con 0x7fe4dc15daa0 2023-11-04T01:43:17.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.292+0000 7fe4d9ffb640 1 -- 172.21.15.77:0/3684932135 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4c4003520 con 0x7fe4dc15daa0 2023-11-04T01:43:17.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.292+0000 7fe4db7fe640 1 -- 172.21.15.77:0/3684932135 >> v2:172.21.15.122:3300/0 conn(0x7fe4dc0cde60 msgr2=0x7fe4dc15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:17.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.292+0000 7fe4db7fe640 1 --2- 172.21.15.77:0/3684932135 >> v2:172.21.15.122:3300/0 conn(0x7fe4dc0cde60 0x7fe4dc15d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.292+0000 7fe4db7fe640 1 -- 172.21.15.77:0/3684932135 >> v1:172.21.15.122:6789/0 conn(0x7fe4dc15daa0 legacy=0x7fe4dc157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.292+0000 7fe4db7fe640 1 -- 172.21.15.77:0/3684932135 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4dc0d1120 con 0x7fe4dc0ce240 2023-11-04T01:43:17.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.293+0000 7fe4db7fe640 1 --2- 172.21.15.77:0/3684932135 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4dc0ce240 0x7fe4dc0d1920 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4009d90 tx=0x7fe4d402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1be6a9d219942c9f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:17.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.293+0000 7fe4d9ffb640 1 -- 172.21.15.77:0/3684932135 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d402cc50 con 0x7fe4dc0ce240 2023-11-04T01:43:17.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.293+0000 7fe4d9ffb640 1 -- 172.21.15.77:0/3684932135 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d402cdb0 con 0x7fe4dc0ce240 2023-11-04T01:43:17.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.293+0000 7fe4d9ffb640 1 -- 172.21.15.77:0/3684932135 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d4034660 con 0x7fe4dc0ce240 2023-11-04T01:43:17.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.294+0000 7fe4e17f5640 1 -- 172.21.15.77:0/3684932135 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4dc0ce240 msgr2=0x7fe4dc0d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.294+0000 7fe4e17f5640 1 --2- 172.21.15.77:0/3684932135 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4dc0ce240 0x7fe4dc0d1920 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4009d90 tx=0x7fe4d402bea0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.294+0000 7fe4e17f5640 1 -- 172.21.15.77:0/3684932135 shutdown_connections 2023-11-04T01:43:17.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.294+0000 7fe4e17f5640 1 --2- 172.21.15.77:0/3684932135 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4dc0ce240 0x7fe4dc0d1920 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.294+0000 7fe4e17f5640 1 --2- 172.21.15.77:0/3684932135 >> v2:172.21.15.122:3300/0 conn(0x7fe4dc0cde60 0x7fe4dc15d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.294+0000 7fe4e17f5640 1 -- 172.21.15.77:0/3684932135 >> 172.21.15.77:0/3684932135 conn(0x7fe4dc071f30 msgr2=0x7fe4dc0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:17.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.294+0000 7fe4e17f5640 1 -- 172.21.15.77:0/3684932135 shutdown_connections 2023-11-04T01:43:17.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.294+0000 7fe4e17f5640 1 -- 172.21.15.77:0/3684932135 wait complete. 2023-11-04T01:43:17.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.295+0000 7fe4e17f5640 1 Processor -- start 2023-11-04T01:43:17.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.295+0000 7fe4e17f5640 1 -- start start 2023-11-04T01:43:17.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.296+0000 7fe4e17f5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4dc0cde60 0x7fe4dc0c5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.296+0000 7fe4e17f5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4dc0ce240 0x7fe4dc145dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.296+0000 7fe4e17f5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4dc15daa0 0x7fe4dc0d1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.296+0000 7fe4e17f5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc146810 con 0x7fe4dc0cde60 2023-11-04T01:43:17.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.296+0000 7fe4e17f5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc146af0 con 0x7fe4dc15daa0 2023-11-04T01:43:17.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.296+0000 7fe4e17f5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc146dd0 con 0x7fe4dc0ce240 2023-11-04T01:43:17.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.296+0000 7fe4daffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4dc0cde60 0x7fe4dc0c5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.296+0000 7fe4daffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4dc0cde60 0x7fe4dc0c5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57028/0 (socket says 172.21.15.77:57028) 2023-11-04T01:43:17.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.296+0000 7fe4daffd640 1 -- 172.21.15.77:0/1764905434 learned_addr learned my addr 172.21.15.77:0/1764905434 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:17.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.296+0000 7fe4db7fe640 1 --2- 172.21.15.77:0/1764905434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4dc15daa0 0x7fe4dc0d1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.296+0000 7fe4da7fc640 1 --2- 172.21.15.77:0/1764905434 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4dc0ce240 0x7fe4dc145dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.296+0000 7fe4daffd640 1 -- 172.21.15.77:0/1764905434 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4dc0ce240 msgr2=0x7fe4dc145dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.296+0000 7fe4daffd640 1 --2- 172.21.15.77:0/1764905434 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4dc0ce240 0x7fe4dc145dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.296+0000 7fe4daffd640 1 -- 172.21.15.77:0/1764905434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4dc15daa0 msgr2=0x7fe4dc0d1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.296+0000 7fe4daffd640 1 --2- 172.21.15.77:0/1764905434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4dc15daa0 0x7fe4dc0d1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.296+0000 7fe4daffd640 1 -- 172.21.15.77:0/1764905434 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d4009a70 con 0x7fe4dc0cde60 2023-11-04T01:43:17.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.296+0000 7fe4da7fc640 1 --2- 172.21.15.77:0/1764905434 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4dc0ce240 0x7fe4dc145dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:17.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.296+0000 7fe4daffd640 1 --2- 172.21.15.77:0/1764905434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4dc0cde60 0x7fe4dc0c5f50 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00e9b0 tx=0x7fe4cc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:17.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.296+0000 7fe4c37fe640 1 -- 172.21.15.77:0/1764905434 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc009670 con 0x7fe4dc0cde60 2023-11-04T01:43:17.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.296+0000 7fe4c37fe640 1 -- 172.21.15.77:0/1764905434 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4cc00c9a0 con 0x7fe4dc0cde60 2023-11-04T01:43:17.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.296+0000 7fe4e17f5640 1 -- 172.21.15.77:0/1764905434 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4dc1470b0 con 0x7fe4dc0cde60 2023-11-04T01:43:17.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.296+0000 7fe4c37fe640 1 -- 172.21.15.77:0/1764905434 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc00cd50 con 0x7fe4dc0cde60 2023-11-04T01:43:17.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.297+0000 7fe4e17f5640 1 -- 172.21.15.77:0/1764905434 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4dc0c6490 con 0x7fe4dc0cde60 2023-11-04T01:43:17.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.297+0000 7fe4e17f5640 1 -- 172.21.15.77:0/1764905434 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4dc074290 con 0x7fe4dc0cde60 2023-11-04T01:43:17.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.298+0000 7fe4c37fe640 1 -- 172.21.15.77:0/1764905434 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe4cc013470 con 0x7fe4dc0cde60 2023-11-04T01:43:17.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.298+0000 7fe4c37fe640 1 --2- 172.21.15.77:0/1764905434 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe4c806ae70 0x7fe4c806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.298+0000 7fe4c37fe640 1 -- 172.21.15.77:0/1764905434 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6354+0+0 (secure 0 0 0) 0x7fe4cc089a40 con 0x7fe4dc0cde60 2023-11-04T01:43:17.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.299+0000 7fe4da7fc640 1 --2- 172.21.15.77:0/1764905434 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe4c806ae70 0x7fe4c806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.299+0000 7fe4da7fc640 1 --2- 172.21.15.77:0/1764905434 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe4c806ae70 0x7fe4c806d330 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc145a20 tx=0x7fe4d0009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:17.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.302+0000 7fe4c37fe640 1 -- 172.21.15.77:0/1764905434 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe4cc08be60 con 0x7fe4dc0cde60 2023-11-04T01:43:17.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.531+0000 7fe4e17f5640 1 -- 172.21.15.77:0/1764905434 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config"]} v 0) v1 -- 0x7fe4dc0ce800 con 0x7fe4dc0cde60 2023-11-04T01:43:17.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.878+0000 7fe4c37fe640 1 -- 172.21.15.77:0/1764905434 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config"]}]=0 v200) v1 ==== 148+0+0 (secure 0 0 0) 0x7fe4cc0170d0 con 0x7fe4dc0cde60 2023-11-04T01:43:17.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.880+0000 7fe4e17f5640 1 -- 172.21.15.77:0/1764905434 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe4c806ae70 msgr2=0x7fe4c806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.880+0000 7fe4e17f5640 1 --2- 172.21.15.77:0/1764905434 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe4c806ae70 0x7fe4c806d330 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc145a20 tx=0x7fe4d0009040 comp rx=0 tx=0).stop 2023-11-04T01:43:17.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.880+0000 7fe4e17f5640 1 -- 172.21.15.77:0/1764905434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4dc0cde60 msgr2=0x7fe4dc0c5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.880+0000 7fe4e17f5640 1 --2- 172.21.15.77:0/1764905434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4dc0cde60 0x7fe4dc0c5f50 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00e9b0 tx=0x7fe4cc00ee70 comp rx=0 tx=0).stop 2023-11-04T01:43:17.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.880+0000 7fe4e17f5640 1 -- 172.21.15.77:0/1764905434 shutdown_connections 2023-11-04T01:43:17.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.880+0000 7fe4e17f5640 1 --2- 172.21.15.77:0/1764905434 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe4c806ae70 0x7fe4c806d330 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.880+0000 7fe4e17f5640 1 --2- 172.21.15.77:0/1764905434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4dc15daa0 0x7fe4dc0d1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.880+0000 7fe4e17f5640 1 --2- 172.21.15.77:0/1764905434 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4dc0ce240 0x7fe4dc145dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.880+0000 7fe4e17f5640 1 --2- 172.21.15.77:0/1764905434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4dc0cde60 0x7fe4dc0c5f50 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.880+0000 7fe4e17f5640 1 -- 172.21.15.77:0/1764905434 >> 172.21.15.77:0/1764905434 conn(0x7fe4dc071f30 msgr2=0x7fe4dc1563a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:17.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.880+0000 7fe4e17f5640 1 -- 172.21.15.77:0/1764905434 shutdown_connections 2023-11-04T01:43:17.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.880+0000 7fe4e17f5640 1 -- 172.21.15.77:0/1764905434 wait complete. 2023-11-04T01:43:17.893 INFO:tasks.cephfs_test_runner:Check whether 'allow_new_snaps' setting works ... ok 2023-11-04T01:43:17.893 INFO:tasks.cephfs_test_runner:Starting test: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) check snaptable transcation 2023-11-04T01:43:17.893 INFO:tasks.cephfs_test_runner:test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:43:17.894 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:17.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.992+0000 7fd538b7c640 1 Processor -- start 2023-11-04T01:43:17.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.992+0000 7fd538b7c640 1 -- start start 2023-11-04T01:43:17.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.993+0000 7fd538b7c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd534157710 0x7fd534167b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.993+0000 7fd538b7c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd53415e000 con 0x7fd5340ce240 2023-11-04T01:43:17.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.993+0000 7fd538b7c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd53415e2e0 con 0x7fd5340cde60 2023-11-04T01:43:17.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.993+0000 7fd538b7c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd53415e5c0 con 0x7fd534157710 2023-11-04T01:43:17.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.993+0000 7fd532d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd534157710 0x7fd534167b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.993+0000 7fd532d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd534157710 0x7fd534167b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38850/0 (socket says 172.21.15.77:38850) 2023-11-04T01:43:17.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.993+0000 7fd531d9b640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd5340ce240 0x7fd534157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40276/0 (socket says 172.21.15.77:40276) 2023-11-04T01:43:17.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.993+0000 7fd532d9d640 1 -- 172.21.15.77:0/946337578 learned_addr learned my addr 172.21.15.77:0/946337578 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:17.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.993+0000 7fd532d9d640 1 -- 172.21.15.77:0/946337578 >> v1:172.21.15.122:6789/0 conn(0x7fd5340cde60 legacy=0x7fd53415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.993+0000 7fd532d9d640 1 -- 172.21.15.77:0/946337578 >> v1:172.21.15.77:6789/0 conn(0x7fd5340ce240 legacy=0x7fd534157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.993+0000 7fd532d9d640 1 -- 172.21.15.77:0/946337578 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5340d1120 con 0x7fd534157710 2023-11-04T01:43:17.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.993+0000 7fd53159a640 1 -- 172.21.15.77:0/946337578 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 767154177 0 0) 0x7fd53415e000 con 0x7fd5340ce240 2023-11-04T01:43:18.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.994+0000 7fd532d9d640 1 --2- 172.21.15.77:0/946337578 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd534157710 0x7fd534167b90 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fd52c009e50 tx=0x7fd52c02c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43c9fe33f579632a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:18.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.994+0000 7fd53159a640 1 -- 172.21.15.77:0/946337578 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c02cbb0 con 0x7fd534157710 2023-11-04T01:43:18.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.994+0000 7fd53159a640 1 -- 172.21.15.77:0/946337578 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52c02cd10 con 0x7fd534157710 2023-11-04T01:43:18.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.994+0000 7fd53159a640 1 -- 172.21.15.77:0/946337578 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c034610 con 0x7fd534157710 2023-11-04T01:43:18.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.995+0000 7fd538b7c640 1 -- 172.21.15.77:0/946337578 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd534157710 msgr2=0x7fd534167b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.995+0000 7fd538b7c640 1 --2- 172.21.15.77:0/946337578 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd534157710 0x7fd534167b90 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fd52c009e50 tx=0x7fd52c02c010 comp rx=0 tx=0).stop 2023-11-04T01:43:18.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.995+0000 7fd538b7c640 1 -- 172.21.15.77:0/946337578 shutdown_connections 2023-11-04T01:43:18.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.995+0000 7fd538b7c640 1 --2- 172.21.15.77:0/946337578 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd534157710 0x7fd534167b90 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.995+0000 7fd538b7c640 1 -- 172.21.15.77:0/946337578 >> 172.21.15.77:0/946337578 conn(0x7fd534071f30 msgr2=0x7fd5340cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:18.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.995+0000 7fd538b7c640 1 -- 172.21.15.77:0/946337578 shutdown_connections 2023-11-04T01:43:18.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.995+0000 7fd538b7c640 1 -- 172.21.15.77:0/946337578 wait complete. 2023-11-04T01:43:18.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.996+0000 7fd538b7c640 1 Processor -- start 2023-11-04T01:43:18.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.996+0000 7fd538b7c640 1 -- start start 2023-11-04T01:43:18.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.997+0000 7fd538b7c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5340cde60 0x7fd53414a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.997+0000 7fd538b7c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5340ce240 0x7fd53414ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.997+0000 7fd538b7c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd534157710 0x7fd5341f5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.997+0000 7fd538b7c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd534149050 con 0x7fd5340cde60 2023-11-04T01:43:18.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.997+0000 7fd538b7c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5341486d0 con 0x7fd5340ce240 2023-11-04T01:43:18.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.997+0000 7fd538b7c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd534148990 con 0x7fd534157710 2023-11-04T01:43:18.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.997+0000 7fd53259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5340cde60 0x7fd53414a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.997+0000 7fd53259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5340cde60 0x7fd53414a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38856/0 (socket says 172.21.15.77:38856) 2023-11-04T01:43:18.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.997+0000 7fd53259c640 1 -- 172.21.15.77:0/2139592635 learned_addr learned my addr 172.21.15.77:0/2139592635 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:18.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.997+0000 7fd53259c640 1 -- 172.21.15.77:0/2139592635 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd534157710 msgr2=0x7fd5341f5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.997+0000 7fd53259c640 1 --2- 172.21.15.77:0/2139592635 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd534157710 0x7fd5341f5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.997+0000 7fd53259c640 1 -- 172.21.15.77:0/2139592635 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5340ce240 msgr2=0x7fd53414ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.997+0000 7fd531d9b640 1 --2- 172.21.15.77:0/2139592635 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5340ce240 0x7fd53414ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.997+0000 7fd53259c640 1 --2- 172.21.15.77:0/2139592635 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5340ce240 0x7fd53414ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.997+0000 7fd53259c640 1 -- 172.21.15.77:0/2139592635 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52c009b30 con 0x7fd5340cde60 2023-11-04T01:43:18.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.998+0000 7fd53259c640 1 --2- 172.21.15.77:0/2139592635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5340cde60 0x7fd53414a5e0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fd52400c450 tx=0x7fd52400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:18.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.998+0000 7fd522ffd640 1 -- 172.21.15.77:0/2139592635 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5240052d0 con 0x7fd5340cde60 2023-11-04T01:43:18.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.998+0000 7fd522ffd640 1 -- 172.21.15.77:0/2139592635 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd524005430 con 0x7fd5340cde60 2023-11-04T01:43:18.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.998+0000 7fd538b7c640 1 -- 172.21.15.77:0/2139592635 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd534148c70 con 0x7fd5340cde60 2023-11-04T01:43:18.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.998+0000 7fd522ffd640 1 -- 172.21.15.77:0/2139592635 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd524012870 con 0x7fd5340cde60 2023-11-04T01:43:18.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.998+0000 7fd538b7c640 1 -- 172.21.15.77:0/2139592635 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd53414bc20 con 0x7fd5340cde60 2023-11-04T01:43:18.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.999+0000 7fd538b7c640 1 -- 172.21.15.77:0/2139592635 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5340ceb40 con 0x7fd5340cde60 2023-11-04T01:43:18.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:17.999+0000 7fd522ffd640 1 -- 172.21.15.77:0/2139592635 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd5240129d0 con 0x7fd5340cde60 2023-11-04T01:43:18.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.000+0000 7fd522ffd640 1 --2- 172.21.15.77:0/2139592635 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd51406ae70 0x7fd51406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.000+0000 7fd522ffd640 1 -- 172.21.15.77:0/2139592635 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6354+0+0 (secure 0 0 0) 0x7fd5240893e0 con 0x7fd5340cde60 2023-11-04T01:43:18.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.000+0000 7fd531d9b640 1 --2- 172.21.15.77:0/2139592635 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd51406ae70 0x7fd51406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.001+0000 7fd531d9b640 1 --2- 172.21.15.77:0/2139592635 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd51406ae70 0x7fd51406d330 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fd528007fd0 tx=0x7fd528009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:18.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.004+0000 7fd522ffd640 1 -- 172.21.15.77:0/2139592635 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd524054200 con 0x7fd5340cde60 2023-11-04T01:43:18.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.171+0000 7fd538b7c640 1 -- 172.21.15.77:0/2139592635 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd534074290 con 0x7fd5340cde60 2023-11-04T01:43:18.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.172+0000 7fd522ffd640 1 -- 172.21.15.77:0/2139592635 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+18466 (secure 0 0 0) 0x7fd524057820 con 0x7fd5340cde60 2023-11-04T01:43:18.174 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:43:18.174 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":87,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:43:16.870014+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:33.159064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:33.647358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.122:6837/1536301485":"2023-11-05T01:43:13.863919+0000","172.21.15.122:6835/1536301485":"2023-11-05T01:43:13.863919+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:18.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.173+0000 7fd538b7c640 1 -- 172.21.15.77:0/2139592635 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd51406ae70 msgr2=0x7fd51406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.173+0000 7fd538b7c640 1 --2- 172.21.15.77:0/2139592635 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd51406ae70 0x7fd51406d330 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fd528007fd0 tx=0x7fd528009040 comp rx=0 tx=0).stop 2023-11-04T01:43:18.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.173+0000 7fd538b7c640 1 -- 172.21.15.77:0/2139592635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5340cde60 msgr2=0x7fd53414a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.173+0000 7fd538b7c640 1 --2- 172.21.15.77:0/2139592635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5340cde60 0x7fd53414a5e0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fd52400c450 tx=0x7fd52400c910 comp rx=0 tx=0).stop 2023-11-04T01:43:18.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.174+0000 7fd538b7c640 1 -- 172.21.15.77:0/2139592635 shutdown_connections 2023-11-04T01:43:18.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.174+0000 7fd538b7c640 1 --2- 172.21.15.77:0/2139592635 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd51406ae70 0x7fd51406d330 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.174+0000 7fd538b7c640 1 --2- 172.21.15.77:0/2139592635 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd534157710 0x7fd5341f5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.174+0000 7fd538b7c640 1 --2- 172.21.15.77:0/2139592635 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5340ce240 0x7fd53414ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.174+0000 7fd538b7c640 1 --2- 172.21.15.77:0/2139592635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5340cde60 0x7fd53414a5e0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.174+0000 7fd538b7c640 1 -- 172.21.15.77:0/2139592635 >> 172.21.15.77:0/2139592635 conn(0x7fd534071f30 msgr2=0x7fd5340d09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:18.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.174+0000 7fd538b7c640 1 -- 172.21.15.77:0/2139592635 shutdown_connections 2023-11-04T01:43:18.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.174+0000 7fd538b7c640 1 -- 172.21.15.77:0/2139592635 wait complete. 2023-11-04T01:43:18.186 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:33.142176+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:42:33.159064+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:42:33.647358+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:43:18.187 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:43:18.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.288+0000 7f779a2e5640 1 Processor -- start 2023-11-04T01:43:18.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.288+0000 7f779a2e5640 1 -- start start 2023-11-04T01:43:18.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.289+0000 7f779a2e5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7794153e60 0x7f779415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.289+0000 7f779a2e5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f77940b4880 0x7f77940b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.289+0000 7f779a2e5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77940cde60 con 0x7f77940cd6d0 2023-11-04T01:43:18.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.289+0000 7f779a2e5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7794160f90 con 0x7f7794153e60 2023-11-04T01:43:18.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.289+0000 7f779a2e5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77940b5200 con 0x7f77940b4880 2023-11-04T01:43:18.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.289+0000 7f7793fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7794153e60 0x7f779415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.289+0000 7f77937fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f77940cd6d0 0x7f7794161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40288/0 (socket says 172.21.15.77:40288) 2023-11-04T01:43:18.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.289+0000 7f77937fe640 1 -- 172.21.15.77:0/448362513 learned_addr learned my addr 172.21.15.77:0/448362513 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:18.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.290+0000 7f7798882640 1 --2- 172.21.15.77:0/448362513 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f77940b4880 0x7f77940b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.290+0000 7f7793fff640 1 -- 172.21.15.77:0/448362513 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f77940b4880 msgr2=0x7f77940b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:18.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.290+0000 7f7793fff640 1 --2- 172.21.15.77:0/448362513 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f77940b4880 0x7f77940b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.290+0000 7f7793fff640 1 -- 172.21.15.77:0/448362513 >> v1:172.21.15.77:6789/0 conn(0x7f77940cd6d0 legacy=0x7f7794161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.290+0000 7f7793fff640 1 -- 172.21.15.77:0/448362513 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779415e400 con 0x7f7794153e60 2023-11-04T01:43:18.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.290+0000 7f7792ffd640 1 -- 172.21.15.77:0/448362513 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1128117391 0 0) 0x7f77940cde60 con 0x7f77940cd6d0 2023-11-04T01:43:18.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.290+0000 7f7793fff640 1 --2- 172.21.15.77:0/448362513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7794153e60 0x7f779415dec0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f77840097a0 tx=0x7f778402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ebe426adefdadc5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:18.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.291+0000 7f7792ffd640 1 -- 172.21.15.77:0/448362513 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7784031830 con 0x7f7794153e60 2023-11-04T01:43:18.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.291+0000 7f7792ffd640 1 -- 172.21.15.77:0/448362513 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7784031990 con 0x7f7794153e60 2023-11-04T01:43:18.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.291+0000 7f7792ffd640 1 -- 172.21.15.77:0/448362513 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7784031d20 con 0x7f7794153e60 2023-11-04T01:43:18.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.291+0000 7f779a2e5640 1 -- 172.21.15.77:0/448362513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7794153e60 msgr2=0x7f779415dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.291+0000 7f779a2e5640 1 --2- 172.21.15.77:0/448362513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7794153e60 0x7f779415dec0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f77840097a0 tx=0x7f778402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.291+0000 7f779a2e5640 1 -- 172.21.15.77:0/448362513 shutdown_connections 2023-11-04T01:43:18.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.291+0000 7f779a2e5640 1 --2- 172.21.15.77:0/448362513 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f77940b4880 0x7f77940b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.291+0000 7f779a2e5640 1 --2- 172.21.15.77:0/448362513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7794153e60 0x7f779415dec0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.291+0000 7f779a2e5640 1 -- 172.21.15.77:0/448362513 >> 172.21.15.77:0/448362513 conn(0x7f77940cf880 msgr2=0x7f77940cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:18.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.291+0000 7f779a2e5640 1 -- 172.21.15.77:0/448362513 shutdown_connections 2023-11-04T01:43:18.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.291+0000 7f779a2e5640 1 -- 172.21.15.77:0/448362513 wait complete. 2023-11-04T01:43:18.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.292+0000 7f779a2e5640 1 Processor -- start 2023-11-04T01:43:18.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.292+0000 7f779a2e5640 1 -- start start 2023-11-04T01:43:18.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.293+0000 7f779a2e5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77940b4880 0x7f77940cb400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.293+0000 7f779a2e5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77940cd6d0 0x7f77940ca970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.293+0000 7f779a2e5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7794153e60 0x7f7794152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.293+0000 7f779a2e5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77940caeb0 con 0x7f77940cd6d0 2023-11-04T01:43:18.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.293+0000 7f779a2e5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77940cbac0 con 0x7f77940b4880 2023-11-04T01:43:18.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.293+0000 7f779a2e5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77940cbda0 con 0x7f7794153e60 2023-11-04T01:43:18.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.293+0000 7f77937fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77940cd6d0 0x7f77940ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.293+0000 7f77937fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77940cd6d0 0x7f77940ca970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38866/0 (socket says 172.21.15.77:38866) 2023-11-04T01:43:18.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.293+0000 7f77937fe640 1 -- 172.21.15.77:0/143408644 learned_addr learned my addr 172.21.15.77:0/143408644 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:18.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.293+0000 7f7793fff640 1 --2- 172.21.15.77:0/143408644 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77940b4880 0x7f77940cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.293+0000 7f7798882640 1 --2- 172.21.15.77:0/143408644 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7794153e60 0x7f7794152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.293+0000 7f77937fe640 1 -- 172.21.15.77:0/143408644 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7794153e60 msgr2=0x7f7794152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.294+0000 7f77937fe640 1 --2- 172.21.15.77:0/143408644 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7794153e60 0x7f7794152f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.294+0000 7f77937fe640 1 -- 172.21.15.77:0/143408644 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77940b4880 msgr2=0x7f77940cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.294+0000 7f77937fe640 1 --2- 172.21.15.77:0/143408644 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77940b4880 0x7f77940cb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.294+0000 7f77937fe640 1 -- 172.21.15.77:0/143408644 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7784009400 con 0x7f77940cd6d0 2023-11-04T01:43:18.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.294+0000 7f7793fff640 1 --2- 172.21.15.77:0/143408644 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77940b4880 0x7f77940cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:18.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.294+0000 7f7798882640 1 --2- 172.21.15.77:0/143408644 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7794153e60 0x7f7794152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:18.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.294+0000 7f77937fe640 1 --2- 172.21.15.77:0/143408644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77940cd6d0 0x7f77940ca970 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f778800c4b0 tx=0x7f778800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:18.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.294+0000 7f7790ff9640 1 -- 172.21.15.77:0/143408644 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77880074e0 con 0x7f77940cd6d0 2023-11-04T01:43:18.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.294+0000 7f7790ff9640 1 -- 172.21.15.77:0/143408644 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7788007660 con 0x7f77940cd6d0 2023-11-04T01:43:18.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.294+0000 7f779a2e5640 1 -- 172.21.15.77:0/143408644 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77940cc080 con 0x7f77940cd6d0 2023-11-04T01:43:18.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.294+0000 7f7790ff9640 1 -- 172.21.15.77:0/143408644 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7788004a20 con 0x7f77940cd6d0 2023-11-04T01:43:18.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.294+0000 7f779a2e5640 1 -- 172.21.15.77:0/143408644 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77940cc640 con 0x7f77940cd6d0 2023-11-04T01:43:18.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.295+0000 7f779a2e5640 1 -- 172.21.15.77:0/143408644 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7794074290 con 0x7f77940cd6d0 2023-11-04T01:43:18.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.295+0000 7f7790ff9640 1 -- 172.21.15.77:0/143408644 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7788004b80 con 0x7f77940cd6d0 2023-11-04T01:43:18.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.296+0000 7f7790ff9640 1 --2- 172.21.15.77:0/143408644 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f778006ae70 0x7f778006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.296+0000 7f7790ff9640 1 -- 172.21.15.77:0/143408644 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6354+0+0 (secure 0 0 0) 0x7f77880889e0 con 0x7f77940cd6d0 2023-11-04T01:43:18.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.296+0000 7f7793fff640 1 --2- 172.21.15.77:0/143408644 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f778006ae70 0x7f778006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.297+0000 7f7793fff640 1 --2- 172.21.15.77:0/143408644 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f778006ae70 0x7f778006d330 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7784036000 tx=0x7f778403c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:18.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.300+0000 7f7790ff9640 1 -- 172.21.15.77:0/143408644 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7788053950 con 0x7f77940cd6d0 2023-11-04T01:43:18.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.464+0000 7f779a2e5640 1 -- 172.21.15.77:0/143408644 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f77940d1d00 con 0x7f77940cd6d0 2023-11-04T01:43:18.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.464+0000 7f7790ff9640 1 -- 172.21.15.77:0/143408644 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7788018020 con 0x7f77940cd6d0 2023-11-04T01:43:18.466 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:43:18.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.466+0000 7f779a2e5640 1 -- 172.21.15.77:0/143408644 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f778006ae70 msgr2=0x7f778006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.466+0000 7f779a2e5640 1 --2- 172.21.15.77:0/143408644 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f778006ae70 0x7f778006d330 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7784036000 tx=0x7f778403c040 comp rx=0 tx=0).stop 2023-11-04T01:43:18.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.466+0000 7f779a2e5640 1 -- 172.21.15.77:0/143408644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77940cd6d0 msgr2=0x7f77940ca970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.466+0000 7f779a2e5640 1 --2- 172.21.15.77:0/143408644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77940cd6d0 0x7f77940ca970 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f778800c4b0 tx=0x7f778800c970 comp rx=0 tx=0).stop 2023-11-04T01:43:18.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.466+0000 7f779a2e5640 1 -- 172.21.15.77:0/143408644 shutdown_connections 2023-11-04T01:43:18.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.466+0000 7f779a2e5640 1 --2- 172.21.15.77:0/143408644 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f778006ae70 0x7f778006d330 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.466+0000 7f779a2e5640 1 --2- 172.21.15.77:0/143408644 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7794153e60 0x7f7794152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.466+0000 7f779a2e5640 1 --2- 172.21.15.77:0/143408644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77940cd6d0 0x7f77940ca970 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.466+0000 7f779a2e5640 1 --2- 172.21.15.77:0/143408644 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77940b4880 0x7f77940cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.466+0000 7f779a2e5640 1 -- 172.21.15.77:0/143408644 >> 172.21.15.77:0/143408644 conn(0x7f77940cf880 msgr2=0x7f77940b8220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:18.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.466+0000 7f779a2e5640 1 -- 172.21.15.77:0/143408644 shutdown_connections 2023-11-04T01:43:18.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.466+0000 7f779a2e5640 1 -- 172.21.15.77:0/143408644 wait complete. 2023-11-04T01:43:18.478 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:43:18.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.579+0000 7f3abb8a9640 1 Processor -- start 2023-11-04T01:43:18.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.579+0000 7f3abb8a9640 1 -- start start 2023-11-04T01:43:18.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.580+0000 7f3abb8a9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3ab40cd6d0 0x7f3ab4161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.580+0000 7f3abb8a9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3ab40b4880 0x7f3ab40b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.580+0000 7f3abb8a9640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab40cde60 con 0x7f3ab4153e60 2023-11-04T01:43:18.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.580+0000 7f3abb8a9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ab4160f90 con 0x7f3ab40b4880 2023-11-04T01:43:18.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.580+0000 7f3abb8a9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab40b51e0 con 0x7f3ab40cd6d0 2023-11-04T01:43:18.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.580+0000 7f3ab9e46640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3ab40b4880 0x7f3ab40b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.580+0000 7f3ab9e46640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3ab40b4880 0x7f3ab40b4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38878/0 (socket says 172.21.15.77:38878) 2023-11-04T01:43:18.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.580+0000 7f3ab9e46640 1 -- 172.21.15.77:0/2423044905 learned_addr learned my addr 172.21.15.77:0/2423044905 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:18.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.581+0000 7f3ab8e44640 1 --2- 172.21.15.77:0/2423044905 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3ab40cd6d0 0x7f3ab4161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.581+0000 7f3ab9e46640 1 -- 172.21.15.77:0/2423044905 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3ab40cd6d0 msgr2=0x7f3ab4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:18.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.581+0000 7f3ab9e46640 1 --2- 172.21.15.77:0/2423044905 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3ab40cd6d0 0x7f3ab4161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.581+0000 7f3ab9e46640 1 -- 172.21.15.77:0/2423044905 >> v1:172.21.15.122:6789/0 conn(0x7f3ab4153e60 legacy=0x7f3ab415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.581+0000 7f3ab9e46640 1 -- 172.21.15.77:0/2423044905 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab4161960 con 0x7f3ab40b4880 2023-11-04T01:43:18.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.581+0000 7f3ab9e46640 1 --2- 172.21.15.77:0/2423044905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ab40b4880 0x7f3ab40b4ca0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f3aac009870 tx=0x7f3aac02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95adc6b9b0ef04d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:18.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.582+0000 7f3aabfff640 1 -- 172.21.15.77:0/2423044905 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac030840 con 0x7f3ab40b4880 2023-11-04T01:43:18.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.582+0000 7f3aabfff640 1 -- 172.21.15.77:0/2423044905 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aac0309a0 con 0x7f3ab40b4880 2023-11-04T01:43:18.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.582+0000 7f3aabfff640 1 -- 172.21.15.77:0/2423044905 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac030d30 con 0x7f3ab40b4880 2023-11-04T01:43:18.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.582+0000 7f3abb8a9640 1 -- 172.21.15.77:0/2423044905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ab40b4880 msgr2=0x7f3ab40b4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.582+0000 7f3abb8a9640 1 --2- 172.21.15.77:0/2423044905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ab40b4880 0x7f3ab40b4ca0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f3aac009870 tx=0x7f3aac02b980 comp rx=0 tx=0).stop 2023-11-04T01:43:18.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.582+0000 7f3abb8a9640 1 -- 172.21.15.77:0/2423044905 shutdown_connections 2023-11-04T01:43:18.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.582+0000 7f3abb8a9640 1 --2- 172.21.15.77:0/2423044905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ab40b4880 0x7f3ab40b4ca0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.582+0000 7f3abb8a9640 1 --2- 172.21.15.77:0/2423044905 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3ab40cd6d0 0x7f3ab4161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.582+0000 7f3abb8a9640 1 -- 172.21.15.77:0/2423044905 >> 172.21.15.77:0/2423044905 conn(0x7f3ab40cf880 msgr2=0x7f3ab40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:18.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.582+0000 7f3abb8a9640 1 -- 172.21.15.77:0/2423044905 shutdown_connections 2023-11-04T01:43:18.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.582+0000 7f3abb8a9640 1 -- 172.21.15.77:0/2423044905 wait complete. 2023-11-04T01:43:18.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.583+0000 7f3abb8a9640 1 Processor -- start 2023-11-04T01:43:18.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.583+0000 7f3abb8a9640 1 -- start start 2023-11-04T01:43:18.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.584+0000 7f3abb8a9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3ab40b4880 0x7f3ab414fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.584+0000 7f3abb8a9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ab40cd6d0 0x7f3ab41f2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.584+0000 7f3abb8a9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ab4153e60 0x7f3ab40cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.584+0000 7f3abb8a9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab40c7cd0 con 0x7f3ab40cd6d0 2023-11-04T01:43:18.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.584+0000 7f3abb8a9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab40ca410 con 0x7f3ab4153e60 2023-11-04T01:43:18.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.584+0000 7f3abb8a9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab40ca680 con 0x7f3ab40b4880 2023-11-04T01:43:18.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.584+0000 7f3ab8e44640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ab40cd6d0 0x7f3ab41f2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.584+0000 7f3ab8e44640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ab40cd6d0 0x7f3ab41f2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38890/0 (socket says 172.21.15.77:38890) 2023-11-04T01:43:18.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.584+0000 7f3ab8e44640 1 -- 172.21.15.77:0/1340777197 learned_addr learned my addr 172.21.15.77:0/1340777197 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:18.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.584+0000 7f3ab9e46640 1 --2- 172.21.15.77:0/1340777197 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ab4153e60 0x7f3ab40cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.584+0000 7f3ab9645640 1 --2- 172.21.15.77:0/1340777197 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3ab40b4880 0x7f3ab414fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.584+0000 7f3ab8e44640 1 -- 172.21.15.77:0/1340777197 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3ab40b4880 msgr2=0x7f3ab414fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.584+0000 7f3ab8e44640 1 --2- 172.21.15.77:0/1340777197 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3ab40b4880 0x7f3ab414fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.584+0000 7f3ab8e44640 1 -- 172.21.15.77:0/1340777197 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ab4153e60 msgr2=0x7f3ab40cca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.584+0000 7f3ab8e44640 1 --2- 172.21.15.77:0/1340777197 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ab4153e60 0x7f3ab40cca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.585+0000 7f3ab8e44640 1 -- 172.21.15.77:0/1340777197 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aac0094d0 con 0x7f3ab40cd6d0 2023-11-04T01:43:18.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.585+0000 7f3ab8e44640 1 --2- 172.21.15.77:0/1340777197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ab40cd6d0 0x7f3ab41f2af0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f3aa400d800 tx=0x7f3aa400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:18.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.585+0000 7f3aa9ffb640 1 -- 172.21.15.77:0/1340777197 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa400b6c0 con 0x7f3ab40cd6d0 2023-11-04T01:43:18.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.585+0000 7f3aa9ffb640 1 -- 172.21.15.77:0/1340777197 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa400b820 con 0x7f3ab40cd6d0 2023-11-04T01:43:18.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.585+0000 7f3aa9ffb640 1 -- 172.21.15.77:0/1340777197 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa400bbb0 con 0x7f3ab40cd6d0 2023-11-04T01:43:18.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.585+0000 7f3abb8a9640 1 -- 172.21.15.77:0/1340777197 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ab40ca960 con 0x7f3ab40cd6d0 2023-11-04T01:43:18.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.585+0000 7f3abb8a9640 1 -- 172.21.15.77:0/1340777197 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ab40caf20 con 0x7f3ab40cd6d0 2023-11-04T01:43:18.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.586+0000 7f3abb8a9640 1 -- 172.21.15.77:0/1340777197 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab40cb0e0 con 0x7f3ab40cd6d0 2023-11-04T01:43:18.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.586+0000 7f3aa9ffb640 1 -- 172.21.15.77:0/1340777197 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3aa400bd10 con 0x7f3ab40cd6d0 2023-11-04T01:43:18.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.586+0000 7f3aa9ffb640 1 --2- 172.21.15.77:0/1340777197 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3a9806aea0 0x7f3a9806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.587+0000 7f3aa9ffb640 1 -- 172.21.15.77:0/1340777197 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6354+0+0 (secure 0 0 0) 0x7f3aa4089d90 con 0x7f3ab40cd6d0 2023-11-04T01:43:18.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.587+0000 7f3ab9645640 1 --2- 172.21.15.77:0/1340777197 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3a9806aea0 0x7f3a9806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.587+0000 7f3ab9645640 1 --2- 172.21.15.77:0/1340777197 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3a9806aea0 0x7f3a9806d360 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f3ab00012e0 tx=0x7f3ab0009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:18.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.591+0000 7f3aa9ffb640 1 -- 172.21.15.77:0/1340777197 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3aa4054bb0 con 0x7f3ab40cd6d0 2023-11-04T01:43:18.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.756+0000 7f3abb8a9640 1 -- 172.21.15.77:0/1340777197 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f3ab4074290 con 0x7f3ab40cd6d0 2023-11-04T01:43:18.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.757+0000 7f3aa9ffb640 1 -- 172.21.15.77:0/1340777197 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v87) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3aa40581d0 con 0x7f3ab40cd6d0 2023-11-04T01:43:18.759 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:43:18.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.759+0000 7f3abb8a9640 1 -- 172.21.15.77:0/1340777197 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3a9806aea0 msgr2=0x7f3a9806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.759+0000 7f3abb8a9640 1 --2- 172.21.15.77:0/1340777197 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3a9806aea0 0x7f3a9806d360 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f3ab00012e0 tx=0x7f3ab0009040 comp rx=0 tx=0).stop 2023-11-04T01:43:18.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.759+0000 7f3abb8a9640 1 -- 172.21.15.77:0/1340777197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ab40cd6d0 msgr2=0x7f3ab41f2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.759+0000 7f3abb8a9640 1 --2- 172.21.15.77:0/1340777197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ab40cd6d0 0x7f3ab41f2af0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f3aa400d800 tx=0x7f3aa400dcc0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.759+0000 7f3abb8a9640 1 -- 172.21.15.77:0/1340777197 shutdown_connections 2023-11-04T01:43:18.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.759+0000 7f3abb8a9640 1 --2- 172.21.15.77:0/1340777197 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3a9806aea0 0x7f3a9806d360 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.759+0000 7f3abb8a9640 1 --2- 172.21.15.77:0/1340777197 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ab4153e60 0x7f3ab40cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.759+0000 7f3abb8a9640 1 --2- 172.21.15.77:0/1340777197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ab40cd6d0 0x7f3ab41f2af0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.759+0000 7f3abb8a9640 1 --2- 172.21.15.77:0/1340777197 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3ab40b4880 0x7f3ab414fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.759+0000 7f3abb8a9640 1 -- 172.21.15.77:0/1340777197 >> 172.21.15.77:0/1340777197 conn(0x7f3ab40cf880 msgr2=0x7f3ab415fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:18.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.759+0000 7f3abb8a9640 1 -- 172.21.15.77:0/1340777197 shutdown_connections 2023-11-04T01:43:18.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.759+0000 7f3abb8a9640 1 -- 172.21.15.77:0/1340777197 wait complete. 2023-11-04T01:43:18.771 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:43:18.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.872+0000 7fa1b2664640 1 Processor -- start 2023-11-04T01:43:18.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.872+0000 7fa1b2664640 1 -- start start 2023-11-04T01:43:18.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.873+0000 7fa1b2664640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa1ac153e60 0x7fa1ac15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.873+0000 7fa1b2664640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa1ac0cd6d0 0x7fa1ac161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.873+0000 7fa1b2664640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1ac0b4880 0x7fa1ac0b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.873+0000 7fa1b2664640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1ac0cde60 con 0x7fa1ac153e60 2023-11-04T01:43:18.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.873+0000 7fa1b2664640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1ac0b5220 con 0x7fa1ac0cd6d0 2023-11-04T01:43:18.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.873+0000 7fa1b2664640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac160f90 con 0x7fa1ac0b4880 2023-11-04T01:43:18.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.873+0000 7fa1abfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa1ac153e60 0x7fa1ac15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.873+0000 7fa1abfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa1ac153e60 0x7fa1ac15dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38906/0 (socket says 172.21.15.77:38906) 2023-11-04T01:43:18.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.873+0000 7fa1abfff640 1 -- 172.21.15.77:0/3424396788 learned_addr learned my addr 172.21.15.77:0/3424396788 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:18.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.873+0000 7fa1ab7fe640 1 --2- 172.21.15.77:0/3424396788 >> v2:172.21.15.122:3300/0 conn(0x7fa1ac0cd6d0 0x7fa1ac161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.874+0000 7fa1abfff640 1 -- 172.21.15.77:0/3424396788 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1ac0b4880 msgr2=0x7fa1ac0b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:18.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.874+0000 7fa1b0c01640 1 --2- 172.21.15.77:0/3424396788 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1ac0b4880 0x7fa1ac0b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.874+0000 7fa1abfff640 1 --2- 172.21.15.77:0/3424396788 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1ac0b4880 0x7fa1ac0b4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.874+0000 7fa1abfff640 1 -- 172.21.15.77:0/3424396788 >> v2:172.21.15.122:3300/0 conn(0x7fa1ac0cd6d0 msgr2=0x7fa1ac161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:18.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.874+0000 7fa1abfff640 1 --2- 172.21.15.77:0/3424396788 >> v2:172.21.15.122:3300/0 conn(0x7fa1ac0cd6d0 0x7fa1ac161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.874+0000 7fa1abfff640 1 -- 172.21.15.77:0/3424396788 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ac15e400 con 0x7fa1ac153e60 2023-11-04T01:43:18.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.874+0000 7fa1ab7fe640 1 --2- 172.21.15.77:0/3424396788 >> v2:172.21.15.122:3300/0 conn(0x7fa1ac0cd6d0 0x7fa1ac161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:18.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.874+0000 7fa1abfff640 1 --2- 172.21.15.77:0/3424396788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1ac153e60 0x7fa1ac15dec0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac0c9e80 tx=0x7fa19c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a583641214444a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:18.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.874+0000 7fa1aaffd640 1 -- 172.21.15.77:0/3424396788 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c031640 con 0x7fa1ac153e60 2023-11-04T01:43:18.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.874+0000 7fa1aaffd640 1 -- 172.21.15.77:0/3424396788 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19c0317a0 con 0x7fa1ac153e60 2023-11-04T01:43:18.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.874+0000 7fa1aaffd640 1 -- 172.21.15.77:0/3424396788 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c031b30 con 0x7fa1ac153e60 2023-11-04T01:43:18.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.875+0000 7fa1b2664640 1 -- 172.21.15.77:0/3424396788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1ac153e60 msgr2=0x7fa1ac15dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.875+0000 7fa1b2664640 1 --2- 172.21.15.77:0/3424396788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1ac153e60 0x7fa1ac15dec0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac0c9e80 tx=0x7fa19c02b8f0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.875+0000 7fa1b2664640 1 -- 172.21.15.77:0/3424396788 shutdown_connections 2023-11-04T01:43:18.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.875+0000 7fa1b2664640 1 --2- 172.21.15.77:0/3424396788 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1ac0b4880 0x7fa1ac0b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.875+0000 7fa1b2664640 1 --2- 172.21.15.77:0/3424396788 >> v2:172.21.15.122:3300/0 conn(0x7fa1ac0cd6d0 0x7fa1ac161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.875+0000 7fa1b2664640 1 --2- 172.21.15.77:0/3424396788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1ac153e60 0x7fa1ac15dec0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.875+0000 7fa1b2664640 1 -- 172.21.15.77:0/3424396788 >> 172.21.15.77:0/3424396788 conn(0x7fa1ac0cf880 msgr2=0x7fa1ac0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:18.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.875+0000 7fa1b2664640 1 -- 172.21.15.77:0/3424396788 shutdown_connections 2023-11-04T01:43:18.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.875+0000 7fa1b2664640 1 -- 172.21.15.77:0/3424396788 wait complete. 2023-11-04T01:43:18.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.876+0000 7fa1b2664640 1 Processor -- start 2023-11-04T01:43:18.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.876+0000 7fa1b2664640 1 -- start start 2023-11-04T01:43:18.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.877+0000 7fa1b2664640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1ac0b4880 0x7fa1ac150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.877+0000 7fa1b2664640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1ac0cd6d0 0x7fa1ac15eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.877+0000 7fa1b2664640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1ac153e60 0x7fa1ac15f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.877+0000 7fa1b2664640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac155f00 con 0x7fa1ac0cd6d0 2023-11-04T01:43:18.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.877+0000 7fa1b2664640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac155bf0 con 0x7fa1ac153e60 2023-11-04T01:43:18.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.877+0000 7fa1b2664640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac150c70 con 0x7fa1ac0b4880 2023-11-04T01:43:18.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.877+0000 7fa1ab7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1ac0cd6d0 0x7fa1ac15eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.877+0000 7fa1ab7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1ac0cd6d0 0x7fa1ac15eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38920/0 (socket says 172.21.15.77:38920) 2023-11-04T01:43:18.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.877+0000 7fa1ab7fe640 1 -- 172.21.15.77:0/1641372586 learned_addr learned my addr 172.21.15.77:0/1641372586 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:18.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.877+0000 7fa1b0c01640 1 --2- 172.21.15.77:0/1641372586 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1ac153e60 0x7fa1ac15f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.877+0000 7fa1abfff640 1 --2- 172.21.15.77:0/1641372586 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1ac0b4880 0x7fa1ac150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.878+0000 7fa1ab7fe640 1 -- 172.21.15.77:0/1641372586 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1ac0b4880 msgr2=0x7fa1ac150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.878+0000 7fa1ab7fe640 1 --2- 172.21.15.77:0/1641372586 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1ac0b4880 0x7fa1ac150730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.878+0000 7fa1ab7fe640 1 -- 172.21.15.77:0/1641372586 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1ac153e60 msgr2=0x7fa1ac15f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.878+0000 7fa1ab7fe640 1 --2- 172.21.15.77:0/1641372586 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1ac153e60 0x7fa1ac15f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.878+0000 7fa1ab7fe640 1 -- 172.21.15.77:0/1641372586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19c0094d0 con 0x7fa1ac0cd6d0 2023-11-04T01:43:18.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.878+0000 7fa1ab7fe640 1 --2- 172.21.15.77:0/1641372586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1ac0cd6d0 0x7fa1ac15eda0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fa1a000c7f0 tx=0x7fa1a000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:18.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.878+0000 7fa1a8ff9640 1 -- 172.21.15.77:0/1641372586 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a0007a30 con 0x7fa1ac0cd6d0 2023-11-04T01:43:18.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.878+0000 7fa1a8ff9640 1 -- 172.21.15.77:0/1641372586 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a0007b90 con 0x7fa1ac0cd6d0 2023-11-04T01:43:18.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.878+0000 7fa1b2664640 1 -- 172.21.15.77:0/1641372586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1ac155090 con 0x7fa1ac0cd6d0 2023-11-04T01:43:18.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.878+0000 7fa1a8ff9640 1 -- 172.21.15.77:0/1641372586 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a000ce40 con 0x7fa1ac0cd6d0 2023-11-04T01:43:18.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.878+0000 7fa1b2664640 1 -- 172.21.15.77:0/1641372586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1ac155650 con 0x7fa1ac0cd6d0 2023-11-04T01:43:18.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.879+0000 7fa1b2664640 1 -- 172.21.15.77:0/1641372586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1ac156040 con 0x7fa1ac0cd6d0 2023-11-04T01:43:18.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.880+0000 7fa1a8ff9640 1 -- 172.21.15.77:0/1641372586 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa1a00113f0 con 0x7fa1ac0cd6d0 2023-11-04T01:43:18.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.880+0000 7fa1a8ff9640 1 --2- 172.21.15.77:0/1641372586 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa19806ae70 0x7fa19806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.880+0000 7fa1a8ff9640 1 -- 172.21.15.77:0/1641372586 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6354+0+0 (secure 0 0 0) 0x7fa1a00899e0 con 0x7fa1ac0cd6d0 2023-11-04T01:43:18.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.880+0000 7fa1abfff640 1 --2- 172.21.15.77:0/1641372586 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa19806ae70 0x7fa19806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.881+0000 7fa1abfff640 1 --2- 172.21.15.77:0/1641372586 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa19806ae70 0x7fa19806d330 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa19c036000 tx=0x7fa19c03c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:18.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:18.885+0000 7fa1a8ff9640 1 -- 172.21.15.77:0/1641372586 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa1ac156040 con 0x7fa1ac0cd6d0 2023-11-04T01:43:19.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.049+0000 7fa1b2664640 1 -- 172.21.15.77:0/1641372586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7fa1ac156040 con 0x7fa1ac0cd6d0 2023-11-04T01:43:19.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.050+0000 7fa1a8ff9640 1 -- 172.21.15.77:0/1641372586 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v87) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa1ac156040 con 0x7fa1ac0cd6d0 2023-11-04T01:43:19.052 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:43:19.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.052+0000 7fa1b2664640 1 -- 172.21.15.77:0/1641372586 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa19806ae70 msgr2=0x7fa19806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:19.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.052+0000 7fa1b2664640 1 --2- 172.21.15.77:0/1641372586 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa19806ae70 0x7fa19806d330 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa19c036000 tx=0x7fa19c03c040 comp rx=0 tx=0).stop 2023-11-04T01:43:19.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.052+0000 7fa1b2664640 1 -- 172.21.15.77:0/1641372586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1ac0cd6d0 msgr2=0x7fa1ac15eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:19.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.052+0000 7fa1b2664640 1 --2- 172.21.15.77:0/1641372586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1ac0cd6d0 0x7fa1ac15eda0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fa1a000c7f0 tx=0x7fa1a000cbf0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.052+0000 7fa1b2664640 1 -- 172.21.15.77:0/1641372586 shutdown_connections 2023-11-04T01:43:19.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.052+0000 7fa1b2664640 1 --2- 172.21.15.77:0/1641372586 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa19806ae70 0x7fa19806d330 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.052+0000 7fa1b2664640 1 --2- 172.21.15.77:0/1641372586 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1ac153e60 0x7fa1ac15f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.052+0000 7fa1b2664640 1 --2- 172.21.15.77:0/1641372586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1ac0cd6d0 0x7fa1ac15eda0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.052+0000 7fa1b2664640 1 --2- 172.21.15.77:0/1641372586 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1ac0b4880 0x7fa1ac150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.052+0000 7fa1b2664640 1 -- 172.21.15.77:0/1641372586 >> 172.21.15.77:0/1641372586 conn(0x7fa1ac0cf880 msgr2=0x7fa1ac0d1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:19.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.052+0000 7fa1b2664640 1 -- 172.21.15.77:0/1641372586 shutdown_connections 2023-11-04T01:43:19.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.052+0000 7fa1b2664640 1 -- 172.21.15.77:0/1641372586 wait complete. 2023-11-04T01:43:19.064 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:43:19.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.164+0000 7fb17db5e640 1 Processor -- start 2023-11-04T01:43:19.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.164+0000 7fb17db5e640 1 -- start start 2023-11-04T01:43:19.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.165+0000 7fb17db5e640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb178153850 0x7fb17815a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:19.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.165+0000 7fb17db5e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb1780cc9d0 0x7fb1780c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:19.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.165+0000 7fb17db5e640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1780c3860 con 0x7fb1780cc520 2023-11-04T01:43:19.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.165+0000 7fb17db5e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1780c9250 con 0x7fb1780cc9d0 2023-11-04T01:43:19.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.165+0000 7fb17db5e640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb178153c30 con 0x7fb178153850 2023-11-04T01:43:19.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.165+0000 7fb177fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb1780cc9d0 0x7fb1780c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:19.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.165+0000 7fb177fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb1780cc9d0 0x7fb1780c3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38926/0 (socket says 172.21.15.77:38926) 2023-11-04T01:43:19.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.165+0000 7fb177fff640 1 -- 172.21.15.77:0/334578345 learned_addr learned my addr 172.21.15.77:0/334578345 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:19.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.165+0000 7fb177fff640 1 -- 172.21.15.77:0/334578345 >> v2:172.21.15.122:3300/0 conn(0x7fb178153850 msgr2=0x7fb17815a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:19.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.165+0000 7fb177fff640 1 --2- 172.21.15.77:0/334578345 >> v2:172.21.15.122:3300/0 conn(0x7fb178153850 0x7fb17815a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.165+0000 7fb177fff640 1 -- 172.21.15.77:0/334578345 >> v1:172.21.15.122:6789/0 conn(0x7fb1780cc520 legacy=0x7fb178070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:19.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.165+0000 7fb177fff640 1 -- 172.21.15.77:0/334578345 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17815a700 con 0x7fb1780cc9d0 2023-11-04T01:43:19.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.166+0000 7fb177fff640 1 --2- 172.21.15.77:0/334578345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1780cc9d0 0x7fb1780c3cf0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fb1780c5710 tx=0x7fb17002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9b794b9202eb5d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:19.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.166+0000 7fb1767fc640 1 -- 172.21.15.77:0/334578345 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17002ca80 con 0x7fb1780cc9d0 2023-11-04T01:43:19.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.166+0000 7fb1767fc640 1 -- 172.21.15.77:0/334578345 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17002cbe0 con 0x7fb1780cc9d0 2023-11-04T01:43:19.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.166+0000 7fb1767fc640 1 -- 172.21.15.77:0/334578345 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1700343f0 con 0x7fb1780cc9d0 2023-11-04T01:43:19.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.167+0000 7fb17db5e640 1 -- 172.21.15.77:0/334578345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1780cc9d0 msgr2=0x7fb1780c3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:19.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.167+0000 7fb17db5e640 1 --2- 172.21.15.77:0/334578345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1780cc9d0 0x7fb1780c3cf0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fb1780c5710 tx=0x7fb17002bee0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.167+0000 7fb17db5e640 1 -- 172.21.15.77:0/334578345 shutdown_connections 2023-11-04T01:43:19.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.167+0000 7fb17db5e640 1 --2- 172.21.15.77:0/334578345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1780cc9d0 0x7fb1780c3cf0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.167+0000 7fb17db5e640 1 --2- 172.21.15.77:0/334578345 >> v2:172.21.15.122:3300/0 conn(0x7fb178153850 0x7fb17815a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.167+0000 7fb17db5e640 1 -- 172.21.15.77:0/334578345 >> 172.21.15.77:0/334578345 conn(0x7fb1780ce950 msgr2=0x7fb1780ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:19.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.167+0000 7fb17db5e640 1 -- 172.21.15.77:0/334578345 shutdown_connections 2023-11-04T01:43:19.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.167+0000 7fb17db5e640 1 -- 172.21.15.77:0/334578345 wait complete. 2023-11-04T01:43:19.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.168+0000 7fb17db5e640 1 Processor -- start 2023-11-04T01:43:19.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.168+0000 7fb17db5e640 1 -- start start 2023-11-04T01:43:19.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.169+0000 7fb17db5e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1780cc520 0x7fb1781482e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:19.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.169+0000 7fb17db5e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb1780cc9d0 0x7fb178148bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:19.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.169+0000 7fb17db5e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb178153850 0x7fb178149100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:19.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.169+0000 7fb17db5e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17814c920 con 0x7fb178153850 2023-11-04T01:43:19.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.169+0000 7fb17db5e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17814ba70 con 0x7fb1780cc520 2023-11-04T01:43:19.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.169+0000 7fb17db5e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17814bd10 con 0x7fb1780cc9d0 2023-11-04T01:43:19.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.169+0000 7fb177fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb178153850 0x7fb178149100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:19.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.169+0000 7fb177fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb178153850 0x7fb178149100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38934/0 (socket says 172.21.15.77:38934) 2023-11-04T01:43:19.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.169+0000 7fb177fff640 1 -- 172.21.15.77:0/3424659775 learned_addr learned my addr 172.21.15.77:0/3424659775 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:19.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.169+0000 7fb1777fe640 1 --2- 172.21.15.77:0/3424659775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1780cc520 0x7fb1781482e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:19.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.169+0000 7fb177fff640 1 -- 172.21.15.77:0/3424659775 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb1780cc9d0 msgr2=0x7fb178148bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:19.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.169+0000 7fb177fff640 1 --2- 172.21.15.77:0/3424659775 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb1780cc9d0 0x7fb178148bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.169+0000 7fb177fff640 1 -- 172.21.15.77:0/3424659775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1780cc520 msgr2=0x7fb1781482e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:19.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.169+0000 7fb177fff640 1 --2- 172.21.15.77:0/3424659775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1780cc520 0x7fb1781482e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.169+0000 7fb177fff640 1 -- 172.21.15.77:0/3424659775 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb170009b30 con 0x7fb178153850 2023-11-04T01:43:19.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.169+0000 7fb177fff640 1 --2- 172.21.15.77:0/3424659775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb178153850 0x7fb178149100 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fb170036040 tx=0x7fb170004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:19.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.169+0000 7fb15ffff640 1 -- 172.21.15.77:0/3424659775 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17003e450 con 0x7fb178153850 2023-11-04T01:43:19.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.170+0000 7fb15ffff640 1 -- 172.21.15.77:0/3424659775 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17003e5d0 con 0x7fb178153850 2023-11-04T01:43:19.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.170+0000 7fb17db5e640 1 -- 172.21.15.77:0/3424659775 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb17814bff0 con 0x7fb178153850 2023-11-04T01:43:19.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.170+0000 7fb15ffff640 1 -- 172.21.15.77:0/3424659775 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17003e980 con 0x7fb178153850 2023-11-04T01:43:19.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.170+0000 7fb17db5e640 1 -- 172.21.15.77:0/3424659775 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb17814c5b0 con 0x7fb178153850 2023-11-04T01:43:19.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.171+0000 7fb17db5e640 1 -- 172.21.15.77:0/3424659775 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17814ca90 con 0x7fb178153850 2023-11-04T01:43:19.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.171+0000 7fb15ffff640 1 -- 172.21.15.77:0/3424659775 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb17002cd50 con 0x7fb178153850 2023-11-04T01:43:19.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.171+0000 7fb15ffff640 1 --2- 172.21.15.77:0/3424659775 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb16406ae70 0x7fb16406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:19.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.171+0000 7fb15ffff640 1 -- 172.21.15.77:0/3424659775 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6354+0+0 (secure 0 0 0) 0x7fb1700ac550 con 0x7fb178153850 2023-11-04T01:43:19.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.172+0000 7fb1777fe640 1 --2- 172.21.15.77:0/3424659775 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb16406ae70 0x7fb16406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:19.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.172+0000 7fb1777fe640 1 --2- 172.21.15.77:0/3424659775 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb16406ae70 0x7fb16406d330 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb16800a770 tx=0x7fb168008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:19.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.175+0000 7fb15ffff640 1 -- 172.21.15.77:0/3424659775 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb1700772e0 con 0x7fb178153850 2023-11-04T01:43:19.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.345+0000 7fb17db5e640 1 -- 172.21.15.77:0/3424659775 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7fb178074290 con 0x7fb178153850 2023-11-04T01:43:19.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.346+0000 7fb15ffff640 1 -- 172.21.15.77:0/3424659775 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v87) v1 ==== 107+0+11 (secure 0 0 0) 0x7fb170043020 con 0x7fb178153850 2023-11-04T01:43:19.348 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:43:19.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.348+0000 7fb17db5e640 1 -- 172.21.15.77:0/3424659775 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb16406ae70 msgr2=0x7fb16406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:19.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.348+0000 7fb17db5e640 1 --2- 172.21.15.77:0/3424659775 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb16406ae70 0x7fb16406d330 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb16800a770 tx=0x7fb168008040 comp rx=0 tx=0).stop 2023-11-04T01:43:19.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.348+0000 7fb17db5e640 1 -- 172.21.15.77:0/3424659775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb178153850 msgr2=0x7fb178149100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:19.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.348+0000 7fb17db5e640 1 --2- 172.21.15.77:0/3424659775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb178153850 0x7fb178149100 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fb170036040 tx=0x7fb170004a40 comp rx=0 tx=0).stop 2023-11-04T01:43:19.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.348+0000 7fb17db5e640 1 -- 172.21.15.77:0/3424659775 shutdown_connections 2023-11-04T01:43:19.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.348+0000 7fb17db5e640 1 --2- 172.21.15.77:0/3424659775 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb16406ae70 0x7fb16406d330 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.348+0000 7fb17db5e640 1 --2- 172.21.15.77:0/3424659775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb178153850 0x7fb178149100 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.348+0000 7fb17db5e640 1 --2- 172.21.15.77:0/3424659775 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb1780cc9d0 0x7fb178148bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.348+0000 7fb17db5e640 1 --2- 172.21.15.77:0/3424659775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1780cc520 0x7fb1781482e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.348+0000 7fb17db5e640 1 -- 172.21.15.77:0/3424659775 >> 172.21.15.77:0/3424659775 conn(0x7fb1780ce950 msgr2=0x7fb178071360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:19.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.348+0000 7fb17db5e640 1 -- 172.21.15.77:0/3424659775 shutdown_connections 2023-11-04T01:43:19.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.348+0000 7fb17db5e640 1 -- 172.21.15.77:0/3424659775 wait complete. 2023-11-04T01:43:19.360 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_kill_mdstable' 2023-11-04T01:43:19.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.458+0000 7ff8c300e640 1 Processor -- start 2023-11-04T01:43:19.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.458+0000 7ff8c300e640 1 -- start start 2023-11-04T01:43:19.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.458+0000 7ff8c300e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff8bc15d0a0 0x7ff8bc0ce070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:19.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.458+0000 7ff8c300e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff8bc0d0f40 0x7ff8bc0b4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:19.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.458+0000 7ff8c300e640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff8bc0b4d50 0x7ff8bc06b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:19.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.458+0000 7ff8c300e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8bc0b51e0 con 0x7ff8bc15d0a0 2023-11-04T01:43:19.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.458+0000 7ff8c300e640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8bc15d480 con 0x7ff8bc0b4d50 2023-11-04T01:43:19.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.458+0000 7ff8c300e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc0b5e20 con 0x7ff8bc0d0f40 2023-11-04T01:43:19.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.458+0000 7ff8c0daa640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff8bc15d0a0 0x7ff8bc0ce070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:19.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.459+0000 7ff8c0daa640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff8bc15d0a0 0x7ff8bc0ce070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38948/0 (socket says 172.21.15.77:38948) 2023-11-04T01:43:19.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.459+0000 7ff8c0daa640 1 -- 172.21.15.77:0/2606049078 learned_addr learned my addr 172.21.15.77:0/2606049078 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:19.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.459+0000 7ff8c0daa640 1 -- 172.21.15.77:0/2606049078 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff8bc0d0f40 msgr2=0x7ff8bc0b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:19.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.459+0000 7ff8c15ab640 1 --2- 172.21.15.77:0/2606049078 >> v2:172.21.15.122:3300/0 conn(0x7ff8bc0b4d50 0x7ff8bc06b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:19.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.459+0000 7ff8bbfff640 1 --2- 172.21.15.77:0/2606049078 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff8bc0d0f40 0x7ff8bc0b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:19.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.459+0000 7ff8c0daa640 1 --2- 172.21.15.77:0/2606049078 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff8bc0d0f40 0x7ff8bc0b4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.459+0000 7ff8c0daa640 1 -- 172.21.15.77:0/2606049078 >> v2:172.21.15.122:3300/0 conn(0x7ff8bc0b4d50 msgr2=0x7ff8bc06b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:19.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.459+0000 7ff8c0daa640 1 --2- 172.21.15.77:0/2606049078 >> v2:172.21.15.122:3300/0 conn(0x7ff8bc0b4d50 0x7ff8bc06b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.459+0000 7ff8c0daa640 1 -- 172.21.15.77:0/2606049078 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8bc0b60e0 con 0x7ff8bc15d0a0 2023-11-04T01:43:19.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.459+0000 7ff8c15ab640 1 --2- 172.21.15.77:0/2606049078 >> v2:172.21.15.122:3300/0 conn(0x7ff8bc0b4d50 0x7ff8bc06b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:19.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.459+0000 7ff8bbfff640 1 --2- 172.21.15.77:0/2606049078 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff8bc0d0f40 0x7ff8bc0b4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:19.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.460+0000 7ff8c0daa640 1 --2- 172.21.15.77:0/2606049078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8bc15d0a0 0x7ff8bc0ce070 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc08c020 tx=0x7ff8b002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a514a7ef49ea8e9b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:19.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.460+0000 7ff8bb7fe640 1 -- 172.21.15.77:0/2606049078 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0031640 con 0x7ff8bc15d0a0 2023-11-04T01:43:19.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.460+0000 7ff8bb7fe640 1 -- 172.21.15.77:0/2606049078 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b00317a0 con 0x7ff8bc15d0a0 2023-11-04T01:43:19.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.460+0000 7ff8bb7fe640 1 -- 172.21.15.77:0/2606049078 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0031b30 con 0x7ff8bc15d0a0 2023-11-04T01:43:19.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.460+0000 7ff8c300e640 1 -- 172.21.15.77:0/2606049078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8bc15d0a0 msgr2=0x7ff8bc0ce070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:19.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.460+0000 7ff8c300e640 1 --2- 172.21.15.77:0/2606049078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8bc15d0a0 0x7ff8bc0ce070 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc08c020 tx=0x7ff8b002b8f0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.460+0000 7ff8c300e640 1 -- 172.21.15.77:0/2606049078 shutdown_connections 2023-11-04T01:43:19.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.460+0000 7ff8c300e640 1 --2- 172.21.15.77:0/2606049078 >> v2:172.21.15.122:3300/0 conn(0x7ff8bc0b4d50 0x7ff8bc06b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.460+0000 7ff8c300e640 1 --2- 172.21.15.77:0/2606049078 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff8bc0d0f40 0x7ff8bc0b4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.460+0000 7ff8c300e640 1 --2- 172.21.15.77:0/2606049078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8bc15d0a0 0x7ff8bc0ce070 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.460+0000 7ff8c300e640 1 -- 172.21.15.77:0/2606049078 >> 172.21.15.77:0/2606049078 conn(0x7ff8bc0cf810 msgr2=0x7ff8bc0cfc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:19.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.460+0000 7ff8c300e640 1 -- 172.21.15.77:0/2606049078 shutdown_connections 2023-11-04T01:43:19.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.460+0000 7ff8c300e640 1 -- 172.21.15.77:0/2606049078 wait complete. 2023-11-04T01:43:19.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.461+0000 7ff8c300e640 1 Processor -- start 2023-11-04T01:43:19.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.462+0000 7ff8c300e640 1 -- start start 2023-11-04T01:43:19.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.462+0000 7ff8c300e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff8bc0b4d50 0x7ff8bc1efdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:19.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.462+0000 7ff8c300e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8bc0d0f40 0x7ff8bc1f3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:19.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.462+0000 7ff8c300e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8bc15d0a0 0x7ff8bc157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:19.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.462+0000 7ff8c300e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc1f3770 con 0x7ff8bc0d0f40 2023-11-04T01:43:19.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.462+0000 7ff8c300e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc156410 con 0x7ff8bc15d0a0 2023-11-04T01:43:19.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.462+0000 7ff8c300e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc1566f0 con 0x7ff8bc0b4d50 2023-11-04T01:43:19.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.462+0000 7ff8bbfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8bc0d0f40 0x7ff8bc1f3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:19.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.462+0000 7ff8bbfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8bc0d0f40 0x7ff8bc1f3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38956/0 (socket says 172.21.15.77:38956) 2023-11-04T01:43:19.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.462+0000 7ff8bbfff640 1 -- 172.21.15.77:0/4137343577 learned_addr learned my addr 172.21.15.77:0/4137343577 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:19.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.463+0000 7ff8bbfff640 1 -- 172.21.15.77:0/4137343577 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff8bc0b4d50 msgr2=0x7ff8bc1efdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:19.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.463+0000 7ff8c0daa640 1 --2- 172.21.15.77:0/4137343577 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff8bc0b4d50 0x7ff8bc1efdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:19.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.463+0000 7ff8c15ab640 1 --2- 172.21.15.77:0/4137343577 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8bc15d0a0 0x7ff8bc157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:19.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.463+0000 7ff8bbfff640 1 --2- 172.21.15.77:0/4137343577 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff8bc0b4d50 0x7ff8bc1efdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.463+0000 7ff8bbfff640 1 -- 172.21.15.77:0/4137343577 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8bc15d0a0 msgr2=0x7ff8bc157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:19.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.463+0000 7ff8bbfff640 1 --2- 172.21.15.77:0/4137343577 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8bc15d0a0 0x7ff8bc157e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.463+0000 7ff8bbfff640 1 -- 172.21.15.77:0/4137343577 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b00094d0 con 0x7ff8bc0d0f40 2023-11-04T01:43:19.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.463+0000 7ff8bbfff640 1 --2- 172.21.15.77:0/4137343577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8bc0d0f40 0x7ff8bc1f3230 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7ff8a800c7f0 tx=0x7ff8a800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:19.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.463+0000 7ff8b97fa640 1 -- 172.21.15.77:0/4137343577 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8007a30 con 0x7ff8bc0d0f40 2023-11-04T01:43:19.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.463+0000 7ff8b97fa640 1 -- 172.21.15.77:0/4137343577 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a8007b90 con 0x7ff8bc0d0f40 2023-11-04T01:43:19.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.463+0000 7ff8c300e640 1 -- 172.21.15.77:0/4137343577 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8bc1569d0 con 0x7ff8bc0d0f40 2023-11-04T01:43:19.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.463+0000 7ff8b97fa640 1 -- 172.21.15.77:0/4137343577 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a800ce40 con 0x7ff8bc0d0f40 2023-11-04T01:43:19.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.463+0000 7ff8c300e640 1 -- 172.21.15.77:0/4137343577 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8bc156f90 con 0x7ff8bc0d0f40 2023-11-04T01:43:19.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.464+0000 7ff8c300e640 1 -- 172.21.15.77:0/4137343577 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8bc074290 con 0x7ff8bc0d0f40 2023-11-04T01:43:19.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.464+0000 7ff8b97fa640 1 -- 172.21.15.77:0/4137343577 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff8a80113f0 con 0x7ff8bc0d0f40 2023-11-04T01:43:19.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.465+0000 7ff8b97fa640 1 --2- 172.21.15.77:0/4137343577 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff8a006ae70 0x7ff8a006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:19.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.465+0000 7ff8b97fa640 1 -- 172.21.15.77:0/4137343577 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6354+0+0 (secure 0 0 0) 0x7ff8a8089970 con 0x7ff8bc0d0f40 2023-11-04T01:43:19.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.465+0000 7ff8c0daa640 1 --2- 172.21.15.77:0/4137343577 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff8a006ae70 0x7ff8a006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:19.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.466+0000 7ff8c0daa640 1 --2- 172.21.15.77:0/4137343577 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff8a006ae70 0x7ff8a006d330 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0036000 tx=0x7ff8b003c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:19.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.469+0000 7ff8b97fa640 1 -- 172.21.15.77:0/4137343577 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff8a8054790 con 0x7ff8bc0d0f40 2023-11-04T01:43:19.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.696+0000 7ff8c300e640 1 -- 172.21.15.77:0/4137343577 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_kill_mdstable"]} v 0) v1 -- 0x7ff8bc159f10 con 0x7ff8bc0d0f40 2023-11-04T01:43:19.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.886+0000 7ff8b97fa640 1 -- 172.21.15.77:0/4137343577 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_kill_mdstable"]}]=0 v202) v1 ==== 142+0+0 (secure 0 0 0) 0x7ff8a801f0d0 con 0x7ff8bc0d0f40 2023-11-04T01:43:19.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.888+0000 7ff8c300e640 1 -- 172.21.15.77:0/4137343577 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff8a006ae70 msgr2=0x7ff8a006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:19.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.888+0000 7ff8c300e640 1 --2- 172.21.15.77:0/4137343577 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff8a006ae70 0x7ff8a006d330 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0036000 tx=0x7ff8b003c040 comp rx=0 tx=0).stop 2023-11-04T01:43:19.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.888+0000 7ff8c300e640 1 -- 172.21.15.77:0/4137343577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8bc0d0f40 msgr2=0x7ff8bc1f3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:19.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.888+0000 7ff8c300e640 1 --2- 172.21.15.77:0/4137343577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8bc0d0f40 0x7ff8bc1f3230 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7ff8a800c7f0 tx=0x7ff8a800cbf0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.888+0000 7ff8c300e640 1 -- 172.21.15.77:0/4137343577 shutdown_connections 2023-11-04T01:43:19.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.888+0000 7ff8c300e640 1 --2- 172.21.15.77:0/4137343577 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff8a006ae70 0x7ff8a006d330 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.888+0000 7ff8c300e640 1 --2- 172.21.15.77:0/4137343577 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8bc15d0a0 0x7ff8bc157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.888+0000 7ff8c300e640 1 --2- 172.21.15.77:0/4137343577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8bc0d0f40 0x7ff8bc1f3230 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.888+0000 7ff8c300e640 1 --2- 172.21.15.77:0/4137343577 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff8bc0b4d50 0x7ff8bc1efdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.888+0000 7ff8c300e640 1 -- 172.21.15.77:0/4137343577 >> 172.21.15.77:0/4137343577 conn(0x7ff8bc0cf810 msgr2=0x7ff8bc0d2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:19.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.888+0000 7ff8c300e640 1 -- 172.21.15.77:0/4137343577 shutdown_connections 2023-11-04T01:43:19.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:19.888+0000 7ff8c300e640 1 -- 172.21.15.77:0/4137343577 wait complete. 2023-11-04T01:43:19.901 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-04T01:43:20.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.001+0000 7f5248aec640 1 Processor -- start 2023-11-04T01:43:20.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.001+0000 7f5248aec640 1 -- start start 2023-11-04T01:43:20.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.002+0000 7f5248aec640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f52440ae1d0 0x7f52440cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.002+0000 7f5248aec640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f524415aff0 con 0x7f5244159c00 2023-11-04T01:43:20.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.002+0000 7f5248aec640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f524415a3e0 con 0x7f52440c4ff0 2023-11-04T01:43:20.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.002+0000 7f5248aec640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f524415a6c0 con 0x7f52440ae1d0 2023-11-04T01:43:20.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.002+0000 7f5242d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f52440ae1d0 0x7f52440cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.002+0000 7f524259c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f5244159c00 0x7f52440c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40290/0 (socket says 172.21.15.77:40290) 2023-11-04T01:43:20.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.002+0000 7f524259c640 1 -- 172.21.15.77:0/489177698 learned_addr learned my addr 172.21.15.77:0/489177698 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:20.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.002+0000 7f5242d9d640 1 -- 172.21.15.77:0/489177698 >> v1:172.21.15.122:6789/0 conn(0x7f52440c4ff0 legacy=0x7f52440adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:20.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.002+0000 7f5242d9d640 1 -- 172.21.15.77:0/489177698 >> v1:172.21.15.77:6789/0 conn(0x7f5244159c00 legacy=0x7f52440c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.002+0000 7f5242d9d640 1 -- 172.21.15.77:0/489177698 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524415a9a0 con 0x7f52440ae1d0 2023-11-04T01:43:20.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.002+0000 7f524159a640 1 -- 172.21.15.77:0/489177698 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3648312969 0 0) 0x7f524415aff0 con 0x7f5244159c00 2023-11-04T01:43:20.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.003+0000 7f5242d9d640 1 --2- 172.21.15.77:0/489177698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52440ae1d0 0x7f52440cc890 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f523c0097a0 tx=0x7f523c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85190dc24b4a9425 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:20.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.003+0000 7f524159a640 1 -- 172.21.15.77:0/489177698 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c031830 con 0x7f52440ae1d0 2023-11-04T01:43:20.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.003+0000 7f524159a640 1 -- 172.21.15.77:0/489177698 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523c031990 con 0x7f52440ae1d0 2023-11-04T01:43:20.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.003+0000 7f524159a640 1 -- 172.21.15.77:0/489177698 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c031d20 con 0x7f52440ae1d0 2023-11-04T01:43:20.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.004+0000 7f5248aec640 1 -- 172.21.15.77:0/489177698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52440ae1d0 msgr2=0x7f52440cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.004+0000 7f5248aec640 1 --2- 172.21.15.77:0/489177698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52440ae1d0 0x7f52440cc890 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f523c0097a0 tx=0x7f523c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.004+0000 7f5248aec640 1 -- 172.21.15.77:0/489177698 shutdown_connections 2023-11-04T01:43:20.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.004+0000 7f5248aec640 1 --2- 172.21.15.77:0/489177698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52440ae1d0 0x7f52440cc890 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.004+0000 7f5248aec640 1 -- 172.21.15.77:0/489177698 >> 172.21.15.77:0/489177698 conn(0x7f52440ce950 msgr2=0x7f52440ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:20.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.004+0000 7f5248aec640 1 -- 172.21.15.77:0/489177698 shutdown_connections 2023-11-04T01:43:20.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.004+0000 7f5248aec640 1 -- 172.21.15.77:0/489177698 wait complete. 2023-11-04T01:43:20.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.005+0000 7f5248aec640 1 Processor -- start 2023-11-04T01:43:20.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.005+0000 7f5248aec640 1 -- start start 2023-11-04T01:43:20.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.006+0000 7f5248aec640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52440ae1d0 0x7f524415c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.006+0000 7f5248aec640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52440c4ff0 0x7f524413d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.006+0000 7f5248aec640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5244159c00 0x7f5244141740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.006+0000 7f5248aec640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52441f0750 con 0x7f52440c4ff0 2023-11-04T01:43:20.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.006+0000 7f5248aec640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5244149a20 con 0x7f52440ae1d0 2023-11-04T01:43:20.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.006+0000 7f5248aec640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5244149d00 con 0x7f5244159c00 2023-11-04T01:43:20.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.006+0000 7f5241d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52440c4ff0 0x7f524413d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.006+0000 7f5241d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52440c4ff0 0x7f524413d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38964/0 (socket says 172.21.15.77:38964) 2023-11-04T01:43:20.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.006+0000 7f5241d9b640 1 -- 172.21.15.77:0/1806245706 learned_addr learned my addr 172.21.15.77:0/1806245706 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:20.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.006+0000 7f524259c640 1 --2- 172.21.15.77:0/1806245706 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52440ae1d0 0x7f524415c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.006+0000 7f5242d9d640 1 --2- 172.21.15.77:0/1806245706 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5244159c00 0x7f5244141740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.006+0000 7f5241d9b640 1 -- 172.21.15.77:0/1806245706 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5244159c00 msgr2=0x7f5244141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.006+0000 7f5241d9b640 1 --2- 172.21.15.77:0/1806245706 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5244159c00 0x7f5244141740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.006+0000 7f5241d9b640 1 -- 172.21.15.77:0/1806245706 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52440ae1d0 msgr2=0x7f524415c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.006+0000 7f5241d9b640 1 --2- 172.21.15.77:0/1806245706 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52440ae1d0 0x7f524415c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.006+0000 7f5241d9b640 1 -- 172.21.15.77:0/1806245706 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523c009400 con 0x7f52440c4ff0 2023-11-04T01:43:20.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.006+0000 7f5241d9b640 1 --2- 172.21.15.77:0/1806245706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52440c4ff0 0x7f524413d990 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f523800c3c0 tx=0x7f523800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:20.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.007+0000 7f5232ffd640 1 -- 172.21.15.77:0/1806245706 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52380035f0 con 0x7f52440c4ff0 2023-11-04T01:43:20.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.007+0000 7f5232ffd640 1 -- 172.21.15.77:0/1806245706 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5238003750 con 0x7f52440c4ff0 2023-11-04T01:43:20.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.007+0000 7f5248aec640 1 -- 172.21.15.77:0/1806245706 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f524415c9c0 con 0x7f52440c4ff0 2023-11-04T01:43:20.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.007+0000 7f5232ffd640 1 -- 172.21.15.77:0/1806245706 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5238003b00 con 0x7f52440c4ff0 2023-11-04T01:43:20.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.007+0000 7f5248aec640 1 -- 172.21.15.77:0/1806245706 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f524415cf40 con 0x7f52440c4ff0 2023-11-04T01:43:20.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.008+0000 7f5248aec640 1 -- 172.21.15.77:0/1806245706 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5244074290 con 0x7f52440c4ff0 2023-11-04T01:43:20.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.008+0000 7f5232ffd640 1 -- 172.21.15.77:0/1806245706 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5238003c60 con 0x7f52440c4ff0 2023-11-04T01:43:20.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.009+0000 7f5232ffd640 1 --2- 172.21.15.77:0/1806245706 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f522406ae70 0x7f522406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.009+0000 7f5232ffd640 1 -- 172.21.15.77:0/1806245706 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6354+0+0 (secure 0 0 0) 0x7f5238088cc0 con 0x7f52440c4ff0 2023-11-04T01:43:20.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.009+0000 7f524259c640 1 --2- 172.21.15.77:0/1806245706 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f522406ae70 0x7f522406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.009+0000 7f524259c640 1 --2- 172.21.15.77:0/1806245706 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f522406ae70 0x7f522406d330 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5234007ed0 tx=0x7f5234007e60 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:20.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.013+0000 7f5232ffd640 1 -- 172.21.15.77:0/1806245706 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5238053c20 con 0x7f52440c4ff0 2023-11-04T01:43:20.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.177+0000 7f5248aec640 1 -- 172.21.15.77:0/1806245706 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f524406c7b0 con 0x7f52440c4ff0 2023-11-04T01:43:20.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.182+0000 7f5232ffd640 1 -- 172.21.15.77:0/1806245706 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v19)=0 v19) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5238017070 con 0x7f52440c4ff0 2023-11-04T01:43:20.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.184+0000 7f5248aec640 1 -- 172.21.15.77:0/1806245706 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f522406ae70 msgr2=0x7f522406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.184+0000 7f5248aec640 1 --2- 172.21.15.77:0/1806245706 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f522406ae70 0x7f522406d330 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5234007ed0 tx=0x7f5234007e60 comp rx=0 tx=0).stop 2023-11-04T01:43:20.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.184+0000 7f5248aec640 1 -- 172.21.15.77:0/1806245706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52440c4ff0 msgr2=0x7f524413d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.184+0000 7f5248aec640 1 --2- 172.21.15.77:0/1806245706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52440c4ff0 0x7f524413d990 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f523800c3c0 tx=0x7f523800c880 comp rx=0 tx=0).stop 2023-11-04T01:43:20.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.184+0000 7f5248aec640 1 -- 172.21.15.77:0/1806245706 shutdown_connections 2023-11-04T01:43:20.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.184+0000 7f5248aec640 1 --2- 172.21.15.77:0/1806245706 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f522406ae70 0x7f522406d330 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.184+0000 7f5248aec640 1 --2- 172.21.15.77:0/1806245706 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5244159c00 0x7f5244141740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.184+0000 7f5248aec640 1 --2- 172.21.15.77:0/1806245706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52440c4ff0 0x7f524413d990 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.184+0000 7f5248aec640 1 --2- 172.21.15.77:0/1806245706 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52440ae1d0 0x7f524415c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.184+0000 7f5248aec640 1 -- 172.21.15.77:0/1806245706 >> 172.21.15.77:0/1806245706 conn(0x7f52440ce950 msgr2=0x7f5244158750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:20.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.184+0000 7f5248aec640 1 -- 172.21.15.77:0/1806245706 shutdown_connections 2023-11-04T01:43:20.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.184+0000 7f5248aec640 1 -- 172.21.15.77:0/1806245706 wait complete. 2023-11-04T01:43:20.197 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:43:20.197 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:43:20.239 DEBUG:teuthology.orchestra.run.smithi122:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:43:20.282 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:43:20.283 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:43:20.283 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:20.298 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19534 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:43:20.299 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:43:20.299 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:20.341 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056339,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13650 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:43:20.341 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:43:20.341 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:20.356 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19534 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:43:20.357 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:43:20.357 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:20.398 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056339,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13650 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:43:20.398 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-04T01:43:20.399 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:20.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.496+0000 7fb950c07640 1 Processor -- start 2023-11-04T01:43:20.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.496+0000 7fb950c07640 1 -- start start 2023-11-04T01:43:20.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.497+0000 7fb950c07640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb94c159c70 0x7fb94c0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.497+0000 7fb950c07640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb94c0b0ae0 0x7fb94c15d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.497+0000 7fb950c07640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb94c0b4110 con 0x7fb94c06db20 2023-11-04T01:43:20.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.497+0000 7fb950c07640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb94c0b49b0 con 0x7fb94c159c70 2023-11-04T01:43:20.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.497+0000 7fb950c07640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb94c0b43f0 con 0x7fb94c0b0ae0 2023-11-04T01:43:20.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.497+0000 7fb94a59c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb94c159c70 0x7fb94c0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.497+0000 7fb94a59c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb94c159c70 0x7fb94c0ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38972/0 (socket says 172.21.15.77:38972) 2023-11-04T01:43:20.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.497+0000 7fb94a59c640 1 -- 172.21.15.77:0/1217332759 learned_addr learned my addr 172.21.15.77:0/1217332759 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:20.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.497+0000 7fb94a59c640 1 -- 172.21.15.77:0/1217332759 >> v2:172.21.15.122:3300/0 conn(0x7fb94c0b0ae0 msgr2=0x7fb94c15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:20.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.497+0000 7fb94ad9d640 1 --2- 172.21.15.77:0/1217332759 >> v2:172.21.15.122:3300/0 conn(0x7fb94c0b0ae0 0x7fb94c15d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.497+0000 7fb94a59c640 1 --2- 172.21.15.77:0/1217332759 >> v2:172.21.15.122:3300/0 conn(0x7fb94c0b0ae0 0x7fb94c15d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.497+0000 7fb94a59c640 1 -- 172.21.15.77:0/1217332759 >> v1:172.21.15.122:6789/0 conn(0x7fb94c06db20 legacy=0x7fb94c0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:20.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.497+0000 7fb94a59c640 1 -- 172.21.15.77:0/1217332759 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb94c0b46d0 con 0x7fb94c159c70 2023-11-04T01:43:20.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.497+0000 7fb94ad9d640 1 --2- 172.21.15.77:0/1217332759 >> v2:172.21.15.122:3300/0 conn(0x7fb94c0b0ae0 0x7fb94c15d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:20.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.498+0000 7fb94a59c640 1 --2- 172.21.15.77:0/1217332759 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb94c159c70 0x7fb94c0ce370 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0c5910 tx=0x7fb93c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc204a7ba7766e21 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:20.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.498+0000 7fb949d9b640 1 -- 172.21.15.77:0/1217332759 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93c031870 con 0x7fb94c159c70 2023-11-04T01:43:20.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.498+0000 7fb949d9b640 1 -- 172.21.15.77:0/1217332759 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb93c0319d0 con 0x7fb94c159c70 2023-11-04T01:43:20.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.498+0000 7fb949d9b640 1 -- 172.21.15.77:0/1217332759 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93c031d60 con 0x7fb94c159c70 2023-11-04T01:43:20.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.499+0000 7fb950c07640 1 -- 172.21.15.77:0/1217332759 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb94c159c70 msgr2=0x7fb94c0ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.499+0000 7fb950c07640 1 --2- 172.21.15.77:0/1217332759 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb94c159c70 0x7fb94c0ce370 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0c5910 tx=0x7fb93c02b910 comp rx=0 tx=0).stop 2023-11-04T01:43:20.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.499+0000 7fb950c07640 1 -- 172.21.15.77:0/1217332759 shutdown_connections 2023-11-04T01:43:20.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.499+0000 7fb950c07640 1 --2- 172.21.15.77:0/1217332759 >> v2:172.21.15.122:3300/0 conn(0x7fb94c0b0ae0 0x7fb94c15d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.499+0000 7fb950c07640 1 --2- 172.21.15.77:0/1217332759 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb94c159c70 0x7fb94c0ce370 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.499+0000 7fb950c07640 1 -- 172.21.15.77:0/1217332759 >> 172.21.15.77:0/1217332759 conn(0x7fb94c0ce950 msgr2=0x7fb94c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:20.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.499+0000 7fb950c07640 1 -- 172.21.15.77:0/1217332759 shutdown_connections 2023-11-04T01:43:20.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.499+0000 7fb950c07640 1 -- 172.21.15.77:0/1217332759 wait complete. 2023-11-04T01:43:20.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.500+0000 7fb950c07640 1 Processor -- start 2023-11-04T01:43:20.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.500+0000 7fb950c07640 1 -- start start 2023-11-04T01:43:20.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.501+0000 7fb950c07640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb94c06db20 0x7fb94c0c4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.501+0000 7fb950c07640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb94c0b0ae0 0x7fb94c157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.501+0000 7fb950c07640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb94c159c70 0x7fb94c153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.501+0000 7fb950c07640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c156890 con 0x7fb94c0b0ae0 2023-11-04T01:43:20.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.501+0000 7fb950c07640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c0c5280 con 0x7fb94c159c70 2023-11-04T01:43:20.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.501+0000 7fb950c07640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c1f06a0 con 0x7fb94c06db20 2023-11-04T01:43:20.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.501+0000 7fb941d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb94c0b0ae0 0x7fb94c157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.501+0000 7fb941d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb94c0b0ae0 0x7fb94c157a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38980/0 (socket says 172.21.15.77:38980) 2023-11-04T01:43:20.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.501+0000 7fb941d9b640 1 -- 172.21.15.77:0/9211048 learned_addr learned my addr 172.21.15.77:0/9211048 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:20.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.501+0000 7fb94ad9d640 1 --2- 172.21.15.77:0/9211048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb94c159c70 0x7fb94c153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.501+0000 7fb94a59c640 1 --2- 172.21.15.77:0/9211048 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb94c06db20 0x7fb94c0c4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.501+0000 7fb941d9b640 1 -- 172.21.15.77:0/9211048 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb94c06db20 msgr2=0x7fb94c0c4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.501+0000 7fb941d9b640 1 --2- 172.21.15.77:0/9211048 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb94c06db20 0x7fb94c0c4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.501+0000 7fb941d9b640 1 -- 172.21.15.77:0/9211048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb94c159c70 msgr2=0x7fb94c153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.501+0000 7fb941d9b640 1 --2- 172.21.15.77:0/9211048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb94c159c70 0x7fb94c153980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.501+0000 7fb941d9b640 1 -- 172.21.15.77:0/9211048 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb93c0094d0 con 0x7fb94c0b0ae0 2023-11-04T01:43:20.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.501+0000 7fb94a59c640 1 --2- 172.21.15.77:0/9211048 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb94c06db20 0x7fb94c0c4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:20.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.501+0000 7fb941d9b640 1 --2- 172.21.15.77:0/9211048 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb94c0b0ae0 0x7fb94c157a80 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fb93400b3f0 tx=0x7fb93400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:20.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.502+0000 7fb9437fe640 1 -- 172.21.15.77:0/9211048 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb934011830 con 0x7fb94c0b0ae0 2023-11-04T01:43:20.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.502+0000 7fb9437fe640 1 -- 172.21.15.77:0/9211048 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb934011990 con 0x7fb94c0b0ae0 2023-11-04T01:43:20.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.502+0000 7fb9437fe640 1 -- 172.21.15.77:0/9211048 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb934011d40 con 0x7fb94c0b0ae0 2023-11-04T01:43:20.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.502+0000 7fb950c07640 1 -- 172.21.15.77:0/9211048 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb94c155d10 con 0x7fb94c0b0ae0 2023-11-04T01:43:20.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.502+0000 7fb950c07640 1 -- 172.21.15.77:0/9211048 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb94c1562d0 con 0x7fb94c0b0ae0 2023-11-04T01:43:20.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.503+0000 7fb950c07640 1 -- 172.21.15.77:0/9211048 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb94c1f0810 con 0x7fb94c0b0ae0 2023-11-04T01:43:20.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.503+0000 7fb9437fe640 1 -- 172.21.15.77:0/9211048 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb93401a400 con 0x7fb94c0b0ae0 2023-11-04T01:43:20.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.503+0000 7fb9437fe640 1 --2- 172.21.15.77:0/9211048 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb92c06ae70 0x7fb92c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.503+0000 7fb9437fe640 1 -- 172.21.15.77:0/9211048 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6354+0+0 (secure 0 0 0) 0x7fb934089660 con 0x7fb94c0b0ae0 2023-11-04T01:43:20.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.504+0000 7fb94a59c640 1 --2- 172.21.15.77:0/9211048 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb92c06ae70 0x7fb92c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.504+0000 7fb94a59c640 1 --2- 172.21.15.77:0/9211048 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb92c06ae70 0x7fb92c06d330 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb93c036000 tx=0x7fb93c03c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:20.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.507+0000 7fb9437fe640 1 -- 172.21.15.77:0/9211048 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb934054480 con 0x7fb94c0b0ae0 2023-11-04T01:43:20.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.708+0000 7fb950c07640 1 -- 172.21.15.77:0/9211048 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb94c074290 con 0x7fb94c0b0ae0 2023-11-04T01:43:20.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.708+0000 7fb9437fe640 1 -- 172.21.15.77:0/9211048 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+3703 (secure 0 0 0) 0x7fb934015e90 con 0x7fb94c0b0ae0 2023-11-04T01:43:20.711 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:43:20.711 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":39,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5992,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/301441031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":301441031},{"type":"v1","addr":"172.21.15.122:6836","nonce":301441031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6861,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/3789657703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3789657703},{"type":"v1","addr":"172.21.15.77:6834","nonce":3789657703}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6864,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3292881877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3292881877},{"type":"v1","addr":"172.21.15.77:6835","nonce":3292881877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":35645,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1144763321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1144763321},{"type":"v1","addr":"172.21.15.122:6837","nonce":1144763321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39}],"filesystems":[]} 2023-11-04T01:43:20.711 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 39 2023-11-04T01:43:20.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.710+0000 7fb950c07640 1 -- 172.21.15.77:0/9211048 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb92c06ae70 msgr2=0x7fb92c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.710+0000 7fb950c07640 1 --2- 172.21.15.77:0/9211048 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb92c06ae70 0x7fb92c06d330 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb93c036000 tx=0x7fb93c03c040 comp rx=0 tx=0).stop 2023-11-04T01:43:20.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.710+0000 7fb950c07640 1 -- 172.21.15.77:0/9211048 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb94c0b0ae0 msgr2=0x7fb94c157a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.710+0000 7fb950c07640 1 --2- 172.21.15.77:0/9211048 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb94c0b0ae0 0x7fb94c157a80 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fb93400b3f0 tx=0x7fb93400b8b0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.710+0000 7fb950c07640 1 -- 172.21.15.77:0/9211048 shutdown_connections 2023-11-04T01:43:20.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.710+0000 7fb950c07640 1 --2- 172.21.15.77:0/9211048 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb92c06ae70 0x7fb92c06d330 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.710+0000 7fb950c07640 1 --2- 172.21.15.77:0/9211048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb94c159c70 0x7fb94c153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.710+0000 7fb950c07640 1 --2- 172.21.15.77:0/9211048 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb94c0b0ae0 0x7fb94c157a80 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.710+0000 7fb950c07640 1 --2- 172.21.15.77:0/9211048 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb94c06db20 0x7fb94c0c4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.710+0000 7fb950c07640 1 -- 172.21.15.77:0/9211048 >> 172.21.15.77:0/9211048 conn(0x7fb94c0ce950 msgr2=0x7fb94c0cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:20.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.710+0000 7fb950c07640 1 -- 172.21.15.77:0/9211048 shutdown_connections 2023-11-04T01:43:20.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.710+0000 7fb950c07640 1 -- 172.21.15.77:0/9211048 wait complete. 2023-11-04T01:43:20.723 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:43:20.723 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:43:20.724 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:43:20.724 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:43:20.724 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:43:20.724 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:43:20.725 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:43:20.725 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:43:20.725 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:43:20.725 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:43:20.726 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:43:20.726 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:43:20.726 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:43:20.726 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:43:20.727 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:43:20.727 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:43:20.733 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:43:20.734 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:43:20.734 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:43:20.735 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:43:20.738 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:43:20.738 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:43:20.739 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:43:20.739 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:43:20.775 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:43:20.776 DEBUG:teuthology.parallel:result is None 2023-11-04T01:43:20.776 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:43:20.777 DEBUG:teuthology.parallel:result is None 2023-11-04T01:43:20.780 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:43:20.780 DEBUG:teuthology.parallel:result is None 2023-11-04T01:43:20.781 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:43:20.781 DEBUG:teuthology.parallel:result is None 2023-11-04T01:43:20.782 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-04T01:43:20.851 INFO:tasks.ceph.mds.a.smithi077.stdout:starting mds.a at 2023-11-04T01:43:20.852 INFO:tasks.ceph.mds.c.smithi077.stdout:starting mds.c at 2023-11-04T01:43:20.865 INFO:tasks.ceph.mds.b.smithi122.stdout:starting mds.b at 2023-11-04T01:43:20.865 INFO:tasks.ceph.mds.d.smithi122.stdout:starting mds.d at 2023-11-04T01:43:20.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.885+0000 7fc268e44640 1 Processor -- start 2023-11-04T01:43:20.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.885+0000 7fc268e44640 1 -- start start 2023-11-04T01:43:20.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.886+0000 7fc268e44640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc2640b4880 0x7fc2640b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.886+0000 7fc268e44640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2640cde60 con 0x7fc2640cd6d0 2023-11-04T01:43:20.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.886+0000 7fc268e44640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc264160f90 con 0x7fc264153e60 2023-11-04T01:43:20.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.886+0000 7fc268e44640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2640b5200 con 0x7fc2640b4880 2023-11-04T01:43:20.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.886+0000 7fc262d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc2640b4880 0x7fc2640b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.886+0000 7fc261d9b640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc2640cd6d0 0x7fc264161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40302/0 (socket says 172.21.15.77:40302) 2023-11-04T01:43:20.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.886+0000 7fc261d9b640 1 -- 172.21.15.77:0/3318145424 learned_addr learned my addr 172.21.15.77:0/3318145424 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:20.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.886+0000 7fc262d9d640 1 -- 172.21.15.77:0/3318145424 >> v1:172.21.15.122:6789/0 conn(0x7fc264153e60 legacy=0x7fc26415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:20.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.886+0000 7fc262d9d640 1 -- 172.21.15.77:0/3318145424 >> v1:172.21.15.77:6789/0 conn(0x7fc2640cd6d0 legacy=0x7fc264161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.886+0000 7fc262d9d640 1 -- 172.21.15.77:0/3318145424 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2640ce090 con 0x7fc2640b4880 2023-11-04T01:43:20.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.887+0000 7fc262d9d640 1 --2- 172.21.15.77:0/3318145424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2640b4880 0x7fc2640b4cc0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fc25c009d90 tx=0x7fc25c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc09fa377612aa8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:20.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.887+0000 7fc26159a640 1 -- 172.21.15.77:0/3318145424 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25c02cc60 con 0x7fc2640b4880 2023-11-04T01:43:20.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.887+0000 7fc26159a640 1 -- 172.21.15.77:0/3318145424 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc25c02cdc0 con 0x7fc2640b4880 2023-11-04T01:43:20.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.887+0000 7fc26159a640 1 -- 172.21.15.77:0/3318145424 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25c034660 con 0x7fc2640b4880 2023-11-04T01:43:20.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.887+0000 7fc268e44640 1 -- 172.21.15.77:0/3318145424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2640b4880 msgr2=0x7fc2640b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.887+0000 7fc268e44640 1 --2- 172.21.15.77:0/3318145424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2640b4880 0x7fc2640b4cc0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fc25c009d90 tx=0x7fc25c02beb0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.888+0000 7fc268e44640 1 -- 172.21.15.77:0/3318145424 shutdown_connections 2023-11-04T01:43:20.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.888+0000 7fc268e44640 1 --2- 172.21.15.77:0/3318145424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2640b4880 0x7fc2640b4cc0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.888+0000 7fc268e44640 1 -- 172.21.15.77:0/3318145424 >> 172.21.15.77:0/3318145424 conn(0x7fc2640cf880 msgr2=0x7fc2640cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:20.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.888+0000 7fc268e44640 1 -- 172.21.15.77:0/3318145424 shutdown_connections 2023-11-04T01:43:20.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.888+0000 7fc268e44640 1 -- 172.21.15.77:0/3318145424 wait complete. 2023-11-04T01:43:20.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.889+0000 7fc268e44640 1 Processor -- start 2023-11-04T01:43:20.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.889+0000 7fc268e44640 1 -- start start 2023-11-04T01:43:20.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.890+0000 7fc268e44640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2640b4880 0x7fc2640c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.890+0000 7fc268e44640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2640cd6d0 0x7fc264156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.890+0000 7fc268e44640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc264153e60 0x7fc264156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.890+0000 7fc268e44640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2641560e0 con 0x7fc2640b4880 2023-11-04T01:43:20.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.890+0000 7fc268e44640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2640c8e80 con 0x7fc2640cd6d0 2023-11-04T01:43:20.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.890+0000 7fc268e44640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc264155460 con 0x7fc264153e60 2023-11-04T01:43:20.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.890+0000 7fc26259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2640b4880 0x7fc2640c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.890+0000 7fc26259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2640b4880 0x7fc2640c8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39026/0 (socket says 172.21.15.77:39026) 2023-11-04T01:43:20.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.890+0000 7fc26259c640 1 -- 172.21.15.77:0/1889434701 learned_addr learned my addr 172.21.15.77:0/1889434701 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:20.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.890+0000 7fc261d9b640 1 --2- 172.21.15.77:0/1889434701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2640cd6d0 0x7fc264156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.890+0000 7fc262d9d640 1 --2- 172.21.15.77:0/1889434701 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc264153e60 0x7fc264156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.890+0000 7fc26259c640 1 -- 172.21.15.77:0/1889434701 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc264153e60 msgr2=0x7fc264156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.890+0000 7fc26259c640 1 --2- 172.21.15.77:0/1889434701 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc264153e60 0x7fc264156cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.890+0000 7fc26259c640 1 -- 172.21.15.77:0/1889434701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2640cd6d0 msgr2=0x7fc264156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.890+0000 7fc26259c640 1 --2- 172.21.15.77:0/1889434701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2640cd6d0 0x7fc264156790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.890+0000 7fc26259c640 1 -- 172.21.15.77:0/1889434701 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc25c009a70 con 0x7fc2640b4880 2023-11-04T01:43:20.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.890+0000 7fc261d9b640 1 --2- 172.21.15.77:0/1889434701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2640cd6d0 0x7fc264156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:20.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.890+0000 7fc26259c640 1 --2- 172.21.15.77:0/1889434701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2640b4880 0x7fc2640c8940 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fc25400b3e0 tx=0x7fc25400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:20.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.894+0000 7fc252ffd640 1 -- 172.21.15.77:0/1889434701 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc254011830 con 0x7fc2640b4880 2023-11-04T01:43:20.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.894+0000 7fc268e44640 1 -- 172.21.15.77:0/1889434701 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc264155740 con 0x7fc2640b4880 2023-11-04T01:43:20.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.894+0000 7fc268e44640 1 -- 172.21.15.77:0/1889434701 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc264155d00 con 0x7fc2640b4880 2023-11-04T01:43:20.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.894+0000 7fc252ffd640 1 -- 172.21.15.77:0/1889434701 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc254009210 con 0x7fc2640b4880 2023-11-04T01:43:20.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.894+0000 7fc252ffd640 1 -- 172.21.15.77:0/1889434701 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc254011b90 con 0x7fc2640b4880 2023-11-04T01:43:20.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.895+0000 7fc268e44640 1 -- 172.21.15.77:0/1889434701 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc248005250 con 0x7fc2640b4880 2023-11-04T01:43:20.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.895+0000 7fc252ffd640 1 -- 172.21.15.77:0/1889434701 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc25401a400 con 0x7fc2640b4880 2023-11-04T01:43:20.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.896+0000 7fc252ffd640 1 --2- 172.21.15.77:0/1889434701 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc24406ae70 0x7fc24406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.896+0000 7fc252ffd640 1 -- 172.21.15.77:0/1889434701 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6354+0+0 (secure 0 0 0) 0x7fc2540899b0 con 0x7fc2640b4880 2023-11-04T01:43:20.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.896+0000 7fc261d9b640 1 --2- 172.21.15.77:0/1889434701 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc24406ae70 0x7fc24406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.896+0000 7fc261d9b640 1 --2- 172.21.15.77:0/1889434701 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc24406ae70 0x7fc24406d330 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc2640cee40 tx=0x7fc258009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:20.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:20.900+0000 7fc252ffd640 1 -- 172.21.15.77:0/1889434701 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc2540547e0 con 0x7fc2640b4880 2023-11-04T01:43:21.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:21.080+0000 7fc268e44640 1 -- 172.21.15.77:0/1889434701 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc248005500 con 0x7fc2640b4880 2023-11-04T01:43:21.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:21.910+0000 7fc252ffd640 1 -- 172.21.15.77:0/1889434701 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v92) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc254015080 con 0x7fc2640b4880 2023-11-04T01:43:21.912 INFO:teuthology.orchestra.run.smithi077.stderr: removed all blocklist entries 2023-11-04T01:43:21.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:21.912+0000 7fc268e44640 1 -- 172.21.15.77:0/1889434701 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc24406ae70 msgr2=0x7fc24406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:21.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:21.912+0000 7fc268e44640 1 --2- 172.21.15.77:0/1889434701 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc24406ae70 0x7fc24406d330 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc2640cee40 tx=0x7fc258009040 comp rx=0 tx=0).stop 2023-11-04T01:43:21.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:21.913+0000 7fc268e44640 1 -- 172.21.15.77:0/1889434701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2640b4880 msgr2=0x7fc2640c8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:21.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:21.913+0000 7fc268e44640 1 --2- 172.21.15.77:0/1889434701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2640b4880 0x7fc2640c8940 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fc25400b3e0 tx=0x7fc25400b8a0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:21.913+0000 7fc268e44640 1 -- 172.21.15.77:0/1889434701 shutdown_connections 2023-11-04T01:43:21.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:21.913+0000 7fc268e44640 1 --2- 172.21.15.77:0/1889434701 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc24406ae70 0x7fc24406d330 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:21.913+0000 7fc268e44640 1 --2- 172.21.15.77:0/1889434701 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc264153e60 0x7fc264156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:21.913+0000 7fc268e44640 1 --2- 172.21.15.77:0/1889434701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2640cd6d0 0x7fc264156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:21.913+0000 7fc268e44640 1 --2- 172.21.15.77:0/1889434701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2640b4880 0x7fc2640c8940 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:21.913+0000 7fc268e44640 1 -- 172.21.15.77:0/1889434701 >> 172.21.15.77:0/1889434701 conn(0x7fc2640cf880 msgr2=0x7fc26415afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:21.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:21.913+0000 7fc268e44640 1 -- 172.21.15.77:0/1889434701 shutdown_connections 2023-11-04T01:43:21.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:21.913+0000 7fc268e44640 1 -- 172.21.15.77:0/1889434701 wait complete. 2023-11-04T01:43:21.928 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-04T01:43:22.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.031+0000 7fbe5e4c2640 1 Processor -- start 2023-11-04T01:43:22.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.031+0000 7fbe5e4c2640 1 -- start start 2023-11-04T01:43:22.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.031+0000 7fbe5e4c2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbe580ce370 0x7fbe5806db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:22.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.031+0000 7fbe5e4c2640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe5806e060 con 0x7fbe580b0ae0 2023-11-04T01:43:22.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.031+0000 7fbe5e4c2640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe580b4110 con 0x7fbe58159c70 2023-11-04T01:43:22.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.031+0000 7fbe5e4c2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe580b49b0 con 0x7fbe580ce370 2023-11-04T01:43:22.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.032+0000 7fbe577fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fbe580b0ae0 0x7fbe5815d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40318/0 (socket says 172.21.15.77:40318) 2023-11-04T01:43:22.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.032+0000 7fbe577fe640 1 -- 172.21.15.77:0/1396736720 learned_addr learned my addr 172.21.15.77:0/1396736720 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:22.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.032+0000 7fbe56ffd640 1 -- 172.21.15.77:0/1396736720 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2686011649 0 0) 0x7fbe5806e060 con 0x7fbe580b0ae0 2023-11-04T01:43:22.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.032+0000 7fbe56ffd640 1 -- 172.21.15.77:0/1396736720 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe40003520 con 0x7fbe580b0ae0 2023-11-04T01:43:22.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.032+0000 7fbe5ca5f640 1 --2- 172.21.15.77:0/1396736720 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbe580ce370 0x7fbe5806db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:22.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.032+0000 7fbe56ffd640 1 -- 172.21.15.77:0/1396736720 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3385624904 0 0) 0x7fbe40003520 con 0x7fbe580b0ae0 2023-11-04T01:43:22.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.032+0000 7fbe56ffd640 1 -- 172.21.15.77:0/1396736720 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbe580ce370 msgr2=0x7fbe5806db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:22.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.032+0000 7fbe56ffd640 1 --2- 172.21.15.77:0/1396736720 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbe580ce370 0x7fbe5806db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.032+0000 7fbe56ffd640 1 -- 172.21.15.77:0/1396736720 >> v1:172.21.15.122:6789/0 conn(0x7fbe58159c70 legacy=0x7fbe580b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.032+0000 7fbe56ffd640 1 -- 172.21.15.77:0/1396736720 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe580b43f0 con 0x7fbe580b0ae0 2023-11-04T01:43:22.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.032+0000 7fbe56ffd640 1 -- 172.21.15.77:0/1396736720 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7fbe4c001670 con 0x7fbe580b0ae0 2023-11-04T01:43:22.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.032+0000 7fbe56ffd640 1 -- 172.21.15.77:0/1396736720 >> v1:172.21.15.77:6789/0 conn(0x7fbe580b0ae0 legacy=0x7fbe5815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.032+0000 7fbe56ffd640 1 --2- 172.21.15.77:0/1396736720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe400039a0 0x7fbe40003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:22.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.032+0000 7fbe56ffd640 1 --2- 172.21.15.77:0/1396736720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe400047c0 0x7fbe40004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:22.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.032+0000 7fbe56ffd640 1 --2- 172.21.15.77:0/1396736720 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbe580ce370 0x7fbe40005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:22.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.032+0000 7fbe56ffd640 1 -- 172.21.15.77:0/1396736720 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe580b49b0 con 0x7fbe400039a0 2023-11-04T01:43:22.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.032+0000 7fbe56ffd640 1 -- 172.21.15.77:0/1396736720 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4000dc40 con 0x7fbe400047c0 2023-11-04T01:43:22.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.032+0000 7fbe56ffd640 1 -- 172.21.15.77:0/1396736720 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4000de00 con 0x7fbe580ce370 2023-11-04T01:43:22.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.032+0000 7fbe57fff640 1 --2- 172.21.15.77:0/1396736720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe400039a0 0x7fbe40003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:22.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.032+0000 7fbe577fe640 1 --2- 172.21.15.77:0/1396736720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe400047c0 0x7fbe40004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:22.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.032+0000 7fbe5ca5f640 1 --2- 172.21.15.77:0/1396736720 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbe580ce370 0x7fbe40005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:22.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.033+0000 7fbe57fff640 1 -- 172.21.15.77:0/1396736720 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbe580ce370 msgr2=0x7fbe40005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:22.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.033+0000 7fbe57fff640 1 --2- 172.21.15.77:0/1396736720 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbe580ce370 0x7fbe40005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.033+0000 7fbe57fff640 1 -- 172.21.15.77:0/1396736720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe400047c0 msgr2=0x7fbe40004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:22.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.033+0000 7fbe57fff640 1 --2- 172.21.15.77:0/1396736720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe400047c0 0x7fbe40004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.033+0000 7fbe57fff640 1 -- 172.21.15.77:0/1396736720 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe40003520 con 0x7fbe400039a0 2023-11-04T01:43:22.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.033+0000 7fbe577fe640 1 --2- 172.21.15.77:0/1396736720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe400047c0 0x7fbe40004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:22.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.033+0000 7fbe57fff640 1 --2- 172.21.15.77:0/1396736720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe400039a0 0x7fbe40003dc0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fbe48001720 tx=0x7fbe400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a4ead96fdc9c08 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:22.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.033+0000 7fbe56ffd640 1 -- 172.21.15.77:0/1396736720 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe480052d0 con 0x7fbe400039a0 2023-11-04T01:43:22.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.033+0000 7fbe56ffd640 1 -- 172.21.15.77:0/1396736720 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4802e050 con 0x7fbe400039a0 2023-11-04T01:43:22.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.033+0000 7fbe56ffd640 1 -- 172.21.15.77:0/1396736720 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe480035f0 con 0x7fbe400039a0 2023-11-04T01:43:22.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.034+0000 7fbe5e4c2640 1 -- 172.21.15.77:0/1396736720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe400039a0 msgr2=0x7fbe40003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.034+0000 7fbe5e4c2640 1 --2- 172.21.15.77:0/1396736720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe400039a0 0x7fbe40003dc0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fbe48001720 tx=0x7fbe400057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.034+0000 7fbe5ca5f640 1 -- 172.21.15.77:0/1396736720 reap_dead start 2023-11-04T01:43:22.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.034+0000 7fbe5e4c2640 1 -- 172.21.15.77:0/1396736720 shutdown_connections 2023-11-04T01:43:22.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.034+0000 7fbe5e4c2640 1 -- 172.21.15.77:0/1396736720 >> 172.21.15.77:0/1396736720 conn(0x7fbe580ce950 msgr2=0x7fbe580ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:22.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.034+0000 7fbe5e4c2640 1 -- 172.21.15.77:0/1396736720 shutdown_connections 2023-11-04T01:43:22.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.034+0000 7fbe5e4c2640 1 -- 172.21.15.77:0/1396736720 wait complete. 2023-11-04T01:43:22.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.035+0000 7fbe5e4c2640 1 Processor -- start 2023-11-04T01:43:22.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.035+0000 7fbe5e4c2640 1 -- start start 2023-11-04T01:43:22.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.036+0000 7fbe5e4c2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe400039a0 0x7fbe580c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:22.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.036+0000 7fbe5e4c2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbe58156c90 0x7fbe58157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:22.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.036+0000 7fbe5e4c2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe580c7910 0x7fbe580c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:22.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.036+0000 7fbe5e4c2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe580c6530 con 0x7fbe580c7910 2023-11-04T01:43:22.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.036+0000 7fbe5e4c2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe58157650 con 0x7fbe400039a0 2023-11-04T01:43:22.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.036+0000 7fbe5e4c2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe580c86b0 con 0x7fbe58156c90 2023-11-04T01:43:22.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.036+0000 7fbe5ca5f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe580c7910 0x7fbe580c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:22.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.036+0000 7fbe5ca5f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe580c7910 0x7fbe580c7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39046/0 (socket says 172.21.15.77:39046) 2023-11-04T01:43:22.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.036+0000 7fbe5ca5f640 1 -- 172.21.15.77:0/3921355106 learned_addr learned my addr 172.21.15.77:0/3921355106 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:22.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.036+0000 7fbe5ca5f640 1 -- 172.21.15.77:0/3921355106 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbe58156c90 msgr2=0x7fbe58157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.036+0000 7fbe5ca5f640 1 --2- 172.21.15.77:0/3921355106 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbe58156c90 0x7fbe58157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.036+0000 7fbe5ca5f640 1 -- 172.21.15.77:0/3921355106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe400039a0 msgr2=0x7fbe580c4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.036+0000 7fbe5ca5f640 1 --2- 172.21.15.77:0/3921355106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe400039a0 0x7fbe580c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.036+0000 7fbe5ca5f640 1 -- 172.21.15.77:0/3921355106 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe581e3c30 con 0x7fbe580c7910 2023-11-04T01:43:22.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.037+0000 7fbe5ca5f640 1 --2- 172.21.15.77:0/3921355106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe580c7910 0x7fbe580c7d90 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fbe580cf6e0 tx=0x7fbe5000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:22.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.037+0000 7fbe54ff9640 1 -- 172.21.15.77:0/3921355106 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5000e040 con 0x7fbe580c7910 2023-11-04T01:43:22.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.037+0000 7fbe54ff9640 1 -- 172.21.15.77:0/3921355106 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5000f040 con 0x7fbe580c7910 2023-11-04T01:43:22.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.037+0000 7fbe5e4c2640 1 -- 172.21.15.77:0/3921355106 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe581e3f10 con 0x7fbe580c7910 2023-11-04T01:43:22.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.037+0000 7fbe54ff9640 1 -- 172.21.15.77:0/3921355106 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe50015670 con 0x7fbe580c7910 2023-11-04T01:43:22.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.037+0000 7fbe5e4c2640 1 -- 172.21.15.77:0/3921355106 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe581e44d0 con 0x7fbe580c7910 2023-11-04T01:43:22.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.038+0000 7fbe5e4c2640 1 -- 172.21.15.77:0/3921355106 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe58074290 con 0x7fbe580c7910 2023-11-04T01:43:22.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.038+0000 7fbe54ff9640 1 -- 172.21.15.77:0/3921355106 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbe500157d0 con 0x7fbe580c7910 2023-11-04T01:43:22.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.038+0000 7fbe54ff9640 1 --2- 172.21.15.77:0/3921355106 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbe4406ae70 0x7fbe4406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:22.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.039+0000 7fbe54ff9640 1 -- 172.21.15.77:0/3921355106 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6268+0+0 (secure 0 0 0) 0x7fbe50089fd0 con 0x7fbe580c7910 2023-11-04T01:43:22.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.039+0000 7fbe57fff640 1 --2- 172.21.15.77:0/3921355106 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbe4406ae70 0x7fbe4406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:22.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.039+0000 7fbe57fff640 1 --2- 172.21.15.77:0/3921355106 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbe4406ae70 0x7fbe4406d330 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fbe48033000 tx=0x7fbe4802f000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:22.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.043+0000 7fbe54ff9640 1 -- 172.21.15.77:0/3921355106 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbe50054e50 con 0x7fbe580c7910 2023-11-04T01:43:22.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.272+0000 7fbe5e4c2640 1 -- 172.21.15.77:0/3921355106 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fbe580cbb90 con 0x7fbe580c7910 2023-11-04T01:43:22.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.272+0000 7fbe54ff9640 1 -- 172.21.15.77:0/3921355106 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fbe50058470 con 0x7fbe580c7910 2023-11-04T01:43:22.274 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:43:22.275 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-04T01:43:22.275 INFO:teuthology.orchestra.run.smithi077.stdout: "auth_dump": [ 2023-11-04T01:43:22.275 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:43:22.276 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.a", 2023-11-04T01:43:22.276 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC1oEVl/r6uOhAA9u5Hcsr4T+QfSgBmS6M2Cw==", 2023-11-04T01:43:22.276 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:43:22.276 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:43:22.276 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-04T01:43:22.276 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-04T01:43:22.277 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:43:22.277 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:43:22.277 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:43:22.277 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:43:22.277 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.b", 2023-11-04T01:43:22.278 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC2oEVlOr56CxAAxOke25BrKTy0Vozn/aPYVw==", 2023-11-04T01:43:22.278 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:43:22.278 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:43:22.278 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-04T01:43:22.278 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-04T01:43:22.279 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:43:22.279 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:43:22.279 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:43:22.279 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:43:22.279 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.c", 2023-11-04T01:43:22.280 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC2oEVlvLxtBhAAuxQpEPrSlVc/YBdqJJn7iA==", 2023-11-04T01:43:22.280 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:43:22.280 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:43:22.280 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-04T01:43:22.280 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-04T01:43:22.281 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:43:22.281 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:43:22.281 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:43:22.281 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:43:22.281 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.d", 2023-11-04T01:43:22.281 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC2oEVlB3PUEhAA0GaPLq/SwHPPHriYNnan9w==", 2023-11-04T01:43:22.282 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:43:22.282 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:43:22.282 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-04T01:43:22.282 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-04T01:43:22.282 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:43:22.283 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:43:22.283 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:43:22.283 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:43:22.283 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.0", 2023-11-04T01:43:22.283 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC5oEVl4pfcMxAATPwL4pgDM0ywnmsufp74lw==", 2023-11-04T01:43:22.283 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:43:22.284 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:43:22.284 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:43:22.284 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:43:22.284 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:43:22.284 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:43:22.284 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:43:22.285 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.1", 2023-11-04T01:43:22.285 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC8oEVl+qN4MhAAXZweqA2M4vvc4B04adonzQ==", 2023-11-04T01:43:22.285 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:43:22.285 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:43:22.285 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:43:22.286 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:43:22.286 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:43:22.286 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:43:22.286 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:43:22.286 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.2", 2023-11-04T01:43:22.287 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC/oEVlRuD4MBAAQPQL0SzC7Cj9bzR/Cj+maA==", 2023-11-04T01:43:22.287 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:43:22.287 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:43:22.287 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:43:22.287 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:43:22.287 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:43:22.288 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:43:22.288 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:43:22.288 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.3", 2023-11-04T01:43:22.288 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDCoEVlDO4fLxAASTTEpVp1dzEEci56OfSEMA==", 2023-11-04T01:43:22.288 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:43:22.289 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:43:22.289 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:43:22.289 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:43:22.289 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:43:22.289 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:43:22.290 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:43:22.290 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.4", 2023-11-04T01:43:22.290 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDIoEVlQGrxOBAACkSdOwyqhcMBPhXbpdXFKw==", 2023-11-04T01:43:22.290 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:43:22.290 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:43:22.291 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:43:22.291 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:43:22.291 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:43:22.291 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:43:22.291 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:43:22.291 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.5", 2023-11-04T01:43:22.292 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDLoEVlTrCoNhAAoLM/rpHPTO6H6eXr8so/pA==", 2023-11-04T01:43:22.292 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:43:22.292 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:43:22.292 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:43:22.292 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:43:22.293 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:43:22.293 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:43:22.293 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:43:22.293 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.6", 2023-11-04T01:43:22.293 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDOoEVlb81bNRAAp8gIPrPxc9T8yp9Z8JJm8g==", 2023-11-04T01:43:22.293 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:43:22.294 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:43:22.294 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:43:22.294 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:43:22.294 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:43:22.294 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:43:22.295 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:43:22.295 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.7", 2023-11-04T01:43:22.295 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDRoEVl2aM/NBAAbi6ZxsZ51qe78O1oaSpF8Q==", 2023-11-04T01:43:22.295 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:43:22.295 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-11-04T01:43:22.296 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-11-04T01:43:22.296 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:43:22.296 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:43:22.296 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:43:22.296 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:43:22.296 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.0", 2023-11-04T01:43:22.297 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC2oEVlChU2FxAAt1/aJZOrufjVZhraPqv1Gw==", 2023-11-04T01:43:22.297 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:43:22.297 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:43:22.297 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow r", 2023-11-04T01:43:22.297 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-04T01:43:22.297 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:43:22.298 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:43:22.298 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:43:22.298 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.1", 2023-11-04T01:43:22.298 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC2oEVlVY9FIBAAUiGoYvAgEDfoAKIJ9e/SOg==", 2023-11-04T01:43:22.299 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:43:22.299 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:43:22.299 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-11-04T01:43:22.299 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-11-04T01:43:22.299 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-11-04T01:43:22.300 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:43:22.300 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:43:22.300 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:43:22.300 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.2", 2023-11-04T01:43:22.300 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC2oEVliWLuHBAA7ElluXYK9/XvMXk4S1njJw==", 2023-11-04T01:43:22.301 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:43:22.301 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:43:22.301 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-11-04T01:43:22.301 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-11-04T01:43:22.301 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-11-04T01:43:22.301 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:43:22.302 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:43:22.302 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:43:22.302 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.3", 2023-11-04T01:43:22.302 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC2oEVlQ3QIJhAA5Fq/oI3qpJseGhwXV66eMA==", 2023-11-04T01:43:22.302 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:43:22.303 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-11-04T01:43:22.303 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-11-04T01:43:22.303 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-11-04T01:43:22.303 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-11-04T01:43:22.303 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:43:22.304 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:43:22.304 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:43:22.304 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.admin", 2023-11-04T01:43:22.304 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC1oEVlhrFGHhAA5nkKwuaaUv+zDDAG4XaBRQ==", 2023-11-04T01:43:22.304 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:43:22.304 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow *", 2023-11-04T01:43:22.305 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-11-04T01:43:22.305 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-11-04T01:43:22.305 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:43:22.305 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:43:22.305 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:43:22.305 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:43:22.306 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mgr.x", 2023-11-04T01:43:22.306 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC1oEVlvoNGNxAAB5/uyqV4Pf/HdyGcr8rVdw==", 2023-11-04T01:43:22.306 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:43:22.306 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow *", 2023-11-04T01:43:22.306 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile mgr", 2023-11-04T01:43:22.306 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:43:22.307 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:43:22.307 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:43:22.307 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:43:22.307 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mgr.y", 2023-11-04T01:43:22.307 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQC1oEVlXDKNMxAAVhq0CA3RveLfU4A6oIO4jQ==", 2023-11-04T01:43:22.308 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-11-04T01:43:22.308 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow *", 2023-11-04T01:43:22.308 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile mgr", 2023-11-04T01:43:22.308 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-11-04T01:43:22.308 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:43:22.308 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:43:22.309 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2023-11-04T01:43:22.309 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-04T01:43:22.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.274+0000 7fbe5e4c2640 1 -- 172.21.15.77:0/3921355106 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbe4406ae70 msgr2=0x7fbe4406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.274+0000 7fbe5e4c2640 1 --2- 172.21.15.77:0/3921355106 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbe4406ae70 0x7fbe4406d330 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fbe48033000 tx=0x7fbe4802f000 comp rx=0 tx=0).stop 2023-11-04T01:43:22.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.274+0000 7fbe5e4c2640 1 -- 172.21.15.77:0/3921355106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe580c7910 msgr2=0x7fbe580c7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.274+0000 7fbe5e4c2640 1 --2- 172.21.15.77:0/3921355106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe580c7910 0x7fbe580c7d90 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fbe580cf6e0 tx=0x7fbe5000f580 comp rx=0 tx=0).stop 2023-11-04T01:43:22.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.275+0000 7fbe5e4c2640 1 -- 172.21.15.77:0/3921355106 shutdown_connections 2023-11-04T01:43:22.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.275+0000 7fbe5e4c2640 1 --2- 172.21.15.77:0/3921355106 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbe4406ae70 0x7fbe4406d330 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.275+0000 7fbe5e4c2640 1 --2- 172.21.15.77:0/3921355106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe580c7910 0x7fbe580c7d90 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.275+0000 7fbe5e4c2640 1 --2- 172.21.15.77:0/3921355106 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbe58156c90 0x7fbe58157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.275+0000 7fbe5e4c2640 1 --2- 172.21.15.77:0/3921355106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe400039a0 0x7fbe580c4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.275+0000 7fbe5e4c2640 1 -- 172.21.15.77:0/3921355106 >> 172.21.15.77:0/3921355106 conn(0x7fbe580ce950 msgr2=0x7fbe580b1570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:22.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.275+0000 7fbe5e4c2640 1 -- 172.21.15.77:0/3921355106 shutdown_connections 2023-11-04T01:43:22.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.275+0000 7fbe5e4c2640 1 -- 172.21.15.77:0/3921355106 wait complete. 2023-11-04T01:43:22.313 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:22.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.412+0000 7fd9f486f640 1 Processor -- start 2023-11-04T01:43:22.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.412+0000 7fd9f486f640 1 -- start start 2023-11-04T01:43:22.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.413+0000 7fd9f486f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd9f015d250 0x7fd9f00c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:22.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.413+0000 7fd9f486f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f006a120 con 0x7fd9f00c9d70 2023-11-04T01:43:22.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.413+0000 7fd9f486f640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f006a370 con 0x7fd9f015ce70 2023-11-04T01:43:22.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.413+0000 7fd9f486f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9f00cdc10 con 0x7fd9f015d250 2023-11-04T01:43:22.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.413+0000 7fd9e7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd9f015d250 0x7fd9f00c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:22.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.413+0000 7fd9eed9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd9f00c9d70 0x7fd9f00ccdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40328/0 (socket says 172.21.15.77:40328) 2023-11-04T01:43:22.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.413+0000 7fd9eed9d640 1 -- 172.21.15.77:0/3829522735 learned_addr learned my addr 172.21.15.77:0/3829522735 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:22.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.413+0000 7fd9e7fff640 1 -- 172.21.15.77:0/3829522735 >> v1:172.21.15.122:6789/0 conn(0x7fd9f015ce70 legacy=0x7fd9f006d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:22.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.413+0000 7fd9e7fff640 1 -- 172.21.15.77:0/3829522735 >> v1:172.21.15.77:6789/0 conn(0x7fd9f00c9d70 legacy=0x7fd9f00ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.413+0000 7fd9e7fff640 1 -- 172.21.15.77:0/3829522735 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f006a650 con 0x7fd9f015d250 2023-11-04T01:43:22.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.413+0000 7fd9edd9b640 1 -- 172.21.15.77:0/3829522735 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 268809721 0 0) 0x7fd9f006a120 con 0x7fd9f00c9d70 2023-11-04T01:43:22.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.414+0000 7fd9e7fff640 1 --2- 172.21.15.77:0/3829522735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9f015d250 0x7fd9f00c9830 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fd9d80097a0 tx=0x7fd9d802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f939236647a580e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:22.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.414+0000 7fd9edd9b640 1 -- 172.21.15.77:0/3829522735 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d8031830 con 0x7fd9f015d250 2023-11-04T01:43:22.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.414+0000 7fd9edd9b640 1 -- 172.21.15.77:0/3829522735 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d8031990 con 0x7fd9f015d250 2023-11-04T01:43:22.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.414+0000 7fd9edd9b640 1 -- 172.21.15.77:0/3829522735 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d8031d20 con 0x7fd9f015d250 2023-11-04T01:43:22.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.415+0000 7fd9f486f640 1 -- 172.21.15.77:0/3829522735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9f015d250 msgr2=0x7fd9f00c9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.415+0000 7fd9f486f640 1 --2- 172.21.15.77:0/3829522735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9f015d250 0x7fd9f00c9830 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fd9d80097a0 tx=0x7fd9d802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.415+0000 7fd9f486f640 1 -- 172.21.15.77:0/3829522735 shutdown_connections 2023-11-04T01:43:22.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.415+0000 7fd9f486f640 1 --2- 172.21.15.77:0/3829522735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9f015d250 0x7fd9f00c9830 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.415+0000 7fd9f486f640 1 -- 172.21.15.77:0/3829522735 >> 172.21.15.77:0/3829522735 conn(0x7fd9f00b0cd0 msgr2=0x7fd9f00b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:22.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.415+0000 7fd9f486f640 1 -- 172.21.15.77:0/3829522735 shutdown_connections 2023-11-04T01:43:22.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.415+0000 7fd9f486f640 1 -- 172.21.15.77:0/3829522735 wait complete. 2023-11-04T01:43:22.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.416+0000 7fd9f486f640 1 Processor -- start 2023-11-04T01:43:22.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.416+0000 7fd9f486f640 1 -- start start 2023-11-04T01:43:22.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.417+0000 7fd9f486f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9f015ce70 0x7fd9f01462c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:22.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.417+0000 7fd9f486f640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd9f015d250 0x7fd9f0148bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:22.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.417+0000 7fd9f486f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9f00adac0 0x7fd9f00c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:22.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.417+0000 7fd9f486f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f0147000 con 0x7fd9f015ce70 2023-11-04T01:43:22.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.417+0000 7fd9f486f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f01494b0 con 0x7fd9f00adac0 2023-11-04T01:43:22.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.417+0000 7fd9f486f640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f0149790 con 0x7fd9f015d250 2023-11-04T01:43:22.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.417+0000 7fd9ee59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9f015ce70 0x7fd9f01462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:22.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.417+0000 7fd9ee59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9f015ce70 0x7fd9f01462c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39074/0 (socket says 172.21.15.77:39074) 2023-11-04T01:43:22.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.417+0000 7fd9ee59c640 1 -- 172.21.15.77:0/1148351600 learned_addr learned my addr 172.21.15.77:0/1148351600 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:22.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.417+0000 7fd9ee59c640 1 -- 172.21.15.77:0/1148351600 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd9f015d250 msgr2=0x7fd9f0148bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.417+0000 7fd9ee59c640 1 --2- 172.21.15.77:0/1148351600 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd9f015d250 0x7fd9f0148bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.417+0000 7fd9ee59c640 1 -- 172.21.15.77:0/1148351600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9f00adac0 msgr2=0x7fd9f00c62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.417+0000 7fd9eed9d640 1 --2- 172.21.15.77:0/1148351600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9f00adac0 0x7fd9f00c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:22.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.417+0000 7fd9ee59c640 1 --2- 172.21.15.77:0/1148351600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9f00adac0 0x7fd9f00c62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.417+0000 7fd9ee59c640 1 -- 172.21.15.77:0/1148351600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d8009400 con 0x7fd9f015ce70 2023-11-04T01:43:22.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.417+0000 7fd9ee59c640 1 --2- 172.21.15.77:0/1148351600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9f015ce70 0x7fd9f01462c0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fd9e000c410 tx=0x7fd9e000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:22.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.417+0000 7fd9e6ffd640 1 -- 172.21.15.77:0/1148351600 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e00035f0 con 0x7fd9f015ce70 2023-11-04T01:43:22.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.417+0000 7fd9e6ffd640 1 -- 172.21.15.77:0/1148351600 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e0003750 con 0x7fd9f015ce70 2023-11-04T01:43:22.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.417+0000 7fd9e6ffd640 1 -- 172.21.15.77:0/1148351600 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e0003b40 con 0x7fd9f015ce70 2023-11-04T01:43:22.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.417+0000 7fd9f486f640 1 -- 172.21.15.77:0/1148351600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9f0149a70 con 0x7fd9f015ce70 2023-11-04T01:43:22.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.417+0000 7fd9f486f640 1 -- 172.21.15.77:0/1148351600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f0146800 con 0x7fd9f015ce70 2023-11-04T01:43:22.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.418+0000 7fd9f486f640 1 -- 172.21.15.77:0/1148351600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9f0147140 con 0x7fd9f015ce70 2023-11-04T01:43:22.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.419+0000 7fd9e6ffd640 1 -- 172.21.15.77:0/1148351600 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd9e0003ca0 con 0x7fd9f015ce70 2023-11-04T01:43:22.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.419+0000 7fd9e6ffd640 1 --2- 172.21.15.77:0/1148351600 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd9d006ae70 0x7fd9d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:22.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.419+0000 7fd9e6ffd640 1 -- 172.21.15.77:0/1148351600 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6268+0+0 (secure 0 0 0) 0x7fd9e00889f0 con 0x7fd9f015ce70 2023-11-04T01:43:22.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.419+0000 7fd9e7fff640 1 --2- 172.21.15.77:0/1148351600 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd9d006ae70 0x7fd9d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:22.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.420+0000 7fd9e7fff640 1 --2- 172.21.15.77:0/1148351600 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd9d006ae70 0x7fd9d006d330 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8036000 tx=0x7fd9d8030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:22.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.423+0000 7fd9e6ffd640 1 -- 172.21.15.77:0/1148351600 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd9f0147140 con 0x7fd9f015ce70 2023-11-04T01:43:22.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.592+0000 7fd9f486f640 1 -- 172.21.15.77:0/1148351600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9f0147140 con 0x7fd9f015ce70 2023-11-04T01:43:22.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.593+0000 7fd9e6ffd640 1 -- 172.21.15.77:0/1148351600 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+18335 (secure 0 0 0) 0x7fd9f0147140 con 0x7fd9f015ce70 2023-11-04T01:43:22.595 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:43:22.596 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":92,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:43:21.909744+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:33.159064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:33.647358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:22.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.595+0000 7fd9f486f640 1 -- 172.21.15.77:0/1148351600 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd9d006ae70 msgr2=0x7fd9d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.595+0000 7fd9f486f640 1 --2- 172.21.15.77:0/1148351600 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd9d006ae70 0x7fd9d006d330 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8036000 tx=0x7fd9d8030000 comp rx=0 tx=0).stop 2023-11-04T01:43:22.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.595+0000 7fd9f486f640 1 -- 172.21.15.77:0/1148351600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9f015ce70 msgr2=0x7fd9f01462c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.595+0000 7fd9f486f640 1 --2- 172.21.15.77:0/1148351600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9f015ce70 0x7fd9f01462c0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fd9e000c410 tx=0x7fd9e000c8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.595+0000 7fd9f486f640 1 -- 172.21.15.77:0/1148351600 shutdown_connections 2023-11-04T01:43:22.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.595+0000 7fd9f486f640 1 --2- 172.21.15.77:0/1148351600 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd9d006ae70 0x7fd9d006d330 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.595+0000 7fd9f486f640 1 --2- 172.21.15.77:0/1148351600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9f00adac0 0x7fd9f00c62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.595+0000 7fd9f486f640 1 --2- 172.21.15.77:0/1148351600 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd9f015d250 0x7fd9f0148bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.595+0000 7fd9f486f640 1 --2- 172.21.15.77:0/1148351600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9f015ce70 0x7fd9f01462c0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.595+0000 7fd9f486f640 1 -- 172.21.15.77:0/1148351600 >> 172.21.15.77:0/1148351600 conn(0x7fd9f00b0cd0 msgr2=0x7fd9f01e8640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:22.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.595+0000 7fd9f486f640 1 -- 172.21.15.77:0/1148351600 shutdown_connections 2023-11-04T01:43:22.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.595+0000 7fd9f486f640 1 -- 172.21.15.77:0/1148351600 wait complete. 2023-11-04T01:43:22.607 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:33.142176+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:42:33.159064+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:42:33.647358+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:43:22.608 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:43:22.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.709+0000 7f0e35010640 1 Processor -- start 2023-11-04T01:43:22.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.709+0000 7f0e35010640 1 -- start start 2023-11-04T01:43:22.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.710+0000 7f0e35010640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e3015d050 0x7f0e30161440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:22.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.710+0000 7f0e35010640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0e3006b730 0x7f0e3006e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:22.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.710+0000 7f0e35010640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e30161980 con 0x7f0e3006a120 2023-11-04T01:43:22.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.710+0000 7f0e35010640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e3006f960 con 0x7f0e3006b730 2023-11-04T01:43:22.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.710+0000 7f0e35010640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e300caad0 con 0x7f0e3015d050 2023-11-04T01:43:22.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.710+0000 7f0e2659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0e3006b730 0x7f0e3006e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:22.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.710+0000 7f0e2659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0e3006b730 0x7f0e3006e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39088/0 (socket says 172.21.15.77:39088) 2023-11-04T01:43:22.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.710+0000 7f0e2659c640 1 -- 172.21.15.77:0/776503339 learned_addr learned my addr 172.21.15.77:0/776503339 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:22.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.710+0000 7f0e2ed9d640 1 --2- 172.21.15.77:0/776503339 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e3015d050 0x7f0e30161440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:22.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.710+0000 7f0e2659c640 1 -- 172.21.15.77:0/776503339 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e3015d050 msgr2=0x7f0e30161440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:22.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.710+0000 7f0e2659c640 1 --2- 172.21.15.77:0/776503339 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e3015d050 0x7f0e30161440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.710+0000 7f0e2659c640 1 -- 172.21.15.77:0/776503339 >> v1:172.21.15.122:6789/0 conn(0x7f0e3006a120 legacy=0x7f0e300cd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:22.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.710+0000 7f0e2659c640 1 -- 172.21.15.77:0/776503339 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3006a690 con 0x7f0e3006b730 2023-11-04T01:43:22.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.711+0000 7f0e2659c640 1 --2- 172.21.15.77:0/776503339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e3006b730 0x7f0e3006e2b0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009870 tx=0x7f0e1802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22a729830e90afb6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:22.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.711+0000 7f0e2e59c640 1 -- 172.21.15.77:0/776503339 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e18031640 con 0x7f0e3006b730 2023-11-04T01:43:22.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.711+0000 7f0e2e59c640 1 -- 172.21.15.77:0/776503339 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e180317a0 con 0x7f0e3006b730 2023-11-04T01:43:22.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.711+0000 7f0e2e59c640 1 -- 172.21.15.77:0/776503339 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e18031b30 con 0x7f0e3006b730 2023-11-04T01:43:22.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.712+0000 7f0e35010640 1 -- 172.21.15.77:0/776503339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e3006b730 msgr2=0x7f0e3006e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.712+0000 7f0e35010640 1 --2- 172.21.15.77:0/776503339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e3006b730 0x7f0e3006e2b0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009870 tx=0x7f0e1802b8f0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.712+0000 7f0e35010640 1 -- 172.21.15.77:0/776503339 shutdown_connections 2023-11-04T01:43:22.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.712+0000 7f0e35010640 1 --2- 172.21.15.77:0/776503339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e3006b730 0x7f0e3006e2b0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.712+0000 7f0e35010640 1 --2- 172.21.15.77:0/776503339 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e3015d050 0x7f0e30161440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.712+0000 7f0e35010640 1 -- 172.21.15.77:0/776503339 >> 172.21.15.77:0/776503339 conn(0x7f0e3006cd70 msgr2=0x7f0e3006d180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:22.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.712+0000 7f0e35010640 1 -- 172.21.15.77:0/776503339 shutdown_connections 2023-11-04T01:43:22.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.712+0000 7f0e35010640 1 -- 172.21.15.77:0/776503339 wait complete. 2023-11-04T01:43:22.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.713+0000 7f0e35010640 1 Processor -- start 2023-11-04T01:43:22.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.713+0000 7f0e35010640 1 -- start start 2023-11-04T01:43:22.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.714+0000 7f0e35010640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e3006a120 0x7f0e30147420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:22.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.714+0000 7f0e35010640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e3006b730 0x7f0e300c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:22.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.714+0000 7f0e35010640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e3015d050 0x7f0e30152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:22.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.714+0000 7f0e35010640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e300c7580 con 0x7f0e3006a120 2023-11-04T01:43:22.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.714+0000 7f0e35010640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e300c6c20 con 0x7f0e3006b730 2023-11-04T01:43:22.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.714+0000 7f0e35010640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e300c6ec0 con 0x7f0e3015d050 2023-11-04T01:43:22.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.714+0000 7f0e2ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e3006a120 0x7f0e30147420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:22.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.714+0000 7f0e2ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e3006a120 0x7f0e30147420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39102/0 (socket says 172.21.15.77:39102) 2023-11-04T01:43:22.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.714+0000 7f0e2ed9d640 1 -- 172.21.15.77:0/2398700962 learned_addr learned my addr 172.21.15.77:0/2398700962 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:22.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.714+0000 7f0e2659c640 1 --2- 172.21.15.77:0/2398700962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e3006b730 0x7f0e300c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:22.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.714+0000 7f0e2f59e640 1 --2- 172.21.15.77:0/2398700962 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e3015d050 0x7f0e30152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:22.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.714+0000 7f0e2ed9d640 1 -- 172.21.15.77:0/2398700962 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e3015d050 msgr2=0x7f0e30152330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.714+0000 7f0e2ed9d640 1 --2- 172.21.15.77:0/2398700962 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e3015d050 0x7f0e30152330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.714+0000 7f0e2ed9d640 1 -- 172.21.15.77:0/2398700962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e3006b730 msgr2=0x7f0e300c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.714+0000 7f0e2ed9d640 1 --2- 172.21.15.77:0/2398700962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e3006b730 0x7f0e300c4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.714+0000 7f0e2ed9d640 1 -- 172.21.15.77:0/2398700962 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e180094d0 con 0x7f0e3006a120 2023-11-04T01:43:22.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.714+0000 7f0e2f59e640 1 --2- 172.21.15.77:0/2398700962 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e3015d050 0x7f0e30152330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:22.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.714+0000 7f0e2ed9d640 1 --2- 172.21.15.77:0/2398700962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e3006a120 0x7f0e30147420 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f0e2000d5f0 tx=0x7f0e2000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:22.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.715+0000 7f0e27fff640 1 -- 172.21.15.77:0/2398700962 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e200125f0 con 0x7f0e3006a120 2023-11-04T01:43:22.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.715+0000 7f0e27fff640 1 -- 172.21.15.77:0/2398700962 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e20012750 con 0x7f0e3006a120 2023-11-04T01:43:22.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.715+0000 7f0e35010640 1 -- 172.21.15.77:0/2398700962 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e300c71a0 con 0x7f0e3006a120 2023-11-04T01:43:22.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.715+0000 7f0e27fff640 1 -- 172.21.15.77:0/2398700962 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e20012b00 con 0x7f0e3006a120 2023-11-04T01:43:22.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.715+0000 7f0e35010640 1 -- 172.21.15.77:0/2398700962 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e30147960 con 0x7f0e3006a120 2023-11-04T01:43:22.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.716+0000 7f0e35010640 1 -- 172.21.15.77:0/2398700962 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e300c77f0 con 0x7f0e3006a120 2023-11-04T01:43:22.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.716+0000 7f0e27fff640 1 -- 172.21.15.77:0/2398700962 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0e20012c60 con 0x7f0e3006a120 2023-11-04T01:43:22.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.716+0000 7f0e27fff640 1 --2- 172.21.15.77:0/2398700962 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0e1006ae70 0x7f0e1006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:22.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.716+0000 7f0e27fff640 1 -- 172.21.15.77:0/2398700962 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6268+0+0 (secure 0 0 0) 0x7f0e20089ca0 con 0x7f0e3006a120 2023-11-04T01:43:22.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.717+0000 7f0e2659c640 1 --2- 172.21.15.77:0/2398700962 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0e1006ae70 0x7f0e1006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:22.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.717+0000 7f0e2659c640 1 --2- 172.21.15.77:0/2398700962 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0e1006ae70 0x7f0e1006d330 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f0e18036000 tx=0x7f0e1803c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:22.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.720+0000 7f0e27fff640 1 -- 172.21.15.77:0/2398700962 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0e20054bb0 con 0x7f0e3006a120 2023-11-04T01:43:22.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.888+0000 7f0e35010640 1 -- 172.21.15.77:0/2398700962 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0e30074290 con 0x7f0e3006a120 2023-11-04T01:43:22.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.888+0000 7f0e27fff640 1 -- 172.21.15.77:0/2398700962 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0e200581d0 con 0x7f0e3006a120 2023-11-04T01:43:22.890 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:43:22.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.890+0000 7f0e35010640 1 -- 172.21.15.77:0/2398700962 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0e1006ae70 msgr2=0x7f0e1006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.890+0000 7f0e35010640 1 --2- 172.21.15.77:0/2398700962 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0e1006ae70 0x7f0e1006d330 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f0e18036000 tx=0x7f0e1803c040 comp rx=0 tx=0).stop 2023-11-04T01:43:22.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.890+0000 7f0e35010640 1 -- 172.21.15.77:0/2398700962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e3006a120 msgr2=0x7f0e30147420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.890+0000 7f0e35010640 1 --2- 172.21.15.77:0/2398700962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e3006a120 0x7f0e30147420 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f0e2000d5f0 tx=0x7f0e2000dab0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.890+0000 7f0e35010640 1 -- 172.21.15.77:0/2398700962 shutdown_connections 2023-11-04T01:43:22.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.890+0000 7f0e35010640 1 --2- 172.21.15.77:0/2398700962 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0e1006ae70 0x7f0e1006d330 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.890+0000 7f0e35010640 1 --2- 172.21.15.77:0/2398700962 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e3015d050 0x7f0e30152330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.890+0000 7f0e35010640 1 --2- 172.21.15.77:0/2398700962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e3006b730 0x7f0e300c4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.890+0000 7f0e35010640 1 --2- 172.21.15.77:0/2398700962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e3006a120 0x7f0e30147420 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.890+0000 7f0e35010640 1 -- 172.21.15.77:0/2398700962 >> 172.21.15.77:0/2398700962 conn(0x7f0e3006cd70 msgr2=0x7f0e300c9980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:22.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.890+0000 7f0e35010640 1 -- 172.21.15.77:0/2398700962 shutdown_connections 2023-11-04T01:43:22.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:22.890+0000 7f0e35010640 1 -- 172.21.15.77:0/2398700962 wait complete. 2023-11-04T01:43:22.902 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:43:23.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.003+0000 7f3990f01640 1 Processor -- start 2023-11-04T01:43:23.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.003+0000 7f3990f01640 1 -- start start 2023-11-04T01:43:23.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.004+0000 7f3990f01640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f398c159c00 0x7f398c0cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.004+0000 7f3990f01640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f398c0c48e0 0x7f398c0c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.004+0000 7f3990f01640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398c15aff0 con 0x7f398c0adac0 2023-11-04T01:43:23.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.004+0000 7f3990f01640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f398c0c52d0 con 0x7f398c159c00 2023-11-04T01:43:23.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.004+0000 7f3990f01640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f398c15a3e0 con 0x7f398c0c48e0 2023-11-04T01:43:23.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.004+0000 7f398a59c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f398c159c00 0x7f398c0cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.004+0000 7f398ad9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f398c0adac0 0x7f398c0adea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40334/0 (socket says 172.21.15.77:40334) 2023-11-04T01:43:23.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.004+0000 7f398ad9d640 1 -- 172.21.15.77:0/2124678914 learned_addr learned my addr 172.21.15.77:0/2124678914 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:23.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.004+0000 7f3989d9b640 1 --2- 172.21.15.77:0/2124678914 >> v2:172.21.15.122:3300/0 conn(0x7f398c0c48e0 0x7f398c0c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.004+0000 7f398a59c640 1 -- 172.21.15.77:0/2124678914 >> v2:172.21.15.122:3300/0 conn(0x7f398c0c48e0 msgr2=0x7f398c0c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:23.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.004+0000 7f398a59c640 1 --2- 172.21.15.77:0/2124678914 >> v2:172.21.15.122:3300/0 conn(0x7f398c0c48e0 0x7f398c0c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.004+0000 7f398a59c640 1 -- 172.21.15.77:0/2124678914 >> v1:172.21.15.77:6789/0 conn(0x7f398c0adac0 legacy=0x7f398c0adea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.004+0000 7f398a59c640 1 -- 172.21.15.77:0/2124678914 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c15a6c0 con 0x7f398c159c00 2023-11-04T01:43:23.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.005+0000 7f398a59c640 1 --2- 172.21.15.77:0/2124678914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f398c159c00 0x7f398c0cc890 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f398c06ebb0 tx=0x7f397c02da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8782f2cdae1bae72 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:23.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.005+0000 7f398959a640 1 -- 172.21.15.77:0/2124678914 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c031870 con 0x7f398c159c00 2023-11-04T01:43:23.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.005+0000 7f398959a640 1 -- 172.21.15.77:0/2124678914 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397c0319d0 con 0x7f398c159c00 2023-11-04T01:43:23.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.005+0000 7f398959a640 1 -- 172.21.15.77:0/2124678914 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c031d60 con 0x7f398c159c00 2023-11-04T01:43:23.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.005+0000 7f3990f01640 1 -- 172.21.15.77:0/2124678914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f398c159c00 msgr2=0x7f398c0cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.005+0000 7f3990f01640 1 --2- 172.21.15.77:0/2124678914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f398c159c00 0x7f398c0cc890 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f398c06ebb0 tx=0x7f397c02da50 comp rx=0 tx=0).stop 2023-11-04T01:43:23.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.005+0000 7f3990f01640 1 -- 172.21.15.77:0/2124678914 shutdown_connections 2023-11-04T01:43:23.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.005+0000 7f3990f01640 1 --2- 172.21.15.77:0/2124678914 >> v2:172.21.15.122:3300/0 conn(0x7f398c0c48e0 0x7f398c0c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.005+0000 7f3990f01640 1 --2- 172.21.15.77:0/2124678914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f398c159c00 0x7f398c0cc890 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.005+0000 7f3990f01640 1 -- 172.21.15.77:0/2124678914 >> 172.21.15.77:0/2124678914 conn(0x7f398c0ce950 msgr2=0x7f398c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:23.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.006+0000 7f3990f01640 1 -- 172.21.15.77:0/2124678914 shutdown_connections 2023-11-04T01:43:23.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.006+0000 7f3990f01640 1 -- 172.21.15.77:0/2124678914 wait complete. 2023-11-04T01:43:23.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.007+0000 7f3990f01640 1 Processor -- start 2023-11-04T01:43:23.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.007+0000 7f3990f01640 1 -- start start 2023-11-04T01:43:23.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.008+0000 7f3990f01640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f398c0adac0 0x7f398c14a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.008+0000 7f3990f01640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f398c0c48e0 0x7f398c0cd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.008+0000 7f3990f01640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f398c159c00 0x7f398c0cd880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.008+0000 7f3990f01640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c1ef2f0 con 0x7f398c159c00 2023-11-04T01:43:23.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.008+0000 7f3990f01640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c1ee6e0 con 0x7f398c0c48e0 2023-11-04T01:43:23.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.008+0000 7f3990f01640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398c1ee9c0 con 0x7f398c0adac0 2023-11-04T01:43:23.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.008+0000 7f398ad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f398c159c00 0x7f398c0cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.008+0000 7f398ad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f398c159c00 0x7f398c0cd880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39120/0 (socket says 172.21.15.77:39120) 2023-11-04T01:43:23.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.008+0000 7f398ad9d640 1 -- 172.21.15.77:0/1804597856 learned_addr learned my addr 172.21.15.77:0/1804597856 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:23.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.008+0000 7f3989d9b640 1 --2- 172.21.15.77:0/1804597856 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f398c0c48e0 0x7f398c0cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.008+0000 7f398a59c640 1 --2- 172.21.15.77:0/1804597856 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f398c0adac0 0x7f398c14a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.008+0000 7f398ad9d640 1 -- 172.21.15.77:0/1804597856 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f398c0adac0 msgr2=0x7f398c14a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.008+0000 7f398ad9d640 1 --2- 172.21.15.77:0/1804597856 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f398c0adac0 0x7f398c14a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.008+0000 7f398ad9d640 1 -- 172.21.15.77:0/1804597856 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f398c0c48e0 msgr2=0x7f398c0cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.008+0000 7f398ad9d640 1 --2- 172.21.15.77:0/1804597856 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f398c0c48e0 0x7f398c0cd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.008+0000 7f398ad9d640 1 -- 172.21.15.77:0/1804597856 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f397c009400 con 0x7f398c159c00 2023-11-04T01:43:23.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.008+0000 7f398ad9d640 1 --2- 172.21.15.77:0/1804597856 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f398c159c00 0x7f398c0cd880 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f398400cbc0 tx=0x7f398400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:23.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.008+0000 7f397affd640 1 -- 172.21.15.77:0/1804597856 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398400ad40 con 0x7f398c159c00 2023-11-04T01:43:23.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.008+0000 7f397affd640 1 -- 172.21.15.77:0/1804597856 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3984012400 con 0x7f398c159c00 2023-11-04T01:43:23.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.008+0000 7f3990f01640 1 -- 172.21.15.77:0/1804597856 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f398c1eeca0 con 0x7f398c159c00 2023-11-04T01:43:23.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.008+0000 7f397affd640 1 -- 172.21.15.77:0/1804597856 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398400aea0 con 0x7f398c159c00 2023-11-04T01:43:23.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.008+0000 7f3990f01640 1 -- 172.21.15.77:0/1804597856 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f398c1ee3a0 con 0x7f398c159c00 2023-11-04T01:43:23.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.009+0000 7f3990f01640 1 -- 172.21.15.77:0/1804597856 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f398c074290 con 0x7f398c159c00 2023-11-04T01:43:23.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.010+0000 7f397affd640 1 -- 172.21.15.77:0/1804597856 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3984007070 con 0x7f398c159c00 2023-11-04T01:43:23.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.010+0000 7f397affd640 1 --2- 172.21.15.77:0/1804597856 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f396c06ae70 0x7f396c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.010+0000 7f397affd640 1 -- 172.21.15.77:0/1804597856 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6268+0+0 (secure 0 0 0) 0x7f39840895c0 con 0x7f398c159c00 2023-11-04T01:43:23.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.010+0000 7f398a59c640 1 --2- 172.21.15.77:0/1804597856 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f396c06ae70 0x7f396c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.011+0000 7f398a59c640 1 --2- 172.21.15.77:0/1804597856 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f396c06ae70 0x7f396c06d330 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f397c038000 tx=0x7f397c008030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:23.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.014+0000 7f397affd640 1 -- 172.21.15.77:0/1804597856 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3984054580 con 0x7f398c159c00 2023-11-04T01:43:23.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.180+0000 7f3990f01640 1 -- 172.21.15.77:0/1804597856 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f398c070e70 con 0x7f398c159c00 2023-11-04T01:43:23.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.180+0000 7f397affd640 1 -- 172.21.15.77:0/1804597856 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v92) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3984057ba0 con 0x7f398c159c00 2023-11-04T01:43:23.182 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:43:23.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.182+0000 7f3990f01640 1 -- 172.21.15.77:0/1804597856 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f396c06ae70 msgr2=0x7f396c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.182+0000 7f3990f01640 1 --2- 172.21.15.77:0/1804597856 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f396c06ae70 0x7f396c06d330 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f397c038000 tx=0x7f397c008030 comp rx=0 tx=0).stop 2023-11-04T01:43:23.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.182+0000 7f3990f01640 1 -- 172.21.15.77:0/1804597856 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f398c159c00 msgr2=0x7f398c0cd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.182+0000 7f3990f01640 1 --2- 172.21.15.77:0/1804597856 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f398c159c00 0x7f398c0cd880 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f398400cbc0 tx=0x7f398400a430 comp rx=0 tx=0).stop 2023-11-04T01:43:23.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.182+0000 7f3990f01640 1 -- 172.21.15.77:0/1804597856 shutdown_connections 2023-11-04T01:43:23.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.182+0000 7f3990f01640 1 --2- 172.21.15.77:0/1804597856 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f396c06ae70 0x7f396c06d330 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.182+0000 7f3990f01640 1 --2- 172.21.15.77:0/1804597856 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f398c159c00 0x7f398c0cd880 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.182+0000 7f3990f01640 1 --2- 172.21.15.77:0/1804597856 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f398c0c48e0 0x7f398c0cd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.182+0000 7f3990f01640 1 --2- 172.21.15.77:0/1804597856 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f398c0adac0 0x7f398c14a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.182+0000 7f3990f01640 1 -- 172.21.15.77:0/1804597856 >> 172.21.15.77:0/1804597856 conn(0x7f398c0ce950 msgr2=0x7f398c071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:23.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.182+0000 7f3990f01640 1 -- 172.21.15.77:0/1804597856 shutdown_connections 2023-11-04T01:43:23.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.182+0000 7f3990f01640 1 -- 172.21.15.77:0/1804597856 wait complete. 2023-11-04T01:43:23.195 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:43:23.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.295+0000 7fb590339640 1 Processor -- start 2023-11-04T01:43:23.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.295+0000 7fb590339640 1 -- start start 2023-11-04T01:43:23.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.296+0000 7fb590339640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb5880c4ff0 0x7fb5880cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.296+0000 7fb590339640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb58815aff0 con 0x7fb588159c00 2023-11-04T01:43:23.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.296+0000 7fb590339640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb58815a3e0 con 0x7fb5880adac0 2023-11-04T01:43:23.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.296+0000 7fb590339640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb58815a6c0 con 0x7fb5880c4ff0 2023-11-04T01:43:23.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.296+0000 7fb58d8d4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb5880c4ff0 0x7fb5880cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.296+0000 7fb58e0d5640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb588159c00 0x7fb5880c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40340/0 (socket says 172.21.15.77:40340) 2023-11-04T01:43:23.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.296+0000 7fb58e0d5640 1 -- 172.21.15.77:0/2702905004 learned_addr learned my addr 172.21.15.77:0/2702905004 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:23.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.296+0000 7fb58d8d4640 1 -- 172.21.15.77:0/2702905004 >> v1:172.21.15.122:6789/0 conn(0x7fb5880adac0 legacy=0x7fb5880adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:23.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.296+0000 7fb58d8d4640 1 -- 172.21.15.77:0/2702905004 >> v1:172.21.15.77:6789/0 conn(0x7fb588159c00 legacy=0x7fb5880c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.296+0000 7fb58d0d3640 1 -- 172.21.15.77:0/2702905004 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2950782262 0 0) 0x7fb58815aff0 con 0x7fb588159c00 2023-11-04T01:43:23.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.296+0000 7fb58d8d4640 1 -- 172.21.15.77:0/2702905004 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58815a9a0 con 0x7fb5880c4ff0 2023-11-04T01:43:23.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.297+0000 7fb58d8d4640 1 --2- 172.21.15.77:0/2702905004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5880c4ff0 0x7fb5880cc890 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fb5780097a0 tx=0x7fb57802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e80f0cee47fb46f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:23.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.297+0000 7fb58d0d3640 1 -- 172.21.15.77:0/2702905004 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb578031830 con 0x7fb5880c4ff0 2023-11-04T01:43:23.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.297+0000 7fb58d0d3640 1 -- 172.21.15.77:0/2702905004 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb578031990 con 0x7fb5880c4ff0 2023-11-04T01:43:23.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.297+0000 7fb58d0d3640 1 -- 172.21.15.77:0/2702905004 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb578031d20 con 0x7fb5880c4ff0 2023-11-04T01:43:23.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.298+0000 7fb590339640 1 -- 172.21.15.77:0/2702905004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5880c4ff0 msgr2=0x7fb5880cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.298+0000 7fb590339640 1 --2- 172.21.15.77:0/2702905004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5880c4ff0 0x7fb5880cc890 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fb5780097a0 tx=0x7fb57802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.298+0000 7fb590339640 1 -- 172.21.15.77:0/2702905004 shutdown_connections 2023-11-04T01:43:23.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.298+0000 7fb590339640 1 --2- 172.21.15.77:0/2702905004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5880c4ff0 0x7fb5880cc890 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.298+0000 7fb590339640 1 -- 172.21.15.77:0/2702905004 >> 172.21.15.77:0/2702905004 conn(0x7fb5880ce950 msgr2=0x7fb5880ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:23.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.298+0000 7fb590339640 1 -- 172.21.15.77:0/2702905004 shutdown_connections 2023-11-04T01:43:23.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.298+0000 7fb590339640 1 -- 172.21.15.77:0/2702905004 wait complete. 2023-11-04T01:43:23.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.299+0000 7fb590339640 1 Processor -- start 2023-11-04T01:43:23.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.299+0000 7fb590339640 1 -- start start 2023-11-04T01:43:23.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.300+0000 7fb590339640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5880adac0 0x7fb58814c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.300+0000 7fb590339640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb5880c4ff0 0x7fb5881e4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.300+0000 7fb590339640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb588159c00 0x7fb5881528a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.300+0000 7fb590339640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5881e55e0 con 0x7fb5880adac0 2023-11-04T01:43:23.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.300+0000 7fb590339640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58814c920 con 0x7fb588159c00 2023-11-04T01:43:23.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.300+0000 7fb590339640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5881f4a30 con 0x7fb5880c4ff0 2023-11-04T01:43:23.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.300+0000 7fb58e0d5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5880adac0 0x7fb58814c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.300+0000 7fb58e0d5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5880adac0 0x7fb58814c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39134/0 (socket says 172.21.15.77:39134) 2023-11-04T01:43:23.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.300+0000 7fb58e0d5640 1 -- 172.21.15.77:0/784142913 learned_addr learned my addr 172.21.15.77:0/784142913 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:23.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.300+0000 7fb58e0d5640 1 -- 172.21.15.77:0/784142913 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb5880c4ff0 msgr2=0x7fb5881e4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.300+0000 7fb58d8d4640 1 --2- 172.21.15.77:0/784142913 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb5880c4ff0 0x7fb5881e4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.300+0000 7fb58e0d5640 1 --2- 172.21.15.77:0/784142913 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb5880c4ff0 0x7fb5881e4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.300+0000 7fb58e0d5640 1 -- 172.21.15.77:0/784142913 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb588159c00 msgr2=0x7fb5881528a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.300+0000 7fb58e8d6640 1 --2- 172.21.15.77:0/784142913 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb588159c00 0x7fb5881528a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.300+0000 7fb58e0d5640 1 --2- 172.21.15.77:0/784142913 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb588159c00 0x7fb5881528a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.300+0000 7fb58e0d5640 1 -- 172.21.15.77:0/784142913 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb578009400 con 0x7fb5880adac0 2023-11-04T01:43:23.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.300+0000 7fb58d8d4640 1 --2- 172.21.15.77:0/784142913 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb5880c4ff0 0x7fb5881e4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:23.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.300+0000 7fb58e8d6640 1 --2- 172.21.15.77:0/784142913 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb588159c00 0x7fb5881528a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:23.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.300+0000 7fb58e0d5640 1 --2- 172.21.15.77:0/784142913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5880adac0 0x7fb58814c3e0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fb58400c7c0 tx=0x7fb58400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:23.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.301+0000 7fb57effd640 1 -- 172.21.15.77:0/784142913 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58400a640 con 0x7fb5880adac0 2023-11-04T01:43:23.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.301+0000 7fb57effd640 1 -- 172.21.15.77:0/784142913 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58400a7c0 con 0x7fb5880adac0 2023-11-04T01:43:23.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.301+0000 7fb590339640 1 -- 172.21.15.77:0/784142913 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5881f3c70 con 0x7fb5880adac0 2023-11-04T01:43:23.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.301+0000 7fb57effd640 1 -- 172.21.15.77:0/784142913 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58400ab70 con 0x7fb5880adac0 2023-11-04T01:43:23.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.301+0000 7fb590339640 1 -- 172.21.15.77:0/784142913 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5881f4230 con 0x7fb5880adac0 2023-11-04T01:43:23.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.302+0000 7fb590339640 1 -- 172.21.15.77:0/784142913 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb588074290 con 0x7fb5880adac0 2023-11-04T01:43:23.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.302+0000 7fb57effd640 1 -- 172.21.15.77:0/784142913 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb58400acd0 con 0x7fb5880adac0 2023-11-04T01:43:23.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.302+0000 7fb57effd640 1 --2- 172.21.15.77:0/784142913 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb56c06aea0 0x7fb56c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.302+0000 7fb57effd640 1 -- 172.21.15.77:0/784142913 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6268+0+0 (secure 0 0 0) 0x7fb584088fb0 con 0x7fb5880adac0 2023-11-04T01:43:23.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.303+0000 7fb58d8d4640 1 --2- 172.21.15.77:0/784142913 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb56c06aea0 0x7fb56c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.303+0000 7fb58d8d4640 1 --2- 172.21.15.77:0/784142913 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb56c06aea0 0x7fb56c06d360 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb578036000 tx=0x7fb578008030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:23.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.307+0000 7fb57effd640 1 -- 172.21.15.77:0/784142913 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb5840bbca0 con 0x7fb5880adac0 2023-11-04T01:43:23.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.473+0000 7fb590339640 1 -- 172.21.15.77:0/784142913 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7fb5880c4c60 con 0x7fb5880adac0 2023-11-04T01:43:23.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.474+0000 7fb57effd640 1 -- 172.21.15.77:0/784142913 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v92) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb584018020 con 0x7fb5880adac0 2023-11-04T01:43:23.476 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:43:23.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.476+0000 7fb590339640 1 -- 172.21.15.77:0/784142913 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb56c06aea0 msgr2=0x7fb56c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.476+0000 7fb590339640 1 --2- 172.21.15.77:0/784142913 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb56c06aea0 0x7fb56c06d360 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb578036000 tx=0x7fb578008030 comp rx=0 tx=0).stop 2023-11-04T01:43:23.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.476+0000 7fb590339640 1 -- 172.21.15.77:0/784142913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5880adac0 msgr2=0x7fb58814c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.476+0000 7fb590339640 1 --2- 172.21.15.77:0/784142913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5880adac0 0x7fb58814c3e0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fb58400c7c0 tx=0x7fb58400cc80 comp rx=0 tx=0).stop 2023-11-04T01:43:23.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.476+0000 7fb590339640 1 -- 172.21.15.77:0/784142913 shutdown_connections 2023-11-04T01:43:23.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.476+0000 7fb590339640 1 --2- 172.21.15.77:0/784142913 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb56c06aea0 0x7fb56c06d360 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.476+0000 7fb590339640 1 --2- 172.21.15.77:0/784142913 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb588159c00 0x7fb5881528a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.476+0000 7fb590339640 1 --2- 172.21.15.77:0/784142913 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb5880c4ff0 0x7fb5881e4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.476+0000 7fb590339640 1 --2- 172.21.15.77:0/784142913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5880adac0 0x7fb58814c3e0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.476+0000 7fb590339640 1 -- 172.21.15.77:0/784142913 >> 172.21.15.77:0/784142913 conn(0x7fb5880ce950 msgr2=0x7fb58806d250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:23.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.476+0000 7fb590339640 1 -- 172.21.15.77:0/784142913 shutdown_connections 2023-11-04T01:43:23.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.476+0000 7fb590339640 1 -- 172.21.15.77:0/784142913 wait complete. 2023-11-04T01:43:23.488 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:43:23.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.590+0000 7fcd565a9640 1 Processor -- start 2023-11-04T01:43:23.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.590+0000 7fcd565a9640 1 -- start start 2023-11-04T01:43:23.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.590+0000 7fcd565a9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcd500b4880 0x7fcd500b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.590+0000 7fcd565a9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd500cde60 con 0x7fcd50153e60 2023-11-04T01:43:23.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.590+0000 7fcd565a9640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd50160f90 con 0x7fcd500cd6d0 2023-11-04T01:43:23.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.590+0000 7fcd565a9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd500b5200 con 0x7fcd500b4880 2023-11-04T01:43:23.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.591+0000 7fcd54b46640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcd500b4880 0x7fcd500b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.591+0000 7fcd4ffff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fcd50153e60 0x7fcd5015dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40352/0 (socket says 172.21.15.77:40352) 2023-11-04T01:43:23.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.591+0000 7fcd4ffff640 1 -- 172.21.15.77:0/4157888428 learned_addr learned my addr 172.21.15.77:0/4157888428 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:23.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.591+0000 7fcd54b46640 1 -- 172.21.15.77:0/4157888428 >> v1:172.21.15.122:6789/0 conn(0x7fcd500cd6d0 legacy=0x7fcd50161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:23.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.591+0000 7fcd54b46640 1 -- 172.21.15.77:0/4157888428 >> v1:172.21.15.77:6789/0 conn(0x7fcd50153e60 legacy=0x7fcd5015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.591+0000 7fcd54b46640 1 -- 172.21.15.77:0/4157888428 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd500ce090 con 0x7fcd500b4880 2023-11-04T01:43:23.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.591+0000 7fcd4effd640 1 -- 172.21.15.77:0/4157888428 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 521592899 0 0) 0x7fcd500cde60 con 0x7fcd50153e60 2023-11-04T01:43:23.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.592+0000 7fcd54b46640 1 --2- 172.21.15.77:0/4157888428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd500b4880 0x7fcd500b4cc0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fcd48009d90 tx=0x7fcd4802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cfd75ec749e7807 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:23.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.592+0000 7fcd4effd640 1 -- 172.21.15.77:0/4157888428 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4802cc60 con 0x7fcd500b4880 2023-11-04T01:43:23.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.592+0000 7fcd4effd640 1 -- 172.21.15.77:0/4157888428 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4802cdc0 con 0x7fcd500b4880 2023-11-04T01:43:23.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.592+0000 7fcd4effd640 1 -- 172.21.15.77:0/4157888428 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd48034660 con 0x7fcd500b4880 2023-11-04T01:43:23.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.592+0000 7fcd565a9640 1 -- 172.21.15.77:0/4157888428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd500b4880 msgr2=0x7fcd500b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.592+0000 7fcd565a9640 1 --2- 172.21.15.77:0/4157888428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd500b4880 0x7fcd500b4cc0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fcd48009d90 tx=0x7fcd4802beb0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.592+0000 7fcd565a9640 1 -- 172.21.15.77:0/4157888428 shutdown_connections 2023-11-04T01:43:23.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.592+0000 7fcd565a9640 1 --2- 172.21.15.77:0/4157888428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd500b4880 0x7fcd500b4cc0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.592+0000 7fcd565a9640 1 -- 172.21.15.77:0/4157888428 >> 172.21.15.77:0/4157888428 conn(0x7fcd500cf880 msgr2=0x7fcd500cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:23.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.592+0000 7fcd565a9640 1 -- 172.21.15.77:0/4157888428 shutdown_connections 2023-11-04T01:43:23.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.592+0000 7fcd565a9640 1 -- 172.21.15.77:0/4157888428 wait complete. 2023-11-04T01:43:23.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.593+0000 7fcd565a9640 1 Processor -- start 2023-11-04T01:43:23.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.594+0000 7fcd565a9640 1 -- start start 2023-11-04T01:43:23.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.594+0000 7fcd565a9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd500b4880 0x7fcd501f2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.594+0000 7fcd565a9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd500cd6d0 0x7fcd50158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.594+0000 7fcd565a9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcd50153e60 0x7fcd50156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.594+0000 7fcd565a9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5015a410 con 0x7fcd500b4880 2023-11-04T01:43:23.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.594+0000 7fcd565a9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd501f27c0 con 0x7fcd500cd6d0 2023-11-04T01:43:23.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.594+0000 7fcd565a9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd50159790 con 0x7fcd50153e60 2023-11-04T01:43:23.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.594+0000 7fcd4ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd500b4880 0x7fcd501f2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.594+0000 7fcd4ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd500b4880 0x7fcd501f2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39154/0 (socket says 172.21.15.77:39154) 2023-11-04T01:43:23.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.594+0000 7fcd4ffff640 1 -- 172.21.15.77:0/2721976179 learned_addr learned my addr 172.21.15.77:0/2721976179 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:23.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.595+0000 7fcd4ffff640 1 -- 172.21.15.77:0/2721976179 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcd50153e60 msgr2=0x7fcd50156830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.595+0000 7fcd4ffff640 1 --2- 172.21.15.77:0/2721976179 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcd50153e60 0x7fcd50156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.595+0000 7fcd4ffff640 1 -- 172.21.15.77:0/2721976179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd500cd6d0 msgr2=0x7fcd50158d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.595+0000 7fcd4ffff640 1 --2- 172.21.15.77:0/2721976179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd500cd6d0 0x7fcd50158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.595+0000 7fcd4ffff640 1 -- 172.21.15.77:0/2721976179 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd48009a70 con 0x7fcd500b4880 2023-11-04T01:43:23.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.595+0000 7fcd4ffff640 1 --2- 172.21.15.77:0/2721976179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd500b4880 0x7fcd501f2280 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000c430 tx=0x7fcd4000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:23.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.595+0000 7fcd4cff9640 1 -- 172.21.15.77:0/2721976179 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd400074e0 con 0x7fcd500b4880 2023-11-04T01:43:23.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.595+0000 7fcd4cff9640 1 -- 172.21.15.77:0/2721976179 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd40007660 con 0x7fcd500b4880 2023-11-04T01:43:23.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.595+0000 7fcd4cff9640 1 -- 172.21.15.77:0/2721976179 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd40004a20 con 0x7fcd500b4880 2023-11-04T01:43:23.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.595+0000 7fcd565a9640 1 -- 172.21.15.77:0/2721976179 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd50159a70 con 0x7fcd500b4880 2023-11-04T01:43:23.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.595+0000 7fcd565a9640 1 -- 172.21.15.77:0/2721976179 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd5015a030 con 0x7fcd500b4880 2023-11-04T01:43:23.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.596+0000 7fcd565a9640 1 -- 172.21.15.77:0/2721976179 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd500c6900 con 0x7fcd500b4880 2023-11-04T01:43:23.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.596+0000 7fcd4cff9640 1 -- 172.21.15.77:0/2721976179 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcd40004b80 con 0x7fcd500b4880 2023-11-04T01:43:23.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.597+0000 7fcd4cff9640 1 --2- 172.21.15.77:0/2721976179 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcd3c06ae70 0x7fcd3c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.597+0000 7fcd4cff9640 1 -- 172.21.15.77:0/2721976179 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6268+0+0 (secure 0 0 0) 0x7fcd40089620 con 0x7fcd500b4880 2023-11-04T01:43:23.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.597+0000 7fcd4f7fe640 1 --2- 172.21.15.77:0/2721976179 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcd3c06ae70 0x7fcd3c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.597+0000 7fcd4f7fe640 1 --2- 172.21.15.77:0/2721976179 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcd3c06ae70 0x7fcd3c06d330 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fcd5015ad20 tx=0x7fcd440079b0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:23.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.601+0000 7fcd4cff9640 1 -- 172.21.15.77:0/2721976179 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcd40054530 con 0x7fcd500b4880 2023-11-04T01:43:23.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.767+0000 7fcd565a9640 1 -- 172.21.15.77:0/2721976179 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7fcd50074290 con 0x7fcd500b4880 2023-11-04T01:43:23.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.767+0000 7fcd4cff9640 1 -- 172.21.15.77:0/2721976179 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v92) v1 ==== 107+0+11 (secure 0 0 0) 0x7fcd40057b50 con 0x7fcd500b4880 2023-11-04T01:43:23.769 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:43:23.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.769+0000 7fcd565a9640 1 -- 172.21.15.77:0/2721976179 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcd3c06ae70 msgr2=0x7fcd3c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.769+0000 7fcd565a9640 1 --2- 172.21.15.77:0/2721976179 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcd3c06ae70 0x7fcd3c06d330 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fcd5015ad20 tx=0x7fcd440079b0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.769+0000 7fcd565a9640 1 -- 172.21.15.77:0/2721976179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd500b4880 msgr2=0x7fcd501f2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.769+0000 7fcd565a9640 1 --2- 172.21.15.77:0/2721976179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd500b4880 0x7fcd501f2280 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000c430 tx=0x7fcd4000c8f0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.769+0000 7fcd565a9640 1 -- 172.21.15.77:0/2721976179 shutdown_connections 2023-11-04T01:43:23.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.769+0000 7fcd565a9640 1 --2- 172.21.15.77:0/2721976179 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcd3c06ae70 0x7fcd3c06d330 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.769+0000 7fcd565a9640 1 --2- 172.21.15.77:0/2721976179 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcd50153e60 0x7fcd50156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.769+0000 7fcd565a9640 1 --2- 172.21.15.77:0/2721976179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd500cd6d0 0x7fcd50158d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.769+0000 7fcd565a9640 1 --2- 172.21.15.77:0/2721976179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd500b4880 0x7fcd501f2280 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.769+0000 7fcd565a9640 1 -- 172.21.15.77:0/2721976179 >> 172.21.15.77:0/2721976179 conn(0x7fcd500cf880 msgr2=0x7fcd500d25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:23.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.769+0000 7fcd565a9640 1 -- 172.21.15.77:0/2721976179 shutdown_connections 2023-11-04T01:43:23.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.769+0000 7fcd565a9640 1 -- 172.21.15.77:0/2721976179 wait complete. 2023-11-04T01:43:23.782 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T01:43:23.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.879+0000 7f17f876c640 1 Processor -- start 2023-11-04T01:43:23.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.879+0000 7f17f876c640 1 -- start start 2023-11-04T01:43:23.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.880+0000 7f17f876c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f17f00b42c0 0x7f17f00c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.880+0000 7f17f876c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f17f00c9c40 0x7f17f00b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.880+0000 7f17f876c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17f00ca090 con 0x7f17f015ad80 2023-11-04T01:43:23.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.880+0000 7f17f876c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17f006cfa0 con 0x7f17f00b42c0 2023-11-04T01:43:23.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.880+0000 7f17f876c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f006d280 con 0x7f17f00c9c40 2023-11-04T01:43:23.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.880+0000 7f17f5d07640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f17f00b42c0 0x7f17f00c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.880+0000 7f17f6d09640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f17f00c9c40 0x7f17f00b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.880+0000 7f17f5d07640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f17f00b42c0 0x7f17f00c9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:54030/0 (socket says 172.21.15.77:54030) 2023-11-04T01:43:23.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.880+0000 7f17f5d07640 1 -- 172.21.15.77:0/4194101861 learned_addr learned my addr 172.21.15.77:0/4194101861 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:23.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.880+0000 7f17f6508640 1 --1- 172.21.15.77:0/4194101861 >> v1:172.21.15.122:6789/0 conn(0x7f17f015ad80 0x7f17f006c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:53796/0 (socket says 172.21.15.77:53796) 2023-11-04T01:43:23.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.881+0000 7f17f5d07640 1 -- 172.21.15.77:0/4194101861 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f17f00c9c40 msgr2=0x7f17f00b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:23.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.881+0000 7f17f5d07640 1 --2- 172.21.15.77:0/4194101861 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f17f00c9c40 0x7f17f00b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.881+0000 7f17f5d07640 1 -- 172.21.15.77:0/4194101861 >> v1:172.21.15.122:6789/0 conn(0x7f17f015ad80 legacy=0x7f17f006c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.881+0000 7f17f5506640 1 -- 172.21.15.77:0/4194101861 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3235780185 0 0) 0x7f17ec001110 con 0x7f17f015ad80 2023-11-04T01:43:23.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.881+0000 7f17f5d07640 1 -- 172.21.15.77:0/4194101861 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f006d560 con 0x7f17f00b42c0 2023-11-04T01:43:23.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.881+0000 7f17f6d09640 1 --2- 172.21.15.77:0/4194101861 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f17f00c9c40 0x7f17f00b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:43:23.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.882+0000 7f17f5d07640 1 --2- 172.21.15.77:0/4194101861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17f00b42c0 0x7f17f00c9700 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f17e0009870 tx=0x7f17e002ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4550e60c6f1cf7d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:23.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.882+0000 7f17f5506640 1 -- 172.21.15.77:0/4194101861 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e002f840 con 0x7f17f00b42c0 2023-11-04T01:43:23.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.882+0000 7f17f5506640 1 -- 172.21.15.77:0/4194101861 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e002f9a0 con 0x7f17f00b42c0 2023-11-04T01:43:23.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.882+0000 7f17f5506640 1 -- 172.21.15.77:0/4194101861 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e002fd30 con 0x7f17f00b42c0 2023-11-04T01:43:23.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.882+0000 7f17f876c640 1 -- 172.21.15.77:0/4194101861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17f00b42c0 msgr2=0x7f17f00c9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.882+0000 7f17f876c640 1 --2- 172.21.15.77:0/4194101861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17f00b42c0 0x7f17f00c9700 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f17e0009870 tx=0x7f17e002ba20 comp rx=0 tx=0).stop 2023-11-04T01:43:23.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.882+0000 7f17f876c640 1 -- 172.21.15.77:0/4194101861 shutdown_connections 2023-11-04T01:43:23.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.882+0000 7f17f876c640 1 --2- 172.21.15.77:0/4194101861 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f17f00c9c40 0x7f17f00b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.882+0000 7f17f876c640 1 --2- 172.21.15.77:0/4194101861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17f00b42c0 0x7f17f00c9700 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.882+0000 7f17f876c640 1 -- 172.21.15.77:0/4194101861 >> 172.21.15.77:0/4194101861 conn(0x7f17f00ce950 msgr2=0x7f17f00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:23.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.882+0000 7f17f876c640 1 -- 172.21.15.77:0/4194101861 shutdown_connections 2023-11-04T01:43:23.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.882+0000 7f17f876c640 1 -- 172.21.15.77:0/4194101861 wait complete. 2023-11-04T01:43:23.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.884+0000 7f17f876c640 1 Processor -- start 2023-11-04T01:43:23.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.884+0000 7f17f876c640 1 -- start start 2023-11-04T01:43:23.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.884+0000 7f17f876c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f17f00b42c0 0x7f17f01e6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.884+0000 7f17f876c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17f00c9c40 0x7f17f0151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.884+0000 7f17f876c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17f015ad80 0x7f17f015c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.884+0000 7f17f876c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f01e6500 con 0x7f17f015ad80 2023-11-04T01:43:23.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.884+0000 7f17f876c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f01e6e60 con 0x7f17f00c9c40 2023-11-04T01:43:23.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.884+0000 7f17f876c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f01e5880 con 0x7f17f00b42c0 2023-11-04T01:43:23.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.884+0000 7f17f6d09640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17f015ad80 0x7f17f015c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.884+0000 7f17f6d09640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17f015ad80 0x7f17f015c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39164/0 (socket says 172.21.15.77:39164) 2023-11-04T01:43:23.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.884+0000 7f17f6d09640 1 -- 172.21.15.77:0/2230913629 learned_addr learned my addr 172.21.15.77:0/2230913629 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:23.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.885+0000 7f17f6508640 1 --2- 172.21.15.77:0/2230913629 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f17f00b42c0 0x7f17f01e6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.885+0000 7f17f5d07640 1 --2- 172.21.15.77:0/2230913629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17f00c9c40 0x7f17f0151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.885+0000 7f17f6d09640 1 -- 172.21.15.77:0/2230913629 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f17f00b42c0 msgr2=0x7f17f01e6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.885+0000 7f17f6d09640 1 --2- 172.21.15.77:0/2230913629 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f17f00b42c0 0x7f17f01e6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.885+0000 7f17f6d09640 1 -- 172.21.15.77:0/2230913629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17f00c9c40 msgr2=0x7f17f0151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.885+0000 7f17f6d09640 1 --2- 172.21.15.77:0/2230913629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17f00c9c40 0x7f17f0151bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.885+0000 7f17f6d09640 1 -- 172.21.15.77:0/2230913629 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e8009a70 con 0x7f17f015ad80 2023-11-04T01:43:23.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.885+0000 7f17f5d07640 1 --2- 172.21.15.77:0/2230913629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17f00c9c40 0x7f17f0151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:23.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.885+0000 7f17f6d09640 1 --2- 172.21.15.77:0/2230913629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17f015ad80 0x7f17f015c3f0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f17e800efc0 tx=0x7f17e8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:23.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.885+0000 7f17e6ffd640 1 -- 172.21.15.77:0/2230913629 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e8009d70 con 0x7f17f015ad80 2023-11-04T01:43:23.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.885+0000 7f17e6ffd640 1 -- 172.21.15.77:0/2230913629 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e800f040 con 0x7f17f015ad80 2023-11-04T01:43:23.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.885+0000 7f17f876c640 1 -- 172.21.15.77:0/2230913629 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17e00094d0 con 0x7f17f015ad80 2023-11-04T01:43:23.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.885+0000 7f17e6ffd640 1 -- 172.21.15.77:0/2230913629 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e8003990 con 0x7f17f015ad80 2023-11-04T01:43:23.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.885+0000 7f17f876c640 1 -- 172.21.15.77:0/2230913629 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f01e5e40 con 0x7f17f015ad80 2023-11-04T01:43:23.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.886+0000 7f17f876c640 1 -- 172.21.15.77:0/2230913629 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f01e6640 con 0x7f17f015ad80 2023-11-04T01:43:23.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.887+0000 7f17e6ffd640 1 -- 172.21.15.77:0/2230913629 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f17e80144a0 con 0x7f17f015ad80 2023-11-04T01:43:23.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.887+0000 7f17e6ffd640 1 --2- 172.21.15.77:0/2230913629 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f17d406ae70 0x7f17d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.887+0000 7f17e6ffd640 1 -- 172.21.15.77:0/2230913629 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6268+0+0 (secure 0 0 0) 0x7f17e808a580 con 0x7f17f015ad80 2023-11-04T01:43:23.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.887+0000 7f17f6508640 1 --2- 172.21.15.77:0/2230913629 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f17d406ae70 0x7f17d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.888+0000 7f17f6508640 1 --2- 172.21.15.77:0/2230913629 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f17d406ae70 0x7f17d406d330 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f17ec000f60 tx=0x7f17ec007c00 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:23.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:23.891+0000 7f17e6ffd640 1 -- 172.21.15.77:0/2230913629 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f17f01e6640 con 0x7f17f015ad80 2023-11-04T01:43:24.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.059+0000 7f17f876c640 1 -- 172.21.15.77:0/2230913629 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f17f01e6640 con 0x7f17f015ad80 2023-11-04T01:43:24.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.060+0000 7f17e6ffd640 1 -- 172.21.15.77:0/2230913629 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v92) v1 ==== 84+0+287 (secure 0 0 0) 0x7f17f01e6640 con 0x7f17f015ad80 2023-11-04T01:43:24.062 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:43:24.062 INFO:teuthology.orchestra.run.smithi077.stdout:[ 2023-11-04T01:43:24.062 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:43:24.062 INFO:teuthology.orchestra.run.smithi077.stdout: "poolnum": 1, 2023-11-04T01:43:24.063 INFO:teuthology.orchestra.run.smithi077.stdout: "poolname": ".mgr" 2023-11-04T01:43:24.063 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:43:24.063 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:43:24.063 INFO:teuthology.orchestra.run.smithi077.stdout: "poolnum": 7, 2023-11-04T01:43:24.063 INFO:teuthology.orchestra.run.smithi077.stdout: "poolname": "snap-test-pool" 2023-11-04T01:43:24.064 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:43:24.064 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:43:24.064 INFO:teuthology.orchestra.run.smithi077.stdout: "poolnum": 12, 2023-11-04T01:43:24.064 INFO:teuthology.orchestra.run.smithi077.stdout: "poolname": "test_data_pool" 2023-11-04T01:43:24.064 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:43:24.064 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-11-04T01:43:24.065 INFO:teuthology.orchestra.run.smithi077.stdout: "poolnum": 13, 2023-11-04T01:43:24.065 INFO:teuthology.orchestra.run.smithi077.stdout: "poolname": "test_metadata_pool" 2023-11-04T01:43:24.065 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:43:24.065 INFO:teuthology.orchestra.run.smithi077.stdout:] 2023-11-04T01:43:24.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.061+0000 7f17f876c640 1 -- 172.21.15.77:0/2230913629 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f17d406ae70 msgr2=0x7f17d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.061+0000 7f17f876c640 1 --2- 172.21.15.77:0/2230913629 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f17d406ae70 0x7f17d406d330 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f17ec000f60 tx=0x7f17ec007c00 comp rx=0 tx=0).stop 2023-11-04T01:43:24.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.061+0000 7f17f876c640 1 -- 172.21.15.77:0/2230913629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17f015ad80 msgr2=0x7f17f015c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.061+0000 7f17f876c640 1 --2- 172.21.15.77:0/2230913629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17f015ad80 0x7f17f015c3f0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f17e800efc0 tx=0x7f17e8009f90 comp rx=0 tx=0).stop 2023-11-04T01:43:24.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.061+0000 7f17f876c640 1 -- 172.21.15.77:0/2230913629 shutdown_connections 2023-11-04T01:43:24.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.061+0000 7f17f876c640 1 --2- 172.21.15.77:0/2230913629 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f17d406ae70 0x7f17d406d330 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.061+0000 7f17f876c640 1 --2- 172.21.15.77:0/2230913629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17f015ad80 0x7f17f015c3f0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.061+0000 7f17f876c640 1 --2- 172.21.15.77:0/2230913629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17f00c9c40 0x7f17f0151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.061+0000 7f17f876c640 1 --2- 172.21.15.77:0/2230913629 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f17f00b42c0 0x7f17f01e6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.061+0000 7f17f876c640 1 -- 172.21.15.77:0/2230913629 >> 172.21.15.77:0/2230913629 conn(0x7f17f00ce950 msgr2=0x7f17f00ae3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:24.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.061+0000 7f17f876c640 1 -- 172.21.15.77:0/2230913629 shutdown_connections 2023-11-04T01:43:24.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.061+0000 7f17f876c640 1 -- 172.21.15.77:0/2230913629 wait complete. 2023-11-04T01:43:24.073 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T01:43:24.074 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T01:43:24.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.175+0000 7f8a2c35e640 1 Processor -- start 2023-11-04T01:43:24.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.175+0000 7f8a2c35e640 1 -- start start 2023-11-04T01:43:24.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.176+0000 7f8a2c35e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8a24151ea0 0x7f8a2415b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.176+0000 7f8a2c35e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8a2415f510 0x7f8a240cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.176+0000 7f8a2c35e640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a2406cf90 con 0x7f8a2406dd50 2023-11-04T01:43:24.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.176+0000 7f8a2c35e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a2406d270 con 0x7f8a2415f510 2023-11-04T01:43:24.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.176+0000 7f8a2c35e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2406d550 con 0x7f8a24151ea0 2023-11-04T01:43:24.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.176+0000 7f8a298f9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8a2415f510 0x7f8a240cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.176+0000 7f8a298f9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8a2415f510 0x7f8a240cb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39180/0 (socket says 172.21.15.77:39180) 2023-11-04T01:43:24.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.176+0000 7f8a298f9640 1 -- 172.21.15.77:0/55142465 learned_addr learned my addr 172.21.15.77:0/55142465 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:24.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.177+0000 7f8a298f9640 1 -- 172.21.15.77:0/55142465 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8a24151ea0 msgr2=0x7f8a2415b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:24.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.177+0000 7f8a298f9640 1 --2- 172.21.15.77:0/55142465 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8a24151ea0 0x7f8a2415b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.177+0000 7f8a298f9640 1 -- 172.21.15.77:0/55142465 >> v1:172.21.15.122:6789/0 conn(0x7f8a2406dd50 legacy=0x7f8a24070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:24.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.177+0000 7f8a298f9640 1 -- 172.21.15.77:0/55142465 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2406d830 con 0x7f8a2415f510 2023-11-04T01:43:24.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.177+0000 7f8a298f9640 1 --2- 172.21.15.77:0/55142465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a2415f510 0x7f8a240cb150 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f8a14009870 tx=0x7f8a1402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3cbcc13c29df5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:24.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.177+0000 7f8a290f8640 1 -- 172.21.15.77:0/55142465 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a14031640 con 0x7f8a2415f510 2023-11-04T01:43:24.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.178+0000 7f8a290f8640 1 -- 172.21.15.77:0/55142465 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a140317a0 con 0x7f8a2415f510 2023-11-04T01:43:24.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.178+0000 7f8a290f8640 1 -- 172.21.15.77:0/55142465 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a14031b30 con 0x7f8a2415f510 2023-11-04T01:43:24.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.178+0000 7f8a2c35e640 1 -- 172.21.15.77:0/55142465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a2415f510 msgr2=0x7f8a240cb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.178+0000 7f8a2c35e640 1 --2- 172.21.15.77:0/55142465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a2415f510 0x7f8a240cb150 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f8a14009870 tx=0x7f8a1402b8f0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.178+0000 7f8a2c35e640 1 -- 172.21.15.77:0/55142465 shutdown_connections 2023-11-04T01:43:24.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.178+0000 7f8a2c35e640 1 --2- 172.21.15.77:0/55142465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a2415f510 0x7f8a240cb150 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.178+0000 7f8a2c35e640 1 --2- 172.21.15.77:0/55142465 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8a24151ea0 0x7f8a2415b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.178+0000 7f8a2c35e640 1 -- 172.21.15.77:0/55142465 >> 172.21.15.77:0/55142465 conn(0x7f8a240b05d0 msgr2=0x7f8a240b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:24.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.178+0000 7f8a2c35e640 1 -- 172.21.15.77:0/55142465 shutdown_connections 2023-11-04T01:43:24.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.178+0000 7f8a2c35e640 1 -- 172.21.15.77:0/55142465 wait complete. 2023-11-04T01:43:24.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.179+0000 7f8a2c35e640 1 Processor -- start 2023-11-04T01:43:24.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.179+0000 7f8a2c35e640 1 -- start start 2023-11-04T01:43:24.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.180+0000 7f8a2c35e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a2406dd50 0x7f8a240c9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.180+0000 7f8a2c35e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8a24151ea0 0x7f8a240b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.180+0000 7f8a2c35e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a2415f510 0x7f8a240b4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.180+0000 7f8a2c35e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a241f35c0 con 0x7f8a2406dd50 2023-11-04T01:43:24.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.180+0000 7f8a2c35e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a241f2c90 con 0x7f8a2415f510 2023-11-04T01:43:24.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.180+0000 7f8a2c35e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a241f2f00 con 0x7f8a24151ea0 2023-11-04T01:43:24.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.180+0000 7f8a2a0fa640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a2406dd50 0x7f8a240c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.180+0000 7f8a2a0fa640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a2406dd50 0x7f8a240c9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39196/0 (socket says 172.21.15.77:39196) 2023-11-04T01:43:24.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.180+0000 7f8a2a0fa640 1 -- 172.21.15.77:0/2743083989 learned_addr learned my addr 172.21.15.77:0/2743083989 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:24.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.180+0000 7f8a2a8fb640 1 --2- 172.21.15.77:0/2743083989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a2415f510 0x7f8a240b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.180+0000 7f8a298f9640 1 --2- 172.21.15.77:0/2743083989 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8a24151ea0 0x7f8a240b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.180+0000 7f8a2a0fa640 1 -- 172.21.15.77:0/2743083989 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8a24151ea0 msgr2=0x7f8a240b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.180+0000 7f8a2a0fa640 1 --2- 172.21.15.77:0/2743083989 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8a24151ea0 0x7f8a240b3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.180+0000 7f8a2a0fa640 1 -- 172.21.15.77:0/2743083989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a2415f510 msgr2=0x7f8a240b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.180+0000 7f8a2a0fa640 1 --2- 172.21.15.77:0/2743083989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a2415f510 0x7f8a240b4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.180+0000 7f8a2a0fa640 1 -- 172.21.15.77:0/2743083989 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a140094d0 con 0x7f8a2406dd50 2023-11-04T01:43:24.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.180+0000 7f8a298f9640 1 --2- 172.21.15.77:0/2743083989 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8a24151ea0 0x7f8a240b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:24.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.181+0000 7f8a2a0fa640 1 --2- 172.21.15.77:0/2743083989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a2406dd50 0x7f8a240c9550 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f8a2000ba80 tx=0x7f8a2000bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:24.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.181+0000 7f8a1affd640 1 -- 172.21.15.77:0/2743083989 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2000cc00 con 0x7f8a2406dd50 2023-11-04T01:43:24.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.181+0000 7f8a1affd640 1 -- 172.21.15.77:0/2743083989 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2000cd80 con 0x7f8a2406dd50 2023-11-04T01:43:24.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.181+0000 7f8a1affd640 1 -- 172.21.15.77:0/2743083989 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a20014680 con 0x7f8a2406dd50 2023-11-04T01:43:24.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.181+0000 7f8a2c35e640 1 -- 172.21.15.77:0/2743083989 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a241f31e0 con 0x7f8a2406dd50 2023-11-04T01:43:24.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.181+0000 7f8a2c35e640 1 -- 172.21.15.77:0/2743083989 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a240b47c0 con 0x7f8a2406dd50 2023-11-04T01:43:24.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.182+0000 7f8a2c35e640 1 -- 172.21.15.77:0/2743083989 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a2404e490 con 0x7f8a2406dd50 2023-11-04T01:43:24.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.182+0000 7f8a1affd640 1 -- 172.21.15.77:0/2743083989 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8a2001d3b0 con 0x7f8a2406dd50 2023-11-04T01:43:24.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.182+0000 7f8a1affd640 1 --2- 172.21.15.77:0/2743083989 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8a0806ae70 0x7f8a0806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.183+0000 7f8a1affd640 1 -- 172.21.15.77:0/2743083989 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6268+0+0 (secure 0 0 0) 0x7f8a20089790 con 0x7f8a2406dd50 2023-11-04T01:43:24.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.183+0000 7f8a298f9640 1 --2- 172.21.15.77:0/2743083989 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8a0806ae70 0x7f8a0806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.183+0000 7f8a298f9640 1 --2- 172.21.15.77:0/2743083989 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8a0806ae70 0x7f8a0806d330 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8a14036000 tx=0x7f8a1403c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:24.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.187+0000 7f8a1affd640 1 -- 172.21.15.77:0/2743083989 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8a200546a0 con 0x7f8a2406dd50 2023-11-04T01:43:24.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.354+0000 7f8a2c35e640 1 -- 172.21.15.77:0/2743083989 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8a240ca3a0 con 0x7f8a2406dd50 2023-11-04T01:43:24.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.918+0000 7f8a1affd640 1 -- 172.21.15.77:0/2743083989 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v93) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8a20057cc0 con 0x7f8a2406dd50 2023-11-04T01:43:24.920 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_metadata' created 2023-11-04T01:43:24.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.921+0000 7f8a2c35e640 1 -- 172.21.15.77:0/2743083989 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8a0806ae70 msgr2=0x7f8a0806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.921+0000 7f8a2c35e640 1 --2- 172.21.15.77:0/2743083989 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8a0806ae70 0x7f8a0806d330 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8a14036000 tx=0x7f8a1403c040 comp rx=0 tx=0).stop 2023-11-04T01:43:24.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.921+0000 7f8a2c35e640 1 -- 172.21.15.77:0/2743083989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a2406dd50 msgr2=0x7f8a240c9550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.921+0000 7f8a2c35e640 1 --2- 172.21.15.77:0/2743083989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a2406dd50 0x7f8a240c9550 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f8a2000ba80 tx=0x7f8a2000bf40 comp rx=0 tx=0).stop 2023-11-04T01:43:24.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.921+0000 7f8a2c35e640 1 -- 172.21.15.77:0/2743083989 shutdown_connections 2023-11-04T01:43:24.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.921+0000 7f8a2c35e640 1 --2- 172.21.15.77:0/2743083989 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8a0806ae70 0x7f8a0806d330 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.921+0000 7f8a2c35e640 1 --2- 172.21.15.77:0/2743083989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a2415f510 0x7f8a240b4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.921+0000 7f8a2c35e640 1 --2- 172.21.15.77:0/2743083989 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8a24151ea0 0x7f8a240b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.921+0000 7f8a2c35e640 1 --2- 172.21.15.77:0/2743083989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a2406dd50 0x7f8a240c9550 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.921+0000 7f8a2c35e640 1 -- 172.21.15.77:0/2743083989 >> 172.21.15.77:0/2743083989 conn(0x7f8a240b05d0 msgr2=0x7f8a240cd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:24.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.921+0000 7f8a2c35e640 1 -- 172.21.15.77:0/2743083989 shutdown_connections 2023-11-04T01:43:24.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:24.921+0000 7f8a2c35e640 1 -- 172.21.15.77:0/2743083989 wait complete. 2023-11-04T01:43:24.939 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T01:43:25.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.045+0000 7f878c54c640 1 Processor -- start 2023-11-04T01:43:25.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.045+0000 7f878c54c640 1 -- start start 2023-11-04T01:43:25.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.046+0000 7f878c54c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8784159c00 0x7f87840cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.046+0000 7f878c54c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f87840ae1d0 0x7f87840c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.046+0000 7f878c54c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f878415aff0 con 0x7f87840c48e0 2023-11-04T01:43:25.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.046+0000 7f878c54c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87840c52d0 con 0x7f8784159c00 2023-11-04T01:43:25.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.046+0000 7f878c54c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878415a3e0 con 0x7f87840ae1d0 2023-11-04T01:43:25.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.046+0000 7f878aae9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f87840ae1d0 0x7f87840c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.046+0000 7f878a2e8640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8784159c00 0x7f87840cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.046+0000 7f8789ae7640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f87840c48e0 0x7f87840adac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:53822/0 (socket says 172.21.15.77:53822) 2023-11-04T01:43:25.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.046+0000 7f8789ae7640 1 -- 172.21.15.77:0/2190173528 learned_addr learned my addr 172.21.15.77:0/2190173528 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:25.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.047+0000 7f878a2e8640 1 -- 172.21.15.77:0/2190173528 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f87840ae1d0 msgr2=0x7f87840c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:25.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.047+0000 7f878a2e8640 1 --2- 172.21.15.77:0/2190173528 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f87840ae1d0 0x7f87840c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.047+0000 7f878a2e8640 1 -- 172.21.15.77:0/2190173528 >> v1:172.21.15.122:6789/0 conn(0x7f87840c48e0 legacy=0x7f87840adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.047+0000 7f878a2e8640 1 -- 172.21.15.77:0/2190173528 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878415a6c0 con 0x7f8784159c00 2023-11-04T01:43:25.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.047+0000 7f878aae9640 1 --2- 172.21.15.77:0/2190173528 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f87840ae1d0 0x7f87840c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:43:25.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.047+0000 7f878a2e8640 1 --2- 172.21.15.77:0/2190173528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8784159c00 0x7f87840cc890 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f87800097a0 tx=0x7f878002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b18f8a42c74103b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:25.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.048+0000 7f87892e6640 1 -- 172.21.15.77:0/2190173528 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878002e070 con 0x7f8784159c00 2023-11-04T01:43:25.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.048+0000 7f87892e6640 1 -- 172.21.15.77:0/2190173528 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87800315a0 con 0x7f8784159c00 2023-11-04T01:43:25.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.048+0000 7f87892e6640 1 -- 172.21.15.77:0/2190173528 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8780031930 con 0x7f8784159c00 2023-11-04T01:43:25.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.048+0000 7f878c54c640 1 -- 172.21.15.77:0/2190173528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8784159c00 msgr2=0x7f87840cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.048+0000 7f878c54c640 1 --2- 172.21.15.77:0/2190173528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8784159c00 0x7f87840cc890 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f87800097a0 tx=0x7f878002b840 comp rx=0 tx=0).stop 2023-11-04T01:43:25.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.048+0000 7f878c54c640 1 -- 172.21.15.77:0/2190173528 shutdown_connections 2023-11-04T01:43:25.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.048+0000 7f878c54c640 1 --2- 172.21.15.77:0/2190173528 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f87840ae1d0 0x7f87840c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.048+0000 7f878c54c640 1 --2- 172.21.15.77:0/2190173528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8784159c00 0x7f87840cc890 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.048+0000 7f878c54c640 1 -- 172.21.15.77:0/2190173528 >> 172.21.15.77:0/2190173528 conn(0x7f87840ce950 msgr2=0x7f87840ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:25.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.048+0000 7f878c54c640 1 -- 172.21.15.77:0/2190173528 shutdown_connections 2023-11-04T01:43:25.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.048+0000 7f878c54c640 1 -- 172.21.15.77:0/2190173528 wait complete. 2023-11-04T01:43:25.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.049+0000 7f878c54c640 1 Processor -- start 2023-11-04T01:43:25.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.049+0000 7f878c54c640 1 -- start start 2023-11-04T01:43:25.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.050+0000 7f878c54c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f87840ae1d0 0x7f8784155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.050+0000 7f878c54c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87840c48e0 0x7f8784152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.050+0000 7f878c54c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8784159c00 0x7f8784157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.050+0000 7f878c54c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8784152ea0 con 0x7f87840c48e0 2023-11-04T01:43:25.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.050+0000 7f878c54c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8784155e00 con 0x7f8784159c00 2023-11-04T01:43:25.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.050+0000 7f878c54c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878414e440 con 0x7f87840ae1d0 2023-11-04T01:43:25.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.050+0000 7f8789ae7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87840c48e0 0x7f8784152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.050+0000 7f8789ae7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87840c48e0 0x7f8784152960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39200/0 (socket says 172.21.15.77:39200) 2023-11-04T01:43:25.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.050+0000 7f8789ae7640 1 -- 172.21.15.77:0/2092327027 learned_addr learned my addr 172.21.15.77:0/2092327027 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:25.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.050+0000 7f878a2e8640 1 --2- 172.21.15.77:0/2092327027 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f87840ae1d0 0x7f8784155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.050+0000 7f878aae9640 1 --2- 172.21.15.77:0/2092327027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8784159c00 0x7f8784157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.050+0000 7f8789ae7640 1 -- 172.21.15.77:0/2092327027 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f87840ae1d0 msgr2=0x7f8784155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.050+0000 7f8789ae7640 1 --2- 172.21.15.77:0/2092327027 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f87840ae1d0 0x7f8784155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.050+0000 7f8789ae7640 1 -- 172.21.15.77:0/2092327027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8784159c00 msgr2=0x7f8784157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.050+0000 7f8789ae7640 1 --2- 172.21.15.77:0/2092327027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8784159c00 0x7f8784157280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.050+0000 7f8789ae7640 1 -- 172.21.15.77:0/2092327027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877c009a70 con 0x7f87840c48e0 2023-11-04T01:43:25.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.051+0000 7f8789ae7640 1 --2- 172.21.15.77:0/2092327027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87840c48e0 0x7f8784152960 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f877400c4a0 tx=0x7f877400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:25.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.051+0000 7f877affd640 1 -- 172.21.15.77:0/2092327027 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8774005ce0 con 0x7f87840c48e0 2023-11-04T01:43:25.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.051+0000 7f877affd640 1 -- 172.21.15.77:0/2092327027 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8774005e40 con 0x7f87840c48e0 2023-11-04T01:43:25.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.051+0000 7f878c54c640 1 -- 172.21.15.77:0/2092327027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8780009400 con 0x7f87840c48e0 2023-11-04T01:43:25.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.051+0000 7f877affd640 1 -- 172.21.15.77:0/2092327027 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87740072d0 con 0x7f87840c48e0 2023-11-04T01:43:25.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.051+0000 7f878c54c640 1 -- 172.21.15.77:0/2092327027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f878414ea00 con 0x7f87840c48e0 2023-11-04T01:43:25.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.052+0000 7f878c54c640 1 -- 172.21.15.77:0/2092327027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8784074290 con 0x7f87840c48e0 2023-11-04T01:43:25.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.052+0000 7f877affd640 1 -- 172.21.15.77:0/2092327027 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8774007430 con 0x7f87840c48e0 2023-11-04T01:43:25.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.053+0000 7f877affd640 1 --2- 172.21.15.77:0/2092327027 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f876806ae70 0x7f876806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.053+0000 7f877affd640 1 -- 172.21.15.77:0/2092327027 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6638+0+0 (secure 0 0 0) 0x7f8774088e10 con 0x7f87840c48e0 2023-11-04T01:43:25.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.053+0000 7f878a2e8640 1 --2- 172.21.15.77:0/2092327027 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f876806ae70 0x7f876806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.053+0000 7f878a2e8640 1 --2- 172.21.15.77:0/2092327027 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f876806ae70 0x7f876806d330 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8780036000 tx=0x7f878003d040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:25.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.057+0000 7f877affd640 1 -- 172.21.15.77:0/2092327027 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8774053bd0 con 0x7f87840c48e0 2023-11-04T01:43:25.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.223+0000 7f878c54c640 1 -- 172.21.15.77:0/2092327027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f87840b4850 con 0x7f87840c48e0 2023-11-04T01:43:25.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.920+0000 7f877affd640 1 -- 172.21.15.77:0/2092327027 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v94) v1 ==== 170+0+0 (secure 0 0 0) 0x7f87740170d0 con 0x7f87840c48e0 2023-11-04T01:43:25.923 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data' created 2023-11-04T01:43:25.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.924+0000 7f878c54c640 1 -- 172.21.15.77:0/2092327027 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f876806ae70 msgr2=0x7f876806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.924+0000 7f878c54c640 1 --2- 172.21.15.77:0/2092327027 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f876806ae70 0x7f876806d330 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8780036000 tx=0x7f878003d040 comp rx=0 tx=0).stop 2023-11-04T01:43:25.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.924+0000 7f878c54c640 1 -- 172.21.15.77:0/2092327027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87840c48e0 msgr2=0x7f8784152960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.924+0000 7f878c54c640 1 --2- 172.21.15.77:0/2092327027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87840c48e0 0x7f8784152960 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f877400c4a0 tx=0x7f877400c8a0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.927+0000 7f878c54c640 1 -- 172.21.15.77:0/2092327027 shutdown_connections 2023-11-04T01:43:25.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.927+0000 7f878c54c640 1 --2- 172.21.15.77:0/2092327027 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f876806ae70 0x7f876806d330 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.927+0000 7f878c54c640 1 --2- 172.21.15.77:0/2092327027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8784159c00 0x7f8784157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.927+0000 7f878c54c640 1 --2- 172.21.15.77:0/2092327027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87840c48e0 0x7f8784152960 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.927+0000 7f878c54c640 1 --2- 172.21.15.77:0/2092327027 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f87840ae1d0 0x7f8784155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.927+0000 7f878c54c640 1 -- 172.21.15.77:0/2092327027 >> 172.21.15.77:0/2092327027 conn(0x7f87840ce950 msgr2=0x7f87840c7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:25.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.932+0000 7f878c54c640 1 -- 172.21.15.77:0/2092327027 shutdown_connections 2023-11-04T01:43:25.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:25.935+0000 7f878c54c640 1 -- 172.21.15.77:0/2092327027 wait complete. 2023-11-04T01:43:25.956 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T01:43:26.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.060+0000 7fdee1ea9640 1 Processor -- start 2023-11-04T01:43:26.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.060+0000 7fdee1ea9640 1 -- start start 2023-11-04T01:43:26.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.061+0000 7fdee1ea9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdedc15ad30 0x7fdedc0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.061+0000 7fdee1ea9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdedc0c3900 con 0x7fdedc070e20 2023-11-04T01:43:26.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.061+0000 7fdee1ea9640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdedc0c3be0 con 0x7fdedc0ad730 2023-11-04T01:43:26.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.061+0000 7fdee1ea9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc0ae260 con 0x7fdedc15ad30 2023-11-04T01:43:26.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.061+0000 7fdedbfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fdedc070e20 0x7fdedc15e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40360/0 (socket says 172.21.15.77:40360) 2023-11-04T01:43:26.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.061+0000 7fdedbfff640 1 -- 172.21.15.77:0/130978698 learned_addr learned my addr 172.21.15.77:0/130978698 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:26.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.062+0000 7fdeda7fc640 1 -- 172.21.15.77:0/130978698 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3503856944 0 0) 0x7fdedc0c3900 con 0x7fdedc070e20 2023-11-04T01:43:26.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.062+0000 7fdeda7fc640 1 -- 172.21.15.77:0/130978698 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdec4003520 con 0x7fdedc070e20 2023-11-04T01:43:26.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.062+0000 7fdedb7fe640 1 --2- 172.21.15.77:0/130978698 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdedc15ad30 0x7fdedc0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.062+0000 7fdeda7fc640 1 -- 172.21.15.77:0/130978698 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1100472810 0 0) 0x7fdec4003520 con 0x7fdedc070e20 2023-11-04T01:43:26.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.062+0000 7fdeda7fc640 1 -- 172.21.15.77:0/130978698 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdedc15ad30 msgr2=0x7fdedc0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:26.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.062+0000 7fdeda7fc640 1 --2- 172.21.15.77:0/130978698 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdedc15ad30 0x7fdedc0adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.062+0000 7fdeda7fc640 1 -- 172.21.15.77:0/130978698 >> v1:172.21.15.122:6789/0 conn(0x7fdedc0ad730 legacy=0x7fdedc070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.062+0000 7fdeda7fc640 1 -- 172.21.15.77:0/130978698 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdedc0c3ec0 con 0x7fdedc070e20 2023-11-04T01:43:26.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.062+0000 7fdeda7fc640 1 -- 172.21.15.77:0/130978698 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7fded40019f0 con 0x7fdedc070e20 2023-11-04T01:43:26.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.062+0000 7fdeda7fc640 1 -- 172.21.15.77:0/130978698 >> v1:172.21.15.77:6789/0 conn(0x7fdedc070e20 legacy=0x7fdedc15e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.062+0000 7fdeda7fc640 1 --2- 172.21.15.77:0/130978698 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdedc15ad30 0x7fdec40039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.062+0000 7fdeda7fc640 1 --2- 172.21.15.77:0/130978698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdec4003fd0 0x7fdec40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.062+0000 7fdeda7fc640 1 --2- 172.21.15.77:0/130978698 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdec4004d00 0x7fdec4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.062+0000 7fdeda7fc640 1 -- 172.21.15.77:0/130978698 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc0ae260 con 0x7fdec4003fd0 2023-11-04T01:43:26.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.062+0000 7fdeda7fc640 1 -- 172.21.15.77:0/130978698 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec400bbc0 con 0x7fdec4004d00 2023-11-04T01:43:26.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.062+0000 7fdeda7fc640 1 -- 172.21.15.77:0/130978698 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec400bd80 con 0x7fdedc15ad30 2023-11-04T01:43:26.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.062+0000 7fdedaffd640 1 --2- 172.21.15.77:0/130978698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdec4003fd0 0x7fdec40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.062+0000 7fdedb7fe640 1 --2- 172.21.15.77:0/130978698 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdedc15ad30 0x7fdec40039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.062+0000 7fdedbfff640 1 --2- 172.21.15.77:0/130978698 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdec4004d00 0x7fdec4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.062+0000 7fdedaffd640 1 -- 172.21.15.77:0/130978698 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdedc15ad30 msgr2=0x7fdec40039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:26.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.062+0000 7fdedaffd640 1 --2- 172.21.15.77:0/130978698 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdedc15ad30 0x7fdec40039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.062+0000 7fdedaffd640 1 -- 172.21.15.77:0/130978698 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdec4004d00 msgr2=0x7fdec4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:26.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.062+0000 7fdedaffd640 1 --2- 172.21.15.77:0/130978698 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdec4004d00 0x7fdec4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.062+0000 7fdedaffd640 1 -- 172.21.15.77:0/130978698 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec4003520 con 0x7fdec4003fd0 2023-11-04T01:43:26.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.062+0000 7fdedb7fe640 1 --2- 172.21.15.77:0/130978698 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdedc15ad30 0x7fdec40039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:26.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.063+0000 7fdedaffd640 1 --2- 172.21.15.77:0/130978698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdec4003fd0 0x7fdec40047c0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fded0001750 tx=0x7fdec40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f46a4fb70fbc60 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:26.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.063+0000 7fdeda7fc640 1 -- 172.21.15.77:0/130978698 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded00052d0 con 0x7fdec4003fd0 2023-11-04T01:43:26.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.063+0000 7fdeda7fc640 1 -- 172.21.15.77:0/130978698 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded002e050 con 0x7fdec4003fd0 2023-11-04T01:43:26.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.063+0000 7fdeda7fc640 1 -- 172.21.15.77:0/130978698 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded0003830 con 0x7fdec4003fd0 2023-11-04T01:43:26.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.064+0000 7fdee1ea9640 1 -- 172.21.15.77:0/130978698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdec4003fd0 msgr2=0x7fdec40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.064+0000 7fdee1ea9640 1 --2- 172.21.15.77:0/130978698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdec4003fd0 0x7fdec40047c0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fded0001750 tx=0x7fdec40057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.064+0000 7fdedbfff640 1 -- 172.21.15.77:0/130978698 reap_dead start 2023-11-04T01:43:26.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.064+0000 7fdee1ea9640 1 -- 172.21.15.77:0/130978698 shutdown_connections 2023-11-04T01:43:26.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.064+0000 7fdee1ea9640 1 -- 172.21.15.77:0/130978698 >> 172.21.15.77:0/130978698 conn(0x7fdedc0ce950 msgr2=0x7fdedc0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:26.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.064+0000 7fdee1ea9640 1 -- 172.21.15.77:0/130978698 shutdown_connections 2023-11-04T01:43:26.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.064+0000 7fdee1ea9640 1 -- 172.21.15.77:0/130978698 wait complete. 2023-11-04T01:43:26.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.065+0000 7fdee1ea9640 1 Processor -- start 2023-11-04T01:43:26.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.065+0000 7fdee1ea9640 1 -- start start 2023-11-04T01:43:26.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.066+0000 7fdee1ea9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdec4003fd0 0x7fdedc14c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.066+0000 7fdee1ea9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdedc1501c0 0x7fdedc0c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.066+0000 7fdee1ea9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdedc150640 0x7fdedc0c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.066+0000 7fdee1ea9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc14ef10 con 0x7fdec4003fd0 2023-11-04T01:43:26.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.066+0000 7fdee1ea9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc14cb30 con 0x7fdedc150640 2023-11-04T01:43:26.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.066+0000 7fdee1ea9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc14f120 con 0x7fdedc1501c0 2023-11-04T01:43:26.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.066+0000 7fdedb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdec4003fd0 0x7fdedc14c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.066+0000 7fdedb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdec4003fd0 0x7fdedc14c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39228/0 (socket says 172.21.15.77:39228) 2023-11-04T01:43:26.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.066+0000 7fdedb7fe640 1 -- 172.21.15.77:0/1652153714 learned_addr learned my addr 172.21.15.77:0/1652153714 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:26.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.066+0000 7fdedbfff640 1 --2- 172.21.15.77:0/1652153714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdedc150640 0x7fdedc0c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.066+0000 7fdedaffd640 1 --2- 172.21.15.77:0/1652153714 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdedc1501c0 0x7fdedc0c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.066+0000 7fdedb7fe640 1 -- 172.21.15.77:0/1652153714 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdedc1501c0 msgr2=0x7fdedc0c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.066+0000 7fdedb7fe640 1 --2- 172.21.15.77:0/1652153714 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdedc1501c0 0x7fdedc0c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.066+0000 7fdedb7fe640 1 -- 172.21.15.77:0/1652153714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdedc150640 msgr2=0x7fdedc0c7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.066+0000 7fdedb7fe640 1 --2- 172.21.15.77:0/1652153714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdedc150640 0x7fdedc0c7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.066+0000 7fdedb7fe640 1 -- 172.21.15.77:0/1652153714 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdedc14f400 con 0x7fdec4003fd0 2023-11-04T01:43:26.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.066+0000 7fdedaffd640 1 --2- 172.21.15.77:0/1652153714 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdedc1501c0 0x7fdedc0c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:26.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.066+0000 7fdedbfff640 1 --2- 172.21.15.77:0/1652153714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdedc150640 0x7fdedc0c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:26.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.066+0000 7fdedb7fe640 1 --2- 172.21.15.77:0/1652153714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdec4003fd0 0x7fdedc14c5f0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fdecc006a90 tx=0x7fdecc004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:26.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.066+0000 7fdec3fff640 1 -- 172.21.15.77:0/1652153714 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdecc014870 con 0x7fdec4003fd0 2023-11-04T01:43:26.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.066+0000 7fdec3fff640 1 -- 172.21.15.77:0/1652153714 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdecc0149d0 con 0x7fdec4003fd0 2023-11-04T01:43:26.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.066+0000 7fdee1ea9640 1 -- 172.21.15.77:0/1652153714 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdedc14f6e0 con 0x7fdec4003fd0 2023-11-04T01:43:26.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.066+0000 7fdec3fff640 1 -- 172.21.15.77:0/1652153714 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdecc014d60 con 0x7fdec4003fd0 2023-11-04T01:43:26.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.066+0000 7fdee1ea9640 1 -- 172.21.15.77:0/1652153714 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdedc14fca0 con 0x7fdec4003fd0 2023-11-04T01:43:26.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.068+0000 7fdee1ea9640 1 -- 172.21.15.77:0/1652153714 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdedc074290 con 0x7fdec4003fd0 2023-11-04T01:43:26.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.068+0000 7fdec3fff640 1 -- 172.21.15.77:0/1652153714 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdecc015410 con 0x7fdec4003fd0 2023-11-04T01:43:26.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.069+0000 7fdec3fff640 1 --2- 172.21.15.77:0/1652153714 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdec806ae70 0x7fdec806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.069+0000 7fdec3fff640 1 -- 172.21.15.77:0/1652153714 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 7020+0+0 (secure 0 0 0) 0x7fdecc08a310 con 0x7fdec4003fd0 2023-11-04T01:43:26.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.069+0000 7fdedaffd640 1 --2- 172.21.15.77:0/1652153714 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdec806ae70 0x7fdec806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.069+0000 7fdedaffd640 1 --2- 172.21.15.77:0/1652153714 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdec806ae70 0x7fdec806d330 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fded0033000 tx=0x7fded0009030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:26.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.073+0000 7fdec3fff640 1 -- 172.21.15.77:0/1652153714 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdecc054ea0 con 0x7fdec4003fd0 2023-11-04T01:43:26.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.271+0000 7fdee1ea9640 1 -- 172.21.15.77:0/1652153714 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fdedc071970 con 0x7fdec4003fd0 2023-11-04T01:43:26.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.944+0000 7fdec3fff640 1 -- 172.21.15.77:0/1652153714 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v41) v1 ==== 174+0+0 (secure 0 0 0) 0x7fdecc0584c0 con 0x7fdec4003fd0 2023-11-04T01:43:26.946 INFO:teuthology.orchestra.run.smithi077.stderr:new fs with metadata pool 16 and data pool 17 2023-11-04T01:43:26.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.946+0000 7fdee1ea9640 1 -- 172.21.15.77:0/1652153714 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdec806ae70 msgr2=0x7fdec806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.946+0000 7fdee1ea9640 1 --2- 172.21.15.77:0/1652153714 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdec806ae70 0x7fdec806d330 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fded0033000 tx=0x7fded0009030 comp rx=0 tx=0).stop 2023-11-04T01:43:26.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.946+0000 7fdee1ea9640 1 -- 172.21.15.77:0/1652153714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdec4003fd0 msgr2=0x7fdedc14c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.946+0000 7fdee1ea9640 1 --2- 172.21.15.77:0/1652153714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdec4003fd0 0x7fdedc14c5f0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fdecc006a90 tx=0x7fdecc004610 comp rx=0 tx=0).stop 2023-11-04T01:43:26.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.946+0000 7fdee1ea9640 1 -- 172.21.15.77:0/1652153714 shutdown_connections 2023-11-04T01:43:26.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.946+0000 7fdee1ea9640 1 --2- 172.21.15.77:0/1652153714 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdec806ae70 0x7fdec806d330 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.946+0000 7fdee1ea9640 1 --2- 172.21.15.77:0/1652153714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdedc150640 0x7fdedc0c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.946+0000 7fdee1ea9640 1 --2- 172.21.15.77:0/1652153714 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdedc1501c0 0x7fdedc0c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.946+0000 7fdee1ea9640 1 --2- 172.21.15.77:0/1652153714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdec4003fd0 0x7fdedc14c5f0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.946+0000 7fdee1ea9640 1 -- 172.21.15.77:0/1652153714 >> 172.21.15.77:0/1652153714 conn(0x7fdedc0ce950 msgr2=0x7fdedc0c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:26.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.946+0000 7fdee1ea9640 1 -- 172.21.15.77:0/1652153714 shutdown_connections 2023-11-04T01:43:26.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:26.946+0000 7fdee1ea9640 1 -- 172.21.15.77:0/1652153714 wait complete. 2023-11-04T01:43:26.962 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:27.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.060+0000 7f4020051640 1 Processor -- start 2023-11-04T01:43:27.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.060+0000 7f4020051640 1 -- start start 2023-11-04T01:43:27.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.061+0000 7f4020051640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f401815cfd0 0x7f40180b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.061+0000 7f4020051640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4018070e90 0x7f401806ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.061+0000 7f4020051640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40180714b0 con 0x7f40180b0910 2023-11-04T01:43:27.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.061+0000 7f4020051640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40180ab8e0 con 0x7f401815cfd0 2023-11-04T01:43:27.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.061+0000 7f4020051640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40180712c0 con 0x7f4018070e90 2023-11-04T01:43:27.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.061+0000 7f401dded640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f401815cfd0 0x7f40180b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.061+0000 7f401d5ec640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f40180b0910 0x7f4018070780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40366/0 (socket says 172.21.15.77:40366) 2023-11-04T01:43:27.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.061+0000 7f401d5ec640 1 -- 172.21.15.77:0/158148003 learned_addr learned my addr 172.21.15.77:0/158148003 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:27.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.061+0000 7f401dded640 1 -- 172.21.15.77:0/158148003 >> v2:172.21.15.122:3300/0 conn(0x7f4018070e90 msgr2=0x7f401806ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:27.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.061+0000 7f401dded640 1 --2- 172.21.15.77:0/158148003 >> v2:172.21.15.122:3300/0 conn(0x7f4018070e90 0x7f401806ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.061+0000 7f401dded640 1 -- 172.21.15.77:0/158148003 >> v1:172.21.15.77:6789/0 conn(0x7f40180b0910 legacy=0x7f4018070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:27.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.061+0000 7f401dded640 1 -- 172.21.15.77:0/158148003 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4018071790 con 0x7f401815cfd0 2023-11-04T01:43:27.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.061+0000 7f401cdeb640 1 -- 172.21.15.77:0/158148003 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 91577057 0 0) 0x7f40180714b0 con 0x7f40180b0910 2023-11-04T01:43:27.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.062+0000 7f401dded640 1 --2- 172.21.15.77:0/158148003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f401815cfd0 0x7f40180b03d0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f40180cf8a0 tx=0x7f401402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d9b5e31101efc05 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:27.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.062+0000 7f401cdeb640 1 -- 172.21.15.77:0/158148003 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401402cc80 con 0x7f401815cfd0 2023-11-04T01:43:27.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.062+0000 7f401cdeb640 1 -- 172.21.15.77:0/158148003 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f401402cde0 con 0x7f401815cfd0 2023-11-04T01:43:27.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.062+0000 7f401cdeb640 1 -- 172.21.15.77:0/158148003 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4014034660 con 0x7f401815cfd0 2023-11-04T01:43:27.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.063+0000 7f4020051640 1 -- 172.21.15.77:0/158148003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f401815cfd0 msgr2=0x7f40180b03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:27.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.063+0000 7f4020051640 1 --2- 172.21.15.77:0/158148003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f401815cfd0 0x7f40180b03d0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f40180cf8a0 tx=0x7f401402bed0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.063+0000 7f4020051640 1 -- 172.21.15.77:0/158148003 shutdown_connections 2023-11-04T01:43:27.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.063+0000 7f4020051640 1 --2- 172.21.15.77:0/158148003 >> v2:172.21.15.122:3300/0 conn(0x7f4018070e90 0x7f401806ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.063+0000 7f4020051640 1 --2- 172.21.15.77:0/158148003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f401815cfd0 0x7f40180b03d0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.063+0000 7f4020051640 1 -- 172.21.15.77:0/158148003 >> 172.21.15.77:0/158148003 conn(0x7f40180ce950 msgr2=0x7f40180ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:27.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.063+0000 7f4020051640 1 -- 172.21.15.77:0/158148003 shutdown_connections 2023-11-04T01:43:27.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.063+0000 7f4020051640 1 -- 172.21.15.77:0/158148003 wait complete. 2023-11-04T01:43:27.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.064+0000 7f4020051640 1 Processor -- start 2023-11-04T01:43:27.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.064+0000 7f4020051640 1 -- start start 2023-11-04T01:43:27.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.065+0000 7f4020051640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4018070e90 0x7f401814f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.065+0000 7f4020051640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f40180b0910 0x7f401815d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.065+0000 7f4020051640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f401815cfd0 0x7f40181f5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.065+0000 7f4020051640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401815e080 con 0x7f4018070e90 2023-11-04T01:43:27.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.065+0000 7f4020051640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401815e360 con 0x7f401815cfd0 2023-11-04T01:43:27.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.065+0000 7f4020051640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f401815e640 con 0x7f40180b0910 2023-11-04T01:43:27.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.065+0000 7f401dded640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4018070e90 0x7f401814f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.065+0000 7f401dded640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4018070e90 0x7f401814f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39260/0 (socket says 172.21.15.77:39260) 2023-11-04T01:43:27.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.065+0000 7f401dded640 1 -- 172.21.15.77:0/3865732214 learned_addr learned my addr 172.21.15.77:0/3865732214 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:27.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.065+0000 7f401d5ec640 1 --2- 172.21.15.77:0/3865732214 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f40180b0910 0x7f401815d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.065+0000 7f401e5ee640 1 --2- 172.21.15.77:0/3865732214 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f401815cfd0 0x7f40181f5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.065+0000 7f401dded640 1 -- 172.21.15.77:0/3865732214 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f40180b0910 msgr2=0x7f401815d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:27.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.065+0000 7f401dded640 1 --2- 172.21.15.77:0/3865732214 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f40180b0910 0x7f401815d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.065+0000 7f401dded640 1 -- 172.21.15.77:0/3865732214 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f401815cfd0 msgr2=0x7f40181f5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:27.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.065+0000 7f401dded640 1 --2- 172.21.15.77:0/3865732214 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f401815cfd0 0x7f40181f5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.065+0000 7f401dded640 1 -- 172.21.15.77:0/3865732214 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4014009a70 con 0x7f4018070e90 2023-11-04T01:43:27.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.065+0000 7f401e5ee640 1 --2- 172.21.15.77:0/3865732214 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f401815cfd0 0x7f40181f5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:27.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.065+0000 7f401dded640 1 --2- 172.21.15.77:0/3865732214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4018070e90 0x7f401814f6b0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f401402c4e0 tx=0x7f4014004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:27.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.065+0000 7f400e7fc640 1 -- 172.21.15.77:0/3865732214 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4014003b90 con 0x7f4018070e90 2023-11-04T01:43:27.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.065+0000 7f400e7fc640 1 -- 172.21.15.77:0/3865732214 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4014003cf0 con 0x7f4018070e90 2023-11-04T01:43:27.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.066+0000 7f4020051640 1 -- 172.21.15.77:0/3865732214 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f401815e920 con 0x7f4018070e90 2023-11-04T01:43:27.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.066+0000 7f400e7fc640 1 -- 172.21.15.77:0/3865732214 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4014004270 con 0x7f4018070e90 2023-11-04T01:43:27.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.066+0000 7f4020051640 1 -- 172.21.15.77:0/3865732214 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f401815dd70 con 0x7f4018070e90 2023-11-04T01:43:27.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.066+0000 7f4020051640 1 -- 172.21.15.77:0/3865732214 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4018074290 con 0x7f4018070e90 2023-11-04T01:43:27.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.067+0000 7f400e7fc640 1 -- 172.21.15.77:0/3865732214 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f40140043d0 con 0x7f4018070e90 2023-11-04T01:43:27.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.067+0000 7f400e7fc640 1 --2- 172.21.15.77:0/3865732214 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3ffc06aea0 0x7f3ffc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.067+0000 7f400e7fc640 1 -- 172.21.15.77:0/3865732214 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f40140aca90 con 0x7f4018070e90 2023-11-04T01:43:27.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.068+0000 7f401d5ec640 1 --2- 172.21.15.77:0/3865732214 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3ffc06aea0 0x7f3ffc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.068+0000 7f401d5ec640 1 --2- 172.21.15.77:0/3865732214 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3ffc06aea0 0x7f3ffc06d360 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4008007fd0 tx=0x7f4008009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:27.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.072+0000 7f400e7fc640 1 -- 172.21.15.77:0/3865732214 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4014077650 con 0x7f4018070e90 2023-11-04T01:43:27.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.238+0000 7f4020051640 1 -- 172.21.15.77:0/3865732214 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f401806c2d0 con 0x7f4018070e90 2023-11-04T01:43:27.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.240+0000 7f400e7fc640 1 -- 172.21.15.77:0/3865732214 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+22006 (secure 0 0 0) 0x7f401404d090 con 0x7f4018070e90 2023-11-04T01:43:27.242 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:43:27.242 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":95,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:43:26.273072+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:33.159064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:33.647358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:43:24.372767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-04T01:43:25.241976+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:27.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.242+0000 7f4020051640 1 -- 172.21.15.77:0/3865732214 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3ffc06aea0 msgr2=0x7f3ffc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:27.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.242+0000 7f4020051640 1 --2- 172.21.15.77:0/3865732214 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3ffc06aea0 0x7f3ffc06d360 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4008007fd0 tx=0x7f4008009040 comp rx=0 tx=0).stop 2023-11-04T01:43:27.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.242+0000 7f4020051640 1 -- 172.21.15.77:0/3865732214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4018070e90 msgr2=0x7f401814f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:27.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.242+0000 7f4020051640 1 --2- 172.21.15.77:0/3865732214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4018070e90 0x7f401814f6b0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f401402c4e0 tx=0x7f4014004a40 comp rx=0 tx=0).stop 2023-11-04T01:43:27.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.242+0000 7f4020051640 1 -- 172.21.15.77:0/3865732214 shutdown_connections 2023-11-04T01:43:27.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.242+0000 7f4020051640 1 --2- 172.21.15.77:0/3865732214 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3ffc06aea0 0x7f3ffc06d360 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.242+0000 7f4020051640 1 --2- 172.21.15.77:0/3865732214 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f401815cfd0 0x7f40181f5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.242+0000 7f4020051640 1 --2- 172.21.15.77:0/3865732214 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f40180b0910 0x7f401815d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.242+0000 7f4020051640 1 --2- 172.21.15.77:0/3865732214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4018070e90 0x7f401814f6b0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.242+0000 7f4020051640 1 -- 172.21.15.77:0/3865732214 >> 172.21.15.77:0/3865732214 conn(0x7f40180ce950 msgr2=0x7f40180c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:27.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.242+0000 7f4020051640 1 -- 172.21.15.77:0/3865732214 shutdown_connections 2023-11-04T01:43:27.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.242+0000 7f4020051640 1 -- 172.21.15.77:0/3865732214 wait complete. 2023-11-04T01:43:27.255 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:27.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.352+0000 7f4e96355640 1 Processor -- start 2023-11-04T01:43:27.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.352+0000 7f4e96355640 1 -- start start 2023-11-04T01:43:27.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.353+0000 7f4e96355640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4e900b42c0 0x7f4e900c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.353+0000 7f4e96355640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4e900c9c40 0x7f4e900b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.353+0000 7f4e96355640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e900ca050 con 0x7f4e9015ad80 2023-11-04T01:43:27.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.353+0000 7f4e96355640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e9006cfa0 con 0x7f4e900b42c0 2023-11-04T01:43:27.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.353+0000 7f4e96355640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e9006d280 con 0x7f4e900c9c40 2023-11-04T01:43:27.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.353+0000 7f4e8f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4e900b42c0 0x7f4e900c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.353+0000 7f4e8f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4e900b42c0 0x7f4e900c9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39270/0 (socket says 172.21.15.77:39270) 2023-11-04T01:43:27.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.353+0000 7f4e8f7fe640 1 -- 172.21.15.77:0/3148603495 learned_addr learned my addr 172.21.15.77:0/3148603495 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:27.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.353+0000 7f4e948f2640 1 --2- 172.21.15.77:0/3148603495 >> v2:172.21.15.122:3300/0 conn(0x7f4e900c9c40 0x7f4e900b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.354+0000 7f4e8f7fe640 1 -- 172.21.15.77:0/3148603495 >> v2:172.21.15.122:3300/0 conn(0x7f4e900c9c40 msgr2=0x7f4e900b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:27.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.354+0000 7f4e8f7fe640 1 --2- 172.21.15.77:0/3148603495 >> v2:172.21.15.122:3300/0 conn(0x7f4e900c9c40 0x7f4e900b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.354+0000 7f4e8f7fe640 1 -- 172.21.15.77:0/3148603495 >> v1:172.21.15.122:6789/0 conn(0x7f4e9015ad80 legacy=0x7f4e9006c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:27.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.354+0000 7f4e8f7fe640 1 -- 172.21.15.77:0/3148603495 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9006d560 con 0x7f4e900b42c0 2023-11-04T01:43:27.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.354+0000 7f4e8f7fe640 1 --2- 172.21.15.77:0/3148603495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e900b42c0 0x7f4e900c9700 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f4e900c8e50 tx=0x7f4e8402ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b33da3125a62d6e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:27.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.354+0000 7f4e8effd640 1 -- 172.21.15.77:0/3148603495 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8402f850 con 0x7f4e900b42c0 2023-11-04T01:43:27.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.354+0000 7f4e8effd640 1 -- 172.21.15.77:0/3148603495 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8402f9b0 con 0x7f4e900b42c0 2023-11-04T01:43:27.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.354+0000 7f4e8effd640 1 -- 172.21.15.77:0/3148603495 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8402fd40 con 0x7f4e900b42c0 2023-11-04T01:43:27.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.355+0000 7f4e96355640 1 -- 172.21.15.77:0/3148603495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e900b42c0 msgr2=0x7f4e900c9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:27.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.355+0000 7f4e96355640 1 --2- 172.21.15.77:0/3148603495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e900b42c0 0x7f4e900c9700 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f4e900c8e50 tx=0x7f4e8402ba30 comp rx=0 tx=0).stop 2023-11-04T01:43:27.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.355+0000 7f4e96355640 1 -- 172.21.15.77:0/3148603495 shutdown_connections 2023-11-04T01:43:27.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.355+0000 7f4e96355640 1 --2- 172.21.15.77:0/3148603495 >> v2:172.21.15.122:3300/0 conn(0x7f4e900c9c40 0x7f4e900b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.355+0000 7f4e96355640 1 --2- 172.21.15.77:0/3148603495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e900b42c0 0x7f4e900c9700 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.355+0000 7f4e96355640 1 -- 172.21.15.77:0/3148603495 >> 172.21.15.77:0/3148603495 conn(0x7f4e900ce950 msgr2=0x7f4e900ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:27.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.355+0000 7f4e96355640 1 -- 172.21.15.77:0/3148603495 shutdown_connections 2023-11-04T01:43:27.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.355+0000 7f4e96355640 1 -- 172.21.15.77:0/3148603495 wait complete. 2023-11-04T01:43:27.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.356+0000 7f4e96355640 1 Processor -- start 2023-11-04T01:43:27.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.356+0000 7f4e96355640 1 -- start start 2023-11-04T01:43:27.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.357+0000 7f4e96355640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e900b42c0 0x7f4e90151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.357+0000 7f4e96355640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e900c9c40 0x7f4e900c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.357+0000 7f4e96355640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4e9015ad80 0x7f4e900c5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.357+0000 7f4e96355640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e90153e80 con 0x7f4e900c9c40 2023-11-04T01:43:27.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.357+0000 7f4e96355640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e90153800 con 0x7f4e900b42c0 2023-11-04T01:43:27.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.357+0000 7f4e96355640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e900c8380 con 0x7f4e9015ad80 2023-11-04T01:43:27.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.357+0000 7f4e8f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e900c9c40 0x7f4e900c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.357+0000 7f4e8f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e900c9c40 0x7f4e900c7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39280/0 (socket says 172.21.15.77:39280) 2023-11-04T01:43:27.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.357+0000 7f4e8f7fe640 1 -- 172.21.15.77:0/3849733915 learned_addr learned my addr 172.21.15.77:0/3849733915 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:27.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.357+0000 7f4e8ffff640 1 --2- 172.21.15.77:0/3849733915 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e900b42c0 0x7f4e90151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.357+0000 7f4e948f2640 1 --2- 172.21.15.77:0/3849733915 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4e9015ad80 0x7f4e900c5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.357+0000 7f4e8f7fe640 1 -- 172.21.15.77:0/3849733915 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4e9015ad80 msgr2=0x7f4e900c5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:27.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.357+0000 7f4e8f7fe640 1 --2- 172.21.15.77:0/3849733915 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4e9015ad80 0x7f4e900c5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.357+0000 7f4e8f7fe640 1 -- 172.21.15.77:0/3849733915 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e900b42c0 msgr2=0x7f4e90151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:27.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.357+0000 7f4e8f7fe640 1 --2- 172.21.15.77:0/3849733915 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e900b42c0 0x7f4e90151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.357+0000 7f4e8f7fe640 1 -- 172.21.15.77:0/3849733915 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e840094d0 con 0x7f4e900c9c40 2023-11-04T01:43:27.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.357+0000 7f4e948f2640 1 --2- 172.21.15.77:0/3849733915 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4e9015ad80 0x7f4e900c5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:27.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.358+0000 7f4e8f7fe640 1 --2- 172.21.15.77:0/3849733915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e900c9c40 0x7f4e900c7d10 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f4e8402ba70 tx=0x7f4e84004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:27.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.358+0000 7f4e8cff9640 1 -- 172.21.15.77:0/3849733915 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e84037d10 con 0x7f4e900c9c40 2023-11-04T01:43:27.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.358+0000 7f4e8cff9640 1 -- 172.21.15.77:0/3849733915 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e84037e90 con 0x7f4e900c9c40 2023-11-04T01:43:27.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.358+0000 7f4e96355640 1 -- 172.21.15.77:0/3849733915 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e900c8660 con 0x7f4e900c9c40 2023-11-04T01:43:27.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.358+0000 7f4e8cff9640 1 -- 172.21.15.77:0/3849733915 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e84041640 con 0x7f4e900c9c40 2023-11-04T01:43:27.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.358+0000 7f4e96355640 1 -- 172.21.15.77:0/3849733915 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e90153aa0 con 0x7f4e900c9c40 2023-11-04T01:43:27.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.359+0000 7f4e96355640 1 -- 172.21.15.77:0/3849733915 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e90074290 con 0x7f4e900c9c40 2023-11-04T01:43:27.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.359+0000 7f4e8cff9640 1 -- 172.21.15.77:0/3849733915 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4e840417a0 con 0x7f4e900c9c40 2023-11-04T01:43:27.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.360+0000 7f4e8cff9640 1 --2- 172.21.15.77:0/3849733915 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4e7c06ae70 0x7f4e7c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.360+0000 7f4e8cff9640 1 -- 172.21.15.77:0/3849733915 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f4e8403c070 con 0x7f4e900c9c40 2023-11-04T01:43:27.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.360+0000 7f4e8ffff640 1 --2- 172.21.15.77:0/3849733915 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4e7c06ae70 0x7f4e7c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.360+0000 7f4e8ffff640 1 --2- 172.21.15.77:0/3849733915 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4e7c06ae70 0x7f4e7c06d330 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4e80000f60 tx=0x7f4e80009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:27.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.364+0000 7f4e8cff9640 1 -- 172.21.15.77:0/3849733915 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4e84077490 con 0x7f4e900c9c40 2023-11-04T01:43:27.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.531+0000 7f4e96355640 1 -- 172.21.15.77:0/3849733915 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e900c5c40 con 0x7f4e900c9c40 2023-11-04T01:43:27.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.532+0000 7f4e8cff9640 1 -- 172.21.15.77:0/3849733915 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+22006 (secure 0 0 0) 0x7f4e8407aab0 con 0x7f4e900c9c40 2023-11-04T01:43:27.534 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:43:27.535 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":95,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:43:26.273072+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:33.159064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:33.647358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:43:24.372767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-04T01:43:25.241976+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:27.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.534+0000 7f4e96355640 1 -- 172.21.15.77:0/3849733915 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4e7c06ae70 msgr2=0x7f4e7c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:27.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.534+0000 7f4e96355640 1 --2- 172.21.15.77:0/3849733915 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4e7c06ae70 0x7f4e7c06d330 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4e80000f60 tx=0x7f4e80009040 comp rx=0 tx=0).stop 2023-11-04T01:43:27.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.534+0000 7f4e96355640 1 -- 172.21.15.77:0/3849733915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e900c9c40 msgr2=0x7f4e900c7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:27.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.534+0000 7f4e96355640 1 --2- 172.21.15.77:0/3849733915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e900c9c40 0x7f4e900c7d10 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f4e8402ba70 tx=0x7f4e84004730 comp rx=0 tx=0).stop 2023-11-04T01:43:27.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.534+0000 7f4e96355640 1 -- 172.21.15.77:0/3849733915 shutdown_connections 2023-11-04T01:43:27.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.534+0000 7f4e96355640 1 --2- 172.21.15.77:0/3849733915 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4e7c06ae70 0x7f4e7c06d330 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.534+0000 7f4e96355640 1 --2- 172.21.15.77:0/3849733915 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4e9015ad80 0x7f4e900c5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.534+0000 7f4e96355640 1 --2- 172.21.15.77:0/3849733915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e900c9c40 0x7f4e900c7d10 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.534+0000 7f4e96355640 1 --2- 172.21.15.77:0/3849733915 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e900b42c0 0x7f4e90151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.534+0000 7f4e96355640 1 -- 172.21.15.77:0/3849733915 >> 172.21.15.77:0/3849733915 conn(0x7f4e900ce950 msgr2=0x7f4e900af5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:27.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.534+0000 7f4e96355640 1 -- 172.21.15.77:0/3849733915 shutdown_connections 2023-11-04T01:43:27.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.534+0000 7f4e96355640 1 -- 172.21.15.77:0/3849733915 wait complete. 2023-11-04T01:43:27.547 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T01:43:27.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.649+0000 7f754c3c7640 1 Processor -- start 2023-11-04T01:43:27.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.649+0000 7f754c3c7640 1 -- start start 2023-11-04T01:43:27.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.650+0000 7f754c3c7640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7544159c00 0x7f75440cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.650+0000 7f754c3c7640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f75440c48e0 0x7f75440c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.650+0000 7f754c3c7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f75440adac0 0x7f75440adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.650+0000 7f754c3c7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75440c52d0 con 0x7f75440adac0 2023-11-04T01:43:27.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.650+0000 7f754c3c7640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f754415aff0 con 0x7f7544159c00 2023-11-04T01:43:27.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.650+0000 7f754c3c7640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75440ae450 con 0x7f75440c48e0 2023-11-04T01:43:27.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.650+0000 7f754a964640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f75440adac0 0x7f75440adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.650+0000 7f754a964640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f75440adac0 0x7f75440adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35402/0 (socket says 172.21.15.77:35402) 2023-11-04T01:43:27.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.650+0000 7f754a964640 1 -- 172.21.15.77:0/1654493186 learned_addr learned my addr 172.21.15.77:0/1654493186 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:27.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.650+0000 7f754a163640 1 --2- 172.21.15.77:0/1654493186 >> v2:172.21.15.122:3300/0 conn(0x7f7544159c00 0x7f75440cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.650+0000 7f7549962640 1 --2- 172.21.15.77:0/1654493186 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f75440c48e0 0x7f75440c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.651+0000 7f754a964640 1 -- 172.21.15.77:0/1654493186 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f75440c48e0 msgr2=0x7f75440c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:27.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.651+0000 7f754a964640 1 --2- 172.21.15.77:0/1654493186 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f75440c48e0 0x7f75440c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.651+0000 7f754a964640 1 -- 172.21.15.77:0/1654493186 >> v2:172.21.15.122:3300/0 conn(0x7f7544159c00 msgr2=0x7f75440cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:27.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.651+0000 7f754a964640 1 --2- 172.21.15.77:0/1654493186 >> v2:172.21.15.122:3300/0 conn(0x7f7544159c00 0x7f75440cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.651+0000 7f754a964640 1 -- 172.21.15.77:0/1654493186 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754415a3e0 con 0x7f75440adac0 2023-11-04T01:43:27.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.651+0000 7f7549962640 1 --2- 172.21.15.77:0/1654493186 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f75440c48e0 0x7f75440c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:27.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.651+0000 7f754a163640 1 --2- 172.21.15.77:0/1654493186 >> v2:172.21.15.122:3300/0 conn(0x7f7544159c00 0x7f75440cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:27.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.651+0000 7f754a964640 1 --2- 172.21.15.77:0/1654493186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75440adac0 0x7f75440adf10 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f75440cc4d0 tx=0x7f753c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a29e3ab7f9cee90 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:27.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.651+0000 7f7549161640 1 -- 172.21.15.77:0/1654493186 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753c031870 con 0x7f75440adac0 2023-11-04T01:43:27.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.651+0000 7f7549161640 1 -- 172.21.15.77:0/1654493186 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753c0319d0 con 0x7f75440adac0 2023-11-04T01:43:27.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.651+0000 7f7549161640 1 -- 172.21.15.77:0/1654493186 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753c031d60 con 0x7f75440adac0 2023-11-04T01:43:27.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.652+0000 7f754c3c7640 1 -- 172.21.15.77:0/1654493186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75440adac0 msgr2=0x7f75440adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:27.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.652+0000 7f754c3c7640 1 --2- 172.21.15.77:0/1654493186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75440adac0 0x7f75440adf10 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f75440cc4d0 tx=0x7f753c02b910 comp rx=0 tx=0).stop 2023-11-04T01:43:27.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.652+0000 7f754c3c7640 1 -- 172.21.15.77:0/1654493186 shutdown_connections 2023-11-04T01:43:27.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.652+0000 7f754c3c7640 1 --2- 172.21.15.77:0/1654493186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75440adac0 0x7f75440adf10 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.652+0000 7f754c3c7640 1 --2- 172.21.15.77:0/1654493186 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f75440c48e0 0x7f75440c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.652+0000 7f754c3c7640 1 --2- 172.21.15.77:0/1654493186 >> v2:172.21.15.122:3300/0 conn(0x7f7544159c00 0x7f75440cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.652+0000 7f754c3c7640 1 -- 172.21.15.77:0/1654493186 >> 172.21.15.77:0/1654493186 conn(0x7f75440ce950 msgr2=0x7f75440ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:27.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.652+0000 7f754c3c7640 1 -- 172.21.15.77:0/1654493186 shutdown_connections 2023-11-04T01:43:27.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.652+0000 7f754c3c7640 1 -- 172.21.15.77:0/1654493186 wait complete. 2023-11-04T01:43:27.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.653+0000 7f754c3c7640 1 Processor -- start 2023-11-04T01:43:27.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.653+0000 7f754c3c7640 1 -- start start 2023-11-04T01:43:27.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.654+0000 7f754c3c7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f75440adac0 0x7f7544135fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.654+0000 7f754c3c7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75440c48e0 0x7f754414ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.654+0000 7f754c3c7640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7544159c00 0x7f75441f3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.654+0000 7f754c3c7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75441343d0 con 0x7f75440c48e0 2023-11-04T01:43:27.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.654+0000 7f754c3c7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75441368e0 con 0x7f75440adac0 2023-11-04T01:43:27.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.654+0000 7f754c3c7640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7544136bc0 con 0x7f7544159c00 2023-11-04T01:43:27.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.654+0000 7f7549962640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75440c48e0 0x7f754414ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.654+0000 7f7549962640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75440c48e0 0x7f754414ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35404/0 (socket says 172.21.15.77:35404) 2023-11-04T01:43:27.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.654+0000 7f7549962640 1 -- 172.21.15.77:0/737413903 learned_addr learned my addr 172.21.15.77:0/737413903 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:27.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.654+0000 7f754a163640 1 --2- 172.21.15.77:0/737413903 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f75440adac0 0x7f7544135fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.654+0000 7f754a964640 1 --2- 172.21.15.77:0/737413903 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7544159c00 0x7f75441f3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.654+0000 7f7549962640 1 -- 172.21.15.77:0/737413903 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7544159c00 msgr2=0x7f75441f3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:27.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.654+0000 7f7549962640 1 --2- 172.21.15.77:0/737413903 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7544159c00 0x7f75441f3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.654+0000 7f7549962640 1 -- 172.21.15.77:0/737413903 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f75440adac0 msgr2=0x7f7544135fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:27.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.654+0000 7f7549962640 1 --2- 172.21.15.77:0/737413903 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f75440adac0 0x7f7544135fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.654+0000 7f7549962640 1 -- 172.21.15.77:0/737413903 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f753c0094d0 con 0x7f75440c48e0 2023-11-04T01:43:27.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.654+0000 7f754a964640 1 --2- 172.21.15.77:0/737413903 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7544159c00 0x7f75441f3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:27.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.654+0000 7f7549962640 1 --2- 172.21.15.77:0/737413903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75440c48e0 0x7f754414ad90 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f753400e810 tx=0x7f753400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:27.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.655+0000 7f753affd640 1 -- 172.21.15.77:0/737413903 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7534004030 con 0x7f75440c48e0 2023-11-04T01:43:27.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.655+0000 7f753affd640 1 -- 172.21.15.77:0/737413903 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7534004190 con 0x7f75440c48e0 2023-11-04T01:43:27.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.655+0000 7f753affd640 1 -- 172.21.15.77:0/737413903 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7534004520 con 0x7f75440c48e0 2023-11-04T01:43:27.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.655+0000 7f754c3c7640 1 -- 172.21.15.77:0/737413903 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7544136ea0 con 0x7f75440c48e0 2023-11-04T01:43:27.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.655+0000 7f754c3c7640 1 -- 172.21.15.77:0/737413903 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7544136520 con 0x7f75440c48e0 2023-11-04T01:43:27.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.656+0000 7f754c3c7640 1 -- 172.21.15.77:0/737413903 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7544074290 con 0x7f75440c48e0 2023-11-04T01:43:27.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.656+0000 7f753affd640 1 -- 172.21.15.77:0/737413903 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f753400c6d0 con 0x7f75440c48e0 2023-11-04T01:43:27.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.656+0000 7f753affd640 1 --2- 172.21.15.77:0/737413903 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f752806ae70 0x7f752806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.656+0000 7f753affd640 1 -- 172.21.15.77:0/737413903 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f75340895f0 con 0x7f75440c48e0 2023-11-04T01:43:27.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.657+0000 7f754a163640 1 --2- 172.21.15.77:0/737413903 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f752806ae70 0x7f752806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.657+0000 7f754a163640 1 --2- 172.21.15.77:0/737413903 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f752806ae70 0x7f752806d330 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7540009fd0 tx=0x7f75400097f0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:27.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.660+0000 7f753affd640 1 -- 172.21.15.77:0/737413903 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7534054260 con 0x7f75440c48e0 2023-11-04T01:43:27.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.864+0000 7f754c3c7640 1 -- 172.21.15.77:0/737413903 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f75440cd4d0 con 0x7f75440c48e0 2023-11-04T01:43:27.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.953+0000 7f753affd640 1 -- 172.21.15.77:0/737413903 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v42) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7534057880 con 0x7f75440c48e0 2023-11-04T01:43:27.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.955+0000 7f754c3c7640 1 -- 172.21.15.77:0/737413903 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f752806ae70 msgr2=0x7f752806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:27.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.955+0000 7f754c3c7640 1 --2- 172.21.15.77:0/737413903 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f752806ae70 0x7f752806d330 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7540009fd0 tx=0x7f75400097f0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.955+0000 7f754c3c7640 1 -- 172.21.15.77:0/737413903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75440c48e0 msgr2=0x7f754414ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:27.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.955+0000 7f754c3c7640 1 --2- 172.21.15.77:0/737413903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75440c48e0 0x7f754414ad90 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f753400e810 tx=0x7f753400ecd0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.955+0000 7f754c3c7640 1 -- 172.21.15.77:0/737413903 shutdown_connections 2023-11-04T01:43:27.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.955+0000 7f754c3c7640 1 --2- 172.21.15.77:0/737413903 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f752806ae70 0x7f752806d330 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.955+0000 7f754c3c7640 1 --2- 172.21.15.77:0/737413903 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7544159c00 0x7f75441f3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.955+0000 7f754c3c7640 1 --2- 172.21.15.77:0/737413903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75440c48e0 0x7f754414ad90 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.955+0000 7f754c3c7640 1 --2- 172.21.15.77:0/737413903 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f75440adac0 0x7f7544135fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.955+0000 7f754c3c7640 1 -- 172.21.15.77:0/737413903 >> 172.21.15.77:0/737413903 conn(0x7f75440ce950 msgr2=0x7f75440c37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:27.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.955+0000 7f754c3c7640 1 -- 172.21.15.77:0/737413903 shutdown_connections 2023-11-04T01:43:27.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:27.955+0000 7f754c3c7640 1 -- 172.21.15.77:0/737413903 wait complete. 2023-11-04T01:43:27.967 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-04T01:43:27.967 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T01:43:28.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.067+0000 7f53da7ee640 1 Processor -- start 2023-11-04T01:43:28.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.067+0000 7f53da7ee640 1 -- start start 2023-11-04T01:43:28.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.068+0000 7f53da7ee640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f53d415ad30 0x7f53d40adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:28.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.068+0000 7f53da7ee640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53d4070e20 0x7f53d415e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:28.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.068+0000 7f53da7ee640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d40c3900 con 0x7f53d40ad730 2023-11-04T01:43:28.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.068+0000 7f53da7ee640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d40ae260 con 0x7f53d415ad30 2023-11-04T01:43:28.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.068+0000 7f53da7ee640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d40c3be0 con 0x7f53d4070e20 2023-11-04T01:43:28.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.068+0000 7f53d3fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f53d415ad30 0x7f53d40adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:28.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.068+0000 7f53d3fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f53d415ad30 0x7f53d40adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35416/0 (socket says 172.21.15.77:35416) 2023-11-04T01:43:28.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.069+0000 7f53d3fff640 1 -- 172.21.15.77:0/1146227474 learned_addr learned my addr 172.21.15.77:0/1146227474 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:28.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.069+0000 7f53d3fff640 1 -- 172.21.15.77:0/1146227474 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53d4070e20 msgr2=0x7f53d415e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:28.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.069+0000 7f53d3fff640 1 --2- 172.21.15.77:0/1146227474 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53d4070e20 0x7f53d415e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:28.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.069+0000 7f53d3fff640 1 -- 172.21.15.77:0/1146227474 >> v1:172.21.15.122:6789/0 conn(0x7f53d40ad730 legacy=0x7f53d4070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:28.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.069+0000 7f53d3fff640 1 -- 172.21.15.77:0/1146227474 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d40c3ec0 con 0x7f53d415ad30 2023-11-04T01:43:28.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.069+0000 7f53d3fff640 1 --2- 172.21.15.77:0/1146227474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53d415ad30 0x7f53d40adc80 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f53c4009870 tx=0x7f53c402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=220f5f07b612f4e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:28.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.070+0000 7f53d2ffd640 1 -- 172.21.15.77:0/1146227474 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c40317c0 con 0x7f53d415ad30 2023-11-04T01:43:28.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.070+0000 7f53d2ffd640 1 -- 172.21.15.77:0/1146227474 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c4031920 con 0x7f53d415ad30 2023-11-04T01:43:28.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.070+0000 7f53d2ffd640 1 -- 172.21.15.77:0/1146227474 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c4031cb0 con 0x7f53d415ad30 2023-11-04T01:43:28.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.070+0000 7f53da7ee640 1 -- 172.21.15.77:0/1146227474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53d415ad30 msgr2=0x7f53d40adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:28.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.070+0000 7f53da7ee640 1 --2- 172.21.15.77:0/1146227474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53d415ad30 0x7f53d40adc80 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f53c4009870 tx=0x7f53c402b860 comp rx=0 tx=0).stop 2023-11-04T01:43:28.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.070+0000 7f53da7ee640 1 -- 172.21.15.77:0/1146227474 shutdown_connections 2023-11-04T01:43:28.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.070+0000 7f53da7ee640 1 --2- 172.21.15.77:0/1146227474 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53d4070e20 0x7f53d415e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:28.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.070+0000 7f53da7ee640 1 --2- 172.21.15.77:0/1146227474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53d415ad30 0x7f53d40adc80 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:28.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.070+0000 7f53da7ee640 1 -- 172.21.15.77:0/1146227474 >> 172.21.15.77:0/1146227474 conn(0x7f53d40ce950 msgr2=0x7f53d40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:28.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.070+0000 7f53da7ee640 1 -- 172.21.15.77:0/1146227474 shutdown_connections 2023-11-04T01:43:28.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.070+0000 7f53da7ee640 1 -- 172.21.15.77:0/1146227474 wait complete. 2023-11-04T01:43:28.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.071+0000 7f53da7ee640 1 Processor -- start 2023-11-04T01:43:28.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.071+0000 7f53da7ee640 1 -- start start 2023-11-04T01:43:28.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.072+0000 7f53da7ee640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53d4070e20 0x7f53d4156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:28.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.072+0000 7f53da7ee640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53d40ad730 0x7f53d40b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:28.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.072+0000 7f53da7ee640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53d415ad30 0x7f53d40b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:28.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.072+0000 7f53da7ee640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d40b26f0 con 0x7f53d4070e20 2023-11-04T01:43:28.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.072+0000 7f53da7ee640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d40b1900 con 0x7f53d40ad730 2023-11-04T01:43:28.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.072+0000 7f53da7ee640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d40b3ea0 con 0x7f53d415ad30 2023-11-04T01:43:28.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.072+0000 7f53d3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53d4070e20 0x7f53d4156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:28.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.072+0000 7f53d3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53d4070e20 0x7f53d4156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35424/0 (socket says 172.21.15.77:35424) 2023-11-04T01:43:28.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.072+0000 7f53d3fff640 1 -- 172.21.15.77:0/1510485346 learned_addr learned my addr 172.21.15.77:0/1510485346 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:28.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.073+0000 7f53d3fff640 1 -- 172.21.15.77:0/1510485346 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53d415ad30 msgr2=0x7f53d40b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:28.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.073+0000 7f53d3fff640 1 --2- 172.21.15.77:0/1510485346 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53d415ad30 0x7f53d40b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:28.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.073+0000 7f53d3fff640 1 -- 172.21.15.77:0/1510485346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53d40ad730 msgr2=0x7f53d40b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:28.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.073+0000 7f53d3fff640 1 --2- 172.21.15.77:0/1510485346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53d40ad730 0x7f53d40b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:28.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.073+0000 7f53d3fff640 1 -- 172.21.15.77:0/1510485346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c40094d0 con 0x7f53d4070e20 2023-11-04T01:43:28.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.073+0000 7f53d3fff640 1 --2- 172.21.15.77:0/1510485346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53d4070e20 0x7f53d4156380 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f53c4000c00 tx=0x7f53c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:28.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.073+0000 7f53d0ff9640 1 -- 172.21.15.77:0/1510485346 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c4032860 con 0x7f53d4070e20 2023-11-04T01:43:28.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.073+0000 7f53d0ff9640 1 -- 172.21.15.77:0/1510485346 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c40329e0 con 0x7f53d4070e20 2023-11-04T01:43:28.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.073+0000 7f53d0ff9640 1 -- 172.21.15.77:0/1510485346 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c4032d90 con 0x7f53d4070e20 2023-11-04T01:43:28.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.073+0000 7f53da7ee640 1 -- 172.21.15.77:0/1510485346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d40b4180 con 0x7f53d4070e20 2023-11-04T01:43:28.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.073+0000 7f53da7ee640 1 -- 172.21.15.77:0/1510485346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d40b1590 con 0x7f53d4070e20 2023-11-04T01:43:28.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.074+0000 7f53da7ee640 1 -- 172.21.15.77:0/1510485346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d4074290 con 0x7f53d4070e20 2023-11-04T01:43:28.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.074+0000 7f53d0ff9640 1 -- 172.21.15.77:0/1510485346 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f53c404d3f0 con 0x7f53d4070e20 2023-11-04T01:43:28.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.075+0000 7f53d0ff9640 1 --2- 172.21.15.77:0/1510485346 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f53c006ae70 0x7f53c006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:28.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.075+0000 7f53d0ff9640 1 -- 172.21.15.77:0/1510485346 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f53c40aba50 con 0x7f53d4070e20 2023-11-04T01:43:28.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.075+0000 7f53d37fe640 1 --2- 172.21.15.77:0/1510485346 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f53c006ae70 0x7f53c006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:28.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.075+0000 7f53d37fe640 1 --2- 172.21.15.77:0/1510485346 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f53c006ae70 0x7f53c006d330 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f53d40cf230 tx=0x7f53c8007990 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:28.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.079+0000 7f53d0ff9640 1 -- 172.21.15.77:0/1510485346 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f53c4076610 con 0x7f53d4070e20 2023-11-04T01:43:28.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.279+0000 7f53da7ee640 1 -- 172.21.15.77:0/1510485346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f53d4074290 con 0x7f53d4070e20 2023-11-04T01:43:28.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.961+0000 7f53d0ff9640 1 -- 172.21.15.77:0/1510485346 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v43) v1 ==== 122+0+0 (secure 0 0 0) 0x7f53c4079c30 con 0x7f53d4070e20 2023-11-04T01:43:28.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.963+0000 7f53da7ee640 1 -- 172.21.15.77:0/1510485346 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f53c006ae70 msgr2=0x7f53c006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:28.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.963+0000 7f53da7ee640 1 --2- 172.21.15.77:0/1510485346 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f53c006ae70 0x7f53c006d330 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f53d40cf230 tx=0x7f53c8007990 comp rx=0 tx=0).stop 2023-11-04T01:43:28.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.963+0000 7f53da7ee640 1 -- 172.21.15.77:0/1510485346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53d4070e20 msgr2=0x7f53d4156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:28.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.963+0000 7f53da7ee640 1 --2- 172.21.15.77:0/1510485346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53d4070e20 0x7f53d4156380 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f53c4000c00 tx=0x7f53c40046c0 comp rx=0 tx=0).stop 2023-11-04T01:43:28.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.963+0000 7f53da7ee640 1 -- 172.21.15.77:0/1510485346 shutdown_connections 2023-11-04T01:43:28.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.963+0000 7f53da7ee640 1 --2- 172.21.15.77:0/1510485346 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f53c006ae70 0x7f53c006d330 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:28.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.963+0000 7f53da7ee640 1 --2- 172.21.15.77:0/1510485346 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f53d415ad30 0x7f53d40b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:28.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.963+0000 7f53da7ee640 1 --2- 172.21.15.77:0/1510485346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53d40ad730 0x7f53d40b1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:28.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.963+0000 7f53da7ee640 1 --2- 172.21.15.77:0/1510485346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53d4070e20 0x7f53d4156380 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:28.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.963+0000 7f53da7ee640 1 -- 172.21.15.77:0/1510485346 >> 172.21.15.77:0/1510485346 conn(0x7f53d40ce950 msgr2=0x7f53d40b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:28.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.963+0000 7f53da7ee640 1 -- 172.21.15.77:0/1510485346 shutdown_connections 2023-11-04T01:43:28.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:28.963+0000 7f53da7ee640 1 -- 172.21.15.77:0/1510485346 wait complete. 2023-11-04T01:43:28.976 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T01:43:28.977 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:29.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.077+0000 7f8dd044b640 1 Processor -- start 2023-11-04T01:43:29.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.077+0000 7f8dd044b640 1 -- start start 2023-11-04T01:43:29.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.078+0000 7f8dd044b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8dc815d250 0x7f8dc80c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.078+0000 7f8dd044b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f8dc80c9d70 0x7f8dc80ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.078+0000 7f8dd044b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dc806a120 con 0x7f8dc815ce70 2023-11-04T01:43:29.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.078+0000 7f8dd044b640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc80cdc10 con 0x7f8dc80c9d70 2023-11-04T01:43:29.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.078+0000 7f8dd044b640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc806a370 con 0x7f8dc815d250 2023-11-04T01:43:29.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.078+0000 7f8dce1e7640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f8dc815ce70 0x7f8dc806d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:54212/0 (socket says 172.21.15.77:54212) 2023-11-04T01:43:29.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.078+0000 7f8dce1e7640 1 -- 172.21.15.77:0/2723020221 learned_addr learned my addr 172.21.15.77:0/2723020221 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:29.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.078+0000 7f8dce9e8640 1 --2- 172.21.15.77:0/2723020221 >> v2:172.21.15.122:3300/0 conn(0x7f8dc80c9d70 0x7f8dc80ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.078+0000 7f8dcd9e6640 1 --2- 172.21.15.77:0/2723020221 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8dc815d250 0x7f8dc80c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.079+0000 7f8dcd1e5640 1 -- 172.21.15.77:0/2723020221 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2884019392 0 0) 0x7f8dc806a120 con 0x7f8dc815ce70 2023-11-04T01:43:29.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.079+0000 7f8dcd1e5640 1 -- 172.21.15.77:0/2723020221 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8db4003520 con 0x7f8dc815ce70 2023-11-04T01:43:29.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.079+0000 7f8dcd1e5640 1 -- 172.21.15.77:0/2723020221 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3738986299 0 0) 0x7f8db4003520 con 0x7f8dc815ce70 2023-11-04T01:43:29.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.079+0000 7f8dcd1e5640 1 -- 172.21.15.77:0/2723020221 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8dc815d250 msgr2=0x7f8dc80c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:29.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.079+0000 7f8dcd1e5640 1 --2- 172.21.15.77:0/2723020221 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8dc815d250 0x7f8dc80c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.079+0000 7f8dcd1e5640 1 -- 172.21.15.77:0/2723020221 >> v2:172.21.15.122:3300/0 conn(0x7f8dc80c9d70 msgr2=0x7f8dc80ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:29.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.079+0000 7f8dcd1e5640 1 --2- 172.21.15.77:0/2723020221 >> v2:172.21.15.122:3300/0 conn(0x7f8dc80c9d70 0x7f8dc80ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.079+0000 7f8dcd1e5640 1 -- 172.21.15.77:0/2723020221 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc806a650 con 0x7f8dc815ce70 2023-11-04T01:43:29.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.079+0000 7f8dcd1e5640 1 -- 172.21.15.77:0/2723020221 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f8dc4001670 con 0x7f8dc815ce70 2023-11-04T01:43:29.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.079+0000 7f8dce9e8640 1 --2- 172.21.15.77:0/2723020221 >> v2:172.21.15.122:3300/0 conn(0x7f8dc80c9d70 0x7f8dc80ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:43:29.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.079+0000 7f8dcd1e5640 1 -- 172.21.15.77:0/2723020221 >> v1:172.21.15.77:6789/0 conn(0x7f8dc815ce70 legacy=0x7f8dc806d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.079+0000 7f8dcd1e5640 1 --2- 172.21.15.77:0/2723020221 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8dc815d250 0x7f8db4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.079+0000 7f8dcd1e5640 1 --2- 172.21.15.77:0/2723020221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8db4003ef0 0x7f8db40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.079+0000 7f8dcd1e5640 1 --2- 172.21.15.77:0/2723020221 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8db4004d00 0x7f8db4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.079+0000 7f8dcd1e5640 1 -- 172.21.15.77:0/2723020221 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc80cdc10 con 0x7f8db4003ef0 2023-11-04T01:43:29.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.079+0000 7f8dcd1e5640 1 -- 172.21.15.77:0/2723020221 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc806a370 con 0x7f8db4004d00 2023-11-04T01:43:29.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.079+0000 7f8dcd1e5640 1 -- 172.21.15.77:0/2723020221 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db400b980 con 0x7f8dc815d250 2023-11-04T01:43:29.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.079+0000 7f8dcd9e6640 1 --2- 172.21.15.77:0/2723020221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8db4003ef0 0x7f8db40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.079+0000 7f8dce1e7640 1 --2- 172.21.15.77:0/2723020221 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8dc815d250 0x7f8db4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.079+0000 7f8dce9e8640 1 --2- 172.21.15.77:0/2723020221 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8db4004d00 0x7f8db4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.079+0000 7f8dcd9e6640 1 -- 172.21.15.77:0/2723020221 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8dc815d250 msgr2=0x7f8db4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:29.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.079+0000 7f8dcd9e6640 1 --2- 172.21.15.77:0/2723020221 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8dc815d250 0x7f8db4003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.079+0000 7f8dcd9e6640 1 -- 172.21.15.77:0/2723020221 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8db4004d00 msgr2=0x7f8db4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:29.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.079+0000 7f8dcd9e6640 1 --2- 172.21.15.77:0/2723020221 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8db4004d00 0x7f8db4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.079+0000 7f8dcd9e6640 1 -- 172.21.15.77:0/2723020221 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db4003520 con 0x7f8db4003ef0 2023-11-04T01:43:29.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.080+0000 7f8dcd9e6640 1 --2- 172.21.15.77:0/2723020221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8db4003ef0 0x7f8db40047c0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f8db8009a90 tx=0x7f8db40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc1d7fe1791c452 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:29.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.080+0000 7f8dcd1e5640 1 -- 172.21.15.77:0/2723020221 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db802c6b0 con 0x7f8db4003ef0 2023-11-04T01:43:29.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.080+0000 7f8dcd1e5640 1 -- 172.21.15.77:0/2723020221 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db802c810 con 0x7f8db4003ef0 2023-11-04T01:43:29.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.080+0000 7f8dcd1e5640 1 -- 172.21.15.77:0/2723020221 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db802cbc0 con 0x7f8db4003ef0 2023-11-04T01:43:29.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.081+0000 7f8dd044b640 1 -- 172.21.15.77:0/2723020221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8db4003ef0 msgr2=0x7f8db40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.081+0000 7f8dd044b640 1 --2- 172.21.15.77:0/2723020221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8db4003ef0 0x7f8db40047c0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f8db8009a90 tx=0x7f8db40057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.081+0000 7f8dce9e8640 1 -- 172.21.15.77:0/2723020221 reap_dead start 2023-11-04T01:43:29.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.081+0000 7f8dd044b640 1 -- 172.21.15.77:0/2723020221 shutdown_connections 2023-11-04T01:43:29.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.081+0000 7f8dd044b640 1 -- 172.21.15.77:0/2723020221 >> 172.21.15.77:0/2723020221 conn(0x7f8dc80b0cd0 msgr2=0x7f8dc80b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:29.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.081+0000 7f8dd044b640 1 -- 172.21.15.77:0/2723020221 shutdown_connections 2023-11-04T01:43:29.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.081+0000 7f8dd044b640 1 -- 172.21.15.77:0/2723020221 wait complete. 2023-11-04T01:43:29.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.082+0000 7f8dd044b640 1 Processor -- start 2023-11-04T01:43:29.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.082+0000 7f8dd044b640 1 -- start start 2023-11-04T01:43:29.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.083+0000 7f8dd044b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8db4003ef0 0x7f8dc80c2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.083+0000 7f8dd044b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8dc80c40b0 0x7f8dc81f29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.083+0000 7f8dd044b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8dc81f2f10 0x7f8dc8149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.083+0000 7f8dd044b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc81490f0 con 0x7f8dc81f2f10 2023-11-04T01:43:29.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.083+0000 7f8dd044b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc80c3c20 con 0x7f8dc80c40b0 2023-11-04T01:43:29.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.083+0000 7f8dd044b640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc80c3010 con 0x7f8db4003ef0 2023-11-04T01:43:29.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.083+0000 7f8dce9e8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8dc81f2f10 0x7f8dc8149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.083+0000 7f8dce9e8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8dc81f2f10 0x7f8dc8149330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35446/0 (socket says 172.21.15.77:35446) 2023-11-04T01:43:29.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.083+0000 7f8dce9e8640 1 -- 172.21.15.77:0/2358400372 learned_addr learned my addr 172.21.15.77:0/2358400372 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:29.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.083+0000 7f8dcd9e6640 1 --2- 172.21.15.77:0/2358400372 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8dc80c40b0 0x7f8dc81f29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.083+0000 7f8dce1e7640 1 --2- 172.21.15.77:0/2358400372 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8db4003ef0 0x7f8dc80c2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.083+0000 7f8dce9e8640 1 -- 172.21.15.77:0/2358400372 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8db4003ef0 msgr2=0x7f8dc80c2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.083+0000 7f8dce9e8640 1 --2- 172.21.15.77:0/2358400372 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8db4003ef0 0x7f8dc80c2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.083+0000 7f8dce9e8640 1 -- 172.21.15.77:0/2358400372 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8dc80c40b0 msgr2=0x7f8dc81f29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.083+0000 7f8dce9e8640 1 --2- 172.21.15.77:0/2358400372 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8dc80c40b0 0x7f8dc81f29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.083+0000 7f8dce9e8640 1 -- 172.21.15.77:0/2358400372 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc80c32f0 con 0x7f8dc81f2f10 2023-11-04T01:43:29.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.083+0000 7f8dce9e8640 1 --2- 172.21.15.77:0/2358400372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8dc81f2f10 0x7f8dc8149330 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f8dc806cef0 tx=0x7f8dc0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:29.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.083+0000 7f8dbeffd640 1 -- 172.21.15.77:0/2358400372 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc000e070 con 0x7f8dc81f2f10 2023-11-04T01:43:29.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.083+0000 7f8dbeffd640 1 -- 172.21.15.77:0/2358400372 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc0011e30 con 0x7f8dc81f2f10 2023-11-04T01:43:29.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.083+0000 7f8dd044b640 1 -- 172.21.15.77:0/2358400372 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dc80c35d0 con 0x7f8dc81f2f10 2023-11-04T01:43:29.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.083+0000 7f8dbeffd640 1 -- 172.21.15.77:0/2358400372 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc0003990 con 0x7f8dc81f2f10 2023-11-04T01:43:29.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.084+0000 7f8dd044b640 1 -- 172.21.15.77:0/2358400372 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc81f3390 con 0x7f8dc81f2f10 2023-11-04T01:43:29.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.084+0000 7f8dd044b640 1 -- 172.21.15.77:0/2358400372 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dc80cba50 con 0x7f8dc81f2f10 2023-11-04T01:43:29.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.085+0000 7f8dbeffd640 1 -- 172.21.15.77:0/2358400372 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8dc0003af0 con 0x7f8dc81f2f10 2023-11-04T01:43:29.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.085+0000 7f8dbeffd640 1 --2- 172.21.15.77:0/2358400372 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8dac06ae70 0x7f8dac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.085+0000 7f8dbeffd640 1 -- 172.21.15.77:0/2358400372 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f8dc008a3a0 con 0x7f8dc81f2f10 2023-11-04T01:43:29.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.086+0000 7f8dce1e7640 1 --2- 172.21.15.77:0/2358400372 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8dac06ae70 0x7f8dac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.086+0000 7f8dce1e7640 1 --2- 172.21.15.77:0/2358400372 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8dac06ae70 0x7f8dac06d330 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f8dc4001eb0 tx=0x7f8dc40078f0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:29.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.089+0000 7f8dbeffd640 1 -- 172.21.15.77:0/2358400372 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8dc0054ed0 con 0x7f8dc81f2f10 2023-11-04T01:43:29.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.290+0000 7f8dd044b640 1 -- 172.21.15.77:0/2358400372 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8dc8074290 con 0x7f8dc81f2f10 2023-11-04T01:43:29.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.291+0000 7f8dbeffd640 1 -- 172.21.15.77:0/2358400372 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4924 (secure 0 0 0) 0x7f8dc00584f0 con 0x7f8dc81f2f10 2023-11-04T01:43:29.293 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:43:29.293 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":43,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7302,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/4241784871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4241784871},{"type":"v1","addr":"172.21.15.77:6834","nonce":4241784871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7305,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:43:28.280821+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":35690},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35690":{"gid":35690,"name":"b","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6836/3699147778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":3699147778},{"type":"v1","addr":"172.21.15.122:6836","nonce":3699147778}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:29.294 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 43 2023-11-04T01:43:29.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.293+0000 7f8dd044b640 1 -- 172.21.15.77:0/2358400372 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8dac06ae70 msgr2=0x7f8dac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.293+0000 7f8dd044b640 1 --2- 172.21.15.77:0/2358400372 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8dac06ae70 0x7f8dac06d330 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f8dc4001eb0 tx=0x7f8dc40078f0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.293+0000 7f8dd044b640 1 -- 172.21.15.77:0/2358400372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8dc81f2f10 msgr2=0x7f8dc8149330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.293+0000 7f8dd044b640 1 --2- 172.21.15.77:0/2358400372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8dc81f2f10 0x7f8dc8149330 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f8dc806cef0 tx=0x7f8dc0009f90 comp rx=0 tx=0).stop 2023-11-04T01:43:29.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.293+0000 7f8dd044b640 1 -- 172.21.15.77:0/2358400372 shutdown_connections 2023-11-04T01:43:29.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.293+0000 7f8dd044b640 1 --2- 172.21.15.77:0/2358400372 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8dac06ae70 0x7f8dac06d330 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.293+0000 7f8dd044b640 1 --2- 172.21.15.77:0/2358400372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8dc81f2f10 0x7f8dc8149330 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.293+0000 7f8dd044b640 1 --2- 172.21.15.77:0/2358400372 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8dc80c40b0 0x7f8dc81f29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.293+0000 7f8dd044b640 1 --2- 172.21.15.77:0/2358400372 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8db4003ef0 0x7f8dc80c2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.293+0000 7f8dd044b640 1 -- 172.21.15.77:0/2358400372 >> 172.21.15.77:0/2358400372 conn(0x7f8dc80b0cd0 msgr2=0x7f8dc80accc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:29.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.293+0000 7f8dd044b640 1 -- 172.21.15.77:0/2358400372 shutdown_connections 2023-11-04T01:43:29.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.293+0000 7f8dd044b640 1 -- 172.21.15.77:0/2358400372 wait complete. 2023-11-04T01:43:29.305 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:29.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.402+0000 7feba68e5640 1 Processor -- start 2023-11-04T01:43:29.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.402+0000 7feba68e5640 1 -- start start 2023-11-04T01:43:29.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.403+0000 7feba68e5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7feba015bfb0 0x7feba00cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.403+0000 7feba68e5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feba00cd860 0x7feba00ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.403+0000 7feba68e5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba00cc450 con 0x7feba015ae40 2023-11-04T01:43:29.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.403+0000 7feba68e5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba015f400 con 0x7feba015bfb0 2023-11-04T01:43:29.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.403+0000 7feba68e5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba015b220 con 0x7feba00cd860 2023-11-04T01:43:29.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.403+0000 7feb9f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7feba015bfb0 0x7feba00cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.403+0000 7feb9ffff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7feba015ae40 0x7feba00cbc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:54216/0 (socket says 172.21.15.77:54216) 2023-11-04T01:43:29.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.403+0000 7feb9ffff640 1 -- 172.21.15.77:0/2347330913 learned_addr learned my addr 172.21.15.77:0/2347330913 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:29.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.404+0000 7feba4e82640 1 --2- 172.21.15.77:0/2347330913 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feba00cd860 0x7feba00ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.404+0000 7feb9f7fe640 1 -- 172.21.15.77:0/2347330913 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feba00cd860 msgr2=0x7feba00ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:29.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.404+0000 7feb9f7fe640 1 --2- 172.21.15.77:0/2347330913 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feba00cd860 0x7feba00ced70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.404+0000 7feb9f7fe640 1 -- 172.21.15.77:0/2347330913 >> v1:172.21.15.77:6789/0 conn(0x7feba015ae40 legacy=0x7feba00cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.404+0000 7feb9f7fe640 1 -- 172.21.15.77:0/2347330913 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba015f890 con 0x7feba015bfb0 2023-11-04T01:43:29.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.404+0000 7feb9effd640 1 -- 172.21.15.77:0/2347330913 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 280570281 0 0) 0x7feb90001110 con 0x7feba015ae40 2023-11-04T01:43:29.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.404+0000 7feb9f7fe640 1 --2- 172.21.15.77:0/2347330913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feba015bfb0 0x7feba00cd320 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7feb940097a0 tx=0x7feb9402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ba402c62af6361 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:29.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.405+0000 7feb9effd640 1 -- 172.21.15.77:0/2347330913 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb94031830 con 0x7feba015bfb0 2023-11-04T01:43:29.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.405+0000 7feb9effd640 1 -- 172.21.15.77:0/2347330913 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb94031990 con 0x7feba015bfb0 2023-11-04T01:43:29.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.405+0000 7feb9effd640 1 -- 172.21.15.77:0/2347330913 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb94031d20 con 0x7feba015bfb0 2023-11-04T01:43:29.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.405+0000 7feba68e5640 1 -- 172.21.15.77:0/2347330913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feba015bfb0 msgr2=0x7feba00cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.405+0000 7feba68e5640 1 --2- 172.21.15.77:0/2347330913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feba015bfb0 0x7feba00cd320 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7feb940097a0 tx=0x7feb9402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.405+0000 7feba68e5640 1 -- 172.21.15.77:0/2347330913 shutdown_connections 2023-11-04T01:43:29.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.405+0000 7feba68e5640 1 --2- 172.21.15.77:0/2347330913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feba015bfb0 0x7feba00cd320 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.405+0000 7feba68e5640 1 --2- 172.21.15.77:0/2347330913 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feba00cd860 0x7feba00ced70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.405+0000 7feba68e5640 1 -- 172.21.15.77:0/2347330913 >> 172.21.15.77:0/2347330913 conn(0x7feba006ea90 msgr2=0x7feba006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:29.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.405+0000 7feba68e5640 1 -- 172.21.15.77:0/2347330913 shutdown_connections 2023-11-04T01:43:29.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.405+0000 7feba68e5640 1 -- 172.21.15.77:0/2347330913 wait complete. 2023-11-04T01:43:29.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.406+0000 7feba68e5640 1 Processor -- start 2023-11-04T01:43:29.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.407+0000 7feba68e5640 1 -- start start 2023-11-04T01:43:29.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.407+0000 7feba68e5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feba00cd860 0x7feba00c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.407+0000 7feba68e5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feba015ae40 0x7feba00c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.407+0000 7feba68e5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feba015bfb0 0x7feba00c5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.407+0000 7feba68e5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba00c84c0 con 0x7feba00cd860 2023-11-04T01:43:29.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.407+0000 7feba68e5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba00c4c40 con 0x7feba015bfb0 2023-11-04T01:43:29.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.407+0000 7feba68e5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba00c4f20 con 0x7feba015ae40 2023-11-04T01:43:29.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.407+0000 7feb9ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feba00cd860 0x7feba00c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.407+0000 7feb9ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feba00cd860 0x7feba00c7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35470/0 (socket says 172.21.15.77:35470) 2023-11-04T01:43:29.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.407+0000 7feb9ffff640 1 -- 172.21.15.77:0/3326260073 learned_addr learned my addr 172.21.15.77:0/3326260073 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:29.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.408+0000 7feba4e82640 1 --2- 172.21.15.77:0/3326260073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feba015bfb0 0x7feba00c5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.408+0000 7feb9ffff640 1 -- 172.21.15.77:0/3326260073 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feba015ae40 msgr2=0x7feba00c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.408+0000 7feb9f7fe640 1 --2- 172.21.15.77:0/3326260073 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feba015ae40 0x7feba00c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.408+0000 7feb9ffff640 1 --2- 172.21.15.77:0/3326260073 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feba015ae40 0x7feba00c9ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.408+0000 7feb9ffff640 1 -- 172.21.15.77:0/3326260073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feba015bfb0 msgr2=0x7feba00c5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.408+0000 7feb9ffff640 1 --2- 172.21.15.77:0/3326260073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feba015bfb0 0x7feba00c5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.408+0000 7feb9ffff640 1 -- 172.21.15.77:0/3326260073 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb94009400 con 0x7feba00cd860 2023-11-04T01:43:29.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.408+0000 7feba4e82640 1 --2- 172.21.15.77:0/3326260073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feba015bfb0 0x7feba00c5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:29.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.408+0000 7feb9ffff640 1 --2- 172.21.15.77:0/3326260073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feba00cd860 0x7feba00c7c70 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7feb9000c780 tx=0x7feb9000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:29.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.408+0000 7feb9cff9640 1 -- 172.21.15.77:0/3326260073 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb900072d0 con 0x7feba00cd860 2023-11-04T01:43:29.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.408+0000 7feb9cff9640 1 -- 172.21.15.77:0/3326260073 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb90007450 con 0x7feba00cd860 2023-11-04T01:43:29.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.408+0000 7feba68e5640 1 -- 172.21.15.77:0/3326260073 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba00c5200 con 0x7feba00cd860 2023-11-04T01:43:29.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.408+0000 7feb9cff9640 1 -- 172.21.15.77:0/3326260073 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb900047e0 con 0x7feba00cd860 2023-11-04T01:43:29.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.408+0000 7feba68e5640 1 -- 172.21.15.77:0/3326260073 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba00c81b0 con 0x7feba00cd860 2023-11-04T01:43:29.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.409+0000 7feba68e5640 1 -- 172.21.15.77:0/3326260073 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba00ce2d0 con 0x7feba00cd860 2023-11-04T01:43:29.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.409+0000 7feb9cff9640 1 -- 172.21.15.77:0/3326260073 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feb90004960 con 0x7feba00cd860 2023-11-04T01:43:29.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.410+0000 7feb9cff9640 1 --2- 172.21.15.77:0/3326260073 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7feb8c06aea0 0x7feb8c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.410+0000 7feb9cff9640 1 -- 172.21.15.77:0/3326260073 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7feb90088fa0 con 0x7feba00cd860 2023-11-04T01:43:29.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.410+0000 7feb9f7fe640 1 --2- 172.21.15.77:0/3326260073 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7feb8c06aea0 0x7feb8c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.410+0000 7feb9f7fe640 1 --2- 172.21.15.77:0/3326260073 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7feb8c06aea0 0x7feb8c06d360 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7feb94036000 tx=0x7feb9403c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:29.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.414+0000 7feb9cff9640 1 -- 172.21.15.77:0/3326260073 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feb900bbca0 con 0x7feba00cd860 2023-11-04T01:43:29.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.579+0000 7feba68e5640 1 -- 172.21.15.77:0/3326260073 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feba00c5720 con 0x7feba00cd860 2023-11-04T01:43:29.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.581+0000 7feb9cff9640 1 -- 172.21.15.77:0/3326260073 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+21993 (secure 0 0 0) 0x7feba00c5720 con 0x7feba00cd860 2023-11-04T01:43:29.582 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:43:29.583 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":96,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:43:27.583457+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:33.159064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:33.647358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:43:24.372767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-04T01:43:25.241976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:29.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.582+0000 7feba68e5640 1 -- 172.21.15.77:0/3326260073 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7feb8c06aea0 msgr2=0x7feb8c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.582+0000 7feba68e5640 1 --2- 172.21.15.77:0/3326260073 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7feb8c06aea0 0x7feb8c06d360 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7feb94036000 tx=0x7feb9403c040 comp rx=0 tx=0).stop 2023-11-04T01:43:29.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.582+0000 7feba68e5640 1 -- 172.21.15.77:0/3326260073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feba00cd860 msgr2=0x7feba00c7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.582+0000 7feba68e5640 1 --2- 172.21.15.77:0/3326260073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feba00cd860 0x7feba00c7c70 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7feb9000c780 tx=0x7feb9000cc40 comp rx=0 tx=0).stop 2023-11-04T01:43:29.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.582+0000 7feba68e5640 1 -- 172.21.15.77:0/3326260073 shutdown_connections 2023-11-04T01:43:29.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.582+0000 7feba68e5640 1 --2- 172.21.15.77:0/3326260073 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7feb8c06aea0 0x7feb8c06d360 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.582+0000 7feba68e5640 1 --2- 172.21.15.77:0/3326260073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feba015bfb0 0x7feba00c5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.582+0000 7feba68e5640 1 --2- 172.21.15.77:0/3326260073 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feba015ae40 0x7feba00c9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.582+0000 7feba68e5640 1 --2- 172.21.15.77:0/3326260073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feba00cd860 0x7feba00c7c70 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.582+0000 7feba68e5640 1 -- 172.21.15.77:0/3326260073 >> 172.21.15.77:0/3326260073 conn(0x7feba006ea90 msgr2=0x7feba00ceb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:29.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.583+0000 7feba68e5640 1 -- 172.21.15.77:0/3326260073 shutdown_connections 2023-11-04T01:43:29.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.583+0000 7feba68e5640 1 -- 172.21.15.77:0/3326260073 wait complete. 2023-11-04T01:43:29.595 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T01:43:29.596 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:43:29.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.693+0000 7f5a1ac1a640 1 Processor -- start 2023-11-04T01:43:29.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.693+0000 7f5a1ac1a640 1 -- start start 2023-11-04T01:43:29.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.694+0000 7f5a1ac1a640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5a1415ad80 0x7f5a1406c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.694+0000 7f5a1ac1a640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5a140c9e10 0x7f5a140b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.694+0000 7f5a1ac1a640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a1406cd00 con 0x7f5a140b42c0 2023-11-04T01:43:29.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.694+0000 7f5a1ac1a640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a1406cfa0 con 0x7f5a1415ad80 2023-11-04T01:43:29.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.694+0000 7f5a1ac1a640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1406d280 con 0x7f5a140c9e10 2023-11-04T01:43:29.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.695+0000 7f5a189b6640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5a1415ad80 0x7f5a1406c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.695+0000 7f5a191b7640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5a140c9e10 0x7f5a140b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.695+0000 7f5a13fff640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f5a140b42c0 0x7f5a140c9700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:44866/0 (socket says 172.21.15.77:44866) 2023-11-04T01:43:29.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.695+0000 7f5a13fff640 1 -- 172.21.15.77:0/1840860013 learned_addr learned my addr 172.21.15.77:0/1840860013 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:29.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.695+0000 7f5a189b6640 1 -- 172.21.15.77:0/1840860013 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5a140c9e10 msgr2=0x7f5a140b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:29.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.695+0000 7f5a189b6640 1 --2- 172.21.15.77:0/1840860013 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5a140c9e10 0x7f5a140b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.695+0000 7f5a189b6640 1 -- 172.21.15.77:0/1840860013 >> v1:172.21.15.122:6789/0 conn(0x7f5a140b42c0 legacy=0x7f5a140c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.695+0000 7f5a189b6640 1 -- 172.21.15.77:0/1840860013 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a1406d560 con 0x7f5a1415ad80 2023-11-04T01:43:29.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.695+0000 7f5a137fe640 1 -- 172.21.15.77:0/1840860013 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 471110624 0 0) 0x7f5a1406cd00 con 0x7f5a140b42c0 2023-11-04T01:43:29.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.696+0000 7f5a189b6640 1 --2- 172.21.15.77:0/1840860013 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a1415ad80 0x7f5a1406c7c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5a040097a0 tx=0x7f5a0402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12685e193a529468 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:29.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.696+0000 7f5a137fe640 1 -- 172.21.15.77:0/1840860013 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a04030610 con 0x7f5a1415ad80 2023-11-04T01:43:29.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.696+0000 7f5a137fe640 1 -- 172.21.15.77:0/1840860013 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a04030770 con 0x7f5a1415ad80 2023-11-04T01:43:29.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.696+0000 7f5a137fe640 1 -- 172.21.15.77:0/1840860013 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a04030b00 con 0x7f5a1415ad80 2023-11-04T01:43:29.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.696+0000 7f5a1ac1a640 1 -- 172.21.15.77:0/1840860013 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a1415ad80 msgr2=0x7f5a1406c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.696+0000 7f5a1ac1a640 1 --2- 172.21.15.77:0/1840860013 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a1415ad80 0x7f5a1406c7c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5a040097a0 tx=0x7f5a0402b960 comp rx=0 tx=0).stop 2023-11-04T01:43:29.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.696+0000 7f5a1ac1a640 1 -- 172.21.15.77:0/1840860013 shutdown_connections 2023-11-04T01:43:29.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.696+0000 7f5a1ac1a640 1 --2- 172.21.15.77:0/1840860013 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5a140c9e10 0x7f5a140b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.696+0000 7f5a1ac1a640 1 --2- 172.21.15.77:0/1840860013 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a1415ad80 0x7f5a1406c7c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.696+0000 7f5a1ac1a640 1 -- 172.21.15.77:0/1840860013 >> 172.21.15.77:0/1840860013 conn(0x7f5a140ce950 msgr2=0x7f5a140ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:29.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.697+0000 7f5a1ac1a640 1 -- 172.21.15.77:0/1840860013 shutdown_connections 2023-11-04T01:43:29.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.697+0000 7f5a1ac1a640 1 -- 172.21.15.77:0/1840860013 wait complete. 2023-11-04T01:43:29.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.698+0000 7f5a1ac1a640 1 Processor -- start 2023-11-04T01:43:29.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.698+0000 7f5a1ac1a640 1 -- start start 2023-11-04T01:43:29.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.698+0000 7f5a1ac1a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a140b42c0 0x7f5a1415ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.698+0000 7f5a1ac1a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a140c9e10 0x7f5a14152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.699+0000 7f5a1ac1a640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5a1415ad80 0x7f5a14142e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.699+0000 7f5a1ac1a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a14151630 con 0x7f5a140b42c0 2023-11-04T01:43:29.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.699+0000 7f5a1ac1a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1415e310 con 0x7f5a140c9e10 2023-11-04T01:43:29.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.699+0000 7f5a1ac1a640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a14154020 con 0x7f5a1415ad80 2023-11-04T01:43:29.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.699+0000 7f5a189b6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a140b42c0 0x7f5a1415ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.699+0000 7f5a189b6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a140b42c0 0x7f5a1415ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35480/0 (socket says 172.21.15.77:35480) 2023-11-04T01:43:29.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.699+0000 7f5a189b6640 1 -- 172.21.15.77:0/3429598729 learned_addr learned my addr 172.21.15.77:0/3429598729 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:29.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.699+0000 7f5a191b7640 1 --2- 172.21.15.77:0/3429598729 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5a1415ad80 0x7f5a14142e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.699+0000 7f5a13fff640 1 --2- 172.21.15.77:0/3429598729 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a140c9e10 0x7f5a14152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.699+0000 7f5a189b6640 1 -- 172.21.15.77:0/3429598729 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5a1415ad80 msgr2=0x7f5a14142e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.699+0000 7f5a189b6640 1 --2- 172.21.15.77:0/3429598729 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5a1415ad80 0x7f5a14142e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.699+0000 7f5a189b6640 1 -- 172.21.15.77:0/3429598729 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a140c9e10 msgr2=0x7f5a14152a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.699+0000 7f5a189b6640 1 --2- 172.21.15.77:0/3429598729 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a140c9e10 0x7f5a14152a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.699+0000 7f5a189b6640 1 -- 172.21.15.77:0/3429598729 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a04009400 con 0x7f5a140b42c0 2023-11-04T01:43:29.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.699+0000 7f5a189b6640 1 --2- 172.21.15.77:0/3429598729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a140b42c0 0x7f5a1415ddd0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f5a04000c00 tx=0x7f5a040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:29.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.699+0000 7f5a117fa640 1 -- 172.21.15.77:0/3429598729 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0403f070 con 0x7f5a140b42c0 2023-11-04T01:43:29.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.699+0000 7f5a117fa640 1 -- 172.21.15.77:0/3429598729 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a04030e30 con 0x7f5a140b42c0 2023-11-04T01:43:29.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.699+0000 7f5a1ac1a640 1 -- 172.21.15.77:0/3429598729 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a141534a0 con 0x7f5a140b42c0 2023-11-04T01:43:29.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.699+0000 7f5a117fa640 1 -- 172.21.15.77:0/3429598729 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a04004250 con 0x7f5a140b42c0 2023-11-04T01:43:29.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.699+0000 7f5a1ac1a640 1 -- 172.21.15.77:0/3429598729 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a14153a60 con 0x7f5a140b42c0 2023-11-04T01:43:29.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.700+0000 7f5a1ac1a640 1 -- 172.21.15.77:0/3429598729 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a14074290 con 0x7f5a140b42c0 2023-11-04T01:43:29.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.701+0000 7f5a117fa640 1 -- 172.21.15.77:0/3429598729 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5a04043070 con 0x7f5a140b42c0 2023-11-04T01:43:29.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.701+0000 7f5a117fa640 1 --2- 172.21.15.77:0/3429598729 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5a0006ae70 0x7f5a0006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.701+0000 7f5a117fa640 1 -- 172.21.15.77:0/3429598729 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f5a040ab660 con 0x7f5a140b42c0 2023-11-04T01:43:29.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.701+0000 7f5a13fff640 1 --2- 172.21.15.77:0/3429598729 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5a0006ae70 0x7f5a0006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.702+0000 7f5a13fff640 1 --2- 172.21.15.77:0/3429598729 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5a0006ae70 0x7f5a0006d330 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5a080011e0 tx=0x7f5a08001130 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:29.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.705+0000 7f5a117fa640 1 -- 172.21.15.77:0/3429598729 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5a040762e0 con 0x7f5a140b42c0 2023-11-04T01:43:29.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.867+0000 7f5a1ac1a640 1 -- 172.21.15.77:0/3429598729 --> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5a1406db20 con 0x7f5a0006ae70 2023-11-04T01:43:29.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.881+0000 7f5a117fa640 1 -- 172.21.15.77:0/3429598729 <== mgr.4123 v2:172.21.15.122:6832/2275325762 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+532189 (secure 0 0 0) 0x7f5a080014d0 con 0x7f5a0006ae70 2023-11-04T01:43:29.888 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:43:29.892 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-04T01:43:29.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.885+0000 7f5a1ac1a640 1 -- 172.21.15.77:0/3429598729 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5a0006ae70 msgr2=0x7f5a0006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.885+0000 7f5a1ac1a640 1 --2- 172.21.15.77:0/3429598729 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5a0006ae70 0x7f5a0006d330 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5a080011e0 tx=0x7f5a08001130 comp rx=0 tx=0).stop 2023-11-04T01:43:29.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.885+0000 7f5a1ac1a640 1 -- 172.21.15.77:0/3429598729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a140b42c0 msgr2=0x7f5a1415ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.885+0000 7f5a1ac1a640 1 --2- 172.21.15.77:0/3429598729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a140b42c0 0x7f5a1415ddd0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f5a04000c00 tx=0x7f5a040046c0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.885+0000 7f5a1ac1a640 1 -- 172.21.15.77:0/3429598729 shutdown_connections 2023-11-04T01:43:29.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.885+0000 7f5a1ac1a640 1 --2- 172.21.15.77:0/3429598729 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5a0006ae70 0x7f5a0006d330 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.885+0000 7f5a1ac1a640 1 --2- 172.21.15.77:0/3429598729 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5a1415ad80 0x7f5a14142e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.885+0000 7f5a1ac1a640 1 --2- 172.21.15.77:0/3429598729 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a140c9e10 0x7f5a14152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.885+0000 7f5a1ac1a640 1 --2- 172.21.15.77:0/3429598729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a140b42c0 0x7f5a1415ddd0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.885+0000 7f5a1ac1a640 1 -- 172.21.15.77:0/3429598729 >> 172.21.15.77:0/3429598729 conn(0x7f5a140ce950 msgr2=0x7f5a140b3480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:29.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.885+0000 7f5a1ac1a640 1 -- 172.21.15.77:0/3429598729 shutdown_connections 2023-11-04T01:43:29.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:29.885+0000 7f5a1ac1a640 1 -- 172.21.15.77:0/3429598729 wait complete. 2023-11-04T01:43:29.897 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":198,"stamp":"2023-11-04T01:43:29.680077+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":167,"num_write_kb":2424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":243,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238892,"kb_used_data":10240,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754735828,"statfs":{"total":773094113280,"available":772849487872,"internally_reserved":0,"allocated":10485760,"data_stored":5754835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":234016306},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.759573"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.607852+0000","last_change":"2023-11-04T01:43:26.604301+0000","last_active":"2023-11-04T01:43:26.607852+0000","last_peered":"2023-11-04T01:43:26.607852+0000","last_clean":"2023-11-04T01:43:26.607852+0000","last_became_active":"2023-11-04T01:43:26.604074+0000","last_became_peered":"2023-11-04T01:43:26.604074+0000","last_unstale":"2023-11-04T01:43:26.607852+0000","last_undegraded":"2023-11-04T01:43:26.607852+0000","last_fullsized":"2023-11-04T01:43:26.607852+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:22:41.980821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.610986+0000","last_change":"2023-11-04T01:43:26.606506+0000","last_active":"2023-11-04T01:43:26.610986+0000","last_peered":"2023-11-04T01:43:26.610986+0000","last_clean":"2023-11-04T01:43:26.610986+0000","last_became_active":"2023-11-04T01:43:26.606129+0000","last_became_peered":"2023-11-04T01:43:26.606129+0000","last_unstale":"2023-11-04T01:43:26.610986+0000","last_undegraded":"2023-11-04T01:43:26.610986+0000","last_fullsized":"2023-11-04T01:43:26.610986+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:19.148345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.610927+0000","last_change":"2023-11-04T01:43:26.608593+0000","last_active":"2023-11-04T01:43:26.610927+0000","last_peered":"2023-11-04T01:43:26.610927+0000","last_clean":"2023-11-04T01:43:26.610927+0000","last_became_active":"2023-11-04T01:43:26.608281+0000","last_became_peered":"2023-11-04T01:43:26.608281+0000","last_unstale":"2023-11-04T01:43:26.610927+0000","last_undegraded":"2023-11-04T01:43:26.610927+0000","last_fullsized":"2023-11-04T01:43:26.610927+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:28:59.171208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.613450+0000","last_change":"2023-11-04T01:43:26.609526+0000","last_active":"2023-11-04T01:43:26.613450+0000","last_peered":"2023-11-04T01:43:26.613450+0000","last_clean":"2023-11-04T01:43:26.613450+0000","last_became_active":"2023-11-04T01:43:26.609298+0000","last_became_peered":"2023-11-04T01:43:26.609298+0000","last_unstale":"2023-11-04T01:43:26.613450+0000","last_undegraded":"2023-11-04T01:43:26.613450+0000","last_fullsized":"2023-11-04T01:43:26.613450+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:47:23.039232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.602569+0000","last_change":"2023-11-04T01:43:26.600421+0000","last_active":"2023-11-04T01:43:26.602569+0000","last_peered":"2023-11-04T01:43:26.602569+0000","last_clean":"2023-11-04T01:43:26.602569+0000","last_became_active":"2023-11-04T01:43:26.600121+0000","last_became_peered":"2023-11-04T01:43:26.600121+0000","last_unstale":"2023-11-04T01:43:26.602569+0000","last_undegraded":"2023-11-04T01:43:26.602569+0000","last_fullsized":"2023-11-04T01:43:26.602569+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:29:23.601229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.596446+0000","last_change":"2023-11-04T01:43:26.594076+0000","last_active":"2023-11-04T01:43:26.596446+0000","last_peered":"2023-11-04T01:43:26.596446+0000","last_clean":"2023-11-04T01:43:26.596446+0000","last_became_active":"2023-11-04T01:43:26.593830+0000","last_became_peered":"2023-11-04T01:43:26.593830+0000","last_unstale":"2023-11-04T01:43:26.596446+0000","last_undegraded":"2023-11-04T01:43:26.596446+0000","last_fullsized":"2023-11-04T01:43:26.596446+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:16:08.737803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.610776+0000","last_change":"2023-11-04T01:43:26.606490+0000","last_active":"2023-11-04T01:43:26.610776+0000","last_peered":"2023-11-04T01:43:26.610776+0000","last_clean":"2023-11-04T01:43:26.610776+0000","last_became_active":"2023-11-04T01:43:26.606124+0000","last_became_peered":"2023-11-04T01:43:26.606124+0000","last_unstale":"2023-11-04T01:43:26.610776+0000","last_undegraded":"2023-11-04T01:43:26.610776+0000","last_fullsized":"2023-11-04T01:43:26.610776+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:20:15.141189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.601342+0000","last_change":"2023-11-04T01:43:26.597894+0000","last_active":"2023-11-04T01:43:26.601342+0000","last_peered":"2023-11-04T01:43:26.601342+0000","last_clean":"2023-11-04T01:43:26.601342+0000","last_became_active":"2023-11-04T01:43:26.597570+0000","last_became_peered":"2023-11-04T01:43:26.597570+0000","last_unstale":"2023-11-04T01:43:26.601342+0000","last_undegraded":"2023-11-04T01:43:26.601342+0000","last_fullsized":"2023-11-04T01:43:26.601342+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:36:13.381952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.605118+0000","last_change":"2023-11-04T01:43:26.599951+0000","last_active":"2023-11-04T01:43:26.605118+0000","last_peered":"2023-11-04T01:43:26.605118+0000","last_clean":"2023-11-04T01:43:26.605118+0000","last_became_active":"2023-11-04T01:43:26.599678+0000","last_became_peered":"2023-11-04T01:43:26.599678+0000","last_unstale":"2023-11-04T01:43:26.605118+0000","last_undegraded":"2023-11-04T01:43:26.605118+0000","last_fullsized":"2023-11-04T01:43:26.605118+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:04:45.129806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.605126+0000","last_change":"2023-11-04T01:43:26.598796+0000","last_active":"2023-11-04T01:43:26.605126+0000","last_peered":"2023-11-04T01:43:26.605126+0000","last_clean":"2023-11-04T01:43:26.605126+0000","last_became_active":"2023-11-04T01:43:26.598554+0000","last_became_peered":"2023-11-04T01:43:26.598554+0000","last_unstale":"2023-11-04T01:43:26.605126+0000","last_undegraded":"2023-11-04T01:43:26.605126+0000","last_fullsized":"2023-11-04T01:43:26.605126+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:19:11.544139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.610949+0000","last_change":"2023-11-04T01:43:26.604926+0000","last_active":"2023-11-04T01:43:26.610949+0000","last_peered":"2023-11-04T01:43:26.610949+0000","last_clean":"2023-11-04T01:43:26.610949+0000","last_became_active":"2023-11-04T01:43:26.604591+0000","last_became_peered":"2023-11-04T01:43:26.604591+0000","last_unstale":"2023-11-04T01:43:26.610949+0000","last_undegraded":"2023-11-04T01:43:26.610949+0000","last_fullsized":"2023-11-04T01:43:26.610949+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:53:02.935789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.605091+0000","last_change":"2023-11-04T01:43:26.599393+0000","last_active":"2023-11-04T01:43:26.605091+0000","last_peered":"2023-11-04T01:43:26.605091+0000","last_clean":"2023-11-04T01:43:26.605091+0000","last_became_active":"2023-11-04T01:43:26.599162+0000","last_became_peered":"2023-11-04T01:43:26.599162+0000","last_unstale":"2023-11-04T01:43:26.605091+0000","last_undegraded":"2023-11-04T01:43:26.605091+0000","last_fullsized":"2023-11-04T01:43:26.605091+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:54:24.828861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.601231+0000","last_change":"2023-11-04T01:43:26.592940+0000","last_active":"2023-11-04T01:43:26.601231+0000","last_peered":"2023-11-04T01:43:26.601231+0000","last_clean":"2023-11-04T01:43:26.601231+0000","last_became_active":"2023-11-04T01:43:26.592667+0000","last_became_peered":"2023-11-04T01:43:26.592667+0000","last_unstale":"2023-11-04T01:43:26.601231+0000","last_undegraded":"2023-11-04T01:43:26.601231+0000","last_fullsized":"2023-11-04T01:43:26.601231+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:30:42.051408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.604803+0000","last_change":"2023-11-04T01:43:26.598668+0000","last_active":"2023-11-04T01:43:26.604803+0000","last_peered":"2023-11-04T01:43:26.604803+0000","last_clean":"2023-11-04T01:43:26.604803+0000","last_became_active":"2023-11-04T01:43:26.598340+0000","last_became_peered":"2023-11-04T01:43:26.598340+0000","last_unstale":"2023-11-04T01:43:26.604803+0000","last_undegraded":"2023-11-04T01:43:26.604803+0000","last_fullsized":"2023-11-04T01:43:26.604803+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:47:16.978014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.595767+0000","last_change":"2023-11-04T01:43:26.594244+0000","last_active":"2023-11-04T01:43:26.595767+0000","last_peered":"2023-11-04T01:43:26.595767+0000","last_clean":"2023-11-04T01:43:26.595767+0000","last_became_active":"2023-11-04T01:43:26.594002+0000","last_became_peered":"2023-11-04T01:43:26.594002+0000","last_unstale":"2023-11-04T01:43:26.595767+0000","last_undegraded":"2023-11-04T01:43:26.595767+0000","last_fullsized":"2023-11-04T01:43:26.595767+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:50:00.360016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.605123+0000","last_change":"2023-11-04T01:43:26.599764+0000","last_active":"2023-11-04T01:43:26.605123+0000","last_peered":"2023-11-04T01:43:26.605123+0000","last_clean":"2023-11-04T01:43:26.605123+0000","last_became_active":"2023-11-04T01:43:26.599512+0000","last_became_peered":"2023-11-04T01:43:26.599512+0000","last_unstale":"2023-11-04T01:43:26.605123+0000","last_undegraded":"2023-11-04T01:43:26.605123+0000","last_fullsized":"2023-11-04T01:43:26.605123+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:18.665481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.610869+0000","last_change":"2023-11-04T01:43:26.605197+0000","last_active":"2023-11-04T01:43:26.610869+0000","last_peered":"2023-11-04T01:43:26.610869+0000","last_clean":"2023-11-04T01:43:26.610869+0000","last_became_active":"2023-11-04T01:43:26.604921+0000","last_became_peered":"2023-11-04T01:43:26.604921+0000","last_unstale":"2023-11-04T01:43:26.610869+0000","last_undegraded":"2023-11-04T01:43:26.610869+0000","last_fullsized":"2023-11-04T01:43:26.610869+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:21.574560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.604309+0000","last_change":"2023-11-04T01:43:26.600640+0000","last_active":"2023-11-04T01:43:26.604309+0000","last_peered":"2023-11-04T01:43:26.604309+0000","last_clean":"2023-11-04T01:43:26.604309+0000","last_became_active":"2023-11-04T01:43:26.600179+0000","last_became_peered":"2023-11-04T01:43:26.600179+0000","last_unstale":"2023-11-04T01:43:26.604309+0000","last_undegraded":"2023-11-04T01:43:26.604309+0000","last_fullsized":"2023-11-04T01:43:26.604309+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:07:01.993689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.606021+0000","last_change":"2023-11-04T01:43:26.601391+0000","last_active":"2023-11-04T01:43:26.606021+0000","last_peered":"2023-11-04T01:43:26.606021+0000","last_clean":"2023-11-04T01:43:26.606021+0000","last_became_active":"2023-11-04T01:43:26.601049+0000","last_became_peered":"2023-11-04T01:43:26.601049+0000","last_unstale":"2023-11-04T01:43:26.606021+0000","last_undegraded":"2023-11-04T01:43:26.606021+0000","last_fullsized":"2023-11-04T01:43:26.606021+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:53:09.582176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.613300+0000","last_change":"2023-11-04T01:43:26.608429+0000","last_active":"2023-11-04T01:43:26.613300+0000","last_peered":"2023-11-04T01:43:26.613300+0000","last_clean":"2023-11-04T01:43:26.613300+0000","last_became_active":"2023-11-04T01:43:26.608125+0000","last_became_peered":"2023-11-04T01:43:26.608125+0000","last_unstale":"2023-11-04T01:43:26.613300+0000","last_undegraded":"2023-11-04T01:43:26.613300+0000","last_fullsized":"2023-11-04T01:43:26.613300+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:43:27.727768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.613397+0000","last_change":"2023-11-04T01:43:26.609223+0000","last_active":"2023-11-04T01:43:26.613397+0000","last_peered":"2023-11-04T01:43:26.613397+0000","last_clean":"2023-11-04T01:43:26.613397+0000","last_became_active":"2023-11-04T01:43:26.608499+0000","last_became_peered":"2023-11-04T01:43:26.608499+0000","last_unstale":"2023-11-04T01:43:26.613397+0000","last_undegraded":"2023-11-04T01:43:26.613397+0000","last_fullsized":"2023-11-04T01:43:26.613397+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:13:56.368948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.600283+0000","last_change":"2023-11-04T01:43:26.598566+0000","last_active":"2023-11-04T01:43:26.600283+0000","last_peered":"2023-11-04T01:43:26.600283+0000","last_clean":"2023-11-04T01:43:26.600283+0000","last_became_active":"2023-11-04T01:43:26.598321+0000","last_became_peered":"2023-11-04T01:43:26.598321+0000","last_unstale":"2023-11-04T01:43:26.600283+0000","last_undegraded":"2023-11-04T01:43:26.600283+0000","last_fullsized":"2023-11-04T01:43:26.600283+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:53:09.582176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.611002+0000","last_change":"2023-11-04T01:43:26.606900+0000","last_active":"2023-11-04T01:43:26.611002+0000","last_peered":"2023-11-04T01:43:26.611002+0000","last_clean":"2023-11-04T01:43:26.611002+0000","last_became_active":"2023-11-04T01:43:26.606627+0000","last_became_peered":"2023-11-04T01:43:26.606627+0000","last_unstale":"2023-11-04T01:43:26.611002+0000","last_undegraded":"2023-11-04T01:43:26.611002+0000","last_fullsized":"2023-11-04T01:43:26.611002+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:51:07.723865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.595484+0000","last_change":"2023-11-04T01:43:26.593458+0000","last_active":"2023-11-04T01:43:26.595484+0000","last_peered":"2023-11-04T01:43:26.595484+0000","last_clean":"2023-11-04T01:43:26.595484+0000","last_became_active":"2023-11-04T01:43:26.591632+0000","last_became_peered":"2023-11-04T01:43:26.591632+0000","last_unstale":"2023-11-04T01:43:26.595484+0000","last_undegraded":"2023-11-04T01:43:26.595484+0000","last_fullsized":"2023-11-04T01:43:26.595484+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:36:13.381952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.610984+0000","last_change":"2023-11-04T01:43:26.606295+0000","last_active":"2023-11-04T01:43:26.610984+0000","last_peered":"2023-11-04T01:43:26.610984+0000","last_clean":"2023-11-04T01:43:26.610984+0000","last_became_active":"2023-11-04T01:43:26.605828+0000","last_became_peered":"2023-11-04T01:43:26.605828+0000","last_unstale":"2023-11-04T01:43:26.610984+0000","last_undegraded":"2023-11-04T01:43:26.610984+0000","last_fullsized":"2023-11-04T01:43:26.610984+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:40:57.517134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.607792+0000","last_change":"2023-11-04T01:43:26.603851+0000","last_active":"2023-11-04T01:43:26.607792+0000","last_peered":"2023-11-04T01:43:26.607792+0000","last_clean":"2023-11-04T01:43:26.607792+0000","last_became_active":"2023-11-04T01:43:26.603588+0000","last_became_peered":"2023-11-04T01:43:26.603588+0000","last_unstale":"2023-11-04T01:43:26.607792+0000","last_undegraded":"2023-11-04T01:43:26.607792+0000","last_fullsized":"2023-11-04T01:43:26.607792+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:27:45.574281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.603355+0000","last_change":"2023-11-04T01:43:26.601574+0000","last_active":"2023-11-04T01:43:26.603355+0000","last_peered":"2023-11-04T01:43:26.603355+0000","last_clean":"2023-11-04T01:43:26.603355+0000","last_became_active":"2023-11-04T01:43:26.601332+0000","last_became_peered":"2023-11-04T01:43:26.601332+0000","last_unstale":"2023-11-04T01:43:26.603355+0000","last_undegraded":"2023-11-04T01:43:26.603355+0000","last_fullsized":"2023-11-04T01:43:26.603355+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:36:52.503545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.601949+0000","last_change":"2023-11-04T01:43:26.600443+0000","last_active":"2023-11-04T01:43:26.601949+0000","last_peered":"2023-11-04T01:43:26.601949+0000","last_clean":"2023-11-04T01:43:26.601949+0000","last_became_active":"2023-11-04T01:43:26.600172+0000","last_became_peered":"2023-11-04T01:43:26.600172+0000","last_unstale":"2023-11-04T01:43:26.601949+0000","last_undegraded":"2023-11-04T01:43:26.601949+0000","last_fullsized":"2023-11-04T01:43:26.601949+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:08:06.977842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.613415+0000","last_change":"2023-11-04T01:43:26.609355+0000","last_active":"2023-11-04T01:43:26.613415+0000","last_peered":"2023-11-04T01:43:26.613415+0000","last_clean":"2023-11-04T01:43:26.613415+0000","last_became_active":"2023-11-04T01:43:26.608207+0000","last_became_peered":"2023-11-04T01:43:26.608207+0000","last_unstale":"2023-11-04T01:43:26.613415+0000","last_undegraded":"2023-11-04T01:43:26.613415+0000","last_fullsized":"2023-11-04T01:43:26.613415+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:24:07.610803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.605342+0000","last_change":"2023-11-04T01:43:26.602514+0000","last_active":"2023-11-04T01:43:26.605342+0000","last_peered":"2023-11-04T01:43:26.605342+0000","last_clean":"2023-11-04T01:43:26.605342+0000","last_became_active":"2023-11-04T01:43:26.602074+0000","last_became_peered":"2023-11-04T01:43:26.602074+0000","last_unstale":"2023-11-04T01:43:26.605342+0000","last_undegraded":"2023-11-04T01:43:26.605342+0000","last_fullsized":"2023-11-04T01:43:26.605342+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:27:35.787906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.607814+0000","last_change":"2023-11-04T01:43:26.603947+0000","last_active":"2023-11-04T01:43:26.607814+0000","last_peered":"2023-11-04T01:43:26.607814+0000","last_clean":"2023-11-04T01:43:26.607814+0000","last_became_active":"2023-11-04T01:43:26.603691+0000","last_became_peered":"2023-11-04T01:43:26.603691+0000","last_unstale":"2023-11-04T01:43:26.607814+0000","last_undegraded":"2023-11-04T01:43:26.607814+0000","last_fullsized":"2023-11-04T01:43:26.607814+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:13:39.232237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.595879+0000","last_change":"2023-11-04T01:43:26.594696+0000","last_active":"2023-11-04T01:43:26.595879+0000","last_peered":"2023-11-04T01:43:26.595879+0000","last_clean":"2023-11-04T01:43:26.595879+0000","last_became_active":"2023-11-04T01:43:26.594463+0000","last_became_peered":"2023-11-04T01:43:26.594463+0000","last_unstale":"2023-11-04T01:43:26.595879+0000","last_undegraded":"2023-11-04T01:43:26.595879+0000","last_fullsized":"2023-11-04T01:43:26.595879+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:26:29.719187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.605180+0000","last_change":"2023-11-04T01:43:26.602138+0000","last_active":"2023-11-04T01:43:26.605180+0000","last_peered":"2023-11-04T01:43:26.605180+0000","last_clean":"2023-11-04T01:43:26.605180+0000","last_became_active":"2023-11-04T01:43:26.601805+0000","last_became_peered":"2023-11-04T01:43:26.601805+0000","last_unstale":"2023-11-04T01:43:26.605180+0000","last_undegraded":"2023-11-04T01:43:26.605180+0000","last_fullsized":"2023-11-04T01:43:26.605180+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:00:57.835782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.589374+0000","last_change":"2023-11-04T01:43:25.946949+0000","last_active":"2023-11-04T01:43:26.589374+0000","last_peered":"2023-11-04T01:43:26.589374+0000","last_clean":"2023-11-04T01:43:26.589374+0000","last_became_active":"2023-11-04T01:43:25.946280+0000","last_became_peered":"2023-11-04T01:43:25.946280+0000","last_unstale":"2023-11-04T01:43:26.589374+0000","last_undegraded":"2023-11-04T01:43:26.589374+0000","last_fullsized":"2023-11-04T01:43:26.589374+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:13:33.494758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.928817+0000","last_change":"2023-11-04T01:42:35.354740+0000","last_active":"2023-11-04T01:43:25.928817+0000","last_peered":"2023-11-04T01:43:25.928817+0000","last_clean":"2023-11-04T01:43:25.928817+0000","last_became_active":"2023-11-04T01:42:35.354383+0000","last_became_peered":"2023-11-04T01:42:35.354383+0000","last_unstale":"2023-11-04T01:43:25.928817+0000","last_undegraded":"2023-11-04T01:43:25.928817+0000","last_fullsized":"2023-11-04T01:43:25.928817+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:38.574240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.930435+0000","last_change":"2023-11-04T01:42:36.412560+0000","last_active":"2023-11-04T01:43:25.930435+0000","last_peered":"2023-11-04T01:43:25.930435+0000","last_clean":"2023-11-04T01:43:25.930435+0000","last_became_active":"2023-11-04T01:42:34.346736+0000","last_became_peered":"2023-11-04T01:42:34.346736+0000","last_unstale":"2023-11-04T01:43:25.930435+0000","last_undegraded":"2023-11-04T01:43:25.930435+0000","last_fullsized":"2023-11-04T01:43:25.930435+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:37.572320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071730100000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":60,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.935834+0000","last_change":"2023-11-04T01:41:36.067943+0000","last_active":"2023-11-04T01:43:25.935834+0000","last_peered":"2023-11-04T01:43:25.935834+0000","last_clean":"2023-11-04T01:43:25.935834+0000","last_became_active":"2023-11-04T01:41:34.734305+0000","last_became_peered":"2023-11-04T01:41:34.734305+0000","last_unstale":"2023-11-04T01:43:25.935834+0000","last_undegraded":"2023-11-04T01:43:25.935834+0000","last_fullsized":"2023-11-04T01:43:25.935834+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:48.121273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033780399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.613238+0000","last_change":"2023-11-04T01:43:26.609127+0000","last_active":"2023-11-04T01:43:26.613238+0000","last_peered":"2023-11-04T01:43:26.613238+0000","last_clean":"2023-11-04T01:43:26.613238+0000","last_became_active":"2023-11-04T01:43:26.608820+0000","last_became_peered":"2023-11-04T01:43:26.608820+0000","last_unstale":"2023-11-04T01:43:26.613238+0000","last_undegraded":"2023-11-04T01:43:26.613238+0000","last_fullsized":"2023-11-04T01:43:26.613238+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:11.756513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.956265+0000","last_change":"2023-11-04T01:43:25.945229+0000","last_active":"2023-11-04T01:43:26.956265+0000","last_peered":"2023-11-04T01:43:26.956265+0000","last_clean":"2023-11-04T01:43:26.956265+0000","last_became_active":"2023-11-04T01:43:25.944691+0000","last_became_peered":"2023-11-04T01:43:25.944691+0000","last_unstale":"2023-11-04T01:43:26.956265+0000","last_undegraded":"2023-11-04T01:43:26.956265+0000","last_fullsized":"2023-11-04T01:43:26.956265+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:52:59.910292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.935159+0000","last_change":"2023-11-04T01:42:35.342778+0000","last_active":"2023-11-04T01:43:25.935159+0000","last_peered":"2023-11-04T01:43:25.935159+0000","last_clean":"2023-11-04T01:43:25.935159+0000","last_became_active":"2023-11-04T01:42:35.342368+0000","last_became_peered":"2023-11-04T01:42:35.342368+0000","last_unstale":"2023-11-04T01:43:25.935159+0000","last_undegraded":"2023-11-04T01:43:25.935159+0000","last_fullsized":"2023-11-04T01:43:25.935159+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:42.907508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.931403+0000","last_change":"2023-11-04T01:42:36.413379+0000","last_active":"2023-11-04T01:43:25.931403+0000","last_peered":"2023-11-04T01:43:25.931403+0000","last_clean":"2023-11-04T01:43:25.931403+0000","last_became_active":"2023-11-04T01:42:34.354671+0000","last_became_peered":"2023-11-04T01:42:34.354671+0000","last_unstale":"2023-11-04T01:43:25.931403+0000","last_undegraded":"2023-11-04T01:43:25.931403+0000","last_fullsized":"2023-11-04T01:43:25.931403+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:36:10.769073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071203900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.927767+0000","last_change":"2023-11-04T01:41:35.728832+0000","last_active":"2023-11-04T01:43:25.927767+0000","last_peered":"2023-11-04T01:43:25.927767+0000","last_clean":"2023-11-04T01:43:25.927767+0000","last_became_active":"2023-11-04T01:41:34.733517+0000","last_became_peered":"2023-11-04T01:41:34.733517+0000","last_unstale":"2023-11-04T01:43:25.927767+0000","last_undegraded":"2023-11-04T01:43:25.927767+0000","last_fullsized":"2023-11-04T01:43:25.927767+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:19.350812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042545700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.600838+0000","last_change":"2023-11-04T01:43:26.599777+0000","last_active":"2023-11-04T01:43:26.600838+0000","last_peered":"2023-11-04T01:43:26.600838+0000","last_clean":"2023-11-04T01:43:26.600838+0000","last_became_active":"2023-11-04T01:43:26.599469+0000","last_became_peered":"2023-11-04T01:43:26.599469+0000","last_unstale":"2023-11-04T01:43:26.600838+0000","last_undegraded":"2023-11-04T01:43:26.600838+0000","last_fullsized":"2023-11-04T01:43:26.600838+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:57:32.261474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.597477+0000","last_change":"2023-11-04T01:43:25.937057+0000","last_active":"2023-11-04T01:43:26.597477+0000","last_peered":"2023-11-04T01:43:26.597477+0000","last_clean":"2023-11-04T01:43:26.597477+0000","last_became_active":"2023-11-04T01:43:25.936776+0000","last_became_peered":"2023-11-04T01:43:25.936776+0000","last_unstale":"2023-11-04T01:43:26.597477+0000","last_undegraded":"2023-11-04T01:43:26.597477+0000","last_fullsized":"2023-11-04T01:43:26.597477+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:15:47.030512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.930909+0000","last_change":"2023-11-04T01:42:35.348988+0000","last_active":"2023-11-04T01:43:25.930909+0000","last_peered":"2023-11-04T01:43:25.930909+0000","last_clean":"2023-11-04T01:43:25.930909+0000","last_became_active":"2023-11-04T01:42:35.348666+0000","last_became_peered":"2023-11-04T01:42:35.348666+0000","last_unstale":"2023-11-04T01:43:25.930909+0000","last_undegraded":"2023-11-04T01:43:25.930909+0000","last_fullsized":"2023-11-04T01:43:25.930909+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:08:28.888035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.927582+0000","last_change":"2023-11-04T01:42:36.408544+0000","last_active":"2023-11-04T01:43:25.927582+0000","last_peered":"2023-11-04T01:43:25.927582+0000","last_clean":"2023-11-04T01:43:25.927582+0000","last_became_active":"2023-11-04T01:42:34.350627+0000","last_became_peered":"2023-11-04T01:42:34.350627+0000","last_unstale":"2023-11-04T01:43:25.927582+0000","last_undegraded":"2023-11-04T01:43:25.927582+0000","last_fullsized":"2023-11-04T01:43:25.927582+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:22:16.530179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059637199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":58,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.931795+0000","last_change":"2023-11-04T01:41:35.906660+0000","last_active":"2023-11-04T01:43:25.931795+0000","last_peered":"2023-11-04T01:43:25.931795+0000","last_clean":"2023-11-04T01:43:25.931795+0000","last_became_active":"2023-11-04T01:41:34.737209+0000","last_became_peered":"2023-11-04T01:41:34.737209+0000","last_unstale":"2023-11-04T01:43:25.931795+0000","last_undegraded":"2023-11-04T01:43:25.931795+0000","last_fullsized":"2023-11-04T01:43:25.931795+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:59.608410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068889500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.606074+0000","last_change":"2023-11-04T01:43:26.602609+0000","last_active":"2023-11-04T01:43:26.606074+0000","last_peered":"2023-11-04T01:43:26.606074+0000","last_clean":"2023-11-04T01:43:26.606074+0000","last_became_active":"2023-11-04T01:43:26.601957+0000","last_became_peered":"2023-11-04T01:43:26.601957+0000","last_unstale":"2023-11-04T01:43:26.606074+0000","last_undegraded":"2023-11-04T01:43:26.606074+0000","last_fullsized":"2023-11-04T01:43:26.606074+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:30:46.749090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.588130+0000","last_change":"2023-11-04T01:43:25.945070+0000","last_active":"2023-11-04T01:43:26.588130+0000","last_peered":"2023-11-04T01:43:26.588130+0000","last_clean":"2023-11-04T01:43:26.588130+0000","last_became_active":"2023-11-04T01:43:25.944799+0000","last_became_peered":"2023-11-04T01:43:25.944799+0000","last_unstale":"2023-11-04T01:43:26.588130+0000","last_undegraded":"2023-11-04T01:43:26.588130+0000","last_fullsized":"2023-11-04T01:43:26.588130+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:27:34.786211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.924972+0000","last_change":"2023-11-04T01:42:35.355495+0000","last_active":"2023-11-04T01:43:25.924972+0000","last_peered":"2023-11-04T01:43:25.924972+0000","last_clean":"2023-11-04T01:43:25.924972+0000","last_became_active":"2023-11-04T01:42:35.355032+0000","last_became_peered":"2023-11-04T01:42:35.355032+0000","last_unstale":"2023-11-04T01:43:25.924972+0000","last_undegraded":"2023-11-04T01:43:25.924972+0000","last_fullsized":"2023-11-04T01:43:25.924972+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:48.181161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.931860+0000","last_change":"2023-11-04T01:42:36.413121+0000","last_active":"2023-11-04T01:43:25.931860+0000","last_peered":"2023-11-04T01:43:25.931860+0000","last_clean":"2023-11-04T01:43:25.931860+0000","last_became_active":"2023-11-04T01:42:34.348018+0000","last_became_peered":"2023-11-04T01:42:34.348018+0000","last_unstale":"2023-11-04T01:43:25.931860+0000","last_undegraded":"2023-11-04T01:43:25.931860+0000","last_fullsized":"2023-11-04T01:43:25.931860+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:01:38.616017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088815699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":60,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.929671+0000","last_change":"2023-11-04T01:41:36.067946+0000","last_active":"2023-11-04T01:43:25.929671+0000","last_peered":"2023-11-04T01:43:25.929671+0000","last_clean":"2023-11-04T01:43:25.929671+0000","last_became_active":"2023-11-04T01:41:34.729591+0000","last_became_peered":"2023-11-04T01:41:34.729591+0000","last_unstale":"2023-11-04T01:43:25.929671+0000","last_undegraded":"2023-11-04T01:43:25.929671+0000","last_fullsized":"2023-11-04T01:43:25.929671+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:59.608410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032681099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.603369+0000","last_change":"2023-11-04T01:43:26.598862+0000","last_active":"2023-11-04T01:43:26.603369+0000","last_peered":"2023-11-04T01:43:26.603369+0000","last_clean":"2023-11-04T01:43:26.603369+0000","last_became_active":"2023-11-04T01:43:26.598614+0000","last_became_peered":"2023-11-04T01:43:26.598614+0000","last_unstale":"2023-11-04T01:43:26.603369+0000","last_undegraded":"2023-11-04T01:43:26.603369+0000","last_fullsized":"2023-11-04T01:43:26.603369+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:33:55.624535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.590496+0000","last_change":"2023-11-04T01:43:25.939279+0000","last_active":"2023-11-04T01:43:26.590496+0000","last_peered":"2023-11-04T01:43:26.590496+0000","last_clean":"2023-11-04T01:43:26.590496+0000","last_became_active":"2023-11-04T01:43:25.939018+0000","last_became_peered":"2023-11-04T01:43:25.939018+0000","last_unstale":"2023-11-04T01:43:26.590496+0000","last_undegraded":"2023-11-04T01:43:26.590496+0000","last_fullsized":"2023-11-04T01:43:26.590496+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:30:43.848957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.929480+0000","last_change":"2023-11-04T01:42:35.345520+0000","last_active":"2023-11-04T01:43:25.929480+0000","last_peered":"2023-11-04T01:43:25.929480+0000","last_clean":"2023-11-04T01:43:25.929480+0000","last_became_active":"2023-11-04T01:42:35.345171+0000","last_became_peered":"2023-11-04T01:42:35.345171+0000","last_unstale":"2023-11-04T01:43:25.929480+0000","last_undegraded":"2023-11-04T01:43:25.929480+0000","last_fullsized":"2023-11-04T01:43:25.929480+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:09:48.559668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.932551+0000","last_change":"2023-11-04T01:42:36.408199+0000","last_active":"2023-11-04T01:43:25.932551+0000","last_peered":"2023-11-04T01:43:25.932551+0000","last_clean":"2023-11-04T01:43:25.932551+0000","last_became_active":"2023-11-04T01:42:34.346643+0000","last_became_peered":"2023-11-04T01:42:34.346643+0000","last_unstale":"2023-11-04T01:43:25.932551+0000","last_undegraded":"2023-11-04T01:43:25.932551+0000","last_fullsized":"2023-11-04T01:43:25.932551+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:16:15.635771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056985800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.933765+0000","last_change":"2023-11-04T01:41:35.905999+0000","last_active":"2023-11-04T01:43:25.933765+0000","last_peered":"2023-11-04T01:43:25.933765+0000","last_clean":"2023-11-04T01:43:25.933765+0000","last_became_active":"2023-11-04T01:41:34.735286+0000","last_became_peered":"2023-11-04T01:41:34.735286+0000","last_unstale":"2023-11-04T01:43:25.933765+0000","last_undegraded":"2023-11-04T01:43:25.933765+0000","last_fullsized":"2023-11-04T01:43:25.933765+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:14:22.019781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051880100000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.602581+0000","last_change":"2023-11-04T01:43:26.599736+0000","last_active":"2023-11-04T01:43:26.602581+0000","last_peered":"2023-11-04T01:43:26.602581+0000","last_clean":"2023-11-04T01:43:26.602581+0000","last_became_active":"2023-11-04T01:43:26.599365+0000","last_became_peered":"2023-11-04T01:43:26.599365+0000","last_unstale":"2023-11-04T01:43:26.602581+0000","last_undegraded":"2023-11-04T01:43:26.602581+0000","last_fullsized":"2023-11-04T01:43:26.602581+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:15:35.270592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.596455+0000","last_change":"2023-11-04T01:43:25.938026+0000","last_active":"2023-11-04T01:43:26.596455+0000","last_peered":"2023-11-04T01:43:26.596455+0000","last_clean":"2023-11-04T01:43:26.596455+0000","last_became_active":"2023-11-04T01:43:25.937750+0000","last_became_peered":"2023-11-04T01:43:25.937750+0000","last_unstale":"2023-11-04T01:43:26.596455+0000","last_undegraded":"2023-11-04T01:43:26.596455+0000","last_fullsized":"2023-11-04T01:43:26.596455+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:18:24.702905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.924159+0000","last_change":"2023-11-04T01:42:35.347120+0000","last_active":"2023-11-04T01:43:25.924159+0000","last_peered":"2023-11-04T01:43:25.924159+0000","last_clean":"2023-11-04T01:43:25.924159+0000","last_became_active":"2023-11-04T01:42:35.346861+0000","last_became_peered":"2023-11-04T01:42:35.346861+0000","last_unstale":"2023-11-04T01:43:25.924159+0000","last_undegraded":"2023-11-04T01:43:25.924159+0000","last_fullsized":"2023-11-04T01:43:25.924159+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:51:31.538081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.930826+0000","last_change":"2023-11-04T01:42:36.409273+0000","last_active":"2023-11-04T01:43:25.930826+0000","last_peered":"2023-11-04T01:43:25.930826+0000","last_clean":"2023-11-04T01:43:25.930826+0000","last_became_active":"2023-11-04T01:42:34.349691+0000","last_became_peered":"2023-11-04T01:42:34.349691+0000","last_unstale":"2023-11-04T01:43:25.930826+0000","last_undegraded":"2023-11-04T01:43:25.930826+0000","last_fullsized":"2023-11-04T01:43:25.930826+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:04:04.521532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000397551,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":60,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.925683+0000","last_change":"2023-11-04T01:41:36.344205+0000","last_active":"2023-11-04T01:43:25.925683+0000","last_peered":"2023-11-04T01:43:25.925683+0000","last_clean":"2023-11-04T01:43:25.925683+0000","last_became_active":"2023-11-04T01:41:34.733205+0000","last_became_peered":"2023-11-04T01:41:34.733205+0000","last_unstale":"2023-11-04T01:43:25.925683+0000","last_undegraded":"2023-11-04T01:43:25.925683+0000","last_fullsized":"2023-11-04T01:43:25.925683+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:37.958719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011584760000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.606041+0000","last_change":"2023-11-04T01:43:26.603827+0000","last_active":"2023-11-04T01:43:26.606041+0000","last_peered":"2023-11-04T01:43:26.606041+0000","last_clean":"2023-11-04T01:43:26.606041+0000","last_became_active":"2023-11-04T01:43:26.603523+0000","last_became_peered":"2023-11-04T01:43:26.603523+0000","last_unstale":"2023-11-04T01:43:26.606041+0000","last_undegraded":"2023-11-04T01:43:26.606041+0000","last_fullsized":"2023-11-04T01:43:26.606041+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:07:35.970868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.595641+0000","last_change":"2023-11-04T01:43:25.936705+0000","last_active":"2023-11-04T01:43:26.595641+0000","last_peered":"2023-11-04T01:43:26.595641+0000","last_clean":"2023-11-04T01:43:26.595641+0000","last_became_active":"2023-11-04T01:43:25.936365+0000","last_became_peered":"2023-11-04T01:43:25.936365+0000","last_unstale":"2023-11-04T01:43:26.595641+0000","last_undegraded":"2023-11-04T01:43:26.595641+0000","last_fullsized":"2023-11-04T01:43:26.595641+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:26:28.717492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.930136+0000","last_change":"2023-11-04T01:42:35.355437+0000","last_active":"2023-11-04T01:43:25.930136+0000","last_peered":"2023-11-04T01:43:25.930136+0000","last_clean":"2023-11-04T01:43:25.930136+0000","last_became_active":"2023-11-04T01:42:35.355084+0000","last_became_peered":"2023-11-04T01:42:35.355084+0000","last_unstale":"2023-11-04T01:43:25.930136+0000","last_undegraded":"2023-11-04T01:43:25.930136+0000","last_fullsized":"2023-11-04T01:43:25.930136+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:39:42.671180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.925603+0000","last_change":"2023-11-04T01:42:36.341135+0000","last_active":"2023-11-04T01:43:25.925603+0000","last_peered":"2023-11-04T01:43:25.925603+0000","last_clean":"2023-11-04T01:43:25.925603+0000","last_became_active":"2023-11-04T01:42:34.344383+0000","last_became_peered":"2023-11-04T01:42:34.344383+0000","last_unstale":"2023-11-04T01:43:25.925603+0000","last_undegraded":"2023-11-04T01:43:25.925603+0000","last_fullsized":"2023-11-04T01:43:25.925603+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:31:27.915960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011027179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":60,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.924415+0000","last_change":"2023-11-04T01:41:36.343728+0000","last_active":"2023-11-04T01:43:25.924415+0000","last_peered":"2023-11-04T01:43:25.924415+0000","last_clean":"2023-11-04T01:43:25.924415+0000","last_became_active":"2023-11-04T01:41:34.731106+0000","last_became_peered":"2023-11-04T01:41:34.731106+0000","last_unstale":"2023-11-04T01:43:25.924415+0000","last_undegraded":"2023-11-04T01:43:25.924415+0000","last_fullsized":"2023-11-04T01:43:25.924415+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:29.730483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058974500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.604884+0000","last_change":"2023-11-04T01:43:26.599668+0000","last_active":"2023-11-04T01:43:26.604884+0000","last_peered":"2023-11-04T01:43:26.604884+0000","last_clean":"2023-11-04T01:43:26.604884+0000","last_became_active":"2023-11-04T01:43:26.599352+0000","last_became_peered":"2023-11-04T01:43:26.599352+0000","last_unstale":"2023-11-04T01:43:26.604884+0000","last_undegraded":"2023-11-04T01:43:26.604884+0000","last_fullsized":"2023-11-04T01:43:26.604884+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:07:01.993689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.592569+0000","last_change":"2023-11-04T01:43:25.942872+0000","last_active":"2023-11-04T01:43:26.592569+0000","last_peered":"2023-11-04T01:43:26.592569+0000","last_clean":"2023-11-04T01:43:26.592569+0000","last_became_active":"2023-11-04T01:43:25.942638+0000","last_became_peered":"2023-11-04T01:43:25.942638+0000","last_unstale":"2023-11-04T01:43:26.592569+0000","last_undegraded":"2023-11-04T01:43:26.592569+0000","last_fullsized":"2023-11-04T01:43:26.592569+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:28:58.169513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.934193+0000","last_change":"2023-11-04T01:42:35.349178+0000","last_active":"2023-11-04T01:43:25.934193+0000","last_peered":"2023-11-04T01:43:25.934193+0000","last_clean":"2023-11-04T01:43:25.934193+0000","last_became_active":"2023-11-04T01:42:35.348762+0000","last_became_peered":"2023-11-04T01:42:35.348762+0000","last_unstale":"2023-11-04T01:43:25.934193+0000","last_undegraded":"2023-11-04T01:43:25.934193+0000","last_fullsized":"2023-11-04T01:43:25.934193+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:50:43.272196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.928033+0000","last_change":"2023-11-04T01:42:36.408535+0000","last_active":"2023-11-04T01:43:25.928033+0000","last_peered":"2023-11-04T01:43:25.928033+0000","last_clean":"2023-11-04T01:43:25.928033+0000","last_became_active":"2023-11-04T01:42:34.351574+0000","last_became_peered":"2023-11-04T01:42:34.351574+0000","last_unstale":"2023-11-04T01:43:25.928033+0000","last_undegraded":"2023-11-04T01:43:25.928033+0000","last_fullsized":"2023-11-04T01:43:25.928033+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:28.593045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053030500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.934266+0000","last_change":"2023-11-04T01:41:35.931778+0000","last_active":"2023-11-04T01:43:25.934266+0000","last_peered":"2023-11-04T01:43:25.934266+0000","last_clean":"2023-11-04T01:43:25.934266+0000","last_became_active":"2023-11-04T01:41:34.736897+0000","last_became_peered":"2023-11-04T01:41:34.736897+0000","last_unstale":"2023-11-04T01:43:25.934266+0000","last_undegraded":"2023-11-04T01:43:25.934266+0000","last_fullsized":"2023-11-04T01:43:25.934266+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:20.089706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071523300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.613376+0000","last_change":"2023-11-04T01:43:26.608944+0000","last_active":"2023-11-04T01:43:26.613376+0000","last_peered":"2023-11-04T01:43:26.613376+0000","last_clean":"2023-11-04T01:43:26.613376+0000","last_became_active":"2023-11-04T01:43:26.608489+0000","last_became_peered":"2023-11-04T01:43:26.608489+0000","last_unstale":"2023-11-04T01:43:26.613376+0000","last_undegraded":"2023-11-04T01:43:26.613376+0000","last_fullsized":"2023-11-04T01:43:26.613376+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:13:04.902034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.598365+0000","last_change":"2023-11-04T01:43:25.946569+0000","last_active":"2023-11-04T01:43:26.598365+0000","last_peered":"2023-11-04T01:43:26.598365+0000","last_clean":"2023-11-04T01:43:26.598365+0000","last_became_active":"2023-11-04T01:43:25.946280+0000","last_became_peered":"2023-11-04T01:43:25.946280+0000","last_unstale":"2023-11-04T01:43:26.598365+0000","last_undegraded":"2023-11-04T01:43:26.598365+0000","last_fullsized":"2023-11-04T01:43:26.598365+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:30:41.049713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.931713+0000","last_change":"2023-11-04T01:42:35.353394+0000","last_active":"2023-11-04T01:43:25.931713+0000","last_peered":"2023-11-04T01:43:25.931713+0000","last_clean":"2023-11-04T01:43:25.931713+0000","last_became_active":"2023-11-04T01:42:35.353098+0000","last_became_peered":"2023-11-04T01:42:35.353098+0000","last_unstale":"2023-11-04T01:43:25.931713+0000","last_undegraded":"2023-11-04T01:43:25.931713+0000","last_fullsized":"2023-11-04T01:43:25.931713+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:51:13.068224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.932871+0000","last_change":"2023-11-04T01:42:36.412911+0000","last_active":"2023-11-04T01:43:25.932871+0000","last_peered":"2023-11-04T01:43:25.932871+0000","last_clean":"2023-11-04T01:43:25.932871+0000","last_became_active":"2023-11-04T01:42:34.349620+0000","last_became_peered":"2023-11-04T01:42:34.349620+0000","last_unstale":"2023-11-04T01:43:25.932871+0000","last_undegraded":"2023-11-04T01:43:25.932871+0000","last_fullsized":"2023-11-04T01:43:25.932871+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:22:16.530179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041040599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":70,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.929928+0000","last_change":"2023-11-04T01:41:35.729017+0000","last_active":"2023-11-04T01:43:25.929928+0000","last_peered":"2023-11-04T01:43:25.929928+0000","last_clean":"2023-11-04T01:43:25.929928+0000","last_became_active":"2023-11-04T01:41:34.730592+0000","last_became_peered":"2023-11-04T01:41:34.730592+0000","last_unstale":"2023-11-04T01:43:25.929928+0000","last_undegraded":"2023-11-04T01:43:25.929928+0000","last_fullsized":"2023-11-04T01:43:25.929928+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:08.858430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088820999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.613332+0000","last_change":"2023-11-04T01:43:26.608750+0000","last_active":"2023-11-04T01:43:26.613332+0000","last_peered":"2023-11-04T01:43:26.613332+0000","last_clean":"2023-11-04T01:43:26.613332+0000","last_became_active":"2023-11-04T01:43:26.608073+0000","last_became_peered":"2023-11-04T01:43:26.608073+0000","last_unstale":"2023-11-04T01:43:26.613332+0000","last_undegraded":"2023-11-04T01:43:26.613332+0000","last_fullsized":"2023-11-04T01:43:26.613332+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:47:16.978014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.596146+0000","last_change":"2023-11-04T01:43:25.938488+0000","last_active":"2023-11-04T01:43:26.596146+0000","last_peered":"2023-11-04T01:43:26.596146+0000","last_clean":"2023-11-04T01:43:26.596146+0000","last_became_active":"2023-11-04T01:43:25.938231+0000","last_became_peered":"2023-11-04T01:43:25.938231+0000","last_unstale":"2023-11-04T01:43:26.596146+0000","last_undegraded":"2023-11-04T01:43:26.596146+0000","last_fullsized":"2023-11-04T01:43:26.596146+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:11:58.007982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.932222+0000","last_change":"2023-11-04T01:42:35.355799+0000","last_active":"2023-11-04T01:43:25.932222+0000","last_peered":"2023-11-04T01:43:25.932222+0000","last_clean":"2023-11-04T01:43:25.932222+0000","last_became_active":"2023-11-04T01:42:35.355542+0000","last_became_peered":"2023-11-04T01:42:35.355542+0000","last_unstale":"2023-11-04T01:43:25.932222+0000","last_undegraded":"2023-11-04T01:43:25.932222+0000","last_fullsized":"2023-11-04T01:43:25.932222+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:10:24.565360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.931319+0000","last_change":"2023-11-04T01:42:36.413447+0000","last_active":"2023-11-04T01:43:25.931319+0000","last_peered":"2023-11-04T01:43:25.931319+0000","last_clean":"2023-11-04T01:43:25.931319+0000","last_became_active":"2023-11-04T01:42:34.351191+0000","last_became_peered":"2023-11-04T01:42:34.351191+0000","last_unstale":"2023-11-04T01:43:25.931319+0000","last_undegraded":"2023-11-04T01:43:25.931319+0000","last_fullsized":"2023-11-04T01:43:25.931319+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:32:10.544188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082047100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":62,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.933230+0000","last_change":"2023-11-04T01:41:35.729378+0000","last_active":"2023-11-04T01:43:25.933230+0000","last_peered":"2023-11-04T01:43:25.933230+0000","last_clean":"2023-11-04T01:43:25.933230+0000","last_became_active":"2023-11-04T01:41:34.730387+0000","last_became_peered":"2023-11-04T01:41:34.730387+0000","last_unstale":"2023-11-04T01:43:25.933230+0000","last_undegraded":"2023-11-04T01:43:25.933230+0000","last_fullsized":"2023-11-04T01:43:25.933230+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:12.653602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072268699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.602821+0000","last_change":"2023-11-04T01:43:26.597621+0000","last_active":"2023-11-04T01:43:26.602821+0000","last_peered":"2023-11-04T01:43:26.602821+0000","last_clean":"2023-11-04T01:43:26.602821+0000","last_became_active":"2023-11-04T01:43:26.597368+0000","last_became_peered":"2023-11-04T01:43:26.597368+0000","last_unstale":"2023-11-04T01:43:26.602821+0000","last_undegraded":"2023-11-04T01:43:26.602821+0000","last_fullsized":"2023-11-04T01:43:26.602821+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:28:05.980460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.597594+0000","last_change":"2023-11-04T01:43:25.936248+0000","last_active":"2023-11-04T01:43:26.597594+0000","last_peered":"2023-11-04T01:43:26.597594+0000","last_clean":"2023-11-04T01:43:26.597594+0000","last_became_active":"2023-11-04T01:43:25.935979+0000","last_became_peered":"2023-11-04T01:43:25.935979+0000","last_unstale":"2023-11-04T01:43:26.597594+0000","last_undegraded":"2023-11-04T01:43:26.597594+0000","last_fullsized":"2023-11-04T01:43:26.597594+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:23:42.772424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.929733+0000","last_change":"2023-11-04T01:42:35.352317+0000","last_active":"2023-11-04T01:43:25.929733+0000","last_peered":"2023-11-04T01:43:25.929733+0000","last_clean":"2023-11-04T01:43:25.929733+0000","last_became_active":"2023-11-04T01:42:35.351486+0000","last_became_peered":"2023-11-04T01:42:35.351486+0000","last_unstale":"2023-11-04T01:43:25.929733+0000","last_undegraded":"2023-11-04T01:43:25.929733+0000","last_fullsized":"2023-11-04T01:43:25.929733+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:33:20.111728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.925129+0000","last_change":"2023-11-04T01:42:36.342710+0000","last_active":"2023-11-04T01:43:25.925129+0000","last_peered":"2023-11-04T01:43:25.925129+0000","last_clean":"2023-11-04T01:43:25.925129+0000","last_became_active":"2023-11-04T01:42:34.349773+0000","last_became_peered":"2023-11-04T01:42:34.349773+0000","last_unstale":"2023-11-04T01:43:25.925129+0000","last_undegraded":"2023-11-04T01:43:25.925129+0000","last_fullsized":"2023-11-04T01:43:25.925129+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:55:22.976726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077362500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":70,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.930203+0000","last_change":"2023-11-04T01:41:35.729318+0000","last_active":"2023-11-04T01:43:25.930203+0000","last_peered":"2023-11-04T01:43:25.930203+0000","last_clean":"2023-11-04T01:43:25.930203+0000","last_became_active":"2023-11-04T01:41:34.733796+0000","last_became_peered":"2023-11-04T01:41:34.733796+0000","last_unstale":"2023-11-04T01:43:25.930203+0000","last_undegraded":"2023-11-04T01:43:25.930203+0000","last_fullsized":"2023-11-04T01:43:25.930203+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:19.350812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053712200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.604914+0000","last_change":"2023-11-04T01:43:26.598803+0000","last_active":"2023-11-04T01:43:26.604914+0000","last_peered":"2023-11-04T01:43:26.604914+0000","last_clean":"2023-11-04T01:43:26.604914+0000","last_became_active":"2023-11-04T01:43:26.598531+0000","last_became_peered":"2023-11-04T01:43:26.598531+0000","last_unstale":"2023-11-04T01:43:26.604914+0000","last_undegraded":"2023-11-04T01:43:26.604914+0000","last_fullsized":"2023-11-04T01:43:26.604914+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:57:32.261474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.588757+0000","last_change":"2023-11-04T01:43:25.946397+0000","last_active":"2023-11-04T01:43:26.588757+0000","last_peered":"2023-11-04T01:43:26.588757+0000","last_clean":"2023-11-04T01:43:26.588757+0000","last_became_active":"2023-11-04T01:43:25.946052+0000","last_became_peered":"2023-11-04T01:43:25.946052+0000","last_unstale":"2023-11-04T01:43:26.588757+0000","last_undegraded":"2023-11-04T01:43:26.588757+0000","last_fullsized":"2023-11-04T01:43:26.588757+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:19.505130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.929328+0000","last_change":"2023-11-04T01:42:35.355335+0000","last_active":"2023-11-04T01:43:25.929328+0000","last_peered":"2023-11-04T01:43:25.929328+0000","last_clean":"2023-11-04T01:43:25.929328+0000","last_became_active":"2023-11-04T01:42:35.355057+0000","last_became_peered":"2023-11-04T01:42:35.355057+0000","last_unstale":"2023-11-04T01:43:25.929328+0000","last_undegraded":"2023-11-04T01:43:25.929328+0000","last_fullsized":"2023-11-04T01:43:25.929328+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:34:48.488293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.925719+0000","last_change":"2023-11-04T01:42:36.342412+0000","last_active":"2023-11-04T01:43:25.925719+0000","last_peered":"2023-11-04T01:43:25.925719+0000","last_clean":"2023-11-04T01:43:25.925719+0000","last_became_active":"2023-11-04T01:42:34.344325+0000","last_became_peered":"2023-11-04T01:42:34.344325+0000","last_unstale":"2023-11-04T01:43:25.925719+0000","last_undegraded":"2023-11-04T01:43:25.925719+0000","last_fullsized":"2023-11-04T01:43:25.925719+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:29:52.259787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010133010000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.932950+0000","last_change":"2023-11-04T01:41:35.931929+0000","last_active":"2023-11-04T01:43:25.932950+0000","last_peered":"2023-11-04T01:43:25.932950+0000","last_clean":"2023-11-04T01:43:25.932950+0000","last_became_active":"2023-11-04T01:41:34.738795+0000","last_became_peered":"2023-11-04T01:41:34.738795+0000","last_unstale":"2023-11-04T01:43:25.932950+0000","last_undegraded":"2023-11-04T01:43:25.932950+0000","last_fullsized":"2023-11-04T01:43:25.932950+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:59.608410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046204999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.613434+0000","last_change":"2023-11-04T01:43:26.608508+0000","last_active":"2023-11-04T01:43:26.613434+0000","last_peered":"2023-11-04T01:43:26.613434+0000","last_clean":"2023-11-04T01:43:26.613434+0000","last_became_active":"2023-11-04T01:43:26.608213+0000","last_became_peered":"2023-11-04T01:43:26.608213+0000","last_unstale":"2023-11-04T01:43:26.613434+0000","last_undegraded":"2023-11-04T01:43:26.613434+0000","last_fullsized":"2023-11-04T01:43:26.613434+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:12:28.716919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.592563+0000","last_change":"2023-11-04T01:43:25.938604+0000","last_active":"2023-11-04T01:43:26.592563+0000","last_peered":"2023-11-04T01:43:26.592563+0000","last_clean":"2023-11-04T01:43:26.592563+0000","last_became_active":"2023-11-04T01:43:25.938375+0000","last_became_peered":"2023-11-04T01:43:25.938375+0000","last_unstale":"2023-11-04T01:43:26.592563+0000","last_undegraded":"2023-11-04T01:43:26.592563+0000","last_fullsized":"2023-11-04T01:43:26.592563+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:30:45.747394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.932679+0000","last_change":"2023-11-04T01:42:35.352853+0000","last_active":"2023-11-04T01:43:25.932679+0000","last_peered":"2023-11-04T01:43:25.932679+0000","last_clean":"2023-11-04T01:43:25.932679+0000","last_became_active":"2023-11-04T01:42:35.351314+0000","last_became_peered":"2023-11-04T01:42:35.351314+0000","last_unstale":"2023-11-04T01:43:25.932679+0000","last_undegraded":"2023-11-04T01:43:25.932679+0000","last_fullsized":"2023-11-04T01:43:25.932679+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:24:28.106438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.934134+0000","last_change":"2023-11-04T01:42:36.411957+0000","last_active":"2023-11-04T01:43:25.934134+0000","last_peered":"2023-11-04T01:43:25.934134+0000","last_clean":"2023-11-04T01:43:25.934134+0000","last_became_active":"2023-11-04T01:42:34.348584+0000","last_became_peered":"2023-11-04T01:42:34.348584+0000","last_unstale":"2023-11-04T01:43:25.934134+0000","last_undegraded":"2023-11-04T01:43:25.934134+0000","last_fullsized":"2023-11-04T01:43:25.934134+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:30.702295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089633200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":70,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.928340+0000","last_change":"2023-11-04T01:41:35.728945+0000","last_active":"2023-11-04T01:43:25.928340+0000","last_peered":"2023-11-04T01:43:25.928340+0000","last_clean":"2023-11-04T01:43:25.928340+0000","last_became_active":"2023-11-04T01:41:34.735082+0000","last_became_peered":"2023-11-04T01:41:34.735082+0000","last_unstale":"2023-11-04T01:43:25.928340+0000","last_undegraded":"2023-11-04T01:43:25.928340+0000","last_fullsized":"2023-11-04T01:43:25.928340+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:16.970814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079093000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.604328+0000","last_change":"2023-11-04T01:43:26.601071+0000","last_active":"2023-11-04T01:43:26.604328+0000","last_peered":"2023-11-04T01:43:26.604328+0000","last_clean":"2023-11-04T01:43:26.604328+0000","last_became_active":"2023-11-04T01:43:26.600778+0000","last_became_peered":"2023-11-04T01:43:26.600778+0000","last_unstale":"2023-11-04T01:43:26.604328+0000","last_undegraded":"2023-11-04T01:43:26.604328+0000","last_fullsized":"2023-11-04T01:43:26.604328+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:11.756513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.585780+0000","last_change":"2023-11-04T01:43:25.937401+0000","last_active":"2023-11-04T01:43:26.585780+0000","last_peered":"2023-11-04T01:43:26.585780+0000","last_clean":"2023-11-04T01:43:26.585780+0000","last_became_active":"2023-11-04T01:43:25.937134+0000","last_became_peered":"2023-11-04T01:43:25.937134+0000","last_unstale":"2023-11-04T01:43:26.585780+0000","last_undegraded":"2023-11-04T01:43:26.585780+0000","last_fullsized":"2023-11-04T01:43:26.585780+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:50:07.744916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.933364+0000","last_change":"2023-11-04T01:42:35.349043+0000","last_active":"2023-11-04T01:43:25.933364+0000","last_peered":"2023-11-04T01:43:25.933364+0000","last_clean":"2023-11-04T01:43:25.933364+0000","last_became_active":"2023-11-04T01:42:35.348696+0000","last_became_peered":"2023-11-04T01:42:35.348696+0000","last_unstale":"2023-11-04T01:43:25.933364+0000","last_undegraded":"2023-11-04T01:43:25.933364+0000","last_fullsized":"2023-11-04T01:43:25.933364+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:21:03.655247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.932761+0000","last_change":"2023-11-04T01:42:36.412004+0000","last_active":"2023-11-04T01:43:25.932761+0000","last_peered":"2023-11-04T01:43:25.932761+0000","last_clean":"2023-11-04T01:43:25.932761+0000","last_became_active":"2023-11-04T01:42:34.347931+0000","last_became_peered":"2023-11-04T01:42:34.347931+0000","last_unstale":"2023-11-04T01:43:25.932761+0000","last_undegraded":"2023-11-04T01:43:25.932761+0000","last_fullsized":"2023-11-04T01:43:25.932761+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:04.045465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092725399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":62,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.932837+0000","last_change":"2023-11-04T01:41:35.728625+0000","last_active":"2023-11-04T01:43:25.932837+0000","last_peered":"2023-11-04T01:43:25.932837+0000","last_clean":"2023-11-04T01:43:25.932837+0000","last_became_active":"2023-11-04T01:41:34.731514+0000","last_became_peered":"2023-11-04T01:41:34.731514+0000","last_unstale":"2023-11-04T01:43:25.932837+0000","last_undegraded":"2023-11-04T01:43:25.932837+0000","last_fullsized":"2023-11-04T01:43:25.932837+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:51:50.413223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047686400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.608000+0000","last_change":"2023-11-04T01:43:26.603855+0000","last_active":"2023-11-04T01:43:26.608000+0000","last_peered":"2023-11-04T01:43:26.608000+0000","last_clean":"2023-11-04T01:43:26.608000+0000","last_became_active":"2023-11-04T01:43:26.603576+0000","last_became_peered":"2023-11-04T01:43:26.603576+0000","last_unstale":"2023-11-04T01:43:26.608000+0000","last_undegraded":"2023-11-04T01:43:26.608000+0000","last_fullsized":"2023-11-04T01:43:26.608000+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:30:42.051408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.586102+0000","last_change":"2023-11-04T01:43:25.938132+0000","last_active":"2023-11-04T01:43:26.586102+0000","last_peered":"2023-11-04T01:43:26.586102+0000","last_clean":"2023-11-04T01:43:26.586102+0000","last_became_active":"2023-11-04T01:43:25.937895+0000","last_became_peered":"2023-11-04T01:43:25.937895+0000","last_unstale":"2023-11-04T01:43:26.586102+0000","last_undegraded":"2023-11-04T01:43:26.586102+0000","last_fullsized":"2023-11-04T01:43:26.586102+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:51:34.340257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.933547+0000","last_change":"2023-11-04T01:42:35.344216+0000","last_active":"2023-11-04T01:43:25.933547+0000","last_peered":"2023-11-04T01:43:25.933547+0000","last_clean":"2023-11-04T01:43:25.933547+0000","last_became_active":"2023-11-04T01:42:35.343986+0000","last_became_peered":"2023-11-04T01:42:35.343986+0000","last_unstale":"2023-11-04T01:43:25.933547+0000","last_undegraded":"2023-11-04T01:43:25.933547+0000","last_fullsized":"2023-11-04T01:43:25.933547+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:32.012283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.934267+0000","last_change":"2023-11-04T01:42:36.408418+0000","last_active":"2023-11-04T01:43:25.934267+0000","last_peered":"2023-11-04T01:43:25.934267+0000","last_clean":"2023-11-04T01:43:25.934267+0000","last_became_active":"2023-11-04T01:42:34.345245+0000","last_became_peered":"2023-11-04T01:42:34.345245+0000","last_unstale":"2023-11-04T01:43:25.934267+0000","last_undegraded":"2023-11-04T01:43:25.934267+0000","last_fullsized":"2023-11-04T01:43:25.934267+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:01:34.850682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042992099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":60,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.924522+0000","last_change":"2023-11-04T01:41:36.343762+0000","last_active":"2023-11-04T01:43:25.924522+0000","last_peered":"2023-11-04T01:43:25.924522+0000","last_clean":"2023-11-04T01:43:25.924522+0000","last_became_active":"2023-11-04T01:41:34.733406+0000","last_became_peered":"2023-11-04T01:41:34.733406+0000","last_unstale":"2023-11-04T01:43:25.924522+0000","last_undegraded":"2023-11-04T01:43:25.924522+0000","last_fullsized":"2023-11-04T01:43:25.924522+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:34:35.541159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058533399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.605028+0000","last_change":"2023-11-04T01:43:26.598994+0000","last_active":"2023-11-04T01:43:26.605028+0000","last_peered":"2023-11-04T01:43:26.605028+0000","last_clean":"2023-11-04T01:43:26.605028+0000","last_became_active":"2023-11-04T01:43:26.598675+0000","last_became_peered":"2023-11-04T01:43:26.598675+0000","last_unstale":"2023-11-04T01:43:26.605028+0000","last_undegraded":"2023-11-04T01:43:26.605028+0000","last_fullsized":"2023-11-04T01:43:26.605028+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:12:54.552368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.596853+0000","last_change":"2023-11-04T01:43:25.937265+0000","last_active":"2023-11-04T01:43:26.596853+0000","last_peered":"2023-11-04T01:43:26.596853+0000","last_clean":"2023-11-04T01:43:26.596853+0000","last_became_active":"2023-11-04T01:43:25.936764+0000","last_became_peered":"2023-11-04T01:43:25.936764+0000","last_unstale":"2023-11-04T01:43:26.596853+0000","last_undegraded":"2023-11-04T01:43:26.596853+0000","last_fullsized":"2023-11-04T01:43:26.596853+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:31:37.659592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.928099+0000","last_change":"2023-11-04T01:42:35.345703+0000","last_active":"2023-11-04T01:43:25.928099+0000","last_peered":"2023-11-04T01:43:25.928099+0000","last_clean":"2023-11-04T01:43:25.928099+0000","last_became_active":"2023-11-04T01:42:35.345089+0000","last_became_peered":"2023-11-04T01:42:35.345089+0000","last_unstale":"2023-11-04T01:43:25.928099+0000","last_undegraded":"2023-11-04T01:43:25.928099+0000","last_fullsized":"2023-11-04T01:43:25.928099+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:36:11.770993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.924061+0000","last_change":"2023-11-04T01:42:36.341220+0000","last_active":"2023-11-04T01:43:25.924061+0000","last_peered":"2023-11-04T01:43:25.924061+0000","last_clean":"2023-11-04T01:43:25.924061+0000","last_became_active":"2023-11-04T01:42:34.350834+0000","last_became_peered":"2023-11-04T01:42:34.350834+0000","last_unstale":"2023-11-04T01:43:25.924061+0000","last_undegraded":"2023-11-04T01:43:25.924061+0000","last_fullsized":"2023-11-04T01:43:25.924061+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:16:15.635771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011584519999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.931143+0000","last_change":"2023-11-04T01:41:35.906297+0000","last_active":"2023-11-04T01:43:25.931143+0000","last_peered":"2023-11-04T01:43:25.931143+0000","last_clean":"2023-11-04T01:43:25.931143+0000","last_became_active":"2023-11-04T01:41:34.734134+0000","last_became_peered":"2023-11-04T01:41:34.734134+0000","last_unstale":"2023-11-04T01:43:25.931143+0000","last_undegraded":"2023-11-04T01:43:25.931143+0000","last_fullsized":"2023-11-04T01:43:25.931143+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:52.597063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087104900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.610733+0000","last_change":"2023-11-04T01:43:26.605357+0000","last_active":"2023-11-04T01:43:26.610733+0000","last_peered":"2023-11-04T01:43:26.610733+0000","last_clean":"2023-11-04T01:43:26.610733+0000","last_became_active":"2023-11-04T01:43:26.604820+0000","last_became_peered":"2023-11-04T01:43:26.604820+0000","last_unstale":"2023-11-04T01:43:26.610733+0000","last_undegraded":"2023-11-04T01:43:26.610733+0000","last_fullsized":"2023-11-04T01:43:26.610733+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:30:38.079607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.585502+0000","last_change":"2023-11-04T01:43:25.937639+0000","last_active":"2023-11-04T01:43:26.585502+0000","last_peered":"2023-11-04T01:43:26.585502+0000","last_clean":"2023-11-04T01:43:26.585502+0000","last_became_active":"2023-11-04T01:43:25.937389+0000","last_became_peered":"2023-11-04T01:43:25.937389+0000","last_unstale":"2023-11-04T01:43:26.585502+0000","last_undegraded":"2023-11-04T01:43:26.585502+0000","last_fullsized":"2023-11-04T01:43:26.585502+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:07:34.969173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.930042+0000","last_change":"2023-11-04T01:42:35.355771+0000","last_active":"2023-11-04T01:43:25.930042+0000","last_peered":"2023-11-04T01:43:25.930042+0000","last_clean":"2023-11-04T01:43:25.930042+0000","last_became_active":"2023-11-04T01:42:35.355459+0000","last_became_peered":"2023-11-04T01:42:35.355459+0000","last_unstale":"2023-11-04T01:43:25.930042+0000","last_undegraded":"2023-11-04T01:43:25.930042+0000","last_fullsized":"2023-11-04T01:43:25.930042+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:48:17.884449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.929600+0000","last_change":"2023-11-04T01:42:36.410175+0000","last_active":"2023-11-04T01:43:25.929600+0000","last_peered":"2023-11-04T01:43:25.929600+0000","last_clean":"2023-11-04T01:43:25.929600+0000","last_became_active":"2023-11-04T01:42:34.353093+0000","last_became_peered":"2023-11-04T01:42:34.353093+0000","last_unstale":"2023-11-04T01:43:25.929600+0000","last_undegraded":"2023-11-04T01:43:25.929600+0000","last_fullsized":"2023-11-04T01:43:25.929600+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:19:10.941730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000299241,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.932213+0000","last_change":"2023-11-04T01:41:35.906596+0000","last_active":"2023-11-04T01:43:25.932213+0000","last_peered":"2023-11-04T01:43:25.932213+0000","last_clean":"2023-11-04T01:43:25.932213+0000","last_became_active":"2023-11-04T01:41:34.738529+0000","last_became_peered":"2023-11-04T01:41:34.738529+0000","last_unstale":"2023-11-04T01:43:25.932213+0000","last_undegraded":"2023-11-04T01:43:25.932213+0000","last_fullsized":"2023-11-04T01:43:25.932213+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:48.121273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086660600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.605075+0000","last_change":"2023-11-04T01:43:26.599958+0000","last_active":"2023-11-04T01:43:26.605075+0000","last_peered":"2023-11-04T01:43:26.605075+0000","last_clean":"2023-11-04T01:43:26.605075+0000","last_became_active":"2023-11-04T01:43:26.599723+0000","last_became_peered":"2023-11-04T01:43:26.599723+0000","last_unstale":"2023-11-04T01:43:26.605075+0000","last_undegraded":"2023-11-04T01:43:26.605075+0000","last_fullsized":"2023-11-04T01:43:26.605075+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:20:15.129750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"95'1","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.955185+0000","last_change":"2023-11-04T01:43:25.942236+0000","last_active":"2023-11-04T01:43:26.955185+0000","last_peered":"2023-11-04T01:43:26.955185+0000","last_clean":"2023-11-04T01:43:26.955185+0000","last_became_active":"2023-11-04T01:43:25.941989+0000","last_became_peered":"2023-11-04T01:43:25.941989+0000","last_unstale":"2023-11-04T01:43:26.955185+0000","last_undegraded":"2023-11-04T01:43:26.955185+0000","last_fullsized":"2023-11-04T01:43:26.955185+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:21:12.226739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.932792+0000","last_change":"2023-11-04T01:42:35.352467+0000","last_active":"2023-11-04T01:43:25.932792+0000","last_peered":"2023-11-04T01:43:25.932792+0000","last_clean":"2023-11-04T01:43:25.932792+0000","last_became_active":"2023-11-04T01:42:35.352199+0000","last_became_peered":"2023-11-04T01:42:35.352199+0000","last_unstale":"2023-11-04T01:43:25.932792+0000","last_undegraded":"2023-11-04T01:43:25.932792+0000","last_fullsized":"2023-11-04T01:43:25.932792+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:34:48.488293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.929336+0000","last_change":"2023-11-04T01:42:36.410094+0000","last_active":"2023-11-04T01:43:25.929336+0000","last_peered":"2023-11-04T01:43:25.929336+0000","last_clean":"2023-11-04T01:43:25.929336+0000","last_became_active":"2023-11-04T01:42:34.346812+0000","last_became_peered":"2023-11-04T01:42:34.346812+0000","last_unstale":"2023-11-04T01:43:25.929336+0000","last_undegraded":"2023-11-04T01:43:25.929336+0000","last_fullsized":"2023-11-04T01:43:25.929336+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:47.456400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034280500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.929553+0000","last_change":"2023-11-04T01:41:35.906430+0000","last_active":"2023-11-04T01:43:25.929553+0000","last_peered":"2023-11-04T01:43:25.929553+0000","last_clean":"2023-11-04T01:43:25.929553+0000","last_became_active":"2023-11-04T01:41:34.741147+0000","last_became_peered":"2023-11-04T01:41:34.741147+0000","last_unstale":"2023-11-04T01:43:25.929553+0000","last_undegraded":"2023-11-04T01:43:25.929553+0000","last_fullsized":"2023-11-04T01:43:25.929553+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:20.089706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090504400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.610789+0000","last_change":"2023-11-04T01:43:26.606762+0000","last_active":"2023-11-04T01:43:26.610789+0000","last_peered":"2023-11-04T01:43:26.610789+0000","last_clean":"2023-11-04T01:43:26.610789+0000","last_became_active":"2023-11-04T01:43:26.606454+0000","last_became_peered":"2023-11-04T01:43:26.606454+0000","last_unstale":"2023-11-04T01:43:26.610789+0000","last_undegraded":"2023-11-04T01:43:26.610789+0000","last_fullsized":"2023-11-04T01:43:26.610789+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:36:52.503545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.597713+0000","last_change":"2023-11-04T01:43:25.933808+0000","last_active":"2023-11-04T01:43:26.597713+0000","last_peered":"2023-11-04T01:43:26.597713+0000","last_clean":"2023-11-04T01:43:26.597713+0000","last_became_active":"2023-11-04T01:43:25.933297+0000","last_became_peered":"2023-11-04T01:43:25.933297+0000","last_unstale":"2023-11-04T01:43:26.597713+0000","last_undegraded":"2023-11-04T01:43:26.597713+0000","last_fullsized":"2023-11-04T01:43:26.597713+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:44:46.271388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.931782+0000","last_change":"2023-11-04T01:42:35.348600+0000","last_active":"2023-11-04T01:43:25.931782+0000","last_peered":"2023-11-04T01:43:25.931782+0000","last_clean":"2023-11-04T01:43:25.931782+0000","last_became_active":"2023-11-04T01:42:35.348315+0000","last_became_peered":"2023-11-04T01:42:35.348315+0000","last_unstale":"2023-11-04T01:43:25.931782+0000","last_undegraded":"2023-11-04T01:43:25.931782+0000","last_fullsized":"2023-11-04T01:43:25.931782+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:13:42.469906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.929405+0000","last_change":"2023-11-04T01:42:36.411537+0000","last_active":"2023-11-04T01:43:25.929405+0000","last_peered":"2023-11-04T01:43:25.929405+0000","last_clean":"2023-11-04T01:43:25.929405+0000","last_became_active":"2023-11-04T01:42:34.354741+0000","last_became_peered":"2023-11-04T01:42:34.354741+0000","last_unstale":"2023-11-04T01:43:25.929405+0000","last_undegraded":"2023-11-04T01:43:25.929405+0000","last_fullsized":"2023-11-04T01:43:25.929405+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:22:16.530179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000668952,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":60,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.925545+0000","last_change":"2023-11-04T01:41:36.344408+0000","last_active":"2023-11-04T01:43:25.925545+0000","last_peered":"2023-11-04T01:43:25.925545+0000","last_clean":"2023-11-04T01:43:25.925545+0000","last_became_active":"2023-11-04T01:41:34.730735+0000","last_became_peered":"2023-11-04T01:41:34.730735+0000","last_unstale":"2023-11-04T01:43:25.925545+0000","last_undegraded":"2023-11-04T01:43:25.925545+0000","last_fullsized":"2023-11-04T01:43:25.925545+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:10:58.095232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081464299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.604963+0000","last_change":"2023-11-04T01:43:26.598114+0000","last_active":"2023-11-04T01:43:26.604963+0000","last_peered":"2023-11-04T01:43:26.604963+0000","last_clean":"2023-11-04T01:43:26.604963+0000","last_became_active":"2023-11-04T01:43:26.597191+0000","last_became_peered":"2023-11-04T01:43:26.597191+0000","last_unstale":"2023-11-04T01:43:26.604963+0000","last_undegraded":"2023-11-04T01:43:26.604963+0000","last_fullsized":"2023-11-04T01:43:26.604963+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:27.667188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.595390+0000","last_change":"2023-11-04T01:43:25.943802+0000","last_active":"2023-11-04T01:43:26.595390+0000","last_peered":"2023-11-04T01:43:26.595390+0000","last_clean":"2023-11-04T01:43:26.595390+0000","last_became_active":"2023-11-04T01:43:25.943541+0000","last_became_peered":"2023-11-04T01:43:25.943541+0000","last_unstale":"2023-11-04T01:43:26.595390+0000","last_undegraded":"2023-11-04T01:43:26.595390+0000","last_fullsized":"2023-11-04T01:43:26.595390+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:14:33.157947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.929480+0000","last_change":"2023-11-04T01:42:35.353952+0000","last_active":"2023-11-04T01:43:25.929480+0000","last_peered":"2023-11-04T01:43:25.929480+0000","last_clean":"2023-11-04T01:43:25.929480+0000","last_became_active":"2023-11-04T01:42:35.353703+0000","last_became_peered":"2023-11-04T01:42:35.353703+0000","last_unstale":"2023-11-04T01:43:25.929480+0000","last_undegraded":"2023-11-04T01:43:25.929480+0000","last_fullsized":"2023-11-04T01:43:25.929480+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:29.594965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.931783+0000","last_change":"2023-11-04T01:42:36.412751+0000","last_active":"2023-11-04T01:43:25.931783+0000","last_peered":"2023-11-04T01:43:25.931783+0000","last_clean":"2023-11-04T01:43:25.931783+0000","last_became_active":"2023-11-04T01:42:34.350389+0000","last_became_peered":"2023-11-04T01:42:34.350389+0000","last_unstale":"2023-11-04T01:43:25.931783+0000","last_undegraded":"2023-11-04T01:43:25.931783+0000","last_fullsized":"2023-11-04T01:43:25.931783+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:33.892673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057436599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":64,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.933321+0000","last_change":"2023-11-04T01:41:36.244245+0000","last_active":"2023-11-04T01:43:25.933321+0000","last_peered":"2023-11-04T01:43:25.933321+0000","last_clean":"2023-11-04T01:43:25.933321+0000","last_became_active":"2023-11-04T01:41:34.734925+0000","last_became_peered":"2023-11-04T01:41:34.734925+0000","last_unstale":"2023-11-04T01:43:25.933321+0000","last_undegraded":"2023-11-04T01:43:25.933321+0000","last_fullsized":"2023-11-04T01:43:25.933321+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:44.193748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025350200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.604395+0000","last_change":"2023-11-04T01:43:26.601141+0000","last_active":"2023-11-04T01:43:26.604395+0000","last_peered":"2023-11-04T01:43:26.604395+0000","last_clean":"2023-11-04T01:43:26.604395+0000","last_became_active":"2023-11-04T01:43:26.600857+0000","last_became_peered":"2023-11-04T01:43:26.600857+0000","last_unstale":"2023-11-04T01:43:26.604395+0000","last_undegraded":"2023-11-04T01:43:26.604395+0000","last_fullsized":"2023-11-04T01:43:26.604395+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:59:42.998041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.588453+0000","last_change":"2023-11-04T01:43:25.938399+0000","last_active":"2023-11-04T01:43:26.588453+0000","last_peered":"2023-11-04T01:43:26.588453+0000","last_clean":"2023-11-04T01:43:26.588453+0000","last_became_active":"2023-11-04T01:43:25.938101+0000","last_became_peered":"2023-11-04T01:43:25.938101+0000","last_unstale":"2023-11-04T01:43:26.588453+0000","last_undegraded":"2023-11-04T01:43:26.588453+0000","last_fullsized":"2023-11-04T01:43:26.588453+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:51:10.860489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.924413+0000","last_change":"2023-11-04T01:42:35.347267+0000","last_active":"2023-11-04T01:43:25.924413+0000","last_peered":"2023-11-04T01:43:25.924413+0000","last_clean":"2023-11-04T01:43:25.924413+0000","last_became_active":"2023-11-04T01:42:35.347025+0000","last_became_peered":"2023-11-04T01:42:35.347025+0000","last_unstale":"2023-11-04T01:43:25.924413+0000","last_undegraded":"2023-11-04T01:43:25.924413+0000","last_fullsized":"2023-11-04T01:43:25.924413+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:43.681647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.934221+0000","last_change":"2023-11-04T01:42:36.412195+0000","last_active":"2023-11-04T01:43:25.934221+0000","last_peered":"2023-11-04T01:43:25.934221+0000","last_clean":"2023-11-04T01:43:25.934221+0000","last_became_active":"2023-11-04T01:42:34.348235+0000","last_became_peered":"2023-11-04T01:42:34.348235+0000","last_unstale":"2023-11-04T01:43:25.934221+0000","last_undegraded":"2023-11-04T01:43:25.934221+0000","last_fullsized":"2023-11-04T01:43:25.934221+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:41:39.504471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095507199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":60,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.924134+0000","last_change":"2023-11-04T01:41:36.343956+0000","last_active":"2023-11-04T01:43:25.924134+0000","last_peered":"2023-11-04T01:43:25.924134+0000","last_clean":"2023-11-04T01:43:25.924134+0000","last_became_active":"2023-11-04T01:41:34.736013+0000","last_became_peered":"2023-11-04T01:41:34.736013+0000","last_unstale":"2023-11-04T01:43:25.924134+0000","last_undegraded":"2023-11-04T01:43:25.924134+0000","last_fullsized":"2023-11-04T01:43:25.924134+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:08.858430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081427799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.596355+0000","last_change":"2023-11-04T01:43:26.595068+0000","last_active":"2023-11-04T01:43:26.596355+0000","last_peered":"2023-11-04T01:43:26.596355+0000","last_clean":"2023-11-04T01:43:26.596355+0000","last_became_active":"2023-11-04T01:43:26.594805+0000","last_became_peered":"2023-11-04T01:43:26.594805+0000","last_unstale":"2023-11-04T01:43:26.596355+0000","last_undegraded":"2023-11-04T01:43:26.596355+0000","last_fullsized":"2023-11-04T01:43:26.596355+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:36:31.544152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"95'4","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.955728+0000","last_change":"2023-11-04T01:43:25.935226+0000","last_active":"2023-11-04T01:43:26.955728+0000","last_peered":"2023-11-04T01:43:26.955728+0000","last_clean":"2023-11-04T01:43:26.955728+0000","last_became_active":"2023-11-04T01:43:25.934932+0000","last_became_peered":"2023-11-04T01:43:25.934932+0000","last_unstale":"2023-11-04T01:43:26.955728+0000","last_undegraded":"2023-11-04T01:43:26.955728+0000","last_fullsized":"2023-11-04T01:43:26.955728+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:25:57.693458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.927480+0000","last_change":"2023-11-04T01:42:35.354870+0000","last_active":"2023-11-04T01:43:25.927480+0000","last_peered":"2023-11-04T01:43:25.927480+0000","last_clean":"2023-11-04T01:43:25.927480+0000","last_became_active":"2023-11-04T01:42:35.354442+0000","last_became_peered":"2023-11-04T01:42:35.354442+0000","last_unstale":"2023-11-04T01:43:25.927480+0000","last_undegraded":"2023-11-04T01:43:25.927480+0000","last_fullsized":"2023-11-04T01:43:25.927480+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:08:28.888035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.924320+0000","last_change":"2023-11-04T01:42:36.342222+0000","last_active":"2023-11-04T01:43:25.924320+0000","last_peered":"2023-11-04T01:43:25.924320+0000","last_clean":"2023-11-04T01:43:25.924320+0000","last_became_active":"2023-11-04T01:42:34.347183+0000","last_became_peered":"2023-11-04T01:42:34.347183+0000","last_unstale":"2023-11-04T01:43:25.924320+0000","last_undegraded":"2023-11-04T01:43:25.924320+0000","last_fullsized":"2023-11-04T01:43:25.924320+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:52:53.403289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001441877,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":64,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.930818+0000","last_change":"2023-11-04T01:41:36.243977+0000","last_active":"2023-11-04T01:43:25.930818+0000","last_peered":"2023-11-04T01:43:25.930818+0000","last_clean":"2023-11-04T01:43:25.930818+0000","last_became_active":"2023-11-04T01:41:34.733127+0000","last_became_peered":"2023-11-04T01:41:34.733127+0000","last_unstale":"2023-11-04T01:43:25.930818+0000","last_undegraded":"2023-11-04T01:43:25.930818+0000","last_fullsized":"2023-11-04T01:43:25.930818+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:36.118907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051788300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.601531+0000","last_change":"2023-11-04T01:43:26.596781+0000","last_active":"2023-11-04T01:43:26.601531+0000","last_peered":"2023-11-04T01:43:26.601531+0000","last_clean":"2023-11-04T01:43:26.601531+0000","last_became_active":"2023-11-04T01:43:26.596496+0000","last_became_peered":"2023-11-04T01:43:26.596496+0000","last_unstale":"2023-11-04T01:43:26.601531+0000","last_undegraded":"2023-11-04T01:43:26.601531+0000","last_fullsized":"2023-11-04T01:43:26.601531+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:59:42.998041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.589734+0000","last_change":"2023-11-04T01:43:25.946646+0000","last_active":"2023-11-04T01:43:26.589734+0000","last_peered":"2023-11-04T01:43:26.589734+0000","last_clean":"2023-11-04T01:43:26.589734+0000","last_became_active":"2023-11-04T01:43:25.946321+0000","last_became_peered":"2023-11-04T01:43:25.946321+0000","last_unstale":"2023-11-04T01:43:26.589734+0000","last_undegraded":"2023-11-04T01:43:26.589734+0000","last_fullsized":"2023-11-04T01:43:26.589734+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:52:22.125331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.933515+0000","last_change":"2023-11-04T01:42:35.354884+0000","last_active":"2023-11-04T01:43:25.933515+0000","last_peered":"2023-11-04T01:43:25.933515+0000","last_clean":"2023-11-04T01:43:25.933515+0000","last_became_active":"2023-11-04T01:42:35.354616+0000","last_became_peered":"2023-11-04T01:42:35.354616+0000","last_unstale":"2023-11-04T01:43:25.933515+0000","last_undegraded":"2023-11-04T01:43:25.933515+0000","last_fullsized":"2023-11-04T01:43:25.933515+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:41:40.506391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.930694+0000","last_change":"2023-11-04T01:42:36.411716+0000","last_active":"2023-11-04T01:43:25.930694+0000","last_peered":"2023-11-04T01:43:25.930694+0000","last_clean":"2023-11-04T01:43:25.930694+0000","last_became_active":"2023-11-04T01:42:34.350215+0000","last_became_peered":"2023-11-04T01:42:34.350215+0000","last_unstale":"2023-11-04T01:43:25.930694+0000","last_undegraded":"2023-11-04T01:43:25.930694+0000","last_fullsized":"2023-11-04T01:43:25.930694+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:20:02.805323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076372199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":60,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.932946+0000","last_change":"2023-11-04T01:41:36.067797+0000","last_active":"2023-11-04T01:43:25.932946+0000","last_peered":"2023-11-04T01:43:25.932946+0000","last_clean":"2023-11-04T01:43:25.932946+0000","last_became_active":"2023-11-04T01:41:34.734880+0000","last_became_peered":"2023-11-04T01:41:34.734880+0000","last_unstale":"2023-11-04T01:43:25.932946+0000","last_undegraded":"2023-11-04T01:43:25.932946+0000","last_fullsized":"2023-11-04T01:43:25.932946+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:20.089706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036003499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.595800+0000","last_change":"2023-11-04T01:43:26.594187+0000","last_active":"2023-11-04T01:43:26.595800+0000","last_peered":"2023-11-04T01:43:26.595800+0000","last_clean":"2023-11-04T01:43:26.595800+0000","last_became_active":"2023-11-04T01:43:26.593927+0000","last_became_peered":"2023-11-04T01:43:26.593927+0000","last_unstale":"2023-11-04T01:43:26.595800+0000","last_undegraded":"2023-11-04T01:43:26.595800+0000","last_fullsized":"2023-11-04T01:43:26.595800+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:21:13.228434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.589445+0000","last_change":"2023-11-04T01:43:25.946670+0000","last_active":"2023-11-04T01:43:26.589445+0000","last_peered":"2023-11-04T01:43:26.589445+0000","last_clean":"2023-11-04T01:43:26.589445+0000","last_became_active":"2023-11-04T01:43:25.946214+0000","last_became_peered":"2023-11-04T01:43:25.946214+0000","last_unstale":"2023-11-04T01:43:26.589445+0000","last_undegraded":"2023-11-04T01:43:26.589445+0000","last_fullsized":"2023-11-04T01:43:26.589445+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:53:44.992459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.928194+0000","last_change":"2023-11-04T01:42:35.345946+0000","last_active":"2023-11-04T01:43:25.928194+0000","last_peered":"2023-11-04T01:43:25.928194+0000","last_clean":"2023-11-04T01:43:25.928194+0000","last_became_active":"2023-11-04T01:42:35.345033+0000","last_became_peered":"2023-11-04T01:42:35.345033+0000","last_unstale":"2023-11-04T01:43:25.928194+0000","last_undegraded":"2023-11-04T01:43:25.928194+0000","last_fullsized":"2023-11-04T01:43:25.928194+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:32:11.546107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.933594+0000","last_change":"2023-11-04T01:42:36.410760+0000","last_active":"2023-11-04T01:43:25.933594+0000","last_peered":"2023-11-04T01:43:25.933594+0000","last_clean":"2023-11-04T01:43:25.933594+0000","last_became_active":"2023-11-04T01:42:34.349633+0000","last_became_peered":"2023-11-04T01:42:34.349633+0000","last_unstale":"2023-11-04T01:43:25.933594+0000","last_undegraded":"2023-11-04T01:43:25.933594+0000","last_fullsized":"2023-11-04T01:43:25.933594+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:08:27.886115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066417699999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":62,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.932738+0000","last_change":"2023-11-04T01:41:35.729089+0000","last_active":"2023-11-04T01:43:25.932738+0000","last_peered":"2023-11-04T01:43:25.932738+0000","last_clean":"2023-11-04T01:43:25.932738+0000","last_became_active":"2023-11-04T01:41:34.731063+0000","last_became_peered":"2023-11-04T01:41:34.731063+0000","last_unstale":"2023-11-04T01:43:25.932738+0000","last_undegraded":"2023-11-04T01:43:25.932738+0000","last_fullsized":"2023-11-04T01:43:25.932738+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:38:46.633175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083653600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.594605+0000","last_change":"2023-11-04T01:43:26.592882+0000","last_active":"2023-11-04T01:43:26.594605+0000","last_peered":"2023-11-04T01:43:26.594605+0000","last_clean":"2023-11-04T01:43:26.594605+0000","last_became_active":"2023-11-04T01:43:26.591571+0000","last_became_peered":"2023-11-04T01:43:26.591571+0000","last_unstale":"2023-11-04T01:43:26.594605+0000","last_undegraded":"2023-11-04T01:43:26.594605+0000","last_fullsized":"2023-11-04T01:43:26.594605+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:28:59.171208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.591988+0000","last_change":"2023-11-04T01:43:25.937396+0000","last_active":"2023-11-04T01:43:26.591988+0000","last_peered":"2023-11-04T01:43:26.591988+0000","last_clean":"2023-11-04T01:43:26.591988+0000","last_became_active":"2023-11-04T01:43:25.937108+0000","last_became_peered":"2023-11-04T01:43:25.937108+0000","last_unstale":"2023-11-04T01:43:26.591988+0000","last_undegraded":"2023-11-04T01:43:26.591988+0000","last_fullsized":"2023-11-04T01:43:26.591988+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:53:08.580481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.931627+0000","last_change":"2023-11-04T01:42:35.357455+0000","last_active":"2023-11-04T01:43:25.931627+0000","last_peered":"2023-11-04T01:43:25.931627+0000","last_clean":"2023-11-04T01:43:25.931627+0000","last_became_active":"2023-11-04T01:42:35.357198+0000","last_became_peered":"2023-11-04T01:42:35.357198+0000","last_unstale":"2023-11-04T01:43:25.931627+0000","last_undegraded":"2023-11-04T01:43:25.931627+0000","last_fullsized":"2023-11-04T01:43:25.931627+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:33:20.111728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.924878+0000","last_change":"2023-11-04T01:42:36.342203+0000","last_active":"2023-11-04T01:43:25.924878+0000","last_peered":"2023-11-04T01:43:25.924878+0000","last_clean":"2023-11-04T01:43:25.924878+0000","last_became_active":"2023-11-04T01:42:34.351883+0000","last_became_peered":"2023-11-04T01:42:34.351883+0000","last_unstale":"2023-11-04T01:43:25.924878+0000","last_undegraded":"2023-11-04T01:43:25.924878+0000","last_fullsized":"2023-11-04T01:43:25.924878+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:41.905588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016503290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":70,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.930033+0000","last_change":"2023-11-04T01:41:35.729232+0000","last_active":"2023-11-04T01:43:25.930033+0000","last_peered":"2023-11-04T01:43:25.930033+0000","last_clean":"2023-11-04T01:43:25.930033+0000","last_became_active":"2023-11-04T01:41:34.731490+0000","last_became_peered":"2023-11-04T01:41:34.731490+0000","last_unstale":"2023-11-04T01:43:25.930033+0000","last_undegraded":"2023-11-04T01:43:25.930033+0000","last_fullsized":"2023-11-04T01:43:25.930033+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:37.958719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089653699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.607617+0000","last_change":"2023-11-04T01:43:26.603489+0000","last_active":"2023-11-04T01:43:26.607617+0000","last_peered":"2023-11-04T01:43:26.607617+0000","last_clean":"2023-11-04T01:43:26.607617+0000","last_became_active":"2023-11-04T01:43:26.603241+0000","last_became_peered":"2023-11-04T01:43:26.603241+0000","last_unstale":"2023-11-04T01:43:26.607617+0000","last_undegraded":"2023-11-04T01:43:26.607617+0000","last_fullsized":"2023-11-04T01:43:26.607617+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:30:46.749090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.956365+0000","last_change":"2023-11-04T01:43:25.945353+0000","last_active":"2023-11-04T01:43:26.956365+0000","last_peered":"2023-11-04T01:43:26.956365+0000","last_clean":"2023-11-04T01:43:26.956365+0000","last_became_active":"2023-11-04T01:43:25.945057+0000","last_became_peered":"2023-11-04T01:43:25.945057+0000","last_unstale":"2023-11-04T01:43:26.956365+0000","last_undegraded":"2023-11-04T01:43:26.956365+0000","last_fullsized":"2023-11-04T01:43:26.956365+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:55:50.937742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.932246+0000","last_change":"2023-11-04T01:42:35.353012+0000","last_active":"2023-11-04T01:43:25.932246+0000","last_peered":"2023-11-04T01:43:25.932246+0000","last_clean":"2023-11-04T01:43:25.932246+0000","last_became_active":"2023-11-04T01:42:35.352268+0000","last_became_peered":"2023-11-04T01:42:35.352268+0000","last_unstale":"2023-11-04T01:43:25.932246+0000","last_undegraded":"2023-11-04T01:43:25.932246+0000","last_fullsized":"2023-11-04T01:43:25.932246+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:51:13.068224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.931543+0000","last_change":"2023-11-04T01:42:36.413549+0000","last_active":"2023-11-04T01:43:25.931543+0000","last_peered":"2023-11-04T01:43:25.931543+0000","last_clean":"2023-11-04T01:43:25.931543+0000","last_became_active":"2023-11-04T01:42:34.355467+0000","last_became_peered":"2023-11-04T01:42:34.355467+0000","last_unstale":"2023-11-04T01:43:25.931543+0000","last_undegraded":"2023-11-04T01:43:25.931543+0000","last_fullsized":"2023-11-04T01:43:25.931543+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:09:47.557748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071579,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":60,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.925197+0000","last_change":"2023-11-04T01:41:36.344018+0000","last_active":"2023-11-04T01:43:25.925197+0000","last_peered":"2023-11-04T01:43:25.925197+0000","last_clean":"2023-11-04T01:43:25.925197+0000","last_became_active":"2023-11-04T01:41:34.734178+0000","last_became_peered":"2023-11-04T01:41:34.734178+0000","last_unstale":"2023-11-04T01:43:25.925197+0000","last_undegraded":"2023-11-04T01:43:25.925197+0000","last_fullsized":"2023-11-04T01:43:25.925197+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:16.970814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077338299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.613542+0000","last_change":"2023-11-04T01:43:26.608387+0000","last_active":"2023-11-04T01:43:26.613542+0000","last_peered":"2023-11-04T01:43:26.613542+0000","last_clean":"2023-11-04T01:43:26.613542+0000","last_became_active":"2023-11-04T01:43:26.608162+0000","last_became_peered":"2023-11-04T01:43:26.608162+0000","last_unstale":"2023-11-04T01:43:26.613542+0000","last_undegraded":"2023-11-04T01:43:26.613542+0000","last_fullsized":"2023-11-04T01:43:26.613542+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:18:39.204152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.588897+0000","last_change":"2023-11-04T01:43:25.939285+0000","last_active":"2023-11-04T01:43:26.588897+0000","last_peered":"2023-11-04T01:43:26.588897+0000","last_clean":"2023-11-04T01:43:26.588897+0000","last_became_active":"2023-11-04T01:43:25.938988+0000","last_became_peered":"2023-11-04T01:43:25.938988+0000","last_unstale":"2023-11-04T01:43:26.588897+0000","last_undegraded":"2023-11-04T01:43:26.588897+0000","last_fullsized":"2023-11-04T01:43:26.588897+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:17:07.224941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.931703+0000","last_change":"2023-11-04T01:42:35.351651+0000","last_active":"2023-11-04T01:43:25.931703+0000","last_peered":"2023-11-04T01:43:25.931703+0000","last_clean":"2023-11-04T01:43:25.931703+0000","last_became_active":"2023-11-04T01:42:35.351384+0000","last_became_peered":"2023-11-04T01:42:35.351384+0000","last_unstale":"2023-11-04T01:43:25.931703+0000","last_undegraded":"2023-11-04T01:43:25.931703+0000","last_fullsized":"2023-11-04T01:43:25.931703+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:16.391588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.925060+0000","last_change":"2023-11-04T01:42:36.342476+0000","last_active":"2023-11-04T01:43:25.925060+0000","last_peered":"2023-11-04T01:43:25.925060+0000","last_clean":"2023-11-04T01:43:25.925060+0000","last_became_active":"2023-11-04T01:42:34.350295+0000","last_became_peered":"2023-11-04T01:42:34.350295+0000","last_unstale":"2023-11-04T01:43:25.925060+0000","last_undegraded":"2023-11-04T01:43:25.925060+0000","last_fullsized":"2023-11-04T01:43:25.925060+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:30:27.909910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000695332,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":58,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.932219+0000","last_change":"2023-11-04T01:41:35.906788+0000","last_active":"2023-11-04T01:43:25.932219+0000","last_peered":"2023-11-04T01:43:25.932219+0000","last_clean":"2023-11-04T01:43:25.932219+0000","last_became_active":"2023-11-04T01:41:34.734386+0000","last_became_peered":"2023-11-04T01:41:34.734386+0000","last_unstale":"2023-11-04T01:43:25.932219+0000","last_undegraded":"2023-11-04T01:43:25.932219+0000","last_fullsized":"2023-11-04T01:43:25.932219+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:23:23.733128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060435600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.604374+0000","last_change":"2023-11-04T01:43:26.600756+0000","last_active":"2023-11-04T01:43:26.604374+0000","last_peered":"2023-11-04T01:43:26.604374+0000","last_clean":"2023-11-04T01:43:26.604374+0000","last_became_active":"2023-11-04T01:43:26.600195+0000","last_became_peered":"2023-11-04T01:43:26.600195+0000","last_unstale":"2023-11-04T01:43:26.604374+0000","last_undegraded":"2023-11-04T01:43:26.604374+0000","last_fullsized":"2023-11-04T01:43:26.604374+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:51:11.862184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.585919+0000","last_change":"2023-11-04T01:43:25.940024+0000","last_active":"2023-11-04T01:43:26.585919+0000","last_peered":"2023-11-04T01:43:26.585919+0000","last_clean":"2023-11-04T01:43:26.585919+0000","last_became_active":"2023-11-04T01:43:25.939732+0000","last_became_peered":"2023-11-04T01:43:25.939732+0000","last_unstale":"2023-11-04T01:43:26.585919+0000","last_undegraded":"2023-11-04T01:43:26.585919+0000","last_fullsized":"2023-11-04T01:43:26.585919+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:38:21.324255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.927757+0000","last_change":"2023-11-04T01:42:35.354173+0000","last_active":"2023-11-04T01:43:25.927757+0000","last_peered":"2023-11-04T01:43:25.927757+0000","last_clean":"2023-11-04T01:43:25.927757+0000","last_became_active":"2023-11-04T01:42:35.353832+0000","last_became_peered":"2023-11-04T01:42:35.353832+0000","last_unstale":"2023-11-04T01:43:25.927757+0000","last_undegraded":"2023-11-04T01:43:25.927757+0000","last_fullsized":"2023-11-04T01:43:25.927757+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:34:48.488293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.933233+0000","last_change":"2023-11-04T01:42:36.342247+0000","last_active":"2023-11-04T01:43:25.933233+0000","last_peered":"2023-11-04T01:43:25.933233+0000","last_clean":"2023-11-04T01:43:25.933233+0000","last_became_active":"2023-11-04T01:42:34.352917+0000","last_became_peered":"2023-11-04T01:42:34.352917+0000","last_unstale":"2023-11-04T01:43:25.933233+0000","last_undegraded":"2023-11-04T01:43:25.933233+0000","last_fullsized":"2023-11-04T01:43:25.933233+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:56.180797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014365140000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.932003+0000","last_change":"2023-11-04T01:41:35.931718+0000","last_active":"2023-11-04T01:43:25.932003+0000","last_peered":"2023-11-04T01:43:25.932003+0000","last_clean":"2023-11-04T01:43:25.932003+0000","last_became_active":"2023-11-04T01:41:34.741033+0000","last_became_peered":"2023-11-04T01:41:34.741033+0000","last_unstale":"2023-11-04T01:43:25.932003+0000","last_undegraded":"2023-11-04T01:43:25.932003+0000","last_fullsized":"2023-11-04T01:43:25.932003+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:48.121273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065858400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.604779+0000","last_change":"2023-11-04T01:43:26.602337+0000","last_active":"2023-11-04T01:43:26.604779+0000","last_peered":"2023-11-04T01:43:26.604779+0000","last_clean":"2023-11-04T01:43:26.604779+0000","last_became_active":"2023-11-04T01:43:26.602009+0000","last_became_peered":"2023-11-04T01:43:26.602009+0000","last_unstale":"2023-11-04T01:43:26.604779+0000","last_undegraded":"2023-11-04T01:43:26.604779+0000","last_fullsized":"2023-11-04T01:43:26.604779+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:53:00.911987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.590704+0000","last_change":"2023-11-04T01:43:25.946784+0000","last_active":"2023-11-04T01:43:26.590704+0000","last_peered":"2023-11-04T01:43:26.590704+0000","last_clean":"2023-11-04T01:43:26.590704+0000","last_became_active":"2023-11-04T01:43:25.946017+0000","last_became_peered":"2023-11-04T01:43:25.946017+0000","last_unstale":"2023-11-04T01:43:26.590704+0000","last_undegraded":"2023-11-04T01:43:26.590704+0000","last_fullsized":"2023-11-04T01:43:26.590704+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:38.768411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.933310+0000","last_change":"2023-11-04T01:42:35.351103+0000","last_active":"2023-11-04T01:43:25.933310+0000","last_peered":"2023-11-04T01:43:25.933310+0000","last_clean":"2023-11-04T01:43:25.933310+0000","last_became_active":"2023-11-04T01:42:35.350867+0000","last_became_peered":"2023-11-04T01:42:35.350867+0000","last_unstale":"2023-11-04T01:43:25.933310+0000","last_undegraded":"2023-11-04T01:43:25.933310+0000","last_fullsized":"2023-11-04T01:43:25.933310+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:12:54.713516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.932811+0000","last_change":"2023-11-04T01:42:36.408801+0000","last_active":"2023-11-04T01:43:25.932811+0000","last_peered":"2023-11-04T01:43:25.932811+0000","last_clean":"2023-11-04T01:43:25.932811+0000","last_became_active":"2023-11-04T01:42:34.345669+0000","last_became_peered":"2023-11-04T01:42:34.345669+0000","last_unstale":"2023-11-04T01:43:25.932811+0000","last_undegraded":"2023-11-04T01:43:25.932811+0000","last_fullsized":"2023-11-04T01:43:25.932811+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:42.679727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055359799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.927237+0000","last_change":"2023-11-04T01:41:35.728094+0000","last_active":"2023-11-04T01:43:25.927237+0000","last_peered":"2023-11-04T01:43:25.927237+0000","last_clean":"2023-11-04T01:43:25.927237+0000","last_became_active":"2023-11-04T01:41:34.738687+0000","last_became_peered":"2023-11-04T01:41:34.738687+0000","last_unstale":"2023-11-04T01:43:25.927237+0000","last_undegraded":"2023-11-04T01:43:25.927237+0000","last_fullsized":"2023-11-04T01:43:25.927237+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:37.958719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068772699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.605264+0000","last_change":"2023-11-04T01:43:26.602580+0000","last_active":"2023-11-04T01:43:26.605264+0000","last_peered":"2023-11-04T01:43:26.605264+0000","last_clean":"2023-11-04T01:43:26.605264+0000","last_became_active":"2023-11-04T01:43:26.602205+0000","last_became_peered":"2023-11-04T01:43:26.602205+0000","last_unstale":"2023-11-04T01:43:26.605264+0000","last_undegraded":"2023-11-04T01:43:26.605264+0000","last_fullsized":"2023-11-04T01:43:26.605264+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:33:55.624535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.596766+0000","last_change":"2023-11-04T01:43:25.940123+0000","last_active":"2023-11-04T01:43:26.596766+0000","last_peered":"2023-11-04T01:43:26.596766+0000","last_clean":"2023-11-04T01:43:26.596766+0000","last_became_active":"2023-11-04T01:43:25.939837+0000","last_became_peered":"2023-11-04T01:43:25.939837+0000","last_unstale":"2023-11-04T01:43:26.596766+0000","last_undegraded":"2023-11-04T01:43:26.596766+0000","last_fullsized":"2023-11-04T01:43:26.596766+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:11:56.324882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.927888+0000","last_change":"2023-11-04T01:42:35.354730+0000","last_active":"2023-11-04T01:43:25.927888+0000","last_peered":"2023-11-04T01:43:25.927888+0000","last_clean":"2023-11-04T01:43:25.927888+0000","last_became_active":"2023-11-04T01:42:35.354427+0000","last_became_peered":"2023-11-04T01:42:35.354427+0000","last_unstale":"2023-11-04T01:43:25.927888+0000","last_undegraded":"2023-11-04T01:43:25.927888+0000","last_fullsized":"2023-11-04T01:43:25.927888+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:41:40.506391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.932748+0000","last_change":"2023-11-04T01:42:36.407795+0000","last_active":"2023-11-04T01:43:25.932748+0000","last_peered":"2023-11-04T01:43:25.932748+0000","last_clean":"2023-11-04T01:43:25.932748+0000","last_became_active":"2023-11-04T01:42:34.349234+0000","last_became_peered":"2023-11-04T01:42:34.349234+0000","last_unstale":"2023-11-04T01:43:25.932748+0000","last_undegraded":"2023-11-04T01:43:25.932748+0000","last_fullsized":"2023-11-04T01:43:25.932748+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:31:27.915960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000451805,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":62,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.932901+0000","last_change":"2023-11-04T01:41:35.729106+0000","last_active":"2023-11-04T01:43:25.932901+0000","last_peered":"2023-11-04T01:43:25.932901+0000","last_clean":"2023-11-04T01:43:25.932901+0000","last_became_active":"2023-11-04T01:41:34.731230+0000","last_became_peered":"2023-11-04T01:41:34.731230+0000","last_unstale":"2023-11-04T01:43:25.932901+0000","last_undegraded":"2023-11-04T01:43:25.932901+0000","last_fullsized":"2023-11-04T01:43:25.932901+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:07:32.744572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078592199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.613562+0000","last_change":"2023-11-04T01:43:26.609677+0000","last_active":"2023-11-04T01:43:26.613562+0000","last_peered":"2023-11-04T01:43:26.613562+0000","last_clean":"2023-11-04T01:43:26.613562+0000","last_became_active":"2023-11-04T01:43:26.609284+0000","last_became_peered":"2023-11-04T01:43:26.609284+0000","last_unstale":"2023-11-04T01:43:26.613562+0000","last_undegraded":"2023-11-04T01:43:26.613562+0000","last_fullsized":"2023-11-04T01:43:26.613562+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:27:55.919487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.596659+0000","last_change":"2023-11-04T01:43:25.939708+0000","last_active":"2023-11-04T01:43:26.596659+0000","last_peered":"2023-11-04T01:43:26.596659+0000","last_clean":"2023-11-04T01:43:26.596659+0000","last_became_active":"2023-11-04T01:43:25.939487+0000","last_became_peered":"2023-11-04T01:43:25.939487+0000","last_unstale":"2023-11-04T01:43:26.596659+0000","last_undegraded":"2023-11-04T01:43:26.596659+0000","last_fullsized":"2023-11-04T01:43:26.596659+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:30:16.920650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.930743+0000","last_change":"2023-11-04T01:42:35.352725+0000","last_active":"2023-11-04T01:43:25.930743+0000","last_peered":"2023-11-04T01:43:25.930743+0000","last_clean":"2023-11-04T01:43:25.930743+0000","last_became_active":"2023-11-04T01:42:35.352127+0000","last_became_peered":"2023-11-04T01:42:35.352127+0000","last_unstale":"2023-11-04T01:43:25.930743+0000","last_undegraded":"2023-11-04T01:43:25.930743+0000","last_fullsized":"2023-11-04T01:43:25.930743+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:52:59.201087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.931414+0000","last_change":"2023-11-04T01:42:36.342229+0000","last_active":"2023-11-04T01:43:25.931414+0000","last_peered":"2023-11-04T01:43:25.931414+0000","last_clean":"2023-11-04T01:43:25.931414+0000","last_became_active":"2023-11-04T01:42:34.351542+0000","last_became_peered":"2023-11-04T01:42:34.351542+0000","last_unstale":"2023-11-04T01:43:25.931414+0000","last_undegraded":"2023-11-04T01:43:25.931414+0000","last_fullsized":"2023-11-04T01:43:25.931414+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:37:08.472507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017924740000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":62,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.932825+0000","last_change":"2023-11-04T01:41:35.728672+0000","last_active":"2023-11-04T01:43:25.932825+0000","last_peered":"2023-11-04T01:43:25.932825+0000","last_clean":"2023-11-04T01:43:25.932825+0000","last_became_active":"2023-11-04T01:41:34.727419+0000","last_became_peered":"2023-11-04T01:41:34.727419+0000","last_unstale":"2023-11-04T01:43:25.932825+0000","last_undegraded":"2023-11-04T01:43:25.932825+0000","last_fullsized":"2023-11-04T01:43:25.932825+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:35:01.127206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044278299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.594595+0000","last_change":"2023-11-04T01:43:26.593123+0000","last_active":"2023-11-04T01:43:26.594595+0000","last_peered":"2023-11-04T01:43:26.594595+0000","last_clean":"2023-11-04T01:43:26.594595+0000","last_became_active":"2023-11-04T01:43:26.592221+0000","last_became_peered":"2023-11-04T01:43:26.592221+0000","last_unstale":"2023-11-04T01:43:26.594595+0000","last_undegraded":"2023-11-04T01:43:26.594595+0000","last_fullsized":"2023-11-04T01:43:26.594595+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:51:11.862184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.596264+0000","last_change":"2023-11-04T01:43:25.936829+0000","last_active":"2023-11-04T01:43:26.596264+0000","last_peered":"2023-11-04T01:43:26.596264+0000","last_clean":"2023-11-04T01:43:26.596264+0000","last_became_active":"2023-11-04T01:43:25.936006+0000","last_became_peered":"2023-11-04T01:43:25.936006+0000","last_unstale":"2023-11-04T01:43:26.596264+0000","last_undegraded":"2023-11-04T01:43:26.596264+0000","last_fullsized":"2023-11-04T01:43:26.596264+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:35:07.455271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.929245+0000","last_change":"2023-11-04T01:42:35.352519+0000","last_active":"2023-11-04T01:43:25.929245+0000","last_peered":"2023-11-04T01:43:25.929245+0000","last_clean":"2023-11-04T01:43:25.929245+0000","last_became_active":"2023-11-04T01:42:35.352163+0000","last_became_peered":"2023-11-04T01:42:35.352163+0000","last_unstale":"2023-11-04T01:43:25.929245+0000","last_undegraded":"2023-11-04T01:43:25.929245+0000","last_fullsized":"2023-11-04T01:43:25.929245+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:05:52.477616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":43,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.929821+0000","last_change":"2023-11-04T01:42:36.342140+0000","last_active":"2023-11-04T01:43:25.929821+0000","last_peered":"2023-11-04T01:43:25.929821+0000","last_clean":"2023-11-04T01:43:25.929821+0000","last_became_active":"2023-11-04T01:42:34.354685+0000","last_became_peered":"2023-11-04T01:42:34.354685+0000","last_unstale":"2023-11-04T01:43:25.929821+0000","last_undegraded":"2023-11-04T01:43:25.929821+0000","last_fullsized":"2023-11-04T01:43:25.929821+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:54:50.302775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050039500000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":60,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.924995+0000","last_change":"2023-11-04T01:41:36.344271+0000","last_active":"2023-11-04T01:43:25.924995+0000","last_peered":"2023-11-04T01:43:25.924995+0000","last_clean":"2023-11-04T01:43:25.924995+0000","last_became_active":"2023-11-04T01:41:34.732524+0000","last_became_peered":"2023-11-04T01:41:34.732524+0000","last_unstale":"2023-11-04T01:43:25.924995+0000","last_undegraded":"2023-11-04T01:43:25.924995+0000","last_fullsized":"2023-11-04T01:43:25.924995+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:19.350812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081160599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":241,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.928425+0000","last_change":"2023-11-04T01:39:54.204460+0000","last_active":"2023-11-04T01:43:25.928425+0000","last_peered":"2023-11-04T01:43:25.928425+0000","last_clean":"2023-11-04T01:43:25.928425+0000","last_became_active":"2023-11-04T01:39:54.203352+0000","last_became_peered":"2023-11-04T01:39:54.203352+0000","last_unstale":"2023-11-04T01:43:25.928425+0000","last_undegraded":"2023-11-04T01:43:25.928425+0000","last_fullsized":"2023-11-04T01:43:25.928425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:52.627032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:52.627032+0000","last_clean_scrub_stamp":"2023-11-04T01:39:52.627032+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:17:18.474768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28176,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343664,"statfs":{"total":96636764160,"available":96607911936,"internally_reserved":0,"allocated":1179648,"data_stored":579503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.52700000000000002,"15min":0.53500000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.65100000000000002,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.50600000000000001,"15min":0.499},"min":{"1min":0.376,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71499999999999997,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.51300000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54400000000000004,"15min":0.54700000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69899999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.37},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55500000000000005,"15min":0.55300000000000005},"min":{"1min":0.41099999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.73299999999999998,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.60199999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56699999999999995,"15min":0.57399999999999995},"min":{"1min":0.39400000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71499999999999997,"5min":1.177,"15min":1.177},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.54200000000000004,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66300000000000003,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.48499999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.44600000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.73399999999999999,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.625,"15min":0.63400000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77300000000000002,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.54800000000000004}]},{"osd":4,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.52400000000000002,"15min":0.52600000000000002},"min":{"1min":0.30599999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68000000000000005,"5min":1.048,"15min":1.048},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.54600000000000004,"15min":0.53200000000000003},"min":{"1min":0.33000000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.622}]},{"osd":6,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.52900000000000003,"15min":0.51500000000000001},"min":{"1min":0.36899999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56499999999999995,"15min":0.56899999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.56699999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57699999999999996,"15min":0.56100000000000005},"min":{"1min":0.34200000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.626,"15min":0.624},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.66400000000000003}]}]},{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32892,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338948,"statfs":{"total":96636764160,"available":96603082752,"internally_reserved":0,"allocated":1753088,"data_stored":1161081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53700000000000003,"15min":0.51800000000000002},"min":{"1min":0.38500000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70399999999999996,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.41899999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.70699999999999996,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.61899999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60299999999999998,"15min":0.60999999999999999},"min":{"1min":0.45300000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73099999999999998,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.628,"15min":0.61399999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.75,"5min":2.5049999999999999,"15min":2.5049999999999999},"last":0.80900000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59299999999999997,"15min":0.58499999999999996},"min":{"1min":0.45300000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.70099999999999996,"5min":1.708,"15min":1.708},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.627,"15min":0.60599999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77500000000000002,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.78500000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58599999999999997,"15min":0.56499999999999995},"min":{"1min":0.38300000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.67700000000000005,"5min":3.2349999999999999,"15min":3.2349999999999999},"last":0.755},{"interface":"front","average":{"1min":0.627,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82599999999999996,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.68799999999999994}]},{"osd":4,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.50900000000000001,"15min":0.48899999999999999},"min":{"1min":0.35999999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.81100000000000005,"5min":1.454,"15min":1.454},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.496,"15min":0.47499999999999998},"min":{"1min":0.34899999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.58499999999999996}]},{"osd":5,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.54300000000000004,"15min":0.50900000000000001},"min":{"1min":0.39700000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.89400000000000002,"5min":1.629,"15min":1.629},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56499999999999995,"15min":0.53500000000000003},"min":{"1min":0.433,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.84399999999999997,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.77100000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63300000000000001,"15min":0.59199999999999997},"min":{"1min":0.41599999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.91500000000000004,"5min":3.7850000000000001,"15min":3.7850000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.58799999999999997,"15min":0.56000000000000005},"min":{"1min":0.41899999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.77200000000000002,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.64000000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28152,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343688,"statfs":{"total":96636764160,"available":96607936512,"internally_reserved":0,"allocated":1159168,"data_stored":570713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.32500000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.67400000000000004,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53200000000000003,"15min":0.53100000000000003},"min":{"1min":0.33100000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75,"5min":0.752,"15min":0.752},"last":0.76400000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.55000000000000004,"15min":0.56200000000000006},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68899999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54500000000000004,"15min":0.55000000000000004},"min":{"1min":0.39500000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.66100000000000003,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.69799999999999995}]},{"osd":2,"last update":"Sat Nov 4 01:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53600000000000003,"15min":0.54000000000000004},"min":{"1min":0.35999999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.68400000000000005,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.63},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.56000000000000005,"15min":0.57399999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.66800000000000004,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.78100000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.72199999999999998,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.41299999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.75900000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.80000000000000004}]},{"osd":4,"last update":"Sat Nov 4 01:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52500000000000002,"15min":0.52000000000000002},"min":{"1min":0.36499999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56200000000000006,"15min":0.57399999999999995},"min":{"1min":0.36699999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73799999999999999,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.53700000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.53900000000000003,"15min":0.56100000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.70599999999999996,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81699999999999995,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.56399999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57599999999999996,"15min":0.57199999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80000000000000004,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.60399999999999998,"15min":0.61699999999999999},"min":{"1min":0.41899999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.74099999999999999,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.61199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1159168,"data_stored":570713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.51300000000000001,"15min":0.505},"min":{"1min":0.33500000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79400000000000004,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.52100000000000002,"15min":0.51100000000000001},"min":{"1min":0.32200000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.84799999999999998,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.48799999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.502,"15min":0.48599999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.81799999999999995,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.61899999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.40799999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.53900000000000003,"15min":0.53700000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.86799999999999999,"5min":0.873,"15min":0.873},"last":0.68100000000000005}]},{"osd":3,"last update":"Sat Nov 4 01:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53900000000000003,"15min":0.53600000000000003},"min":{"1min":0.42999999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.435},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56699999999999995,"15min":0.56599999999999995},"min":{"1min":0.41499999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.75900000000000001,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.66000000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47499999999999998,"15min":0.48099999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.502,"15min":0.50800000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.55000000000000004}]},{"osd":6,"last update":"Sat Nov 4 01:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49199999999999999,"15min":0.497},"min":{"1min":0.34699999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.69299999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53400000000000003,"15min":0.53700000000000003},"min":{"1min":0.33500000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.46400000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54400000000000004,"15min":0.54700000000000004},"min":{"1min":0.36799999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.441,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.83399999999999996,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.69599999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28152,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343688,"statfs":{"total":96636764160,"available":96607936512,"internally_reserved":0,"allocated":1159168,"data_stored":570713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.314,"15min":0.316},"min":{"1min":0.19800000000000001,"5min":0.186,"15min":0.186},"max":{"1min":0.5,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.33300000000000002,"15min":0.32400000000000001},"min":{"1min":0.28199999999999997,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.45000000000000001,"5min":1.117,"15min":1.117},"last":0.38100000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.36099999999999999,"15min":0.37},"min":{"1min":0.23499999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.55400000000000005,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.40400000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.27400000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.495,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.40799999999999997,"15min":0.42199999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52700000000000002,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.439}]},{"osd":4,"last update":"Sat Nov 4 01:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57199999999999995,"15min":0.58399999999999996},"min":{"1min":0.39500000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73499999999999999,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57599999999999996,"15min":0.58599999999999997},"min":{"1min":0.434,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.52900000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.57099999999999995,"15min":0.58899999999999997},"min":{"1min":0.40799999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71299999999999997,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.57899999999999996,"15min":0.59099999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77900000000000003,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.58299999999999996}]},{"osd":6,"last update":"Sat Nov 4 01:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.41799999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79500000000000004,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.59899999999999998,"15min":0.61299999999999999},"min":{"1min":0.44,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89900000000000002,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.59599999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.61199999999999999,"15min":0.623},"min":{"1min":0.41999999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88200000000000001,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.57399999999999995,"15min":0.58499999999999996},"min":{"1min":0.42399999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73699999999999999,"5min":0.87,"15min":0.87},"last":0.63200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1146880,"data_stored":563027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32000000000000001,"15min":0.32200000000000001},"min":{"1min":0.23699999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.317,"5min":0.34000000000000002,"15min":0.34399999999999997},"min":{"1min":0.224,"5min":0.221,"15min":0.221},"max":{"1min":0.39700000000000002,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.27300000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.35999999999999999,"15min":0.36799999999999999},"min":{"1min":0.26900000000000002,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.41499999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.36199999999999999,"15min":0.374},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.42199999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.372}]},{"osd":3,"last update":"Sat Nov 4 01:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.34200000000000003,"15min":0.35199999999999998},"min":{"1min":0.255,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.41099999999999998,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.40100000000000002,"15min":0.40699999999999997},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.47699999999999998,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.307}]},{"osd":4,"last update":"Sat Nov 4 01:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56100000000000005,"15min":0.54900000000000004},"min":{"1min":0.40100000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.86099999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.63},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.434,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.746,"5min":1.224,"15min":1.224},"last":0.65000000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57499999999999996,"15min":0.56699999999999995},"min":{"1min":0.44600000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81899999999999995,"5min":1.196,"15min":1.196},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.754,"5min":1.25,"15min":1.25},"last":0.69599999999999995}]},{"osd":6,"last update":"Sat Nov 4 01:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.42499999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.73899999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56200000000000006,"15min":0.55500000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.68000000000000005}]},{"osd":7,"last update":"Sat Nov 4 01:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59299999999999997,"15min":0.59699999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.82799999999999996,"5min":1.268,"15min":1.268},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.41499999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.71099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28176,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343664,"statfs":{"total":96636764160,"available":96607911936,"internally_reserved":0,"allocated":1179648,"data_stored":579023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.30099999999999999,"15min":0.30599999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.31,"15min":0.314},"min":{"1min":0.245,"5min":0.218,"15min":0.218},"max":{"1min":0.46899999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.28000000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32500000000000001,"15min":0.33100000000000002},"min":{"1min":0.23100000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.36599999999999999,"15min":0.376},"min":{"1min":0.28399999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.50900000000000001,"5min":0.621,"15min":0.621},"last":0.32900000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.36499999999999999,"15min":0.373},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.53400000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.317},{"interface":"front","average":{"1min":0.376,"5min":0.39500000000000002,"15min":0.40500000000000003},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.35999999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56899999999999995,"15min":0.58699999999999997},"min":{"1min":0.45100000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69499999999999995,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.42199999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72899999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.51800000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.45200000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81200000000000006,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58599999999999997,"15min":0.60299999999999998},"min":{"1min":0.41799999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.753,"5min":0.87,"15min":0.87},"last":0.495}]},{"osd":6,"last update":"Sat Nov 4 01:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55600000000000005,"15min":0.56399999999999995},"min":{"1min":0.40999999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.752,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59099999999999997,"15min":0.60999999999999999},"min":{"1min":0.436,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72799999999999998,"5min":1.129,"15min":1.129},"last":0.57599999999999996}]},{"osd":7,"last update":"Sat Nov 4 01:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.61699999999999999,"15min":0.63300000000000001},"min":{"1min":0.46700000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.72399999999999998,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61499999999999999,"15min":0.629},"min":{"1min":0.40200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76300000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.60199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32892,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338948,"statfs":{"total":96636764160,"available":96603082752,"internally_reserved":0,"allocated":1748992,"data_stored":1160062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:42:53 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.32600000000000001,"15min":0.33200000000000002},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.53200000000000003,"5min":0.874,"15min":0.874},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.374,"15min":0.38800000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.502,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.52900000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:42:53 2023","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.34899999999999998,"15min":0.373},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.38100000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.35499999999999998,"15min":0.372},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.41699999999999998,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.57499999999999996}]},{"osd":3,"last update":"Sat Nov 4 01:42:53 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.34699999999999998,"15min":0.35699999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.46600000000000003,"5min":1.278,"15min":1.278},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.42099999999999999,"15min":0.437},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.52100000000000002,"5min":1.304,"15min":1.304},"last":0.58999999999999997}]},{"osd":4,"last update":"Sat Nov 4 01:42:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.58199999999999996,"15min":0.58699999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76800000000000002,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.622,"15min":0.625},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.82399999999999995,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.85299999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:42:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38400000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73299999999999998,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.58599999999999997,"15min":0.60099999999999998},"min":{"1min":0.373,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.71399999999999997,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.79600000000000004}]},{"osd":6,"last update":"Sat Nov 4 01:42:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.1319999999999999,"5min":1.248,"15min":1.248},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.61499999999999999,"15min":0.626},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73699999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.72399999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:42:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.57899999999999996,"15min":0.58799999999999997},"min":{"1min":0.38300000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78300000000000003,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.872},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.61399999999999999,"15min":0.62},"min":{"1min":0.41199999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.74299999999999999,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.88600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:43:29.908 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:43:30.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.036+0000 7f0c26c0e640 1 Processor -- start 2023-11-04T01:43:30.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.036+0000 7f0c26c0e640 1 -- start start 2023-11-04T01:43:30.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.037+0000 7f0c26c0e640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f0c200b42c0 0x7f0c200c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.037+0000 7f0c26c0e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c200ca050 con 0x7f0c2015ad80 2023-11-04T01:43:30.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.037+0000 7f0c26c0e640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c2006cfa0 con 0x7f0c200c9c40 2023-11-04T01:43:30.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.037+0000 7f0c26c0e640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c2006d280 con 0x7f0c200b42c0 2023-11-04T01:43:30.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.037+0000 7f0c249aa640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f0c2015ad80 0x7f0c2006c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:54222/0 (socket says 172.21.15.77:54222) 2023-11-04T01:43:30.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.037+0000 7f0c249aa640 1 -- 172.21.15.77:0/1232972632 learned_addr learned my addr 172.21.15.77:0/1232972632 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:30.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.037+0000 7f0c1ffff640 1 --2- 172.21.15.77:0/1232972632 >> v2:172.21.15.122:3300/0 conn(0x7f0c200b42c0 0x7f0c200c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.037+0000 7f0c1f7fe640 1 -- 172.21.15.77:0/1232972632 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1134262055 0 0) 0x7f0c200ca050 con 0x7f0c2015ad80 2023-11-04T01:43:30.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.037+0000 7f0c1f7fe640 1 -- 172.21.15.77:0/1232972632 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c10003520 con 0x7f0c2015ad80 2023-11-04T01:43:30.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.037+0000 7f0c1f7fe640 1 -- 172.21.15.77:0/1232972632 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 115871073 0 0) 0x7f0c10003520 con 0x7f0c2015ad80 2023-11-04T01:43:30.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.037+0000 7f0c1f7fe640 1 -- 172.21.15.77:0/1232972632 >> v2:172.21.15.122:3300/0 conn(0x7f0c200b42c0 msgr2=0x7f0c200c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:30.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.037+0000 7f0c1f7fe640 1 --2- 172.21.15.77:0/1232972632 >> v2:172.21.15.122:3300/0 conn(0x7f0c200b42c0 0x7f0c200c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.037+0000 7f0c1f7fe640 1 -- 172.21.15.77:0/1232972632 >> v1:172.21.15.122:6789/0 conn(0x7f0c200c9c40 legacy=0x7f0c200b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.037+0000 7f0c1f7fe640 1 -- 172.21.15.77:0/1232972632 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c2006d560 con 0x7f0c2015ad80 2023-11-04T01:43:30.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.037+0000 7f0c1f7fe640 1 -- 172.21.15.77:0/1232972632 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f0c14001670 con 0x7f0c2015ad80 2023-11-04T01:43:30.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.037+0000 7f0c1f7fe640 1 -- 172.21.15.77:0/1232972632 >> v1:172.21.15.77:6789/0 conn(0x7f0c2015ad80 legacy=0x7f0c2006c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.037+0000 7f0c1f7fe640 1 --2- 172.21.15.77:0/1232972632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c10003970 0x7f0c10003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.037+0000 7f0c1f7fe640 1 --2- 172.21.15.77:0/1232972632 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0c100047c0 0x7f0c10004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.037+0000 7f0c1f7fe640 1 --2- 172.21.15.77:0/1232972632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c10005180 0x7f0c1000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.037+0000 7f0c1f7fe640 1 -- 172.21.15.77:0/1232972632 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2006d280 con 0x7f0c10005180 2023-11-04T01:43:30.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.037+0000 7f0c1f7fe640 1 -- 172.21.15.77:0/1232972632 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1000c030 con 0x7f0c10003970 2023-11-04T01:43:30.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.037+0000 7f0c1f7fe640 1 -- 172.21.15.77:0/1232972632 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1000c1f0 con 0x7f0c100047c0 2023-11-04T01:43:30.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.038+0000 7f0c251ab640 1 --2- 172.21.15.77:0/1232972632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c10005180 0x7f0c1000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.038+0000 7f0c249aa640 1 --2- 172.21.15.77:0/1232972632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c10003970 0x7f0c10003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.038+0000 7f0c1ffff640 1 --2- 172.21.15.77:0/1232972632 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0c100047c0 0x7f0c10004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.038+0000 7f0c251ab640 1 -- 172.21.15.77:0/1232972632 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0c100047c0 msgr2=0x7f0c10004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:30.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.038+0000 7f0c251ab640 1 --2- 172.21.15.77:0/1232972632 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0c100047c0 0x7f0c10004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.038+0000 7f0c251ab640 1 -- 172.21.15.77:0/1232972632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c10003970 msgr2=0x7f0c10003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:30.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.038+0000 7f0c251ab640 1 --2- 172.21.15.77:0/1232972632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c10003970 0x7f0c10003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.038+0000 7f0c251ab640 1 -- 172.21.15.77:0/1232972632 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c10003520 con 0x7f0c10005180 2023-11-04T01:43:30.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.038+0000 7f0c251ab640 1 -- 172.21.15.77:0/1232972632 reap_dead start 2023-11-04T01:43:30.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.038+0000 7f0c251ab640 1 --2- 172.21.15.77:0/1232972632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c10005180 0x7f0c1000b980 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f0c18001e50 tx=0x7f0c100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde1decfb8524c36 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:30.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.039+0000 7f0c1f7fe640 1 -- 172.21.15.77:0/1232972632 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c18003b70 con 0x7f0c10005180 2023-11-04T01:43:30.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.039+0000 7f0c1f7fe640 1 -- 172.21.15.77:0/1232972632 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c18003d10 con 0x7f0c10005180 2023-11-04T01:43:30.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.039+0000 7f0c1f7fe640 1 -- 172.21.15.77:0/1232972632 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c18005310 con 0x7f0c10005180 2023-11-04T01:43:30.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.039+0000 7f0c26c0e640 1 -- 172.21.15.77:0/1232972632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c10005180 msgr2=0x7f0c1000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.039+0000 7f0c26c0e640 1 --2- 172.21.15.77:0/1232972632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c10005180 0x7f0c1000b980 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f0c18001e50 tx=0x7f0c100057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.039+0000 7f0c26c0e640 1 -- 172.21.15.77:0/1232972632 shutdown_connections 2023-11-04T01:43:30.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.039+0000 7f0c26c0e640 1 --2- 172.21.15.77:0/1232972632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c10005180 0x7f0c1000b980 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.039+0000 7f0c26c0e640 1 -- 172.21.15.77:0/1232972632 >> 172.21.15.77:0/1232972632 conn(0x7f0c200ce950 msgr2=0x7f0c200ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:30.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.039+0000 7f0c26c0e640 1 -- 172.21.15.77:0/1232972632 shutdown_connections 2023-11-04T01:43:30.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.039+0000 7f0c26c0e640 1 -- 172.21.15.77:0/1232972632 wait complete. 2023-11-04T01:43:30.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.040+0000 7f0c26c0e640 1 Processor -- start 2023-11-04T01:43:30.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.040+0000 7f0c26c0e640 1 -- start start 2023-11-04T01:43:30.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.041+0000 7f0c26c0e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c10005180 0x7f0c2014ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.041+0000 7f0c26c0e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0c2015be90 0x7f0c2015d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.041+0000 7f0c26c0e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c20154970 0x7f0c20152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.041+0000 7f0c26c0e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2014b2d0 con 0x7f0c10005180 2023-11-04T01:43:30.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.041+0000 7f0c26c0e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c20150970 con 0x7f0c20154970 2023-11-04T01:43:30.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.041+0000 7f0c26c0e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c20150c50 con 0x7f0c2015be90 2023-11-04T01:43:30.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.041+0000 7f0c249aa640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c10005180 0x7f0c2014ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.041+0000 7f0c249aa640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c10005180 0x7f0c2014ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35494/0 (socket says 172.21.15.77:35494) 2023-11-04T01:43:30.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.041+0000 7f0c249aa640 1 -- 172.21.15.77:0/3325076913 learned_addr learned my addr 172.21.15.77:0/3325076913 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:30.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.041+0000 7f0c1ffff640 1 --2- 172.21.15.77:0/3325076913 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0c2015be90 0x7f0c2015d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.042+0000 7f0c251ab640 1 --2- 172.21.15.77:0/3325076913 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c20154970 0x7f0c20152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.042+0000 7f0c249aa640 1 -- 172.21.15.77:0/3325076913 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0c2015be90 msgr2=0x7f0c2015d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.042+0000 7f0c249aa640 1 --2- 172.21.15.77:0/3325076913 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0c2015be90 0x7f0c2015d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.042+0000 7f0c249aa640 1 -- 172.21.15.77:0/3325076913 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c20154970 msgr2=0x7f0c20152fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.042+0000 7f0c249aa640 1 --2- 172.21.15.77:0/3325076913 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c20154970 0x7f0c20152fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.042+0000 7f0c249aa640 1 -- 172.21.15.77:0/3325076913 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c20150f30 con 0x7f0c10005180 2023-11-04T01:43:30.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.042+0000 7f0c1ffff640 1 --2- 172.21.15.77:0/3325076913 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0c2015be90 0x7f0c2015d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:30.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.042+0000 7f0c249aa640 1 --2- 172.21.15.77:0/3325076913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c10005180 0x7f0c2014ad90 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f0c140070b0 tx=0x7f0c14007570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:30.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.042+0000 7f0c1d7fa640 1 -- 172.21.15.77:0/3325076913 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1400f9c0 con 0x7f0c10005180 2023-11-04T01:43:30.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.042+0000 7f0c1d7fa640 1 -- 172.21.15.77:0/3325076913 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1400fb20 con 0x7f0c10005180 2023-11-04T01:43:30.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.042+0000 7f0c26c0e640 1 -- 172.21.15.77:0/3325076913 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c20151210 con 0x7f0c10005180 2023-11-04T01:43:30.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.042+0000 7f0c1d7fa640 1 -- 172.21.15.77:0/3325076913 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1400fed0 con 0x7f0c10005180 2023-11-04T01:43:30.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.042+0000 7f0c26c0e640 1 -- 172.21.15.77:0/3325076913 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c2015d900 con 0x7f0c10005180 2023-11-04T01:43:30.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.043+0000 7f0c26c0e640 1 -- 172.21.15.77:0/3325076913 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c20074290 con 0x7f0c10005180 2023-11-04T01:43:30.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.043+0000 7f0c1d7fa640 1 -- 172.21.15.77:0/3325076913 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0c1401d460 con 0x7f0c10005180 2023-11-04T01:43:30.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.044+0000 7f0c1d7fa640 1 --2- 172.21.15.77:0/3325076913 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0c0406aea0 0x7f0c0406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.044+0000 7f0c1d7fa640 1 -- 172.21.15.77:0/3325076913 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f0c14089cf0 con 0x7f0c10005180 2023-11-04T01:43:30.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.044+0000 7f0c1ffff640 1 --2- 172.21.15.77:0/3325076913 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0c0406aea0 0x7f0c0406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.044+0000 7f0c1ffff640 1 --2- 172.21.15.77:0/3325076913 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0c0406aea0 0x7f0c0406d360 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0c20159820 tx=0x7f0c0c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:30.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.048+0000 7f0c1d7fa640 1 -- 172.21.15.77:0/3325076913 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0c1408e070 con 0x7f0c10005180 2023-11-04T01:43:30.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.210+0000 7f0c26c0e640 1 -- 172.21.15.77:0/3325076913 --> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0c20150dc0 con 0x7f0c0406aea0 2023-11-04T01:43:30.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.223+0000 7f0c1d7fa640 1 -- 172.21.15.77:0/3325076913 <== mgr.4123 v2:172.21.15.122:6832/2275325762 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+532189 (secure 0 0 0) 0x7f0c20150dc0 con 0x7f0c0406aea0 2023-11-04T01:43:30.230 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:43:30.234 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-11-04T01:43:30.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.227+0000 7f0c26c0e640 1 -- 172.21.15.77:0/3325076913 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0c0406aea0 msgr2=0x7f0c0406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.227+0000 7f0c26c0e640 1 --2- 172.21.15.77:0/3325076913 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0c0406aea0 0x7f0c0406d360 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0c20159820 tx=0x7f0c0c008040 comp rx=0 tx=0).stop 2023-11-04T01:43:30.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.227+0000 7f0c26c0e640 1 -- 172.21.15.77:0/3325076913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c10005180 msgr2=0x7f0c2014ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.227+0000 7f0c26c0e640 1 --2- 172.21.15.77:0/3325076913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c10005180 0x7f0c2014ad90 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f0c140070b0 tx=0x7f0c14007570 comp rx=0 tx=0).stop 2023-11-04T01:43:30.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.227+0000 7f0c26c0e640 1 -- 172.21.15.77:0/3325076913 shutdown_connections 2023-11-04T01:43:30.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.227+0000 7f0c26c0e640 1 --2- 172.21.15.77:0/3325076913 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0c0406aea0 0x7f0c0406d360 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.227+0000 7f0c26c0e640 1 --2- 172.21.15.77:0/3325076913 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c20154970 0x7f0c20152fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.227+0000 7f0c26c0e640 1 --2- 172.21.15.77:0/3325076913 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0c2015be90 0x7f0c2015d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.227+0000 7f0c26c0e640 1 --2- 172.21.15.77:0/3325076913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c10005180 0x7f0c2014ad90 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.227+0000 7f0c26c0e640 1 -- 172.21.15.77:0/3325076913 >> 172.21.15.77:0/3325076913 conn(0x7f0c200ce950 msgr2=0x7f0c200ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:30.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.227+0000 7f0c26c0e640 1 -- 172.21.15.77:0/3325076913 shutdown_connections 2023-11-04T01:43:30.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.227+0000 7f0c26c0e640 1 -- 172.21.15.77:0/3325076913 wait complete. 2023-11-04T01:43:30.239 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":198,"stamp":"2023-11-04T01:43:29.680077+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":167,"num_write_kb":2424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":243,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238892,"kb_used_data":10240,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754735828,"statfs":{"total":773094113280,"available":772849487872,"internally_reserved":0,"allocated":10485760,"data_stored":5754835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":234016306},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.759573"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.607852+0000","last_change":"2023-11-04T01:43:26.604301+0000","last_active":"2023-11-04T01:43:26.607852+0000","last_peered":"2023-11-04T01:43:26.607852+0000","last_clean":"2023-11-04T01:43:26.607852+0000","last_became_active":"2023-11-04T01:43:26.604074+0000","last_became_peered":"2023-11-04T01:43:26.604074+0000","last_unstale":"2023-11-04T01:43:26.607852+0000","last_undegraded":"2023-11-04T01:43:26.607852+0000","last_fullsized":"2023-11-04T01:43:26.607852+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:22:41.980821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.610986+0000","last_change":"2023-11-04T01:43:26.606506+0000","last_active":"2023-11-04T01:43:26.610986+0000","last_peered":"2023-11-04T01:43:26.610986+0000","last_clean":"2023-11-04T01:43:26.610986+0000","last_became_active":"2023-11-04T01:43:26.606129+0000","last_became_peered":"2023-11-04T01:43:26.606129+0000","last_unstale":"2023-11-04T01:43:26.610986+0000","last_undegraded":"2023-11-04T01:43:26.610986+0000","last_fullsized":"2023-11-04T01:43:26.610986+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:19.148345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.610927+0000","last_change":"2023-11-04T01:43:26.608593+0000","last_active":"2023-11-04T01:43:26.610927+0000","last_peered":"2023-11-04T01:43:26.610927+0000","last_clean":"2023-11-04T01:43:26.610927+0000","last_became_active":"2023-11-04T01:43:26.608281+0000","last_became_peered":"2023-11-04T01:43:26.608281+0000","last_unstale":"2023-11-04T01:43:26.610927+0000","last_undegraded":"2023-11-04T01:43:26.610927+0000","last_fullsized":"2023-11-04T01:43:26.610927+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:28:59.171208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.613450+0000","last_change":"2023-11-04T01:43:26.609526+0000","last_active":"2023-11-04T01:43:26.613450+0000","last_peered":"2023-11-04T01:43:26.613450+0000","last_clean":"2023-11-04T01:43:26.613450+0000","last_became_active":"2023-11-04T01:43:26.609298+0000","last_became_peered":"2023-11-04T01:43:26.609298+0000","last_unstale":"2023-11-04T01:43:26.613450+0000","last_undegraded":"2023-11-04T01:43:26.613450+0000","last_fullsized":"2023-11-04T01:43:26.613450+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:47:23.039232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.602569+0000","last_change":"2023-11-04T01:43:26.600421+0000","last_active":"2023-11-04T01:43:26.602569+0000","last_peered":"2023-11-04T01:43:26.602569+0000","last_clean":"2023-11-04T01:43:26.602569+0000","last_became_active":"2023-11-04T01:43:26.600121+0000","last_became_peered":"2023-11-04T01:43:26.600121+0000","last_unstale":"2023-11-04T01:43:26.602569+0000","last_undegraded":"2023-11-04T01:43:26.602569+0000","last_fullsized":"2023-11-04T01:43:26.602569+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:29:23.601229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.596446+0000","last_change":"2023-11-04T01:43:26.594076+0000","last_active":"2023-11-04T01:43:26.596446+0000","last_peered":"2023-11-04T01:43:26.596446+0000","last_clean":"2023-11-04T01:43:26.596446+0000","last_became_active":"2023-11-04T01:43:26.593830+0000","last_became_peered":"2023-11-04T01:43:26.593830+0000","last_unstale":"2023-11-04T01:43:26.596446+0000","last_undegraded":"2023-11-04T01:43:26.596446+0000","last_fullsized":"2023-11-04T01:43:26.596446+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:16:08.737803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.610776+0000","last_change":"2023-11-04T01:43:26.606490+0000","last_active":"2023-11-04T01:43:26.610776+0000","last_peered":"2023-11-04T01:43:26.610776+0000","last_clean":"2023-11-04T01:43:26.610776+0000","last_became_active":"2023-11-04T01:43:26.606124+0000","last_became_peered":"2023-11-04T01:43:26.606124+0000","last_unstale":"2023-11-04T01:43:26.610776+0000","last_undegraded":"2023-11-04T01:43:26.610776+0000","last_fullsized":"2023-11-04T01:43:26.610776+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:20:15.141189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.601342+0000","last_change":"2023-11-04T01:43:26.597894+0000","last_active":"2023-11-04T01:43:26.601342+0000","last_peered":"2023-11-04T01:43:26.601342+0000","last_clean":"2023-11-04T01:43:26.601342+0000","last_became_active":"2023-11-04T01:43:26.597570+0000","last_became_peered":"2023-11-04T01:43:26.597570+0000","last_unstale":"2023-11-04T01:43:26.601342+0000","last_undegraded":"2023-11-04T01:43:26.601342+0000","last_fullsized":"2023-11-04T01:43:26.601342+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:36:13.381952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.605118+0000","last_change":"2023-11-04T01:43:26.599951+0000","last_active":"2023-11-04T01:43:26.605118+0000","last_peered":"2023-11-04T01:43:26.605118+0000","last_clean":"2023-11-04T01:43:26.605118+0000","last_became_active":"2023-11-04T01:43:26.599678+0000","last_became_peered":"2023-11-04T01:43:26.599678+0000","last_unstale":"2023-11-04T01:43:26.605118+0000","last_undegraded":"2023-11-04T01:43:26.605118+0000","last_fullsized":"2023-11-04T01:43:26.605118+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:04:45.129806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.605126+0000","last_change":"2023-11-04T01:43:26.598796+0000","last_active":"2023-11-04T01:43:26.605126+0000","last_peered":"2023-11-04T01:43:26.605126+0000","last_clean":"2023-11-04T01:43:26.605126+0000","last_became_active":"2023-11-04T01:43:26.598554+0000","last_became_peered":"2023-11-04T01:43:26.598554+0000","last_unstale":"2023-11-04T01:43:26.605126+0000","last_undegraded":"2023-11-04T01:43:26.605126+0000","last_fullsized":"2023-11-04T01:43:26.605126+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:19:11.544139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.610949+0000","last_change":"2023-11-04T01:43:26.604926+0000","last_active":"2023-11-04T01:43:26.610949+0000","last_peered":"2023-11-04T01:43:26.610949+0000","last_clean":"2023-11-04T01:43:26.610949+0000","last_became_active":"2023-11-04T01:43:26.604591+0000","last_became_peered":"2023-11-04T01:43:26.604591+0000","last_unstale":"2023-11-04T01:43:26.610949+0000","last_undegraded":"2023-11-04T01:43:26.610949+0000","last_fullsized":"2023-11-04T01:43:26.610949+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:53:02.935789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.605091+0000","last_change":"2023-11-04T01:43:26.599393+0000","last_active":"2023-11-04T01:43:26.605091+0000","last_peered":"2023-11-04T01:43:26.605091+0000","last_clean":"2023-11-04T01:43:26.605091+0000","last_became_active":"2023-11-04T01:43:26.599162+0000","last_became_peered":"2023-11-04T01:43:26.599162+0000","last_unstale":"2023-11-04T01:43:26.605091+0000","last_undegraded":"2023-11-04T01:43:26.605091+0000","last_fullsized":"2023-11-04T01:43:26.605091+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:54:24.828861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.601231+0000","last_change":"2023-11-04T01:43:26.592940+0000","last_active":"2023-11-04T01:43:26.601231+0000","last_peered":"2023-11-04T01:43:26.601231+0000","last_clean":"2023-11-04T01:43:26.601231+0000","last_became_active":"2023-11-04T01:43:26.592667+0000","last_became_peered":"2023-11-04T01:43:26.592667+0000","last_unstale":"2023-11-04T01:43:26.601231+0000","last_undegraded":"2023-11-04T01:43:26.601231+0000","last_fullsized":"2023-11-04T01:43:26.601231+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:30:42.051408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.604803+0000","last_change":"2023-11-04T01:43:26.598668+0000","last_active":"2023-11-04T01:43:26.604803+0000","last_peered":"2023-11-04T01:43:26.604803+0000","last_clean":"2023-11-04T01:43:26.604803+0000","last_became_active":"2023-11-04T01:43:26.598340+0000","last_became_peered":"2023-11-04T01:43:26.598340+0000","last_unstale":"2023-11-04T01:43:26.604803+0000","last_undegraded":"2023-11-04T01:43:26.604803+0000","last_fullsized":"2023-11-04T01:43:26.604803+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:47:16.978014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.595767+0000","last_change":"2023-11-04T01:43:26.594244+0000","last_active":"2023-11-04T01:43:26.595767+0000","last_peered":"2023-11-04T01:43:26.595767+0000","last_clean":"2023-11-04T01:43:26.595767+0000","last_became_active":"2023-11-04T01:43:26.594002+0000","last_became_peered":"2023-11-04T01:43:26.594002+0000","last_unstale":"2023-11-04T01:43:26.595767+0000","last_undegraded":"2023-11-04T01:43:26.595767+0000","last_fullsized":"2023-11-04T01:43:26.595767+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:50:00.360016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.605123+0000","last_change":"2023-11-04T01:43:26.599764+0000","last_active":"2023-11-04T01:43:26.605123+0000","last_peered":"2023-11-04T01:43:26.605123+0000","last_clean":"2023-11-04T01:43:26.605123+0000","last_became_active":"2023-11-04T01:43:26.599512+0000","last_became_peered":"2023-11-04T01:43:26.599512+0000","last_unstale":"2023-11-04T01:43:26.605123+0000","last_undegraded":"2023-11-04T01:43:26.605123+0000","last_fullsized":"2023-11-04T01:43:26.605123+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:48:18.665481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.610869+0000","last_change":"2023-11-04T01:43:26.605197+0000","last_active":"2023-11-04T01:43:26.610869+0000","last_peered":"2023-11-04T01:43:26.610869+0000","last_clean":"2023-11-04T01:43:26.610869+0000","last_became_active":"2023-11-04T01:43:26.604921+0000","last_became_peered":"2023-11-04T01:43:26.604921+0000","last_unstale":"2023-11-04T01:43:26.610869+0000","last_undegraded":"2023-11-04T01:43:26.610869+0000","last_fullsized":"2023-11-04T01:43:26.610869+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:43:21.574560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.604309+0000","last_change":"2023-11-04T01:43:26.600640+0000","last_active":"2023-11-04T01:43:26.604309+0000","last_peered":"2023-11-04T01:43:26.604309+0000","last_clean":"2023-11-04T01:43:26.604309+0000","last_became_active":"2023-11-04T01:43:26.600179+0000","last_became_peered":"2023-11-04T01:43:26.600179+0000","last_unstale":"2023-11-04T01:43:26.604309+0000","last_undegraded":"2023-11-04T01:43:26.604309+0000","last_fullsized":"2023-11-04T01:43:26.604309+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:07:01.993689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.606021+0000","last_change":"2023-11-04T01:43:26.601391+0000","last_active":"2023-11-04T01:43:26.606021+0000","last_peered":"2023-11-04T01:43:26.606021+0000","last_clean":"2023-11-04T01:43:26.606021+0000","last_became_active":"2023-11-04T01:43:26.601049+0000","last_became_peered":"2023-11-04T01:43:26.601049+0000","last_unstale":"2023-11-04T01:43:26.606021+0000","last_undegraded":"2023-11-04T01:43:26.606021+0000","last_fullsized":"2023-11-04T01:43:26.606021+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:53:09.582176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.613300+0000","last_change":"2023-11-04T01:43:26.608429+0000","last_active":"2023-11-04T01:43:26.613300+0000","last_peered":"2023-11-04T01:43:26.613300+0000","last_clean":"2023-11-04T01:43:26.613300+0000","last_became_active":"2023-11-04T01:43:26.608125+0000","last_became_peered":"2023-11-04T01:43:26.608125+0000","last_unstale":"2023-11-04T01:43:26.613300+0000","last_undegraded":"2023-11-04T01:43:26.613300+0000","last_fullsized":"2023-11-04T01:43:26.613300+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:43:27.727768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.613397+0000","last_change":"2023-11-04T01:43:26.609223+0000","last_active":"2023-11-04T01:43:26.613397+0000","last_peered":"2023-11-04T01:43:26.613397+0000","last_clean":"2023-11-04T01:43:26.613397+0000","last_became_active":"2023-11-04T01:43:26.608499+0000","last_became_peered":"2023-11-04T01:43:26.608499+0000","last_unstale":"2023-11-04T01:43:26.613397+0000","last_undegraded":"2023-11-04T01:43:26.613397+0000","last_fullsized":"2023-11-04T01:43:26.613397+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:13:56.368948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.600283+0000","last_change":"2023-11-04T01:43:26.598566+0000","last_active":"2023-11-04T01:43:26.600283+0000","last_peered":"2023-11-04T01:43:26.600283+0000","last_clean":"2023-11-04T01:43:26.600283+0000","last_became_active":"2023-11-04T01:43:26.598321+0000","last_became_peered":"2023-11-04T01:43:26.598321+0000","last_unstale":"2023-11-04T01:43:26.600283+0000","last_undegraded":"2023-11-04T01:43:26.600283+0000","last_fullsized":"2023-11-04T01:43:26.600283+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:53:09.582176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.611002+0000","last_change":"2023-11-04T01:43:26.606900+0000","last_active":"2023-11-04T01:43:26.611002+0000","last_peered":"2023-11-04T01:43:26.611002+0000","last_clean":"2023-11-04T01:43:26.611002+0000","last_became_active":"2023-11-04T01:43:26.606627+0000","last_became_peered":"2023-11-04T01:43:26.606627+0000","last_unstale":"2023-11-04T01:43:26.611002+0000","last_undegraded":"2023-11-04T01:43:26.611002+0000","last_fullsized":"2023-11-04T01:43:26.611002+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:51:07.723865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.595484+0000","last_change":"2023-11-04T01:43:26.593458+0000","last_active":"2023-11-04T01:43:26.595484+0000","last_peered":"2023-11-04T01:43:26.595484+0000","last_clean":"2023-11-04T01:43:26.595484+0000","last_became_active":"2023-11-04T01:43:26.591632+0000","last_became_peered":"2023-11-04T01:43:26.591632+0000","last_unstale":"2023-11-04T01:43:26.595484+0000","last_undegraded":"2023-11-04T01:43:26.595484+0000","last_fullsized":"2023-11-04T01:43:26.595484+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:36:13.381952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.610984+0000","last_change":"2023-11-04T01:43:26.606295+0000","last_active":"2023-11-04T01:43:26.610984+0000","last_peered":"2023-11-04T01:43:26.610984+0000","last_clean":"2023-11-04T01:43:26.610984+0000","last_became_active":"2023-11-04T01:43:26.605828+0000","last_became_peered":"2023-11-04T01:43:26.605828+0000","last_unstale":"2023-11-04T01:43:26.610984+0000","last_undegraded":"2023-11-04T01:43:26.610984+0000","last_fullsized":"2023-11-04T01:43:26.610984+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:40:57.517134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.607792+0000","last_change":"2023-11-04T01:43:26.603851+0000","last_active":"2023-11-04T01:43:26.607792+0000","last_peered":"2023-11-04T01:43:26.607792+0000","last_clean":"2023-11-04T01:43:26.607792+0000","last_became_active":"2023-11-04T01:43:26.603588+0000","last_became_peered":"2023-11-04T01:43:26.603588+0000","last_unstale":"2023-11-04T01:43:26.607792+0000","last_undegraded":"2023-11-04T01:43:26.607792+0000","last_fullsized":"2023-11-04T01:43:26.607792+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:27:45.574281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.603355+0000","last_change":"2023-11-04T01:43:26.601574+0000","last_active":"2023-11-04T01:43:26.603355+0000","last_peered":"2023-11-04T01:43:26.603355+0000","last_clean":"2023-11-04T01:43:26.603355+0000","last_became_active":"2023-11-04T01:43:26.601332+0000","last_became_peered":"2023-11-04T01:43:26.601332+0000","last_unstale":"2023-11-04T01:43:26.603355+0000","last_undegraded":"2023-11-04T01:43:26.603355+0000","last_fullsized":"2023-11-04T01:43:26.603355+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:36:52.503545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.601949+0000","last_change":"2023-11-04T01:43:26.600443+0000","last_active":"2023-11-04T01:43:26.601949+0000","last_peered":"2023-11-04T01:43:26.601949+0000","last_clean":"2023-11-04T01:43:26.601949+0000","last_became_active":"2023-11-04T01:43:26.600172+0000","last_became_peered":"2023-11-04T01:43:26.600172+0000","last_unstale":"2023-11-04T01:43:26.601949+0000","last_undegraded":"2023-11-04T01:43:26.601949+0000","last_fullsized":"2023-11-04T01:43:26.601949+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:08:06.977842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.613415+0000","last_change":"2023-11-04T01:43:26.609355+0000","last_active":"2023-11-04T01:43:26.613415+0000","last_peered":"2023-11-04T01:43:26.613415+0000","last_clean":"2023-11-04T01:43:26.613415+0000","last_became_active":"2023-11-04T01:43:26.608207+0000","last_became_peered":"2023-11-04T01:43:26.608207+0000","last_unstale":"2023-11-04T01:43:26.613415+0000","last_undegraded":"2023-11-04T01:43:26.613415+0000","last_fullsized":"2023-11-04T01:43:26.613415+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:24:07.610803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.605342+0000","last_change":"2023-11-04T01:43:26.602514+0000","last_active":"2023-11-04T01:43:26.605342+0000","last_peered":"2023-11-04T01:43:26.605342+0000","last_clean":"2023-11-04T01:43:26.605342+0000","last_became_active":"2023-11-04T01:43:26.602074+0000","last_became_peered":"2023-11-04T01:43:26.602074+0000","last_unstale":"2023-11-04T01:43:26.605342+0000","last_undegraded":"2023-11-04T01:43:26.605342+0000","last_fullsized":"2023-11-04T01:43:26.605342+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:27:35.787906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.607814+0000","last_change":"2023-11-04T01:43:26.603947+0000","last_active":"2023-11-04T01:43:26.607814+0000","last_peered":"2023-11-04T01:43:26.607814+0000","last_clean":"2023-11-04T01:43:26.607814+0000","last_became_active":"2023-11-04T01:43:26.603691+0000","last_became_peered":"2023-11-04T01:43:26.603691+0000","last_unstale":"2023-11-04T01:43:26.607814+0000","last_undegraded":"2023-11-04T01:43:26.607814+0000","last_fullsized":"2023-11-04T01:43:26.607814+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:13:39.232237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.595879+0000","last_change":"2023-11-04T01:43:26.594696+0000","last_active":"2023-11-04T01:43:26.595879+0000","last_peered":"2023-11-04T01:43:26.595879+0000","last_clean":"2023-11-04T01:43:26.595879+0000","last_became_active":"2023-11-04T01:43:26.594463+0000","last_became_peered":"2023-11-04T01:43:26.594463+0000","last_unstale":"2023-11-04T01:43:26.595879+0000","last_undegraded":"2023-11-04T01:43:26.595879+0000","last_fullsized":"2023-11-04T01:43:26.595879+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:26:29.719187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.605180+0000","last_change":"2023-11-04T01:43:26.602138+0000","last_active":"2023-11-04T01:43:26.605180+0000","last_peered":"2023-11-04T01:43:26.605180+0000","last_clean":"2023-11-04T01:43:26.605180+0000","last_became_active":"2023-11-04T01:43:26.601805+0000","last_became_peered":"2023-11-04T01:43:26.601805+0000","last_unstale":"2023-11-04T01:43:26.605180+0000","last_undegraded":"2023-11-04T01:43:26.605180+0000","last_fullsized":"2023-11-04T01:43:26.605180+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:00:57.835782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.589374+0000","last_change":"2023-11-04T01:43:25.946949+0000","last_active":"2023-11-04T01:43:26.589374+0000","last_peered":"2023-11-04T01:43:26.589374+0000","last_clean":"2023-11-04T01:43:26.589374+0000","last_became_active":"2023-11-04T01:43:25.946280+0000","last_became_peered":"2023-11-04T01:43:25.946280+0000","last_unstale":"2023-11-04T01:43:26.589374+0000","last_undegraded":"2023-11-04T01:43:26.589374+0000","last_fullsized":"2023-11-04T01:43:26.589374+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:13:33.494758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.928817+0000","last_change":"2023-11-04T01:42:35.354740+0000","last_active":"2023-11-04T01:43:25.928817+0000","last_peered":"2023-11-04T01:43:25.928817+0000","last_clean":"2023-11-04T01:43:25.928817+0000","last_became_active":"2023-11-04T01:42:35.354383+0000","last_became_peered":"2023-11-04T01:42:35.354383+0000","last_unstale":"2023-11-04T01:43:25.928817+0000","last_undegraded":"2023-11-04T01:43:25.928817+0000","last_fullsized":"2023-11-04T01:43:25.928817+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:38.574240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.930435+0000","last_change":"2023-11-04T01:42:36.412560+0000","last_active":"2023-11-04T01:43:25.930435+0000","last_peered":"2023-11-04T01:43:25.930435+0000","last_clean":"2023-11-04T01:43:25.930435+0000","last_became_active":"2023-11-04T01:42:34.346736+0000","last_became_peered":"2023-11-04T01:42:34.346736+0000","last_unstale":"2023-11-04T01:43:25.930435+0000","last_undegraded":"2023-11-04T01:43:25.930435+0000","last_fullsized":"2023-11-04T01:43:25.930435+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:37.572320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071730100000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":60,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.935834+0000","last_change":"2023-11-04T01:41:36.067943+0000","last_active":"2023-11-04T01:43:25.935834+0000","last_peered":"2023-11-04T01:43:25.935834+0000","last_clean":"2023-11-04T01:43:25.935834+0000","last_became_active":"2023-11-04T01:41:34.734305+0000","last_became_peered":"2023-11-04T01:41:34.734305+0000","last_unstale":"2023-11-04T01:43:25.935834+0000","last_undegraded":"2023-11-04T01:43:25.935834+0000","last_fullsized":"2023-11-04T01:43:25.935834+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:48.121273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033780399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.613238+0000","last_change":"2023-11-04T01:43:26.609127+0000","last_active":"2023-11-04T01:43:26.613238+0000","last_peered":"2023-11-04T01:43:26.613238+0000","last_clean":"2023-11-04T01:43:26.613238+0000","last_became_active":"2023-11-04T01:43:26.608820+0000","last_became_peered":"2023-11-04T01:43:26.608820+0000","last_unstale":"2023-11-04T01:43:26.613238+0000","last_undegraded":"2023-11-04T01:43:26.613238+0000","last_fullsized":"2023-11-04T01:43:26.613238+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:11.756513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.956265+0000","last_change":"2023-11-04T01:43:25.945229+0000","last_active":"2023-11-04T01:43:26.956265+0000","last_peered":"2023-11-04T01:43:26.956265+0000","last_clean":"2023-11-04T01:43:26.956265+0000","last_became_active":"2023-11-04T01:43:25.944691+0000","last_became_peered":"2023-11-04T01:43:25.944691+0000","last_unstale":"2023-11-04T01:43:26.956265+0000","last_undegraded":"2023-11-04T01:43:26.956265+0000","last_fullsized":"2023-11-04T01:43:26.956265+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:52:59.910292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.935159+0000","last_change":"2023-11-04T01:42:35.342778+0000","last_active":"2023-11-04T01:43:25.935159+0000","last_peered":"2023-11-04T01:43:25.935159+0000","last_clean":"2023-11-04T01:43:25.935159+0000","last_became_active":"2023-11-04T01:42:35.342368+0000","last_became_peered":"2023-11-04T01:42:35.342368+0000","last_unstale":"2023-11-04T01:43:25.935159+0000","last_undegraded":"2023-11-04T01:43:25.935159+0000","last_fullsized":"2023-11-04T01:43:25.935159+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:42.907508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.931403+0000","last_change":"2023-11-04T01:42:36.413379+0000","last_active":"2023-11-04T01:43:25.931403+0000","last_peered":"2023-11-04T01:43:25.931403+0000","last_clean":"2023-11-04T01:43:25.931403+0000","last_became_active":"2023-11-04T01:42:34.354671+0000","last_became_peered":"2023-11-04T01:42:34.354671+0000","last_unstale":"2023-11-04T01:43:25.931403+0000","last_undegraded":"2023-11-04T01:43:25.931403+0000","last_fullsized":"2023-11-04T01:43:25.931403+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:36:10.769073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071203900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.927767+0000","last_change":"2023-11-04T01:41:35.728832+0000","last_active":"2023-11-04T01:43:25.927767+0000","last_peered":"2023-11-04T01:43:25.927767+0000","last_clean":"2023-11-04T01:43:25.927767+0000","last_became_active":"2023-11-04T01:41:34.733517+0000","last_became_peered":"2023-11-04T01:41:34.733517+0000","last_unstale":"2023-11-04T01:43:25.927767+0000","last_undegraded":"2023-11-04T01:43:25.927767+0000","last_fullsized":"2023-11-04T01:43:25.927767+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:19.350812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042545700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.600838+0000","last_change":"2023-11-04T01:43:26.599777+0000","last_active":"2023-11-04T01:43:26.600838+0000","last_peered":"2023-11-04T01:43:26.600838+0000","last_clean":"2023-11-04T01:43:26.600838+0000","last_became_active":"2023-11-04T01:43:26.599469+0000","last_became_peered":"2023-11-04T01:43:26.599469+0000","last_unstale":"2023-11-04T01:43:26.600838+0000","last_undegraded":"2023-11-04T01:43:26.600838+0000","last_fullsized":"2023-11-04T01:43:26.600838+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:57:32.261474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.597477+0000","last_change":"2023-11-04T01:43:25.937057+0000","last_active":"2023-11-04T01:43:26.597477+0000","last_peered":"2023-11-04T01:43:26.597477+0000","last_clean":"2023-11-04T01:43:26.597477+0000","last_became_active":"2023-11-04T01:43:25.936776+0000","last_became_peered":"2023-11-04T01:43:25.936776+0000","last_unstale":"2023-11-04T01:43:26.597477+0000","last_undegraded":"2023-11-04T01:43:26.597477+0000","last_fullsized":"2023-11-04T01:43:26.597477+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:15:47.030512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.930909+0000","last_change":"2023-11-04T01:42:35.348988+0000","last_active":"2023-11-04T01:43:25.930909+0000","last_peered":"2023-11-04T01:43:25.930909+0000","last_clean":"2023-11-04T01:43:25.930909+0000","last_became_active":"2023-11-04T01:42:35.348666+0000","last_became_peered":"2023-11-04T01:42:35.348666+0000","last_unstale":"2023-11-04T01:43:25.930909+0000","last_undegraded":"2023-11-04T01:43:25.930909+0000","last_fullsized":"2023-11-04T01:43:25.930909+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:08:28.888035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.927582+0000","last_change":"2023-11-04T01:42:36.408544+0000","last_active":"2023-11-04T01:43:25.927582+0000","last_peered":"2023-11-04T01:43:25.927582+0000","last_clean":"2023-11-04T01:43:25.927582+0000","last_became_active":"2023-11-04T01:42:34.350627+0000","last_became_peered":"2023-11-04T01:42:34.350627+0000","last_unstale":"2023-11-04T01:43:25.927582+0000","last_undegraded":"2023-11-04T01:43:25.927582+0000","last_fullsized":"2023-11-04T01:43:25.927582+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:22:16.530179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059637199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":58,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.931795+0000","last_change":"2023-11-04T01:41:35.906660+0000","last_active":"2023-11-04T01:43:25.931795+0000","last_peered":"2023-11-04T01:43:25.931795+0000","last_clean":"2023-11-04T01:43:25.931795+0000","last_became_active":"2023-11-04T01:41:34.737209+0000","last_became_peered":"2023-11-04T01:41:34.737209+0000","last_unstale":"2023-11-04T01:43:25.931795+0000","last_undegraded":"2023-11-04T01:43:25.931795+0000","last_fullsized":"2023-11-04T01:43:25.931795+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:59.608410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068889500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.606074+0000","last_change":"2023-11-04T01:43:26.602609+0000","last_active":"2023-11-04T01:43:26.606074+0000","last_peered":"2023-11-04T01:43:26.606074+0000","last_clean":"2023-11-04T01:43:26.606074+0000","last_became_active":"2023-11-04T01:43:26.601957+0000","last_became_peered":"2023-11-04T01:43:26.601957+0000","last_unstale":"2023-11-04T01:43:26.606074+0000","last_undegraded":"2023-11-04T01:43:26.606074+0000","last_fullsized":"2023-11-04T01:43:26.606074+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:30:46.749090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.588130+0000","last_change":"2023-11-04T01:43:25.945070+0000","last_active":"2023-11-04T01:43:26.588130+0000","last_peered":"2023-11-04T01:43:26.588130+0000","last_clean":"2023-11-04T01:43:26.588130+0000","last_became_active":"2023-11-04T01:43:25.944799+0000","last_became_peered":"2023-11-04T01:43:25.944799+0000","last_unstale":"2023-11-04T01:43:26.588130+0000","last_undegraded":"2023-11-04T01:43:26.588130+0000","last_fullsized":"2023-11-04T01:43:26.588130+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:27:34.786211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.924972+0000","last_change":"2023-11-04T01:42:35.355495+0000","last_active":"2023-11-04T01:43:25.924972+0000","last_peered":"2023-11-04T01:43:25.924972+0000","last_clean":"2023-11-04T01:43:25.924972+0000","last_became_active":"2023-11-04T01:42:35.355032+0000","last_became_peered":"2023-11-04T01:42:35.355032+0000","last_unstale":"2023-11-04T01:43:25.924972+0000","last_undegraded":"2023-11-04T01:43:25.924972+0000","last_fullsized":"2023-11-04T01:43:25.924972+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:48.181161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.931860+0000","last_change":"2023-11-04T01:42:36.413121+0000","last_active":"2023-11-04T01:43:25.931860+0000","last_peered":"2023-11-04T01:43:25.931860+0000","last_clean":"2023-11-04T01:43:25.931860+0000","last_became_active":"2023-11-04T01:42:34.348018+0000","last_became_peered":"2023-11-04T01:42:34.348018+0000","last_unstale":"2023-11-04T01:43:25.931860+0000","last_undegraded":"2023-11-04T01:43:25.931860+0000","last_fullsized":"2023-11-04T01:43:25.931860+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:01:38.616017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088815699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":60,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.929671+0000","last_change":"2023-11-04T01:41:36.067946+0000","last_active":"2023-11-04T01:43:25.929671+0000","last_peered":"2023-11-04T01:43:25.929671+0000","last_clean":"2023-11-04T01:43:25.929671+0000","last_became_active":"2023-11-04T01:41:34.729591+0000","last_became_peered":"2023-11-04T01:41:34.729591+0000","last_unstale":"2023-11-04T01:43:25.929671+0000","last_undegraded":"2023-11-04T01:43:25.929671+0000","last_fullsized":"2023-11-04T01:43:25.929671+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:59.608410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032681099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.603369+0000","last_change":"2023-11-04T01:43:26.598862+0000","last_active":"2023-11-04T01:43:26.603369+0000","last_peered":"2023-11-04T01:43:26.603369+0000","last_clean":"2023-11-04T01:43:26.603369+0000","last_became_active":"2023-11-04T01:43:26.598614+0000","last_became_peered":"2023-11-04T01:43:26.598614+0000","last_unstale":"2023-11-04T01:43:26.603369+0000","last_undegraded":"2023-11-04T01:43:26.603369+0000","last_fullsized":"2023-11-04T01:43:26.603369+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:33:55.624535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.590496+0000","last_change":"2023-11-04T01:43:25.939279+0000","last_active":"2023-11-04T01:43:26.590496+0000","last_peered":"2023-11-04T01:43:26.590496+0000","last_clean":"2023-11-04T01:43:26.590496+0000","last_became_active":"2023-11-04T01:43:25.939018+0000","last_became_peered":"2023-11-04T01:43:25.939018+0000","last_unstale":"2023-11-04T01:43:26.590496+0000","last_undegraded":"2023-11-04T01:43:26.590496+0000","last_fullsized":"2023-11-04T01:43:26.590496+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:30:43.848957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.929480+0000","last_change":"2023-11-04T01:42:35.345520+0000","last_active":"2023-11-04T01:43:25.929480+0000","last_peered":"2023-11-04T01:43:25.929480+0000","last_clean":"2023-11-04T01:43:25.929480+0000","last_became_active":"2023-11-04T01:42:35.345171+0000","last_became_peered":"2023-11-04T01:42:35.345171+0000","last_unstale":"2023-11-04T01:43:25.929480+0000","last_undegraded":"2023-11-04T01:43:25.929480+0000","last_fullsized":"2023-11-04T01:43:25.929480+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:09:48.559668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.932551+0000","last_change":"2023-11-04T01:42:36.408199+0000","last_active":"2023-11-04T01:43:25.932551+0000","last_peered":"2023-11-04T01:43:25.932551+0000","last_clean":"2023-11-04T01:43:25.932551+0000","last_became_active":"2023-11-04T01:42:34.346643+0000","last_became_peered":"2023-11-04T01:42:34.346643+0000","last_unstale":"2023-11-04T01:43:25.932551+0000","last_undegraded":"2023-11-04T01:43:25.932551+0000","last_fullsized":"2023-11-04T01:43:25.932551+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:16:15.635771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056985800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.933765+0000","last_change":"2023-11-04T01:41:35.905999+0000","last_active":"2023-11-04T01:43:25.933765+0000","last_peered":"2023-11-04T01:43:25.933765+0000","last_clean":"2023-11-04T01:43:25.933765+0000","last_became_active":"2023-11-04T01:41:34.735286+0000","last_became_peered":"2023-11-04T01:41:34.735286+0000","last_unstale":"2023-11-04T01:43:25.933765+0000","last_undegraded":"2023-11-04T01:43:25.933765+0000","last_fullsized":"2023-11-04T01:43:25.933765+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:14:22.019781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051880100000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.602581+0000","last_change":"2023-11-04T01:43:26.599736+0000","last_active":"2023-11-04T01:43:26.602581+0000","last_peered":"2023-11-04T01:43:26.602581+0000","last_clean":"2023-11-04T01:43:26.602581+0000","last_became_active":"2023-11-04T01:43:26.599365+0000","last_became_peered":"2023-11-04T01:43:26.599365+0000","last_unstale":"2023-11-04T01:43:26.602581+0000","last_undegraded":"2023-11-04T01:43:26.602581+0000","last_fullsized":"2023-11-04T01:43:26.602581+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:15:35.270592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.596455+0000","last_change":"2023-11-04T01:43:25.938026+0000","last_active":"2023-11-04T01:43:26.596455+0000","last_peered":"2023-11-04T01:43:26.596455+0000","last_clean":"2023-11-04T01:43:26.596455+0000","last_became_active":"2023-11-04T01:43:25.937750+0000","last_became_peered":"2023-11-04T01:43:25.937750+0000","last_unstale":"2023-11-04T01:43:26.596455+0000","last_undegraded":"2023-11-04T01:43:26.596455+0000","last_fullsized":"2023-11-04T01:43:26.596455+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:18:24.702905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.924159+0000","last_change":"2023-11-04T01:42:35.347120+0000","last_active":"2023-11-04T01:43:25.924159+0000","last_peered":"2023-11-04T01:43:25.924159+0000","last_clean":"2023-11-04T01:43:25.924159+0000","last_became_active":"2023-11-04T01:42:35.346861+0000","last_became_peered":"2023-11-04T01:42:35.346861+0000","last_unstale":"2023-11-04T01:43:25.924159+0000","last_undegraded":"2023-11-04T01:43:25.924159+0000","last_fullsized":"2023-11-04T01:43:25.924159+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:51:31.538081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.930826+0000","last_change":"2023-11-04T01:42:36.409273+0000","last_active":"2023-11-04T01:43:25.930826+0000","last_peered":"2023-11-04T01:43:25.930826+0000","last_clean":"2023-11-04T01:43:25.930826+0000","last_became_active":"2023-11-04T01:42:34.349691+0000","last_became_peered":"2023-11-04T01:42:34.349691+0000","last_unstale":"2023-11-04T01:43:25.930826+0000","last_undegraded":"2023-11-04T01:43:25.930826+0000","last_fullsized":"2023-11-04T01:43:25.930826+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:04:04.521532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000397551,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":60,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.925683+0000","last_change":"2023-11-04T01:41:36.344205+0000","last_active":"2023-11-04T01:43:25.925683+0000","last_peered":"2023-11-04T01:43:25.925683+0000","last_clean":"2023-11-04T01:43:25.925683+0000","last_became_active":"2023-11-04T01:41:34.733205+0000","last_became_peered":"2023-11-04T01:41:34.733205+0000","last_unstale":"2023-11-04T01:43:25.925683+0000","last_undegraded":"2023-11-04T01:43:25.925683+0000","last_fullsized":"2023-11-04T01:43:25.925683+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:37.958719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011584760000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.606041+0000","last_change":"2023-11-04T01:43:26.603827+0000","last_active":"2023-11-04T01:43:26.606041+0000","last_peered":"2023-11-04T01:43:26.606041+0000","last_clean":"2023-11-04T01:43:26.606041+0000","last_became_active":"2023-11-04T01:43:26.603523+0000","last_became_peered":"2023-11-04T01:43:26.603523+0000","last_unstale":"2023-11-04T01:43:26.606041+0000","last_undegraded":"2023-11-04T01:43:26.606041+0000","last_fullsized":"2023-11-04T01:43:26.606041+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:07:35.970868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.595641+0000","last_change":"2023-11-04T01:43:25.936705+0000","last_active":"2023-11-04T01:43:26.595641+0000","last_peered":"2023-11-04T01:43:26.595641+0000","last_clean":"2023-11-04T01:43:26.595641+0000","last_became_active":"2023-11-04T01:43:25.936365+0000","last_became_peered":"2023-11-04T01:43:25.936365+0000","last_unstale":"2023-11-04T01:43:26.595641+0000","last_undegraded":"2023-11-04T01:43:26.595641+0000","last_fullsized":"2023-11-04T01:43:26.595641+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:26:28.717492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.930136+0000","last_change":"2023-11-04T01:42:35.355437+0000","last_active":"2023-11-04T01:43:25.930136+0000","last_peered":"2023-11-04T01:43:25.930136+0000","last_clean":"2023-11-04T01:43:25.930136+0000","last_became_active":"2023-11-04T01:42:35.355084+0000","last_became_peered":"2023-11-04T01:42:35.355084+0000","last_unstale":"2023-11-04T01:43:25.930136+0000","last_undegraded":"2023-11-04T01:43:25.930136+0000","last_fullsized":"2023-11-04T01:43:25.930136+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:39:42.671180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.925603+0000","last_change":"2023-11-04T01:42:36.341135+0000","last_active":"2023-11-04T01:43:25.925603+0000","last_peered":"2023-11-04T01:43:25.925603+0000","last_clean":"2023-11-04T01:43:25.925603+0000","last_became_active":"2023-11-04T01:42:34.344383+0000","last_became_peered":"2023-11-04T01:42:34.344383+0000","last_unstale":"2023-11-04T01:43:25.925603+0000","last_undegraded":"2023-11-04T01:43:25.925603+0000","last_fullsized":"2023-11-04T01:43:25.925603+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:31:27.915960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011027179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":60,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.924415+0000","last_change":"2023-11-04T01:41:36.343728+0000","last_active":"2023-11-04T01:43:25.924415+0000","last_peered":"2023-11-04T01:43:25.924415+0000","last_clean":"2023-11-04T01:43:25.924415+0000","last_became_active":"2023-11-04T01:41:34.731106+0000","last_became_peered":"2023-11-04T01:41:34.731106+0000","last_unstale":"2023-11-04T01:43:25.924415+0000","last_undegraded":"2023-11-04T01:43:25.924415+0000","last_fullsized":"2023-11-04T01:43:25.924415+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:29.730483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058974500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.604884+0000","last_change":"2023-11-04T01:43:26.599668+0000","last_active":"2023-11-04T01:43:26.604884+0000","last_peered":"2023-11-04T01:43:26.604884+0000","last_clean":"2023-11-04T01:43:26.604884+0000","last_became_active":"2023-11-04T01:43:26.599352+0000","last_became_peered":"2023-11-04T01:43:26.599352+0000","last_unstale":"2023-11-04T01:43:26.604884+0000","last_undegraded":"2023-11-04T01:43:26.604884+0000","last_fullsized":"2023-11-04T01:43:26.604884+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:07:01.993689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.592569+0000","last_change":"2023-11-04T01:43:25.942872+0000","last_active":"2023-11-04T01:43:26.592569+0000","last_peered":"2023-11-04T01:43:26.592569+0000","last_clean":"2023-11-04T01:43:26.592569+0000","last_became_active":"2023-11-04T01:43:25.942638+0000","last_became_peered":"2023-11-04T01:43:25.942638+0000","last_unstale":"2023-11-04T01:43:26.592569+0000","last_undegraded":"2023-11-04T01:43:26.592569+0000","last_fullsized":"2023-11-04T01:43:26.592569+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:28:58.169513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.934193+0000","last_change":"2023-11-04T01:42:35.349178+0000","last_active":"2023-11-04T01:43:25.934193+0000","last_peered":"2023-11-04T01:43:25.934193+0000","last_clean":"2023-11-04T01:43:25.934193+0000","last_became_active":"2023-11-04T01:42:35.348762+0000","last_became_peered":"2023-11-04T01:42:35.348762+0000","last_unstale":"2023-11-04T01:43:25.934193+0000","last_undegraded":"2023-11-04T01:43:25.934193+0000","last_fullsized":"2023-11-04T01:43:25.934193+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:50:43.272196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.928033+0000","last_change":"2023-11-04T01:42:36.408535+0000","last_active":"2023-11-04T01:43:25.928033+0000","last_peered":"2023-11-04T01:43:25.928033+0000","last_clean":"2023-11-04T01:43:25.928033+0000","last_became_active":"2023-11-04T01:42:34.351574+0000","last_became_peered":"2023-11-04T01:42:34.351574+0000","last_unstale":"2023-11-04T01:43:25.928033+0000","last_undegraded":"2023-11-04T01:43:25.928033+0000","last_fullsized":"2023-11-04T01:43:25.928033+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:28.593045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053030500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.934266+0000","last_change":"2023-11-04T01:41:35.931778+0000","last_active":"2023-11-04T01:43:25.934266+0000","last_peered":"2023-11-04T01:43:25.934266+0000","last_clean":"2023-11-04T01:43:25.934266+0000","last_became_active":"2023-11-04T01:41:34.736897+0000","last_became_peered":"2023-11-04T01:41:34.736897+0000","last_unstale":"2023-11-04T01:43:25.934266+0000","last_undegraded":"2023-11-04T01:43:25.934266+0000","last_fullsized":"2023-11-04T01:43:25.934266+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:20.089706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071523300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.613376+0000","last_change":"2023-11-04T01:43:26.608944+0000","last_active":"2023-11-04T01:43:26.613376+0000","last_peered":"2023-11-04T01:43:26.613376+0000","last_clean":"2023-11-04T01:43:26.613376+0000","last_became_active":"2023-11-04T01:43:26.608489+0000","last_became_peered":"2023-11-04T01:43:26.608489+0000","last_unstale":"2023-11-04T01:43:26.613376+0000","last_undegraded":"2023-11-04T01:43:26.613376+0000","last_fullsized":"2023-11-04T01:43:26.613376+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:13:04.902034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.598365+0000","last_change":"2023-11-04T01:43:25.946569+0000","last_active":"2023-11-04T01:43:26.598365+0000","last_peered":"2023-11-04T01:43:26.598365+0000","last_clean":"2023-11-04T01:43:26.598365+0000","last_became_active":"2023-11-04T01:43:25.946280+0000","last_became_peered":"2023-11-04T01:43:25.946280+0000","last_unstale":"2023-11-04T01:43:26.598365+0000","last_undegraded":"2023-11-04T01:43:26.598365+0000","last_fullsized":"2023-11-04T01:43:26.598365+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:30:41.049713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.931713+0000","last_change":"2023-11-04T01:42:35.353394+0000","last_active":"2023-11-04T01:43:25.931713+0000","last_peered":"2023-11-04T01:43:25.931713+0000","last_clean":"2023-11-04T01:43:25.931713+0000","last_became_active":"2023-11-04T01:42:35.353098+0000","last_became_peered":"2023-11-04T01:42:35.353098+0000","last_unstale":"2023-11-04T01:43:25.931713+0000","last_undegraded":"2023-11-04T01:43:25.931713+0000","last_fullsized":"2023-11-04T01:43:25.931713+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:51:13.068224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.932871+0000","last_change":"2023-11-04T01:42:36.412911+0000","last_active":"2023-11-04T01:43:25.932871+0000","last_peered":"2023-11-04T01:43:25.932871+0000","last_clean":"2023-11-04T01:43:25.932871+0000","last_became_active":"2023-11-04T01:42:34.349620+0000","last_became_peered":"2023-11-04T01:42:34.349620+0000","last_unstale":"2023-11-04T01:43:25.932871+0000","last_undegraded":"2023-11-04T01:43:25.932871+0000","last_fullsized":"2023-11-04T01:43:25.932871+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:22:16.530179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041040599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":70,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.929928+0000","last_change":"2023-11-04T01:41:35.729017+0000","last_active":"2023-11-04T01:43:25.929928+0000","last_peered":"2023-11-04T01:43:25.929928+0000","last_clean":"2023-11-04T01:43:25.929928+0000","last_became_active":"2023-11-04T01:41:34.730592+0000","last_became_peered":"2023-11-04T01:41:34.730592+0000","last_unstale":"2023-11-04T01:43:25.929928+0000","last_undegraded":"2023-11-04T01:43:25.929928+0000","last_fullsized":"2023-11-04T01:43:25.929928+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:08.858430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088820999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.613332+0000","last_change":"2023-11-04T01:43:26.608750+0000","last_active":"2023-11-04T01:43:26.613332+0000","last_peered":"2023-11-04T01:43:26.613332+0000","last_clean":"2023-11-04T01:43:26.613332+0000","last_became_active":"2023-11-04T01:43:26.608073+0000","last_became_peered":"2023-11-04T01:43:26.608073+0000","last_unstale":"2023-11-04T01:43:26.613332+0000","last_undegraded":"2023-11-04T01:43:26.613332+0000","last_fullsized":"2023-11-04T01:43:26.613332+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:47:16.978014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.596146+0000","last_change":"2023-11-04T01:43:25.938488+0000","last_active":"2023-11-04T01:43:26.596146+0000","last_peered":"2023-11-04T01:43:26.596146+0000","last_clean":"2023-11-04T01:43:26.596146+0000","last_became_active":"2023-11-04T01:43:25.938231+0000","last_became_peered":"2023-11-04T01:43:25.938231+0000","last_unstale":"2023-11-04T01:43:26.596146+0000","last_undegraded":"2023-11-04T01:43:26.596146+0000","last_fullsized":"2023-11-04T01:43:26.596146+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:11:58.007982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.932222+0000","last_change":"2023-11-04T01:42:35.355799+0000","last_active":"2023-11-04T01:43:25.932222+0000","last_peered":"2023-11-04T01:43:25.932222+0000","last_clean":"2023-11-04T01:43:25.932222+0000","last_became_active":"2023-11-04T01:42:35.355542+0000","last_became_peered":"2023-11-04T01:42:35.355542+0000","last_unstale":"2023-11-04T01:43:25.932222+0000","last_undegraded":"2023-11-04T01:43:25.932222+0000","last_fullsized":"2023-11-04T01:43:25.932222+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:10:24.565360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.931319+0000","last_change":"2023-11-04T01:42:36.413447+0000","last_active":"2023-11-04T01:43:25.931319+0000","last_peered":"2023-11-04T01:43:25.931319+0000","last_clean":"2023-11-04T01:43:25.931319+0000","last_became_active":"2023-11-04T01:42:34.351191+0000","last_became_peered":"2023-11-04T01:42:34.351191+0000","last_unstale":"2023-11-04T01:43:25.931319+0000","last_undegraded":"2023-11-04T01:43:25.931319+0000","last_fullsized":"2023-11-04T01:43:25.931319+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:32:10.544188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082047100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":62,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.933230+0000","last_change":"2023-11-04T01:41:35.729378+0000","last_active":"2023-11-04T01:43:25.933230+0000","last_peered":"2023-11-04T01:43:25.933230+0000","last_clean":"2023-11-04T01:43:25.933230+0000","last_became_active":"2023-11-04T01:41:34.730387+0000","last_became_peered":"2023-11-04T01:41:34.730387+0000","last_unstale":"2023-11-04T01:43:25.933230+0000","last_undegraded":"2023-11-04T01:43:25.933230+0000","last_fullsized":"2023-11-04T01:43:25.933230+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:12.653602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072268699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.602821+0000","last_change":"2023-11-04T01:43:26.597621+0000","last_active":"2023-11-04T01:43:26.602821+0000","last_peered":"2023-11-04T01:43:26.602821+0000","last_clean":"2023-11-04T01:43:26.602821+0000","last_became_active":"2023-11-04T01:43:26.597368+0000","last_became_peered":"2023-11-04T01:43:26.597368+0000","last_unstale":"2023-11-04T01:43:26.602821+0000","last_undegraded":"2023-11-04T01:43:26.602821+0000","last_fullsized":"2023-11-04T01:43:26.602821+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:28:05.980460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.597594+0000","last_change":"2023-11-04T01:43:25.936248+0000","last_active":"2023-11-04T01:43:26.597594+0000","last_peered":"2023-11-04T01:43:26.597594+0000","last_clean":"2023-11-04T01:43:26.597594+0000","last_became_active":"2023-11-04T01:43:25.935979+0000","last_became_peered":"2023-11-04T01:43:25.935979+0000","last_unstale":"2023-11-04T01:43:26.597594+0000","last_undegraded":"2023-11-04T01:43:26.597594+0000","last_fullsized":"2023-11-04T01:43:26.597594+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:23:42.772424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.929733+0000","last_change":"2023-11-04T01:42:35.352317+0000","last_active":"2023-11-04T01:43:25.929733+0000","last_peered":"2023-11-04T01:43:25.929733+0000","last_clean":"2023-11-04T01:43:25.929733+0000","last_became_active":"2023-11-04T01:42:35.351486+0000","last_became_peered":"2023-11-04T01:42:35.351486+0000","last_unstale":"2023-11-04T01:43:25.929733+0000","last_undegraded":"2023-11-04T01:43:25.929733+0000","last_fullsized":"2023-11-04T01:43:25.929733+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:33:20.111728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.925129+0000","last_change":"2023-11-04T01:42:36.342710+0000","last_active":"2023-11-04T01:43:25.925129+0000","last_peered":"2023-11-04T01:43:25.925129+0000","last_clean":"2023-11-04T01:43:25.925129+0000","last_became_active":"2023-11-04T01:42:34.349773+0000","last_became_peered":"2023-11-04T01:42:34.349773+0000","last_unstale":"2023-11-04T01:43:25.925129+0000","last_undegraded":"2023-11-04T01:43:25.925129+0000","last_fullsized":"2023-11-04T01:43:25.925129+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:55:22.976726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077362500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":70,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.930203+0000","last_change":"2023-11-04T01:41:35.729318+0000","last_active":"2023-11-04T01:43:25.930203+0000","last_peered":"2023-11-04T01:43:25.930203+0000","last_clean":"2023-11-04T01:43:25.930203+0000","last_became_active":"2023-11-04T01:41:34.733796+0000","last_became_peered":"2023-11-04T01:41:34.733796+0000","last_unstale":"2023-11-04T01:43:25.930203+0000","last_undegraded":"2023-11-04T01:43:25.930203+0000","last_fullsized":"2023-11-04T01:43:25.930203+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:19.350812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053712200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.604914+0000","last_change":"2023-11-04T01:43:26.598803+0000","last_active":"2023-11-04T01:43:26.604914+0000","last_peered":"2023-11-04T01:43:26.604914+0000","last_clean":"2023-11-04T01:43:26.604914+0000","last_became_active":"2023-11-04T01:43:26.598531+0000","last_became_peered":"2023-11-04T01:43:26.598531+0000","last_unstale":"2023-11-04T01:43:26.604914+0000","last_undegraded":"2023-11-04T01:43:26.604914+0000","last_fullsized":"2023-11-04T01:43:26.604914+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:57:32.261474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.588757+0000","last_change":"2023-11-04T01:43:25.946397+0000","last_active":"2023-11-04T01:43:26.588757+0000","last_peered":"2023-11-04T01:43:26.588757+0000","last_clean":"2023-11-04T01:43:26.588757+0000","last_became_active":"2023-11-04T01:43:25.946052+0000","last_became_peered":"2023-11-04T01:43:25.946052+0000","last_unstale":"2023-11-04T01:43:26.588757+0000","last_undegraded":"2023-11-04T01:43:26.588757+0000","last_fullsized":"2023-11-04T01:43:26.588757+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:19.505130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.929328+0000","last_change":"2023-11-04T01:42:35.355335+0000","last_active":"2023-11-04T01:43:25.929328+0000","last_peered":"2023-11-04T01:43:25.929328+0000","last_clean":"2023-11-04T01:43:25.929328+0000","last_became_active":"2023-11-04T01:42:35.355057+0000","last_became_peered":"2023-11-04T01:42:35.355057+0000","last_unstale":"2023-11-04T01:43:25.929328+0000","last_undegraded":"2023-11-04T01:43:25.929328+0000","last_fullsized":"2023-11-04T01:43:25.929328+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:34:48.488293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.925719+0000","last_change":"2023-11-04T01:42:36.342412+0000","last_active":"2023-11-04T01:43:25.925719+0000","last_peered":"2023-11-04T01:43:25.925719+0000","last_clean":"2023-11-04T01:43:25.925719+0000","last_became_active":"2023-11-04T01:42:34.344325+0000","last_became_peered":"2023-11-04T01:42:34.344325+0000","last_unstale":"2023-11-04T01:43:25.925719+0000","last_undegraded":"2023-11-04T01:43:25.925719+0000","last_fullsized":"2023-11-04T01:43:25.925719+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:29:52.259787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010133010000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.932950+0000","last_change":"2023-11-04T01:41:35.931929+0000","last_active":"2023-11-04T01:43:25.932950+0000","last_peered":"2023-11-04T01:43:25.932950+0000","last_clean":"2023-11-04T01:43:25.932950+0000","last_became_active":"2023-11-04T01:41:34.738795+0000","last_became_peered":"2023-11-04T01:41:34.738795+0000","last_unstale":"2023-11-04T01:43:25.932950+0000","last_undegraded":"2023-11-04T01:43:25.932950+0000","last_fullsized":"2023-11-04T01:43:25.932950+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:59.608410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046204999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.613434+0000","last_change":"2023-11-04T01:43:26.608508+0000","last_active":"2023-11-04T01:43:26.613434+0000","last_peered":"2023-11-04T01:43:26.613434+0000","last_clean":"2023-11-04T01:43:26.613434+0000","last_became_active":"2023-11-04T01:43:26.608213+0000","last_became_peered":"2023-11-04T01:43:26.608213+0000","last_unstale":"2023-11-04T01:43:26.613434+0000","last_undegraded":"2023-11-04T01:43:26.613434+0000","last_fullsized":"2023-11-04T01:43:26.613434+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:12:28.716919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.592563+0000","last_change":"2023-11-04T01:43:25.938604+0000","last_active":"2023-11-04T01:43:26.592563+0000","last_peered":"2023-11-04T01:43:26.592563+0000","last_clean":"2023-11-04T01:43:26.592563+0000","last_became_active":"2023-11-04T01:43:25.938375+0000","last_became_peered":"2023-11-04T01:43:25.938375+0000","last_unstale":"2023-11-04T01:43:26.592563+0000","last_undegraded":"2023-11-04T01:43:26.592563+0000","last_fullsized":"2023-11-04T01:43:26.592563+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:30:45.747394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.932679+0000","last_change":"2023-11-04T01:42:35.352853+0000","last_active":"2023-11-04T01:43:25.932679+0000","last_peered":"2023-11-04T01:43:25.932679+0000","last_clean":"2023-11-04T01:43:25.932679+0000","last_became_active":"2023-11-04T01:42:35.351314+0000","last_became_peered":"2023-11-04T01:42:35.351314+0000","last_unstale":"2023-11-04T01:43:25.932679+0000","last_undegraded":"2023-11-04T01:43:25.932679+0000","last_fullsized":"2023-11-04T01:43:25.932679+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:24:28.106438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.934134+0000","last_change":"2023-11-04T01:42:36.411957+0000","last_active":"2023-11-04T01:43:25.934134+0000","last_peered":"2023-11-04T01:43:25.934134+0000","last_clean":"2023-11-04T01:43:25.934134+0000","last_became_active":"2023-11-04T01:42:34.348584+0000","last_became_peered":"2023-11-04T01:42:34.348584+0000","last_unstale":"2023-11-04T01:43:25.934134+0000","last_undegraded":"2023-11-04T01:43:25.934134+0000","last_fullsized":"2023-11-04T01:43:25.934134+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:30.702295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089633200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":70,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.928340+0000","last_change":"2023-11-04T01:41:35.728945+0000","last_active":"2023-11-04T01:43:25.928340+0000","last_peered":"2023-11-04T01:43:25.928340+0000","last_clean":"2023-11-04T01:43:25.928340+0000","last_became_active":"2023-11-04T01:41:34.735082+0000","last_became_peered":"2023-11-04T01:41:34.735082+0000","last_unstale":"2023-11-04T01:43:25.928340+0000","last_undegraded":"2023-11-04T01:43:25.928340+0000","last_fullsized":"2023-11-04T01:43:25.928340+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:16.970814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079093000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.604328+0000","last_change":"2023-11-04T01:43:26.601071+0000","last_active":"2023-11-04T01:43:26.604328+0000","last_peered":"2023-11-04T01:43:26.604328+0000","last_clean":"2023-11-04T01:43:26.604328+0000","last_became_active":"2023-11-04T01:43:26.600778+0000","last_became_peered":"2023-11-04T01:43:26.600778+0000","last_unstale":"2023-11-04T01:43:26.604328+0000","last_undegraded":"2023-11-04T01:43:26.604328+0000","last_fullsized":"2023-11-04T01:43:26.604328+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:11.756513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.585780+0000","last_change":"2023-11-04T01:43:25.937401+0000","last_active":"2023-11-04T01:43:26.585780+0000","last_peered":"2023-11-04T01:43:26.585780+0000","last_clean":"2023-11-04T01:43:26.585780+0000","last_became_active":"2023-11-04T01:43:25.937134+0000","last_became_peered":"2023-11-04T01:43:25.937134+0000","last_unstale":"2023-11-04T01:43:26.585780+0000","last_undegraded":"2023-11-04T01:43:26.585780+0000","last_fullsized":"2023-11-04T01:43:26.585780+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:50:07.744916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.933364+0000","last_change":"2023-11-04T01:42:35.349043+0000","last_active":"2023-11-04T01:43:25.933364+0000","last_peered":"2023-11-04T01:43:25.933364+0000","last_clean":"2023-11-04T01:43:25.933364+0000","last_became_active":"2023-11-04T01:42:35.348696+0000","last_became_peered":"2023-11-04T01:42:35.348696+0000","last_unstale":"2023-11-04T01:43:25.933364+0000","last_undegraded":"2023-11-04T01:43:25.933364+0000","last_fullsized":"2023-11-04T01:43:25.933364+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:21:03.655247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.932761+0000","last_change":"2023-11-04T01:42:36.412004+0000","last_active":"2023-11-04T01:43:25.932761+0000","last_peered":"2023-11-04T01:43:25.932761+0000","last_clean":"2023-11-04T01:43:25.932761+0000","last_became_active":"2023-11-04T01:42:34.347931+0000","last_became_peered":"2023-11-04T01:42:34.347931+0000","last_unstale":"2023-11-04T01:43:25.932761+0000","last_undegraded":"2023-11-04T01:43:25.932761+0000","last_fullsized":"2023-11-04T01:43:25.932761+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:08:04.045465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092725399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":62,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.932837+0000","last_change":"2023-11-04T01:41:35.728625+0000","last_active":"2023-11-04T01:43:25.932837+0000","last_peered":"2023-11-04T01:43:25.932837+0000","last_clean":"2023-11-04T01:43:25.932837+0000","last_became_active":"2023-11-04T01:41:34.731514+0000","last_became_peered":"2023-11-04T01:41:34.731514+0000","last_unstale":"2023-11-04T01:43:25.932837+0000","last_undegraded":"2023-11-04T01:43:25.932837+0000","last_fullsized":"2023-11-04T01:43:25.932837+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:51:50.413223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047686400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.608000+0000","last_change":"2023-11-04T01:43:26.603855+0000","last_active":"2023-11-04T01:43:26.608000+0000","last_peered":"2023-11-04T01:43:26.608000+0000","last_clean":"2023-11-04T01:43:26.608000+0000","last_became_active":"2023-11-04T01:43:26.603576+0000","last_became_peered":"2023-11-04T01:43:26.603576+0000","last_unstale":"2023-11-04T01:43:26.608000+0000","last_undegraded":"2023-11-04T01:43:26.608000+0000","last_fullsized":"2023-11-04T01:43:26.608000+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:30:42.051408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.586102+0000","last_change":"2023-11-04T01:43:25.938132+0000","last_active":"2023-11-04T01:43:26.586102+0000","last_peered":"2023-11-04T01:43:26.586102+0000","last_clean":"2023-11-04T01:43:26.586102+0000","last_became_active":"2023-11-04T01:43:25.937895+0000","last_became_peered":"2023-11-04T01:43:25.937895+0000","last_unstale":"2023-11-04T01:43:26.586102+0000","last_undegraded":"2023-11-04T01:43:26.586102+0000","last_fullsized":"2023-11-04T01:43:26.586102+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:51:34.340257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.933547+0000","last_change":"2023-11-04T01:42:35.344216+0000","last_active":"2023-11-04T01:43:25.933547+0000","last_peered":"2023-11-04T01:43:25.933547+0000","last_clean":"2023-11-04T01:43:25.933547+0000","last_became_active":"2023-11-04T01:42:35.343986+0000","last_became_peered":"2023-11-04T01:42:35.343986+0000","last_unstale":"2023-11-04T01:43:25.933547+0000","last_undegraded":"2023-11-04T01:43:25.933547+0000","last_fullsized":"2023-11-04T01:43:25.933547+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:32.012283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.934267+0000","last_change":"2023-11-04T01:42:36.408418+0000","last_active":"2023-11-04T01:43:25.934267+0000","last_peered":"2023-11-04T01:43:25.934267+0000","last_clean":"2023-11-04T01:43:25.934267+0000","last_became_active":"2023-11-04T01:42:34.345245+0000","last_became_peered":"2023-11-04T01:42:34.345245+0000","last_unstale":"2023-11-04T01:43:25.934267+0000","last_undegraded":"2023-11-04T01:43:25.934267+0000","last_fullsized":"2023-11-04T01:43:25.934267+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:01:34.850682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042992099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":60,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.924522+0000","last_change":"2023-11-04T01:41:36.343762+0000","last_active":"2023-11-04T01:43:25.924522+0000","last_peered":"2023-11-04T01:43:25.924522+0000","last_clean":"2023-11-04T01:43:25.924522+0000","last_became_active":"2023-11-04T01:41:34.733406+0000","last_became_peered":"2023-11-04T01:41:34.733406+0000","last_unstale":"2023-11-04T01:43:25.924522+0000","last_undegraded":"2023-11-04T01:43:25.924522+0000","last_fullsized":"2023-11-04T01:43:25.924522+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:34:35.541159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058533399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.605028+0000","last_change":"2023-11-04T01:43:26.598994+0000","last_active":"2023-11-04T01:43:26.605028+0000","last_peered":"2023-11-04T01:43:26.605028+0000","last_clean":"2023-11-04T01:43:26.605028+0000","last_became_active":"2023-11-04T01:43:26.598675+0000","last_became_peered":"2023-11-04T01:43:26.598675+0000","last_unstale":"2023-11-04T01:43:26.605028+0000","last_undegraded":"2023-11-04T01:43:26.605028+0000","last_fullsized":"2023-11-04T01:43:26.605028+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:12:54.552368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.596853+0000","last_change":"2023-11-04T01:43:25.937265+0000","last_active":"2023-11-04T01:43:26.596853+0000","last_peered":"2023-11-04T01:43:26.596853+0000","last_clean":"2023-11-04T01:43:26.596853+0000","last_became_active":"2023-11-04T01:43:25.936764+0000","last_became_peered":"2023-11-04T01:43:25.936764+0000","last_unstale":"2023-11-04T01:43:26.596853+0000","last_undegraded":"2023-11-04T01:43:26.596853+0000","last_fullsized":"2023-11-04T01:43:26.596853+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:31:37.659592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.928099+0000","last_change":"2023-11-04T01:42:35.345703+0000","last_active":"2023-11-04T01:43:25.928099+0000","last_peered":"2023-11-04T01:43:25.928099+0000","last_clean":"2023-11-04T01:43:25.928099+0000","last_became_active":"2023-11-04T01:42:35.345089+0000","last_became_peered":"2023-11-04T01:42:35.345089+0000","last_unstale":"2023-11-04T01:43:25.928099+0000","last_undegraded":"2023-11-04T01:43:25.928099+0000","last_fullsized":"2023-11-04T01:43:25.928099+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:36:11.770993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.924061+0000","last_change":"2023-11-04T01:42:36.341220+0000","last_active":"2023-11-04T01:43:25.924061+0000","last_peered":"2023-11-04T01:43:25.924061+0000","last_clean":"2023-11-04T01:43:25.924061+0000","last_became_active":"2023-11-04T01:42:34.350834+0000","last_became_peered":"2023-11-04T01:42:34.350834+0000","last_unstale":"2023-11-04T01:43:25.924061+0000","last_undegraded":"2023-11-04T01:43:25.924061+0000","last_fullsized":"2023-11-04T01:43:25.924061+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:16:15.635771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011584519999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.931143+0000","last_change":"2023-11-04T01:41:35.906297+0000","last_active":"2023-11-04T01:43:25.931143+0000","last_peered":"2023-11-04T01:43:25.931143+0000","last_clean":"2023-11-04T01:43:25.931143+0000","last_became_active":"2023-11-04T01:41:34.734134+0000","last_became_peered":"2023-11-04T01:41:34.734134+0000","last_unstale":"2023-11-04T01:43:25.931143+0000","last_undegraded":"2023-11-04T01:43:25.931143+0000","last_fullsized":"2023-11-04T01:43:25.931143+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:52.597063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087104900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.610733+0000","last_change":"2023-11-04T01:43:26.605357+0000","last_active":"2023-11-04T01:43:26.610733+0000","last_peered":"2023-11-04T01:43:26.610733+0000","last_clean":"2023-11-04T01:43:26.610733+0000","last_became_active":"2023-11-04T01:43:26.604820+0000","last_became_peered":"2023-11-04T01:43:26.604820+0000","last_unstale":"2023-11-04T01:43:26.610733+0000","last_undegraded":"2023-11-04T01:43:26.610733+0000","last_fullsized":"2023-11-04T01:43:26.610733+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:30:38.079607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.585502+0000","last_change":"2023-11-04T01:43:25.937639+0000","last_active":"2023-11-04T01:43:26.585502+0000","last_peered":"2023-11-04T01:43:26.585502+0000","last_clean":"2023-11-04T01:43:26.585502+0000","last_became_active":"2023-11-04T01:43:25.937389+0000","last_became_peered":"2023-11-04T01:43:25.937389+0000","last_unstale":"2023-11-04T01:43:26.585502+0000","last_undegraded":"2023-11-04T01:43:26.585502+0000","last_fullsized":"2023-11-04T01:43:26.585502+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:07:34.969173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.930042+0000","last_change":"2023-11-04T01:42:35.355771+0000","last_active":"2023-11-04T01:43:25.930042+0000","last_peered":"2023-11-04T01:43:25.930042+0000","last_clean":"2023-11-04T01:43:25.930042+0000","last_became_active":"2023-11-04T01:42:35.355459+0000","last_became_peered":"2023-11-04T01:42:35.355459+0000","last_unstale":"2023-11-04T01:43:25.930042+0000","last_undegraded":"2023-11-04T01:43:25.930042+0000","last_fullsized":"2023-11-04T01:43:25.930042+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:48:17.884449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.929600+0000","last_change":"2023-11-04T01:42:36.410175+0000","last_active":"2023-11-04T01:43:25.929600+0000","last_peered":"2023-11-04T01:43:25.929600+0000","last_clean":"2023-11-04T01:43:25.929600+0000","last_became_active":"2023-11-04T01:42:34.353093+0000","last_became_peered":"2023-11-04T01:42:34.353093+0000","last_unstale":"2023-11-04T01:43:25.929600+0000","last_undegraded":"2023-11-04T01:43:25.929600+0000","last_fullsized":"2023-11-04T01:43:25.929600+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:19:10.941730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000299241,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.932213+0000","last_change":"2023-11-04T01:41:35.906596+0000","last_active":"2023-11-04T01:43:25.932213+0000","last_peered":"2023-11-04T01:43:25.932213+0000","last_clean":"2023-11-04T01:43:25.932213+0000","last_became_active":"2023-11-04T01:41:34.738529+0000","last_became_peered":"2023-11-04T01:41:34.738529+0000","last_unstale":"2023-11-04T01:43:25.932213+0000","last_undegraded":"2023-11-04T01:43:25.932213+0000","last_fullsized":"2023-11-04T01:43:25.932213+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:48.121273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086660600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.605075+0000","last_change":"2023-11-04T01:43:26.599958+0000","last_active":"2023-11-04T01:43:26.605075+0000","last_peered":"2023-11-04T01:43:26.605075+0000","last_clean":"2023-11-04T01:43:26.605075+0000","last_became_active":"2023-11-04T01:43:26.599723+0000","last_became_peered":"2023-11-04T01:43:26.599723+0000","last_unstale":"2023-11-04T01:43:26.605075+0000","last_undegraded":"2023-11-04T01:43:26.605075+0000","last_fullsized":"2023-11-04T01:43:26.605075+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:20:15.129750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"95'1","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.955185+0000","last_change":"2023-11-04T01:43:25.942236+0000","last_active":"2023-11-04T01:43:26.955185+0000","last_peered":"2023-11-04T01:43:26.955185+0000","last_clean":"2023-11-04T01:43:26.955185+0000","last_became_active":"2023-11-04T01:43:25.941989+0000","last_became_peered":"2023-11-04T01:43:25.941989+0000","last_unstale":"2023-11-04T01:43:26.955185+0000","last_undegraded":"2023-11-04T01:43:26.955185+0000","last_fullsized":"2023-11-04T01:43:26.955185+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:21:12.226739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.932792+0000","last_change":"2023-11-04T01:42:35.352467+0000","last_active":"2023-11-04T01:43:25.932792+0000","last_peered":"2023-11-04T01:43:25.932792+0000","last_clean":"2023-11-04T01:43:25.932792+0000","last_became_active":"2023-11-04T01:42:35.352199+0000","last_became_peered":"2023-11-04T01:42:35.352199+0000","last_unstale":"2023-11-04T01:43:25.932792+0000","last_undegraded":"2023-11-04T01:43:25.932792+0000","last_fullsized":"2023-11-04T01:43:25.932792+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:34:48.488293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.929336+0000","last_change":"2023-11-04T01:42:36.410094+0000","last_active":"2023-11-04T01:43:25.929336+0000","last_peered":"2023-11-04T01:43:25.929336+0000","last_clean":"2023-11-04T01:43:25.929336+0000","last_became_active":"2023-11-04T01:42:34.346812+0000","last_became_peered":"2023-11-04T01:42:34.346812+0000","last_unstale":"2023-11-04T01:43:25.929336+0000","last_undegraded":"2023-11-04T01:43:25.929336+0000","last_fullsized":"2023-11-04T01:43:25.929336+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:47.456400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034280500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.929553+0000","last_change":"2023-11-04T01:41:35.906430+0000","last_active":"2023-11-04T01:43:25.929553+0000","last_peered":"2023-11-04T01:43:25.929553+0000","last_clean":"2023-11-04T01:43:25.929553+0000","last_became_active":"2023-11-04T01:41:34.741147+0000","last_became_peered":"2023-11-04T01:41:34.741147+0000","last_unstale":"2023-11-04T01:43:25.929553+0000","last_undegraded":"2023-11-04T01:43:25.929553+0000","last_fullsized":"2023-11-04T01:43:25.929553+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:20.089706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090504400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.610789+0000","last_change":"2023-11-04T01:43:26.606762+0000","last_active":"2023-11-04T01:43:26.610789+0000","last_peered":"2023-11-04T01:43:26.610789+0000","last_clean":"2023-11-04T01:43:26.610789+0000","last_became_active":"2023-11-04T01:43:26.606454+0000","last_became_peered":"2023-11-04T01:43:26.606454+0000","last_unstale":"2023-11-04T01:43:26.610789+0000","last_undegraded":"2023-11-04T01:43:26.610789+0000","last_fullsized":"2023-11-04T01:43:26.610789+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:36:52.503545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.597713+0000","last_change":"2023-11-04T01:43:25.933808+0000","last_active":"2023-11-04T01:43:26.597713+0000","last_peered":"2023-11-04T01:43:26.597713+0000","last_clean":"2023-11-04T01:43:26.597713+0000","last_became_active":"2023-11-04T01:43:25.933297+0000","last_became_peered":"2023-11-04T01:43:25.933297+0000","last_unstale":"2023-11-04T01:43:26.597713+0000","last_undegraded":"2023-11-04T01:43:26.597713+0000","last_fullsized":"2023-11-04T01:43:26.597713+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:44:46.271388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.931782+0000","last_change":"2023-11-04T01:42:35.348600+0000","last_active":"2023-11-04T01:43:25.931782+0000","last_peered":"2023-11-04T01:43:25.931782+0000","last_clean":"2023-11-04T01:43:25.931782+0000","last_became_active":"2023-11-04T01:42:35.348315+0000","last_became_peered":"2023-11-04T01:42:35.348315+0000","last_unstale":"2023-11-04T01:43:25.931782+0000","last_undegraded":"2023-11-04T01:43:25.931782+0000","last_fullsized":"2023-11-04T01:43:25.931782+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:13:42.469906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.929405+0000","last_change":"2023-11-04T01:42:36.411537+0000","last_active":"2023-11-04T01:43:25.929405+0000","last_peered":"2023-11-04T01:43:25.929405+0000","last_clean":"2023-11-04T01:43:25.929405+0000","last_became_active":"2023-11-04T01:42:34.354741+0000","last_became_peered":"2023-11-04T01:42:34.354741+0000","last_unstale":"2023-11-04T01:43:25.929405+0000","last_undegraded":"2023-11-04T01:43:25.929405+0000","last_fullsized":"2023-11-04T01:43:25.929405+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:22:16.530179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000668952,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":60,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.925545+0000","last_change":"2023-11-04T01:41:36.344408+0000","last_active":"2023-11-04T01:43:25.925545+0000","last_peered":"2023-11-04T01:43:25.925545+0000","last_clean":"2023-11-04T01:43:25.925545+0000","last_became_active":"2023-11-04T01:41:34.730735+0000","last_became_peered":"2023-11-04T01:41:34.730735+0000","last_unstale":"2023-11-04T01:43:25.925545+0000","last_undegraded":"2023-11-04T01:43:25.925545+0000","last_fullsized":"2023-11-04T01:43:25.925545+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:10:58.095232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081464299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.604963+0000","last_change":"2023-11-04T01:43:26.598114+0000","last_active":"2023-11-04T01:43:26.604963+0000","last_peered":"2023-11-04T01:43:26.604963+0000","last_clean":"2023-11-04T01:43:26.604963+0000","last_became_active":"2023-11-04T01:43:26.597191+0000","last_became_peered":"2023-11-04T01:43:26.597191+0000","last_unstale":"2023-11-04T01:43:26.604963+0000","last_undegraded":"2023-11-04T01:43:26.604963+0000","last_fullsized":"2023-11-04T01:43:26.604963+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:27.667188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.595390+0000","last_change":"2023-11-04T01:43:25.943802+0000","last_active":"2023-11-04T01:43:26.595390+0000","last_peered":"2023-11-04T01:43:26.595390+0000","last_clean":"2023-11-04T01:43:26.595390+0000","last_became_active":"2023-11-04T01:43:25.943541+0000","last_became_peered":"2023-11-04T01:43:25.943541+0000","last_unstale":"2023-11-04T01:43:26.595390+0000","last_undegraded":"2023-11-04T01:43:26.595390+0000","last_fullsized":"2023-11-04T01:43:26.595390+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:14:33.157947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.929480+0000","last_change":"2023-11-04T01:42:35.353952+0000","last_active":"2023-11-04T01:43:25.929480+0000","last_peered":"2023-11-04T01:43:25.929480+0000","last_clean":"2023-11-04T01:43:25.929480+0000","last_became_active":"2023-11-04T01:42:35.353703+0000","last_became_peered":"2023-11-04T01:42:35.353703+0000","last_unstale":"2023-11-04T01:43:25.929480+0000","last_undegraded":"2023-11-04T01:43:25.929480+0000","last_fullsized":"2023-11-04T01:43:25.929480+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:29.594965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.931783+0000","last_change":"2023-11-04T01:42:36.412751+0000","last_active":"2023-11-04T01:43:25.931783+0000","last_peered":"2023-11-04T01:43:25.931783+0000","last_clean":"2023-11-04T01:43:25.931783+0000","last_became_active":"2023-11-04T01:42:34.350389+0000","last_became_peered":"2023-11-04T01:42:34.350389+0000","last_unstale":"2023-11-04T01:43:25.931783+0000","last_undegraded":"2023-11-04T01:43:25.931783+0000","last_fullsized":"2023-11-04T01:43:25.931783+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:33.892673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057436599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":64,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.933321+0000","last_change":"2023-11-04T01:41:36.244245+0000","last_active":"2023-11-04T01:43:25.933321+0000","last_peered":"2023-11-04T01:43:25.933321+0000","last_clean":"2023-11-04T01:43:25.933321+0000","last_became_active":"2023-11-04T01:41:34.734925+0000","last_became_peered":"2023-11-04T01:41:34.734925+0000","last_unstale":"2023-11-04T01:43:25.933321+0000","last_undegraded":"2023-11-04T01:43:25.933321+0000","last_fullsized":"2023-11-04T01:43:25.933321+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:21:44.193748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025350200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.604395+0000","last_change":"2023-11-04T01:43:26.601141+0000","last_active":"2023-11-04T01:43:26.604395+0000","last_peered":"2023-11-04T01:43:26.604395+0000","last_clean":"2023-11-04T01:43:26.604395+0000","last_became_active":"2023-11-04T01:43:26.600857+0000","last_became_peered":"2023-11-04T01:43:26.600857+0000","last_unstale":"2023-11-04T01:43:26.604395+0000","last_undegraded":"2023-11-04T01:43:26.604395+0000","last_fullsized":"2023-11-04T01:43:26.604395+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:59:42.998041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.588453+0000","last_change":"2023-11-04T01:43:25.938399+0000","last_active":"2023-11-04T01:43:26.588453+0000","last_peered":"2023-11-04T01:43:26.588453+0000","last_clean":"2023-11-04T01:43:26.588453+0000","last_became_active":"2023-11-04T01:43:25.938101+0000","last_became_peered":"2023-11-04T01:43:25.938101+0000","last_unstale":"2023-11-04T01:43:26.588453+0000","last_undegraded":"2023-11-04T01:43:26.588453+0000","last_fullsized":"2023-11-04T01:43:26.588453+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:51:10.860489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.924413+0000","last_change":"2023-11-04T01:42:35.347267+0000","last_active":"2023-11-04T01:43:25.924413+0000","last_peered":"2023-11-04T01:43:25.924413+0000","last_clean":"2023-11-04T01:43:25.924413+0000","last_became_active":"2023-11-04T01:42:35.347025+0000","last_became_peered":"2023-11-04T01:42:35.347025+0000","last_unstale":"2023-11-04T01:43:25.924413+0000","last_undegraded":"2023-11-04T01:43:25.924413+0000","last_fullsized":"2023-11-04T01:43:25.924413+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:43.681647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.934221+0000","last_change":"2023-11-04T01:42:36.412195+0000","last_active":"2023-11-04T01:43:25.934221+0000","last_peered":"2023-11-04T01:43:25.934221+0000","last_clean":"2023-11-04T01:43:25.934221+0000","last_became_active":"2023-11-04T01:42:34.348235+0000","last_became_peered":"2023-11-04T01:42:34.348235+0000","last_unstale":"2023-11-04T01:43:25.934221+0000","last_undegraded":"2023-11-04T01:43:25.934221+0000","last_fullsized":"2023-11-04T01:43:25.934221+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:41:39.504471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095507199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":60,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.924134+0000","last_change":"2023-11-04T01:41:36.343956+0000","last_active":"2023-11-04T01:43:25.924134+0000","last_peered":"2023-11-04T01:43:25.924134+0000","last_clean":"2023-11-04T01:43:25.924134+0000","last_became_active":"2023-11-04T01:41:34.736013+0000","last_became_peered":"2023-11-04T01:41:34.736013+0000","last_unstale":"2023-11-04T01:43:25.924134+0000","last_undegraded":"2023-11-04T01:43:25.924134+0000","last_fullsized":"2023-11-04T01:43:25.924134+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:08.858430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081427799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.596355+0000","last_change":"2023-11-04T01:43:26.595068+0000","last_active":"2023-11-04T01:43:26.596355+0000","last_peered":"2023-11-04T01:43:26.596355+0000","last_clean":"2023-11-04T01:43:26.596355+0000","last_became_active":"2023-11-04T01:43:26.594805+0000","last_became_peered":"2023-11-04T01:43:26.594805+0000","last_unstale":"2023-11-04T01:43:26.596355+0000","last_undegraded":"2023-11-04T01:43:26.596355+0000","last_fullsized":"2023-11-04T01:43:26.596355+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:36:31.544152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"95'4","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.955728+0000","last_change":"2023-11-04T01:43:25.935226+0000","last_active":"2023-11-04T01:43:26.955728+0000","last_peered":"2023-11-04T01:43:26.955728+0000","last_clean":"2023-11-04T01:43:26.955728+0000","last_became_active":"2023-11-04T01:43:25.934932+0000","last_became_peered":"2023-11-04T01:43:25.934932+0000","last_unstale":"2023-11-04T01:43:26.955728+0000","last_undegraded":"2023-11-04T01:43:26.955728+0000","last_fullsized":"2023-11-04T01:43:26.955728+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:25:57.693458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.927480+0000","last_change":"2023-11-04T01:42:35.354870+0000","last_active":"2023-11-04T01:43:25.927480+0000","last_peered":"2023-11-04T01:43:25.927480+0000","last_clean":"2023-11-04T01:43:25.927480+0000","last_became_active":"2023-11-04T01:42:35.354442+0000","last_became_peered":"2023-11-04T01:42:35.354442+0000","last_unstale":"2023-11-04T01:43:25.927480+0000","last_undegraded":"2023-11-04T01:43:25.927480+0000","last_fullsized":"2023-11-04T01:43:25.927480+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:08:28.888035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.924320+0000","last_change":"2023-11-04T01:42:36.342222+0000","last_active":"2023-11-04T01:43:25.924320+0000","last_peered":"2023-11-04T01:43:25.924320+0000","last_clean":"2023-11-04T01:43:25.924320+0000","last_became_active":"2023-11-04T01:42:34.347183+0000","last_became_peered":"2023-11-04T01:42:34.347183+0000","last_unstale":"2023-11-04T01:43:25.924320+0000","last_undegraded":"2023-11-04T01:43:25.924320+0000","last_fullsized":"2023-11-04T01:43:25.924320+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:52:53.403289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001441877,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":64,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.930818+0000","last_change":"2023-11-04T01:41:36.243977+0000","last_active":"2023-11-04T01:43:25.930818+0000","last_peered":"2023-11-04T01:43:25.930818+0000","last_clean":"2023-11-04T01:43:25.930818+0000","last_became_active":"2023-11-04T01:41:34.733127+0000","last_became_peered":"2023-11-04T01:41:34.733127+0000","last_unstale":"2023-11-04T01:43:25.930818+0000","last_undegraded":"2023-11-04T01:43:25.930818+0000","last_fullsized":"2023-11-04T01:43:25.930818+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:36.118907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051788300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.601531+0000","last_change":"2023-11-04T01:43:26.596781+0000","last_active":"2023-11-04T01:43:26.601531+0000","last_peered":"2023-11-04T01:43:26.601531+0000","last_clean":"2023-11-04T01:43:26.601531+0000","last_became_active":"2023-11-04T01:43:26.596496+0000","last_became_peered":"2023-11-04T01:43:26.596496+0000","last_unstale":"2023-11-04T01:43:26.601531+0000","last_undegraded":"2023-11-04T01:43:26.601531+0000","last_fullsized":"2023-11-04T01:43:26.601531+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:59:42.998041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.589734+0000","last_change":"2023-11-04T01:43:25.946646+0000","last_active":"2023-11-04T01:43:26.589734+0000","last_peered":"2023-11-04T01:43:26.589734+0000","last_clean":"2023-11-04T01:43:26.589734+0000","last_became_active":"2023-11-04T01:43:25.946321+0000","last_became_peered":"2023-11-04T01:43:25.946321+0000","last_unstale":"2023-11-04T01:43:26.589734+0000","last_undegraded":"2023-11-04T01:43:26.589734+0000","last_fullsized":"2023-11-04T01:43:26.589734+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:52:22.125331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.933515+0000","last_change":"2023-11-04T01:42:35.354884+0000","last_active":"2023-11-04T01:43:25.933515+0000","last_peered":"2023-11-04T01:43:25.933515+0000","last_clean":"2023-11-04T01:43:25.933515+0000","last_became_active":"2023-11-04T01:42:35.354616+0000","last_became_peered":"2023-11-04T01:42:35.354616+0000","last_unstale":"2023-11-04T01:43:25.933515+0000","last_undegraded":"2023-11-04T01:43:25.933515+0000","last_fullsized":"2023-11-04T01:43:25.933515+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:41:40.506391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.930694+0000","last_change":"2023-11-04T01:42:36.411716+0000","last_active":"2023-11-04T01:43:25.930694+0000","last_peered":"2023-11-04T01:43:25.930694+0000","last_clean":"2023-11-04T01:43:25.930694+0000","last_became_active":"2023-11-04T01:42:34.350215+0000","last_became_peered":"2023-11-04T01:42:34.350215+0000","last_unstale":"2023-11-04T01:43:25.930694+0000","last_undegraded":"2023-11-04T01:43:25.930694+0000","last_fullsized":"2023-11-04T01:43:25.930694+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:20:02.805323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076372199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":60,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.932946+0000","last_change":"2023-11-04T01:41:36.067797+0000","last_active":"2023-11-04T01:43:25.932946+0000","last_peered":"2023-11-04T01:43:25.932946+0000","last_clean":"2023-11-04T01:43:25.932946+0000","last_became_active":"2023-11-04T01:41:34.734880+0000","last_became_peered":"2023-11-04T01:41:34.734880+0000","last_unstale":"2023-11-04T01:43:25.932946+0000","last_undegraded":"2023-11-04T01:43:25.932946+0000","last_fullsized":"2023-11-04T01:43:25.932946+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:40:20.089706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036003499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.595800+0000","last_change":"2023-11-04T01:43:26.594187+0000","last_active":"2023-11-04T01:43:26.595800+0000","last_peered":"2023-11-04T01:43:26.595800+0000","last_clean":"2023-11-04T01:43:26.595800+0000","last_became_active":"2023-11-04T01:43:26.593927+0000","last_became_peered":"2023-11-04T01:43:26.593927+0000","last_unstale":"2023-11-04T01:43:26.595800+0000","last_undegraded":"2023-11-04T01:43:26.595800+0000","last_fullsized":"2023-11-04T01:43:26.595800+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:21:13.228434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.589445+0000","last_change":"2023-11-04T01:43:25.946670+0000","last_active":"2023-11-04T01:43:26.589445+0000","last_peered":"2023-11-04T01:43:26.589445+0000","last_clean":"2023-11-04T01:43:26.589445+0000","last_became_active":"2023-11-04T01:43:25.946214+0000","last_became_peered":"2023-11-04T01:43:25.946214+0000","last_unstale":"2023-11-04T01:43:26.589445+0000","last_undegraded":"2023-11-04T01:43:26.589445+0000","last_fullsized":"2023-11-04T01:43:26.589445+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:53:44.992459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.928194+0000","last_change":"2023-11-04T01:42:35.345946+0000","last_active":"2023-11-04T01:43:25.928194+0000","last_peered":"2023-11-04T01:43:25.928194+0000","last_clean":"2023-11-04T01:43:25.928194+0000","last_became_active":"2023-11-04T01:42:35.345033+0000","last_became_peered":"2023-11-04T01:42:35.345033+0000","last_unstale":"2023-11-04T01:43:25.928194+0000","last_undegraded":"2023-11-04T01:43:25.928194+0000","last_fullsized":"2023-11-04T01:43:25.928194+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:32:11.546107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.933594+0000","last_change":"2023-11-04T01:42:36.410760+0000","last_active":"2023-11-04T01:43:25.933594+0000","last_peered":"2023-11-04T01:43:25.933594+0000","last_clean":"2023-11-04T01:43:25.933594+0000","last_became_active":"2023-11-04T01:42:34.349633+0000","last_became_peered":"2023-11-04T01:42:34.349633+0000","last_unstale":"2023-11-04T01:43:25.933594+0000","last_undegraded":"2023-11-04T01:43:25.933594+0000","last_fullsized":"2023-11-04T01:43:25.933594+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:08:27.886115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066417699999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":62,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.932738+0000","last_change":"2023-11-04T01:41:35.729089+0000","last_active":"2023-11-04T01:43:25.932738+0000","last_peered":"2023-11-04T01:43:25.932738+0000","last_clean":"2023-11-04T01:43:25.932738+0000","last_became_active":"2023-11-04T01:41:34.731063+0000","last_became_peered":"2023-11-04T01:41:34.731063+0000","last_unstale":"2023-11-04T01:43:25.932738+0000","last_undegraded":"2023-11-04T01:43:25.932738+0000","last_fullsized":"2023-11-04T01:43:25.932738+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:38:46.633175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083653600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.594605+0000","last_change":"2023-11-04T01:43:26.592882+0000","last_active":"2023-11-04T01:43:26.594605+0000","last_peered":"2023-11-04T01:43:26.594605+0000","last_clean":"2023-11-04T01:43:26.594605+0000","last_became_active":"2023-11-04T01:43:26.591571+0000","last_became_peered":"2023-11-04T01:43:26.591571+0000","last_unstale":"2023-11-04T01:43:26.594605+0000","last_undegraded":"2023-11-04T01:43:26.594605+0000","last_fullsized":"2023-11-04T01:43:26.594605+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:28:59.171208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.591988+0000","last_change":"2023-11-04T01:43:25.937396+0000","last_active":"2023-11-04T01:43:26.591988+0000","last_peered":"2023-11-04T01:43:26.591988+0000","last_clean":"2023-11-04T01:43:26.591988+0000","last_became_active":"2023-11-04T01:43:25.937108+0000","last_became_peered":"2023-11-04T01:43:25.937108+0000","last_unstale":"2023-11-04T01:43:26.591988+0000","last_undegraded":"2023-11-04T01:43:26.591988+0000","last_fullsized":"2023-11-04T01:43:26.591988+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:53:08.580481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.931627+0000","last_change":"2023-11-04T01:42:35.357455+0000","last_active":"2023-11-04T01:43:25.931627+0000","last_peered":"2023-11-04T01:43:25.931627+0000","last_clean":"2023-11-04T01:43:25.931627+0000","last_became_active":"2023-11-04T01:42:35.357198+0000","last_became_peered":"2023-11-04T01:42:35.357198+0000","last_unstale":"2023-11-04T01:43:25.931627+0000","last_undegraded":"2023-11-04T01:43:25.931627+0000","last_fullsized":"2023-11-04T01:43:25.931627+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:33:20.111728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.924878+0000","last_change":"2023-11-04T01:42:36.342203+0000","last_active":"2023-11-04T01:43:25.924878+0000","last_peered":"2023-11-04T01:43:25.924878+0000","last_clean":"2023-11-04T01:43:25.924878+0000","last_became_active":"2023-11-04T01:42:34.351883+0000","last_became_peered":"2023-11-04T01:42:34.351883+0000","last_unstale":"2023-11-04T01:43:25.924878+0000","last_undegraded":"2023-11-04T01:43:25.924878+0000","last_fullsized":"2023-11-04T01:43:25.924878+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:12:41.905588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016503290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":70,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.930033+0000","last_change":"2023-11-04T01:41:35.729232+0000","last_active":"2023-11-04T01:43:25.930033+0000","last_peered":"2023-11-04T01:43:25.930033+0000","last_clean":"2023-11-04T01:43:25.930033+0000","last_became_active":"2023-11-04T01:41:34.731490+0000","last_became_peered":"2023-11-04T01:41:34.731490+0000","last_unstale":"2023-11-04T01:43:25.930033+0000","last_undegraded":"2023-11-04T01:43:25.930033+0000","last_fullsized":"2023-11-04T01:43:25.930033+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:37.958719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089653699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.607617+0000","last_change":"2023-11-04T01:43:26.603489+0000","last_active":"2023-11-04T01:43:26.607617+0000","last_peered":"2023-11-04T01:43:26.607617+0000","last_clean":"2023-11-04T01:43:26.607617+0000","last_became_active":"2023-11-04T01:43:26.603241+0000","last_became_peered":"2023-11-04T01:43:26.603241+0000","last_unstale":"2023-11-04T01:43:26.607617+0000","last_undegraded":"2023-11-04T01:43:26.607617+0000","last_fullsized":"2023-11-04T01:43:26.607617+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:30:46.749090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"95'2","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.956365+0000","last_change":"2023-11-04T01:43:25.945353+0000","last_active":"2023-11-04T01:43:26.956365+0000","last_peered":"2023-11-04T01:43:26.956365+0000","last_clean":"2023-11-04T01:43:26.956365+0000","last_became_active":"2023-11-04T01:43:25.945057+0000","last_became_peered":"2023-11-04T01:43:25.945057+0000","last_unstale":"2023-11-04T01:43:26.956365+0000","last_undegraded":"2023-11-04T01:43:26.956365+0000","last_fullsized":"2023-11-04T01:43:26.956365+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:55:50.937742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.932246+0000","last_change":"2023-11-04T01:42:35.353012+0000","last_active":"2023-11-04T01:43:25.932246+0000","last_peered":"2023-11-04T01:43:25.932246+0000","last_clean":"2023-11-04T01:43:25.932246+0000","last_became_active":"2023-11-04T01:42:35.352268+0000","last_became_peered":"2023-11-04T01:42:35.352268+0000","last_unstale":"2023-11-04T01:43:25.932246+0000","last_undegraded":"2023-11-04T01:43:25.932246+0000","last_fullsized":"2023-11-04T01:43:25.932246+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:51:13.068224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.931543+0000","last_change":"2023-11-04T01:42:36.413549+0000","last_active":"2023-11-04T01:43:25.931543+0000","last_peered":"2023-11-04T01:43:25.931543+0000","last_clean":"2023-11-04T01:43:25.931543+0000","last_became_active":"2023-11-04T01:42:34.355467+0000","last_became_peered":"2023-11-04T01:42:34.355467+0000","last_unstale":"2023-11-04T01:43:25.931543+0000","last_undegraded":"2023-11-04T01:43:25.931543+0000","last_fullsized":"2023-11-04T01:43:25.931543+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:09:47.557748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071579,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":60,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.925197+0000","last_change":"2023-11-04T01:41:36.344018+0000","last_active":"2023-11-04T01:43:25.925197+0000","last_peered":"2023-11-04T01:43:25.925197+0000","last_clean":"2023-11-04T01:43:25.925197+0000","last_became_active":"2023-11-04T01:41:34.734178+0000","last_became_peered":"2023-11-04T01:41:34.734178+0000","last_unstale":"2023-11-04T01:43:25.925197+0000","last_undegraded":"2023-11-04T01:43:25.925197+0000","last_fullsized":"2023-11-04T01:43:25.925197+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:16.970814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077338299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.613542+0000","last_change":"2023-11-04T01:43:26.608387+0000","last_active":"2023-11-04T01:43:26.613542+0000","last_peered":"2023-11-04T01:43:26.613542+0000","last_clean":"2023-11-04T01:43:26.613542+0000","last_became_active":"2023-11-04T01:43:26.608162+0000","last_became_peered":"2023-11-04T01:43:26.608162+0000","last_unstale":"2023-11-04T01:43:26.613542+0000","last_undegraded":"2023-11-04T01:43:26.613542+0000","last_fullsized":"2023-11-04T01:43:26.613542+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:18:39.204152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.588897+0000","last_change":"2023-11-04T01:43:25.939285+0000","last_active":"2023-11-04T01:43:26.588897+0000","last_peered":"2023-11-04T01:43:26.588897+0000","last_clean":"2023-11-04T01:43:26.588897+0000","last_became_active":"2023-11-04T01:43:25.938988+0000","last_became_peered":"2023-11-04T01:43:25.938988+0000","last_unstale":"2023-11-04T01:43:26.588897+0000","last_undegraded":"2023-11-04T01:43:26.588897+0000","last_fullsized":"2023-11-04T01:43:26.588897+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:17:07.224941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.931703+0000","last_change":"2023-11-04T01:42:35.351651+0000","last_active":"2023-11-04T01:43:25.931703+0000","last_peered":"2023-11-04T01:43:25.931703+0000","last_clean":"2023-11-04T01:43:25.931703+0000","last_became_active":"2023-11-04T01:42:35.351384+0000","last_became_peered":"2023-11-04T01:42:35.351384+0000","last_unstale":"2023-11-04T01:43:25.931703+0000","last_undegraded":"2023-11-04T01:43:25.931703+0000","last_fullsized":"2023-11-04T01:43:25.931703+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:16.391588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.925060+0000","last_change":"2023-11-04T01:42:36.342476+0000","last_active":"2023-11-04T01:43:25.925060+0000","last_peered":"2023-11-04T01:43:25.925060+0000","last_clean":"2023-11-04T01:43:25.925060+0000","last_became_active":"2023-11-04T01:42:34.350295+0000","last_became_peered":"2023-11-04T01:42:34.350295+0000","last_unstale":"2023-11-04T01:43:25.925060+0000","last_undegraded":"2023-11-04T01:43:25.925060+0000","last_fullsized":"2023-11-04T01:43:25.925060+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:30:27.909910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000695332,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":58,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.932219+0000","last_change":"2023-11-04T01:41:35.906788+0000","last_active":"2023-11-04T01:43:25.932219+0000","last_peered":"2023-11-04T01:43:25.932219+0000","last_clean":"2023-11-04T01:43:25.932219+0000","last_became_active":"2023-11-04T01:41:34.734386+0000","last_became_peered":"2023-11-04T01:41:34.734386+0000","last_unstale":"2023-11-04T01:43:25.932219+0000","last_undegraded":"2023-11-04T01:43:25.932219+0000","last_fullsized":"2023-11-04T01:43:25.932219+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:23:23.733128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060435600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.604374+0000","last_change":"2023-11-04T01:43:26.600756+0000","last_active":"2023-11-04T01:43:26.604374+0000","last_peered":"2023-11-04T01:43:26.604374+0000","last_clean":"2023-11-04T01:43:26.604374+0000","last_became_active":"2023-11-04T01:43:26.600195+0000","last_became_peered":"2023-11-04T01:43:26.600195+0000","last_unstale":"2023-11-04T01:43:26.604374+0000","last_undegraded":"2023-11-04T01:43:26.604374+0000","last_fullsized":"2023-11-04T01:43:26.604374+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:51:11.862184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.585919+0000","last_change":"2023-11-04T01:43:25.940024+0000","last_active":"2023-11-04T01:43:26.585919+0000","last_peered":"2023-11-04T01:43:26.585919+0000","last_clean":"2023-11-04T01:43:26.585919+0000","last_became_active":"2023-11-04T01:43:25.939732+0000","last_became_peered":"2023-11-04T01:43:25.939732+0000","last_unstale":"2023-11-04T01:43:26.585919+0000","last_undegraded":"2023-11-04T01:43:26.585919+0000","last_fullsized":"2023-11-04T01:43:26.585919+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:38:21.324255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.927757+0000","last_change":"2023-11-04T01:42:35.354173+0000","last_active":"2023-11-04T01:43:25.927757+0000","last_peered":"2023-11-04T01:43:25.927757+0000","last_clean":"2023-11-04T01:43:25.927757+0000","last_became_active":"2023-11-04T01:42:35.353832+0000","last_became_peered":"2023-11-04T01:42:35.353832+0000","last_unstale":"2023-11-04T01:43:25.927757+0000","last_undegraded":"2023-11-04T01:43:25.927757+0000","last_fullsized":"2023-11-04T01:43:25.927757+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:34:48.488293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.933233+0000","last_change":"2023-11-04T01:42:36.342247+0000","last_active":"2023-11-04T01:43:25.933233+0000","last_peered":"2023-11-04T01:43:25.933233+0000","last_clean":"2023-11-04T01:43:25.933233+0000","last_became_active":"2023-11-04T01:42:34.352917+0000","last_became_peered":"2023-11-04T01:42:34.352917+0000","last_unstale":"2023-11-04T01:43:25.933233+0000","last_undegraded":"2023-11-04T01:43:25.933233+0000","last_fullsized":"2023-11-04T01:43:25.933233+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:56.180797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014365140000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.932003+0000","last_change":"2023-11-04T01:41:35.931718+0000","last_active":"2023-11-04T01:43:25.932003+0000","last_peered":"2023-11-04T01:43:25.932003+0000","last_clean":"2023-11-04T01:43:25.932003+0000","last_became_active":"2023-11-04T01:41:34.741033+0000","last_became_peered":"2023-11-04T01:41:34.741033+0000","last_unstale":"2023-11-04T01:43:25.932003+0000","last_undegraded":"2023-11-04T01:43:25.932003+0000","last_fullsized":"2023-11-04T01:43:25.932003+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:48.121273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065858400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.604779+0000","last_change":"2023-11-04T01:43:26.602337+0000","last_active":"2023-11-04T01:43:26.604779+0000","last_peered":"2023-11-04T01:43:26.604779+0000","last_clean":"2023-11-04T01:43:26.604779+0000","last_became_active":"2023-11-04T01:43:26.602009+0000","last_became_peered":"2023-11-04T01:43:26.602009+0000","last_unstale":"2023-11-04T01:43:26.604779+0000","last_undegraded":"2023-11-04T01:43:26.604779+0000","last_fullsized":"2023-11-04T01:43:26.604779+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:53:00.911987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.590704+0000","last_change":"2023-11-04T01:43:25.946784+0000","last_active":"2023-11-04T01:43:26.590704+0000","last_peered":"2023-11-04T01:43:26.590704+0000","last_clean":"2023-11-04T01:43:26.590704+0000","last_became_active":"2023-11-04T01:43:25.946017+0000","last_became_peered":"2023-11-04T01:43:25.946017+0000","last_unstale":"2023-11-04T01:43:26.590704+0000","last_undegraded":"2023-11-04T01:43:26.590704+0000","last_fullsized":"2023-11-04T01:43:26.590704+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:38.768411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.933310+0000","last_change":"2023-11-04T01:42:35.351103+0000","last_active":"2023-11-04T01:43:25.933310+0000","last_peered":"2023-11-04T01:43:25.933310+0000","last_clean":"2023-11-04T01:43:25.933310+0000","last_became_active":"2023-11-04T01:42:35.350867+0000","last_became_peered":"2023-11-04T01:42:35.350867+0000","last_unstale":"2023-11-04T01:43:25.933310+0000","last_undegraded":"2023-11-04T01:43:25.933310+0000","last_fullsized":"2023-11-04T01:43:25.933310+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:12:54.713516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.932811+0000","last_change":"2023-11-04T01:42:36.408801+0000","last_active":"2023-11-04T01:43:25.932811+0000","last_peered":"2023-11-04T01:43:25.932811+0000","last_clean":"2023-11-04T01:43:25.932811+0000","last_became_active":"2023-11-04T01:42:34.345669+0000","last_became_peered":"2023-11-04T01:42:34.345669+0000","last_unstale":"2023-11-04T01:43:25.932811+0000","last_undegraded":"2023-11-04T01:43:25.932811+0000","last_fullsized":"2023-11-04T01:43:25.932811+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:14:42.679727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055359799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.927237+0000","last_change":"2023-11-04T01:41:35.728094+0000","last_active":"2023-11-04T01:43:25.927237+0000","last_peered":"2023-11-04T01:43:25.927237+0000","last_clean":"2023-11-04T01:43:25.927237+0000","last_became_active":"2023-11-04T01:41:34.738687+0000","last_became_peered":"2023-11-04T01:41:34.738687+0000","last_unstale":"2023-11-04T01:43:25.927237+0000","last_undegraded":"2023-11-04T01:43:25.927237+0000","last_fullsized":"2023-11-04T01:43:25.927237+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:37.958719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068772699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.605264+0000","last_change":"2023-11-04T01:43:26.602580+0000","last_active":"2023-11-04T01:43:26.605264+0000","last_peered":"2023-11-04T01:43:26.605264+0000","last_clean":"2023-11-04T01:43:26.605264+0000","last_became_active":"2023-11-04T01:43:26.602205+0000","last_became_peered":"2023-11-04T01:43:26.602205+0000","last_unstale":"2023-11-04T01:43:26.605264+0000","last_undegraded":"2023-11-04T01:43:26.605264+0000","last_fullsized":"2023-11-04T01:43:26.605264+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:33:55.624535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.596766+0000","last_change":"2023-11-04T01:43:25.940123+0000","last_active":"2023-11-04T01:43:26.596766+0000","last_peered":"2023-11-04T01:43:26.596766+0000","last_clean":"2023-11-04T01:43:26.596766+0000","last_became_active":"2023-11-04T01:43:25.939837+0000","last_became_peered":"2023-11-04T01:43:25.939837+0000","last_unstale":"2023-11-04T01:43:26.596766+0000","last_undegraded":"2023-11-04T01:43:26.596766+0000","last_fullsized":"2023-11-04T01:43:26.596766+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:11:56.324882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.927888+0000","last_change":"2023-11-04T01:42:35.354730+0000","last_active":"2023-11-04T01:43:25.927888+0000","last_peered":"2023-11-04T01:43:25.927888+0000","last_clean":"2023-11-04T01:43:25.927888+0000","last_became_active":"2023-11-04T01:42:35.354427+0000","last_became_peered":"2023-11-04T01:42:35.354427+0000","last_unstale":"2023-11-04T01:43:25.927888+0000","last_undegraded":"2023-11-04T01:43:25.927888+0000","last_fullsized":"2023-11-04T01:43:25.927888+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:41:40.506391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.932748+0000","last_change":"2023-11-04T01:42:36.407795+0000","last_active":"2023-11-04T01:43:25.932748+0000","last_peered":"2023-11-04T01:43:25.932748+0000","last_clean":"2023-11-04T01:43:25.932748+0000","last_became_active":"2023-11-04T01:42:34.349234+0000","last_became_peered":"2023-11-04T01:42:34.349234+0000","last_unstale":"2023-11-04T01:43:25.932748+0000","last_undegraded":"2023-11-04T01:43:25.932748+0000","last_fullsized":"2023-11-04T01:43:25.932748+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:31:27.915960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000451805,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":62,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.932901+0000","last_change":"2023-11-04T01:41:35.729106+0000","last_active":"2023-11-04T01:43:25.932901+0000","last_peered":"2023-11-04T01:43:25.932901+0000","last_clean":"2023-11-04T01:43:25.932901+0000","last_became_active":"2023-11-04T01:41:34.731230+0000","last_became_peered":"2023-11-04T01:41:34.731230+0000","last_unstale":"2023-11-04T01:43:25.932901+0000","last_undegraded":"2023-11-04T01:43:25.932901+0000","last_fullsized":"2023-11-04T01:43:25.932901+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:07:32.744572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078592199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.613562+0000","last_change":"2023-11-04T01:43:26.609677+0000","last_active":"2023-11-04T01:43:26.613562+0000","last_peered":"2023-11-04T01:43:26.613562+0000","last_clean":"2023-11-04T01:43:26.613562+0000","last_became_active":"2023-11-04T01:43:26.609284+0000","last_became_peered":"2023-11-04T01:43:26.609284+0000","last_unstale":"2023-11-04T01:43:26.613562+0000","last_undegraded":"2023-11-04T01:43:26.613562+0000","last_fullsized":"2023-11-04T01:43:26.613562+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:27:55.919487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.596659+0000","last_change":"2023-11-04T01:43:25.939708+0000","last_active":"2023-11-04T01:43:26.596659+0000","last_peered":"2023-11-04T01:43:26.596659+0000","last_clean":"2023-11-04T01:43:26.596659+0000","last_became_active":"2023-11-04T01:43:25.939487+0000","last_became_peered":"2023-11-04T01:43:25.939487+0000","last_unstale":"2023-11-04T01:43:26.596659+0000","last_undegraded":"2023-11-04T01:43:26.596659+0000","last_fullsized":"2023-11-04T01:43:26.596659+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:30:16.920650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.930743+0000","last_change":"2023-11-04T01:42:35.352725+0000","last_active":"2023-11-04T01:43:25.930743+0000","last_peered":"2023-11-04T01:43:25.930743+0000","last_clean":"2023-11-04T01:43:25.930743+0000","last_became_active":"2023-11-04T01:42:35.352127+0000","last_became_peered":"2023-11-04T01:42:35.352127+0000","last_unstale":"2023-11-04T01:43:25.930743+0000","last_undegraded":"2023-11-04T01:43:25.930743+0000","last_fullsized":"2023-11-04T01:43:25.930743+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:52:59.201087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.931414+0000","last_change":"2023-11-04T01:42:36.342229+0000","last_active":"2023-11-04T01:43:25.931414+0000","last_peered":"2023-11-04T01:43:25.931414+0000","last_clean":"2023-11-04T01:43:25.931414+0000","last_became_active":"2023-11-04T01:42:34.351542+0000","last_became_peered":"2023-11-04T01:42:34.351542+0000","last_unstale":"2023-11-04T01:43:25.931414+0000","last_undegraded":"2023-11-04T01:43:25.931414+0000","last_fullsized":"2023-11-04T01:43:25.931414+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:37:08.472507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017924740000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":62,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.932825+0000","last_change":"2023-11-04T01:41:35.728672+0000","last_active":"2023-11-04T01:43:25.932825+0000","last_peered":"2023-11-04T01:43:25.932825+0000","last_clean":"2023-11-04T01:43:25.932825+0000","last_became_active":"2023-11-04T01:41:34.727419+0000","last_became_peered":"2023-11-04T01:41:34.727419+0000","last_unstale":"2023-11-04T01:43:25.932825+0000","last_undegraded":"2023-11-04T01:43:25.932825+0000","last_fullsized":"2023-11-04T01:43:25.932825+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:35:01.127206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044278299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.594595+0000","last_change":"2023-11-04T01:43:26.593123+0000","last_active":"2023-11-04T01:43:26.594595+0000","last_peered":"2023-11-04T01:43:26.594595+0000","last_clean":"2023-11-04T01:43:26.594595+0000","last_became_active":"2023-11-04T01:43:26.592221+0000","last_became_peered":"2023-11-04T01:43:26.592221+0000","last_unstale":"2023-11-04T01:43:26.594595+0000","last_undegraded":"2023-11-04T01:43:26.594595+0000","last_fullsized":"2023-11-04T01:43:26.594595+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:25.919410+0000","last_clean_scrub_stamp":"2023-11-04T01:43:25.919410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:51:11.862184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-11-04T01:43:26.596264+0000","last_change":"2023-11-04T01:43:25.936829+0000","last_active":"2023-11-04T01:43:26.596264+0000","last_peered":"2023-11-04T01:43:26.596264+0000","last_clean":"2023-11-04T01:43:26.596264+0000","last_became_active":"2023-11-04T01:43:25.936006+0000","last_became_peered":"2023-11-04T01:43:25.936006+0000","last_unstale":"2023-11-04T01:43:26.596264+0000","last_undegraded":"2023-11-04T01:43:26.596264+0000","last_fullsized":"2023-11-04T01:43:26.596264+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:24.917715+0000","last_clean_scrub_stamp":"2023-11-04T01:43:24.917715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:35:07.455271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.929245+0000","last_change":"2023-11-04T01:42:35.352519+0000","last_active":"2023-11-04T01:43:25.929245+0000","last_peered":"2023-11-04T01:43:25.929245+0000","last_clean":"2023-11-04T01:43:25.929245+0000","last_became_active":"2023-11-04T01:42:35.352163+0000","last_became_peered":"2023-11-04T01:42:35.352163+0000","last_unstale":"2023-11-04T01:43:25.929245+0000","last_undegraded":"2023-11-04T01:43:25.929245+0000","last_fullsized":"2023-11-04T01:43:25.929245+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:34.330465+0000","last_clean_scrub_stamp":"2023-11-04T01:42:34.330465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:05:52.477616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":43,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.929821+0000","last_change":"2023-11-04T01:42:36.342140+0000","last_active":"2023-11-04T01:43:25.929821+0000","last_peered":"2023-11-04T01:43:25.929821+0000","last_clean":"2023-11-04T01:43:25.929821+0000","last_became_active":"2023-11-04T01:42:34.354685+0000","last_became_peered":"2023-11-04T01:42:34.354685+0000","last_unstale":"2023-11-04T01:43:25.929821+0000","last_undegraded":"2023-11-04T01:43:25.929821+0000","last_fullsized":"2023-11-04T01:43:25.929821+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:33.328545+0000","last_clean_scrub_stamp":"2023-11-04T01:42:33.328545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:54:50.302775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050039500000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":60,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.924995+0000","last_change":"2023-11-04T01:41:36.344271+0000","last_active":"2023-11-04T01:43:25.924995+0000","last_peered":"2023-11-04T01:43:25.924995+0000","last_clean":"2023-11-04T01:43:25.924995+0000","last_became_active":"2023-11-04T01:41:34.732524+0000","last_became_peered":"2023-11-04T01:41:34.732524+0000","last_unstale":"2023-11-04T01:43:25.924995+0000","last_undegraded":"2023-11-04T01:43:25.924995+0000","last_fullsized":"2023-11-04T01:43:25.924995+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:41:33.701346+0000","last_clean_scrub_stamp":"2023-11-04T01:41:33.701346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:19.350812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081160599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":241,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-11-04T01:43:25.928425+0000","last_change":"2023-11-04T01:39:54.204460+0000","last_active":"2023-11-04T01:43:25.928425+0000","last_peered":"2023-11-04T01:43:25.928425+0000","last_clean":"2023-11-04T01:43:25.928425+0000","last_became_active":"2023-11-04T01:39:54.203352+0000","last_became_peered":"2023-11-04T01:39:54.203352+0000","last_unstale":"2023-11-04T01:43:25.928425+0000","last_undegraded":"2023-11-04T01:43:25.928425+0000","last_fullsized":"2023-11-04T01:43:25.928425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:39:52.627032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:39:52.627032+0000","last_clean_scrub_stamp":"2023-11-04T01:39:52.627032+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:17:18.474768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28176,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343664,"statfs":{"total":96636764160,"available":96607911936,"internally_reserved":0,"allocated":1179648,"data_stored":579503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.52700000000000002,"15min":0.53500000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.65100000000000002,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.50600000000000001,"15min":0.499},"min":{"1min":0.376,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71499999999999997,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.51300000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54400000000000004,"15min":0.54700000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69899999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.37},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55500000000000005,"15min":0.55300000000000005},"min":{"1min":0.41099999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.73299999999999998,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.60199999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56699999999999995,"15min":0.57399999999999995},"min":{"1min":0.39400000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71499999999999997,"5min":1.177,"15min":1.177},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.54200000000000004,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66300000000000003,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.48499999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.44600000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.73399999999999999,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.625,"15min":0.63400000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77300000000000002,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.54800000000000004}]},{"osd":4,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.52400000000000002,"15min":0.52600000000000002},"min":{"1min":0.30599999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68000000000000005,"5min":1.048,"15min":1.048},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.54600000000000004,"15min":0.53200000000000003},"min":{"1min":0.33000000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.622}]},{"osd":6,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.52900000000000003,"15min":0.51500000000000001},"min":{"1min":0.36899999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56499999999999995,"15min":0.56899999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.56699999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57699999999999996,"15min":0.56100000000000005},"min":{"1min":0.34200000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.626,"15min":0.624},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.66400000000000003}]}]},{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32892,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338948,"statfs":{"total":96636764160,"available":96603082752,"internally_reserved":0,"allocated":1753088,"data_stored":1161081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53700000000000003,"15min":0.51800000000000002},"min":{"1min":0.38500000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70399999999999996,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.41899999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.70699999999999996,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.61899999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60299999999999998,"15min":0.60999999999999999},"min":{"1min":0.45300000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73099999999999998,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.628,"15min":0.61399999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.75,"5min":2.5049999999999999,"15min":2.5049999999999999},"last":0.80900000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59299999999999997,"15min":0.58499999999999996},"min":{"1min":0.45300000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.70099999999999996,"5min":1.708,"15min":1.708},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.627,"15min":0.60599999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77500000000000002,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.78500000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58599999999999997,"15min":0.56499999999999995},"min":{"1min":0.38300000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.67700000000000005,"5min":3.2349999999999999,"15min":3.2349999999999999},"last":0.755},{"interface":"front","average":{"1min":0.627,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82599999999999996,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.68799999999999994}]},{"osd":4,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.50900000000000001,"15min":0.48899999999999999},"min":{"1min":0.35999999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.81100000000000005,"5min":1.454,"15min":1.454},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.496,"15min":0.47499999999999998},"min":{"1min":0.34899999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.58499999999999996}]},{"osd":5,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.54300000000000004,"15min":0.50900000000000001},"min":{"1min":0.39700000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.89400000000000002,"5min":1.629,"15min":1.629},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56499999999999995,"15min":0.53500000000000003},"min":{"1min":0.433,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.84399999999999997,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.77100000000000002}]},{"osd":6,"last update":"Sat Nov 4 01:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63300000000000001,"15min":0.59199999999999997},"min":{"1min":0.41599999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.91500000000000004,"5min":3.7850000000000001,"15min":3.7850000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.58799999999999997,"15min":0.56000000000000005},"min":{"1min":0.41899999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.77200000000000002,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.64000000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28152,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343688,"statfs":{"total":96636764160,"available":96607936512,"internally_reserved":0,"allocated":1159168,"data_stored":570713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.32500000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.67400000000000004,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53200000000000003,"15min":0.53100000000000003},"min":{"1min":0.33100000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75,"5min":0.752,"15min":0.752},"last":0.76400000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.55000000000000004,"15min":0.56200000000000006},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68899999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54500000000000004,"15min":0.55000000000000004},"min":{"1min":0.39500000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.66100000000000003,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.69799999999999995}]},{"osd":2,"last update":"Sat Nov 4 01:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53600000000000003,"15min":0.54000000000000004},"min":{"1min":0.35999999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.68400000000000005,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.63},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.56000000000000005,"15min":0.57399999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.66800000000000004,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.78100000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.72199999999999998,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.41299999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.75900000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.80000000000000004}]},{"osd":4,"last update":"Sat Nov 4 01:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52500000000000002,"15min":0.52000000000000002},"min":{"1min":0.36499999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56200000000000006,"15min":0.57399999999999995},"min":{"1min":0.36699999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73799999999999999,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.53700000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.53900000000000003,"15min":0.56100000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.70599999999999996,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81699999999999995,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.56399999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57599999999999996,"15min":0.57199999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80000000000000004,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.60399999999999998,"15min":0.61699999999999999},"min":{"1min":0.41899999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.74099999999999999,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.61199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1159168,"data_stored":570713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.51300000000000001,"15min":0.505},"min":{"1min":0.33500000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79400000000000004,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.52100000000000002,"15min":0.51100000000000001},"min":{"1min":0.32200000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.84799999999999998,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.48799999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.502,"15min":0.48599999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.81799999999999995,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.61899999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.40799999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.53900000000000003,"15min":0.53700000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.86799999999999999,"5min":0.873,"15min":0.873},"last":0.68100000000000005}]},{"osd":3,"last update":"Sat Nov 4 01:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53900000000000003,"15min":0.53600000000000003},"min":{"1min":0.42999999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.435},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56699999999999995,"15min":0.56599999999999995},"min":{"1min":0.41499999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.75900000000000001,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.66000000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47499999999999998,"15min":0.48099999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.502,"15min":0.50800000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.55000000000000004}]},{"osd":6,"last update":"Sat Nov 4 01:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49199999999999999,"15min":0.497},"min":{"1min":0.34699999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.69299999999999995,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53400000000000003,"15min":0.53700000000000003},"min":{"1min":0.33500000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.46400000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54400000000000004,"15min":0.54700000000000004},"min":{"1min":0.36799999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.441,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.83399999999999996,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.69599999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28152,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343688,"statfs":{"total":96636764160,"available":96607936512,"internally_reserved":0,"allocated":1159168,"data_stored":570713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.314,"15min":0.316},"min":{"1min":0.19800000000000001,"5min":0.186,"15min":0.186},"max":{"1min":0.5,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.33300000000000002,"15min":0.32400000000000001},"min":{"1min":0.28199999999999997,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.45000000000000001,"5min":1.117,"15min":1.117},"last":0.38100000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.36099999999999999,"15min":0.37},"min":{"1min":0.23499999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.55400000000000005,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.40400000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.27400000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.495,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.40799999999999997,"15min":0.42199999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52700000000000002,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.439}]},{"osd":4,"last update":"Sat Nov 4 01:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57199999999999995,"15min":0.58399999999999996},"min":{"1min":0.39500000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73499999999999999,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57599999999999996,"15min":0.58599999999999997},"min":{"1min":0.434,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.52900000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.57099999999999995,"15min":0.58899999999999997},"min":{"1min":0.40799999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71299999999999997,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.57899999999999996,"15min":0.59099999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77900000000000003,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.58299999999999996}]},{"osd":6,"last update":"Sat Nov 4 01:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.41799999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79500000000000004,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.59899999999999998,"15min":0.61299999999999999},"min":{"1min":0.44,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89900000000000002,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.59599999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.61199999999999999,"15min":0.623},"min":{"1min":0.41999999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88200000000000001,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.57399999999999995,"15min":0.58499999999999996},"min":{"1min":0.42399999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73699999999999999,"5min":0.87,"15min":0.87},"last":0.63200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1146880,"data_stored":563027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32000000000000001,"15min":0.32200000000000001},"min":{"1min":0.23699999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.317,"5min":0.34000000000000002,"15min":0.34399999999999997},"min":{"1min":0.224,"5min":0.221,"15min":0.221},"max":{"1min":0.39700000000000002,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.27300000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.35999999999999999,"15min":0.36799999999999999},"min":{"1min":0.26900000000000002,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.41499999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.36199999999999999,"15min":0.374},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.42199999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.372}]},{"osd":3,"last update":"Sat Nov 4 01:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.34200000000000003,"15min":0.35199999999999998},"min":{"1min":0.255,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.41099999999999998,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.40100000000000002,"15min":0.40699999999999997},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.47699999999999998,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.307}]},{"osd":4,"last update":"Sat Nov 4 01:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56100000000000005,"15min":0.54900000000000004},"min":{"1min":0.40100000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.86099999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.63},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.434,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.746,"5min":1.224,"15min":1.224},"last":0.65000000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57499999999999996,"15min":0.56699999999999995},"min":{"1min":0.44600000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81899999999999995,"5min":1.196,"15min":1.196},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.754,"5min":1.25,"15min":1.25},"last":0.69599999999999995}]},{"osd":6,"last update":"Sat Nov 4 01:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.42499999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.73899999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56200000000000006,"15min":0.55500000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.68000000000000005}]},{"osd":7,"last update":"Sat Nov 4 01:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59299999999999997,"15min":0.59699999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.82799999999999996,"5min":1.268,"15min":1.268},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.41499999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.71099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28176,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343664,"statfs":{"total":96636764160,"available":96607911936,"internally_reserved":0,"allocated":1179648,"data_stored":579023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.30099999999999999,"15min":0.30599999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.31,"15min":0.314},"min":{"1min":0.245,"5min":0.218,"15min":0.218},"max":{"1min":0.46899999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.28000000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32500000000000001,"15min":0.33100000000000002},"min":{"1min":0.23100000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.36599999999999999,"15min":0.376},"min":{"1min":0.28399999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.50900000000000001,"5min":0.621,"15min":0.621},"last":0.32900000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.36499999999999999,"15min":0.373},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.53400000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.317},{"interface":"front","average":{"1min":0.376,"5min":0.39500000000000002,"15min":0.40500000000000003},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.35999999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56899999999999995,"15min":0.58699999999999997},"min":{"1min":0.45100000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69499999999999995,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.42199999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72899999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.51800000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.45200000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81200000000000006,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58599999999999997,"15min":0.60299999999999998},"min":{"1min":0.41799999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.753,"5min":0.87,"15min":0.87},"last":0.495}]},{"osd":6,"last update":"Sat Nov 4 01:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55600000000000005,"15min":0.56399999999999995},"min":{"1min":0.40999999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.752,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59099999999999997,"15min":0.60999999999999999},"min":{"1min":0.436,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72799999999999998,"5min":1.129,"15min":1.129},"last":0.57599999999999996}]},{"osd":7,"last update":"Sat Nov 4 01:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.61699999999999999,"15min":0.63300000000000001},"min":{"1min":0.46700000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.72399999999999998,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61499999999999999,"15min":0.629},"min":{"1min":0.40200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76300000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.60199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32892,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338948,"statfs":{"total":96636764160,"available":96603082752,"internally_reserved":0,"allocated":1748992,"data_stored":1160062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:42:53 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.32600000000000001,"15min":0.33200000000000002},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.53200000000000003,"5min":0.874,"15min":0.874},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.374,"15min":0.38800000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.502,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.52900000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:42:53 2023","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.34899999999999998,"15min":0.373},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.38100000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.35499999999999998,"15min":0.372},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.41699999999999998,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.57499999999999996}]},{"osd":3,"last update":"Sat Nov 4 01:42:53 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.34699999999999998,"15min":0.35699999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.46600000000000003,"5min":1.278,"15min":1.278},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.42099999999999999,"15min":0.437},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.52100000000000002,"5min":1.304,"15min":1.304},"last":0.58999999999999997}]},{"osd":4,"last update":"Sat Nov 4 01:42:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.58199999999999996,"15min":0.58699999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76800000000000002,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.622,"15min":0.625},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.82399999999999995,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.85299999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:42:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38400000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73299999999999998,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.58599999999999997,"15min":0.60099999999999998},"min":{"1min":0.373,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.71399999999999997,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.79600000000000004}]},{"osd":6,"last update":"Sat Nov 4 01:42:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.1319999999999999,"5min":1.248,"15min":1.248},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.61499999999999999,"15min":0.626},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73699999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.72399999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:42:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.57899999999999996,"15min":0.58799999999999997},"min":{"1min":0.38300000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78300000000000003,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.872},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.61399999999999999,"15min":0.62},"min":{"1min":0.41199999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.74299999999999999,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.88600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:43:30.249 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T01:43:30.250 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-04T01:43:30.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.384+0000 7f301e2c2640 1 Processor -- start 2023-11-04T01:43:30.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.384+0000 7f301e2c2640 1 -- start start 2023-11-04T01:43:30.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.385+0000 7f301e2c2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f30180b64c0 0x7f30180b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.385+0000 7f301e2c2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f30180cd3b0 0x7f30180cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.385+0000 7f301e2c2640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30180d01f0 con 0x7f301815af20 2023-11-04T01:43:30.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.385+0000 7f301e2c2640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30180cc380 con 0x7f30180cd3b0 2023-11-04T01:43:30.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.385+0000 7f301e2c2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30180cdd80 con 0x7f30180b64c0 2023-11-04T01:43:30.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.385+0000 7f301c85f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f30180cd3b0 0x7f30180cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.385+0000 7f3017fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f301815af20 0x7f30180cbc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:54226/0 (socket says 172.21.15.77:54226) 2023-11-04T01:43:30.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.385+0000 7f3017fff640 1 -- 172.21.15.77:0/4116666649 learned_addr learned my addr 172.21.15.77:0/4116666649 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:30.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.386+0000 7f30177fe640 1 --2- 172.21.15.77:0/4116666649 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f30180b64c0 0x7f30180b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.386+0000 7f301c85f640 1 -- 172.21.15.77:0/4116666649 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f30180b64c0 msgr2=0x7f30180b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:30.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.386+0000 7f301c85f640 1 --2- 172.21.15.77:0/4116666649 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f30180b64c0 0x7f30180b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.386+0000 7f301c85f640 1 -- 172.21.15.77:0/4116666649 >> v1:172.21.15.77:6789/0 conn(0x7f301815af20 legacy=0x7f30180cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.386+0000 7f301c85f640 1 -- 172.21.15.77:0/4116666649 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30180b6a40 con 0x7f30180cd3b0 2023-11-04T01:43:30.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.386+0000 7f3016ffd640 1 -- 172.21.15.77:0/4116666649 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4231572817 0 0) 0x7f30180d01f0 con 0x7f301815af20 2023-11-04T01:43:30.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.386+0000 7f301c85f640 1 --2- 172.21.15.77:0/4116666649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30180cd3b0 0x7f30180cd840 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f3010009dc0 tx=0x7f301002be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e49fd509e03b2de4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:30.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.386+0000 7f3016ffd640 1 -- 172.21.15.77:0/4116666649 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301002cc40 con 0x7f30180cd3b0 2023-11-04T01:43:30.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.387+0000 7f3016ffd640 1 -- 172.21.15.77:0/4116666649 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301002cda0 con 0x7f30180cd3b0 2023-11-04T01:43:30.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.387+0000 7f3016ffd640 1 -- 172.21.15.77:0/4116666649 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3010034660 con 0x7f30180cd3b0 2023-11-04T01:43:30.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.387+0000 7f301e2c2640 1 -- 172.21.15.77:0/4116666649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30180cd3b0 msgr2=0x7f30180cd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.387+0000 7f301e2c2640 1 --2- 172.21.15.77:0/4116666649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30180cd3b0 0x7f30180cd840 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f3010009dc0 tx=0x7f301002be90 comp rx=0 tx=0).stop 2023-11-04T01:43:30.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.387+0000 7f301e2c2640 1 -- 172.21.15.77:0/4116666649 shutdown_connections 2023-11-04T01:43:30.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.387+0000 7f301e2c2640 1 --2- 172.21.15.77:0/4116666649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30180cd3b0 0x7f30180cd840 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.387+0000 7f301e2c2640 1 --2- 172.21.15.77:0/4116666649 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f30180b64c0 0x7f30180b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.387+0000 7f301e2c2640 1 -- 172.21.15.77:0/4116666649 >> 172.21.15.77:0/4116666649 conn(0x7f301806ea20 msgr2=0x7f301806ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:30.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.387+0000 7f301e2c2640 1 -- 172.21.15.77:0/4116666649 shutdown_connections 2023-11-04T01:43:30.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.387+0000 7f301e2c2640 1 -- 172.21.15.77:0/4116666649 wait complete. 2023-11-04T01:43:30.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.388+0000 7f301e2c2640 1 Processor -- start 2023-11-04T01:43:30.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.388+0000 7f301e2c2640 1 -- start start 2023-11-04T01:43:30.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.389+0000 7f301e2c2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f30180b64c0 0x7f30180b05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.389+0000 7f301e2c2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30180cd3b0 0x7f3018150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.389+0000 7f301e2c2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f301815af20 0x7f30180c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.389+0000 7f301e2c2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30181558f0 con 0x7f30180cd3b0 2023-11-04T01:43:30.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.389+0000 7f301e2c2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3018155bd0 con 0x7f301815af20 2023-11-04T01:43:30.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.389+0000 7f301e2c2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3018153c40 con 0x7f30180b64c0 2023-11-04T01:43:30.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.389+0000 7f30177fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30180cd3b0 0x7f3018150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.389+0000 7f30177fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30180cd3b0 0x7f3018150b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35500/0 (socket says 172.21.15.77:35500) 2023-11-04T01:43:30.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.389+0000 7f30177fe640 1 -- 172.21.15.77:0/902752300 learned_addr learned my addr 172.21.15.77:0/902752300 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:30.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.390+0000 7f3017fff640 1 --2- 172.21.15.77:0/902752300 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f30180b64c0 0x7f30180b05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.390+0000 7f301c85f640 1 --2- 172.21.15.77:0/902752300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f301815af20 0x7f30180c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.390+0000 7f30177fe640 1 -- 172.21.15.77:0/902752300 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f30180b64c0 msgr2=0x7f30180b05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.390+0000 7f30177fe640 1 --2- 172.21.15.77:0/902752300 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f30180b64c0 0x7f30180b05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.390+0000 7f30177fe640 1 -- 172.21.15.77:0/902752300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f301815af20 msgr2=0x7f30180c6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.390+0000 7f30177fe640 1 --2- 172.21.15.77:0/902752300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f301815af20 0x7f30180c6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.390+0000 7f30177fe640 1 -- 172.21.15.77:0/902752300 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3010009a70 con 0x7f30180cd3b0 2023-11-04T01:43:30.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.390+0000 7f3017fff640 1 --2- 172.21.15.77:0/902752300 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f30180b64c0 0x7f30180b05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:30.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.390+0000 7f30177fe640 1 --2- 172.21.15.77:0/902752300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30180cd3b0 0x7f3018150b60 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f300c00d800 tx=0x7f300c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:30.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.390+0000 7f3014ff9640 1 -- 172.21.15.77:0/902752300 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300c00b6c0 con 0x7f30180cd3b0 2023-11-04T01:43:30.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.390+0000 7f3014ff9640 1 -- 172.21.15.77:0/902752300 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300c00b820 con 0x7f30180cd3b0 2023-11-04T01:43:30.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.390+0000 7f3014ff9640 1 -- 172.21.15.77:0/902752300 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300c00bbb0 con 0x7f30180cd3b0 2023-11-04T01:43:30.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.390+0000 7f301e2c2640 1 -- 172.21.15.77:0/902752300 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3018153f20 con 0x7f30180cd3b0 2023-11-04T01:43:30.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.390+0000 7f301e2c2640 1 -- 172.21.15.77:0/902752300 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30181510a0 con 0x7f30180cd3b0 2023-11-04T01:43:30.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.391+0000 7f301e2c2640 1 -- 172.21.15.77:0/902752300 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30181512c0 con 0x7f30180cd3b0 2023-11-04T01:43:30.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.391+0000 7f3014ff9640 1 -- 172.21.15.77:0/902752300 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f300c00bd10 con 0x7f30180cd3b0 2023-11-04T01:43:30.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.392+0000 7f3014ff9640 1 --2- 172.21.15.77:0/902752300 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f300406ae70 0x7f300406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.392+0000 7f3014ff9640 1 -- 172.21.15.77:0/902752300 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f300c08a130 con 0x7f30180cd3b0 2023-11-04T01:43:30.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.392+0000 7f3017fff640 1 --2- 172.21.15.77:0/902752300 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f300406ae70 0x7f300406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.392+0000 7f3017fff640 1 --2- 172.21.15.77:0/902752300 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f300406ae70 0x7f300406d330 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f3008000f60 tx=0x7f3008009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:30.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.396+0000 7f3014ff9640 1 -- 172.21.15.77:0/902752300 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f30181512c0 con 0x7f30180cd3b0 2023-11-04T01:43:30.605 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:43:30.608 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:43:30.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.629+0000 7f301e2c2640 1 -- 172.21.15.77:0/902752300 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f30181512c0 con 0x7f30180cd3b0 2023-11-04T01:43:30.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.633+0000 7f3014ff9640 1 -- 172.21.15.77:0/902752300 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+147 (secure 0 0 0) 0x7f30181512c0 con 0x7f30180cd3b0 2023-11-04T01:43:30.635 INFO:teuthology.orchestra.run.smithi077.stdout:[client.0] 2023-11-04T01:43:30.635 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQC2oEVlChU2FxAAt1/aJZOrufjVZhraPqv1Gw== 2023-11-04T01:43:30.636 INFO:teuthology.orchestra.run.smithi077.stdout: caps mds = "allow" 2023-11-04T01:43:30.636 INFO:teuthology.orchestra.run.smithi077.stdout: caps mon = "allow r" 2023-11-04T01:43:30.636 INFO:teuthology.orchestra.run.smithi077.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-04T01:43:30.637 INFO:teuthology.orchestra.run.smithi077.stderr:updated caps for client.0 2023-11-04T01:43:30.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.635+0000 7f301e2c2640 1 -- 172.21.15.77:0/902752300 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f300406ae70 msgr2=0x7f300406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.635+0000 7f301e2c2640 1 --2- 172.21.15.77:0/902752300 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f300406ae70 0x7f300406d330 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f3008000f60 tx=0x7f3008009040 comp rx=0 tx=0).stop 2023-11-04T01:43:30.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.635+0000 7f301e2c2640 1 -- 172.21.15.77:0/902752300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30180cd3b0 msgr2=0x7f3018150b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.635+0000 7f301e2c2640 1 --2- 172.21.15.77:0/902752300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30180cd3b0 0x7f3018150b60 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f300c00d800 tx=0x7f300c00dcc0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.635+0000 7f301e2c2640 1 -- 172.21.15.77:0/902752300 shutdown_connections 2023-11-04T01:43:30.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.635+0000 7f301e2c2640 1 --2- 172.21.15.77:0/902752300 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f300406ae70 0x7f300406d330 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.635+0000 7f301e2c2640 1 --2- 172.21.15.77:0/902752300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f301815af20 0x7f30180c6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.635+0000 7f301e2c2640 1 --2- 172.21.15.77:0/902752300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30180cd3b0 0x7f3018150b60 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.635+0000 7f301e2c2640 1 --2- 172.21.15.77:0/902752300 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f30180b64c0 0x7f30180b05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.635+0000 7f301e2c2640 1 -- 172.21.15.77:0/902752300 >> 172.21.15.77:0/902752300 conn(0x7f301806ea20 msgr2=0x7f30180c9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:30.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.635+0000 7f301e2c2640 1 -- 172.21.15.77:0/902752300 shutdown_connections 2023-11-04T01:43:30.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.635+0000 7f301e2c2640 1 -- 172.21.15.77:0/902752300 wait complete. 2023-11-04T01:43:30.648 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:30.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.795+0000 7fc19f226640 1 Processor -- start 2023-11-04T01:43:30.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.795+0000 7fc19f226640 1 -- start start 2023-11-04T01:43:30.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.795+0000 7fc19f226640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc1980cde60 0x7fc19815d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.795+0000 7fc19f226640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc1980ce240 0x7fc1980d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.795+0000 7fc19f226640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc19815e000 con 0x7fc19815daa0 2023-11-04T01:43:30.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.795+0000 7fc19f226640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc19815e5c0 con 0x7fc1980ce240 2023-11-04T01:43:30.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.795+0000 7fc19f226640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc19815e2e0 con 0x7fc1980cde60 2023-11-04T01:43:30.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.796+0000 7fc197fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc19815daa0 0x7fc198157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:54228/0 (socket says 172.21.15.77:54228) 2023-11-04T01:43:30.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.796+0000 7fc197fff640 1 -- 172.21.15.77:0/603594 learned_addr learned my addr 172.21.15.77:0/603594 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:30.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.796+0000 7fc19cfc2640 1 --2- 172.21.15.77:0/603594 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc1980cde60 0x7fc19815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.796+0000 7fc1977fe640 1 -- 172.21.15.77:0/603594 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3247198468 0 0) 0x7fc19815e000 con 0x7fc19815daa0 2023-11-04T01:43:30.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.796+0000 7fc1977fe640 1 -- 172.21.15.77:0/603594 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc180003520 con 0x7fc19815daa0 2023-11-04T01:43:30.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.796+0000 7fc19d7c3640 1 --2- 172.21.15.77:0/603594 >> v2:172.21.15.122:3300/0 conn(0x7fc1980ce240 0x7fc1980d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.796+0000 7fc1977fe640 1 -- 172.21.15.77:0/603594 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2316497668 0 0) 0x7fc180003520 con 0x7fc19815daa0 2023-11-04T01:43:30.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.796+0000 7fc1977fe640 1 -- 172.21.15.77:0/603594 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc1980cde60 msgr2=0x7fc19815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:30.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.796+0000 7fc1977fe640 1 --2- 172.21.15.77:0/603594 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc1980cde60 0x7fc19815d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.796+0000 7fc1977fe640 1 -- 172.21.15.77:0/603594 >> v2:172.21.15.122:3300/0 conn(0x7fc1980ce240 msgr2=0x7fc1980d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:30.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.796+0000 7fc1977fe640 1 --2- 172.21.15.77:0/603594 >> v2:172.21.15.122:3300/0 conn(0x7fc1980ce240 0x7fc1980d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.796+0000 7fc1977fe640 1 -- 172.21.15.77:0/603594 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1980d1120 con 0x7fc19815daa0 2023-11-04T01:43:30.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.796+0000 7fc1977fe640 1 -- 172.21.15.77:0/603594 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7fc18c001670 con 0x7fc19815daa0 2023-11-04T01:43:30.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.796+0000 7fc1977fe640 1 -- 172.21.15.77:0/603594 >> v1:172.21.15.77:6789/0 conn(0x7fc19815daa0 legacy=0x7fc198157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.796+0000 7fc1977fe640 1 --2- 172.21.15.77:0/603594 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc180003970 0x7fc180003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.796+0000 7fc1977fe640 1 --2- 172.21.15.77:0/603594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1800047c0 0x7fc180004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.796+0000 7fc1977fe640 1 --2- 172.21.15.77:0/603594 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc1980cde60 0x7fc180005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.796+0000 7fc1977fe640 1 -- 172.21.15.77:0/603594 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19815e5c0 con 0x7fc1800047c0 2023-11-04T01:43:30.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.796+0000 7fc1977fe640 1 -- 172.21.15.77:0/603594 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19815e2e0 con 0x7fc180003970 2023-11-04T01:43:30.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.796+0000 7fc1977fe640 1 -- 172.21.15.77:0/603594 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc18000b980 con 0x7fc1980cde60 2023-11-04T01:43:30.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.796+0000 7fc197fff640 1 --2- 172.21.15.77:0/603594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1800047c0 0x7fc180004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.796+0000 7fc19cfc2640 1 --2- 172.21.15.77:0/603594 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc180003970 0x7fc180003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.796+0000 7fc19d7c3640 1 --2- 172.21.15.77:0/603594 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc1980cde60 0x7fc180005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.797+0000 7fc197fff640 1 -- 172.21.15.77:0/603594 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc1980cde60 msgr2=0x7fc180005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:30.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.797+0000 7fc197fff640 1 --2- 172.21.15.77:0/603594 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc1980cde60 0x7fc180005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.797+0000 7fc197fff640 1 -- 172.21.15.77:0/603594 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc180003970 msgr2=0x7fc180003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:30.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.797+0000 7fc197fff640 1 --2- 172.21.15.77:0/603594 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc180003970 0x7fc180003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.797+0000 7fc197fff640 1 -- 172.21.15.77:0/603594 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc180003520 con 0x7fc1800047c0 2023-11-04T01:43:30.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.797+0000 7fc19d7c3640 1 --2- 172.21.15.77:0/603594 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc1980cde60 0x7fc180005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:30.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.797+0000 7fc197fff640 1 --2- 172.21.15.77:0/603594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1800047c0 0x7fc180004c40 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fc18c00c210 tx=0x7fc1800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daa8a1367f40ee08 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:30.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.797+0000 7fc1977fe640 1 -- 172.21.15.77:0/603594 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18c02cb00 con 0x7fc1800047c0 2023-11-04T01:43:30.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.797+0000 7fc1977fe640 1 -- 172.21.15.77:0/603594 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18c02cc60 con 0x7fc1800047c0 2023-11-04T01:43:30.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.797+0000 7fc1977fe640 1 -- 172.21.15.77:0/603594 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18c0058d0 con 0x7fc1800047c0 2023-11-04T01:43:30.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.798+0000 7fc19f226640 1 -- 172.21.15.77:0/603594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1800047c0 msgr2=0x7fc180004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.798+0000 7fc19f226640 1 --2- 172.21.15.77:0/603594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1800047c0 0x7fc180004c40 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fc18c00c210 tx=0x7fc1800057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.798+0000 7fc19d7c3640 1 -- 172.21.15.77:0/603594 reap_dead start 2023-11-04T01:43:30.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.798+0000 7fc19f226640 1 -- 172.21.15.77:0/603594 shutdown_connections 2023-11-04T01:43:30.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.798+0000 7fc19f226640 1 -- 172.21.15.77:0/603594 >> 172.21.15.77:0/603594 conn(0x7fc198071f30 msgr2=0x7fc1980cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:30.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.798+0000 7fc19f226640 1 -- 172.21.15.77:0/603594 shutdown_connections 2023-11-04T01:43:30.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.798+0000 7fc19f226640 1 -- 172.21.15.77:0/603594 wait complete. 2023-11-04T01:43:30.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.799+0000 7fc19f226640 1 Processor -- start 2023-11-04T01:43:30.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.799+0000 7fc19f226640 1 -- start start 2023-11-04T01:43:30.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.800+0000 7fc19f226640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1800047c0 0x7fc19814b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.800+0000 7fc19f226640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc19815ab10 0x7fc198154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.800+0000 7fc19f226640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1981548c0 0x7fc198158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.800+0000 7fc19f226640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc198154d50 con 0x7fc1800047c0 2023-11-04T01:43:30.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.800+0000 7fc19f226640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc198159a70 con 0x7fc1981548c0 2023-11-04T01:43:30.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.800+0000 7fc19f226640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc198159d50 con 0x7fc19815ab10 2023-11-04T01:43:30.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.800+0000 7fc19cfc2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1800047c0 0x7fc19814b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.800+0000 7fc19cfc2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1800047c0 0x7fc19814b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35514/0 (socket says 172.21.15.77:35514) 2023-11-04T01:43:30.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.800+0000 7fc19cfc2640 1 -- 172.21.15.77:0/2229940778 learned_addr learned my addr 172.21.15.77:0/2229940778 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:30.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.800+0000 7fc197fff640 1 --2- 172.21.15.77:0/2229940778 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc19815ab10 0x7fc198154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.800+0000 7fc19cfc2640 1 -- 172.21.15.77:0/2229940778 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc19815ab10 msgr2=0x7fc198154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.800+0000 7fc19cfc2640 1 --2- 172.21.15.77:0/2229940778 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc19815ab10 0x7fc198154380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.800+0000 7fc19cfc2640 1 -- 172.21.15.77:0/2229940778 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1981548c0 msgr2=0x7fc198158d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.800+0000 7fc19cfc2640 1 --2- 172.21.15.77:0/2229940778 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1981548c0 0x7fc198158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.800+0000 7fc19cfc2640 1 -- 172.21.15.77:0/2229940778 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc19815a030 con 0x7fc1800047c0 2023-11-04T01:43:30.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.800+0000 7fc19cfc2640 1 --2- 172.21.15.77:0/2229940778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1800047c0 0x7fc19814b3d0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fc190009f90 tx=0x7fc19000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:30.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.801+0000 7fc1957fa640 1 -- 172.21.15.77:0/2229940778 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19000e040 con 0x7fc1800047c0 2023-11-04T01:43:30.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.801+0000 7fc1957fa640 1 -- 172.21.15.77:0/2229940778 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19000f040 con 0x7fc1800047c0 2023-11-04T01:43:30.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.801+0000 7fc19f226640 1 -- 172.21.15.77:0/2229940778 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc19815a310 con 0x7fc1800047c0 2023-11-04T01:43:30.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.801+0000 7fc1957fa640 1 -- 172.21.15.77:0/2229940778 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc190015650 con 0x7fc1800047c0 2023-11-04T01:43:30.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.801+0000 7fc19f226640 1 -- 172.21.15.77:0/2229940778 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc19814b910 con 0x7fc1800047c0 2023-11-04T01:43:30.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.801+0000 7fc19f226640 1 -- 172.21.15.77:0/2229940778 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc198074290 con 0x7fc1800047c0 2023-11-04T01:43:30.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.802+0000 7fc1957fa640 1 -- 172.21.15.77:0/2229940778 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc1900157b0 con 0x7fc1800047c0 2023-11-04T01:43:30.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.802+0000 7fc1957fa640 1 --2- 172.21.15.77:0/2229940778 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc18406ae70 0x7fc18406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.802+0000 7fc1957fa640 1 -- 172.21.15.77:0/2229940778 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fc19008a730 con 0x7fc1800047c0 2023-11-04T01:43:30.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.803+0000 7fc197fff640 1 --2- 172.21.15.77:0/2229940778 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc18406ae70 0x7fc18406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.803+0000 7fc197fff640 1 --2- 172.21.15.77:0/2229940778 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc18406ae70 0x7fc18406d330 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc18c034000 tx=0x7fc18c037040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:30.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:30.807+0000 7fc1957fa640 1 -- 172.21.15.77:0/2229940778 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc1900552f0 con 0x7fc1800047c0 2023-11-04T01:43:31.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.007+0000 7fc19f226640 1 -- 172.21.15.77:0/2229940778 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1980d2b10 con 0x7fc1800047c0 2023-11-04T01:43:31.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.008+0000 7fc1957fa640 1 -- 172.21.15.77:0/2229940778 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4924 (secure 0 0 0) 0x7fc190058910 con 0x7fc1800047c0 2023-11-04T01:43:31.010 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:43:31.010 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":43,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7302,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/4241784871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4241784871},{"type":"v1","addr":"172.21.15.77:6834","nonce":4241784871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7305,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:43:28.280821+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":35690},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35690":{"gid":35690,"name":"b","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6836/3699147778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":3699147778},{"type":"v1","addr":"172.21.15.122:6836","nonce":3699147778}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:31.011 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 43 2023-11-04T01:43:31.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.009+0000 7fc19f226640 1 -- 172.21.15.77:0/2229940778 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc18406ae70 msgr2=0x7fc18406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.009+0000 7fc19f226640 1 --2- 172.21.15.77:0/2229940778 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc18406ae70 0x7fc18406d330 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc18c034000 tx=0x7fc18c037040 comp rx=0 tx=0).stop 2023-11-04T01:43:31.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.009+0000 7fc19f226640 1 -- 172.21.15.77:0/2229940778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1800047c0 msgr2=0x7fc19814b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.009+0000 7fc19f226640 1 --2- 172.21.15.77:0/2229940778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1800047c0 0x7fc19814b3d0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fc190009f90 tx=0x7fc19000f580 comp rx=0 tx=0).stop 2023-11-04T01:43:31.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.009+0000 7fc19f226640 1 -- 172.21.15.77:0/2229940778 shutdown_connections 2023-11-04T01:43:31.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.009+0000 7fc19f226640 1 --2- 172.21.15.77:0/2229940778 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc18406ae70 0x7fc18406d330 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.009+0000 7fc19f226640 1 --2- 172.21.15.77:0/2229940778 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1981548c0 0x7fc198158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.009+0000 7fc19f226640 1 --2- 172.21.15.77:0/2229940778 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc19815ab10 0x7fc198154380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.009+0000 7fc19f226640 1 --2- 172.21.15.77:0/2229940778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1800047c0 0x7fc19814b3d0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.009+0000 7fc19f226640 1 -- 172.21.15.77:0/2229940778 >> 172.21.15.77:0/2229940778 conn(0x7fc198071f30 msgr2=0x7fc1980c9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:31.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.010+0000 7fc19f226640 1 -- 172.21.15.77:0/2229940778 shutdown_connections 2023-11-04T01:43:31.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.010+0000 7fc19f226640 1 -- 172.21.15.77:0/2229940778 wait complete. 2023-11-04T01:43:31.424 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 43, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:43:26.273417+0000', 'modified': '2023-11-04T01:43:28.280821+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 35690}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_35690': {'gid': 35690, 'name': 'b', 'rank': 0, 'incarnation': 41, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.122:6836/3699147778', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6834', 'nonce': 3699147778}, {'type': 'v1', 'addr': '172.21.15.122:6836', 'nonce': 3699147778}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:43:31.425 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:43:31.425 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-04T01:43:31.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.528+0000 7f953e826640 1 Processor -- start 2023-11-04T01:43:31.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.528+0000 7f953e826640 1 -- start start 2023-11-04T01:43:31.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.528+0000 7f953e826640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9538153e60 0x7f953815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.528+0000 7f953e826640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f95380b4880 0x7f95380b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.528+0000 7f953e826640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95380cde60 con 0x7f95380cd6d0 2023-11-04T01:43:31.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.528+0000 7f953e826640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95380b5230 con 0x7f95380b4880 2023-11-04T01:43:31.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.528+0000 7f953e826640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9538160f90 con 0x7f9538153e60 2023-11-04T01:43:31.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.529+0000 7f9537fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9538153e60 0x7f953815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.529+0000 7f953cdc3640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f95380b4880 0x7f95380b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.529+0000 7f95377fe640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f95380cd6d0 0x7f9538161420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:44892/0 (socket says 172.21.15.77:44892) 2023-11-04T01:43:31.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.529+0000 7f95377fe640 1 -- 172.21.15.77:0/3319638429 learned_addr learned my addr 172.21.15.77:0/3319638429 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:31.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.529+0000 7f9536ffd640 1 -- 172.21.15.77:0/3319638429 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3599265503 0 0) 0x7f95380cde60 con 0x7f95380cd6d0 2023-11-04T01:43:31.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.529+0000 7f9537fff640 1 -- 172.21.15.77:0/3319638429 >> v2:172.21.15.122:3300/0 conn(0x7f95380b4880 msgr2=0x7f95380b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:31.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.529+0000 7f9537fff640 1 --2- 172.21.15.77:0/3319638429 >> v2:172.21.15.122:3300/0 conn(0x7f95380b4880 0x7f95380b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.529+0000 7f9537fff640 1 -- 172.21.15.77:0/3319638429 >> v1:172.21.15.122:6789/0 conn(0x7f95380cd6d0 legacy=0x7f9538161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.529+0000 7f9537fff640 1 -- 172.21.15.77:0/3319638429 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f953815e400 con 0x7f9538153e60 2023-11-04T01:43:31.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.530+0000 7f9537fff640 1 --2- 172.21.15.77:0/3319638429 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9538153e60 0x7f953815dec0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f952c0097a0 tx=0x7f952c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6f2f234742e4da6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:31.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.530+0000 7f9536ffd640 1 -- 172.21.15.77:0/3319638429 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952c031830 con 0x7f9538153e60 2023-11-04T01:43:31.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.530+0000 7f9536ffd640 1 -- 172.21.15.77:0/3319638429 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952c031990 con 0x7f9538153e60 2023-11-04T01:43:31.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.530+0000 7f9536ffd640 1 -- 172.21.15.77:0/3319638429 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952c031d20 con 0x7f9538153e60 2023-11-04T01:43:31.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.531+0000 7f953e826640 1 -- 172.21.15.77:0/3319638429 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9538153e60 msgr2=0x7f953815dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.531+0000 7f953e826640 1 --2- 172.21.15.77:0/3319638429 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9538153e60 0x7f953815dec0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f952c0097a0 tx=0x7f952c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.531+0000 7f953e826640 1 -- 172.21.15.77:0/3319638429 shutdown_connections 2023-11-04T01:43:31.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.531+0000 7f953e826640 1 --2- 172.21.15.77:0/3319638429 >> v2:172.21.15.122:3300/0 conn(0x7f95380b4880 0x7f95380b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.531+0000 7f953e826640 1 --2- 172.21.15.77:0/3319638429 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9538153e60 0x7f953815dec0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.531+0000 7f953e826640 1 -- 172.21.15.77:0/3319638429 >> 172.21.15.77:0/3319638429 conn(0x7f95380cf880 msgr2=0x7f95380cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:31.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.531+0000 7f953e826640 1 -- 172.21.15.77:0/3319638429 shutdown_connections 2023-11-04T01:43:31.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.531+0000 7f953e826640 1 -- 172.21.15.77:0/3319638429 wait complete. 2023-11-04T01:43:31.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.532+0000 7f953e826640 1 Processor -- start 2023-11-04T01:43:31.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.532+0000 7f953e826640 1 -- start start 2023-11-04T01:43:31.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.533+0000 7f953e826640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95380b4880 0x7f95381f3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.533+0000 7f953e826640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f95380cd6d0 0x7f953815e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.533+0000 7f953e826640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9538153e60 0x7f953815eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.533+0000 7f953e826640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95381f38c0 con 0x7f95380b4880 2023-11-04T01:43:31.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.533+0000 7f953e826640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95381f3300 con 0x7f9538153e60 2023-11-04T01:43:31.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.533+0000 7f953e826640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95381f35e0 con 0x7f95380cd6d0 2023-11-04T01:43:31.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.533+0000 7f9537fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95380b4880 0x7f95381f3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.533+0000 7f9537fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95380b4880 0x7f95381f3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35530/0 (socket says 172.21.15.77:35530) 2023-11-04T01:43:31.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.533+0000 7f9537fff640 1 -- 172.21.15.77:0/867369483 learned_addr learned my addr 172.21.15.77:0/867369483 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:31.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.533+0000 7f95377fe640 1 --2- 172.21.15.77:0/867369483 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f95380cd6d0 0x7f953815e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.533+0000 7f953cdc3640 1 --2- 172.21.15.77:0/867369483 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9538153e60 0x7f953815eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.533+0000 7f9537fff640 1 -- 172.21.15.77:0/867369483 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f95380cd6d0 msgr2=0x7f953815e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.533+0000 7f9537fff640 1 --2- 172.21.15.77:0/867369483 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f95380cd6d0 0x7f953815e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.533+0000 7f9537fff640 1 -- 172.21.15.77:0/867369483 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9538153e60 msgr2=0x7f953815eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.533+0000 7f9537fff640 1 --2- 172.21.15.77:0/867369483 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9538153e60 0x7f953815eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.533+0000 7f9537fff640 1 -- 172.21.15.77:0/867369483 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f952c009400 con 0x7f95380b4880 2023-11-04T01:43:31.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.533+0000 7f953cdc3640 1 --2- 172.21.15.77:0/867369483 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9538153e60 0x7f953815eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:31.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.533+0000 7f9537fff640 1 --2- 172.21.15.77:0/867369483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95380b4880 0x7f95381f3aa0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f952c000c00 tx=0x7f952c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:31.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.533+0000 7f9534ff9640 1 -- 172.21.15.77:0/867369483 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952c004230 con 0x7f95380b4880 2023-11-04T01:43:31.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.534+0000 7f9534ff9640 1 -- 172.21.15.77:0/867369483 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952c0043b0 con 0x7f95380b4880 2023-11-04T01:43:31.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.534+0000 7f9534ff9640 1 -- 172.21.15.77:0/867369483 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952c004520 con 0x7f95380b4880 2023-11-04T01:43:31.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.534+0000 7f953e826640 1 -- 172.21.15.77:0/867369483 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9538154370 con 0x7f95380b4880 2023-11-04T01:43:31.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.534+0000 7f953e826640 1 -- 172.21.15.77:0/867369483 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95380c9180 con 0x7f95380b4880 2023-11-04T01:43:31.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.535+0000 7f9534ff9640 1 -- 172.21.15.77:0/867369483 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f952c03a870 con 0x7f95380b4880 2023-11-04T01:43:31.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.536+0000 7f9534ff9640 1 --2- 172.21.15.77:0/867369483 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f952406ae70 0x7f952406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.536+0000 7f9534ff9640 1 -- 172.21.15.77:0/867369483 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f952c0abc20 con 0x7f95380b4880 2023-11-04T01:43:31.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.536+0000 7f95377fe640 1 --2- 172.21.15.77:0/867369483 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f952406ae70 0x7f952406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.536+0000 7f95413b8740 1 Processor -- start 2023-11-04T01:43:31.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.537+0000 7f95413b8740 1 -- start start 2023-11-04T01:43:31.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.537+0000 7f95377fe640 1 --2- 172.21.15.77:0/867369483 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f952406ae70 0x7f952406d330 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9528000f60 tx=0x7f9528007b50 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:31.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.537+0000 7f95413b8740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cb455e850 0x563cb4531750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.537+0000 7f95413b8740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x563cb455ec30 0x563cb45615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.537+0000 7f95413b8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563cb4531c90 0x563cb4561b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.537+0000 7f95413b8740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cb4442740 con 0x563cb455e850 2023-11-04T01:43:31.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.537+0000 7f95413b8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cb44a48d0 con 0x563cb4531c90 2023-11-04T01:43:31.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.537+0000 7f95413b8740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x563cb44a1fc0 con 0x563cb455ec30 2023-11-04T01:43:31.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.537+0000 7f9537fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cb455e850 0x563cb4531750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.537+0000 7f9537fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cb455e850 0x563cb4531750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35544/0 (socket says 172.21.15.77:35544) 2023-11-04T01:43:31.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.537+0000 7f9537fff640 1 -- 172.21.15.77:0/2933406020 learned_addr learned my addr 172.21.15.77:0/2933406020 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:31.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.537+0000 7f95377fe640 1 --2- 172.21.15.77:0/2933406020 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x563cb455ec30 0x563cb45615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.537+0000 7f953cdc3640 1 --2- 172.21.15.77:0/2933406020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563cb4531c90 0x563cb4561b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.538+0000 7f9537fff640 1 -- 172.21.15.77:0/2933406020 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x563cb455ec30 msgr2=0x563cb45615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:31.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.538+0000 7f9537fff640 1 --2- 172.21.15.77:0/2933406020 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x563cb455ec30 0x563cb45615e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.538+0000 7f9537fff640 1 -- 172.21.15.77:0/2933406020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563cb4531c90 msgr2=0x563cb4561b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:31.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.538+0000 7f9537fff640 1 --2- 172.21.15.77:0/2933406020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563cb4531c90 0x563cb4561b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.538+0000 7f9537fff640 1 -- 172.21.15.77:0/2933406020 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563cb4460ca0 con 0x563cb455e850 2023-11-04T01:43:31.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.538+0000 7f953cdc3640 1 --2- 172.21.15.77:0/2933406020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563cb4531c90 0x563cb4561b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:31.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.538+0000 7f9537fff640 1 --2- 172.21.15.77:0/2933406020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cb455e850 0x563cb4531750 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f952c034040 tx=0x7f952c07ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba60edc979dde7f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:31.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.538+0000 7f951dffb640 1 -- 172.21.15.77:0/2933406020 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952c07e5f0 con 0x563cb455e850 2023-11-04T01:43:31.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.538+0000 7f951dffb640 1 -- 172.21.15.77:0/2933406020 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952c0827a0 con 0x563cb455e850 2023-11-04T01:43:31.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.538+0000 7f951dffb640 1 -- 172.21.15.77:0/2933406020 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952c076bb0 con 0x563cb455e850 2023-11-04T01:43:31.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.538+0000 7f95413b8740 1 -- 172.21.15.77:0/2933406020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cb455e850 msgr2=0x563cb4531750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.538+0000 7f95413b8740 1 --2- 172.21.15.77:0/2933406020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cb455e850 0x563cb4531750 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f952c034040 tx=0x7f952c07ac60 comp rx=0 tx=0).stop 2023-11-04T01:43:31.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.538+0000 7f95413b8740 1 -- 172.21.15.77:0/2933406020 shutdown_connections 2023-11-04T01:43:31.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.538+0000 7f95413b8740 1 --2- 172.21.15.77:0/2933406020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563cb4531c90 0x563cb4561b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.538+0000 7f95413b8740 1 --2- 172.21.15.77:0/2933406020 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x563cb455ec30 0x563cb45615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.538+0000 7f95413b8740 1 --2- 172.21.15.77:0/2933406020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cb455e850 0x563cb4531750 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.538+0000 7f95413b8740 1 -- 172.21.15.77:0/2933406020 >> 172.21.15.77:0/2933406020 conn(0x563cb4533a60 msgr2=0x563cb457c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:31.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.538+0000 7f95413b8740 1 -- 172.21.15.77:0/2933406020 shutdown_connections 2023-11-04T01:43:31.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.539+0000 7f95413b8740 1 -- 172.21.15.77:0/2933406020 wait complete. 2023-11-04T01:43:31.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.539+0000 7f95413b8740 1 -- start start 2023-11-04T01:43:31.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.539+0000 7f95413b8740 1 Processor -- start 2023-11-04T01:43:31.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.540+0000 7f95413b8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563cb455e850 0x563cb454ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.540+0000 7f95413b8740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cb455ec30 0x563cb45651d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.540+0000 7f95413b8740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x563cb458c190 0x563cb4564250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.540+0000 7f95413b8740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cb449d8b0 con 0x563cb455ec30 2023-11-04T01:43:31.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.540+0000 7f95413b8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cb4457c80 con 0x563cb455e850 2023-11-04T01:43:31.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.540+0000 7f95413b8740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x563cb4457920 con 0x563cb458c190 2023-11-04T01:43:31.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.540+0000 7f95413b8740 10 client.0 _ll_register_callbacks cb 0x563cb41afac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:43:31.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.540+0000 7f95377fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cb455ec30 0x563cb45651d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.540+0000 7f95377fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cb455ec30 0x563cb45651d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35560/0 (socket says 172.21.15.77:35560) 2023-11-04T01:43:31.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.540+0000 7f95377fe640 1 -- 172.21.15.77:0/3969685359 learned_addr learned my addr 172.21.15.77:0/3969685359 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:31.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.540+0000 7f953cdc3640 1 --2- 172.21.15.77:0/3969685359 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x563cb458c190 0x563cb4564250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.540+0000 7f9537fff640 1 --2- 172.21.15.77:0/3969685359 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563cb455e850 0x563cb454ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.540+0000 7f95377fe640 1 -- 172.21.15.77:0/3969685359 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x563cb458c190 msgr2=0x563cb4564250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:31.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.540+0000 7f95377fe640 1 --2- 172.21.15.77:0/3969685359 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x563cb458c190 0x563cb4564250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.540+0000 7f95377fe640 1 -- 172.21.15.77:0/3969685359 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563cb455e850 msgr2=0x563cb454ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:31.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.540+0000 7f95377fe640 1 --2- 172.21.15.77:0/3969685359 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563cb455e850 0x563cb454ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.540+0000 7f95377fe640 1 -- 172.21.15.77:0/3969685359 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95380c9180 con 0x563cb455ec30 2023-11-04T01:43:31.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.540+0000 7f9537fff640 1 --2- 172.21.15.77:0/3969685359 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563cb455e850 0x563cb454ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:31.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.541+0000 7f95377fe640 1 --2- 172.21.15.77:0/3969685359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cb455ec30 0x563cb45651d0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f9528001c90 tx=0x7f9528000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c55346faa8003 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:31.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.541+0000 7f9516ffd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:43:31.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.541+0000 7f9516ffd640 1 -- 172.21.15.77:0/3969685359 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9528001d80 con 0x563cb455ec30 2023-11-04T01:43:31.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.541+0000 7f9516ffd640 1 -- 172.21.15.77:0/3969685359 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f9528012590 con 0x563cb455ec30 2023-11-04T01:43:31.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.541+0000 7f95413b8740 1 -- 172.21.15.77:0/3969685359 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563cb4449bf0 con 0x563cb455ec30 2023-11-04T01:43:31.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.541+0000 7f9516ffd640 1 -- 172.21.15.77:0/3969685359 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9528012750 con 0x563cb455ec30 2023-11-04T01:43:31.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.541+0000 7f95413b8740 10 client.7467 fetch_fsmap learned FSMap version 43 2023-11-04T01:43:31.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.541+0000 7f95413b8740 1 -- 172.21.15.77:0/3969685359 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x563cb449bf30 con 0x563cb455ec30 2023-11-04T01:43:31.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.541+0000 7f9516ffd640 1 -- 172.21.15.77:0/3969685359 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563cb4449bf0 con 0x563cb455ec30 2023-11-04T01:43:31.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.541+0000 7f9516ffd640 1 -- 172.21.15.77:0/3969685359 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 43) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9528020070 con 0x563cb455ec30 2023-11-04T01:43:31.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.541+0000 7f95413b8740 10 client.7467 fetch_fsmap finished waiting for FSMap version 43 2023-11-04T01:43:31.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.541+0000 7f95413b8740 10 client.7467 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:43:31.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.541+0000 7f95413b8740 20 client.7467 populate_metadata read hostname 'smithi077' 2023-11-04T01:43:31.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.541+0000 7f95413b8740 1 --2- 172.21.15.77:0/3969685359 >> [v2:172.21.15.122:6834/3699147778,v1:172.21.15.122:6836/3699147778] conn(0x563cb45978f0 0x563cb4599ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.541+0000 7f95413b8740 4 client.7467 mds_command: new command op to 35690 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:43:31.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.541+0000 7f95413b8740 1 -- 172.21.15.77:0/3969685359 --> [v2:172.21.15.122:6834/3699147778,v1:172.21.15.122:6836/3699147778] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563cb4496890 con 0x563cb45978f0 2023-11-04T01:43:31.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.541+0000 7f9537fff640 1 --2- 172.21.15.77:0/3969685359 >> [v2:172.21.15.122:6834/3699147778,v1:172.21.15.122:6836/3699147778] conn(0x563cb45978f0 0x563cb4599ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.542+0000 7f9516ffd640 10 client.7467 ms_handle_connect on v2:172.21.15.122:6834/3699147778 2023-11-04T01:43:31.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.542+0000 7f9537fff640 1 --2- 172.21.15.77:0/3969685359 >> [v2:172.21.15.122:6834/3699147778,v1:172.21.15.122:6836/3699147778] conn(0x563cb45978f0 0x563cb4599ce0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25efcca82d0bcac6 server_cookie=1717ebdbea9c1aef in_seq=0 out_seq=0 2023-11-04T01:43:31.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.542+0000 7f9516ffd640 1 -- 172.21.15.77:0/3969685359 <== mds.0 v2:172.21.15.122:6834/3699147778 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563cb4496890 con 0x563cb45978f0 2023-11-04T01:43:31.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.542+0000 7f9516ffd640 10 client.7467 handle_command_reply: tid=0 2023-11-04T01:43:31.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.542+0000 7f95413b8740 1 client.7467 shutdown 2023-11-04T01:43:31.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.543+0000 7f95413b8740 1 -- 172.21.15.77:0/3969685359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cb455ec30 msgr2=0x563cb45651d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.543+0000 7f95413b8740 1 --2- 172.21.15.77:0/3969685359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cb455ec30 0x563cb45651d0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f9528001c90 tx=0x7f9528000ed0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.543+0000 7f95413b8740 1 -- 172.21.15.77:0/3969685359 shutdown_connections 2023-11-04T01:43:31.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.543+0000 7f95413b8740 1 --2- 172.21.15.77:0/3969685359 >> [v2:172.21.15.122:6834/3699147778,v1:172.21.15.122:6836/3699147778] conn(0x563cb45978f0 0x563cb4599ce0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.543+0000 7f95413b8740 1 --2- 172.21.15.77:0/3969685359 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x563cb458c190 0x563cb4564250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.543+0000 7f95413b8740 1 --2- 172.21.15.77:0/3969685359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cb455ec30 0x563cb45651d0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.543+0000 7f95413b8740 1 --2- 172.21.15.77:0/3969685359 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563cb455e850 0x563cb454ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.543+0000 7f95413b8740 1 -- 172.21.15.77:0/3969685359 >> 172.21.15.77:0/3969685359 conn(0x563cb4531c90 msgr2=0x563cb4580480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:31.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.543+0000 7f9516ffd640 0 client.7467 ms_handle_reset on v2:172.21.15.122:6834/3699147778 2023-11-04T01:43:31.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.543+0000 7f95413b8740 1 -- 172.21.15.77:0/3969685359 shutdown_connections 2023-11-04T01:43:31.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.543+0000 7f95413b8740 1 -- 172.21.15.77:0/3969685359 wait complete. 2023-11-04T01:43:31.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.543+0000 7f95413b8740 20 client.7467 trim_cache size 0 max 16384 2023-11-04T01:43:31.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.558+0000 7f95413b8740 1 Processor -- start 2023-11-04T01:43:31.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.558+0000 7f95413b8740 1 -- start start 2023-11-04T01:43:31.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.559+0000 7f95413b8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563cb455e850 0x563cb459e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.559+0000 7f95413b8740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x563cb455ec30 0x563cb4565060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.559+0000 7f95413b8740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cb458c190 0x563cb4535250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.559+0000 7f95413b8740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cb4536350 con 0x563cb458c190 2023-11-04T01:43:31.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.559+0000 7f95413b8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cb441d280 con 0x563cb455e850 2023-11-04T01:43:31.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.559+0000 7f95413b8740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x563cb4535df0 con 0x563cb455ec30 2023-11-04T01:43:31.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.559+0000 7f953cdc3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cb458c190 0x563cb4535250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.559+0000 7f953cdc3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cb458c190 0x563cb4535250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35572/0 (socket says 172.21.15.77:35572) 2023-11-04T01:43:31.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.559+0000 7f953cdc3640 1 -- 172.21.15.77:0/3077956484 learned_addr learned my addr 172.21.15.77:0/3077956484 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:31.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.559+0000 7f953cdc3640 1 -- 172.21.15.77:0/3077956484 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x563cb455ec30 msgr2=0x563cb4565060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:31.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.559+0000 7f953cdc3640 1 --2- 172.21.15.77:0/3077956484 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x563cb455ec30 0x563cb4565060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.559+0000 7f953cdc3640 1 -- 172.21.15.77:0/3077956484 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563cb455e850 msgr2=0x563cb459e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:31.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.559+0000 7f953cdc3640 1 --2- 172.21.15.77:0/3077956484 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563cb455e850 0x563cb459e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.559+0000 7f953cdc3640 1 -- 172.21.15.77:0/3077956484 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563cb4439d10 con 0x563cb458c190 2023-11-04T01:43:31.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.559+0000 7f953cdc3640 1 --2- 172.21.15.77:0/3077956484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cb458c190 0x563cb4535250 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f95300076e0 tx=0x7f9530009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=602d4e33fc1ea048 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:31.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.559+0000 7f951e7fc640 1 -- 172.21.15.77:0/3077956484 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95300146c0 con 0x563cb458c190 2023-11-04T01:43:31.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.559+0000 7f951e7fc640 1 -- 172.21.15.77:0/3077956484 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f953000f050 con 0x563cb458c190 2023-11-04T01:43:31.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.559+0000 7f951e7fc640 1 -- 172.21.15.77:0/3077956484 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9530014a20 con 0x563cb458c190 2023-11-04T01:43:31.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.560+0000 7f95413b8740 1 -- 172.21.15.77:0/3077956484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cb458c190 msgr2=0x563cb4535250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.560+0000 7f95413b8740 1 --2- 172.21.15.77:0/3077956484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cb458c190 0x563cb4535250 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f95300076e0 tx=0x7f9530009750 comp rx=0 tx=0).stop 2023-11-04T01:43:31.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.560+0000 7f95413b8740 1 -- 172.21.15.77:0/3077956484 shutdown_connections 2023-11-04T01:43:31.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.560+0000 7f95413b8740 1 --2- 172.21.15.77:0/3077956484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cb458c190 0x563cb4535250 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.560+0000 7f95413b8740 1 --2- 172.21.15.77:0/3077956484 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x563cb455ec30 0x563cb4565060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.560+0000 7f95413b8740 1 --2- 172.21.15.77:0/3077956484 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563cb455e850 0x563cb459e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.560+0000 7f95413b8740 1 -- 172.21.15.77:0/3077956484 >> 172.21.15.77:0/3077956484 conn(0x563cb4531c90 msgr2=0x563cb45388f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:31.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.560+0000 7f95413b8740 1 -- 172.21.15.77:0/3077956484 shutdown_connections 2023-11-04T01:43:31.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.560+0000 7f95413b8740 1 -- 172.21.15.77:0/3077956484 wait complete. 2023-11-04T01:43:31.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.560+0000 7f95413b8740 1 -- start start 2023-11-04T01:43:31.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.561+0000 7f95413b8740 1 Processor -- start 2023-11-04T01:43:31.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.561+0000 7f95413b8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563cb455e850 0x563cb45e5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.561+0000 7f95413b8740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x563cb455ec30 0x563cb45351e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.561+0000 7f95413b8740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cb458c190 0x563cb4535720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.561+0000 7f95413b8740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cb4560d60 con 0x563cb458c190 2023-11-04T01:43:31.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.561+0000 7f95413b8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cb457dd00 con 0x563cb455e850 2023-11-04T01:43:31.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.561+0000 7f95413b8740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x563cb454d970 con 0x563cb455ec30 2023-11-04T01:43:31.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.561+0000 7f95413b8740 10 client.0 _ll_register_callbacks cb 0x7f952c0767e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:43:31.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.562+0000 7f953cdc3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cb458c190 0x563cb4535720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.562+0000 7f953cdc3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cb458c190 0x563cb4535720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35584/0 (socket says 172.21.15.77:35584) 2023-11-04T01:43:31.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.562+0000 7f953cdc3640 1 -- 172.21.15.77:0/1134506309 learned_addr learned my addr 172.21.15.77:0/1134506309 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:31.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.562+0000 7f9537fff640 1 --2- 172.21.15.77:0/1134506309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563cb455e850 0x563cb45e5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.562+0000 7f95377fe640 1 --2- 172.21.15.77:0/1134506309 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x563cb455ec30 0x563cb45351e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.562+0000 7f953cdc3640 1 -- 172.21.15.77:0/1134506309 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x563cb455ec30 msgr2=0x563cb45351e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:31.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.562+0000 7f953cdc3640 1 --2- 172.21.15.77:0/1134506309 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x563cb455ec30 0x563cb45351e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.562+0000 7f953cdc3640 1 -- 172.21.15.77:0/1134506309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563cb455e850 msgr2=0x563cb45e5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:31.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.562+0000 7f953cdc3640 1 --2- 172.21.15.77:0/1134506309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563cb455e850 0x563cb45e5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.562+0000 7f953cdc3640 1 -- 172.21.15.77:0/1134506309 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9530007330 con 0x563cb458c190 2023-11-04T01:43:31.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.562+0000 7f9537fff640 1 --2- 172.21.15.77:0/1134506309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563cb455e850 0x563cb45e5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:31.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.562+0000 7f953cdc3640 1 --2- 172.21.15.77:0/1134506309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cb458c190 0x563cb4535720 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f953000b010 tx=0x7f9530004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=604c08adbe6cf5ac server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:31.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.562+0000 7f9516ffd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:43:31.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.562+0000 7f9516ffd640 1 -- 172.21.15.77:0/1134506309 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9530022660 con 0x563cb458c190 2023-11-04T01:43:31.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.562+0000 7f9516ffd640 1 -- 172.21.15.77:0/1134506309 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f95300227c0 con 0x563cb458c190 2023-11-04T01:43:31.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.562+0000 7f95413b8740 1 -- 172.21.15.77:0/1134506309 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f952c0827a0 con 0x563cb458c190 2023-11-04T01:43:31.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.562+0000 7f9516ffd640 1 -- 172.21.15.77:0/1134506309 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9530022980 con 0x563cb458c190 2023-11-04T01:43:31.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.562+0000 7f95413b8740 10 client.7473 fetch_fsmap learned FSMap version 43 2023-11-04T01:43:31.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.562+0000 7f95413b8740 1 -- 172.21.15.77:0/1134506309 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x563cb445f500 con 0x563cb458c190 2023-11-04T01:43:31.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.562+0000 7f9516ffd640 1 -- 172.21.15.77:0/1134506309 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952c0827a0 con 0x563cb458c190 2023-11-04T01:43:31.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.562+0000 7f9516ffd640 1 -- 172.21.15.77:0/1134506309 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 43) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9530022ae0 con 0x563cb458c190 2023-11-04T01:43:31.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.562+0000 7f95413b8740 10 client.7473 fetch_fsmap finished waiting for FSMap version 43 2023-11-04T01:43:31.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.562+0000 7f95413b8740 10 client.7473 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:43:31.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.562+0000 7f95413b8740 20 client.7473 populate_metadata read hostname 'smithi077' 2023-11-04T01:43:31.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.562+0000 7f95413b8740 1 --2- 172.21.15.77:0/1134506309 >> [v2:172.21.15.122:6834/3699147778,v1:172.21.15.122:6836/3699147778] conn(0x563cb4561500 0x563cb45618e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.562+0000 7f95413b8740 4 client.7473 mds_command: new command op to 35690 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:43:31.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.562+0000 7f95413b8740 1 -- 172.21.15.77:0/1134506309 --> [v2:172.21.15.122:6834/3699147778,v1:172.21.15.122:6836/3699147778] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563cb44965b0 con 0x563cb4561500 2023-11-04T01:43:31.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.563+0000 7f9537fff640 1 --2- 172.21.15.77:0/1134506309 >> [v2:172.21.15.122:6834/3699147778,v1:172.21.15.122:6836/3699147778] conn(0x563cb4561500 0x563cb45618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.563+0000 7f9537fff640 1 --2- 172.21.15.77:0/1134506309 >> [v2:172.21.15.122:6834/3699147778,v1:172.21.15.122:6836/3699147778] conn(0x563cb4561500 0x563cb45618e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13a1ddbb01411ed8 server_cookie=81d1a82c4fab716c in_seq=0 out_seq=0 2023-11-04T01:43:31.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.563+0000 7f9516ffd640 10 client.7473 ms_handle_connect on v2:172.21.15.122:6834/3699147778 2023-11-04T01:43:31.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.563+0000 7f9516ffd640 1 -- 172.21.15.77:0/1134506309 <== mds.0 v2:172.21.15.122:6834/3699147778 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x563cb44965b0 con 0x563cb4561500 2023-11-04T01:43:31.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.563+0000 7f9516ffd640 10 client.7473 handle_command_reply: tid=0 2023-11-04T01:43:31.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.563+0000 7f95413b8740 1 client.7473 shutdown 2023-11-04T01:43:31.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.563+0000 7f95413b8740 1 -- 172.21.15.77:0/1134506309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cb458c190 msgr2=0x563cb4535720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.563+0000 7f95413b8740 1 --2- 172.21.15.77:0/1134506309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cb458c190 0x563cb4535720 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f953000b010 tx=0x7f9530004ab0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.563+0000 7f95413b8740 1 -- 172.21.15.77:0/1134506309 shutdown_connections 2023-11-04T01:43:31.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.563+0000 7f95413b8740 1 --2- 172.21.15.77:0/1134506309 >> [v2:172.21.15.122:6834/3699147778,v1:172.21.15.122:6836/3699147778] conn(0x563cb4561500 0x563cb45618e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.563+0000 7f95413b8740 1 --2- 172.21.15.77:0/1134506309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cb458c190 0x563cb4535720 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.563+0000 7f95413b8740 1 --2- 172.21.15.77:0/1134506309 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x563cb455ec30 0x563cb45351e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.563+0000 7f95413b8740 1 --2- 172.21.15.77:0/1134506309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563cb455e850 0x563cb45e5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.563+0000 7f95413b8740 1 -- 172.21.15.77:0/1134506309 >> 172.21.15.77:0/1134506309 conn(0x563cb4531c90 msgr2=0x563cb4565060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:31.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.563+0000 7f9516ffd640 0 client.7473 ms_handle_reset on v2:172.21.15.122:6834/3699147778 2023-11-04T01:43:31.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.564+0000 7f95413b8740 1 -- 172.21.15.77:0/1134506309 shutdown_connections 2023-11-04T01:43:31.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.564+0000 7f95413b8740 1 -- 172.21.15.77:0/1134506309 wait complete. 2023-11-04T01:43:31.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.564+0000 7f95413b8740 20 client.7473 trim_cache size 0 max 16384 2023-11-04T01:43:31.592 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-04T01:43:31.593 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "0c22c75d-0169-41ef-b663-6ac1c5b0f71f", 2023-11-04T01:43:31.593 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 0, 2023-11-04T01:43:31.593 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 35690, 2023-11-04T01:43:31.593 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2023-11-04T01:43:31.593 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2023-11-04T01:43:31.594 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2023-11-04T01:43:31.594 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 4.6182781630000003, 2023-11-04T01:43:31.594 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 43, 2023-11-04T01:43:31.594 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 96, 2023-11-04T01:43:31.594 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 96, 2023-11-04T01:43:31.595 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 10.69877222 2023-11-04T01:43:31.595 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-04T01:43:31.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.564+0000 7f953e826640 1 -- 172.21.15.77:0/867369483 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f952406ae70 msgr2=0x7f952406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.564+0000 7f953e826640 1 --2- 172.21.15.77:0/867369483 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f952406ae70 0x7f952406d330 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9528000f60 tx=0x7f9528007b50 comp rx=0 tx=0).stop 2023-11-04T01:43:31.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.564+0000 7f953e826640 1 -- 172.21.15.77:0/867369483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95380b4880 msgr2=0x7f95381f3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.564+0000 7f953e826640 1 --2- 172.21.15.77:0/867369483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95380b4880 0x7f95381f3aa0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f952c000c00 tx=0x7f952c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.564+0000 7f953e826640 1 -- 172.21.15.77:0/867369483 shutdown_connections 2023-11-04T01:43:31.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.564+0000 7f953e826640 1 --2- 172.21.15.77:0/867369483 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f952406ae70 0x7f952406d330 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.564+0000 7f953e826640 1 --2- 172.21.15.77:0/867369483 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9538153e60 0x7f953815eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.564+0000 7f953e826640 1 --2- 172.21.15.77:0/867369483 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f95380cd6d0 0x7f953815e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.564+0000 7f953e826640 1 --2- 172.21.15.77:0/867369483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95380b4880 0x7f95381f3aa0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.564+0000 7f953e826640 1 -- 172.21.15.77:0/867369483 >> 172.21.15.77:0/867369483 conn(0x7f95380cf880 msgr2=0x7f953815fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:31.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.564+0000 7f953e826640 1 -- 172.21.15.77:0/867369483 shutdown_connections 2023-11-04T01:43:31.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.564+0000 7f953e826640 1 -- 172.21.15.77:0/867369483 wait complete. 2023-11-04T01:43:31.599 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:43:31.600 INFO:tasks.ceph.mds.b.smithi122.stderr:2023-11-04T01:43:31.588+0000 7f384fd24640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:43:31.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.698+0000 7f9da607c640 1 Processor -- start 2023-11-04T01:43:31.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.699+0000 7f9da607c640 1 -- start start 2023-11-04T01:43:31.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.699+0000 7f9da607c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9da00ce240 0x7f9da0157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.699+0000 7f9da607c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9da0157540 0x7f9da00d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.699+0000 7f9da607c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da015e000 con 0x7f9da00cde60 2023-11-04T01:43:31.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.699+0000 7f9da607c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9da015e5c0 con 0x7f9da00ce240 2023-11-04T01:43:31.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.699+0000 7f9da607c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da015e2e0 con 0x7f9da0157540 2023-11-04T01:43:31.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.699+0000 7f9d97fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9da00ce240 0x7f9da0157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.699+0000 7f9d9f7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f9da00cde60 0x7f9da015d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:54240/0 (socket says 172.21.15.77:54240) 2023-11-04T01:43:31.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.699+0000 7f9d9f7fe640 1 -- 172.21.15.77:0/3797930827 learned_addr learned my addr 172.21.15.77:0/3797930827 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:31.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.700+0000 7f9d97fff640 1 -- 172.21.15.77:0/3797930827 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9da0157540 msgr2=0x7f9da00d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:31.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.700+0000 7f9d97fff640 1 --2- 172.21.15.77:0/3797930827 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9da0157540 0x7f9da00d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.700+0000 7f9d97fff640 1 -- 172.21.15.77:0/3797930827 >> v1:172.21.15.77:6789/0 conn(0x7f9da00cde60 legacy=0x7f9da015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.700+0000 7f9d97fff640 1 -- 172.21.15.77:0/3797930827 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da00d1120 con 0x7f9da00ce240 2023-11-04T01:43:31.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.700+0000 7f9d97fff640 1 --2- 172.21.15.77:0/3797930827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9da00ce240 0x7f9da0157000 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f9d880097a0 tx=0x7f9d8802b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3836ecc05b31fe2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:31.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.701+0000 7f9d9effd640 1 -- 172.21.15.77:0/3797930827 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d88030710 con 0x7f9da00ce240 2023-11-04T01:43:31.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.701+0000 7f9d9effd640 1 -- 172.21.15.77:0/3797930827 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8802e050 con 0x7f9da00ce240 2023-11-04T01:43:31.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.701+0000 7f9d9effd640 1 -- 172.21.15.77:0/3797930827 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d88030a90 con 0x7f9da00ce240 2023-11-04T01:43:31.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.701+0000 7f9da607c640 1 -- 172.21.15.77:0/3797930827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9da00ce240 msgr2=0x7f9da0157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.701+0000 7f9da607c640 1 --2- 172.21.15.77:0/3797930827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9da00ce240 0x7f9da0157000 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f9d880097a0 tx=0x7f9d8802b710 comp rx=0 tx=0).stop 2023-11-04T01:43:31.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.701+0000 7f9da607c640 1 -- 172.21.15.77:0/3797930827 shutdown_connections 2023-11-04T01:43:31.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.701+0000 7f9da607c640 1 --2- 172.21.15.77:0/3797930827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9da00ce240 0x7f9da0157000 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.701+0000 7f9da607c640 1 --2- 172.21.15.77:0/3797930827 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9da0157540 0x7f9da00d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.701+0000 7f9da607c640 1 -- 172.21.15.77:0/3797930827 >> 172.21.15.77:0/3797930827 conn(0x7f9da0071f30 msgr2=0x7f9da00cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:31.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.701+0000 7f9da607c640 1 -- 172.21.15.77:0/3797930827 shutdown_connections 2023-11-04T01:43:31.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.701+0000 7f9da607c640 1 -- 172.21.15.77:0/3797930827 wait complete. 2023-11-04T01:43:31.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.702+0000 7f9da607c640 1 Processor -- start 2023-11-04T01:43:31.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.702+0000 7f9da607c640 1 -- start start 2023-11-04T01:43:31.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.703+0000 7f9da607c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9da00cde60 0x7f9da00cc840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.703+0000 7f9da607c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9da00ce240 0x7f9da01f1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.703+0000 7f9da607c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9da0157540 0x7f9da01f2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.703+0000 7f9da607c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da0159340 con 0x7f9da00ce240 2023-11-04T01:43:31.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.703+0000 7f9da607c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da01f28c0 con 0x7f9da0157540 2023-11-04T01:43:31.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.703+0000 7f9da607c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da0158860 con 0x7f9da00cde60 2023-11-04T01:43:31.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.703+0000 7f9d97fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9da00ce240 0x7f9da01f1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.703+0000 7f9d97fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9da00ce240 0x7f9da01f1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35606/0 (socket says 172.21.15.77:35606) 2023-11-04T01:43:31.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.703+0000 7f9d97fff640 1 -- 172.21.15.77:0/267498863 learned_addr learned my addr 172.21.15.77:0/267498863 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:31.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.703+0000 7f9d9f7fe640 1 --2- 172.21.15.77:0/267498863 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9da00cde60 0x7f9da00cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.704+0000 7f9d9ffff640 1 --2- 172.21.15.77:0/267498863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9da0157540 0x7f9da01f2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.704+0000 7f9d97fff640 1 -- 172.21.15.77:0/267498863 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9da00cde60 msgr2=0x7f9da00cc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.704+0000 7f9d97fff640 1 --2- 172.21.15.77:0/267498863 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9da00cde60 0x7f9da00cc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.704+0000 7f9d97fff640 1 -- 172.21.15.77:0/267498863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9da0157540 msgr2=0x7f9da01f2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.704+0000 7f9d97fff640 1 --2- 172.21.15.77:0/267498863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9da0157540 0x7f9da01f2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.704+0000 7f9d97fff640 1 -- 172.21.15.77:0/267498863 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d88009400 con 0x7f9da00ce240 2023-11-04T01:43:31.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.704+0000 7f9d9ffff640 1 --2- 172.21.15.77:0/267498863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9da0157540 0x7f9da01f2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:31.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.704+0000 7f9d97fff640 1 --2- 172.21.15.77:0/267498863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9da00ce240 0x7f9da01f1e40 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f9d880097a0 tx=0x7f9d880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:31.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.704+0000 7f9d9cff9640 1 -- 172.21.15.77:0/267498863 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d88032910 con 0x7f9da00ce240 2023-11-04T01:43:31.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.704+0000 7f9d9cff9640 1 -- 172.21.15.77:0/267498863 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d88032a70 con 0x7f9da00ce240 2023-11-04T01:43:31.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.704+0000 7f9d9cff9640 1 -- 172.21.15.77:0/267498863 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d88032e20 con 0x7f9da00ce240 2023-11-04T01:43:31.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.704+0000 7f9da607c640 1 -- 172.21.15.77:0/267498863 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da0148bd0 con 0x7f9da00ce240 2023-11-04T01:43:31.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.704+0000 7f9da607c640 1 -- 172.21.15.77:0/267498863 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da0149190 con 0x7f9da00ce240 2023-11-04T01:43:31.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.705+0000 7f9da607c640 1 -- 172.21.15.77:0/267498863 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9da0148a30 con 0x7f9da00ce240 2023-11-04T01:43:31.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.705+0000 7f9d9cff9640 1 -- 172.21.15.77:0/267498863 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9d88039040 con 0x7f9da00ce240 2023-11-04T01:43:31.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.706+0000 7f9d9cff9640 1 --2- 172.21.15.77:0/267498863 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9d8006ae70 0x7f9d8006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.706+0000 7f9d9cff9640 1 -- 172.21.15.77:0/267498863 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f9d880ab9a0 con 0x7f9da00ce240 2023-11-04T01:43:31.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.706+0000 7f9d9f7fe640 1 --2- 172.21.15.77:0/267498863 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9d8006ae70 0x7f9d8006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.707+0000 7f9d9f7fe640 1 --2- 172.21.15.77:0/267498863 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9d8006ae70 0x7f9d8006d330 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f9d90007fd0 tx=0x7f9d90007c20 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:31.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.710+0000 7f9d9cff9640 1 -- 172.21.15.77:0/267498863 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9da0148a30 con 0x7f9da00ce240 2023-11-04T01:43:31.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.914+0000 7f9da607c640 1 -- 172.21.15.77:0/267498863 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9da0148a30 con 0x7f9da00ce240 2023-11-04T01:43:31.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.914+0000 7f9d9cff9640 1 -- 172.21.15.77:0/267498863 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v43) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9da0148a30 con 0x7f9da00ce240 2023-11-04T01:43:31.916 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:43:31.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.916+0000 7f9da607c640 1 -- 172.21.15.77:0/267498863 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9d8006ae70 msgr2=0x7f9d8006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.916+0000 7f9da607c640 1 --2- 172.21.15.77:0/267498863 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9d8006ae70 0x7f9d8006d330 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f9d90007fd0 tx=0x7f9d90007c20 comp rx=0 tx=0).stop 2023-11-04T01:43:31.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.916+0000 7f9da607c640 1 -- 172.21.15.77:0/267498863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9da00ce240 msgr2=0x7f9da01f1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.916+0000 7f9da607c640 1 --2- 172.21.15.77:0/267498863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9da00ce240 0x7f9da01f1e40 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f9d880097a0 tx=0x7f9d880046c0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.916+0000 7f9da607c640 1 -- 172.21.15.77:0/267498863 shutdown_connections 2023-11-04T01:43:31.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.916+0000 7f9da607c640 1 --2- 172.21.15.77:0/267498863 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9d8006ae70 0x7f9d8006d330 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.916+0000 7f9da607c640 1 --2- 172.21.15.77:0/267498863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9da0157540 0x7f9da01f2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.916+0000 7f9da607c640 1 --2- 172.21.15.77:0/267498863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9da00ce240 0x7f9da01f1e40 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.916+0000 7f9da607c640 1 --2- 172.21.15.77:0/267498863 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9da00cde60 0x7f9da00cc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.916+0000 7f9da607c640 1 -- 172.21.15.77:0/267498863 >> 172.21.15.77:0/267498863 conn(0x7f9da0071f30 msgr2=0x7f9da00d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:31.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.916+0000 7f9da607c640 1 -- 172.21.15.77:0/267498863 shutdown_connections 2023-11-04T01:43:31.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:31.916+0000 7f9da607c640 1 -- 172.21.15.77:0/267498863 wait complete. 2023-11-04T01:43:31.928 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:43:31.929 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:43:31.929 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2023-11-04T01:43:31.929 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:43:31.930 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:31.930 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:43:31.930 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:43:31.931 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:43:31.931 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:43:31.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:31.932 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2023-11-04T01:43:31.947 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:43:31.948 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:43:31.948 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:43:31.948 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:31.948 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2023-11-04T01:43:31.948 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:31.949 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:43:31.949 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:31.949 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f0 2023-11-04T01:43:31.949 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:43:31.949 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:31.949 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f1 2023-11-04T01:43:31.950 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:43:31.950 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:31.950 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:43:31.950 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:31.950 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:43:31.951 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 42194sec preferred_lft 42194sec 2023-11-04T01:43:31.951 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::ec4:7aff:fe8f:d3d3/64 scope link 2023-11-04T01:43:31.951 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:31.951 INFO:teuthology.orchestra.run.smithi077.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:43:31.951 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 06:3a:02:11:c4:57 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:31.952 INFO:teuthology.orchestra.run.smithi077.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:43:31.952 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:31.952 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::8039:1aff:fee2:109f/64 scope link 2023-11-04T01:43:31.952 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:31.952 INFO:teuthology.orchestra.run.smithi077.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:43:31.952 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 06:3a:02:11:c4:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:31.953 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::43a:2ff:fe11:c457/64 scope link 2023-11-04T01:43:31.953 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:31.953 INFO:teuthology.orchestra.run.smithi077.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:43:31.953 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether c2:4f:2a:69:4f:38 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:31.953 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::c04f:2aff:fe69:4f38/64 scope link 2023-11-04T01:43:31.953 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:31.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:31.954 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:43:32.012 INFO:teuthology.orchestra.run.smithi077.stdout:1 2023-11-04T01:43:32.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:32.014 DEBUG:teuthology.orchestra.run.smithi077:> route 2023-11-04T01:43:32.069 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2023-11-04T01:43:32.070 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:43:32.070 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:43:32.070 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:43:32.070 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:43:32.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:32.071 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-11-04T01:43:32.071 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-11-04T01:43:32.072 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:43:32.072 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:43:32.072 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:43:32.073 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-11-04T01:43:32.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:32.165 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2023-11-04T01:43:32.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:43:32.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:43:32.180 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:43:32.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:32.180 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 up 2023-11-04T01:43:32.246 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:43:32.246 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:43:32.246 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:32.301 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:43:32.301 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:43:32.302 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:32.355 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:43:32.410 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2023-11-04T01:43:32.411 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2023-11-04T01:43:32.411 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2023-11-04T01:43:32.411 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2023-11-04T01:43:32.411 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2023-11-04T01:43:32.412 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2023-11-04T01:43:32.412 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2023-11-04T01:43:32.412 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2023-11-04T01:43:32.412 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2023-11-04T01:43:32.412 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2023-11-04T01:43:32.413 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2023-11-04T01:43:32.413 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2023-11-04T01:43:32.413 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:43:32.413 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2023-11-04T01:43:32.413 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2023-11-04T01:43:32.414 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2023-11-04T01:43:32.414 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2023-11-04T01:43:32.414 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2023-11-04T01:43:32.414 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2023-11-04T01:43:32.414 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:43:32.415 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:43:32.415 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:43:32.415 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:43:32.415 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2023-11-04T01:43:32.415 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2023-11-04T01:43:32.416 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:43:32.416 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:43:32.416 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:43:32.416 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:43:32.416 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2023-11-04T01:43:32.416 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:32.417 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:32.417 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:32.417 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:32.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:32.418 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-11-04T01:43:32.465 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:43:32.465 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:43:32.508 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:43:32.522 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2023-11-04T01:43:32.522 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2023-11-04T01:43:32.523 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2023-11-04T01:43:32.523 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2023-11-04T01:43:32.523 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2023-11-04T01:43:32.523 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2023-11-04T01:43:32.523 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2023-11-04T01:43:32.523 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2023-11-04T01:43:32.524 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2023-11-04T01:43:32.524 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2023-11-04T01:43:32.524 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2023-11-04T01:43:32.524 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2023-11-04T01:43:32.524 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:43:32.524 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2023-11-04T01:43:32.525 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2023-11-04T01:43:32.525 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2023-11-04T01:43:32.525 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2023-11-04T01:43:32.525 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2023-11-04T01:43:32.525 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2023-11-04T01:43:32.526 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:43:32.526 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:43:32.526 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:43:32.526 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:43:32.526 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2023-11-04T01:43:32.527 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2023-11-04T01:43:32.527 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:43:32.527 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:43:32.527 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:43:32.527 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:43:32.527 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2023-11-04T01:43:32.528 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:32.528 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:32.528 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:32.528 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:32.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:32.529 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-11-04T01:43:32.597 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:2023-11-04T01:43:32.596+0000 7ff19ea3d480 -1 init, newargv = 0x55c7f503aa10 newargc=15 2023-11-04T01:43:32.598 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[147949]: starting ceph client 2023-11-04T01:43:32.602 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[147949]: starting fuse 2023-11-04T01:43:33.679 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:43:33.699 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2023-11-04T01:43:33.699 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2023-11-04T01:43:33.699 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2023-11-04T01:43:33.699 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2023-11-04T01:43:33.700 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2023-11-04T01:43:33.700 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2023-11-04T01:43:33.700 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2023-11-04T01:43:33.700 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2023-11-04T01:43:33.700 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2023-11-04T01:43:33.701 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2023-11-04T01:43:33.701 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2023-11-04T01:43:33.701 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2023-11-04T01:43:33.701 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:43:33.701 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2023-11-04T01:43:33.702 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2023-11-04T01:43:33.702 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2023-11-04T01:43:33.702 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2023-11-04T01:43:33.702 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2023-11-04T01:43:33.702 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2023-11-04T01:43:33.703 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:43:33.703 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:43:33.703 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:43:33.703 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:43:33.703 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2023-11-04T01:43:33.704 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2023-11-04T01:43:33.704 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:43:33.704 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:43:33.704 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:43:33.704 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:43:33.705 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2023-11-04T01:43:33.705 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:33.705 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:33.706 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:33.706 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:33.706 INFO:teuthology.orchestra.run.smithi077.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:33.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:33.708 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-11-04T01:43:33.757 INFO:teuthology.orchestra.run.smithi077.stdout:42 2023-11-04T01:43:33.757 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-11-04T01:43:33.758 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:43:33.758 DEBUG:teuthology.orchestra.run.smithi077:> import glob 2023-11-04T01:43:33.759 DEBUG:teuthology.orchestra.run.smithi077:> import re 2023-11-04T01:43:33.759 DEBUG:teuthology.orchestra.run.smithi077:> import os 2023-11-04T01:43:33.760 DEBUG:teuthology.orchestra.run.smithi077:> import subprocess 2023-11-04T01:43:33.760 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:43:33.760 DEBUG:teuthology.orchestra.run.smithi077:> def _find_admin_socket(client_name): 2023-11-04T01:43:33.761 DEBUG:teuthology.orchestra.run.smithi077:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:43:33.761 DEBUG:teuthology.orchestra.run.smithi077:> files = glob.glob(asok_path) 2023-11-04T01:43:33.761 DEBUG:teuthology.orchestra.run.smithi077:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:43:33.762 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:43:33.762 DEBUG:teuthology.orchestra.run.smithi077:> # Given a non-glob path, it better be there 2023-11-04T01:43:33.763 DEBUG:teuthology.orchestra.run.smithi077:> if "*" not in asok_path: 2023-11-04T01:43:33.763 DEBUG:teuthology.orchestra.run.smithi077:> assert(len(files) == 1) 2023-11-04T01:43:33.763 DEBUG:teuthology.orchestra.run.smithi077:> return files[0] 2023-11-04T01:43:33.764 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:43:33.764 DEBUG:teuthology.orchestra.run.smithi077:> for f in files: 2023-11-04T01:43:33.764 DEBUG:teuthology.orchestra.run.smithi077:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:43:33.765 DEBUG:teuthology.orchestra.run.smithi077:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:43:33.765 DEBUG:teuthology.orchestra.run.smithi077:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:43:33.765 DEBUG:teuthology.orchestra.run.smithi077:> contents = proc_f.read() 2023-11-04T01:43:33.766 DEBUG:teuthology.orchestra.run.smithi077:> if mountpoint in contents: 2023-11-04T01:43:33.766 DEBUG:teuthology.orchestra.run.smithi077:> return f 2023-11-04T01:43:33.766 DEBUG:teuthology.orchestra.run.smithi077:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:43:33.767 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:43:33.767 DEBUG:teuthology.orchestra.run.smithi077:> print(_find_admin_socket("client.0")) 2023-11-04T01:43:33.767 DEBUG:teuthology.orchestra.run.smithi077:> ' 2023-11-04T01:43:33.885 INFO:teuthology.orchestra.run.smithi077.stdout:/var/run/ceph/ceph-client.0.147949.asok 2023-11-04T01:43:33.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:33.896 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.147949.asok 2023-11-04T01:43:33.897 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:43:33.897 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.147949.asok status 2023-11-04T01:43:33.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:34.065 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-04T01:43:34.065 INFO:teuthology.orchestra.run.smithi077.stdout: "metadata": { 2023-11-04T01:43:34.065 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:43:34.065 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:43:34.065 INFO:teuthology.orchestra.run.smithi077.stdout: "entity_id": "0", 2023-11-04T01:43:34.066 INFO:teuthology.orchestra.run.smithi077.stdout: "hostname": "smithi077", 2023-11-04T01:43:34.066 INFO:teuthology.orchestra.run.smithi077.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:43:34.066 INFO:teuthology.orchestra.run.smithi077.stdout: "pid": "147949", 2023-11-04T01:43:34.066 INFO:teuthology.orchestra.run.smithi077.stdout: "root": "/" 2023-11-04T01:43:34.067 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:43:34.067 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_count": 0, 2023-11-04T01:43:34.067 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_pinned_count": 0, 2023-11-04T01:43:34.067 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 7488, 2023-11-04T01:43:34.067 INFO:teuthology.orchestra.run.smithi077.stdout: "inst": { 2023-11-04T01:43:34.067 INFO:teuthology.orchestra.run.smithi077.stdout: "name": { 2023-11-04T01:43:34.068 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "client", 2023-11-04T01:43:34.068 INFO:teuthology.orchestra.run.smithi077.stdout: "num": 7488 2023-11-04T01:43:34.068 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:43:34.069 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2023-11-04T01:43:34.069 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2023-11-04T01:43:34.069 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:43:34.069 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 3032548059 2023-11-04T01:43:34.069 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:43:34.069 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:43:34.070 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2023-11-04T01:43:34.070 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2023-11-04T01:43:34.070 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:43:34.070 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 3032548059 2023-11-04T01:43:34.071 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:43:34.071 INFO:teuthology.orchestra.run.smithi077.stdout: "inst_str": "client.7488 192.168.0.1:0/3032548059", 2023-11-04T01:43:34.071 INFO:teuthology.orchestra.run.smithi077.stdout: "addr_str": "192.168.0.1:0/3032548059", 2023-11-04T01:43:34.071 INFO:teuthology.orchestra.run.smithi077.stdout: "inode_count": 1, 2023-11-04T01:43:34.071 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_epoch": 43, 2023-11-04T01:43:34.072 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch": 96, 2023-11-04T01:43:34.072 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:43:34.072 INFO:teuthology.orchestra.run.smithi077.stdout: "blocklisted": false, 2023-11-04T01:43:34.072 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs" 2023-11-04T01:43:34.072 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-04T01:43:34.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:34.079 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:43:34.079 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:43:34.080 DEBUG:teuthology.orchestra.run.smithi077:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:34.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:34.141 INFO:teuthology.orchestra.run.smithi077.stdout:fuseblk 2023-11-04T01:43:34.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:34.145 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:34.145 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:43:34.146 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:34.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:34.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:34.212 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get mds_max_snaps_per_dir 2023-11-04T01:43:34.324 INFO:teuthology.orchestra.run.smithi077.stdout:{"mds_max_snaps_per_dir":"100"} 2023-11-04T01:43:34.324 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_max_snaps_per_dir": "100" } 2023-11-04T01:43:34.325 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2023-11-04T01:43:34.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.426+0000 7fb7ac261640 1 Processor -- start 2023-11-04T01:43:34.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.427+0000 7fb7ac261640 1 -- start start 2023-11-04T01:43:34.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.427+0000 7fb7ac261640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb7a40cb270 0x7fb7a40b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.427+0000 7fb7ac261640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb7a406a830 0x7fb7a40ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.427+0000 7fb7ac261640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7a40cdc30 con 0x7fb7a40cb650 2023-11-04T01:43:34.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.427+0000 7fb7ac261640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7a40caa00 con 0x7fb7a406a830 2023-11-04T01:43:34.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.427+0000 7fb7ac261640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7a40cd620 con 0x7fb7a40cb270 2023-11-04T01:43:34.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.427+0000 7fb7aa7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb7a406a830 0x7fb7a40ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.427+0000 7fb7aa7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb7a406a830 0x7fb7a40ca4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35614/0 (socket says 172.21.15.77:35614) 2023-11-04T01:43:34.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.427+0000 7fb7aa7fe640 1 -- 172.21.15.77:0/3419501885 learned_addr learned my addr 172.21.15.77:0/3419501885 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:34.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.428+0000 7fb7a9ffd640 1 --2- 172.21.15.77:0/3419501885 >> v2:172.21.15.122:3300/0 conn(0x7fb7a40cb270 0x7fb7a40b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.428+0000 7fb7aa7fe640 1 -- 172.21.15.77:0/3419501885 >> v2:172.21.15.122:3300/0 conn(0x7fb7a40cb270 msgr2=0x7fb7a40b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:34.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.428+0000 7fb7aa7fe640 1 --2- 172.21.15.77:0/3419501885 >> v2:172.21.15.122:3300/0 conn(0x7fb7a40cb270 0x7fb7a40b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.428+0000 7fb7aa7fe640 1 -- 172.21.15.77:0/3419501885 >> v1:172.21.15.122:6789/0 conn(0x7fb7a40cb650 legacy=0x7fb7a406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:34.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.428+0000 7fb7aa7fe640 1 -- 172.21.15.77:0/3419501885 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a406fe00 con 0x7fb7a406a830 2023-11-04T01:43:34.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.428+0000 7fb7aa7fe640 1 --2- 172.21.15.77:0/3419501885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7a406a830 0x7fb7a40ca4c0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fb7a40cd570 tx=0x7fb79c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bfdcd177752bad8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:34.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.429+0000 7fb7a8ffb640 1 -- 172.21.15.77:0/3419501885 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79c030860 con 0x7fb7a406a830 2023-11-04T01:43:34.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.429+0000 7fb7a8ffb640 1 -- 172.21.15.77:0/3419501885 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb79c0309c0 con 0x7fb7a406a830 2023-11-04T01:43:34.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.429+0000 7fb7a8ffb640 1 -- 172.21.15.77:0/3419501885 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79c030d50 con 0x7fb7a406a830 2023-11-04T01:43:34.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.429+0000 7fb7ac261640 1 -- 172.21.15.77:0/3419501885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7a406a830 msgr2=0x7fb7a40ca4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.429+0000 7fb7ac261640 1 --2- 172.21.15.77:0/3419501885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7a406a830 0x7fb7a40ca4c0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fb7a40cd570 tx=0x7fb79c02b9a0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.429+0000 7fb7ac261640 1 -- 172.21.15.77:0/3419501885 shutdown_connections 2023-11-04T01:43:34.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.429+0000 7fb7ac261640 1 --2- 172.21.15.77:0/3419501885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7a406a830 0x7fb7a40ca4c0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.429+0000 7fb7ac261640 1 --2- 172.21.15.77:0/3419501885 >> v2:172.21.15.122:3300/0 conn(0x7fb7a40cb270 0x7fb7a40b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.429+0000 7fb7ac261640 1 -- 172.21.15.77:0/3419501885 >> 172.21.15.77:0/3419501885 conn(0x7fb7a406d820 msgr2=0x7fb7a406dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:34.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.429+0000 7fb7ac261640 1 -- 172.21.15.77:0/3419501885 shutdown_connections 2023-11-04T01:43:34.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.429+0000 7fb7ac261640 1 -- 172.21.15.77:0/3419501885 wait complete. 2023-11-04T01:43:34.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.430+0000 7fb7ac261640 1 Processor -- start 2023-11-04T01:43:34.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.430+0000 7fb7ac261640 1 -- start start 2023-11-04T01:43:34.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.431+0000 7fb7ac261640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7a406a830 0x7fb7a4155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.431+0000 7fb7ac261640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb7a40cb270 0x7fb7a40c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.431+0000 7fb7ac261640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7a40cb650 0x7fb7a40c9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.431+0000 7fb7ac261640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a40b3430 con 0x7fb7a406a830 2023-11-04T01:43:34.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.431+0000 7fb7ac261640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a41f4b30 con 0x7fb7a40cb270 2023-11-04T01:43:34.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.431+0000 7fb7ac261640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a41f4200 con 0x7fb7a40cb650 2023-11-04T01:43:34.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.431+0000 7fb7a9ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7a406a830 0x7fb7a4155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.431+0000 7fb7a9ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7a406a830 0x7fb7a4155040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35630/0 (socket says 172.21.15.77:35630) 2023-11-04T01:43:34.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.431+0000 7fb7a9ffd640 1 -- 172.21.15.77:0/719444115 learned_addr learned my addr 172.21.15.77:0/719444115 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:34.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.431+0000 7fb7a97fc640 1 --2- 172.21.15.77:0/719444115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb7a40cb270 0x7fb7a40c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.432+0000 7fb7aa7fe640 1 --2- 172.21.15.77:0/719444115 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7a40cb650 0x7fb7a40c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.432+0000 7fb7a9ffd640 1 -- 172.21.15.77:0/719444115 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7a40cb650 msgr2=0x7fb7a40c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.432+0000 7fb7a9ffd640 1 --2- 172.21.15.77:0/719444115 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7a40cb650 0x7fb7a40c9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.432+0000 7fb7a9ffd640 1 -- 172.21.15.77:0/719444115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb7a40cb270 msgr2=0x7fb7a40c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.432+0000 7fb7a9ffd640 1 --2- 172.21.15.77:0/719444115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb7a40cb270 0x7fb7a40c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.432+0000 7fb7a9ffd640 1 -- 172.21.15.77:0/719444115 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb79c0094d0 con 0x7fb7a406a830 2023-11-04T01:43:34.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.432+0000 7fb7aa7fe640 1 --2- 172.21.15.77:0/719444115 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7a40cb650 0x7fb7a40c9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:34.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.432+0000 7fb7a9ffd640 1 --2- 172.21.15.77:0/719444115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7a406a830 0x7fb7a4155040 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0007ef0 tx=0x7fb7a000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:34.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.432+0000 7fb79a7fc640 1 -- 172.21.15.77:0/719444115 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a0014620 con 0x7fb7a406a830 2023-11-04T01:43:34.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.432+0000 7fb79a7fc640 1 -- 172.21.15.77:0/719444115 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a0014780 con 0x7fb7a406a830 2023-11-04T01:43:34.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.432+0000 7fb7ac261640 1 -- 172.21.15.77:0/719444115 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7a41f44e0 con 0x7fb7a406a830 2023-11-04T01:43:34.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.432+0000 7fb79a7fc640 1 -- 172.21.15.77:0/719444115 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a0014b30 con 0x7fb7a406a830 2023-11-04T01:43:34.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.432+0000 7fb7ac261640 1 -- 172.21.15.77:0/719444115 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7a40aebc0 con 0x7fb7a406a830 2023-11-04T01:43:34.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.433+0000 7fb7ac261640 1 -- 172.21.15.77:0/719444115 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7a404e490 con 0x7fb7a406a830 2023-11-04T01:43:34.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.433+0000 7fb79a7fc640 1 -- 172.21.15.77:0/719444115 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb7a0014c90 con 0x7fb7a406a830 2023-11-04T01:43:34.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.434+0000 7fb79a7fc640 1 --2- 172.21.15.77:0/719444115 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb78806aea0 0x7fb78806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.434+0000 7fb79a7fc640 1 -- 172.21.15.77:0/719444115 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fb7a008a5e0 con 0x7fb7a406a830 2023-11-04T01:43:34.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.434+0000 7fb7a97fc640 1 --2- 172.21.15.77:0/719444115 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb78806aea0 0x7fb78806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.434+0000 7fb7a97fc640 1 --2- 172.21.15.77:0/719444115 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb78806aea0 0x7fb78806d360 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb7a415e830 tx=0x7fb794009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:34.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.438+0000 7fb79a7fc640 1 -- 172.21.15.77:0/719444115 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb7a0055110 con 0x7fb7a406a830 2023-11-04T01:43:34.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:34.642+0000 7fb7ac261640 1 -- 172.21.15.77:0/719444115 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb7a40b59d0 con 0x7fb7a406a830 2023-11-04T01:43:35.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.591+0000 7fb79a7fc640 1 -- 172.21.15.77:0/719444115 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v44) v1 ==== 167+0+0 (secure 0 0 0) 0x7fb7a0058730 con 0x7fb7a406a830 2023-11-04T01:43:35.593 INFO:teuthology.orchestra.run.smithi077.stderr:enabled new snapshots 2023-11-04T01:43:35.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.595+0000 7fb7ac261640 1 -- 172.21.15.77:0/719444115 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb78806aea0 msgr2=0x7fb78806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:35.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.595+0000 7fb7ac261640 1 --2- 172.21.15.77:0/719444115 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb78806aea0 0x7fb78806d360 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb7a415e830 tx=0x7fb794009040 comp rx=0 tx=0).stop 2023-11-04T01:43:35.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.595+0000 7fb7ac261640 1 -- 172.21.15.77:0/719444115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7a406a830 msgr2=0x7fb7a4155040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:35.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.595+0000 7fb7ac261640 1 --2- 172.21.15.77:0/719444115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7a406a830 0x7fb7a4155040 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0007ef0 tx=0x7fb7a000e4b0 comp rx=0 tx=0).stop 2023-11-04T01:43:35.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.595+0000 7fb7ac261640 1 -- 172.21.15.77:0/719444115 shutdown_connections 2023-11-04T01:43:35.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.595+0000 7fb7ac261640 1 --2- 172.21.15.77:0/719444115 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb78806aea0 0x7fb78806d360 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:35.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.595+0000 7fb7ac261640 1 --2- 172.21.15.77:0/719444115 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7a40cb650 0x7fb7a40c9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:35.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.595+0000 7fb7ac261640 1 --2- 172.21.15.77:0/719444115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb7a40cb270 0x7fb7a40c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:35.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.595+0000 7fb7ac261640 1 --2- 172.21.15.77:0/719444115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7a406a830 0x7fb7a4155040 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:35.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.595+0000 7fb7ac261640 1 -- 172.21.15.77:0/719444115 >> 172.21.15.77:0/719444115 conn(0x7fb7a406d820 msgr2=0x7fb7a40d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:35.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.595+0000 7fb7ac261640 1 -- 172.21.15.77:0/719444115 shutdown_connections 2023-11-04T01:43:35.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.595+0000 7fb7ac261640 1 -- 172.21.15.77:0/719444115 wait complete. 2023-11-04T01:43:35.610 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 2 2023-11-04T01:43:35.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.716+0000 7f4d711c0640 1 Processor -- start 2023-11-04T01:43:35.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.716+0000 7f4d711c0640 1 -- start start 2023-11-04T01:43:35.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.717+0000 7f4d711c0640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4d6c15b140 0x7f4d6c06e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:35.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.717+0000 7f4d711c0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d6c0b24f0 con 0x7f4d6c06cbd0 2023-11-04T01:43:35.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.717+0000 7f4d711c0640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d6c0ce220 con 0x7f4d6c067090 2023-11-04T01:43:35.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.717+0000 7f4d711c0640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d6c0cdc60 con 0x7f4d6c15b140 2023-11-04T01:43:35.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.717+0000 7f4d6ad9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f4d6c06cbd0 0x7f4d6c06cfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:54246/0 (socket says 172.21.15.77:54246) 2023-11-04T01:43:35.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.717+0000 7f4d6ad9d640 1 -- 172.21.15.77:0/4119161067 learned_addr learned my addr 172.21.15.77:0/4119161067 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:35.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.717+0000 7f4d69d9b640 1 -- 172.21.15.77:0/4119161067 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2242471570 0 0) 0x7f4d6c0b24f0 con 0x7f4d6c06cbd0 2023-11-04T01:43:35.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.717+0000 7f4d69d9b640 1 -- 172.21.15.77:0/4119161067 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d54003520 con 0x7f4d6c06cbd0 2023-11-04T01:43:35.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.717+0000 7f4d6a59c640 1 --2- 172.21.15.77:0/4119161067 >> v2:172.21.15.122:3300/0 conn(0x7f4d6c15b140 0x7f4d6c06e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:35.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.717+0000 7f4d69d9b640 1 -- 172.21.15.77:0/4119161067 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 667376415 0 0) 0x7f4d54003520 con 0x7f4d6c06cbd0 2023-11-04T01:43:35.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.717+0000 7f4d69d9b640 1 -- 172.21.15.77:0/4119161067 >> v2:172.21.15.122:3300/0 conn(0x7f4d6c15b140 msgr2=0x7f4d6c06e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:35.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.717+0000 7f4d69d9b640 1 --2- 172.21.15.77:0/4119161067 >> v2:172.21.15.122:3300/0 conn(0x7f4d6c15b140 0x7f4d6c06e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:35.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.717+0000 7f4d69d9b640 1 -- 172.21.15.77:0/4119161067 >> v1:172.21.15.122:6789/0 conn(0x7f4d6c067090 legacy=0x7f4d6c0b2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:35.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.717+0000 7f4d69d9b640 1 -- 172.21.15.77:0/4119161067 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d6c0cdf40 con 0x7f4d6c06cbd0 2023-11-04T01:43:35.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.717+0000 7f4d69d9b640 1 -- 172.21.15.77:0/4119161067 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f4d5c001670 con 0x7f4d6c06cbd0 2023-11-04T01:43:35.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.717+0000 7f4d69d9b640 1 -- 172.21.15.77:0/4119161067 >> v1:172.21.15.77:6789/0 conn(0x7f4d6c06cbd0 legacy=0x7f4d6c06cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:35.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.717+0000 7f4d69d9b640 1 --2- 172.21.15.77:0/4119161067 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d54003970 0x7f4d54003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:35.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.717+0000 7f4d69d9b640 1 --2- 172.21.15.77:0/4119161067 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d540047c0 0x7f4d54004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:35.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.717+0000 7f4d69d9b640 1 --2- 172.21.15.77:0/4119161067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d540052a0 0x7f4d5400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:35.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.717+0000 7f4d69d9b640 1 -- 172.21.15.77:0/4119161067 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c0cdc60 con 0x7f4d540052a0 2023-11-04T01:43:35.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.717+0000 7f4d69d9b640 1 -- 172.21.15.77:0/4119161067 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5400c150 con 0x7f4d54003970 2023-11-04T01:43:35.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.717+0000 7f4d69d9b640 1 -- 172.21.15.77:0/4119161067 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5400c310 con 0x7f4d540047c0 2023-11-04T01:43:35.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.717+0000 7f4d6b59e640 1 --2- 172.21.15.77:0/4119161067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d540052a0 0x7f4d5400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:35.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.717+0000 7f4d6ad9d640 1 --2- 172.21.15.77:0/4119161067 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d54003970 0x7f4d54003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:35.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.718+0000 7f4d6a59c640 1 --2- 172.21.15.77:0/4119161067 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d540047c0 0x7f4d54004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:35.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.718+0000 7f4d6b59e640 1 -- 172.21.15.77:0/4119161067 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d540047c0 msgr2=0x7f4d54004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:35.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.718+0000 7f4d6b59e640 1 --2- 172.21.15.77:0/4119161067 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d540047c0 0x7f4d54004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:35.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.718+0000 7f4d6b59e640 1 -- 172.21.15.77:0/4119161067 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d54003970 msgr2=0x7f4d54003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:35.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.718+0000 7f4d6b59e640 1 --2- 172.21.15.77:0/4119161067 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d54003970 0x7f4d54003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:35.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.718+0000 7f4d6b59e640 1 -- 172.21.15.77:0/4119161067 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d54003520 con 0x7f4d540052a0 2023-11-04T01:43:35.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.718+0000 7f4d6a59c640 1 --2- 172.21.15.77:0/4119161067 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d540047c0 0x7f4d54004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:35.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.718+0000 7f4d6b59e640 1 -- 172.21.15.77:0/4119161067 reap_dead start 2023-11-04T01:43:35.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.718+0000 7f4d6b59e640 1 --2- 172.21.15.77:0/4119161067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d540052a0 0x7f4d5400b980 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f4d64004480 tx=0x7f4d540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c0e59795423e9a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:35.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.718+0000 7f4d69d9b640 1 -- 172.21.15.77:0/4119161067 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d64006b50 con 0x7f4d540052a0 2023-11-04T01:43:35.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.719+0000 7f4d69d9b640 1 -- 172.21.15.77:0/4119161067 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d64006cd0 con 0x7f4d540052a0 2023-11-04T01:43:35.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.719+0000 7f4d69d9b640 1 -- 172.21.15.77:0/4119161067 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d64007260 con 0x7f4d540052a0 2023-11-04T01:43:35.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.719+0000 7f4d711c0640 1 -- 172.21.15.77:0/4119161067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d540052a0 msgr2=0x7f4d5400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:35.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.719+0000 7f4d711c0640 1 --2- 172.21.15.77:0/4119161067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d540052a0 0x7f4d5400b980 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f4d64004480 tx=0x7f4d540057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:35.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.719+0000 7f4d711c0640 1 -- 172.21.15.77:0/4119161067 shutdown_connections 2023-11-04T01:43:35.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.719+0000 7f4d711c0640 1 --2- 172.21.15.77:0/4119161067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d540052a0 0x7f4d5400b980 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:35.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.719+0000 7f4d711c0640 1 -- 172.21.15.77:0/4119161067 >> 172.21.15.77:0/4119161067 conn(0x7f4d6c06a120 msgr2=0x7f4d6c06a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:35.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.719+0000 7f4d711c0640 1 -- 172.21.15.77:0/4119161067 shutdown_connections 2023-11-04T01:43:35.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.719+0000 7f4d711c0640 1 -- 172.21.15.77:0/4119161067 wait complete. 2023-11-04T01:43:35.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.720+0000 7f4d711c0640 1 Processor -- start 2023-11-04T01:43:35.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.721+0000 7f4d711c0640 1 -- start start 2023-11-04T01:43:35.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.721+0000 7f4d711c0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d540052a0 0x7f4d6c0afe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:35.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.721+0000 7f4d711c0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d6c0ca9d0 0x7f4d6c1f24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:35.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.721+0000 7f4d711c0640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d6c0c9c20 0x7f4d6c0c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:35.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.721+0000 7f4d711c0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c1f2e40 con 0x7f4d540052a0 2023-11-04T01:43:35.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.721+0000 7f4d711c0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c1f3120 con 0x7f4d6c0ca9d0 2023-11-04T01:43:35.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.721+0000 7f4d711c0640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c1f3400 con 0x7f4d6c0c9c20 2023-11-04T01:43:35.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.721+0000 7f4d6ad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d540052a0 0x7f4d6c0afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:35.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.721+0000 7f4d6ad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d540052a0 0x7f4d6c0afe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35652/0 (socket says 172.21.15.77:35652) 2023-11-04T01:43:35.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.721+0000 7f4d6ad9d640 1 -- 172.21.15.77:0/2392482970 learned_addr learned my addr 172.21.15.77:0/2392482970 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:35.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.722+0000 7f4d6b59e640 1 --2- 172.21.15.77:0/2392482970 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d6c0c9c20 0x7f4d6c0c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:35.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.722+0000 7f4d6a59c640 1 --2- 172.21.15.77:0/2392482970 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d6c0ca9d0 0x7f4d6c1f24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:35.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.722+0000 7f4d6ad9d640 1 -- 172.21.15.77:0/2392482970 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d6c0c9c20 msgr2=0x7f4d6c0c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:35.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.722+0000 7f4d6ad9d640 1 --2- 172.21.15.77:0/2392482970 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d6c0c9c20 0x7f4d6c0c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:35.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.722+0000 7f4d6ad9d640 1 -- 172.21.15.77:0/2392482970 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d6c0ca9d0 msgr2=0x7f4d6c1f24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:35.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.722+0000 7f4d6ad9d640 1 --2- 172.21.15.77:0/2392482970 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d6c0ca9d0 0x7f4d6c1f24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:35.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.722+0000 7f4d6ad9d640 1 -- 172.21.15.77:0/2392482970 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d6c0c9420 con 0x7f4d540052a0 2023-11-04T01:43:35.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.722+0000 7f4d6ad9d640 1 --2- 172.21.15.77:0/2392482970 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d540052a0 0x7f4d6c0afe30 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c007290 tx=0x7f4d5c007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:35.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.722+0000 7f4d537fe640 1 -- 172.21.15.77:0/2392482970 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c00f9c0 con 0x7f4d540052a0 2023-11-04T01:43:35.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.722+0000 7f4d537fe640 1 -- 172.21.15.77:0/2392482970 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5c00fb40 con 0x7f4d540052a0 2023-11-04T01:43:35.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.722+0000 7f4d711c0640 1 -- 172.21.15.77:0/2392482970 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d6c0c9700 con 0x7f4d540052a0 2023-11-04T01:43:35.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.722+0000 7f4d537fe640 1 -- 172.21.15.77:0/2392482970 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c0133f0 con 0x7f4d540052a0 2023-11-04T01:43:35.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.722+0000 7f4d711c0640 1 -- 172.21.15.77:0/2392482970 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d6c1f2a30 con 0x7f4d540052a0 2023-11-04T01:43:35.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.723+0000 7f4d711c0640 1 -- 172.21.15.77:0/2392482970 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6c0c9920 con 0x7f4d540052a0 2023-11-04T01:43:35.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.723+0000 7f4d537fe640 1 -- 172.21.15.77:0/2392482970 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4d5c013550 con 0x7f4d540052a0 2023-11-04T01:43:35.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.724+0000 7f4d537fe640 1 --2- 172.21.15.77:0/2392482970 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4d5806aea0 0x7f4d5806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:35.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.724+0000 7f4d537fe640 1 -- 172.21.15.77:0/2392482970 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f4d5c089da0 con 0x7f4d540052a0 2023-11-04T01:43:35.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.724+0000 7f4d6a59c640 1 --2- 172.21.15.77:0/2392482970 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4d5806aea0 0x7f4d5806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:35.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.724+0000 7f4d6a59c640 1 --2- 172.21.15.77:0/2392482970 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4d5806aea0 0x7f4d5806d360 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c1f3660 tx=0x7f4d60008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:35.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.728+0000 7f4d537fe640 1 -- 172.21.15.77:0/2392482970 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4d5c0548d0 con 0x7f4d540052a0 2023-11-04T01:43:35.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:35.928+0000 7f4d711c0640 1 -- 172.21.15.77:0/2392482970 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f4d6c074290 con 0x7f4d540052a0 2023-11-04T01:43:36.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.599+0000 7f4d537fe640 1 -- 172.21.15.77:0/2392482970 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v45) v1 ==== 105+0+0 (secure 0 0 0) 0x7f4d5c089030 con 0x7f4d540052a0 2023-11-04T01:43:36.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.602+0000 7f4d711c0640 1 -- 172.21.15.77:0/2392482970 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4d5806aea0 msgr2=0x7f4d5806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.602+0000 7f4d711c0640 1 --2- 172.21.15.77:0/2392482970 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4d5806aea0 0x7f4d5806d360 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c1f3660 tx=0x7f4d60008040 comp rx=0 tx=0).stop 2023-11-04T01:43:36.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.602+0000 7f4d711c0640 1 -- 172.21.15.77:0/2392482970 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d540052a0 msgr2=0x7f4d6c0afe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.602+0000 7f4d711c0640 1 --2- 172.21.15.77:0/2392482970 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d540052a0 0x7f4d6c0afe30 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c007290 tx=0x7f4d5c007750 comp rx=0 tx=0).stop 2023-11-04T01:43:36.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.602+0000 7f4d711c0640 1 -- 172.21.15.77:0/2392482970 shutdown_connections 2023-11-04T01:43:36.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.602+0000 7f4d711c0640 1 --2- 172.21.15.77:0/2392482970 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4d5806aea0 0x7f4d5806d360 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.602+0000 7f4d711c0640 1 --2- 172.21.15.77:0/2392482970 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d6c0c9c20 0x7f4d6c0c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.602+0000 7f4d711c0640 1 --2- 172.21.15.77:0/2392482970 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d6c0ca9d0 0x7f4d6c1f24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.602+0000 7f4d711c0640 1 --2- 172.21.15.77:0/2392482970 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d540052a0 0x7f4d6c0afe30 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.602+0000 7f4d711c0640 1 -- 172.21.15.77:0/2392482970 >> 172.21.15.77:0/2392482970 conn(0x7f4d6c06a120 msgr2=0x7f4d6c06d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:36.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.602+0000 7f4d711c0640 1 -- 172.21.15.77:0/2392482970 shutdown_connections 2023-11-04T01:43:36.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.602+0000 7f4d711c0640 1 -- 172.21.15.77:0/2392482970 wait complete. 2023-11-04T01:43:36.621 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:36.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.724+0000 7f40ab821640 1 Processor -- start 2023-11-04T01:43:36.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.724+0000 7f40ab821640 1 -- start start 2023-11-04T01:43:36.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.725+0000 7f40ab821640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f40a40cda60 0x7f40a40ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.725+0000 7f40ab821640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40a40cc990 con 0x7f40a4070d40 2023-11-04T01:43:36.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.725+0000 7f40ab821640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40a40ccc70 con 0x7f40a40b0cd0 2023-11-04T01:43:36.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.725+0000 7f40ab821640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a40c9ce0 con 0x7f40a40cda60 2023-11-04T01:43:36.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.725+0000 7f40a9dbe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f40a4070d40 0x7f40a406c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:54256/0 (socket says 172.21.15.77:54256) 2023-11-04T01:43:36.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.725+0000 7f40a9dbe640 1 -- 172.21.15.77:0/1563826142 learned_addr learned my addr 172.21.15.77:0/1563826142 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:36.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.725+0000 7f409bfff640 1 -- 172.21.15.77:0/1563826142 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2946283320 0 0) 0x7f40a40cc990 con 0x7f40a4070d40 2023-11-04T01:43:36.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.725+0000 7f409bfff640 1 -- 172.21.15.77:0/1563826142 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4090003520 con 0x7f40a4070d40 2023-11-04T01:43:36.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.725+0000 7f40a95bd640 1 --2- 172.21.15.77:0/1563826142 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f40a40cda60 0x7f40a40ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.725+0000 7f409bfff640 1 -- 172.21.15.77:0/1563826142 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1412325977 0 0) 0x7f4090003520 con 0x7f40a4070d40 2023-11-04T01:43:36.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.725+0000 7f409bfff640 1 -- 172.21.15.77:0/1563826142 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f40a40cda60 msgr2=0x7f40a40ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:36.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.725+0000 7f409bfff640 1 --2- 172.21.15.77:0/1563826142 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f40a40cda60 0x7f40a40ca7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.725+0000 7f409bfff640 1 -- 172.21.15.77:0/1563826142 >> v1:172.21.15.122:6789/0 conn(0x7f40a40b0cd0 legacy=0x7f40a4070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.725+0000 7f409bfff640 1 -- 172.21.15.77:0/1563826142 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a40c9fc0 con 0x7f40a4070d40 2023-11-04T01:43:36.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.725+0000 7f409bfff640 1 -- 172.21.15.77:0/1563826142 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f409c0019f0 con 0x7f40a4070d40 2023-11-04T01:43:36.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.725+0000 7f409bfff640 1 -- 172.21.15.77:0/1563826142 >> v1:172.21.15.77:6789/0 conn(0x7f40a4070d40 legacy=0x7f40a406c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.725+0000 7f409bfff640 1 --2- 172.21.15.77:0/1563826142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40900039a0 0x7f4090003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.725+0000 7f409bfff640 1 --2- 172.21.15.77:0/1563826142 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f40a40cda60 0x7f40900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.725+0000 7f409bfff640 1 --2- 172.21.15.77:0/1563826142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4090004d00 0x7f4090005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.726+0000 7f409bfff640 1 -- 172.21.15.77:0/1563826142 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a40c9ce0 con 0x7f40900039a0 2023-11-04T01:43:36.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.726+0000 7f409bfff640 1 -- 172.21.15.77:0/1563826142 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409000ba30 con 0x7f4090004d00 2023-11-04T01:43:36.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.726+0000 7f409bfff640 1 -- 172.21.15.77:0/1563826142 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f409000bbf0 con 0x7f40a40cda60 2023-11-04T01:43:36.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.726+0000 7f40a95bd640 1 --2- 172.21.15.77:0/1563826142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40900039a0 0x7f4090003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.726+0000 7f40a8dbc640 1 --2- 172.21.15.77:0/1563826142 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f40a40cda60 0x7f40900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.726+0000 7f40a9dbe640 1 --2- 172.21.15.77:0/1563826142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4090004d00 0x7f4090005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.726+0000 7f40a95bd640 1 -- 172.21.15.77:0/1563826142 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f40a40cda60 msgr2=0x7f40900047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:36.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.726+0000 7f40a95bd640 1 --2- 172.21.15.77:0/1563826142 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f40a40cda60 0x7f40900047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.726+0000 7f40a95bd640 1 -- 172.21.15.77:0/1563826142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4090004d00 msgr2=0x7f4090005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:36.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.726+0000 7f40a95bd640 1 --2- 172.21.15.77:0/1563826142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4090004d00 0x7f4090005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.726+0000 7f40a95bd640 1 -- 172.21.15.77:0/1563826142 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4090003520 con 0x7f40900039a0 2023-11-04T01:43:36.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.726+0000 7f40a9dbe640 1 --2- 172.21.15.77:0/1563826142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4090004d00 0x7f4090005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:36.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.727+0000 7f40a95bd640 1 --2- 172.21.15.77:0/1563826142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40900039a0 0x7f4090003dc0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f40a0009a90 tx=0x7f40900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5900c3561e2f1c66 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:36.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.727+0000 7f409bfff640 1 -- 172.21.15.77:0/1563826142 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a002c680 con 0x7f40900039a0 2023-11-04T01:43:36.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.727+0000 7f409bfff640 1 -- 172.21.15.77:0/1563826142 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a002c7e0 con 0x7f40900039a0 2023-11-04T01:43:36.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.727+0000 7f409bfff640 1 -- 172.21.15.77:0/1563826142 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a002cb70 con 0x7f40900039a0 2023-11-04T01:43:36.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.727+0000 7f40ab821640 1 -- 172.21.15.77:0/1563826142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40900039a0 msgr2=0x7f4090003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.727+0000 7f40ab821640 1 --2- 172.21.15.77:0/1563826142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40900039a0 0x7f4090003dc0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f40a0009a90 tx=0x7f40900057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.727+0000 7f40a9dbe640 1 -- 172.21.15.77:0/1563826142 reap_dead start 2023-11-04T01:43:36.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.727+0000 7f40ab821640 1 -- 172.21.15.77:0/1563826142 shutdown_connections 2023-11-04T01:43:36.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.727+0000 7f40ab821640 1 -- 172.21.15.77:0/1563826142 >> 172.21.15.77:0/1563826142 conn(0x7f40a40ce950 msgr2=0x7f40a40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:36.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.727+0000 7f40ab821640 1 -- 172.21.15.77:0/1563826142 shutdown_connections 2023-11-04T01:43:36.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.727+0000 7f40ab821640 1 -- 172.21.15.77:0/1563826142 wait complete. 2023-11-04T01:43:36.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.728+0000 7f40ab821640 1 Processor -- start 2023-11-04T01:43:36.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.728+0000 7f40ab821640 1 -- start start 2023-11-04T01:43:36.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.729+0000 7f40ab821640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40900039a0 0x7f40a414eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.729+0000 7f40ab821640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40a415ca40 0x7f40a40b2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.729+0000 7f40ab821640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f40a4159e90 0x7f40a40b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.729+0000 7f40ab821640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a40b37a0 con 0x7f40a415ca40 2023-11-04T01:43:36.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.729+0000 7f40ab821640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a40b4770 con 0x7f40900039a0 2023-11-04T01:43:36.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.729+0000 7f40ab821640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a40c6fb0 con 0x7f40a4159e90 2023-11-04T01:43:36.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.729+0000 7f40a8dbc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40a415ca40 0x7f40a40b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.729+0000 7f40a8dbc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40a415ca40 0x7f40a40b2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35666/0 (socket says 172.21.15.77:35666) 2023-11-04T01:43:36.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.729+0000 7f40a8dbc640 1 -- 172.21.15.77:0/701953485 learned_addr learned my addr 172.21.15.77:0/701953485 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:36.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.729+0000 7f40a95bd640 1 --2- 172.21.15.77:0/701953485 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40900039a0 0x7f40a414eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.729+0000 7f40a9dbe640 1 --2- 172.21.15.77:0/701953485 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f40a4159e90 0x7f40a40b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.730+0000 7f40a8dbc640 1 -- 172.21.15.77:0/701953485 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f40a4159e90 msgr2=0x7f40a40b27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.730+0000 7f40a8dbc640 1 --2- 172.21.15.77:0/701953485 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f40a4159e90 0x7f40a40b27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.730+0000 7f40a8dbc640 1 -- 172.21.15.77:0/701953485 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40900039a0 msgr2=0x7f40a414eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.730+0000 7f40a8dbc640 1 --2- 172.21.15.77:0/701953485 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40900039a0 0x7f40a414eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.730+0000 7f40a8dbc640 1 -- 172.21.15.77:0/701953485 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a40c7290 con 0x7f40a415ca40 2023-11-04T01:43:36.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.730+0000 7f40a9dbe640 1 --2- 172.21.15.77:0/701953485 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f40a4159e90 0x7f40a40b27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:36.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.730+0000 7f40a8dbc640 1 --2- 172.21.15.77:0/701953485 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40a415ca40 0x7f40a40b2260 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f409400f820 tx=0x7f409400fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:36.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.730+0000 7f4099ffb640 1 -- 172.21.15.77:0/701953485 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40940050d0 con 0x7f40a415ca40 2023-11-04T01:43:36.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.730+0000 7f4099ffb640 1 -- 172.21.15.77:0/701953485 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4094005230 con 0x7f40a415ca40 2023-11-04T01:43:36.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.730+0000 7f4099ffb640 1 -- 172.21.15.77:0/701953485 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409400d730 con 0x7f40a415ca40 2023-11-04T01:43:36.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.730+0000 7f40ab821640 1 -- 172.21.15.77:0/701953485 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a40c7570 con 0x7f40a415ca40 2023-11-04T01:43:36.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.730+0000 7f40ab821640 1 -- 172.21.15.77:0/701953485 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a40b3400 con 0x7f40a415ca40 2023-11-04T01:43:36.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.731+0000 7f40ab821640 1 -- 172.21.15.77:0/701953485 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a40c6e10 con 0x7f40a415ca40 2023-11-04T01:43:36.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.731+0000 7f4099ffb640 1 -- 172.21.15.77:0/701953485 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f409400d890 con 0x7f40a415ca40 2023-11-04T01:43:36.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.732+0000 7f4099ffb640 1 --2- 172.21.15.77:0/701953485 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f408806ae70 0x7f408806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:36.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.732+0000 7f4099ffb640 1 -- 172.21.15.77:0/701953485 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f4094089a40 con 0x7f40a415ca40 2023-11-04T01:43:36.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.732+0000 7f40a95bd640 1 --2- 172.21.15.77:0/701953485 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f408806ae70 0x7f408806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:36.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.732+0000 7f40a95bd640 1 --2- 172.21.15.77:0/701953485 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f408806ae70 0x7f408806d330 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f40a0036000 tx=0x7f40a0030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:36.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.736+0000 7f4099ffb640 1 -- 172.21.15.77:0/701953485 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f40a40c6e10 con 0x7f40a415ca40 2023-11-04T01:43:36.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.937+0000 7f40ab821640 1 -- 172.21.15.77:0/701953485 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40a40c6e10 con 0x7f40a415ca40 2023-11-04T01:43:36.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.938+0000 7f4099ffb640 1 -- 172.21.15.77:0/701953485 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4940 (secure 0 0 0) 0x7f40a40c6e10 con 0x7f40a415ca40 2023-11-04T01:43:36.940 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:43:36.940 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":46,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7302,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/4241784871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4241784871},{"type":"v1","addr":"172.21.15.77:6834","nonce":4241784871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:43:36.603129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":35690,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:creating","state_seq":1,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_35690":{"gid":35690,"name":"b","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6836/3699147778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":3699147778},{"type":"v1","addr":"172.21.15.122:6836","nonce":3699147778}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:36.941 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 46 2023-11-04T01:43:36.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.940+0000 7f40ab821640 1 -- 172.21.15.77:0/701953485 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f408806ae70 msgr2=0x7f408806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.940+0000 7f40ab821640 1 --2- 172.21.15.77:0/701953485 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f408806ae70 0x7f408806d330 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f40a0036000 tx=0x7f40a0030000 comp rx=0 tx=0).stop 2023-11-04T01:43:36.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.940+0000 7f40ab821640 1 -- 172.21.15.77:0/701953485 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40a415ca40 msgr2=0x7f40a40b2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:36.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.940+0000 7f40ab821640 1 --2- 172.21.15.77:0/701953485 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40a415ca40 0x7f40a40b2260 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f409400f820 tx=0x7f409400fce0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.940+0000 7f40ab821640 1 -- 172.21.15.77:0/701953485 shutdown_connections 2023-11-04T01:43:36.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.940+0000 7f40ab821640 1 --2- 172.21.15.77:0/701953485 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f408806ae70 0x7f408806d330 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.940+0000 7f40ab821640 1 --2- 172.21.15.77:0/701953485 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f40a4159e90 0x7f40a40b27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.940+0000 7f40ab821640 1 --2- 172.21.15.77:0/701953485 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40a415ca40 0x7f40a40b2260 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.940+0000 7f40ab821640 1 --2- 172.21.15.77:0/701953485 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40900039a0 0x7f40a414eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:36.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.940+0000 7f40ab821640 1 -- 172.21.15.77:0/701953485 >> 172.21.15.77:0/701953485 conn(0x7f40a40ce950 msgr2=0x7f40a40b1570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:36.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.940+0000 7f40ab821640 1 -- 172.21.15.77:0/701953485 shutdown_connections 2023-11-04T01:43:36.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:36.940+0000 7f40ab821640 1 -- 172.21.15.77:0/701953485 wait complete. 2023-11-04T01:43:37.354 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 46, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-04T01:43:26.273417+0000', 'modified': '2023-11-04T01:43:36.603129+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 35690, 'mds_1': 7305}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7305': {'gid': 7305, 'name': 'c', 'rank': 1, 'incarnation': 46, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.77:6835/3207490604', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6833', 'nonce': 3207490604}, {'type': 'v1', 'addr': '172.21.15.77:6835', 'nonce': 3207490604}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_35690': {'gid': 35690, 'name': 'b', 'rank': 0, 'incarnation': 41, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.122:6836/3699147778', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6834', 'nonce': 3699147778}, {'type': 'v1', 'addr': '172.21.15.122:6836', 'nonce': 3699147778}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:43:37.355 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7305:up:creating 2023-11-04T01:43:38.356 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:38.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.464+0000 7f3ee95c0640 1 Processor -- start 2023-11-04T01:43:38.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.464+0000 7f3ee95c0640 1 -- start start 2023-11-04T01:43:38.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.465+0000 7f3ee95c0640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3ee40cde60 0x7f3ee415d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:38.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.465+0000 7f3ee95c0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3ee415daa0 0x7f3ee4157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:38.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.465+0000 7f3ee95c0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ee415e000 con 0x7f3ee40ce240 2023-11-04T01:43:38.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.465+0000 7f3ee95c0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ee415e5c0 con 0x7f3ee415daa0 2023-11-04T01:43:38.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.465+0000 7f3ee95c0640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ee415e2e0 con 0x7f3ee40cde60 2023-11-04T01:43:38.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.465+0000 7f3ee27fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3ee415daa0 0x7f3ee4157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:38.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.465+0000 7f3ee37fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f3ee40ce240 0x7f3ee406b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:48562/0 (socket says 172.21.15.77:48562) 2023-11-04T01:43:38.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.465+0000 7f3ee37fe640 1 -- 172.21.15.77:0/3353645355 learned_addr learned my addr 172.21.15.77:0/3353645355 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:38.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.465+0000 7f3ee2ffd640 1 --2- 172.21.15.77:0/3353645355 >> v2:172.21.15.122:3300/0 conn(0x7f3ee40cde60 0x7f3ee415d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:38.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.465+0000 7f3ee27fc640 1 -- 172.21.15.77:0/3353645355 >> v2:172.21.15.122:3300/0 conn(0x7f3ee40cde60 msgr2=0x7f3ee415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:38.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.465+0000 7f3ee27fc640 1 --2- 172.21.15.77:0/3353645355 >> v2:172.21.15.122:3300/0 conn(0x7f3ee40cde60 0x7f3ee415d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:38.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.465+0000 7f3ee27fc640 1 -- 172.21.15.77:0/3353645355 >> v1:172.21.15.77:6789/0 conn(0x7f3ee40ce240 legacy=0x7f3ee406b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:38.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.465+0000 7f3ee27fc640 1 -- 172.21.15.77:0/3353645355 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee40d1120 con 0x7f3ee415daa0 2023-11-04T01:43:38.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.465+0000 7f3ee1ffb640 1 -- 172.21.15.77:0/3353645355 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1583179334 0 0) 0x7f3ee415e000 con 0x7f3ee40ce240 2023-11-04T01:43:38.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.466+0000 7f3ee27fc640 1 --2- 172.21.15.77:0/3353645355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ee415daa0 0x7f3ee4157000 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f3ee40b5550 tx=0x7f3ed802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f202b678582c32b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:38.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.466+0000 7f3ee1ffb640 1 -- 172.21.15.77:0/3353645355 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed8031830 con 0x7f3ee415daa0 2023-11-04T01:43:38.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.466+0000 7f3ee1ffb640 1 -- 172.21.15.77:0/3353645355 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed8031990 con 0x7f3ee415daa0 2023-11-04T01:43:38.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.466+0000 7f3ee1ffb640 1 -- 172.21.15.77:0/3353645355 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed8031d20 con 0x7f3ee415daa0 2023-11-04T01:43:38.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.467+0000 7f3ee95c0640 1 -- 172.21.15.77:0/3353645355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ee415daa0 msgr2=0x7f3ee4157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:38.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.467+0000 7f3ee95c0640 1 --2- 172.21.15.77:0/3353645355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ee415daa0 0x7f3ee4157000 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f3ee40b5550 tx=0x7f3ed802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:38.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.467+0000 7f3ee95c0640 1 -- 172.21.15.77:0/3353645355 shutdown_connections 2023-11-04T01:43:38.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.467+0000 7f3ee95c0640 1 --2- 172.21.15.77:0/3353645355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ee415daa0 0x7f3ee4157000 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:38.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.467+0000 7f3ee95c0640 1 --2- 172.21.15.77:0/3353645355 >> v2:172.21.15.122:3300/0 conn(0x7f3ee40cde60 0x7f3ee415d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:38.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.467+0000 7f3ee95c0640 1 -- 172.21.15.77:0/3353645355 >> 172.21.15.77:0/3353645355 conn(0x7f3ee4071f30 msgr2=0x7f3ee40cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:38.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.467+0000 7f3ee95c0640 1 -- 172.21.15.77:0/3353645355 shutdown_connections 2023-11-04T01:43:38.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.467+0000 7f3ee95c0640 1 -- 172.21.15.77:0/3353645355 wait complete. 2023-11-04T01:43:38.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.468+0000 7f3ee95c0640 1 Processor -- start 2023-11-04T01:43:38.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.468+0000 7f3ee95c0640 1 -- start start 2023-11-04T01:43:38.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.469+0000 7f3ee95c0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ee40cde60 0x7f3ee41f2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:38.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.469+0000 7f3ee95c0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ee40ce240 0x7f3ee40cca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:38.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.469+0000 7f3ee95c0640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3ee415daa0 0x7f3ee40ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:38.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.469+0000 7f3ee95c0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee41f5ee0 con 0x7f3ee40cde60 2023-11-04T01:43:38.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.469+0000 7f3ee95c0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee41f61c0 con 0x7f3ee40ce240 2023-11-04T01:43:38.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.469+0000 7f3ee95c0640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee41f64a0 con 0x7f3ee415daa0 2023-11-04T01:43:38.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.469+0000 7f3ee2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ee40cde60 0x7f3ee41f2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:38.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.469+0000 7f3ee2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ee40cde60 0x7f3ee41f2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35014/0 (socket says 172.21.15.77:35014) 2023-11-04T01:43:38.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.469+0000 7f3ee2ffd640 1 -- 172.21.15.77:0/3103547271 learned_addr learned my addr 172.21.15.77:0/3103547271 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:38.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.469+0000 7f3ee27fc640 1 --2- 172.21.15.77:0/3103547271 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ee40ce240 0x7f3ee40cca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:38.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.469+0000 7f3ee37fe640 1 --2- 172.21.15.77:0/3103547271 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3ee415daa0 0x7f3ee40ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:38.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.469+0000 7f3ee2ffd640 1 -- 172.21.15.77:0/3103547271 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3ee415daa0 msgr2=0x7f3ee40ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:38.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.469+0000 7f3ee2ffd640 1 --2- 172.21.15.77:0/3103547271 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3ee415daa0 0x7f3ee40ccf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:38.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.469+0000 7f3ee2ffd640 1 -- 172.21.15.77:0/3103547271 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ee40ce240 msgr2=0x7f3ee40cca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:38.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.469+0000 7f3ee2ffd640 1 --2- 172.21.15.77:0/3103547271 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ee40ce240 0x7f3ee40cca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:38.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.469+0000 7f3ee2ffd640 1 -- 172.21.15.77:0/3103547271 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed8009400 con 0x7f3ee40cde60 2023-11-04T01:43:38.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.469+0000 7f3ee27fc640 1 --2- 172.21.15.77:0/3103547271 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ee40ce240 0x7f3ee40cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:38.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.470+0000 7f3ee2ffd640 1 --2- 172.21.15.77:0/3103547271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ee40cde60 0x7f3ee41f2020 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f3ed400d800 tx=0x7f3ed400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:38.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.470+0000 7f3ecb7fe640 1 -- 172.21.15.77:0/3103547271 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed400b6c0 con 0x7f3ee40cde60 2023-11-04T01:43:38.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.470+0000 7f3ecb7fe640 1 -- 172.21.15.77:0/3103547271 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed400b820 con 0x7f3ee40cde60 2023-11-04T01:43:38.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.470+0000 7f3ee95c0640 1 -- 172.21.15.77:0/3103547271 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ee41f6780 con 0x7f3ee40cde60 2023-11-04T01:43:38.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.470+0000 7f3ecb7fe640 1 -- 172.21.15.77:0/3103547271 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed400bbb0 con 0x7f3ee40cde60 2023-11-04T01:43:38.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.470+0000 7f3ee95c0640 1 -- 172.21.15.77:0/3103547271 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee414e850 con 0x7f3ee40cde60 2023-11-04T01:43:38.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.471+0000 7f3ee95c0640 1 -- 172.21.15.77:0/3103547271 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ee4074290 con 0x7f3ee40cde60 2023-11-04T01:43:38.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.471+0000 7f3ecb7fe640 1 -- 172.21.15.77:0/3103547271 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3ed400bd10 con 0x7f3ee40cde60 2023-11-04T01:43:38.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.472+0000 7f3ecb7fe640 1 --2- 172.21.15.77:0/3103547271 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3ed006ae70 0x7f3ed006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:38.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.472+0000 7f3ecb7fe640 1 -- 172.21.15.77:0/3103547271 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f3ed408a0a0 con 0x7f3ee40cde60 2023-11-04T01:43:38.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.472+0000 7f3ee27fc640 1 --2- 172.21.15.77:0/3103547271 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3ed006ae70 0x7f3ed006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:38.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.472+0000 7f3ee27fc640 1 --2- 172.21.15.77:0/3103547271 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3ed006ae70 0x7f3ed006d330 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8036000 tx=0x7f3ed8008030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:38.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.476+0000 7f3ecb7fe640 1 -- 172.21.15.77:0/3103547271 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3ed4054c60 con 0x7f3ee40cde60 2023-11-04T01:43:38.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.677+0000 7f3ee95c0640 1 -- 172.21.15.77:0/3103547271 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ee40d38a0 con 0x7f3ee40cde60 2023-11-04T01:43:38.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.678+0000 7f3ecb7fe640 1 -- 172.21.15.77:0/3103547271 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f3ed4058280 con 0x7f3ee40cde60 2023-11-04T01:43:38.680 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:43:38.680 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7302,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/4241784871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4241784871},{"type":"v1","addr":"172.21.15.77:6834","nonce":4241784871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:43:36.620245+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":35690,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_35690":{"gid":35690,"name":"b","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6836/3699147778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":3699147778},{"type":"v1","addr":"172.21.15.122:6836","nonce":3699147778}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:38.681 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 47 2023-11-04T01:43:38.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.679+0000 7f3ee95c0640 1 -- 172.21.15.77:0/3103547271 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3ed006ae70 msgr2=0x7f3ed006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:38.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.679+0000 7f3ee95c0640 1 --2- 172.21.15.77:0/3103547271 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3ed006ae70 0x7f3ed006d330 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8036000 tx=0x7f3ed8008030 comp rx=0 tx=0).stop 2023-11-04T01:43:38.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.679+0000 7f3ee95c0640 1 -- 172.21.15.77:0/3103547271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ee40cde60 msgr2=0x7f3ee41f2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:38.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.679+0000 7f3ee95c0640 1 --2- 172.21.15.77:0/3103547271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ee40cde60 0x7f3ee41f2020 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f3ed400d800 tx=0x7f3ed400dcc0 comp rx=0 tx=0).stop 2023-11-04T01:43:38.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.679+0000 7f3ee95c0640 1 -- 172.21.15.77:0/3103547271 shutdown_connections 2023-11-04T01:43:38.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.679+0000 7f3ee95c0640 1 --2- 172.21.15.77:0/3103547271 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3ed006ae70 0x7f3ed006d330 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:38.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.679+0000 7f3ee95c0640 1 --2- 172.21.15.77:0/3103547271 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3ee415daa0 0x7f3ee40ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:38.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.679+0000 7f3ee95c0640 1 --2- 172.21.15.77:0/3103547271 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ee40ce240 0x7f3ee40cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:38.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.679+0000 7f3ee95c0640 1 --2- 172.21.15.77:0/3103547271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ee40cde60 0x7f3ee41f2020 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:38.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.679+0000 7f3ee95c0640 1 -- 172.21.15.77:0/3103547271 >> 172.21.15.77:0/3103547271 conn(0x7f3ee4071f30 msgr2=0x7f3ee40c90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:38.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.680+0000 7f3ee95c0640 1 -- 172.21.15.77:0/3103547271 shutdown_connections 2023-11-04T01:43:38.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:38.680+0000 7f3ee95c0640 1 -- 172.21.15.77:0/3103547271 wait complete. 2023-11-04T01:43:39.095 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-04T01:43:26.273417+0000', 'modified': '2023-11-04T01:43:36.620245+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 35690, 'mds_1': 7305}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7305': {'gid': 7305, 'name': 'c', 'rank': 1, 'incarnation': 46, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.77:6835/3207490604', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6833', 'nonce': 3207490604}, {'type': 'v1', 'addr': '172.21.15.77:6835', 'nonce': 3207490604}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_35690': {'gid': 35690, 'name': 'b', 'rank': 0, 'incarnation': 41, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.122:6836/3699147778', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6834', 'nonce': 3699147778}, {'type': 'v1', 'addr': '172.21.15.122:6836', 'nonce': 3699147778}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:43:39.095 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-11-04T01:43:39.096 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-04T01:43:39.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.199+0000 7f552ee10640 1 Processor -- start 2023-11-04T01:43:39.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.199+0000 7f552ee10640 1 -- start start 2023-11-04T01:43:39.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.200+0000 7f552ee10640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5528159c00 0x7f55280cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.200+0000 7f552ee10640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f55280c48e0 0x7f55280c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.200+0000 7f552ee10640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f552815aff0 con 0x7f55280adac0 2023-11-04T01:43:39.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.200+0000 7f552ee10640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55280c52d0 con 0x7f5528159c00 2023-11-04T01:43:39.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.200+0000 7f552ee10640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f552815a3e0 con 0x7f55280c48e0 2023-11-04T01:43:39.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.200+0000 7f552cbac640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5528159c00 0x7f55280cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.200+0000 7f552cbac640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5528159c00 0x7f55280cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35018/0 (socket says 172.21.15.77:35018) 2023-11-04T01:43:39.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.200+0000 7f552cbac640 1 -- 172.21.15.77:0/174198977 learned_addr learned my addr 172.21.15.77:0/174198977 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:39.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.200+0000 7f5527fff640 1 --2- 172.21.15.77:0/174198977 >> v2:172.21.15.122:3300/0 conn(0x7f55280c48e0 0x7f55280c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.200+0000 7f552cbac640 1 -- 172.21.15.77:0/174198977 >> v2:172.21.15.122:3300/0 conn(0x7f55280c48e0 msgr2=0x7f55280c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:39.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.201+0000 7f552cbac640 1 --2- 172.21.15.77:0/174198977 >> v2:172.21.15.122:3300/0 conn(0x7f55280c48e0 0x7f55280c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.201+0000 7f552cbac640 1 -- 172.21.15.77:0/174198977 >> v1:172.21.15.122:6789/0 conn(0x7f55280adac0 legacy=0x7f55280adea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:39.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.201+0000 7f552cbac640 1 -- 172.21.15.77:0/174198977 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f552815a6c0 con 0x7f5528159c00 2023-11-04T01:43:39.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.201+0000 7f5527fff640 1 --2- 172.21.15.77:0/174198977 >> v2:172.21.15.122:3300/0 conn(0x7f55280c48e0 0x7f55280c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:39.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.201+0000 7f552cbac640 1 --2- 172.21.15.77:0/174198977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5528159c00 0x7f55280cc890 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f552806ebb0 tx=0x7f551802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=392ba8675dcc625c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:39.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.201+0000 7f55277fe640 1 -- 172.21.15.77:0/174198977 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5518031870 con 0x7f5528159c00 2023-11-04T01:43:39.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.201+0000 7f55277fe640 1 -- 172.21.15.77:0/174198977 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55180319d0 con 0x7f5528159c00 2023-11-04T01:43:39.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.201+0000 7f55277fe640 1 -- 172.21.15.77:0/174198977 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5518031d60 con 0x7f5528159c00 2023-11-04T01:43:39.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.202+0000 7f552ee10640 1 -- 172.21.15.77:0/174198977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5528159c00 msgr2=0x7f55280cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.202+0000 7f552ee10640 1 --2- 172.21.15.77:0/174198977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5528159c00 0x7f55280cc890 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f552806ebb0 tx=0x7f551802b910 comp rx=0 tx=0).stop 2023-11-04T01:43:39.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.202+0000 7f552ee10640 1 -- 172.21.15.77:0/174198977 shutdown_connections 2023-11-04T01:43:39.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.202+0000 7f552ee10640 1 --2- 172.21.15.77:0/174198977 >> v2:172.21.15.122:3300/0 conn(0x7f55280c48e0 0x7f55280c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.202+0000 7f552ee10640 1 --2- 172.21.15.77:0/174198977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5528159c00 0x7f55280cc890 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.202+0000 7f552ee10640 1 -- 172.21.15.77:0/174198977 >> 172.21.15.77:0/174198977 conn(0x7f55280ce950 msgr2=0x7f55280ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:39.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.202+0000 7f552ee10640 1 -- 172.21.15.77:0/174198977 shutdown_connections 2023-11-04T01:43:39.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.202+0000 7f552ee10640 1 -- 172.21.15.77:0/174198977 wait complete. 2023-11-04T01:43:39.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.203+0000 7f552ee10640 1 Processor -- start 2023-11-04T01:43:39.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.203+0000 7f552ee10640 1 -- start start 2023-11-04T01:43:39.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.204+0000 7f552ee10640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55280adac0 0x7f55280c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.204+0000 7f552ee10640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55280c48e0 0x7f552814afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.204+0000 7f552ee10640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5528159c00 0x7f55281426d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.204+0000 7f552ee10640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552814b520 con 0x7f5528159c00 2023-11-04T01:43:39.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.204+0000 7f552ee10640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55280c7740 con 0x7f55280c48e0 2023-11-04T01:43:39.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.204+0000 7f552ee10640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55280c6b30 con 0x7f55280adac0 2023-11-04T01:43:39.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.204+0000 7f552d3ad640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5528159c00 0x7f55281426d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.204+0000 7f552d3ad640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5528159c00 0x7f55281426d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35030/0 (socket says 172.21.15.77:35030) 2023-11-04T01:43:39.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.204+0000 7f552d3ad640 1 -- 172.21.15.77:0/2833091419 learned_addr learned my addr 172.21.15.77:0/2833091419 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:39.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.204+0000 7f552cbac640 1 --2- 172.21.15.77:0/2833091419 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55280adac0 0x7f55280c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.204+0000 7f552d3ad640 1 -- 172.21.15.77:0/2833091419 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55280adac0 msgr2=0x7f55280c6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.204+0000 7f552d3ad640 1 --2- 172.21.15.77:0/2833091419 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55280adac0 0x7f55280c6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.204+0000 7f552d3ad640 1 -- 172.21.15.77:0/2833091419 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55280c48e0 msgr2=0x7f552814afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.204+0000 7f552d3ad640 1 --2- 172.21.15.77:0/2833091419 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55280c48e0 0x7f552814afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.204+0000 7f552d3ad640 1 -- 172.21.15.77:0/2833091419 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55180094d0 con 0x7f5528159c00 2023-11-04T01:43:39.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.205+0000 7f552d3ad640 1 --2- 172.21.15.77:0/2833091419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5528159c00 0x7f55281426d0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f552000c7d0 tx=0x7f552000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:39.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.205+0000 7f55257fa640 1 -- 172.21.15.77:0/2833091419 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5520003b70 con 0x7f5528159c00 2023-11-04T01:43:39.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.205+0000 7f55257fa640 1 -- 172.21.15.77:0/2833091419 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5520003cd0 con 0x7f5528159c00 2023-11-04T01:43:39.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.205+0000 7f552ee10640 1 -- 172.21.15.77:0/2833091419 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55280c6e10 con 0x7f5528159c00 2023-11-04T01:43:39.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.205+0000 7f55257fa640 1 -- 172.21.15.77:0/2833091419 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552000aa90 con 0x7f5528159c00 2023-11-04T01:43:39.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.205+0000 7f552ee10640 1 -- 172.21.15.77:0/2833091419 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55280c73d0 con 0x7f5528159c00 2023-11-04T01:43:39.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.207+0000 7f55257fa640 1 -- 172.21.15.77:0/2833091419 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f552000abf0 con 0x7f5528159c00 2023-11-04T01:43:39.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.207+0000 7f55257fa640 1 --2- 172.21.15.77:0/2833091419 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f551406ae70 0x7f551406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.207+0000 7f55257fa640 1 -- 172.21.15.77:0/2833091419 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f55200899f0 con 0x7f5528159c00 2023-11-04T01:43:39.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.207+0000 7f552cbac640 1 --2- 172.21.15.77:0/2833091419 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f551406ae70 0x7f551406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.208+0000 7f552cbac640 1 --2- 172.21.15.77:0/2833091419 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f551406ae70 0x7f551406d330 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5518036000 tx=0x7f551803c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:39.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.208+0000 7f55319a3740 1 Processor -- start 2023-11-04T01:43:39.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.208+0000 7f55319a3740 1 -- start start 2023-11-04T01:43:39.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.208+0000 7f55319a3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c65702850 0x560c656d5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.208+0000 7f55319a3740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c65702c30 0x560c657055e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.208+0000 7f55319a3740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560c656d5c90 0x560c65705b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.209+0000 7f55319a3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c655e6740 con 0x560c65702850 2023-11-04T01:43:39.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.209+0000 7f55319a3740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c656488d0 con 0x560c65702c30 2023-11-04T01:43:39.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.209+0000 7f55319a3740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x560c65645fc0 con 0x560c656d5c90 2023-11-04T01:43:39.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.209+0000 7f552cbac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c65702850 0x560c656d5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.209+0000 7f552cbac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c65702850 0x560c656d5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35042/0 (socket says 172.21.15.77:35042) 2023-11-04T01:43:39.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.209+0000 7f552cbac640 1 -- 172.21.15.77:0/1157939432 learned_addr learned my addr 172.21.15.77:0/1157939432 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:39.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.209+0000 7f5527fff640 1 --2- 172.21.15.77:0/1157939432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c65702c30 0x560c657055e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.209+0000 7f552d3ad640 1 --2- 172.21.15.77:0/1157939432 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560c656d5c90 0x560c65705b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.209+0000 7f552cbac640 1 -- 172.21.15.77:0/1157939432 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560c656d5c90 msgr2=0x560c65705b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:39.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.209+0000 7f552cbac640 1 --2- 172.21.15.77:0/1157939432 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560c656d5c90 0x560c65705b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.209+0000 7f552cbac640 1 -- 172.21.15.77:0/1157939432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c65702c30 msgr2=0x560c657055e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:39.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.209+0000 7f552cbac640 1 --2- 172.21.15.77:0/1157939432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c65702c30 0x560c657055e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.209+0000 7f552cbac640 1 -- 172.21.15.77:0/1157939432 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c65604ca0 con 0x560c65702850 2023-11-04T01:43:39.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.209+0000 7f552cbac640 1 --2- 172.21.15.77:0/1157939432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c65702850 0x560c656d5750 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f551802bf20 tx=0x7f5518030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=847c2b3a56058034 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:39.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.209+0000 7f550e7fc640 1 -- 172.21.15.77:0/1157939432 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5518050480 con 0x560c65702850 2023-11-04T01:43:39.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.209+0000 7f550e7fc640 1 -- 172.21.15.77:0/1157939432 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5518049070 con 0x560c65702850 2023-11-04T01:43:39.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.209+0000 7f550e7fc640 1 -- 172.21.15.77:0/1157939432 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55180507e0 con 0x560c65702850 2023-11-04T01:43:39.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.210+0000 7f55319a3740 1 -- 172.21.15.77:0/1157939432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c65702850 msgr2=0x560c656d5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.210+0000 7f55319a3740 1 --2- 172.21.15.77:0/1157939432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c65702850 0x560c656d5750 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f551802bf20 tx=0x7f5518030000 comp rx=0 tx=0).stop 2023-11-04T01:43:39.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.210+0000 7f55319a3740 1 -- 172.21.15.77:0/1157939432 shutdown_connections 2023-11-04T01:43:39.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.210+0000 7f55319a3740 1 --2- 172.21.15.77:0/1157939432 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560c656d5c90 0x560c65705b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.210+0000 7f55319a3740 1 --2- 172.21.15.77:0/1157939432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c65702c30 0x560c657055e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.210+0000 7f55319a3740 1 --2- 172.21.15.77:0/1157939432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c65702850 0x560c656d5750 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.210+0000 7f55319a3740 1 -- 172.21.15.77:0/1157939432 >> 172.21.15.77:0/1157939432 conn(0x560c656d7a60 msgr2=0x560c657205e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:39.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.210+0000 7f55319a3740 1 -- 172.21.15.77:0/1157939432 shutdown_connections 2023-11-04T01:43:39.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.210+0000 7f55319a3740 1 -- 172.21.15.77:0/1157939432 wait complete. 2023-11-04T01:43:39.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.210+0000 7f55319a3740 1 -- start start 2023-11-04T01:43:39.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.211+0000 7f55319a3740 1 Processor -- start 2023-11-04T01:43:39.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.211+0000 7f55319a3740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560c65702850 0x560c656f0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.211+0000 7f55319a3740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c65702c30 0x560c657207c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.211+0000 7f55319a3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c65708760 0x560c65708be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.211+0000 7f55319a3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c656418b0 con 0x560c65708760 2023-11-04T01:43:39.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.211+0000 7f55319a3740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c655fbc80 con 0x560c65702c30 2023-11-04T01:43:39.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.211+0000 7f55319a3740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x560c655fb920 con 0x560c65702850 2023-11-04T01:43:39.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.211+0000 7f55319a3740 10 client.0 _ll_register_callbacks cb 0x560c65353ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:43:39.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.211+0000 7f552d3ad640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c65708760 0x560c65708be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.212+0000 7f552d3ad640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c65708760 0x560c65708be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35044/0 (socket says 172.21.15.77:35044) 2023-11-04T01:43:39.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.212+0000 7f552d3ad640 1 -- 172.21.15.77:0/43420538 learned_addr learned my addr 172.21.15.77:0/43420538 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:39.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.212+0000 7f5527fff640 1 --2- 172.21.15.77:0/43420538 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c65702c30 0x560c657207c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.212+0000 7f552cbac640 1 --2- 172.21.15.77:0/43420538 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560c65702850 0x560c656f0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.212+0000 7f552d3ad640 1 -- 172.21.15.77:0/43420538 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560c65702850 msgr2=0x560c656f0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:39.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.212+0000 7f552d3ad640 1 --2- 172.21.15.77:0/43420538 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560c65702850 0x560c656f0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.212+0000 7f552d3ad640 1 -- 172.21.15.77:0/43420538 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c65702c30 msgr2=0x560c657207c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:39.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.212+0000 7f552d3ad640 1 --2- 172.21.15.77:0/43420538 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c65702c30 0x560c657207c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.212+0000 7f552d3ad640 1 -- 172.21.15.77:0/43420538 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f552815a6c0 con 0x560c65708760 2023-11-04T01:43:39.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.212+0000 7f552d3ad640 1 --2- 172.21.15.77:0/43420538 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c65708760 0x560c65708be0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f5520002230 tx=0x7f5520057c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26e6b3c54ce5d54 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:39.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.212+0000 7f55077fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:43:39.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.212+0000 7f55077fe640 1 -- 172.21.15.77:0/43420538 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552005c170 con 0x560c65708760 2023-11-04T01:43:39.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.212+0000 7f55077fe640 1 -- 172.21.15.77:0/43420538 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f552005c330 con 0x560c65708760 2023-11-04T01:43:39.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.212+0000 7f55319a3740 1 -- 172.21.15.77:0/43420538 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560c655edbf0 con 0x560c65708760 2023-11-04T01:43:39.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.212+0000 7f55077fe640 1 -- 172.21.15.77:0/43420538 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55200604e0 con 0x560c65708760 2023-11-04T01:43:39.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.212+0000 7f55319a3740 10 client.7527 fetch_fsmap learned FSMap version 47 2023-11-04T01:43:39.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.212+0000 7f55319a3740 1 -- 172.21.15.77:0/43420538 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x560c6563ff30 con 0x560c65708760 2023-11-04T01:43:39.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.212+0000 7f55077fe640 1 -- 172.21.15.77:0/43420538 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5520073080 con 0x560c65708760 2023-11-04T01:43:39.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.212+0000 7f55077fe640 1 -- 172.21.15.77:0/43420538 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 47) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f5520019020 con 0x560c65708760 2023-11-04T01:43:39.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.212+0000 7f55319a3740 10 client.7527 fetch_fsmap finished waiting for FSMap version 47 2023-11-04T01:43:39.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.212+0000 7f55319a3740 10 client.7527 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:43:39.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.213+0000 7f55319a3740 20 client.7527 populate_metadata read hostname 'smithi077' 2023-11-04T01:43:39.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.213+0000 7f55319a3740 1 --2- 172.21.15.77:0/43420538 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x560c65733bf0 0x560c65733fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.213+0000 7f55319a3740 4 client.7527 mds_command: new command op to 7305 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:43:39.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.213+0000 7f55319a3740 1 -- 172.21.15.77:0/43420538 --> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560c6563a890 con 0x560c65733bf0 2023-11-04T01:43:39.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.213+0000 7f552cbac640 1 --2- 172.21.15.77:0/43420538 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x560c65733bf0 0x560c65733fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.213+0000 7f55077fe640 10 client.7527 ms_handle_connect on v2:172.21.15.77:6833/3207490604 2023-11-04T01:43:39.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.213+0000 7f552cbac640 1 --2- 172.21.15.77:0/43420538 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x560c65733bf0 0x560c65733fd0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d84768bf8f41b431 server_cookie=865fe86f6bac941c in_seq=0 out_seq=0 2023-11-04T01:43:39.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.213+0000 7f55077fe640 1 -- 172.21.15.77:0/43420538 <== mds.1 v2:172.21.15.77:6833/3207490604 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560c6563a890 con 0x560c65733bf0 2023-11-04T01:43:39.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.213+0000 7f55077fe640 10 client.7527 handle_command_reply: tid=0 2023-11-04T01:43:39.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.213+0000 7f55319a3740 1 client.7527 shutdown 2023-11-04T01:43:39.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.214+0000 7f55319a3740 1 -- 172.21.15.77:0/43420538 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c65708760 msgr2=0x560c65708be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.214+0000 7f55319a3740 1 --2- 172.21.15.77:0/43420538 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c65708760 0x560c65708be0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f5520002230 tx=0x7f5520057c00 comp rx=0 tx=0).stop 2023-11-04T01:43:39.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.214+0000 7f55319a3740 1 -- 172.21.15.77:0/43420538 shutdown_connections 2023-11-04T01:43:39.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.214+0000 7f55319a3740 1 --2- 172.21.15.77:0/43420538 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c65708760 0x560c65708be0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.214+0000 7f55319a3740 1 --2- 172.21.15.77:0/43420538 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x560c65733bf0 0x560c65733fd0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.214+0000 7f55319a3740 1 --2- 172.21.15.77:0/43420538 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c65702c30 0x560c657207c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.214+0000 7f55319a3740 1 --2- 172.21.15.77:0/43420538 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560c65702850 0x560c656f0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.214+0000 7f55077fe640 0 client.7527 ms_handle_reset on v2:172.21.15.77:6833/3207490604 2023-11-04T01:43:39.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.214+0000 7f55319a3740 1 -- 172.21.15.77:0/43420538 >> 172.21.15.77:0/43420538 conn(0x560c656d5c90 msgr2=0x560c656d96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:39.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.214+0000 7f55319a3740 1 -- 172.21.15.77:0/43420538 shutdown_connections 2023-11-04T01:43:39.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.214+0000 7f55319a3740 1 -- 172.21.15.77:0/43420538 wait complete. 2023-11-04T01:43:39.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.214+0000 7f55319a3740 20 client.7527 trim_cache size 0 max 16384 2023-11-04T01:43:39.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.229+0000 7f55319a3740 1 Processor -- start 2023-11-04T01:43:39.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.229+0000 7f55319a3740 1 -- start start 2023-11-04T01:43:39.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.230+0000 7f55319a3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c65702850 0x560c65722aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.230+0000 7f55319a3740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c65702c30 0x560c65743240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.230+0000 7f55319a3740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560c65708760 0x560c656d44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.230+0000 7f55319a3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c655c1280 con 0x560c65702850 2023-11-04T01:43:39.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.230+0000 7f55319a3740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c656efff0 con 0x560c65702c30 2023-11-04T01:43:39.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.230+0000 7f55319a3740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x560c6573aad0 con 0x560c65708760 2023-11-04T01:43:39.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.230+0000 7f552cbac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c65702850 0x560c65722aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.230+0000 7f552cbac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c65702850 0x560c65722aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35060/0 (socket says 172.21.15.77:35060) 2023-11-04T01:43:39.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.230+0000 7f552cbac640 1 -- 172.21.15.77:0/3827894966 learned_addr learned my addr 172.21.15.77:0/3827894966 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:39.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.230+0000 7f552d3ad640 1 --2- 172.21.15.77:0/3827894966 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560c65708760 0x560c656d44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.230+0000 7f5527fff640 1 --2- 172.21.15.77:0/3827894966 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c65702c30 0x560c65743240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.230+0000 7f552cbac640 1 -- 172.21.15.77:0/3827894966 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560c65708760 msgr2=0x560c656d44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:39.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.230+0000 7f552cbac640 1 --2- 172.21.15.77:0/3827894966 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560c65708760 0x560c656d44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.230+0000 7f552cbac640 1 -- 172.21.15.77:0/3827894966 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c65702c30 msgr2=0x560c65743240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:39.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.230+0000 7f552cbac640 1 --2- 172.21.15.77:0/3827894966 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c65702c30 0x560c65743240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.230+0000 7f552cbac640 1 -- 172.21.15.77:0/3827894966 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c655ddd10 con 0x560c65702850 2023-11-04T01:43:39.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.230+0000 7f5527fff640 1 --2- 172.21.15.77:0/3827894966 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c65702c30 0x560c65743240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:39.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.230+0000 7f552cbac640 1 --2- 172.21.15.77:0/3827894966 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c65702850 0x560c65722aa0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f5518009960 tx=0x7f5518031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68f762706ee3b9ef server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:39.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.230+0000 7f550effd640 1 -- 172.21.15.77:0/3827894966 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5518058d70 con 0x560c65702850 2023-11-04T01:43:39.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.230+0000 7f550effd640 1 -- 172.21.15.77:0/3827894966 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5518058360 con 0x560c65702850 2023-11-04T01:43:39.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.231+0000 7f550effd640 1 -- 172.21.15.77:0/3827894966 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55180586d0 con 0x560c65702850 2023-11-04T01:43:39.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.231+0000 7f55319a3740 1 -- 172.21.15.77:0/3827894966 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c65702850 msgr2=0x560c65722aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.231+0000 7f55319a3740 1 --2- 172.21.15.77:0/3827894966 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c65702850 0x560c65722aa0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f5518009960 tx=0x7f5518031000 comp rx=0 tx=0).stop 2023-11-04T01:43:39.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.231+0000 7f55319a3740 1 -- 172.21.15.77:0/3827894966 shutdown_connections 2023-11-04T01:43:39.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.231+0000 7f55319a3740 1 --2- 172.21.15.77:0/3827894966 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560c65708760 0x560c656d44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.231+0000 7f55319a3740 1 --2- 172.21.15.77:0/3827894966 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c65702c30 0x560c65743240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.231+0000 7f55319a3740 1 --2- 172.21.15.77:0/3827894966 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c65702850 0x560c65722aa0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.231+0000 7f55319a3740 1 -- 172.21.15.77:0/3827894966 >> 172.21.15.77:0/3827894966 conn(0x560c656d5c90 msgr2=0x560c657205d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:39.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.231+0000 7f55319a3740 1 -- 172.21.15.77:0/3827894966 shutdown_connections 2023-11-04T01:43:39.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.231+0000 7f55319a3740 1 -- 172.21.15.77:0/3827894966 wait complete. 2023-11-04T01:43:39.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.232+0000 7f55319a3740 1 -- start start 2023-11-04T01:43:39.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.232+0000 7f55319a3740 1 Processor -- start 2023-11-04T01:43:39.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.232+0000 7f55319a3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c65702850 0x560c6572ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.232+0000 7f55319a3740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c65702c30 0x560c657055d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.232+0000 7f55319a3740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560c65708760 0x560c65705b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.232+0000 7f55319a3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c6578b580 con 0x560c65702850 2023-11-04T01:43:39.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.232+0000 7f55319a3740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c656d4b90 con 0x560c65702c30 2023-11-04T01:43:39.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.232+0000 7f55319a3740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x560c656d4de0 con 0x560c65708760 2023-11-04T01:43:39.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.233+0000 7f55319a3740 10 client.0 _ll_register_callbacks cb 0x7f55180096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:43:39.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.233+0000 7f552cbac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c65702850 0x560c6572ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.233+0000 7f552cbac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c65702850 0x560c6572ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35064/0 (socket says 172.21.15.77:35064) 2023-11-04T01:43:39.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.233+0000 7f552cbac640 1 -- 172.21.15.77:0/3028808285 learned_addr learned my addr 172.21.15.77:0/3028808285 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:39.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.233+0000 7f5527fff640 1 --2- 172.21.15.77:0/3028808285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c65702c30 0x560c657055d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.233+0000 7f552d3ad640 1 --2- 172.21.15.77:0/3028808285 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560c65708760 0x560c65705b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.233+0000 7f552cbac640 1 -- 172.21.15.77:0/3028808285 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560c65708760 msgr2=0x560c65705b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:39.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.233+0000 7f552cbac640 1 --2- 172.21.15.77:0/3028808285 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560c65708760 0x560c65705b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.233+0000 7f552cbac640 1 -- 172.21.15.77:0/3028808285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c65702c30 msgr2=0x560c657055d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:39.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.233+0000 7f552cbac640 1 --2- 172.21.15.77:0/3028808285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c65702c30 0x560c657055d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.233+0000 7f552cbac640 1 -- 172.21.15.77:0/3028808285 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560c65604ca0 con 0x560c65702850 2023-11-04T01:43:39.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.233+0000 7f552cbac640 1 --2- 172.21.15.77:0/3028808285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c65702850 0x560c6572ecb0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f55180090b0 tx=0x7f5518004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c8946245e9b35b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:39.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.233+0000 7f55077fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:43:39.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.233+0000 7f55077fe640 1 -- 172.21.15.77:0/3028808285 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5518058a20 con 0x560c65702850 2023-11-04T01:43:39.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.233+0000 7f55077fe640 1 -- 172.21.15.77:0/3028808285 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f551804b070 con 0x560c65702850 2023-11-04T01:43:39.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.233+0000 7f55319a3740 1 -- 172.21.15.77:0/3028808285 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5518049070 con 0x560c65702850 2023-11-04T01:43:39.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.233+0000 7f55077fe640 1 -- 172.21.15.77:0/3028808285 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5518058b80 con 0x560c65702850 2023-11-04T01:43:39.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.233+0000 7f55319a3740 10 client.7533 fetch_fsmap learned FSMap version 47 2023-11-04T01:43:39.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.233+0000 7f55319a3740 1 -- 172.21.15.77:0/3028808285 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x560c65603500 con 0x560c65702850 2023-11-04T01:43:39.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.233+0000 7f55077fe640 1 -- 172.21.15.77:0/3028808285 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5518049070 con 0x560c65702850 2023-11-04T01:43:39.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.233+0000 7f55077fe640 1 -- 172.21.15.77:0/3028808285 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 47) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f551805f070 con 0x560c65702850 2023-11-04T01:43:39.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.234+0000 7f55319a3740 10 client.7533 fetch_fsmap finished waiting for FSMap version 47 2023-11-04T01:43:39.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.234+0000 7f55319a3740 10 client.7533 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:43:39.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.234+0000 7f55319a3740 20 client.7533 populate_metadata read hostname 'smithi077' 2023-11-04T01:43:39.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.234+0000 7f55319a3740 1 --2- 172.21.15.77:0/3028808285 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x560c6578a6e0 0x560c6578aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.234+0000 7f55319a3740 4 client.7533 mds_command: new command op to 7305 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:43:39.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.234+0000 7f55319a3740 1 -- 172.21.15.77:0/3028808285 --> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560c6563a5b0 con 0x560c6578a6e0 2023-11-04T01:43:39.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.234+0000 7f5527fff640 1 --2- 172.21.15.77:0/3028808285 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x560c6578a6e0 0x560c6578aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.234+0000 7f55077fe640 10 client.7533 ms_handle_connect on v2:172.21.15.77:6833/3207490604 2023-11-04T01:43:39.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.234+0000 7f5527fff640 1 --2- 172.21.15.77:0/3028808285 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x560c6578a6e0 0x560c6578aac0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c8be8fb60aa30b03 server_cookie=7370e64c247df9a in_seq=0 out_seq=0 2023-11-04T01:43:39.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.234+0000 7f55077fe640 1 -- 172.21.15.77:0/3028808285 <== mds.1 v2:172.21.15.77:6833/3207490604 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x560c6563a5b0 con 0x560c6578a6e0 2023-11-04T01:43:39.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.234+0000 7f55077fe640 10 client.7533 handle_command_reply: tid=0 2023-11-04T01:43:39.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.234+0000 7f55319a3740 1 client.7533 shutdown 2023-11-04T01:43:39.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.234+0000 7f55319a3740 1 -- 172.21.15.77:0/3028808285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c65702850 msgr2=0x560c6572ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.234+0000 7f55319a3740 1 --2- 172.21.15.77:0/3028808285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c65702850 0x560c6572ecb0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f55180090b0 tx=0x7f5518004730 comp rx=0 tx=0).stop 2023-11-04T01:43:39.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.234+0000 7f55319a3740 1 -- 172.21.15.77:0/3028808285 shutdown_connections 2023-11-04T01:43:39.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.234+0000 7f55319a3740 1 --2- 172.21.15.77:0/3028808285 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560c65708760 0x560c65705b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.234+0000 7f55319a3740 1 --2- 172.21.15.77:0/3028808285 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x560c6578a6e0 0x560c6578aac0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.234+0000 7f55319a3740 1 --2- 172.21.15.77:0/3028808285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c65702c30 0x560c657055d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.234+0000 7f55077fe640 0 client.7533 ms_handle_reset on v2:172.21.15.77:6833/3207490604 2023-11-04T01:43:39.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.234+0000 7f55319a3740 1 --2- 172.21.15.77:0/3028808285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560c65702850 0x560c6572ecb0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.234+0000 7f55319a3740 1 -- 172.21.15.77:0/3028808285 >> 172.21.15.77:0/3028808285 conn(0x560c656d5c90 msgr2=0x560c656f09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:39.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.234+0000 7f55319a3740 1 -- 172.21.15.77:0/3028808285 shutdown_connections 2023-11-04T01:43:39.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.234+0000 7f55319a3740 1 -- 172.21.15.77:0/3028808285 wait complete. 2023-11-04T01:43:39.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.235+0000 7f55319a3740 20 client.7533 trim_cache size 0 max 16384 2023-11-04T01:43:39.260 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-04T01:43:39.260 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "0c22c75d-0169-41ef-b663-6ac1c5b0f71f", 2023-11-04T01:43:39.261 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 1, 2023-11-04T01:43:39.261 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 7305, 2023-11-04T01:43:39.261 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2023-11-04T01:43:39.261 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2023-11-04T01:43:39.261 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2023-11-04T01:43:39.262 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 2.6307125469999999, 2023-11-04T01:43:39.262 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 47, 2023-11-04T01:43:39.262 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 96, 2023-11-04T01:43:39.262 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 96, 2023-11-04T01:43:39.262 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 18.382808022999999 2023-11-04T01:43:39.263 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-04T01:43:39.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.235+0000 7f552ee10640 1 -- 172.21.15.77:0/2833091419 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f551406ae70 msgr2=0x7f551406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.235+0000 7f552ee10640 1 --2- 172.21.15.77:0/2833091419 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f551406ae70 0x7f551406d330 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5518036000 tx=0x7f551803c040 comp rx=0 tx=0).stop 2023-11-04T01:43:39.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.235+0000 7f552ee10640 1 -- 172.21.15.77:0/2833091419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5528159c00 msgr2=0x7f55281426d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.235+0000 7f552ee10640 1 --2- 172.21.15.77:0/2833091419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5528159c00 0x7f55281426d0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f552000c7d0 tx=0x7f552000cc90 comp rx=0 tx=0).stop 2023-11-04T01:43:39.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.235+0000 7f552ee10640 1 -- 172.21.15.77:0/2833091419 shutdown_connections 2023-11-04T01:43:39.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.235+0000 7f552ee10640 1 --2- 172.21.15.77:0/2833091419 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f551406ae70 0x7f551406d330 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.235+0000 7f552ee10640 1 --2- 172.21.15.77:0/2833091419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5528159c00 0x7f55281426d0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.235+0000 7f552ee10640 1 --2- 172.21.15.77:0/2833091419 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55280c48e0 0x7f552814afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.235+0000 7f552ee10640 1 --2- 172.21.15.77:0/2833091419 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55280adac0 0x7f55280c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.235+0000 7f552ee10640 1 -- 172.21.15.77:0/2833091419 >> 172.21.15.77:0/2833091419 conn(0x7f55280ce950 msgr2=0x7f55280cb340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:39.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.235+0000 7f552ee10640 1 -- 172.21.15.77:0/2833091419 shutdown_connections 2023-11-04T01:43:39.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.235+0000 7f552ee10640 1 -- 172.21.15.77:0/2833091419 wait complete. 2023-11-04T01:43:39.267 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-04T01:43:39.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.367+0000 7fb4bf178640 1 Processor -- start 2023-11-04T01:43:39.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.367+0000 7fb4bf178640 1 -- start start 2023-11-04T01:43:39.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.368+0000 7fb4bf178640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb4b80b1a40 0x7fb4b80ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.368+0000 7fb4bf178640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb4b806a830 0x7fb4b80cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.368+0000 7fb4bf178640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4b8160990 con 0x7fb4b81605b0 2023-11-04T01:43:39.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.368+0000 7fb4bf178640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4b80cc7c0 con 0x7fb4b80b1a40 2023-11-04T01:43:39.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.368+0000 7fb4bf178640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4b80cd750 con 0x7fb4b806a830 2023-11-04T01:43:39.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.368+0000 7fb4b7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb4b80b1a40 0x7fb4b80ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.368+0000 7fb4b7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb4b80b1a40 0x7fb4b80ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35068/0 (socket says 172.21.15.77:35068) 2023-11-04T01:43:39.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.368+0000 7fb4b7fff640 1 -- 172.21.15.77:0/2682037379 learned_addr learned my addr 172.21.15.77:0/2682037379 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:39.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.368+0000 7fb4bd715640 1 --2- 172.21.15.77:0/2682037379 >> v2:172.21.15.122:3300/0 conn(0x7fb4b806a830 0x7fb4b80cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.368+0000 7fb4b7fff640 1 -- 172.21.15.77:0/2682037379 >> v2:172.21.15.122:3300/0 conn(0x7fb4b806a830 msgr2=0x7fb4b80cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:39.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.368+0000 7fb4b7fff640 1 --2- 172.21.15.77:0/2682037379 >> v2:172.21.15.122:3300/0 conn(0x7fb4b806a830 0x7fb4b80cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.368+0000 7fb4b7fff640 1 -- 172.21.15.77:0/2682037379 >> v1:172.21.15.122:6789/0 conn(0x7fb4b81605b0 legacy=0x7fb4b806a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.368+0000 7fb4b7fff640 1 -- 172.21.15.77:0/2682037379 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b80cc4e0 con 0x7fb4b80b1a40 2023-11-04T01:43:39.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.369+0000 7fb4b7fff640 1 --2- 172.21.15.77:0/2682037379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4b80b1a40 0x7fb4b80ccbc0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fb4b80c6aa0 tx=0x7fb4a402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd580daa0ab26d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:39.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.369+0000 7fb4b77fe640 1 -- 172.21.15.77:0/2682037379 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a40317e0 con 0x7fb4b80b1a40 2023-11-04T01:43:39.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.369+0000 7fb4b77fe640 1 -- 172.21.15.77:0/2682037379 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a4031940 con 0x7fb4b80b1a40 2023-11-04T01:43:39.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.369+0000 7fb4b77fe640 1 -- 172.21.15.77:0/2682037379 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a4031cd0 con 0x7fb4b80b1a40 2023-11-04T01:43:39.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.369+0000 7fb4bf178640 1 -- 172.21.15.77:0/2682037379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4b80b1a40 msgr2=0x7fb4b80ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.369+0000 7fb4bf178640 1 --2- 172.21.15.77:0/2682037379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4b80b1a40 0x7fb4b80ccbc0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fb4b80c6aa0 tx=0x7fb4a402b880 comp rx=0 tx=0).stop 2023-11-04T01:43:39.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.369+0000 7fb4bf178640 1 -- 172.21.15.77:0/2682037379 shutdown_connections 2023-11-04T01:43:39.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.369+0000 7fb4bf178640 1 --2- 172.21.15.77:0/2682037379 >> v2:172.21.15.122:3300/0 conn(0x7fb4b806a830 0x7fb4b80cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.369+0000 7fb4bf178640 1 --2- 172.21.15.77:0/2682037379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4b80b1a40 0x7fb4b80ccbc0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.369+0000 7fb4bf178640 1 -- 172.21.15.77:0/2682037379 >> 172.21.15.77:0/2682037379 conn(0x7fb4b8071820 msgr2=0x7fb4b8071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:39.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.370+0000 7fb4bf178640 1 -- 172.21.15.77:0/2682037379 shutdown_connections 2023-11-04T01:43:39.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.370+0000 7fb4bf178640 1 -- 172.21.15.77:0/2682037379 wait complete. 2023-11-04T01:43:39.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.371+0000 7fb4bf178640 1 Processor -- start 2023-11-04T01:43:39.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.371+0000 7fb4bf178640 1 -- start start 2023-11-04T01:43:39.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.371+0000 7fb4bf178640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4b806a830 0x7fb4b814ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.371+0000 7fb4bf178640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4b81605b0 0x7fb4b815ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.372+0000 7fb4bf178640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4b815f870 0x7fb4b815f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.372+0000 7fb4bf178640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b81546d0 con 0x7fb4b81605b0 2023-11-04T01:43:39.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.372+0000 7fb4bf178640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b814b370 con 0x7fb4b815f870 2023-11-04T01:43:39.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.372+0000 7fb4bf178640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b80b2a30 con 0x7fb4b806a830 2023-11-04T01:43:39.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.372+0000 7fb4b7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4b81605b0 0x7fb4b815ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.372+0000 7fb4b7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4b81605b0 0x7fb4b815ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35078/0 (socket says 172.21.15.77:35078) 2023-11-04T01:43:39.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.372+0000 7fb4b7fff640 1 -- 172.21.15.77:0/3503837505 learned_addr learned my addr 172.21.15.77:0/3503837505 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:39.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.372+0000 7fb4bd715640 1 --2- 172.21.15.77:0/3503837505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4b815f870 0x7fb4b815f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.372+0000 7fb4bcf14640 1 --2- 172.21.15.77:0/3503837505 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4b806a830 0x7fb4b814ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.372+0000 7fb4b7fff640 1 -- 172.21.15.77:0/3503837505 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4b806a830 msgr2=0x7fb4b814ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.372+0000 7fb4b7fff640 1 --2- 172.21.15.77:0/3503837505 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4b806a830 0x7fb4b814ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.372+0000 7fb4b7fff640 1 -- 172.21.15.77:0/3503837505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4b815f870 msgr2=0x7fb4b815f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.372+0000 7fb4b7fff640 1 --2- 172.21.15.77:0/3503837505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4b815f870 0x7fb4b815f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.372+0000 7fb4b7fff640 1 -- 172.21.15.77:0/3503837505 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a40094d0 con 0x7fb4b81605b0 2023-11-04T01:43:39.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.372+0000 7fb4bd715640 1 --2- 172.21.15.77:0/3503837505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4b815f870 0x7fb4b815f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:39.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.372+0000 7fb4b7fff640 1 --2- 172.21.15.77:0/3503837505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4b81605b0 0x7fb4b815ebf0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fb4a402b8c0 tx=0x7fb4a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:39.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.372+0000 7fb4b57fa640 1 -- 172.21.15.77:0/3503837505 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a4032880 con 0x7fb4b81605b0 2023-11-04T01:43:39.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.372+0000 7fb4b57fa640 1 -- 172.21.15.77:0/3503837505 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a4032a20 con 0x7fb4b81605b0 2023-11-04T01:43:39.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.372+0000 7fb4bf178640 1 -- 172.21.15.77:0/3503837505 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4b80b2d10 con 0x7fb4b81605b0 2023-11-04T01:43:39.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.372+0000 7fb4b57fa640 1 -- 172.21.15.77:0/3503837505 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a4032dd0 con 0x7fb4b81605b0 2023-11-04T01:43:39.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.372+0000 7fb4bf178640 1 -- 172.21.15.77:0/3503837505 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4b80b32d0 con 0x7fb4b81605b0 2023-11-04T01:43:39.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.374+0000 7fb4b57fa640 1 -- 172.21.15.77:0/3503837505 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb4a40453f0 con 0x7fb4b81605b0 2023-11-04T01:43:39.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.374+0000 7fb4b57fa640 1 --2- 172.21.15.77:0/3503837505 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb49c06ae70 0x7fb49c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.374+0000 7fb4b57fa640 1 -- 172.21.15.77:0/3503837505 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fb4a40abd20 con 0x7fb4b81605b0 2023-11-04T01:43:39.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.374+0000 7fb4bcf14640 1 --2- 172.21.15.77:0/3503837505 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb49c06ae70 0x7fb49c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.375+0000 7fb4bcf14640 1 --2- 172.21.15.77:0/3503837505 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb49c06ae70 0x7fb49c06d330 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac000f60 tx=0x7fb4ac009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:39.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.375+0000 7fb4c1de6740 1 Processor -- start 2023-11-04T01:43:39.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.375+0000 7fb4c1de6740 1 -- start start 2023-11-04T01:43:39.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.376+0000 7fb4c1de6740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c7cda9e850 0x55c7cda71750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.376+0000 7fb4c1de6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7cda9ec30 0x55c7cdaa15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.376+0000 7fb4c1de6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7cda71c90 0x55c7cdaa1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.376+0000 7fb4c1de6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7cd982740 con 0x55c7cda9ec30 2023-11-04T01:43:39.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.376+0000 7fb4c1de6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7cd9e48d0 con 0x55c7cda71c90 2023-11-04T01:43:39.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.376+0000 7fb4c1de6740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c7cd9e1fc0 con 0x55c7cda9e850 2023-11-04T01:43:39.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.376+0000 7fb4b7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7cda9ec30 0x55c7cdaa15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.376+0000 7fb4b7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7cda9ec30 0x55c7cdaa15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35092/0 (socket says 172.21.15.77:35092) 2023-11-04T01:43:39.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.376+0000 7fb4b7fff640 1 -- 172.21.15.77:0/3155270094 learned_addr learned my addr 172.21.15.77:0/3155270094 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:39.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.376+0000 7fb4bcf14640 1 --2- 172.21.15.77:0/3155270094 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c7cda9e850 0x55c7cda71750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.376+0000 7fb4bd715640 1 --2- 172.21.15.77:0/3155270094 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7cda71c90 0x55c7cdaa1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.376+0000 7fb4b7fff640 1 -- 172.21.15.77:0/3155270094 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c7cda9e850 msgr2=0x55c7cda71750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:39.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.376+0000 7fb4b7fff640 1 --2- 172.21.15.77:0/3155270094 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c7cda9e850 0x55c7cda71750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.376+0000 7fb4b7fff640 1 -- 172.21.15.77:0/3155270094 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7cda71c90 msgr2=0x55c7cdaa1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:39.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.376+0000 7fb4b7fff640 1 --2- 172.21.15.77:0/3155270094 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7cda71c90 0x55c7cdaa1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.376+0000 7fb4b7fff640 1 -- 172.21.15.77:0/3155270094 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7cd9a0ca0 con 0x55c7cda9ec30 2023-11-04T01:43:39.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.377+0000 7fb4b7fff640 1 --2- 172.21.15.77:0/3155270094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7cda9ec30 0x55c7cdaa15e0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4076910 tx=0x7fb4a407a310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=286d5beea5a84b35 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:39.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.377+0000 7fb4a27fc640 1 -- 172.21.15.77:0/3155270094 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a4082710 con 0x55c7cda9ec30 2023-11-04T01:43:39.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.377+0000 7fb4a27fc640 1 -- 172.21.15.77:0/3155270094 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a40787b0 con 0x55c7cda9ec30 2023-11-04T01:43:39.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.377+0000 7fb4a27fc640 1 -- 172.21.15.77:0/3155270094 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a407e170 con 0x55c7cda9ec30 2023-11-04T01:43:39.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.377+0000 7fb4c1de6740 1 -- 172.21.15.77:0/3155270094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7cda9ec30 msgr2=0x55c7cdaa15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.377+0000 7fb4c1de6740 1 --2- 172.21.15.77:0/3155270094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7cda9ec30 0x55c7cdaa15e0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4076910 tx=0x7fb4a407a310 comp rx=0 tx=0).stop 2023-11-04T01:43:39.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.377+0000 7fb4c1de6740 1 -- 172.21.15.77:0/3155270094 shutdown_connections 2023-11-04T01:43:39.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.377+0000 7fb4c1de6740 1 --2- 172.21.15.77:0/3155270094 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7cda71c90 0x55c7cdaa1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.377+0000 7fb4c1de6740 1 --2- 172.21.15.77:0/3155270094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7cda9ec30 0x55c7cdaa15e0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.377+0000 7fb4c1de6740 1 --2- 172.21.15.77:0/3155270094 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c7cda9e850 0x55c7cda71750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.377+0000 7fb4c1de6740 1 -- 172.21.15.77:0/3155270094 >> 172.21.15.77:0/3155270094 conn(0x55c7cda73a60 msgr2=0x55c7cdabc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:39.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.377+0000 7fb4c1de6740 1 -- 172.21.15.77:0/3155270094 shutdown_connections 2023-11-04T01:43:39.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.377+0000 7fb4c1de6740 1 -- 172.21.15.77:0/3155270094 wait complete. 2023-11-04T01:43:39.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.378+0000 7fb4c1de6740 1 -- start start 2023-11-04T01:43:39.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.378+0000 7fb4c1de6740 1 Processor -- start 2023-11-04T01:43:39.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.379+0000 7fb4c1de6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7cda9e850 0x55c7cdaa2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.379+0000 7fb4c1de6740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c7cda9ec30 0x55c7cdab4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.379+0000 7fb4c1de6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7cdacc970 0x55c7cdab5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.379+0000 7fb4c1de6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7cd9dd8b0 con 0x55c7cdacc970 2023-11-04T01:43:39.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.379+0000 7fb4c1de6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7cd997c80 con 0x55c7cda9e850 2023-11-04T01:43:39.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.379+0000 7fb4c1de6740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c7cd997920 con 0x55c7cda9ec30 2023-11-04T01:43:39.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.379+0000 7fb4c1de6740 10 client.0 _ll_register_callbacks cb 0x55c7cd6efac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:43:39.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.379+0000 7fb4bd715640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7cdacc970 0x55c7cdab5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.379+0000 7fb4bd715640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7cdacc970 0x55c7cdab5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35104/0 (socket says 172.21.15.77:35104) 2023-11-04T01:43:39.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.379+0000 7fb4bd715640 1 -- 172.21.15.77:0/4175524690 learned_addr learned my addr 172.21.15.77:0/4175524690 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:39.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.379+0000 7fb4b7fff640 1 --2- 172.21.15.77:0/4175524690 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c7cda9ec30 0x55c7cdab4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.379+0000 7fb4bcf14640 1 --2- 172.21.15.77:0/4175524690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7cda9e850 0x55c7cdaa2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.379+0000 7fb4bd715640 1 -- 172.21.15.77:0/4175524690 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c7cda9ec30 msgr2=0x55c7cdab4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:39.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.379+0000 7fb4bd715640 1 --2- 172.21.15.77:0/4175524690 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c7cda9ec30 0x55c7cdab4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.379+0000 7fb4bd715640 1 -- 172.21.15.77:0/4175524690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7cda9e850 msgr2=0x55c7cdaa2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:39.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.379+0000 7fb4bd715640 1 --2- 172.21.15.77:0/4175524690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7cda9e850 0x55c7cdaa2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.379+0000 7fb4bd715640 1 -- 172.21.15.77:0/4175524690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4b80b32d0 con 0x55c7cdacc970 2023-11-04T01:43:39.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.379+0000 7fb4bd715640 1 --2- 172.21.15.77:0/4175524690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7cdacc970 0x55c7cdab5f20 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fb4b0007da0 tx=0x7fb4b00115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d415d109f849f4ed server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:39.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.379+0000 7fb4977fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:43:39.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.380+0000 7fb4977fe640 1 -- 172.21.15.77:0/4175524690 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b0011c30 con 0x55c7cdacc970 2023-11-04T01:43:39.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.380+0000 7fb4977fe640 1 -- 172.21.15.77:0/4175524690 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fb4b0011d90 con 0x55c7cdacc970 2023-11-04T01:43:39.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.380+0000 7fb4c1de6740 1 -- 172.21.15.77:0/4175524690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c7cd989bf0 con 0x55c7cdacc970 2023-11-04T01:43:39.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.380+0000 7fb4977fe640 1 -- 172.21.15.77:0/4175524690 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4b0016450 con 0x55c7cdacc970 2023-11-04T01:43:39.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.380+0000 7fb4c1de6740 10 client.7545 fetch_fsmap learned FSMap version 47 2023-11-04T01:43:39.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.380+0000 7fb4c1de6740 1 -- 172.21.15.77:0/4175524690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x55c7cd9dbf30 con 0x55c7cdacc970 2023-11-04T01:43:39.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.380+0000 7fb4977fe640 1 -- 172.21.15.77:0/4175524690 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c7cd989bf0 con 0x55c7cdacc970 2023-11-04T01:43:39.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.380+0000 7fb4977fe640 1 -- 172.21.15.77:0/4175524690 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 47) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fb4b0014070 con 0x55c7cdacc970 2023-11-04T01:43:39.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.380+0000 7fb4c1de6740 10 client.7545 fetch_fsmap finished waiting for FSMap version 47 2023-11-04T01:43:39.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.380+0000 7fb4c1de6740 10 client.7545 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:43:39.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.380+0000 7fb4c1de6740 20 client.7545 populate_metadata read hostname 'smithi077' 2023-11-04T01:43:39.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.380+0000 7fb4c1de6740 1 --2- 172.21.15.77:0/4175524690 >> [v2:172.21.15.122:6834/3699147778,v1:172.21.15.122:6836/3699147778] conn(0x55c7cdacff20 0x55c7cdad0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.380+0000 7fb4c1de6740 4 client.7545 mds_command: new command op to 35690 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:43:39.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.380+0000 7fb4c1de6740 1 -- 172.21.15.77:0/4175524690 --> [v2:172.21.15.122:6834/3699147778,v1:172.21.15.122:6836/3699147778] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c7cd9d6890 con 0x55c7cdacff20 2023-11-04T01:43:39.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.380+0000 7fb4bcf14640 1 --2- 172.21.15.77:0/4175524690 >> [v2:172.21.15.122:6834/3699147778,v1:172.21.15.122:6836/3699147778] conn(0x55c7cdacff20 0x55c7cdad0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.381+0000 7fb4977fe640 10 client.7545 ms_handle_connect on v2:172.21.15.122:6834/3699147778 2023-11-04T01:43:39.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.381+0000 7fb4bcf14640 1 --2- 172.21.15.77:0/4175524690 >> [v2:172.21.15.122:6834/3699147778,v1:172.21.15.122:6836/3699147778] conn(0x55c7cdacff20 0x55c7cdad0300 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b95920a42f856f4 server_cookie=9be91a1759bdfcc3 in_seq=0 out_seq=0 2023-11-04T01:43:39.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.381+0000 7fb4977fe640 1 -- 172.21.15.77:0/4175524690 <== mds.0 v2:172.21.15.122:6834/3699147778 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c7cd9d6890 con 0x55c7cdacff20 2023-11-04T01:43:39.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.381+0000 7fb4977fe640 10 client.7545 handle_command_reply: tid=0 2023-11-04T01:43:39.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.381+0000 7fb4c1de6740 1 client.7545 shutdown 2023-11-04T01:43:39.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.381+0000 7fb4c1de6740 1 -- 172.21.15.77:0/4175524690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7cdacc970 msgr2=0x55c7cdab5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.381+0000 7fb4c1de6740 1 --2- 172.21.15.77:0/4175524690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7cdacc970 0x55c7cdab5f20 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fb4b0007da0 tx=0x7fb4b00115a0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.381+0000 7fb4c1de6740 1 -- 172.21.15.77:0/4175524690 shutdown_connections 2023-11-04T01:43:39.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.381+0000 7fb4c1de6740 1 --2- 172.21.15.77:0/4175524690 >> [v2:172.21.15.122:6834/3699147778,v1:172.21.15.122:6836/3699147778] conn(0x55c7cdacff20 0x55c7cdad0300 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.381+0000 7fb4c1de6740 1 --2- 172.21.15.77:0/4175524690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7cdacc970 0x55c7cdab5f20 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.381+0000 7fb4c1de6740 1 --2- 172.21.15.77:0/4175524690 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c7cda9ec30 0x55c7cdab4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.381+0000 7fb4c1de6740 1 --2- 172.21.15.77:0/4175524690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7cda9e850 0x55c7cdaa2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.381+0000 7fb4977fe640 0 client.7545 ms_handle_reset on v2:172.21.15.122:6834/3699147778 2023-11-04T01:43:39.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.381+0000 7fb4c1de6740 1 -- 172.21.15.77:0/4175524690 >> 172.21.15.77:0/4175524690 conn(0x55c7cda71c90 msgr2=0x55c7cda704f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:39.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.382+0000 7fb4c1de6740 1 -- 172.21.15.77:0/4175524690 shutdown_connections 2023-11-04T01:43:39.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.382+0000 7fb4c1de6740 1 -- 172.21.15.77:0/4175524690 wait complete. 2023-11-04T01:43:39.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.382+0000 7fb4c1de6740 20 client.7545 trim_cache size 0 max 16384 2023-11-04T01:43:39.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.397+0000 7fb4c1de6740 1 Processor -- start 2023-11-04T01:43:39.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.397+0000 7fb4c1de6740 1 -- start start 2023-11-04T01:43:39.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.398+0000 7fb4c1de6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7cda9e850 0x55c7cda75540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.398+0000 7fb4c1de6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7cda9ec30 0x55c7cda9c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.398+0000 7fb4c1de6740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c7cdacc970 0x55c7cda9ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.398+0000 7fb4c1de6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7cd95d280 con 0x55c7cda9ec30 2023-11-04T01:43:39.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.398+0000 7fb4c1de6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7cdaa59b0 con 0x55c7cda9e850 2023-11-04T01:43:39.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.398+0000 7fb4c1de6740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c7cdab4940 con 0x55c7cdacc970 2023-11-04T01:43:39.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.398+0000 7fb4b7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7cda9ec30 0x55c7cda9c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.398+0000 7fb4b7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7cda9ec30 0x55c7cda9c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35112/0 (socket says 172.21.15.77:35112) 2023-11-04T01:43:39.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.398+0000 7fb4b7fff640 1 -- 172.21.15.77:0/1451535003 learned_addr learned my addr 172.21.15.77:0/1451535003 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:39.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.398+0000 7fb4b7fff640 1 -- 172.21.15.77:0/1451535003 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c7cdacc970 msgr2=0x55c7cda9ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:39.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.398+0000 7fb4b7fff640 1 --2- 172.21.15.77:0/1451535003 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c7cdacc970 0x55c7cda9ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.398+0000 7fb4b7fff640 1 -- 172.21.15.77:0/1451535003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7cda9e850 msgr2=0x55c7cda75540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:39.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.398+0000 7fb4b7fff640 1 --2- 172.21.15.77:0/1451535003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7cda9e850 0x55c7cda75540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.398+0000 7fb4b7fff640 1 -- 172.21.15.77:0/1451535003 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7cd979d10 con 0x55c7cda9ec30 2023-11-04T01:43:39.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.398+0000 7fb4b7fff640 1 --2- 172.21.15.77:0/1451535003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7cda9ec30 0x55c7cda9c930 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fb4a407a3a0 tx=0x7fb4a407e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d4cd07c06e47a05 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:39.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.398+0000 7fb4a2ffd640 1 -- 172.21.15.77:0/1451535003 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a4082710 con 0x55c7cda9ec30 2023-11-04T01:43:39.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.398+0000 7fb4a2ffd640 1 -- 172.21.15.77:0/1451535003 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a409b070 con 0x55c7cda9ec30 2023-11-04T01:43:39.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.398+0000 7fb4a2ffd640 1 -- 172.21.15.77:0/1451535003 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a407e560 con 0x55c7cda9ec30 2023-11-04T01:43:39.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.399+0000 7fb4c1de6740 1 -- 172.21.15.77:0/1451535003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7cda9ec30 msgr2=0x55c7cda9c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.399+0000 7fb4c1de6740 1 --2- 172.21.15.77:0/1451535003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7cda9ec30 0x55c7cda9c930 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fb4a407a3a0 tx=0x7fb4a407e000 comp rx=0 tx=0).stop 2023-11-04T01:43:39.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.399+0000 7fb4c1de6740 1 -- 172.21.15.77:0/1451535003 shutdown_connections 2023-11-04T01:43:39.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.399+0000 7fb4c1de6740 1 --2- 172.21.15.77:0/1451535003 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c7cdacc970 0x55c7cda9ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.399+0000 7fb4c1de6740 1 --2- 172.21.15.77:0/1451535003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7cda9ec30 0x55c7cda9c930 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.399+0000 7fb4c1de6740 1 --2- 172.21.15.77:0/1451535003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7cda9e850 0x55c7cda75540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.399+0000 7fb4c1de6740 1 -- 172.21.15.77:0/1451535003 >> 172.21.15.77:0/1451535003 conn(0x55c7cda71c90 msgr2=0x55c7cda6cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:39.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.399+0000 7fb4c1de6740 1 -- 172.21.15.77:0/1451535003 shutdown_connections 2023-11-04T01:43:39.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.399+0000 7fb4c1de6740 1 -- 172.21.15.77:0/1451535003 wait complete. 2023-11-04T01:43:39.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.399+0000 7fb4c1de6740 1 -- start start 2023-11-04T01:43:39.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.400+0000 7fb4c1de6740 1 Processor -- start 2023-11-04T01:43:39.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.400+0000 7fb4c1de6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7cda9e850 0x55c7cdacafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.400+0000 7fb4c1de6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7cda9ec30 0x55c7cdabfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.400+0000 7fb4c1de6740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c7cdacc970 0x55c7cdac0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.400+0000 7fb4c1de6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7cdaa2930 con 0x55c7cda9e850 2023-11-04T01:43:39.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.400+0000 7fb4c1de6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7cdabc150 con 0x55c7cda9ec30 2023-11-04T01:43:39.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.400+0000 7fb4c1de6740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c7cdad6a70 con 0x55c7cdacc970 2023-11-04T01:43:39.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.400+0000 7fb4c1de6740 10 client.0 _ll_register_callbacks cb 0x7fb4a4031f60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:43:39.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.400+0000 7fb4bcf14640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7cda9e850 0x55c7cdacafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.400+0000 7fb4bcf14640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7cda9e850 0x55c7cdacafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35124/0 (socket says 172.21.15.77:35124) 2023-11-04T01:43:39.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.400+0000 7fb4bcf14640 1 -- 172.21.15.77:0/1854520065 learned_addr learned my addr 172.21.15.77:0/1854520065 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:39.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.400+0000 7fb4bd715640 1 --2- 172.21.15.77:0/1854520065 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c7cdacc970 0x55c7cdac0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.401+0000 7fb4b7fff640 1 --2- 172.21.15.77:0/1854520065 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7cda9ec30 0x55c7cdabfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.401+0000 7fb4bcf14640 1 -- 172.21.15.77:0/1854520065 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c7cdacc970 msgr2=0x55c7cdac0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:39.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.401+0000 7fb4bcf14640 1 --2- 172.21.15.77:0/1854520065 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c7cdacc970 0x55c7cdac0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.401+0000 7fb4bcf14640 1 -- 172.21.15.77:0/1854520065 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7cda9ec30 msgr2=0x55c7cdabfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:39.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.401+0000 7fb4bcf14640 1 --2- 172.21.15.77:0/1854520065 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7cda9ec30 0x55c7cdabfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.401+0000 7fb4bcf14640 1 -- 172.21.15.77:0/1854520065 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c7cd9a0ca0 con 0x55c7cda9e850 2023-11-04T01:43:39.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.401+0000 7fb4bcf14640 1 --2- 172.21.15.77:0/1854520065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7cda9e850 0x55c7cdacafe0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x55c7cdab3db0 tx=0x7fb4ac000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6688ccc6245634a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:39.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.401+0000 7fb4977fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:43:39.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.401+0000 7fb4977fe640 1 -- 172.21.15.77:0/1854520065 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac007250 con 0x55c7cda9e850 2023-11-04T01:43:39.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.401+0000 7fb4977fe640 1 -- 172.21.15.77:0/1854520065 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fb4ac02a020 con 0x55c7cda9e850 2023-11-04T01:43:39.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.401+0000 7fb4c1de6740 1 -- 172.21.15.77:0/1854520065 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb4a40787b0 con 0x55c7cda9e850 2023-11-04T01:43:39.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.401+0000 7fb4977fe640 1 -- 172.21.15.77:0/1854520065 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4ac003e70 con 0x55c7cda9e850 2023-11-04T01:43:39.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.401+0000 7fb4c1de6740 10 client.7551 fetch_fsmap learned FSMap version 47 2023-11-04T01:43:39.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.401+0000 7fb4c1de6740 1 -- 172.21.15.77:0/1854520065 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x55c7cd99f500 con 0x55c7cda9e850 2023-11-04T01:43:39.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.401+0000 7fb4977fe640 1 -- 172.21.15.77:0/1854520065 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a40787b0 con 0x55c7cda9e850 2023-11-04T01:43:39.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.401+0000 7fb4977fe640 1 -- 172.21.15.77:0/1854520065 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 47) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fb4ac0073b0 con 0x55c7cda9e850 2023-11-04T01:43:39.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.401+0000 7fb4c1de6740 10 client.7551 fetch_fsmap finished waiting for FSMap version 47 2023-11-04T01:43:39.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.401+0000 7fb4c1de6740 10 client.7551 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:43:39.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.401+0000 7fb4c1de6740 20 client.7551 populate_metadata read hostname 'smithi077' 2023-11-04T01:43:39.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.401+0000 7fb4c1de6740 1 --2- 172.21.15.77:0/1854520065 >> [v2:172.21.15.122:6834/3699147778,v1:172.21.15.122:6836/3699147778] conn(0x55c7cdabb3d0 0x55c7cdabb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.401+0000 7fb4c1de6740 4 client.7551 mds_command: new command op to 35690 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:43:39.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.401+0000 7fb4c1de6740 1 -- 172.21.15.77:0/1854520065 --> [v2:172.21.15.122:6834/3699147778,v1:172.21.15.122:6836/3699147778] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c7cd9d65b0 con 0x55c7cdabb3d0 2023-11-04T01:43:39.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.402+0000 7fb4b7fff640 1 --2- 172.21.15.77:0/1854520065 >> [v2:172.21.15.122:6834/3699147778,v1:172.21.15.122:6836/3699147778] conn(0x55c7cdabb3d0 0x55c7cdabb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.402+0000 7fb4b7fff640 1 --2- 172.21.15.77:0/1854520065 >> [v2:172.21.15.122:6834/3699147778,v1:172.21.15.122:6836/3699147778] conn(0x55c7cdabb3d0 0x55c7cdabb7b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7c8829ffad11014 server_cookie=c53cd23ea32e1c5f in_seq=0 out_seq=0 2023-11-04T01:43:39.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.402+0000 7fb4977fe640 10 client.7551 ms_handle_connect on v2:172.21.15.122:6834/3699147778 2023-11-04T01:43:39.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.402+0000 7fb4977fe640 1 -- 172.21.15.77:0/1854520065 <== mds.0 v2:172.21.15.122:6834/3699147778 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55c7cd9d65b0 con 0x55c7cdabb3d0 2023-11-04T01:43:39.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.402+0000 7fb4977fe640 10 client.7551 handle_command_reply: tid=0 2023-11-04T01:43:39.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.402+0000 7fb4c1de6740 1 client.7551 shutdown 2023-11-04T01:43:39.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.402+0000 7fb4c1de6740 1 -- 172.21.15.77:0/1854520065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7cda9e850 msgr2=0x55c7cdacafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.402+0000 7fb4c1de6740 1 --2- 172.21.15.77:0/1854520065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7cda9e850 0x55c7cdacafe0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x55c7cdab3db0 tx=0x7fb4ac000ed0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.402+0000 7fb4c1de6740 1 -- 172.21.15.77:0/1854520065 shutdown_connections 2023-11-04T01:43:39.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.402+0000 7fb4c1de6740 1 --2- 172.21.15.77:0/1854520065 >> [v2:172.21.15.122:6834/3699147778,v1:172.21.15.122:6836/3699147778] conn(0x55c7cdabb3d0 0x55c7cdabb7b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.402+0000 7fb4c1de6740 1 --2- 172.21.15.77:0/1854520065 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55c7cdacc970 0x55c7cdac0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.402+0000 7fb4c1de6740 1 --2- 172.21.15.77:0/1854520065 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7cda9ec30 0x55c7cdabfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.402+0000 7fb4977fe640 0 client.7551 ms_handle_reset on v2:172.21.15.122:6834/3699147778 2023-11-04T01:43:39.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.402+0000 7fb4c1de6740 1 --2- 172.21.15.77:0/1854520065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7cda9e850 0x55c7cdacafe0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.402+0000 7fb4c1de6740 1 -- 172.21.15.77:0/1854520065 >> 172.21.15.77:0/1854520065 conn(0x55c7cda71c90 msgr2=0x55c7cda75540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:39.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.402+0000 7fb4c1de6740 1 -- 172.21.15.77:0/1854520065 shutdown_connections 2023-11-04T01:43:39.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.402+0000 7fb4c1de6740 1 -- 172.21.15.77:0/1854520065 wait complete. 2023-11-04T01:43:39.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.403+0000 7fb4c1de6740 20 client.7551 trim_cache size 0 max 16384 2023-11-04T01:43:39.427 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-04T01:43:39.427 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "0c22c75d-0169-41ef-b663-6ac1c5b0f71f", 2023-11-04T01:43:39.427 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 0, 2023-11-04T01:43:39.427 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 35690, 2023-11-04T01:43:39.427 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2023-11-04T01:43:39.428 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2023-11-04T01:43:39.428 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2023-11-04T01:43:39.428 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 12.457162598, 2023-11-04T01:43:39.428 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 47, 2023-11-04T01:43:39.428 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 96, 2023-11-04T01:43:39.428 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 96, 2023-11-04T01:43:39.429 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 18.537649076000001 2023-11-04T01:43:39.429 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-04T01:43:39.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.403+0000 7fb4bf178640 1 -- 172.21.15.77:0/3503837505 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb49c06ae70 msgr2=0x7fb49c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.403+0000 7fb4bf178640 1 --2- 172.21.15.77:0/3503837505 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb49c06ae70 0x7fb49c06d330 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac000f60 tx=0x7fb4ac009040 comp rx=0 tx=0).stop 2023-11-04T01:43:39.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.403+0000 7fb4bf178640 1 -- 172.21.15.77:0/3503837505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4b81605b0 msgr2=0x7fb4b815ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.403+0000 7fb4bf178640 1 --2- 172.21.15.77:0/3503837505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4b81605b0 0x7fb4b815ebf0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fb4a402b8c0 tx=0x7fb4a40046c0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.403+0000 7fb4bf178640 1 -- 172.21.15.77:0/3503837505 shutdown_connections 2023-11-04T01:43:39.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.403+0000 7fb4bf178640 1 --2- 172.21.15.77:0/3503837505 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb49c06ae70 0x7fb49c06d330 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.403+0000 7fb4bf178640 1 --2- 172.21.15.77:0/3503837505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4b815f870 0x7fb4b815f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.403+0000 7fb4bf178640 1 --2- 172.21.15.77:0/3503837505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4b81605b0 0x7fb4b815ebf0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.403+0000 7fb4bf178640 1 --2- 172.21.15.77:0/3503837505 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4b806a830 0x7fb4b814ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.403+0000 7fb4bf178640 1 -- 172.21.15.77:0/3503837505 >> 172.21.15.77:0/3503837505 conn(0x7fb4b8071820 msgr2=0x7fb4b8071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:39.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.403+0000 7fb4bf178640 1 -- 172.21.15.77:0/3503837505 shutdown_connections 2023-11-04T01:43:39.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.403+0000 7fb4bf178640 1 -- 172.21.15.77:0/3503837505 wait complete. 2023-11-04T01:43:39.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:39.433 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/dir) 2023-11-04T01:43:39.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:39.455 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1) 2023-11-04T01:43:39.512 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:39.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.650+0000 7f14cfdb6640 1 Processor -- start 2023-11-04T01:43:39.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.651+0000 7f14cfdb6640 1 -- start start 2023-11-04T01:43:39.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.651+0000 7f14cfdb6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f14c8159c70 0x7f14c80ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.651+0000 7f14cfdb6640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f14c806db20 0x7f14c80b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.651+0000 7f14cfdb6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c80b4110 con 0x7f14c80b0910 2023-11-04T01:43:39.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.651+0000 7f14cfdb6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14c80b49b0 con 0x7f14c8159c70 2023-11-04T01:43:39.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.651+0000 7f14cfdb6640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14c80b0da0 con 0x7f14c806db20 2023-11-04T01:43:39.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.651+0000 7f14cdb52640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f14c8159c70 0x7f14c80ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.651+0000 7f14ce353640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f14c80b0910 0x7f14c815d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:48578/0 (socket says 172.21.15.77:48578) 2023-11-04T01:43:39.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.651+0000 7f14ce353640 1 -- 172.21.15.77:0/2244674910 learned_addr learned my addr 172.21.15.77:0/2244674910 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:39.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.652+0000 7f14cdb52640 1 -- 172.21.15.77:0/2244674910 >> v2:172.21.15.122:3300/0 conn(0x7f14c806db20 msgr2=0x7f14c80b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:39.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.652+0000 7f14cdb52640 1 --2- 172.21.15.77:0/2244674910 >> v2:172.21.15.122:3300/0 conn(0x7f14c806db20 0x7f14c80b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.652+0000 7f14cdb52640 1 -- 172.21.15.77:0/2244674910 >> v1:172.21.15.77:6789/0 conn(0x7f14c80b0910 legacy=0x7f14c815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.652+0000 7f14cdb52640 1 -- 172.21.15.77:0/2244674910 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c80b43f0 con 0x7f14c8159c70 2023-11-04T01:43:39.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.652+0000 7f14ccb50640 1 -- 172.21.15.77:0/2244674910 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3379283129 0 0) 0x7f14c80b4110 con 0x7f14c80b0910 2023-11-04T01:43:39.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.652+0000 7f14cdb52640 1 --2- 172.21.15.77:0/2244674910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14c8159c70 0x7f14c80ce370 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f14c80cf800 tx=0x7f14c402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3524a9541f3fa817 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:39.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.653+0000 7f14ccb50640 1 -- 172.21.15.77:0/2244674910 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c4031830 con 0x7f14c8159c70 2023-11-04T01:43:39.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.653+0000 7f14ccb50640 1 -- 172.21.15.77:0/2244674910 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c4031990 con 0x7f14c8159c70 2023-11-04T01:43:39.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.653+0000 7f14ccb50640 1 -- 172.21.15.77:0/2244674910 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c4031d20 con 0x7f14c8159c70 2023-11-04T01:43:39.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.653+0000 7f14cfdb6640 1 -- 172.21.15.77:0/2244674910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14c8159c70 msgr2=0x7f14c80ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.653+0000 7f14cfdb6640 1 --2- 172.21.15.77:0/2244674910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14c8159c70 0x7f14c80ce370 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f14c80cf800 tx=0x7f14c402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.653+0000 7f14cfdb6640 1 -- 172.21.15.77:0/2244674910 shutdown_connections 2023-11-04T01:43:39.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.653+0000 7f14cfdb6640 1 --2- 172.21.15.77:0/2244674910 >> v2:172.21.15.122:3300/0 conn(0x7f14c806db20 0x7f14c80b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.653+0000 7f14cfdb6640 1 --2- 172.21.15.77:0/2244674910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14c8159c70 0x7f14c80ce370 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.653+0000 7f14cfdb6640 1 -- 172.21.15.77:0/2244674910 >> 172.21.15.77:0/2244674910 conn(0x7f14c80ce950 msgr2=0x7f14c80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:39.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.653+0000 7f14cfdb6640 1 -- 172.21.15.77:0/2244674910 shutdown_connections 2023-11-04T01:43:39.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.653+0000 7f14cfdb6640 1 -- 172.21.15.77:0/2244674910 wait complete. 2023-11-04T01:43:39.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.654+0000 7f14cfdb6640 1 Processor -- start 2023-11-04T01:43:39.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.654+0000 7f14cfdb6640 1 -- start start 2023-11-04T01:43:39.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.655+0000 7f14cfdb6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14c806db20 0x7f14c80c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.655+0000 7f14cfdb6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f14c80b0910 0x7f14c814fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.655+0000 7f14cfdb6640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f14c8159c70 0x7f14c814eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.655+0000 7f14cfdb6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c8155360 con 0x7f14c806db20 2023-11-04T01:43:39.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.655+0000 7f14cfdb6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c8150e90 con 0x7f14c80b0910 2023-11-04T01:43:39.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.655+0000 7f14cfdb6640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c8150320 con 0x7f14c8159c70 2023-11-04T01:43:39.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.655+0000 7f14cdb52640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14c806db20 0x7f14c80c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.655+0000 7f14cdb52640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14c806db20 0x7f14c80c7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35150/0 (socket says 172.21.15.77:35150) 2023-11-04T01:43:39.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.655+0000 7f14cdb52640 1 -- 172.21.15.77:0/177052664 learned_addr learned my addr 172.21.15.77:0/177052664 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:39.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.655+0000 7f14cdb52640 1 -- 172.21.15.77:0/177052664 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f14c8159c70 msgr2=0x7f14c814eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.655+0000 7f14cdb52640 1 --2- 172.21.15.77:0/177052664 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f14c8159c70 0x7f14c814eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.655+0000 7f14cdb52640 1 -- 172.21.15.77:0/177052664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f14c80b0910 msgr2=0x7f14c814fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.655+0000 7f14cdb52640 1 --2- 172.21.15.77:0/177052664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f14c80b0910 0x7f14c814fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.655+0000 7f14cdb52640 1 -- 172.21.15.77:0/177052664 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c4009400 con 0x7f14c806db20 2023-11-04T01:43:39.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.656+0000 7f14cdb52640 1 --2- 172.21.15.77:0/177052664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14c806db20 0x7f14c80c7f90 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f14c4009890 tx=0x7f14c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:39.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.656+0000 7f14be7fc640 1 -- 172.21.15.77:0/177052664 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c403ba70 con 0x7f14c806db20 2023-11-04T01:43:39.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.656+0000 7f14be7fc640 1 -- 172.21.15.77:0/177052664 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c403bbf0 con 0x7f14c806db20 2023-11-04T01:43:39.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.656+0000 7f14cfdb6640 1 -- 172.21.15.77:0/177052664 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c81505f0 con 0x7f14c806db20 2023-11-04T01:43:39.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.656+0000 7f14be7fc640 1 -- 172.21.15.77:0/177052664 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c40453f0 con 0x7f14c806db20 2023-11-04T01:43:39.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.656+0000 7f14cfdb6640 1 -- 172.21.15.77:0/177052664 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c8150bb0 con 0x7f14c806db20 2023-11-04T01:43:39.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.657+0000 7f14cfdb6640 1 -- 172.21.15.77:0/177052664 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14c81550a0 con 0x7f14c806db20 2023-11-04T01:43:39.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.657+0000 7f14be7fc640 1 -- 172.21.15.77:0/177052664 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f14c4045550 con 0x7f14c806db20 2023-11-04T01:43:39.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.657+0000 7f14be7fc640 1 --2- 172.21.15.77:0/177052664 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f14ac06ae70 0x7f14ac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.658+0000 7f14be7fc640 1 -- 172.21.15.77:0/177052664 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f14c40abdf0 con 0x7f14c806db20 2023-11-04T01:43:39.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.658+0000 7f14cd351640 1 --2- 172.21.15.77:0/177052664 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f14ac06ae70 0x7f14ac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.658+0000 7f14cd351640 1 --2- 172.21.15.77:0/177052664 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f14ac06ae70 0x7f14ac06d330 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f14c80cd3a0 tx=0x7f14b8006bf0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:39.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.662+0000 7f14be7fc640 1 -- 172.21.15.77:0/177052664 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f14c40769b0 con 0x7f14c806db20 2023-11-04T01:43:39.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.861+0000 7f14cfdb6640 1 -- 172.21.15.77:0/177052664 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f14c806d1e0 con 0x7f14c806db20 2023-11-04T01:43:39.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.861+0000 7f14be7fc640 1 -- 172.21.15.77:0/177052664 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f14c4079fd0 con 0x7f14c806db20 2023-11-04T01:43:39.863 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:43:39.864 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7302,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/4241784871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4241784871},{"type":"v1","addr":"172.21.15.77:6834","nonce":4241784871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:43:36.620245+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":35690,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_35690":{"gid":35690,"name":"b","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6836/3699147778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":3699147778},{"type":"v1","addr":"172.21.15.122:6836","nonce":3699147778}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:39.864 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 47 2023-11-04T01:43:39.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.863+0000 7f14cfdb6640 1 -- 172.21.15.77:0/177052664 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f14ac06ae70 msgr2=0x7f14ac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.863+0000 7f14cfdb6640 1 --2- 172.21.15.77:0/177052664 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f14ac06ae70 0x7f14ac06d330 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f14c80cd3a0 tx=0x7f14b8006bf0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.863+0000 7f14cfdb6640 1 -- 172.21.15.77:0/177052664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14c806db20 msgr2=0x7f14c80c7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.863+0000 7f14cfdb6640 1 --2- 172.21.15.77:0/177052664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14c806db20 0x7f14c80c7f90 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f14c4009890 tx=0x7f14c40046c0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.863+0000 7f14cfdb6640 1 -- 172.21.15.77:0/177052664 shutdown_connections 2023-11-04T01:43:39.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.863+0000 7f14cfdb6640 1 --2- 172.21.15.77:0/177052664 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f14ac06ae70 0x7f14ac06d330 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.863+0000 7f14cfdb6640 1 --2- 172.21.15.77:0/177052664 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f14c8159c70 0x7f14c814eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.863+0000 7f14cfdb6640 1 --2- 172.21.15.77:0/177052664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f14c80b0910 0x7f14c814fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.863+0000 7f14cfdb6640 1 --2- 172.21.15.77:0/177052664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14c806db20 0x7f14c80c7f90 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.863+0000 7f14cfdb6640 1 -- 172.21.15.77:0/177052664 >> 172.21.15.77:0/177052664 conn(0x7f14c80ce950 msgr2=0x7f14c8070630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:39.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.863+0000 7f14cfdb6640 1 -- 172.21.15.77:0/177052664 shutdown_connections 2023-11-04T01:43:39.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:39.863+0000 7f14cfdb6640 1 -- 172.21.15.77:0/177052664 wait complete. 2023-11-04T01:43:39.875 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-11-04T01:43:39.987 INFO:teuthology.orchestra.run.smithi077.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-11-04T01:43:39.987 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-11-04T01:43:39.988 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1', 1)] 2023-11-04T01:43:41.989 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:42.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.097+0000 7f7a50090640 1 Processor -- start 2023-11-04T01:43:42.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.098+0000 7f7a50090640 1 -- start start 2023-11-04T01:43:42.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.098+0000 7f7a50090640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7a48159c70 0x7f7a480ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.098+0000 7f7a50090640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7a4806db20 0x7f7a480b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.098+0000 7f7a50090640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7a480b0910 0x7f7a4815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.098+0000 7f7a50090640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a480b49b0 con 0x7f7a4806db20 2023-11-04T01:43:42.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.098+0000 7f7a50090640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a480b0da0 con 0x7f7a48159c70 2023-11-04T01:43:42.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.098+0000 7f7a50090640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a480b4110 con 0x7f7a480b0910 2023-11-04T01:43:42.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.099+0000 7f7a4d62b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7a4806db20 0x7f7a480b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.099+0000 7f7a4d62b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7a4806db20 0x7f7a480b03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35156/0 (socket says 172.21.15.77:35156) 2023-11-04T01:43:42.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.099+0000 7f7a4d62b640 1 -- 172.21.15.77:0/1074400922 learned_addr learned my addr 172.21.15.77:0/1074400922 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:42.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.099+0000 7f7a4d62b640 1 -- 172.21.15.77:0/1074400922 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7a480b0910 msgr2=0x7f7a4815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:42.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.099+0000 7f7a4d62b640 1 --2- 172.21.15.77:0/1074400922 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7a480b0910 0x7f7a4815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.099+0000 7f7a4d62b640 1 -- 172.21.15.77:0/1074400922 >> v2:172.21.15.122:3300/0 conn(0x7f7a48159c70 msgr2=0x7f7a480ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:42.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.099+0000 7f7a4de2c640 1 --2- 172.21.15.77:0/1074400922 >> v2:172.21.15.122:3300/0 conn(0x7f7a48159c70 0x7f7a480ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.099+0000 7f7a4d62b640 1 --2- 172.21.15.77:0/1074400922 >> v2:172.21.15.122:3300/0 conn(0x7f7a48159c70 0x7f7a480ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.099+0000 7f7a4d62b640 1 -- 172.21.15.77:0/1074400922 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a480b43f0 con 0x7f7a4806db20 2023-11-04T01:43:42.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.099+0000 7f7a4de2c640 1 --2- 172.21.15.77:0/1074400922 >> v2:172.21.15.122:3300/0 conn(0x7f7a48159c70 0x7f7a480ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:42.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.100+0000 7f7a4d62b640 1 --2- 172.21.15.77:0/1074400922 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a4806db20 0x7f7a480b03d0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f7a480cc440 tx=0x7f7a3c02e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e86ad0a657a90285 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:42.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.100+0000 7f7a4ce2a640 1 -- 172.21.15.77:0/1074400922 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c02ee90 con 0x7f7a4806db20 2023-11-04T01:43:42.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.100+0000 7f7a4ce2a640 1 -- 172.21.15.77:0/1074400922 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3c036440 con 0x7f7a4806db20 2023-11-04T01:43:42.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.100+0000 7f7a4ce2a640 1 -- 172.21.15.77:0/1074400922 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c0367d0 con 0x7f7a4806db20 2023-11-04T01:43:42.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.100+0000 7f7a50090640 1 -- 172.21.15.77:0/1074400922 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a4806db20 msgr2=0x7f7a480b03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.100+0000 7f7a50090640 1 --2- 172.21.15.77:0/1074400922 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a4806db20 0x7f7a480b03d0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f7a480cc440 tx=0x7f7a3c02e0e0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.100+0000 7f7a50090640 1 -- 172.21.15.77:0/1074400922 shutdown_connections 2023-11-04T01:43:42.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.100+0000 7f7a50090640 1 --2- 172.21.15.77:0/1074400922 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7a480b0910 0x7f7a4815d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.100+0000 7f7a50090640 1 --2- 172.21.15.77:0/1074400922 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a4806db20 0x7f7a480b03d0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.100+0000 7f7a50090640 1 --2- 172.21.15.77:0/1074400922 >> v2:172.21.15.122:3300/0 conn(0x7f7a48159c70 0x7f7a480ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.100+0000 7f7a50090640 1 -- 172.21.15.77:0/1074400922 >> 172.21.15.77:0/1074400922 conn(0x7f7a480ce950 msgr2=0x7f7a480ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:42.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.101+0000 7f7a50090640 1 -- 172.21.15.77:0/1074400922 shutdown_connections 2023-11-04T01:43:42.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.101+0000 7f7a50090640 1 -- 172.21.15.77:0/1074400922 wait complete. 2023-11-04T01:43:42.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.102+0000 7f7a50090640 1 Processor -- start 2023-11-04T01:43:42.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.102+0000 7f7a50090640 1 -- start start 2023-11-04T01:43:42.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.102+0000 7f7a50090640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7a4806db20 0x7f7a480afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.102+0000 7f7a50090640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a480b0910 0x7f7a4814dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.102+0000 7f7a50090640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a48159c70 0x7f7a480ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.102+0000 7f7a50090640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4814e420 con 0x7f7a48159c70 2023-11-04T01:43:42.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.102+0000 7f7a50090640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a480af750 con 0x7f7a480b0910 2023-11-04T01:43:42.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.102+0000 7f7a50090640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a480aeb40 con 0x7f7a4806db20 2023-11-04T01:43:42.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.103+0000 7f7a4e62d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a48159c70 0x7f7a480ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.103+0000 7f7a4e62d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a48159c70 0x7f7a480ae1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35172/0 (socket says 172.21.15.77:35172) 2023-11-04T01:43:42.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.103+0000 7f7a4e62d640 1 -- 172.21.15.77:0/694152874 learned_addr learned my addr 172.21.15.77:0/694152874 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:42.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.103+0000 7f7a4d62b640 1 --2- 172.21.15.77:0/694152874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a480b0910 0x7f7a4814dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.103+0000 7f7a4de2c640 1 --2- 172.21.15.77:0/694152874 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7a4806db20 0x7f7a480afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.103+0000 7f7a4e62d640 1 -- 172.21.15.77:0/694152874 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7a4806db20 msgr2=0x7f7a480afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.103+0000 7f7a4e62d640 1 --2- 172.21.15.77:0/694152874 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7a4806db20 0x7f7a480afbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.103+0000 7f7a4e62d640 1 -- 172.21.15.77:0/694152874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a480b0910 msgr2=0x7f7a4814dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.103+0000 7f7a4e62d640 1 --2- 172.21.15.77:0/694152874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a480b0910 0x7f7a4814dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.103+0000 7f7a4e62d640 1 -- 172.21.15.77:0/694152874 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a3c00b770 con 0x7f7a48159c70 2023-11-04T01:43:42.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.103+0000 7f7a4e62d640 1 --2- 172.21.15.77:0/694152874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a48159c70 0x7f7a480ae1d0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f7a3800b970 tx=0x7f7a3800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:42.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.103+0000 7f7a467fc640 1 -- 172.21.15.77:0/694152874 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3800cb40 con 0x7f7a48159c70 2023-11-04T01:43:42.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.103+0000 7f7a467fc640 1 -- 172.21.15.77:0/694152874 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3800ccc0 con 0x7f7a48159c70 2023-11-04T01:43:42.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.103+0000 7f7a467fc640 1 -- 172.21.15.77:0/694152874 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a38014680 con 0x7f7a48159c70 2023-11-04T01:43:42.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.103+0000 7f7a50090640 1 -- 172.21.15.77:0/694152874 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a480aee20 con 0x7f7a48159c70 2023-11-04T01:43:42.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.103+0000 7f7a50090640 1 -- 172.21.15.77:0/694152874 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a480af3e0 con 0x7f7a48159c70 2023-11-04T01:43:42.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.104+0000 7f7a50090640 1 -- 172.21.15.77:0/694152874 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a480af8c0 con 0x7f7a48159c70 2023-11-04T01:43:42.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.105+0000 7f7a467fc640 1 -- 172.21.15.77:0/694152874 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7a3801d3b0 con 0x7f7a48159c70 2023-11-04T01:43:42.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.105+0000 7f7a467fc640 1 --2- 172.21.15.77:0/694152874 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7a3406ae70 0x7f7a3406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.105+0000 7f7a467fc640 1 -- 172.21.15.77:0/694152874 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f7a38089a70 con 0x7f7a48159c70 2023-11-04T01:43:42.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.105+0000 7f7a4de2c640 1 --2- 172.21.15.77:0/694152874 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7a3406ae70 0x7f7a3406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.106+0000 7f7a4de2c640 1 --2- 172.21.15.77:0/694152874 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7a3406ae70 0x7f7a3406d330 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7a4000b840 tx=0x7f7a40008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:42.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.110+0000 7f7a467fc640 1 -- 172.21.15.77:0/694152874 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7a38054630 con 0x7f7a48159c70 2023-11-04T01:43:42.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.308+0000 7f7a50090640 1 -- 172.21.15.77:0/694152874 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7a48074290 con 0x7f7a48159c70 2023-11-04T01:43:42.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.308+0000 7f7a467fc640 1 -- 172.21.15.77:0/694152874 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f7a38019090 con 0x7f7a48159c70 2023-11-04T01:43:42.310 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:43:42.311 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7302,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/4241784871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4241784871},{"type":"v1","addr":"172.21.15.77:6834","nonce":4241784871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:43:36.620245+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":35690,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_35690":{"gid":35690,"name":"b","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6836/3699147778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":3699147778},{"type":"v1","addr":"172.21.15.122:6836","nonce":3699147778}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:42.311 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 47 2023-11-04T01:43:42.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.310+0000 7f7a50090640 1 -- 172.21.15.77:0/694152874 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7a3406ae70 msgr2=0x7f7a3406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.310+0000 7f7a50090640 1 --2- 172.21.15.77:0/694152874 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7a3406ae70 0x7f7a3406d330 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7a4000b840 tx=0x7f7a40008040 comp rx=0 tx=0).stop 2023-11-04T01:43:42.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.310+0000 7f7a50090640 1 -- 172.21.15.77:0/694152874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a48159c70 msgr2=0x7f7a480ae1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.310+0000 7f7a50090640 1 --2- 172.21.15.77:0/694152874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a48159c70 0x7f7a480ae1d0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f7a3800b970 tx=0x7f7a3800be30 comp rx=0 tx=0).stop 2023-11-04T01:43:42.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.310+0000 7f7a50090640 1 -- 172.21.15.77:0/694152874 shutdown_connections 2023-11-04T01:43:42.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.310+0000 7f7a50090640 1 --2- 172.21.15.77:0/694152874 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7a3406ae70 0x7f7a3406d330 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.310+0000 7f7a50090640 1 --2- 172.21.15.77:0/694152874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a48159c70 0x7f7a480ae1d0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.310+0000 7f7a50090640 1 --2- 172.21.15.77:0/694152874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7a480b0910 0x7f7a4814dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.310+0000 7f7a50090640 1 --2- 172.21.15.77:0/694152874 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7a4806db20 0x7f7a480afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.310+0000 7f7a50090640 1 -- 172.21.15.77:0/694152874 >> 172.21.15.77:0/694152874 conn(0x7f7a480ce950 msgr2=0x7f7a480ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:42.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.310+0000 7f7a50090640 1 -- 172.21.15.77:0/694152874 shutdown_connections 2023-11-04T01:43:42.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:42.310+0000 7f7a50090640 1 -- 172.21.15.77:0/694152874 wait complete. 2023-11-04T01:43:42.323 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-11-04T01:43:42.436 INFO:teuthology.orchestra.run.smithi077.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-11-04T01:43:42.437 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-11-04T01:43:42.437 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1', 1)] 2023-11-04T01:43:44.438 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:44.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.550+0000 7f3e62b3e640 1 Processor -- start 2023-11-04T01:43:44.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.550+0000 7f3e62b3e640 1 -- start start 2023-11-04T01:43:44.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.550+0000 7f3e62b3e640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3e5c0ce240 0x7f3e5c157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.550+0000 7f3e62b3e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e5c15e000 con 0x7f3e5c157540 2023-11-04T01:43:44.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.550+0000 7f3e62b3e640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e5c15e2e0 con 0x7f3e5c0cde60 2023-11-04T01:43:44.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.550+0000 7f3e62b3e640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e5c15e5c0 con 0x7f3e5c0ce240 2023-11-04T01:43:44.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.551+0000 7f3e610db640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f3e5c157540 0x7f3e5c0d1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:48588/0 (socket says 172.21.15.77:48588) 2023-11-04T01:43:44.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.551+0000 7f3e610db640 1 -- 172.21.15.77:0/3068290969 learned_addr learned my addr 172.21.15.77:0/3068290969 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:44.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.551+0000 7f3e5bfff640 1 --2- 172.21.15.77:0/3068290969 >> v2:172.21.15.122:3300/0 conn(0x7f3e5c0ce240 0x7f3e5c157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.551+0000 7f3e5b7fe640 1 -- 172.21.15.77:0/3068290969 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2082986659 0 0) 0x7f3e5c15e000 con 0x7f3e5c157540 2023-11-04T01:43:44.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.551+0000 7f3e5b7fe640 1 -- 172.21.15.77:0/3068290969 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e48003520 con 0x7f3e5c157540 2023-11-04T01:43:44.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.551+0000 7f3e5b7fe640 1 -- 172.21.15.77:0/3068290969 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1358198252 0 0) 0x7f3e48003520 con 0x7f3e5c157540 2023-11-04T01:43:44.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.551+0000 7f3e5b7fe640 1 -- 172.21.15.77:0/3068290969 >> v2:172.21.15.122:3300/0 conn(0x7f3e5c0ce240 msgr2=0x7f3e5c157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:44.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.551+0000 7f3e5b7fe640 1 --2- 172.21.15.77:0/3068290969 >> v2:172.21.15.122:3300/0 conn(0x7f3e5c0ce240 0x7f3e5c157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.551+0000 7f3e5b7fe640 1 -- 172.21.15.77:0/3068290969 >> v1:172.21.15.122:6789/0 conn(0x7f3e5c0cde60 legacy=0x7f3e5c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.551+0000 7f3e5b7fe640 1 -- 172.21.15.77:0/3068290969 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e5c0d1120 con 0x7f3e5c157540 2023-11-04T01:43:44.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.551+0000 7f3e5b7fe640 1 -- 172.21.15.77:0/3068290969 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f3e4c001670 con 0x7f3e5c157540 2023-11-04T01:43:44.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.551+0000 7f3e5b7fe640 1 -- 172.21.15.77:0/3068290969 >> v1:172.21.15.77:6789/0 conn(0x7f3e5c157540 legacy=0x7f3e5c0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.551+0000 7f3e5b7fe640 1 --2- 172.21.15.77:0/3068290969 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e48003970 0x7f3e48003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.551+0000 7f3e5b7fe640 1 --2- 172.21.15.77:0/3068290969 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3e480047c0 0x7f3e48004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.551+0000 7f3e5b7fe640 1 --2- 172.21.15.77:0/3068290969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e48005180 0x7f3e4800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.551+0000 7f3e5b7fe640 1 -- 172.21.15.77:0/3068290969 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c15e5c0 con 0x7f3e48005180 2023-11-04T01:43:44.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.551+0000 7f3e5b7fe640 1 -- 172.21.15.77:0/3068290969 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4800c020 con 0x7f3e48003970 2023-11-04T01:43:44.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.551+0000 7f3e5b7fe640 1 -- 172.21.15.77:0/3068290969 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4800c1e0 con 0x7f3e480047c0 2023-11-04T01:43:44.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.551+0000 7f3e610db640 1 --2- 172.21.15.77:0/3068290969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e48005180 0x7f3e4800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.551+0000 7f3e608da640 1 --2- 172.21.15.77:0/3068290969 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e48003970 0x7f3e48003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.552+0000 7f3e5bfff640 1 --2- 172.21.15.77:0/3068290969 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3e480047c0 0x7f3e48004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.552+0000 7f3e610db640 1 -- 172.21.15.77:0/3068290969 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3e480047c0 msgr2=0x7f3e48004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:44.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.552+0000 7f3e610db640 1 --2- 172.21.15.77:0/3068290969 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3e480047c0 0x7f3e48004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.552+0000 7f3e610db640 1 -- 172.21.15.77:0/3068290969 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e48003970 msgr2=0x7f3e48003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:44.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.552+0000 7f3e610db640 1 --2- 172.21.15.77:0/3068290969 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e48003970 0x7f3e48003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.552+0000 7f3e610db640 1 -- 172.21.15.77:0/3068290969 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e48003520 con 0x7f3e48005180 2023-11-04T01:43:44.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.552+0000 7f3e5bfff640 1 --2- 172.21.15.77:0/3068290969 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3e480047c0 0x7f3e48004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:44.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.552+0000 7f3e610db640 1 -- 172.21.15.77:0/3068290969 reap_dead start 2023-11-04T01:43:44.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.552+0000 7f3e610db640 1 --2- 172.21.15.77:0/3068290969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e48005180 0x7f3e4800b980 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c00c240 tx=0x7f3e480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a84f803355be58e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:44.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.553+0000 7f3e5b7fe640 1 -- 172.21.15.77:0/3068290969 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c005ad0 con 0x7f3e48005180 2023-11-04T01:43:44.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.553+0000 7f3e5b7fe640 1 -- 172.21.15.77:0/3068290969 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4c005c70 con 0x7f3e48005180 2023-11-04T01:43:44.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.553+0000 7f3e5b7fe640 1 -- 172.21.15.77:0/3068290969 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c02c8b0 con 0x7f3e48005180 2023-11-04T01:43:44.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.553+0000 7f3e62b3e640 1 -- 172.21.15.77:0/3068290969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e48005180 msgr2=0x7f3e4800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.553+0000 7f3e62b3e640 1 --2- 172.21.15.77:0/3068290969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e48005180 0x7f3e4800b980 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c00c240 tx=0x7f3e480057f0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.553+0000 7f3e62b3e640 1 -- 172.21.15.77:0/3068290969 shutdown_connections 2023-11-04T01:43:44.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.553+0000 7f3e62b3e640 1 --2- 172.21.15.77:0/3068290969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e48005180 0x7f3e4800b980 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.553+0000 7f3e62b3e640 1 -- 172.21.15.77:0/3068290969 >> 172.21.15.77:0/3068290969 conn(0x7f3e5c071f30 msgr2=0x7f3e5c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:44.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.553+0000 7f3e62b3e640 1 -- 172.21.15.77:0/3068290969 shutdown_connections 2023-11-04T01:43:44.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.553+0000 7f3e62b3e640 1 -- 172.21.15.77:0/3068290969 wait complete. 2023-11-04T01:43:44.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.554+0000 7f3e62b3e640 1 Processor -- start 2023-11-04T01:43:44.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.554+0000 7f3e62b3e640 1 -- start start 2023-11-04T01:43:44.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.555+0000 7f3e62b3e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e48005180 0x7f3e5c155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.555+0000 7f3e62b3e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e5c1f23d0 0x7f3e5c0c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.555+0000 7f3e62b3e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3e5c0c9000 0x7f3e5c157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.555+0000 7f3e62b3e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c158b40 con 0x7f3e5c1f23d0 2023-11-04T01:43:44.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.555+0000 7f3e62b3e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c0c9480 con 0x7f3e48005180 2023-11-04T01:43:44.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.555+0000 7f3e62b3e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c159970 con 0x7f3e5c0c9000 2023-11-04T01:43:44.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.555+0000 7f3e5bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e5c1f23d0 0x7f3e5c0c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.555+0000 7f3e5bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e5c1f23d0 0x7f3e5c0c8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35200/0 (socket says 172.21.15.77:35200) 2023-11-04T01:43:44.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.555+0000 7f3e5bfff640 1 -- 172.21.15.77:0/4096748477 learned_addr learned my addr 172.21.15.77:0/4096748477 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:44.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.555+0000 7f3e608da640 1 --2- 172.21.15.77:0/4096748477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e48005180 0x7f3e5c155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.555+0000 7f3e610db640 1 --2- 172.21.15.77:0/4096748477 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3e5c0c9000 0x7f3e5c157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.556+0000 7f3e5bfff640 1 -- 172.21.15.77:0/4096748477 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3e5c0c9000 msgr2=0x7f3e5c157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.556+0000 7f3e5bfff640 1 --2- 172.21.15.77:0/4096748477 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3e5c0c9000 0x7f3e5c157b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.556+0000 7f3e5bfff640 1 -- 172.21.15.77:0/4096748477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e48005180 msgr2=0x7f3e5c155c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.556+0000 7f3e5bfff640 1 --2- 172.21.15.77:0/4096748477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e48005180 0x7f3e5c155c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.556+0000 7f3e5bfff640 1 -- 172.21.15.77:0/4096748477 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e5c158860 con 0x7f3e5c1f23d0 2023-11-04T01:43:44.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.556+0000 7f3e5bfff640 1 --2- 172.21.15.77:0/4096748477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e5c1f23d0 0x7f3e5c0c8ac0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f3e44011570 tx=0x7f3e44011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:44.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.556+0000 7f3e597fa640 1 -- 172.21.15.77:0/4096748477 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e44015870 con 0x7f3e5c1f23d0 2023-11-04T01:43:44.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.556+0000 7f3e597fa640 1 -- 172.21.15.77:0/4096748477 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e440159d0 con 0x7f3e5c1f23d0 2023-11-04T01:43:44.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.556+0000 7f3e62b3e640 1 -- 172.21.15.77:0/4096748477 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e5c159320 con 0x7f3e5c1f23d0 2023-11-04T01:43:44.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.556+0000 7f3e597fa640 1 -- 172.21.15.77:0/4096748477 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e44015d40 con 0x7f3e5c1f23d0 2023-11-04T01:43:44.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.556+0000 7f3e62b3e640 1 -- 172.21.15.77:0/4096748477 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e5c156190 con 0x7f3e5c1f23d0 2023-11-04T01:43:44.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.557+0000 7f3e62b3e640 1 -- 172.21.15.77:0/4096748477 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e5c159180 con 0x7f3e5c1f23d0 2023-11-04T01:43:44.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.557+0000 7f3e597fa640 1 -- 172.21.15.77:0/4096748477 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3e4400f460 con 0x7f3e5c1f23d0 2023-11-04T01:43:44.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.558+0000 7f3e597fa640 1 --2- 172.21.15.77:0/4096748477 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3e3c06aea0 0x7f3e3c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.558+0000 7f3e597fa640 1 -- 172.21.15.77:0/4096748477 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f3e4408a0f0 con 0x7f3e5c1f23d0 2023-11-04T01:43:44.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.558+0000 7f3e608da640 1 --2- 172.21.15.77:0/4096748477 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3e3c06aea0 0x7f3e3c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.559+0000 7f3e608da640 1 --2- 172.21.15.77:0/4096748477 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3e3c06aea0 0x7f3e3c06d360 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f3e54000f80 tx=0x7f3e54009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:44.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.562+0000 7f3e597fa640 1 -- 172.21.15.77:0/4096748477 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3e5c159180 con 0x7f3e5c1f23d0 2023-11-04T01:43:44.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.763+0000 7f3e62b3e640 1 -- 172.21.15.77:0/4096748477 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e5c159180 con 0x7f3e5c1f23d0 2023-11-04T01:43:44.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.764+0000 7f3e597fa640 1 -- 172.21.15.77:0/4096748477 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f3e5c159180 con 0x7f3e5c1f23d0 2023-11-04T01:43:44.766 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:43:44.766 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7302,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/4241784871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4241784871},{"type":"v1","addr":"172.21.15.77:6834","nonce":4241784871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:43:36.620245+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":35690,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_35690":{"gid":35690,"name":"b","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6836/3699147778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":3699147778},{"type":"v1","addr":"172.21.15.122:6836","nonce":3699147778}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:44.767 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 47 2023-11-04T01:43:44.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.766+0000 7f3e62b3e640 1 -- 172.21.15.77:0/4096748477 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3e3c06aea0 msgr2=0x7f3e3c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.766+0000 7f3e62b3e640 1 --2- 172.21.15.77:0/4096748477 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3e3c06aea0 0x7f3e3c06d360 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f3e54000f80 tx=0x7f3e54009040 comp rx=0 tx=0).stop 2023-11-04T01:43:44.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.766+0000 7f3e62b3e640 1 -- 172.21.15.77:0/4096748477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e5c1f23d0 msgr2=0x7f3e5c0c8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.766+0000 7f3e62b3e640 1 --2- 172.21.15.77:0/4096748477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e5c1f23d0 0x7f3e5c0c8ac0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f3e44011570 tx=0x7f3e44011a30 comp rx=0 tx=0).stop 2023-11-04T01:43:44.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.766+0000 7f3e62b3e640 1 -- 172.21.15.77:0/4096748477 shutdown_connections 2023-11-04T01:43:44.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.766+0000 7f3e62b3e640 1 --2- 172.21.15.77:0/4096748477 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3e3c06aea0 0x7f3e3c06d360 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.766+0000 7f3e62b3e640 1 --2- 172.21.15.77:0/4096748477 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3e5c0c9000 0x7f3e5c157b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.766+0000 7f3e62b3e640 1 --2- 172.21.15.77:0/4096748477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e5c1f23d0 0x7f3e5c0c8ac0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.766+0000 7f3e62b3e640 1 --2- 172.21.15.77:0/4096748477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e48005180 0x7f3e5c155c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.766+0000 7f3e62b3e640 1 -- 172.21.15.77:0/4096748477 >> 172.21.15.77:0/4096748477 conn(0x7f3e5c071f30 msgr2=0x7f3e5c0c6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:44.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.766+0000 7f3e62b3e640 1 -- 172.21.15.77:0/4096748477 shutdown_connections 2023-11-04T01:43:44.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:44.766+0000 7f3e62b3e640 1 -- 172.21.15.77:0/4096748477 wait complete. 2023-11-04T01:43:44.778 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-11-04T01:43:44.892 INFO:teuthology.orchestra.run.smithi077.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-11-04T01:43:44.892 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-11-04T01:43:44.893 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1', 1)] 2023-11-04T01:43:46.894 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:47.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.003+0000 7f320c5e7640 1 Processor -- start 2023-11-04T01:43:47.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.003+0000 7f320c5e7640 1 -- start start 2023-11-04T01:43:47.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.004+0000 7f320c5e7640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32040cde60 0x7f320415d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.004+0000 7f320c5e7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f320415e000 con 0x7f320415daa0 2023-11-04T01:43:47.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.004+0000 7f320c5e7640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f320415e2e0 con 0x7f32040ce240 2023-11-04T01:43:47.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.004+0000 7f320c5e7640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f320415e5c0 con 0x7f32040cde60 2023-11-04T01:43:47.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.004+0000 7f3209b82640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f320415daa0 0x7f3204157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:48596/0 (socket says 172.21.15.77:48596) 2023-11-04T01:43:47.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.004+0000 7f3209b82640 1 -- 172.21.15.77:0/3530107796 learned_addr learned my addr 172.21.15.77:0/3530107796 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:47.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.005+0000 7f320a383640 1 --2- 172.21.15.77:0/3530107796 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32040cde60 0x7f320415d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.005+0000 7f3209381640 1 -- 172.21.15.77:0/3530107796 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804212256 0 0) 0x7f320415e000 con 0x7f320415daa0 2023-11-04T01:43:47.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.005+0000 7f3209381640 1 -- 172.21.15.77:0/3530107796 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31f0003520 con 0x7f320415daa0 2023-11-04T01:43:47.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.005+0000 7f3209381640 1 -- 172.21.15.77:0/3530107796 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2890208538 0 0) 0x7f320415e2e0 con 0x7f32040ce240 2023-11-04T01:43:47.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.005+0000 7f3209381640 1 -- 172.21.15.77:0/3530107796 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f320415e000 con 0x7f32040ce240 2023-11-04T01:43:47.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.005+0000 7f320a383640 1 -- 172.21.15.77:0/3530107796 >> v1:172.21.15.122:6789/0 conn(0x7f32040ce240 legacy=0x7f32040d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.005+0000 7f320a383640 1 -- 172.21.15.77:0/3530107796 >> v1:172.21.15.77:6789/0 conn(0x7f320415daa0 legacy=0x7f3204157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.005+0000 7f320a383640 1 -- 172.21.15.77:0/3530107796 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32040d1120 con 0x7f32040cde60 2023-11-04T01:43:47.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.006+0000 7f320a383640 1 --2- 172.21.15.77:0/3530107796 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32040cde60 0x7f320415d560 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3200009dc0 tx=0x7f320002bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c74954ae219ee1d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:47.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.006+0000 7f3209381640 1 -- 172.21.15.77:0/3530107796 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320002ccd0 con 0x7f32040cde60 2023-11-04T01:43:47.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.006+0000 7f3209381640 1 -- 172.21.15.77:0/3530107796 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f320002ce30 con 0x7f32040cde60 2023-11-04T01:43:47.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.006+0000 7f3209381640 1 -- 172.21.15.77:0/3530107796 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3200034660 con 0x7f32040cde60 2023-11-04T01:43:47.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.006+0000 7f320c5e7640 1 -- 172.21.15.77:0/3530107796 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32040cde60 msgr2=0x7f320415d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.006+0000 7f320c5e7640 1 --2- 172.21.15.77:0/3530107796 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32040cde60 0x7f320415d560 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3200009dc0 tx=0x7f320002bf20 comp rx=0 tx=0).stop 2023-11-04T01:43:47.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.007+0000 7f320c5e7640 1 -- 172.21.15.77:0/3530107796 shutdown_connections 2023-11-04T01:43:47.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.007+0000 7f320c5e7640 1 --2- 172.21.15.77:0/3530107796 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32040cde60 0x7f320415d560 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.007+0000 7f320c5e7640 1 -- 172.21.15.77:0/3530107796 >> 172.21.15.77:0/3530107796 conn(0x7f3204071f30 msgr2=0x7f32040cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:47.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.007+0000 7f320c5e7640 1 -- 172.21.15.77:0/3530107796 shutdown_connections 2023-11-04T01:43:47.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.007+0000 7f320c5e7640 1 -- 172.21.15.77:0/3530107796 wait complete. 2023-11-04T01:43:47.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.008+0000 7f320c5e7640 1 Processor -- start 2023-11-04T01:43:47.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.008+0000 7f320c5e7640 1 -- start start 2023-11-04T01:43:47.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.009+0000 7f320c5e7640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32040cde60 0x7f32041537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.009+0000 7f320c5e7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32040ce240 0x7f3204156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.009+0000 7f320c5e7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f320415daa0 0x7f3204155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.009+0000 7f320c5e7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32041f28b0 con 0x7f32040ce240 2023-11-04T01:43:47.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.009+0000 7f320c5e7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3204156dd0 con 0x7f320415daa0 2023-11-04T01:43:47.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.009+0000 7f320c5e7640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3204157020 con 0x7f32040cde60 2023-11-04T01:43:47.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.009+0000 7f3209b82640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32040ce240 0x7f3204156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.009+0000 7f3209b82640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32040ce240 0x7f3204156180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35214/0 (socket says 172.21.15.77:35214) 2023-11-04T01:43:47.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.009+0000 7f3209b82640 1 -- 172.21.15.77:0/3248100718 learned_addr learned my addr 172.21.15.77:0/3248100718 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:47.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.009+0000 7f320a383640 1 --2- 172.21.15.77:0/3248100718 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32040cde60 0x7f32041537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.009+0000 7f320ab84640 1 --2- 172.21.15.77:0/3248100718 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f320415daa0 0x7f3204155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.009+0000 7f3209b82640 1 -- 172.21.15.77:0/3248100718 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32040cde60 msgr2=0x7f32041537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.009+0000 7f3209b82640 1 --2- 172.21.15.77:0/3248100718 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32040cde60 0x7f32041537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.009+0000 7f3209b82640 1 -- 172.21.15.77:0/3248100718 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f320415daa0 msgr2=0x7f3204155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.009+0000 7f3209b82640 1 --2- 172.21.15.77:0/3248100718 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f320415daa0 0x7f3204155260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.009+0000 7f3209b82640 1 -- 172.21.15.77:0/3248100718 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3200009a70 con 0x7f32040ce240 2023-11-04T01:43:47.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.009+0000 7f320a383640 1 --2- 172.21.15.77:0/3248100718 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32040cde60 0x7f32041537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:47.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.009+0000 7f3209b82640 1 --2- 172.21.15.77:0/3248100718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32040ce240 0x7f3204156180 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f31f400c4d0 tx=0x7f31f400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:47.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.009+0000 7f31faffd640 1 -- 172.21.15.77:0/3248100718 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f4005ce0 con 0x7f32040ce240 2023-11-04T01:43:47.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.009+0000 7f31faffd640 1 -- 172.21.15.77:0/3248100718 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f4005e40 con 0x7f32040ce240 2023-11-04T01:43:47.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.009+0000 7f320c5e7640 1 -- 172.21.15.77:0/3248100718 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3204157300 con 0x7f32040ce240 2023-11-04T01:43:47.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.009+0000 7f31faffd640 1 -- 172.21.15.77:0/3248100718 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f4007270 con 0x7f32040ce240 2023-11-04T01:43:47.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.009+0000 7f320c5e7640 1 -- 172.21.15.77:0/3248100718 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32041578c0 con 0x7f32040ce240 2023-11-04T01:43:47.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.010+0000 7f320c5e7640 1 -- 172.21.15.77:0/3248100718 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3204157ae0 con 0x7f32040ce240 2023-11-04T01:43:47.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.011+0000 7f31faffd640 1 -- 172.21.15.77:0/3248100718 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f31f40073d0 con 0x7f32040ce240 2023-11-04T01:43:47.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.011+0000 7f31faffd640 1 --2- 172.21.15.77:0/3248100718 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f31e806ae70 0x7f31e806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.011+0000 7f31faffd640 1 -- 172.21.15.77:0/3248100718 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7f31f4088fe0 con 0x7f32040ce240 2023-11-04T01:43:47.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.011+0000 7f320a383640 1 --2- 172.21.15.77:0/3248100718 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f31e806ae70 0x7f31e806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.012+0000 7f320a383640 1 --2- 172.21.15.77:0/3248100718 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f31e806ae70 0x7f31e806d330 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f3200036000 tx=0x7f3200030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:47.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.015+0000 7f31faffd640 1 -- 172.21.15.77:0/3248100718 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f31f4053c50 con 0x7f32040ce240 2023-11-04T01:43:47.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.218+0000 7f320c5e7640 1 -- 172.21.15.77:0/3248100718 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3204074290 con 0x7f32040ce240 2023-11-04T01:43:47.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.219+0000 7f31faffd640 1 -- 172.21.15.77:0/3248100718 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4939 (secure 0 0 0) 0x7f31f4057270 con 0x7f32040ce240 2023-11-04T01:43:47.221 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:43:47.221 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7302,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/4241784871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4241784871},{"type":"v1","addr":"172.21.15.77:6834","nonce":4241784871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:43:45.869116+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":35690,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_35690":{"gid":35690,"name":"b","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6836/3699147778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":3699147778},{"type":"v1","addr":"172.21.15.122:6836","nonce":3699147778}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:47.222 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 48 2023-11-04T01:43:47.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.221+0000 7f320c5e7640 1 -- 172.21.15.77:0/3248100718 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f31e806ae70 msgr2=0x7f31e806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.221+0000 7f320c5e7640 1 --2- 172.21.15.77:0/3248100718 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f31e806ae70 0x7f31e806d330 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f3200036000 tx=0x7f3200030000 comp rx=0 tx=0).stop 2023-11-04T01:43:47.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.221+0000 7f320c5e7640 1 -- 172.21.15.77:0/3248100718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32040ce240 msgr2=0x7f3204156180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.221+0000 7f320c5e7640 1 --2- 172.21.15.77:0/3248100718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32040ce240 0x7f3204156180 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f31f400c4d0 tx=0x7f31f400c990 comp rx=0 tx=0).stop 2023-11-04T01:43:47.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.221+0000 7f320c5e7640 1 -- 172.21.15.77:0/3248100718 shutdown_connections 2023-11-04T01:43:47.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.221+0000 7f320c5e7640 1 --2- 172.21.15.77:0/3248100718 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f31e806ae70 0x7f31e806d330 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.221+0000 7f320c5e7640 1 --2- 172.21.15.77:0/3248100718 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f320415daa0 0x7f3204155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.221+0000 7f320c5e7640 1 --2- 172.21.15.77:0/3248100718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32040ce240 0x7f3204156180 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.221+0000 7f320c5e7640 1 --2- 172.21.15.77:0/3248100718 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32040cde60 0x7f32041537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.221+0000 7f320c5e7640 1 -- 172.21.15.77:0/3248100718 >> 172.21.15.77:0/3248100718 conn(0x7f3204071f30 msgr2=0x7f32040d1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:47.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.221+0000 7f320c5e7640 1 -- 172.21.15.77:0/3248100718 shutdown_connections 2023-11-04T01:43:47.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.221+0000 7f320c5e7640 1 -- 172.21.15.77:0/3248100718 wait complete. 2023-11-04T01:43:47.234 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-11-04T01:43:47.347 INFO:teuthology.orchestra.run.smithi077.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"8","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"3","version":"3","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2023-11-04T01:43:47.347 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "8" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "3", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "3" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-11-04T01:43:47.348 INFO:tasks.cephfs.cephfs_test_case:[('/d1', 1)] =?= [('/d1', 1)] 2023-11-04T01:43:47.349 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dump snaps --server 2023-11-04T01:43:47.473 INFO:teuthology.orchestra.run.smithi122.stdout:{"last_snap":1,"last_created":1,"last_destroyed":1,"pending_noop":[],"snaps":[],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:43:47.474 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 1, "last_destroyed": 1, "last_snap": 1, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [] } 2023-11-04T01:43:47.474 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=1 2023-11-04T01:43:47.475 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:47.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.572+0000 7fb9d14b4640 1 Processor -- start 2023-11-04T01:43:47.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.572+0000 7fb9d14b4640 1 -- start start 2023-11-04T01:43:47.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.573+0000 7fb9d14b4640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb9cc0aec80 0x7fb9cc0b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.573+0000 7fb9d14b4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb9cc0af060 0x7fb9cc06a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.573+0000 7fb9d14b4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9cc0b1590 con 0x7fb9cc06ef40 2023-11-04T01:43:47.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.573+0000 7fb9d14b4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9cc155a40 con 0x7fb9cc0af060 2023-11-04T01:43:47.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.573+0000 7fb9d14b4640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9cc06a660 con 0x7fb9cc0aec80 2023-11-04T01:43:47.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.573+0000 7fb9ca7fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb9cc0af060 0x7fb9cc06a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.573+0000 7fb9cb7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb9cc06ef40 0x7fb9cc0cb7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:60916/0 (socket says 172.21.15.77:60916) 2023-11-04T01:43:47.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.573+0000 7fb9cb7fe640 1 -- 172.21.15.77:0/4186483526 learned_addr learned my addr 172.21.15.77:0/4186483526 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:47.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.573+0000 7fb9caffd640 1 --2- 172.21.15.77:0/4186483526 >> v2:172.21.15.122:3300/0 conn(0x7fb9cc0aec80 0x7fb9cc0b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.573+0000 7fb9ca7fc640 1 -- 172.21.15.77:0/4186483526 >> v2:172.21.15.122:3300/0 conn(0x7fb9cc0aec80 msgr2=0x7fb9cc0b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:47.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.573+0000 7fb9ca7fc640 1 --2- 172.21.15.77:0/4186483526 >> v2:172.21.15.122:3300/0 conn(0x7fb9cc0aec80 0x7fb9cc0b1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.573+0000 7fb9ca7fc640 1 -- 172.21.15.77:0/4186483526 >> v1:172.21.15.77:6789/0 conn(0x7fb9cc06ef40 legacy=0x7fb9cc0cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.573+0000 7fb9ca7fc640 1 -- 172.21.15.77:0/4186483526 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9cc06a8e0 con 0x7fb9cc0af060 2023-11-04T01:43:47.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.573+0000 7fb9caffd640 1 --2- 172.21.15.77:0/4186483526 >> v2:172.21.15.122:3300/0 conn(0x7fb9cc0aec80 0x7fb9cc0b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:47.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.574+0000 7fb9ca7fc640 1 --2- 172.21.15.77:0/4186483526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9cc0af060 0x7fb9cc06a120 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc06f440 tx=0x7fb9c002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e28130b71549745f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:47.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.574+0000 7fb9c9ffb640 1 -- 172.21.15.77:0/4186483526 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c0031830 con 0x7fb9cc0af060 2023-11-04T01:43:47.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.574+0000 7fb9c9ffb640 1 -- 172.21.15.77:0/4186483526 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c0031990 con 0x7fb9cc0af060 2023-11-04T01:43:47.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.574+0000 7fb9c9ffb640 1 -- 172.21.15.77:0/4186483526 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c0031d20 con 0x7fb9cc0af060 2023-11-04T01:43:47.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.574+0000 7fb9d14b4640 1 -- 172.21.15.77:0/4186483526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9cc0af060 msgr2=0x7fb9cc06a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.574+0000 7fb9d14b4640 1 --2- 172.21.15.77:0/4186483526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9cc0af060 0x7fb9cc06a120 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc06f440 tx=0x7fb9c002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.575+0000 7fb9d14b4640 1 -- 172.21.15.77:0/4186483526 shutdown_connections 2023-11-04T01:43:47.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.575+0000 7fb9d14b4640 1 --2- 172.21.15.77:0/4186483526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9cc0af060 0x7fb9cc06a120 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.575+0000 7fb9d14b4640 1 --2- 172.21.15.77:0/4186483526 >> v2:172.21.15.122:3300/0 conn(0x7fb9cc0aec80 0x7fb9cc0b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.575+0000 7fb9d14b4640 1 -- 172.21.15.77:0/4186483526 >> 172.21.15.77:0/4186483526 conn(0x7fb9cc098d40 msgr2=0x7fb9cc0cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:47.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.575+0000 7fb9d14b4640 1 -- 172.21.15.77:0/4186483526 shutdown_connections 2023-11-04T01:43:47.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.575+0000 7fb9d14b4640 1 -- 172.21.15.77:0/4186483526 wait complete. 2023-11-04T01:43:47.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.576+0000 7fb9d14b4640 1 Processor -- start 2023-11-04T01:43:47.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.576+0000 7fb9d14b4640 1 -- start start 2023-11-04T01:43:47.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.577+0000 7fb9d14b4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9cc06ef40 0x7fb9cc0c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.577+0000 7fb9d14b4640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb9cc0aec80 0x7fb9cc14a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.577+0000 7fb9d14b4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9cc0af060 0x7fb9cc0c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.577+0000 7fb9d14b4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc0c8830 con 0x7fb9cc06ef40 2023-11-04T01:43:47.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.577+0000 7fb9d14b4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc0c7140 con 0x7fb9cc0af060 2023-11-04T01:43:47.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.577+0000 7fb9d14b4640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc0c7420 con 0x7fb9cc0aec80 2023-11-04T01:43:47.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.577+0000 7fb9caffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9cc06ef40 0x7fb9cc0c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.577+0000 7fb9caffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9cc06ef40 0x7fb9cc0c6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48640/0 (socket says 172.21.15.77:48640) 2023-11-04T01:43:47.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.577+0000 7fb9caffd640 1 -- 172.21.15.77:0/3135680257 learned_addr learned my addr 172.21.15.77:0/3135680257 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:47.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.577+0000 7fb9cb7fe640 1 --2- 172.21.15.77:0/3135680257 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9cc0af060 0x7fb9cc0c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.577+0000 7fb9ca7fc640 1 --2- 172.21.15.77:0/3135680257 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb9cc0aec80 0x7fb9cc14a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.577+0000 7fb9caffd640 1 -- 172.21.15.77:0/3135680257 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb9cc0aec80 msgr2=0x7fb9cc14a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.577+0000 7fb9caffd640 1 --2- 172.21.15.77:0/3135680257 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb9cc0aec80 0x7fb9cc14a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.577+0000 7fb9caffd640 1 -- 172.21.15.77:0/3135680257 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9cc0af060 msgr2=0x7fb9cc0c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.577+0000 7fb9caffd640 1 --2- 172.21.15.77:0/3135680257 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9cc0af060 0x7fb9cc0c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.577+0000 7fb9caffd640 1 -- 172.21.15.77:0/3135680257 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c00093a0 con 0x7fb9cc06ef40 2023-11-04T01:43:47.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.577+0000 7fb9ca7fc640 1 --2- 172.21.15.77:0/3135680257 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb9cc0aec80 0x7fb9cc14a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:47.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.577+0000 7fb9caffd640 1 --2- 172.21.15.77:0/3135680257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9cc06ef40 0x7fb9cc0c6ab0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc00a390 tx=0x7fb9bc00a850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:47.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.577+0000 7fb9b37fe640 1 -- 172.21.15.77:0/3135680257 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc008580 con 0x7fb9cc06ef40 2023-11-04T01:43:47.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.577+0000 7fb9b37fe640 1 -- 172.21.15.77:0/3135680257 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9bc0086e0 con 0x7fb9cc06ef40 2023-11-04T01:43:47.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.577+0000 7fb9d14b4640 1 -- 172.21.15.77:0/3135680257 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9cc0c7700 con 0x7fb9cc06ef40 2023-11-04T01:43:47.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.577+0000 7fb9b37fe640 1 -- 172.21.15.77:0/3135680257 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc008a70 con 0x7fb9cc06ef40 2023-11-04T01:43:47.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.577+0000 7fb9d14b4640 1 -- 172.21.15.77:0/3135680257 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9cc1f4670 con 0x7fb9cc06ef40 2023-11-04T01:43:47.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.578+0000 7fb9d14b4640 1 -- 172.21.15.77:0/3135680257 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9cc0c7940 con 0x7fb9cc06ef40 2023-11-04T01:43:47.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.579+0000 7fb9b37fe640 1 -- 172.21.15.77:0/3135680257 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb9bc008bd0 con 0x7fb9cc06ef40 2023-11-04T01:43:47.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.579+0000 7fb9b37fe640 1 --2- 172.21.15.77:0/3135680257 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb9b806ae70 0x7fb9b806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.579+0000 7fb9b37fe640 1 -- 172.21.15.77:0/3135680257 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7120+0+0 (secure 0 0 0) 0x7fb9bc089fb0 con 0x7fb9cc06ef40 2023-11-04T01:43:47.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.579+0000 7fb9ca7fc640 1 --2- 172.21.15.77:0/3135680257 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb9b806ae70 0x7fb9b806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.580+0000 7fb9ca7fc640 1 --2- 172.21.15.77:0/3135680257 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb9b806ae70 0x7fb9b806d330 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0036000 tx=0x7fb9c003c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:47.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.583+0000 7fb9b37fe640 1 -- 172.21.15.77:0/3135680257 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb9bc0bcca0 con 0x7fb9cc06ef40 2023-11-04T01:43:47.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.789+0000 7fb9d14b4640 1 -- 172.21.15.77:0/3135680257 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb9cc1f3fb0 con 0x7fb9cc06ef40 2023-11-04T01:43:47.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.790+0000 7fb9b37fe640 1 -- 172.21.15.77:0/3135680257 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4939 (secure 0 0 0) 0x7fb9cc1f3fb0 con 0x7fb9cc06ef40 2023-11-04T01:43:47.792 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:43:47.792 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7302,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/4241784871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4241784871},{"type":"v1","addr":"172.21.15.77:6834","nonce":4241784871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:43:45.869116+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":35690,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_35690":{"gid":35690,"name":"b","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6836/3699147778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":3699147778},{"type":"v1","addr":"172.21.15.122:6836","nonce":3699147778}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:47.793 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 48 2023-11-04T01:43:47.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.792+0000 7fb9d14b4640 1 -- 172.21.15.77:0/3135680257 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb9b806ae70 msgr2=0x7fb9b806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.792+0000 7fb9d14b4640 1 --2- 172.21.15.77:0/3135680257 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb9b806ae70 0x7fb9b806d330 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0036000 tx=0x7fb9c003c040 comp rx=0 tx=0).stop 2023-11-04T01:43:47.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.792+0000 7fb9d14b4640 1 -- 172.21.15.77:0/3135680257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9cc06ef40 msgr2=0x7fb9cc0c6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.792+0000 7fb9d14b4640 1 --2- 172.21.15.77:0/3135680257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9cc06ef40 0x7fb9cc0c6ab0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc00a390 tx=0x7fb9bc00a850 comp rx=0 tx=0).stop 2023-11-04T01:43:47.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.792+0000 7fb9d14b4640 1 -- 172.21.15.77:0/3135680257 shutdown_connections 2023-11-04T01:43:47.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.792+0000 7fb9d14b4640 1 --2- 172.21.15.77:0/3135680257 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb9b806ae70 0x7fb9b806d330 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.792+0000 7fb9d14b4640 1 --2- 172.21.15.77:0/3135680257 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb9cc0af060 0x7fb9cc0c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.792+0000 7fb9d14b4640 1 --2- 172.21.15.77:0/3135680257 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb9cc0aec80 0x7fb9cc14a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.792+0000 7fb9d14b4640 1 --2- 172.21.15.77:0/3135680257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9cc06ef40 0x7fb9cc0c6ab0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.792+0000 7fb9d14b4640 1 -- 172.21.15.77:0/3135680257 >> 172.21.15.77:0/3135680257 conn(0x7fb9cc098d40 msgr2=0x7fb9cc0cce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:47.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.792+0000 7fb9d14b4640 1 -- 172.21.15.77:0/3135680257 shutdown_connections 2023-11-04T01:43:47.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.792+0000 7fb9d14b4640 1 -- 172.21.15.77:0/3135680257 wait complete. 2023-11-04T01:43:47.804 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:43:47.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.904+0000 7fa4c1305640 1 Processor -- start 2023-11-04T01:43:47.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.904+0000 7fa4c1305640 1 -- start start 2023-11-04T01:43:47.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.904+0000 7fa4c1305640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa4bc0cd6d0 0x7fa4bc161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.904+0000 7fa4c1305640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa4bc0b4880 0x7fa4bc0b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.904+0000 7fa4c1305640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4bc0cde60 con 0x7fa4bc153e60 2023-11-04T01:43:47.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.904+0000 7fa4c1305640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4bc160f90 con 0x7fa4bc0cd6d0 2023-11-04T01:43:47.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.904+0000 7fa4c1305640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4bc161960 con 0x7fa4bc0b4880 2023-11-04T01:43:47.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.904+0000 7fa4ba7fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa4bc0cd6d0 0x7fa4bc161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.904+0000 7fa4ba7fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa4bc0cd6d0 0x7fa4bc161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48650/0 (socket says 172.21.15.77:48650) 2023-11-04T01:43:47.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.905+0000 7fa4ba7fc640 1 -- 172.21.15.77:0/3256046462 learned_addr learned my addr 172.21.15.77:0/3256046462 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:47.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.905+0000 7fa4bb7fe640 1 --2- 172.21.15.77:0/3256046462 >> v2:172.21.15.122:3300/0 conn(0x7fa4bc0b4880 0x7fa4bc0b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.905+0000 7fa4ba7fc640 1 -- 172.21.15.77:0/3256046462 >> v2:172.21.15.122:3300/0 conn(0x7fa4bc0b4880 msgr2=0x7fa4bc0b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:47.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.905+0000 7fa4ba7fc640 1 --2- 172.21.15.77:0/3256046462 >> v2:172.21.15.122:3300/0 conn(0x7fa4bc0b4880 0x7fa4bc0b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.905+0000 7fa4ba7fc640 1 -- 172.21.15.77:0/3256046462 >> v1:172.21.15.122:6789/0 conn(0x7fa4bc153e60 legacy=0x7fa4bc15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.905+0000 7fa4ba7fc640 1 -- 172.21.15.77:0/3256046462 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc0b5220 con 0x7fa4bc0cd6d0 2023-11-04T01:43:47.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.905+0000 7fa4ba7fc640 1 --2- 172.21.15.77:0/3256046462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4bc0cd6d0 0x7fa4bc161420 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc0b8f40 tx=0x7fa4b002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f47b7a89db8aeb8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:47.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.906+0000 7fa4b9ffb640 1 -- 172.21.15.77:0/3256046462 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b0030860 con 0x7fa4bc0cd6d0 2023-11-04T01:43:47.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.906+0000 7fa4b9ffb640 1 -- 172.21.15.77:0/3256046462 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b00309c0 con 0x7fa4bc0cd6d0 2023-11-04T01:43:47.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.906+0000 7fa4b9ffb640 1 -- 172.21.15.77:0/3256046462 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b0030d50 con 0x7fa4bc0cd6d0 2023-11-04T01:43:47.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.906+0000 7fa4c1305640 1 -- 172.21.15.77:0/3256046462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4bc0cd6d0 msgr2=0x7fa4bc161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.906+0000 7fa4c1305640 1 --2- 172.21.15.77:0/3256046462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4bc0cd6d0 0x7fa4bc161420 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc0b8f40 tx=0x7fa4b002b9a0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.906+0000 7fa4c1305640 1 -- 172.21.15.77:0/3256046462 shutdown_connections 2023-11-04T01:43:47.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.906+0000 7fa4c1305640 1 --2- 172.21.15.77:0/3256046462 >> v2:172.21.15.122:3300/0 conn(0x7fa4bc0b4880 0x7fa4bc0b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.906+0000 7fa4c1305640 1 --2- 172.21.15.77:0/3256046462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4bc0cd6d0 0x7fa4bc161420 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.906+0000 7fa4c1305640 1 -- 172.21.15.77:0/3256046462 >> 172.21.15.77:0/3256046462 conn(0x7fa4bc0cf880 msgr2=0x7fa4bc0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:47.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.906+0000 7fa4c1305640 1 -- 172.21.15.77:0/3256046462 shutdown_connections 2023-11-04T01:43:47.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.906+0000 7fa4c1305640 1 -- 172.21.15.77:0/3256046462 wait complete. 2023-11-04T01:43:47.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.907+0000 7fa4c1305640 1 Processor -- start 2023-11-04T01:43:47.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.908+0000 7fa4c1305640 1 -- start start 2023-11-04T01:43:47.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.908+0000 7fa4c1305640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4bc0b4880 0x7fa4bc145a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.908+0000 7fa4c1305640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa4bc0cd6d0 0x7fa4bc0c6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.908+0000 7fa4c1305640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4bc153e60 0x7fa4bc158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.908+0000 7fa4c1305640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc159fe0 con 0x7fa4bc153e60 2023-11-04T01:43:47.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.908+0000 7fa4c1305640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc0c65c0 con 0x7fa4bc0b4880 2023-11-04T01:43:47.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.908+0000 7fa4c1305640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc159100 con 0x7fa4bc0cd6d0 2023-11-04T01:43:47.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.908+0000 7fa4bb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4bc153e60 0x7fa4bc158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.908+0000 7fa4bb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4bc153e60 0x7fa4bc158bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48652/0 (socket says 172.21.15.77:48652) 2023-11-04T01:43:47.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.908+0000 7fa4bb7fe640 1 -- 172.21.15.77:0/4153757690 learned_addr learned my addr 172.21.15.77:0/4153757690 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:47.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.909+0000 7fa4ba7fc640 1 --2- 172.21.15.77:0/4153757690 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa4bc0cd6d0 0x7fa4bc0c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.909+0000 7fa4baffd640 1 --2- 172.21.15.77:0/4153757690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4bc0b4880 0x7fa4bc145a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.909+0000 7fa4bb7fe640 1 -- 172.21.15.77:0/4153757690 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa4bc0cd6d0 msgr2=0x7fa4bc0c6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.909+0000 7fa4bb7fe640 1 --2- 172.21.15.77:0/4153757690 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa4bc0cd6d0 0x7fa4bc0c6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.909+0000 7fa4bb7fe640 1 -- 172.21.15.77:0/4153757690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4bc0b4880 msgr2=0x7fa4bc145a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.909+0000 7fa4bb7fe640 1 --2- 172.21.15.77:0/4153757690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4bc0b4880 0x7fa4bc145a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.909+0000 7fa4bb7fe640 1 -- 172.21.15.77:0/4153757690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b00094d0 con 0x7fa4bc153e60 2023-11-04T01:43:47.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.909+0000 7fa4ba7fc640 1 --2- 172.21.15.77:0/4153757690 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa4bc0cd6d0 0x7fa4bc0c6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:47.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.909+0000 7fa4baffd640 1 --2- 172.21.15.77:0/4153757690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4bc0b4880 0x7fa4bc145a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:47.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.909+0000 7fa4bb7fe640 1 --2- 172.21.15.77:0/4153757690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4bc153e60 0x7fa4bc158bc0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fa4b400e930 tx=0x7fa4b400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:47.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.909+0000 7fa4a37fe640 1 -- 172.21.15.77:0/4153757690 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4009690 con 0x7fa4bc153e60 2023-11-04T01:43:47.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.909+0000 7fa4a37fe640 1 -- 172.21.15.77:0/4153757690 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b400c920 con 0x7fa4bc153e60 2023-11-04T01:43:47.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.909+0000 7fa4a37fe640 1 -- 172.21.15.77:0/4153757690 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b400ccd0 con 0x7fa4bc153e60 2023-11-04T01:43:47.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.909+0000 7fa4c1305640 1 -- 172.21.15.77:0/4153757690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4bc159360 con 0x7fa4bc153e60 2023-11-04T01:43:47.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.909+0000 7fa4c1305640 1 -- 172.21.15.77:0/4153757690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4bc159920 con 0x7fa4bc153e60 2023-11-04T01:43:47.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.910+0000 7fa4c1305640 1 -- 172.21.15.77:0/4153757690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4bc15a120 con 0x7fa4bc153e60 2023-11-04T01:43:47.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.910+0000 7fa4a37fe640 1 -- 172.21.15.77:0/4153757690 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa4b4013470 con 0x7fa4bc153e60 2023-11-04T01:43:47.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.911+0000 7fa4a37fe640 1 --2- 172.21.15.77:0/4153757690 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa4a806ae70 0x7fa4a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.911+0000 7fa4a37fe640 1 -- 172.21.15.77:0/4153757690 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7178+0+0 (secure 0 0 0) 0x7fa4b4089d40 con 0x7fa4bc153e60 2023-11-04T01:43:47.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.911+0000 7fa4baffd640 1 --2- 172.21.15.77:0/4153757690 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa4a806ae70 0x7fa4a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.911+0000 7fa4baffd640 1 --2- 172.21.15.77:0/4153757690 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa4a806ae70 0x7fa4a806d330 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc142d60 tx=0x7fa4ac009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:47.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:47.915+0000 7fa4a37fe640 1 -- 172.21.15.77:0/4153757690 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa4bc15a120 con 0x7fa4bc153e60 2023-11-04T01:43:48.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:48.147+0000 7fa4c1305640 1 -- 172.21.15.77:0/4153757690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7fa4bc15a120 con 0x7fa4bc153e60 2023-11-04T01:43:48.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:48.751+0000 7fa4a37fe640 1 -- 172.21.15.77:0/4153757690 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.35690 v49) v1 ==== 113+0+0 (secure 0 0 0) 0x7fa4bc15a120 con 0x7fa4bc153e60 2023-11-04T01:43:48.753 INFO:teuthology.orchestra.run.smithi077.stderr:freezing mds.35690 2023-11-04T01:43:48.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:48.753+0000 7fa4c1305640 1 -- 172.21.15.77:0/4153757690 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa4a806ae70 msgr2=0x7fa4a806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:48.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:48.753+0000 7fa4c1305640 1 --2- 172.21.15.77:0/4153757690 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa4a806ae70 0x7fa4a806d330 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc142d60 tx=0x7fa4ac009040 comp rx=0 tx=0).stop 2023-11-04T01:43:48.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:48.753+0000 7fa4c1305640 1 -- 172.21.15.77:0/4153757690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4bc153e60 msgr2=0x7fa4bc158bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:48.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:48.753+0000 7fa4c1305640 1 --2- 172.21.15.77:0/4153757690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4bc153e60 0x7fa4bc158bc0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fa4b400e930 tx=0x7fa4b400edf0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:48.753+0000 7fa4c1305640 1 -- 172.21.15.77:0/4153757690 shutdown_connections 2023-11-04T01:43:48.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:48.753+0000 7fa4c1305640 1 --2- 172.21.15.77:0/4153757690 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa4a806ae70 0x7fa4a806d330 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:48.753+0000 7fa4c1305640 1 --2- 172.21.15.77:0/4153757690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4bc153e60 0x7fa4bc158bc0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:48.753+0000 7fa4c1305640 1 --2- 172.21.15.77:0/4153757690 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa4bc0cd6d0 0x7fa4bc0c6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:48.753+0000 7fa4c1305640 1 --2- 172.21.15.77:0/4153757690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4bc0b4880 0x7fa4bc145a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:48.753+0000 7fa4c1305640 1 -- 172.21.15.77:0/4153757690 >> 172.21.15.77:0/4153757690 conn(0x7fa4bc0cf880 msgr2=0x7fa4bc15fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:48.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:48.753+0000 7fa4c1305640 1 -- 172.21.15.77:0/4153757690 shutdown_connections 2023-11-04T01:43:48.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:48.753+0000 7fa4c1305640 1 -- 172.21.15.77:0/4153757690 wait complete. 2023-11-04T01:43:48.768 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json config set mds_kill_mdstable_at 1 2023-11-04T01:43:48.888 INFO:teuthology.orchestra.run.smithi122.stdout:{"success":"mds_kill_mdstable_at = '1' (not observed, change may require restart) "} 2023-11-04T01:43:48.889 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '1' (not observed, change may require restart) " } 2023-11-04T01:43:48.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:48.890 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s11) 2023-11-04T01:43:48.893 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:43:48.910 INFO:tasks.ceph.mds.b.smithi122.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_prepare(ceph::cref_t&)' thread 7f3852529640 time 2023-11-04T01:43:48.910060+0000 2023-11-04T01:43:48.910 INFO:tasks.ceph.mds.b.smithi122.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 61: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 1) 2023-11-04T01:43:48.911 INFO:tasks.ceph.mds.b.smithi122.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:48.911 INFO:tasks.ceph.mds.b.smithi122.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f385816efaf] 2023-11-04T01:43:48.912 INFO:tasks.ceph.mds.b.smithi122.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f385816f16d] 2023-11-04T01:43:48.912 INFO:tasks.ceph.mds.b.smithi122.stderr: 3: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x354) [0x562c9f945254] 2023-11-04T01:43:48.912 INFO:tasks.ceph.mds.b.smithi122.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x562c9f6d80a9] 2023-11-04T01:43:48.912 INFO:tasks.ceph.mds.b.smithi122.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x562c9f6dab2b] 2023-11-04T01:43:48.912 INFO:tasks.ceph.mds.b.smithi122.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562c9f6db01c] 2023-11-04T01:43:48.913 INFO:tasks.ceph.mds.b.smithi122.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x562c9f6c4325] 2023-11-04T01:43:48.913 INFO:tasks.ceph.mds.b.smithi122.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f385835ff9a] 2023-11-04T01:43:48.913 INFO:tasks.ceph.mds.b.smithi122.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f38583f1741] 2023-11-04T01:43:48.913 INFO:tasks.ceph.mds.b.smithi122.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f385789f802] 2023-11-04T01:43:48.913 INFO:tasks.ceph.mds.b.smithi122.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f385783f450] 2023-11-04T01:43:48.913 INFO:tasks.ceph.mds.b.smithi122.stderr:2023-11-04T01:43:48.909+0000 7f3852529640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_prepare(ceph::cref_t&)' thread 7f3852529640 time 2023-11-04T01:43:48.910060+0000 2023-11-04T01:43:48.914 INFO:tasks.ceph.mds.b.smithi122.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 61: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 1) 2023-11-04T01:43:48.914 INFO:tasks.ceph.mds.b.smithi122.stderr: 2023-11-04T01:43:48.914 INFO:tasks.ceph.mds.b.smithi122.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:48.914 INFO:tasks.ceph.mds.b.smithi122.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f385816efaf] 2023-11-04T01:43:48.914 INFO:tasks.ceph.mds.b.smithi122.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f385816f16d] 2023-11-04T01:43:48.915 INFO:tasks.ceph.mds.b.smithi122.stderr: 3: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x354) [0x562c9f945254] 2023-11-04T01:43:48.915 INFO:tasks.ceph.mds.b.smithi122.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x562c9f6d80a9] 2023-11-04T01:43:48.915 INFO:tasks.ceph.mds.b.smithi122.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x562c9f6dab2b] 2023-11-04T01:43:48.915 INFO:tasks.ceph.mds.b.smithi122.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562c9f6db01c] 2023-11-04T01:43:48.915 INFO:tasks.ceph.mds.b.smithi122.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x562c9f6c4325] 2023-11-04T01:43:48.915 INFO:tasks.ceph.mds.b.smithi122.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f385835ff9a] 2023-11-04T01:43:48.916 INFO:tasks.ceph.mds.b.smithi122.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f38583f1741] 2023-11-04T01:43:48.916 INFO:tasks.ceph.mds.b.smithi122.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f385789f802] 2023-11-04T01:43:48.916 INFO:tasks.ceph.mds.b.smithi122.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f385783f450] 2023-11-04T01:43:48.916 INFO:tasks.ceph.mds.b.smithi122.stderr: 2023-11-04T01:43:48.916 INFO:tasks.ceph.mds.b.smithi122.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:43:48.917 INFO:tasks.ceph.mds.b.smithi122.stderr: in thread 7f3852529640 thread_name:ms_dispatch 2023-11-04T01:43:48.917 INFO:tasks.ceph.mds.b.smithi122.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:48.917 INFO:tasks.ceph.mds.b.smithi122.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f3857854db0] 2023-11-04T01:43:48.917 INFO:tasks.ceph.mds.b.smithi122.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f38578a154c] 2023-11-04T01:43:48.917 INFO:tasks.ceph.mds.b.smithi122.stderr: 3: raise() 2023-11-04T01:43:48.917 INFO:tasks.ceph.mds.b.smithi122.stderr: 4: abort() 2023-11-04T01:43:48.918 INFO:tasks.ceph.mds.b.smithi122.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f385816f009] 2023-11-04T01:43:48.918 INFO:tasks.ceph.mds.b.smithi122.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f385816f16d] 2023-11-04T01:43:48.918 INFO:tasks.ceph.mds.b.smithi122.stderr: 7: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x354) [0x562c9f945254] 2023-11-04T01:43:48.918 INFO:tasks.ceph.mds.b.smithi122.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x562c9f6d80a9] 2023-11-04T01:43:48.918 INFO:tasks.ceph.mds.b.smithi122.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x562c9f6dab2b] 2023-11-04T01:43:48.919 INFO:tasks.ceph.mds.b.smithi122.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562c9f6db01c] 2023-11-04T01:43:48.919 INFO:tasks.ceph.mds.b.smithi122.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x562c9f6c4325] 2023-11-04T01:43:48.919 INFO:tasks.ceph.mds.b.smithi122.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f385835ff9a] 2023-11-04T01:43:48.919 INFO:tasks.ceph.mds.b.smithi122.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f38583f1741] 2023-11-04T01:43:48.919 INFO:tasks.ceph.mds.b.smithi122.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f385789f802] 2023-11-04T01:43:48.919 INFO:tasks.ceph.mds.b.smithi122.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f385783f450] 2023-11-04T01:43:48.920 INFO:tasks.ceph.mds.b.smithi122.stderr:2023-11-04T01:43:48.910+0000 7f3852529640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:43:48.920 INFO:tasks.ceph.mds.b.smithi122.stderr: in thread 7f3852529640 thread_name:ms_dispatch 2023-11-04T01:43:48.920 INFO:tasks.ceph.mds.b.smithi122.stderr: 2023-11-04T01:43:48.920 INFO:tasks.ceph.mds.b.smithi122.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:48.920 INFO:tasks.ceph.mds.b.smithi122.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f3857854db0] 2023-11-04T01:43:48.921 INFO:tasks.ceph.mds.b.smithi122.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f38578a154c] 2023-11-04T01:43:48.921 INFO:tasks.ceph.mds.b.smithi122.stderr: 3: raise() 2023-11-04T01:43:48.921 INFO:tasks.ceph.mds.b.smithi122.stderr: 4: abort() 2023-11-04T01:43:48.921 INFO:tasks.ceph.mds.b.smithi122.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f385816f009] 2023-11-04T01:43:48.921 INFO:tasks.ceph.mds.b.smithi122.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f385816f16d] 2023-11-04T01:43:48.922 INFO:tasks.ceph.mds.b.smithi122.stderr: 7: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x354) [0x562c9f945254] 2023-11-04T01:43:48.922 INFO:tasks.ceph.mds.b.smithi122.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x562c9f6d80a9] 2023-11-04T01:43:48.922 INFO:tasks.ceph.mds.b.smithi122.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x562c9f6dab2b] 2023-11-04T01:43:48.922 INFO:tasks.ceph.mds.b.smithi122.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562c9f6db01c] 2023-11-04T01:43:48.922 INFO:tasks.ceph.mds.b.smithi122.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x562c9f6c4325] 2023-11-04T01:43:48.923 INFO:tasks.ceph.mds.b.smithi122.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f385835ff9a] 2023-11-04T01:43:48.923 INFO:tasks.ceph.mds.b.smithi122.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f38583f1741] 2023-11-04T01:43:48.923 INFO:tasks.ceph.mds.b.smithi122.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f385789f802] 2023-11-04T01:43:48.923 INFO:tasks.ceph.mds.b.smithi122.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f385783f450] 2023-11-04T01:43:48.923 INFO:tasks.ceph.mds.b.smithi122.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:43:48.923 INFO:tasks.ceph.mds.b.smithi122.stderr: 2023-11-04T01:43:48.924 INFO:tasks.ceph.mds.b.smithi122.stderr: -2534> 2023-11-04T01:43:31.588+0000 7f384fd24640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:43:48.924 INFO:tasks.ceph.mds.b.smithi122.stderr: -1> 2023-11-04T01:43:48.909+0000 7f3852529640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_prepare(ceph::cref_t&)' thread 7f3852529640 time 2023-11-04T01:43:48.910060+0000 2023-11-04T01:43:48.925 INFO:tasks.ceph.mds.b.smithi122.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 61: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 1) 2023-11-04T01:43:48.925 INFO:tasks.ceph.mds.b.smithi122.stderr: 2023-11-04T01:43:48.925 INFO:tasks.ceph.mds.b.smithi122.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:48.925 INFO:tasks.ceph.mds.b.smithi122.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f385816efaf] 2023-11-04T01:43:48.925 INFO:tasks.ceph.mds.b.smithi122.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f385816f16d] 2023-11-04T01:43:48.925 INFO:tasks.ceph.mds.b.smithi122.stderr: 3: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x354) [0x562c9f945254] 2023-11-04T01:43:48.926 INFO:tasks.ceph.mds.b.smithi122.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x562c9f6d80a9] 2023-11-04T01:43:48.926 INFO:tasks.ceph.mds.b.smithi122.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x562c9f6dab2b] 2023-11-04T01:43:48.926 INFO:tasks.ceph.mds.b.smithi122.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562c9f6db01c] 2023-11-04T01:43:48.926 INFO:tasks.ceph.mds.b.smithi122.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x562c9f6c4325] 2023-11-04T01:43:48.926 INFO:tasks.ceph.mds.b.smithi122.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f385835ff9a] 2023-11-04T01:43:48.927 INFO:tasks.ceph.mds.b.smithi122.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f38583f1741] 2023-11-04T01:43:48.927 INFO:tasks.ceph.mds.b.smithi122.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f385789f802] 2023-11-04T01:43:48.927 INFO:tasks.ceph.mds.b.smithi122.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f385783f450] 2023-11-04T01:43:48.927 INFO:tasks.ceph.mds.b.smithi122.stderr: 2023-11-04T01:43:48.927 INFO:tasks.ceph.mds.b.smithi122.stderr: 0> 2023-11-04T01:43:48.910+0000 7f3852529640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:43:48.928 INFO:tasks.ceph.mds.b.smithi122.stderr: in thread 7f3852529640 thread_name:ms_dispatch 2023-11-04T01:43:48.928 INFO:tasks.ceph.mds.b.smithi122.stderr: 2023-11-04T01:43:48.928 INFO:tasks.ceph.mds.b.smithi122.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:48.928 INFO:tasks.ceph.mds.b.smithi122.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f3857854db0] 2023-11-04T01:43:48.928 INFO:tasks.ceph.mds.b.smithi122.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f38578a154c] 2023-11-04T01:43:48.928 INFO:tasks.ceph.mds.b.smithi122.stderr: 3: raise() 2023-11-04T01:43:48.929 INFO:tasks.ceph.mds.b.smithi122.stderr: 4: abort() 2023-11-04T01:43:48.929 INFO:tasks.ceph.mds.b.smithi122.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f385816f009] 2023-11-04T01:43:48.929 INFO:tasks.ceph.mds.b.smithi122.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f385816f16d] 2023-11-04T01:43:48.929 INFO:tasks.ceph.mds.b.smithi122.stderr: 7: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x354) [0x562c9f945254] 2023-11-04T01:43:48.929 INFO:tasks.ceph.mds.b.smithi122.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x562c9f6d80a9] 2023-11-04T01:43:48.930 INFO:tasks.ceph.mds.b.smithi122.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x562c9f6dab2b] 2023-11-04T01:43:48.930 INFO:tasks.ceph.mds.b.smithi122.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562c9f6db01c] 2023-11-04T01:43:48.930 INFO:tasks.ceph.mds.b.smithi122.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x562c9f6c4325] 2023-11-04T01:43:48.930 INFO:tasks.ceph.mds.b.smithi122.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f385835ff9a] 2023-11-04T01:43:48.930 INFO:tasks.ceph.mds.b.smithi122.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f38583f1741] 2023-11-04T01:43:48.931 INFO:tasks.ceph.mds.b.smithi122.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f385789f802] 2023-11-04T01:43:48.931 INFO:tasks.ceph.mds.b.smithi122.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f385783f450] 2023-11-04T01:43:48.931 INFO:tasks.ceph.mds.b.smithi122.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:43:48.931 INFO:tasks.ceph.mds.b.smithi122.stderr: 2023-11-04T01:43:48.931 INFO:tasks.ceph.mds.b.smithi122.stderr: -2534> 2023-11-04T01:43:31.588+0000 7f384fd24640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:43:48.931 INFO:tasks.ceph.mds.b.smithi122.stderr: -1> 2023-11-04T01:43:48.909+0000 7f3852529640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_prepare(ceph::cref_t&)' thread 7f3852529640 time 2023-11-04T01:43:48.910060+0000 2023-11-04T01:43:48.932 INFO:tasks.ceph.mds.b.smithi122.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 61: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 1) 2023-11-04T01:43:48.932 INFO:tasks.ceph.mds.b.smithi122.stderr: 2023-11-04T01:43:48.932 INFO:tasks.ceph.mds.b.smithi122.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:48.932 INFO:tasks.ceph.mds.b.smithi122.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f385816efaf] 2023-11-04T01:43:48.932 INFO:tasks.ceph.mds.b.smithi122.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f385816f16d] 2023-11-04T01:43:48.932 INFO:tasks.ceph.mds.b.smithi122.stderr: 3: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x354) [0x562c9f945254] 2023-11-04T01:43:48.933 INFO:tasks.ceph.mds.b.smithi122.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x562c9f6d80a9] 2023-11-04T01:43:48.933 INFO:tasks.ceph.mds.b.smithi122.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x562c9f6dab2b] 2023-11-04T01:43:48.933 INFO:tasks.ceph.mds.b.smithi122.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562c9f6db01c] 2023-11-04T01:43:48.933 INFO:tasks.ceph.mds.b.smithi122.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x562c9f6c4325] 2023-11-04T01:43:48.933 INFO:tasks.ceph.mds.b.smithi122.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f385835ff9a] 2023-11-04T01:43:48.934 INFO:tasks.ceph.mds.b.smithi122.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f38583f1741] 2023-11-04T01:43:48.934 INFO:tasks.ceph.mds.b.smithi122.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f385789f802] 2023-11-04T01:43:48.934 INFO:tasks.ceph.mds.b.smithi122.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f385783f450] 2023-11-04T01:43:48.934 INFO:tasks.ceph.mds.b.smithi122.stderr: 2023-11-04T01:43:48.934 INFO:tasks.ceph.mds.b.smithi122.stderr: 0> 2023-11-04T01:43:48.910+0000 7f3852529640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:43:48.934 INFO:tasks.ceph.mds.b.smithi122.stderr: in thread 7f3852529640 thread_name:ms_dispatch 2023-11-04T01:43:48.935 INFO:tasks.ceph.mds.b.smithi122.stderr: 2023-11-04T01:43:48.935 INFO:tasks.ceph.mds.b.smithi122.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:43:48.935 INFO:tasks.ceph.mds.b.smithi122.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f3857854db0] 2023-11-04T01:43:48.935 INFO:tasks.ceph.mds.b.smithi122.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f38578a154c] 2023-11-04T01:43:48.935 INFO:tasks.ceph.mds.b.smithi122.stderr: 3: raise() 2023-11-04T01:43:48.936 INFO:tasks.ceph.mds.b.smithi122.stderr: 4: abort() 2023-11-04T01:43:48.936 INFO:tasks.ceph.mds.b.smithi122.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f385816f009] 2023-11-04T01:43:48.936 INFO:tasks.ceph.mds.b.smithi122.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f385816f16d] 2023-11-04T01:43:48.936 INFO:tasks.ceph.mds.b.smithi122.stderr: 7: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x354) [0x562c9f945254] 2023-11-04T01:43:48.936 INFO:tasks.ceph.mds.b.smithi122.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x562c9f6d80a9] 2023-11-04T01:43:48.936 INFO:tasks.ceph.mds.b.smithi122.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x562c9f6dab2b] 2023-11-04T01:43:48.937 INFO:tasks.ceph.mds.b.smithi122.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562c9f6db01c] 2023-11-04T01:43:48.937 INFO:tasks.ceph.mds.b.smithi122.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x562c9f6c4325] 2023-11-04T01:43:48.937 INFO:tasks.ceph.mds.b.smithi122.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f385835ff9a] 2023-11-04T01:43:48.937 INFO:tasks.ceph.mds.b.smithi122.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f38583f1741] 2023-11-04T01:43:48.938 INFO:tasks.ceph.mds.b.smithi122.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f385789f802] 2023-11-04T01:43:48.938 INFO:tasks.ceph.mds.b.smithi122.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f385783f450] 2023-11-04T01:43:48.938 INFO:tasks.ceph.mds.b.smithi122.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:43:48.938 INFO:tasks.ceph.mds.b.smithi122.stderr: 2023-11-04T01:43:49.040 INFO:teuthology.orchestra.run.smithi077.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:43:49.040 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:43:49.041 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:49.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.138+0000 7fdaacf4c640 1 Processor -- start 2023-11-04T01:43:49.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.138+0000 7fdaacf4c640 1 -- start start 2023-11-04T01:43:49.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.139+0000 7fdaacf4c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fdaa8159c70 0x7fdaa80ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.139+0000 7fdaacf4c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdaa806db20 0x7fdaa80b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.139+0000 7fdaacf4c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaa80b4110 con 0x7fdaa80b0910 2023-11-04T01:43:49.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.139+0000 7fdaacf4c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaa80b49b0 con 0x7fdaa806db20 2023-11-04T01:43:49.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.139+0000 7fdaacf4c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaa80b0da0 con 0x7fdaa8159c70 2023-11-04T01:43:49.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.139+0000 7fdaa5d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdaa806db20 0x7fdaa80b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.139+0000 7fdaa6d9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fdaa80b0910 0x7fdaa815d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:60930/0 (socket says 172.21.15.77:60930) 2023-11-04T01:43:49.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.139+0000 7fdaa6d9d640 1 -- 172.21.15.77:0/3338237772 learned_addr learned my addr 172.21.15.77:0/3338237772 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:49.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.139+0000 7fdaa659c640 1 --2- 172.21.15.77:0/3338237772 >> v2:172.21.15.122:3300/0 conn(0x7fdaa8159c70 0x7fdaa80ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.140+0000 7fdaa5d9b640 1 -- 172.21.15.77:0/3338237772 >> v2:172.21.15.122:3300/0 conn(0x7fdaa8159c70 msgr2=0x7fdaa80ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:49.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.140+0000 7fdaa5d9b640 1 --2- 172.21.15.77:0/3338237772 >> v2:172.21.15.122:3300/0 conn(0x7fdaa8159c70 0x7fdaa80ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.140+0000 7fdaa5d9b640 1 -- 172.21.15.77:0/3338237772 >> v1:172.21.15.77:6789/0 conn(0x7fdaa80b0910 legacy=0x7fdaa815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.140+0000 7fdaa5d9b640 1 -- 172.21.15.77:0/3338237772 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa80b43f0 con 0x7fdaa806db20 2023-11-04T01:43:49.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.140+0000 7fdaa559a640 1 -- 172.21.15.77:0/3338237772 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4117142429 0 0) 0x7fdaa80b4110 con 0x7fdaa80b0910 2023-11-04T01:43:49.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.140+0000 7fdaa659c640 1 --2- 172.21.15.77:0/3338237772 >> v2:172.21.15.122:3300/0 conn(0x7fdaa8159c70 0x7fdaa80ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:49.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.140+0000 7fdaa5d9b640 1 --2- 172.21.15.77:0/3338237772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdaa806db20 0x7fdaa80b03d0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fdaa80cc440 tx=0x7fda9c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec131d9405c1d2a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:49.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.141+0000 7fdaa559a640 1 -- 172.21.15.77:0/3338237772 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9c031830 con 0x7fdaa806db20 2023-11-04T01:43:49.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.141+0000 7fdaa559a640 1 -- 172.21.15.77:0/3338237772 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9c031990 con 0x7fdaa806db20 2023-11-04T01:43:49.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.141+0000 7fdaa559a640 1 -- 172.21.15.77:0/3338237772 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9c031d20 con 0x7fdaa806db20 2023-11-04T01:43:49.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.141+0000 7fdaacf4c640 1 -- 172.21.15.77:0/3338237772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdaa806db20 msgr2=0x7fdaa80b03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.141+0000 7fdaacf4c640 1 --2- 172.21.15.77:0/3338237772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdaa806db20 0x7fdaa80b03d0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fdaa80cc440 tx=0x7fda9c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.141+0000 7fdaacf4c640 1 -- 172.21.15.77:0/3338237772 shutdown_connections 2023-11-04T01:43:49.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.141+0000 7fdaacf4c640 1 --2- 172.21.15.77:0/3338237772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdaa806db20 0x7fdaa80b03d0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.141+0000 7fdaacf4c640 1 --2- 172.21.15.77:0/3338237772 >> v2:172.21.15.122:3300/0 conn(0x7fdaa8159c70 0x7fdaa80ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.141+0000 7fdaacf4c640 1 -- 172.21.15.77:0/3338237772 >> 172.21.15.77:0/3338237772 conn(0x7fdaa80ce950 msgr2=0x7fdaa80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:49.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.141+0000 7fdaacf4c640 1 -- 172.21.15.77:0/3338237772 shutdown_connections 2023-11-04T01:43:49.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.141+0000 7fdaacf4c640 1 -- 172.21.15.77:0/3338237772 wait complete. 2023-11-04T01:43:49.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.143+0000 7fdaacf4c640 1 Processor -- start 2023-11-04T01:43:49.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.143+0000 7fdaacf4c640 1 -- start start 2023-11-04T01:43:49.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.143+0000 7fdaacf4c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdaa806db20 0x7fdaa8143430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.143+0000 7fdaacf4c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdaa80b0910 0x7fdaa80c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.143+0000 7fdaacf4c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdaa8159c70 0x7fdaa8151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.143+0000 7fdaacf4c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa80c87d0 con 0x7fdaa80b0910 2023-11-04T01:43:49.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.143+0000 7fdaacf4c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa8143970 con 0x7fdaa806db20 2023-11-04T01:43:49.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.143+0000 7fdaacf4c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa814f250 con 0x7fdaa8159c70 2023-11-04T01:43:49.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.144+0000 7fdaa5d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdaa80b0910 0x7fdaa80c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.144+0000 7fdaa5d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdaa80b0910 0x7fdaa80c4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48682/0 (socket says 172.21.15.77:48682) 2023-11-04T01:43:49.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.144+0000 7fdaa5d9b640 1 -- 172.21.15.77:0/447591448 learned_addr learned my addr 172.21.15.77:0/447591448 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:49.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.144+0000 7fdaa659c640 1 --2- 172.21.15.77:0/447591448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdaa806db20 0x7fdaa8143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.144+0000 7fdaa6d9d640 1 --2- 172.21.15.77:0/447591448 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdaa8159c70 0x7fdaa8151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.144+0000 7fdaa5d9b640 1 -- 172.21.15.77:0/447591448 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdaa8159c70 msgr2=0x7fdaa8151b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.144+0000 7fdaa5d9b640 1 --2- 172.21.15.77:0/447591448 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdaa8159c70 0x7fdaa8151b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.144+0000 7fdaa5d9b640 1 -- 172.21.15.77:0/447591448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdaa806db20 msgr2=0x7fdaa8143430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.144+0000 7fdaa5d9b640 1 --2- 172.21.15.77:0/447591448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdaa806db20 0x7fdaa8143430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.144+0000 7fdaa5d9b640 1 -- 172.21.15.77:0/447591448 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c009400 con 0x7fdaa80b0910 2023-11-04T01:43:49.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.144+0000 7fdaa659c640 1 --2- 172.21.15.77:0/447591448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdaa806db20 0x7fdaa8143430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:49.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.144+0000 7fdaa5d9b640 1 --2- 172.21.15.77:0/447591448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdaa80b0910 0x7fdaa80c4bf0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fda9c009890 tx=0x7fda9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:49.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.144+0000 7fda96ffd640 1 -- 172.21.15.77:0/447591448 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9c03aa60 con 0x7fdaa80b0910 2023-11-04T01:43:49.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.144+0000 7fda96ffd640 1 -- 172.21.15.77:0/447591448 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9c03abe0 con 0x7fdaa80b0910 2023-11-04T01:43:49.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.144+0000 7fdaacf4c640 1 -- 172.21.15.77:0/447591448 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa80c7bc0 con 0x7fdaa80b0910 2023-11-04T01:43:49.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.144+0000 7fda96ffd640 1 -- 172.21.15.77:0/447591448 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9c0443f0 con 0x7fdaa80b0910 2023-11-04T01:43:49.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.144+0000 7fdaacf4c640 1 -- 172.21.15.77:0/447591448 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa80c8180 con 0x7fdaa80b0910 2023-11-04T01:43:49.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.145+0000 7fdaacf4c640 1 -- 172.21.15.77:0/447591448 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa8074290 con 0x7fdaa80b0910 2023-11-04T01:43:49.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.145+0000 7fda96ffd640 1 -- 172.21.15.77:0/447591448 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fda9c044550 con 0x7fdaa80b0910 2023-11-04T01:43:49.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.146+0000 7fda96ffd640 1 --2- 172.21.15.77:0/447591448 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fda8806ae70 0x7fda8806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.146+0000 7fda96ffd640 1 -- 172.21.15.77:0/447591448 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7178+0+0 (secure 0 0 0) 0x7fda9c0abe10 con 0x7fdaa80b0910 2023-11-04T01:43:49.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.146+0000 7fdaa659c640 1 --2- 172.21.15.77:0/447591448 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fda8806ae70 0x7fda8806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.147+0000 7fdaa659c640 1 --2- 172.21.15.77:0/447591448 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fda8806ae70 0x7fda8806d330 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fda98009540 tx=0x7fda9800b040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:49.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.150+0000 7fda96ffd640 1 -- 172.21.15.77:0/447591448 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fda9c0769a0 con 0x7fdaa80b0910 2023-11-04T01:43:49.282 INFO:tasks.ceph.mds.b.smithi122.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:43:49.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.350+0000 7fdaacf4c640 1 -- 172.21.15.77:0/447591448 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdaa815d0e0 con 0x7fdaa80b0910 2023-11-04T01:43:49.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.350+0000 7fda96ffd640 1 -- 172.21.15.77:0/447591448 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4939 (secure 0 0 0) 0x7fda9c079fc0 con 0x7fdaa80b0910 2023-11-04T01:43:49.352 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:43:49.353 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7302,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/4241784871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4241784871},{"type":"v1","addr":"172.21.15.77:6834","nonce":4241784871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:43:48.148864+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":35690,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_35690":{"gid":35690,"name":"b","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6836/3699147778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":3699147778},{"type":"v1","addr":"172.21.15.122:6836","nonce":3699147778}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:49.353 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 49 2023-11-04T01:43:49.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.352+0000 7fdaacf4c640 1 -- 172.21.15.77:0/447591448 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fda8806ae70 msgr2=0x7fda8806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.352+0000 7fdaacf4c640 1 --2- 172.21.15.77:0/447591448 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fda8806ae70 0x7fda8806d330 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fda98009540 tx=0x7fda9800b040 comp rx=0 tx=0).stop 2023-11-04T01:43:49.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.352+0000 7fdaacf4c640 1 -- 172.21.15.77:0/447591448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdaa80b0910 msgr2=0x7fdaa80c4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.352+0000 7fdaacf4c640 1 --2- 172.21.15.77:0/447591448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdaa80b0910 0x7fdaa80c4bf0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fda9c009890 tx=0x7fda9c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.352+0000 7fdaacf4c640 1 -- 172.21.15.77:0/447591448 shutdown_connections 2023-11-04T01:43:49.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.352+0000 7fdaacf4c640 1 --2- 172.21.15.77:0/447591448 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fda8806ae70 0x7fda8806d330 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.352+0000 7fdaacf4c640 1 --2- 172.21.15.77:0/447591448 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdaa8159c70 0x7fdaa8151b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.352+0000 7fdaacf4c640 1 --2- 172.21.15.77:0/447591448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdaa80b0910 0x7fdaa80c4bf0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.352+0000 7fdaacf4c640 1 --2- 172.21.15.77:0/447591448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdaa806db20 0x7fdaa8143430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.352+0000 7fdaacf4c640 1 -- 172.21.15.77:0/447591448 >> 172.21.15.77:0/447591448 conn(0x7fdaa80ce950 msgr2=0x7fdaa80cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:49.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.352+0000 7fdaacf4c640 1 -- 172.21.15.77:0/447591448 shutdown_connections 2023-11-04T01:43:49.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:49.352+0000 7fdaacf4c640 1 -- 172.21.15.77:0/447591448 wait complete. 2023-11-04T01:43:49.365 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:43:53.597 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-11-04T01:43:54.366 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:54.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.473+0000 7f42f552c640 1 Processor -- start 2023-11-04T01:43:54.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.473+0000 7f42f552c640 1 -- start start 2023-11-04T01:43:54.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.474+0000 7f42f552c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f42f015ad80 0x7f42f006c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.474+0000 7f42f552c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42f00b42c0 0x7f42f00c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.474+0000 7f42f552c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f00ca070 con 0x7f42f00c9c40 2023-11-04T01:43:54.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.474+0000 7f42f552c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f006cd00 con 0x7f42f015ad80 2023-11-04T01:43:54.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.474+0000 7f42f552c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f006cfa0 con 0x7f42f00b42c0 2023-11-04T01:43:54.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.474+0000 7f42eeffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f42f015ad80 0x7f42f006c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:54.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.474+0000 7f42eeffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f42f015ad80 0x7f42f006c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48684/0 (socket says 172.21.15.77:48684) 2023-11-04T01:43:54.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.474+0000 7f42eeffd640 1 -- 172.21.15.77:0/1180843027 learned_addr learned my addr 172.21.15.77:0/1180843027 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:54.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.474+0000 7f42ee7fc640 1 --2- 172.21.15.77:0/1180843027 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42f00b42c0 0x7f42f00c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:54.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.475+0000 7f42eeffd640 1 -- 172.21.15.77:0/1180843027 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42f00b42c0 msgr2=0x7f42f00c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:54.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.475+0000 7f42eeffd640 1 --2- 172.21.15.77:0/1180843027 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42f00b42c0 0x7f42f00c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.475+0000 7f42eeffd640 1 -- 172.21.15.77:0/1180843027 >> v1:172.21.15.122:6789/0 conn(0x7f42f00c9c40 legacy=0x7f42f0070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:54.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.475+0000 7f42eeffd640 1 -- 172.21.15.77:0/1180843027 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f006d280 con 0x7f42f015ad80 2023-11-04T01:43:54.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.475+0000 7f42eeffd640 1 --2- 172.21.15.77:0/1180843027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42f015ad80 0x7f42f006c7c0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f42e0009e50 tx=0x7f42e002bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c13729f4946d94db server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:54.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.475+0000 7f42edffb640 1 -- 172.21.15.77:0/1180843027 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e002cb90 con 0x7f42f015ad80 2023-11-04T01:43:54.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.476+0000 7f42edffb640 1 -- 172.21.15.77:0/1180843027 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e002ccf0 con 0x7f42f015ad80 2023-11-04T01:43:54.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.476+0000 7f42edffb640 1 -- 172.21.15.77:0/1180843027 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e0034610 con 0x7f42f015ad80 2023-11-04T01:43:54.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.476+0000 7f42f552c640 1 -- 172.21.15.77:0/1180843027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42f015ad80 msgr2=0x7f42f006c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:54.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.476+0000 7f42f552c640 1 --2- 172.21.15.77:0/1180843027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42f015ad80 0x7f42f006c7c0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f42e0009e50 tx=0x7f42e002bff0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.476+0000 7f42f552c640 1 -- 172.21.15.77:0/1180843027 shutdown_connections 2023-11-04T01:43:54.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.476+0000 7f42f552c640 1 --2- 172.21.15.77:0/1180843027 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42f00b42c0 0x7f42f00c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.476+0000 7f42f552c640 1 --2- 172.21.15.77:0/1180843027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42f015ad80 0x7f42f006c7c0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.476+0000 7f42f552c640 1 -- 172.21.15.77:0/1180843027 >> 172.21.15.77:0/1180843027 conn(0x7f42f00ce950 msgr2=0x7f42f00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:54.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.476+0000 7f42f552c640 1 -- 172.21.15.77:0/1180843027 shutdown_connections 2023-11-04T01:43:54.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.476+0000 7f42f552c640 1 -- 172.21.15.77:0/1180843027 wait complete. 2023-11-04T01:43:54.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.477+0000 7f42f552c640 1 Processor -- start 2023-11-04T01:43:54.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.478+0000 7f42f552c640 1 -- start start 2023-11-04T01:43:54.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.478+0000 7f42f552c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42f00b42c0 0x7f42f01515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.478+0000 7f42f552c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42f00c9c40 0x7f42f00c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.478+0000 7f42f552c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42f015ad80 0x7f42f015b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.478+0000 7f42f552c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f00c6820 con 0x7f42f015ad80 2023-11-04T01:43:54.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.478+0000 7f42f552c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f00c8520 con 0x7f42f00b42c0 2023-11-04T01:43:54.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.478+0000 7f42f552c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f00c6440 con 0x7f42f00c9c40 2023-11-04T01:43:54.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.478+0000 7f42ef7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42f015ad80 0x7f42f015b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:54.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.478+0000 7f42ef7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42f015ad80 0x7f42f015b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48692/0 (socket says 172.21.15.77:48692) 2023-11-04T01:43:54.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.478+0000 7f42ef7fe640 1 -- 172.21.15.77:0/118592926 learned_addr learned my addr 172.21.15.77:0/118592926 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:54.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.479+0000 7f42eeffd640 1 --2- 172.21.15.77:0/118592926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42f00b42c0 0x7f42f01515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:54.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.479+0000 7f42ef7fe640 1 -- 172.21.15.77:0/118592926 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42f00c9c40 msgr2=0x7f42f00c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:54.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.479+0000 7f42ee7fc640 1 --2- 172.21.15.77:0/118592926 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42f00c9c40 0x7f42f00c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:54.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.479+0000 7f42ef7fe640 1 --2- 172.21.15.77:0/118592926 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42f00c9c40 0x7f42f00c6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.479+0000 7f42ef7fe640 1 -- 172.21.15.77:0/118592926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42f00b42c0 msgr2=0x7f42f01515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:54.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.479+0000 7f42ef7fe640 1 --2- 172.21.15.77:0/118592926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42f00b42c0 0x7f42f01515f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.479+0000 7f42ef7fe640 1 -- 172.21.15.77:0/118592926 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e0009b30 con 0x7f42f015ad80 2023-11-04T01:43:54.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.479+0000 7f42eeffd640 1 --2- 172.21.15.77:0/118592926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42f00b42c0 0x7f42f01515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:54.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.479+0000 7f42ef7fe640 1 --2- 172.21.15.77:0/118592926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42f015ad80 0x7f42f015b630 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f42e800c3c0 tx=0x7f42e800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:54.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.479+0000 7f42d77fe640 1 -- 172.21.15.77:0/118592926 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e80052d0 con 0x7f42f015ad80 2023-11-04T01:43:54.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.479+0000 7f42d77fe640 1 -- 172.21.15.77:0/118592926 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e8005430 con 0x7f42f015ad80 2023-11-04T01:43:54.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.479+0000 7f42f552c640 1 -- 172.21.15.77:0/118592926 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f0151b30 con 0x7f42f015ad80 2023-11-04T01:43:54.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.479+0000 7f42d77fe640 1 -- 172.21.15.77:0/118592926 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e8003850 con 0x7f42f015ad80 2023-11-04T01:43:54.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.479+0000 7f42f552c640 1 -- 172.21.15.77:0/118592926 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f00c8800 con 0x7f42f015ad80 2023-11-04T01:43:54.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.480+0000 7f42f552c640 1 -- 172.21.15.77:0/118592926 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f00c6960 con 0x7f42f015ad80 2023-11-04T01:43:54.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.480+0000 7f42d77fe640 1 -- 172.21.15.77:0/118592926 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f42e80039b0 con 0x7f42f015ad80 2023-11-04T01:43:54.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.481+0000 7f42d77fe640 1 --2- 172.21.15.77:0/118592926 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f42dc06ae70 0x7f42dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.481+0000 7f42d77fe640 1 -- 172.21.15.77:0/118592926 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7178+0+0 (secure 0 0 0) 0x7f42e8088f90 con 0x7f42f015ad80 2023-11-04T01:43:54.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.481+0000 7f42eeffd640 1 --2- 172.21.15.77:0/118592926 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f42dc06ae70 0x7f42dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:54.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.482+0000 7f42eeffd640 1 --2- 172.21.15.77:0/118592926 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f42dc06ae70 0x7f42dc06d330 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f42e0035000 tx=0x7f42e0030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:54.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.485+0000 7f42d77fe640 1 -- 172.21.15.77:0/118592926 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f42e80bbca0 con 0x7f42f015ad80 2023-11-04T01:43:54.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.687+0000 7f42f552c640 1 -- 172.21.15.77:0/118592926 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42f0074290 con 0x7f42f015ad80 2023-11-04T01:43:54.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.687+0000 7f42d77fe640 1 -- 172.21.15.77:0/118592926 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4939 (secure 0 0 0) 0x7f42e8017090 con 0x7f42f015ad80 2023-11-04T01:43:54.690 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:43:54.691 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7302,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/4241784871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4241784871},{"type":"v1","addr":"172.21.15.77:6834","nonce":4241784871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:43:48.148864+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":35690,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_35690":{"gid":35690,"name":"b","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6836/3699147778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":3699147778},{"type":"v1","addr":"172.21.15.122:6836","nonce":3699147778}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:43:54.691 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 49 2023-11-04T01:43:54.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.689+0000 7f42f552c640 1 -- 172.21.15.77:0/118592926 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f42dc06ae70 msgr2=0x7f42dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:54.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.689+0000 7f42f552c640 1 --2- 172.21.15.77:0/118592926 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f42dc06ae70 0x7f42dc06d330 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f42e0035000 tx=0x7f42e0030000 comp rx=0 tx=0).stop 2023-11-04T01:43:54.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.689+0000 7f42f552c640 1 -- 172.21.15.77:0/118592926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42f015ad80 msgr2=0x7f42f015b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:54.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.689+0000 7f42f552c640 1 --2- 172.21.15.77:0/118592926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42f015ad80 0x7f42f015b630 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f42e800c3c0 tx=0x7f42e800c880 comp rx=0 tx=0).stop 2023-11-04T01:43:54.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.689+0000 7f42f552c640 1 -- 172.21.15.77:0/118592926 shutdown_connections 2023-11-04T01:43:54.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.689+0000 7f42f552c640 1 --2- 172.21.15.77:0/118592926 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f42dc06ae70 0x7f42dc06d330 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.689+0000 7f42f552c640 1 --2- 172.21.15.77:0/118592926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42f015ad80 0x7f42f015b630 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.689+0000 7f42f552c640 1 --2- 172.21.15.77:0/118592926 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f42f00c9c40 0x7f42f00c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.689+0000 7f42f552c640 1 --2- 172.21.15.77:0/118592926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42f00b42c0 0x7f42f01515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.689+0000 7f42f552c640 1 -- 172.21.15.77:0/118592926 >> 172.21.15.77:0/118592926 conn(0x7f42f00ce950 msgr2=0x7f42f00b3310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:54.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.689+0000 7f42f552c640 1 -- 172.21.15.77:0/118592926 shutdown_connections 2023-11-04T01:43:54.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:54.689+0000 7f42f552c640 1 -- 172.21.15.77:0/118592926 wait complete. 2023-11-04T01:43:54.702 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:43:59.704 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:59.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.814+0000 7f6b3adc9640 1 Processor -- start 2023-11-04T01:43:59.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.814+0000 7f6b3adc9640 1 -- start start 2023-11-04T01:43:59.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.815+0000 7f6b3adc9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6b3415cfd0 0x7f6b340b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:59.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.815+0000 7f6b3adc9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6b340b0910 0x7f6b34070780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:59.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.815+0000 7f6b3adc9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b340714b0 con 0x7f6b34070cc0 2023-11-04T01:43:59.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.815+0000 7f6b3adc9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b340ab8e0 con 0x7f6b340b0910 2023-11-04T01:43:59.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.815+0000 7f6b3adc9640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b340b0da0 con 0x7f6b3415cfd0 2023-11-04T01:43:59.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.815+0000 7f6b33fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6b340b0910 0x7f6b34070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:59.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.815+0000 7f6b39366640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6b34070cc0 0x7f6b34160a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:39548/0 (socket says 172.21.15.77:39548) 2023-11-04T01:43:59.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.815+0000 7f6b39366640 1 -- 172.21.15.77:0/796271516 learned_addr learned my addr 172.21.15.77:0/796271516 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:43:59.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.815+0000 7f6b33fff640 1 -- 172.21.15.77:0/796271516 >> v2:172.21.15.122:3300/0 conn(0x7f6b3415cfd0 msgr2=0x7f6b340b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:59.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.815+0000 7f6b38b65640 1 --2- 172.21.15.77:0/796271516 >> v2:172.21.15.122:3300/0 conn(0x7f6b3415cfd0 0x7f6b340b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:59.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.815+0000 7f6b33fff640 1 --2- 172.21.15.77:0/796271516 >> v2:172.21.15.122:3300/0 conn(0x7f6b3415cfd0 0x7f6b340b03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.815+0000 7f6b33fff640 1 -- 172.21.15.77:0/796271516 >> v1:172.21.15.77:6789/0 conn(0x7f6b34070cc0 legacy=0x7f6b34160a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:59.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.815+0000 7f6b337fe640 1 -- 172.21.15.77:0/796271516 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1015895693 0 0) 0x7f6b340714b0 con 0x7f6b34070cc0 2023-11-04T01:43:59.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.815+0000 7f6b33fff640 1 -- 172.21.15.77:0/796271516 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b34071790 con 0x7f6b340b0910 2023-11-04T01:43:59.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.816+0000 7f6b33fff640 1 --2- 172.21.15.77:0/796271516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b340b0910 0x7f6b34070780 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f6b340cf8f0 tx=0x7f6b2002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=967da055c95ec0c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:59.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.816+0000 7f6b337fe640 1 -- 172.21.15.77:0/796271516 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b20031830 con 0x7f6b340b0910 2023-11-04T01:43:59.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.816+0000 7f6b337fe640 1 -- 172.21.15.77:0/796271516 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b20031990 con 0x7f6b340b0910 2023-11-04T01:43:59.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.816+0000 7f6b337fe640 1 -- 172.21.15.77:0/796271516 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b20031d20 con 0x7f6b340b0910 2023-11-04T01:43:59.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.817+0000 7f6b3adc9640 1 -- 172.21.15.77:0/796271516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b340b0910 msgr2=0x7f6b34070780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:59.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.817+0000 7f6b3adc9640 1 --2- 172.21.15.77:0/796271516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b340b0910 0x7f6b34070780 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f6b340cf8f0 tx=0x7f6b2002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.817+0000 7f6b3adc9640 1 -- 172.21.15.77:0/796271516 shutdown_connections 2023-11-04T01:43:59.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.817+0000 7f6b3adc9640 1 --2- 172.21.15.77:0/796271516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b340b0910 0x7f6b34070780 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.817+0000 7f6b3adc9640 1 --2- 172.21.15.77:0/796271516 >> v2:172.21.15.122:3300/0 conn(0x7f6b3415cfd0 0x7f6b340b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.817+0000 7f6b3adc9640 1 -- 172.21.15.77:0/796271516 >> 172.21.15.77:0/796271516 conn(0x7f6b340ce950 msgr2=0x7f6b340ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:59.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.817+0000 7f6b3adc9640 1 -- 172.21.15.77:0/796271516 shutdown_connections 2023-11-04T01:43:59.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.817+0000 7f6b3adc9640 1 -- 172.21.15.77:0/796271516 wait complete. 2023-11-04T01:43:59.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.818+0000 7f6b3adc9640 1 Processor -- start 2023-11-04T01:43:59.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.818+0000 7f6b3adc9640 1 -- start start 2023-11-04T01:43:59.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.819+0000 7f6b3adc9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6b34070cc0 0x7f6b3414ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:59.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.819+0000 7f6b3adc9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b340b0910 0x7f6b340c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:59.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.819+0000 7f6b3adc9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b3415cfd0 0x7f6b3414f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:59.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.819+0000 7f6b3adc9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b340c6e20 con 0x7f6b340b0910 2023-11-04T01:43:59.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.819+0000 7f6b3adc9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3414b380 con 0x7f6b3415cfd0 2023-11-04T01:43:59.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.819+0000 7f6b3adc9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b340c7070 con 0x7f6b34070cc0 2023-11-04T01:43:59.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.819+0000 7f6b33fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b340b0910 0x7f6b340c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:59.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.819+0000 7f6b33fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b340b0910 0x7f6b340c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49896/0 (socket says 172.21.15.77:49896) 2023-11-04T01:43:59.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.819+0000 7f6b33fff640 1 -- 172.21.15.77:0/1912757053 learned_addr learned my addr 172.21.15.77:0/1912757053 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:43:59.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.819+0000 7f6b38b65640 1 --2- 172.21.15.77:0/1912757053 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6b34070cc0 0x7f6b3414ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:59.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.819+0000 7f6b39366640 1 --2- 172.21.15.77:0/1912757053 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b3415cfd0 0x7f6b3414f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:59.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.819+0000 7f6b33fff640 1 -- 172.21.15.77:0/1912757053 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6b34070cc0 msgr2=0x7f6b3414ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:59.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.819+0000 7f6b33fff640 1 --2- 172.21.15.77:0/1912757053 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6b34070cc0 0x7f6b3414ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.819+0000 7f6b33fff640 1 -- 172.21.15.77:0/1912757053 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b3415cfd0 msgr2=0x7f6b3414f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:59.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.819+0000 7f6b33fff640 1 --2- 172.21.15.77:0/1912757053 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b3415cfd0 0x7f6b3414f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.819+0000 7f6b33fff640 1 -- 172.21.15.77:0/1912757053 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b20009400 con 0x7f6b340b0910 2023-11-04T01:43:59.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.819+0000 7f6b33fff640 1 --2- 172.21.15.77:0/1912757053 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b340b0910 0x7f6b340c8110 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f6b20009890 tx=0x7f6b200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:59.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.819+0000 7f6b317fa640 1 -- 172.21.15.77:0/1912757053 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2003ba70 con 0x7f6b340b0910 2023-11-04T01:43:59.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.820+0000 7f6b317fa640 1 -- 172.21.15.77:0/1912757053 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2003bbf0 con 0x7f6b340b0910 2023-11-04T01:43:59.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.820+0000 7f6b317fa640 1 -- 172.21.15.77:0/1912757053 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b20045400 con 0x7f6b340b0910 2023-11-04T01:43:59.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.820+0000 7f6b3adc9640 1 -- 172.21.15.77:0/1912757053 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b340c7350 con 0x7f6b340b0910 2023-11-04T01:43:59.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.820+0000 7f6b3adc9640 1 -- 172.21.15.77:0/1912757053 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b340c7910 con 0x7f6b340b0910 2023-11-04T01:43:59.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.821+0000 7f6b3adc9640 1 -- 172.21.15.77:0/1912757053 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b34074290 con 0x7f6b340b0910 2023-11-04T01:43:59.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.821+0000 7f6b317fa640 1 -- 172.21.15.77:0/1912757053 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6b2004e440 con 0x7f6b340b0910 2023-11-04T01:43:59.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.821+0000 7f6b317fa640 1 --2- 172.21.15.77:0/1912757053 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6b1806ae70 0x7f6b1806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:59.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.821+0000 7f6b317fa640 1 -- 172.21.15.77:0/1912757053 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7178+0+0 (secure 0 0 0) 0x7f6b200abf60 con 0x7f6b340b0910 2023-11-04T01:43:59.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.822+0000 7f6b38b65640 1 --2- 172.21.15.77:0/1912757053 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6b1806ae70 0x7f6b1806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:59.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.822+0000 7f6b38b65640 1 --2- 172.21.15.77:0/1912757053 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6b1806ae70 0x7f6b1806d330 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f6b28006fd0 tx=0x7f6b28008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:59.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:43:59.826+0000 7f6b317fa640 1 -- 172.21.15.77:0/1912757053 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6b20076ae0 con 0x7f6b340b0910 2023-11-04T01:44:00.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:00.031+0000 7f6b3adc9640 1 -- 172.21.15.77:0/1912757053 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b3406c2d0 con 0x7f6b340b0910 2023-11-04T01:44:00.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:00.032+0000 7f6b317fa640 1 -- 172.21.15.77:0/1912757053 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4939 (secure 0 0 0) 0x7f6b20035020 con 0x7f6b340b0910 2023-11-04T01:44:00.034 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:44:00.034 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7302,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/4241784871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4241784871},{"type":"v1","addr":"172.21.15.77:6834","nonce":4241784871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:43:48.148864+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":35690,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_35690":{"gid":35690,"name":"b","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6836/3699147778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":3699147778},{"type":"v1","addr":"172.21.15.122:6836","nonce":3699147778}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:00.035 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 49 2023-11-04T01:44:00.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:00.034+0000 7f6b3adc9640 1 -- 172.21.15.77:0/1912757053 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6b1806ae70 msgr2=0x7f6b1806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:00.034+0000 7f6b3adc9640 1 --2- 172.21.15.77:0/1912757053 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6b1806ae70 0x7f6b1806d330 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f6b28006fd0 tx=0x7f6b28008040 comp rx=0 tx=0).stop 2023-11-04T01:44:00.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:00.034+0000 7f6b3adc9640 1 -- 172.21.15.77:0/1912757053 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b340b0910 msgr2=0x7f6b340c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:00.034+0000 7f6b3adc9640 1 --2- 172.21.15.77:0/1912757053 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b340b0910 0x7f6b340c8110 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f6b20009890 tx=0x7f6b200046c0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:00.034+0000 7f6b3adc9640 1 -- 172.21.15.77:0/1912757053 shutdown_connections 2023-11-04T01:44:00.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:00.034+0000 7f6b3adc9640 1 --2- 172.21.15.77:0/1912757053 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6b1806ae70 0x7f6b1806d330 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:00.034+0000 7f6b3adc9640 1 --2- 172.21.15.77:0/1912757053 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b3415cfd0 0x7f6b3414f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:00.034+0000 7f6b3adc9640 1 --2- 172.21.15.77:0/1912757053 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b340b0910 0x7f6b340c8110 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:00.034+0000 7f6b3adc9640 1 --2- 172.21.15.77:0/1912757053 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6b34070cc0 0x7f6b3414ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:00.034+0000 7f6b3adc9640 1 -- 172.21.15.77:0/1912757053 >> 172.21.15.77:0/1912757053 conn(0x7f6b340ce950 msgr2=0x7f6b3406d490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:00.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:00.034+0000 7f6b3adc9640 1 -- 172.21.15.77:0/1912757053 shutdown_connections 2023-11-04T01:44:00.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:00.034+0000 7f6b3adc9640 1 -- 172.21.15.77:0/1912757053 wait complete. 2023-11-04T01:44:00.046 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:44:00.209 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~7s 2023-11-04T01:44:00.661 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:44:00.664 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:44:05.047 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:05.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.157+0000 7f4a7be56640 1 Processor -- start 2023-11-04T01:44:05.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.157+0000 7f4a7be56640 1 -- start start 2023-11-04T01:44:05.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.158+0000 7f4a7be56640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4a740cde60 0x7f4a7415d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:05.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.158+0000 7f4a7be56640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4a7415daa0 0x7f4a74157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:05.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.158+0000 7f4a7be56640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4a740ce240 0x7f4a74157540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:05.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.158+0000 7f4a7be56640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a7415e5c0 con 0x7f4a7415daa0 2023-11-04T01:44:05.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.158+0000 7f4a7be56640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a74157a80 con 0x7f4a740cde60 2023-11-04T01:44:05.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.158+0000 7f4a7be56640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7415e000 con 0x7f4a740ce240 2023-11-04T01:44:05.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.158+0000 7f4a793f1640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4a7415daa0 0x7f4a74157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:05.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.158+0000 7f4a793f1640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4a7415daa0 0x7f4a74157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49898/0 (socket says 172.21.15.77:49898) 2023-11-04T01:44:05.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.158+0000 7f4a793f1640 1 -- 172.21.15.77:0/2414548563 learned_addr learned my addr 172.21.15.77:0/2414548563 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:05.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.158+0000 7f4a7a3f3640 1 --2- 172.21.15.77:0/2414548563 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4a740ce240 0x7f4a74157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:05.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.158+0000 7f4a79bf2640 1 --2- 172.21.15.77:0/2414548563 >> v2:172.21.15.122:3300/0 conn(0x7f4a740cde60 0x7f4a7415d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:05.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.158+0000 7f4a793f1640 1 -- 172.21.15.77:0/2414548563 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4a740ce240 msgr2=0x7f4a74157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:05.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.158+0000 7f4a793f1640 1 --2- 172.21.15.77:0/2414548563 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4a740ce240 0x7f4a74157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:05.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.158+0000 7f4a793f1640 1 -- 172.21.15.77:0/2414548563 >> v2:172.21.15.122:3300/0 conn(0x7f4a740cde60 msgr2=0x7f4a7415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:05.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.158+0000 7f4a793f1640 1 --2- 172.21.15.77:0/2414548563 >> v2:172.21.15.122:3300/0 conn(0x7f4a740cde60 0x7f4a7415d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:05.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.158+0000 7f4a793f1640 1 -- 172.21.15.77:0/2414548563 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a7415e2e0 con 0x7f4a7415daa0 2023-11-04T01:44:05.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.158+0000 7f4a79bf2640 1 --2- 172.21.15.77:0/2414548563 >> v2:172.21.15.122:3300/0 conn(0x7f4a740cde60 0x7f4a7415d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:05.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.159+0000 7f4a793f1640 1 --2- 172.21.15.77:0/2414548563 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a7415daa0 0x7f4a74157000 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f4a740b5550 tx=0x7f4a6402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4d9e06da4e99f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:05.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.159+0000 7f4a78bf0640 1 -- 172.21.15.77:0/2414548563 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a64031870 con 0x7f4a7415daa0 2023-11-04T01:44:05.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.159+0000 7f4a78bf0640 1 -- 172.21.15.77:0/2414548563 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a640319d0 con 0x7f4a7415daa0 2023-11-04T01:44:05.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.159+0000 7f4a78bf0640 1 -- 172.21.15.77:0/2414548563 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a64031d60 con 0x7f4a7415daa0 2023-11-04T01:44:05.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.160+0000 7f4a7be56640 1 -- 172.21.15.77:0/2414548563 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a7415daa0 msgr2=0x7f4a74157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:05.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.160+0000 7f4a7be56640 1 --2- 172.21.15.77:0/2414548563 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a7415daa0 0x7f4a74157000 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f4a740b5550 tx=0x7f4a6402b910 comp rx=0 tx=0).stop 2023-11-04T01:44:05.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.160+0000 7f4a7be56640 1 -- 172.21.15.77:0/2414548563 shutdown_connections 2023-11-04T01:44:05.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.160+0000 7f4a7be56640 1 --2- 172.21.15.77:0/2414548563 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4a740ce240 0x7f4a74157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:05.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.160+0000 7f4a7be56640 1 --2- 172.21.15.77:0/2414548563 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a7415daa0 0x7f4a74157000 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:05.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.160+0000 7f4a7be56640 1 --2- 172.21.15.77:0/2414548563 >> v2:172.21.15.122:3300/0 conn(0x7f4a740cde60 0x7f4a7415d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:05.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.160+0000 7f4a7be56640 1 -- 172.21.15.77:0/2414548563 >> 172.21.15.77:0/2414548563 conn(0x7f4a74071f30 msgr2=0x7f4a740cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:05.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.160+0000 7f4a7be56640 1 -- 172.21.15.77:0/2414548563 shutdown_connections 2023-11-04T01:44:05.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.160+0000 7f4a7be56640 1 -- 172.21.15.77:0/2414548563 wait complete. 2023-11-04T01:44:05.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.161+0000 7f4a7be56640 1 Processor -- start 2023-11-04T01:44:05.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.161+0000 7f4a7be56640 1 -- start start 2023-11-04T01:44:05.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.162+0000 7f4a7be56640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a740cde60 0x7f4a740c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:05.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.162+0000 7f4a7be56640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4a740ce240 0x7f4a740ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:05.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.162+0000 7f4a7be56640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a7415daa0 0x7f4a74151230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:05.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.162+0000 7f4a7be56640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a740cb230 con 0x7f4a7415daa0 2023-11-04T01:44:05.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.162+0000 7f4a7be56640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a740cd260 con 0x7f4a740cde60 2023-11-04T01:44:05.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.162+0000 7f4a7be56640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a740ca5b0 con 0x7f4a740ce240 2023-11-04T01:44:05.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.162+0000 7f4a7a3f3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a7415daa0 0x7f4a74151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:05.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.162+0000 7f4a7a3f3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a7415daa0 0x7f4a74151230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49912/0 (socket says 172.21.15.77:49912) 2023-11-04T01:44:05.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.162+0000 7f4a7a3f3640 1 -- 172.21.15.77:0/3509747463 learned_addr learned my addr 172.21.15.77:0/3509747463 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:05.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.162+0000 7f4a79bf2640 1 --2- 172.21.15.77:0/3509747463 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a740cde60 0x7f4a740c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:05.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.162+0000 7f4a793f1640 1 --2- 172.21.15.77:0/3509747463 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4a740ce240 0x7f4a740ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:05.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.162+0000 7f4a7a3f3640 1 -- 172.21.15.77:0/3509747463 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4a740ce240 msgr2=0x7f4a740ccd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:05.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.162+0000 7f4a7a3f3640 1 --2- 172.21.15.77:0/3509747463 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4a740ce240 0x7f4a740ccd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:05.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.162+0000 7f4a7a3f3640 1 -- 172.21.15.77:0/3509747463 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a740cde60 msgr2=0x7f4a740c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:05.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.162+0000 7f4a7a3f3640 1 --2- 172.21.15.77:0/3509747463 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a740cde60 0x7f4a740c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:05.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.162+0000 7f4a7a3f3640 1 -- 172.21.15.77:0/3509747463 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a640094d0 con 0x7f4a7415daa0 2023-11-04T01:44:05.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.162+0000 7f4a79bf2640 1 --2- 172.21.15.77:0/3509747463 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a740cde60 0x7f4a740c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:05.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.162+0000 7f4a7a3f3640 1 --2- 172.21.15.77:0/3509747463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a7415daa0 0x7f4a74151230 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c00efc0 tx=0x7f4a6c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:05.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.163+0000 7f4a6a7fc640 1 -- 172.21.15.77:0/3509747463 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c009ca0 con 0x7f4a7415daa0 2023-11-04T01:44:05.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.163+0000 7f4a6a7fc640 1 -- 172.21.15.77:0/3509747463 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6c00f040 con 0x7f4a7415daa0 2023-11-04T01:44:05.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.163+0000 7f4a7be56640 1 -- 172.21.15.77:0/3509747463 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a740ca890 con 0x7f4a7415daa0 2023-11-04T01:44:05.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.163+0000 7f4a6a7fc640 1 -- 172.21.15.77:0/3509747463 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c0146c0 con 0x7f4a7415daa0 2023-11-04T01:44:05.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.163+0000 7f4a7be56640 1 -- 172.21.15.77:0/3509747463 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a740cae50 con 0x7f4a7415daa0 2023-11-04T01:44:05.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.164+0000 7f4a7be56640 1 -- 172.21.15.77:0/3509747463 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a740cb370 con 0x7f4a7415daa0 2023-11-04T01:44:05.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.164+0000 7f4a6a7fc640 1 -- 172.21.15.77:0/3509747463 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4a6c014820 con 0x7f4a7415daa0 2023-11-04T01:44:05.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.164+0000 7f4a6a7fc640 1 --2- 172.21.15.77:0/3509747463 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4a5806ae70 0x7f4a5806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:05.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.165+0000 7f4a6a7fc640 1 -- 172.21.15.77:0/3509747463 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7178+0+0 (secure 0 0 0) 0x7f4a6c08aad0 con 0x7f4a7415daa0 2023-11-04T01:44:05.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.165+0000 7f4a79bf2640 1 --2- 172.21.15.77:0/3509747463 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4a5806ae70 0x7f4a5806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:05.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.165+0000 7f4a79bf2640 1 --2- 172.21.15.77:0/3509747463 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4a5806ae70 0x7f4a5806d330 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4a7000c940 tx=0x7f4a70008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:05.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.169+0000 7f4a6a7fc640 1 -- 172.21.15.77:0/3509747463 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4a740cb370 con 0x7f4a7415daa0 2023-11-04T01:44:05.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.368+0000 7f4a7be56640 1 -- 172.21.15.77:0/3509747463 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a740cb550 con 0x7f4a7415daa0 2023-11-04T01:44:05.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.369+0000 7f4a6a7fc640 1 -- 172.21.15.77:0/3509747463 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4939 (secure 0 0 0) 0x7f4a740cb550 con 0x7f4a7415daa0 2023-11-04T01:44:05.371 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:44:05.372 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7302,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/4241784871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4241784871},{"type":"v1","addr":"172.21.15.77:6834","nonce":4241784871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:43:48.148864+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":35690,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_35690":{"gid":35690,"name":"b","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6836/3699147778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":3699147778},{"type":"v1","addr":"172.21.15.122:6836","nonce":3699147778}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:05.374 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 49 2023-11-04T01:44:05.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.371+0000 7f4a7be56640 1 -- 172.21.15.77:0/3509747463 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4a5806ae70 msgr2=0x7f4a5806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:05.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.371+0000 7f4a7be56640 1 --2- 172.21.15.77:0/3509747463 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4a5806ae70 0x7f4a5806d330 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4a7000c940 tx=0x7f4a70008040 comp rx=0 tx=0).stop 2023-11-04T01:44:05.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.371+0000 7f4a7be56640 1 -- 172.21.15.77:0/3509747463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a7415daa0 msgr2=0x7f4a74151230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:05.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.371+0000 7f4a7be56640 1 --2- 172.21.15.77:0/3509747463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a7415daa0 0x7f4a74151230 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c00efc0 tx=0x7f4a6c00c490 comp rx=0 tx=0).stop 2023-11-04T01:44:05.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.371+0000 7f4a7be56640 1 -- 172.21.15.77:0/3509747463 shutdown_connections 2023-11-04T01:44:05.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.371+0000 7f4a7be56640 1 --2- 172.21.15.77:0/3509747463 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4a5806ae70 0x7f4a5806d330 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:05.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.371+0000 7f4a7be56640 1 --2- 172.21.15.77:0/3509747463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a7415daa0 0x7f4a74151230 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:05.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.371+0000 7f4a7be56640 1 --2- 172.21.15.77:0/3509747463 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4a740ce240 0x7f4a740ccd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:05.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.371+0000 7f4a7be56640 1 --2- 172.21.15.77:0/3509747463 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4a740cde60 0x7f4a740c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:05.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.371+0000 7f4a7be56640 1 -- 172.21.15.77:0/3509747463 >> 172.21.15.77:0/3509747463 conn(0x7f4a74071f30 msgr2=0x7f4a740d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:05.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.371+0000 7f4a7be56640 1 -- 172.21.15.77:0/3509747463 shutdown_connections 2023-11-04T01:44:05.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:05.371+0000 7f4a7be56640 1 -- 172.21.15.77:0/3509747463 wait complete. 2023-11-04T01:44:05.383 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:44:06.821 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~13s 2023-11-04T01:44:10.384 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:10.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.492+0000 7f7bf6c44640 1 Processor -- start 2023-11-04T01:44:10.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.492+0000 7f7bf6c44640 1 -- start start 2023-11-04T01:44:10.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.493+0000 7f7bf6c44640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7bf00b0ae0 0x7f7bf00ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:10.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.493+0000 7f7bf6c44640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7bf006db20 0x7f7bf015d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:10.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.493+0000 7f7bf6c44640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf00b4110 con 0x7f7bf0159c70 2023-11-04T01:44:10.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.493+0000 7f7bf6c44640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf00b49b0 con 0x7f7bf00b0ae0 2023-11-04T01:44:10.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.493+0000 7f7bf6c44640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf00b43f0 con 0x7f7bf006db20 2023-11-04T01:44:10.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.493+0000 7f7bf49e0640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f7bf0159c70 0x7f7bf00b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:47888/0 (socket says 172.21.15.77:47888) 2023-11-04T01:44:10.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.493+0000 7f7bf49e0640 1 -- 172.21.15.77:0/2577874681 learned_addr learned my addr 172.21.15.77:0/2577874681 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:44:10.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.493+0000 7f7be77fe640 1 -- 172.21.15.77:0/2577874681 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2134939153 0 0) 0x7f7bf00b4110 con 0x7f7bf0159c70 2023-11-04T01:44:10.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.493+0000 7f7be77fe640 1 -- 172.21.15.77:0/2577874681 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bd8003520 con 0x7f7bf0159c70 2023-11-04T01:44:10.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.493+0000 7f7bf51e1640 1 --2- 172.21.15.77:0/2577874681 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7bf006db20 0x7f7bf015d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:10.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.493+0000 7f7be7fff640 1 --2- 172.21.15.77:0/2577874681 >> v2:172.21.15.122:3300/0 conn(0x7f7bf00b0ae0 0x7f7bf00ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:10.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.493+0000 7f7be77fe640 1 -- 172.21.15.77:0/2577874681 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2294794419 0 0) 0x7f7bd8003520 con 0x7f7bf0159c70 2023-11-04T01:44:10.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.493+0000 7f7be77fe640 1 -- 172.21.15.77:0/2577874681 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7bf006db20 msgr2=0x7f7bf015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:10.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.493+0000 7f7be77fe640 1 --2- 172.21.15.77:0/2577874681 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7bf006db20 0x7f7bf015d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.493+0000 7f7be77fe640 1 -- 172.21.15.77:0/2577874681 >> v2:172.21.15.122:3300/0 conn(0x7f7bf00b0ae0 msgr2=0x7f7bf00ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:10.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.493+0000 7f7be77fe640 1 --2- 172.21.15.77:0/2577874681 >> v2:172.21.15.122:3300/0 conn(0x7f7bf00b0ae0 0x7f7bf00ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.493+0000 7f7be77fe640 1 -- 172.21.15.77:0/2577874681 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf00b46d0 con 0x7f7bf0159c70 2023-11-04T01:44:10.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.493+0000 7f7be77fe640 1 -- 172.21.15.77:0/2577874681 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f7bec001670 con 0x7f7bf0159c70 2023-11-04T01:44:10.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.493+0000 7f7be77fe640 1 -- 172.21.15.77:0/2577874681 >> v1:172.21.15.77:6789/0 conn(0x7f7bf0159c70 legacy=0x7f7bf00b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:10.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.493+0000 7f7be77fe640 1 --2- 172.21.15.77:0/2577874681 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7bf006db20 0x7f7bd8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:10.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.493+0000 7f7be77fe640 1 --2- 172.21.15.77:0/2577874681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd8003ef0 0x7f7bd80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:10.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.494+0000 7f7be77fe640 1 --2- 172.21.15.77:0/2577874681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bd8004d00 0x7f7bd8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:10.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.494+0000 7f7be77fe640 1 -- 172.21.15.77:0/2577874681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf00b49b0 con 0x7f7bd8003ef0 2023-11-04T01:44:10.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.494+0000 7f7be77fe640 1 -- 172.21.15.77:0/2577874681 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf00b43f0 con 0x7f7bd8004d00 2023-11-04T01:44:10.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.494+0000 7f7be77fe640 1 -- 172.21.15.77:0/2577874681 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd8014190 con 0x7f7bf006db20 2023-11-04T01:44:10.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.494+0000 7f7be7fff640 1 --2- 172.21.15.77:0/2577874681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd8003ef0 0x7f7bd80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:10.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.494+0000 7f7bf49e0640 1 --2- 172.21.15.77:0/2577874681 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7bf006db20 0x7f7bd8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:10.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.494+0000 7f7bf51e1640 1 --2- 172.21.15.77:0/2577874681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bd8004d00 0x7f7bd8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:10.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.494+0000 7f7be7fff640 1 -- 172.21.15.77:0/2577874681 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7bf006db20 msgr2=0x7f7bd8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:10.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.494+0000 7f7be7fff640 1 --2- 172.21.15.77:0/2577874681 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7bf006db20 0x7f7bd8003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.494+0000 7f7be7fff640 1 -- 172.21.15.77:0/2577874681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bd8004d00 msgr2=0x7f7bd8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:10.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.494+0000 7f7be7fff640 1 --2- 172.21.15.77:0/2577874681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bd8004d00 0x7f7bd8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.494+0000 7f7be7fff640 1 -- 172.21.15.77:0/2577874681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd8003520 con 0x7f7bd8003ef0 2023-11-04T01:44:10.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.494+0000 7f7bf49e0640 1 --2- 172.21.15.77:0/2577874681 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7bf006db20 0x7f7bd8003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:10.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.495+0000 7f7be7fff640 1 --2- 172.21.15.77:0/2577874681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd8003ef0 0x7f7bd80047c0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f7be000d940 tx=0x7f7bd80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f238695ae25118c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:10.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.495+0000 7f7be77fe640 1 -- 172.21.15.77:0/2577874681 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be002ccd0 con 0x7f7bd8003ef0 2023-11-04T01:44:10.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.495+0000 7f7be77fe640 1 -- 172.21.15.77:0/2577874681 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be002ce30 con 0x7f7bd8003ef0 2023-11-04T01:44:10.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.495+0000 7f7be77fe640 1 -- 172.21.15.77:0/2577874681 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be0034640 con 0x7f7bd8003ef0 2023-11-04T01:44:10.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.495+0000 7f7bf6c44640 1 -- 172.21.15.77:0/2577874681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd8003ef0 msgr2=0x7f7bd80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:10.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.495+0000 7f7bf6c44640 1 --2- 172.21.15.77:0/2577874681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd8003ef0 0x7f7bd80047c0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f7be000d940 tx=0x7f7bd80057f0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.495+0000 7f7bf51e1640 1 -- 172.21.15.77:0/2577874681 reap_dead start 2023-11-04T01:44:10.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.495+0000 7f7bf6c44640 1 -- 172.21.15.77:0/2577874681 shutdown_connections 2023-11-04T01:44:10.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.495+0000 7f7bf6c44640 1 -- 172.21.15.77:0/2577874681 >> 172.21.15.77:0/2577874681 conn(0x7f7bf00ce950 msgr2=0x7f7bf00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:10.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.495+0000 7f7bf6c44640 1 -- 172.21.15.77:0/2577874681 shutdown_connections 2023-11-04T01:44:10.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.495+0000 7f7bf6c44640 1 -- 172.21.15.77:0/2577874681 wait complete. 2023-11-04T01:44:10.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.496+0000 7f7bf6c44640 1 Processor -- start 2023-11-04T01:44:10.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.497+0000 7f7bf6c44640 1 -- start start 2023-11-04T01:44:10.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.497+0000 7f7bf6c44640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bd8003ef0 0x7f7bf0154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:10.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.497+0000 7f7bf6c44640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7bf01eefb0 0x7f7bf014dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:10.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.497+0000 7f7bf6c44640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bf015b650 0x7f7bf015bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:10.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.497+0000 7f7bf6c44640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf00ae4e0 con 0x7f7bf015b650 2023-11-04T01:44:10.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.497+0000 7f7bf6c44640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf015c010 con 0x7f7bd8003ef0 2023-11-04T01:44:10.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.497+0000 7f7bf6c44640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf014e420 con 0x7f7bf01eefb0 2023-11-04T01:44:10.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.498+0000 7f7bf51e1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bf015b650 0x7f7bf015bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:10.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.498+0000 7f7bf51e1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bf015b650 0x7f7bf015bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41256/0 (socket says 172.21.15.77:41256) 2023-11-04T01:44:10.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.498+0000 7f7bf51e1640 1 -- 172.21.15.77:0/3015524153 learned_addr learned my addr 172.21.15.77:0/3015524153 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:10.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.498+0000 7f7be7fff640 1 --2- 172.21.15.77:0/3015524153 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7bf01eefb0 0x7f7bf014dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:10.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.498+0000 7f7bf49e0640 1 --2- 172.21.15.77:0/3015524153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bd8003ef0 0x7f7bf0154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:10.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.498+0000 7f7bf51e1640 1 -- 172.21.15.77:0/3015524153 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7bf01eefb0 msgr2=0x7f7bf014dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:10.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.498+0000 7f7bf51e1640 1 --2- 172.21.15.77:0/3015524153 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7bf01eefb0 0x7f7bf014dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.498+0000 7f7bf51e1640 1 -- 172.21.15.77:0/3015524153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bd8003ef0 msgr2=0x7f7bf0154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:10.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.498+0000 7f7bf51e1640 1 --2- 172.21.15.77:0/3015524153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bd8003ef0 0x7f7bf0154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.498+0000 7f7bf51e1640 1 -- 172.21.15.77:0/3015524153 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf0151e60 con 0x7f7bf015b650 2023-11-04T01:44:10.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.498+0000 7f7bf49e0640 1 --2- 172.21.15.77:0/3015524153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bd8003ef0 0x7f7bf0154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:10.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.498+0000 7f7bf51e1640 1 --2- 172.21.15.77:0/3015524153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bf015b650 0x7f7bf015bad0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f7bf00cf6e0 tx=0x7f7be8007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:10.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.498+0000 7f7be57fa640 1 -- 172.21.15.77:0/3015524153 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be80048a0 con 0x7f7bf015b650 2023-11-04T01:44:10.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.498+0000 7f7be57fa640 1 -- 172.21.15.77:0/3015524153 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be80173f0 con 0x7f7bf015b650 2023-11-04T01:44:10.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.498+0000 7f7be57fa640 1 -- 172.21.15.77:0/3015524153 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be80177a0 con 0x7f7bf015b650 2023-11-04T01:44:10.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.498+0000 7f7bf6c44640 1 -- 172.21.15.77:0/3015524153 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf00ad860 con 0x7f7bf015b650 2023-11-04T01:44:10.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.498+0000 7f7bf6c44640 1 -- 172.21.15.77:0/3015524153 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf00ade20 con 0x7f7bf015b650 2023-11-04T01:44:10.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.499+0000 7f7bf6c44640 1 -- 172.21.15.77:0/3015524153 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf015d170 con 0x7f7bf015b650 2023-11-04T01:44:10.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.500+0000 7f7be57fa640 1 -- 172.21.15.77:0/3015524153 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7be8017900 con 0x7f7bf015b650 2023-11-04T01:44:10.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.500+0000 7f7be57fa640 1 --2- 172.21.15.77:0/3015524153 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7bdc06ae70 0x7f7bdc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:10.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.500+0000 7f7be57fa640 1 -- 172.21.15.77:0/3015524153 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7178+0+0 (secure 0 0 0) 0x7f7be8089ca0 con 0x7f7bf015b650 2023-11-04T01:44:10.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.500+0000 7f7bf49e0640 1 --2- 172.21.15.77:0/3015524153 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7bdc06ae70 0x7f7bdc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:10.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.501+0000 7f7bf49e0640 1 --2- 172.21.15.77:0/3015524153 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7bdc06ae70 0x7f7bdc06d330 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f7bf015c350 tx=0x7f7bec009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:10.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.504+0000 7f7be57fa640 1 -- 172.21.15.77:0/3015524153 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7be8054790 con 0x7f7bf015b650 2023-11-04T01:44:10.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.708+0000 7f7bf6c44640 1 -- 172.21.15.77:0/3015524153 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7bf00ae620 con 0x7f7bf015b650 2023-11-04T01:44:10.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.708+0000 7f7be57fa640 1 -- 172.21.15.77:0/3015524153 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4987 (secure 0 0 0) 0x7f7bf00ae620 con 0x7f7bf015b650 2023-11-04T01:44:10.711 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:44:10.711 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7302,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/4241784871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4241784871},{"type":"v1","addr":"172.21.15.77:6834","nonce":4241784871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:44:05.587460+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":35690,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_35690":{"gid":35690,"name":"b","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6836/3699147778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":3699147778},{"type":"v1","addr":"172.21.15.122:6836","nonce":3699147778}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:44:05.587459+0000","export_targets":[1],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:10.711 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 50 2023-11-04T01:44:10.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.710+0000 7f7bf6c44640 1 -- 172.21.15.77:0/3015524153 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7bdc06ae70 msgr2=0x7f7bdc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:10.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.710+0000 7f7bf6c44640 1 --2- 172.21.15.77:0/3015524153 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7bdc06ae70 0x7f7bdc06d330 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f7bf015c350 tx=0x7f7bec009040 comp rx=0 tx=0).stop 2023-11-04T01:44:10.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.710+0000 7f7bf6c44640 1 -- 172.21.15.77:0/3015524153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bf015b650 msgr2=0x7f7bf015bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:10.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.710+0000 7f7bf6c44640 1 --2- 172.21.15.77:0/3015524153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bf015b650 0x7f7bf015bad0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f7bf00cf6e0 tx=0x7f7be8007700 comp rx=0 tx=0).stop 2023-11-04T01:44:10.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.710+0000 7f7bf6c44640 1 -- 172.21.15.77:0/3015524153 shutdown_connections 2023-11-04T01:44:10.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.710+0000 7f7bf6c44640 1 --2- 172.21.15.77:0/3015524153 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7bdc06ae70 0x7f7bdc06d330 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.710+0000 7f7bf6c44640 1 --2- 172.21.15.77:0/3015524153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bf015b650 0x7f7bf015bad0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.710+0000 7f7bf6c44640 1 --2- 172.21.15.77:0/3015524153 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7bf01eefb0 0x7f7bf014dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.710+0000 7f7bf6c44640 1 --2- 172.21.15.77:0/3015524153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bd8003ef0 0x7f7bf0154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.711+0000 7f7bf6c44640 1 -- 172.21.15.77:0/3015524153 >> 172.21.15.77:0/3015524153 conn(0x7f7bf00ce950 msgr2=0x7f7bf0070630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:10.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.711+0000 7f7bf6c44640 1 -- 172.21.15.77:0/3015524153 shutdown_connections 2023-11-04T01:44:10.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.711+0000 7f7bf6c44640 1 -- 172.21.15.77:0/3015524153 wait complete. 2023-11-04T01:44:10.723 DEBUG:tasks.ceph_test_case:wait_until_true: success in 20s and 0 retries 2023-11-04T01:44:10.723 DEBUG:teuthology.orchestra.run.smithi122:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:44:10.753 INFO:teuthology.orchestra.run.smithi122.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:44:10.755 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:44:10.755 DEBUG:teuthology.orchestra.run.smithi122:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:44:10.827 INFO:teuthology.orchestra.run.smithi122.stdout:1699062228.96052.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i b', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:44:10.829 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062228.96052.core'] 2023-11-04T01:44:10.829 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062228.96052.core, deleting it 2023-11-04T01:44:10.830 DEBUG:teuthology.orchestra.run.smithi122:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062228.96052.core 2023-11-04T01:44:10.900 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:44:11.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.999+0000 7f357f058640 1 Processor -- start 2023-11-04T01:44:11.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.999+0000 7f357f058640 1 -- start start 2023-11-04T01:44:11.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.999+0000 7f357f058640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f35780cc9d0 0x7f35780c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.999+0000 7f357f058640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35780c3860 con 0x7f3578153850 2023-11-04T01:44:11.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.999+0000 7f357f058640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35780c9250 con 0x7f35780cc520 2023-11-04T01:44:11.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:10.999+0000 7f357f058640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3578153c30 con 0x7f35780cc9d0 2023-11-04T01:44:11.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.000+0000 7f357cdf4640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f3578153850 0x7f357815a1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:47898/0 (socket says 172.21.15.77:47898) 2023-11-04T01:44:11.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.000+0000 7f357cdf4640 1 -- 172.21.15.77:0/714127660 learned_addr learned my addr 172.21.15.77:0/714127660 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:44:11.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.000+0000 7f357d5f5640 1 --2- 172.21.15.77:0/714127660 >> v2:172.21.15.77:3300/0 conn(0x7f35780cc9d0 0x7f35780c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.000+0000 7f35777fe640 1 -- 172.21.15.77:0/714127660 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4193661589 0 0) 0x7f35780c3860 con 0x7f3578153850 2023-11-04T01:44:11.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.000+0000 7f35777fe640 1 -- 172.21.15.77:0/714127660 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3568003440 con 0x7f3578153850 2023-11-04T01:44:11.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.000+0000 7f357d5f5640 1 -- 172.21.15.77:0/714127660 >> v1:172.21.15.122:6789/0 conn(0x7f35780cc520 legacy=0x7f3578070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:11.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.000+0000 7f357d5f5640 1 -- 172.21.15.77:0/714127660 >> v1:172.21.15.77:6789/0 conn(0x7f3578153850 legacy=0x7f357815a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:11.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.000+0000 7f357d5f5640 1 -- 172.21.15.77:0/714127660 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35780ce590 con 0x7f35780cc9d0 2023-11-04T01:44:11.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.001+0000 7f357d5f5640 1 --2- 172.21.15.77:0/714127660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35780cc9d0 0x7f35780c3cf0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f3570009d90 tx=0x7f357002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a07c7e4a18b6a8e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:11.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.001+0000 7f35777fe640 1 -- 172.21.15.77:0/714127660 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357002cc60 con 0x7f35780cc9d0 2023-11-04T01:44:11.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.001+0000 7f35777fe640 1 -- 172.21.15.77:0/714127660 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357002cdc0 con 0x7f35780cc9d0 2023-11-04T01:44:11.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.001+0000 7f35777fe640 1 -- 172.21.15.77:0/714127660 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3570034640 con 0x7f35780cc9d0 2023-11-04T01:44:11.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.001+0000 7f357f058640 1 -- 172.21.15.77:0/714127660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35780cc9d0 msgr2=0x7f35780c3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:11.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.001+0000 7f357f058640 1 --2- 172.21.15.77:0/714127660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35780cc9d0 0x7f35780c3cf0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f3570009d90 tx=0x7f357002beb0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.001+0000 7f357f058640 1 -- 172.21.15.77:0/714127660 shutdown_connections 2023-11-04T01:44:11.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.001+0000 7f357f058640 1 --2- 172.21.15.77:0/714127660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35780cc9d0 0x7f35780c3cf0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.001+0000 7f357f058640 1 -- 172.21.15.77:0/714127660 >> 172.21.15.77:0/714127660 conn(0x7f35780ce950 msgr2=0x7f35780ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:11.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.001+0000 7f357f058640 1 -- 172.21.15.77:0/714127660 shutdown_connections 2023-11-04T01:44:11.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.001+0000 7f357f058640 1 -- 172.21.15.77:0/714127660 wait complete. 2023-11-04T01:44:11.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.002+0000 7f357f058640 1 Processor -- start 2023-11-04T01:44:11.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.002+0000 7f357f058640 1 -- start start 2023-11-04T01:44:11.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.003+0000 7f357f058640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35780cc520 0x7f35780c6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.003+0000 7f357f058640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35780cc9d0 0x7f35781525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.003+0000 7f357f058640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3578153850 0x7f35780c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.003+0000 7f357f058640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3578152b00 con 0x7f35780cc520 2023-11-04T01:44:11.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.003+0000 7f357f058640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35780c8680 con 0x7f35780cc9d0 2023-11-04T01:44:11.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.003+0000 7f357f058640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35780c5ba0 con 0x7f3578153850 2023-11-04T01:44:11.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.003+0000 7f357cdf4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35780cc520 0x7f35780c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.003+0000 7f357cdf4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35780cc520 0x7f35780c6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41266/0 (socket says 172.21.15.77:41266) 2023-11-04T01:44:11.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.003+0000 7f357cdf4640 1 -- 172.21.15.77:0/4009523396 learned_addr learned my addr 172.21.15.77:0/4009523396 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:11.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.004+0000 7f3577fff640 1 --2- 172.21.15.77:0/4009523396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35780cc9d0 0x7f35781525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.004+0000 7f357d5f5640 1 --2- 172.21.15.77:0/4009523396 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3578153850 0x7f35780c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.004+0000 7f357cdf4640 1 -- 172.21.15.77:0/4009523396 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3578153850 msgr2=0x7f35780c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:11.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.004+0000 7f357cdf4640 1 --2- 172.21.15.77:0/4009523396 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3578153850 0x7f35780c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.004+0000 7f357cdf4640 1 -- 172.21.15.77:0/4009523396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35780cc9d0 msgr2=0x7f35781525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:11.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.004+0000 7f357cdf4640 1 --2- 172.21.15.77:0/4009523396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35780cc9d0 0x7f35781525c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.004+0000 7f357cdf4640 1 -- 172.21.15.77:0/4009523396 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3570009a70 con 0x7f35780cc520 2023-11-04T01:44:11.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.004+0000 7f357d5f5640 1 --2- 172.21.15.77:0/4009523396 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3578153850 0x7f35780c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:11.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.004+0000 7f357cdf4640 1 --2- 172.21.15.77:0/4009523396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35780cc520 0x7f35780c6960 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f356c00c390 tx=0x7f356c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:11.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.004+0000 7f35757fa640 1 -- 172.21.15.77:0/4009523396 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c005ce0 con 0x7f35780cc520 2023-11-04T01:44:11.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.004+0000 7f35757fa640 1 -- 172.21.15.77:0/4009523396 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356c005e40 con 0x7f35780cc520 2023-11-04T01:44:11.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.004+0000 7f357f058640 1 -- 172.21.15.77:0/4009523396 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35780c5e80 con 0x7f35780cc520 2023-11-04T01:44:11.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.004+0000 7f35757fa640 1 -- 172.21.15.77:0/4009523396 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c0072f0 con 0x7f35780cc520 2023-11-04T01:44:11.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.004+0000 7f357f058640 1 -- 172.21.15.77:0/4009523396 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35780c6440 con 0x7f35780cc520 2023-11-04T01:44:11.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.005+0000 7f357f058640 1 -- 172.21.15.77:0/4009523396 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3578074290 con 0x7f35780cc520 2023-11-04T01:44:11.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.005+0000 7f35757fa640 1 -- 172.21.15.77:0/4009523396 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f356c007450 con 0x7f35780cc520 2023-11-04T01:44:11.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.006+0000 7f35757fa640 1 --2- 172.21.15.77:0/4009523396 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f355c06ae70 0x7f355c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.006+0000 7f35757fa640 1 -- 172.21.15.77:0/4009523396 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7178+0+0 (secure 0 0 0) 0x7f356c089160 con 0x7f35780cc520 2023-11-04T01:44:11.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.006+0000 7f3577fff640 1 --2- 172.21.15.77:0/4009523396 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f355c06ae70 0x7f355c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.006+0000 7f3577fff640 1 --2- 172.21.15.77:0/4009523396 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f355c06ae70 0x7f355c06d330 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3578157360 tx=0x7f3564009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:11.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.010+0000 7f35757fa640 1 -- 172.21.15.77:0/4009523396 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f356c053ce0 con 0x7f35780cc520 2023-11-04T01:44:11.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.241+0000 7f357f058640 1 -- 172.21.15.77:0/4009523396 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7f35780c5010 con 0x7f35780cc520 2023-11-04T01:44:11.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.243+0000 7f35757fa640 1 -- 172.21.15.77:0/4009523396 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 35690 v51) v1 ==== 98+0+0 (secure 0 0 0) 0x7f356c057300 con 0x7f35780cc520 2023-11-04T01:44:11.245 INFO:teuthology.orchestra.run.smithi077.stderr:failed mds gid 35690 2023-11-04T01:44:11.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.246+0000 7f357f058640 1 -- 172.21.15.77:0/4009523396 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f355c06ae70 msgr2=0x7f355c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:11.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.246+0000 7f357f058640 1 --2- 172.21.15.77:0/4009523396 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f355c06ae70 0x7f355c06d330 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3578157360 tx=0x7f3564009040 comp rx=0 tx=0).stop 2023-11-04T01:44:11.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.246+0000 7f357f058640 1 -- 172.21.15.77:0/4009523396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35780cc520 msgr2=0x7f35780c6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:11.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.246+0000 7f357f058640 1 --2- 172.21.15.77:0/4009523396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35780cc520 0x7f35780c6960 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f356c00c390 tx=0x7f356c00c850 comp rx=0 tx=0).stop 2023-11-04T01:44:11.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.246+0000 7f357f058640 1 -- 172.21.15.77:0/4009523396 shutdown_connections 2023-11-04T01:44:11.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.246+0000 7f357f058640 1 --2- 172.21.15.77:0/4009523396 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f355c06ae70 0x7f355c06d330 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.246+0000 7f357f058640 1 --2- 172.21.15.77:0/4009523396 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3578153850 0x7f35780c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.246+0000 7f357f058640 1 --2- 172.21.15.77:0/4009523396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35780cc9d0 0x7f35781525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.246+0000 7f357f058640 1 --2- 172.21.15.77:0/4009523396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35780cc520 0x7f35780c6960 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.246+0000 7f357f058640 1 -- 172.21.15.77:0/4009523396 >> 172.21.15.77:0/4009523396 conn(0x7f35780ce950 msgr2=0x7f357815b440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:11.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.246+0000 7f357f058640 1 -- 172.21.15.77:0/4009523396 shutdown_connections 2023-11-04T01:44:11.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.247+0000 7f357f058640 1 -- 172.21.15.77:0/4009523396 wait complete. 2023-11-04T01:44:11.261 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:44:11.262 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:44:11.262 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:44:11.262 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:44:11.263 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:44:11.263 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi122 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b' 2023-11-04T01:44:11.264 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:44:11.264 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:44:11.267 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:44:11.267 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:11.343 INFO:tasks.ceph.mds.b.smithi122.stdout:starting mds.b at 2023-11-04T01:44:11.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.366+0000 7f065b256640 1 Processor -- start 2023-11-04T01:44:11.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.366+0000 7f065b256640 1 -- start start 2023-11-04T01:44:11.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.367+0000 7f065b256640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f06540cda60 0x7f06540ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.367+0000 7f065b256640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f06540b0cd0 0x7f0654070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.367+0000 7f065b256640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f06540cace0 0x7f0654070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.367+0000 7f065b256640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06540cc990 con 0x7f06540b0cd0 2023-11-04T01:44:11.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.367+0000 7f065b256640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06540ccc70 con 0x7f06540cace0 2023-11-04T01:44:11.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.367+0000 7f065b256640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06540c9ce0 con 0x7f06540cda60 2023-11-04T01:44:11.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.367+0000 7f0653fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f06540b0cd0 0x7f0654070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.367+0000 7f0653fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f06540b0cd0 0x7f0654070630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41270/0 (socket says 172.21.15.77:41270) 2023-11-04T01:44:11.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.367+0000 7f0653fff640 1 -- 172.21.15.77:0/2774746785 learned_addr learned my addr 172.21.15.77:0/2774746785 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:11.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.367+0000 7f06597f3640 1 --2- 172.21.15.77:0/2774746785 >> v2:172.21.15.122:3300/0 conn(0x7f06540cace0 0x7f0654070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.367+0000 7f0658ff2640 1 --2- 172.21.15.77:0/2774746785 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f06540cda60 0x7f06540ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.367+0000 7f0653fff640 1 -- 172.21.15.77:0/2774746785 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f06540cda60 msgr2=0x7f06540ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:11.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.367+0000 7f0653fff640 1 --2- 172.21.15.77:0/2774746785 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f06540cda60 0x7f06540ca7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.367+0000 7f0653fff640 1 -- 172.21.15.77:0/2774746785 >> v2:172.21.15.122:3300/0 conn(0x7f06540cace0 msgr2=0x7f0654070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:11.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.367+0000 7f0653fff640 1 --2- 172.21.15.77:0/2774746785 >> v2:172.21.15.122:3300/0 conn(0x7f06540cace0 0x7f0654070b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.367+0000 7f0653fff640 1 -- 172.21.15.77:0/2774746785 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06540c9fc0 con 0x7f06540b0cd0 2023-11-04T01:44:11.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.367+0000 7f06597f3640 1 --2- 172.21.15.77:0/2774746785 >> v2:172.21.15.122:3300/0 conn(0x7f06540cace0 0x7f0654070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:11.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.368+0000 7f0653fff640 1 --2- 172.21.15.77:0/2774746785 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06540b0cd0 0x7f0654070630 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f0654071ba0 tx=0x7f064802dea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee6663324e5f4ac6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:11.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.368+0000 7f06537fe640 1 -- 172.21.15.77:0/2774746785 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064802ec50 con 0x7f06540b0cd0 2023-11-04T01:44:11.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.368+0000 7f06537fe640 1 -- 172.21.15.77:0/2774746785 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0648032070 con 0x7f06540b0cd0 2023-11-04T01:44:11.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.368+0000 7f06537fe640 1 -- 172.21.15.77:0/2774746785 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0648038400 con 0x7f06540b0cd0 2023-11-04T01:44:11.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.369+0000 7f065b256640 1 -- 172.21.15.77:0/2774746785 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06540b0cd0 msgr2=0x7f0654070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:11.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.369+0000 7f065b256640 1 --2- 172.21.15.77:0/2774746785 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06540b0cd0 0x7f0654070630 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f0654071ba0 tx=0x7f064802dea0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.369+0000 7f065b256640 1 -- 172.21.15.77:0/2774746785 shutdown_connections 2023-11-04T01:44:11.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.369+0000 7f065b256640 1 --2- 172.21.15.77:0/2774746785 >> v2:172.21.15.122:3300/0 conn(0x7f06540cace0 0x7f0654070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.369+0000 7f065b256640 1 --2- 172.21.15.77:0/2774746785 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06540b0cd0 0x7f0654070630 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.369+0000 7f065b256640 1 --2- 172.21.15.77:0/2774746785 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f06540cda60 0x7f06540ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.369+0000 7f065b256640 1 -- 172.21.15.77:0/2774746785 >> 172.21.15.77:0/2774746785 conn(0x7f06540ce950 msgr2=0x7f06540ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:11.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.369+0000 7f065b256640 1 -- 172.21.15.77:0/2774746785 shutdown_connections 2023-11-04T01:44:11.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.369+0000 7f065b256640 1 -- 172.21.15.77:0/2774746785 wait complete. 2023-11-04T01:44:11.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.370+0000 7f065b256640 1 Processor -- start 2023-11-04T01:44:11.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.370+0000 7f065b256640 1 -- start start 2023-11-04T01:44:11.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.371+0000 7f065b256640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06540b0cd0 0x7f0654148db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.371+0000 7f065b256640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f06540cace0 0x7f06540ad140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.371+0000 7f065b256640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06540cda60 0x7f0654147900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.371+0000 7f065b256640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06540b3f70 con 0x7f06540b0cd0 2023-11-04T01:44:11.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.371+0000 7f065b256640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06541492f0 con 0x7f06540cda60 2023-11-04T01:44:11.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.371+0000 7f065b256640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0654146860 con 0x7f06540cace0 2023-11-04T01:44:11.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.371+0000 7f0658ff2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06540b0cd0 0x7f0654148db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.371+0000 7f0658ff2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06540b0cd0 0x7f0654148db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41278/0 (socket says 172.21.15.77:41278) 2023-11-04T01:44:11.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.371+0000 7f0658ff2640 1 -- 172.21.15.77:0/367734469 learned_addr learned my addr 172.21.15.77:0/367734469 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:11.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.371+0000 7f0653fff640 1 --2- 172.21.15.77:0/367734469 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f06540cace0 0x7f06540ad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.371+0000 7f06597f3640 1 --2- 172.21.15.77:0/367734469 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06540cda60 0x7f0654147900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.371+0000 7f0658ff2640 1 -- 172.21.15.77:0/367734469 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f06540cace0 msgr2=0x7f06540ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:11.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.371+0000 7f0658ff2640 1 --2- 172.21.15.77:0/367734469 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f06540cace0 0x7f06540ad140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.371+0000 7f0658ff2640 1 -- 172.21.15.77:0/367734469 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06540cda60 msgr2=0x7f0654147900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:11.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.371+0000 7f0658ff2640 1 --2- 172.21.15.77:0/367734469 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06540cda60 0x7f0654147900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.371+0000 7f0658ff2640 1 -- 172.21.15.77:0/367734469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064800b760 con 0x7f06540b0cd0 2023-11-04T01:44:11.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.372+0000 7f0658ff2640 1 --2- 172.21.15.77:0/367734469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06540b0cd0 0x7f0654148db0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f064400d5f0 tx=0x7f064400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:11.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.372+0000 7f06517fa640 1 -- 172.21.15.77:0/367734469 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06440125f0 con 0x7f06540b0cd0 2023-11-04T01:44:11.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.372+0000 7f06517fa640 1 -- 172.21.15.77:0/367734469 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0644012750 con 0x7f06540b0cd0 2023-11-04T01:44:11.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.372+0000 7f06517fa640 1 -- 172.21.15.77:0/367734469 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0644012b00 con 0x7f06540b0cd0 2023-11-04T01:44:11.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.372+0000 7f065b256640 1 -- 172.21.15.77:0/367734469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0654146b40 con 0x7f06540b0cd0 2023-11-04T01:44:11.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.372+0000 7f065b256640 1 -- 172.21.15.77:0/367734469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0654147100 con 0x7f06540b0cd0 2023-11-04T01:44:11.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.373+0000 7f065b256640 1 -- 172.21.15.77:0/367734469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0654074290 con 0x7f06540b0cd0 2023-11-04T01:44:11.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.373+0000 7f06517fa640 1 -- 172.21.15.77:0/367734469 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0644012c60 con 0x7f06540b0cd0 2023-11-04T01:44:11.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.373+0000 7f06517fa640 1 --2- 172.21.15.77:0/367734469 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f064006aea0 0x7f064006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.373+0000 7f06517fa640 1 -- 172.21.15.77:0/367734469 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f0644089fb0 con 0x7f06540b0cd0 2023-11-04T01:44:11.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.374+0000 7f0653fff640 1 --2- 172.21.15.77:0/367734469 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f064006aea0 0x7f064006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.374+0000 7f0653fff640 1 --2- 172.21.15.77:0/367734469 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f064006aea0 0x7f064006d360 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f0648039000 tx=0x7f0648034000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:11.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.378+0000 7f06517fa640 1 -- 172.21.15.77:0/367734469 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f06440bcca0 con 0x7f06540b0cd0 2023-11-04T01:44:11.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.578+0000 7f065b256640 1 -- 172.21.15.77:0/367734469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06540b48d0 con 0x7f06540b0cd0 2023-11-04T01:44:11.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.578+0000 7f06517fa640 1 -- 172.21.15.77:0/367734469 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4142 (secure 0 0 0) 0x7f0644054b00 con 0x7f06540b0cd0 2023-11-04T01:44:11.581 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:44:11.581 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:44:11.247580+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7302,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7302":{"gid":7302,"name":"a","rank":0,"incarnation":52,"state":"up:replay","state_seq":1,"addr":"172.21.15.77:6834/4241784871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4241784871},{"type":"v1","addr":"172.21.15.77:6834","nonce":4241784871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:11.582 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 52 2023-11-04T01:44:11.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.580+0000 7f065b256640 1 -- 172.21.15.77:0/367734469 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f064006aea0 msgr2=0x7f064006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:11.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.580+0000 7f065b256640 1 --2- 172.21.15.77:0/367734469 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f064006aea0 0x7f064006d360 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f0648039000 tx=0x7f0648034000 comp rx=0 tx=0).stop 2023-11-04T01:44:11.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.580+0000 7f065b256640 1 -- 172.21.15.77:0/367734469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06540b0cd0 msgr2=0x7f0654148db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:11.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.580+0000 7f065b256640 1 --2- 172.21.15.77:0/367734469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06540b0cd0 0x7f0654148db0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f064400d5f0 tx=0x7f064400dab0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.580+0000 7f065b256640 1 -- 172.21.15.77:0/367734469 shutdown_connections 2023-11-04T01:44:11.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.580+0000 7f065b256640 1 --2- 172.21.15.77:0/367734469 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f064006aea0 0x7f064006d360 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.580+0000 7f065b256640 1 --2- 172.21.15.77:0/367734469 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06540cda60 0x7f0654147900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.580+0000 7f065b256640 1 --2- 172.21.15.77:0/367734469 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f06540cace0 0x7f06540ad140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.580+0000 7f065b256640 1 --2- 172.21.15.77:0/367734469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06540b0cd0 0x7f0654148db0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.580+0000 7f065b256640 1 -- 172.21.15.77:0/367734469 >> 172.21.15.77:0/367734469 conn(0x7f06540ce950 msgr2=0x7f06540ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:11.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.580+0000 7f065b256640 1 -- 172.21.15.77:0/367734469 shutdown_connections 2023-11-04T01:44:11.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:11.580+0000 7f065b256640 1 -- 172.21.15.77:0/367734469 wait complete. 2023-11-04T01:44:11.592 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:44:13.533 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-11-04T01:44:16.590 INFO:tasks.ceph.mds.a.smithi077.stderr:2023-11-04T01:44:16.588+0000 7f51c577d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:44:16.590 INFO:tasks.ceph.mds.a.smithi077.stderr:2023-11-04T01:44:16.588+0000 7f51c577d640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:44:16.594 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:16.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.702+0000 7f74ef7e2640 1 Processor -- start 2023-11-04T01:44:16.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.703+0000 7f74ef7e2640 1 -- start start 2023-11-04T01:44:16.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.704+0000 7f74ef7e2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74e8070d40 0x7f74e806c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:16.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.704+0000 7f74ef7e2640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74e80cc990 con 0x7f74e80cda60 2023-11-04T01:44:16.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.704+0000 7f74ef7e2640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74e80ccc70 con 0x7f74e80b0cd0 2023-11-04T01:44:16.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.704+0000 7f74ef7e2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e80c9ce0 con 0x7f74e8070d40 2023-11-04T01:44:16.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.704+0000 7f74ed57e640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f74e80cda60 0x7f74e80ca7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:47908/0 (socket says 172.21.15.77:47908) 2023-11-04T01:44:16.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.704+0000 7f74ed57e640 1 -- 172.21.15.77:0/949182356 learned_addr learned my addr 172.21.15.77:0/949182356 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:44:16.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.704+0000 7f74edd7f640 1 --2- 172.21.15.77:0/949182356 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74e8070d40 0x7f74e806c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:16.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.704+0000 7f74dffff640 1 -- 172.21.15.77:0/949182356 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1481825438 0 0) 0x7f74e80cc990 con 0x7f74e80cda60 2023-11-04T01:44:16.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.704+0000 7f74dffff640 1 -- 172.21.15.77:0/949182356 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74d4003520 con 0x7f74e80cda60 2023-11-04T01:44:16.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.704+0000 7f74dffff640 1 -- 172.21.15.77:0/949182356 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2490528665 0 0) 0x7f74e80ccc70 con 0x7f74e80b0cd0 2023-11-04T01:44:16.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.704+0000 7f74dffff640 1 -- 172.21.15.77:0/949182356 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74e80cc990 con 0x7f74e80b0cd0 2023-11-04T01:44:16.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.704+0000 7f74dffff640 1 -- 172.21.15.77:0/949182356 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3985549909 0 0) 0x7f74d4003520 con 0x7f74e80cda60 2023-11-04T01:44:16.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.704+0000 7f74dffff640 1 -- 172.21.15.77:0/949182356 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74e8070d40 msgr2=0x7f74e806c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:16.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.704+0000 7f74dffff640 1 --2- 172.21.15.77:0/949182356 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74e8070d40 0x7f74e806c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:16.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.704+0000 7f74dffff640 1 -- 172.21.15.77:0/949182356 >> v1:172.21.15.122:6789/0 conn(0x7f74e80b0cd0 legacy=0x7f74e8070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:16.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.704+0000 7f74dffff640 1 -- 172.21.15.77:0/949182356 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e80c9fc0 con 0x7f74e80cda60 2023-11-04T01:44:16.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.704+0000 7f74dffff640 1 -- 172.21.15.77:0/949182356 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f74d8001670 con 0x7f74e80cda60 2023-11-04T01:44:16.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.704+0000 7f74dffff640 1 -- 172.21.15.77:0/949182356 >> v1:172.21.15.77:6789/0 conn(0x7f74e80cda60 legacy=0x7f74e80ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:16.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.704+0000 7f74dffff640 1 --2- 172.21.15.77:0/949182356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74d4003b30 0x7f74d4003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:16.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.704+0000 7f74dffff640 1 --2- 172.21.15.77:0/949182356 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74e8070d40 0x7f74d40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:16.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.704+0000 7f74dffff640 1 --2- 172.21.15.77:0/949182356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74d4004d00 0x7f74d4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:16.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.704+0000 7f74dffff640 1 -- 172.21.15.77:0/949182356 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e80c9ce0 con 0x7f74d4003b30 2023-11-04T01:44:16.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.704+0000 7f74dffff640 1 -- 172.21.15.77:0/949182356 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d400ba30 con 0x7f74d4004d00 2023-11-04T01:44:16.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.704+0000 7f74dffff640 1 -- 172.21.15.77:0/949182356 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d400bbf0 con 0x7f74e8070d40 2023-11-04T01:44:16.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.704+0000 7f74ed57e640 1 --2- 172.21.15.77:0/949182356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74d4003b30 0x7f74d4003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:16.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.705+0000 7f74edd7f640 1 --2- 172.21.15.77:0/949182356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74d4004d00 0x7f74d4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:16.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.705+0000 7f74ecd7d640 1 --2- 172.21.15.77:0/949182356 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74e8070d40 0x7f74d40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:16.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.705+0000 7f74ed57e640 1 -- 172.21.15.77:0/949182356 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74e8070d40 msgr2=0x7f74d40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:16.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.705+0000 7f74ed57e640 1 --2- 172.21.15.77:0/949182356 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74e8070d40 0x7f74d40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:16.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.705+0000 7f74ed57e640 1 -- 172.21.15.77:0/949182356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74d4004d00 msgr2=0x7f74d4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:16.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.705+0000 7f74ed57e640 1 --2- 172.21.15.77:0/949182356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74d4004d00 0x7f74d4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:16.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.705+0000 7f74ed57e640 1 -- 172.21.15.77:0/949182356 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d4003520 con 0x7f74d4003b30 2023-11-04T01:44:16.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.705+0000 7f74edd7f640 1 --2- 172.21.15.77:0/949182356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74d4004d00 0x7f74d4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:16.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.706+0000 7f74ed57e640 1 --2- 172.21.15.77:0/949182356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74d4003b30 0x7f74d4003f30 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f74d8007fd0 tx=0x7f74d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae7142f6620712 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:16.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.706+0000 7f74dffff640 1 -- 172.21.15.77:0/949182356 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d8005ad0 con 0x7f74d4003b30 2023-11-04T01:44:16.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.706+0000 7f74dffff640 1 -- 172.21.15.77:0/949182356 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d8005c50 con 0x7f74d4003b30 2023-11-04T01:44:16.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.706+0000 7f74dffff640 1 -- 172.21.15.77:0/949182356 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d802c850 con 0x7f74d4003b30 2023-11-04T01:44:16.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.706+0000 7f74ef7e2640 1 -- 172.21.15.77:0/949182356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74d4003b30 msgr2=0x7f74d4003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:16.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.706+0000 7f74ef7e2640 1 --2- 172.21.15.77:0/949182356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74d4003b30 0x7f74d4003f30 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f74d8007fd0 tx=0x7f74d40057f0 comp rx=0 tx=0).stop 2023-11-04T01:44:16.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.706+0000 7f74edd7f640 1 -- 172.21.15.77:0/949182356 reap_dead start 2023-11-04T01:44:16.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.706+0000 7f74ef7e2640 1 -- 172.21.15.77:0/949182356 shutdown_connections 2023-11-04T01:44:16.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.706+0000 7f74ef7e2640 1 -- 172.21.15.77:0/949182356 >> 172.21.15.77:0/949182356 conn(0x7f74e80ce950 msgr2=0x7f74e80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:16.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.706+0000 7f74ef7e2640 1 -- 172.21.15.77:0/949182356 shutdown_connections 2023-11-04T01:44:16.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.706+0000 7f74ef7e2640 1 -- 172.21.15.77:0/949182356 wait complete. 2023-11-04T01:44:16.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.707+0000 7f74ef7e2640 1 Processor -- start 2023-11-04T01:44:16.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.708+0000 7f74ef7e2640 1 -- start start 2023-11-04T01:44:16.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.708+0000 7f74ef7e2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74d4003b30 0x7f74e81f6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:16.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.708+0000 7f74ef7e2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74e81e1bb0 0x7f74e81494b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:16.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.708+0000 7f74ef7e2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74e81499f0 0x7f74e80b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:16.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.708+0000 7f74ef7e2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e81e23e0 con 0x7f74d4003b30 2023-11-04T01:44:16.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.708+0000 7f74ef7e2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e814cc40 con 0x7f74e81e1bb0 2023-11-04T01:44:16.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.708+0000 7f74ef7e2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e81e2a80 con 0x7f74e81499f0 2023-11-04T01:44:16.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.708+0000 7f74ed57e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74d4003b30 0x7f74e81f6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:16.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.708+0000 7f74ed57e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74d4003b30 0x7f74e81f6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41296/0 (socket says 172.21.15.77:41296) 2023-11-04T01:44:16.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.708+0000 7f74ed57e640 1 -- 172.21.15.77:0/797076156 learned_addr learned my addr 172.21.15.77:0/797076156 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:16.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.709+0000 7f74ecd7d640 1 --2- 172.21.15.77:0/797076156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74e81e1bb0 0x7f74e81494b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:16.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.709+0000 7f74edd7f640 1 --2- 172.21.15.77:0/797076156 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74e81499f0 0x7f74e80b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:16.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.709+0000 7f74ed57e640 1 -- 172.21.15.77:0/797076156 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74e81499f0 msgr2=0x7f74e80b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:16.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.709+0000 7f74ed57e640 1 --2- 172.21.15.77:0/797076156 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74e81499f0 0x7f74e80b3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:16.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.709+0000 7f74ed57e640 1 -- 172.21.15.77:0/797076156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74e81e1bb0 msgr2=0x7f74e81494b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:16.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.709+0000 7f74ed57e640 1 --2- 172.21.15.77:0/797076156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74e81e1bb0 0x7f74e81494b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:16.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.709+0000 7f74ed57e640 1 -- 172.21.15.77:0/797076156 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e814c2a0 con 0x7f74d4003b30 2023-11-04T01:44:16.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.709+0000 7f74edd7f640 1 --2- 172.21.15.77:0/797076156 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74e81499f0 0x7f74e80b3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:16.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.709+0000 7f74ecd7d640 1 --2- 172.21.15.77:0/797076156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74e81e1bb0 0x7f74e81494b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:16.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.709+0000 7f74ed57e640 1 --2- 172.21.15.77:0/797076156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74d4003b30 0x7f74e81f6bd0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f74d8000f60 tx=0x7f74d80019f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:16.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.709+0000 7f74ddffb640 1 -- 172.21.15.77:0/797076156 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d803c040 con 0x7f74d4003b30 2023-11-04T01:44:16.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.709+0000 7f74ddffb640 1 -- 172.21.15.77:0/797076156 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d802cc60 con 0x7f74d4003b30 2023-11-04T01:44:16.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.709+0000 7f74ddffb640 1 -- 172.21.15.77:0/797076156 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d8007070 con 0x7f74d4003b30 2023-11-04T01:44:16.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.709+0000 7f74ef7e2640 1 -- 172.21.15.77:0/797076156 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e814c580 con 0x7f74d4003b30 2023-11-04T01:44:16.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.709+0000 7f74ef7e2640 1 -- 172.21.15.77:0/797076156 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e81e2030 con 0x7f74d4003b30 2023-11-04T01:44:16.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.710+0000 7f74ef7e2640 1 -- 172.21.15.77:0/797076156 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74e8149dd0 con 0x7f74d4003b30 2023-11-04T01:44:16.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.711+0000 7f74ddffb640 1 -- 172.21.15.77:0/797076156 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f74d8032070 con 0x7f74d4003b30 2023-11-04T01:44:16.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.711+0000 7f74ddffb640 1 --2- 172.21.15.77:0/797076156 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f74cc06aea0 0x7f74cc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:16.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.711+0000 7f74ddffb640 1 -- 172.21.15.77:0/797076156 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f74d80aa920 con 0x7f74d4003b30 2023-11-04T01:44:16.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.711+0000 7f74ecd7d640 1 --2- 172.21.15.77:0/797076156 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f74cc06aea0 0x7f74cc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:16.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.712+0000 7f74ecd7d640 1 --2- 172.21.15.77:0/797076156 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f74cc06aea0 0x7f74cc06d360 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f74e814d200 tx=0x7f74e4009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:16.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.715+0000 7f74ddffb640 1 -- 172.21.15.77:0/797076156 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f74e8149dd0 con 0x7f74d4003b30 2023-11-04T01:44:16.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.917+0000 7f74ef7e2640 1 -- 172.21.15.77:0/797076156 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74e8149dd0 con 0x7f74d4003b30 2023-11-04T01:44:16.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.918+0000 7f74ddffb640 1 -- 172.21.15.77:0/797076156 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f74e8149dd0 con 0x7f74d4003b30 2023-11-04T01:44:16.920 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:44:16.920 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":56,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":35840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2908314953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2908314953},{"type":"v1","addr":"172.21.15.122:6836","nonce":2908314953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:44:14.265873+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7302,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7302":{"gid":7302,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":17,"addr":"172.21.15.77:6834/4241784871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4241784871},{"type":"v1","addr":"172.21.15.77:6834","nonce":4241784871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:16.921 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 56 2023-11-04T01:44:16.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.920+0000 7f74ef7e2640 1 -- 172.21.15.77:0/797076156 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f74cc06aea0 msgr2=0x7f74cc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:16.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.920+0000 7f74ef7e2640 1 --2- 172.21.15.77:0/797076156 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f74cc06aea0 0x7f74cc06d360 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f74e814d200 tx=0x7f74e4009040 comp rx=0 tx=0).stop 2023-11-04T01:44:16.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.920+0000 7f74ef7e2640 1 -- 172.21.15.77:0/797076156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74d4003b30 msgr2=0x7f74e81f6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:16.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.920+0000 7f74ef7e2640 1 --2- 172.21.15.77:0/797076156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74d4003b30 0x7f74e81f6bd0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f74d8000f60 tx=0x7f74d80019f0 comp rx=0 tx=0).stop 2023-11-04T01:44:16.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.920+0000 7f74ef7e2640 1 -- 172.21.15.77:0/797076156 shutdown_connections 2023-11-04T01:44:16.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.920+0000 7f74ef7e2640 1 --2- 172.21.15.77:0/797076156 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f74cc06aea0 0x7f74cc06d360 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:16.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.920+0000 7f74ef7e2640 1 --2- 172.21.15.77:0/797076156 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f74e81499f0 0x7f74e80b3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:16.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.920+0000 7f74ef7e2640 1 --2- 172.21.15.77:0/797076156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74e81e1bb0 0x7f74e81494b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:16.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.920+0000 7f74ef7e2640 1 --2- 172.21.15.77:0/797076156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74d4003b30 0x7f74e81f6bd0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:16.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.920+0000 7f74ef7e2640 1 -- 172.21.15.77:0/797076156 >> 172.21.15.77:0/797076156 conn(0x7f74e80ce950 msgr2=0x7f74e80c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:16.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.920+0000 7f74ef7e2640 1 -- 172.21.15.77:0/797076156 shutdown_connections 2023-11-04T01:44:16.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:16.920+0000 7f74ef7e2640 1 -- 172.21.15.77:0/797076156 wait complete. 2023-11-04T01:44:16.932 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:44:16.932 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:17.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.030+0000 7f6a3a451640 1 Processor -- start 2023-11-04T01:44:17.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.030+0000 7f6a3a451640 1 -- start start 2023-11-04T01:44:17.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.031+0000 7f6a3a451640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6a34159c70 0x7f6a340ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.031+0000 7f6a3a451640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a3406db20 0x7f6a340b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.031+0000 7f6a3a451640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a340b4110 con 0x7f6a340b0910 2023-11-04T01:44:17.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.031+0000 7f6a3a451640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a340b49b0 con 0x7f6a34159c70 2023-11-04T01:44:17.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.031+0000 7f6a3a451640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a340b0da0 con 0x7f6a3406db20 2023-11-04T01:44:17.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.031+0000 7f6a389ee640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6a340b0910 0x7f6a3415d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:47914/0 (socket says 172.21.15.77:47914) 2023-11-04T01:44:17.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.031+0000 7f6a389ee640 1 -- 172.21.15.77:0/4178221338 learned_addr learned my addr 172.21.15.77:0/4178221338 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:44:17.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.031+0000 7f6a33fff640 1 --2- 172.21.15.77:0/4178221338 >> v2:172.21.15.122:3300/0 conn(0x7f6a34159c70 0x7f6a340ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.031+0000 7f6a337fe640 1 --2- 172.21.15.77:0/4178221338 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a3406db20 0x7f6a340b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.031+0000 7f6a32ffd640 1 -- 172.21.15.77:0/4178221338 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3535150710 0 0) 0x7f6a340b4110 con 0x7f6a340b0910 2023-11-04T01:44:17.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.032+0000 7f6a32ffd640 1 -- 172.21.15.77:0/4178221338 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a1c003520 con 0x7f6a340b0910 2023-11-04T01:44:17.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.032+0000 7f6a32ffd640 1 -- 172.21.15.77:0/4178221338 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2867276984 0 0) 0x7f6a1c003520 con 0x7f6a340b0910 2023-11-04T01:44:17.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.032+0000 7f6a32ffd640 1 -- 172.21.15.77:0/4178221338 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a3406db20 msgr2=0x7f6a340b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:17.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.032+0000 7f6a32ffd640 1 --2- 172.21.15.77:0/4178221338 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a3406db20 0x7f6a340b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.032+0000 7f6a32ffd640 1 -- 172.21.15.77:0/4178221338 >> v2:172.21.15.122:3300/0 conn(0x7f6a34159c70 msgr2=0x7f6a340ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:17.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.032+0000 7f6a32ffd640 1 --2- 172.21.15.77:0/4178221338 >> v2:172.21.15.122:3300/0 conn(0x7f6a34159c70 0x7f6a340ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.032+0000 7f6a32ffd640 1 -- 172.21.15.77:0/4178221338 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a340b43f0 con 0x7f6a340b0910 2023-11-04T01:44:17.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.032+0000 7f6a32ffd640 1 -- 172.21.15.77:0/4178221338 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f6a2c0019f0 con 0x7f6a340b0910 2023-11-04T01:44:17.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.032+0000 7f6a33fff640 1 --2- 172.21.15.77:0/4178221338 >> v2:172.21.15.122:3300/0 conn(0x7f6a34159c70 0x7f6a340ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:44:17.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.032+0000 7f6a32ffd640 1 -- 172.21.15.77:0/4178221338 >> v1:172.21.15.77:6789/0 conn(0x7f6a340b0910 legacy=0x7f6a3415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.032+0000 7f6a32ffd640 1 --2- 172.21.15.77:0/4178221338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a1c003970 0x7f6a1c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.032+0000 7f6a32ffd640 1 --2- 172.21.15.77:0/4178221338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a1c0047c0 0x7f6a1c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.032+0000 7f6a32ffd640 1 --2- 172.21.15.77:0/4178221338 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a3406db20 0x7f6a1c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.032+0000 7f6a32ffd640 1 -- 172.21.15.77:0/4178221338 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a340b49b0 con 0x7f6a1c003970 2023-11-04T01:44:17.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.032+0000 7f6a32ffd640 1 -- 172.21.15.77:0/4178221338 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a340b0da0 con 0x7f6a1c0047c0 2023-11-04T01:44:17.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.032+0000 7f6a32ffd640 1 -- 172.21.15.77:0/4178221338 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c00b980 con 0x7f6a3406db20 2023-11-04T01:44:17.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.032+0000 7f6a33fff640 1 --2- 172.21.15.77:0/4178221338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a1c003970 0x7f6a1c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.032+0000 7f6a337fe640 1 --2- 172.21.15.77:0/4178221338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a1c0047c0 0x7f6a1c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.032+0000 7f6a389ee640 1 --2- 172.21.15.77:0/4178221338 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a3406db20 0x7f6a1c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.032+0000 7f6a33fff640 1 -- 172.21.15.77:0/4178221338 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a3406db20 msgr2=0x7f6a1c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:17.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.032+0000 7f6a33fff640 1 --2- 172.21.15.77:0/4178221338 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a3406db20 0x7f6a1c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.032+0000 7f6a33fff640 1 -- 172.21.15.77:0/4178221338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a1c0047c0 msgr2=0x7f6a1c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:17.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.032+0000 7f6a33fff640 1 --2- 172.21.15.77:0/4178221338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a1c0047c0 0x7f6a1c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.032+0000 7f6a33fff640 1 -- 172.21.15.77:0/4178221338 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1c003520 con 0x7f6a1c003970 2023-11-04T01:44:17.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.033+0000 7f6a33fff640 1 --2- 172.21.15.77:0/4178221338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a1c003970 0x7f6a1c003d90 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f6a24009c90 tx=0x7f6a1c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d31b8c221ee00b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:17.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.033+0000 7f6a32ffd640 1 -- 172.21.15.77:0/4178221338 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2402c980 con 0x7f6a1c003970 2023-11-04T01:44:17.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.033+0000 7f6a32ffd640 1 -- 172.21.15.77:0/4178221338 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2402cae0 con 0x7f6a1c003970 2023-11-04T01:44:17.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.033+0000 7f6a32ffd640 1 -- 172.21.15.77:0/4178221338 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2402ce90 con 0x7f6a1c003970 2023-11-04T01:44:17.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.034+0000 7f6a3a451640 1 -- 172.21.15.77:0/4178221338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a1c003970 msgr2=0x7f6a1c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.034+0000 7f6a3a451640 1 --2- 172.21.15.77:0/4178221338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a1c003970 0x7f6a1c003d90 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f6a24009c90 tx=0x7f6a1c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.034+0000 7f6a389ee640 1 -- 172.21.15.77:0/4178221338 reap_dead start 2023-11-04T01:44:17.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.034+0000 7f6a3a451640 1 -- 172.21.15.77:0/4178221338 shutdown_connections 2023-11-04T01:44:17.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.034+0000 7f6a3a451640 1 -- 172.21.15.77:0/4178221338 >> 172.21.15.77:0/4178221338 conn(0x7f6a340ce950 msgr2=0x7f6a340ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:17.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.034+0000 7f6a3a451640 1 -- 172.21.15.77:0/4178221338 shutdown_connections 2023-11-04T01:44:17.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.034+0000 7f6a3a451640 1 -- 172.21.15.77:0/4178221338 wait complete. 2023-11-04T01:44:17.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.035+0000 7f6a3a451640 1 Processor -- start 2023-11-04T01:44:17.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.035+0000 7f6a3a451640 1 -- start start 2023-11-04T01:44:17.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.036+0000 7f6a3a451640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a1c003970 0x7f6a34153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.036+0000 7f6a3a451640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a34155d50 0x7f6a3414ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.036+0000 7f6a3a451640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a340ccec0 0x7f6a340cd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.036+0000 7f6a3a451640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a34155930 con 0x7f6a34155d50 2023-11-04T01:44:17.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.036+0000 7f6a3a451640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a340cd880 con 0x7f6a1c003970 2023-11-04T01:44:17.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.036+0000 7f6a3a451640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a34154cb0 con 0x7f6a340ccec0 2023-11-04T01:44:17.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.036+0000 7f6a337fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a34155d50 0x7f6a3414ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.036+0000 7f6a337fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a34155d50 0x7f6a3414ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41326/0 (socket says 172.21.15.77:41326) 2023-11-04T01:44:17.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.036+0000 7f6a337fe640 1 -- 172.21.15.77:0/321329034 learned_addr learned my addr 172.21.15.77:0/321329034 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:17.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.036+0000 7f6a337fe640 1 -- 172.21.15.77:0/321329034 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a340ccec0 msgr2=0x7f6a340cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.036+0000 7f6a337fe640 1 --2- 172.21.15.77:0/321329034 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a340ccec0 0x7f6a340cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.036+0000 7f6a337fe640 1 -- 172.21.15.77:0/321329034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a1c003970 msgr2=0x7f6a34153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.036+0000 7f6a337fe640 1 --2- 172.21.15.77:0/321329034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a1c003970 0x7f6a34153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.036+0000 7f6a337fe640 1 -- 172.21.15.77:0/321329034 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a34154f90 con 0x7f6a34155d50 2023-11-04T01:44:17.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.036+0000 7f6a337fe640 1 --2- 172.21.15.77:0/321329034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a34155d50 0x7f6a3414ac60 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f6a280119a0 tx=0x7f6a28011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:17.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.036+0000 7f6a30ff9640 1 -- 172.21.15.77:0/321329034 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2800fa90 con 0x7f6a34155d50 2023-11-04T01:44:17.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.036+0000 7f6a30ff9640 1 -- 172.21.15.77:0/321329034 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2800fbf0 con 0x7f6a34155d50 2023-11-04T01:44:17.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.036+0000 7f6a3a451640 1 -- 172.21.15.77:0/321329034 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a34155270 con 0x7f6a34155d50 2023-11-04T01:44:17.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.036+0000 7f6a30ff9640 1 -- 172.21.15.77:0/321329034 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a28014440 con 0x7f6a34155d50 2023-11-04T01:44:17.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.036+0000 7f6a3a451640 1 -- 172.21.15.77:0/321329034 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a3414b1a0 con 0x7f6a34155d50 2023-11-04T01:44:17.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.037+0000 7f6a3a451640 1 -- 172.21.15.77:0/321329034 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a34074290 con 0x7f6a34155d50 2023-11-04T01:44:17.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.038+0000 7f6a30ff9640 1 -- 172.21.15.77:0/321329034 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6a280145a0 con 0x7f6a34155d50 2023-11-04T01:44:17.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.038+0000 7f6a30ff9640 1 --2- 172.21.15.77:0/321329034 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6a2006aea0 0x7f6a2006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.038+0000 7f6a30ff9640 1 -- 172.21.15.77:0/321329034 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f6a2808a360 con 0x7f6a34155d50 2023-11-04T01:44:17.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.039+0000 7f6a33fff640 1 --2- 172.21.15.77:0/321329034 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6a2006aea0 0x7f6a2006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.039+0000 7f6a33fff640 1 --2- 172.21.15.77:0/321329034 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6a2006aea0 0x7f6a2006d360 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f6a24036000 tx=0x7f6a2402e000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:17.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.043+0000 7f6a30ff9640 1 -- 172.21.15.77:0/321329034 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6a28054e00 con 0x7f6a34155d50 2023-11-04T01:44:17.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.242+0000 7f6a3a451640 1 -- 172.21.15.77:0/321329034 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a3406d3f0 con 0x7f6a34155d50 2023-11-04T01:44:17.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.242+0000 7f6a30ff9640 1 -- 172.21.15.77:0/321329034 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f6a28058420 con 0x7f6a34155d50 2023-11-04T01:44:17.244 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:44:17.245 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":56,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":35840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2908314953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2908314953},{"type":"v1","addr":"172.21.15.122:6836","nonce":2908314953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:44:14.265873+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7302,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7302":{"gid":7302,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":17,"addr":"172.21.15.77:6834/4241784871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4241784871},{"type":"v1","addr":"172.21.15.77:6834","nonce":4241784871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:17.245 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 56 2023-11-04T01:44:17.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.244+0000 7f6a3a451640 1 -- 172.21.15.77:0/321329034 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6a2006aea0 msgr2=0x7f6a2006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.244+0000 7f6a3a451640 1 --2- 172.21.15.77:0/321329034 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6a2006aea0 0x7f6a2006d360 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f6a24036000 tx=0x7f6a2402e000 comp rx=0 tx=0).stop 2023-11-04T01:44:17.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.244+0000 7f6a3a451640 1 -- 172.21.15.77:0/321329034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a34155d50 msgr2=0x7f6a3414ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.244+0000 7f6a3a451640 1 --2- 172.21.15.77:0/321329034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a34155d50 0x7f6a3414ac60 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f6a280119a0 tx=0x7f6a28011e60 comp rx=0 tx=0).stop 2023-11-04T01:44:17.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.244+0000 7f6a3a451640 1 -- 172.21.15.77:0/321329034 shutdown_connections 2023-11-04T01:44:17.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.244+0000 7f6a3a451640 1 --2- 172.21.15.77:0/321329034 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6a2006aea0 0x7f6a2006d360 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.244+0000 7f6a3a451640 1 --2- 172.21.15.77:0/321329034 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a340ccec0 0x7f6a340cd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.244+0000 7f6a3a451640 1 --2- 172.21.15.77:0/321329034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a34155d50 0x7f6a3414ac60 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.244+0000 7f6a3a451640 1 --2- 172.21.15.77:0/321329034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a1c003970 0x7f6a34153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.244+0000 7f6a3a451640 1 -- 172.21.15.77:0/321329034 >> 172.21.15.77:0/321329034 conn(0x7f6a340ce950 msgr2=0x7f6a340ce090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:17.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.244+0000 7f6a3a451640 1 -- 172.21.15.77:0/321329034 shutdown_connections 2023-11-04T01:44:17.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.244+0000 7f6a3a451640 1 -- 172.21.15.77:0/321329034 wait complete. 2023-11-04T01:44:17.659 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-04T01:43:26.273417+0000', 'modified': '2023-11-04T01:44:14.265873+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 99, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7302, 'mds_1': 7305}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7302': {'gid': 7302, 'name': 'a', 'rank': 0, 'incarnation': 52, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.77:6834/4241784871', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6832', 'nonce': 4241784871}, {'type': 'v1', 'addr': '172.21.15.77:6834', 'nonce': 4241784871}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_7305': {'gid': 7305, 'name': 'c', 'rank': 1, 'incarnation': 46, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.77:6835/3207490604', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6833', 'nonce': 3207490604}, {'type': 'v1', 'addr': '172.21.15.77:6835', 'nonce': 3207490604}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:44:17.659 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-11-04T01:44:17.660 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-04T01:44:17.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.762+0000 7f35b674c640 1 Processor -- start 2023-11-04T01:44:17.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.762+0000 7f35b674c640 1 -- start start 2023-11-04T01:44:17.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.762+0000 7f35b674c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f35b00ca0a0 0x7f35b00cc920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.762+0000 7f35b674c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35b00caa20 con 0x7f35b015e3f0 2023-11-04T01:44:17.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.762+0000 7f35b674c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35b00cb230 con 0x7f35b00cc300 2023-11-04T01:44:17.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.762+0000 7f35b674c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35b00b3300 con 0x7f35b00ca0a0 2023-11-04T01:44:17.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.762+0000 7f35affff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f35b015e3f0 0x7f35b00b2bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:47242/0 (socket says 172.21.15.77:47242) 2023-11-04T01:44:17.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.762+0000 7f35affff640 1 -- 172.21.15.77:0/1137011621 learned_addr learned my addr 172.21.15.77:0/1137011621 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:44:17.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.763+0000 7f35aeffd640 1 -- 172.21.15.77:0/1137011621 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3130174618 0 0) 0x7f35b00caa20 con 0x7f35b015e3f0 2023-11-04T01:44:17.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.763+0000 7f35af7fe640 1 --2- 172.21.15.77:0/1137011621 >> v2:172.21.15.122:3300/0 conn(0x7f35b00ca0a0 0x7f35b00cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.763+0000 7f35aeffd640 1 -- 172.21.15.77:0/1137011621 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3598003520 con 0x7f35b015e3f0 2023-11-04T01:44:17.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.763+0000 7f35aeffd640 1 -- 172.21.15.77:0/1137011621 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2715612147 0 0) 0x7f3598003520 con 0x7f35b015e3f0 2023-11-04T01:44:17.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.763+0000 7f35aeffd640 1 -- 172.21.15.77:0/1137011621 >> v2:172.21.15.122:3300/0 conn(0x7f35b00ca0a0 msgr2=0x7f35b00cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:17.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.763+0000 7f35aeffd640 1 --2- 172.21.15.77:0/1137011621 >> v2:172.21.15.122:3300/0 conn(0x7f35b00ca0a0 0x7f35b00cc920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.763+0000 7f35aeffd640 1 -- 172.21.15.77:0/1137011621 >> v1:172.21.15.122:6789/0 conn(0x7f35b00cc300 legacy=0x7f35b00b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.763+0000 7f35aeffd640 1 -- 172.21.15.77:0/1137011621 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b00ca530 con 0x7f35b015e3f0 2023-11-04T01:44:17.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.763+0000 7f35aeffd640 1 -- 172.21.15.77:0/1137011621 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f35a0001670 con 0x7f35b015e3f0 2023-11-04T01:44:17.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.763+0000 7f35aeffd640 1 -- 172.21.15.77:0/1137011621 >> v1:172.21.15.77:6789/0 conn(0x7f35b015e3f0 legacy=0x7f35b00b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.763+0000 7f35aeffd640 1 --2- 172.21.15.77:0/1137011621 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3598003970 0x7f3598003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.763+0000 7f35aeffd640 1 --2- 172.21.15.77:0/1137011621 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f35980047c0 0x7f3598004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.763+0000 7f35aeffd640 1 --2- 172.21.15.77:0/1137011621 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3598005180 0x7f359800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.763+0000 7f35aeffd640 1 -- 172.21.15.77:0/1137011621 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b00b3300 con 0x7f3598003970 2023-11-04T01:44:17.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.763+0000 7f35aeffd640 1 -- 172.21.15.77:0/1137011621 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359800c020 con 0x7f3598005180 2023-11-04T01:44:17.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.763+0000 7f35aeffd640 1 -- 172.21.15.77:0/1137011621 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359800c1e0 con 0x7f35980047c0 2023-11-04T01:44:17.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.763+0000 7f35affff640 1 --2- 172.21.15.77:0/1137011621 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3598003970 0x7f3598003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.763+0000 7f35af7fe640 1 --2- 172.21.15.77:0/1137011621 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f35980047c0 0x7f3598004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.763+0000 7f35b4ce9640 1 --2- 172.21.15.77:0/1137011621 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3598005180 0x7f359800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.763+0000 7f35affff640 1 -- 172.21.15.77:0/1137011621 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f35980047c0 msgr2=0x7f3598004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:17.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.763+0000 7f35affff640 1 --2- 172.21.15.77:0/1137011621 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f35980047c0 0x7f3598004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.763+0000 7f35affff640 1 -- 172.21.15.77:0/1137011621 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3598005180 msgr2=0x7f359800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:17.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.763+0000 7f35affff640 1 --2- 172.21.15.77:0/1137011621 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3598005180 0x7f359800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.763+0000 7f35b4ce9640 1 -- 172.21.15.77:0/1137011621 reap_dead start 2023-11-04T01:44:17.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.763+0000 7f35affff640 1 -- 172.21.15.77:0/1137011621 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3598003520 con 0x7f3598003970 2023-11-04T01:44:17.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.764+0000 7f35affff640 1 --2- 172.21.15.77:0/1137011621 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3598003970 0x7f3598003d90 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f35a0007ca0 tx=0x7f35980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ef427d9a31340b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:17.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.764+0000 7f35aeffd640 1 -- 172.21.15.77:0/1137011621 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a00058d0 con 0x7f3598003970 2023-11-04T01:44:17.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.764+0000 7f35aeffd640 1 -- 172.21.15.77:0/1137011621 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a0005a30 con 0x7f3598003970 2023-11-04T01:44:17.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.764+0000 7f35aeffd640 1 -- 172.21.15.77:0/1137011621 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a0005e60 con 0x7f3598003970 2023-11-04T01:44:17.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.765+0000 7f35b674c640 1 -- 172.21.15.77:0/1137011621 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3598003970 msgr2=0x7f3598003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.765+0000 7f35b674c640 1 --2- 172.21.15.77:0/1137011621 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3598003970 0x7f3598003d90 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f35a0007ca0 tx=0x7f35980057f0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.765+0000 7f35b674c640 1 -- 172.21.15.77:0/1137011621 shutdown_connections 2023-11-04T01:44:17.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.765+0000 7f35b674c640 1 --2- 172.21.15.77:0/1137011621 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3598003970 0x7f3598003d90 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.765+0000 7f35b674c640 1 -- 172.21.15.77:0/1137011621 >> 172.21.15.77:0/1137011621 conn(0x7f35b0071820 msgr2=0x7f35b0071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:17.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.765+0000 7f35b674c640 1 -- 172.21.15.77:0/1137011621 shutdown_connections 2023-11-04T01:44:17.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.765+0000 7f35b674c640 1 -- 172.21.15.77:0/1137011621 wait complete. 2023-11-04T01:44:17.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.766+0000 7f35b674c640 1 Processor -- start 2023-11-04T01:44:17.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.766+0000 7f35b674c640 1 -- start start 2023-11-04T01:44:17.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.767+0000 7f35b674c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3598003970 0x7f35b014f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.767+0000 7f35b674c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35b01eea00 0x7f35b00c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.767+0000 7f35b674c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35b00c8e20 0x7f35b014e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.767+0000 7f35b674c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b01ef030 con 0x7f35b01eea00 2023-11-04T01:44:17.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.767+0000 7f35b674c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b00c4dd0 con 0x7f35b00c8e20 2023-11-04T01:44:17.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.767+0000 7f35b674c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b00c5070 con 0x7f3598003970 2023-11-04T01:44:17.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.767+0000 7f35af7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35b01eea00 0x7f35b00c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.767+0000 7f35af7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35b01eea00 0x7f35b00c5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52818/0 (socket says 172.21.15.77:52818) 2023-11-04T01:44:17.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.767+0000 7f35af7fe640 1 -- 172.21.15.77:0/2058118361 learned_addr learned my addr 172.21.15.77:0/2058118361 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:17.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.767+0000 7f35b4ce9640 1 --2- 172.21.15.77:0/2058118361 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35b00c8e20 0x7f35b014e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.767+0000 7f35affff640 1 --2- 172.21.15.77:0/2058118361 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3598003970 0x7f35b014f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.767+0000 7f35af7fe640 1 -- 172.21.15.77:0/2058118361 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3598003970 msgr2=0x7f35b014f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.767+0000 7f35af7fe640 1 --2- 172.21.15.77:0/2058118361 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3598003970 0x7f35b014f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.767+0000 7f35af7fe640 1 -- 172.21.15.77:0/2058118361 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35b00c8e20 msgr2=0x7f35b014e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.767+0000 7f35af7fe640 1 --2- 172.21.15.77:0/2058118361 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35b00c8e20 0x7f35b014e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.767+0000 7f35af7fe640 1 -- 172.21.15.77:0/2058118361 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b00c5350 con 0x7f35b01eea00 2023-11-04T01:44:17.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.767+0000 7f35af7fe640 1 --2- 172.21.15.77:0/2058118361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35b01eea00 0x7f35b00c5e30 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f35a40116d0 tx=0x7f35a4011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:17.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.768+0000 7f35acff9640 1 -- 172.21.15.77:0/2058118361 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a400f9c0 con 0x7f35b01eea00 2023-11-04T01:44:17.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.768+0000 7f35acff9640 1 -- 172.21.15.77:0/2058118361 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a400fb20 con 0x7f35b01eea00 2023-11-04T01:44:17.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.768+0000 7f35acff9640 1 -- 172.21.15.77:0/2058118361 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a400fe90 con 0x7f35b01eea00 2023-11-04T01:44:17.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.768+0000 7f35b674c640 1 -- 172.21.15.77:0/2058118361 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35b00c5630 con 0x7f35b01eea00 2023-11-04T01:44:17.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.768+0000 7f35b674c640 1 -- 172.21.15.77:0/2058118361 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35b00c37b0 con 0x7f35b01eea00 2023-11-04T01:44:17.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.769+0000 7f35acff9640 1 -- 172.21.15.77:0/2058118361 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f35a4015460 con 0x7f35b01eea00 2023-11-04T01:44:17.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.770+0000 7f35acff9640 1 --2- 172.21.15.77:0/2058118361 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f359c06ae70 0x7f359c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.770+0000 7f35acff9640 1 -- 172.21.15.77:0/2058118361 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f35a408a110 con 0x7f35b01eea00 2023-11-04T01:44:17.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.770+0000 7f35affff640 1 --2- 172.21.15.77:0/2058118361 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f359c06ae70 0x7f359c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.771+0000 7f35b93b3740 1 Processor -- start 2023-11-04T01:44:17.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.771+0000 7f35affff640 1 --2- 172.21.15.77:0/2058118361 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f359c06ae70 0x7f359c06d330 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f35a0038000 tx=0x7f35a0009030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:17.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.771+0000 7f35b93b3740 1 -- start start 2023-11-04T01:44:17.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.771+0000 7f35b93b3740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7da83850 0x555a7da56750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.771+0000 7f35b93b3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7da83c30 0x555a7da865e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.771+0000 7f35b93b3740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x555a7da56c90 0x555a7da86b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.771+0000 7f35b93b3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a7d967740 con 0x555a7da83c30 2023-11-04T01:44:17.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.771+0000 7f35b93b3740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a7d9c98d0 con 0x555a7da83850 2023-11-04T01:44:17.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.771+0000 7f35b93b3740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x555a7d9c6fc0 con 0x555a7da56c90 2023-11-04T01:44:17.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.771+0000 7f35af7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7da83c30 0x555a7da865e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.771+0000 7f35af7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7da83c30 0x555a7da865e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52832/0 (socket says 172.21.15.77:52832) 2023-11-04T01:44:17.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.771+0000 7f35af7fe640 1 -- 172.21.15.77:0/2364525720 learned_addr learned my addr 172.21.15.77:0/2364525720 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:17.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.771+0000 7f35affff640 1 --2- 172.21.15.77:0/2364525720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7da83850 0x555a7da56750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.772+0000 7f35b4ce9640 1 --2- 172.21.15.77:0/2364525720 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x555a7da56c90 0x555a7da86b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.772+0000 7f35af7fe640 1 -- 172.21.15.77:0/2364525720 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x555a7da56c90 msgr2=0x555a7da86b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:17.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.772+0000 7f35af7fe640 1 --2- 172.21.15.77:0/2364525720 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x555a7da56c90 0x555a7da86b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.772+0000 7f35af7fe640 1 -- 172.21.15.77:0/2364525720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7da83850 msgr2=0x555a7da56750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:17.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.772+0000 7f35af7fe640 1 --2- 172.21.15.77:0/2364525720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7da83850 0x555a7da56750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.772+0000 7f35af7fe640 1 -- 172.21.15.77:0/2364525720 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a7d985ca0 con 0x555a7da83c30 2023-11-04T01:44:17.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.772+0000 7f35af7fe640 1 --2- 172.21.15.77:0/2364525720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7da83c30 0x555a7da865e0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f35a4060640 tx=0x7f35a4058f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a56c606a46b401b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:17.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.772+0000 7f3595ffb640 1 -- 172.21.15.77:0/2364525720 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a4070170 con 0x555a7da83c30 2023-11-04T01:44:17.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.772+0000 7f3595ffb640 1 -- 172.21.15.77:0/2364525720 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a405c9c0 con 0x555a7da83c30 2023-11-04T01:44:17.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.772+0000 7f3595ffb640 1 -- 172.21.15.77:0/2364525720 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a4060b70 con 0x555a7da83c30 2023-11-04T01:44:17.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.772+0000 7f35b93b3740 1 -- 172.21.15.77:0/2364525720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7da83c30 msgr2=0x555a7da865e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.772+0000 7f35b93b3740 1 --2- 172.21.15.77:0/2364525720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7da83c30 0x555a7da865e0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f35a4060640 tx=0x7f35a4058f70 comp rx=0 tx=0).stop 2023-11-04T01:44:17.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.772+0000 7f35b93b3740 1 -- 172.21.15.77:0/2364525720 shutdown_connections 2023-11-04T01:44:17.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.772+0000 7f35b93b3740 1 --2- 172.21.15.77:0/2364525720 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x555a7da56c90 0x555a7da86b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.772+0000 7f35b93b3740 1 --2- 172.21.15.77:0/2364525720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7da83c30 0x555a7da865e0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.772+0000 7f35b93b3740 1 --2- 172.21.15.77:0/2364525720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7da83850 0x555a7da56750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.772+0000 7f35b93b3740 1 -- 172.21.15.77:0/2364525720 >> 172.21.15.77:0/2364525720 conn(0x555a7da58a60 msgr2=0x555a7daa15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:17.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.773+0000 7f35b93b3740 1 -- 172.21.15.77:0/2364525720 shutdown_connections 2023-11-04T01:44:17.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.773+0000 7f35b93b3740 1 -- 172.21.15.77:0/2364525720 wait complete. 2023-11-04T01:44:17.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.773+0000 7f35b93b3740 1 -- start start 2023-11-04T01:44:17.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.773+0000 7f35b93b3740 1 Processor -- start 2023-11-04T01:44:17.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.774+0000 7f35b93b3740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x555a7da83850 0x555a7da9c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.774+0000 7f35b93b3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7da83c30 0x555a7da9b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.774+0000 7f35b93b3740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7da9bc10 0x555a7da9b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.774+0000 7f35b93b3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a7d9c28b0 con 0x555a7da83c30 2023-11-04T01:44:17.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.774+0000 7f35b93b3740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a7d97cc80 con 0x555a7da9bc10 2023-11-04T01:44:17.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.774+0000 7f35b93b3740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x555a7d97c920 con 0x555a7da83850 2023-11-04T01:44:17.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.774+0000 7f35b93b3740 10 client.0 _ll_register_callbacks cb 0x555a7d6d4ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:44:17.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.774+0000 7f35af7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7da83c30 0x555a7da9b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.774+0000 7f35af7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7da83c30 0x555a7da9b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52846/0 (socket says 172.21.15.77:52846) 2023-11-04T01:44:17.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.774+0000 7f35af7fe640 1 -- 172.21.15.77:0/77564218 learned_addr learned my addr 172.21.15.77:0/77564218 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:17.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.774+0000 7f35affff640 1 --2- 172.21.15.77:0/77564218 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x555a7da83850 0x555a7da9c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.774+0000 7f35b4ce9640 1 --2- 172.21.15.77:0/77564218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7da9bc10 0x555a7da9b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.774+0000 7f35af7fe640 1 -- 172.21.15.77:0/77564218 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x555a7da83850 msgr2=0x555a7da9c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:17.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.774+0000 7f35af7fe640 1 --2- 172.21.15.77:0/77564218 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x555a7da83850 0x555a7da9c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.774+0000 7f35af7fe640 1 -- 172.21.15.77:0/77564218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7da9bc10 msgr2=0x555a7da9b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:17.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.774+0000 7f35af7fe640 1 --2- 172.21.15.77:0/77564218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7da9bc10 0x555a7da9b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.774+0000 7f35af7fe640 1 -- 172.21.15.77:0/77564218 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35b00c37b0 con 0x555a7da83c30 2023-11-04T01:44:17.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.775+0000 7f35af7fe640 1 --2- 172.21.15.77:0/77564218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7da83c30 0x555a7da9b050 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f35a4054d20 tx=0x7f35a408a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37df589b70e7ec0f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:17.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.775+0000 7f358effd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:44:17.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.775+0000 7f358effd640 1 -- 172.21.15.77:0/77564218 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a4070170 con 0x555a7da83c30 2023-11-04T01:44:17.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.775+0000 7f358effd640 1 -- 172.21.15.77:0/77564218 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f35a4060b70 con 0x555a7da83c30 2023-11-04T01:44:17.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.775+0000 7f35b93b3740 1 -- 172.21.15.77:0/77564218 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555a7d96ebf0 con 0x555a7da83c30 2023-11-04T01:44:17.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.775+0000 7f358effd640 1 -- 172.21.15.77:0/77564218 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35a40606e0 con 0x555a7da83c30 2023-11-04T01:44:17.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.775+0000 7f35b93b3740 10 client.7671 fetch_fsmap learned FSMap version 56 2023-11-04T01:44:17.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.775+0000 7f35b93b3740 1 -- 172.21.15.77:0/77564218 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x555a7d9c0f30 con 0x555a7da83c30 2023-11-04T01:44:17.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.775+0000 7f358effd640 1 -- 172.21.15.77:0/77564218 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555a7d96ebf0 con 0x555a7da83c30 2023-11-04T01:44:17.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.775+0000 7f358effd640 1 -- 172.21.15.77:0/77564218 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 56) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f35a401b020 con 0x555a7da83c30 2023-11-04T01:44:17.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.775+0000 7f35b93b3740 10 client.7671 fetch_fsmap finished waiting for FSMap version 56 2023-11-04T01:44:17.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.775+0000 7f35b93b3740 10 client.7671 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:44:17.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.775+0000 7f35b93b3740 20 client.7671 populate_metadata read hostname 'smithi077' 2023-11-04T01:44:17.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.775+0000 7f35b93b3740 1 --2- 172.21.15.77:0/77564218 >> [v2:172.21.15.77:6832/4241784871,v1:172.21.15.77:6834/4241784871] conn(0x555a7da89d10 0x555a7dabedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.775+0000 7f35b93b3740 4 client.7671 mds_command: new command op to 7302 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:44:17.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.775+0000 7f35b93b3740 1 -- 172.21.15.77:0/77564218 --> [v2:172.21.15.77:6832/4241784871,v1:172.21.15.77:6834/4241784871] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555a7d9bb890 con 0x555a7da89d10 2023-11-04T01:44:17.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.775+0000 7f35affff640 1 --2- 172.21.15.77:0/77564218 >> [v2:172.21.15.77:6832/4241784871,v1:172.21.15.77:6834/4241784871] conn(0x555a7da89d10 0x555a7dabedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.775+0000 7f358effd640 10 client.7671 ms_handle_connect on v2:172.21.15.77:6832/4241784871 2023-11-04T01:44:17.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.775+0000 7f35affff640 1 --2- 172.21.15.77:0/77564218 >> [v2:172.21.15.77:6832/4241784871,v1:172.21.15.77:6834/4241784871] conn(0x555a7da89d10 0x555a7dabedd0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dacfb6bb8a9035a2 server_cookie=15fca9fc26056f0c in_seq=0 out_seq=0 2023-11-04T01:44:17.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.776+0000 7f358effd640 1 -- 172.21.15.77:0/77564218 <== mds.0 v2:172.21.15.77:6832/4241784871 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555a7d9bb890 con 0x555a7da89d10 2023-11-04T01:44:17.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.776+0000 7f358effd640 10 client.7671 handle_command_reply: tid=0 2023-11-04T01:44:17.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.776+0000 7f35b93b3740 1 client.7671 shutdown 2023-11-04T01:44:17.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.776+0000 7f35b93b3740 1 -- 172.21.15.77:0/77564218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7da83c30 msgr2=0x555a7da9b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.776+0000 7f35b93b3740 1 --2- 172.21.15.77:0/77564218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7da83c30 0x555a7da9b050 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f35a4054d20 tx=0x7f35a408a040 comp rx=0 tx=0).stop 2023-11-04T01:44:17.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.776+0000 7f35b93b3740 1 -- 172.21.15.77:0/77564218 shutdown_connections 2023-11-04T01:44:17.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.776+0000 7f35b93b3740 1 --2- 172.21.15.77:0/77564218 >> [v2:172.21.15.77:6832/4241784871,v1:172.21.15.77:6834/4241784871] conn(0x555a7da89d10 0x555a7dabedd0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.776+0000 7f35b93b3740 1 --2- 172.21.15.77:0/77564218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7da9bc10 0x555a7da9b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.776+0000 7f35b93b3740 1 --2- 172.21.15.77:0/77564218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7da83c30 0x555a7da9b050 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.776+0000 7f35b93b3740 1 --2- 172.21.15.77:0/77564218 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x555a7da83850 0x555a7da9c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.776+0000 7f358effd640 0 client.7671 ms_handle_reset on v2:172.21.15.77:6832/4241784871 2023-11-04T01:44:17.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.776+0000 7f35b93b3740 1 -- 172.21.15.77:0/77564218 >> 172.21.15.77:0/77564218 conn(0x555a7da56c90 msgr2=0x555a7da5a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:17.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.776+0000 7f35b93b3740 1 -- 172.21.15.77:0/77564218 shutdown_connections 2023-11-04T01:44:17.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.776+0000 7f35b93b3740 1 -- 172.21.15.77:0/77564218 wait complete. 2023-11-04T01:44:17.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.776+0000 7f35b93b3740 20 client.7671 trim_cache size 0 max 16384 2023-11-04T01:44:17.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.792+0000 7f35b93b3740 1 Processor -- start 2023-11-04T01:44:17.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.792+0000 7f35b93b3740 1 -- start start 2023-11-04T01:44:17.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.792+0000 7f35b93b3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7da83850 0x555a7daa53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.792+0000 7f35b93b3740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7da83c30 0x555a7da9d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.792+0000 7f35b93b3740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x555a7da9bc10 0x555a7da82620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.792+0000 7f35b93b3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a7da8a460 con 0x555a7da83850 2023-11-04T01:44:17.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.792+0000 7f35b93b3740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a7d942280 con 0x555a7da83c30 2023-11-04T01:44:17.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.792+0000 7f35b93b3740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x555a7da9b740 con 0x555a7da9bc10 2023-11-04T01:44:17.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.793+0000 7f35affff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7da83850 0x555a7daa53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.793+0000 7f35affff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7da83850 0x555a7daa53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52858/0 (socket says 172.21.15.77:52858) 2023-11-04T01:44:17.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.793+0000 7f35affff640 1 -- 172.21.15.77:0/3004466773 learned_addr learned my addr 172.21.15.77:0/3004466773 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:17.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.793+0000 7f35af7fe640 1 --2- 172.21.15.77:0/3004466773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7da83c30 0x555a7da9d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.793+0000 7f35b4ce9640 1 --2- 172.21.15.77:0/3004466773 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x555a7da9bc10 0x555a7da82620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.793+0000 7f35affff640 1 -- 172.21.15.77:0/3004466773 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x555a7da9bc10 msgr2=0x555a7da82620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:17.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.793+0000 7f35affff640 1 --2- 172.21.15.77:0/3004466773 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x555a7da9bc10 0x555a7da82620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.793+0000 7f35affff640 1 -- 172.21.15.77:0/3004466773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7da83c30 msgr2=0x555a7da9d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:17.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.793+0000 7f35affff640 1 --2- 172.21.15.77:0/3004466773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7da83c30 0x555a7da9d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.793+0000 7f35affff640 1 -- 172.21.15.77:0/3004466773 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a7d95ed10 con 0x555a7da83850 2023-11-04T01:44:17.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.793+0000 7f35af7fe640 1 --2- 172.21.15.77:0/3004466773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7da83c30 0x555a7da9d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:17.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.793+0000 7f35affff640 1 --2- 172.21.15.77:0/3004466773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7da83850 0x555a7daa53f0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f35a0001930 tx=0x7f35a0007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaac774616e6087e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:17.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.793+0000 7f35967fc640 1 -- 172.21.15.77:0/3004466773 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a0059070 con 0x555a7da83850 2023-11-04T01:44:17.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.793+0000 7f35967fc640 1 -- 172.21.15.77:0/3004466773 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a0007070 con 0x555a7da83850 2023-11-04T01:44:17.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.793+0000 7f35967fc640 1 -- 172.21.15.77:0/3004466773 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a0040040 con 0x555a7da83850 2023-11-04T01:44:17.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.793+0000 7f35b93b3740 1 -- 172.21.15.77:0/3004466773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7da83850 msgr2=0x555a7daa53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.793+0000 7f35b93b3740 1 --2- 172.21.15.77:0/3004466773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7da83850 0x555a7daa53f0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f35a0001930 tx=0x7f35a0007000 comp rx=0 tx=0).stop 2023-11-04T01:44:17.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.793+0000 7f35b93b3740 1 -- 172.21.15.77:0/3004466773 shutdown_connections 2023-11-04T01:44:17.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.793+0000 7f35b93b3740 1 --2- 172.21.15.77:0/3004466773 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x555a7da9bc10 0x555a7da82620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.793+0000 7f35b93b3740 1 --2- 172.21.15.77:0/3004466773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7da83c30 0x555a7da9d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.793+0000 7f35b93b3740 1 --2- 172.21.15.77:0/3004466773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7da83850 0x555a7daa53f0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.794+0000 7f35b93b3740 1 -- 172.21.15.77:0/3004466773 >> 172.21.15.77:0/3004466773 conn(0x555a7da56c90 msgr2=0x555a7da98930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:17.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.794+0000 7f35b93b3740 1 -- 172.21.15.77:0/3004466773 shutdown_connections 2023-11-04T01:44:17.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.794+0000 7f35b93b3740 1 -- 172.21.15.77:0/3004466773 wait complete. 2023-11-04T01:44:17.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.794+0000 7f35b93b3740 1 -- start start 2023-11-04T01:44:17.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.794+0000 7f35b93b3740 1 Processor -- start 2023-11-04T01:44:17.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.795+0000 7f35b93b3740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7da83850 0x555a7da83030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.795+0000 7f35b93b3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7da83c30 0x555a7db0bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.795+0000 7f35b93b3740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x555a7da9bc10 0x555a7da98a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.795+0000 7f35b93b3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a7da731b0 con 0x555a7da83c30 2023-11-04T01:44:17.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.795+0000 7f35b93b3740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a7db0c690 con 0x555a7da83850 2023-11-04T01:44:17.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.795+0000 7f35b93b3740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x555a7dab43c0 con 0x555a7da9bc10 2023-11-04T01:44:17.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.795+0000 7f35b93b3740 10 client.0 _ll_register_callbacks cb 0x7f35a4054bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:44:17.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.795+0000 7f35af7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7da83c30 0x555a7db0bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.795+0000 7f35af7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7da83c30 0x555a7db0bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52866/0 (socket says 172.21.15.77:52866) 2023-11-04T01:44:17.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.795+0000 7f35af7fe640 1 -- 172.21.15.77:0/3753156106 learned_addr learned my addr 172.21.15.77:0/3753156106 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:17.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.795+0000 7f35affff640 1 --2- 172.21.15.77:0/3753156106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7da83850 0x555a7da83030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.795+0000 7f35b4ce9640 1 --2- 172.21.15.77:0/3753156106 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x555a7da9bc10 0x555a7da98a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.795+0000 7f35af7fe640 1 -- 172.21.15.77:0/3753156106 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x555a7da9bc10 msgr2=0x555a7da98a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:17.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.795+0000 7f35af7fe640 1 --2- 172.21.15.77:0/3753156106 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x555a7da9bc10 0x555a7da98a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.795+0000 7f35af7fe640 1 -- 172.21.15.77:0/3753156106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7da83850 msgr2=0x555a7da83030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:17.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.795+0000 7f35af7fe640 1 --2- 172.21.15.77:0/3753156106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7da83850 0x555a7da83030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.795+0000 7f35af7fe640 1 -- 172.21.15.77:0/3753156106 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a004e040 con 0x555a7da83c30 2023-11-04T01:44:17.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.795+0000 7f35b4ce9640 1 --2- 172.21.15.77:0/3753156106 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x555a7da9bc10 0x555a7da98a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:17.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.795+0000 7f35af7fe640 1 --2- 172.21.15.77:0/3753156106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7da83c30 0x555a7db0bc10 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f35a40116a0 tx=0x7f35a401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5d95897892c8e23 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:17.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.795+0000 7f358effd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:44:17.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.796+0000 7f358effd640 1 -- 172.21.15.77:0/3753156106 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a40771f0 con 0x555a7da83c30 2023-11-04T01:44:17.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.796+0000 7f358effd640 1 -- 172.21.15.77:0/3753156106 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f35a4070170 con 0x555a7da83c30 2023-11-04T01:44:17.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.796+0000 7f35b93b3740 1 -- 172.21.15.77:0/3753156106 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f35a405c9c0 con 0x555a7da83c30 2023-11-04T01:44:17.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.796+0000 7f358effd640 1 -- 172.21.15.77:0/3753156106 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35a4060b70 con 0x555a7da83c30 2023-11-04T01:44:17.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.796+0000 7f35b93b3740 10 client.7677 fetch_fsmap learned FSMap version 56 2023-11-04T01:44:17.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.796+0000 7f35b93b3740 1 -- 172.21.15.77:0/3753156106 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x555a7d984500 con 0x555a7da83c30 2023-11-04T01:44:17.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.796+0000 7f358effd640 1 -- 172.21.15.77:0/3753156106 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a405c9c0 con 0x555a7da83c30 2023-11-04T01:44:17.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.796+0000 7f358effd640 1 -- 172.21.15.77:0/3753156106 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 56) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f35a40577d0 con 0x555a7da83c30 2023-11-04T01:44:17.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.796+0000 7f35b93b3740 10 client.7677 fetch_fsmap finished waiting for FSMap version 56 2023-11-04T01:44:17.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.796+0000 7f35b93b3740 10 client.7677 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:44:17.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.796+0000 7f35b93b3740 20 client.7677 populate_metadata read hostname 'smithi077' 2023-11-04T01:44:17.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.796+0000 7f35b93b3740 1 --2- 172.21.15.77:0/3753156106 >> [v2:172.21.15.77:6832/4241784871,v1:172.21.15.77:6834/4241784871] conn(0x555a7dab3710 0x555a7dab3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.796+0000 7f35b93b3740 4 client.7677 mds_command: new command op to 7302 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:44:17.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.796+0000 7f35b93b3740 1 -- 172.21.15.77:0/3753156106 --> [v2:172.21.15.77:6832/4241784871,v1:172.21.15.77:6834/4241784871] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555a7d9bb5b0 con 0x555a7dab3710 2023-11-04T01:44:17.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.796+0000 7f35affff640 1 --2- 172.21.15.77:0/3753156106 >> [v2:172.21.15.77:6832/4241784871,v1:172.21.15.77:6834/4241784871] conn(0x555a7dab3710 0x555a7dab3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.796+0000 7f358effd640 10 client.7677 ms_handle_connect on v2:172.21.15.77:6832/4241784871 2023-11-04T01:44:17.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.796+0000 7f35affff640 1 --2- 172.21.15.77:0/3753156106 >> [v2:172.21.15.77:6832/4241784871,v1:172.21.15.77:6834/4241784871] conn(0x555a7dab3710 0x555a7dab3af0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d6d13b2929e13a5 server_cookie=697e496e9e1679e5 in_seq=0 out_seq=0 2023-11-04T01:44:17.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.797+0000 7f358effd640 1 -- 172.21.15.77:0/3753156106 <== mds.0 v2:172.21.15.77:6832/4241784871 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x555a7d9bb5b0 con 0x555a7dab3710 2023-11-04T01:44:17.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.797+0000 7f358effd640 10 client.7677 handle_command_reply: tid=0 2023-11-04T01:44:17.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.797+0000 7f35b93b3740 1 client.7677 shutdown 2023-11-04T01:44:17.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.797+0000 7f35b93b3740 1 -- 172.21.15.77:0/3753156106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7da83c30 msgr2=0x555a7db0bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.797+0000 7f35b93b3740 1 --2- 172.21.15.77:0/3753156106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7da83c30 0x555a7db0bc10 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f35a40116a0 tx=0x7f35a401e000 comp rx=0 tx=0).stop 2023-11-04T01:44:17.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.797+0000 7f35b93b3740 1 -- 172.21.15.77:0/3753156106 shutdown_connections 2023-11-04T01:44:17.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.797+0000 7f35b93b3740 1 --2- 172.21.15.77:0/3753156106 >> [v2:172.21.15.77:6832/4241784871,v1:172.21.15.77:6834/4241784871] conn(0x555a7dab3710 0x555a7dab3af0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.797+0000 7f35b93b3740 1 --2- 172.21.15.77:0/3753156106 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x555a7da9bc10 0x555a7da98a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.797+0000 7f358effd640 0 client.7677 ms_handle_reset on v2:172.21.15.77:6832/4241784871 2023-11-04T01:44:17.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.797+0000 7f35b93b3740 1 --2- 172.21.15.77:0/3753156106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7da83c30 0x555a7db0bc10 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.797+0000 7f35b93b3740 1 --2- 172.21.15.77:0/3753156106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a7da83850 0x555a7da83030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.797+0000 7f35b93b3740 1 -- 172.21.15.77:0/3753156106 >> 172.21.15.77:0/3753156106 conn(0x555a7da56c90 msgr2=0x555a7da995f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:17.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.797+0000 7f35b93b3740 1 -- 172.21.15.77:0/3753156106 shutdown_connections 2023-11-04T01:44:17.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.797+0000 7f35b93b3740 1 -- 172.21.15.77:0/3753156106 wait complete. 2023-11-04T01:44:17.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.797+0000 7f35b93b3740 20 client.7677 trim_cache size 0 max 16384 2023-11-04T01:44:17.828 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-04T01:44:17.829 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "0c22c75d-0169-41ef-b663-6ac1c5b0f71f", 2023-11-04T01:44:17.829 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 0, 2023-11-04T01:44:17.829 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 7302, 2023-11-04T01:44:17.829 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2023-11-04T01:44:17.829 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2023-11-04T01:44:17.829 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2023-11-04T01:44:17.830 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 6.5465990959999996, 2023-11-04T01:44:17.830 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 56, 2023-11-04T01:44:17.830 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 99, 2023-11-04T01:44:17.830 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 99, 2023-11-04T01:44:17.830 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 56.945656569999997 2023-11-04T01:44:17.831 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-04T01:44:17.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.797+0000 7f35b674c640 1 -- 172.21.15.77:0/2058118361 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f359c06ae70 msgr2=0x7f359c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.797+0000 7f35b674c640 1 --2- 172.21.15.77:0/2058118361 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f359c06ae70 0x7f359c06d330 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f35a0038000 tx=0x7f35a0009030 comp rx=0 tx=0).stop 2023-11-04T01:44:17.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.797+0000 7f35b674c640 1 -- 172.21.15.77:0/2058118361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35b01eea00 msgr2=0x7f35b00c5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.797+0000 7f35b674c640 1 --2- 172.21.15.77:0/2058118361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35b01eea00 0x7f35b00c5e30 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f35a40116d0 tx=0x7f35a4011b90 comp rx=0 tx=0).stop 2023-11-04T01:44:17.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.797+0000 7f35b674c640 1 -- 172.21.15.77:0/2058118361 shutdown_connections 2023-11-04T01:44:17.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.797+0000 7f35b674c640 1 --2- 172.21.15.77:0/2058118361 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f359c06ae70 0x7f359c06d330 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.797+0000 7f35b674c640 1 --2- 172.21.15.77:0/2058118361 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35b00c8e20 0x7f35b014e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.797+0000 7f35b674c640 1 --2- 172.21.15.77:0/2058118361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35b01eea00 0x7f35b00c5e30 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.797+0000 7f35b674c640 1 --2- 172.21.15.77:0/2058118361 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3598003970 0x7f35b014f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.797+0000 7f35b674c640 1 -- 172.21.15.77:0/2058118361 >> 172.21.15.77:0/2058118361 conn(0x7f35b0071820 msgr2=0x7f35b015a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:17.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.798+0000 7f35b674c640 1 -- 172.21.15.77:0/2058118361 shutdown_connections 2023-11-04T01:44:17.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.798+0000 7f35b674c640 1 -- 172.21.15.77:0/2058118361 wait complete. 2023-11-04T01:44:17.835 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-04T01:44:17.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.933+0000 7f16db373640 1 Processor -- start 2023-11-04T01:44:17.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.933+0000 7f16db373640 1 -- start start 2023-11-04T01:44:17.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.934+0000 7f16db373640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f16d40cd6d0 0x7f16d4161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.934+0000 7f16db373640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f16d40b4880 0x7f16d40b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.934+0000 7f16db373640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16d40cde60 con 0x7f16d4153e60 2023-11-04T01:44:17.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.934+0000 7f16db373640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16d4160f90 con 0x7f16d40b4880 2023-11-04T01:44:17.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.934+0000 7f16db373640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d40b51e0 con 0x7f16d40cd6d0 2023-11-04T01:44:17.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.934+0000 7f16d9910640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f16d40b4880 0x7f16d40b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.934+0000 7f16d9910640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f16d40b4880 0x7f16d40b4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52878/0 (socket says 172.21.15.77:52878) 2023-11-04T01:44:17.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.934+0000 7f16d9910640 1 -- 172.21.15.77:0/961729336 learned_addr learned my addr 172.21.15.77:0/961729336 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:17.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.935+0000 7f16d890e640 1 --2- 172.21.15.77:0/961729336 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f16d40cd6d0 0x7f16d4161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.935+0000 7f16d9910640 1 -- 172.21.15.77:0/961729336 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f16d40cd6d0 msgr2=0x7f16d4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:17.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.935+0000 7f16d9910640 1 --2- 172.21.15.77:0/961729336 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f16d40cd6d0 0x7f16d4161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.935+0000 7f16d9910640 1 -- 172.21.15.77:0/961729336 >> v1:172.21.15.122:6789/0 conn(0x7f16d4153e60 legacy=0x7f16d415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:17.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.935+0000 7f16d9910640 1 -- 172.21.15.77:0/961729336 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d4161960 con 0x7f16d40b4880 2023-11-04T01:44:17.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.935+0000 7f16d9910640 1 --2- 172.21.15.77:0/961729336 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16d40b4880 0x7f16d40b4ca0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f16cc009870 tx=0x7f16cc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff42c9b4f689c54a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:17.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.936+0000 7f16cbfff640 1 -- 172.21.15.77:0/961729336 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc031640 con 0x7f16d40b4880 2023-11-04T01:44:17.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.936+0000 7f16cbfff640 1 -- 172.21.15.77:0/961729336 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16cc0317a0 con 0x7f16d40b4880 2023-11-04T01:44:17.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.936+0000 7f16cbfff640 1 -- 172.21.15.77:0/961729336 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc031b30 con 0x7f16d40b4880 2023-11-04T01:44:17.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.936+0000 7f16db373640 1 -- 172.21.15.77:0/961729336 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16d40b4880 msgr2=0x7f16d40b4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.936+0000 7f16db373640 1 --2- 172.21.15.77:0/961729336 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16d40b4880 0x7f16d40b4ca0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f16cc009870 tx=0x7f16cc02b8f0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.936+0000 7f16db373640 1 -- 172.21.15.77:0/961729336 shutdown_connections 2023-11-04T01:44:17.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.936+0000 7f16db373640 1 --2- 172.21.15.77:0/961729336 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16d40b4880 0x7f16d40b4ca0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.936+0000 7f16db373640 1 --2- 172.21.15.77:0/961729336 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f16d40cd6d0 0x7f16d4161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.936+0000 7f16db373640 1 -- 172.21.15.77:0/961729336 >> 172.21.15.77:0/961729336 conn(0x7f16d40cf880 msgr2=0x7f16d40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:17.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.936+0000 7f16db373640 1 -- 172.21.15.77:0/961729336 shutdown_connections 2023-11-04T01:44:17.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.936+0000 7f16db373640 1 -- 172.21.15.77:0/961729336 wait complete. 2023-11-04T01:44:17.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.937+0000 7f16db373640 1 Processor -- start 2023-11-04T01:44:17.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.937+0000 7f16db373640 1 -- start start 2023-11-04T01:44:17.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.938+0000 7f16db373640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f16d40b4880 0x7f16d40c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.938+0000 7f16db373640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f16d40cd6d0 0x7f16d415f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.938+0000 7f16db373640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16d4153e60 0x7f16d415fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.938+0000 7f16db373640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d40c7940 con 0x7f16d4153e60 2023-11-04T01:44:17.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.938+0000 7f16db373640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d40c8950 con 0x7f16d40b4880 2023-11-04T01:44:17.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.938+0000 7f16db373640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d40c7b90 con 0x7f16d40cd6d0 2023-11-04T01:44:17.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.938+0000 7f16d9910640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16d4153e60 0x7f16d415fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.938+0000 7f16d9910640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16d4153e60 0x7f16d415fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52888/0 (socket says 172.21.15.77:52888) 2023-11-04T01:44:17.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.938+0000 7f16d9910640 1 -- 172.21.15.77:0/3616479999 learned_addr learned my addr 172.21.15.77:0/3616479999 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:17.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.938+0000 7f16d910f640 1 --2- 172.21.15.77:0/3616479999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f16d40b4880 0x7f16d40c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.938+0000 7f16d890e640 1 --2- 172.21.15.77:0/3616479999 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f16d40cd6d0 0x7f16d415f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.938+0000 7f16d9910640 1 -- 172.21.15.77:0/3616479999 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f16d40cd6d0 msgr2=0x7f16d415f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.938+0000 7f16d9910640 1 --2- 172.21.15.77:0/3616479999 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f16d40cd6d0 0x7f16d415f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.938+0000 7f16d9910640 1 -- 172.21.15.77:0/3616479999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f16d40b4880 msgr2=0x7f16d40c5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.938+0000 7f16d9910640 1 --2- 172.21.15.77:0/3616479999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f16d40b4880 0x7f16d40c5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.938+0000 7f16d9910640 1 -- 172.21.15.77:0/3616479999 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16cc0094d0 con 0x7f16d4153e60 2023-11-04T01:44:17.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.938+0000 7f16d890e640 1 --2- 172.21.15.77:0/3616479999 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f16d40cd6d0 0x7f16d415f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:17.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.939+0000 7f16d9910640 1 --2- 172.21.15.77:0/3616479999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16d4153e60 0x7f16d415fb20 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f16cc02b930 tx=0x7f16cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:17.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.939+0000 7f16c9ffb640 1 -- 172.21.15.77:0/3616479999 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc03ac60 con 0x7f16d4153e60 2023-11-04T01:44:17.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.939+0000 7f16c9ffb640 1 -- 172.21.15.77:0/3616479999 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16cc03ade0 con 0x7f16d4153e60 2023-11-04T01:44:17.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.939+0000 7f16db373640 1 -- 172.21.15.77:0/3616479999 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16d40c7e70 con 0x7f16d4153e60 2023-11-04T01:44:17.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.939+0000 7f16c9ffb640 1 -- 172.21.15.77:0/3616479999 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc044630 con 0x7f16d4153e60 2023-11-04T01:44:17.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.939+0000 7f16db373640 1 -- 172.21.15.77:0/3616479999 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d40c8430 con 0x7f16d4153e60 2023-11-04T01:44:17.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.940+0000 7f16c9ffb640 1 -- 172.21.15.77:0/3616479999 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f16cc02f050 con 0x7f16d4153e60 2023-11-04T01:44:17.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.941+0000 7f16c9ffb640 1 --2- 172.21.15.77:0/3616479999 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f16b806ae70 0x7f16b806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.941+0000 7f16c9ffb640 1 -- 172.21.15.77:0/3616479999 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f16cc0abd10 con 0x7f16d4153e60 2023-11-04T01:44:17.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.941+0000 7f16d910f640 1 --2- 172.21.15.77:0/3616479999 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f16b806ae70 0x7f16b806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.941+0000 7f16d910f640 1 --2- 172.21.15.77:0/3616479999 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f16b806ae70 0x7f16b806d330 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f16d0009f20 tx=0x7f16d00094d0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:17.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.942+0000 7f16ddfdf740 1 Processor -- start 2023-11-04T01:44:17.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.942+0000 7f16ddfdf740 1 -- start start 2023-11-04T01:44:17.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.942+0000 7f16ddfdf740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558845e7c850 0x558845e4f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.942+0000 7f16ddfdf740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558845e7cc30 0x558845e7f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.942+0000 7f16ddfdf740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558845e4fc90 0x558845e7fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.942+0000 7f16ddfdf740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x558845d60740 con 0x558845e7c850 2023-11-04T01:44:17.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.942+0000 7f16ddfdf740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x558845dc28d0 con 0x558845e4fc90 2023-11-04T01:44:17.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.942+0000 7f16ddfdf740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x558845dbffc0 con 0x558845e7cc30 2023-11-04T01:44:17.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.942+0000 7f16d910f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558845e7c850 0x558845e4f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.942+0000 7f16d910f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558845e7c850 0x558845e4f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52904/0 (socket says 172.21.15.77:52904) 2023-11-04T01:44:17.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.942+0000 7f16d910f640 1 -- 172.21.15.77:0/316351201 learned_addr learned my addr 172.21.15.77:0/316351201 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:17.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.943+0000 7f16d890e640 1 --2- 172.21.15.77:0/316351201 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558845e7cc30 0x558845e7f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.943+0000 7f16d9910640 1 --2- 172.21.15.77:0/316351201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558845e4fc90 0x558845e7fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.943+0000 7f16d910f640 1 -- 172.21.15.77:0/316351201 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558845e7cc30 msgr2=0x558845e7f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:17.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.943+0000 7f16d910f640 1 --2- 172.21.15.77:0/316351201 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558845e7cc30 0x558845e7f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.943+0000 7f16d910f640 1 -- 172.21.15.77:0/316351201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558845e4fc90 msgr2=0x558845e7fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:17.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.943+0000 7f16d910f640 1 --2- 172.21.15.77:0/316351201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558845e4fc90 0x558845e7fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.943+0000 7f16d910f640 1 -- 172.21.15.77:0/316351201 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558845d7eca0 con 0x558845e7c850 2023-11-04T01:44:17.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.943+0000 7f16d9910640 1 --2- 172.21.15.77:0/316351201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558845e4fc90 0x558845e7fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:17.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.943+0000 7f16d910f640 1 --2- 172.21.15.77:0/316351201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558845e7c850 0x558845e4f750 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f16d0017750 tx=0x7f16d0011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=762629582e31fe85 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:17.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.943+0000 7f16beffd640 1 -- 172.21.15.77:0/316351201 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d001c070 con 0x558845e7c850 2023-11-04T01:44:17.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.943+0000 7f16beffd640 1 -- 172.21.15.77:0/316351201 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d0017e00 con 0x558845e7c850 2023-11-04T01:44:17.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.943+0000 7f16beffd640 1 -- 172.21.15.77:0/316351201 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d0011070 con 0x558845e7c850 2023-11-04T01:44:17.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.943+0000 7f16ddfdf740 1 -- 172.21.15.77:0/316351201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558845e7c850 msgr2=0x558845e4f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.943+0000 7f16ddfdf740 1 --2- 172.21.15.77:0/316351201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558845e7c850 0x558845e4f750 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f16d0017750 tx=0x7f16d0011000 comp rx=0 tx=0).stop 2023-11-04T01:44:17.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.944+0000 7f16ddfdf740 1 -- 172.21.15.77:0/316351201 shutdown_connections 2023-11-04T01:44:17.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.944+0000 7f16ddfdf740 1 --2- 172.21.15.77:0/316351201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558845e4fc90 0x558845e7fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.944+0000 7f16ddfdf740 1 --2- 172.21.15.77:0/316351201 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558845e7cc30 0x558845e7f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.944+0000 7f16ddfdf740 1 --2- 172.21.15.77:0/316351201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558845e7c850 0x558845e4f750 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.944+0000 7f16ddfdf740 1 -- 172.21.15.77:0/316351201 >> 172.21.15.77:0/316351201 conn(0x558845e51a60 msgr2=0x558845e9a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:17.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.944+0000 7f16ddfdf740 1 -- 172.21.15.77:0/316351201 shutdown_connections 2023-11-04T01:44:17.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.944+0000 7f16ddfdf740 1 -- 172.21.15.77:0/316351201 wait complete. 2023-11-04T01:44:17.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.944+0000 7f16ddfdf740 1 -- start start 2023-11-04T01:44:17.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.944+0000 7f16ddfdf740 1 Processor -- start 2023-11-04T01:44:17.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.945+0000 7f16ddfdf740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558845e7c850 0x558845e81bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.945+0000 7f16ddfdf740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558845e7cc30 0x558845e79ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.945+0000 7f16ddfdf740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558845e7a4f0 0x558845eaa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.945+0000 7f16ddfdf740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x558845dbb8b0 con 0x558845e7c850 2023-11-04T01:44:17.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.945+0000 7f16ddfdf740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x558845d75c80 con 0x558845e7cc30 2023-11-04T01:44:17.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.945+0000 7f16ddfdf740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x558845d75920 con 0x558845e7a4f0 2023-11-04T01:44:17.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.945+0000 7f16ddfdf740 10 client.0 _ll_register_callbacks cb 0x558845acdac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:44:17.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.945+0000 7f16d910f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558845e7c850 0x558845e81bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.945+0000 7f16d910f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558845e7c850 0x558845e81bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52918/0 (socket says 172.21.15.77:52918) 2023-11-04T01:44:17.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.945+0000 7f16d910f640 1 -- 172.21.15.77:0/1245360586 learned_addr learned my addr 172.21.15.77:0/1245360586 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:17.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.945+0000 7f16d910f640 1 -- 172.21.15.77:0/1245360586 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558845e7a4f0 msgr2=0x558845eaa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:17.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.945+0000 7f16d910f640 1 --2- 172.21.15.77:0/1245360586 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558845e7a4f0 0x558845eaa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.945+0000 7f16d910f640 1 -- 172.21.15.77:0/1245360586 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558845e7cc30 msgr2=0x558845e79ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:17.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.945+0000 7f16d910f640 1 --2- 172.21.15.77:0/1245360586 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558845e7cc30 0x558845e79ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.945+0000 7f16d910f640 1 -- 172.21.15.77:0/1245360586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d0017430 con 0x558845e7c850 2023-11-04T01:44:17.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.946+0000 7f16d910f640 1 --2- 172.21.15.77:0/1245360586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558845e7c850 0x558845e81bf0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f16d0017c10 tx=0x7f16d0004a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=930879dad6d0acab server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:17.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.946+0000 7f16b3fff640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:44:17.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.946+0000 7f16b3fff640 1 -- 172.21.15.77:0/1245360586 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d0011040 con 0x558845e7c850 2023-11-04T01:44:17.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.946+0000 7f16b3fff640 1 -- 172.21.15.77:0/1245360586 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f16d0004430 con 0x558845e7c850 2023-11-04T01:44:17.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.946+0000 7f16ddfdf740 1 -- 172.21.15.77:0/1245360586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558845d67bf0 con 0x558845e7c850 2023-11-04T01:44:17.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.946+0000 7f16b3fff640 1 -- 172.21.15.77:0/1245360586 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16d00045f0 con 0x558845e7c850 2023-11-04T01:44:17.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.946+0000 7f16ddfdf740 10 client.7689 fetch_fsmap learned FSMap version 56 2023-11-04T01:44:17.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.946+0000 7f16ddfdf740 1 -- 172.21.15.77:0/1245360586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x558845db9f30 con 0x558845e7c850 2023-11-04T01:44:17.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.946+0000 7f16b3fff640 1 -- 172.21.15.77:0/1245360586 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558845d67bf0 con 0x558845e7c850 2023-11-04T01:44:17.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.946+0000 7f16b3fff640 1 -- 172.21.15.77:0/1245360586 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 56) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f16d0022420 con 0x558845e7c850 2023-11-04T01:44:17.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.946+0000 7f16ddfdf740 10 client.7689 fetch_fsmap finished waiting for FSMap version 56 2023-11-04T01:44:17.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.946+0000 7f16ddfdf740 10 client.7689 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:44:17.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.946+0000 7f16ddfdf740 20 client.7689 populate_metadata read hostname 'smithi077' 2023-11-04T01:44:17.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.946+0000 7f16ddfdf740 1 --2- 172.21.15.77:0/1245360586 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x558845eb5960 0x558845eb7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.946+0000 7f16ddfdf740 4 client.7689 mds_command: new command op to 7305 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:44:17.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.946+0000 7f16ddfdf740 1 -- 172.21.15.77:0/1245360586 --> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558845db4890 con 0x558845eb5960 2023-11-04T01:44:17.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.946+0000 7f16d890e640 1 --2- 172.21.15.77:0/1245360586 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x558845eb5960 0x558845eb7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.947+0000 7f16b3fff640 10 client.7689 ms_handle_connect on v2:172.21.15.77:6833/3207490604 2023-11-04T01:44:17.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.947+0000 7f16d890e640 1 --2- 172.21.15.77:0/1245360586 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x558845eb5960 0x558845eb7d50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=781cce62f5f21511 server_cookie=6192097aef12193c in_seq=0 out_seq=0 2023-11-04T01:44:17.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.947+0000 7f16b3fff640 1 -- 172.21.15.77:0/1245360586 <== mds.1 v2:172.21.15.77:6833/3207490604 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558845db4890 con 0x558845eb5960 2023-11-04T01:44:17.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.947+0000 7f16b3fff640 10 client.7689 handle_command_reply: tid=0 2023-11-04T01:44:17.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.947+0000 7f16ddfdf740 1 client.7689 shutdown 2023-11-04T01:44:17.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.947+0000 7f16ddfdf740 1 -- 172.21.15.77:0/1245360586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558845e7c850 msgr2=0x558845e81bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.947+0000 7f16ddfdf740 1 --2- 172.21.15.77:0/1245360586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558845e7c850 0x558845e81bf0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f16d0017c10 tx=0x7f16d0004a00 comp rx=0 tx=0).stop 2023-11-04T01:44:17.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.947+0000 7f16ddfdf740 1 -- 172.21.15.77:0/1245360586 shutdown_connections 2023-11-04T01:44:17.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.947+0000 7f16ddfdf740 1 --2- 172.21.15.77:0/1245360586 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558845e7a4f0 0x558845eaa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.947+0000 7f16ddfdf740 1 --2- 172.21.15.77:0/1245360586 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x558845eb5960 0x558845eb7d50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.947+0000 7f16ddfdf740 1 --2- 172.21.15.77:0/1245360586 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558845e7cc30 0x558845e79ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.947+0000 7f16ddfdf740 1 --2- 172.21.15.77:0/1245360586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558845e7c850 0x558845e81bf0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.947+0000 7f16b3fff640 0 client.7689 ms_handle_reset on v2:172.21.15.77:6833/3207490604 2023-11-04T01:44:17.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.947+0000 7f16ddfdf740 1 -- 172.21.15.77:0/1245360586 >> 172.21.15.77:0/1245360586 conn(0x558845e4fc90 msgr2=0x558845e536d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:17.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.947+0000 7f16ddfdf740 1 -- 172.21.15.77:0/1245360586 shutdown_connections 2023-11-04T01:44:17.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.947+0000 7f16ddfdf740 1 -- 172.21.15.77:0/1245360586 wait complete. 2023-11-04T01:44:17.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.948+0000 7f16ddfdf740 20 client.7689 trim_cache size 0 max 16384 2023-11-04T01:44:17.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.963+0000 7f16ddfdf740 1 Processor -- start 2023-11-04T01:44:17.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.963+0000 7f16ddfdf740 1 -- start start 2023-11-04T01:44:17.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.964+0000 7f16ddfdf740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558845e7a4f0 0x558845e79560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.964+0000 7f16ddfdf740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558845e7c850 0x558845e4e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.964+0000 7f16ddfdf740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558845e7cc30 0x558845ebbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.964+0000 7f16ddfdf740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x558845d3b280 con 0x558845e7a4f0 2023-11-04T01:44:17.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.964+0000 7f16ddfdf740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x558845e94c90 con 0x558845e7c850 2023-11-04T01:44:17.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.964+0000 7f16ddfdf740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x558845e837f0 con 0x558845e7cc30 2023-11-04T01:44:17.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.964+0000 7f16d910f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558845e7a4f0 0x558845e79560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.964+0000 7f16d910f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558845e7a4f0 0x558845e79560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52920/0 (socket says 172.21.15.77:52920) 2023-11-04T01:44:17.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.964+0000 7f16d910f640 1 -- 172.21.15.77:0/1072551164 learned_addr learned my addr 172.21.15.77:0/1072551164 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:17.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.964+0000 7f16d910f640 1 -- 172.21.15.77:0/1072551164 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558845e7cc30 msgr2=0x558845ebbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:17.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.964+0000 7f16d910f640 1 --2- 172.21.15.77:0/1072551164 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558845e7cc30 0x558845ebbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.964+0000 7f16d910f640 1 -- 172.21.15.77:0/1072551164 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558845e7c850 msgr2=0x558845e4e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:17.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.964+0000 7f16d890e640 1 --2- 172.21.15.77:0/1072551164 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558845e7c850 0x558845e4e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.964+0000 7f16d910f640 1 --2- 172.21.15.77:0/1072551164 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558845e7c850 0x558845e4e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.964+0000 7f16d910f640 1 -- 172.21.15.77:0/1072551164 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558845d57d10 con 0x558845e7a4f0 2023-11-04T01:44:17.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.964+0000 7f16d890e640 1 --2- 172.21.15.77:0/1072551164 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558845e7c850 0x558845e4e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:17.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.964+0000 7f16d910f640 1 --2- 172.21.15.77:0/1072551164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558845e7a4f0 0x558845e79560 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f16d0009650 tx=0x7f16d0027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=958b07c4df2c72e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:17.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.964+0000 7f16bf7fe640 1 -- 172.21.15.77:0/1072551164 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d0022420 con 0x558845e7a4f0 2023-11-04T01:44:17.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.964+0000 7f16bf7fe640 1 -- 172.21.15.77:0/1072551164 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d0022580 con 0x558845e7a4f0 2023-11-04T01:44:17.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.964+0000 7f16bf7fe640 1 -- 172.21.15.77:0/1072551164 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d0022d40 con 0x558845e7a4f0 2023-11-04T01:44:17.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.965+0000 7f16ddfdf740 1 -- 172.21.15.77:0/1072551164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558845e7a4f0 msgr2=0x558845e79560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.965+0000 7f16ddfdf740 1 --2- 172.21.15.77:0/1072551164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558845e7a4f0 0x558845e79560 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f16d0009650 tx=0x7f16d0027000 comp rx=0 tx=0).stop 2023-11-04T01:44:17.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.965+0000 7f16ddfdf740 1 -- 172.21.15.77:0/1072551164 shutdown_connections 2023-11-04T01:44:17.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.965+0000 7f16ddfdf740 1 --2- 172.21.15.77:0/1072551164 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558845e7cc30 0x558845ebbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.965+0000 7f16ddfdf740 1 --2- 172.21.15.77:0/1072551164 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558845e7c850 0x558845e4e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.965+0000 7f16ddfdf740 1 --2- 172.21.15.77:0/1072551164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558845e7a4f0 0x558845e79560 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.965+0000 7f16ddfdf740 1 -- 172.21.15.77:0/1072551164 >> 172.21.15.77:0/1072551164 conn(0x558845e4fc90 msgr2=0x558845e805d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:17.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.965+0000 7f16ddfdf740 1 -- 172.21.15.77:0/1072551164 shutdown_connections 2023-11-04T01:44:17.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.965+0000 7f16ddfdf740 1 -- 172.21.15.77:0/1072551164 wait complete. 2023-11-04T01:44:17.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.965+0000 7f16ddfdf740 1 -- start start 2023-11-04T01:44:17.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.965+0000 7f16ddfdf740 1 Processor -- start 2023-11-04T01:44:17.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.966+0000 7f16ddfdf740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558845e7a4f0 0x558845e9c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.966+0000 7f16ddfdf740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558845e7c850 0x558845e7f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.966+0000 7f16ddfdf740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558845e7cc30 0x558845f04ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.966+0000 7f16ddfdf740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x558845e7f560 con 0x558845e7cc30 2023-11-04T01:44:17.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.966+0000 7f16ddfdf740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x558845e7f990 con 0x558845e7a4f0 2023-11-04T01:44:17.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.966+0000 7f16ddfdf740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x558845e9dd80 con 0x558845e7c850 2023-11-04T01:44:17.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.966+0000 7f16ddfdf740 10 client.0 _ll_register_callbacks cb 0x7f16d0009680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:44:17.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.966+0000 7f16d9910640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558845e7cc30 0x558845f04ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.966+0000 7f16d9910640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558845e7cc30 0x558845f04ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52922/0 (socket says 172.21.15.77:52922) 2023-11-04T01:44:17.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.966+0000 7f16d9910640 1 -- 172.21.15.77:0/2815879327 learned_addr learned my addr 172.21.15.77:0/2815879327 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:17.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.967+0000 7f16d910f640 1 --2- 172.21.15.77:0/2815879327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558845e7a4f0 0x558845e9c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.967+0000 7f16d890e640 1 --2- 172.21.15.77:0/2815879327 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558845e7c850 0x558845e7f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.967+0000 7f16d9910640 1 -- 172.21.15.77:0/2815879327 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558845e7c850 msgr2=0x558845e7f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:17.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.967+0000 7f16d9910640 1 --2- 172.21.15.77:0/2815879327 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558845e7c850 0x558845e7f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.967+0000 7f16d9910640 1 -- 172.21.15.77:0/2815879327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558845e7a4f0 msgr2=0x558845e9c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:17.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.967+0000 7f16d9910640 1 --2- 172.21.15.77:0/2815879327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558845e7a4f0 0x558845e9c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.967+0000 7f16d9910640 1 -- 172.21.15.77:0/2815879327 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558845db9f30 con 0x558845e7cc30 2023-11-04T01:44:17.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.967+0000 7f16d910f640 1 --2- 172.21.15.77:0/2815879327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558845e7a4f0 0x558845e9c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:17.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.967+0000 7f16d9910640 1 --2- 172.21.15.77:0/2815879327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558845e7cc30 0x558845f04ef0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f16cc009870 tx=0x7f16cc02f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f15fe053d80a0d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:17.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.967+0000 7f16b3fff640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:44:17.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.967+0000 7f16b3fff640 1 -- 172.21.15.77:0/2815879327 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc07a9a0 con 0x558845e7cc30 2023-11-04T01:44:17.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.967+0000 7f16b3fff640 1 -- 172.21.15.77:0/2815879327 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f16cc07e690 con 0x558845e7cc30 2023-11-04T01:44:17.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.967+0000 7f16ddfdf740 1 -- 172.21.15.77:0/2815879327 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558845db45b0 con 0x558845e7cc30 2023-11-04T01:44:17.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.967+0000 7f16b3fff640 1 -- 172.21.15.77:0/2815879327 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16cc082840 con 0x558845e7cc30 2023-11-04T01:44:17.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.967+0000 7f16ddfdf740 10 client.7695 fetch_fsmap learned FSMap version 56 2023-11-04T01:44:17.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.967+0000 7f16ddfdf740 1 -- 172.21.15.77:0/2815879327 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x558845d7d500 con 0x558845e7cc30 2023-11-04T01:44:17.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.967+0000 7f16b3fff640 1 -- 172.21.15.77:0/2815879327 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558845db45b0 con 0x558845e7cc30 2023-11-04T01:44:17.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.967+0000 7f16b3fff640 1 -- 172.21.15.77:0/2815879327 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 56) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f16cc079a30 con 0x558845e7cc30 2023-11-04T01:44:17.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.967+0000 7f16ddfdf740 10 client.7695 fetch_fsmap finished waiting for FSMap version 56 2023-11-04T01:44:17.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.967+0000 7f16ddfdf740 10 client.7695 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:44:17.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.967+0000 7f16ddfdf740 20 client.7695 populate_metadata read hostname 'smithi077' 2023-11-04T01:44:17.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.967+0000 7f16ddfdf740 1 --2- 172.21.15.77:0/2815879327 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x558845e7abb0 0x558845e7af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.967+0000 7f16ddfdf740 4 client.7695 mds_command: new command op to 7305 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:44:17.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.967+0000 7f16ddfdf740 1 -- 172.21.15.77:0/2815879327 --> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558845abc6c0 con 0x558845e7abb0 2023-11-04T01:44:17.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.967+0000 7f16d910f640 1 --2- 172.21.15.77:0/2815879327 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x558845e7abb0 0x558845e7af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.968+0000 7f16b3fff640 10 client.7695 ms_handle_connect on v2:172.21.15.77:6833/3207490604 2023-11-04T01:44:17.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.968+0000 7f16d910f640 1 --2- 172.21.15.77:0/2815879327 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x558845e7abb0 0x558845e7af90 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9d66ab7c8970b47c server_cookie=69d9a74af9877180 in_seq=0 out_seq=0 2023-11-04T01:44:17.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.968+0000 7f16b3fff640 1 -- 172.21.15.77:0/2815879327 <== mds.1 v2:172.21.15.77:6833/3207490604 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x558845abc6c0 con 0x558845e7abb0 2023-11-04T01:44:17.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.968+0000 7f16b3fff640 10 client.7695 handle_command_reply: tid=0 2023-11-04T01:44:17.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.968+0000 7f16ddfdf740 1 client.7695 shutdown 2023-11-04T01:44:17.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.968+0000 7f16ddfdf740 1 -- 172.21.15.77:0/2815879327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558845e7cc30 msgr2=0x558845f04ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.968+0000 7f16ddfdf740 1 --2- 172.21.15.77:0/2815879327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558845e7cc30 0x558845f04ef0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f16cc009870 tx=0x7f16cc02f3c0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.968+0000 7f16ddfdf740 1 -- 172.21.15.77:0/2815879327 shutdown_connections 2023-11-04T01:44:17.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.968+0000 7f16ddfdf740 1 --2- 172.21.15.77:0/2815879327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558845e7cc30 0x558845f04ef0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.968+0000 7f16ddfdf740 1 --2- 172.21.15.77:0/2815879327 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558845e7c850 0x558845e7f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.968+0000 7f16ddfdf740 1 --2- 172.21.15.77:0/2815879327 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x558845e7abb0 0x558845e7af90 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.968+0000 7f16ddfdf740 1 --2- 172.21.15.77:0/2815879327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558845e7a4f0 0x558845e9c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.968+0000 7f16b3fff640 0 client.7695 ms_handle_reset on v2:172.21.15.77:6833/3207490604 2023-11-04T01:44:17.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.968+0000 7f16ddfdf740 1 -- 172.21.15.77:0/2815879327 >> 172.21.15.77:0/2815879327 conn(0x558845e4fc90 msgr2=0x558845e803c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:17.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.968+0000 7f16ddfdf740 1 -- 172.21.15.77:0/2815879327 shutdown_connections 2023-11-04T01:44:17.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.968+0000 7f16ddfdf740 1 -- 172.21.15.77:0/2815879327 wait complete. 2023-11-04T01:44:17.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.968+0000 7f16ddfdf740 20 client.7695 trim_cache size 0 max 16384 2023-11-04T01:44:17.997 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-04T01:44:17.997 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "0c22c75d-0169-41ef-b663-6ac1c5b0f71f", 2023-11-04T01:44:17.997 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 1, 2023-11-04T01:44:17.997 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 7305, 2023-11-04T01:44:17.998 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2023-11-04T01:44:17.998 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2023-11-04T01:44:17.998 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2023-11-04T01:44:17.998 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 41.364509793000003, 2023-11-04T01:44:17.998 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 56, 2023-11-04T01:44:17.999 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 99, 2023-11-04T01:44:17.999 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 99, 2023-11-04T01:44:17.999 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 57.116606007999998 2023-11-04T01:44:17.999 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-04T01:44:18.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.969+0000 7f16db373640 1 -- 172.21.15.77:0/3616479999 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f16b806ae70 msgr2=0x7f16b806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.969+0000 7f16db373640 1 --2- 172.21.15.77:0/3616479999 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f16b806ae70 0x7f16b806d330 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f16d0009f20 tx=0x7f16d00094d0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.969+0000 7f16db373640 1 -- 172.21.15.77:0/3616479999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16d4153e60 msgr2=0x7f16d415fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.969+0000 7f16db373640 1 --2- 172.21.15.77:0/3616479999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16d4153e60 0x7f16d415fb20 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f16cc02b930 tx=0x7f16cc0046c0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.969+0000 7f16db373640 1 -- 172.21.15.77:0/3616479999 shutdown_connections 2023-11-04T01:44:18.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.969+0000 7f16db373640 1 --2- 172.21.15.77:0/3616479999 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f16b806ae70 0x7f16b806d330 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.969+0000 7f16db373640 1 --2- 172.21.15.77:0/3616479999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16d4153e60 0x7f16d415fb20 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.969+0000 7f16db373640 1 --2- 172.21.15.77:0/3616479999 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f16d40cd6d0 0x7f16d415f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.969+0000 7f16db373640 1 --2- 172.21.15.77:0/3616479999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f16d40b4880 0x7f16d40c5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.969+0000 7f16db373640 1 -- 172.21.15.77:0/3616479999 >> 172.21.15.77:0/3616479999 conn(0x7f16d40cf880 msgr2=0x7f16d40d0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:18.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.969+0000 7f16db373640 1 -- 172.21.15.77:0/3616479999 shutdown_connections 2023-11-04T01:44:18.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:17.969+0000 7f16db373640 1 -- 172.21.15.77:0/3616479999 wait complete. 2023-11-04T01:44:18.003 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:18.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.101+0000 7f002e81a640 1 Processor -- start 2023-11-04T01:44:18.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.101+0000 7f002e81a640 1 -- start start 2023-11-04T01:44:18.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.101+0000 7f002e81a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f00280cde60 0x7f002815d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.101+0000 7f002e81a640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f002815daa0 0x7f0028157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.101+0000 7f002e81a640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f00280ce240 0x7f0028157540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.101+0000 7f002e81a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f002815e5c0 con 0x7f00280cde60 2023-11-04T01:44:18.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.101+0000 7f002e81a640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0028157a80 con 0x7f00280ce240 2023-11-04T01:44:18.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.101+0000 7f002e81a640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f002815e000 con 0x7f002815daa0 2023-11-04T01:44:18.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.102+0000 7f0027fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f00280cde60 0x7f002815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.102+0000 7f0027fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f00280cde60 0x7f002815d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52932/0 (socket says 172.21.15.77:52932) 2023-11-04T01:44:18.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.102+0000 7f0027fff640 1 -- 172.21.15.77:0/3644497992 learned_addr learned my addr 172.21.15.77:0/3644497992 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:18.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.102+0000 7f002cdb7640 1 --2- 172.21.15.77:0/3644497992 >> v2:172.21.15.122:3300/0 conn(0x7f00280ce240 0x7f0028157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.102+0000 7f00277fe640 1 --2- 172.21.15.77:0/3644497992 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f002815daa0 0x7f0028157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.102+0000 7f0027fff640 1 -- 172.21.15.77:0/3644497992 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f002815daa0 msgr2=0x7f0028157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:18.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.102+0000 7f0027fff640 1 --2- 172.21.15.77:0/3644497992 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f002815daa0 0x7f0028157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.102+0000 7f0027fff640 1 -- 172.21.15.77:0/3644497992 >> v2:172.21.15.122:3300/0 conn(0x7f00280ce240 msgr2=0x7f0028157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:18.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.102+0000 7f0027fff640 1 --2- 172.21.15.77:0/3644497992 >> v2:172.21.15.122:3300/0 conn(0x7f00280ce240 0x7f0028157540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.102+0000 7f0027fff640 1 -- 172.21.15.77:0/3644497992 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f002815e2e0 con 0x7f00280cde60 2023-11-04T01:44:18.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.103+0000 7f0027fff640 1 --2- 172.21.15.77:0/3644497992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00280cde60 0x7f002815d560 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f002815df30 tx=0x7f001802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bcfc116b9deaef5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:18.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.103+0000 7f0026ffd640 1 -- 172.21.15.77:0/3644497992 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0018031870 con 0x7f00280cde60 2023-11-04T01:44:18.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.103+0000 7f0026ffd640 1 -- 172.21.15.77:0/3644497992 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00180319d0 con 0x7f00280cde60 2023-11-04T01:44:18.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.103+0000 7f0026ffd640 1 -- 172.21.15.77:0/3644497992 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0018031d60 con 0x7f00280cde60 2023-11-04T01:44:18.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.103+0000 7f002e81a640 1 -- 172.21.15.77:0/3644497992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00280cde60 msgr2=0x7f002815d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.103+0000 7f002e81a640 1 --2- 172.21.15.77:0/3644497992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00280cde60 0x7f002815d560 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f002815df30 tx=0x7f001802b910 comp rx=0 tx=0).stop 2023-11-04T01:44:18.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.103+0000 7f002e81a640 1 -- 172.21.15.77:0/3644497992 shutdown_connections 2023-11-04T01:44:18.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.103+0000 7f002e81a640 1 --2- 172.21.15.77:0/3644497992 >> v2:172.21.15.122:3300/0 conn(0x7f00280ce240 0x7f0028157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.103+0000 7f002e81a640 1 --2- 172.21.15.77:0/3644497992 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f002815daa0 0x7f0028157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.103+0000 7f002e81a640 1 --2- 172.21.15.77:0/3644497992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00280cde60 0x7f002815d560 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.103+0000 7f002e81a640 1 -- 172.21.15.77:0/3644497992 >> 172.21.15.77:0/3644497992 conn(0x7f0028071f30 msgr2=0x7f00280cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:18.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.103+0000 7f002e81a640 1 -- 172.21.15.77:0/3644497992 shutdown_connections 2023-11-04T01:44:18.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.103+0000 7f002e81a640 1 -- 172.21.15.77:0/3644497992 wait complete. 2023-11-04T01:44:18.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.104+0000 7f002e81a640 1 Processor -- start 2023-11-04T01:44:18.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.105+0000 7f002e81a640 1 -- start start 2023-11-04T01:44:18.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.105+0000 7f002e81a640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00280cde60 0x7f002815aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.105+0000 7f002e81a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00280ce240 0x7f00280caf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.105+0000 7f002e81a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f002815daa0 0x7f00280cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.105+0000 7f002e81a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00281f2910 con 0x7f002815daa0 2023-11-04T01:44:18.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.105+0000 7f002e81a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00280cbb20 con 0x7f00280ce240 2023-11-04T01:44:18.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.105+0000 7f002e81a640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00280cbe00 con 0x7f00280cde60 2023-11-04T01:44:18.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.105+0000 7f002cdb7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f002815daa0 0x7f00280cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.105+0000 7f002cdb7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f002815daa0 0x7f00280cb480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52944/0 (socket says 172.21.15.77:52944) 2023-11-04T01:44:18.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.105+0000 7f002cdb7640 1 -- 172.21.15.77:0/2907126548 learned_addr learned my addr 172.21.15.77:0/2907126548 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:18.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.106+0000 7f00277fe640 1 --2- 172.21.15.77:0/2907126548 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00280ce240 0x7f00280caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.106+0000 7f002cdb7640 1 -- 172.21.15.77:0/2907126548 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00280cde60 msgr2=0x7f002815aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.106+0000 7f0027fff640 1 --2- 172.21.15.77:0/2907126548 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00280cde60 0x7f002815aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.106+0000 7f002cdb7640 1 --2- 172.21.15.77:0/2907126548 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00280cde60 0x7f002815aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.106+0000 7f002cdb7640 1 -- 172.21.15.77:0/2907126548 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00280ce240 msgr2=0x7f00280caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.106+0000 7f002cdb7640 1 --2- 172.21.15.77:0/2907126548 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00280ce240 0x7f00280caf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.106+0000 7f002cdb7640 1 -- 172.21.15.77:0/2907126548 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00180094d0 con 0x7f002815daa0 2023-11-04T01:44:18.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.106+0000 7f002cdb7640 1 --2- 172.21.15.77:0/2907126548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f002815daa0 0x7f00280cb480 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f002000ccf0 tx=0x7f002000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:18.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.106+0000 7f0024ff9640 1 -- 172.21.15.77:0/2907126548 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0020003b90 con 0x7f002815daa0 2023-11-04T01:44:18.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.106+0000 7f0024ff9640 1 -- 172.21.15.77:0/2907126548 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0020003cf0 con 0x7f002815daa0 2023-11-04T01:44:18.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.106+0000 7f002e81a640 1 -- 172.21.15.77:0/2907126548 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00280cc0e0 con 0x7f002815daa0 2023-11-04T01:44:18.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.106+0000 7f0024ff9640 1 -- 172.21.15.77:0/2907126548 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0020004240 con 0x7f002815daa0 2023-11-04T01:44:18.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.106+0000 7f002e81a640 1 -- 172.21.15.77:0/2907126548 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00280cc6a0 con 0x7f002815daa0 2023-11-04T01:44:18.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.107+0000 7f002e81a640 1 -- 172.21.15.77:0/2907126548 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0028074290 con 0x7f002815daa0 2023-11-04T01:44:18.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.108+0000 7f0024ff9640 1 -- 172.21.15.77:0/2907126548 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f00200043a0 con 0x7f002815daa0 2023-11-04T01:44:18.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.108+0000 7f0024ff9640 1 --2- 172.21.15.77:0/2907126548 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f001406ae70 0x7f001406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.108+0000 7f0024ff9640 1 -- 172.21.15.77:0/2907126548 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f0020012070 con 0x7f002815daa0 2023-11-04T01:44:18.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.108+0000 7f0027fff640 1 --2- 172.21.15.77:0/2907126548 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f001406ae70 0x7f001406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.109+0000 7f0027fff640 1 --2- 172.21.15.77:0/2907126548 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f001406ae70 0x7f001406d330 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f0018036000 tx=0x7f001803c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:18.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.112+0000 7f0024ff9640 1 -- 172.21.15.77:0/2907126548 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0020054fb0 con 0x7f002815daa0 2023-11-04T01:44:18.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.312+0000 7f002e81a640 1 -- 172.21.15.77:0/2907126548 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00280cc8c0 con 0x7f002815daa0 2023-11-04T01:44:18.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.312+0000 7f0024ff9640 1 -- 172.21.15.77:0/2907126548 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f00200585d0 con 0x7f002815daa0 2023-11-04T01:44:18.315 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:44:18.315 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":56,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":35840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2908314953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2908314953},{"type":"v1","addr":"172.21.15.122:6836","nonce":2908314953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:44:14.265873+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7302,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7302":{"gid":7302,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":17,"addr":"172.21.15.77:6834/4241784871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4241784871},{"type":"v1","addr":"172.21.15.77:6834","nonce":4241784871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:18.315 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 56 2023-11-04T01:44:18.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.314+0000 7f002e81a640 1 -- 172.21.15.77:0/2907126548 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f001406ae70 msgr2=0x7f001406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.314+0000 7f002e81a640 1 --2- 172.21.15.77:0/2907126548 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f001406ae70 0x7f001406d330 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f0018036000 tx=0x7f001803c040 comp rx=0 tx=0).stop 2023-11-04T01:44:18.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.314+0000 7f002e81a640 1 -- 172.21.15.77:0/2907126548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f002815daa0 msgr2=0x7f00280cb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.314+0000 7f002e81a640 1 --2- 172.21.15.77:0/2907126548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f002815daa0 0x7f00280cb480 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f002000ccf0 tx=0x7f002000a660 comp rx=0 tx=0).stop 2023-11-04T01:44:18.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.314+0000 7f002e81a640 1 -- 172.21.15.77:0/2907126548 shutdown_connections 2023-11-04T01:44:18.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.314+0000 7f002e81a640 1 --2- 172.21.15.77:0/2907126548 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f001406ae70 0x7f001406d330 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.314+0000 7f002e81a640 1 --2- 172.21.15.77:0/2907126548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f002815daa0 0x7f00280cb480 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.314+0000 7f002e81a640 1 --2- 172.21.15.77:0/2907126548 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00280ce240 0x7f00280caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.314+0000 7f002e81a640 1 --2- 172.21.15.77:0/2907126548 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f00280cde60 0x7f002815aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.314+0000 7f002e81a640 1 -- 172.21.15.77:0/2907126548 >> 172.21.15.77:0/2907126548 conn(0x7f0028071f30 msgr2=0x7f0028156530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:18.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.315+0000 7f002e81a640 1 -- 172.21.15.77:0/2907126548 shutdown_connections 2023-11-04T01:44:18.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.315+0000 7f002e81a640 1 -- 172.21.15.77:0/2907126548 wait complete. 2023-11-04T01:44:18.327 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump snaps --server 2023-11-04T01:44:18.439 INFO:teuthology.orchestra.run.smithi077.stdout:{"last_snap":2,"last_created":2,"last_destroyed":1,"pending_noop":[],"snaps":[{"snapid":2,"ino":1099511627777,"stamp":"2023-11-04T01:43:48.909834+0000","name":"s11","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:44:18.440 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 2, "last_destroyed": 1, "last_snap": 2, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s11", "snapid": 2, "stamp": "2023-11-04T01:43:48.909834+0000" } ] } 2023-11-04T01:44:18.441 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-04T01:44:18.441 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=2 2023-11-04T01:44:18.441 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:18.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.538+0000 7f7bd67a9640 1 Processor -- start 2023-11-04T01:44:18.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.538+0000 7f7bd67a9640 1 -- start start 2023-11-04T01:44:18.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.539+0000 7f7bd67a9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7bd00cde60 0x7f7bd015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.539+0000 7f7bd67a9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7bd015daa0 0x7f7bd0157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.539+0000 7f7bd67a9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7bd00ce240 0x7f7bd0157540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.539+0000 7f7bd67a9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bd015e5c0 con 0x7f7bd00ce240 2023-11-04T01:44:18.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.539+0000 7f7bd67a9640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bd0157a80 con 0x7f7bd00cde60 2023-11-04T01:44:18.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.539+0000 7f7bd67a9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd015e000 con 0x7f7bd015daa0 2023-11-04T01:44:18.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.539+0000 7f7bd4d46640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7bd00ce240 0x7f7bd0157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.539+0000 7f7bd4d46640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7bd00ce240 0x7f7bd0157540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52950/0 (socket says 172.21.15.77:52950) 2023-11-04T01:44:18.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.539+0000 7f7bd4d46640 1 -- 172.21.15.77:0/1617321863 learned_addr learned my addr 172.21.15.77:0/1617321863 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:18.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.540+0000 7f7bd4d46640 1 -- 172.21.15.77:0/1617321863 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7bd015daa0 msgr2=0x7f7bd0157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:18.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.540+0000 7f7bd4d46640 1 --2- 172.21.15.77:0/1617321863 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7bd015daa0 0x7f7bd0157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.540+0000 7f7bd4d46640 1 -- 172.21.15.77:0/1617321863 >> v2:172.21.15.122:3300/0 conn(0x7f7bd00cde60 msgr2=0x7f7bd015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:18.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.540+0000 7f7bcffff640 1 --2- 172.21.15.77:0/1617321863 >> v2:172.21.15.122:3300/0 conn(0x7f7bd00cde60 0x7f7bd015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.540+0000 7f7bd4d46640 1 --2- 172.21.15.77:0/1617321863 >> v2:172.21.15.122:3300/0 conn(0x7f7bd00cde60 0x7f7bd015d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.540+0000 7f7bd4d46640 1 -- 172.21.15.77:0/1617321863 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd015e2e0 con 0x7f7bd00ce240 2023-11-04T01:44:18.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.540+0000 7f7bd4d46640 1 --2- 172.21.15.77:0/1617321863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd00ce240 0x7f7bd0157540 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f7bd00b5550 tx=0x7f7bc802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a8aca2991940626 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:18.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.540+0000 7f7bceffd640 1 -- 172.21.15.77:0/1617321863 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc802ca70 con 0x7f7bd00ce240 2023-11-04T01:44:18.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.541+0000 7f7bceffd640 1 -- 172.21.15.77:0/1617321863 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc802cbd0 con 0x7f7bd00ce240 2023-11-04T01:44:18.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.541+0000 7f7bceffd640 1 -- 172.21.15.77:0/1617321863 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc80343f0 con 0x7f7bd00ce240 2023-11-04T01:44:18.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.541+0000 7f7bd67a9640 1 -- 172.21.15.77:0/1617321863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd00ce240 msgr2=0x7f7bd0157540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.541+0000 7f7bd67a9640 1 --2- 172.21.15.77:0/1617321863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd00ce240 0x7f7bd0157540 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f7bd00b5550 tx=0x7f7bc802bed0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.541+0000 7f7bd67a9640 1 -- 172.21.15.77:0/1617321863 shutdown_connections 2023-11-04T01:44:18.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.541+0000 7f7bd67a9640 1 --2- 172.21.15.77:0/1617321863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd00ce240 0x7f7bd0157540 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.541+0000 7f7bd67a9640 1 --2- 172.21.15.77:0/1617321863 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7bd015daa0 0x7f7bd0157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.541+0000 7f7bd67a9640 1 --2- 172.21.15.77:0/1617321863 >> v2:172.21.15.122:3300/0 conn(0x7f7bd00cde60 0x7f7bd015d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.541+0000 7f7bd67a9640 1 -- 172.21.15.77:0/1617321863 >> 172.21.15.77:0/1617321863 conn(0x7f7bd0071f30 msgr2=0x7f7bd00cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:18.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.541+0000 7f7bd67a9640 1 -- 172.21.15.77:0/1617321863 shutdown_connections 2023-11-04T01:44:18.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.541+0000 7f7bd67a9640 1 -- 172.21.15.77:0/1617321863 wait complete. 2023-11-04T01:44:18.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.542+0000 7f7bd67a9640 1 Processor -- start 2023-11-04T01:44:18.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.542+0000 7f7bd67a9640 1 -- start start 2023-11-04T01:44:18.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.543+0000 7f7bd67a9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7bd00cde60 0x7f7bd01f6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.543+0000 7f7bd67a9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd00ce240 0x7f7bd0152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.543+0000 7f7bd67a9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bd015daa0 0x7f7bd00cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.543+0000 7f7bd67a9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd01f6980 con 0x7f7bd00ce240 2023-11-04T01:44:18.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.543+0000 7f7bd67a9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd01585e0 con 0x7f7bd015daa0 2023-11-04T01:44:18.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.543+0000 7f7bd67a9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd0158380 con 0x7f7bd00cde60 2023-11-04T01:44:18.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.543+0000 7f7bcf7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd00ce240 0x7f7bd0152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.543+0000 7f7bcf7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd00ce240 0x7f7bd0152320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52966/0 (socket says 172.21.15.77:52966) 2023-11-04T01:44:18.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.543+0000 7f7bcf7fe640 1 -- 172.21.15.77:0/2353532844 learned_addr learned my addr 172.21.15.77:0/2353532844 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:18.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.543+0000 7f7bd4d46640 1 --2- 172.21.15.77:0/2353532844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bd015daa0 0x7f7bd00cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.543+0000 7f7bcffff640 1 --2- 172.21.15.77:0/2353532844 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7bd00cde60 0x7f7bd01f6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.543+0000 7f7bcf7fe640 1 -- 172.21.15.77:0/2353532844 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7bd00cde60 msgr2=0x7f7bd01f6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.543+0000 7f7bcf7fe640 1 --2- 172.21.15.77:0/2353532844 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7bd00cde60 0x7f7bd01f6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.543+0000 7f7bcf7fe640 1 -- 172.21.15.77:0/2353532844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bd015daa0 msgr2=0x7f7bd00cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.543+0000 7f7bcf7fe640 1 --2- 172.21.15.77:0/2353532844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bd015daa0 0x7f7bd00cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.543+0000 7f7bcf7fe640 1 -- 172.21.15.77:0/2353532844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc8009b30 con 0x7f7bd00ce240 2023-11-04T01:44:18.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.544+0000 7f7bcf7fe640 1 --2- 172.21.15.77:0/2353532844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd00ce240 0x7f7bd0152320 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f7bc400b440 tx=0x7f7bc400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:18.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.544+0000 7f7bccff9640 1 -- 172.21.15.77:0/2353532844 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4011890 con 0x7f7bd00ce240 2023-11-04T01:44:18.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.544+0000 7f7bccff9640 1 -- 172.21.15.77:0/2353532844 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc40119f0 con 0x7f7bd00ce240 2023-11-04T01:44:18.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.544+0000 7f7bd67a9640 1 -- 172.21.15.77:0/2353532844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bd0158b30 con 0x7f7bd00ce240 2023-11-04T01:44:18.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.544+0000 7f7bccff9640 1 -- 172.21.15.77:0/2353532844 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4011da0 con 0x7f7bd00ce240 2023-11-04T01:44:18.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.544+0000 7f7bd67a9640 1 -- 172.21.15.77:0/2353532844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bd0157dc0 con 0x7f7bd00ce240 2023-11-04T01:44:18.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.545+0000 7f7bd67a9640 1 -- 172.21.15.77:0/2353532844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bd0157c20 con 0x7f7bd00ce240 2023-11-04T01:44:18.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.545+0000 7f7bccff9640 1 -- 172.21.15.77:0/2353532844 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7bc401a400 con 0x7f7bd00ce240 2023-11-04T01:44:18.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.546+0000 7f7bccff9640 1 --2- 172.21.15.77:0/2353532844 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7bbc06ae70 0x7f7bbc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.546+0000 7f7bccff9640 1 -- 172.21.15.77:0/2353532844 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f7bc4089f20 con 0x7f7bd00ce240 2023-11-04T01:44:18.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.546+0000 7f7bcffff640 1 --2- 172.21.15.77:0/2353532844 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7bbc06ae70 0x7f7bbc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.546+0000 7f7bcffff640 1 --2- 172.21.15.77:0/2353532844 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7bbc06ae70 0x7f7bbc06d330 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7bc000a970 tx=0x7f7bc0008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:18.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.550+0000 7f7bccff9640 1 -- 172.21.15.77:0/2353532844 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7bd0157c20 con 0x7f7bd00ce240 2023-11-04T01:44:18.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.750+0000 7f7bd67a9640 1 -- 172.21.15.77:0/2353532844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7bd0157c20 con 0x7f7bd00ce240 2023-11-04T01:44:18.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.750+0000 7f7bccff9640 1 -- 172.21.15.77:0/2353532844 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f7bd0157c20 con 0x7f7bd00ce240 2023-11-04T01:44:18.753 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:44:18.753 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":56,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":35840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2908314953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2908314953},{"type":"v1","addr":"172.21.15.122:6836","nonce":2908314953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:44:14.265873+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7302,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7302":{"gid":7302,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":17,"addr":"172.21.15.77:6834/4241784871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4241784871},{"type":"v1","addr":"172.21.15.77:6834","nonce":4241784871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:18.754 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 56 2023-11-04T01:44:18.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.752+0000 7f7bd67a9640 1 -- 172.21.15.77:0/2353532844 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7bbc06ae70 msgr2=0x7f7bbc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.752+0000 7f7bd67a9640 1 --2- 172.21.15.77:0/2353532844 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7bbc06ae70 0x7f7bbc06d330 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7bc000a970 tx=0x7f7bc0008040 comp rx=0 tx=0).stop 2023-11-04T01:44:18.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.752+0000 7f7bd67a9640 1 -- 172.21.15.77:0/2353532844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd00ce240 msgr2=0x7f7bd0152320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.752+0000 7f7bd67a9640 1 --2- 172.21.15.77:0/2353532844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd00ce240 0x7f7bd0152320 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f7bc400b440 tx=0x7f7bc400b900 comp rx=0 tx=0).stop 2023-11-04T01:44:18.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.752+0000 7f7bd67a9640 1 -- 172.21.15.77:0/2353532844 shutdown_connections 2023-11-04T01:44:18.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.752+0000 7f7bd67a9640 1 --2- 172.21.15.77:0/2353532844 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7bbc06ae70 0x7f7bbc06d330 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.752+0000 7f7bd67a9640 1 --2- 172.21.15.77:0/2353532844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bd015daa0 0x7f7bd00cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.752+0000 7f7bd67a9640 1 --2- 172.21.15.77:0/2353532844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bd00ce240 0x7f7bd0152320 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.752+0000 7f7bd67a9640 1 --2- 172.21.15.77:0/2353532844 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7bd00cde60 0x7f7bd01f6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.752+0000 7f7bd67a9640 1 -- 172.21.15.77:0/2353532844 >> 172.21.15.77:0/2353532844 conn(0x7f7bd0071f30 msgr2=0x7f7bd00b77d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:18.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.752+0000 7f7bd67a9640 1 -- 172.21.15.77:0/2353532844 shutdown_connections 2023-11-04T01:44:18.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.752+0000 7f7bd67a9640 1 -- 172.21.15.77:0/2353532844 wait complete. 2023-11-04T01:44:18.764 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:44:18.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.864+0000 7f4adc525640 1 Processor -- start 2023-11-04T01:44:18.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.864+0000 7f4adc525640 1 -- start start 2023-11-04T01:44:18.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.865+0000 7f4adc525640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ad415d1b0 0x7f4ad40cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.865+0000 7f4adc525640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4ad4066000 0x7f4ad406a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.865+0000 7f4adc525640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad40c9bf0 con 0x7f4ad4070ff0 2023-11-04T01:44:18.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.865+0000 7f4adc525640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad40cd890 con 0x7f4ad4066000 2023-11-04T01:44:18.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.865+0000 7f4adc525640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad40cdb30 con 0x7f4ad415d1b0 2023-11-04T01:44:18.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.865+0000 7f4adaac2640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4ad4066000 0x7f4ad406a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.865+0000 7f4ad9ac0640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ad415d1b0 0x7f4ad40cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.865+0000 7f4ada2c1640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f4ad4070ff0 0x7f4ad40713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:57846/0 (socket says 172.21.15.77:57846) 2023-11-04T01:44:18.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.865+0000 7f4ada2c1640 1 -- 172.21.15.77:0/862268753 learned_addr learned my addr 172.21.15.77:0/862268753 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:44:18.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.865+0000 7f4adaac2640 1 -- 172.21.15.77:0/862268753 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ad415d1b0 msgr2=0x7f4ad40cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:18.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.865+0000 7f4adaac2640 1 --2- 172.21.15.77:0/862268753 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ad415d1b0 0x7f4ad40cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.865+0000 7f4adaac2640 1 -- 172.21.15.77:0/862268753 >> v1:172.21.15.122:6789/0 conn(0x7f4ad4070ff0 legacy=0x7f4ad40713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.865+0000 7f4adaac2640 1 -- 172.21.15.77:0/862268753 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad40cde10 con 0x7f4ad4066000 2023-11-04T01:44:18.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.865+0000 7f4ad9ac0640 1 --2- 172.21.15.77:0/862268753 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ad415d1b0 0x7f4ad40cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:44:18.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.866+0000 7f4adaac2640 1 --2- 172.21.15.77:0/862268753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ad4066000 0x7f4ad406a500 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4acc009d90 tx=0x7f4acc02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18dc3ba3e22e848f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:18.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.866+0000 7f4ad92bf640 1 -- 172.21.15.77:0/862268753 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4acc02cc50 con 0x7f4ad4066000 2023-11-04T01:44:18.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.866+0000 7f4ad92bf640 1 -- 172.21.15.77:0/862268753 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4acc02cdb0 con 0x7f4ad4066000 2023-11-04T01:44:18.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.866+0000 7f4ad92bf640 1 -- 172.21.15.77:0/862268753 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4acc034660 con 0x7f4ad4066000 2023-11-04T01:44:18.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.867+0000 7f4adc525640 1 -- 172.21.15.77:0/862268753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ad4066000 msgr2=0x7f4ad406a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.867+0000 7f4adc525640 1 --2- 172.21.15.77:0/862268753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ad4066000 0x7f4ad406a500 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4acc009d90 tx=0x7f4acc02bea0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.867+0000 7f4adc525640 1 -- 172.21.15.77:0/862268753 shutdown_connections 2023-11-04T01:44:18.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.867+0000 7f4adc525640 1 --2- 172.21.15.77:0/862268753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ad4066000 0x7f4ad406a500 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.867+0000 7f4adc525640 1 --2- 172.21.15.77:0/862268753 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ad415d1b0 0x7f4ad40cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.867+0000 7f4adc525640 1 -- 172.21.15.77:0/862268753 >> 172.21.15.77:0/862268753 conn(0x7f4ad40cbc90 msgr2=0x7f4ad40cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:18.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.867+0000 7f4adc525640 1 -- 172.21.15.77:0/862268753 shutdown_connections 2023-11-04T01:44:18.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.867+0000 7f4adc525640 1 -- 172.21.15.77:0/862268753 wait complete. 2023-11-04T01:44:18.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.868+0000 7f4adc525640 1 Processor -- start 2023-11-04T01:44:18.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.868+0000 7f4adc525640 1 -- start start 2023-11-04T01:44:18.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.869+0000 7f4adc525640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ad4066000 0x7f4ad40c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.869+0000 7f4adc525640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ad4070ff0 0x7f4ad41537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.869+0000 7f4adc525640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ad415d1b0 0x7f4ad415ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.869+0000 7f4adc525640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad40c5a90 con 0x7f4ad4070ff0 2023-11-04T01:44:18.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.869+0000 7f4adc525640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad40c4e80 con 0x7f4ad415d1b0 2023-11-04T01:44:18.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.869+0000 7f4adc525640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad40c5160 con 0x7f4ad4066000 2023-11-04T01:44:18.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.869+0000 7f4ad9ac0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ad4070ff0 0x7f4ad41537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.869+0000 7f4ad9ac0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ad4070ff0 0x7f4ad41537d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52970/0 (socket says 172.21.15.77:52970) 2023-11-04T01:44:18.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.869+0000 7f4ad9ac0640 1 -- 172.21.15.77:0/1953949994 learned_addr learned my addr 172.21.15.77:0/1953949994 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:18.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.869+0000 7f4ada2c1640 1 --2- 172.21.15.77:0/1953949994 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ad4066000 0x7f4ad40c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.869+0000 7f4adaac2640 1 --2- 172.21.15.77:0/1953949994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ad415d1b0 0x7f4ad415ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.869+0000 7f4ad9ac0640 1 -- 172.21.15.77:0/1953949994 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ad4066000 msgr2=0x7f4ad40c69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.869+0000 7f4ad9ac0640 1 --2- 172.21.15.77:0/1953949994 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ad4066000 0x7f4ad40c69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.869+0000 7f4ad9ac0640 1 -- 172.21.15.77:0/1953949994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ad415d1b0 msgr2=0x7f4ad415ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.869+0000 7f4ad9ac0640 1 --2- 172.21.15.77:0/1953949994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ad415d1b0 0x7f4ad415ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.869+0000 7f4ad9ac0640 1 -- 172.21.15.77:0/1953949994 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac4009400 con 0x7f4ad4070ff0 2023-11-04T01:44:18.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.869+0000 7f4ad9ac0640 1 --2- 172.21.15.77:0/1953949994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ad4070ff0 0x7f4ad41537d0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f4ac400ebe0 tx=0x7f4ac400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:18.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.870+0000 7f4acaffd640 1 -- 172.21.15.77:0/1953949994 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac4009760 con 0x7f4ad4070ff0 2023-11-04T01:44:18.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.870+0000 7f4acaffd640 1 -- 172.21.15.77:0/1953949994 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac400cc30 con 0x7f4ad4070ff0 2023-11-04T01:44:18.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.870+0000 7f4adc525640 1 -- 172.21.15.77:0/1953949994 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4acc009a70 con 0x7f4ad4070ff0 2023-11-04T01:44:18.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.870+0000 7f4acaffd640 1 -- 172.21.15.77:0/1953949994 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac400eee0 con 0x7f4ad4070ff0 2023-11-04T01:44:18.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.870+0000 7f4adc525640 1 -- 172.21.15.77:0/1953949994 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad40c5720 con 0x7f4ad4070ff0 2023-11-04T01:44:18.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.871+0000 7f4adc525640 1 -- 172.21.15.77:0/1953949994 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad4074290 con 0x7f4ad4070ff0 2023-11-04T01:44:18.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.871+0000 7f4acaffd640 1 -- 172.21.15.77:0/1953949994 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4ac4013470 con 0x7f4ad4070ff0 2023-11-04T01:44:18.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.871+0000 7f4acaffd640 1 --2- 172.21.15.77:0/1953949994 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4ab806ae70 0x7f4ab806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.872+0000 7f4acaffd640 1 -- 172.21.15.77:0/1953949994 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f4ac4089ec0 con 0x7f4ad4070ff0 2023-11-04T01:44:18.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.872+0000 7f4ada2c1640 1 --2- 172.21.15.77:0/1953949994 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4ab806ae70 0x7f4ab806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.872+0000 7f4ada2c1640 1 --2- 172.21.15.77:0/1953949994 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4ab806ae70 0x7f4ab806d330 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0005880 tx=0x7f4ad0009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:18.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:18.876+0000 7f4acaffd640 1 -- 172.21.15.77:0/1953949994 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4ac4054a10 con 0x7f4ad4070ff0 2023-11-04T01:44:19.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:19.108+0000 7f4adc525640 1 -- 172.21.15.77:0/1953949994 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7f4ad406b140 con 0x7f4ad4070ff0 2023-11-04T01:44:19.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:19.609+0000 7f4acaffd640 1 -- 172.21.15.77:0/1953949994 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.7302 v57) v1 ==== 112+0+0 (secure 0 0 0) 0x7f4ac40170a0 con 0x7f4ad4070ff0 2023-11-04T01:44:19.612 INFO:teuthology.orchestra.run.smithi077.stderr:freezing mds.7302 2023-11-04T01:44:19.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:19.611+0000 7f4adc525640 1 -- 172.21.15.77:0/1953949994 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4ab806ae70 msgr2=0x7f4ab806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:19.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:19.611+0000 7f4adc525640 1 --2- 172.21.15.77:0/1953949994 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4ab806ae70 0x7f4ab806d330 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0005880 tx=0x7f4ad0009040 comp rx=0 tx=0).stop 2023-11-04T01:44:19.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:19.611+0000 7f4adc525640 1 -- 172.21.15.77:0/1953949994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ad4070ff0 msgr2=0x7f4ad41537d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:19.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:19.611+0000 7f4adc525640 1 --2- 172.21.15.77:0/1953949994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ad4070ff0 0x7f4ad41537d0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f4ac400ebe0 tx=0x7f4ac400c520 comp rx=0 tx=0).stop 2023-11-04T01:44:19.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:19.612+0000 7f4adc525640 1 -- 172.21.15.77:0/1953949994 shutdown_connections 2023-11-04T01:44:19.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:19.612+0000 7f4adc525640 1 --2- 172.21.15.77:0/1953949994 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4ab806ae70 0x7f4ab806d330 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:19.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:19.612+0000 7f4adc525640 1 --2- 172.21.15.77:0/1953949994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ad415d1b0 0x7f4ad415ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:19.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:19.612+0000 7f4adc525640 1 --2- 172.21.15.77:0/1953949994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ad4070ff0 0x7f4ad41537d0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:19.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:19.612+0000 7f4adc525640 1 --2- 172.21.15.77:0/1953949994 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ad4066000 0x7f4ad40c69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:19.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:19.612+0000 7f4adc525640 1 -- 172.21.15.77:0/1953949994 >> 172.21.15.77:0/1953949994 conn(0x7f4ad40cbc90 msgr2=0x7f4ad40713d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:19.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:19.612+0000 7f4adc525640 1 -- 172.21.15.77:0/1953949994 shutdown_connections 2023-11-04T01:44:19.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:19.612+0000 7f4adc525640 1 -- 172.21.15.77:0/1953949994 wait complete. 2023-11-04T01:44:19.624 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_kill_mdstable_at 2 2023-11-04T01:44:19.736 INFO:teuthology.orchestra.run.smithi077.stdout:{"success":"mds_kill_mdstable_at = '2' (not observed, change may require restart) "} 2023-11-04T01:44:19.736 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '2' (not observed, change may require restart) " } 2023-11-04T01:44:19.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:19.737 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s12) 2023-11-04T01:44:19.740 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:44:19.757 INFO:tasks.ceph.mds.a.smithi077.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7f51c1f76640 time 2023-11-04T01:44:19.756715+0000 2023-11-04T01:44:19.757 INFO:tasks.ceph.mds.a.smithi077.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:44:19.758 INFO:tasks.ceph.mds.a.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:19.758 INFO:tasks.ceph.mds.a.smithi077.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f51cdb6efaf] 2023-11-04T01:44:19.759 INFO:tasks.ceph.mds.a.smithi077.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f51cdb6f16d] 2023-11-04T01:44:19.759 INFO:tasks.ceph.mds.a.smithi077.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x56160a0379ce] 2023-11-04T01:44:19.759 INFO:tasks.ceph.mds.a.smithi077.stderr: 4: (MDSContext::complete(int)+0x5c) [0x56160a067bcc] 2023-11-04T01:44:19.759 INFO:tasks.ceph.mds.a.smithi077.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x56160a070b0c] 2023-11-04T01:44:19.759 INFO:tasks.ceph.mds.a.smithi077.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x56160a070c63] 2023-11-04T01:44:19.760 INFO:tasks.ceph.mds.a.smithi077.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f51cdc164a5] 2023-11-04T01:44:19.760 INFO:tasks.ceph.mds.a.smithi077.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f51cd29f802] 2023-11-04T01:44:19.760 INFO:tasks.ceph.mds.a.smithi077.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f51cd23f450] 2023-11-04T01:44:19.760 INFO:tasks.ceph.mds.a.smithi077.stderr:2023-11-04T01:44:19.756+0000 7f51c1f76640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7f51c1f76640 time 2023-11-04T01:44:19.756715+0000 2023-11-04T01:44:19.760 INFO:tasks.ceph.mds.a.smithi077.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:44:19.761 INFO:tasks.ceph.mds.a.smithi077.stderr: 2023-11-04T01:44:19.761 INFO:tasks.ceph.mds.a.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:19.761 INFO:tasks.ceph.mds.a.smithi077.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f51cdb6efaf] 2023-11-04T01:44:19.761 INFO:tasks.ceph.mds.a.smithi077.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f51cdb6f16d] 2023-11-04T01:44:19.761 INFO:tasks.ceph.mds.a.smithi077.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x56160a0379ce] 2023-11-04T01:44:19.762 INFO:tasks.ceph.mds.a.smithi077.stderr: 4: (MDSContext::complete(int)+0x5c) [0x56160a067bcc] 2023-11-04T01:44:19.762 INFO:tasks.ceph.mds.a.smithi077.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x56160a070b0c] 2023-11-04T01:44:19.762 INFO:tasks.ceph.mds.a.smithi077.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x56160a070c63] 2023-11-04T01:44:19.762 INFO:tasks.ceph.mds.a.smithi077.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f51cdc164a5] 2023-11-04T01:44:19.762 INFO:tasks.ceph.mds.a.smithi077.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f51cd29f802] 2023-11-04T01:44:19.763 INFO:tasks.ceph.mds.a.smithi077.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f51cd23f450] 2023-11-04T01:44:19.763 INFO:tasks.ceph.mds.a.smithi077.stderr: 2023-11-04T01:44:19.763 INFO:tasks.ceph.mds.a.smithi077.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:44:19.763 INFO:tasks.ceph.mds.a.smithi077.stderr: in thread 7f51c1f76640 thread_name:MR_Finisher 2023-11-04T01:44:19.763 INFO:tasks.ceph.mds.a.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:19.763 INFO:tasks.ceph.mds.a.smithi077.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f51cd254db0] 2023-11-04T01:44:19.764 INFO:tasks.ceph.mds.a.smithi077.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f51cd2a154c] 2023-11-04T01:44:19.764 INFO:tasks.ceph.mds.a.smithi077.stderr: 3: raise() 2023-11-04T01:44:19.764 INFO:tasks.ceph.mds.a.smithi077.stderr: 4: abort() 2023-11-04T01:44:19.764 INFO:tasks.ceph.mds.a.smithi077.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f51cdb6f009] 2023-11-04T01:44:19.764 INFO:tasks.ceph.mds.a.smithi077.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f51cdb6f16d] 2023-11-04T01:44:19.764 INFO:tasks.ceph.mds.a.smithi077.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x56160a0379ce] 2023-11-04T01:44:19.765 INFO:tasks.ceph.mds.a.smithi077.stderr: 8: (MDSContext::complete(int)+0x5c) [0x56160a067bcc] 2023-11-04T01:44:19.765 INFO:tasks.ceph.mds.a.smithi077.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x56160a070b0c] 2023-11-04T01:44:19.765 INFO:tasks.ceph.mds.a.smithi077.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x56160a070c63] 2023-11-04T01:44:19.765 INFO:tasks.ceph.mds.a.smithi077.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f51cdc164a5] 2023-11-04T01:44:19.765 INFO:tasks.ceph.mds.a.smithi077.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7f51cd29f802] 2023-11-04T01:44:19.766 INFO:tasks.ceph.mds.a.smithi077.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7f51cd23f450] 2023-11-04T01:44:19.766 INFO:tasks.ceph.mds.a.smithi077.stderr:2023-11-04T01:44:19.756+0000 7f51c1f76640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:44:19.766 INFO:tasks.ceph.mds.a.smithi077.stderr: in thread 7f51c1f76640 thread_name:MR_Finisher 2023-11-04T01:44:19.766 INFO:tasks.ceph.mds.a.smithi077.stderr: 2023-11-04T01:44:19.766 INFO:tasks.ceph.mds.a.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:19.767 INFO:tasks.ceph.mds.a.smithi077.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f51cd254db0] 2023-11-04T01:44:19.767 INFO:tasks.ceph.mds.a.smithi077.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f51cd2a154c] 2023-11-04T01:44:19.767 INFO:tasks.ceph.mds.a.smithi077.stderr: 3: raise() 2023-11-04T01:44:19.767 INFO:tasks.ceph.mds.a.smithi077.stderr: 4: abort() 2023-11-04T01:44:19.767 INFO:tasks.ceph.mds.a.smithi077.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f51cdb6f009] 2023-11-04T01:44:19.768 INFO:tasks.ceph.mds.a.smithi077.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f51cdb6f16d] 2023-11-04T01:44:19.768 INFO:tasks.ceph.mds.a.smithi077.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x56160a0379ce] 2023-11-04T01:44:19.768 INFO:tasks.ceph.mds.a.smithi077.stderr: 8: (MDSContext::complete(int)+0x5c) [0x56160a067bcc] 2023-11-04T01:44:19.768 INFO:tasks.ceph.mds.a.smithi077.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x56160a070b0c] 2023-11-04T01:44:19.768 INFO:tasks.ceph.mds.a.smithi077.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x56160a070c63] 2023-11-04T01:44:19.768 INFO:tasks.ceph.mds.a.smithi077.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f51cdc164a5] 2023-11-04T01:44:19.769 INFO:tasks.ceph.mds.a.smithi077.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7f51cd29f802] 2023-11-04T01:44:19.769 INFO:tasks.ceph.mds.a.smithi077.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7f51cd23f450] 2023-11-04T01:44:19.769 INFO:tasks.ceph.mds.a.smithi077.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:44:19.769 INFO:tasks.ceph.mds.a.smithi077.stderr: 2023-11-04T01:44:19.770 INFO:tasks.ceph.mds.a.smithi077.stderr: -353> 2023-11-04T01:44:16.588+0000 7f51c577d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:44:19.770 INFO:tasks.ceph.mds.a.smithi077.stderr: -351> 2023-11-04T01:44:16.588+0000 7f51c577d640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:44:19.770 INFO:tasks.ceph.mds.a.smithi077.stderr: -1> 2023-11-04T01:44:19.756+0000 7f51c1f76640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7f51c1f76640 time 2023-11-04T01:44:19.756715+0000 2023-11-04T01:44:19.771 INFO:tasks.ceph.mds.a.smithi077.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:44:19.771 INFO:tasks.ceph.mds.a.smithi077.stderr: 2023-11-04T01:44:19.771 INFO:tasks.ceph.mds.a.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:19.771 INFO:tasks.ceph.mds.a.smithi077.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f51cdb6efaf] 2023-11-04T01:44:19.771 INFO:tasks.ceph.mds.a.smithi077.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f51cdb6f16d] 2023-11-04T01:44:19.772 INFO:tasks.ceph.mds.a.smithi077.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x56160a0379ce] 2023-11-04T01:44:19.772 INFO:tasks.ceph.mds.a.smithi077.stderr: 4: (MDSContext::complete(int)+0x5c) [0x56160a067bcc] 2023-11-04T01:44:19.772 INFO:tasks.ceph.mds.a.smithi077.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x56160a070b0c] 2023-11-04T01:44:19.772 INFO:tasks.ceph.mds.a.smithi077.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x56160a070c63] 2023-11-04T01:44:19.772 INFO:tasks.ceph.mds.a.smithi077.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f51cdc164a5] 2023-11-04T01:44:19.773 INFO:tasks.ceph.mds.a.smithi077.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f51cd29f802] 2023-11-04T01:44:19.773 INFO:tasks.ceph.mds.a.smithi077.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f51cd23f450] 2023-11-04T01:44:19.773 INFO:tasks.ceph.mds.a.smithi077.stderr: 2023-11-04T01:44:19.773 INFO:tasks.ceph.mds.a.smithi077.stderr: 0> 2023-11-04T01:44:19.756+0000 7f51c1f76640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:44:19.773 INFO:tasks.ceph.mds.a.smithi077.stderr: in thread 7f51c1f76640 thread_name:MR_Finisher 2023-11-04T01:44:19.774 INFO:tasks.ceph.mds.a.smithi077.stderr: 2023-11-04T01:44:19.774 INFO:tasks.ceph.mds.a.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:19.774 INFO:tasks.ceph.mds.a.smithi077.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f51cd254db0] 2023-11-04T01:44:19.774 INFO:tasks.ceph.mds.a.smithi077.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f51cd2a154c] 2023-11-04T01:44:19.774 INFO:tasks.ceph.mds.a.smithi077.stderr: 3: raise() 2023-11-04T01:44:19.775 INFO:tasks.ceph.mds.a.smithi077.stderr: 4: abort() 2023-11-04T01:44:19.775 INFO:tasks.ceph.mds.a.smithi077.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f51cdb6f009] 2023-11-04T01:44:19.775 INFO:tasks.ceph.mds.a.smithi077.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f51cdb6f16d] 2023-11-04T01:44:19.775 INFO:tasks.ceph.mds.a.smithi077.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x56160a0379ce] 2023-11-04T01:44:19.775 INFO:tasks.ceph.mds.a.smithi077.stderr: 8: (MDSContext::complete(int)+0x5c) [0x56160a067bcc] 2023-11-04T01:44:19.776 INFO:tasks.ceph.mds.a.smithi077.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x56160a070b0c] 2023-11-04T01:44:19.776 INFO:tasks.ceph.mds.a.smithi077.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x56160a070c63] 2023-11-04T01:44:19.776 INFO:tasks.ceph.mds.a.smithi077.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f51cdc164a5] 2023-11-04T01:44:19.776 INFO:tasks.ceph.mds.a.smithi077.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7f51cd29f802] 2023-11-04T01:44:19.776 INFO:tasks.ceph.mds.a.smithi077.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7f51cd23f450] 2023-11-04T01:44:19.777 INFO:tasks.ceph.mds.a.smithi077.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:44:19.777 INFO:tasks.ceph.mds.a.smithi077.stderr: 2023-11-04T01:44:19.777 INFO:tasks.ceph.mds.a.smithi077.stderr: -353> 2023-11-04T01:44:16.588+0000 7f51c577d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:44:19.777 INFO:tasks.ceph.mds.a.smithi077.stderr: -351> 2023-11-04T01:44:16.588+0000 7f51c577d640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:44:19.777 INFO:tasks.ceph.mds.a.smithi077.stderr: -1> 2023-11-04T01:44:19.756+0000 7f51c1f76640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7f51c1f76640 time 2023-11-04T01:44:19.756715+0000 2023-11-04T01:44:19.778 INFO:tasks.ceph.mds.a.smithi077.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:44:19.778 INFO:tasks.ceph.mds.a.smithi077.stderr: 2023-11-04T01:44:19.778 INFO:tasks.ceph.mds.a.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:19.778 INFO:tasks.ceph.mds.a.smithi077.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f51cdb6efaf] 2023-11-04T01:44:19.778 INFO:tasks.ceph.mds.a.smithi077.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f51cdb6f16d] 2023-11-04T01:44:19.779 INFO:tasks.ceph.mds.a.smithi077.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x56160a0379ce] 2023-11-04T01:44:19.779 INFO:tasks.ceph.mds.a.smithi077.stderr: 4: (MDSContext::complete(int)+0x5c) [0x56160a067bcc] 2023-11-04T01:44:19.779 INFO:tasks.ceph.mds.a.smithi077.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x56160a070b0c] 2023-11-04T01:44:19.779 INFO:tasks.ceph.mds.a.smithi077.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x56160a070c63] 2023-11-04T01:44:19.779 INFO:tasks.ceph.mds.a.smithi077.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f51cdc164a5] 2023-11-04T01:44:19.779 INFO:tasks.ceph.mds.a.smithi077.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f51cd29f802] 2023-11-04T01:44:19.780 INFO:tasks.ceph.mds.a.smithi077.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f51cd23f450] 2023-11-04T01:44:19.780 INFO:tasks.ceph.mds.a.smithi077.stderr: 2023-11-04T01:44:19.780 INFO:tasks.ceph.mds.a.smithi077.stderr: 0> 2023-11-04T01:44:19.756+0000 7f51c1f76640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:44:19.780 INFO:tasks.ceph.mds.a.smithi077.stderr: in thread 7f51c1f76640 thread_name:MR_Finisher 2023-11-04T01:44:19.780 INFO:tasks.ceph.mds.a.smithi077.stderr: 2023-11-04T01:44:19.781 INFO:tasks.ceph.mds.a.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:19.781 INFO:tasks.ceph.mds.a.smithi077.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f51cd254db0] 2023-11-04T01:44:19.781 INFO:tasks.ceph.mds.a.smithi077.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f51cd2a154c] 2023-11-04T01:44:19.781 INFO:tasks.ceph.mds.a.smithi077.stderr: 3: raise() 2023-11-04T01:44:19.781 INFO:tasks.ceph.mds.a.smithi077.stderr: 4: abort() 2023-11-04T01:44:19.781 INFO:tasks.ceph.mds.a.smithi077.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f51cdb6f009] 2023-11-04T01:44:19.782 INFO:tasks.ceph.mds.a.smithi077.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f51cdb6f16d] 2023-11-04T01:44:19.782 INFO:tasks.ceph.mds.a.smithi077.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x56160a0379ce] 2023-11-04T01:44:19.782 INFO:tasks.ceph.mds.a.smithi077.stderr: 8: (MDSContext::complete(int)+0x5c) [0x56160a067bcc] 2023-11-04T01:44:19.782 INFO:tasks.ceph.mds.a.smithi077.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x56160a070b0c] 2023-11-04T01:44:19.783 INFO:tasks.ceph.mds.a.smithi077.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x56160a070c63] 2023-11-04T01:44:19.783 INFO:tasks.ceph.mds.a.smithi077.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f51cdc164a5] 2023-11-04T01:44:19.783 INFO:tasks.ceph.mds.a.smithi077.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7f51cd29f802] 2023-11-04T01:44:19.783 INFO:tasks.ceph.mds.a.smithi077.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7f51cd23f450] 2023-11-04T01:44:19.783 INFO:tasks.ceph.mds.a.smithi077.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:44:19.783 INFO:tasks.ceph.mds.a.smithi077.stderr: 2023-11-04T01:44:19.862 INFO:teuthology.orchestra.run.smithi077.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:44:19.862 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:44:19.863 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:20.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.000+0000 7ffb48ba9640 1 Processor -- start 2023-11-04T01:44:20.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.000+0000 7ffb48ba9640 1 -- start start 2023-11-04T01:44:20.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.001+0000 7ffb48ba9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ffb440b0ae0 0x7ffb440ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.001+0000 7ffb48ba9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ffb4406db20 0x7ffb4415d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.001+0000 7ffb48ba9640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb440b4110 con 0x7ffb44159c70 2023-11-04T01:44:20.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.001+0000 7ffb48ba9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb440b49b0 con 0x7ffb4406db20 2023-11-04T01:44:20.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.001+0000 7ffb48ba9640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb440b43f0 con 0x7ffb440b0ae0 2023-11-04T01:44:20.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.001+0000 7ffb42d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ffb4406db20 0x7ffb4415d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.001+0000 7ffb42d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ffb4406db20 0x7ffb4415d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52982/0 (socket says 172.21.15.77:52982) 2023-11-04T01:44:20.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.001+0000 7ffb42d9d640 1 -- 172.21.15.77:0/2566568893 learned_addr learned my addr 172.21.15.77:0/2566568893 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:20.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.001+0000 7ffb41d9b640 1 --2- 172.21.15.77:0/2566568893 >> v2:172.21.15.122:3300/0 conn(0x7ffb440b0ae0 0x7ffb440ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.001+0000 7ffb42d9d640 1 -- 172.21.15.77:0/2566568893 >> v2:172.21.15.122:3300/0 conn(0x7ffb440b0ae0 msgr2=0x7ffb440ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:20.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.001+0000 7ffb42d9d640 1 --2- 172.21.15.77:0/2566568893 >> v2:172.21.15.122:3300/0 conn(0x7ffb440b0ae0 0x7ffb440ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.002+0000 7ffb42d9d640 1 -- 172.21.15.77:0/2566568893 >> v1:172.21.15.122:6789/0 conn(0x7ffb44159c70 legacy=0x7ffb440b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.002+0000 7ffb42d9d640 1 -- 172.21.15.77:0/2566568893 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb440b46d0 con 0x7ffb4406db20 2023-11-04T01:44:20.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.002+0000 7ffb42d9d640 1 --2- 172.21.15.77:0/2566568893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb4406db20 0x7ffb4415d7d0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7ffb440cf800 tx=0x7ffb3c02dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b7f1a137d16e896 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:20.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.002+0000 7ffb4159a640 1 -- 172.21.15.77:0/2566568893 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c02e960 con 0x7ffb4406db20 2023-11-04T01:44:20.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.002+0000 7ffb4159a640 1 -- 172.21.15.77:0/2566568893 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3c02eac0 con 0x7ffb4406db20 2023-11-04T01:44:20.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.002+0000 7ffb4159a640 1 -- 172.21.15.77:0/2566568893 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c02ee50 con 0x7ffb4406db20 2023-11-04T01:44:20.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.003+0000 7ffb48ba9640 1 -- 172.21.15.77:0/2566568893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb4406db20 msgr2=0x7ffb4415d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.003+0000 7ffb48ba9640 1 --2- 172.21.15.77:0/2566568893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb4406db20 0x7ffb4415d7d0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7ffb440cf800 tx=0x7ffb3c02dbb0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.003+0000 7ffb48ba9640 1 -- 172.21.15.77:0/2566568893 shutdown_connections 2023-11-04T01:44:20.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.003+0000 7ffb48ba9640 1 --2- 172.21.15.77:0/2566568893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb4406db20 0x7ffb4415d7d0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.003+0000 7ffb48ba9640 1 --2- 172.21.15.77:0/2566568893 >> v2:172.21.15.122:3300/0 conn(0x7ffb440b0ae0 0x7ffb440ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.003+0000 7ffb48ba9640 1 -- 172.21.15.77:0/2566568893 >> 172.21.15.77:0/2566568893 conn(0x7ffb440ce950 msgr2=0x7ffb440ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:20.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.003+0000 7ffb48ba9640 1 -- 172.21.15.77:0/2566568893 shutdown_connections 2023-11-04T01:44:20.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.003+0000 7ffb48ba9640 1 -- 172.21.15.77:0/2566568893 wait complete. 2023-11-04T01:44:20.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.004+0000 7ffb48ba9640 1 Processor -- start 2023-11-04T01:44:20.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.004+0000 7ffb48ba9640 1 -- start start 2023-11-04T01:44:20.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.005+0000 7ffb48ba9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb4406db20 0x7ffb440c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.005+0000 7ffb48ba9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffb440b0ae0 0x7ffb441f1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.005+0000 7ffb48ba9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb44159c70 0x7ffb441f2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.005+0000 7ffb48ba9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb441f2950 con 0x7ffb4406db20 2023-11-04T01:44:20.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.005+0000 7ffb48ba9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb441f2c30 con 0x7ffb44159c70 2023-11-04T01:44:20.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.005+0000 7ffb48ba9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb441f2f10 con 0x7ffb440b0ae0 2023-11-04T01:44:20.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.005+0000 7ffb4259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb4406db20 0x7ffb440c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.005+0000 7ffb4259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb4406db20 0x7ffb440c86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52998/0 (socket says 172.21.15.77:52998) 2023-11-04T01:44:20.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.005+0000 7ffb4259c640 1 -- 172.21.15.77:0/3907999590 learned_addr learned my addr 172.21.15.77:0/3907999590 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:20.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.006+0000 7ffb4259c640 1 -- 172.21.15.77:0/3907999590 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffb440b0ae0 msgr2=0x7ffb441f1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.006+0000 7ffb4259c640 1 --2- 172.21.15.77:0/3907999590 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffb440b0ae0 0x7ffb441f1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.006+0000 7ffb4259c640 1 -- 172.21.15.77:0/3907999590 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb44159c70 msgr2=0x7ffb441f2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.006+0000 7ffb4259c640 1 --2- 172.21.15.77:0/3907999590 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb44159c70 0x7ffb441f2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.006+0000 7ffb4259c640 1 -- 172.21.15.77:0/3907999590 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb3c0094d0 con 0x7ffb4406db20 2023-11-04T01:44:20.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.006+0000 7ffb4259c640 1 --2- 172.21.15.77:0/3907999590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb4406db20 0x7ffb440c86a0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7ffb3400c790 tx=0x7ffb3400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:20.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.006+0000 7ffb32ffd640 1 -- 172.21.15.77:0/3907999590 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3400cea0 con 0x7ffb4406db20 2023-11-04T01:44:20.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.006+0000 7ffb32ffd640 1 -- 172.21.15.77:0/3907999590 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb34006d50 con 0x7ffb4406db20 2023-11-04T01:44:20.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.006+0000 7ffb48ba9640 1 -- 172.21.15.77:0/3907999590 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb441f31f0 con 0x7ffb4406db20 2023-11-04T01:44:20.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.006+0000 7ffb32ffd640 1 -- 172.21.15.77:0/3907999590 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb34003bb0 con 0x7ffb4406db20 2023-11-04T01:44:20.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.006+0000 7ffb48ba9640 1 -- 172.21.15.77:0/3907999590 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb440c8be0 con 0x7ffb4406db20 2023-11-04T01:44:20.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.007+0000 7ffb48ba9640 1 -- 172.21.15.77:0/3907999590 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb44074290 con 0x7ffb4406db20 2023-11-04T01:44:20.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.007+0000 7ffb32ffd640 1 -- 172.21.15.77:0/3907999590 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffb34003d10 con 0x7ffb4406db20 2023-11-04T01:44:20.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.008+0000 7ffb32ffd640 1 --2- 172.21.15.77:0/3907999590 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ffb2406ae70 0x7ffb2406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.008+0000 7ffb32ffd640 1 -- 172.21.15.77:0/3907999590 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7ffb340897e0 con 0x7ffb4406db20 2023-11-04T01:44:20.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.008+0000 7ffb41d9b640 1 --2- 172.21.15.77:0/3907999590 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ffb2406ae70 0x7ffb2406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.008+0000 7ffb41d9b640 1 --2- 172.21.15.77:0/3907999590 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ffb2406ae70 0x7ffb2406d330 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ffb44155b00 tx=0x7ffb38008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:20.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.012+0000 7ffb32ffd640 1 -- 172.21.15.77:0/3907999590 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffb34057da0 con 0x7ffb4406db20 2023-11-04T01:44:20.109 INFO:tasks.ceph.mds.a.smithi077.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:44:20.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.213+0000 7ffb48ba9640 1 -- 172.21.15.77:0/3907999590 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb4406d3f0 con 0x7ffb4406db20 2023-11-04T01:44:20.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.214+0000 7ffb32ffd640 1 -- 172.21.15.77:0/3907999590 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4938 (secure 0 0 0) 0x7ffb3405ce60 con 0x7ffb4406db20 2023-11-04T01:44:20.216 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:44:20.216 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":57,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":35840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2908314953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2908314953},{"type":"v1","addr":"172.21.15.122:6836","nonce":2908314953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:44:19.109525+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7302,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7302":{"gid":7302,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":17,"addr":"172.21.15.77:6834/4241784871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4241784871},{"type":"v1","addr":"172.21.15.77:6834","nonce":4241784871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:20.218 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 57 2023-11-04T01:44:20.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.216+0000 7ffb48ba9640 1 -- 172.21.15.77:0/3907999590 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ffb2406ae70 msgr2=0x7ffb2406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.216+0000 7ffb48ba9640 1 --2- 172.21.15.77:0/3907999590 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ffb2406ae70 0x7ffb2406d330 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ffb44155b00 tx=0x7ffb38008040 comp rx=0 tx=0).stop 2023-11-04T01:44:20.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.216+0000 7ffb48ba9640 1 -- 172.21.15.77:0/3907999590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb4406db20 msgr2=0x7ffb440c86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.216+0000 7ffb48ba9640 1 --2- 172.21.15.77:0/3907999590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb4406db20 0x7ffb440c86a0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7ffb3400c790 tx=0x7ffb3400cc50 comp rx=0 tx=0).stop 2023-11-04T01:44:20.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.216+0000 7ffb48ba9640 1 -- 172.21.15.77:0/3907999590 shutdown_connections 2023-11-04T01:44:20.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.216+0000 7ffb48ba9640 1 --2- 172.21.15.77:0/3907999590 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ffb2406ae70 0x7ffb2406d330 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.216+0000 7ffb48ba9640 1 --2- 172.21.15.77:0/3907999590 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb44159c70 0x7ffb441f2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.216+0000 7ffb48ba9640 1 --2- 172.21.15.77:0/3907999590 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffb440b0ae0 0x7ffb441f1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.216+0000 7ffb48ba9640 1 --2- 172.21.15.77:0/3907999590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb4406db20 0x7ffb440c86a0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.216+0000 7ffb48ba9640 1 -- 172.21.15.77:0/3907999590 >> 172.21.15.77:0/3907999590 conn(0x7ffb440ce950 msgr2=0x7ffb440b1570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:20.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.216+0000 7ffb48ba9640 1 -- 172.21.15.77:0/3907999590 shutdown_connections 2023-11-04T01:44:20.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:20.216+0000 7ffb48ba9640 1 -- 172.21.15.77:0/3907999590 wait complete. 2023-11-04T01:44:20.228 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:44:25.229 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:25.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.339+0000 7f396344f640 1 Processor -- start 2023-11-04T01:44:25.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.340+0000 7f396344f640 1 -- start start 2023-11-04T01:44:25.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.340+0000 7f396344f640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f395c0cde60 0x7f395c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.341+0000 7f396344f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f395c15e000 con 0x7f395c15daa0 2023-11-04T01:44:25.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.341+0000 7f396344f640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f395c15e2e0 con 0x7f395c0ce240 2023-11-04T01:44:25.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.341+0000 7f396344f640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f395c15e5c0 con 0x7f395c0cde60 2023-11-04T01:44:25.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.341+0000 7f39609ea640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f395c15daa0 0x7f395c157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:47246/0 (socket says 172.21.15.77:47246) 2023-11-04T01:44:25.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.341+0000 7f39609ea640 1 -- 172.21.15.77:0/2146832153 learned_addr learned my addr 172.21.15.77:0/2146832153 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:44:25.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.341+0000 7f39611eb640 1 --2- 172.21.15.77:0/2146832153 >> v2:172.21.15.122:3300/0 conn(0x7f395c0cde60 0x7f395c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.341+0000 7f3953fff640 1 -- 172.21.15.77:0/2146832153 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4256751342 0 0) 0x7f395c15e000 con 0x7f395c15daa0 2023-11-04T01:44:25.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.341+0000 7f3953fff640 1 -- 172.21.15.77:0/2146832153 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3948003520 con 0x7f395c15daa0 2023-11-04T01:44:25.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.341+0000 7f39611eb640 1 -- 172.21.15.77:0/2146832153 >> v1:172.21.15.122:6789/0 conn(0x7f395c0ce240 legacy=0x7f395c0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.341+0000 7f39611eb640 1 -- 172.21.15.77:0/2146832153 >> v1:172.21.15.77:6789/0 conn(0x7f395c15daa0 legacy=0x7f395c157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.341+0000 7f3953fff640 1 -- 172.21.15.77:0/2146832153 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2878879536 0 0) 0x7f3948003520 con 0x7f395c15daa0 2023-11-04T01:44:25.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.341+0000 7f39611eb640 1 -- 172.21.15.77:0/2146832153 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f395c0d1120 con 0x7f395c0cde60 2023-11-04T01:44:25.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.342+0000 7f39611eb640 1 --2- 172.21.15.77:0/2146832153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f395c0cde60 0x7f395c15d560 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3958009d90 tx=0x7f395802be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fff8941631c90af server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:25.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.342+0000 7f3953fff640 1 -- 172.21.15.77:0/2146832153 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394c001670 con 0x7f395c0cde60 2023-11-04T01:44:25.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.342+0000 7f3953fff640 1 -- 172.21.15.77:0/2146832153 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395802c940 con 0x7f395c0cde60 2023-11-04T01:44:25.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.342+0000 7f3953fff640 1 -- 172.21.15.77:0/2146832153 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395802ccd0 con 0x7f395c0cde60 2023-11-04T01:44:25.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.343+0000 7f396344f640 1 -- 172.21.15.77:0/2146832153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f395c0cde60 msgr2=0x7f395c15d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.343+0000 7f396344f640 1 --2- 172.21.15.77:0/2146832153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f395c0cde60 0x7f395c15d560 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3958009d90 tx=0x7f395802be10 comp rx=0 tx=0).stop 2023-11-04T01:44:25.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.343+0000 7f396344f640 1 -- 172.21.15.77:0/2146832153 shutdown_connections 2023-11-04T01:44:25.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.343+0000 7f396344f640 1 --2- 172.21.15.77:0/2146832153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f395c0cde60 0x7f395c15d560 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.343+0000 7f396344f640 1 -- 172.21.15.77:0/2146832153 >> 172.21.15.77:0/2146832153 conn(0x7f395c071f30 msgr2=0x7f395c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:25.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.343+0000 7f396344f640 1 -- 172.21.15.77:0/2146832153 shutdown_connections 2023-11-04T01:44:25.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.343+0000 7f396344f640 1 -- 172.21.15.77:0/2146832153 wait complete. 2023-11-04T01:44:25.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.344+0000 7f396344f640 1 Processor -- start 2023-11-04T01:44:25.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.344+0000 7f396344f640 1 -- start start 2023-11-04T01:44:25.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.345+0000 7f396344f640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f395c0cde60 0x7f395c156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.345+0000 7f396344f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f395c0ce240 0x7f395c1f64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.345+0000 7f396344f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f395c15daa0 0x7f395c1f1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.345+0000 7f396344f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395c1f6a00 con 0x7f395c15daa0 2023-11-04T01:44:25.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.345+0000 7f396344f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395c157490 con 0x7f395c0ce240 2023-11-04T01:44:25.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.345+0000 7f396344f640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f395c157770 con 0x7f395c0cde60 2023-11-04T01:44:25.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.345+0000 7f39619ec640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f395c15daa0 0x7f395c1f1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.345+0000 7f39619ec640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f395c15daa0 0x7f395c1f1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53000/0 (socket says 172.21.15.77:53000) 2023-11-04T01:44:25.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.345+0000 7f39619ec640 1 -- 172.21.15.77:0/332884083 learned_addr learned my addr 172.21.15.77:0/332884083 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:25.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.345+0000 7f39609ea640 1 --2- 172.21.15.77:0/332884083 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f395c0ce240 0x7f395c1f64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.345+0000 7f39611eb640 1 --2- 172.21.15.77:0/332884083 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f395c0cde60 0x7f395c156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.345+0000 7f39619ec640 1 -- 172.21.15.77:0/332884083 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f395c0cde60 msgr2=0x7f395c156dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.345+0000 7f39619ec640 1 --2- 172.21.15.77:0/332884083 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f395c0cde60 0x7f395c156dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.345+0000 7f39619ec640 1 -- 172.21.15.77:0/332884083 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f395c0ce240 msgr2=0x7f395c1f64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.345+0000 7f39619ec640 1 --2- 172.21.15.77:0/332884083 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f395c0ce240 0x7f395c1f64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.345+0000 7f39619ec640 1 -- 172.21.15.77:0/332884083 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3958009a70 con 0x7f395c15daa0 2023-11-04T01:44:25.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.346+0000 7f39619ec640 1 --2- 172.21.15.77:0/332884083 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f395c15daa0 0x7f395c1f1d40 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f395400c3a0 tx=0x7f395400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:25.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.346+0000 7f3951ffb640 1 -- 172.21.15.77:0/332884083 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39540052d0 con 0x7f395c15daa0 2023-11-04T01:44:25.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.346+0000 7f3951ffb640 1 -- 172.21.15.77:0/332884083 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3954005430 con 0x7f395c15daa0 2023-11-04T01:44:25.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.346+0000 7f396344f640 1 -- 172.21.15.77:0/332884083 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f395c157a50 con 0x7f395c15daa0 2023-11-04T01:44:25.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.346+0000 7f3951ffb640 1 -- 172.21.15.77:0/332884083 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3954003830 con 0x7f395c15daa0 2023-11-04T01:44:25.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.346+0000 7f396344f640 1 -- 172.21.15.77:0/332884083 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f395c147c50 con 0x7f395c15daa0 2023-11-04T01:44:25.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.347+0000 7f396344f640 1 -- 172.21.15.77:0/332884083 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f395c074290 con 0x7f395c15daa0 2023-11-04T01:44:25.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.347+0000 7f3951ffb640 1 -- 172.21.15.77:0/332884083 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3954003990 con 0x7f395c15daa0 2023-11-04T01:44:25.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.348+0000 7f3951ffb640 1 --2- 172.21.15.77:0/332884083 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f394006ae70 0x7f394006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.348+0000 7f3951ffb640 1 -- 172.21.15.77:0/332884083 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f3954089190 con 0x7f395c15daa0 2023-11-04T01:44:25.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.348+0000 7f39611eb640 1 --2- 172.21.15.77:0/332884083 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f394006ae70 0x7f394006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.348+0000 7f39611eb640 1 --2- 172.21.15.77:0/332884083 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f394006ae70 0x7f394006d330 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f3958036000 tx=0x7f3958030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:25.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.352+0000 7f3951ffb640 1 -- 172.21.15.77:0/332884083 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3954053d00 con 0x7f395c15daa0 2023-11-04T01:44:25.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.550+0000 7f396344f640 1 -- 172.21.15.77:0/332884083 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f395c147e10 con 0x7f395c15daa0 2023-11-04T01:44:25.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.551+0000 7f3951ffb640 1 -- 172.21.15.77:0/332884083 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f3954074e60 con 0x7f395c15daa0 2023-11-04T01:44:25.553 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:44:25.553 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":57,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":35840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2908314953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2908314953},{"type":"v1","addr":"172.21.15.122:6836","nonce":2908314953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:44:19.109525+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7302,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7302":{"gid":7302,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":17,"addr":"172.21.15.77:6834/4241784871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4241784871},{"type":"v1","addr":"172.21.15.77:6834","nonce":4241784871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:25.554 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 57 2023-11-04T01:44:25.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.553+0000 7f396344f640 1 -- 172.21.15.77:0/332884083 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f394006ae70 msgr2=0x7f394006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.553+0000 7f396344f640 1 --2- 172.21.15.77:0/332884083 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f394006ae70 0x7f394006d330 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f3958036000 tx=0x7f3958030000 comp rx=0 tx=0).stop 2023-11-04T01:44:25.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.553+0000 7f396344f640 1 -- 172.21.15.77:0/332884083 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f395c15daa0 msgr2=0x7f395c1f1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.553+0000 7f396344f640 1 --2- 172.21.15.77:0/332884083 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f395c15daa0 0x7f395c1f1d40 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f395400c3a0 tx=0x7f395400c860 comp rx=0 tx=0).stop 2023-11-04T01:44:25.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.553+0000 7f396344f640 1 -- 172.21.15.77:0/332884083 shutdown_connections 2023-11-04T01:44:25.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.553+0000 7f396344f640 1 --2- 172.21.15.77:0/332884083 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f394006ae70 0x7f394006d330 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.553+0000 7f396344f640 1 --2- 172.21.15.77:0/332884083 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f395c15daa0 0x7f395c1f1d40 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.553+0000 7f396344f640 1 --2- 172.21.15.77:0/332884083 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f395c0ce240 0x7f395c1f64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.553+0000 7f396344f640 1 --2- 172.21.15.77:0/332884083 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f395c0cde60 0x7f395c156dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.553+0000 7f396344f640 1 -- 172.21.15.77:0/332884083 >> 172.21.15.77:0/332884083 conn(0x7f395c071f30 msgr2=0x7f395c0c6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:25.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.553+0000 7f396344f640 1 -- 172.21.15.77:0/332884083 shutdown_connections 2023-11-04T01:44:25.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:25.553+0000 7f396344f640 1 -- 172.21.15.77:0/332884083 wait complete. 2023-11-04T01:44:25.565 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:44:26.869 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-11-04T01:44:30.566 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:30.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.679+0000 7fcca2165640 1 Processor -- start 2023-11-04T01:44:30.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.679+0000 7fcca2165640 1 -- start start 2023-11-04T01:44:30.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.679+0000 7fcca2165640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcc9c0cde60 0x7fcc9c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:30.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.679+0000 7fcca2165640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fcc9c0ce240 0x7fcc9c0d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:30.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.679+0000 7fcca2165640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc9c15e000 con 0x7fcc9c15daa0 2023-11-04T01:44:30.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.679+0000 7fcca2165640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc9c15e5c0 con 0x7fcc9c0ce240 2023-11-04T01:44:30.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.679+0000 7fcca2165640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9c15e2e0 con 0x7fcc9c0cde60 2023-11-04T01:44:30.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.680+0000 7fcc9b7fe640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcc9c0cde60 0x7fcc9c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:30.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.680+0000 7fcc9bfff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fcc9c0ce240 0x7fcc9c0d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:30.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.680+0000 7fcc9b7fe640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcc9c0cde60 0x7fcc9c15d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:45540/0 (socket says 172.21.15.77:45540) 2023-11-04T01:44:30.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.680+0000 7fcc9bfff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fcc9c0ce240 0x7fcc9c0d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:49368/0 (socket says 172.21.15.77:49368) 2023-11-04T01:44:30.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.680+0000 7fcc9b7fe640 1 -- 172.21.15.77:0/2673004736 learned_addr learned my addr 172.21.15.77:0/2673004736 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:30.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.680+0000 7fcc9affd640 1 --1- 172.21.15.77:0/2673004736 >> v1:172.21.15.122:6789/0 conn(0x7fcc9c15daa0 0x7fcc9c157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:44770/0 (socket says 172.21.15.77:44770) 2023-11-04T01:44:30.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.680+0000 7fcc9bfff640 1 -- 172.21.15.77:0/2673004736 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcc9c0cde60 msgr2=0x7fcc9c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:30.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.680+0000 7fcc9bfff640 1 --2- 172.21.15.77:0/2673004736 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcc9c0cde60 0x7fcc9c15d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.680+0000 7fcc9bfff640 1 -- 172.21.15.77:0/2673004736 >> v1:172.21.15.122:6789/0 conn(0x7fcc9c15daa0 legacy=0x7fcc9c157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:30.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.680+0000 7fcc9bfff640 1 -- 172.21.15.77:0/2673004736 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc9c0d1120 con 0x7fcc9c0ce240 2023-11-04T01:44:30.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.680+0000 7fcc9b7fe640 1 --2- 172.21.15.77:0/2673004736 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcc9c0cde60 0x7fcc9c15d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:44:30.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.681+0000 7fcc9bfff640 1 --2- 172.21.15.77:0/2673004736 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc9c0ce240 0x7fcc9c0d1920 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fcc94009d90 tx=0x7fcc9402bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12348829a4dcecd2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:30.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.681+0000 7fcc9a7fc640 1 -- 172.21.15.77:0/2673004736 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9402cc50 con 0x7fcc9c0ce240 2023-11-04T01:44:30.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.681+0000 7fcc9a7fc640 1 -- 172.21.15.77:0/2673004736 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9402cdb0 con 0x7fcc9c0ce240 2023-11-04T01:44:30.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.681+0000 7fcc9a7fc640 1 -- 172.21.15.77:0/2673004736 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc94034660 con 0x7fcc9c0ce240 2023-11-04T01:44:30.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.682+0000 7fcca2165640 1 -- 172.21.15.77:0/2673004736 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc9c0ce240 msgr2=0x7fcc9c0d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:30.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.682+0000 7fcca2165640 1 --2- 172.21.15.77:0/2673004736 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc9c0ce240 0x7fcc9c0d1920 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fcc94009d90 tx=0x7fcc9402bea0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.682+0000 7fcca2165640 1 -- 172.21.15.77:0/2673004736 shutdown_connections 2023-11-04T01:44:30.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.682+0000 7fcca2165640 1 --2- 172.21.15.77:0/2673004736 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc9c0ce240 0x7fcc9c0d1920 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.682+0000 7fcca2165640 1 --2- 172.21.15.77:0/2673004736 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcc9c0cde60 0x7fcc9c15d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.682+0000 7fcca2165640 1 -- 172.21.15.77:0/2673004736 >> 172.21.15.77:0/2673004736 conn(0x7fcc9c071f30 msgr2=0x7fcc9c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:30.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.682+0000 7fcca2165640 1 -- 172.21.15.77:0/2673004736 shutdown_connections 2023-11-04T01:44:30.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.682+0000 7fcca2165640 1 -- 172.21.15.77:0/2673004736 wait complete. 2023-11-04T01:44:30.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.683+0000 7fcca2165640 1 Processor -- start 2023-11-04T01:44:30.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.683+0000 7fcca2165640 1 -- start start 2023-11-04T01:44:30.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.684+0000 7fcca2165640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc9c0cde60 0x7fcc9c158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:30.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.684+0000 7fcca2165640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcc9c0ce240 0x7fcc9c14b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:30.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.684+0000 7fcca2165640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc9c15daa0 0x7fcc9c0cc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:30.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.684+0000 7fcca2165640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9c14b780 con 0x7fcc9c0cde60 2023-11-04T01:44:30.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.684+0000 7fcca2165640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9c1578f0 con 0x7fcc9c15daa0 2023-11-04T01:44:30.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.684+0000 7fcca2165640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9c157bd0 con 0x7fcc9c0ce240 2023-11-04T01:44:30.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.684+0000 7fcc9b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc9c0cde60 0x7fcc9c158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:30.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.684+0000 7fcc9b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc9c0cde60 0x7fcc9c158990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35218/0 (socket says 172.21.15.77:35218) 2023-11-04T01:44:30.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.684+0000 7fcc9b7fe640 1 -- 172.21.15.77:0/2663948739 learned_addr learned my addr 172.21.15.77:0/2663948739 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:30.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.684+0000 7fcc9bfff640 1 --2- 172.21.15.77:0/2663948739 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc9c15daa0 0x7fcc9c0cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:30.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.684+0000 7fcc9affd640 1 --2- 172.21.15.77:0/2663948739 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcc9c0ce240 0x7fcc9c14b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:30.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.684+0000 7fcc9b7fe640 1 -- 172.21.15.77:0/2663948739 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcc9c0ce240 msgr2=0x7fcc9c14b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:30.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.684+0000 7fcc9b7fe640 1 --2- 172.21.15.77:0/2663948739 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcc9c0ce240 0x7fcc9c14b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.684+0000 7fcc9b7fe640 1 -- 172.21.15.77:0/2663948739 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc9c15daa0 msgr2=0x7fcc9c0cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:30.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.684+0000 7fcc9b7fe640 1 --2- 172.21.15.77:0/2663948739 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc9c15daa0 0x7fcc9c0cc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.684+0000 7fcc9b7fe640 1 -- 172.21.15.77:0/2663948739 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc8c0094d0 con 0x7fcc9c0cde60 2023-11-04T01:44:30.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.684+0000 7fcc9affd640 1 --2- 172.21.15.77:0/2663948739 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcc9c0ce240 0x7fcc9c14b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:30.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.684+0000 7fcc9b7fe640 1 --2- 172.21.15.77:0/2663948739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc9c0cde60 0x7fcc9c158990 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c00e9d0 tx=0x7fcc8c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:30.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.685+0000 7fcc83fff640 1 -- 172.21.15.77:0/2663948739 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c00ca60 con 0x7fcc9c0cde60 2023-11-04T01:44:30.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.685+0000 7fcc83fff640 1 -- 172.21.15.77:0/2663948739 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc8c00cbc0 con 0x7fcc9c0cde60 2023-11-04T01:44:30.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.685+0000 7fcca2165640 1 -- 172.21.15.77:0/2663948739 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc94009a70 con 0x7fcc9c0cde60 2023-11-04T01:44:30.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.685+0000 7fcc83fff640 1 -- 172.21.15.77:0/2663948739 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c013470 con 0x7fcc9c0cde60 2023-11-04T01:44:30.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.685+0000 7fcca2165640 1 -- 172.21.15.77:0/2663948739 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc9c158190 con 0x7fcc9c0cde60 2023-11-04T01:44:30.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.686+0000 7fcca2165640 1 -- 172.21.15.77:0/2663948739 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc9c074290 con 0x7fcc9c0cde60 2023-11-04T01:44:30.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.686+0000 7fcc83fff640 1 -- 172.21.15.77:0/2663948739 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcc8c0135d0 con 0x7fcc9c0cde60 2023-11-04T01:44:30.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.686+0000 7fcc83fff640 1 --2- 172.21.15.77:0/2663948739 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcc8806ae70 0x7fcc8806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:30.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.686+0000 7fcc83fff640 1 -- 172.21.15.77:0/2663948739 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7fcc8c089e20 con 0x7fcc9c0cde60 2023-11-04T01:44:30.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.687+0000 7fcc9affd640 1 --2- 172.21.15.77:0/2663948739 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcc8806ae70 0x7fcc8806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:30.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.687+0000 7fcc9affd640 1 --2- 172.21.15.77:0/2663948739 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcc8806ae70 0x7fcc8806d330 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fcc90007fd0 tx=0x7fcc90007d40 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:30.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.691+0000 7fcc83fff640 1 -- 172.21.15.77:0/2663948739 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcc8c054a00 con 0x7fcc9c0cde60 2023-11-04T01:44:30.793 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:44:30.796 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:44:30.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.899+0000 7fcca2165640 1 -- 172.21.15.77:0/2663948739 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc9c0c62a0 con 0x7fcc9c0cde60 2023-11-04T01:44:30.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.899+0000 7fcc83fff640 1 -- 172.21.15.77:0/2663948739 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4938 (secure 0 0 0) 0x7fcc8c017090 con 0x7fcc9c0cde60 2023-11-04T01:44:30.901 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:44:30.902 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":57,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":35840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2908314953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2908314953},{"type":"v1","addr":"172.21.15.122:6836","nonce":2908314953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:44:19.109525+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7302,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7302":{"gid":7302,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":17,"addr":"172.21.15.77:6834/4241784871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4241784871},{"type":"v1","addr":"172.21.15.77:6834","nonce":4241784871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:30.902 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 57 2023-11-04T01:44:30.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.901+0000 7fcca2165640 1 -- 172.21.15.77:0/2663948739 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcc8806ae70 msgr2=0x7fcc8806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:30.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.901+0000 7fcca2165640 1 --2- 172.21.15.77:0/2663948739 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcc8806ae70 0x7fcc8806d330 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fcc90007fd0 tx=0x7fcc90007d40 comp rx=0 tx=0).stop 2023-11-04T01:44:30.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.901+0000 7fcca2165640 1 -- 172.21.15.77:0/2663948739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc9c0cde60 msgr2=0x7fcc9c158990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:30.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.901+0000 7fcca2165640 1 --2- 172.21.15.77:0/2663948739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc9c0cde60 0x7fcc9c158990 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c00e9d0 tx=0x7fcc8c00ee90 comp rx=0 tx=0).stop 2023-11-04T01:44:30.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.901+0000 7fcca2165640 1 -- 172.21.15.77:0/2663948739 shutdown_connections 2023-11-04T01:44:30.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.901+0000 7fcca2165640 1 --2- 172.21.15.77:0/2663948739 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcc8806ae70 0x7fcc8806d330 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.901+0000 7fcca2165640 1 --2- 172.21.15.77:0/2663948739 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc9c15daa0 0x7fcc9c0cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.901+0000 7fcca2165640 1 --2- 172.21.15.77:0/2663948739 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcc9c0ce240 0x7fcc9c14b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.901+0000 7fcca2165640 1 --2- 172.21.15.77:0/2663948739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc9c0cde60 0x7fcc9c158990 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.901+0000 7fcca2165640 1 -- 172.21.15.77:0/2663948739 >> 172.21.15.77:0/2663948739 conn(0x7fcc9c071f30 msgr2=0x7fcc9c0c8950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:30.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.901+0000 7fcca2165640 1 -- 172.21.15.77:0/2663948739 shutdown_connections 2023-11-04T01:44:30.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:30.901+0000 7fcca2165640 1 -- 172.21.15.77:0/2663948739 wait complete. 2023-11-04T01:44:30.914 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:44:33.480 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~7s 2023-11-04T01:44:35.915 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:36.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.024+0000 7fb508610640 1 Processor -- start 2023-11-04T01:44:36.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.024+0000 7fb508610640 1 -- start start 2023-11-04T01:44:36.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.025+0000 7fb508610640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb5000ce240 0x7fb500157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.025+0000 7fb508610640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb500157540 0x7fb5000d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.025+0000 7fb508610640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb50015e000 con 0x7fb5000cde60 2023-11-04T01:44:36.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.025+0000 7fb508610640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb50015e5c0 con 0x7fb500157540 2023-11-04T01:44:36.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.025+0000 7fb508610640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb50015e2e0 con 0x7fb5000ce240 2023-11-04T01:44:36.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.025+0000 7fb506bad640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb500157540 0x7fb5000d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.025+0000 7fb506bad640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb500157540 0x7fb5000d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35226/0 (socket says 172.21.15.77:35226) 2023-11-04T01:44:36.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.025+0000 7fb506bad640 1 -- 172.21.15.77:0/3314784991 learned_addr learned my addr 172.21.15.77:0/3314784991 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:36.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.026+0000 7fb505bab640 1 --2- 172.21.15.77:0/3314784991 >> v2:172.21.15.122:3300/0 conn(0x7fb5000ce240 0x7fb500157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.026+0000 7fb506bad640 1 -- 172.21.15.77:0/3314784991 >> v2:172.21.15.122:3300/0 conn(0x7fb5000ce240 msgr2=0x7fb500157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:36.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.026+0000 7fb506bad640 1 --2- 172.21.15.77:0/3314784991 >> v2:172.21.15.122:3300/0 conn(0x7fb5000ce240 0x7fb500157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.026+0000 7fb506bad640 1 -- 172.21.15.77:0/3314784991 >> v1:172.21.15.122:6789/0 conn(0x7fb5000cde60 legacy=0x7fb50015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:36.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.026+0000 7fb506bad640 1 -- 172.21.15.77:0/3314784991 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5000d1120 con 0x7fb500157540 2023-11-04T01:44:36.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.026+0000 7fb506bad640 1 --2- 172.21.15.77:0/3314784991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb500157540 0x7fb5000d1920 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fb5000cf5f0 tx=0x7fb4f802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21fa720efac34b7d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:36.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.027+0000 7fb5053aa640 1 -- 172.21.15.77:0/3314784991 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f8030860 con 0x7fb500157540 2023-11-04T01:44:36.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.027+0000 7fb5053aa640 1 -- 172.21.15.77:0/3314784991 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f80309c0 con 0x7fb500157540 2023-11-04T01:44:36.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.027+0000 7fb5053aa640 1 -- 172.21.15.77:0/3314784991 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f8030d50 con 0x7fb500157540 2023-11-04T01:44:36.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.027+0000 7fb508610640 1 -- 172.21.15.77:0/3314784991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb500157540 msgr2=0x7fb5000d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:36.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.027+0000 7fb508610640 1 --2- 172.21.15.77:0/3314784991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb500157540 0x7fb5000d1920 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fb5000cf5f0 tx=0x7fb4f802b9a0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.027+0000 7fb508610640 1 -- 172.21.15.77:0/3314784991 shutdown_connections 2023-11-04T01:44:36.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.027+0000 7fb508610640 1 --2- 172.21.15.77:0/3314784991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb500157540 0x7fb5000d1920 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.027+0000 7fb508610640 1 --2- 172.21.15.77:0/3314784991 >> v2:172.21.15.122:3300/0 conn(0x7fb5000ce240 0x7fb500157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.027+0000 7fb508610640 1 -- 172.21.15.77:0/3314784991 >> 172.21.15.77:0/3314784991 conn(0x7fb500071f30 msgr2=0x7fb5000cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:36.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.027+0000 7fb508610640 1 -- 172.21.15.77:0/3314784991 shutdown_connections 2023-11-04T01:44:36.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.027+0000 7fb508610640 1 -- 172.21.15.77:0/3314784991 wait complete. 2023-11-04T01:44:36.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.029+0000 7fb508610640 1 Processor -- start 2023-11-04T01:44:36.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.029+0000 7fb508610640 1 -- start start 2023-11-04T01:44:36.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.029+0000 7fb508610640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5000cde60 0x7fb5001488a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.029+0000 7fb508610640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb5000ce240 0x7fb500158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.029+0000 7fb508610640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb500157540 0x7fb500148080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.029+0000 7fb508610640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb500158ba0 con 0x7fb5000cde60 2023-11-04T01:44:36.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.029+0000 7fb508610640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5001485c0 con 0x7fb500157540 2023-11-04T01:44:36.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.029+0000 7fb508610640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb500148ef0 con 0x7fb5000ce240 2023-11-04T01:44:36.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.029+0000 7fb5063ac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5000cde60 0x7fb5001488a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.029+0000 7fb5063ac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5000cde60 0x7fb5001488a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35236/0 (socket says 172.21.15.77:35236) 2023-11-04T01:44:36.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.029+0000 7fb5063ac640 1 -- 172.21.15.77:0/1236439688 learned_addr learned my addr 172.21.15.77:0/1236439688 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:36.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.030+0000 7fb506bad640 1 --2- 172.21.15.77:0/1236439688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb500157540 0x7fb500148080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.030+0000 7fb505bab640 1 --2- 172.21.15.77:0/1236439688 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb5000ce240 0x7fb500158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.030+0000 7fb5063ac640 1 -- 172.21.15.77:0/1236439688 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb5000ce240 msgr2=0x7fb500158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:36.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.030+0000 7fb5063ac640 1 --2- 172.21.15.77:0/1236439688 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb5000ce240 0x7fb500158660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.030+0000 7fb5063ac640 1 -- 172.21.15.77:0/1236439688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb500157540 msgr2=0x7fb500148080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:36.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.030+0000 7fb5063ac640 1 --2- 172.21.15.77:0/1236439688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb500157540 0x7fb500148080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.030+0000 7fb5063ac640 1 -- 172.21.15.77:0/1236439688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f80094d0 con 0x7fb5000cde60 2023-11-04T01:44:36.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.030+0000 7fb5063ac640 1 --2- 172.21.15.77:0/1236439688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5000cde60 0x7fb5001488a0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00c870 tx=0x7fb4fc00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:36.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.030+0000 7fb4f6ffd640 1 -- 172.21.15.77:0/1236439688 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc003b70 con 0x7fb5000cde60 2023-11-04T01:44:36.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.030+0000 7fb4f6ffd640 1 -- 172.21.15.77:0/1236439688 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4fc003cf0 con 0x7fb5000cde60 2023-11-04T01:44:36.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.030+0000 7fb508610640 1 -- 172.21.15.77:0/1236439688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5001491d0 con 0x7fb5000cde60 2023-11-04T01:44:36.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.030+0000 7fb4f6ffd640 1 -- 172.21.15.77:0/1236439688 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc00aa90 con 0x7fb5000cde60 2023-11-04T01:44:36.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.030+0000 7fb508610640 1 -- 172.21.15.77:0/1236439688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb500149790 con 0x7fb5000cde60 2023-11-04T01:44:36.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.031+0000 7fb508610640 1 -- 172.21.15.77:0/1236439688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb500074290 con 0x7fb5000cde60 2023-11-04T01:44:36.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.031+0000 7fb4f6ffd640 1 -- 172.21.15.77:0/1236439688 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb4fc00abf0 con 0x7fb5000cde60 2023-11-04T01:44:36.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.032+0000 7fb4f6ffd640 1 --2- 172.21.15.77:0/1236439688 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb4e406ae70 0x7fb4e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.032+0000 7fb4f6ffd640 1 -- 172.21.15.77:0/1236439688 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7fb4fc089aa0 con 0x7fb5000cde60 2023-11-04T01:44:36.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.032+0000 7fb505bab640 1 --2- 172.21.15.77:0/1236439688 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb4e406ae70 0x7fb4e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.032+0000 7fb505bab640 1 --2- 172.21.15.77:0/1236439688 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb4e406ae70 0x7fb4e406d330 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb5000ccbc0 tx=0x7fb4f0008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:36.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.036+0000 7fb4f6ffd640 1 -- 172.21.15.77:0/1236439688 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb4fc0545d0 con 0x7fb5000cde60 2023-11-04T01:44:36.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.237+0000 7fb508610640 1 -- 172.21.15.77:0/1236439688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5000d2480 con 0x7fb5000cde60 2023-11-04T01:44:36.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.237+0000 7fb4f6ffd640 1 -- 172.21.15.77:0/1236439688 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4986 (secure 0 0 0) 0x7fb4fc003e60 con 0x7fb5000cde60 2023-11-04T01:44:36.239 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:44:36.240 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":58,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":35840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2908314953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2908314953},{"type":"v1","addr":"172.21.15.122:6836","nonce":2908314953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:44:35.592867+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":99,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7302,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7302":{"gid":7302,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":17,"addr":"172.21.15.77:6834/4241784871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4241784871},{"type":"v1","addr":"172.21.15.77:6834","nonce":4241784871}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:44:35.592867+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:36.241 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 58 2023-11-04T01:44:36.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.239+0000 7fb508610640 1 -- 172.21.15.77:0/1236439688 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb4e406ae70 msgr2=0x7fb4e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:36.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.239+0000 7fb508610640 1 --2- 172.21.15.77:0/1236439688 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb4e406ae70 0x7fb4e406d330 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb5000ccbc0 tx=0x7fb4f0008040 comp rx=0 tx=0).stop 2023-11-04T01:44:36.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.239+0000 7fb508610640 1 -- 172.21.15.77:0/1236439688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5000cde60 msgr2=0x7fb5001488a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:36.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.239+0000 7fb508610640 1 --2- 172.21.15.77:0/1236439688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5000cde60 0x7fb5001488a0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00c870 tx=0x7fb4fc00cd30 comp rx=0 tx=0).stop 2023-11-04T01:44:36.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.239+0000 7fb508610640 1 -- 172.21.15.77:0/1236439688 shutdown_connections 2023-11-04T01:44:36.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.239+0000 7fb508610640 1 --2- 172.21.15.77:0/1236439688 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb4e406ae70 0x7fb4e406d330 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.239+0000 7fb508610640 1 --2- 172.21.15.77:0/1236439688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb500157540 0x7fb500148080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.239+0000 7fb508610640 1 --2- 172.21.15.77:0/1236439688 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb5000ce240 0x7fb500158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.239+0000 7fb508610640 1 --2- 172.21.15.77:0/1236439688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5000cde60 0x7fb5001488a0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.239+0000 7fb508610640 1 -- 172.21.15.77:0/1236439688 >> 172.21.15.77:0/1236439688 conn(0x7fb500071f30 msgr2=0x7fb5000d1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:36.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.239+0000 7fb508610640 1 -- 172.21.15.77:0/1236439688 shutdown_connections 2023-11-04T01:44:36.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.239+0000 7fb508610640 1 -- 172.21.15.77:0/1236439688 wait complete. 2023-11-04T01:44:36.251 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-11-04T01:44:36.252 DEBUG:teuthology.orchestra.run.smithi077:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:44:36.277 INFO:teuthology.orchestra.run.smithi077.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:44:36.279 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:44:36.279 DEBUG:teuthology.orchestra.run.smithi077:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:44:36.349 INFO:teuthology.orchestra.run.smithi077.stdout:1699062259.146684.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i a', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:44:36.350 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062259.146684.core'] 2023-11-04T01:44:36.351 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062259.146684.core, deleting it 2023-11-04T01:44:36.351 DEBUG:teuthology.orchestra.run.smithi077:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062259.146684.core 2023-11-04T01:44:36.419 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:44:36.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.557+0000 7fbe48207640 1 Processor -- start 2023-11-04T01:44:36.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.558+0000 7fbe48207640 1 -- start start 2023-11-04T01:44:36.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.558+0000 7fbe48207640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbe400c4ff0 0x7fbe400cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.558+0000 7fbe48207640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fbe400adac0 0x7fbe400adf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.558+0000 7fbe48207640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe4015aff0 con 0x7fbe40159c00 2023-11-04T01:44:36.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.558+0000 7fbe48207640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe400ae460 con 0x7fbe400c4ff0 2023-11-04T01:44:36.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.558+0000 7fbe48207640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe4015a3e0 con 0x7fbe400adac0 2023-11-04T01:44:36.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.559+0000 7fbe457a2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbe400c4ff0 0x7fbe400cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.559+0000 7fbe457a2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbe400c4ff0 0x7fbe400cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35242/0 (socket says 172.21.15.77:35242) 2023-11-04T01:44:36.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.559+0000 7fbe45fa3640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fbe40159c00 0x7fbe400c48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:54072/0 (socket says 172.21.15.77:54072) 2023-11-04T01:44:36.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.559+0000 7fbe457a2640 1 -- 172.21.15.77:0/1600030244 learned_addr learned my addr 172.21.15.77:0/1600030244 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:36.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.559+0000 7fbe467a4640 1 --2- 172.21.15.77:0/1600030244 >> v2:172.21.15.122:3300/0 conn(0x7fbe400adac0 0x7fbe400adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.559+0000 7fbe457a2640 1 -- 172.21.15.77:0/1600030244 >> v2:172.21.15.122:3300/0 conn(0x7fbe400adac0 msgr2=0x7fbe400adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:36.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.559+0000 7fbe457a2640 1 --2- 172.21.15.77:0/1600030244 >> v2:172.21.15.122:3300/0 conn(0x7fbe400adac0 0x7fbe400adf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.559+0000 7fbe457a2640 1 -- 172.21.15.77:0/1600030244 >> v1:172.21.15.77:6789/0 conn(0x7fbe40159c00 legacy=0x7fbe400c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:36.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.559+0000 7fbe457a2640 1 -- 172.21.15.77:0/1600030244 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe4015a6c0 con 0x7fbe400c4ff0 2023-11-04T01:44:36.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.559+0000 7fbe467a4640 1 --2- 172.21.15.77:0/1600030244 >> v2:172.21.15.122:3300/0 conn(0x7fbe400adac0 0x7fbe400adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:36.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.560+0000 7fbe457a2640 1 --2- 172.21.15.77:0/1600030244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe400c4ff0 0x7fbe400cc890 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fbe400c59a0 tx=0x7fbe3c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc03ea6e5a3fc94 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:36.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.560+0000 7fbe44fa1640 1 -- 172.21.15.77:0/1600030244 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c030860 con 0x7fbe400c4ff0 2023-11-04T01:44:36.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.560+0000 7fbe44fa1640 1 -- 172.21.15.77:0/1600030244 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3c0309c0 con 0x7fbe400c4ff0 2023-11-04T01:44:36.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.560+0000 7fbe44fa1640 1 -- 172.21.15.77:0/1600030244 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c030d50 con 0x7fbe400c4ff0 2023-11-04T01:44:36.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.560+0000 7fbe48207640 1 -- 172.21.15.77:0/1600030244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe400c4ff0 msgr2=0x7fbe400cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:36.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.560+0000 7fbe48207640 1 --2- 172.21.15.77:0/1600030244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe400c4ff0 0x7fbe400cc890 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fbe400c59a0 tx=0x7fbe3c02b9a0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.560+0000 7fbe48207640 1 -- 172.21.15.77:0/1600030244 shutdown_connections 2023-11-04T01:44:36.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.560+0000 7fbe48207640 1 --2- 172.21.15.77:0/1600030244 >> v2:172.21.15.122:3300/0 conn(0x7fbe400adac0 0x7fbe400adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.560+0000 7fbe48207640 1 --2- 172.21.15.77:0/1600030244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe400c4ff0 0x7fbe400cc890 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.560+0000 7fbe48207640 1 -- 172.21.15.77:0/1600030244 >> 172.21.15.77:0/1600030244 conn(0x7fbe400ce950 msgr2=0x7fbe400ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:36.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.560+0000 7fbe48207640 1 -- 172.21.15.77:0/1600030244 shutdown_connections 2023-11-04T01:44:36.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.560+0000 7fbe48207640 1 -- 172.21.15.77:0/1600030244 wait complete. 2023-11-04T01:44:36.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.562+0000 7fbe48207640 1 Processor -- start 2023-11-04T01:44:36.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.562+0000 7fbe48207640 1 -- start start 2023-11-04T01:44:36.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.562+0000 7fbe48207640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe400adac0 0x7fbe400c6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.562+0000 7fbe48207640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe400c4ff0 0x7fbe4014b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.562+0000 7fbe48207640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbe40159c00 0x7fbe4013e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.562+0000 7fbe48207640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe400c6a50 con 0x7fbe400adac0 2023-11-04T01:44:36.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.562+0000 7fbe48207640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe400c6d30 con 0x7fbe400c4ff0 2023-11-04T01:44:36.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.562+0000 7fbe48207640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe400c7010 con 0x7fbe40159c00 2023-11-04T01:44:36.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.562+0000 7fbe45fa3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe400adac0 0x7fbe400c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.562+0000 7fbe45fa3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe400adac0 0x7fbe400c6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35258/0 (socket says 172.21.15.77:35258) 2023-11-04T01:44:36.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.562+0000 7fbe45fa3640 1 -- 172.21.15.77:0/3185500811 learned_addr learned my addr 172.21.15.77:0/3185500811 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:36.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.563+0000 7fbe45fa3640 1 -- 172.21.15.77:0/3185500811 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbe40159c00 msgr2=0x7fbe4013e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:36.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.563+0000 7fbe45fa3640 1 --2- 172.21.15.77:0/3185500811 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbe40159c00 0x7fbe4013e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.563+0000 7fbe45fa3640 1 -- 172.21.15.77:0/3185500811 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe400c4ff0 msgr2=0x7fbe4014b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:36.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.563+0000 7fbe45fa3640 1 --2- 172.21.15.77:0/3185500811 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe400c4ff0 0x7fbe4014b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.563+0000 7fbe45fa3640 1 -- 172.21.15.77:0/3185500811 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe3c0094d0 con 0x7fbe400adac0 2023-11-04T01:44:36.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.563+0000 7fbe45fa3640 1 --2- 172.21.15.77:0/3185500811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe400adac0 0x7fbe400c6200 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fbe3000c3e0 tx=0x7fbe3000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:36.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.563+0000 7fbe367fc640 1 -- 172.21.15.77:0/3185500811 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe300074e0 con 0x7fbe400adac0 2023-11-04T01:44:36.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.563+0000 7fbe367fc640 1 -- 172.21.15.77:0/3185500811 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe30007640 con 0x7fbe400adac0 2023-11-04T01:44:36.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.563+0000 7fbe48207640 1 -- 172.21.15.77:0/3185500811 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe400c72f0 con 0x7fbe400adac0 2023-11-04T01:44:36.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.563+0000 7fbe367fc640 1 -- 172.21.15.77:0/3185500811 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe300049e0 con 0x7fbe400adac0 2023-11-04T01:44:36.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.563+0000 7fbe48207640 1 -- 172.21.15.77:0/3185500811 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe400c6740 con 0x7fbe400adac0 2023-11-04T01:44:36.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.564+0000 7fbe48207640 1 -- 172.21.15.77:0/3185500811 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe400c7810 con 0x7fbe400adac0 2023-11-04T01:44:36.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.564+0000 7fbe367fc640 1 -- 172.21.15.77:0/3185500811 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbe30004b40 con 0x7fbe400adac0 2023-11-04T01:44:36.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.565+0000 7fbe367fc640 1 --2- 172.21.15.77:0/3185500811 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbe2406aea0 0x7fbe2406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.565+0000 7fbe367fc640 1 -- 172.21.15.77:0/3185500811 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7264+0+0 (secure 0 0 0) 0x7fbe300895e0 con 0x7fbe400adac0 2023-11-04T01:44:36.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.565+0000 7fbe457a2640 1 --2- 172.21.15.77:0/3185500811 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbe2406aea0 0x7fbe2406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.565+0000 7fbe457a2640 1 --2- 172.21.15.77:0/3185500811 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbe2406aea0 0x7fbe2406d360 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c036000 tx=0x7fbe3c03b040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:36.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.569+0000 7fbe367fc640 1 -- 172.21.15.77:0/3185500811 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbe400c7810 con 0x7fbe400adac0 2023-11-04T01:44:36.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.806+0000 7fbe48207640 1 -- 172.21.15.77:0/3185500811 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7fbe400c7810 con 0x7fbe400adac0 2023-11-04T01:44:36.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.808+0000 7fbe367fc640 1 -- 172.21.15.77:0/3185500811 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 7302 v59) v1 ==== 97+0+0 (secure 0 0 0) 0x7fbe400c7810 con 0x7fbe400adac0 2023-11-04T01:44:36.809 INFO:teuthology.orchestra.run.smithi077.stderr:failed mds gid 7302 2023-11-04T01:44:36.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.811+0000 7fbe48207640 1 -- 172.21.15.77:0/3185500811 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbe2406aea0 msgr2=0x7fbe2406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:36.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.811+0000 7fbe48207640 1 --2- 172.21.15.77:0/3185500811 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbe2406aea0 0x7fbe2406d360 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c036000 tx=0x7fbe3c03b040 comp rx=0 tx=0).stop 2023-11-04T01:44:36.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.811+0000 7fbe48207640 1 -- 172.21.15.77:0/3185500811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe400adac0 msgr2=0x7fbe400c6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:36.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.811+0000 7fbe48207640 1 --2- 172.21.15.77:0/3185500811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe400adac0 0x7fbe400c6200 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fbe3000c3e0 tx=0x7fbe3000c8a0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.811+0000 7fbe48207640 1 -- 172.21.15.77:0/3185500811 shutdown_connections 2023-11-04T01:44:36.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.811+0000 7fbe48207640 1 --2- 172.21.15.77:0/3185500811 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbe2406aea0 0x7fbe2406d360 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.811+0000 7fbe48207640 1 --2- 172.21.15.77:0/3185500811 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbe40159c00 0x7fbe4013e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.811+0000 7fbe48207640 1 --2- 172.21.15.77:0/3185500811 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe400c4ff0 0x7fbe4014b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.811+0000 7fbe48207640 1 --2- 172.21.15.77:0/3185500811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe400adac0 0x7fbe400c6200 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.811+0000 7fbe48207640 1 -- 172.21.15.77:0/3185500811 >> 172.21.15.77:0/3185500811 conn(0x7fbe400ce950 msgr2=0x7fbe400cc890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:36.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.811+0000 7fbe48207640 1 -- 172.21.15.77:0/3185500811 shutdown_connections 2023-11-04T01:44:36.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.811+0000 7fbe48207640 1 -- 172.21.15.77:0/3185500811 wait complete. 2023-11-04T01:44:36.826 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:44:36.826 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:44:36.826 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:44:36.827 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:44:36.827 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:44:36.828 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi077 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2023-11-04T01:44:36.828 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:44:36.829 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:44:36.831 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:44:36.831 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:36.906 INFO:tasks.ceph.mds.a.smithi077.stdout:starting mds.a at 2023-11-04T01:44:36.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.930+0000 7f2fc5a7c640 1 Processor -- start 2023-11-04T01:44:36.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.930+0000 7f2fc5a7c640 1 -- start start 2023-11-04T01:44:36.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.931+0000 7f2fc5a7c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2fc00cde60 0x7f2fc015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.931+0000 7f2fc5a7c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2fc00ce240 0x7f2fc00d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.931+0000 7f2fc5a7c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc015e000 con 0x7f2fc015daa0 2023-11-04T01:44:36.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.931+0000 7f2fc5a7c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc015e5c0 con 0x7f2fc00cde60 2023-11-04T01:44:36.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.931+0000 7f2fc5a7c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc015e2e0 con 0x7f2fc00ce240 2023-11-04T01:44:36.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.931+0000 7f2fbf7fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2fc00cde60 0x7f2fc015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.932+0000 7f2fbffff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2fc00ce240 0x7f2fc00d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.932+0000 7f2fbf7fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2fc00cde60 0x7f2fc015d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:49428/0 (socket says 172.21.15.77:49428) 2023-11-04T01:44:36.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.932+0000 7f2fbeffd640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f2fc015daa0 0x7f2fc0157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:44794/0 (socket says 172.21.15.77:44794) 2023-11-04T01:44:36.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.932+0000 7f2fbf7fe640 1 -- 172.21.15.77:0/3791483239 learned_addr learned my addr 172.21.15.77:0/3791483239 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:36.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.932+0000 7f2fbffff640 1 -- 172.21.15.77:0/3791483239 >> v2:172.21.15.122:3300/0 conn(0x7f2fc00cde60 msgr2=0x7f2fc015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:36.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.932+0000 7f2fbffff640 1 --2- 172.21.15.77:0/3791483239 >> v2:172.21.15.122:3300/0 conn(0x7f2fc00cde60 0x7f2fc015d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.932+0000 7f2fbffff640 1 -- 172.21.15.77:0/3791483239 >> v1:172.21.15.122:6789/0 conn(0x7f2fc015daa0 legacy=0x7f2fc0157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:36.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.932+0000 7f2fbffff640 1 -- 172.21.15.77:0/3791483239 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc00d1120 con 0x7f2fc00ce240 2023-11-04T01:44:36.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.933+0000 7f2fbffff640 1 --2- 172.21.15.77:0/3791483239 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2fc00ce240 0x7f2fc00d1920 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8009d90 tx=0x7f2fb802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfd23238227891d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:36.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.933+0000 7f2fbe7fc640 1 -- 172.21.15.77:0/3791483239 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb802cc50 con 0x7f2fc00ce240 2023-11-04T01:44:36.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.933+0000 7f2fbe7fc640 1 -- 172.21.15.77:0/3791483239 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb802cdb0 con 0x7f2fc00ce240 2023-11-04T01:44:36.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.933+0000 7f2fbe7fc640 1 -- 172.21.15.77:0/3791483239 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8034660 con 0x7f2fc00ce240 2023-11-04T01:44:36.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.933+0000 7f2fc5a7c640 1 -- 172.21.15.77:0/3791483239 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2fc00ce240 msgr2=0x7f2fc00d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:36.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.933+0000 7f2fc5a7c640 1 --2- 172.21.15.77:0/3791483239 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2fc00ce240 0x7f2fc00d1920 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8009d90 tx=0x7f2fb802bea0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.933+0000 7f2fc5a7c640 1 -- 172.21.15.77:0/3791483239 shutdown_connections 2023-11-04T01:44:36.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.933+0000 7f2fc5a7c640 1 --2- 172.21.15.77:0/3791483239 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2fc00ce240 0x7f2fc00d1920 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.933+0000 7f2fc5a7c640 1 --2- 172.21.15.77:0/3791483239 >> v2:172.21.15.122:3300/0 conn(0x7f2fc00cde60 0x7f2fc015d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.933+0000 7f2fc5a7c640 1 -- 172.21.15.77:0/3791483239 >> 172.21.15.77:0/3791483239 conn(0x7f2fc0071f30 msgr2=0x7f2fc00cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:36.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.933+0000 7f2fc5a7c640 1 -- 172.21.15.77:0/3791483239 shutdown_connections 2023-11-04T01:44:36.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.933+0000 7f2fc5a7c640 1 -- 172.21.15.77:0/3791483239 wait complete. 2023-11-04T01:44:36.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.934+0000 7f2fc5a7c640 1 Processor -- start 2023-11-04T01:44:36.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.935+0000 7f2fc5a7c640 1 -- start start 2023-11-04T01:44:36.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.935+0000 7f2fc5a7c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fc00cde60 0x7f2fc01f5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.935+0000 7f2fc5a7c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fc00ce240 0x7f2fc0147750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.935+0000 7f2fc5a7c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2fc015daa0 0x7f2fc0158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.935+0000 7f2fc5a7c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc01466b0 con 0x7f2fc00ce240 2023-11-04T01:44:36.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.935+0000 7f2fc5a7c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc0146990 con 0x7f2fc00cde60 2023-11-04T01:44:36.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.935+0000 7f2fc5a7c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc0146c70 con 0x7f2fc015daa0 2023-11-04T01:44:36.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.936+0000 7f2fbeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fc00ce240 0x7f2fc0147750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.936+0000 7f2fbeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fc00ce240 0x7f2fc0147750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35284/0 (socket says 172.21.15.77:35284) 2023-11-04T01:44:36.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.936+0000 7f2fbeffd640 1 -- 172.21.15.77:0/289582166 learned_addr learned my addr 172.21.15.77:0/289582166 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:36.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.936+0000 7f2fbffff640 1 --2- 172.21.15.77:0/289582166 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2fc015daa0 0x7f2fc0158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.936+0000 7f2fbf7fe640 1 --2- 172.21.15.77:0/289582166 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fc00cde60 0x7f2fc01f5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.936+0000 7f2fbeffd640 1 -- 172.21.15.77:0/289582166 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2fc015daa0 msgr2=0x7f2fc0158a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:36.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.936+0000 7f2fbeffd640 1 --2- 172.21.15.77:0/289582166 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2fc015daa0 0x7f2fc0158a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.936+0000 7f2fbeffd640 1 -- 172.21.15.77:0/289582166 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fc00cde60 msgr2=0x7f2fc01f5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:36.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.936+0000 7f2fbeffd640 1 --2- 172.21.15.77:0/289582166 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fc00cde60 0x7f2fc01f5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.936+0000 7f2fbeffd640 1 -- 172.21.15.77:0/289582166 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb8009a70 con 0x7f2fc00ce240 2023-11-04T01:44:36.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.936+0000 7f2fbeffd640 1 --2- 172.21.15.77:0/289582166 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fc00ce240 0x7f2fc0147750 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f2fb400c440 tx=0x7f2fb400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:36.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.936+0000 7f2fa7fff640 1 -- 172.21.15.77:0/289582166 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb40074e0 con 0x7f2fc00ce240 2023-11-04T01:44:36.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.936+0000 7f2fa7fff640 1 -- 172.21.15.77:0/289582166 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb4007640 con 0x7f2fc00ce240 2023-11-04T01:44:36.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.936+0000 7f2fc5a7c640 1 -- 172.21.15.77:0/289582166 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc0146f50 con 0x7f2fc00ce240 2023-11-04T01:44:36.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.936+0000 7f2fa7fff640 1 -- 172.21.15.77:0/289582166 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4004a20 con 0x7f2fc00ce240 2023-11-04T01:44:36.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.936+0000 7f2fc5a7c640 1 -- 172.21.15.77:0/289582166 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc01f5850 con 0x7f2fc00ce240 2023-11-04T01:44:36.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.937+0000 7f2fc5a7c640 1 -- 172.21.15.77:0/289582166 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc01f5a10 con 0x7f2fc00ce240 2023-11-04T01:44:36.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.938+0000 7f2fa7fff640 1 -- 172.21.15.77:0/289582166 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2fb4004b80 con 0x7f2fc00ce240 2023-11-04T01:44:36.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.938+0000 7f2fa7fff640 1 --2- 172.21.15.77:0/289582166 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2fac06aea0 0x7f2fac06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.938+0000 7f2fa7fff640 1 -- 172.21.15.77:0/289582166 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f2fb40895c0 con 0x7f2fc00ce240 2023-11-04T01:44:36.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.938+0000 7f2fbf7fe640 1 --2- 172.21.15.77:0/289582166 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2fac06aea0 0x7f2fac06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.939+0000 7f2fbf7fe640 1 --2- 172.21.15.77:0/289582166 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2fac06aea0 0x7f2fac06d360 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0009aa0 tx=0x7f2fb0008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:36.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:36.942+0000 7f2fa7fff640 1 -- 172.21.15.77:0/289582166 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2fb4054000 con 0x7f2fc00ce240 2023-11-04T01:44:37.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:37.141+0000 7f2fc5a7c640 1 -- 172.21.15.77:0/289582166 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2fc0074290 con 0x7f2fc00ce240 2023-11-04T01:44:37.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:37.142+0000 7f2fa7fff640 1 -- 172.21.15.77:0/289582166 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4149 (secure 0 0 0) 0x7f2fb4057620 con 0x7f2fc00ce240 2023-11-04T01:44:37.144 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:44:37.144 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":60,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:44:36.812154+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":35840,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_35840":{"gid":35840,"name":"b","rank":0,"incarnation":60,"state":"up:replay","state_seq":1,"addr":"172.21.15.122:6836/2908314953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2908314953},{"type":"v1","addr":"172.21.15.122:6836","nonce":2908314953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:37.145 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 60 2023-11-04T01:44:37.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:37.144+0000 7f2fc5a7c640 1 -- 172.21.15.77:0/289582166 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2fac06aea0 msgr2=0x7f2fac06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:37.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:37.144+0000 7f2fc5a7c640 1 --2- 172.21.15.77:0/289582166 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2fac06aea0 0x7f2fac06d360 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0009aa0 tx=0x7f2fb0008040 comp rx=0 tx=0).stop 2023-11-04T01:44:37.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:37.144+0000 7f2fc5a7c640 1 -- 172.21.15.77:0/289582166 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fc00ce240 msgr2=0x7f2fc0147750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:37.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:37.144+0000 7f2fc5a7c640 1 --2- 172.21.15.77:0/289582166 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fc00ce240 0x7f2fc0147750 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f2fb400c440 tx=0x7f2fb400c900 comp rx=0 tx=0).stop 2023-11-04T01:44:37.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:37.144+0000 7f2fc5a7c640 1 -- 172.21.15.77:0/289582166 shutdown_connections 2023-11-04T01:44:37.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:37.144+0000 7f2fc5a7c640 1 --2- 172.21.15.77:0/289582166 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2fac06aea0 0x7f2fac06d360 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:37.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:37.144+0000 7f2fc5a7c640 1 --2- 172.21.15.77:0/289582166 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2fc015daa0 0x7f2fc0158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:37.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:37.144+0000 7f2fc5a7c640 1 --2- 172.21.15.77:0/289582166 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fc00ce240 0x7f2fc0147750 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:37.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:37.144+0000 7f2fc5a7c640 1 --2- 172.21.15.77:0/289582166 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fc00cde60 0x7f2fc01f5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:37.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:37.144+0000 7f2fc5a7c640 1 -- 172.21.15.77:0/289582166 >> 172.21.15.77:0/289582166 conn(0x7f2fc0071f30 msgr2=0x7f2fc00b7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:37.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:37.144+0000 7f2fc5a7c640 1 -- 172.21.15.77:0/289582166 shutdown_connections 2023-11-04T01:44:37.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:37.144+0000 7f2fc5a7c640 1 -- 172.21.15.77:0/289582166 wait complete. 2023-11-04T01:44:37.156 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:44:40.193 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-11-04T01:44:42.158 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:42.262 INFO:tasks.ceph.mds.b.smithi122.stderr:2023-11-04T01:44:42.261+0000 7f13b8322640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:44:42.263 INFO:tasks.ceph.mds.b.smithi122.stderr:2023-11-04T01:44:42.261+0000 7f13b8322640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:44:42.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.267+0000 7f71debb6640 1 Processor -- start 2023-11-04T01:44:42.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.267+0000 7f71debb6640 1 -- start start 2023-11-04T01:44:42.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.267+0000 7f71debb6640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71d80ce240 0x7f71d8157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:42.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.267+0000 7f71debb6640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f71d8157540 0x7f71d80d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:42.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.268+0000 7f71debb6640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d815e000 con 0x7f71d80cde60 2023-11-04T01:44:42.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.268+0000 7f71debb6640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d815e5c0 con 0x7f71d8157540 2023-11-04T01:44:42.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.268+0000 7f71debb6640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d815e2e0 con 0x7f71d80ce240 2023-11-04T01:44:42.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.268+0000 7f71d7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71d80ce240 0x7f71d8157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:42.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.268+0000 7f71dd153640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f71d8157540 0x7f71d80d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:42.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.268+0000 7f71dc952640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f71d80cde60 0x7f71d815d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:58014/0 (socket says 172.21.15.77:58014) 2023-11-04T01:44:42.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.268+0000 7f71d7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71d80ce240 0x7f71d8157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:35388/0 (socket says 172.21.15.77:35388) 2023-11-04T01:44:42.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.268+0000 7f71dc952640 1 -- 172.21.15.77:0/974359865 learned_addr learned my addr 172.21.15.77:0/974359865 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:44:42.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.268+0000 7f71d7fff640 1 -- 172.21.15.77:0/974359865 >> v2:172.21.15.122:3300/0 conn(0x7f71d8157540 msgr2=0x7f71d80d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:42.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.268+0000 7f71d7fff640 1 --2- 172.21.15.77:0/974359865 >> v2:172.21.15.122:3300/0 conn(0x7f71d8157540 0x7f71d80d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:42.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.268+0000 7f71d7fff640 1 -- 172.21.15.77:0/974359865 >> v1:172.21.15.122:6789/0 conn(0x7f71d80cde60 legacy=0x7f71d815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:42.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.268+0000 7f71d7fff640 1 -- 172.21.15.77:0/974359865 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d80d1120 con 0x7f71d80ce240 2023-11-04T01:44:42.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.268+0000 7f71dd153640 1 --2- 172.21.15.77:0/974359865 >> v2:172.21.15.122:3300/0 conn(0x7f71d8157540 0x7f71d80d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:44:42.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.269+0000 7f71d7fff640 1 --2- 172.21.15.77:0/974359865 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71d80ce240 0x7f71d8157000 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f71c40097a0 tx=0x7f71c402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb6bc099b0b7fc7d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:42.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.269+0000 7f71d77fe640 1 -- 172.21.15.77:0/974359865 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c4031830 con 0x7f71d80ce240 2023-11-04T01:44:42.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.269+0000 7f71d77fe640 1 -- 172.21.15.77:0/974359865 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c4031990 con 0x7f71d80ce240 2023-11-04T01:44:42.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.269+0000 7f71d77fe640 1 -- 172.21.15.77:0/974359865 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c4031d20 con 0x7f71d80ce240 2023-11-04T01:44:42.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.270+0000 7f71debb6640 1 -- 172.21.15.77:0/974359865 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71d80ce240 msgr2=0x7f71d8157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:42.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.270+0000 7f71debb6640 1 --2- 172.21.15.77:0/974359865 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71d80ce240 0x7f71d8157000 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f71c40097a0 tx=0x7f71c402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:44:42.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.270+0000 7f71debb6640 1 -- 172.21.15.77:0/974359865 shutdown_connections 2023-11-04T01:44:42.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.270+0000 7f71debb6640 1 --2- 172.21.15.77:0/974359865 >> v2:172.21.15.122:3300/0 conn(0x7f71d8157540 0x7f71d80d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:42.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.270+0000 7f71debb6640 1 --2- 172.21.15.77:0/974359865 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71d80ce240 0x7f71d8157000 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:42.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.270+0000 7f71debb6640 1 -- 172.21.15.77:0/974359865 >> 172.21.15.77:0/974359865 conn(0x7f71d8071f30 msgr2=0x7f71d80cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:42.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.270+0000 7f71debb6640 1 -- 172.21.15.77:0/974359865 shutdown_connections 2023-11-04T01:44:42.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.270+0000 7f71debb6640 1 -- 172.21.15.77:0/974359865 wait complete. 2023-11-04T01:44:42.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.271+0000 7f71debb6640 1 Processor -- start 2023-11-04T01:44:42.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.271+0000 7f71debb6640 1 -- start start 2023-11-04T01:44:42.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.272+0000 7f71debb6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71d80cde60 0x7f71d81502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:42.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.272+0000 7f71debb6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71d80ce240 0x7f71d80b4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:42.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.272+0000 7f71debb6640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71d8157540 0x7f71d80cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:42.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.272+0000 7f71debb6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d8150820 con 0x7f71d80cde60 2023-11-04T01:44:42.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.272+0000 7f71debb6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d80c9ef0 con 0x7f71d80ce240 2023-11-04T01:44:42.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.272+0000 7f71debb6640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d80cad50 con 0x7f71d8157540 2023-11-04T01:44:42.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.272+0000 7f71dc952640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71d80cde60 0x7f71d81502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:42.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.272+0000 7f71dc952640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71d80cde60 0x7f71d81502e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52798/0 (socket says 172.21.15.77:52798) 2023-11-04T01:44:42.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.272+0000 7f71dc952640 1 -- 172.21.15.77:0/2466942401 learned_addr learned my addr 172.21.15.77:0/2466942401 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:42.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.273+0000 7f71dd153640 1 --2- 172.21.15.77:0/2466942401 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71d8157540 0x7f71d80cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:42.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.273+0000 7f71d7fff640 1 --2- 172.21.15.77:0/2466942401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71d80ce240 0x7f71d80b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:42.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.273+0000 7f71dc952640 1 -- 172.21.15.77:0/2466942401 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71d8157540 msgr2=0x7f71d80cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:42.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.273+0000 7f71dc952640 1 --2- 172.21.15.77:0/2466942401 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71d8157540 0x7f71d80cb9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:42.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.273+0000 7f71dc952640 1 -- 172.21.15.77:0/2466942401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71d80ce240 msgr2=0x7f71d80b4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:42.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.273+0000 7f71dc952640 1 --2- 172.21.15.77:0/2466942401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71d80ce240 0x7f71d80b4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:42.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.273+0000 7f71dc952640 1 -- 172.21.15.77:0/2466942401 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d0009a70 con 0x7f71d80cde60 2023-11-04T01:44:42.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.273+0000 7f71dc952640 1 --2- 172.21.15.77:0/2466942401 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71d80cde60 0x7f71d81502e0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f71cc00c4d0 tx=0x7f71cc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:42.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.273+0000 7f71d57fa640 1 -- 172.21.15.77:0/2466942401 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc005ce0 con 0x7f71d80cde60 2023-11-04T01:44:42.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.273+0000 7f71d57fa640 1 -- 172.21.15.77:0/2466942401 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71cc005e40 con 0x7f71d80cde60 2023-11-04T01:44:42.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.273+0000 7f71d57fa640 1 -- 172.21.15.77:0/2466942401 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc007270 con 0x7f71d80cde60 2023-11-04T01:44:42.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.273+0000 7f71debb6640 1 -- 172.21.15.77:0/2466942401 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c4009400 con 0x7f71d80cde60 2023-11-04T01:44:42.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.273+0000 7f71debb6640 1 -- 172.21.15.77:0/2466942401 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d80ca140 con 0x7f71d80cde60 2023-11-04T01:44:42.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.274+0000 7f71debb6640 1 -- 172.21.15.77:0/2466942401 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d80cfea0 con 0x7f71d80cde60 2023-11-04T01:44:42.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.274+0000 7f71d57fa640 1 -- 172.21.15.77:0/2466942401 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f71cc0073d0 con 0x7f71d80cde60 2023-11-04T01:44:42.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.275+0000 7f71d57fa640 1 --2- 172.21.15.77:0/2466942401 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f71bc06aea0 0x7f71bc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:42.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.275+0000 7f71d57fa640 1 -- 172.21.15.77:0/2466942401 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f71cc089090 con 0x7f71d80cde60 2023-11-04T01:44:42.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.275+0000 7f71d7fff640 1 --2- 172.21.15.77:0/2466942401 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f71bc06aea0 0x7f71bc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:42.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.276+0000 7f71d7fff640 1 --2- 172.21.15.77:0/2466942401 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f71bc06aea0 0x7f71bc06d360 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f71c4036000 tx=0x7f71c4008030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:42.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.279+0000 7f71d57fa640 1 -- 172.21.15.77:0/2466942401 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f71cc053c10 con 0x7f71d80cde60 2023-11-04T01:44:42.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.487+0000 7f71debb6640 1 -- 172.21.15.77:0/2466942401 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71d8074290 con 0x7f71d80cde60 2023-11-04T01:44:42.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.488+0000 7f71d57fa640 1 -- 172.21.15.77:0/2466942401 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f71cc017090 con 0x7f71d80cde60 2023-11-04T01:44:42.491 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:44:42.491 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":64,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7743,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/285184758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":285184758},{"type":"v1","addr":"172.21.15.77:6834","nonce":285184758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:44:39.830971+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":35840,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_35840":{"gid":35840,"name":"b","rank":0,"incarnation":60,"state":"up:active","state_seq":11,"addr":"172.21.15.122:6836/2908314953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2908314953},{"type":"v1","addr":"172.21.15.122:6836","nonce":2908314953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:42.491 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 64 2023-11-04T01:44:42.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.490+0000 7f71debb6640 1 -- 172.21.15.77:0/2466942401 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f71bc06aea0 msgr2=0x7f71bc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:42.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.490+0000 7f71debb6640 1 --2- 172.21.15.77:0/2466942401 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f71bc06aea0 0x7f71bc06d360 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f71c4036000 tx=0x7f71c4008030 comp rx=0 tx=0).stop 2023-11-04T01:44:42.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.490+0000 7f71debb6640 1 -- 172.21.15.77:0/2466942401 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71d80cde60 msgr2=0x7f71d81502e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:42.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.490+0000 7f71debb6640 1 --2- 172.21.15.77:0/2466942401 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71d80cde60 0x7f71d81502e0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f71cc00c4d0 tx=0x7f71cc00c990 comp rx=0 tx=0).stop 2023-11-04T01:44:42.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.490+0000 7f71debb6640 1 -- 172.21.15.77:0/2466942401 shutdown_connections 2023-11-04T01:44:42.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.490+0000 7f71debb6640 1 --2- 172.21.15.77:0/2466942401 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f71bc06aea0 0x7f71bc06d360 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:42.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.490+0000 7f71debb6640 1 --2- 172.21.15.77:0/2466942401 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f71d8157540 0x7f71d80cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:42.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.490+0000 7f71debb6640 1 --2- 172.21.15.77:0/2466942401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71d80ce240 0x7f71d80b4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:42.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.490+0000 7f71debb6640 1 --2- 172.21.15.77:0/2466942401 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71d80cde60 0x7f71d81502e0 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:42.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.490+0000 7f71debb6640 1 -- 172.21.15.77:0/2466942401 >> 172.21.15.77:0/2466942401 conn(0x7f71d8071f30 msgr2=0x7f71d80b5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:42.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.490+0000 7f71debb6640 1 -- 172.21.15.77:0/2466942401 shutdown_connections 2023-11-04T01:44:42.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.490+0000 7f71debb6640 1 -- 172.21.15.77:0/2466942401 wait complete. 2023-11-04T01:44:42.503 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:44:42.503 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:42.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.601+0000 7f70d6b3c640 1 Processor -- start 2023-11-04T01:44:42.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.601+0000 7f70d6b3c640 1 -- start start 2023-11-04T01:44:42.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.602+0000 7f70d6b3c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70d00ce370 0x7f70d006db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:42.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.602+0000 7f70d6b3c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d006e060 con 0x7f70d0159c70 2023-11-04T01:44:42.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.602+0000 7f70d6b3c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d00b4110 con 0x7f70d00b0ae0 2023-11-04T01:44:42.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.602+0000 7f70d6b3c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d00b49b0 con 0x7f70d00ce370 2023-11-04T01:44:42.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.602+0000 7f70d48d8640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f70d0159c70 0x7f70d00b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:47188/0 (socket says 172.21.15.77:47188) 2023-11-04T01:44:42.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.602+0000 7f70d48d8640 1 -- 172.21.15.77:0/1088846320 learned_addr learned my addr 172.21.15.77:0/1088846320 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:44:42.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.602+0000 7f70d50d9640 1 --2- 172.21.15.77:0/1088846320 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70d00ce370 0x7f70d006db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:42.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.602+0000 7f70cf7fe640 1 -- 172.21.15.77:0/1088846320 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3526002691 0 0) 0x7f70d006e060 con 0x7f70d0159c70 2023-11-04T01:44:42.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.602+0000 7f70cf7fe640 1 -- 172.21.15.77:0/1088846320 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70c0003520 con 0x7f70d0159c70 2023-11-04T01:44:42.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.602+0000 7f70cf7fe640 1 -- 172.21.15.77:0/1088846320 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2848585315 0 0) 0x7f70d00b4110 con 0x7f70d00b0ae0 2023-11-04T01:44:42.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.602+0000 7f70d50d9640 1 -- 172.21.15.77:0/1088846320 >> v1:172.21.15.122:6789/0 conn(0x7f70d00b0ae0 legacy=0x7f70d015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:42.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.602+0000 7f70d50d9640 1 -- 172.21.15.77:0/1088846320 >> v1:172.21.15.77:6789/0 conn(0x7f70d0159c70 legacy=0x7f70d00b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:42.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.602+0000 7f70d50d9640 1 -- 172.21.15.77:0/1088846320 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d00b43f0 con 0x7f70d00ce370 2023-11-04T01:44:42.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.603+0000 7f70d50d9640 1 --2- 172.21.15.77:0/1088846320 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70d00ce370 0x7f70d006db20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f70c8009dc0 tx=0x7f70c802bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d82b371f99b67bd4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:42.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.603+0000 7f70cf7fe640 1 -- 172.21.15.77:0/1088846320 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c802ccd0 con 0x7f70d00ce370 2023-11-04T01:44:42.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.603+0000 7f70cf7fe640 1 -- 172.21.15.77:0/1088846320 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c802ce30 con 0x7f70d00ce370 2023-11-04T01:44:42.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.603+0000 7f70cf7fe640 1 -- 172.21.15.77:0/1088846320 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c8034640 con 0x7f70d00ce370 2023-11-04T01:44:42.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.604+0000 7f70d6b3c640 1 -- 172.21.15.77:0/1088846320 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70d00ce370 msgr2=0x7f70d006db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:42.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.604+0000 7f70d6b3c640 1 --2- 172.21.15.77:0/1088846320 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70d00ce370 0x7f70d006db20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f70c8009dc0 tx=0x7f70c802bf20 comp rx=0 tx=0).stop 2023-11-04T01:44:42.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.604+0000 7f70d6b3c640 1 -- 172.21.15.77:0/1088846320 shutdown_connections 2023-11-04T01:44:42.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.604+0000 7f70d6b3c640 1 --2- 172.21.15.77:0/1088846320 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70d00ce370 0x7f70d006db20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:42.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.604+0000 7f70d6b3c640 1 -- 172.21.15.77:0/1088846320 >> 172.21.15.77:0/1088846320 conn(0x7f70d00ce950 msgr2=0x7f70d00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:42.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.604+0000 7f70d6b3c640 1 -- 172.21.15.77:0/1088846320 shutdown_connections 2023-11-04T01:44:42.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.604+0000 7f70d6b3c640 1 -- 172.21.15.77:0/1088846320 wait complete. 2023-11-04T01:44:42.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.605+0000 7f70d6b3c640 1 Processor -- start 2023-11-04T01:44:42.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.605+0000 7f70d6b3c640 1 -- start start 2023-11-04T01:44:42.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.606+0000 7f70d6b3c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70d00b0ae0 0x7f70d0157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:42.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.606+0000 7f70d6b3c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70d00ce370 0x7f70d01f5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:42.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.606+0000 7f70d6b3c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70d0159c70 0x7f70d01f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:42.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.606+0000 7f70d6b3c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d01577d0 con 0x7f70d00ce370 2023-11-04T01:44:42.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.606+0000 7f70d6b3c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d00b1fc0 con 0x7f70d00b0ae0 2023-11-04T01:44:42.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.606+0000 7f70d6b3c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d01f6dc0 con 0x7f70d0159c70 2023-11-04T01:44:42.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.606+0000 7f70cffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70d00ce370 0x7f70d01f5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:42.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.606+0000 7f70cffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70d00ce370 0x7f70d01f5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52810/0 (socket says 172.21.15.77:52810) 2023-11-04T01:44:42.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.606+0000 7f70cffff640 1 -- 172.21.15.77:0/4151656285 learned_addr learned my addr 172.21.15.77:0/4151656285 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:42.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.606+0000 7f70d50d9640 1 --2- 172.21.15.77:0/4151656285 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70d0159c70 0x7f70d01f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:42.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.606+0000 7f70d48d8640 1 --2- 172.21.15.77:0/4151656285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70d00b0ae0 0x7f70d0157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:42.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.606+0000 7f70cffff640 1 -- 172.21.15.77:0/4151656285 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70d0159c70 msgr2=0x7f70d01f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:42.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.606+0000 7f70cffff640 1 --2- 172.21.15.77:0/4151656285 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70d0159c70 0x7f70d01f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:42.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.606+0000 7f70cffff640 1 -- 172.21.15.77:0/4151656285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70d00b0ae0 msgr2=0x7f70d0157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:42.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.606+0000 7f70cffff640 1 --2- 172.21.15.77:0/4151656285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70d00b0ae0 0x7f70d0157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:42.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.606+0000 7f70cffff640 1 -- 172.21.15.77:0/4151656285 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c8009a70 con 0x7f70d00ce370 2023-11-04T01:44:42.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.606+0000 7f70d50d9640 1 --2- 172.21.15.77:0/4151656285 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70d0159c70 0x7f70d01f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:42.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.606+0000 7f70cffff640 1 --2- 172.21.15.77:0/4151656285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70d00ce370 0x7f70d01f5f70 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f70bc00c4b0 tx=0x7f70bc00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:42.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.606+0000 7f70cd7fa640 1 -- 172.21.15.77:0/4151656285 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70bc005480 con 0x7f70d00ce370 2023-11-04T01:44:42.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.606+0000 7f70cd7fa640 1 -- 172.21.15.77:0/4151656285 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70bc0035f0 con 0x7f70d00ce370 2023-11-04T01:44:42.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.606+0000 7f70cd7fa640 1 -- 172.21.15.77:0/4151656285 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70bc0039a0 con 0x7f70d00ce370 2023-11-04T01:44:42.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.606+0000 7f70d6b3c640 1 -- 172.21.15.77:0/4151656285 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d01f6ae0 con 0x7f70d00ce370 2023-11-04T01:44:42.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.607+0000 7f70d6b3c640 1 -- 172.21.15.77:0/4151656285 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d00b1c50 con 0x7f70d00ce370 2023-11-04T01:44:42.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.607+0000 7f70d6b3c640 1 -- 172.21.15.77:0/4151656285 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d00b2170 con 0x7f70d00ce370 2023-11-04T01:44:42.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.608+0000 7f70cd7fa640 1 -- 172.21.15.77:0/4151656285 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f70bc003b00 con 0x7f70d00ce370 2023-11-04T01:44:42.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.608+0000 7f70cd7fa640 1 --2- 172.21.15.77:0/4151656285 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f70b406ae70 0x7f70b406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:42.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.609+0000 7f70cd7fa640 1 -- 172.21.15.77:0/4151656285 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f70bc089210 con 0x7f70d00ce370 2023-11-04T01:44:42.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.609+0000 7f70d48d8640 1 --2- 172.21.15.77:0/4151656285 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f70b406ae70 0x7f70b406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:42.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.609+0000 7f70d48d8640 1 --2- 172.21.15.77:0/4151656285 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f70b406ae70 0x7f70b406d330 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f70c4007fd0 tx=0x7f70c4009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:42.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.613+0000 7f70cd7fa640 1 -- 172.21.15.77:0/4151656285 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f70d00b2170 con 0x7f70d00ce370 2023-11-04T01:44:42.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.815+0000 7f70d6b3c640 1 -- 172.21.15.77:0/4151656285 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70d00c9730 con 0x7f70d00ce370 2023-11-04T01:44:42.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.815+0000 7f70cd7fa640 1 -- 172.21.15.77:0/4151656285 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f70bc017090 con 0x7f70d00ce370 2023-11-04T01:44:42.818 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:44:42.819 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":64,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7743,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/285184758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":285184758},{"type":"v1","addr":"172.21.15.77:6834","nonce":285184758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:44:39.830971+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":35840,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_35840":{"gid":35840,"name":"b","rank":0,"incarnation":60,"state":"up:active","state_seq":11,"addr":"172.21.15.122:6836/2908314953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2908314953},{"type":"v1","addr":"172.21.15.122:6836","nonce":2908314953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:42.820 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 64 2023-11-04T01:44:42.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.817+0000 7f70d6b3c640 1 -- 172.21.15.77:0/4151656285 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f70b406ae70 msgr2=0x7f70b406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:42.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.817+0000 7f70d6b3c640 1 --2- 172.21.15.77:0/4151656285 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f70b406ae70 0x7f70b406d330 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f70c4007fd0 tx=0x7f70c4009040 comp rx=0 tx=0).stop 2023-11-04T01:44:42.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.817+0000 7f70d6b3c640 1 -- 172.21.15.77:0/4151656285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70d00ce370 msgr2=0x7f70d01f5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:42.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.817+0000 7f70d6b3c640 1 --2- 172.21.15.77:0/4151656285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70d00ce370 0x7f70d01f5f70 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f70bc00c4b0 tx=0x7f70bc00c970 comp rx=0 tx=0).stop 2023-11-04T01:44:42.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.817+0000 7f70d6b3c640 1 -- 172.21.15.77:0/4151656285 shutdown_connections 2023-11-04T01:44:42.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.817+0000 7f70d6b3c640 1 --2- 172.21.15.77:0/4151656285 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f70b406ae70 0x7f70b406d330 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:42.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.817+0000 7f70d6b3c640 1 --2- 172.21.15.77:0/4151656285 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f70d0159c70 0x7f70d01f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:42.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.817+0000 7f70d6b3c640 1 --2- 172.21.15.77:0/4151656285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70d00ce370 0x7f70d01f5f70 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:42.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.817+0000 7f70d6b3c640 1 --2- 172.21.15.77:0/4151656285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70d00b0ae0 0x7f70d0157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:42.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.817+0000 7f70d6b3c640 1 -- 172.21.15.77:0/4151656285 >> 172.21.15.77:0/4151656285 conn(0x7f70d00ce950 msgr2=0x7f70d015dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:42.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.817+0000 7f70d6b3c640 1 -- 172.21.15.77:0/4151656285 shutdown_connections 2023-11-04T01:44:42.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:42.817+0000 7f70d6b3c640 1 -- 172.21.15.77:0/4151656285 wait complete. 2023-11-04T01:44:43.233 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 64, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-04T01:43:26.273417+0000', 'modified': '2023-11-04T01:44:39.830971+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 100, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 35840, 'mds_1': 7305}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7305': {'gid': 7305, 'name': 'c', 'rank': 1, 'incarnation': 46, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.77:6835/3207490604', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6833', 'nonce': 3207490604}, {'type': 'v1', 'addr': '172.21.15.77:6835', 'nonce': 3207490604}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_35840': {'gid': 35840, 'name': 'b', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.122:6836/2908314953', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6834', 'nonce': 2908314953}, {'type': 'v1', 'addr': '172.21.15.122:6836', 'nonce': 2908314953}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:44:43.233 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-11-04T01:44:43.234 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-04T01:44:43.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.333+0000 7f320880e640 1 Processor -- start 2023-11-04T01:44:43.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.333+0000 7f320880e640 1 -- start start 2023-11-04T01:44:43.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.334+0000 7f320880e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f320415ad30 0x7f32040adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.334+0000 7f320880e640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f32040ad730 0x7f3204070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.334+0000 7f320880e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32040c3900 con 0x7f3204070c50 2023-11-04T01:44:43.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.334+0000 7f320880e640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32040ae260 con 0x7f32040ad730 2023-11-04T01:44:43.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.334+0000 7f320880e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f320415f750 con 0x7f320415ad30 2023-11-04T01:44:43.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.334+0000 7f3202d9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f3204070c50 0x7f32040c8fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:47190/0 (socket says 172.21.15.77:47190) 2023-11-04T01:44:43.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.334+0000 7f3202d9d640 1 -- 172.21.15.77:0/3312466656 learned_addr learned my addr 172.21.15.77:0/3312466656 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:44:43.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.334+0000 7f31fbfff640 1 --2- 172.21.15.77:0/3312466656 >> v2:172.21.15.122:3300/0 conn(0x7f32040ad730 0x7f3204070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.334+0000 7f320259c640 1 --2- 172.21.15.77:0/3312466656 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f320415ad30 0x7f32040adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.334+0000 7f3201d9b640 1 -- 172.21.15.77:0/3312466656 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 614079400 0 0) 0x7f32040c3900 con 0x7f3204070c50 2023-11-04T01:44:43.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.334+0000 7f3201d9b640 1 -- 172.21.15.77:0/3312466656 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31f0003520 con 0x7f3204070c50 2023-11-04T01:44:43.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.334+0000 7f3201d9b640 1 -- 172.21.15.77:0/3312466656 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 117494465 0 0) 0x7f31f0003520 con 0x7f3204070c50 2023-11-04T01:44:43.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.334+0000 7f3201d9b640 1 -- 172.21.15.77:0/3312466656 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f320415ad30 msgr2=0x7f32040adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:43.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.334+0000 7f3201d9b640 1 --2- 172.21.15.77:0/3312466656 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f320415ad30 0x7f32040adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.334+0000 7f3201d9b640 1 -- 172.21.15.77:0/3312466656 >> v2:172.21.15.122:3300/0 conn(0x7f32040ad730 msgr2=0x7f3204070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:43.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.334+0000 7f3201d9b640 1 --2- 172.21.15.77:0/3312466656 >> v2:172.21.15.122:3300/0 conn(0x7f32040ad730 0x7f3204070710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.334+0000 7f3201d9b640 1 -- 172.21.15.77:0/3312466656 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32040c3be0 con 0x7f3204070c50 2023-11-04T01:44:43.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.334+0000 7f3201d9b640 1 -- 172.21.15.77:0/3312466656 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f31fc0019f0 con 0x7f3204070c50 2023-11-04T01:44:43.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.334+0000 7f3201d9b640 1 -- 172.21.15.77:0/3312466656 >> v1:172.21.15.77:6789/0 conn(0x7f3204070c50 legacy=0x7f32040c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.334+0000 7f3201d9b640 1 --2- 172.21.15.77:0/3312466656 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f320415ad30 0x7f31f0003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.334+0000 7f3201d9b640 1 --2- 172.21.15.77:0/3312466656 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31f0003ef0 0x7f31f00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.334+0000 7f3201d9b640 1 --2- 172.21.15.77:0/3312466656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31f0004d00 0x7f31f0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.334+0000 7f3201d9b640 1 -- 172.21.15.77:0/3312466656 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32040ae260 con 0x7f31f0004d00 2023-11-04T01:44:43.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.334+0000 7f3201d9b640 1 -- 172.21.15.77:0/3312466656 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320415f750 con 0x7f31f0003ef0 2023-11-04T01:44:43.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.334+0000 7f3201d9b640 1 -- 172.21.15.77:0/3312466656 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f000b9d0 con 0x7f320415ad30 2023-11-04T01:44:43.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.335+0000 7f3202d9d640 1 --2- 172.21.15.77:0/3312466656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31f0004d00 0x7f31f0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.335+0000 7f320259c640 1 --2- 172.21.15.77:0/3312466656 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f320415ad30 0x7f31f0003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.335+0000 7f31fbfff640 1 --2- 172.21.15.77:0/3312466656 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31f0003ef0 0x7f31f00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.335+0000 7f3202d9d640 1 -- 172.21.15.77:0/3312466656 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f320415ad30 msgr2=0x7f31f0003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:43.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.335+0000 7f3202d9d640 1 --2- 172.21.15.77:0/3312466656 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f320415ad30 0x7f31f0003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.335+0000 7f3202d9d640 1 -- 172.21.15.77:0/3312466656 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31f0003ef0 msgr2=0x7f31f00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:43.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.335+0000 7f3202d9d640 1 --2- 172.21.15.77:0/3312466656 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31f0003ef0 0x7f31f00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.335+0000 7f3202d9d640 1 -- 172.21.15.77:0/3312466656 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f0003520 con 0x7f31f0004d00 2023-11-04T01:44:43.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.335+0000 7f3202d9d640 1 --2- 172.21.15.77:0/3312466656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31f0004d00 0x7f31f0005180 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f31fc00a860 tx=0x7f31f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaf49a9495d1276 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:43.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.336+0000 7f3201d9b640 1 -- 172.21.15.77:0/3312466656 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc0072d0 con 0x7f31f0004d00 2023-11-04T01:44:43.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.336+0000 7f3201d9b640 1 -- 172.21.15.77:0/3312466656 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31fc02f070 con 0x7f31f0004d00 2023-11-04T01:44:43.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.336+0000 7f3201d9b640 1 -- 172.21.15.77:0/3312466656 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc0076f0 con 0x7f31f0004d00 2023-11-04T01:44:43.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.336+0000 7f320880e640 1 -- 172.21.15.77:0/3312466656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31f0004d00 msgr2=0x7f31f0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.336+0000 7f320880e640 1 --2- 172.21.15.77:0/3312466656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31f0004d00 0x7f31f0005180 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f31fc00a860 tx=0x7f31f00057f0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.336+0000 7f3202d9d640 1 -- 172.21.15.77:0/3312466656 reap_dead start 2023-11-04T01:44:43.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.336+0000 7f320880e640 1 -- 172.21.15.77:0/3312466656 shutdown_connections 2023-11-04T01:44:43.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.336+0000 7f320880e640 1 -- 172.21.15.77:0/3312466656 >> 172.21.15.77:0/3312466656 conn(0x7f32040ce950 msgr2=0x7f32040ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:43.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.336+0000 7f320880e640 1 -- 172.21.15.77:0/3312466656 shutdown_connections 2023-11-04T01:44:43.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.336+0000 7f320880e640 1 -- 172.21.15.77:0/3312466656 wait complete. 2023-11-04T01:44:43.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.337+0000 7f320880e640 1 Processor -- start 2023-11-04T01:44:43.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.338+0000 7f320880e640 1 -- start start 2023-11-04T01:44:43.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.338+0000 7f320880e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31f0004d00 0x7f32040c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.338+0000 7f320880e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32041f5ce0 0x7f320414a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.338+0000 7f320880e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32040c5a20 0x7f32040b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.338+0000 7f320880e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32040c7fc0 con 0x7f31f0004d00 2023-11-04T01:44:43.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.338+0000 7f320880e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32040c77b0 con 0x7f32041f5ce0 2023-11-04T01:44:43.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.338+0000 7f320880e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32041f6250 con 0x7f32040c5a20 2023-11-04T01:44:43.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.338+0000 7f320259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31f0004d00 0x7f32040c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.338+0000 7f320259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31f0004d00 0x7f32040c7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52836/0 (socket says 172.21.15.77:52836) 2023-11-04T01:44:43.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.338+0000 7f320259c640 1 -- 172.21.15.77:0/3388615464 learned_addr learned my addr 172.21.15.77:0/3388615464 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:43.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.338+0000 7f3202d9d640 1 --2- 172.21.15.77:0/3388615464 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32040c5a20 0x7f32040b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.338+0000 7f31fbfff640 1 --2- 172.21.15.77:0/3388615464 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32041f5ce0 0x7f320414a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.339+0000 7f320259c640 1 -- 172.21.15.77:0/3388615464 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32040c5a20 msgr2=0x7f32040b39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.339+0000 7f320259c640 1 --2- 172.21.15.77:0/3388615464 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32040c5a20 0x7f32040b39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.339+0000 7f320259c640 1 -- 172.21.15.77:0/3388615464 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32041f5ce0 msgr2=0x7f320414a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.339+0000 7f320259c640 1 --2- 172.21.15.77:0/3388615464 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32041f5ce0 0x7f320414a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.339+0000 7f320259c640 1 -- 172.21.15.77:0/3388615464 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32041f6530 con 0x7f31f0004d00 2023-11-04T01:44:43.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.339+0000 7f320259c640 1 --2- 172.21.15.77:0/3388615464 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31f0004d00 0x7f32040c7a80 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f31f40119d0 tx=0x7f31f4011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:43.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.339+0000 7f31faffd640 1 -- 172.21.15.77:0/3388615464 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f400fb50 con 0x7f31f0004d00 2023-11-04T01:44:43.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.339+0000 7f31faffd640 1 -- 172.21.15.77:0/3388615464 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f400fcb0 con 0x7f31f0004d00 2023-11-04T01:44:43.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.339+0000 7f320880e640 1 -- 172.21.15.77:0/3388615464 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32041f6810 con 0x7f31f0004d00 2023-11-04T01:44:43.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.339+0000 7f31faffd640 1 -- 172.21.15.77:0/3388615464 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f4014440 con 0x7f31f0004d00 2023-11-04T01:44:43.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.339+0000 7f320880e640 1 -- 172.21.15.77:0/3388615464 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32041f26f0 con 0x7f31f0004d00 2023-11-04T01:44:43.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.340+0000 7f31faffd640 1 -- 172.21.15.77:0/3388615464 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f31f40145a0 con 0x7f31f0004d00 2023-11-04T01:44:43.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.341+0000 7f31faffd640 1 --2- 172.21.15.77:0/3388615464 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f31e406ae70 0x7f31e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.341+0000 7f31faffd640 1 -- 172.21.15.77:0/3388615464 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f31f408a4e0 con 0x7f31f0004d00 2023-11-04T01:44:43.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.341+0000 7f31fbfff640 1 --2- 172.21.15.77:0/3388615464 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f31e406ae70 0x7f31e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.341+0000 7f31fbfff640 1 --2- 172.21.15.77:0/3388615464 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f31e406ae70 0x7f31e406d330 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f320406d080 tx=0x7f31ec008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:43.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.342+0000 7f320b39d740 1 Processor -- start 2023-11-04T01:44:43.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.342+0000 7f320b39d740 1 -- start start 2023-11-04T01:44:43.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.343+0000 7f320b39d740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55d138c10850 0x55d138be3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.343+0000 7f320b39d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d138c10c30 0x55d138c135e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.343+0000 7f320b39d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d138be3c90 0x55d138c13b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.343+0000 7f320b39d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d138af4740 con 0x55d138be3c90 2023-11-04T01:44:43.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.343+0000 7f320b39d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d138b568d0 con 0x55d138c10c30 2023-11-04T01:44:43.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.343+0000 7f320b39d740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d138b53fc0 con 0x55d138c10850 2023-11-04T01:44:43.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.343+0000 7f3202d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d138be3c90 0x55d138c13b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.343+0000 7f3202d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d138be3c90 0x55d138c13b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52848/0 (socket says 172.21.15.77:52848) 2023-11-04T01:44:43.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.343+0000 7f3202d9d640 1 -- 172.21.15.77:0/4081149390 learned_addr learned my addr 172.21.15.77:0/4081149390 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:43.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.343+0000 7f320259c640 1 --2- 172.21.15.77:0/4081149390 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55d138c10850 0x55d138be3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.343+0000 7f31fbfff640 1 --2- 172.21.15.77:0/4081149390 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d138c10c30 0x55d138c135e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.343+0000 7f3202d9d640 1 -- 172.21.15.77:0/4081149390 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55d138c10850 msgr2=0x55d138be3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:43.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.343+0000 7f3202d9d640 1 --2- 172.21.15.77:0/4081149390 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55d138c10850 0x55d138be3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.343+0000 7f3202d9d640 1 -- 172.21.15.77:0/4081149390 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d138c10c30 msgr2=0x55d138c135e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:43.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.343+0000 7f3202d9d640 1 --2- 172.21.15.77:0/4081149390 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d138c10c30 0x55d138c135e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.343+0000 7f3202d9d640 1 -- 172.21.15.77:0/4081149390 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d138b12ca0 con 0x55d138be3c90 2023-11-04T01:44:43.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.343+0000 7f320259c640 1 --2- 172.21.15.77:0/4081149390 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55d138c10850 0x55d138be3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:43.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.343+0000 7f31fbfff640 1 --2- 172.21.15.77:0/4081149390 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d138c10c30 0x55d138c135e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:43.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.343+0000 7f3202d9d640 1 --2- 172.21.15.77:0/4081149390 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d138be3c90 0x55d138c13b20 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f31fc00a860 tx=0x7f31fc02f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3fbcdfec1357c76 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:43.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.343+0000 7f31e3fff640 1 -- 172.21.15.77:0/4081149390 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc0019b0 con 0x55d138be3c90 2023-11-04T01:44:43.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.343+0000 7f31e3fff640 1 -- 172.21.15.77:0/4081149390 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31fc001250 con 0x55d138be3c90 2023-11-04T01:44:43.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.343+0000 7f31e3fff640 1 -- 172.21.15.77:0/4081149390 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc004d60 con 0x55d138be3c90 2023-11-04T01:44:43.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.344+0000 7f320b39d740 1 -- 172.21.15.77:0/4081149390 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d138be3c90 msgr2=0x55d138c13b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.344+0000 7f320b39d740 1 --2- 172.21.15.77:0/4081149390 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d138be3c90 0x55d138c13b20 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f31fc00a860 tx=0x7f31fc02f000 comp rx=0 tx=0).stop 2023-11-04T01:44:43.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.344+0000 7f320b39d740 1 -- 172.21.15.77:0/4081149390 shutdown_connections 2023-11-04T01:44:43.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.344+0000 7f320b39d740 1 --2- 172.21.15.77:0/4081149390 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d138be3c90 0x55d138c13b20 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.344+0000 7f320b39d740 1 --2- 172.21.15.77:0/4081149390 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d138c10c30 0x55d138c135e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.344+0000 7f320b39d740 1 --2- 172.21.15.77:0/4081149390 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55d138c10850 0x55d138be3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.344+0000 7f320b39d740 1 -- 172.21.15.77:0/4081149390 >> 172.21.15.77:0/4081149390 conn(0x55d138be5a60 msgr2=0x55d138c2e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:43.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.344+0000 7f320b39d740 1 -- 172.21.15.77:0/4081149390 shutdown_connections 2023-11-04T01:44:43.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.344+0000 7f320b39d740 1 -- 172.21.15.77:0/4081149390 wait complete. 2023-11-04T01:44:43.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.345+0000 7f320b39d740 1 -- start start 2023-11-04T01:44:43.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.345+0000 7f320b39d740 1 Processor -- start 2023-11-04T01:44:43.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.346+0000 7f320b39d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d138c10850 0x55d138c150a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.346+0000 7f320b39d740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55d138c10c30 0x55d138bfe2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.346+0000 7f320b39d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d138c276b0 0x55d138c27b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.346+0000 7f320b39d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d138b4f8b0 con 0x55d138c10850 2023-11-04T01:44:43.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.346+0000 7f320b39d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d138b09c80 con 0x55d138c276b0 2023-11-04T01:44:43.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.346+0000 7f320b39d740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d138b09920 con 0x55d138c10c30 2023-11-04T01:44:43.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.346+0000 7f320b39d740 10 client.0 _ll_register_callbacks cb 0x55d138861ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:44:43.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.346+0000 7f320259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d138c10850 0x55d138c150a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.346+0000 7f320259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d138c10850 0x55d138c150a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52860/0 (socket says 172.21.15.77:52860) 2023-11-04T01:44:43.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.346+0000 7f320259c640 1 -- 172.21.15.77:0/1433076326 learned_addr learned my addr 172.21.15.77:0/1433076326 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:43.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.346+0000 7f3202d9d640 1 --2- 172.21.15.77:0/1433076326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d138c276b0 0x55d138c27b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.346+0000 7f31fbfff640 1 --2- 172.21.15.77:0/1433076326 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55d138c10c30 0x55d138bfe2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.346+0000 7f320259c640 1 -- 172.21.15.77:0/1433076326 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55d138c10c30 msgr2=0x55d138bfe2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:43.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.346+0000 7f320259c640 1 --2- 172.21.15.77:0/1433076326 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55d138c10c30 0x55d138bfe2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.346+0000 7f320259c640 1 -- 172.21.15.77:0/1433076326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d138c276b0 msgr2=0x55d138c27b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:43.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.346+0000 7f320259c640 1 --2- 172.21.15.77:0/1433076326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d138c276b0 0x55d138c27b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.346+0000 7f320259c640 1 -- 172.21.15.77:0/1433076326 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f0003520 con 0x55d138c10850 2023-11-04T01:44:43.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.346+0000 7f31fbfff640 1 --2- 172.21.15.77:0/1433076326 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55d138c10c30 0x55d138bfe2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:43.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.346+0000 7f320259c640 1 --2- 172.21.15.77:0/1433076326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d138c10850 0x55d138c150a0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f31f40550e0 tx=0x7f31f4058ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29eb50fc08770b24 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:43.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.346+0000 7f31e17fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:44:43.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.346+0000 7f31e17fa640 1 -- 172.21.15.77:0/1433076326 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f40582d0 con 0x55d138c10850 2023-11-04T01:44:43.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.346+0000 7f31e17fa640 1 -- 172.21.15.77:0/1433076326 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f31f408a0b0 con 0x55d138c10850 2023-11-04T01:44:43.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.346+0000 7f320b39d740 1 -- 172.21.15.77:0/1433076326 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d138afbbf0 con 0x55d138c10850 2023-11-04T01:44:43.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.347+0000 7f31e17fa640 1 -- 172.21.15.77:0/1433076326 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31f4088100 con 0x55d138c10850 2023-11-04T01:44:43.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.347+0000 7f320b39d740 10 client.7767 fetch_fsmap learned FSMap version 64 2023-11-04T01:44:43.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.347+0000 7f320b39d740 1 -- 172.21.15.77:0/1433076326 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) v3 -- 0x55d138b4df30 con 0x55d138c10850 2023-11-04T01:44:43.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.347+0000 7f31e17fa640 1 -- 172.21.15.77:0/1433076326 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d138afbbf0 con 0x55d138c10850 2023-11-04T01:44:43.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.347+0000 7f31e17fa640 1 -- 172.21.15.77:0/1433076326 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 64) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f31f401b020 con 0x55d138c10850 2023-11-04T01:44:43.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.347+0000 7f320b39d740 10 client.7767 fetch_fsmap finished waiting for FSMap version 64 2023-11-04T01:44:43.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.347+0000 7f320b39d740 10 client.7767 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:44:43.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.347+0000 7f320b39d740 20 client.7767 populate_metadata read hostname 'smithi077' 2023-11-04T01:44:43.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.347+0000 7f320b39d740 1 --2- 172.21.15.77:0/1433076326 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x55d138c00600 0x55d138c00a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.347+0000 7f320b39d740 4 client.7767 mds_command: new command op to 7305 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:44:43.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.347+0000 7f320b39d740 1 -- 172.21.15.77:0/1433076326 --> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d138b48890 con 0x55d138c00600 2023-11-04T01:44:43.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.347+0000 7f31fbfff640 1 --2- 172.21.15.77:0/1433076326 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x55d138c00600 0x55d138c00a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.347+0000 7f31e17fa640 10 client.7767 ms_handle_connect on v2:172.21.15.77:6833/3207490604 2023-11-04T01:44:43.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.347+0000 7f31fbfff640 1 --2- 172.21.15.77:0/1433076326 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x55d138c00600 0x55d138c00a90 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8af2458aa3a0539a server_cookie=ab5999c9e19b8f58 in_seq=0 out_seq=0 2023-11-04T01:44:43.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.348+0000 7f31e17fa640 1 -- 172.21.15.77:0/1433076326 <== mds.1 v2:172.21.15.77:6833/3207490604 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d138b48890 con 0x55d138c00600 2023-11-04T01:44:43.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.348+0000 7f31e17fa640 10 client.7767 handle_command_reply: tid=0 2023-11-04T01:44:43.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.348+0000 7f320b39d740 1 client.7767 shutdown 2023-11-04T01:44:43.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.348+0000 7f320b39d740 1 -- 172.21.15.77:0/1433076326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d138c10850 msgr2=0x55d138c150a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.348+0000 7f320b39d740 1 --2- 172.21.15.77:0/1433076326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d138c10850 0x55d138c150a0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f31f40550e0 tx=0x7f31f4058ca0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.348+0000 7f320b39d740 1 -- 172.21.15.77:0/1433076326 shutdown_connections 2023-11-04T01:44:43.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.348+0000 7f320b39d740 1 --2- 172.21.15.77:0/1433076326 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x55d138c00600 0x55d138c00a90 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.348+0000 7f320b39d740 1 --2- 172.21.15.77:0/1433076326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d138c276b0 0x55d138c27b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.348+0000 7f320b39d740 1 --2- 172.21.15.77:0/1433076326 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55d138c10c30 0x55d138bfe2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.348+0000 7f320b39d740 1 --2- 172.21.15.77:0/1433076326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d138c10850 0x55d138c150a0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.348+0000 7f31e17fa640 0 client.7767 ms_handle_reset on v2:172.21.15.77:6833/3207490604 2023-11-04T01:44:43.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.348+0000 7f320b39d740 1 -- 172.21.15.77:0/1433076326 >> 172.21.15.77:0/1433076326 conn(0x55d138be3c90 msgr2=0x55d138be7600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:43.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.348+0000 7f320b39d740 1 -- 172.21.15.77:0/1433076326 shutdown_connections 2023-11-04T01:44:43.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.348+0000 7f320b39d740 1 -- 172.21.15.77:0/1433076326 wait complete. 2023-11-04T01:44:43.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.348+0000 7f320b39d740 20 client.7767 trim_cache size 0 max 16384 2023-11-04T01:44:43.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.364+0000 7f320b39d740 1 Processor -- start 2023-11-04T01:44:43.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.364+0000 7f320b39d740 1 -- start start 2023-11-04T01:44:43.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.365+0000 7f320b39d740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55d138c10850 0x55d138c136b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.365+0000 7f320b39d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d138c10c30 0x55d138c00910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.365+0000 7f320b39d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d138c276b0 0x55d138c00e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.365+0000 7f320b39d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d138acf280 con 0x55d138c276b0 2023-11-04T01:44:43.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.365+0000 7f320b39d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d138be2660 con 0x55d138c10c30 2023-11-04T01:44:43.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.365+0000 7f320b39d740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d138bfeeb0 con 0x55d138c10850 2023-11-04T01:44:43.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.365+0000 7f3202d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d138c276b0 0x55d138c00e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.365+0000 7f3202d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d138c276b0 0x55d138c00e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52868/0 (socket says 172.21.15.77:52868) 2023-11-04T01:44:43.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.365+0000 7f3202d9d640 1 -- 172.21.15.77:0/460496280 learned_addr learned my addr 172.21.15.77:0/460496280 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:43.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.365+0000 7f320259c640 1 --2- 172.21.15.77:0/460496280 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55d138c10850 0x55d138c136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.365+0000 7f31fbfff640 1 --2- 172.21.15.77:0/460496280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d138c10c30 0x55d138c00910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.365+0000 7f3202d9d640 1 -- 172.21.15.77:0/460496280 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55d138c10850 msgr2=0x55d138c136b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:43.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.365+0000 7f3202d9d640 1 --2- 172.21.15.77:0/460496280 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55d138c10850 0x55d138c136b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.365+0000 7f3202d9d640 1 -- 172.21.15.77:0/460496280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d138c10c30 msgr2=0x55d138c00910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:43.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.365+0000 7f3202d9d640 1 --2- 172.21.15.77:0/460496280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d138c10c30 0x55d138c00910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.365+0000 7f3202d9d640 1 -- 172.21.15.77:0/460496280 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d138aebd10 con 0x55d138c276b0 2023-11-04T01:44:43.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.365+0000 7f31fbfff640 1 --2- 172.21.15.77:0/460496280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d138c10c30 0x55d138c00910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:43.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.366+0000 7f3202d9d640 1 --2- 172.21.15.77:0/460496280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d138c276b0 0x55d138c00e50 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f31fc00a980 tx=0x7f31fc030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b88ecd566c810e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:43.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.366+0000 7f31f8ff9640 1 -- 172.21.15.77:0/460496280 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc04f070 con 0x55d138c276b0 2023-11-04T01:44:43.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.366+0000 7f31f8ff9640 1 -- 172.21.15.77:0/460496280 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31fc0017b0 con 0x55d138c276b0 2023-11-04T01:44:43.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.366+0000 7f31f8ff9640 1 -- 172.21.15.77:0/460496280 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc001920 con 0x55d138c276b0 2023-11-04T01:44:43.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.366+0000 7f320b39d740 1 -- 172.21.15.77:0/460496280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d138c276b0 msgr2=0x55d138c00e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.366+0000 7f320b39d740 1 --2- 172.21.15.77:0/460496280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d138c276b0 0x55d138c00e50 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f31fc00a980 tx=0x7f31fc030000 comp rx=0 tx=0).stop 2023-11-04T01:44:43.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.366+0000 7f320b39d740 1 -- 172.21.15.77:0/460496280 shutdown_connections 2023-11-04T01:44:43.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.366+0000 7f320b39d740 1 --2- 172.21.15.77:0/460496280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d138c276b0 0x55d138c00e50 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.366+0000 7f320b39d740 1 --2- 172.21.15.77:0/460496280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d138c10c30 0x55d138c00910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.366+0000 7f320b39d740 1 --2- 172.21.15.77:0/460496280 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55d138c10850 0x55d138c136b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.366+0000 7f320b39d740 1 -- 172.21.15.77:0/460496280 >> 172.21.15.77:0/460496280 conn(0x55d138be3c90 msgr2=0x55d138c31790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:43.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.366+0000 7f320b39d740 1 -- 172.21.15.77:0/460496280 shutdown_connections 2023-11-04T01:44:43.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.366+0000 7f320b39d740 1 -- 172.21.15.77:0/460496280 wait complete. 2023-11-04T01:44:43.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.367+0000 7f320b39d740 1 -- start start 2023-11-04T01:44:43.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.367+0000 7f320b39d740 1 Processor -- start 2023-11-04T01:44:43.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.368+0000 7f320b39d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d138c10850 0x55d138c98dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.368+0000 7f320b39d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d138c10c30 0x55d138c00910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.368+0000 7f320b39d740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55d138c276b0 0x55d138c00e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.368+0000 7f320b39d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d138c017c0 con 0x55d138c10850 2023-11-04T01:44:43.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.368+0000 7f320b39d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d138c240a0 con 0x55d138c10c30 2023-11-04T01:44:43.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.368+0000 7f320b39d740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d138c04b80 con 0x55d138c276b0 2023-11-04T01:44:43.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.368+0000 7f320b39d740 10 client.0 _ll_register_callbacks cb 0x7f31f00036b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:44:43.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.368+0000 7f320259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d138c10850 0x55d138c98dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.368+0000 7f320259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d138c10850 0x55d138c98dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52876/0 (socket says 172.21.15.77:52876) 2023-11-04T01:44:43.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.368+0000 7f320259c640 1 -- 172.21.15.77:0/3093535517 learned_addr learned my addr 172.21.15.77:0/3093535517 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:43.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.368+0000 7f3202d9d640 1 --2- 172.21.15.77:0/3093535517 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55d138c276b0 0x55d138c00e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.368+0000 7f31fbfff640 1 --2- 172.21.15.77:0/3093535517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d138c10c30 0x55d138c00910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.368+0000 7f320259c640 1 -- 172.21.15.77:0/3093535517 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55d138c276b0 msgr2=0x55d138c00e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:43.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.368+0000 7f320259c640 1 --2- 172.21.15.77:0/3093535517 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55d138c276b0 0x55d138c00e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.368+0000 7f320259c640 1 -- 172.21.15.77:0/3093535517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d138c10c30 msgr2=0x55d138c00910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:43.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.368+0000 7f320259c640 1 --2- 172.21.15.77:0/3093535517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d138c10c30 0x55d138c00910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.368+0000 7f320259c640 1 -- 172.21.15.77:0/3093535517 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d138b12ca0 con 0x55d138c10850 2023-11-04T01:44:43.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.368+0000 7f320259c640 1 --2- 172.21.15.77:0/3093535517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d138c10850 0x55d138c98dc0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f31f40119a0 tx=0x7f31f4088270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e71563d03e46094b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:43.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.368+0000 7f31e17fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:44:43.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.369+0000 7f31e17fa640 1 -- 172.21.15.77:0/3093535517 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f4088100 con 0x55d138c10850 2023-11-04T01:44:43.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.369+0000 7f31e17fa640 1 -- 172.21.15.77:0/3093535517 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f31f4060a50 con 0x55d138c10850 2023-11-04T01:44:43.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.369+0000 7f320b39d740 1 -- 172.21.15.77:0/3093535517 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f31fc001250 con 0x55d138c10850 2023-11-04T01:44:43.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.369+0000 7f31e17fa640 1 -- 172.21.15.77:0/3093535517 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31f4058540 con 0x55d138c10850 2023-11-04T01:44:43.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.369+0000 7f320b39d740 10 client.7773 fetch_fsmap learned FSMap version 64 2023-11-04T01:44:43.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.369+0000 7f320b39d740 1 -- 172.21.15.77:0/3093535517 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) v3 -- 0x55d138b11500 con 0x55d138c10850 2023-11-04T01:44:43.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.369+0000 7f31e17fa640 1 -- 172.21.15.77:0/3093535517 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31fc001250 con 0x55d138c10850 2023-11-04T01:44:43.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.369+0000 7f31e17fa640 1 -- 172.21.15.77:0/3093535517 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 64) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f31f40549d0 con 0x55d138c10850 2023-11-04T01:44:43.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.369+0000 7f320b39d740 10 client.7773 fetch_fsmap finished waiting for FSMap version 64 2023-11-04T01:44:43.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.369+0000 7f320b39d740 10 client.7773 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:44:43.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.369+0000 7f320b39d740 20 client.7773 populate_metadata read hostname 'smithi077' 2023-11-04T01:44:43.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.369+0000 7f320b39d740 1 --2- 172.21.15.77:0/3093535517 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x55d138c9cd10 0x55d138c9d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.369+0000 7f320b39d740 4 client.7773 mds_command: new command op to 7305 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:44:43.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.369+0000 7f320b39d740 1 -- 172.21.15.77:0/3093535517 --> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d138b485b0 con 0x55d138c9cd10 2023-11-04T01:44:43.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.369+0000 7f31fbfff640 1 --2- 172.21.15.77:0/3093535517 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x55d138c9cd10 0x55d138c9d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.369+0000 7f31e17fa640 10 client.7773 ms_handle_connect on v2:172.21.15.77:6833/3207490604 2023-11-04T01:44:43.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.369+0000 7f31fbfff640 1 --2- 172.21.15.77:0/3093535517 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x55d138c9cd10 0x55d138c9d0f0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6441b2fd1996e337 server_cookie=a604dc70fa384326 in_seq=0 out_seq=0 2023-11-04T01:44:43.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.370+0000 7f31e17fa640 1 -- 172.21.15.77:0/3093535517 <== mds.1 v2:172.21.15.77:6833/3207490604 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55d138b485b0 con 0x55d138c9cd10 2023-11-04T01:44:43.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.370+0000 7f31e17fa640 10 client.7773 handle_command_reply: tid=0 2023-11-04T01:44:43.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.370+0000 7f320b39d740 1 client.7773 shutdown 2023-11-04T01:44:43.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.370+0000 7f320b39d740 1 -- 172.21.15.77:0/3093535517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d138c10850 msgr2=0x55d138c98dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.370+0000 7f320b39d740 1 --2- 172.21.15.77:0/3093535517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d138c10850 0x55d138c98dc0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f31f40119a0 tx=0x7f31f4088270 comp rx=0 tx=0).stop 2023-11-04T01:44:43.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.370+0000 7f320b39d740 1 -- 172.21.15.77:0/3093535517 shutdown_connections 2023-11-04T01:44:43.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.370+0000 7f320b39d740 1 --2- 172.21.15.77:0/3093535517 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55d138c276b0 0x55d138c00e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.370+0000 7f320b39d740 1 --2- 172.21.15.77:0/3093535517 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x55d138c9cd10 0x55d138c9d0f0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.370+0000 7f320b39d740 1 --2- 172.21.15.77:0/3093535517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d138c10c30 0x55d138c00910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.370+0000 7f320b39d740 1 --2- 172.21.15.77:0/3093535517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d138c10850 0x55d138c98dc0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.370+0000 7f31e17fa640 0 client.7773 ms_handle_reset on v2:172.21.15.77:6833/3207490604 2023-11-04T01:44:43.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.370+0000 7f320b39d740 1 -- 172.21.15.77:0/3093535517 >> 172.21.15.77:0/3093535517 conn(0x55d138be3c90 msgr2=0x55d138c136b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:43.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.370+0000 7f320b39d740 1 -- 172.21.15.77:0/3093535517 shutdown_connections 2023-11-04T01:44:43.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.370+0000 7f320b39d740 1 -- 172.21.15.77:0/3093535517 wait complete. 2023-11-04T01:44:43.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.370+0000 7f320b39d740 20 client.7773 trim_cache size 0 max 16384 2023-11-04T01:44:43.404 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-04T01:44:43.404 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "0c22c75d-0169-41ef-b663-6ac1c5b0f71f", 2023-11-04T01:44:43.404 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 1, 2023-11-04T01:44:43.405 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 7305, 2023-11-04T01:44:43.405 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2023-11-04T01:44:43.405 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2023-11-04T01:44:43.405 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2023-11-04T01:44:43.406 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 66.767230212000001, 2023-11-04T01:44:43.406 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 64, 2023-11-04T01:44:43.406 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 100, 2023-11-04T01:44:43.406 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 100, 2023-11-04T01:44:43.406 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 82.519326656999993 2023-11-04T01:44:43.407 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-04T01:44:43.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.370+0000 7f320880e640 1 -- 172.21.15.77:0/3388615464 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f31e406ae70 msgr2=0x7f31e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.370+0000 7f320880e640 1 --2- 172.21.15.77:0/3388615464 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f31e406ae70 0x7f31e406d330 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f320406d080 tx=0x7f31ec008040 comp rx=0 tx=0).stop 2023-11-04T01:44:43.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.370+0000 7f320880e640 1 -- 172.21.15.77:0/3388615464 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31f0004d00 msgr2=0x7f32040c7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.370+0000 7f320880e640 1 --2- 172.21.15.77:0/3388615464 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31f0004d00 0x7f32040c7a80 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f31f40119d0 tx=0x7f31f4011e90 comp rx=0 tx=0).stop 2023-11-04T01:44:43.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.370+0000 7f320880e640 1 -- 172.21.15.77:0/3388615464 shutdown_connections 2023-11-04T01:44:43.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.370+0000 7f320880e640 1 --2- 172.21.15.77:0/3388615464 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f31e406ae70 0x7f31e406d330 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.370+0000 7f320880e640 1 --2- 172.21.15.77:0/3388615464 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32040c5a20 0x7f32040b39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.370+0000 7f320880e640 1 --2- 172.21.15.77:0/3388615464 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32041f5ce0 0x7f320414a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.370+0000 7f320880e640 1 --2- 172.21.15.77:0/3388615464 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31f0004d00 0x7f32040c7a80 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.371+0000 7f320880e640 1 -- 172.21.15.77:0/3388615464 >> 172.21.15.77:0/3388615464 conn(0x7f32040ce950 msgr2=0x7f3204155400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:43.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.371+0000 7f320880e640 1 -- 172.21.15.77:0/3388615464 shutdown_connections 2023-11-04T01:44:43.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.371+0000 7f320880e640 1 -- 172.21.15.77:0/3388615464 wait complete. 2023-11-04T01:44:43.411 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-04T01:44:43.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.508+0000 7fa52bc90640 1 Processor -- start 2023-11-04T01:44:43.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.508+0000 7fa52bc90640 1 -- start start 2023-11-04T01:44:43.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.509+0000 7fa52bc90640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa5240cd6d0 0x7fa524161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.509+0000 7fa52bc90640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5240cde60 con 0x7fa524153e60 2023-11-04T01:44:43.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.509+0000 7fa52bc90640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa524160f90 con 0x7fa5240b4880 2023-11-04T01:44:43.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.509+0000 7fa52bc90640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa524161960 con 0x7fa5240cd6d0 2023-11-04T01:44:43.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.509+0000 7fa529a2c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fa524153e60 0x7fa52415dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:47194/0 (socket says 172.21.15.77:47194) 2023-11-04T01:44:43.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.509+0000 7fa529a2c640 1 -- 172.21.15.77:0/3679081601 learned_addr learned my addr 172.21.15.77:0/3679081601 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:44:43.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.509+0000 7fa52922b640 1 --2- 172.21.15.77:0/3679081601 >> v2:172.21.15.77:3300/0 conn(0x7fa5240cd6d0 0x7fa524161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.510+0000 7fa528a2a640 1 -- 172.21.15.77:0/3679081601 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 264814239 0 0) 0x7fa5240cde60 con 0x7fa524153e60 2023-11-04T01:44:43.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.510+0000 7fa528a2a640 1 -- 172.21.15.77:0/3679081601 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa50c003520 con 0x7fa524153e60 2023-11-04T01:44:43.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.510+0000 7fa52922b640 1 -- 172.21.15.77:0/3679081601 >> v1:172.21.15.122:6789/0 conn(0x7fa5240b4880 legacy=0x7fa5240d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:43.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.510+0000 7fa52922b640 1 -- 172.21.15.77:0/3679081601 >> v1:172.21.15.77:6789/0 conn(0x7fa524153e60 legacy=0x7fa52415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.510+0000 7fa52922b640 1 -- 172.21.15.77:0/3679081601 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5240ce090 con 0x7fa5240cd6d0 2023-11-04T01:44:43.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.510+0000 7fa52922b640 1 --2- 172.21.15.77:0/3679081601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5240cd6d0 0x7fa524161420 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fa5180097a0 tx=0x7fa51802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6edf642a5d04133 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:43.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.511+0000 7fa528a2a640 1 -- 172.21.15.77:0/3679081601 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa518031830 con 0x7fa5240cd6d0 2023-11-04T01:44:43.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.511+0000 7fa528a2a640 1 -- 172.21.15.77:0/3679081601 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa518031990 con 0x7fa5240cd6d0 2023-11-04T01:44:43.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.511+0000 7fa528a2a640 1 -- 172.21.15.77:0/3679081601 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa518031d20 con 0x7fa5240cd6d0 2023-11-04T01:44:43.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.511+0000 7fa52bc90640 1 -- 172.21.15.77:0/3679081601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5240cd6d0 msgr2=0x7fa524161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.511+0000 7fa52bc90640 1 --2- 172.21.15.77:0/3679081601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5240cd6d0 0x7fa524161420 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fa5180097a0 tx=0x7fa51802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.511+0000 7fa52bc90640 1 -- 172.21.15.77:0/3679081601 shutdown_connections 2023-11-04T01:44:43.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.511+0000 7fa52bc90640 1 --2- 172.21.15.77:0/3679081601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5240cd6d0 0x7fa524161420 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.511+0000 7fa52bc90640 1 -- 172.21.15.77:0/3679081601 >> 172.21.15.77:0/3679081601 conn(0x7fa5240cf880 msgr2=0x7fa5240cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:43.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.511+0000 7fa52bc90640 1 -- 172.21.15.77:0/3679081601 shutdown_connections 2023-11-04T01:44:43.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.511+0000 7fa52bc90640 1 -- 172.21.15.77:0/3679081601 wait complete. 2023-11-04T01:44:43.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.512+0000 7fa52bc90640 1 Processor -- start 2023-11-04T01:44:43.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.512+0000 7fa52bc90640 1 -- start start 2023-11-04T01:44:43.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.513+0000 7fa52bc90640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa5240b4880 0x7fa5241f5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.513+0000 7fa52bc90640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5240cd6d0 0x7fa524154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.513+0000 7fa52bc90640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa524153e60 0x7fa5240d1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.513+0000 7fa52bc90640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa524157390 con 0x7fa5240cd6d0 2023-11-04T01:44:43.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.513+0000 7fa52bc90640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa524156a60 con 0x7fa524153e60 2023-11-04T01:44:43.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.513+0000 7fa52bc90640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa524156d40 con 0x7fa5240b4880 2023-11-04T01:44:43.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.513+0000 7fa52922b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5240cd6d0 0x7fa524154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.513+0000 7fa52922b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5240cd6d0 0x7fa524154c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52884/0 (socket says 172.21.15.77:52884) 2023-11-04T01:44:43.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.513+0000 7fa52922b640 1 -- 172.21.15.77:0/387425216 learned_addr learned my addr 172.21.15.77:0/387425216 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:43.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.513+0000 7fa529a2c640 1 --2- 172.21.15.77:0/387425216 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa5240b4880 0x7fa5241f5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.513+0000 7fa52922b640 1 -- 172.21.15.77:0/387425216 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa5240b4880 msgr2=0x7fa5241f5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.513+0000 7fa52a22d640 1 --2- 172.21.15.77:0/387425216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa524153e60 0x7fa5240d1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.513+0000 7fa52922b640 1 --2- 172.21.15.77:0/387425216 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa5240b4880 0x7fa5241f5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.513+0000 7fa52922b640 1 -- 172.21.15.77:0/387425216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa524153e60 msgr2=0x7fa5240d1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.513+0000 7fa52922b640 1 --2- 172.21.15.77:0/387425216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa524153e60 0x7fa5240d1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.513+0000 7fa52922b640 1 -- 172.21.15.77:0/387425216 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa518009400 con 0x7fa5240cd6d0 2023-11-04T01:44:43.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.513+0000 7fa529a2c640 1 --2- 172.21.15.77:0/387425216 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa5240b4880 0x7fa5241f5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:43.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.513+0000 7fa52a22d640 1 --2- 172.21.15.77:0/387425216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa524153e60 0x7fa5240d1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:43.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.514+0000 7fa52922b640 1 --2- 172.21.15.77:0/387425216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5240cd6d0 0x7fa524154c10 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fa5180098c0 tx=0x7fa5180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:43.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.514+0000 7fa5227fc640 1 -- 172.21.15.77:0/387425216 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51803a6f0 con 0x7fa5240cd6d0 2023-11-04T01:44:43.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.514+0000 7fa5227fc640 1 -- 172.21.15.77:0/387425216 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51803a870 con 0x7fa5240cd6d0 2023-11-04T01:44:43.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.514+0000 7fa52bc90640 1 -- 172.21.15.77:0/387425216 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa524157020 con 0x7fa5240cd6d0 2023-11-04T01:44:43.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.514+0000 7fa5227fc640 1 -- 172.21.15.77:0/387425216 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51803ac20 con 0x7fa5240cd6d0 2023-11-04T01:44:43.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.514+0000 7fa52bc90640 1 -- 172.21.15.77:0/387425216 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa524154730 con 0x7fa5240cd6d0 2023-11-04T01:44:43.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.515+0000 7fa5227fc640 1 -- 172.21.15.77:0/387425216 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa51804c3b0 con 0x7fa5240cd6d0 2023-11-04T01:44:43.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.516+0000 7fa5227fc640 1 --2- 172.21.15.77:0/387425216 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa51006ae70 0x7fa51006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.516+0000 7fa5227fc640 1 -- 172.21.15.77:0/387425216 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7fa5180ab8a0 con 0x7fa5240cd6d0 2023-11-04T01:44:43.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.516+0000 7fa529a2c640 1 --2- 172.21.15.77:0/387425216 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa51006ae70 0x7fa51006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.517+0000 7fa529a2c640 1 --2- 172.21.15.77:0/387425216 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa51006ae70 0x7fa51006d330 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fa514001560 tx=0x7fa514009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:43.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.517+0000 7fa52e81f740 1 Processor -- start 2023-11-04T01:44:43.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.517+0000 7fa52e81f740 1 -- start start 2023-11-04T01:44:43.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.518+0000 7fa52e81f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f203c7850 0x559f2039a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.518+0000 7fa52e81f740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x559f203c7c30 0x559f203ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.518+0000 7fa52e81f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f2039ac90 0x559f203cab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.518+0000 7fa52e81f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f202ab740 con 0x559f203c7850 2023-11-04T01:44:43.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.518+0000 7fa52e81f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f2030d8d0 con 0x559f2039ac90 2023-11-04T01:44:43.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.518+0000 7fa52e81f740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f2030afc0 con 0x559f203c7c30 2023-11-04T01:44:43.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.518+0000 7fa529a2c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f203c7850 0x559f2039a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.518+0000 7fa529a2c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f203c7850 0x559f2039a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52890/0 (socket says 172.21.15.77:52890) 2023-11-04T01:44:43.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.518+0000 7fa529a2c640 1 -- 172.21.15.77:0/3772093813 learned_addr learned my addr 172.21.15.77:0/3772093813 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:43.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.518+0000 7fa52a22d640 1 --2- 172.21.15.77:0/3772093813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f2039ac90 0x559f203cab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.518+0000 7fa52922b640 1 --2- 172.21.15.77:0/3772093813 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x559f203c7c30 0x559f203ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.518+0000 7fa529a2c640 1 -- 172.21.15.77:0/3772093813 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x559f203c7c30 msgr2=0x559f203ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:43.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.518+0000 7fa529a2c640 1 --2- 172.21.15.77:0/3772093813 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x559f203c7c30 0x559f203ca5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.518+0000 7fa529a2c640 1 -- 172.21.15.77:0/3772093813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f2039ac90 msgr2=0x559f203cab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:43.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.518+0000 7fa529a2c640 1 --2- 172.21.15.77:0/3772093813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f2039ac90 0x559f203cab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.518+0000 7fa529a2c640 1 -- 172.21.15.77:0/3772093813 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f202c9ca0 con 0x559f203c7850 2023-11-04T01:44:43.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.518+0000 7fa529a2c640 1 --2- 172.21.15.77:0/3772093813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f203c7850 0x559f2039a750 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fa51400de70 tx=0x7fa514010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ae6c5395da2d2f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:43.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.518+0000 7fa50b7fe640 1 -- 172.21.15.77:0/3772093813 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa514012820 con 0x559f203c7850 2023-11-04T01:44:43.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.518+0000 7fa50b7fe640 1 -- 172.21.15.77:0/3772093813 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa514012980 con 0x559f203c7850 2023-11-04T01:44:43.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.518+0000 7fa50b7fe640 1 -- 172.21.15.77:0/3772093813 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa514012cf0 con 0x559f203c7850 2023-11-04T01:44:43.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.519+0000 7fa52e81f740 1 -- 172.21.15.77:0/3772093813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f203c7850 msgr2=0x559f2039a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.519+0000 7fa52e81f740 1 --2- 172.21.15.77:0/3772093813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f203c7850 0x559f2039a750 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fa51400de70 tx=0x7fa514010000 comp rx=0 tx=0).stop 2023-11-04T01:44:43.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.519+0000 7fa52e81f740 1 -- 172.21.15.77:0/3772093813 shutdown_connections 2023-11-04T01:44:43.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.519+0000 7fa52e81f740 1 --2- 172.21.15.77:0/3772093813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f2039ac90 0x559f203cab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.519+0000 7fa52e81f740 1 --2- 172.21.15.77:0/3772093813 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x559f203c7c30 0x559f203ca5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.519+0000 7fa52e81f740 1 --2- 172.21.15.77:0/3772093813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f203c7850 0x559f2039a750 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.519+0000 7fa52e81f740 1 -- 172.21.15.77:0/3772093813 >> 172.21.15.77:0/3772093813 conn(0x559f2039ca60 msgr2=0x559f203e55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:43.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.519+0000 7fa52e81f740 1 -- 172.21.15.77:0/3772093813 shutdown_connections 2023-11-04T01:44:43.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.519+0000 7fa52e81f740 1 -- 172.21.15.77:0/3772093813 wait complete. 2023-11-04T01:44:43.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.520+0000 7fa52e81f740 1 -- start start 2023-11-04T01:44:43.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.520+0000 7fa52e81f740 1 Processor -- start 2023-11-04T01:44:43.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.520+0000 7fa52e81f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f203c7850 0x559f203f66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.521+0000 7fa52e81f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f203c7c30 0x559f203c0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.521+0000 7fa52e81f740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x559f203c2ed0 0x559f203bf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.521+0000 7fa52e81f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f203068b0 con 0x559f203c7c30 2023-11-04T01:44:43.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.521+0000 7fa52e81f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f202c0c80 con 0x559f203c7850 2023-11-04T01:44:43.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.521+0000 7fa52e81f740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f202c0920 con 0x559f203c2ed0 2023-11-04T01:44:43.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.521+0000 7fa52e81f740 10 client.0 _ll_register_callbacks cb 0x559f20018ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:44:43.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.521+0000 7fa52922b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f203c7c30 0x559f203c0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.521+0000 7fa52922b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f203c7c30 0x559f203c0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52896/0 (socket says 172.21.15.77:52896) 2023-11-04T01:44:43.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.521+0000 7fa52922b640 1 -- 172.21.15.77:0/3505808212 learned_addr learned my addr 172.21.15.77:0/3505808212 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:43.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.521+0000 7fa529a2c640 1 --2- 172.21.15.77:0/3505808212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f203c7850 0x559f203f66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.521+0000 7fa52a22d640 1 --2- 172.21.15.77:0/3505808212 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x559f203c2ed0 0x559f203bf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.521+0000 7fa52922b640 1 -- 172.21.15.77:0/3505808212 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x559f203c2ed0 msgr2=0x559f203bf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:43.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.521+0000 7fa52922b640 1 --2- 172.21.15.77:0/3505808212 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x559f203c2ed0 0x559f203bf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.521+0000 7fa52922b640 1 -- 172.21.15.77:0/3505808212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f203c7850 msgr2=0x559f203f66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:43.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.521+0000 7fa52922b640 1 --2- 172.21.15.77:0/3505808212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f203c7850 0x559f203f66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.521+0000 7fa52922b640 1 -- 172.21.15.77:0/3505808212 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa50c003520 con 0x559f203c7c30 2023-11-04T01:44:43.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.521+0000 7fa52922b640 1 --2- 172.21.15.77:0/3505808212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f203c7c30 0x559f203c0eb0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fa51802b910 tx=0x7fa518040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c26ea592d2bf950 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:43.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.521+0000 7fa508ff9640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:44:43.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.521+0000 7fa508ff9640 1 -- 172.21.15.77:0/3505808212 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51807e020 con 0x559f203c7c30 2023-11-04T01:44:43.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.521+0000 7fa508ff9640 1 -- 172.21.15.77:0/3505808212 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7fa5180823b0 con 0x559f203c7c30 2023-11-04T01:44:43.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.521+0000 7fa52e81f740 1 -- 172.21.15.77:0/3505808212 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559f202b2bf0 con 0x559f203c7c30 2023-11-04T01:44:43.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.521+0000 7fa508ff9640 1 -- 172.21.15.77:0/3505808212 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa51803ad80 con 0x559f203c7c30 2023-11-04T01:44:43.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.521+0000 7fa52e81f740 10 client.7788 fetch_fsmap learned FSMap version 64 2023-11-04T01:44:43.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.521+0000 7fa52e81f740 1 -- 172.21.15.77:0/3505808212 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) v3 -- 0x559f20304f30 con 0x559f203c7c30 2023-11-04T01:44:43.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.522+0000 7fa508ff9640 1 -- 172.21.15.77:0/3505808212 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559f202b2bf0 con 0x559f203c7c30 2023-11-04T01:44:43.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.522+0000 7fa508ff9640 1 -- 172.21.15.77:0/3505808212 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 64) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fa5180767c0 con 0x559f203c7c30 2023-11-04T01:44:43.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.522+0000 7fa52e81f740 10 client.7788 fetch_fsmap finished waiting for FSMap version 64 2023-11-04T01:44:43.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.522+0000 7fa52e81f740 10 client.7788 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:44:43.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.522+0000 7fa52e81f740 20 client.7788 populate_metadata read hostname 'smithi077' 2023-11-04T01:44:43.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.522+0000 7fa52e81f740 1 --2- 172.21.15.77:0/3505808212 >> [v2:172.21.15.122:6834/2908314953,v1:172.21.15.122:6836/2908314953] conn(0x559f203f9560 0x559f203c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.522+0000 7fa52e81f740 4 client.7788 mds_command: new command op to 35840 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:44:43.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.522+0000 7fa52e81f740 1 -- 172.21.15.77:0/3505808212 --> [v2:172.21.15.122:6834/2908314953,v1:172.21.15.122:6836/2908314953] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559f202ff890 con 0x559f203f9560 2023-11-04T01:44:43.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.522+0000 7fa529a2c640 1 --2- 172.21.15.77:0/3505808212 >> [v2:172.21.15.122:6834/2908314953,v1:172.21.15.122:6836/2908314953] conn(0x559f203f9560 0x559f203c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.522+0000 7fa508ff9640 10 client.7788 ms_handle_connect on v2:172.21.15.122:6834/2908314953 2023-11-04T01:44:43.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.522+0000 7fa529a2c640 1 --2- 172.21.15.77:0/3505808212 >> [v2:172.21.15.122:6834/2908314953,v1:172.21.15.122:6836/2908314953] conn(0x559f203f9560 0x559f203c96f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a1346f9c6e689cb server_cookie=8b6767c1b5fe5cf8 in_seq=0 out_seq=0 2023-11-04T01:44:43.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.523+0000 7fa508ff9640 1 -- 172.21.15.77:0/3505808212 <== mds.0 v2:172.21.15.122:6834/2908314953 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559f202ff890 con 0x559f203f9560 2023-11-04T01:44:43.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.523+0000 7fa508ff9640 10 client.7788 handle_command_reply: tid=0 2023-11-04T01:44:43.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.523+0000 7fa52e81f740 1 client.7788 shutdown 2023-11-04T01:44:43.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.523+0000 7fa52e81f740 1 -- 172.21.15.77:0/3505808212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f203c7c30 msgr2=0x559f203c0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.523+0000 7fa52e81f740 1 --2- 172.21.15.77:0/3505808212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f203c7c30 0x559f203c0eb0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fa51802b910 tx=0x7fa518040000 comp rx=0 tx=0).stop 2023-11-04T01:44:43.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.523+0000 7fa52e81f740 1 -- 172.21.15.77:0/3505808212 shutdown_connections 2023-11-04T01:44:43.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.523+0000 7fa52e81f740 1 --2- 172.21.15.77:0/3505808212 >> [v2:172.21.15.122:6834/2908314953,v1:172.21.15.122:6836/2908314953] conn(0x559f203f9560 0x559f203c96f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.523+0000 7fa52e81f740 1 --2- 172.21.15.77:0/3505808212 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x559f203c2ed0 0x559f203bf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.523+0000 7fa52e81f740 1 --2- 172.21.15.77:0/3505808212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f203c7c30 0x559f203c0eb0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.523+0000 7fa52e81f740 1 --2- 172.21.15.77:0/3505808212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f203c7850 0x559f203f66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.523+0000 7fa508ff9640 0 client.7788 ms_handle_reset on v2:172.21.15.122:6834/2908314953 2023-11-04T01:44:43.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.523+0000 7fa52e81f740 1 -- 172.21.15.77:0/3505808212 >> 172.21.15.77:0/3505808212 conn(0x559f2039ac90 msgr2=0x559f2039e600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:43.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.523+0000 7fa52e81f740 1 -- 172.21.15.77:0/3505808212 shutdown_connections 2023-11-04T01:44:43.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.523+0000 7fa52e81f740 1 -- 172.21.15.77:0/3505808212 wait complete. 2023-11-04T01:44:43.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.524+0000 7fa52e81f740 20 client.7788 trim_cache size 0 max 16384 2023-11-04T01:44:43.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.539+0000 7fa52e81f740 1 Processor -- start 2023-11-04T01:44:43.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.539+0000 7fa52e81f740 1 -- start start 2023-11-04T01:44:43.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.540+0000 7fa52e81f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f203c2ed0 0x559f203e8af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.540+0000 7fa52e81f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f203c7850 0x559f203996e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.540+0000 7fa52e81f740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x559f203c7c30 0x559f203bf120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.540+0000 7fa52e81f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f20286280 con 0x559f203c2ed0 2023-11-04T01:44:43.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.540+0000 7fa52e81f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f202a5150 con 0x559f203c7850 2023-11-04T01:44:43.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.540+0000 7fa52e81f740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f203cb770 con 0x559f203c7c30 2023-11-04T01:44:43.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.540+0000 7fa529a2c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f203c2ed0 0x559f203e8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.540+0000 7fa529a2c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f203c2ed0 0x559f203e8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52906/0 (socket says 172.21.15.77:52906) 2023-11-04T01:44:43.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.540+0000 7fa529a2c640 1 -- 172.21.15.77:0/1105931517 learned_addr learned my addr 172.21.15.77:0/1105931517 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:43.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.540+0000 7fa52a22d640 1 --2- 172.21.15.77:0/1105931517 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x559f203c7c30 0x559f203bf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.540+0000 7fa52922b640 1 --2- 172.21.15.77:0/1105931517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f203c7850 0x559f203996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.540+0000 7fa529a2c640 1 -- 172.21.15.77:0/1105931517 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x559f203c7c30 msgr2=0x559f203bf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:43.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.540+0000 7fa529a2c640 1 --2- 172.21.15.77:0/1105931517 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x559f203c7c30 0x559f203bf120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.540+0000 7fa529a2c640 1 -- 172.21.15.77:0/1105931517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f203c7850 msgr2=0x559f203996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:43.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.540+0000 7fa529a2c640 1 --2- 172.21.15.77:0/1105931517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f203c7850 0x559f203996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.540+0000 7fa529a2c640 1 -- 172.21.15.77:0/1105931517 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f202a2d10 con 0x559f203c2ed0 2023-11-04T01:44:43.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.540+0000 7fa52922b640 1 --2- 172.21.15.77:0/1105931517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f203c7850 0x559f203996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:43.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.540+0000 7fa52a22d640 1 --2- 172.21.15.77:0/1105931517 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x559f203c7c30 0x559f203bf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:43.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.540+0000 7fa529a2c640 1 --2- 172.21.15.77:0/1105931517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f203c2ed0 0x559f203e8af0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fa514002230 tx=0x7fa514007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ac58fcb35b3909 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:43.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.540+0000 7fa50bfff640 1 -- 172.21.15.77:0/1105931517 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa514027030 con 0x559f203c2ed0 2023-11-04T01:44:43.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.540+0000 7fa50bfff640 1 -- 172.21.15.77:0/1105931517 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa514028040 con 0x559f203c2ed0 2023-11-04T01:44:43.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.540+0000 7fa50bfff640 1 -- 172.21.15.77:0/1105931517 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa514012cf0 con 0x559f203c2ed0 2023-11-04T01:44:43.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.541+0000 7fa52e81f740 1 -- 172.21.15.77:0/1105931517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f203c2ed0 msgr2=0x559f203e8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.541+0000 7fa52e81f740 1 --2- 172.21.15.77:0/1105931517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f203c2ed0 0x559f203e8af0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fa514002230 tx=0x7fa514007000 comp rx=0 tx=0).stop 2023-11-04T01:44:43.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.541+0000 7fa52e81f740 1 -- 172.21.15.77:0/1105931517 shutdown_connections 2023-11-04T01:44:43.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.541+0000 7fa52e81f740 1 --2- 172.21.15.77:0/1105931517 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x559f203c7c30 0x559f203bf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.541+0000 7fa52e81f740 1 --2- 172.21.15.77:0/1105931517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f203c7850 0x559f203996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.541+0000 7fa52e81f740 1 --2- 172.21.15.77:0/1105931517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f203c2ed0 0x559f203e8af0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.541+0000 7fa52e81f740 1 -- 172.21.15.77:0/1105931517 >> 172.21.15.77:0/1105931517 conn(0x559f2039ac90 msgr2=0x559f203f6440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:43.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.541+0000 7fa52e81f740 1 -- 172.21.15.77:0/1105931517 shutdown_connections 2023-11-04T01:44:43.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.541+0000 7fa52e81f740 1 -- 172.21.15.77:0/1105931517 wait complete. 2023-11-04T01:44:43.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.541+0000 7fa52e81f740 1 -- start start 2023-11-04T01:44:43.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.541+0000 7fa52e81f740 1 Processor -- start 2023-11-04T01:44:43.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.542+0000 7fa52e81f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f203c2ed0 0x559f2044a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.542+0000 7fa52e81f740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x559f203c7850 0x559f203996e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.542+0000 7fa52e81f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f203c7c30 0x559f20399c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.542+0000 7fa52e81f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f2044a880 con 0x559f203c7c30 2023-11-04T01:44:43.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.542+0000 7fa52e81f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f203be1b0 con 0x559f203c2ed0 2023-11-04T01:44:43.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.542+0000 7fa52e81f740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f203be490 con 0x559f203c7850 2023-11-04T01:44:43.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.542+0000 7fa52e81f740 10 client.0 _ll_register_callbacks cb 0x7fa514001db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:44:43.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.542+0000 7fa52a22d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f203c7c30 0x559f20399c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.542+0000 7fa52a22d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f203c7c30 0x559f20399c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52912/0 (socket says 172.21.15.77:52912) 2023-11-04T01:44:43.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.542+0000 7fa52a22d640 1 -- 172.21.15.77:0/4068079289 learned_addr learned my addr 172.21.15.77:0/4068079289 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:43.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.542+0000 7fa529a2c640 1 --2- 172.21.15.77:0/4068079289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f203c2ed0 0x559f2044a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.542+0000 7fa52922b640 1 --2- 172.21.15.77:0/4068079289 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x559f203c7850 0x559f203996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.543+0000 7fa52a22d640 1 -- 172.21.15.77:0/4068079289 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x559f203c7850 msgr2=0x559f203996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:43.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.543+0000 7fa52a22d640 1 --2- 172.21.15.77:0/4068079289 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x559f203c7850 0x559f203996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.543+0000 7fa52a22d640 1 -- 172.21.15.77:0/4068079289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f203c2ed0 msgr2=0x559f2044a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:43.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.543+0000 7fa52a22d640 1 --2- 172.21.15.77:0/4068079289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f203c2ed0 0x559f2044a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.543+0000 7fa52a22d640 1 -- 172.21.15.77:0/4068079289 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559f202c9ca0 con 0x559f203c7c30 2023-11-04T01:44:43.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.543+0000 7fa529a2c640 1 --2- 172.21.15.77:0/4068079289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f203c2ed0 0x559f2044a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:43.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.543+0000 7fa52a22d640 1 --2- 172.21.15.77:0/4068079289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f203c7c30 0x559f20399c20 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fa51c005620 tx=0x7fa51c013760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d07e8c26064f5b56 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:43.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.543+0000 7fa508ff9640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:44:43.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.543+0000 7fa508ff9640 1 -- 172.21.15.77:0/4068079289 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c007260 con 0x559f203c7c30 2023-11-04T01:44:43.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.543+0000 7fa508ff9640 1 -- 172.21.15.77:0/4068079289 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7fa51c0073c0 con 0x559f203c7c30 2023-11-04T01:44:43.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.543+0000 7fa52e81f740 1 -- 172.21.15.77:0/4068079289 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559f203cb030 con 0x559f203c7c30 2023-11-04T01:44:43.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.543+0000 7fa508ff9640 1 -- 172.21.15.77:0/4068079289 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa51c007580 con 0x559f203c7c30 2023-11-04T01:44:43.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.543+0000 7fa52e81f740 10 client.7794 fetch_fsmap learned FSMap version 64 2023-11-04T01:44:43.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.543+0000 7fa52e81f740 1 -- 172.21.15.77:0/4068079289 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) v3 -- 0x559f202c8500 con 0x559f203c7c30 2023-11-04T01:44:43.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.543+0000 7fa508ff9640 1 -- 172.21.15.77:0/4068079289 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559f203cb030 con 0x559f203c7c30 2023-11-04T01:44:43.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.543+0000 7fa508ff9640 1 -- 172.21.15.77:0/4068079289 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 64) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fa51c025020 con 0x559f203c7c30 2023-11-04T01:44:43.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.543+0000 7fa52e81f740 10 client.7794 fetch_fsmap finished waiting for FSMap version 64 2023-11-04T01:44:43.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.543+0000 7fa52e81f740 10 client.7794 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:44:43.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.543+0000 7fa52e81f740 20 client.7794 populate_metadata read hostname 'smithi077' 2023-11-04T01:44:43.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.543+0000 7fa52e81f740 1 --2- 172.21.15.77:0/4068079289 >> [v2:172.21.15.122:6834/2908314953,v1:172.21.15.122:6836/2908314953] conn(0x559f20450cc0 0x559f2045b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.543+0000 7fa52e81f740 4 client.7794 mds_command: new command op to 35840 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:44:43.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.543+0000 7fa52e81f740 1 -- 172.21.15.77:0/4068079289 --> [v2:172.21.15.122:6834/2908314953,v1:172.21.15.122:6836/2908314953] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fa514012980 con 0x559f20450cc0 2023-11-04T01:44:43.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.543+0000 7fa529a2c640 1 --2- 172.21.15.77:0/4068079289 >> [v2:172.21.15.122:6834/2908314953,v1:172.21.15.122:6836/2908314953] conn(0x559f20450cc0 0x559f2045b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.544+0000 7fa508ff9640 10 client.7794 ms_handle_connect on v2:172.21.15.122:6834/2908314953 2023-11-04T01:44:43.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.544+0000 7fa529a2c640 1 --2- 172.21.15.77:0/4068079289 >> [v2:172.21.15.122:6834/2908314953,v1:172.21.15.122:6836/2908314953] conn(0x559f20450cc0 0x559f2045b9d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e94a1f48dd732789 server_cookie=1b87e9e681faee05 in_seq=0 out_seq=0 2023-11-04T01:44:43.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.544+0000 7fa508ff9640 1 -- 172.21.15.77:0/4068079289 <== mds.0 v2:172.21.15.122:6834/2908314953 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x7fa514012980 con 0x559f20450cc0 2023-11-04T01:44:43.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.544+0000 7fa508ff9640 10 client.7794 handle_command_reply: tid=0 2023-11-04T01:44:43.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.544+0000 7fa52e81f740 1 client.7794 shutdown 2023-11-04T01:44:43.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.544+0000 7fa52e81f740 1 -- 172.21.15.77:0/4068079289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f203c7c30 msgr2=0x559f20399c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.544+0000 7fa52e81f740 1 --2- 172.21.15.77:0/4068079289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f203c7c30 0x559f20399c20 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fa51c005620 tx=0x7fa51c013760 comp rx=0 tx=0).stop 2023-11-04T01:44:43.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.544+0000 7fa52e81f740 1 -- 172.21.15.77:0/4068079289 shutdown_connections 2023-11-04T01:44:43.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.544+0000 7fa52e81f740 1 --2- 172.21.15.77:0/4068079289 >> [v2:172.21.15.122:6834/2908314953,v1:172.21.15.122:6836/2908314953] conn(0x559f20450cc0 0x559f2045b9d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.544+0000 7fa52e81f740 1 --2- 172.21.15.77:0/4068079289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f203c7c30 0x559f20399c20 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.544+0000 7fa508ff9640 0 client.7794 ms_handle_reset on v2:172.21.15.122:6834/2908314953 2023-11-04T01:44:43.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.544+0000 7fa52e81f740 1 --2- 172.21.15.77:0/4068079289 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x559f203c7850 0x559f203996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.544+0000 7fa52e81f740 1 --2- 172.21.15.77:0/4068079289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f203c2ed0 0x559f2044a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.544+0000 7fa52e81f740 1 -- 172.21.15.77:0/4068079289 >> 172.21.15.77:0/4068079289 conn(0x559f2039ac90 msgr2=0x559f203ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:43.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.544+0000 7fa52e81f740 1 -- 172.21.15.77:0/4068079289 shutdown_connections 2023-11-04T01:44:43.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.544+0000 7fa52e81f740 1 -- 172.21.15.77:0/4068079289 wait complete. 2023-11-04T01:44:43.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.544+0000 7fa52e81f740 20 client.7794 trim_cache size 0 max 16384 2023-11-04T01:44:43.571 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-04T01:44:43.572 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "0c22c75d-0169-41ef-b663-6ac1c5b0f71f", 2023-11-04T01:44:43.572 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 0, 2023-11-04T01:44:43.572 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 35840, 2023-11-04T01:44:43.572 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2023-11-04T01:44:43.573 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2023-11-04T01:44:43.573 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2023-11-04T01:44:43.573 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 6.728224075, 2023-11-04T01:44:43.573 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 64, 2023-11-04T01:44:43.573 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 100, 2023-11-04T01:44:43.573 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 100, 2023-11-04T01:44:43.574 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 32.201748825999999 2023-11-04T01:44:43.574 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-04T01:44:43.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.545+0000 7fa52bc90640 1 -- 172.21.15.77:0/387425216 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa51006ae70 msgr2=0x7fa51006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.545+0000 7fa52bc90640 1 --2- 172.21.15.77:0/387425216 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa51006ae70 0x7fa51006d330 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fa514001560 tx=0x7fa514009040 comp rx=0 tx=0).stop 2023-11-04T01:44:43.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.545+0000 7fa52bc90640 1 -- 172.21.15.77:0/387425216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5240cd6d0 msgr2=0x7fa524154c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.545+0000 7fa52bc90640 1 --2- 172.21.15.77:0/387425216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5240cd6d0 0x7fa524154c10 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fa5180098c0 tx=0x7fa5180046c0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.545+0000 7fa52bc90640 1 -- 172.21.15.77:0/387425216 shutdown_connections 2023-11-04T01:44:43.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.545+0000 7fa52bc90640 1 --2- 172.21.15.77:0/387425216 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa51006ae70 0x7fa51006d330 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.545+0000 7fa52bc90640 1 --2- 172.21.15.77:0/387425216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa524153e60 0x7fa5240d1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.545+0000 7fa52bc90640 1 --2- 172.21.15.77:0/387425216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5240cd6d0 0x7fa524154c10 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.545+0000 7fa52bc90640 1 --2- 172.21.15.77:0/387425216 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa5240b4880 0x7fa5241f5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.545+0000 7fa52bc90640 1 -- 172.21.15.77:0/387425216 >> 172.21.15.77:0/387425216 conn(0x7fa5240cf880 msgr2=0x7fa52415b970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:43.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.545+0000 7fa52bc90640 1 -- 172.21.15.77:0/387425216 shutdown_connections 2023-11-04T01:44:43.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.545+0000 7fa52bc90640 1 -- 172.21.15.77:0/387425216 wait complete. 2023-11-04T01:44:43.578 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:43.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.675+0000 7f4ad740e640 1 Processor -- start 2023-11-04T01:44:43.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.675+0000 7f4ad740e640 1 -- start start 2023-11-04T01:44:43.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.676+0000 7f4ad740e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4ad0159c70 0x7f4ad00ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.676+0000 7f4ad740e640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4ad00b0ae0 0x7f4ad015d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.676+0000 7f4ad740e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad00b4110 con 0x7f4ad006db20 2023-11-04T01:44:43.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.676+0000 7f4ad740e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad00b49b0 con 0x7f4ad0159c70 2023-11-04T01:44:43.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.676+0000 7f4ad740e640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad00b43f0 con 0x7f4ad00b0ae0 2023-11-04T01:44:43.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.676+0000 7f4ad51aa640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4ad0159c70 0x7f4ad00ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.676+0000 7f4ad49a9640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f4ad006db20 0x7f4ad00b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:47206/0 (socket says 172.21.15.77:47206) 2023-11-04T01:44:43.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.676+0000 7f4ad51aa640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4ad0159c70 0x7f4ad00ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52926/0 (socket says 172.21.15.77:52926) 2023-11-04T01:44:43.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.676+0000 7f4ad49a9640 1 -- 172.21.15.77:0/471108289 learned_addr learned my addr 172.21.15.77:0/471108289 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:44:43.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.676+0000 7f4ad59ab640 1 --2- 172.21.15.77:0/471108289 >> v2:172.21.15.122:3300/0 conn(0x7f4ad00b0ae0 0x7f4ad015d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.676+0000 7f4ad51aa640 1 -- 172.21.15.77:0/471108289 >> v2:172.21.15.122:3300/0 conn(0x7f4ad00b0ae0 msgr2=0x7f4ad015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:43.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.676+0000 7f4ad51aa640 1 --2- 172.21.15.77:0/471108289 >> v2:172.21.15.122:3300/0 conn(0x7f4ad00b0ae0 0x7f4ad015d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.676+0000 7f4ad51aa640 1 -- 172.21.15.77:0/471108289 >> v1:172.21.15.77:6789/0 conn(0x7f4ad006db20 legacy=0x7f4ad00b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.676+0000 7f4ac7fff640 1 -- 172.21.15.77:0/471108289 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2530283140 0 0) 0x7f4ad00b4110 con 0x7f4ad006db20 2023-11-04T01:44:43.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.676+0000 7f4ad51aa640 1 -- 172.21.15.77:0/471108289 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad00b46d0 con 0x7f4ad0159c70 2023-11-04T01:44:43.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.676+0000 7f4ad59ab640 1 --2- 172.21.15.77:0/471108289 >> v2:172.21.15.122:3300/0 conn(0x7f4ad00b0ae0 0x7f4ad015d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:43.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.677+0000 7f4ad51aa640 1 --2- 172.21.15.77:0/471108289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ad0159c70 0x7f4ad00ce370 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f4ad00c5910 tx=0x7f4acc02e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9576d914057260a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:43.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.677+0000 7f4ac7fff640 1 -- 172.21.15.77:0/471108289 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4acc02ea60 con 0x7f4ad0159c70 2023-11-04T01:44:43.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.677+0000 7f4ac7fff640 1 -- 172.21.15.77:0/471108289 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4acc02ebc0 con 0x7f4ad0159c70 2023-11-04T01:44:43.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.677+0000 7f4ac7fff640 1 -- 172.21.15.77:0/471108289 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4acc009540 con 0x7f4ad0159c70 2023-11-04T01:44:43.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.678+0000 7f4ad740e640 1 -- 172.21.15.77:0/471108289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ad0159c70 msgr2=0x7f4ad00ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.678+0000 7f4ad740e640 1 --2- 172.21.15.77:0/471108289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ad0159c70 0x7f4ad00ce370 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f4ad00c5910 tx=0x7f4acc02e0c0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.678+0000 7f4ad740e640 1 -- 172.21.15.77:0/471108289 shutdown_connections 2023-11-04T01:44:43.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.678+0000 7f4ad740e640 1 --2- 172.21.15.77:0/471108289 >> v2:172.21.15.122:3300/0 conn(0x7f4ad00b0ae0 0x7f4ad015d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.678+0000 7f4ad740e640 1 --2- 172.21.15.77:0/471108289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ad0159c70 0x7f4ad00ce370 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.678+0000 7f4ad740e640 1 -- 172.21.15.77:0/471108289 >> 172.21.15.77:0/471108289 conn(0x7f4ad00ce950 msgr2=0x7f4ad00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:43.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.678+0000 7f4ad740e640 1 -- 172.21.15.77:0/471108289 shutdown_connections 2023-11-04T01:44:43.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.678+0000 7f4ad740e640 1 -- 172.21.15.77:0/471108289 wait complete. 2023-11-04T01:44:43.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.679+0000 7f4ad740e640 1 Processor -- start 2023-11-04T01:44:43.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.679+0000 7f4ad740e640 1 -- start start 2023-11-04T01:44:43.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.680+0000 7f4ad740e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ad006db20 0x7f4ad014e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.680+0000 7f4ad740e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ad00b0ae0 0x7f4ad0147930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.680+0000 7f4ad740e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ad0159c70 0x7f4ad01f34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.680+0000 7f4ad740e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad01f3db0 con 0x7f4ad0159c70 2023-11-04T01:44:43.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.680+0000 7f4ad740e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad0147e70 con 0x7f4ad006db20 2023-11-04T01:44:43.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.680+0000 7f4ad740e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad0150370 con 0x7f4ad00b0ae0 2023-11-04T01:44:43.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.680+0000 7f4ad59ab640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ad0159c70 0x7f4ad01f34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.680+0000 7f4ad59ab640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ad0159c70 0x7f4ad01f34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52930/0 (socket says 172.21.15.77:52930) 2023-11-04T01:44:43.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.680+0000 7f4ad59ab640 1 -- 172.21.15.77:0/497743472 learned_addr learned my addr 172.21.15.77:0/497743472 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:43.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.680+0000 7f4ad51aa640 1 --2- 172.21.15.77:0/497743472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ad006db20 0x7f4ad014e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.680+0000 7f4ad49a9640 1 --2- 172.21.15.77:0/497743472 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ad00b0ae0 0x7f4ad0147930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.680+0000 7f4ad59ab640 1 -- 172.21.15.77:0/497743472 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ad00b0ae0 msgr2=0x7f4ad0147930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.680+0000 7f4ad59ab640 1 --2- 172.21.15.77:0/497743472 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ad00b0ae0 0x7f4ad0147930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.680+0000 7f4ad59ab640 1 -- 172.21.15.77:0/497743472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ad006db20 msgr2=0x7f4ad014e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.680+0000 7f4ad59ab640 1 --2- 172.21.15.77:0/497743472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ad006db20 0x7f4ad014e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.680+0000 7f4ad59ab640 1 -- 172.21.15.77:0/497743472 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4acc00bc80 con 0x7f4ad0159c70 2023-11-04T01:44:43.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.680+0000 7f4ad51aa640 1 --2- 172.21.15.77:0/497743472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ad006db20 0x7f4ad014e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:43.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.680+0000 7f4ad49a9640 1 --2- 172.21.15.77:0/497743472 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ad00b0ae0 0x7f4ad0147930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:43.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.680+0000 7f4ad59ab640 1 --2- 172.21.15.77:0/497743472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ad0159c70 0x7f4ad01f34c0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800e5e0 tx=0x7f4ac800eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:43.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.680+0000 7f4ac5ffb640 1 -- 172.21.15.77:0/497743472 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8004230 con 0x7f4ad0159c70 2023-11-04T01:44:43.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.680+0000 7f4ac5ffb640 1 -- 172.21.15.77:0/497743472 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac8004390 con 0x7f4ad0159c70 2023-11-04T01:44:43.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.680+0000 7f4ad740e640 1 -- 172.21.15.77:0/497743472 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad014fa40 con 0x7f4ad0159c70 2023-11-04T01:44:43.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.680+0000 7f4ac5ffb640 1 -- 172.21.15.77:0/497743472 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8003830 con 0x7f4ad0159c70 2023-11-04T01:44:43.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.681+0000 7f4ad740e640 1 -- 172.21.15.77:0/497743472 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad0150000 con 0x7f4ad0159c70 2023-11-04T01:44:43.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.681+0000 7f4ad740e640 1 -- 172.21.15.77:0/497743472 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad0150520 con 0x7f4ad0159c70 2023-11-04T01:44:43.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.682+0000 7f4ac5ffb640 1 -- 172.21.15.77:0/497743472 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4ac8003990 con 0x7f4ad0159c70 2023-11-04T01:44:43.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.682+0000 7f4ac5ffb640 1 --2- 172.21.15.77:0/497743472 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4ab406ae70 0x7f4ab406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.682+0000 7f4ac5ffb640 1 -- 172.21.15.77:0/497743472 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f4ac8089830 con 0x7f4ad0159c70 2023-11-04T01:44:43.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.682+0000 7f4ad51aa640 1 --2- 172.21.15.77:0/497743472 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4ab406ae70 0x7f4ab406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.683+0000 7f4ad51aa640 1 --2- 172.21.15.77:0/497743472 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4ab406ae70 0x7f4ab406d330 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f4acc037000 tx=0x7f4acc032000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:43.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.686+0000 7f4ac5ffb640 1 -- 172.21.15.77:0/497743472 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4ad0150520 con 0x7f4ad0159c70 2023-11-04T01:44:43.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.886+0000 7f4ad740e640 1 -- 172.21.15.77:0/497743472 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ad00cdb30 con 0x7f4ad0159c70 2023-11-04T01:44:43.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.886+0000 7f4ac5ffb640 1 -- 172.21.15.77:0/497743472 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f4ac8054270 con 0x7f4ad0159c70 2023-11-04T01:44:43.890 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:44:43.890 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":64,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7743,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/285184758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":285184758},{"type":"v1","addr":"172.21.15.77:6834","nonce":285184758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:44:39.830971+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":35840,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_35840":{"gid":35840,"name":"b","rank":0,"incarnation":60,"state":"up:active","state_seq":11,"addr":"172.21.15.122:6836/2908314953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2908314953},{"type":"v1","addr":"172.21.15.122:6836","nonce":2908314953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:43.890 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 64 2023-11-04T01:44:43.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.888+0000 7f4ad740e640 1 -- 172.21.15.77:0/497743472 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4ab406ae70 msgr2=0x7f4ab406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.888+0000 7f4ad740e640 1 --2- 172.21.15.77:0/497743472 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4ab406ae70 0x7f4ab406d330 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f4acc037000 tx=0x7f4acc032000 comp rx=0 tx=0).stop 2023-11-04T01:44:43.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.888+0000 7f4ad740e640 1 -- 172.21.15.77:0/497743472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ad0159c70 msgr2=0x7f4ad01f34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.888+0000 7f4ad740e640 1 --2- 172.21.15.77:0/497743472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ad0159c70 0x7f4ad01f34c0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800e5e0 tx=0x7f4ac800eaa0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.888+0000 7f4ad740e640 1 -- 172.21.15.77:0/497743472 shutdown_connections 2023-11-04T01:44:43.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.888+0000 7f4ad740e640 1 --2- 172.21.15.77:0/497743472 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4ab406ae70 0x7f4ab406d330 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.888+0000 7f4ad740e640 1 --2- 172.21.15.77:0/497743472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ad0159c70 0x7f4ad01f34c0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.888+0000 7f4ad740e640 1 --2- 172.21.15.77:0/497743472 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ad00b0ae0 0x7f4ad0147930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.888+0000 7f4ad740e640 1 --2- 172.21.15.77:0/497743472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ad006db20 0x7f4ad014e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.888+0000 7f4ad740e640 1 -- 172.21.15.77:0/497743472 >> 172.21.15.77:0/497743472 conn(0x7f4ad00ce950 msgr2=0x7f4ad00b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:43.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.888+0000 7f4ad740e640 1 -- 172.21.15.77:0/497743472 shutdown_connections 2023-11-04T01:44:43.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:43.888+0000 7f4ad740e640 1 -- 172.21.15.77:0/497743472 wait complete. 2023-11-04T01:44:43.902 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dump snaps --server 2023-11-04T01:44:44.025 INFO:teuthology.orchestra.run.smithi122.stdout:{"last_snap":3,"last_created":3,"last_destroyed":1,"pending_noop":[],"snaps":[{"snapid":2,"ino":1099511627777,"stamp":"2023-11-04T01:43:48.909834+0000","name":"s11","metadata":{}},{"snapid":3,"ino":1099511627777,"stamp":"2023-11-04T01:44:19.755300+0000","name":"s12","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:44:44.026 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 3, "last_destroyed": 1, "last_snap": 3, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s11", "snapid": 2, "stamp": "2023-11-04T01:43:48.909834+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s12", "snapid": 3, "stamp": "2023-11-04T01:44:19.755300+0000" } ] } 2023-11-04T01:44:44.026 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-04T01:44:44.027 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=5 2023-11-04T01:44:44.027 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:44.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.125+0000 7f8ab760e640 1 Processor -- start 2023-11-04T01:44:44.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.125+0000 7f8ab760e640 1 -- start start 2023-11-04T01:44:44.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.125+0000 7f8ab760e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8ab0159c70 0x7f8ab00ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:44.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.126+0000 7f8ab760e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab00b4110 con 0x7f8ab00b0ae0 2023-11-04T01:44:44.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.126+0000 7f8ab760e640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab00b43f0 con 0x7f8ab006db20 2023-11-04T01:44:44.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.126+0000 7f8ab760e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ab00b49b0 con 0x7f8ab0159c70 2023-11-04T01:44:44.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.126+0000 7f8ab53aa640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8ab0159c70 0x7f8ab00ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:44.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.126+0000 7f8ab5bab640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f8ab00b0ae0 0x7f8ab015d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:47208/0 (socket says 172.21.15.77:47208) 2023-11-04T01:44:44.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.126+0000 7f8ab5bab640 1 -- 172.21.15.77:0/3004607564 learned_addr learned my addr 172.21.15.77:0/3004607564 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:44:44.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.126+0000 7f8ab53aa640 1 -- 172.21.15.77:0/3004607564 >> v1:172.21.15.122:6789/0 conn(0x7f8ab006db20 legacy=0x7f8ab00b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:44.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.126+0000 7f8ab53aa640 1 -- 172.21.15.77:0/3004607564 >> v1:172.21.15.77:6789/0 conn(0x7f8ab00b0ae0 legacy=0x7f8ab015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:44.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.126+0000 7f8ab53aa640 1 -- 172.21.15.77:0/3004607564 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab00b46d0 con 0x7f8ab0159c70 2023-11-04T01:44:44.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.127+0000 7f8ab53aa640 1 --2- 172.21.15.77:0/3004607564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ab0159c70 0x7f8ab00ce370 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f8aa40097a0 tx=0x7f8aa402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc93f9675b6970c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:44.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.127+0000 7f8aa3fff640 1 -- 172.21.15.77:0/3004607564 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4031830 con 0x7f8ab0159c70 2023-11-04T01:44:44.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.127+0000 7f8aa3fff640 1 -- 172.21.15.77:0/3004607564 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa4031990 con 0x7f8ab0159c70 2023-11-04T01:44:44.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.127+0000 7f8aa3fff640 1 -- 172.21.15.77:0/3004607564 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4031d20 con 0x7f8ab0159c70 2023-11-04T01:44:44.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.127+0000 7f8ab760e640 1 -- 172.21.15.77:0/3004607564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ab0159c70 msgr2=0x7f8ab00ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:44.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.127+0000 7f8ab760e640 1 --2- 172.21.15.77:0/3004607564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ab0159c70 0x7f8ab00ce370 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f8aa40097a0 tx=0x7f8aa402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.127+0000 7f8ab760e640 1 -- 172.21.15.77:0/3004607564 shutdown_connections 2023-11-04T01:44:44.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.127+0000 7f8ab760e640 1 --2- 172.21.15.77:0/3004607564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ab0159c70 0x7f8ab00ce370 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.127+0000 7f8ab760e640 1 -- 172.21.15.77:0/3004607564 >> 172.21.15.77:0/3004607564 conn(0x7f8ab00ce950 msgr2=0x7f8ab00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:44.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.127+0000 7f8ab760e640 1 -- 172.21.15.77:0/3004607564 shutdown_connections 2023-11-04T01:44:44.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.128+0000 7f8ab760e640 1 -- 172.21.15.77:0/3004607564 wait complete. 2023-11-04T01:44:44.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.129+0000 7f8ab760e640 1 Processor -- start 2023-11-04T01:44:44.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.129+0000 7f8ab760e640 1 -- start start 2023-11-04T01:44:44.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.129+0000 7f8ab760e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ab006db20 0x7f8ab0158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:44.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.129+0000 7f8ab760e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ab00b0ae0 0x7f8ab00ad510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:44.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.129+0000 7f8ab760e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ab0159c70 0x7f8ab015c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:44.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.129+0000 7f8ab760e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab00adf90 con 0x7f8ab00b0ae0 2023-11-04T01:44:44.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.129+0000 7f8ab760e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab00ae270 con 0x7f8ab006db20 2023-11-04T01:44:44.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.129+0000 7f8ab760e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab00ae550 con 0x7f8ab0159c70 2023-11-04T01:44:44.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.129+0000 7f8ab4ba9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ab00b0ae0 0x7f8ab00ad510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:44.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.129+0000 7f8ab4ba9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ab00b0ae0 0x7f8ab00ad510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52948/0 (socket says 172.21.15.77:52948) 2023-11-04T01:44:44.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.129+0000 7f8ab4ba9640 1 -- 172.21.15.77:0/1837626728 learned_addr learned my addr 172.21.15.77:0/1837626728 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:44.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.130+0000 7f8ab53aa640 1 --2- 172.21.15.77:0/1837626728 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ab006db20 0x7f8ab0158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:44.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.130+0000 7f8ab5bab640 1 --2- 172.21.15.77:0/1837626728 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ab0159c70 0x7f8ab015c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:44.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.130+0000 7f8ab4ba9640 1 -- 172.21.15.77:0/1837626728 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ab0159c70 msgr2=0x7f8ab015c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:44.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.130+0000 7f8ab4ba9640 1 --2- 172.21.15.77:0/1837626728 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ab0159c70 0x7f8ab015c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.130+0000 7f8ab4ba9640 1 -- 172.21.15.77:0/1837626728 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ab006db20 msgr2=0x7f8ab0158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:44.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.130+0000 7f8ab4ba9640 1 --2- 172.21.15.77:0/1837626728 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ab006db20 0x7f8ab0158500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.130+0000 7f8ab4ba9640 1 -- 172.21.15.77:0/1837626728 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa4009400 con 0x7f8ab00b0ae0 2023-11-04T01:44:44.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.130+0000 7f8ab53aa640 1 --2- 172.21.15.77:0/1837626728 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ab006db20 0x7f8ab0158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:44.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.130+0000 7f8ab4ba9640 1 --2- 172.21.15.77:0/1837626728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ab00b0ae0 0x7f8ab00ad510 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f8aac00c430 tx=0x7f8aac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:44.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.130+0000 7f8aa1ffb640 1 -- 172.21.15.77:0/1837626728 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aac011790 con 0x7f8ab00b0ae0 2023-11-04T01:44:44.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.130+0000 7f8aa1ffb640 1 -- 172.21.15.77:0/1837626728 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aac0118f0 con 0x7f8ab00b0ae0 2023-11-04T01:44:44.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.130+0000 7f8ab760e640 1 -- 172.21.15.77:0/1837626728 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ab00ae830 con 0x7f8ab00b0ae0 2023-11-04T01:44:44.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.130+0000 7f8aa1ffb640 1 -- 172.21.15.77:0/1837626728 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aac011ce0 con 0x7f8ab00b0ae0 2023-11-04T01:44:44.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.130+0000 7f8ab760e640 1 -- 172.21.15.77:0/1837626728 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab00ad100 con 0x7f8ab00b0ae0 2023-11-04T01:44:44.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.131+0000 7f8ab760e640 1 -- 172.21.15.77:0/1837626728 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ab0074290 con 0x7f8ab00b0ae0 2023-11-04T01:44:44.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.132+0000 7f8aa1ffb640 1 -- 172.21.15.77:0/1837626728 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8aac01c460 con 0x7f8ab00b0ae0 2023-11-04T01:44:44.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.132+0000 7f8aa1ffb640 1 --2- 172.21.15.77:0/1837626728 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8a9406aea0 0x7f8a9406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:44.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.132+0000 7f8aa1ffb640 1 -- 172.21.15.77:0/1837626728 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f8aac089b30 con 0x7f8ab00b0ae0 2023-11-04T01:44:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.132+0000 7f8ab53aa640 1 --2- 172.21.15.77:0/1837626728 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8a9406aea0 0x7f8a9406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.133+0000 7f8ab53aa640 1 --2- 172.21.15.77:0/1837626728 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8a9406aea0 0x7f8a9406d360 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4036000 tx=0x7f8aa403c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.137+0000 7f8aa1ffb640 1 -- 172.21.15.77:0/1837626728 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8aac054600 con 0x7f8ab00b0ae0 2023-11-04T01:44:44.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.334+0000 7f8ab760e640 1 -- 172.21.15.77:0/1837626728 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ab006d3f0 con 0x7f8ab00b0ae0 2023-11-04T01:44:44.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.335+0000 7f8aa1ffb640 1 -- 172.21.15.77:0/1837626728 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f8aac057c20 con 0x7f8ab00b0ae0 2023-11-04T01:44:44.338 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:44:44.338 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":64,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7743,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/285184758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":285184758},{"type":"v1","addr":"172.21.15.77:6834","nonce":285184758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:44:39.830971+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":35840,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_35840":{"gid":35840,"name":"b","rank":0,"incarnation":60,"state":"up:active","state_seq":11,"addr":"172.21.15.122:6836/2908314953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2908314953},{"type":"v1","addr":"172.21.15.122:6836","nonce":2908314953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:44.338 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 64 2023-11-04T01:44:44.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.337+0000 7f8ab760e640 1 -- 172.21.15.77:0/1837626728 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8a9406aea0 msgr2=0x7f8a9406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:44.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.337+0000 7f8ab760e640 1 --2- 172.21.15.77:0/1837626728 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8a9406aea0 0x7f8a9406d360 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4036000 tx=0x7f8aa403c040 comp rx=0 tx=0).stop 2023-11-04T01:44:44.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.337+0000 7f8ab760e640 1 -- 172.21.15.77:0/1837626728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ab00b0ae0 msgr2=0x7f8ab00ad510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:44.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.337+0000 7f8ab760e640 1 --2- 172.21.15.77:0/1837626728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ab00b0ae0 0x7f8ab00ad510 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f8aac00c430 tx=0x7f8aac00c8f0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.337+0000 7f8ab760e640 1 -- 172.21.15.77:0/1837626728 shutdown_connections 2023-11-04T01:44:44.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.337+0000 7f8ab760e640 1 --2- 172.21.15.77:0/1837626728 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8a9406aea0 0x7f8a9406d360 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.337+0000 7f8ab760e640 1 --2- 172.21.15.77:0/1837626728 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8ab0159c70 0x7f8ab015c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.337+0000 7f8ab760e640 1 --2- 172.21.15.77:0/1837626728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ab00b0ae0 0x7f8ab00ad510 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.337+0000 7f8ab760e640 1 --2- 172.21.15.77:0/1837626728 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ab006db20 0x7f8ab0158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.337+0000 7f8ab760e640 1 -- 172.21.15.77:0/1837626728 >> 172.21.15.77:0/1837626728 conn(0x7f8ab00ce950 msgr2=0x7f8ab00b2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:44.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.337+0000 7f8ab760e640 1 -- 172.21.15.77:0/1837626728 shutdown_connections 2023-11-04T01:44:44.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.337+0000 7f8ab760e640 1 -- 172.21.15.77:0/1837626728 wait complete. 2023-11-04T01:44:44.350 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:44:44.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.449+0000 7fbc25155640 1 Processor -- start 2023-11-04T01:44:44.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.449+0000 7fbc25155640 1 -- start start 2023-11-04T01:44:44.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.450+0000 7fbc25155640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fbc2015ad40 0x7fbc2006b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:44.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.450+0000 7fbc25155640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc20065df0 con 0x7fbc2015b120 2023-11-04T01:44:44.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.450+0000 7fbc25155640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc20066040 con 0x7fbc200c9b60 2023-11-04T01:44:44.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.450+0000 7fbc25155640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc2006bc40 con 0x7fbc2015ad40 2023-11-04T01:44:44.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.450+0000 7fbc1e59c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fbc2015b120 0x7fbc2015f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:47220/0 (socket says 172.21.15.77:47220) 2023-11-04T01:44:44.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.450+0000 7fbc1e59c640 1 -- 172.21.15.77:0/1276586856 learned_addr learned my addr 172.21.15.77:0/1276586856 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:44:44.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.450+0000 7fbc1ed9d640 1 --2- 172.21.15.77:0/1276586856 >> v2:172.21.15.122:3300/0 conn(0x7fbc2015ad40 0x7fbc2006b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:44.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.450+0000 7fbc1dd9b640 1 -- 172.21.15.77:0/1276586856 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3437862660 0 0) 0x7fbc20065df0 con 0x7fbc2015b120 2023-11-04T01:44:44.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.450+0000 7fbc1dd9b640 1 -- 172.21.15.77:0/1276586856 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc08003520 con 0x7fbc2015b120 2023-11-04T01:44:44.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.450+0000 7fbc1dd9b640 1 -- 172.21.15.77:0/1276586856 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3388253394 0 0) 0x7fbc08003520 con 0x7fbc2015b120 2023-11-04T01:44:44.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.450+0000 7fbc1dd9b640 1 -- 172.21.15.77:0/1276586856 >> v2:172.21.15.122:3300/0 conn(0x7fbc2015ad40 msgr2=0x7fbc2006b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:44.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.450+0000 7fbc1dd9b640 1 --2- 172.21.15.77:0/1276586856 >> v2:172.21.15.122:3300/0 conn(0x7fbc2015ad40 0x7fbc2006b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.450+0000 7fbc1dd9b640 1 -- 172.21.15.77:0/1276586856 >> v1:172.21.15.122:6789/0 conn(0x7fbc200c9b60 legacy=0x7fbc20070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:44.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.450+0000 7fbc1dd9b640 1 -- 172.21.15.77:0/1276586856 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc20066320 con 0x7fbc2015b120 2023-11-04T01:44:44.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.450+0000 7fbc1dd9b640 1 -- 172.21.15.77:0/1276586856 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7fbc14001670 con 0x7fbc2015b120 2023-11-04T01:44:44.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.450+0000 7fbc1dd9b640 1 -- 172.21.15.77:0/1276586856 >> v1:172.21.15.77:6789/0 conn(0x7fbc2015b120 legacy=0x7fbc2015f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:44.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.450+0000 7fbc1dd9b640 1 --2- 172.21.15.77:0/1276586856 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbc08003970 0x7fbc08003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:44.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.450+0000 7fbc1dd9b640 1 --2- 172.21.15.77:0/1276586856 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc080047c0 0x7fbc08004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:44.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.451+0000 7fbc1dd9b640 1 --2- 172.21.15.77:0/1276586856 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbc08005180 0x7fbc0800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:44.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.451+0000 7fbc1dd9b640 1 -- 172.21.15.77:0/1276586856 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2006bc40 con 0x7fbc080047c0 2023-11-04T01:44:44.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.451+0000 7fbc1dd9b640 1 -- 172.21.15.77:0/1276586856 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0800c020 con 0x7fbc08005180 2023-11-04T01:44:44.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.451+0000 7fbc1dd9b640 1 -- 172.21.15.77:0/1276586856 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0800c1e0 con 0x7fbc08003970 2023-11-04T01:44:44.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.451+0000 7fbc1ed9d640 1 --2- 172.21.15.77:0/1276586856 >> v2:172.21.15.122:3300/0 conn(0x7fbc2015ad40 0x7fbc2006b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:44:44.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.451+0000 7fbc1e59c640 1 --2- 172.21.15.77:0/1276586856 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc080047c0 0x7fbc08004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:44.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.451+0000 7fbc1f59e640 1 --2- 172.21.15.77:0/1276586856 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbc08005180 0x7fbc0800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:44.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.451+0000 7fbc1ed9d640 1 --2- 172.21.15.77:0/1276586856 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbc08003970 0x7fbc08003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:44.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.451+0000 7fbc1e59c640 1 -- 172.21.15.77:0/1276586856 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbc08003970 msgr2=0x7fbc08003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:44.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.451+0000 7fbc1e59c640 1 --2- 172.21.15.77:0/1276586856 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbc08003970 0x7fbc08003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.451+0000 7fbc1e59c640 1 -- 172.21.15.77:0/1276586856 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbc08005180 msgr2=0x7fbc0800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:44.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.451+0000 7fbc1e59c640 1 --2- 172.21.15.77:0/1276586856 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbc08005180 0x7fbc0800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.451+0000 7fbc1f59e640 1 -- 172.21.15.77:0/1276586856 reap_dead start 2023-11-04T01:44:44.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.451+0000 7fbc1e59c640 1 -- 172.21.15.77:0/1276586856 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc08003520 con 0x7fbc080047c0 2023-11-04T01:44:44.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.452+0000 7fbc1e59c640 1 --2- 172.21.15.77:0/1276586856 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc080047c0 0x7fbc08004c40 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fbc1400c210 tx=0x7fbc080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b12321122e3d82b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:44.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.452+0000 7fbc1dd9b640 1 -- 172.21.15.77:0/1276586856 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc14005ad0 con 0x7fbc080047c0 2023-11-04T01:44:44.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.452+0000 7fbc1dd9b640 1 -- 172.21.15.77:0/1276586856 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc14005c30 con 0x7fbc080047c0 2023-11-04T01:44:44.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.452+0000 7fbc1dd9b640 1 -- 172.21.15.77:0/1276586856 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1402cad0 con 0x7fbc080047c0 2023-11-04T01:44:44.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.452+0000 7fbc25155640 1 -- 172.21.15.77:0/1276586856 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc080047c0 msgr2=0x7fbc08004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:44.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.452+0000 7fbc25155640 1 --2- 172.21.15.77:0/1276586856 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc080047c0 0x7fbc08004c40 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fbc1400c210 tx=0x7fbc080057f0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.452+0000 7fbc25155640 1 -- 172.21.15.77:0/1276586856 shutdown_connections 2023-11-04T01:44:44.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.452+0000 7fbc25155640 1 --2- 172.21.15.77:0/1276586856 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc080047c0 0x7fbc08004c40 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.452+0000 7fbc25155640 1 -- 172.21.15.77:0/1276586856 >> 172.21.15.77:0/1276586856 conn(0x7fbc200cbc90 msgr2=0x7fbc200cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:44.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.452+0000 7fbc25155640 1 -- 172.21.15.77:0/1276586856 shutdown_connections 2023-11-04T01:44:44.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.452+0000 7fbc25155640 1 -- 172.21.15.77:0/1276586856 wait complete. 2023-11-04T01:44:44.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.454+0000 7fbc25155640 1 Processor -- start 2023-11-04T01:44:44.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.454+0000 7fbc25155640 1 -- start start 2023-11-04T01:44:44.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.454+0000 7fbc25155640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbc080047c0 0x7fbc200cd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:44.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.454+0000 7fbc25155640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc200c5010 0x7fbc2014a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:44.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.454+0000 7fbc25155640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbc200c3ae0 0x7fbc200c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:44.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.454+0000 7fbc25155640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc200ce6a0 con 0x7fbc200c5010 2023-11-04T01:44:44.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.454+0000 7fbc25155640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc200cdd30 con 0x7fbc080047c0 2023-11-04T01:44:44.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.454+0000 7fbc25155640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc200c3f70 con 0x7fbc200c3ae0 2023-11-04T01:44:44.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.455+0000 7fbc1e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc200c5010 0x7fbc2014a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:44.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.455+0000 7fbc1e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc200c5010 0x7fbc2014a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52958/0 (socket says 172.21.15.77:52958) 2023-11-04T01:44:44.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.455+0000 7fbc1e59c640 1 -- 172.21.15.77:0/271901156 learned_addr learned my addr 172.21.15.77:0/271901156 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:44.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.455+0000 7fbc1ed9d640 1 --2- 172.21.15.77:0/271901156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbc080047c0 0x7fbc200cd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:44.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.455+0000 7fbc1f59e640 1 --2- 172.21.15.77:0/271901156 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbc200c3ae0 0x7fbc200c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:44.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.455+0000 7fbc1e59c640 1 -- 172.21.15.77:0/271901156 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbc200c3ae0 msgr2=0x7fbc200c28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:44.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.455+0000 7fbc1e59c640 1 --2- 172.21.15.77:0/271901156 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbc200c3ae0 0x7fbc200c28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.455+0000 7fbc1e59c640 1 -- 172.21.15.77:0/271901156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbc080047c0 msgr2=0x7fbc200cd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:44.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.455+0000 7fbc1e59c640 1 --2- 172.21.15.77:0/271901156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbc080047c0 0x7fbc200cd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.455+0000 7fbc1e59c640 1 -- 172.21.15.77:0/271901156 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc200c4250 con 0x7fbc200c5010 2023-11-04T01:44:44.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.455+0000 7fbc1f59e640 1 --2- 172.21.15.77:0/271901156 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbc200c3ae0 0x7fbc200c28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:44.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.455+0000 7fbc1e59c640 1 --2- 172.21.15.77:0/271901156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc200c5010 0x7fbc2014a3e0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fbc14001930 tx=0x7fbc1402e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:44.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.455+0000 7fbc077fe640 1 -- 172.21.15.77:0/271901156 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1403c040 con 0x7fbc200c5010 2023-11-04T01:44:44.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.455+0000 7fbc077fe640 1 -- 172.21.15.77:0/271901156 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1402cca0 con 0x7fbc200c5010 2023-11-04T01:44:44.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.455+0000 7fbc25155640 1 -- 172.21.15.77:0/271901156 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc200c4530 con 0x7fbc200c5010 2023-11-04T01:44:44.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.455+0000 7fbc077fe640 1 -- 172.21.15.77:0/271901156 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc140072b0 con 0x7fbc200c5010 2023-11-04T01:44:44.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.455+0000 7fbc25155640 1 -- 172.21.15.77:0/271901156 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc200c4af0 con 0x7fbc200c5010 2023-11-04T01:44:44.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.456+0000 7fbc25155640 1 -- 172.21.15.77:0/271901156 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc200c4c80 con 0x7fbc200c5010 2023-11-04T01:44:44.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.457+0000 7fbc077fe640 1 -- 172.21.15.77:0/271901156 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbc14032070 con 0x7fbc200c5010 2023-11-04T01:44:44.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.457+0000 7fbc077fe640 1 --2- 172.21.15.77:0/271901156 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbc0c06ae70 0x7fbc0c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:44.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.457+0000 7fbc077fe640 1 -- 172.21.15.77:0/271901156 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7fbc140ab0c0 con 0x7fbc200c5010 2023-11-04T01:44:44.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.457+0000 7fbc1ed9d640 1 --2- 172.21.15.77:0/271901156 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbc0c06ae70 0x7fbc0c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:44.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.457+0000 7fbc1ed9d640 1 --2- 172.21.15.77:0/271901156 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbc0c06ae70 0x7fbc0c06d330 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fbc2015fa80 tx=0x7fbc10008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:44.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.461+0000 7fbc077fe640 1 -- 172.21.15.77:0/271901156 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbc14075b00 con 0x7fbc200c5010 2023-11-04T01:44:44.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.692+0000 7fbc25155640 1 -- 172.21.15.77:0/271901156 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7fbc20074290 con 0x7fbc200c5010 2023-11-04T01:44:44.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.848+0000 7fbc077fe640 1 -- 172.21.15.77:0/271901156 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.35840 v65) v1 ==== 113+0+0 (secure 0 0 0) 0x7fbc14079120 con 0x7fbc200c5010 2023-11-04T01:44:44.850 INFO:teuthology.orchestra.run.smithi077.stderr:freezing mds.35840 2023-11-04T01:44:44.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.850+0000 7fbc25155640 1 -- 172.21.15.77:0/271901156 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbc0c06ae70 msgr2=0x7fbc0c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:44.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.850+0000 7fbc25155640 1 --2- 172.21.15.77:0/271901156 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbc0c06ae70 0x7fbc0c06d330 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fbc2015fa80 tx=0x7fbc10008040 comp rx=0 tx=0).stop 2023-11-04T01:44:44.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.850+0000 7fbc25155640 1 -- 172.21.15.77:0/271901156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc200c5010 msgr2=0x7fbc2014a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:44.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.850+0000 7fbc25155640 1 --2- 172.21.15.77:0/271901156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc200c5010 0x7fbc2014a3e0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fbc14001930 tx=0x7fbc1402e070 comp rx=0 tx=0).stop 2023-11-04T01:44:44.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.850+0000 7fbc25155640 1 -- 172.21.15.77:0/271901156 shutdown_connections 2023-11-04T01:44:44.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.850+0000 7fbc25155640 1 --2- 172.21.15.77:0/271901156 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbc0c06ae70 0x7fbc0c06d330 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.850+0000 7fbc25155640 1 --2- 172.21.15.77:0/271901156 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbc200c3ae0 0x7fbc200c28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.850+0000 7fbc25155640 1 --2- 172.21.15.77:0/271901156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc200c5010 0x7fbc2014a3e0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.850+0000 7fbc25155640 1 --2- 172.21.15.77:0/271901156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbc080047c0 0x7fbc200cd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.850+0000 7fbc25155640 1 -- 172.21.15.77:0/271901156 >> 172.21.15.77:0/271901156 conn(0x7fbc200cbc90 msgr2=0x7fbc200c5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:44.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.850+0000 7fbc25155640 1 -- 172.21.15.77:0/271901156 shutdown_connections 2023-11-04T01:44:44.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:44.850+0000 7fbc25155640 1 -- 172.21.15.77:0/271901156 wait complete. 2023-11-04T01:44:44.863 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json config set mds_kill_mdstable_at 5 2023-11-04T01:44:44.990 INFO:teuthology.orchestra.run.smithi122.stdout:{"success":"mds_kill_mdstable_at = '5' (not observed, change may require restart) "} 2023-11-04T01:44:44.990 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '5' (not observed, change may require restart) " } 2023-11-04T01:44:44.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:44.991 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s15) 2023-11-04T01:44:44.994 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:44:45.015 INFO:tasks.ceph.mds.b.smithi122.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f13bab27640 time 2023-11-04T01:44:45.014668+0000 2023-11-04T01:44:45.015 INFO:tasks.ceph.mds.b.smithi122.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:44:45.017 INFO:tasks.ceph.mds.b.smithi122.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:45.017 INFO:tasks.ceph.mds.b.smithi122.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f13c076efaf] 2023-11-04T01:44:45.017 INFO:tasks.ceph.mds.b.smithi122.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f13c076f16d] 2023-11-04T01:44:45.017 INFO:tasks.ceph.mds.b.smithi122.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55993f51b187] 2023-11-04T01:44:45.018 INFO:tasks.ceph.mds.b.smithi122.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55993f2aa0a9] 2023-11-04T01:44:45.018 INFO:tasks.ceph.mds.b.smithi122.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55993f2acb2b] 2023-11-04T01:44:45.018 INFO:tasks.ceph.mds.b.smithi122.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55993f2ad01c] 2023-11-04T01:44:45.018 INFO:tasks.ceph.mds.b.smithi122.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55993f296325] 2023-11-04T01:44:45.019 INFO:tasks.ceph.mds.b.smithi122.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f13c095ff9a] 2023-11-04T01:44:45.019 INFO:tasks.ceph.mds.b.smithi122.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f13c09f1741] 2023-11-04T01:44:45.019 INFO:tasks.ceph.mds.b.smithi122.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f13bfe9f802] 2023-11-04T01:44:45.019 INFO:tasks.ceph.mds.b.smithi122.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f13bfe3f450] 2023-11-04T01:44:45.020 INFO:tasks.ceph.mds.b.smithi122.stderr:2023-11-04T01:44:45.013+0000 7f13bab27640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f13bab27640 time 2023-11-04T01:44:45.014668+0000 2023-11-04T01:44:45.020 INFO:tasks.ceph.mds.b.smithi122.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:44:45.020 INFO:tasks.ceph.mds.b.smithi122.stderr: 2023-11-04T01:44:45.020 INFO:tasks.ceph.mds.b.smithi122.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:45.021 INFO:tasks.ceph.mds.b.smithi122.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f13c076efaf] 2023-11-04T01:44:45.021 INFO:tasks.ceph.mds.b.smithi122.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f13c076f16d] 2023-11-04T01:44:45.021 INFO:tasks.ceph.mds.b.smithi122.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55993f51b187] 2023-11-04T01:44:45.021 INFO:tasks.ceph.mds.b.smithi122.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55993f2aa0a9] 2023-11-04T01:44:45.021 INFO:tasks.ceph.mds.b.smithi122.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55993f2acb2b] 2023-11-04T01:44:45.022 INFO:tasks.ceph.mds.b.smithi122.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55993f2ad01c] 2023-11-04T01:44:45.022 INFO:tasks.ceph.mds.b.smithi122.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55993f296325] 2023-11-04T01:44:45.022 INFO:tasks.ceph.mds.b.smithi122.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f13c095ff9a] 2023-11-04T01:44:45.022 INFO:tasks.ceph.mds.b.smithi122.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f13c09f1741] 2023-11-04T01:44:45.023 INFO:tasks.ceph.mds.b.smithi122.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f13bfe9f802] 2023-11-04T01:44:45.023 INFO:tasks.ceph.mds.b.smithi122.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f13bfe3f450] 2023-11-04T01:44:45.023 INFO:tasks.ceph.mds.b.smithi122.stderr: 2023-11-04T01:44:45.023 INFO:tasks.ceph.mds.b.smithi122.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:44:45.023 INFO:tasks.ceph.mds.b.smithi122.stderr: in thread 7f13bab27640 thread_name:ms_dispatch 2023-11-04T01:44:45.024 INFO:tasks.ceph.mds.b.smithi122.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:45.024 INFO:tasks.ceph.mds.b.smithi122.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f13bfe54db0] 2023-11-04T01:44:45.024 INFO:tasks.ceph.mds.b.smithi122.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f13bfea154c] 2023-11-04T01:44:45.024 INFO:tasks.ceph.mds.b.smithi122.stderr: 3: raise() 2023-11-04T01:44:45.025 INFO:tasks.ceph.mds.b.smithi122.stderr: 4: abort() 2023-11-04T01:44:45.025 INFO:tasks.ceph.mds.b.smithi122.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f13c076f009] 2023-11-04T01:44:45.025 INFO:tasks.ceph.mds.b.smithi122.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f13c076f16d] 2023-11-04T01:44:45.025 INFO:tasks.ceph.mds.b.smithi122.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55993f51b187] 2023-11-04T01:44:45.025 INFO:tasks.ceph.mds.b.smithi122.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55993f2aa0a9] 2023-11-04T01:44:45.026 INFO:tasks.ceph.mds.b.smithi122.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55993f2acb2b] 2023-11-04T01:44:45.026 INFO:tasks.ceph.mds.b.smithi122.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55993f2ad01c] 2023-11-04T01:44:45.026 INFO:tasks.ceph.mds.b.smithi122.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55993f296325] 2023-11-04T01:44:45.026 INFO:tasks.ceph.mds.b.smithi122.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f13c095ff9a] 2023-11-04T01:44:45.026 INFO:tasks.ceph.mds.b.smithi122.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f13c09f1741] 2023-11-04T01:44:45.027 INFO:tasks.ceph.mds.b.smithi122.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f13bfe9f802] 2023-11-04T01:44:45.027 INFO:tasks.ceph.mds.b.smithi122.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f13bfe3f450] 2023-11-04T01:44:45.027 INFO:tasks.ceph.mds.b.smithi122.stderr:2023-11-04T01:44:45.014+0000 7f13bab27640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:44:45.027 INFO:tasks.ceph.mds.b.smithi122.stderr: in thread 7f13bab27640 thread_name:ms_dispatch 2023-11-04T01:44:45.027 INFO:tasks.ceph.mds.b.smithi122.stderr: 2023-11-04T01:44:45.028 INFO:tasks.ceph.mds.b.smithi122.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:45.028 INFO:tasks.ceph.mds.b.smithi122.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f13bfe54db0] 2023-11-04T01:44:45.028 INFO:tasks.ceph.mds.b.smithi122.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f13bfea154c] 2023-11-04T01:44:45.028 INFO:tasks.ceph.mds.b.smithi122.stderr: 3: raise() 2023-11-04T01:44:45.029 INFO:tasks.ceph.mds.b.smithi122.stderr: 4: abort() 2023-11-04T01:44:45.029 INFO:tasks.ceph.mds.b.smithi122.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f13c076f009] 2023-11-04T01:44:45.029 INFO:tasks.ceph.mds.b.smithi122.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f13c076f16d] 2023-11-04T01:44:45.029 INFO:tasks.ceph.mds.b.smithi122.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55993f51b187] 2023-11-04T01:44:45.029 INFO:tasks.ceph.mds.b.smithi122.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55993f2aa0a9] 2023-11-04T01:44:45.030 INFO:tasks.ceph.mds.b.smithi122.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55993f2acb2b] 2023-11-04T01:44:45.030 INFO:tasks.ceph.mds.b.smithi122.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55993f2ad01c] 2023-11-04T01:44:45.030 INFO:tasks.ceph.mds.b.smithi122.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55993f296325] 2023-11-04T01:44:45.030 INFO:tasks.ceph.mds.b.smithi122.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f13c095ff9a] 2023-11-04T01:44:45.030 INFO:tasks.ceph.mds.b.smithi122.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f13c09f1741] 2023-11-04T01:44:45.031 INFO:tasks.ceph.mds.b.smithi122.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f13bfe9f802] 2023-11-04T01:44:45.031 INFO:tasks.ceph.mds.b.smithi122.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f13bfe3f450] 2023-11-04T01:44:45.031 INFO:tasks.ceph.mds.b.smithi122.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:44:45.031 INFO:tasks.ceph.mds.b.smithi122.stderr: 2023-11-04T01:44:45.033 INFO:tasks.ceph.mds.b.smithi122.stderr: -518> 2023-11-04T01:44:42.261+0000 7f13b8322640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:44:45.033 INFO:tasks.ceph.mds.b.smithi122.stderr: -516> 2023-11-04T01:44:42.261+0000 7f13b8322640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:44:45.033 INFO:tasks.ceph.mds.b.smithi122.stderr: -1> 2023-11-04T01:44:45.013+0000 7f13bab27640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f13bab27640 time 2023-11-04T01:44:45.014668+0000 2023-11-04T01:44:45.033 INFO:tasks.ceph.mds.b.smithi122.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:44:45.033 INFO:tasks.ceph.mds.b.smithi122.stderr: 2023-11-04T01:44:45.034 INFO:tasks.ceph.mds.b.smithi122.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:45.034 INFO:tasks.ceph.mds.b.smithi122.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f13c076efaf] 2023-11-04T01:44:45.034 INFO:tasks.ceph.mds.b.smithi122.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f13c076f16d] 2023-11-04T01:44:45.034 INFO:tasks.ceph.mds.b.smithi122.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55993f51b187] 2023-11-04T01:44:45.035 INFO:tasks.ceph.mds.b.smithi122.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55993f2aa0a9] 2023-11-04T01:44:45.035 INFO:tasks.ceph.mds.b.smithi122.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55993f2acb2b] 2023-11-04T01:44:45.035 INFO:tasks.ceph.mds.b.smithi122.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55993f2ad01c] 2023-11-04T01:44:45.035 INFO:tasks.ceph.mds.b.smithi122.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55993f296325] 2023-11-04T01:44:45.035 INFO:tasks.ceph.mds.b.smithi122.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f13c095ff9a] 2023-11-04T01:44:45.036 INFO:tasks.ceph.mds.b.smithi122.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f13c09f1741] 2023-11-04T01:44:45.036 INFO:tasks.ceph.mds.b.smithi122.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f13bfe9f802] 2023-11-04T01:44:45.036 INFO:tasks.ceph.mds.b.smithi122.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f13bfe3f450] 2023-11-04T01:44:45.036 INFO:tasks.ceph.mds.b.smithi122.stderr: 2023-11-04T01:44:45.037 INFO:tasks.ceph.mds.b.smithi122.stderr: 0> 2023-11-04T01:44:45.014+0000 7f13bab27640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:44:45.037 INFO:tasks.ceph.mds.b.smithi122.stderr: in thread 7f13bab27640 thread_name:ms_dispatch 2023-11-04T01:44:45.037 INFO:tasks.ceph.mds.b.smithi122.stderr: 2023-11-04T01:44:45.037 INFO:tasks.ceph.mds.b.smithi122.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:45.037 INFO:tasks.ceph.mds.b.smithi122.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f13bfe54db0] 2023-11-04T01:44:45.038 INFO:tasks.ceph.mds.b.smithi122.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f13bfea154c] 2023-11-04T01:44:45.038 INFO:tasks.ceph.mds.b.smithi122.stderr: 3: raise() 2023-11-04T01:44:45.038 INFO:tasks.ceph.mds.b.smithi122.stderr: 4: abort() 2023-11-04T01:44:45.038 INFO:tasks.ceph.mds.b.smithi122.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f13c076f009] 2023-11-04T01:44:45.039 INFO:tasks.ceph.mds.b.smithi122.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f13c076f16d] 2023-11-04T01:44:45.039 INFO:tasks.ceph.mds.b.smithi122.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55993f51b187] 2023-11-04T01:44:45.039 INFO:tasks.ceph.mds.b.smithi122.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55993f2aa0a9] 2023-11-04T01:44:45.039 INFO:tasks.ceph.mds.b.smithi122.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55993f2acb2b] 2023-11-04T01:44:45.039 INFO:tasks.ceph.mds.b.smithi122.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55993f2ad01c] 2023-11-04T01:44:45.040 INFO:tasks.ceph.mds.b.smithi122.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55993f296325] 2023-11-04T01:44:45.040 INFO:tasks.ceph.mds.b.smithi122.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f13c095ff9a] 2023-11-04T01:44:45.040 INFO:tasks.ceph.mds.b.smithi122.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f13c09f1741] 2023-11-04T01:44:45.040 INFO:tasks.ceph.mds.b.smithi122.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f13bfe9f802] 2023-11-04T01:44:45.041 INFO:tasks.ceph.mds.b.smithi122.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f13bfe3f450] 2023-11-04T01:44:45.041 INFO:tasks.ceph.mds.b.smithi122.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:44:45.041 INFO:tasks.ceph.mds.b.smithi122.stderr: 2023-11-04T01:44:45.041 INFO:tasks.ceph.mds.b.smithi122.stderr: -518> 2023-11-04T01:44:42.261+0000 7f13b8322640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:44:45.041 INFO:tasks.ceph.mds.b.smithi122.stderr: -516> 2023-11-04T01:44:42.261+0000 7f13b8322640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:44:45.042 INFO:tasks.ceph.mds.b.smithi122.stderr: -1> 2023-11-04T01:44:45.013+0000 7f13bab27640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f13bab27640 time 2023-11-04T01:44:45.014668+0000 2023-11-04T01:44:45.042 INFO:tasks.ceph.mds.b.smithi122.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:44:45.042 INFO:tasks.ceph.mds.b.smithi122.stderr: 2023-11-04T01:44:45.042 INFO:tasks.ceph.mds.b.smithi122.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:45.043 INFO:tasks.ceph.mds.b.smithi122.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f13c076efaf] 2023-11-04T01:44:45.043 INFO:tasks.ceph.mds.b.smithi122.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f13c076f16d] 2023-11-04T01:44:45.043 INFO:tasks.ceph.mds.b.smithi122.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55993f51b187] 2023-11-04T01:44:45.043 INFO:tasks.ceph.mds.b.smithi122.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55993f2aa0a9] 2023-11-04T01:44:45.043 INFO:tasks.ceph.mds.b.smithi122.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55993f2acb2b] 2023-11-04T01:44:45.044 INFO:tasks.ceph.mds.b.smithi122.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55993f2ad01c] 2023-11-04T01:44:45.044 INFO:tasks.ceph.mds.b.smithi122.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55993f296325] 2023-11-04T01:44:45.044 INFO:tasks.ceph.mds.b.smithi122.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f13c095ff9a] 2023-11-04T01:44:45.044 INFO:tasks.ceph.mds.b.smithi122.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f13c09f1741] 2023-11-04T01:44:45.045 INFO:tasks.ceph.mds.b.smithi122.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f13bfe9f802] 2023-11-04T01:44:45.045 INFO:tasks.ceph.mds.b.smithi122.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f13bfe3f450] 2023-11-04T01:44:45.045 INFO:tasks.ceph.mds.b.smithi122.stderr: 2023-11-04T01:44:45.045 INFO:tasks.ceph.mds.b.smithi122.stderr: 0> 2023-11-04T01:44:45.014+0000 7f13bab27640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:44:45.046 INFO:tasks.ceph.mds.b.smithi122.stderr: in thread 7f13bab27640 thread_name:ms_dispatch 2023-11-04T01:44:45.046 INFO:tasks.ceph.mds.b.smithi122.stderr: 2023-11-04T01:44:45.046 INFO:tasks.ceph.mds.b.smithi122.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:44:45.046 INFO:tasks.ceph.mds.b.smithi122.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f13bfe54db0] 2023-11-04T01:44:45.046 INFO:tasks.ceph.mds.b.smithi122.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f13bfea154c] 2023-11-04T01:44:45.047 INFO:tasks.ceph.mds.b.smithi122.stderr: 3: raise() 2023-11-04T01:44:45.047 INFO:tasks.ceph.mds.b.smithi122.stderr: 4: abort() 2023-11-04T01:44:45.047 INFO:tasks.ceph.mds.b.smithi122.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f13c076f009] 2023-11-04T01:44:45.047 INFO:tasks.ceph.mds.b.smithi122.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f13c076f16d] 2023-11-04T01:44:45.048 INFO:tasks.ceph.mds.b.smithi122.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x55993f51b187] 2023-11-04T01:44:45.048 INFO:tasks.ceph.mds.b.smithi122.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55993f2aa0a9] 2023-11-04T01:44:45.048 INFO:tasks.ceph.mds.b.smithi122.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55993f2acb2b] 2023-11-04T01:44:45.048 INFO:tasks.ceph.mds.b.smithi122.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55993f2ad01c] 2023-11-04T01:44:45.048 INFO:tasks.ceph.mds.b.smithi122.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55993f296325] 2023-11-04T01:44:45.049 INFO:tasks.ceph.mds.b.smithi122.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f13c095ff9a] 2023-11-04T01:44:45.049 INFO:tasks.ceph.mds.b.smithi122.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f13c09f1741] 2023-11-04T01:44:45.049 INFO:tasks.ceph.mds.b.smithi122.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f13bfe9f802] 2023-11-04T01:44:45.049 INFO:tasks.ceph.mds.b.smithi122.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f13bfe3f450] 2023-11-04T01:44:45.050 INFO:tasks.ceph.mds.b.smithi122.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:44:45.050 INFO:tasks.ceph.mds.b.smithi122.stderr: 2023-11-04T01:44:45.119 INFO:teuthology.orchestra.run.smithi077.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:44:45.120 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:44:45.120 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:45.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.217+0000 7ff058f3c640 1 Processor -- start 2023-11-04T01:44:45.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.217+0000 7ff058f3c640 1 -- start start 2023-11-04T01:44:45.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.218+0000 7ff058f3c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff0540ce240 0x7ff054157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:45.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.218+0000 7ff058f3c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff054157540 0x7ff0540d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:45.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.218+0000 7ff058f3c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff05415e000 con 0x7ff0540cde60 2023-11-04T01:44:45.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.218+0000 7ff058f3c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff05415e5c0 con 0x7ff054157540 2023-11-04T01:44:45.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.218+0000 7ff058f3c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff05415e2e0 con 0x7ff0540ce240 2023-11-04T01:44:45.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.218+0000 7ff052d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff054157540 0x7ff0540d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:45.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.218+0000 7ff052d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff054157540 0x7ff0540d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52968/0 (socket says 172.21.15.77:52968) 2023-11-04T01:44:45.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.218+0000 7ff052d9d640 1 -- 172.21.15.77:0/4248394244 learned_addr learned my addr 172.21.15.77:0/4248394244 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:45.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.219+0000 7ff051d9b640 1 --2- 172.21.15.77:0/4248394244 >> v2:172.21.15.122:3300/0 conn(0x7ff0540ce240 0x7ff054157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:45.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.219+0000 7ff052d9d640 1 -- 172.21.15.77:0/4248394244 >> v2:172.21.15.122:3300/0 conn(0x7ff0540ce240 msgr2=0x7ff054157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:45.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.219+0000 7ff052d9d640 1 --2- 172.21.15.77:0/4248394244 >> v2:172.21.15.122:3300/0 conn(0x7ff0540ce240 0x7ff054157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.219+0000 7ff052d9d640 1 -- 172.21.15.77:0/4248394244 >> v1:172.21.15.122:6789/0 conn(0x7ff0540cde60 legacy=0x7ff05415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:45.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.219+0000 7ff052d9d640 1 -- 172.21.15.77:0/4248394244 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0540d1120 con 0x7ff054157540 2023-11-04T01:44:45.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.219+0000 7ff052d9d640 1 --2- 172.21.15.77:0/4248394244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff054157540 0x7ff0540d1920 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7ff0540cf5f0 tx=0x7ff04c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b36480e5c905b9b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:45.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.220+0000 7ff05159a640 1 -- 172.21.15.77:0/4248394244 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c02cb20 con 0x7ff054157540 2023-11-04T01:44:45.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.220+0000 7ff05159a640 1 -- 172.21.15.77:0/4248394244 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04c02cc80 con 0x7ff054157540 2023-11-04T01:44:45.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.220+0000 7ff05159a640 1 -- 172.21.15.77:0/4248394244 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c0343f0 con 0x7ff054157540 2023-11-04T01:44:45.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.220+0000 7ff058f3c640 1 -- 172.21.15.77:0/4248394244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff054157540 msgr2=0x7ff0540d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:45.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.220+0000 7ff058f3c640 1 --2- 172.21.15.77:0/4248394244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff054157540 0x7ff0540d1920 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7ff0540cf5f0 tx=0x7ff04c02bf80 comp rx=0 tx=0).stop 2023-11-04T01:44:45.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.220+0000 7ff058f3c640 1 -- 172.21.15.77:0/4248394244 shutdown_connections 2023-11-04T01:44:45.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.220+0000 7ff058f3c640 1 --2- 172.21.15.77:0/4248394244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff054157540 0x7ff0540d1920 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.220+0000 7ff058f3c640 1 --2- 172.21.15.77:0/4248394244 >> v2:172.21.15.122:3300/0 conn(0x7ff0540ce240 0x7ff054157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.220+0000 7ff058f3c640 1 -- 172.21.15.77:0/4248394244 >> 172.21.15.77:0/4248394244 conn(0x7ff054071f30 msgr2=0x7ff0540cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:45.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.220+0000 7ff058f3c640 1 -- 172.21.15.77:0/4248394244 shutdown_connections 2023-11-04T01:44:45.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.220+0000 7ff058f3c640 1 -- 172.21.15.77:0/4248394244 wait complete. 2023-11-04T01:44:45.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.222+0000 7ff058f3c640 1 Processor -- start 2023-11-04T01:44:45.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.222+0000 7ff058f3c640 1 -- start start 2023-11-04T01:44:45.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.222+0000 7ff058f3c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff0540cde60 0x7ff0540b4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:45.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.222+0000 7ff058f3c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0540ce240 0x7ff0540cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:45.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.222+0000 7ff058f3c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff054157540 0x7ff0540cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:45.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.222+0000 7ff058f3c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff054147e20 con 0x7ff054157540 2023-11-04T01:44:45.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.222+0000 7ff058f3c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0541f34f0 con 0x7ff0540ce240 2023-11-04T01:44:45.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.222+0000 7ff058f3c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff05414ac50 con 0x7ff0540cde60 2023-11-04T01:44:45.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.222+0000 7ff052d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff054157540 0x7ff0540cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:45.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.222+0000 7ff052d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff054157540 0x7ff0540cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52978/0 (socket says 172.21.15.77:52978) 2023-11-04T01:44:45.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.222+0000 7ff052d9d640 1 -- 172.21.15.77:0/2657481091 learned_addr learned my addr 172.21.15.77:0/2657481091 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:45.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.223+0000 7ff051d9b640 1 --2- 172.21.15.77:0/2657481091 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0540ce240 0x7ff0540cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:45.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.223+0000 7ff05259c640 1 --2- 172.21.15.77:0/2657481091 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff0540cde60 0x7ff0540b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:45.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.223+0000 7ff052d9d640 1 -- 172.21.15.77:0/2657481091 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff0540cde60 msgr2=0x7ff0540b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:45.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.223+0000 7ff052d9d640 1 --2- 172.21.15.77:0/2657481091 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff0540cde60 0x7ff0540b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.223+0000 7ff052d9d640 1 -- 172.21.15.77:0/2657481091 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0540ce240 msgr2=0x7ff0540cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:45.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.223+0000 7ff052d9d640 1 --2- 172.21.15.77:0/2657481091 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0540ce240 0x7ff0540cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.223+0000 7ff052d9d640 1 -- 172.21.15.77:0/2657481091 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff04c009b30 con 0x7ff054157540 2023-11-04T01:44:45.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.223+0000 7ff052d9d640 1 --2- 172.21.15.77:0/2657481091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff054157540 0x7ff0540cc600 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7ff04c036040 tx=0x7ff04c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:45.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.223+0000 7ff04affd640 1 -- 172.21.15.77:0/2657481091 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c009510 con 0x7ff054157540 2023-11-04T01:44:45.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.223+0000 7ff04affd640 1 -- 172.21.15.77:0/2657481091 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04c02c920 con 0x7ff054157540 2023-11-04T01:44:45.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.223+0000 7ff04affd640 1 -- 172.21.15.77:0/2657481091 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c03e690 con 0x7ff054157540 2023-11-04T01:44:45.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.223+0000 7ff058f3c640 1 -- 172.21.15.77:0/2657481091 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff054148030 con 0x7ff054157540 2023-11-04T01:44:45.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.223+0000 7ff058f3c640 1 -- 172.21.15.77:0/2657481091 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0541485f0 con 0x7ff054157540 2023-11-04T01:44:45.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.224+0000 7ff058f3c640 1 -- 172.21.15.77:0/2657481091 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff054074290 con 0x7ff054157540 2023-11-04T01:44:45.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.225+0000 7ff04affd640 1 -- 172.21.15.77:0/2657481091 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff04c03e7f0 con 0x7ff054157540 2023-11-04T01:44:45.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.225+0000 7ff04affd640 1 --2- 172.21.15.77:0/2657481091 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff03406ae70 0x7ff03406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:45.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.225+0000 7ff04affd640 1 -- 172.21.15.77:0/2657481091 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7ff04c0ac610 con 0x7ff054157540 2023-11-04T01:44:45.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.225+0000 7ff05259c640 1 --2- 172.21.15.77:0/2657481091 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff03406ae70 0x7ff03406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:45.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.226+0000 7ff05259c640 1 --2- 172.21.15.77:0/2657481091 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff03406ae70 0x7ff03406d330 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7ff0540b7e40 tx=0x7ff044009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:45.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.229+0000 7ff04affd640 1 -- 172.21.15.77:0/2657481091 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff04c077100 con 0x7ff054157540 2023-11-04T01:44:45.371 INFO:tasks.ceph.mds.b.smithi122.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:44:45.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.428+0000 7ff058f3c640 1 -- 172.21.15.77:0/2657481091 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0540b8940 con 0x7ff054157540 2023-11-04T01:44:45.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.429+0000 7ff04affd640 1 -- 172.21.15.77:0/2657481091 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4938 (secure 0 0 0) 0x7ff04c07a720 con 0x7ff054157540 2023-11-04T01:44:45.431 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:44:45.431 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":65,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7743,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/285184758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":285184758},{"type":"v1","addr":"172.21.15.77:6834","nonce":285184758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:44:44.694835+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":35840,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_35840":{"gid":35840,"name":"b","rank":0,"incarnation":60,"state":"up:active","state_seq":11,"addr":"172.21.15.122:6836/2908314953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2908314953},{"type":"v1","addr":"172.21.15.122:6836","nonce":2908314953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:45.431 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 65 2023-11-04T01:44:45.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.430+0000 7ff058f3c640 1 -- 172.21.15.77:0/2657481091 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff03406ae70 msgr2=0x7ff03406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:45.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.430+0000 7ff058f3c640 1 --2- 172.21.15.77:0/2657481091 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff03406ae70 0x7ff03406d330 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7ff0540b7e40 tx=0x7ff044009040 comp rx=0 tx=0).stop 2023-11-04T01:44:45.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.430+0000 7ff058f3c640 1 -- 172.21.15.77:0/2657481091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff054157540 msgr2=0x7ff0540cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:45.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.430+0000 7ff058f3c640 1 --2- 172.21.15.77:0/2657481091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff054157540 0x7ff0540cc600 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7ff04c036040 tx=0x7ff04c004a40 comp rx=0 tx=0).stop 2023-11-04T01:44:45.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.430+0000 7ff058f3c640 1 -- 172.21.15.77:0/2657481091 shutdown_connections 2023-11-04T01:44:45.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.430+0000 7ff058f3c640 1 --2- 172.21.15.77:0/2657481091 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff03406ae70 0x7ff03406d330 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.430+0000 7ff058f3c640 1 --2- 172.21.15.77:0/2657481091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff054157540 0x7ff0540cc600 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.430+0000 7ff058f3c640 1 --2- 172.21.15.77:0/2657481091 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff0540ce240 0x7ff0540cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.430+0000 7ff058f3c640 1 --2- 172.21.15.77:0/2657481091 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff0540cde60 0x7ff0540b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.431+0000 7ff058f3c640 1 -- 172.21.15.77:0/2657481091 >> 172.21.15.77:0/2657481091 conn(0x7ff054071f30 msgr2=0x7ff054072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:45.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.431+0000 7ff058f3c640 1 -- 172.21.15.77:0/2657481091 shutdown_connections 2023-11-04T01:44:45.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:45.431+0000 7ff058f3c640 1 -- 172.21.15.77:0/2657481091 wait complete. 2023-11-04T01:44:45.443 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:44:46.803 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-11-04T01:44:50.444 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:50.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.553+0000 7f3bfc67c640 1 Processor -- start 2023-11-04T01:44:50.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.553+0000 7f3bfc67c640 1 -- start start 2023-11-04T01:44:50.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.554+0000 7f3bfc67c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f3bf415ae40 0x7f3bf415bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.554+0000 7f3bfc67c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3bf40cda30 0x7f3bf40ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.554+0000 7f3bfc67c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf40cc450 con 0x7f3bf40cbc00 2023-11-04T01:44:50.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.554+0000 7f3bfc67c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf415f400 con 0x7f3bf40cda30 2023-11-04T01:44:50.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.554+0000 7f3bfc67c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf415b220 con 0x7f3bf415ae40 2023-11-04T01:44:50.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.554+0000 7f3bfac19640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3bf40cda30 0x7f3bf40ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.554+0000 7f3bf9c17640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f3bf40cbc00 0x7f3bf40cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49940/0 (socket says 172.21.15.77:49940) 2023-11-04T01:44:50.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.554+0000 7f3bf9c17640 1 -- 172.21.15.77:0/81336486 learned_addr learned my addr 172.21.15.77:0/81336486 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:44:50.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.555+0000 7f3bfa418640 1 --2- 172.21.15.77:0/81336486 >> v2:172.21.15.122:3300/0 conn(0x7f3bf415ae40 0x7f3bf415bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.555+0000 7f3bfac19640 1 -- 172.21.15.77:0/81336486 >> v2:172.21.15.122:3300/0 conn(0x7f3bf415ae40 msgr2=0x7f3bf415bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:50.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.555+0000 7f3bfac19640 1 --2- 172.21.15.77:0/81336486 >> v2:172.21.15.122:3300/0 conn(0x7f3bf415ae40 0x7f3bf415bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.555+0000 7f3bfac19640 1 -- 172.21.15.77:0/81336486 >> v1:172.21.15.77:6789/0 conn(0x7f3bf40cbc00 legacy=0x7f3bf40cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.555+0000 7f3bfac19640 1 -- 172.21.15.77:0/81336486 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf415f890 con 0x7f3bf40cda30 2023-11-04T01:44:50.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.555+0000 7f3bf9416640 1 -- 172.21.15.77:0/81336486 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1755736560 0 0) 0x7f3be4001110 con 0x7f3bf40cbc00 2023-11-04T01:44:50.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.555+0000 7f3bfa418640 1 --2- 172.21.15.77:0/81336486 >> v2:172.21.15.122:3300/0 conn(0x7f3bf415ae40 0x7f3bf415bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:50.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.556+0000 7f3bfac19640 1 --2- 172.21.15.77:0/81336486 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bf40cda30 0x7f3bf40ced70 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f3bf406e580 tx=0x7f3bec02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b7ddf995bd099e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:50.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.556+0000 7f3bf9416640 1 -- 172.21.15.77:0/81336486 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec031830 con 0x7f3bf40cda30 2023-11-04T01:44:50.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.556+0000 7f3bf9416640 1 -- 172.21.15.77:0/81336486 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bec031990 con 0x7f3bf40cda30 2023-11-04T01:44:50.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.556+0000 7f3bf9416640 1 -- 172.21.15.77:0/81336486 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec031d20 con 0x7f3bf40cda30 2023-11-04T01:44:50.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.556+0000 7f3bfc67c640 1 -- 172.21.15.77:0/81336486 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bf40cda30 msgr2=0x7f3bf40ced70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.556+0000 7f3bfc67c640 1 --2- 172.21.15.77:0/81336486 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bf40cda30 0x7f3bf40ced70 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f3bf406e580 tx=0x7f3bec02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.556+0000 7f3bfc67c640 1 -- 172.21.15.77:0/81336486 shutdown_connections 2023-11-04T01:44:50.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.556+0000 7f3bfc67c640 1 --2- 172.21.15.77:0/81336486 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bf40cda30 0x7f3bf40ced70 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.556+0000 7f3bfc67c640 1 --2- 172.21.15.77:0/81336486 >> v2:172.21.15.122:3300/0 conn(0x7f3bf415ae40 0x7f3bf415bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.556+0000 7f3bfc67c640 1 -- 172.21.15.77:0/81336486 >> 172.21.15.77:0/81336486 conn(0x7f3bf406ea90 msgr2=0x7f3bf406ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:50.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.556+0000 7f3bfc67c640 1 -- 172.21.15.77:0/81336486 shutdown_connections 2023-11-04T01:44:50.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.556+0000 7f3bfc67c640 1 -- 172.21.15.77:0/81336486 wait complete. 2023-11-04T01:44:50.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.557+0000 7f3bfc67c640 1 Processor -- start 2023-11-04T01:44:50.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.558+0000 7f3bfc67c640 1 -- start start 2023-11-04T01:44:50.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.558+0000 7f3bfc67c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bf40cbc00 0x7f3bf40c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.558+0000 7f3bfc67c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3bf40cda30 0x7f3bf40c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.558+0000 7f3bfc67c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bf415ae40 0x7f3bf406b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.558+0000 7f3bfc67c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf40b1910 con 0x7f3bf40cbc00 2023-11-04T01:44:50.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.558+0000 7f3bfc67c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf40c86f0 con 0x7f3bf415ae40 2023-11-04T01:44:50.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.558+0000 7f3bfc67c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf406cb70 con 0x7f3bf40cda30 2023-11-04T01:44:50.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.558+0000 7f3bfa418640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bf40cbc00 0x7f3bf40c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.558+0000 7f3bfa418640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bf40cbc00 0x7f3bf40c7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47018/0 (socket says 172.21.15.77:47018) 2023-11-04T01:44:50.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.558+0000 7f3bfa418640 1 -- 172.21.15.77:0/1330068064 learned_addr learned my addr 172.21.15.77:0/1330068064 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:50.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.559+0000 7f3bfac19640 1 --2- 172.21.15.77:0/1330068064 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bf415ae40 0x7f3bf406b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.559+0000 7f3bf9c17640 1 --2- 172.21.15.77:0/1330068064 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3bf40cda30 0x7f3bf40c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.559+0000 7f3bfa418640 1 -- 172.21.15.77:0/1330068064 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3bf40cda30 msgr2=0x7f3bf40c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.559+0000 7f3bfa418640 1 --2- 172.21.15.77:0/1330068064 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3bf40cda30 0x7f3bf40c81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.559+0000 7f3bfa418640 1 -- 172.21.15.77:0/1330068064 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bf415ae40 msgr2=0x7f3bf406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.559+0000 7f3bfa418640 1 --2- 172.21.15.77:0/1330068064 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bf415ae40 0x7f3bf406b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.559+0000 7f3bfa418640 1 -- 172.21.15.77:0/1330068064 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bec009400 con 0x7f3bf40cbc00 2023-11-04T01:44:50.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.559+0000 7f3bfac19640 1 --2- 172.21.15.77:0/1330068064 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bf415ae40 0x7f3bf406b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:50.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.559+0000 7f3bf9c17640 1 --2- 172.21.15.77:0/1330068064 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3bf40cda30 0x7f3bf40c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:50.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.559+0000 7f3bfa418640 1 --2- 172.21.15.77:0/1330068064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bf40cbc00 0x7f3bf40c7c70 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000ce00 tx=0x7f3bf000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:50.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.559+0000 7f3beaffd640 1 -- 172.21.15.77:0/1330068064 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf000f890 con 0x7f3bf40cbc00 2023-11-04T01:44:50.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.559+0000 7f3beaffd640 1 -- 172.21.15.77:0/1330068064 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf000f9f0 con 0x7f3bf40cbc00 2023-11-04T01:44:50.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.559+0000 7f3bfc67c640 1 -- 172.21.15.77:0/1330068064 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf406c5b0 con 0x7f3bf40cbc00 2023-11-04T01:44:50.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.559+0000 7f3beaffd640 1 -- 172.21.15.77:0/1330068064 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf000fdc0 con 0x7f3bf40cbc00 2023-11-04T01:44:50.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.559+0000 7f3bfc67c640 1 -- 172.21.15.77:0/1330068064 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf40b1530 con 0x7f3bf40cbc00 2023-11-04T01:44:50.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.560+0000 7f3bfc67c640 1 -- 172.21.15.77:0/1330068064 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf40b1b80 con 0x7f3bf40cbc00 2023-11-04T01:44:50.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.560+0000 7f3beaffd640 1 -- 172.21.15.77:0/1330068064 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3bf000b040 con 0x7f3bf40cbc00 2023-11-04T01:44:50.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.561+0000 7f3beaffd640 1 --2- 172.21.15.77:0/1330068064 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3bd806ae70 0x7f3bd806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.561+0000 7f3beaffd640 1 -- 172.21.15.77:0/1330068064 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f3bf008a580 con 0x7f3bf40cbc00 2023-11-04T01:44:50.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.561+0000 7f3bf9c17640 1 --2- 172.21.15.77:0/1330068064 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3bd806ae70 0x7f3bd806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.561+0000 7f3bf9c17640 1 --2- 172.21.15.77:0/1330068064 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3bd806ae70 0x7f3bd806d330 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f3bf41f6590 tx=0x7f3be4009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:50.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.565+0000 7f3beaffd640 1 -- 172.21.15.77:0/1330068064 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3bf0055050 con 0x7f3bf40cbc00 2023-11-04T01:44:50.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.766+0000 7f3bfc67c640 1 -- 172.21.15.77:0/1330068064 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3bf40ce2d0 con 0x7f3bf40cbc00 2023-11-04T01:44:50.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.766+0000 7f3beaffd640 1 -- 172.21.15.77:0/1330068064 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f3bf0058670 con 0x7f3bf40cbc00 2023-11-04T01:44:50.768 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:44:50.768 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":65,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7743,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/285184758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":285184758},{"type":"v1","addr":"172.21.15.77:6834","nonce":285184758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:44:44.694835+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":35840,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_35840":{"gid":35840,"name":"b","rank":0,"incarnation":60,"state":"up:active","state_seq":11,"addr":"172.21.15.122:6836/2908314953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2908314953},{"type":"v1","addr":"172.21.15.122:6836","nonce":2908314953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:50.769 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 65 2023-11-04T01:44:50.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.768+0000 7f3bfc67c640 1 -- 172.21.15.77:0/1330068064 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3bd806ae70 msgr2=0x7f3bd806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.768+0000 7f3bfc67c640 1 --2- 172.21.15.77:0/1330068064 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3bd806ae70 0x7f3bd806d330 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f3bf41f6590 tx=0x7f3be4009040 comp rx=0 tx=0).stop 2023-11-04T01:44:50.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.768+0000 7f3bfc67c640 1 -- 172.21.15.77:0/1330068064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bf40cbc00 msgr2=0x7f3bf40c7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.768+0000 7f3bfc67c640 1 --2- 172.21.15.77:0/1330068064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bf40cbc00 0x7f3bf40c7c70 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000ce00 tx=0x7f3bf000a650 comp rx=0 tx=0).stop 2023-11-04T01:44:50.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.768+0000 7f3bfc67c640 1 -- 172.21.15.77:0/1330068064 shutdown_connections 2023-11-04T01:44:50.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.768+0000 7f3bfc67c640 1 --2- 172.21.15.77:0/1330068064 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f3bd806ae70 0x7f3bd806d330 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.768+0000 7f3bfc67c640 1 --2- 172.21.15.77:0/1330068064 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bf415ae40 0x7f3bf406b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.768+0000 7f3bfc67c640 1 --2- 172.21.15.77:0/1330068064 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f3bf40cda30 0x7f3bf40c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.768+0000 7f3bfc67c640 1 --2- 172.21.15.77:0/1330068064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bf40cbc00 0x7f3bf40c7c70 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.768+0000 7f3bfc67c640 1 -- 172.21.15.77:0/1330068064 >> 172.21.15.77:0/1330068064 conn(0x7f3bf406ea90 msgr2=0x7f3bf40cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:50.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.768+0000 7f3bfc67c640 1 -- 172.21.15.77:0/1330068064 shutdown_connections 2023-11-04T01:44:50.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:50.768+0000 7f3bfc67c640 1 -- 172.21.15.77:0/1330068064 wait complete. 2023-11-04T01:44:50.780 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:44:53.415 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~7s 2023-11-04T01:44:55.781 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:55.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.890+0000 7f962c9b6640 1 Processor -- start 2023-11-04T01:44:55.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.890+0000 7f962c9b6640 1 -- start start 2023-11-04T01:44:55.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.891+0000 7f962c9b6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f96280cda60 0x7f96280ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:55.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.891+0000 7f962c9b6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96280cc990 con 0x7f9628070d40 2023-11-04T01:44:55.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.891+0000 7f962c9b6640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96280ccc70 con 0x7f96280b0cd0 2023-11-04T01:44:55.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.891+0000 7f962c9b6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96280c9ce0 con 0x7f96280cda60 2023-11-04T01:44:55.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.891+0000 7f962659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f96280cda60 0x7f96280ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:55.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.891+0000 7f9626d9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f9628070d40 0x7f962806c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49950/0 (socket says 172.21.15.77:49950) 2023-11-04T01:44:55.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.891+0000 7f9626d9d640 1 -- 172.21.15.77:0/2560080196 learned_addr learned my addr 172.21.15.77:0/2560080196 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:44:55.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.892+0000 7f962659c640 1 -- 172.21.15.77:0/2560080196 >> v1:172.21.15.122:6789/0 conn(0x7f96280b0cd0 legacy=0x7f9628070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:55.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.892+0000 7f962659c640 1 -- 172.21.15.77:0/2560080196 >> v1:172.21.15.77:6789/0 conn(0x7f9628070d40 legacy=0x7f962806c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:55.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.892+0000 7f962659c640 1 -- 172.21.15.77:0/2560080196 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96280c9fc0 con 0x7f96280cda60 2023-11-04T01:44:55.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.892+0000 7f962559a640 1 -- 172.21.15.77:0/2560080196 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1435830049 0 0) 0x7f96280cc990 con 0x7f9628070d40 2023-11-04T01:44:55.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.892+0000 7f962659c640 1 --2- 172.21.15.77:0/2560080196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96280cda60 0x7f96280ca7a0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f9618009d90 tx=0x7f961802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=572fc59ba5ef5320 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:55.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.893+0000 7f962559a640 1 -- 172.21.15.77:0/2560080196 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961802cc60 con 0x7f96280cda60 2023-11-04T01:44:55.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.893+0000 7f962559a640 1 -- 172.21.15.77:0/2560080196 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961802cdc0 con 0x7f96280cda60 2023-11-04T01:44:55.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.893+0000 7f962559a640 1 -- 172.21.15.77:0/2560080196 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9618034660 con 0x7f96280cda60 2023-11-04T01:44:55.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.893+0000 7f962c9b6640 1 -- 172.21.15.77:0/2560080196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96280cda60 msgr2=0x7f96280ca7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:55.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.893+0000 7f962c9b6640 1 --2- 172.21.15.77:0/2560080196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96280cda60 0x7f96280ca7a0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f9618009d90 tx=0x7f961802beb0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.893+0000 7f962c9b6640 1 -- 172.21.15.77:0/2560080196 shutdown_connections 2023-11-04T01:44:55.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.893+0000 7f962c9b6640 1 --2- 172.21.15.77:0/2560080196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96280cda60 0x7f96280ca7a0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.893+0000 7f962c9b6640 1 -- 172.21.15.77:0/2560080196 >> 172.21.15.77:0/2560080196 conn(0x7f96280ce950 msgr2=0x7f96280ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:55.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.893+0000 7f962c9b6640 1 -- 172.21.15.77:0/2560080196 shutdown_connections 2023-11-04T01:44:55.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.893+0000 7f962c9b6640 1 -- 172.21.15.77:0/2560080196 wait complete. 2023-11-04T01:44:55.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.895+0000 7f962c9b6640 1 Processor -- start 2023-11-04T01:44:55.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.895+0000 7f962c9b6640 1 -- start start 2023-11-04T01:44:55.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.895+0000 7f962c9b6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9628070d40 0x7f96280c2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:55.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.895+0000 7f962c9b6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96280b0cd0 0x7f96280c5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:55.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.895+0000 7f962c9b6640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f96280cda60 0x7f962815b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:55.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.895+0000 7f962c9b6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962814ffb0 con 0x7f9628070d40 2023-11-04T01:44:55.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.895+0000 7f962c9b6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96280c3960 con 0x7f96280b0cd0 2023-11-04T01:44:55.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.895+0000 7f962c9b6640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96280c57c0 con 0x7f96280cda60 2023-11-04T01:44:55.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.896+0000 7f962659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9628070d40 0x7f96280c2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:55.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.896+0000 7f962659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9628070d40 0x7f96280c2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47030/0 (socket says 172.21.15.77:47030) 2023-11-04T01:44:55.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.896+0000 7f962659c640 1 -- 172.21.15.77:0/1256312629 learned_addr learned my addr 172.21.15.77:0/1256312629 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:44:55.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.896+0000 7f9625d9b640 1 --2- 172.21.15.77:0/1256312629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96280b0cd0 0x7f96280c5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:55.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.896+0000 7f9626d9d640 1 --2- 172.21.15.77:0/1256312629 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f96280cda60 0x7f962815b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:55.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.896+0000 7f962659c640 1 -- 172.21.15.77:0/1256312629 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f96280cda60 msgr2=0x7f962815b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:55.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.896+0000 7f962659c640 1 --2- 172.21.15.77:0/1256312629 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f96280cda60 0x7f962815b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.896+0000 7f962659c640 1 -- 172.21.15.77:0/1256312629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96280b0cd0 msgr2=0x7f96280c5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:55.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.896+0000 7f962659c640 1 --2- 172.21.15.77:0/1256312629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96280b0cd0 0x7f96280c5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.896+0000 7f962659c640 1 -- 172.21.15.77:0/1256312629 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9618009a70 con 0x7f9628070d40 2023-11-04T01:44:55.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.896+0000 7f962659c640 1 --2- 172.21.15.77:0/1256312629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9628070d40 0x7f96280c2cd0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f9618009d90 tx=0x7f9618004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:55.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.896+0000 7f9616ffd640 1 -- 172.21.15.77:0/1256312629 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961803e610 con 0x7f9628070d40 2023-11-04T01:44:55.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.896+0000 7f9616ffd640 1 -- 172.21.15.77:0/1256312629 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961803e770 con 0x7f9628070d40 2023-11-04T01:44:55.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.896+0000 7f9616ffd640 1 -- 172.21.15.77:0/1256312629 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961803eb20 con 0x7f9628070d40 2023-11-04T01:44:55.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.896+0000 7f962c9b6640 1 -- 172.21.15.77:0/1256312629 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96280c33a0 con 0x7f9628070d40 2023-11-04T01:44:55.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.896+0000 7f962c9b6640 1 -- 172.21.15.77:0/1256312629 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f962814fbd0 con 0x7f9628070d40 2023-11-04T01:44:55.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.897+0000 7f962c9b6640 1 -- 172.21.15.77:0/1256312629 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f962814fa30 con 0x7f9628070d40 2023-11-04T01:44:55.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.898+0000 7f9616ffd640 1 -- 172.21.15.77:0/1256312629 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f961803b050 con 0x7f9628070d40 2023-11-04T01:44:55.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.898+0000 7f9616ffd640 1 --2- 172.21.15.77:0/1256312629 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f960806ae70 0x7f960806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:55.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.898+0000 7f9616ffd640 1 -- 172.21.15.77:0/1256312629 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7f96180ac670 con 0x7f9628070d40 2023-11-04T01:44:55.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.898+0000 7f9625d9b640 1 --2- 172.21.15.77:0/1256312629 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f960806ae70 0x7f960806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:55.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.899+0000 7f9625d9b640 1 --2- 172.21.15.77:0/1256312629 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f960806ae70 0x7f960806d330 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f96280c8e70 tx=0x7f961c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:55.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:55.902+0000 7f9616ffd640 1 -- 172.21.15.77:0/1256312629 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f962814fa30 con 0x7f9628070d40 2023-11-04T01:44:56.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:56.101+0000 7f962c9b6640 1 -- 172.21.15.77:0/1256312629 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96281500f0 con 0x7f9628070d40 2023-11-04T01:44:56.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:56.101+0000 7f9616ffd640 1 -- 172.21.15.77:0/1256312629 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f96281500f0 con 0x7f9628070d40 2023-11-04T01:44:56.107 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:44:56.107 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":65,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7743,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/285184758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":285184758},{"type":"v1","addr":"172.21.15.77:6834","nonce":285184758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:44:44.694835+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":35840,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_35840":{"gid":35840,"name":"b","rank":0,"incarnation":60,"state":"up:active","state_seq":11,"addr":"172.21.15.122:6836/2908314953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2908314953},{"type":"v1","addr":"172.21.15.122:6836","nonce":2908314953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:44:56.108 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 65 2023-11-04T01:44:56.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:56.103+0000 7f962c9b6640 1 -- 172.21.15.77:0/1256312629 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f960806ae70 msgr2=0x7f960806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:56.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:56.103+0000 7f962c9b6640 1 --2- 172.21.15.77:0/1256312629 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f960806ae70 0x7f960806d330 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f96280c8e70 tx=0x7f961c009040 comp rx=0 tx=0).stop 2023-11-04T01:44:56.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:56.103+0000 7f962c9b6640 1 -- 172.21.15.77:0/1256312629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9628070d40 msgr2=0x7f96280c2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:56.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:56.103+0000 7f962c9b6640 1 --2- 172.21.15.77:0/1256312629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9628070d40 0x7f96280c2cd0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f9618009d90 tx=0x7f9618004a40 comp rx=0 tx=0).stop 2023-11-04T01:44:56.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:56.103+0000 7f962c9b6640 1 -- 172.21.15.77:0/1256312629 shutdown_connections 2023-11-04T01:44:56.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:56.103+0000 7f962c9b6640 1 --2- 172.21.15.77:0/1256312629 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f960806ae70 0x7f960806d330 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:56.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:56.103+0000 7f962c9b6640 1 --2- 172.21.15.77:0/1256312629 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f96280cda60 0x7f962815b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:56.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:56.103+0000 7f962c9b6640 1 --2- 172.21.15.77:0/1256312629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96280b0cd0 0x7f96280c5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:56.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:56.103+0000 7f962c9b6640 1 --2- 172.21.15.77:0/1256312629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9628070d40 0x7f96280c2cd0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:56.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:56.103+0000 7f962c9b6640 1 -- 172.21.15.77:0/1256312629 >> 172.21.15.77:0/1256312629 conn(0x7f96280ce950 msgr2=0x7f9628072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:56.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:56.103+0000 7f962c9b6640 1 -- 172.21.15.77:0/1256312629 shutdown_connections 2023-11-04T01:44:56.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:44:56.103+0000 7f962c9b6640 1 -- 172.21.15.77:0/1256312629 wait complete. 2023-11-04T01:44:56.115 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:45:00.025 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~13s 2023-11-04T01:45:00.858 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:45:00.861 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:45:01.116 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:01.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.226+0000 7fd8818e0640 1 Processor -- start 2023-11-04T01:45:01.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.226+0000 7fd8818e0640 1 -- start start 2023-11-04T01:45:01.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.227+0000 7fd8818e0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd87c0ce240 0x7fd87c157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:01.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.227+0000 7fd8818e0640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd87c157540 0x7fd87c0d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:01.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.227+0000 7fd8818e0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd87c15e000 con 0x7fd87c0cde60 2023-11-04T01:45:01.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.227+0000 7fd8818e0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd87c15e5c0 con 0x7fd87c0ce240 2023-11-04T01:45:01.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.227+0000 7fd8818e0640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c15e2e0 con 0x7fd87c157540 2023-11-04T01:45:01.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.227+0000 7fd87affd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd87c0cde60 0x7fd87c15d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:39594/0 (socket says 172.21.15.77:39594) 2023-11-04T01:45:01.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.227+0000 7fd87affd640 1 -- 172.21.15.77:0/4010231355 learned_addr learned my addr 172.21.15.77:0/4010231355 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:45:01.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.227+0000 7fd87a7fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd87c0ce240 0x7fd87c157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:01.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.227+0000 7fd87b7fe640 1 --2- 172.21.15.77:0/4010231355 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd87c157540 0x7fd87c0d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:01.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.227+0000 7fd87a7fc640 1 -- 172.21.15.77:0/4010231355 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd87c157540 msgr2=0x7fd87c0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:01.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.227+0000 7fd87a7fc640 1 --2- 172.21.15.77:0/4010231355 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd87c157540 0x7fd87c0d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.227+0000 7fd87a7fc640 1 -- 172.21.15.77:0/4010231355 >> v1:172.21.15.77:6789/0 conn(0x7fd87c0cde60 legacy=0x7fd87c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:01.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.227+0000 7fd879ffb640 1 -- 172.21.15.77:0/4010231355 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 591157647 0 0) 0x7fd87c15e000 con 0x7fd87c0cde60 2023-11-04T01:45:01.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.227+0000 7fd87a7fc640 1 -- 172.21.15.77:0/4010231355 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd87c0d1120 con 0x7fd87c0ce240 2023-11-04T01:45:01.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.227+0000 7fd87b7fe640 1 --2- 172.21.15.77:0/4010231355 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd87c157540 0x7fd87c0d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:01.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.228+0000 7fd87a7fc640 1 --2- 172.21.15.77:0/4010231355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd87c0ce240 0x7fd87c157000 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fd8700097a0 tx=0x7fd87002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ee09f8a7e92b0eb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:01.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.228+0000 7fd879ffb640 1 -- 172.21.15.77:0/4010231355 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd870031830 con 0x7fd87c0ce240 2023-11-04T01:45:01.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.228+0000 7fd879ffb640 1 -- 172.21.15.77:0/4010231355 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd870031990 con 0x7fd87c0ce240 2023-11-04T01:45:01.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.228+0000 7fd879ffb640 1 -- 172.21.15.77:0/4010231355 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd870031d20 con 0x7fd87c0ce240 2023-11-04T01:45:01.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.228+0000 7fd8818e0640 1 -- 172.21.15.77:0/4010231355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd87c0ce240 msgr2=0x7fd87c157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:01.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.228+0000 7fd8818e0640 1 --2- 172.21.15.77:0/4010231355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd87c0ce240 0x7fd87c157000 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fd8700097a0 tx=0x7fd87002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.229+0000 7fd8818e0640 1 -- 172.21.15.77:0/4010231355 shutdown_connections 2023-11-04T01:45:01.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.229+0000 7fd8818e0640 1 --2- 172.21.15.77:0/4010231355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd87c0ce240 0x7fd87c157000 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.229+0000 7fd8818e0640 1 --2- 172.21.15.77:0/4010231355 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd87c157540 0x7fd87c0d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.229+0000 7fd8818e0640 1 -- 172.21.15.77:0/4010231355 >> 172.21.15.77:0/4010231355 conn(0x7fd87c071f30 msgr2=0x7fd87c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:01.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.229+0000 7fd8818e0640 1 -- 172.21.15.77:0/4010231355 shutdown_connections 2023-11-04T01:45:01.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.229+0000 7fd8818e0640 1 -- 172.21.15.77:0/4010231355 wait complete. 2023-11-04T01:45:01.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.230+0000 7fd8818e0640 1 Processor -- start 2023-11-04T01:45:01.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.230+0000 7fd8818e0640 1 -- start start 2023-11-04T01:45:01.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.231+0000 7fd8818e0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd87c0cde60 0x7fd87c15bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:01.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.231+0000 7fd8818e0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd87c0ce240 0x7fd87c1f1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:01.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.231+0000 7fd8818e0640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd87c157540 0x7fd87c1f1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:01.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.231+0000 7fd8818e0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c1f22e0 con 0x7fd87c0cde60 2023-11-04T01:45:01.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.231+0000 7fd8818e0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c149790 con 0x7fd87c0ce240 2023-11-04T01:45:01.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.231+0000 7fd8818e0640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c149a70 con 0x7fd87c157540 2023-11-04T01:45:01.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.231+0000 7fd87affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd87c0cde60 0x7fd87c15bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:01.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.231+0000 7fd87affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd87c0cde60 0x7fd87c15bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53002/0 (socket says 172.21.15.77:53002) 2023-11-04T01:45:01.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.231+0000 7fd87affd640 1 -- 172.21.15.77:0/2252663937 learned_addr learned my addr 172.21.15.77:0/2252663937 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:01.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.231+0000 7fd87affd640 1 -- 172.21.15.77:0/2252663937 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd87c157540 msgr2=0x7fd87c1f1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:01.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.231+0000 7fd87affd640 1 --2- 172.21.15.77:0/2252663937 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd87c157540 0x7fd87c1f1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.231+0000 7fd87affd640 1 -- 172.21.15.77:0/2252663937 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd87c0ce240 msgr2=0x7fd87c1f1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:01.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.231+0000 7fd87affd640 1 --2- 172.21.15.77:0/2252663937 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd87c0ce240 0x7fd87c1f1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.231+0000 7fd87affd640 1 -- 172.21.15.77:0/2252663937 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd870009400 con 0x7fd87c0cde60 2023-11-04T01:45:01.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.231+0000 7fd87affd640 1 --2- 172.21.15.77:0/2252663937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd87c0cde60 0x7fd87c15bfa0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fd86c00c4d0 tx=0x7fd86c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:01.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.231+0000 7fd863fff640 1 -- 172.21.15.77:0/2252663937 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86c0074e0 con 0x7fd87c0cde60 2023-11-04T01:45:01.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.231+0000 7fd863fff640 1 -- 172.21.15.77:0/2252663937 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd86c007640 con 0x7fd87c0cde60 2023-11-04T01:45:01.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.231+0000 7fd8818e0640 1 -- 172.21.15.77:0/2252663937 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd87c149d50 con 0x7fd87c0cde60 2023-11-04T01:45:01.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.231+0000 7fd863fff640 1 -- 172.21.15.77:0/2252663937 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86c004a20 con 0x7fd87c0cde60 2023-11-04T01:45:01.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.231+0000 7fd8818e0640 1 -- 172.21.15.77:0/2252663937 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd87c14a310 con 0x7fd87c0cde60 2023-11-04T01:45:01.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.232+0000 7fd8818e0640 1 -- 172.21.15.77:0/2252663937 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd87c074290 con 0x7fd87c0cde60 2023-11-04T01:45:01.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.233+0000 7fd863fff640 1 -- 172.21.15.77:0/2252663937 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd86c004b80 con 0x7fd87c0cde60 2023-11-04T01:45:01.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.233+0000 7fd863fff640 1 --2- 172.21.15.77:0/2252663937 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd86806aea0 0x7fd86806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:01.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.233+0000 7fd863fff640 1 -- 172.21.15.77:0/2252663937 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7fd86c088e30 con 0x7fd87c0cde60 2023-11-04T01:45:01.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.234+0000 7fd87a7fc640 1 --2- 172.21.15.77:0/2252663937 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd86806aea0 0x7fd86806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:01.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.234+0000 7fd87a7fc640 1 --2- 172.21.15.77:0/2252663937 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd86806aea0 0x7fd86806d360 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fd870036000 tx=0x7fd870030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:01.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.238+0000 7fd863fff640 1 -- 172.21.15.77:0/2252663937 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd86c053870 con 0x7fd87c0cde60 2023-11-04T01:45:01.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.438+0000 7fd8818e0640 1 -- 172.21.15.77:0/2252663937 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd87c0c9670 con 0x7fd87c0cde60 2023-11-04T01:45:01.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.439+0000 7fd863fff640 1 -- 172.21.15.77:0/2252663937 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4986 (secure 0 0 0) 0x7fd86c018020 con 0x7fd87c0cde60 2023-11-04T01:45:01.441 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:01.441 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":66,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7743,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/285184758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":285184758},{"type":"v1","addr":"172.21.15.77:6834","nonce":285184758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:45:00.597717+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":35840,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_35840":{"gid":35840,"name":"b","rank":0,"incarnation":60,"state":"up:active","state_seq":11,"addr":"172.21.15.122:6836/2908314953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2908314953},{"type":"v1","addr":"172.21.15.122:6836","nonce":2908314953}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:45:00.597717+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:01.441 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 66 2023-11-04T01:45:01.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.441+0000 7fd8818e0640 1 -- 172.21.15.77:0/2252663937 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd86806aea0 msgr2=0x7fd86806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:01.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.441+0000 7fd8818e0640 1 --2- 172.21.15.77:0/2252663937 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd86806aea0 0x7fd86806d360 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fd870036000 tx=0x7fd870030000 comp rx=0 tx=0).stop 2023-11-04T01:45:01.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.441+0000 7fd8818e0640 1 -- 172.21.15.77:0/2252663937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd87c0cde60 msgr2=0x7fd87c15bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:01.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.441+0000 7fd8818e0640 1 --2- 172.21.15.77:0/2252663937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd87c0cde60 0x7fd87c15bfa0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fd86c00c4d0 tx=0x7fd86c00c990 comp rx=0 tx=0).stop 2023-11-04T01:45:01.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.441+0000 7fd8818e0640 1 -- 172.21.15.77:0/2252663937 shutdown_connections 2023-11-04T01:45:01.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.441+0000 7fd8818e0640 1 --2- 172.21.15.77:0/2252663937 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd86806aea0 0x7fd86806d360 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.441+0000 7fd8818e0640 1 --2- 172.21.15.77:0/2252663937 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd87c157540 0x7fd87c1f1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.441+0000 7fd8818e0640 1 --2- 172.21.15.77:0/2252663937 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd87c0ce240 0x7fd87c1f1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.441+0000 7fd8818e0640 1 --2- 172.21.15.77:0/2252663937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd87c0cde60 0x7fd87c15bfa0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.441+0000 7fd8818e0640 1 -- 172.21.15.77:0/2252663937 >> 172.21.15.77:0/2252663937 conn(0x7fd87c071f30 msgr2=0x7fd87c0b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:01.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.441+0000 7fd8818e0640 1 -- 172.21.15.77:0/2252663937 shutdown_connections 2023-11-04T01:45:01.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.441+0000 7fd8818e0640 1 -- 172.21.15.77:0/2252663937 wait complete. 2023-11-04T01:45:01.453 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-11-04T01:45:01.454 DEBUG:teuthology.orchestra.run.smithi122:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:45:01.484 INFO:teuthology.orchestra.run.smithi122.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:45:01.486 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:45:01.486 DEBUG:teuthology.orchestra.run.smithi122:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:45:01.559 INFO:teuthology.orchestra.run.smithi122.stdout:1699062285.96256.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i b', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:45:01.561 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062285.96256.core'] 2023-11-04T01:45:01.561 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062285.96256.core, deleting it 2023-11-04T01:45:01.562 DEBUG:teuthology.orchestra.run.smithi122:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062285.96256.core 2023-11-04T01:45:01.634 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:45:01.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.734+0000 7fd0664ec640 1 Processor -- start 2023-11-04T01:45:01.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.734+0000 7fd0664ec640 1 -- start start 2023-11-04T01:45:01.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.735+0000 7fd0664ec640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd06015ad30 0x7fd0600adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:01.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.735+0000 7fd0664ec640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0600ad730 0x7fd060070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:01.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.735+0000 7fd0664ec640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0600c3900 con 0x7fd060070c50 2023-11-04T01:45:01.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.735+0000 7fd0664ec640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0600ae260 con 0x7fd06015ad30 2023-11-04T01:45:01.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.735+0000 7fd0664ec640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06015f750 con 0x7fd0600ad730 2023-11-04T01:45:01.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.735+0000 7fd05f7fe640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0600ad730 0x7fd060070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:01.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.735+0000 7fd05ffff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd06015ad30 0x7fd0600adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:01.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.735+0000 7fd064a89640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fd060070c50 0x7fd0600c8fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:38404/0 (socket says 172.21.15.77:38404) 2023-11-04T01:45:01.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.735+0000 7fd05ffff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd06015ad30 0x7fd0600adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:58192/0 (socket says 172.21.15.77:58192) 2023-11-04T01:45:01.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.735+0000 7fd05f7fe640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0600ad730 0x7fd060070710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:49816/0 (socket says 172.21.15.77:49816) 2023-11-04T01:45:01.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.735+0000 7fd064a89640 1 -- 172.21.15.77:0/3441143620 learned_addr learned my addr 172.21.15.77:0/3441143620 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:45:01.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.735+0000 7fd05ffff640 1 -- 172.21.15.77:0/3441143620 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0600ad730 msgr2=0x7fd060070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:01.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.735+0000 7fd05ffff640 1 --2- 172.21.15.77:0/3441143620 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0600ad730 0x7fd060070710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.735+0000 7fd05ffff640 1 -- 172.21.15.77:0/3441143620 >> v1:172.21.15.122:6789/0 conn(0x7fd060070c50 legacy=0x7fd0600c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:01.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.735+0000 7fd05effd640 1 -- 172.21.15.77:0/3441143620 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1992475963 0 0) 0x7fd0600c3900 con 0x7fd060070c50 2023-11-04T01:45:01.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.735+0000 7fd05ffff640 1 -- 172.21.15.77:0/3441143620 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0600c3be0 con 0x7fd06015ad30 2023-11-04T01:45:01.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.735+0000 7fd05f7fe640 1 --2- 172.21.15.77:0/3441143620 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0600ad730 0x7fd060070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:45:01.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.736+0000 7fd05ffff640 1 --2- 172.21.15.77:0/3441143620 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd06015ad30 0x7fd0600adc80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd0500097d0 tx=0x7fd05002b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25a8a5942f7b42b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:01.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.736+0000 7fd05effd640 1 -- 172.21.15.77:0/3441143620 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd050031770 con 0x7fd06015ad30 2023-11-04T01:45:01.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.736+0000 7fd05effd640 1 -- 172.21.15.77:0/3441143620 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0500318d0 con 0x7fd06015ad30 2023-11-04T01:45:01.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.736+0000 7fd05effd640 1 -- 172.21.15.77:0/3441143620 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd050031c60 con 0x7fd06015ad30 2023-11-04T01:45:01.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.737+0000 7fd0664ec640 1 -- 172.21.15.77:0/3441143620 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd06015ad30 msgr2=0x7fd0600adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:01.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.737+0000 7fd0664ec640 1 --2- 172.21.15.77:0/3441143620 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd06015ad30 0x7fd0600adc80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd0500097d0 tx=0x7fd05002b810 comp rx=0 tx=0).stop 2023-11-04T01:45:01.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.737+0000 7fd0664ec640 1 -- 172.21.15.77:0/3441143620 shutdown_connections 2023-11-04T01:45:01.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.737+0000 7fd0664ec640 1 --2- 172.21.15.77:0/3441143620 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0600ad730 0x7fd060070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.737+0000 7fd0664ec640 1 --2- 172.21.15.77:0/3441143620 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd06015ad30 0x7fd0600adc80 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.737+0000 7fd0664ec640 1 -- 172.21.15.77:0/3441143620 >> 172.21.15.77:0/3441143620 conn(0x7fd0600ce950 msgr2=0x7fd0600ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:01.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.737+0000 7fd0664ec640 1 -- 172.21.15.77:0/3441143620 shutdown_connections 2023-11-04T01:45:01.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.737+0000 7fd0664ec640 1 -- 172.21.15.77:0/3441143620 wait complete. 2023-11-04T01:45:01.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.738+0000 7fd0664ec640 1 Processor -- start 2023-11-04T01:45:01.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.738+0000 7fd0664ec640 1 -- start start 2023-11-04T01:45:01.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.739+0000 7fd0664ec640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd060070c50 0x7fd06015c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:01.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.739+0000 7fd0664ec640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0600ad730 0x7fd06015d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:01.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.739+0000 7fd0664ec640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd06015ad30 0x7fd060155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:01.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.739+0000 7fd0664ec640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0600b3fc0 con 0x7fd060070c50 2023-11-04T01:45:01.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.739+0000 7fd0664ec640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0600b3a00 con 0x7fd06015ad30 2023-11-04T01:45:01.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.739+0000 7fd0664ec640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0600b3ce0 con 0x7fd0600ad730 2023-11-04T01:45:01.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.739+0000 7fd05ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd060070c50 0x7fd06015c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:01.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.739+0000 7fd05ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd060070c50 0x7fd06015c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53004/0 (socket says 172.21.15.77:53004) 2023-11-04T01:45:01.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.739+0000 7fd05ffff640 1 -- 172.21.15.77:0/3001805141 learned_addr learned my addr 172.21.15.77:0/3001805141 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:01.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.739+0000 7fd064a89640 1 --2- 172.21.15.77:0/3001805141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd06015ad30 0x7fd060155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:01.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.739+0000 7fd05f7fe640 1 --2- 172.21.15.77:0/3001805141 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0600ad730 0x7fd06015d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:01.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.739+0000 7fd05ffff640 1 -- 172.21.15.77:0/3001805141 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0600ad730 msgr2=0x7fd06015d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:01.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.739+0000 7fd05ffff640 1 --2- 172.21.15.77:0/3001805141 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0600ad730 0x7fd06015d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.739+0000 7fd05ffff640 1 -- 172.21.15.77:0/3001805141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd06015ad30 msgr2=0x7fd060155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:01.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.739+0000 7fd05ffff640 1 --2- 172.21.15.77:0/3001805141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd06015ad30 0x7fd060155900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.739+0000 7fd05ffff640 1 -- 172.21.15.77:0/3001805141 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd054009400 con 0x7fd060070c50 2023-11-04T01:45:01.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.739+0000 7fd05f7fe640 1 --2- 172.21.15.77:0/3001805141 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0600ad730 0x7fd06015d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:01.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.740+0000 7fd05ffff640 1 --2- 172.21.15.77:0/3001805141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd060070c50 0x7fd06015c4c0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fd0500097d0 tx=0x7fd0500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:01.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.740+0000 7fd05cff9640 1 -- 172.21.15.77:0/3001805141 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd050004030 con 0x7fd060070c50 2023-11-04T01:45:01.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.740+0000 7fd05cff9640 1 -- 172.21.15.77:0/3001805141 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0500041b0 con 0x7fd060070c50 2023-11-04T01:45:01.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.740+0000 7fd0664ec640 1 -- 172.21.15.77:0/3001805141 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd050009400 con 0x7fd060070c50 2023-11-04T01:45:01.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.740+0000 7fd05cff9640 1 -- 172.21.15.77:0/3001805141 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd050003610 con 0x7fd060070c50 2023-11-04T01:45:01.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.740+0000 7fd0664ec640 1 -- 172.21.15.77:0/3001805141 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd06015bfa0 con 0x7fd060070c50 2023-11-04T01:45:01.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.741+0000 7fd0664ec640 1 -- 172.21.15.77:0/3001805141 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd06015bb20 con 0x7fd060070c50 2023-11-04T01:45:01.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.741+0000 7fd05cff9640 1 -- 172.21.15.77:0/3001805141 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd050003770 con 0x7fd060070c50 2023-11-04T01:45:01.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.741+0000 7fd05cff9640 1 --2- 172.21.15.77:0/3001805141 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd04c06ae70 0x7fd04c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:01.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.742+0000 7fd05cff9640 1 -- 172.21.15.77:0/3001805141 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7350+0+0 (secure 0 0 0) 0x7fd0500abc30 con 0x7fd060070c50 2023-11-04T01:45:01.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.742+0000 7fd05f7fe640 1 --2- 172.21.15.77:0/3001805141 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd04c06ae70 0x7fd04c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:01.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.742+0000 7fd05f7fe640 1 --2- 172.21.15.77:0/3001805141 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd04c06ae70 0x7fd04c06d330 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd054009d20 tx=0x7fd054008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:01.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.746+0000 7fd05cff9640 1 -- 172.21.15.77:0/3001805141 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd06015bb20 con 0x7fd060070c50 2023-11-04T01:45:01.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.980+0000 7fd0664ec640 1 -- 172.21.15.77:0/3001805141 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7fd06015bb20 con 0x7fd060070c50 2023-11-04T01:45:01.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.982+0000 7fd05cff9640 1 -- 172.21.15.77:0/3001805141 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 35840 v67) v1 ==== 98+0+0 (secure 0 0 0) 0x7fd06015bb20 con 0x7fd060070c50 2023-11-04T01:45:01.984 INFO:teuthology.orchestra.run.smithi077.stderr:failed mds gid 35840 2023-11-04T01:45:01.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.985+0000 7fd0664ec640 1 -- 172.21.15.77:0/3001805141 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd04c06ae70 msgr2=0x7fd04c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:01.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.985+0000 7fd0664ec640 1 --2- 172.21.15.77:0/3001805141 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd04c06ae70 0x7fd04c06d330 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd054009d20 tx=0x7fd054008040 comp rx=0 tx=0).stop 2023-11-04T01:45:01.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.985+0000 7fd0664ec640 1 -- 172.21.15.77:0/3001805141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd060070c50 msgr2=0x7fd06015c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:01.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.985+0000 7fd0664ec640 1 --2- 172.21.15.77:0/3001805141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd060070c50 0x7fd06015c4c0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fd0500097d0 tx=0x7fd0500046c0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.985+0000 7fd0664ec640 1 -- 172.21.15.77:0/3001805141 shutdown_connections 2023-11-04T01:45:01.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.985+0000 7fd0664ec640 1 --2- 172.21.15.77:0/3001805141 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd04c06ae70 0x7fd04c06d330 secure :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd054009d20 tx=0x7fd054008040 comp rx=0 tx=0).stop 2023-11-04T01:45:01.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.985+0000 7fd0664ec640 1 --2- 172.21.15.77:0/3001805141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd06015ad30 0x7fd060155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.985+0000 7fd0664ec640 1 --2- 172.21.15.77:0/3001805141 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0600ad730 0x7fd06015d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.985+0000 7fd0664ec640 1 --2- 172.21.15.77:0/3001805141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd060070c50 0x7fd06015c4c0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.985+0000 7fd0664ec640 1 -- 172.21.15.77:0/3001805141 >> 172.21.15.77:0/3001805141 conn(0x7fd0600ce950 msgr2=0x7fd06006cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:01.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.986+0000 7fd0664ec640 1 -- 172.21.15.77:0/3001805141 shutdown_connections 2023-11-04T01:45:01.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:01.986+0000 7fd0664ec640 1 -- 172.21.15.77:0/3001805141 wait complete. 2023-11-04T01:45:02.002 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:45:02.002 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:45:02.002 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:45:02.003 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:45:02.003 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:45:02.004 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi122 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b' 2023-11-04T01:45:02.004 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:45:02.005 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:45:02.007 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:45:02.008 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:02.084 INFO:tasks.ceph.mds.b.smithi122.stdout:starting mds.b at 2023-11-04T01:45:02.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.106+0000 7f9a34fa9640 1 Processor -- start 2023-11-04T01:45:02.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.106+0000 7f9a34fa9640 1 -- start start 2023-11-04T01:45:02.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.107+0000 7f9a34fa9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9a300cde60 0x7f9a3015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:02.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.107+0000 7f9a34fa9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9a3015daa0 0x7f9a30157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:02.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.107+0000 7f9a34fa9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9a300ce240 0x7f9a30157540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:02.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.107+0000 7f9a34fa9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a3015e5c0 con 0x7f9a3015daa0 2023-11-04T01:45:02.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.107+0000 7f9a34fa9640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a30157a80 con 0x7f9a300ce240 2023-11-04T01:45:02.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.107+0000 7f9a34fa9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3015e000 con 0x7f9a300cde60 2023-11-04T01:45:02.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.107+0000 7f9a2dd9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9a3015daa0 0x7f9a30157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:02.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.107+0000 7f9a2dd9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9a3015daa0 0x7f9a30157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53018/0 (socket says 172.21.15.77:53018) 2023-11-04T01:45:02.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.107+0000 7f9a2dd9b640 1 -- 172.21.15.77:0/1731241637 learned_addr learned my addr 172.21.15.77:0/1731241637 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:02.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.108+0000 7f9a2ed9d640 1 --2- 172.21.15.77:0/1731241637 >> v2:172.21.15.122:3300/0 conn(0x7f9a300ce240 0x7f9a30157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:02.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.108+0000 7f9a2e59c640 1 --2- 172.21.15.77:0/1731241637 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9a300cde60 0x7f9a3015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:02.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.108+0000 7f9a2dd9b640 1 -- 172.21.15.77:0/1731241637 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9a300cde60 msgr2=0x7f9a3015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:02.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.108+0000 7f9a2dd9b640 1 --2- 172.21.15.77:0/1731241637 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9a300cde60 0x7f9a3015d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:02.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.108+0000 7f9a2dd9b640 1 -- 172.21.15.77:0/1731241637 >> v2:172.21.15.122:3300/0 conn(0x7f9a300ce240 msgr2=0x7f9a30157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:02.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.108+0000 7f9a2dd9b640 1 --2- 172.21.15.77:0/1731241637 >> v2:172.21.15.122:3300/0 conn(0x7f9a300ce240 0x7f9a30157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:02.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.108+0000 7f9a2dd9b640 1 -- 172.21.15.77:0/1731241637 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3015e2e0 con 0x7f9a3015daa0 2023-11-04T01:45:02.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.108+0000 7f9a2dd9b640 1 --2- 172.21.15.77:0/1731241637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a3015daa0 0x7f9a30157000 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f9a3015df30 tx=0x7f9a2402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2585d909d6c14308 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:02.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.108+0000 7f9a2d59a640 1 -- 172.21.15.77:0/1731241637 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a24031870 con 0x7f9a3015daa0 2023-11-04T01:45:02.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.109+0000 7f9a2d59a640 1 -- 172.21.15.77:0/1731241637 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a240319d0 con 0x7f9a3015daa0 2023-11-04T01:45:02.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.109+0000 7f9a2d59a640 1 -- 172.21.15.77:0/1731241637 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a24031d60 con 0x7f9a3015daa0 2023-11-04T01:45:02.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.109+0000 7f9a34fa9640 1 -- 172.21.15.77:0/1731241637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a3015daa0 msgr2=0x7f9a30157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:02.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.109+0000 7f9a34fa9640 1 --2- 172.21.15.77:0/1731241637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a3015daa0 0x7f9a30157000 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f9a3015df30 tx=0x7f9a2402b910 comp rx=0 tx=0).stop 2023-11-04T01:45:02.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.109+0000 7f9a34fa9640 1 -- 172.21.15.77:0/1731241637 shutdown_connections 2023-11-04T01:45:02.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.109+0000 7f9a34fa9640 1 --2- 172.21.15.77:0/1731241637 >> v2:172.21.15.122:3300/0 conn(0x7f9a300ce240 0x7f9a30157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:02.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.109+0000 7f9a34fa9640 1 --2- 172.21.15.77:0/1731241637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a3015daa0 0x7f9a30157000 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:02.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.109+0000 7f9a34fa9640 1 --2- 172.21.15.77:0/1731241637 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9a300cde60 0x7f9a3015d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:02.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.109+0000 7f9a34fa9640 1 -- 172.21.15.77:0/1731241637 >> 172.21.15.77:0/1731241637 conn(0x7f9a30071f30 msgr2=0x7f9a300cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:02.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.109+0000 7f9a34fa9640 1 -- 172.21.15.77:0/1731241637 shutdown_connections 2023-11-04T01:45:02.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.109+0000 7f9a34fa9640 1 -- 172.21.15.77:0/1731241637 wait complete. 2023-11-04T01:45:02.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.111+0000 7f9a34fa9640 1 Processor -- start 2023-11-04T01:45:02.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.111+0000 7f9a34fa9640 1 -- start start 2023-11-04T01:45:02.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.111+0000 7f9a34fa9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a300cde60 0x7f9a300cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:02.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.111+0000 7f9a34fa9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9a300ce240 0x7f9a300c9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:02.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.111+0000 7f9a34fa9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a3015daa0 0x7f9a301f9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:02.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.111+0000 7f9a34fa9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3014fea0 con 0x7f9a3015daa0 2023-11-04T01:45:02.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.111+0000 7f9a34fa9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a300cc830 con 0x7f9a300cde60 2023-11-04T01:45:02.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.111+0000 7f9a34fa9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a300cb850 con 0x7f9a300ce240 2023-11-04T01:45:02.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.111+0000 7f9a2ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a3015daa0 0x7f9a301f9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:02.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.111+0000 7f9a2ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a3015daa0 0x7f9a301f9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53030/0 (socket says 172.21.15.77:53030) 2023-11-04T01:45:02.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.111+0000 7f9a2ed9d640 1 -- 172.21.15.77:0/2516586731 learned_addr learned my addr 172.21.15.77:0/2516586731 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:02.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.111+0000 7f9a2e59c640 1 --2- 172.21.15.77:0/2516586731 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a300cde60 0x7f9a300cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:02.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.111+0000 7f9a2dd9b640 1 --2- 172.21.15.77:0/2516586731 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9a300ce240 0x7f9a300c9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:02.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.112+0000 7f9a2ed9d640 1 -- 172.21.15.77:0/2516586731 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9a300ce240 msgr2=0x7f9a300c9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:02.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.112+0000 7f9a2ed9d640 1 --2- 172.21.15.77:0/2516586731 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9a300ce240 0x7f9a300c9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:02.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.112+0000 7f9a2ed9d640 1 -- 172.21.15.77:0/2516586731 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a300cde60 msgr2=0x7f9a300cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:02.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.112+0000 7f9a2ed9d640 1 --2- 172.21.15.77:0/2516586731 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a300cde60 0x7f9a300cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:02.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.112+0000 7f9a2ed9d640 1 -- 172.21.15.77:0/2516586731 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a240094d0 con 0x7f9a3015daa0 2023-11-04T01:45:02.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.112+0000 7f9a2ed9d640 1 --2- 172.21.15.77:0/2516586731 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a3015daa0 0x7f9a301f9c10 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f9a2800d800 tx=0x7f9a2800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:02.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.112+0000 7f9a1effd640 1 -- 172.21.15.77:0/2516586731 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2800b6c0 con 0x7f9a3015daa0 2023-11-04T01:45:02.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.112+0000 7f9a1effd640 1 -- 172.21.15.77:0/2516586731 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2800b840 con 0x7f9a3015daa0 2023-11-04T01:45:02.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.112+0000 7f9a34fa9640 1 -- 172.21.15.77:0/2516586731 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a30151d80 con 0x7f9a3015daa0 2023-11-04T01:45:02.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.112+0000 7f9a1effd640 1 -- 172.21.15.77:0/2516586731 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2800bbf0 con 0x7f9a3015daa0 2023-11-04T01:45:02.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.112+0000 7f9a34fa9640 1 -- 172.21.15.77:0/2516586731 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a300cbaf0 con 0x7f9a3015daa0 2023-11-04T01:45:02.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.113+0000 7f9a34fa9640 1 -- 172.21.15.77:0/2516586731 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a301522a0 con 0x7f9a3015daa0 2023-11-04T01:45:02.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.113+0000 7f9a1effd640 1 -- 172.21.15.77:0/2516586731 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9a2800bd50 con 0x7f9a3015daa0 2023-11-04T01:45:02.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.114+0000 7f9a1effd640 1 --2- 172.21.15.77:0/2516586731 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9a1006ae70 0x7f9a1006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:02.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.114+0000 7f9a1effd640 1 -- 172.21.15.77:0/2516586731 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f9a2808a0d0 con 0x7f9a3015daa0 2023-11-04T01:45:02.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.114+0000 7f9a2e59c640 1 --2- 172.21.15.77:0/2516586731 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9a1006ae70 0x7f9a1006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:02.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.114+0000 7f9a2e59c640 1 --2- 172.21.15.77:0/2516586731 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9a1006ae70 0x7f9a1006d330 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9a20003aa0 tx=0x7f9a20009830 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:02.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.118+0000 7f9a1effd640 1 -- 172.21.15.77:0/2516586731 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9a301522a0 con 0x7f9a3015daa0 2023-11-04T01:45:02.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.320+0000 7f9a34fa9640 1 -- 172.21.15.77:0/2516586731 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a301522a0 con 0x7f9a3015daa0 2023-11-04T01:45:02.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.321+0000 7f9a1effd640 1 -- 172.21.15.77:0/2516586731 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4140 (secure 0 0 0) 0x7f9a301522a0 con 0x7f9a3015daa0 2023-11-04T01:45:02.323 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:02.323 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":68,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:45:01.987501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7743,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7743":{"gid":7743,"name":"a","rank":0,"incarnation":68,"state":"up:replay","state_seq":1,"addr":"172.21.15.77:6834/285184758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":285184758},{"type":"v1","addr":"172.21.15.77:6834","nonce":285184758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:02.324 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 68 2023-11-04T01:45:02.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.323+0000 7f9a34fa9640 1 -- 172.21.15.77:0/2516586731 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9a1006ae70 msgr2=0x7f9a1006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:02.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.323+0000 7f9a34fa9640 1 --2- 172.21.15.77:0/2516586731 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9a1006ae70 0x7f9a1006d330 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9a20003aa0 tx=0x7f9a20009830 comp rx=0 tx=0).stop 2023-11-04T01:45:02.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.323+0000 7f9a34fa9640 1 -- 172.21.15.77:0/2516586731 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a3015daa0 msgr2=0x7f9a301f9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:02.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.323+0000 7f9a34fa9640 1 --2- 172.21.15.77:0/2516586731 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a3015daa0 0x7f9a301f9c10 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f9a2800d800 tx=0x7f9a2800dcc0 comp rx=0 tx=0).stop 2023-11-04T01:45:02.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.323+0000 7f9a34fa9640 1 -- 172.21.15.77:0/2516586731 shutdown_connections 2023-11-04T01:45:02.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.323+0000 7f9a34fa9640 1 --2- 172.21.15.77:0/2516586731 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9a1006ae70 0x7f9a1006d330 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:02.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.323+0000 7f9a34fa9640 1 --2- 172.21.15.77:0/2516586731 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a3015daa0 0x7f9a301f9c10 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:02.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.323+0000 7f9a34fa9640 1 --2- 172.21.15.77:0/2516586731 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9a300ce240 0x7f9a300c9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:02.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.323+0000 7f9a34fa9640 1 --2- 172.21.15.77:0/2516586731 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a300cde60 0x7f9a300cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:02.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.323+0000 7f9a34fa9640 1 -- 172.21.15.77:0/2516586731 >> 172.21.15.77:0/2516586731 conn(0x7f9a30071f30 msgr2=0x7f9a30156480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:02.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.323+0000 7f9a34fa9640 1 -- 172.21.15.77:0/2516586731 shutdown_connections 2023-11-04T01:45:02.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:02.323+0000 7f9a34fa9640 1 -- 172.21.15.77:0/2516586731 wait complete. 2023-11-04T01:45:02.335 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:45:06.738 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-11-04T01:45:07.337 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:07.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.448+0000 7f0bd8651640 1 Processor -- start 2023-11-04T01:45:07.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.448+0000 7f0bd8651640 1 -- start start 2023-11-04T01:45:07.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.449+0000 7f0bd8651640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0bd00b0ae0 0x7f0bd00ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:07.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.449+0000 7f0bd8651640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f0bd006db20 0x7f0bd015d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:07.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.449+0000 7f0bd8651640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bd00b4110 con 0x7f0bd0159c70 2023-11-04T01:45:07.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.449+0000 7f0bd8651640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bd00b49b0 con 0x7f0bd00b0ae0 2023-11-04T01:45:07.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.449+0000 7f0bd8651640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bd00b43f0 con 0x7f0bd006db20 2023-11-04T01:45:07.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.449+0000 7f0bd63ed640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f0bd0159c70 0x7f0bd00b03d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:48496/0 (socket says 172.21.15.77:48496) 2023-11-04T01:45:07.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.449+0000 7f0bd63ed640 1 -- 172.21.15.77:0/2587838922 learned_addr learned my addr 172.21.15.77:0/2587838922 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:45:07.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.449+0000 7f0bd5bec640 1 --2- 172.21.15.77:0/2587838922 >> v2:172.21.15.77:3300/0 conn(0x7f0bd00b0ae0 0x7f0bd00ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:07.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.449+0000 7f0bd53eb640 1 -- 172.21.15.77:0/2587838922 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2213049718 0 0) 0x7f0bd00b4110 con 0x7f0bd0159c70 2023-11-04T01:45:07.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.449+0000 7f0bd53eb640 1 -- 172.21.15.77:0/2587838922 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bbc003520 con 0x7f0bd0159c70 2023-11-04T01:45:07.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.449+0000 7f0bd6bee640 1 --2- 172.21.15.77:0/2587838922 >> v2:172.21.15.122:3300/0 conn(0x7f0bd006db20 0x7f0bd015d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:07.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.449+0000 7f0bd5bec640 1 -- 172.21.15.77:0/2587838922 >> v2:172.21.15.122:3300/0 conn(0x7f0bd006db20 msgr2=0x7f0bd015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:07.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.449+0000 7f0bd5bec640 1 --2- 172.21.15.77:0/2587838922 >> v2:172.21.15.122:3300/0 conn(0x7f0bd006db20 0x7f0bd015d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.449+0000 7f0bd5bec640 1 -- 172.21.15.77:0/2587838922 >> v1:172.21.15.77:6789/0 conn(0x7f0bd0159c70 legacy=0x7f0bd00b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:07.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.449+0000 7f0bd5bec640 1 -- 172.21.15.77:0/2587838922 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd00b46d0 con 0x7f0bd00b0ae0 2023-11-04T01:45:07.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.450+0000 7f0bd5bec640 1 --2- 172.21.15.77:0/2587838922 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bd00b0ae0 0x7f0bd00ce370 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0070580 tx=0x7f0bc002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd8cad8b677bf028 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:07.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.450+0000 7f0bd53eb640 1 -- 172.21.15.77:0/2587838922 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc0031830 con 0x7f0bd00b0ae0 2023-11-04T01:45:07.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.450+0000 7f0bd53eb640 1 -- 172.21.15.77:0/2587838922 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc0031990 con 0x7f0bd00b0ae0 2023-11-04T01:45:07.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.450+0000 7f0bd53eb640 1 -- 172.21.15.77:0/2587838922 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc0031d00 con 0x7f0bd00b0ae0 2023-11-04T01:45:07.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.451+0000 7f0bd8651640 1 -- 172.21.15.77:0/2587838922 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bd00b0ae0 msgr2=0x7f0bd00ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:07.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.451+0000 7f0bd8651640 1 --2- 172.21.15.77:0/2587838922 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bd00b0ae0 0x7f0bd00ce370 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0070580 tx=0x7f0bc002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.451+0000 7f0bd8651640 1 -- 172.21.15.77:0/2587838922 shutdown_connections 2023-11-04T01:45:07.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.451+0000 7f0bd8651640 1 --2- 172.21.15.77:0/2587838922 >> v2:172.21.15.122:3300/0 conn(0x7f0bd006db20 0x7f0bd015d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.451+0000 7f0bd8651640 1 --2- 172.21.15.77:0/2587838922 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bd00b0ae0 0x7f0bd00ce370 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.451+0000 7f0bd8651640 1 -- 172.21.15.77:0/2587838922 >> 172.21.15.77:0/2587838922 conn(0x7f0bd00ce950 msgr2=0x7f0bd00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:07.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.451+0000 7f0bd8651640 1 -- 172.21.15.77:0/2587838922 shutdown_connections 2023-11-04T01:45:07.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.451+0000 7f0bd8651640 1 -- 172.21.15.77:0/2587838922 wait complete. 2023-11-04T01:45:07.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.452+0000 7f0bd8651640 1 Processor -- start 2023-11-04T01:45:07.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.452+0000 7f0bd8651640 1 -- start start 2023-11-04T01:45:07.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.453+0000 7f0bd8651640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0bd006db20 0x7f0bd00c7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:07.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.453+0000 7f0bd8651640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0bd00b0ae0 0x7f0bd0152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:07.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.453+0000 7f0bd8651640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bd0159c70 0x7f0bd015c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:07.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.453+0000 7f0bd8651640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd0153240 con 0x7f0bd0159c70 2023-11-04T01:45:07.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.453+0000 7f0bd8651640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd00c66a0 con 0x7f0bd00b0ae0 2023-11-04T01:45:07.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.453+0000 7f0bd8651640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd00c6980 con 0x7f0bd006db20 2023-11-04T01:45:07.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.453+0000 7f0bd6bee640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bd0159c70 0x7f0bd015c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:07.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.453+0000 7f0bd6bee640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bd0159c70 0x7f0bd015c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40790/0 (socket says 172.21.15.77:40790) 2023-11-04T01:45:07.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.453+0000 7f0bd6bee640 1 -- 172.21.15.77:0/766592201 learned_addr learned my addr 172.21.15.77:0/766592201 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:07.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.453+0000 7f0bd5bec640 1 --2- 172.21.15.77:0/766592201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0bd00b0ae0 0x7f0bd0152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:07.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.453+0000 7f0bd63ed640 1 --2- 172.21.15.77:0/766592201 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0bd006db20 0x7f0bd00c7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:07.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.453+0000 7f0bd6bee640 1 -- 172.21.15.77:0/766592201 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0bd006db20 msgr2=0x7f0bd00c7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:07.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.453+0000 7f0bd6bee640 1 --2- 172.21.15.77:0/766592201 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0bd006db20 0x7f0bd00c7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.453+0000 7f0bd6bee640 1 -- 172.21.15.77:0/766592201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0bd00b0ae0 msgr2=0x7f0bd0152d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:07.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.453+0000 7f0bd6bee640 1 --2- 172.21.15.77:0/766592201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0bd00b0ae0 0x7f0bd0152d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.453+0000 7f0bd6bee640 1 -- 172.21.15.77:0/766592201 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc0009400 con 0x7f0bd0159c70 2023-11-04T01:45:07.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.453+0000 7f0bd5bec640 1 --2- 172.21.15.77:0/766592201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0bd00b0ae0 0x7f0bd0152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:07.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.453+0000 7f0bd6bee640 1 --2- 172.21.15.77:0/766592201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bd0159c70 0x7f0bd015c620 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f0bc800cc30 tx=0x7f0bc800a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:07.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.454+0000 7f0bc6ffd640 1 -- 172.21.15.77:0/766592201 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc800ce40 con 0x7f0bd0159c70 2023-11-04T01:45:07.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.454+0000 7f0bc6ffd640 1 -- 172.21.15.77:0/766592201 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc8003990 con 0x7f0bd0159c70 2023-11-04T01:45:07.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.454+0000 7f0bd8651640 1 -- 172.21.15.77:0/766592201 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bd00c6c60 con 0x7f0bd0159c70 2023-11-04T01:45:07.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.454+0000 7f0bc6ffd640 1 -- 172.21.15.77:0/766592201 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8003d20 con 0x7f0bd0159c70 2023-11-04T01:45:07.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.454+0000 7f0bd8651640 1 -- 172.21.15.77:0/766592201 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bd00c7220 con 0x7f0bd0159c70 2023-11-04T01:45:07.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.455+0000 7f0bd8651640 1 -- 172.21.15.77:0/766592201 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bd00c7410 con 0x7f0bd0159c70 2023-11-04T01:45:07.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.455+0000 7f0bc6ffd640 1 -- 172.21.15.77:0/766592201 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0bc8003e80 con 0x7f0bd0159c70 2023-11-04T01:45:07.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.455+0000 7f0bc6ffd640 1 --2- 172.21.15.77:0/766592201 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0bb406aea0 0x7f0bb406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:07.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.456+0000 7f0bc6ffd640 1 -- 172.21.15.77:0/766592201 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f0bc8089fc0 con 0x7f0bd0159c70 2023-11-04T01:45:07.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.456+0000 7f0bd63ed640 1 --2- 172.21.15.77:0/766592201 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0bb406aea0 0x7f0bb406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:07.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.456+0000 7f0bd63ed640 1 --2- 172.21.15.77:0/766592201 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0bb406aea0 0x7f0bb406d360 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc007fd0 tx=0x7f0bcc009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:07.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.460+0000 7f0bc6ffd640 1 -- 172.21.15.77:0/766592201 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0bc80bcca0 con 0x7f0bd0159c70 2023-11-04T01:45:07.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.660+0000 7f0bd8651640 1 -- 172.21.15.77:0/766592201 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0bd0074290 con 0x7f0bd0159c70 2023-11-04T01:45:07.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.660+0000 7f0bc6ffd640 1 -- 172.21.15.77:0/766592201 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f0bc801d070 con 0x7f0bd0159c70 2023-11-04T01:45:07.662 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:07.663 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":72,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/1345816612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1345816612},{"type":"v1","addr":"172.21.15.122:6836","nonce":1345816612}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:45:04.999768+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7743,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7743":{"gid":7743,"name":"a","rank":0,"incarnation":68,"state":"up:active","state_seq":11,"addr":"172.21.15.77:6834/285184758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":285184758},{"type":"v1","addr":"172.21.15.77:6834","nonce":285184758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:07.664 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 72 2023-11-04T01:45:07.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.662+0000 7f0bd8651640 1 -- 172.21.15.77:0/766592201 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0bb406aea0 msgr2=0x7f0bb406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:07.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.662+0000 7f0bd8651640 1 --2- 172.21.15.77:0/766592201 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0bb406aea0 0x7f0bb406d360 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc007fd0 tx=0x7f0bcc009040 comp rx=0 tx=0).stop 2023-11-04T01:45:07.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.662+0000 7f0bd8651640 1 -- 172.21.15.77:0/766592201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bd0159c70 msgr2=0x7f0bd015c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:07.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.662+0000 7f0bd8651640 1 --2- 172.21.15.77:0/766592201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bd0159c70 0x7f0bd015c620 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f0bc800cc30 tx=0x7f0bc800a5c0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.662+0000 7f0bd8651640 1 -- 172.21.15.77:0/766592201 shutdown_connections 2023-11-04T01:45:07.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.662+0000 7f0bd8651640 1 --2- 172.21.15.77:0/766592201 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0bb406aea0 0x7f0bb406d360 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.662+0000 7f0bd8651640 1 --2- 172.21.15.77:0/766592201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bd0159c70 0x7f0bd015c620 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.662+0000 7f0bd8651640 1 --2- 172.21.15.77:0/766592201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0bd00b0ae0 0x7f0bd0152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.662+0000 7f0bd8651640 1 --2- 172.21.15.77:0/766592201 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0bd006db20 0x7f0bd00c7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.662+0000 7f0bd8651640 1 -- 172.21.15.77:0/766592201 >> 172.21.15.77:0/766592201 conn(0x7f0bd00ce950 msgr2=0x7f0bd00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:07.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.662+0000 7f0bd8651640 1 -- 172.21.15.77:0/766592201 shutdown_connections 2023-11-04T01:45:07.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.662+0000 7f0bd8651640 1 -- 172.21.15.77:0/766592201 wait complete. 2023-11-04T01:45:07.674 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:45:07.674 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:07.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.772+0000 7f336f939640 1 Processor -- start 2023-11-04T01:45:07.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.772+0000 7f336f939640 1 -- start start 2023-11-04T01:45:07.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.773+0000 7f336f939640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f336815ce60 0x7f336806b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:07.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.773+0000 7f336f939640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f33680cf160 0x7f33680cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:07.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.773+0000 7f336f939640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33681615d0 con 0x7f336806bd30 2023-11-04T01:45:07.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.773+0000 7f336f939640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33680cbde0 con 0x7f33680cf160 2023-11-04T01:45:07.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.773+0000 7f336f939640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33680cfb50 con 0x7f336815ce60 2023-11-04T01:45:07.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.773+0000 7f336ded6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f33680cf160 0x7f33680cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:07.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.773+0000 7f336ced4640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f336806bd30 0x7f3368160b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:48506/0 (socket says 172.21.15.77:48506) 2023-11-04T01:45:07.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.773+0000 7f336ced4640 1 -- 172.21.15.77:0/3444473587 learned_addr learned my addr 172.21.15.77:0/3444473587 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:45:07.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.774+0000 7f336ded6640 1 -- 172.21.15.77:0/3444473587 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f336815ce60 msgr2=0x7f336806b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:07.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.774+0000 7f336ded6640 1 --2- 172.21.15.77:0/3444473587 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f336815ce60 0x7f336806b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.774+0000 7f336ded6640 1 -- 172.21.15.77:0/3444473587 >> v1:172.21.15.77:6789/0 conn(0x7f336806bd30 legacy=0x7f3368160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:07.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.774+0000 7f336ded6640 1 -- 172.21.15.77:0/3444473587 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33681618b0 con 0x7f33680cf160 2023-11-04T01:45:07.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.774+0000 7f335ffff640 1 -- 172.21.15.77:0/3444473587 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 690783589 0 0) 0x7f33681615d0 con 0x7f336806bd30 2023-11-04T01:45:07.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.774+0000 7f336ded6640 1 --2- 172.21.15.77:0/3444473587 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33680cf160 0x7f33680cf610 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f33600097a0 tx=0x7f336002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=248d26cd4ba8c70c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:07.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.774+0000 7f335ffff640 1 -- 172.21.15.77:0/3444473587 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3360031830 con 0x7f33680cf160 2023-11-04T01:45:07.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.775+0000 7f335ffff640 1 -- 172.21.15.77:0/3444473587 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3360031990 con 0x7f33680cf160 2023-11-04T01:45:07.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.775+0000 7f335ffff640 1 -- 172.21.15.77:0/3444473587 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3360031d20 con 0x7f33680cf160 2023-11-04T01:45:07.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.775+0000 7f336f939640 1 -- 172.21.15.77:0/3444473587 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33680cf160 msgr2=0x7f33680cf610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:07.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.775+0000 7f336f939640 1 --2- 172.21.15.77:0/3444473587 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33680cf160 0x7f33680cf610 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f33600097a0 tx=0x7f336002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.775+0000 7f336f939640 1 -- 172.21.15.77:0/3444473587 shutdown_connections 2023-11-04T01:45:07.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.775+0000 7f336f939640 1 --2- 172.21.15.77:0/3444473587 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33680cf160 0x7f33680cf610 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.775+0000 7f336f939640 1 --2- 172.21.15.77:0/3444473587 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f336815ce60 0x7f336806b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.775+0000 7f336f939640 1 -- 172.21.15.77:0/3444473587 >> 172.21.15.77:0/3444473587 conn(0x7f336806ea90 msgr2=0x7f336806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:07.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.775+0000 7f336f939640 1 -- 172.21.15.77:0/3444473587 shutdown_connections 2023-11-04T01:45:07.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.775+0000 7f336f939640 1 -- 172.21.15.77:0/3444473587 wait complete. 2023-11-04T01:45:07.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.776+0000 7f336f939640 1 Processor -- start 2023-11-04T01:45:07.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.776+0000 7f336f939640 1 -- start start 2023-11-04T01:45:07.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.777+0000 7f336f939640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33680cf160 0x7f3368150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:07.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.777+0000 7f336f939640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f336815ce60 0x7f33680c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:07.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.777+0000 7f336f939640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33680c98d0 0x7f336806c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:07.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.777+0000 7f336f939640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33680c94b0 con 0x7f33680cf160 2023-11-04T01:45:07.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.777+0000 7f336f939640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3368151510 con 0x7f33680c98d0 2023-11-04T01:45:07.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.777+0000 7f336f939640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33680c8830 con 0x7f336815ce60 2023-11-04T01:45:07.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.777+0000 7f336d6d5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33680cf160 0x7f3368150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:07.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.777+0000 7f336d6d5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33680cf160 0x7f3368150fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40806/0 (socket says 172.21.15.77:40806) 2023-11-04T01:45:07.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.777+0000 7f336d6d5640 1 -- 172.21.15.77:0/2117861624 learned_addr learned my addr 172.21.15.77:0/2117861624 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:07.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.777+0000 7f336ded6640 1 --2- 172.21.15.77:0/2117861624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33680c98d0 0x7f336806c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:07.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.777+0000 7f336d6d5640 1 -- 172.21.15.77:0/2117861624 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f336815ce60 msgr2=0x7f33680c7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:07.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.777+0000 7f336ced4640 1 --2- 172.21.15.77:0/2117861624 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f336815ce60 0x7f33680c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:07.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.777+0000 7f336d6d5640 1 --2- 172.21.15.77:0/2117861624 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f336815ce60 0x7f33680c7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.777+0000 7f336d6d5640 1 -- 172.21.15.77:0/2117861624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33680c98d0 msgr2=0x7f336806c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:07.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.777+0000 7f336d6d5640 1 --2- 172.21.15.77:0/2117861624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33680c98d0 0x7f336806c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.777+0000 7f336d6d5640 1 -- 172.21.15.77:0/2117861624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3360009400 con 0x7f33680cf160 2023-11-04T01:45:07.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.777+0000 7f336ded6640 1 --2- 172.21.15.77:0/2117861624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33680c98d0 0x7f336806c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:07.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.777+0000 7f336ced4640 1 --2- 172.21.15.77:0/2117861624 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f336815ce60 0x7f33680c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:07.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.778+0000 7f336d6d5640 1 --2- 172.21.15.77:0/2117861624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33680cf160 0x7f3368150fd0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f336400ba50 tx=0x7f336400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:07.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.778+0000 7f335dffb640 1 -- 172.21.15.77:0/2117861624 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336400cbe0 con 0x7f33680cf160 2023-11-04T01:45:07.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.778+0000 7f335dffb640 1 -- 172.21.15.77:0/2117861624 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336400cd60 con 0x7f33680cf160 2023-11-04T01:45:07.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.778+0000 7f335dffb640 1 -- 172.21.15.77:0/2117861624 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3364014680 con 0x7f33680cf160 2023-11-04T01:45:07.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.778+0000 7f336f939640 1 -- 172.21.15.77:0/2117861624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33680c8b10 con 0x7f33680cf160 2023-11-04T01:45:07.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.778+0000 7f336f939640 1 -- 172.21.15.77:0/2117861624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33680c90d0 con 0x7f33680cf160 2023-11-04T01:45:07.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.779+0000 7f336f939640 1 -- 172.21.15.77:0/2117861624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3368074290 con 0x7f33680cf160 2023-11-04T01:45:07.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.779+0000 7f335dffb640 1 -- 172.21.15.77:0/2117861624 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f336401d3b0 con 0x7f33680cf160 2023-11-04T01:45:07.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.779+0000 7f335dffb640 1 --2- 172.21.15.77:0/2117861624 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f334c06ae70 0x7f334c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:07.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.780+0000 7f335dffb640 1 -- 172.21.15.77:0/2117861624 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f3364089c60 con 0x7f33680cf160 2023-11-04T01:45:07.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.780+0000 7f336ced4640 1 --2- 172.21.15.77:0/2117861624 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f334c06ae70 0x7f334c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:07.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.780+0000 7f336ced4640 1 --2- 172.21.15.77:0/2117861624 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f334c06ae70 0x7f334c06d330 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f336815b9d0 tx=0x7f3358009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:07.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.784+0000 7f335dffb640 1 -- 172.21.15.77:0/2117861624 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3364054650 con 0x7f33680cf160 2023-11-04T01:45:07.826 INFO:tasks.ceph.mds.a.smithi077.stderr:2023-11-04T01:45:07.825+0000 7fb4704b8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:45:07.827 INFO:tasks.ceph.mds.a.smithi077.stderr:2023-11-04T01:45:07.825+0000 7fb4704b8640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:45:07.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.986+0000 7f336f939640 1 -- 172.21.15.77:0/2117861624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33680b6160 con 0x7f33680cf160 2023-11-04T01:45:07.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.987+0000 7f335dffb640 1 -- 172.21.15.77:0/2117861624 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f3364019090 con 0x7f33680cf160 2023-11-04T01:45:07.989 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:07.989 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":72,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/1345816612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1345816612},{"type":"v1","addr":"172.21.15.122:6836","nonce":1345816612}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:45:04.999768+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7743,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7743":{"gid":7743,"name":"a","rank":0,"incarnation":68,"state":"up:active","state_seq":11,"addr":"172.21.15.77:6834/285184758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":285184758},{"type":"v1","addr":"172.21.15.77:6834","nonce":285184758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:07.989 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 72 2023-11-04T01:45:07.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.988+0000 7f336f939640 1 -- 172.21.15.77:0/2117861624 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f334c06ae70 msgr2=0x7f334c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:07.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.988+0000 7f336f939640 1 --2- 172.21.15.77:0/2117861624 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f334c06ae70 0x7f334c06d330 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f336815b9d0 tx=0x7f3358009040 comp rx=0 tx=0).stop 2023-11-04T01:45:07.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.988+0000 7f336f939640 1 -- 172.21.15.77:0/2117861624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33680cf160 msgr2=0x7f3368150fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:07.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.988+0000 7f336f939640 1 --2- 172.21.15.77:0/2117861624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33680cf160 0x7f3368150fd0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f336400ba50 tx=0x7f336400bf10 comp rx=0 tx=0).stop 2023-11-04T01:45:07.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.989+0000 7f336f939640 1 -- 172.21.15.77:0/2117861624 shutdown_connections 2023-11-04T01:45:07.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.989+0000 7f336f939640 1 --2- 172.21.15.77:0/2117861624 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f334c06ae70 0x7f334c06d330 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.989+0000 7f336f939640 1 --2- 172.21.15.77:0/2117861624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33680c98d0 0x7f336806c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.989+0000 7f336f939640 1 --2- 172.21.15.77:0/2117861624 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f336815ce60 0x7f33680c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.989+0000 7f336f939640 1 --2- 172.21.15.77:0/2117861624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33680cf160 0x7f3368150fd0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.989+0000 7f336f939640 1 -- 172.21.15.77:0/2117861624 >> 172.21.15.77:0/2117861624 conn(0x7f336806ea90 msgr2=0x7f33680c6500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:07.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.989+0000 7f336f939640 1 -- 172.21.15.77:0/2117861624 shutdown_connections 2023-11-04T01:45:07.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:07.989+0000 7f336f939640 1 -- 172.21.15.77:0/2117861624 wait complete. 2023-11-04T01:45:08.403 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 72, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-04T01:43:26.273417+0000', 'modified': '2023-11-04T01:45:04.999768+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 101, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7743, 'mds_1': 7305}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7305': {'gid': 7305, 'name': 'c', 'rank': 1, 'incarnation': 46, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.77:6835/3207490604', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6833', 'nonce': 3207490604}, {'type': 'v1', 'addr': '172.21.15.77:6835', 'nonce': 3207490604}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_7743': {'gid': 7743, 'name': 'a', 'rank': 0, 'incarnation': 68, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.77:6834/285184758', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6832', 'nonce': 285184758}, {'type': 'v1', 'addr': '172.21.15.77:6834', 'nonce': 285184758}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:45:08.403 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-11-04T01:45:08.404 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-04T01:45:08.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.504+0000 7f943eb41640 1 Processor -- start 2023-11-04T01:45:08.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.504+0000 7f943eb41640 1 -- start start 2023-11-04T01:45:08.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.505+0000 7f943eb41640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9438159c00 0x7f94380cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.505+0000 7f943eb41640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f94380c48e0 0x7f94380c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.505+0000 7f943eb41640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f94380adac0 0x7f94380adea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.505+0000 7f943eb41640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94380c52d0 con 0x7f9438159c00 2023-11-04T01:45:08.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.505+0000 7f943eb41640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f943815aff0 con 0x7f94380c48e0 2023-11-04T01:45:08.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.505+0000 7f943eb41640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943815a3e0 con 0x7f94380adac0 2023-11-04T01:45:08.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.505+0000 7f943c8dd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9438159c00 0x7f94380cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.505+0000 7f943c8dd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9438159c00 0x7f94380cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40820/0 (socket says 172.21.15.77:40820) 2023-11-04T01:45:08.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.505+0000 7f943c8dd640 1 -- 172.21.15.77:0/1443760562 learned_addr learned my addr 172.21.15.77:0/1443760562 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:08.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.505+0000 7f9437fff640 1 --2- 172.21.15.77:0/1443760562 >> v2:172.21.15.122:3300/0 conn(0x7f94380c48e0 0x7f94380c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.505+0000 7f943d0de640 1 --2- 172.21.15.77:0/1443760562 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f94380adac0 0x7f94380adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.505+0000 7f943c8dd640 1 -- 172.21.15.77:0/1443760562 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f94380adac0 msgr2=0x7f94380adea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:08.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.505+0000 7f943c8dd640 1 --2- 172.21.15.77:0/1443760562 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f94380adac0 0x7f94380adea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.505+0000 7f943c8dd640 1 -- 172.21.15.77:0/1443760562 >> v2:172.21.15.122:3300/0 conn(0x7f94380c48e0 msgr2=0x7f94380c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:08.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.505+0000 7f943c8dd640 1 --2- 172.21.15.77:0/1443760562 >> v2:172.21.15.122:3300/0 conn(0x7f94380c48e0 0x7f94380c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.505+0000 7f943c8dd640 1 -- 172.21.15.77:0/1443760562 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943815a6c0 con 0x7f9438159c00 2023-11-04T01:45:08.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.506+0000 7f943c8dd640 1 --2- 172.21.15.77:0/1443760562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9438159c00 0x7f94380cc890 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f943806ebb0 tx=0x7f942c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca3bd3ad92a05895 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:08.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.506+0000 7f94377fe640 1 -- 172.21.15.77:0/1443760562 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c031870 con 0x7f9438159c00 2023-11-04T01:45:08.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.506+0000 7f94377fe640 1 -- 172.21.15.77:0/1443760562 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942c0319d0 con 0x7f9438159c00 2023-11-04T01:45:08.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.506+0000 7f94377fe640 1 -- 172.21.15.77:0/1443760562 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c031d60 con 0x7f9438159c00 2023-11-04T01:45:08.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.506+0000 7f943eb41640 1 -- 172.21.15.77:0/1443760562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9438159c00 msgr2=0x7f94380cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:08.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.506+0000 7f943eb41640 1 --2- 172.21.15.77:0/1443760562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9438159c00 0x7f94380cc890 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f943806ebb0 tx=0x7f942c02b910 comp rx=0 tx=0).stop 2023-11-04T01:45:08.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.506+0000 7f943eb41640 1 -- 172.21.15.77:0/1443760562 shutdown_connections 2023-11-04T01:45:08.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.506+0000 7f943eb41640 1 --2- 172.21.15.77:0/1443760562 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f94380adac0 0x7f94380adea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.506+0000 7f943eb41640 1 --2- 172.21.15.77:0/1443760562 >> v2:172.21.15.122:3300/0 conn(0x7f94380c48e0 0x7f94380c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.506+0000 7f943eb41640 1 --2- 172.21.15.77:0/1443760562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9438159c00 0x7f94380cc890 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.506+0000 7f943eb41640 1 -- 172.21.15.77:0/1443760562 >> 172.21.15.77:0/1443760562 conn(0x7f94380ce950 msgr2=0x7f94380ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:08.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.506+0000 7f943eb41640 1 -- 172.21.15.77:0/1443760562 shutdown_connections 2023-11-04T01:45:08.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.506+0000 7f943eb41640 1 -- 172.21.15.77:0/1443760562 wait complete. 2023-11-04T01:45:08.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.508+0000 7f943eb41640 1 Processor -- start 2023-11-04T01:45:08.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.508+0000 7f943eb41640 1 -- start start 2023-11-04T01:45:08.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.508+0000 7f943eb41640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94380adac0 0x7f94381e35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.508+0000 7f943eb41640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94380c48e0 0x7f943814fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.508+0000 7f943eb41640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9438159c00 0x7f9438156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.508+0000 7f943eb41640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94381e2370 con 0x7f94380adac0 2023-11-04T01:45:08.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.508+0000 7f943eb41640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94381e3b20 con 0x7f94380c48e0 2023-11-04T01:45:08.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.508+0000 7f943eb41640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94380c6de0 con 0x7f9438159c00 2023-11-04T01:45:08.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.509+0000 7f943c8dd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94380adac0 0x7f94381e35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.509+0000 7f943c8dd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94380adac0 0x7f94381e35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40836/0 (socket says 172.21.15.77:40836) 2023-11-04T01:45:08.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.509+0000 7f943c8dd640 1 -- 172.21.15.77:0/94527367 learned_addr learned my addr 172.21.15.77:0/94527367 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:08.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.509+0000 7f943c8dd640 1 -- 172.21.15.77:0/94527367 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9438159c00 msgr2=0x7f9438156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:08.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.509+0000 7f943c8dd640 1 --2- 172.21.15.77:0/94527367 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9438159c00 0x7f9438156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.509+0000 7f943c8dd640 1 -- 172.21.15.77:0/94527367 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94380c48e0 msgr2=0x7f943814fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:08.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.509+0000 7f943c8dd640 1 --2- 172.21.15.77:0/94527367 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94380c48e0 0x7f943814fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.509+0000 7f943c8dd640 1 -- 172.21.15.77:0/94527367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f942c0094d0 con 0x7f94380adac0 2023-11-04T01:45:08.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.509+0000 7f943c8dd640 1 --2- 172.21.15.77:0/94527367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94380adac0 0x7f94381e35e0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f942c000c00 tx=0x7f942c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:08.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.509+0000 7f94357fa640 1 -- 172.21.15.77:0/94527367 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c03ad30 con 0x7f94380adac0 2023-11-04T01:45:08.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.509+0000 7f94357fa640 1 -- 172.21.15.77:0/94527367 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942c0443f0 con 0x7f94380adac0 2023-11-04T01:45:08.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.509+0000 7f943eb41640 1 -- 172.21.15.77:0/94527367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94380c70c0 con 0x7f94380adac0 2023-11-04T01:45:08.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.509+0000 7f94357fa640 1 -- 172.21.15.77:0/94527367 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c0447a0 con 0x7f94380adac0 2023-11-04T01:45:08.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.509+0000 7f943eb41640 1 -- 172.21.15.77:0/94527367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94380c7680 con 0x7f94380adac0 2023-11-04T01:45:08.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.511+0000 7f94357fa640 1 -- 172.21.15.77:0/94527367 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f942c044900 con 0x7f94380adac0 2023-11-04T01:45:08.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.511+0000 7f94357fa640 1 --2- 172.21.15.77:0/94527367 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f941c06ae70 0x7f941c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.511+0000 7f94357fa640 1 -- 172.21.15.77:0/94527367 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f942c02d040 con 0x7f94380adac0 2023-11-04T01:45:08.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.512+0000 7f9437fff640 1 --2- 172.21.15.77:0/94527367 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f941c06ae70 0x7f941c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.512+0000 7f9437fff640 1 --2- 172.21.15.77:0/94527367 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f941c06ae70 0x7f941c06d330 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9438070fe0 tx=0x7f9424008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:08.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.512+0000 7f94417b0740 1 Processor -- start 2023-11-04T01:45:08.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.512+0000 7f94417b0740 1 -- start start 2023-11-04T01:45:08.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.513+0000 7f94417b0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e2cbae1850 0x55e2cbab4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.513+0000 7f94417b0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2cbae1c30 0x55e2cbae45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.513+0000 7f94417b0740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55e2cbab4c90 0x55e2cbae4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.513+0000 7f94417b0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2cb9c5740 con 0x55e2cbae1850 2023-11-04T01:45:08.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.513+0000 7f94417b0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2cba278d0 con 0x55e2cbae1c30 2023-11-04T01:45:08.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.513+0000 7f94417b0740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e2cba24fc0 con 0x55e2cbab4c90 2023-11-04T01:45:08.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.513+0000 7f943c8dd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e2cbae1850 0x55e2cbab4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.513+0000 7f943c8dd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e2cbae1850 0x55e2cbab4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40838/0 (socket says 172.21.15.77:40838) 2023-11-04T01:45:08.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.513+0000 7f943c8dd640 1 -- 172.21.15.77:0/288157807 learned_addr learned my addr 172.21.15.77:0/288157807 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:08.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.513+0000 7f943d0de640 1 --2- 172.21.15.77:0/288157807 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55e2cbab4c90 0x55e2cbae4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.513+0000 7f943c8dd640 1 -- 172.21.15.77:0/288157807 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55e2cbab4c90 msgr2=0x55e2cbae4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:08.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.513+0000 7f943c8dd640 1 --2- 172.21.15.77:0/288157807 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55e2cbab4c90 0x55e2cbae4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.513+0000 7f9437fff640 1 --2- 172.21.15.77:0/288157807 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2cbae1c30 0x55e2cbae45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.513+0000 7f943c8dd640 1 -- 172.21.15.77:0/288157807 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2cbae1c30 msgr2=0x55e2cbae45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:08.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.513+0000 7f943c8dd640 1 --2- 172.21.15.77:0/288157807 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2cbae1c30 0x55e2cbae45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.513+0000 7f943c8dd640 1 -- 172.21.15.77:0/288157807 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e2cb9e3ca0 con 0x55e2cbae1850 2023-11-04T01:45:08.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.513+0000 7f943c8dd640 1 --2- 172.21.15.77:0/288157807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e2cbae1850 0x55e2cbab4750 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f942c07a4b0 tx=0x7f942c07b1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5617af3f041323 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:08.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.513+0000 7f94227fc640 1 -- 172.21.15.77:0/288157807 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c07ec20 con 0x55e2cbae1850 2023-11-04T01:45:08.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.513+0000 7f94227fc640 1 -- 172.21.15.77:0/288157807 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942c082dd0 con 0x55e2cbae1850 2023-11-04T01:45:08.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.514+0000 7f94227fc640 1 -- 172.21.15.77:0/288157807 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c078e70 con 0x55e2cbae1850 2023-11-04T01:45:08.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.514+0000 7f94417b0740 1 -- 172.21.15.77:0/288157807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e2cbae1850 msgr2=0x55e2cbab4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:08.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.514+0000 7f94417b0740 1 --2- 172.21.15.77:0/288157807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e2cbae1850 0x55e2cbab4750 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f942c07a4b0 tx=0x7f942c07b1d0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.514+0000 7f94417b0740 1 -- 172.21.15.77:0/288157807 shutdown_connections 2023-11-04T01:45:08.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.514+0000 7f94417b0740 1 --2- 172.21.15.77:0/288157807 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55e2cbab4c90 0x55e2cbae4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.514+0000 7f94417b0740 1 --2- 172.21.15.77:0/288157807 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2cbae1c30 0x55e2cbae45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.514+0000 7f94417b0740 1 --2- 172.21.15.77:0/288157807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e2cbae1850 0x55e2cbab4750 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.514+0000 7f94417b0740 1 -- 172.21.15.77:0/288157807 >> 172.21.15.77:0/288157807 conn(0x55e2cbab6a60 msgr2=0x55e2cbaff5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:08.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.514+0000 7f94417b0740 1 -- 172.21.15.77:0/288157807 shutdown_connections 2023-11-04T01:45:08.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.514+0000 7f94417b0740 1 -- 172.21.15.77:0/288157807 wait complete. 2023-11-04T01:45:08.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.515+0000 7f94417b0740 1 -- start start 2023-11-04T01:45:08.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.515+0000 7f94417b0740 1 Processor -- start 2023-11-04T01:45:08.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.516+0000 7f94417b0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e2cbae1850 0x55e2cbae6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.516+0000 7f94417b0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2cbae1c30 0x55e2cbaf9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.516+0000 7f94417b0740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55e2cbad2ca0 0x55e2cbafa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.516+0000 7f94417b0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2cba208b0 con 0x55e2cbae1850 2023-11-04T01:45:08.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.516+0000 7f94417b0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2cb9dac80 con 0x55e2cbae1c30 2023-11-04T01:45:08.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.516+0000 7f94417b0740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e2cb9da920 con 0x55e2cbad2ca0 2023-11-04T01:45:08.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.516+0000 7f94417b0740 10 client.0 _ll_register_callbacks cb 0x55e2cb732ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:45:08.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.516+0000 7f943c8dd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e2cbae1850 0x55e2cbae6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.516+0000 7f943c8dd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e2cbae1850 0x55e2cbae6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40842/0 (socket says 172.21.15.77:40842) 2023-11-04T01:45:08.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.516+0000 7f943c8dd640 1 -- 172.21.15.77:0/1816006403 learned_addr learned my addr 172.21.15.77:0/1816006403 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:08.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.516+0000 7f9437fff640 1 --2- 172.21.15.77:0/1816006403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2cbae1c30 0x55e2cbaf9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.516+0000 7f943d0de640 1 --2- 172.21.15.77:0/1816006403 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55e2cbad2ca0 0x55e2cbafa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.516+0000 7f943c8dd640 1 -- 172.21.15.77:0/1816006403 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55e2cbad2ca0 msgr2=0x55e2cbafa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:08.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.516+0000 7f943c8dd640 1 --2- 172.21.15.77:0/1816006403 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55e2cbad2ca0 0x55e2cbafa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.516+0000 7f943c8dd640 1 -- 172.21.15.77:0/1816006403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2cbae1c30 msgr2=0x55e2cbaf9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:08.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.516+0000 7f943c8dd640 1 --2- 172.21.15.77:0/1816006403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2cbae1c30 0x55e2cbaf9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.516+0000 7f943c8dd640 1 -- 172.21.15.77:0/1816006403 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94380c7680 con 0x55e2cbae1850 2023-11-04T01:45:08.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.516+0000 7f943c8dd640 1 --2- 172.21.15.77:0/1816006403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e2cbae1850 0x55e2cbae6620 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f942c07a4b0 tx=0x7f942c04b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77de2643d3cd9edb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:08.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.516+0000 7f94177fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:45:08.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.516+0000 7f94177fe640 1 -- 172.21.15.77:0/1816006403 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c0a6030 con 0x55e2cbae1850 2023-11-04T01:45:08.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.516+0000 7f94177fe640 1 -- 172.21.15.77:0/1816006403 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f942c0a7070 con 0x55e2cbae1850 2023-11-04T01:45:08.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.516+0000 7f94417b0740 1 -- 172.21.15.77:0/1816006403 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e2cb9ccbf0 con 0x55e2cbae1850 2023-11-04T01:45:08.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.516+0000 7f94177fe640 1 -- 172.21.15.77:0/1816006403 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f942c07eca0 con 0x55e2cbae1850 2023-11-04T01:45:08.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.516+0000 7f94417b0740 10 client.7896 fetch_fsmap learned FSMap version 72 2023-11-04T01:45:08.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.516+0000 7f94417b0740 1 -- 172.21.15.77:0/1816006403 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x55e2cba1ef30 con 0x55e2cbae1850 2023-11-04T01:45:08.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.516+0000 7f94177fe640 1 -- 172.21.15.77:0/1816006403 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942c08c020 con 0x55e2cbae1850 2023-11-04T01:45:08.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.517+0000 7f94177fe640 1 -- 172.21.15.77:0/1816006403 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 72) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f942c092170 con 0x55e2cbae1850 2023-11-04T01:45:08.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.517+0000 7f94417b0740 10 client.7896 fetch_fsmap finished waiting for FSMap version 72 2023-11-04T01:45:08.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.517+0000 7f94417b0740 10 client.7896 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:45:08.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.517+0000 7f94417b0740 20 client.7896 populate_metadata read hostname 'smithi077' 2023-11-04T01:45:08.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.517+0000 7f94417b0740 1 --2- 172.21.15.77:0/1816006403 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x55e2cbb117e0 0x55e2cbb0faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.517+0000 7f94417b0740 4 client.7896 mds_command: new command op to 7305 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:45:08.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.517+0000 7f94417b0740 1 -- 172.21.15.77:0/1816006403 --> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e2cba19890 con 0x55e2cbb117e0 2023-11-04T01:45:08.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.517+0000 7f9437fff640 1 --2- 172.21.15.77:0/1816006403 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x55e2cbb117e0 0x55e2cbb0faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.517+0000 7f9437fff640 1 --2- 172.21.15.77:0/1816006403 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x55e2cbb117e0 0x55e2cbb0faa0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=37f76a4e48eba2e6 server_cookie=73525ba57ab5ece0 in_seq=0 out_seq=0 2023-11-04T01:45:08.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.517+0000 7f94177fe640 10 client.7896 ms_handle_connect on v2:172.21.15.77:6833/3207490604 2023-11-04T01:45:08.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.517+0000 7f94177fe640 1 -- 172.21.15.77:0/1816006403 <== mds.1 v2:172.21.15.77:6833/3207490604 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e2cba19890 con 0x55e2cbb117e0 2023-11-04T01:45:08.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.517+0000 7f94177fe640 10 client.7896 handle_command_reply: tid=0 2023-11-04T01:45:08.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.518+0000 7f94417b0740 1 client.7896 shutdown 2023-11-04T01:45:08.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.518+0000 7f94417b0740 1 -- 172.21.15.77:0/1816006403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e2cbae1850 msgr2=0x55e2cbae6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:08.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.518+0000 7f94417b0740 1 --2- 172.21.15.77:0/1816006403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e2cbae1850 0x55e2cbae6620 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f942c07a4b0 tx=0x7f942c04b000 comp rx=0 tx=0).stop 2023-11-04T01:45:08.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.518+0000 7f94417b0740 1 -- 172.21.15.77:0/1816006403 shutdown_connections 2023-11-04T01:45:08.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.518+0000 7f94417b0740 1 --2- 172.21.15.77:0/1816006403 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55e2cbad2ca0 0x55e2cbafa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.518+0000 7f94417b0740 1 --2- 172.21.15.77:0/1816006403 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x55e2cbb117e0 0x55e2cbb0faa0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.518+0000 7f94417b0740 1 --2- 172.21.15.77:0/1816006403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2cbae1c30 0x55e2cbaf9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.518+0000 7f94417b0740 1 --2- 172.21.15.77:0/1816006403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e2cbae1850 0x55e2cbae6620 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.518+0000 7f94177fe640 0 client.7896 ms_handle_reset on v2:172.21.15.77:6833/3207490604 2023-11-04T01:45:08.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.518+0000 7f94417b0740 1 -- 172.21.15.77:0/1816006403 >> 172.21.15.77:0/1816006403 conn(0x55e2cbab4c90 msgr2=0x55e2cbb03380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:08.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.518+0000 7f94417b0740 1 -- 172.21.15.77:0/1816006403 shutdown_connections 2023-11-04T01:45:08.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.518+0000 7f94417b0740 1 -- 172.21.15.77:0/1816006403 wait complete. 2023-11-04T01:45:08.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.518+0000 7f94417b0740 20 client.7896 trim_cache size 0 max 16384 2023-11-04T01:45:08.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.533+0000 7f94417b0740 1 Processor -- start 2023-11-04T01:45:08.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.533+0000 7f94417b0740 1 -- start start 2023-11-04T01:45:08.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.534+0000 7f94417b0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2cbab4c90 0x55e2cbae05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.534+0000 7f94417b0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e2cbad2ca0 0x55e2cbb22400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.534+0000 7f94417b0740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55e2cbae1850 0x55e2cbae4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.534+0000 7f94417b0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2cb9a0280 con 0x55e2cbad2ca0 2023-11-04T01:45:08.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.534+0000 7f94417b0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2cb9ec7e0 con 0x55e2cbab4c90 2023-11-04T01:45:08.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.534+0000 7f94417b0740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e2cbb22940 con 0x55e2cbae1850 2023-11-04T01:45:08.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.534+0000 7f9437fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e2cbad2ca0 0x55e2cbb22400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.534+0000 7f9437fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e2cbad2ca0 0x55e2cbb22400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40846/0 (socket says 172.21.15.77:40846) 2023-11-04T01:45:08.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.534+0000 7f9437fff640 1 -- 172.21.15.77:0/1580220941 learned_addr learned my addr 172.21.15.77:0/1580220941 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:08.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.534+0000 7f9437fff640 1 -- 172.21.15.77:0/1580220941 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55e2cbae1850 msgr2=0x55e2cbae4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:08.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.534+0000 7f9437fff640 1 --2- 172.21.15.77:0/1580220941 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55e2cbae1850 0x55e2cbae4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.534+0000 7f9437fff640 1 -- 172.21.15.77:0/1580220941 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2cbab4c90 msgr2=0x55e2cbae05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:08.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.534+0000 7f9437fff640 1 --2- 172.21.15.77:0/1580220941 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2cbab4c90 0x55e2cbae05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.534+0000 7f9437fff640 1 -- 172.21.15.77:0/1580220941 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e2cb9bcd10 con 0x55e2cbad2ca0 2023-11-04T01:45:08.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.534+0000 7f9437fff640 1 --2- 172.21.15.77:0/1580220941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e2cbad2ca0 0x55e2cbb22400 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f94380c3de0 tx=0x7f9424013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5f0df9a3a0f27eb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:08.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.535+0000 7f9422ffd640 1 -- 172.21.15.77:0/1580220941 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9424025170 con 0x55e2cbad2ca0 2023-11-04T01:45:08.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.535+0000 7f9422ffd640 1 -- 172.21.15.77:0/1580220941 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942401a040 con 0x55e2cbad2ca0 2023-11-04T01:45:08.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.535+0000 7f9422ffd640 1 -- 172.21.15.77:0/1580220941 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94240252f0 con 0x55e2cbad2ca0 2023-11-04T01:45:08.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.535+0000 7f94417b0740 1 -- 172.21.15.77:0/1580220941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e2cbad2ca0 msgr2=0x55e2cbb22400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:08.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.535+0000 7f94417b0740 1 --2- 172.21.15.77:0/1580220941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e2cbad2ca0 0x55e2cbb22400 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f94380c3de0 tx=0x7f9424013000 comp rx=0 tx=0).stop 2023-11-04T01:45:08.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.535+0000 7f94417b0740 1 -- 172.21.15.77:0/1580220941 shutdown_connections 2023-11-04T01:45:08.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.535+0000 7f94417b0740 1 --2- 172.21.15.77:0/1580220941 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55e2cbae1850 0x55e2cbae4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.535+0000 7f94417b0740 1 --2- 172.21.15.77:0/1580220941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e2cbad2ca0 0x55e2cbb22400 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.535+0000 7f94417b0740 1 --2- 172.21.15.77:0/1580220941 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2cbab4c90 0x55e2cbae05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.535+0000 7f94417b0740 1 -- 172.21.15.77:0/1580220941 >> 172.21.15.77:0/1580220941 conn(0x55e2cbaaff80 msgr2=0x55e2cbaf9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:08.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.535+0000 7f94417b0740 1 -- 172.21.15.77:0/1580220941 shutdown_connections 2023-11-04T01:45:08.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.535+0000 7f94417b0740 1 -- 172.21.15.77:0/1580220941 wait complete. 2023-11-04T01:45:08.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.536+0000 7f94417b0740 1 -- start start 2023-11-04T01:45:08.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.536+0000 7f94417b0740 1 Processor -- start 2023-11-04T01:45:08.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.537+0000 7f94417b0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2cbab4c90 0x55e2cbb681a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.537+0000 7f94417b0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e2cbad2ca0 0x55e2cbb01e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.537+0000 7f94417b0740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55e2cbae1850 0x55e2cbb02340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.537+0000 7f94417b0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2cba1fa50 con 0x55e2cbad2ca0 2023-11-04T01:45:08.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.537+0000 7f94417b0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2cbb0e050 con 0x55e2cbab4c90 2023-11-04T01:45:08.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.537+0000 7f94417b0740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e2cbaf5ef0 con 0x55e2cbae1850 2023-11-04T01:45:08.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.537+0000 7f94417b0740 10 client.0 _ll_register_callbacks cb 0x7f942c076e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:45:08.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.537+0000 7f9437fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e2cbad2ca0 0x55e2cbb01e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.537+0000 7f9437fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e2cbad2ca0 0x55e2cbb01e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40850/0 (socket says 172.21.15.77:40850) 2023-11-04T01:45:08.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.537+0000 7f9437fff640 1 -- 172.21.15.77:0/1996222981 learned_addr learned my addr 172.21.15.77:0/1996222981 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:08.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.537+0000 7f943c8dd640 1 --2- 172.21.15.77:0/1996222981 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2cbab4c90 0x55e2cbb681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.537+0000 7f943d0de640 1 --2- 172.21.15.77:0/1996222981 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55e2cbae1850 0x55e2cbb02340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.537+0000 7f9437fff640 1 -- 172.21.15.77:0/1996222981 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55e2cbae1850 msgr2=0x55e2cbb02340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:08.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.537+0000 7f9437fff640 1 --2- 172.21.15.77:0/1996222981 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55e2cbae1850 0x55e2cbb02340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.537+0000 7f9437fff640 1 -- 172.21.15.77:0/1996222981 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2cbab4c90 msgr2=0x55e2cbb681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:08.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.537+0000 7f9437fff640 1 --2- 172.21.15.77:0/1996222981 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2cbab4c90 0x55e2cbb681a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.537+0000 7f9437fff640 1 -- 172.21.15.77:0/1996222981 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f942400e040 con 0x55e2cbad2ca0 2023-11-04T01:45:08.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.537+0000 7f9437fff640 1 --2- 172.21.15.77:0/1996222981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e2cbad2ca0 0x55e2cbb01e00 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f9424008010 tx=0x7f9424006e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca4d343bfc253b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:08.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.537+0000 7f94177fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:45:08.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.537+0000 7f94177fe640 1 -- 172.21.15.77:0/1996222981 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94240144b0 con 0x55e2cbad2ca0 2023-11-04T01:45:08.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.537+0000 7f94177fe640 1 -- 172.21.15.77:0/1996222981 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f9424014610 con 0x55e2cbad2ca0 2023-11-04T01:45:08.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.537+0000 7f94417b0740 1 -- 172.21.15.77:0/1996222981 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f942c082dd0 con 0x55e2cbad2ca0 2023-11-04T01:45:08.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.537+0000 7f94177fe640 1 -- 172.21.15.77:0/1996222981 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94240147d0 con 0x55e2cbad2ca0 2023-11-04T01:45:08.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.537+0000 7f94417b0740 10 client.7902 fetch_fsmap learned FSMap version 72 2023-11-04T01:45:08.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.537+0000 7f94417b0740 1 -- 172.21.15.77:0/1996222981 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x55e2cb9e2500 con 0x55e2cbad2ca0 2023-11-04T01:45:08.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.538+0000 7f94177fe640 1 -- 172.21.15.77:0/1996222981 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942c082dd0 con 0x55e2cbad2ca0 2023-11-04T01:45:08.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.538+0000 7f94177fe640 1 -- 172.21.15.77:0/1996222981 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 72) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f942401f040 con 0x55e2cbad2ca0 2023-11-04T01:45:08.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.538+0000 7f94417b0740 10 client.7902 fetch_fsmap finished waiting for FSMap version 72 2023-11-04T01:45:08.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.538+0000 7f94417b0740 10 client.7902 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:45:08.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.538+0000 7f94417b0740 20 client.7902 populate_metadata read hostname 'smithi077' 2023-11-04T01:45:08.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.538+0000 7f94417b0740 1 --2- 172.21.15.77:0/1996222981 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x55e2cbae1c30 0x55e2cbb6e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.538+0000 7f94417b0740 4 client.7902 mds_command: new command op to 7305 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:45:08.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.538+0000 7f94417b0740 1 -- 172.21.15.77:0/1996222981 --> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e2cba195b0 con 0x55e2cbae1c30 2023-11-04T01:45:08.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.538+0000 7f943c8dd640 1 --2- 172.21.15.77:0/1996222981 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x55e2cbae1c30 0x55e2cbb6e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.538+0000 7f94177fe640 10 client.7902 ms_handle_connect on v2:172.21.15.77:6833/3207490604 2023-11-04T01:45:08.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.538+0000 7f943c8dd640 1 --2- 172.21.15.77:0/1996222981 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x55e2cbae1c30 0x55e2cbb6e6c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=83fdedec1828dd27 server_cookie=f29fd1986a776a97 in_seq=0 out_seq=0 2023-11-04T01:45:08.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.538+0000 7f94177fe640 1 -- 172.21.15.77:0/1996222981 <== mds.1 v2:172.21.15.77:6833/3207490604 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55e2cba195b0 con 0x55e2cbae1c30 2023-11-04T01:45:08.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.538+0000 7f94177fe640 10 client.7902 handle_command_reply: tid=0 2023-11-04T01:45:08.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.538+0000 7f94417b0740 1 client.7902 shutdown 2023-11-04T01:45:08.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.538+0000 7f94417b0740 1 -- 172.21.15.77:0/1996222981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e2cbad2ca0 msgr2=0x55e2cbb01e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:08.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.538+0000 7f94417b0740 1 --2- 172.21.15.77:0/1996222981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e2cbad2ca0 0x55e2cbb01e00 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f9424008010 tx=0x7f9424006e10 comp rx=0 tx=0).stop 2023-11-04T01:45:08.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.538+0000 7f94417b0740 1 -- 172.21.15.77:0/1996222981 shutdown_connections 2023-11-04T01:45:08.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.538+0000 7f94417b0740 1 --2- 172.21.15.77:0/1996222981 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55e2cbae1850 0x55e2cbb02340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.538+0000 7f94417b0740 1 --2- 172.21.15.77:0/1996222981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e2cbad2ca0 0x55e2cbb01e00 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.538+0000 7f94417b0740 1 --2- 172.21.15.77:0/1996222981 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x55e2cbae1c30 0x55e2cbb6e6c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.538+0000 7f94417b0740 1 --2- 172.21.15.77:0/1996222981 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e2cbab4c90 0x55e2cbb681a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.538+0000 7f94177fe640 0 client.7902 ms_handle_reset on v2:172.21.15.77:6833/3207490604 2023-11-04T01:45:08.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.538+0000 7f94417b0740 1 -- 172.21.15.77:0/1996222981 >> 172.21.15.77:0/1996222981 conn(0x55e2cbaaff80 msgr2=0x55e2cbae4950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:08.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.539+0000 7f94417b0740 1 -- 172.21.15.77:0/1996222981 shutdown_connections 2023-11-04T01:45:08.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.539+0000 7f94417b0740 1 -- 172.21.15.77:0/1996222981 wait complete. 2023-11-04T01:45:08.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.539+0000 7f94417b0740 20 client.7902 trim_cache size 0 max 16384 2023-11-04T01:45:08.568 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-04T01:45:08.569 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "0c22c75d-0169-41ef-b663-6ac1c5b0f71f", 2023-11-04T01:45:08.569 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 1, 2023-11-04T01:45:08.569 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 7305, 2023-11-04T01:45:08.569 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2023-11-04T01:45:08.569 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2023-11-04T01:45:08.570 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2023-11-04T01:45:08.570 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 91.934866376000002, 2023-11-04T01:45:08.570 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 72, 2023-11-04T01:45:08.570 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 101, 2023-11-04T01:45:08.571 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 101, 2023-11-04T01:45:08.571 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 107.68696264800001 2023-11-04T01:45:08.571 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-04T01:45:08.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.539+0000 7f943eb41640 1 -- 172.21.15.77:0/94527367 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f941c06ae70 msgr2=0x7f941c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:08.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.539+0000 7f943eb41640 1 --2- 172.21.15.77:0/94527367 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f941c06ae70 0x7f941c06d330 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9438070fe0 tx=0x7f9424008040 comp rx=0 tx=0).stop 2023-11-04T01:45:08.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.539+0000 7f943eb41640 1 -- 172.21.15.77:0/94527367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94380adac0 msgr2=0x7f94381e35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:08.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.539+0000 7f943eb41640 1 --2- 172.21.15.77:0/94527367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94380adac0 0x7f94381e35e0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f942c000c00 tx=0x7f942c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.539+0000 7f943eb41640 1 -- 172.21.15.77:0/94527367 shutdown_connections 2023-11-04T01:45:08.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.539+0000 7f943eb41640 1 --2- 172.21.15.77:0/94527367 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f941c06ae70 0x7f941c06d330 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.539+0000 7f943eb41640 1 --2- 172.21.15.77:0/94527367 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9438159c00 0x7f9438156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.539+0000 7f943eb41640 1 --2- 172.21.15.77:0/94527367 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94380c48e0 0x7f943814fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.539+0000 7f943eb41640 1 --2- 172.21.15.77:0/94527367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94380adac0 0x7f94381e35e0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.539+0000 7f943eb41640 1 -- 172.21.15.77:0/94527367 >> 172.21.15.77:0/94527367 conn(0x7f94380ce950 msgr2=0x7f94381e5900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:08.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.539+0000 7f943eb41640 1 -- 172.21.15.77:0/94527367 shutdown_connections 2023-11-04T01:45:08.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.539+0000 7f943eb41640 1 -- 172.21.15.77:0/94527367 wait complete. 2023-11-04T01:45:08.575 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-04T01:45:08.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.674+0000 7f5474a56640 1 Processor -- start 2023-11-04T01:45:08.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.674+0000 7f5474a56640 1 -- start start 2023-11-04T01:45:08.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.675+0000 7f5474a56640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f547015d1b0 0x7f54700cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.675+0000 7f5474a56640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5470066000 0x7f547006a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.675+0000 7f5474a56640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54700c9bf0 con 0x7f5470070ff0 2023-11-04T01:45:08.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.675+0000 7f5474a56640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54700cd890 con 0x7f5470066000 2023-11-04T01:45:08.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.675+0000 7f5474a56640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54700cdb30 con 0x7f547015d1b0 2023-11-04T01:45:08.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.675+0000 7f546ed9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5470066000 0x7f547006a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.675+0000 7f546ed9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5470066000 0x7f547006a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40852/0 (socket says 172.21.15.77:40852) 2023-11-04T01:45:08.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.675+0000 7f546ed9d640 1 -- 172.21.15.77:0/1451544501 learned_addr learned my addr 172.21.15.77:0/1451544501 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:08.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.675+0000 7f5465d9b640 1 --2- 172.21.15.77:0/1451544501 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f547015d1b0 0x7f54700cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.675+0000 7f546ed9d640 1 -- 172.21.15.77:0/1451544501 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f547015d1b0 msgr2=0x7f54700cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:08.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.675+0000 7f546ed9d640 1 --2- 172.21.15.77:0/1451544501 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f547015d1b0 0x7f54700cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.675+0000 7f546ed9d640 1 -- 172.21.15.77:0/1451544501 >> v1:172.21.15.122:6789/0 conn(0x7f5470070ff0 legacy=0x7f54700713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:08.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.675+0000 7f546ed9d640 1 -- 172.21.15.77:0/1451544501 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54700cde10 con 0x7f5470066000 2023-11-04T01:45:08.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.675+0000 7f5465d9b640 1 --2- 172.21.15.77:0/1451544501 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f547015d1b0 0x7f54700cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:08.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.676+0000 7f546ed9d640 1 --2- 172.21.15.77:0/1451544501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5470066000 0x7f547006a500 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f5468009e50 tx=0x7f546802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72034c20a4ecf0a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:08.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.676+0000 7f546dd9b640 1 -- 172.21.15.77:0/1451544501 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546802ca70 con 0x7f5470066000 2023-11-04T01:45:08.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.676+0000 7f546dd9b640 1 -- 172.21.15.77:0/1451544501 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546802cbd0 con 0x7f5470066000 2023-11-04T01:45:08.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.676+0000 7f546dd9b640 1 -- 172.21.15.77:0/1451544501 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54680343f0 con 0x7f5470066000 2023-11-04T01:45:08.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.676+0000 7f5474a56640 1 -- 172.21.15.77:0/1451544501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5470066000 msgr2=0x7f547006a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:08.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.676+0000 7f5474a56640 1 --2- 172.21.15.77:0/1451544501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5470066000 0x7f547006a500 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f5468009e50 tx=0x7f546802bed0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.676+0000 7f5474a56640 1 -- 172.21.15.77:0/1451544501 shutdown_connections 2023-11-04T01:45:08.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.676+0000 7f5474a56640 1 --2- 172.21.15.77:0/1451544501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5470066000 0x7f547006a500 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.676+0000 7f5474a56640 1 --2- 172.21.15.77:0/1451544501 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f547015d1b0 0x7f54700cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.676+0000 7f5474a56640 1 -- 172.21.15.77:0/1451544501 >> 172.21.15.77:0/1451544501 conn(0x7f54700cbc90 msgr2=0x7f54700cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:08.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.676+0000 7f5474a56640 1 -- 172.21.15.77:0/1451544501 shutdown_connections 2023-11-04T01:45:08.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.676+0000 7f5474a56640 1 -- 172.21.15.77:0/1451544501 wait complete. 2023-11-04T01:45:08.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.678+0000 7f5474a56640 1 Processor -- start 2023-11-04T01:45:08.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.678+0000 7f5474a56640 1 -- start start 2023-11-04T01:45:08.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.679+0000 7f5474a56640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5470066000 0x7f547006ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.679+0000 7f5474a56640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5470070ff0 0x7f54700c3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.679+0000 7f5474a56640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f547015d1b0 0x7f54701516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.679+0000 7f5474a56640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547015ec00 con 0x7f5470070ff0 2023-11-04T01:45:08.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.679+0000 7f5474a56640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547015e5d0 con 0x7f547015d1b0 2023-11-04T01:45:08.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.679+0000 7f5474a56640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54700c3ba0 con 0x7f5470066000 2023-11-04T01:45:08.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.679+0000 7f5465d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5470070ff0 0x7f54700c3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.679+0000 7f5465d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5470070ff0 0x7f54700c3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40866/0 (socket says 172.21.15.77:40866) 2023-11-04T01:45:08.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.679+0000 7f5465d9b640 1 -- 172.21.15.77:0/3967096120 learned_addr learned my addr 172.21.15.77:0/3967096120 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:08.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.679+0000 7f546ed9d640 1 --2- 172.21.15.77:0/3967096120 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f547015d1b0 0x7f54701516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.679+0000 7f546e59c640 1 --2- 172.21.15.77:0/3967096120 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5470066000 0x7f547006ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.679+0000 7f5465d9b640 1 -- 172.21.15.77:0/3967096120 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5470066000 msgr2=0x7f547006ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:08.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.679+0000 7f5465d9b640 1 --2- 172.21.15.77:0/3967096120 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5470066000 0x7f547006ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.679+0000 7f5465d9b640 1 -- 172.21.15.77:0/3967096120 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f547015d1b0 msgr2=0x7f54701516d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:08.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.679+0000 7f5465d9b640 1 --2- 172.21.15.77:0/3967096120 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f547015d1b0 0x7f54701516d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.679+0000 7f5465d9b640 1 -- 172.21.15.77:0/3967096120 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5468009b30 con 0x7f5470070ff0 2023-11-04T01:45:08.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.679+0000 7f5465d9b640 1 --2- 172.21.15.77:0/3967096120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5470070ff0 0x7f54700c3660 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f545800c820 tx=0x7f545800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:08.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.679+0000 7f54677fe640 1 -- 172.21.15.77:0/3967096120 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5458007a30 con 0x7f5470070ff0 2023-11-04T01:45:08.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.679+0000 7f54677fe640 1 -- 172.21.15.77:0/3967096120 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5458007b90 con 0x7f5470070ff0 2023-11-04T01:45:08.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.679+0000 7f5474a56640 1 -- 172.21.15.77:0/3967096120 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f547006b360 con 0x7f5470070ff0 2023-11-04T01:45:08.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.679+0000 7f54677fe640 1 -- 172.21.15.77:0/3967096120 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545800ce70 con 0x7f5470070ff0 2023-11-04T01:45:08.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.679+0000 7f5474a56640 1 -- 172.21.15.77:0/3967096120 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f547015e820 con 0x7f5470070ff0 2023-11-04T01:45:08.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.681+0000 7f54677fe640 1 -- 172.21.15.77:0/3967096120 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f54580113f0 con 0x7f5470070ff0 2023-11-04T01:45:08.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.681+0000 7f54677fe640 1 --2- 172.21.15.77:0/3967096120 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f545006aea0 0x7f545006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.681+0000 7f54677fe640 1 -- 172.21.15.77:0/3967096120 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f5458089e00 con 0x7f5470070ff0 2023-11-04T01:45:08.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.682+0000 7f546e59c640 1 --2- 172.21.15.77:0/3967096120 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f545006aea0 0x7f545006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.682+0000 7f546e59c640 1 --2- 172.21.15.77:0/3967096120 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f545006aea0 0x7f545006d360 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f5460004ea0 tx=0x7f5460009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:08.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.682+0000 7f54775df740 1 Processor -- start 2023-11-04T01:45:08.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.683+0000 7f54775df740 1 -- start start 2023-11-04T01:45:08.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.683+0000 7f54775df740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560a05d4b850 0x560a05d1e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.683+0000 7f54775df740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a05d4bc30 0x560a05d4e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.683+0000 7f54775df740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a05d1ec90 0x560a05d4eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.683+0000 7f54775df740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a05c2f740 con 0x560a05d1ec90 2023-11-04T01:45:08.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.683+0000 7f54775df740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a05c918d0 con 0x560a05d4bc30 2023-11-04T01:45:08.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.683+0000 7f54775df740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x560a05c8efc0 con 0x560a05d4b850 2023-11-04T01:45:08.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.683+0000 7f546ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a05d1ec90 0x560a05d4eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.683+0000 7f546ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a05d1ec90 0x560a05d4eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40874/0 (socket says 172.21.15.77:40874) 2023-11-04T01:45:08.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.683+0000 7f546ed9d640 1 -- 172.21.15.77:0/536856098 learned_addr learned my addr 172.21.15.77:0/536856098 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:08.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.683+0000 7f5465d9b640 1 --2- 172.21.15.77:0/536856098 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a05d4bc30 0x560a05d4e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.683+0000 7f546e59c640 1 --2- 172.21.15.77:0/536856098 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560a05d4b850 0x560a05d1e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.684+0000 7f546ed9d640 1 -- 172.21.15.77:0/536856098 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560a05d4b850 msgr2=0x560a05d1e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:08.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.684+0000 7f546ed9d640 1 --2- 172.21.15.77:0/536856098 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560a05d4b850 0x560a05d1e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.684+0000 7f546ed9d640 1 -- 172.21.15.77:0/536856098 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a05d4bc30 msgr2=0x560a05d4e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:08.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.684+0000 7f546ed9d640 1 --2- 172.21.15.77:0/536856098 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a05d4bc30 0x560a05d4e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.684+0000 7f546ed9d640 1 -- 172.21.15.77:0/536856098 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a05c4dca0 con 0x560a05d1ec90 2023-11-04T01:45:08.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.684+0000 7f546ed9d640 1 --2- 172.21.15.77:0/536856098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a05d1ec90 0x560a05d4eb20 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f5468036040 tx=0x7f546802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2354628e65058e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:08.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.684+0000 7f544ffff640 1 -- 172.21.15.77:0/536856098 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546803e630 con 0x560a05d1ec90 2023-11-04T01:45:08.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.684+0000 7f544ffff640 1 -- 172.21.15.77:0/536856098 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546803e7b0 con 0x560a05d1ec90 2023-11-04T01:45:08.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.684+0000 7f544ffff640 1 -- 172.21.15.77:0/536856098 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546803eb60 con 0x560a05d1ec90 2023-11-04T01:45:08.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.685+0000 7f54775df740 1 -- 172.21.15.77:0/536856098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a05d1ec90 msgr2=0x560a05d4eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:08.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.685+0000 7f54775df740 1 --2- 172.21.15.77:0/536856098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a05d1ec90 0x560a05d4eb20 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f5468036040 tx=0x7f546802e000 comp rx=0 tx=0).stop 2023-11-04T01:45:08.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.685+0000 7f54775df740 1 -- 172.21.15.77:0/536856098 shutdown_connections 2023-11-04T01:45:08.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.685+0000 7f54775df740 1 --2- 172.21.15.77:0/536856098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a05d1ec90 0x560a05d4eb20 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.685+0000 7f54775df740 1 --2- 172.21.15.77:0/536856098 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a05d4bc30 0x560a05d4e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.685+0000 7f54775df740 1 --2- 172.21.15.77:0/536856098 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560a05d4b850 0x560a05d1e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.685+0000 7f54775df740 1 -- 172.21.15.77:0/536856098 >> 172.21.15.77:0/536856098 conn(0x560a05d20a60 msgr2=0x560a05d695e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:08.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.685+0000 7f54775df740 1 -- 172.21.15.77:0/536856098 shutdown_connections 2023-11-04T01:45:08.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.685+0000 7f54775df740 1 -- 172.21.15.77:0/536856098 wait complete. 2023-11-04T01:45:08.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.685+0000 7f54775df740 1 -- start start 2023-11-04T01:45:08.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.685+0000 7f54775df740 1 Processor -- start 2023-11-04T01:45:08.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.686+0000 7f54775df740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a05d4b850 0x560a05d4d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.686+0000 7f54775df740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a05d4bc30 0x560a05d444a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.686+0000 7f54775df740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560a05d4d550 0x560a05d449e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.686+0000 7f54775df740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a05c8a8b0 con 0x560a05d4b850 2023-11-04T01:45:08.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.686+0000 7f54775df740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a05c44c80 con 0x560a05d4bc30 2023-11-04T01:45:08.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.686+0000 7f54775df740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x560a05c44920 con 0x560a05d4d550 2023-11-04T01:45:08.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.686+0000 7f54775df740 10 client.0 _ll_register_callbacks cb 0x560a0599cac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:45:08.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.686+0000 7f546e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a05d4b850 0x560a05d4d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.686+0000 7f546e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a05d4b850 0x560a05d4d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40882/0 (socket says 172.21.15.77:40882) 2023-11-04T01:45:08.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.686+0000 7f546e59c640 1 -- 172.21.15.77:0/2985963690 learned_addr learned my addr 172.21.15.77:0/2985963690 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:08.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.687+0000 7f546ed9d640 1 --2- 172.21.15.77:0/2985963690 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560a05d4d550 0x560a05d449e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.687+0000 7f5465d9b640 1 --2- 172.21.15.77:0/2985963690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a05d4bc30 0x560a05d444a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.687+0000 7f546e59c640 1 -- 172.21.15.77:0/2985963690 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560a05d4d550 msgr2=0x560a05d449e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:08.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.687+0000 7f546e59c640 1 --2- 172.21.15.77:0/2985963690 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560a05d4d550 0x560a05d449e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.687+0000 7f546e59c640 1 -- 172.21.15.77:0/2985963690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a05d4bc30 msgr2=0x560a05d444a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:08.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.687+0000 7f546e59c640 1 --2- 172.21.15.77:0/2985963690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a05d4bc30 0x560a05d444a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.687+0000 7f546e59c640 1 -- 172.21.15.77:0/2985963690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54700cde10 con 0x560a05d4b850 2023-11-04T01:45:08.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.687+0000 7f546e59c640 1 --2- 172.21.15.77:0/2985963690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a05d4b850 0x560a05d4d010 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f546000ef00 tx=0x7f5460003760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61161cdc612a976c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:08.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.687+0000 7f544d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:45:08.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.687+0000 7f544d7fa640 1 -- 172.21.15.77:0/2985963690 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5460015e40 con 0x560a05d4b850 2023-11-04T01:45:08.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.687+0000 7f544d7fa640 1 -- 172.21.15.77:0/2985963690 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f5460021600 con 0x560a05d4b850 2023-11-04T01:45:08.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.687+0000 7f54775df740 1 -- 172.21.15.77:0/2985963690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560a05c36bf0 con 0x560a05d4b850 2023-11-04T01:45:08.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.687+0000 7f544d7fa640 1 -- 172.21.15.77:0/2985963690 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5460021800 con 0x560a05d4b850 2023-11-04T01:45:08.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.687+0000 7f54775df740 10 client.7914 fetch_fsmap learned FSMap version 72 2023-11-04T01:45:08.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.687+0000 7f54775df740 1 -- 172.21.15.77:0/2985963690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x560a05c88f30 con 0x560a05d4b850 2023-11-04T01:45:08.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.687+0000 7f544d7fa640 1 -- 172.21.15.77:0/2985963690 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560a05c36bf0 con 0x560a05d4b850 2023-11-04T01:45:08.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.687+0000 7f544d7fa640 1 -- 172.21.15.77:0/2985963690 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 72) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f5460030050 con 0x560a05d4b850 2023-11-04T01:45:08.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.687+0000 7f54775df740 10 client.7914 fetch_fsmap finished waiting for FSMap version 72 2023-11-04T01:45:08.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.687+0000 7f54775df740 10 client.7914 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:45:08.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.687+0000 7f54775df740 20 client.7914 populate_metadata read hostname 'smithi077' 2023-11-04T01:45:08.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.687+0000 7f54775df740 1 --2- 172.21.15.77:0/2985963690 >> [v2:172.21.15.77:6832/285184758,v1:172.21.15.77:6834/285184758] conn(0x560a05d84b70 0x560a05d86f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.687+0000 7f54775df740 4 client.7914 mds_command: new command op to 7743 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:45:08.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.687+0000 7f54775df740 1 -- 172.21.15.77:0/2985963690 --> [v2:172.21.15.77:6832/285184758,v1:172.21.15.77:6834/285184758] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560a05c83890 con 0x560a05d84b70 2023-11-04T01:45:08.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.687+0000 7f5465d9b640 1 --2- 172.21.15.77:0/2985963690 >> [v2:172.21.15.77:6832/285184758,v1:172.21.15.77:6834/285184758] conn(0x560a05d84b70 0x560a05d86f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.688+0000 7f5465d9b640 1 --2- 172.21.15.77:0/2985963690 >> [v2:172.21.15.77:6832/285184758,v1:172.21.15.77:6834/285184758] conn(0x560a05d84b70 0x560a05d86f60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45d595d67b6b61bc server_cookie=6ddd8dfea1b60001 in_seq=0 out_seq=0 2023-11-04T01:45:08.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.688+0000 7f544d7fa640 10 client.7914 ms_handle_connect on v2:172.21.15.77:6832/285184758 2023-11-04T01:45:08.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.688+0000 7f544d7fa640 1 -- 172.21.15.77:0/2985963690 <== mds.0 v2:172.21.15.77:6832/285184758 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560a05c83890 con 0x560a05d84b70 2023-11-04T01:45:08.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.688+0000 7f544d7fa640 10 client.7914 handle_command_reply: tid=0 2023-11-04T01:45:08.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.688+0000 7f54775df740 1 client.7914 shutdown 2023-11-04T01:45:08.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.688+0000 7f54775df740 1 -- 172.21.15.77:0/2985963690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a05d4b850 msgr2=0x560a05d4d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:08.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.688+0000 7f54775df740 1 --2- 172.21.15.77:0/2985963690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a05d4b850 0x560a05d4d010 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f546000ef00 tx=0x7f5460003760 comp rx=0 tx=0).stop 2023-11-04T01:45:08.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.689+0000 7f54775df740 1 -- 172.21.15.77:0/2985963690 shutdown_connections 2023-11-04T01:45:08.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.689+0000 7f54775df740 1 --2- 172.21.15.77:0/2985963690 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560a05d4d550 0x560a05d449e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.689+0000 7f54775df740 1 --2- 172.21.15.77:0/2985963690 >> [v2:172.21.15.77:6832/285184758,v1:172.21.15.77:6834/285184758] conn(0x560a05d84b70 0x560a05d86f60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.689+0000 7f54775df740 1 --2- 172.21.15.77:0/2985963690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a05d4bc30 0x560a05d444a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.689+0000 7f544d7fa640 0 client.7914 ms_handle_reset on v2:172.21.15.77:6832/285184758 2023-11-04T01:45:08.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.689+0000 7f54775df740 1 --2- 172.21.15.77:0/2985963690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a05d4b850 0x560a05d4d010 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.689+0000 7f54775df740 1 -- 172.21.15.77:0/2985963690 >> 172.21.15.77:0/2985963690 conn(0x560a05d1ec90 msgr2=0x560a05d6d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:08.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.689+0000 7f54775df740 1 -- 172.21.15.77:0/2985963690 shutdown_connections 2023-11-04T01:45:08.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.689+0000 7f54775df740 1 -- 172.21.15.77:0/2985963690 wait complete. 2023-11-04T01:45:08.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.689+0000 7f54775df740 20 client.7914 trim_cache size 0 max 16384 2023-11-04T01:45:08.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.704+0000 7f54775df740 1 Processor -- start 2023-11-04T01:45:08.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.704+0000 7f54775df740 1 -- start start 2023-11-04T01:45:08.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.705+0000 7f54775df740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a05d4b850 0x560a05d444b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.705+0000 7f54775df740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a05d4bc30 0x560a05d449f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.705+0000 7f54775df740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560a05d4d550 0x560a05d4c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.705+0000 7f54775df740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a05c0a280 con 0x560a05d4bc30 2023-11-04T01:45:08.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.705+0000 7f54775df740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a05d46330 con 0x560a05d4b850 2023-11-04T01:45:08.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.705+0000 7f54775df740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x560a05d44f30 con 0x560a05d4d550 2023-11-04T01:45:08.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.705+0000 7f5465d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a05d4bc30 0x560a05d449f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.705+0000 7f5465d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a05d4bc30 0x560a05d449f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40888/0 (socket says 172.21.15.77:40888) 2023-11-04T01:45:08.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.705+0000 7f5465d9b640 1 -- 172.21.15.77:0/2051781391 learned_addr learned my addr 172.21.15.77:0/2051781391 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:08.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.705+0000 7f546e59c640 1 --2- 172.21.15.77:0/2051781391 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a05d4b850 0x560a05d444b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.705+0000 7f546ed9d640 1 --2- 172.21.15.77:0/2051781391 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560a05d4d550 0x560a05d4c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.705+0000 7f5465d9b640 1 -- 172.21.15.77:0/2051781391 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560a05d4d550 msgr2=0x560a05d4c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:08.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.705+0000 7f5465d9b640 1 --2- 172.21.15.77:0/2051781391 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560a05d4d550 0x560a05d4c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.705+0000 7f5465d9b640 1 -- 172.21.15.77:0/2051781391 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a05d4b850 msgr2=0x560a05d444b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:08.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.705+0000 7f5465d9b640 1 --2- 172.21.15.77:0/2051781391 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a05d4b850 0x560a05d444b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.705+0000 7f5465d9b640 1 -- 172.21.15.77:0/2051781391 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a05c26d10 con 0x560a05d4bc30 2023-11-04T01:45:08.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.705+0000 7f546e59c640 1 --2- 172.21.15.77:0/2051781391 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a05d4b850 0x560a05d444b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:08.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.705+0000 7f5465d9b640 1 --2- 172.21.15.77:0/2051781391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a05d4bc30 0x560a05d449f0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f545800cfd0 tx=0x7f545801c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1423f8843ac4c09 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:08.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.705+0000 7f5464d99640 1 -- 172.21.15.77:0/2051781391 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5458087ce0 con 0x560a05d4bc30 2023-11-04T01:45:08.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.705+0000 7f5464d99640 1 -- 172.21.15.77:0/2051781391 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5458056840 con 0x560a05d4bc30 2023-11-04T01:45:08.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.705+0000 7f5464d99640 1 -- 172.21.15.77:0/2051781391 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5458060310 con 0x560a05d4bc30 2023-11-04T01:45:08.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.706+0000 7f54775df740 1 -- 172.21.15.77:0/2051781391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a05d4bc30 msgr2=0x560a05d449f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:08.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.706+0000 7f54775df740 1 --2- 172.21.15.77:0/2051781391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a05d4bc30 0x560a05d449f0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f545800cfd0 tx=0x7f545801c040 comp rx=0 tx=0).stop 2023-11-04T01:45:08.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.706+0000 7f54775df740 1 -- 172.21.15.77:0/2051781391 shutdown_connections 2023-11-04T01:45:08.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.706+0000 7f54775df740 1 --2- 172.21.15.77:0/2051781391 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560a05d4d550 0x560a05d4c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.706+0000 7f54775df740 1 --2- 172.21.15.77:0/2051781391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a05d4bc30 0x560a05d449f0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.706+0000 7f54775df740 1 --2- 172.21.15.77:0/2051781391 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a05d4b850 0x560a05d444b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.706+0000 7f54775df740 1 -- 172.21.15.77:0/2051781391 >> 172.21.15.77:0/2051781391 conn(0x560a05d1ec90 msgr2=0x560a05d4e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:08.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.706+0000 7f54775df740 1 -- 172.21.15.77:0/2051781391 shutdown_connections 2023-11-04T01:45:08.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.706+0000 7f54775df740 1 -- 172.21.15.77:0/2051781391 wait complete. 2023-11-04T01:45:08.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.707+0000 7f54775df740 1 -- start start 2023-11-04T01:45:08.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.707+0000 7f54775df740 1 Processor -- start 2023-11-04T01:45:08.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.707+0000 7f54775df740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a05d4b850 0x560a05d42320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.707+0000 7f54775df740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a05d4bc30 0x560a05d42860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.707+0000 7f54775df740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560a05d4d550 0x560a05d4ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.707+0000 7f54775df740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a05dd4750 con 0x560a05d4b850 2023-11-04T01:45:08.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.707+0000 7f54775df740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a05d43990 con 0x560a05d4bc30 2023-11-04T01:45:08.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.707+0000 7f54775df740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x560a05d4aaa0 con 0x560a05d4d550 2023-11-04T01:45:08.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.708+0000 7f54775df740 10 client.0 _ll_register_callbacks cb 0x7f5468009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:45:08.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.708+0000 7f546e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a05d4b850 0x560a05d42320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.708+0000 7f546e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a05d4b850 0x560a05d42320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40898/0 (socket says 172.21.15.77:40898) 2023-11-04T01:45:08.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.708+0000 7f546e59c640 1 -- 172.21.15.77:0/3144507115 learned_addr learned my addr 172.21.15.77:0/3144507115 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:08.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.708+0000 7f546ed9d640 1 --2- 172.21.15.77:0/3144507115 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560a05d4d550 0x560a05d4ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.708+0000 7f5465d9b640 1 --2- 172.21.15.77:0/3144507115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a05d4bc30 0x560a05d42860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.708+0000 7f546e59c640 1 -- 172.21.15.77:0/3144507115 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560a05d4d550 msgr2=0x560a05d4ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:08.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.708+0000 7f546e59c640 1 --2- 172.21.15.77:0/3144507115 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560a05d4d550 0x560a05d4ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.708+0000 7f546e59c640 1 -- 172.21.15.77:0/3144507115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a05d4bc30 msgr2=0x560a05d42860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:08.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.708+0000 7f546e59c640 1 --2- 172.21.15.77:0/3144507115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a05d4bc30 0x560a05d42860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.708+0000 7f546e59c640 1 -- 172.21.15.77:0/3144507115 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f547015e820 con 0x560a05d4b850 2023-11-04T01:45:08.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.708+0000 7f546e59c640 1 --2- 172.21.15.77:0/3144507115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a05d4b850 0x560a05d42320 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f5460007b20 tx=0x7f5460015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e31f57aeb33801 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:08.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.708+0000 7f544d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:45:08.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.708+0000 7f544d7fa640 1 -- 172.21.15.77:0/3144507115 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5460005420 con 0x560a05d4b850 2023-11-04T01:45:08.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.708+0000 7f544d7fa640 1 -- 172.21.15.77:0/3144507115 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f5460032a90 con 0x560a05d4b850 2023-11-04T01:45:08.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.708+0000 7f54775df740 1 -- 172.21.15.77:0/3144507115 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f546803e7b0 con 0x560a05d4b850 2023-11-04T01:45:08.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.708+0000 7f544d7fa640 1 -- 172.21.15.77:0/3144507115 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5460021a00 con 0x560a05d4b850 2023-11-04T01:45:08.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.708+0000 7f54775df740 10 client.7920 fetch_fsmap learned FSMap version 72 2023-11-04T01:45:08.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.708+0000 7f54775df740 1 -- 172.21.15.77:0/3144507115 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x560a05c4c500 con 0x560a05d4b850 2023-11-04T01:45:08.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.709+0000 7f544d7fa640 1 -- 172.21.15.77:0/3144507115 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546803e7b0 con 0x560a05d4b850 2023-11-04T01:45:08.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.709+0000 7f544d7fa640 1 -- 172.21.15.77:0/3144507115 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 72) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f5460030040 con 0x560a05d4b850 2023-11-04T01:45:08.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.709+0000 7f54775df740 10 client.7920 fetch_fsmap finished waiting for FSMap version 72 2023-11-04T01:45:08.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.709+0000 7f54775df740 10 client.7920 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:45:08.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.709+0000 7f54775df740 20 client.7920 populate_metadata read hostname 'smithi077' 2023-11-04T01:45:08.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.709+0000 7f54775df740 1 --2- 172.21.15.77:0/3144507115 >> [v2:172.21.15.77:6832/285184758,v1:172.21.15.77:6834/285184758] conn(0x560a05d4cf40 0x560a05d827b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.709+0000 7f54775df740 4 client.7920 mds_command: new command op to 7743 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:45:08.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.709+0000 7f54775df740 1 -- 172.21.15.77:0/3144507115 --> [v2:172.21.15.77:6832/285184758,v1:172.21.15.77:6834/285184758] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560a05c835b0 con 0x560a05d4cf40 2023-11-04T01:45:08.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.709+0000 7f5465d9b640 1 --2- 172.21.15.77:0/3144507115 >> [v2:172.21.15.77:6832/285184758,v1:172.21.15.77:6834/285184758] conn(0x560a05d4cf40 0x560a05d827b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.709+0000 7f544d7fa640 10 client.7920 ms_handle_connect on v2:172.21.15.77:6832/285184758 2023-11-04T01:45:08.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.709+0000 7f5465d9b640 1 --2- 172.21.15.77:0/3144507115 >> [v2:172.21.15.77:6832/285184758,v1:172.21.15.77:6834/285184758] conn(0x560a05d4cf40 0x560a05d827b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e4a55312b1710a9 server_cookie=f1f0dc703070d2ae in_seq=0 out_seq=0 2023-11-04T01:45:08.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.709+0000 7f544d7fa640 1 -- 172.21.15.77:0/3144507115 <== mds.0 v2:172.21.15.77:6832/285184758 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x560a05c835b0 con 0x560a05d4cf40 2023-11-04T01:45:08.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.709+0000 7f544d7fa640 10 client.7920 handle_command_reply: tid=0 2023-11-04T01:45:08.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.709+0000 7f54775df740 1 client.7920 shutdown 2023-11-04T01:45:08.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.709+0000 7f54775df740 1 -- 172.21.15.77:0/3144507115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a05d4b850 msgr2=0x560a05d42320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:08.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.709+0000 7f54775df740 1 --2- 172.21.15.77:0/3144507115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a05d4b850 0x560a05d42320 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f5460007b20 tx=0x7f5460015000 comp rx=0 tx=0).stop 2023-11-04T01:45:08.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.709+0000 7f54775df740 1 -- 172.21.15.77:0/3144507115 shutdown_connections 2023-11-04T01:45:08.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.709+0000 7f54775df740 1 --2- 172.21.15.77:0/3144507115 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x560a05d4d550 0x560a05d4ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.709+0000 7f54775df740 1 --2- 172.21.15.77:0/3144507115 >> [v2:172.21.15.77:6832/285184758,v1:172.21.15.77:6834/285184758] conn(0x560a05d4cf40 0x560a05d827b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.709+0000 7f54775df740 1 --2- 172.21.15.77:0/3144507115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560a05d4bc30 0x560a05d42860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.709+0000 7f54775df740 1 --2- 172.21.15.77:0/3144507115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560a05d4b850 0x560a05d42320 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.709+0000 7f544d7fa640 0 client.7920 ms_handle_reset on v2:172.21.15.77:6832/285184758 2023-11-04T01:45:08.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.709+0000 7f54775df740 1 -- 172.21.15.77:0/3144507115 >> 172.21.15.77:0/3144507115 conn(0x560a05d1ec90 msgr2=0x560a05d444b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:08.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.709+0000 7f54775df740 1 -- 172.21.15.77:0/3144507115 shutdown_connections 2023-11-04T01:45:08.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.709+0000 7f54775df740 1 -- 172.21.15.77:0/3144507115 wait complete. 2023-11-04T01:45:08.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.710+0000 7f54775df740 20 client.7920 trim_cache size 0 max 16384 2023-11-04T01:45:08.740 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-04T01:45:08.740 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "0c22c75d-0169-41ef-b663-6ac1c5b0f71f", 2023-11-04T01:45:08.741 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 0, 2023-11-04T01:45:08.741 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 7743, 2023-11-04T01:45:08.741 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2023-11-04T01:45:08.741 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2023-11-04T01:45:08.741 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2023-11-04T01:45:08.742 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 6.7214666789999997, 2023-11-04T01:45:08.742 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 72, 2023-11-04T01:45:08.742 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 101, 2023-11-04T01:45:08.742 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 101, 2023-11-04T01:45:08.743 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 31.803045301000001 2023-11-04T01:45:08.743 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-04T01:45:08.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.710+0000 7f5474a56640 1 -- 172.21.15.77:0/3967096120 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f545006aea0 msgr2=0x7f545006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:08.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.710+0000 7f5474a56640 1 --2- 172.21.15.77:0/3967096120 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f545006aea0 0x7f545006d360 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f5460004ea0 tx=0x7f5460009040 comp rx=0 tx=0).stop 2023-11-04T01:45:08.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.710+0000 7f5474a56640 1 -- 172.21.15.77:0/3967096120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5470070ff0 msgr2=0x7f54700c3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:08.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.710+0000 7f5474a56640 1 --2- 172.21.15.77:0/3967096120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5470070ff0 0x7f54700c3660 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f545800c820 tx=0x7f545800cc20 comp rx=0 tx=0).stop 2023-11-04T01:45:08.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.710+0000 7f5474a56640 1 -- 172.21.15.77:0/3967096120 shutdown_connections 2023-11-04T01:45:08.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.710+0000 7f5474a56640 1 --2- 172.21.15.77:0/3967096120 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f545006aea0 0x7f545006d360 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.710+0000 7f5474a56640 1 --2- 172.21.15.77:0/3967096120 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f547015d1b0 0x7f54701516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.710+0000 7f5474a56640 1 --2- 172.21.15.77:0/3967096120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5470070ff0 0x7f54700c3660 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.710+0000 7f5474a56640 1 --2- 172.21.15.77:0/3967096120 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5470066000 0x7f547006ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.710+0000 7f5474a56640 1 -- 172.21.15.77:0/3967096120 >> 172.21.15.77:0/3967096120 conn(0x7f54700cbc90 msgr2=0x7f54700ca670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:08.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.710+0000 7f5474a56640 1 -- 172.21.15.77:0/3967096120 shutdown_connections 2023-11-04T01:45:08.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.710+0000 7f5474a56640 1 -- 172.21.15.77:0/3967096120 wait complete. 2023-11-04T01:45:08.747 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:08.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.845+0000 7f550597c640 1 Processor -- start 2023-11-04T01:45:08.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.845+0000 7f550597c640 1 -- start start 2023-11-04T01:45:08.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.846+0000 7f550597c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f550015bfb0 0x7f55000cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.846+0000 7f550597c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55000cd860 0x7f55000ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.846+0000 7f550597c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55000cc450 con 0x7f550015ae40 2023-11-04T01:45:08.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.846+0000 7f550597c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f550015f400 con 0x7f550015bfb0 2023-11-04T01:45:08.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.846+0000 7f550597c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f550015b220 con 0x7f55000cd860 2023-11-04T01:45:08.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.846+0000 7f54feffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f550015ae40 0x7f55000cbc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:48508/0 (socket says 172.21.15.77:48508) 2023-11-04T01:45:08.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.846+0000 7f54feffd640 1 -- 172.21.15.77:0/3148705592 learned_addr learned my addr 172.21.15.77:0/3148705592 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:45:08.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.846+0000 7f54fdffb640 1 -- 172.21.15.77:0/3148705592 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2012257776 0 0) 0x7f54f0001110 con 0x7f550015ae40 2023-11-04T01:45:08.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.846+0000 7f54fdffb640 1 -- 172.21.15.77:0/3148705592 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54e8003520 con 0x7f550015ae40 2023-11-04T01:45:08.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.846+0000 7f54fe7fc640 1 --2- 172.21.15.77:0/3148705592 >> v2:172.21.15.122:3300/0 conn(0x7f550015bfb0 0x7f55000cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.846+0000 7f54ff7fe640 1 --2- 172.21.15.77:0/3148705592 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55000cd860 0x7f55000ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.847+0000 7f54fdffb640 1 -- 172.21.15.77:0/3148705592 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 475955963 0 0) 0x7f54e8003520 con 0x7f550015ae40 2023-11-04T01:45:08.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.847+0000 7f54fdffb640 1 -- 172.21.15.77:0/3148705592 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55000cd860 msgr2=0x7f55000ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:08.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.847+0000 7f54fdffb640 1 --2- 172.21.15.77:0/3148705592 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55000cd860 0x7f55000ced70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.847+0000 7f54fdffb640 1 -- 172.21.15.77:0/3148705592 >> v2:172.21.15.122:3300/0 conn(0x7f550015bfb0 msgr2=0x7f55000cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:08.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.847+0000 7f54fdffb640 1 --2- 172.21.15.77:0/3148705592 >> v2:172.21.15.122:3300/0 conn(0x7f550015bfb0 0x7f55000cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.847+0000 7f54fdffb640 1 -- 172.21.15.77:0/3148705592 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550015f890 con 0x7f550015ae40 2023-11-04T01:45:08.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.847+0000 7f54fdffb640 1 -- 172.21.15.77:0/3148705592 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f54f0001800 con 0x7f550015ae40 2023-11-04T01:45:08.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.847+0000 7f54fdffb640 1 -- 172.21.15.77:0/3148705592 >> v1:172.21.15.77:6789/0 conn(0x7f550015ae40 legacy=0x7f55000cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:08.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.847+0000 7f54fdffb640 1 --2- 172.21.15.77:0/3148705592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54e8003970 0x7f54e8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.847+0000 7f54fdffb640 1 --2- 172.21.15.77:0/3148705592 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55000cd860 0x7f54e80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.847+0000 7f54fdffb640 1 --2- 172.21.15.77:0/3148705592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54e8004d00 0x7f54e8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.847+0000 7f54fdffb640 1 -- 172.21.15.77:0/3148705592 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550015f400 con 0x7f54e8003970 2023-11-04T01:45:08.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.847+0000 7f54fdffb640 1 -- 172.21.15.77:0/3148705592 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550015b220 con 0x7f54e8004d00 2023-11-04T01:45:08.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.847+0000 7f54fdffb640 1 -- 172.21.15.77:0/3148705592 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e800ba30 con 0x7f55000cd860 2023-11-04T01:45:08.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.847+0000 7f54feffd640 1 --2- 172.21.15.77:0/3148705592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54e8003970 0x7f54e8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.847+0000 7f54fe7fc640 1 --2- 172.21.15.77:0/3148705592 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55000cd860 0x7f54e80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.847+0000 7f54ff7fe640 1 --2- 172.21.15.77:0/3148705592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54e8004d00 0x7f54e8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.847+0000 7f54feffd640 1 -- 172.21.15.77:0/3148705592 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55000cd860 msgr2=0x7f54e80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:08.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.847+0000 7f54feffd640 1 --2- 172.21.15.77:0/3148705592 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55000cd860 0x7f54e80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.847+0000 7f54feffd640 1 -- 172.21.15.77:0/3148705592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54e8004d00 msgr2=0x7f54e8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:08.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.847+0000 7f54feffd640 1 --2- 172.21.15.77:0/3148705592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54e8004d00 0x7f54e8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.847+0000 7f54feffd640 1 -- 172.21.15.77:0/3148705592 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e8003520 con 0x7f54e8003970 2023-11-04T01:45:08.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.847+0000 7f54fe7fc640 1 --2- 172.21.15.77:0/3148705592 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55000cd860 0x7f54e80047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:08.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.847+0000 7f54ff7fe640 1 --2- 172.21.15.77:0/3148705592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54e8004d00 0x7f54e8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:08.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.848+0000 7f54feffd640 1 --2- 172.21.15.77:0/3148705592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54e8003970 0x7f54e8003d90 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f54f000c240 tx=0x7f54e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa4f79a5863cad3b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:08.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.848+0000 7f54fdffb640 1 -- 172.21.15.77:0/3148705592 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f0005ad0 con 0x7f54e8003970 2023-11-04T01:45:08.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.848+0000 7f54fdffb640 1 -- 172.21.15.77:0/3148705592 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f0005c30 con 0x7f54e8003970 2023-11-04T01:45:08.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.848+0000 7f54fdffb640 1 -- 172.21.15.77:0/3148705592 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f002c8b0 con 0x7f54e8003970 2023-11-04T01:45:08.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.848+0000 7f550597c640 1 -- 172.21.15.77:0/3148705592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54e8003970 msgr2=0x7f54e8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:08.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.848+0000 7f550597c640 1 --2- 172.21.15.77:0/3148705592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54e8003970 0x7f54e8003d90 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f54f000c240 tx=0x7f54e80057f0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.848+0000 7f54ff7fe640 1 -- 172.21.15.77:0/3148705592 reap_dead start 2023-11-04T01:45:08.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.848+0000 7f550597c640 1 -- 172.21.15.77:0/3148705592 shutdown_connections 2023-11-04T01:45:08.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.849+0000 7f550597c640 1 -- 172.21.15.77:0/3148705592 >> 172.21.15.77:0/3148705592 conn(0x7f550006ea90 msgr2=0x7f550006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:08.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.849+0000 7f550597c640 1 -- 172.21.15.77:0/3148705592 shutdown_connections 2023-11-04T01:45:08.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.849+0000 7f550597c640 1 -- 172.21.15.77:0/3148705592 wait complete. 2023-11-04T01:45:08.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.850+0000 7f550597c640 1 Processor -- start 2023-11-04T01:45:08.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.850+0000 7f550597c640 1 -- start start 2023-11-04T01:45:08.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.851+0000 7f550597c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54e8003970 0x7f55000ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.851+0000 7f550597c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55001f18e0 0x7f55000c3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.851+0000 7f550597c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55000c52b0 0x7f55000c61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.851+0000 7f550597c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55000caad0 con 0x7f54e8003970 2023-11-04T01:45:08.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.851+0000 7f550597c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55000c44f0 con 0x7f55000c52b0 2023-11-04T01:45:08.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.851+0000 7f550597c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55000c47d0 con 0x7f55001f18e0 2023-11-04T01:45:08.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.851+0000 7f54feffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54e8003970 0x7f55000ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.851+0000 7f54feffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54e8003970 0x7f55000ca4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40914/0 (socket says 172.21.15.77:40914) 2023-11-04T01:45:08.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.851+0000 7f54feffd640 1 -- 172.21.15.77:0/1636357477 learned_addr learned my addr 172.21.15.77:0/1636357477 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:08.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.851+0000 7f54feffd640 1 -- 172.21.15.77:0/1636357477 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55001f18e0 msgr2=0x7f55000c3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:08.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.851+0000 7f54feffd640 1 --2- 172.21.15.77:0/1636357477 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55001f18e0 0x7f55000c3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.851+0000 7f54feffd640 1 -- 172.21.15.77:0/1636357477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55000c52b0 msgr2=0x7f55000c61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:08.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.851+0000 7f54feffd640 1 --2- 172.21.15.77:0/1636357477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55000c52b0 0x7f55000c61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.851+0000 7f54feffd640 1 -- 172.21.15.77:0/1636357477 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55000c4ab0 con 0x7f54e8003970 2023-11-04T01:45:08.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.851+0000 7f54feffd640 1 --2- 172.21.15.77:0/1636357477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54e8003970 0x7f55000ca4f0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f54f000c360 tx=0x7f550015f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:08.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.851+0000 7f54e7fff640 1 -- 172.21.15.77:0/1636357477 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f002ccc0 con 0x7f54e8003970 2023-11-04T01:45:08.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.851+0000 7f54e7fff640 1 -- 172.21.15.77:0/1636357477 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f0001170 con 0x7f54e8003970 2023-11-04T01:45:08.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.851+0000 7f550597c640 1 -- 172.21.15.77:0/1636357477 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55000c4d90 con 0x7f54e8003970 2023-11-04T01:45:08.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.851+0000 7f54e7fff640 1 -- 172.21.15.77:0/1636357477 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f0007270 con 0x7f54e8003970 2023-11-04T01:45:08.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.851+0000 7f550597c640 1 -- 172.21.15.77:0/1636357477 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55000c3bc0 con 0x7f54e8003970 2023-11-04T01:45:08.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.852+0000 7f550597c640 1 -- 172.21.15.77:0/1636357477 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55000ce2d0 con 0x7f54e8003970 2023-11-04T01:45:08.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.853+0000 7f54e7fff640 1 -- 172.21.15.77:0/1636357477 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f54f0032070 con 0x7f54e8003970 2023-11-04T01:45:08.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.853+0000 7f54e7fff640 1 --2- 172.21.15.77:0/1636357477 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f54ec06aea0 0x7f54ec06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.853+0000 7f54e7fff640 1 -- 172.21.15.77:0/1636357477 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f54f003c040 con 0x7f54e8003970 2023-11-04T01:45:08.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.853+0000 7f54fe7fc640 1 --2- 172.21.15.77:0/1636357477 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f54ec06aea0 0x7f54ec06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.854+0000 7f54fe7fc640 1 --2- 172.21.15.77:0/1636357477 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f54ec06aea0 0x7f54ec06d360 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f54f4006d40 tx=0x7f54f4006bd0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:08.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:08.857+0000 7f54e7fff640 1 -- 172.21.15.77:0/1636357477 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f54f00ddca0 con 0x7f54e8003970 2023-11-04T01:45:09.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.059+0000 7f550597c640 1 -- 172.21.15.77:0/1636357477 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f55000cc450 con 0x7f54e8003970 2023-11-04T01:45:09.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.059+0000 7f54e7fff640 1 -- 172.21.15.77:0/1636357477 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f55000cc450 con 0x7f54e8003970 2023-11-04T01:45:09.061 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:09.062 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":72,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/1345816612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1345816612},{"type":"v1","addr":"172.21.15.122:6836","nonce":1345816612}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:45:04.999768+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7743,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7743":{"gid":7743,"name":"a","rank":0,"incarnation":68,"state":"up:active","state_seq":11,"addr":"172.21.15.77:6834/285184758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":285184758},{"type":"v1","addr":"172.21.15.77:6834","nonce":285184758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:09.062 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 72 2023-11-04T01:45:09.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.061+0000 7f550597c640 1 -- 172.21.15.77:0/1636357477 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f54ec06aea0 msgr2=0x7f54ec06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.061+0000 7f550597c640 1 --2- 172.21.15.77:0/1636357477 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f54ec06aea0 0x7f54ec06d360 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f54f4006d40 tx=0x7f54f4006bd0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.061+0000 7f550597c640 1 -- 172.21.15.77:0/1636357477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54e8003970 msgr2=0x7f55000ca4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.061+0000 7f550597c640 1 --2- 172.21.15.77:0/1636357477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54e8003970 0x7f55000ca4f0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f54f000c360 tx=0x7f550015f370 comp rx=0 tx=0).stop 2023-11-04T01:45:09.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.061+0000 7f550597c640 1 -- 172.21.15.77:0/1636357477 shutdown_connections 2023-11-04T01:45:09.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.061+0000 7f550597c640 1 --2- 172.21.15.77:0/1636357477 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f54ec06aea0 0x7f54ec06d360 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.061+0000 7f550597c640 1 --2- 172.21.15.77:0/1636357477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f55000c52b0 0x7f55000c61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.061+0000 7f550597c640 1 --2- 172.21.15.77:0/1636357477 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f55001f18e0 0x7f55000c3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.061+0000 7f550597c640 1 --2- 172.21.15.77:0/1636357477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54e8003970 0x7f55000ca4f0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.061+0000 7f550597c640 1 -- 172.21.15.77:0/1636357477 >> 172.21.15.77:0/1636357477 conn(0x7f550006ea90 msgr2=0x7f55000d01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:09.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.061+0000 7f550597c640 1 -- 172.21.15.77:0/1636357477 shutdown_connections 2023-11-04T01:45:09.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.061+0000 7f550597c640 1 -- 172.21.15.77:0/1636357477 wait complete. 2023-11-04T01:45:09.073 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump snaps --server 2023-11-04T01:45:09.185 INFO:teuthology.orchestra.run.smithi077.stdout:{"last_snap":4,"last_created":4,"last_destroyed":1,"pending_noop":[],"snaps":[{"snapid":2,"ino":1099511627777,"stamp":"2023-11-04T01:43:48.909834+0000","name":"s11","metadata":{}},{"snapid":3,"ino":1099511627777,"stamp":"2023-11-04T01:44:19.755300+0000","name":"s12","metadata":{}},{"snapid":4,"ino":1099511627777,"stamp":"2023-11-04T01:44:45.010974+0000","name":"s15","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:45:09.186 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 4, "last_destroyed": 1, "last_snap": 4, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s11", "snapid": 2, "stamp": "2023-11-04T01:43:48.909834+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s12", "snapid": 3, "stamp": "2023-11-04T01:44:19.755300+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s15", "snapid": 4, "stamp": "2023-11-04T01:44:45.010974+0000" } ] } 2023-11-04T01:45:09.186 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-04T01:45:09.187 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=6 2023-11-04T01:45:09.187 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:09.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.284+0000 7fcae1539640 1 Processor -- start 2023-11-04T01:45:09.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.284+0000 7fcae1539640 1 -- start start 2023-11-04T01:45:09.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.285+0000 7fcae1539640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcadc0cde60 0x7fcadc15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.285+0000 7fcae1539640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fcadc0ce240 0x7fcadc0d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.285+0000 7fcae1539640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcadc15e000 con 0x7fcadc15daa0 2023-11-04T01:45:09.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.285+0000 7fcae1539640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcadc15e5c0 con 0x7fcadc0cde60 2023-11-04T01:45:09.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.285+0000 7fcae1539640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcadc15e2e0 con 0x7fcadc0ce240 2023-11-04T01:45:09.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.285+0000 7fcadaffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcadc0cde60 0x7fcadc15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.285+0000 7fcada7fc640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fcadc15daa0 0x7fcadc157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:48512/0 (socket says 172.21.15.77:48512) 2023-11-04T01:45:09.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.285+0000 7fcada7fc640 1 -- 172.21.15.77:0/94424972 learned_addr learned my addr 172.21.15.77:0/94424972 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:45:09.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.285+0000 7fcadb7fe640 1 --2- 172.21.15.77:0/94424972 >> v2:172.21.15.122:3300/0 conn(0x7fcadc0ce240 0x7fcadc0d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.285+0000 7fcadaffd640 1 -- 172.21.15.77:0/94424972 >> v2:172.21.15.122:3300/0 conn(0x7fcadc0ce240 msgr2=0x7fcadc0d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:09.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.285+0000 7fcadaffd640 1 --2- 172.21.15.77:0/94424972 >> v2:172.21.15.122:3300/0 conn(0x7fcadc0ce240 0x7fcadc0d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.285+0000 7fcadaffd640 1 -- 172.21.15.77:0/94424972 >> v1:172.21.15.77:6789/0 conn(0x7fcadc15daa0 legacy=0x7fcadc157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.285+0000 7fcadaffd640 1 -- 172.21.15.77:0/94424972 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcadc0d1120 con 0x7fcadc0cde60 2023-11-04T01:45:09.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.285+0000 7fcad9ffb640 1 -- 172.21.15.77:0/94424972 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1099826548 0 0) 0x7fcadc15e000 con 0x7fcadc15daa0 2023-11-04T01:45:09.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.286+0000 7fcadaffd640 1 --2- 172.21.15.77:0/94424972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcadc0cde60 0x7fcadc15d560 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fcadc0cf2e0 tx=0x7fcacc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1e90f5db03f13cd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:09.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.286+0000 7fcad9ffb640 1 -- 172.21.15.77:0/94424972 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc02cc80 con 0x7fcadc0cde60 2023-11-04T01:45:09.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.286+0000 7fcad9ffb640 1 -- 172.21.15.77:0/94424972 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcacc02cde0 con 0x7fcadc0cde60 2023-11-04T01:45:09.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.286+0000 7fcad9ffb640 1 -- 172.21.15.77:0/94424972 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc034660 con 0x7fcadc0cde60 2023-11-04T01:45:09.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.286+0000 7fcae1539640 1 -- 172.21.15.77:0/94424972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcadc0cde60 msgr2=0x7fcadc15d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.286+0000 7fcae1539640 1 --2- 172.21.15.77:0/94424972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcadc0cde60 0x7fcadc15d560 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fcadc0cf2e0 tx=0x7fcacc02bed0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.287+0000 7fcae1539640 1 -- 172.21.15.77:0/94424972 shutdown_connections 2023-11-04T01:45:09.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.287+0000 7fcae1539640 1 --2- 172.21.15.77:0/94424972 >> v2:172.21.15.122:3300/0 conn(0x7fcadc0ce240 0x7fcadc0d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.287+0000 7fcae1539640 1 --2- 172.21.15.77:0/94424972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcadc0cde60 0x7fcadc15d560 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.287+0000 7fcae1539640 1 -- 172.21.15.77:0/94424972 >> 172.21.15.77:0/94424972 conn(0x7fcadc071f30 msgr2=0x7fcadc0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:09.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.287+0000 7fcae1539640 1 -- 172.21.15.77:0/94424972 shutdown_connections 2023-11-04T01:45:09.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.287+0000 7fcae1539640 1 -- 172.21.15.77:0/94424972 wait complete. 2023-11-04T01:45:09.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.288+0000 7fcae1539640 1 Processor -- start 2023-11-04T01:45:09.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.288+0000 7fcae1539640 1 -- start start 2023-11-04T01:45:09.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.288+0000 7fcae1539640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcadc0cde60 0x7fcadc14d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.289+0000 7fcae1539640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcadc0ce240 0x7fcadc0cc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.289+0000 7fcae1539640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcadc15daa0 0x7fcadc0ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.289+0000 7fcae1539640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc0ca690 con 0x7fcadc15daa0 2023-11-04T01:45:09.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.289+0000 7fcae1539640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc1e4540 con 0x7fcadc0ce240 2023-11-04T01:45:09.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.289+0000 7fcae1539640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc1e4820 con 0x7fcadc0cde60 2023-11-04T01:45:09.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.289+0000 7fcadb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcadc15daa0 0x7fcadc0ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.289+0000 7fcadb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcadc15daa0 0x7fcadc0ca900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40946/0 (socket says 172.21.15.77:40946) 2023-11-04T01:45:09.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.289+0000 7fcadb7fe640 1 -- 172.21.15.77:0/3512664067 learned_addr learned my addr 172.21.15.77:0/3512664067 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:09.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.289+0000 7fcadaffd640 1 --2- 172.21.15.77:0/3512664067 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcadc0cde60 0x7fcadc14d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.289+0000 7fcada7fc640 1 --2- 172.21.15.77:0/3512664067 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcadc0ce240 0x7fcadc0cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.289+0000 7fcadb7fe640 1 -- 172.21.15.77:0/3512664067 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcadc0cde60 msgr2=0x7fcadc14d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.289+0000 7fcadb7fe640 1 --2- 172.21.15.77:0/3512664067 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcadc0cde60 0x7fcadc14d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.289+0000 7fcadb7fe640 1 -- 172.21.15.77:0/3512664067 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcadc0ce240 msgr2=0x7fcadc0cc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.289+0000 7fcadb7fe640 1 --2- 172.21.15.77:0/3512664067 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcadc0ce240 0x7fcadc0cc770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.289+0000 7fcadb7fe640 1 -- 172.21.15.77:0/3512664067 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcacc009a70 con 0x7fcadc15daa0 2023-11-04T01:45:09.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.289+0000 7fcadaffd640 1 --2- 172.21.15.77:0/3512664067 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcadc0cde60 0x7fcadc14d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:09.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.289+0000 7fcada7fc640 1 --2- 172.21.15.77:0/3512664067 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcadc0ce240 0x7fcadc0cc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:09.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.289+0000 7fcadb7fe640 1 --2- 172.21.15.77:0/3512664067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcadc15daa0 0x7fcadc0ca900 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fcad400d5d0 tx=0x7fcad400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:09.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.289+0000 7fcac37fe640 1 -- 172.21.15.77:0/3512664067 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad40125f0 con 0x7fcadc15daa0 2023-11-04T01:45:09.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.289+0000 7fcac37fe640 1 -- 172.21.15.77:0/3512664067 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad4012750 con 0x7fcadc15daa0 2023-11-04T01:45:09.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.289+0000 7fcae1539640 1 -- 172.21.15.77:0/3512664067 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcadc1e4b00 con 0x7fcadc15daa0 2023-11-04T01:45:09.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.289+0000 7fcac37fe640 1 -- 172.21.15.77:0/3512664067 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad4012b00 con 0x7fcadc15daa0 2023-11-04T01:45:09.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.289+0000 7fcae1539640 1 -- 172.21.15.77:0/3512664067 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcadc1e50c0 con 0x7fcadc15daa0 2023-11-04T01:45:09.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.290+0000 7fcae1539640 1 -- 172.21.15.77:0/3512664067 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcadc0d2b10 con 0x7fcadc15daa0 2023-11-04T01:45:09.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.290+0000 7fcac37fe640 1 -- 172.21.15.77:0/3512664067 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcad4012c60 con 0x7fcadc15daa0 2023-11-04T01:45:09.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.291+0000 7fcac37fe640 1 --2- 172.21.15.77:0/3512664067 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcac806aea0 0x7fcac806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.291+0000 7fcac37fe640 1 -- 172.21.15.77:0/3512664067 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7fcad408a270 con 0x7fcadc15daa0 2023-11-04T01:45:09.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.291+0000 7fcadaffd640 1 --2- 172.21.15.77:0/3512664067 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcac806aea0 0x7fcac806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.292+0000 7fcadaffd640 1 --2- 172.21.15.77:0/3512664067 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcac806aea0 0x7fcac806d360 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fcacc036000 tx=0x7fcacc030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:09.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.295+0000 7fcac37fe640 1 -- 172.21.15.77:0/3512664067 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcad4054bd0 con 0x7fcadc15daa0 2023-11-04T01:45:09.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.493+0000 7fcae1539640 1 -- 172.21.15.77:0/3512664067 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcadc074290 con 0x7fcadc15daa0 2023-11-04T01:45:09.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.494+0000 7fcac37fe640 1 -- 172.21.15.77:0/3512664067 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4935 (secure 0 0 0) 0x7fcad40581f0 con 0x7fcadc15daa0 2023-11-04T01:45:09.496 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:09.496 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":72,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/1345816612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1345816612},{"type":"v1","addr":"172.21.15.122:6836","nonce":1345816612}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:45:04.999768+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7743,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7743":{"gid":7743,"name":"a","rank":0,"incarnation":68,"state":"up:active","state_seq":11,"addr":"172.21.15.77:6834/285184758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":285184758},{"type":"v1","addr":"172.21.15.77:6834","nonce":285184758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:09.498 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 72 2023-11-04T01:45:09.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.496+0000 7fcae1539640 1 -- 172.21.15.77:0/3512664067 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcac806aea0 msgr2=0x7fcac806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.496+0000 7fcae1539640 1 --2- 172.21.15.77:0/3512664067 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcac806aea0 0x7fcac806d360 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fcacc036000 tx=0x7fcacc030000 comp rx=0 tx=0).stop 2023-11-04T01:45:09.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.496+0000 7fcae1539640 1 -- 172.21.15.77:0/3512664067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcadc15daa0 msgr2=0x7fcadc0ca900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.496+0000 7fcae1539640 1 --2- 172.21.15.77:0/3512664067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcadc15daa0 0x7fcadc0ca900 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fcad400d5d0 tx=0x7fcad400da90 comp rx=0 tx=0).stop 2023-11-04T01:45:09.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.496+0000 7fcae1539640 1 -- 172.21.15.77:0/3512664067 shutdown_connections 2023-11-04T01:45:09.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.496+0000 7fcae1539640 1 --2- 172.21.15.77:0/3512664067 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcac806aea0 0x7fcac806d360 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.496+0000 7fcae1539640 1 --2- 172.21.15.77:0/3512664067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcadc15daa0 0x7fcadc0ca900 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.496+0000 7fcae1539640 1 --2- 172.21.15.77:0/3512664067 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcadc0ce240 0x7fcadc0cc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.496+0000 7fcae1539640 1 --2- 172.21.15.77:0/3512664067 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcadc0cde60 0x7fcadc14d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.496+0000 7fcae1539640 1 -- 172.21.15.77:0/3512664067 >> 172.21.15.77:0/3512664067 conn(0x7fcadc071f30 msgr2=0x7fcadc156530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:09.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.496+0000 7fcae1539640 1 -- 172.21.15.77:0/3512664067 shutdown_connections 2023-11-04T01:45:09.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.496+0000 7fcae1539640 1 -- 172.21.15.77:0/3512664067 wait complete. 2023-11-04T01:45:09.508 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:45:09.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.608+0000 7f0dbd99e640 1 Processor -- start 2023-11-04T01:45:09.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.608+0000 7f0dbd99e640 1 -- start start 2023-11-04T01:45:09.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.609+0000 7f0dbd99e640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f0db815af20 0x7f0db80b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.609+0000 7f0dbd99e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0db80b64c0 0x7f0db80cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.609+0000 7f0dbd99e640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db80d01f0 con 0x7f0db80cd3b0 2023-11-04T01:45:09.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.609+0000 7f0dbd99e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db80b6a40 con 0x7f0db80b64c0 2023-11-04T01:45:09.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.609+0000 7f0dbd99e640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db80d04b0 con 0x7f0db815af20 2023-11-04T01:45:09.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.609+0000 7f0db67fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0db80b64c0 0x7f0db80cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.609+0000 7f0db67fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0db80b64c0 0x7f0db80cbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40962/0 (socket says 172.21.15.77:40962) 2023-11-04T01:45:09.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.609+0000 7f0db67fc640 1 -- 172.21.15.77:0/726393268 learned_addr learned my addr 172.21.15.77:0/726393268 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:09.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.610+0000 7f0db6ffd640 1 --2- 172.21.15.77:0/726393268 >> v2:172.21.15.122:3300/0 conn(0x7f0db815af20 0x7f0db80b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.610+0000 7f0db67fc640 1 -- 172.21.15.77:0/726393268 >> v2:172.21.15.122:3300/0 conn(0x7f0db815af20 msgr2=0x7f0db80b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:09.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.610+0000 7f0db67fc640 1 --2- 172.21.15.77:0/726393268 >> v2:172.21.15.122:3300/0 conn(0x7f0db815af20 0x7f0db80b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.610+0000 7f0db67fc640 1 -- 172.21.15.77:0/726393268 >> v1:172.21.15.122:6789/0 conn(0x7f0db80cd3b0 legacy=0x7f0db80b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:09.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.610+0000 7f0db67fc640 1 -- 172.21.15.77:0/726393268 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db80d0790 con 0x7f0db80b64c0 2023-11-04T01:45:09.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.610+0000 7f0db67fc640 1 --2- 172.21.15.77:0/726393268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0db80b64c0 0x7f0db80cbc70 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f0db80b3760 tx=0x7f0dac02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ac16b91f618f15 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:09.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.611+0000 7f0db5ffb640 1 -- 172.21.15.77:0/726393268 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac031870 con 0x7f0db80b64c0 2023-11-04T01:45:09.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.611+0000 7f0db5ffb640 1 -- 172.21.15.77:0/726393268 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dac0319d0 con 0x7f0db80b64c0 2023-11-04T01:45:09.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.611+0000 7f0db5ffb640 1 -- 172.21.15.77:0/726393268 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac031d60 con 0x7f0db80b64c0 2023-11-04T01:45:09.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.611+0000 7f0dbd99e640 1 -- 172.21.15.77:0/726393268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0db80b64c0 msgr2=0x7f0db80cbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.611+0000 7f0dbd99e640 1 --2- 172.21.15.77:0/726393268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0db80b64c0 0x7f0db80cbc70 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f0db80b3760 tx=0x7f0dac02b910 comp rx=0 tx=0).stop 2023-11-04T01:45:09.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.611+0000 7f0dbd99e640 1 -- 172.21.15.77:0/726393268 shutdown_connections 2023-11-04T01:45:09.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.611+0000 7f0dbd99e640 1 --2- 172.21.15.77:0/726393268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0db80b64c0 0x7f0db80cbc70 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.611+0000 7f0dbd99e640 1 --2- 172.21.15.77:0/726393268 >> v2:172.21.15.122:3300/0 conn(0x7f0db815af20 0x7f0db80b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.611+0000 7f0dbd99e640 1 -- 172.21.15.77:0/726393268 >> 172.21.15.77:0/726393268 conn(0x7f0db806ea20 msgr2=0x7f0db806ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:09.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.611+0000 7f0dbd99e640 1 -- 172.21.15.77:0/726393268 shutdown_connections 2023-11-04T01:45:09.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.611+0000 7f0dbd99e640 1 -- 172.21.15.77:0/726393268 wait complete. 2023-11-04T01:45:09.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.612+0000 7f0dbd99e640 1 Processor -- start 2023-11-04T01:45:09.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.613+0000 7f0dbd99e640 1 -- start start 2023-11-04T01:45:09.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.613+0000 7f0dbd99e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0db80b64c0 0x7f0db8149e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.613+0000 7f0dbd99e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0db80cd3b0 0x7f0db80c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.613+0000 7f0dbd99e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0db815af20 0x7f0db80c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.613+0000 7f0dbd99e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db81f3d50 con 0x7f0db815af20 2023-11-04T01:45:09.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.613+0000 7f0dbd99e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db8158930 con 0x7f0db80cd3b0 2023-11-04T01:45:09.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.613+0000 7f0dbd99e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db8157db0 con 0x7f0db80b64c0 2023-11-04T01:45:09.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.613+0000 7f0db77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0db815af20 0x7f0db80c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.613+0000 7f0db77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0db815af20 0x7f0db80c6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40974/0 (socket says 172.21.15.77:40974) 2023-11-04T01:45:09.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.613+0000 7f0db77fe640 1 -- 172.21.15.77:0/134525553 learned_addr learned my addr 172.21.15.77:0/134525553 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:09.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.614+0000 7f0db67fc640 1 --2- 172.21.15.77:0/134525553 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0db80cd3b0 0x7f0db80c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.614+0000 7f0db6ffd640 1 --2- 172.21.15.77:0/134525553 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0db80b64c0 0x7f0db8149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.614+0000 7f0db77fe640 1 -- 172.21.15.77:0/134525553 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0db80b64c0 msgr2=0x7f0db8149e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.614+0000 7f0db77fe640 1 --2- 172.21.15.77:0/134525553 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0db80b64c0 0x7f0db8149e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.614+0000 7f0db77fe640 1 -- 172.21.15.77:0/134525553 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0db80cd3b0 msgr2=0x7f0db80c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.614+0000 7f0db77fe640 1 --2- 172.21.15.77:0/134525553 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0db80cd3b0 0x7f0db80c65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.614+0000 7f0db77fe640 1 -- 172.21.15.77:0/134525553 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dac0094d0 con 0x7f0db815af20 2023-11-04T01:45:09.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.614+0000 7f0db67fc640 1 --2- 172.21.15.77:0/134525553 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0db80cd3b0 0x7f0db80c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:09.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.614+0000 7f0db6ffd640 1 --2- 172.21.15.77:0/134525553 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0db80b64c0 0x7f0db8149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:09.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.614+0000 7f0db77fe640 1 --2- 172.21.15.77:0/134525553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0db815af20 0x7f0db80c6af0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f0db000c410 tx=0x7f0db000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:09.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.614+0000 7f0d9ffff640 1 -- 172.21.15.77:0/134525553 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db0011790 con 0x7f0db815af20 2023-11-04T01:45:09.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.614+0000 7f0d9ffff640 1 -- 172.21.15.77:0/134525553 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db00118f0 con 0x7f0db815af20 2023-11-04T01:45:09.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.614+0000 7f0dbd99e640 1 -- 172.21.15.77:0/134525553 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db8158090 con 0x7f0db815af20 2023-11-04T01:45:09.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.614+0000 7f0d9ffff640 1 -- 172.21.15.77:0/134525553 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db0011ce0 con 0x7f0db815af20 2023-11-04T01:45:09.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.614+0000 7f0dbd99e640 1 -- 172.21.15.77:0/134525553 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db8158650 con 0x7f0db815af20 2023-11-04T01:45:09.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.615+0000 7f0dbd99e640 1 -- 172.21.15.77:0/134525553 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db8148390 con 0x7f0db815af20 2023-11-04T01:45:09.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.615+0000 7f0d9ffff640 1 -- 172.21.15.77:0/134525553 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0db001c460 con 0x7f0db815af20 2023-11-04T01:45:09.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.616+0000 7f0d9ffff640 1 --2- 172.21.15.77:0/134525553 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0da406ae70 0x7f0da406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.616+0000 7f0d9ffff640 1 -- 172.21.15.77:0/134525553 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f0db0089930 con 0x7f0db815af20 2023-11-04T01:45:09.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.616+0000 7f0db6ffd640 1 --2- 172.21.15.77:0/134525553 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0da406ae70 0x7f0da406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.617+0000 7f0db6ffd640 1 --2- 172.21.15.77:0/134525553 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0da406ae70 0x7f0da406d330 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0db81590a0 tx=0x7f0da800b040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:09.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.620+0000 7f0d9ffff640 1 -- 172.21.15.77:0/134525553 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0db00543b0 con 0x7f0db815af20 2023-11-04T01:45:09.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:09.850+0000 7f0dbd99e640 1 -- 172.21.15.77:0/134525553 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7f0db80cc7c0 con 0x7f0db815af20 2023-11-04T01:45:10.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.024+0000 7f0d9ffff640 1 -- 172.21.15.77:0/134525553 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.7743 v73) v1 ==== 112+0+0 (secure 0 0 0) 0x7f0db00579d0 con 0x7f0db815af20 2023-11-04T01:45:10.026 INFO:teuthology.orchestra.run.smithi077.stderr:freezing mds.7743 2023-11-04T01:45:10.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.026+0000 7f0dbd99e640 1 -- 172.21.15.77:0/134525553 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0da406ae70 msgr2=0x7f0da406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.026+0000 7f0dbd99e640 1 --2- 172.21.15.77:0/134525553 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0da406ae70 0x7f0da406d330 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0db81590a0 tx=0x7f0da800b040 comp rx=0 tx=0).stop 2023-11-04T01:45:10.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.026+0000 7f0dbd99e640 1 -- 172.21.15.77:0/134525553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0db815af20 msgr2=0x7f0db80c6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.026+0000 7f0dbd99e640 1 --2- 172.21.15.77:0/134525553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0db815af20 0x7f0db80c6af0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f0db000c410 tx=0x7f0db000c8d0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.026+0000 7f0dbd99e640 1 -- 172.21.15.77:0/134525553 shutdown_connections 2023-11-04T01:45:10.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.026+0000 7f0dbd99e640 1 --2- 172.21.15.77:0/134525553 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0da406ae70 0x7f0da406d330 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.026+0000 7f0dbd99e640 1 --2- 172.21.15.77:0/134525553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0db815af20 0x7f0db80c6af0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.026+0000 7f0dbd99e640 1 --2- 172.21.15.77:0/134525553 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0db80cd3b0 0x7f0db80c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.026+0000 7f0dbd99e640 1 --2- 172.21.15.77:0/134525553 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0db80b64c0 0x7f0db8149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.026+0000 7f0dbd99e640 1 -- 172.21.15.77:0/134525553 >> 172.21.15.77:0/134525553 conn(0x7f0db806ea20 msgr2=0x7f0db80b5370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:10.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.026+0000 7f0dbd99e640 1 -- 172.21.15.77:0/134525553 shutdown_connections 2023-11-04T01:45:10.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.026+0000 7f0dbd99e640 1 -- 172.21.15.77:0/134525553 wait complete. 2023-11-04T01:45:10.038 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_kill_mdstable_at 6 2023-11-04T01:45:10.149 INFO:teuthology.orchestra.run.smithi077.stdout:{"success":"mds_kill_mdstable_at = '6' (not observed, change may require restart) "} 2023-11-04T01:45:10.150 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '6' (not observed, change may require restart) " } 2023-11-04T01:45:10.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:10.150 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s16) 2023-11-04T01:45:10.153 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:45:10.276 INFO:teuthology.orchestra.run.smithi077.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:45:10.277 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:45:10.277 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:10.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.374+0000 7f6a1cbd7640 1 Processor -- start 2023-11-04T01:45:10.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.375+0000 7f6a1cbd7640 1 -- start start 2023-11-04T01:45:10.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.375+0000 7f6a1cbd7640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f6a180ce370 0x7f6a1806db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.375+0000 7f6a1cbd7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a1806e060 con 0x7f6a180b0ae0 2023-11-04T01:45:10.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.375+0000 7f6a1cbd7640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a180b4110 con 0x7f6a18159c70 2023-11-04T01:45:10.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.375+0000 7f6a1cbd7640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a180b49b0 con 0x7f6a180ce370 2023-11-04T01:45:10.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.376+0000 7f6a15d9b640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6a180b0ae0 0x7f6a1815d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:48516/0 (socket says 172.21.15.77:48516) 2023-11-04T01:45:10.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.376+0000 7f6a15d9b640 1 -- 172.21.15.77:0/622447357 learned_addr learned my addr 172.21.15.77:0/622447357 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:45:10.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.376+0000 7f6a1559a640 1 -- 172.21.15.77:0/622447357 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4027143145 0 0) 0x7f6a1806e060 con 0x7f6a180b0ae0 2023-11-04T01:45:10.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.376+0000 7f6a1559a640 1 -- 172.21.15.77:0/622447357 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a00003520 con 0x7f6a180b0ae0 2023-11-04T01:45:10.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.376+0000 7f6a16d9d640 1 --2- 172.21.15.77:0/622447357 >> v2:172.21.15.122:3300/0 conn(0x7f6a180ce370 0x7f6a1806db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.376+0000 7f6a1559a640 1 -- 172.21.15.77:0/622447357 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3141831770 0 0) 0x7f6a00003520 con 0x7f6a180b0ae0 2023-11-04T01:45:10.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.376+0000 7f6a1559a640 1 -- 172.21.15.77:0/622447357 >> v2:172.21.15.122:3300/0 conn(0x7f6a180ce370 msgr2=0x7f6a1806db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:10.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.376+0000 7f6a1559a640 1 --2- 172.21.15.77:0/622447357 >> v2:172.21.15.122:3300/0 conn(0x7f6a180ce370 0x7f6a1806db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.376+0000 7f6a1559a640 1 -- 172.21.15.77:0/622447357 >> v1:172.21.15.122:6789/0 conn(0x7f6a18159c70 legacy=0x7f6a180b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.376+0000 7f6a1559a640 1 -- 172.21.15.77:0/622447357 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a180b43f0 con 0x7f6a180b0ae0 2023-11-04T01:45:10.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.376+0000 7f6a1559a640 1 -- 172.21.15.77:0/622447357 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f6a08001670 con 0x7f6a180b0ae0 2023-11-04T01:45:10.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.376+0000 7f6a1559a640 1 -- 172.21.15.77:0/622447357 >> v1:172.21.15.77:6789/0 conn(0x7f6a180b0ae0 legacy=0x7f6a1815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.376+0000 7f6a1559a640 1 --2- 172.21.15.77:0/622447357 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a00003970 0x7f6a00003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.376+0000 7f6a1559a640 1 --2- 172.21.15.77:0/622447357 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a000047c0 0x7f6a00004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.376+0000 7f6a1559a640 1 --2- 172.21.15.77:0/622447357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a000051d0 0x7f6a0000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.376+0000 7f6a1559a640 1 -- 172.21.15.77:0/622447357 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a180b49b0 con 0x7f6a000051d0 2023-11-04T01:45:10.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.376+0000 7f6a1559a640 1 -- 172.21.15.77:0/622447357 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0000c100 con 0x7f6a000047c0 2023-11-04T01:45:10.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.376+0000 7f6a1559a640 1 -- 172.21.15.77:0/622447357 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0000c2c0 con 0x7f6a00003970 2023-11-04T01:45:10.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.376+0000 7f6a16d9d640 1 --2- 172.21.15.77:0/622447357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a000051d0 0x7f6a0000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.376+0000 7f6a15d9b640 1 --2- 172.21.15.77:0/622447357 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a000047c0 0x7f6a00004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.376+0000 7f6a1659c640 1 --2- 172.21.15.77:0/622447357 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a00003970 0x7f6a00003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.377+0000 7f6a16d9d640 1 -- 172.21.15.77:0/622447357 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a00003970 msgr2=0x7f6a00003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:10.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.377+0000 7f6a16d9d640 1 --2- 172.21.15.77:0/622447357 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a00003970 0x7f6a00003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.377+0000 7f6a16d9d640 1 -- 172.21.15.77:0/622447357 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a000047c0 msgr2=0x7f6a00004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:10.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.377+0000 7f6a16d9d640 1 --2- 172.21.15.77:0/622447357 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a000047c0 0x7f6a00004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.377+0000 7f6a16d9d640 1 -- 172.21.15.77:0/622447357 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a00003520 con 0x7f6a000051d0 2023-11-04T01:45:10.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.377+0000 7f6a16d9d640 1 -- 172.21.15.77:0/622447357 reap_dead start 2023-11-04T01:45:10.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.377+0000 7f6a16d9d640 1 --2- 172.21.15.77:0/622447357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a000051d0 0x7f6a0000b980 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f6a10007360 tx=0x7f6a000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802fb6b9784dcb81 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:10.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.377+0000 7f6a1559a640 1 -- 172.21.15.77:0/622447357 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1002ccf0 con 0x7f6a000051d0 2023-11-04T01:45:10.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.377+0000 7f6a1559a640 1 -- 172.21.15.77:0/622447357 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1002ce90 con 0x7f6a000051d0 2023-11-04T01:45:10.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.377+0000 7f6a1559a640 1 -- 172.21.15.77:0/622447357 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a10003bd0 con 0x7f6a000051d0 2023-11-04T01:45:10.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.378+0000 7f6a1cbd7640 1 -- 172.21.15.77:0/622447357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a000051d0 msgr2=0x7f6a0000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.378+0000 7f6a1cbd7640 1 --2- 172.21.15.77:0/622447357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a000051d0 0x7f6a0000b980 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f6a10007360 tx=0x7f6a000057f0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.378+0000 7f6a1cbd7640 1 -- 172.21.15.77:0/622447357 shutdown_connections 2023-11-04T01:45:10.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.378+0000 7f6a1cbd7640 1 --2- 172.21.15.77:0/622447357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a000051d0 0x7f6a0000b980 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.378+0000 7f6a1cbd7640 1 -- 172.21.15.77:0/622447357 >> 172.21.15.77:0/622447357 conn(0x7f6a180ce950 msgr2=0x7f6a180ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:10.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.378+0000 7f6a1cbd7640 1 -- 172.21.15.77:0/622447357 shutdown_connections 2023-11-04T01:45:10.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.378+0000 7f6a1cbd7640 1 -- 172.21.15.77:0/622447357 wait complete. 2023-11-04T01:45:10.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.379+0000 7f6a1cbd7640 1 Processor -- start 2023-11-04T01:45:10.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.379+0000 7f6a1cbd7640 1 -- start start 2023-11-04T01:45:10.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.380+0000 7f6a1cbd7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a000051d0 0x7f6a181566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.380+0000 7f6a1cbd7640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a180c83b0 0x7f6a18147cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.380+0000 7f6a1cbd7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a181f26b0 0x7f6a1815ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.380+0000 7f6a1cbd7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a180ce7e0 con 0x7f6a000051d0 2023-11-04T01:45:10.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.380+0000 7f6a1cbd7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a180c8830 con 0x7f6a181f26b0 2023-11-04T01:45:10.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.380+0000 7f6a1cbd7640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a180b25a0 con 0x7f6a180c83b0 2023-11-04T01:45:10.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.380+0000 7f6a1659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a000051d0 0x7f6a181566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.380+0000 7f6a1659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a000051d0 0x7f6a181566f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40990/0 (socket says 172.21.15.77:40990) 2023-11-04T01:45:10.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.380+0000 7f6a1659c640 1 -- 172.21.15.77:0/337063370 learned_addr learned my addr 172.21.15.77:0/337063370 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:10.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.380+0000 7f6a15d9b640 1 --2- 172.21.15.77:0/337063370 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a180c83b0 0x7f6a18147cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.380+0000 7f6a16d9d640 1 --2- 172.21.15.77:0/337063370 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a181f26b0 0x7f6a1815ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.381+0000 7f6a1659c640 1 -- 172.21.15.77:0/337063370 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a180c83b0 msgr2=0x7f6a18147cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.381+0000 7f6a1659c640 1 --2- 172.21.15.77:0/337063370 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a180c83b0 0x7f6a18147cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.381+0000 7f6a1659c640 1 -- 172.21.15.77:0/337063370 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a181f26b0 msgr2=0x7f6a1815ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.381+0000 7f6a1659c640 1 --2- 172.21.15.77:0/337063370 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a181f26b0 0x7f6a1815ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.381+0000 7f6a1659c640 1 -- 172.21.15.77:0/337063370 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a18153560 con 0x7f6a000051d0 2023-11-04T01:45:10.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.381+0000 7f6a1659c640 1 --2- 172.21.15.77:0/337063370 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a000051d0 0x7f6a181566f0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c00f620 tx=0x7f6a0c00fa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:10.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.381+0000 7f6a06ffd640 1 -- 172.21.15.77:0/337063370 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c0053a0 con 0x7f6a000051d0 2023-11-04T01:45:10.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.381+0000 7f6a06ffd640 1 -- 172.21.15.77:0/337063370 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0c0035f0 con 0x7f6a000051d0 2023-11-04T01:45:10.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.381+0000 7f6a1cbd7640 1 -- 172.21.15.77:0/337063370 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a180b1c70 con 0x7f6a000051d0 2023-11-04T01:45:10.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.381+0000 7f6a06ffd640 1 -- 172.21.15.77:0/337063370 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c0039a0 con 0x7f6a000051d0 2023-11-04T01:45:10.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.381+0000 7f6a1cbd7640 1 -- 172.21.15.77:0/337063370 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a180b2230 con 0x7f6a000051d0 2023-11-04T01:45:10.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.382+0000 7f6a1cbd7640 1 -- 172.21.15.77:0/337063370 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a180b23f0 con 0x7f6a000051d0 2023-11-04T01:45:10.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.382+0000 7f6a06ffd640 1 -- 172.21.15.77:0/337063370 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6a0c003b00 con 0x7f6a000051d0 2023-11-04T01:45:10.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.383+0000 7f6a06ffd640 1 --2- 172.21.15.77:0/337063370 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f69f806aea0 0x7f69f806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.383+0000 7f6a06ffd640 1 -- 172.21.15.77:0/337063370 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f6a0c089560 con 0x7f6a000051d0 2023-11-04T01:45:10.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.383+0000 7f6a15d9b640 1 --2- 172.21.15.77:0/337063370 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f69f806aea0 0x7f69f806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.384+0000 7f6a15d9b640 1 --2- 172.21.15.77:0/337063370 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f69f806aea0 0x7f69f806d360 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f6a08000c00 tx=0x7f6a08000fe0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:10.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.387+0000 7f6a06ffd640 1 -- 172.21.15.77:0/337063370 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6a0c053f60 con 0x7f6a000051d0 2023-11-04T01:45:10.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.589+0000 7f6a1cbd7640 1 -- 172.21.15.77:0/337063370 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a18074290 con 0x7f6a000051d0 2023-11-04T01:45:10.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.590+0000 7f6a06ffd640 1 -- 172.21.15.77:0/337063370 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f6a0c057580 con 0x7f6a000051d0 2023-11-04T01:45:10.592 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:10.592 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":73,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/1345816612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1345816612},{"type":"v1","addr":"172.21.15.122:6836","nonce":1345816612}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:45:09.851981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7743,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7743":{"gid":7743,"name":"a","rank":0,"incarnation":68,"state":"up:active","state_seq":11,"addr":"172.21.15.77:6834/285184758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":285184758},{"type":"v1","addr":"172.21.15.77:6834","nonce":285184758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:10.592 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 73 2023-11-04T01:45:10.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.592+0000 7f6a1cbd7640 1 -- 172.21.15.77:0/337063370 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f69f806aea0 msgr2=0x7f69f806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.592+0000 7f6a1cbd7640 1 --2- 172.21.15.77:0/337063370 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f69f806aea0 0x7f69f806d360 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f6a08000c00 tx=0x7f6a08000fe0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.592+0000 7f6a1cbd7640 1 -- 172.21.15.77:0/337063370 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a000051d0 msgr2=0x7f6a181566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.592+0000 7f6a1cbd7640 1 --2- 172.21.15.77:0/337063370 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a000051d0 0x7f6a181566f0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c00f620 tx=0x7f6a0c00fa20 comp rx=0 tx=0).stop 2023-11-04T01:45:10.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.592+0000 7f6a1cbd7640 1 -- 172.21.15.77:0/337063370 shutdown_connections 2023-11-04T01:45:10.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.592+0000 7f6a1cbd7640 1 --2- 172.21.15.77:0/337063370 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f69f806aea0 0x7f69f806d360 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.592+0000 7f6a1cbd7640 1 --2- 172.21.15.77:0/337063370 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a181f26b0 0x7f6a1815ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.592+0000 7f6a1cbd7640 1 --2- 172.21.15.77:0/337063370 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a180c83b0 0x7f6a18147cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.592+0000 7f6a1cbd7640 1 --2- 172.21.15.77:0/337063370 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a000051d0 0x7f6a181566f0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.592+0000 7f6a1cbd7640 1 -- 172.21.15.77:0/337063370 >> 172.21.15.77:0/337063370 conn(0x7f6a180ce950 msgr2=0x7f6a181577b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:10.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.592+0000 7f6a1cbd7640 1 -- 172.21.15.77:0/337063370 shutdown_connections 2023-11-04T01:45:10.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:10.592+0000 7f6a1cbd7640 1 -- 172.21.15.77:0/337063370 wait complete. 2023-11-04T01:45:10.605 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:45:10.859 INFO:tasks.ceph.mds.a.smithi077.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7fb46ccb1640 time 2023-11-04T01:45:10.858727+0000 2023-11-04T01:45:10.860 INFO:tasks.ceph.mds.a.smithi077.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:45:10.860 INFO:tasks.ceph.mds.a.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:45:10.860 INFO:tasks.ceph.mds.a.smithi077.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb47876efaf] 2023-11-04T01:45:10.860 INFO:tasks.ceph.mds.a.smithi077.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fb47876f16d] 2023-11-04T01:45:10.861 INFO:tasks.ceph.mds.a.smithi077.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55e1d139b21b] 2023-11-04T01:45:10.861 INFO:tasks.ceph.mds.a.smithi077.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55e1d13cabcc] 2023-11-04T01:45:10.861 INFO:tasks.ceph.mds.a.smithi077.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x55e1d13d3b0c] 2023-11-04T01:45:10.861 INFO:tasks.ceph.mds.a.smithi077.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55e1d13d3c63] 2023-11-04T01:45:10.861 INFO:tasks.ceph.mds.a.smithi077.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fb4788164a5] 2023-11-04T01:45:10.862 INFO:tasks.ceph.mds.a.smithi077.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fb477e9f802] 2023-11-04T01:45:10.862 INFO:tasks.ceph.mds.a.smithi077.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fb477e3f450] 2023-11-04T01:45:10.862 INFO:tasks.ceph.mds.a.smithi077.stderr:2023-11-04T01:45:10.858+0000 7fb46ccb1640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7fb46ccb1640 time 2023-11-04T01:45:10.858727+0000 2023-11-04T01:45:10.862 INFO:tasks.ceph.mds.a.smithi077.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:45:10.862 INFO:tasks.ceph.mds.a.smithi077.stderr: 2023-11-04T01:45:10.863 INFO:tasks.ceph.mds.a.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:45:10.863 INFO:tasks.ceph.mds.a.smithi077.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb47876efaf] 2023-11-04T01:45:10.863 INFO:tasks.ceph.mds.a.smithi077.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fb47876f16d] 2023-11-04T01:45:10.863 INFO:tasks.ceph.mds.a.smithi077.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55e1d139b21b] 2023-11-04T01:45:10.863 INFO:tasks.ceph.mds.a.smithi077.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55e1d13cabcc] 2023-11-04T01:45:10.864 INFO:tasks.ceph.mds.a.smithi077.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x55e1d13d3b0c] 2023-11-04T01:45:10.864 INFO:tasks.ceph.mds.a.smithi077.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55e1d13d3c63] 2023-11-04T01:45:10.864 INFO:tasks.ceph.mds.a.smithi077.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fb4788164a5] 2023-11-04T01:45:10.864 INFO:tasks.ceph.mds.a.smithi077.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fb477e9f802] 2023-11-04T01:45:10.864 INFO:tasks.ceph.mds.a.smithi077.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fb477e3f450] 2023-11-04T01:45:10.865 INFO:tasks.ceph.mds.a.smithi077.stderr: 2023-11-04T01:45:10.865 INFO:tasks.ceph.mds.a.smithi077.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:45:10.865 INFO:tasks.ceph.mds.a.smithi077.stderr: in thread 7fb46ccb1640 thread_name:MR_Finisher 2023-11-04T01:45:10.866 INFO:tasks.ceph.mds.a.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:45:10.866 INFO:tasks.ceph.mds.a.smithi077.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fb477e54db0] 2023-11-04T01:45:10.866 INFO:tasks.ceph.mds.a.smithi077.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fb477ea154c] 2023-11-04T01:45:10.867 INFO:tasks.ceph.mds.a.smithi077.stderr: 3: raise() 2023-11-04T01:45:10.867 INFO:tasks.ceph.mds.a.smithi077.stderr: 4: abort() 2023-11-04T01:45:10.867 INFO:tasks.ceph.mds.a.smithi077.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb47876f009] 2023-11-04T01:45:10.867 INFO:tasks.ceph.mds.a.smithi077.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fb47876f16d] 2023-11-04T01:45:10.868 INFO:tasks.ceph.mds.a.smithi077.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55e1d139b21b] 2023-11-04T01:45:10.868 INFO:tasks.ceph.mds.a.smithi077.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55e1d13cabcc] 2023-11-04T01:45:10.868 INFO:tasks.ceph.mds.a.smithi077.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x55e1d13d3b0c] 2023-11-04T01:45:10.868 INFO:tasks.ceph.mds.a.smithi077.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55e1d13d3c63] 2023-11-04T01:45:10.868 INFO:tasks.ceph.mds.a.smithi077.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fb4788164a5] 2023-11-04T01:45:10.869 INFO:tasks.ceph.mds.a.smithi077.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7fb477e9f802] 2023-11-04T01:45:10.869 INFO:tasks.ceph.mds.a.smithi077.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7fb477e3f450] 2023-11-04T01:45:10.869 INFO:tasks.ceph.mds.a.smithi077.stderr:2023-11-04T01:45:10.859+0000 7fb46ccb1640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:45:10.869 INFO:tasks.ceph.mds.a.smithi077.stderr: in thread 7fb46ccb1640 thread_name:MR_Finisher 2023-11-04T01:45:10.869 INFO:tasks.ceph.mds.a.smithi077.stderr: 2023-11-04T01:45:10.870 INFO:tasks.ceph.mds.a.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:45:10.870 INFO:tasks.ceph.mds.a.smithi077.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fb477e54db0] 2023-11-04T01:45:10.870 INFO:tasks.ceph.mds.a.smithi077.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fb477ea154c] 2023-11-04T01:45:10.870 INFO:tasks.ceph.mds.a.smithi077.stderr: 3: raise() 2023-11-04T01:45:10.871 INFO:tasks.ceph.mds.a.smithi077.stderr: 4: abort() 2023-11-04T01:45:10.871 INFO:tasks.ceph.mds.a.smithi077.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb47876f009] 2023-11-04T01:45:10.871 INFO:tasks.ceph.mds.a.smithi077.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fb47876f16d] 2023-11-04T01:45:10.871 INFO:tasks.ceph.mds.a.smithi077.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55e1d139b21b] 2023-11-04T01:45:10.872 INFO:tasks.ceph.mds.a.smithi077.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55e1d13cabcc] 2023-11-04T01:45:10.872 INFO:tasks.ceph.mds.a.smithi077.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x55e1d13d3b0c] 2023-11-04T01:45:10.872 INFO:tasks.ceph.mds.a.smithi077.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55e1d13d3c63] 2023-11-04T01:45:10.872 INFO:tasks.ceph.mds.a.smithi077.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fb4788164a5] 2023-11-04T01:45:10.873 INFO:tasks.ceph.mds.a.smithi077.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7fb477e9f802] 2023-11-04T01:45:10.873 INFO:tasks.ceph.mds.a.smithi077.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7fb477e3f450] 2023-11-04T01:45:10.873 INFO:tasks.ceph.mds.a.smithi077.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:45:10.873 INFO:tasks.ceph.mds.a.smithi077.stderr: 2023-11-04T01:45:10.873 INFO:tasks.ceph.mds.a.smithi077.stderr: -480> 2023-11-04T01:45:07.825+0000 7fb4704b8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:45:10.874 INFO:tasks.ceph.mds.a.smithi077.stderr: -478> 2023-11-04T01:45:07.825+0000 7fb4704b8640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:45:10.874 INFO:tasks.ceph.mds.a.smithi077.stderr: -1> 2023-11-04T01:45:10.858+0000 7fb46ccb1640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7fb46ccb1640 time 2023-11-04T01:45:10.858727+0000 2023-11-04T01:45:10.874 INFO:tasks.ceph.mds.a.smithi077.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:45:10.874 INFO:tasks.ceph.mds.a.smithi077.stderr: 2023-11-04T01:45:10.874 INFO:tasks.ceph.mds.a.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:45:10.875 INFO:tasks.ceph.mds.a.smithi077.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb47876efaf] 2023-11-04T01:45:10.875 INFO:tasks.ceph.mds.a.smithi077.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fb47876f16d] 2023-11-04T01:45:10.875 INFO:tasks.ceph.mds.a.smithi077.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55e1d139b21b] 2023-11-04T01:45:10.875 INFO:tasks.ceph.mds.a.smithi077.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55e1d13cabcc] 2023-11-04T01:45:10.876 INFO:tasks.ceph.mds.a.smithi077.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x55e1d13d3b0c] 2023-11-04T01:45:10.876 INFO:tasks.ceph.mds.a.smithi077.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55e1d13d3c63] 2023-11-04T01:45:10.876 INFO:tasks.ceph.mds.a.smithi077.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fb4788164a5] 2023-11-04T01:45:10.876 INFO:tasks.ceph.mds.a.smithi077.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fb477e9f802] 2023-11-04T01:45:10.877 INFO:tasks.ceph.mds.a.smithi077.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fb477e3f450] 2023-11-04T01:45:10.877 INFO:tasks.ceph.mds.a.smithi077.stderr: 2023-11-04T01:45:10.877 INFO:tasks.ceph.mds.a.smithi077.stderr: 0> 2023-11-04T01:45:10.859+0000 7fb46ccb1640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:45:10.877 INFO:tasks.ceph.mds.a.smithi077.stderr: in thread 7fb46ccb1640 thread_name:MR_Finisher 2023-11-04T01:45:10.877 INFO:tasks.ceph.mds.a.smithi077.stderr: 2023-11-04T01:45:10.878 INFO:tasks.ceph.mds.a.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:45:10.878 INFO:tasks.ceph.mds.a.smithi077.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fb477e54db0] 2023-11-04T01:45:10.878 INFO:tasks.ceph.mds.a.smithi077.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fb477ea154c] 2023-11-04T01:45:10.878 INFO:tasks.ceph.mds.a.smithi077.stderr: 3: raise() 2023-11-04T01:45:10.879 INFO:tasks.ceph.mds.a.smithi077.stderr: 4: abort() 2023-11-04T01:45:10.879 INFO:tasks.ceph.mds.a.smithi077.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb47876f009] 2023-11-04T01:45:10.879 INFO:tasks.ceph.mds.a.smithi077.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fb47876f16d] 2023-11-04T01:45:10.879 INFO:tasks.ceph.mds.a.smithi077.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55e1d139b21b] 2023-11-04T01:45:10.879 INFO:tasks.ceph.mds.a.smithi077.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55e1d13cabcc] 2023-11-04T01:45:10.879 INFO:tasks.ceph.mds.a.smithi077.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x55e1d13d3b0c] 2023-11-04T01:45:10.880 INFO:tasks.ceph.mds.a.smithi077.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55e1d13d3c63] 2023-11-04T01:45:10.880 INFO:tasks.ceph.mds.a.smithi077.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fb4788164a5] 2023-11-04T01:45:10.880 INFO:tasks.ceph.mds.a.smithi077.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7fb477e9f802] 2023-11-04T01:45:10.880 INFO:tasks.ceph.mds.a.smithi077.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7fb477e3f450] 2023-11-04T01:45:10.880 INFO:tasks.ceph.mds.a.smithi077.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:45:10.881 INFO:tasks.ceph.mds.a.smithi077.stderr: 2023-11-04T01:45:10.881 INFO:tasks.ceph.mds.a.smithi077.stderr: -480> 2023-11-04T01:45:07.825+0000 7fb4704b8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:45:10.882 INFO:tasks.ceph.mds.a.smithi077.stderr: -478> 2023-11-04T01:45:07.825+0000 7fb4704b8640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:45:10.882 INFO:tasks.ceph.mds.a.smithi077.stderr: -1> 2023-11-04T01:45:10.858+0000 7fb46ccb1640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7fb46ccb1640 time 2023-11-04T01:45:10.858727+0000 2023-11-04T01:45:10.882 INFO:tasks.ceph.mds.a.smithi077.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:45:10.882 INFO:tasks.ceph.mds.a.smithi077.stderr: 2023-11-04T01:45:10.882 INFO:tasks.ceph.mds.a.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:45:10.883 INFO:tasks.ceph.mds.a.smithi077.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb47876efaf] 2023-11-04T01:45:10.883 INFO:tasks.ceph.mds.a.smithi077.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fb47876f16d] 2023-11-04T01:45:10.883 INFO:tasks.ceph.mds.a.smithi077.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55e1d139b21b] 2023-11-04T01:45:10.883 INFO:tasks.ceph.mds.a.smithi077.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55e1d13cabcc] 2023-11-04T01:45:10.883 INFO:tasks.ceph.mds.a.smithi077.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x55e1d13d3b0c] 2023-11-04T01:45:10.884 INFO:tasks.ceph.mds.a.smithi077.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55e1d13d3c63] 2023-11-04T01:45:10.884 INFO:tasks.ceph.mds.a.smithi077.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fb4788164a5] 2023-11-04T01:45:10.884 INFO:tasks.ceph.mds.a.smithi077.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fb477e9f802] 2023-11-04T01:45:10.884 INFO:tasks.ceph.mds.a.smithi077.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fb477e3f450] 2023-11-04T01:45:10.884 INFO:tasks.ceph.mds.a.smithi077.stderr: 2023-11-04T01:45:10.885 INFO:tasks.ceph.mds.a.smithi077.stderr: 0> 2023-11-04T01:45:10.859+0000 7fb46ccb1640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:45:10.885 INFO:tasks.ceph.mds.a.smithi077.stderr: in thread 7fb46ccb1640 thread_name:MR_Finisher 2023-11-04T01:45:10.885 INFO:tasks.ceph.mds.a.smithi077.stderr: 2023-11-04T01:45:10.885 INFO:tasks.ceph.mds.a.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:45:10.885 INFO:tasks.ceph.mds.a.smithi077.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fb477e54db0] 2023-11-04T01:45:10.886 INFO:tasks.ceph.mds.a.smithi077.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fb477ea154c] 2023-11-04T01:45:10.886 INFO:tasks.ceph.mds.a.smithi077.stderr: 3: raise() 2023-11-04T01:45:10.886 INFO:tasks.ceph.mds.a.smithi077.stderr: 4: abort() 2023-11-04T01:45:10.886 INFO:tasks.ceph.mds.a.smithi077.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb47876f009] 2023-11-04T01:45:10.887 INFO:tasks.ceph.mds.a.smithi077.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fb47876f16d] 2023-11-04T01:45:10.887 INFO:tasks.ceph.mds.a.smithi077.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55e1d139b21b] 2023-11-04T01:45:10.887 INFO:tasks.ceph.mds.a.smithi077.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55e1d13cabcc] 2023-11-04T01:45:10.887 INFO:tasks.ceph.mds.a.smithi077.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x55e1d13d3b0c] 2023-11-04T01:45:10.887 INFO:tasks.ceph.mds.a.smithi077.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55e1d13d3c63] 2023-11-04T01:45:10.888 INFO:tasks.ceph.mds.a.smithi077.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fb4788164a5] 2023-11-04T01:45:10.888 INFO:tasks.ceph.mds.a.smithi077.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7fb477e9f802] 2023-11-04T01:45:10.888 INFO:tasks.ceph.mds.a.smithi077.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7fb477e3f450] 2023-11-04T01:45:10.888 INFO:tasks.ceph.mds.a.smithi077.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:45:10.888 INFO:tasks.ceph.mds.a.smithi077.stderr: 2023-11-04T01:45:11.132 INFO:tasks.ceph.mds.a.smithi077.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:45:13.354 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-11-04T01:45:15.607 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:15.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.717+0000 7fe5689b6640 1 Processor -- start 2023-11-04T01:45:15.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.717+0000 7fe5689b6640 1 -- start start 2023-11-04T01:45:15.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.718+0000 7fe5689b6640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe56415ad80 0x7fe56406c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:15.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.718+0000 7fe5689b6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe5640b42c0 0x7fe5640c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:15.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.718+0000 7fe5689b6640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe56406cd00 con 0x7fe5640c9c40 2023-11-04T01:45:15.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.718+0000 7fe5689b6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5640ca020 con 0x7fe5640b42c0 2023-11-04T01:45:15.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.718+0000 7fe5689b6640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe56406cfa0 con 0x7fe56415ad80 2023-11-04T01:45:15.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.718+0000 7fe561d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe5640b42c0 0x7fe5640c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:15.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.718+0000 7fe561d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe5640b42c0 0x7fe5640c9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41004/0 (socket says 172.21.15.77:41004) 2023-11-04T01:45:15.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.718+0000 7fe561d9b640 1 -- 172.21.15.77:0/550560408 learned_addr learned my addr 172.21.15.77:0/550560408 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:15.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.718+0000 7fe56259c640 1 --2- 172.21.15.77:0/550560408 >> v2:172.21.15.122:3300/0 conn(0x7fe56415ad80 0x7fe56406c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:15.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.718+0000 7fe561d9b640 1 -- 172.21.15.77:0/550560408 >> v2:172.21.15.122:3300/0 conn(0x7fe56415ad80 msgr2=0x7fe56406c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:15.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.718+0000 7fe561d9b640 1 --2- 172.21.15.77:0/550560408 >> v2:172.21.15.122:3300/0 conn(0x7fe56415ad80 0x7fe56406c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:15.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.718+0000 7fe561d9b640 1 -- 172.21.15.77:0/550560408 >> v1:172.21.15.122:6789/0 conn(0x7fe5640c9c40 legacy=0x7fe564070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:15.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.718+0000 7fe561d9b640 1 -- 172.21.15.77:0/550560408 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe56406d280 con 0x7fe5640b42c0 2023-11-04T01:45:15.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.719+0000 7fe561d9b640 1 --2- 172.21.15.77:0/550560408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5640b42c0 0x7fe5640c9700 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fe5640c8e50 tx=0x7fe55402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a70661fa8fcc71 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:15.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.719+0000 7fe56159a640 1 -- 172.21.15.77:0/550560408 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe554030840 con 0x7fe5640b42c0 2023-11-04T01:45:15.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.719+0000 7fe56159a640 1 -- 172.21.15.77:0/550560408 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5540309a0 con 0x7fe5640b42c0 2023-11-04T01:45:15.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.719+0000 7fe56159a640 1 -- 172.21.15.77:0/550560408 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe554030d30 con 0x7fe5640b42c0 2023-11-04T01:45:15.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.719+0000 7fe5689b6640 1 -- 172.21.15.77:0/550560408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5640b42c0 msgr2=0x7fe5640c9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:15.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.719+0000 7fe5689b6640 1 --2- 172.21.15.77:0/550560408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5640b42c0 0x7fe5640c9700 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fe5640c8e50 tx=0x7fe55402b980 comp rx=0 tx=0).stop 2023-11-04T01:45:15.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.720+0000 7fe5689b6640 1 -- 172.21.15.77:0/550560408 shutdown_connections 2023-11-04T01:45:15.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.720+0000 7fe5689b6640 1 --2- 172.21.15.77:0/550560408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5640b42c0 0x7fe5640c9700 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:15.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.720+0000 7fe5689b6640 1 --2- 172.21.15.77:0/550560408 >> v2:172.21.15.122:3300/0 conn(0x7fe56415ad80 0x7fe56406c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:15.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.720+0000 7fe5689b6640 1 -- 172.21.15.77:0/550560408 >> 172.21.15.77:0/550560408 conn(0x7fe5640ce950 msgr2=0x7fe5640ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:15.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.720+0000 7fe5689b6640 1 -- 172.21.15.77:0/550560408 shutdown_connections 2023-11-04T01:45:15.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.720+0000 7fe5689b6640 1 -- 172.21.15.77:0/550560408 wait complete. 2023-11-04T01:45:15.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.721+0000 7fe5689b6640 1 Processor -- start 2023-11-04T01:45:15.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.721+0000 7fe5689b6640 1 -- start start 2023-11-04T01:45:15.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.722+0000 7fe5689b6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5640b42c0 0x7fe5641567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:15.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.722+0000 7fe5689b6640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe5640c9c40 0x7fe5640cc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:15.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.722+0000 7fe5689b6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe56415ad80 0x7fe5640cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:15.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.722+0000 7fe5689b6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5641f7270 con 0x7fe56415ad80 2023-11-04T01:45:15.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.722+0000 7fe5689b6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5640b2870 con 0x7fe5640b42c0 2023-11-04T01:45:15.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.722+0000 7fe5689b6640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5641f7690 con 0x7fe5640c9c40 2023-11-04T01:45:15.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.722+0000 7fe562d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe56415ad80 0x7fe5640cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:15.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.722+0000 7fe562d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe56415ad80 0x7fe5640cccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41010/0 (socket says 172.21.15.77:41010) 2023-11-04T01:45:15.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.722+0000 7fe562d9d640 1 -- 172.21.15.77:0/3732835844 learned_addr learned my addr 172.21.15.77:0/3732835844 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:15.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.722+0000 7fe56259c640 1 --2- 172.21.15.77:0/3732835844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5640b42c0 0x7fe5641567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:15.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.722+0000 7fe561d9b640 1 --2- 172.21.15.77:0/3732835844 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe5640c9c40 0x7fe5640cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:15.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.722+0000 7fe562d9d640 1 -- 172.21.15.77:0/3732835844 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe5640c9c40 msgr2=0x7fe5640cc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:15.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.722+0000 7fe562d9d640 1 --2- 172.21.15.77:0/3732835844 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe5640c9c40 0x7fe5640cc770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:15.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.722+0000 7fe562d9d640 1 -- 172.21.15.77:0/3732835844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5640b42c0 msgr2=0x7fe5641567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:15.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.722+0000 7fe562d9d640 1 --2- 172.21.15.77:0/3732835844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5640b42c0 0x7fe5641567f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:15.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.722+0000 7fe562d9d640 1 -- 172.21.15.77:0/3732835844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5540094d0 con 0x7fe56415ad80 2023-11-04T01:45:15.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.722+0000 7fe561d9b640 1 --2- 172.21.15.77:0/3732835844 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe5640c9c40 0x7fe5640cc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:15.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.722+0000 7fe562d9d640 1 --2- 172.21.15.77:0/3732835844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe56415ad80 0x7fe5640cccb0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fe55c00c780 tx=0x7fe55c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:15.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.722+0000 7fe552ffd640 1 -- 172.21.15.77:0/3732835844 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c004b60 con 0x7fe56415ad80 2023-11-04T01:45:15.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.722+0000 7fe552ffd640 1 -- 172.21.15.77:0/3732835844 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55c00ce90 con 0x7fe56415ad80 2023-11-04T01:45:15.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.722+0000 7fe5689b6640 1 -- 172.21.15.77:0/3732835844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5641f68d0 con 0x7fe56415ad80 2023-11-04T01:45:15.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.722+0000 7fe552ffd640 1 -- 172.21.15.77:0/3732835844 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c00a850 con 0x7fe56415ad80 2023-11-04T01:45:15.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.723+0000 7fe5689b6640 1 -- 172.21.15.77:0/3732835844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5641f6e90 con 0x7fe56415ad80 2023-11-04T01:45:15.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.723+0000 7fe5689b6640 1 -- 172.21.15.77:0/3732835844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe564074290 con 0x7fe56415ad80 2023-11-04T01:45:15.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.724+0000 7fe552ffd640 1 -- 172.21.15.77:0/3732835844 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe55c00a9b0 con 0x7fe56415ad80 2023-11-04T01:45:15.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.724+0000 7fe552ffd640 1 --2- 172.21.15.77:0/3732835844 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe54406ae70 0x7fe54406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:15.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.725+0000 7fe552ffd640 1 -- 172.21.15.77:0/3732835844 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7fe55c089d20 con 0x7fe56415ad80 2023-11-04T01:45:15.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.725+0000 7fe56259c640 1 --2- 172.21.15.77:0/3732835844 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe54406ae70 0x7fe54406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:15.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.725+0000 7fe56259c640 1 --2- 172.21.15.77:0/3732835844 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe54406ae70 0x7fe54406d330 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe5580079a0 tx=0x7fe558008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:15.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.729+0000 7fe552ffd640 1 -- 172.21.15.77:0/3732835844 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe55c0547a0 con 0x7fe56415ad80 2023-11-04T01:45:15.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.932+0000 7fe5689b6640 1 -- 172.21.15.77:0/3732835844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5640b4880 con 0x7fe56415ad80 2023-11-04T01:45:15.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.932+0000 7fe552ffd640 1 -- 172.21.15.77:0/3732835844 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+4935 (secure 0 0 0) 0x7fe55c057dc0 con 0x7fe56415ad80 2023-11-04T01:45:15.934 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:15.935 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":73,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/1345816612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1345816612},{"type":"v1","addr":"172.21.15.122:6836","nonce":1345816612}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:45:09.851981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7743,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7743":{"gid":7743,"name":"a","rank":0,"incarnation":68,"state":"up:active","state_seq":11,"addr":"172.21.15.77:6834/285184758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":285184758},{"type":"v1","addr":"172.21.15.77:6834","nonce":285184758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:15.935 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 73 2023-11-04T01:45:15.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.934+0000 7fe5689b6640 1 -- 172.21.15.77:0/3732835844 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe54406ae70 msgr2=0x7fe54406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:15.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.934+0000 7fe5689b6640 1 --2- 172.21.15.77:0/3732835844 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe54406ae70 0x7fe54406d330 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe5580079a0 tx=0x7fe558008040 comp rx=0 tx=0).stop 2023-11-04T01:45:15.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.934+0000 7fe5689b6640 1 -- 172.21.15.77:0/3732835844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe56415ad80 msgr2=0x7fe5640cccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:15.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.934+0000 7fe5689b6640 1 --2- 172.21.15.77:0/3732835844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe56415ad80 0x7fe5640cccb0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fe55c00c780 tx=0x7fe55c00cc40 comp rx=0 tx=0).stop 2023-11-04T01:45:15.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.934+0000 7fe5689b6640 1 -- 172.21.15.77:0/3732835844 shutdown_connections 2023-11-04T01:45:15.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.934+0000 7fe5689b6640 1 --2- 172.21.15.77:0/3732835844 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe54406ae70 0x7fe54406d330 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:15.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.934+0000 7fe5689b6640 1 --2- 172.21.15.77:0/3732835844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe56415ad80 0x7fe5640cccb0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:15.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.934+0000 7fe5689b6640 1 --2- 172.21.15.77:0/3732835844 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe5640c9c40 0x7fe5640cc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:15.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.934+0000 7fe5689b6640 1 --2- 172.21.15.77:0/3732835844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5640b42c0 0x7fe5641567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:15.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.934+0000 7fe5689b6640 1 -- 172.21.15.77:0/3732835844 >> 172.21.15.77:0/3732835844 conn(0x7fe5640ce950 msgr2=0x7fe5640acf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:15.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.934+0000 7fe5689b6640 1 -- 172.21.15.77:0/3732835844 shutdown_connections 2023-11-04T01:45:15.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:15.934+0000 7fe5689b6640 1 -- 172.21.15.77:0/3732835844 wait complete. 2023-11-04T01:45:15.946 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:45:19.967 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~7s 2023-11-04T01:45:20.948 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:21.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.057+0000 7fd789955640 1 Processor -- start 2023-11-04T01:45:21.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.057+0000 7fd789955640 1 -- start start 2023-11-04T01:45:21.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.057+0000 7fd789955640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd7840ce240 0x7fd784157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:21.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.057+0000 7fd789955640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd784157540 0x7fd7840d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:21.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.057+0000 7fd789955640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd78415e000 con 0x7fd7840cde60 2023-11-04T01:45:21.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.057+0000 7fd789955640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd78415e5c0 con 0x7fd7840ce240 2023-11-04T01:45:21.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.057+0000 7fd789955640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd78415e2e0 con 0x7fd784157540 2023-11-04T01:45:21.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.058+0000 7fd7837fe640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd784157540 0x7fd7840d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:21.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.058+0000 7fd7827fc640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd7840ce240 0x7fd784157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:21.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.058+0000 7fd7827fc640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd7840ce240 0x7fd784157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:55210/0 (socket says 172.21.15.77:55210) 2023-11-04T01:45:21.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.058+0000 7fd782ffd640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fd7840cde60 0x7fd78415d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:42012/0 (socket says 172.21.15.77:42012) 2023-11-04T01:45:21.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.058+0000 7fd7827fc640 1 -- 172.21.15.77:0/4212913222 learned_addr learned my addr 172.21.15.77:0/4212913222 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:21.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.058+0000 7fd7837fe640 1 --2- 172.21.15.77:0/4212913222 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd784157540 0x7fd7840d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:35416/0 (socket says 172.21.15.77:35416) 2023-11-04T01:45:21.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.058+0000 7fd7827fc640 1 -- 172.21.15.77:0/4212913222 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd784157540 msgr2=0x7fd7840d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:21.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.058+0000 7fd7827fc640 1 --2- 172.21.15.77:0/4212913222 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd784157540 0x7fd7840d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.058+0000 7fd7827fc640 1 -- 172.21.15.77:0/4212913222 >> v1:172.21.15.122:6789/0 conn(0x7fd7840cde60 legacy=0x7fd78415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:21.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.058+0000 7fd7827fc640 1 -- 172.21.15.77:0/4212913222 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7840d1120 con 0x7fd7840ce240 2023-11-04T01:45:21.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.058+0000 7fd781ffb640 1 -- 172.21.15.77:0/4212913222 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2991729370 0 0) 0x7fd78415e000 con 0x7fd7840cde60 2023-11-04T01:45:21.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.058+0000 7fd7837fe640 1 --2- 172.21.15.77:0/4212913222 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd784157540 0x7fd7840d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:45:21.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.059+0000 7fd7827fc640 1 --2- 172.21.15.77:0/4212913222 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7840ce240 0x7fd784157000 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd778009870 tx=0x7fd77802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3f1d3c023452adb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:21.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.059+0000 7fd781ffb640 1 -- 172.21.15.77:0/4212913222 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd778030840 con 0x7fd7840ce240 2023-11-04T01:45:21.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.059+0000 7fd781ffb640 1 -- 172.21.15.77:0/4212913222 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7780309a0 con 0x7fd7840ce240 2023-11-04T01:45:21.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.059+0000 7fd781ffb640 1 -- 172.21.15.77:0/4212913222 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd778030d30 con 0x7fd7840ce240 2023-11-04T01:45:21.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.060+0000 7fd789955640 1 -- 172.21.15.77:0/4212913222 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7840ce240 msgr2=0x7fd784157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:21.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.060+0000 7fd789955640 1 --2- 172.21.15.77:0/4212913222 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7840ce240 0x7fd784157000 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd778009870 tx=0x7fd77802b980 comp rx=0 tx=0).stop 2023-11-04T01:45:21.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.060+0000 7fd789955640 1 -- 172.21.15.77:0/4212913222 shutdown_connections 2023-11-04T01:45:21.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.060+0000 7fd789955640 1 --2- 172.21.15.77:0/4212913222 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd784157540 0x7fd7840d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.060+0000 7fd789955640 1 --2- 172.21.15.77:0/4212913222 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7840ce240 0x7fd784157000 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.060+0000 7fd789955640 1 -- 172.21.15.77:0/4212913222 >> 172.21.15.77:0/4212913222 conn(0x7fd784071f30 msgr2=0x7fd7840cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:21.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.060+0000 7fd789955640 1 -- 172.21.15.77:0/4212913222 shutdown_connections 2023-11-04T01:45:21.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.060+0000 7fd789955640 1 -- 172.21.15.77:0/4212913222 wait complete. 2023-11-04T01:45:21.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.061+0000 7fd789955640 1 Processor -- start 2023-11-04T01:45:21.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.061+0000 7fd789955640 1 -- start start 2023-11-04T01:45:21.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.062+0000 7fd789955640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7840cde60 0x7fd7840b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:21.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.062+0000 7fd789955640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7840ce240 0x7fd78415b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:21.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.062+0000 7fd789955640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd784157540 0x7fd78415b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:21.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.062+0000 7fd789955640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7840cbe50 con 0x7fd7840cde60 2023-11-04T01:45:21.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.062+0000 7fd789955640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7840cc130 con 0x7fd7840ce240 2023-11-04T01:45:21.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.062+0000 7fd789955640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7840cc410 con 0x7fd784157540 2023-11-04T01:45:21.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.062+0000 7fd782ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7840cde60 0x7fd7840b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:21.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.062+0000 7fd782ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7840cde60 0x7fd7840b45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52374/0 (socket says 172.21.15.77:52374) 2023-11-04T01:45:21.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.062+0000 7fd782ffd640 1 -- 172.21.15.77:0/332743397 learned_addr learned my addr 172.21.15.77:0/332743397 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:21.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.062+0000 7fd7827fc640 1 --2- 172.21.15.77:0/332743397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7840ce240 0x7fd78415b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:21.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.062+0000 7fd7837fe640 1 --2- 172.21.15.77:0/332743397 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd784157540 0x7fd78415b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:21.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.062+0000 7fd782ffd640 1 -- 172.21.15.77:0/332743397 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd784157540 msgr2=0x7fd78415b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:21.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.062+0000 7fd782ffd640 1 --2- 172.21.15.77:0/332743397 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd784157540 0x7fd78415b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.062+0000 7fd782ffd640 1 -- 172.21.15.77:0/332743397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7840ce240 msgr2=0x7fd78415b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:21.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.062+0000 7fd782ffd640 1 --2- 172.21.15.77:0/332743397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7840ce240 0x7fd78415b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.062+0000 7fd782ffd640 1 -- 172.21.15.77:0/332743397 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd77c009a70 con 0x7fd7840cde60 2023-11-04T01:45:21.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.063+0000 7fd782ffd640 1 --2- 172.21.15.77:0/332743397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7840cde60 0x7fd7840b45f0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fd77400c4d0 tx=0x7fd77400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:21.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.063+0000 7fd76bfff640 1 -- 172.21.15.77:0/332743397 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7740074e0 con 0x7fd7840cde60 2023-11-04T01:45:21.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.063+0000 7fd76bfff640 1 -- 172.21.15.77:0/332743397 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd774007640 con 0x7fd7840cde60 2023-11-04T01:45:21.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.063+0000 7fd76bfff640 1 -- 172.21.15.77:0/332743397 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd774004a20 con 0x7fd7840cde60 2023-11-04T01:45:21.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.063+0000 7fd789955640 1 -- 172.21.15.77:0/332743397 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7780094d0 con 0x7fd7840cde60 2023-11-04T01:45:21.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.063+0000 7fd789955640 1 -- 172.21.15.77:0/332743397 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7840cb100 con 0x7fd7840cde60 2023-11-04T01:45:21.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.064+0000 7fd789955640 1 -- 172.21.15.77:0/332743397 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7840cc930 con 0x7fd7840cde60 2023-11-04T01:45:21.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.064+0000 7fd76bfff640 1 -- 172.21.15.77:0/332743397 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd774004b80 con 0x7fd7840cde60 2023-11-04T01:45:21.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.065+0000 7fd76bfff640 1 --2- 172.21.15.77:0/332743397 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd77006aea0 0x7fd77006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:21.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.065+0000 7fd76bfff640 1 -- 172.21.15.77:0/332743397 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7fd774089a70 con 0x7fd7840cde60 2023-11-04T01:45:21.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.065+0000 7fd7827fc640 1 --2- 172.21.15.77:0/332743397 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd77006aea0 0x7fd77006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:21.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.065+0000 7fd7827fc640 1 --2- 172.21.15.77:0/332743397 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd77006aea0 0x7fd77006d360 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fd778036000 tx=0x7fd778008030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:21.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.069+0000 7fd76bfff640 1 -- 172.21.15.77:0/332743397 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd774054460 con 0x7fd7840cde60 2023-11-04T01:45:21.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.271+0000 7fd789955640 1 -- 172.21.15.77:0/332743397 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd784074290 con 0x7fd7840cde60 2023-11-04T01:45:21.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.271+0000 7fd76bfff640 1 -- 172.21.15.77:0/332743397 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+4935 (secure 0 0 0) 0x7fd774057a80 con 0x7fd7840cde60 2023-11-04T01:45:21.274 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:21.274 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":73,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/1345816612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1345816612},{"type":"v1","addr":"172.21.15.122:6836","nonce":1345816612}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:45:09.851981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7743,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7743":{"gid":7743,"name":"a","rank":0,"incarnation":68,"state":"up:active","state_seq":11,"addr":"172.21.15.77:6834/285184758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":285184758},{"type":"v1","addr":"172.21.15.77:6834","nonce":285184758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:21.274 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 73 2023-11-04T01:45:21.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.273+0000 7fd789955640 1 -- 172.21.15.77:0/332743397 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd77006aea0 msgr2=0x7fd77006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:21.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.273+0000 7fd789955640 1 --2- 172.21.15.77:0/332743397 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd77006aea0 0x7fd77006d360 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fd778036000 tx=0x7fd778008030 comp rx=0 tx=0).stop 2023-11-04T01:45:21.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.273+0000 7fd789955640 1 -- 172.21.15.77:0/332743397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7840cde60 msgr2=0x7fd7840b45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:21.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.273+0000 7fd789955640 1 --2- 172.21.15.77:0/332743397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7840cde60 0x7fd7840b45f0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fd77400c4d0 tx=0x7fd77400c8d0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.273+0000 7fd789955640 1 -- 172.21.15.77:0/332743397 shutdown_connections 2023-11-04T01:45:21.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.273+0000 7fd789955640 1 --2- 172.21.15.77:0/332743397 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd77006aea0 0x7fd77006d360 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.273+0000 7fd789955640 1 --2- 172.21.15.77:0/332743397 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd784157540 0x7fd78415b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.273+0000 7fd789955640 1 --2- 172.21.15.77:0/332743397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7840ce240 0x7fd78415b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.274+0000 7fd789955640 1 --2- 172.21.15.77:0/332743397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7840cde60 0x7fd7840b45f0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.274+0000 7fd789955640 1 -- 172.21.15.77:0/332743397 >> 172.21.15.77:0/332743397 conn(0x7fd784071f30 msgr2=0x7fd7840c91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:21.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.274+0000 7fd789955640 1 -- 172.21.15.77:0/332743397 shutdown_connections 2023-11-04T01:45:21.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:21.274+0000 7fd789955640 1 -- 172.21.15.77:0/332743397 wait complete. 2023-11-04T01:45:21.286 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:45:26.287 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:26.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.397+0000 7f58f4c00640 1 Processor -- start 2023-11-04T01:45:26.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.397+0000 7f58f4c00640 1 -- start start 2023-11-04T01:45:26.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.397+0000 7f58f4c00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f58f015ce60 0x7f58f006b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:26.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.398+0000 7f58f4c00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58f01615d0 con 0x7f58f00cf160 2023-11-04T01:45:26.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.398+0000 7f58f4c00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58f01618b0 con 0x7f58f006bd30 2023-11-04T01:45:26.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.398+0000 7f58f4c00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58f00cbde0 con 0x7f58f015ce60 2023-11-04T01:45:26.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.398+0000 7f58ee59c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f58f015ce60 0x7f58f006b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:26.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.398+0000 7f58ee59c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f58f015ce60 0x7f58f006b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52378/0 (socket says 172.21.15.77:52378) 2023-11-04T01:45:26.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.398+0000 7f58eed9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f58f00cf160 0x7f58f00cc200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:50334/0 (socket says 172.21.15.77:50334) 2023-11-04T01:45:26.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.398+0000 7f58ee59c640 1 -- 172.21.15.77:0/1291320562 learned_addr learned my addr 172.21.15.77:0/1291320562 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:26.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.398+0000 7f58ee59c640 1 -- 172.21.15.77:0/1291320562 >> v1:172.21.15.122:6789/0 conn(0x7f58f006bd30 legacy=0x7f58f0160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:26.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.398+0000 7f58ee59c640 1 -- 172.21.15.77:0/1291320562 >> v1:172.21.15.77:6789/0 conn(0x7f58f00cf160 legacy=0x7f58f00cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:26.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.398+0000 7f58ee59c640 1 -- 172.21.15.77:0/1291320562 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f00cba00 con 0x7f58f015ce60 2023-11-04T01:45:26.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.399+0000 7f58ee59c640 1 --2- 172.21.15.77:0/1291320562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58f015ce60 0x7f58f006b7f0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f58e0009870 tx=0x7f58e002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db3dc6d9fca61eb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:26.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.399+0000 7f58edd9b640 1 -- 172.21.15.77:0/1291320562 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e0030860 con 0x7f58f015ce60 2023-11-04T01:45:26.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.399+0000 7f58edd9b640 1 -- 172.21.15.77:0/1291320562 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e00309c0 con 0x7f58f015ce60 2023-11-04T01:45:26.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.399+0000 7f58edd9b640 1 -- 172.21.15.77:0/1291320562 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e0030d50 con 0x7f58f015ce60 2023-11-04T01:45:26.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.399+0000 7f58f4c00640 1 -- 172.21.15.77:0/1291320562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58f015ce60 msgr2=0x7f58f006b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:26.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.399+0000 7f58f4c00640 1 --2- 172.21.15.77:0/1291320562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58f015ce60 0x7f58f006b7f0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f58e0009870 tx=0x7f58e002b9a0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.400+0000 7f58f4c00640 1 -- 172.21.15.77:0/1291320562 shutdown_connections 2023-11-04T01:45:26.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.400+0000 7f58f4c00640 1 --2- 172.21.15.77:0/1291320562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58f015ce60 0x7f58f006b7f0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.400+0000 7f58f4c00640 1 -- 172.21.15.77:0/1291320562 >> 172.21.15.77:0/1291320562 conn(0x7f58f006ea90 msgr2=0x7f58f006ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:26.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.400+0000 7f58f4c00640 1 -- 172.21.15.77:0/1291320562 shutdown_connections 2023-11-04T01:45:26.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.400+0000 7f58f4c00640 1 -- 172.21.15.77:0/1291320562 wait complete. 2023-11-04T01:45:26.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.401+0000 7f58f4c00640 1 Processor -- start 2023-11-04T01:45:26.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.401+0000 7f58f4c00640 1 -- start start 2023-11-04T01:45:26.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.402+0000 7f58f4c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58f00cf160 0x7f58f014f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:26.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.402+0000 7f58f4c00640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f58f015ce60 0x7f58f00b5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:26.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.402+0000 7f58f4c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58f00c5f00 0x7f58f00b5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:26.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.402+0000 7f58f4c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f00c91e0 con 0x7f58f00c5f00 2023-11-04T01:45:26.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.402+0000 7f58f4c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f015dfa0 con 0x7f58f00cf160 2023-11-04T01:45:26.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.402+0000 7f58f4c00640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f015d240 con 0x7f58f015ce60 2023-11-04T01:45:26.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.402+0000 7f58eed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58f00c5f00 0x7f58f00b5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:26.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.402+0000 7f58eed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58f00c5f00 0x7f58f00b5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52394/0 (socket says 172.21.15.77:52394) 2023-11-04T01:45:26.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.402+0000 7f58eed9d640 1 -- 172.21.15.77:0/3819768638 learned_addr learned my addr 172.21.15.77:0/3819768638 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:26.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.402+0000 7f58ee59c640 1 --2- 172.21.15.77:0/3819768638 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58f00cf160 0x7f58f014f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:26.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.402+0000 7f58eed9d640 1 -- 172.21.15.77:0/3819768638 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f58f015ce60 msgr2=0x7f58f00b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:26.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.402+0000 7f58eed9d640 1 --2- 172.21.15.77:0/3819768638 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f58f015ce60 0x7f58f00b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.402+0000 7f58eed9d640 1 -- 172.21.15.77:0/3819768638 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58f00cf160 msgr2=0x7f58f014f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:26.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.402+0000 7f58eed9d640 1 --2- 172.21.15.77:0/3819768638 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58f00cf160 0x7f58f014f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.402+0000 7f58eed9d640 1 -- 172.21.15.77:0/3819768638 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e00094d0 con 0x7f58f00c5f00 2023-11-04T01:45:26.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.402+0000 7f58ee59c640 1 --2- 172.21.15.77:0/3819768638 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58f00cf160 0x7f58f014f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:26.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.402+0000 7f58eed9d640 1 --2- 172.21.15.77:0/3819768638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58f00c5f00 0x7f58f00b5ed0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f58e800c780 tx=0x7f58e800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:26.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.402+0000 7f58e6ffd640 1 -- 172.21.15.77:0/3819768638 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e800ce90 con 0x7f58f00c5f00 2023-11-04T01:45:26.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.402+0000 7f58e6ffd640 1 -- 172.21.15.77:0/3819768638 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e800a640 con 0x7f58f00c5f00 2023-11-04T01:45:26.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.402+0000 7f58e6ffd640 1 -- 172.21.15.77:0/3819768638 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e800a9f0 con 0x7f58f00c5f00 2023-11-04T01:45:26.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.402+0000 7f58f4c00640 1 -- 172.21.15.77:0/3819768638 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58f015d520 con 0x7f58f00c5f00 2023-11-04T01:45:26.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.403+0000 7f58f4c00640 1 -- 172.21.15.77:0/3819768638 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f014f910 con 0x7f58f00c5f00 2023-11-04T01:45:26.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.403+0000 7f58f4c00640 1 -- 172.21.15.77:0/3819768638 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58f0074290 con 0x7f58f00c5f00 2023-11-04T01:45:26.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.404+0000 7f58e6ffd640 1 -- 172.21.15.77:0/3819768638 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f58e800ab50 con 0x7f58f00c5f00 2023-11-04T01:45:26.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.404+0000 7f58e6ffd640 1 --2- 172.21.15.77:0/3819768638 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f58d006aea0 0x7f58d006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:26.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.404+0000 7f58e6ffd640 1 -- 172.21.15.77:0/3819768638 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7f58e8089420 con 0x7f58f00c5f00 2023-11-04T01:45:26.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.405+0000 7f58ee59c640 1 --2- 172.21.15.77:0/3819768638 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f58d006aea0 0x7f58d006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:26.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.405+0000 7f58ee59c640 1 --2- 172.21.15.77:0/3819768638 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f58d006aea0 0x7f58d006d360 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f58e0036000 tx=0x7f58e003b040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:26.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.408+0000 7f58e6ffd640 1 -- 172.21.15.77:0/3819768638 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f58e8053ec0 con 0x7f58f00c5f00 2023-11-04T01:45:26.577 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~13s 2023-11-04T01:45:26.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.611+0000 7f58f4c00640 1 -- 172.21.15.77:0/3819768638 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58f00b3480 con 0x7f58f00c5f00 2023-11-04T01:45:26.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.612+0000 7f58e6ffd640 1 -- 172.21.15.77:0/3819768638 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4983 (secure 0 0 0) 0x7f58e80574e0 con 0x7f58f00c5f00 2023-11-04T01:45:26.615 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:26.615 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":74,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/1345816612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1345816612},{"type":"v1","addr":"172.21.15.122:6836","nonce":1345816612}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:45:25.602719+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7743,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7743":{"gid":7743,"name":"a","rank":0,"incarnation":68,"state":"up:active","state_seq":11,"addr":"172.21.15.77:6834/285184758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":285184758},{"type":"v1","addr":"172.21.15.77:6834","nonce":285184758}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:45:25.602719+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:26.616 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 74 2023-11-04T01:45:26.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.614+0000 7f58f4c00640 1 -- 172.21.15.77:0/3819768638 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f58d006aea0 msgr2=0x7f58d006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:26.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.614+0000 7f58f4c00640 1 --2- 172.21.15.77:0/3819768638 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f58d006aea0 0x7f58d006d360 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f58e0036000 tx=0x7f58e003b040 comp rx=0 tx=0).stop 2023-11-04T01:45:26.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.614+0000 7f58f4c00640 1 -- 172.21.15.77:0/3819768638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58f00c5f00 msgr2=0x7f58f00b5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:26.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.614+0000 7f58f4c00640 1 --2- 172.21.15.77:0/3819768638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58f00c5f00 0x7f58f00b5ed0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f58e800c780 tx=0x7f58e800cc40 comp rx=0 tx=0).stop 2023-11-04T01:45:26.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.614+0000 7f58f4c00640 1 -- 172.21.15.77:0/3819768638 shutdown_connections 2023-11-04T01:45:26.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.614+0000 7f58f4c00640 1 --2- 172.21.15.77:0/3819768638 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f58d006aea0 0x7f58d006d360 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.614+0000 7f58f4c00640 1 --2- 172.21.15.77:0/3819768638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58f00c5f00 0x7f58f00b5ed0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.614+0000 7f58f4c00640 1 --2- 172.21.15.77:0/3819768638 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f58f015ce60 0x7f58f00b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.614+0000 7f58f4c00640 1 --2- 172.21.15.77:0/3819768638 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58f00cf160 0x7f58f014f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.614+0000 7f58f4c00640 1 -- 172.21.15.77:0/3819768638 >> 172.21.15.77:0/3819768638 conn(0x7f58f006ea90 msgr2=0x7f58f00c4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:26.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.614+0000 7f58f4c00640 1 -- 172.21.15.77:0/3819768638 shutdown_connections 2023-11-04T01:45:26.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.614+0000 7f58f4c00640 1 -- 172.21.15.77:0/3819768638 wait complete. 2023-11-04T01:45:26.627 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-11-04T01:45:26.628 DEBUG:teuthology.orchestra.run.smithi077:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:45:26.653 INFO:teuthology.orchestra.run.smithi077.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:45:26.654 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:45:26.655 DEBUG:teuthology.orchestra.run.smithi077:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:45:26.724 INFO:teuthology.orchestra.run.smithi077.stdout:1699062310.149897.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i a', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:45:26.725 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062310.149897.core'] 2023-11-04T01:45:26.726 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062310.149897.core, deleting it 2023-11-04T01:45:26.726 DEBUG:teuthology.orchestra.run.smithi077:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062310.149897.core 2023-11-04T01:45:26.795 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:45:26.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.932+0000 7fc132590640 1 Processor -- start 2023-11-04T01:45:26.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.932+0000 7fc132590640 1 -- start start 2023-11-04T01:45:26.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.933+0000 7fc132590640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc12c159c00 0x7fc12c0cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:26.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.933+0000 7fc132590640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc12c0c48e0 0x7fc12c0c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:26.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.933+0000 7fc132590640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc12c0adac0 0x7fc12c0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:26.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.933+0000 7fc132590640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc12c0c52d0 con 0x7fc12c0adac0 2023-11-04T01:45:26.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.933+0000 7fc132590640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc12c15aff0 con 0x7fc12c159c00 2023-11-04T01:45:26.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.933+0000 7fc132590640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c0ae450 con 0x7fc12c0c48e0 2023-11-04T01:45:26.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.933+0000 7fc130b2d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc12c0adac0 0x7fc12c0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:26.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.933+0000 7fc130b2d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc12c0adac0 0x7fc12c0adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52400/0 (socket says 172.21.15.77:52400) 2023-11-04T01:45:26.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.933+0000 7fc130b2d640 1 -- 172.21.15.77:0/4081586659 learned_addr learned my addr 172.21.15.77:0/4081586659 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:26.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.933+0000 7fc12b7fe640 1 --2- 172.21.15.77:0/4081586659 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc12c0c48e0 0x7fc12c0c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:26.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.933+0000 7fc12bfff640 1 --2- 172.21.15.77:0/4081586659 >> v2:172.21.15.122:3300/0 conn(0x7fc12c159c00 0x7fc12c0cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:26.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.933+0000 7fc130b2d640 1 -- 172.21.15.77:0/4081586659 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc12c0c48e0 msgr2=0x7fc12c0c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:26.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.933+0000 7fc130b2d640 1 --2- 172.21.15.77:0/4081586659 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc12c0c48e0 0x7fc12c0c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.933+0000 7fc130b2d640 1 -- 172.21.15.77:0/4081586659 >> v2:172.21.15.122:3300/0 conn(0x7fc12c159c00 msgr2=0x7fc12c0cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:26.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.933+0000 7fc130b2d640 1 --2- 172.21.15.77:0/4081586659 >> v2:172.21.15.122:3300/0 conn(0x7fc12c159c00 0x7fc12c0cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.933+0000 7fc130b2d640 1 -- 172.21.15.77:0/4081586659 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc12c15a3e0 con 0x7fc12c0adac0 2023-11-04T01:45:26.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.934+0000 7fc130b2d640 1 --2- 172.21.15.77:0/4081586659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc12c0adac0 0x7fc12c0adf10 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fc12c0cc4d0 tx=0x7fc12402e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20c736236a4a3409 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:26.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.934+0000 7fc12affd640 1 -- 172.21.15.77:0/4081586659 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12402ea80 con 0x7fc12c0adac0 2023-11-04T01:45:26.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.934+0000 7fc12affd640 1 -- 172.21.15.77:0/4081586659 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc12402ebe0 con 0x7fc12c0adac0 2023-11-04T01:45:26.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.934+0000 7fc12affd640 1 -- 172.21.15.77:0/4081586659 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc124009600 con 0x7fc12c0adac0 2023-11-04T01:45:26.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.934+0000 7fc132590640 1 -- 172.21.15.77:0/4081586659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc12c0adac0 msgr2=0x7fc12c0adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:26.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.934+0000 7fc132590640 1 --2- 172.21.15.77:0/4081586659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc12c0adac0 0x7fc12c0adf10 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fc12c0cc4d0 tx=0x7fc12402e0e0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.934+0000 7fc132590640 1 -- 172.21.15.77:0/4081586659 shutdown_connections 2023-11-04T01:45:26.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.934+0000 7fc132590640 1 --2- 172.21.15.77:0/4081586659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc12c0adac0 0x7fc12c0adf10 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.934+0000 7fc132590640 1 --2- 172.21.15.77:0/4081586659 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc12c0c48e0 0x7fc12c0c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.934+0000 7fc132590640 1 --2- 172.21.15.77:0/4081586659 >> v2:172.21.15.122:3300/0 conn(0x7fc12c159c00 0x7fc12c0cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.934+0000 7fc132590640 1 -- 172.21.15.77:0/4081586659 >> 172.21.15.77:0/4081586659 conn(0x7fc12c0ce950 msgr2=0x7fc12c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:26.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.934+0000 7fc132590640 1 -- 172.21.15.77:0/4081586659 shutdown_connections 2023-11-04T01:45:26.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.934+0000 7fc132590640 1 -- 172.21.15.77:0/4081586659 wait complete. 2023-11-04T01:45:26.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.936+0000 7fc132590640 1 Processor -- start 2023-11-04T01:45:26.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.936+0000 7fc132590640 1 -- start start 2023-11-04T01:45:26.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.937+0000 7fc132590640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc12c0adac0 0x7fc12c0ace10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:26.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.937+0000 7fc132590640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc12c0c48e0 0x7fc12c14b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:26.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.937+0000 7fc132590640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc12c159c00 0x7fc12c0ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:26.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.937+0000 7fc132590640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c0ad350 con 0x7fc12c0adac0 2023-11-04T01:45:26.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.937+0000 7fc132590640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c0c5fe0 con 0x7fc12c159c00 2023-11-04T01:45:26.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.937+0000 7fc132590640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c14dfb0 con 0x7fc12c0c48e0 2023-11-04T01:45:26.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.937+0000 7fc12bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc12c0adac0 0x7fc12c0ace10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:26.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.937+0000 7fc12bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc12c0adac0 0x7fc12c0ace10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52402/0 (socket says 172.21.15.77:52402) 2023-11-04T01:45:26.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.937+0000 7fc12bfff640 1 -- 172.21.15.77:0/443593636 learned_addr learned my addr 172.21.15.77:0/443593636 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:26.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.937+0000 7fc12bfff640 1 -- 172.21.15.77:0/443593636 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc12c0c48e0 msgr2=0x7fc12c14b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:26.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.937+0000 7fc12bfff640 1 --2- 172.21.15.77:0/443593636 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc12c0c48e0 0x7fc12c14b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.937+0000 7fc12bfff640 1 -- 172.21.15.77:0/443593636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc12c159c00 msgr2=0x7fc12c0ab8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:26.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.937+0000 7fc12bfff640 1 --2- 172.21.15.77:0/443593636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc12c159c00 0x7fc12c0ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.937+0000 7fc12bfff640 1 -- 172.21.15.77:0/443593636 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc12400bd40 con 0x7fc12c0adac0 2023-11-04T01:45:26.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.937+0000 7fc12bfff640 1 --2- 172.21.15.77:0/443593636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc12c0adac0 0x7fc12c0ace10 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fc12000d5f0 tx=0x7fc12000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:26.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.937+0000 7fc128ff9640 1 -- 172.21.15.77:0/443593636 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1200125f0 con 0x7fc12c0adac0 2023-11-04T01:45:26.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.937+0000 7fc128ff9640 1 -- 172.21.15.77:0/443593636 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc120012750 con 0x7fc12c0adac0 2023-11-04T01:45:26.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.937+0000 7fc128ff9640 1 -- 172.21.15.77:0/443593636 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc120012b00 con 0x7fc12c0adac0 2023-11-04T01:45:26.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.937+0000 7fc132590640 1 -- 172.21.15.77:0/443593636 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc12c14e290 con 0x7fc12c0adac0 2023-11-04T01:45:26.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.937+0000 7fc132590640 1 -- 172.21.15.77:0/443593636 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc12c0c64d0 con 0x7fc12c0adac0 2023-11-04T01:45:26.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.938+0000 7fc132590640 1 -- 172.21.15.77:0/443593636 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc12c0c6690 con 0x7fc12c0adac0 2023-11-04T01:45:26.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.939+0000 7fc128ff9640 1 -- 172.21.15.77:0/443593636 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc120012c60 con 0x7fc12c0adac0 2023-11-04T01:45:26.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.939+0000 7fc128ff9640 1 --2- 172.21.15.77:0/443593636 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc11806ae70 0x7fc11806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:26.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.939+0000 7fc128ff9640 1 -- 172.21.15.77:0/443593636 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7436+0+0 (secure 0 0 0) 0x7fc12008a180 con 0x7fc12c0adac0 2023-11-04T01:45:26.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.939+0000 7fc12b7fe640 1 --2- 172.21.15.77:0/443593636 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc11806ae70 0x7fc11806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:26.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.940+0000 7fc12b7fe640 1 --2- 172.21.15.77:0/443593636 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc11806ae70 0x7fc11806d330 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc12c158e10 tx=0x7fc11c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:26.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:26.943+0000 7fc128ff9640 1 -- 172.21.15.77:0/443593636 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc120054b70 con 0x7fc12c0adac0 2023-11-04T01:45:27.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.179+0000 7fc132590640 1 -- 172.21.15.77:0/443593636 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7fc12c14e480 con 0x7fc12c0adac0 2023-11-04T01:45:27.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.182+0000 7fc128ff9640 1 -- 172.21.15.77:0/443593636 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 7743 v75) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc120058190 con 0x7fc12c0adac0 2023-11-04T01:45:27.184 INFO:teuthology.orchestra.run.smithi077.stderr:failed mds gid 7743 2023-11-04T01:45:27.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.184+0000 7fc132590640 1 -- 172.21.15.77:0/443593636 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc11806ae70 msgr2=0x7fc11806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:27.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.184+0000 7fc132590640 1 --2- 172.21.15.77:0/443593636 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc11806ae70 0x7fc11806d330 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc12c158e10 tx=0x7fc11c008040 comp rx=0 tx=0).stop 2023-11-04T01:45:27.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.184+0000 7fc132590640 1 -- 172.21.15.77:0/443593636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc12c0adac0 msgr2=0x7fc12c0ace10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:27.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.184+0000 7fc132590640 1 --2- 172.21.15.77:0/443593636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc12c0adac0 0x7fc12c0ace10 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fc12000d5f0 tx=0x7fc12000dab0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.185+0000 7fc132590640 1 -- 172.21.15.77:0/443593636 shutdown_connections 2023-11-04T01:45:27.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.185+0000 7fc132590640 1 --2- 172.21.15.77:0/443593636 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc11806ae70 0x7fc11806d330 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.185+0000 7fc132590640 1 --2- 172.21.15.77:0/443593636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc12c159c00 0x7fc12c0ab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.185+0000 7fc132590640 1 --2- 172.21.15.77:0/443593636 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc12c0c48e0 0x7fc12c14b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.185+0000 7fc132590640 1 --2- 172.21.15.77:0/443593636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc12c0adac0 0x7fc12c0ace10 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.185+0000 7fc132590640 1 -- 172.21.15.77:0/443593636 >> 172.21.15.77:0/443593636 conn(0x7fc12c0ce950 msgr2=0x7fc12c071290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:27.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.185+0000 7fc132590640 1 -- 172.21.15.77:0/443593636 shutdown_connections 2023-11-04T01:45:27.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.185+0000 7fc132590640 1 -- 172.21.15.77:0/443593636 wait complete. 2023-11-04T01:45:27.200 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:45:27.201 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:45:27.201 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:45:27.202 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:45:27.202 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:45:27.202 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi077 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2023-11-04T01:45:27.203 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:45:27.204 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:45:27.206 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:45:27.206 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:27.281 INFO:tasks.ceph.mds.a.smithi077.stdout:starting mds.a at 2023-11-04T01:45:27.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.305+0000 7f1ade3c9640 1 Processor -- start 2023-11-04T01:45:27.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.305+0000 7f1ade3c9640 1 -- start start 2023-11-04T01:45:27.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.305+0000 7f1ade3c9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1ad815ad80 0x7f1ad80abe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:27.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.305+0000 7f1ade3c9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ad806a1b0 0x7f1ad806b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:27.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.305+0000 7f1ade3c9640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad806cf60 con 0x7f1ad80c9a40 2023-11-04T01:45:27.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.305+0000 7f1ade3c9640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad80ac390 con 0x7f1ad815ad80 2023-11-04T01:45:27.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.305+0000 7f1ade3c9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad815b160 con 0x7f1ad806a1b0 2023-11-04T01:45:27.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.306+0000 7f1ad77fe640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ad806a1b0 0x7f1ad806b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:27.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.306+0000 7f1ad7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1ad815ad80 0x7f1ad80abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:27.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.306+0000 7f1adc966640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f1ad80c9a40 0x7f1ad806dce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:42038/0 (socket says 172.21.15.77:42038) 2023-11-04T01:45:27.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.306+0000 7f1adc966640 1 -- 172.21.15.77:0/1293645692 learned_addr learned my addr 172.21.15.77:0/1293645692 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:45:27.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.306+0000 7f1ad6ffd640 1 -- 172.21.15.77:0/1293645692 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3202336665 0 0) 0x7f1ad806cf60 con 0x7f1ad80c9a40 2023-11-04T01:45:27.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.306+0000 7f1ad77fe640 1 -- 172.21.15.77:0/1293645692 >> v2:172.21.15.122:3300/0 conn(0x7f1ad815ad80 msgr2=0x7f1ad80abe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:27.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.306+0000 7f1ad77fe640 1 --2- 172.21.15.77:0/1293645692 >> v2:172.21.15.122:3300/0 conn(0x7f1ad815ad80 0x7f1ad80abe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.306+0000 7f1ad77fe640 1 -- 172.21.15.77:0/1293645692 >> v1:172.21.15.122:6789/0 conn(0x7f1ad80c9a40 legacy=0x7f1ad806dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:27.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.306+0000 7f1ad77fe640 1 -- 172.21.15.77:0/1293645692 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad806b9b0 con 0x7f1ad806a1b0 2023-11-04T01:45:27.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.306+0000 7f1ad7fff640 1 --2- 172.21.15.77:0/1293645692 >> v2:172.21.15.122:3300/0 conn(0x7f1ad815ad80 0x7f1ad80abe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:45:27.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.307+0000 7f1ad77fe640 1 --2- 172.21.15.77:0/1293645692 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ad806a1b0 0x7f1ad806b010 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1acc0097a0 tx=0x7f1acc02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d924b7fe8eec02c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:27.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.307+0000 7f1ad6ffd640 1 -- 172.21.15.77:0/1293645692 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc02d040 con 0x7f1ad806a1b0 2023-11-04T01:45:27.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.307+0000 7f1ad6ffd640 1 -- 172.21.15.77:0/1293645692 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1acc031810 con 0x7f1ad806a1b0 2023-11-04T01:45:27.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.307+0000 7f1ad6ffd640 1 -- 172.21.15.77:0/1293645692 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc031ba0 con 0x7f1ad806a1b0 2023-11-04T01:45:27.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.308+0000 7f1ade3c9640 1 -- 172.21.15.77:0/1293645692 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ad806a1b0 msgr2=0x7f1ad806b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:27.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.308+0000 7f1ade3c9640 1 --2- 172.21.15.77:0/1293645692 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ad806a1b0 0x7f1ad806b010 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1acc0097a0 tx=0x7f1acc02b8b0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.308+0000 7f1ade3c9640 1 -- 172.21.15.77:0/1293645692 shutdown_connections 2023-11-04T01:45:27.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.308+0000 7f1ade3c9640 1 --2- 172.21.15.77:0/1293645692 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ad806a1b0 0x7f1ad806b010 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.308+0000 7f1ade3c9640 1 --2- 172.21.15.77:0/1293645692 >> v2:172.21.15.122:3300/0 conn(0x7f1ad815ad80 0x7f1ad80abe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.308+0000 7f1ade3c9640 1 -- 172.21.15.77:0/1293645692 >> 172.21.15.77:0/1293645692 conn(0x7f1ad80b0cd0 msgr2=0x7f1ad80b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:27.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.308+0000 7f1ade3c9640 1 -- 172.21.15.77:0/1293645692 shutdown_connections 2023-11-04T01:45:27.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.308+0000 7f1ade3c9640 1 -- 172.21.15.77:0/1293645692 wait complete. 2023-11-04T01:45:27.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.309+0000 7f1ade3c9640 1 Processor -- start 2023-11-04T01:45:27.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.309+0000 7f1ade3c9640 1 -- start start 2023-11-04T01:45:27.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.310+0000 7f1ade3c9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ad806a1b0 0x7f1ad814b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:27.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.310+0000 7f1ade3c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ad80c9a40 0x7f1ad81555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:27.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.310+0000 7f1ade3c9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ad815ad80 0x7f1ad8155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:27.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.310+0000 7f1ade3c9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad80c6f00 con 0x7f1ad80c9a40 2023-11-04T01:45:27.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.310+0000 7f1ade3c9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad80c71e0 con 0x7f1ad815ad80 2023-11-04T01:45:27.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.310+0000 7f1ade3c9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad80c74c0 con 0x7f1ad806a1b0 2023-11-04T01:45:27.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.310+0000 7f1ad77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ad80c9a40 0x7f1ad81555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:27.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.310+0000 7f1ad77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ad80c9a40 0x7f1ad81555c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52422/0 (socket says 172.21.15.77:52422) 2023-11-04T01:45:27.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.310+0000 7f1adc966640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ad815ad80 0x7f1ad8155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:27.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.310+0000 7f1ad77fe640 1 -- 172.21.15.77:0/711680822 learned_addr learned my addr 172.21.15.77:0/711680822 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:27.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.310+0000 7f1ad7fff640 1 --2- 172.21.15.77:0/711680822 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ad806a1b0 0x7f1ad814b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:27.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.310+0000 7f1ad77fe640 1 -- 172.21.15.77:0/711680822 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ad806a1b0 msgr2=0x7f1ad814b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:27.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.310+0000 7f1ad77fe640 1 --2- 172.21.15.77:0/711680822 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ad806a1b0 0x7f1ad814b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.310+0000 7f1ad77fe640 1 -- 172.21.15.77:0/711680822 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ad815ad80 msgr2=0x7f1ad8155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:27.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.310+0000 7f1ad77fe640 1 --2- 172.21.15.77:0/711680822 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ad815ad80 0x7f1ad8155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.310+0000 7f1ad77fe640 1 -- 172.21.15.77:0/711680822 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac8009400 con 0x7f1ad80c9a40 2023-11-04T01:45:27.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.311+0000 7f1ad77fe640 1 --2- 172.21.15.77:0/711680822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ad80c9a40 0x7f1ad81555c0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f1acc0097a0 tx=0x7f1acc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:27.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.311+0000 7f1ad4ff9640 1 -- 172.21.15.77:0/711680822 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc006e10 con 0x7f1ad80c9a40 2023-11-04T01:45:27.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.311+0000 7f1ad4ff9640 1 -- 172.21.15.77:0/711680822 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1acc03bb60 con 0x7f1ad80c9a40 2023-11-04T01:45:27.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.311+0000 7f1ade3c9640 1 -- 172.21.15.77:0/711680822 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1acc009400 con 0x7f1ad80c9a40 2023-11-04T01:45:27.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.311+0000 7f1ad4ff9640 1 -- 172.21.15.77:0/711680822 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc004030 con 0x7f1ad80c9a40 2023-11-04T01:45:27.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.311+0000 7f1ade3c9640 1 -- 172.21.15.77:0/711680822 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad814bb10 con 0x7f1ad80c9a40 2023-11-04T01:45:27.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.312+0000 7f1ade3c9640 1 -- 172.21.15.77:0/711680822 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad8074290 con 0x7f1ad80c9a40 2023-11-04T01:45:27.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.312+0000 7f1ad4ff9640 1 -- 172.21.15.77:0/711680822 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1acc043070 con 0x7f1ad80c9a40 2023-11-04T01:45:27.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.313+0000 7f1ad4ff9640 1 --2- 172.21.15.77:0/711680822 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1ac406ae70 0x7f1ac406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:27.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.313+0000 7f1ad4ff9640 1 -- 172.21.15.77:0/711680822 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7f1acc0aba10 con 0x7f1ad80c9a40 2023-11-04T01:45:27.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.313+0000 7f1ad7fff640 1 --2- 172.21.15.77:0/711680822 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1ac406ae70 0x7f1ac406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:27.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.313+0000 7f1ad7fff640 1 --2- 172.21.15.77:0/711680822 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1ac406ae70 0x7f1ac406d330 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8009c30 tx=0x7f1ac8009190 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:27.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.317+0000 7f1ad4ff9640 1 -- 172.21.15.77:0/711680822 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1acc0763c0 con 0x7f1ad80c9a40 2023-11-04T01:45:27.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.519+0000 7f1ade3c9640 1 -- 172.21.15.77:0/711680822 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ad806d1d0 con 0x7f1ad80c9a40 2023-11-04T01:45:27.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.519+0000 7f1ad4ff9640 1 -- 172.21.15.77:0/711680822 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4146 (secure 0 0 0) 0x7f1acc0799e0 con 0x7f1ad80c9a40 2023-11-04T01:45:27.522 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:27.523 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":76,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:45:27.186789+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6640,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6640":{"gid":6640,"name":"b","rank":0,"incarnation":76,"state":"up:replay","state_seq":1,"addr":"172.21.15.122:6836/1345816612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1345816612},{"type":"v1","addr":"172.21.15.122:6836","nonce":1345816612}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:27.523 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 76 2023-11-04T01:45:27.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.521+0000 7f1ade3c9640 1 -- 172.21.15.77:0/711680822 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1ac406ae70 msgr2=0x7f1ac406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:27.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.521+0000 7f1ade3c9640 1 --2- 172.21.15.77:0/711680822 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1ac406ae70 0x7f1ac406d330 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8009c30 tx=0x7f1ac8009190 comp rx=0 tx=0).stop 2023-11-04T01:45:27.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.521+0000 7f1ade3c9640 1 -- 172.21.15.77:0/711680822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ad80c9a40 msgr2=0x7f1ad81555c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:27.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.521+0000 7f1ade3c9640 1 --2- 172.21.15.77:0/711680822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ad80c9a40 0x7f1ad81555c0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f1acc0097a0 tx=0x7f1acc0046c0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.521+0000 7f1ade3c9640 1 -- 172.21.15.77:0/711680822 shutdown_connections 2023-11-04T01:45:27.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.521+0000 7f1ade3c9640 1 --2- 172.21.15.77:0/711680822 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1ac406ae70 0x7f1ac406d330 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.521+0000 7f1ade3c9640 1 --2- 172.21.15.77:0/711680822 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ad815ad80 0x7f1ad8155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.521+0000 7f1ade3c9640 1 --2- 172.21.15.77:0/711680822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ad80c9a40 0x7f1ad81555c0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.521+0000 7f1ade3c9640 1 --2- 172.21.15.77:0/711680822 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ad806a1b0 0x7f1ad814b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.521+0000 7f1ade3c9640 1 -- 172.21.15.77:0/711680822 >> 172.21.15.77:0/711680822 conn(0x7f1ad80b0cd0 msgr2=0x7f1ad80ad1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:27.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.522+0000 7f1ade3c9640 1 -- 172.21.15.77:0/711680822 shutdown_connections 2023-11-04T01:45:27.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:27.522+0000 7f1ade3c9640 1 -- 172.21.15.77:0/711680822 wait complete. 2023-11-04T01:45:27.535 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:45:30.922 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:45:30.925 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:45:32.536 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:32.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.645+0000 7fb292f0f640 1 Processor -- start 2023-11-04T01:45:32.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.645+0000 7fb292f0f640 1 -- start start 2023-11-04T01:45:32.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.646+0000 7fb292f0f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb28c159c70 0x7fb28c0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.646+0000 7fb292f0f640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb28c06db20 0x7fb28c0b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.646+0000 7fb292f0f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb28c0b4110 con 0x7fb28c0b0910 2023-11-04T01:45:32.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.646+0000 7fb292f0f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb28c0b49b0 con 0x7fb28c159c70 2023-11-04T01:45:32.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.646+0000 7fb292f0f640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb28c0b0da0 con 0x7fb28c06db20 2023-11-04T01:45:32.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.646+0000 7fb2914ac640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb28c0b0910 0x7fb28c15d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35668/0 (socket says 172.21.15.77:35668) 2023-11-04T01:45:32.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.646+0000 7fb290cab640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb28c159c70 0x7fb28c0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:32.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.646+0000 7fb2914ac640 1 -- 172.21.15.77:0/3144518224 learned_addr learned my addr 172.21.15.77:0/3144518224 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:45:32.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.647+0000 7fb28bfff640 1 --2- 172.21.15.77:0/3144518224 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb28c06db20 0x7fb28c0b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:32.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.647+0000 7fb28b7fe640 1 -- 172.21.15.77:0/3144518224 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 473305699 0 0) 0x7fb28c0b4110 con 0x7fb28c0b0910 2023-11-04T01:45:32.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.647+0000 7fb28b7fe640 1 -- 172.21.15.77:0/3144518224 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb274003520 con 0x7fb28c0b0910 2023-11-04T01:45:32.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.647+0000 7fb290cab640 1 -- 172.21.15.77:0/3144518224 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb28c06db20 msgr2=0x7fb28c0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:32.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.647+0000 7fb290cab640 1 --2- 172.21.15.77:0/3144518224 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb28c06db20 0x7fb28c0b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.647+0000 7fb290cab640 1 -- 172.21.15.77:0/3144518224 >> v1:172.21.15.77:6789/0 conn(0x7fb28c0b0910 legacy=0x7fb28c15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:32.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.647+0000 7fb290cab640 1 -- 172.21.15.77:0/3144518224 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb28c0b43f0 con 0x7fb28c159c70 2023-11-04T01:45:32.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.647+0000 7fb28bfff640 1 --2- 172.21.15.77:0/3144518224 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb28c06db20 0x7fb28c0b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:32.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.647+0000 7fb290cab640 1 --2- 172.21.15.77:0/3144518224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb28c159c70 0x7fb28c0ce370 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fb27c0097a0 tx=0x7fb27c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aba51fd11d1cf8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:32.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.648+0000 7fb28b7fe640 1 -- 172.21.15.77:0/3144518224 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27c031830 con 0x7fb28c159c70 2023-11-04T01:45:32.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.648+0000 7fb28b7fe640 1 -- 172.21.15.77:0/3144518224 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27c031990 con 0x7fb28c159c70 2023-11-04T01:45:32.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.648+0000 7fb28b7fe640 1 -- 172.21.15.77:0/3144518224 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27c031d00 con 0x7fb28c159c70 2023-11-04T01:45:32.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.648+0000 7fb292f0f640 1 -- 172.21.15.77:0/3144518224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb28c159c70 msgr2=0x7fb28c0ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:32.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.648+0000 7fb292f0f640 1 --2- 172.21.15.77:0/3144518224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb28c159c70 0x7fb28c0ce370 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fb27c0097a0 tx=0x7fb27c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.648+0000 7fb292f0f640 1 -- 172.21.15.77:0/3144518224 shutdown_connections 2023-11-04T01:45:32.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.648+0000 7fb292f0f640 1 --2- 172.21.15.77:0/3144518224 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb28c06db20 0x7fb28c0b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.648+0000 7fb292f0f640 1 --2- 172.21.15.77:0/3144518224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb28c159c70 0x7fb28c0ce370 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.648+0000 7fb292f0f640 1 -- 172.21.15.77:0/3144518224 >> 172.21.15.77:0/3144518224 conn(0x7fb28c0ce950 msgr2=0x7fb28c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:32.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.648+0000 7fb292f0f640 1 -- 172.21.15.77:0/3144518224 shutdown_connections 2023-11-04T01:45:32.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.648+0000 7fb292f0f640 1 -- 172.21.15.77:0/3144518224 wait complete. 2023-11-04T01:45:32.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.649+0000 7fb292f0f640 1 Processor -- start 2023-11-04T01:45:32.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.649+0000 7fb292f0f640 1 -- start start 2023-11-04T01:45:32.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.650+0000 7fb292f0f640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb28c06db20 0x7fb28c14de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.650+0000 7fb292f0f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb28c0b0910 0x7fb28c14e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.650+0000 7fb292f0f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb28c159c70 0x7fb28c1ee500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.650+0000 7fb292f0f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28c14e3b0 con 0x7fb28c159c70 2023-11-04T01:45:32.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.650+0000 7fb292f0f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28c151cc0 con 0x7fb28c0b0910 2023-11-04T01:45:32.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.650+0000 7fb292f0f640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb28c14ee90 con 0x7fb28c06db20 2023-11-04T01:45:32.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.650+0000 7fb2914ac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb28c159c70 0x7fb28c1ee500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:32.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.650+0000 7fb2914ac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb28c159c70 0x7fb28c1ee500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49718/0 (socket says 172.21.15.77:49718) 2023-11-04T01:45:32.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.650+0000 7fb2914ac640 1 -- 172.21.15.77:0/3755586169 learned_addr learned my addr 172.21.15.77:0/3755586169 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:32.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.651+0000 7fb28bfff640 1 --2- 172.21.15.77:0/3755586169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb28c0b0910 0x7fb28c14e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:32.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.651+0000 7fb290cab640 1 --2- 172.21.15.77:0/3755586169 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb28c06db20 0x7fb28c14de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:32.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.651+0000 7fb2914ac640 1 -- 172.21.15.77:0/3755586169 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb28c06db20 msgr2=0x7fb28c14de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:32.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.651+0000 7fb2914ac640 1 --2- 172.21.15.77:0/3755586169 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb28c06db20 0x7fb28c14de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.651+0000 7fb2914ac640 1 -- 172.21.15.77:0/3755586169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb28c0b0910 msgr2=0x7fb28c14e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:32.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.651+0000 7fb2914ac640 1 --2- 172.21.15.77:0/3755586169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb28c0b0910 0x7fb28c14e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.651+0000 7fb2914ac640 1 -- 172.21.15.77:0/3755586169 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27c009400 con 0x7fb28c159c70 2023-11-04T01:45:32.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.651+0000 7fb290cab640 1 --2- 172.21.15.77:0/3755586169 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb28c06db20 0x7fb28c14de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:32.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.651+0000 7fb2914ac640 1 --2- 172.21.15.77:0/3755586169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb28c159c70 0x7fb28c1ee500 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fb28400cb40 tx=0x7fb28400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:32.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.651+0000 7fb2897fa640 1 -- 172.21.15.77:0/3755586169 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28400aca0 con 0x7fb28c159c70 2023-11-04T01:45:32.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.651+0000 7fb2897fa640 1 -- 172.21.15.77:0/3755586169 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28400ae00 con 0x7fb28c159c70 2023-11-04T01:45:32.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.651+0000 7fb2897fa640 1 -- 172.21.15.77:0/3755586169 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb284012620 con 0x7fb28c159c70 2023-11-04T01:45:32.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.651+0000 7fb292f0f640 1 -- 172.21.15.77:0/3755586169 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb28c1510b0 con 0x7fb28c159c70 2023-11-04T01:45:32.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.651+0000 7fb292f0f640 1 -- 172.21.15.77:0/3755586169 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb28c151670 con 0x7fb28c159c70 2023-11-04T01:45:32.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.652+0000 7fb292f0f640 1 -- 172.21.15.77:0/3755586169 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb28c074290 con 0x7fb28c159c70 2023-11-04T01:45:32.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.653+0000 7fb2897fa640 1 -- 172.21.15.77:0/3755586169 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb284007070 con 0x7fb28c159c70 2023-11-04T01:45:32.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.653+0000 7fb2897fa640 1 --2- 172.21.15.77:0/3755586169 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb27806ae70 0x7fb27806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.653+0000 7fb2897fa640 1 -- 172.21.15.77:0/3755586169 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7fb284089cc0 con 0x7fb28c159c70 2023-11-04T01:45:32.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.653+0000 7fb290cab640 1 --2- 172.21.15.77:0/3755586169 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb27806ae70 0x7fb27806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:32.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.654+0000 7fb290cab640 1 --2- 172.21.15.77:0/3755586169 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb27806ae70 0x7fb27806d330 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fb27c036000 tx=0x7fb27c03c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:32.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.657+0000 7fb2897fa640 1 -- 172.21.15.77:0/3755586169 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb284054700 con 0x7fb28c159c70 2023-11-04T01:45:32.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.856+0000 7fb292f0f640 1 -- 172.21.15.77:0/3755586169 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb28c15b0a0 con 0x7fb28c159c70 2023-11-04T01:45:32.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.857+0000 7fb2897fa640 1 -- 172.21.15.77:0/3755586169 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4938 (secure 0 0 0) 0x7fb284017090 con 0x7fb28c159c70 2023-11-04T01:45:32.859 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:32.859 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":80,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7977,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/3276812155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3276812155},{"type":"v1","addr":"172.21.15.77:6834","nonce":3276812155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:45:30.197166+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6640,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6640":{"gid":6640,"name":"b","rank":0,"incarnation":76,"state":"up:active","state_seq":11,"addr":"172.21.15.122:6836/1345816612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1345816612},{"type":"v1","addr":"172.21.15.122:6836","nonce":1345816612}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:32.859 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 80 2023-11-04T01:45:32.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.859+0000 7fb292f0f640 1 -- 172.21.15.77:0/3755586169 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb27806ae70 msgr2=0x7fb27806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:32.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.859+0000 7fb292f0f640 1 --2- 172.21.15.77:0/3755586169 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb27806ae70 0x7fb27806d330 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fb27c036000 tx=0x7fb27c03c040 comp rx=0 tx=0).stop 2023-11-04T01:45:32.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.859+0000 7fb292f0f640 1 -- 172.21.15.77:0/3755586169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb28c159c70 msgr2=0x7fb28c1ee500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:32.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.859+0000 7fb292f0f640 1 --2- 172.21.15.77:0/3755586169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb28c159c70 0x7fb28c1ee500 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fb28400cb40 tx=0x7fb28400a060 comp rx=0 tx=0).stop 2023-11-04T01:45:32.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.859+0000 7fb292f0f640 1 -- 172.21.15.77:0/3755586169 shutdown_connections 2023-11-04T01:45:32.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.859+0000 7fb292f0f640 1 --2- 172.21.15.77:0/3755586169 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb27806ae70 0x7fb27806d330 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.859+0000 7fb292f0f640 1 --2- 172.21.15.77:0/3755586169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb28c159c70 0x7fb28c1ee500 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.859+0000 7fb292f0f640 1 --2- 172.21.15.77:0/3755586169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb28c0b0910 0x7fb28c14e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.859+0000 7fb292f0f640 1 --2- 172.21.15.77:0/3755586169 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb28c06db20 0x7fb28c14de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.859+0000 7fb292f0f640 1 -- 172.21.15.77:0/3755586169 >> 172.21.15.77:0/3755586169 conn(0x7fb28c0ce950 msgr2=0x7fb28c158f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:32.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.859+0000 7fb292f0f640 1 -- 172.21.15.77:0/3755586169 shutdown_connections 2023-11-04T01:45:32.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.859+0000 7fb292f0f640 1 -- 172.21.15.77:0/3755586169 wait complete. 2023-11-04T01:45:32.871 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:45:32.871 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:32.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.969+0000 7fef53256640 1 Processor -- start 2023-11-04T01:45:32.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.969+0000 7fef53256640 1 -- start start 2023-11-04T01:45:32.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.970+0000 7fef53256640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fef4c0cda60 0x7fef4c0ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.970+0000 7fef53256640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef4c0cc990 con 0x7fef4c070d40 2023-11-04T01:45:32.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.970+0000 7fef53256640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef4c0ccc70 con 0x7fef4c0b0cd0 2023-11-04T01:45:32.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.970+0000 7fef53256640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef4c0c9ce0 con 0x7fef4c0cda60 2023-11-04T01:45:32.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.970+0000 7fef517f3640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fef4c070d40 0x7fef4c06c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35676/0 (socket says 172.21.15.77:35676) 2023-11-04T01:45:32.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.970+0000 7fef517f3640 1 -- 172.21.15.77:0/3563767638 learned_addr learned my addr 172.21.15.77:0/3563767638 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:45:32.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.970+0000 7fef50ff2640 1 --2- 172.21.15.77:0/3563767638 >> v2:172.21.15.122:3300/0 conn(0x7fef4c0cda60 0x7fef4c0ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:32.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.970+0000 7fef4b7fe640 1 -- 172.21.15.77:0/3563767638 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1212651202 0 0) 0x7fef4c0cc990 con 0x7fef4c070d40 2023-11-04T01:45:32.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.970+0000 7fef4b7fe640 1 -- 172.21.15.77:0/3563767638 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef34003520 con 0x7fef4c070d40 2023-11-04T01:45:32.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.971+0000 7fef4b7fe640 1 -- 172.21.15.77:0/3563767638 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3070103852 0 0) 0x7fef34003520 con 0x7fef4c070d40 2023-11-04T01:45:32.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.971+0000 7fef4b7fe640 1 -- 172.21.15.77:0/3563767638 >> v2:172.21.15.122:3300/0 conn(0x7fef4c0cda60 msgr2=0x7fef4c0ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:32.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.971+0000 7fef4b7fe640 1 --2- 172.21.15.77:0/3563767638 >> v2:172.21.15.122:3300/0 conn(0x7fef4c0cda60 0x7fef4c0ca7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.971+0000 7fef4b7fe640 1 -- 172.21.15.77:0/3563767638 >> v1:172.21.15.122:6789/0 conn(0x7fef4c0b0cd0 legacy=0x7fef4c070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:32.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.971+0000 7fef4b7fe640 1 -- 172.21.15.77:0/3563767638 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef4c0c9fc0 con 0x7fef4c070d40 2023-11-04T01:45:32.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.971+0000 7fef4b7fe640 1 -- 172.21.15.77:0/3563767638 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7fef440019f0 con 0x7fef4c070d40 2023-11-04T01:45:32.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.971+0000 7fef4b7fe640 1 -- 172.21.15.77:0/3563767638 >> v1:172.21.15.77:6789/0 conn(0x7fef4c070d40 legacy=0x7fef4c06c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:32.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.971+0000 7fef4b7fe640 1 --2- 172.21.15.77:0/3563767638 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fef34003970 0x7fef34003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.971+0000 7fef4b7fe640 1 --2- 172.21.15.77:0/3563767638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef34004370 0x7fef34004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.971+0000 7fef4b7fe640 1 --2- 172.21.15.77:0/3563767638 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef34005040 0x7fef3400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.971+0000 7fef4b7fe640 1 -- 172.21.15.77:0/3563767638 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4c0c9ce0 con 0x7fef34004370 2023-11-04T01:45:32.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.971+0000 7fef4b7fe640 1 -- 172.21.15.77:0/3563767638 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3400bfa0 con 0x7fef34005040 2023-11-04T01:45:32.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.971+0000 7fef4b7fe640 1 -- 172.21.15.77:0/3563767638 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef3400c160 con 0x7fef34003970 2023-11-04T01:45:32.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.971+0000 7fef4bfff640 1 --2- 172.21.15.77:0/3563767638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef34004370 0x7fef34004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:32.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.971+0000 7fef50ff2640 1 --2- 172.21.15.77:0/3563767638 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fef34003970 0x7fef34003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:32.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.971+0000 7fef517f3640 1 --2- 172.21.15.77:0/3563767638 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef34005040 0x7fef3400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:32.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.971+0000 7fef4bfff640 1 -- 172.21.15.77:0/3563767638 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fef34003970 msgr2=0x7fef34003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:32.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.971+0000 7fef4bfff640 1 --2- 172.21.15.77:0/3563767638 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fef34003970 0x7fef34003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.971+0000 7fef4bfff640 1 -- 172.21.15.77:0/3563767638 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef34005040 msgr2=0x7fef3400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:32.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.971+0000 7fef4bfff640 1 --2- 172.21.15.77:0/3563767638 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef34005040 0x7fef3400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.971+0000 7fef4bfff640 1 -- 172.21.15.77:0/3563767638 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef34003520 con 0x7fef34004370 2023-11-04T01:45:32.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.971+0000 7fef517f3640 1 --2- 172.21.15.77:0/3563767638 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef34005040 0x7fef3400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:32.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.971+0000 7fef517f3640 1 -- 172.21.15.77:0/3563767638 reap_dead start 2023-11-04T01:45:32.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.972+0000 7fef4bfff640 1 --2- 172.21.15.77:0/3563767638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef34004370 0x7fef34004840 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7fef40001830 tx=0x7fef340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f90b575d4affeb1f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:32.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.972+0000 7fef4b7fe640 1 -- 172.21.15.77:0/3563767638 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef40032600 con 0x7fef34004370 2023-11-04T01:45:32.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.972+0000 7fef4b7fe640 1 -- 172.21.15.77:0/3563767638 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4002e050 con 0x7fef34004370 2023-11-04T01:45:32.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.972+0000 7fef4b7fe640 1 -- 172.21.15.77:0/3563767638 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef400329c0 con 0x7fef34004370 2023-11-04T01:45:32.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.972+0000 7fef53256640 1 -- 172.21.15.77:0/3563767638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef34004370 msgr2=0x7fef34004840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:32.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.972+0000 7fef53256640 1 --2- 172.21.15.77:0/3563767638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef34004370 0x7fef34004840 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7fef40001830 tx=0x7fef340057f0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.972+0000 7fef53256640 1 -- 172.21.15.77:0/3563767638 shutdown_connections 2023-11-04T01:45:32.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.972+0000 7fef53256640 1 --2- 172.21.15.77:0/3563767638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef34004370 0x7fef34004840 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.972+0000 7fef53256640 1 -- 172.21.15.77:0/3563767638 >> 172.21.15.77:0/3563767638 conn(0x7fef4c0ce950 msgr2=0x7fef4c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:32.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.972+0000 7fef53256640 1 -- 172.21.15.77:0/3563767638 shutdown_connections 2023-11-04T01:45:32.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.972+0000 7fef53256640 1 -- 172.21.15.77:0/3563767638 wait complete. 2023-11-04T01:45:32.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.974+0000 7fef53256640 1 Processor -- start 2023-11-04T01:45:32.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.974+0000 7fef53256640 1 -- start start 2023-11-04T01:45:32.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.974+0000 7fef53256640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fef34004370 0x7fef4c1f52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.974+0000 7fef53256640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef4c0c68d0 0x7fef4c0c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.974+0000 7fef53256640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef4c0c82f0 0x7fef4c0c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.974+0000 7fef53256640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4c15c410 con 0x7fef4c0c82f0 2023-11-04T01:45:32.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.974+0000 7fef53256640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4c15bb70 con 0x7fef4c0c68d0 2023-11-04T01:45:32.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.974+0000 7fef53256640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef4c15be50 con 0x7fef34004370 2023-11-04T01:45:32.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.975+0000 7fef517f3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef4c0c82f0 0x7fef4c0c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:32.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.975+0000 7fef517f3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef4c0c82f0 0x7fef4c0c8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49746/0 (socket says 172.21.15.77:49746) 2023-11-04T01:45:32.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.975+0000 7fef517f3640 1 -- 172.21.15.77:0/1329587146 learned_addr learned my addr 172.21.15.77:0/1329587146 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:32.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.975+0000 7fef517f3640 1 -- 172.21.15.77:0/1329587146 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fef34004370 msgr2=0x7fef4c1f52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:32.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.975+0000 7fef517f3640 1 --2- 172.21.15.77:0/1329587146 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fef34004370 0x7fef4c1f52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.975+0000 7fef517f3640 1 -- 172.21.15.77:0/1329587146 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef4c0c68d0 msgr2=0x7fef4c0c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:32.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.975+0000 7fef517f3640 1 --2- 172.21.15.77:0/1329587146 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef4c0c68d0 0x7fef4c0c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.975+0000 7fef517f3640 1 -- 172.21.15.77:0/1329587146 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef4c15c130 con 0x7fef4c0c82f0 2023-11-04T01:45:32.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.975+0000 7fef517f3640 1 --2- 172.21.15.77:0/1329587146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef4c0c82f0 0x7fef4c0c8770 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fef4c15ce70 tx=0x7fef4400b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:32.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.975+0000 7fef497fa640 1 -- 172.21.15.77:0/1329587146 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44004d60 con 0x7fef4c0c82f0 2023-11-04T01:45:32.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.975+0000 7fef497fa640 1 -- 172.21.15.77:0/1329587146 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4400bb80 con 0x7fef4c0c82f0 2023-11-04T01:45:32.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.975+0000 7fef53256640 1 -- 172.21.15.77:0/1329587146 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef4c0aba60 con 0x7fef4c0c82f0 2023-11-04T01:45:32.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.975+0000 7fef497fa640 1 -- 172.21.15.77:0/1329587146 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44007070 con 0x7fef4c0c82f0 2023-11-04T01:45:32.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.975+0000 7fef53256640 1 -- 172.21.15.77:0/1329587146 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef4c1f5800 con 0x7fef4c0c82f0 2023-11-04T01:45:32.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.976+0000 7fef53256640 1 -- 172.21.15.77:0/1329587146 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef4c1f59f0 con 0x7fef4c0c82f0 2023-11-04T01:45:32.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.976+0000 7fef497fa640 1 -- 172.21.15.77:0/1329587146 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fef440071d0 con 0x7fef4c0c82f0 2023-11-04T01:45:32.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.977+0000 7fef497fa640 1 --2- 172.21.15.77:0/1329587146 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fef3806ae60 0x7fef3806d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.977+0000 7fef497fa640 1 -- 172.21.15.77:0/1329587146 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7fef4408a030 con 0x7fef4c0c82f0 2023-11-04T01:45:32.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.977+0000 7fef50ff2640 1 --2- 172.21.15.77:0/1329587146 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fef3806ae60 0x7fef3806d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:32.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.978+0000 7fef50ff2640 1 --2- 172.21.15.77:0/1329587146 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fef3806ae60 0x7fef3806d320 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fef3c009990 tx=0x7fef3c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:32.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:32.981+0000 7fef497fa640 1 -- 172.21.15.77:0/1329587146 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fef44054a50 con 0x7fef4c0c82f0 2023-11-04T01:45:32.998 INFO:tasks.ceph.mds.b.smithi122.stderr:2023-11-04T01:45:32.996+0000 7fcd3db5a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:45:32.998 INFO:tasks.ceph.mds.b.smithi122.stderr:2023-11-04T01:45:32.996+0000 7fcd3db5a640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:45:33.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.181+0000 7fef53256640 1 -- 172.21.15.77:0/1329587146 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef4c074290 con 0x7fef4c0c82f0 2023-11-04T01:45:33.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.182+0000 7fef497fa640 1 -- 172.21.15.77:0/1329587146 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4938 (secure 0 0 0) 0x7fef44058070 con 0x7fef4c0c82f0 2023-11-04T01:45:33.184 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:33.184 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":80,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7977,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/3276812155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3276812155},{"type":"v1","addr":"172.21.15.77:6834","nonce":3276812155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:45:30.197166+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6640,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6640":{"gid":6640,"name":"b","rank":0,"incarnation":76,"state":"up:active","state_seq":11,"addr":"172.21.15.122:6836/1345816612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1345816612},{"type":"v1","addr":"172.21.15.122:6836","nonce":1345816612}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:33.184 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 80 2023-11-04T01:45:33.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.183+0000 7fef53256640 1 -- 172.21.15.77:0/1329587146 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fef3806ae60 msgr2=0x7fef3806d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:33.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.183+0000 7fef53256640 1 --2- 172.21.15.77:0/1329587146 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fef3806ae60 0x7fef3806d320 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fef3c009990 tx=0x7fef3c008040 comp rx=0 tx=0).stop 2023-11-04T01:45:33.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.183+0000 7fef53256640 1 -- 172.21.15.77:0/1329587146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef4c0c82f0 msgr2=0x7fef4c0c8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:33.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.183+0000 7fef53256640 1 --2- 172.21.15.77:0/1329587146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef4c0c82f0 0x7fef4c0c8770 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fef4c15ce70 tx=0x7fef4400b4a0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.183+0000 7fef53256640 1 -- 172.21.15.77:0/1329587146 shutdown_connections 2023-11-04T01:45:33.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.183+0000 7fef53256640 1 --2- 172.21.15.77:0/1329587146 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fef3806ae60 0x7fef3806d320 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.183+0000 7fef53256640 1 --2- 172.21.15.77:0/1329587146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef4c0c82f0 0x7fef4c0c8770 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.183+0000 7fef53256640 1 --2- 172.21.15.77:0/1329587146 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef4c0c68d0 0x7fef4c0c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.183+0000 7fef53256640 1 --2- 172.21.15.77:0/1329587146 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fef34004370 0x7fef4c1f52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.183+0000 7fef53256640 1 -- 172.21.15.77:0/1329587146 >> 172.21.15.77:0/1329587146 conn(0x7fef4c0ce950 msgr2=0x7fef4c1e1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:33.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.184+0000 7fef53256640 1 -- 172.21.15.77:0/1329587146 shutdown_connections 2023-11-04T01:45:33.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.184+0000 7fef53256640 1 -- 172.21.15.77:0/1329587146 wait complete. 2023-11-04T01:45:33.294 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-11-04T01:45:33.598 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 80, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-04T01:43:26.273417+0000', 'modified': '2023-11-04T01:45:30.197166+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 102, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 6640, 'mds_1': 7305}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6640': {'gid': 6640, 'name': 'b', 'rank': 0, 'incarnation': 76, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.122:6836/1345816612', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6834', 'nonce': 1345816612}, {'type': 'v1', 'addr': '172.21.15.122:6836', 'nonce': 1345816612}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_7305': {'gid': 7305, 'name': 'c', 'rank': 1, 'incarnation': 46, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.77:6835/3207490604', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6833', 'nonce': 3207490604}, {'type': 'v1', 'addr': '172.21.15.77:6835', 'nonce': 3207490604}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:45:33.598 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-11-04T01:45:33.599 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-04T01:45:33.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.702+0000 7fa1a9b3c640 1 Processor -- start 2023-11-04T01:45:33.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.702+0000 7fa1a9b3c640 1 -- start start 2023-11-04T01:45:33.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.703+0000 7fa1a9b3c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1a4159c00 0x7fa1a40cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.703+0000 7fa1a9b3c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa1a40c48e0 0x7fa1a40c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.703+0000 7fa1a9b3c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1a415aff0 con 0x7fa1a40adac0 2023-11-04T01:45:33.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.703+0000 7fa1a9b3c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1a40c52a0 con 0x7fa1a40c48e0 2023-11-04T01:45:33.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.703+0000 7fa1a9b3c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a415a3e0 con 0x7fa1a4159c00 2023-11-04T01:45:33.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.703+0000 7fa1a2ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa1a40c48e0 0x7fa1a40c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.703+0000 7fa1a2ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa1a40c48e0 0x7fa1a40c4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49748/0 (socket says 172.21.15.77:49748) 2023-11-04T01:45:33.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.703+0000 7fa1a2ffd640 1 -- 172.21.15.77:0/2936499146 learned_addr learned my addr 172.21.15.77:0/2936499146 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:33.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.703+0000 7fa1a37fe640 1 --2- 172.21.15.77:0/2936499146 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1a4159c00 0x7fa1a40cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.703+0000 7fa1a2ffd640 1 -- 172.21.15.77:0/2936499146 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1a4159c00 msgr2=0x7fa1a40cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:33.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.703+0000 7fa1a2ffd640 1 --2- 172.21.15.77:0/2936499146 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1a4159c00 0x7fa1a40cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.703+0000 7fa1a2ffd640 1 -- 172.21.15.77:0/2936499146 >> v1:172.21.15.122:6789/0 conn(0x7fa1a40adac0 legacy=0x7fa1a40adef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:33.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.703+0000 7fa1a2ffd640 1 -- 172.21.15.77:0/2936499146 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a415a6c0 con 0x7fa1a40c48e0 2023-11-04T01:45:33.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.704+0000 7fa1a2ffd640 1 --2- 172.21.15.77:0/2936499146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1a40c48e0 0x7fa1a40c4d60 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fa198009870 tx=0x7fa19802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320cf4c519004695 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:33.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.704+0000 7fa1a27fc640 1 -- 172.21.15.77:0/2936499146 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa198030840 con 0x7fa1a40c48e0 2023-11-04T01:45:33.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.704+0000 7fa1a27fc640 1 -- 172.21.15.77:0/2936499146 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1980309a0 con 0x7fa1a40c48e0 2023-11-04T01:45:33.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.704+0000 7fa1a27fc640 1 -- 172.21.15.77:0/2936499146 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa198030d30 con 0x7fa1a40c48e0 2023-11-04T01:45:33.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.705+0000 7fa1a9b3c640 1 -- 172.21.15.77:0/2936499146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1a40c48e0 msgr2=0x7fa1a40c4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:33.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.705+0000 7fa1a9b3c640 1 --2- 172.21.15.77:0/2936499146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1a40c48e0 0x7fa1a40c4d60 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fa198009870 tx=0x7fa19802b980 comp rx=0 tx=0).stop 2023-11-04T01:45:33.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.705+0000 7fa1a9b3c640 1 -- 172.21.15.77:0/2936499146 shutdown_connections 2023-11-04T01:45:33.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.705+0000 7fa1a9b3c640 1 --2- 172.21.15.77:0/2936499146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1a40c48e0 0x7fa1a40c4d60 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.705+0000 7fa1a9b3c640 1 --2- 172.21.15.77:0/2936499146 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1a4159c00 0x7fa1a40cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.705+0000 7fa1a9b3c640 1 -- 172.21.15.77:0/2936499146 >> 172.21.15.77:0/2936499146 conn(0x7fa1a40ce950 msgr2=0x7fa1a40ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:33.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.705+0000 7fa1a9b3c640 1 -- 172.21.15.77:0/2936499146 shutdown_connections 2023-11-04T01:45:33.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.705+0000 7fa1a9b3c640 1 -- 172.21.15.77:0/2936499146 wait complete. 2023-11-04T01:45:33.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.706+0000 7fa1a9b3c640 1 Processor -- start 2023-11-04T01:45:33.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.706+0000 7fa1a9b3c640 1 -- start start 2023-11-04T01:45:33.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.707+0000 7fa1a9b3c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1a40adac0 0x7fa1a40c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.707+0000 7fa1a9b3c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1a40c48e0 0x7fa1a40c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.707+0000 7fa1a9b3c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1a4159c00 0x7fa1a40c76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.707+0000 7fa1a9b3c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a40c6cc0 con 0x7fa1a40adac0 2023-11-04T01:45:33.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.707+0000 7fa1a9b3c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a40cca30 con 0x7fa1a4159c00 2023-11-04T01:45:33.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.707+0000 7fa1a9b3c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a40ccd10 con 0x7fa1a40c48e0 2023-11-04T01:45:33.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.707+0000 7fa1a37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1a40adac0 0x7fa1a40c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.707+0000 7fa1a37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1a40adac0 0x7fa1a40c6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49762/0 (socket says 172.21.15.77:49762) 2023-11-04T01:45:33.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.707+0000 7fa1a37fe640 1 -- 172.21.15.77:0/2569684128 learned_addr learned my addr 172.21.15.77:0/2569684128 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:33.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.707+0000 7fa1a3fff640 1 --2- 172.21.15.77:0/2569684128 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1a4159c00 0x7fa1a40c76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.707+0000 7fa1a2ffd640 1 --2- 172.21.15.77:0/2569684128 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1a40c48e0 0x7fa1a40c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.707+0000 7fa1a37fe640 1 -- 172.21.15.77:0/2569684128 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1a40c48e0 msgr2=0x7fa1a40c71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:33.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.707+0000 7fa1a37fe640 1 --2- 172.21.15.77:0/2569684128 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1a40c48e0 0x7fa1a40c71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.707+0000 7fa1a37fe640 1 -- 172.21.15.77:0/2569684128 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1a4159c00 msgr2=0x7fa1a40c76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:33.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.707+0000 7fa1a37fe640 1 --2- 172.21.15.77:0/2569684128 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1a4159c00 0x7fa1a40c76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.707+0000 7fa1a37fe640 1 -- 172.21.15.77:0/2569684128 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1980094d0 con 0x7fa1a40adac0 2023-11-04T01:45:33.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.707+0000 7fa1a37fe640 1 --2- 172.21.15.77:0/2569684128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1a40adac0 0x7fa1a40c6430 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fa19400d800 tx=0x7fa19400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:33.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.707+0000 7fa18bfff640 1 -- 172.21.15.77:0/2569684128 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19400b6c0 con 0x7fa1a40adac0 2023-11-04T01:45:33.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.707+0000 7fa18bfff640 1 -- 172.21.15.77:0/2569684128 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19400b820 con 0x7fa1a40adac0 2023-11-04T01:45:33.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.707+0000 7fa18bfff640 1 -- 172.21.15.77:0/2569684128 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19400bbb0 con 0x7fa1a40adac0 2023-11-04T01:45:33.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.707+0000 7fa1a9b3c640 1 -- 172.21.15.77:0/2569684128 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1a40ccff0 con 0x7fa1a40adac0 2023-11-04T01:45:33.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.707+0000 7fa1a9b3c640 1 -- 172.21.15.77:0/2569684128 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a40c6970 con 0x7fa1a40adac0 2023-11-04T01:45:33.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.709+0000 7fa18bfff640 1 -- 172.21.15.77:0/2569684128 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa19400bd10 con 0x7fa1a40adac0 2023-11-04T01:45:33.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.709+0000 7fa18bfff640 1 --2- 172.21.15.77:0/2569684128 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa19006aea0 0x7fa19006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.709+0000 7fa18bfff640 1 -- 172.21.15.77:0/2569684128 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7fa19408a2f0 con 0x7fa1a40adac0 2023-11-04T01:45:33.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.710+0000 7fa1a2ffd640 1 --2- 172.21.15.77:0/2569684128 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa19006aea0 0x7fa19006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.710+0000 7fa1a2ffd640 1 --2- 172.21.15.77:0/2569684128 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa19006aea0 0x7fa19006d360 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa198036000 tx=0x7fa198008030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:33.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.710+0000 7fa1ac7ab740 1 Processor -- start 2023-11-04T01:45:33.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.710+0000 7fa1ac7ab740 1 -- start start 2023-11-04T01:45:33.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.711+0000 7fa1ac7ab740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558479629850 0x5584795fc750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.711+0000 7fa1ac7ab740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558479629c30 0x55847962c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.711+0000 7fa1ac7ab740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5584795fcc90 0x55847962cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.711+0000 7fa1ac7ab740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55847950d740 con 0x5584795fcc90 2023-11-04T01:45:33.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.711+0000 7fa1ac7ab740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55847956f8d0 con 0x558479629c30 2023-11-04T01:45:33.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.711+0000 7fa1ac7ab740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x55847956cfc0 con 0x558479629850 2023-11-04T01:45:33.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.711+0000 7fa1a3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5584795fcc90 0x55847962cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.711+0000 7fa1a3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5584795fcc90 0x55847962cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49774/0 (socket says 172.21.15.77:49774) 2023-11-04T01:45:33.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.711+0000 7fa1a3fff640 1 -- 172.21.15.77:0/1289352482 learned_addr learned my addr 172.21.15.77:0/1289352482 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:33.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.711+0000 7fa1a2ffd640 1 --2- 172.21.15.77:0/1289352482 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558479629c30 0x55847962c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.711+0000 7fa1a37fe640 1 --2- 172.21.15.77:0/1289352482 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558479629850 0x5584795fc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.712+0000 7fa1a3fff640 1 -- 172.21.15.77:0/1289352482 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558479629850 msgr2=0x5584795fc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:33.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.712+0000 7fa1a3fff640 1 --2- 172.21.15.77:0/1289352482 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558479629850 0x5584795fc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.712+0000 7fa1a3fff640 1 -- 172.21.15.77:0/1289352482 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558479629c30 msgr2=0x55847962c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:33.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.712+0000 7fa1a3fff640 1 --2- 172.21.15.77:0/1289352482 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558479629c30 0x55847962c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.712+0000 7fa1a3fff640 1 -- 172.21.15.77:0/1289352482 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55847952bca0 con 0x5584795fcc90 2023-11-04T01:45:33.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.712+0000 7fa1a37fe640 1 --2- 172.21.15.77:0/1289352482 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558479629850 0x5584795fc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:33.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.712+0000 7fa1a3fff640 1 --2- 172.21.15.77:0/1289352482 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5584795fcc90 0x55847962cb20 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fa19c001c00 tx=0x7fa19c0020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=386d6912cc65d5ac server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:33.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.712+0000 7fa1897fa640 1 -- 172.21.15.77:0/1289352482 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c003b80 con 0x5584795fcc90 2023-11-04T01:45:33.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.712+0000 7fa1897fa640 1 -- 172.21.15.77:0/1289352482 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19c003ce0 con 0x5584795fcc90 2023-11-04T01:45:33.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.712+0000 7fa1897fa640 1 -- 172.21.15.77:0/1289352482 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c00ea40 con 0x5584795fcc90 2023-11-04T01:45:33.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.712+0000 7fa1ac7ab740 1 -- 172.21.15.77:0/1289352482 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5584795fcc90 msgr2=0x55847962cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:33.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.712+0000 7fa1ac7ab740 1 --2- 172.21.15.77:0/1289352482 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5584795fcc90 0x55847962cb20 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fa19c001c00 tx=0x7fa19c0020c0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.713+0000 7fa1ac7ab740 1 -- 172.21.15.77:0/1289352482 shutdown_connections 2023-11-04T01:45:33.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.713+0000 7fa1ac7ab740 1 --2- 172.21.15.77:0/1289352482 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5584795fcc90 0x55847962cb20 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.713+0000 7fa1ac7ab740 1 --2- 172.21.15.77:0/1289352482 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558479629c30 0x55847962c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.713+0000 7fa1ac7ab740 1 --2- 172.21.15.77:0/1289352482 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558479629850 0x5584795fc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.713+0000 7fa1ac7ab740 1 -- 172.21.15.77:0/1289352482 >> 172.21.15.77:0/1289352482 conn(0x5584795fea60 msgr2=0x5584796475e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:33.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.713+0000 7fa1ac7ab740 1 -- 172.21.15.77:0/1289352482 shutdown_connections 2023-11-04T01:45:33.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.713+0000 7fa1ac7ab740 1 -- 172.21.15.77:0/1289352482 wait complete. 2023-11-04T01:45:33.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.713+0000 7fa1ac7ab740 1 -- start start 2023-11-04T01:45:33.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.713+0000 7fa1ac7ab740 1 Processor -- start 2023-11-04T01:45:33.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.714+0000 7fa1ac7ab740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558479629850 0x5584796300c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.714+0000 7fa1ac7ab740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558479629c30 0x558479625390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.714+0000 7fa1ac7ab740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55847962a5c0 0x558479610e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.714+0000 7fa1ac7ab740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584795688b0 con 0x55847962a5c0 2023-11-04T01:45:33.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.714+0000 7fa1ac7ab740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x558479522c80 con 0x558479629c30 2023-11-04T01:45:33.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.714+0000 7fa1ac7ab740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x558479522920 con 0x558479629850 2023-11-04T01:45:33.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.714+0000 7fa1ac7ab740 10 client.0 _ll_register_callbacks cb 0x55847927aac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:45:33.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.714+0000 7fa1a3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55847962a5c0 0x558479610e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.714+0000 7fa1a3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55847962a5c0 0x558479610e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49776/0 (socket says 172.21.15.77:49776) 2023-11-04T01:45:33.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.714+0000 7fa1a3fff640 1 -- 172.21.15.77:0/3831385462 learned_addr learned my addr 172.21.15.77:0/3831385462 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:33.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.714+0000 7fa1a2ffd640 1 --2- 172.21.15.77:0/3831385462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558479629c30 0x558479625390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.714+0000 7fa1a37fe640 1 --2- 172.21.15.77:0/3831385462 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558479629850 0x5584796300c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.714+0000 7fa1a3fff640 1 -- 172.21.15.77:0/3831385462 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558479629850 msgr2=0x5584796300c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:33.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.714+0000 7fa1a3fff640 1 --2- 172.21.15.77:0/3831385462 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558479629850 0x5584796300c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.714+0000 7fa1a3fff640 1 -- 172.21.15.77:0/3831385462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558479629c30 msgr2=0x558479625390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:33.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.714+0000 7fa1a3fff640 1 --2- 172.21.15.77:0/3831385462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558479629c30 0x558479625390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.714+0000 7fa1a3fff640 1 -- 172.21.15.77:0/3831385462 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa19c00f040 con 0x55847962a5c0 2023-11-04T01:45:33.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.714+0000 7fa1a2ffd640 1 --2- 172.21.15.77:0/3831385462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558479629c30 0x558479625390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:33.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.714+0000 7fa1a3fff640 1 --2- 172.21.15.77:0/3831385462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55847962a5c0 0x558479610e70 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fa19c013000 tx=0x7fa19c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c814285a2a5967 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:33.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.714+0000 7fa1827fc640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:45:33.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.715+0000 7fa1827fc640 1 -- 172.21.15.77:0/3831385462 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c006e80 con 0x55847962a5c0 2023-11-04T01:45:33.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.715+0000 7fa1827fc640 1 -- 172.21.15.77:0/3831385462 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7fa19c00ea10 con 0x55847962a5c0 2023-11-04T01:45:33.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.715+0000 7fa1ac7ab740 1 -- 172.21.15.77:0/3831385462 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558479514bf0 con 0x55847962a5c0 2023-11-04T01:45:33.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.715+0000 7fa1827fc640 1 -- 172.21.15.77:0/3831385462 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa19c00ebd0 con 0x55847962a5c0 2023-11-04T01:45:33.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.715+0000 7fa1ac7ab740 10 client.8007 fetch_fsmap learned FSMap version 80 2023-11-04T01:45:33.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.715+0000 7fa1ac7ab740 1 -- 172.21.15.77:0/3831385462 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=2+}) v3 -- 0x558479566f30 con 0x55847962a5c0 2023-11-04T01:45:33.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.715+0000 7fa1827fc640 1 -- 172.21.15.77:0/3831385462 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558479514bf0 con 0x55847962a5c0 2023-11-04T01:45:33.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.715+0000 7fa1827fc640 1 -- 172.21.15.77:0/3831385462 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 80) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fa19c00ed30 con 0x55847962a5c0 2023-11-04T01:45:33.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.715+0000 7fa1ac7ab740 10 client.8007 fetch_fsmap finished waiting for FSMap version 80 2023-11-04T01:45:33.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.715+0000 7fa1ac7ab740 10 client.8007 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:45:33.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.715+0000 7fa1ac7ab740 20 client.8007 populate_metadata read hostname 'smithi077' 2023-11-04T01:45:33.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.715+0000 7fa1ac7ab740 1 --2- 172.21.15.77:0/3831385462 >> [v2:172.21.15.122:6834/1345816612,v1:172.21.15.122:6836/1345816612] conn(0x558479613450 0x5584796247e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.715+0000 7fa1ac7ab740 4 client.8007 mds_command: new command op to 6640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:45:33.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.715+0000 7fa1ac7ab740 1 -- 172.21.15.77:0/3831385462 --> [v2:172.21.15.122:6834/1345816612,v1:172.21.15.122:6836/1345816612] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558479561890 con 0x558479613450 2023-11-04T01:45:33.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.715+0000 7fa1a37fe640 1 --2- 172.21.15.77:0/3831385462 >> [v2:172.21.15.122:6834/1345816612,v1:172.21.15.122:6836/1345816612] conn(0x558479613450 0x5584796247e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.716+0000 7fa1827fc640 10 client.8007 ms_handle_connect on v2:172.21.15.122:6834/1345816612 2023-11-04T01:45:33.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.716+0000 7fa1a37fe640 1 --2- 172.21.15.77:0/3831385462 >> [v2:172.21.15.122:6834/1345816612,v1:172.21.15.122:6836/1345816612] conn(0x558479613450 0x5584796247e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=523f7f24446bc904 server_cookie=29c9b821cd890c58 in_seq=0 out_seq=0 2023-11-04T01:45:33.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.716+0000 7fa1827fc640 1 -- 172.21.15.77:0/3831385462 <== mds.0 v2:172.21.15.122:6834/1345816612 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558479561890 con 0x558479613450 2023-11-04T01:45:33.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.716+0000 7fa1827fc640 10 client.8007 handle_command_reply: tid=0 2023-11-04T01:45:33.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.716+0000 7fa1ac7ab740 1 client.8007 shutdown 2023-11-04T01:45:33.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.717+0000 7fa1ac7ab740 1 -- 172.21.15.77:0/3831385462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55847962a5c0 msgr2=0x558479610e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:33.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.717+0000 7fa1ac7ab740 1 --2- 172.21.15.77:0/3831385462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55847962a5c0 0x558479610e70 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fa19c013000 tx=0x7fa19c001250 comp rx=0 tx=0).stop 2023-11-04T01:45:33.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.717+0000 7fa1ac7ab740 1 -- 172.21.15.77:0/3831385462 shutdown_connections 2023-11-04T01:45:33.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.717+0000 7fa1ac7ab740 1 --2- 172.21.15.77:0/3831385462 >> [v2:172.21.15.122:6834/1345816612,v1:172.21.15.122:6836/1345816612] conn(0x558479613450 0x5584796247e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.717+0000 7fa1ac7ab740 1 --2- 172.21.15.77:0/3831385462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55847962a5c0 0x558479610e70 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.717+0000 7fa1ac7ab740 1 --2- 172.21.15.77:0/3831385462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558479629c30 0x558479625390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.717+0000 7fa1ac7ab740 1 --2- 172.21.15.77:0/3831385462 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558479629850 0x5584796300c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.717+0000 7fa1827fc640 0 client.8007 ms_handle_reset on v2:172.21.15.122:6834/1345816612 2023-11-04T01:45:33.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.717+0000 7fa1ac7ab740 1 -- 172.21.15.77:0/3831385462 >> 172.21.15.77:0/3831385462 conn(0x5584795fcc90 msgr2=0x558479600600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:33.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.717+0000 7fa1ac7ab740 1 -- 172.21.15.77:0/3831385462 shutdown_connections 2023-11-04T01:45:33.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.717+0000 7fa1ac7ab740 1 -- 172.21.15.77:0/3831385462 wait complete. 2023-11-04T01:45:33.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.717+0000 7fa1ac7ab740 20 client.8007 trim_cache size 0 max 16384 2023-11-04T01:45:33.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.732+0000 7fa1ac7ab740 1 Processor -- start 2023-11-04T01:45:33.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.732+0000 7fa1ac7ab740 1 -- start start 2023-11-04T01:45:33.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.733+0000 7fa1ac7ab740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558479629850 0x558479661f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.733+0000 7fa1ac7ab740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558479629c30 0x558479622f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.733+0000 7fa1ac7ab740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55847962a5c0 0x5584796234d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.733+0000 7fa1ac7ab740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55847962fb80 con 0x558479629850 2023-11-04T01:45:33.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.733+0000 7fa1ac7ab740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584794e8280 con 0x558479629c30 2023-11-04T01:45:33.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.733+0000 7fa1ac7ab740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x5584795347e0 con 0x55847962a5c0 2023-11-04T01:45:33.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.733+0000 7fa1a37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558479629850 0x558479661f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.733+0000 7fa1a37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558479629850 0x558479661f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49792/0 (socket says 172.21.15.77:49792) 2023-11-04T01:45:33.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.733+0000 7fa1a37fe640 1 -- 172.21.15.77:0/2959642817 learned_addr learned my addr 172.21.15.77:0/2959642817 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:33.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.733+0000 7fa1a2ffd640 1 --2- 172.21.15.77:0/2959642817 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558479629c30 0x558479622f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.733+0000 7fa1a3fff640 1 --2- 172.21.15.77:0/2959642817 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55847962a5c0 0x5584796234d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.733+0000 7fa1a37fe640 1 -- 172.21.15.77:0/2959642817 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55847962a5c0 msgr2=0x5584796234d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:33.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.733+0000 7fa1a37fe640 1 --2- 172.21.15.77:0/2959642817 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55847962a5c0 0x5584796234d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.733+0000 7fa1a37fe640 1 -- 172.21.15.77:0/2959642817 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558479629c30 msgr2=0x558479622f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:33.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.733+0000 7fa1a37fe640 1 --2- 172.21.15.77:0/2959642817 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558479629c30 0x558479622f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.733+0000 7fa1a37fe640 1 -- 172.21.15.77:0/2959642817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558479504d10 con 0x558479629850 2023-11-04T01:45:33.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.733+0000 7fa1a2ffd640 1 --2- 172.21.15.77:0/2959642817 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558479629c30 0x558479622f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:33.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.733+0000 7fa1a3fff640 1 --2- 172.21.15.77:0/2959642817 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55847962a5c0 0x5584796234d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:33.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.734+0000 7fa1a37fe640 1 --2- 172.21.15.77:0/2959642817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558479629850 0x558479661f50 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fa194006f00 tx=0x7fa194006e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96cb6a6e2e45b5aa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:33.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.734+0000 7fa189ffb640 1 -- 172.21.15.77:0/2959642817 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa194070220 con 0x558479629850 2023-11-04T01:45:33.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.734+0000 7fa189ffb640 1 -- 172.21.15.77:0/2959642817 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa194060c40 con 0x558479629850 2023-11-04T01:45:33.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.734+0000 7fa189ffb640 1 -- 172.21.15.77:0/2959642817 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1940569f0 con 0x558479629850 2023-11-04T01:45:33.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.734+0000 7fa1ac7ab740 1 -- 172.21.15.77:0/2959642817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558479629850 msgr2=0x558479661f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:33.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.734+0000 7fa1ac7ab740 1 --2- 172.21.15.77:0/2959642817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558479629850 0x558479661f50 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fa194006f00 tx=0x7fa194006e90 comp rx=0 tx=0).stop 2023-11-04T01:45:33.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.734+0000 7fa1ac7ab740 1 -- 172.21.15.77:0/2959642817 shutdown_connections 2023-11-04T01:45:33.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.734+0000 7fa1ac7ab740 1 --2- 172.21.15.77:0/2959642817 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55847962a5c0 0x5584796234d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.734+0000 7fa1ac7ab740 1 --2- 172.21.15.77:0/2959642817 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558479629c30 0x558479622f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.734+0000 7fa1ac7ab740 1 --2- 172.21.15.77:0/2959642817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558479629850 0x558479661f50 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.734+0000 7fa1ac7ab740 1 -- 172.21.15.77:0/2959642817 >> 172.21.15.77:0/2959642817 conn(0x5584795fcc90 msgr2=0x5584796225d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:33.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.734+0000 7fa1ac7ab740 1 -- 172.21.15.77:0/2959642817 shutdown_connections 2023-11-04T01:45:33.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.734+0000 7fa1ac7ab740 1 -- 172.21.15.77:0/2959642817 wait complete. 2023-11-04T01:45:33.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.735+0000 7fa1ac7ab740 1 -- start start 2023-11-04T01:45:33.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.735+0000 7fa1ac7ab740 1 Processor -- start 2023-11-04T01:45:33.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.736+0000 7fa1ac7ab740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558479629850 0x558479623340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.736+0000 7fa1ac7ab740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558479629c30 0x5584796102c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.736+0000 7fa1ac7ab740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55847962a5c0 0x558479610800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.736+0000 7fa1ac7ab740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584796738b0 con 0x55847962a5c0 2023-11-04T01:45:33.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.736+0000 7fa1ac7ab740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584796b6710 con 0x558479629850 2023-11-04T01:45:33.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.736+0000 7fa1ac7ab740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x55847964a1b0 con 0x558479629c30 2023-11-04T01:45:33.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.736+0000 7fa1ac7ab740 10 client.0 _ll_register_callbacks cb 0x7fa19c001640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:45:33.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.736+0000 7fa1a3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55847962a5c0 0x558479610800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.736+0000 7fa1a3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55847962a5c0 0x558479610800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49796/0 (socket says 172.21.15.77:49796) 2023-11-04T01:45:33.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.736+0000 7fa1a3fff640 1 -- 172.21.15.77:0/3791269732 learned_addr learned my addr 172.21.15.77:0/3791269732 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:33.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.736+0000 7fa1a2ffd640 1 --2- 172.21.15.77:0/3791269732 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558479629c30 0x5584796102c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.736+0000 7fa1a37fe640 1 --2- 172.21.15.77:0/3791269732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558479629850 0x558479623340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.736+0000 7fa1a3fff640 1 -- 172.21.15.77:0/3791269732 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558479629c30 msgr2=0x5584796102c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:33.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.736+0000 7fa1a3fff640 1 --2- 172.21.15.77:0/3791269732 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558479629c30 0x5584796102c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.736+0000 7fa1a3fff640 1 -- 172.21.15.77:0/3791269732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558479629850 msgr2=0x558479623340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:33.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.736+0000 7fa1a3fff640 1 --2- 172.21.15.77:0/3791269732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558479629850 0x558479623340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.736+0000 7fa1a3fff640 1 -- 172.21.15.77:0/3791269732 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a40c6970 con 0x55847962a5c0 2023-11-04T01:45:33.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.736+0000 7fa1a2ffd640 1 --2- 172.21.15.77:0/3791269732 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558479629c30 0x5584796102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:33.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.736+0000 7fa1a3fff640 1 --2- 172.21.15.77:0/3791269732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55847962a5c0 0x558479610800 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x558479614000 tx=0x7fa19c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf3c262b0f1f9aa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:33.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.736+0000 7fa1827fc640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:45:33.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.736+0000 7fa1827fc640 1 -- 172.21.15.77:0/3791269732 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c0014a0 con 0x55847962a5c0 2023-11-04T01:45:33.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.736+0000 7fa1827fc640 1 -- 172.21.15.77:0/3791269732 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7fa19c033070 con 0x55847962a5c0 2023-11-04T01:45:33.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.736+0000 7fa1ac7ab740 1 -- 172.21.15.77:0/3791269732 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa19c003ce0 con 0x55847962a5c0 2023-11-04T01:45:33.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.736+0000 7fa1827fc640 1 -- 172.21.15.77:0/3791269732 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa19c0057d0 con 0x55847962a5c0 2023-11-04T01:45:33.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.736+0000 7fa1ac7ab740 10 client.8013 fetch_fsmap learned FSMap version 80 2023-11-04T01:45:33.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.736+0000 7fa1ac7ab740 1 -- 172.21.15.77:0/3791269732 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=2+}) v3 -- 0x55847952a500 con 0x55847962a5c0 2023-11-04T01:45:33.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.737+0000 7fa1827fc640 1 -- 172.21.15.77:0/3791269732 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19c003ce0 con 0x55847962a5c0 2023-11-04T01:45:33.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.737+0000 7fa1827fc640 1 -- 172.21.15.77:0/3791269732 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 80) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fa19c00ec20 con 0x55847962a5c0 2023-11-04T01:45:33.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.737+0000 7fa1ac7ab740 10 client.8013 fetch_fsmap finished waiting for FSMap version 80 2023-11-04T01:45:33.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.737+0000 7fa1ac7ab740 10 client.8013 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:45:33.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.737+0000 7fa1ac7ab740 20 client.8013 populate_metadata read hostname 'smithi077' 2023-11-04T01:45:33.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.737+0000 7fa1ac7ab740 1 --2- 172.21.15.77:0/3791269732 >> [v2:172.21.15.122:6834/1345816612,v1:172.21.15.122:6836/1345816612] conn(0x5584796b57c0 0x5584796b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.737+0000 7fa1ac7ab740 4 client.8013 mds_command: new command op to 6640 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:45:33.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.737+0000 7fa1ac7ab740 1 -- 172.21.15.77:0/3791269732 --> [v2:172.21.15.122:6834/1345816612,v1:172.21.15.122:6836/1345816612] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5584795615b0 con 0x5584796b57c0 2023-11-04T01:45:33.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.737+0000 7fa1a37fe640 1 --2- 172.21.15.77:0/3791269732 >> [v2:172.21.15.122:6834/1345816612,v1:172.21.15.122:6836/1345816612] conn(0x5584796b57c0 0x5584796b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.737+0000 7fa1a37fe640 1 --2- 172.21.15.77:0/3791269732 >> [v2:172.21.15.122:6834/1345816612,v1:172.21.15.122:6836/1345816612] conn(0x5584796b57c0 0x5584796b5ba0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b48c2e7a6c50e54c server_cookie=a3f10426b8cd9bfb in_seq=0 out_seq=0 2023-11-04T01:45:33.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.737+0000 7fa1827fc640 10 client.8013 ms_handle_connect on v2:172.21.15.122:6834/1345816612 2023-11-04T01:45:33.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.737+0000 7fa1827fc640 1 -- 172.21.15.77:0/3791269732 <== mds.0 v2:172.21.15.122:6834/1345816612 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x5584795615b0 con 0x5584796b57c0 2023-11-04T01:45:33.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.737+0000 7fa1827fc640 10 client.8013 handle_command_reply: tid=0 2023-11-04T01:45:33.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.737+0000 7fa1ac7ab740 1 client.8013 shutdown 2023-11-04T01:45:33.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.738+0000 7fa1ac7ab740 1 -- 172.21.15.77:0/3791269732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55847962a5c0 msgr2=0x558479610800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:33.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.738+0000 7fa1ac7ab740 1 --2- 172.21.15.77:0/3791269732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55847962a5c0 0x558479610800 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x558479614000 tx=0x7fa19c009040 comp rx=0 tx=0).stop 2023-11-04T01:45:33.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.738+0000 7fa1ac7ab740 1 -- 172.21.15.77:0/3791269732 shutdown_connections 2023-11-04T01:45:33.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.738+0000 7fa1ac7ab740 1 --2- 172.21.15.77:0/3791269732 >> [v2:172.21.15.122:6834/1345816612,v1:172.21.15.122:6836/1345816612] conn(0x5584796b57c0 0x5584796b5ba0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.738+0000 7fa1ac7ab740 1 --2- 172.21.15.77:0/3791269732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55847962a5c0 0x558479610800 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.738+0000 7fa1827fc640 0 client.8013 ms_handle_reset on v2:172.21.15.122:6834/1345816612 2023-11-04T01:45:33.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.738+0000 7fa1ac7ab740 1 --2- 172.21.15.77:0/3791269732 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558479629c30 0x5584796102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.738+0000 7fa1ac7ab740 1 --2- 172.21.15.77:0/3791269732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558479629850 0x558479623340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.738+0000 7fa1ac7ab740 1 -- 172.21.15.77:0/3791269732 >> 172.21.15.77:0/3791269732 conn(0x5584795fcc90 msgr2=0x558479669d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:33.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.738+0000 7fa1ac7ab740 1 -- 172.21.15.77:0/3791269732 shutdown_connections 2023-11-04T01:45:33.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.738+0000 7fa1ac7ab740 1 -- 172.21.15.77:0/3791269732 wait complete. 2023-11-04T01:45:33.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.738+0000 7fa1ac7ab740 20 client.8013 trim_cache size 0 max 16384 2023-11-04T01:45:33.767 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-04T01:45:33.768 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "0c22c75d-0169-41ef-b663-6ac1c5b0f71f", 2023-11-04T01:45:33.768 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 0, 2023-11-04T01:45:33.768 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 6640, 2023-11-04T01:45:33.769 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2023-11-04T01:45:33.769 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2023-11-04T01:45:33.769 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2023-11-04T01:45:33.769 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 6.5491042669999997, 2023-11-04T01:45:33.769 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 80, 2023-11-04T01:45:33.770 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 102, 2023-11-04T01:45:33.770 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 102, 2023-11-04T01:45:33.770 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 31.653332424999999 2023-11-04T01:45:33.770 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-04T01:45:33.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.738+0000 7fa1a9b3c640 1 -- 172.21.15.77:0/2569684128 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa19006aea0 msgr2=0x7fa19006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:33.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.738+0000 7fa1a9b3c640 1 --2- 172.21.15.77:0/2569684128 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa19006aea0 0x7fa19006d360 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa198036000 tx=0x7fa198008030 comp rx=0 tx=0).stop 2023-11-04T01:45:33.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.738+0000 7fa1a9b3c640 1 -- 172.21.15.77:0/2569684128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1a40adac0 msgr2=0x7fa1a40c6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:33.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.738+0000 7fa1a9b3c640 1 --2- 172.21.15.77:0/2569684128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1a40adac0 0x7fa1a40c6430 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fa19400d800 tx=0x7fa19400dcc0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.738+0000 7fa1a9b3c640 1 -- 172.21.15.77:0/2569684128 shutdown_connections 2023-11-04T01:45:33.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.738+0000 7fa1a9b3c640 1 --2- 172.21.15.77:0/2569684128 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa19006aea0 0x7fa19006d360 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.738+0000 7fa1a9b3c640 1 --2- 172.21.15.77:0/2569684128 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1a4159c00 0x7fa1a40c76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.738+0000 7fa1a9b3c640 1 --2- 172.21.15.77:0/2569684128 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1a40c48e0 0x7fa1a40c71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.738+0000 7fa1a9b3c640 1 --2- 172.21.15.77:0/2569684128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1a40adac0 0x7fa1a40c6430 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.738+0000 7fa1a9b3c640 1 -- 172.21.15.77:0/2569684128 >> 172.21.15.77:0/2569684128 conn(0x7fa1a40ce950 msgr2=0x7fa1a4150790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:33.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.738+0000 7fa1a9b3c640 1 -- 172.21.15.77:0/2569684128 shutdown_connections 2023-11-04T01:45:33.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.738+0000 7fa1a9b3c640 1 -- 172.21.15.77:0/2569684128 wait complete. 2023-11-04T01:45:33.775 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-04T01:45:33.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.874+0000 7ff7e0abb640 1 Processor -- start 2023-11-04T01:45:33.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.874+0000 7ff7e0abb640 1 -- start start 2023-11-04T01:45:33.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.875+0000 7ff7e0abb640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff7dc066000 0x7ff7dc0cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.875+0000 7ff7e0abb640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7dc0c9bf0 con 0x7ff7dc070ff0 2023-11-04T01:45:33.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.875+0000 7ff7e0abb640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7dc0cd890 con 0x7ff7dc15d1b0 2023-11-04T01:45:33.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.875+0000 7ff7e0abb640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7dc0cdb30 con 0x7ff7dc066000 2023-11-04T01:45:33.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.875+0000 7ff7da59c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ff7dc070ff0 0x7ff7dc0713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35692/0 (socket says 172.21.15.77:35692) 2023-11-04T01:45:33.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.875+0000 7ff7da59c640 1 -- 172.21.15.77:0/3337247301 learned_addr learned my addr 172.21.15.77:0/3337247301 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:45:33.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.875+0000 7ff7dad9d640 1 --2- 172.21.15.77:0/3337247301 >> v2:172.21.15.122:3300/0 conn(0x7ff7dc066000 0x7ff7dc0cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.875+0000 7ff7d9d9b640 1 -- 172.21.15.77:0/3337247301 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2851113634 0 0) 0x7ff7dc0c9bf0 con 0x7ff7dc070ff0 2023-11-04T01:45:33.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.875+0000 7ff7d9d9b640 1 -- 172.21.15.77:0/3337247301 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7c8003520 con 0x7ff7dc070ff0 2023-11-04T01:45:33.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.875+0000 7ff7d9d9b640 1 -- 172.21.15.77:0/3337247301 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 877882488 0 0) 0x7ff7c8003520 con 0x7ff7dc070ff0 2023-11-04T01:45:33.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.875+0000 7ff7d9d9b640 1 -- 172.21.15.77:0/3337247301 >> v2:172.21.15.122:3300/0 conn(0x7ff7dc066000 msgr2=0x7ff7dc0cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:33.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.875+0000 7ff7d9d9b640 1 --2- 172.21.15.77:0/3337247301 >> v2:172.21.15.122:3300/0 conn(0x7ff7dc066000 0x7ff7dc0cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.875+0000 7ff7d9d9b640 1 -- 172.21.15.77:0/3337247301 >> v1:172.21.15.122:6789/0 conn(0x7ff7dc15d1b0 legacy=0x7ff7dc06a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:33.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.875+0000 7ff7d9d9b640 1 -- 172.21.15.77:0/3337247301 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7dc0cde10 con 0x7ff7dc070ff0 2023-11-04T01:45:33.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.875+0000 7ff7d9d9b640 1 -- 172.21.15.77:0/3337247301 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7ff7cc001670 con 0x7ff7dc070ff0 2023-11-04T01:45:33.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.875+0000 7ff7d9d9b640 1 -- 172.21.15.77:0/3337247301 >> v1:172.21.15.77:6789/0 conn(0x7ff7dc070ff0 legacy=0x7ff7dc0713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:33.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.875+0000 7ff7d9d9b640 1 --2- 172.21.15.77:0/3337247301 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7c80039c0 0x7ff7c8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.875+0000 7ff7d9d9b640 1 --2- 172.21.15.77:0/3337247301 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff7c80047c0 0x7ff7c8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.875+0000 7ff7d9d9b640 1 --2- 172.21.15.77:0/3337247301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7c8005180 0x7ff7c800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.875+0000 7ff7d9d9b640 1 -- 172.21.15.77:0/3337247301 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc0cdb30 con 0x7ff7c8005180 2023-11-04T01:45:33.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.875+0000 7ff7d9d9b640 1 -- 172.21.15.77:0/3337247301 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c800c080 con 0x7ff7c80039c0 2023-11-04T01:45:33.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.875+0000 7ff7d9d9b640 1 -- 172.21.15.77:0/3337247301 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c800c240 con 0x7ff7c80047c0 2023-11-04T01:45:33.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.875+0000 7ff7dad9d640 1 --2- 172.21.15.77:0/3337247301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7c8005180 0x7ff7c800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.876+0000 7ff7da59c640 1 --2- 172.21.15.77:0/3337247301 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7c80039c0 0x7ff7c8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.876+0000 7ff7d1d9b640 1 --2- 172.21.15.77:0/3337247301 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff7c80047c0 0x7ff7c8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.876+0000 7ff7dad9d640 1 -- 172.21.15.77:0/3337247301 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff7c80047c0 msgr2=0x7ff7c8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:33.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.876+0000 7ff7dad9d640 1 --2- 172.21.15.77:0/3337247301 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff7c80047c0 0x7ff7c8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.876+0000 7ff7dad9d640 1 -- 172.21.15.77:0/3337247301 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7c80039c0 msgr2=0x7ff7c8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:33.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.876+0000 7ff7dad9d640 1 --2- 172.21.15.77:0/3337247301 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7c80039c0 0x7ff7c8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.876+0000 7ff7dad9d640 1 -- 172.21.15.77:0/3337247301 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c8003520 con 0x7ff7c8005180 2023-11-04T01:45:33.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.876+0000 7ff7dad9d640 1 -- 172.21.15.77:0/3337247301 reap_dead start 2023-11-04T01:45:33.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.876+0000 7ff7dad9d640 1 --2- 172.21.15.77:0/3337247301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7c8005180 0x7ff7c800b980 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4009fc0 tx=0x7ff7c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e1fbad071c51252 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:33.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.877+0000 7ff7d9d9b640 1 -- 172.21.15.77:0/3337247301 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d402cc60 con 0x7ff7c8005180 2023-11-04T01:45:33.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.877+0000 7ff7d9d9b640 1 -- 172.21.15.77:0/3337247301 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7d400f040 con 0x7ff7c8005180 2023-11-04T01:45:33.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.877+0000 7ff7d9d9b640 1 -- 172.21.15.77:0/3337247301 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d4003990 con 0x7ff7c8005180 2023-11-04T01:45:33.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.877+0000 7ff7e0abb640 1 -- 172.21.15.77:0/3337247301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7c8005180 msgr2=0x7ff7c800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:33.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.877+0000 7ff7e0abb640 1 --2- 172.21.15.77:0/3337247301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7c8005180 0x7ff7c800b980 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4009fc0 tx=0x7ff7c80057f0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.877+0000 7ff7e0abb640 1 -- 172.21.15.77:0/3337247301 shutdown_connections 2023-11-04T01:45:33.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.877+0000 7ff7e0abb640 1 --2- 172.21.15.77:0/3337247301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7c8005180 0x7ff7c800b980 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.877+0000 7ff7e0abb640 1 -- 172.21.15.77:0/3337247301 >> 172.21.15.77:0/3337247301 conn(0x7ff7dc0cbc90 msgr2=0x7ff7dc0cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:33.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.877+0000 7ff7e0abb640 1 -- 172.21.15.77:0/3337247301 shutdown_connections 2023-11-04T01:45:33.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.877+0000 7ff7e0abb640 1 -- 172.21.15.77:0/3337247301 wait complete. 2023-11-04T01:45:33.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.879+0000 7ff7e0abb640 1 Processor -- start 2023-11-04T01:45:33.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.879+0000 7ff7e0abb640 1 -- start start 2023-11-04T01:45:33.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.879+0000 7ff7e0abb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7c8005180 0x7ff7dc1584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.879+0000 7ff7e0abb640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff7dc0c8b50 0x7ff7dc0c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.879+0000 7ff7e0abb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7dc0c6cf0 0x7ff7dc1f18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.879+0000 7ff7e0abb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc0b2870 con 0x7ff7c8005180 2023-11-04T01:45:33.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.879+0000 7ff7e0abb640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc0c7700 con 0x7ff7dc0c6cf0 2023-11-04T01:45:33.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.879+0000 7ff7e0abb640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc0b1f40 con 0x7ff7dc0c8b50 2023-11-04T01:45:33.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.879+0000 7ff7da59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7c8005180 0x7ff7dc1584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.879+0000 7ff7da59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7c8005180 0x7ff7dc1584d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49818/0 (socket says 172.21.15.77:49818) 2023-11-04T01:45:33.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.879+0000 7ff7da59c640 1 -- 172.21.15.77:0/2349752449 learned_addr learned my addr 172.21.15.77:0/2349752449 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:33.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.880+0000 7ff7da59c640 1 -- 172.21.15.77:0/2349752449 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff7dc0c8b50 msgr2=0x7ff7dc0c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:33.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.880+0000 7ff7da59c640 1 --2- 172.21.15.77:0/2349752449 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff7dc0c8b50 0x7ff7dc0c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.880+0000 7ff7da59c640 1 -- 172.21.15.77:0/2349752449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7dc0c6cf0 msgr2=0x7ff7dc1f18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:33.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.880+0000 7ff7da59c640 1 --2- 172.21.15.77:0/2349752449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7dc0c6cf0 0x7ff7dc1f18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.880+0000 7ff7da59c640 1 -- 172.21.15.77:0/2349752449 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7dc0b2220 con 0x7ff7c8005180 2023-11-04T01:45:33.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.880+0000 7ff7da59c640 1 --2- 172.21.15.77:0/2349752449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7c8005180 0x7ff7dc1584d0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc0072c0 tx=0x7ff7cc0076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:33.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.880+0000 7ff7d37fe640 1 -- 172.21.15.77:0/2349752449 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc00f9c0 con 0x7ff7c8005180 2023-11-04T01:45:33.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.880+0000 7ff7d37fe640 1 -- 172.21.15.77:0/2349752449 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7cc00fb40 con 0x7ff7c8005180 2023-11-04T01:45:33.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.880+0000 7ff7e0abb640 1 -- 172.21.15.77:0/2349752449 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7dc0b2500 con 0x7ff7c8005180 2023-11-04T01:45:33.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.880+0000 7ff7d37fe640 1 -- 172.21.15.77:0/2349752449 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc0133f0 con 0x7ff7c8005180 2023-11-04T01:45:33.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.880+0000 7ff7e0abb640 1 -- 172.21.15.77:0/2349752449 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7dc0c8820 con 0x7ff7c8005180 2023-11-04T01:45:33.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.882+0000 7ff7d37fe640 1 -- 172.21.15.77:0/2349752449 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff7cc013550 con 0x7ff7c8005180 2023-11-04T01:45:33.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.882+0000 7ff7d37fe640 1 --2- 172.21.15.77:0/2349752449 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff7bc06ae70 0x7ff7bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.882+0000 7ff7d37fe640 1 -- 172.21.15.77:0/2349752449 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7ff7cc089c00 con 0x7ff7c8005180 2023-11-04T01:45:33.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.882+0000 7ff7d1d9b640 1 --2- 172.21.15.77:0/2349752449 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff7bc06ae70 0x7ff7bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.883+0000 7ff7d1d9b640 1 --2- 172.21.15.77:0/2349752449 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff7bc06ae70 0x7ff7bc06d330 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4000c00 tx=0x7ff7c4009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:33.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.883+0000 7ff7e364b740 1 Processor -- start 2023-11-04T01:45:33.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.883+0000 7ff7e364b740 1 -- start start 2023-11-04T01:45:33.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.884+0000 7ff7e364b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5651e4ab0850 0x5651e4a83750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.884+0000 7ff7e364b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5651e4ab0c30 0x5651e4ab35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.884+0000 7ff7e364b740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5651e4a83c90 0x5651e4ab3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.884+0000 7ff7e364b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651e4994740 con 0x5651e4ab0c30 2023-11-04T01:45:33.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.884+0000 7ff7e364b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651e49f68d0 con 0x5651e4ab0850 2023-11-04T01:45:33.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.884+0000 7ff7e364b740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651e49f3fc0 con 0x5651e4a83c90 2023-11-04T01:45:33.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.884+0000 7ff7d1d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5651e4ab0c30 0x5651e4ab35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.884+0000 7ff7d1d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5651e4ab0c30 0x5651e4ab35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49832/0 (socket says 172.21.15.77:49832) 2023-11-04T01:45:33.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.884+0000 7ff7d1d9b640 1 -- 172.21.15.77:0/2335076687 learned_addr learned my addr 172.21.15.77:0/2335076687 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:33.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.884+0000 7ff7dad9d640 1 --2- 172.21.15.77:0/2335076687 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5651e4a83c90 0x5651e4ab3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.884+0000 7ff7da59c640 1 --2- 172.21.15.77:0/2335076687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5651e4ab0850 0x5651e4a83750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.884+0000 7ff7d1d9b640 1 -- 172.21.15.77:0/2335076687 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5651e4a83c90 msgr2=0x5651e4ab3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:33.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.884+0000 7ff7d1d9b640 1 --2- 172.21.15.77:0/2335076687 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5651e4a83c90 0x5651e4ab3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.884+0000 7ff7d1d9b640 1 -- 172.21.15.77:0/2335076687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5651e4ab0850 msgr2=0x5651e4a83750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:33.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.884+0000 7ff7d1d9b640 1 --2- 172.21.15.77:0/2335076687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5651e4ab0850 0x5651e4a83750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.884+0000 7ff7d1d9b640 1 -- 172.21.15.77:0/2335076687 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651e49b2ca0 con 0x5651e4ab0c30 2023-11-04T01:45:33.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.885+0000 7ff7d1d9b640 1 --2- 172.21.15.77:0/2335076687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5651e4ab0c30 0x5651e4ab35e0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4001e50 tx=0x7ff7c4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=281dc43954048fec server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:33.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.885+0000 7ff7bbfff640 1 -- 172.21.15.77:0/2335076687 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c4014850 con 0x5651e4ab0c30 2023-11-04T01:45:33.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.885+0000 7ff7bbfff640 1 -- 172.21.15.77:0/2335076687 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c40149b0 con 0x5651e4ab0c30 2023-11-04T01:45:33.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.885+0000 7ff7bbfff640 1 -- 172.21.15.77:0/2335076687 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c4014d60 con 0x5651e4ab0c30 2023-11-04T01:45:33.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.885+0000 7ff7e364b740 1 -- 172.21.15.77:0/2335076687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5651e4ab0c30 msgr2=0x5651e4ab35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:33.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.885+0000 7ff7e364b740 1 --2- 172.21.15.77:0/2335076687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5651e4ab0c30 0x5651e4ab35e0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4001e50 tx=0x7ff7c4012000 comp rx=0 tx=0).stop 2023-11-04T01:45:33.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.885+0000 7ff7e364b740 1 -- 172.21.15.77:0/2335076687 shutdown_connections 2023-11-04T01:45:33.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.885+0000 7ff7e364b740 1 --2- 172.21.15.77:0/2335076687 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5651e4a83c90 0x5651e4ab3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.885+0000 7ff7e364b740 1 --2- 172.21.15.77:0/2335076687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5651e4ab0c30 0x5651e4ab35e0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.885+0000 7ff7e364b740 1 --2- 172.21.15.77:0/2335076687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5651e4ab0850 0x5651e4a83750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.885+0000 7ff7e364b740 1 -- 172.21.15.77:0/2335076687 >> 172.21.15.77:0/2335076687 conn(0x5651e4a85a60 msgr2=0x5651e4ace5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:33.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.885+0000 7ff7e364b740 1 -- 172.21.15.77:0/2335076687 shutdown_connections 2023-11-04T01:45:33.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.885+0000 7ff7e364b740 1 -- 172.21.15.77:0/2335076687 wait complete. 2023-11-04T01:45:33.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.886+0000 7ff7e364b740 1 -- start start 2023-11-04T01:45:33.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.886+0000 7ff7e364b740 1 Processor -- start 2023-11-04T01:45:33.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.887+0000 7ff7e364b740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5651e4ab0850 0x5651e4ac7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.887+0000 7ff7e364b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5651e4ab0c30 0x5651e4ac7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.887+0000 7ff7e364b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5651e4a9ee70 0x5651e4ac8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.887+0000 7ff7e364b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651e49ef8b0 con 0x5651e4a9ee70 2023-11-04T01:45:33.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.887+0000 7ff7e364b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651e49a9c80 con 0x5651e4ab0c30 2023-11-04T01:45:33.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.887+0000 7ff7e364b740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651e49a9920 con 0x5651e4ab0850 2023-11-04T01:45:33.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.887+0000 7ff7e364b740 10 client.0 _ll_register_callbacks cb 0x5651e4701ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:45:33.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.887+0000 7ff7dad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5651e4a9ee70 0x5651e4ac8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.887+0000 7ff7dad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5651e4a9ee70 0x5651e4ac8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49834/0 (socket says 172.21.15.77:49834) 2023-11-04T01:45:33.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.887+0000 7ff7dad9d640 1 -- 172.21.15.77:0/255737841 learned_addr learned my addr 172.21.15.77:0/255737841 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:33.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.887+0000 7ff7d1d9b640 1 --2- 172.21.15.77:0/255737841 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5651e4ab0c30 0x5651e4ac7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.887+0000 7ff7da59c640 1 --2- 172.21.15.77:0/255737841 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5651e4ab0850 0x5651e4ac7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.887+0000 7ff7dad9d640 1 -- 172.21.15.77:0/255737841 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5651e4ab0850 msgr2=0x5651e4ac7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:33.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.887+0000 7ff7dad9d640 1 --2- 172.21.15.77:0/255737841 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5651e4ab0850 0x5651e4ac7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.887+0000 7ff7dad9d640 1 -- 172.21.15.77:0/255737841 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5651e4ab0c30 msgr2=0x5651e4ac7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:33.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.887+0000 7ff7dad9d640 1 --2- 172.21.15.77:0/255737841 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5651e4ab0c30 0x5651e4ac7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.887+0000 7ff7dad9d640 1 -- 172.21.15.77:0/255737841 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7dc0cd890 con 0x5651e4a9ee70 2023-11-04T01:45:33.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.888+0000 7ff7dad9d640 1 --2- 172.21.15.77:0/255737841 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5651e4a9ee70 0x5651e4ac8c10 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7ff7d402c6d0 tx=0x7ff7d4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d473d08d2d35da2b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:33.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.888+0000 7ff7b97fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:45:33.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.888+0000 7ff7b97fa640 1 -- 172.21.15.77:0/255737841 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d4003da0 con 0x5651e4a9ee70 2023-11-04T01:45:33.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.888+0000 7ff7b97fa640 1 -- 172.21.15.77:0/255737841 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7ff7d402ce40 con 0x5651e4a9ee70 2023-11-04T01:45:33.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.888+0000 7ff7e364b740 1 -- 172.21.15.77:0/255737841 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5651e499bbf0 con 0x5651e4a9ee70 2023-11-04T01:45:33.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.888+0000 7ff7b97fa640 1 -- 172.21.15.77:0/255737841 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7d4004030 con 0x5651e4a9ee70 2023-11-04T01:45:33.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.888+0000 7ff7e364b740 10 client.8025 fetch_fsmap learned FSMap version 80 2023-11-04T01:45:33.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.888+0000 7ff7e364b740 1 -- 172.21.15.77:0/255737841 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=2+}) v3 -- 0x5651e49edf30 con 0x5651e4a9ee70 2023-11-04T01:45:33.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.888+0000 7ff7b97fa640 1 -- 172.21.15.77:0/255737841 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5651e499bbf0 con 0x5651e4a9ee70 2023-11-04T01:45:33.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.888+0000 7ff7b97fa640 1 -- 172.21.15.77:0/255737841 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 80) v1 ==== 3306+0+0 (secure 0 0 0) 0x7ff7d403c040 con 0x5651e4a9ee70 2023-11-04T01:45:33.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.888+0000 7ff7e364b740 10 client.8025 fetch_fsmap finished waiting for FSMap version 80 2023-11-04T01:45:33.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.888+0000 7ff7e364b740 10 client.8025 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:45:33.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.888+0000 7ff7e364b740 20 client.8025 populate_metadata read hostname 'smithi077' 2023-11-04T01:45:33.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.888+0000 7ff7e364b740 1 --2- 172.21.15.77:0/255737841 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x5651e4aa1070 0x5651e4aa14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.888+0000 7ff7e364b740 4 client.8025 mds_command: new command op to 7305 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:45:33.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.888+0000 7ff7e364b740 1 -- 172.21.15.77:0/255737841 --> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5651e49e8890 con 0x5651e4aa1070 2023-11-04T01:45:33.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.888+0000 7ff7da59c640 1 --2- 172.21.15.77:0/255737841 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x5651e4aa1070 0x5651e4aa14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.889+0000 7ff7b97fa640 10 client.8025 ms_handle_connect on v2:172.21.15.77:6833/3207490604 2023-11-04T01:45:33.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.889+0000 7ff7da59c640 1 --2- 172.21.15.77:0/255737841 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x5651e4aa1070 0x5651e4aa14e0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f992fa0fda764ac3 server_cookie=5994dc4311bf56da in_seq=0 out_seq=0 2023-11-04T01:45:33.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.889+0000 7ff7b97fa640 1 -- 172.21.15.77:0/255737841 <== mds.1 v2:172.21.15.77:6833/3207490604 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5651e49e8890 con 0x5651e4aa1070 2023-11-04T01:45:33.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.889+0000 7ff7b97fa640 10 client.8025 handle_command_reply: tid=0 2023-11-04T01:45:33.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.889+0000 7ff7e364b740 1 client.8025 shutdown 2023-11-04T01:45:33.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.889+0000 7ff7e364b740 1 -- 172.21.15.77:0/255737841 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5651e4a9ee70 msgr2=0x5651e4ac8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:33.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.889+0000 7ff7e364b740 1 --2- 172.21.15.77:0/255737841 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5651e4a9ee70 0x5651e4ac8c10 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7ff7d402c6d0 tx=0x7ff7d4009750 comp rx=0 tx=0).stop 2023-11-04T01:45:33.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.889+0000 7ff7e364b740 1 -- 172.21.15.77:0/255737841 shutdown_connections 2023-11-04T01:45:33.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.889+0000 7ff7e364b740 1 --2- 172.21.15.77:0/255737841 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5651e4a9ee70 0x5651e4ac8c10 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.889+0000 7ff7e364b740 1 --2- 172.21.15.77:0/255737841 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x5651e4aa1070 0x5651e4aa14e0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.889+0000 7ff7e364b740 1 --2- 172.21.15.77:0/255737841 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5651e4ab0c30 0x5651e4ac7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.889+0000 7ff7e364b740 1 --2- 172.21.15.77:0/255737841 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5651e4ab0850 0x5651e4ac7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.889+0000 7ff7b97fa640 0 client.8025 ms_handle_reset on v2:172.21.15.77:6833/3207490604 2023-11-04T01:45:33.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.889+0000 7ff7e364b740 1 -- 172.21.15.77:0/255737841 >> 172.21.15.77:0/255737841 conn(0x5651e4a83c90 msgr2=0x5651e4a87600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:33.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.889+0000 7ff7e364b740 1 -- 172.21.15.77:0/255737841 shutdown_connections 2023-11-04T01:45:33.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.889+0000 7ff7e364b740 1 -- 172.21.15.77:0/255737841 wait complete. 2023-11-04T01:45:33.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.889+0000 7ff7e364b740 20 client.8025 trim_cache size 0 max 16384 2023-11-04T01:45:33.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.905+0000 7ff7e364b740 1 Processor -- start 2023-11-04T01:45:33.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.905+0000 7ff7e364b740 1 -- start start 2023-11-04T01:45:33.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.905+0000 7ff7e364b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5651e4a9ee70 0x5651e4ac71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.905+0000 7ff7e364b740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5651e4ab0850 0x5651e4ade3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.905+0000 7ff7e364b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5651e4ab0c30 0x5651e4ac7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.906+0000 7ff7e364b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651e496f280 con 0x5651e4ab0c30 2023-11-04T01:45:33.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.906+0000 7ff7e364b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651e4b301c0 con 0x5651e4a9ee70 2023-11-04T01:45:33.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.906+0000 7ff7e364b740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651e498e0b0 con 0x5651e4ab0850 2023-11-04T01:45:33.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.906+0000 7ff7dad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5651e4ab0c30 0x5651e4ac7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.906+0000 7ff7dad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5651e4ab0c30 0x5651e4ac7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49848/0 (socket says 172.21.15.77:49848) 2023-11-04T01:45:33.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.906+0000 7ff7dad9d640 1 -- 172.21.15.77:0/2127430142 learned_addr learned my addr 172.21.15.77:0/2127430142 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:33.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.906+0000 7ff7da59c640 1 --2- 172.21.15.77:0/2127430142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5651e4a9ee70 0x5651e4ac71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.906+0000 7ff7d1d9b640 1 --2- 172.21.15.77:0/2127430142 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5651e4ab0850 0x5651e4ade3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.906+0000 7ff7dad9d640 1 -- 172.21.15.77:0/2127430142 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5651e4ab0850 msgr2=0x5651e4ade3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:33.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.906+0000 7ff7dad9d640 1 --2- 172.21.15.77:0/2127430142 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5651e4ab0850 0x5651e4ade3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.906+0000 7ff7dad9d640 1 -- 172.21.15.77:0/2127430142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5651e4a9ee70 msgr2=0x5651e4ac71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:33.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.906+0000 7ff7dad9d640 1 --2- 172.21.15.77:0/2127430142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5651e4a9ee70 0x5651e4ac71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.906+0000 7ff7dad9d640 1 -- 172.21.15.77:0/2127430142 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651e498bd10 con 0x5651e4ab0c30 2023-11-04T01:45:33.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.906+0000 7ff7dad9d640 1 --2- 172.21.15.77:0/2127430142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5651e4ab0c30 0x5651e4ac7af0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7ff7d400e230 tx=0x7ff7d403d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6407fc3c00634c32 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:33.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.906+0000 7ff7d0d99640 1 -- 172.21.15.77:0/2127430142 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d40040e0 con 0x5651e4ab0c30 2023-11-04T01:45:33.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.906+0000 7ff7d0d99640 1 -- 172.21.15.77:0/2127430142 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7d4003ba0 con 0x5651e4ab0c30 2023-11-04T01:45:33.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.906+0000 7ff7d0d99640 1 -- 172.21.15.77:0/2127430142 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d4003d50 con 0x5651e4ab0c30 2023-11-04T01:45:33.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.907+0000 7ff7e364b740 1 -- 172.21.15.77:0/2127430142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5651e4ab0c30 msgr2=0x5651e4ac7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:33.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.907+0000 7ff7e364b740 1 --2- 172.21.15.77:0/2127430142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5651e4ab0c30 0x5651e4ac7af0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7ff7d400e230 tx=0x7ff7d403d000 comp rx=0 tx=0).stop 2023-11-04T01:45:33.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.907+0000 7ff7e364b740 1 -- 172.21.15.77:0/2127430142 shutdown_connections 2023-11-04T01:45:33.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.907+0000 7ff7e364b740 1 --2- 172.21.15.77:0/2127430142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5651e4ab0c30 0x5651e4ac7af0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.907+0000 7ff7e364b740 1 --2- 172.21.15.77:0/2127430142 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5651e4ab0850 0x5651e4ade3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.907+0000 7ff7e364b740 1 --2- 172.21.15.77:0/2127430142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5651e4a9ee70 0x5651e4ac71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.907+0000 7ff7e364b740 1 -- 172.21.15.77:0/2127430142 >> 172.21.15.77:0/2127430142 conn(0x5651e4a83c90 msgr2=0x5651e4ab35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:33.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.907+0000 7ff7e364b740 1 -- 172.21.15.77:0/2127430142 shutdown_connections 2023-11-04T01:45:33.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.907+0000 7ff7e364b740 1 -- 172.21.15.77:0/2127430142 wait complete. 2023-11-04T01:45:33.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.907+0000 7ff7e364b740 1 -- start start 2023-11-04T01:45:33.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.907+0000 7ff7e364b740 1 Processor -- start 2023-11-04T01:45:33.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.908+0000 7ff7e364b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5651e4a9ee70 0x5651e4b28660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.908+0000 7ff7e364b740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5651e4ab0850 0x5651e4a89100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.908+0000 7ff7e364b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5651e4ab0c30 0x5651e4adcd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.908+0000 7ff7e364b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651e4b28ba0 con 0x5651e4a9ee70 2023-11-04T01:45:33.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.908+0000 7ff7e364b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651e4add910 con 0x5651e4ab0c30 2023-11-04T01:45:33.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.908+0000 7ff7e364b740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651e4ae7f40 con 0x5651e4ab0850 2023-11-04T01:45:33.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.908+0000 7ff7e364b740 10 client.0 _ll_register_callbacks cb 0x7ff7c4017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:45:33.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.908+0000 7ff7da59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5651e4a9ee70 0x5651e4b28660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.908+0000 7ff7da59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5651e4a9ee70 0x5651e4b28660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49864/0 (socket says 172.21.15.77:49864) 2023-11-04T01:45:33.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.908+0000 7ff7da59c640 1 -- 172.21.15.77:0/2919940728 learned_addr learned my addr 172.21.15.77:0/2919940728 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:33.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.909+0000 7ff7dad9d640 1 --2- 172.21.15.77:0/2919940728 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5651e4ab0c30 0x5651e4adcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.909+0000 7ff7da59c640 1 -- 172.21.15.77:0/2919940728 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5651e4ab0850 msgr2=0x5651e4a89100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:33.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.909+0000 7ff7da59c640 1 --2- 172.21.15.77:0/2919940728 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5651e4ab0850 0x5651e4a89100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.909+0000 7ff7da59c640 1 -- 172.21.15.77:0/2919940728 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5651e4ab0c30 msgr2=0x5651e4adcd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:33.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.909+0000 7ff7da59c640 1 --2- 172.21.15.77:0/2919940728 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5651e4ab0c30 0x5651e4adcd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.909+0000 7ff7da59c640 1 -- 172.21.15.77:0/2919940728 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5651e49edf30 con 0x5651e4a9ee70 2023-11-04T01:45:33.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.909+0000 7ff7dad9d640 1 --2- 172.21.15.77:0/2919940728 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5651e4ab0c30 0x5651e4adcd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:33.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.909+0000 7ff7da59c640 1 --2- 172.21.15.77:0/2919940728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5651e4a9ee70 0x5651e4b28660 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc00f5a0 tx=0x7ff7cc089040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f033f250078268 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:33.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.909+0000 7ff7b97fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:45:33.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.909+0000 7ff7b97fa640 1 -- 172.21.15.77:0/2919940728 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc086070 con 0x5651e4a9ee70 2023-11-04T01:45:33.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.909+0000 7ff7b97fa640 1 -- 172.21.15.77:0/2919940728 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7ff7cc0605e0 con 0x5651e4a9ee70 2023-11-04T01:45:33.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.909+0000 7ff7e364b740 1 -- 172.21.15.77:0/2919940728 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff7c40149b0 con 0x5651e4a9ee70 2023-11-04T01:45:33.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.909+0000 7ff7b97fa640 1 -- 172.21.15.77:0/2919940728 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7cc056680 con 0x5651e4a9ee70 2023-11-04T01:45:33.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.909+0000 7ff7e364b740 10 client.8031 fetch_fsmap learned FSMap version 80 2023-11-04T01:45:33.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.909+0000 7ff7e364b740 1 -- 172.21.15.77:0/2919940728 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=2+}) v3 -- 0x5651e49b1500 con 0x5651e4a9ee70 2023-11-04T01:45:33.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.909+0000 7ff7b97fa640 1 -- 172.21.15.77:0/2919940728 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7cc07a030 con 0x5651e4a9ee70 2023-11-04T01:45:33.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.909+0000 7ff7b97fa640 1 -- 172.21.15.77:0/2919940728 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 80) v1 ==== 3306+0+0 (secure 0 0 0) 0x7ff7cc012070 con 0x5651e4a9ee70 2023-11-04T01:45:33.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.909+0000 7ff7e364b740 10 client.8031 fetch_fsmap finished waiting for FSMap version 80 2023-11-04T01:45:33.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.909+0000 7ff7e364b740 10 client.8031 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:45:33.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.909+0000 7ff7e364b740 20 client.8031 populate_metadata read hostname 'smithi077' 2023-11-04T01:45:33.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.909+0000 7ff7e364b740 1 --2- 172.21.15.77:0/2919940728 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x5651e4ab4980 0x5651e4ab4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.909+0000 7ff7e364b740 4 client.8031 mds_command: new command op to 7305 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:45:33.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.909+0000 7ff7e364b740 1 -- 172.21.15.77:0/2919940728 --> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5651e49e85b0 con 0x5651e4ab4980 2023-11-04T01:45:33.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.909+0000 7ff7d1d9b640 1 --2- 172.21.15.77:0/2919940728 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x5651e4ab4980 0x5651e4ab4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.910+0000 7ff7b97fa640 10 client.8031 ms_handle_connect on v2:172.21.15.77:6833/3207490604 2023-11-04T01:45:33.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.910+0000 7ff7d1d9b640 1 --2- 172.21.15.77:0/2919940728 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x5651e4ab4980 0x5651e4ab4d60 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ea7f5a2bf3f85764 server_cookie=c30437bb87c025a in_seq=0 out_seq=0 2023-11-04T01:45:33.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.910+0000 7ff7b97fa640 1 -- 172.21.15.77:0/2919940728 <== mds.1 v2:172.21.15.77:6833/3207490604 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x5651e49e85b0 con 0x5651e4ab4980 2023-11-04T01:45:33.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.910+0000 7ff7b97fa640 10 client.8031 handle_command_reply: tid=0 2023-11-04T01:45:33.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.910+0000 7ff7e364b740 1 client.8031 shutdown 2023-11-04T01:45:33.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.910+0000 7ff7e364b740 1 -- 172.21.15.77:0/2919940728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5651e4a9ee70 msgr2=0x5651e4b28660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:33.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.910+0000 7ff7e364b740 1 --2- 172.21.15.77:0/2919940728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5651e4a9ee70 0x5651e4b28660 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc00f5a0 tx=0x7ff7cc089040 comp rx=0 tx=0).stop 2023-11-04T01:45:33.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.910+0000 7ff7e364b740 1 -- 172.21.15.77:0/2919940728 shutdown_connections 2023-11-04T01:45:33.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.910+0000 7ff7e364b740 1 --2- 172.21.15.77:0/2919940728 >> [v2:172.21.15.77:6833/3207490604,v1:172.21.15.77:6835/3207490604] conn(0x5651e4ab4980 0x5651e4ab4d60 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.910+0000 7ff7e364b740 1 --2- 172.21.15.77:0/2919940728 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5651e4ab0c30 0x5651e4adcd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.910+0000 7ff7e364b740 1 --2- 172.21.15.77:0/2919940728 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x5651e4ab0850 0x5651e4a89100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.910+0000 7ff7b97fa640 0 client.8031 ms_handle_reset on v2:172.21.15.77:6833/3207490604 2023-11-04T01:45:33.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.910+0000 7ff7e364b740 1 --2- 172.21.15.77:0/2919940728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5651e4a9ee70 0x5651e4b28660 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.910+0000 7ff7e364b740 1 -- 172.21.15.77:0/2919940728 >> 172.21.15.77:0/2919940728 conn(0x5651e4a83c90 msgr2=0x5651e4a824f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:33.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.910+0000 7ff7e364b740 1 -- 172.21.15.77:0/2919940728 shutdown_connections 2023-11-04T01:45:33.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.910+0000 7ff7e364b740 1 -- 172.21.15.77:0/2919940728 wait complete. 2023-11-04T01:45:33.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.910+0000 7ff7e364b740 20 client.8031 trim_cache size 0 max 16384 2023-11-04T01:45:33.940 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-04T01:45:33.941 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "0c22c75d-0169-41ef-b663-6ac1c5b0f71f", 2023-11-04T01:45:33.941 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 1, 2023-11-04T01:45:33.941 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 7305, 2023-11-04T01:45:33.941 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2023-11-04T01:45:33.941 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2023-11-04T01:45:33.942 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2023-11-04T01:45:33.942 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 117.306503779, 2023-11-04T01:45:33.942 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 80, 2023-11-04T01:45:33.942 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 102, 2023-11-04T01:45:33.942 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 102, 2023-11-04T01:45:33.943 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 133.05860091299999 2023-11-04T01:45:33.943 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-04T01:45:33.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.911+0000 7ff7e0abb640 1 -- 172.21.15.77:0/2349752449 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff7bc06ae70 msgr2=0x7ff7bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:33.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.911+0000 7ff7e0abb640 1 --2- 172.21.15.77:0/2349752449 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff7bc06ae70 0x7ff7bc06d330 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4000c00 tx=0x7ff7c4009040 comp rx=0 tx=0).stop 2023-11-04T01:45:33.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.911+0000 7ff7e0abb640 1 -- 172.21.15.77:0/2349752449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7c8005180 msgr2=0x7ff7dc1584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:33.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.911+0000 7ff7e0abb640 1 --2- 172.21.15.77:0/2349752449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7c8005180 0x7ff7dc1584d0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc0072c0 tx=0x7ff7cc0076c0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.911+0000 7ff7e0abb640 1 -- 172.21.15.77:0/2349752449 shutdown_connections 2023-11-04T01:45:33.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.911+0000 7ff7e0abb640 1 --2- 172.21.15.77:0/2349752449 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff7bc06ae70 0x7ff7bc06d330 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.911+0000 7ff7e0abb640 1 --2- 172.21.15.77:0/2349752449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7dc0c6cf0 0x7ff7dc1f18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.911+0000 7ff7e0abb640 1 --2- 172.21.15.77:0/2349752449 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff7dc0c8b50 0x7ff7dc0c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.911+0000 7ff7e0abb640 1 --2- 172.21.15.77:0/2349752449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7c8005180 0x7ff7dc1584d0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.911+0000 7ff7e0abb640 1 -- 172.21.15.77:0/2349752449 >> 172.21.15.77:0/2349752449 conn(0x7ff7dc0cbc90 msgr2=0x7ff7dc06a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:33.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.911+0000 7ff7e0abb640 1 -- 172.21.15.77:0/2349752449 shutdown_connections 2023-11-04T01:45:33.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:33.911+0000 7ff7e0abb640 1 -- 172.21.15.77:0/2349752449 wait complete. 2023-11-04T01:45:33.947 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:34.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.044+0000 7ff842997640 1 Processor -- start 2023-11-04T01:45:34.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.044+0000 7ff842997640 1 -- start start 2023-11-04T01:45:34.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.044+0000 7ff842997640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff83c0cde60 0x7ff83c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:34.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.044+0000 7ff842997640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff83c15daa0 0x7ff83c157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:34.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.044+0000 7ff842997640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83c15e000 con 0x7ff83c0ce240 2023-11-04T01:45:34.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.044+0000 7ff842997640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff83c15e5c0 con 0x7ff83c15daa0 2023-11-04T01:45:34.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.044+0000 7ff842997640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c15e2e0 con 0x7ff83c0cde60 2023-11-04T01:45:34.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.045+0000 7ff83b7fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff83c15daa0 0x7ff83c157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:34.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.045+0000 7ff83bfff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff83c0cde60 0x7ff83c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:34.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.045+0000 7ff840f34640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7ff83c0ce240 0x7ff83c06b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:55556/0 (socket says 172.21.15.77:55556) 2023-11-04T01:45:34.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.045+0000 7ff83b7fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff83c15daa0 0x7ff83c157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.77:53366/0 (socket says 172.21.15.77:53366) 2023-11-04T01:45:34.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.045+0000 7ff840f34640 1 -- 172.21.15.77:0/2141560827 learned_addr learned my addr 172.21.15.77:0/2141560827 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:45:34.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.045+0000 7ff83b7fe640 1 -- 172.21.15.77:0/2141560827 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff83c0cde60 msgr2=0x7ff83c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:34.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.045+0000 7ff83b7fe640 1 --2- 172.21.15.77:0/2141560827 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff83c0cde60 0x7ff83c15d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.045+0000 7ff83b7fe640 1 -- 172.21.15.77:0/2141560827 >> v1:172.21.15.122:6789/0 conn(0x7ff83c0ce240 legacy=0x7ff83c06b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:34.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.045+0000 7ff83b7fe640 1 -- 172.21.15.77:0/2141560827 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83c0d1120 con 0x7ff83c15daa0 2023-11-04T01:45:34.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.045+0000 7ff83affd640 1 -- 172.21.15.77:0/2141560827 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 459073761 0 0) 0x7ff83c15e000 con 0x7ff83c0ce240 2023-11-04T01:45:34.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.046+0000 7ff83b7fe640 1 --2- 172.21.15.77:0/2141560827 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff83c15daa0 0x7ff83c157000 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff82c0097a0 tx=0x7ff82c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d7f2851b865149e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:34.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.046+0000 7ff83affd640 1 -- 172.21.15.77:0/2141560827 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c031830 con 0x7ff83c15daa0 2023-11-04T01:45:34.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.046+0000 7ff83affd640 1 -- 172.21.15.77:0/2141560827 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82c031990 con 0x7ff83c15daa0 2023-11-04T01:45:34.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.046+0000 7ff83affd640 1 -- 172.21.15.77:0/2141560827 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c031d20 con 0x7ff83c15daa0 2023-11-04T01:45:34.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.046+0000 7ff842997640 1 -- 172.21.15.77:0/2141560827 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff83c15daa0 msgr2=0x7ff83c157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:34.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.046+0000 7ff842997640 1 --2- 172.21.15.77:0/2141560827 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff83c15daa0 0x7ff83c157000 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff82c0097a0 tx=0x7ff82c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.046+0000 7ff842997640 1 -- 172.21.15.77:0/2141560827 shutdown_connections 2023-11-04T01:45:34.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.046+0000 7ff842997640 1 --2- 172.21.15.77:0/2141560827 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff83c15daa0 0x7ff83c157000 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.046+0000 7ff842997640 1 --2- 172.21.15.77:0/2141560827 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff83c0cde60 0x7ff83c15d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.046+0000 7ff842997640 1 -- 172.21.15.77:0/2141560827 >> 172.21.15.77:0/2141560827 conn(0x7ff83c071f30 msgr2=0x7ff83c0cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:34.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.047+0000 7ff842997640 1 -- 172.21.15.77:0/2141560827 shutdown_connections 2023-11-04T01:45:34.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.047+0000 7ff842997640 1 -- 172.21.15.77:0/2141560827 wait complete. 2023-11-04T01:45:34.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.048+0000 7ff842997640 1 Processor -- start 2023-11-04T01:45:34.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.048+0000 7ff842997640 1 -- start start 2023-11-04T01:45:34.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.048+0000 7ff842997640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff83c0cde60 0x7ff83c0c5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:34.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.048+0000 7ff842997640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff83c0ce240 0x7ff83c153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:34.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.049+0000 7ff842997640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff83c15daa0 0x7ff83c151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:34.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.049+0000 7ff842997640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c152d50 con 0x7ff83c0ce240 2023-11-04T01:45:34.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.049+0000 7ff842997640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c1523d0 con 0x7ff83c0cde60 2023-11-04T01:45:34.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.049+0000 7ff842997640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c1f6b80 con 0x7ff83c15daa0 2023-11-04T01:45:34.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.049+0000 7ff83b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff83c0ce240 0x7ff83c153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:34.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.049+0000 7ff83b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff83c0ce240 0x7ff83c153170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49876/0 (socket says 172.21.15.77:49876) 2023-11-04T01:45:34.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.049+0000 7ff83b7fe640 1 -- 172.21.15.77:0/3046808682 learned_addr learned my addr 172.21.15.77:0/3046808682 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:34.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.049+0000 7ff83bfff640 1 --2- 172.21.15.77:0/3046808682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff83c0cde60 0x7ff83c0c5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:34.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.049+0000 7ff840f34640 1 --2- 172.21.15.77:0/3046808682 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff83c15daa0 0x7ff83c151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:34.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.049+0000 7ff83b7fe640 1 -- 172.21.15.77:0/3046808682 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff83c15daa0 msgr2=0x7ff83c151020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:34.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.049+0000 7ff83b7fe640 1 --2- 172.21.15.77:0/3046808682 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff83c15daa0 0x7ff83c151020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.049+0000 7ff83b7fe640 1 -- 172.21.15.77:0/3046808682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff83c0cde60 msgr2=0x7ff83c0c5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:34.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.049+0000 7ff83b7fe640 1 --2- 172.21.15.77:0/3046808682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff83c0cde60 0x7ff83c0c5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.049+0000 7ff83b7fe640 1 -- 172.21.15.77:0/3046808682 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c009400 con 0x7ff83c0ce240 2023-11-04T01:45:34.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.049+0000 7ff83b7fe640 1 --2- 172.21.15.77:0/3046808682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff83c0ce240 0x7ff83c153170 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7ff82c000c00 tx=0x7ff82c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:34.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.049+0000 7ff838ff9640 1 -- 172.21.15.77:0/3046808682 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c03a830 con 0x7ff83c0ce240 2023-11-04T01:45:34.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.049+0000 7ff838ff9640 1 -- 172.21.15.77:0/3046808682 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82c03a9b0 con 0x7ff83c0ce240 2023-11-04T01:45:34.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.049+0000 7ff842997640 1 -- 172.21.15.77:0/3046808682 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff83c152690 con 0x7ff83c0ce240 2023-11-04T01:45:34.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.049+0000 7ff838ff9640 1 -- 172.21.15.77:0/3046808682 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c03ad60 con 0x7ff83c0ce240 2023-11-04T01:45:34.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.049+0000 7ff842997640 1 -- 172.21.15.77:0/3046808682 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff83c0c5f40 con 0x7ff83c0ce240 2023-11-04T01:45:34.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.050+0000 7ff842997640 1 -- 172.21.15.77:0/3046808682 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff83c152e90 con 0x7ff83c0ce240 2023-11-04T01:45:34.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.051+0000 7ff838ff9640 1 -- 172.21.15.77:0/3046808682 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff82c04d450 con 0x7ff83c0ce240 2023-11-04T01:45:34.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.051+0000 7ff838ff9640 1 --2- 172.21.15.77:0/3046808682 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff82806ae70 0x7ff82806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:34.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.051+0000 7ff838ff9640 1 -- 172.21.15.77:0/3046808682 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7ff82c0abd70 con 0x7ff83c0ce240 2023-11-04T01:45:34.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.051+0000 7ff83bfff640 1 --2- 172.21.15.77:0/3046808682 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff82806ae70 0x7ff82806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:34.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.052+0000 7ff83bfff640 1 --2- 172.21.15.77:0/3046808682 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff82806ae70 0x7ff82806d330 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff830009b40 tx=0x7ff830009190 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:34.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.055+0000 7ff838ff9640 1 -- 172.21.15.77:0/3046808682 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff83c152e90 con 0x7ff83c0ce240 2023-11-04T01:45:34.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.255+0000 7ff842997640 1 -- 172.21.15.77:0/3046808682 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff83c152e90 con 0x7ff83c0ce240 2023-11-04T01:45:34.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.256+0000 7ff838ff9640 1 -- 172.21.15.77:0/3046808682 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4938 (secure 0 0 0) 0x7ff83c152e90 con 0x7ff83c0ce240 2023-11-04T01:45:34.258 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:34.259 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":80,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7977,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/3276812155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3276812155},{"type":"v1","addr":"172.21.15.77:6834","nonce":3276812155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:45:30.197166+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6640,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6640":{"gid":6640,"name":"b","rank":0,"incarnation":76,"state":"up:active","state_seq":11,"addr":"172.21.15.122:6836/1345816612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1345816612},{"type":"v1","addr":"172.21.15.122:6836","nonce":1345816612}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:34.260 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 80 2023-11-04T01:45:34.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.258+0000 7ff842997640 1 -- 172.21.15.77:0/3046808682 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff82806ae70 msgr2=0x7ff82806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:34.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.258+0000 7ff842997640 1 --2- 172.21.15.77:0/3046808682 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff82806ae70 0x7ff82806d330 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff830009b40 tx=0x7ff830009190 comp rx=0 tx=0).stop 2023-11-04T01:45:34.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.258+0000 7ff842997640 1 -- 172.21.15.77:0/3046808682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff83c0ce240 msgr2=0x7ff83c153170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:34.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.258+0000 7ff842997640 1 --2- 172.21.15.77:0/3046808682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff83c0ce240 0x7ff83c153170 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7ff82c000c00 tx=0x7ff82c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.258+0000 7ff842997640 1 -- 172.21.15.77:0/3046808682 shutdown_connections 2023-11-04T01:45:34.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.258+0000 7ff842997640 1 --2- 172.21.15.77:0/3046808682 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff82806ae70 0x7ff82806d330 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.258+0000 7ff842997640 1 --2- 172.21.15.77:0/3046808682 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff83c15daa0 0x7ff83c151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.258+0000 7ff842997640 1 --2- 172.21.15.77:0/3046808682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff83c0ce240 0x7ff83c153170 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.258+0000 7ff842997640 1 --2- 172.21.15.77:0/3046808682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff83c0cde60 0x7ff83c0c5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.258+0000 7ff842997640 1 -- 172.21.15.77:0/3046808682 >> 172.21.15.77:0/3046808682 conn(0x7ff83c071f30 msgr2=0x7ff83c0b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:34.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.258+0000 7ff842997640 1 -- 172.21.15.77:0/3046808682 shutdown_connections 2023-11-04T01:45:34.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.258+0000 7ff842997640 1 -- 172.21.15.77:0/3046808682 wait complete. 2023-11-04T01:45:34.270 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dump snaps --server 2023-11-04T01:45:34.400 INFO:teuthology.orchestra.run.smithi122.stdout:{"last_snap":5,"last_created":5,"last_destroyed":1,"pending_noop":[],"snaps":[{"snapid":2,"ino":1099511627777,"stamp":"2023-11-04T01:43:48.909834+0000","name":"s11","metadata":{}},{"snapid":3,"ino":1099511627777,"stamp":"2023-11-04T01:44:19.755300+0000","name":"s12","metadata":{}},{"snapid":4,"ino":1099511627777,"stamp":"2023-11-04T01:44:45.010974+0000","name":"s15","metadata":{}},{"snapid":5,"ino":1099511627777,"stamp":"2023-11-04T01:45:10.168642+0000","name":"s16","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:45:34.400 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 1, "last_snap": 5, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s11", "snapid": 2, "stamp": "2023-11-04T01:43:48.909834+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s12", "snapid": 3, "stamp": "2023-11-04T01:44:19.755300+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s15", "snapid": 4, "stamp": "2023-11-04T01:44:45.010974+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s16", "snapid": 5, "stamp": "2023-11-04T01:45:10.168642+0000" } ] } 2023-11-04T01:45:34.401 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-04T01:45:34.402 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-04T01:45:34.405 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-04T01:45:34.453 INFO:teuthology.orchestra.run.smithi077.stdout:[global] 2023-11-04T01:45:34.453 INFO:teuthology.orchestra.run.smithi077.stdout: chdir = "" 2023-11-04T01:45:34.454 INFO:teuthology.orchestra.run.smithi077.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-04T01:45:34.454 INFO:teuthology.orchestra.run.smithi077.stdout: auth supported = cephx 2023-11-04T01:45:34.454 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:34.455 INFO:teuthology.orchestra.run.smithi077.stdout: filestore xattr use omap = true 2023-11-04T01:45:34.455 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:34.455 INFO:teuthology.orchestra.run.smithi077.stdout: mon clock drift allowed = 1.000 2023-11-04T01:45:34.455 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:34.455 INFO:teuthology.orchestra.run.smithi077.stdout: osd crush chooseleaf type = 0 2023-11-04T01:45:34.456 INFO:teuthology.orchestra.run.smithi077.stdout: auth debug = true 2023-11-04T01:45:34.456 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:34.456 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on old message = true 2023-11-04T01:45:34.456 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on bug = true 2023-11-04T01:45:34.456 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:34.457 INFO:teuthology.orchestra.run.smithi077.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-04T01:45:34.457 INFO:teuthology.orchestra.run.smithi077.stdout: mon pg warn max object skew = 0 2023-11-04T01:45:34.457 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:34.457 INFO:teuthology.orchestra.run.smithi077.stdout: # disable pg_autoscaler by default for new pools 2023-11-04T01:45:34.458 INFO:teuthology.orchestra.run.smithi077.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-04T01:45:34.458 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:34.458 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default size = 2 2023-11-04T01:45:34.458 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:34.459 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow primary affinity = true 2023-11-04T01:45:34.459 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow pg remap = true 2023-11-04T01:45:34.459 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on legacy crush tunables = false 2023-11-04T01:45:34.459 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on crush straw calc version zero = false 2023-11-04T01:45:34.459 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on no sortbitwise = false 2023-11-04T01:45:34.460 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on osd down out interval zero = false 2023-11-04T01:45:34.460 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on too few osds = false 2023-11-04T01:45:34.460 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-04T01:45:34.460 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-04T01:45:34.460 INFO:teuthology.orchestra.run.smithi077.stdout: mon_allow_pool_size_one = true 2023-11-04T01:45:34.461 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:34.461 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-04T01:45:34.461 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:34.461 INFO:teuthology.orchestra.run.smithi077.stdout: osd default data pool replay window = 5 2023-11-04T01:45:34.461 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:34.462 INFO:teuthology.orchestra.run.smithi077.stdout: mon allow pool delete = true 2023-11-04T01:45:34.462 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:34.462 INFO:teuthology.orchestra.run.smithi077.stdout: mon cluster log file level = debug 2023-11-04T01:45:34.462 INFO:teuthology.orchestra.run.smithi077.stdout: debug asserts on shutdown = true 2023-11-04T01:45:34.463 INFO:teuthology.orchestra.run.smithi077.stdout: mon health detail to clog = false 2023-11-04T01:45:34.463 INFO:teuthology.orchestra.run.smithi077.stdout: mon host = "172.21.15.77,172.21.15.122,[v2:172.21.15.122:3301,v1:172.21.15.122:6790]" 2023-11-04T01:45:34.463 INFO:teuthology.orchestra.run.smithi077.stdout: fsid = 0c22c75d-0169-41ef-b663-6ac1c5b0f71f 2023-11-04T01:45:34.463 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:34.463 INFO:teuthology.orchestra.run.smithi077.stdout:[osd] 2023-11-04T01:45:34.464 INFO:teuthology.orchestra.run.smithi077.stdout: osd journal size = 100 2023-11-04T01:45:34.464 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:34.464 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub load threshold = 5.0 2023-11-04T01:45:34.464 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub max interval = 600 2023-11-04T01:45:34.464 INFO:teuthology.orchestra.run.smithi077.stdout: osd mclock profile = high_recovery_ops 2023-11-04T01:45:34.465 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:34.465 INFO:teuthology.orchestra.run.smithi077.stdout: osd recover clone overlap = true 2023-11-04T01:45:34.465 INFO:teuthology.orchestra.run.smithi077.stdout: osd recovery max chunk = 1048576 2023-11-04T01:45:34.465 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:34.466 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug shutdown = true 2023-11-04T01:45:34.466 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug op order = true 2023-11-04T01:45:34.466 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug verify stray on activate = true 2023-11-04T01:45:34.466 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug trim objects = true 2023-11-04T01:45:34.466 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:34.467 INFO:teuthology.orchestra.run.smithi077.stdout: osd open classes on start = true 2023-11-04T01:45:34.467 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug pg log writeout = true 2023-11-04T01:45:34.467 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:34.467 INFO:teuthology.orchestra.run.smithi077.stdout: osd deep scrub update digest min age = 30 2023-11-04T01:45:34.468 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:34.468 INFO:teuthology.orchestra.run.smithi077.stdout: osd map max advance = 10 2023-11-04T01:45:34.468 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:34.468 INFO:teuthology.orchestra.run.smithi077.stdout: journal zero on create = true 2023-11-04T01:45:34.468 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:34.469 INFO:teuthology.orchestra.run.smithi077.stdout: filestore ondisk finisher threads = 3 2023-11-04T01:45:34.469 INFO:teuthology.orchestra.run.smithi077.stdout: filestore apply finisher threads = 3 2023-11-04T01:45:34.469 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:34.469 INFO:teuthology.orchestra.run.smithi077.stdout: bdev debug aio = true 2023-11-04T01:45:34.470 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug misdirected ops = true 2023-11-04T01:45:34.470 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore block size = 96636764160 2023-11-04T01:45:34.470 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore fsck on mount = True 2023-11-04T01:45:34.470 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluefs = 20 2023-11-04T01:45:34.470 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluestore = 20 2023-11-04T01:45:34.471 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2023-11-04T01:45:34.471 INFO:teuthology.orchestra.run.smithi077.stdout: debug osd = 20 2023-11-04T01:45:34.471 INFO:teuthology.orchestra.run.smithi077.stdout: debug rocksdb = 10 2023-11-04T01:45:34.471 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd backfillfull_ratio = 0.85 2023-11-04T01:45:34.471 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd full ratio = 0.9 2023-11-04T01:45:34.472 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd nearfull ratio = 0.8 2023-11-04T01:45:34.472 INFO:teuthology.orchestra.run.smithi077.stdout: osd failsafe full ratio = 0.95 2023-11-04T01:45:34.472 INFO:teuthology.orchestra.run.smithi077.stdout: osd objectstore = bluestore 2023-11-04T01:45:34.472 INFO:teuthology.orchestra.run.smithi077.stdout: osd op complaint time = 180 2023-11-04T01:45:34.473 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:34.473 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr] 2023-11-04T01:45:34.473 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2023-11-04T01:45:34.473 INFO:teuthology.orchestra.run.smithi077.stdout: debug mgr = 20 2023-11-04T01:45:34.473 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2023-11-04T01:45:34.474 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2023-11-04T01:45:34.474 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:45:34.474 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:45:34.474 INFO:teuthology.orchestra.run.smithi077.stdout: mgr/telemetry/nag = false 2023-11-04T01:45:34.475 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:34.475 INFO:teuthology.orchestra.run.smithi077.stdout:[mon] 2023-11-04T01:45:34.475 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2023-11-04T01:45:34.475 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2023-11-04T01:45:34.475 INFO:teuthology.orchestra.run.smithi077.stdout: debug paxos = 20 2023-11-04T01:45:34.476 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2023-11-04T01:45:34.476 INFO:teuthology.orchestra.run.smithi077.stdout: mon data avail warn = 5 2023-11-04T01:45:34.476 INFO:teuthology.orchestra.run.smithi077.stdout: mon mgr mkfs grace = 240 2023-11-04T01:45:34.476 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:45:34.477 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd reporter subtree level = osd 2023-11-04T01:45:34.477 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd prime pg temp = true 2023-11-04T01:45:34.477 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:45:34.477 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:34.477 INFO:teuthology.orchestra.run.smithi077.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-04T01:45:34.478 INFO:teuthology.orchestra.run.smithi077.stdout: auth mon ticket ttl = 660 # 11m 2023-11-04T01:45:34.478 INFO:teuthology.orchestra.run.smithi077.stdout: auth service ticket ttl = 240 # 4m 2023-11-04T01:45:34.478 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:34.478 INFO:teuthology.orchestra.run.smithi077.stdout: # don't complain about insecure global_id in the test suite 2023-11-04T01:45:34.478 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-04T01:45:34.479 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-04T01:45:34.479 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:34.479 INFO:teuthology.orchestra.run.smithi077.stdout: # 1m isn't quite enough 2023-11-04T01:45:34.479 INFO:teuthology.orchestra.run.smithi077.stdout: mon_down_mkfs_grace = 2m 2023-11-04T01:45:34.480 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:34.480 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_filestore_osds = false 2023-11-04T01:45:34.480 INFO:teuthology.orchestra.run.smithi077.stdout: mon op complaint time = 120 2023-11-04T01:45:34.480 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:34.480 INFO:teuthology.orchestra.run.smithi077.stdout:[client] 2023-11-04T01:45:34.481 INFO:teuthology.orchestra.run.smithi077.stdout: rgw cache enabled = true 2023-11-04T01:45:34.481 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable ops log = true 2023-11-04T01:45:34.481 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable usage log = true 2023-11-04T01:45:34.481 INFO:teuthology.orchestra.run.smithi077.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-04T01:45:34.482 INFO:teuthology.orchestra.run.smithi077.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-04T01:45:34.482 INFO:teuthology.orchestra.run.smithi077.stdout: client mount timeout = 600 2023-11-04T01:45:34.482 INFO:teuthology.orchestra.run.smithi077.stdout: debug client = 20 2023-11-04T01:45:34.482 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2023-11-04T01:45:34.482 INFO:teuthology.orchestra.run.smithi077.stdout: pid file = "" 2023-11-04T01:45:34.483 INFO:teuthology.orchestra.run.smithi077.stdout: rados mon op timeout = 900 2023-11-04T01:45:34.483 INFO:teuthology.orchestra.run.smithi077.stdout: rados osd op timeout = 900 2023-11-04T01:45:34.483 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.a] 2023-11-04T01:45:34.483 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.b] 2023-11-04T01:45:34.484 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.c] 2023-11-04T01:45:34.484 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.a] 2023-11-04T01:45:34.484 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.c] 2023-11-04T01:45:34.484 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.b] 2023-11-04T01:45:34.485 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.d] 2023-11-04T01:45:34.485 INFO:teuthology.orchestra.run.smithi077.stdout:[mds] 2023-11-04T01:45:34.485 INFO:teuthology.orchestra.run.smithi077.stdout: debug mds = 20 2023-11-04T01:45:34.485 INFO:teuthology.orchestra.run.smithi077.stdout: debug mds balancer = 20 2023-11-04T01:45:34.485 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2023-11-04T01:45:34.486 INFO:teuthology.orchestra.run.smithi077.stdout: mds debug frag = True 2023-11-04T01:45:34.486 INFO:teuthology.orchestra.run.smithi077.stdout: mds debug scatterstat = True 2023-11-04T01:45:34.486 INFO:teuthology.orchestra.run.smithi077.stdout: mds op complaint time = 180 2023-11-04T01:45:34.486 INFO:teuthology.orchestra.run.smithi077.stdout: mds verify scatter = True 2023-11-04T01:45:34.487 INFO:teuthology.orchestra.run.smithi077.stdout: osd op complaint time = 180 2023-11-04T01:45:34.487 INFO:teuthology.orchestra.run.smithi077.stdout: rados mon op timeout = 900 2023-11-04T01:45:34.487 INFO:teuthology.orchestra.run.smithi077.stdout: rados osd op timeout = 900 2023-11-04T01:45:34.487 INFO:teuthology.orchestra.run.smithi077.stdout: mds_reconnect_timeout = 5 2023-11-04T01:45:34.489 INFO:teuthology.orchestra.run.smithi122.stdout:[global] 2023-11-04T01:45:34.490 INFO:teuthology.orchestra.run.smithi122.stdout: chdir = "" 2023-11-04T01:45:34.490 INFO:teuthology.orchestra.run.smithi122.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-04T01:45:34.490 INFO:teuthology.orchestra.run.smithi122.stdout: auth supported = cephx 2023-11-04T01:45:34.491 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:45:34.491 INFO:teuthology.orchestra.run.smithi122.stdout: filestore xattr use omap = true 2023-11-04T01:45:34.491 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:45:34.491 INFO:teuthology.orchestra.run.smithi122.stdout: mon clock drift allowed = 1.000 2023-11-04T01:45:34.492 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:45:34.492 INFO:teuthology.orchestra.run.smithi122.stdout: osd crush chooseleaf type = 0 2023-11-04T01:45:34.492 INFO:teuthology.orchestra.run.smithi122.stdout: auth debug = true 2023-11-04T01:45:34.492 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:45:34.492 INFO:teuthology.orchestra.run.smithi122.stdout: ms die on old message = true 2023-11-04T01:45:34.493 INFO:teuthology.orchestra.run.smithi122.stdout: ms die on bug = true 2023-11-04T01:45:34.493 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:45:34.493 INFO:teuthology.orchestra.run.smithi122.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-04T01:45:34.493 INFO:teuthology.orchestra.run.smithi122.stdout: mon pg warn max object skew = 0 2023-11-04T01:45:34.493 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:45:34.494 INFO:teuthology.orchestra.run.smithi122.stdout: # disable pg_autoscaler by default for new pools 2023-11-04T01:45:34.494 INFO:teuthology.orchestra.run.smithi122.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-04T01:45:34.494 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:45:34.494 INFO:teuthology.orchestra.run.smithi122.stdout: osd pool default size = 2 2023-11-04T01:45:34.495 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:45:34.495 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd allow primary affinity = true 2023-11-04T01:45:34.495 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd allow pg remap = true 2023-11-04T01:45:34.495 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on legacy crush tunables = false 2023-11-04T01:45:34.495 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on crush straw calc version zero = false 2023-11-04T01:45:34.496 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on no sortbitwise = false 2023-11-04T01:45:34.496 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on osd down out interval zero = false 2023-11-04T01:45:34.496 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on too few osds = false 2023-11-04T01:45:34.496 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-04T01:45:34.497 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-04T01:45:34.497 INFO:teuthology.orchestra.run.smithi122.stdout: mon_allow_pool_size_one = true 2023-11-04T01:45:34.497 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:45:34.497 INFO:teuthology.orchestra.run.smithi122.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-04T01:45:34.497 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:45:34.498 INFO:teuthology.orchestra.run.smithi122.stdout: osd default data pool replay window = 5 2023-11-04T01:45:34.498 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:45:34.498 INFO:teuthology.orchestra.run.smithi122.stdout: mon allow pool delete = true 2023-11-04T01:45:34.498 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:45:34.499 INFO:teuthology.orchestra.run.smithi122.stdout: mon cluster log file level = debug 2023-11-04T01:45:34.499 INFO:teuthology.orchestra.run.smithi122.stdout: debug asserts on shutdown = true 2023-11-04T01:45:34.499 INFO:teuthology.orchestra.run.smithi122.stdout: mon health detail to clog = false 2023-11-04T01:45:34.499 INFO:teuthology.orchestra.run.smithi122.stdout: mon host = "172.21.15.77,172.21.15.122,[v2:172.21.15.122:3301,v1:172.21.15.122:6790]" 2023-11-04T01:45:34.499 INFO:teuthology.orchestra.run.smithi122.stdout: fsid = 0c22c75d-0169-41ef-b663-6ac1c5b0f71f 2023-11-04T01:45:34.500 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:45:34.500 INFO:teuthology.orchestra.run.smithi122.stdout:[osd] 2023-11-04T01:45:34.500 INFO:teuthology.orchestra.run.smithi122.stdout: osd journal size = 100 2023-11-04T01:45:34.500 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:45:34.501 INFO:teuthology.orchestra.run.smithi122.stdout: osd scrub load threshold = 5.0 2023-11-04T01:45:34.501 INFO:teuthology.orchestra.run.smithi122.stdout: osd scrub max interval = 600 2023-11-04T01:45:34.501 INFO:teuthology.orchestra.run.smithi122.stdout: osd mclock profile = high_recovery_ops 2023-11-04T01:45:34.501 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:45:34.501 INFO:teuthology.orchestra.run.smithi122.stdout: osd recover clone overlap = true 2023-11-04T01:45:34.502 INFO:teuthology.orchestra.run.smithi122.stdout: osd recovery max chunk = 1048576 2023-11-04T01:45:34.502 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:45:34.502 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug shutdown = true 2023-11-04T01:45:34.502 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug op order = true 2023-11-04T01:45:34.502 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug verify stray on activate = true 2023-11-04T01:45:34.505 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug trim objects = true 2023-11-04T01:45:34.505 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:45:34.506 INFO:teuthology.orchestra.run.smithi122.stdout: osd open classes on start = true 2023-11-04T01:45:34.506 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug pg log writeout = true 2023-11-04T01:45:34.506 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:45:34.506 INFO:teuthology.orchestra.run.smithi122.stdout: osd deep scrub update digest min age = 30 2023-11-04T01:45:34.506 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:45:34.506 INFO:teuthology.orchestra.run.smithi122.stdout: osd map max advance = 10 2023-11-04T01:45:34.507 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:45:34.507 INFO:teuthology.orchestra.run.smithi122.stdout: journal zero on create = true 2023-11-04T01:45:34.507 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:45:34.507 INFO:teuthology.orchestra.run.smithi122.stdout: filestore ondisk finisher threads = 3 2023-11-04T01:45:34.507 INFO:teuthology.orchestra.run.smithi122.stdout: filestore apply finisher threads = 3 2023-11-04T01:45:34.508 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:45:34.508 INFO:teuthology.orchestra.run.smithi122.stdout: bdev debug aio = true 2023-11-04T01:45:34.508 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug misdirected ops = true 2023-11-04T01:45:34.508 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore block size = 96636764160 2023-11-04T01:45:34.508 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore fsck on mount = True 2023-11-04T01:45:34.509 INFO:teuthology.orchestra.run.smithi122.stdout: debug bluefs = 20 2023-11-04T01:45:34.509 INFO:teuthology.orchestra.run.smithi122.stdout: debug bluestore = 20 2023-11-04T01:45:34.509 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2023-11-04T01:45:34.509 INFO:teuthology.orchestra.run.smithi122.stdout: debug osd = 20 2023-11-04T01:45:34.509 INFO:teuthology.orchestra.run.smithi122.stdout: debug rocksdb = 10 2023-11-04T01:45:34.509 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd backfillfull_ratio = 0.85 2023-11-04T01:45:34.510 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd full ratio = 0.9 2023-11-04T01:45:34.510 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd nearfull ratio = 0.8 2023-11-04T01:45:34.510 INFO:teuthology.orchestra.run.smithi122.stdout: osd failsafe full ratio = 0.95 2023-11-04T01:45:34.510 INFO:teuthology.orchestra.run.smithi122.stdout: osd objectstore = bluestore 2023-11-04T01:45:34.510 INFO:teuthology.orchestra.run.smithi122.stdout: osd op complaint time = 180 2023-11-04T01:45:34.511 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:45:34.511 INFO:teuthology.orchestra.run.smithi122.stdout:[mgr] 2023-11-04T01:45:34.511 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2023-11-04T01:45:34.511 INFO:teuthology.orchestra.run.smithi122.stdout: debug mgr = 20 2023-11-04T01:45:34.511 INFO:teuthology.orchestra.run.smithi122.stdout: debug mon = 20 2023-11-04T01:45:34.511 INFO:teuthology.orchestra.run.smithi122.stdout: debug auth = 20 2023-11-04T01:45:34.512 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:45:34.512 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:45:34.512 INFO:teuthology.orchestra.run.smithi122.stdout: mgr/telemetry/nag = false 2023-11-04T01:45:34.512 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:45:34.512 INFO:teuthology.orchestra.run.smithi122.stdout:[mon] 2023-11-04T01:45:34.512 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2023-11-04T01:45:34.513 INFO:teuthology.orchestra.run.smithi122.stdout: debug mon = 20 2023-11-04T01:45:34.513 INFO:teuthology.orchestra.run.smithi122.stdout: debug paxos = 20 2023-11-04T01:45:34.513 INFO:teuthology.orchestra.run.smithi122.stdout: debug auth = 20 2023-11-04T01:45:34.513 INFO:teuthology.orchestra.run.smithi122.stdout: mon data avail warn = 5 2023-11-04T01:45:34.513 INFO:teuthology.orchestra.run.smithi122.stdout: mon mgr mkfs grace = 240 2023-11-04T01:45:34.514 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:45:34.514 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd reporter subtree level = osd 2023-11-04T01:45:34.514 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd prime pg temp = true 2023-11-04T01:45:34.514 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:45:34.514 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:45:34.515 INFO:teuthology.orchestra.run.smithi122.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-04T01:45:34.515 INFO:teuthology.orchestra.run.smithi122.stdout: auth mon ticket ttl = 660 # 11m 2023-11-04T01:45:34.515 INFO:teuthology.orchestra.run.smithi122.stdout: auth service ticket ttl = 240 # 4m 2023-11-04T01:45:34.515 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:45:34.515 INFO:teuthology.orchestra.run.smithi122.stdout: # don't complain about insecure global_id in the test suite 2023-11-04T01:45:34.516 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-04T01:45:34.516 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-04T01:45:34.516 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:45:34.516 INFO:teuthology.orchestra.run.smithi122.stdout: # 1m isn't quite enough 2023-11-04T01:45:34.516 INFO:teuthology.orchestra.run.smithi122.stdout: mon_down_mkfs_grace = 2m 2023-11-04T01:45:34.517 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:45:34.517 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_filestore_osds = false 2023-11-04T01:45:34.517 INFO:teuthology.orchestra.run.smithi122.stdout: mon op complaint time = 120 2023-11-04T01:45:34.517 INFO:teuthology.orchestra.run.smithi122.stdout: 2023-11-04T01:45:34.517 INFO:teuthology.orchestra.run.smithi122.stdout:[client] 2023-11-04T01:45:34.518 INFO:teuthology.orchestra.run.smithi122.stdout: rgw cache enabled = true 2023-11-04T01:45:34.518 INFO:teuthology.orchestra.run.smithi122.stdout: rgw enable ops log = true 2023-11-04T01:45:34.518 INFO:teuthology.orchestra.run.smithi122.stdout: rgw enable usage log = true 2023-11-04T01:45:34.518 INFO:teuthology.orchestra.run.smithi122.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-04T01:45:34.518 INFO:teuthology.orchestra.run.smithi122.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-04T01:45:34.519 INFO:teuthology.orchestra.run.smithi122.stdout: client mount timeout = 600 2023-11-04T01:45:34.519 INFO:teuthology.orchestra.run.smithi122.stdout: debug client = 20 2023-11-04T01:45:34.519 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2023-11-04T01:45:34.519 INFO:teuthology.orchestra.run.smithi122.stdout: pid file = "" 2023-11-04T01:45:34.519 INFO:teuthology.orchestra.run.smithi122.stdout: rados mon op timeout = 900 2023-11-04T01:45:34.519 INFO:teuthology.orchestra.run.smithi122.stdout: rados osd op timeout = 900 2023-11-04T01:45:34.520 INFO:teuthology.orchestra.run.smithi122.stdout:[mon.a] 2023-11-04T01:45:34.520 INFO:teuthology.orchestra.run.smithi122.stdout:[mon.b] 2023-11-04T01:45:34.520 INFO:teuthology.orchestra.run.smithi122.stdout:[mon.c] 2023-11-04T01:45:34.520 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.a] 2023-11-04T01:45:34.520 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.c] 2023-11-04T01:45:34.521 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.b] 2023-11-04T01:45:34.521 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.d] 2023-11-04T01:45:34.521 INFO:teuthology.orchestra.run.smithi122.stdout:[mds] 2023-11-04T01:45:34.521 INFO:teuthology.orchestra.run.smithi122.stdout: debug mds = 20 2023-11-04T01:45:34.521 INFO:teuthology.orchestra.run.smithi122.stdout: debug mds balancer = 20 2023-11-04T01:45:34.522 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2023-11-04T01:45:34.522 INFO:teuthology.orchestra.run.smithi122.stdout: mds debug frag = True 2023-11-04T01:45:34.522 INFO:teuthology.orchestra.run.smithi122.stdout: mds debug scatterstat = True 2023-11-04T01:45:34.522 INFO:teuthology.orchestra.run.smithi122.stdout: mds op complaint time = 180 2023-11-04T01:45:34.522 INFO:teuthology.orchestra.run.smithi122.stdout: mds verify scatter = True 2023-11-04T01:45:34.523 INFO:teuthology.orchestra.run.smithi122.stdout: osd op complaint time = 180 2023-11-04T01:45:34.523 INFO:teuthology.orchestra.run.smithi122.stdout: rados mon op timeout = 900 2023-11-04T01:45:34.523 INFO:teuthology.orchestra.run.smithi122.stdout: rados osd op timeout = 900 2023-11-04T01:45:34.523 INFO:teuthology.orchestra.run.smithi122.stdout: mds_reconnect_timeout = 5 2023-11-04T01:45:34.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:34.524 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir d1/dir/.snap/*) 2023-11-04T01:45:34.570 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=2, also kill snapclient 2023-11-04T01:45:34.571 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:34.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.671+0000 7f38d48d4640 1 Processor -- start 2023-11-04T01:45:34.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.671+0000 7f38d48d4640 1 -- start start 2023-11-04T01:45:34.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.672+0000 7f38d48d4640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f38d00ade00 0x7f38d00b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:34.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.672+0000 7f38d48d4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d006cc90 con 0x7f38d006c5f0 2023-11-04T01:45:34.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.672+0000 7f38d48d4640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d00b0e60 con 0x7f38d006d9c0 2023-11-04T01:45:34.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.672+0000 7f38d48d4640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d006cee0 con 0x7f38d00ade00 2023-11-04T01:45:34.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.672+0000 7f38ced9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f38d006c5f0 0x7f38d00cc680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35702/0 (socket says 172.21.15.77:35702) 2023-11-04T01:45:34.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.672+0000 7f38ced9d640 1 -- 172.21.15.77:0/833624171 learned_addr learned my addr 172.21.15.77:0/833624171 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:45:34.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.672+0000 7f38ce59c640 1 --2- 172.21.15.77:0/833624171 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f38d00ade00 0x7f38d00b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:34.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.672+0000 7f38cd59a640 1 -- 172.21.15.77:0/833624171 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3808568806 0 0) 0x7f38d006cc90 con 0x7f38d006c5f0 2023-11-04T01:45:34.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.672+0000 7f38cd59a640 1 -- 172.21.15.77:0/833624171 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38b8003520 con 0x7f38d006c5f0 2023-11-04T01:45:34.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.672+0000 7f38cd59a640 1 -- 172.21.15.77:0/833624171 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 535089024 0 0) 0x7f38d00b0e60 con 0x7f38d006d9c0 2023-11-04T01:45:34.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.672+0000 7f38cd59a640 1 -- 172.21.15.77:0/833624171 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38d006cc90 con 0x7f38d006d9c0 2023-11-04T01:45:34.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.672+0000 7f38ce59c640 1 -- 172.21.15.77:0/833624171 >> v1:172.21.15.122:6789/0 conn(0x7f38d006d9c0 legacy=0x7f38d00710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:34.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.672+0000 7f38ce59c640 1 -- 172.21.15.77:0/833624171 >> v1:172.21.15.77:6789/0 conn(0x7f38d006c5f0 legacy=0x7f38d00cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:34.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.672+0000 7f38ce59c640 1 -- 172.21.15.77:0/833624171 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d006d1c0 con 0x7f38d00ade00 2023-11-04T01:45:34.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.673+0000 7f38ce59c640 1 --2- 172.21.15.77:0/833624171 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f38d00ade00 0x7f38d00b0530 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f38c00097d0 tx=0x7f38c002b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=195e48ae9472a99d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:34.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.673+0000 7f38cd59a640 1 -- 172.21.15.77:0/833624171 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c0031770 con 0x7f38d00ade00 2023-11-04T01:45:34.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.673+0000 7f38cd59a640 1 -- 172.21.15.77:0/833624171 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c00318d0 con 0x7f38d00ade00 2023-11-04T01:45:34.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.673+0000 7f38cd59a640 1 -- 172.21.15.77:0/833624171 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c0031c60 con 0x7f38d00ade00 2023-11-04T01:45:34.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.674+0000 7f38d48d4640 1 -- 172.21.15.77:0/833624171 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f38d00ade00 msgr2=0x7f38d00b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:34.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.674+0000 7f38d48d4640 1 --2- 172.21.15.77:0/833624171 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f38d00ade00 0x7f38d00b0530 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f38c00097d0 tx=0x7f38c002b810 comp rx=0 tx=0).stop 2023-11-04T01:45:34.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.674+0000 7f38d48d4640 1 -- 172.21.15.77:0/833624171 shutdown_connections 2023-11-04T01:45:34.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.674+0000 7f38d48d4640 1 --2- 172.21.15.77:0/833624171 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f38d00ade00 0x7f38d00b0530 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.674+0000 7f38d48d4640 1 -- 172.21.15.77:0/833624171 >> 172.21.15.77:0/833624171 conn(0x7f38d00cb530 msgr2=0x7f38d00cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:34.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.674+0000 7f38d48d4640 1 -- 172.21.15.77:0/833624171 shutdown_connections 2023-11-04T01:45:34.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.674+0000 7f38d48d4640 1 -- 172.21.15.77:0/833624171 wait complete. 2023-11-04T01:45:34.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.675+0000 7f38d48d4640 1 Processor -- start 2023-11-04T01:45:34.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.675+0000 7f38d48d4640 1 -- start start 2023-11-04T01:45:34.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.676+0000 7f38d48d4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38d006c5f0 0x7f38d01537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:34.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.676+0000 7f38d48d4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38d006d9c0 0x7f38d01552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:34.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.676+0000 7f38d48d4640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f38d00ade00 0x7f38d00c4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:34.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.676+0000 7f38d48d4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d0155a80 con 0x7f38d006c5f0 2023-11-04T01:45:34.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.676+0000 7f38d48d4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d01557e0 con 0x7f38d006d9c0 2023-11-04T01:45:34.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.676+0000 7f38d48d4640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d00c4fa0 con 0x7f38d00ade00 2023-11-04T01:45:34.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.676+0000 7f38ce59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38d006c5f0 0x7f38d01537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:34.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.676+0000 7f38ce59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38d006c5f0 0x7f38d01537b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49888/0 (socket says 172.21.15.77:49888) 2023-11-04T01:45:34.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.676+0000 7f38ce59c640 1 -- 172.21.15.77:0/1588167169 learned_addr learned my addr 172.21.15.77:0/1588167169 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:34.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.676+0000 7f38cdd9b640 1 --2- 172.21.15.77:0/1588167169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38d006d9c0 0x7f38d01552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:34.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.676+0000 7f38ced9d640 1 --2- 172.21.15.77:0/1588167169 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f38d00ade00 0x7f38d00c4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:34.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.676+0000 7f38ce59c640 1 -- 172.21.15.77:0/1588167169 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f38d00ade00 msgr2=0x7f38d00c4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:34.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.676+0000 7f38ce59c640 1 --2- 172.21.15.77:0/1588167169 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f38d00ade00 0x7f38d00c4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.676+0000 7f38ce59c640 1 -- 172.21.15.77:0/1588167169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38d006d9c0 msgr2=0x7f38d01552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:34.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.676+0000 7f38ce59c640 1 --2- 172.21.15.77:0/1588167169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38d006d9c0 0x7f38d01552a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.676+0000 7f38ce59c640 1 -- 172.21.15.77:0/1588167169 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c0009400 con 0x7f38d006c5f0 2023-11-04T01:45:34.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.676+0000 7f38ced9d640 1 --2- 172.21.15.77:0/1588167169 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f38d00ade00 0x7f38d00c4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:34.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.676+0000 7f38cdd9b640 1 --2- 172.21.15.77:0/1588167169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38d006d9c0 0x7f38d01552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:34.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.676+0000 7f38ce59c640 1 --2- 172.21.15.77:0/1588167169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38d006c5f0 0x7f38d01537b0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f38c0034040 tx=0x7f38c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:34.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.676+0000 7f38beffd640 1 -- 172.21.15.77:0/1588167169 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c0032610 con 0x7f38d006c5f0 2023-11-04T01:45:34.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.677+0000 7f38beffd640 1 -- 172.21.15.77:0/1588167169 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c0032770 con 0x7f38d006c5f0 2023-11-04T01:45:34.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.677+0000 7f38d48d4640 1 -- 172.21.15.77:0/1588167169 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d01529f0 con 0x7f38d006c5f0 2023-11-04T01:45:34.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.677+0000 7f38beffd640 1 -- 172.21.15.77:0/1588167169 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c0032b20 con 0x7f38d006c5f0 2023-11-04T01:45:34.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.677+0000 7f38d48d4640 1 -- 172.21.15.77:0/1588167169 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d0152fb0 con 0x7f38d006c5f0 2023-11-04T01:45:34.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.677+0000 7f38d48d4640 1 -- 172.21.15.77:0/1588167169 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d00684b0 con 0x7f38d006c5f0 2023-11-04T01:45:34.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.678+0000 7f38beffd640 1 -- 172.21.15.77:0/1588167169 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f38c0032c80 con 0x7f38d006c5f0 2023-11-04T01:45:34.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.678+0000 7f38beffd640 1 --2- 172.21.15.77:0/1588167169 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f38b006ae70 0x7f38b006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:34.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.678+0000 7f38beffd640 1 -- 172.21.15.77:0/1588167169 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7f38c00ac010 con 0x7f38d006c5f0 2023-11-04T01:45:34.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.678+0000 7f38cdd9b640 1 --2- 172.21.15.77:0/1588167169 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f38b006ae70 0x7f38b006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:34.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.679+0000 7f38cdd9b640 1 --2- 172.21.15.77:0/1588167169 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f38b006ae70 0x7f38b006d330 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f38d015a6f0 tx=0x7f38c4009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:34.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.682+0000 7f38beffd640 1 -- 172.21.15.77:0/1588167169 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f38c0076a40 con 0x7f38d006c5f0 2023-11-04T01:45:34.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.884+0000 7f38d48d4640 1 -- 172.21.15.77:0/1588167169 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f38d00c1bc0 con 0x7f38d006c5f0 2023-11-04T01:45:34.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.885+0000 7f38beffd640 1 -- 172.21.15.77:0/1588167169 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f38c007a060 con 0x7f38d006c5f0 2023-11-04T01:45:34.887 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:34.887 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":80,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7977,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/3276812155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3276812155},{"type":"v1","addr":"172.21.15.77:6834","nonce":3276812155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:45:30.197166+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6640,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6640":{"gid":6640,"name":"b","rank":0,"incarnation":76,"state":"up:active","state_seq":11,"addr":"172.21.15.122:6836/1345816612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1345816612},{"type":"v1","addr":"172.21.15.122:6836","nonce":1345816612}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:34.887 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 80 2023-11-04T01:45:34.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.887+0000 7f38d48d4640 1 -- 172.21.15.77:0/1588167169 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f38b006ae70 msgr2=0x7f38b006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:34.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.887+0000 7f38d48d4640 1 --2- 172.21.15.77:0/1588167169 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f38b006ae70 0x7f38b006d330 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f38d015a6f0 tx=0x7f38c4009040 comp rx=0 tx=0).stop 2023-11-04T01:45:34.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.887+0000 7f38d48d4640 1 -- 172.21.15.77:0/1588167169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38d006c5f0 msgr2=0x7f38d01537b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:34.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.887+0000 7f38d48d4640 1 --2- 172.21.15.77:0/1588167169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38d006c5f0 0x7f38d01537b0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f38c0034040 tx=0x7f38c00046c0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.887+0000 7f38d48d4640 1 -- 172.21.15.77:0/1588167169 shutdown_connections 2023-11-04T01:45:34.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.887+0000 7f38d48d4640 1 --2- 172.21.15.77:0/1588167169 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f38b006ae70 0x7f38b006d330 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.887+0000 7f38d48d4640 1 --2- 172.21.15.77:0/1588167169 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f38d00ade00 0x7f38d00c4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.887+0000 7f38d48d4640 1 --2- 172.21.15.77:0/1588167169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38d006d9c0 0x7f38d01552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.887+0000 7f38d48d4640 1 --2- 172.21.15.77:0/1588167169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38d006c5f0 0x7f38d01537b0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.887+0000 7f38d48d4640 1 -- 172.21.15.77:0/1588167169 >> 172.21.15.77:0/1588167169 conn(0x7f38d00cb530 msgr2=0x7f38d00710d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:34.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.887+0000 7f38d48d4640 1 -- 172.21.15.77:0/1588167169 shutdown_connections 2023-11-04T01:45:34.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:34.887+0000 7f38d48d4640 1 -- 172.21.15.77:0/1588167169 wait complete. 2023-11-04T01:45:34.899 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dump snaps --server 2023-11-04T01:45:35.014 INFO:teuthology.orchestra.run.smithi122.stdout:{"last_snap":9,"last_created":5,"last_destroyed":8,"pending_noop":[],"snaps":[{"snapid":5,"ino":1099511627777,"stamp":"2023-11-04T01:45:10.168642+0000","name":"s16","metadata":{}}],"need_to_purge":{"17":[2,3,4,6,7,8]},"pending_update":[],"pending_destroy":[{"version":16,"removed_snap":5,"seq":9}]} 2023-11-04T01:45:35.014 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 8, "last_snap": 9, "need_to_purge": { "17": [ 2, 3, 4, 6, 7, 8 ] }, "pending_destroy": [ { "removed_snap": 5, "seq": 9, "version": 16 } ], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s16", "snapid": 5, "stamp": "2023-11-04T01:45:10.168642+0000" } ] } 2023-11-04T01:45:35.015 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:45:35.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.115+0000 7f02a9d61640 1 Processor -- start 2023-11-04T01:45:35.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.115+0000 7f02a9d61640 1 -- start start 2023-11-04T01:45:35.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.116+0000 7f02a9d61640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f02a40addd0 0x7f02a40cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.116+0000 7f02a9d61640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02a40cd720 con 0x7f02a406c220 2023-11-04T01:45:35.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.116+0000 7f02a9d61640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02a40ae1b0 con 0x7f02a40cc680 2023-11-04T01:45:35.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.116+0000 7f02a9d61640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a40ccb10 con 0x7f02a40addd0 2023-11-04T01:45:35.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.116+0000 7f02a3fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f02a406c220 0x7f02a406f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35714/0 (socket says 172.21.15.77:35714) 2023-11-04T01:45:35.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.116+0000 7f02a3fff640 1 -- 172.21.15.77:0/950609784 learned_addr learned my addr 172.21.15.77:0/950609784 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:45:35.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.116+0000 7f02a37fe640 1 --2- 172.21.15.77:0/950609784 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f02a40addd0 0x7f02a40cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.116+0000 7f02a27fc640 1 -- 172.21.15.77:0/950609784 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 734157015 0 0) 0x7f02a40cd720 con 0x7f02a406c220 2023-11-04T01:45:35.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.116+0000 7f02a27fc640 1 -- 172.21.15.77:0/950609784 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f028c004630 con 0x7f02a406c220 2023-11-04T01:45:35.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.116+0000 7f02a27fc640 1 -- 172.21.15.77:0/950609784 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3556725533 0 0) 0x7f02a40ae1b0 con 0x7f02a40cc680 2023-11-04T01:45:35.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.116+0000 7f02a27fc640 1 -- 172.21.15.77:0/950609784 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02a40cd720 con 0x7f02a40cc680 2023-11-04T01:45:35.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.116+0000 7f02a37fe640 1 -- 172.21.15.77:0/950609784 >> v1:172.21.15.122:6789/0 conn(0x7f02a40cc680 legacy=0x7f02a406bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:35.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.116+0000 7f02a37fe640 1 -- 172.21.15.77:0/950609784 >> v1:172.21.15.77:6789/0 conn(0x7f02a406c220 legacy=0x7f02a406f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:35.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.116+0000 7f02a37fe640 1 -- 172.21.15.77:0/950609784 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a40ccdf0 con 0x7f02a40addd0 2023-11-04T01:45:35.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.117+0000 7f02a37fe640 1 --2- 172.21.15.77:0/950609784 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f02a40addd0 0x7f02a40cdbb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f02980097d0 tx=0x7f029802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e8d3016346ce200 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:35.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.117+0000 7f02a27fc640 1 -- 172.21.15.77:0/950609784 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0298031890 con 0x7f02a40addd0 2023-11-04T01:45:35.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.117+0000 7f02a27fc640 1 -- 172.21.15.77:0/950609784 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02980319f0 con 0x7f02a40addd0 2023-11-04T01:45:35.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.117+0000 7f02a27fc640 1 -- 172.21.15.77:0/950609784 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0298031d60 con 0x7f02a40addd0 2023-11-04T01:45:35.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.118+0000 7f02a9d61640 1 -- 172.21.15.77:0/950609784 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f02a40addd0 msgr2=0x7f02a40cdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:35.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.118+0000 7f02a9d61640 1 --2- 172.21.15.77:0/950609784 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f02a40addd0 0x7f02a40cdbb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f02980097d0 tx=0x7f029802b930 comp rx=0 tx=0).stop 2023-11-04T01:45:35.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.118+0000 7f02a9d61640 1 -- 172.21.15.77:0/950609784 shutdown_connections 2023-11-04T01:45:35.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.118+0000 7f02a9d61640 1 --2- 172.21.15.77:0/950609784 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f02a40addd0 0x7f02a40cdbb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.118+0000 7f02a9d61640 1 -- 172.21.15.77:0/950609784 >> 172.21.15.77:0/950609784 conn(0x7f02a40cb530 msgr2=0x7f02a40cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:35.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.118+0000 7f02a9d61640 1 -- 172.21.15.77:0/950609784 shutdown_connections 2023-11-04T01:45:35.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.118+0000 7f02a9d61640 1 -- 172.21.15.77:0/950609784 wait complete. 2023-11-04T01:45:35.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.119+0000 7f02a9d61640 1 Processor -- start 2023-11-04T01:45:35.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.119+0000 7f02a9d61640 1 -- start start 2023-11-04T01:45:35.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.120+0000 7f02a9d61640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02a406c220 0x7f02a414f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.120+0000 7f02a9d61640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02a40addd0 0x7f02a41e45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.120+0000 7f02a9d61640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f02a40c4c20 0x7f02a40c50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.120+0000 7f02a9d61640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a414f5b0 con 0x7f02a406c220 2023-11-04T01:45:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.120+0000 7f02a9d61640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a41e4140 con 0x7f02a40addd0 2023-11-04T01:45:35.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.120+0000 7f02a9d61640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a41e4b10 con 0x7f02a40c4c20 2023-11-04T01:45:35.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.120+0000 7f02a37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02a406c220 0x7f02a414f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.120+0000 7f02a37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02a406c220 0x7f02a414f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49890/0 (socket says 172.21.15.77:49890) 2023-11-04T01:45:35.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.120+0000 7f02a37fe640 1 -- 172.21.15.77:0/3756567901 learned_addr learned my addr 172.21.15.77:0/3756567901 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:35.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.120+0000 7f02a2ffd640 1 --2- 172.21.15.77:0/3756567901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02a40addd0 0x7f02a41e45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.120+0000 7f02a3fff640 1 --2- 172.21.15.77:0/3756567901 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f02a40c4c20 0x7f02a40c50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.120+0000 7f02a37fe640 1 -- 172.21.15.77:0/3756567901 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f02a40c4c20 msgr2=0x7f02a40c50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:35.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.120+0000 7f02a37fe640 1 --2- 172.21.15.77:0/3756567901 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f02a40c4c20 0x7f02a40c50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.120+0000 7f02a37fe640 1 -- 172.21.15.77:0/3756567901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02a40addd0 msgr2=0x7f02a41e45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:35.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.120+0000 7f02a37fe640 1 --2- 172.21.15.77:0/3756567901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02a40addd0 0x7f02a41e45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.120+0000 7f02a37fe640 1 -- 172.21.15.77:0/3756567901 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0298009400 con 0x7f02a406c220 2023-11-04T01:45:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.121+0000 7f02a37fe640 1 --2- 172.21.15.77:0/3756567901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02a406c220 0x7f02a414f070 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f0298000c00 tx=0x7f02980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.121+0000 7f028bfff640 1 -- 172.21.15.77:0/3756567901 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029803bbf0 con 0x7f02a406c220 2023-11-04T01:45:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.121+0000 7f028bfff640 1 -- 172.21.15.77:0/3756567901 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029803bd70 con 0x7f02a406c220 2023-11-04T01:45:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.121+0000 7f02a9d61640 1 -- 172.21.15.77:0/3756567901 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a40c7cc0 con 0x7f02a406c220 2023-11-04T01:45:35.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.121+0000 7f028bfff640 1 -- 172.21.15.77:0/3756567901 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0298045630 con 0x7f02a406c220 2023-11-04T01:45:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.121+0000 7f02a9d61640 1 -- 172.21.15.77:0/3756567901 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a41e3af0 con 0x7f02a406c220 2023-11-04T01:45:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.122+0000 7f02a9d61640 1 -- 172.21.15.77:0/3756567901 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02a40c7a70 con 0x7f02a406c220 2023-11-04T01:45:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.122+0000 7f028bfff640 1 -- 172.21.15.77:0/3756567901 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f029804e450 con 0x7f02a406c220 2023-11-04T01:45:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.122+0000 7f028bfff640 1 --2- 172.21.15.77:0/3756567901 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f029006ae70 0x7f029006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.122+0000 7f028bfff640 1 -- 172.21.15.77:0/3756567901 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7f02980ac210 con 0x7f02a406c220 2023-11-04T01:45:35.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.123+0000 7f02a2ffd640 1 --2- 172.21.15.77:0/3756567901 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f029006ae70 0x7f029006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.123+0000 7f02a2ffd640 1 --2- 172.21.15.77:0/3756567901 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f029006ae70 0x7f029006d330 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f0294007fd0 tx=0x7f0294009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:35.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.127+0000 7f028bfff640 1 -- 172.21.15.77:0/3756567901 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0298076c50 con 0x7f02a406c220 2023-11-04T01:45:35.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:35.358+0000 7f02a9d61640 1 -- 172.21.15.77:0/3756567901 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7f02a40cd0a0 con 0x7f02a406c220 2023-11-04T01:45:36.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.219+0000 7f028bfff640 1 -- 172.21.15.77:0/3756567901 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.6640 v81) v1 ==== 112+0+0 (secure 0 0 0) 0x7f029807a270 con 0x7f02a406c220 2023-11-04T01:45:36.221 INFO:teuthology.orchestra.run.smithi077.stderr:freezing mds.6640 2023-11-04T01:45:36.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.221+0000 7f02a9d61640 1 -- 172.21.15.77:0/3756567901 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f029006ae70 msgr2=0x7f029006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:36.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.221+0000 7f02a9d61640 1 --2- 172.21.15.77:0/3756567901 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f029006ae70 0x7f029006d330 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f0294007fd0 tx=0x7f0294009040 comp rx=0 tx=0).stop 2023-11-04T01:45:36.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.221+0000 7f02a9d61640 1 -- 172.21.15.77:0/3756567901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02a406c220 msgr2=0x7f02a414f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:36.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.221+0000 7f02a9d61640 1 --2- 172.21.15.77:0/3756567901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02a406c220 0x7f02a414f070 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f0298000c00 tx=0x7f02980046c0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.221+0000 7f02a9d61640 1 -- 172.21.15.77:0/3756567901 shutdown_connections 2023-11-04T01:45:36.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.221+0000 7f02a9d61640 1 --2- 172.21.15.77:0/3756567901 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f029006ae70 0x7f029006d330 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.222+0000 7f02a9d61640 1 --2- 172.21.15.77:0/3756567901 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f02a40c4c20 0x7f02a40c50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.222+0000 7f02a9d61640 1 --2- 172.21.15.77:0/3756567901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02a40addd0 0x7f02a41e45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.222+0000 7f02a9d61640 1 --2- 172.21.15.77:0/3756567901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02a406c220 0x7f02a414f070 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.222+0000 7f02a9d61640 1 -- 172.21.15.77:0/3756567901 >> 172.21.15.77:0/3756567901 conn(0x7f02a40cb530 msgr2=0x7f02a40cea10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:36.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.222+0000 7f02a9d61640 1 -- 172.21.15.77:0/3756567901 shutdown_connections 2023-11-04T01:45:36.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.222+0000 7f02a9d61640 1 -- 172.21.15.77:0/3756567901 wait complete. 2023-11-04T01:45:36.235 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:1 true 2023-11-04T01:45:36.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.335+0000 7f734fb90640 1 Processor -- start 2023-11-04T01:45:36.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.335+0000 7f734fb90640 1 -- start start 2023-11-04T01:45:36.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.336+0000 7f734fb90640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f73480b0c40 0x7f734806fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.336+0000 7f734fb90640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f734806bb60 0x7f7348070530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.336+0000 7f734fb90640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7348071500 con 0x7f7348159e40 2023-11-04T01:45:36.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.336+0000 7f734fb90640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7348070a70 con 0x7f734806bb60 2023-11-04T01:45:36.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.336+0000 7f734fb90640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f734815dae0 con 0x7f73480b0c40 2023-11-04T01:45:36.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.336+0000 7f734e12d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f734806bb60 0x7f7348070530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.336+0000 7f734e12d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f734806bb60 0x7f7348070530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49896/0 (socket says 172.21.15.77:49896) 2023-11-04T01:45:36.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.336+0000 7f734e12d640 1 -- 172.21.15.77:0/2135792946 learned_addr learned my addr 172.21.15.77:0/2135792946 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:36.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.336+0000 7f734d12b640 1 --2- 172.21.15.77:0/2135792946 >> v2:172.21.15.122:3300/0 conn(0x7f73480b0c40 0x7f734806fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.336+0000 7f734e12d640 1 -- 172.21.15.77:0/2135792946 >> v2:172.21.15.122:3300/0 conn(0x7f73480b0c40 msgr2=0x7f734806fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:36.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.336+0000 7f734e12d640 1 --2- 172.21.15.77:0/2135792946 >> v2:172.21.15.122:3300/0 conn(0x7f73480b0c40 0x7f734806fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.336+0000 7f734e12d640 1 -- 172.21.15.77:0/2135792946 >> v1:172.21.15.122:6789/0 conn(0x7f7348159e40 legacy=0x7f73480b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:36.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.336+0000 7f734e12d640 1 -- 172.21.15.77:0/2135792946 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7348070c60 con 0x7f734806bb60 2023-11-04T01:45:36.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.337+0000 7f734e12d640 1 --2- 172.21.15.77:0/2135792946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f734806bb60 0x7f7348070530 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f734806fdc0 tx=0x7f734002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104a18982001364c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:36.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.337+0000 7f734c92a640 1 -- 172.21.15.77:0/2135792946 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734002c9f0 con 0x7f734806bb60 2023-11-04T01:45:36.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.337+0000 7f734c92a640 1 -- 172.21.15.77:0/2135792946 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f734002cb50 con 0x7f734806bb60 2023-11-04T01:45:36.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.337+0000 7f734c92a640 1 -- 172.21.15.77:0/2135792946 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73400343f0 con 0x7f734806bb60 2023-11-04T01:45:36.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.338+0000 7f734fb90640 1 -- 172.21.15.77:0/2135792946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f734806bb60 msgr2=0x7f7348070530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:36.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.338+0000 7f734fb90640 1 --2- 172.21.15.77:0/2135792946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f734806bb60 0x7f7348070530 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f734806fdc0 tx=0x7f734002be50 comp rx=0 tx=0).stop 2023-11-04T01:45:36.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.338+0000 7f734fb90640 1 -- 172.21.15.77:0/2135792946 shutdown_connections 2023-11-04T01:45:36.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.338+0000 7f734fb90640 1 --2- 172.21.15.77:0/2135792946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f734806bb60 0x7f7348070530 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.338+0000 7f734fb90640 1 --2- 172.21.15.77:0/2135792946 >> v2:172.21.15.122:3300/0 conn(0x7f73480b0c40 0x7f734806fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.338+0000 7f734fb90640 1 -- 172.21.15.77:0/2135792946 >> 172.21.15.77:0/2135792946 conn(0x7f73480cb530 msgr2=0x7f73480cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:36.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.338+0000 7f734fb90640 1 -- 172.21.15.77:0/2135792946 shutdown_connections 2023-11-04T01:45:36.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.338+0000 7f734fb90640 1 -- 172.21.15.77:0/2135792946 wait complete. 2023-11-04T01:45:36.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.339+0000 7f734fb90640 1 Processor -- start 2023-11-04T01:45:36.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.339+0000 7f734fb90640 1 -- start start 2023-11-04T01:45:36.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.340+0000 7f734fb90640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f734806bb60 0x7f73480a9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.340+0000 7f734fb90640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f73480b0c40 0x7f734814efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.340+0000 7f734fb90640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7348159e40 0x7f73480acd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.340+0000 7f734fb90640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73480ac970 con 0x7f7348159e40 2023-11-04T01:45:36.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.340+0000 7f734fb90640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734814f500 con 0x7f734806bb60 2023-11-04T01:45:36.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.340+0000 7f734fb90640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73480abcf0 con 0x7f73480b0c40 2023-11-04T01:45:36.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.340+0000 7f734e12d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7348159e40 0x7f73480acd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.340+0000 7f734e12d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7348159e40 0x7f73480acd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49900/0 (socket says 172.21.15.77:49900) 2023-11-04T01:45:36.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.340+0000 7f734e12d640 1 -- 172.21.15.77:0/3897622585 learned_addr learned my addr 172.21.15.77:0/3897622585 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:36.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.340+0000 7f734d92c640 1 --2- 172.21.15.77:0/3897622585 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f734806bb60 0x7f73480a9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.340+0000 7f734d12b640 1 --2- 172.21.15.77:0/3897622585 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f73480b0c40 0x7f734814efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.340+0000 7f734e12d640 1 -- 172.21.15.77:0/3897622585 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f73480b0c40 msgr2=0x7f734814efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:36.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.340+0000 7f734e12d640 1 --2- 172.21.15.77:0/3897622585 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f73480b0c40 0x7f734814efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.340+0000 7f734e12d640 1 -- 172.21.15.77:0/3897622585 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f734806bb60 msgr2=0x7f73480a9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:36.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.340+0000 7f734e12d640 1 --2- 172.21.15.77:0/3897622585 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f734806bb60 0x7f73480a9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.340+0000 7f734e12d640 1 -- 172.21.15.77:0/3897622585 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7340009b30 con 0x7f7348159e40 2023-11-04T01:45:36.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.340+0000 7f734d12b640 1 --2- 172.21.15.77:0/3897622585 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f73480b0c40 0x7f734814efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:36.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.340+0000 7f734e12d640 1 --2- 172.21.15.77:0/3897622585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7348159e40 0x7f73480acd90 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f7340036040 tx=0x7f7340004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:36.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.340+0000 7f733e7fc640 1 -- 172.21.15.77:0/3897622585 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7340009510 con 0x7f7348159e40 2023-11-04T01:45:36.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.340+0000 7f733e7fc640 1 -- 172.21.15.77:0/3897622585 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f734003e450 con 0x7f7348159e40 2023-11-04T01:45:36.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.340+0000 7f734fb90640 1 -- 172.21.15.77:0/3897622585 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73480abfd0 con 0x7f7348159e40 2023-11-04T01:45:36.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.341+0000 7f733e7fc640 1 -- 172.21.15.77:0/3897622585 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734003e7e0 con 0x7f7348159e40 2023-11-04T01:45:36.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.341+0000 7f734fb90640 1 -- 172.21.15.77:0/3897622585 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73480ac590 con 0x7f7348159e40 2023-11-04T01:45:36.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.342+0000 7f734fb90640 1 -- 172.21.15.77:0/3897622585 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73480acab0 con 0x7f7348159e40 2023-11-04T01:45:36.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.342+0000 7f733e7fc640 1 -- 172.21.15.77:0/3897622585 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f734003e940 con 0x7f7348159e40 2023-11-04T01:45:36.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.342+0000 7f733e7fc640 1 --2- 172.21.15.77:0/3897622585 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f732c06ae70 0x7f732c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.342+0000 7f733e7fc640 1 -- 172.21.15.77:0/3897622585 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7522+0+0 (secure 0 0 0) 0x7f73400ac990 con 0x7f7348159e40 2023-11-04T01:45:36.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.342+0000 7f734d92c640 1 --2- 172.21.15.77:0/3897622585 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f732c06ae70 0x7f732c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.343+0000 7f734d92c640 1 --2- 172.21.15.77:0/3897622585 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f732c06ae70 0x7f732c06d330 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f7344006fd0 tx=0x7f7344009060 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:36.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.346+0000 7f733e7fc640 1 -- 172.21.15.77:0/3897622585 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f73480acab0 con 0x7f7348159e40 2023-11-04T01:45:36.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:36.579+0000 7f734fb90640 1 -- 172.21.15.77:0/3897622585 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"} v 0) v1 -- 0x7f73480acab0 con 0x7f7348159e40 2023-11-04T01:45:37.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.220+0000 7f733e7fc640 1 -- 172.21.15.77:0/3897622585 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"}]=0 freezing mds.7305 v82) v1 ==== 112+0+0 (secure 0 0 0) 0x7f73480acab0 con 0x7f7348159e40 2023-11-04T01:45:37.222 INFO:teuthology.orchestra.run.smithi077.stderr:freezing mds.7305 2023-11-04T01:45:37.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.222+0000 7f734fb90640 1 -- 172.21.15.77:0/3897622585 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f732c06ae70 msgr2=0x7f732c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:37.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.222+0000 7f734fb90640 1 --2- 172.21.15.77:0/3897622585 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f732c06ae70 0x7f732c06d330 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f7344006fd0 tx=0x7f7344009060 comp rx=0 tx=0).stop 2023-11-04T01:45:37.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.222+0000 7f734fb90640 1 -- 172.21.15.77:0/3897622585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7348159e40 msgr2=0x7f73480acd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:37.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.222+0000 7f734fb90640 1 --2- 172.21.15.77:0/3897622585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7348159e40 0x7f73480acd90 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f7340036040 tx=0x7f7340004a40 comp rx=0 tx=0).stop 2023-11-04T01:45:37.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.222+0000 7f734fb90640 1 -- 172.21.15.77:0/3897622585 shutdown_connections 2023-11-04T01:45:37.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.222+0000 7f734fb90640 1 --2- 172.21.15.77:0/3897622585 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f732c06ae70 0x7f732c06d330 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:37.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.222+0000 7f734fb90640 1 --2- 172.21.15.77:0/3897622585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7348159e40 0x7f73480acd90 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:37.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.222+0000 7f734fb90640 1 --2- 172.21.15.77:0/3897622585 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f73480b0c40 0x7f734814efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:37.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.222+0000 7f734fb90640 1 --2- 172.21.15.77:0/3897622585 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f734806bb60 0x7f73480a9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:37.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.222+0000 7f734fb90640 1 -- 172.21.15.77:0/3897622585 >> 172.21.15.77:0/3897622585 conn(0x7f73480cb530 msgr2=0x7f73480cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:37.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.222+0000 7f734fb90640 1 -- 172.21.15.77:0/3897622585 shutdown_connections 2023-11-04T01:45:37.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.222+0000 7f734fb90640 1 -- 172.21.15.77:0/3897622585 wait complete. 2023-11-04T01:45:37.236 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json config set mds_kill_mdstable_at 2 2023-11-04T01:45:37.362 INFO:teuthology.orchestra.run.smithi122.stdout:{"success":"mds_kill_mdstable_at = '2' (not observed, change may require restart) "} 2023-11-04T01:45:37.362 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '2' (not observed, change may require restart) " } 2023-11-04T01:45:37.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:37.365 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s22) 2023-11-04T01:45:37.369 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:45:37.386 INFO:tasks.ceph.mds.b.smithi122.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7fcd3a353640 time 2023-11-04T01:45:37.386260+0000 2023-11-04T01:45:37.387 INFO:tasks.ceph.mds.b.smithi122.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:45:37.387 INFO:tasks.ceph.mds.b.smithi122.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:45:37.388 INFO:tasks.ceph.mds.b.smithi122.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fcd45f6efaf] 2023-11-04T01:45:37.388 INFO:tasks.ceph.mds.b.smithi122.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fcd45f6f16d] 2023-11-04T01:45:37.388 INFO:tasks.ceph.mds.b.smithi122.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x5560428909ce] 2023-11-04T01:45:37.388 INFO:tasks.ceph.mds.b.smithi122.stderr: 4: (MDSContext::complete(int)+0x5c) [0x5560428c0bcc] 2023-11-04T01:45:37.389 INFO:tasks.ceph.mds.b.smithi122.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x5560428c9b0c] 2023-11-04T01:45:37.389 INFO:tasks.ceph.mds.b.smithi122.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x5560428c9c63] 2023-11-04T01:45:37.389 INFO:tasks.ceph.mds.b.smithi122.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fcd460164a5] 2023-11-04T01:45:37.389 INFO:tasks.ceph.mds.b.smithi122.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fcd4569f802] 2023-11-04T01:45:37.389 INFO:tasks.ceph.mds.b.smithi122.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fcd4563f450] 2023-11-04T01:45:37.390 INFO:tasks.ceph.mds.b.smithi122.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:45:37.390 INFO:tasks.ceph.mds.b.smithi122.stderr: in thread 7fcd3a353640 thread_name:MR_Finisher 2023-11-04T01:45:37.390 INFO:tasks.ceph.mds.b.smithi122.stderr:2023-11-04T01:45:37.385+0000 7fcd3a353640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7fcd3a353640 time 2023-11-04T01:45:37.386260+0000 2023-11-04T01:45:37.390 INFO:tasks.ceph.mds.b.smithi122.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:45:37.390 INFO:tasks.ceph.mds.b.smithi122.stderr: 2023-11-04T01:45:37.391 INFO:tasks.ceph.mds.b.smithi122.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:45:37.391 INFO:tasks.ceph.mds.b.smithi122.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fcd45f6efaf] 2023-11-04T01:45:37.391 INFO:tasks.ceph.mds.b.smithi122.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fcd45f6f16d] 2023-11-04T01:45:37.391 INFO:tasks.ceph.mds.b.smithi122.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x5560428909ce] 2023-11-04T01:45:37.392 INFO:tasks.ceph.mds.b.smithi122.stderr: 4: (MDSContext::complete(int)+0x5c) [0x5560428c0bcc] 2023-11-04T01:45:37.392 INFO:tasks.ceph.mds.b.smithi122.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x5560428c9b0c] 2023-11-04T01:45:37.392 INFO:tasks.ceph.mds.b.smithi122.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x5560428c9c63] 2023-11-04T01:45:37.392 INFO:tasks.ceph.mds.b.smithi122.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fcd460164a5] 2023-11-04T01:45:37.392 INFO:tasks.ceph.mds.b.smithi122.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fcd4569f802] 2023-11-04T01:45:37.393 INFO:tasks.ceph.mds.b.smithi122.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fcd4563f450] 2023-11-04T01:45:37.393 INFO:tasks.ceph.mds.b.smithi122.stderr: 2023-11-04T01:45:37.393 INFO:tasks.ceph.mds.b.smithi122.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:45:37.393 INFO:tasks.ceph.mds.b.smithi122.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fcd45654db0] 2023-11-04T01:45:37.394 INFO:tasks.ceph.mds.b.smithi122.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fcd456a154c] 2023-11-04T01:45:37.394 INFO:tasks.ceph.mds.b.smithi122.stderr: 3: raise() 2023-11-04T01:45:37.394 INFO:tasks.ceph.mds.b.smithi122.stderr: 4: abort() 2023-11-04T01:45:37.394 INFO:tasks.ceph.mds.b.smithi122.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fcd45f6f009] 2023-11-04T01:45:37.394 INFO:tasks.ceph.mds.b.smithi122.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fcd45f6f16d] 2023-11-04T01:45:37.395 INFO:tasks.ceph.mds.b.smithi122.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x5560428909ce] 2023-11-04T01:45:37.395 INFO:tasks.ceph.mds.b.smithi122.stderr: 8: (MDSContext::complete(int)+0x5c) [0x5560428c0bcc] 2023-11-04T01:45:37.395 INFO:tasks.ceph.mds.b.smithi122.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x5560428c9b0c] 2023-11-04T01:45:37.395 INFO:tasks.ceph.mds.b.smithi122.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x5560428c9c63] 2023-11-04T01:45:37.395 INFO:tasks.ceph.mds.b.smithi122.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fcd460164a5] 2023-11-04T01:45:37.396 INFO:tasks.ceph.mds.b.smithi122.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7fcd4569f802] 2023-11-04T01:45:37.396 INFO:tasks.ceph.mds.b.smithi122.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7fcd4563f450] 2023-11-04T01:45:37.396 INFO:tasks.ceph.mds.b.smithi122.stderr:2023-11-04T01:45:37.386+0000 7fcd3a353640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:45:37.396 INFO:tasks.ceph.mds.b.smithi122.stderr: in thread 7fcd3a353640 thread_name:MR_Finisher 2023-11-04T01:45:37.397 INFO:tasks.ceph.mds.b.smithi122.stderr: 2023-11-04T01:45:37.397 INFO:tasks.ceph.mds.b.smithi122.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:45:37.397 INFO:tasks.ceph.mds.b.smithi122.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fcd45654db0] 2023-11-04T01:45:37.397 INFO:tasks.ceph.mds.b.smithi122.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fcd456a154c] 2023-11-04T01:45:37.397 INFO:tasks.ceph.mds.b.smithi122.stderr: 3: raise() 2023-11-04T01:45:37.398 INFO:tasks.ceph.mds.b.smithi122.stderr: 4: abort() 2023-11-04T01:45:37.398 INFO:tasks.ceph.mds.b.smithi122.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fcd45f6f009] 2023-11-04T01:45:37.398 INFO:tasks.ceph.mds.b.smithi122.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fcd45f6f16d] 2023-11-04T01:45:37.398 INFO:tasks.ceph.mds.b.smithi122.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x5560428909ce] 2023-11-04T01:45:37.398 INFO:tasks.ceph.mds.b.smithi122.stderr: 8: (MDSContext::complete(int)+0x5c) [0x5560428c0bcc] 2023-11-04T01:45:37.399 INFO:tasks.ceph.mds.b.smithi122.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x5560428c9b0c] 2023-11-04T01:45:37.399 INFO:tasks.ceph.mds.b.smithi122.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x5560428c9c63] 2023-11-04T01:45:37.399 INFO:tasks.ceph.mds.b.smithi122.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fcd460164a5] 2023-11-04T01:45:37.399 INFO:tasks.ceph.mds.b.smithi122.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7fcd4569f802] 2023-11-04T01:45:37.399 INFO:tasks.ceph.mds.b.smithi122.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7fcd4563f450] 2023-11-04T01:45:37.400 INFO:tasks.ceph.mds.b.smithi122.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:45:37.400 INFO:tasks.ceph.mds.b.smithi122.stderr: 2023-11-04T01:45:37.401 INFO:tasks.ceph.mds.b.smithi122.stderr: -675> 2023-11-04T01:45:32.996+0000 7fcd3db5a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:45:37.401 INFO:tasks.ceph.mds.b.smithi122.stderr: -673> 2023-11-04T01:45:32.996+0000 7fcd3db5a640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:45:37.401 INFO:tasks.ceph.mds.b.smithi122.stderr: -1> 2023-11-04T01:45:37.385+0000 7fcd3a353640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7fcd3a353640 time 2023-11-04T01:45:37.386260+0000 2023-11-04T01:45:37.401 INFO:tasks.ceph.mds.b.smithi122.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:45:37.401 INFO:tasks.ceph.mds.b.smithi122.stderr: 2023-11-04T01:45:37.402 INFO:tasks.ceph.mds.b.smithi122.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:45:37.402 INFO:tasks.ceph.mds.b.smithi122.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fcd45f6efaf] 2023-11-04T01:45:37.402 INFO:tasks.ceph.mds.b.smithi122.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fcd45f6f16d] 2023-11-04T01:45:37.402 INFO:tasks.ceph.mds.b.smithi122.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x5560428909ce] 2023-11-04T01:45:37.402 INFO:tasks.ceph.mds.b.smithi122.stderr: 4: (MDSContext::complete(int)+0x5c) [0x5560428c0bcc] 2023-11-04T01:45:37.402 INFO:tasks.ceph.mds.b.smithi122.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x5560428c9b0c] 2023-11-04T01:45:37.403 INFO:tasks.ceph.mds.b.smithi122.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x5560428c9c63] 2023-11-04T01:45:37.403 INFO:tasks.ceph.mds.b.smithi122.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fcd460164a5] 2023-11-04T01:45:37.403 INFO:tasks.ceph.mds.b.smithi122.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fcd4569f802] 2023-11-04T01:45:37.403 INFO:tasks.ceph.mds.b.smithi122.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fcd4563f450] 2023-11-04T01:45:37.403 INFO:tasks.ceph.mds.b.smithi122.stderr: 2023-11-04T01:45:37.404 INFO:tasks.ceph.mds.b.smithi122.stderr: 0> 2023-11-04T01:45:37.386+0000 7fcd3a353640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:45:37.457 INFO:tasks.ceph.mds.b.smithi122.stderr: in thread 7fcd3a353640 thread_name:MR_Finisher 2023-11-04T01:45:37.457 INFO:tasks.ceph.mds.b.smithi122.stderr: 2023-11-04T01:45:37.457 INFO:tasks.ceph.mds.b.smithi122.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:45:37.458 INFO:tasks.ceph.mds.b.smithi122.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fcd45654db0] 2023-11-04T01:45:37.458 INFO:tasks.ceph.mds.b.smithi122.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fcd456a154c] 2023-11-04T01:45:37.458 INFO:tasks.ceph.mds.b.smithi122.stderr: 3: raise() 2023-11-04T01:45:37.458 INFO:tasks.ceph.mds.b.smithi122.stderr: 4: abort() 2023-11-04T01:45:37.458 INFO:tasks.ceph.mds.b.smithi122.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fcd45f6f009] 2023-11-04T01:45:37.459 INFO:tasks.ceph.mds.b.smithi122.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fcd45f6f16d] 2023-11-04T01:45:37.459 INFO:tasks.ceph.mds.b.smithi122.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x5560428909ce] 2023-11-04T01:45:37.459 INFO:tasks.ceph.mds.b.smithi122.stderr: 8: (MDSContext::complete(int)+0x5c) [0x5560428c0bcc] 2023-11-04T01:45:37.459 INFO:tasks.ceph.mds.b.smithi122.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x5560428c9b0c] 2023-11-04T01:45:37.459 INFO:tasks.ceph.mds.b.smithi122.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x5560428c9c63] 2023-11-04T01:45:37.460 INFO:tasks.ceph.mds.b.smithi122.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fcd460164a5] 2023-11-04T01:45:37.460 INFO:tasks.ceph.mds.b.smithi122.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7fcd4569f802] 2023-11-04T01:45:37.460 INFO:tasks.ceph.mds.b.smithi122.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7fcd4563f450] 2023-11-04T01:45:37.460 INFO:tasks.ceph.mds.b.smithi122.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:45:37.460 INFO:tasks.ceph.mds.b.smithi122.stderr: 2023-11-04T01:45:37.461 INFO:tasks.ceph.mds.b.smithi122.stderr: -675> 2023-11-04T01:45:32.996+0000 7fcd3db5a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:45:37.461 INFO:tasks.ceph.mds.b.smithi122.stderr: -673> 2023-11-04T01:45:32.996+0000 7fcd3db5a640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:45:37.461 INFO:tasks.ceph.mds.b.smithi122.stderr: -1> 2023-11-04T01:45:37.385+0000 7fcd3a353640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7fcd3a353640 time 2023-11-04T01:45:37.386260+0000 2023-11-04T01:45:37.461 INFO:tasks.ceph.mds.b.smithi122.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:45:37.461 INFO:tasks.ceph.mds.b.smithi122.stderr: 2023-11-04T01:45:37.462 INFO:tasks.ceph.mds.b.smithi122.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:45:37.462 INFO:tasks.ceph.mds.b.smithi122.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fcd45f6efaf] 2023-11-04T01:45:37.462 INFO:tasks.ceph.mds.b.smithi122.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fcd45f6f16d] 2023-11-04T01:45:37.462 INFO:tasks.ceph.mds.b.smithi122.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x5560428909ce] 2023-11-04T01:45:37.463 INFO:tasks.ceph.mds.b.smithi122.stderr: 4: (MDSContext::complete(int)+0x5c) [0x5560428c0bcc] 2023-11-04T01:45:37.463 INFO:tasks.ceph.mds.b.smithi122.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x5560428c9b0c] 2023-11-04T01:45:37.463 INFO:tasks.ceph.mds.b.smithi122.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x5560428c9c63] 2023-11-04T01:45:37.463 INFO:tasks.ceph.mds.b.smithi122.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fcd460164a5] 2023-11-04T01:45:37.463 INFO:tasks.ceph.mds.b.smithi122.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fcd4569f802] 2023-11-04T01:45:37.464 INFO:tasks.ceph.mds.b.smithi122.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fcd4563f450] 2023-11-04T01:45:37.464 INFO:tasks.ceph.mds.b.smithi122.stderr: 2023-11-04T01:45:37.464 INFO:tasks.ceph.mds.b.smithi122.stderr: 0> 2023-11-04T01:45:37.386+0000 7fcd3a353640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:45:37.464 INFO:tasks.ceph.mds.b.smithi122.stderr: in thread 7fcd3a353640 thread_name:MR_Finisher 2023-11-04T01:45:37.464 INFO:tasks.ceph.mds.b.smithi122.stderr: 2023-11-04T01:45:37.465 INFO:tasks.ceph.mds.b.smithi122.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:45:37.465 INFO:tasks.ceph.mds.b.smithi122.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fcd45654db0] 2023-11-04T01:45:37.465 INFO:tasks.ceph.mds.b.smithi122.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fcd456a154c] 2023-11-04T01:45:37.465 INFO:tasks.ceph.mds.b.smithi122.stderr: 3: raise() 2023-11-04T01:45:37.465 INFO:tasks.ceph.mds.b.smithi122.stderr: 4: abort() 2023-11-04T01:45:37.466 INFO:tasks.ceph.mds.b.smithi122.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fcd45f6f009] 2023-11-04T01:45:37.466 INFO:tasks.ceph.mds.b.smithi122.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fcd45f6f16d] 2023-11-04T01:45:37.466 INFO:tasks.ceph.mds.b.smithi122.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x73e) [0x5560428909ce] 2023-11-04T01:45:37.466 INFO:tasks.ceph.mds.b.smithi122.stderr: 8: (MDSContext::complete(int)+0x5c) [0x5560428c0bcc] 2023-11-04T01:45:37.466 INFO:tasks.ceph.mds.b.smithi122.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x5560428c9b0c] 2023-11-04T01:45:37.467 INFO:tasks.ceph.mds.b.smithi122.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x5560428c9c63] 2023-11-04T01:45:37.467 INFO:tasks.ceph.mds.b.smithi122.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fcd460164a5] 2023-11-04T01:45:37.467 INFO:tasks.ceph.mds.b.smithi122.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7fcd4569f802] 2023-11-04T01:45:37.467 INFO:tasks.ceph.mds.b.smithi122.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7fcd4563f450] 2023-11-04T01:45:37.467 INFO:tasks.ceph.mds.b.smithi122.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:45:37.468 INFO:tasks.ceph.mds.b.smithi122.stderr: 2023-11-04T01:45:37.519 INFO:teuthology.orchestra.run.smithi077.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:45:37.519 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:45:37.520 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:37.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.619+0000 7f5cd4290640 1 Processor -- start 2023-11-04T01:45:37.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.620+0000 7f5cd4290640 1 -- start start 2023-11-04T01:45:37.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.621+0000 7f5cd4290640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5ccc15b200 0x7f5ccc0ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:37.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.621+0000 7f5cd4290640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ccc0afda0 0x7f5ccc0cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:37.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.621+0000 7f5cd4290640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5ccc0cd7f0 0x7f5ccc0cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:37.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.621+0000 7f5cd4290640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ccc0cdc40 con 0x7f5ccc15b200 2023-11-04T01:45:37.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.621+0000 7f5cd4290640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ccc0cde80 con 0x7f5ccc0cd7f0 2023-11-04T01:45:37.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.621+0000 7f5cd4290640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc0cf670 con 0x7f5ccc0afda0 2023-11-04T01:45:37.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.621+0000 7f5cd202c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5ccc15b200 0x7f5ccc0ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:37.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.621+0000 7f5cd202c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5ccc15b200 0x7f5ccc0ceb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34614/0 (socket says 172.21.15.77:34614) 2023-11-04T01:45:37.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.621+0000 7f5cd202c640 1 -- 172.21.15.77:0/2572824579 learned_addr learned my addr 172.21.15.77:0/2572824579 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:37.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.621+0000 7f5cd182b640 1 --2- 172.21.15.77:0/2572824579 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ccc0afda0 0x7f5ccc0cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:37.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.622+0000 7f5cd282d640 1 --2- 172.21.15.77:0/2572824579 >> v2:172.21.15.122:3300/0 conn(0x7f5ccc0cd7f0 0x7f5ccc0cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:37.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.622+0000 7f5cd202c640 1 -- 172.21.15.77:0/2572824579 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ccc0afda0 msgr2=0x7f5ccc0cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:37.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.622+0000 7f5cd202c640 1 --2- 172.21.15.77:0/2572824579 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ccc0afda0 0x7f5ccc0cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:37.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.622+0000 7f5cd202c640 1 -- 172.21.15.77:0/2572824579 >> v2:172.21.15.122:3300/0 conn(0x7f5ccc0cd7f0 msgr2=0x7f5ccc0cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:37.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.622+0000 7f5cd202c640 1 --2- 172.21.15.77:0/2572824579 >> v2:172.21.15.122:3300/0 conn(0x7f5ccc0cd7f0 0x7f5ccc0cb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:37.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.622+0000 7f5cd202c640 1 -- 172.21.15.77:0/2572824579 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ccc0cf950 con 0x7f5ccc15b200 2023-11-04T01:45:37.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.623+0000 7f5cd202c640 1 --2- 172.21.15.77:0/2572824579 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ccc15b200 0x7f5ccc0ceb30 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc15ed40 tx=0x7f5cbc02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f89da9ec8b94306 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:37.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.623+0000 7f5cd102a640 1 -- 172.21.15.77:0/2572824579 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc004230 con 0x7f5ccc15b200 2023-11-04T01:45:37.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.623+0000 7f5cd102a640 1 -- 172.21.15.77:0/2572824579 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cbc004390 con 0x7f5ccc15b200 2023-11-04T01:45:37.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.623+0000 7f5cd102a640 1 -- 172.21.15.77:0/2572824579 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc003810 con 0x7f5ccc15b200 2023-11-04T01:45:37.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.624+0000 7f5cd4290640 1 -- 172.21.15.77:0/2572824579 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ccc15b200 msgr2=0x7f5ccc0ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:37.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.624+0000 7f5cd4290640 1 --2- 172.21.15.77:0/2572824579 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ccc15b200 0x7f5ccc0ceb30 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc15ed40 tx=0x7f5cbc02b860 comp rx=0 tx=0).stop 2023-11-04T01:45:37.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.624+0000 7f5cd4290640 1 -- 172.21.15.77:0/2572824579 shutdown_connections 2023-11-04T01:45:37.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.624+0000 7f5cd4290640 1 --2- 172.21.15.77:0/2572824579 >> v2:172.21.15.122:3300/0 conn(0x7f5ccc0cd7f0 0x7f5ccc0cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:37.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.624+0000 7f5cd4290640 1 --2- 172.21.15.77:0/2572824579 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ccc0afda0 0x7f5ccc0cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:37.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.624+0000 7f5cd4290640 1 --2- 172.21.15.77:0/2572824579 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ccc15b200 0x7f5ccc0ceb30 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:37.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.624+0000 7f5cd4290640 1 -- 172.21.15.77:0/2572824579 >> 172.21.15.77:0/2572824579 conn(0x7f5ccc0d0c30 msgr2=0x7f5ccc0d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:37.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.624+0000 7f5cd4290640 1 -- 172.21.15.77:0/2572824579 shutdown_connections 2023-11-04T01:45:37.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.624+0000 7f5cd4290640 1 -- 172.21.15.77:0/2572824579 wait complete. 2023-11-04T01:45:37.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.626+0000 7f5cd4290640 1 Processor -- start 2023-11-04T01:45:37.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.626+0000 7f5cd4290640 1 -- start start 2023-11-04T01:45:37.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.626+0000 7f5cd4290640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ccc0afda0 0x7f5ccc15c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:37.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.626+0000 7f5cd4290640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ccc0cd7f0 0x7f5ccc15b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:37.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.626+0000 7f5cd4290640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ccc15b200 0x7f5ccc0ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:37.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.626+0000 7f5cd4290640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc0c9a10 con 0x7f5ccc15b200 2023-11-04T01:45:37.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.626+0000 7f5cd4290640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc0c9cf0 con 0x7f5ccc0cd7f0 2023-11-04T01:45:37.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.626+0000 7f5cd4290640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc157580 con 0x7f5ccc0afda0 2023-11-04T01:45:37.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.626+0000 7f5cd282d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ccc15b200 0x7f5ccc0ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:37.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.627+0000 7f5cd282d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ccc15b200 0x7f5ccc0ae0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34626/0 (socket says 172.21.15.77:34626) 2023-11-04T01:45:37.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.627+0000 7f5cd282d640 1 -- 172.21.15.77:0/662388678 learned_addr learned my addr 172.21.15.77:0/662388678 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:37.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.627+0000 7f5cd182b640 1 --2- 172.21.15.77:0/662388678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ccc0cd7f0 0x7f5ccc15b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:37.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.627+0000 7f5cd202c640 1 --2- 172.21.15.77:0/662388678 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ccc0afda0 0x7f5ccc15c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:37.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.627+0000 7f5cd282d640 1 -- 172.21.15.77:0/662388678 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ccc0afda0 msgr2=0x7f5ccc15c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:37.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.627+0000 7f5cd282d640 1 --2- 172.21.15.77:0/662388678 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ccc0afda0 0x7f5ccc15c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:37.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.627+0000 7f5cd282d640 1 -- 172.21.15.77:0/662388678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ccc0cd7f0 msgr2=0x7f5ccc15b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:37.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.627+0000 7f5cd282d640 1 --2- 172.21.15.77:0/662388678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ccc0cd7f0 0x7f5ccc15b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:37.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.627+0000 7f5cd282d640 1 -- 172.21.15.77:0/662388678 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cbc009460 con 0x7f5ccc15b200 2023-11-04T01:45:37.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.627+0000 7f5cd282d640 1 --2- 172.21.15.77:0/662388678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ccc15b200 0x7f5ccc0ae0b0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4007e40 tx=0x7f5cc400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:37.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.627+0000 7f5cc2ffd640 1 -- 172.21.15.77:0/662388678 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc4014620 con 0x7f5ccc15b200 2023-11-04T01:45:37.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.627+0000 7f5cc2ffd640 1 -- 172.21.15.77:0/662388678 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc400ee90 con 0x7f5ccc15b200 2023-11-04T01:45:37.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.627+0000 7f5cd4290640 1 -- 172.21.15.77:0/662388678 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ccc157860 con 0x7f5ccc15b200 2023-11-04T01:45:37.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.627+0000 7f5cc2ffd640 1 -- 172.21.15.77:0/662388678 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc40149e0 con 0x7f5ccc15b200 2023-11-04T01:45:37.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.627+0000 7f5cd4290640 1 -- 172.21.15.77:0/662388678 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ccc15cba0 con 0x7f5ccc15b200 2023-11-04T01:45:37.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.628+0000 7f5cd4290640 1 -- 172.21.15.77:0/662388678 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ccc1573e0 con 0x7f5ccc15b200 2023-11-04T01:45:37.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.629+0000 7f5cc2ffd640 1 -- 172.21.15.77:0/662388678 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5cc4014b40 con 0x7f5ccc15b200 2023-11-04T01:45:37.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.629+0000 7f5cc2ffd640 1 --2- 172.21.15.77:0/662388678 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5cb006ae70 0x7f5cb006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:37.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.629+0000 7f5cc2ffd640 1 -- 172.21.15.77:0/662388678 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 7610+0+0 (secure 0 0 0) 0x7f5cc408a430 con 0x7f5ccc15b200 2023-11-04T01:45:37.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.629+0000 7f5cd202c640 1 --2- 172.21.15.77:0/662388678 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5cb006ae70 0x7f5cb006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:37.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.630+0000 7f5cd202c640 1 --2- 172.21.15.77:0/662388678 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5cb006ae70 0x7f5cb006d330 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc034000 tx=0x7f5cbc008030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:37.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.633+0000 7f5cc2ffd640 1 -- 172.21.15.77:0/662388678 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5ccc1573e0 con 0x7f5ccc15b200 2023-11-04T01:45:37.714 INFO:tasks.ceph.mds.b.smithi122.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:45:37.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.839+0000 7f5cd4290640 1 -- 172.21.15.77:0/662388678 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ccc15cba0 con 0x7f5ccc15b200 2023-11-04T01:45:37.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.839+0000 7f5cc2ffd640 1 -- 172.21.15.77:0/662388678 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f5ccc15cba0 con 0x7f5ccc15b200 2023-11-04T01:45:37.841 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:37.841 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":82,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7977,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/3276812155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3276812155},{"type":"v1","addr":"172.21.15.77:6834","nonce":3276812155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:45:36.580424+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6640,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6640":{"gid":6640,"name":"b","rank":0,"incarnation":76,"state":"up:active","state_seq":11,"addr":"172.21.15.122:6836/1345816612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1345816612},{"type":"v1","addr":"172.21.15.122:6836","nonce":1345816612}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:37.842 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 82 2023-11-04T01:45:37.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.841+0000 7f5cd4290640 1 -- 172.21.15.77:0/662388678 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5cb006ae70 msgr2=0x7f5cb006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:37.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.841+0000 7f5cd4290640 1 --2- 172.21.15.77:0/662388678 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5cb006ae70 0x7f5cb006d330 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc034000 tx=0x7f5cbc008030 comp rx=0 tx=0).stop 2023-11-04T01:45:37.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.841+0000 7f5cd4290640 1 -- 172.21.15.77:0/662388678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ccc15b200 msgr2=0x7f5ccc0ae0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:37.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.841+0000 7f5cd4290640 1 --2- 172.21.15.77:0/662388678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ccc15b200 0x7f5ccc0ae0b0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4007e40 tx=0x7f5cc400e4b0 comp rx=0 tx=0).stop 2023-11-04T01:45:37.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.841+0000 7f5cd4290640 1 -- 172.21.15.77:0/662388678 shutdown_connections 2023-11-04T01:45:37.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.841+0000 7f5cd4290640 1 --2- 172.21.15.77:0/662388678 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5cb006ae70 0x7f5cb006d330 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:37.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.841+0000 7f5cd4290640 1 --2- 172.21.15.77:0/662388678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ccc15b200 0x7f5ccc0ae0b0 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:37.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.841+0000 7f5cd4290640 1 --2- 172.21.15.77:0/662388678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ccc0cd7f0 0x7f5ccc15b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:37.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.841+0000 7f5cd4290640 1 --2- 172.21.15.77:0/662388678 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5ccc0afda0 0x7f5ccc15c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:37.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.841+0000 7f5cd4290640 1 -- 172.21.15.77:0/662388678 >> 172.21.15.77:0/662388678 conn(0x7f5ccc0d0c30 msgr2=0x7f5ccc0b1990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:37.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.841+0000 7f5cd4290640 1 -- 172.21.15.77:0/662388678 shutdown_connections 2023-11-04T01:45:37.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:37.841+0000 7f5cd4290640 1 -- 172.21.15.77:0/662388678 wait complete. 2023-11-04T01:45:37.853 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:45:39.904 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-11-04T01:45:42.854 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:42.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.964+0000 7fc5bbe26640 1 Processor -- start 2023-11-04T01:45:42.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.965+0000 7fc5bbe26640 1 -- start start 2023-11-04T01:45:42.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.965+0000 7fc5bbe26640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc5b415d4e0 0x7fc5b40d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:42.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.965+0000 7fc5bbe26640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc5b40d3b60 0x7fc5b40d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:42.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.965+0000 7fc5bbe26640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b40b32b0 con 0x7fc5b415d100 2023-11-04T01:45:42.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.965+0000 7fc5bbe26640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b40cec20 con 0x7fc5b415d4e0 2023-11-04T01:45:42.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.965+0000 7fc5bbe26640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b40cee10 con 0x7fc5b40d3b60 2023-11-04T01:45:42.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.966+0000 7fc5b93c1640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc5b415d4e0 0x7fc5b40d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:42.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.966+0000 7fc5b93c1640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc5b415d4e0 0x7fc5b40d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34636/0 (socket says 172.21.15.77:34636) 2023-11-04T01:45:42.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.966+0000 7fc5b93c1640 1 -- 172.21.15.77:0/3478974778 learned_addr learned my addr 172.21.15.77:0/3478974778 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:42.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.966+0000 7fc5ba3c3640 1 --2- 172.21.15.77:0/3478974778 >> v2:172.21.15.122:3300/0 conn(0x7fc5b40d3b60 0x7fc5b40d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:42.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.966+0000 7fc5b93c1640 1 -- 172.21.15.77:0/3478974778 >> v2:172.21.15.122:3300/0 conn(0x7fc5b40d3b60 msgr2=0x7fc5b40d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:42.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.966+0000 7fc5b93c1640 1 --2- 172.21.15.77:0/3478974778 >> v2:172.21.15.122:3300/0 conn(0x7fc5b40d3b60 0x7fc5b40d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:42.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.966+0000 7fc5b93c1640 1 -- 172.21.15.77:0/3478974778 >> v1:172.21.15.122:6789/0 conn(0x7fc5b415d100 legacy=0x7fc5b40ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:42.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.966+0000 7fc5b93c1640 1 -- 172.21.15.77:0/3478974778 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b40b4750 con 0x7fc5b415d4e0 2023-11-04T01:45:42.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.966+0000 7fc5ba3c3640 1 --2- 172.21.15.77:0/3478974778 >> v2:172.21.15.122:3300/0 conn(0x7fc5b40d3b60 0x7fc5b40d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:42.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.967+0000 7fc5b93c1640 1 --2- 172.21.15.77:0/3478974778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5b415d4e0 0x7fc5b40d14d0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fc5b408d6a0 tx=0x7fc5a402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55ca6e1062d7a0de server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:42.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.967+0000 7fc5b8bc0640 1 -- 172.21.15.77:0/3478974778 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4031870 con 0x7fc5b415d4e0 2023-11-04T01:45:42.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.967+0000 7fc5b8bc0640 1 -- 172.21.15.77:0/3478974778 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a40319d0 con 0x7fc5b415d4e0 2023-11-04T01:45:42.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.967+0000 7fc5b8bc0640 1 -- 172.21.15.77:0/3478974778 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4031d60 con 0x7fc5b415d4e0 2023-11-04T01:45:42.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.967+0000 7fc5bbe26640 1 -- 172.21.15.77:0/3478974778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5b415d4e0 msgr2=0x7fc5b40d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:42.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.967+0000 7fc5bbe26640 1 --2- 172.21.15.77:0/3478974778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5b415d4e0 0x7fc5b40d14d0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fc5b408d6a0 tx=0x7fc5a402b910 comp rx=0 tx=0).stop 2023-11-04T01:45:42.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.968+0000 7fc5bbe26640 1 -- 172.21.15.77:0/3478974778 shutdown_connections 2023-11-04T01:45:42.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.968+0000 7fc5bbe26640 1 --2- 172.21.15.77:0/3478974778 >> v2:172.21.15.122:3300/0 conn(0x7fc5b40d3b60 0x7fc5b40d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:42.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.968+0000 7fc5bbe26640 1 --2- 172.21.15.77:0/3478974778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5b415d4e0 0x7fc5b40d14d0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:42.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.968+0000 7fc5bbe26640 1 -- 172.21.15.77:0/3478974778 >> 172.21.15.77:0/3478974778 conn(0x7fc5b40d2ef0 msgr2=0x7fc5b40d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:42.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.968+0000 7fc5bbe26640 1 -- 172.21.15.77:0/3478974778 shutdown_connections 2023-11-04T01:45:42.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.968+0000 7fc5bbe26640 1 -- 172.21.15.77:0/3478974778 wait complete. 2023-11-04T01:45:42.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.969+0000 7fc5bbe26640 1 Processor -- start 2023-11-04T01:45:42.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.969+0000 7fc5bbe26640 1 -- start start 2023-11-04T01:45:42.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.970+0000 7fc5bbe26640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc5b40d3b60 0x7fc5b414f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:42.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.970+0000 7fc5bbe26640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5b415d100 0x7fc5b41f3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:42.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.970+0000 7fc5bbe26640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5b415d4e0 0x7fc5b415fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:42.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.970+0000 7fc5bbe26640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b41f3a60 con 0x7fc5b415d100 2023-11-04T01:45:42.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.970+0000 7fc5bbe26640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b40b5d80 con 0x7fc5b415d4e0 2023-11-04T01:45:42.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.970+0000 7fc5bbe26640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b40b6060 con 0x7fc5b40d3b60 2023-11-04T01:45:42.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.970+0000 7fc5b93c1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5b415d100 0x7fc5b41f3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:42.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.970+0000 7fc5b93c1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5b415d100 0x7fc5b41f3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34646/0 (socket says 172.21.15.77:34646) 2023-11-04T01:45:42.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.970+0000 7fc5b93c1640 1 -- 172.21.15.77:0/2661885035 learned_addr learned my addr 172.21.15.77:0/2661885035 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:42.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.970+0000 7fc5b93c1640 1 -- 172.21.15.77:0/2661885035 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc5b40d3b60 msgr2=0x7fc5b414f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:42.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.970+0000 7fc5b93c1640 1 --2- 172.21.15.77:0/2661885035 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc5b40d3b60 0x7fc5b414f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:42.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.970+0000 7fc5b93c1640 1 -- 172.21.15.77:0/2661885035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5b415d4e0 msgr2=0x7fc5b415fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:42.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.970+0000 7fc5b93c1640 1 --2- 172.21.15.77:0/2661885035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5b415d4e0 0x7fc5b415fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:42.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.970+0000 7fc5b93c1640 1 -- 172.21.15.77:0/2661885035 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a40094d0 con 0x7fc5b415d100 2023-11-04T01:45:42.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.970+0000 7fc5b93c1640 1 --2- 172.21.15.77:0/2661885035 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5b415d100 0x7fc5b41f3520 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fc5a402b950 tx=0x7fc5a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:42.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.970+0000 7fc5aa7fc640 1 -- 172.21.15.77:0/2661885035 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4031820 con 0x7fc5b415d100 2023-11-04T01:45:42.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.970+0000 7fc5aa7fc640 1 -- 172.21.15.77:0/2661885035 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a40443f0 con 0x7fc5b415d100 2023-11-04T01:45:42.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.970+0000 7fc5aa7fc640 1 -- 172.21.15.77:0/2661885035 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a40447a0 con 0x7fc5b415d100 2023-11-04T01:45:42.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.970+0000 7fc5bbe26640 1 -- 172.21.15.77:0/2661885035 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b40b6340 con 0x7fc5b415d100 2023-11-04T01:45:42.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.970+0000 7fc5bbe26640 1 -- 172.21.15.77:0/2661885035 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b40b6900 con 0x7fc5b415d100 2023-11-04T01:45:42.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.972+0000 7fc5bbe26640 1 -- 172.21.15.77:0/2661885035 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b40684b0 con 0x7fc5b415d100 2023-11-04T01:45:42.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.972+0000 7fc5aa7fc640 1 -- 172.21.15.77:0/2661885035 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc5a404d450 con 0x7fc5b415d100 2023-11-04T01:45:42.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.972+0000 7fc5aa7fc640 1 --2- 172.21.15.77:0/2661885035 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc59806aea0 0x7fc59806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:42.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.972+0000 7fc5aa7fc640 1 -- 172.21.15.77:0/2661885035 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 7610+0+0 (secure 0 0 0) 0x7fc5a402d040 con 0x7fc5b415d100 2023-11-04T01:45:42.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.973+0000 7fc5b9bc2640 1 --2- 172.21.15.77:0/2661885035 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc59806aea0 0x7fc59806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:42.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.973+0000 7fc5b9bc2640 1 --2- 172.21.15.77:0/2661885035 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc59806aea0 0x7fc59806d360 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0003d10 tx=0x7fc5b0007a00 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:42.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:42.976+0000 7fc5aa7fc640 1 -- 172.21.15.77:0/2661885035 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc5a4076e30 con 0x7fc5b415d100 2023-11-04T01:45:43.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:43.174+0000 7fc5bbe26640 1 -- 172.21.15.77:0/2661885035 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5b40d0ef0 con 0x7fc5b415d100 2023-11-04T01:45:43.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:43.175+0000 7fc5aa7fc640 1 -- 172.21.15.77:0/2661885035 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4938 (secure 0 0 0) 0x7fc5a4035020 con 0x7fc5b415d100 2023-11-04T01:45:43.176 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:43.177 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":82,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7977,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/3276812155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3276812155},{"type":"v1","addr":"172.21.15.77:6834","nonce":3276812155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:45:36.580424+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6640,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6640":{"gid":6640,"name":"b","rank":0,"incarnation":76,"state":"up:active","state_seq":11,"addr":"172.21.15.122:6836/1345816612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1345816612},{"type":"v1","addr":"172.21.15.122:6836","nonce":1345816612}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:43.177 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 82 2023-11-04T01:45:43.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:43.176+0000 7fc5bbe26640 1 -- 172.21.15.77:0/2661885035 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc59806aea0 msgr2=0x7fc59806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:43.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:43.176+0000 7fc5bbe26640 1 --2- 172.21.15.77:0/2661885035 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc59806aea0 0x7fc59806d360 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0003d10 tx=0x7fc5b0007a00 comp rx=0 tx=0).stop 2023-11-04T01:45:43.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:43.176+0000 7fc5bbe26640 1 -- 172.21.15.77:0/2661885035 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5b415d100 msgr2=0x7fc5b41f3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:43.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:43.176+0000 7fc5bbe26640 1 --2- 172.21.15.77:0/2661885035 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5b415d100 0x7fc5b41f3520 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fc5a402b950 tx=0x7fc5a40046c0 comp rx=0 tx=0).stop 2023-11-04T01:45:43.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:43.176+0000 7fc5bbe26640 1 -- 172.21.15.77:0/2661885035 shutdown_connections 2023-11-04T01:45:43.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:43.176+0000 7fc5bbe26640 1 --2- 172.21.15.77:0/2661885035 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc59806aea0 0x7fc59806d360 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:43.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:43.176+0000 7fc5bbe26640 1 --2- 172.21.15.77:0/2661885035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5b415d4e0 0x7fc5b415fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:43.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:43.176+0000 7fc5bbe26640 1 --2- 172.21.15.77:0/2661885035 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5b415d100 0x7fc5b41f3520 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:43.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:43.176+0000 7fc5bbe26640 1 --2- 172.21.15.77:0/2661885035 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc5b40d3b60 0x7fc5b414f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:43.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:43.176+0000 7fc5bbe26640 1 -- 172.21.15.77:0/2661885035 >> 172.21.15.77:0/2661885035 conn(0x7fc5b40d2ef0 msgr2=0x7fc5b40b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:43.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:43.176+0000 7fc5bbe26640 1 -- 172.21.15.77:0/2661885035 shutdown_connections 2023-11-04T01:45:43.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:43.176+0000 7fc5bbe26640 1 -- 172.21.15.77:0/2661885035 wait complete. 2023-11-04T01:45:43.188 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:45:46.515 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~7s 2023-11-04T01:45:48.189 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:48.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.299+0000 7fe09991d640 1 Processor -- start 2023-11-04T01:45:48.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.299+0000 7fe09991d640 1 -- start start 2023-11-04T01:45:48.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.299+0000 7fe09991d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe09415d100 0x7fe0940ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:48.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.299+0000 7fe09991d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe09415d4e0 0x7fe0940d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:48.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.299+0000 7fe09991d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe0940d3b60 0x7fe0940d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:48.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.299+0000 7fe09991d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0940b32b0 con 0x7fe0940d3b60 2023-11-04T01:45:48.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.300+0000 7fe09991d640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0940cee10 con 0x7fe09415d100 2023-11-04T01:45:48.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.300+0000 7fe09991d640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0940b2980 con 0x7fe09415d4e0 2023-11-04T01:45:48.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.300+0000 7fe0937fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe0940d3b60 0x7fe0940d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:48.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.300+0000 7fe0937fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe0940d3b60 0x7fe0940d1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38558/0 (socket says 172.21.15.77:38558) 2023-11-04T01:45:48.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.300+0000 7fe0937fe640 1 -- 172.21.15.77:0/1821531582 learned_addr learned my addr 172.21.15.77:0/1821531582 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:48.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.300+0000 7fe092ffd640 1 --2- 172.21.15.77:0/1821531582 >> v2:172.21.15.122:3300/0 conn(0x7fe09415d100 0x7fe0940ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:48.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.300+0000 7fe08bfff640 1 --2- 172.21.15.77:0/1821531582 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe09415d4e0 0x7fe0940d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:48.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.300+0000 7fe0937fe640 1 -- 172.21.15.77:0/1821531582 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe09415d4e0 msgr2=0x7fe0940d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:48.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.300+0000 7fe0937fe640 1 --2- 172.21.15.77:0/1821531582 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe09415d4e0 0x7fe0940d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:48.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.300+0000 7fe0937fe640 1 -- 172.21.15.77:0/1821531582 >> v2:172.21.15.122:3300/0 conn(0x7fe09415d100 msgr2=0x7fe0940ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:48.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.300+0000 7fe0937fe640 1 --2- 172.21.15.77:0/1821531582 >> v2:172.21.15.122:3300/0 conn(0x7fe09415d100 0x7fe0940ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:48.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.300+0000 7fe0937fe640 1 -- 172.21.15.77:0/1821531582 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0940b2c60 con 0x7fe0940d3b60 2023-11-04T01:45:48.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.301+0000 7fe0937fe640 1 --2- 172.21.15.77:0/1821531582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0940d3b60 0x7fe0940d1a10 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fe0940d09f0 tx=0x7fe08c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=571147d702c3290e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:48.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.301+0000 7fe0927fc640 1 -- 172.21.15.77:0/1821531582 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c02ca70 con 0x7fe0940d3b60 2023-11-04T01:45:48.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.301+0000 7fe0927fc640 1 -- 172.21.15.77:0/1821531582 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08c02cbd0 con 0x7fe0940d3b60 2023-11-04T01:45:48.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.301+0000 7fe0927fc640 1 -- 172.21.15.77:0/1821531582 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c0343f0 con 0x7fe0940d3b60 2023-11-04T01:45:48.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.302+0000 7fe09991d640 1 -- 172.21.15.77:0/1821531582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0940d3b60 msgr2=0x7fe0940d1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:48.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.302+0000 7fe09991d640 1 --2- 172.21.15.77:0/1821531582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0940d3b60 0x7fe0940d1a10 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fe0940d09f0 tx=0x7fe08c02bed0 comp rx=0 tx=0).stop 2023-11-04T01:45:48.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.302+0000 7fe09991d640 1 -- 172.21.15.77:0/1821531582 shutdown_connections 2023-11-04T01:45:48.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.302+0000 7fe09991d640 1 --2- 172.21.15.77:0/1821531582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0940d3b60 0x7fe0940d1a10 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:48.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.302+0000 7fe09991d640 1 --2- 172.21.15.77:0/1821531582 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe09415d4e0 0x7fe0940d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:48.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.302+0000 7fe09991d640 1 --2- 172.21.15.77:0/1821531582 >> v2:172.21.15.122:3300/0 conn(0x7fe09415d100 0x7fe0940ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:48.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.302+0000 7fe09991d640 1 -- 172.21.15.77:0/1821531582 >> 172.21.15.77:0/1821531582 conn(0x7fe0940d2ef0 msgr2=0x7fe0940d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:48.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.302+0000 7fe09991d640 1 -- 172.21.15.77:0/1821531582 shutdown_connections 2023-11-04T01:45:48.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.302+0000 7fe09991d640 1 -- 172.21.15.77:0/1821531582 wait complete. 2023-11-04T01:45:48.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.303+0000 7fe09991d640 1 Processor -- start 2023-11-04T01:45:48.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.303+0000 7fe09991d640 1 -- start start 2023-11-04T01:45:48.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.303+0000 7fe09991d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0940d3b60 0x7fe09415a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:48.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.304+0000 7fe09991d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe09415d100 0x7fe0940b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:48.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.304+0000 7fe09991d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe09415d4e0 0x7fe09406bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:48.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.304+0000 7fe09991d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09415a9d0 con 0x7fe09415d4e0 2023-11-04T01:45:48.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.304+0000 7fe09991d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09415d900 con 0x7fe0940d3b60 2023-11-04T01:45:48.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.304+0000 7fe09991d640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09415db50 con 0x7fe09415d100 2023-11-04T01:45:48.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.304+0000 7fe0937fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe09415d4e0 0x7fe09406bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:48.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.304+0000 7fe0937fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe09415d4e0 0x7fe09406bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38570/0 (socket says 172.21.15.77:38570) 2023-11-04T01:45:48.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.304+0000 7fe0937fe640 1 -- 172.21.15.77:0/1738709340 learned_addr learned my addr 172.21.15.77:0/1738709340 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:48.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.304+0000 7fe08bfff640 1 --2- 172.21.15.77:0/1738709340 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe09415d100 0x7fe0940b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:48.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.304+0000 7fe092ffd640 1 --2- 172.21.15.77:0/1738709340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0940d3b60 0x7fe09415a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:48.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.304+0000 7fe0937fe640 1 -- 172.21.15.77:0/1738709340 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe09415d100 msgr2=0x7fe0940b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:48.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.304+0000 7fe0937fe640 1 --2- 172.21.15.77:0/1738709340 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe09415d100 0x7fe0940b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:48.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.304+0000 7fe0937fe640 1 -- 172.21.15.77:0/1738709340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0940d3b60 msgr2=0x7fe09415a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:48.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.304+0000 7fe0937fe640 1 --2- 172.21.15.77:0/1738709340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0940d3b60 0x7fe09415a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:48.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.304+0000 7fe0937fe640 1 -- 172.21.15.77:0/1738709340 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe08c009b30 con 0x7fe09415d4e0 2023-11-04T01:45:48.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.304+0000 7fe092ffd640 1 --2- 172.21.15.77:0/1738709340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0940d3b60 0x7fe09415a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:48.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.304+0000 7fe0937fe640 1 --2- 172.21.15.77:0/1738709340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe09415d4e0 0x7fe09406bb00 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fe08c036040 tx=0x7fe08c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:48.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.304+0000 7fe090ff9640 1 -- 172.21.15.77:0/1738709340 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c009510 con 0x7fe09415d4e0 2023-11-04T01:45:48.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.304+0000 7fe090ff9640 1 -- 172.21.15.77:0/1738709340 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08c03e450 con 0x7fe09415d4e0 2023-11-04T01:45:48.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.304+0000 7fe09991d640 1 -- 172.21.15.77:0/1738709340 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09415de30 con 0x7fe09415d4e0 2023-11-04T01:45:48.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.304+0000 7fe090ff9640 1 -- 172.21.15.77:0/1738709340 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c03e800 con 0x7fe09415d4e0 2023-11-04T01:45:48.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.304+0000 7fe09991d640 1 -- 172.21.15.77:0/1738709340 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe09415e3f0 con 0x7fe09415d4e0 2023-11-04T01:45:48.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.305+0000 7fe09991d640 1 -- 172.21.15.77:0/1738709340 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0940684b0 con 0x7fe09415d4e0 2023-11-04T01:45:48.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.306+0000 7fe090ff9640 1 -- 172.21.15.77:0/1738709340 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe08c03e960 con 0x7fe09415d4e0 2023-11-04T01:45:48.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.306+0000 7fe090ff9640 1 --2- 172.21.15.77:0/1738709340 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe07406ae70 0x7fe07406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:48.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.306+0000 7fe090ff9640 1 -- 172.21.15.77:0/1738709340 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7566+0+0 (secure 0 0 0) 0x7fe08c0aca10 con 0x7fe09415d4e0 2023-11-04T01:45:48.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.306+0000 7fe092ffd640 1 --2- 172.21.15.77:0/1738709340 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe07406ae70 0x7fe07406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:48.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.307+0000 7fe092ffd640 1 --2- 172.21.15.77:0/1738709340 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe07406ae70 0x7fe07406d330 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fe084003940 tx=0x7fe084008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:48.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.310+0000 7fe090ff9640 1 -- 172.21.15.77:0/1738709340 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe08c077380 con 0x7fe09415d4e0 2023-11-04T01:45:48.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.509+0000 7fe09991d640 1 -- 172.21.15.77:0/1738709340 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0940d2cd0 con 0x7fe09415d4e0 2023-11-04T01:45:48.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.509+0000 7fe090ff9640 1 -- 172.21.15.77:0/1738709340 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4938 (secure 0 0 0) 0x7fe08c07a9a0 con 0x7fe09415d4e0 2023-11-04T01:45:48.511 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:48.512 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":82,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7977,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/3276812155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3276812155},{"type":"v1","addr":"172.21.15.77:6834","nonce":3276812155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:45:36.580424+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6640,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6640":{"gid":6640,"name":"b","rank":0,"incarnation":76,"state":"up:active","state_seq":11,"addr":"172.21.15.122:6836/1345816612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1345816612},{"type":"v1","addr":"172.21.15.122:6836","nonce":1345816612}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:48.512 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 82 2023-11-04T01:45:48.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.511+0000 7fe09991d640 1 -- 172.21.15.77:0/1738709340 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe07406ae70 msgr2=0x7fe07406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:48.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.511+0000 7fe09991d640 1 --2- 172.21.15.77:0/1738709340 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe07406ae70 0x7fe07406d330 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fe084003940 tx=0x7fe084008040 comp rx=0 tx=0).stop 2023-11-04T01:45:48.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.511+0000 7fe09991d640 1 -- 172.21.15.77:0/1738709340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe09415d4e0 msgr2=0x7fe09406bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:48.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.511+0000 7fe09991d640 1 --2- 172.21.15.77:0/1738709340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe09415d4e0 0x7fe09406bb00 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fe08c036040 tx=0x7fe08c004a40 comp rx=0 tx=0).stop 2023-11-04T01:45:48.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.511+0000 7fe09991d640 1 -- 172.21.15.77:0/1738709340 shutdown_connections 2023-11-04T01:45:48.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.511+0000 7fe09991d640 1 --2- 172.21.15.77:0/1738709340 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe07406ae70 0x7fe07406d330 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:48.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.511+0000 7fe09991d640 1 --2- 172.21.15.77:0/1738709340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe09415d4e0 0x7fe09406bb00 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:48.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.511+0000 7fe09991d640 1 --2- 172.21.15.77:0/1738709340 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe09415d100 0x7fe0940b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:48.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.511+0000 7fe09991d640 1 --2- 172.21.15.77:0/1738709340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0940d3b60 0x7fe09415a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:48.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.511+0000 7fe09991d640 1 -- 172.21.15.77:0/1738709340 >> 172.21.15.77:0/1738709340 conn(0x7fe0940d2ef0 msgr2=0x7fe0940d14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:48.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.511+0000 7fe09991d640 1 -- 172.21.15.77:0/1738709340 shutdown_connections 2023-11-04T01:45:48.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:48.511+0000 7fe09991d640 1 -- 172.21.15.77:0/1738709340 wait complete. 2023-11-04T01:45:48.523 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:45:53.126 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~13s 2023-11-04T01:45:53.524 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:53.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.634+0000 7fbcd1e34640 1 Processor -- start 2023-11-04T01:45:53.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.634+0000 7fbcd1e34640 1 -- start start 2023-11-04T01:45:53.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.635+0000 7fbcd1e34640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fbccc0b1440 0x7fbccc06c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:53.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.635+0000 7fbcd1e34640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbccc06b740 0x7fbccc066010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:53.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.635+0000 7fbcd1e34640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbccc0ad6a0 con 0x7fbccc15ade0 2023-11-04T01:45:53.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.635+0000 7fbcd1e34640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbccc0acaf0 con 0x7fbccc0b1440 2023-11-04T01:45:53.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.635+0000 7fbcd1e34640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc0acdd0 con 0x7fbccc06b740 2023-11-04T01:45:53.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.635+0000 7fbccbfff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbccc06b740 0x7fbccc066010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:53.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.635+0000 7fbccaffd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fbccc0b1440 0x7fbccc06c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:53.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.635+0000 7fbccb7fe640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fbccc15ade0 0x7fbccc0b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:37618/0 (socket says 172.21.15.77:37618) 2023-11-04T01:45:53.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.635+0000 7fbccb7fe640 1 -- 172.21.15.77:0/2055410419 learned_addr learned my addr 172.21.15.77:0/2055410419 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:45:53.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.635+0000 7fbccbfff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbccc06b740 0x7fbccc066010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:59748/0 (socket says 172.21.15.77:59748) 2023-11-04T01:45:53.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.636+0000 7fbcca7fc640 1 -- 172.21.15.77:0/2055410419 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3486720504 0 0) 0x7fbccc0ad6a0 con 0x7fbccc15ade0 2023-11-04T01:45:53.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.636+0000 7fbcca7fc640 1 -- 172.21.15.77:0/2055410419 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcb4003520 con 0x7fbccc15ade0 2023-11-04T01:45:53.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.636+0000 7fbccbfff640 1 -- 172.21.15.77:0/2055410419 >> v2:172.21.15.122:3300/0 conn(0x7fbccc0b1440 msgr2=0x7fbccc06c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:53.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.636+0000 7fbccbfff640 1 --2- 172.21.15.77:0/2055410419 >> v2:172.21.15.122:3300/0 conn(0x7fbccc0b1440 0x7fbccc06c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:53.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.636+0000 7fbccbfff640 1 -- 172.21.15.77:0/2055410419 >> v1:172.21.15.122:6789/0 conn(0x7fbccc15ade0 legacy=0x7fbccc0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:53.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.636+0000 7fbccbfff640 1 -- 172.21.15.77:0/2055410419 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbccc0ad0e0 con 0x7fbccc06b740 2023-11-04T01:45:53.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.637+0000 7fbccbfff640 1 --2- 172.21.15.77:0/2055410419 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbccc06b740 0x7fbccc066010 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4009d90 tx=0x7fbcc402be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5e97c1cf004755a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:53.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.637+0000 7fbcca7fc640 1 -- 172.21.15.77:0/2055410419 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc402cbc0 con 0x7fbccc06b740 2023-11-04T01:45:53.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.637+0000 7fbcca7fc640 1 -- 172.21.15.77:0/2055410419 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc402cd20 con 0x7fbccc06b740 2023-11-04T01:45:53.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.637+0000 7fbcca7fc640 1 -- 172.21.15.77:0/2055410419 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4034660 con 0x7fbccc06b740 2023-11-04T01:45:53.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.637+0000 7fbcd1e34640 1 -- 172.21.15.77:0/2055410419 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbccc06b740 msgr2=0x7fbccc066010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:53.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.637+0000 7fbcd1e34640 1 --2- 172.21.15.77:0/2055410419 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbccc06b740 0x7fbccc066010 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4009d90 tx=0x7fbcc402be10 comp rx=0 tx=0).stop 2023-11-04T01:45:53.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.637+0000 7fbcd1e34640 1 -- 172.21.15.77:0/2055410419 shutdown_connections 2023-11-04T01:45:53.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.637+0000 7fbcd1e34640 1 --2- 172.21.15.77:0/2055410419 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbccc06b740 0x7fbccc066010 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:53.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.637+0000 7fbcd1e34640 1 --2- 172.21.15.77:0/2055410419 >> v2:172.21.15.122:3300/0 conn(0x7fbccc0b1440 0x7fbccc06c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:53.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.637+0000 7fbcd1e34640 1 -- 172.21.15.77:0/2055410419 >> 172.21.15.77:0/2055410419 conn(0x7fbccc0cbd30 msgr2=0x7fbccc0cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:53.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.637+0000 7fbcd1e34640 1 -- 172.21.15.77:0/2055410419 shutdown_connections 2023-11-04T01:45:53.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.637+0000 7fbcd1e34640 1 -- 172.21.15.77:0/2055410419 wait complete. 2023-11-04T01:45:53.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.639+0000 7fbcd1e34640 1 Processor -- start 2023-11-04T01:45:53.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.639+0000 7fbcd1e34640 1 -- start start 2023-11-04T01:45:53.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.639+0000 7fbcd1e34640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbccc06b740 0x7fbccc152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:53.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.640+0000 7fbcd1e34640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbccc0b1440 0x7fbccc0c1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:53.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.640+0000 7fbcd1e34640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbccc15ade0 0x7fbccc09a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:53.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.640+0000 7fbcd1e34640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc0af780 con 0x7fbccc06b740 2023-11-04T01:45:53.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.640+0000 7fbcd1e34640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc0ce1c0 con 0x7fbccc15ade0 2023-11-04T01:45:53.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.640+0000 7fbcd1e34640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc0ce4a0 con 0x7fbccc0b1440 2023-11-04T01:45:53.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.640+0000 7fbccb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbccc06b740 0x7fbccc152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:53.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.640+0000 7fbccb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbccc06b740 0x7fbccc152d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38580/0 (socket says 172.21.15.77:38580) 2023-11-04T01:45:53.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.640+0000 7fbccb7fe640 1 -- 172.21.15.77:0/3904940463 learned_addr learned my addr 172.21.15.77:0/3904940463 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:53.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.640+0000 7fbccaffd640 1 --2- 172.21.15.77:0/3904940463 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbccc0b1440 0x7fbccc0c1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:53.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.640+0000 7fbccbfff640 1 --2- 172.21.15.77:0/3904940463 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbccc15ade0 0x7fbccc09a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:53.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.640+0000 7fbccb7fe640 1 -- 172.21.15.77:0/3904940463 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbccc0b1440 msgr2=0x7fbccc0c1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:53.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.640+0000 7fbccb7fe640 1 --2- 172.21.15.77:0/3904940463 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbccc0b1440 0x7fbccc0c1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:53.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.640+0000 7fbccb7fe640 1 -- 172.21.15.77:0/3904940463 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbccc15ade0 msgr2=0x7fbccc09a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:53.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.640+0000 7fbccb7fe640 1 --2- 172.21.15.77:0/3904940463 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbccc15ade0 0x7fbccc09a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:53.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.640+0000 7fbccb7fe640 1 -- 172.21.15.77:0/3904940463 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc4009a70 con 0x7fbccc06b740 2023-11-04T01:45:53.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.640+0000 7fbccaffd640 1 --2- 172.21.15.77:0/3904940463 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbccc0b1440 0x7fbccc0c1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:53.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.640+0000 7fbccbfff640 1 --2- 172.21.15.77:0/3904940463 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbccc15ade0 0x7fbccc09a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:53.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.640+0000 7fbccb7fe640 1 --2- 172.21.15.77:0/3904940463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbccc06b740 0x7fbccc152d60 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fbcc00058d0 tx=0x7fbcc000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:53.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.640+0000 7fbcb3fff640 1 -- 172.21.15.77:0/3904940463 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc0005d30 con 0x7fbccc06b740 2023-11-04T01:45:53.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.640+0000 7fbcb3fff640 1 -- 172.21.15.77:0/3904940463 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc0005e90 con 0x7fbccc06b740 2023-11-04T01:45:53.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.640+0000 7fbcd1e34640 1 -- 172.21.15.77:0/3904940463 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbccc0ce780 con 0x7fbccc06b740 2023-11-04T01:45:53.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.640+0000 7fbcb3fff640 1 -- 172.21.15.77:0/3904940463 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc0007310 con 0x7fbccc06b740 2023-11-04T01:45:53.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.640+0000 7fbcd1e34640 1 -- 172.21.15.77:0/3904940463 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbccc1532a0 con 0x7fbccc06b740 2023-11-04T01:45:53.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.641+0000 7fbcd1e34640 1 -- 172.21.15.77:0/3904940463 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbccc0684b0 con 0x7fbccc06b740 2023-11-04T01:45:53.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.642+0000 7fbcb3fff640 1 -- 172.21.15.77:0/3904940463 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbcc0007470 con 0x7fbccc06b740 2023-11-04T01:45:53.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.642+0000 7fbcb3fff640 1 --2- 172.21.15.77:0/3904940463 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbcb806ae70 0x7fbcb806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:53.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.642+0000 7fbcb3fff640 1 -- 172.21.15.77:0/3904940463 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7566+0+0 (secure 0 0 0) 0x7fbcc00893b0 con 0x7fbccc06b740 2023-11-04T01:45:53.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.643+0000 7fbccaffd640 1 --2- 172.21.15.77:0/3904940463 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbcb806ae70 0x7fbcb806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:53.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.643+0000 7fbccaffd640 1 --2- 172.21.15.77:0/3904940463 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbcb806ae70 0x7fbcb806d330 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fbccc159dc0 tx=0x7fbcbc008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:53.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.646+0000 7fbcb3fff640 1 -- 172.21.15.77:0/3904940463 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbcc0053d20 con 0x7fbccc06b740 2023-11-04T01:45:53.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.850+0000 7fbcd1e34640 1 -- 172.21.15.77:0/3904940463 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbccc065df0 con 0x7fbccc06b740 2023-11-04T01:45:53.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.850+0000 7fbcb3fff640 1 -- 172.21.15.77:0/3904940463 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4986 (secure 0 0 0) 0x7fbcc0057340 con 0x7fbccc06b740 2023-11-04T01:45:53.852 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:53.852 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":83,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7977,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/3276812155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3276812155},{"type":"v1","addr":"172.21.15.77:6834","nonce":3276812155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:45:50.607898+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6640,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6640":{"gid":6640,"name":"b","rank":0,"incarnation":76,"state":"up:active","state_seq":11,"addr":"172.21.15.122:6836/1345816612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1345816612},{"type":"v1","addr":"172.21.15.122:6836","nonce":1345816612}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:45:50.607898+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:53.853 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 83 2023-11-04T01:45:53.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.852+0000 7fbcd1e34640 1 -- 172.21.15.77:0/3904940463 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbcb806ae70 msgr2=0x7fbcb806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:53.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.852+0000 7fbcd1e34640 1 --2- 172.21.15.77:0/3904940463 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbcb806ae70 0x7fbcb806d330 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fbccc159dc0 tx=0x7fbcbc008040 comp rx=0 tx=0).stop 2023-11-04T01:45:53.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.852+0000 7fbcd1e34640 1 -- 172.21.15.77:0/3904940463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbccc06b740 msgr2=0x7fbccc152d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:53.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.852+0000 7fbcd1e34640 1 --2- 172.21.15.77:0/3904940463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbccc06b740 0x7fbccc152d60 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fbcc00058d0 tx=0x7fbcc000c8f0 comp rx=0 tx=0).stop 2023-11-04T01:45:53.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.852+0000 7fbcd1e34640 1 -- 172.21.15.77:0/3904940463 shutdown_connections 2023-11-04T01:45:53.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.852+0000 7fbcd1e34640 1 --2- 172.21.15.77:0/3904940463 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbcb806ae70 0x7fbcb806d330 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:53.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.852+0000 7fbcd1e34640 1 --2- 172.21.15.77:0/3904940463 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbccc15ade0 0x7fbccc09a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:53.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.852+0000 7fbcd1e34640 1 --2- 172.21.15.77:0/3904940463 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbccc0b1440 0x7fbccc0c1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:53.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.852+0000 7fbcd1e34640 1 --2- 172.21.15.77:0/3904940463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbccc06b740 0x7fbccc152d60 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:53.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.852+0000 7fbcd1e34640 1 -- 172.21.15.77:0/3904940463 >> 172.21.15.77:0/3904940463 conn(0x7fbccc0cbd30 msgr2=0x7fbccc0c97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:53.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.852+0000 7fbcd1e34640 1 -- 172.21.15.77:0/3904940463 shutdown_connections 2023-11-04T01:45:53.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:53.852+0000 7fbcd1e34640 1 -- 172.21.15.77:0/3904940463 wait complete. 2023-11-04T01:45:53.864 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-11-04T01:45:53.864 DEBUG:teuthology.orchestra.run.smithi122:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:45:53.894 INFO:teuthology.orchestra.run.smithi122.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:45:53.896 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:45:53.896 DEBUG:teuthology.orchestra.run.smithi122:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:45:53.970 INFO:teuthology.orchestra.run.smithi122.stdout:1699062337.96443.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i b', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:45:53.972 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062337.96443.core'] 2023-11-04T01:45:53.972 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062337.96443.core, deleting it 2023-11-04T01:45:53.973 DEBUG:teuthology.orchestra.run.smithi122:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062337.96443.core 2023-11-04T01:45:54.044 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:54.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.142+0000 7f1f23b76640 1 Processor -- start 2023-11-04T01:45:54.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.142+0000 7f1f23b76640 1 -- start start 2023-11-04T01:45:54.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.143+0000 7f1f23b76640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1f1c15d1b0 0x7f1f1c0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:54.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.143+0000 7f1f23b76640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1f1c06c240 0x7f1f1c0b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:54.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.143+0000 7f1f23b76640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f1c0b2310 con 0x7f1f1c06c6d0 2023-11-04T01:45:54.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.143+0000 7f1f23b76640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f1c06cbe0 con 0x7f1f1c06c240 2023-11-04T01:45:54.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.143+0000 7f1f23b76640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f1c0b2100 con 0x7f1f1c15d1b0 2023-11-04T01:45:54.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.143+0000 7f1f21111640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1f1c06c240 0x7f1f1c0b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:54.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.143+0000 7f1f21111640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1f1c06c240 0x7f1f1c0b0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38588/0 (socket says 172.21.15.77:38588) 2023-11-04T01:45:54.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.143+0000 7f1f21111640 1 -- 172.21.15.77:0/3125555850 learned_addr learned my addr 172.21.15.77:0/3125555850 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:54.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.143+0000 7f1f21912640 1 --2- 172.21.15.77:0/3125555850 >> v2:172.21.15.122:3300/0 conn(0x7f1f1c15d1b0 0x7f1f1c0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:54.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.143+0000 7f1f21111640 1 -- 172.21.15.77:0/3125555850 >> v2:172.21.15.122:3300/0 conn(0x7f1f1c15d1b0 msgr2=0x7f1f1c0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:54.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.143+0000 7f1f21111640 1 --2- 172.21.15.77:0/3125555850 >> v2:172.21.15.122:3300/0 conn(0x7f1f1c15d1b0 0x7f1f1c0b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:54.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.143+0000 7f1f21111640 1 -- 172.21.15.77:0/3125555850 >> v1:172.21.15.122:6789/0 conn(0x7f1f1c06c6d0 legacy=0x7f1f1c06a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:54.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.143+0000 7f1f21111640 1 -- 172.21.15.77:0/3125555850 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f1c0b25f0 con 0x7f1f1c06c240 2023-11-04T01:45:54.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.144+0000 7f1f21111640 1 --2- 172.21.15.77:0/3125555850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f1c06c240 0x7f1f1c0b0d30 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c0b1b80 tx=0x7f1f0c02ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2b87137eb673ec server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:54.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.144+0000 7f1f20910640 1 -- 172.21.15.77:0/3125555850 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c02f850 con 0x7f1f1c06c240 2023-11-04T01:45:54.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.144+0000 7f1f20910640 1 -- 172.21.15.77:0/3125555850 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f0c02f9b0 con 0x7f1f1c06c240 2023-11-04T01:45:54.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.144+0000 7f1f20910640 1 -- 172.21.15.77:0/3125555850 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c02fd40 con 0x7f1f1c06c240 2023-11-04T01:45:54.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.144+0000 7f1f23b76640 1 -- 172.21.15.77:0/3125555850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f1c06c240 msgr2=0x7f1f1c0b0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:54.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.144+0000 7f1f23b76640 1 --2- 172.21.15.77:0/3125555850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f1c06c240 0x7f1f1c0b0d30 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c0b1b80 tx=0x7f1f0c02ba30 comp rx=0 tx=0).stop 2023-11-04T01:45:54.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.144+0000 7f1f23b76640 1 -- 172.21.15.77:0/3125555850 shutdown_connections 2023-11-04T01:45:54.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.144+0000 7f1f23b76640 1 --2- 172.21.15.77:0/3125555850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f1c06c240 0x7f1f1c0b0d30 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:54.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.144+0000 7f1f23b76640 1 --2- 172.21.15.77:0/3125555850 >> v2:172.21.15.122:3300/0 conn(0x7f1f1c15d1b0 0x7f1f1c0b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:54.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.144+0000 7f1f23b76640 1 -- 172.21.15.77:0/3125555850 >> 172.21.15.77:0/3125555850 conn(0x7f1f1c0cbd30 msgr2=0x7f1f1c0cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:54.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.145+0000 7f1f23b76640 1 -- 172.21.15.77:0/3125555850 shutdown_connections 2023-11-04T01:45:54.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.145+0000 7f1f23b76640 1 -- 172.21.15.77:0/3125555850 wait complete. 2023-11-04T01:45:54.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.146+0000 7f1f23b76640 1 Processor -- start 2023-11-04T01:45:54.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.146+0000 7f1f23b76640 1 -- start start 2023-11-04T01:45:54.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.146+0000 7f1f23b76640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1f1c06c240 0x7f1f1c0707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:54.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.146+0000 7f1f23b76640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f1c06c6d0 0x7f1f1c070ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:54.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.146+0000 7f1f23b76640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f1c15d1b0 0x7f1f1c0c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:54.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.146+0000 7f1f23b76640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1c0c58c0 con 0x7f1f1c15d1b0 2023-11-04T01:45:54.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.146+0000 7f1f23b76640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1c0c6380 con 0x7f1f1c06c6d0 2023-11-04T01:45:54.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.146+0000 7f1f23b76640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1c0c6f00 con 0x7f1f1c06c240 2023-11-04T01:45:54.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.146+0000 7f1f22113640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f1c15d1b0 0x7f1f1c0c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:54.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.147+0000 7f1f22113640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f1c15d1b0 0x7f1f1c0c81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38602/0 (socket says 172.21.15.77:38602) 2023-11-04T01:45:54.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.147+0000 7f1f22113640 1 -- 172.21.15.77:0/3744655532 learned_addr learned my addr 172.21.15.77:0/3744655532 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:54.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.147+0000 7f1f22113640 1 -- 172.21.15.77:0/3744655532 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1f1c06c240 msgr2=0x7f1f1c0707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:54.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.147+0000 7f1f21912640 1 --2- 172.21.15.77:0/3744655532 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1f1c06c240 0x7f1f1c0707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:54.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.147+0000 7f1f22113640 1 --2- 172.21.15.77:0/3744655532 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1f1c06c240 0x7f1f1c0707a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:54.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.147+0000 7f1f22113640 1 -- 172.21.15.77:0/3744655532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f1c06c6d0 msgr2=0x7f1f1c070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:54.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.147+0000 7f1f21111640 1 --2- 172.21.15.77:0/3744655532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f1c06c6d0 0x7f1f1c070ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:54.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.147+0000 7f1f22113640 1 --2- 172.21.15.77:0/3744655532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f1c06c6d0 0x7f1f1c070ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:54.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.147+0000 7f1f22113640 1 -- 172.21.15.77:0/3744655532 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f0c0094d0 con 0x7f1f1c15d1b0 2023-11-04T01:45:54.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.147+0000 7f1f22113640 1 --2- 172.21.15.77:0/3744655532 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f1c15d1b0 0x7f1f1c0c81d0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f1f1400c7a0 tx=0x7f1f1400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:54.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.147+0000 7f1f127fc640 1 -- 172.21.15.77:0/3744655532 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f14003b70 con 0x7f1f1c15d1b0 2023-11-04T01:45:54.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.147+0000 7f1f127fc640 1 -- 172.21.15.77:0/3744655532 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f14003cf0 con 0x7f1f1c15d1b0 2023-11-04T01:45:54.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.147+0000 7f1f23b76640 1 -- 172.21.15.77:0/3744655532 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f1c0c7390 con 0x7f1f1c15d1b0 2023-11-04T01:45:54.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.147+0000 7f1f127fc640 1 -- 172.21.15.77:0/3744655532 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1400aa90 con 0x7f1f1c15d1b0 2023-11-04T01:45:54.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.147+0000 7f1f23b76640 1 -- 172.21.15.77:0/3744655532 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f1c0c68b0 con 0x7f1f1c15d1b0 2023-11-04T01:45:54.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.148+0000 7f1f23b76640 1 -- 172.21.15.77:0/3744655532 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f1c066600 con 0x7f1f1c15d1b0 2023-11-04T01:45:54.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.148+0000 7f1f127fc640 1 -- 172.21.15.77:0/3744655532 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1f1400abf0 con 0x7f1f1c15d1b0 2023-11-04T01:45:54.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.149+0000 7f1f127fc640 1 --2- 172.21.15.77:0/3744655532 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1f0006ae70 0x7f1f0006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:54.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.149+0000 7f1f127fc640 1 -- 172.21.15.77:0/3744655532 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7566+0+0 (secure 0 0 0) 0x7f1f14089c00 con 0x7f1f1c15d1b0 2023-11-04T01:45:54.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.149+0000 7f1f21912640 1 --2- 172.21.15.77:0/3744655532 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1f0006ae70 0x7f1f0006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:54.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.150+0000 7f1f21912640 1 --2- 172.21.15.77:0/3744655532 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1f0006ae70 0x7f1f0006d330 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c0c5210 tx=0x7f1f18008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:54.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.153+0000 7f1f127fc640 1 -- 172.21.15.77:0/3744655532 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1f14090080 con 0x7f1f1c15d1b0 2023-11-04T01:45:54.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.356+0000 7f1f23b76640 1 -- 172.21.15.77:0/3744655532 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f1c0c7070 con 0x7f1f1c15d1b0 2023-11-04T01:45:54.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.357+0000 7f1f127fc640 1 -- 172.21.15.77:0/3744655532 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4986 (secure 0 0 0) 0x7f1f14003e60 con 0x7f1f1c15d1b0 2023-11-04T01:45:54.359 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:54.359 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":83,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7977,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/3276812155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3276812155},{"type":"v1","addr":"172.21.15.77:6834","nonce":3276812155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:45:50.607898+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6640,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6640":{"gid":6640,"name":"b","rank":0,"incarnation":76,"state":"up:active","state_seq":11,"addr":"172.21.15.122:6836/1345816612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1345816612},{"type":"v1","addr":"172.21.15.122:6836","nonce":1345816612}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:45:50.607898+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:54.360 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 83 2023-11-04T01:45:54.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.359+0000 7f1f23b76640 1 -- 172.21.15.77:0/3744655532 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1f0006ae70 msgr2=0x7f1f0006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:54.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.359+0000 7f1f23b76640 1 --2- 172.21.15.77:0/3744655532 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1f0006ae70 0x7f1f0006d330 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c0c5210 tx=0x7f1f18008040 comp rx=0 tx=0).stop 2023-11-04T01:45:54.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.359+0000 7f1f23b76640 1 -- 172.21.15.77:0/3744655532 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f1c15d1b0 msgr2=0x7f1f1c0c81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:54.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.359+0000 7f1f23b76640 1 --2- 172.21.15.77:0/3744655532 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f1c15d1b0 0x7f1f1c0c81d0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f1f1400c7a0 tx=0x7f1f1400cc60 comp rx=0 tx=0).stop 2023-11-04T01:45:54.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.359+0000 7f1f23b76640 1 -- 172.21.15.77:0/3744655532 shutdown_connections 2023-11-04T01:45:54.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.359+0000 7f1f23b76640 1 --2- 172.21.15.77:0/3744655532 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1f0006ae70 0x7f1f0006d330 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:54.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.359+0000 7f1f23b76640 1 --2- 172.21.15.77:0/3744655532 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f1c15d1b0 0x7f1f1c0c81d0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:54.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.359+0000 7f1f23b76640 1 --2- 172.21.15.77:0/3744655532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1f1c06c6d0 0x7f1f1c070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:54.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.359+0000 7f1f23b76640 1 --2- 172.21.15.77:0/3744655532 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1f1c06c240 0x7f1f1c0707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:54.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.359+0000 7f1f23b76640 1 -- 172.21.15.77:0/3744655532 >> 172.21.15.77:0/3744655532 conn(0x7f1f1c0cbd30 msgr2=0x7f1f1c0ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:54.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.359+0000 7f1f23b76640 1 -- 172.21.15.77:0/3744655532 shutdown_connections 2023-11-04T01:45:54.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.359+0000 7f1f23b76640 1 -- 172.21.15.77:0/3744655532 wait complete. 2023-11-04T01:45:54.371 INFO:tasks.ceph.mds.c:Sent signal 9 2023-11-04T01:45:54.372 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:45:54.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:54.372 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 down 2023-11-04T01:45:54.400 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:45:54.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.541+0000 7f1e66f89640 1 Processor -- start 2023-11-04T01:45:54.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.541+0000 7f1e66f89640 1 -- start start 2023-11-04T01:45:54.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.541+0000 7f1e66f89640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1e6015d100 0x7f1e600ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:54.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.541+0000 7f1e66f89640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1e6015d4e0 0x7f1e600d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:54.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.541+0000 7f1e66f89640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e600b32b0 con 0x7f1e600d3b60 2023-11-04T01:45:54.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.541+0000 7f1e66f89640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e600cee10 con 0x7f1e6015d4e0 2023-11-04T01:45:54.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.541+0000 7f1e66f89640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e600b4750 con 0x7f1e6015d100 2023-11-04T01:45:54.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.541+0000 7f1e5ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1e6015d4e0 0x7f1e600d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:54.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.541+0000 7f1e65526640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f1e600d3b60 0x7f1e600cf520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:34530/0 (socket says 172.21.15.77:34530) 2023-11-04T01:45:54.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.541+0000 7f1e65526640 1 -- 172.21.15.77:0/2461699169 learned_addr learned my addr 172.21.15.77:0/2461699169 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:45:54.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.542+0000 7f1e5ffff640 1 -- 172.21.15.77:0/2461699169 >> v2:172.21.15.122:3300/0 conn(0x7f1e6015d100 msgr2=0x7f1e600ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:54.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.542+0000 7f1e64d25640 1 --2- 172.21.15.77:0/2461699169 >> v2:172.21.15.122:3300/0 conn(0x7f1e6015d100 0x7f1e600ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:54.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.542+0000 7f1e5ffff640 1 --2- 172.21.15.77:0/2461699169 >> v2:172.21.15.122:3300/0 conn(0x7f1e6015d100 0x7f1e600ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:54.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.542+0000 7f1e5ffff640 1 -- 172.21.15.77:0/2461699169 >> v1:172.21.15.77:6789/0 conn(0x7f1e600d3b60 legacy=0x7f1e600cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:54.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.542+0000 7f1e5ffff640 1 -- 172.21.15.77:0/2461699169 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e600b2980 con 0x7f1e6015d4e0 2023-11-04T01:45:54.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.542+0000 7f1e5f7fe640 1 -- 172.21.15.77:0/2461699169 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1451537238 0 0) 0x7f1e600b32b0 con 0x7f1e600d3b60 2023-11-04T01:45:54.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.543+0000 7f1e5ffff640 1 --2- 172.21.15.77:0/2461699169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e6015d4e0 0x7f1e600d14d0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f1e600d09f0 tx=0x7f1e4802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=652b90548974a5f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:54.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.543+0000 7f1e5f7fe640 1 -- 172.21.15.77:0/2461699169 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e48031830 con 0x7f1e6015d4e0 2023-11-04T01:45:54.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.543+0000 7f1e5f7fe640 1 -- 172.21.15.77:0/2461699169 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e48031990 con 0x7f1e6015d4e0 2023-11-04T01:45:54.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.543+0000 7f1e5f7fe640 1 -- 172.21.15.77:0/2461699169 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e48031d20 con 0x7f1e6015d4e0 2023-11-04T01:45:54.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.543+0000 7f1e66f89640 1 -- 172.21.15.77:0/2461699169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e6015d4e0 msgr2=0x7f1e600d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:54.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.543+0000 7f1e66f89640 1 --2- 172.21.15.77:0/2461699169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e6015d4e0 0x7f1e600d14d0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f1e600d09f0 tx=0x7f1e4802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:45:54.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.543+0000 7f1e66f89640 1 -- 172.21.15.77:0/2461699169 shutdown_connections 2023-11-04T01:45:54.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.543+0000 7f1e66f89640 1 --2- 172.21.15.77:0/2461699169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e6015d4e0 0x7f1e600d14d0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:54.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.543+0000 7f1e66f89640 1 --2- 172.21.15.77:0/2461699169 >> v2:172.21.15.122:3300/0 conn(0x7f1e6015d100 0x7f1e600ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:54.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.543+0000 7f1e66f89640 1 -- 172.21.15.77:0/2461699169 >> 172.21.15.77:0/2461699169 conn(0x7f1e600d2ef0 msgr2=0x7f1e600d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:54.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.543+0000 7f1e66f89640 1 -- 172.21.15.77:0/2461699169 shutdown_connections 2023-11-04T01:45:54.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.543+0000 7f1e66f89640 1 -- 172.21.15.77:0/2461699169 wait complete. 2023-11-04T01:45:54.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.544+0000 7f1e66f89640 1 Processor -- start 2023-11-04T01:45:54.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.544+0000 7f1e66f89640 1 -- start start 2023-11-04T01:45:54.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.545+0000 7f1e66f89640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e600d3b60 0x7f1e60151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:54.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.545+0000 7f1e66f89640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e6015d100 0x7f1e600cb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:54.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.545+0000 7f1e66f89640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1e6015d4e0 0x7f1e600b7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:54.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.545+0000 7f1e66f89640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e601519b0 con 0x7f1e6015d100 2023-11-04T01:45:54.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.545+0000 7f1e66f89640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e600cce10 con 0x7f1e600d3b60 2023-11-04T01:45:54.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.545+0000 7f1e66f89640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e600cb5a0 con 0x7f1e6015d4e0 2023-11-04T01:45:54.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.545+0000 7f1e5ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e6015d100 0x7f1e600cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:54.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.545+0000 7f1e5ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e6015d100 0x7f1e600cb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38630/0 (socket says 172.21.15.77:38630) 2023-11-04T01:45:54.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.545+0000 7f1e5ffff640 1 -- 172.21.15.77:0/1443595820 learned_addr learned my addr 172.21.15.77:0/1443595820 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:54.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.546+0000 7f1e5ffff640 1 -- 172.21.15.77:0/1443595820 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1e6015d4e0 msgr2=0x7f1e600b7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:54.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.546+0000 7f1e5ffff640 1 --2- 172.21.15.77:0/1443595820 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1e6015d4e0 0x7f1e600b7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:54.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.546+0000 7f1e64d25640 1 --2- 172.21.15.77:0/1443595820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e600d3b60 0x7f1e60151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:54.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.546+0000 7f1e5ffff640 1 -- 172.21.15.77:0/1443595820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e600d3b60 msgr2=0x7f1e60151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:54.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.546+0000 7f1e5ffff640 1 --2- 172.21.15.77:0/1443595820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e600d3b60 0x7f1e60151470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:54.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.546+0000 7f1e5ffff640 1 -- 172.21.15.77:0/1443595820 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e48009400 con 0x7f1e6015d100 2023-11-04T01:45:54.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.546+0000 7f1e5ffff640 1 --2- 172.21.15.77:0/1443595820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e6015d100 0x7f1e600cb060 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f1e48009890 tx=0x7f1e480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:54.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.546+0000 7f1e5d7fa640 1 -- 172.21.15.77:0/1443595820 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4803ba70 con 0x7f1e6015d100 2023-11-04T01:45:54.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.546+0000 7f1e5d7fa640 1 -- 172.21.15.77:0/1443595820 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4803bbd0 con 0x7f1e6015d100 2023-11-04T01:45:54.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.546+0000 7f1e66f89640 1 -- 172.21.15.77:0/1443595820 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e600c9fc0 con 0x7f1e6015d100 2023-11-04T01:45:54.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.546+0000 7f1e5d7fa640 1 -- 172.21.15.77:0/1443595820 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e480453f0 con 0x7f1e6015d100 2023-11-04T01:45:54.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.546+0000 7f1e66f89640 1 -- 172.21.15.77:0/1443595820 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e600ca580 con 0x7f1e6015d100 2023-11-04T01:45:54.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.547+0000 7f1e66f89640 1 -- 172.21.15.77:0/1443595820 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e600684b0 con 0x7f1e6015d100 2023-11-04T01:45:54.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.547+0000 7f1e5d7fa640 1 -- 172.21.15.77:0/1443595820 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1e48045550 con 0x7f1e6015d100 2023-11-04T01:45:54.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.548+0000 7f1e5d7fa640 1 --2- 172.21.15.77:0/1443595820 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1e4006ae70 0x7f1e4006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:54.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.548+0000 7f1e5d7fa640 1 -- 172.21.15.77:0/1443595820 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7566+0+0 (secure 0 0 0) 0x7f1e480ac0a0 con 0x7f1e6015d100 2023-11-04T01:45:54.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.548+0000 7f1e64d25640 1 --2- 172.21.15.77:0/1443595820 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1e4006ae70 0x7f1e4006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:54.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.548+0000 7f1e64d25640 1 --2- 172.21.15.77:0/1443595820 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1e4006ae70 0x7f1e4006d330 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f1e600b8a70 tx=0x7f1e58008410 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:54.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.552+0000 7f1e5d7fa640 1 -- 172.21.15.77:0/1443595820 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1e48076b30 con 0x7f1e6015d100 2023-11-04T01:45:54.572 INFO:tasks.ceph.mds.c.smithi077.stderr:daemon-helper: command crashed with signal 9 2023-11-04T01:45:54.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.788+0000 7f1e66f89640 1 -- 172.21.15.77:0/1443595820 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7f1e600d2cd0 con 0x7f1e6015d100 2023-11-04T01:45:54.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.790+0000 7f1e5d7fa640 1 -- 172.21.15.77:0/1443595820 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 6640 v84) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1e48035090 con 0x7f1e6015d100 2023-11-04T01:45:54.791 INFO:teuthology.orchestra.run.smithi077.stderr:failed mds gid 6640 2023-11-04T01:45:54.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.792+0000 7f1e66f89640 1 -- 172.21.15.77:0/1443595820 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1e4006ae70 msgr2=0x7f1e4006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:54.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.792+0000 7f1e66f89640 1 --2- 172.21.15.77:0/1443595820 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1e4006ae70 0x7f1e4006d330 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f1e600b8a70 tx=0x7f1e58008410 comp rx=0 tx=0).stop 2023-11-04T01:45:54.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.792+0000 7f1e66f89640 1 -- 172.21.15.77:0/1443595820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e6015d100 msgr2=0x7f1e600cb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:54.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.792+0000 7f1e66f89640 1 --2- 172.21.15.77:0/1443595820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e6015d100 0x7f1e600cb060 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f1e48009890 tx=0x7f1e480046c0 comp rx=0 tx=0).stop 2023-11-04T01:45:54.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.792+0000 7f1e66f89640 1 -- 172.21.15.77:0/1443595820 shutdown_connections 2023-11-04T01:45:54.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.792+0000 7f1e66f89640 1 --2- 172.21.15.77:0/1443595820 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1e4006ae70 0x7f1e4006d330 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:54.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.792+0000 7f1e66f89640 1 --2- 172.21.15.77:0/1443595820 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1e6015d4e0 0x7f1e600b7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:54.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.792+0000 7f1e66f89640 1 --2- 172.21.15.77:0/1443595820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e6015d100 0x7f1e600cb060 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:54.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.792+0000 7f1e66f89640 1 --2- 172.21.15.77:0/1443595820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e600d3b60 0x7f1e60151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:54.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.793+0000 7f1e66f89640 1 -- 172.21.15.77:0/1443595820 >> 172.21.15.77:0/1443595820 conn(0x7f1e600d2ef0 msgr2=0x7f1e600d14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:54.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.793+0000 7f1e66f89640 1 -- 172.21.15.77:0/1443595820 shutdown_connections 2023-11-04T01:45:54.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.793+0000 7f1e66f89640 1 -- 172.21.15.77:0/1443595820 wait complete. 2023-11-04T01:45:54.807 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:45:54.808 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:45:54.808 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:45:54.809 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:45:54.809 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:45:54.810 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi122 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b' 2023-11-04T01:45:54.810 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:45:54.810 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:45:54.813 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:45:54.814 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:54.893 INFO:tasks.ceph.mds.b.smithi122.stdout:starting mds.b at 2023-11-04T01:45:54.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.912+0000 7f605ef00640 1 Processor -- start 2023-11-04T01:45:54.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.912+0000 7f605ef00640 1 -- start start 2023-11-04T01:45:54.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.913+0000 7f605ef00640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f60580ade00 0x7f60580b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:54.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.913+0000 7f605ef00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f605806cc90 con 0x7f605806d9c0 2023-11-04T01:45:54.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.913+0000 7f605ef00640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60580b0e60 con 0x7f605806c5f0 2023-11-04T01:45:54.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.913+0000 7f605ef00640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f605806cee0 con 0x7f60580ade00 2023-11-04T01:45:54.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.913+0000 7f6057fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f605806d9c0 0x7f60580710d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:34542/0 (socket says 172.21.15.77:34542) 2023-11-04T01:45:54.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.913+0000 7f6057fff640 1 -- 172.21.15.77:0/3251777261 learned_addr learned my addr 172.21.15.77:0/3251777261 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:45:54.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.913+0000 7f60577fe640 1 -- 172.21.15.77:0/3251777261 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2636059309 0 0) 0x7f605806cc90 con 0x7f605806d9c0 2023-11-04T01:45:54.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.913+0000 7f60577fe640 1 -- 172.21.15.77:0/3251777261 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6048003520 con 0x7f605806d9c0 2023-11-04T01:45:54.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.913+0000 7f605cc9c640 1 --2- 172.21.15.77:0/3251777261 >> v2:172.21.15.122:3300/0 conn(0x7f60580ade00 0x7f60580b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:54.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.913+0000 7f60577fe640 1 -- 172.21.15.77:0/3251777261 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1991822691 0 0) 0x7f6048003520 con 0x7f605806d9c0 2023-11-04T01:45:54.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.913+0000 7f60577fe640 1 -- 172.21.15.77:0/3251777261 >> v2:172.21.15.122:3300/0 conn(0x7f60580ade00 msgr2=0x7f60580b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:54.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.913+0000 7f60577fe640 1 --2- 172.21.15.77:0/3251777261 >> v2:172.21.15.122:3300/0 conn(0x7f60580ade00 0x7f60580b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:54.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.913+0000 7f60577fe640 1 -- 172.21.15.77:0/3251777261 >> v1:172.21.15.122:6789/0 conn(0x7f605806c5f0 legacy=0x7f60580cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:54.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.913+0000 7f60577fe640 1 -- 172.21.15.77:0/3251777261 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605806d1c0 con 0x7f605806d9c0 2023-11-04T01:45:54.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.913+0000 7f60577fe640 1 -- 172.21.15.77:0/3251777261 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f6044001670 con 0x7f605806d9c0 2023-11-04T01:45:54.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.913+0000 7f60577fe640 1 -- 172.21.15.77:0/3251777261 >> v1:172.21.15.77:6789/0 conn(0x7f605806d9c0 legacy=0x7f60580710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:54.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.913+0000 7f60577fe640 1 --2- 172.21.15.77:0/3251777261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6048003970 0x7f6048003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:54.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.913+0000 7f60577fe640 1 --2- 172.21.15.77:0/3251777261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60480047c0 0x7f6048004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:54.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.913+0000 7f60577fe640 1 --2- 172.21.15.77:0/3251777261 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6048005380 0x7f604800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:54.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.913+0000 7f60577fe640 1 -- 172.21.15.77:0/3251777261 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605806cee0 con 0x7f6048003970 2023-11-04T01:45:54.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.913+0000 7f60577fe640 1 -- 172.21.15.77:0/3251777261 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604800c210 con 0x7f60480047c0 2023-11-04T01:45:54.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.913+0000 7f60577fe640 1 -- 172.21.15.77:0/3251777261 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f604800c3d0 con 0x7f6048005380 2023-11-04T01:45:54.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.913+0000 7f605cc9c640 1 --2- 172.21.15.77:0/3251777261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6048003970 0x7f6048003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:54.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.914+0000 7f6057fff640 1 --2- 172.21.15.77:0/3251777261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60480047c0 0x7f6048004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:54.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.914+0000 7f605d49d640 1 --2- 172.21.15.77:0/3251777261 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6048005380 0x7f604800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:54.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.914+0000 7f605cc9c640 1 -- 172.21.15.77:0/3251777261 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6048005380 msgr2=0x7f604800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:54.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.914+0000 7f605cc9c640 1 --2- 172.21.15.77:0/3251777261 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6048005380 0x7f604800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:54.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.914+0000 7f605cc9c640 1 -- 172.21.15.77:0/3251777261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60480047c0 msgr2=0x7f6048004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:54.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.914+0000 7f605cc9c640 1 --2- 172.21.15.77:0/3251777261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60480047c0 0x7f6048004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:54.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.914+0000 7f605cc9c640 1 -- 172.21.15.77:0/3251777261 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6048003520 con 0x7f6048003970 2023-11-04T01:45:54.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.914+0000 7f605d49d640 1 -- 172.21.15.77:0/3251777261 reap_dead start 2023-11-04T01:45:54.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.914+0000 7f605cc9c640 1 --2- 172.21.15.77:0/3251777261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6048003970 0x7f6048003d90 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f604c00ba30 tx=0x7f60480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4376ad3d3b83a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:54.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.915+0000 7f60577fe640 1 -- 172.21.15.77:0/3251777261 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c032640 con 0x7f6048003970 2023-11-04T01:45:54.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.915+0000 7f60577fe640 1 -- 172.21.15.77:0/3251777261 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604c0327a0 con 0x7f6048003970 2023-11-04T01:45:54.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.915+0000 7f60577fe640 1 -- 172.21.15.77:0/3251777261 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c032b30 con 0x7f6048003970 2023-11-04T01:45:54.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.915+0000 7f605ef00640 1 -- 172.21.15.77:0/3251777261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6048003970 msgr2=0x7f6048003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:54.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.915+0000 7f605ef00640 1 --2- 172.21.15.77:0/3251777261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6048003970 0x7f6048003d90 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f604c00ba30 tx=0x7f60480057f0 comp rx=0 tx=0).stop 2023-11-04T01:45:54.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.915+0000 7f605ef00640 1 -- 172.21.15.77:0/3251777261 shutdown_connections 2023-11-04T01:45:54.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.915+0000 7f605ef00640 1 --2- 172.21.15.77:0/3251777261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6048003970 0x7f6048003d90 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:54.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.915+0000 7f605ef00640 1 -- 172.21.15.77:0/3251777261 >> 172.21.15.77:0/3251777261 conn(0x7f60580cb530 msgr2=0x7f60580cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:54.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.915+0000 7f605ef00640 1 -- 172.21.15.77:0/3251777261 shutdown_connections 2023-11-04T01:45:54.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.915+0000 7f605ef00640 1 -- 172.21.15.77:0/3251777261 wait complete. 2023-11-04T01:45:54.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.916+0000 7f605ef00640 1 Processor -- start 2023-11-04T01:45:54.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.916+0000 7f605ef00640 1 -- start start 2023-11-04T01:45:54.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.917+0000 7f605ef00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6048003970 0x7f60581576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:54.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.917+0000 7f605ef00640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f60580c8720 0x7f60581efec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:54.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.917+0000 7f605ef00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60581548c0 0x7f6058154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:54.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.917+0000 7f605ef00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6058155260 con 0x7f60581548c0 2023-11-04T01:45:54.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.917+0000 7f605ef00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60580c3610 con 0x7f6048003970 2023-11-04T01:45:54.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.917+0000 7f605ef00640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6058157c30 con 0x7f60580c8720 2023-11-04T01:45:54.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.917+0000 7f605d49d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60581548c0 0x7f6058154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:54.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.917+0000 7f605d49d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60581548c0 0x7f6058154d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38658/0 (socket says 172.21.15.77:38658) 2023-11-04T01:45:54.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.917+0000 7f605d49d640 1 -- 172.21.15.77:0/3635108092 learned_addr learned my addr 172.21.15.77:0/3635108092 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:45:54.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.917+0000 7f605d49d640 1 -- 172.21.15.77:0/3635108092 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f60580c8720 msgr2=0x7f60581efec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:54.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.917+0000 7f605d49d640 1 --2- 172.21.15.77:0/3635108092 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f60580c8720 0x7f60581efec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:54.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.917+0000 7f605d49d640 1 -- 172.21.15.77:0/3635108092 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6048003970 msgr2=0x7f60581576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:54.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.917+0000 7f605cc9c640 1 --2- 172.21.15.77:0/3635108092 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6048003970 0x7f60581576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:54.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.918+0000 7f605d49d640 1 --2- 172.21.15.77:0/3635108092 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6048003970 0x7f60581576f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:54.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.918+0000 7f605d49d640 1 -- 172.21.15.77:0/3635108092 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60581f0400 con 0x7f60581548c0 2023-11-04T01:45:54.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.918+0000 7f605d49d640 1 --2- 172.21.15.77:0/3635108092 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60581548c0 0x7f6058154d20 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f6050007fd0 tx=0x7f605000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:54.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.918+0000 7f60557fa640 1 -- 172.21.15.77:0/3635108092 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6050003970 con 0x7f60581548c0 2023-11-04T01:45:54.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.918+0000 7f60557fa640 1 -- 172.21.15.77:0/3635108092 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6050003af0 con 0x7f60581548c0 2023-11-04T01:45:54.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.918+0000 7f605ef00640 1 -- 172.21.15.77:0/3635108092 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60580c6710 con 0x7f60581548c0 2023-11-04T01:45:54.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.918+0000 7f60557fa640 1 -- 172.21.15.77:0/3635108092 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6050003ea0 con 0x7f60581548c0 2023-11-04T01:45:54.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.918+0000 7f605ef00640 1 -- 172.21.15.77:0/3635108092 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60580c3860 con 0x7f60581548c0 2023-11-04T01:45:54.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.919+0000 7f605ef00640 1 -- 172.21.15.77:0/3635108092 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60580684b0 con 0x7f60581548c0 2023-11-04T01:45:54.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.919+0000 7f60557fa640 1 -- 172.21.15.77:0/3635108092 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f60500050d0 con 0x7f60581548c0 2023-11-04T01:45:54.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.919+0000 7f60557fa640 1 --2- 172.21.15.77:0/3635108092 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f603c06ae70 0x7f603c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:54.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.920+0000 7f60557fa640 1 -- 172.21.15.77:0/3635108092 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7608+0+0 (secure 0 0 0) 0x7f6050089b00 con 0x7f60581548c0 2023-11-04T01:45:54.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.920+0000 7f605cc9c640 1 --2- 172.21.15.77:0/3635108092 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f603c06ae70 0x7f603c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:54.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.920+0000 7f605cc9c640 1 --2- 172.21.15.77:0/3635108092 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f603c06ae70 0x7f603c06d330 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f604c00ba00 tx=0x7f604c030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:54.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:54.924+0000 7f60557fa640 1 -- 172.21.15.77:0/3635108092 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f60500544d0 con 0x7f60581548c0 2023-11-04T01:45:55.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:55.122+0000 7f605ef00640 1 -- 172.21.15.77:0/3635108092 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60580cddc0 con 0x7f60581548c0 2023-11-04T01:45:55.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:55.123+0000 7f60557fa640 1 -- 172.21.15.77:0/3635108092 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4143 (secure 0 0 0) 0x7f6050057af0 con 0x7f60581548c0 2023-11-04T01:45:55.125 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:45:55.125 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":85,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:45:54.794128+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":105,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7977,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7977":{"gid":7977,"name":"a","rank":0,"incarnation":85,"state":"up:replay","state_seq":1,"addr":"172.21.15.77:6834/3276812155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3276812155},{"type":"v1","addr":"172.21.15.77:6834","nonce":3276812155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:55.126 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 85 2023-11-04T01:45:55.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:55.125+0000 7f605ef00640 1 -- 172.21.15.77:0/3635108092 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f603c06ae70 msgr2=0x7f603c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:55.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:55.125+0000 7f605ef00640 1 --2- 172.21.15.77:0/3635108092 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f603c06ae70 0x7f603c06d330 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f604c00ba00 tx=0x7f604c030000 comp rx=0 tx=0).stop 2023-11-04T01:45:55.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:55.125+0000 7f605ef00640 1 -- 172.21.15.77:0/3635108092 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60581548c0 msgr2=0x7f6058154d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:55.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:55.125+0000 7f605ef00640 1 --2- 172.21.15.77:0/3635108092 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60581548c0 0x7f6058154d20 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f6050007fd0 tx=0x7f605000eb90 comp rx=0 tx=0).stop 2023-11-04T01:45:55.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:55.125+0000 7f605ef00640 1 -- 172.21.15.77:0/3635108092 shutdown_connections 2023-11-04T01:45:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:55.125+0000 7f605ef00640 1 --2- 172.21.15.77:0/3635108092 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f603c06ae70 0x7f603c06d330 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:55.125+0000 7f605ef00640 1 --2- 172.21.15.77:0/3635108092 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60581548c0 0x7f6058154d20 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:55.125+0000 7f605ef00640 1 --2- 172.21.15.77:0/3635108092 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f60580c8720 0x7f60581efec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:55.125+0000 7f605ef00640 1 --2- 172.21.15.77:0/3635108092 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6048003970 0x7f60581576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:55.125+0000 7f605ef00640 1 -- 172.21.15.77:0/3635108092 >> 172.21.15.77:0/3635108092 conn(0x7f60580cb530 msgr2=0x7f60580b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:55.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:55.125+0000 7f605ef00640 1 -- 172.21.15.77:0/3635108092 shutdown_connections 2023-11-04T01:45:55.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:45:55.125+0000 7f605ef00640 1 -- 172.21.15.77:0/3635108092 wait complete. 2023-11-04T01:45:55.137 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:45:59.737 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-11-04T01:45:59.737 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-11-04T01:46:00.138 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:00.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.248+0000 7f5929844640 1 Processor -- start 2023-11-04T01:46:00.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.248+0000 7f5929844640 1 -- start start 2023-11-04T01:46:00.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.249+0000 7f5929844640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f592415d1b0 0x7f59240d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:00.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.249+0000 7f5929844640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f592415d590 con 0x7f59240b5050 2023-11-04T01:46:00.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.249+0000 7f5929844640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59240d1a50 con 0x7f59240d14d0 2023-11-04T01:46:00.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.249+0000 7f5929844640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59240ce6c0 con 0x7f592415d1b0 2023-11-04T01:46:00.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.249+0000 7f59237fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f59240b5050 0x7f59240b5ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35790/0 (socket says 172.21.15.77:35790) 2023-11-04T01:46:00.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.249+0000 7f59237fe640 1 -- 172.21.15.77:0/3947737392 learned_addr learned my addr 172.21.15.77:0/3947737392 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:46:00.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.249+0000 7f5922ffd640 1 --2- 172.21.15.77:0/3947737392 >> v2:172.21.15.122:3300/0 conn(0x7f592415d1b0 0x7f59240d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:00.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.249+0000 7f59227fc640 1 -- 172.21.15.77:0/3947737392 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1833680429 0 0) 0x7f591c001490 con 0x7f59240b5050 2023-11-04T01:46:00.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.249+0000 7f59227fc640 1 -- 172.21.15.77:0/3947737392 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5910003520 con 0x7f59240b5050 2023-11-04T01:46:00.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.250+0000 7f59227fc640 1 -- 172.21.15.77:0/3947737392 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 103369341 0 0) 0x7f59240d1a50 con 0x7f59240d14d0 2023-11-04T01:46:00.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.250+0000 7f59227fc640 1 -- 172.21.15.77:0/3947737392 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f591c001490 con 0x7f59240d14d0 2023-11-04T01:46:00.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.250+0000 7f59227fc640 1 -- 172.21.15.77:0/3947737392 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1492074078 0 0) 0x7f5910003520 con 0x7f59240b5050 2023-11-04T01:46:00.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.250+0000 7f59227fc640 1 -- 172.21.15.77:0/3947737392 >> v2:172.21.15.122:3300/0 conn(0x7f592415d1b0 msgr2=0x7f59240d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:00.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.250+0000 7f59227fc640 1 --2- 172.21.15.77:0/3947737392 >> v2:172.21.15.122:3300/0 conn(0x7f592415d1b0 0x7f59240d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:00.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.250+0000 7f59227fc640 1 -- 172.21.15.77:0/3947737392 >> v1:172.21.15.122:6789/0 conn(0x7f59240d14d0 legacy=0x7f59240b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:00.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.250+0000 7f59227fc640 1 -- 172.21.15.77:0/3947737392 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59240d1d30 con 0x7f59240b5050 2023-11-04T01:46:00.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.250+0000 7f59227fc640 1 -- 172.21.15.77:0/3947737392 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f591c001b80 con 0x7f59240b5050 2023-11-04T01:46:00.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.250+0000 7f59227fc640 1 -- 172.21.15.77:0/3947737392 >> v1:172.21.15.77:6789/0 conn(0x7f59240b5050 legacy=0x7f59240b5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:00.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.250+0000 7f59227fc640 1 --2- 172.21.15.77:0/3947737392 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5910003b00 0x7f5910003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:00.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.250+0000 7f59227fc640 1 --2- 172.21.15.77:0/3947737392 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f59100047c0 0x7f5910004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:00.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.250+0000 7f59227fc640 1 --2- 172.21.15.77:0/3947737392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5910005180 0x7f591000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:00.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.250+0000 7f59227fc640 1 -- 172.21.15.77:0/3947737392 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59240ce6c0 con 0x7f5910005180 2023-11-04T01:46:00.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.250+0000 7f59227fc640 1 -- 172.21.15.77:0/3947737392 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591000c000 con 0x7f5910003b00 2023-11-04T01:46:00.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.250+0000 7f59227fc640 1 -- 172.21.15.77:0/3947737392 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f591000c1c0 con 0x7f59100047c0 2023-11-04T01:46:00.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.250+0000 7f59237fe640 1 --2- 172.21.15.77:0/3947737392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5910005180 0x7f591000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:00.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.250+0000 7f5922ffd640 1 --2- 172.21.15.77:0/3947737392 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5910003b00 0x7f5910003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:00.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.250+0000 7f591bfff640 1 --2- 172.21.15.77:0/3947737392 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f59100047c0 0x7f5910004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:00.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.250+0000 7f59237fe640 1 -- 172.21.15.77:0/3947737392 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f59100047c0 msgr2=0x7f5910004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:00.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.250+0000 7f59237fe640 1 --2- 172.21.15.77:0/3947737392 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f59100047c0 0x7f5910004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:00.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.250+0000 7f59237fe640 1 -- 172.21.15.77:0/3947737392 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5910003b00 msgr2=0x7f5910003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:00.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.250+0000 7f59237fe640 1 --2- 172.21.15.77:0/3947737392 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5910003b00 0x7f5910003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:00.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.250+0000 7f59237fe640 1 -- 172.21.15.77:0/3947737392 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5910003520 con 0x7f5910005180 2023-11-04T01:46:00.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.250+0000 7f591bfff640 1 --2- 172.21.15.77:0/3947737392 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f59100047c0 0x7f5910004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:00.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.251+0000 7f59237fe640 1 -- 172.21.15.77:0/3947737392 reap_dead start 2023-11-04T01:46:00.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.251+0000 7f59237fe640 1 --2- 172.21.15.77:0/3947737392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5910005180 0x7f591000b980 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f59240c9f40 tx=0x7f59100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd0546c5d6c09650 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:00.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.251+0000 7f59227fc640 1 -- 172.21.15.77:0/3947737392 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c034630 con 0x7f5910005180 2023-11-04T01:46:00.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.251+0000 7f59227fc640 1 -- 172.21.15.77:0/3947737392 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591c02f070 con 0x7f5910005180 2023-11-04T01:46:00.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.251+0000 7f59227fc640 1 -- 172.21.15.77:0/3947737392 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c0349f0 con 0x7f5910005180 2023-11-04T01:46:00.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.252+0000 7f5929844640 1 -- 172.21.15.77:0/3947737392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5910005180 msgr2=0x7f591000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:00.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.252+0000 7f5929844640 1 --2- 172.21.15.77:0/3947737392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5910005180 0x7f591000b980 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f59240c9f40 tx=0x7f59100057f0 comp rx=0 tx=0).stop 2023-11-04T01:46:00.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.252+0000 7f5929844640 1 -- 172.21.15.77:0/3947737392 shutdown_connections 2023-11-04T01:46:00.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.252+0000 7f5929844640 1 --2- 172.21.15.77:0/3947737392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5910005180 0x7f591000b980 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:00.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.252+0000 7f5929844640 1 -- 172.21.15.77:0/3947737392 >> 172.21.15.77:0/3947737392 conn(0x7f59240cf940 msgr2=0x7f59240cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:00.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.252+0000 7f5929844640 1 -- 172.21.15.77:0/3947737392 shutdown_connections 2023-11-04T01:46:00.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.252+0000 7f5929844640 1 -- 172.21.15.77:0/3947737392 wait complete. 2023-11-04T01:46:00.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.253+0000 7f5929844640 1 Processor -- start 2023-11-04T01:46:00.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.253+0000 7f5929844640 1 -- start start 2023-11-04T01:46:00.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.254+0000 7f5929844640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5910005180 0x7f59241f2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:00.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.254+0000 7f5929844640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f59241f3550 0x7f59240cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:00.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.254+0000 7f5929844640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59240d2af0 0x7f59240d2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:00.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.254+0000 7f5929844640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5924150be0 con 0x7f59240d2af0 2023-11-04T01:46:00.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.254+0000 7f5929844640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59240d34e0 con 0x7f59241f3550 2023-11-04T01:46:00.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.254+0000 7f5929844640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5924155710 con 0x7f5910005180 2023-11-04T01:46:00.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.254+0000 7f59237fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59240d2af0 0x7f59240d2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:00.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.254+0000 7f59237fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59240d2af0 0x7f59240d2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54338/0 (socket says 172.21.15.77:54338) 2023-11-04T01:46:00.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.254+0000 7f59237fe640 1 -- 172.21.15.77:0/2085968776 learned_addr learned my addr 172.21.15.77:0/2085968776 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:00.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.254+0000 7f591bfff640 1 --2- 172.21.15.77:0/2085968776 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f59241f3550 0x7f59240cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:00.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.254+0000 7f5922ffd640 1 --2- 172.21.15.77:0/2085968776 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5910005180 0x7f59241f2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:00.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.254+0000 7f59237fe640 1 -- 172.21.15.77:0/2085968776 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5910005180 msgr2=0x7f59241f2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:00.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.254+0000 7f59237fe640 1 --2- 172.21.15.77:0/2085968776 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5910005180 0x7f59241f2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:00.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.254+0000 7f59237fe640 1 -- 172.21.15.77:0/2085968776 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f59241f3550 msgr2=0x7f59240cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:00.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.254+0000 7f59237fe640 1 --2- 172.21.15.77:0/2085968776 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f59241f3550 0x7f59240cafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:00.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.254+0000 7f59237fe640 1 -- 172.21.15.77:0/2085968776 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59240cb830 con 0x7f59240d2af0 2023-11-04T01:46:00.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.254+0000 7f5922ffd640 1 --2- 172.21.15.77:0/2085968776 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5910005180 0x7f59241f2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:00.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.254+0000 7f591bfff640 1 --2- 172.21.15.77:0/2085968776 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f59241f3550 0x7f59240cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:00.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.254+0000 7f59237fe640 1 --2- 172.21.15.77:0/2085968776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59240d2af0 0x7f59240d2fa0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f591c002230 tx=0x7f591c001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:00.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.254+0000 7f5920ff9640 1 -- 172.21.15.77:0/2085968776 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c034430 con 0x7f59240d2af0 2023-11-04T01:46:00.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.254+0000 7f5920ff9640 1 -- 172.21.15.77:0/2085968776 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591c034590 con 0x7f59240d2af0 2023-11-04T01:46:00.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.254+0000 7f5929844640 1 -- 172.21.15.77:0/2085968776 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59240cbb10 con 0x7f59240d2af0 2023-11-04T01:46:00.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.254+0000 7f5920ff9640 1 -- 172.21.15.77:0/2085968776 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c034920 con 0x7f59240d2af0 2023-11-04T01:46:00.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.255+0000 7f5929844640 1 -- 172.21.15.77:0/2085968776 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59240cc0d0 con 0x7f59240d2af0 2023-11-04T01:46:00.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.256+0000 7f5929844640 1 -- 172.21.15.77:0/2085968776 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59241f3930 con 0x7f59240d2af0 2023-11-04T01:46:00.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.256+0000 7f5920ff9640 1 -- 172.21.15.77:0/2085968776 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f591c031030 con 0x7f59240d2af0 2023-11-04T01:46:00.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.256+0000 7f5920ff9640 1 --2- 172.21.15.77:0/2085968776 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f590406aea0 0x7f590406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:00.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.256+0000 7f5920ff9640 1 -- 172.21.15.77:0/2085968776 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7608+0+0 (secure 0 0 0) 0x7f591c0aada0 con 0x7f59240d2af0 2023-11-04T01:46:00.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.257+0000 7f5922ffd640 1 --2- 172.21.15.77:0/2085968776 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f590406aea0 0x7f590406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:00.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.257+0000 7f5922ffd640 1 --2- 172.21.15.77:0/2085968776 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f590406aea0 0x7f590406d360 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f59140093d0 tx=0x7f5914008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:00.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.261+0000 7f5920ff9640 1 -- 172.21.15.77:0/2085968776 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f59241f3930 con 0x7f59240d2af0 2023-11-04T01:46:00.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.461+0000 7f5929844640 1 -- 172.21.15.77:0/2085968776 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f592415d590 con 0x7f59240d2af0 2023-11-04T01:46:00.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.462+0000 7f5920ff9640 1 -- 172.21.15.77:0/2085968776 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f592415d590 con 0x7f59240d2af0 2023-11-04T01:46:00.464 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:46:00.464 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":86,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6814,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/1450731169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1450731169},{"type":"v1","addr":"172.21.15.122:6836","nonce":1450731169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:45:54.807399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":105,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7977,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7977":{"gid":7977,"name":"a","rank":0,"incarnation":85,"state":"up:resolve","state_seq":8,"addr":"172.21.15.77:6834/3276812155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3276812155},{"type":"v1","addr":"172.21.15.77:6834","nonce":3276812155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:00.464 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 86 2023-11-04T01:46:00.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.463+0000 7f5929844640 1 -- 172.21.15.77:0/2085968776 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f590406aea0 msgr2=0x7f590406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:00.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.463+0000 7f5929844640 1 --2- 172.21.15.77:0/2085968776 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f590406aea0 0x7f590406d360 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f59140093d0 tx=0x7f5914008040 comp rx=0 tx=0).stop 2023-11-04T01:46:00.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.463+0000 7f5929844640 1 -- 172.21.15.77:0/2085968776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59240d2af0 msgr2=0x7f59240d2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:00.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.463+0000 7f5929844640 1 --2- 172.21.15.77:0/2085968776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59240d2af0 0x7f59240d2fa0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f591c002230 tx=0x7f591c001e90 comp rx=0 tx=0).stop 2023-11-04T01:46:00.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.464+0000 7f5929844640 1 -- 172.21.15.77:0/2085968776 shutdown_connections 2023-11-04T01:46:00.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.464+0000 7f5929844640 1 --2- 172.21.15.77:0/2085968776 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f590406aea0 0x7f590406d360 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:00.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.464+0000 7f5929844640 1 --2- 172.21.15.77:0/2085968776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59240d2af0 0x7f59240d2fa0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:00.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.464+0000 7f5929844640 1 --2- 172.21.15.77:0/2085968776 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f59241f3550 0x7f59240cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:00.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.464+0000 7f5929844640 1 --2- 172.21.15.77:0/2085968776 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5910005180 0x7f59241f2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:00.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.464+0000 7f5929844640 1 -- 172.21.15.77:0/2085968776 >> 172.21.15.77:0/2085968776 conn(0x7f59240cf940 msgr2=0x7f59240b4930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:00.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.464+0000 7f5929844640 1 -- 172.21.15.77:0/2085968776 shutdown_connections 2023-11-04T01:46:00.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.464+0000 7f5929844640 1 -- 172.21.15.77:0/2085968776 wait complete. 2023-11-04T01:46:00.476 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:46:00.477 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:00.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.574+0000 7efe0e2d4640 1 Processor -- start 2023-11-04T01:46:00.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.574+0000 7efe0e2d4640 1 -- start start 2023-11-04T01:46:00.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.575+0000 7efe0e2d4640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7efe0806d9c0 0x7efe080710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:00.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.575+0000 7efe0e2d4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efe0806c5f0 0x7efe08071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:00.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.575+0000 7efe0e2d4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe0806cc90 con 0x7efe080ade00 2023-11-04T01:46:00.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.575+0000 7efe0e2d4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe080b0c40 con 0x7efe0806c5f0 2023-11-04T01:46:00.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.575+0000 7efe0e2d4640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe08071b50 con 0x7efe0806d9c0 2023-11-04T01:46:00.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.575+0000 7efe0c871640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efe0806c5f0 0x7efe08071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:00.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.575+0000 7efe07fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7efe080ade00 0x7efe080b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35792/0 (socket says 172.21.15.77:35792) 2023-11-04T01:46:00.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.575+0000 7efe07fff640 1 -- 172.21.15.77:0/1340326217 learned_addr learned my addr 172.21.15.77:0/1340326217 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:46:00.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.575+0000 7efe077fe640 1 --2- 172.21.15.77:0/1340326217 >> v2:172.21.15.122:3300/0 conn(0x7efe0806d9c0 0x7efe080710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:00.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.575+0000 7efe0c871640 1 -- 172.21.15.77:0/1340326217 >> v2:172.21.15.122:3300/0 conn(0x7efe0806d9c0 msgr2=0x7efe080710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:00.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.575+0000 7efe0c871640 1 --2- 172.21.15.77:0/1340326217 >> v2:172.21.15.122:3300/0 conn(0x7efe0806d9c0 0x7efe080710d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:00.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.575+0000 7efe0c871640 1 -- 172.21.15.77:0/1340326217 >> v1:172.21.15.77:6789/0 conn(0x7efe080ade00 legacy=0x7efe080b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:00.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.575+0000 7efe0c871640 1 -- 172.21.15.77:0/1340326217 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe080b0e60 con 0x7efe0806c5f0 2023-11-04T01:46:00.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.575+0000 7efe06ffd640 1 -- 172.21.15.77:0/1340326217 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1086975948 0 0) 0x7efe0806cc90 con 0x7efe080ade00 2023-11-04T01:46:00.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.576+0000 7efe0c871640 1 --2- 172.21.15.77:0/1340326217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe0806c5f0 0x7efe08071610 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7efe080c9080 tx=0x7efe0002bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5133a904e86dc456 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:00.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.576+0000 7efe06ffd640 1 -- 172.21.15.77:0/1340326217 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0002cb60 con 0x7efe0806c5f0 2023-11-04T01:46:00.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.576+0000 7efe06ffd640 1 -- 172.21.15.77:0/1340326217 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0002ccc0 con 0x7efe0806c5f0 2023-11-04T01:46:00.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.576+0000 7efe06ffd640 1 -- 172.21.15.77:0/1340326217 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe00034660 con 0x7efe0806c5f0 2023-11-04T01:46:00.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.577+0000 7efe0e2d4640 1 -- 172.21.15.77:0/1340326217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe0806c5f0 msgr2=0x7efe08071610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:00.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.577+0000 7efe0e2d4640 1 --2- 172.21.15.77:0/1340326217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe0806c5f0 0x7efe08071610 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7efe080c9080 tx=0x7efe0002bdb0 comp rx=0 tx=0).stop 2023-11-04T01:46:00.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.577+0000 7efe0e2d4640 1 -- 172.21.15.77:0/1340326217 shutdown_connections 2023-11-04T01:46:00.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.577+0000 7efe0e2d4640 1 --2- 172.21.15.77:0/1340326217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe0806c5f0 0x7efe08071610 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:00.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.577+0000 7efe0e2d4640 1 --2- 172.21.15.77:0/1340326217 >> v2:172.21.15.122:3300/0 conn(0x7efe0806d9c0 0x7efe080710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:00.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.577+0000 7efe0e2d4640 1 -- 172.21.15.77:0/1340326217 >> 172.21.15.77:0/1340326217 conn(0x7efe080cb530 msgr2=0x7efe080cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:00.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.577+0000 7efe0e2d4640 1 -- 172.21.15.77:0/1340326217 shutdown_connections 2023-11-04T01:46:00.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.577+0000 7efe0e2d4640 1 -- 172.21.15.77:0/1340326217 wait complete. 2023-11-04T01:46:00.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.578+0000 7efe0e2d4640 1 Processor -- start 2023-11-04T01:46:00.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.578+0000 7efe0e2d4640 1 -- start start 2023-11-04T01:46:00.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.579+0000 7efe0e2d4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe0806c5f0 0x7efe080c2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:00.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.579+0000 7efe0e2d4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe0806d9c0 0x7efe080acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:00.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.579+0000 7efe0e2d4640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efe080ade00 0x7efe080ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:00.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.579+0000 7efe0e2d4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe081f28a0 con 0x7efe0806c5f0 2023-11-04T01:46:00.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.579+0000 7efe0e2d4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe081f2b80 con 0x7efe0806d9c0 2023-11-04T01:46:00.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.579+0000 7efe0e2d4640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe081f2e60 con 0x7efe080ade00 2023-11-04T01:46:00.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.579+0000 7efe07fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe0806c5f0 0x7efe080c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:00.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.579+0000 7efe07fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe0806c5f0 0x7efe080c2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54354/0 (socket says 172.21.15.77:54354) 2023-11-04T01:46:00.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.579+0000 7efe07fff640 1 -- 172.21.15.77:0/472158290 learned_addr learned my addr 172.21.15.77:0/472158290 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:00.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.579+0000 7efe077fe640 1 --2- 172.21.15.77:0/472158290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe0806d9c0 0x7efe080acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:00.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.579+0000 7efe0c871640 1 --2- 172.21.15.77:0/472158290 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efe080ade00 0x7efe080ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:00.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.579+0000 7efe07fff640 1 -- 172.21.15.77:0/472158290 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efe080ade00 msgr2=0x7efe080ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:00.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.579+0000 7efe07fff640 1 --2- 172.21.15.77:0/472158290 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efe080ade00 0x7efe080ca2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:00.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.579+0000 7efe07fff640 1 -- 172.21.15.77:0/472158290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe0806d9c0 msgr2=0x7efe080acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:00.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.579+0000 7efe07fff640 1 --2- 172.21.15.77:0/472158290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe0806d9c0 0x7efe080acb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:00.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.579+0000 7efe07fff640 1 -- 172.21.15.77:0/472158290 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe00009a70 con 0x7efe0806c5f0 2023-11-04T01:46:00.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.579+0000 7efe0c871640 1 --2- 172.21.15.77:0/472158290 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efe080ade00 0x7efe080ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:00.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.579+0000 7efe07fff640 1 --2- 172.21.15.77:0/472158290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe0806c5f0 0x7efe080c2580 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7efdf800c4d0 tx=0x7efdf800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:00.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.580+0000 7efe04ff9640 1 -- 172.21.15.77:0/472158290 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf80074e0 con 0x7efe0806c5f0 2023-11-04T01:46:00.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.580+0000 7efe04ff9640 1 -- 172.21.15.77:0/472158290 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf8007660 con 0x7efe0806c5f0 2023-11-04T01:46:00.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.580+0000 7efe0e2d4640 1 -- 172.21.15.77:0/472158290 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe081f3140 con 0x7efe0806c5f0 2023-11-04T01:46:00.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.580+0000 7efe04ff9640 1 -- 172.21.15.77:0/472158290 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf8004a20 con 0x7efe0806c5f0 2023-11-04T01:46:00.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.580+0000 7efe0e2d4640 1 -- 172.21.15.77:0/472158290 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe081f2590 con 0x7efe0806c5f0 2023-11-04T01:46:00.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.581+0000 7efe0e2d4640 1 -- 172.21.15.77:0/472158290 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe080684b0 con 0x7efe0806c5f0 2023-11-04T01:46:00.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.581+0000 7efe04ff9640 1 -- 172.21.15.77:0/472158290 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efdf8004b80 con 0x7efe0806c5f0 2023-11-04T01:46:00.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.581+0000 7efe04ff9640 1 --2- 172.21.15.77:0/472158290 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efdf406ae70 0x7efdf406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:00.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.582+0000 7efe04ff9640 1 -- 172.21.15.77:0/472158290 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7608+0+0 (secure 0 0 0) 0x7efdf80892b0 con 0x7efe0806c5f0 2023-11-04T01:46:00.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.582+0000 7efe077fe640 1 --2- 172.21.15.77:0/472158290 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efdf406ae70 0x7efdf406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:00.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.582+0000 7efe077fe640 1 --2- 172.21.15.77:0/472158290 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efdf406ae70 0x7efdf406d330 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7efdfc006fd0 tx=0x7efdfc008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:00.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.586+0000 7efe04ff9640 1 -- 172.21.15.77:0/472158290 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efdf8053bf0 con 0x7efe0806c5f0 2023-11-04T01:46:00.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.787+0000 7efe0e2d4640 1 -- 172.21.15.77:0/472158290 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe080cddc0 con 0x7efe0806c5f0 2023-11-04T01:46:00.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.787+0000 7efe04ff9640 1 -- 172.21.15.77:0/472158290 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4938 (secure 0 0 0) 0x7efdf8057210 con 0x7efe0806c5f0 2023-11-04T01:46:00.789 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:46:00.790 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":86,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6814,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/1450731169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1450731169},{"type":"v1","addr":"172.21.15.122:6836","nonce":1450731169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:45:54.807399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":105,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7977,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7977":{"gid":7977,"name":"a","rank":0,"incarnation":85,"state":"up:resolve","state_seq":8,"addr":"172.21.15.77:6834/3276812155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3276812155},{"type":"v1","addr":"172.21.15.77:6834","nonce":3276812155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:00.790 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 86 2023-11-04T01:46:00.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.789+0000 7efe0e2d4640 1 -- 172.21.15.77:0/472158290 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efdf406ae70 msgr2=0x7efdf406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:00.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.789+0000 7efe0e2d4640 1 --2- 172.21.15.77:0/472158290 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efdf406ae70 0x7efdf406d330 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7efdfc006fd0 tx=0x7efdfc008040 comp rx=0 tx=0).stop 2023-11-04T01:46:00.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.789+0000 7efe0e2d4640 1 -- 172.21.15.77:0/472158290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe0806c5f0 msgr2=0x7efe080c2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:00.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.789+0000 7efe0e2d4640 1 --2- 172.21.15.77:0/472158290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe0806c5f0 0x7efe080c2580 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7efdf800c4d0 tx=0x7efdf800c990 comp rx=0 tx=0).stop 2023-11-04T01:46:00.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.789+0000 7efe0e2d4640 1 -- 172.21.15.77:0/472158290 shutdown_connections 2023-11-04T01:46:00.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.789+0000 7efe0e2d4640 1 --2- 172.21.15.77:0/472158290 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efdf406ae70 0x7efdf406d330 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:00.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.789+0000 7efe0e2d4640 1 --2- 172.21.15.77:0/472158290 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efe080ade00 0x7efe080ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:00.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.789+0000 7efe0e2d4640 1 --2- 172.21.15.77:0/472158290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe0806d9c0 0x7efe080acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:00.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.789+0000 7efe0e2d4640 1 --2- 172.21.15.77:0/472158290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe0806c5f0 0x7efe080c2580 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:00.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.789+0000 7efe0e2d4640 1 -- 172.21.15.77:0/472158290 >> 172.21.15.77:0/472158290 conn(0x7efe080cb530 msgr2=0x7efe080b1490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:00.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.789+0000 7efe0e2d4640 1 -- 172.21.15.77:0/472158290 shutdown_connections 2023-11-04T01:46:00.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.789+0000 7efe0e2d4640 1 -- 172.21.15.77:0/472158290 wait complete. 2023-11-04T01:46:00.802 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:resolve 2023-11-04T01:46:00.802 DEBUG:tasks.cephfs.filesystem:reached state 'up:resolve' in 0.3256497383117676s 2023-11-04T01:46:00.803 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:00.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.900+0000 7f4ee9a26640 1 Processor -- start 2023-11-04T01:46:00.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.901+0000 7f4ee9a26640 1 -- start start 2023-11-04T01:46:00.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.901+0000 7f4ee9a26640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4ee415d100 0x7f4ee40ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:00.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.901+0000 7f4ee9a26640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f4ee40d1be0 0x7f4ee40b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:00.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.901+0000 7f4ee9a26640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ee40b32b0 con 0x7f4ee415d4e0 2023-11-04T01:46:00.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.901+0000 7f4ee9a26640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ee40cee10 con 0x7f4ee415d100 2023-11-04T01:46:00.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.901+0000 7f4ee9a26640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ee40b2980 con 0x7f4ee40d1be0 2023-11-04T01:46:00.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.901+0000 7f4ee2ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4ee415d100 0x7f4ee40ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:00.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.901+0000 7f4ee27fc640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f4ee415d4e0 0x7f4ee40d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35804/0 (socket says 172.21.15.77:35804) 2023-11-04T01:46:00.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.901+0000 7f4ee27fc640 1 -- 172.21.15.77:0/2581002868 learned_addr learned my addr 172.21.15.77:0/2581002868 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:46:00.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.902+0000 7f4ee37fe640 1 --2- 172.21.15.77:0/2581002868 >> v2:172.21.15.122:3300/0 conn(0x7f4ee40d1be0 0x7f4ee40b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:00.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.902+0000 7f4ee2ffd640 1 -- 172.21.15.77:0/2581002868 >> v2:172.21.15.122:3300/0 conn(0x7f4ee40d1be0 msgr2=0x7f4ee40b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:00.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.902+0000 7f4ee2ffd640 1 --2- 172.21.15.77:0/2581002868 >> v2:172.21.15.122:3300/0 conn(0x7f4ee40d1be0 0x7f4ee40b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:00.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.902+0000 7f4ee2ffd640 1 -- 172.21.15.77:0/2581002868 >> v1:172.21.15.77:6789/0 conn(0x7f4ee415d4e0 legacy=0x7f4ee40d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:00.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.902+0000 7f4ee2ffd640 1 -- 172.21.15.77:0/2581002868 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee40b2c60 con 0x7f4ee415d100 2023-11-04T01:46:00.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.902+0000 7f4ee1ffb640 1 -- 172.21.15.77:0/2581002868 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1895665951 0 0) 0x7f4ee40b32b0 con 0x7f4ee415d4e0 2023-11-04T01:46:00.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.902+0000 7f4ee2ffd640 1 --2- 172.21.15.77:0/2581002868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ee415d100 0x7f4ee40ce510 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f4ee408d6a0 tx=0x7f4ed402bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cacb91caca8bf0b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:00.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.903+0000 7f4ee1ffb640 1 -- 172.21.15.77:0/2581002868 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed402ccb0 con 0x7f4ee415d100 2023-11-04T01:46:00.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.903+0000 7f4ee1ffb640 1 -- 172.21.15.77:0/2581002868 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed402ce10 con 0x7f4ee415d100 2023-11-04T01:46:00.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.903+0000 7f4ee1ffb640 1 -- 172.21.15.77:0/2581002868 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed4034660 con 0x7f4ee415d100 2023-11-04T01:46:00.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.903+0000 7f4ee9a26640 1 -- 172.21.15.77:0/2581002868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ee415d100 msgr2=0x7f4ee40ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:00.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.903+0000 7f4ee9a26640 1 --2- 172.21.15.77:0/2581002868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ee415d100 0x7f4ee40ce510 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f4ee408d6a0 tx=0x7f4ed402bf00 comp rx=0 tx=0).stop 2023-11-04T01:46:00.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.903+0000 7f4ee9a26640 1 -- 172.21.15.77:0/2581002868 shutdown_connections 2023-11-04T01:46:00.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.903+0000 7f4ee9a26640 1 --2- 172.21.15.77:0/2581002868 >> v2:172.21.15.122:3300/0 conn(0x7f4ee40d1be0 0x7f4ee40b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:00.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.903+0000 7f4ee9a26640 1 --2- 172.21.15.77:0/2581002868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ee415d100 0x7f4ee40ce510 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:00.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.903+0000 7f4ee9a26640 1 -- 172.21.15.77:0/2581002868 >> 172.21.15.77:0/2581002868 conn(0x7f4ee40d2ef0 msgr2=0x7f4ee40d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:00.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.903+0000 7f4ee9a26640 1 -- 172.21.15.77:0/2581002868 shutdown_connections 2023-11-04T01:46:00.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.903+0000 7f4ee9a26640 1 -- 172.21.15.77:0/2581002868 wait complete. 2023-11-04T01:46:00.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.904+0000 7f4ee9a26640 1 Processor -- start 2023-11-04T01:46:00.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.904+0000 7f4ee9a26640 1 -- start start 2023-11-04T01:46:00.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.905+0000 7f4ee9a26640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ee40d1be0 0x7f4ee4160250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:00.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.905+0000 7f4ee9a26640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ee415d100 0x7f4ee4159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:00.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.905+0000 7f4ee9a26640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ee415d4e0 0x7f4ee415d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:00.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.905+0000 7f4ee9a26640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee415a940 con 0x7f4ee40d1be0 2023-11-04T01:46:00.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.905+0000 7f4ee9a26640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee4160790 con 0x7f4ee415d100 2023-11-04T01:46:00.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.905+0000 7f4ee9a26640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee40cc130 con 0x7f4ee415d4e0 2023-11-04T01:46:00.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.905+0000 7f4ee2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ee40d1be0 0x7f4ee4160250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:00.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.905+0000 7f4ee2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ee40d1be0 0x7f4ee4160250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54376/0 (socket says 172.21.15.77:54376) 2023-11-04T01:46:00.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.905+0000 7f4ee2ffd640 1 -- 172.21.15.77:0/799309662 learned_addr learned my addr 172.21.15.77:0/799309662 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:00.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.905+0000 7f4ee27fc640 1 --2- 172.21.15.77:0/799309662 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ee415d100 0x7f4ee4159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:00.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.906+0000 7f4ee2ffd640 1 -- 172.21.15.77:0/799309662 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ee415d4e0 msgr2=0x7f4ee415d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:00.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.906+0000 7f4ee2ffd640 1 --2- 172.21.15.77:0/799309662 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ee415d4e0 0x7f4ee415d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:00.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.906+0000 7f4ee2ffd640 1 -- 172.21.15.77:0/799309662 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ee415d100 msgr2=0x7f4ee4159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:00.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.906+0000 7f4ee2ffd640 1 --2- 172.21.15.77:0/799309662 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ee415d100 0x7f4ee4159d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:00.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.906+0000 7f4ee2ffd640 1 -- 172.21.15.77:0/799309662 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed4009a70 con 0x7f4ee40d1be0 2023-11-04T01:46:00.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.906+0000 7f4ee2ffd640 1 --2- 172.21.15.77:0/799309662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ee40d1be0 0x7f4ee4160250 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f4ed4009ed0 tx=0x7f4ed4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:00.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.906+0000 7f4ecbfff640 1 -- 172.21.15.77:0/799309662 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed4003b90 con 0x7f4ee40d1be0 2023-11-04T01:46:00.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.906+0000 7f4ecbfff640 1 -- 172.21.15.77:0/799309662 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed4003cf0 con 0x7f4ee40d1be0 2023-11-04T01:46:00.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.906+0000 7f4ecbfff640 1 -- 172.21.15.77:0/799309662 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed4004260 con 0x7f4ee40d1be0 2023-11-04T01:46:00.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.906+0000 7f4ee9a26640 1 -- 172.21.15.77:0/799309662 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee40cc410 con 0x7f4ee40d1be0 2023-11-04T01:46:00.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.906+0000 7f4ee9a26640 1 -- 172.21.15.77:0/799309662 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee40ccef0 con 0x7f4ee40d1be0 2023-11-04T01:46:00.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.907+0000 7f4ee9a26640 1 -- 172.21.15.77:0/799309662 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ee40684b0 con 0x7f4ee40d1be0 2023-11-04T01:46:00.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.907+0000 7f4ecbfff640 1 -- 172.21.15.77:0/799309662 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4ed403b050 con 0x7f4ee40d1be0 2023-11-04T01:46:00.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.908+0000 7f4ecbfff640 1 --2- 172.21.15.77:0/799309662 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4ed006aea0 0x7f4ed006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:00.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.908+0000 7f4ecbfff640 1 -- 172.21.15.77:0/799309662 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7608+0+0 (secure 0 0 0) 0x7f4ed40ac320 con 0x7f4ee40d1be0 2023-11-04T01:46:00.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.908+0000 7f4ee27fc640 1 --2- 172.21.15.77:0/799309662 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4ed006aea0 0x7f4ed006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:00.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.908+0000 7f4ee27fc640 1 --2- 172.21.15.77:0/799309662 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4ed006aea0 0x7f4ed006d360 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8007fd0 tx=0x7f4ed8009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:00.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:00.912+0000 7f4ecbfff640 1 -- 172.21.15.77:0/799309662 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4ed4076e10 con 0x7f4ee40d1be0 2023-11-04T01:46:01.068 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:46:01.071 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:46:01.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.116+0000 7f4ee9a26640 1 -- 172.21.15.77:0/799309662 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ee40d2cd0 con 0x7f4ee40d1be0 2023-11-04T01:46:01.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.117+0000 7f4ecbfff640 1 -- 172.21.15.77:0/799309662 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f4ed4039090 con 0x7f4ee40d1be0 2023-11-04T01:46:01.119 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:46:01.119 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":86,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6814,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/1450731169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1450731169},{"type":"v1","addr":"172.21.15.122:6836","nonce":1450731169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:45:54.807399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":105,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7977,"mds_1":7305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7305":{"gid":7305,"name":"c","rank":1,"incarnation":46,"state":"up:active","state_seq":5,"addr":"172.21.15.77:6835/3207490604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3207490604},{"type":"v1","addr":"172.21.15.77:6835","nonce":3207490604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7977":{"gid":7977,"name":"a","rank":0,"incarnation":85,"state":"up:resolve","state_seq":8,"addr":"172.21.15.77:6834/3276812155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3276812155},{"type":"v1","addr":"172.21.15.77:6834","nonce":3276812155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:01.119 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 86 2023-11-04T01:46:01.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.119+0000 7f4ee9a26640 1 -- 172.21.15.77:0/799309662 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4ed006aea0 msgr2=0x7f4ed006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:01.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.119+0000 7f4ee9a26640 1 --2- 172.21.15.77:0/799309662 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4ed006aea0 0x7f4ed006d360 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8007fd0 tx=0x7f4ed8009040 comp rx=0 tx=0).stop 2023-11-04T01:46:01.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.119+0000 7f4ee9a26640 1 -- 172.21.15.77:0/799309662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ee40d1be0 msgr2=0x7f4ee4160250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:01.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.119+0000 7f4ee9a26640 1 --2- 172.21.15.77:0/799309662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ee40d1be0 0x7f4ee4160250 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f4ed4009ed0 tx=0x7f4ed4004a40 comp rx=0 tx=0).stop 2023-11-04T01:46:01.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.119+0000 7f4ee9a26640 1 -- 172.21.15.77:0/799309662 shutdown_connections 2023-11-04T01:46:01.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.119+0000 7f4ee9a26640 1 --2- 172.21.15.77:0/799309662 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4ed006aea0 0x7f4ed006d360 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:01.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.119+0000 7f4ee9a26640 1 --2- 172.21.15.77:0/799309662 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4ee415d4e0 0x7f4ee415d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:01.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.119+0000 7f4ee9a26640 1 --2- 172.21.15.77:0/799309662 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ee415d100 0x7f4ee4159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:01.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.119+0000 7f4ee9a26640 1 --2- 172.21.15.77:0/799309662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ee40d1be0 0x7f4ee4160250 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:01.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.119+0000 7f4ee9a26640 1 -- 172.21.15.77:0/799309662 >> 172.21.15.77:0/799309662 conn(0x7f4ee40d2ef0 msgr2=0x7f4ee41e7690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:01.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.119+0000 7f4ee9a26640 1 -- 172.21.15.77:0/799309662 shutdown_connections 2023-11-04T01:46:01.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.119+0000 7f4ee9a26640 1 -- 172.21.15.77:0/799309662 wait complete. 2023-11-04T01:46:01.132 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump snaps --server 2023-11-04T01:46:01.245 INFO:teuthology.orchestra.run.smithi077.stdout:{"last_snap":10,"last_created":5,"last_destroyed":9,"pending_noop":[],"snaps":[],"need_to_purge":{"17":[2,3,4,5,6,7,8,9]},"pending_update":[{"version":18,"snapinfo":{"snapid":10,"ino":1099511627777,"stamp":"2023-11-04T01:45:37.384318+0000","name":"s22","metadata":{}}}],"pending_destroy":[]} 2023-11-04T01:46:01.245 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 9, "last_snap": 10, "need_to_purge": { "17": [ 2, 3, 4, 5, 6, 7, 8, 9 ] }, "pending_destroy": [], "pending_noop": [], "pending_update": [ { "snapInfinityo": { "ino": 1099511627777, "metadata": {}, "name": "s22", "snapid": 10, "stamp": "2023-11-04T01:45:37.384318+0000" }, "version": 18 } ], "snaps": [] } 2023-11-04T01:46:01.246 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:1 2023-11-04T01:46:01.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.345+0000 7f4781da5640 1 Processor -- start 2023-11-04T01:46:01.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.345+0000 7f4781da5640 1 -- start start 2023-11-04T01:46:01.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.346+0000 7f4781da5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f477c0b0c40 0x7f477c06fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:01.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.346+0000 7f4781da5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f477c071500 con 0x7f477c06bb60 2023-11-04T01:46:01.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.346+0000 7f4781da5640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f477c15dae0 con 0x7f477c159e40 2023-11-04T01:46:01.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.346+0000 7f4781da5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477c070c60 con 0x7f477c0b0c40 2023-11-04T01:46:01.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.346+0000 7f477bfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f477c06bb60 0x7f477c0cd790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35818/0 (socket says 172.21.15.77:35818) 2023-11-04T01:46:01.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.346+0000 7f477bfff640 1 -- 172.21.15.77:0/1437601977 learned_addr learned my addr 172.21.15.77:0/1437601977 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:46:01.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.346+0000 7f477affd640 1 --2- 172.21.15.77:0/1437601977 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f477c0b0c40 0x7f477c06fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:01.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.346+0000 7f477a7fc640 1 -- 172.21.15.77:0/1437601977 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1344814733 0 0) 0x7f477c071500 con 0x7f477c06bb60 2023-11-04T01:46:01.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.346+0000 7f477a7fc640 1 -- 172.21.15.77:0/1437601977 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4764003520 con 0x7f477c06bb60 2023-11-04T01:46:01.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.346+0000 7f477a7fc640 1 -- 172.21.15.77:0/1437601977 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2389423469 0 0) 0x7f4764003520 con 0x7f477c06bb60 2023-11-04T01:46:01.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.346+0000 7f477a7fc640 1 -- 172.21.15.77:0/1437601977 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f477c0b0c40 msgr2=0x7f477c06fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:01.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.346+0000 7f477a7fc640 1 --2- 172.21.15.77:0/1437601977 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f477c0b0c40 0x7f477c06fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:01.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.346+0000 7f477a7fc640 1 -- 172.21.15.77:0/1437601977 >> v1:172.21.15.122:6789/0 conn(0x7f477c159e40 legacy=0x7f477c0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:01.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.346+0000 7f477a7fc640 1 -- 172.21.15.77:0/1437601977 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477c070f40 con 0x7f477c06bb60 2023-11-04T01:46:01.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.346+0000 7f477a7fc640 1 -- 172.21.15.77:0/1437601977 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f47740019f0 con 0x7f477c06bb60 2023-11-04T01:46:01.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.347+0000 7f477a7fc640 1 -- 172.21.15.77:0/1437601977 >> v1:172.21.15.77:6789/0 conn(0x7f477c06bb60 legacy=0x7f477c0cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:01.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.347+0000 7f477a7fc640 1 --2- 172.21.15.77:0/1437601977 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47640039a0 0x7f4764003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:01.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.347+0000 7f477a7fc640 1 --2- 172.21.15.77:0/1437601977 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f477c0b0c40 0x7f47640047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:01.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.347+0000 7f477a7fc640 1 --2- 172.21.15.77:0/1437601977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4764004d00 0x7f4764005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:01.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.347+0000 7f477a7fc640 1 -- 172.21.15.77:0/1437601977 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c070c60 con 0x7f4764004d00 2023-11-04T01:46:01.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.347+0000 7f477a7fc640 1 -- 172.21.15.77:0/1437601977 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476400ba30 con 0x7f47640039a0 2023-11-04T01:46:01.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.347+0000 7f477a7fc640 1 -- 172.21.15.77:0/1437601977 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f476400bbf0 con 0x7f477c0b0c40 2023-11-04T01:46:01.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.347+0000 7f477bfff640 1 --2- 172.21.15.77:0/1437601977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4764004d00 0x7f4764005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:01.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.347+0000 7f477b7fe640 1 --2- 172.21.15.77:0/1437601977 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47640039a0 0x7f4764003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:01.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.347+0000 7f477affd640 1 --2- 172.21.15.77:0/1437601977 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f477c0b0c40 0x7f47640047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:01.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.347+0000 7f477bfff640 1 -- 172.21.15.77:0/1437601977 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f477c0b0c40 msgr2=0x7f47640047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:01.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.347+0000 7f477bfff640 1 --2- 172.21.15.77:0/1437601977 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f477c0b0c40 0x7f47640047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:01.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.347+0000 7f477bfff640 1 -- 172.21.15.77:0/1437601977 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47640039a0 msgr2=0x7f4764003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:01.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.347+0000 7f477bfff640 1 --2- 172.21.15.77:0/1437601977 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47640039a0 0x7f4764003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:01.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.347+0000 7f477bfff640 1 -- 172.21.15.77:0/1437601977 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4764003520 con 0x7f4764004d00 2023-11-04T01:46:01.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.348+0000 7f477bfff640 1 --2- 172.21.15.77:0/1437601977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4764004d00 0x7f4764005180 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f477400a830 tx=0x7f47640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=334942d9d06398ec server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:01.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.348+0000 7f477a7fc640 1 -- 172.21.15.77:0/1437601977 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477402cea0 con 0x7f4764004d00 2023-11-04T01:46:01.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.348+0000 7f477a7fc640 1 -- 172.21.15.77:0/1437601977 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477402f070 con 0x7f4764004d00 2023-11-04T01:46:01.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.348+0000 7f477a7fc640 1 -- 172.21.15.77:0/1437601977 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4774034890 con 0x7f4764004d00 2023-11-04T01:46:01.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.348+0000 7f4781da5640 1 -- 172.21.15.77:0/1437601977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4764004d00 msgr2=0x7f4764005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:01.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.348+0000 7f4781da5640 1 --2- 172.21.15.77:0/1437601977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4764004d00 0x7f4764005180 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f477400a830 tx=0x7f47640057f0 comp rx=0 tx=0).stop 2023-11-04T01:46:01.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.348+0000 7f477bfff640 1 -- 172.21.15.77:0/1437601977 reap_dead start 2023-11-04T01:46:01.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.348+0000 7f4781da5640 1 -- 172.21.15.77:0/1437601977 shutdown_connections 2023-11-04T01:46:01.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.348+0000 7f4781da5640 1 -- 172.21.15.77:0/1437601977 >> 172.21.15.77:0/1437601977 conn(0x7f477c0cb530 msgr2=0x7f477c0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:01.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.348+0000 7f4781da5640 1 -- 172.21.15.77:0/1437601977 shutdown_connections 2023-11-04T01:46:01.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.348+0000 7f4781da5640 1 -- 172.21.15.77:0/1437601977 wait complete. 2023-11-04T01:46:01.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.350+0000 7f4781da5640 1 Processor -- start 2023-11-04T01:46:01.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.350+0000 7f4781da5640 1 -- start start 2023-11-04T01:46:01.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.350+0000 7f4781da5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f477c0cc9f0 0x7f477c1f3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:01.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.350+0000 7f4781da5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f477c0ccdd0 0x7f477c15c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:01.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.350+0000 7f4781da5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f477c15c770 0x7f477c14ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:01.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.350+0000 7f4781da5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c0aea10 con 0x7f477c0cc9f0 2023-11-04T01:46:01.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.350+0000 7f4781da5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c0aec80 con 0x7f477c15c770 2023-11-04T01:46:01.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.350+0000 7f4781da5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477c0aef60 con 0x7f477c0ccdd0 2023-11-04T01:46:01.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.351+0000 7f477b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f477c0cc9f0 0x7f477c1f3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:01.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.351+0000 7f477b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f477c0cc9f0 0x7f477c1f3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54400/0 (socket says 172.21.15.77:54400) 2023-11-04T01:46:01.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.351+0000 7f477b7fe640 1 -- 172.21.15.77:0/1544101653 learned_addr learned my addr 172.21.15.77:0/1544101653 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:01.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.351+0000 7f477bfff640 1 --2- 172.21.15.77:0/1544101653 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f477c15c770 0x7f477c14ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:01.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.351+0000 7f477affd640 1 --2- 172.21.15.77:0/1544101653 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f477c0ccdd0 0x7f477c15c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:01.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.351+0000 7f477b7fe640 1 -- 172.21.15.77:0/1544101653 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f477c0ccdd0 msgr2=0x7f477c15c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:01.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.351+0000 7f477b7fe640 1 --2- 172.21.15.77:0/1544101653 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f477c0ccdd0 0x7f477c15c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:01.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.351+0000 7f477b7fe640 1 -- 172.21.15.77:0/1544101653 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f477c15c770 msgr2=0x7f477c14ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:01.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.351+0000 7f477b7fe640 1 --2- 172.21.15.77:0/1544101653 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f477c15c770 0x7f477c14ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:01.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.351+0000 7f477b7fe640 1 -- 172.21.15.77:0/1544101653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477c0af240 con 0x7f477c0cc9f0 2023-11-04T01:46:01.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.351+0000 7f477b7fe640 1 --2- 172.21.15.77:0/1544101653 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f477c0cc9f0 0x7f477c1f3900 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f476c00f7c0 tx=0x7f476c00fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:01.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.351+0000 7f4763fff640 1 -- 172.21.15.77:0/1544101653 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c00fed0 con 0x7f477c0cc9f0 2023-11-04T01:46:01.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.351+0000 7f4763fff640 1 -- 172.21.15.77:0/1544101653 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f476c0052e0 con 0x7f477c0cc9f0 2023-11-04T01:46:01.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.351+0000 7f4781da5640 1 -- 172.21.15.77:0/1544101653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f477c0af520 con 0x7f477c0cc9f0 2023-11-04T01:46:01.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.351+0000 7f4763fff640 1 -- 172.21.15.77:0/1544101653 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c00d970 con 0x7f477c0cc9f0 2023-11-04T01:46:01.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.351+0000 7f4781da5640 1 -- 172.21.15.77:0/1544101653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f477c15bc00 con 0x7f477c0cc9f0 2023-11-04T01:46:01.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.352+0000 7f4781da5640 1 -- 172.21.15.77:0/1544101653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f477c0c5a50 con 0x7f477c0cc9f0 2023-11-04T01:46:01.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.353+0000 7f4763fff640 1 -- 172.21.15.77:0/1544101653 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f476c00dad0 con 0x7f477c0cc9f0 2023-11-04T01:46:01.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.353+0000 7f4763fff640 1 --2- 172.21.15.77:0/1544101653 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f476806aea0 0x7f476806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:01.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.353+0000 7f4763fff640 1 -- 172.21.15.77:0/1544101653 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7608+0+0 (secure 0 0 0) 0x7f476c089d80 con 0x7f477c0cc9f0 2023-11-04T01:46:01.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.353+0000 7f477affd640 1 --2- 172.21.15.77:0/1544101653 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f476806aea0 0x7f476806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:01.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.354+0000 7f477affd640 1 --2- 172.21.15.77:0/1544101653 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f476806aea0 0x7f476806d360 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f477c1f5c90 tx=0x7f4770008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:01.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.358+0000 7f4763fff640 1 -- 172.21.15.77:0/1544101653 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f476c054750 con 0x7f477c0cc9f0 2023-11-04T01:46:01.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.590+0000 7f4781da5640 1 -- 172.21.15.77:0/1544101653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:1"} v 0) v1 -- 0x7f477c0684b0 con 0x7f477c0cc9f0 2023-11-04T01:46:01.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.592+0000 7f4763fff640 1 -- 172.21.15.77:0/1544101653 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:1"}]=0 failed mds gid 7305 v87) v1 ==== 97+0+0 (secure 0 0 0) 0x7f476c057d70 con 0x7f477c0cc9f0 2023-11-04T01:46:01.594 INFO:teuthology.orchestra.run.smithi077.stderr:failed mds gid 7305 2023-11-04T01:46:01.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.595+0000 7f4781da5640 1 -- 172.21.15.77:0/1544101653 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f476806aea0 msgr2=0x7f476806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:01.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.595+0000 7f4781da5640 1 --2- 172.21.15.77:0/1544101653 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f476806aea0 0x7f476806d360 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f477c1f5c90 tx=0x7f4770008040 comp rx=0 tx=0).stop 2023-11-04T01:46:01.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.595+0000 7f4781da5640 1 -- 172.21.15.77:0/1544101653 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f477c0cc9f0 msgr2=0x7f477c1f3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:01.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.595+0000 7f4781da5640 1 --2- 172.21.15.77:0/1544101653 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f477c0cc9f0 0x7f477c1f3900 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f476c00f7c0 tx=0x7f476c00fc80 comp rx=0 tx=0).stop 2023-11-04T01:46:01.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.596+0000 7f4781da5640 1 -- 172.21.15.77:0/1544101653 shutdown_connections 2023-11-04T01:46:01.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.596+0000 7f4781da5640 1 --2- 172.21.15.77:0/1544101653 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f476806aea0 0x7f476806d360 secure :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f477c1f5c90 tx=0x7f4770008040 comp rx=0 tx=0).stop 2023-11-04T01:46:01.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.596+0000 7f4781da5640 1 --2- 172.21.15.77:0/1544101653 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f477c15c770 0x7f477c14ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:01.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.596+0000 7f4781da5640 1 --2- 172.21.15.77:0/1544101653 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f477c0ccdd0 0x7f477c15c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:01.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.596+0000 7f4781da5640 1 --2- 172.21.15.77:0/1544101653 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f477c0cc9f0 0x7f477c1f3900 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:01.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.596+0000 7f4781da5640 1 -- 172.21.15.77:0/1544101653 >> 172.21.15.77:0/1544101653 conn(0x7f477c0cb530 msgr2=0x7f477c0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:01.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.596+0000 7f4781da5640 1 -- 172.21.15.77:0/1544101653 shutdown_connections 2023-11-04T01:46:01.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.596+0000 7f4781da5640 1 -- 172.21.15.77:0/1544101653 wait complete. 2023-11-04T01:46:01.610 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:46:01.611 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:46:01.611 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:46:01.611 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:46:01.612 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:46:01.613 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi077 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2023-11-04T01:46:01.613 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:46:01.614 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:46:01.617 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:46:01.617 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:01.690 INFO:tasks.ceph.mds.c.smithi077.stdout:starting mds.c at 2023-11-04T01:46:01.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.717+0000 7f320b4e5640 1 Processor -- start 2023-11-04T01:46:01.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.717+0000 7f320b4e5640 1 -- start start 2023-11-04T01:46:01.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.718+0000 7f320b4e5640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f32040ceda0 0x7f320415cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:01.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.718+0000 7f320b4e5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32040b0150 con 0x7f32040cf890 2023-11-04T01:46:01.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.718+0000 7f320b4e5640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32040b1170 con 0x7f32040b2210 2023-11-04T01:46:01.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.718+0000 7f320b4e5640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32040b1df0 con 0x7f32040ceda0 2023-11-04T01:46:01.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.718+0000 7f3209a82640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f32040cf890 0x7f320406b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35834/0 (socket says 172.21.15.77:35834) 2023-11-04T01:46:01.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.718+0000 7f3209a82640 1 -- 172.21.15.77:0/3432571648 learned_addr learned my addr 172.21.15.77:0/3432571648 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:46:01.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.718+0000 7f3209281640 1 --2- 172.21.15.77:0/3432571648 >> v2:172.21.15.122:3300/0 conn(0x7f32040ceda0 0x7f320415cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:01.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.718+0000 7f31fbfff640 1 -- 172.21.15.77:0/3432571648 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3368222150 0 0) 0x7f32040b0150 con 0x7f32040cf890 2023-11-04T01:46:01.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.718+0000 7f31fbfff640 1 -- 172.21.15.77:0/3432571648 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31f0003520 con 0x7f32040cf890 2023-11-04T01:46:01.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.718+0000 7f3209281640 1 -- 172.21.15.77:0/3432571648 >> v1:172.21.15.122:6789/0 conn(0x7f32040b2210 legacy=0x7f32040cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:01.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.718+0000 7f31fbfff640 1 -- 172.21.15.77:0/3432571648 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1245729183 0 0) 0x7f31f0003520 con 0x7f32040cf890 2023-11-04T01:46:01.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.718+0000 7f3209281640 1 -- 172.21.15.77:0/3432571648 >> v1:172.21.15.77:6789/0 conn(0x7f32040cf890 legacy=0x7f320406b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:01.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.718+0000 7f3209281640 1 -- 172.21.15.77:0/3432571648 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32040b1450 con 0x7f32040ceda0 2023-11-04T01:46:01.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.719+0000 7f3209281640 1 --2- 172.21.15.77:0/3432571648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32040ceda0 0x7f320415cf20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3200009790 tx=0x7f320002b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=775ac09870cb7841 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:01.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.719+0000 7f31fbfff640 1 -- 172.21.15.77:0/3432571648 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc0019f0 con 0x7f32040ceda0 2023-11-04T01:46:01.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.719+0000 7f31fbfff640 1 -- 172.21.15.77:0/3432571648 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f320002e050 con 0x7f32040ceda0 2023-11-04T01:46:01.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.719+0000 7f31fbfff640 1 -- 172.21.15.77:0/3432571648 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3200030710 con 0x7f32040ceda0 2023-11-04T01:46:01.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.720+0000 7f320b4e5640 1 -- 172.21.15.77:0/3432571648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32040ceda0 msgr2=0x7f320415cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:01.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.720+0000 7f320b4e5640 1 --2- 172.21.15.77:0/3432571648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32040ceda0 0x7f320415cf20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3200009790 tx=0x7f320002b790 comp rx=0 tx=0).stop 2023-11-04T01:46:01.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.720+0000 7f320b4e5640 1 -- 172.21.15.77:0/3432571648 shutdown_connections 2023-11-04T01:46:01.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.720+0000 7f320b4e5640 1 --2- 172.21.15.77:0/3432571648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32040ceda0 0x7f320415cf20 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:01.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.720+0000 7f320b4e5640 1 -- 172.21.15.77:0/3432571648 >> 172.21.15.77:0/3432571648 conn(0x7f32040d0c30 msgr2=0x7f32040d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:01.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.720+0000 7f320b4e5640 1 -- 172.21.15.77:0/3432571648 shutdown_connections 2023-11-04T01:46:01.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.720+0000 7f320b4e5640 1 -- 172.21.15.77:0/3432571648 wait complete. 2023-11-04T01:46:01.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.721+0000 7f320b4e5640 1 Processor -- start 2023-11-04T01:46:01.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.721+0000 7f320b4e5640 1 -- start start 2023-11-04T01:46:01.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.722+0000 7f320b4e5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32040b2210 0x7f3204148d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:01.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.722+0000 7f320b4e5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32040ceda0 0x7f3204148460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:01.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.722+0000 7f320b4e5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32040cf890 0x7f320414a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:01.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.722+0000 7f320b4e5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3204149fc0 con 0x7f32040cf890 2023-11-04T01:46:01.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.722+0000 7f320b4e5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320415a600 con 0x7f32040b2210 2023-11-04T01:46:01.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.722+0000 7f320b4e5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32041493b0 con 0x7f32040ceda0 2023-11-04T01:46:01.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.722+0000 7f3209a82640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32040cf890 0x7f320414a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:01.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.722+0000 7f3209a82640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32040cf890 0x7f320414a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54442/0 (socket says 172.21.15.77:54442) 2023-11-04T01:46:01.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.722+0000 7f3209a82640 1 -- 172.21.15.77:0/4198096520 learned_addr learned my addr 172.21.15.77:0/4198096520 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:01.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.722+0000 7f3209281640 1 --2- 172.21.15.77:0/4198096520 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32040b2210 0x7f3204148d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:01.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.722+0000 7f3208a80640 1 --2- 172.21.15.77:0/4198096520 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32040ceda0 0x7f3204148460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:01.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.722+0000 7f3209a82640 1 -- 172.21.15.77:0/4198096520 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32040ceda0 msgr2=0x7f3204148460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:01.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.722+0000 7f3209a82640 1 --2- 172.21.15.77:0/4198096520 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32040ceda0 0x7f3204148460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:01.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.722+0000 7f3209a82640 1 -- 172.21.15.77:0/4198096520 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32040b2210 msgr2=0x7f3204148d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:01.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.722+0000 7f3209a82640 1 --2- 172.21.15.77:0/4198096520 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32040b2210 0x7f3204148d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:01.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.722+0000 7f3209a82640 1 -- 172.21.15.77:0/4198096520 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32000093a0 con 0x7f32040cf890 2023-11-04T01:46:01.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.722+0000 7f3209a82640 1 --2- 172.21.15.77:0/4198096520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32040cf890 0x7f320414a450 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f31fc001830 tx=0x7f31fc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:01.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.722+0000 7f31f9ffb640 1 -- 172.21.15.77:0/4198096520 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc012400 con 0x7f32040cf890 2023-11-04T01:46:01.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.722+0000 7f31f9ffb640 1 -- 172.21.15.77:0/4198096520 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31fc012560 con 0x7f32040cf890 2023-11-04T01:46:01.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.722+0000 7f320b4e5640 1 -- 172.21.15.77:0/4198096520 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3204149690 con 0x7f32040cf890 2023-11-04T01:46:01.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.722+0000 7f31f9ffb640 1 -- 172.21.15.77:0/4198096520 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc012910 con 0x7f32040cf890 2023-11-04T01:46:01.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.723+0000 7f320b4e5640 1 -- 172.21.15.77:0/4198096520 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3204149c50 con 0x7f32040cf890 2023-11-04T01:46:01.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.724+0000 7f320b4e5640 1 -- 172.21.15.77:0/4198096520 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f320414a170 con 0x7f32040cf890 2023-11-04T01:46:01.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.724+0000 7f31f9ffb640 1 -- 172.21.15.77:0/4198096520 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f31fc012a70 con 0x7f32040cf890 2023-11-04T01:46:01.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.724+0000 7f31f9ffb640 1 --2- 172.21.15.77:0/4198096520 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f31e806aea0 0x7f31e806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:01.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.724+0000 7f31f9ffb640 1 -- 172.21.15.77:0/4198096520 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7694+0+0 (secure 0 0 0) 0x7f31fc08a540 con 0x7f32040cf890 2023-11-04T01:46:01.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.724+0000 7f3209281640 1 --2- 172.21.15.77:0/4198096520 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f31e806aea0 0x7f31e806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:01.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.725+0000 7f3209281640 1 --2- 172.21.15.77:0/4198096520 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f31e806aea0 0x7f31e806d360 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f3200034000 tx=0x7f320002f000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:01.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.728+0000 7f31f9ffb640 1 -- 172.21.15.77:0/4198096520 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f31fc054dc0 con 0x7f32040cf890 2023-11-04T01:46:01.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.934+0000 7f320b4e5640 1 -- 172.21.15.77:0/4198096520 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32040684b0 con 0x7f32040cf890 2023-11-04T01:46:01.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.934+0000 7f31f9ffb640 1 -- 172.21.15.77:0/4198096520 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4147 (secure 0 0 0) 0x7f31fc0583e0 con 0x7f32040cf890 2023-11-04T01:46:01.937 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:46:01.937 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":88,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:46:01.595969+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7977,"mds_1":6814},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6814":{"gid":6814,"name":"b","rank":1,"incarnation":88,"state":"up:replay","state_seq":1,"addr":"172.21.15.122:6836/1450731169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1450731169},{"type":"v1","addr":"172.21.15.122:6836","nonce":1450731169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7977":{"gid":7977,"name":"a","rank":0,"incarnation":85,"state":"up:resolve","state_seq":8,"addr":"172.21.15.77:6834/3276812155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3276812155},{"type":"v1","addr":"172.21.15.77:6834","nonce":3276812155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:01.938 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 88 2023-11-04T01:46:01.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.936+0000 7f320b4e5640 1 -- 172.21.15.77:0/4198096520 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f31e806aea0 msgr2=0x7f31e806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:01.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.936+0000 7f320b4e5640 1 --2- 172.21.15.77:0/4198096520 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f31e806aea0 0x7f31e806d360 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f3200034000 tx=0x7f320002f000 comp rx=0 tx=0).stop 2023-11-04T01:46:01.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.936+0000 7f320b4e5640 1 -- 172.21.15.77:0/4198096520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32040cf890 msgr2=0x7f320414a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:01.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.936+0000 7f320b4e5640 1 --2- 172.21.15.77:0/4198096520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32040cf890 0x7f320414a450 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f31fc001830 tx=0x7f31fc00a430 comp rx=0 tx=0).stop 2023-11-04T01:46:01.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.936+0000 7f320b4e5640 1 -- 172.21.15.77:0/4198096520 shutdown_connections 2023-11-04T01:46:01.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.936+0000 7f320b4e5640 1 --2- 172.21.15.77:0/4198096520 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f31e806aea0 0x7f31e806d360 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:01.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.936+0000 7f320b4e5640 1 --2- 172.21.15.77:0/4198096520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32040cf890 0x7f320414a450 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:01.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.936+0000 7f320b4e5640 1 --2- 172.21.15.77:0/4198096520 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32040ceda0 0x7f3204148460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:01.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.936+0000 7f320b4e5640 1 --2- 172.21.15.77:0/4198096520 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32040b2210 0x7f3204148d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:01.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.936+0000 7f320b4e5640 1 -- 172.21.15.77:0/4198096520 >> 172.21.15.77:0/4198096520 conn(0x7f32040d0c30 msgr2=0x7f320415c230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:01.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.936+0000 7f320b4e5640 1 -- 172.21.15.77:0/4198096520 shutdown_connections 2023-11-04T01:46:01.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:01.936+0000 7f320b4e5640 1 -- 172.21.15.77:0/4198096520 wait complete. 2023-11-04T01:46:01.949 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:46:06.447 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-11-04T01:46:06.950 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:07.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.059+0000 7f09d8b61640 1 Processor -- start 2023-11-04T01:46:07.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.059+0000 7f09d8b61640 1 -- start start 2023-11-04T01:46:07.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.060+0000 7f09d8b61640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f09d40ade00 0x7f09d40b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:07.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.060+0000 7f09d8b61640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f09d406c5f0 0x7f09d40cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:07.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.060+0000 7f09d8b61640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09d406cc90 con 0x7f09d406d9c0 2023-11-04T01:46:07.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.060+0000 7f09d8b61640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09d40b0e60 con 0x7f09d406c5f0 2023-11-04T01:46:07.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.060+0000 7f09d8b61640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d406cee0 con 0x7f09d40ade00 2023-11-04T01:46:07.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.060+0000 7f09d1d9b640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f09d406d9c0 0x7f09d40710d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35844/0 (socket says 172.21.15.77:35844) 2023-11-04T01:46:07.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.060+0000 7f09d1d9b640 1 -- 172.21.15.77:0/1737238907 learned_addr learned my addr 172.21.15.77:0/1737238907 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:46:07.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.060+0000 7f09d2d9d640 1 --2- 172.21.15.77:0/1737238907 >> v2:172.21.15.122:3300/0 conn(0x7f09d406c5f0 0x7f09d40cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:07.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.060+0000 7f09d259c640 1 --2- 172.21.15.77:0/1737238907 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f09d40ade00 0x7f09d40b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:07.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.061+0000 7f09d159a640 1 -- 172.21.15.77:0/1737238907 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 345644792 0 0) 0x7f09d406cc90 con 0x7f09d406d9c0 2023-11-04T01:46:07.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.061+0000 7f09d159a640 1 -- 172.21.15.77:0/1737238907 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09bc003520 con 0x7f09d406d9c0 2023-11-04T01:46:07.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.061+0000 7f09d159a640 1 -- 172.21.15.77:0/1737238907 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2024994141 0 0) 0x7f09bc003520 con 0x7f09d406d9c0 2023-11-04T01:46:07.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.061+0000 7f09d159a640 1 -- 172.21.15.77:0/1737238907 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f09d40ade00 msgr2=0x7f09d40b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:07.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.061+0000 7f09d159a640 1 --2- 172.21.15.77:0/1737238907 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f09d40ade00 0x7f09d40b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:07.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.061+0000 7f09d159a640 1 -- 172.21.15.77:0/1737238907 >> v2:172.21.15.122:3300/0 conn(0x7f09d406c5f0 msgr2=0x7f09d40cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:07.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.061+0000 7f09d159a640 1 --2- 172.21.15.77:0/1737238907 >> v2:172.21.15.122:3300/0 conn(0x7f09d406c5f0 0x7f09d40cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:07.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.061+0000 7f09d159a640 1 -- 172.21.15.77:0/1737238907 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d406d1c0 con 0x7f09d406d9c0 2023-11-04T01:46:07.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.061+0000 7f09d159a640 1 -- 172.21.15.77:0/1737238907 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f09c8001670 con 0x7f09d406d9c0 2023-11-04T01:46:07.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.061+0000 7f09d159a640 1 -- 172.21.15.77:0/1737238907 >> v1:172.21.15.77:6789/0 conn(0x7f09d406d9c0 legacy=0x7f09d40710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:07.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.061+0000 7f09d159a640 1 --2- 172.21.15.77:0/1737238907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09bc003970 0x7f09bc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:07.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.061+0000 7f09d159a640 1 --2- 172.21.15.77:0/1737238907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09bc0047c0 0x7f09bc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:07.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.061+0000 7f09d159a640 1 --2- 172.21.15.77:0/1737238907 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f09d40ade00 0x7f09bc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:07.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.061+0000 7f09d159a640 1 -- 172.21.15.77:0/1737238907 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d40b0e60 con 0x7f09bc0047c0 2023-11-04T01:46:07.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.061+0000 7f09d159a640 1 -- 172.21.15.77:0/1737238907 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d406cee0 con 0x7f09bc003970 2023-11-04T01:46:07.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.061+0000 7f09d159a640 1 -- 172.21.15.77:0/1737238907 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc00ba00 con 0x7f09d40ade00 2023-11-04T01:46:07.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.061+0000 7f09d2d9d640 1 --2- 172.21.15.77:0/1737238907 >> v2:172.21.15.122:3300/0 conn(0x7f09d406c5f0 0x7f09d40cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:46:07.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.061+0000 7f09d1d9b640 1 --2- 172.21.15.77:0/1737238907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09bc0047c0 0x7f09bc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:07.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.061+0000 7f09d2d9d640 1 --2- 172.21.15.77:0/1737238907 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f09d40ade00 0x7f09bc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:07.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.061+0000 7f09d259c640 1 --2- 172.21.15.77:0/1737238907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09bc003970 0x7f09bc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:07.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.061+0000 7f09d1d9b640 1 -- 172.21.15.77:0/1737238907 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f09d40ade00 msgr2=0x7f09bc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:07.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.061+0000 7f09d1d9b640 1 --2- 172.21.15.77:0/1737238907 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f09d40ade00 0x7f09bc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:07.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.061+0000 7f09d1d9b640 1 -- 172.21.15.77:0/1737238907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09bc003970 msgr2=0x7f09bc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:07.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.061+0000 7f09d1d9b640 1 --2- 172.21.15.77:0/1737238907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09bc003970 0x7f09bc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:07.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.061+0000 7f09d1d9b640 1 -- 172.21.15.77:0/1737238907 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09bc003520 con 0x7f09bc0047c0 2023-11-04T01:46:07.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.061+0000 7f09d259c640 1 --2- 172.21.15.77:0/1737238907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09bc003970 0x7f09bc003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:07.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.062+0000 7f09d1d9b640 1 --2- 172.21.15.77:0/1737238907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09bc0047c0 0x7f09bc004c40 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f09d40cb4e0 tx=0x7f09bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=698cc4a28b51b2fc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:07.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.062+0000 7f09d159a640 1 -- 172.21.15.77:0/1737238907 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c8005ad0 con 0x7f09bc0047c0 2023-11-04T01:46:07.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.062+0000 7f09d159a640 1 -- 172.21.15.77:0/1737238907 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c8005c50 con 0x7f09bc0047c0 2023-11-04T01:46:07.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.062+0000 7f09d159a640 1 -- 172.21.15.77:0/1737238907 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c802c8d0 con 0x7f09bc0047c0 2023-11-04T01:46:07.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.063+0000 7f09d8b61640 1 -- 172.21.15.77:0/1737238907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09bc0047c0 msgr2=0x7f09bc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:07.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.063+0000 7f09d8b61640 1 --2- 172.21.15.77:0/1737238907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09bc0047c0 0x7f09bc004c40 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f09d40cb4e0 tx=0x7f09bc0057f0 comp rx=0 tx=0).stop 2023-11-04T01:46:07.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.063+0000 7f09d2d9d640 1 -- 172.21.15.77:0/1737238907 reap_dead start 2023-11-04T01:46:07.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.063+0000 7f09d8b61640 1 -- 172.21.15.77:0/1737238907 shutdown_connections 2023-11-04T01:46:07.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.063+0000 7f09d8b61640 1 -- 172.21.15.77:0/1737238907 >> 172.21.15.77:0/1737238907 conn(0x7f09d40cb530 msgr2=0x7f09d40cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:07.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.063+0000 7f09d8b61640 1 -- 172.21.15.77:0/1737238907 shutdown_connections 2023-11-04T01:46:07.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.063+0000 7f09d8b61640 1 -- 172.21.15.77:0/1737238907 wait complete. 2023-11-04T01:46:07.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.064+0000 7f09d8b61640 1 Processor -- start 2023-11-04T01:46:07.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.064+0000 7f09d8b61640 1 -- start start 2023-11-04T01:46:07.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.065+0000 7f09d8b61640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f09bc0047c0 0x7f09d414f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:07.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.065+0000 7f09d8b61640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09d40c7eb0 0x7f09d41f27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:07.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.065+0000 7f09d8b61640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09d41e5a30 0x7f09d41e5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:07.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.065+0000 7f09d8b61640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d41e63f0 con 0x7f09d41e5a30 2023-11-04T01:46:07.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.065+0000 7f09d8b61640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d40c8330 con 0x7f09d40c7eb0 2023-11-04T01:46:07.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.065+0000 7f09d8b61640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d41f2d00 con 0x7f09bc0047c0 2023-11-04T01:46:07.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.065+0000 7f09d2d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09d41e5a30 0x7f09d41e5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:07.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.065+0000 7f09d2d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09d41e5a30 0x7f09d41e5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54464/0 (socket says 172.21.15.77:54464) 2023-11-04T01:46:07.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.065+0000 7f09d2d9d640 1 -- 172.21.15.77:0/2437818239 learned_addr learned my addr 172.21.15.77:0/2437818239 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:07.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.065+0000 7f09d1d9b640 1 --2- 172.21.15.77:0/2437818239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09d40c7eb0 0x7f09d41f27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:07.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.065+0000 7f09d259c640 1 --2- 172.21.15.77:0/2437818239 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f09bc0047c0 0x7f09d414f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:07.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.065+0000 7f09d2d9d640 1 -- 172.21.15.77:0/2437818239 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f09bc0047c0 msgr2=0x7f09d414f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:07.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.065+0000 7f09d2d9d640 1 --2- 172.21.15.77:0/2437818239 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f09bc0047c0 0x7f09d414f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:07.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.065+0000 7f09d2d9d640 1 -- 172.21.15.77:0/2437818239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09d40c7eb0 msgr2=0x7f09d41f27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:07.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.065+0000 7f09d2d9d640 1 --2- 172.21.15.77:0/2437818239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09d40c7eb0 0x7f09d41f27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:07.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.065+0000 7f09d2d9d640 1 -- 172.21.15.77:0/2437818239 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d40c5d00 con 0x7f09d41e5a30 2023-11-04T01:46:07.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.066+0000 7f09d2d9d640 1 --2- 172.21.15.77:0/2437818239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09d41e5a30 0x7f09d41e5eb0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f09d40cda00 tx=0x7f09cc00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:07.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.066+0000 7f09c2ffd640 1 -- 172.21.15.77:0/2437818239 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09cc01c070 con 0x7f09d41e5a30 2023-11-04T01:46:07.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.066+0000 7f09c2ffd640 1 -- 172.21.15.77:0/2437818239 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09cc00f040 con 0x7f09d41e5a30 2023-11-04T01:46:07.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.066+0000 7f09c2ffd640 1 -- 172.21.15.77:0/2437818239 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09cc00e040 con 0x7f09d41e5a30 2023-11-04T01:46:07.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.066+0000 7f09d8b61640 1 -- 172.21.15.77:0/2437818239 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d41f2fa0 con 0x7f09d41e5a30 2023-11-04T01:46:07.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.066+0000 7f09d8b61640 1 -- 172.21.15.77:0/2437818239 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09d41f3560 con 0x7f09d41e5a30 2023-11-04T01:46:07.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.067+0000 7f09d8b61640 1 -- 172.21.15.77:0/2437818239 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09d40c5f20 con 0x7f09d41e5a30 2023-11-04T01:46:07.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.067+0000 7f09c2ffd640 1 -- 172.21.15.77:0/2437818239 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f09cc015430 con 0x7f09d41e5a30 2023-11-04T01:46:07.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.068+0000 7f09c2ffd640 1 --2- 172.21.15.77:0/2437818239 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f09b406aea0 0x7f09b406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:07.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.068+0000 7f09c2ffd640 1 -- 172.21.15.77:0/2437818239 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7694+0+0 (secure 0 0 0) 0x7f09cc08a0e0 con 0x7f09d41e5a30 2023-11-04T01:46:07.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.068+0000 7f09d259c640 1 --2- 172.21.15.77:0/2437818239 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f09b406aea0 0x7f09b406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:07.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.069+0000 7f09d259c640 1 --2- 172.21.15.77:0/2437818239 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f09b406aea0 0x7f09b406d360 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f09d40ae750 tx=0x7f09c4008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:07.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.072+0000 7f09c2ffd640 1 -- 172.21.15.77:0/2437818239 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f09d40c5f20 con 0x7f09d41e5a30 2023-11-04T01:46:07.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.276+0000 7f09d8b61640 1 -- 172.21.15.77:0/2437818239 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09d40c5f20 con 0x7f09d41e5a30 2023-11-04T01:46:07.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.277+0000 7f09c2ffd640 1 -- 172.21.15.77:0/2437818239 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f09d40c5f20 con 0x7f09d41e5a30 2023-11-04T01:46:07.279 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:46:07.279 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":90,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8139,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2107153526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2107153526},{"type":"v1","addr":"172.21.15.77:6835","nonce":2107153526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:46:02.609248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7977,"mds_1":6814},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6814":{"gid":6814,"name":"b","rank":1,"incarnation":88,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.122:6836/1450731169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1450731169},{"type":"v1","addr":"172.21.15.122:6836","nonce":1450731169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7977":{"gid":7977,"name":"a","rank":0,"incarnation":85,"state":"up:reconnect","state_seq":10,"addr":"172.21.15.77:6834/3276812155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3276812155},{"type":"v1","addr":"172.21.15.77:6834","nonce":3276812155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:07.280 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 90 2023-11-04T01:46:07.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.279+0000 7f09d8b61640 1 -- 172.21.15.77:0/2437818239 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f09b406aea0 msgr2=0x7f09b406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:07.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.279+0000 7f09d8b61640 1 --2- 172.21.15.77:0/2437818239 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f09b406aea0 0x7f09b406d360 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f09d40ae750 tx=0x7f09c4008040 comp rx=0 tx=0).stop 2023-11-04T01:46:07.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.279+0000 7f09d8b61640 1 -- 172.21.15.77:0/2437818239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09d41e5a30 msgr2=0x7f09d41e5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:07.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.279+0000 7f09d8b61640 1 --2- 172.21.15.77:0/2437818239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09d41e5a30 0x7f09d41e5eb0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f09d40cda00 tx=0x7f09cc00f580 comp rx=0 tx=0).stop 2023-11-04T01:46:07.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.279+0000 7f09d8b61640 1 -- 172.21.15.77:0/2437818239 shutdown_connections 2023-11-04T01:46:07.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.279+0000 7f09d8b61640 1 --2- 172.21.15.77:0/2437818239 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f09b406aea0 0x7f09b406d360 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:07.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.279+0000 7f09d8b61640 1 --2- 172.21.15.77:0/2437818239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09d41e5a30 0x7f09d41e5eb0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:07.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.279+0000 7f09d8b61640 1 --2- 172.21.15.77:0/2437818239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09d40c7eb0 0x7f09d41f27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:07.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.279+0000 7f09d8b61640 1 --2- 172.21.15.77:0/2437818239 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f09bc0047c0 0x7f09d414f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:07.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.279+0000 7f09d8b61640 1 -- 172.21.15.77:0/2437818239 >> 172.21.15.77:0/2437818239 conn(0x7f09d40cb530 msgr2=0x7f09d40c1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:07.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.279+0000 7f09d8b61640 1 -- 172.21.15.77:0/2437818239 shutdown_connections 2023-11-04T01:46:07.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.279+0000 7f09d8b61640 1 -- 172.21.15.77:0/2437818239 wait complete. 2023-11-04T01:46:07.291 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:46:07.292 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:07.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.390+0000 7ff9d69e2640 1 Processor -- start 2023-11-04T01:46:07.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.390+0000 7ff9d69e2640 1 -- start start 2023-11-04T01:46:07.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.391+0000 7ff9d69e2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff9d00ceda0 0x7ff9d015cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:07.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.391+0000 7ff9d69e2640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff9d00b2210 0x7ff9d015d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:07.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.391+0000 7ff9d69e2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff9d00cf180 0x7ff9d00cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:07.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.391+0000 7ff9d69e2640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9d00b1df0 con 0x7ff9d00ceda0 2023-11-04T01:46:07.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.391+0000 7ff9d69e2640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9d015d9a0 con 0x7ff9d00b2210 2023-11-04T01:46:07.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.391+0000 7ff9d69e2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d00b0150 con 0x7ff9d00cf180 2023-11-04T01:46:07.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.391+0000 7ff9cffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff9d00ceda0 0x7ff9d015cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:07.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.391+0000 7ff9cffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff9d00ceda0 0x7ff9d015cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54474/0 (socket says 172.21.15.77:54474) 2023-11-04T01:46:07.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.391+0000 7ff9cffff640 1 -- 172.21.15.77:0/4055191593 learned_addr learned my addr 172.21.15.77:0/4055191593 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:07.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.391+0000 7ff9cf7fe640 1 --2- 172.21.15.77:0/4055191593 >> v2:172.21.15.122:3300/0 conn(0x7ff9d00b2210 0x7ff9d015d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:07.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.391+0000 7ff9d4f7f640 1 --2- 172.21.15.77:0/4055191593 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff9d00cf180 0x7ff9d00cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:07.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.392+0000 7ff9cffff640 1 -- 172.21.15.77:0/4055191593 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff9d00cf180 msgr2=0x7ff9d00cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:07.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.392+0000 7ff9cffff640 1 --2- 172.21.15.77:0/4055191593 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff9d00cf180 0x7ff9d00cf610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:07.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.392+0000 7ff9cffff640 1 -- 172.21.15.77:0/4055191593 >> v2:172.21.15.122:3300/0 conn(0x7ff9d00b2210 msgr2=0x7ff9d015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:07.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.392+0000 7ff9cffff640 1 --2- 172.21.15.77:0/4055191593 >> v2:172.21.15.122:3300/0 conn(0x7ff9d00b2210 0x7ff9d015d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:07.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.392+0000 7ff9cffff640 1 -- 172.21.15.77:0/4055191593 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d00b1170 con 0x7ff9d00ceda0 2023-11-04T01:46:07.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.392+0000 7ff9cffff640 1 --2- 172.21.15.77:0/4055191593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9d00ceda0 0x7ff9d015cf20 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00b3770 tx=0x7ff9c002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=509d0a46a9a8652a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:07.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.392+0000 7ff9ceffd640 1 -- 172.21.15.77:0/4055191593 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c0004230 con 0x7ff9d00ceda0 2023-11-04T01:46:07.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.392+0000 7ff9ceffd640 1 -- 172.21.15.77:0/4055191593 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c0004390 con 0x7ff9d00ceda0 2023-11-04T01:46:07.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.392+0000 7ff9ceffd640 1 -- 172.21.15.77:0/4055191593 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c0003810 con 0x7ff9d00ceda0 2023-11-04T01:46:07.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.393+0000 7ff9d69e2640 1 -- 172.21.15.77:0/4055191593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9d00ceda0 msgr2=0x7ff9d015cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:07.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.393+0000 7ff9d69e2640 1 --2- 172.21.15.77:0/4055191593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9d00ceda0 0x7ff9d015cf20 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00b3770 tx=0x7ff9c002b860 comp rx=0 tx=0).stop 2023-11-04T01:46:07.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.393+0000 7ff9d69e2640 1 -- 172.21.15.77:0/4055191593 shutdown_connections 2023-11-04T01:46:07.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.393+0000 7ff9d69e2640 1 --2- 172.21.15.77:0/4055191593 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff9d00cf180 0x7ff9d00cf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:07.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.393+0000 7ff9d69e2640 1 --2- 172.21.15.77:0/4055191593 >> v2:172.21.15.122:3300/0 conn(0x7ff9d00b2210 0x7ff9d015d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:07.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.393+0000 7ff9d69e2640 1 --2- 172.21.15.77:0/4055191593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9d00ceda0 0x7ff9d015cf20 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:07.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.393+0000 7ff9d69e2640 1 -- 172.21.15.77:0/4055191593 >> 172.21.15.77:0/4055191593 conn(0x7ff9d00d0c30 msgr2=0x7ff9d00d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:07.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.393+0000 7ff9d69e2640 1 -- 172.21.15.77:0/4055191593 shutdown_connections 2023-11-04T01:46:07.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.393+0000 7ff9d69e2640 1 -- 172.21.15.77:0/4055191593 wait complete. 2023-11-04T01:46:07.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.394+0000 7ff9d69e2640 1 Processor -- start 2023-11-04T01:46:07.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.394+0000 7ff9d69e2640 1 -- start start 2023-11-04T01:46:07.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.395+0000 7ff9d69e2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff9d00b2210 0x7ff9d01f2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:07.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.395+0000 7ff9d69e2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff9d00ceda0 0x7ff9d00cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:07.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.395+0000 7ff9d69e2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9d00cf180 0x7ff9d0154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:07.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.395+0000 7ff9d69e2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d00c4620 con 0x7ff9d00cf180 2023-11-04T01:46:07.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.395+0000 7ff9d69e2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d01f3060 con 0x7ff9d00ceda0 2023-11-04T01:46:07.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.395+0000 7ff9d69e2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d01f3340 con 0x7ff9d00b2210 2023-11-04T01:46:07.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.395+0000 7ff9d4f7f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9d00cf180 0x7ff9d0154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:07.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.395+0000 7ff9d4f7f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9d00cf180 0x7ff9d0154d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54484/0 (socket says 172.21.15.77:54484) 2023-11-04T01:46:07.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.395+0000 7ff9d4f7f640 1 -- 172.21.15.77:0/3988468162 learned_addr learned my addr 172.21.15.77:0/3988468162 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:07.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.395+0000 7ff9cffff640 1 --2- 172.21.15.77:0/3988468162 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff9d00b2210 0x7ff9d01f2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:07.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.395+0000 7ff9cf7fe640 1 --2- 172.21.15.77:0/3988468162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff9d00ceda0 0x7ff9d00cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:07.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.396+0000 7ff9d4f7f640 1 -- 172.21.15.77:0/3988468162 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff9d00b2210 msgr2=0x7ff9d01f2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:07.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.396+0000 7ff9d4f7f640 1 --2- 172.21.15.77:0/3988468162 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff9d00b2210 0x7ff9d01f2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:07.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.396+0000 7ff9d4f7f640 1 -- 172.21.15.77:0/3988468162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff9d00ceda0 msgr2=0x7ff9d00cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:07.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.396+0000 7ff9d4f7f640 1 --2- 172.21.15.77:0/3988468162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff9d00ceda0 0x7ff9d00cdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:07.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.396+0000 7ff9d4f7f640 1 -- 172.21.15.77:0/3988468162 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c0009460 con 0x7ff9d00cf180 2023-11-04T01:46:07.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.396+0000 7ff9d4f7f640 1 --2- 172.21.15.77:0/3988468162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9d00cf180 0x7ff9d0154d50 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8007e60 tx=0x7ff9c800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:07.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.396+0000 7ff9ccff9640 1 -- 172.21.15.77:0/3988468162 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8014420 con 0x7ff9d00cf180 2023-11-04T01:46:07.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.396+0000 7ff9ccff9640 1 -- 172.21.15.77:0/3988468162 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c80145a0 con 0x7ff9d00cf180 2023-11-04T01:46:07.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.396+0000 7ff9d69e2640 1 -- 172.21.15.77:0/3988468162 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d01f3620 con 0x7ff9d00cf180 2023-11-04T01:46:07.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.396+0000 7ff9ccff9640 1 -- 172.21.15.77:0/3988468162 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8014950 con 0x7ff9d00cf180 2023-11-04T01:46:07.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.396+0000 7ff9d69e2640 1 -- 172.21.15.77:0/3988468162 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d0155290 con 0x7ff9d00cf180 2023-11-04T01:46:07.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.397+0000 7ff9d69e2640 1 -- 172.21.15.77:0/3988468162 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d00c47f0 con 0x7ff9d00cf180 2023-11-04T01:46:07.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.397+0000 7ff9ccff9640 1 -- 172.21.15.77:0/3988468162 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff9c8014ab0 con 0x7ff9d00cf180 2023-11-04T01:46:07.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.398+0000 7ff9ccff9640 1 --2- 172.21.15.77:0/3988468162 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff9bc06ae70 0x7ff9bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:07.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.398+0000 7ff9ccff9640 1 -- 172.21.15.77:0/3988468162 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7694+0+0 (secure 0 0 0) 0x7ff9c808a510 con 0x7ff9d00cf180 2023-11-04T01:46:07.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.398+0000 7ff9cffff640 1 --2- 172.21.15.77:0/3988468162 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff9bc06ae70 0x7ff9bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:07.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.398+0000 7ff9cffff640 1 --2- 172.21.15.77:0/3988468162 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff9bc06ae70 0x7ff9bc06d330 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0034000 tx=0x7ff9c0008030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:07.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.402+0000 7ff9ccff9640 1 -- 172.21.15.77:0/3988468162 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff9d00c47f0 con 0x7ff9d00cf180 2023-11-04T01:46:07.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.601+0000 7ff9d69e2640 1 -- 172.21.15.77:0/3988468162 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9d00b19e0 con 0x7ff9d00cf180 2023-11-04T01:46:07.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.601+0000 7ff9ccff9640 1 -- 172.21.15.77:0/3988468162 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4944 (secure 0 0 0) 0x7ff9c80589d0 con 0x7ff9d00cf180 2023-11-04T01:46:07.603 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:46:07.604 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":90,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8139,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2107153526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2107153526},{"type":"v1","addr":"172.21.15.77:6835","nonce":2107153526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:46:02.609248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7977,"mds_1":6814},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6814":{"gid":6814,"name":"b","rank":1,"incarnation":88,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.122:6836/1450731169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1450731169},{"type":"v1","addr":"172.21.15.122:6836","nonce":1450731169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7977":{"gid":7977,"name":"a","rank":0,"incarnation":85,"state":"up:reconnect","state_seq":10,"addr":"172.21.15.77:6834/3276812155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3276812155},{"type":"v1","addr":"172.21.15.77:6834","nonce":3276812155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:07.604 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 90 2023-11-04T01:46:07.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.603+0000 7ff9d69e2640 1 -- 172.21.15.77:0/3988468162 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff9bc06ae70 msgr2=0x7ff9bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:07.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.603+0000 7ff9d69e2640 1 --2- 172.21.15.77:0/3988468162 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff9bc06ae70 0x7ff9bc06d330 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0034000 tx=0x7ff9c0008030 comp rx=0 tx=0).stop 2023-11-04T01:46:07.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.603+0000 7ff9d69e2640 1 -- 172.21.15.77:0/3988468162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9d00cf180 msgr2=0x7ff9d0154d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:07.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.603+0000 7ff9d69e2640 1 --2- 172.21.15.77:0/3988468162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9d00cf180 0x7ff9d0154d50 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8007e60 tx=0x7ff9c800e4b0 comp rx=0 tx=0).stop 2023-11-04T01:46:07.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.603+0000 7ff9d69e2640 1 -- 172.21.15.77:0/3988468162 shutdown_connections 2023-11-04T01:46:07.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.603+0000 7ff9d69e2640 1 --2- 172.21.15.77:0/3988468162 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff9bc06ae70 0x7ff9bc06d330 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:07.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.603+0000 7ff9d69e2640 1 --2- 172.21.15.77:0/3988468162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9d00cf180 0x7ff9d0154d50 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:07.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.603+0000 7ff9d69e2640 1 --2- 172.21.15.77:0/3988468162 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff9d00ceda0 0x7ff9d00cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:07.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.603+0000 7ff9d69e2640 1 --2- 172.21.15.77:0/3988468162 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff9d00b2210 0x7ff9d01f2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:07.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.603+0000 7ff9d69e2640 1 -- 172.21.15.77:0/3988468162 >> 172.21.15.77:0/3988468162 conn(0x7ff9d00d0c30 msgr2=0x7ff9d006f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:07.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.603+0000 7ff9d69e2640 1 -- 172.21.15.77:0/3988468162 shutdown_connections 2023-11-04T01:46:07.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:07.603+0000 7ff9d69e2640 1 -- 172.21.15.77:0/3988468162 wait complete. 2023-11-04T01:46:07.616 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:46:08.617 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:08.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.725+0000 7fe985b1d640 1 Processor -- start 2023-11-04T01:46:08.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.725+0000 7fe985b1d640 1 -- start start 2023-11-04T01:46:08.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.726+0000 7fe985b1d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe98015b330 0x7fe9800cba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:08.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.726+0000 7fe985b1d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe9800b2160 0x7fe98006ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:08.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.726+0000 7fe985b1d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe98006ca60 0x7fe98006cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:08.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.726+0000 7fe985b1d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe98006d430 con 0x7fe98015b330 2023-11-04T01:46:08.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.726+0000 7fe985b1d640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9800cb5d0 con 0x7fe9800b2160 2023-11-04T01:46:08.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.726+0000 7fe985b1d640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98006f3f0 con 0x7fe98006ca60 2023-11-04T01:46:08.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.726+0000 7fe97f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe98015b330 0x7fe9800cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:08.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.726+0000 7fe97f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe98015b330 0x7fe9800cba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55614/0 (socket says 172.21.15.77:55614) 2023-11-04T01:46:08.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.726+0000 7fe97f7fe640 1 -- 172.21.15.77:0/2341339606 learned_addr learned my addr 172.21.15.77:0/2341339606 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:08.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.726+0000 7fe97effd640 1 --2- 172.21.15.77:0/2341339606 >> v2:172.21.15.122:3300/0 conn(0x7fe9800b2160 0x7fe98006ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:08.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.726+0000 7fe97ffff640 1 --2- 172.21.15.77:0/2341339606 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe98006ca60 0x7fe98006cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:08.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.726+0000 7fe97f7fe640 1 -- 172.21.15.77:0/2341339606 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe98006ca60 msgr2=0x7fe98006cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:08.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.726+0000 7fe97f7fe640 1 --2- 172.21.15.77:0/2341339606 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe98006ca60 0x7fe98006cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:08.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.726+0000 7fe97f7fe640 1 -- 172.21.15.77:0/2341339606 >> v2:172.21.15.122:3300/0 conn(0x7fe9800b2160 msgr2=0x7fe98006ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:08.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.726+0000 7fe97f7fe640 1 --2- 172.21.15.77:0/2341339606 >> v2:172.21.15.122:3300/0 conn(0x7fe9800b2160 0x7fe98006ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:08.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.726+0000 7fe97f7fe640 1 -- 172.21.15.77:0/2341339606 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9800c3490 con 0x7fe98015b330 2023-11-04T01:46:08.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.727+0000 7fe97f7fe640 1 --2- 172.21.15.77:0/2341339606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe98015b330 0x7fe9800cba60 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fe9800703d0 tx=0x7fe97002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34222d1c8ef75883 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:08.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.727+0000 7fe97e7fc640 1 -- 172.21.15.77:0/2341339606 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe970031870 con 0x7fe98015b330 2023-11-04T01:46:08.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.727+0000 7fe97e7fc640 1 -- 172.21.15.77:0/2341339606 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9700319d0 con 0x7fe98015b330 2023-11-04T01:46:08.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.727+0000 7fe97e7fc640 1 -- 172.21.15.77:0/2341339606 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe970031d60 con 0x7fe98015b330 2023-11-04T01:46:08.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.728+0000 7fe985b1d640 1 -- 172.21.15.77:0/2341339606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe98015b330 msgr2=0x7fe9800cba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:08.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.728+0000 7fe985b1d640 1 --2- 172.21.15.77:0/2341339606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe98015b330 0x7fe9800cba60 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fe9800703d0 tx=0x7fe97002b910 comp rx=0 tx=0).stop 2023-11-04T01:46:08.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.728+0000 7fe985b1d640 1 -- 172.21.15.77:0/2341339606 shutdown_connections 2023-11-04T01:46:08.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.728+0000 7fe985b1d640 1 --2- 172.21.15.77:0/2341339606 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe98006ca60 0x7fe98006cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:08.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.728+0000 7fe985b1d640 1 --2- 172.21.15.77:0/2341339606 >> v2:172.21.15.122:3300/0 conn(0x7fe9800b2160 0x7fe98006ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:08.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.728+0000 7fe985b1d640 1 --2- 172.21.15.77:0/2341339606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe98015b330 0x7fe9800cba60 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:08.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.728+0000 7fe985b1d640 1 -- 172.21.15.77:0/2341339606 >> 172.21.15.77:0/2341339606 conn(0x7fe9800b1640 msgr2=0x7fe9800b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:08.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.728+0000 7fe985b1d640 1 -- 172.21.15.77:0/2341339606 shutdown_connections 2023-11-04T01:46:08.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.728+0000 7fe985b1d640 1 -- 172.21.15.77:0/2341339606 wait complete. 2023-11-04T01:46:08.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.729+0000 7fe985b1d640 1 Processor -- start 2023-11-04T01:46:08.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.729+0000 7fe985b1d640 1 -- start start 2023-11-04T01:46:08.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.730+0000 7fe985b1d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe98006ca60 0x7fe980150980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:08.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.730+0000 7fe985b1d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9800b2160 0x7fe9800b2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:08.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.730+0000 7fe985b1d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe98015b330 0x7fe9800b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:08.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.730+0000 7fe985b1d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9801f0ac0 con 0x7fe98015b330 2023-11-04T01:46:08.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.730+0000 7fe985b1d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9800c9880 con 0x7fe9800b2160 2023-11-04T01:46:08.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.730+0000 7fe985b1d640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9801ee530 con 0x7fe98006ca60 2023-11-04T01:46:08.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.730+0000 7fe97ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe98015b330 0x7fe9800b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:08.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.730+0000 7fe97ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe98015b330 0x7fe9800b2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55630/0 (socket says 172.21.15.77:55630) 2023-11-04T01:46:08.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.730+0000 7fe97ffff640 1 -- 172.21.15.77:0/3824985447 learned_addr learned my addr 172.21.15.77:0/3824985447 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:08.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.730+0000 7fe97effd640 1 --2- 172.21.15.77:0/3824985447 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9800b2160 0x7fe9800b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:08.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.730+0000 7fe97f7fe640 1 --2- 172.21.15.77:0/3824985447 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe98006ca60 0x7fe980150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:08.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.730+0000 7fe97ffff640 1 -- 172.21.15.77:0/3824985447 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe98006ca60 msgr2=0x7fe980150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:08.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.730+0000 7fe97ffff640 1 --2- 172.21.15.77:0/3824985447 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe98006ca60 0x7fe980150980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:08.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.730+0000 7fe97ffff640 1 -- 172.21.15.77:0/3824985447 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9800b2160 msgr2=0x7fe9800b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:08.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.730+0000 7fe97ffff640 1 --2- 172.21.15.77:0/3824985447 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9800b2160 0x7fe9800b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:08.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.730+0000 7fe97ffff640 1 -- 172.21.15.77:0/3824985447 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9700094d0 con 0x7fe98015b330 2023-11-04T01:46:08.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.730+0000 7fe97f7fe640 1 --2- 172.21.15.77:0/3824985447 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe98006ca60 0x7fe980150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:08.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.730+0000 7fe97effd640 1 --2- 172.21.15.77:0/3824985447 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9800b2160 0x7fe9800b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:08.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.731+0000 7fe97ffff640 1 --2- 172.21.15.77:0/3824985447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe98015b330 0x7fe9800b2cb0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fe978007d20 tx=0x7fe97800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:08.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.731+0000 7fe967fff640 1 -- 172.21.15.77:0/3824985447 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe978014420 con 0x7fe98015b330 2023-11-04T01:46:08.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.731+0000 7fe967fff640 1 -- 172.21.15.77:0/3824985447 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9780145a0 con 0x7fe98015b330 2023-11-04T01:46:08.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.731+0000 7fe985b1d640 1 -- 172.21.15.77:0/3824985447 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9800c3b30 con 0x7fe98015b330 2023-11-04T01:46:08.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.731+0000 7fe967fff640 1 -- 172.21.15.77:0/3824985447 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe978014950 con 0x7fe98015b330 2023-11-04T01:46:08.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.731+0000 7fe985b1d640 1 -- 172.21.15.77:0/3824985447 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9801f0cd0 con 0x7fe98015b330 2023-11-04T01:46:08.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.732+0000 7fe985b1d640 1 -- 172.21.15.77:0/3824985447 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe98006da20 con 0x7fe98015b330 2023-11-04T01:46:08.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.732+0000 7fe967fff640 1 -- 172.21.15.77:0/3824985447 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe978014ab0 con 0x7fe98015b330 2023-11-04T01:46:08.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.733+0000 7fe967fff640 1 --2- 172.21.15.77:0/3824985447 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe96c06ae70 0x7fe96c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:08.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.733+0000 7fe967fff640 1 -- 172.21.15.77:0/3824985447 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7694+0+0 (secure 0 0 0) 0x7fe97808a590 con 0x7fe98015b330 2023-11-04T01:46:08.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.733+0000 7fe97f7fe640 1 --2- 172.21.15.77:0/3824985447 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe96c06ae70 0x7fe96c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:08.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.733+0000 7fe97f7fe640 1 --2- 172.21.15.77:0/3824985447 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe96c06ae70 0x7fe96c06d330 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe970036000 tx=0x7fe97003c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:08.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.737+0000 7fe967fff640 1 -- 172.21.15.77:0/3824985447 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe978054f10 con 0x7fe98015b330 2023-11-04T01:46:08.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.936+0000 7fe985b1d640 1 -- 172.21.15.77:0/3824985447 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9800684b0 con 0x7fe98015b330 2023-11-04T01:46:08.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.936+0000 7fe967fff640 1 -- 172.21.15.77:0/3824985447 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4944 (secure 0 0 0) 0x7fe978058530 con 0x7fe98015b330 2023-11-04T01:46:08.939 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:46:08.940 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":90,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8139,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2107153526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2107153526},{"type":"v1","addr":"172.21.15.77:6835","nonce":2107153526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:46:02.609248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7977,"mds_1":6814},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6814":{"gid":6814,"name":"b","rank":1,"incarnation":88,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.122:6836/1450731169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1450731169},{"type":"v1","addr":"172.21.15.122:6836","nonce":1450731169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7977":{"gid":7977,"name":"a","rank":0,"incarnation":85,"state":"up:reconnect","state_seq":10,"addr":"172.21.15.77:6834/3276812155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3276812155},{"type":"v1","addr":"172.21.15.77:6834","nonce":3276812155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:08.940 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 90 2023-11-04T01:46:08.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.938+0000 7fe985b1d640 1 -- 172.21.15.77:0/3824985447 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe96c06ae70 msgr2=0x7fe96c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:08.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.938+0000 7fe985b1d640 1 --2- 172.21.15.77:0/3824985447 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe96c06ae70 0x7fe96c06d330 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe970036000 tx=0x7fe97003c040 comp rx=0 tx=0).stop 2023-11-04T01:46:08.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.938+0000 7fe985b1d640 1 -- 172.21.15.77:0/3824985447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe98015b330 msgr2=0x7fe9800b2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:08.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.938+0000 7fe985b1d640 1 --2- 172.21.15.77:0/3824985447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe98015b330 0x7fe9800b2cb0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fe978007d20 tx=0x7fe97800e4b0 comp rx=0 tx=0).stop 2023-11-04T01:46:08.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.938+0000 7fe985b1d640 1 -- 172.21.15.77:0/3824985447 shutdown_connections 2023-11-04T01:46:08.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.938+0000 7fe985b1d640 1 --2- 172.21.15.77:0/3824985447 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe96c06ae70 0x7fe96c06d330 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:08.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.938+0000 7fe985b1d640 1 --2- 172.21.15.77:0/3824985447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe98015b330 0x7fe9800b2cb0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:08.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.938+0000 7fe985b1d640 1 --2- 172.21.15.77:0/3824985447 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9800b2160 0x7fe9800b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:08.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.938+0000 7fe985b1d640 1 --2- 172.21.15.77:0/3824985447 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe98006ca60 0x7fe980150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:08.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.938+0000 7fe985b1d640 1 -- 172.21.15.77:0/3824985447 >> 172.21.15.77:0/3824985447 conn(0x7fe9800b1640 msgr2=0x7fe9800ca450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:08.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.938+0000 7fe985b1d640 1 -- 172.21.15.77:0/3824985447 shutdown_connections 2023-11-04T01:46:08.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:08.938+0000 7fe985b1d640 1 -- 172.21.15.77:0/3824985447 wait complete. 2023-11-04T01:46:08.951 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:46:09.953 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:10.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.061+0000 7f1073064640 1 Processor -- start 2023-11-04T01:46:10.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.061+0000 7f1073064640 1 -- start start 2023-11-04T01:46:10.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.062+0000 7f1073064640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f106c159e40 0x7f106c0b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:10.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.062+0000 7f1073064640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f106c071500 con 0x7f106c06bb60 2023-11-04T01:46:10.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.062+0000 7f1073064640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f106c15dae0 con 0x7f106c070700 2023-11-04T01:46:10.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.062+0000 7f1073064640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f106c070c60 con 0x7f106c159e40 2023-11-04T01:46:10.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.062+0000 7f106bfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f106c06bb60 0x7f106c06fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57434/0 (socket says 172.21.15.77:57434) 2023-11-04T01:46:10.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.062+0000 7f106bfff640 1 -- 172.21.15.77:0/3178582100 learned_addr learned my addr 172.21.15.77:0/3178582100 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:46:10.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.062+0000 7f1070e00640 1 --2- 172.21.15.77:0/3178582100 >> v2:172.21.15.122:3300/0 conn(0x7f106c159e40 0x7f106c0b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:10.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.062+0000 7f106b7fe640 1 -- 172.21.15.77:0/3178582100 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 689759795 0 0) 0x7f106c071500 con 0x7f106c06bb60 2023-11-04T01:46:10.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.062+0000 7f106b7fe640 1 -- 172.21.15.77:0/3178582100 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1054003520 con 0x7f106c06bb60 2023-11-04T01:46:10.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.062+0000 7f1070e00640 1 -- 172.21.15.77:0/3178582100 >> v1:172.21.15.122:6789/0 conn(0x7f106c070700 legacy=0x7f106c0cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:10.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.062+0000 7f1070e00640 1 -- 172.21.15.77:0/3178582100 >> v1:172.21.15.77:6789/0 conn(0x7f106c06bb60 legacy=0x7f106c06fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:10.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.062+0000 7f1070e00640 1 -- 172.21.15.77:0/3178582100 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106c070f40 con 0x7f106c159e40 2023-11-04T01:46:10.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.063+0000 7f1070e00640 1 --2- 172.21.15.77:0/3178582100 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f106c159e40 0x7f106c0b0530 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f105c0097a0 tx=0x7f105c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e148f495745c0e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:10.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.063+0000 7f106b7fe640 1 -- 172.21.15.77:0/3178582100 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c02e070 con 0x7f106c159e40 2023-11-04T01:46:10.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.063+0000 7f106b7fe640 1 -- 172.21.15.77:0/3178582100 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105c0315a0 con 0x7f106c159e40 2023-11-04T01:46:10.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.063+0000 7f106b7fe640 1 -- 172.21.15.77:0/3178582100 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c031930 con 0x7f106c159e40 2023-11-04T01:46:10.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.064+0000 7f1073064640 1 -- 172.21.15.77:0/3178582100 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f106c159e40 msgr2=0x7f106c0b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:10.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.064+0000 7f1073064640 1 --2- 172.21.15.77:0/3178582100 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f106c159e40 0x7f106c0b0530 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f105c0097a0 tx=0x7f105c02b840 comp rx=0 tx=0).stop 2023-11-04T01:46:10.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.064+0000 7f1073064640 1 -- 172.21.15.77:0/3178582100 shutdown_connections 2023-11-04T01:46:10.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.064+0000 7f1073064640 1 --2- 172.21.15.77:0/3178582100 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f106c159e40 0x7f106c0b0530 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:10.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.064+0000 7f1073064640 1 -- 172.21.15.77:0/3178582100 >> 172.21.15.77:0/3178582100 conn(0x7f106c0cb530 msgr2=0x7f106c0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:10.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.064+0000 7f1073064640 1 -- 172.21.15.77:0/3178582100 shutdown_connections 2023-11-04T01:46:10.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.064+0000 7f1073064640 1 -- 172.21.15.77:0/3178582100 wait complete. 2023-11-04T01:46:10.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.065+0000 7f1073064640 1 Processor -- start 2023-11-04T01:46:10.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.065+0000 7f1073064640 1 -- start start 2023-11-04T01:46:10.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.066+0000 7f1073064640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f106c06bb60 0x7f106c1ecd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:10.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.066+0000 7f1073064640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f106c070700 0x7f106c15b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:10.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.066+0000 7f1073064640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f106c159e40 0x7f106c15bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:10.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.066+0000 7f1073064640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106c153860 con 0x7f106c06bb60 2023-11-04T01:46:10.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.066+0000 7f1073064640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106c15c200 con 0x7f106c070700 2023-11-04T01:46:10.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.066+0000 7f1073064640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106c0c5030 con 0x7f106c159e40 2023-11-04T01:46:10.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.066+0000 7f1070e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f106c06bb60 0x7f106c1ecd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:10.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.066+0000 7f1070e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f106c06bb60 0x7f106c1ecd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55640/0 (socket says 172.21.15.77:55640) 2023-11-04T01:46:10.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.066+0000 7f1070e00640 1 -- 172.21.15.77:0/1608514107 learned_addr learned my addr 172.21.15.77:0/1608514107 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:10.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.067+0000 7f1070e00640 1 -- 172.21.15.77:0/1608514107 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f106c159e40 msgr2=0x7f106c15bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:10.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.067+0000 7f106bfff640 1 --2- 172.21.15.77:0/1608514107 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f106c070700 0x7f106c15b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:10.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.067+0000 7f1071601640 1 --2- 172.21.15.77:0/1608514107 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f106c159e40 0x7f106c15bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:10.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.067+0000 7f1070e00640 1 --2- 172.21.15.77:0/1608514107 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f106c159e40 0x7f106c15bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:10.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.067+0000 7f1070e00640 1 -- 172.21.15.77:0/1608514107 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f106c070700 msgr2=0x7f106c15b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:10.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.067+0000 7f1070e00640 1 --2- 172.21.15.77:0/1608514107 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f106c070700 0x7f106c15b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:10.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.067+0000 7f1070e00640 1 -- 172.21.15.77:0/1608514107 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105c009400 con 0x7f106c06bb60 2023-11-04T01:46:10.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.067+0000 7f1070e00640 1 --2- 172.21.15.77:0/1608514107 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f106c06bb60 0x7f106c1ecd90 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f105c034040 tx=0x7f105c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:10.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.067+0000 7f10697fa640 1 -- 172.21.15.77:0/1608514107 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c032840 con 0x7f106c06bb60 2023-11-04T01:46:10.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.067+0000 7f10697fa640 1 -- 172.21.15.77:0/1608514107 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105c031f00 con 0x7f106c06bb60 2023-11-04T01:46:10.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.067+0000 7f10697fa640 1 -- 172.21.15.77:0/1608514107 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c032be0 con 0x7f106c06bb60 2023-11-04T01:46:10.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.067+0000 7f1073064640 1 -- 172.21.15.77:0/1608514107 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f106c1f2fc0 con 0x7f106c06bb60 2023-11-04T01:46:10.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.067+0000 7f1073064640 1 -- 172.21.15.77:0/1608514107 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f106c1f3580 con 0x7f106c06bb60 2023-11-04T01:46:10.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.068+0000 7f1073064640 1 -- 172.21.15.77:0/1608514107 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f106c0684b0 con 0x7f106c06bb60 2023-11-04T01:46:10.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.068+0000 7f10697fa640 1 -- 172.21.15.77:0/1608514107 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f105c032d40 con 0x7f106c06bb60 2023-11-04T01:46:10.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.069+0000 7f10697fa640 1 --2- 172.21.15.77:0/1608514107 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f105806ae70 0x7f105806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:10.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.069+0000 7f10697fa640 1 -- 172.21.15.77:0/1608514107 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7694+0+0 (secure 0 0 0) 0x7f105c0abdb0 con 0x7f106c06bb60 2023-11-04T01:46:10.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.069+0000 7f106bfff640 1 --2- 172.21.15.77:0/1608514107 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f105806ae70 0x7f105806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:10.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.070+0000 7f106bfff640 1 --2- 172.21.15.77:0/1608514107 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f105806ae70 0x7f105806d330 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f106c0c56a0 tx=0x7f1060009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:10.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.073+0000 7f10697fa640 1 -- 172.21.15.77:0/1608514107 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f105c076620 con 0x7f106c06bb60 2023-11-04T01:46:10.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.273+0000 7f1073064640 1 -- 172.21.15.77:0/1608514107 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f106c0c5780 con 0x7f106c06bb60 2023-11-04T01:46:10.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.273+0000 7f10697fa640 1 -- 172.21.15.77:0/1608514107 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f105c080030 con 0x7f106c06bb60 2023-11-04T01:46:10.277 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:46:10.277 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":90,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8139,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2107153526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2107153526},{"type":"v1","addr":"172.21.15.77:6835","nonce":2107153526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:46:02.609248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7977,"mds_1":6814},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6814":{"gid":6814,"name":"b","rank":1,"incarnation":88,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.122:6836/1450731169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1450731169},{"type":"v1","addr":"172.21.15.122:6836","nonce":1450731169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7977":{"gid":7977,"name":"a","rank":0,"incarnation":85,"state":"up:reconnect","state_seq":10,"addr":"172.21.15.77:6834/3276812155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3276812155},{"type":"v1","addr":"172.21.15.77:6834","nonce":3276812155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:10.277 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 90 2023-11-04T01:46:10.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.275+0000 7f1073064640 1 -- 172.21.15.77:0/1608514107 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f105806ae70 msgr2=0x7f105806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:10.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.275+0000 7f1073064640 1 --2- 172.21.15.77:0/1608514107 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f105806ae70 0x7f105806d330 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f106c0c56a0 tx=0x7f1060009040 comp rx=0 tx=0).stop 2023-11-04T01:46:10.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.275+0000 7f1073064640 1 -- 172.21.15.77:0/1608514107 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f106c06bb60 msgr2=0x7f106c1ecd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:10.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.275+0000 7f1073064640 1 --2- 172.21.15.77:0/1608514107 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f106c06bb60 0x7f106c1ecd90 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f105c034040 tx=0x7f105c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:46:10.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.275+0000 7f1073064640 1 -- 172.21.15.77:0/1608514107 shutdown_connections 2023-11-04T01:46:10.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.275+0000 7f1073064640 1 --2- 172.21.15.77:0/1608514107 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f105806ae70 0x7f105806d330 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:10.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.275+0000 7f1073064640 1 --2- 172.21.15.77:0/1608514107 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f106c159e40 0x7f106c15bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:10.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.275+0000 7f1073064640 1 --2- 172.21.15.77:0/1608514107 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f106c070700 0x7f106c15b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:10.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.275+0000 7f1073064640 1 --2- 172.21.15.77:0/1608514107 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f106c06bb60 0x7f106c1ecd90 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:10.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.275+0000 7f1073064640 1 -- 172.21.15.77:0/1608514107 >> 172.21.15.77:0/1608514107 conn(0x7f106c0cb530 msgr2=0x7f106c06fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:10.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.275+0000 7f1073064640 1 -- 172.21.15.77:0/1608514107 shutdown_connections 2023-11-04T01:46:10.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:10.275+0000 7f1073064640 1 -- 172.21.15.77:0/1608514107 wait complete. 2023-11-04T01:46:10.289 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:46:11.290 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:11.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.400+0000 7f0215aaf640 1 Processor -- start 2023-11-04T01:46:11.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.400+0000 7f0215aaf640 1 -- start start 2023-11-04T01:46:11.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.401+0000 7f0215aaf640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f02100b30d0 0x7f02100b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:11.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.401+0000 7f0215aaf640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02100b3530 con 0x7f021015d1b0 2023-11-04T01:46:11.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.401+0000 7f0215aaf640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021006c950 con 0x7f02100b1270 2023-11-04T01:46:11.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.401+0000 7f0215aaf640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02100b1700 con 0x7f02100b30d0 2023-11-04T01:46:11.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.401+0000 7f020f7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f021015d1b0 0x7f021006c240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57436/0 (socket says 172.21.15.77:57436) 2023-11-04T01:46:11.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.401+0000 7f020f7fe640 1 -- 172.21.15.77:0/1565656095 learned_addr learned my addr 172.21.15.77:0/1565656095 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:46:11.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.401+0000 7f020effd640 1 --2- 172.21.15.77:0/1565656095 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f02100b30d0 0x7f02100b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:11.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.401+0000 7f020e7fc640 1 -- 172.21.15.77:0/1565656095 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2060943191 0 0) 0x7f02100b3530 con 0x7f021015d1b0 2023-11-04T01:46:11.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.401+0000 7f020e7fc640 1 -- 172.21.15.77:0/1565656095 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01fc003520 con 0x7f021015d1b0 2023-11-04T01:46:11.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.402+0000 7f020e7fc640 1 -- 172.21.15.77:0/1565656095 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 125082715 0 0) 0x7f021006c950 con 0x7f02100b1270 2023-11-04T01:46:11.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.402+0000 7f020e7fc640 1 -- 172.21.15.77:0/1565656095 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02100b3530 con 0x7f02100b1270 2023-11-04T01:46:11.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.402+0000 7f020e7fc640 1 -- 172.21.15.77:0/1565656095 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3797370163 0 0) 0x7f01fc003520 con 0x7f021015d1b0 2023-11-04T01:46:11.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.402+0000 7f020e7fc640 1 -- 172.21.15.77:0/1565656095 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f02100b30d0 msgr2=0x7f02100b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:11.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.402+0000 7f020e7fc640 1 --2- 172.21.15.77:0/1565656095 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f02100b30d0 0x7f02100b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:11.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.402+0000 7f020e7fc640 1 -- 172.21.15.77:0/1565656095 >> v1:172.21.15.122:6789/0 conn(0x7f02100b1270 legacy=0x7f021006a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:11.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.402+0000 7f020e7fc640 1 -- 172.21.15.77:0/1565656095 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02100b2310 con 0x7f021015d1b0 2023-11-04T01:46:11.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.402+0000 7f020e7fc640 1 -- 172.21.15.77:0/1565656095 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f02000017f0 con 0x7f021015d1b0 2023-11-04T01:46:11.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.402+0000 7f020e7fc640 1 -- 172.21.15.77:0/1565656095 >> v1:172.21.15.77:6789/0 conn(0x7f021015d1b0 legacy=0x7f021006c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:11.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.402+0000 7f020e7fc640 1 --2- 172.21.15.77:0/1565656095 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f02100b30d0 0x7f01fc003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:11.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.402+0000 7f020e7fc640 1 --2- 172.21.15.77:0/1565656095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01fc004090 0x7f01fc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:11.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.402+0000 7f020e7fc640 1 --2- 172.21.15.77:0/1565656095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01fc004d00 0x7f01fc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:11.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.402+0000 7f020e7fc640 1 -- 172.21.15.77:0/1565656095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02100b1700 con 0x7f01fc004d00 2023-11-04T01:46:11.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.402+0000 7f020e7fc640 1 -- 172.21.15.77:0/1565656095 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01fc00ba60 con 0x7f01fc004090 2023-11-04T01:46:11.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.402+0000 7f020e7fc640 1 -- 172.21.15.77:0/1565656095 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01fc00bc20 con 0x7f02100b30d0 2023-11-04T01:46:11.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.402+0000 7f020ffff640 1 --2- 172.21.15.77:0/1565656095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01fc004d00 0x7f01fc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:11.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.402+0000 7f020f7fe640 1 --2- 172.21.15.77:0/1565656095 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f02100b30d0 0x7f01fc003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:11.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.402+0000 7f020effd640 1 --2- 172.21.15.77:0/1565656095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01fc004090 0x7f01fc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:11.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.402+0000 7f020ffff640 1 -- 172.21.15.77:0/1565656095 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f02100b30d0 msgr2=0x7f01fc003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:11.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.402+0000 7f020ffff640 1 --2- 172.21.15.77:0/1565656095 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f02100b30d0 0x7f01fc003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:11.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.402+0000 7f020ffff640 1 -- 172.21.15.77:0/1565656095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01fc004090 msgr2=0x7f01fc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:11.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.402+0000 7f020ffff640 1 --2- 172.21.15.77:0/1565656095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01fc004090 0x7f01fc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:11.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.402+0000 7f020ffff640 1 -- 172.21.15.77:0/1565656095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01fc003520 con 0x7f01fc004d00 2023-11-04T01:46:11.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.402+0000 7f020effd640 1 --2- 172.21.15.77:0/1565656095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01fc004090 0x7f01fc0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:11.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.403+0000 7f020ffff640 1 --2- 172.21.15.77:0/1565656095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01fc004d00 0x7f01fc005180 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f0208001fd0 tx=0x7f01fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59129c5945646056 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:11.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.403+0000 7f020e7fc640 1 -- 172.21.15.77:0/1565656095 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0208003b70 con 0x7f01fc004d00 2023-11-04T01:46:11.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.403+0000 7f020e7fc640 1 -- 172.21.15.77:0/1565656095 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0208003cd0 con 0x7f01fc004d00 2023-11-04T01:46:11.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.403+0000 7f020e7fc640 1 -- 172.21.15.77:0/1565656095 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02080052f0 con 0x7f01fc004d00 2023-11-04T01:46:11.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.404+0000 7f0215aaf640 1 -- 172.21.15.77:0/1565656095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01fc004d00 msgr2=0x7f01fc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:11.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.404+0000 7f0215aaf640 1 --2- 172.21.15.77:0/1565656095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01fc004d00 0x7f01fc005180 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f0208001fd0 tx=0x7f01fc0057f0 comp rx=0 tx=0).stop 2023-11-04T01:46:11.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.404+0000 7f020ffff640 1 -- 172.21.15.77:0/1565656095 reap_dead start 2023-11-04T01:46:11.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.404+0000 7f0215aaf640 1 -- 172.21.15.77:0/1565656095 shutdown_connections 2023-11-04T01:46:11.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.404+0000 7f0215aaf640 1 -- 172.21.15.77:0/1565656095 >> 172.21.15.77:0/1565656095 conn(0x7f02100cbd30 msgr2=0x7f02100cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:11.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.404+0000 7f0215aaf640 1 -- 172.21.15.77:0/1565656095 shutdown_connections 2023-11-04T01:46:11.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.404+0000 7f0215aaf640 1 -- 172.21.15.77:0/1565656095 wait complete. 2023-11-04T01:46:11.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.405+0000 7f0215aaf640 1 Processor -- start 2023-11-04T01:46:11.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.405+0000 7f0215aaf640 1 -- start start 2023-11-04T01:46:11.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.406+0000 7f0215aaf640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01fc004d00 0x7f02100c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:11.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.406+0000 7f0215aaf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02100cce60 0x7f02100c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:11.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.406+0000 7f0215aaf640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f02100ce6c0 0x7f02100ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:11.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.406+0000 7f0215aaf640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02100cd640 con 0x7f02100cce60 2023-11-04T01:46:11.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.406+0000 7f0215aaf640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02100cd920 con 0x7f01fc004d00 2023-11-04T01:46:11.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.406+0000 7f0215aaf640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02100cdc00 con 0x7f02100ce6c0 2023-11-04T01:46:11.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.406+0000 7f020effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02100cce60 0x7f02100c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:11.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.406+0000 7f020effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02100cce60 0x7f02100c8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55664/0 (socket says 172.21.15.77:55664) 2023-11-04T01:46:11.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.406+0000 7f020effd640 1 -- 172.21.15.77:0/1732672659 learned_addr learned my addr 172.21.15.77:0/1732672659 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:11.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.406+0000 7f020ffff640 1 --2- 172.21.15.77:0/1732672659 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f02100ce6c0 0x7f02100ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:11.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.406+0000 7f020f7fe640 1 --2- 172.21.15.77:0/1732672659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01fc004d00 0x7f02100c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:11.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.406+0000 7f020effd640 1 -- 172.21.15.77:0/1732672659 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f02100ce6c0 msgr2=0x7f02100ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:11.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.406+0000 7f020effd640 1 --2- 172.21.15.77:0/1732672659 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f02100ce6c0 0x7f02100ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:11.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.406+0000 7f020effd640 1 -- 172.21.15.77:0/1732672659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01fc004d00 msgr2=0x7f02100c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:11.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.406+0000 7f020effd640 1 --2- 172.21.15.77:0/1732672659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01fc004d00 0x7f02100c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:11.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.406+0000 7f020effd640 1 -- 172.21.15.77:0/1732672659 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02100cdee0 con 0x7f02100cce60 2023-11-04T01:46:11.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.406+0000 7f020effd640 1 --2- 172.21.15.77:0/1732672659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02100cce60 0x7f02100c8140 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f01f8011600 tx=0x7f01f8011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:11.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.407+0000 7f0207fff640 1 -- 172.21.15.77:0/1732672659 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f800f920 con 0x7f02100cce60 2023-11-04T01:46:11.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.407+0000 7f0207fff640 1 -- 172.21.15.77:0/1732672659 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f800fa80 con 0x7f02100cce60 2023-11-04T01:46:11.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.407+0000 7f0207fff640 1 -- 172.21.15.77:0/1732672659 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f800fe10 con 0x7f02100cce60 2023-11-04T01:46:11.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.407+0000 7f0215aaf640 1 -- 172.21.15.77:0/1732672659 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02100ce1c0 con 0x7f02100cce60 2023-11-04T01:46:11.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.407+0000 7f0215aaf640 1 -- 172.21.15.77:0/1732672659 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02100c8680 con 0x7f02100cce60 2023-11-04T01:46:11.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.408+0000 7f0215aaf640 1 -- 172.21.15.77:0/1732672659 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02100ce350 con 0x7f02100cce60 2023-11-04T01:46:11.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.408+0000 7f0207fff640 1 -- 172.21.15.77:0/1732672659 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f01f8015460 con 0x7f02100cce60 2023-11-04T01:46:11.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.408+0000 7f0207fff640 1 --2- 172.21.15.77:0/1732672659 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f01f006ae70 0x7f01f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:11.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.409+0000 7f0207fff640 1 -- 172.21.15.77:0/1732672659 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f01f808a570 con 0x7f02100cce60 2023-11-04T01:46:11.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.409+0000 7f020f7fe640 1 --2- 172.21.15.77:0/1732672659 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f01f006ae70 0x7f01f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:11.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.409+0000 7f020f7fe640 1 --2- 172.21.15.77:0/1732672659 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f01f006ae70 0x7f01f006d330 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f0200000ef0 tx=0x7f0200009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:11.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.413+0000 7f0207fff640 1 -- 172.21.15.77:0/1732672659 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f01f8054ee0 con 0x7f02100cce60 2023-11-04T01:46:11.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.612+0000 7f0215aaf640 1 -- 172.21.15.77:0/1732672659 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0210066600 con 0x7f02100cce60 2023-11-04T01:46:11.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.613+0000 7f0207fff640 1 -- 172.21.15.77:0/1732672659 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f01f8058500 con 0x7f02100cce60 2023-11-04T01:46:11.616 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:46:11.616 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":90,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8139,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2107153526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2107153526},{"type":"v1","addr":"172.21.15.77:6835","nonce":2107153526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:46:02.609248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7977,"mds_1":6814},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6814":{"gid":6814,"name":"b","rank":1,"incarnation":88,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.122:6836/1450731169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1450731169},{"type":"v1","addr":"172.21.15.122:6836","nonce":1450731169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7977":{"gid":7977,"name":"a","rank":0,"incarnation":85,"state":"up:reconnect","state_seq":10,"addr":"172.21.15.77:6834/3276812155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3276812155},{"type":"v1","addr":"172.21.15.77:6834","nonce":3276812155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:11.617 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 90 2023-11-04T01:46:11.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.615+0000 7f0215aaf640 1 -- 172.21.15.77:0/1732672659 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f01f006ae70 msgr2=0x7f01f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:11.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.615+0000 7f0215aaf640 1 --2- 172.21.15.77:0/1732672659 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f01f006ae70 0x7f01f006d330 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f0200000ef0 tx=0x7f0200009040 comp rx=0 tx=0).stop 2023-11-04T01:46:11.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.615+0000 7f0215aaf640 1 -- 172.21.15.77:0/1732672659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02100cce60 msgr2=0x7f02100c8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:11.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.615+0000 7f0215aaf640 1 --2- 172.21.15.77:0/1732672659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02100cce60 0x7f02100c8140 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f01f8011600 tx=0x7f01f8011ac0 comp rx=0 tx=0).stop 2023-11-04T01:46:11.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.615+0000 7f0215aaf640 1 -- 172.21.15.77:0/1732672659 shutdown_connections 2023-11-04T01:46:11.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.615+0000 7f0215aaf640 1 --2- 172.21.15.77:0/1732672659 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f01f006ae70 0x7f01f006d330 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:11.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.615+0000 7f0215aaf640 1 --2- 172.21.15.77:0/1732672659 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f02100ce6c0 0x7f02100ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:11.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.615+0000 7f0215aaf640 1 --2- 172.21.15.77:0/1732672659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02100cce60 0x7f02100c8140 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:11.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.615+0000 7f0215aaf640 1 --2- 172.21.15.77:0/1732672659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01fc004d00 0x7f02100c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:11.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.615+0000 7f0215aaf640 1 -- 172.21.15.77:0/1732672659 >> 172.21.15.77:0/1732672659 conn(0x7f02100cbd30 msgr2=0x7f0210071750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:11.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.615+0000 7f0215aaf640 1 -- 172.21.15.77:0/1732672659 shutdown_connections 2023-11-04T01:46:11.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:11.615+0000 7f0215aaf640 1 -- 172.21.15.77:0/1732672659 wait complete. 2023-11-04T01:46:11.628 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:46:12.629 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:12.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.738+0000 7f2fefdc9640 1 Processor -- start 2023-11-04T01:46:12.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.738+0000 7f2fefdc9640 1 -- start start 2023-11-04T01:46:12.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.739+0000 7f2fefdc9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2fe80cc680 0x7f2fe80cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:12.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.739+0000 7f2fefdc9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2fe806c220 0x7f2fe80ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:12.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.739+0000 7f2fefdc9640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe80cd720 con 0x7f2fe80addd0 2023-11-04T01:46:12.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.739+0000 7f2fefdc9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fe80ae1b0 con 0x7f2fe80cc680 2023-11-04T01:46:12.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.739+0000 7f2fefdc9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe80ccb10 con 0x7f2fe806c220 2023-11-04T01:46:12.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.739+0000 7f2fed364640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2fe80cc680 0x7f2fe80cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:12.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.739+0000 7f2fed364640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2fe80cc680 0x7f2fe80cdbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55680/0 (socket says 172.21.15.77:55680) 2023-11-04T01:46:12.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.739+0000 7f2fed364640 1 -- 172.21.15.77:0/4012775957 learned_addr learned my addr 172.21.15.77:0/4012775957 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:12.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.739+0000 7f2fed364640 1 -- 172.21.15.77:0/4012775957 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2fe806c220 msgr2=0x7f2fe80ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:12.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.739+0000 7f2fee366640 1 --2- 172.21.15.77:0/4012775957 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2fe806c220 0x7f2fe80ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:12.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.739+0000 7f2fed364640 1 --2- 172.21.15.77:0/4012775957 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2fe806c220 0x7f2fe80ca2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:12.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.739+0000 7f2fed364640 1 -- 172.21.15.77:0/4012775957 >> v1:172.21.15.122:6789/0 conn(0x7f2fe80addd0 legacy=0x7f2fe806bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:12.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.739+0000 7f2fed364640 1 -- 172.21.15.77:0/4012775957 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe80ccdf0 con 0x7f2fe80cc680 2023-11-04T01:46:12.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.740+0000 7f2fed364640 1 --2- 172.21.15.77:0/4012775957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fe80cc680 0x7f2fe80cdbb0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f2fd800bb10 tx=0x7f2fd802e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bf63b9835acb254 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:12.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.740+0000 7f2fecb63640 1 -- 172.21.15.77:0/4012775957 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd802ee70 con 0x7f2fe80cc680 2023-11-04T01:46:12.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.740+0000 7f2fecb63640 1 -- 172.21.15.77:0/4012775957 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd8036440 con 0x7f2fe80cc680 2023-11-04T01:46:12.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.740+0000 7f2fecb63640 1 -- 172.21.15.77:0/4012775957 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd80367d0 con 0x7f2fe80cc680 2023-11-04T01:46:12.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.741+0000 7f2fefdc9640 1 -- 172.21.15.77:0/4012775957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fe80cc680 msgr2=0x7f2fe80cdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:12.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.741+0000 7f2fefdc9640 1 --2- 172.21.15.77:0/4012775957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fe80cc680 0x7f2fe80cdbb0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f2fd800bb10 tx=0x7f2fd802e0c0 comp rx=0 tx=0).stop 2023-11-04T01:46:12.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.741+0000 7f2fefdc9640 1 -- 172.21.15.77:0/4012775957 shutdown_connections 2023-11-04T01:46:12.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.741+0000 7f2fefdc9640 1 --2- 172.21.15.77:0/4012775957 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2fe806c220 0x7f2fe80ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:12.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.741+0000 7f2fefdc9640 1 --2- 172.21.15.77:0/4012775957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fe80cc680 0x7f2fe80cdbb0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:12.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.741+0000 7f2fefdc9640 1 -- 172.21.15.77:0/4012775957 >> 172.21.15.77:0/4012775957 conn(0x7f2fe80cb530 msgr2=0x7f2fe80cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:12.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.741+0000 7f2fefdc9640 1 -- 172.21.15.77:0/4012775957 shutdown_connections 2023-11-04T01:46:12.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.741+0000 7f2fefdc9640 1 -- 172.21.15.77:0/4012775957 wait complete. 2023-11-04T01:46:12.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.742+0000 7f2fefdc9640 1 Processor -- start 2023-11-04T01:46:12.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.742+0000 7f2fefdc9640 1 -- start start 2023-11-04T01:46:12.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.743+0000 7f2fefdc9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fe806c220 0x7f2fe8151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:12.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.743+0000 7f2fefdc9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2fe80addd0 0x7f2fe80c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:12.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.743+0000 7f2fefdc9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fe80c32e0 0x7f2fe81ef110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:12.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.743+0000 7f2fefdc9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe815a250 con 0x7f2fe80c32e0 2023-11-04T01:46:12.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.743+0000 7f2fefdc9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe81515b0 con 0x7f2fe806c220 2023-11-04T01:46:12.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.743+0000 7f2fefdc9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe80c3990 con 0x7f2fe80addd0 2023-11-04T01:46:12.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.743+0000 7f2fee366640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fe80c32e0 0x7f2fe81ef110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:12.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.743+0000 7f2fee366640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fe80c32e0 0x7f2fe81ef110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55694/0 (socket says 172.21.15.77:55694) 2023-11-04T01:46:12.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.743+0000 7f2fee366640 1 -- 172.21.15.77:0/1790560279 learned_addr learned my addr 172.21.15.77:0/1790560279 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:12.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.743+0000 7f2fedb65640 1 --2- 172.21.15.77:0/1790560279 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fe806c220 0x7f2fe8151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:12.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.743+0000 7f2fed364640 1 --2- 172.21.15.77:0/1790560279 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2fe80addd0 0x7f2fe80c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:12.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.743+0000 7f2fee366640 1 -- 172.21.15.77:0/1790560279 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2fe80addd0 msgr2=0x7f2fe80c49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:12.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.743+0000 7f2fee366640 1 --2- 172.21.15.77:0/1790560279 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2fe80addd0 0x7f2fe80c49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:12.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.743+0000 7f2fee366640 1 -- 172.21.15.77:0/1790560279 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fe806c220 msgr2=0x7f2fe8151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:12.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.743+0000 7f2fee366640 1 --2- 172.21.15.77:0/1790560279 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fe806c220 0x7f2fe8151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:12.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.743+0000 7f2fee366640 1 -- 172.21.15.77:0/1790560279 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd800b770 con 0x7f2fe80c32e0 2023-11-04T01:46:12.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.743+0000 7f2fee366640 1 --2- 172.21.15.77:0/1790560279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fe80c32e0 0x7f2fe81ef110 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f2fe000cc00 tx=0x7f2fe000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:12.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.744+0000 7f2fde7fc640 1 -- 172.21.15.77:0/1790560279 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe000ce10 con 0x7f2fe80c32e0 2023-11-04T01:46:12.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.744+0000 7f2fde7fc640 1 -- 172.21.15.77:0/1790560279 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe0003990 con 0x7f2fe80c32e0 2023-11-04T01:46:12.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.744+0000 7f2fefdc9640 1 -- 172.21.15.77:0/1790560279 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe80c3c30 con 0x7f2fe80c32e0 2023-11-04T01:46:12.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.744+0000 7f2fde7fc640 1 -- 172.21.15.77:0/1790560279 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0003d20 con 0x7f2fe80c32e0 2023-11-04T01:46:12.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.744+0000 7f2fefdc9640 1 -- 172.21.15.77:0/1790560279 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe80c41f0 con 0x7f2fe80c32e0 2023-11-04T01:46:12.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.745+0000 7f2fefdc9640 1 -- 172.21.15.77:0/1790560279 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fe80684b0 con 0x7f2fe80c32e0 2023-11-04T01:46:12.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.745+0000 7f2fde7fc640 1 -- 172.21.15.77:0/1790560279 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2fe0003e80 con 0x7f2fe80c32e0 2023-11-04T01:46:12.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.745+0000 7f2fde7fc640 1 --2- 172.21.15.77:0/1790560279 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2fcc06aea0 0x7f2fcc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:12.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.746+0000 7f2fde7fc640 1 -- 172.21.15.77:0/1790560279 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f2fe008a130 con 0x7f2fe80c32e0 2023-11-04T01:46:12.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.746+0000 7f2fedb65640 1 --2- 172.21.15.77:0/1790560279 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2fcc06aea0 0x7f2fcc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:12.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.746+0000 7f2fedb65640 1 --2- 172.21.15.77:0/1790560279 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2fcc06aea0 0x7f2fcc06d360 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4004ea0 tx=0x7f2fe4009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:12.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.750+0000 7f2fde7fc640 1 -- 172.21.15.77:0/1790560279 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2fe00549f0 con 0x7f2fe80c32e0 2023-11-04T01:46:12.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.949+0000 7f2fefdc9640 1 -- 172.21.15.77:0/1790560279 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2fe80b4a10 con 0x7f2fe80c32e0 2023-11-04T01:46:12.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.950+0000 7f2fde7fc640 1 -- 172.21.15.77:0/1790560279 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f2fe001d020 con 0x7f2fe80c32e0 2023-11-04T01:46:12.953 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:46:12.953 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":92,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8139,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2107153526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2107153526},{"type":"v1","addr":"172.21.15.77:6835","nonce":2107153526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:46:11.638244+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7977,"mds_1":6814},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6814":{"gid":6814,"name":"b","rank":1,"incarnation":88,"state":"up:active","state_seq":8,"addr":"172.21.15.122:6836/1450731169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1450731169},{"type":"v1","addr":"172.21.15.122:6836","nonce":1450731169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7977":{"gid":7977,"name":"a","rank":0,"incarnation":85,"state":"up:active","state_seq":14,"addr":"172.21.15.77:6834/3276812155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3276812155},{"type":"v1","addr":"172.21.15.77:6834","nonce":3276812155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:12.954 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 92 2023-11-04T01:46:12.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.951+0000 7f2fefdc9640 1 -- 172.21.15.77:0/1790560279 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2fcc06aea0 msgr2=0x7f2fcc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:12.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.951+0000 7f2fefdc9640 1 --2- 172.21.15.77:0/1790560279 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2fcc06aea0 0x7f2fcc06d360 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4004ea0 tx=0x7f2fe4009040 comp rx=0 tx=0).stop 2023-11-04T01:46:12.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.951+0000 7f2fefdc9640 1 -- 172.21.15.77:0/1790560279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fe80c32e0 msgr2=0x7f2fe81ef110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:12.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.951+0000 7f2fefdc9640 1 --2- 172.21.15.77:0/1790560279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fe80c32e0 0x7f2fe81ef110 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f2fe000cc00 tx=0x7f2fe000a5c0 comp rx=0 tx=0).stop 2023-11-04T01:46:12.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.952+0000 7f2fefdc9640 1 -- 172.21.15.77:0/1790560279 shutdown_connections 2023-11-04T01:46:12.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.952+0000 7f2fefdc9640 1 --2- 172.21.15.77:0/1790560279 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2fcc06aea0 0x7f2fcc06d360 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:12.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.952+0000 7f2fefdc9640 1 --2- 172.21.15.77:0/1790560279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fe80c32e0 0x7f2fe81ef110 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:12.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.952+0000 7f2fefdc9640 1 --2- 172.21.15.77:0/1790560279 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2fe80addd0 0x7f2fe80c49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:12.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.952+0000 7f2fefdc9640 1 --2- 172.21.15.77:0/1790560279 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fe806c220 0x7f2fe8151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:12.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.952+0000 7f2fefdc9640 1 -- 172.21.15.77:0/1790560279 >> 172.21.15.77:0/1790560279 conn(0x7f2fe80cb530 msgr2=0x7f2fe8157860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:12.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.952+0000 7f2fefdc9640 1 -- 172.21.15.77:0/1790560279 shutdown_connections 2023-11-04T01:46:12.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:12.952+0000 7f2fefdc9640 1 -- 172.21.15.77:0/1790560279 wait complete. 2023-11-04T01:46:12.965 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:active 2023-11-04T01:46:12.965 DEBUG:tasks.cephfs.filesystem:reached state 'up:active' in 5.673605918884277s 2023-11-04T01:46:12.966 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:13.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.063+0000 7ff936226640 1 Processor -- start 2023-11-04T01:46:13.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.063+0000 7ff936226640 1 -- start start 2023-11-04T01:46:13.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.063+0000 7ff936226640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff93015d4e0 0x7ff9300d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:13.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.063+0000 7ff936226640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff9300d3b60 0x7ff9300d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:13.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.063+0000 7ff936226640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9300b32b0 con 0x7ff93015d100 2023-11-04T01:46:13.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.063+0000 7ff936226640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9300cec20 con 0x7ff93015d4e0 2023-11-04T01:46:13.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.063+0000 7ff936226640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9300cee10 con 0x7ff9300d3b60 2023-11-04T01:46:13.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.064+0000 7ff926ffd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff93015d4e0 0x7ff9300d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:13.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.064+0000 7ff92f7fe640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7ff93015d100 0x7ff9300ce510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:57312/0 (socket says 172.21.15.77:57312) 2023-11-04T01:46:13.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.064+0000 7ff92f7fe640 1 -- 172.21.15.77:0/3869780631 learned_addr learned my addr 172.21.15.77:0/3869780631 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:46:13.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.064+0000 7ff92ffff640 1 --2- 172.21.15.77:0/3869780631 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff9300d3b60 0x7ff9300d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:13.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.064+0000 7ff926ffd640 1 -- 172.21.15.77:0/3869780631 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff9300d3b60 msgr2=0x7ff9300d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:13.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.064+0000 7ff926ffd640 1 --2- 172.21.15.77:0/3869780631 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff9300d3b60 0x7ff9300d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:13.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.064+0000 7ff926ffd640 1 -- 172.21.15.77:0/3869780631 >> v1:172.21.15.122:6789/0 conn(0x7ff93015d100 legacy=0x7ff9300ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:13.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.064+0000 7ff926ffd640 1 -- 172.21.15.77:0/3869780631 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9300b4750 con 0x7ff93015d4e0 2023-11-04T01:46:13.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.065+0000 7ff926ffd640 1 --2- 172.21.15.77:0/3869780631 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff93015d4e0 0x7ff9300d14d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff9180097a0 tx=0x7ff91802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2482d0207e5173a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:13.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.065+0000 7ff92effd640 1 -- 172.21.15.77:0/3869780631 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff918031830 con 0x7ff93015d4e0 2023-11-04T01:46:13.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.065+0000 7ff92effd640 1 -- 172.21.15.77:0/3869780631 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff918031990 con 0x7ff93015d4e0 2023-11-04T01:46:13.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.065+0000 7ff92effd640 1 -- 172.21.15.77:0/3869780631 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff918031d20 con 0x7ff93015d4e0 2023-11-04T01:46:13.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.066+0000 7ff936226640 1 -- 172.21.15.77:0/3869780631 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff93015d4e0 msgr2=0x7ff9300d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:13.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.066+0000 7ff936226640 1 --2- 172.21.15.77:0/3869780631 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff93015d4e0 0x7ff9300d14d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff9180097a0 tx=0x7ff91802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:46:13.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.066+0000 7ff936226640 1 -- 172.21.15.77:0/3869780631 shutdown_connections 2023-11-04T01:46:13.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.066+0000 7ff936226640 1 --2- 172.21.15.77:0/3869780631 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff9300d3b60 0x7ff9300d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:13.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.066+0000 7ff936226640 1 --2- 172.21.15.77:0/3869780631 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff93015d4e0 0x7ff9300d14d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:13.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.066+0000 7ff936226640 1 -- 172.21.15.77:0/3869780631 >> 172.21.15.77:0/3869780631 conn(0x7ff9300d2ef0 msgr2=0x7ff9300d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:13.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.066+0000 7ff936226640 1 -- 172.21.15.77:0/3869780631 shutdown_connections 2023-11-04T01:46:13.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.066+0000 7ff936226640 1 -- 172.21.15.77:0/3869780631 wait complete. 2023-11-04T01:46:13.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.067+0000 7ff936226640 1 Processor -- start 2023-11-04T01:46:13.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.067+0000 7ff936226640 1 -- start start 2023-11-04T01:46:13.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.068+0000 7ff936226640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff9300d3b60 0x7ff93015a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:13.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.068+0000 7ff936226640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff93015d100 0x7ff9301f2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:13.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.068+0000 7ff936226640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff93015d4e0 0x7ff9300b6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:13.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.068+0000 7ff936226640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9301f34c0 con 0x7ff93015d100 2023-11-04T01:46:13.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.068+0000 7ff936226640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9301f37a0 con 0x7ff93015d4e0 2023-11-04T01:46:13.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.068+0000 7ff936226640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9301f3a80 con 0x7ff9300d3b60 2023-11-04T01:46:13.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.068+0000 7ff926ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff93015d100 0x7ff9301f2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:13.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.068+0000 7ff926ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff93015d100 0x7ff9301f2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55696/0 (socket says 172.21.15.77:55696) 2023-11-04T01:46:13.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.068+0000 7ff926ffd640 1 -- 172.21.15.77:0/2575252609 learned_addr learned my addr 172.21.15.77:0/2575252609 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:13.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.068+0000 7ff92ffff640 1 --2- 172.21.15.77:0/2575252609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff93015d4e0 0x7ff9300b6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:13.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.068+0000 7ff92f7fe640 1 --2- 172.21.15.77:0/2575252609 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff9300d3b60 0x7ff93015a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:13.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.068+0000 7ff926ffd640 1 -- 172.21.15.77:0/2575252609 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff9300d3b60 msgr2=0x7ff93015a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:13.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.068+0000 7ff926ffd640 1 --2- 172.21.15.77:0/2575252609 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff9300d3b60 0x7ff93015a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:13.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.068+0000 7ff926ffd640 1 -- 172.21.15.77:0/2575252609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff93015d4e0 msgr2=0x7ff9300b6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:13.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.068+0000 7ff926ffd640 1 --2- 172.21.15.77:0/2575252609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff93015d4e0 0x7ff9300b6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:13.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.068+0000 7ff926ffd640 1 -- 172.21.15.77:0/2575252609 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff918009400 con 0x7ff93015d100 2023-11-04T01:46:13.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.068+0000 7ff926ffd640 1 --2- 172.21.15.77:0/2575252609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff93015d100 0x7ff9301f2b50 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7ff918000c00 tx=0x7ff9180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:13.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.069+0000 7ff92cff9640 1 -- 172.21.15.77:0/2575252609 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91803a830 con 0x7ff93015d100 2023-11-04T01:46:13.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.069+0000 7ff92cff9640 1 -- 172.21.15.77:0/2575252609 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91803a9b0 con 0x7ff93015d100 2023-11-04T01:46:13.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.069+0000 7ff936226640 1 -- 172.21.15.77:0/2575252609 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9300b5b10 con 0x7ff93015d100 2023-11-04T01:46:13.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.069+0000 7ff92cff9640 1 -- 172.21.15.77:0/2575252609 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91803ad60 con 0x7ff93015d100 2023-11-04T01:46:13.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.069+0000 7ff936226640 1 -- 172.21.15.77:0/2575252609 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff93015abd0 con 0x7ff93015d100 2023-11-04T01:46:13.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.070+0000 7ff936226640 1 -- 172.21.15.77:0/2575252609 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9300b6030 con 0x7ff93015d100 2023-11-04T01:46:13.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.070+0000 7ff92cff9640 1 -- 172.21.15.77:0/2575252609 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff91804d450 con 0x7ff93015d100 2023-11-04T01:46:13.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.070+0000 7ff92cff9640 1 --2- 172.21.15.77:0/2575252609 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff91006ae70 0x7ff91006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:13.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.071+0000 7ff92cff9640 1 -- 172.21.15.77:0/2575252609 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7737+0+0 (secure 0 0 0) 0x7ff9180abc80 con 0x7ff93015d100 2023-11-04T01:46:13.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.071+0000 7ff92f7fe640 1 --2- 172.21.15.77:0/2575252609 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff91006ae70 0x7ff91006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:13.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.071+0000 7ff92f7fe640 1 --2- 172.21.15.77:0/2575252609 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff91006ae70 0x7ff91006d330 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7ff9200058d0 tx=0x7ff920009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:13.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.075+0000 7ff92cff9640 1 -- 172.21.15.77:0/2575252609 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff9300b6030 con 0x7ff93015d100 2023-11-04T01:46:13.198 INFO:tasks.ceph.mds.a.smithi077.stderr:2023-11-04T01:46:13.196+0000 7f757b6dc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:46:13.199 INFO:tasks.ceph.mds.a.smithi077.stderr:2023-11-04T01:46:13.196+0000 7f757b6dc640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:46:13.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.277+0000 7ff936226640 1 -- 172.21.15.77:0/2575252609 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9300b6030 con 0x7ff93015d100 2023-11-04T01:46:13.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.278+0000 7ff92cff9640 1 -- 172.21.15.77:0/2575252609 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4938 (secure 0 0 0) 0x7ff9300b6030 con 0x7ff93015d100 2023-11-04T01:46:13.281 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:46:13.281 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":92,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8139,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2107153526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2107153526},{"type":"v1","addr":"172.21.15.77:6835","nonce":2107153526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:46:11.638244+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7977,"mds_1":6814},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6814":{"gid":6814,"name":"b","rank":1,"incarnation":88,"state":"up:active","state_seq":8,"addr":"172.21.15.122:6836/1450731169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1450731169},{"type":"v1","addr":"172.21.15.122:6836","nonce":1450731169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7977":{"gid":7977,"name":"a","rank":0,"incarnation":85,"state":"up:active","state_seq":14,"addr":"172.21.15.77:6834/3276812155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3276812155},{"type":"v1","addr":"172.21.15.77:6834","nonce":3276812155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:13.281 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 92 2023-11-04T01:46:13.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.280+0000 7ff936226640 1 -- 172.21.15.77:0/2575252609 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff91006ae70 msgr2=0x7ff91006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:13.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.280+0000 7ff936226640 1 --2- 172.21.15.77:0/2575252609 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff91006ae70 0x7ff91006d330 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7ff9200058d0 tx=0x7ff920009040 comp rx=0 tx=0).stop 2023-11-04T01:46:13.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.280+0000 7ff936226640 1 -- 172.21.15.77:0/2575252609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff93015d100 msgr2=0x7ff9301f2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:13.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.280+0000 7ff936226640 1 --2- 172.21.15.77:0/2575252609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff93015d100 0x7ff9301f2b50 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7ff918000c00 tx=0x7ff9180046c0 comp rx=0 tx=0).stop 2023-11-04T01:46:13.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.280+0000 7ff936226640 1 -- 172.21.15.77:0/2575252609 shutdown_connections 2023-11-04T01:46:13.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.280+0000 7ff936226640 1 --2- 172.21.15.77:0/2575252609 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff91006ae70 0x7ff91006d330 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:13.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.280+0000 7ff936226640 1 --2- 172.21.15.77:0/2575252609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff93015d4e0 0x7ff9300b6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:13.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.280+0000 7ff936226640 1 --2- 172.21.15.77:0/2575252609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff93015d100 0x7ff9301f2b50 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:13.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.280+0000 7ff936226640 1 --2- 172.21.15.77:0/2575252609 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff9300d3b60 0x7ff93015a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:13.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.280+0000 7ff936226640 1 -- 172.21.15.77:0/2575252609 >> 172.21.15.77:0/2575252609 conn(0x7ff9300d2ef0 msgr2=0x7ff93006bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:13.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.280+0000 7ff936226640 1 -- 172.21.15.77:0/2575252609 shutdown_connections 2023-11-04T01:46:13.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.280+0000 7ff936226640 1 -- 172.21.15.77:0/2575252609 wait complete. 2023-11-04T01:46:13.293 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump snaps --server 2023-11-04T01:46:13.406 INFO:teuthology.orchestra.run.smithi077.stdout:{"last_snap":10,"last_created":5,"last_destroyed":9,"pending_noop":[],"snaps":[],"need_to_purge":{"17":[2,3,4,5,6,7,8,9]},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:46:13.407 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 9, "last_snap": 10, "need_to_purge": { "17": [ 2, 3, 4, 5, 6, 7, 8, 9 ] }, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [] } 2023-11-04T01:46:13.407 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-04T01:46:13.408 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:13.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.505+0000 7fd5521b6640 1 Processor -- start 2023-11-04T01:46:13.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.505+0000 7fd5521b6640 1 -- start start 2023-11-04T01:46:13.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.505+0000 7fd5521b6640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd54c06d9c0 0x7fd54c0710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:13.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.505+0000 7fd5521b6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd54c06c5f0 0x7fd54c071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:13.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.505+0000 7fd5521b6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd54c06cc90 con 0x7fd54c0ade00 2023-11-04T01:46:13.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.505+0000 7fd5521b6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd54c0b0c40 con 0x7fd54c06c5f0 2023-11-04T01:46:13.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.505+0000 7fd5521b6640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd54c071b50 con 0x7fd54c06d9c0 2023-11-04T01:46:13.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.505+0000 7fd54b7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd54c0ade00 0x7fd54c0b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57452/0 (socket says 172.21.15.77:57452) 2023-11-04T01:46:13.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.505+0000 7fd54b7fe640 1 -- 172.21.15.77:0/4080115231 learned_addr learned my addr 172.21.15.77:0/4080115231 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:46:13.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.505+0000 7fd54bfff640 1 --2- 172.21.15.77:0/4080115231 >> v2:172.21.15.77:3300/0 conn(0x7fd54c06c5f0 0x7fd54c071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:13.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.506+0000 7fd542ffd640 1 --2- 172.21.15.77:0/4080115231 >> v2:172.21.15.122:3300/0 conn(0x7fd54c06d9c0 0x7fd54c0710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:13.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.506+0000 7fd54affd640 1 -- 172.21.15.77:0/4080115231 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638621772 0 0) 0x7fd54c06cc90 con 0x7fd54c0ade00 2023-11-04T01:46:13.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.506+0000 7fd54affd640 1 -- 172.21.15.77:0/4080115231 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd538003520 con 0x7fd54c0ade00 2023-11-04T01:46:13.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.506+0000 7fd54bfff640 1 -- 172.21.15.77:0/4080115231 >> v2:172.21.15.122:3300/0 conn(0x7fd54c06d9c0 msgr2=0x7fd54c0710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:13.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.506+0000 7fd54bfff640 1 --2- 172.21.15.77:0/4080115231 >> v2:172.21.15.122:3300/0 conn(0x7fd54c06d9c0 0x7fd54c0710d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:13.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.506+0000 7fd54bfff640 1 -- 172.21.15.77:0/4080115231 >> v1:172.21.15.77:6789/0 conn(0x7fd54c0ade00 legacy=0x7fd54c0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:13.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.506+0000 7fd54bfff640 1 -- 172.21.15.77:0/4080115231 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54c0b0e60 con 0x7fd54c06c5f0 2023-11-04T01:46:13.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.507+0000 7fd54bfff640 1 --2- 172.21.15.77:0/4080115231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd54c06c5f0 0x7fd54c071610 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fd54c0c9080 tx=0x7fd54402bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a1eb74124e3899 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:13.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.507+0000 7fd54affd640 1 -- 172.21.15.77:0/4080115231 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54402cb60 con 0x7fd54c06c5f0 2023-11-04T01:46:13.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.507+0000 7fd54affd640 1 -- 172.21.15.77:0/4080115231 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54402ccc0 con 0x7fd54c06c5f0 2023-11-04T01:46:13.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.507+0000 7fd54affd640 1 -- 172.21.15.77:0/4080115231 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd544034660 con 0x7fd54c06c5f0 2023-11-04T01:46:13.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.507+0000 7fd5521b6640 1 -- 172.21.15.77:0/4080115231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd54c06c5f0 msgr2=0x7fd54c071610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:13.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.507+0000 7fd5521b6640 1 --2- 172.21.15.77:0/4080115231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd54c06c5f0 0x7fd54c071610 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fd54c0c9080 tx=0x7fd54402bdb0 comp rx=0 tx=0).stop 2023-11-04T01:46:13.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.507+0000 7fd5521b6640 1 -- 172.21.15.77:0/4080115231 shutdown_connections 2023-11-04T01:46:13.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.507+0000 7fd5521b6640 1 --2- 172.21.15.77:0/4080115231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd54c06c5f0 0x7fd54c071610 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:13.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.507+0000 7fd5521b6640 1 --2- 172.21.15.77:0/4080115231 >> v2:172.21.15.122:3300/0 conn(0x7fd54c06d9c0 0x7fd54c0710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:13.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.507+0000 7fd5521b6640 1 -- 172.21.15.77:0/4080115231 >> 172.21.15.77:0/4080115231 conn(0x7fd54c0cb530 msgr2=0x7fd54c0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:13.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.507+0000 7fd5521b6640 1 -- 172.21.15.77:0/4080115231 shutdown_connections 2023-11-04T01:46:13.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.507+0000 7fd5521b6640 1 -- 172.21.15.77:0/4080115231 wait complete. 2023-11-04T01:46:13.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.508+0000 7fd5521b6640 1 Processor -- start 2023-11-04T01:46:13.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.509+0000 7fd5521b6640 1 -- start start 2023-11-04T01:46:13.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.509+0000 7fd5521b6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd54c06c5f0 0x7fd54c1523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:13.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.509+0000 7fd5521b6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd54c06d9c0 0x7fd54c0ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:13.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.509+0000 7fd5521b6640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd54c0ade00 0x7fd54c0ace10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:13.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.509+0000 7fd5521b6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c1528e0 con 0x7fd54c06d9c0 2023-11-04T01:46:13.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.509+0000 7fd5521b6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c0c6010 con 0x7fd54c06c5f0 2023-11-04T01:46:13.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.509+0000 7fd5521b6640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c0c62f0 con 0x7fd54c0ade00 2023-11-04T01:46:13.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.509+0000 7fd542ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd54c06d9c0 0x7fd54c0ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:13.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.509+0000 7fd542ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd54c06d9c0 0x7fd54c0ac8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55712/0 (socket says 172.21.15.77:55712) 2023-11-04T01:46:13.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.509+0000 7fd542ffd640 1 -- 172.21.15.77:0/1385886224 learned_addr learned my addr 172.21.15.77:0/1385886224 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:13.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.510+0000 7fd54b7fe640 1 --2- 172.21.15.77:0/1385886224 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd54c06c5f0 0x7fd54c1523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:13.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.510+0000 7fd54bfff640 1 --2- 172.21.15.77:0/1385886224 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd54c0ade00 0x7fd54c0ace10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:13.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.510+0000 7fd542ffd640 1 -- 172.21.15.77:0/1385886224 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd54c0ade00 msgr2=0x7fd54c0ace10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:13.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.510+0000 7fd542ffd640 1 --2- 172.21.15.77:0/1385886224 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd54c0ade00 0x7fd54c0ace10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:13.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.510+0000 7fd542ffd640 1 -- 172.21.15.77:0/1385886224 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd54c06c5f0 msgr2=0x7fd54c1523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:13.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.510+0000 7fd542ffd640 1 --2- 172.21.15.77:0/1385886224 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd54c06c5f0 0x7fd54c1523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:13.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.510+0000 7fd542ffd640 1 -- 172.21.15.77:0/1385886224 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd544009a70 con 0x7fd54c06d9c0 2023-11-04T01:46:13.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.510+0000 7fd542ffd640 1 --2- 172.21.15.77:0/1385886224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd54c06d9c0 0x7fd54c0ac8d0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fd53400d5d0 tx=0x7fd53400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:13.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.510+0000 7fd548ff9640 1 -- 172.21.15.77:0/1385886224 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd534004240 con 0x7fd54c06d9c0 2023-11-04T01:46:13.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.510+0000 7fd548ff9640 1 -- 172.21.15.77:0/1385886224 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5340043a0 con 0x7fd54c06d9c0 2023-11-04T01:46:13.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.510+0000 7fd548ff9640 1 -- 172.21.15.77:0/1385886224 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd534003830 con 0x7fd54c06d9c0 2023-11-04T01:46:13.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.510+0000 7fd5521b6640 1 -- 172.21.15.77:0/1385886224 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd54c0c65d0 con 0x7fd54c06d9c0 2023-11-04T01:46:13.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.510+0000 7fd5521b6640 1 -- 172.21.15.77:0/1385886224 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd54c0c6b90 con 0x7fd54c06d9c0 2023-11-04T01:46:13.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.511+0000 7fd5521b6640 1 -- 172.21.15.77:0/1385886224 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd54c0684b0 con 0x7fd54c06d9c0 2023-11-04T01:46:13.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.511+0000 7fd548ff9640 1 -- 172.21.15.77:0/1385886224 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd534003990 con 0x7fd54c06d9c0 2023-11-04T01:46:13.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.512+0000 7fd548ff9640 1 --2- 172.21.15.77:0/1385886224 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd52c06ae70 0x7fd52c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:13.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.512+0000 7fd548ff9640 1 -- 172.21.15.77:0/1385886224 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7737+0+0 (secure 0 0 0) 0x7fd534089f80 con 0x7fd54c06d9c0 2023-11-04T01:46:13.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.512+0000 7fd54b7fe640 1 --2- 172.21.15.77:0/1385886224 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd52c06ae70 0x7fd52c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:13.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.512+0000 7fd54b7fe640 1 --2- 172.21.15.77:0/1385886224 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd52c06ae70 0x7fd52c06d330 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fd53c0011e0 tx=0x7fd53c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:13.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.516+0000 7fd548ff9640 1 -- 172.21.15.77:0/1385886224 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd5340bcca0 con 0x7fd54c06d9c0 2023-11-04T01:46:13.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.721+0000 7fd5521b6640 1 -- 172.21.15.77:0/1385886224 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd54c0cddc0 con 0x7fd54c06d9c0 2023-11-04T01:46:13.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.722+0000 7fd548ff9640 1 -- 172.21.15.77:0/1385886224 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4938 (secure 0 0 0) 0x7fd534054850 con 0x7fd54c06d9c0 2023-11-04T01:46:13.725 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:46:13.725 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":92,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8139,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2107153526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2107153526},{"type":"v1","addr":"172.21.15.77:6835","nonce":2107153526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:46:11.638244+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7977,"mds_1":6814},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6814":{"gid":6814,"name":"b","rank":1,"incarnation":88,"state":"up:active","state_seq":8,"addr":"172.21.15.122:6836/1450731169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1450731169},{"type":"v1","addr":"172.21.15.122:6836","nonce":1450731169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7977":{"gid":7977,"name":"a","rank":0,"incarnation":85,"state":"up:active","state_seq":14,"addr":"172.21.15.77:6834/3276812155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3276812155},{"type":"v1","addr":"172.21.15.77:6834","nonce":3276812155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:13.725 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 92 2023-11-04T01:46:13.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.724+0000 7fd5521b6640 1 -- 172.21.15.77:0/1385886224 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd52c06ae70 msgr2=0x7fd52c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:13.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.724+0000 7fd5521b6640 1 --2- 172.21.15.77:0/1385886224 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd52c06ae70 0x7fd52c06d330 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fd53c0011e0 tx=0x7fd53c009040 comp rx=0 tx=0).stop 2023-11-04T01:46:13.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.724+0000 7fd5521b6640 1 -- 172.21.15.77:0/1385886224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd54c06d9c0 msgr2=0x7fd54c0ac8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:13.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.724+0000 7fd5521b6640 1 --2- 172.21.15.77:0/1385886224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd54c06d9c0 0x7fd54c0ac8d0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fd53400d5d0 tx=0x7fd53400da90 comp rx=0 tx=0).stop 2023-11-04T01:46:13.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.724+0000 7fd5521b6640 1 -- 172.21.15.77:0/1385886224 shutdown_connections 2023-11-04T01:46:13.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.724+0000 7fd5521b6640 1 --2- 172.21.15.77:0/1385886224 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd52c06ae70 0x7fd52c06d330 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:13.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.724+0000 7fd5521b6640 1 --2- 172.21.15.77:0/1385886224 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd54c0ade00 0x7fd54c0ace10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:13.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.724+0000 7fd5521b6640 1 --2- 172.21.15.77:0/1385886224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd54c06d9c0 0x7fd54c0ac8d0 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:13.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.724+0000 7fd5521b6640 1 --2- 172.21.15.77:0/1385886224 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd54c06c5f0 0x7fd54c1523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:13.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.724+0000 7fd5521b6640 1 -- 172.21.15.77:0/1385886224 >> 172.21.15.77:0/1385886224 conn(0x7fd54c0cb530 msgr2=0x7fd54c15cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:13.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.724+0000 7fd5521b6640 1 -- 172.21.15.77:0/1385886224 shutdown_connections 2023-11-04T01:46:13.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:13.724+0000 7fd5521b6640 1 -- 172.21.15.77:0/1385886224 wait complete. 2023-11-04T01:46:13.737 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump snaps --server 2023-11-04T01:46:13.849 INFO:teuthology.orchestra.run.smithi077.stdout:{"last_snap":10,"last_created":5,"last_destroyed":9,"pending_noop":[],"snaps":[],"need_to_purge":{"17":[2,3,4,5,6,7,8,9]},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:46:13.850 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 9, "last_snap": 10, "need_to_purge": { "17": [ 2, 3, 4, 5, 6, 7, 8, 9 ] }, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [] } 2023-11-04T01:46:13.851 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:46:13.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:46:13.851 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 up 2023-11-04T01:46:13.878 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:46:13.879 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:46:13.938 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:46:14.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.075+0000 7fcb69b3c640 1 Processor -- start 2023-11-04T01:46:14.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.075+0000 7fcb69b3c640 1 -- start start 2023-11-04T01:46:14.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.075+0000 7fcb69b3c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fcb6415d100 0x7fcb640ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:14.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.075+0000 7fcb69b3c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcb640d1be0 0x7fcb640b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:14.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.075+0000 7fcb69b3c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb640b32b0 con 0x7fcb6415d4e0 2023-11-04T01:46:14.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.075+0000 7fcb69b3c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb640cee10 con 0x7fcb6415d100 2023-11-04T01:46:14.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.075+0000 7fcb69b3c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb640b2980 con 0x7fcb640d1be0 2023-11-04T01:46:14.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.076+0000 7fcb63fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcb640d1be0 0x7fcb640b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:14.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.076+0000 7fcb637fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fcb6415d100 0x7fcb640ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:14.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.076+0000 7fcb63fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcb640d1be0 0x7fcb640b3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:45882/0 (socket says 172.21.15.77:45882) 2023-11-04T01:46:14.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.076+0000 7fcb62ffd640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fcb6415d4e0 0x7fcb640d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:57316/0 (socket says 172.21.15.77:57316) 2023-11-04T01:46:14.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.076+0000 7fcb63fff640 1 -- 172.21.15.77:0/1306454057 learned_addr learned my addr 172.21.15.77:0/1306454057 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:14.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.076+0000 7fcb627fc640 1 -- 172.21.15.77:0/1306454057 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 779222380 0 0) 0x7fcb640b32b0 con 0x7fcb6415d4e0 2023-11-04T01:46:14.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.076+0000 7fcb627fc640 1 -- 172.21.15.77:0/1306454057 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb4c003520 con 0x7fcb6415d4e0 2023-11-04T01:46:14.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.076+0000 7fcb63fff640 1 -- 172.21.15.77:0/1306454057 >> v2:172.21.15.122:3300/0 conn(0x7fcb6415d100 msgr2=0x7fcb640ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:14.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.076+0000 7fcb63fff640 1 --2- 172.21.15.77:0/1306454057 >> v2:172.21.15.122:3300/0 conn(0x7fcb6415d100 0x7fcb640ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.076+0000 7fcb63fff640 1 -- 172.21.15.77:0/1306454057 >> v1:172.21.15.122:6789/0 conn(0x7fcb6415d4e0 legacy=0x7fcb640d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:14.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.076+0000 7fcb63fff640 1 -- 172.21.15.77:0/1306454057 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb640b2c60 con 0x7fcb640d1be0 2023-11-04T01:46:14.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.077+0000 7fcb63fff640 1 --2- 172.21.15.77:0/1306454057 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcb640d1be0 0x7fcb640b3740 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c009e50 tx=0x7fcb5c02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b0599c8ad50ac79 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:14.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.077+0000 7fcb627fc640 1 -- 172.21.15.77:0/1306454057 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c02cb00 con 0x7fcb640d1be0 2023-11-04T01:46:14.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.077+0000 7fcb627fc640 1 -- 172.21.15.77:0/1306454057 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5c02cc60 con 0x7fcb640d1be0 2023-11-04T01:46:14.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.077+0000 7fcb627fc640 1 -- 172.21.15.77:0/1306454057 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c0343f0 con 0x7fcb640d1be0 2023-11-04T01:46:14.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.078+0000 7fcb69b3c640 1 -- 172.21.15.77:0/1306454057 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcb640d1be0 msgr2=0x7fcb640b3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:14.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.078+0000 7fcb69b3c640 1 --2- 172.21.15.77:0/1306454057 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcb640d1be0 0x7fcb640b3740 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c009e50 tx=0x7fcb5c02bf60 comp rx=0 tx=0).stop 2023-11-04T01:46:14.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.078+0000 7fcb69b3c640 1 -- 172.21.15.77:0/1306454057 shutdown_connections 2023-11-04T01:46:14.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.078+0000 7fcb69b3c640 1 --2- 172.21.15.77:0/1306454057 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcb640d1be0 0x7fcb640b3740 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.078+0000 7fcb69b3c640 1 --2- 172.21.15.77:0/1306454057 >> v2:172.21.15.122:3300/0 conn(0x7fcb6415d100 0x7fcb640ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.078+0000 7fcb69b3c640 1 -- 172.21.15.77:0/1306454057 >> 172.21.15.77:0/1306454057 conn(0x7fcb640d2ef0 msgr2=0x7fcb640d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:14.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.078+0000 7fcb69b3c640 1 -- 172.21.15.77:0/1306454057 shutdown_connections 2023-11-04T01:46:14.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.078+0000 7fcb69b3c640 1 -- 172.21.15.77:0/1306454057 wait complete. 2023-11-04T01:46:14.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.079+0000 7fcb69b3c640 1 Processor -- start 2023-11-04T01:46:14.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.079+0000 7fcb69b3c640 1 -- start start 2023-11-04T01:46:14.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.080+0000 7fcb69b3c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb640d1be0 0x7fcb6406be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:14.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.080+0000 7fcb69b3c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb6415d100 0x7fcb641f5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:14.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.080+0000 7fcb69b3c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcb6415d4e0 0x7fcb64157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:14.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.080+0000 7fcb69b3c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb641f5cb0 con 0x7fcb6415d100 2023-11-04T01:46:14.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.080+0000 7fcb69b3c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6406add0 con 0x7fcb640d1be0 2023-11-04T01:46:14.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.080+0000 7fcb69b3c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6406b0b0 con 0x7fcb6415d4e0 2023-11-04T01:46:14.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.080+0000 7fcb62ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb6415d100 0x7fcb641f5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:14.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.080+0000 7fcb62ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb6415d100 0x7fcb641f5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55714/0 (socket says 172.21.15.77:55714) 2023-11-04T01:46:14.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.080+0000 7fcb62ffd640 1 -- 172.21.15.77:0/774886762 learned_addr learned my addr 172.21.15.77:0/774886762 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:14.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.080+0000 7fcb637fe640 1 --2- 172.21.15.77:0/774886762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb640d1be0 0x7fcb6406be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:14.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.080+0000 7fcb63fff640 1 --2- 172.21.15.77:0/774886762 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcb6415d4e0 0x7fcb64157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:14.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.080+0000 7fcb62ffd640 1 -- 172.21.15.77:0/774886762 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcb6415d4e0 msgr2=0x7fcb64157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:14.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.080+0000 7fcb62ffd640 1 --2- 172.21.15.77:0/774886762 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcb6415d4e0 0x7fcb64157830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.080+0000 7fcb62ffd640 1 -- 172.21.15.77:0/774886762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb640d1be0 msgr2=0x7fcb6406be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:14.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.080+0000 7fcb62ffd640 1 --2- 172.21.15.77:0/774886762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb640d1be0 0x7fcb6406be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.080+0000 7fcb62ffd640 1 -- 172.21.15.77:0/774886762 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb5c009b30 con 0x7fcb6415d100 2023-11-04T01:46:14.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.080+0000 7fcb62ffd640 1 --2- 172.21.15.77:0/774886762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb6415d100 0x7fcb641f5770 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fcb5800c430 tx=0x7fcb5800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:14.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.080+0000 7fcb4bfff640 1 -- 172.21.15.77:0/774886762 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb580074e0 con 0x7fcb6415d100 2023-11-04T01:46:14.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.081+0000 7fcb4bfff640 1 -- 172.21.15.77:0/774886762 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb58007660 con 0x7fcb6415d100 2023-11-04T01:46:14.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.081+0000 7fcb4bfff640 1 -- 172.21.15.77:0/774886762 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb58004a20 con 0x7fcb6415d100 2023-11-04T01:46:14.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.081+0000 7fcb69b3c640 1 -- 172.21.15.77:0/774886762 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb6406b390 con 0x7fcb6415d100 2023-11-04T01:46:14.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.081+0000 7fcb69b3c640 1 -- 172.21.15.77:0/774886762 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb6406b950 con 0x7fcb6415d100 2023-11-04T01:46:14.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.082+0000 7fcb69b3c640 1 -- 172.21.15.77:0/774886762 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb640684b0 con 0x7fcb6415d100 2023-11-04T01:46:14.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.082+0000 7fcb4bfff640 1 -- 172.21.15.77:0/774886762 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcb58004b80 con 0x7fcb6415d100 2023-11-04T01:46:14.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.082+0000 7fcb4bfff640 1 --2- 172.21.15.77:0/774886762 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcb5006ae70 0x7fcb5006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:14.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.082+0000 7fcb4bfff640 1 -- 172.21.15.77:0/774886762 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7737+0+0 (secure 0 0 0) 0x7fcb58089800 con 0x7fcb6415d100 2023-11-04T01:46:14.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.083+0000 7fcb637fe640 1 --2- 172.21.15.77:0/774886762 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcb5006ae70 0x7fcb5006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:14.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.083+0000 7fcb637fe640 1 --2- 172.21.15.77:0/774886762 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcb5006ae70 0x7fcb5006d330 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fcb640b45d0 tx=0x7fcb54008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:14.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.086+0000 7fcb4bfff640 1 -- 172.21.15.77:0/774886762 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcb58054150 con 0x7fcb6415d100 2023-11-04T01:46:14.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.254+0000 7fcb69b3c640 1 -- 172.21.15.77:0/774886762 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb640d2cd0 con 0x7fcb6415d100 2023-11-04T01:46:14.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.255+0000 7fcb4bfff640 1 -- 172.21.15.77:0/774886762 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+22955 (secure 0 0 0) 0x7fcb58057770 con 0x7fcb6415d100 2023-11-04T01:46:14.258 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:46:14.259 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":107,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:46:10.622777+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:33.159064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:33.647358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:43:24.372767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-04T01:43:25.241976+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":8,"snap_epoch":103,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.7","mappings":[{"from":0,"to":5}]},{"pgid":"17.3f","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/3032548059":"2023-11-04T02:46:09.897134+0000","172.21.15.77:6835/3207490604":"2023-11-05T01:46:01.591697+0000","172.21.15.77:6833/3207490604":"2023-11-05T01:46:01.591697+0000","172.21.15.122:6834/1345816612":"2023-11-05T01:45:54.789240+0000","172.21.15.77:6832/285184758":"2023-11-05T01:45:27.182069+0000","172.21.15.122:6836/2908314953":"2023-11-05T01:45:01.982045+0000","172.21.15.77:6834/285184758":"2023-11-05T01:45:27.182069+0000","172.21.15.122:6834/2908314953":"2023-11-05T01:45:01.982045+0000","172.21.15.77:6834/4241784871":"2023-11-05T01:44:36.807284+0000","172.21.15.77:6832/4241784871":"2023-11-05T01:44:36.807284+0000","172.21.15.122:6836/3699147778":"2023-11-05T01:44:11.242543+0000","172.21.15.122:6836/1345816612":"2023-11-05T01:45:54.789240+0000","172.21.15.122:6834/3699147778":"2023-11-05T01:44:11.242543+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:46:14.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.257+0000 7fcb69b3c640 1 -- 172.21.15.77:0/774886762 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcb5006ae70 msgr2=0x7fcb5006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:14.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.257+0000 7fcb69b3c640 1 --2- 172.21.15.77:0/774886762 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcb5006ae70 0x7fcb5006d330 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fcb640b45d0 tx=0x7fcb54008040 comp rx=0 tx=0).stop 2023-11-04T01:46:14.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.257+0000 7fcb69b3c640 1 -- 172.21.15.77:0/774886762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb6415d100 msgr2=0x7fcb641f5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:14.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.257+0000 7fcb69b3c640 1 --2- 172.21.15.77:0/774886762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb6415d100 0x7fcb641f5770 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fcb5800c430 tx=0x7fcb5800c8f0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.257+0000 7fcb69b3c640 1 -- 172.21.15.77:0/774886762 shutdown_connections 2023-11-04T01:46:14.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.257+0000 7fcb69b3c640 1 --2- 172.21.15.77:0/774886762 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcb5006ae70 0x7fcb5006d330 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.257+0000 7fcb69b3c640 1 --2- 172.21.15.77:0/774886762 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcb6415d4e0 0x7fcb64157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.257+0000 7fcb69b3c640 1 --2- 172.21.15.77:0/774886762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb6415d100 0x7fcb641f5770 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.257+0000 7fcb69b3c640 1 --2- 172.21.15.77:0/774886762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb640d1be0 0x7fcb6406be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.257+0000 7fcb69b3c640 1 -- 172.21.15.77:0/774886762 >> 172.21.15.77:0/774886762 conn(0x7fcb640d2ef0 msgr2=0x7fcb640b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:14.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.257+0000 7fcb69b3c640 1 -- 172.21.15.77:0/774886762 shutdown_connections 2023-11-04T01:46:14.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.257+0000 7fcb69b3c640 1 -- 172.21.15.77:0/774886762 wait complete. 2023-11-04T01:46:14.271 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:33.142176+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:42:33.159064+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:42:33.647358+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:43:24.372767+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:43:25.241976+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 8, 'snap_epoch': 103, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:46:14.272 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:46:14.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.372+0000 7fb308264640 1 Processor -- start 2023-11-04T01:46:14.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.372+0000 7fb308264640 1 -- start start 2023-11-04T01:46:14.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.373+0000 7fb308264640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb3000d1be0 0x7fb300167e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:14.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.373+0000 7fb308264640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3000b32b0 con 0x7fb30015d4e0 2023-11-04T01:46:14.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.373+0000 7fb308264640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3000cee10 con 0x7fb30015d100 2023-11-04T01:46:14.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.373+0000 7fb308264640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3000cec20 con 0x7fb3000d1be0 2023-11-04T01:46:14.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.373+0000 7fb3057ff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb30015d4e0 0x7fb3000d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57462/0 (socket says 172.21.15.77:57462) 2023-11-04T01:46:14.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.373+0000 7fb3057ff640 1 -- 172.21.15.77:0/3884580155 learned_addr learned my addr 172.21.15.77:0/3884580155 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:46:14.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.373+0000 7fb306801640 1 --2- 172.21.15.77:0/3884580155 >> v2:172.21.15.77:3300/0 conn(0x7fb3000d1be0 0x7fb300167e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:14.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.373+0000 7fb304ffe640 1 -- 172.21.15.77:0/3884580155 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2410633563 0 0) 0x7fb3000b32b0 con 0x7fb30015d4e0 2023-11-04T01:46:14.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.373+0000 7fb304ffe640 1 -- 172.21.15.77:0/3884580155 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2ec003520 con 0x7fb30015d4e0 2023-11-04T01:46:14.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.373+0000 7fb306801640 1 -- 172.21.15.77:0/3884580155 >> v1:172.21.15.122:6789/0 conn(0x7fb30015d100 legacy=0x7fb3000ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:14.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.373+0000 7fb306801640 1 -- 172.21.15.77:0/3884580155 >> v1:172.21.15.77:6789/0 conn(0x7fb30015d4e0 legacy=0x7fb3000d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:14.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.373+0000 7fb306801640 1 -- 172.21.15.77:0/3884580155 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3000b4750 con 0x7fb3000d1be0 2023-11-04T01:46:14.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.374+0000 7fb306801640 1 --2- 172.21.15.77:0/3884580155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3000d1be0 0x7fb300167e80 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8009d90 tx=0x7fb2f802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e584ec46dd581d71 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:14.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.374+0000 7fb304ffe640 1 -- 172.21.15.77:0/3884580155 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f802cc60 con 0x7fb3000d1be0 2023-11-04T01:46:14.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.374+0000 7fb304ffe640 1 -- 172.21.15.77:0/3884580155 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f802cdc0 con 0x7fb3000d1be0 2023-11-04T01:46:14.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.374+0000 7fb304ffe640 1 -- 172.21.15.77:0/3884580155 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8034640 con 0x7fb3000d1be0 2023-11-04T01:46:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.375+0000 7fb308264640 1 -- 172.21.15.77:0/3884580155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3000d1be0 msgr2=0x7fb300167e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.375+0000 7fb308264640 1 --2- 172.21.15.77:0/3884580155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3000d1be0 0x7fb300167e80 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8009d90 tx=0x7fb2f802beb0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.375+0000 7fb308264640 1 -- 172.21.15.77:0/3884580155 shutdown_connections 2023-11-04T01:46:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.375+0000 7fb308264640 1 --2- 172.21.15.77:0/3884580155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3000d1be0 0x7fb300167e80 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.375+0000 7fb308264640 1 -- 172.21.15.77:0/3884580155 >> 172.21.15.77:0/3884580155 conn(0x7fb3000d2ef0 msgr2=0x7fb3000d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:14.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.375+0000 7fb308264640 1 -- 172.21.15.77:0/3884580155 shutdown_connections 2023-11-04T01:46:14.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.375+0000 7fb308264640 1 -- 172.21.15.77:0/3884580155 wait complete. 2023-11-04T01:46:14.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.376+0000 7fb308264640 1 Processor -- start 2023-11-04T01:46:14.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.376+0000 7fb308264640 1 -- start start 2023-11-04T01:46:14.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.376+0000 7fb308264640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3000d1be0 0x7fb3000b7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:14.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.376+0000 7fb308264640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb30015d100 0x7fb30015f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:14.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.376+0000 7fb308264640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb30015d4e0 0x7fb3000cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:14.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.377+0000 7fb308264640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30015fb90 con 0x7fb3000d1be0 2023-11-04T01:46:14.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.377+0000 7fb308264640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3000cbae0 con 0x7fb30015d100 2023-11-04T01:46:14.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.377+0000 7fb308264640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3000b6160 con 0x7fb30015d4e0 2023-11-04T01:46:14.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.377+0000 7fb306000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3000d1be0 0x7fb3000b7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:14.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.377+0000 7fb306000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3000d1be0 0x7fb3000b7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55726/0 (socket says 172.21.15.77:55726) 2023-11-04T01:46:14.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.377+0000 7fb306000640 1 -- 172.21.15.77:0/3695078462 learned_addr learned my addr 172.21.15.77:0/3695078462 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:14.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.377+0000 7fb306000640 1 -- 172.21.15.77:0/3695078462 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb30015d4e0 msgr2=0x7fb3000cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:14.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.377+0000 7fb306000640 1 --2- 172.21.15.77:0/3695078462 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb30015d4e0 0x7fb3000cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.377+0000 7fb306000640 1 -- 172.21.15.77:0/3695078462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb30015d100 msgr2=0x7fb30015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:14.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.377+0000 7fb306000640 1 --2- 172.21.15.77:0/3695078462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb30015d100 0x7fb30015f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.377+0000 7fb306000640 1 -- 172.21.15.77:0/3695078462 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f8009a70 con 0x7fb3000d1be0 2023-11-04T01:46:14.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.377+0000 7fb306000640 1 --2- 172.21.15.77:0/3695078462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3000d1be0 0x7fb3000b7e80 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc004640 tx=0x7fb2fc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:14.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.377+0000 7fb2f67fc640 1 -- 172.21.15.77:0/3695078462 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc011790 con 0x7fb3000d1be0 2023-11-04T01:46:14.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.377+0000 7fb2f67fc640 1 -- 172.21.15.77:0/3695078462 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2fc0118f0 con 0x7fb3000d1be0 2023-11-04T01:46:14.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.377+0000 7fb2f67fc640 1 -- 172.21.15.77:0/3695078462 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc011ce0 con 0x7fb3000d1be0 2023-11-04T01:46:14.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.377+0000 7fb308264640 1 -- 172.21.15.77:0/3695078462 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3000b8580 con 0x7fb3000d1be0 2023-11-04T01:46:14.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.377+0000 7fb308264640 1 -- 172.21.15.77:0/3695078462 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3000b5df0 con 0x7fb3000d1be0 2023-11-04T01:46:14.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.378+0000 7fb308264640 1 -- 172.21.15.77:0/3695078462 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3000684b0 con 0x7fb3000d1be0 2023-11-04T01:46:14.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.379+0000 7fb2f67fc640 1 -- 172.21.15.77:0/3695078462 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb2fc012420 con 0x7fb3000d1be0 2023-11-04T01:46:14.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.379+0000 7fb2f67fc640 1 --2- 172.21.15.77:0/3695078462 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb2e406ae70 0x7fb2e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:14.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.379+0000 7fb2f67fc640 1 -- 172.21.15.77:0/3695078462 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7737+0+0 (secure 0 0 0) 0x7fb2fc089ac0 con 0x7fb3000d1be0 2023-11-04T01:46:14.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.379+0000 7fb3057ff640 1 --2- 172.21.15.77:0/3695078462 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb2e406ae70 0x7fb2e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:14.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.380+0000 7fb3057ff640 1 --2- 172.21.15.77:0/3695078462 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb2e406ae70 0x7fb2e406d330 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0000f60 tx=0x7fb2f00078f0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:14.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.383+0000 7fb2f67fc640 1 -- 172.21.15.77:0/3695078462 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb2fc054380 con 0x7fb3000d1be0 2023-11-04T01:46:14.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.548+0000 7fb308264640 1 -- 172.21.15.77:0/3695078462 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb3000d2cd0 con 0x7fb3000d1be0 2023-11-04T01:46:14.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.549+0000 7fb2f67fc640 1 -- 172.21.15.77:0/3695078462 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v107) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb2fc089e60 con 0x7fb3000d1be0 2023-11-04T01:46:14.552 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:46:14.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.550+0000 7fb308264640 1 -- 172.21.15.77:0/3695078462 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb2e406ae70 msgr2=0x7fb2e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:14.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.550+0000 7fb308264640 1 --2- 172.21.15.77:0/3695078462 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb2e406ae70 0x7fb2e406d330 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0000f60 tx=0x7fb2f00078f0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.550+0000 7fb308264640 1 -- 172.21.15.77:0/3695078462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3000d1be0 msgr2=0x7fb3000b7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:14.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.550+0000 7fb308264640 1 --2- 172.21.15.77:0/3695078462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3000d1be0 0x7fb3000b7e80 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc004640 tx=0x7fb2fc00c8e0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.551+0000 7fb308264640 1 -- 172.21.15.77:0/3695078462 shutdown_connections 2023-11-04T01:46:14.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.551+0000 7fb308264640 1 --2- 172.21.15.77:0/3695078462 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb2e406ae70 0x7fb2e406d330 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.551+0000 7fb308264640 1 --2- 172.21.15.77:0/3695078462 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb30015d4e0 0x7fb3000cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.551+0000 7fb308264640 1 --2- 172.21.15.77:0/3695078462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb30015d100 0x7fb30015f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.551+0000 7fb308264640 1 --2- 172.21.15.77:0/3695078462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3000d1be0 0x7fb3000b7e80 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.551+0000 7fb308264640 1 -- 172.21.15.77:0/3695078462 >> 172.21.15.77:0/3695078462 conn(0x7fb3000d2ef0 msgr2=0x7fb3000d32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:14.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.551+0000 7fb308264640 1 -- 172.21.15.77:0/3695078462 shutdown_connections 2023-11-04T01:46:14.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.551+0000 7fb308264640 1 -- 172.21.15.77:0/3695078462 wait complete. 2023-11-04T01:46:14.564 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:46:14.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.665+0000 7f31134a9640 1 Processor -- start 2023-11-04T01:46:14.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.666+0000 7f31134a9640 1 -- start start 2023-11-04T01:46:14.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.666+0000 7f31134a9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f310c15d4e0 0x7f310c0d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:14.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.666+0000 7f31134a9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f310c0d3b60 0x7f310c0d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:14.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.666+0000 7f31134a9640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f310c0b32b0 con 0x7f310c15d100 2023-11-04T01:46:14.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.666+0000 7f31134a9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f310c0cec20 con 0x7f310c0d3b60 2023-11-04T01:46:14.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.666+0000 7f31134a9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f310c0cee10 con 0x7f310c15d4e0 2023-11-04T01:46:14.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.667+0000 7f3111a46640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f310c0d3b60 0x7f310c0d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:14.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.667+0000 7f3111a46640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f310c0d3b60 0x7f310c0d1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55728/0 (socket says 172.21.15.77:55728) 2023-11-04T01:46:14.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.667+0000 7f3111a46640 1 -- 172.21.15.77:0/312085596 learned_addr learned my addr 172.21.15.77:0/312085596 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:14.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.667+0000 7f3111a46640 1 -- 172.21.15.77:0/312085596 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f310c15d4e0 msgr2=0x7f310c0d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:14.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.667+0000 7f3111a46640 1 --2- 172.21.15.77:0/312085596 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f310c15d4e0 0x7f310c0d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.667+0000 7f3111a46640 1 -- 172.21.15.77:0/312085596 >> v1:172.21.15.122:6789/0 conn(0x7f310c15d100 legacy=0x7f310c0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:14.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.667+0000 7f3111a46640 1 -- 172.21.15.77:0/312085596 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f310c0b4750 con 0x7f310c0d3b60 2023-11-04T01:46:14.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.668+0000 7f3111a46640 1 --2- 172.21.15.77:0/312085596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f310c0d3b60 0x7f310c0d1a10 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f3104009e50 tx=0x7f310402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d39058d68532db01 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:14.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.668+0000 7f3103fff640 1 -- 172.21.15.77:0/312085596 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310402ca70 con 0x7f310c0d3b60 2023-11-04T01:46:14.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.668+0000 7f3103fff640 1 -- 172.21.15.77:0/312085596 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310402cbd0 con 0x7f310c0d3b60 2023-11-04T01:46:14.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.668+0000 7f3103fff640 1 -- 172.21.15.77:0/312085596 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31040343f0 con 0x7f310c0d3b60 2023-11-04T01:46:14.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.668+0000 7f31134a9640 1 -- 172.21.15.77:0/312085596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f310c0d3b60 msgr2=0x7f310c0d1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:14.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.668+0000 7f31134a9640 1 --2- 172.21.15.77:0/312085596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f310c0d3b60 0x7f310c0d1a10 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f3104009e50 tx=0x7f310402bed0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.668+0000 7f31134a9640 1 -- 172.21.15.77:0/312085596 shutdown_connections 2023-11-04T01:46:14.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.668+0000 7f31134a9640 1 --2- 172.21.15.77:0/312085596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f310c0d3b60 0x7f310c0d1a10 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.668+0000 7f31134a9640 1 --2- 172.21.15.77:0/312085596 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f310c15d4e0 0x7f310c0d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.668+0000 7f31134a9640 1 -- 172.21.15.77:0/312085596 >> 172.21.15.77:0/312085596 conn(0x7f310c0d2ef0 msgr2=0x7f310c0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:14.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.668+0000 7f31134a9640 1 -- 172.21.15.77:0/312085596 shutdown_connections 2023-11-04T01:46:14.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.668+0000 7f31134a9640 1 -- 172.21.15.77:0/312085596 wait complete. 2023-11-04T01:46:14.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.669+0000 7f31134a9640 1 Processor -- start 2023-11-04T01:46:14.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.669+0000 7f31134a9640 1 -- start start 2023-11-04T01:46:14.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.670+0000 7f31134a9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f310c0d3b60 0x7f310c14e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:14.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.670+0000 7f31134a9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f310c15d100 0x7f310c0ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:14.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.670+0000 7f31134a9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f310c15d4e0 0x7f310c0b65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:14.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.670+0000 7f31134a9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310c14e880 con 0x7f310c0d3b60 2023-11-04T01:46:14.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.670+0000 7f31134a9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310c0b5390 con 0x7f310c15d100 2023-11-04T01:46:14.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.670+0000 7f31134a9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f310c0b5670 con 0x7f310c15d4e0 2023-11-04T01:46:14.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.670+0000 7f3111245640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f310c0d3b60 0x7f310c14e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:14.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.670+0000 7f3111245640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f310c0d3b60 0x7f310c14e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55736/0 (socket says 172.21.15.77:55736) 2023-11-04T01:46:14.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.670+0000 7f3111245640 1 -- 172.21.15.77:0/3355236292 learned_addr learned my addr 172.21.15.77:0/3355236292 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:14.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.670+0000 7f3111a46640 1 --2- 172.21.15.77:0/3355236292 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f310c15d4e0 0x7f310c0b65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:14.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.670+0000 7f3110a44640 1 --2- 172.21.15.77:0/3355236292 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f310c15d100 0x7f310c0ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:14.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.671+0000 7f3111245640 1 -- 172.21.15.77:0/3355236292 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f310c15d4e0 msgr2=0x7f310c0b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:14.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.671+0000 7f3111245640 1 --2- 172.21.15.77:0/3355236292 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f310c15d4e0 0x7f310c0b65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.671+0000 7f3111245640 1 -- 172.21.15.77:0/3355236292 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f310c15d100 msgr2=0x7f310c0ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:14.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.671+0000 7f3111245640 1 --2- 172.21.15.77:0/3355236292 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f310c15d100 0x7f310c0ccb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.671+0000 7f3111245640 1 -- 172.21.15.77:0/3355236292 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3104009b30 con 0x7f310c0d3b60 2023-11-04T01:46:14.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.671+0000 7f3110a44640 1 --2- 172.21.15.77:0/3355236292 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f310c15d100 0x7f310c0ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:14.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.671+0000 7f3111245640 1 --2- 172.21.15.77:0/3355236292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f310c0d3b60 0x7f310c14e340 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f310800c400 tx=0x7f310800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:14.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.671+0000 7f3101ffb640 1 -- 172.21.15.77:0/3355236292 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31080054e0 con 0x7f310c0d3b60 2023-11-04T01:46:14.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.671+0000 7f3101ffb640 1 -- 172.21.15.77:0/3355236292 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3108003640 con 0x7f310c0d3b60 2023-11-04T01:46:14.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.671+0000 7f31134a9640 1 -- 172.21.15.77:0/3355236292 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f310c0b5950 con 0x7f310c0d3b60 2023-11-04T01:46:14.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.671+0000 7f3101ffb640 1 -- 172.21.15.77:0/3355236292 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31080039f0 con 0x7f310c0d3b60 2023-11-04T01:46:14.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.671+0000 7f31134a9640 1 -- 172.21.15.77:0/3355236292 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f310c0b5f10 con 0x7f310c0d3b60 2023-11-04T01:46:14.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.672+0000 7f31134a9640 1 -- 172.21.15.77:0/3355236292 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f310c0684b0 con 0x7f310c0d3b60 2023-11-04T01:46:14.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.672+0000 7f3101ffb640 1 -- 172.21.15.77:0/3355236292 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3108003b50 con 0x7f310c0d3b60 2023-11-04T01:46:14.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.673+0000 7f3101ffb640 1 --2- 172.21.15.77:0/3355236292 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f30f006aea0 0x7f30f006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:14.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.673+0000 7f3101ffb640 1 -- 172.21.15.77:0/3355236292 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f31080893e0 con 0x7f310c0d3b60 2023-11-04T01:46:14.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.673+0000 7f3110a44640 1 --2- 172.21.15.77:0/3355236292 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f30f006aea0 0x7f30f006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:14.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.674+0000 7f3110a44640 1 --2- 172.21.15.77:0/3355236292 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f30f006aea0 0x7f30f006d360 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f310c0b0eb0 tx=0x7f30fc008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:14.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.677+0000 7f3101ffb640 1 -- 172.21.15.77:0/3355236292 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3108053ca0 con 0x7f310c0d3b60 2023-11-04T01:46:14.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.845+0000 7f31134a9640 1 -- 172.21.15.77:0/3355236292 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f310c0d2cd0 con 0x7f310c0d3b60 2023-11-04T01:46:14.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.845+0000 7f3101ffb640 1 -- 172.21.15.77:0/3355236292 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v107) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3108017020 con 0x7f310c0d3b60 2023-11-04T01:46:14.848 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:46:14.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.847+0000 7f31134a9640 1 -- 172.21.15.77:0/3355236292 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f30f006aea0 msgr2=0x7f30f006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:14.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.847+0000 7f31134a9640 1 --2- 172.21.15.77:0/3355236292 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f30f006aea0 0x7f30f006d360 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f310c0b0eb0 tx=0x7f30fc008040 comp rx=0 tx=0).stop 2023-11-04T01:46:14.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.847+0000 7f31134a9640 1 -- 172.21.15.77:0/3355236292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f310c0d3b60 msgr2=0x7f310c14e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:14.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.847+0000 7f31134a9640 1 --2- 172.21.15.77:0/3355236292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f310c0d3b60 0x7f310c14e340 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f310800c400 tx=0x7f310800c8c0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.847+0000 7f31134a9640 1 -- 172.21.15.77:0/3355236292 shutdown_connections 2023-11-04T01:46:14.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.847+0000 7f31134a9640 1 --2- 172.21.15.77:0/3355236292 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f30f006aea0 0x7f30f006d360 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.847+0000 7f31134a9640 1 --2- 172.21.15.77:0/3355236292 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f310c15d4e0 0x7f310c0b65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.847+0000 7f31134a9640 1 --2- 172.21.15.77:0/3355236292 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f310c15d100 0x7f310c0ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.847+0000 7f31134a9640 1 --2- 172.21.15.77:0/3355236292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f310c0d3b60 0x7f310c14e340 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.847+0000 7f31134a9640 1 -- 172.21.15.77:0/3355236292 >> 172.21.15.77:0/3355236292 conn(0x7f310c0d2ef0 msgr2=0x7f310c1601b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:14.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.847+0000 7f31134a9640 1 -- 172.21.15.77:0/3355236292 shutdown_connections 2023-11-04T01:46:14.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.847+0000 7f31134a9640 1 -- 172.21.15.77:0/3355236292 wait complete. 2023-11-04T01:46:14.860 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:46:14.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.960+0000 7faeb624b640 1 Processor -- start 2023-11-04T01:46:14.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.960+0000 7faeb624b640 1 -- start start 2023-11-04T01:46:14.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.961+0000 7faeb624b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7faeb006c5f0 0x7faeb0165ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:14.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.961+0000 7faeb624b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb006cc90 con 0x7faeb00ade00 2023-11-04T01:46:14.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.961+0000 7faeb624b640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb00b0e60 con 0x7faeb006d9c0 2023-11-04T01:46:14.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.961+0000 7faeb624b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb00b0c40 con 0x7faeb006c5f0 2023-11-04T01:46:14.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.961+0000 7faeaffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7faeb006c5f0 0x7faeb0165ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:14.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.961+0000 7faeaf7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7faeb00ade00 0x7faeb00b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57468/0 (socket says 172.21.15.77:57468) 2023-11-04T01:46:14.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.961+0000 7faeaffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7faeb006c5f0 0x7faeb0165ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55746/0 (socket says 172.21.15.77:55746) 2023-11-04T01:46:14.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.961+0000 7faeaf7fe640 1 -- 172.21.15.77:0/2352822896 learned_addr learned my addr 172.21.15.77:0/2352822896 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:46:14.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.961+0000 7faeaffff640 1 -- 172.21.15.77:0/2352822896 >> v1:172.21.15.122:6789/0 conn(0x7faeb006d9c0 legacy=0x7faeb00710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:14.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.961+0000 7faeaffff640 1 -- 172.21.15.77:0/2352822896 >> v1:172.21.15.77:6789/0 conn(0x7faeb00ade00 legacy=0x7faeb00b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:14.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.961+0000 7faeae7fc640 1 -- 172.21.15.77:0/2352822896 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1963797788 0 0) 0x7faeb006cc90 con 0x7faeb00ade00 2023-11-04T01:46:14.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.961+0000 7faeaffff640 1 -- 172.21.15.77:0/2352822896 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb006cee0 con 0x7faeb006c5f0 2023-11-04T01:46:14.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.962+0000 7faeaffff640 1 --2- 172.21.15.77:0/2352822896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faeb006c5f0 0x7faeb0165ce0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7faea8009d90 tx=0x7faea802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60ad739e344ef115 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:14.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.962+0000 7faeae7fc640 1 -- 172.21.15.77:0/2352822896 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea802cbd0 con 0x7faeb006c5f0 2023-11-04T01:46:14.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.962+0000 7faeae7fc640 1 -- 172.21.15.77:0/2352822896 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea802cd30 con 0x7faeb006c5f0 2023-11-04T01:46:14.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.962+0000 7faeae7fc640 1 -- 172.21.15.77:0/2352822896 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea802cea0 con 0x7faeb006c5f0 2023-11-04T01:46:14.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.963+0000 7faeb624b640 1 -- 172.21.15.77:0/2352822896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faeb006c5f0 msgr2=0x7faeb0165ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:14.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.963+0000 7faeb624b640 1 --2- 172.21.15.77:0/2352822896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faeb006c5f0 0x7faeb0165ce0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7faea8009d90 tx=0x7faea802be20 comp rx=0 tx=0).stop 2023-11-04T01:46:14.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.963+0000 7faeb624b640 1 -- 172.21.15.77:0/2352822896 shutdown_connections 2023-11-04T01:46:14.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.963+0000 7faeb624b640 1 --2- 172.21.15.77:0/2352822896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faeb006c5f0 0x7faeb0165ce0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.963+0000 7faeb624b640 1 -- 172.21.15.77:0/2352822896 >> 172.21.15.77:0/2352822896 conn(0x7faeb00cb530 msgr2=0x7faeb00cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:14.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.963+0000 7faeb624b640 1 -- 172.21.15.77:0/2352822896 shutdown_connections 2023-11-04T01:46:14.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.963+0000 7faeb624b640 1 -- 172.21.15.77:0/2352822896 wait complete. 2023-11-04T01:46:14.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.964+0000 7faeb624b640 1 Processor -- start 2023-11-04T01:46:14.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.964+0000 7faeb624b640 1 -- start start 2023-11-04T01:46:14.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.965+0000 7faeb624b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faeb006c5f0 0x7faeb01f4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:14.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.965+0000 7faeb624b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faeb006d9c0 0x7faeb014efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:14.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.965+0000 7faeb624b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faeb00ade00 0x7faeb00c2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:14.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.965+0000 7faeb624b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb01f4ce0 con 0x7faeb006d9c0 2023-11-04T01:46:14.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.965+0000 7faeb624b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb0154a60 con 0x7faeb006c5f0 2023-11-04T01:46:14.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.965+0000 7faeb624b640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb0154d40 con 0x7faeb00ade00 2023-11-04T01:46:14.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.965+0000 7faeaeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faeb006d9c0 0x7faeb014efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:14.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.965+0000 7faeaeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faeb006d9c0 0x7faeb014efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55758/0 (socket says 172.21.15.77:55758) 2023-11-04T01:46:14.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.965+0000 7faeaeffd640 1 -- 172.21.15.77:0/3911548371 learned_addr learned my addr 172.21.15.77:0/3911548371 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:14.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.965+0000 7faeaf7fe640 1 --2- 172.21.15.77:0/3911548371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faeb006c5f0 0x7faeb01f4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:14.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.965+0000 7faeaffff640 1 --2- 172.21.15.77:0/3911548371 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faeb00ade00 0x7faeb00c2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:14.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.965+0000 7faeaeffd640 1 -- 172.21.15.77:0/3911548371 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faeb00ade00 msgr2=0x7faeb00c2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:14.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.965+0000 7faeaeffd640 1 --2- 172.21.15.77:0/3911548371 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faeb00ade00 0x7faeb00c2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.965+0000 7faeaeffd640 1 -- 172.21.15.77:0/3911548371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faeb006c5f0 msgr2=0x7faeb01f4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:14.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.965+0000 7faeaeffd640 1 --2- 172.21.15.77:0/3911548371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faeb006c5f0 0x7faeb01f4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.965+0000 7faeaeffd640 1 -- 172.21.15.77:0/3911548371 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea8009a70 con 0x7faeb006d9c0 2023-11-04T01:46:14.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.965+0000 7faeaeffd640 1 --2- 172.21.15.77:0/3911548371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faeb006d9c0 0x7faeb014efc0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7faea400c3c0 tx=0x7faea400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:14.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.965+0000 7fae97fff640 1 -- 172.21.15.77:0/3911548371 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea40052d0 con 0x7faeb006d9c0 2023-11-04T01:46:14.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.965+0000 7fae97fff640 1 -- 172.21.15.77:0/3911548371 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea4005430 con 0x7faeb006d9c0 2023-11-04T01:46:14.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.966+0000 7faeb624b640 1 -- 172.21.15.77:0/3911548371 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb0155020 con 0x7faeb006d9c0 2023-11-04T01:46:14.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.966+0000 7fae97fff640 1 -- 172.21.15.77:0/3911548371 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea4003830 con 0x7faeb006d9c0 2023-11-04T01:46:14.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.966+0000 7faeb624b640 1 -- 172.21.15.77:0/3911548371 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb014f500 con 0x7faeb006d9c0 2023-11-04T01:46:14.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.966+0000 7faeb624b640 1 -- 172.21.15.77:0/3911548371 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb00684b0 con 0x7faeb006d9c0 2023-11-04T01:46:14.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.967+0000 7fae97fff640 1 -- 172.21.15.77:0/3911548371 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faea4003990 con 0x7faeb006d9c0 2023-11-04T01:46:14.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.967+0000 7fae97fff640 1 --2- 172.21.15.77:0/3911548371 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fae9c06aea0 0x7fae9c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:14.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.967+0000 7fae97fff640 1 -- 172.21.15.77:0/3911548371 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7737+0+0 (secure 0 0 0) 0x7faea4089280 con 0x7faeb006d9c0 2023-11-04T01:46:14.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.968+0000 7faeaf7fe640 1 --2- 172.21.15.77:0/3911548371 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fae9c06aea0 0x7fae9c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:14.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.968+0000 7faeaf7fe640 1 --2- 172.21.15.77:0/3911548371 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fae9c06aea0 0x7fae9c06d360 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7faea0000f60 tx=0x7faea0007d00 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:14.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:14.972+0000 7fae97fff640 1 -- 172.21.15.77:0/3911548371 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faea4053b40 con 0x7faeb006d9c0 2023-11-04T01:46:15.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.135+0000 7faeb624b640 1 -- 172.21.15.77:0/3911548371 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7faeb00cddc0 con 0x7faeb006d9c0 2023-11-04T01:46:15.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.136+0000 7fae97fff640 1 -- 172.21.15.77:0/3911548371 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v107) v1 ==== 103+0+11 (secure 0 0 0) 0x7faea4017020 con 0x7faeb006d9c0 2023-11-04T01:46:15.139 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:46:15.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.137+0000 7faeb624b640 1 -- 172.21.15.77:0/3911548371 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fae9c06aea0 msgr2=0x7fae9c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:15.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.137+0000 7faeb624b640 1 --2- 172.21.15.77:0/3911548371 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fae9c06aea0 0x7fae9c06d360 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7faea0000f60 tx=0x7faea0007d00 comp rx=0 tx=0).stop 2023-11-04T01:46:15.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.137+0000 7faeb624b640 1 -- 172.21.15.77:0/3911548371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faeb006d9c0 msgr2=0x7faeb014efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:15.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.137+0000 7faeb624b640 1 --2- 172.21.15.77:0/3911548371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faeb006d9c0 0x7faeb014efc0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7faea400c3c0 tx=0x7faea400c880 comp rx=0 tx=0).stop 2023-11-04T01:46:15.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.137+0000 7faeb624b640 1 -- 172.21.15.77:0/3911548371 shutdown_connections 2023-11-04T01:46:15.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.137+0000 7faeb624b640 1 --2- 172.21.15.77:0/3911548371 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fae9c06aea0 0x7fae9c06d360 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.137+0000 7faeb624b640 1 --2- 172.21.15.77:0/3911548371 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faeb00ade00 0x7faeb00c2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.137+0000 7faeb624b640 1 --2- 172.21.15.77:0/3911548371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faeb006d9c0 0x7faeb014efc0 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.137+0000 7faeb624b640 1 --2- 172.21.15.77:0/3911548371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faeb006c5f0 0x7faeb01f4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.137+0000 7faeb624b640 1 -- 172.21.15.77:0/3911548371 >> 172.21.15.77:0/3911548371 conn(0x7faeb00cb530 msgr2=0x7faeb00b04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:15.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.138+0000 7faeb624b640 1 -- 172.21.15.77:0/3911548371 shutdown_connections 2023-11-04T01:46:15.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.138+0000 7faeb624b640 1 -- 172.21.15.77:0/3911548371 wait complete. 2023-11-04T01:46:15.151 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:46:15.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.251+0000 7fa15ab4c640 1 Processor -- start 2023-11-04T01:46:15.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.251+0000 7fa15ab4c640 1 -- start start 2023-11-04T01:46:15.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.252+0000 7fa15ab4c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa15406d9c0 0x7fa1540710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:15.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.252+0000 7fa15ab4c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa15406cc90 con 0x7fa1540ade00 2023-11-04T01:46:15.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.252+0000 7fa15ab4c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1540b0e60 con 0x7fa15406c5f0 2023-11-04T01:46:15.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.252+0000 7fa15ab4c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1540b0c40 con 0x7fa15406d9c0 2023-11-04T01:46:15.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.252+0000 7fa153fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa15406d9c0 0x7fa1540710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:15.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.252+0000 7fa153fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa15406d9c0 0x7fa1540710d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55774/0 (socket says 172.21.15.77:55774) 2023-11-04T01:46:15.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.252+0000 7fa153fff640 1 -- 172.21.15.77:0/3836262615 learned_addr learned my addr 172.21.15.77:0/3836262615 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:15.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.252+0000 7fa1588e8640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fa1540ade00 0x7fa1540b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57484/0 (socket says 172.21.15.77:57484) 2023-11-04T01:46:15.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.252+0000 7fa153fff640 1 -- 172.21.15.77:0/3836262615 >> v1:172.21.15.122:6789/0 conn(0x7fa15406c5f0 legacy=0x7fa1540cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:15.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.252+0000 7fa153fff640 1 -- 172.21.15.77:0/3836262615 >> v1:172.21.15.77:6789/0 conn(0x7fa1540ade00 legacy=0x7fa1540b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:15.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.252+0000 7fa1537fe640 1 -- 172.21.15.77:0/3836262615 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2064970149 0 0) 0x7fa15406cc90 con 0x7fa1540ade00 2023-11-04T01:46:15.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.252+0000 7fa153fff640 1 -- 172.21.15.77:0/3836262615 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa15406cee0 con 0x7fa15406d9c0 2023-11-04T01:46:15.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.253+0000 7fa153fff640 1 --2- 172.21.15.77:0/3836262615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa15406d9c0 0x7fa1540710d0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7fa140009870 tx=0x7fa14002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b305618f8324b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:15.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.253+0000 7fa1537fe640 1 -- 172.21.15.77:0/3836262615 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa140031870 con 0x7fa15406d9c0 2023-11-04T01:46:15.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.253+0000 7fa1537fe640 1 -- 172.21.15.77:0/3836262615 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1400319d0 con 0x7fa15406d9c0 2023-11-04T01:46:15.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.253+0000 7fa1537fe640 1 -- 172.21.15.77:0/3836262615 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa140031d60 con 0x7fa15406d9c0 2023-11-04T01:46:15.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.253+0000 7fa15ab4c640 1 -- 172.21.15.77:0/3836262615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa15406d9c0 msgr2=0x7fa1540710d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:15.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.253+0000 7fa15ab4c640 1 --2- 172.21.15.77:0/3836262615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa15406d9c0 0x7fa1540710d0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7fa140009870 tx=0x7fa14002b910 comp rx=0 tx=0).stop 2023-11-04T01:46:15.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.253+0000 7fa15ab4c640 1 -- 172.21.15.77:0/3836262615 shutdown_connections 2023-11-04T01:46:15.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.253+0000 7fa15ab4c640 1 --2- 172.21.15.77:0/3836262615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa15406d9c0 0x7fa1540710d0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.253+0000 7fa15ab4c640 1 -- 172.21.15.77:0/3836262615 >> 172.21.15.77:0/3836262615 conn(0x7fa1540cb530 msgr2=0x7fa1540cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:15.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.253+0000 7fa15ab4c640 1 -- 172.21.15.77:0/3836262615 shutdown_connections 2023-11-04T01:46:15.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.253+0000 7fa15ab4c640 1 -- 172.21.15.77:0/3836262615 wait complete. 2023-11-04T01:46:15.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.255+0000 7fa15ab4c640 1 Processor -- start 2023-11-04T01:46:15.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.255+0000 7fa15ab4c640 1 -- start start 2023-11-04T01:46:15.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.255+0000 7fa15ab4c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa15406c5f0 0x7fa1540c7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:15.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.255+0000 7fa15ab4c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa15406d9c0 0x7fa154148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:15.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.255+0000 7fa15ab4c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1540ade00 0x7fa1541567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:15.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.255+0000 7fa15ab4c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1540c5fd0 con 0x7fa15406d9c0 2023-11-04T01:46:15.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.255+0000 7fa15ab4c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1540c62b0 con 0x7fa1540ade00 2023-11-04T01:46:15.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.255+0000 7fa15ab4c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1540c6590 con 0x7fa15406c5f0 2023-11-04T01:46:15.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.256+0000 7fa153fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa15406d9c0 0x7fa154148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:15.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.256+0000 7fa153fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa15406d9c0 0x7fa154148dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55780/0 (socket says 172.21.15.77:55780) 2023-11-04T01:46:15.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.256+0000 7fa153fff640 1 -- 172.21.15.77:0/449714051 learned_addr learned my addr 172.21.15.77:0/449714051 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:15.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.256+0000 7fa1588e8640 1 --2- 172.21.15.77:0/449714051 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa15406c5f0 0x7fa1540c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:15.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.256+0000 7fa1590e9640 1 --2- 172.21.15.77:0/449714051 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1540ade00 0x7fa1541567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:15.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.256+0000 7fa153fff640 1 -- 172.21.15.77:0/449714051 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa15406c5f0 msgr2=0x7fa1540c7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:15.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.256+0000 7fa153fff640 1 --2- 172.21.15.77:0/449714051 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa15406c5f0 0x7fa1540c7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.256+0000 7fa153fff640 1 -- 172.21.15.77:0/449714051 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1540ade00 msgr2=0x7fa1541567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:15.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.256+0000 7fa153fff640 1 --2- 172.21.15.77:0/449714051 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1540ade00 0x7fa1541567c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.256+0000 7fa153fff640 1 -- 172.21.15.77:0/449714051 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1400094d0 con 0x7fa15406d9c0 2023-11-04T01:46:15.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.256+0000 7fa153fff640 1 --2- 172.21.15.77:0/449714051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa15406d9c0 0x7fa154148dc0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fa140009870 tx=0x7fa1400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:15.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.256+0000 7fa1517fa640 1 -- 172.21.15.77:0/449714051 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa140031820 con 0x7fa15406d9c0 2023-11-04T01:46:15.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.256+0000 7fa1517fa640 1 -- 172.21.15.77:0/449714051 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1400443f0 con 0x7fa15406d9c0 2023-11-04T01:46:15.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.256+0000 7fa15ab4c640 1 -- 172.21.15.77:0/449714051 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1540c6870 con 0x7fa15406d9c0 2023-11-04T01:46:15.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.256+0000 7fa1517fa640 1 -- 172.21.15.77:0/449714051 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1400447a0 con 0x7fa15406d9c0 2023-11-04T01:46:15.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.256+0000 7fa15ab4c640 1 -- 172.21.15.77:0/449714051 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1540c75b0 con 0x7fa15406d9c0 2023-11-04T01:46:15.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.257+0000 7fa15ab4c640 1 -- 172.21.15.77:0/449714051 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1540c6d90 con 0x7fa15406d9c0 2023-11-04T01:46:15.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.258+0000 7fa1517fa640 1 -- 172.21.15.77:0/449714051 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa14004d450 con 0x7fa15406d9c0 2023-11-04T01:46:15.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.258+0000 7fa1517fa640 1 --2- 172.21.15.77:0/449714051 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa13806ae70 0x7fa13806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:15.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.258+0000 7fa1517fa640 1 -- 172.21.15.77:0/449714051 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7737+0+0 (secure 0 0 0) 0x7fa14002d040 con 0x7fa15406d9c0 2023-11-04T01:46:15.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.258+0000 7fa1588e8640 1 --2- 172.21.15.77:0/449714051 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa13806ae70 0x7fa13806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:15.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.259+0000 7fa1588e8640 1 --2- 172.21.15.77:0/449714051 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa13806ae70 0x7fa13806d330 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa148000f60 tx=0x7fa148007d00 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:15.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.262+0000 7fa1517fa640 1 -- 172.21.15.77:0/449714051 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa1540c6d90 con 0x7fa15406d9c0 2023-11-04T01:46:15.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.426+0000 7fa15ab4c640 1 -- 172.21.15.77:0/449714051 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7fa1540c6d90 con 0x7fa15406d9c0 2023-11-04T01:46:15.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.427+0000 7fa1517fa640 1 -- 172.21.15.77:0/449714051 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v107) v1 ==== 107+0+11 (secure 0 0 0) 0x7fa1540c6d90 con 0x7fa15406d9c0 2023-11-04T01:46:15.430 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:46:15.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.429+0000 7fa15ab4c640 1 -- 172.21.15.77:0/449714051 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa13806ae70 msgr2=0x7fa13806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:15.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.429+0000 7fa15ab4c640 1 --2- 172.21.15.77:0/449714051 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa13806ae70 0x7fa13806d330 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa148000f60 tx=0x7fa148007d00 comp rx=0 tx=0).stop 2023-11-04T01:46:15.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.429+0000 7fa15ab4c640 1 -- 172.21.15.77:0/449714051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa15406d9c0 msgr2=0x7fa154148dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:15.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.429+0000 7fa15ab4c640 1 --2- 172.21.15.77:0/449714051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa15406d9c0 0x7fa154148dc0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fa140009870 tx=0x7fa1400046c0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.429+0000 7fa15ab4c640 1 -- 172.21.15.77:0/449714051 shutdown_connections 2023-11-04T01:46:15.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.429+0000 7fa15ab4c640 1 --2- 172.21.15.77:0/449714051 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa13806ae70 0x7fa13806d330 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.429+0000 7fa15ab4c640 1 --2- 172.21.15.77:0/449714051 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1540ade00 0x7fa1541567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.429+0000 7fa15ab4c640 1 --2- 172.21.15.77:0/449714051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa15406d9c0 0x7fa154148dc0 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.429+0000 7fa15ab4c640 1 --2- 172.21.15.77:0/449714051 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa15406c5f0 0x7fa1540c7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.429+0000 7fa15ab4c640 1 -- 172.21.15.77:0/449714051 >> 172.21.15.77:0/449714051 conn(0x7fa1540cb530 msgr2=0x7fa1540cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:15.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.429+0000 7fa15ab4c640 1 -- 172.21.15.77:0/449714051 shutdown_connections 2023-11-04T01:46:15.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.429+0000 7fa15ab4c640 1 -- 172.21.15.77:0/449714051 wait complete. 2023-11-04T01:46:15.442 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:46:15.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.542+0000 7f2a9bc90640 1 Processor -- start 2023-11-04T01:46:15.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.542+0000 7f2a9bc90640 1 -- start start 2023-11-04T01:46:15.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.543+0000 7f2a9bc90640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f2a94159e40 0x7f2a940b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:15.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.543+0000 7f2a9bc90640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2a94070700 0x7f2a940b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:15.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.543+0000 7f2a9bc90640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a94071500 con 0x7f2a9406bb60 2023-11-04T01:46:15.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.543+0000 7f2a9bc90640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a9415dae0 con 0x7f2a94070700 2023-11-04T01:46:15.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.543+0000 7f2a9bc90640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a94070c60 con 0x7f2a94159e40 2023-11-04T01:46:15.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.543+0000 7f2a9a22d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2a94070700 0x7f2a940b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:15.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.543+0000 7f2a9a22d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2a94070700 0x7f2a940b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55784/0 (socket says 172.21.15.77:55784) 2023-11-04T01:46:15.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.543+0000 7f2a9a22d640 1 -- 172.21.15.77:0/1912300447 learned_addr learned my addr 172.21.15.77:0/1912300447 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:15.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.543+0000 7f2a99a2c640 1 --2- 172.21.15.77:0/1912300447 >> v2:172.21.15.122:3300/0 conn(0x7f2a94159e40 0x7f2a940b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:15.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.543+0000 7f2a9a22d640 1 -- 172.21.15.77:0/1912300447 >> v2:172.21.15.122:3300/0 conn(0x7f2a94159e40 msgr2=0x7f2a940b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:15.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.543+0000 7f2a9a22d640 1 --2- 172.21.15.77:0/1912300447 >> v2:172.21.15.122:3300/0 conn(0x7f2a94159e40 0x7f2a940b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.543+0000 7f2a9a22d640 1 -- 172.21.15.77:0/1912300447 >> v1:172.21.15.122:6789/0 conn(0x7f2a9406bb60 legacy=0x7f2a9406fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:15.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.543+0000 7f2a9a22d640 1 -- 172.21.15.77:0/1912300447 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a94070f40 con 0x7f2a94070700 2023-11-04T01:46:15.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.544+0000 7f2a9a22d640 1 --2- 172.21.15.77:0/1912300447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a94070700 0x7f2a940b0a70 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f2a940ce7f0 tx=0x7f2a8c02bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d82e509d30a75444 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:15.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.544+0000 7f2a98a2a640 1 -- 172.21.15.77:0/1912300447 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c02c960 con 0x7f2a94070700 2023-11-04T01:46:15.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.544+0000 7f2a98a2a640 1 -- 172.21.15.77:0/1912300447 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8c02cac0 con 0x7f2a94070700 2023-11-04T01:46:15.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.544+0000 7f2a98a2a640 1 -- 172.21.15.77:0/1912300447 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c02ce50 con 0x7f2a94070700 2023-11-04T01:46:15.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.545+0000 7f2a9bc90640 1 -- 172.21.15.77:0/1912300447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a94070700 msgr2=0x7f2a940b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:15.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.545+0000 7f2a9bc90640 1 --2- 172.21.15.77:0/1912300447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a94070700 0x7f2a940b0a70 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f2a940ce7f0 tx=0x7f2a8c02bdc0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.545+0000 7f2a9bc90640 1 -- 172.21.15.77:0/1912300447 shutdown_connections 2023-11-04T01:46:15.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.545+0000 7f2a9bc90640 1 --2- 172.21.15.77:0/1912300447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a94070700 0x7f2a940b0a70 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.545+0000 7f2a9bc90640 1 --2- 172.21.15.77:0/1912300447 >> v2:172.21.15.122:3300/0 conn(0x7f2a94159e40 0x7f2a940b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.545+0000 7f2a9bc90640 1 -- 172.21.15.77:0/1912300447 >> 172.21.15.77:0/1912300447 conn(0x7f2a940cb530 msgr2=0x7f2a940cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:15.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.545+0000 7f2a9bc90640 1 -- 172.21.15.77:0/1912300447 shutdown_connections 2023-11-04T01:46:15.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.545+0000 7f2a9bc90640 1 -- 172.21.15.77:0/1912300447 wait complete. 2023-11-04T01:46:15.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.546+0000 7f2a9bc90640 1 Processor -- start 2023-11-04T01:46:15.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.546+0000 7f2a9bc90640 1 -- start start 2023-11-04T01:46:15.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.546+0000 7f2a9bc90640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2a9406bb60 0x7f2a941570a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:15.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.546+0000 7f2a9bc90640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a94070700 0x7f2a940c36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:15.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.546+0000 7f2a9bc90640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2a94159e40 0x7f2a940c4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:15.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.546+0000 7f2a9bc90640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a941575e0 con 0x7f2a94070700 2023-11-04T01:46:15.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.546+0000 7f2a9bc90640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a94151ae0 con 0x7f2a9406bb60 2023-11-04T01:46:15.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.546+0000 7f2a9bc90640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a940c3bf0 con 0x7f2a94159e40 2023-11-04T01:46:15.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.547+0000 7f2a9922b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a94070700 0x7f2a940c36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:15.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.547+0000 7f2a9922b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a94070700 0x7f2a940c36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55798/0 (socket says 172.21.15.77:55798) 2023-11-04T01:46:15.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.547+0000 7f2a9922b640 1 -- 172.21.15.77:0/3936526170 learned_addr learned my addr 172.21.15.77:0/3936526170 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:15.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.547+0000 7f2a9a22d640 1 --2- 172.21.15.77:0/3936526170 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2a94159e40 0x7f2a940c4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:15.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.547+0000 7f2a99a2c640 1 --2- 172.21.15.77:0/3936526170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2a9406bb60 0x7f2a941570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:15.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.547+0000 7f2a9922b640 1 -- 172.21.15.77:0/3936526170 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2a94159e40 msgr2=0x7f2a940c4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:15.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.547+0000 7f2a9922b640 1 --2- 172.21.15.77:0/3936526170 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2a94159e40 0x7f2a940c4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.547+0000 7f2a9922b640 1 -- 172.21.15.77:0/3936526170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2a9406bb60 msgr2=0x7f2a941570a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:15.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.547+0000 7f2a9922b640 1 --2- 172.21.15.77:0/3936526170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2a9406bb60 0x7f2a941570a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.547+0000 7f2a9922b640 1 -- 172.21.15.77:0/3936526170 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a8c009b30 con 0x7f2a94070700 2023-11-04T01:46:15.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.547+0000 7f2a9a22d640 1 --2- 172.21.15.77:0/3936526170 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2a94159e40 0x7f2a940c4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:15.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.547+0000 7f2a99a2c640 1 --2- 172.21.15.77:0/3936526170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2a9406bb60 0x7f2a941570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:15.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.547+0000 7f2a9922b640 1 --2- 172.21.15.77:0/3936526170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a94070700 0x7f2a940c36b0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f2a8400c430 tx=0x7f2a8400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:15.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.547+0000 7f2a8a7fc640 1 -- 172.21.15.77:0/3936526170 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a84011790 con 0x7f2a94070700 2023-11-04T01:46:15.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.547+0000 7f2a8a7fc640 1 -- 172.21.15.77:0/3936526170 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a840118f0 con 0x7f2a94070700 2023-11-04T01:46:15.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.547+0000 7f2a8a7fc640 1 -- 172.21.15.77:0/3936526170 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a84011ce0 con 0x7f2a94070700 2023-11-04T01:46:15.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.547+0000 7f2a9bc90640 1 -- 172.21.15.77:0/3936526170 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a940c7b80 con 0x7f2a94070700 2023-11-04T01:46:15.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.547+0000 7f2a9bc90640 1 -- 172.21.15.77:0/3936526170 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a940c8140 con 0x7f2a94070700 2023-11-04T01:46:15.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.548+0000 7f2a9bc90640 1 -- 172.21.15.77:0/3936526170 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a941551d0 con 0x7f2a94070700 2023-11-04T01:46:15.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.549+0000 7f2a8a7fc640 1 -- 172.21.15.77:0/3936526170 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2a8401c460 con 0x7f2a94070700 2023-11-04T01:46:15.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.549+0000 7f2a8a7fc640 1 --2- 172.21.15.77:0/3936526170 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2a7806ae70 0x7f2a7806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:15.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.549+0000 7f2a8a7fc640 1 -- 172.21.15.77:0/3936526170 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f2a84089d70 con 0x7f2a94070700 2023-11-04T01:46:15.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.549+0000 7f2a99a2c640 1 --2- 172.21.15.77:0/3936526170 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2a7806ae70 0x7f2a7806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:15.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.550+0000 7f2a99a2c640 1 --2- 172.21.15.77:0/3936526170 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2a7806ae70 0x7f2a7806d330 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f2a90006fd0 tx=0x7f2a90008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:15.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.554+0000 7f2a8a7fc640 1 -- 172.21.15.77:0/3936526170 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2a84054630 con 0x7f2a94070700 2023-11-04T01:46:15.618 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:2023-11-04T01:46:15.615+0000 7ff1837fe640 -1 client.7488 mds.1 rejected us (blocklisted (blacklisted)) 2023-11-04T01:46:15.619 INFO:teuthology.orchestra.run.smithi077.stderr:mkdir: cannot create directory ‘d1/dir/.snap/s22’: Operation not permitted 2023-11-04T01:46:15.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.722+0000 7f2a9bc90640 1 -- 172.21.15.77:0/3936526170 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2a940684b0 con 0x7f2a94070700 2023-11-04T01:46:15.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.723+0000 7f2a8a7fc640 1 -- 172.21.15.77:0/3936526170 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v107) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2a84057c50 con 0x7f2a94070700 2023-11-04T01:46:15.726 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:46:15.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.724+0000 7f2a9bc90640 1 -- 172.21.15.77:0/3936526170 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2a7806ae70 msgr2=0x7f2a7806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:15.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.724+0000 7f2a9bc90640 1 --2- 172.21.15.77:0/3936526170 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2a7806ae70 0x7f2a7806d330 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f2a90006fd0 tx=0x7f2a90008040 comp rx=0 tx=0).stop 2023-11-04T01:46:15.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.725+0000 7f2a9bc90640 1 -- 172.21.15.77:0/3936526170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a94070700 msgr2=0x7f2a940c36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:15.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.725+0000 7f2a9bc90640 1 --2- 172.21.15.77:0/3936526170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a94070700 0x7f2a940c36b0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f2a8400c430 tx=0x7f2a8400c8f0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.725+0000 7f2a9bc90640 1 -- 172.21.15.77:0/3936526170 shutdown_connections 2023-11-04T01:46:15.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.725+0000 7f2a9bc90640 1 --2- 172.21.15.77:0/3936526170 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2a7806ae70 0x7f2a7806d330 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.725+0000 7f2a9bc90640 1 --2- 172.21.15.77:0/3936526170 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2a94159e40 0x7f2a940c4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.725+0000 7f2a9bc90640 1 --2- 172.21.15.77:0/3936526170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a94070700 0x7f2a940c36b0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.725+0000 7f2a9bc90640 1 --2- 172.21.15.77:0/3936526170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2a9406bb60 0x7f2a941570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.725+0000 7f2a9bc90640 1 -- 172.21.15.77:0/3936526170 >> 172.21.15.77:0/3936526170 conn(0x7f2a940cb530 msgr2=0x7f2a9415caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:15.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.725+0000 7f2a9bc90640 1 -- 172.21.15.77:0/3936526170 shutdown_connections 2023-11-04T01:46:15.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.725+0000 7f2a9bc90640 1 -- 172.21.15.77:0/3936526170 wait complete. 2023-11-04T01:46:15.738 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:46:15.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.838+0000 7fb32d790640 1 Processor -- start 2023-11-04T01:46:15.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.838+0000 7fb32d790640 1 -- start start 2023-11-04T01:46:15.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.839+0000 7fb32d790640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb32815d100 0x7fb3280ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:15.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.839+0000 7fb32d790640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb32815d4e0 0x7fb3280d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:15.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.839+0000 7fb32d790640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb3280d3b60 0x7fb3280d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:15.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.839+0000 7fb32d790640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3280b32b0 con 0x7fb3280d3b60 2023-11-04T01:46:15.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.839+0000 7fb32d790640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3280cee10 con 0x7fb32815d100 2023-11-04T01:46:15.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.839+0000 7fb32d790640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3280b2980 con 0x7fb32815d4e0 2023-11-04T01:46:15.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.839+0000 7fb3277fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb3280d3b60 0x7fb3280d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:15.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.839+0000 7fb3277fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb3280d3b60 0x7fb3280d1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55810/0 (socket says 172.21.15.77:55810) 2023-11-04T01:46:15.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.839+0000 7fb3277fe640 1 -- 172.21.15.77:0/3369391372 learned_addr learned my addr 172.21.15.77:0/3369391372 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:15.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.840+0000 7fb3277fe640 1 -- 172.21.15.77:0/3369391372 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb32815d4e0 msgr2=0x7fb3280d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:15.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.840+0000 7fb3277fe640 1 --2- 172.21.15.77:0/3369391372 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb32815d4e0 0x7fb3280d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.840+0000 7fb3277fe640 1 -- 172.21.15.77:0/3369391372 >> v2:172.21.15.122:3300/0 conn(0x7fb32815d100 msgr2=0x7fb3280ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:15.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.840+0000 7fb326ffd640 1 --2- 172.21.15.77:0/3369391372 >> v2:172.21.15.122:3300/0 conn(0x7fb32815d100 0x7fb3280ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:15.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.840+0000 7fb3277fe640 1 --2- 172.21.15.77:0/3369391372 >> v2:172.21.15.122:3300/0 conn(0x7fb32815d100 0x7fb3280ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.840+0000 7fb3277fe640 1 -- 172.21.15.77:0/3369391372 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3280b2c60 con 0x7fb3280d3b60 2023-11-04T01:46:15.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.840+0000 7fb3277fe640 1 --2- 172.21.15.77:0/3369391372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3280d3b60 0x7fb3280d1a10 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fb3280d09f0 tx=0x7fb32002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=245c9de2e7913391 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:15.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.840+0000 7fb325ffb640 1 -- 172.21.15.77:0/3369391372 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb320031870 con 0x7fb3280d3b60 2023-11-04T01:46:15.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.841+0000 7fb325ffb640 1 -- 172.21.15.77:0/3369391372 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3200319d0 con 0x7fb3280d3b60 2023-11-04T01:46:15.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.841+0000 7fb325ffb640 1 -- 172.21.15.77:0/3369391372 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb320031d60 con 0x7fb3280d3b60 2023-11-04T01:46:15.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.841+0000 7fb32d790640 1 -- 172.21.15.77:0/3369391372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3280d3b60 msgr2=0x7fb3280d1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:15.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.841+0000 7fb32d790640 1 --2- 172.21.15.77:0/3369391372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3280d3b60 0x7fb3280d1a10 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fb3280d09f0 tx=0x7fb32002b910 comp rx=0 tx=0).stop 2023-11-04T01:46:15.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.841+0000 7fb32d790640 1 -- 172.21.15.77:0/3369391372 shutdown_connections 2023-11-04T01:46:15.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.841+0000 7fb32d790640 1 --2- 172.21.15.77:0/3369391372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3280d3b60 0x7fb3280d1a10 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.841+0000 7fb32d790640 1 --2- 172.21.15.77:0/3369391372 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb32815d4e0 0x7fb3280d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.841+0000 7fb32d790640 1 --2- 172.21.15.77:0/3369391372 >> v2:172.21.15.122:3300/0 conn(0x7fb32815d100 0x7fb3280ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.841+0000 7fb32d790640 1 -- 172.21.15.77:0/3369391372 >> 172.21.15.77:0/3369391372 conn(0x7fb3280d2ef0 msgr2=0x7fb3280d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:15.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.841+0000 7fb32d790640 1 -- 172.21.15.77:0/3369391372 shutdown_connections 2023-11-04T01:46:15.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.841+0000 7fb32d790640 1 -- 172.21.15.77:0/3369391372 wait complete. 2023-11-04T01:46:15.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.842+0000 7fb32d790640 1 Processor -- start 2023-11-04T01:46:15.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.842+0000 7fb32d790640 1 -- start start 2023-11-04T01:46:15.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.843+0000 7fb32d790640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3280d3b60 0x7fb3281f3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:15.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.843+0000 7fb32d790640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb32815d100 0x7fb3280b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:15.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.843+0000 7fb32d790640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb32815d4e0 0x7fb3280b1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:15.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.843+0000 7fb32d790640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3281f38d0 con 0x7fb3280d3b60 2023-11-04T01:46:15.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.843+0000 7fb32d790640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32815f410 con 0x7fb32815d100 2023-11-04T01:46:15.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.843+0000 7fb32d790640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3281f35f0 con 0x7fb32815d4e0 2023-11-04T01:46:15.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.843+0000 7fb326ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3280d3b60 0x7fb3281f3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:15.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.843+0000 7fb326ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3280d3b60 0x7fb3281f3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55818/0 (socket says 172.21.15.77:55818) 2023-11-04T01:46:15.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.843+0000 7fb326ffd640 1 -- 172.21.15.77:0/2521062473 learned_addr learned my addr 172.21.15.77:0/2521062473 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:15.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.843+0000 7fb3267fc640 1 --2- 172.21.15.77:0/2521062473 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb32815d100 0x7fb3280b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:15.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.844+0000 7fb326ffd640 1 -- 172.21.15.77:0/2521062473 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb32815d4e0 msgr2=0x7fb3280b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:15.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.844+0000 7fb3277fe640 1 --2- 172.21.15.77:0/2521062473 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb32815d4e0 0x7fb3280b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:15.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.844+0000 7fb326ffd640 1 --2- 172.21.15.77:0/2521062473 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb32815d4e0 0x7fb3280b1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.844+0000 7fb326ffd640 1 -- 172.21.15.77:0/2521062473 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb32815d100 msgr2=0x7fb3280b0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:15.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.844+0000 7fb326ffd640 1 --2- 172.21.15.77:0/2521062473 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb32815d100 0x7fb3280b0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.844+0000 7fb326ffd640 1 -- 172.21.15.77:0/2521062473 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3200094d0 con 0x7fb3280d3b60 2023-11-04T01:46:15.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.844+0000 7fb3267fc640 1 --2- 172.21.15.77:0/2521062473 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb32815d100 0x7fb3280b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:15.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.844+0000 7fb326ffd640 1 --2- 172.21.15.77:0/2521062473 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3280d3b60 0x7fb3281f3ab0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fb31800ceb0 tx=0x7fb31800a6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:15.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.844+0000 7fb30f7fe640 1 -- 172.21.15.77:0/2521062473 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb318003b90 con 0x7fb3280d3b60 2023-11-04T01:46:15.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.844+0000 7fb30f7fe640 1 -- 172.21.15.77:0/2521062473 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb318003cf0 con 0x7fb3280d3b60 2023-11-04T01:46:15.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.844+0000 7fb32d790640 1 -- 172.21.15.77:0/2521062473 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb32809cdc0 con 0x7fb3280d3b60 2023-11-04T01:46:15.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.844+0000 7fb30f7fe640 1 -- 172.21.15.77:0/2521062473 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb318003ea0 con 0x7fb3280d3b60 2023-11-04T01:46:15.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.844+0000 7fb32d790640 1 -- 172.21.15.77:0/2521062473 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb32809d380 con 0x7fb3280d3b60 2023-11-04T01:46:15.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.845+0000 7fb32d790640 1 -- 172.21.15.77:0/2521062473 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb32809d5a0 con 0x7fb3280d3b60 2023-11-04T01:46:15.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.846+0000 7fb30f7fe640 1 -- 172.21.15.77:0/2521062473 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb31800e870 con 0x7fb3280d3b60 2023-11-04T01:46:15.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.846+0000 7fb30f7fe640 1 --2- 172.21.15.77:0/2521062473 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb31406ae70 0x7fb31406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:15.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.846+0000 7fb30f7fe640 1 -- 172.21.15.77:0/2521062473 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7737+0+0 (secure 0 0 0) 0x7fb318012070 con 0x7fb3280d3b60 2023-11-04T01:46:15.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.846+0000 7fb3267fc640 1 --2- 172.21.15.77:0/2521062473 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb31406ae70 0x7fb31406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:15.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.847+0000 7fb3267fc640 1 --2- 172.21.15.77:0/2521062473 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb31406ae70 0x7fb31406d330 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb32809efd0 tx=0x7fb31c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:15.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:15.850+0000 7fb30f7fe640 1 -- 172.21.15.77:0/2521062473 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb318055330 con 0x7fb3280d3b60 2023-11-04T01:46:16.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.019+0000 7fb32d790640 1 -- 172.21.15.77:0/2521062473 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb3280684b0 con 0x7fb3280d3b60 2023-11-04T01:46:16.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.019+0000 7fb30f7fe640 1 -- 172.21.15.77:0/2521062473 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v107) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb318058950 con 0x7fb3280d3b60 2023-11-04T01:46:16.022 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-04T01:46:16.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.021+0000 7fb32d790640 1 -- 172.21.15.77:0/2521062473 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb31406ae70 msgr2=0x7fb31406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:16.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.021+0000 7fb32d790640 1 --2- 172.21.15.77:0/2521062473 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb31406ae70 0x7fb31406d330 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb32809efd0 tx=0x7fb31c008040 comp rx=0 tx=0).stop 2023-11-04T01:46:16.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.021+0000 7fb32d790640 1 -- 172.21.15.77:0/2521062473 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3280d3b60 msgr2=0x7fb3281f3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:16.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.021+0000 7fb32d790640 1 --2- 172.21.15.77:0/2521062473 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3280d3b60 0x7fb3281f3ab0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fb31800ceb0 tx=0x7fb31800a6b0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.021+0000 7fb32d790640 1 -- 172.21.15.77:0/2521062473 shutdown_connections 2023-11-04T01:46:16.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.021+0000 7fb32d790640 1 --2- 172.21.15.77:0/2521062473 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb31406ae70 0x7fb31406d330 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.021+0000 7fb32d790640 1 --2- 172.21.15.77:0/2521062473 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb32815d4e0 0x7fb3280b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.021+0000 7fb32d790640 1 --2- 172.21.15.77:0/2521062473 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb32815d100 0x7fb3280b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.021+0000 7fb32d790640 1 --2- 172.21.15.77:0/2521062473 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3280d3b60 0x7fb3281f3ab0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.021+0000 7fb32d790640 1 -- 172.21.15.77:0/2521062473 >> 172.21.15.77:0/2521062473 conn(0x7fb3280d2ef0 msgr2=0x7fb32806a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:16.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.021+0000 7fb32d790640 1 -- 172.21.15.77:0/2521062473 shutdown_connections 2023-11-04T01:46:16.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.022+0000 7fb32d790640 1 -- 172.21.15.77:0/2521062473 wait complete. 2023-11-04T01:46:16.034 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:46:16.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.133+0000 7f6ef79e2640 1 Processor -- start 2023-11-04T01:46:16.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.133+0000 7f6ef79e2640 1 -- start start 2023-11-04T01:46:16.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.134+0000 7f6ef79e2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6ef00b0c40 0x7f6ef006fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:16.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.134+0000 7f6ef79e2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6ef006bb60 0x7f6ef0070530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:16.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.134+0000 7f6ef79e2640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ef0071500 con 0x7f6ef0159e40 2023-11-04T01:46:16.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.134+0000 7f6ef79e2640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef0070a70 con 0x7f6ef006bb60 2023-11-04T01:46:16.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.134+0000 7f6ef79e2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef015dae0 con 0x7f6ef00b0c40 2023-11-04T01:46:16.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.134+0000 7f6ef5f7f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6ef006bb60 0x7f6ef0070530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:16.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.134+0000 7f6ef577e640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6ef0159e40 0x7f6ef00b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57488/0 (socket says 172.21.15.77:57488) 2023-11-04T01:46:16.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.134+0000 7f6ef577e640 1 -- 172.21.15.77:0/2660021946 learned_addr learned my addr 172.21.15.77:0/2660021946 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:46:16.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.134+0000 7f6ef4f7d640 1 --2- 172.21.15.77:0/2660021946 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6ef00b0c40 0x7f6ef006fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:16.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.134+0000 7f6ef5f7f640 1 -- 172.21.15.77:0/2660021946 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6ef00b0c40 msgr2=0x7f6ef006fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:16.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.134+0000 7f6ef5f7f640 1 --2- 172.21.15.77:0/2660021946 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6ef00b0c40 0x7f6ef006fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.134+0000 7f6ef5f7f640 1 -- 172.21.15.77:0/2660021946 >> v1:172.21.15.77:6789/0 conn(0x7f6ef0159e40 legacy=0x7f6ef00b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:16.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.134+0000 7f6ef5f7f640 1 -- 172.21.15.77:0/2660021946 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef0070c60 con 0x7f6ef006bb60 2023-11-04T01:46:16.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.134+0000 7f6ee7fff640 1 -- 172.21.15.77:0/2660021946 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 567108772 0 0) 0x7f6ef0071500 con 0x7f6ef0159e40 2023-11-04T01:46:16.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.135+0000 7f6ef5f7f640 1 --2- 172.21.15.77:0/2660021946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ef006bb60 0x7f6ef0070530 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8009d90 tx=0x7f6ee802be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f17fc773b2038bbd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:16.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.135+0000 7f6ee7fff640 1 -- 172.21.15.77:0/2660021946 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee802cbc0 con 0x7f6ef006bb60 2023-11-04T01:46:16.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.135+0000 7f6ee7fff640 1 -- 172.21.15.77:0/2660021946 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee802cd20 con 0x7f6ef006bb60 2023-11-04T01:46:16.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.135+0000 7f6ee7fff640 1 -- 172.21.15.77:0/2660021946 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8034660 con 0x7f6ef006bb60 2023-11-04T01:46:16.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.136+0000 7f6ef79e2640 1 -- 172.21.15.77:0/2660021946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ef006bb60 msgr2=0x7f6ef0070530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:16.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.136+0000 7f6ef79e2640 1 --2- 172.21.15.77:0/2660021946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ef006bb60 0x7f6ef0070530 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8009d90 tx=0x7f6ee802be10 comp rx=0 tx=0).stop 2023-11-04T01:46:16.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.136+0000 7f6ef79e2640 1 -- 172.21.15.77:0/2660021946 shutdown_connections 2023-11-04T01:46:16.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.136+0000 7f6ef79e2640 1 --2- 172.21.15.77:0/2660021946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ef006bb60 0x7f6ef0070530 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.136+0000 7f6ef79e2640 1 --2- 172.21.15.77:0/2660021946 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6ef00b0c40 0x7f6ef006fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.136+0000 7f6ef79e2640 1 -- 172.21.15.77:0/2660021946 >> 172.21.15.77:0/2660021946 conn(0x7f6ef00cb530 msgr2=0x7f6ef00cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:16.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.136+0000 7f6ef79e2640 1 -- 172.21.15.77:0/2660021946 shutdown_connections 2023-11-04T01:46:16.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.136+0000 7f6ef79e2640 1 -- 172.21.15.77:0/2660021946 wait complete. 2023-11-04T01:46:16.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.137+0000 7f6ef79e2640 1 Processor -- start 2023-11-04T01:46:16.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.137+0000 7f6ef79e2640 1 -- start start 2023-11-04T01:46:16.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.138+0000 7f6ef79e2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ef006bb60 0x7f6ef015c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:16.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.138+0000 7f6ef79e2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6ef00b0c40 0x7f6ef00c2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:16.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.138+0000 7f6ef79e2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ef0159e40 0x7f6ef015aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:16.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.138+0000 7f6ef79e2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef0151360 con 0x7f6ef0159e40 2023-11-04T01:46:16.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.138+0000 7f6ef79e2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef015a220 con 0x7f6ef006bb60 2023-11-04T01:46:16.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.138+0000 7f6ef79e2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef00c34d0 con 0x7f6ef00b0c40 2023-11-04T01:46:16.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.138+0000 7f6ef5f7f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ef0159e40 0x7f6ef015aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:16.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.138+0000 7f6ef5f7f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ef0159e40 0x7f6ef015aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55840/0 (socket says 172.21.15.77:55840) 2023-11-04T01:46:16.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.138+0000 7f6ef5f7f640 1 -- 172.21.15.77:0/2714316299 learned_addr learned my addr 172.21.15.77:0/2714316299 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:16.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.138+0000 7f6ef577e640 1 --2- 172.21.15.77:0/2714316299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ef006bb60 0x7f6ef015c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:16.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.138+0000 7f6ef4f7d640 1 --2- 172.21.15.77:0/2714316299 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6ef00b0c40 0x7f6ef00c2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:16.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.138+0000 7f6ef5f7f640 1 -- 172.21.15.77:0/2714316299 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6ef00b0c40 msgr2=0x7f6ef00c2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:16.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.138+0000 7f6ef5f7f640 1 --2- 172.21.15.77:0/2714316299 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6ef00b0c40 0x7f6ef00c2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.138+0000 7f6ef5f7f640 1 -- 172.21.15.77:0/2714316299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ef006bb60 msgr2=0x7f6ef015c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:16.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.138+0000 7f6ef5f7f640 1 --2- 172.21.15.77:0/2714316299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ef006bb60 0x7f6ef015c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.138+0000 7f6ef5f7f640 1 -- 172.21.15.77:0/2714316299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee8009a70 con 0x7f6ef0159e40 2023-11-04T01:46:16.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.138+0000 7f6ef5f7f640 1 --2- 172.21.15.77:0/2714316299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ef0159e40 0x7f6ef015aa00 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8009d90 tx=0x7f6ee8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:16.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.139+0000 7f6ee5ffb640 1 -- 172.21.15.77:0/2714316299 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8040650 con 0x7f6ef0159e40 2023-11-04T01:46:16.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.139+0000 7f6ee5ffb640 1 -- 172.21.15.77:0/2714316299 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee802ce90 con 0x7f6ef0159e40 2023-11-04T01:46:16.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.139+0000 7f6ef79e2640 1 -- 172.21.15.77:0/2714316299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef015cb90 con 0x7f6ef0159e40 2023-11-04T01:46:16.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.139+0000 7f6ee5ffb640 1 -- 172.21.15.77:0/2714316299 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8040a10 con 0x7f6ef0159e40 2023-11-04T01:46:16.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.139+0000 7f6ef79e2640 1 -- 172.21.15.77:0/2714316299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef015d150 con 0x7f6ef0159e40 2023-11-04T01:46:16.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.140+0000 7f6ef79e2640 1 -- 172.21.15.77:0/2714316299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef00684b0 con 0x7f6ef0159e40 2023-11-04T01:46:16.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.140+0000 7f6ee5ffb640 1 -- 172.21.15.77:0/2714316299 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6ee8040b70 con 0x7f6ef0159e40 2023-11-04T01:46:16.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.140+0000 7f6ee5ffb640 1 --2- 172.21.15.77:0/2714316299 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6ed406ae70 0x7f6ed406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:16.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.141+0000 7f6ee5ffb640 1 -- 172.21.15.77:0/2714316299 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7737+0+0 (secure 0 0 0) 0x7f6ee80ac980 con 0x7f6ef0159e40 2023-11-04T01:46:16.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.141+0000 7f6ef577e640 1 --2- 172.21.15.77:0/2714316299 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6ed406ae70 0x7f6ed406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:16.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.141+0000 7f6ef577e640 1 --2- 172.21.15.77:0/2714316299 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6ed406ae70 0x7f6ed406d330 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f6eec007fd0 tx=0x7f6eec007de0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:16.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.145+0000 7f6ee5ffb640 1 -- 172.21.15.77:0/2714316299 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6ee80772f0 con 0x7f6ef0159e40 2023-11-04T01:46:16.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.322+0000 7f6ef79e2640 1 -- 172.21.15.77:0/2714316299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6ef00c9750 con 0x7f6ef0159e40 2023-11-04T01:46:16.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.322+0000 7f6ee5ffb640 1 -- 172.21.15.77:0/2714316299 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 13 entries v107) v1 ==== 81+0+793 (secure 0 0 0) 0x7f6ee807a910 con 0x7f6ef0159e40 2023-11-04T01:46:16.324 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.1:0/3032548059 2023-11-04T02:46:09.897134+0000 2023-11-04T01:46:16.325 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6835/3207490604 2023-11-05T01:46:01.591697+0000 2023-11-04T01:46:16.325 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6833/3207490604 2023-11-05T01:46:01.591697+0000 2023-11-04T01:46:16.325 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6834/1345816612 2023-11-05T01:45:54.789240+0000 2023-11-04T01:46:16.325 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6832/285184758 2023-11-05T01:45:27.182069+0000 2023-11-04T01:46:16.325 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6836/2908314953 2023-11-05T01:45:01.982045+0000 2023-11-04T01:46:16.326 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6834/285184758 2023-11-05T01:45:27.182069+0000 2023-11-04T01:46:16.326 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6834/2908314953 2023-11-05T01:45:01.982045+0000 2023-11-04T01:46:16.326 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6834/4241784871 2023-11-05T01:44:36.807284+0000 2023-11-04T01:46:16.326 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6832/4241784871 2023-11-05T01:44:36.807284+0000 2023-11-04T01:46:16.327 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6836/3699147778 2023-11-05T01:44:11.242543+0000 2023-11-04T01:46:16.327 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6836/1345816612 2023-11-05T01:45:54.789240+0000 2023-11-04T01:46:16.327 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6834/3699147778 2023-11-05T01:44:11.242543+0000 2023-11-04T01:46:16.328 INFO:teuthology.orchestra.run.smithi077.stderr:listed 13 entries 2023-11-04T01:46:16.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.324+0000 7f6ef79e2640 1 -- 172.21.15.77:0/2714316299 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6ed406ae70 msgr2=0x7f6ed406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:16.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.324+0000 7f6ef79e2640 1 --2- 172.21.15.77:0/2714316299 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6ed406ae70 0x7f6ed406d330 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f6eec007fd0 tx=0x7f6eec007de0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.324+0000 7f6ef79e2640 1 -- 172.21.15.77:0/2714316299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ef0159e40 msgr2=0x7f6ef015aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:16.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.324+0000 7f6ef79e2640 1 --2- 172.21.15.77:0/2714316299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ef0159e40 0x7f6ef015aa00 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8009d90 tx=0x7f6ee8004a40 comp rx=0 tx=0).stop 2023-11-04T01:46:16.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.324+0000 7f6ef79e2640 1 -- 172.21.15.77:0/2714316299 shutdown_connections 2023-11-04T01:46:16.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.324+0000 7f6ef79e2640 1 --2- 172.21.15.77:0/2714316299 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6ed406ae70 0x7f6ed406d330 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.324+0000 7f6ef79e2640 1 --2- 172.21.15.77:0/2714316299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ef0159e40 0x7f6ef015aa00 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.324+0000 7f6ef79e2640 1 --2- 172.21.15.77:0/2714316299 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6ef00b0c40 0x7f6ef00c2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.324+0000 7f6ef79e2640 1 --2- 172.21.15.77:0/2714316299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ef006bb60 0x7f6ef015c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.324+0000 7f6ef79e2640 1 -- 172.21.15.77:0/2714316299 >> 172.21.15.77:0/2714316299 conn(0x7f6ef00cb530 msgr2=0x7f6ef00ae480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:16.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.324+0000 7f6ef79e2640 1 -- 172.21.15.77:0/2714316299 shutdown_connections 2023-11-04T01:46:16.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.324+0000 7f6ef79e2640 1 -- 172.21.15.77:0/2714316299 wait complete. 2023-11-04T01:46:16.336 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2023-11-04T01:46:16.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:46:16.337 DEBUG:teuthology.orchestra.run.smithi077:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2023-11-04T01:46:16.363 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[147949]: fuse finished with error 0 and tester_r 0 2023-11-04T01:46:16.365 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2023-11-04T01:46:16.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:46:16.366 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:46:16.420 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:46:16.421 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:46:16.475 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19534 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:46:16.476 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:46:16.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.612+0000 7ff4c9f9e640 1 Processor -- start 2023-11-04T01:46:16.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.612+0000 7ff4c9f9e640 1 -- start start 2023-11-04T01:46:16.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.613+0000 7ff4c9f9e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4c40cd9c0 0x7ff4c4165e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:16.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.613+0000 7ff4c9f9e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c40cf240 con 0x7ff4c415b200 2023-11-04T01:46:16.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.613+0000 7ff4c9f9e640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c40cde80 con 0x7ff4c40afda0 2023-11-04T01:46:16.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.613+0000 7ff4c9f9e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c40cf670 con 0x7ff4c40cd9c0 2023-11-04T01:46:16.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.613+0000 7ff4c37fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ff4c415b200 0x7ff4c40ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57500/0 (socket says 172.21.15.77:57500) 2023-11-04T01:46:16.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.613+0000 7ff4c37fe640 1 -- 172.21.15.77:0/674477890 learned_addr learned my addr 172.21.15.77:0/674477890 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:46:16.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.614+0000 7ff4c2ffd640 1 -- 172.21.15.77:0/674477890 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2080182945 0 0) 0x7ff4b4001290 con 0x7ff4c415b200 2023-11-04T01:46:16.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.614+0000 7ff4c2ffd640 1 -- 172.21.15.77:0/674477890 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4b0003520 con 0x7ff4c415b200 2023-11-04T01:46:16.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.614+0000 7ff4c3fff640 1 --2- 172.21.15.77:0/674477890 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4c40cd9c0 0x7ff4c4165e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:16.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.614+0000 7ff4c2ffd640 1 -- 172.21.15.77:0/674477890 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 142969638 0 0) 0x7ff4b0003520 con 0x7ff4c415b200 2023-11-04T01:46:16.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.614+0000 7ff4c2ffd640 1 -- 172.21.15.77:0/674477890 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4c40cd9c0 msgr2=0x7ff4c4165e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:16.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.614+0000 7ff4c2ffd640 1 --2- 172.21.15.77:0/674477890 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4c40cd9c0 0x7ff4c4165e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.614+0000 7ff4c2ffd640 1 -- 172.21.15.77:0/674477890 >> v1:172.21.15.122:6789/0 conn(0x7ff4c40afda0 legacy=0x7ff4c40cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:16.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.614+0000 7ff4c2ffd640 1 -- 172.21.15.77:0/674477890 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c40cf950 con 0x7ff4c415b200 2023-11-04T01:46:16.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.614+0000 7ff4c2ffd640 1 -- 172.21.15.77:0/674477890 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7ff4b4001980 con 0x7ff4c415b200 2023-11-04T01:46:16.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.614+0000 7ff4c2ffd640 1 -- 172.21.15.77:0/674477890 >> v1:172.21.15.77:6789/0 conn(0x7ff4c415b200 legacy=0x7ff4c40ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:16.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.614+0000 7ff4c2ffd640 1 --2- 172.21.15.77:0/674477890 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4b00039a0 0x7ff4b0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:16.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.614+0000 7ff4c2ffd640 1 --2- 172.21.15.77:0/674477890 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4c40cd9c0 0x7ff4b00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:16.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.614+0000 7ff4c2ffd640 1 --2- 172.21.15.77:0/674477890 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4b0004d00 0x7ff4b0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:16.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.614+0000 7ff4c2ffd640 1 -- 172.21.15.77:0/674477890 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c40cf670 con 0x7ff4b00039a0 2023-11-04T01:46:16.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.614+0000 7ff4c2ffd640 1 -- 172.21.15.77:0/674477890 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b000bb90 con 0x7ff4b0004d00 2023-11-04T01:46:16.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.614+0000 7ff4c2ffd640 1 -- 172.21.15.77:0/674477890 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b000bd50 con 0x7ff4c40cd9c0 2023-11-04T01:46:16.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.614+0000 7ff4c37fe640 1 --2- 172.21.15.77:0/674477890 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4b00039a0 0x7ff4b0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:16.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.614+0000 7ff4baffd640 1 --2- 172.21.15.77:0/674477890 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4c40cd9c0 0x7ff4b00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:16.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.614+0000 7ff4c3fff640 1 --2- 172.21.15.77:0/674477890 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4b0004d00 0x7ff4b0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:16.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.614+0000 7ff4c37fe640 1 -- 172.21.15.77:0/674477890 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4c40cd9c0 msgr2=0x7ff4b00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:16.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.614+0000 7ff4c37fe640 1 --2- 172.21.15.77:0/674477890 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4c40cd9c0 0x7ff4b00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.614+0000 7ff4c37fe640 1 -- 172.21.15.77:0/674477890 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4b0004d00 msgr2=0x7ff4b0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:16.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.614+0000 7ff4c37fe640 1 --2- 172.21.15.77:0/674477890 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4b0004d00 0x7ff4b0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.614+0000 7ff4c37fe640 1 -- 172.21.15.77:0/674477890 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b0003520 con 0x7ff4b00039a0 2023-11-04T01:46:16.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.614+0000 7ff4c3fff640 1 --2- 172.21.15.77:0/674477890 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4b0004d00 0x7ff4b0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:16.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.615+0000 7ff4c37fe640 1 --2- 172.21.15.77:0/674477890 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4b00039a0 0x7ff4b0003dc0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7ff4b400c210 tx=0x7ff4b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd37c3987b3906fc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:16.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.615+0000 7ff4c2ffd640 1 -- 172.21.15.77:0/674477890 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4007270 con 0x7ff4b00039a0 2023-11-04T01:46:16.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.615+0000 7ff4c2ffd640 1 -- 172.21.15.77:0/674477890 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b40073f0 con 0x7ff4b00039a0 2023-11-04T01:46:16.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.615+0000 7ff4c2ffd640 1 -- 172.21.15.77:0/674477890 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b402c890 con 0x7ff4b00039a0 2023-11-04T01:46:16.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.616+0000 7ff4c9f9e640 1 -- 172.21.15.77:0/674477890 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4b00039a0 msgr2=0x7ff4b0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:16.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.616+0000 7ff4c9f9e640 1 --2- 172.21.15.77:0/674477890 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4b00039a0 0x7ff4b0003dc0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7ff4b400c210 tx=0x7ff4b00057f0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.616+0000 7ff4c3fff640 1 -- 172.21.15.77:0/674477890 reap_dead start 2023-11-04T01:46:16.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.616+0000 7ff4c9f9e640 1 -- 172.21.15.77:0/674477890 shutdown_connections 2023-11-04T01:46:16.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.616+0000 7ff4c9f9e640 1 -- 172.21.15.77:0/674477890 >> 172.21.15.77:0/674477890 conn(0x7ff4c40d0c30 msgr2=0x7ff4c40d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:16.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.616+0000 7ff4c9f9e640 1 -- 172.21.15.77:0/674477890 shutdown_connections 2023-11-04T01:46:16.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.616+0000 7ff4c9f9e640 1 -- 172.21.15.77:0/674477890 wait complete. 2023-11-04T01:46:16.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.617+0000 7ff4c9f9e640 1 Processor -- start 2023-11-04T01:46:16.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.617+0000 7ff4c9f9e640 1 -- start start 2023-11-04T01:46:16.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.618+0000 7ff4c9f9e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4b00039a0 0x7ff4c40c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:16.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.618+0000 7ff4c9f9e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4c4153200 0x7ff4c40ca820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:16.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.618+0000 7ff4c9f9e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4c4154340 0x7ff4c41547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:16.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.618+0000 7ff4c9f9e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c4154d00 con 0x7ff4c4154340 2023-11-04T01:46:16.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.618+0000 7ff4c9f9e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c40c6420 con 0x7ff4b00039a0 2023-11-04T01:46:16.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.618+0000 7ff4c9f9e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c40c6700 con 0x7ff4c4153200 2023-11-04T01:46:16.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.618+0000 7ff4c3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4c4154340 0x7ff4c41547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:16.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.618+0000 7ff4c3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4c4154340 0x7ff4c41547c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55858/0 (socket says 172.21.15.77:55858) 2023-11-04T01:46:16.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.618+0000 7ff4c3fff640 1 -- 172.21.15.77:0/1663305870 learned_addr learned my addr 172.21.15.77:0/1663305870 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:16.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.618+0000 7ff4c37fe640 1 --2- 172.21.15.77:0/1663305870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4b00039a0 0x7ff4c40c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:16.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.618+0000 7ff4baffd640 1 --2- 172.21.15.77:0/1663305870 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4c4153200 0x7ff4c40ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:16.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.618+0000 7ff4c3fff640 1 -- 172.21.15.77:0/1663305870 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4c4153200 msgr2=0x7ff4c40ca820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:16.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.618+0000 7ff4c3fff640 1 --2- 172.21.15.77:0/1663305870 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4c4153200 0x7ff4c40ca820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.618+0000 7ff4c3fff640 1 -- 172.21.15.77:0/1663305870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4b00039a0 msgr2=0x7ff4c40c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:16.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.618+0000 7ff4c3fff640 1 --2- 172.21.15.77:0/1663305870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4b00039a0 0x7ff4c40c5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.618+0000 7ff4c3fff640 1 -- 172.21.15.77:0/1663305870 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c40c69e0 con 0x7ff4c4154340 2023-11-04T01:46:16.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.618+0000 7ff4c3fff640 1 --2- 172.21.15.77:0/1663305870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4c4154340 0x7ff4c41547c0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4071a30 tx=0x7ff4bc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:16.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.618+0000 7ff4c0ff9640 1 -- 172.21.15.77:0/1663305870 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc007c90 con 0x7ff4c4154340 2023-11-04T01:46:16.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.618+0000 7ff4c0ff9640 1 -- 172.21.15.77:0/1663305870 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4bc00f050 con 0x7ff4c4154340 2023-11-04T01:46:16.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.618+0000 7ff4c9f9e640 1 -- 172.21.15.77:0/1663305870 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c40c6cc0 con 0x7ff4c4154340 2023-11-04T01:46:16.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.619+0000 7ff4c0ff9640 1 -- 172.21.15.77:0/1663305870 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc014650 con 0x7ff4c4154340 2023-11-04T01:46:16.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.619+0000 7ff4c9f9e640 1 -- 172.21.15.77:0/1663305870 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c4153900 con 0x7ff4c4154340 2023-11-04T01:46:16.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.620+0000 7ff4c9f9e640 1 -- 172.21.15.77:0/1663305870 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c40684b0 con 0x7ff4c4154340 2023-11-04T01:46:16.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.620+0000 7ff4c0ff9640 1 -- 172.21.15.77:0/1663305870 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff4bc0147b0 con 0x7ff4c4154340 2023-11-04T01:46:16.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.620+0000 7ff4c0ff9640 1 --2- 172.21.15.77:0/1663305870 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff4a406ae70 0x7ff4a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:16.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.620+0000 7ff4c0ff9640 1 -- 172.21.15.77:0/1663305870 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7737+0+0 (secure 0 0 0) 0x7ff4bc08a270 con 0x7ff4c4154340 2023-11-04T01:46:16.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.621+0000 7ff4c37fe640 1 --2- 172.21.15.77:0/1663305870 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff4a406ae70 0x7ff4a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:16.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.621+0000 7ff4c37fe640 1 --2- 172.21.15.77:0/1663305870 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff4a406ae70 0x7ff4a406d330 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4034000 tx=0x7ff4b4009030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:16.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.624+0000 7ff4c0ff9640 1 -- 172.21.15.77:0/1663305870 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff4bc054b30 con 0x7ff4c4154340 2023-11-04T01:46:16.635 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:2023-11-04T01:46:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:46:16.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.830+0000 7ff4c9f9e640 1 -- 172.21.15.77:0/1663305870 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff4c40af420 con 0x7ff4c4154340 2023-11-04T01:46:16.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.831+0000 7ff4c0ff9640 1 -- 172.21.15.77:0/1663305870 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v92) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff4bc058150 con 0x7ff4c4154340 2023-11-04T01:46:16.833 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:46:16.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.832+0000 7ff4c9f9e640 1 -- 172.21.15.77:0/1663305870 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff4a406ae70 msgr2=0x7ff4a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:16.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.832+0000 7ff4c9f9e640 1 --2- 172.21.15.77:0/1663305870 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff4a406ae70 0x7ff4a406d330 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4034000 tx=0x7ff4b4009030 comp rx=0 tx=0).stop 2023-11-04T01:46:16.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.832+0000 7ff4c9f9e640 1 -- 172.21.15.77:0/1663305870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4c4154340 msgr2=0x7ff4c41547c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:16.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.832+0000 7ff4c9f9e640 1 --2- 172.21.15.77:0/1663305870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4c4154340 0x7ff4c41547c0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4071a30 tx=0x7ff4bc004770 comp rx=0 tx=0).stop 2023-11-04T01:46:16.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.833+0000 7ff4c9f9e640 1 -- 172.21.15.77:0/1663305870 shutdown_connections 2023-11-04T01:46:16.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.833+0000 7ff4c9f9e640 1 --2- 172.21.15.77:0/1663305870 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff4a406ae70 0x7ff4a406d330 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.833+0000 7ff4c9f9e640 1 --2- 172.21.15.77:0/1663305870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4c4154340 0x7ff4c41547c0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.833+0000 7ff4c9f9e640 1 --2- 172.21.15.77:0/1663305870 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff4c4153200 0x7ff4c40ca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.833+0000 7ff4c9f9e640 1 --2- 172.21.15.77:0/1663305870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4b00039a0 0x7ff4c40c5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:16.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.833+0000 7ff4c9f9e640 1 -- 172.21.15.77:0/1663305870 >> 172.21.15.77:0/1663305870 conn(0x7ff4c40d0c30 msgr2=0x7ff4c40d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:16.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.833+0000 7ff4c9f9e640 1 -- 172.21.15.77:0/1663305870 shutdown_connections 2023-11-04T01:46:16.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:16.833+0000 7ff4c9f9e640 1 -- 172.21.15.77:0/1663305870 wait complete. 2023-11-04T01:46:16.845 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:46:16.846 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:46:16.846 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2023-11-04T01:46:16.846 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:46:16.847 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:46:16.847 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:46:16.847 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:46:16.847 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:46:16.848 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:46:16.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:46:16.849 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2023-11-04T01:46:16.864 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:46:16.864 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:46:16.864 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:46:16.865 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:46:16.865 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2023-11-04T01:46:16.865 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:46:16.865 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:46:16.865 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:46:16.866 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f0 2023-11-04T01:46:16.866 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:46:16.866 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:46:16.866 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f1 2023-11-04T01:46:16.867 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:46:16.867 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:46:16.867 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:46:16.867 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:46:16.867 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:46:16.868 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 42029sec preferred_lft 42029sec 2023-11-04T01:46:16.868 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::ec4:7aff:fe8f:d3d3/64 scope link 2023-11-04T01:46:16.868 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:46:16.868 INFO:teuthology.orchestra.run.smithi077.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:46:16.868 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 06:3a:02:11:c4:57 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:46:16.869 INFO:teuthology.orchestra.run.smithi077.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:46:16.869 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:46:16.869 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::8039:1aff:fee2:109f/64 scope link 2023-11-04T01:46:16.869 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:46:16.869 INFO:teuthology.orchestra.run.smithi077.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:46:16.870 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 06:3a:02:11:c4:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:46:16.870 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::43a:2ff:fe11:c457/64 scope link 2023-11-04T01:46:16.870 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:46:16.870 INFO:teuthology.orchestra.run.smithi077.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:46:16.870 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether c2:4f:2a:69:4f:38 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:46:16.871 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::c04f:2aff:fe69:4f38/64 scope link 2023-11-04T01:46:16.871 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:46:16.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:46:16.872 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:46:16.929 INFO:teuthology.orchestra.run.smithi077.stdout:1 2023-11-04T01:46:16.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:46:16.931 DEBUG:teuthology.orchestra.run.smithi077:> route 2023-11-04T01:46:16.986 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2023-11-04T01:46:16.986 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:46:16.987 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:46:16.987 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:46:16.987 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:46:16.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:46:16.988 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-11-04T01:46:16.988 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-11-04T01:46:16.988 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:46:16.989 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:46:16.989 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:46:16.990 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-11-04T01:46:17.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:46:17.081 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2023-11-04T01:46:17.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:46:17.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:46:17.096 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:46:17.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:46:17.097 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 up 2023-11-04T01:46:17.163 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:46:17.163 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:46:17.163 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:46:17.218 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:46:17.218 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:46:17.218 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:46:17.272 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:46:17.328 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2023-11-04T01:46:17.328 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2023-11-04T01:46:17.328 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2023-11-04T01:46:17.329 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2023-11-04T01:46:17.329 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2023-11-04T01:46:17.329 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2023-11-04T01:46:17.329 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2023-11-04T01:46:17.329 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2023-11-04T01:46:17.330 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2023-11-04T01:46:17.330 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2023-11-04T01:46:17.330 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2023-11-04T01:46:17.330 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2023-11-04T01:46:17.330 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:46:17.331 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2023-11-04T01:46:17.331 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2023-11-04T01:46:17.331 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2023-11-04T01:46:17.331 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2023-11-04T01:46:17.331 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2023-11-04T01:46:17.332 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2023-11-04T01:46:17.332 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:46:17.332 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:46:17.332 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:46:17.332 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:46:17.333 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2023-11-04T01:46:17.333 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2023-11-04T01:46:17.333 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:46:17.333 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:46:17.333 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:46:17.333 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:46:17.334 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2023-11-04T01:46:17.334 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:46:17.334 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:46:17.334 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:46:17.334 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:46:17.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:46:17.335 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-11-04T01:46:17.383 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:46:17.383 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:46:17.426 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:46:17.440 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2023-11-04T01:46:17.441 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2023-11-04T01:46:17.441 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2023-11-04T01:46:17.441 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2023-11-04T01:46:17.441 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2023-11-04T01:46:17.442 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2023-11-04T01:46:17.442 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2023-11-04T01:46:17.442 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2023-11-04T01:46:17.442 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2023-11-04T01:46:17.442 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2023-11-04T01:46:17.443 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2023-11-04T01:46:17.443 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2023-11-04T01:46:17.443 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:46:17.443 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2023-11-04T01:46:17.443 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2023-11-04T01:46:17.443 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2023-11-04T01:46:17.444 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2023-11-04T01:46:17.444 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2023-11-04T01:46:17.444 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2023-11-04T01:46:17.444 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:46:17.444 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:46:17.445 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:46:17.445 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:46:17.445 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2023-11-04T01:46:17.445 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2023-11-04T01:46:17.445 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:46:17.445 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:46:17.446 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:46:17.446 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:46:17.446 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2023-11-04T01:46:17.446 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:46:17.446 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:46:17.446 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:46:17.447 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:46:17.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:46:17.447 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-11-04T01:46:17.514 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:2023-11-04T01:46:17.513+0000 7fceb23f6480 -1 init, newargv = 0x55c18a7bcc50 newargc=15 2023-11-04T01:46:17.514 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[153551]: starting ceph client 2023-11-04T01:46:17.520 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[153551]: starting fuse 2023-11-04T01:46:18.597 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:46:18.617 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2023-11-04T01:46:18.617 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2023-11-04T01:46:18.617 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2023-11-04T01:46:18.618 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2023-11-04T01:46:18.618 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2023-11-04T01:46:18.618 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2023-11-04T01:46:18.618 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2023-11-04T01:46:18.619 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2023-11-04T01:46:18.619 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2023-11-04T01:46:18.619 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2023-11-04T01:46:18.619 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2023-11-04T01:46:18.619 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2023-11-04T01:46:18.620 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:46:18.620 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2023-11-04T01:46:18.620 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2023-11-04T01:46:18.620 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2023-11-04T01:46:18.621 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2023-11-04T01:46:18.621 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2023-11-04T01:46:18.621 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2023-11-04T01:46:18.622 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:46:18.622 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:46:18.622 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:46:18.622 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:46:18.623 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2023-11-04T01:46:18.623 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2023-11-04T01:46:18.623 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:46:18.623 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:46:18.623 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:46:18.624 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:46:18.624 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2023-11-04T01:46:18.624 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:46:18.624 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:46:18.624 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:46:18.625 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:46:18.625 INFO:teuthology.orchestra.run.smithi077.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:46:18.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:46:18.626 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-11-04T01:46:18.674 INFO:teuthology.orchestra.run.smithi077.stdout:42 2023-11-04T01:46:18.674 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-11-04T01:46:18.675 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:46:18.675 DEBUG:teuthology.orchestra.run.smithi077:> import glob 2023-11-04T01:46:18.675 DEBUG:teuthology.orchestra.run.smithi077:> import re 2023-11-04T01:46:18.676 DEBUG:teuthology.orchestra.run.smithi077:> import os 2023-11-04T01:46:18.676 DEBUG:teuthology.orchestra.run.smithi077:> import subprocess 2023-11-04T01:46:18.677 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:46:18.677 DEBUG:teuthology.orchestra.run.smithi077:> def _find_admin_socket(client_name): 2023-11-04T01:46:18.677 DEBUG:teuthology.orchestra.run.smithi077:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:46:18.678 DEBUG:teuthology.orchestra.run.smithi077:> files = glob.glob(asok_path) 2023-11-04T01:46:18.678 DEBUG:teuthology.orchestra.run.smithi077:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:46:18.679 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:46:18.679 DEBUG:teuthology.orchestra.run.smithi077:> # Given a non-glob path, it better be there 2023-11-04T01:46:18.679 DEBUG:teuthology.orchestra.run.smithi077:> if "*" not in asok_path: 2023-11-04T01:46:18.680 DEBUG:teuthology.orchestra.run.smithi077:> assert(len(files) == 1) 2023-11-04T01:46:18.680 DEBUG:teuthology.orchestra.run.smithi077:> return files[0] 2023-11-04T01:46:18.680 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:46:18.681 DEBUG:teuthology.orchestra.run.smithi077:> for f in files: 2023-11-04T01:46:18.681 DEBUG:teuthology.orchestra.run.smithi077:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:46:18.682 DEBUG:teuthology.orchestra.run.smithi077:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:46:18.682 DEBUG:teuthology.orchestra.run.smithi077:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:46:18.683 DEBUG:teuthology.orchestra.run.smithi077:> contents = proc_f.read() 2023-11-04T01:46:18.683 DEBUG:teuthology.orchestra.run.smithi077:> if mountpoint in contents: 2023-11-04T01:46:18.683 DEBUG:teuthology.orchestra.run.smithi077:> return f 2023-11-04T01:46:18.684 DEBUG:teuthology.orchestra.run.smithi077:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:46:18.684 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:46:18.685 DEBUG:teuthology.orchestra.run.smithi077:> print(_find_admin_socket("client.0")) 2023-11-04T01:46:18.685 DEBUG:teuthology.orchestra.run.smithi077:> ' 2023-11-04T01:46:18.799 INFO:teuthology.orchestra.run.smithi077.stdout:/var/run/ceph/ceph-client.0.153551.asok 2023-11-04T01:46:18.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:46:18.810 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.153551.asok 2023-11-04T01:46:18.810 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:46:18.811 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.153551.asok status 2023-11-04T01:46:18.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:46:18.978 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-04T01:46:18.979 INFO:teuthology.orchestra.run.smithi077.stdout: "metadata": { 2023-11-04T01:46:18.979 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:46:18.979 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:46:18.979 INFO:teuthology.orchestra.run.smithi077.stdout: "entity_id": "0", 2023-11-04T01:46:18.980 INFO:teuthology.orchestra.run.smithi077.stdout: "hostname": "smithi077", 2023-11-04T01:46:18.980 INFO:teuthology.orchestra.run.smithi077.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:46:18.980 INFO:teuthology.orchestra.run.smithi077.stdout: "pid": "153551", 2023-11-04T01:46:18.980 INFO:teuthology.orchestra.run.smithi077.stdout: "root": "/" 2023-11-04T01:46:18.981 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:46:18.981 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_count": 0, 2023-11-04T01:46:18.981 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_pinned_count": 0, 2023-11-04T01:46:18.981 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 8265, 2023-11-04T01:46:18.981 INFO:teuthology.orchestra.run.smithi077.stdout: "inst": { 2023-11-04T01:46:18.982 INFO:teuthology.orchestra.run.smithi077.stdout: "name": { 2023-11-04T01:46:18.982 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "client", 2023-11-04T01:46:18.982 INFO:teuthology.orchestra.run.smithi077.stdout: "num": 8265 2023-11-04T01:46:18.982 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:46:18.982 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2023-11-04T01:46:18.983 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2023-11-04T01:46:18.983 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:46:18.983 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2249624526 2023-11-04T01:46:18.983 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:46:18.983 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:46:18.984 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2023-11-04T01:46:18.984 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2023-11-04T01:46:18.984 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:46:18.984 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2249624526 2023-11-04T01:46:18.984 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:46:18.984 INFO:teuthology.orchestra.run.smithi077.stdout: "inst_str": "client.8265 192.168.0.1:0/2249624526", 2023-11-04T01:46:18.985 INFO:teuthology.orchestra.run.smithi077.stdout: "addr_str": "192.168.0.1:0/2249624526", 2023-11-04T01:46:18.985 INFO:teuthology.orchestra.run.smithi077.stdout: "inode_count": 1, 2023-11-04T01:46:18.985 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_epoch": 92, 2023-11-04T01:46:18.985 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch": 107, 2023-11-04T01:46:18.986 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:46:18.986 INFO:teuthology.orchestra.run.smithi077.stdout: "blocklisted": false, 2023-11-04T01:46:18.986 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs" 2023-11-04T01:46:18.986 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-04T01:46:18.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:46:18.993 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:46:18.993 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:46:18.993 DEBUG:teuthology.orchestra.run.smithi077:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:46:19.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:46:19.052 INFO:teuthology.orchestra.run.smithi077.stdout:fuseblk 2023-11-04T01:46:19.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:46:19.058 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:46:19.059 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:46:19.059 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:46:19.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:46:19.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:46:19.124 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 flush journal 2023-11-04T01:46:19.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.223+0000 7f8f49b4c640 1 Processor -- start 2023-11-04T01:46:19.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.224+0000 7f8f49b4c640 1 -- start start 2023-11-04T01:46:19.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.224+0000 7f8f49b4c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8f440b0c40 0x7f8f440ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.224+0000 7f8f49b4c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f440c9100 con 0x7f8f4406b950 2023-11-04T01:46:19.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.224+0000 7f8f49b4c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f440ae230 con 0x7f8f441605b0 2023-11-04T01:46:19.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.224+0000 7f8f49b4c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f440aceb0 con 0x7f8f440b0c40 2023-11-04T01:46:19.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.224+0000 7f8f43fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f8f4406b950 0x7f8f440c9590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49410/0 (socket says 172.21.15.77:49410) 2023-11-04T01:46:19.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.224+0000 7f8f43fff640 1 -- 172.21.15.77:0/1837301038 learned_addr learned my addr 172.21.15.77:0/1837301038 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:46:19.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.225+0000 7f8f42ffd640 1 --2- 172.21.15.77:0/1837301038 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8f440b0c40 0x7f8f440ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.225+0000 7f8f427fc640 1 -- 172.21.15.77:0/1837301038 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2072109485 0 0) 0x7f8f440c9100 con 0x7f8f4406b950 2023-11-04T01:46:19.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.225+0000 7f8f427fc640 1 -- 172.21.15.77:0/1837301038 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f2c003520 con 0x7f8f4406b950 2023-11-04T01:46:19.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.225+0000 7f8f427fc640 1 -- 172.21.15.77:0/1837301038 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2150750180 0 0) 0x7f8f440ae230 con 0x7f8f441605b0 2023-11-04T01:46:19.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.225+0000 7f8f427fc640 1 -- 172.21.15.77:0/1837301038 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f440c9100 con 0x7f8f441605b0 2023-11-04T01:46:19.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.225+0000 7f8f427fc640 1 -- 172.21.15.77:0/1837301038 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1130697147 0 0) 0x7f8f2c003520 con 0x7f8f4406b950 2023-11-04T01:46:19.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.225+0000 7f8f427fc640 1 -- 172.21.15.77:0/1837301038 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8f440b0c40 msgr2=0x7f8f440ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:19.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.225+0000 7f8f427fc640 1 --2- 172.21.15.77:0/1837301038 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8f440b0c40 0x7f8f440ac8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.225+0000 7f8f427fc640 1 -- 172.21.15.77:0/1837301038 >> v1:172.21.15.122:6789/0 conn(0x7f8f441605b0 legacy=0x7f8f440b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:19.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.225+0000 7f8f427fc640 1 -- 172.21.15.77:0/1837301038 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f440ad190 con 0x7f8f4406b950 2023-11-04T01:46:19.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.225+0000 7f8f427fc640 1 -- 172.21.15.77:0/1837301038 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f8f3c0019f0 con 0x7f8f4406b950 2023-11-04T01:46:19.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.225+0000 7f8f427fc640 1 -- 172.21.15.77:0/1837301038 >> v1:172.21.15.77:6789/0 conn(0x7f8f4406b950 legacy=0x7f8f440c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:19.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.225+0000 7f8f427fc640 1 --2- 172.21.15.77:0/1837301038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f2c003b30 0x7f8f2c003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.225+0000 7f8f427fc640 1 --2- 172.21.15.77:0/1837301038 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8f440b0c40 0x7f8f2c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.225+0000 7f8f427fc640 1 --2- 172.21.15.77:0/1837301038 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f2c004d00 0x7f8f2c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.225+0000 7f8f427fc640 1 -- 172.21.15.77:0/1837301038 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f440aceb0 con 0x7f8f2c003b30 2023-11-04T01:46:19.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.225+0000 7f8f427fc640 1 -- 172.21.15.77:0/1837301038 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c00ba80 con 0x7f8f2c004d00 2023-11-04T01:46:19.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.225+0000 7f8f427fc640 1 -- 172.21.15.77:0/1837301038 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c00bc40 con 0x7f8f440b0c40 2023-11-04T01:46:19.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.225+0000 7f8f437fe640 1 --2- 172.21.15.77:0/1837301038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f2c003b30 0x7f8f2c003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.225+0000 7f8f43fff640 1 --2- 172.21.15.77:0/1837301038 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f2c004d00 0x7f8f2c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.225+0000 7f8f42ffd640 1 --2- 172.21.15.77:0/1837301038 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8f440b0c40 0x7f8f2c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.225+0000 7f8f437fe640 1 -- 172.21.15.77:0/1837301038 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8f440b0c40 msgr2=0x7f8f2c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:19.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.225+0000 7f8f437fe640 1 --2- 172.21.15.77:0/1837301038 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8f440b0c40 0x7f8f2c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.225+0000 7f8f437fe640 1 -- 172.21.15.77:0/1837301038 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f2c004d00 msgr2=0x7f8f2c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:19.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.225+0000 7f8f437fe640 1 --2- 172.21.15.77:0/1837301038 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f2c004d00 0x7f8f2c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.225+0000 7f8f437fe640 1 -- 172.21.15.77:0/1837301038 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2c003520 con 0x7f8f2c003b30 2023-11-04T01:46:19.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.226+0000 7f8f437fe640 1 --2- 172.21.15.77:0/1837301038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f2c003b30 0x7f8f2c003f30 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f8f340018d0 tx=0x7f8f2c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a92f3a6192897f6a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:19.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.226+0000 7f8f427fc640 1 -- 172.21.15.77:0/1837301038 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f340052d0 con 0x7f8f2c003b30 2023-11-04T01:46:19.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.226+0000 7f8f427fc640 1 -- 172.21.15.77:0/1837301038 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f34005430 con 0x7f8f2c003b30 2023-11-04T01:46:19.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.226+0000 7f8f427fc640 1 -- 172.21.15.77:0/1837301038 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f34003810 con 0x7f8f2c003b30 2023-11-04T01:46:19.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.227+0000 7f8f49b4c640 1 -- 172.21.15.77:0/1837301038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f2c003b30 msgr2=0x7f8f2c003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:19.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.227+0000 7f8f49b4c640 1 --2- 172.21.15.77:0/1837301038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f2c003b30 0x7f8f2c003f30 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f8f340018d0 tx=0x7f8f2c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.227+0000 7f8f43fff640 1 -- 172.21.15.77:0/1837301038 reap_dead start 2023-11-04T01:46:19.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.227+0000 7f8f49b4c640 1 -- 172.21.15.77:0/1837301038 shutdown_connections 2023-11-04T01:46:19.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.227+0000 7f8f49b4c640 1 -- 172.21.15.77:0/1837301038 >> 172.21.15.77:0/1837301038 conn(0x7f8f440cb530 msgr2=0x7f8f440cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:19.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.227+0000 7f8f49b4c640 1 -- 172.21.15.77:0/1837301038 shutdown_connections 2023-11-04T01:46:19.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.227+0000 7f8f49b4c640 1 -- 172.21.15.77:0/1837301038 wait complete. 2023-11-04T01:46:19.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.228+0000 7f8f49b4c640 1 Processor -- start 2023-11-04T01:46:19.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.228+0000 7f8f49b4c640 1 -- start start 2023-11-04T01:46:19.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.229+0000 7f8f49b4c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8f2c003b30 0x7f8f440b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.229+0000 7f8f49b4c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f440c85b0 0x7f8f440c6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.229+0000 7f8f49b4c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f440c6590 0x7f8f440c6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.229+0000 7f8f49b4c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f440c8390 con 0x7f8f440c85b0 2023-11-04T01:46:19.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.229+0000 7f8f49b4c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f44153460 con 0x7f8f440c6590 2023-11-04T01:46:19.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.229+0000 7f8f49b4c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f44153180 con 0x7f8f2c003b30 2023-11-04T01:46:19.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.229+0000 7f8f42ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f440c85b0 0x7f8f440c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.229+0000 7f8f42ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f440c85b0 0x7f8f440c6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53306/0 (socket says 172.21.15.77:53306) 2023-11-04T01:46:19.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.229+0000 7f8f42ffd640 1 -- 172.21.15.77:0/1117642885 learned_addr learned my addr 172.21.15.77:0/1117642885 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:19.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.229+0000 7f8f437fe640 1 --2- 172.21.15.77:0/1117642885 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8f2c003b30 0x7f8f440b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.229+0000 7f8f43fff640 1 --2- 172.21.15.77:0/1117642885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f440c6590 0x7f8f440c6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.229+0000 7f8f42ffd640 1 -- 172.21.15.77:0/1117642885 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8f2c003b30 msgr2=0x7f8f440b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:19.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.229+0000 7f8f42ffd640 1 --2- 172.21.15.77:0/1117642885 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8f2c003b30 0x7f8f440b3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.229+0000 7f8f42ffd640 1 -- 172.21.15.77:0/1117642885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f440c6590 msgr2=0x7f8f440c6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:19.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.229+0000 7f8f42ffd640 1 --2- 172.21.15.77:0/1117642885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f440c6590 0x7f8f440c6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.229+0000 7f8f42ffd640 1 -- 172.21.15.77:0/1117642885 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f440b2980 con 0x7f8f440c85b0 2023-11-04T01:46:19.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.229+0000 7f8f437fe640 1 --2- 172.21.15.77:0/1117642885 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8f2c003b30 0x7f8f440b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:19.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.229+0000 7f8f42ffd640 1 --2- 172.21.15.77:0/1117642885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f440c85b0 0x7f8f440c6050 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f8f38011630 tx=0x7f8f38011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:19.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.229+0000 7f8f2bfff640 1 -- 172.21.15.77:0/1117642885 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3800f8c0 con 0x7f8f440c85b0 2023-11-04T01:46:19.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.229+0000 7f8f2bfff640 1 -- 172.21.15.77:0/1117642885 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3800fa20 con 0x7f8f440c85b0 2023-11-04T01:46:19.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.229+0000 7f8f49b4c640 1 -- 172.21.15.77:0/1117642885 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f440b2c60 con 0x7f8f440c85b0 2023-11-04T01:46:19.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.229+0000 7f8f2bfff640 1 -- 172.21.15.77:0/1117642885 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3800fd90 con 0x7f8f440c85b0 2023-11-04T01:46:19.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.229+0000 7f8f49b4c640 1 -- 172.21.15.77:0/1117642885 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f440c8a30 con 0x7f8f440c85b0 2023-11-04T01:46:19.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.231+0000 7f8f2bfff640 1 -- 172.21.15.77:0/1117642885 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8f38015460 con 0x7f8f440c85b0 2023-11-04T01:46:19.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.231+0000 7f8f2bfff640 1 --2- 172.21.15.77:0/1117642885 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8f3006ae70 0x7f8f3006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.231+0000 7f8f2bfff640 1 -- 172.21.15.77:0/1117642885 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7825+0+0 (secure 0 0 0) 0x7f8f3808a600 con 0x7f8f440c85b0 2023-11-04T01:46:19.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.231+0000 7f8f437fe640 1 --2- 172.21.15.77:0/1117642885 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8f3006ae70 0x7f8f3006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.232+0000 7f8f437fe640 1 --2- 172.21.15.77:0/1117642885 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8f3006ae70 0x7f8f3006d330 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8f34034000 tx=0x7f8f34031000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:19.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.232+0000 7f8f4c7b3740 1 Processor -- start 2023-11-04T01:46:19.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.232+0000 7f8f4c7b3740 1 -- start start 2023-11-04T01:46:19.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.233+0000 7f8f4c7b3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d4710e4c0 0x564d4710e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.233+0000 7f8f4c7b3740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x564d470de6d0 0x564d4710b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.233+0000 7f8f4c7b3740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d470e2040 0x564d4710bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.233+0000 7f8f4c7b3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d47051d70 con 0x564d4710e4c0 2023-11-04T01:46:19.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.233+0000 7f8f4c7b3740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d4704f460 con 0x564d470e2040 2023-11-04T01:46:19.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.233+0000 7f8f4c7b3740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x564d4704ad50 con 0x564d470de6d0 2023-11-04T01:46:19.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.233+0000 7f8f437fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d4710e4c0 0x564d4710e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.233+0000 7f8f437fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d4710e4c0 0x564d4710e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53310/0 (socket says 172.21.15.77:53310) 2023-11-04T01:46:19.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.233+0000 7f8f437fe640 1 -- 172.21.15.77:0/854445549 learned_addr learned my addr 172.21.15.77:0/854445549 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:19.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.233+0000 7f8f42ffd640 1 --2- 172.21.15.77:0/854445549 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x564d470de6d0 0x564d4710b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.233+0000 7f8f43fff640 1 --2- 172.21.15.77:0/854445549 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d470e2040 0x564d4710bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.233+0000 7f8f437fe640 1 -- 172.21.15.77:0/854445549 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x564d470de6d0 msgr2=0x564d4710b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:19.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.233+0000 7f8f437fe640 1 --2- 172.21.15.77:0/854445549 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x564d470de6d0 0x564d4710b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.233+0000 7f8f437fe640 1 -- 172.21.15.77:0/854445549 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d470e2040 msgr2=0x564d4710bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:19.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.233+0000 7f8f437fe640 1 --2- 172.21.15.77:0/854445549 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d470e2040 0x564d4710bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.233+0000 7f8f437fe640 1 -- 172.21.15.77:0/854445549 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d4700de30 con 0x564d4710e4c0 2023-11-04T01:46:19.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.234+0000 7f8f437fe640 1 --2- 172.21.15.77:0/854445549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d4710e4c0 0x564d4710e8a0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f8f34001200 tx=0x7f8f34009030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5c6d8fe8c8860d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:19.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.234+0000 7f8f297fa640 1 -- 172.21.15.77:0/854445549 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f340035f0 con 0x564d4710e4c0 2023-11-04T01:46:19.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.234+0000 7f8f297fa640 1 -- 172.21.15.77:0/854445549 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f34003750 con 0x564d4710e4c0 2023-11-04T01:46:19.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.234+0000 7f8f297fa640 1 -- 172.21.15.77:0/854445549 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f34003ac0 con 0x564d4710e4c0 2023-11-04T01:46:19.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.234+0000 7f8f4c7b3740 1 -- 172.21.15.77:0/854445549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d4710e4c0 msgr2=0x564d4710e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:19.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.234+0000 7f8f4c7b3740 1 --2- 172.21.15.77:0/854445549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d4710e4c0 0x564d4710e8a0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f8f34001200 tx=0x7f8f34009030 comp rx=0 tx=0).stop 2023-11-04T01:46:19.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.234+0000 7f8f4c7b3740 1 -- 172.21.15.77:0/854445549 shutdown_connections 2023-11-04T01:46:19.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.234+0000 7f8f4c7b3740 1 --2- 172.21.15.77:0/854445549 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d470e2040 0x564d4710bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.234+0000 7f8f4c7b3740 1 --2- 172.21.15.77:0/854445549 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x564d470de6d0 0x564d4710b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.234+0000 7f8f4c7b3740 1 --2- 172.21.15.77:0/854445549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d4710e4c0 0x564d4710e8a0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.234+0000 7f8f4c7b3740 1 -- 172.21.15.77:0/854445549 >> 172.21.15.77:0/854445549 conn(0x564d470e09e0 msgr2=0x564d471292d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:19.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.234+0000 7f8f4c7b3740 1 -- 172.21.15.77:0/854445549 shutdown_connections 2023-11-04T01:46:19.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.235+0000 7f8f4c7b3740 1 -- 172.21.15.77:0/854445549 wait complete. 2023-11-04T01:46:19.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.235+0000 7f8f4c7b3740 1 -- start start 2023-11-04T01:46:19.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.235+0000 7f8f4c7b3740 1 Processor -- start 2023-11-04T01:46:19.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.236+0000 7f8f4c7b3740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x564d470e2040 0x564d471298b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.236+0000 7f8f4c7b3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d4710e4c0 0x564d47108ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.236+0000 7f8f4c7b3740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d47109150 0x564d47113f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.236+0000 7f8f4c7b3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d47004ee0 con 0x564d4710e4c0 2023-11-04T01:46:19.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.236+0000 7f8f4c7b3740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d47004b80 con 0x564d47109150 2023-11-04T01:46:19.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.236+0000 7f8f4c7b3740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x564d46fca3a0 con 0x564d470e2040 2023-11-04T01:46:19.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.236+0000 7f8f4c7b3740 10 client.0 _ll_register_callbacks cb 0x564d46fce8b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:46:19.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.236+0000 7f8f42ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d4710e4c0 0x564d47108ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.236+0000 7f8f42ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d4710e4c0 0x564d47108ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53320/0 (socket says 172.21.15.77:53320) 2023-11-04T01:46:19.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.236+0000 7f8f42ffd640 1 -- 172.21.15.77:0/1705539742 learned_addr learned my addr 172.21.15.77:0/1705539742 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:19.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.236+0000 7f8f437fe640 1 --2- 172.21.15.77:0/1705539742 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x564d470e2040 0x564d471298b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.236+0000 7f8f43fff640 1 --2- 172.21.15.77:0/1705539742 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d47109150 0x564d47113f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.236+0000 7f8f42ffd640 1 -- 172.21.15.77:0/1705539742 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x564d470e2040 msgr2=0x564d471298b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:19.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.236+0000 7f8f42ffd640 1 --2- 172.21.15.77:0/1705539742 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x564d470e2040 0x564d471298b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.236+0000 7f8f42ffd640 1 -- 172.21.15.77:0/1705539742 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d47109150 msgr2=0x564d47113f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:19.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.236+0000 7f8f42ffd640 1 --2- 172.21.15.77:0/1705539742 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d47109150 0x564d47113f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.236+0000 7f8f42ffd640 1 -- 172.21.15.77:0/1705539742 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f2c003520 con 0x564d4710e4c0 2023-11-04T01:46:19.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.236+0000 7f8f42ffd640 1 --2- 172.21.15.77:0/1705539742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d4710e4c0 0x564d47108ac0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f8f38055160 tx=0x7f8f38060eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=420e0fdaca2eaf03 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:19.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.236+0000 7f8f227fc640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:46:19.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.237+0000 7f8f227fc640 1 -- 172.21.15.77:0/1705539742 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f38070210 con 0x564d4710e4c0 2023-11-04T01:46:19.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.237+0000 7f8f227fc640 1 -- 172.21.15.77:0/1705539742 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 7825+0+0 (secure 0 0 0) 0x7f8f38070370 con 0x564d4710e4c0 2023-11-04T01:46:19.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.237+0000 7f8f4c7b3740 1 -- 172.21.15.77:0/1705539742 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564d47043d30 con 0x564d4710e4c0 2023-11-04T01:46:19.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.237+0000 7f8f227fc640 1 -- 172.21.15.77:0/1705539742 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f380880c0 con 0x564d4710e4c0 2023-11-04T01:46:19.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.237+0000 7f8f4c7b3740 10 client.8277 fetch_fsmap learned FSMap version 92 2023-11-04T01:46:19.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.237+0000 7f8f4c7b3740 1 -- 172.21.15.77:0/1705539742 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x564d470493d0 con 0x564d4710e4c0 2023-11-04T01:46:19.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.237+0000 7f8f227fc640 1 -- 172.21.15.77:0/1705539742 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f38076020 con 0x564d4710e4c0 2023-11-04T01:46:19.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.237+0000 7f8f227fc640 1 -- 172.21.15.77:0/1705539742 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 92) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f8f3801b020 con 0x564d4710e4c0 2023-11-04T01:46:19.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.237+0000 7f8f4c7b3740 10 client.8277 fetch_fsmap finished waiting for FSMap version 92 2023-11-04T01:46:19.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.237+0000 7f8f4c7b3740 10 client.8277 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-11-04T01:46:19.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.237+0000 7f8f4c7b3740 20 client.8277 populate_metadata read hostname 'smithi077' 2023-11-04T01:46:19.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.237+0000 7f8f4c7b3740 1 --2- 172.21.15.77:0/1705539742 >> [v2:172.21.15.77:6832/3276812155,v1:172.21.15.77:6834/3276812155] conn(0x564d47111f80 0x564d4713c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.237+0000 7f8f4c7b3740 4 client.8277 mds_command: new command op to 7977 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:46:19.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.237+0000 7f8f4c7b3740 1 -- 172.21.15.77:0/1705539742 --> [v2:172.21.15.77:6832/3276812155,v1:172.21.15.77:6834/3276812155] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564d47043a50 con 0x564d47111f80 2023-11-04T01:46:19.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.237+0000 7f8f437fe640 1 --2- 172.21.15.77:0/1705539742 >> [v2:172.21.15.77:6832/3276812155,v1:172.21.15.77:6834/3276812155] conn(0x564d47111f80 0x564d4713c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.237+0000 7f8f227fc640 10 client.8277 ms_handle_connect on v2:172.21.15.77:6832/3276812155 2023-11-04T01:46:19.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.237+0000 7f8f437fe640 1 --2- 172.21.15.77:0/1705539742 >> [v2:172.21.15.77:6832/3276812155,v1:172.21.15.77:6834/3276812155] conn(0x564d47111f80 0x564d4713c490 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf0a77e614646d48 server_cookie=b9bee97362a8619b in_seq=0 out_seq=0 2023-11-04T01:46:19.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.238+0000 7f8f227fc640 1 -- 172.21.15.77:0/1705539742 <== mds.0 v2:172.21.15.77:6832/3276812155 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564d47043a50 con 0x564d47111f80 2023-11-04T01:46:19.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.238+0000 7f8f227fc640 10 client.8277 handle_command_reply: tid=0 2023-11-04T01:46:19.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.238+0000 7f8f4c7b3740 1 client.8277 shutdown 2023-11-04T01:46:19.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.238+0000 7f8f4c7b3740 1 -- 172.21.15.77:0/1705539742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d4710e4c0 msgr2=0x564d47108ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:19.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.238+0000 7f8f4c7b3740 1 --2- 172.21.15.77:0/1705539742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d4710e4c0 0x564d47108ac0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f8f38055160 tx=0x7f8f38060eb0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.238+0000 7f8f4c7b3740 1 -- 172.21.15.77:0/1705539742 shutdown_connections 2023-11-04T01:46:19.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.238+0000 7f8f4c7b3740 1 --2- 172.21.15.77:0/1705539742 >> [v2:172.21.15.77:6832/3276812155,v1:172.21.15.77:6834/3276812155] conn(0x564d47111f80 0x564d4713c490 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.238+0000 7f8f4c7b3740 1 --2- 172.21.15.77:0/1705539742 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d47109150 0x564d47113f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.238+0000 7f8f4c7b3740 1 --2- 172.21.15.77:0/1705539742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d4710e4c0 0x564d47108ac0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.238+0000 7f8f4c7b3740 1 --2- 172.21.15.77:0/1705539742 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x564d470e2040 0x564d471298b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.238+0000 7f8f227fc640 0 client.8277 ms_handle_reset on v2:172.21.15.77:6832/3276812155 2023-11-04T01:46:19.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.238+0000 7f8f4c7b3740 1 -- 172.21.15.77:0/1705539742 >> 172.21.15.77:0/1705539742 conn(0x564d470de6d0 msgr2=0x564d4712c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:19.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.238+0000 7f8f4c7b3740 1 -- 172.21.15.77:0/1705539742 shutdown_connections 2023-11-04T01:46:19.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.238+0000 7f8f4c7b3740 1 -- 172.21.15.77:0/1705539742 wait complete. 2023-11-04T01:46:19.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.238+0000 7f8f4c7b3740 20 client.8277 trim_cache size 0 max 16384 2023-11-04T01:46:19.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.251+0000 7f8f4c7b3740 1 Processor -- start 2023-11-04T01:46:19.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.251+0000 7f8f4c7b3740 1 -- start start 2023-11-04T01:46:19.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.252+0000 7f8f4c7b3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d470e2040 0x564d47129920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.252+0000 7f8f4c7b3740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x564d47109150 0x564d470d9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.252+0000 7f8f4c7b3740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d4710e4c0 0x564d471290b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.252+0000 7f8f4c7b3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d4710f550 con 0x564d470e2040 2023-11-04T01:46:19.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.252+0000 7f8f4c7b3740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d471295f0 con 0x564d4710e4c0 2023-11-04T01:46:19.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.252+0000 7f8f4c7b3740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x564d4710f780 con 0x564d47109150 2023-11-04T01:46:19.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.252+0000 7f8f437fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d470e2040 0x564d47129920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.252+0000 7f8f437fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d470e2040 0x564d47129920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53326/0 (socket says 172.21.15.77:53326) 2023-11-04T01:46:19.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.252+0000 7f8f437fe640 1 -- 172.21.15.77:0/2106910362 learned_addr learned my addr 172.21.15.77:0/2106910362 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:19.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.252+0000 7f8f437fe640 1 -- 172.21.15.77:0/2106910362 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x564d47109150 msgr2=0x564d470d9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:19.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.252+0000 7f8f437fe640 1 --2- 172.21.15.77:0/2106910362 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x564d47109150 0x564d470d9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.252+0000 7f8f437fe640 1 -- 172.21.15.77:0/2106910362 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d4710e4c0 msgr2=0x564d471290b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:19.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.252+0000 7f8f437fe640 1 --2- 172.21.15.77:0/2106910362 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d4710e4c0 0x564d471290b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.252+0000 7f8f437fe640 1 -- 172.21.15.77:0/2106910362 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d46fe6ea0 con 0x564d470e2040 2023-11-04T01:46:19.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.252+0000 7f8f437fe640 1 --2- 172.21.15.77:0/2106910362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d470e2040 0x564d47129920 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f8f340018a0 tx=0x7f8f3403f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b80f995c2fff743b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:19.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.253+0000 7f8f29ffb640 1 -- 172.21.15.77:0/2106910362 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3405a040 con 0x564d470e2040 2023-11-04T01:46:19.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.253+0000 7f8f29ffb640 1 -- 172.21.15.77:0/2106910362 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3405c040 con 0x564d470e2040 2023-11-04T01:46:19.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.253+0000 7f8f29ffb640 1 -- 172.21.15.77:0/2106910362 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f34061630 con 0x564d470e2040 2023-11-04T01:46:19.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.253+0000 7f8f4c7b3740 1 -- 172.21.15.77:0/2106910362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d470e2040 msgr2=0x564d47129920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:19.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.253+0000 7f8f4c7b3740 1 --2- 172.21.15.77:0/2106910362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d470e2040 0x564d47129920 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f8f340018a0 tx=0x7f8f3403f000 comp rx=0 tx=0).stop 2023-11-04T01:46:19.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.253+0000 7f8f4c7b3740 1 -- 172.21.15.77:0/2106910362 shutdown_connections 2023-11-04T01:46:19.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.253+0000 7f8f4c7b3740 1 --2- 172.21.15.77:0/2106910362 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d4710e4c0 0x564d471290b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.253+0000 7f8f4c7b3740 1 --2- 172.21.15.77:0/2106910362 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x564d47109150 0x564d470d9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.253+0000 7f8f4c7b3740 1 --2- 172.21.15.77:0/2106910362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d470e2040 0x564d47129920 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.253+0000 7f8f4c7b3740 1 -- 172.21.15.77:0/2106910362 >> 172.21.15.77:0/2106910362 conn(0x564d470de6d0 msgr2=0x564d47107c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:19.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.253+0000 7f8f4c7b3740 1 -- 172.21.15.77:0/2106910362 shutdown_connections 2023-11-04T01:46:19.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.253+0000 7f8f4c7b3740 1 -- 172.21.15.77:0/2106910362 wait complete. 2023-11-04T01:46:19.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.254+0000 7f8f4c7b3740 1 -- start start 2023-11-04T01:46:19.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.254+0000 7f8f4c7b3740 1 Processor -- start 2023-11-04T01:46:19.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.254+0000 7f8f4c7b3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d470e2040 0x564d47192d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.254+0000 7f8f4c7b3740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d47109150 0x564d47142c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.254+0000 7f8f4c7b3740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x564d4710e4c0 0x564d471478e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.254+0000 7f8f4c7b3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d471482d0 con 0x564d470e2040 2023-11-04T01:46:19.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.254+0000 7f8f4c7b3740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d470dd890 con 0x564d47109150 2023-11-04T01:46:19.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.254+0000 7f8f4c7b3740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x564d47142790 con 0x564d4710e4c0 2023-11-04T01:46:19.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.255+0000 7f8f4c7b3740 10 client.0 _ll_register_callbacks cb 0x7f8f34042070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:46:19.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.255+0000 7f8f437fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d470e2040 0x564d47192d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.255+0000 7f8f437fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d470e2040 0x564d47192d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53334/0 (socket says 172.21.15.77:53334) 2023-11-04T01:46:19.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.255+0000 7f8f437fe640 1 -- 172.21.15.77:0/662375729 learned_addr learned my addr 172.21.15.77:0/662375729 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:19.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.255+0000 7f8f42ffd640 1 --2- 172.21.15.77:0/662375729 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d47109150 0x564d47142c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.255+0000 7f8f43fff640 1 --2- 172.21.15.77:0/662375729 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x564d4710e4c0 0x564d471478e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.255+0000 7f8f437fe640 1 -- 172.21.15.77:0/662375729 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x564d4710e4c0 msgr2=0x564d471478e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:19.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.255+0000 7f8f437fe640 1 --2- 172.21.15.77:0/662375729 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x564d4710e4c0 0x564d471478e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.255+0000 7f8f437fe640 1 -- 172.21.15.77:0/662375729 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d47109150 msgr2=0x564d47142c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:19.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.255+0000 7f8f437fe640 1 --2- 172.21.15.77:0/662375729 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d47109150 0x564d47142c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.255+0000 7f8f437fe640 1 -- 172.21.15.77:0/662375729 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564d4700de30 con 0x564d470e2040 2023-11-04T01:46:19.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.255+0000 7f8f437fe640 1 --2- 172.21.15.77:0/662375729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d470e2040 0x564d47192d70 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f8f34007b60 tx=0x7f8f3402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2472feca619fad13 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:19.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.255+0000 7f8f227fc640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:46:19.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.255+0000 7f8f227fc640 1 -- 172.21.15.77:0/662375729 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3405a040 con 0x564d470e2040 2023-11-04T01:46:19.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.255+0000 7f8f227fc640 1 -- 172.21.15.77:0/662375729 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 7825+0+0 (secure 0 0 0) 0x7f8f34061430 con 0x564d470e2040 2023-11-04T01:46:19.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.255+0000 7f8f4c7b3740 1 -- 172.21.15.77:0/662375729 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8f34003750 con 0x564d470e2040 2023-11-04T01:46:19.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.255+0000 7f8f227fc640 1 -- 172.21.15.77:0/662375729 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f340077d0 con 0x564d470e2040 2023-11-04T01:46:19.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.255+0000 7f8f4c7b3740 10 client.8283 fetch_fsmap learned FSMap version 92 2023-11-04T01:46:19.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.255+0000 7f8f4c7b3740 1 -- 172.21.15.77:0/662375729 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x564d4700c690 con 0x564d470e2040 2023-11-04T01:46:19.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.255+0000 7f8f227fc640 1 -- 172.21.15.77:0/662375729 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3407b020 con 0x564d470e2040 2023-11-04T01:46:19.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.256+0000 7f8f227fc640 1 -- 172.21.15.77:0/662375729 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 92) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f8f340615f0 con 0x564d470e2040 2023-11-04T01:46:19.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.256+0000 7f8f4c7b3740 10 client.8283 fetch_fsmap finished waiting for FSMap version 92 2023-11-04T01:46:19.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.256+0000 7f8f4c7b3740 10 client.8283 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-11-04T01:46:19.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.256+0000 7f8f4c7b3740 20 client.8283 populate_metadata read hostname 'smithi077' 2023-11-04T01:46:19.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.256+0000 7f8f4c7b3740 1 --2- 172.21.15.77:0/662375729 >> [v2:172.21.15.77:6832/3276812155,v1:172.21.15.77:6834/3276812155] conn(0x564d47143160 0x564d47113ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.256+0000 7f8f4c7b3740 4 client.8283 mds_command: new command op to 7977 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-11-04T01:46:19.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.256+0000 7f8f4c7b3740 1 -- 172.21.15.77:0/662375729 --> [v2:172.21.15.77:6832/3276812155,v1:172.21.15.77:6834/3276812155] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564d46d4b7e0 con 0x564d47143160 2023-11-04T01:46:19.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.256+0000 7f8f42ffd640 1 --2- 172.21.15.77:0/662375729 >> [v2:172.21.15.77:6832/3276812155,v1:172.21.15.77:6834/3276812155] conn(0x564d47143160 0x564d47113ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.256+0000 7f8f227fc640 10 client.8283 ms_handle_connect on v2:172.21.15.77:6832/3276812155 2023-11-04T01:46:19.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.256+0000 7f8f42ffd640 1 --2- 172.21.15.77:0/662375729 >> [v2:172.21.15.77:6832/3276812155,v1:172.21.15.77:6834/3276812155] conn(0x564d47143160 0x564d47113ef0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=601fc6490ba856f2 server_cookie=78766927ea0ba15f in_seq=0 out_seq=0 2023-11-04T01:46:19.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.266+0000 7f8f227fc640 1 -- 172.21.15.77:0/662375729 <== mds.0 v2:172.21.15.77:6832/3276812155 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564d46d4b7e0 con 0x564d47143160 2023-11-04T01:46:19.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.267+0000 7f8f227fc640 10 client.8283 handle_command_reply: tid=0 2023-11-04T01:46:19.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.267+0000 7f8f4c7b3740 1 client.8283 shutdown 2023-11-04T01:46:19.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.267+0000 7f8f4c7b3740 1 -- 172.21.15.77:0/662375729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d470e2040 msgr2=0x564d47192d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:19.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.267+0000 7f8f4c7b3740 1 --2- 172.21.15.77:0/662375729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d470e2040 0x564d47192d70 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f8f34007b60 tx=0x7f8f3402e000 comp rx=0 tx=0).stop 2023-11-04T01:46:19.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.267+0000 7f8f4c7b3740 1 -- 172.21.15.77:0/662375729 shutdown_connections 2023-11-04T01:46:19.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.267+0000 7f8f4c7b3740 1 --2- 172.21.15.77:0/662375729 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x564d4710e4c0 0x564d471478e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.267+0000 7f8f4c7b3740 1 --2- 172.21.15.77:0/662375729 >> [v2:172.21.15.77:6832/3276812155,v1:172.21.15.77:6834/3276812155] conn(0x564d47143160 0x564d47113ef0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.267+0000 7f8f4c7b3740 1 --2- 172.21.15.77:0/662375729 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564d47109150 0x564d47142c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.267+0000 7f8f227fc640 0 client.8283 ms_handle_reset on v2:172.21.15.77:6832/3276812155 2023-11-04T01:46:19.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.267+0000 7f8f4c7b3740 1 --2- 172.21.15.77:0/662375729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d470e2040 0x564d47192d70 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.267+0000 7f8f4c7b3740 1 -- 172.21.15.77:0/662375729 >> 172.21.15.77:0/662375729 conn(0x564d470de6d0 msgr2=0x564d470e27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:19.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.267+0000 7f8f4c7b3740 1 -- 172.21.15.77:0/662375729 shutdown_connections 2023-11-04T01:46:19.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.267+0000 7f8f4c7b3740 1 -- 172.21.15.77:0/662375729 wait complete. 2023-11-04T01:46:19.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.267+0000 7f8f4c7b3740 20 client.8283 trim_cache size 0 max 16384 2023-11-04T01:46:19.293 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-04T01:46:19.294 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "", 2023-11-04T01:46:19.294 INFO:teuthology.orchestra.run.smithi077.stdout: "return_code": 0 2023-11-04T01:46:19.294 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-04T01:46:19.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.267+0000 7f8f49b4c640 1 -- 172.21.15.77:0/1117642885 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8f3006ae70 msgr2=0x7f8f3006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:19.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.267+0000 7f8f49b4c640 1 --2- 172.21.15.77:0/1117642885 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8f3006ae70 0x7f8f3006d330 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8f34034000 tx=0x7f8f34031000 comp rx=0 tx=0).stop 2023-11-04T01:46:19.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.267+0000 7f8f49b4c640 1 -- 172.21.15.77:0/1117642885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f440c85b0 msgr2=0x7f8f440c6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:19.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.267+0000 7f8f49b4c640 1 --2- 172.21.15.77:0/1117642885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f440c85b0 0x7f8f440c6050 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f8f38011630 tx=0x7f8f38011af0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.268+0000 7f8f49b4c640 1 -- 172.21.15.77:0/1117642885 shutdown_connections 2023-11-04T01:46:19.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.268+0000 7f8f49b4c640 1 --2- 172.21.15.77:0/1117642885 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8f3006ae70 0x7f8f3006d330 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.268+0000 7f8f49b4c640 1 --2- 172.21.15.77:0/1117642885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f440c6590 0x7f8f440c6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.268+0000 7f8f49b4c640 1 --2- 172.21.15.77:0/1117642885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f440c85b0 0x7f8f440c6050 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.268+0000 7f8f49b4c640 1 --2- 172.21.15.77:0/1117642885 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8f2c003b30 0x7f8f440b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.268+0000 7f8f49b4c640 1 -- 172.21.15.77:0/1117642885 >> 172.21.15.77:0/1117642885 conn(0x7f8f440cb530 msgr2=0x7f8f4406bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:19.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.268+0000 7f8f49b4c640 1 -- 172.21.15.77:0/1117642885 shutdown_connections 2023-11-04T01:46:19.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.268+0000 7f8f49b4c640 1 -- 172.21.15.77:0/1117642885 wait complete. 2023-11-04T01:46:19.298 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=5, also kill snapclient 2023-11-04T01:46:19.299 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:19.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.398+0000 7f20a8f61640 1 Processor -- start 2023-11-04T01:46:19.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.398+0000 7f20a8f61640 1 -- start start 2023-11-04T01:46:19.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.399+0000 7f20a8f61640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f20a4159e40 0x7f20a40b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.399+0000 7f20a8f61640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f20a406bb60 0x7f20a40b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.399+0000 7f20a8f61640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a4071500 con 0x7f20a406fff0 2023-11-04T01:46:19.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.399+0000 7f20a8f61640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20a415dae0 con 0x7f20a406bb60 2023-11-04T01:46:19.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.399+0000 7f20a8f61640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20a4070c60 con 0x7f20a4159e40 2023-11-04T01:46:19.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.399+0000 7f209bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f20a406bb60 0x7f20a40b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.399+0000 7f209bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f20a406bb60 0x7f20a40b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53348/0 (socket says 172.21.15.77:53348) 2023-11-04T01:46:19.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.399+0000 7f209bfff640 1 -- 172.21.15.77:0/3743475078 learned_addr learned my addr 172.21.15.77:0/3743475078 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:19.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.399+0000 7f20a259c640 1 --2- 172.21.15.77:0/3743475078 >> v2:172.21.15.122:3300/0 conn(0x7f20a4159e40 0x7f20a40b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.399+0000 7f209bfff640 1 -- 172.21.15.77:0/3743475078 >> v2:172.21.15.122:3300/0 conn(0x7f20a4159e40 msgr2=0x7f20a40b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:19.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.399+0000 7f209bfff640 1 --2- 172.21.15.77:0/3743475078 >> v2:172.21.15.122:3300/0 conn(0x7f20a4159e40 0x7f20a40b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.399+0000 7f209bfff640 1 -- 172.21.15.77:0/3743475078 >> v1:172.21.15.122:6789/0 conn(0x7f20a406fff0 legacy=0x7f20a4070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:19.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.399+0000 7f209bfff640 1 -- 172.21.15.77:0/3743475078 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a4070f40 con 0x7f20a406bb60 2023-11-04T01:46:19.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.400+0000 7f209bfff640 1 --2- 172.21.15.77:0/3743475078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20a406bb60 0x7f20a40b0a70 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f20a40ce7f0 tx=0x7f208c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9325c424dc77de1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:19.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.400+0000 7f20a1d9b640 1 -- 172.21.15.77:0/3743475078 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208c0317e0 con 0x7f20a406bb60 2023-11-04T01:46:19.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.400+0000 7f20a1d9b640 1 -- 172.21.15.77:0/3743475078 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208c031940 con 0x7f20a406bb60 2023-11-04T01:46:19.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.400+0000 7f20a1d9b640 1 -- 172.21.15.77:0/3743475078 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208c031cd0 con 0x7f20a406bb60 2023-11-04T01:46:19.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.401+0000 7f20a8f61640 1 -- 172.21.15.77:0/3743475078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20a406bb60 msgr2=0x7f20a40b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:19.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.401+0000 7f20a8f61640 1 --2- 172.21.15.77:0/3743475078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20a406bb60 0x7f20a40b0a70 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f20a40ce7f0 tx=0x7f208c02b880 comp rx=0 tx=0).stop 2023-11-04T01:46:19.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.401+0000 7f20a8f61640 1 -- 172.21.15.77:0/3743475078 shutdown_connections 2023-11-04T01:46:19.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.401+0000 7f20a8f61640 1 --2- 172.21.15.77:0/3743475078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20a406bb60 0x7f20a40b0a70 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.401+0000 7f20a8f61640 1 --2- 172.21.15.77:0/3743475078 >> v2:172.21.15.122:3300/0 conn(0x7f20a4159e40 0x7f20a40b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.401+0000 7f20a8f61640 1 -- 172.21.15.77:0/3743475078 >> 172.21.15.77:0/3743475078 conn(0x7f20a40cb530 msgr2=0x7f20a40cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:19.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.401+0000 7f20a8f61640 1 -- 172.21.15.77:0/3743475078 shutdown_connections 2023-11-04T01:46:19.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.401+0000 7f20a8f61640 1 -- 172.21.15.77:0/3743475078 wait complete. 2023-11-04T01:46:19.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.402+0000 7f20a8f61640 1 Processor -- start 2023-11-04T01:46:19.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.402+0000 7f20a8f61640 1 -- start start 2023-11-04T01:46:19.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.403+0000 7f20a8f61640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20a406bb60 0x7f20a40c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.403+0000 7f20a8f61640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20a406fff0 0x7f20a41f2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.403+0000 7f20a8f61640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20a4159e40 0x7f20a40ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.403+0000 7f20a8f61640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a41f2d30 con 0x7f20a406bb60 2023-11-04T01:46:19.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.403+0000 7f20a8f61640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a41f38b0 con 0x7f20a406fff0 2023-11-04T01:46:19.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.403+0000 7f20a8f61640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a41f2f80 con 0x7f20a4159e40 2023-11-04T01:46:19.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.403+0000 7f20a259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20a406bb60 0x7f20a40c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.403+0000 7f20a259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20a406bb60 0x7f20a40c84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53354/0 (socket says 172.21.15.77:53354) 2023-11-04T01:46:19.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.403+0000 7f20a259c640 1 -- 172.21.15.77:0/4144764781 learned_addr learned my addr 172.21.15.77:0/4144764781 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:19.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.403+0000 7f209bfff640 1 --2- 172.21.15.77:0/4144764781 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20a406fff0 0x7f20a41f2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.403+0000 7f20a2d9d640 1 --2- 172.21.15.77:0/4144764781 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20a4159e40 0x7f20a40ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.403+0000 7f20a259c640 1 -- 172.21.15.77:0/4144764781 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20a4159e40 msgr2=0x7f20a40ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:19.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.403+0000 7f20a259c640 1 --2- 172.21.15.77:0/4144764781 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20a4159e40 0x7f20a40ce9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.403+0000 7f20a259c640 1 -- 172.21.15.77:0/4144764781 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20a406fff0 msgr2=0x7f20a41f2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:19.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.403+0000 7f20a259c640 1 --2- 172.21.15.77:0/4144764781 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20a406fff0 0x7f20a41f2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.403+0000 7f20a259c640 1 -- 172.21.15.77:0/4144764781 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f208c0094d0 con 0x7f20a406bb60 2023-11-04T01:46:19.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.403+0000 7f20a2d9d640 1 --2- 172.21.15.77:0/4144764781 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20a4159e40 0x7f20a40ce9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:19.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.403+0000 7f209bfff640 1 --2- 172.21.15.77:0/4144764781 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20a406fff0 0x7f20a41f2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:19.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.404+0000 7f20a259c640 1 --2- 172.21.15.77:0/4144764781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20a406bb60 0x7f20a40c84b0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f209400d5f0 tx=0x7f209400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:19.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.404+0000 7f209affd640 1 -- 172.21.15.77:0/4144764781 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20940125f0 con 0x7f20a406bb60 2023-11-04T01:46:19.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.404+0000 7f209affd640 1 -- 172.21.15.77:0/4144764781 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2094012750 con 0x7f20a406bb60 2023-11-04T01:46:19.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.404+0000 7f20a8f61640 1 -- 172.21.15.77:0/4144764781 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20a41f3260 con 0x7f20a406bb60 2023-11-04T01:46:19.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.404+0000 7f209affd640 1 -- 172.21.15.77:0/4144764781 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2094012b00 con 0x7f20a406bb60 2023-11-04T01:46:19.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.404+0000 7f20a8f61640 1 -- 172.21.15.77:0/4144764781 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a40c89f0 con 0x7f20a406bb60 2023-11-04T01:46:19.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.405+0000 7f20a8f61640 1 -- 172.21.15.77:0/4144764781 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a40684b0 con 0x7f20a406bb60 2023-11-04T01:46:19.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.405+0000 7f209affd640 1 -- 172.21.15.77:0/4144764781 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2094012c60 con 0x7f20a406bb60 2023-11-04T01:46:19.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.406+0000 7f209affd640 1 --2- 172.21.15.77:0/4144764781 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f208406ae70 0x7f208406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.406+0000 7f209affd640 1 -- 172.21.15.77:0/4144764781 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7825+0+0 (secure 0 0 0) 0x7f209408a2b0 con 0x7f20a406bb60 2023-11-04T01:46:19.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.406+0000 7f209bfff640 1 --2- 172.21.15.77:0/4144764781 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f208406ae70 0x7f208406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.406+0000 7f209bfff640 1 --2- 172.21.15.77:0/4144764781 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f208406ae70 0x7f208406d330 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f208c036000 tx=0x7f208c03d040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:19.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.410+0000 7f209affd640 1 -- 172.21.15.77:0/4144764781 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2094054ba0 con 0x7f20a406bb60 2023-11-04T01:46:19.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.609+0000 7f20a8f61640 1 -- 172.21.15.77:0/4144764781 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20a40ad940 con 0x7f20a406bb60 2023-11-04T01:46:19.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.609+0000 7f209affd640 1 -- 172.21.15.77:0/4144764781 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f20940581c0 con 0x7f20a406bb60 2023-11-04T01:46:19.612 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:46:19.612 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":92,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8139,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2107153526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2107153526},{"type":"v1","addr":"172.21.15.77:6835","nonce":2107153526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:46:11.638244+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7977,"mds_1":6814},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6814":{"gid":6814,"name":"b","rank":1,"incarnation":88,"state":"up:active","state_seq":8,"addr":"172.21.15.122:6836/1450731169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1450731169},{"type":"v1","addr":"172.21.15.122:6836","nonce":1450731169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7977":{"gid":7977,"name":"a","rank":0,"incarnation":85,"state":"up:active","state_seq":14,"addr":"172.21.15.77:6834/3276812155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3276812155},{"type":"v1","addr":"172.21.15.77:6834","nonce":3276812155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:19.612 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 92 2023-11-04T01:46:19.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.611+0000 7f20a8f61640 1 -- 172.21.15.77:0/4144764781 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f208406ae70 msgr2=0x7f208406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:19.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.611+0000 7f20a8f61640 1 --2- 172.21.15.77:0/4144764781 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f208406ae70 0x7f208406d330 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f208c036000 tx=0x7f208c03d040 comp rx=0 tx=0).stop 2023-11-04T01:46:19.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.611+0000 7f20a8f61640 1 -- 172.21.15.77:0/4144764781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20a406bb60 msgr2=0x7f20a40c84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:19.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.611+0000 7f20a8f61640 1 --2- 172.21.15.77:0/4144764781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20a406bb60 0x7f20a40c84b0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f209400d5f0 tx=0x7f209400dab0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.611+0000 7f20a8f61640 1 -- 172.21.15.77:0/4144764781 shutdown_connections 2023-11-04T01:46:19.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.611+0000 7f20a8f61640 1 --2- 172.21.15.77:0/4144764781 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f208406ae70 0x7f208406d330 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.611+0000 7f20a8f61640 1 --2- 172.21.15.77:0/4144764781 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20a4159e40 0x7f20a40ce9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.611+0000 7f20a8f61640 1 --2- 172.21.15.77:0/4144764781 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20a406fff0 0x7f20a41f2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.611+0000 7f20a8f61640 1 --2- 172.21.15.77:0/4144764781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20a406bb60 0x7f20a40c84b0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.611+0000 7f20a8f61640 1 -- 172.21.15.77:0/4144764781 >> 172.21.15.77:0/4144764781 conn(0x7f20a40cb530 msgr2=0x7f20a4070420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:19.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.611+0000 7f20a8f61640 1 -- 172.21.15.77:0/4144764781 shutdown_connections 2023-11-04T01:46:19.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.611+0000 7f20a8f61640 1 -- 172.21.15.77:0/4144764781 wait complete. 2023-11-04T01:46:19.624 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump snaps --server 2023-11-04T01:46:19.737 INFO:teuthology.orchestra.run.smithi077.stdout:{"last_snap":10,"last_created":5,"last_destroyed":9,"pending_noop":[],"snaps":[],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:46:19.737 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 9, "last_snap": 10, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [] } 2023-11-04T01:46:19.738 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:46:19.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.838+0000 7f90384ec640 1 Processor -- start 2023-11-04T01:46:19.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.838+0000 7f90384ec640 1 -- start start 2023-11-04T01:46:19.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.839+0000 7f90384ec640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f90300b3ca0 0x7f903006b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.839+0000 7f90384ec640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f903015d4f0 con 0x7f903015d110 2023-11-04T01:46:19.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.839+0000 7f90384ec640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f903006b9f0 con 0x7f90300b2100 2023-11-04T01:46:19.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.839+0000 7f90384ec640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90300664f0 con 0x7f90300b3ca0 2023-11-04T01:46:19.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.839+0000 7f9036288640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f903015d110 0x7f90300ace70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49412/0 (socket says 172.21.15.77:49412) 2023-11-04T01:46:19.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.839+0000 7f9036288640 1 -- 172.21.15.77:0/1142189783 learned_addr learned my addr 172.21.15.77:0/1142189783 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:46:19.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.839+0000 7f9035286640 1 -- 172.21.15.77:0/1142189783 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1746465151 0 0) 0x7f903015d4f0 con 0x7f903015d110 2023-11-04T01:46:19.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.839+0000 7f9035286640 1 -- 172.21.15.77:0/1142189783 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f901c003520 con 0x7f903015d110 2023-11-04T01:46:19.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.839+0000 7f9035a87640 1 --2- 172.21.15.77:0/1142189783 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f90300b3ca0 0x7f903006b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.840+0000 7f9035286640 1 -- 172.21.15.77:0/1142189783 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1621683 0 0) 0x7f901c003520 con 0x7f903015d110 2023-11-04T01:46:19.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.840+0000 7f9035286640 1 -- 172.21.15.77:0/1142189783 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f90300b3ca0 msgr2=0x7f903006b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:19.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.840+0000 7f9035286640 1 --2- 172.21.15.77:0/1142189783 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f90300b3ca0 0x7f903006b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.840+0000 7f9035286640 1 -- 172.21.15.77:0/1142189783 >> v1:172.21.15.122:6789/0 conn(0x7f90300b2100 legacy=0x7f90300b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:19.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.840+0000 7f9035286640 1 -- 172.21.15.77:0/1142189783 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903006c2e0 con 0x7f903015d110 2023-11-04T01:46:19.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.840+0000 7f9035286640 1 -- 172.21.15.77:0/1142189783 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f902c0017f0 con 0x7f903015d110 2023-11-04T01:46:19.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.840+0000 7f9035286640 1 -- 172.21.15.77:0/1142189783 >> v1:172.21.15.77:6789/0 conn(0x7f903015d110 legacy=0x7f90300ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:19.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.840+0000 7f9035286640 1 --2- 172.21.15.77:0/1142189783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f901c0039a0 0x7f901c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.840+0000 7f9035286640 1 --2- 172.21.15.77:0/1142189783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f901c0047c0 0x7f901c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.840+0000 7f9035286640 1 --2- 172.21.15.77:0/1142189783 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f90300b3ca0 0x7f901c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.840+0000 7f9035286640 1 -- 172.21.15.77:0/1142189783 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90300664f0 con 0x7f901c0047c0 2023-11-04T01:46:19.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.840+0000 7f9035286640 1 -- 172.21.15.77:0/1142189783 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901c00ba30 con 0x7f901c0039a0 2023-11-04T01:46:19.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.840+0000 7f9035286640 1 -- 172.21.15.77:0/1142189783 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f901c00bbf0 con 0x7f90300b3ca0 2023-11-04T01:46:19.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.840+0000 7f9035a87640 1 --2- 172.21.15.77:0/1142189783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f901c0047c0 0x7f901c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.840+0000 7f9036288640 1 --2- 172.21.15.77:0/1142189783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f901c0039a0 0x7f901c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.840+0000 7f9036a89640 1 --2- 172.21.15.77:0/1142189783 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f90300b3ca0 0x7f901c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.840+0000 7f9035a87640 1 -- 172.21.15.77:0/1142189783 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f90300b3ca0 msgr2=0x7f901c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:19.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.840+0000 7f9035a87640 1 --2- 172.21.15.77:0/1142189783 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f90300b3ca0 0x7f901c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.840+0000 7f9035a87640 1 -- 172.21.15.77:0/1142189783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f901c0039a0 msgr2=0x7f901c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:19.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.840+0000 7f9035a87640 1 --2- 172.21.15.77:0/1142189783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f901c0039a0 0x7f901c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.840+0000 7f9035a87640 1 -- 172.21.15.77:0/1142189783 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f901c003520 con 0x7f901c0047c0 2023-11-04T01:46:19.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.840+0000 7f9036288640 1 --2- 172.21.15.77:0/1142189783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f901c0039a0 0x7f901c003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:19.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.841+0000 7f9035a87640 1 --2- 172.21.15.77:0/1142189783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f901c0047c0 0x7f901c004c40 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f9020009a90 tx=0x7f901c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feb7c5edab6bd836 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:19.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.841+0000 7f9035286640 1 -- 172.21.15.77:0/1142189783 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902002c680 con 0x7f901c0047c0 2023-11-04T01:46:19.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.841+0000 7f9035286640 1 -- 172.21.15.77:0/1142189783 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902002c7e0 con 0x7f901c0047c0 2023-11-04T01:46:19.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.841+0000 7f9035286640 1 -- 172.21.15.77:0/1142189783 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902002cb70 con 0x7f901c0047c0 2023-11-04T01:46:19.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.842+0000 7f90384ec640 1 -- 172.21.15.77:0/1142189783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f901c0047c0 msgr2=0x7f901c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:19.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.842+0000 7f90384ec640 1 --2- 172.21.15.77:0/1142189783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f901c0047c0 0x7f901c004c40 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f9020009a90 tx=0x7f901c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.842+0000 7f9036a89640 1 -- 172.21.15.77:0/1142189783 reap_dead start 2023-11-04T01:46:19.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.842+0000 7f90384ec640 1 -- 172.21.15.77:0/1142189783 shutdown_connections 2023-11-04T01:46:19.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.842+0000 7f90384ec640 1 -- 172.21.15.77:0/1142189783 >> 172.21.15.77:0/1142189783 conn(0x7f90300cbd30 msgr2=0x7f90300cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:19.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.842+0000 7f90384ec640 1 -- 172.21.15.77:0/1142189783 shutdown_connections 2023-11-04T01:46:19.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.842+0000 7f90384ec640 1 -- 172.21.15.77:0/1142189783 wait complete. 2023-11-04T01:46:19.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.843+0000 7f90384ec640 1 Processor -- start 2023-11-04T01:46:19.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.843+0000 7f90384ec640 1 -- start start 2023-11-04T01:46:19.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.843+0000 7f90384ec640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f901c0047c0 0x7f90301f1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.843+0000 7f90384ec640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f903009c0d0 0x7f903009c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.843+0000 7f90384ec640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f903009a260 0x7f903009a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.843+0000 7f90384ec640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903009ac50 con 0x7f901c0047c0 2023-11-04T01:46:19.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.844+0000 7f90384ec640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9030071080 con 0x7f903009c0d0 2023-11-04T01:46:19.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.844+0000 7f90384ec640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9030071360 con 0x7f903009a260 2023-11-04T01:46:19.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.844+0000 7f9036288640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f901c0047c0 0x7f90301f1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.844+0000 7f9036288640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f901c0047c0 0x7f90301f1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53364/0 (socket says 172.21.15.77:53364) 2023-11-04T01:46:19.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.844+0000 7f9036288640 1 -- 172.21.15.77:0/3068486640 learned_addr learned my addr 172.21.15.77:0/3068486640 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:19.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.844+0000 7f9035a87640 1 --2- 172.21.15.77:0/3068486640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f903009c0d0 0x7f903009c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.844+0000 7f9036a89640 1 --2- 172.21.15.77:0/3068486640 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f903009a260 0x7f903009a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.844+0000 7f9036288640 1 -- 172.21.15.77:0/3068486640 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f903009a260 msgr2=0x7f903009a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:19.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.844+0000 7f9036288640 1 --2- 172.21.15.77:0/3068486640 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f903009a260 0x7f903009a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.844+0000 7f9036288640 1 -- 172.21.15.77:0/3068486640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f903009c0d0 msgr2=0x7f903009c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:19.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.844+0000 7f9036288640 1 --2- 172.21.15.77:0/3068486640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f903009c0d0 0x7f903009c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:19.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.844+0000 7f9036288640 1 -- 172.21.15.77:0/3068486640 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9030071640 con 0x7f901c0047c0 2023-11-04T01:46:19.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.844+0000 7f9036288640 1 --2- 172.21.15.77:0/3068486640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f901c0047c0 0x7f90301f1fe0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f902c001380 tx=0x7f902c00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:19.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.844+0000 7f9026ffd640 1 -- 172.21.15.77:0/3068486640 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c00ee60 con 0x7f901c0047c0 2023-11-04T01:46:19.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.844+0000 7f9026ffd640 1 -- 172.21.15.77:0/3068486640 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902c0072e0 con 0x7f901c0047c0 2023-11-04T01:46:19.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.844+0000 7f90384ec640 1 -- 172.21.15.77:0/3068486640 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9030071920 con 0x7f901c0047c0 2023-11-04T01:46:19.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.844+0000 7f9026ffd640 1 -- 172.21.15.77:0/3068486640 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c0057a0 con 0x7f901c0047c0 2023-11-04T01:46:19.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.844+0000 7f90384ec640 1 -- 172.21.15.77:0/3068486640 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9030070d50 con 0x7f901c0047c0 2023-11-04T01:46:19.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.845+0000 7f90384ec640 1 -- 172.21.15.77:0/3068486640 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90300684b0 con 0x7f901c0047c0 2023-11-04T01:46:19.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.846+0000 7f9026ffd640 1 -- 172.21.15.77:0/3068486640 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f902c005900 con 0x7f901c0047c0 2023-11-04T01:46:19.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.846+0000 7f9026ffd640 1 --2- 172.21.15.77:0/3068486640 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f901406aea0 0x7f901406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:19.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.846+0000 7f9026ffd640 1 -- 172.21.15.77:0/3068486640 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7825+0+0 (secure 0 0 0) 0x7f902c089e30 con 0x7f901c0047c0 2023-11-04T01:46:19.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.846+0000 7f9035a87640 1 --2- 172.21.15.77:0/3068486640 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f901406aea0 0x7f901406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:19.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.847+0000 7f9035a87640 1 --2- 172.21.15.77:0/3068486640 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f901406aea0 0x7f901406d360 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f9020036000 tx=0x7f9020030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:19.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:19.850+0000 7f9026ffd640 1 -- 172.21.15.77:0/3068486640 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f902c054690 con 0x7f901c0047c0 2023-11-04T01:46:20.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.086+0000 7f90384ec640 1 -- 172.21.15.77:0/3068486640 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7f903006b690 con 0x7f901c0047c0 2023-11-04T01:46:20.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.673+0000 7f9026ffd640 1 -- 172.21.15.77:0/3068486640 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.7977 v93) v1 ==== 112+0+0 (secure 0 0 0) 0x7f902c057cb0 con 0x7f901c0047c0 2023-11-04T01:46:20.675 INFO:teuthology.orchestra.run.smithi077.stderr:freezing mds.7977 2023-11-04T01:46:20.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.676+0000 7f90384ec640 1 -- 172.21.15.77:0/3068486640 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f901406aea0 msgr2=0x7f901406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:20.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.676+0000 7f90384ec640 1 --2- 172.21.15.77:0/3068486640 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f901406aea0 0x7f901406d360 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f9020036000 tx=0x7f9020030000 comp rx=0 tx=0).stop 2023-11-04T01:46:20.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.676+0000 7f90384ec640 1 -- 172.21.15.77:0/3068486640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f901c0047c0 msgr2=0x7f90301f1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:20.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.676+0000 7f90384ec640 1 --2- 172.21.15.77:0/3068486640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f901c0047c0 0x7f90301f1fe0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f902c001380 tx=0x7f902c00ec10 comp rx=0 tx=0).stop 2023-11-04T01:46:20.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.676+0000 7f90384ec640 1 -- 172.21.15.77:0/3068486640 shutdown_connections 2023-11-04T01:46:20.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.676+0000 7f90384ec640 1 --2- 172.21.15.77:0/3068486640 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f901406aea0 0x7f901406d360 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:20.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.676+0000 7f90384ec640 1 --2- 172.21.15.77:0/3068486640 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f903009a260 0x7f903009a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:20.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.676+0000 7f90384ec640 1 --2- 172.21.15.77:0/3068486640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f903009c0d0 0x7f903009c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:20.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.676+0000 7f90384ec640 1 --2- 172.21.15.77:0/3068486640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f901c0047c0 0x7f90301f1fe0 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:20.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.676+0000 7f90384ec640 1 -- 172.21.15.77:0/3068486640 >> 172.21.15.77:0/3068486640 conn(0x7f90300cbd30 msgr2=0x7f90300abf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:20.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.676+0000 7f90384ec640 1 -- 172.21.15.77:0/3068486640 shutdown_connections 2023-11-04T01:46:20.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.676+0000 7f90384ec640 1 -- 172.21.15.77:0/3068486640 wait complete. 2023-11-04T01:46:20.689 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:1 true 2023-11-04T01:46:20.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.794+0000 7fd941000640 1 Processor -- start 2023-11-04T01:46:20.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.794+0000 7fd941000640 1 -- start start 2023-11-04T01:46:20.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.795+0000 7fd941000640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd93c0ccf50 0x7fd93c06a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:20.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.795+0000 7fd941000640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd93c06aca0 con 0x7fd93c158880 2023-11-04T01:46:20.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.795+0000 7fd941000640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd93c0cd3e0 con 0x7fd93c06a850 2023-11-04T01:46:20.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.795+0000 7fd941000640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd93c0ce2b0 con 0x7fd93c0ccf50 2023-11-04T01:46:20.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.795+0000 7fd93a59c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd93c158880 0x7fd93c15be00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49424/0 (socket says 172.21.15.77:49424) 2023-11-04T01:46:20.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.795+0000 7fd93a59c640 1 -- 172.21.15.77:0/2819136072 learned_addr learned my addr 172.21.15.77:0/2819136072 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:46:20.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.795+0000 7fd93959a640 1 -- 172.21.15.77:0/2819136072 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1748972880 0 0) 0x7fd92c001110 con 0x7fd93c158880 2023-11-04T01:46:20.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.795+0000 7fd93959a640 1 -- 172.21.15.77:0/2819136072 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd924003520 con 0x7fd93c158880 2023-11-04T01:46:20.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.795+0000 7fd939d9b640 1 --2- 172.21.15.77:0/2819136072 >> v2:172.21.15.122:3300/0 conn(0x7fd93c0ccf50 0x7fd93c06a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:20.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.795+0000 7fd93959a640 1 -- 172.21.15.77:0/2819136072 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2635797807 0 0) 0x7fd924003520 con 0x7fd93c158880 2023-11-04T01:46:20.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.795+0000 7fd93959a640 1 -- 172.21.15.77:0/2819136072 >> v2:172.21.15.122:3300/0 conn(0x7fd93c0ccf50 msgr2=0x7fd93c06a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:20.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.795+0000 7fd93959a640 1 --2- 172.21.15.77:0/2819136072 >> v2:172.21.15.122:3300/0 conn(0x7fd93c0ccf50 0x7fd93c06a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:20.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.795+0000 7fd93959a640 1 -- 172.21.15.77:0/2819136072 >> v1:172.21.15.122:6789/0 conn(0x7fd93c06a850 legacy=0x7fd93c0b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:20.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.795+0000 7fd93959a640 1 -- 172.21.15.77:0/2819136072 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd93c0cd630 con 0x7fd93c158880 2023-11-04T01:46:20.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.795+0000 7fd93959a640 1 -- 172.21.15.77:0/2819136072 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7fd92c001800 con 0x7fd93c158880 2023-11-04T01:46:20.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.795+0000 7fd93959a640 1 -- 172.21.15.77:0/2819136072 >> v1:172.21.15.77:6789/0 conn(0x7fd93c158880 legacy=0x7fd93c15be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:20.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.795+0000 7fd93959a640 1 --2- 172.21.15.77:0/2819136072 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd924003970 0x7fd924003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:20.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.795+0000 7fd93959a640 1 --2- 172.21.15.77:0/2819136072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9240047c0 0x7fd924004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:20.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.795+0000 7fd93959a640 1 --2- 172.21.15.77:0/2819136072 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9240052a0 0x7fd92400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:20.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.795+0000 7fd93959a640 1 -- 172.21.15.77:0/2819136072 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c0ce2b0 con 0x7fd9240052a0 2023-11-04T01:46:20.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.795+0000 7fd93959a640 1 -- 172.21.15.77:0/2819136072 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92400c170 con 0x7fd9240047c0 2023-11-04T01:46:20.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.795+0000 7fd93959a640 1 -- 172.21.15.77:0/2819136072 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd92400c330 con 0x7fd924003970 2023-11-04T01:46:20.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.795+0000 7fd93ad9d640 1 --2- 172.21.15.77:0/2819136072 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9240052a0 0x7fd92400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:20.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.796+0000 7fd93a59c640 1 --2- 172.21.15.77:0/2819136072 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd924003970 0x7fd924003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:20.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.796+0000 7fd939d9b640 1 --2- 172.21.15.77:0/2819136072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9240047c0 0x7fd924004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:20.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.796+0000 7fd93ad9d640 1 -- 172.21.15.77:0/2819136072 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd924003970 msgr2=0x7fd924003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:20.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.796+0000 7fd93ad9d640 1 --2- 172.21.15.77:0/2819136072 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd924003970 0x7fd924003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:20.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.796+0000 7fd93ad9d640 1 -- 172.21.15.77:0/2819136072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9240047c0 msgr2=0x7fd924004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:20.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.796+0000 7fd93ad9d640 1 --2- 172.21.15.77:0/2819136072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9240047c0 0x7fd924004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:20.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.796+0000 7fd93ad9d640 1 -- 172.21.15.77:0/2819136072 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd924003520 con 0x7fd9240052a0 2023-11-04T01:46:20.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.796+0000 7fd93ad9d640 1 -- 172.21.15.77:0/2819136072 reap_dead start 2023-11-04T01:46:20.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.796+0000 7fd93ad9d640 1 --2- 172.21.15.77:0/2819136072 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9240052a0 0x7fd92400b980 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fd934001e20 tx=0x7fd9240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e8c453efbfc9861 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:20.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.797+0000 7fd93959a640 1 -- 172.21.15.77:0/2819136072 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd934003b70 con 0x7fd9240052a0 2023-11-04T01:46:20.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.797+0000 7fd93959a640 1 -- 172.21.15.77:0/2819136072 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd934003cd0 con 0x7fd9240052a0 2023-11-04T01:46:20.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.797+0000 7fd93959a640 1 -- 172.21.15.77:0/2819136072 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd934005310 con 0x7fd9240052a0 2023-11-04T01:46:20.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.797+0000 7fd941000640 1 -- 172.21.15.77:0/2819136072 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9240052a0 msgr2=0x7fd92400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:20.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.797+0000 7fd941000640 1 --2- 172.21.15.77:0/2819136072 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9240052a0 0x7fd92400b980 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fd934001e20 tx=0x7fd9240057f0 comp rx=0 tx=0).stop 2023-11-04T01:46:20.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.797+0000 7fd941000640 1 -- 172.21.15.77:0/2819136072 shutdown_connections 2023-11-04T01:46:20.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.797+0000 7fd941000640 1 --2- 172.21.15.77:0/2819136072 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9240052a0 0x7fd92400b980 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:20.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.797+0000 7fd941000640 1 -- 172.21.15.77:0/2819136072 >> 172.21.15.77:0/2819136072 conn(0x7fd93c0b0870 msgr2=0x7fd93c0b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:20.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.797+0000 7fd941000640 1 -- 172.21.15.77:0/2819136072 shutdown_connections 2023-11-04T01:46:20.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.797+0000 7fd941000640 1 -- 172.21.15.77:0/2819136072 wait complete. 2023-11-04T01:46:20.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.798+0000 7fd941000640 1 Processor -- start 2023-11-04T01:46:20.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.799+0000 7fd941000640 1 -- start start 2023-11-04T01:46:20.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.799+0000 7fd941000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9240052a0 0x7fd93c15c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:20.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.799+0000 7fd941000640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd93c1f4a80 0x7fd93c1f0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:20.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.799+0000 7fd941000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd93c157190 0x7fd93c143b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:20.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.799+0000 7fd941000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c1ee410 con 0x7fd9240052a0 2023-11-04T01:46:20.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.799+0000 7fd941000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c1f1220 con 0x7fd93c157190 2023-11-04T01:46:20.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.799+0000 7fd941000640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c1f1500 con 0x7fd93c1f4a80 2023-11-04T01:46:20.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.799+0000 7fd93a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9240052a0 0x7fd93c15c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:20.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.799+0000 7fd93a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9240052a0 0x7fd93c15c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53370/0 (socket says 172.21.15.77:53370) 2023-11-04T01:46:20.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.799+0000 7fd93a59c640 1 -- 172.21.15.77:0/3042395664 learned_addr learned my addr 172.21.15.77:0/3042395664 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:20.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.799+0000 7fd93ad9d640 1 --2- 172.21.15.77:0/3042395664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd93c157190 0x7fd93c143b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:20.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.800+0000 7fd939d9b640 1 --2- 172.21.15.77:0/3042395664 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd93c1f4a80 0x7fd93c1f0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:20.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.800+0000 7fd93a59c640 1 -- 172.21.15.77:0/3042395664 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd93c1f4a80 msgr2=0x7fd93c1f0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:20.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.800+0000 7fd93a59c640 1 --2- 172.21.15.77:0/3042395664 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd93c1f4a80 0x7fd93c1f0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:20.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.800+0000 7fd93a59c640 1 -- 172.21.15.77:0/3042395664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd93c157190 msgr2=0x7fd93c143b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:20.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.800+0000 7fd93a59c640 1 --2- 172.21.15.77:0/3042395664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd93c157190 0x7fd93c143b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:20.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.800+0000 7fd93a59c640 1 -- 172.21.15.77:0/3042395664 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd93c1f17e0 con 0x7fd9240052a0 2023-11-04T01:46:20.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.800+0000 7fd939d9b640 1 --2- 172.21.15.77:0/3042395664 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd93c1f4a80 0x7fd93c1f0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:20.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.800+0000 7fd93a59c640 1 --2- 172.21.15.77:0/3042395664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9240052a0 0x7fd93c15c8a0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fd92c007340 tx=0x7fd92c007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:20.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.800+0000 7fd92affd640 1 -- 172.21.15.77:0/3042395664 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92c00f8c0 con 0x7fd9240052a0 2023-11-04T01:46:20.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.800+0000 7fd92affd640 1 -- 172.21.15.77:0/3042395664 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd92c00fa40 con 0x7fd9240052a0 2023-11-04T01:46:20.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.800+0000 7fd92affd640 1 -- 172.21.15.77:0/3042395664 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92c00fdf0 con 0x7fd9240052a0 2023-11-04T01:46:20.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.800+0000 7fd941000640 1 -- 172.21.15.77:0/3042395664 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd93c144b00 con 0x7fd9240052a0 2023-11-04T01:46:20.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.800+0000 7fd941000640 1 -- 172.21.15.77:0/3042395664 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd93c15cde0 con 0x7fd9240052a0 2023-11-04T01:46:20.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.801+0000 7fd941000640 1 -- 172.21.15.77:0/3042395664 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd93c145020 con 0x7fd9240052a0 2023-11-04T01:46:20.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.801+0000 7fd92affd640 1 -- 172.21.15.77:0/3042395664 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd92c01d460 con 0x7fd9240052a0 2023-11-04T01:46:20.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.802+0000 7fd92affd640 1 --2- 172.21.15.77:0/3042395664 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd91c06ae70 0x7fd91c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:20.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.802+0000 7fd92affd640 1 -- 172.21.15.77:0/3042395664 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7825+0+0 (secure 0 0 0) 0x7fd92c089f40 con 0x7fd9240052a0 2023-11-04T01:46:20.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.802+0000 7fd939d9b640 1 --2- 172.21.15.77:0/3042395664 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd91c06ae70 0x7fd91c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:20.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.802+0000 7fd939d9b640 1 --2- 172.21.15.77:0/3042395664 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd91c06ae70 0x7fd91c06d330 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fd93c157fa0 tx=0x7fd930008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:20.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:20.806+0000 7fd92affd640 1 -- 172.21.15.77:0/3042395664 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd93c145020 con 0x7fd9240052a0 2023-11-04T01:46:21.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:21.037+0000 7fd941000640 1 -- 172.21.15.77:0/3042395664 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"} v 0) v1 -- 0x7fd93c06aca0 con 0x7fd9240052a0 2023-11-04T01:46:21.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:21.681+0000 7fd92affd640 1 -- 172.21.15.77:0/3042395664 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"}]=0 freezing mds.6814 v94) v1 ==== 112+0+0 (secure 0 0 0) 0x7fd93c06aca0 con 0x7fd9240052a0 2023-11-04T01:46:21.683 INFO:teuthology.orchestra.run.smithi077.stderr:freezing mds.6814 2023-11-04T01:46:21.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:21.684+0000 7fd941000640 1 -- 172.21.15.77:0/3042395664 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd91c06ae70 msgr2=0x7fd91c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:21.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:21.684+0000 7fd941000640 1 --2- 172.21.15.77:0/3042395664 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd91c06ae70 0x7fd91c06d330 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fd93c157fa0 tx=0x7fd930008040 comp rx=0 tx=0).stop 2023-11-04T01:46:21.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:21.684+0000 7fd941000640 1 -- 172.21.15.77:0/3042395664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9240052a0 msgr2=0x7fd93c15c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:21.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:21.684+0000 7fd941000640 1 --2- 172.21.15.77:0/3042395664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9240052a0 0x7fd93c15c8a0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fd92c007340 tx=0x7fd92c007800 comp rx=0 tx=0).stop 2023-11-04T01:46:21.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:21.684+0000 7fd941000640 1 -- 172.21.15.77:0/3042395664 shutdown_connections 2023-11-04T01:46:21.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:21.684+0000 7fd941000640 1 --2- 172.21.15.77:0/3042395664 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd91c06ae70 0x7fd91c06d330 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:21.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:21.684+0000 7fd941000640 1 --2- 172.21.15.77:0/3042395664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd93c157190 0x7fd93c143b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:21.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:21.684+0000 7fd941000640 1 --2- 172.21.15.77:0/3042395664 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd93c1f4a80 0x7fd93c1f0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:21.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:21.684+0000 7fd941000640 1 --2- 172.21.15.77:0/3042395664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9240052a0 0x7fd93c15c8a0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:21.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:21.684+0000 7fd941000640 1 -- 172.21.15.77:0/3042395664 >> 172.21.15.77:0/3042395664 conn(0x7fd93c0b0870 msgr2=0x7fd93c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:21.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:21.684+0000 7fd941000640 1 -- 172.21.15.77:0/3042395664 shutdown_connections 2023-11-04T01:46:21.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:21.684+0000 7fd941000640 1 -- 172.21.15.77:0/3042395664 wait complete. 2023-11-04T01:46:21.699 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_kill_mdstable_at 5 2023-11-04T01:46:21.816 INFO:teuthology.orchestra.run.smithi077.stdout:{"success":"mds_kill_mdstable_at = '5' (not observed, change may require restart) "} 2023-11-04T01:46:21.816 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '5' (not observed, change may require restart) " } 2023-11-04T01:46:21.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:46:21.817 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s25) 2023-11-04T01:46:21.820 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:46:21.842 INFO:tasks.ceph.mds.a.smithi077.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f757dee1640 time 2023-11-04T01:46:21.841853+0000 2023-11-04T01:46:21.842 INFO:tasks.ceph.mds.a.smithi077.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:46:21.843 INFO:tasks.ceph.mds.a.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:21.844 INFO:tasks.ceph.mds.a.smithi077.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f758396efaf] 2023-11-04T01:46:21.844 INFO:tasks.ceph.mds.a.smithi077.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f758396f16d] 2023-11-04T01:46:21.844 INFO:tasks.ceph.mds.a.smithi077.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x5587fa29a187] 2023-11-04T01:46:21.844 INFO:tasks.ceph.mds.a.smithi077.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x5587fa0290a9] 2023-11-04T01:46:21.844 INFO:tasks.ceph.mds.a.smithi077.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x5587fa02bb2b] 2023-11-04T01:46:21.845 INFO:tasks.ceph.mds.a.smithi077.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5587fa02c01c] 2023-11-04T01:46:21.845 INFO:tasks.ceph.mds.a.smithi077.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x5587fa015325] 2023-11-04T01:46:21.845 INFO:tasks.ceph.mds.a.smithi077.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f7583b5ff9a] 2023-11-04T01:46:21.845 INFO:tasks.ceph.mds.a.smithi077.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f7583bf1741] 2023-11-04T01:46:21.845 INFO:tasks.ceph.mds.a.smithi077.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f758309f802] 2023-11-04T01:46:21.846 INFO:tasks.ceph.mds.a.smithi077.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f758303f450] 2023-11-04T01:46:21.846 INFO:tasks.ceph.mds.a.smithi077.stderr:2023-11-04T01:46:21.841+0000 7f757dee1640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f757dee1640 time 2023-11-04T01:46:21.841853+0000 2023-11-04T01:46:21.846 INFO:tasks.ceph.mds.a.smithi077.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:46:21.846 INFO:tasks.ceph.mds.a.smithi077.stderr: 2023-11-04T01:46:21.846 INFO:tasks.ceph.mds.a.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:21.847 INFO:tasks.ceph.mds.a.smithi077.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f758396efaf] 2023-11-04T01:46:21.847 INFO:tasks.ceph.mds.a.smithi077.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f758396f16d] 2023-11-04T01:46:21.847 INFO:tasks.ceph.mds.a.smithi077.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x5587fa29a187] 2023-11-04T01:46:21.847 INFO:tasks.ceph.mds.a.smithi077.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x5587fa0290a9] 2023-11-04T01:46:21.847 INFO:tasks.ceph.mds.a.smithi077.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x5587fa02bb2b] 2023-11-04T01:46:21.848 INFO:tasks.ceph.mds.a.smithi077.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5587fa02c01c] 2023-11-04T01:46:21.848 INFO:tasks.ceph.mds.a.smithi077.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x5587fa015325] 2023-11-04T01:46:21.848 INFO:tasks.ceph.mds.a.smithi077.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f7583b5ff9a] 2023-11-04T01:46:21.848 INFO:tasks.ceph.mds.a.smithi077.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f7583bf1741] 2023-11-04T01:46:21.848 INFO:tasks.ceph.mds.a.smithi077.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f758309f802] 2023-11-04T01:46:21.849 INFO:tasks.ceph.mds.a.smithi077.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f758303f450] 2023-11-04T01:46:21.849 INFO:tasks.ceph.mds.a.smithi077.stderr: 2023-11-04T01:46:21.849 INFO:tasks.ceph.mds.a.smithi077.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:46:21.849 INFO:tasks.ceph.mds.a.smithi077.stderr: in thread 7f757dee1640 thread_name:ms_dispatch 2023-11-04T01:46:21.851 INFO:tasks.ceph.mds.a.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:21.851 INFO:tasks.ceph.mds.a.smithi077.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f7583054db0] 2023-11-04T01:46:21.851 INFO:tasks.ceph.mds.a.smithi077.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f75830a154c] 2023-11-04T01:46:21.851 INFO:tasks.ceph.mds.a.smithi077.stderr: 3: raise() 2023-11-04T01:46:21.854 INFO:tasks.ceph.mds.a.smithi077.stderr: 4: abort() 2023-11-04T01:46:21.854 INFO:tasks.ceph.mds.a.smithi077.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f758396f009] 2023-11-04T01:46:21.854 INFO:tasks.ceph.mds.a.smithi077.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f758396f16d] 2023-11-04T01:46:21.855 INFO:tasks.ceph.mds.a.smithi077.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x5587fa29a187] 2023-11-04T01:46:21.855 INFO:tasks.ceph.mds.a.smithi077.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x5587fa0290a9] 2023-11-04T01:46:21.855 INFO:tasks.ceph.mds.a.smithi077.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x5587fa02bb2b] 2023-11-04T01:46:21.855 INFO:tasks.ceph.mds.a.smithi077.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5587fa02c01c] 2023-11-04T01:46:21.855 INFO:tasks.ceph.mds.a.smithi077.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x5587fa015325] 2023-11-04T01:46:21.855 INFO:tasks.ceph.mds.a.smithi077.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f7583b5ff9a] 2023-11-04T01:46:21.856 INFO:tasks.ceph.mds.a.smithi077.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f7583bf1741] 2023-11-04T01:46:21.856 INFO:tasks.ceph.mds.a.smithi077.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f758309f802] 2023-11-04T01:46:21.856 INFO:tasks.ceph.mds.a.smithi077.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f758303f450] 2023-11-04T01:46:21.856 INFO:tasks.ceph.mds.a.smithi077.stderr:2023-11-04T01:46:21.842+0000 7f757dee1640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:46:21.856 INFO:tasks.ceph.mds.a.smithi077.stderr: in thread 7f757dee1640 thread_name:ms_dispatch 2023-11-04T01:46:21.856 INFO:tasks.ceph.mds.a.smithi077.stderr: 2023-11-04T01:46:21.857 INFO:tasks.ceph.mds.a.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:21.857 INFO:tasks.ceph.mds.a.smithi077.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f7583054db0] 2023-11-04T01:46:21.857 INFO:tasks.ceph.mds.a.smithi077.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f75830a154c] 2023-11-04T01:46:21.857 INFO:tasks.ceph.mds.a.smithi077.stderr: 3: raise() 2023-11-04T01:46:21.857 INFO:tasks.ceph.mds.a.smithi077.stderr: 4: abort() 2023-11-04T01:46:21.858 INFO:tasks.ceph.mds.a.smithi077.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f758396f009] 2023-11-04T01:46:21.858 INFO:tasks.ceph.mds.a.smithi077.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f758396f16d] 2023-11-04T01:46:21.858 INFO:tasks.ceph.mds.a.smithi077.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x5587fa29a187] 2023-11-04T01:46:21.858 INFO:tasks.ceph.mds.a.smithi077.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x5587fa0290a9] 2023-11-04T01:46:21.858 INFO:tasks.ceph.mds.a.smithi077.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x5587fa02bb2b] 2023-11-04T01:46:21.859 INFO:tasks.ceph.mds.a.smithi077.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5587fa02c01c] 2023-11-04T01:46:21.859 INFO:tasks.ceph.mds.a.smithi077.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x5587fa015325] 2023-11-04T01:46:21.859 INFO:tasks.ceph.mds.a.smithi077.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f7583b5ff9a] 2023-11-04T01:46:21.859 INFO:tasks.ceph.mds.a.smithi077.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f7583bf1741] 2023-11-04T01:46:21.859 INFO:tasks.ceph.mds.a.smithi077.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f758309f802] 2023-11-04T01:46:21.859 INFO:tasks.ceph.mds.a.smithi077.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f758303f450] 2023-11-04T01:46:21.860 INFO:tasks.ceph.mds.a.smithi077.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:46:21.860 INFO:tasks.ceph.mds.a.smithi077.stderr: 2023-11-04T01:46:21.860 INFO:tasks.ceph.mds.a.smithi077.stderr: -1123> 2023-11-04T01:46:13.196+0000 7f757b6dc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:46:21.860 INFO:tasks.ceph.mds.a.smithi077.stderr: -1121> 2023-11-04T01:46:13.196+0000 7f757b6dc640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:46:21.860 INFO:tasks.ceph.mds.a.smithi077.stderr: -1> 2023-11-04T01:46:21.841+0000 7f757dee1640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f757dee1640 time 2023-11-04T01:46:21.841853+0000 2023-11-04T01:46:21.861 INFO:tasks.ceph.mds.a.smithi077.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:46:21.861 INFO:tasks.ceph.mds.a.smithi077.stderr: 2023-11-04T01:46:21.861 INFO:tasks.ceph.mds.a.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:21.861 INFO:tasks.ceph.mds.a.smithi077.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f758396efaf] 2023-11-04T01:46:21.861 INFO:tasks.ceph.mds.a.smithi077.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f758396f16d] 2023-11-04T01:46:21.861 INFO:tasks.ceph.mds.a.smithi077.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x5587fa29a187] 2023-11-04T01:46:21.862 INFO:tasks.ceph.mds.a.smithi077.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x5587fa0290a9] 2023-11-04T01:46:21.862 INFO:tasks.ceph.mds.a.smithi077.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x5587fa02bb2b] 2023-11-04T01:46:21.862 INFO:tasks.ceph.mds.a.smithi077.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5587fa02c01c] 2023-11-04T01:46:21.862 INFO:tasks.ceph.mds.a.smithi077.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x5587fa015325] 2023-11-04T01:46:21.862 INFO:tasks.ceph.mds.a.smithi077.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f7583b5ff9a] 2023-11-04T01:46:21.863 INFO:tasks.ceph.mds.a.smithi077.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f7583bf1741] 2023-11-04T01:46:21.863 INFO:tasks.ceph.mds.a.smithi077.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f758309f802] 2023-11-04T01:46:21.863 INFO:tasks.ceph.mds.a.smithi077.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f758303f450] 2023-11-04T01:46:21.863 INFO:tasks.ceph.mds.a.smithi077.stderr: 2023-11-04T01:46:21.863 INFO:tasks.ceph.mds.a.smithi077.stderr: 0> 2023-11-04T01:46:21.842+0000 7f757dee1640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:46:21.863 INFO:tasks.ceph.mds.a.smithi077.stderr: in thread 7f757dee1640 thread_name:ms_dispatch 2023-11-04T01:46:21.864 INFO:tasks.ceph.mds.a.smithi077.stderr: 2023-11-04T01:46:21.864 INFO:tasks.ceph.mds.a.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:21.864 INFO:tasks.ceph.mds.a.smithi077.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f7583054db0] 2023-11-04T01:46:21.864 INFO:tasks.ceph.mds.a.smithi077.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f75830a154c] 2023-11-04T01:46:21.864 INFO:tasks.ceph.mds.a.smithi077.stderr: 3: raise() 2023-11-04T01:46:21.865 INFO:tasks.ceph.mds.a.smithi077.stderr: 4: abort() 2023-11-04T01:46:21.865 INFO:tasks.ceph.mds.a.smithi077.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f758396f009] 2023-11-04T01:46:21.865 INFO:tasks.ceph.mds.a.smithi077.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f758396f16d] 2023-11-04T01:46:21.865 INFO:tasks.ceph.mds.a.smithi077.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x5587fa29a187] 2023-11-04T01:46:21.865 INFO:tasks.ceph.mds.a.smithi077.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x5587fa0290a9] 2023-11-04T01:46:21.865 INFO:tasks.ceph.mds.a.smithi077.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x5587fa02bb2b] 2023-11-04T01:46:21.866 INFO:tasks.ceph.mds.a.smithi077.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5587fa02c01c] 2023-11-04T01:46:21.866 INFO:tasks.ceph.mds.a.smithi077.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x5587fa015325] 2023-11-04T01:46:21.866 INFO:tasks.ceph.mds.a.smithi077.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f7583b5ff9a] 2023-11-04T01:46:21.866 INFO:tasks.ceph.mds.a.smithi077.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f7583bf1741] 2023-11-04T01:46:21.866 INFO:tasks.ceph.mds.a.smithi077.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f758309f802] 2023-11-04T01:46:21.867 INFO:tasks.ceph.mds.a.smithi077.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f758303f450] 2023-11-04T01:46:21.867 INFO:tasks.ceph.mds.a.smithi077.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:46:21.867 INFO:tasks.ceph.mds.a.smithi077.stderr: 2023-11-04T01:46:21.867 INFO:tasks.ceph.mds.a.smithi077.stderr: -1123> 2023-11-04T01:46:13.196+0000 7f757b6dc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:46:21.868 INFO:tasks.ceph.mds.a.smithi077.stderr: -1121> 2023-11-04T01:46:13.196+0000 7f757b6dc640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:46:21.868 INFO:tasks.ceph.mds.a.smithi077.stderr: -1> 2023-11-04T01:46:21.841+0000 7f757dee1640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f757dee1640 time 2023-11-04T01:46:21.841853+0000 2023-11-04T01:46:21.868 INFO:tasks.ceph.mds.a.smithi077.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:46:21.868 INFO:tasks.ceph.mds.a.smithi077.stderr: 2023-11-04T01:46:21.869 INFO:tasks.ceph.mds.a.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:21.869 INFO:tasks.ceph.mds.a.smithi077.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f758396efaf] 2023-11-04T01:46:21.869 INFO:tasks.ceph.mds.a.smithi077.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f758396f16d] 2023-11-04T01:46:21.869 INFO:tasks.ceph.mds.a.smithi077.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x5587fa29a187] 2023-11-04T01:46:21.869 INFO:tasks.ceph.mds.a.smithi077.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x5587fa0290a9] 2023-11-04T01:46:21.870 INFO:tasks.ceph.mds.a.smithi077.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x5587fa02bb2b] 2023-11-04T01:46:21.870 INFO:tasks.ceph.mds.a.smithi077.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5587fa02c01c] 2023-11-04T01:46:21.870 INFO:tasks.ceph.mds.a.smithi077.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x5587fa015325] 2023-11-04T01:46:21.870 INFO:tasks.ceph.mds.a.smithi077.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7f7583b5ff9a] 2023-11-04T01:46:21.870 INFO:tasks.ceph.mds.a.smithi077.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f7583bf1741] 2023-11-04T01:46:21.871 INFO:tasks.ceph.mds.a.smithi077.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f758309f802] 2023-11-04T01:46:21.871 INFO:tasks.ceph.mds.a.smithi077.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f758303f450] 2023-11-04T01:46:21.871 INFO:tasks.ceph.mds.a.smithi077.stderr: 2023-11-04T01:46:21.871 INFO:tasks.ceph.mds.a.smithi077.stderr: 0> 2023-11-04T01:46:21.842+0000 7f757dee1640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:46:21.871 INFO:tasks.ceph.mds.a.smithi077.stderr: in thread 7f757dee1640 thread_name:ms_dispatch 2023-11-04T01:46:21.872 INFO:tasks.ceph.mds.a.smithi077.stderr: 2023-11-04T01:46:21.872 INFO:tasks.ceph.mds.a.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:21.872 INFO:tasks.ceph.mds.a.smithi077.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f7583054db0] 2023-11-04T01:46:21.872 INFO:tasks.ceph.mds.a.smithi077.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f75830a154c] 2023-11-04T01:46:21.872 INFO:tasks.ceph.mds.a.smithi077.stderr: 3: raise() 2023-11-04T01:46:21.872 INFO:tasks.ceph.mds.a.smithi077.stderr: 4: abort() 2023-11-04T01:46:21.873 INFO:tasks.ceph.mds.a.smithi077.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f758396f009] 2023-11-04T01:46:21.873 INFO:tasks.ceph.mds.a.smithi077.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7f758396f16d] 2023-11-04T01:46:21.873 INFO:tasks.ceph.mds.a.smithi077.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7e7) [0x5587fa29a187] 2023-11-04T01:46:21.873 INFO:tasks.ceph.mds.a.smithi077.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x5587fa0290a9] 2023-11-04T01:46:21.873 INFO:tasks.ceph.mds.a.smithi077.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x5587fa02bb2b] 2023-11-04T01:46:21.874 INFO:tasks.ceph.mds.a.smithi077.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5587fa02c01c] 2023-11-04T01:46:21.874 INFO:tasks.ceph.mds.a.smithi077.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x5587fa015325] 2023-11-04T01:46:21.874 INFO:tasks.ceph.mds.a.smithi077.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7f7583b5ff9a] 2023-11-04T01:46:21.874 INFO:tasks.ceph.mds.a.smithi077.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7f7583bf1741] 2023-11-04T01:46:21.874 INFO:tasks.ceph.mds.a.smithi077.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7f758309f802] 2023-11-04T01:46:21.875 INFO:tasks.ceph.mds.a.smithi077.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7f758303f450] 2023-11-04T01:46:21.875 INFO:tasks.ceph.mds.a.smithi077.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:46:21.875 INFO:tasks.ceph.mds.a.smithi077.stderr: 2023-11-04T01:46:21.949 INFO:teuthology.orchestra.run.smithi077.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:46:21.949 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:46:21.950 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:22.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.089+0000 7f4c2c924640 1 Processor -- start 2023-11-04T01:46:22.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.089+0000 7f4c2c924640 1 -- start start 2023-11-04T01:46:22.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.089+0000 7f4c2c924640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4c2815b200 0x7f4c280ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.089+0000 7f4c2c924640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4c280afda0 0x7f4c280cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.089+0000 7f4c2c924640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c280cdc40 con 0x7f4c280cd7f0 2023-11-04T01:46:22.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.089+0000 7f4c2c924640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c280cde80 con 0x7f4c2815b200 2023-11-04T01:46:22.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.089+0000 7f4c2c924640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c280cf670 con 0x7f4c280afda0 2023-11-04T01:46:22.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.090+0000 7f4c2659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4c2815b200 0x7f4c280ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:22.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.090+0000 7f4c2659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4c2815b200 0x7f4c280ceb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53386/0 (socket says 172.21.15.77:53386) 2023-11-04T01:46:22.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.090+0000 7f4c2659c640 1 -- 172.21.15.77:0/3011400142 learned_addr learned my addr 172.21.15.77:0/3011400142 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:22.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.090+0000 7f4c1ffff640 1 --2- 172.21.15.77:0/3011400142 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4c280afda0 0x7f4c280cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:22.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.090+0000 7f4c2659c640 1 -- 172.21.15.77:0/3011400142 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4c280afda0 msgr2=0x7f4c280cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:22.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.090+0000 7f4c2659c640 1 --2- 172.21.15.77:0/3011400142 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4c280afda0 0x7f4c280cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.090+0000 7f4c2659c640 1 -- 172.21.15.77:0/3011400142 >> v1:172.21.15.77:6789/0 conn(0x7f4c280cd7f0 legacy=0x7f4c280cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:22.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.090+0000 7f4c2659c640 1 -- 172.21.15.77:0/3011400142 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c280cf950 con 0x7f4c2815b200 2023-11-04T01:46:22.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.091+0000 7f4c2659c640 1 --2- 172.21.15.77:0/3011400142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c2815b200 0x7f4c280ceb30 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f4c18009850 tx=0x7f4c1802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=335e92dabe7d3c4c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:22.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.091+0000 7f4c25d9b640 1 -- 172.21.15.77:0/3011400142 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c18004230 con 0x7f4c2815b200 2023-11-04T01:46:22.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.091+0000 7f4c25d9b640 1 -- 172.21.15.77:0/3011400142 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c18004390 con 0x7f4c2815b200 2023-11-04T01:46:22.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.091+0000 7f4c25d9b640 1 -- 172.21.15.77:0/3011400142 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c18031830 con 0x7f4c2815b200 2023-11-04T01:46:22.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.091+0000 7f4c2c924640 1 -- 172.21.15.77:0/3011400142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c2815b200 msgr2=0x7f4c280ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:22.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.091+0000 7f4c2c924640 1 --2- 172.21.15.77:0/3011400142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c2815b200 0x7f4c280ceb30 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f4c18009850 tx=0x7f4c1802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.091+0000 7f4c2c924640 1 -- 172.21.15.77:0/3011400142 shutdown_connections 2023-11-04T01:46:22.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.091+0000 7f4c2c924640 1 --2- 172.21.15.77:0/3011400142 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4c280afda0 0x7f4c280cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.091+0000 7f4c2c924640 1 --2- 172.21.15.77:0/3011400142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c2815b200 0x7f4c280ceb30 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.091+0000 7f4c2c924640 1 -- 172.21.15.77:0/3011400142 >> 172.21.15.77:0/3011400142 conn(0x7f4c280d0c30 msgr2=0x7f4c280d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:22.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.091+0000 7f4c2c924640 1 -- 172.21.15.77:0/3011400142 shutdown_connections 2023-11-04T01:46:22.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.091+0000 7f4c2c924640 1 -- 172.21.15.77:0/3011400142 wait complete. 2023-11-04T01:46:22.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.093+0000 7f4c2c924640 1 Processor -- start 2023-11-04T01:46:22.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.093+0000 7f4c2c924640 1 -- start start 2023-11-04T01:46:22.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.093+0000 7f4c2c924640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c280afda0 0x7f4c2814ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.093+0000 7f4c2c924640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c280cd7f0 0x7f4c280b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.093+0000 7f4c2c924640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4c2815b200 0x7f4c2815daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.093+0000 7f4c2c924640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c280b0540 con 0x7f4c280afda0 2023-11-04T01:46:22.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.093+0000 7f4c2c924640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c28150b00 con 0x7f4c280cd7f0 2023-11-04T01:46:22.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.093+0000 7f4c2c924640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c280b0180 con 0x7f4c2815b200 2023-11-04T01:46:22.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.093+0000 7f4c2659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c280afda0 0x7f4c2814ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:22.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.093+0000 7f4c2659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c280afda0 0x7f4c2814ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53396/0 (socket says 172.21.15.77:53396) 2023-11-04T01:46:22.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.093+0000 7f4c2659c640 1 -- 172.21.15.77:0/2716226561 learned_addr learned my addr 172.21.15.77:0/2716226561 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:22.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.094+0000 7f4c2659c640 1 -- 172.21.15.77:0/2716226561 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4c2815b200 msgr2=0x7f4c2815daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:22.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.094+0000 7f4c2659c640 1 --2- 172.21.15.77:0/2716226561 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4c2815b200 0x7f4c2815daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.094+0000 7f4c2659c640 1 -- 172.21.15.77:0/2716226561 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c280cd7f0 msgr2=0x7f4c280b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:22.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.094+0000 7f4c2659c640 1 --2- 172.21.15.77:0/2716226561 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c280cd7f0 0x7f4c280b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.094+0000 7f4c2659c640 1 -- 172.21.15.77:0/2716226561 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c18009460 con 0x7f4c280afda0 2023-11-04T01:46:22.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.094+0000 7f4c2659c640 1 --2- 172.21.15.77:0/2716226561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c280afda0 0x7f4c2814ff90 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f4c1802b910 tx=0x7f4c180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:22.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.094+0000 7f4c1effd640 1 -- 172.21.15.77:0/2716226561 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c18031830 con 0x7f4c280afda0 2023-11-04T01:46:22.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.094+0000 7f4c1effd640 1 -- 172.21.15.77:0/2716226561 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c18031990 con 0x7f4c280afda0 2023-11-04T01:46:22.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.094+0000 7f4c1effd640 1 -- 172.21.15.77:0/2716226561 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c18031d20 con 0x7f4c280afda0 2023-11-04T01:46:22.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.094+0000 7f4c2c924640 1 -- 172.21.15.77:0/2716226561 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c2815ca80 con 0x7f4c280afda0 2023-11-04T01:46:22.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.094+0000 7f4c2c924640 1 -- 172.21.15.77:0/2716226561 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c2815d040 con 0x7f4c280afda0 2023-11-04T01:46:22.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.095+0000 7f4c2c924640 1 -- 172.21.15.77:0/2716226561 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c280684b0 con 0x7f4c280afda0 2023-11-04T01:46:22.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.095+0000 7f4c1effd640 1 -- 172.21.15.77:0/2716226561 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4c18003610 con 0x7f4c280afda0 2023-11-04T01:46:22.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.096+0000 7f4c1effd640 1 --2- 172.21.15.77:0/2716226561 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4c0806ae70 0x7f4c0806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:22.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.096+0000 7f4c1effd640 1 -- 172.21.15.77:0/2716226561 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7825+0+0 (secure 0 0 0) 0x7f4c180ac2e0 con 0x7f4c280afda0 2023-11-04T01:46:22.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.096+0000 7f4c1ffff640 1 --2- 172.21.15.77:0/2716226561 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4c0806ae70 0x7f4c0806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:22.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.097+0000 7f4c1ffff640 1 --2- 172.21.15.77:0/2716226561 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4c0806ae70 0x7f4c0806d330 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f4c280b1fe0 tx=0x7f4c10008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:22.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.100+0000 7f4c1effd640 1 -- 172.21.15.77:0/2716226561 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4c18076b40 con 0x7f4c280afda0 2023-11-04T01:46:22.132 INFO:tasks.ceph.mds.a.smithi077.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:46:22.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.306+0000 7f4c2c924640 1 -- 172.21.15.77:0/2716226561 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c280cb950 con 0x7f4c280afda0 2023-11-04T01:46:22.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.307+0000 7f4c1effd640 1 -- 172.21.15.77:0/2716226561 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f4c1803f070 con 0x7f4c280afda0 2023-11-04T01:46:22.309 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:46:22.309 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":94,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8139,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2107153526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2107153526},{"type":"v1","addr":"172.21.15.77:6835","nonce":2107153526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:46:21.038212+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7977,"mds_1":6814},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6814":{"gid":6814,"name":"b","rank":1,"incarnation":88,"state":"up:active","state_seq":8,"addr":"172.21.15.122:6836/1450731169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1450731169},{"type":"v1","addr":"172.21.15.122:6836","nonce":1450731169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7977":{"gid":7977,"name":"a","rank":0,"incarnation":85,"state":"up:active","state_seq":14,"addr":"172.21.15.77:6834/3276812155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3276812155},{"type":"v1","addr":"172.21.15.77:6834","nonce":3276812155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:22.309 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 94 2023-11-04T01:46:22.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.309+0000 7f4c2c924640 1 -- 172.21.15.77:0/2716226561 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4c0806ae70 msgr2=0x7f4c0806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:22.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.309+0000 7f4c2c924640 1 --2- 172.21.15.77:0/2716226561 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4c0806ae70 0x7f4c0806d330 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f4c280b1fe0 tx=0x7f4c10008040 comp rx=0 tx=0).stop 2023-11-04T01:46:22.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.309+0000 7f4c2c924640 1 -- 172.21.15.77:0/2716226561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c280afda0 msgr2=0x7f4c2814ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:22.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.309+0000 7f4c2c924640 1 --2- 172.21.15.77:0/2716226561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c280afda0 0x7f4c2814ff90 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f4c1802b910 tx=0x7f4c180046c0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.309+0000 7f4c2c924640 1 -- 172.21.15.77:0/2716226561 shutdown_connections 2023-11-04T01:46:22.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.309+0000 7f4c2c924640 1 --2- 172.21.15.77:0/2716226561 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4c0806ae70 0x7f4c0806d330 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.309+0000 7f4c2c924640 1 --2- 172.21.15.77:0/2716226561 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4c2815b200 0x7f4c2815daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.309+0000 7f4c2c924640 1 --2- 172.21.15.77:0/2716226561 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c280cd7f0 0x7f4c280b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.309+0000 7f4c2c924640 1 --2- 172.21.15.77:0/2716226561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c280afda0 0x7f4c2814ff90 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:22.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.309+0000 7f4c2c924640 1 -- 172.21.15.77:0/2716226561 >> 172.21.15.77:0/2716226561 conn(0x7f4c280d0c30 msgr2=0x7f4c28159e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:22.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.309+0000 7f4c2c924640 1 -- 172.21.15.77:0/2716226561 shutdown_connections 2023-11-04T01:46:22.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:22.309+0000 7f4c2c924640 1 -- 172.21.15.77:0/2716226561 wait complete. 2023-11-04T01:46:22.321 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:46:26.483 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-11-04T01:46:27.322 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:27.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.433+0000 7f4d440c9640 1 Processor -- start 2023-11-04T01:46:27.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.433+0000 7f4d440c9640 1 -- start start 2023-11-04T01:46:27.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.434+0000 7f4d440c9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d3c0ade00 0x7f4d3c0b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.434+0000 7f4d440c9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d3c06cc90 con 0x7f4d3c06c5f0 2023-11-04T01:46:27.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.434+0000 7f4d440c9640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d3c0b0e60 con 0x7f4d3c06d9c0 2023-11-04T01:46:27.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.434+0000 7f4d440c9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c06cee0 con 0x7f4d3c0ade00 2023-11-04T01:46:27.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.434+0000 7f4d42666640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f4d3c06c5f0 0x7f4d3c0cc680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:47546/0 (socket says 172.21.15.77:47546) 2023-11-04T01:46:27.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.434+0000 7f4d42666640 1 -- 172.21.15.77:0/3622013640 learned_addr learned my addr 172.21.15.77:0/3622013640 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:46:27.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.434+0000 7f4d41e65640 1 --2- 172.21.15.77:0/3622013640 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d3c0ade00 0x7f4d3c0b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.434+0000 7f4d40e63640 1 -- 172.21.15.77:0/3622013640 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3793423643 0 0) 0x7f4d3c06cc90 con 0x7f4d3c06c5f0 2023-11-04T01:46:27.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.434+0000 7f4d40e63640 1 -- 172.21.15.77:0/3622013640 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d28003520 con 0x7f4d3c06c5f0 2023-11-04T01:46:27.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.434+0000 7f4d40e63640 1 -- 172.21.15.77:0/3622013640 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4168419704 0 0) 0x7f4d3c0b0e60 con 0x7f4d3c06d9c0 2023-11-04T01:46:27.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.434+0000 7f4d40e63640 1 -- 172.21.15.77:0/3622013640 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d3c06cc90 con 0x7f4d3c06d9c0 2023-11-04T01:46:27.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.434+0000 7f4d40e63640 1 -- 172.21.15.77:0/3622013640 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3768256259 0 0) 0x7f4d28003520 con 0x7f4d3c06c5f0 2023-11-04T01:46:27.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.434+0000 7f4d40e63640 1 -- 172.21.15.77:0/3622013640 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d3c0ade00 msgr2=0x7f4d3c0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:27.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.434+0000 7f4d40e63640 1 --2- 172.21.15.77:0/3622013640 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d3c0ade00 0x7f4d3c0b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.434+0000 7f4d40e63640 1 -- 172.21.15.77:0/3622013640 >> v1:172.21.15.122:6789/0 conn(0x7f4d3c06d9c0 legacy=0x7f4d3c0710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:27.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.435+0000 7f4d40e63640 1 -- 172.21.15.77:0/3622013640 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3c06d1c0 con 0x7f4d3c06c5f0 2023-11-04T01:46:27.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.435+0000 7f4d40e63640 1 -- 172.21.15.77:0/3622013640 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f4d340019f0 con 0x7f4d3c06c5f0 2023-11-04T01:46:27.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.435+0000 7f4d40e63640 1 -- 172.21.15.77:0/3622013640 >> v1:172.21.15.77:6789/0 conn(0x7f4d3c06c5f0 legacy=0x7f4d3c0cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:27.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.435+0000 7f4d40e63640 1 --2- 172.21.15.77:0/3622013640 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d3c0ade00 0x7f4d28003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.435+0000 7f4d40e63640 1 --2- 172.21.15.77:0/3622013640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d28004090 0x7f4d280047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.435+0000 7f4d40e63640 1 --2- 172.21.15.77:0/3622013640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d28004d00 0x7f4d28005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.435+0000 7f4d40e63640 1 -- 172.21.15.77:0/3622013640 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c06cee0 con 0x7f4d28004d00 2023-11-04T01:46:27.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.435+0000 7f4d40e63640 1 -- 172.21.15.77:0/3622013640 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2800bb90 con 0x7f4d28004090 2023-11-04T01:46:27.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.435+0000 7f4d40e63640 1 -- 172.21.15.77:0/3622013640 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2800bd50 con 0x7f4d3c0ade00 2023-11-04T01:46:27.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.435+0000 7f4d42666640 1 --2- 172.21.15.77:0/3622013640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d28004d00 0x7f4d28005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.435+0000 7f4d41e65640 1 --2- 172.21.15.77:0/3622013640 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d3c0ade00 0x7f4d28003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.435+0000 7f4d41664640 1 --2- 172.21.15.77:0/3622013640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d28004090 0x7f4d280047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.435+0000 7f4d42666640 1 -- 172.21.15.77:0/3622013640 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d3c0ade00 msgr2=0x7f4d28003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:27.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.435+0000 7f4d42666640 1 --2- 172.21.15.77:0/3622013640 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d3c0ade00 0x7f4d28003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.435+0000 7f4d42666640 1 -- 172.21.15.77:0/3622013640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d28004090 msgr2=0x7f4d280047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:27.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.435+0000 7f4d42666640 1 --2- 172.21.15.77:0/3622013640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d28004090 0x7f4d280047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.435+0000 7f4d42666640 1 -- 172.21.15.77:0/3622013640 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d28003520 con 0x7f4d28004d00 2023-11-04T01:46:27.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.435+0000 7f4d41664640 1 --2- 172.21.15.77:0/3622013640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d28004090 0x7f4d280047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:27.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.436+0000 7f4d42666640 1 --2- 172.21.15.77:0/3622013640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d28004d00 0x7f4d28005180 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400a7c0 tx=0x7f4d280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d190a6fd99505ef server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:27.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.436+0000 7f4d40e63640 1 -- 172.21.15.77:0/3622013640 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d34034630 con 0x7f4d28004d00 2023-11-04T01:46:27.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.436+0000 7f4d40e63640 1 -- 172.21.15.77:0/3622013640 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3402f070 con 0x7f4d28004d00 2023-11-04T01:46:27.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.436+0000 7f4d40e63640 1 -- 172.21.15.77:0/3622013640 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d34034a30 con 0x7f4d28004d00 2023-11-04T01:46:27.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.436+0000 7f4d440c9640 1 -- 172.21.15.77:0/3622013640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d28004d00 msgr2=0x7f4d28005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:27.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.436+0000 7f4d440c9640 1 --2- 172.21.15.77:0/3622013640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d28004d00 0x7f4d28005180 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400a7c0 tx=0x7f4d280057f0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.436+0000 7f4d42666640 1 -- 172.21.15.77:0/3622013640 reap_dead start 2023-11-04T01:46:27.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.436+0000 7f4d440c9640 1 -- 172.21.15.77:0/3622013640 shutdown_connections 2023-11-04T01:46:27.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.436+0000 7f4d440c9640 1 -- 172.21.15.77:0/3622013640 >> 172.21.15.77:0/3622013640 conn(0x7f4d3c0cb530 msgr2=0x7f4d3c0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:27.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.437+0000 7f4d440c9640 1 -- 172.21.15.77:0/3622013640 shutdown_connections 2023-11-04T01:46:27.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.437+0000 7f4d440c9640 1 -- 172.21.15.77:0/3622013640 wait complete. 2023-11-04T01:46:27.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.438+0000 7f4d440c9640 1 Processor -- start 2023-11-04T01:46:27.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.438+0000 7f4d440c9640 1 -- start start 2023-11-04T01:46:27.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.438+0000 7f4d440c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d28004d00 0x7f4d3c15a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.438+0000 7f4d440c9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d3c15a8a0 0x7f4d3c1f0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.438+0000 7f4d440c9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d3c1f0dc0 0x7f4d3c1f1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.438+0000 7f4d440c9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c1f1780 con 0x7f4d28004d00 2023-11-04T01:46:27.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.438+0000 7f4d440c9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c15b100 con 0x7f4d3c1f0dc0 2023-11-04T01:46:27.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.438+0000 7f4d440c9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c15ae20 con 0x7f4d3c15a8a0 2023-11-04T01:46:27.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.439+0000 7f4d41e65640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d28004d00 0x7f4d3c15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.439+0000 7f4d41e65640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d28004d00 0x7f4d3c15a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52338/0 (socket says 172.21.15.77:52338) 2023-11-04T01:46:27.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.439+0000 7f4d41e65640 1 -- 172.21.15.77:0/263334236 learned_addr learned my addr 172.21.15.77:0/263334236 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:27.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.439+0000 7f4d41e65640 1 -- 172.21.15.77:0/263334236 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d3c15a8a0 msgr2=0x7f4d3c1f0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:27.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.439+0000 7f4d41e65640 1 --2- 172.21.15.77:0/263334236 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d3c15a8a0 0x7f4d3c1f0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.439+0000 7f4d41e65640 1 -- 172.21.15.77:0/263334236 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d3c1f0dc0 msgr2=0x7f4d3c1f1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:27.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.439+0000 7f4d41e65640 1 --2- 172.21.15.77:0/263334236 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d3c1f0dc0 0x7f4d3c1f1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.439+0000 7f4d41e65640 1 -- 172.21.15.77:0/263334236 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3c154fc0 con 0x7f4d28004d00 2023-11-04T01:46:27.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.439+0000 7f4d41e65640 1 --2- 172.21.15.77:0/263334236 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d28004d00 0x7f4d3c15a360 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f4d380119a0 tx=0x7f4d38011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:27.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.439+0000 7f4d327fc640 1 -- 172.21.15.77:0/263334236 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3800fa70 con 0x7f4d28004d00 2023-11-04T01:46:27.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.439+0000 7f4d327fc640 1 -- 172.21.15.77:0/263334236 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3800fbd0 con 0x7f4d28004d00 2023-11-04T01:46:27.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.439+0000 7f4d440c9640 1 -- 172.21.15.77:0/263334236 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d3c1552a0 con 0x7f4d28004d00 2023-11-04T01:46:27.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.439+0000 7f4d327fc640 1 -- 172.21.15.77:0/263334236 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d38014440 con 0x7f4d28004d00 2023-11-04T01:46:27.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.439+0000 7f4d440c9640 1 -- 172.21.15.77:0/263334236 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d3c157780 con 0x7f4d28004d00 2023-11-04T01:46:27.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.440+0000 7f4d440c9640 1 -- 172.21.15.77:0/263334236 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d3c0684b0 con 0x7f4d28004d00 2023-11-04T01:46:27.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.441+0000 7f4d327fc640 1 -- 172.21.15.77:0/263334236 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4d3801d400 con 0x7f4d28004d00 2023-11-04T01:46:27.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.441+0000 7f4d327fc640 1 --2- 172.21.15.77:0/263334236 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4d2006aea0 0x7f4d2006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.441+0000 7f4d327fc640 1 -- 172.21.15.77:0/263334236 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7781+0+0 (secure 0 0 0) 0x7f4d3808a570 con 0x7f4d28004d00 2023-11-04T01:46:27.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.441+0000 7f4d41664640 1 --2- 172.21.15.77:0/263334236 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4d2006aea0 0x7f4d2006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.442+0000 7f4d41664640 1 --2- 172.21.15.77:0/263334236 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4d2006aea0 0x7f4d2006d360 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c007fd0 tx=0x7f4d2c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:27.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.445+0000 7f4d327fc640 1 -- 172.21.15.77:0/263334236 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4d38054e90 con 0x7f4d28004d00 2023-11-04T01:46:27.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.648+0000 7f4d440c9640 1 -- 172.21.15.77:0/263334236 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d3c0cddc0 con 0x7f4d28004d00 2023-11-04T01:46:27.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.648+0000 7f4d327fc640 1 -- 172.21.15.77:0/263334236 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4938 (secure 0 0 0) 0x7f4d380584b0 con 0x7f4d28004d00 2023-11-04T01:46:27.651 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:46:27.651 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":94,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8139,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2107153526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2107153526},{"type":"v1","addr":"172.21.15.77:6835","nonce":2107153526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:46:21.038212+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7977,"mds_1":6814},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6814":{"gid":6814,"name":"b","rank":1,"incarnation":88,"state":"up:active","state_seq":8,"addr":"172.21.15.122:6836/1450731169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1450731169},{"type":"v1","addr":"172.21.15.122:6836","nonce":1450731169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7977":{"gid":7977,"name":"a","rank":0,"incarnation":85,"state":"up:active","state_seq":14,"addr":"172.21.15.77:6834/3276812155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3276812155},{"type":"v1","addr":"172.21.15.77:6834","nonce":3276812155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:27.651 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 94 2023-11-04T01:46:27.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.650+0000 7f4d440c9640 1 -- 172.21.15.77:0/263334236 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4d2006aea0 msgr2=0x7f4d2006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:27.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.650+0000 7f4d440c9640 1 --2- 172.21.15.77:0/263334236 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4d2006aea0 0x7f4d2006d360 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c007fd0 tx=0x7f4d2c009040 comp rx=0 tx=0).stop 2023-11-04T01:46:27.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.650+0000 7f4d440c9640 1 -- 172.21.15.77:0/263334236 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d28004d00 msgr2=0x7f4d3c15a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:27.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.650+0000 7f4d440c9640 1 --2- 172.21.15.77:0/263334236 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d28004d00 0x7f4d3c15a360 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f4d380119a0 tx=0x7f4d38011e60 comp rx=0 tx=0).stop 2023-11-04T01:46:27.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.650+0000 7f4d440c9640 1 -- 172.21.15.77:0/263334236 shutdown_connections 2023-11-04T01:46:27.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.650+0000 7f4d440c9640 1 --2- 172.21.15.77:0/263334236 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f4d2006aea0 0x7f4d2006d360 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.650+0000 7f4d440c9640 1 --2- 172.21.15.77:0/263334236 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d3c1f0dc0 0x7f4d3c1f1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.650+0000 7f4d440c9640 1 --2- 172.21.15.77:0/263334236 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f4d3c15a8a0 0x7f4d3c1f0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.650+0000 7f4d440c9640 1 --2- 172.21.15.77:0/263334236 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d28004d00 0x7f4d3c15a360 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.650+0000 7f4d440c9640 1 -- 172.21.15.77:0/263334236 >> 172.21.15.77:0/263334236 conn(0x7f4d3c0cb530 msgr2=0x7f4d3c0ccf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:27.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.651+0000 7f4d440c9640 1 -- 172.21.15.77:0/263334236 shutdown_connections 2023-11-04T01:46:27.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:27.651+0000 7f4d440c9640 1 -- 172.21.15.77:0/263334236 wait complete. 2023-11-04T01:46:27.663 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:46:31.250 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:46:31.254 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:46:32.664 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:32.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.773+0000 7ff49e9c7640 1 Processor -- start 2023-11-04T01:46:32.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.773+0000 7ff49e9c7640 1 -- start start 2023-11-04T01:46:32.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.774+0000 7ff49e9c7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff498159e40 0x7ff4980b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:32.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.774+0000 7ff49e9c7640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff49806bb60 0x7ff4980b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:32.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.774+0000 7ff49e9c7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff498071500 con 0x7ff49806fff0 2023-11-04T01:46:32.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.774+0000 7ff49e9c7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff49815dae0 con 0x7ff498159e40 2023-11-04T01:46:32.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.774+0000 7ff49e9c7640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff498070c60 con 0x7ff49806bb60 2023-11-04T01:46:32.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.774+0000 7ff497fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff498159e40 0x7ff4980b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:32.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.774+0000 7ff497fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff498159e40 0x7ff4980b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52354/0 (socket says 172.21.15.77:52354) 2023-11-04T01:46:32.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.774+0000 7ff497fff640 1 -- 172.21.15.77:0/3309474315 learned_addr learned my addr 172.21.15.77:0/3309474315 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:32.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.774+0000 7ff4977fe640 1 --2- 172.21.15.77:0/3309474315 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff49806bb60 0x7ff4980b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:32.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.774+0000 7ff497fff640 1 -- 172.21.15.77:0/3309474315 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff49806bb60 msgr2=0x7ff4980b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:32.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.774+0000 7ff497fff640 1 --2- 172.21.15.77:0/3309474315 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff49806bb60 0x7ff4980b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:32.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.774+0000 7ff497fff640 1 -- 172.21.15.77:0/3309474315 >> v1:172.21.15.77:6789/0 conn(0x7ff49806fff0 legacy=0x7ff498070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:32.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.774+0000 7ff497fff640 1 -- 172.21.15.77:0/3309474315 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff498070f40 con 0x7ff498159e40 2023-11-04T01:46:32.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.774+0000 7ff4977fe640 1 --2- 172.21.15.77:0/3309474315 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff49806bb60 0x7ff4980b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:32.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.775+0000 7ff497fff640 1 --2- 172.21.15.77:0/3309474315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff498159e40 0x7ff4980b0530 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7ff488009870 tx=0x7ff48802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61da8f482080ef6e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:32.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.775+0000 7ff496ffd640 1 -- 172.21.15.77:0/3309474315 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff488031640 con 0x7ff498159e40 2023-11-04T01:46:32.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.775+0000 7ff496ffd640 1 -- 172.21.15.77:0/3309474315 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4880317a0 con 0x7ff498159e40 2023-11-04T01:46:32.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.775+0000 7ff496ffd640 1 -- 172.21.15.77:0/3309474315 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff488031b30 con 0x7ff498159e40 2023-11-04T01:46:32.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.776+0000 7ff49e9c7640 1 -- 172.21.15.77:0/3309474315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff498159e40 msgr2=0x7ff4980b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:32.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.776+0000 7ff49e9c7640 1 --2- 172.21.15.77:0/3309474315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff498159e40 0x7ff4980b0530 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7ff488009870 tx=0x7ff48802b8f0 comp rx=0 tx=0).stop 2023-11-04T01:46:32.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.776+0000 7ff49e9c7640 1 -- 172.21.15.77:0/3309474315 shutdown_connections 2023-11-04T01:46:32.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.776+0000 7ff49e9c7640 1 --2- 172.21.15.77:0/3309474315 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff49806bb60 0x7ff4980b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:32.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.776+0000 7ff49e9c7640 1 --2- 172.21.15.77:0/3309474315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff498159e40 0x7ff4980b0530 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:32.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.776+0000 7ff49e9c7640 1 -- 172.21.15.77:0/3309474315 >> 172.21.15.77:0/3309474315 conn(0x7ff4980cb530 msgr2=0x7ff4980cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:32.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.776+0000 7ff49e9c7640 1 -- 172.21.15.77:0/3309474315 shutdown_connections 2023-11-04T01:46:32.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.776+0000 7ff49e9c7640 1 -- 172.21.15.77:0/3309474315 wait complete. 2023-11-04T01:46:32.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.777+0000 7ff49e9c7640 1 Processor -- start 2023-11-04T01:46:32.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.777+0000 7ff49e9c7640 1 -- start start 2023-11-04T01:46:32.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.778+0000 7ff49e9c7640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff49806bb60 0x7ff4980c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:32.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.778+0000 7ff49e9c7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff49806fff0 0x7ff49814c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:32.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.778+0000 7ff49e9c7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff498159e40 0x7ff498151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:32.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.778+0000 7ff49e9c7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4980c80c0 con 0x7ff49806fff0 2023-11-04T01:46:32.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.778+0000 7ff49e9c7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49814c5f0 con 0x7ff498159e40 2023-11-04T01:46:32.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.778+0000 7ff49e9c7640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4980c74b0 con 0x7ff49806bb60 2023-11-04T01:46:32.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.778+0000 7ff4977fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff49806fff0 0x7ff49814c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:32.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.778+0000 7ff4977fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff49806fff0 0x7ff49814c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52360/0 (socket says 172.21.15.77:52360) 2023-11-04T01:46:32.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.778+0000 7ff4977fe640 1 -- 172.21.15.77:0/31134262 learned_addr learned my addr 172.21.15.77:0/31134262 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:32.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.778+0000 7ff497fff640 1 --2- 172.21.15.77:0/31134262 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff49806bb60 0x7ff4980c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:32.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.778+0000 7ff49cf64640 1 --2- 172.21.15.77:0/31134262 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff498159e40 0x7ff498151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:32.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.778+0000 7ff4977fe640 1 -- 172.21.15.77:0/31134262 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff49806bb60 msgr2=0x7ff4980c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:32.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.778+0000 7ff4977fe640 1 --2- 172.21.15.77:0/31134262 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff49806bb60 0x7ff4980c8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:32.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.778+0000 7ff4977fe640 1 -- 172.21.15.77:0/31134262 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff498159e40 msgr2=0x7ff498151910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:32.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.778+0000 7ff4977fe640 1 --2- 172.21.15.77:0/31134262 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff498159e40 0x7ff498151910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:32.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.778+0000 7ff4977fe640 1 -- 172.21.15.77:0/31134262 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4880094d0 con 0x7ff49806fff0 2023-11-04T01:46:32.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.778+0000 7ff49cf64640 1 --2- 172.21.15.77:0/31134262 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff498159e40 0x7ff498151910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:32.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.779+0000 7ff4977fe640 1 --2- 172.21.15.77:0/31134262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff49806fff0 0x7ff49814c0b0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7ff48c00c7f0 tx=0x7ff48c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:32.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.779+0000 7ff494ff9640 1 -- 172.21.15.77:0/31134262 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c007a30 con 0x7ff49806fff0 2023-11-04T01:46:32.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.779+0000 7ff494ff9640 1 -- 172.21.15.77:0/31134262 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48c007b90 con 0x7ff49806fff0 2023-11-04T01:46:32.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.779+0000 7ff49e9c7640 1 -- 172.21.15.77:0/31134262 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4980c7790 con 0x7ff49806fff0 2023-11-04T01:46:32.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.779+0000 7ff494ff9640 1 -- 172.21.15.77:0/31134262 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c00ce40 con 0x7ff49806fff0 2023-11-04T01:46:32.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.779+0000 7ff49e9c7640 1 -- 172.21.15.77:0/31134262 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4980c7d50 con 0x7ff49806fff0 2023-11-04T01:46:32.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.780+0000 7ff49e9c7640 1 -- 172.21.15.77:0/31134262 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4980684b0 con 0x7ff49806fff0 2023-11-04T01:46:32.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.780+0000 7ff494ff9640 1 -- 172.21.15.77:0/31134262 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff48c0113f0 con 0x7ff49806fff0 2023-11-04T01:46:32.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.781+0000 7ff494ff9640 1 --2- 172.21.15.77:0/31134262 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff48406ae70 0x7ff48406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:32.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.781+0000 7ff494ff9640 1 -- 172.21.15.77:0/31134262 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7781+0+0 (secure 0 0 0) 0x7ff48c089f70 con 0x7ff49806fff0 2023-11-04T01:46:32.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.781+0000 7ff497fff640 1 --2- 172.21.15.77:0/31134262 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff48406ae70 0x7ff48406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:32.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.782+0000 7ff497fff640 1 --2- 172.21.15.77:0/31134262 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff48406ae70 0x7ff48406d330 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff488036000 tx=0x7ff48803c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:32.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.785+0000 7ff494ff9640 1 -- 172.21.15.77:0/31134262 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff48c0bcca0 con 0x7ff49806fff0 2023-11-04T01:46:32.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.987+0000 7ff49e9c7640 1 -- 172.21.15.77:0/31134262 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4980c9e50 con 0x7ff49806fff0 2023-11-04T01:46:32.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.988+0000 7ff494ff9640 1 -- 172.21.15.77:0/31134262 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4938 (secure 0 0 0) 0x7ff48c01f020 con 0x7ff49806fff0 2023-11-04T01:46:32.990 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:46:32.990 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":94,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8139,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2107153526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2107153526},{"type":"v1","addr":"172.21.15.77:6835","nonce":2107153526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:46:21.038212+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7977,"mds_1":6814},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6814":{"gid":6814,"name":"b","rank":1,"incarnation":88,"state":"up:active","state_seq":8,"addr":"172.21.15.122:6836/1450731169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1450731169},{"type":"v1","addr":"172.21.15.122:6836","nonce":1450731169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7977":{"gid":7977,"name":"a","rank":0,"incarnation":85,"state":"up:active","state_seq":14,"addr":"172.21.15.77:6834/3276812155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3276812155},{"type":"v1","addr":"172.21.15.77:6834","nonce":3276812155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:32.990 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 94 2023-11-04T01:46:32.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.990+0000 7ff49e9c7640 1 -- 172.21.15.77:0/31134262 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff48406ae70 msgr2=0x7ff48406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:32.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.990+0000 7ff49e9c7640 1 --2- 172.21.15.77:0/31134262 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff48406ae70 0x7ff48406d330 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff488036000 tx=0x7ff48803c040 comp rx=0 tx=0).stop 2023-11-04T01:46:32.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.990+0000 7ff49e9c7640 1 -- 172.21.15.77:0/31134262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff49806fff0 msgr2=0x7ff49814c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:32.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.990+0000 7ff49e9c7640 1 --2- 172.21.15.77:0/31134262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff49806fff0 0x7ff49814c0b0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7ff48c00c7f0 tx=0x7ff48c00cbf0 comp rx=0 tx=0).stop 2023-11-04T01:46:32.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.990+0000 7ff49e9c7640 1 -- 172.21.15.77:0/31134262 shutdown_connections 2023-11-04T01:46:32.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.990+0000 7ff49e9c7640 1 --2- 172.21.15.77:0/31134262 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff48406ae70 0x7ff48406d330 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:32.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.990+0000 7ff49e9c7640 1 --2- 172.21.15.77:0/31134262 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff498159e40 0x7ff498151910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:32.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.990+0000 7ff49e9c7640 1 --2- 172.21.15.77:0/31134262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff49806fff0 0x7ff49814c0b0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:32.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.990+0000 7ff49e9c7640 1 --2- 172.21.15.77:0/31134262 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff49806bb60 0x7ff4980c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:32.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.990+0000 7ff49e9c7640 1 -- 172.21.15.77:0/31134262 >> 172.21.15.77:0/31134262 conn(0x7ff4980cb530 msgr2=0x7ff498070460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:32.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.990+0000 7ff49e9c7640 1 -- 172.21.15.77:0/31134262 shutdown_connections 2023-11-04T01:46:32.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:32.990+0000 7ff49e9c7640 1 -- 172.21.15.77:0/31134262 wait complete. 2023-11-04T01:46:33.002 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:46:33.095 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~7s 2023-11-04T01:46:38.003 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:38.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.113+0000 7fae2c378640 1 Processor -- start 2023-11-04T01:46:38.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.113+0000 7fae2c378640 1 -- start start 2023-11-04T01:46:38.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.114+0000 7fae2c378640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fae24159e40 0x7fae240b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:38.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.114+0000 7fae2c378640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fae24070700 0x7fae240b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:38.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.114+0000 7fae2c378640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae24071500 con 0x7fae2406bb60 2023-11-04T01:46:38.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.114+0000 7fae2c378640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae2415dae0 con 0x7fae24070700 2023-11-04T01:46:38.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.114+0000 7fae2c378640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae24070c60 con 0x7fae24159e40 2023-11-04T01:46:38.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.114+0000 7fae2a114640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fae24159e40 0x7fae240b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:38.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.114+0000 7fae2a915640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fae24070700 0x7fae240b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:38.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.114+0000 7fae2a114640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fae24159e40 0x7fae240b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:54974/0 (socket says 172.21.15.77:54974) 2023-11-04T01:46:38.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.114+0000 7fae2a114640 1 -- 172.21.15.77:0/2043878260 learned_addr learned my addr 172.21.15.77:0/2043878260 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:38.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.114+0000 7fae2a114640 1 -- 172.21.15.77:0/2043878260 >> v2:172.21.15.122:3300/0 conn(0x7fae24070700 msgr2=0x7fae240b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:38.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.114+0000 7fae2a114640 1 --2- 172.21.15.77:0/2043878260 >> v2:172.21.15.122:3300/0 conn(0x7fae24070700 0x7fae240b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:38.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.114+0000 7fae2a114640 1 -- 172.21.15.77:0/2043878260 >> v1:172.21.15.122:6789/0 conn(0x7fae2406bb60 legacy=0x7fae2406fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:38.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.114+0000 7fae2a114640 1 -- 172.21.15.77:0/2043878260 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae24070f40 con 0x7fae24159e40 2023-11-04T01:46:38.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.115+0000 7fae2a114640 1 --2- 172.21.15.77:0/2043878260 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fae24159e40 0x7fae240b0530 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fae2000bb10 tx=0x7fae2002e0c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3884a56e3736b9e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:38.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.115+0000 7fae29112640 1 -- 172.21.15.77:0/2043878260 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2002ee70 con 0x7fae24159e40 2023-11-04T01:46:38.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.115+0000 7fae29112640 1 -- 172.21.15.77:0/2043878260 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae20036440 con 0x7fae24159e40 2023-11-04T01:46:38.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.115+0000 7fae29112640 1 -- 172.21.15.77:0/2043878260 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae200367d0 con 0x7fae24159e40 2023-11-04T01:46:38.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.116+0000 7fae2c378640 1 -- 172.21.15.77:0/2043878260 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fae24159e40 msgr2=0x7fae240b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:38.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.116+0000 7fae2c378640 1 --2- 172.21.15.77:0/2043878260 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fae24159e40 0x7fae240b0530 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fae2000bb10 tx=0x7fae2002e0c0 comp rx=0 tx=0).stop 2023-11-04T01:46:38.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.116+0000 7fae2c378640 1 -- 172.21.15.77:0/2043878260 shutdown_connections 2023-11-04T01:46:38.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.116+0000 7fae2c378640 1 --2- 172.21.15.77:0/2043878260 >> v2:172.21.15.122:3300/0 conn(0x7fae24070700 0x7fae240b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:38.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.116+0000 7fae2c378640 1 --2- 172.21.15.77:0/2043878260 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fae24159e40 0x7fae240b0530 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:38.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.116+0000 7fae2c378640 1 -- 172.21.15.77:0/2043878260 >> 172.21.15.77:0/2043878260 conn(0x7fae240cb530 msgr2=0x7fae240cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:38.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.116+0000 7fae2c378640 1 -- 172.21.15.77:0/2043878260 shutdown_connections 2023-11-04T01:46:38.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.116+0000 7fae2c378640 1 -- 172.21.15.77:0/2043878260 wait complete. 2023-11-04T01:46:38.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.118+0000 7fae2c378640 1 Processor -- start 2023-11-04T01:46:38.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.118+0000 7fae2c378640 1 -- start start 2023-11-04T01:46:38.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.118+0000 7fae2c378640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae2406bb60 0x7fae2414ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:38.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.118+0000 7fae2c378640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fae24070700 0x7fae241ee800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:38.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.118+0000 7fae2c378640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae24159e40 0x7fae241f2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:38.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.118+0000 7fae2c378640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae241f21e0 con 0x7fae2406bb60 2023-11-04T01:46:38.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.118+0000 7fae2c378640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae241ef110 con 0x7fae24159e40 2023-11-04T01:46:38.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.118+0000 7fae2c378640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae241ef3f0 con 0x7fae24070700 2023-11-04T01:46:38.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.118+0000 7fae2a114640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae2406bb60 0x7fae2414ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:38.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.118+0000 7fae2a114640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae2406bb60 0x7fae2414ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44490/0 (socket says 172.21.15.77:44490) 2023-11-04T01:46:38.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.118+0000 7fae2a114640 1 -- 172.21.15.77:0/1853418737 learned_addr learned my addr 172.21.15.77:0/1853418737 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:38.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.119+0000 7fae2a915640 1 --2- 172.21.15.77:0/1853418737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae24159e40 0x7fae241f2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:38.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.119+0000 7fae29913640 1 --2- 172.21.15.77:0/1853418737 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fae24070700 0x7fae241ee800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:38.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.119+0000 7fae2a114640 1 -- 172.21.15.77:0/1853418737 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fae24070700 msgr2=0x7fae241ee800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:38.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.119+0000 7fae2a114640 1 --2- 172.21.15.77:0/1853418737 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fae24070700 0x7fae241ee800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:38.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.119+0000 7fae2a114640 1 -- 172.21.15.77:0/1853418737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae24159e40 msgr2=0x7fae241f2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:38.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.119+0000 7fae2a114640 1 --2- 172.21.15.77:0/1853418737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae24159e40 0x7fae241f2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:38.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.119+0000 7fae2a114640 1 -- 172.21.15.77:0/1853418737 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2000b770 con 0x7fae2406bb60 2023-11-04T01:46:38.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.119+0000 7fae2a915640 1 --2- 172.21.15.77:0/1853418737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae24159e40 0x7fae241f2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:46:38.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.119+0000 7fae2a114640 1 --2- 172.21.15.77:0/1853418737 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae2406bb60 0x7fae2414ef50 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fae2000b2c0 tx=0x7fae200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:38.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.119+0000 7fae1affd640 1 -- 172.21.15.77:0/1853418737 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2003f810 con 0x7fae2406bb60 2023-11-04T01:46:38.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.119+0000 7fae1affd640 1 -- 172.21.15.77:0/1853418737 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2003f990 con 0x7fae2406bb60 2023-11-04T01:46:38.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.119+0000 7fae2c378640 1 -- 172.21.15.77:0/1853418737 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae241ef6d0 con 0x7fae2406bb60 2023-11-04T01:46:38.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.119+0000 7fae1affd640 1 -- 172.21.15.77:0/1853418737 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2003fd40 con 0x7fae2406bb60 2023-11-04T01:46:38.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.119+0000 7fae2c378640 1 -- 172.21.15.77:0/1853418737 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae241eed40 con 0x7fae2406bb60 2023-11-04T01:46:38.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.120+0000 7fae2c378640 1 -- 172.21.15.77:0/1853418737 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae240684b0 con 0x7fae2406bb60 2023-11-04T01:46:38.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.121+0000 7fae1affd640 1 -- 172.21.15.77:0/1853418737 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fae2003d040 con 0x7fae2406bb60 2023-11-04T01:46:38.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.121+0000 7fae1affd640 1 --2- 172.21.15.77:0/1853418737 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fae0806aea0 0x7fae0806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:38.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.121+0000 7fae1affd640 1 -- 172.21.15.77:0/1853418737 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7781+0+0 (secure 0 0 0) 0x7fae20045030 con 0x7fae2406bb60 2023-11-04T01:46:38.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.121+0000 7fae29913640 1 --2- 172.21.15.77:0/1853418737 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fae0806aea0 0x7fae0806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:38.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.122+0000 7fae29913640 1 --2- 172.21.15.77:0/1853418737 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fae0806aea0 0x7fae0806d360 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fae240ada60 tx=0x7fae14009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:38.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.125+0000 7fae1affd640 1 -- 172.21.15.77:0/1853418737 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fae200790d0 con 0x7fae2406bb60 2023-11-04T01:46:38.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.329+0000 7fae2c378640 1 -- 172.21.15.77:0/1853418737 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fae240711f0 con 0x7fae2406bb60 2023-11-04T01:46:38.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.329+0000 7fae1affd640 1 -- 172.21.15.77:0/1853418737 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4986 (secure 0 0 0) 0x7fae2004f090 con 0x7fae2406bb60 2023-11-04T01:46:38.331 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:46:38.332 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":95,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8139,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2107153526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2107153526},{"type":"v1","addr":"172.21.15.77:6835","nonce":2107153526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:46:35.617199+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7977,"mds_1":6814},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6814":{"gid":6814,"name":"b","rank":1,"incarnation":88,"state":"up:active","state_seq":8,"addr":"172.21.15.122:6836/1450731169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1450731169},{"type":"v1","addr":"172.21.15.122:6836","nonce":1450731169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7977":{"gid":7977,"name":"a","rank":0,"incarnation":85,"state":"up:active","state_seq":14,"addr":"172.21.15.77:6834/3276812155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3276812155},{"type":"v1","addr":"172.21.15.77:6834","nonce":3276812155}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:46:35.617198+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:38.332 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 95 2023-11-04T01:46:38.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.331+0000 7fae2c378640 1 -- 172.21.15.77:0/1853418737 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fae0806aea0 msgr2=0x7fae0806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:38.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.331+0000 7fae2c378640 1 --2- 172.21.15.77:0/1853418737 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fae0806aea0 0x7fae0806d360 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fae240ada60 tx=0x7fae14009040 comp rx=0 tx=0).stop 2023-11-04T01:46:38.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.331+0000 7fae2c378640 1 -- 172.21.15.77:0/1853418737 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae2406bb60 msgr2=0x7fae2414ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:38.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.331+0000 7fae2c378640 1 --2- 172.21.15.77:0/1853418737 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae2406bb60 0x7fae2414ef50 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fae2000b2c0 tx=0x7fae200046c0 comp rx=0 tx=0).stop 2023-11-04T01:46:38.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.331+0000 7fae2c378640 1 -- 172.21.15.77:0/1853418737 shutdown_connections 2023-11-04T01:46:38.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.331+0000 7fae2c378640 1 --2- 172.21.15.77:0/1853418737 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fae0806aea0 0x7fae0806d360 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:38.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.331+0000 7fae2c378640 1 --2- 172.21.15.77:0/1853418737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fae24159e40 0x7fae241f2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:38.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.331+0000 7fae2c378640 1 --2- 172.21.15.77:0/1853418737 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fae24070700 0x7fae241ee800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:38.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.331+0000 7fae2c378640 1 --2- 172.21.15.77:0/1853418737 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae2406bb60 0x7fae2414ef50 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:38.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.331+0000 7fae2c378640 1 -- 172.21.15.77:0/1853418737 >> 172.21.15.77:0/1853418737 conn(0x7fae240cb530 msgr2=0x7fae240cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:38.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.331+0000 7fae2c378640 1 -- 172.21.15.77:0/1853418737 shutdown_connections 2023-11-04T01:46:38.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.331+0000 7fae2c378640 1 -- 172.21.15.77:0/1853418737 wait complete. 2023-11-04T01:46:38.343 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-11-04T01:46:38.344 DEBUG:teuthology.orchestra.run.smithi077:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:46:38.369 INFO:teuthology.orchestra.run.smithi077.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:46:38.371 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:46:38.371 DEBUG:teuthology.orchestra.run.smithi077:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:46:38.440 INFO:teuthology.orchestra.run.smithi077.stdout:1699062381.151332.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i a', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:46:38.442 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062381.151332.core'] 2023-11-04T01:46:38.442 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062381.151332.core, deleting it 2023-11-04T01:46:38.443 DEBUG:teuthology.orchestra.run.smithi077:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062381.151332.core 2023-11-04T01:46:38.511 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:38.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.650+0000 7fa7e2ee0640 1 Processor -- start 2023-11-04T01:46:38.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.650+0000 7fa7e2ee0640 1 -- start start 2023-11-04T01:46:38.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.651+0000 7fa7e2ee0640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7dc15d4e0 0x7fa7dc0d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:38.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.651+0000 7fa7e2ee0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7dc0b32b0 con 0x7fa7dc15d100 2023-11-04T01:46:38.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.651+0000 7fa7e2ee0640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7dc0cee10 con 0x7fa7dc0d3b60 2023-11-04T01:46:38.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.651+0000 7fa7e2ee0640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7dc0cec20 con 0x7fa7dc15d4e0 2023-11-04T01:46:38.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.651+0000 7fa7e0c7c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fa7dc15d100 0x7fa7dc0ce510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40556/0 (socket says 172.21.15.77:40556) 2023-11-04T01:46:38.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.651+0000 7fa7e0c7c640 1 -- 172.21.15.77:0/1181612973 learned_addr learned my addr 172.21.15.77:0/1181612973 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:46:38.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.652+0000 7fa7dbfff640 1 --2- 172.21.15.77:0/1181612973 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7dc15d4e0 0x7fa7dc0d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:38.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.652+0000 7fa7db7fe640 1 -- 172.21.15.77:0/1181612973 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3322075790 0 0) 0x7fa7dc0b32b0 con 0x7fa7dc15d100 2023-11-04T01:46:38.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.652+0000 7fa7db7fe640 1 -- 172.21.15.77:0/1181612973 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7c8003520 con 0x7fa7dc15d100 2023-11-04T01:46:38.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.652+0000 7fa7db7fe640 1 -- 172.21.15.77:0/1181612973 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3399028191 0 0) 0x7fa7c8003520 con 0x7fa7dc15d100 2023-11-04T01:46:38.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.652+0000 7fa7db7fe640 1 -- 172.21.15.77:0/1181612973 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7dc15d4e0 msgr2=0x7fa7dc0d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:38.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.652+0000 7fa7db7fe640 1 --2- 172.21.15.77:0/1181612973 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7dc15d4e0 0x7fa7dc0d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:38.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.652+0000 7fa7db7fe640 1 -- 172.21.15.77:0/1181612973 >> v1:172.21.15.122:6789/0 conn(0x7fa7dc0d3b60 legacy=0x7fa7dc0b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:38.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.652+0000 7fa7db7fe640 1 -- 172.21.15.77:0/1181612973 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7dc0b2980 con 0x7fa7dc15d100 2023-11-04T01:46:38.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.652+0000 7fa7db7fe640 1 -- 172.21.15.77:0/1181612973 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7fa7d4001b70 con 0x7fa7dc15d100 2023-11-04T01:46:38.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.652+0000 7fa7db7fe640 1 -- 172.21.15.77:0/1181612973 >> v1:172.21.15.77:6789/0 conn(0x7fa7dc15d100 legacy=0x7fa7dc0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:38.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.652+0000 7fa7db7fe640 1 --2- 172.21.15.77:0/1181612973 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7c80039a0 0x7fa7c8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:38.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.652+0000 7fa7db7fe640 1 --2- 172.21.15.77:0/1181612973 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7dc15d4e0 0x7fa7c80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:38.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.652+0000 7fa7db7fe640 1 --2- 172.21.15.77:0/1181612973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7c8004d00 0x7fa7c8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:38.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.652+0000 7fa7db7fe640 1 -- 172.21.15.77:0/1181612973 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c800ba30 con 0x7fa7c8004d00 2023-11-04T01:46:38.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.652+0000 7fa7db7fe640 1 -- 172.21.15.77:0/1181612973 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c800bba0 con 0x7fa7c80039a0 2023-11-04T01:46:38.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.652+0000 7fa7db7fe640 1 -- 172.21.15.77:0/1181612973 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c800bd60 con 0x7fa7dc15d4e0 2023-11-04T01:46:38.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.652+0000 7fa7e0c7c640 1 --2- 172.21.15.77:0/1181612973 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7c80039a0 0x7fa7c8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:38.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.652+0000 7fa7e147d640 1 --2- 172.21.15.77:0/1181612973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7c8004d00 0x7fa7c8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:38.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.652+0000 7fa7dbfff640 1 --2- 172.21.15.77:0/1181612973 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7dc15d4e0 0x7fa7c80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:38.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.652+0000 7fa7e147d640 1 -- 172.21.15.77:0/1181612973 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7dc15d4e0 msgr2=0x7fa7c80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:38.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.652+0000 7fa7e147d640 1 --2- 172.21.15.77:0/1181612973 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7dc15d4e0 0x7fa7c80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:38.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.652+0000 7fa7e147d640 1 -- 172.21.15.77:0/1181612973 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7c80039a0 msgr2=0x7fa7c8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:38.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.652+0000 7fa7e147d640 1 --2- 172.21.15.77:0/1181612973 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7c80039a0 0x7fa7c8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:38.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.652+0000 7fa7e147d640 1 -- 172.21.15.77:0/1181612973 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c8003520 con 0x7fa7c8004d00 2023-11-04T01:46:38.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.653+0000 7fa7e147d640 1 --2- 172.21.15.77:0/1181612973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7c8004d00 0x7fa7c8005180 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc001720 tx=0x7fa7c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e579d561ade0bd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:38.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.654+0000 7fa7db7fe640 1 -- 172.21.15.77:0/1181612973 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc0052d0 con 0x7fa7c8004d00 2023-11-04T01:46:38.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.654+0000 7fa7db7fe640 1 -- 172.21.15.77:0/1181612973 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7cc02e050 con 0x7fa7c8004d00 2023-11-04T01:46:38.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.654+0000 7fa7db7fe640 1 -- 172.21.15.77:0/1181612973 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc0035f0 con 0x7fa7c8004d00 2023-11-04T01:46:38.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.655+0000 7fa7e2ee0640 1 -- 172.21.15.77:0/1181612973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7c8004d00 msgr2=0x7fa7c8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:38.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.655+0000 7fa7e2ee0640 1 --2- 172.21.15.77:0/1181612973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7c8004d00 0x7fa7c8005180 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc001720 tx=0x7fa7c80057f0 comp rx=0 tx=0).stop 2023-11-04T01:46:38.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.655+0000 7fa7e147d640 1 -- 172.21.15.77:0/1181612973 reap_dead start 2023-11-04T01:46:38.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.655+0000 7fa7e2ee0640 1 -- 172.21.15.77:0/1181612973 shutdown_connections 2023-11-04T01:46:38.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.655+0000 7fa7e2ee0640 1 -- 172.21.15.77:0/1181612973 >> 172.21.15.77:0/1181612973 conn(0x7fa7dc0d2ef0 msgr2=0x7fa7dc0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:38.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.655+0000 7fa7e2ee0640 1 -- 172.21.15.77:0/1181612973 shutdown_connections 2023-11-04T01:46:38.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.655+0000 7fa7e2ee0640 1 -- 172.21.15.77:0/1181612973 wait complete. 2023-11-04T01:46:38.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.657+0000 7fa7e2ee0640 1 Processor -- start 2023-11-04T01:46:38.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.657+0000 7fa7e2ee0640 1 -- start start 2023-11-04T01:46:38.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.658+0000 7fa7e2ee0640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7dc155f70 0x7fa7dc1603a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:38.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.658+0000 7fa7e2ee0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7dc0ca8b0 0x7fa7dc0cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:38.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.658+0000 7fa7e2ee0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7dc0cc920 0x7fa7dc1f65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:38.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.658+0000 7fa7e2ee0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7dc1601c0 con 0x7fa7dc0ca8b0 2023-11-04T01:46:38.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.658+0000 7fa7e2ee0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7dc0b74d0 con 0x7fa7dc0cc920 2023-11-04T01:46:38.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.658+0000 7fa7e2ee0640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7dc0b77b0 con 0x7fa7dc155f70 2023-11-04T01:46:38.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.658+0000 7fa7dbfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7dc0ca8b0 0x7fa7dc0cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:38.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.658+0000 7fa7dbfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7dc0ca8b0 0x7fa7dc0cc3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44504/0 (socket says 172.21.15.77:44504) 2023-11-04T01:46:38.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.658+0000 7fa7dbfff640 1 -- 172.21.15.77:0/1802632715 learned_addr learned my addr 172.21.15.77:0/1802632715 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:38.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.658+0000 7fa7e147d640 1 --2- 172.21.15.77:0/1802632715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7dc0cc920 0x7fa7dc1f65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:38.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.658+0000 7fa7e0c7c640 1 --2- 172.21.15.77:0/1802632715 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7dc155f70 0x7fa7dc1603a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:38.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.658+0000 7fa7dbfff640 1 -- 172.21.15.77:0/1802632715 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7dc155f70 msgr2=0x7fa7dc1603a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:38.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.658+0000 7fa7dbfff640 1 --2- 172.21.15.77:0/1802632715 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7dc155f70 0x7fa7dc1603a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:38.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.658+0000 7fa7dbfff640 1 -- 172.21.15.77:0/1802632715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7dc0cc920 msgr2=0x7fa7dc1f65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:38.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.658+0000 7fa7dbfff640 1 --2- 172.21.15.77:0/1802632715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7dc0cc920 0x7fa7dc1f65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:38.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.658+0000 7fa7dbfff640 1 -- 172.21.15.77:0/1802632715 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7dc0b7a90 con 0x7fa7dc0ca8b0 2023-11-04T01:46:38.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.658+0000 7fa7e147d640 1 --2- 172.21.15.77:0/1802632715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7dc0cc920 0x7fa7dc1f65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:38.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.658+0000 7fa7dbfff640 1 --2- 172.21.15.77:0/1802632715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7dc0ca8b0 0x7fa7dc0cc3e0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fa7c40119a0 tx=0x7fa7c4011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:38.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.659+0000 7fa7d97fa640 1 -- 172.21.15.77:0/1802632715 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c400faf0 con 0x7fa7dc0ca8b0 2023-11-04T01:46:38.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.659+0000 7fa7d97fa640 1 -- 172.21.15.77:0/1802632715 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c400fc50 con 0x7fa7dc0ca8b0 2023-11-04T01:46:38.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.659+0000 7fa7e2ee0640 1 -- 172.21.15.77:0/1802632715 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7dc0b7d70 con 0x7fa7dc0ca8b0 2023-11-04T01:46:38.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.659+0000 7fa7d97fa640 1 -- 172.21.15.77:0/1802632715 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4014440 con 0x7fa7dc0ca8b0 2023-11-04T01:46:38.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.659+0000 7fa7e2ee0640 1 -- 172.21.15.77:0/1802632715 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7dc0ccda0 con 0x7fa7dc0ca8b0 2023-11-04T01:46:38.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.660+0000 7fa7e2ee0640 1 -- 172.21.15.77:0/1802632715 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7dc0684b0 con 0x7fa7dc0ca8b0 2023-11-04T01:46:38.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.660+0000 7fa7d97fa640 1 -- 172.21.15.77:0/1802632715 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa7c40145a0 con 0x7fa7dc0ca8b0 2023-11-04T01:46:38.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.660+0000 7fa7d97fa640 1 --2- 172.21.15.77:0/1802632715 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa7bc06ae70 0x7fa7bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:38.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.660+0000 7fa7d97fa640 1 -- 172.21.15.77:0/1802632715 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7781+0+0 (secure 0 0 0) 0x7fa7c408a650 con 0x7fa7dc0ca8b0 2023-11-04T01:46:38.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.661+0000 7fa7e0c7c640 1 --2- 172.21.15.77:0/1802632715 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa7bc06ae70 0x7fa7bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:38.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.661+0000 7fa7e0c7c640 1 --2- 172.21.15.77:0/1802632715 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa7bc06ae70 0x7fa7bc06d330 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fa7d40014b0 tx=0x7fa7d4009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:38.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.665+0000 7fa7d97fa640 1 -- 172.21.15.77:0/1802632715 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa7c4054f70 con 0x7fa7dc0ca8b0 2023-11-04T01:46:38.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.868+0000 7fa7e2ee0640 1 -- 172.21.15.77:0/1802632715 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7dc0d2cd0 con 0x7fa7dc0ca8b0 2023-11-04T01:46:38.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.868+0000 7fa7d97fa640 1 -- 172.21.15.77:0/1802632715 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4986 (secure 0 0 0) 0x7fa7c4058590 con 0x7fa7dc0ca8b0 2023-11-04T01:46:38.881 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:46:38.881 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":95,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8139,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2107153526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2107153526},{"type":"v1","addr":"172.21.15.77:6835","nonce":2107153526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:46:35.617199+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7977,"mds_1":6814},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6814":{"gid":6814,"name":"b","rank":1,"incarnation":88,"state":"up:active","state_seq":8,"addr":"172.21.15.122:6836/1450731169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1450731169},{"type":"v1","addr":"172.21.15.122:6836","nonce":1450731169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7977":{"gid":7977,"name":"a","rank":0,"incarnation":85,"state":"up:active","state_seq":14,"addr":"172.21.15.77:6834/3276812155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3276812155},{"type":"v1","addr":"172.21.15.77:6834","nonce":3276812155}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:46:35.617198+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:38.883 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 95 2023-11-04T01:46:38.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.870+0000 7fa7e2ee0640 1 -- 172.21.15.77:0/1802632715 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa7bc06ae70 msgr2=0x7fa7bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:38.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.870+0000 7fa7e2ee0640 1 --2- 172.21.15.77:0/1802632715 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa7bc06ae70 0x7fa7bc06d330 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fa7d40014b0 tx=0x7fa7d4009040 comp rx=0 tx=0).stop 2023-11-04T01:46:38.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.870+0000 7fa7e2ee0640 1 -- 172.21.15.77:0/1802632715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7dc0ca8b0 msgr2=0x7fa7dc0cc3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:38.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.870+0000 7fa7e2ee0640 1 --2- 172.21.15.77:0/1802632715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7dc0ca8b0 0x7fa7dc0cc3e0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fa7c40119a0 tx=0x7fa7c4011e60 comp rx=0 tx=0).stop 2023-11-04T01:46:38.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.870+0000 7fa7e2ee0640 1 -- 172.21.15.77:0/1802632715 shutdown_connections 2023-11-04T01:46:38.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.870+0000 7fa7e2ee0640 1 --2- 172.21.15.77:0/1802632715 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa7bc06ae70 0x7fa7bc06d330 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:38.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.870+0000 7fa7e2ee0640 1 --2- 172.21.15.77:0/1802632715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7dc0cc920 0x7fa7dc1f65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:38.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.870+0000 7fa7e2ee0640 1 --2- 172.21.15.77:0/1802632715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7dc0ca8b0 0x7fa7dc0cc3e0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:38.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.870+0000 7fa7e2ee0640 1 --2- 172.21.15.77:0/1802632715 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7dc155f70 0x7fa7dc1603a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:38.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.870+0000 7fa7e2ee0640 1 -- 172.21.15.77:0/1802632715 >> 172.21.15.77:0/1802632715 conn(0x7fa7dc0d2ef0 msgr2=0x7fa7dc0d14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:38.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.870+0000 7fa7e2ee0640 1 -- 172.21.15.77:0/1802632715 shutdown_connections 2023-11-04T01:46:38.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:38.870+0000 7fa7e2ee0640 1 -- 172.21.15.77:0/1802632715 wait complete. 2023-11-04T01:46:38.886 INFO:tasks.ceph.mds.b:Sent signal 9 2023-11-04T01:46:38.886 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:46:38.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:46:38.887 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 down 2023-11-04T01:46:38.914 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:46:39.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.052+0000 7fe16ddfc640 1 Processor -- start 2023-11-04T01:46:39.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.053+0000 7fe16ddfc640 1 -- start start 2023-11-04T01:46:39.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.053+0000 7fe16ddfc640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe16815d4e0 0x7fe1680d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:39.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.053+0000 7fe16ddfc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe1680d3b60 0x7fe1680d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:39.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.053+0000 7fe16ddfc640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1680b32b0 con 0x7fe16815d100 2023-11-04T01:46:39.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.053+0000 7fe16ddfc640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1680cec20 con 0x7fe1680d3b60 2023-11-04T01:46:39.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.053+0000 7fe16ddfc640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1680cee10 con 0x7fe16815d4e0 2023-11-04T01:46:39.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.053+0000 7fe167fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe1680d3b60 0x7fe1680d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:39.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.053+0000 7fe167fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe1680d3b60 0x7fe1680d1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44512/0 (socket says 172.21.15.77:44512) 2023-11-04T01:46:39.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.053+0000 7fe167fff640 1 -- 172.21.15.77:0/7579324 learned_addr learned my addr 172.21.15.77:0/7579324 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:39.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.054+0000 7fe15effd640 1 --2- 172.21.15.77:0/7579324 >> v2:172.21.15.122:3300/0 conn(0x7fe16815d4e0 0x7fe1680d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:39.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.054+0000 7fe167fff640 1 -- 172.21.15.77:0/7579324 >> v2:172.21.15.122:3300/0 conn(0x7fe16815d4e0 msgr2=0x7fe1680d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:39.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.054+0000 7fe167fff640 1 --2- 172.21.15.77:0/7579324 >> v2:172.21.15.122:3300/0 conn(0x7fe16815d4e0 0x7fe1680d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:39.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.054+0000 7fe167fff640 1 -- 172.21.15.77:0/7579324 >> v1:172.21.15.77:6789/0 conn(0x7fe16815d100 legacy=0x7fe1680ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:39.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.054+0000 7fe167fff640 1 -- 172.21.15.77:0/7579324 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1680b4750 con 0x7fe1680d3b60 2023-11-04T01:46:39.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.054+0000 7fe15effd640 1 --2- 172.21.15.77:0/7579324 >> v2:172.21.15.122:3300/0 conn(0x7fe16815d4e0 0x7fe1680d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:39.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.054+0000 7fe167fff640 1 --2- 172.21.15.77:0/7579324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1680d3b60 0x7fe1680d1a10 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fe168160da0 tx=0x7fe16002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f58beb0593dcf1a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:39.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.055+0000 7fe166ffd640 1 -- 172.21.15.77:0/7579324 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16002cb20 con 0x7fe1680d3b60 2023-11-04T01:46:39.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.055+0000 7fe166ffd640 1 -- 172.21.15.77:0/7579324 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16002cc80 con 0x7fe1680d3b60 2023-11-04T01:46:39.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.055+0000 7fe166ffd640 1 -- 172.21.15.77:0/7579324 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1600343f0 con 0x7fe1680d3b60 2023-11-04T01:46:39.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.055+0000 7fe16ddfc640 1 -- 172.21.15.77:0/7579324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1680d3b60 msgr2=0x7fe1680d1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:39.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.055+0000 7fe16ddfc640 1 --2- 172.21.15.77:0/7579324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1680d3b60 0x7fe1680d1a10 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fe168160da0 tx=0x7fe16002bf80 comp rx=0 tx=0).stop 2023-11-04T01:46:39.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.055+0000 7fe16ddfc640 1 -- 172.21.15.77:0/7579324 shutdown_connections 2023-11-04T01:46:39.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.055+0000 7fe16ddfc640 1 --2- 172.21.15.77:0/7579324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1680d3b60 0x7fe1680d1a10 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:39.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.055+0000 7fe16ddfc640 1 --2- 172.21.15.77:0/7579324 >> v2:172.21.15.122:3300/0 conn(0x7fe16815d4e0 0x7fe1680d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:39.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.055+0000 7fe16ddfc640 1 -- 172.21.15.77:0/7579324 >> 172.21.15.77:0/7579324 conn(0x7fe1680d2ef0 msgr2=0x7fe1680d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:39.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.055+0000 7fe16ddfc640 1 -- 172.21.15.77:0/7579324 shutdown_connections 2023-11-04T01:46:39.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.055+0000 7fe16ddfc640 1 -- 172.21.15.77:0/7579324 wait complete. 2023-11-04T01:46:39.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.056+0000 7fe16ddfc640 1 Processor -- start 2023-11-04T01:46:39.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.057+0000 7fe16ddfc640 1 -- start start 2023-11-04T01:46:39.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.057+0000 7fe16ddfc640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe1680d3b60 0x7fe168151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:39.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.057+0000 7fe16ddfc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe16815d100 0x7fe1680ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:39.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.057+0000 7fe16ddfc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe16815d4e0 0x7fe1680b8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:39.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.057+0000 7fe16ddfc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1680cc820 con 0x7fe16815d100 2023-11-04T01:46:39.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.057+0000 7fe16ddfc640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1680cd180 con 0x7fe16815d4e0 2023-11-04T01:46:39.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.057+0000 7fe16ddfc640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1680cb730 con 0x7fe1680d3b60 2023-11-04T01:46:39.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.057+0000 7fe15effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe16815d100 0x7fe1680ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:39.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.057+0000 7fe15effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe16815d100 0x7fe1680ccc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44514/0 (socket says 172.21.15.77:44514) 2023-11-04T01:46:39.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.057+0000 7fe15effd640 1 -- 172.21.15.77:0/2237312691 learned_addr learned my addr 172.21.15.77:0/2237312691 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:39.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.058+0000 7fe167fff640 1 --2- 172.21.15.77:0/2237312691 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe16815d4e0 0x7fe1680b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:39.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.058+0000 7fe1677fe640 1 --2- 172.21.15.77:0/2237312691 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe1680d3b60 0x7fe168151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:39.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.058+0000 7fe15effd640 1 -- 172.21.15.77:0/2237312691 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe1680d3b60 msgr2=0x7fe168151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:39.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.058+0000 7fe15effd640 1 --2- 172.21.15.77:0/2237312691 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe1680d3b60 0x7fe168151470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:39.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.058+0000 7fe15effd640 1 -- 172.21.15.77:0/2237312691 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe16815d4e0 msgr2=0x7fe1680b8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:39.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.058+0000 7fe15effd640 1 --2- 172.21.15.77:0/2237312691 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe16815d4e0 0x7fe1680b8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:39.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.058+0000 7fe15effd640 1 -- 172.21.15.77:0/2237312691 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe160009b30 con 0x7fe16815d100 2023-11-04T01:46:39.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.058+0000 7fe15effd640 1 --2- 172.21.15.77:0/2237312691 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe16815d100 0x7fe1680ccc40 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fe15000c7c0 tx=0x7fe15000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:39.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.058+0000 7fe164ff9640 1 -- 172.21.15.77:0/2237312691 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1500077c0 con 0x7fe16815d100 2023-11-04T01:46:39.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.058+0000 7fe164ff9640 1 -- 172.21.15.77:0/2237312691 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe150007920 con 0x7fe16815d100 2023-11-04T01:46:39.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.058+0000 7fe164ff9640 1 -- 172.21.15.77:0/2237312691 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe150007cb0 con 0x7fe16815d100 2023-11-04T01:46:39.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.058+0000 7fe16ddfc640 1 -- 172.21.15.77:0/2237312691 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1680cb980 con 0x7fe16815d100 2023-11-04T01:46:39.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.058+0000 7fe16ddfc640 1 -- 172.21.15.77:0/2237312691 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1680cc160 con 0x7fe16815d100 2023-11-04T01:46:39.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.059+0000 7fe16ddfc640 1 -- 172.21.15.77:0/2237312691 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1680cc960 con 0x7fe16815d100 2023-11-04T01:46:39.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.060+0000 7fe164ff9640 1 -- 172.21.15.77:0/2237312691 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe1500113f0 con 0x7fe16815d100 2023-11-04T01:46:39.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.060+0000 7fe164ff9640 1 --2- 172.21.15.77:0/2237312691 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe14806ae70 0x7fe14806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:39.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.060+0000 7fe164ff9640 1 -- 172.21.15.77:0/2237312691 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7781+0+0 (secure 0 0 0) 0x7fe150089f40 con 0x7fe16815d100 2023-11-04T01:46:39.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.060+0000 7fe1677fe640 1 --2- 172.21.15.77:0/2237312691 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe14806ae70 0x7fe14806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:39.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.061+0000 7fe1677fe640 1 --2- 172.21.15.77:0/2237312691 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe14806ae70 0x7fe14806d330 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe158000fd0 tx=0x7fe158009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:39.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.064+0000 7fe164ff9640 1 -- 172.21.15.77:0/2237312691 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe150054740 con 0x7fe16815d100 2023-11-04T01:46:39.087 INFO:tasks.ceph.mds.b.smithi122.stderr:daemon-helper: command crashed with signal 9 2023-11-04T01:46:39.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.297+0000 7fe16ddfc640 1 -- 172.21.15.77:0/2237312691 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7fe1680684b0 con 0x7fe16815d100 2023-11-04T01:46:39.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.300+0000 7fe164ff9640 1 -- 172.21.15.77:0/2237312691 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 7977 v96) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe15001f070 con 0x7fe16815d100 2023-11-04T01:46:39.301 INFO:teuthology.orchestra.run.smithi077.stderr:failed mds gid 7977 2023-11-04T01:46:39.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.301+0000 7fe16ddfc640 1 -- 172.21.15.77:0/2237312691 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe14806ae70 msgr2=0x7fe14806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:39.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.301+0000 7fe16ddfc640 1 --2- 172.21.15.77:0/2237312691 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe14806ae70 0x7fe14806d330 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe158000fd0 tx=0x7fe158009040 comp rx=0 tx=0).stop 2023-11-04T01:46:39.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.301+0000 7fe16ddfc640 1 -- 172.21.15.77:0/2237312691 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe16815d100 msgr2=0x7fe1680ccc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:39.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.301+0000 7fe16ddfc640 1 --2- 172.21.15.77:0/2237312691 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe16815d100 0x7fe1680ccc40 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fe15000c7c0 tx=0x7fe15000cc80 comp rx=0 tx=0).stop 2023-11-04T01:46:39.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.301+0000 7fe16ddfc640 1 -- 172.21.15.77:0/2237312691 shutdown_connections 2023-11-04T01:46:39.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.301+0000 7fe16ddfc640 1 --2- 172.21.15.77:0/2237312691 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe14806ae70 0x7fe14806d330 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:39.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.301+0000 7fe16ddfc640 1 --2- 172.21.15.77:0/2237312691 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe16815d4e0 0x7fe1680b8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:39.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.301+0000 7fe16ddfc640 1 --2- 172.21.15.77:0/2237312691 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe16815d100 0x7fe1680ccc40 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:39.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.301+0000 7fe16ddfc640 1 --2- 172.21.15.77:0/2237312691 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe1680d3b60 0x7fe168151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:39.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.301+0000 7fe16ddfc640 1 -- 172.21.15.77:0/2237312691 >> 172.21.15.77:0/2237312691 conn(0x7fe1680d2ef0 msgr2=0x7fe1680b1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:39.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.302+0000 7fe16ddfc640 1 -- 172.21.15.77:0/2237312691 shutdown_connections 2023-11-04T01:46:39.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.302+0000 7fe16ddfc640 1 -- 172.21.15.77:0/2237312691 wait complete. 2023-11-04T01:46:39.317 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:46:39.318 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:46:39.318 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:46:39.319 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:46:39.319 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:46:39.319 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi077 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2023-11-04T01:46:39.320 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:46:39.320 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:46:39.323 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:46:39.324 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:39.397 INFO:tasks.ceph.mds.a.smithi077.stdout:starting mds.a at 2023-11-04T01:46:39.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.422+0000 7f1c1ff2c640 1 Processor -- start 2023-11-04T01:46:39.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.423+0000 7f1c1ff2c640 1 -- start start 2023-11-04T01:46:39.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.423+0000 7f1c1ff2c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1c180cb680 0x7f1c180cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:39.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.423+0000 7f1c1ff2c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1c1815afb0 0x7f1c180cba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:39.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.423+0000 7f1c1ff2c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c1815ea20 con 0x7f1c181597a0 2023-11-04T01:46:39.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.423+0000 7f1c1ff2c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c1815b520 con 0x7f1c1815afb0 2023-11-04T01:46:39.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.423+0000 7f1c1ff2c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c180cbfa0 con 0x7f1c180cb680 2023-11-04T01:46:39.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.424+0000 7f1c1dcc8640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1c180cb680 0x7f1c180cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:39.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.424+0000 7f1c1d4c7640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1c1815afb0 0x7f1c180cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:39.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.424+0000 7f1c1dcc8640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1c180cb680 0x7f1c180cf470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:55048/0 (socket says 172.21.15.77:55048) 2023-11-04T01:46:39.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.424+0000 7f1c1dcc8640 1 -- 172.21.15.77:0/3985357835 learned_addr learned my addr 172.21.15.77:0/3985357835 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:39.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.424+0000 7f1c1dcc8640 1 -- 172.21.15.77:0/3985357835 >> v2:172.21.15.122:3300/0 conn(0x7f1c1815afb0 msgr2=0x7f1c180cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:39.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.424+0000 7f1c1dcc8640 1 --2- 172.21.15.77:0/3985357835 >> v2:172.21.15.122:3300/0 conn(0x7f1c1815afb0 0x7f1c180cba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:39.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.424+0000 7f1c1dcc8640 1 -- 172.21.15.77:0/3985357835 >> v1:172.21.15.122:6789/0 conn(0x7f1c181597a0 legacy=0x7f1c18159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:39.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.424+0000 7f1c1dcc8640 1 -- 172.21.15.77:0/3985357835 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1815dc60 con 0x7f1c180cb680 2023-11-04T01:46:39.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.425+0000 7f1c1dcc8640 1 --2- 172.21.15.77:0/3985357835 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1c180cb680 0x7f1c180cf470 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400bb10 tx=0x7f1c1402e0c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d99e1e10d12722c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:39.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.425+0000 7f1c1ccc6640 1 -- 172.21.15.77:0/3985357835 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1402ee70 con 0x7f1c180cb680 2023-11-04T01:46:39.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.425+0000 7f1c1ccc6640 1 -- 172.21.15.77:0/3985357835 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c14036440 con 0x7f1c180cb680 2023-11-04T01:46:39.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.425+0000 7f1c1ccc6640 1 -- 172.21.15.77:0/3985357835 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c140367d0 con 0x7f1c180cb680 2023-11-04T01:46:39.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.426+0000 7f1c1ff2c640 1 -- 172.21.15.77:0/3985357835 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1c180cb680 msgr2=0x7f1c180cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:39.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.426+0000 7f1c1ff2c640 1 --2- 172.21.15.77:0/3985357835 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1c180cb680 0x7f1c180cf470 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400bb10 tx=0x7f1c1402e0c0 comp rx=0 tx=0).stop 2023-11-04T01:46:39.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.426+0000 7f1c1ff2c640 1 -- 172.21.15.77:0/3985357835 shutdown_connections 2023-11-04T01:46:39.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.426+0000 7f1c1ff2c640 1 --2- 172.21.15.77:0/3985357835 >> v2:172.21.15.122:3300/0 conn(0x7f1c1815afb0 0x7f1c180cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:39.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.426+0000 7f1c1ff2c640 1 --2- 172.21.15.77:0/3985357835 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1c180cb680 0x7f1c180cf470 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:39.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.426+0000 7f1c1ff2c640 1 -- 172.21.15.77:0/3985357835 >> 172.21.15.77:0/3985357835 conn(0x7f1c180b1640 msgr2=0x7f1c180b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:39.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.426+0000 7f1c1ff2c640 1 -- 172.21.15.77:0/3985357835 shutdown_connections 2023-11-04T01:46:39.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.426+0000 7f1c1ff2c640 1 -- 172.21.15.77:0/3985357835 wait complete. 2023-11-04T01:46:39.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.427+0000 7f1c1ff2c640 1 Processor -- start 2023-11-04T01:46:39.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.427+0000 7f1c1ff2c640 1 -- start start 2023-11-04T01:46:39.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.428+0000 7f1c1ff2c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c180cb680 0x7f1c18154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:39.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.428+0000 7f1c1ff2c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c181597a0 0x7f1c1814e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:39.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.428+0000 7f1c1ff2c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1c1815afb0 0x7f1c181537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:39.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.428+0000 7f1c1ff2c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c181533b0 con 0x7f1c180cb680 2023-11-04T01:46:39.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.428+0000 7f1c1ff2c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1814f480 con 0x7f1c181597a0 2023-11-04T01:46:39.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.428+0000 7f1c1ff2c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1814e9d0 con 0x7f1c1815afb0 2023-11-04T01:46:39.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.428+0000 7f1c1dcc8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c180cb680 0x7f1c18154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:39.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.428+0000 7f1c1dcc8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c180cb680 0x7f1c18154450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44536/0 (socket says 172.21.15.77:44536) 2023-11-04T01:46:39.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.428+0000 7f1c1dcc8640 1 -- 172.21.15.77:0/703554155 learned_addr learned my addr 172.21.15.77:0/703554155 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:39.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.428+0000 7f1c1e4c9640 1 --2- 172.21.15.77:0/703554155 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1c1815afb0 0x7f1c181537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:39.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.428+0000 7f1c1d4c7640 1 --2- 172.21.15.77:0/703554155 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c181597a0 0x7f1c1814e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:39.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.428+0000 7f1c1dcc8640 1 -- 172.21.15.77:0/703554155 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1c1815afb0 msgr2=0x7f1c181537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:39.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.428+0000 7f1c1dcc8640 1 --2- 172.21.15.77:0/703554155 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1c1815afb0 0x7f1c181537d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:39.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.428+0000 7f1c1dcc8640 1 -- 172.21.15.77:0/703554155 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c181597a0 msgr2=0x7f1c1814e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:39.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.428+0000 7f1c1dcc8640 1 --2- 172.21.15.77:0/703554155 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c181597a0 0x7f1c1814e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:39.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.428+0000 7f1c1dcc8640 1 -- 172.21.15.77:0/703554155 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1400b770 con 0x7f1c180cb680 2023-11-04T01:46:39.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.428+0000 7f1c1dcc8640 1 --2- 172.21.15.77:0/703554155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c180cb680 0x7f1c18154450 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400ba60 tx=0x7f1c140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:39.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.428+0000 7f1c0e7fc640 1 -- 172.21.15.77:0/703554155 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c14041830 con 0x7f1c180cb680 2023-11-04T01:46:39.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.429+0000 7f1c0e7fc640 1 -- 172.21.15.77:0/703554155 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c140419b0 con 0x7f1c180cb680 2023-11-04T01:46:39.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.429+0000 7f1c1ff2c640 1 -- 172.21.15.77:0/703554155 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c18154b50 con 0x7f1c180cb680 2023-11-04T01:46:39.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.429+0000 7f1c0e7fc640 1 -- 172.21.15.77:0/703554155 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c14041d60 con 0x7f1c180cb680 2023-11-04T01:46:39.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.429+0000 7f1c1ff2c640 1 -- 172.21.15.77:0/703554155 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c18155110 con 0x7f1c180cb680 2023-11-04T01:46:39.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.429+0000 7f1c1ff2c640 1 -- 172.21.15.77:0/703554155 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c18153620 con 0x7f1c180cb680 2023-11-04T01:46:39.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.430+0000 7f1c0e7fc640 1 -- 172.21.15.77:0/703554155 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1c1403d040 con 0x7f1c180cb680 2023-11-04T01:46:39.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.430+0000 7f1c0e7fc640 1 --2- 172.21.15.77:0/703554155 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1bfc06ae70 0x7f1bfc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:39.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.430+0000 7f1c0e7fc640 1 -- 172.21.15.77:0/703554155 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7823+0+0 (secure 0 0 0) 0x7f1c140aea50 con 0x7f1c180cb680 2023-11-04T01:46:39.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.430+0000 7f1c1d4c7640 1 --2- 172.21.15.77:0/703554155 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1bfc06ae70 0x7f1bfc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:39.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.431+0000 7f1c1d4c7640 1 --2- 172.21.15.77:0/703554155 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1bfc06ae70 0x7f1bfc06d330 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f1c1815ab50 tx=0x7f1c08009190 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:39.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.434+0000 7f1c0e7fc640 1 -- 172.21.15.77:0/703554155 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1c14079370 con 0x7f1c180cb680 2023-11-04T01:46:39.608 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~13s 2023-11-04T01:46:39.608 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-11-04T01:46:39.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.634+0000 7f1c1ff2c640 1 -- 172.21.15.77:0/703554155 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c1815df40 con 0x7f1c180cb680 2023-11-04T01:46:39.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.635+0000 7f1c0e7fc640 1 -- 172.21.15.77:0/703554155 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+4146 (secure 0 0 0) 0x7f1c1407c990 con 0x7f1c180cb680 2023-11-04T01:46:39.637 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:46:39.637 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":97,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":97,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:46:39.305968+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8139,"mds_1":6814},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6814":{"gid":6814,"name":"b","rank":1,"incarnation":88,"state":"up:active","state_seq":8,"addr":"172.21.15.122:6836/1450731169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1450731169},{"type":"v1","addr":"172.21.15.122:6836","nonce":1450731169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8139":{"gid":8139,"name":"c","rank":0,"incarnation":97,"state":"up:replay","state_seq":1,"addr":"172.21.15.77:6835/2107153526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2107153526},{"type":"v1","addr":"172.21.15.77:6835","nonce":2107153526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:39.637 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 97 2023-11-04T01:46:39.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.637+0000 7f1c1ff2c640 1 -- 172.21.15.77:0/703554155 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1bfc06ae70 msgr2=0x7f1bfc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:39.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.637+0000 7f1c1ff2c640 1 --2- 172.21.15.77:0/703554155 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1bfc06ae70 0x7f1bfc06d330 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f1c1815ab50 tx=0x7f1c08009190 comp rx=0 tx=0).stop 2023-11-04T01:46:39.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.637+0000 7f1c1ff2c640 1 -- 172.21.15.77:0/703554155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c180cb680 msgr2=0x7f1c18154450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:39.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.637+0000 7f1c1ff2c640 1 --2- 172.21.15.77:0/703554155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c180cb680 0x7f1c18154450 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400ba60 tx=0x7f1c140046c0 comp rx=0 tx=0).stop 2023-11-04T01:46:39.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.637+0000 7f1c1ff2c640 1 -- 172.21.15.77:0/703554155 shutdown_connections 2023-11-04T01:46:39.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.637+0000 7f1c1ff2c640 1 --2- 172.21.15.77:0/703554155 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1bfc06ae70 0x7f1bfc06d330 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:39.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.637+0000 7f1c1ff2c640 1 --2- 172.21.15.77:0/703554155 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1c1815afb0 0x7f1c181537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:39.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.637+0000 7f1c1ff2c640 1 --2- 172.21.15.77:0/703554155 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c181597a0 0x7f1c1814e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:39.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.637+0000 7f1c1ff2c640 1 --2- 172.21.15.77:0/703554155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c180cb680 0x7f1c18154450 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:39.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.637+0000 7f1c1ff2c640 1 -- 172.21.15.77:0/703554155 >> 172.21.15.77:0/703554155 conn(0x7f1c180b1640 msgr2=0x7f1c1806a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:39.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.637+0000 7f1c1ff2c640 1 -- 172.21.15.77:0/703554155 shutdown_connections 2023-11-04T01:46:39.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:39.637+0000 7f1c1ff2c640 1 -- 172.21.15.77:0/703554155 wait complete. 2023-11-04T01:46:39.649 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:46:44.650 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:44.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.761+0000 7f61c6e32640 1 Processor -- start 2023-11-04T01:46:44.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.761+0000 7f61c6e32640 1 -- start start 2023-11-04T01:46:44.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.762+0000 7f61c6e32640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f61c00addd0 0x7f61c00cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:44.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.762+0000 7f61c6e32640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f61c006c220 0x7f61c00ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:44.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.762+0000 7f61c6e32640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c00cd720 con 0x7f61c00cc680 2023-11-04T01:46:44.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.762+0000 7f61c6e32640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c00ae1b0 con 0x7f61c006c220 2023-11-04T01:46:44.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.762+0000 7f61c6e32640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c00ccb10 con 0x7f61c00addd0 2023-11-04T01:46:44.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.762+0000 7f61bffff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f61c00cc680 0x7f61c006bb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40576/0 (socket says 172.21.15.77:40576) 2023-11-04T01:46:44.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.762+0000 7f61bffff640 1 -- 172.21.15.77:0/2169218449 learned_addr learned my addr 172.21.15.77:0/2169218449 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:46:44.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.762+0000 7f61c53cf640 1 --2- 172.21.15.77:0/2169218449 >> v2:172.21.15.77:3300/0 conn(0x7f61c006c220 0x7f61c00ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:44.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.762+0000 7f61c4bce640 1 --2- 172.21.15.77:0/2169218449 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f61c00addd0 0x7f61c00cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:44.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.762+0000 7f61bf7fe640 1 -- 172.21.15.77:0/2169218449 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1749430598 0 0) 0x7f61c00cd720 con 0x7f61c00cc680 2023-11-04T01:46:44.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.762+0000 7f61bf7fe640 1 -- 172.21.15.77:0/2169218449 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61b0003520 con 0x7f61c00cc680 2023-11-04T01:46:44.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.762+0000 7f61c53cf640 1 -- 172.21.15.77:0/2169218449 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f61c00addd0 msgr2=0x7f61c00cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:44.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.762+0000 7f61c53cf640 1 --2- 172.21.15.77:0/2169218449 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f61c00addd0 0x7f61c00cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:44.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.762+0000 7f61c53cf640 1 -- 172.21.15.77:0/2169218449 >> v1:172.21.15.77:6789/0 conn(0x7f61c00cc680 legacy=0x7f61c006bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:44.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.762+0000 7f61c53cf640 1 -- 172.21.15.77:0/2169218449 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c00ccdf0 con 0x7f61c006c220 2023-11-04T01:46:44.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.763+0000 7f61c53cf640 1 --2- 172.21.15.77:0/2169218449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61c006c220 0x7f61c00ca2d0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f61b8009d90 tx=0x7f61b802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=788108e2dcda7e78 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:44.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.763+0000 7f61bf7fe640 1 -- 172.21.15.77:0/2169218449 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b802cc50 con 0x7f61c006c220 2023-11-04T01:46:44.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.763+0000 7f61bf7fe640 1 -- 172.21.15.77:0/2169218449 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b802cdb0 con 0x7f61c006c220 2023-11-04T01:46:44.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.763+0000 7f61bf7fe640 1 -- 172.21.15.77:0/2169218449 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b8034660 con 0x7f61c006c220 2023-11-04T01:46:44.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.764+0000 7f61c6e32640 1 -- 172.21.15.77:0/2169218449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61c006c220 msgr2=0x7f61c00ca2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:44.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.764+0000 7f61c6e32640 1 --2- 172.21.15.77:0/2169218449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61c006c220 0x7f61c00ca2d0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f61b8009d90 tx=0x7f61b802bea0 comp rx=0 tx=0).stop 2023-11-04T01:46:44.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.764+0000 7f61c6e32640 1 -- 172.21.15.77:0/2169218449 shutdown_connections 2023-11-04T01:46:44.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.764+0000 7f61c6e32640 1 --2- 172.21.15.77:0/2169218449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61c006c220 0x7f61c00ca2d0 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:44.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.764+0000 7f61c6e32640 1 --2- 172.21.15.77:0/2169218449 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f61c00addd0 0x7f61c00cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:44.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.764+0000 7f61c6e32640 1 -- 172.21.15.77:0/2169218449 >> 172.21.15.77:0/2169218449 conn(0x7f61c00cb530 msgr2=0x7f61c00cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:44.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.764+0000 7f61c6e32640 1 -- 172.21.15.77:0/2169218449 shutdown_connections 2023-11-04T01:46:44.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.764+0000 7f61c6e32640 1 -- 172.21.15.77:0/2169218449 wait complete. 2023-11-04T01:46:44.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.765+0000 7f61c6e32640 1 Processor -- start 2023-11-04T01:46:44.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.765+0000 7f61c6e32640 1 -- start start 2023-11-04T01:46:44.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.766+0000 7f61c6e32640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61c006c220 0x7f61c014d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:44.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.766+0000 7f61c6e32640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f61c00addd0 0x7f61c00b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:44.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.766+0000 7f61c6e32640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61c00c7340 0x7f61c00c32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:44.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.766+0000 7f61c6e32640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c00c25c0 con 0x7f61c006c220 2023-11-04T01:46:44.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.766+0000 7f61c6e32640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c014dec0 con 0x7f61c00c7340 2023-11-04T01:46:44.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.766+0000 7f61c6e32640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c00b2fd0 con 0x7f61c00addd0 2023-11-04T01:46:44.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.766+0000 7f61c4bce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61c006c220 0x7f61c014d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:44.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.766+0000 7f61c4bce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61c006c220 0x7f61c014d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44544/0 (socket says 172.21.15.77:44544) 2023-11-04T01:46:44.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.766+0000 7f61c4bce640 1 -- 172.21.15.77:0/1195814700 learned_addr learned my addr 172.21.15.77:0/1195814700 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:44.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.766+0000 7f61bffff640 1 --2- 172.21.15.77:0/1195814700 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f61c00addd0 0x7f61c00b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:44.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.766+0000 7f61c53cf640 1 --2- 172.21.15.77:0/1195814700 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61c00c7340 0x7f61c00c32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:44.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.766+0000 7f61c4bce640 1 -- 172.21.15.77:0/1195814700 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f61c00addd0 msgr2=0x7f61c00b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:44.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.766+0000 7f61c4bce640 1 --2- 172.21.15.77:0/1195814700 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f61c00addd0 0x7f61c00b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:44.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.766+0000 7f61c4bce640 1 -- 172.21.15.77:0/1195814700 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61c00c7340 msgr2=0x7f61c00c32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:44.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.766+0000 7f61c4bce640 1 --2- 172.21.15.77:0/1195814700 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61c00c7340 0x7f61c00c32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:44.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.766+0000 7f61c4bce640 1 -- 172.21.15.77:0/1195814700 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b8009a70 con 0x7f61c006c220 2023-11-04T01:46:44.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.766+0000 7f61bffff640 1 --2- 172.21.15.77:0/1195814700 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f61c00addd0 0x7f61c00b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:44.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.767+0000 7f61c4bce640 1 --2- 172.21.15.77:0/1195814700 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61c006c220 0x7f61c014d980 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f61b400e910 tx=0x7f61b400edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:44.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.767+0000 7f61bd7fa640 1 -- 172.21.15.77:0/1195814700 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b400cc40 con 0x7f61c006c220 2023-11-04T01:46:44.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.767+0000 7f61bd7fa640 1 -- 172.21.15.77:0/1195814700 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b400cda0 con 0x7f61c006c220 2023-11-04T01:46:44.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.767+0000 7f61c6e32640 1 -- 172.21.15.77:0/1195814700 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61c014e120 con 0x7f61c006c220 2023-11-04T01:46:44.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.767+0000 7f61bd7fa640 1 -- 172.21.15.77:0/1195814700 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b4011610 con 0x7f61c006c220 2023-11-04T01:46:44.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.767+0000 7f61c6e32640 1 -- 172.21.15.77:0/1195814700 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c00c2ab0 con 0x7f61c006c220 2023-11-04T01:46:44.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.768+0000 7f61c6e32640 1 -- 172.21.15.77:0/1195814700 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61c00684b0 con 0x7f61c006c220 2023-11-04T01:46:44.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.768+0000 7f61bd7fa640 1 -- 172.21.15.77:0/1195814700 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f61b4011770 con 0x7f61c006c220 2023-11-04T01:46:44.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.769+0000 7f61bd7fa640 1 --2- 172.21.15.77:0/1195814700 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f61a406ae70 0x7f61a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:44.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.769+0000 7f61bd7fa640 1 -- 172.21.15.77:0/1195814700 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7823+0+0 (secure 0 0 0) 0x7f61b4089c70 con 0x7f61c006c220 2023-11-04T01:46:44.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.769+0000 7f61bffff640 1 --2- 172.21.15.77:0/1195814700 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f61a406ae70 0x7f61a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:44.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.769+0000 7f61bffff640 1 --2- 172.21.15.77:0/1195814700 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f61a406ae70 0x7f61a406d330 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f61c00b4080 tx=0x7f61ac009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:44.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.773+0000 7f61bd7fa640 1 -- 172.21.15.77:0/1195814700 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f61b40544e0 con 0x7f61c006c220 2023-11-04T01:46:44.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.973+0000 7f61c6e32640 1 -- 172.21.15.77:0/1195814700 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61c00c20e0 con 0x7f61c006c220 2023-11-04T01:46:44.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.973+0000 7f61bd7fa640 1 -- 172.21.15.77:0/1195814700 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4939 (secure 0 0 0) 0x7f61b4016020 con 0x7f61c006c220 2023-11-04T01:46:44.975 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:46:44.975 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":98,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/4183807043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4183807043},{"type":"v1","addr":"172.21.15.77:6834","nonce":4183807043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:46:39.322774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8139,"mds_1":6814},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6814":{"gid":6814,"name":"b","rank":1,"incarnation":88,"state":"up:active","state_seq":8,"addr":"172.21.15.122:6836/1450731169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1450731169},{"type":"v1","addr":"172.21.15.122:6836","nonce":1450731169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8139":{"gid":8139,"name":"c","rank":0,"incarnation":97,"state":"up:resolve","state_seq":11,"addr":"172.21.15.77:6835/2107153526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2107153526},{"type":"v1","addr":"172.21.15.77:6835","nonce":2107153526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:44.976 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 98 2023-11-04T01:46:44.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.975+0000 7f61c6e32640 1 -- 172.21.15.77:0/1195814700 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f61a406ae70 msgr2=0x7f61a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:44.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.975+0000 7f61c6e32640 1 --2- 172.21.15.77:0/1195814700 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f61a406ae70 0x7f61a406d330 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f61c00b4080 tx=0x7f61ac009040 comp rx=0 tx=0).stop 2023-11-04T01:46:44.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.975+0000 7f61c6e32640 1 -- 172.21.15.77:0/1195814700 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61c006c220 msgr2=0x7f61c014d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:44.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.975+0000 7f61c6e32640 1 --2- 172.21.15.77:0/1195814700 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61c006c220 0x7f61c014d980 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f61b400e910 tx=0x7f61b400edd0 comp rx=0 tx=0).stop 2023-11-04T01:46:44.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.975+0000 7f61c6e32640 1 -- 172.21.15.77:0/1195814700 shutdown_connections 2023-11-04T01:46:44.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.975+0000 7f61c6e32640 1 --2- 172.21.15.77:0/1195814700 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f61a406ae70 0x7f61a406d330 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:44.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.975+0000 7f61c6e32640 1 --2- 172.21.15.77:0/1195814700 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61c00c7340 0x7f61c00c32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:44.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.975+0000 7f61c6e32640 1 --2- 172.21.15.77:0/1195814700 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f61c00addd0 0x7f61c00b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:44.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.975+0000 7f61c6e32640 1 --2- 172.21.15.77:0/1195814700 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61c006c220 0x7f61c014d980 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:44.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.975+0000 7f61c6e32640 1 -- 172.21.15.77:0/1195814700 >> 172.21.15.77:0/1195814700 conn(0x7f61c00cb530 msgr2=0x7f61c0158e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:44.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.975+0000 7f61c6e32640 1 -- 172.21.15.77:0/1195814700 shutdown_connections 2023-11-04T01:46:44.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:44.975+0000 7f61c6e32640 1 -- 172.21.15.77:0/1195814700 wait complete. 2023-11-04T01:46:44.987 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:46:44.988 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:45.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.086+0000 7f05bef89640 1 Processor -- start 2023-11-04T01:46:45.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.086+0000 7f05bef89640 1 -- start start 2023-11-04T01:46:45.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.087+0000 7f05bef89640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f05b815d100 0x7f05b80ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:45.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.087+0000 7f05bef89640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f05b815d4e0 0x7f05b80d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:45.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.087+0000 7f05bef89640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f05b80d3b60 0x7f05b80d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:45.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.087+0000 7f05bef89640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b80b32b0 con 0x7f05b815d4e0 2023-11-04T01:46:45.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.087+0000 7f05bef89640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b80cee10 con 0x7f05b815d100 2023-11-04T01:46:45.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.087+0000 7f05bef89640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b80b2980 con 0x7f05b80d3b60 2023-11-04T01:46:45.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.087+0000 7f05b7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f05b815d4e0 0x7f05b80d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:45.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.087+0000 7f05b7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f05b815d4e0 0x7f05b80d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44552/0 (socket says 172.21.15.77:44552) 2023-11-04T01:46:45.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.087+0000 7f05b7fff640 1 -- 172.21.15.77:0/777920860 learned_addr learned my addr 172.21.15.77:0/777920860 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:45.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.088+0000 7f05bd526640 1 --2- 172.21.15.77:0/777920860 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f05b80d3b60 0x7f05b80d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:45.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.088+0000 7f05bcd25640 1 --2- 172.21.15.77:0/777920860 >> v2:172.21.15.122:3300/0 conn(0x7f05b815d100 0x7f05b80ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:45.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.088+0000 7f05b7fff640 1 -- 172.21.15.77:0/777920860 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f05b80d3b60 msgr2=0x7f05b80d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:45.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.088+0000 7f05b7fff640 1 --2- 172.21.15.77:0/777920860 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f05b80d3b60 0x7f05b80d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.088+0000 7f05b7fff640 1 -- 172.21.15.77:0/777920860 >> v2:172.21.15.122:3300/0 conn(0x7f05b815d100 msgr2=0x7f05b80ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:45.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.088+0000 7f05b7fff640 1 --2- 172.21.15.77:0/777920860 >> v2:172.21.15.122:3300/0 conn(0x7f05b815d100 0x7f05b80ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.088+0000 7f05b7fff640 1 -- 172.21.15.77:0/777920860 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b80b2c60 con 0x7f05b815d4e0 2023-11-04T01:46:45.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.088+0000 7f05bd526640 1 --2- 172.21.15.77:0/777920860 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f05b80d3b60 0x7f05b80d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:45.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.088+0000 7f05bcd25640 1 --2- 172.21.15.77:0/777920860 >> v2:172.21.15.122:3300/0 conn(0x7f05b815d100 0x7f05b80ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:45.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.088+0000 7f05b7fff640 1 --2- 172.21.15.77:0/777920860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05b815d4e0 0x7f05b80d14d0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f05b80d09f0 tx=0x7f05ac02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc0abe9e5aa90364 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:45.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.089+0000 7f05b77fe640 1 -- 172.21.15.77:0/777920860 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac031860 con 0x7f05b815d4e0 2023-11-04T01:46:45.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.089+0000 7f05b77fe640 1 -- 172.21.15.77:0/777920860 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ac0319c0 con 0x7f05b815d4e0 2023-11-04T01:46:45.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.089+0000 7f05b77fe640 1 -- 172.21.15.77:0/777920860 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac031d50 con 0x7f05b815d4e0 2023-11-04T01:46:45.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.089+0000 7f05bef89640 1 -- 172.21.15.77:0/777920860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05b815d4e0 msgr2=0x7f05b80d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:45.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.089+0000 7f05bef89640 1 --2- 172.21.15.77:0/777920860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05b815d4e0 0x7f05b80d14d0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f05b80d09f0 tx=0x7f05ac02b900 comp rx=0 tx=0).stop 2023-11-04T01:46:45.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.089+0000 7f05bef89640 1 -- 172.21.15.77:0/777920860 shutdown_connections 2023-11-04T01:46:45.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.089+0000 7f05bef89640 1 --2- 172.21.15.77:0/777920860 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f05b80d3b60 0x7f05b80d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.089+0000 7f05bef89640 1 --2- 172.21.15.77:0/777920860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05b815d4e0 0x7f05b80d14d0 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.089+0000 7f05bef89640 1 --2- 172.21.15.77:0/777920860 >> v2:172.21.15.122:3300/0 conn(0x7f05b815d100 0x7f05b80ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.089+0000 7f05bef89640 1 -- 172.21.15.77:0/777920860 >> 172.21.15.77:0/777920860 conn(0x7f05b80d2ef0 msgr2=0x7f05b80d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:45.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.089+0000 7f05bef89640 1 -- 172.21.15.77:0/777920860 shutdown_connections 2023-11-04T01:46:45.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.089+0000 7f05bef89640 1 -- 172.21.15.77:0/777920860 wait complete. 2023-11-04T01:46:45.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.090+0000 7f05bef89640 1 Processor -- start 2023-11-04T01:46:45.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.090+0000 7f05bef89640 1 -- start start 2023-11-04T01:46:45.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.091+0000 7f05bef89640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05b80d3b60 0x7f05b815fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:45.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.091+0000 7f05bef89640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f05b815d100 0x7f05b80b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:45.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.091+0000 7f05bef89640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05b815d4e0 0x7f05b80b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:45.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.091+0000 7f05bef89640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b815ff60 con 0x7f05b80d3b60 2023-11-04T01:46:45.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.091+0000 7f05bef89640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b80c9fc0 con 0x7f05b815d4e0 2023-11-04T01:46:45.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.091+0000 7f05bef89640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b80ca2a0 con 0x7f05b815d100 2023-11-04T01:46:45.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.091+0000 7f05bcd25640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05b80d3b60 0x7f05b815fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:45.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.091+0000 7f05bcd25640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05b80d3b60 0x7f05b815fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44554/0 (socket says 172.21.15.77:44554) 2023-11-04T01:46:45.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.091+0000 7f05bcd25640 1 -- 172.21.15.77:0/514683432 learned_addr learned my addr 172.21.15.77:0/514683432 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:45.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.092+0000 7f05bcd25640 1 -- 172.21.15.77:0/514683432 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f05b815d100 msgr2=0x7f05b80b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:45.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.092+0000 7f05bcd25640 1 --2- 172.21.15.77:0/514683432 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f05b815d100 0x7f05b80b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.092+0000 7f05bcd25640 1 -- 172.21.15.77:0/514683432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05b815d4e0 msgr2=0x7f05b80b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:45.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.092+0000 7f05bcd25640 1 --2- 172.21.15.77:0/514683432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05b815d4e0 0x7f05b80b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.092+0000 7f05bcd25640 1 -- 172.21.15.77:0/514683432 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ac0094d0 con 0x7f05b80d3b60 2023-11-04T01:46:45.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.092+0000 7f05bcd25640 1 --2- 172.21.15.77:0/514683432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05b80d3b60 0x7f05b815fa20 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f05a800c7f0 tx=0x7f05a800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:45.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.092+0000 7f05b57fa640 1 -- 172.21.15.77:0/514683432 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a8005b90 con 0x7f05b80d3b60 2023-11-04T01:46:45.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.092+0000 7f05b57fa640 1 -- 172.21.15.77:0/514683432 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a8005cf0 con 0x7f05b80d3b60 2023-11-04T01:46:45.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.092+0000 7f05bef89640 1 -- 172.21.15.77:0/514683432 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b80ca580 con 0x7f05b80d3b60 2023-11-04T01:46:45.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.092+0000 7f05b57fa640 1 -- 172.21.15.77:0/514683432 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a8007a30 con 0x7f05b80d3b60 2023-11-04T01:46:45.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.092+0000 7f05bef89640 1 -- 172.21.15.77:0/514683432 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b80cab40 con 0x7f05b80d3b60 2023-11-04T01:46:45.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.093+0000 7f05bef89640 1 -- 172.21.15.77:0/514683432 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05b80684b0 con 0x7f05b80d3b60 2023-11-04T01:46:45.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.093+0000 7f05b57fa640 1 -- 172.21.15.77:0/514683432 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f05a8007b90 con 0x7f05b80d3b60 2023-11-04T01:46:45.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.093+0000 7f05b57fa640 1 --2- 172.21.15.77:0/514683432 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f05a406ae70 0x7f05a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:45.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.094+0000 7f05b57fa640 1 -- 172.21.15.77:0/514683432 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7823+0+0 (secure 0 0 0) 0x7f05a8089de0 con 0x7f05b80d3b60 2023-11-04T01:46:45.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.094+0000 7f05b7fff640 1 --2- 172.21.15.77:0/514683432 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f05a406ae70 0x7f05a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:45.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.094+0000 7f05b7fff640 1 --2- 172.21.15.77:0/514683432 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f05a406ae70 0x7f05a406d330 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f05ac036000 tx=0x7f05ac030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:45.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.098+0000 7f05b57fa640 1 -- 172.21.15.77:0/514683432 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f05a8054650 con 0x7f05b80d3b60 2023-11-04T01:46:45.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.297+0000 7f05bef89640 1 -- 172.21.15.77:0/514683432 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05b80d2cd0 con 0x7f05b80d3b60 2023-11-04T01:46:45.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.298+0000 7f05b57fa640 1 -- 172.21.15.77:0/514683432 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4939 (secure 0 0 0) 0x7f05a801e070 con 0x7f05b80d3b60 2023-11-04T01:46:45.299 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:46:45.300 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":98,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/4183807043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4183807043},{"type":"v1","addr":"172.21.15.77:6834","nonce":4183807043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:46:39.322774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8139,"mds_1":6814},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6814":{"gid":6814,"name":"b","rank":1,"incarnation":88,"state":"up:active","state_seq":8,"addr":"172.21.15.122:6836/1450731169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1450731169},{"type":"v1","addr":"172.21.15.122:6836","nonce":1450731169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8139":{"gid":8139,"name":"c","rank":0,"incarnation":97,"state":"up:resolve","state_seq":11,"addr":"172.21.15.77:6835/2107153526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2107153526},{"type":"v1","addr":"172.21.15.77:6835","nonce":2107153526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:45.300 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 98 2023-11-04T01:46:45.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.300+0000 7f05bef89640 1 -- 172.21.15.77:0/514683432 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f05a406ae70 msgr2=0x7f05a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:45.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.300+0000 7f05bef89640 1 --2- 172.21.15.77:0/514683432 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f05a406ae70 0x7f05a406d330 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f05ac036000 tx=0x7f05ac030000 comp rx=0 tx=0).stop 2023-11-04T01:46:45.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.300+0000 7f05bef89640 1 -- 172.21.15.77:0/514683432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05b80d3b60 msgr2=0x7f05b815fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:45.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.300+0000 7f05bef89640 1 --2- 172.21.15.77:0/514683432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05b80d3b60 0x7f05b815fa20 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f05a800c7f0 tx=0x7f05a800cbf0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.300+0000 7f05bef89640 1 -- 172.21.15.77:0/514683432 shutdown_connections 2023-11-04T01:46:45.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.300+0000 7f05bef89640 1 --2- 172.21.15.77:0/514683432 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f05a406ae70 0x7f05a406d330 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.300+0000 7f05bef89640 1 --2- 172.21.15.77:0/514683432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05b815d4e0 0x7f05b80b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.300+0000 7f05bef89640 1 --2- 172.21.15.77:0/514683432 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f05b815d100 0x7f05b80b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.300+0000 7f05bef89640 1 --2- 172.21.15.77:0/514683432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05b80d3b60 0x7f05b815fa20 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.300+0000 7f05bef89640 1 -- 172.21.15.77:0/514683432 >> 172.21.15.77:0/514683432 conn(0x7f05b80d2ef0 msgr2=0x7f05b80b11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:45.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.300+0000 7f05bef89640 1 -- 172.21.15.77:0/514683432 shutdown_connections 2023-11-04T01:46:45.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.300+0000 7f05bef89640 1 -- 172.21.15.77:0/514683432 wait complete. 2023-11-04T01:46:45.312 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:resolve 2023-11-04T01:46:45.312 DEBUG:tasks.cephfs.filesystem:reached state 'up:resolve' in 0.32465147972106934s 2023-11-04T01:46:45.313 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:45.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.410+0000 7f9231a7c640 1 Processor -- start 2023-11-04T01:46:45.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.410+0000 7f9231a7c640 1 -- start start 2023-11-04T01:46:45.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.411+0000 7f9231a7c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f922c159e40 0x7f922c0b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:45.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.411+0000 7f9231a7c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f922c070700 0x7f922c0b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:45.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.411+0000 7f9231a7c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f922c071500 con 0x7f922c06bb60 2023-11-04T01:46:45.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.411+0000 7f9231a7c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f922c15dae0 con 0x7f922c159e40 2023-11-04T01:46:45.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.411+0000 7f9231a7c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f922c070c60 con 0x7f922c070700 2023-11-04T01:46:45.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.411+0000 7f922b7fe640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f922c159e40 0x7f922c0b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:45.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.411+0000 7f922bfff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f922c070700 0x7f922c0b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:45.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.411+0000 7f922affd640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f922c06bb60 0x7f922c06fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:38838/0 (socket says 172.21.15.77:38838) 2023-11-04T01:46:45.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.411+0000 7f922affd640 1 -- 172.21.15.77:0/236647222 learned_addr learned my addr 172.21.15.77:0/236647222 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:46:45.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.412+0000 7f922b7fe640 1 -- 172.21.15.77:0/236647222 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f922c070700 msgr2=0x7f922c0b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:45.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.412+0000 7f922b7fe640 1 --2- 172.21.15.77:0/236647222 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f922c070700 0x7f922c0b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.412+0000 7f922b7fe640 1 -- 172.21.15.77:0/236647222 >> v1:172.21.15.122:6789/0 conn(0x7f922c06bb60 legacy=0x7f922c06fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:45.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.412+0000 7f922b7fe640 1 -- 172.21.15.77:0/236647222 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f922c070f40 con 0x7f922c159e40 2023-11-04T01:46:45.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.412+0000 7f922a7fc640 1 -- 172.21.15.77:0/236647222 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2607385678 0 0) 0x7f922c071500 con 0x7f922c06bb60 2023-11-04T01:46:45.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.412+0000 7f922bfff640 1 --2- 172.21.15.77:0/236647222 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f922c070700 0x7f922c0b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:46:45.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.412+0000 7f922b7fe640 1 --2- 172.21.15.77:0/236647222 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f922c159e40 0x7f922c0b0530 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f921c0097a0 tx=0x7f921c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80f4b946018eb00e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:45.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.412+0000 7f922a7fc640 1 -- 172.21.15.77:0/236647222 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c02e070 con 0x7f922c159e40 2023-11-04T01:46:45.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.412+0000 7f922a7fc640 1 -- 172.21.15.77:0/236647222 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921c0315a0 con 0x7f922c159e40 2023-11-04T01:46:45.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.413+0000 7f922a7fc640 1 -- 172.21.15.77:0/236647222 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c031930 con 0x7f922c159e40 2023-11-04T01:46:45.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.413+0000 7f9231a7c640 1 -- 172.21.15.77:0/236647222 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f922c159e40 msgr2=0x7f922c0b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:45.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.413+0000 7f9231a7c640 1 --2- 172.21.15.77:0/236647222 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f922c159e40 0x7f922c0b0530 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f921c0097a0 tx=0x7f921c02b840 comp rx=0 tx=0).stop 2023-11-04T01:46:45.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.413+0000 7f9231a7c640 1 -- 172.21.15.77:0/236647222 shutdown_connections 2023-11-04T01:46:45.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.413+0000 7f9231a7c640 1 --2- 172.21.15.77:0/236647222 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f922c070700 0x7f922c0b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.413+0000 7f9231a7c640 1 --2- 172.21.15.77:0/236647222 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f922c159e40 0x7f922c0b0530 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.413+0000 7f9231a7c640 1 -- 172.21.15.77:0/236647222 >> 172.21.15.77:0/236647222 conn(0x7f922c0cb530 msgr2=0x7f922c0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:45.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.413+0000 7f9231a7c640 1 -- 172.21.15.77:0/236647222 shutdown_connections 2023-11-04T01:46:45.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.413+0000 7f9231a7c640 1 -- 172.21.15.77:0/236647222 wait complete. 2023-11-04T01:46:45.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.414+0000 7f9231a7c640 1 Processor -- start 2023-11-04T01:46:45.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.414+0000 7f9231a7c640 1 -- start start 2023-11-04T01:46:45.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.415+0000 7f9231a7c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f922c06bb60 0x7f922c0c1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:45.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.415+0000 7f9231a7c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f922c070700 0x7f922c153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:45.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.415+0000 7f9231a7c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f922c159e40 0x7f922c154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:45.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.415+0000 7f9231a7c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922c1526a0 con 0x7f922c06bb60 2023-11-04T01:46:45.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.415+0000 7f9231a7c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922c0c2cb0 con 0x7f922c159e40 2023-11-04T01:46:45.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.415+0000 7f9231a7c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f922c0c1960 con 0x7f922c070700 2023-11-04T01:46:45.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.415+0000 7f922b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f922c06bb60 0x7f922c0c1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:45.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.415+0000 7f922b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f922c06bb60 0x7f922c0c1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44562/0 (socket says 172.21.15.77:44562) 2023-11-04T01:46:45.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.415+0000 7f922b7fe640 1 -- 172.21.15.77:0/4111698716 learned_addr learned my addr 172.21.15.77:0/4111698716 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:45.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.415+0000 7f922bfff640 1 --2- 172.21.15.77:0/4111698716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f922c159e40 0x7f922c154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:45.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.415+0000 7f922affd640 1 --2- 172.21.15.77:0/4111698716 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f922c070700 0x7f922c153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:45.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.415+0000 7f922b7fe640 1 -- 172.21.15.77:0/4111698716 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f922c070700 msgr2=0x7f922c153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:45.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.415+0000 7f922b7fe640 1 --2- 172.21.15.77:0/4111698716 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f922c070700 0x7f922c153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.415+0000 7f922b7fe640 1 -- 172.21.15.77:0/4111698716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f922c159e40 msgr2=0x7f922c154120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:45.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.415+0000 7f922b7fe640 1 --2- 172.21.15.77:0/4111698716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f922c159e40 0x7f922c154120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.415+0000 7f922b7fe640 1 -- 172.21.15.77:0/4111698716 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9224009a70 con 0x7f922c06bb60 2023-11-04T01:46:45.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.416+0000 7f922b7fe640 1 --2- 172.21.15.77:0/4111698716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f922c06bb60 0x7f922c0c1420 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f921c0097a0 tx=0x7f921c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:45.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.416+0000 7f9213fff640 1 -- 172.21.15.77:0/4111698716 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c004230 con 0x7f922c06bb60 2023-11-04T01:46:45.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.416+0000 7f9213fff640 1 -- 172.21.15.77:0/4111698716 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921c004390 con 0x7f922c06bb60 2023-11-04T01:46:45.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.416+0000 7f9213fff640 1 -- 172.21.15.77:0/4111698716 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c003850 con 0x7f922c06bb60 2023-11-04T01:46:45.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.416+0000 7f9231a7c640 1 -- 172.21.15.77:0/4111698716 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f921c009400 con 0x7f922c06bb60 2023-11-04T01:46:45.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.416+0000 7f9231a7c640 1 -- 172.21.15.77:0/4111698716 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f922c1f5230 con 0x7f922c06bb60 2023-11-04T01:46:45.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.417+0000 7f9231a7c640 1 -- 172.21.15.77:0/4111698716 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f922c0684b0 con 0x7f922c06bb60 2023-11-04T01:46:45.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.417+0000 7f9213fff640 1 -- 172.21.15.77:0/4111698716 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f921c0039b0 con 0x7f922c06bb60 2023-11-04T01:46:45.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.418+0000 7f9213fff640 1 --2- 172.21.15.77:0/4111698716 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f921806ae70 0x7f921806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:45.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.418+0000 7f9213fff640 1 -- 172.21.15.77:0/4111698716 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7823+0+0 (secure 0 0 0) 0x7f921c0abc20 con 0x7f922c06bb60 2023-11-04T01:46:45.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.418+0000 7f922affd640 1 --2- 172.21.15.77:0/4111698716 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f921806ae70 0x7f921806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:45.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.418+0000 7f922affd640 1 --2- 172.21.15.77:0/4111698716 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f921806ae70 0x7f921806d330 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f922c152850 tx=0x7f9220007f00 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:45.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.422+0000 7f9213fff640 1 -- 172.21.15.77:0/4111698716 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f921c076520 con 0x7f922c06bb60 2023-11-04T01:46:45.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.626+0000 7f9231a7c640 1 -- 172.21.15.77:0/4111698716 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f922c155520 con 0x7f922c06bb60 2023-11-04T01:46:45.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.626+0000 7f9213fff640 1 -- 172.21.15.77:0/4111698716 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4939 (secure 0 0 0) 0x7f921c079b40 con 0x7f922c06bb60 2023-11-04T01:46:45.629 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:46:45.629 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":98,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/4183807043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4183807043},{"type":"v1","addr":"172.21.15.77:6834","nonce":4183807043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:46:39.322774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8139,"mds_1":6814},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6814":{"gid":6814,"name":"b","rank":1,"incarnation":88,"state":"up:active","state_seq":8,"addr":"172.21.15.122:6836/1450731169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1450731169},{"type":"v1","addr":"172.21.15.122:6836","nonce":1450731169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8139":{"gid":8139,"name":"c","rank":0,"incarnation":97,"state":"up:resolve","state_seq":11,"addr":"172.21.15.77:6835/2107153526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2107153526},{"type":"v1","addr":"172.21.15.77:6835","nonce":2107153526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:45.629 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 98 2023-11-04T01:46:45.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.629+0000 7f9231a7c640 1 -- 172.21.15.77:0/4111698716 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f921806ae70 msgr2=0x7f921806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:45.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.629+0000 7f9231a7c640 1 --2- 172.21.15.77:0/4111698716 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f921806ae70 0x7f921806d330 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f922c152850 tx=0x7f9220007f00 comp rx=0 tx=0).stop 2023-11-04T01:46:45.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.629+0000 7f9231a7c640 1 -- 172.21.15.77:0/4111698716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f922c06bb60 msgr2=0x7f922c0c1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:45.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.629+0000 7f9231a7c640 1 --2- 172.21.15.77:0/4111698716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f922c06bb60 0x7f922c0c1420 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f921c0097a0 tx=0x7f921c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.629+0000 7f9231a7c640 1 -- 172.21.15.77:0/4111698716 shutdown_connections 2023-11-04T01:46:45.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.629+0000 7f9231a7c640 1 --2- 172.21.15.77:0/4111698716 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f921806ae70 0x7f921806d330 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.629+0000 7f9231a7c640 1 --2- 172.21.15.77:0/4111698716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f922c159e40 0x7f922c154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.629+0000 7f9231a7c640 1 --2- 172.21.15.77:0/4111698716 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f922c070700 0x7f922c153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.629+0000 7f9231a7c640 1 --2- 172.21.15.77:0/4111698716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f922c06bb60 0x7f922c0c1420 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.629+0000 7f9231a7c640 1 -- 172.21.15.77:0/4111698716 >> 172.21.15.77:0/4111698716 conn(0x7f922c0cb530 msgr2=0x7f922c15dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:45.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.629+0000 7f9231a7c640 1 -- 172.21.15.77:0/4111698716 shutdown_connections 2023-11-04T01:46:45.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.629+0000 7f9231a7c640 1 -- 172.21.15.77:0/4111698716 wait complete. 2023-11-04T01:46:45.641 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump snaps --server 2023-11-04T01:46:45.754 INFO:teuthology.orchestra.run.smithi077.stdout:{"last_snap":11,"last_created":5,"last_destroyed":9,"pending_noop":[],"snaps":[],"need_to_purge":{},"pending_update":[{"version":22,"snapinfo":{"snapid":11,"ino":1099511627777,"stamp":"2023-11-04T01:46:21.837860+0000","name":"s25","metadata":{}}}],"pending_destroy":[]} 2023-11-04T01:46:45.754 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 9, "last_snap": 11, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [ { "snapInfinityo": { "ino": 1099511627777, "metadata": {}, "name": "s25", "snapid": 11, "stamp": "2023-11-04T01:46:21.837860+0000" }, "version": 22 } ], "snaps": [] } 2023-11-04T01:46:45.755 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:1 2023-11-04T01:46:45.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.854+0000 7f04b4c64640 1 Processor -- start 2023-11-04T01:46:45.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.854+0000 7f04b4c64640 1 -- start start 2023-11-04T01:46:45.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.855+0000 7f04b4c64640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04b006d9c0 0x7f04b00710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:45.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.855+0000 7f04b4c64640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f04b006c5f0 0x7f04b0071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:45.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.855+0000 7f04b4c64640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04b006cc90 con 0x7f04b00ade00 2023-11-04T01:46:45.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.855+0000 7f04b4c64640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04b00b0c40 con 0x7f04b006c5f0 2023-11-04T01:46:45.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.855+0000 7f04b4c64640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b0071b50 con 0x7f04b006d9c0 2023-11-04T01:46:45.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.855+0000 7f04a7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04b006d9c0 0x7f04b00710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:45.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.855+0000 7f04aed9d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f04b006c5f0 0x7f04b0071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:45.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.855+0000 7f04ae59c640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f04b00ade00 0x7f04b00b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:38840/0 (socket says 172.21.15.77:38840) 2023-11-04T01:46:45.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.855+0000 7f04a7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04b006d9c0 0x7f04b00710d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:55138/0 (socket says 172.21.15.77:55138) 2023-11-04T01:46:45.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.855+0000 7f04a7fff640 1 -- 172.21.15.77:0/2278727681 learned_addr learned my addr 172.21.15.77:0/2278727681 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:45.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.855+0000 7f04aed9d640 1 -- 172.21.15.77:0/2278727681 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04b006d9c0 msgr2=0x7f04b00710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:45.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.855+0000 7f04aed9d640 1 --2- 172.21.15.77:0/2278727681 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04b006d9c0 0x7f04b00710d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.855+0000 7f04aed9d640 1 -- 172.21.15.77:0/2278727681 >> v1:172.21.15.122:6789/0 conn(0x7f04b00ade00 legacy=0x7f04b00b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:45.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.855+0000 7f04aed9d640 1 -- 172.21.15.77:0/2278727681 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b00b0e60 con 0x7f04b006c5f0 2023-11-04T01:46:45.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.855+0000 7f04a7fff640 1 --2- 172.21.15.77:0/2278727681 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04b006d9c0 0x7f04b00710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:46:45.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.856+0000 7f04aed9d640 1 --2- 172.21.15.77:0/2278727681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04b006c5f0 0x7f04b0071610 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f04a8009d90 tx=0x7f04a802bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4417737c2ee12249 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:45.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.856+0000 7f04add9b640 1 -- 172.21.15.77:0/2278727681 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a802cb30 con 0x7f04b006c5f0 2023-11-04T01:46:45.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.856+0000 7f04add9b640 1 -- 172.21.15.77:0/2278727681 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a802cc90 con 0x7f04b006c5f0 2023-11-04T01:46:45.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.856+0000 7f04add9b640 1 -- 172.21.15.77:0/2278727681 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a8034440 con 0x7f04b006c5f0 2023-11-04T01:46:45.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.857+0000 7f04b4c64640 1 -- 172.21.15.77:0/2278727681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04b006c5f0 msgr2=0x7f04b0071610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:45.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.857+0000 7f04b4c64640 1 --2- 172.21.15.77:0/2278727681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04b006c5f0 0x7f04b0071610 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f04a8009d90 tx=0x7f04a802bd80 comp rx=0 tx=0).stop 2023-11-04T01:46:45.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.857+0000 7f04b4c64640 1 -- 172.21.15.77:0/2278727681 shutdown_connections 2023-11-04T01:46:45.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.857+0000 7f04b4c64640 1 --2- 172.21.15.77:0/2278727681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04b006c5f0 0x7f04b0071610 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.857+0000 7f04b4c64640 1 --2- 172.21.15.77:0/2278727681 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04b006d9c0 0x7f04b00710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.857+0000 7f04b4c64640 1 -- 172.21.15.77:0/2278727681 >> 172.21.15.77:0/2278727681 conn(0x7f04b00cb530 msgr2=0x7f04b00cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:45.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.857+0000 7f04b4c64640 1 -- 172.21.15.77:0/2278727681 shutdown_connections 2023-11-04T01:46:45.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.857+0000 7f04b4c64640 1 -- 172.21.15.77:0/2278727681 wait complete. 2023-11-04T01:46:45.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.858+0000 7f04b4c64640 1 Processor -- start 2023-11-04T01:46:45.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.858+0000 7f04b4c64640 1 -- start start 2023-11-04T01:46:45.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.859+0000 7f04b4c64640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04b006c5f0 0x7f04b0149880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:45.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.859+0000 7f04b4c64640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04b006d9c0 0x7f04b01e5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:45.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.859+0000 7f04b4c64640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04b00ade00 0x7f04b01e6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:45.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.859+0000 7f04b4c64640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b01e6640 con 0x7f04b00ade00 2023-11-04T01:46:45.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.859+0000 7f04b4c64640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b00c3f30 con 0x7f04b006c5f0 2023-11-04T01:46:45.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.859+0000 7f04b4c64640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b00c3c50 con 0x7f04b006d9c0 2023-11-04T01:46:45.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.859+0000 7f04aed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04b00ade00 0x7f04b01e6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:45.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.859+0000 7f04aed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04b00ade00 0x7f04b01e6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44574/0 (socket says 172.21.15.77:44574) 2023-11-04T01:46:45.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.859+0000 7f04aed9d640 1 -- 172.21.15.77:0/39237510 learned_addr learned my addr 172.21.15.77:0/39237510 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:45.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.859+0000 7f04a7fff640 1 --2- 172.21.15.77:0/39237510 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04b006d9c0 0x7f04b01e5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:45.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.859+0000 7f04ae59c640 1 --2- 172.21.15.77:0/39237510 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04b006c5f0 0x7f04b0149880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:45.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.859+0000 7f04aed9d640 1 -- 172.21.15.77:0/39237510 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04b006d9c0 msgr2=0x7f04b01e5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:45.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.859+0000 7f04aed9d640 1 --2- 172.21.15.77:0/39237510 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04b006d9c0 0x7f04b01e5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.859+0000 7f04aed9d640 1 -- 172.21.15.77:0/39237510 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04b006c5f0 msgr2=0x7f04b0149880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:45.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.859+0000 7f04aed9d640 1 --2- 172.21.15.77:0/39237510 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04b006c5f0 0x7f04b0149880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.859+0000 7f04aed9d640 1 -- 172.21.15.77:0/39237510 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04980094d0 con 0x7f04b00ade00 2023-11-04T01:46:45.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.860+0000 7f04aed9d640 1 --2- 172.21.15.77:0/39237510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04b00ade00 0x7f04b01e6100 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f04a8009d90 tx=0x7f04a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:45.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.860+0000 7f04a6ffd640 1 -- 172.21.15.77:0/39237510 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a8009450 con 0x7f04b00ade00 2023-11-04T01:46:45.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.860+0000 7f04a6ffd640 1 -- 172.21.15.77:0/39237510 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a8040450 con 0x7f04b00ade00 2023-11-04T01:46:45.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.860+0000 7f04a6ffd640 1 -- 172.21.15.77:0/39237510 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a8040800 con 0x7f04b00ade00 2023-11-04T01:46:45.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.860+0000 7f04b4c64640 1 -- 172.21.15.77:0/39237510 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04a8009a70 con 0x7f04b00ade00 2023-11-04T01:46:45.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.860+0000 7f04b4c64640 1 -- 172.21.15.77:0/39237510 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b014a550 con 0x7f04b00ade00 2023-11-04T01:46:45.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.861+0000 7f04b4c64640 1 -- 172.21.15.77:0/39237510 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04b00684b0 con 0x7f04b00ade00 2023-11-04T01:46:45.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.861+0000 7f04a6ffd640 1 -- 172.21.15.77:0/39237510 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f04a8040960 con 0x7f04b00ade00 2023-11-04T01:46:45.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.862+0000 7f04a6ffd640 1 --2- 172.21.15.77:0/39237510 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f049006ae70 0x7f049006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:45.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.862+0000 7f04a6ffd640 1 -- 172.21.15.77:0/39237510 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7823+0+0 (secure 0 0 0) 0x7f04a80ac8e0 con 0x7f04b00ade00 2023-11-04T01:46:45.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.862+0000 7f04ae59c640 1 --2- 172.21.15.77:0/39237510 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f049006ae70 0x7f049006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:45.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.862+0000 7f04ae59c640 1 --2- 172.21.15.77:0/39237510 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f049006ae70 0x7f049006d330 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f04a0000f60 tx=0x7f04a0000ed0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:45.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:45.866+0000 7f04a6ffd640 1 -- 172.21.15.77:0/39237510 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f04a8077200 con 0x7f04b00ade00 2023-11-04T01:46:46.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.101+0000 7f04b4c64640 1 -- 172.21.15.77:0/39237510 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:1"} v 0) v1 -- 0x7f04b00cddc0 con 0x7f04b00ade00 2023-11-04T01:46:46.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.103+0000 7f04a6ffd640 1 -- 172.21.15.77:0/39237510 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:1"}]=0 failed mds gid 6814 v99) v1 ==== 97+0+0 (secure 0 0 0) 0x7f04a807a820 con 0x7f04b00ade00 2023-11-04T01:46:46.104 INFO:teuthology.orchestra.run.smithi077.stderr:failed mds gid 6814 2023-11-04T01:46:46.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.105+0000 7f04b4c64640 1 -- 172.21.15.77:0/39237510 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f049006ae70 msgr2=0x7f049006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:46.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.105+0000 7f04b4c64640 1 --2- 172.21.15.77:0/39237510 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f049006ae70 0x7f049006d330 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f04a0000f60 tx=0x7f04a0000ed0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.105+0000 7f04b4c64640 1 -- 172.21.15.77:0/39237510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04b00ade00 msgr2=0x7f04b01e6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:46.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.105+0000 7f04b4c64640 1 --2- 172.21.15.77:0/39237510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04b00ade00 0x7f04b01e6100 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f04a8009d90 tx=0x7f04a8004a40 comp rx=0 tx=0).stop 2023-11-04T01:46:46.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.105+0000 7f04b4c64640 1 -- 172.21.15.77:0/39237510 shutdown_connections 2023-11-04T01:46:46.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.105+0000 7f04b4c64640 1 --2- 172.21.15.77:0/39237510 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f049006ae70 0x7f049006d330 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.105+0000 7f04b4c64640 1 --2- 172.21.15.77:0/39237510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04b00ade00 0x7f04b01e6100 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.105+0000 7f04b4c64640 1 --2- 172.21.15.77:0/39237510 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f04b006d9c0 0x7f04b01e5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.105+0000 7f04b4c64640 1 --2- 172.21.15.77:0/39237510 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f04b006c5f0 0x7f04b0149880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.105+0000 7f04b4c64640 1 -- 172.21.15.77:0/39237510 >> 172.21.15.77:0/39237510 conn(0x7f04b00cb530 msgr2=0x7f04b00b1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:46.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.106+0000 7f04b4c64640 1 -- 172.21.15.77:0/39237510 shutdown_connections 2023-11-04T01:46:46.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.106+0000 7f04b4c64640 1 -- 172.21.15.77:0/39237510 wait complete. 2023-11-04T01:46:46.120 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:46:46.120 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:46:46.120 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:46:46.121 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:46:46.121 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:46:46.122 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi122 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b' 2023-11-04T01:46:46.122 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:46:46.122 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:46:46.125 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:46:46.125 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:46.203 INFO:tasks.ceph.mds.b.smithi122.stdout:starting mds.b at 2023-11-04T01:46:46.224 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~7s 2023-11-04T01:46:46.224 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-11-04T01:46:46.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.223+0000 7f0757b25640 1 Processor -- start 2023-11-04T01:46:46.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.223+0000 7f0757b25640 1 -- start start 2023-11-04T01:46:46.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.223+0000 7f0757b25640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f075015d110 0x7f075006b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:46.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.224+0000 7f0757b25640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f07500b3ca0 0x7f07500ace70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:46.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.224+0000 7f0757b25640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f07500ad3b0 0x7f07500b2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:46.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.224+0000 7f0757b25640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07500664f0 con 0x7f07500ad3b0 2023-11-04T01:46:46.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.224+0000 7f0757b25640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f075015d4f0 con 0x7f075015d110 2023-11-04T01:46:46.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.224+0000 7f0757b25640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f075006b9f0 con 0x7f07500b3ca0 2023-11-04T01:46:46.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.224+0000 7f07560c2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f07500ad3b0 0x7f07500b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:46.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.224+0000 7f07560c2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f07500ad3b0 0x7f07500b2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44586/0 (socket says 172.21.15.77:44586) 2023-11-04T01:46:46.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.224+0000 7f07560c2640 1 -- 172.21.15.77:0/2240211440 learned_addr learned my addr 172.21.15.77:0/2240211440 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:46.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.224+0000 7f07558c1640 1 --2- 172.21.15.77:0/2240211440 >> v2:172.21.15.122:3300/0 conn(0x7f075015d110 0x7f075006b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:46.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.224+0000 7f07550c0640 1 --2- 172.21.15.77:0/2240211440 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f07500b3ca0 0x7f07500ace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:46.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.224+0000 7f07560c2640 1 -- 172.21.15.77:0/2240211440 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f07500b3ca0 msgr2=0x7f07500ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:46.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.224+0000 7f07560c2640 1 --2- 172.21.15.77:0/2240211440 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f07500b3ca0 0x7f07500ace70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.224+0000 7f07560c2640 1 -- 172.21.15.77:0/2240211440 >> v2:172.21.15.122:3300/0 conn(0x7f075015d110 msgr2=0x7f075006b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:46.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.224+0000 7f07560c2640 1 --2- 172.21.15.77:0/2240211440 >> v2:172.21.15.122:3300/0 conn(0x7f075015d110 0x7f075006b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.224+0000 7f07560c2640 1 -- 172.21.15.77:0/2240211440 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f075006c2e0 con 0x7f07500ad3b0 2023-11-04T01:46:46.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.225+0000 7f07560c2640 1 --2- 172.21.15.77:0/2240211440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07500ad3b0 0x7f07500b2100 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f07500ccd90 tx=0x7f074802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a73ab604e21fa386 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:46.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.225+0000 7f07548bf640 1 -- 172.21.15.77:0/2240211440 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074802ca70 con 0x7f07500ad3b0 2023-11-04T01:46:46.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.225+0000 7f07548bf640 1 -- 172.21.15.77:0/2240211440 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074802cbd0 con 0x7f07500ad3b0 2023-11-04T01:46:46.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.225+0000 7f07548bf640 1 -- 172.21.15.77:0/2240211440 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07480343f0 con 0x7f07500ad3b0 2023-11-04T01:46:46.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.225+0000 7f0757b25640 1 -- 172.21.15.77:0/2240211440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07500ad3b0 msgr2=0x7f07500b2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:46.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.225+0000 7f0757b25640 1 --2- 172.21.15.77:0/2240211440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07500ad3b0 0x7f07500b2100 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f07500ccd90 tx=0x7f074802bed0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.225+0000 7f0757b25640 1 -- 172.21.15.77:0/2240211440 shutdown_connections 2023-11-04T01:46:46.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.225+0000 7f0757b25640 1 --2- 172.21.15.77:0/2240211440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07500ad3b0 0x7f07500b2100 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.225+0000 7f0757b25640 1 --2- 172.21.15.77:0/2240211440 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f07500b3ca0 0x7f07500ace70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.225+0000 7f0757b25640 1 --2- 172.21.15.77:0/2240211440 >> v2:172.21.15.122:3300/0 conn(0x7f075015d110 0x7f075006b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.225+0000 7f0757b25640 1 -- 172.21.15.77:0/2240211440 >> 172.21.15.77:0/2240211440 conn(0x7f07500cbd30 msgr2=0x7f07500cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:46.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.225+0000 7f0757b25640 1 -- 172.21.15.77:0/2240211440 shutdown_connections 2023-11-04T01:46:46.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.226+0000 7f0757b25640 1 -- 172.21.15.77:0/2240211440 wait complete. 2023-11-04T01:46:46.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.227+0000 7f0757b25640 1 Processor -- start 2023-11-04T01:46:46.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.227+0000 7f0757b25640 1 -- start start 2023-11-04T01:46:46.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.227+0000 7f0757b25640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07500ad3b0 0x7f075006a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:46.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.227+0000 7f0757b25640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f07500b3ca0 0x7f0750071db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:46.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.227+0000 7f0757b25640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f075015d110 0x7f075014b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:46.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.227+0000 7f0757b25640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075015f230 con 0x7f075015d110 2023-11-04T01:46:46.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.227+0000 7f0757b25640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075015f510 con 0x7f07500ad3b0 2023-11-04T01:46:46.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.227+0000 7f0757b25640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f075015f7f0 con 0x7f07500b3ca0 2023-11-04T01:46:46.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.227+0000 7f07560c2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f075015d110 0x7f075014b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:46.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.227+0000 7f07560c2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f075015d110 0x7f075014b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44592/0 (socket says 172.21.15.77:44592) 2023-11-04T01:46:46.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.227+0000 7f07560c2640 1 -- 172.21.15.77:0/1324916008 learned_addr learned my addr 172.21.15.77:0/1324916008 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:46.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.228+0000 7f07558c1640 1 --2- 172.21.15.77:0/1324916008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07500ad3b0 0x7f075006a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:46.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.228+0000 7f07550c0640 1 --2- 172.21.15.77:0/1324916008 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f07500b3ca0 0x7f0750071db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:46.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.228+0000 7f07560c2640 1 -- 172.21.15.77:0/1324916008 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f07500b3ca0 msgr2=0x7f0750071db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:46.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.228+0000 7f07560c2640 1 --2- 172.21.15.77:0/1324916008 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f07500b3ca0 0x7f0750071db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.228+0000 7f07560c2640 1 -- 172.21.15.77:0/1324916008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07500ad3b0 msgr2=0x7f075006a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:46.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.228+0000 7f07560c2640 1 --2- 172.21.15.77:0/1324916008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07500ad3b0 0x7f075006a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.228+0000 7f07560c2640 1 -- 172.21.15.77:0/1324916008 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0748009b30 con 0x7f075015d110 2023-11-04T01:46:46.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.228+0000 7f07558c1640 1 --2- 172.21.15.77:0/1324916008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07500ad3b0 0x7f075006a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:46.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.228+0000 7f07560c2640 1 --2- 172.21.15.77:0/1324916008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f075015d110 0x7f075014b2e0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f0748036040 tx=0x7f0748004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:46.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.228+0000 7f07467fc640 1 -- 172.21.15.77:0/1324916008 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0748009510 con 0x7f075015d110 2023-11-04T01:46:46.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.228+0000 7f07467fc640 1 -- 172.21.15.77:0/1324916008 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074803e450 con 0x7f075015d110 2023-11-04T01:46:46.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.228+0000 7f07467fc640 1 -- 172.21.15.77:0/1324916008 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074803e800 con 0x7f075015d110 2023-11-04T01:46:46.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.228+0000 7f0757b25640 1 -- 172.21.15.77:0/1324916008 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f075015fad0 con 0x7f075015d110 2023-11-04T01:46:46.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.228+0000 7f0757b25640 1 -- 172.21.15.77:0/1324916008 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0750157ec0 con 0x7f075015d110 2023-11-04T01:46:46.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.229+0000 7f0757b25640 1 -- 172.21.15.77:0/1324916008 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f075015fff0 con 0x7f075015d110 2023-11-04T01:46:46.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.229+0000 7f07467fc640 1 -- 172.21.15.77:0/1324916008 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f074803e960 con 0x7f075015d110 2023-11-04T01:46:46.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.230+0000 7f07467fc640 1 --2- 172.21.15.77:0/1324916008 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f073406ae70 0x7f073406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:46.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.230+0000 7f07467fc640 1 -- 172.21.15.77:0/1324916008 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7909+0+0 (secure 0 0 0) 0x7f07480acc40 con 0x7f075015d110 2023-11-04T01:46:46.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.230+0000 7f07558c1640 1 --2- 172.21.15.77:0/1324916008 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f073406ae70 0x7f073406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:46.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.230+0000 7f07558c1640 1 --2- 172.21.15.77:0/1324916008 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f073406ae70 0x7f073406d330 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f074c0079d0 tx=0x7f074c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:46.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.234+0000 7f07467fc640 1 -- 172.21.15.77:0/1324916008 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f075015fff0 con 0x7f075015d110 2023-11-04T01:46:46.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.432+0000 7f0757b25640 1 -- 172.21.15.77:0/1324916008 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f075015fff0 con 0x7f075015d110 2023-11-04T01:46:46.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.433+0000 7f07467fc640 1 -- 172.21.15.77:0/1324916008 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) v1 ==== 95+0+4148 (secure 0 0 0) 0x7f075015fff0 con 0x7f075015d110 2023-11-04T01:46:46.435 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:46:46.435 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":100,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:46:46.106864+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8139,"mds_1":8343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8139":{"gid":8139,"name":"c","rank":0,"incarnation":97,"state":"up:resolve","state_seq":11,"addr":"172.21.15.77:6835/2107153526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2107153526},{"type":"v1","addr":"172.21.15.77:6835","nonce":2107153526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8343":{"gid":8343,"name":"a","rank":1,"incarnation":100,"state":"up:replay","state_seq":1,"addr":"172.21.15.77:6834/4183807043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4183807043},{"type":"v1","addr":"172.21.15.77:6834","nonce":4183807043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:46.435 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 100 2023-11-04T01:46:46.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.435+0000 7f0757b25640 1 -- 172.21.15.77:0/1324916008 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f073406ae70 msgr2=0x7f073406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:46.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.435+0000 7f0757b25640 1 --2- 172.21.15.77:0/1324916008 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f073406ae70 0x7f073406d330 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f074c0079d0 tx=0x7f074c008040 comp rx=0 tx=0).stop 2023-11-04T01:46:46.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.435+0000 7f0757b25640 1 -- 172.21.15.77:0/1324916008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f075015d110 msgr2=0x7f075014b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:46.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.435+0000 7f0757b25640 1 --2- 172.21.15.77:0/1324916008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f075015d110 0x7f075014b2e0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f0748036040 tx=0x7f0748004a40 comp rx=0 tx=0).stop 2023-11-04T01:46:46.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.435+0000 7f0757b25640 1 -- 172.21.15.77:0/1324916008 shutdown_connections 2023-11-04T01:46:46.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.435+0000 7f0757b25640 1 --2- 172.21.15.77:0/1324916008 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f073406ae70 0x7f073406d330 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.435+0000 7f0757b25640 1 --2- 172.21.15.77:0/1324916008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f075015d110 0x7f075014b2e0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.435+0000 7f0757b25640 1 --2- 172.21.15.77:0/1324916008 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f07500b3ca0 0x7f0750071db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.435+0000 7f0757b25640 1 --2- 172.21.15.77:0/1324916008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07500ad3b0 0x7f075006a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.435+0000 7f0757b25640 1 -- 172.21.15.77:0/1324916008 >> 172.21.15.77:0/1324916008 conn(0x7f07500cbd30 msgr2=0x7f07500b0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:46.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.435+0000 7f0757b25640 1 -- 172.21.15.77:0/1324916008 shutdown_connections 2023-11-04T01:46:46.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:46.435+0000 7f0757b25640 1 -- 172.21.15.77:0/1324916008 wait complete. 2023-11-04T01:46:46.447 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:46:51.448 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:51.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.557+0000 7fce2d0d4640 1 Processor -- start 2023-11-04T01:46:51.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.557+0000 7fce2d0d4640 1 -- start start 2023-11-04T01:46:51.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.558+0000 7fce2d0d4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fce280b0c40 0x7fce2806fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:51.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.558+0000 7fce2d0d4640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fce2806bb60 0x7fce28070530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:51.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.558+0000 7fce2d0d4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce28071500 con 0x7fce28159e40 2023-11-04T01:46:51.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.558+0000 7fce2d0d4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce28070a70 con 0x7fce280b0c40 2023-11-04T01:46:51.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.558+0000 7fce2d0d4640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce2815dae0 con 0x7fce2806bb60 2023-11-04T01:46:51.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.558+0000 7fce2659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fce280b0c40 0x7fce2806fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:51.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.558+0000 7fce26d9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fce28159e40 0x7fce280b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49860/0 (socket says 172.21.15.77:49860) 2023-11-04T01:46:51.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.558+0000 7fce2659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fce280b0c40 0x7fce2806fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41736/0 (socket says 172.21.15.77:41736) 2023-11-04T01:46:51.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.558+0000 7fce26d9d640 1 -- 172.21.15.77:0/4275843481 learned_addr learned my addr 172.21.15.77:0/4275843481 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:46:51.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.558+0000 7fce2659c640 1 -- 172.21.15.77:0/4275843481 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fce2806bb60 msgr2=0x7fce28070530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:51.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.558+0000 7fce2659c640 1 --2- 172.21.15.77:0/4275843481 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fce2806bb60 0x7fce28070530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:51.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.558+0000 7fce2659c640 1 -- 172.21.15.77:0/4275843481 >> v1:172.21.15.77:6789/0 conn(0x7fce28159e40 legacy=0x7fce280b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:51.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.558+0000 7fce2659c640 1 -- 172.21.15.77:0/4275843481 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce28070c60 con 0x7fce280b0c40 2023-11-04T01:46:51.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.559+0000 7fce2659c640 1 --2- 172.21.15.77:0/4275843481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce280b0c40 0x7fce2806fff0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fce1c00ba40 tx=0x7fce1c02dff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af4cf64b0e4a53af server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:51.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.559+0000 7fce25d9b640 1 -- 172.21.15.77:0/4275843481 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c02eda0 con 0x7fce280b0c40 2023-11-04T01:46:51.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.559+0000 7fce25d9b640 1 -- 172.21.15.77:0/4275843481 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce1c036440 con 0x7fce280b0c40 2023-11-04T01:46:51.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.559+0000 7fce25d9b640 1 -- 172.21.15.77:0/4275843481 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c0367d0 con 0x7fce280b0c40 2023-11-04T01:46:51.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.560+0000 7fce2d0d4640 1 -- 172.21.15.77:0/4275843481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce280b0c40 msgr2=0x7fce2806fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:51.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.560+0000 7fce2d0d4640 1 --2- 172.21.15.77:0/4275843481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce280b0c40 0x7fce2806fff0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fce1c00ba40 tx=0x7fce1c02dff0 comp rx=0 tx=0).stop 2023-11-04T01:46:51.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.560+0000 7fce2d0d4640 1 -- 172.21.15.77:0/4275843481 shutdown_connections 2023-11-04T01:46:51.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.560+0000 7fce2d0d4640 1 --2- 172.21.15.77:0/4275843481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce280b0c40 0x7fce2806fff0 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:51.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.560+0000 7fce2d0d4640 1 --2- 172.21.15.77:0/4275843481 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fce2806bb60 0x7fce28070530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:51.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.560+0000 7fce2d0d4640 1 -- 172.21.15.77:0/4275843481 >> 172.21.15.77:0/4275843481 conn(0x7fce280cb530 msgr2=0x7fce280cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:51.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.560+0000 7fce2d0d4640 1 -- 172.21.15.77:0/4275843481 shutdown_connections 2023-11-04T01:46:51.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.560+0000 7fce2d0d4640 1 -- 172.21.15.77:0/4275843481 wait complete. 2023-11-04T01:46:51.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.561+0000 7fce2d0d4640 1 Processor -- start 2023-11-04T01:46:51.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.561+0000 7fce2d0d4640 1 -- start start 2023-11-04T01:46:51.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.562+0000 7fce2d0d4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce2806bb60 0x7fce281583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:51.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.562+0000 7fce2d0d4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce280b0c40 0x7fce28158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:51.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.562+0000 7fce2d0d4640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fce28159e40 0x7fce280c70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:51.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.562+0000 7fce2d0d4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce281eea90 con 0x7fce2806bb60 2023-11-04T01:46:51.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.562+0000 7fce2d0d4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce280c4930 con 0x7fce280b0c40 2023-11-04T01:46:51.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.562+0000 7fce2d0d4640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce280c5730 con 0x7fce28159e40 2023-11-04T01:46:51.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.562+0000 7fce26d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce2806bb60 0x7fce281583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:51.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.562+0000 7fce26d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce2806bb60 0x7fce281583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41744/0 (socket says 172.21.15.77:41744) 2023-11-04T01:46:51.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.562+0000 7fce26d9d640 1 -- 172.21.15.77:0/3875947907 learned_addr learned my addr 172.21.15.77:0/3875947907 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:51.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.562+0000 7fce2659c640 1 --2- 172.21.15.77:0/3875947907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce280b0c40 0x7fce28158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:51.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.562+0000 7fce2759e640 1 --2- 172.21.15.77:0/3875947907 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fce28159e40 0x7fce280c70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:51.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.562+0000 7fce26d9d640 1 -- 172.21.15.77:0/3875947907 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fce28159e40 msgr2=0x7fce280c70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:51.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.562+0000 7fce26d9d640 1 --2- 172.21.15.77:0/3875947907 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fce28159e40 0x7fce280c70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:51.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.562+0000 7fce26d9d640 1 -- 172.21.15.77:0/3875947907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce280b0c40 msgr2=0x7fce28158ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:51.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.562+0000 7fce26d9d640 1 --2- 172.21.15.77:0/3875947907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce280b0c40 0x7fce28158ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:51.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.562+0000 7fce26d9d640 1 -- 172.21.15.77:0/3875947907 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce1c00b6a0 con 0x7fce2806bb60 2023-11-04T01:46:51.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.562+0000 7fce2659c640 1 --2- 172.21.15.77:0/3875947907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce280b0c40 0x7fce28158ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:51.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.563+0000 7fce26d9d640 1 --2- 172.21.15.77:0/3875947907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce2806bb60 0x7fce281583e0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fce1800c480 tx=0x7fce1800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:51.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.563+0000 7fce0f7fe640 1 -- 172.21.15.77:0/3875947907 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce18005ce0 con 0x7fce2806bb60 2023-11-04T01:46:51.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.563+0000 7fce0f7fe640 1 -- 172.21.15.77:0/3875947907 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce18005e40 con 0x7fce2806bb60 2023-11-04T01:46:51.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.563+0000 7fce2d0d4640 1 -- 172.21.15.77:0/3875947907 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce280c8990 con 0x7fce2806bb60 2023-11-04T01:46:51.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.563+0000 7fce0f7fe640 1 -- 172.21.15.77:0/3875947907 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce180072f0 con 0x7fce2806bb60 2023-11-04T01:46:51.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.563+0000 7fce2d0d4640 1 -- 172.21.15.77:0/3875947907 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce280c4e90 con 0x7fce2806bb60 2023-11-04T01:46:51.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.564+0000 7fce2d0d4640 1 -- 172.21.15.77:0/3875947907 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce280684b0 con 0x7fce2806bb60 2023-11-04T01:46:51.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.564+0000 7fce0f7fe640 1 -- 172.21.15.77:0/3875947907 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fce18007510 con 0x7fce2806bb60 2023-11-04T01:46:51.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.565+0000 7fce0f7fe640 1 --2- 172.21.15.77:0/3875947907 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fce1406ae70 0x7fce1406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:51.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.565+0000 7fce0f7fe640 1 -- 172.21.15.77:0/3875947907 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7909+0+0 (secure 0 0 0) 0x7fce18089340 con 0x7fce2806bb60 2023-11-04T01:46:51.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.565+0000 7fce2659c640 1 --2- 172.21.15.77:0/3875947907 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fce1406ae70 0x7fce1406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:51.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.565+0000 7fce2659c640 1 --2- 172.21.15.77:0/3875947907 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fce1406ae70 0x7fce1406d330 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fce1c038000 tx=0x7fce1c032000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:51.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.569+0000 7fce0f7fe640 1 -- 172.21.15.77:0/3875947907 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fce18053c90 con 0x7fce2806bb60 2023-11-04T01:46:51.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.771+0000 7fce2d0d4640 1 -- 172.21.15.77:0/3875947907 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce280c9750 con 0x7fce2806bb60 2023-11-04T01:46:51.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.772+0000 7fce0f7fe640 1 -- 172.21.15.77:0/3875947907 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+4948 (secure 0 0 0) 0x7fce18017020 con 0x7fce2806bb60 2023-11-04T01:46:51.774 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:46:51.774 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":102,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7033,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2238841748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2238841748},{"type":"v1","addr":"172.21.15.122:6836","nonce":2238841748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:46:47.114701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8139,"mds_1":8343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8139":{"gid":8139,"name":"c","rank":0,"incarnation":97,"state":"up:reconnect","state_seq":13,"addr":"172.21.15.77:6835/2107153526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2107153526},{"type":"v1","addr":"172.21.15.77:6835","nonce":2107153526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8343":{"gid":8343,"name":"a","rank":1,"incarnation":100,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.77:6834/4183807043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4183807043},{"type":"v1","addr":"172.21.15.77:6834","nonce":4183807043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:51.775 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 102 2023-11-04T01:46:51.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.774+0000 7fce2d0d4640 1 -- 172.21.15.77:0/3875947907 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fce1406ae70 msgr2=0x7fce1406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:51.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.774+0000 7fce2d0d4640 1 --2- 172.21.15.77:0/3875947907 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fce1406ae70 0x7fce1406d330 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fce1c038000 tx=0x7fce1c032000 comp rx=0 tx=0).stop 2023-11-04T01:46:51.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.774+0000 7fce2d0d4640 1 -- 172.21.15.77:0/3875947907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce2806bb60 msgr2=0x7fce281583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:51.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.774+0000 7fce2d0d4640 1 --2- 172.21.15.77:0/3875947907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce2806bb60 0x7fce281583e0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fce1800c480 tx=0x7fce1800c940 comp rx=0 tx=0).stop 2023-11-04T01:46:51.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.774+0000 7fce2d0d4640 1 -- 172.21.15.77:0/3875947907 shutdown_connections 2023-11-04T01:46:51.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.774+0000 7fce2d0d4640 1 --2- 172.21.15.77:0/3875947907 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fce1406ae70 0x7fce1406d330 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:51.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.774+0000 7fce2d0d4640 1 --2- 172.21.15.77:0/3875947907 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fce28159e40 0x7fce280c70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:51.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.774+0000 7fce2d0d4640 1 --2- 172.21.15.77:0/3875947907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce280b0c40 0x7fce28158ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:51.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.774+0000 7fce2d0d4640 1 --2- 172.21.15.77:0/3875947907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce2806bb60 0x7fce281583e0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:51.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.774+0000 7fce2d0d4640 1 -- 172.21.15.77:0/3875947907 >> 172.21.15.77:0/3875947907 conn(0x7fce280cb530 msgr2=0x7fce280cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:51.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.774+0000 7fce2d0d4640 1 -- 172.21.15.77:0/3875947907 shutdown_connections 2023-11-04T01:46:51.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.774+0000 7fce2d0d4640 1 -- 172.21.15.77:0/3875947907 wait complete. 2023-11-04T01:46:51.786 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:46:51.786 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:51.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.884+0000 7f1eac22d640 1 Processor -- start 2023-11-04T01:46:51.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.884+0000 7f1eac22d640 1 -- start start 2023-11-04T01:46:51.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.885+0000 7f1eac22d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f1ea40ca1a0 0x7f1ea40ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:51.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.885+0000 7f1eac22d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ea406a0d0 0x7f1ea406a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:51.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.885+0000 7f1eac22d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ea40b25a0 con 0x7f1ea415d4e0 2023-11-04T01:46:51.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.885+0000 7f1eac22d640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ea40cab60 con 0x7f1ea40ca1a0 2023-11-04T01:46:51.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.885+0000 7f1eac22d640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea40b2300 con 0x7f1ea406a0d0 2023-11-04T01:46:51.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.885+0000 7f1ea9fc9640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f1ea415d4e0 0x7f1ea40ce850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49872/0 (socket says 172.21.15.77:49872) 2023-11-04T01:46:51.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.885+0000 7f1ea9fc9640 1 -- 172.21.15.77:0/3687816601 learned_addr learned my addr 172.21.15.77:0/3687816601 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:46:51.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.885+0000 7f1ea8fc7640 1 -- 172.21.15.77:0/3687816601 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1809213421 0 0) 0x7f1ea40b25a0 con 0x7f1ea415d4e0 2023-11-04T01:46:51.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.885+0000 7f1ea8fc7640 1 -- 172.21.15.77:0/3687816601 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e90003520 con 0x7f1ea415d4e0 2023-11-04T01:46:51.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.885+0000 7f1ea97c8640 1 --2- 172.21.15.77:0/3687816601 >> v2:172.21.15.122:3300/0 conn(0x7f1ea40ca1a0 0x7f1ea40ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:51.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.885+0000 7f1eaa7ca640 1 --2- 172.21.15.77:0/3687816601 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ea406a0d0 0x7f1ea406a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:51.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.885+0000 7f1ea8fc7640 1 -- 172.21.15.77:0/3687816601 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3038931640 0 0) 0x7f1e90003520 con 0x7f1ea415d4e0 2023-11-04T01:46:51.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.885+0000 7f1ea8fc7640 1 -- 172.21.15.77:0/3687816601 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ea406a0d0 msgr2=0x7f1ea406a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:51.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.885+0000 7f1ea8fc7640 1 --2- 172.21.15.77:0/3687816601 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ea406a0d0 0x7f1ea406a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:51.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.885+0000 7f1ea8fc7640 1 -- 172.21.15.77:0/3687816601 >> v2:172.21.15.122:3300/0 conn(0x7f1ea40ca1a0 msgr2=0x7f1ea40ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:51.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.885+0000 7f1ea8fc7640 1 --2- 172.21.15.77:0/3687816601 >> v2:172.21.15.122:3300/0 conn(0x7f1ea40ca1a0 0x7f1ea40ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:51.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.885+0000 7f1ea8fc7640 1 -- 172.21.15.77:0/3687816601 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea415d8c0 con 0x7f1ea415d4e0 2023-11-04T01:46:51.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.885+0000 7f1ea8fc7640 1 -- 172.21.15.77:0/3687816601 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f1ea0001670 con 0x7f1ea415d4e0 2023-11-04T01:46:51.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.885+0000 7f1ea97c8640 1 --2- 172.21.15.77:0/3687816601 >> v2:172.21.15.122:3300/0 conn(0x7f1ea40ca1a0 0x7f1ea40ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:51.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.885+0000 7f1ea8fc7640 1 -- 172.21.15.77:0/3687816601 >> v1:172.21.15.77:6789/0 conn(0x7f1ea415d4e0 legacy=0x7f1ea40ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:51.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.886+0000 7f1ea8fc7640 1 --2- 172.21.15.77:0/3687816601 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ea406a0d0 0x7f1e90003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:51.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.886+0000 7f1ea8fc7640 1 --2- 172.21.15.77:0/3687816601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e90003f60 0x7f1e900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:51.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.886+0000 7f1ea8fc7640 1 --2- 172.21.15.77:0/3687816601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e90004d00 0x7f1e90005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:51.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.886+0000 7f1ea8fc7640 1 -- 172.21.15.77:0/3687816601 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea40cab60 con 0x7f1e90003f60 2023-11-04T01:46:51.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.886+0000 7f1ea8fc7640 1 -- 172.21.15.77:0/3687816601 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea40b2300 con 0x7f1e90004d00 2023-11-04T01:46:51.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.886+0000 7f1ea8fc7640 1 -- 172.21.15.77:0/3687816601 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9000bab0 con 0x7f1ea406a0d0 2023-11-04T01:46:51.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.886+0000 7f1ea97c8640 1 --2- 172.21.15.77:0/3687816601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e90003f60 0x7f1e900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:51.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.886+0000 7f1ea9fc9640 1 --2- 172.21.15.77:0/3687816601 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ea406a0d0 0x7f1e90003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:51.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.886+0000 7f1eaa7ca640 1 --2- 172.21.15.77:0/3687816601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e90004d00 0x7f1e90005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:51.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.886+0000 7f1ea97c8640 1 -- 172.21.15.77:0/3687816601 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ea406a0d0 msgr2=0x7f1e90003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:51.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.886+0000 7f1ea97c8640 1 --2- 172.21.15.77:0/3687816601 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1ea406a0d0 0x7f1e90003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:51.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.886+0000 7f1ea97c8640 1 -- 172.21.15.77:0/3687816601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e90004d00 msgr2=0x7f1e90005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:51.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.886+0000 7f1ea97c8640 1 --2- 172.21.15.77:0/3687816601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1e90004d00 0x7f1e90005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:51.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.886+0000 7f1ea97c8640 1 -- 172.21.15.77:0/3687816601 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e90003520 con 0x7f1e90003f60 2023-11-04T01:46:51.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.887+0000 7f1ea97c8640 1 --2- 172.21.15.77:0/3687816601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e90003f60 0x7f1e900047c0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f1e940098a0 tx=0x7f1e900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc84e095fd598284 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:51.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.887+0000 7f1ea8fc7640 1 -- 172.21.15.77:0/3687816601 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e94004230 con 0x7f1e90003f60 2023-11-04T01:46:51.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.887+0000 7f1ea8fc7640 1 -- 172.21.15.77:0/3687816601 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e94004390 con 0x7f1e90003f60 2023-11-04T01:46:51.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.887+0000 7f1ea8fc7640 1 -- 172.21.15.77:0/3687816601 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e94003830 con 0x7f1e90003f60 2023-11-04T01:46:51.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.887+0000 7f1eac22d640 1 -- 172.21.15.77:0/3687816601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e90003f60 msgr2=0x7f1e900047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:51.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.887+0000 7f1eac22d640 1 --2- 172.21.15.77:0/3687816601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e90003f60 0x7f1e900047c0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f1e940098a0 tx=0x7f1e900057f0 comp rx=0 tx=0).stop 2023-11-04T01:46:51.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.887+0000 7f1eaa7ca640 1 -- 172.21.15.77:0/3687816601 reap_dead start 2023-11-04T01:46:51.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.887+0000 7f1eac22d640 1 -- 172.21.15.77:0/3687816601 shutdown_connections 2023-11-04T01:46:51.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.887+0000 7f1eac22d640 1 -- 172.21.15.77:0/3687816601 >> 172.21.15.77:0/3687816601 conn(0x7f1ea40b1640 msgr2=0x7f1ea40b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:51.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.887+0000 7f1eac22d640 1 -- 172.21.15.77:0/3687816601 shutdown_connections 2023-11-04T01:46:51.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.887+0000 7f1eac22d640 1 -- 172.21.15.77:0/3687816601 wait complete. 2023-11-04T01:46:51.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.889+0000 7f1eac22d640 1 Processor -- start 2023-11-04T01:46:51.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.889+0000 7f1eac22d640 1 -- start start 2023-11-04T01:46:51.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.889+0000 7f1eac22d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1e90003f60 0x7f1ea4155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:51.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.889+0000 7f1eac22d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ea41f3c50 0x7f1ea40b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:51.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.889+0000 7f1eac22d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ea41f40d0 0x7f1ea40b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:51.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.889+0000 7f1eac22d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea415aad0 con 0x7f1ea41f40d0 2023-11-04T01:46:51.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.889+0000 7f1eac22d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea415adb0 con 0x7f1ea41f3c50 2023-11-04T01:46:51.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.889+0000 7f1eac22d640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea415b090 con 0x7f1e90003f60 2023-11-04T01:46:51.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.889+0000 7f1eaa7ca640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ea41f40d0 0x7f1ea40b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:51.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.889+0000 7f1eaa7ca640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ea41f40d0 0x7f1ea40b50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41758/0 (socket says 172.21.15.77:41758) 2023-11-04T01:46:51.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.889+0000 7f1eaa7ca640 1 -- 172.21.15.77:0/3662662306 learned_addr learned my addr 172.21.15.77:0/3662662306 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:51.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.890+0000 7f1ea97c8640 1 --2- 172.21.15.77:0/3662662306 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ea41f3c50 0x7f1ea40b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:51.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.890+0000 7f1ea9fc9640 1 --2- 172.21.15.77:0/3662662306 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1e90003f60 0x7f1ea4155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:51.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.890+0000 7f1eaa7ca640 1 -- 172.21.15.77:0/3662662306 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1e90003f60 msgr2=0x7f1ea4155130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:51.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.890+0000 7f1eaa7ca640 1 --2- 172.21.15.77:0/3662662306 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1e90003f60 0x7f1ea4155130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:51.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.890+0000 7f1eaa7ca640 1 -- 172.21.15.77:0/3662662306 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ea41f3c50 msgr2=0x7f1ea40b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:51.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.890+0000 7f1eaa7ca640 1 --2- 172.21.15.77:0/3662662306 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ea41f3c50 0x7f1ea40b4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:51.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.890+0000 7f1eaa7ca640 1 -- 172.21.15.77:0/3662662306 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea415b370 con 0x7f1ea41f40d0 2023-11-04T01:46:51.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.890+0000 7f1ea9fc9640 1 --2- 172.21.15.77:0/3662662306 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1e90003f60 0x7f1ea4155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:51.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.890+0000 7f1ea97c8640 1 --2- 172.21.15.77:0/3662662306 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ea41f3c50 0x7f1ea40b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:51.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.890+0000 7f1eaa7ca640 1 --2- 172.21.15.77:0/3662662306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ea41f40d0 0x7f1ea40b50b0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4061e60 tx=0x7f1e9c007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:51.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.890+0000 7f1e9a7fc640 1 -- 172.21.15.77:0/3662662306 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c0046a0 con 0x7f1ea41f40d0 2023-11-04T01:46:51.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.890+0000 7f1e9a7fc640 1 -- 172.21.15.77:0/3662662306 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9c004800 con 0x7f1ea41f40d0 2023-11-04T01:46:51.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.890+0000 7f1eac22d640 1 -- 172.21.15.77:0/3662662306 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ea415b650 con 0x7f1ea41f40d0 2023-11-04T01:46:51.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.890+0000 7f1e9a7fc640 1 -- 172.21.15.77:0/3662662306 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c015660 con 0x7f1ea41f40d0 2023-11-04T01:46:51.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.890+0000 7f1eac22d640 1 -- 172.21.15.77:0/3662662306 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ea4155670 con 0x7f1ea41f40d0 2023-11-04T01:46:51.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.891+0000 7f1eac22d640 1 -- 172.21.15.77:0/3662662306 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ea415bb70 con 0x7f1ea41f40d0 2023-11-04T01:46:51.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.891+0000 7f1e9a7fc640 1 -- 172.21.15.77:0/3662662306 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1e9c0157c0 con 0x7f1ea41f40d0 2023-11-04T01:46:51.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.892+0000 7f1e9a7fc640 1 --2- 172.21.15.77:0/3662662306 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1e8806aea0 0x7f1e8806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:51.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.892+0000 7f1e9a7fc640 1 -- 172.21.15.77:0/3662662306 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7909+0+0 (secure 0 0 0) 0x7f1e9c08a420 con 0x7f1ea41f40d0 2023-11-04T01:46:51.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.892+0000 7f1ea9fc9640 1 --2- 172.21.15.77:0/3662662306 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1e8806aea0 0x7f1e8806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:51.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.892+0000 7f1ea9fc9640 1 --2- 172.21.15.77:0/3662662306 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1e8806aea0 0x7f1e8806d360 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f1ea41f6090 tx=0x7f1ea000a040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:51.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:51.896+0000 7f1e9a7fc640 1 -- 172.21.15.77:0/3662662306 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1ea415bb70 con 0x7f1ea41f40d0 2023-11-04T01:46:52.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:52.099+0000 7f1eac22d640 1 -- 172.21.15.77:0/3662662306 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ea415bb70 con 0x7f1ea41f40d0 2023-11-04T01:46:52.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:52.099+0000 7f1e9a7fc640 1 -- 172.21.15.77:0/3662662306 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+4948 (secure 0 0 0) 0x7f1ea415bb70 con 0x7f1ea41f40d0 2023-11-04T01:46:52.102 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:46:52.102 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":102,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7033,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2238841748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2238841748},{"type":"v1","addr":"172.21.15.122:6836","nonce":2238841748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:46:47.114701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8139,"mds_1":8343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8139":{"gid":8139,"name":"c","rank":0,"incarnation":97,"state":"up:reconnect","state_seq":13,"addr":"172.21.15.77:6835/2107153526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2107153526},{"type":"v1","addr":"172.21.15.77:6835","nonce":2107153526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8343":{"gid":8343,"name":"a","rank":1,"incarnation":100,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.77:6834/4183807043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4183807043},{"type":"v1","addr":"172.21.15.77:6834","nonce":4183807043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:52.103 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 102 2023-11-04T01:46:52.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:52.101+0000 7f1eac22d640 1 -- 172.21.15.77:0/3662662306 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1e8806aea0 msgr2=0x7f1e8806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:52.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:52.101+0000 7f1eac22d640 1 --2- 172.21.15.77:0/3662662306 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1e8806aea0 0x7f1e8806d360 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f1ea41f6090 tx=0x7f1ea000a040 comp rx=0 tx=0).stop 2023-11-04T01:46:52.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:52.101+0000 7f1eac22d640 1 -- 172.21.15.77:0/3662662306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ea41f40d0 msgr2=0x7f1ea40b50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:52.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:52.101+0000 7f1eac22d640 1 --2- 172.21.15.77:0/3662662306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ea41f40d0 0x7f1ea40b50b0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4061e60 tx=0x7f1e9c007700 comp rx=0 tx=0).stop 2023-11-04T01:46:52.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:52.101+0000 7f1eac22d640 1 -- 172.21.15.77:0/3662662306 shutdown_connections 2023-11-04T01:46:52.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:52.101+0000 7f1eac22d640 1 --2- 172.21.15.77:0/3662662306 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1e8806aea0 0x7f1e8806d360 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:52.101+0000 7f1eac22d640 1 --2- 172.21.15.77:0/3662662306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ea41f40d0 0x7f1ea40b50b0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:52.101+0000 7f1eac22d640 1 --2- 172.21.15.77:0/3662662306 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ea41f3c50 0x7f1ea40b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:52.101+0000 7f1eac22d640 1 --2- 172.21.15.77:0/3662662306 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f1e90003f60 0x7f1ea4155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:52.101+0000 7f1eac22d640 1 -- 172.21.15.77:0/3662662306 >> 172.21.15.77:0/3662662306 conn(0x7f1ea40b1640 msgr2=0x7f1ea40acaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:52.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:52.101+0000 7f1eac22d640 1 -- 172.21.15.77:0/3662662306 shutdown_connections 2023-11-04T01:46:52.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:52.101+0000 7f1eac22d640 1 -- 172.21.15.77:0/3662662306 wait complete. 2023-11-04T01:46:52.113 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:46:52.935 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-11-04T01:46:53.115 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:53.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.225+0000 7fc7f4765640 1 Processor -- start 2023-11-04T01:46:53.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.225+0000 7fc7f4765640 1 -- start start 2023-11-04T01:46:53.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.226+0000 7fc7f4765640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fc7ec0cc680 0x7fc7ec0cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.226+0000 7fc7f4765640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc7ec06c220 0x7fc7ec0ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.226+0000 7fc7f4765640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7ec0cd720 con 0x7fc7ec0addd0 2023-11-04T01:46:53.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.226+0000 7fc7f4765640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7ec0ae1b0 con 0x7fc7ec06c220 2023-11-04T01:46:53.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.226+0000 7fc7f4765640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7ec0ccb10 con 0x7fc7ec0cc680 2023-11-04T01:46:53.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.226+0000 7fc7f2d02640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc7ec06c220 0x7fc7ec0ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.226+0000 7fc7f2501640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc7ec0addd0 0x7fc7ec06bb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49886/0 (socket says 172.21.15.77:49886) 2023-11-04T01:46:53.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.226+0000 7fc7f2501640 1 -- 172.21.15.77:0/3940653054 learned_addr learned my addr 172.21.15.77:0/3940653054 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:46:53.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.226+0000 7fc7f1d00640 1 --2- 172.21.15.77:0/3940653054 >> v2:172.21.15.122:3300/0 conn(0x7fc7ec0cc680 0x7fc7ec0cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.226+0000 7fc7f2d02640 1 -- 172.21.15.77:0/3940653054 >> v2:172.21.15.122:3300/0 conn(0x7fc7ec0cc680 msgr2=0x7fc7ec0cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:53.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.226+0000 7fc7f2d02640 1 --2- 172.21.15.77:0/3940653054 >> v2:172.21.15.122:3300/0 conn(0x7fc7ec0cc680 0x7fc7ec0cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.226+0000 7fc7f2d02640 1 -- 172.21.15.77:0/3940653054 >> v1:172.21.15.77:6789/0 conn(0x7fc7ec0addd0 legacy=0x7fc7ec06bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:53.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.226+0000 7fc7f2d02640 1 -- 172.21.15.77:0/3940653054 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7ec0ccdf0 con 0x7fc7ec06c220 2023-11-04T01:46:53.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.226+0000 7fc7f1d00640 1 --2- 172.21.15.77:0/3940653054 >> v2:172.21.15.122:3300/0 conn(0x7fc7ec0cc680 0x7fc7ec0cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:53.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.227+0000 7fc7f2d02640 1 --2- 172.21.15.77:0/3940653054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7ec06c220 0x7fc7ec0ca2d0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec0b1650 tx=0x7fc7e402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de527f267aece92a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:53.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.227+0000 7fc7f14ff640 1 -- 172.21.15.77:0/3940653054 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e402cc80 con 0x7fc7ec06c220 2023-11-04T01:46:53.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.227+0000 7fc7f14ff640 1 -- 172.21.15.77:0/3940653054 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e402cde0 con 0x7fc7ec06c220 2023-11-04T01:46:53.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.227+0000 7fc7f14ff640 1 -- 172.21.15.77:0/3940653054 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e4034660 con 0x7fc7ec06c220 2023-11-04T01:46:53.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.228+0000 7fc7f4765640 1 -- 172.21.15.77:0/3940653054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7ec06c220 msgr2=0x7fc7ec0ca2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:53.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.228+0000 7fc7f4765640 1 --2- 172.21.15.77:0/3940653054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7ec06c220 0x7fc7ec0ca2d0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec0b1650 tx=0x7fc7e402bed0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.228+0000 7fc7f4765640 1 -- 172.21.15.77:0/3940653054 shutdown_connections 2023-11-04T01:46:53.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.228+0000 7fc7f4765640 1 --2- 172.21.15.77:0/3940653054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7ec06c220 0x7fc7ec0ca2d0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.228+0000 7fc7f4765640 1 --2- 172.21.15.77:0/3940653054 >> v2:172.21.15.122:3300/0 conn(0x7fc7ec0cc680 0x7fc7ec0cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.228+0000 7fc7f4765640 1 -- 172.21.15.77:0/3940653054 >> 172.21.15.77:0/3940653054 conn(0x7fc7ec0cb530 msgr2=0x7fc7ec0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:53.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.228+0000 7fc7f4765640 1 -- 172.21.15.77:0/3940653054 shutdown_connections 2023-11-04T01:46:53.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.228+0000 7fc7f4765640 1 -- 172.21.15.77:0/3940653054 wait complete. 2023-11-04T01:46:53.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.229+0000 7fc7f4765640 1 Processor -- start 2023-11-04T01:46:53.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.229+0000 7fc7f4765640 1 -- start start 2023-11-04T01:46:53.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.230+0000 7fc7f4765640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7ec06c220 0x7fc7ec0c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.230+0000 7fc7f4765640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc7ec0addd0 0x7fc7ec15c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.230+0000 7fc7f4765640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7ec144bf0 0x7fc7ec0ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.230+0000 7fc7f4765640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ec0c8db0 con 0x7fc7ec06c220 2023-11-04T01:46:53.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.230+0000 7fc7f4765640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ec0c8130 con 0x7fc7ec144bf0 2023-11-04T01:46:53.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.230+0000 7fc7f4765640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ec0c8410 con 0x7fc7ec0addd0 2023-11-04T01:46:53.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.230+0000 7fc7f2501640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7ec06c220 0x7fc7ec0c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.230+0000 7fc7f2501640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7ec06c220 0x7fc7ec0c7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41778/0 (socket says 172.21.15.77:41778) 2023-11-04T01:46:53.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.230+0000 7fc7f2501640 1 -- 172.21.15.77:0/3181860150 learned_addr learned my addr 172.21.15.77:0/3181860150 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:53.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.230+0000 7fc7f2d02640 1 --2- 172.21.15.77:0/3181860150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7ec144bf0 0x7fc7ec0ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.230+0000 7fc7f1d00640 1 --2- 172.21.15.77:0/3181860150 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc7ec0addd0 0x7fc7ec15c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.230+0000 7fc7f2501640 1 -- 172.21.15.77:0/3181860150 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc7ec0addd0 msgr2=0x7fc7ec15c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:53.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.230+0000 7fc7f2501640 1 --2- 172.21.15.77:0/3181860150 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc7ec0addd0 0x7fc7ec15c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.230+0000 7fc7f2501640 1 -- 172.21.15.77:0/3181860150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7ec144bf0 msgr2=0x7fc7ec0ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:53.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.230+0000 7fc7f2501640 1 --2- 172.21.15.77:0/3181860150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7ec144bf0 0x7fc7ec0ac8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.230+0000 7fc7f2501640 1 -- 172.21.15.77:0/3181860150 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e4009a70 con 0x7fc7ec06c220 2023-11-04T01:46:53.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.230+0000 7fc7f2d02640 1 --2- 172.21.15.77:0/3181860150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7ec144bf0 0x7fc7ec0ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:53.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.230+0000 7fc7f1d00640 1 --2- 172.21.15.77:0/3181860150 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc7ec0addd0 0x7fc7ec15c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:53.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.230+0000 7fc7f2501640 1 --2- 172.21.15.77:0/3181860150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7ec06c220 0x7fc7ec0c7a50 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fc7e800c4a0 tx=0x7fc7e800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:53.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.230+0000 7fc7e2ffd640 1 -- 172.21.15.77:0/3181860150 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8005ce0 con 0x7fc7ec06c220 2023-11-04T01:46:53.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.230+0000 7fc7e2ffd640 1 -- 172.21.15.77:0/3181860150 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e8005e40 con 0x7fc7ec06c220 2023-11-04T01:46:53.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.230+0000 7fc7f4765640 1 -- 172.21.15.77:0/3181860150 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7ec0c86f0 con 0x7fc7ec06c220 2023-11-04T01:46:53.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.230+0000 7fc7e2ffd640 1 -- 172.21.15.77:0/3181860150 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8007270 con 0x7fc7ec06c220 2023-11-04T01:46:53.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.230+0000 7fc7f4765640 1 -- 172.21.15.77:0/3181860150 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7ec15c9c0 con 0x7fc7ec06c220 2023-11-04T01:46:53.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.231+0000 7fc7f4765640 1 -- 172.21.15.77:0/3181860150 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7ec0684b0 con 0x7fc7ec06c220 2023-11-04T01:46:53.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.232+0000 7fc7e2ffd640 1 -- 172.21.15.77:0/3181860150 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc7e8007490 con 0x7fc7ec06c220 2023-11-04T01:46:53.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.232+0000 7fc7e2ffd640 1 --2- 172.21.15.77:0/3181860150 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc7d006ae70 0x7fc7d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.232+0000 7fc7e2ffd640 1 -- 172.21.15.77:0/3181860150 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7909+0+0 (secure 0 0 0) 0x7fc7e8089400 con 0x7fc7ec06c220 2023-11-04T01:46:53.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.232+0000 7fc7f1d00640 1 --2- 172.21.15.77:0/3181860150 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc7d006ae70 0x7fc7d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.233+0000 7fc7f1d00640 1 --2- 172.21.15.77:0/3181860150 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc7d006ae70 0x7fc7d006d330 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec152ee0 tx=0x7fc7dc008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:53.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.237+0000 7fc7e2ffd640 1 -- 172.21.15.77:0/3181860150 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc7e8053c30 con 0x7fc7ec06c220 2023-11-04T01:46:53.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.440+0000 7fc7f4765640 1 -- 172.21.15.77:0/3181860150 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7ec0b4a30 con 0x7fc7ec06c220 2023-11-04T01:46:53.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.440+0000 7fc7e2ffd640 1 -- 172.21.15.77:0/3181860150 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+4948 (secure 0 0 0) 0x7fc7e8017070 con 0x7fc7ec06c220 2023-11-04T01:46:53.442 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:46:53.443 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":102,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7033,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2238841748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2238841748},{"type":"v1","addr":"172.21.15.122:6836","nonce":2238841748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:46:47.114701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8139,"mds_1":8343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8139":{"gid":8139,"name":"c","rank":0,"incarnation":97,"state":"up:reconnect","state_seq":13,"addr":"172.21.15.77:6835/2107153526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2107153526},{"type":"v1","addr":"172.21.15.77:6835","nonce":2107153526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8343":{"gid":8343,"name":"a","rank":1,"incarnation":100,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.77:6834/4183807043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4183807043},{"type":"v1","addr":"172.21.15.77:6834","nonce":4183807043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:53.443 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 102 2023-11-04T01:46:53.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.442+0000 7fc7f4765640 1 -- 172.21.15.77:0/3181860150 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc7d006ae70 msgr2=0x7fc7d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:53.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.442+0000 7fc7f4765640 1 --2- 172.21.15.77:0/3181860150 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc7d006ae70 0x7fc7d006d330 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec152ee0 tx=0x7fc7dc008040 comp rx=0 tx=0).stop 2023-11-04T01:46:53.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.442+0000 7fc7f4765640 1 -- 172.21.15.77:0/3181860150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7ec06c220 msgr2=0x7fc7ec0c7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:53.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.442+0000 7fc7f4765640 1 --2- 172.21.15.77:0/3181860150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7ec06c220 0x7fc7ec0c7a50 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fc7e800c4a0 tx=0x7fc7e800c960 comp rx=0 tx=0).stop 2023-11-04T01:46:53.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.442+0000 7fc7f4765640 1 -- 172.21.15.77:0/3181860150 shutdown_connections 2023-11-04T01:46:53.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.442+0000 7fc7f4765640 1 --2- 172.21.15.77:0/3181860150 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc7d006ae70 0x7fc7d006d330 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.442+0000 7fc7f4765640 1 --2- 172.21.15.77:0/3181860150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7ec144bf0 0x7fc7ec0ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.442+0000 7fc7f4765640 1 --2- 172.21.15.77:0/3181860150 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc7ec0addd0 0x7fc7ec15c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.442+0000 7fc7f4765640 1 --2- 172.21.15.77:0/3181860150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7ec06c220 0x7fc7ec0c7a50 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.442+0000 7fc7f4765640 1 -- 172.21.15.77:0/3181860150 >> 172.21.15.77:0/3181860150 conn(0x7fc7ec0cb530 msgr2=0x7fc7ec0afab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:53.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.442+0000 7fc7f4765640 1 -- 172.21.15.77:0/3181860150 shutdown_connections 2023-11-04T01:46:53.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:53.442+0000 7fc7f4765640 1 -- 172.21.15.77:0/3181860150 wait complete. 2023-11-04T01:46:53.454 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:46:54.455 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:54.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.563+0000 7f5c9b54c640 1 Processor -- start 2023-11-04T01:46:54.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.564+0000 7f5c9b54c640 1 -- start start 2023-11-04T01:46:54.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.564+0000 7f5c9b54c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5c940b2210 0x7f5c940cf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:54.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.564+0000 7f5c9b54c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5c9415d630 0x7f5c940cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:54.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.564+0000 7f5c9b54c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c940b0150 con 0x7f5c940ceda0 2023-11-04T01:46:54.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.564+0000 7f5c9b54c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c940b1df0 con 0x7f5c940b2210 2023-11-04T01:46:54.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.564+0000 7f5c9b54c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c940b1170 con 0x7f5c9415d630 2023-11-04T01:46:54.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.565+0000 7f5c98ae7640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5c940b2210 0x7f5c940cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:54.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.565+0000 7f5c99ae9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5c9415d630 0x7f5c940cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:54.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.565+0000 7f5c992e8640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f5c940ceda0 0x7f5c9415cf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:58502/0 (socket says 172.21.15.77:58502) 2023-11-04T01:46:54.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.565+0000 7f5c992e8640 1 -- 172.21.15.77:0/1976635053 learned_addr learned my addr 172.21.15.77:0/1976635053 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:46:54.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.565+0000 7f5c93fff640 1 -- 172.21.15.77:0/1976635053 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3509800517 0 0) 0x7f5c940b0150 con 0x7f5c940ceda0 2023-11-04T01:46:54.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.565+0000 7f5c93fff640 1 -- 172.21.15.77:0/1976635053 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c7c003520 con 0x7f5c940ceda0 2023-11-04T01:46:54.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.565+0000 7f5c99ae9640 1 -- 172.21.15.77:0/1976635053 >> v2:172.21.15.122:3300/0 conn(0x7f5c940b2210 msgr2=0x7f5c940cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:54.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.565+0000 7f5c99ae9640 1 --2- 172.21.15.77:0/1976635053 >> v2:172.21.15.122:3300/0 conn(0x7f5c940b2210 0x7f5c940cf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.565+0000 7f5c99ae9640 1 -- 172.21.15.77:0/1976635053 >> v1:172.21.15.122:6789/0 conn(0x7f5c940ceda0 legacy=0x7f5c9415cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:54.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.565+0000 7f5c99ae9640 1 -- 172.21.15.77:0/1976635053 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c940b1450 con 0x7f5c9415d630 2023-11-04T01:46:54.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.565+0000 7f5c98ae7640 1 --2- 172.21.15.77:0/1976635053 >> v2:172.21.15.122:3300/0 conn(0x7f5c940b2210 0x7f5c940cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:46:54.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.566+0000 7f5c99ae9640 1 --2- 172.21.15.77:0/1976635053 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5c9415d630 0x7f5c940cf6c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5c840097a0 tx=0x7f5c8402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c985f48e4ce0ba3f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:54.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.566+0000 7f5c93fff640 1 -- 172.21.15.77:0/1976635053 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8402e070 con 0x7f5c9415d630 2023-11-04T01:46:54.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.566+0000 7f5c93fff640 1 -- 172.21.15.77:0/1976635053 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c840315a0 con 0x7f5c9415d630 2023-11-04T01:46:54.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.566+0000 7f5c93fff640 1 -- 172.21.15.77:0/1976635053 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c84031930 con 0x7f5c9415d630 2023-11-04T01:46:54.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.567+0000 7f5c9b54c640 1 -- 172.21.15.77:0/1976635053 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5c9415d630 msgr2=0x7f5c940cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:54.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.567+0000 7f5c9b54c640 1 --2- 172.21.15.77:0/1976635053 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5c9415d630 0x7f5c940cf6c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5c840097a0 tx=0x7f5c8402b840 comp rx=0 tx=0).stop 2023-11-04T01:46:54.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.567+0000 7f5c9b54c640 1 -- 172.21.15.77:0/1976635053 shutdown_connections 2023-11-04T01:46:54.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.567+0000 7f5c9b54c640 1 --2- 172.21.15.77:0/1976635053 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5c9415d630 0x7f5c940cf6c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.567+0000 7f5c9b54c640 1 --2- 172.21.15.77:0/1976635053 >> v2:172.21.15.122:3300/0 conn(0x7f5c940b2210 0x7f5c940cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.567+0000 7f5c9b54c640 1 -- 172.21.15.77:0/1976635053 >> 172.21.15.77:0/1976635053 conn(0x7f5c940d0c30 msgr2=0x7f5c940d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:54.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.567+0000 7f5c9b54c640 1 -- 172.21.15.77:0/1976635053 shutdown_connections 2023-11-04T01:46:54.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.567+0000 7f5c9b54c640 1 -- 172.21.15.77:0/1976635053 wait complete. 2023-11-04T01:46:54.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.568+0000 7f5c9b54c640 1 Processor -- start 2023-11-04T01:46:54.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.568+0000 7f5c9b54c640 1 -- start start 2023-11-04T01:46:54.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.569+0000 7f5c9b54c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5c940b2210 0x7f5c940cc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:54.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.569+0000 7f5c9b54c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c940ceda0 0x7f5c9415c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:54.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.569+0000 7f5c9b54c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c9415d630 0x7f5c9409e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:54.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.569+0000 7f5c9b54c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c940cc210 con 0x7f5c940ceda0 2023-11-04T01:46:54.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.569+0000 7f5c9b54c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c940ccb70 con 0x7f5c9415d630 2023-11-04T01:46:54.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.569+0000 7f5c9b54c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c940cb590 con 0x7f5c940b2210 2023-11-04T01:46:54.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.569+0000 7f5c98ae7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c940ceda0 0x7f5c9415c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:54.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.569+0000 7f5c98ae7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c940ceda0 0x7f5c9415c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41780/0 (socket says 172.21.15.77:41780) 2023-11-04T01:46:54.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.569+0000 7f5c98ae7640 1 -- 172.21.15.77:0/3854355887 learned_addr learned my addr 172.21.15.77:0/3854355887 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:54.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.569+0000 7f5c99ae9640 1 --2- 172.21.15.77:0/3854355887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c9415d630 0x7f5c9409e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:54.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.569+0000 7f5c992e8640 1 --2- 172.21.15.77:0/3854355887 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5c940b2210 0x7f5c940cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:54.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.569+0000 7f5c98ae7640 1 -- 172.21.15.77:0/3854355887 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5c940b2210 msgr2=0x7f5c940cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:54.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.569+0000 7f5c98ae7640 1 --2- 172.21.15.77:0/3854355887 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5c940b2210 0x7f5c940cc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.569+0000 7f5c98ae7640 1 -- 172.21.15.77:0/3854355887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c9415d630 msgr2=0x7f5c9409e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:54.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.569+0000 7f5c98ae7640 1 --2- 172.21.15.77:0/3854355887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c9415d630 0x7f5c9409e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.569+0000 7f5c98ae7640 1 -- 172.21.15.77:0/3854355887 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c88009400 con 0x7f5c940ceda0 2023-11-04T01:46:54.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.569+0000 7f5c98ae7640 1 --2- 172.21.15.77:0/3854355887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c940ceda0 0x7f5c9415c3a0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f5c8800e960 tx=0x7f5c8800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:54.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.569+0000 7f5c91ffb640 1 -- 172.21.15.77:0/3854355887 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8800ca00 con 0x7f5c940ceda0 2023-11-04T01:46:54.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.570+0000 7f5c91ffb640 1 -- 172.21.15.77:0/3854355887 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c8800cb60 con 0x7f5c940ceda0 2023-11-04T01:46:54.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.570+0000 7f5c9b54c640 1 -- 172.21.15.77:0/3854355887 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c84009400 con 0x7f5c940ceda0 2023-11-04T01:46:54.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.570+0000 7f5c91ffb640 1 -- 172.21.15.77:0/3854355887 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c88013470 con 0x7f5c940ceda0 2023-11-04T01:46:54.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.570+0000 7f5c9b54c640 1 -- 172.21.15.77:0/3854355887 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c940cbb50 con 0x7f5c940ceda0 2023-11-04T01:46:54.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.571+0000 7f5c9b54c640 1 -- 172.21.15.77:0/3854355887 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c940684b0 con 0x7f5c940ceda0 2023-11-04T01:46:54.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.571+0000 7f5c91ffb640 1 -- 172.21.15.77:0/3854355887 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5c880135d0 con 0x7f5c940ceda0 2023-11-04T01:46:54.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.571+0000 7f5c91ffb640 1 --2- 172.21.15.77:0/3854355887 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5c8006ae70 0x7f5c8006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:54.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.572+0000 7f5c91ffb640 1 -- 172.21.15.77:0/3854355887 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7909+0+0 (secure 0 0 0) 0x7f5c8808a060 con 0x7f5c940ceda0 2023-11-04T01:46:54.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.572+0000 7f5c992e8640 1 --2- 172.21.15.77:0/3854355887 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5c8006ae70 0x7f5c8006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:54.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.572+0000 7f5c992e8640 1 --2- 172.21.15.77:0/3854355887 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5c8006ae70 0x7f5c8006d330 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c0015b0 tx=0x7f5c8c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:54.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.576+0000 7f5c91ffb640 1 -- 172.21.15.77:0/3854355887 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5c880549b0 con 0x7f5c940ceda0 2023-11-04T01:46:54.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.786+0000 7f5c9b54c640 1 -- 172.21.15.77:0/3854355887 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c940d10b0 con 0x7f5c940ceda0 2023-11-04T01:46:54.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.787+0000 7f5c91ffb640 1 -- 172.21.15.77:0/3854355887 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+4948 (secure 0 0 0) 0x7f5c88017090 con 0x7f5c940ceda0 2023-11-04T01:46:54.790 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:46:54.790 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":102,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7033,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2238841748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2238841748},{"type":"v1","addr":"172.21.15.122:6836","nonce":2238841748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:46:47.114701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8139,"mds_1":8343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8139":{"gid":8139,"name":"c","rank":0,"incarnation":97,"state":"up:reconnect","state_seq":13,"addr":"172.21.15.77:6835/2107153526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2107153526},{"type":"v1","addr":"172.21.15.77:6835","nonce":2107153526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8343":{"gid":8343,"name":"a","rank":1,"incarnation":100,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.77:6834/4183807043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4183807043},{"type":"v1","addr":"172.21.15.77:6834","nonce":4183807043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:54.790 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 102 2023-11-04T01:46:54.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.788+0000 7f5c9b54c640 1 -- 172.21.15.77:0/3854355887 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5c8006ae70 msgr2=0x7f5c8006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:54.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.788+0000 7f5c9b54c640 1 --2- 172.21.15.77:0/3854355887 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5c8006ae70 0x7f5c8006d330 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c0015b0 tx=0x7f5c8c009040 comp rx=0 tx=0).stop 2023-11-04T01:46:54.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.788+0000 7f5c9b54c640 1 -- 172.21.15.77:0/3854355887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c940ceda0 msgr2=0x7f5c9415c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:54.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.788+0000 7f5c9b54c640 1 --2- 172.21.15.77:0/3854355887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c940ceda0 0x7f5c9415c3a0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f5c8800e960 tx=0x7f5c8800ee20 comp rx=0 tx=0).stop 2023-11-04T01:46:54.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.789+0000 7f5c9b54c640 1 -- 172.21.15.77:0/3854355887 shutdown_connections 2023-11-04T01:46:54.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.789+0000 7f5c9b54c640 1 --2- 172.21.15.77:0/3854355887 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5c8006ae70 0x7f5c8006d330 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.789+0000 7f5c9b54c640 1 --2- 172.21.15.77:0/3854355887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5c9415d630 0x7f5c9409e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.789+0000 7f5c9b54c640 1 --2- 172.21.15.77:0/3854355887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c940ceda0 0x7f5c9415c3a0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.789+0000 7f5c9b54c640 1 --2- 172.21.15.77:0/3854355887 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5c940b2210 0x7f5c940cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.789+0000 7f5c9b54c640 1 -- 172.21.15.77:0/3854355887 >> 172.21.15.77:0/3854355887 conn(0x7f5c940d0c30 msgr2=0x7f5c940ca1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:54.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.789+0000 7f5c9b54c640 1 -- 172.21.15.77:0/3854355887 shutdown_connections 2023-11-04T01:46:54.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:54.789+0000 7f5c9b54c640 1 -- 172.21.15.77:0/3854355887 wait complete. 2023-11-04T01:46:54.802 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:46:55.803 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:55.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.911+0000 7f6a652b4640 1 Processor -- start 2023-11-04T01:46:55.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.911+0000 7f6a652b4640 1 -- start start 2023-11-04T01:46:55.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.912+0000 7f6a652b4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6a6015d4e0 0x7f6a600d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:55.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.912+0000 7f6a652b4640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a600d3b60 0x7f6a600d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:55.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.912+0000 7f6a652b4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a600b32b0 con 0x7f6a6015d100 2023-11-04T01:46:55.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.912+0000 7f6a652b4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a600cec20 con 0x7f6a6015d4e0 2023-11-04T01:46:55.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.912+0000 7f6a652b4640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a600cee10 con 0x7f6a600d3b60 2023-11-04T01:46:55.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.912+0000 7f6a5effd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6a6015d100 0x7f6a600ce510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49894/0 (socket says 172.21.15.77:49894) 2023-11-04T01:46:55.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.912+0000 7f6a5effd640 1 -- 172.21.15.77:0/3575423578 learned_addr learned my addr 172.21.15.77:0/3575423578 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:46:55.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.912+0000 7f6a5e7fc640 1 --2- 172.21.15.77:0/3575423578 >> v2:172.21.15.77:3300/0 conn(0x7f6a6015d4e0 0x7f6a600d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:55.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.912+0000 7f6a5dffb640 1 -- 172.21.15.77:0/3575423578 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2037601026 0 0) 0x7f6a600b32b0 con 0x7f6a6015d100 2023-11-04T01:46:55.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.912+0000 7f6a5f7fe640 1 --2- 172.21.15.77:0/3575423578 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a600d3b60 0x7f6a600d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:55.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.912+0000 7f6a5dffb640 1 -- 172.21.15.77:0/3575423578 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a48003520 con 0x7f6a6015d100 2023-11-04T01:46:55.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.912+0000 7f6a5e7fc640 1 -- 172.21.15.77:0/3575423578 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a600d3b60 msgr2=0x7f6a600d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:55.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.912+0000 7f6a5e7fc640 1 --2- 172.21.15.77:0/3575423578 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a600d3b60 0x7f6a600d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:55.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.912+0000 7f6a5e7fc640 1 -- 172.21.15.77:0/3575423578 >> v1:172.21.15.77:6789/0 conn(0x7f6a6015d100 legacy=0x7f6a600ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:55.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.912+0000 7f6a5e7fc640 1 -- 172.21.15.77:0/3575423578 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a600b4750 con 0x7f6a6015d4e0 2023-11-04T01:46:55.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.912+0000 7f6a5f7fe640 1 --2- 172.21.15.77:0/3575423578 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a600d3b60 0x7f6a600d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:55.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.913+0000 7f6a5e7fc640 1 --2- 172.21.15.77:0/3575423578 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a6015d4e0 0x7f6a600d14d0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f6a540097a0 tx=0x7f6a5402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915923a021018ce2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:55.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.913+0000 7f6a5dffb640 1 -- 172.21.15.77:0/3575423578 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a54031830 con 0x7f6a6015d4e0 2023-11-04T01:46:55.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.913+0000 7f6a5dffb640 1 -- 172.21.15.77:0/3575423578 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a54031990 con 0x7f6a6015d4e0 2023-11-04T01:46:55.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.913+0000 7f6a5dffb640 1 -- 172.21.15.77:0/3575423578 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a54031d20 con 0x7f6a6015d4e0 2023-11-04T01:46:55.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.914+0000 7f6a652b4640 1 -- 172.21.15.77:0/3575423578 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a6015d4e0 msgr2=0x7f6a600d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:55.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.914+0000 7f6a652b4640 1 --2- 172.21.15.77:0/3575423578 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a6015d4e0 0x7f6a600d14d0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f6a540097a0 tx=0x7f6a5402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:46:55.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.914+0000 7f6a652b4640 1 -- 172.21.15.77:0/3575423578 shutdown_connections 2023-11-04T01:46:55.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.914+0000 7f6a652b4640 1 --2- 172.21.15.77:0/3575423578 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a6015d4e0 0x7f6a600d14d0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:55.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.914+0000 7f6a652b4640 1 --2- 172.21.15.77:0/3575423578 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a600d3b60 0x7f6a600d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:55.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.914+0000 7f6a652b4640 1 -- 172.21.15.77:0/3575423578 >> 172.21.15.77:0/3575423578 conn(0x7f6a600d2ef0 msgr2=0x7f6a600d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:55.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.914+0000 7f6a652b4640 1 -- 172.21.15.77:0/3575423578 shutdown_connections 2023-11-04T01:46:55.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.914+0000 7f6a652b4640 1 -- 172.21.15.77:0/3575423578 wait complete. 2023-11-04T01:46:55.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.915+0000 7f6a652b4640 1 Processor -- start 2023-11-04T01:46:55.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.915+0000 7f6a652b4640 1 -- start start 2023-11-04T01:46:55.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.916+0000 7f6a652b4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a600d3b60 0x7f6a601f2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:55.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.916+0000 7f6a652b4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a6015d100 0x7f6a601f2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:55.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.916+0000 7f6a652b4640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a6015d4e0 0x7f6a6015ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:55.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.916+0000 7f6a652b4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a600c9cc0 con 0x7f6a6015d100 2023-11-04T01:46:55.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.916+0000 7f6a652b4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a600b4ec0 con 0x7f6a600d3b60 2023-11-04T01:46:55.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.916+0000 7f6a652b4640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a600b51a0 con 0x7f6a6015d4e0 2023-11-04T01:46:55.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.916+0000 7f6a5e7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a6015d100 0x7f6a601f2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:55.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.916+0000 7f6a5e7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a6015d100 0x7f6a601f2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41790/0 (socket says 172.21.15.77:41790) 2023-11-04T01:46:55.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.916+0000 7f6a5e7fc640 1 -- 172.21.15.77:0/653540874 learned_addr learned my addr 172.21.15.77:0/653540874 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:55.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.916+0000 7f6a5effd640 1 --2- 172.21.15.77:0/653540874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a600d3b60 0x7f6a601f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:55.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.916+0000 7f6a5f7fe640 1 --2- 172.21.15.77:0/653540874 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a6015d4e0 0x7f6a6015ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:55.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.916+0000 7f6a5e7fc640 1 -- 172.21.15.77:0/653540874 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a6015d4e0 msgr2=0x7f6a6015ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:55.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.916+0000 7f6a5e7fc640 1 --2- 172.21.15.77:0/653540874 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a6015d4e0 0x7f6a6015ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:55.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.916+0000 7f6a5e7fc640 1 -- 172.21.15.77:0/653540874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a600d3b60 msgr2=0x7f6a601f2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:55.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.916+0000 7f6a5e7fc640 1 --2- 172.21.15.77:0/653540874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a600d3b60 0x7f6a601f2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:55.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.916+0000 7f6a5e7fc640 1 -- 172.21.15.77:0/653540874 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a54009400 con 0x7f6a6015d100 2023-11-04T01:46:55.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.916+0000 7f6a5effd640 1 --2- 172.21.15.77:0/653540874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a600d3b60 0x7f6a601f2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:55.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.916+0000 7f6a5f7fe640 1 --2- 172.21.15.77:0/653540874 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a6015d4e0 0x7f6a6015ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:55.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.917+0000 7f6a5e7fc640 1 --2- 172.21.15.77:0/653540874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a6015d100 0x7f6a601f2a50 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f6a54000c00 tx=0x7f6a540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:55.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.917+0000 7f6a477fe640 1 -- 172.21.15.77:0/653540874 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5403a830 con 0x7f6a6015d100 2023-11-04T01:46:55.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.917+0000 7f6a477fe640 1 -- 172.21.15.77:0/653540874 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5403a9b0 con 0x7f6a6015d100 2023-11-04T01:46:55.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.917+0000 7f6a652b4640 1 -- 172.21.15.77:0/653540874 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a600b5480 con 0x7f6a6015d100 2023-11-04T01:46:55.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.917+0000 7f6a477fe640 1 -- 172.21.15.77:0/653540874 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5403ad60 con 0x7f6a6015d100 2023-11-04T01:46:55.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.917+0000 7f6a652b4640 1 -- 172.21.15.77:0/653540874 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a600b5a40 con 0x7f6a6015d100 2023-11-04T01:46:55.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.918+0000 7f6a652b4640 1 -- 172.21.15.77:0/653540874 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a600684b0 con 0x7f6a6015d100 2023-11-04T01:46:55.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.918+0000 7f6a477fe640 1 -- 172.21.15.77:0/653540874 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6a5404d450 con 0x7f6a6015d100 2023-11-04T01:46:55.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.919+0000 7f6a477fe640 1 --2- 172.21.15.77:0/653540874 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6a4c06ae70 0x7f6a4c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:55.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.919+0000 7f6a477fe640 1 -- 172.21.15.77:0/653540874 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f6a540abf30 con 0x7f6a6015d100 2023-11-04T01:46:55.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.919+0000 7f6a5effd640 1 --2- 172.21.15.77:0/653540874 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6a4c06ae70 0x7f6a4c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:55.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.919+0000 7f6a5effd640 1 --2- 172.21.15.77:0/653540874 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6a4c06ae70 0x7f6a4c06d330 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6a50007fd0 tx=0x7f6a50009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:55.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:55.923+0000 7f6a477fe640 1 -- 172.21.15.77:0/653540874 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6a54076720 con 0x7f6a6015d100 2023-11-04T01:46:56.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:56.122+0000 7f6a652b4640 1 -- 172.21.15.77:0/653540874 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a600d2cd0 con 0x7f6a6015d100 2023-11-04T01:46:56.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:56.123+0000 7f6a477fe640 1 -- 172.21.15.77:0/653540874 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) v1 ==== 95+0+4942 (secure 0 0 0) 0x7f6a54035030 con 0x7f6a6015d100 2023-11-04T01:46:56.127 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:46:56.127 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":103,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7033,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2238841748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2238841748},{"type":"v1","addr":"172.21.15.122:6836","nonce":2238841748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:46:54.652994+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8139,"mds_1":8343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8139":{"gid":8139,"name":"c","rank":0,"incarnation":97,"state":"up:rejoin","state_seq":15,"addr":"172.21.15.77:6835/2107153526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2107153526},{"type":"v1","addr":"172.21.15.77:6835","nonce":2107153526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8343":{"gid":8343,"name":"a","rank":1,"incarnation":100,"state":"up:rejoin","state_seq":6,"addr":"172.21.15.77:6834/4183807043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4183807043},{"type":"v1","addr":"172.21.15.77:6834","nonce":4183807043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:56.128 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 103 2023-11-04T01:46:56.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:56.125+0000 7f6a652b4640 1 -- 172.21.15.77:0/653540874 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6a4c06ae70 msgr2=0x7f6a4c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:56.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:56.125+0000 7f6a652b4640 1 --2- 172.21.15.77:0/653540874 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6a4c06ae70 0x7f6a4c06d330 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6a50007fd0 tx=0x7f6a50009040 comp rx=0 tx=0).stop 2023-11-04T01:46:56.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:56.125+0000 7f6a652b4640 1 -- 172.21.15.77:0/653540874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a6015d100 msgr2=0x7f6a601f2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:56.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:56.125+0000 7f6a652b4640 1 --2- 172.21.15.77:0/653540874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a6015d100 0x7f6a601f2a50 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f6a54000c00 tx=0x7f6a540046c0 comp rx=0 tx=0).stop 2023-11-04T01:46:56.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:56.125+0000 7f6a652b4640 1 -- 172.21.15.77:0/653540874 shutdown_connections 2023-11-04T01:46:56.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:56.125+0000 7f6a652b4640 1 --2- 172.21.15.77:0/653540874 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f6a4c06ae70 0x7f6a4c06d330 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:56.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:56.125+0000 7f6a652b4640 1 --2- 172.21.15.77:0/653540874 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6a6015d4e0 0x7f6a6015ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:56.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:56.125+0000 7f6a652b4640 1 --2- 172.21.15.77:0/653540874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a6015d100 0x7f6a601f2a50 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:56.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:56.125+0000 7f6a652b4640 1 --2- 172.21.15.77:0/653540874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a600d3b60 0x7f6a601f2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:56.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:56.125+0000 7f6a652b4640 1 -- 172.21.15.77:0/653540874 >> 172.21.15.77:0/653540874 conn(0x7f6a600d2ef0 msgr2=0x7f6a600cf1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:56.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:56.125+0000 7f6a652b4640 1 -- 172.21.15.77:0/653540874 shutdown_connections 2023-11-04T01:46:56.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:56.125+0000 7f6a652b4640 1 -- 172.21.15.77:0/653540874 wait complete. 2023-11-04T01:46:56.138 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:rejoin 2023-11-04T01:46:57.139 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:57.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.239+0000 7fa1def33640 1 Processor -- start 2023-11-04T01:46:57.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.239+0000 7fa1def33640 1 -- start start 2023-11-04T01:46:57.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.240+0000 7fa1def33640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1d815d110 0x7fa1d806b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:57.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.240+0000 7fa1def33640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa1d80b3ca0 0x7fa1d80ace70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:57.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.240+0000 7fa1def33640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1d815d4f0 con 0x7fa1d80ad3b0 2023-11-04T01:46:57.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.240+0000 7fa1def33640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1d80664f0 con 0x7fa1d80b3ca0 2023-11-04T01:46:57.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.240+0000 7fa1def33640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d806b9f0 con 0x7fa1d815d110 2023-11-04T01:46:57.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.240+0000 7fa1dcccf640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1d815d110 0x7fa1d806b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:57.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.240+0000 7fa1cffff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa1d80b3ca0 0x7fa1d80ace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:57.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.240+0000 7fa1dd4d0640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fa1d80ad3b0 0x7fa1d80b2100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:58508/0 (socket says 172.21.15.77:58508) 2023-11-04T01:46:57.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.240+0000 7fa1dd4d0640 1 -- 172.21.15.77:0/3424885596 learned_addr learned my addr 172.21.15.77:0/3424885596 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:46:57.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.240+0000 7fa1dcccf640 1 -- 172.21.15.77:0/3424885596 >> v2:172.21.15.122:3300/0 conn(0x7fa1d80b3ca0 msgr2=0x7fa1d80ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:57.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.240+0000 7fa1dcccf640 1 --2- 172.21.15.77:0/3424885596 >> v2:172.21.15.122:3300/0 conn(0x7fa1d80b3ca0 0x7fa1d80ace70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:57.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.240+0000 7fa1dcccf640 1 -- 172.21.15.77:0/3424885596 >> v1:172.21.15.122:6789/0 conn(0x7fa1d80ad3b0 legacy=0x7fa1d80b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:57.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.240+0000 7fa1dcccf640 1 -- 172.21.15.77:0/3424885596 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d806c2e0 con 0x7fa1d815d110 2023-11-04T01:46:57.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.241+0000 7fa1dcccf640 1 --2- 172.21.15.77:0/3424885596 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1d815d110 0x7fa1d806b2f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4009790 tx=0x7fa1d402b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8425d6998feb6c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:57.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.241+0000 7fa1cf7fe640 1 -- 172.21.15.77:0/3424885596 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4031800 con 0x7fa1d815d110 2023-11-04T01:46:57.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.241+0000 7fa1cf7fe640 1 -- 172.21.15.77:0/3424885596 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d4031960 con 0x7fa1d815d110 2023-11-04T01:46:57.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.241+0000 7fa1cf7fe640 1 -- 172.21.15.77:0/3424885596 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4031cf0 con 0x7fa1d815d110 2023-11-04T01:46:57.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.242+0000 7fa1def33640 1 -- 172.21.15.77:0/3424885596 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1d815d110 msgr2=0x7fa1d806b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:57.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.242+0000 7fa1def33640 1 --2- 172.21.15.77:0/3424885596 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1d815d110 0x7fa1d806b2f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4009790 tx=0x7fa1d402b8a0 comp rx=0 tx=0).stop 2023-11-04T01:46:57.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.242+0000 7fa1def33640 1 -- 172.21.15.77:0/3424885596 shutdown_connections 2023-11-04T01:46:57.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.242+0000 7fa1def33640 1 --2- 172.21.15.77:0/3424885596 >> v2:172.21.15.122:3300/0 conn(0x7fa1d80b3ca0 0x7fa1d80ace70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:57.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.242+0000 7fa1def33640 1 --2- 172.21.15.77:0/3424885596 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1d815d110 0x7fa1d806b2f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:57.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.242+0000 7fa1def33640 1 -- 172.21.15.77:0/3424885596 >> 172.21.15.77:0/3424885596 conn(0x7fa1d80cbd30 msgr2=0x7fa1d80cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:57.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.242+0000 7fa1def33640 1 -- 172.21.15.77:0/3424885596 shutdown_connections 2023-11-04T01:46:57.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.242+0000 7fa1def33640 1 -- 172.21.15.77:0/3424885596 wait complete. 2023-11-04T01:46:57.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.243+0000 7fa1def33640 1 Processor -- start 2023-11-04T01:46:57.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.243+0000 7fa1def33640 1 -- start start 2023-11-04T01:46:57.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.244+0000 7fa1def33640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1d80ad3b0 0x7fa1d81f6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:57.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.244+0000 7fa1def33640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1d80b3ca0 0x7fa1d81595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:57.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.244+0000 7fa1def33640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1d815d110 0x7fa1d815e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:57.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.244+0000 7fa1def33640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d8070560 con 0x7fa1d80b3ca0 2023-11-04T01:46:57.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.244+0000 7fa1def33640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d80c6380 con 0x7fa1d815d110 2023-11-04T01:46:57.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.244+0000 7fa1def33640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d815c270 con 0x7fa1d80ad3b0 2023-11-04T01:46:57.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.244+0000 7fa1cffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1d80b3ca0 0x7fa1d81595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:57.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.244+0000 7fa1cffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1d80b3ca0 0x7fa1d81595c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41792/0 (socket says 172.21.15.77:41792) 2023-11-04T01:46:57.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.244+0000 7fa1cffff640 1 -- 172.21.15.77:0/2056153640 learned_addr learned my addr 172.21.15.77:0/2056153640 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:57.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.244+0000 7fa1dcccf640 1 --2- 172.21.15.77:0/2056153640 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1d80ad3b0 0x7fa1d81f6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:57.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.244+0000 7fa1dd4d0640 1 --2- 172.21.15.77:0/2056153640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1d815d110 0x7fa1d815e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:57.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.244+0000 7fa1cffff640 1 -- 172.21.15.77:0/2056153640 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1d80ad3b0 msgr2=0x7fa1d81f6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:57.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.244+0000 7fa1cffff640 1 --2- 172.21.15.77:0/2056153640 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1d80ad3b0 0x7fa1d81f6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:57.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.244+0000 7fa1cffff640 1 -- 172.21.15.77:0/2056153640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1d815d110 msgr2=0x7fa1d815e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:57.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.244+0000 7fa1cffff640 1 --2- 172.21.15.77:0/2056153640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1d815d110 0x7fa1d815e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:57.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.244+0000 7fa1cffff640 1 -- 172.21.15.77:0/2056153640 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d40093a0 con 0x7fa1d80b3ca0 2023-11-04T01:46:57.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.244+0000 7fa1cffff640 1 --2- 172.21.15.77:0/2056153640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1d80b3ca0 0x7fa1d81595c0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fa1c800e9b0 tx=0x7fa1c800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:57.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.245+0000 7fa1cd7fa640 1 -- 172.21.15.77:0/2056153640 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c8009670 con 0x7fa1d80b3ca0 2023-11-04T01:46:57.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.245+0000 7fa1cd7fa640 1 -- 172.21.15.77:0/2056153640 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c800c9a0 con 0x7fa1d80b3ca0 2023-11-04T01:46:57.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.245+0000 7fa1def33640 1 -- 172.21.15.77:0/2056153640 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1d80c8d70 con 0x7fa1d80b3ca0 2023-11-04T01:46:57.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.245+0000 7fa1cd7fa640 1 -- 172.21.15.77:0/2056153640 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c800cd50 con 0x7fa1d80b3ca0 2023-11-04T01:46:57.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.245+0000 7fa1def33640 1 -- 172.21.15.77:0/2056153640 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1d80c92f0 con 0x7fa1d80b3ca0 2023-11-04T01:46:57.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.246+0000 7fa1def33640 1 -- 172.21.15.77:0/2056153640 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d80706a0 con 0x7fa1d80b3ca0 2023-11-04T01:46:57.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.246+0000 7fa1cd7fa640 1 -- 172.21.15.77:0/2056153640 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa1c8013470 con 0x7fa1d80b3ca0 2023-11-04T01:46:57.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.246+0000 7fa1cd7fa640 1 --2- 172.21.15.77:0/2056153640 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa1c406ae70 0x7fa1c406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:57.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.247+0000 7fa1cd7fa640 1 -- 172.21.15.77:0/2056153640 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7952+0+0 (secure 0 0 0) 0x7fa1c808a100 con 0x7fa1d80b3ca0 2023-11-04T01:46:57.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.247+0000 7fa1dcccf640 1 --2- 172.21.15.77:0/2056153640 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa1c406ae70 0x7fa1c406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:57.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.247+0000 7fa1dcccf640 1 --2- 172.21.15.77:0/2056153640 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa1c406ae70 0x7fa1c406d330 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4036000 tx=0x7fa1d4008030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:57.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.251+0000 7fa1cd7fa640 1 -- 172.21.15.77:0/2056153640 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa1c8054910 con 0x7fa1d80b3ca0 2023-11-04T01:46:57.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.452+0000 7fa1def33640 1 -- 172.21.15.77:0/2056153640 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1d80684b0 con 0x7fa1d80b3ca0 2023-11-04T01:46:57.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.453+0000 7fa1cd7fa640 1 -- 172.21.15.77:0/2056153640 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4942 (secure 0 0 0) 0x7fa1c8021090 con 0x7fa1d80b3ca0 2023-11-04T01:46:57.456 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:46:57.456 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":104,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7033,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2238841748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2238841748},{"type":"v1","addr":"172.21.15.122:6836","nonce":2238841748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:46:55.646378+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8139,"mds_1":8343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8139":{"gid":8139,"name":"c","rank":0,"incarnation":97,"state":"up:active","state_seq":16,"addr":"172.21.15.77:6835/2107153526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2107153526},{"type":"v1","addr":"172.21.15.77:6835","nonce":2107153526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8343":{"gid":8343,"name":"a","rank":1,"incarnation":100,"state":"up:active","state_seq":7,"addr":"172.21.15.77:6834/4183807043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4183807043},{"type":"v1","addr":"172.21.15.77:6834","nonce":4183807043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:57.456 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 104 2023-11-04T01:46:57.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.455+0000 7fa1def33640 1 -- 172.21.15.77:0/2056153640 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa1c406ae70 msgr2=0x7fa1c406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:57.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.455+0000 7fa1def33640 1 --2- 172.21.15.77:0/2056153640 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa1c406ae70 0x7fa1c406d330 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4036000 tx=0x7fa1d4008030 comp rx=0 tx=0).stop 2023-11-04T01:46:57.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.455+0000 7fa1def33640 1 -- 172.21.15.77:0/2056153640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1d80b3ca0 msgr2=0x7fa1d81595c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:57.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.455+0000 7fa1def33640 1 --2- 172.21.15.77:0/2056153640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1d80b3ca0 0x7fa1d81595c0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fa1c800e9b0 tx=0x7fa1c800ee70 comp rx=0 tx=0).stop 2023-11-04T01:46:57.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.455+0000 7fa1def33640 1 -- 172.21.15.77:0/2056153640 shutdown_connections 2023-11-04T01:46:57.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.455+0000 7fa1def33640 1 --2- 172.21.15.77:0/2056153640 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa1c406ae70 0x7fa1c406d330 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:57.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.455+0000 7fa1def33640 1 --2- 172.21.15.77:0/2056153640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1d815d110 0x7fa1d815e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:57.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.455+0000 7fa1def33640 1 --2- 172.21.15.77:0/2056153640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1d80b3ca0 0x7fa1d81595c0 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:57.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.455+0000 7fa1def33640 1 --2- 172.21.15.77:0/2056153640 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1d80ad3b0 0x7fa1d81f6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:57.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.455+0000 7fa1def33640 1 -- 172.21.15.77:0/2056153640 >> 172.21.15.77:0/2056153640 conn(0x7fa1d80cbd30 msgr2=0x7fa1d80c98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:57.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.455+0000 7fa1def33640 1 -- 172.21.15.77:0/2056153640 shutdown_connections 2023-11-04T01:46:57.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.455+0000 7fa1def33640 1 -- 172.21.15.77:0/2056153640 wait complete. 2023-11-04T01:46:57.468 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:active 2023-11-04T01:46:57.468 DEBUG:tasks.cephfs.filesystem:reached state 'up:active' in 5.681934833526611s 2023-11-04T01:46:57.469 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:57.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.566+0000 7f72714d4640 1 Processor -- start 2023-11-04T01:46:57.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.566+0000 7f72714d4640 1 -- start start 2023-11-04T01:46:57.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.567+0000 7f72714d4640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f726c15d100 0x7f726c0ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:57.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.567+0000 7f72714d4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f726c0b32b0 con 0x7f726c15d4e0 2023-11-04T01:46:57.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.567+0000 7f72714d4640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f726c0cee10 con 0x7f726c0d1be0 2023-11-04T01:46:57.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.567+0000 7f72714d4640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f726c0b2980 con 0x7f726c15d100 2023-11-04T01:46:57.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.567+0000 7f726a7fc640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f726c15d4e0 0x7f726c0d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45802/0 (socket says 172.21.15.77:45802) 2023-11-04T01:46:57.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.567+0000 7f726a7fc640 1 -- 172.21.15.77:0/2696020605 learned_addr learned my addr 172.21.15.77:0/2696020605 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:46:57.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.567+0000 7f726affd640 1 --2- 172.21.15.77:0/2696020605 >> v2:172.21.15.122:3300/0 conn(0x7f726c15d100 0x7f726c0ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:57.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.567+0000 7f7269ffb640 1 -- 172.21.15.77:0/2696020605 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2393530376 0 0) 0x7f726c0b32b0 con 0x7f726c15d4e0 2023-11-04T01:46:57.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.568+0000 7f7269ffb640 1 -- 172.21.15.77:0/2696020605 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7254003520 con 0x7f726c15d4e0 2023-11-04T01:46:57.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.568+0000 7f726affd640 1 -- 172.21.15.77:0/2696020605 >> v1:172.21.15.122:6789/0 conn(0x7f726c0d1be0 legacy=0x7f726c0b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:57.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.568+0000 7f7269ffb640 1 -- 172.21.15.77:0/2696020605 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 635508170 0 0) 0x7f7254003520 con 0x7f726c15d4e0 2023-11-04T01:46:57.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.568+0000 7f726affd640 1 -- 172.21.15.77:0/2696020605 >> v1:172.21.15.77:6789/0 conn(0x7f726c15d4e0 legacy=0x7f726c0d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:57.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.568+0000 7f726affd640 1 -- 172.21.15.77:0/2696020605 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726c0b2c60 con 0x7f726c15d100 2023-11-04T01:46:57.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.568+0000 7f726affd640 1 --2- 172.21.15.77:0/2696020605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f726c15d100 0x7f726c0ce510 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f725c009de0 tx=0x7f725c02be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3722c5053adf7ff2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:57.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.569+0000 7f7269ffb640 1 -- 172.21.15.77:0/2696020605 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7260001670 con 0x7f726c15d100 2023-11-04T01:46:57.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.569+0000 7f7269ffb640 1 -- 172.21.15.77:0/2696020605 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725c02c980 con 0x7f726c15d100 2023-11-04T01:46:57.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.569+0000 7f7269ffb640 1 -- 172.21.15.77:0/2696020605 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c02cd10 con 0x7f726c15d100 2023-11-04T01:46:57.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.569+0000 7f72714d4640 1 -- 172.21.15.77:0/2696020605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f726c15d100 msgr2=0x7f726c0ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:57.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.569+0000 7f72714d4640 1 --2- 172.21.15.77:0/2696020605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f726c15d100 0x7f726c0ce510 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f725c009de0 tx=0x7f725c02be50 comp rx=0 tx=0).stop 2023-11-04T01:46:57.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.569+0000 7f72714d4640 1 -- 172.21.15.77:0/2696020605 shutdown_connections 2023-11-04T01:46:57.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.569+0000 7f72714d4640 1 --2- 172.21.15.77:0/2696020605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f726c15d100 0x7f726c0ce510 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:57.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.569+0000 7f72714d4640 1 -- 172.21.15.77:0/2696020605 >> 172.21.15.77:0/2696020605 conn(0x7f726c0d2ef0 msgr2=0x7f726c0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:57.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.569+0000 7f72714d4640 1 -- 172.21.15.77:0/2696020605 shutdown_connections 2023-11-04T01:46:57.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.569+0000 7f72714d4640 1 -- 172.21.15.77:0/2696020605 wait complete. 2023-11-04T01:46:57.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.571+0000 7f72714d4640 1 Processor -- start 2023-11-04T01:46:57.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.571+0000 7f72714d4640 1 -- start start 2023-11-04T01:46:57.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.571+0000 7f72714d4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f726c0d1be0 0x7f726c0b0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:57.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.571+0000 7f72714d4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f726c15d100 0x7f726c0b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:57.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.571+0000 7f72714d4640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f726c15d4e0 0x7f726c0b5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:57.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.571+0000 7f72714d4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726c0b1010 con 0x7f726c0d1be0 2023-11-04T01:46:57.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.571+0000 7f72714d4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726c0b12f0 con 0x7f726c15d100 2023-11-04T01:46:57.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.571+0000 7f72714d4640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726c0b15d0 con 0x7f726c15d4e0 2023-11-04T01:46:57.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.571+0000 7f726affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f726c0d1be0 0x7f726c0b0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:57.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.571+0000 7f726affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f726c0d1be0 0x7f726c0b0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33684/0 (socket says 172.21.15.77:33684) 2023-11-04T01:46:57.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.571+0000 7f726affd640 1 -- 172.21.15.77:0/3578997597 learned_addr learned my addr 172.21.15.77:0/3578997597 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:57.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.572+0000 7f726a7fc640 1 --2- 172.21.15.77:0/3578997597 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f726c15d100 0x7f726c0b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:57.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.572+0000 7f726b7fe640 1 --2- 172.21.15.77:0/3578997597 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f726c15d4e0 0x7f726c0b5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:57.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.572+0000 7f726affd640 1 -- 172.21.15.77:0/3578997597 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f726c15d4e0 msgr2=0x7f726c0b5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:57.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.572+0000 7f726affd640 1 --2- 172.21.15.77:0/3578997597 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f726c15d4e0 0x7f726c0b5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:57.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.572+0000 7f726affd640 1 -- 172.21.15.77:0/3578997597 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f726c15d100 msgr2=0x7f726c0b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:57.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.572+0000 7f726affd640 1 --2- 172.21.15.77:0/3578997597 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f726c15d100 0x7f726c0b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:57.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.572+0000 7f726affd640 1 -- 172.21.15.77:0/3578997597 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725c009a70 con 0x7f726c0d1be0 2023-11-04T01:46:57.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.572+0000 7f726b7fe640 1 --2- 172.21.15.77:0/3578997597 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f726c15d4e0 0x7f726c0b5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:57.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.572+0000 7f726affd640 1 --2- 172.21.15.77:0/3578997597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f726c0d1be0 0x7f726c0b0a30 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f725c037040 tx=0x7f725c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:57.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.572+0000 7f72537fe640 1 -- 172.21.15.77:0/3578997597 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c009450 con 0x7f726c0d1be0 2023-11-04T01:46:57.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.572+0000 7f72537fe640 1 -- 172.21.15.77:0/3578997597 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725c003990 con 0x7f726c0d1be0 2023-11-04T01:46:57.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.572+0000 7f72714d4640 1 -- 172.21.15.77:0/3578997597 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f726c0b18b0 con 0x7f726c0d1be0 2023-11-04T01:46:57.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.572+0000 7f72537fe640 1 -- 172.21.15.77:0/3578997597 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c003d40 con 0x7f726c0d1be0 2023-11-04T01:46:57.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.572+0000 7f72714d4640 1 -- 172.21.15.77:0/3578997597 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f726c0b20b0 con 0x7f726c0d1be0 2023-11-04T01:46:57.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.573+0000 7f72714d4640 1 -- 172.21.15.77:0/3578997597 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f726c0b1dd0 con 0x7f726c0d1be0 2023-11-04T01:46:57.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.573+0000 7f72537fe640 1 -- 172.21.15.77:0/3578997597 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f725c03b050 con 0x7f726c0d1be0 2023-11-04T01:46:57.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.574+0000 7f72537fe640 1 --2- 172.21.15.77:0/3578997597 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f725806ae70 0x7f725806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:57.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.574+0000 7f72537fe640 1 -- 172.21.15.77:0/3578997597 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f725c0ac4a0 con 0x7f726c0d1be0 2023-11-04T01:46:57.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.574+0000 7f726a7fc640 1 --2- 172.21.15.77:0/3578997597 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f725806ae70 0x7f725806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:57.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.575+0000 7f726a7fc640 1 --2- 172.21.15.77:0/3578997597 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f725806ae70 0x7f725806d330 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f726c1f66c0 tx=0x7f7260009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:57.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.578+0000 7f72537fe640 1 -- 172.21.15.77:0/3578997597 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f726c0b1dd0 con 0x7f726c0d1be0 2023-11-04T01:46:57.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.781+0000 7f72714d4640 1 -- 172.21.15.77:0/3578997597 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f726c0b1dd0 con 0x7f726c0d1be0 2023-11-04T01:46:57.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.781+0000 7f72537fe640 1 -- 172.21.15.77:0/3578997597 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4942 (secure 0 0 0) 0x7f726c0b1dd0 con 0x7f726c0d1be0 2023-11-04T01:46:57.784 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:46:57.784 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":104,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7033,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2238841748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2238841748},{"type":"v1","addr":"172.21.15.122:6836","nonce":2238841748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:46:55.646378+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8139,"mds_1":8343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8139":{"gid":8139,"name":"c","rank":0,"incarnation":97,"state":"up:active","state_seq":16,"addr":"172.21.15.77:6835/2107153526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2107153526},{"type":"v1","addr":"172.21.15.77:6835","nonce":2107153526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8343":{"gid":8343,"name":"a","rank":1,"incarnation":100,"state":"up:active","state_seq":7,"addr":"172.21.15.77:6834/4183807043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4183807043},{"type":"v1","addr":"172.21.15.77:6834","nonce":4183807043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:57.785 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 104 2023-11-04T01:46:57.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.783+0000 7f72714d4640 1 -- 172.21.15.77:0/3578997597 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f725806ae70 msgr2=0x7f725806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:57.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.783+0000 7f72714d4640 1 --2- 172.21.15.77:0/3578997597 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f725806ae70 0x7f725806d330 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f726c1f66c0 tx=0x7f7260009040 comp rx=0 tx=0).stop 2023-11-04T01:46:57.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.783+0000 7f72714d4640 1 -- 172.21.15.77:0/3578997597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f726c0d1be0 msgr2=0x7f726c0b0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:57.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.783+0000 7f72714d4640 1 --2- 172.21.15.77:0/3578997597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f726c0d1be0 0x7f726c0b0a30 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f725c037040 tx=0x7f725c004a40 comp rx=0 tx=0).stop 2023-11-04T01:46:57.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.783+0000 7f72714d4640 1 -- 172.21.15.77:0/3578997597 shutdown_connections 2023-11-04T01:46:57.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.783+0000 7f72714d4640 1 --2- 172.21.15.77:0/3578997597 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f725806ae70 0x7f725806d330 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:57.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.783+0000 7f72714d4640 1 --2- 172.21.15.77:0/3578997597 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f726c15d4e0 0x7f726c0b5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:57.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.783+0000 7f72714d4640 1 --2- 172.21.15.77:0/3578997597 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f726c15d100 0x7f726c0b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:57.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.783+0000 7f72714d4640 1 --2- 172.21.15.77:0/3578997597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f726c0d1be0 0x7f726c0b0a30 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:57.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.783+0000 7f72714d4640 1 -- 172.21.15.77:0/3578997597 >> 172.21.15.77:0/3578997597 conn(0x7f726c0d2ef0 msgr2=0x7f726c15c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:57.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.783+0000 7f72714d4640 1 -- 172.21.15.77:0/3578997597 shutdown_connections 2023-11-04T01:46:57.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:57.783+0000 7f72714d4640 1 -- 172.21.15.77:0/3578997597 wait complete. 2023-11-04T01:46:57.796 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump snaps --server 2023-11-04T01:46:57.909 INFO:teuthology.orchestra.run.smithi077.stdout:{"last_snap":11,"last_created":11,"last_destroyed":9,"pending_noop":[],"snaps":[{"snapid":11,"ino":1099511627777,"stamp":"2023-11-04T01:46:21.837860+0000","name":"s25","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:46:57.910 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 11, "last_destroyed": 9, "last_snap": 11, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s25", "snapid": 11, "stamp": "2023-11-04T01:46:21.837860+0000" } ] } 2023-11-04T01:46:57.910 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-04T01:46:57.911 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:58.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.008+0000 7f51782a2640 1 Processor -- start 2023-11-04T01:46:58.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.008+0000 7f51782a2640 1 -- start start 2023-11-04T01:46:58.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.009+0000 7f51782a2640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f51700ade00 0x7f51700b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:58.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.009+0000 7f51782a2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f517006d9c0 0x7f51700710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:58.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.009+0000 7f51782a2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f517006c5f0 0x7f5170071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:58.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.009+0000 7f51782a2640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f517006cc90 con 0x7f517006c5f0 2023-11-04T01:46:58.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.009+0000 7f51782a2640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5170071b50 con 0x7f51700ade00 2023-11-04T01:46:58.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.009+0000 7f51782a2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51700b0e60 con 0x7f517006d9c0 2023-11-04T01:46:58.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.009+0000 7f517683f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f517006c5f0 0x7f5170071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:58.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.009+0000 7f517683f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f517006c5f0 0x7f5170071610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33700/0 (socket says 172.21.15.77:33700) 2023-11-04T01:46:58.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.009+0000 7f517683f640 1 -- 172.21.15.77:0/4206143554 learned_addr learned my addr 172.21.15.77:0/4206143554 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:58.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.009+0000 7f517603e640 1 --2- 172.21.15.77:0/4206143554 >> v2:172.21.15.122:3300/0 conn(0x7f51700ade00 0x7f51700b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:58.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.009+0000 7f517583d640 1 --2- 172.21.15.77:0/4206143554 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f517006d9c0 0x7f51700710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:58.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.009+0000 7f517683f640 1 -- 172.21.15.77:0/4206143554 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f517006d9c0 msgr2=0x7f51700710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:58.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.009+0000 7f517683f640 1 --2- 172.21.15.77:0/4206143554 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f517006d9c0 0x7f51700710d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.009+0000 7f517683f640 1 -- 172.21.15.77:0/4206143554 >> v2:172.21.15.122:3300/0 conn(0x7f51700ade00 msgr2=0x7f51700b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:58.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.009+0000 7f517683f640 1 --2- 172.21.15.77:0/4206143554 >> v2:172.21.15.122:3300/0 conn(0x7f51700ade00 0x7f51700b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.009+0000 7f517683f640 1 -- 172.21.15.77:0/4206143554 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517006cee0 con 0x7f517006c5f0 2023-11-04T01:46:58.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.009+0000 7f517603e640 1 --2- 172.21.15.77:0/4206143554 >> v2:172.21.15.122:3300/0 conn(0x7f51700ade00 0x7f51700b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:58.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.010+0000 7f517683f640 1 --2- 172.21.15.77:0/4206143554 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f517006c5f0 0x7f5170071610 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f51700cb430 tx=0x7f516802bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c939cef3bf9fcbc8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:58.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.010+0000 7f517503c640 1 -- 172.21.15.77:0/4206143554 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516802c950 con 0x7f517006c5f0 2023-11-04T01:46:58.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.010+0000 7f517503c640 1 -- 172.21.15.77:0/4206143554 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516802cab0 con 0x7f517006c5f0 2023-11-04T01:46:58.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.010+0000 7f517503c640 1 -- 172.21.15.77:0/4206143554 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516802ce40 con 0x7f517006c5f0 2023-11-04T01:46:58.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.010+0000 7f51782a2640 1 -- 172.21.15.77:0/4206143554 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f517006c5f0 msgr2=0x7f5170071610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:58.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.010+0000 7f51782a2640 1 --2- 172.21.15.77:0/4206143554 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f517006c5f0 0x7f5170071610 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f51700cb430 tx=0x7f516802bdb0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.010+0000 7f51782a2640 1 -- 172.21.15.77:0/4206143554 shutdown_connections 2023-11-04T01:46:58.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.010+0000 7f51782a2640 1 --2- 172.21.15.77:0/4206143554 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f517006c5f0 0x7f5170071610 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.010+0000 7f51782a2640 1 --2- 172.21.15.77:0/4206143554 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f517006d9c0 0x7f51700710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.010+0000 7f51782a2640 1 --2- 172.21.15.77:0/4206143554 >> v2:172.21.15.122:3300/0 conn(0x7f51700ade00 0x7f51700b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.010+0000 7f51782a2640 1 -- 172.21.15.77:0/4206143554 >> 172.21.15.77:0/4206143554 conn(0x7f51700cb530 msgr2=0x7f51700cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:58.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.011+0000 7f51782a2640 1 -- 172.21.15.77:0/4206143554 shutdown_connections 2023-11-04T01:46:58.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.011+0000 7f51782a2640 1 -- 172.21.15.77:0/4206143554 wait complete. 2023-11-04T01:46:58.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.012+0000 7f51782a2640 1 Processor -- start 2023-11-04T01:46:58.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.012+0000 7f51782a2640 1 -- start start 2023-11-04T01:46:58.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.012+0000 7f51782a2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f517006c5f0 0x7f517015b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:58.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.012+0000 7f51782a2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f517006d9c0 0x7f51700c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:58.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.012+0000 7f51782a2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51700ade00 0x7f51700c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:58.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.012+0000 7f51782a2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51700a87f0 con 0x7f517006d9c0 2023-11-04T01:46:58.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.012+0000 7f51782a2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51700a8ad0 con 0x7f51700ade00 2023-11-04T01:46:58.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.012+0000 7f51782a2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51700a8db0 con 0x7f517006c5f0 2023-11-04T01:46:58.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.012+0000 7f517583d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f517006d9c0 0x7f51700c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:58.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.012+0000 7f517583d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f517006d9c0 0x7f51700c8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33714/0 (socket says 172.21.15.77:33714) 2023-11-04T01:46:58.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.012+0000 7f517583d640 1 -- 172.21.15.77:0/1637840518 learned_addr learned my addr 172.21.15.77:0/1637840518 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:58.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.013+0000 7f517603e640 1 --2- 172.21.15.77:0/1637840518 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f517006c5f0 0x7f517015b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:58.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.013+0000 7f517683f640 1 --2- 172.21.15.77:0/1637840518 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51700ade00 0x7f51700c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:58.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.013+0000 7f517583d640 1 -- 172.21.15.77:0/1637840518 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f517006c5f0 msgr2=0x7f517015b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:58.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.013+0000 7f517583d640 1 --2- 172.21.15.77:0/1637840518 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f517006c5f0 0x7f517015b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.013+0000 7f517583d640 1 -- 172.21.15.77:0/1637840518 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51700ade00 msgr2=0x7f51700c45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:58.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.013+0000 7f517583d640 1 --2- 172.21.15.77:0/1637840518 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51700ade00 0x7f51700c45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.013+0000 7f517583d640 1 -- 172.21.15.77:0/1637840518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5168009b30 con 0x7f517006d9c0 2023-11-04T01:46:58.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.013+0000 7f517603e640 1 --2- 172.21.15.77:0/1637840518 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f517006c5f0 0x7f517015b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:58.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.013+0000 7f517583d640 1 --2- 172.21.15.77:0/1637840518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f517006d9c0 0x7f51700c8400 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f516000c7f0 tx=0x7f516000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:58.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.013+0000 7f5166ffd640 1 -- 172.21.15.77:0/1637840518 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5160004230 con 0x7f517006d9c0 2023-11-04T01:46:58.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.013+0000 7f5166ffd640 1 -- 172.21.15.77:0/1637840518 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5160004390 con 0x7f517006d9c0 2023-11-04T01:46:58.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.013+0000 7f51782a2640 1 -- 172.21.15.77:0/1637840518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51700a9090 con 0x7f517006d9c0 2023-11-04T01:46:58.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.013+0000 7f5166ffd640 1 -- 172.21.15.77:0/1637840518 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5160007860 con 0x7f517006d9c0 2023-11-04T01:46:58.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.013+0000 7f51782a2640 1 -- 172.21.15.77:0/1637840518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51700a9650 con 0x7f517006d9c0 2023-11-04T01:46:58.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.014+0000 7f51782a2640 1 -- 172.21.15.77:0/1637840518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f517006c130 con 0x7f517006d9c0 2023-11-04T01:46:58.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.014+0000 7f5166ffd640 1 -- 172.21.15.77:0/1637840518 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5160007bd0 con 0x7f517006d9c0 2023-11-04T01:46:58.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.015+0000 7f5166ffd640 1 --2- 172.21.15.77:0/1637840518 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f515406ae70 0x7f515406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:58.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.015+0000 7f5166ffd640 1 -- 172.21.15.77:0/1637840518 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f5160089eb0 con 0x7f517006d9c0 2023-11-04T01:46:58.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.015+0000 7f517603e640 1 --2- 172.21.15.77:0/1637840518 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f515406ae70 0x7f515406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:58.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.016+0000 7f517603e640 1 --2- 172.21.15.77:0/1637840518 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f515406ae70 0x7f515406d330 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f516c00a910 tx=0x7f516c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:58.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.019+0000 7f5166ffd640 1 -- 172.21.15.77:0/1637840518 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5160054750 con 0x7f517006d9c0 2023-11-04T01:46:58.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.222+0000 7f51782a2640 1 -- 172.21.15.77:0/1637840518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51700684b0 con 0x7f517006d9c0 2023-11-04T01:46:58.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.222+0000 7f5166ffd640 1 -- 172.21.15.77:0/1637840518 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4942 (secure 0 0 0) 0x7f516001e070 con 0x7f517006d9c0 2023-11-04T01:46:58.225 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:46:58.226 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":104,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7033,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2238841748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2238841748},{"type":"v1","addr":"172.21.15.122:6836","nonce":2238841748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:46:55.646378+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8139,"mds_1":8343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8139":{"gid":8139,"name":"c","rank":0,"incarnation":97,"state":"up:active","state_seq":16,"addr":"172.21.15.77:6835/2107153526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2107153526},{"type":"v1","addr":"172.21.15.77:6835","nonce":2107153526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8343":{"gid":8343,"name":"a","rank":1,"incarnation":100,"state":"up:active","state_seq":7,"addr":"172.21.15.77:6834/4183807043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4183807043},{"type":"v1","addr":"172.21.15.77:6834","nonce":4183807043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:58.227 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 104 2023-11-04T01:46:58.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.224+0000 7f51782a2640 1 -- 172.21.15.77:0/1637840518 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f515406ae70 msgr2=0x7f515406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:58.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.224+0000 7f51782a2640 1 --2- 172.21.15.77:0/1637840518 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f515406ae70 0x7f515406d330 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f516c00a910 tx=0x7f516c008040 comp rx=0 tx=0).stop 2023-11-04T01:46:58.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.224+0000 7f51782a2640 1 -- 172.21.15.77:0/1637840518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f517006d9c0 msgr2=0x7f51700c8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:58.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.224+0000 7f51782a2640 1 --2- 172.21.15.77:0/1637840518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f517006d9c0 0x7f51700c8400 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f516000c7f0 tx=0x7f516000ccb0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.224+0000 7f51782a2640 1 -- 172.21.15.77:0/1637840518 shutdown_connections 2023-11-04T01:46:58.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.224+0000 7f51782a2640 1 --2- 172.21.15.77:0/1637840518 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f515406ae70 0x7f515406d330 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.224+0000 7f51782a2640 1 --2- 172.21.15.77:0/1637840518 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51700ade00 0x7f51700c45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.224+0000 7f51782a2640 1 --2- 172.21.15.77:0/1637840518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f517006d9c0 0x7f51700c8400 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.224+0000 7f51782a2640 1 --2- 172.21.15.77:0/1637840518 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f517006c5f0 0x7f517015b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.224+0000 7f51782a2640 1 -- 172.21.15.77:0/1637840518 >> 172.21.15.77:0/1637840518 conn(0x7f51700cb530 msgr2=0x7f51700ae4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:58.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.224+0000 7f51782a2640 1 -- 172.21.15.77:0/1637840518 shutdown_connections 2023-11-04T01:46:58.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.224+0000 7f51782a2640 1 -- 172.21.15.77:0/1637840518 wait complete. 2023-11-04T01:46:58.237 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump snaps --server 2023-11-04T01:46:58.350 INFO:teuthology.orchestra.run.smithi077.stdout:{"last_snap":11,"last_created":11,"last_destroyed":9,"pending_noop":[],"snaps":[{"snapid":11,"ino":1099511627777,"stamp":"2023-11-04T01:46:21.837860+0000","name":"s25","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:46:58.351 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 11, "last_destroyed": 9, "last_snap": 11, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s25", "snapid": 11, "stamp": "2023-11-04T01:46:21.837860+0000" } ] } 2023-11-04T01:46:58.351 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:46:58.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:46:58.352 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 up 2023-11-04T01:46:58.379 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:46:58.379 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:46:58.434 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:46:58.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.569+0000 7f4203815640 1 Processor -- start 2023-11-04T01:46:58.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.570+0000 7f4203815640 1 -- start start 2023-11-04T01:46:58.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.570+0000 7f4203815640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41fc15d4e0 0x7f41fc0d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:58.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.570+0000 7f4203815640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41fc0b32b0 con 0x7f41fc15d100 2023-11-04T01:46:58.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.570+0000 7f4203815640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41fc0cee10 con 0x7f41fc0d3b60 2023-11-04T01:46:58.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.570+0000 7f4203815640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41fc0cec20 con 0x7f41fc15d4e0 2023-11-04T01:46:58.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.571+0000 7f42015b1640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f41fc15d100 0x7f41fc0ce510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45804/0 (socket says 172.21.15.77:45804) 2023-11-04T01:46:58.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.571+0000 7f42015b1640 1 -- 172.21.15.77:0/1702571940 learned_addr learned my addr 172.21.15.77:0/1702571940 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:46:58.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.571+0000 7f41fbfff640 1 -- 172.21.15.77:0/1702571940 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 772791878 0 0) 0x7f41fc0b32b0 con 0x7f41fc15d100 2023-11-04T01:46:58.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.571+0000 7f4200db0640 1 --2- 172.21.15.77:0/1702571940 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41fc15d4e0 0x7f41fc0d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:58.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.571+0000 7f41fbfff640 1 -- 172.21.15.77:0/1702571940 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41e4003520 con 0x7f41fc15d100 2023-11-04T01:46:58.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.571+0000 7f41fbfff640 1 -- 172.21.15.77:0/1702571940 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 625982588 0 0) 0x7f41e4003520 con 0x7f41fc15d100 2023-11-04T01:46:58.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.571+0000 7f41fbfff640 1 -- 172.21.15.77:0/1702571940 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41fc15d4e0 msgr2=0x7f41fc0d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:58.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.571+0000 7f41fbfff640 1 --2- 172.21.15.77:0/1702571940 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41fc15d4e0 0x7f41fc0d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.571+0000 7f41fbfff640 1 -- 172.21.15.77:0/1702571940 >> v1:172.21.15.122:6789/0 conn(0x7f41fc0d3b60 legacy=0x7f41fc0b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:58.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.571+0000 7f41fbfff640 1 -- 172.21.15.77:0/1702571940 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41fc0b2980 con 0x7f41fc15d100 2023-11-04T01:46:58.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.571+0000 7f41fbfff640 1 -- 172.21.15.77:0/1702571940 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f41f40017f0 con 0x7f41fc15d100 2023-11-04T01:46:58.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.571+0000 7f41fbfff640 1 -- 172.21.15.77:0/1702571940 >> v1:172.21.15.77:6789/0 conn(0x7f41fc15d100 legacy=0x7f41fc0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:58.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.571+0000 7f41fbfff640 1 --2- 172.21.15.77:0/1702571940 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41fc15d4e0 0x7f41e40039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:58.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.571+0000 7f41fbfff640 1 --2- 172.21.15.77:0/1702571940 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41e4003f20 0x7f41e40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:58.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.571+0000 7f41fbfff640 1 --2- 172.21.15.77:0/1702571940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41e4004d00 0x7f41e4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:58.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.571+0000 7f41fbfff640 1 -- 172.21.15.77:0/1702571940 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e400ba30 con 0x7f41e4004d00 2023-11-04T01:46:58.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.571+0000 7f41fbfff640 1 -- 172.21.15.77:0/1702571940 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e400bba0 con 0x7f41e4003f20 2023-11-04T01:46:58.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.571+0000 7f41fbfff640 1 -- 172.21.15.77:0/1702571940 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e400bd60 con 0x7f41fc15d4e0 2023-11-04T01:46:58.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.571+0000 7f4201db2640 1 --2- 172.21.15.77:0/1702571940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41e4004d00 0x7f41e4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:58.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.571+0000 7f4200db0640 1 --2- 172.21.15.77:0/1702571940 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41e4003f20 0x7f41e40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:58.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.571+0000 7f42015b1640 1 --2- 172.21.15.77:0/1702571940 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41fc15d4e0 0x7f41e40039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:58.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.571+0000 7f4201db2640 1 -- 172.21.15.77:0/1702571940 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41fc15d4e0 msgr2=0x7f41e40039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:58.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.571+0000 7f4201db2640 1 --2- 172.21.15.77:0/1702571940 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41fc15d4e0 0x7f41e40039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.571+0000 7f4201db2640 1 -- 172.21.15.77:0/1702571940 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41e4003f20 msgr2=0x7f41e40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:58.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.571+0000 7f4201db2640 1 --2- 172.21.15.77:0/1702571940 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41e4003f20 0x7f41e40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.571+0000 7f4201db2640 1 -- 172.21.15.77:0/1702571940 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e4003520 con 0x7f41e4004d00 2023-11-04T01:46:58.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.571+0000 7f42015b1640 1 --2- 172.21.15.77:0/1702571940 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41fc15d4e0 0x7f41e40039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:58.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.572+0000 7f4201db2640 1 --2- 172.21.15.77:0/1702571940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41e4004d00 0x7f41e4005180 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f41ec001e50 tx=0x7f41e40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2107e76097afe893 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:58.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.572+0000 7f41fbfff640 1 -- 172.21.15.77:0/1702571940 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ec003b70 con 0x7f41e4004d00 2023-11-04T01:46:58.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.572+0000 7f41fbfff640 1 -- 172.21.15.77:0/1702571940 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41ec003cd0 con 0x7f41e4004d00 2023-11-04T01:46:58.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.572+0000 7f41fbfff640 1 -- 172.21.15.77:0/1702571940 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ec005310 con 0x7f41e4004d00 2023-11-04T01:46:58.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.573+0000 7f4203815640 1 -- 172.21.15.77:0/1702571940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41e4004d00 msgr2=0x7f41e4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:58.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.573+0000 7f4203815640 1 --2- 172.21.15.77:0/1702571940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41e4004d00 0x7f41e4005180 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f41ec001e50 tx=0x7f41e40057f0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.573+0000 7f4201db2640 1 -- 172.21.15.77:0/1702571940 reap_dead start 2023-11-04T01:46:58.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.573+0000 7f4203815640 1 -- 172.21.15.77:0/1702571940 shutdown_connections 2023-11-04T01:46:58.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.573+0000 7f4203815640 1 -- 172.21.15.77:0/1702571940 >> 172.21.15.77:0/1702571940 conn(0x7f41fc0d2ef0 msgr2=0x7f41fc0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:58.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.573+0000 7f4203815640 1 -- 172.21.15.77:0/1702571940 shutdown_connections 2023-11-04T01:46:58.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.573+0000 7f4203815640 1 -- 172.21.15.77:0/1702571940 wait complete. 2023-11-04T01:46:58.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.574+0000 7f4203815640 1 Processor -- start 2023-11-04T01:46:58.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.574+0000 7f4203815640 1 -- start start 2023-11-04T01:46:58.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.575+0000 7f4203815640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41fc0b83d0 0x7f41fc0c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:58.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.575+0000 7f4203815640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41fc0b87b0 0x7f41fc14c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:58.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.575+0000 7f4203815640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41fc0cd060 0x7f41fc14c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:58.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.575+0000 7f4203815640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41fc15f490 con 0x7f41fc0b83d0 2023-11-04T01:46:58.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.575+0000 7f4203815640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41fc0ca8a0 con 0x7f41fc0cd060 2023-11-04T01:46:58.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.575+0000 7f4203815640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41fc15e870 con 0x7f41fc0b87b0 2023-11-04T01:46:58.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.575+0000 7f42015b1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41fc0b83d0 0x7f41fc0c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:58.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.575+0000 7f42015b1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41fc0b83d0 0x7f41fc0c9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33722/0 (socket says 172.21.15.77:33722) 2023-11-04T01:46:58.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.575+0000 7f42015b1640 1 -- 172.21.15.77:0/4283554561 learned_addr learned my addr 172.21.15.77:0/4283554561 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:58.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.575+0000 7f4200db0640 1 --2- 172.21.15.77:0/4283554561 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41fc0b87b0 0x7f41fc14c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:58.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.575+0000 7f4201db2640 1 --2- 172.21.15.77:0/4283554561 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41fc0cd060 0x7f41fc14c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:58.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.575+0000 7f42015b1640 1 -- 172.21.15.77:0/4283554561 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41fc0b87b0 msgr2=0x7f41fc14c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:58.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.575+0000 7f42015b1640 1 --2- 172.21.15.77:0/4283554561 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41fc0b87b0 0x7f41fc14c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.575+0000 7f42015b1640 1 -- 172.21.15.77:0/4283554561 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41fc0cd060 msgr2=0x7f41fc14c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:58.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.575+0000 7f42015b1640 1 --2- 172.21.15.77:0/4283554561 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41fc0cd060 0x7f41fc14c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.575+0000 7f42015b1640 1 -- 172.21.15.77:0/4283554561 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41fc15f8b0 con 0x7f41fc0b83d0 2023-11-04T01:46:58.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.575+0000 7f42015b1640 1 --2- 172.21.15.77:0/4283554561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41fc0b83d0 0x7f41fc0c9fc0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f41f400e820 tx=0x7f41f400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:58.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.575+0000 7f41f9ffb640 1 -- 172.21.15.77:0/4283554561 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f40072e0 con 0x7f41fc0b83d0 2023-11-04T01:46:58.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.575+0000 7f41f9ffb640 1 -- 172.21.15.77:0/4283554561 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f4007440 con 0x7f41fc0b83d0 2023-11-04T01:46:58.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.575+0000 7f4203815640 1 -- 172.21.15.77:0/4283554561 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41fc15eaf0 con 0x7f41fc0b83d0 2023-11-04T01:46:58.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.576+0000 7f41f9ffb640 1 -- 172.21.15.77:0/4283554561 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f40057a0 con 0x7f41fc0b83d0 2023-11-04T01:46:58.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.576+0000 7f4203815640 1 -- 172.21.15.77:0/4283554561 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41fc15f0b0 con 0x7f41fc0b83d0 2023-11-04T01:46:58.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.577+0000 7f4203815640 1 -- 172.21.15.77:0/4283554561 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41fc15f240 con 0x7f41fc0b83d0 2023-11-04T01:46:58.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.577+0000 7f41f9ffb640 1 -- 172.21.15.77:0/4283554561 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f41f4005920 con 0x7f41fc0b83d0 2023-11-04T01:46:58.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.577+0000 7f41f9ffb640 1 --2- 172.21.15.77:0/4283554561 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f41e806ae70 0x7f41e806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:58.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.578+0000 7f41f9ffb640 1 -- 172.21.15.77:0/4283554561 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f41f408a110 con 0x7f41fc0b83d0 2023-11-04T01:46:58.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.578+0000 7f4200db0640 1 --2- 172.21.15.77:0/4283554561 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f41e806ae70 0x7f41e806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:58.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.578+0000 7f4200db0640 1 --2- 172.21.15.77:0/4283554561 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f41e806ae70 0x7f41e806d330 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f41fc15fef0 tx=0x7f41f0008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:58.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.582+0000 7f41f9ffb640 1 -- 172.21.15.77:0/4283554561 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f41f4054870 con 0x7f41fc0b83d0 2023-11-04T01:46:58.611 INFO:tasks.ceph.mds.c.smithi077.stderr:2023-11-04T01:46:58.609+0000 7fefdd415640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:46:58.612 INFO:tasks.ceph.mds.c.smithi077.stderr:2023-11-04T01:46:58.609+0000 7fefdd415640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:46:58.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.749+0000 7f4203815640 1 -- 172.21.15.77:0/4283554561 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41fc0684b0 con 0x7f41fc0b83d0 2023-11-04T01:46:58.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.750+0000 7f41f9ffb640 1 -- 172.21.15.77:0/4283554561 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+23278 (secure 0 0 0) 0x7f41f4057e90 con 0x7f41fc0b83d0 2023-11-04T01:46:58.753 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:46:58.754 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":112,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:46:54.633475+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:33.159064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:33.647358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:43:24.372767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-04T01:43:25.241976+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":9,"snap_epoch":108,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.7","mappings":[{"from":0,"to":5}]},{"pgid":"17.3f","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/2249624526":"2023-11-04T02:46:54.400007+0000","172.21.15.122:6834/1450731169":"2023-11-05T01:46:46.102329+0000","172.21.15.77:6834/3276812155":"2023-11-05T01:46:39.299125+0000","172.21.15.77:6832/3276812155":"2023-11-05T01:46:39.299125+0000","172.21.15.122:6836/1450731169":"2023-11-05T01:46:46.102329+0000","172.21.15.122:6834/3699147778":"2023-11-05T01:44:11.242543+0000","172.21.15.122:6836/3699147778":"2023-11-05T01:44:11.242543+0000","172.21.15.77:6834/4241784871":"2023-11-05T01:44:36.807284+0000","172.21.15.122:6834/2908314953":"2023-11-05T01:45:01.982045+0000","172.21.15.77:6834/285184758":"2023-11-05T01:45:27.182069+0000","172.21.15.122:6836/2908314953":"2023-11-05T01:45:01.982045+0000","172.21.15.122:6836/1345816612":"2023-11-05T01:45:54.789240+0000","172.21.15.77:6832/285184758":"2023-11-05T01:45:27.182069+0000","172.21.15.122:6834/1345816612":"2023-11-05T01:45:54.789240+0000","172.21.15.77:6833/3207490604":"2023-11-05T01:46:01.591697+0000","172.21.15.77:6832/4241784871":"2023-11-05T01:44:36.807284+0000","172.21.15.77:6835/3207490604":"2023-11-05T01:46:01.591697+0000","192.168.0.1:0/3032548059":"2023-11-04T02:46:09.897134+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:46:58.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.752+0000 7f4203815640 1 -- 172.21.15.77:0/4283554561 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f41e806ae70 msgr2=0x7f41e806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:58.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.752+0000 7f4203815640 1 --2- 172.21.15.77:0/4283554561 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f41e806ae70 0x7f41e806d330 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f41fc15fef0 tx=0x7f41f0008040 comp rx=0 tx=0).stop 2023-11-04T01:46:58.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.752+0000 7f4203815640 1 -- 172.21.15.77:0/4283554561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41fc0b83d0 msgr2=0x7f41fc0c9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:58.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.752+0000 7f4203815640 1 --2- 172.21.15.77:0/4283554561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41fc0b83d0 0x7f41fc0c9fc0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f41f400e820 tx=0x7f41f400ece0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.752+0000 7f4203815640 1 -- 172.21.15.77:0/4283554561 shutdown_connections 2023-11-04T01:46:58.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.752+0000 7f4203815640 1 --2- 172.21.15.77:0/4283554561 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f41e806ae70 0x7f41e806d330 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.753+0000 7f4203815640 1 --2- 172.21.15.77:0/4283554561 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41fc0cd060 0x7f41fc14c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.753+0000 7f4203815640 1 --2- 172.21.15.77:0/4283554561 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41fc0b87b0 0x7f41fc14c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.753+0000 7f4203815640 1 --2- 172.21.15.77:0/4283554561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41fc0b83d0 0x7f41fc0c9fc0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.753+0000 7f4203815640 1 -- 172.21.15.77:0/4283554561 >> 172.21.15.77:0/4283554561 conn(0x7f41fc0d2ef0 msgr2=0x7f41fc15c310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:58.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.753+0000 7f4203815640 1 -- 172.21.15.77:0/4283554561 shutdown_connections 2023-11-04T01:46:58.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.753+0000 7f4203815640 1 -- 172.21.15.77:0/4283554561 wait complete. 2023-11-04T01:46:58.766 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:33.142176+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:42:33.159064+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:42:33.647358+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:43:24.372767+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:43:25.241976+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 9, 'snap_epoch': 108, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:46:58.767 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:46:58.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.866+0000 7fa1c164f640 1 Processor -- start 2023-11-04T01:46:58.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.866+0000 7fa1c164f640 1 -- start start 2023-11-04T01:46:58.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.867+0000 7fa1c164f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa1bc0ca1a0 0x7fa1bc0ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:58.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.867+0000 7fa1c164f640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1bc06a0d0 0x7fa1bc06a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:58.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.867+0000 7fa1c164f640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1bc0b25a0 con 0x7fa1bc15d4e0 2023-11-04T01:46:58.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.867+0000 7fa1c164f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1bc0cab60 con 0x7fa1bc0ca1a0 2023-11-04T01:46:58.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.867+0000 7fa1c164f640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc0b2300 con 0x7fa1bc06a0d0 2023-11-04T01:46:58.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.867+0000 7fa1ba7fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa1bc0ca1a0 0x7fa1bc0ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:58.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.867+0000 7fa1ba7fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa1bc0ca1a0 0x7fa1bc0ca620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33730/0 (socket says 172.21.15.77:33730) 2023-11-04T01:46:58.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.867+0000 7fa1ba7fc640 1 -- 172.21.15.77:0/1260610581 learned_addr learned my addr 172.21.15.77:0/1260610581 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:58.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.868+0000 7fa1ba7fc640 1 -- 172.21.15.77:0/1260610581 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1bc06a0d0 msgr2=0x7fa1bc06a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:58.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.868+0000 7fa1ba7fc640 1 --2- 172.21.15.77:0/1260610581 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1bc06a0d0 0x7fa1bc06a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.868+0000 7fa1ba7fc640 1 -- 172.21.15.77:0/1260610581 >> v1:172.21.15.122:6789/0 conn(0x7fa1bc15d4e0 legacy=0x7fa1bc0ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:58.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.868+0000 7fa1ba7fc640 1 -- 172.21.15.77:0/1260610581 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1bc15d8c0 con 0x7fa1bc0ca1a0 2023-11-04T01:46:58.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.868+0000 7fa1ba7fc640 1 --2- 172.21.15.77:0/1260610581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1bc0ca1a0 0x7fa1bc0ca620 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0009870 tx=0x7fa1b002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32da1c71cf9b466a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:58.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.868+0000 7fa1b9ffb640 1 -- 172.21.15.77:0/1260610581 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b00317c0 con 0x7fa1bc0ca1a0 2023-11-04T01:46:58.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.869+0000 7fa1b9ffb640 1 -- 172.21.15.77:0/1260610581 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b0031920 con 0x7fa1bc0ca1a0 2023-11-04T01:46:58.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.869+0000 7fa1b9ffb640 1 -- 172.21.15.77:0/1260610581 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0031cb0 con 0x7fa1bc0ca1a0 2023-11-04T01:46:58.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.869+0000 7fa1c164f640 1 -- 172.21.15.77:0/1260610581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1bc0ca1a0 msgr2=0x7fa1bc0ca620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:58.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.869+0000 7fa1c164f640 1 --2- 172.21.15.77:0/1260610581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1bc0ca1a0 0x7fa1bc0ca620 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0009870 tx=0x7fa1b002b860 comp rx=0 tx=0).stop 2023-11-04T01:46:58.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.869+0000 7fa1c164f640 1 -- 172.21.15.77:0/1260610581 shutdown_connections 2023-11-04T01:46:58.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.869+0000 7fa1c164f640 1 --2- 172.21.15.77:0/1260610581 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1bc06a0d0 0x7fa1bc06a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.869+0000 7fa1c164f640 1 --2- 172.21.15.77:0/1260610581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1bc0ca1a0 0x7fa1bc0ca620 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.869+0000 7fa1c164f640 1 -- 172.21.15.77:0/1260610581 >> 172.21.15.77:0/1260610581 conn(0x7fa1bc0b1640 msgr2=0x7fa1bc0b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:58.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.869+0000 7fa1c164f640 1 -- 172.21.15.77:0/1260610581 shutdown_connections 2023-11-04T01:46:58.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.869+0000 7fa1c164f640 1 -- 172.21.15.77:0/1260610581 wait complete. 2023-11-04T01:46:58.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.870+0000 7fa1c164f640 1 Processor -- start 2023-11-04T01:46:58.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.870+0000 7fa1c164f640 1 -- start start 2023-11-04T01:46:58.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.871+0000 7fa1c164f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1bc06a0d0 0x7fa1bc146050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:58.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.871+0000 7fa1c164f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1bc0ca1a0 0x7fa1bc0c3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:58.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.871+0000 7fa1c164f640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1bc15d4e0 0x7fa1bc0c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:58.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.871+0000 7fa1c164f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc0b3ae0 con 0x7fa1bc0ca1a0 2023-11-04T01:46:58.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.871+0000 7fa1c164f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc0b2e60 con 0x7fa1bc06a0d0 2023-11-04T01:46:58.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.871+0000 7fa1c164f640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc0b3140 con 0x7fa1bc15d4e0 2023-11-04T01:46:58.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.871+0000 7fa1ba7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1bc0ca1a0 0x7fa1bc0c3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:58.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.871+0000 7fa1ba7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1bc0ca1a0 0x7fa1bc0c3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33736/0 (socket says 172.21.15.77:33736) 2023-11-04T01:46:58.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.871+0000 7fa1ba7fc640 1 -- 172.21.15.77:0/1644855427 learned_addr learned my addr 172.21.15.77:0/1644855427 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:58.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.871+0000 7fa1baffd640 1 --2- 172.21.15.77:0/1644855427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1bc06a0d0 0x7fa1bc146050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:58.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.871+0000 7fa1bb7fe640 1 --2- 172.21.15.77:0/1644855427 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1bc15d4e0 0x7fa1bc0c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:58.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.872+0000 7fa1ba7fc640 1 -- 172.21.15.77:0/1644855427 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1bc15d4e0 msgr2=0x7fa1bc0c3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:58.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.872+0000 7fa1ba7fc640 1 --2- 172.21.15.77:0/1644855427 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1bc15d4e0 0x7fa1bc0c3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.872+0000 7fa1ba7fc640 1 -- 172.21.15.77:0/1644855427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1bc06a0d0 msgr2=0x7fa1bc146050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:58.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.872+0000 7fa1ba7fc640 1 --2- 172.21.15.77:0/1644855427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1bc06a0d0 0x7fa1bc146050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:58.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.872+0000 7fa1ba7fc640 1 -- 172.21.15.77:0/1644855427 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b00094d0 con 0x7fa1bc0ca1a0 2023-11-04T01:46:58.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.872+0000 7fa1baffd640 1 --2- 172.21.15.77:0/1644855427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1bc06a0d0 0x7fa1bc146050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:58.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.872+0000 7fa1ba7fc640 1 --2- 172.21.15.77:0/1644855427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1bc0ca1a0 0x7fa1bc0c3680 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0000c00 tx=0x7fa1b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:58.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.872+0000 7fa1a37fe640 1 -- 172.21.15.77:0/1644855427 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0032860 con 0x7fa1bc0ca1a0 2023-11-04T01:46:58.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.872+0000 7fa1a37fe640 1 -- 172.21.15.77:0/1644855427 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b00329e0 con 0x7fa1bc0ca1a0 2023-11-04T01:46:58.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.872+0000 7fa1c164f640 1 -- 172.21.15.77:0/1644855427 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1bc0b3420 con 0x7fa1bc0ca1a0 2023-11-04T01:46:58.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.872+0000 7fa1a37fe640 1 -- 172.21.15.77:0/1644855427 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0032d90 con 0x7fa1bc0ca1a0 2023-11-04T01:46:58.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.872+0000 7fa1c164f640 1 -- 172.21.15.77:0/1644855427 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1bc0c5970 con 0x7fa1bc0ca1a0 2023-11-04T01:46:58.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.873+0000 7fa1c164f640 1 -- 172.21.15.77:0/1644855427 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1bc0b3c20 con 0x7fa1bc0ca1a0 2023-11-04T01:46:58.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.873+0000 7fa1a37fe640 1 -- 172.21.15.77:0/1644855427 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa1b004d3f0 con 0x7fa1bc0ca1a0 2023-11-04T01:46:58.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.874+0000 7fa1a37fe640 1 --2- 172.21.15.77:0/1644855427 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa1a806ae70 0x7fa1a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:58.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.874+0000 7fa1a37fe640 1 -- 172.21.15.77:0/1644855427 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7952+0+0 (secure 0 0 0) 0x7fa1b00abde0 con 0x7fa1bc0ca1a0 2023-11-04T01:46:58.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.874+0000 7fa1baffd640 1 --2- 172.21.15.77:0/1644855427 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa1a806ae70 0x7fa1a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:58.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.875+0000 7fa1baffd640 1 --2- 172.21.15.77:0/1644855427 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa1a806ae70 0x7fa1a806d330 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4009fc0 tx=0x7fa1b4009550 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:58.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:58.878+0000 7fa1a37fe640 1 -- 172.21.15.77:0/1644855427 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa1bc0b3c20 con 0x7fa1bc0ca1a0 2023-11-04T01:46:59.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.044+0000 7fa1c164f640 1 -- 172.21.15.77:0/1644855427 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa1bc0b3c20 con 0x7fa1bc0ca1a0 2023-11-04T01:46:59.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.045+0000 7fa1a37fe640 1 -- 172.21.15.77:0/1644855427 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v112) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa1bc0b3c20 con 0x7fa1bc0ca1a0 2023-11-04T01:46:59.048 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:46:59.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.047+0000 7fa1c164f640 1 -- 172.21.15.77:0/1644855427 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa1a806ae70 msgr2=0x7fa1a806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:59.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.047+0000 7fa1c164f640 1 --2- 172.21.15.77:0/1644855427 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa1a806ae70 0x7fa1a806d330 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4009fc0 tx=0x7fa1b4009550 comp rx=0 tx=0).stop 2023-11-04T01:46:59.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.047+0000 7fa1c164f640 1 -- 172.21.15.77:0/1644855427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1bc0ca1a0 msgr2=0x7fa1bc0c3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:59.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.047+0000 7fa1c164f640 1 --2- 172.21.15.77:0/1644855427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1bc0ca1a0 0x7fa1bc0c3680 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0000c00 tx=0x7fa1b00046c0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.047+0000 7fa1c164f640 1 -- 172.21.15.77:0/1644855427 shutdown_connections 2023-11-04T01:46:59.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.047+0000 7fa1c164f640 1 --2- 172.21.15.77:0/1644855427 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa1a806ae70 0x7fa1a806d330 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.047+0000 7fa1c164f640 1 --2- 172.21.15.77:0/1644855427 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa1bc15d4e0 0x7fa1bc0c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.047+0000 7fa1c164f640 1 --2- 172.21.15.77:0/1644855427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1bc0ca1a0 0x7fa1bc0c3680 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.047+0000 7fa1c164f640 1 --2- 172.21.15.77:0/1644855427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1bc06a0d0 0x7fa1bc146050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.047+0000 7fa1c164f640 1 -- 172.21.15.77:0/1644855427 >> 172.21.15.77:0/1644855427 conn(0x7fa1bc0b1640 msgr2=0x7fa1bc0adfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:59.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.047+0000 7fa1c164f640 1 -- 172.21.15.77:0/1644855427 shutdown_connections 2023-11-04T01:46:59.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.047+0000 7fa1c164f640 1 -- 172.21.15.77:0/1644855427 wait complete. 2023-11-04T01:46:59.060 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:46:59.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.160+0000 7fd766d7c640 1 Processor -- start 2023-11-04T01:46:59.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.160+0000 7fd766d7c640 1 -- start start 2023-11-04T01:46:59.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.161+0000 7fd766d7c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd7600afda0 0x7fd7600cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:59.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.161+0000 7fd766d7c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd7600cd7f0 0x7fd7600ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:59.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.161+0000 7fd766d7c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7600cf240 con 0x7fd76015b200 2023-11-04T01:46:59.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.161+0000 7fd766d7c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7600cdc20 con 0x7fd7600afda0 2023-11-04T01:46:59.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.161+0000 7fd766d7c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7600cde80 con 0x7fd7600cd7f0 2023-11-04T01:46:59.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.161+0000 7fd75ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd7600afda0 0x7fd7600cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:59.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.161+0000 7fd764b18640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd76015b200 0x7fd7600ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45808/0 (socket says 172.21.15.77:45808) 2023-11-04T01:46:59.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.161+0000 7fd764b18640 1 -- 172.21.15.77:0/3770087268 learned_addr learned my addr 172.21.15.77:0/3770087268 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:46:59.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.161+0000 7fd765319640 1 --2- 172.21.15.77:0/3770087268 >> v2:172.21.15.122:3300/0 conn(0x7fd7600cd7f0 0x7fd7600ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:59.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.162+0000 7fd75ffff640 1 -- 172.21.15.77:0/3770087268 >> v2:172.21.15.122:3300/0 conn(0x7fd7600cd7f0 msgr2=0x7fd7600ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:59.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.162+0000 7fd75ffff640 1 --2- 172.21.15.77:0/3770087268 >> v2:172.21.15.122:3300/0 conn(0x7fd7600cd7f0 0x7fd7600ae2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.162+0000 7fd75ffff640 1 -- 172.21.15.77:0/3770087268 >> v1:172.21.15.77:6789/0 conn(0x7fd76015b200 legacy=0x7fd7600ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:59.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.162+0000 7fd75f7fe640 1 -- 172.21.15.77:0/3770087268 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1049849677 0 0) 0x7fd750001290 con 0x7fd76015b200 2023-11-04T01:46:59.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.162+0000 7fd75ffff640 1 -- 172.21.15.77:0/3770087268 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7600cf670 con 0x7fd7600afda0 2023-11-04T01:46:59.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.162+0000 7fd75ffff640 1 --2- 172.21.15.77:0/3770087268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7600afda0 0x7fd7600cd2b0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fd7600711b0 tx=0x7fd75402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a0dfedd1199ad7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:59.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.162+0000 7fd75f7fe640 1 -- 172.21.15.77:0/3770087268 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75402e070 con 0x7fd7600afda0 2023-11-04T01:46:59.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.162+0000 7fd75f7fe640 1 -- 172.21.15.77:0/3770087268 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7540315a0 con 0x7fd7600afda0 2023-11-04T01:46:59.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.162+0000 7fd75f7fe640 1 -- 172.21.15.77:0/3770087268 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd754031930 con 0x7fd7600afda0 2023-11-04T01:46:59.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.163+0000 7fd766d7c640 1 -- 172.21.15.77:0/3770087268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7600afda0 msgr2=0x7fd7600cd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:59.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.163+0000 7fd766d7c640 1 --2- 172.21.15.77:0/3770087268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7600afda0 0x7fd7600cd2b0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fd7600711b0 tx=0x7fd75402b840 comp rx=0 tx=0).stop 2023-11-04T01:46:59.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.163+0000 7fd766d7c640 1 -- 172.21.15.77:0/3770087268 shutdown_connections 2023-11-04T01:46:59.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.163+0000 7fd766d7c640 1 --2- 172.21.15.77:0/3770087268 >> v2:172.21.15.122:3300/0 conn(0x7fd7600cd7f0 0x7fd7600ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.163+0000 7fd766d7c640 1 --2- 172.21.15.77:0/3770087268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7600afda0 0x7fd7600cd2b0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.163+0000 7fd766d7c640 1 -- 172.21.15.77:0/3770087268 >> 172.21.15.77:0/3770087268 conn(0x7fd7600d0c30 msgr2=0x7fd7600d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:59.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.163+0000 7fd766d7c640 1 -- 172.21.15.77:0/3770087268 shutdown_connections 2023-11-04T01:46:59.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.163+0000 7fd766d7c640 1 -- 172.21.15.77:0/3770087268 wait complete. 2023-11-04T01:46:59.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.164+0000 7fd766d7c640 1 Processor -- start 2023-11-04T01:46:59.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.164+0000 7fd766d7c640 1 -- start start 2023-11-04T01:46:59.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.165+0000 7fd766d7c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7600afda0 0x7fd760148a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:59.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.165+0000 7fd766d7c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7600cd7f0 0x7fd760147f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:59.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.165+0000 7fd766d7c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd76015b200 0x7fd76015d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:59.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.165+0000 7fd766d7c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76014b900 con 0x7fd7600afda0 2023-11-04T01:46:59.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.165+0000 7fd766d7c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7600c54a0 con 0x7fd7600cd7f0 2023-11-04T01:46:59.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.165+0000 7fd766d7c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7600c4890 con 0x7fd76015b200 2023-11-04T01:46:59.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.165+0000 7fd764b18640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7600afda0 0x7fd760148a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:59.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.165+0000 7fd764b18640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7600afda0 0x7fd760148a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33754/0 (socket says 172.21.15.77:33754) 2023-11-04T01:46:59.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.165+0000 7fd764b18640 1 -- 172.21.15.77:0/610914776 learned_addr learned my addr 172.21.15.77:0/610914776 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:59.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.165+0000 7fd764b18640 1 -- 172.21.15.77:0/610914776 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd76015b200 msgr2=0x7fd76015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:59.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.165+0000 7fd75ffff640 1 --2- 172.21.15.77:0/610914776 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7600cd7f0 0x7fd760147f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:59.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.165+0000 7fd765319640 1 --2- 172.21.15.77:0/610914776 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd76015b200 0x7fd76015d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:59.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.165+0000 7fd764b18640 1 --2- 172.21.15.77:0/610914776 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd76015b200 0x7fd76015d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.165+0000 7fd764b18640 1 -- 172.21.15.77:0/610914776 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7600cd7f0 msgr2=0x7fd760147f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:59.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.165+0000 7fd764b18640 1 --2- 172.21.15.77:0/610914776 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7600cd7f0 0x7fd760147f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.165+0000 7fd764b18640 1 -- 172.21.15.77:0/610914776 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd754009400 con 0x7fd7600afda0 2023-11-04T01:46:59.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.165+0000 7fd75ffff640 1 --2- 172.21.15.77:0/610914776 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7600cd7f0 0x7fd760147f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:59.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.165+0000 7fd765319640 1 --2- 172.21.15.77:0/610914776 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd76015b200 0x7fd76015d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:59.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.166+0000 7fd764b18640 1 --2- 172.21.15.77:0/610914776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7600afda0 0x7fd760148a90 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fd750001eb0 tx=0x7fd75000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:59.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.166+0000 7fd75d7fa640 1 -- 172.21.15.77:0/610914776 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd750007480 con 0x7fd7600afda0 2023-11-04T01:46:59.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.166+0000 7fd75d7fa640 1 -- 172.21.15.77:0/610914776 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7500075e0 con 0x7fd7600afda0 2023-11-04T01:46:59.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.166+0000 7fd766d7c640 1 -- 172.21.15.77:0/610914776 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7600c4b70 con 0x7fd7600afda0 2023-11-04T01:46:59.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.166+0000 7fd75d7fa640 1 -- 172.21.15.77:0/610914776 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7500059c0 con 0x7fd7600afda0 2023-11-04T01:46:59.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.166+0000 7fd766d7c640 1 -- 172.21.15.77:0/610914776 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7600c5130 con 0x7fd7600afda0 2023-11-04T01:46:59.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.167+0000 7fd766d7c640 1 -- 172.21.15.77:0/610914776 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7600684b0 con 0x7fd7600afda0 2023-11-04T01:46:59.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.167+0000 7fd75d7fa640 1 -- 172.21.15.77:0/610914776 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd750005b20 con 0x7fd7600afda0 2023-11-04T01:46:59.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.168+0000 7fd75d7fa640 1 --2- 172.21.15.77:0/610914776 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd74c06ae70 0x7fd74c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:59.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.168+0000 7fd75d7fa640 1 -- 172.21.15.77:0/610914776 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7952+0+0 (secure 0 0 0) 0x7fd750089270 con 0x7fd7600afda0 2023-11-04T01:46:59.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.168+0000 7fd75ffff640 1 --2- 172.21.15.77:0/610914776 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd74c06ae70 0x7fd74c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:59.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.168+0000 7fd75ffff640 1 --2- 172.21.15.77:0/610914776 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd74c06ae70 0x7fd74c06d330 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd754036000 tx=0x7fd75403d040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:59.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.172+0000 7fd75d7fa640 1 -- 172.21.15.77:0/610914776 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd750053af0 con 0x7fd7600afda0 2023-11-04T01:46:59.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.336+0000 7fd766d7c640 1 -- 172.21.15.77:0/610914776 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fd7600cf240 con 0x7fd7600afda0 2023-11-04T01:46:59.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.337+0000 7fd75d7fa640 1 -- 172.21.15.77:0/610914776 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v112) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd7600cf240 con 0x7fd7600afda0 2023-11-04T01:46:59.340 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:46:59.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.339+0000 7fd766d7c640 1 -- 172.21.15.77:0/610914776 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd74c06ae70 msgr2=0x7fd74c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:59.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.339+0000 7fd766d7c640 1 --2- 172.21.15.77:0/610914776 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd74c06ae70 0x7fd74c06d330 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd754036000 tx=0x7fd75403d040 comp rx=0 tx=0).stop 2023-11-04T01:46:59.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.339+0000 7fd766d7c640 1 -- 172.21.15.77:0/610914776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7600afda0 msgr2=0x7fd760148a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:59.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.339+0000 7fd766d7c640 1 --2- 172.21.15.77:0/610914776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7600afda0 0x7fd760148a90 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fd750001eb0 tx=0x7fd75000c9b0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.339+0000 7fd766d7c640 1 -- 172.21.15.77:0/610914776 shutdown_connections 2023-11-04T01:46:59.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.339+0000 7fd766d7c640 1 --2- 172.21.15.77:0/610914776 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd74c06ae70 0x7fd74c06d330 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.339+0000 7fd766d7c640 1 --2- 172.21.15.77:0/610914776 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd76015b200 0x7fd76015d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.339+0000 7fd766d7c640 1 --2- 172.21.15.77:0/610914776 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7600cd7f0 0x7fd760147f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.339+0000 7fd766d7c640 1 --2- 172.21.15.77:0/610914776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7600afda0 0x7fd760148a90 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.339+0000 7fd766d7c640 1 -- 172.21.15.77:0/610914776 >> 172.21.15.77:0/610914776 conn(0x7fd7600d0c30 msgr2=0x7fd7601599e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:59.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.339+0000 7fd766d7c640 1 -- 172.21.15.77:0/610914776 shutdown_connections 2023-11-04T01:46:59.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.339+0000 7fd766d7c640 1 -- 172.21.15.77:0/610914776 wait complete. 2023-11-04T01:46:59.352 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:46:59.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.453+0000 7ff90b383640 1 Processor -- start 2023-11-04T01:46:59.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.453+0000 7ff90b383640 1 -- start start 2023-11-04T01:46:59.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.454+0000 7ff90b383640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff9040cda40 0x7ff9040cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:59.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.454+0000 7ff90b383640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff9040cc400 0x7ff9040c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:59.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.454+0000 7ff90b383640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9040ca5c0 con 0x7ff9040caba0 2023-11-04T01:46:59.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.454+0000 7ff90b383640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff90406c140 con 0x7ff9040cda40 2023-11-04T01:46:59.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.454+0000 7ff90b383640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9040cb0f0 con 0x7ff9040cc400 2023-11-04T01:46:59.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.454+0000 7ff909920640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ff9040caba0 0x7ff9040c99f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45812/0 (socket says 172.21.15.77:45812) 2023-11-04T01:46:59.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.454+0000 7ff909920640 1 -- 172.21.15.77:0/108554386 learned_addr learned my addr 172.21.15.77:0/108554386 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:46:59.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.454+0000 7ff90911f640 1 --2- 172.21.15.77:0/108554386 >> v2:172.21.15.122:3300/0 conn(0x7ff9040cda40 0x7ff9040cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:59.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.454+0000 7ff8fbfff640 1 -- 172.21.15.77:0/108554386 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 14764374 0 0) 0x7ff9040ca5c0 con 0x7ff9040caba0 2023-11-04T01:46:59.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.454+0000 7ff8fbfff640 1 -- 172.21.15.77:0/108554386 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8f0003520 con 0x7ff9040caba0 2023-11-04T01:46:59.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.454+0000 7ff90891e640 1 --2- 172.21.15.77:0/108554386 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff9040cc400 0x7ff9040c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:59.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.454+0000 7ff8fbfff640 1 -- 172.21.15.77:0/108554386 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3661047994 0 0) 0x7ff8f0003520 con 0x7ff9040caba0 2023-11-04T01:46:59.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.454+0000 7ff8fbfff640 1 -- 172.21.15.77:0/108554386 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff9040cc400 msgr2=0x7ff9040c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:59.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.454+0000 7ff8fbfff640 1 --2- 172.21.15.77:0/108554386 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff9040cc400 0x7ff9040c94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.454+0000 7ff8fbfff640 1 -- 172.21.15.77:0/108554386 >> v2:172.21.15.122:3300/0 conn(0x7ff9040cda40 msgr2=0x7ff9040cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:59.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.454+0000 7ff8fbfff640 1 --2- 172.21.15.77:0/108554386 >> v2:172.21.15.122:3300/0 conn(0x7ff9040cda40 0x7ff9040cde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.454+0000 7ff8fbfff640 1 -- 172.21.15.77:0/108554386 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff90406c560 con 0x7ff9040caba0 2023-11-04T01:46:59.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.454+0000 7ff8fbfff640 1 -- 172.21.15.77:0/108554386 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7ff8fc0019f0 con 0x7ff9040caba0 2023-11-04T01:46:59.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.454+0000 7ff8fbfff640 1 -- 172.21.15.77:0/108554386 >> v1:172.21.15.77:6789/0 conn(0x7ff9040caba0 legacy=0x7ff9040c99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:59.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.454+0000 7ff8fbfff640 1 --2- 172.21.15.77:0/108554386 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff9040cc400 0x7ff8f0003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:59.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.454+0000 7ff8fbfff640 1 --2- 172.21.15.77:0/108554386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8f0003ef0 0x7ff8f00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:59.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.454+0000 7ff8fbfff640 1 --2- 172.21.15.77:0/108554386 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8f0004d00 0x7ff8f0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:59.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.454+0000 7ff8fbfff640 1 -- 172.21.15.77:0/108554386 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90406c140 con 0x7ff8f0003ef0 2023-11-04T01:46:59.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.454+0000 7ff8fbfff640 1 -- 172.21.15.77:0/108554386 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9040cb0f0 con 0x7ff8f0004d00 2023-11-04T01:46:59.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.454+0000 7ff8fbfff640 1 -- 172.21.15.77:0/108554386 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f000b9d0 con 0x7ff9040cc400 2023-11-04T01:46:59.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.455+0000 7ff90891e640 1 --2- 172.21.15.77:0/108554386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8f0003ef0 0x7ff8f00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:59.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.455+0000 7ff90911f640 1 --2- 172.21.15.77:0/108554386 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff9040cc400 0x7ff8f0003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:59.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.455+0000 7ff909920640 1 --2- 172.21.15.77:0/108554386 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8f0004d00 0x7ff8f0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:59.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.455+0000 7ff90891e640 1 -- 172.21.15.77:0/108554386 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff9040cc400 msgr2=0x7ff8f0003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:59.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.455+0000 7ff90891e640 1 --2- 172.21.15.77:0/108554386 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff9040cc400 0x7ff8f0003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.455+0000 7ff90891e640 1 -- 172.21.15.77:0/108554386 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8f0004d00 msgr2=0x7ff8f0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:59.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.455+0000 7ff90891e640 1 --2- 172.21.15.77:0/108554386 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8f0004d00 0x7ff8f0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.455+0000 7ff90891e640 1 -- 172.21.15.77:0/108554386 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f0003520 con 0x7ff8f0003ef0 2023-11-04T01:46:59.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.456+0000 7ff90891e640 1 --2- 172.21.15.77:0/108554386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8f0003ef0 0x7ff8f00047c0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4009ac0 tx=0x7ff8f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=554d3fe3b0078201 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:59.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.456+0000 7ff8fbfff640 1 -- 172.21.15.77:0/108554386 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f402c680 con 0x7ff8f0003ef0 2023-11-04T01:46:59.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.456+0000 7ff8fbfff640 1 -- 172.21.15.77:0/108554386 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f402c7e0 con 0x7ff8f0003ef0 2023-11-04T01:46:59.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.456+0000 7ff8fbfff640 1 -- 172.21.15.77:0/108554386 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f402cb90 con 0x7ff8f0003ef0 2023-11-04T01:46:59.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.456+0000 7ff90b383640 1 -- 172.21.15.77:0/108554386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8f0003ef0 msgr2=0x7ff8f00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:59.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.456+0000 7ff90b383640 1 --2- 172.21.15.77:0/108554386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8f0003ef0 0x7ff8f00047c0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4009ac0 tx=0x7ff8f00057f0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.456+0000 7ff909920640 1 -- 172.21.15.77:0/108554386 reap_dead start 2023-11-04T01:46:59.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.456+0000 7ff90b383640 1 -- 172.21.15.77:0/108554386 shutdown_connections 2023-11-04T01:46:59.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.456+0000 7ff90b383640 1 -- 172.21.15.77:0/108554386 >> 172.21.15.77:0/108554386 conn(0x7ff9040cb8e0 msgr2=0x7ff9040cbcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:59.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.456+0000 7ff90b383640 1 -- 172.21.15.77:0/108554386 shutdown_connections 2023-11-04T01:46:59.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.456+0000 7ff90b383640 1 -- 172.21.15.77:0/108554386 wait complete. 2023-11-04T01:46:59.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.457+0000 7ff90b383640 1 Processor -- start 2023-11-04T01:46:59.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.457+0000 7ff90b383640 1 -- start start 2023-11-04T01:46:59.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.458+0000 7ff90b383640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8f0003ef0 0x7ff90414cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:59.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.458+0000 7ff90b383640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff9041e4870 0x7ff904159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:59.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.458+0000 7ff90b383640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9041e4cf0 0x7ff90415a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:59.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.458+0000 7ff90b383640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90414d260 con 0x7ff9041e4cf0 2023-11-04T01:46:59.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.458+0000 7ff90b383640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9041e6e00 con 0x7ff8f0003ef0 2023-11-04T01:46:59.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.458+0000 7ff90b383640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9041e7080 con 0x7ff9041e4870 2023-11-04T01:46:59.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.458+0000 7ff909920640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9041e4cf0 0x7ff90415a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:59.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.458+0000 7ff909920640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9041e4cf0 0x7ff90415a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33770/0 (socket says 172.21.15.77:33770) 2023-11-04T01:46:59.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.458+0000 7ff909920640 1 -- 172.21.15.77:0/2166308719 learned_addr learned my addr 172.21.15.77:0/2166308719 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:59.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.458+0000 7ff90911f640 1 --2- 172.21.15.77:0/2166308719 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8f0003ef0 0x7ff90414cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:59.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.458+0000 7ff90891e640 1 --2- 172.21.15.77:0/2166308719 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff9041e4870 0x7ff904159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:59.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.458+0000 7ff909920640 1 -- 172.21.15.77:0/2166308719 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff9041e4870 msgr2=0x7ff904159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:59.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.458+0000 7ff909920640 1 --2- 172.21.15.77:0/2166308719 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff9041e4870 0x7ff904159be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.458+0000 7ff909920640 1 -- 172.21.15.77:0/2166308719 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8f0003ef0 msgr2=0x7ff90414cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:59.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.458+0000 7ff909920640 1 --2- 172.21.15.77:0/2166308719 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8f0003ef0 0x7ff90414cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.458+0000 7ff909920640 1 -- 172.21.15.77:0/2166308719 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9041e7360 con 0x7ff9041e4cf0 2023-11-04T01:46:59.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.458+0000 7ff90911f640 1 --2- 172.21.15.77:0/2166308719 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8f0003ef0 0x7ff90414cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:59.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.459+0000 7ff909920640 1 --2- 172.21.15.77:0/2166308719 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9041e4cf0 0x7ff90415a120 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7ff90406fc30 tx=0x7ff8fc007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:59.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.459+0000 7ff8f9ffb640 1 -- 172.21.15.77:0/2166308719 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc00ac20 con 0x7ff9041e4cf0 2023-11-04T01:46:59.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.459+0000 7ff8f9ffb640 1 -- 172.21.15.77:0/2166308719 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8fc00ad80 con 0x7ff9041e4cf0 2023-11-04T01:46:59.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.459+0000 7ff90b383640 1 -- 172.21.15.77:0/2166308719 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9041e7640 con 0x7ff9041e4cf0 2023-11-04T01:46:59.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.459+0000 7ff8f9ffb640 1 -- 172.21.15.77:0/2166308719 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc013630 con 0x7ff9041e4cf0 2023-11-04T01:46:59.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.459+0000 7ff90b383640 1 -- 172.21.15.77:0/2166308719 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9040b4860 con 0x7ff9041e4cf0 2023-11-04T01:46:59.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.460+0000 7ff90b383640 1 -- 172.21.15.77:0/2166308719 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9040cec60 con 0x7ff9041e4cf0 2023-11-04T01:46:59.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.460+0000 7ff8f9ffb640 1 -- 172.21.15.77:0/2166308719 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff8fc013790 con 0x7ff9041e4cf0 2023-11-04T01:46:59.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.461+0000 7ff8f9ffb640 1 --2- 172.21.15.77:0/2166308719 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff8e806aea0 0x7ff8e806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:59.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.461+0000 7ff8f9ffb640 1 -- 172.21.15.77:0/2166308719 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7952+0+0 (secure 0 0 0) 0x7ff8fc08a5a0 con 0x7ff9041e4cf0 2023-11-04T01:46:59.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.461+0000 7ff90911f640 1 --2- 172.21.15.77:0/2166308719 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff8e806aea0 0x7ff8e806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:59.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.461+0000 7ff90911f640 1 --2- 172.21.15.77:0/2166308719 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff8e806aea0 0x7ff8e806d360 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff900009c40 tx=0x7ff900008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:59.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.465+0000 7ff8f9ffb640 1 -- 172.21.15.77:0/2166308719 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff8fc054d90 con 0x7ff9041e4cf0 2023-11-04T01:46:59.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.628+0000 7ff90b383640 1 -- 172.21.15.77:0/2166308719 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7ff9041e7b60 con 0x7ff9041e4cf0 2023-11-04T01:46:59.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.628+0000 7ff8f9ffb640 1 -- 172.21.15.77:0/2166308719 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v112) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff9041e7b60 con 0x7ff9041e4cf0 2023-11-04T01:46:59.632 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:46:59.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.630+0000 7ff90b383640 1 -- 172.21.15.77:0/2166308719 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff8e806aea0 msgr2=0x7ff8e806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:59.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.630+0000 7ff90b383640 1 --2- 172.21.15.77:0/2166308719 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff8e806aea0 0x7ff8e806d360 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff900009c40 tx=0x7ff900008040 comp rx=0 tx=0).stop 2023-11-04T01:46:59.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.630+0000 7ff90b383640 1 -- 172.21.15.77:0/2166308719 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9041e4cf0 msgr2=0x7ff90415a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:59.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.630+0000 7ff90b383640 1 --2- 172.21.15.77:0/2166308719 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9041e4cf0 0x7ff90415a120 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7ff90406fc30 tx=0x7ff8fc007bd0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.630+0000 7ff90b383640 1 -- 172.21.15.77:0/2166308719 shutdown_connections 2023-11-04T01:46:59.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.630+0000 7ff90b383640 1 --2- 172.21.15.77:0/2166308719 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff8e806aea0 0x7ff8e806d360 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.630+0000 7ff90b383640 1 --2- 172.21.15.77:0/2166308719 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9041e4cf0 0x7ff90415a120 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.630+0000 7ff90b383640 1 --2- 172.21.15.77:0/2166308719 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff9041e4870 0x7ff904159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.630+0000 7ff90b383640 1 --2- 172.21.15.77:0/2166308719 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8f0003ef0 0x7ff90414cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.630+0000 7ff90b383640 1 -- 172.21.15.77:0/2166308719 >> 172.21.15.77:0/2166308719 conn(0x7ff9040cb8e0 msgr2=0x7ff904159170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:59.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.630+0000 7ff90b383640 1 -- 172.21.15.77:0/2166308719 shutdown_connections 2023-11-04T01:46:59.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.630+0000 7ff90b383640 1 -- 172.21.15.77:0/2166308719 wait complete. 2023-11-04T01:46:59.643 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:46:59.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.743+0000 7fe4e3cd4640 1 Processor -- start 2023-11-04T01:46:59.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.744+0000 7fe4e3cd4640 1 -- start start 2023-11-04T01:46:59.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.744+0000 7fe4e3cd4640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4dc159e40 0x7fe4dc0b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:59.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.744+0000 7fe4e3cd4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe4dc06bb60 0x7fe4dc0b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:59.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.744+0000 7fe4e3cd4640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4dc071500 con 0x7fe4dc06fff0 2023-11-04T01:46:59.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.744+0000 7fe4e3cd4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4dc15dae0 con 0x7fe4dc06bb60 2023-11-04T01:46:59.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.744+0000 7fe4e3cd4640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc070c60 con 0x7fe4dc159e40 2023-11-04T01:46:59.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.744+0000 7fe4e126f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe4dc06bb60 0x7fe4dc0b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:59.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.745+0000 7fe4e126f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe4dc06bb60 0x7fe4dc0b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33780/0 (socket says 172.21.15.77:33780) 2023-11-04T01:46:59.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.745+0000 7fe4e126f640 1 -- 172.21.15.77:0/980131483 learned_addr learned my addr 172.21.15.77:0/980131483 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:59.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.745+0000 7fe4e1a70640 1 --2- 172.21.15.77:0/980131483 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4dc159e40 0x7fe4dc0b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:59.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.745+0000 7fe4e126f640 1 -- 172.21.15.77:0/980131483 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4dc159e40 msgr2=0x7fe4dc0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:59.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.745+0000 7fe4e126f640 1 --2- 172.21.15.77:0/980131483 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4dc159e40 0x7fe4dc0b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.745+0000 7fe4e126f640 1 -- 172.21.15.77:0/980131483 >> v1:172.21.15.122:6789/0 conn(0x7fe4dc06fff0 legacy=0x7fe4dc070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:59.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.745+0000 7fe4e126f640 1 -- 172.21.15.77:0/980131483 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4dc070f40 con 0x7fe4dc06bb60 2023-11-04T01:46:59.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.746+0000 7fe4e126f640 1 --2- 172.21.15.77:0/980131483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4dc06bb60 0x7fe4dc0b0a70 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00bb10 tx=0x7fe4cc02e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1abd09e6f6b66eda server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:59.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.746+0000 7fe4e0a6e640 1 -- 172.21.15.77:0/980131483 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc02ee70 con 0x7fe4dc06bb60 2023-11-04T01:46:59.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.746+0000 7fe4e0a6e640 1 -- 172.21.15.77:0/980131483 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4cc036440 con 0x7fe4dc06bb60 2023-11-04T01:46:59.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.746+0000 7fe4e0a6e640 1 -- 172.21.15.77:0/980131483 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc0367d0 con 0x7fe4dc06bb60 2023-11-04T01:46:59.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.746+0000 7fe4e3cd4640 1 -- 172.21.15.77:0/980131483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4dc06bb60 msgr2=0x7fe4dc0b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:59.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.746+0000 7fe4e3cd4640 1 --2- 172.21.15.77:0/980131483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4dc06bb60 0x7fe4dc0b0a70 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00bb10 tx=0x7fe4cc02e0c0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.746+0000 7fe4e3cd4640 1 -- 172.21.15.77:0/980131483 shutdown_connections 2023-11-04T01:46:59.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.746+0000 7fe4e3cd4640 1 --2- 172.21.15.77:0/980131483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4dc06bb60 0x7fe4dc0b0a70 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.746+0000 7fe4e3cd4640 1 --2- 172.21.15.77:0/980131483 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4dc159e40 0x7fe4dc0b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.746+0000 7fe4e3cd4640 1 -- 172.21.15.77:0/980131483 >> 172.21.15.77:0/980131483 conn(0x7fe4dc0cb530 msgr2=0x7fe4dc0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:59.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.746+0000 7fe4e3cd4640 1 -- 172.21.15.77:0/980131483 shutdown_connections 2023-11-04T01:46:59.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.746+0000 7fe4e3cd4640 1 -- 172.21.15.77:0/980131483 wait complete. 2023-11-04T01:46:59.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.747+0000 7fe4e3cd4640 1 Processor -- start 2023-11-04T01:46:59.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.748+0000 7fe4e3cd4640 1 -- start start 2023-11-04T01:46:59.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.748+0000 7fe4e3cd4640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4dc06bb60 0x7fe4dc1f5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:59.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.748+0000 7fe4e3cd4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4dc06fff0 0x7fe4dc0c6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:59.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.748+0000 7fe4e3cd4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4dc159e40 0x7fe4dc0ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:59.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.748+0000 7fe4e3cd4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc0c7b80 con 0x7fe4dc06fff0 2023-11-04T01:46:59.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.748+0000 7fe4e3cd4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc0c6f00 con 0x7fe4dc159e40 2023-11-04T01:46:59.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.748+0000 7fe4e3cd4640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc0c71e0 con 0x7fe4dc06bb60 2023-11-04T01:46:59.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.748+0000 7fe4e126f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4dc06fff0 0x7fe4dc0c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:59.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.748+0000 7fe4e126f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4dc06fff0 0x7fe4dc0c6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33790/0 (socket says 172.21.15.77:33790) 2023-11-04T01:46:59.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.748+0000 7fe4e126f640 1 -- 172.21.15.77:0/542726073 learned_addr learned my addr 172.21.15.77:0/542726073 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:46:59.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.749+0000 7fe4e126f640 1 -- 172.21.15.77:0/542726073 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4dc06bb60 msgr2=0x7fe4dc1f5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:59.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.749+0000 7fe4e126f640 1 --2- 172.21.15.77:0/542726073 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4dc06bb60 0x7fe4dc1f5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.749+0000 7fe4e2271640 1 --2- 172.21.15.77:0/542726073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4dc159e40 0x7fe4dc0ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:59.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.749+0000 7fe4e126f640 1 -- 172.21.15.77:0/542726073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4dc159e40 msgr2=0x7fe4dc0ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:59.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.749+0000 7fe4e126f640 1 --2- 172.21.15.77:0/542726073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4dc159e40 0x7fe4dc0ac8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.749+0000 7fe4e126f640 1 -- 172.21.15.77:0/542726073 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4cc00b770 con 0x7fe4dc06fff0 2023-11-04T01:46:59.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.749+0000 7fe4e2271640 1 --2- 172.21.15.77:0/542726073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4dc159e40 0x7fe4dc0ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:59.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.749+0000 7fe4e126f640 1 --2- 172.21.15.77:0/542726073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4dc06fff0 0x7fe4dc0c6590 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00b2c0 tx=0x7fe4cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:59.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.749+0000 7fe4d27fc640 1 -- 172.21.15.77:0/542726073 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc034850 con 0x7fe4dc06fff0 2023-11-04T01:46:59.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.749+0000 7fe4d27fc640 1 -- 172.21.15.77:0/542726073 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4cc0349d0 con 0x7fe4dc06fff0 2023-11-04T01:46:59.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.749+0000 7fe4e3cd4640 1 -- 172.21.15.77:0/542726073 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4dc0c74c0 con 0x7fe4dc06fff0 2023-11-04T01:46:59.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.749+0000 7fe4d27fc640 1 -- 172.21.15.77:0/542726073 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc034d80 con 0x7fe4dc06fff0 2023-11-04T01:46:59.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.749+0000 7fe4e3cd4640 1 -- 172.21.15.77:0/542726073 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4dc1f5ca0 con 0x7fe4dc06fff0 2023-11-04T01:46:59.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.750+0000 7fe4e3cd4640 1 -- 172.21.15.77:0/542726073 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4dc0684b0 con 0x7fe4dc06fff0 2023-11-04T01:46:59.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.750+0000 7fe4d27fc640 1 -- 172.21.15.77:0/542726073 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe4cc03d070 con 0x7fe4dc06fff0 2023-11-04T01:46:59.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.751+0000 7fe4d27fc640 1 --2- 172.21.15.77:0/542726073 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe4c006ae70 0x7fe4c006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:59.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.751+0000 7fe4d27fc640 1 -- 172.21.15.77:0/542726073 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7952+0+0 (secure 0 0 0) 0x7fe4cc0acca0 con 0x7fe4dc06fff0 2023-11-04T01:46:59.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.751+0000 7fe4e1a70640 1 --2- 172.21.15.77:0/542726073 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe4c006ae70 0x7fe4c006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:59.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.752+0000 7fe4e1a70640 1 --2- 172.21.15.77:0/542726073 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe4c006ae70 0x7fe4c006d330 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8006fd0 tx=0x7fe4d8008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:59.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.755+0000 7fe4d27fc640 1 -- 172.21.15.77:0/542726073 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe4cc077640 con 0x7fe4dc06fff0 2023-11-04T01:46:59.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.919+0000 7fe4e3cd4640 1 -- 172.21.15.77:0/542726073 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7fe4dc0c9750 con 0x7fe4dc06fff0 2023-11-04T01:46:59.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.920+0000 7fe4d27fc640 1 -- 172.21.15.77:0/542726073 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v112) v1 ==== 107+0+11 (secure 0 0 0) 0x7fe4cc03b020 con 0x7fe4dc06fff0 2023-11-04T01:46:59.923 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:46:59.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.921+0000 7fe4e3cd4640 1 -- 172.21.15.77:0/542726073 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe4c006ae70 msgr2=0x7fe4c006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:59.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.922+0000 7fe4e3cd4640 1 --2- 172.21.15.77:0/542726073 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe4c006ae70 0x7fe4c006d330 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8006fd0 tx=0x7fe4d8008040 comp rx=0 tx=0).stop 2023-11-04T01:46:59.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.922+0000 7fe4e3cd4640 1 -- 172.21.15.77:0/542726073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4dc06fff0 msgr2=0x7fe4dc0c6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:59.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.922+0000 7fe4e3cd4640 1 --2- 172.21.15.77:0/542726073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4dc06fff0 0x7fe4dc0c6590 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00b2c0 tx=0x7fe4cc0046c0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.922+0000 7fe4e3cd4640 1 -- 172.21.15.77:0/542726073 shutdown_connections 2023-11-04T01:46:59.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.922+0000 7fe4e3cd4640 1 --2- 172.21.15.77:0/542726073 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe4c006ae70 0x7fe4c006d330 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.922+0000 7fe4e3cd4640 1 --2- 172.21.15.77:0/542726073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4dc159e40 0x7fe4dc0ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.922+0000 7fe4e3cd4640 1 --2- 172.21.15.77:0/542726073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4dc06fff0 0x7fe4dc0c6590 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.922+0000 7fe4e3cd4640 1 --2- 172.21.15.77:0/542726073 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe4dc06bb60 0x7fe4dc1f5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:59.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.922+0000 7fe4e3cd4640 1 -- 172.21.15.77:0/542726073 >> 172.21.15.77:0/542726073 conn(0x7fe4dc0cb530 msgr2=0x7fe4dc0ccd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:59.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.922+0000 7fe4e3cd4640 1 -- 172.21.15.77:0/542726073 shutdown_connections 2023-11-04T01:46:59.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:46:59.922+0000 7fe4e3cd4640 1 -- 172.21.15.77:0/542726073 wait complete. 2023-11-04T01:46:59.935 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:47:00.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.035+0000 7fd2a1b68640 1 Processor -- start 2023-11-04T01:47:00.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.035+0000 7fd2a1b68640 1 -- start start 2023-11-04T01:47:00.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.036+0000 7fd2a1b68640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd29c0cb680 0x7fd29c0cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.036+0000 7fd2a1b68640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd29c15afb0 0x7fd29c0cba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.036+0000 7fd2a1b68640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd29c15ea20 con 0x7fd29c1597a0 2023-11-04T01:47:00.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.036+0000 7fd2a1b68640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd29c15b520 con 0x7fd29c15afb0 2023-11-04T01:47:00.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.036+0000 7fd2a1b68640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd29c0cbfa0 con 0x7fd29c0cb680 2023-11-04T01:47:00.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.036+0000 7fd29affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd29c15afb0 0x7fd29c0cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.036+0000 7fd29affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd29c15afb0 0x7fd29c0cba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33800/0 (socket says 172.21.15.77:33800) 2023-11-04T01:47:00.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.036+0000 7fd29affd640 1 -- 172.21.15.77:0/1137375524 learned_addr learned my addr 172.21.15.77:0/1137375524 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:00.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.036+0000 7fd29affd640 1 -- 172.21.15.77:0/1137375524 >> v2:172.21.15.122:3300/0 conn(0x7fd29c0cb680 msgr2=0x7fd29c0cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:00.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.036+0000 7fd29affd640 1 --2- 172.21.15.77:0/1137375524 >> v2:172.21.15.122:3300/0 conn(0x7fd29c0cb680 0x7fd29c0cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.036+0000 7fd29affd640 1 -- 172.21.15.77:0/1137375524 >> v1:172.21.15.122:6789/0 conn(0x7fd29c1597a0 legacy=0x7fd29c159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:00.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.036+0000 7fd29affd640 1 -- 172.21.15.77:0/1137375524 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29c15dc60 con 0x7fd29c15afb0 2023-11-04T01:47:00.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.037+0000 7fd29affd640 1 --2- 172.21.15.77:0/1137375524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd29c15afb0 0x7fd29c0cba60 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fd29c0682b0 tx=0x7fd29002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8aef4eee9ebe4b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:00.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.037+0000 7fd29a7fc640 1 -- 172.21.15.77:0/1137375524 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2900317e0 con 0x7fd29c15afb0 2023-11-04T01:47:00.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.037+0000 7fd29a7fc640 1 -- 172.21.15.77:0/1137375524 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd290031940 con 0x7fd29c15afb0 2023-11-04T01:47:00.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.037+0000 7fd29a7fc640 1 -- 172.21.15.77:0/1137375524 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd290031cd0 con 0x7fd29c15afb0 2023-11-04T01:47:00.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.037+0000 7fd2a1b68640 1 -- 172.21.15.77:0/1137375524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd29c15afb0 msgr2=0x7fd29c0cba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.037+0000 7fd2a1b68640 1 --2- 172.21.15.77:0/1137375524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd29c15afb0 0x7fd29c0cba60 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fd29c0682b0 tx=0x7fd29002b880 comp rx=0 tx=0).stop 2023-11-04T01:47:00.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.038+0000 7fd2a1b68640 1 -- 172.21.15.77:0/1137375524 shutdown_connections 2023-11-04T01:47:00.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.038+0000 7fd2a1b68640 1 --2- 172.21.15.77:0/1137375524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd29c15afb0 0x7fd29c0cba60 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.038+0000 7fd2a1b68640 1 --2- 172.21.15.77:0/1137375524 >> v2:172.21.15.122:3300/0 conn(0x7fd29c0cb680 0x7fd29c0cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.038+0000 7fd2a1b68640 1 -- 172.21.15.77:0/1137375524 >> 172.21.15.77:0/1137375524 conn(0x7fd29c0b1640 msgr2=0x7fd29c0b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:00.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.038+0000 7fd2a1b68640 1 -- 172.21.15.77:0/1137375524 shutdown_connections 2023-11-04T01:47:00.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.038+0000 7fd2a1b68640 1 -- 172.21.15.77:0/1137375524 wait complete. 2023-11-04T01:47:00.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.039+0000 7fd2a1b68640 1 Processor -- start 2023-11-04T01:47:00.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.039+0000 7fd2a1b68640 1 -- start start 2023-11-04T01:47:00.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.040+0000 7fd2a1b68640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd29c0cb680 0x7fd29c14dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.040+0000 7fd2a1b68640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd29c1597a0 0x7fd29c0b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.040+0000 7fd2a1b68640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd29c15afb0 0x7fd29c1e5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.040+0000 7fd2a1b68640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c157780 con 0x7fd29c0cb680 2023-11-04T01:47:00.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.040+0000 7fd2a1b68640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c156b00 con 0x7fd29c1597a0 2023-11-04T01:47:00.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.040+0000 7fd2a1b68640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c156de0 con 0x7fd29c15afb0 2023-11-04T01:47:00.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.040+0000 7fd29b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd29c0cb680 0x7fd29c14dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.040+0000 7fd29b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd29c0cb680 0x7fd29c14dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33816/0 (socket says 172.21.15.77:33816) 2023-11-04T01:47:00.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.040+0000 7fd29b7fe640 1 -- 172.21.15.77:0/1530536355 learned_addr learned my addr 172.21.15.77:0/1530536355 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:00.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.040+0000 7fd29affd640 1 --2- 172.21.15.77:0/1530536355 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd29c1597a0 0x7fd29c0b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.040+0000 7fd29bfff640 1 --2- 172.21.15.77:0/1530536355 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd29c15afb0 0x7fd29c1e5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.040+0000 7fd29b7fe640 1 -- 172.21.15.77:0/1530536355 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd29c15afb0 msgr2=0x7fd29c1e5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.040+0000 7fd29b7fe640 1 --2- 172.21.15.77:0/1530536355 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd29c15afb0 0x7fd29c1e5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.040+0000 7fd29b7fe640 1 -- 172.21.15.77:0/1530536355 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd29c1597a0 msgr2=0x7fd29c0b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.040+0000 7fd29b7fe640 1 --2- 172.21.15.77:0/1530536355 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd29c1597a0 0x7fd29c0b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.040+0000 7fd29b7fe640 1 -- 172.21.15.77:0/1530536355 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2900094d0 con 0x7fd29c0cb680 2023-11-04T01:47:00.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.040+0000 7fd29b7fe640 1 --2- 172.21.15.77:0/1530536355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd29c0cb680 0x7fd29c14dd30 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7fd28c00b410 tx=0x7fd28c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:00.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.040+0000 7fd283fff640 1 -- 172.21.15.77:0/1530536355 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28c011830 con 0x7fd29c0cb680 2023-11-04T01:47:00.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.040+0000 7fd283fff640 1 -- 172.21.15.77:0/1530536355 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28c0119b0 con 0x7fd29c0cb680 2023-11-04T01:47:00.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.040+0000 7fd2a1b68640 1 -- 172.21.15.77:0/1530536355 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd29c1570c0 con 0x7fd29c0cb680 2023-11-04T01:47:00.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.040+0000 7fd283fff640 1 -- 172.21.15.77:0/1530536355 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28c011d60 con 0x7fd29c0cb680 2023-11-04T01:47:00.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.040+0000 7fd2a1b68640 1 -- 172.21.15.77:0/1530536355 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd29c14e270 con 0x7fd29c0cb680 2023-11-04T01:47:00.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.041+0000 7fd2a1b68640 1 -- 172.21.15.77:0/1530536355 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd29c1578c0 con 0x7fd29c0cb680 2023-11-04T01:47:00.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.042+0000 7fd283fff640 1 -- 172.21.15.77:0/1530536355 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd28c01a400 con 0x7fd29c0cb680 2023-11-04T01:47:00.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.042+0000 7fd283fff640 1 --2- 172.21.15.77:0/1530536355 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd28806ae70 0x7fd28806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.042+0000 7fd283fff640 1 -- 172.21.15.77:0/1530536355 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7952+0+0 (secure 0 0 0) 0x7fd28c08a050 con 0x7fd29c0cb680 2023-11-04T01:47:00.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.042+0000 7fd29affd640 1 --2- 172.21.15.77:0/1530536355 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd28806ae70 0x7fd28806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.043+0000 7fd29affd640 1 --2- 172.21.15.77:0/1530536355 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd28806ae70 0x7fd28806d330 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd290036000 tx=0x7fd29003d040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:00.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.046+0000 7fd283fff640 1 -- 172.21.15.77:0/1530536355 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd28c054840 con 0x7fd29c0cb680 2023-11-04T01:47:00.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.213+0000 7fd2a1b68640 1 -- 172.21.15.77:0/1530536355 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd29c0684b0 con 0x7fd29c0cb680 2023-11-04T01:47:00.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.213+0000 7fd283fff640 1 -- 172.21.15.77:0/1530536355 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v112) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd28c0150a0 con 0x7fd29c0cb680 2023-11-04T01:47:00.217 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:47:00.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.215+0000 7fd2a1b68640 1 -- 172.21.15.77:0/1530536355 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd28806ae70 msgr2=0x7fd28806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.215+0000 7fd2a1b68640 1 --2- 172.21.15.77:0/1530536355 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd28806ae70 0x7fd28806d330 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd290036000 tx=0x7fd29003d040 comp rx=0 tx=0).stop 2023-11-04T01:47:00.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.215+0000 7fd2a1b68640 1 -- 172.21.15.77:0/1530536355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd29c0cb680 msgr2=0x7fd29c14dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.215+0000 7fd2a1b68640 1 --2- 172.21.15.77:0/1530536355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd29c0cb680 0x7fd29c14dd30 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7fd28c00b410 tx=0x7fd28c00b8d0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.215+0000 7fd2a1b68640 1 -- 172.21.15.77:0/1530536355 shutdown_connections 2023-11-04T01:47:00.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.215+0000 7fd2a1b68640 1 --2- 172.21.15.77:0/1530536355 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd28806ae70 0x7fd28806d330 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.215+0000 7fd2a1b68640 1 --2- 172.21.15.77:0/1530536355 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd29c15afb0 0x7fd29c1e5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.215+0000 7fd2a1b68640 1 --2- 172.21.15.77:0/1530536355 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd29c1597a0 0x7fd29c0b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.215+0000 7fd2a1b68640 1 --2- 172.21.15.77:0/1530536355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd29c0cb680 0x7fd29c14dd30 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.215+0000 7fd2a1b68640 1 -- 172.21.15.77:0/1530536355 >> 172.21.15.77:0/1530536355 conn(0x7fd29c0b1640 msgr2=0x7fd29c0cef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:00.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.215+0000 7fd2a1b68640 1 -- 172.21.15.77:0/1530536355 shutdown_connections 2023-11-04T01:47:00.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.215+0000 7fd2a1b68640 1 -- 172.21.15.77:0/1530536355 wait complete. 2023-11-04T01:47:00.229 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:47:00.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.328+0000 7f5da834c640 1 Processor -- start 2023-11-04T01:47:00.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.328+0000 7f5da834c640 1 -- start start 2023-11-04T01:47:00.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.329+0000 7f5da834c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5da015d4e0 0x7f5da00ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.329+0000 7f5da834c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5da00ca8b0 0x7f5da006a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.329+0000 7f5da834c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5da00b25a0 con 0x7f5da00ced90 2023-11-04T01:47:00.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.329+0000 7f5da834c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5da00b2300 con 0x7f5da015d4e0 2023-11-04T01:47:00.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.329+0000 7f5da834c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5da015d8c0 con 0x7f5da00ca8b0 2023-11-04T01:47:00.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.329+0000 7f5da60e8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5da015d4e0 0x7f5da00ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.329+0000 7f5da58e7640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f5da00ced90 0x7f5da00ca1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45820/0 (socket says 172.21.15.77:45820) 2023-11-04T01:47:00.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.329+0000 7f5da58e7640 1 -- 172.21.15.77:0/976926825 learned_addr learned my addr 172.21.15.77:0/976926825 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:47:00.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.330+0000 7f5da60e8640 1 -- 172.21.15.77:0/976926825 >> v2:172.21.15.122:3300/0 conn(0x7f5da00ca8b0 msgr2=0x7f5da006a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:00.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.330+0000 7f5da68e9640 1 --2- 172.21.15.77:0/976926825 >> v2:172.21.15.122:3300/0 conn(0x7f5da00ca8b0 0x7f5da006a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.330+0000 7f5da60e8640 1 --2- 172.21.15.77:0/976926825 >> v2:172.21.15.122:3300/0 conn(0x7f5da00ca8b0 0x7f5da006a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.330+0000 7f5da50e6640 1 -- 172.21.15.77:0/976926825 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3749207056 0 0) 0x7f5da00b25a0 con 0x7f5da00ced90 2023-11-04T01:47:00.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.330+0000 7f5da60e8640 1 -- 172.21.15.77:0/976926825 >> v1:172.21.15.77:6789/0 conn(0x7f5da00ced90 legacy=0x7f5da00ca1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.330+0000 7f5da60e8640 1 -- 172.21.15.77:0/976926825 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da015e5f0 con 0x7f5da015d4e0 2023-11-04T01:47:00.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.330+0000 7f5da68e9640 1 --2- 172.21.15.77:0/976926825 >> v2:172.21.15.122:3300/0 conn(0x7f5da00ca8b0 0x7f5da006a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:00.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.330+0000 7f5da60e8640 1 --2- 172.21.15.77:0/976926825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5da015d4e0 0x7f5da00ce850 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c0097a0 tx=0x7f5d9c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a666d87c3a84bfb8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:00.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.331+0000 7f5da50e6640 1 -- 172.21.15.77:0/976926825 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c031830 con 0x7f5da015d4e0 2023-11-04T01:47:00.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.331+0000 7f5da50e6640 1 -- 172.21.15.77:0/976926825 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9c031990 con 0x7f5da015d4e0 2023-11-04T01:47:00.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.331+0000 7f5da50e6640 1 -- 172.21.15.77:0/976926825 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c031d20 con 0x7f5da015d4e0 2023-11-04T01:47:00.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.331+0000 7f5da834c640 1 -- 172.21.15.77:0/976926825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5da015d4e0 msgr2=0x7f5da00ce850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.331+0000 7f5da834c640 1 --2- 172.21.15.77:0/976926825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5da015d4e0 0x7f5da00ce850 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c0097a0 tx=0x7f5d9c02b8d0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.331+0000 7f5da834c640 1 -- 172.21.15.77:0/976926825 shutdown_connections 2023-11-04T01:47:00.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.331+0000 7f5da834c640 1 --2- 172.21.15.77:0/976926825 >> v2:172.21.15.122:3300/0 conn(0x7f5da00ca8b0 0x7f5da006a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.331+0000 7f5da834c640 1 --2- 172.21.15.77:0/976926825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5da015d4e0 0x7f5da00ce850 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.331+0000 7f5da834c640 1 -- 172.21.15.77:0/976926825 >> 172.21.15.77:0/976926825 conn(0x7f5da00b1640 msgr2=0x7f5da00b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:00.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.331+0000 7f5da834c640 1 -- 172.21.15.77:0/976926825 shutdown_connections 2023-11-04T01:47:00.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.331+0000 7f5da834c640 1 -- 172.21.15.77:0/976926825 wait complete. 2023-11-04T01:47:00.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.332+0000 7f5da834c640 1 Processor -- start 2023-11-04T01:47:00.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.332+0000 7f5da834c640 1 -- start start 2023-11-04T01:47:00.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.333+0000 7f5da834c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5da00ca8b0 0x7f5da01582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.333+0000 7f5da834c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5da00ced90 0x7f5da01e38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.333+0000 7f5da834c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5da015d4e0 0x7f5da01e3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.333+0000 7f5da834c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da0158830 con 0x7f5da00ced90 2023-11-04T01:47:00.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.333+0000 7f5da834c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da015c0f0 con 0x7f5da015d4e0 2023-11-04T01:47:00.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.333+0000 7f5da834c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da015b050 con 0x7f5da00ca8b0 2023-11-04T01:47:00.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.333+0000 7f5da58e7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5da00ced90 0x7f5da01e38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.333+0000 7f5da58e7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5da00ced90 0x7f5da01e38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33820/0 (socket says 172.21.15.77:33820) 2023-11-04T01:47:00.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.333+0000 7f5da58e7640 1 -- 172.21.15.77:0/1212572236 learned_addr learned my addr 172.21.15.77:0/1212572236 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:00.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.333+0000 7f5da60e8640 1 --2- 172.21.15.77:0/1212572236 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5da00ca8b0 0x7f5da01582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.333+0000 7f5da68e9640 1 --2- 172.21.15.77:0/1212572236 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5da015d4e0 0x7f5da01e3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.333+0000 7f5da58e7640 1 -- 172.21.15.77:0/1212572236 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5da00ca8b0 msgr2=0x7f5da01582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.333+0000 7f5da58e7640 1 --2- 172.21.15.77:0/1212572236 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5da00ca8b0 0x7f5da01582f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.333+0000 7f5da58e7640 1 -- 172.21.15.77:0/1212572236 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5da015d4e0 msgr2=0x7f5da01e3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.333+0000 7f5da58e7640 1 --2- 172.21.15.77:0/1212572236 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5da015d4e0 0x7f5da01e3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.333+0000 7f5da58e7640 1 -- 172.21.15.77:0/1212572236 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d9c009400 con 0x7f5da00ced90 2023-11-04T01:47:00.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.333+0000 7f5da68e9640 1 --2- 172.21.15.77:0/1212572236 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5da015d4e0 0x7f5da01e3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:00.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.334+0000 7f5da58e7640 1 --2- 172.21.15.77:0/1212572236 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5da00ced90 0x7f5da01e38d0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f5d9000c4d0 tx=0x7f5d9000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:00.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.334+0000 7f5d96ffd640 1 -- 172.21.15.77:0/1212572236 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d900074e0 con 0x7f5da00ced90 2023-11-04T01:47:00.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.334+0000 7f5d96ffd640 1 -- 172.21.15.77:0/1212572236 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d90007660 con 0x7f5da00ced90 2023-11-04T01:47:00.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.334+0000 7f5d96ffd640 1 -- 172.21.15.77:0/1212572236 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d90004a20 con 0x7f5da00ced90 2023-11-04T01:47:00.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.334+0000 7f5da834c640 1 -- 172.21.15.77:0/1212572236 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da015b330 con 0x7f5da00ced90 2023-11-04T01:47:00.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.334+0000 7f5da834c640 1 -- 172.21.15.77:0/1212572236 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5da015b8f0 con 0x7f5da00ced90 2023-11-04T01:47:00.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.335+0000 7f5da834c640 1 -- 172.21.15.77:0/1212572236 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5da00684b0 con 0x7f5da00ced90 2023-11-04T01:47:00.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.335+0000 7f5d96ffd640 1 -- 172.21.15.77:0/1212572236 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5d90004b80 con 0x7f5da00ced90 2023-11-04T01:47:00.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.336+0000 7f5d96ffd640 1 --2- 172.21.15.77:0/1212572236 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5d8406ae70 0x7f5d8406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.336+0000 7f5d96ffd640 1 -- 172.21.15.77:0/1212572236 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f5d900890f0 con 0x7f5da00ced90 2023-11-04T01:47:00.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.336+0000 7f5da60e8640 1 --2- 172.21.15.77:0/1212572236 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5d8406ae70 0x7f5d8406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.336+0000 7f5da60e8640 1 --2- 172.21.15.77:0/1212572236 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5d8406ae70 0x7f5d8406d330 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c036000 tx=0x7f5d9c008030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:00.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.340+0000 7f5d96ffd640 1 -- 172.21.15.77:0/1212572236 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5d90053850 con 0x7f5da00ced90 2023-11-04T01:47:00.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.506+0000 7f5da834c640 1 -- 172.21.15.77:0/1212572236 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5da0159710 con 0x7f5da00ced90 2023-11-04T01:47:00.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.506+0000 7f5d96ffd640 1 -- 172.21.15.77:0/1212572236 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v112) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5d90018070 con 0x7f5da00ced90 2023-11-04T01:47:00.509 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-04T01:47:00.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.508+0000 7f5da834c640 1 -- 172.21.15.77:0/1212572236 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5d8406ae70 msgr2=0x7f5d8406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.508+0000 7f5da834c640 1 --2- 172.21.15.77:0/1212572236 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5d8406ae70 0x7f5d8406d330 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c036000 tx=0x7f5d9c008030 comp rx=0 tx=0).stop 2023-11-04T01:47:00.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.508+0000 7f5da834c640 1 -- 172.21.15.77:0/1212572236 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5da00ced90 msgr2=0x7f5da01e38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.508+0000 7f5da834c640 1 --2- 172.21.15.77:0/1212572236 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5da00ced90 0x7f5da01e38d0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f5d9000c4d0 tx=0x7f5d9000c990 comp rx=0 tx=0).stop 2023-11-04T01:47:00.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.508+0000 7f5da834c640 1 -- 172.21.15.77:0/1212572236 shutdown_connections 2023-11-04T01:47:00.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.508+0000 7f5da834c640 1 --2- 172.21.15.77:0/1212572236 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f5d8406ae70 0x7f5d8406d330 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.508+0000 7f5da834c640 1 --2- 172.21.15.77:0/1212572236 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5da015d4e0 0x7f5da01e3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.508+0000 7f5da834c640 1 --2- 172.21.15.77:0/1212572236 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5da00ced90 0x7f5da01e38d0 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.508+0000 7f5da834c640 1 --2- 172.21.15.77:0/1212572236 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5da00ca8b0 0x7f5da01582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.508+0000 7f5da834c640 1 -- 172.21.15.77:0/1212572236 >> 172.21.15.77:0/1212572236 conn(0x7f5da00b1640 msgr2=0x7f5da00aedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:00.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.508+0000 7f5da834c640 1 -- 172.21.15.77:0/1212572236 shutdown_connections 2023-11-04T01:47:00.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.508+0000 7f5da834c640 1 -- 172.21.15.77:0/1212572236 wait complete. 2023-11-04T01:47:00.521 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:47:00.523 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:2023-11-04T01:47:00.521+0000 7fce977fe640 -1 client.8265 mds.1 rejected us (blocklisted (blacklisted)) 2023-11-04T01:47:00.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.619+0000 7f54b94d7640 1 Processor -- start 2023-11-04T01:47:00.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.619+0000 7f54b94d7640 1 -- start start 2023-11-04T01:47:00.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.620+0000 7f54b94d7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f54b415d4e0 0x7f54b40d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.620+0000 7f54b94d7640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f54b40d3b60 0x7f54b40d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.620+0000 7f54b94d7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b40b32b0 con 0x7f54b415d100 2023-11-04T01:47:00.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.620+0000 7f54b94d7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b40cec20 con 0x7f54b415d4e0 2023-11-04T01:47:00.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.620+0000 7f54b94d7640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b40cee10 con 0x7f54b40d3b60 2023-11-04T01:47:00.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.620+0000 7f54b27fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f54b415d4e0 0x7f54b40d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.620+0000 7f54b2ffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f54b415d100 0x7f54b40ce510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45824/0 (socket says 172.21.15.77:45824) 2023-11-04T01:47:00.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.620+0000 7f54b2ffd640 1 -- 172.21.15.77:0/29603576 learned_addr learned my addr 172.21.15.77:0/29603576 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:47:00.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.620+0000 7f54b37fe640 1 --2- 172.21.15.77:0/29603576 >> v2:172.21.15.122:3300/0 conn(0x7f54b40d3b60 0x7f54b40d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.620+0000 7f54b1ffb640 1 -- 172.21.15.77:0/29603576 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3428075510 0 0) 0x7f54b40b32b0 con 0x7f54b415d100 2023-11-04T01:47:00.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.620+0000 7f54b1ffb640 1 -- 172.21.15.77:0/29603576 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f549c003520 con 0x7f54b415d100 2023-11-04T01:47:00.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.620+0000 7f54b27fc640 1 -- 172.21.15.77:0/29603576 >> v2:172.21.15.122:3300/0 conn(0x7f54b40d3b60 msgr2=0x7f54b40d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:00.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.620+0000 7f54b27fc640 1 --2- 172.21.15.77:0/29603576 >> v2:172.21.15.122:3300/0 conn(0x7f54b40d3b60 0x7f54b40d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.620+0000 7f54b27fc640 1 -- 172.21.15.77:0/29603576 >> v1:172.21.15.77:6789/0 conn(0x7f54b415d100 legacy=0x7f54b40ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.620+0000 7f54b27fc640 1 -- 172.21.15.77:0/29603576 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b40b4750 con 0x7f54b415d4e0 2023-11-04T01:47:00.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.620+0000 7f54b37fe640 1 --2- 172.21.15.77:0/29603576 >> v2:172.21.15.122:3300/0 conn(0x7f54b40d3b60 0x7f54b40d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:00.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.621+0000 7f54b27fc640 1 --2- 172.21.15.77:0/29603576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54b415d4e0 0x7f54b40d14d0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f54b408d6a0 tx=0x7f54a802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d21f5320c4b80b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:00.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.621+0000 7f54b1ffb640 1 -- 172.21.15.77:0/29603576 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a8031830 con 0x7f54b415d4e0 2023-11-04T01:47:00.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.621+0000 7f54b1ffb640 1 -- 172.21.15.77:0/29603576 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a8031990 con 0x7f54b415d4e0 2023-11-04T01:47:00.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.621+0000 7f54b1ffb640 1 -- 172.21.15.77:0/29603576 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a8031d20 con 0x7f54b415d4e0 2023-11-04T01:47:00.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.622+0000 7f54b94d7640 1 -- 172.21.15.77:0/29603576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54b415d4e0 msgr2=0x7f54b40d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.622+0000 7f54b94d7640 1 --2- 172.21.15.77:0/29603576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54b415d4e0 0x7f54b40d14d0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f54b408d6a0 tx=0x7f54a802b8d0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.622+0000 7f54b94d7640 1 -- 172.21.15.77:0/29603576 shutdown_connections 2023-11-04T01:47:00.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.622+0000 7f54b94d7640 1 --2- 172.21.15.77:0/29603576 >> v2:172.21.15.122:3300/0 conn(0x7f54b40d3b60 0x7f54b40d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.622+0000 7f54b94d7640 1 --2- 172.21.15.77:0/29603576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54b415d4e0 0x7f54b40d14d0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.622+0000 7f54b94d7640 1 -- 172.21.15.77:0/29603576 >> 172.21.15.77:0/29603576 conn(0x7f54b40d2ef0 msgr2=0x7f54b40d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:00.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.622+0000 7f54b94d7640 1 -- 172.21.15.77:0/29603576 shutdown_connections 2023-11-04T01:47:00.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.622+0000 7f54b94d7640 1 -- 172.21.15.77:0/29603576 wait complete. 2023-11-04T01:47:00.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.623+0000 7f54b94d7640 1 Processor -- start 2023-11-04T01:47:00.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.623+0000 7f54b94d7640 1 -- start start 2023-11-04T01:47:00.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.624+0000 7f54b94d7640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54b40d3b60 0x7f54b41f3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.624+0000 7f54b94d7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54b415d100 0x7f54b40c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.624+0000 7f54b94d7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54b415d4e0 0x7f54b415fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.624+0000 7f54b94d7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b415af70 con 0x7f54b415d100 2023-11-04T01:47:00.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.624+0000 7f54b94d7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b409cda0 con 0x7f54b415d4e0 2023-11-04T01:47:00.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.624+0000 7f54b94d7640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b41f3a70 con 0x7f54b40d3b60 2023-11-04T01:47:00.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.624+0000 7f54b27fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54b415d100 0x7f54b40c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.624+0000 7f54b27fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54b415d100 0x7f54b40c97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33834/0 (socket says 172.21.15.77:33834) 2023-11-04T01:47:00.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.624+0000 7f54b27fc640 1 -- 172.21.15.77:0/3825006078 learned_addr learned my addr 172.21.15.77:0/3825006078 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:00.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.624+0000 7f54b37fe640 1 --2- 172.21.15.77:0/3825006078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54b415d4e0 0x7f54b415fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.624+0000 7f54b2ffd640 1 --2- 172.21.15.77:0/3825006078 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54b40d3b60 0x7f54b41f3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.624+0000 7f54b27fc640 1 -- 172.21.15.77:0/3825006078 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54b40d3b60 msgr2=0x7f54b41f3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.624+0000 7f54b27fc640 1 --2- 172.21.15.77:0/3825006078 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54b40d3b60 0x7f54b41f3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.624+0000 7f54b27fc640 1 -- 172.21.15.77:0/3825006078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54b415d4e0 msgr2=0x7f54b415fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.624+0000 7f54b27fc640 1 --2- 172.21.15.77:0/3825006078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54b415d4e0 0x7f54b415fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.624+0000 7f54b27fc640 1 -- 172.21.15.77:0/3825006078 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a8009400 con 0x7f54b415d100 2023-11-04T01:47:00.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.625+0000 7f54b27fc640 1 --2- 172.21.15.77:0/3825006078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54b415d100 0x7f54b40c97c0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f54a8000c00 tx=0x7f54a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:00.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.625+0000 7f549b7fe640 1 -- 172.21.15.77:0/3825006078 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a803a830 con 0x7f54b415d100 2023-11-04T01:47:00.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.625+0000 7f549b7fe640 1 -- 172.21.15.77:0/3825006078 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a803a990 con 0x7f54b415d100 2023-11-04T01:47:00.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.625+0000 7f54b94d7640 1 -- 172.21.15.77:0/3825006078 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b40ca560 con 0x7f54b415d100 2023-11-04T01:47:00.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.625+0000 7f549b7fe640 1 -- 172.21.15.77:0/3825006078 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a803ad40 con 0x7f54b415d100 2023-11-04T01:47:00.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.625+0000 7f54b94d7640 1 -- 172.21.15.77:0/3825006078 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b40cab20 con 0x7f54b415d100 2023-11-04T01:47:00.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.626+0000 7f54b94d7640 1 -- 172.21.15.77:0/3825006078 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b40684b0 con 0x7f54b415d100 2023-11-04T01:47:00.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.626+0000 7f549b7fe640 1 -- 172.21.15.77:0/3825006078 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f54a804d450 con 0x7f54b415d100 2023-11-04T01:47:00.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.627+0000 7f549b7fe640 1 --2- 172.21.15.77:0/3825006078 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f54a006ae70 0x7f54a006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.627+0000 7f549b7fe640 1 -- 172.21.15.77:0/3825006078 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f54a80abd10 con 0x7f54b415d100 2023-11-04T01:47:00.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.627+0000 7f54b2ffd640 1 --2- 172.21.15.77:0/3825006078 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f54a006ae70 0x7f54a006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.628+0000 7f54b2ffd640 1 --2- 172.21.15.77:0/3825006078 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f54a006ae70 0x7f54a006d330 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f54a40010e0 tx=0x7f54a4007be0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:00.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.631+0000 7f549b7fe640 1 -- 172.21.15.77:0/3825006078 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f54a8076640 con 0x7f54b415d100 2023-11-04T01:47:00.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.809+0000 7f54b94d7640 1 -- 172.21.15.77:0/3825006078 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f54b40d2cd0 con 0x7f54b415d100 2023-11-04T01:47:00.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.810+0000 7f549b7fe640 1 -- 172.21.15.77:0/3825006078 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 18 entries v112) v1 ==== 81+0+1096 (secure 0 0 0) 0x7f54a8035460 con 0x7f54b415d100 2023-11-04T01:47:00.813 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.1:0/2249624526 2023-11-04T02:46:54.400007+0000 2023-11-04T01:47:00.813 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6834/1450731169 2023-11-05T01:46:46.102329+0000 2023-11-04T01:47:00.813 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6834/3276812155 2023-11-05T01:46:39.299125+0000 2023-11-04T01:47:00.814 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6832/3276812155 2023-11-05T01:46:39.299125+0000 2023-11-04T01:47:00.814 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6836/1450731169 2023-11-05T01:46:46.102329+0000 2023-11-04T01:47:00.814 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6834/3699147778 2023-11-05T01:44:11.242543+0000 2023-11-04T01:47:00.814 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6836/3699147778 2023-11-05T01:44:11.242543+0000 2023-11-04T01:47:00.814 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6834/4241784871 2023-11-05T01:44:36.807284+0000 2023-11-04T01:47:00.815 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6834/2908314953 2023-11-05T01:45:01.982045+0000 2023-11-04T01:47:00.815 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6834/285184758 2023-11-05T01:45:27.182069+0000 2023-11-04T01:47:00.815 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6836/2908314953 2023-11-05T01:45:01.982045+0000 2023-11-04T01:47:00.815 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6836/1345816612 2023-11-05T01:45:54.789240+0000 2023-11-04T01:47:00.815 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6832/285184758 2023-11-05T01:45:27.182069+0000 2023-11-04T01:47:00.816 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6834/1345816612 2023-11-05T01:45:54.789240+0000 2023-11-04T01:47:00.816 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6833/3207490604 2023-11-05T01:46:01.591697+0000 2023-11-04T01:47:00.816 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6832/4241784871 2023-11-05T01:44:36.807284+0000 2023-11-04T01:47:00.816 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6835/3207490604 2023-11-05T01:46:01.591697+0000 2023-11-04T01:47:00.816 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.1:0/3032548059 2023-11-04T02:46:09.897134+0000 2023-11-04T01:47:00.817 INFO:teuthology.orchestra.run.smithi077.stderr:listed 18 entries 2023-11-04T01:47:00.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.812+0000 7f54b94d7640 1 -- 172.21.15.77:0/3825006078 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f54a006ae70 msgr2=0x7f54a006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.812+0000 7f54b94d7640 1 --2- 172.21.15.77:0/3825006078 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f54a006ae70 0x7f54a006d330 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f54a40010e0 tx=0x7f54a4007be0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.812+0000 7f54b94d7640 1 -- 172.21.15.77:0/3825006078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54b415d100 msgr2=0x7f54b40c97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.812+0000 7f54b94d7640 1 --2- 172.21.15.77:0/3825006078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54b415d100 0x7f54b40c97c0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f54a8000c00 tx=0x7f54a80046c0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.812+0000 7f54b94d7640 1 -- 172.21.15.77:0/3825006078 shutdown_connections 2023-11-04T01:47:00.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.812+0000 7f54b94d7640 1 --2- 172.21.15.77:0/3825006078 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f54a006ae70 0x7f54a006d330 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.812+0000 7f54b94d7640 1 --2- 172.21.15.77:0/3825006078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54b415d4e0 0x7f54b415fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.812+0000 7f54b94d7640 1 --2- 172.21.15.77:0/3825006078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54b415d100 0x7f54b40c97c0 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.812+0000 7f54b94d7640 1 --2- 172.21.15.77:0/3825006078 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f54b40d3b60 0x7f54b41f3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.812+0000 7f54b94d7640 1 -- 172.21.15.77:0/3825006078 >> 172.21.15.77:0/3825006078 conn(0x7f54b40d2ef0 msgr2=0x7f54b415c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:00.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.812+0000 7f54b94d7640 1 -- 172.21.15.77:0/3825006078 shutdown_connections 2023-11-04T01:47:00.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:00.812+0000 7f54b94d7640 1 -- 172.21.15.77:0/3825006078 wait complete. 2023-11-04T01:47:00.825 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2023-11-04T01:47:00.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:00.826 DEBUG:teuthology.orchestra.run.smithi077:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2023-11-04T01:47:00.852 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[153551]: fuse finished with error 0 and tester_r 0 2023-11-04T01:47:00.853 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2023-11-04T01:47:00.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:00.854 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:47:00.908 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:47:00.909 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:47:00.963 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19534 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:47:00.964 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:47:01.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.101+0000 7fce2c81a640 1 Processor -- start 2023-11-04T01:47:01.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.101+0000 7fce2c81a640 1 -- start start 2023-11-04T01:47:01.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.102+0000 7fce2c81a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fce280addd0 0x7fce280cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:01.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.102+0000 7fce2c81a640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fce2806c220 0x7fce280ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:01.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.102+0000 7fce2c81a640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce280cd720 con 0x7fce280cc680 2023-11-04T01:47:01.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.102+0000 7fce2c81a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce280ae1b0 con 0x7fce280addd0 2023-11-04T01:47:01.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.102+0000 7fce2c81a640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce280ccb10 con 0x7fce2806c220 2023-11-04T01:47:01.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.102+0000 7fce2659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fce280addd0 0x7fce280cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:01.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.102+0000 7fce2659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fce280addd0 0x7fce280cdbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33838/0 (socket says 172.21.15.77:33838) 2023-11-04T01:47:01.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.102+0000 7fce2659c640 1 -- 172.21.15.77:0/2763280783 learned_addr learned my addr 172.21.15.77:0/2763280783 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:01.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.102+0000 7fce26d9d640 1 --2- 172.21.15.77:0/2763280783 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fce2806c220 0x7fce280ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:01.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.102+0000 7fce2659c640 1 -- 172.21.15.77:0/2763280783 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fce2806c220 msgr2=0x7fce280ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:01.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.102+0000 7fce2659c640 1 --2- 172.21.15.77:0/2763280783 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fce2806c220 0x7fce280ca2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:01.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.102+0000 7fce2659c640 1 -- 172.21.15.77:0/2763280783 >> v1:172.21.15.122:6789/0 conn(0x7fce280cc680 legacy=0x7fce2806bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:01.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.102+0000 7fce2659c640 1 -- 172.21.15.77:0/2763280783 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce280ccdf0 con 0x7fce280addd0 2023-11-04T01:47:01.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.103+0000 7fce2659c640 1 --2- 172.21.15.77:0/2763280783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce280addd0 0x7fce280cdbb0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fce18009870 tx=0x7fce1802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b4f0fa1d9dac87e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:01.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.103+0000 7fce2559a640 1 -- 172.21.15.77:0/2763280783 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce18030840 con 0x7fce280addd0 2023-11-04T01:47:01.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.103+0000 7fce2559a640 1 -- 172.21.15.77:0/2763280783 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce180309a0 con 0x7fce280addd0 2023-11-04T01:47:01.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.103+0000 7fce2559a640 1 -- 172.21.15.77:0/2763280783 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce18030d30 con 0x7fce280addd0 2023-11-04T01:47:01.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.103+0000 7fce2c81a640 1 -- 172.21.15.77:0/2763280783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce280addd0 msgr2=0x7fce280cdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:01.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.103+0000 7fce2c81a640 1 --2- 172.21.15.77:0/2763280783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce280addd0 0x7fce280cdbb0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fce18009870 tx=0x7fce1802b980 comp rx=0 tx=0).stop 2023-11-04T01:47:01.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.104+0000 7fce2c81a640 1 -- 172.21.15.77:0/2763280783 shutdown_connections 2023-11-04T01:47:01.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.104+0000 7fce2c81a640 1 --2- 172.21.15.77:0/2763280783 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fce2806c220 0x7fce280ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:01.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.104+0000 7fce2c81a640 1 --2- 172.21.15.77:0/2763280783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce280addd0 0x7fce280cdbb0 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:01.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.104+0000 7fce2c81a640 1 -- 172.21.15.77:0/2763280783 >> 172.21.15.77:0/2763280783 conn(0x7fce280cb530 msgr2=0x7fce280cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:01.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.104+0000 7fce2c81a640 1 -- 172.21.15.77:0/2763280783 shutdown_connections 2023-11-04T01:47:01.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.104+0000 7fce2c81a640 1 -- 172.21.15.77:0/2763280783 wait complete. 2023-11-04T01:47:01.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.105+0000 7fce2c81a640 1 Processor -- start 2023-11-04T01:47:01.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.105+0000 7fce2c81a640 1 -- start start 2023-11-04T01:47:01.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.106+0000 7fce2c81a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce2806c220 0x7fce28154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:01.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.106+0000 7fce2c81a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce280addd0 0x7fce28165360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:01.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.106+0000 7fce2c81a640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fce281658a0 0x7fce280c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:01.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.106+0000 7fce2c81a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce28165d50 con 0x7fce280addd0 2023-11-04T01:47:01.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.106+0000 7fce2c81a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce28155470 con 0x7fce2806c220 2023-11-04T01:47:01.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.106+0000 7fce2c81a640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce281548d0 con 0x7fce281658a0 2023-11-04T01:47:01.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.106+0000 7fce25d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce280addd0 0x7fce28165360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:01.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.106+0000 7fce25d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce280addd0 0x7fce28165360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33854/0 (socket says 172.21.15.77:33854) 2023-11-04T01:47:01.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.106+0000 7fce25d9b640 1 -- 172.21.15.77:0/883923481 learned_addr learned my addr 172.21.15.77:0/883923481 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:01.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.106+0000 7fce25d9b640 1 -- 172.21.15.77:0/883923481 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fce281658a0 msgr2=0x7fce280c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:01.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.106+0000 7fce25d9b640 1 --2- 172.21.15.77:0/883923481 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fce281658a0 0x7fce280c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:01.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.106+0000 7fce25d9b640 1 -- 172.21.15.77:0/883923481 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce2806c220 msgr2=0x7fce28154030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:01.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.106+0000 7fce25d9b640 1 --2- 172.21.15.77:0/883923481 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce2806c220 0x7fce28154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:01.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.106+0000 7fce25d9b640 1 -- 172.21.15.77:0/883923481 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce180094d0 con 0x7fce280addd0 2023-11-04T01:47:01.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.106+0000 7fce25d9b640 1 --2- 172.21.15.77:0/883923481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce280addd0 0x7fce28165360 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fce1c00c430 tx=0x7fce1c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:01.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.106+0000 7fce16ffd640 1 -- 172.21.15.77:0/883923481 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c0052d0 con 0x7fce280addd0 2023-11-04T01:47:01.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.106+0000 7fce16ffd640 1 -- 172.21.15.77:0/883923481 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce1c005430 con 0x7fce280addd0 2023-11-04T01:47:01.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.106+0000 7fce2c81a640 1 -- 172.21.15.77:0/883923481 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce280c4f00 con 0x7fce280addd0 2023-11-04T01:47:01.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.106+0000 7fce16ffd640 1 -- 172.21.15.77:0/883923481 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c003830 con 0x7fce280addd0 2023-11-04T01:47:01.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.106+0000 7fce2c81a640 1 -- 172.21.15.77:0/883923481 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce28155100 con 0x7fce280addd0 2023-11-04T01:47:01.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.107+0000 7fce2c81a640 1 -- 172.21.15.77:0/883923481 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce28154c60 con 0x7fce280addd0 2023-11-04T01:47:01.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.108+0000 7fce16ffd640 1 -- 172.21.15.77:0/883923481 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fce1c003990 con 0x7fce280addd0 2023-11-04T01:47:01.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.108+0000 7fce16ffd640 1 --2- 172.21.15.77:0/883923481 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fce0806ae70 0x7fce0806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:01.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.108+0000 7fce16ffd640 1 -- 172.21.15.77:0/883923481 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7952+0+0 (secure 0 0 0) 0x7fce1c089430 con 0x7fce280addd0 2023-11-04T01:47:01.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.108+0000 7fce2659c640 1 --2- 172.21.15.77:0/883923481 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fce0806ae70 0x7fce0806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:01.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.109+0000 7fce2659c640 1 --2- 172.21.15.77:0/883923481 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fce0806ae70 0x7fce0806d330 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fce18036000 tx=0x7fce1803b040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:01.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.112+0000 7fce16ffd640 1 -- 172.21.15.77:0/883923481 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fce1c053c20 con 0x7fce280addd0 2023-11-04T01:47:01.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.315+0000 7fce2c81a640 1 -- 172.21.15.77:0/883923481 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fce28155620 con 0x7fce280addd0 2023-11-04T01:47:01.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.315+0000 7fce16ffd640 1 -- 172.21.15.77:0/883923481 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v104) v1 ==== 53+0+73 (secure 0 0 0) 0x7fce28155620 con 0x7fce280addd0 2023-11-04T01:47:01.317 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:47:01.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.317+0000 7fce2c81a640 1 -- 172.21.15.77:0/883923481 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fce0806ae70 msgr2=0x7fce0806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:01.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.317+0000 7fce2c81a640 1 --2- 172.21.15.77:0/883923481 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fce0806ae70 0x7fce0806d330 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fce18036000 tx=0x7fce1803b040 comp rx=0 tx=0).stop 2023-11-04T01:47:01.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.317+0000 7fce2c81a640 1 -- 172.21.15.77:0/883923481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce280addd0 msgr2=0x7fce28165360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:01.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.317+0000 7fce2c81a640 1 --2- 172.21.15.77:0/883923481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce280addd0 0x7fce28165360 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fce1c00c430 tx=0x7fce1c00c8f0 comp rx=0 tx=0).stop 2023-11-04T01:47:01.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.317+0000 7fce2c81a640 1 -- 172.21.15.77:0/883923481 shutdown_connections 2023-11-04T01:47:01.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.317+0000 7fce2c81a640 1 --2- 172.21.15.77:0/883923481 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fce0806ae70 0x7fce0806d330 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:01.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.317+0000 7fce2c81a640 1 --2- 172.21.15.77:0/883923481 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fce281658a0 0x7fce280c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:01.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.317+0000 7fce2c81a640 1 --2- 172.21.15.77:0/883923481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce280addd0 0x7fce28165360 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:01.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.317+0000 7fce2c81a640 1 --2- 172.21.15.77:0/883923481 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce2806c220 0x7fce28154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:01.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.317+0000 7fce2c81a640 1 -- 172.21.15.77:0/883923481 >> 172.21.15.77:0/883923481 conn(0x7fce280cb530 msgr2=0x7fce280aebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:01.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.317+0000 7fce2c81a640 1 -- 172.21.15.77:0/883923481 shutdown_connections 2023-11-04T01:47:01.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:01.317+0000 7fce2c81a640 1 -- 172.21.15.77:0/883923481 wait complete. 2023-11-04T01:47:01.329 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:47:01.329 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:47:01.330 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2023-11-04T01:47:01.330 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:47:01.330 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:47:01.331 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:47:01.331 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:47:01.331 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:47:01.332 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:47:01.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:01.333 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2023-11-04T01:47:01.349 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:47:01.349 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:47:01.349 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:47:01.350 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:47:01.350 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2023-11-04T01:47:01.350 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:47:01.350 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:47:01.350 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:47:01.351 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f0 2023-11-04T01:47:01.351 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:47:01.351 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:47:01.351 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f1 2023-11-04T01:47:01.351 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:47:01.352 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:47:01.352 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:47:01.352 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:47:01.352 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:47:01.352 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 41984sec preferred_lft 41984sec 2023-11-04T01:47:01.353 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::ec4:7aff:fe8f:d3d3/64 scope link 2023-11-04T01:47:01.353 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:47:01.353 INFO:teuthology.orchestra.run.smithi077.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:47:01.353 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 06:3a:02:11:c4:57 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:47:01.353 INFO:teuthology.orchestra.run.smithi077.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:47:01.354 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:47:01.354 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::8039:1aff:fee2:109f/64 scope link 2023-11-04T01:47:01.354 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:47:01.354 INFO:teuthology.orchestra.run.smithi077.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:47:01.354 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 06:3a:02:11:c4:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:47:01.355 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::43a:2ff:fe11:c457/64 scope link 2023-11-04T01:47:01.355 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:47:01.355 INFO:teuthology.orchestra.run.smithi077.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:47:01.355 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether c2:4f:2a:69:4f:38 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:47:01.355 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::c04f:2aff:fe69:4f38/64 scope link 2023-11-04T01:47:01.356 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:47:01.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:01.356 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:47:01.413 INFO:teuthology.orchestra.run.smithi077.stdout:1 2023-11-04T01:47:01.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:01.415 DEBUG:teuthology.orchestra.run.smithi077:> route 2023-11-04T01:47:01.418 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:47:01.458 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:47:01.471 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2023-11-04T01:47:01.471 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:47:01.471 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:47:01.471 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:47:01.472 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:47:01.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:01.472 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-11-04T01:47:01.473 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-11-04T01:47:01.473 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:47:01.474 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:47:01.474 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:47:01.474 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-11-04T01:47:01.526 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:2023-11-04T01:47:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:47:01.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:01.580 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2023-11-04T01:47:01.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:47:01.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:47:01.635 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:47:01.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:01.636 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 up 2023-11-04T01:47:01.701 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:47:01.701 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:47:01.702 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:47:01.755 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:47:01.756 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:47:01.756 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:47:01.810 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:47:01.865 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2023-11-04T01:47:01.866 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2023-11-04T01:47:01.866 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2023-11-04T01:47:01.866 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2023-11-04T01:47:01.866 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2023-11-04T01:47:01.867 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2023-11-04T01:47:01.867 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2023-11-04T01:47:01.867 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2023-11-04T01:47:01.867 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2023-11-04T01:47:01.867 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2023-11-04T01:47:01.867 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2023-11-04T01:47:01.868 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2023-11-04T01:47:01.868 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:47:01.868 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2023-11-04T01:47:01.868 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2023-11-04T01:47:01.868 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2023-11-04T01:47:01.868 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2023-11-04T01:47:01.869 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2023-11-04T01:47:01.869 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2023-11-04T01:47:01.869 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:47:01.869 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:47:01.869 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:47:01.870 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:47:01.870 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2023-11-04T01:47:01.870 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2023-11-04T01:47:01.870 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:47:01.870 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:47:01.871 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:47:01.871 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:47:01.871 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2023-11-04T01:47:01.871 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:47:01.871 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:47:01.872 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:47:01.872 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:47:01.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:01.872 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-11-04T01:47:01.919 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:47:01.920 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:47:01.962 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:47:01.977 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2023-11-04T01:47:01.977 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2023-11-04T01:47:01.977 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2023-11-04T01:47:01.977 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2023-11-04T01:47:01.978 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2023-11-04T01:47:01.978 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2023-11-04T01:47:01.978 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2023-11-04T01:47:01.978 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2023-11-04T01:47:01.978 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2023-11-04T01:47:01.979 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2023-11-04T01:47:01.979 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2023-11-04T01:47:01.979 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2023-11-04T01:47:01.979 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:47:01.979 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2023-11-04T01:47:01.979 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2023-11-04T01:47:01.980 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2023-11-04T01:47:01.980 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2023-11-04T01:47:01.980 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2023-11-04T01:47:01.980 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2023-11-04T01:47:01.980 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:47:01.981 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:47:01.981 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:47:01.981 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:47:01.981 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2023-11-04T01:47:01.981 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2023-11-04T01:47:01.981 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:47:01.982 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:47:01.982 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:47:01.982 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:47:01.982 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2023-11-04T01:47:01.982 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:47:01.983 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:47:01.983 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:47:01.983 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:47:01.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:01.983 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-11-04T01:47:02.051 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:2023-11-04T01:47:02.049+0000 7f26b623a480 -1 init, newargv = 0x562c52469be0 newargc=15 2023-11-04T01:47:02.051 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[155739]: starting ceph client 2023-11-04T01:47:02.057 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[155739]: starting fuse 2023-11-04T01:47:03.132 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:47:03.152 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2023-11-04T01:47:03.153 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2023-11-04T01:47:03.153 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2023-11-04T01:47:03.153 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2023-11-04T01:47:03.153 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2023-11-04T01:47:03.153 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2023-11-04T01:47:03.154 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2023-11-04T01:47:03.154 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2023-11-04T01:47:03.154 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2023-11-04T01:47:03.154 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2023-11-04T01:47:03.154 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2023-11-04T01:47:03.154 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2023-11-04T01:47:03.155 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:47:03.155 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2023-11-04T01:47:03.155 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2023-11-04T01:47:03.155 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2023-11-04T01:47:03.155 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2023-11-04T01:47:03.155 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2023-11-04T01:47:03.156 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2023-11-04T01:47:03.156 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:47:03.156 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:47:03.156 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:47:03.156 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:47:03.157 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2023-11-04T01:47:03.157 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2023-11-04T01:47:03.157 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:47:03.157 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:47:03.157 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:47:03.158 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:47:03.158 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2023-11-04T01:47:03.158 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:47:03.158 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:47:03.158 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:47:03.159 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:47:03.159 INFO:teuthology.orchestra.run.smithi077.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:47:03.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:03.160 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-11-04T01:47:03.210 INFO:teuthology.orchestra.run.smithi077.stdout:42 2023-11-04T01:47:03.211 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-11-04T01:47:03.212 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:47:03.212 DEBUG:teuthology.orchestra.run.smithi077:> import glob 2023-11-04T01:47:03.212 DEBUG:teuthology.orchestra.run.smithi077:> import re 2023-11-04T01:47:03.213 DEBUG:teuthology.orchestra.run.smithi077:> import os 2023-11-04T01:47:03.213 DEBUG:teuthology.orchestra.run.smithi077:> import subprocess 2023-11-04T01:47:03.213 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:47:03.214 DEBUG:teuthology.orchestra.run.smithi077:> def _find_admin_socket(client_name): 2023-11-04T01:47:03.214 DEBUG:teuthology.orchestra.run.smithi077:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:47:03.214 DEBUG:teuthology.orchestra.run.smithi077:> files = glob.glob(asok_path) 2023-11-04T01:47:03.215 DEBUG:teuthology.orchestra.run.smithi077:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:47:03.215 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:47:03.216 DEBUG:teuthology.orchestra.run.smithi077:> # Given a non-glob path, it better be there 2023-11-04T01:47:03.216 DEBUG:teuthology.orchestra.run.smithi077:> if "*" not in asok_path: 2023-11-04T01:47:03.216 DEBUG:teuthology.orchestra.run.smithi077:> assert(len(files) == 1) 2023-11-04T01:47:03.217 DEBUG:teuthology.orchestra.run.smithi077:> return files[0] 2023-11-04T01:47:03.217 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:47:03.217 DEBUG:teuthology.orchestra.run.smithi077:> for f in files: 2023-11-04T01:47:03.218 DEBUG:teuthology.orchestra.run.smithi077:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:47:03.218 DEBUG:teuthology.orchestra.run.smithi077:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:47:03.218 DEBUG:teuthology.orchestra.run.smithi077:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:47:03.219 DEBUG:teuthology.orchestra.run.smithi077:> contents = proc_f.read() 2023-11-04T01:47:03.219 DEBUG:teuthology.orchestra.run.smithi077:> if mountpoint in contents: 2023-11-04T01:47:03.219 DEBUG:teuthology.orchestra.run.smithi077:> return f 2023-11-04T01:47:03.220 DEBUG:teuthology.orchestra.run.smithi077:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:47:03.220 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:47:03.221 DEBUG:teuthology.orchestra.run.smithi077:> print(_find_admin_socket("client.0")) 2023-11-04T01:47:03.221 DEBUG:teuthology.orchestra.run.smithi077:> ' 2023-11-04T01:47:03.335 INFO:teuthology.orchestra.run.smithi077.stdout:/var/run/ceph/ceph-client.0.155739.asok 2023-11-04T01:47:03.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:47:03.346 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.155739.asok 2023-11-04T01:47:03.346 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:47:03.347 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.155739.asok status 2023-11-04T01:47:03.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:47:03.514 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-04T01:47:03.515 INFO:teuthology.orchestra.run.smithi077.stdout: "metadata": { 2023-11-04T01:47:03.515 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:47:03.515 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:47:03.515 INFO:teuthology.orchestra.run.smithi077.stdout: "entity_id": "0", 2023-11-04T01:47:03.516 INFO:teuthology.orchestra.run.smithi077.stdout: "hostname": "smithi077", 2023-11-04T01:47:03.516 INFO:teuthology.orchestra.run.smithi077.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:47:03.516 INFO:teuthology.orchestra.run.smithi077.stdout: "pid": "155739", 2023-11-04T01:47:03.516 INFO:teuthology.orchestra.run.smithi077.stdout: "root": "/" 2023-11-04T01:47:03.516 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:47:03.516 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_count": 0, 2023-11-04T01:47:03.517 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_pinned_count": 0, 2023-11-04T01:47:03.517 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 8499, 2023-11-04T01:47:03.517 INFO:teuthology.orchestra.run.smithi077.stdout: "inst": { 2023-11-04T01:47:03.517 INFO:teuthology.orchestra.run.smithi077.stdout: "name": { 2023-11-04T01:47:03.517 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "client", 2023-11-04T01:47:03.518 INFO:teuthology.orchestra.run.smithi077.stdout: "num": 8499 2023-11-04T01:47:03.518 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:47:03.518 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2023-11-04T01:47:03.518 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2023-11-04T01:47:03.518 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:47:03.519 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2955237098 2023-11-04T01:47:03.519 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:47:03.519 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:47:03.519 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2023-11-04T01:47:03.519 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2023-11-04T01:47:03.520 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:47:03.520 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2955237098 2023-11-04T01:47:03.520 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:47:03.520 INFO:teuthology.orchestra.run.smithi077.stdout: "inst_str": "client.8499 192.168.0.1:0/2955237098", 2023-11-04T01:47:03.520 INFO:teuthology.orchestra.run.smithi077.stdout: "addr_str": "192.168.0.1:0/2955237098", 2023-11-04T01:47:03.521 INFO:teuthology.orchestra.run.smithi077.stdout: "inode_count": 1, 2023-11-04T01:47:03.521 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_epoch": 104, 2023-11-04T01:47:03.521 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch": 112, 2023-11-04T01:47:03.521 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:47:03.521 INFO:teuthology.orchestra.run.smithi077.stdout: "blocklisted": false, 2023-11-04T01:47:03.522 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs" 2023-11-04T01:47:03.522 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-04T01:47:03.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:47:03.528 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:47:03.529 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:47:03.529 DEBUG:teuthology.orchestra.run.smithi077:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:47:03.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:47:03.587 INFO:teuthology.orchestra.run.smithi077.stdout:fuseblk 2023-11-04T01:47:03.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:47:03.594 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:47:03.594 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:47:03.595 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:47:03.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:47:03.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:47:03.660 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 flush journal 2023-11-04T01:47:03.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.760+0000 7f9f66724640 1 Processor -- start 2023-11-04T01:47:03.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.760+0000 7f9f66724640 1 -- start start 2023-11-04T01:47:03.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.761+0000 7f9f66724640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f9f6006d9c0 0x7f9f600710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.761+0000 7f9f66724640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f6006cc90 con 0x7f9f600ade00 2023-11-04T01:47:03.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.761+0000 7f9f66724640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f600b0e60 con 0x7f9f6006c5f0 2023-11-04T01:47:03.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.761+0000 7f9f66724640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f600b0c40 con 0x7f9f6006d9c0 2023-11-04T01:47:03.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.761+0000 7f9f5ffff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f9f600ade00 0x7f9f600b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45832/0 (socket says 172.21.15.77:45832) 2023-11-04T01:47:03.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.761+0000 7f9f5ffff640 1 -- 172.21.15.77:0/259220111 learned_addr learned my addr 172.21.15.77:0/259220111 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:47:03.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.761+0000 7f9f5f7fe640 1 --2- 172.21.15.77:0/259220111 >> v2:172.21.15.122:3300/0 conn(0x7f9f6006d9c0 0x7f9f600710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.761+0000 7f9f5effd640 1 -- 172.21.15.77:0/259220111 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 312565986 0 0) 0x7f9f6006cc90 con 0x7f9f600ade00 2023-11-04T01:47:03.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.761+0000 7f9f5effd640 1 -- 172.21.15.77:0/259220111 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f48003520 con 0x7f9f600ade00 2023-11-04T01:47:03.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.761+0000 7f9f5effd640 1 -- 172.21.15.77:0/259220111 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2855306349 0 0) 0x7f9f48003520 con 0x7f9f600ade00 2023-11-04T01:47:03.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.761+0000 7f9f5effd640 1 -- 172.21.15.77:0/259220111 >> v2:172.21.15.122:3300/0 conn(0x7f9f6006d9c0 msgr2=0x7f9f600710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:03.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.761+0000 7f9f5effd640 1 --2- 172.21.15.77:0/259220111 >> v2:172.21.15.122:3300/0 conn(0x7f9f6006d9c0 0x7f9f600710d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.761+0000 7f9f5effd640 1 -- 172.21.15.77:0/259220111 >> v1:172.21.15.122:6789/0 conn(0x7f9f6006c5f0 legacy=0x7f9f600cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:03.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.761+0000 7f9f5effd640 1 -- 172.21.15.77:0/259220111 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f6006cee0 con 0x7f9f600ade00 2023-11-04T01:47:03.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.761+0000 7f9f5effd640 1 -- 172.21.15.77:0/259220111 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f9f50001670 con 0x7f9f600ade00 2023-11-04T01:47:03.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.761+0000 7f9f5effd640 1 -- 172.21.15.77:0/259220111 >> v1:172.21.15.77:6789/0 conn(0x7f9f600ade00 legacy=0x7f9f600b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:03.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.761+0000 7f9f5effd640 1 --2- 172.21.15.77:0/259220111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f48003970 0x7f9f48003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.761+0000 7f9f5effd640 1 --2- 172.21.15.77:0/259220111 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f480047c0 0x7f9f48004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.761+0000 7f9f5effd640 1 --2- 172.21.15.77:0/259220111 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f480052a0 0x7f9f4800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.761+0000 7f9f5effd640 1 -- 172.21.15.77:0/259220111 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f600b0c40 con 0x7f9f48003970 2023-11-04T01:47:03.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.761+0000 7f9f5effd640 1 -- 172.21.15.77:0/259220111 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4800c170 con 0x7f9f480052a0 2023-11-04T01:47:03.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.761+0000 7f9f5effd640 1 -- 172.21.15.77:0/259220111 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4800c330 con 0x7f9f480047c0 2023-11-04T01:47:03.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.761+0000 7f9f5ffff640 1 --2- 172.21.15.77:0/259220111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f48003970 0x7f9f48003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.762+0000 7f9f5f7fe640 1 --2- 172.21.15.77:0/259220111 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f480047c0 0x7f9f48004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.762+0000 7f9f64cc1640 1 --2- 172.21.15.77:0/259220111 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f480052a0 0x7f9f4800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.762+0000 7f9f5ffff640 1 -- 172.21.15.77:0/259220111 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f480047c0 msgr2=0x7f9f48004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:03.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.762+0000 7f9f5ffff640 1 --2- 172.21.15.77:0/259220111 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f480047c0 0x7f9f48004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.762+0000 7f9f5ffff640 1 -- 172.21.15.77:0/259220111 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f480052a0 msgr2=0x7f9f4800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:03.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.762+0000 7f9f5ffff640 1 --2- 172.21.15.77:0/259220111 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f480052a0 0x7f9f4800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.762+0000 7f9f5ffff640 1 -- 172.21.15.77:0/259220111 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f48003520 con 0x7f9f48003970 2023-11-04T01:47:03.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.762+0000 7f9f64cc1640 1 --2- 172.21.15.77:0/259220111 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f480052a0 0x7f9f4800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:03.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.762+0000 7f9f64cc1640 1 -- 172.21.15.77:0/259220111 reap_dead start 2023-11-04T01:47:03.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.762+0000 7f9f5ffff640 1 --2- 172.21.15.77:0/259220111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f48003970 0x7f9f48003d90 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f9f5000c210 tx=0x7f9f480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=981241af4ce632c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:03.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.763+0000 7f9f5effd640 1 -- 172.21.15.77:0/259220111 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f50005ad0 con 0x7f9f48003970 2023-11-04T01:47:03.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.763+0000 7f9f5effd640 1 -- 172.21.15.77:0/259220111 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f50005c50 con 0x7f9f48003970 2023-11-04T01:47:03.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.763+0000 7f9f5effd640 1 -- 172.21.15.77:0/259220111 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5002c890 con 0x7f9f48003970 2023-11-04T01:47:03.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.763+0000 7f9f66724640 1 -- 172.21.15.77:0/259220111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f48003970 msgr2=0x7f9f48003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:03.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.763+0000 7f9f66724640 1 --2- 172.21.15.77:0/259220111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f48003970 0x7f9f48003d90 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f9f5000c210 tx=0x7f9f480057f0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.763+0000 7f9f66724640 1 -- 172.21.15.77:0/259220111 shutdown_connections 2023-11-04T01:47:03.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.763+0000 7f9f66724640 1 --2- 172.21.15.77:0/259220111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f48003970 0x7f9f48003d90 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.763+0000 7f9f66724640 1 -- 172.21.15.77:0/259220111 >> 172.21.15.77:0/259220111 conn(0x7f9f600cb530 msgr2=0x7f9f600cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:03.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.763+0000 7f9f66724640 1 -- 172.21.15.77:0/259220111 shutdown_connections 2023-11-04T01:47:03.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.763+0000 7f9f66724640 1 -- 172.21.15.77:0/259220111 wait complete. 2023-11-04T01:47:03.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.764+0000 7f9f66724640 1 Processor -- start 2023-11-04T01:47:03.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.764+0000 7f9f66724640 1 -- start start 2023-11-04T01:47:03.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.765+0000 7f9f66724640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f48003970 0x7f9f600c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.765+0000 7f9f66724640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f600c7110 0x7f9f60149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.765+0000 7f9f66724640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f601f5f60 0x7f9f60149850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.765+0000 7f9f66724640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f600c8a40 con 0x7f9f600c7110 2023-11-04T01:47:03.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.765+0000 7f9f66724640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f601f6520 con 0x7f9f48003970 2023-11-04T01:47:03.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.765+0000 7f9f66724640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f601f6800 con 0x7f9f601f5f60 2023-11-04T01:47:03.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.765+0000 7f9f5f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f600c7110 0x7f9f60149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.765+0000 7f9f5f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f600c7110 0x7f9f60149310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33876/0 (socket says 172.21.15.77:33876) 2023-11-04T01:47:03.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.765+0000 7f9f5f7fe640 1 -- 172.21.15.77:0/2057193450 learned_addr learned my addr 172.21.15.77:0/2057193450 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:03.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.765+0000 7f9f5f7fe640 1 -- 172.21.15.77:0/2057193450 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f601f5f60 msgr2=0x7f9f60149850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:03.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.765+0000 7f9f5f7fe640 1 --2- 172.21.15.77:0/2057193450 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f601f5f60 0x7f9f60149850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.765+0000 7f9f5f7fe640 1 -- 172.21.15.77:0/2057193450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f48003970 msgr2=0x7f9f600c6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:03.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.765+0000 7f9f5f7fe640 1 --2- 172.21.15.77:0/2057193450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f48003970 0x7f9f600c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.765+0000 7f9f5f7fe640 1 -- 172.21.15.77:0/2057193450 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f601f6ae0 con 0x7f9f600c7110 2023-11-04T01:47:03.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.766+0000 7f9f5f7fe640 1 --2- 172.21.15.77:0/2057193450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f600c7110 0x7f9f60149310 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f9f540118e0 tx=0x7f9f54011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:03.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.766+0000 7f9f5cff9640 1 -- 172.21.15.77:0/2057193450 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f54004300 con 0x7f9f600c7110 2023-11-04T01:47:03.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.766+0000 7f9f5cff9640 1 -- 172.21.15.77:0/2057193450 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f54004460 con 0x7f9f600c7110 2023-11-04T01:47:03.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.766+0000 7f9f5cff9640 1 -- 172.21.15.77:0/2057193450 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5400fa20 con 0x7f9f600c7110 2023-11-04T01:47:03.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.766+0000 7f9f66724640 1 -- 172.21.15.77:0/2057193450 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f601f6dc0 con 0x7f9f600c7110 2023-11-04T01:47:03.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.766+0000 7f9f66724640 1 -- 172.21.15.77:0/2057193450 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f600ac8d0 con 0x7f9f600c7110 2023-11-04T01:47:03.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.767+0000 7f9f5cff9640 1 -- 172.21.15.77:0/2057193450 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9f5400fb80 con 0x7f9f600c7110 2023-11-04T01:47:03.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.767+0000 7f9f5cff9640 1 --2- 172.21.15.77:0/2057193450 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9f4c06ae70 0x7f9f4c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.768+0000 7f9f5cff9640 1 -- 172.21.15.77:0/2057193450 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f9f5408a460 con 0x7f9f600c7110 2023-11-04T01:47:03.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.768+0000 7f9f5ffff640 1 --2- 172.21.15.77:0/2057193450 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9f4c06ae70 0x7f9f4c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.768+0000 7f9f5ffff640 1 --2- 172.21.15.77:0/2057193450 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9f4c06ae70 0x7f9f4c06d330 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f9f50034000 tx=0x7f9f50039040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:03.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.769+0000 7f9f6938b740 1 Processor -- start 2023-11-04T01:47:03.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.769+0000 7f9f6938b740 1 -- start start 2023-11-04T01:47:03.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.769+0000 7f9f6938b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55864dfde4c0 0x55864dfde8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.769+0000 7f9f6938b740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55864dfae6d0 0x55864dfdb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.769+0000 7f9f6938b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55864dfb2040 0x55864dfdbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.769+0000 7f9f6938b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55864df21d70 con 0x55864dfb2040 2023-11-04T01:47:03.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.769+0000 7f9f6938b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55864df1f460 con 0x55864dfde4c0 2023-11-04T01:47:03.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.769+0000 7f9f6938b740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x55864df1ad50 con 0x55864dfae6d0 2023-11-04T01:47:03.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.769+0000 7f9f64cc1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55864dfb2040 0x55864dfdbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.769+0000 7f9f64cc1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55864dfb2040 0x55864dfdbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33880/0 (socket says 172.21.15.77:33880) 2023-11-04T01:47:03.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.769+0000 7f9f64cc1640 1 -- 172.21.15.77:0/2910170448 learned_addr learned my addr 172.21.15.77:0/2910170448 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:03.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.770+0000 7f9f5ffff640 1 --2- 172.21.15.77:0/2910170448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55864dfde4c0 0x55864dfde8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.770+0000 7f9f5f7fe640 1 --2- 172.21.15.77:0/2910170448 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55864dfae6d0 0x55864dfdb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.770+0000 7f9f64cc1640 1 -- 172.21.15.77:0/2910170448 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55864dfae6d0 msgr2=0x55864dfdb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:03.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.770+0000 7f9f64cc1640 1 --2- 172.21.15.77:0/2910170448 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55864dfae6d0 0x55864dfdb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.770+0000 7f9f64cc1640 1 -- 172.21.15.77:0/2910170448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55864dfde4c0 msgr2=0x55864dfde8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:03.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.770+0000 7f9f64cc1640 1 --2- 172.21.15.77:0/2910170448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55864dfde4c0 0x55864dfde8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.770+0000 7f9f64cc1640 1 -- 172.21.15.77:0/2910170448 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55864dedde30 con 0x55864dfb2040 2023-11-04T01:47:03.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.770+0000 7f9f5ffff640 1 --2- 172.21.15.77:0/2910170448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55864dfde4c0 0x55864dfde8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:03.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.770+0000 7f9f64cc1640 1 --2- 172.21.15.77:0/2910170448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55864dfb2040 0x55864dfdbc70 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f9f60071da0 tx=0x7f9f58001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62333a3d199db99b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:03.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.770+0000 7f9f45ffb640 1 -- 172.21.15.77:0/2910170448 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f580020d0 con 0x55864dfb2040 2023-11-04T01:47:03.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.770+0000 7f9f45ffb640 1 -- 172.21.15.77:0/2910170448 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f58006d60 con 0x55864dfb2040 2023-11-04T01:47:03.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.770+0000 7f9f45ffb640 1 -- 172.21.15.77:0/2910170448 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f58003b70 con 0x55864dfb2040 2023-11-04T01:47:03.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.770+0000 7f9f6938b740 1 -- 172.21.15.77:0/2910170448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55864dfb2040 msgr2=0x55864dfdbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:03.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.770+0000 7f9f6938b740 1 --2- 172.21.15.77:0/2910170448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55864dfb2040 0x55864dfdbc70 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f9f60071da0 tx=0x7f9f58001e80 comp rx=0 tx=0).stop 2023-11-04T01:47:03.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.771+0000 7f9f6938b740 1 -- 172.21.15.77:0/2910170448 shutdown_connections 2023-11-04T01:47:03.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.771+0000 7f9f6938b740 1 --2- 172.21.15.77:0/2910170448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55864dfb2040 0x55864dfdbc70 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.771+0000 7f9f6938b740 1 --2- 172.21.15.77:0/2910170448 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55864dfae6d0 0x55864dfdb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.771+0000 7f9f6938b740 1 --2- 172.21.15.77:0/2910170448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55864dfde4c0 0x55864dfde8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.771+0000 7f9f6938b740 1 -- 172.21.15.77:0/2910170448 >> 172.21.15.77:0/2910170448 conn(0x55864dfb09e0 msgr2=0x55864dff92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:03.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.771+0000 7f9f6938b740 1 -- 172.21.15.77:0/2910170448 shutdown_connections 2023-11-04T01:47:03.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.771+0000 7f9f6938b740 1 -- 172.21.15.77:0/2910170448 wait complete. 2023-11-04T01:47:03.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.771+0000 7f9f6938b740 1 -- start start 2023-11-04T01:47:03.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.771+0000 7f9f6938b740 1 Processor -- start 2023-11-04T01:47:03.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.772+0000 7f9f6938b740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55864dfb2040 0x55864dfcbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.772+0000 7f9f6938b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55864dfde4c0 0x55864dfe15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.772+0000 7f9f6938b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55864dfd72c0 0x55864dfd7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.772+0000 7f9f6938b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55864ded4ee0 con 0x55864dfd72c0 2023-11-04T01:47:03.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.772+0000 7f9f6938b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55864ded4b80 con 0x55864dfde4c0 2023-11-04T01:47:03.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.772+0000 7f9f6938b740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x55864de9a3a0 con 0x55864dfb2040 2023-11-04T01:47:03.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.772+0000 7f9f6938b740 10 client.0 _ll_register_callbacks cb 0x55864de9e8b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:47:03.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.772+0000 7f9f64cc1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55864dfd72c0 0x55864dfd7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.772+0000 7f9f64cc1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55864dfd72c0 0x55864dfd7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33888/0 (socket says 172.21.15.77:33888) 2023-11-04T01:47:03.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.772+0000 7f9f64cc1640 1 -- 172.21.15.77:0/3633210861 learned_addr learned my addr 172.21.15.77:0/3633210861 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:03.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.772+0000 7f9f5f7fe640 1 --2- 172.21.15.77:0/3633210861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55864dfde4c0 0x55864dfe15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.772+0000 7f9f5ffff640 1 --2- 172.21.15.77:0/3633210861 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55864dfb2040 0x55864dfcbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.772+0000 7f9f64cc1640 1 -- 172.21.15.77:0/3633210861 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55864dfb2040 msgr2=0x55864dfcbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:03.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.772+0000 7f9f64cc1640 1 --2- 172.21.15.77:0/3633210861 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55864dfb2040 0x55864dfcbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.772+0000 7f9f64cc1640 1 -- 172.21.15.77:0/3633210861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55864dfde4c0 msgr2=0x55864dfe15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:03.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.772+0000 7f9f64cc1640 1 --2- 172.21.15.77:0/3633210861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55864dfde4c0 0x55864dfe15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.772+0000 7f9f64cc1640 1 -- 172.21.15.77:0/3633210861 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f5800f040 con 0x55864dfd72c0 2023-11-04T01:47:03.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.772+0000 7f9f5f7fe640 1 --2- 172.21.15.77:0/3633210861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55864dfde4c0 0x55864dfe15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:03.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.773+0000 7f9f64cc1640 1 --2- 172.21.15.77:0/3633210861 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55864dfd72c0 0x55864dfd7720 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f9f58000f80 tx=0x7f9f58007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee57a8edc0cc23c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:03.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.773+0000 7f9f3effd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:47:03.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.773+0000 7f9f3effd640 1 -- 172.21.15.77:0/3633210861 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f58005270 con 0x55864dfd72c0 2023-11-04T01:47:03.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.773+0000 7f9f3effd640 1 -- 172.21.15.77:0/3633210861 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f9f580053d0 con 0x55864dfd72c0 2023-11-04T01:47:03.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.773+0000 7f9f6938b740 1 -- 172.21.15.77:0/3633210861 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55864df13d30 con 0x55864dfd72c0 2023-11-04T01:47:03.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.773+0000 7f9f3effd640 1 -- 172.21.15.77:0/3633210861 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f58005590 con 0x55864dfd72c0 2023-11-04T01:47:03.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.773+0000 7f9f6938b740 10 client.8511 fetch_fsmap learned FSMap version 104 2023-11-04T01:47:03.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.773+0000 7f9f6938b740 1 -- 172.21.15.77:0/3633210861 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) v3 -- 0x55864df193d0 con 0x55864dfd72c0 2023-11-04T01:47:03.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.773+0000 7f9f3effd640 1 -- 172.21.15.77:0/3633210861 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55864df13d30 con 0x55864dfd72c0 2023-11-04T01:47:03.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.773+0000 7f9f3effd640 1 -- 172.21.15.77:0/3633210861 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 104) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f9f5801e040 con 0x55864dfd72c0 2023-11-04T01:47:03.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.773+0000 7f9f6938b740 10 client.8511 fetch_fsmap finished waiting for FSMap version 104 2023-11-04T01:47:03.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.773+0000 7f9f6938b740 10 client.8511 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2023-11-04T01:47:03.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.773+0000 7f9f6938b740 20 client.8511 populate_metadata read hostname 'smithi077' 2023-11-04T01:47:03.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.773+0000 7f9f6938b740 1 --2- 172.21.15.77:0/3633210861 >> [v2:172.21.15.77:6833/2107153526,v1:172.21.15.77:6835/2107153526] conn(0x55864dfe0690 0x55864dfe0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.773+0000 7f9f6938b740 4 client.8511 mds_command: new command op to 8139 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:47:03.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.773+0000 7f9f6938b740 1 -- 172.21.15.77:0/3633210861 --> [v2:172.21.15.77:6833/2107153526,v1:172.21.15.77:6835/2107153526] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55864df13a50 con 0x55864dfe0690 2023-11-04T01:47:03.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.773+0000 7f9f5ffff640 1 --2- 172.21.15.77:0/3633210861 >> [v2:172.21.15.77:6833/2107153526,v1:172.21.15.77:6835/2107153526] conn(0x55864dfe0690 0x55864dfe0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.774+0000 7f9f5ffff640 1 --2- 172.21.15.77:0/3633210861 >> [v2:172.21.15.77:6833/2107153526,v1:172.21.15.77:6835/2107153526] conn(0x55864dfe0690 0x55864dfe0a70 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=768415cbd95772c8 server_cookie=caa5f8ef025fa271 in_seq=0 out_seq=0 2023-11-04T01:47:03.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.774+0000 7f9f3effd640 10 client.8511 ms_handle_connect on v2:172.21.15.77:6833/2107153526 2023-11-04T01:47:03.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.774+0000 7f9f3effd640 1 -- 172.21.15.77:0/3633210861 <== mds.0 v2:172.21.15.77:6833/2107153526 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55864df13a50 con 0x55864dfe0690 2023-11-04T01:47:03.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.774+0000 7f9f3effd640 10 client.8511 handle_command_reply: tid=0 2023-11-04T01:47:03.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.774+0000 7f9f6938b740 1 client.8511 shutdown 2023-11-04T01:47:03.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.774+0000 7f9f6938b740 1 -- 172.21.15.77:0/3633210861 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55864dfd72c0 msgr2=0x55864dfd7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:03.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.774+0000 7f9f6938b740 1 --2- 172.21.15.77:0/3633210861 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55864dfd72c0 0x55864dfd7720 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f9f58000f80 tx=0x7f9f58007f50 comp rx=0 tx=0).stop 2023-11-04T01:47:03.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.774+0000 7f9f6938b740 1 -- 172.21.15.77:0/3633210861 shutdown_connections 2023-11-04T01:47:03.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.774+0000 7f9f6938b740 1 --2- 172.21.15.77:0/3633210861 >> [v2:172.21.15.77:6833/2107153526,v1:172.21.15.77:6835/2107153526] conn(0x55864dfe0690 0x55864dfe0a70 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.774+0000 7f9f6938b740 1 --2- 172.21.15.77:0/3633210861 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55864dfd72c0 0x55864dfd7720 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.774+0000 7f9f6938b740 1 --2- 172.21.15.77:0/3633210861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55864dfde4c0 0x55864dfe15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.774+0000 7f9f3effd640 0 client.8511 ms_handle_reset on v2:172.21.15.77:6833/2107153526 2023-11-04T01:47:03.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.774+0000 7f9f6938b740 1 --2- 172.21.15.77:0/3633210861 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55864dfb2040 0x55864dfcbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.774+0000 7f9f6938b740 1 -- 172.21.15.77:0/3633210861 >> 172.21.15.77:0/3633210861 conn(0x55864dfae6d0 msgr2=0x55864dffc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:03.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.774+0000 7f9f6938b740 1 -- 172.21.15.77:0/3633210861 shutdown_connections 2023-11-04T01:47:03.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.774+0000 7f9f6938b740 1 -- 172.21.15.77:0/3633210861 wait complete. 2023-11-04T01:47:03.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.775+0000 7f9f6938b740 20 client.8511 trim_cache size 0 max 16384 2023-11-04T01:47:03.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.787+0000 7f9f6938b740 1 Processor -- start 2023-11-04T01:47:03.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.788+0000 7f9f6938b740 1 -- start start 2023-11-04T01:47:03.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.788+0000 7f9f6938b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55864dfb2040 0x55864dffc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.788+0000 7f9f6938b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55864dfd72c0 0x55864dffcd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.788+0000 7f9f6938b740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55864dfde4c0 0x55864dfb3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.788+0000 7f9f6938b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55864dfc9110 con 0x55864dfb2040 2023-11-04T01:47:03.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.788+0000 7f9f6938b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55864ded00a0 con 0x55864dfd72c0 2023-11-04T01:47:03.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.788+0000 7f9f6938b740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x55864dfb5020 con 0x55864dfde4c0 2023-11-04T01:47:03.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.788+0000 7f9f5ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55864dfb2040 0x55864dffc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.788+0000 7f9f5ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55864dfb2040 0x55864dffc7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33892/0 (socket says 172.21.15.77:33892) 2023-11-04T01:47:03.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.788+0000 7f9f5ffff640 1 -- 172.21.15.77:0/3094338932 learned_addr learned my addr 172.21.15.77:0/3094338932 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:03.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.789+0000 7f9f5ffff640 1 -- 172.21.15.77:0/3094338932 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55864dfde4c0 msgr2=0x55864dfb3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:03.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.789+0000 7f9f5ffff640 1 --2- 172.21.15.77:0/3094338932 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55864dfde4c0 0x55864dfb3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.789+0000 7f9f5ffff640 1 -- 172.21.15.77:0/3094338932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55864dfd72c0 msgr2=0x55864dffcd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:03.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.789+0000 7f9f5f7fe640 1 --2- 172.21.15.77:0/3094338932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55864dfd72c0 0x55864dffcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.789+0000 7f9f5ffff640 1 --2- 172.21.15.77:0/3094338932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55864dfd72c0 0x55864dffcd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.789+0000 7f9f5ffff640 1 -- 172.21.15.77:0/3094338932 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55864deb6ea0 con 0x55864dfb2040 2023-11-04T01:47:03.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.789+0000 7f9f5ffff640 1 --2- 172.21.15.77:0/3094338932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55864dfb2040 0x55864dffc7e0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f9f5000c330 tx=0x7f9f50007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=848d1fd808190ff2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:03.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.789+0000 7f9f467fc640 1 -- 172.21.15.77:0/3094338932 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5003c040 con 0x55864dfb2040 2023-11-04T01:47:03.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.789+0000 7f9f467fc640 1 -- 172.21.15.77:0/3094338932 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f50049040 con 0x55864dfb2040 2023-11-04T01:47:03.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.789+0000 7f9f467fc640 1 -- 172.21.15.77:0/3094338932 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f50005e40 con 0x55864dfb2040 2023-11-04T01:47:03.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.789+0000 7f9f6938b740 1 -- 172.21.15.77:0/3094338932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55864dfb2040 msgr2=0x55864dffc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:03.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.789+0000 7f9f6938b740 1 --2- 172.21.15.77:0/3094338932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55864dfb2040 0x55864dffc7e0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f9f5000c330 tx=0x7f9f50007000 comp rx=0 tx=0).stop 2023-11-04T01:47:03.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.789+0000 7f9f6938b740 1 -- 172.21.15.77:0/3094338932 shutdown_connections 2023-11-04T01:47:03.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.789+0000 7f9f6938b740 1 --2- 172.21.15.77:0/3094338932 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55864dfde4c0 0x55864dfb3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.789+0000 7f9f6938b740 1 --2- 172.21.15.77:0/3094338932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55864dfd72c0 0x55864dffcd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.789+0000 7f9f6938b740 1 --2- 172.21.15.77:0/3094338932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55864dfb2040 0x55864dffc7e0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.789+0000 7f9f6938b740 1 -- 172.21.15.77:0/3094338932 >> 172.21.15.77:0/3094338932 conn(0x55864dfae6d0 msgr2=0x55864e01aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:03.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.789+0000 7f9f6938b740 1 -- 172.21.15.77:0/3094338932 shutdown_connections 2023-11-04T01:47:03.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.789+0000 7f9f6938b740 1 -- 172.21.15.77:0/3094338932 wait complete. 2023-11-04T01:47:03.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.790+0000 7f9f6938b740 1 -- start start 2023-11-04T01:47:03.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.790+0000 7f9f6938b740 1 Processor -- start 2023-11-04T01:47:03.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.791+0000 7f9f6938b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55864dfb2040 0x55864e0085a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.791+0000 7f9f6938b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55864dfd72c0 0x55864dfd8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.791+0000 7f9f6938b740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55864dfde4c0 0x55864e00c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.791+0000 7f9f6938b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55864dfc7f20 con 0x55864dfb2040 2023-11-04T01:47:03.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.791+0000 7f9f6938b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55864e00cfa0 con 0x55864dfd72c0 2023-11-04T01:47:03.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.791+0000 7f9f6938b740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x55864dfc7cd0 con 0x55864dfde4c0 2023-11-04T01:47:03.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.791+0000 7f9f6938b740 10 client.0 _ll_register_callbacks cb 0x7f9f58017070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:47:03.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.791+0000 7f9f5ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55864dfb2040 0x55864e0085a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.791+0000 7f9f5ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55864dfb2040 0x55864e0085a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33894/0 (socket says 172.21.15.77:33894) 2023-11-04T01:47:03.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.791+0000 7f9f5ffff640 1 -- 172.21.15.77:0/918433766 learned_addr learned my addr 172.21.15.77:0/918433766 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:03.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.791+0000 7f9f64cc1640 1 --2- 172.21.15.77:0/918433766 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55864dfde4c0 0x55864e00c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.791+0000 7f9f5f7fe640 1 --2- 172.21.15.77:0/918433766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55864dfd72c0 0x55864dfd8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.791+0000 7f9f5ffff640 1 -- 172.21.15.77:0/918433766 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55864dfde4c0 msgr2=0x55864e00c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:03.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.791+0000 7f9f5ffff640 1 --2- 172.21.15.77:0/918433766 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55864dfde4c0 0x55864e00c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.791+0000 7f9f5ffff640 1 -- 172.21.15.77:0/918433766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55864dfd72c0 msgr2=0x55864dfd8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:03.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.791+0000 7f9f5ffff640 1 --2- 172.21.15.77:0/918433766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55864dfd72c0 0x55864dfd8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.791+0000 7f9f5ffff640 1 -- 172.21.15.77:0/918433766 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f48003520 con 0x55864dfb2040 2023-11-04T01:47:03.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.791+0000 7f9f5f7fe640 1 --2- 172.21.15.77:0/918433766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55864dfd72c0 0x55864dfd8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:03.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.791+0000 7f9f5ffff640 1 --2- 172.21.15.77:0/918433766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55864dfb2040 0x55864e0085a0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f9f50001540 tx=0x7f9f5002e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=998cc69c6c55e7c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:03.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.791+0000 7f9f3effd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:47:03.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.792+0000 7f9f3effd640 1 -- 172.21.15.77:0/918433766 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5003c040 con 0x55864dfb2040 2023-11-04T01:47:03.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.792+0000 7f9f3effd640 1 -- 172.21.15.77:0/918433766 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f9f5004e650 con 0x55864dfb2040 2023-11-04T01:47:03.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.792+0000 7f9f6938b740 1 -- 172.21.15.77:0/918433766 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9f58006d60 con 0x55864dfb2040 2023-11-04T01:47:03.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.792+0000 7f9f3effd640 1 -- 172.21.15.77:0/918433766 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f5004e810 con 0x55864dfb2040 2023-11-04T01:47:03.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.792+0000 7f9f6938b740 10 client.8517 fetch_fsmap learned FSMap version 104 2023-11-04T01:47:03.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.792+0000 7f9f6938b740 1 -- 172.21.15.77:0/918433766 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) v3 -- 0x55864dedc690 con 0x55864dfb2040 2023-11-04T01:47:03.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.792+0000 7f9f3effd640 1 -- 172.21.15.77:0/918433766 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f58006d60 con 0x55864dfb2040 2023-11-04T01:47:03.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.792+0000 7f9f3effd640 1 -- 172.21.15.77:0/918433766 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 104) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f9f500070c0 con 0x55864dfb2040 2023-11-04T01:47:03.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.792+0000 7f9f6938b740 10 client.8517 fetch_fsmap finished waiting for FSMap version 104 2023-11-04T01:47:03.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.792+0000 7f9f6938b740 10 client.8517 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2023-11-04T01:47:03.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.792+0000 7f9f6938b740 20 client.8517 populate_metadata read hostname 'smithi077' 2023-11-04T01:47:03.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.792+0000 7f9f6938b740 1 --2- 172.21.15.77:0/918433766 >> [v2:172.21.15.77:6833/2107153526,v1:172.21.15.77:6835/2107153526] conn(0x55864e012240 0x55864e00c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.792+0000 7f9f6938b740 4 client.8517 mds_command: new command op to 8139 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-11-04T01:47:03.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.792+0000 7f9f6938b740 1 -- 172.21.15.77:0/918433766 --> [v2:172.21.15.77:6833/2107153526,v1:172.21.15.77:6835/2107153526] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55864dc1b7e0 con 0x55864e012240 2023-11-04T01:47:03.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.792+0000 7f9f5f7fe640 1 --2- 172.21.15.77:0/918433766 >> [v2:172.21.15.77:6833/2107153526,v1:172.21.15.77:6835/2107153526] conn(0x55864e012240 0x55864e00c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.792+0000 7f9f3effd640 10 client.8517 ms_handle_connect on v2:172.21.15.77:6833/2107153526 2023-11-04T01:47:03.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.792+0000 7f9f5f7fe640 1 --2- 172.21.15.77:0/918433766 >> [v2:172.21.15.77:6833/2107153526,v1:172.21.15.77:6835/2107153526] conn(0x55864e012240 0x55864e00c8f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42c4dfdd8b78599d server_cookie=597f3c79fabb4baa in_seq=0 out_seq=0 2023-11-04T01:47:03.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.802+0000 7f9f3effd640 1 -- 172.21.15.77:0/918433766 <== mds.0 v2:172.21.15.77:6833/2107153526 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55864dc1b7e0 con 0x55864e012240 2023-11-04T01:47:03.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.802+0000 7f9f3effd640 10 client.8517 handle_command_reply: tid=0 2023-11-04T01:47:03.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.802+0000 7f9f6938b740 1 client.8517 shutdown 2023-11-04T01:47:03.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.802+0000 7f9f6938b740 1 -- 172.21.15.77:0/918433766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55864dfb2040 msgr2=0x55864e0085a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:03.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.802+0000 7f9f6938b740 1 --2- 172.21.15.77:0/918433766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55864dfb2040 0x55864e0085a0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f9f50001540 tx=0x7f9f5002e070 comp rx=0 tx=0).stop 2023-11-04T01:47:03.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.802+0000 7f9f6938b740 1 -- 172.21.15.77:0/918433766 shutdown_connections 2023-11-04T01:47:03.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.802+0000 7f9f6938b740 1 --2- 172.21.15.77:0/918433766 >> [v2:172.21.15.77:6833/2107153526,v1:172.21.15.77:6835/2107153526] conn(0x55864e012240 0x55864e00c8f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.802+0000 7f9f6938b740 1 --2- 172.21.15.77:0/918433766 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x55864dfde4c0 0x55864e00c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.802+0000 7f9f3effd640 0 client.8517 ms_handle_reset on v2:172.21.15.77:6833/2107153526 2023-11-04T01:47:03.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.802+0000 7f9f6938b740 1 --2- 172.21.15.77:0/918433766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55864dfd72c0 0x55864dfd8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.802+0000 7f9f6938b740 1 --2- 172.21.15.77:0/918433766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55864dfb2040 0x55864e0085a0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.802+0000 7f9f6938b740 1 -- 172.21.15.77:0/918433766 >> 172.21.15.77:0/918433766 conn(0x55864dfae6d0 msgr2=0x55864dfe1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:03.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.802+0000 7f9f6938b740 1 -- 172.21.15.77:0/918433766 shutdown_connections 2023-11-04T01:47:03.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.802+0000 7f9f6938b740 1 -- 172.21.15.77:0/918433766 wait complete. 2023-11-04T01:47:03.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.802+0000 7f9f6938b740 20 client.8517 trim_cache size 0 max 16384 2023-11-04T01:47:03.827 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-04T01:47:03.827 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "", 2023-11-04T01:47:03.827 INFO:teuthology.orchestra.run.smithi077.stdout: "return_code": 0 2023-11-04T01:47:03.828 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-04T01:47:03.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.803+0000 7f9f66724640 1 -- 172.21.15.77:0/2057193450 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9f4c06ae70 msgr2=0x7f9f4c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:03.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.803+0000 7f9f66724640 1 --2- 172.21.15.77:0/2057193450 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9f4c06ae70 0x7f9f4c06d330 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f9f50034000 tx=0x7f9f50039040 comp rx=0 tx=0).stop 2023-11-04T01:47:03.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.803+0000 7f9f66724640 1 -- 172.21.15.77:0/2057193450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f600c7110 msgr2=0x7f9f60149310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:03.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.803+0000 7f9f66724640 1 --2- 172.21.15.77:0/2057193450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f600c7110 0x7f9f60149310 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f9f540118e0 tx=0x7f9f54011da0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.803+0000 7f9f66724640 1 -- 172.21.15.77:0/2057193450 shutdown_connections 2023-11-04T01:47:03.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.803+0000 7f9f66724640 1 --2- 172.21.15.77:0/2057193450 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9f4c06ae70 0x7f9f4c06d330 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.803+0000 7f9f66724640 1 --2- 172.21.15.77:0/2057193450 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f601f5f60 0x7f9f60149850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.803+0000 7f9f66724640 1 --2- 172.21.15.77:0/2057193450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f600c7110 0x7f9f60149310 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.803+0000 7f9f66724640 1 --2- 172.21.15.77:0/2057193450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f48003970 0x7f9f600c6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.803+0000 7f9f66724640 1 -- 172.21.15.77:0/2057193450 >> 172.21.15.77:0/2057193450 conn(0x7f9f600cb530 msgr2=0x7f9f600afb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:03.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.803+0000 7f9f66724640 1 -- 172.21.15.77:0/2057193450 shutdown_connections 2023-11-04T01:47:03.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.803+0000 7f9f66724640 1 -- 172.21.15.77:0/2057193450 wait complete. 2023-11-04T01:47:03.832 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=6, also kill snapclient 2023-11-04T01:47:03.832 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:03.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.930+0000 7f32bc500640 1 Processor -- start 2023-11-04T01:47:03.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.930+0000 7f32bc500640 1 -- start start 2023-11-04T01:47:03.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.931+0000 7f32bc500640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f32b40d1be0 0x7f32b4167e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.931+0000 7f32bc500640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32b40b32b0 con 0x7f32b415d4e0 2023-11-04T01:47:03.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.931+0000 7f32bc500640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32b40cee10 con 0x7f32b415d100 2023-11-04T01:47:03.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.931+0000 7f32bc500640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b40cec20 con 0x7f32b40d1be0 2023-11-04T01:47:03.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.931+0000 7f32b9a9b640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f32b415d4e0 0x7f32b40d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45838/0 (socket says 172.21.15.77:45838) 2023-11-04T01:47:03.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.931+0000 7f32b9a9b640 1 -- 172.21.15.77:0/3583595474 learned_addr learned my addr 172.21.15.77:0/3583595474 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:47:03.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.932+0000 7f32baa9d640 1 --2- 172.21.15.77:0/3583595474 >> v2:172.21.15.122:3300/0 conn(0x7f32b40d1be0 0x7f32b4167e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.932+0000 7f32b929a640 1 -- 172.21.15.77:0/3583595474 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3025911145 0 0) 0x7f32b40b32b0 con 0x7f32b415d4e0 2023-11-04T01:47:03.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.932+0000 7f32b929a640 1 -- 172.21.15.77:0/3583595474 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32a0003520 con 0x7f32b415d4e0 2023-11-04T01:47:03.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.932+0000 7f32b929a640 1 -- 172.21.15.77:0/3583595474 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3604179363 0 0) 0x7f32a0003520 con 0x7f32b415d4e0 2023-11-04T01:47:03.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.932+0000 7f32b929a640 1 -- 172.21.15.77:0/3583595474 >> v2:172.21.15.122:3300/0 conn(0x7f32b40d1be0 msgr2=0x7f32b4167e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:03.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.932+0000 7f32b929a640 1 --2- 172.21.15.77:0/3583595474 >> v2:172.21.15.122:3300/0 conn(0x7f32b40d1be0 0x7f32b4167e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.932+0000 7f32b929a640 1 -- 172.21.15.77:0/3583595474 >> v1:172.21.15.122:6789/0 conn(0x7f32b415d100 legacy=0x7f32b40ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:03.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.932+0000 7f32b929a640 1 -- 172.21.15.77:0/3583595474 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b40b4750 con 0x7f32b415d4e0 2023-11-04T01:47:03.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.932+0000 7f32b929a640 1 -- 172.21.15.77:0/3583595474 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f32a4001670 con 0x7f32b415d4e0 2023-11-04T01:47:03.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.932+0000 7f32b929a640 1 -- 172.21.15.77:0/3583595474 >> v1:172.21.15.77:6789/0 conn(0x7f32b415d4e0 legacy=0x7f32b40d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:03.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.932+0000 7f32b929a640 1 --2- 172.21.15.77:0/3583595474 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32a0003970 0x7f32a0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.932+0000 7f32b929a640 1 --2- 172.21.15.77:0/3583595474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32a00047c0 0x7f32a0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.932+0000 7f32b929a640 1 --2- 172.21.15.77:0/3583595474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32a0005180 0x7f32a000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.932+0000 7f32b929a640 1 -- 172.21.15.77:0/3583595474 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a000bff0 con 0x7f32a0005180 2023-11-04T01:47:03.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.932+0000 7f32b929a640 1 -- 172.21.15.77:0/3583595474 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a000c160 con 0x7f32a00047c0 2023-11-04T01:47:03.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.932+0000 7f32b929a640 1 -- 172.21.15.77:0/3583595474 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a000c320 con 0x7f32a0003970 2023-11-04T01:47:03.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.932+0000 7f32baa9d640 1 --2- 172.21.15.77:0/3583595474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32a0005180 0x7f32a000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.932+0000 7f32b9a9b640 1 --2- 172.21.15.77:0/3583595474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32a00047c0 0x7f32a0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.932+0000 7f32ba29c640 1 --2- 172.21.15.77:0/3583595474 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32a0003970 0x7f32a0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.932+0000 7f32baa9d640 1 -- 172.21.15.77:0/3583595474 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32a0003970 msgr2=0x7f32a0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:03.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.932+0000 7f32baa9d640 1 --2- 172.21.15.77:0/3583595474 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32a0003970 0x7f32a0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.932+0000 7f32baa9d640 1 -- 172.21.15.77:0/3583595474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32a00047c0 msgr2=0x7f32a0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:03.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.932+0000 7f32baa9d640 1 --2- 172.21.15.77:0/3583595474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32a00047c0 0x7f32a0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.932+0000 7f32baa9d640 1 -- 172.21.15.77:0/3583595474 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a0003520 con 0x7f32a0005180 2023-11-04T01:47:03.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.933+0000 7f32baa9d640 1 -- 172.21.15.77:0/3583595474 reap_dead start 2023-11-04T01:47:03.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.933+0000 7f32baa9d640 1 --2- 172.21.15.77:0/3583595474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32a0005180 0x7f32a000b980 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f32ac009ac0 tx=0x7f32a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f6acbbbbb2180d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:03.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.933+0000 7f32b929a640 1 -- 172.21.15.77:0/3583595474 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ac004020 con 0x7f32a0005180 2023-11-04T01:47:03.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.933+0000 7f32b929a640 1 -- 172.21.15.77:0/3583595474 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ac004180 con 0x7f32a0005180 2023-11-04T01:47:03.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.933+0000 7f32b929a640 1 -- 172.21.15.77:0/3583595474 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ac02c710 con 0x7f32a0005180 2023-11-04T01:47:03.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.934+0000 7f32bc500640 1 -- 172.21.15.77:0/3583595474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32a0005180 msgr2=0x7f32a000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:03.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.934+0000 7f32bc500640 1 --2- 172.21.15.77:0/3583595474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32a0005180 0x7f32a000b980 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f32ac009ac0 tx=0x7f32a00057f0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.934+0000 7f32bc500640 1 -- 172.21.15.77:0/3583595474 shutdown_connections 2023-11-04T01:47:03.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.934+0000 7f32bc500640 1 --2- 172.21.15.77:0/3583595474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32a0005180 0x7f32a000b980 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.934+0000 7f32bc500640 1 -- 172.21.15.77:0/3583595474 >> 172.21.15.77:0/3583595474 conn(0x7f32b40d2ef0 msgr2=0x7f32b40d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:03.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.934+0000 7f32bc500640 1 -- 172.21.15.77:0/3583595474 shutdown_connections 2023-11-04T01:47:03.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.934+0000 7f32bc500640 1 -- 172.21.15.77:0/3583595474 wait complete. 2023-11-04T01:47:03.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.935+0000 7f32bc500640 1 Processor -- start 2023-11-04T01:47:03.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.935+0000 7f32bc500640 1 -- start start 2023-11-04T01:47:03.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.936+0000 7f32bc500640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32a0005180 0x7f32b40b7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.936+0000 7f32bc500640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32b4160290 0x7f32b40cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.936+0000 7f32bc500640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32b41f5ee0 0x7f32b41f6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.936+0000 7f32bc500640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b415e0a0 con 0x7f32a0005180 2023-11-04T01:47:03.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.936+0000 7f32bc500640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b41f68a0 con 0x7f32b41f5ee0 2023-11-04T01:47:03.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.936+0000 7f32bc500640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b40b8520 con 0x7f32b4160290 2023-11-04T01:47:03.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.936+0000 7f32ba29c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32a0005180 0x7f32b40b7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.936+0000 7f32ba29c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32a0005180 0x7f32b40b7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33912/0 (socket says 172.21.15.77:33912) 2023-11-04T01:47:03.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.936+0000 7f32ba29c640 1 -- 172.21.15.77:0/3706581549 learned_addr learned my addr 172.21.15.77:0/3706581549 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:03.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.936+0000 7f32ba29c640 1 -- 172.21.15.77:0/3706581549 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32b4160290 msgr2=0x7f32b40cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:03.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.936+0000 7f32ba29c640 1 --2- 172.21.15.77:0/3706581549 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32b4160290 0x7f32b40cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.936+0000 7f32baa9d640 1 --2- 172.21.15.77:0/3706581549 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32b41f5ee0 0x7f32b41f6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.936+0000 7f32ba29c640 1 -- 172.21.15.77:0/3706581549 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32b41f5ee0 msgr2=0x7f32b41f6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:03.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.936+0000 7f32ba29c640 1 --2- 172.21.15.77:0/3706581549 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32b41f5ee0 0x7f32b41f6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:03.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.936+0000 7f32ba29c640 1 -- 172.21.15.77:0/3706581549 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b40b8240 con 0x7f32a0005180 2023-11-04T01:47:03.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.936+0000 7f32ba29c640 1 --2- 172.21.15.77:0/3706581549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32a0005180 0x7f32b40b7b80 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f32b000f890 tx=0x7f32b000fd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:03.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.936+0000 7f32aaffd640 1 -- 172.21.15.77:0/3706581549 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b0006db0 con 0x7f32a0005180 2023-11-04T01:47:03.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.936+0000 7f32aaffd640 1 -- 172.21.15.77:0/3706581549 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b00039c0 con 0x7f32a0005180 2023-11-04T01:47:03.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.936+0000 7f32bc500640 1 -- 172.21.15.77:0/3706581549 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b415d9e0 con 0x7f32a0005180 2023-11-04T01:47:03.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.936+0000 7f32aaffd640 1 -- 172.21.15.77:0/3706581549 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b0003d50 con 0x7f32a0005180 2023-11-04T01:47:03.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.937+0000 7f32bc500640 1 -- 172.21.15.77:0/3706581549 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b4160710 con 0x7f32a0005180 2023-11-04T01:47:03.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.937+0000 7f32bc500640 1 -- 172.21.15.77:0/3706581549 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32b40684b0 con 0x7f32a0005180 2023-11-04T01:47:03.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.938+0000 7f32aaffd640 1 -- 172.21.15.77:0/3706581549 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f32b000d730 con 0x7f32a0005180 2023-11-04T01:47:03.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.938+0000 7f32aaffd640 1 --2- 172.21.15.77:0/3706581549 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f329806aea0 0x7f329806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:03.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.938+0000 7f32aaffd640 1 -- 172.21.15.77:0/3706581549 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f32b0089b70 con 0x7f32a0005180 2023-11-04T01:47:03.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.938+0000 7f32b9a9b640 1 --2- 172.21.15.77:0/3706581549 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f329806aea0 0x7f329806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:03.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.939+0000 7f32b9a9b640 1 --2- 172.21.15.77:0/3706581549 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f329806aea0 0x7f329806d360 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f32b415ff20 tx=0x7f32a4001490 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:03.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:03.942+0000 7f32aaffd640 1 -- 172.21.15.77:0/3706581549 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f32b0054360 con 0x7f32a0005180 2023-11-04T01:47:04.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.142+0000 7f32bc500640 1 -- 172.21.15.77:0/3706581549 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32b415e310 con 0x7f32a0005180 2023-11-04T01:47:04.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.143+0000 7f32aaffd640 1 -- 172.21.15.77:0/3706581549 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4942 (secure 0 0 0) 0x7f32b0057980 con 0x7f32a0005180 2023-11-04T01:47:04.145 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:47:04.145 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":104,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7033,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2238841748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2238841748},{"type":"v1","addr":"172.21.15.122:6836","nonce":2238841748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:46:55.646378+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8139,"mds_1":8343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8139":{"gid":8139,"name":"c","rank":0,"incarnation":97,"state":"up:active","state_seq":16,"addr":"172.21.15.77:6835/2107153526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2107153526},{"type":"v1","addr":"172.21.15.77:6835","nonce":2107153526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8343":{"gid":8343,"name":"a","rank":1,"incarnation":100,"state":"up:active","state_seq":7,"addr":"172.21.15.77:6834/4183807043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4183807043},{"type":"v1","addr":"172.21.15.77:6834","nonce":4183807043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:04.145 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 104 2023-11-04T01:47:04.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.144+0000 7f32bc500640 1 -- 172.21.15.77:0/3706581549 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f329806aea0 msgr2=0x7f329806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:04.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.144+0000 7f32bc500640 1 --2- 172.21.15.77:0/3706581549 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f329806aea0 0x7f329806d360 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f32b415ff20 tx=0x7f32a4001490 comp rx=0 tx=0).stop 2023-11-04T01:47:04.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.144+0000 7f32bc500640 1 -- 172.21.15.77:0/3706581549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32a0005180 msgr2=0x7f32b40b7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:04.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.144+0000 7f32bc500640 1 --2- 172.21.15.77:0/3706581549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32a0005180 0x7f32b40b7b80 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f32b000f890 tx=0x7f32b000fd50 comp rx=0 tx=0).stop 2023-11-04T01:47:04.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.144+0000 7f32bc500640 1 -- 172.21.15.77:0/3706581549 shutdown_connections 2023-11-04T01:47:04.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.144+0000 7f32bc500640 1 --2- 172.21.15.77:0/3706581549 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f329806aea0 0x7f329806d360 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:04.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.144+0000 7f32bc500640 1 --2- 172.21.15.77:0/3706581549 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32b41f5ee0 0x7f32b41f6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:04.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.144+0000 7f32bc500640 1 --2- 172.21.15.77:0/3706581549 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f32b4160290 0x7f32b40cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:04.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.144+0000 7f32bc500640 1 --2- 172.21.15.77:0/3706581549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32a0005180 0x7f32b40b7b80 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:04.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.144+0000 7f32bc500640 1 -- 172.21.15.77:0/3706581549 >> 172.21.15.77:0/3706581549 conn(0x7f32b40d2ef0 msgr2=0x7f32b415c380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:04.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.145+0000 7f32bc500640 1 -- 172.21.15.77:0/3706581549 shutdown_connections 2023-11-04T01:47:04.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.145+0000 7f32bc500640 1 -- 172.21.15.77:0/3706581549 wait complete. 2023-11-04T01:47:04.157 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump snaps --server 2023-11-04T01:47:04.270 INFO:teuthology.orchestra.run.smithi077.stdout:{"last_snap":11,"last_created":11,"last_destroyed":9,"pending_noop":[],"snaps":[{"snapid":11,"ino":1099511627777,"stamp":"2023-11-04T01:46:21.837860+0000","name":"s25","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:47:04.271 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 11, "last_destroyed": 9, "last_snap": 11, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s25", "snapid": 11, "stamp": "2023-11-04T01:46:21.837860+0000" } ] } 2023-11-04T01:47:04.271 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:47:04.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.370+0000 7fcddcf90640 1 Processor -- start 2023-11-04T01:47:04.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.370+0000 7fcddcf90640 1 -- start start 2023-11-04T01:47:04.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.371+0000 7fcddcf90640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fcdd815d100 0x7fcdd80ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:04.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.371+0000 7fcddcf90640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcdd80d1be0 0x7fcdd80b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:04.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.371+0000 7fcddcf90640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd80b32b0 con 0x7fcdd815d4e0 2023-11-04T01:47:04.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.371+0000 7fcddcf90640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdd80cee10 con 0x7fcdd80d1be0 2023-11-04T01:47:04.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.371+0000 7fcddcf90640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdd80b2980 con 0x7fcdd815d100 2023-11-04T01:47:04.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.371+0000 7fcdd6d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcdd80d1be0 0x7fcdd80b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:04.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.371+0000 7fcdd5d9b640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fcdd815d4e0 0x7fcdd80d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45850/0 (socket says 172.21.15.77:45850) 2023-11-04T01:47:04.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.371+0000 7fcdd5d9b640 1 -- 172.21.15.77:0/2179621519 learned_addr learned my addr 172.21.15.77:0/2179621519 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:47:04.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.372+0000 7fcdd659c640 1 --2- 172.21.15.77:0/2179621519 >> v2:172.21.15.122:3300/0 conn(0x7fcdd815d100 0x7fcdd80ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:04.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.372+0000 7fcdd6d9d640 1 -- 172.21.15.77:0/2179621519 >> v2:172.21.15.122:3300/0 conn(0x7fcdd815d100 msgr2=0x7fcdd80ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:04.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.372+0000 7fcdd6d9d640 1 --2- 172.21.15.77:0/2179621519 >> v2:172.21.15.122:3300/0 conn(0x7fcdd815d100 0x7fcdd80ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:04.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.372+0000 7fcdd6d9d640 1 -- 172.21.15.77:0/2179621519 >> v1:172.21.15.77:6789/0 conn(0x7fcdd815d4e0 legacy=0x7fcdd80d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:04.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.372+0000 7fcdd6d9d640 1 -- 172.21.15.77:0/2179621519 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd80b2c60 con 0x7fcdd80d1be0 2023-11-04T01:47:04.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.372+0000 7fcdd659c640 1 --2- 172.21.15.77:0/2179621519 >> v2:172.21.15.122:3300/0 conn(0x7fcdd815d100 0x7fcdd80ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:04.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.372+0000 7fcdd6d9d640 1 --2- 172.21.15.77:0/2179621519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdd80d1be0 0x7fcdd80b3740 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fcdd80d09f0 tx=0x7fcdd002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c80383e99d94092 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:04.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.373+0000 7fcdd559a640 1 -- 172.21.15.77:0/2179621519 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd0031830 con 0x7fcdd80d1be0 2023-11-04T01:47:04.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.373+0000 7fcdd559a640 1 -- 172.21.15.77:0/2179621519 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd0031990 con 0x7fcdd80d1be0 2023-11-04T01:47:04.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.373+0000 7fcdd559a640 1 -- 172.21.15.77:0/2179621519 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd0031d20 con 0x7fcdd80d1be0 2023-11-04T01:47:04.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.373+0000 7fcddcf90640 1 -- 172.21.15.77:0/2179621519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdd80d1be0 msgr2=0x7fcdd80b3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:04.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.373+0000 7fcddcf90640 1 --2- 172.21.15.77:0/2179621519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdd80d1be0 0x7fcdd80b3740 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fcdd80d09f0 tx=0x7fcdd002b8d0 comp rx=0 tx=0).stop 2023-11-04T01:47:04.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.373+0000 7fcddcf90640 1 -- 172.21.15.77:0/2179621519 shutdown_connections 2023-11-04T01:47:04.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.373+0000 7fcddcf90640 1 --2- 172.21.15.77:0/2179621519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdd80d1be0 0x7fcdd80b3740 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:04.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.373+0000 7fcddcf90640 1 --2- 172.21.15.77:0/2179621519 >> v2:172.21.15.122:3300/0 conn(0x7fcdd815d100 0x7fcdd80ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:04.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.373+0000 7fcddcf90640 1 -- 172.21.15.77:0/2179621519 >> 172.21.15.77:0/2179621519 conn(0x7fcdd80d2ef0 msgr2=0x7fcdd80d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:04.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.373+0000 7fcddcf90640 1 -- 172.21.15.77:0/2179621519 shutdown_connections 2023-11-04T01:47:04.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.373+0000 7fcddcf90640 1 -- 172.21.15.77:0/2179621519 wait complete. 2023-11-04T01:47:04.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.375+0000 7fcddcf90640 1 Processor -- start 2023-11-04T01:47:04.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.375+0000 7fcddcf90640 1 -- start start 2023-11-04T01:47:04.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.375+0000 7fcddcf90640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcdd80d1be0 0x7fcdd80b8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:04.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.375+0000 7fcddcf90640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcdd815d100 0x7fcdd80b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:04.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.375+0000 7fcddcf90640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdd815d4e0 0x7fcdd815a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:04.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.375+0000 7fcddcf90640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd815ab60 con 0x7fcdd815d4e0 2023-11-04T01:47:04.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.375+0000 7fcddcf90640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd81f2b80 con 0x7fcdd80d1be0 2023-11-04T01:47:04.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.375+0000 7fcddcf90640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd80b66f0 con 0x7fcdd815d100 2023-11-04T01:47:04.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.375+0000 7fcdd6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdd815d4e0 0x7fcdd815a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:04.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.375+0000 7fcdd6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdd815d4e0 0x7fcdd815a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33928/0 (socket says 172.21.15.77:33928) 2023-11-04T01:47:04.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.375+0000 7fcdd6d9d640 1 -- 172.21.15.77:0/1847709479 learned_addr learned my addr 172.21.15.77:0/1847709479 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:04.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.376+0000 7fcdd659c640 1 --2- 172.21.15.77:0/1847709479 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcdd80d1be0 0x7fcdd80b8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:04.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.376+0000 7fcdd5d9b640 1 --2- 172.21.15.77:0/1847709479 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcdd815d100 0x7fcdd80b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:04.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.376+0000 7fcdd6d9d640 1 -- 172.21.15.77:0/1847709479 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcdd815d100 msgr2=0x7fcdd80b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:04.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.376+0000 7fcdd6d9d640 1 --2- 172.21.15.77:0/1847709479 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcdd815d100 0x7fcdd80b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:04.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.376+0000 7fcdd6d9d640 1 -- 172.21.15.77:0/1847709479 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcdd80d1be0 msgr2=0x7fcdd80b8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:04.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.376+0000 7fcdd6d9d640 1 --2- 172.21.15.77:0/1847709479 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcdd80d1be0 0x7fcdd80b8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:04.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.376+0000 7fcdd6d9d640 1 -- 172.21.15.77:0/1847709479 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd0009400 con 0x7fcdd815d4e0 2023-11-04T01:47:04.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.376+0000 7fcdd5d9b640 1 --2- 172.21.15.77:0/1847709479 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcdd815d100 0x7fcdd80b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:04.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.376+0000 7fcdd6d9d640 1 --2- 172.21.15.77:0/1847709479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdd815d4e0 0x7fcdd815a620 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0034040 tx=0x7fcdd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:04.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.376+0000 7fcdc6ffd640 1 -- 172.21.15.77:0/1847709479 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd003a9e0 con 0x7fcdd815d4e0 2023-11-04T01:47:04.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.376+0000 7fcdc6ffd640 1 -- 172.21.15.77:0/1847709479 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd003ab40 con 0x7fcdd815d4e0 2023-11-04T01:47:04.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.376+0000 7fcddcf90640 1 -- 172.21.15.77:0/1847709479 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdd80b6070 con 0x7fcdd815d4e0 2023-11-04T01:47:04.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.376+0000 7fcdc6ffd640 1 -- 172.21.15.77:0/1847709479 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd00443f0 con 0x7fcdd815d4e0 2023-11-04T01:47:04.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.376+0000 7fcddcf90640 1 -- 172.21.15.77:0/1847709479 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd81f3120 con 0x7fcdd815d4e0 2023-11-04T01:47:04.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.377+0000 7fcddcf90640 1 -- 172.21.15.77:0/1847709479 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdd80684b0 con 0x7fcdd815d4e0 2023-11-04T01:47:04.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.377+0000 7fcdc6ffd640 1 -- 172.21.15.77:0/1847709479 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcdd0044550 con 0x7fcdd815d4e0 2023-11-04T01:47:04.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.378+0000 7fcdc6ffd640 1 --2- 172.21.15.77:0/1847709479 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcdb806ae70 0x7fcdb806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:04.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.378+0000 7fcdc6ffd640 1 -- 172.21.15.77:0/1847709479 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7952+0+0 (secure 0 0 0) 0x7fcdd00ac0e0 con 0x7fcdd815d4e0 2023-11-04T01:47:04.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.378+0000 7fcdd659c640 1 --2- 172.21.15.77:0/1847709479 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcdb806ae70 0x7fcdb806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:04.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.378+0000 7fcdd659c640 1 --2- 172.21.15.77:0/1847709479 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcdb806ae70 0x7fcdb806d330 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8007600 tx=0x7fcdc8007590 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:04.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.382+0000 7fcdc6ffd640 1 -- 172.21.15.77:0/1847709479 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcdd00769f0 con 0x7fcdd815d4e0 2023-11-04T01:47:04.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.613+0000 7fcddcf90640 1 -- 172.21.15.77:0/1847709479 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7fcdd80d2cd0 con 0x7fcdd815d4e0 2023-11-04T01:47:04.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.808+0000 7fcdc6ffd640 1 -- 172.21.15.77:0/1847709479 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.8139 v105) v1 ==== 112+0+0 (secure 0 0 0) 0x7fcdd00350a0 con 0x7fcdd815d4e0 2023-11-04T01:47:04.810 INFO:teuthology.orchestra.run.smithi077.stderr:freezing mds.8139 2023-11-04T01:47:04.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.811+0000 7fcddcf90640 1 -- 172.21.15.77:0/1847709479 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcdb806ae70 msgr2=0x7fcdb806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:04.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.811+0000 7fcddcf90640 1 --2- 172.21.15.77:0/1847709479 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcdb806ae70 0x7fcdb806d330 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8007600 tx=0x7fcdc8007590 comp rx=0 tx=0).stop 2023-11-04T01:47:04.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.811+0000 7fcddcf90640 1 -- 172.21.15.77:0/1847709479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdd815d4e0 msgr2=0x7fcdd815a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:04.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.811+0000 7fcddcf90640 1 --2- 172.21.15.77:0/1847709479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdd815d4e0 0x7fcdd815a620 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0034040 tx=0x7fcdd00046c0 comp rx=0 tx=0).stop 2023-11-04T01:47:04.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.811+0000 7fcddcf90640 1 -- 172.21.15.77:0/1847709479 shutdown_connections 2023-11-04T01:47:04.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.811+0000 7fcddcf90640 1 --2- 172.21.15.77:0/1847709479 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcdb806ae70 0x7fcdb806d330 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:04.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.811+0000 7fcddcf90640 1 --2- 172.21.15.77:0/1847709479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdd815d4e0 0x7fcdd815a620 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:04.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.811+0000 7fcddcf90640 1 --2- 172.21.15.77:0/1847709479 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcdd815d100 0x7fcdd80b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:04.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.811+0000 7fcddcf90640 1 --2- 172.21.15.77:0/1847709479 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcdd80d1be0 0x7fcdd80b8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:04.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.811+0000 7fcddcf90640 1 -- 172.21.15.77:0/1847709479 >> 172.21.15.77:0/1847709479 conn(0x7fcdd80d2ef0 msgr2=0x7fcdd80d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:04.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.811+0000 7fcddcf90640 1 -- 172.21.15.77:0/1847709479 shutdown_connections 2023-11-04T01:47:04.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.811+0000 7fcddcf90640 1 -- 172.21.15.77:0/1847709479 wait complete. 2023-11-04T01:47:04.824 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:1 true 2023-11-04T01:47:04.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.923+0000 7fb4fb04f640 1 Processor -- start 2023-11-04T01:47:04.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.923+0000 7fb4fb04f640 1 -- start start 2023-11-04T01:47:04.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.924+0000 7fb4fb04f640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4f415d4e0 0x7fb4f40d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:04.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.924+0000 7fb4fb04f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f40b32b0 con 0x7fb4f40d3b60 2023-11-04T01:47:04.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.924+0000 7fb4fb04f640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f40cee10 con 0x7fb4f415d100 2023-11-04T01:47:04.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.924+0000 7fb4fb04f640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f40cec20 con 0x7fb4f415d4e0 2023-11-04T01:47:04.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.924+0000 7fb4f95ec640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb4f40d3b60 0x7fb4f40b3740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45862/0 (socket says 172.21.15.77:45862) 2023-11-04T01:47:04.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.924+0000 7fb4f95ec640 1 -- 172.21.15.77:0/3473042944 learned_addr learned my addr 172.21.15.77:0/3473042944 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:47:04.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.925+0000 7fb4f3fff640 1 --2- 172.21.15.77:0/3473042944 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4f415d4e0 0x7fb4f40d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:04.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.925+0000 7fb4f37fe640 1 -- 172.21.15.77:0/3473042944 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1434014244 0 0) 0x7fb4f40b32b0 con 0x7fb4f40d3b60 2023-11-04T01:47:04.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.925+0000 7fb4f37fe640 1 -- 172.21.15.77:0/3473042944 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4dc003520 con 0x7fb4f40d3b60 2023-11-04T01:47:04.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.925+0000 7fb4f37fe640 1 -- 172.21.15.77:0/3473042944 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 38938075 0 0) 0x7fb4dc003520 con 0x7fb4f40d3b60 2023-11-04T01:47:04.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.925+0000 7fb4f37fe640 1 -- 172.21.15.77:0/3473042944 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4f415d4e0 msgr2=0x7fb4f40d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:04.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.925+0000 7fb4f37fe640 1 --2- 172.21.15.77:0/3473042944 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4f415d4e0 0x7fb4f40d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:04.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.925+0000 7fb4f37fe640 1 -- 172.21.15.77:0/3473042944 >> v1:172.21.15.122:6789/0 conn(0x7fb4f415d100 legacy=0x7fb4f40ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:04.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.925+0000 7fb4f37fe640 1 -- 172.21.15.77:0/3473042944 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f40b2980 con 0x7fb4f40d3b60 2023-11-04T01:47:04.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.925+0000 7fb4f37fe640 1 -- 172.21.15.77:0/3473042944 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7fb4ec0019f0 con 0x7fb4f40d3b60 2023-11-04T01:47:04.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.925+0000 7fb4f37fe640 1 -- 172.21.15.77:0/3473042944 >> v1:172.21.15.77:6789/0 conn(0x7fb4f40d3b60 legacy=0x7fb4f40b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:04.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.925+0000 7fb4f37fe640 1 --2- 172.21.15.77:0/3473042944 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4f415d4e0 0x7fb4dc0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:04.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.925+0000 7fb4f37fe640 1 --2- 172.21.15.77:0/3473042944 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4dc003ee0 0x7fb4dc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:04.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.925+0000 7fb4f37fe640 1 --2- 172.21.15.77:0/3473042944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4dc004d00 0x7fb4dc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:04.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.925+0000 7fb4f37fe640 1 -- 172.21.15.77:0/3473042944 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4dc00b9b0 con 0x7fb4dc004d00 2023-11-04T01:47:04.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.925+0000 7fb4f37fe640 1 -- 172.21.15.77:0/3473042944 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4dc00bb20 con 0x7fb4dc003ee0 2023-11-04T01:47:04.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.925+0000 7fb4f37fe640 1 -- 172.21.15.77:0/3473042944 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4dc00bce0 con 0x7fb4f415d4e0 2023-11-04T01:47:04.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.925+0000 7fb4f95ec640 1 --2- 172.21.15.77:0/3473042944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4dc004d00 0x7fb4dc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:04.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.925+0000 7fb4f3fff640 1 --2- 172.21.15.77:0/3473042944 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4dc003ee0 0x7fb4dc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:04.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.925+0000 7fb4f8deb640 1 --2- 172.21.15.77:0/3473042944 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4f415d4e0 0x7fb4dc0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:04.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.925+0000 7fb4f95ec640 1 -- 172.21.15.77:0/3473042944 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4f415d4e0 msgr2=0x7fb4dc0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:04.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.925+0000 7fb4f95ec640 1 --2- 172.21.15.77:0/3473042944 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4f415d4e0 0x7fb4dc0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:04.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.925+0000 7fb4f95ec640 1 -- 172.21.15.77:0/3473042944 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4dc003ee0 msgr2=0x7fb4dc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:04.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.925+0000 7fb4f95ec640 1 --2- 172.21.15.77:0/3473042944 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4dc003ee0 0x7fb4dc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:04.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.925+0000 7fb4f95ec640 1 -- 172.21.15.77:0/3473042944 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4dc003520 con 0x7fb4dc004d00 2023-11-04T01:47:04.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.926+0000 7fb4f95ec640 1 --2- 172.21.15.77:0/3473042944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4dc004d00 0x7fb4dc005180 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec00a830 tx=0x7fb4dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f94853db11d52024 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:04.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.926+0000 7fb4f37fe640 1 -- 172.21.15.77:0/3473042944 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec02cea0 con 0x7fb4dc004d00 2023-11-04T01:47:04.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.926+0000 7fb4f37fe640 1 -- 172.21.15.77:0/3473042944 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4ec02f070 con 0x7fb4dc004d00 2023-11-04T01:47:04.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.926+0000 7fb4f37fe640 1 -- 172.21.15.77:0/3473042944 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec0348d0 con 0x7fb4dc004d00 2023-11-04T01:47:04.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.927+0000 7fb4fb04f640 1 -- 172.21.15.77:0/3473042944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4dc004d00 msgr2=0x7fb4dc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:04.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.927+0000 7fb4fb04f640 1 --2- 172.21.15.77:0/3473042944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4dc004d00 0x7fb4dc005180 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec00a830 tx=0x7fb4dc0057f0 comp rx=0 tx=0).stop 2023-11-04T01:47:04.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.927+0000 7fb4f95ec640 1 -- 172.21.15.77:0/3473042944 reap_dead start 2023-11-04T01:47:04.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.927+0000 7fb4fb04f640 1 -- 172.21.15.77:0/3473042944 shutdown_connections 2023-11-04T01:47:04.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.927+0000 7fb4fb04f640 1 -- 172.21.15.77:0/3473042944 >> 172.21.15.77:0/3473042944 conn(0x7fb4f40d2ef0 msgr2=0x7fb4f40d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:04.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.927+0000 7fb4fb04f640 1 -- 172.21.15.77:0/3473042944 shutdown_connections 2023-11-04T01:47:04.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.927+0000 7fb4fb04f640 1 -- 172.21.15.77:0/3473042944 wait complete. 2023-11-04T01:47:04.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.928+0000 7fb4fb04f640 1 Processor -- start 2023-11-04T01:47:04.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.928+0000 7fb4fb04f640 1 -- start start 2023-11-04T01:47:04.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.929+0000 7fb4fb04f640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4dc004d00 0x7fb4f40b7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:04.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.929+0000 7fb4fb04f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4f40b5a70 0x7fb4f40b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:04.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.929+0000 7fb4fb04f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4f41f6080 0x7fb4f41f6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:04.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.929+0000 7fb4fb04f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f40b7f60 con 0x7fb4f40b5a70 2023-11-04T01:47:04.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.929+0000 7fb4fb04f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f415e1d0 con 0x7fb4f41f6080 2023-11-04T01:47:04.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.929+0000 7fb4fb04f640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f40b6430 con 0x7fb4dc004d00 2023-11-04T01:47:04.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.929+0000 7fb4f3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4f40b5a70 0x7fb4f40b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:04.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.929+0000 7fb4f3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4f40b5a70 0x7fb4f40b5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33948/0 (socket says 172.21.15.77:33948) 2023-11-04T01:47:04.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.929+0000 7fb4f3fff640 1 -- 172.21.15.77:0/3454488558 learned_addr learned my addr 172.21.15.77:0/3454488558 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:04.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.929+0000 7fb4f95ec640 1 --2- 172.21.15.77:0/3454488558 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4f41f6080 0x7fb4f41f6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:04.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.929+0000 7fb4f8deb640 1 --2- 172.21.15.77:0/3454488558 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4dc004d00 0x7fb4f40b7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:04.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.929+0000 7fb4f3fff640 1 -- 172.21.15.77:0/3454488558 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4dc004d00 msgr2=0x7fb4f40b7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:04.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.929+0000 7fb4f3fff640 1 --2- 172.21.15.77:0/3454488558 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4dc004d00 0x7fb4f40b7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:04.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.929+0000 7fb4f3fff640 1 -- 172.21.15.77:0/3454488558 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4f41f6080 msgr2=0x7fb4f41f6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:04.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.929+0000 7fb4f3fff640 1 --2- 172.21.15.77:0/3454488558 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4f41f6080 0x7fb4f41f6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:04.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.929+0000 7fb4f3fff640 1 -- 172.21.15.77:0/3454488558 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f40b8140 con 0x7fb4f40b5a70 2023-11-04T01:47:04.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.929+0000 7fb4f8deb640 1 --2- 172.21.15.77:0/3454488558 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4dc004d00 0x7fb4f40b7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:04.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.929+0000 7fb4f3fff640 1 --2- 172.21.15.77:0/3454488558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4f40b5a70 0x7fb4f40b5ef0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fb4e80119a0 tx=0x7fb4e8011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:04.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.929+0000 7fb4f17fa640 1 -- 172.21.15.77:0/3454488558 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e800fa90 con 0x7fb4f40b5a70 2023-11-04T01:47:04.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.929+0000 7fb4f17fa640 1 -- 172.21.15.77:0/3454488558 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e800fbf0 con 0x7fb4f40b5a70 2023-11-04T01:47:04.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.929+0000 7fb4f17fa640 1 -- 172.21.15.77:0/3454488558 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e8014440 con 0x7fb4f40b5a70 2023-11-04T01:47:04.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.929+0000 7fb4fb04f640 1 -- 172.21.15.77:0/3454488558 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f40b8420 con 0x7fb4f40b5a70 2023-11-04T01:47:04.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.930+0000 7fb4fb04f640 1 -- 172.21.15.77:0/3454488558 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f40b89e0 con 0x7fb4f40b5a70 2023-11-04T01:47:04.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.930+0000 7fb4fb04f640 1 -- 172.21.15.77:0/3454488558 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f415e340 con 0x7fb4f40b5a70 2023-11-04T01:47:04.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.931+0000 7fb4f17fa640 1 -- 172.21.15.77:0/3454488558 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb4e80145a0 con 0x7fb4f40b5a70 2023-11-04T01:47:04.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.931+0000 7fb4f17fa640 1 --2- 172.21.15.77:0/3454488558 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb4e006ae70 0x7fb4e006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:04.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.931+0000 7fb4f17fa640 1 -- 172.21.15.77:0/3454488558 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7952+0+0 (secure 0 0 0) 0x7fb4e808a6c0 con 0x7fb4f40b5a70 2023-11-04T01:47:04.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.931+0000 7fb4f8deb640 1 --2- 172.21.15.77:0/3454488558 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb4e006ae70 0x7fb4e006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:04.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.932+0000 7fb4f8deb640 1 --2- 172.21.15.77:0/3454488558 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb4e006ae70 0x7fb4e006d330 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4003750 tx=0x7fb4e4009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:04.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:04.936+0000 7fb4f17fa640 1 -- 172.21.15.77:0/3454488558 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb4f415e340 con 0x7fb4f40b5a70 2023-11-04T01:47:05.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:05.167+0000 7fb4fb04f640 1 -- 172.21.15.77:0/3454488558 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"} v 0) v1 -- 0x7fb4f40684b0 con 0x7fb4f40b5a70 2023-11-04T01:47:05.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:05.811+0000 7fb4f17fa640 1 -- 172.21.15.77:0/3454488558 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"}]=0 freezing mds.8343 v106) v1 ==== 112+0+0 (secure 0 0 0) 0x7fb4e8054eb0 con 0x7fb4f40b5a70 2023-11-04T01:47:05.813 INFO:teuthology.orchestra.run.smithi077.stderr:freezing mds.8343 2023-11-04T01:47:05.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:05.815+0000 7fb4fb04f640 1 -- 172.21.15.77:0/3454488558 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb4e006ae70 msgr2=0x7fb4e006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:05.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:05.815+0000 7fb4fb04f640 1 --2- 172.21.15.77:0/3454488558 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb4e006ae70 0x7fb4e006d330 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4003750 tx=0x7fb4e4009040 comp rx=0 tx=0).stop 2023-11-04T01:47:05.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:05.815+0000 7fb4fb04f640 1 -- 172.21.15.77:0/3454488558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4f40b5a70 msgr2=0x7fb4f40b5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:05.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:05.815+0000 7fb4fb04f640 1 --2- 172.21.15.77:0/3454488558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4f40b5a70 0x7fb4f40b5ef0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fb4e80119a0 tx=0x7fb4e8011e60 comp rx=0 tx=0).stop 2023-11-04T01:47:05.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:05.815+0000 7fb4fb04f640 1 -- 172.21.15.77:0/3454488558 shutdown_connections 2023-11-04T01:47:05.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:05.815+0000 7fb4fb04f640 1 --2- 172.21.15.77:0/3454488558 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb4e006ae70 0x7fb4e006d330 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:05.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:05.815+0000 7fb4fb04f640 1 --2- 172.21.15.77:0/3454488558 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4f41f6080 0x7fb4f41f6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:05.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:05.815+0000 7fb4fb04f640 1 --2- 172.21.15.77:0/3454488558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4f40b5a70 0x7fb4f40b5ef0 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:05.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:05.815+0000 7fb4fb04f640 1 --2- 172.21.15.77:0/3454488558 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb4dc004d00 0x7fb4f40b7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:05.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:05.815+0000 7fb4fb04f640 1 -- 172.21.15.77:0/3454488558 >> 172.21.15.77:0/3454488558 conn(0x7fb4f40d2ef0 msgr2=0x7fb4f40b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:05.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:05.815+0000 7fb4fb04f640 1 -- 172.21.15.77:0/3454488558 shutdown_connections 2023-11-04T01:47:05.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:05.815+0000 7fb4fb04f640 1 -- 172.21.15.77:0/3454488558 wait complete. 2023-11-04T01:47:05.828 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_kill_mdstable_at 6 2023-11-04T01:47:05.942 INFO:teuthology.orchestra.run.smithi077.stdout:{"success":"mds_kill_mdstable_at = '6' (not observed, change may require restart) "} 2023-11-04T01:47:05.942 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '6' (not observed, change may require restart) " } 2023-11-04T01:47:05.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:05.943 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s26) 2023-11-04T01:47:05.946 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:47:06.070 INFO:teuthology.orchestra.run.smithi077.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:47:06.070 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:47:06.071 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:06.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.169+0000 7f97fe300640 1 Processor -- start 2023-11-04T01:47:06.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.169+0000 7f97fe300640 1 -- start start 2023-11-04T01:47:06.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.169+0000 7f97fe300640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f97f80ade00 0x7f97f80b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:06.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.169+0000 7f97fe300640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f97f806d9c0 0x7f97f80710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:06.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.169+0000 7f97fe300640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97f806cc90 con 0x7f97f806c5f0 2023-11-04T01:47:06.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.169+0000 7f97fe300640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f80b0e60 con 0x7f97f80ade00 2023-11-04T01:47:06.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.169+0000 7f97fe300640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f806cee0 con 0x7f97f806d9c0 2023-11-04T01:47:06.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.170+0000 7f97f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f97f80ade00 0x7f97f80b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:06.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.170+0000 7f97fc89d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f97f806c5f0 0x7f97f815e9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45872/0 (socket says 172.21.15.77:45872) 2023-11-04T01:47:06.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.170+0000 7f97fc89d640 1 -- 172.21.15.77:0/2811999773 learned_addr learned my addr 172.21.15.77:0/2811999773 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:47:06.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.170+0000 7f97f7fff640 1 -- 172.21.15.77:0/2811999773 >> v2:172.21.15.122:3300/0 conn(0x7f97f806d9c0 msgr2=0x7f97f80710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:06.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.170+0000 7f97f7fff640 1 --2- 172.21.15.77:0/2811999773 >> v2:172.21.15.122:3300/0 conn(0x7f97f806d9c0 0x7f97f80710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.170+0000 7f97f7fff640 1 -- 172.21.15.77:0/2811999773 >> v1:172.21.15.77:6789/0 conn(0x7f97f806c5f0 legacy=0x7f97f815e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:06.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.170+0000 7f97f6ffd640 1 -- 172.21.15.77:0/2811999773 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2848891006 0 0) 0x7f97f806cc90 con 0x7f97f806c5f0 2023-11-04T01:47:06.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.170+0000 7f97f7fff640 1 -- 172.21.15.77:0/2811999773 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f806d1c0 con 0x7f97f80ade00 2023-11-04T01:47:06.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.171+0000 7f97f7fff640 1 --2- 172.21.15.77:0/2811999773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97f80ade00 0x7f97f80b0530 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f97f80c9080 tx=0x7f97e802b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a1728eac4a42c79 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:06.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.171+0000 7f97f6ffd640 1 -- 172.21.15.77:0/2811999773 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e8031740 con 0x7f97f80ade00 2023-11-04T01:47:06.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.171+0000 7f97f6ffd640 1 -- 172.21.15.77:0/2811999773 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e80318a0 con 0x7f97f80ade00 2023-11-04T01:47:06.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.171+0000 7f97f6ffd640 1 -- 172.21.15.77:0/2811999773 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e8031c30 con 0x7f97f80ade00 2023-11-04T01:47:06.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.171+0000 7f97fe300640 1 -- 172.21.15.77:0/2811999773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97f80ade00 msgr2=0x7f97f80b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:06.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.171+0000 7f97fe300640 1 --2- 172.21.15.77:0/2811999773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97f80ade00 0x7f97f80b0530 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f97f80c9080 tx=0x7f97e802b7e0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.171+0000 7f97fe300640 1 -- 172.21.15.77:0/2811999773 shutdown_connections 2023-11-04T01:47:06.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.171+0000 7f97fe300640 1 --2- 172.21.15.77:0/2811999773 >> v2:172.21.15.122:3300/0 conn(0x7f97f806d9c0 0x7f97f80710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.171+0000 7f97fe300640 1 --2- 172.21.15.77:0/2811999773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97f80ade00 0x7f97f80b0530 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.171+0000 7f97fe300640 1 -- 172.21.15.77:0/2811999773 >> 172.21.15.77:0/2811999773 conn(0x7f97f80cb530 msgr2=0x7f97f80cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:06.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.171+0000 7f97fe300640 1 -- 172.21.15.77:0/2811999773 shutdown_connections 2023-11-04T01:47:06.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.171+0000 7f97fe300640 1 -- 172.21.15.77:0/2811999773 wait complete. 2023-11-04T01:47:06.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.172+0000 7f97fe300640 1 Processor -- start 2023-11-04T01:47:06.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.173+0000 7f97fe300640 1 -- start start 2023-11-04T01:47:06.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.173+0000 7f97fe300640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97f806c5f0 0x7f97f81f4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:06.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.173+0000 7f97fe300640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97f806d9c0 0x7f97f8157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:06.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.173+0000 7f97fe300640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97f80ade00 0x7f97f8158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:06.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.173+0000 7f97fe300640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f815abf0 con 0x7f97f806c5f0 2023-11-04T01:47:06.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.173+0000 7f97fe300640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f8159d40 con 0x7f97f80ade00 2023-11-04T01:47:06.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.173+0000 7f97fe300640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f8159fe0 con 0x7f97f806d9c0 2023-11-04T01:47:06.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.173+0000 7f97f7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97f806c5f0 0x7f97f81f4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:06.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.173+0000 7f97f7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97f806c5f0 0x7f97f81f4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33968/0 (socket says 172.21.15.77:33968) 2023-11-04T01:47:06.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.173+0000 7f97f7fff640 1 -- 172.21.15.77:0/1689414212 learned_addr learned my addr 172.21.15.77:0/1689414212 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:06.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.174+0000 7f97fc89d640 1 --2- 172.21.15.77:0/1689414212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97f80ade00 0x7f97f8158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:06.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.174+0000 7f97f7fff640 1 -- 172.21.15.77:0/1689414212 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97f806d9c0 msgr2=0x7f97f8157ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:06.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.174+0000 7f97f7fff640 1 --2- 172.21.15.77:0/1689414212 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97f806d9c0 0x7f97f8157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.174+0000 7f97f7fff640 1 -- 172.21.15.77:0/1689414212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97f80ade00 msgr2=0x7f97f8158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:06.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.174+0000 7f97f7fff640 1 --2- 172.21.15.77:0/1689414212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97f80ade00 0x7f97f8158410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.174+0000 7f97f7fff640 1 -- 172.21.15.77:0/1689414212 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e8009400 con 0x7f97f806c5f0 2023-11-04T01:47:06.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.174+0000 7f97fc89d640 1 --2- 172.21.15.77:0/1689414212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97f80ade00 0x7f97f8158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:06.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.174+0000 7f97f7fff640 1 --2- 172.21.15.77:0/1689414212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97f806c5f0 0x7f97f81f4540 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f97e8000c00 tx=0x7f97e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:06.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.174+0000 7f97f4ff9640 1 -- 172.21.15.77:0/1689414212 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e8033c70 con 0x7f97f806c5f0 2023-11-04T01:47:06.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.174+0000 7f97f4ff9640 1 -- 172.21.15.77:0/1689414212 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e8033df0 con 0x7f97f806c5f0 2023-11-04T01:47:06.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.174+0000 7f97fe300640 1 -- 172.21.15.77:0/1689414212 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f815a2c0 con 0x7f97f806c5f0 2023-11-04T01:47:06.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.174+0000 7f97f4ff9640 1 -- 172.21.15.77:0/1689414212 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e803d6b0 con 0x7f97f806c5f0 2023-11-04T01:47:06.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.174+0000 7f97fe300640 1 -- 172.21.15.77:0/1689414212 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f815a880 con 0x7f97f806c5f0 2023-11-04T01:47:06.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.175+0000 7f97fe300640 1 -- 172.21.15.77:0/1689414212 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f815aa10 con 0x7f97f806c5f0 2023-11-04T01:47:06.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.176+0000 7f97f4ff9640 1 -- 172.21.15.77:0/1689414212 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f97e803a040 con 0x7f97f806c5f0 2023-11-04T01:47:06.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.176+0000 7f97f4ff9640 1 --2- 172.21.15.77:0/1689414212 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f97e406ae70 0x7f97e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:06.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.176+0000 7f97f4ff9640 1 -- 172.21.15.77:0/1689414212 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f97e80abe50 con 0x7f97f806c5f0 2023-11-04T01:47:06.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.176+0000 7f97f77fe640 1 --2- 172.21.15.77:0/1689414212 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f97e406ae70 0x7f97e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:06.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.177+0000 7f97f77fe640 1 --2- 172.21.15.77:0/1689414212 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f97e406ae70 0x7f97e406d330 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f97f80b3ad0 tx=0x7f97ec006bf0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:06.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.180+0000 7f97f4ff9640 1 -- 172.21.15.77:0/1689414212 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f97e8076640 con 0x7f97f806c5f0 2023-11-04T01:47:06.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.384+0000 7f97fe300640 1 -- 172.21.15.77:0/1689414212 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f97f80684b0 con 0x7f97f806c5f0 2023-11-04T01:47:06.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.385+0000 7f97f4ff9640 1 -- 172.21.15.77:0/1689414212 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4942 (secure 0 0 0) 0x7f97e804e090 con 0x7f97f806c5f0 2023-11-04T01:47:06.387 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:47:06.387 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":106,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7033,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2238841748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2238841748},{"type":"v1","addr":"172.21.15.122:6836","nonce":2238841748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:47:05.168262+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8139,"mds_1":8343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8139":{"gid":8139,"name":"c","rank":0,"incarnation":97,"state":"up:active","state_seq":16,"addr":"172.21.15.77:6835/2107153526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2107153526},{"type":"v1","addr":"172.21.15.77:6835","nonce":2107153526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8343":{"gid":8343,"name":"a","rank":1,"incarnation":100,"state":"up:active","state_seq":7,"addr":"172.21.15.77:6834/4183807043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4183807043},{"type":"v1","addr":"172.21.15.77:6834","nonce":4183807043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:06.387 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 106 2023-11-04T01:47:06.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.387+0000 7f97fe300640 1 -- 172.21.15.77:0/1689414212 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f97e406ae70 msgr2=0x7f97e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:06.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.387+0000 7f97fe300640 1 --2- 172.21.15.77:0/1689414212 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f97e406ae70 0x7f97e406d330 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f97f80b3ad0 tx=0x7f97ec006bf0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.387+0000 7f97fe300640 1 -- 172.21.15.77:0/1689414212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97f806c5f0 msgr2=0x7f97f81f4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:06.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.387+0000 7f97fe300640 1 --2- 172.21.15.77:0/1689414212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97f806c5f0 0x7f97f81f4540 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f97e8000c00 tx=0x7f97e80046c0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.387+0000 7f97fe300640 1 -- 172.21.15.77:0/1689414212 shutdown_connections 2023-11-04T01:47:06.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.387+0000 7f97fe300640 1 --2- 172.21.15.77:0/1689414212 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f97e406ae70 0x7f97e406d330 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.387+0000 7f97fe300640 1 --2- 172.21.15.77:0/1689414212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f97f80ade00 0x7f97f8158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.387+0000 7f97fe300640 1 --2- 172.21.15.77:0/1689414212 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f97f806d9c0 0x7f97f8157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.387+0000 7f97fe300640 1 --2- 172.21.15.77:0/1689414212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97f806c5f0 0x7f97f81f4540 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:06.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.387+0000 7f97fe300640 1 -- 172.21.15.77:0/1689414212 >> 172.21.15.77:0/1689414212 conn(0x7f97f80cb530 msgr2=0x7f97f80cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:06.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.387+0000 7f97fe300640 1 -- 172.21.15.77:0/1689414212 shutdown_connections 2023-11-04T01:47:06.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:06.387+0000 7f97fe300640 1 -- 172.21.15.77:0/1689414212 wait complete. 2023-11-04T01:47:06.399 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:47:06.696 INFO:tasks.ceph.mds.c.smithi077.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7fefd9c0e640 time 2023-11-04T01:47:06.695853+0000 2023-11-04T01:47:06.696 INFO:tasks.ceph.mds.c.smithi077.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:47:06.697 INFO:tasks.ceph.mds.c.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:06.697 INFO:tasks.ceph.mds.c.smithi077.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fefe576efaf] 2023-11-04T01:47:06.698 INFO:tasks.ceph.mds.c.smithi077.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fefe576f16d] 2023-11-04T01:47:06.698 INFO:tasks.ceph.mds.c.smithi077.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55bf2e88421b] 2023-11-04T01:47:06.698 INFO:tasks.ceph.mds.c.smithi077.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55bf2e8b3bcc] 2023-11-04T01:47:06.698 INFO:tasks.ceph.mds.c.smithi077.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x55bf2e8bcb0c] 2023-11-04T01:47:06.699 INFO:tasks.ceph.mds.c.smithi077.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55bf2e8bcc63] 2023-11-04T01:47:06.699 INFO:tasks.ceph.mds.c.smithi077.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fefe58164a5] 2023-11-04T01:47:06.699 INFO:tasks.ceph.mds.c.smithi077.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fefe4e9f802] 2023-11-04T01:47:06.699 INFO:tasks.ceph.mds.c.smithi077.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fefe4e3f450] 2023-11-04T01:47:06.699 INFO:tasks.ceph.mds.c.smithi077.stderr:2023-11-04T01:47:06.695+0000 7fefd9c0e640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7fefd9c0e640 time 2023-11-04T01:47:06.695853+0000 2023-11-04T01:47:06.700 INFO:tasks.ceph.mds.c.smithi077.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:47:06.700 INFO:tasks.ceph.mds.c.smithi077.stderr: 2023-11-04T01:47:06.700 INFO:tasks.ceph.mds.c.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:06.700 INFO:tasks.ceph.mds.c.smithi077.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fefe576efaf] 2023-11-04T01:47:06.700 INFO:tasks.ceph.mds.c.smithi077.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fefe576f16d] 2023-11-04T01:47:06.701 INFO:tasks.ceph.mds.c.smithi077.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55bf2e88421b] 2023-11-04T01:47:06.701 INFO:tasks.ceph.mds.c.smithi077.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55bf2e8b3bcc] 2023-11-04T01:47:06.701 INFO:tasks.ceph.mds.c.smithi077.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x55bf2e8bcb0c] 2023-11-04T01:47:06.701 INFO:tasks.ceph.mds.c.smithi077.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55bf2e8bcc63] 2023-11-04T01:47:06.701 INFO:tasks.ceph.mds.c.smithi077.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fefe58164a5] 2023-11-04T01:47:06.702 INFO:tasks.ceph.mds.c.smithi077.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fefe4e9f802] 2023-11-04T01:47:06.702 INFO:tasks.ceph.mds.c.smithi077.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fefe4e3f450] 2023-11-04T01:47:06.702 INFO:tasks.ceph.mds.c.smithi077.stderr: 2023-11-04T01:47:06.702 INFO:tasks.ceph.mds.c.smithi077.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:47:06.702 INFO:tasks.ceph.mds.c.smithi077.stderr: in thread 7fefd9c0e640 thread_name:MR_Finisher 2023-11-04T01:47:06.703 INFO:tasks.ceph.mds.c.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:06.703 INFO:tasks.ceph.mds.c.smithi077.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fefe4e54db0] 2023-11-04T01:47:06.703 INFO:tasks.ceph.mds.c.smithi077.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fefe4ea154c] 2023-11-04T01:47:06.703 INFO:tasks.ceph.mds.c.smithi077.stderr: 3: raise() 2023-11-04T01:47:06.703 INFO:tasks.ceph.mds.c.smithi077.stderr: 4: abort() 2023-11-04T01:47:06.704 INFO:tasks.ceph.mds.c.smithi077.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fefe576f009] 2023-11-04T01:47:06.704 INFO:tasks.ceph.mds.c.smithi077.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fefe576f16d] 2023-11-04T01:47:06.704 INFO:tasks.ceph.mds.c.smithi077.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55bf2e88421b] 2023-11-04T01:47:06.704 INFO:tasks.ceph.mds.c.smithi077.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55bf2e8b3bcc] 2023-11-04T01:47:06.704 INFO:tasks.ceph.mds.c.smithi077.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x55bf2e8bcb0c] 2023-11-04T01:47:06.705 INFO:tasks.ceph.mds.c.smithi077.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55bf2e8bcc63] 2023-11-04T01:47:06.705 INFO:tasks.ceph.mds.c.smithi077.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fefe58164a5] 2023-11-04T01:47:06.705 INFO:tasks.ceph.mds.c.smithi077.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7fefe4e9f802] 2023-11-04T01:47:06.705 INFO:tasks.ceph.mds.c.smithi077.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7fefe4e3f450] 2023-11-04T01:47:06.705 INFO:tasks.ceph.mds.c.smithi077.stderr:2023-11-04T01:47:06.696+0000 7fefd9c0e640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:47:06.706 INFO:tasks.ceph.mds.c.smithi077.stderr: in thread 7fefd9c0e640 thread_name:MR_Finisher 2023-11-04T01:47:06.706 INFO:tasks.ceph.mds.c.smithi077.stderr: 2023-11-04T01:47:06.706 INFO:tasks.ceph.mds.c.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:06.706 INFO:tasks.ceph.mds.c.smithi077.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fefe4e54db0] 2023-11-04T01:47:06.706 INFO:tasks.ceph.mds.c.smithi077.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fefe4ea154c] 2023-11-04T01:47:06.707 INFO:tasks.ceph.mds.c.smithi077.stderr: 3: raise() 2023-11-04T01:47:06.707 INFO:tasks.ceph.mds.c.smithi077.stderr: 4: abort() 2023-11-04T01:47:06.707 INFO:tasks.ceph.mds.c.smithi077.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fefe576f009] 2023-11-04T01:47:06.707 INFO:tasks.ceph.mds.c.smithi077.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fefe576f16d] 2023-11-04T01:47:06.707 INFO:tasks.ceph.mds.c.smithi077.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55bf2e88421b] 2023-11-04T01:47:06.708 INFO:tasks.ceph.mds.c.smithi077.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55bf2e8b3bcc] 2023-11-04T01:47:06.708 INFO:tasks.ceph.mds.c.smithi077.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x55bf2e8bcb0c] 2023-11-04T01:47:06.708 INFO:tasks.ceph.mds.c.smithi077.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55bf2e8bcc63] 2023-11-04T01:47:06.708 INFO:tasks.ceph.mds.c.smithi077.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fefe58164a5] 2023-11-04T01:47:06.708 INFO:tasks.ceph.mds.c.smithi077.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7fefe4e9f802] 2023-11-04T01:47:06.709 INFO:tasks.ceph.mds.c.smithi077.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7fefe4e3f450] 2023-11-04T01:47:06.709 INFO:tasks.ceph.mds.c.smithi077.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:47:06.709 INFO:tasks.ceph.mds.c.smithi077.stderr: 2023-11-04T01:47:06.710 INFO:tasks.ceph.mds.c.smithi077.stderr: -843> 2023-11-04T01:46:58.609+0000 7fefdd415640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:47:06.710 INFO:tasks.ceph.mds.c.smithi077.stderr: -841> 2023-11-04T01:46:58.609+0000 7fefdd415640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:47:06.710 INFO:tasks.ceph.mds.c.smithi077.stderr: -1> 2023-11-04T01:47:06.695+0000 7fefd9c0e640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7fefd9c0e640 time 2023-11-04T01:47:06.695853+0000 2023-11-04T01:47:06.710 INFO:tasks.ceph.mds.c.smithi077.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:47:06.711 INFO:tasks.ceph.mds.c.smithi077.stderr: 2023-11-04T01:47:06.711 INFO:tasks.ceph.mds.c.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:06.711 INFO:tasks.ceph.mds.c.smithi077.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fefe576efaf] 2023-11-04T01:47:06.711 INFO:tasks.ceph.mds.c.smithi077.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fefe576f16d] 2023-11-04T01:47:06.711 INFO:tasks.ceph.mds.c.smithi077.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55bf2e88421b] 2023-11-04T01:47:06.712 INFO:tasks.ceph.mds.c.smithi077.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55bf2e8b3bcc] 2023-11-04T01:47:06.712 INFO:tasks.ceph.mds.c.smithi077.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x55bf2e8bcb0c] 2023-11-04T01:47:06.712 INFO:tasks.ceph.mds.c.smithi077.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55bf2e8bcc63] 2023-11-04T01:47:06.712 INFO:tasks.ceph.mds.c.smithi077.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fefe58164a5] 2023-11-04T01:47:06.712 INFO:tasks.ceph.mds.c.smithi077.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fefe4e9f802] 2023-11-04T01:47:06.713 INFO:tasks.ceph.mds.c.smithi077.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fefe4e3f450] 2023-11-04T01:47:06.713 INFO:tasks.ceph.mds.c.smithi077.stderr: 2023-11-04T01:47:06.713 INFO:tasks.ceph.mds.c.smithi077.stderr: 0> 2023-11-04T01:47:06.696+0000 7fefd9c0e640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:47:06.713 INFO:tasks.ceph.mds.c.smithi077.stderr: in thread 7fefd9c0e640 thread_name:MR_Finisher 2023-11-04T01:47:06.713 INFO:tasks.ceph.mds.c.smithi077.stderr: 2023-11-04T01:47:06.714 INFO:tasks.ceph.mds.c.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:06.714 INFO:tasks.ceph.mds.c.smithi077.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fefe4e54db0] 2023-11-04T01:47:06.714 INFO:tasks.ceph.mds.c.smithi077.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fefe4ea154c] 2023-11-04T01:47:06.714 INFO:tasks.ceph.mds.c.smithi077.stderr: 3: raise() 2023-11-04T01:47:06.714 INFO:tasks.ceph.mds.c.smithi077.stderr: 4: abort() 2023-11-04T01:47:06.715 INFO:tasks.ceph.mds.c.smithi077.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fefe576f009] 2023-11-04T01:47:06.715 INFO:tasks.ceph.mds.c.smithi077.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fefe576f16d] 2023-11-04T01:47:06.715 INFO:tasks.ceph.mds.c.smithi077.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55bf2e88421b] 2023-11-04T01:47:06.715 INFO:tasks.ceph.mds.c.smithi077.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55bf2e8b3bcc] 2023-11-04T01:47:06.715 INFO:tasks.ceph.mds.c.smithi077.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x55bf2e8bcb0c] 2023-11-04T01:47:06.716 INFO:tasks.ceph.mds.c.smithi077.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55bf2e8bcc63] 2023-11-04T01:47:06.716 INFO:tasks.ceph.mds.c.smithi077.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fefe58164a5] 2023-11-04T01:47:06.716 INFO:tasks.ceph.mds.c.smithi077.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7fefe4e9f802] 2023-11-04T01:47:06.716 INFO:tasks.ceph.mds.c.smithi077.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7fefe4e3f450] 2023-11-04T01:47:06.716 INFO:tasks.ceph.mds.c.smithi077.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:47:06.716 INFO:tasks.ceph.mds.c.smithi077.stderr: 2023-11-04T01:47:06.717 INFO:tasks.ceph.mds.c.smithi077.stderr: -846> 2023-11-04T01:46:58.609+0000 7fefdd415640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:47:06.717 INFO:tasks.ceph.mds.c.smithi077.stderr: -844> 2023-11-04T01:46:58.609+0000 7fefdd415640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:47:06.717 INFO:tasks.ceph.mds.c.smithi077.stderr: -4> 2023-11-04T01:47:06.695+0000 7fefd9c0e640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7fefd9c0e640 time 2023-11-04T01:47:06.695853+0000 2023-11-04T01:47:06.717 INFO:tasks.ceph.mds.c.smithi077.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:47:06.717 INFO:tasks.ceph.mds.c.smithi077.stderr: 2023-11-04T01:47:06.718 INFO:tasks.ceph.mds.c.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:06.718 INFO:tasks.ceph.mds.c.smithi077.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fefe576efaf] 2023-11-04T01:47:06.718 INFO:tasks.ceph.mds.c.smithi077.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fefe576f16d] 2023-11-04T01:47:06.718 INFO:tasks.ceph.mds.c.smithi077.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55bf2e88421b] 2023-11-04T01:47:06.718 INFO:tasks.ceph.mds.c.smithi077.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55bf2e8b3bcc] 2023-11-04T01:47:06.719 INFO:tasks.ceph.mds.c.smithi077.stderr: 5: (MDSIOContextBase::complete(int)+0x31c) [0x55bf2e8bcb0c] 2023-11-04T01:47:06.719 INFO:tasks.ceph.mds.c.smithi077.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55bf2e8bcc63] 2023-11-04T01:47:06.719 INFO:tasks.ceph.mds.c.smithi077.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fefe58164a5] 2023-11-04T01:47:06.719 INFO:tasks.ceph.mds.c.smithi077.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fefe4e9f802] 2023-11-04T01:47:06.719 INFO:tasks.ceph.mds.c.smithi077.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fefe4e3f450] 2023-11-04T01:47:06.720 INFO:tasks.ceph.mds.c.smithi077.stderr: 2023-11-04T01:47:06.720 INFO:tasks.ceph.mds.c.smithi077.stderr: -3> 2023-11-04T01:47:06.696+0000 7fefd9c0e640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:47:06.720 INFO:tasks.ceph.mds.c.smithi077.stderr: in thread 7fefd9c0e640 thread_name:MR_Finisher 2023-11-04T01:47:06.720 INFO:tasks.ceph.mds.c.smithi077.stderr: 2023-11-04T01:47:06.720 INFO:tasks.ceph.mds.c.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:06.720 INFO:tasks.ceph.mds.c.smithi077.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fefe4e54db0] 2023-11-04T01:47:06.721 INFO:tasks.ceph.mds.c.smithi077.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fefe4ea154c] 2023-11-04T01:47:06.721 INFO:tasks.ceph.mds.c.smithi077.stderr: 3: raise() 2023-11-04T01:47:06.721 INFO:tasks.ceph.mds.c.smithi077.stderr: 4: abort() 2023-11-04T01:47:06.721 INFO:tasks.ceph.mds.c.smithi077.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fefe576f009] 2023-11-04T01:47:06.721 INFO:tasks.ceph.mds.c.smithi077.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fefe576f16d] 2023-11-04T01:47:06.722 INFO:tasks.ceph.mds.c.smithi077.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x41b) [0x55bf2e88421b] 2023-11-04T01:47:06.722 INFO:tasks.ceph.mds.c.smithi077.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55bf2e8b3bcc] 2023-11-04T01:47:06.722 INFO:tasks.ceph.mds.c.smithi077.stderr: 9: (MDSIOContextBase::complete(int)+0x31c) [0x55bf2e8bcb0c] 2023-11-04T01:47:06.722 INFO:tasks.ceph.mds.c.smithi077.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55bf2e8bcc63] 2023-11-04T01:47:06.722 INFO:tasks.ceph.mds.c.smithi077.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fefe58164a5] 2023-11-04T01:47:06.722 INFO:tasks.ceph.mds.c.smithi077.stderr: 12: /lib64/libc.so.6(+0x9f802) [0x7fefe4e9f802] 2023-11-04T01:47:06.723 INFO:tasks.ceph.mds.c.smithi077.stderr: 13: /lib64/libc.so.6(+0x3f450) [0x7fefe4e3f450] 2023-11-04T01:47:06.723 INFO:tasks.ceph.mds.c.smithi077.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:47:06.723 INFO:tasks.ceph.mds.c.smithi077.stderr: 2023-11-04T01:47:06.957 INFO:tasks.ceph.mds.c.smithi077.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:47:11.400 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:11.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.510+0000 7ffb917d7640 1 Processor -- start 2023-11-04T01:47:11.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.510+0000 7ffb917d7640 1 -- start start 2023-11-04T01:47:11.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.511+0000 7ffb917d7640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffb8c15d100 0x7ffb8c0ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:11.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.511+0000 7ffb917d7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ffb8c15d4e0 0x7ffb8c0d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:11.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.511+0000 7ffb917d7640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb8c0b32b0 con 0x7ffb8c0d3b60 2023-11-04T01:47:11.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.511+0000 7ffb917d7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb8c0cee10 con 0x7ffb8c15d4e0 2023-11-04T01:47:11.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.511+0000 7ffb917d7640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c0b4750 con 0x7ffb8c15d100 2023-11-04T01:47:11.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.511+0000 7ffb8a7fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ffb8c15d4e0 0x7ffb8c0d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:11.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.511+0000 7ffb8a7fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ffb8c15d4e0 0x7ffb8c0d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34034/0 (socket says 172.21.15.77:34034) 2023-11-04T01:47:11.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.511+0000 7ffb8a7fc640 1 -- 172.21.15.77:0/3307403561 learned_addr learned my addr 172.21.15.77:0/3307403561 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:11.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.512+0000 7ffb8affd640 1 --2- 172.21.15.77:0/3307403561 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffb8c15d100 0x7ffb8c0ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:11.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.512+0000 7ffb8a7fc640 1 -- 172.21.15.77:0/3307403561 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffb8c15d100 msgr2=0x7ffb8c0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:11.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.512+0000 7ffb8a7fc640 1 --2- 172.21.15.77:0/3307403561 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffb8c15d100 0x7ffb8c0ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:11.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.512+0000 7ffb8a7fc640 1 -- 172.21.15.77:0/3307403561 >> v1:172.21.15.122:6789/0 conn(0x7ffb8c0d3b60 legacy=0x7ffb8c0cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:11.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.512+0000 7ffb8a7fc640 1 -- 172.21.15.77:0/3307403561 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8c0b2980 con 0x7ffb8c15d4e0 2023-11-04T01:47:11.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.512+0000 7ffb8a7fc640 1 --2- 172.21.15.77:0/3307403561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb8c15d4e0 0x7ffb8c0d14d0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7ffb80009870 tx=0x7ffb8002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66740bceff98082c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:11.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.513+0000 7ffb89ffb640 1 -- 172.21.15.77:0/3307403561 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb80030840 con 0x7ffb8c15d4e0 2023-11-04T01:47:11.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.513+0000 7ffb89ffb640 1 -- 172.21.15.77:0/3307403561 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb800309a0 con 0x7ffb8c15d4e0 2023-11-04T01:47:11.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.513+0000 7ffb89ffb640 1 -- 172.21.15.77:0/3307403561 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb80030d30 con 0x7ffb8c15d4e0 2023-11-04T01:47:11.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.513+0000 7ffb917d7640 1 -- 172.21.15.77:0/3307403561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb8c15d4e0 msgr2=0x7ffb8c0d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:11.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.513+0000 7ffb917d7640 1 --2- 172.21.15.77:0/3307403561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb8c15d4e0 0x7ffb8c0d14d0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7ffb80009870 tx=0x7ffb8002b980 comp rx=0 tx=0).stop 2023-11-04T01:47:11.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.513+0000 7ffb917d7640 1 -- 172.21.15.77:0/3307403561 shutdown_connections 2023-11-04T01:47:11.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.513+0000 7ffb917d7640 1 --2- 172.21.15.77:0/3307403561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb8c15d4e0 0x7ffb8c0d14d0 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:11.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.513+0000 7ffb917d7640 1 --2- 172.21.15.77:0/3307403561 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffb8c15d100 0x7ffb8c0ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:11.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.513+0000 7ffb917d7640 1 -- 172.21.15.77:0/3307403561 >> 172.21.15.77:0/3307403561 conn(0x7ffb8c0d2ef0 msgr2=0x7ffb8c0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:11.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.513+0000 7ffb917d7640 1 -- 172.21.15.77:0/3307403561 shutdown_connections 2023-11-04T01:47:11.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.513+0000 7ffb917d7640 1 -- 172.21.15.77:0/3307403561 wait complete. 2023-11-04T01:47:11.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.515+0000 7ffb917d7640 1 Processor -- start 2023-11-04T01:47:11.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.515+0000 7ffb917d7640 1 -- start start 2023-11-04T01:47:11.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.515+0000 7ffb917d7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb8c0d3b60 0x7ffb8c0c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:11.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.515+0000 7ffb917d7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb8c15d100 0x7ffb8c0b8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:11.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.515+0000 7ffb917d7640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffb8c15d4e0 0x7ffb8c149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:11.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.515+0000 7ffb917d7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c0ca810 con 0x7ffb8c15d100 2023-11-04T01:47:11.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.515+0000 7ffb917d7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c0cd210 con 0x7ffb8c0d3b60 2023-11-04T01:47:11.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.515+0000 7ffb917d7640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c0cc970 con 0x7ffb8c15d4e0 2023-11-04T01:47:11.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.515+0000 7ffb8a7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb8c15d100 0x7ffb8c0b8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:11.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.516+0000 7ffb8a7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb8c15d100 0x7ffb8c0b8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34050/0 (socket says 172.21.15.77:34050) 2023-11-04T01:47:11.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.516+0000 7ffb8a7fc640 1 -- 172.21.15.77:0/3923870509 learned_addr learned my addr 172.21.15.77:0/3923870509 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:11.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.516+0000 7ffb8affd640 1 --2- 172.21.15.77:0/3923870509 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb8c0d3b60 0x7ffb8c0c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:11.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.516+0000 7ffb8a7fc640 1 -- 172.21.15.77:0/3923870509 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffb8c15d4e0 msgr2=0x7ffb8c149310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:11.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.516+0000 7ffb8a7fc640 1 --2- 172.21.15.77:0/3923870509 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffb8c15d4e0 0x7ffb8c149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:11.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.516+0000 7ffb8a7fc640 1 -- 172.21.15.77:0/3923870509 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb8c0d3b60 msgr2=0x7ffb8c0c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:11.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.516+0000 7ffb8a7fc640 1 --2- 172.21.15.77:0/3923870509 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb8c0d3b60 0x7ffb8c0c9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:11.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.516+0000 7ffb8a7fc640 1 -- 172.21.15.77:0/3923870509 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb800094d0 con 0x7ffb8c15d100 2023-11-04T01:47:11.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.516+0000 7ffb8affd640 1 --2- 172.21.15.77:0/3923870509 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb8c0d3b60 0x7ffb8c0c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:11.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.516+0000 7ffb8a7fc640 1 --2- 172.21.15.77:0/3923870509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb8c15d100 0x7ffb8c0b8290 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7ffb80000c00 tx=0x7ffb80004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:11.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.516+0000 7ffb737fe640 1 -- 172.21.15.77:0/3923870509 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb80039c90 con 0x7ffb8c15d100 2023-11-04T01:47:11.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.516+0000 7ffb737fe640 1 -- 172.21.15.77:0/3923870509 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb80039df0 con 0x7ffb8c15d100 2023-11-04T01:47:11.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.516+0000 7ffb917d7640 1 -- 172.21.15.77:0/3923870509 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb8c0ccc50 con 0x7ffb8c15d100 2023-11-04T01:47:11.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.516+0000 7ffb737fe640 1 -- 172.21.15.77:0/3923870509 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb80043640 con 0x7ffb8c15d100 2023-11-04T01:47:11.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.516+0000 7ffb917d7640 1 -- 172.21.15.77:0/3923870509 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb8c0ca500 con 0x7ffb8c15d100 2023-11-04T01:47:11.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.517+0000 7ffb917d7640 1 -- 172.21.15.77:0/3923870509 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb8c15e990 con 0x7ffb8c15d100 2023-11-04T01:47:11.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.518+0000 7ffb737fe640 1 -- 172.21.15.77:0/3923870509 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffb800437a0 con 0x7ffb8c15d100 2023-11-04T01:47:11.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.518+0000 7ffb737fe640 1 --2- 172.21.15.77:0/3923870509 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ffb7806ae70 0x7ffb7806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:11.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.518+0000 7ffb737fe640 1 -- 172.21.15.77:0/3923870509 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7952+0+0 (secure 0 0 0) 0x7ffb8003e070 con 0x7ffb8c15d100 2023-11-04T01:47:11.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.518+0000 7ffb8affd640 1 --2- 172.21.15.77:0/3923870509 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ffb7806ae70 0x7ffb7806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:11.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.519+0000 7ffb8affd640 1 --2- 172.21.15.77:0/3923870509 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ffb7806ae70 0x7ffb7806d330 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c007520 tx=0x7ffb7c00b040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:11.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.522+0000 7ffb737fe640 1 -- 172.21.15.77:0/3923870509 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffb8c15e990 con 0x7ffb8c15d100 2023-11-04T01:47:11.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.726+0000 7ffb917d7640 1 -- 172.21.15.77:0/3923870509 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb8c15e990 con 0x7ffb8c15d100 2023-11-04T01:47:11.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.726+0000 7ffb737fe640 1 -- 172.21.15.77:0/3923870509 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4942 (secure 0 0 0) 0x7ffb8c15e990 con 0x7ffb8c15d100 2023-11-04T01:47:11.729 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:47:11.729 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":106,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7033,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2238841748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2238841748},{"type":"v1","addr":"172.21.15.122:6836","nonce":2238841748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:47:05.168262+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8139,"mds_1":8343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8139":{"gid":8139,"name":"c","rank":0,"incarnation":97,"state":"up:active","state_seq":16,"addr":"172.21.15.77:6835/2107153526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2107153526},{"type":"v1","addr":"172.21.15.77:6835","nonce":2107153526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8343":{"gid":8343,"name":"a","rank":1,"incarnation":100,"state":"up:active","state_seq":7,"addr":"172.21.15.77:6834/4183807043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4183807043},{"type":"v1","addr":"172.21.15.77:6834","nonce":4183807043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:11.729 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 106 2023-11-04T01:47:11.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.728+0000 7ffb917d7640 1 -- 172.21.15.77:0/3923870509 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ffb7806ae70 msgr2=0x7ffb7806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:11.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.728+0000 7ffb917d7640 1 --2- 172.21.15.77:0/3923870509 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ffb7806ae70 0x7ffb7806d330 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c007520 tx=0x7ffb7c00b040 comp rx=0 tx=0).stop 2023-11-04T01:47:11.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.728+0000 7ffb917d7640 1 -- 172.21.15.77:0/3923870509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb8c15d100 msgr2=0x7ffb8c0b8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:11.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.728+0000 7ffb917d7640 1 --2- 172.21.15.77:0/3923870509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb8c15d100 0x7ffb8c0b8290 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7ffb80000c00 tx=0x7ffb80004730 comp rx=0 tx=0).stop 2023-11-04T01:47:11.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.728+0000 7ffb917d7640 1 -- 172.21.15.77:0/3923870509 shutdown_connections 2023-11-04T01:47:11.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.728+0000 7ffb917d7640 1 --2- 172.21.15.77:0/3923870509 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ffb7806ae70 0x7ffb7806d330 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:11.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.728+0000 7ffb917d7640 1 --2- 172.21.15.77:0/3923870509 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ffb8c15d4e0 0x7ffb8c149310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:11.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.728+0000 7ffb917d7640 1 --2- 172.21.15.77:0/3923870509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb8c15d100 0x7ffb8c0b8290 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:11.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.728+0000 7ffb917d7640 1 --2- 172.21.15.77:0/3923870509 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb8c0d3b60 0x7ffb8c0c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:11.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.728+0000 7ffb917d7640 1 -- 172.21.15.77:0/3923870509 >> 172.21.15.77:0/3923870509 conn(0x7ffb8c0d2ef0 msgr2=0x7ffb8c0cfde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:11.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.728+0000 7ffb917d7640 1 -- 172.21.15.77:0/3923870509 shutdown_connections 2023-11-04T01:47:11.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:11.728+0000 7ffb917d7640 1 -- 172.21.15.77:0/3923870509 wait complete. 2023-11-04T01:47:11.741 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:47:12.967 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-11-04T01:47:16.741 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:16.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.851+0000 7ff6236e0640 1 Processor -- start 2023-11-04T01:47:16.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.852+0000 7ff6236e0640 1 -- start start 2023-11-04T01:47:16.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.852+0000 7ff6236e0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff61c15d4e0 0x7ff61c0d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:16.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.852+0000 7ff6236e0640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff61c0d3b60 0x7ff61c0d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:16.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.852+0000 7ff6236e0640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff61c0b32b0 con 0x7ff61c15d100 2023-11-04T01:47:16.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.852+0000 7ff6236e0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff61c0cec20 con 0x7ff61c15d4e0 2023-11-04T01:47:16.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.852+0000 7ff6236e0640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff61c0cee10 con 0x7ff61c0d3b60 2023-11-04T01:47:16.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.853+0000 7ff620c7b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff61c15d4e0 0x7ff61c0d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:16.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.853+0000 7ff620c7b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff61c15d4e0 0x7ff61c0d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34052/0 (socket says 172.21.15.77:34052) 2023-11-04T01:47:16.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.853+0000 7ff620c7b640 1 -- 172.21.15.77:0/2391138816 learned_addr learned my addr 172.21.15.77:0/2391138816 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:16.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.853+0000 7ff621c7d640 1 --2- 172.21.15.77:0/2391138816 >> v2:172.21.15.122:3300/0 conn(0x7ff61c0d3b60 0x7ff61c0d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:16.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.853+0000 7ff620c7b640 1 -- 172.21.15.77:0/2391138816 >> v2:172.21.15.122:3300/0 conn(0x7ff61c0d3b60 msgr2=0x7ff61c0d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:16.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.853+0000 7ff620c7b640 1 --2- 172.21.15.77:0/2391138816 >> v2:172.21.15.122:3300/0 conn(0x7ff61c0d3b60 0x7ff61c0d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:16.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.853+0000 7ff620c7b640 1 -- 172.21.15.77:0/2391138816 >> v1:172.21.15.122:6789/0 conn(0x7ff61c15d100 legacy=0x7ff61c0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:16.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.853+0000 7ff620c7b640 1 -- 172.21.15.77:0/2391138816 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff61c0b4750 con 0x7ff61c15d4e0 2023-11-04T01:47:16.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.854+0000 7ff620c7b640 1 --2- 172.21.15.77:0/2391138816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff61c15d4e0 0x7ff61c0d14d0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7ff61c08d6a0 tx=0x7ff60c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0e1ebae3ceb2e92 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:16.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.854+0000 7ff613fff640 1 -- 172.21.15.77:0/2391138816 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60c031870 con 0x7ff61c15d4e0 2023-11-04T01:47:16.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.854+0000 7ff613fff640 1 -- 172.21.15.77:0/2391138816 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60c0319d0 con 0x7ff61c15d4e0 2023-11-04T01:47:16.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.854+0000 7ff613fff640 1 -- 172.21.15.77:0/2391138816 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60c031d60 con 0x7ff61c15d4e0 2023-11-04T01:47:16.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.854+0000 7ff6236e0640 1 -- 172.21.15.77:0/2391138816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff61c15d4e0 msgr2=0x7ff61c0d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:16.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.854+0000 7ff6236e0640 1 --2- 172.21.15.77:0/2391138816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff61c15d4e0 0x7ff61c0d14d0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7ff61c08d6a0 tx=0x7ff60c02b910 comp rx=0 tx=0).stop 2023-11-04T01:47:16.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.854+0000 7ff6236e0640 1 -- 172.21.15.77:0/2391138816 shutdown_connections 2023-11-04T01:47:16.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.854+0000 7ff6236e0640 1 --2- 172.21.15.77:0/2391138816 >> v2:172.21.15.122:3300/0 conn(0x7ff61c0d3b60 0x7ff61c0d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:16.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.854+0000 7ff6236e0640 1 --2- 172.21.15.77:0/2391138816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff61c15d4e0 0x7ff61c0d14d0 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:16.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.854+0000 7ff6236e0640 1 -- 172.21.15.77:0/2391138816 >> 172.21.15.77:0/2391138816 conn(0x7ff61c0d2ef0 msgr2=0x7ff61c0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:16.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.854+0000 7ff6236e0640 1 -- 172.21.15.77:0/2391138816 shutdown_connections 2023-11-04T01:47:16.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.855+0000 7ff6236e0640 1 -- 172.21.15.77:0/2391138816 wait complete. 2023-11-04T01:47:16.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.856+0000 7ff6236e0640 1 Processor -- start 2023-11-04T01:47:16.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.856+0000 7ff6236e0640 1 -- start start 2023-11-04T01:47:16.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.856+0000 7ff6236e0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff61c0d3b60 0x7ff61c1f2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:16.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.856+0000 7ff6236e0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff61c15d100 0x7ff61c0b7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:16.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.856+0000 7ff6236e0640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff61c15d4e0 0x7ff61c0b7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:16.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.856+0000 7ff6236e0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c1f27c0 con 0x7ff61c0d3b60 2023-11-04T01:47:16.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.856+0000 7ff6236e0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c1f5e90 con 0x7ff61c15d100 2023-11-04T01:47:16.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.856+0000 7ff6236e0640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c1f6730 con 0x7ff61c15d4e0 2023-11-04T01:47:16.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.856+0000 7ff62147c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff61c0d3b60 0x7ff61c1f2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:16.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.856+0000 7ff62147c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff61c0d3b60 0x7ff61c1f2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34054/0 (socket says 172.21.15.77:34054) 2023-11-04T01:47:16.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.856+0000 7ff62147c640 1 -- 172.21.15.77:0/1928989568 learned_addr learned my addr 172.21.15.77:0/1928989568 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:16.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.857+0000 7ff620c7b640 1 --2- 172.21.15.77:0/1928989568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff61c15d100 0x7ff61c0b7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:16.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.857+0000 7ff62147c640 1 -- 172.21.15.77:0/1928989568 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff61c15d4e0 msgr2=0x7ff61c0b7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:16.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.857+0000 7ff62147c640 1 --2- 172.21.15.77:0/1928989568 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff61c15d4e0 0x7ff61c0b7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:16.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.857+0000 7ff62147c640 1 -- 172.21.15.77:0/1928989568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff61c15d100 msgr2=0x7ff61c0b7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:16.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.857+0000 7ff62147c640 1 --2- 172.21.15.77:0/1928989568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff61c15d100 0x7ff61c0b7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:16.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.857+0000 7ff62147c640 1 -- 172.21.15.77:0/1928989568 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60c0094d0 con 0x7ff61c0d3b60 2023-11-04T01:47:16.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.857+0000 7ff62147c640 1 --2- 172.21.15.77:0/1928989568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff61c0d3b60 0x7ff61c1f2280 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7ff61800c450 tx=0x7ff61800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:16.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.857+0000 7ff611ffb640 1 -- 172.21.15.77:0/1928989568 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff618012830 con 0x7ff61c0d3b60 2023-11-04T01:47:16.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.857+0000 7ff611ffb640 1 -- 172.21.15.77:0/1928989568 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff618012990 con 0x7ff61c0d3b60 2023-11-04T01:47:16.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.857+0000 7ff6236e0640 1 -- 172.21.15.77:0/1928989568 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff61c160020 con 0x7ff61c0d3b60 2023-11-04T01:47:16.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.857+0000 7ff611ffb640 1 -- 172.21.15.77:0/1928989568 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff618012d40 con 0x7ff61c0d3b60 2023-11-04T01:47:16.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.857+0000 7ff6236e0640 1 -- 172.21.15.77:0/1928989568 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff61c1f63c0 con 0x7ff61c0d3b60 2023-11-04T01:47:16.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.858+0000 7ff6236e0640 1 -- 172.21.15.77:0/1928989568 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff61c0d0440 con 0x7ff61c0d3b60 2023-11-04T01:47:16.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.859+0000 7ff611ffb640 1 -- 172.21.15.77:0/1928989568 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff61801b410 con 0x7ff61c0d3b60 2023-11-04T01:47:16.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.859+0000 7ff611ffb640 1 --2- 172.21.15.77:0/1928989568 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff60006ae70 0x7ff60006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:16.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.859+0000 7ff611ffb640 1 -- 172.21.15.77:0/1928989568 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7952+0+0 (secure 0 0 0) 0x7ff618089ec0 con 0x7ff61c0d3b60 2023-11-04T01:47:16.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.860+0000 7ff620c7b640 1 --2- 172.21.15.77:0/1928989568 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff60006ae70 0x7ff60006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:16.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.860+0000 7ff620c7b640 1 --2- 172.21.15.77:0/1928989568 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff60006ae70 0x7ff60006d330 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ff60c036000 tx=0x7ff60c03c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:16.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:16.864+0000 7ff611ffb640 1 -- 172.21.15.77:0/1928989568 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff6180546b0 con 0x7ff61c0d3b60 2023-11-04T01:47:17.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:17.063+0000 7ff6236e0640 1 -- 172.21.15.77:0/1928989568 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff61c160300 con 0x7ff61c0d3b60 2023-11-04T01:47:17.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:17.063+0000 7ff611ffb640 1 -- 172.21.15.77:0/1928989568 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4942 (secure 0 0 0) 0x7ff618016020 con 0x7ff61c0d3b60 2023-11-04T01:47:17.065 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:47:17.066 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":106,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7033,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2238841748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2238841748},{"type":"v1","addr":"172.21.15.122:6836","nonce":2238841748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:47:05.168262+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8139,"mds_1":8343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8139":{"gid":8139,"name":"c","rank":0,"incarnation":97,"state":"up:active","state_seq":16,"addr":"172.21.15.77:6835/2107153526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2107153526},{"type":"v1","addr":"172.21.15.77:6835","nonce":2107153526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8343":{"gid":8343,"name":"a","rank":1,"incarnation":100,"state":"up:active","state_seq":7,"addr":"172.21.15.77:6834/4183807043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4183807043},{"type":"v1","addr":"172.21.15.77:6834","nonce":4183807043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:17.067 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 106 2023-11-04T01:47:17.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:17.065+0000 7ff6236e0640 1 -- 172.21.15.77:0/1928989568 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff60006ae70 msgr2=0x7ff60006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:17.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:17.065+0000 7ff6236e0640 1 --2- 172.21.15.77:0/1928989568 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff60006ae70 0x7ff60006d330 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ff60c036000 tx=0x7ff60c03c040 comp rx=0 tx=0).stop 2023-11-04T01:47:17.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:17.065+0000 7ff6236e0640 1 -- 172.21.15.77:0/1928989568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff61c0d3b60 msgr2=0x7ff61c1f2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:17.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:17.065+0000 7ff6236e0640 1 --2- 172.21.15.77:0/1928989568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff61c0d3b60 0x7ff61c1f2280 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7ff61800c450 tx=0x7ff61800c910 comp rx=0 tx=0).stop 2023-11-04T01:47:17.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:17.065+0000 7ff6236e0640 1 -- 172.21.15.77:0/1928989568 shutdown_connections 2023-11-04T01:47:17.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:17.065+0000 7ff6236e0640 1 --2- 172.21.15.77:0/1928989568 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff60006ae70 0x7ff60006d330 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:17.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:17.065+0000 7ff6236e0640 1 --2- 172.21.15.77:0/1928989568 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff61c15d4e0 0x7ff61c0b7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:17.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:17.065+0000 7ff6236e0640 1 --2- 172.21.15.77:0/1928989568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff61c15d100 0x7ff61c0b7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:17.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:17.065+0000 7ff6236e0640 1 --2- 172.21.15.77:0/1928989568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff61c0d3b60 0x7ff61c1f2280 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:17.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:17.065+0000 7ff6236e0640 1 -- 172.21.15.77:0/1928989568 >> 172.21.15.77:0/1928989568 conn(0x7ff61c0d2ef0 msgr2=0x7ff61c06bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:17.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:17.065+0000 7ff6236e0640 1 -- 172.21.15.77:0/1928989568 shutdown_connections 2023-11-04T01:47:17.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:17.065+0000 7ff6236e0640 1 -- 172.21.15.77:0/1928989568 wait complete. 2023-11-04T01:47:17.077 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:47:19.580 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~7s 2023-11-04T01:47:22.079 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:22.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.189+0000 7f784bb90640 1 Processor -- start 2023-11-04T01:47:22.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.189+0000 7f784bb90640 1 -- start start 2023-11-04T01:47:22.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.190+0000 7f784bb90640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f78440adf90 0x7f78440ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:22.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.190+0000 7f784bb90640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7844070000 0x7f784406b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:22.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.190+0000 7f784bb90640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78440ae370 con 0x7f78440cab50 2023-11-04T01:47:22.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.190+0000 7f784bb90640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f784416d860 con 0x7f7844070000 2023-11-04T01:47:22.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.190+0000 7f784bb90640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78440cafb0 con 0x7f78440adf90 2023-11-04T01:47:22.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.190+0000 7f784a12d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7844070000 0x7f784406b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:22.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.190+0000 7f784a12d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7844070000 0x7f784406b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49154/0 (socket says 172.21.15.77:49154) 2023-11-04T01:47:22.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.190+0000 7f784a12d640 1 -- 172.21.15.77:0/3636349260 learned_addr learned my addr 172.21.15.77:0/3636349260 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:22.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.190+0000 7f784892a640 1 -- 172.21.15.77:0/3636349260 <== mon.1 v1:172.21.15.122:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3407754315 0 0) 0x7f7840001110 con 0x7f78440cab50 2023-11-04T01:47:22.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.190+0000 7f784992c640 1 --2- 172.21.15.77:0/3636349260 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f78440adf90 0x7f78440ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:22.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.193+0000 7f784892a640 1 -- 172.21.15.77:0/3636349260 --> v1:172.21.15.122:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7830007930 con 0x7f78440cab50 2023-11-04T01:47:22.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.194+0000 7f784a12d640 1 -- 172.21.15.77:0/3636349260 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f78440adf90 msgr2=0x7f78440ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:22.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.194+0000 7f784a12d640 1 --2- 172.21.15.77:0/3636349260 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f78440adf90 0x7f78440ce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:22.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.194+0000 7f784a12d640 1 -- 172.21.15.77:0/3636349260 >> v1:172.21.15.122:6789/0 conn(0x7f78440cab50 legacy=0x7f784406f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:22.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.194+0000 7f784a12d640 1 -- 172.21.15.77:0/3636349260 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78440cb250 con 0x7f7844070000 2023-11-04T01:47:22.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.194+0000 7f784a12d640 1 --2- 172.21.15.77:0/3636349260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7844070000 0x7f784406b950 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f783c008ec0 tx=0x7f783c02c280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=620bbd1259268a04 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:22.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.194+0000 7f784892a640 1 -- 172.21.15.77:0/3636349260 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783c034640 con 0x7f7844070000 2023-11-04T01:47:22.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.195+0000 7f784892a640 1 -- 172.21.15.77:0/3636349260 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783c0347a0 con 0x7f7844070000 2023-11-04T01:47:22.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.195+0000 7f784892a640 1 -- 172.21.15.77:0/3636349260 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783c034b30 con 0x7f7844070000 2023-11-04T01:47:22.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.195+0000 7f784bb90640 1 -- 172.21.15.77:0/3636349260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7844070000 msgr2=0x7f784406b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:22.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.195+0000 7f784bb90640 1 --2- 172.21.15.77:0/3636349260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7844070000 0x7f784406b950 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f783c008ec0 tx=0x7f783c02c280 comp rx=0 tx=0).stop 2023-11-04T01:47:22.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.195+0000 7f784bb90640 1 -- 172.21.15.77:0/3636349260 shutdown_connections 2023-11-04T01:47:22.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.195+0000 7f784bb90640 1 --2- 172.21.15.77:0/3636349260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7844070000 0x7f784406b950 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:22.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.195+0000 7f784bb90640 1 --2- 172.21.15.77:0/3636349260 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f78440adf90 0x7f78440ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:22.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.195+0000 7f784bb90640 1 -- 172.21.15.77:0/3636349260 >> 172.21.15.77:0/3636349260 conn(0x7f78440ceab0 msgr2=0x7f78440ceec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:22.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.195+0000 7f784bb90640 1 -- 172.21.15.77:0/3636349260 shutdown_connections 2023-11-04T01:47:22.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.195+0000 7f784bb90640 1 -- 172.21.15.77:0/3636349260 wait complete. 2023-11-04T01:47:22.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.196+0000 7f784bb90640 1 Processor -- start 2023-11-04T01:47:22.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.196+0000 7f784bb90640 1 -- start start 2023-11-04T01:47:22.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.197+0000 7f784bb90640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7844070000 0x7f78440c5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:22.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.197+0000 7f784bb90640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78440adf90 0x7f78440c2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:22.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.197+0000 7f784bb90640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f78440cab50 0x7f784415eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:22.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.197+0000 7f784bb90640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78440b1840 con 0x7f78440adf90 2023-11-04T01:47:22.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.197+0000 7f784bb90640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78440c5690 con 0x7f7844070000 2023-11-04T01:47:22.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.197+0000 7f784bb90640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78440c3450 con 0x7f78440cab50 2023-11-04T01:47:22.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.197+0000 7f784912b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78440adf90 0x7f78440c2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:22.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.197+0000 7f784912b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78440adf90 0x7f78440c2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49158/0 (socket says 172.21.15.77:49158) 2023-11-04T01:47:22.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.197+0000 7f784912b640 1 -- 172.21.15.77:0/1402009148 learned_addr learned my addr 172.21.15.77:0/1402009148 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:22.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.197+0000 7f784992c640 1 --2- 172.21.15.77:0/1402009148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7844070000 0x7f78440c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:22.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.197+0000 7f784a12d640 1 --2- 172.21.15.77:0/1402009148 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f78440cab50 0x7f784415eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:22.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.197+0000 7f784912b640 1 -- 172.21.15.77:0/1402009148 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f78440cab50 msgr2=0x7f784415eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:22.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.197+0000 7f784912b640 1 --2- 172.21.15.77:0/1402009148 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f78440cab50 0x7f784415eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:22.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.198+0000 7f784912b640 1 -- 172.21.15.77:0/1402009148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7844070000 msgr2=0x7f78440c5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:22.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.198+0000 7f784912b640 1 --2- 172.21.15.77:0/1402009148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7844070000 0x7f78440c5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:22.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.198+0000 7f784912b640 1 -- 172.21.15.77:0/1402009148 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f783c008b20 con 0x7f78440adf90 2023-11-04T01:47:22.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.198+0000 7f784912b640 1 --2- 172.21.15.77:0/1402009148 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78440adf90 0x7f78440c2f10 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f784000c3e0 tx=0x7f784000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:22.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.198+0000 7f783a7fc640 1 -- 172.21.15.77:0/1402009148 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78400052d0 con 0x7f78440adf90 2023-11-04T01:47:22.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.198+0000 7f783a7fc640 1 -- 172.21.15.77:0/1402009148 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7840005450 con 0x7f78440adf90 2023-11-04T01:47:22.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.198+0000 7f784bb90640 1 -- 172.21.15.77:0/1402009148 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f784415f3f0 con 0x7f78440adf90 2023-11-04T01:47:22.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.198+0000 7f783a7fc640 1 -- 172.21.15.77:0/1402009148 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7840003830 con 0x7f78440adf90 2023-11-04T01:47:22.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.198+0000 7f784bb90640 1 -- 172.21.15.77:0/1402009148 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78440c3960 con 0x7f78440adf90 2023-11-04T01:47:22.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.199+0000 7f784bb90640 1 -- 172.21.15.77:0/1402009148 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78440b1980 con 0x7f78440adf90 2023-11-04T01:47:22.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.199+0000 7f783a7fc640 1 -- 172.21.15.77:0/1402009148 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7840003a50 con 0x7f78440adf90 2023-11-04T01:47:22.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.200+0000 7f783a7fc640 1 --2- 172.21.15.77:0/1402009148 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f782806ae70 0x7f782806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:22.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.200+0000 7f783a7fc640 1 -- 172.21.15.77:0/1402009148 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7952+0+0 (secure 0 0 0) 0x7f7840089320 con 0x7f78440adf90 2023-11-04T01:47:22.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.200+0000 7f784992c640 1 --2- 172.21.15.77:0/1402009148 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f782806ae70 0x7f782806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:22.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.201+0000 7f784992c640 1 --2- 172.21.15.77:0/1402009148 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f782806ae70 0x7f782806d330 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f7834008970 tx=0x7f7834008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:22.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.204+0000 7f783a7fc640 1 -- 172.21.15.77:0/1402009148 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f78440b1980 con 0x7f78440adf90 2023-11-04T01:47:22.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.407+0000 7f784bb90640 1 -- 172.21.15.77:0/1402009148 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78440ae370 con 0x7f78440adf90 2023-11-04T01:47:22.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.407+0000 7f783a7fc640 1 -- 172.21.15.77:0/1402009148 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) v1 ==== 95+0+4990 (secure 0 0 0) 0x7f78440ae370 con 0x7f78440adf90 2023-11-04T01:47:22.409 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:47:22.409 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":107,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7033,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2238841748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2238841748},{"type":"v1","addr":"172.21.15.122:6836","nonce":2238841748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:47:20.626743+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8139,"mds_1":8343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8139":{"gid":8139,"name":"c","rank":0,"incarnation":97,"state":"up:active","state_seq":16,"addr":"172.21.15.77:6835/2107153526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2107153526},{"type":"v1","addr":"172.21.15.77:6835","nonce":2107153526}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:47:20.626743+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8343":{"gid":8343,"name":"a","rank":1,"incarnation":100,"state":"up:active","state_seq":7,"addr":"172.21.15.77:6834/4183807043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4183807043},{"type":"v1","addr":"172.21.15.77:6834","nonce":4183807043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:22.409 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 107 2023-11-04T01:47:22.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.409+0000 7f784bb90640 1 -- 172.21.15.77:0/1402009148 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f782806ae70 msgr2=0x7f782806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:22.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.409+0000 7f784bb90640 1 --2- 172.21.15.77:0/1402009148 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f782806ae70 0x7f782806d330 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f7834008970 tx=0x7f7834008040 comp rx=0 tx=0).stop 2023-11-04T01:47:22.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.409+0000 7f784bb90640 1 -- 172.21.15.77:0/1402009148 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78440adf90 msgr2=0x7f78440c2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:22.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.409+0000 7f784bb90640 1 --2- 172.21.15.77:0/1402009148 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78440adf90 0x7f78440c2f10 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f784000c3e0 tx=0x7f784000c8a0 comp rx=0 tx=0).stop 2023-11-04T01:47:22.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.409+0000 7f784bb90640 1 -- 172.21.15.77:0/1402009148 shutdown_connections 2023-11-04T01:47:22.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.409+0000 7f784bb90640 1 --2- 172.21.15.77:0/1402009148 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f782806ae70 0x7f782806d330 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:22.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.409+0000 7f784bb90640 1 --2- 172.21.15.77:0/1402009148 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f78440cab50 0x7f784415eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:22.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.409+0000 7f784bb90640 1 --2- 172.21.15.77:0/1402009148 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78440adf90 0x7f78440c2f10 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:22.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.409+0000 7f784bb90640 1 --2- 172.21.15.77:0/1402009148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7844070000 0x7f78440c5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:22.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.409+0000 7f784bb90640 1 -- 172.21.15.77:0/1402009148 >> 172.21.15.77:0/1402009148 conn(0x7f78440ceab0 msgr2=0x7f78440ae510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:22.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.409+0000 7f784bb90640 1 -- 172.21.15.77:0/1402009148 shutdown_connections 2023-11-04T01:47:22.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.409+0000 7f784bb90640 1 -- 172.21.15.77:0/1402009148 wait complete. 2023-11-04T01:47:22.422 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-11-04T01:47:22.422 DEBUG:teuthology.orchestra.run.smithi077:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:47:22.447 INFO:teuthology.orchestra.run.smithi077.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:47:22.448 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:47:22.448 DEBUG:teuthology.orchestra.run.smithi077:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:47:22.517 INFO:teuthology.orchestra.run.smithi077.stdout:1699062426.152429.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i c', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:47:22.519 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062426.152429.core'] 2023-11-04T01:47:22.519 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062426.152429.core, deleting it 2023-11-04T01:47:22.520 DEBUG:teuthology.orchestra.run.smithi077:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062426.152429.core 2023-11-04T01:47:22.589 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:22.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.727+0000 7fa9860e5640 1 Processor -- start 2023-11-04T01:47:22.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.727+0000 7fa9860e5640 1 -- start start 2023-11-04T01:47:22.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.728+0000 7fa9860e5640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa9800ade00 0x7fa9800b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:22.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.728+0000 7fa9860e5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa98006c5f0 0x7fa9800cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:22.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.728+0000 7fa9860e5640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa98006cc90 con 0x7fa98006d9c0 2023-11-04T01:47:22.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.728+0000 7fa9860e5640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9800b0e60 con 0x7fa98006c5f0 2023-11-04T01:47:22.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.728+0000 7fa9860e5640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa98006cee0 con 0x7fa9800ade00 2023-11-04T01:47:22.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.728+0000 7fa97ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa98006c5f0 0x7fa9800cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:22.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.728+0000 7fa97ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa98006c5f0 0x7fa9800cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49166/0 (socket says 172.21.15.77:49166) 2023-11-04T01:47:22.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.728+0000 7fa97ffff640 1 -- 172.21.15.77:0/1327802062 learned_addr learned my addr 172.21.15.77:0/1327802062 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:22.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.728+0000 7fa97f7fe640 1 --2- 172.21.15.77:0/1327802062 >> v2:172.21.15.122:3300/0 conn(0x7fa9800ade00 0x7fa9800b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:22.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.728+0000 7fa97ffff640 1 -- 172.21.15.77:0/1327802062 >> v2:172.21.15.122:3300/0 conn(0x7fa9800ade00 msgr2=0x7fa9800b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:22.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.728+0000 7fa97ffff640 1 --2- 172.21.15.77:0/1327802062 >> v2:172.21.15.122:3300/0 conn(0x7fa9800ade00 0x7fa9800b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:22.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.728+0000 7fa97ffff640 1 -- 172.21.15.77:0/1327802062 >> v1:172.21.15.122:6789/0 conn(0x7fa98006d9c0 legacy=0x7fa9800710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:22.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.728+0000 7fa97ffff640 1 -- 172.21.15.77:0/1327802062 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98006d1c0 con 0x7fa98006c5f0 2023-11-04T01:47:22.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.728+0000 7fa97f7fe640 1 --2- 172.21.15.77:0/1327802062 >> v2:172.21.15.122:3300/0 conn(0x7fa9800ade00 0x7fa9800b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:22.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.729+0000 7fa97ffff640 1 --2- 172.21.15.77:0/1327802062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa98006c5f0 0x7fa9800cc680 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fa9800cb430 tx=0x7fa97802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc4b297da3f8eae1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:22.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.729+0000 7fa97e7fc640 1 -- 172.21.15.77:0/1327802062 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa978031750 con 0x7fa98006c5f0 2023-11-04T01:47:22.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.729+0000 7fa97e7fc640 1 -- 172.21.15.77:0/1327802062 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9780318b0 con 0x7fa98006c5f0 2023-11-04T01:47:22.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.729+0000 7fa97e7fc640 1 -- 172.21.15.77:0/1327802062 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa978031c40 con 0x7fa98006c5f0 2023-11-04T01:47:22.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.730+0000 7fa9860e5640 1 -- 172.21.15.77:0/1327802062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa98006c5f0 msgr2=0x7fa9800cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:22.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.730+0000 7fa9860e5640 1 --2- 172.21.15.77:0/1327802062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa98006c5f0 0x7fa9800cc680 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fa9800cb430 tx=0x7fa97802b7f0 comp rx=0 tx=0).stop 2023-11-04T01:47:22.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.730+0000 7fa9860e5640 1 -- 172.21.15.77:0/1327802062 shutdown_connections 2023-11-04T01:47:22.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.730+0000 7fa9860e5640 1 --2- 172.21.15.77:0/1327802062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa98006c5f0 0x7fa9800cc680 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:22.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.730+0000 7fa9860e5640 1 --2- 172.21.15.77:0/1327802062 >> v2:172.21.15.122:3300/0 conn(0x7fa9800ade00 0x7fa9800b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:22.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.730+0000 7fa9860e5640 1 -- 172.21.15.77:0/1327802062 >> 172.21.15.77:0/1327802062 conn(0x7fa9800cb530 msgr2=0x7fa9800cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:22.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.730+0000 7fa9860e5640 1 -- 172.21.15.77:0/1327802062 shutdown_connections 2023-11-04T01:47:22.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.730+0000 7fa9860e5640 1 -- 172.21.15.77:0/1327802062 wait complete. 2023-11-04T01:47:22.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.731+0000 7fa9860e5640 1 Processor -- start 2023-11-04T01:47:22.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.731+0000 7fa9860e5640 1 -- start start 2023-11-04T01:47:22.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.732+0000 7fa9860e5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa98006c5f0 0x7fa9800c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:22.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.732+0000 7fa9860e5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa98006d9c0 0x7fa9801f4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:22.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.732+0000 7fa9860e5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9800ade00 0x7fa98014efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:22.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.732+0000 7fa9860e5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9801f4940 con 0x7fa9800ade00 2023-11-04T01:47:22.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.732+0000 7fa9860e5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9800c8500 con 0x7fa98006c5f0 2023-11-04T01:47:22.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.732+0000 7fa9860e5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98014f500 con 0x7fa98006d9c0 2023-11-04T01:47:22.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.732+0000 7fa97ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9800ade00 0x7fa98014efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:22.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.732+0000 7fa97ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9800ade00 0x7fa98014efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49178/0 (socket says 172.21.15.77:49178) 2023-11-04T01:47:22.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.732+0000 7fa97ffff640 1 -- 172.21.15.77:0/3295656523 learned_addr learned my addr 172.21.15.77:0/3295656523 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:22.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.732+0000 7fa97f7fe640 1 --2- 172.21.15.77:0/3295656523 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa98006c5f0 0x7fa9800c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:22.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.732+0000 7fa97ffff640 1 -- 172.21.15.77:0/3295656523 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa98006d9c0 msgr2=0x7fa9801f4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:22.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.732+0000 7fa97ffff640 1 --2- 172.21.15.77:0/3295656523 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa98006d9c0 0x7fa9801f4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:22.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.732+0000 7fa97ffff640 1 -- 172.21.15.77:0/3295656523 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa98006c5f0 msgr2=0x7fa9800c6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:22.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.732+0000 7fa97ffff640 1 --2- 172.21.15.77:0/3295656523 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa98006c5f0 0x7fa9800c6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:22.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.732+0000 7fa97ffff640 1 -- 172.21.15.77:0/3295656523 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9780094d0 con 0x7fa9800ade00 2023-11-04T01:47:22.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.732+0000 7fa97ffff640 1 --2- 172.21.15.77:0/3295656523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9800ade00 0x7fa98014efc0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fa97802b830 tx=0x7fa9780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:22.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.732+0000 7fa967fff640 1 -- 172.21.15.77:0/3295656523 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa978033c80 con 0x7fa9800ade00 2023-11-04T01:47:22.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.733+0000 7fa967fff640 1 -- 172.21.15.77:0/3295656523 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa978033de0 con 0x7fa9800ade00 2023-11-04T01:47:22.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.733+0000 7fa9860e5640 1 -- 172.21.15.77:0/3295656523 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9800c71b0 con 0x7fa9800ade00 2023-11-04T01:47:22.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.733+0000 7fa967fff640 1 -- 172.21.15.77:0/3295656523 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97803c640 con 0x7fa9800ade00 2023-11-04T01:47:22.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.733+0000 7fa9860e5640 1 -- 172.21.15.77:0/3295656523 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9800c7770 con 0x7fa9800ade00 2023-11-04T01:47:22.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.733+0000 7fa9860e5640 1 -- 172.21.15.77:0/3295656523 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9800cbb40 con 0x7fa9800ade00 2023-11-04T01:47:22.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.734+0000 7fa967fff640 1 -- 172.21.15.77:0/3295656523 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa97803a040 con 0x7fa9800ade00 2023-11-04T01:47:22.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.734+0000 7fa967fff640 1 --2- 172.21.15.77:0/3295656523 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa96c06ae70 0x7fa96c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:22.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.734+0000 7fa967fff640 1 -- 172.21.15.77:0/3295656523 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7952+0+0 (secure 0 0 0) 0x7fa9780abc40 con 0x7fa9800ade00 2023-11-04T01:47:22.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.735+0000 7fa97f7fe640 1 --2- 172.21.15.77:0/3295656523 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa96c06ae70 0x7fa96c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:22.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.735+0000 7fa97f7fe640 1 --2- 172.21.15.77:0/3295656523 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa96c06ae70 0x7fa96c06d330 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fa970008f80 tx=0x7fa9700084d0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:22.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.738+0000 7fa967fff640 1 -- 172.21.15.77:0/3295656523 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa9780763b0 con 0x7fa9800ade00 2023-11-04T01:47:22.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.940+0000 7fa9860e5640 1 -- 172.21.15.77:0/3295656523 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9800684b0 con 0x7fa9800ade00 2023-11-04T01:47:22.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.941+0000 7fa967fff640 1 -- 172.21.15.77:0/3295656523 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) v1 ==== 95+0+4990 (secure 0 0 0) 0x7fa9780799d0 con 0x7fa9800ade00 2023-11-04T01:47:22.943 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:47:22.943 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":107,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7033,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6836/2238841748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2238841748},{"type":"v1","addr":"172.21.15.122:6836","nonce":2238841748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:47:20.626743+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":8139,"mds_1":8343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8139":{"gid":8139,"name":"c","rank":0,"incarnation":97,"state":"up:active","state_seq":16,"addr":"172.21.15.77:6835/2107153526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2107153526},{"type":"v1","addr":"172.21.15.77:6835","nonce":2107153526}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:47:20.626743+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8343":{"gid":8343,"name":"a","rank":1,"incarnation":100,"state":"up:active","state_seq":7,"addr":"172.21.15.77:6834/4183807043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4183807043},{"type":"v1","addr":"172.21.15.77:6834","nonce":4183807043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:22.944 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 107 2023-11-04T01:47:22.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.943+0000 7fa9860e5640 1 -- 172.21.15.77:0/3295656523 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa96c06ae70 msgr2=0x7fa96c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:22.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.943+0000 7fa9860e5640 1 --2- 172.21.15.77:0/3295656523 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa96c06ae70 0x7fa96c06d330 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fa970008f80 tx=0x7fa9700084d0 comp rx=0 tx=0).stop 2023-11-04T01:47:22.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.943+0000 7fa9860e5640 1 -- 172.21.15.77:0/3295656523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9800ade00 msgr2=0x7fa98014efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:22.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.943+0000 7fa9860e5640 1 --2- 172.21.15.77:0/3295656523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9800ade00 0x7fa98014efc0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fa97802b830 tx=0x7fa9780046c0 comp rx=0 tx=0).stop 2023-11-04T01:47:22.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.943+0000 7fa9860e5640 1 -- 172.21.15.77:0/3295656523 shutdown_connections 2023-11-04T01:47:22.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.943+0000 7fa9860e5640 1 --2- 172.21.15.77:0/3295656523 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa96c06ae70 0x7fa96c06d330 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:22.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.943+0000 7fa9860e5640 1 --2- 172.21.15.77:0/3295656523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9800ade00 0x7fa98014efc0 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:22.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.943+0000 7fa9860e5640 1 --2- 172.21.15.77:0/3295656523 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa98006d9c0 0x7fa9801f4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:22.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.943+0000 7fa9860e5640 1 --2- 172.21.15.77:0/3295656523 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa98006c5f0 0x7fa9800c6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:22.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.943+0000 7fa9860e5640 1 -- 172.21.15.77:0/3295656523 >> 172.21.15.77:0/3295656523 conn(0x7fa9800cb530 msgr2=0x7fa9800af9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:22.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.943+0000 7fa9860e5640 1 -- 172.21.15.77:0/3295656523 shutdown_connections 2023-11-04T01:47:22.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:22.943+0000 7fa9860e5640 1 -- 172.21.15.77:0/3295656523 wait complete. 2023-11-04T01:47:22.955 INFO:tasks.ceph.mds.a:Sent signal 9 2023-11-04T01:47:22.956 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:47:22.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:22.956 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 down 2023-11-04T01:47:22.984 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:47:23.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.127+0000 7fb74b99e640 1 Processor -- start 2023-11-04T01:47:23.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.127+0000 7fb74b99e640 1 -- start start 2023-11-04T01:47:23.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.128+0000 7fb74b99e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb744070700 0x7fb744164b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:23.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.128+0000 7fb74b99e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb744071500 con 0x7fb7440b0c40 2023-11-04T01:47:23.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.128+0000 7fb74b99e640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb74415dae0 con 0x7fb744159e40 2023-11-04T01:47:23.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.128+0000 7fb74b99e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb744070c60 con 0x7fb744070700 2023-11-04T01:47:23.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.128+0000 7fb748f39640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb7440b0c40 0x7fb74406fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:56480/0 (socket says 172.21.15.77:56480) 2023-11-04T01:47:23.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.128+0000 7fb748f39640 1 -- 172.21.15.77:0/1839110977 learned_addr learned my addr 172.21.15.77:0/1839110977 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:47:23.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.128+0000 7fb73bfff640 1 -- 172.21.15.77:0/1839110977 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1819921528 0 0) 0x7fb744071500 con 0x7fb7440b0c40 2023-11-04T01:47:23.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.128+0000 7fb749f3b640 1 --2- 172.21.15.77:0/1839110977 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb744070700 0x7fb744164b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:23.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.128+0000 7fb73bfff640 1 -- 172.21.15.77:0/1839110977 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb730003520 con 0x7fb7440b0c40 2023-11-04T01:47:23.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.129+0000 7fb73bfff640 1 -- 172.21.15.77:0/1839110977 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3693944050 0 0) 0x7fb730003520 con 0x7fb7440b0c40 2023-11-04T01:47:23.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.129+0000 7fb73bfff640 1 -- 172.21.15.77:0/1839110977 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb744070700 msgr2=0x7fb744164b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:23.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.129+0000 7fb73bfff640 1 --2- 172.21.15.77:0/1839110977 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb744070700 0x7fb744164b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:23.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.129+0000 7fb73bfff640 1 -- 172.21.15.77:0/1839110977 >> v1:172.21.15.122:6789/0 conn(0x7fb744159e40 legacy=0x7fb7440b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:23.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.129+0000 7fb73bfff640 1 -- 172.21.15.77:0/1839110977 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb744070f40 con 0x7fb7440b0c40 2023-11-04T01:47:23.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.129+0000 7fb73bfff640 1 -- 172.21.15.77:0/1839110977 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7fb734001670 con 0x7fb7440b0c40 2023-11-04T01:47:23.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.129+0000 7fb73bfff640 1 -- 172.21.15.77:0/1839110977 >> v1:172.21.15.77:6789/0 conn(0x7fb7440b0c40 legacy=0x7fb74406fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:23.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.129+0000 7fb73bfff640 1 --2- 172.21.15.77:0/1839110977 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb7300039a0 0x7fb730003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:23.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.129+0000 7fb73bfff640 1 --2- 172.21.15.77:0/1839110977 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb744070700 0x7fb7300047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:23.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.129+0000 7fb73bfff640 1 --2- 172.21.15.77:0/1839110977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb730004d00 0x7fb730005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:23.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.129+0000 7fb73bfff640 1 -- 172.21.15.77:0/1839110977 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb744070c60 con 0x7fb730004d00 2023-11-04T01:47:23.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.129+0000 7fb73bfff640 1 -- 172.21.15.77:0/1839110977 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73000ba30 con 0x7fb7300039a0 2023-11-04T01:47:23.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.129+0000 7fb73bfff640 1 -- 172.21.15.77:0/1839110977 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb73000bbf0 con 0x7fb744070700 2023-11-04T01:47:23.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.129+0000 7fb749f3b640 1 --2- 172.21.15.77:0/1839110977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb730004d00 0x7fb730005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:23.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.129+0000 7fb74973a640 1 --2- 172.21.15.77:0/1839110977 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb7300039a0 0x7fb730003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:23.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.129+0000 7fb748f39640 1 --2- 172.21.15.77:0/1839110977 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb744070700 0x7fb7300047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:23.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.129+0000 7fb749f3b640 1 -- 172.21.15.77:0/1839110977 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb744070700 msgr2=0x7fb7300047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:23.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.129+0000 7fb749f3b640 1 --2- 172.21.15.77:0/1839110977 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb744070700 0x7fb7300047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:23.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.129+0000 7fb749f3b640 1 -- 172.21.15.77:0/1839110977 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb7300039a0 msgr2=0x7fb730003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:23.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.129+0000 7fb749f3b640 1 --2- 172.21.15.77:0/1839110977 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb7300039a0 0x7fb730003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:23.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.129+0000 7fb749f3b640 1 -- 172.21.15.77:0/1839110977 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb730003520 con 0x7fb730004d00 2023-11-04T01:47:23.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.129+0000 7fb748f39640 1 --2- 172.21.15.77:0/1839110977 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb744070700 0x7fb7300047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:23.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.130+0000 7fb749f3b640 1 --2- 172.21.15.77:0/1839110977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb730004d00 0x7fb730005180 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fb73c009fc0 tx=0x7fb7300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5514b78731e8c18a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:23.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.130+0000 7fb73bfff640 1 -- 172.21.15.77:0/1839110977 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c02cc20 con 0x7fb730004d00 2023-11-04T01:47:23.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.130+0000 7fb73bfff640 1 -- 172.21.15.77:0/1839110977 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73c00f040 con 0x7fb730004d00 2023-11-04T01:47:23.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.130+0000 7fb73bfff640 1 -- 172.21.15.77:0/1839110977 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c034440 con 0x7fb730004d00 2023-11-04T01:47:23.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.130+0000 7fb74b99e640 1 -- 172.21.15.77:0/1839110977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb730004d00 msgr2=0x7fb730005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:23.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.130+0000 7fb74b99e640 1 --2- 172.21.15.77:0/1839110977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb730004d00 0x7fb730005180 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fb73c009fc0 tx=0x7fb7300057f0 comp rx=0 tx=0).stop 2023-11-04T01:47:23.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.130+0000 7fb749f3b640 1 -- 172.21.15.77:0/1839110977 reap_dead start 2023-11-04T01:47:23.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.130+0000 7fb74b99e640 1 -- 172.21.15.77:0/1839110977 shutdown_connections 2023-11-04T01:47:23.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.130+0000 7fb74b99e640 1 -- 172.21.15.77:0/1839110977 >> 172.21.15.77:0/1839110977 conn(0x7fb7440cb530 msgr2=0x7fb7440cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:23.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.131+0000 7fb74b99e640 1 -- 172.21.15.77:0/1839110977 shutdown_connections 2023-11-04T01:47:23.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.131+0000 7fb74b99e640 1 -- 172.21.15.77:0/1839110977 wait complete. 2023-11-04T01:47:23.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.132+0000 7fb74b99e640 1 Processor -- start 2023-11-04T01:47:23.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.132+0000 7fb74b99e640 1 -- start start 2023-11-04T01:47:23.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.132+0000 7fb74b99e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb730004d00 0x7fb744148870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:23.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.132+0000 7fb74b99e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb7440c87d0 0x7fb7440ae5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:23.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.132+0000 7fb74b99e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7440c8c50 0x7fb7440aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:23.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.132+0000 7fb74b99e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7440c59b0 con 0x7fb730004d00 2023-11-04T01:47:23.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.132+0000 7fb74b99e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74415b180 con 0x7fb7440c87d0 2023-11-04T01:47:23.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.132+0000 7fb74b99e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb74415a600 con 0x7fb7440c8c50 2023-11-04T01:47:23.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.132+0000 7fb74973a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb730004d00 0x7fb744148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:23.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.133+0000 7fb74973a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb730004d00 0x7fb744148870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49200/0 (socket says 172.21.15.77:49200) 2023-11-04T01:47:23.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.133+0000 7fb74973a640 1 -- 172.21.15.77:0/2231815525 learned_addr learned my addr 172.21.15.77:0/2231815525 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:23.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.133+0000 7fb74973a640 1 -- 172.21.15.77:0/2231815525 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7440c8c50 msgr2=0x7fb7440aeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:23.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.133+0000 7fb74973a640 1 --2- 172.21.15.77:0/2231815525 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7440c8c50 0x7fb7440aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:23.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.133+0000 7fb74973a640 1 -- 172.21.15.77:0/2231815525 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb7440c87d0 msgr2=0x7fb7440ae5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:23.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.133+0000 7fb74973a640 1 --2- 172.21.15.77:0/2231815525 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb7440c87d0 0x7fb7440ae5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:23.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.133+0000 7fb74973a640 1 -- 172.21.15.77:0/2231815525 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb74415a8e0 con 0x7fb730004d00 2023-11-04T01:47:23.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.133+0000 7fb74973a640 1 --2- 172.21.15.77:0/2231815525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb730004d00 0x7fb744148870 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fb74000f7c0 tx=0x7fb74000fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:23.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.133+0000 7fb739ffb640 1 -- 172.21.15.77:0/2231815525 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74000fe70 con 0x7fb730004d00 2023-11-04T01:47:23.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.133+0000 7fb739ffb640 1 -- 172.21.15.77:0/2231815525 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7400052e0 con 0x7fb730004d00 2023-11-04T01:47:23.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.133+0000 7fb74b99e640 1 -- 172.21.15.77:0/2231815525 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb74415abc0 con 0x7fb730004d00 2023-11-04T01:47:23.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.133+0000 7fb739ffb640 1 -- 172.21.15.77:0/2231815525 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74000d8f0 con 0x7fb730004d00 2023-11-04T01:47:23.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.133+0000 7fb74b99e640 1 -- 172.21.15.77:0/2231815525 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb74415a220 con 0x7fb730004d00 2023-11-04T01:47:23.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.134+0000 7fb74b99e640 1 -- 172.21.15.77:0/2231815525 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb74415b3e0 con 0x7fb730004d00 2023-11-04T01:47:23.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.135+0000 7fb739ffb640 1 -- 172.21.15.77:0/2231815525 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb74000da50 con 0x7fb730004d00 2023-11-04T01:47:23.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.135+0000 7fb739ffb640 1 --2- 172.21.15.77:0/2231815525 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb72806aea0 0x7fb72806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:23.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.135+0000 7fb739ffb640 1 -- 172.21.15.77:0/2231815525 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7952+0+0 (secure 0 0 0) 0x7fb740089de0 con 0x7fb730004d00 2023-11-04T01:47:23.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.135+0000 7fb748f39640 1 --2- 172.21.15.77:0/2231815525 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb72806aea0 0x7fb72806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:23.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.136+0000 7fb748f39640 1 --2- 172.21.15.77:0/2231815525 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb72806aea0 0x7fb72806d360 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb7440c9140 tx=0x7fb734001450 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:23.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.139+0000 7fb739ffb640 1 -- 172.21.15.77:0/2231815525 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb74415b3e0 con 0x7fb730004d00 2023-11-04T01:47:23.156 INFO:tasks.ceph.mds.a.smithi077.stderr:daemon-helper: command crashed with signal 9 2023-11-04T01:47:23.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.379+0000 7fb74b99e640 1 -- 172.21.15.77:0/2231815525 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7fb74415a3b0 con 0x7fb730004d00 2023-11-04T01:47:23.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.381+0000 7fb739ffb640 1 -- 172.21.15.77:0/2231815525 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 8139 v108) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb7400580f0 con 0x7fb730004d00 2023-11-04T01:47:23.383 INFO:teuthology.orchestra.run.smithi077.stderr:failed mds gid 8139 2023-11-04T01:47:23.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.384+0000 7fb74b99e640 1 -- 172.21.15.77:0/2231815525 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb72806aea0 msgr2=0x7fb72806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:23.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.384+0000 7fb74b99e640 1 --2- 172.21.15.77:0/2231815525 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb72806aea0 0x7fb72806d360 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb7440c9140 tx=0x7fb734001450 comp rx=0 tx=0).stop 2023-11-04T01:47:23.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.384+0000 7fb74b99e640 1 -- 172.21.15.77:0/2231815525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb730004d00 msgr2=0x7fb744148870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:23.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.384+0000 7fb74b99e640 1 --2- 172.21.15.77:0/2231815525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb730004d00 0x7fb744148870 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fb74000f7c0 tx=0x7fb74000fc80 comp rx=0 tx=0).stop 2023-11-04T01:47:23.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.384+0000 7fb74b99e640 1 -- 172.21.15.77:0/2231815525 shutdown_connections 2023-11-04T01:47:23.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.384+0000 7fb74b99e640 1 --2- 172.21.15.77:0/2231815525 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb72806aea0 0x7fb72806d360 secure :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb7440c9140 tx=0x7fb734001450 comp rx=0 tx=0).stop 2023-11-04T01:47:23.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.384+0000 7fb74b99e640 1 --2- 172.21.15.77:0/2231815525 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb7440c8c50 0x7fb7440aeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:23.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.384+0000 7fb74b99e640 1 --2- 172.21.15.77:0/2231815525 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb7440c87d0 0x7fb7440ae5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:23.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.384+0000 7fb74b99e640 1 --2- 172.21.15.77:0/2231815525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb730004d00 0x7fb744148870 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:23.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.384+0000 7fb74b99e640 1 -- 172.21.15.77:0/2231815525 >> 172.21.15.77:0/2231815525 conn(0x7fb7440cb530 msgr2=0x7fb74406ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:23.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.385+0000 7fb74b99e640 1 -- 172.21.15.77:0/2231815525 shutdown_connections 2023-11-04T01:47:23.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.385+0000 7fb74b99e640 1 -- 172.21.15.77:0/2231815525 wait complete. 2023-11-04T01:47:23.399 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:47:23.399 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:47:23.400 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:47:23.400 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:47:23.400 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:47:23.401 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi077 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2023-11-04T01:47:23.401 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:47:23.402 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:47:23.404 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:47:23.405 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:23.481 INFO:tasks.ceph.mds.c.smithi077.stdout:starting mds.c at 2023-11-04T01:47:23.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.505+0000 7f40808e5640 1 Processor -- start 2023-11-04T01:47:23.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.505+0000 7f40808e5640 1 -- start start 2023-11-04T01:47:23.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.506+0000 7f40808e5640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f407c15d1b0 0x7f407c0d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:23.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.506+0000 7f40808e5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f407c0b5050 0x7f407c0b5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:23.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.506+0000 7f40808e5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f407c15d590 con 0x7f407c0d14d0 2023-11-04T01:47:23.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.506+0000 7f40808e5640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f407c0ce6c0 con 0x7f407c15d1b0 2023-11-04T01:47:23.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.506+0000 7f40808e5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f407c0d1a50 con 0x7f407c0b5050 2023-11-04T01:47:23.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.506+0000 7f4079d9b640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f407c0d14d0 0x7f407c0b4940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:56506/0 (socket says 172.21.15.77:56506) 2023-11-04T01:47:23.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.506+0000 7f4079d9b640 1 -- 172.21.15.77:0/687518965 learned_addr learned my addr 172.21.15.77:0/687518965 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:47:23.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.506+0000 7f407a59c640 1 --2- 172.21.15.77:0/687518965 >> v2:172.21.15.122:3300/0 conn(0x7f407c15d1b0 0x7f407c0d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:23.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.506+0000 7f407ad9d640 1 --2- 172.21.15.77:0/687518965 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f407c0b5050 0x7f407c0b5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:23.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.506+0000 7f407959a640 1 -- 172.21.15.77:0/687518965 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3207382563 0 0) 0x7f4070001110 con 0x7f407c0d14d0 2023-11-04T01:47:23.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.506+0000 7f407959a640 1 -- 172.21.15.77:0/687518965 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4064003520 con 0x7f407c0d14d0 2023-11-04T01:47:23.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.506+0000 7f407a59c640 1 -- 172.21.15.77:0/687518965 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f407c0b5050 msgr2=0x7f407c0b5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:23.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.506+0000 7f407a59c640 1 --2- 172.21.15.77:0/687518965 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f407c0b5050 0x7f407c0b5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:23.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.506+0000 7f407a59c640 1 -- 172.21.15.77:0/687518965 >> v1:172.21.15.77:6789/0 conn(0x7f407c0d14d0 legacy=0x7f407c0b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:23.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.506+0000 7f407a59c640 1 -- 172.21.15.77:0/687518965 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f407c0d1d30 con 0x7f407c15d1b0 2023-11-04T01:47:23.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.507+0000 7f407a59c640 1 --2- 172.21.15.77:0/687518965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f407c15d1b0 0x7f407c0d0f90 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f406c0097a0 tx=0x7f406c02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c45d5ff88b351a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:23.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.507+0000 7f407959a640 1 -- 172.21.15.77:0/687518965 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406c02d040 con 0x7f407c15d1b0 2023-11-04T01:47:23.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.507+0000 7f407959a640 1 -- 172.21.15.77:0/687518965 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406c031810 con 0x7f407c15d1b0 2023-11-04T01:47:23.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.507+0000 7f407959a640 1 -- 172.21.15.77:0/687518965 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406c031ba0 con 0x7f407c15d1b0 2023-11-04T01:47:23.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.508+0000 7f40808e5640 1 -- 172.21.15.77:0/687518965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f407c15d1b0 msgr2=0x7f407c0d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:23.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.508+0000 7f40808e5640 1 --2- 172.21.15.77:0/687518965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f407c15d1b0 0x7f407c0d0f90 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f406c0097a0 tx=0x7f406c02b8b0 comp rx=0 tx=0).stop 2023-11-04T01:47:23.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.508+0000 7f40808e5640 1 -- 172.21.15.77:0/687518965 shutdown_connections 2023-11-04T01:47:23.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.508+0000 7f40808e5640 1 --2- 172.21.15.77:0/687518965 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f407c0b5050 0x7f407c0b5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:23.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.508+0000 7f40808e5640 1 --2- 172.21.15.77:0/687518965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f407c15d1b0 0x7f407c0d0f90 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:23.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.508+0000 7f40808e5640 1 -- 172.21.15.77:0/687518965 >> 172.21.15.77:0/687518965 conn(0x7f407c0cf940 msgr2=0x7f407c0cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:23.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.508+0000 7f40808e5640 1 -- 172.21.15.77:0/687518965 shutdown_connections 2023-11-04T01:47:23.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.508+0000 7f40808e5640 1 -- 172.21.15.77:0/687518965 wait complete. 2023-11-04T01:47:23.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.509+0000 7f40808e5640 1 Processor -- start 2023-11-04T01:47:23.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.509+0000 7f40808e5640 1 -- start start 2023-11-04T01:47:23.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.510+0000 7f40808e5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f407c0b5050 0x7f407c15d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:23.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.510+0000 7f40808e5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f407c0d14d0 0x7f407c1f5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:23.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.510+0000 7f40808e5640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f407c15d1b0 0x7f407c152e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:23.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.510+0000 7f40808e5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407c1f2940 con 0x7f407c0b5050 2023-11-04T01:47:23.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.510+0000 7f40808e5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407c1f6470 con 0x7f407c0d14d0 2023-11-04T01:47:23.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.510+0000 7f40808e5640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f407c1f6710 con 0x7f407c15d1b0 2023-11-04T01:47:23.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.510+0000 7f407a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f407c0b5050 0x7f407c15d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:23.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.510+0000 7f407a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f407c0b5050 0x7f407c15d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49230/0 (socket says 172.21.15.77:49230) 2023-11-04T01:47:23.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.510+0000 7f407a59c640 1 -- 172.21.15.77:0/3811318583 learned_addr learned my addr 172.21.15.77:0/3811318583 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:23.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.510+0000 7f4079d9b640 1 --2- 172.21.15.77:0/3811318583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f407c0d14d0 0x7f407c1f5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:23.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.510+0000 7f407ad9d640 1 --2- 172.21.15.77:0/3811318583 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f407c15d1b0 0x7f407c152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:23.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.510+0000 7f407a59c640 1 -- 172.21.15.77:0/3811318583 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f407c15d1b0 msgr2=0x7f407c152e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:23.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.510+0000 7f407a59c640 1 --2- 172.21.15.77:0/3811318583 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f407c15d1b0 0x7f407c152e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:23.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.510+0000 7f407a59c640 1 -- 172.21.15.77:0/3811318583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f407c0d14d0 msgr2=0x7f407c1f5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:23.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.510+0000 7f407a59c640 1 --2- 172.21.15.77:0/3811318583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f407c0d14d0 0x7f407c1f5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:23.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.510+0000 7f407a59c640 1 -- 172.21.15.77:0/3811318583 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f406c009400 con 0x7f407c0b5050 2023-11-04T01:47:23.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.510+0000 7f407a59c640 1 --2- 172.21.15.77:0/3811318583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f407c0b5050 0x7f407c15d8f0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f406c0098c0 tx=0x7f406c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:23.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.511+0000 7f406affd640 1 -- 172.21.15.77:0/3811318583 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406c03ad60 con 0x7f407c0b5050 2023-11-04T01:47:23.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.511+0000 7f406affd640 1 -- 172.21.15.77:0/3811318583 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406c044400 con 0x7f407c0b5050 2023-11-04T01:47:23.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.511+0000 7f40808e5640 1 -- 172.21.15.77:0/3811318583 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f407c1f69f0 con 0x7f407c0b5050 2023-11-04T01:47:23.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.511+0000 7f406affd640 1 -- 172.21.15.77:0/3811318583 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406c0445b0 con 0x7f407c0b5050 2023-11-04T01:47:23.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.511+0000 7f40808e5640 1 -- 172.21.15.77:0/3811318583 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f407c1f2bc0 con 0x7f407c0b5050 2023-11-04T01:47:23.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.512+0000 7f40808e5640 1 -- 172.21.15.77:0/3811318583 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f407c0684b0 con 0x7f407c0b5050 2023-11-04T01:47:23.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.512+0000 7f406affd640 1 -- 172.21.15.77:0/3811318583 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f406c04d440 con 0x7f407c0b5050 2023-11-04T01:47:23.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.512+0000 7f406affd640 1 --2- 172.21.15.77:0/3811318583 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f405c06ae70 0x7f405c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:23.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.512+0000 7f406affd640 1 -- 172.21.15.77:0/3811318583 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8038+0+0 (secure 0 0 0) 0x7f406c0ac0c0 con 0x7f407c0b5050 2023-11-04T01:47:23.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.513+0000 7f4079d9b640 1 --2- 172.21.15.77:0/3811318583 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f405c06ae70 0x7f405c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:23.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.513+0000 7f4079d9b640 1 --2- 172.21.15.77:0/3811318583 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f405c06ae70 0x7f405c06d330 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f407c1540a0 tx=0x7f4070007bb0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:23.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.517+0000 7f406affd640 1 -- 172.21.15.77:0/3811318583 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f406c076880 con 0x7f407c0b5050 2023-11-04T01:47:23.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.718+0000 7f40808e5640 1 -- 172.21.15.77:0/3811318583 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f407c0b8de0 con 0x7f407c0b5050 2023-11-04T01:47:23.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.719+0000 7f406affd640 1 -- 172.21.15.77:0/3811318583 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+4150 (secure 0 0 0) 0x7f406c079ea0 con 0x7f407c0b5050 2023-11-04T01:47:23.720 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:47:23.721 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":109,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:47:23.386221+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7033,"mds_1":8343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7033":{"gid":7033,"name":"b","rank":0,"incarnation":109,"state":"up:replay","state_seq":1,"addr":"172.21.15.122:6836/2238841748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2238841748},{"type":"v1","addr":"172.21.15.122:6836","nonce":2238841748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8343":{"gid":8343,"name":"a","rank":1,"incarnation":100,"state":"up:active","state_seq":7,"addr":"172.21.15.77:6834/4183807043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4183807043},{"type":"v1","addr":"172.21.15.77:6834","nonce":4183807043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:23.721 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 109 2023-11-04T01:47:23.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.721+0000 7f40808e5640 1 -- 172.21.15.77:0/3811318583 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f405c06ae70 msgr2=0x7f405c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:23.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.721+0000 7f40808e5640 1 --2- 172.21.15.77:0/3811318583 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f405c06ae70 0x7f405c06d330 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f407c1540a0 tx=0x7f4070007bb0 comp rx=0 tx=0).stop 2023-11-04T01:47:23.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.721+0000 7f40808e5640 1 -- 172.21.15.77:0/3811318583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f407c0b5050 msgr2=0x7f407c15d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:23.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.721+0000 7f40808e5640 1 --2- 172.21.15.77:0/3811318583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f407c0b5050 0x7f407c15d8f0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f406c0098c0 tx=0x7f406c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:47:23.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.721+0000 7f40808e5640 1 -- 172.21.15.77:0/3811318583 shutdown_connections 2023-11-04T01:47:23.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.721+0000 7f40808e5640 1 --2- 172.21.15.77:0/3811318583 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f405c06ae70 0x7f405c06d330 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:23.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.721+0000 7f40808e5640 1 --2- 172.21.15.77:0/3811318583 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f407c15d1b0 0x7f407c152e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:23.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.721+0000 7f40808e5640 1 --2- 172.21.15.77:0/3811318583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f407c0d14d0 0x7f407c1f5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:23.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.721+0000 7f40808e5640 1 --2- 172.21.15.77:0/3811318583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f407c0b5050 0x7f407c15d8f0 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:23.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.721+0000 7f40808e5640 1 -- 172.21.15.77:0/3811318583 >> 172.21.15.77:0/3811318583 conn(0x7f407c0cf940 msgr2=0x7f407c15be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:23.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.721+0000 7f40808e5640 1 -- 172.21.15.77:0/3811318583 shutdown_connections 2023-11-04T01:47:23.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:23.721+0000 7f40808e5640 1 -- 172.21.15.77:0/3811318583 wait complete. 2023-11-04T01:47:23.733 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:47:26.191 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-11-04T01:47:26.192 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-11-04T01:47:28.735 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:28.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.845+0000 7fb770c7c640 1 Processor -- start 2023-11-04T01:47:28.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.845+0000 7fb770c7c640 1 -- start start 2023-11-04T01:47:28.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.845+0000 7fb770c7c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb76c15d100 0x7fb76c0ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:28.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.846+0000 7fb770c7c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fb76c15d4e0 0x7fb76c0d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:28.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.846+0000 7fb770c7c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb76c0d3b60 0x7fb76c0d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:28.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.846+0000 7fb770c7c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb76c0b32b0 con 0x7fb76c0d3b60 2023-11-04T01:47:28.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.846+0000 7fb770c7c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb76c0cee10 con 0x7fb76c15d4e0 2023-11-04T01:47:28.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.846+0000 7fb770c7c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb76c0b2980 con 0x7fb76c15d100 2023-11-04T01:47:28.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.846+0000 7fb76ad9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb76c0d3b60 0x7fb76c0d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:28.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.846+0000 7fb76ad9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb76c0d3b60 0x7fb76c0d1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46028/0 (socket says 172.21.15.77:46028) 2023-11-04T01:47:28.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.846+0000 7fb76ad9d640 1 -- 172.21.15.77:0/1507097200 learned_addr learned my addr 172.21.15.77:0/1507097200 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:28.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.846+0000 7fb769d9b640 1 --2- 172.21.15.77:0/1507097200 >> v2:172.21.15.122:3300/0 conn(0x7fb76c15d4e0 0x7fb76c0d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:28.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.846+0000 7fb76a59c640 1 --2- 172.21.15.77:0/1507097200 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb76c15d100 0x7fb76c0ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:28.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.846+0000 7fb76ad9d640 1 -- 172.21.15.77:0/1507097200 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb76c15d100 msgr2=0x7fb76c0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:28.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.846+0000 7fb76ad9d640 1 --2- 172.21.15.77:0/1507097200 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb76c15d100 0x7fb76c0ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:28.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.846+0000 7fb76ad9d640 1 -- 172.21.15.77:0/1507097200 >> v2:172.21.15.122:3300/0 conn(0x7fb76c15d4e0 msgr2=0x7fb76c0d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:28.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.846+0000 7fb76ad9d640 1 --2- 172.21.15.77:0/1507097200 >> v2:172.21.15.122:3300/0 conn(0x7fb76c15d4e0 0x7fb76c0d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:28.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.846+0000 7fb76ad9d640 1 -- 172.21.15.77:0/1507097200 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb76c0b2c60 con 0x7fb76c0d3b60 2023-11-04T01:47:28.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.846+0000 7fb76a59c640 1 --2- 172.21.15.77:0/1507097200 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb76c15d100 0x7fb76c0ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:28.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.847+0000 7fb76ad9d640 1 --2- 172.21.15.77:0/1507097200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb76c0d3b60 0x7fb76c0d1a10 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fb76c08bf20 tx=0x7fb76402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=541d1b5b356c602 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:28.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.847+0000 7fb76959a640 1 -- 172.21.15.77:0/1507097200 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76402ca70 con 0x7fb76c0d3b60 2023-11-04T01:47:28.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.847+0000 7fb76959a640 1 -- 172.21.15.77:0/1507097200 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76402cbd0 con 0x7fb76c0d3b60 2023-11-04T01:47:28.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.847+0000 7fb76959a640 1 -- 172.21.15.77:0/1507097200 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7640343f0 con 0x7fb76c0d3b60 2023-11-04T01:47:28.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.847+0000 7fb770c7c640 1 -- 172.21.15.77:0/1507097200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb76c0d3b60 msgr2=0x7fb76c0d1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:28.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.847+0000 7fb770c7c640 1 --2- 172.21.15.77:0/1507097200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb76c0d3b60 0x7fb76c0d1a10 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fb76c08bf20 tx=0x7fb76402bed0 comp rx=0 tx=0).stop 2023-11-04T01:47:28.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.848+0000 7fb770c7c640 1 -- 172.21.15.77:0/1507097200 shutdown_connections 2023-11-04T01:47:28.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.848+0000 7fb770c7c640 1 --2- 172.21.15.77:0/1507097200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb76c0d3b60 0x7fb76c0d1a10 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:28.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.848+0000 7fb770c7c640 1 --2- 172.21.15.77:0/1507097200 >> v2:172.21.15.122:3300/0 conn(0x7fb76c15d4e0 0x7fb76c0d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:28.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.848+0000 7fb770c7c640 1 --2- 172.21.15.77:0/1507097200 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb76c15d100 0x7fb76c0ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:28.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.848+0000 7fb770c7c640 1 -- 172.21.15.77:0/1507097200 >> 172.21.15.77:0/1507097200 conn(0x7fb76c0d2ef0 msgr2=0x7fb76c0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:28.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.848+0000 7fb770c7c640 1 -- 172.21.15.77:0/1507097200 shutdown_connections 2023-11-04T01:47:28.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.848+0000 7fb770c7c640 1 -- 172.21.15.77:0/1507097200 wait complete. 2023-11-04T01:47:28.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.849+0000 7fb770c7c640 1 Processor -- start 2023-11-04T01:47:28.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.849+0000 7fb770c7c640 1 -- start start 2023-11-04T01:47:28.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.850+0000 7fb770c7c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb76c0d3b60 0x7fb76c15a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:28.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.850+0000 7fb770c7c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb76c15d100 0x7fb76c1f5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:28.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.850+0000 7fb770c7c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb76c15d4e0 0x7fb76c1f6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:28.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.850+0000 7fb770c7c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb76c1585c0 con 0x7fb76c15d4e0 2023-11-04T01:47:28.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.850+0000 7fb770c7c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb76c1588a0 con 0x7fb76c0d3b60 2023-11-04T01:47:28.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.850+0000 7fb770c7c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb76c158b80 con 0x7fb76c15d100 2023-11-04T01:47:28.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.850+0000 7fb76ad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb76c15d4e0 0x7fb76c1f6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:28.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.850+0000 7fb76ad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb76c15d4e0 0x7fb76c1f6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46036/0 (socket says 172.21.15.77:46036) 2023-11-04T01:47:28.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.850+0000 7fb76ad9d640 1 -- 172.21.15.77:0/206148078 learned_addr learned my addr 172.21.15.77:0/206148078 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:28.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.850+0000 7fb76a59c640 1 --2- 172.21.15.77:0/206148078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb76c0d3b60 0x7fb76c15a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:28.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.850+0000 7fb76ad9d640 1 -- 172.21.15.77:0/206148078 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb76c15d100 msgr2=0x7fb76c1f5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:28.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.850+0000 7fb769d9b640 1 --2- 172.21.15.77:0/206148078 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb76c15d100 0x7fb76c1f5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:28.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.850+0000 7fb76ad9d640 1 --2- 172.21.15.77:0/206148078 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb76c15d100 0x7fb76c1f5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:28.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.850+0000 7fb76ad9d640 1 -- 172.21.15.77:0/206148078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb76c0d3b60 msgr2=0x7fb76c15a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:28.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.850+0000 7fb76ad9d640 1 --2- 172.21.15.77:0/206148078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb76c0d3b60 0x7fb76c15a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:28.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.850+0000 7fb76ad9d640 1 -- 172.21.15.77:0/206148078 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb764009b30 con 0x7fb76c15d4e0 2023-11-04T01:47:28.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.850+0000 7fb76a59c640 1 --2- 172.21.15.77:0/206148078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb76c0d3b60 0x7fb76c15a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:28.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.850+0000 7fb769d9b640 1 --2- 172.21.15.77:0/206148078 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb76c15d100 0x7fb76c1f5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:28.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.850+0000 7fb76ad9d640 1 --2- 172.21.15.77:0/206148078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb76c15d4e0 0x7fb76c1f6500 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fb764036040 tx=0x7fb764004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:28.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.851+0000 7fb762ffd640 1 -- 172.21.15.77:0/206148078 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb764009510 con 0x7fb76c15d4e0 2023-11-04T01:47:28.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.851+0000 7fb762ffd640 1 -- 172.21.15.77:0/206148078 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76403e450 con 0x7fb76c15d4e0 2023-11-04T01:47:28.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.851+0000 7fb762ffd640 1 -- 172.21.15.77:0/206148078 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76403e800 con 0x7fb76c15d4e0 2023-11-04T01:47:28.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.851+0000 7fb770c7c640 1 -- 172.21.15.77:0/206148078 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb76c158e60 con 0x7fb76c15d4e0 2023-11-04T01:47:28.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.851+0000 7fb770c7c640 1 -- 172.21.15.77:0/206148078 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb76c1f6bd0 con 0x7fb76c15d4e0 2023-11-04T01:47:28.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.852+0000 7fb770c7c640 1 -- 172.21.15.77:0/206148078 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb76c159320 con 0x7fb76c15d4e0 2023-11-04T01:47:28.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.852+0000 7fb762ffd640 1 -- 172.21.15.77:0/206148078 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb76403e960 con 0x7fb76c15d4e0 2023-11-04T01:47:28.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.852+0000 7fb762ffd640 1 --2- 172.21.15.77:0/206148078 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb74c06ae70 0x7fb74c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:28.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.852+0000 7fb762ffd640 1 -- 172.21.15.77:0/206148078 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8038+0+0 (secure 0 0 0) 0x7fb7640acc40 con 0x7fb76c15d4e0 2023-11-04T01:47:28.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.853+0000 7fb76a59c640 1 --2- 172.21.15.77:0/206148078 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb74c06ae70 0x7fb74c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:28.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.853+0000 7fb76a59c640 1 --2- 172.21.15.77:0/206148078 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb74c06ae70 0x7fb74c06d330 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fb76c1442b0 tx=0x7fb754008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:28.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:28.857+0000 7fb762ffd640 1 -- 172.21.15.77:0/206148078 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb764077580 con 0x7fb76c15d4e0 2023-11-04T01:47:29.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.057+0000 7fb770c7c640 1 -- 172.21.15.77:0/206148078 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb76c0684b0 con 0x7fb76c15d4e0 2023-11-04T01:47:29.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.058+0000 7fb762ffd640 1 -- 172.21.15.77:0/206148078 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) v1 ==== 95+0+4944 (secure 0 0 0) 0x7fb764043090 con 0x7fb76c15d4e0 2023-11-04T01:47:29.060 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:47:29.060 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":110,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8583,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1157837717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1157837717},{"type":"v1","addr":"172.21.15.77:6833","nonce":1157837717}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:47:23.399800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7033,"mds_1":8343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7033":{"gid":7033,"name":"b","rank":0,"incarnation":109,"state":"up:resolve","state_seq":11,"addr":"172.21.15.122:6836/2238841748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2238841748},{"type":"v1","addr":"172.21.15.122:6836","nonce":2238841748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8343":{"gid":8343,"name":"a","rank":1,"incarnation":100,"state":"up:active","state_seq":7,"addr":"172.21.15.77:6834/4183807043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4183807043},{"type":"v1","addr":"172.21.15.77:6834","nonce":4183807043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:29.061 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 110 2023-11-04T01:47:29.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.060+0000 7fb770c7c640 1 -- 172.21.15.77:0/206148078 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb74c06ae70 msgr2=0x7fb74c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:29.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.060+0000 7fb770c7c640 1 --2- 172.21.15.77:0/206148078 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb74c06ae70 0x7fb74c06d330 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fb76c1442b0 tx=0x7fb754008040 comp rx=0 tx=0).stop 2023-11-04T01:47:29.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.060+0000 7fb770c7c640 1 -- 172.21.15.77:0/206148078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb76c15d4e0 msgr2=0x7fb76c1f6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:29.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.060+0000 7fb770c7c640 1 --2- 172.21.15.77:0/206148078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb76c15d4e0 0x7fb76c1f6500 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fb764036040 tx=0x7fb764004a40 comp rx=0 tx=0).stop 2023-11-04T01:47:29.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.060+0000 7fb770c7c640 1 -- 172.21.15.77:0/206148078 shutdown_connections 2023-11-04T01:47:29.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.060+0000 7fb770c7c640 1 --2- 172.21.15.77:0/206148078 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb74c06ae70 0x7fb74c06d330 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:29.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.060+0000 7fb770c7c640 1 --2- 172.21.15.77:0/206148078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb76c15d4e0 0x7fb76c1f6500 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:29.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.060+0000 7fb770c7c640 1 --2- 172.21.15.77:0/206148078 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb76c15d100 0x7fb76c1f5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:29.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.060+0000 7fb770c7c640 1 --2- 172.21.15.77:0/206148078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb76c0d3b60 0x7fb76c15a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:29.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.060+0000 7fb770c7c640 1 -- 172.21.15.77:0/206148078 >> 172.21.15.77:0/206148078 conn(0x7fb76c0d2ef0 msgr2=0x7fb76c0d14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:29.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.060+0000 7fb770c7c640 1 -- 172.21.15.77:0/206148078 shutdown_connections 2023-11-04T01:47:29.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.060+0000 7fb770c7c640 1 -- 172.21.15.77:0/206148078 wait complete. 2023-11-04T01:47:29.072 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:47:29.073 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:29.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.170+0000 7fb229694640 1 Processor -- start 2023-11-04T01:47:29.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.170+0000 7fb229694640 1 -- start start 2023-11-04T01:47:29.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.171+0000 7fb229694640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb2240b2210 0x7fb2240cf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:29.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.171+0000 7fb229694640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2240b0150 con 0x7fb2240ceda0 2023-11-04T01:47:29.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.171+0000 7fb229694640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2240b1170 con 0x7fb22415d630 2023-11-04T01:47:29.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.171+0000 7fb229694640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2240b1df0 con 0x7fb2240b2210 2023-11-04T01:47:29.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.171+0000 7fb2227fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb2240b2210 0x7fb2240cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:29.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.171+0000 7fb2227fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb2240b2210 0x7fb2240cf180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46040/0 (socket says 172.21.15.77:46040) 2023-11-04T01:47:29.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.171+0000 7fb222ffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb2240ceda0 0x7fb22415cf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:38562/0 (socket says 172.21.15.77:38562) 2023-11-04T01:47:29.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.171+0000 7fb222ffd640 1 -- 172.21.15.77:0/2043858754 learned_addr learned my addr 172.21.15.77:0/2043858754 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:47:29.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.172+0000 7fb2227fc640 1 -- 172.21.15.77:0/2043858754 >> v1:172.21.15.122:6789/0 conn(0x7fb22415d630 legacy=0x7fb2240cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:29.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.172+0000 7fb2227fc640 1 -- 172.21.15.77:0/2043858754 >> v1:172.21.15.77:6789/0 conn(0x7fb2240ceda0 legacy=0x7fb22415cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:29.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.172+0000 7fb2227fc640 1 -- 172.21.15.77:0/2043858754 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2240b1450 con 0x7fb2240b2210 2023-11-04T01:47:29.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.172+0000 7fb221ffb640 1 -- 172.21.15.77:0/2043858754 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2637114085 0 0) 0x7fb2240b0150 con 0x7fb2240ceda0 2023-11-04T01:47:29.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.172+0000 7fb2227fc640 1 --2- 172.21.15.77:0/2043858754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2240b2210 0x7fb2240cf180 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fb2180097a0 tx=0x7fb21802b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de2fea4cbec295a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:29.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.172+0000 7fb221ffb640 1 -- 172.21.15.77:0/2043858754 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21802f050 con 0x7fb2240b2210 2023-11-04T01:47:29.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.172+0000 7fb221ffb640 1 -- 172.21.15.77:0/2043858754 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb218031700 con 0x7fb2240b2210 2023-11-04T01:47:29.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.172+0000 7fb221ffb640 1 -- 172.21.15.77:0/2043858754 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb218031a90 con 0x7fb2240b2210 2023-11-04T01:47:29.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.173+0000 7fb229694640 1 -- 172.21.15.77:0/2043858754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2240b2210 msgr2=0x7fb2240cf180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:29.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.173+0000 7fb229694640 1 --2- 172.21.15.77:0/2043858754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2240b2210 0x7fb2240cf180 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fb2180097a0 tx=0x7fb21802b7a0 comp rx=0 tx=0).stop 2023-11-04T01:47:29.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.173+0000 7fb229694640 1 -- 172.21.15.77:0/2043858754 shutdown_connections 2023-11-04T01:47:29.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.173+0000 7fb229694640 1 --2- 172.21.15.77:0/2043858754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2240b2210 0x7fb2240cf180 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:29.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.173+0000 7fb229694640 1 -- 172.21.15.77:0/2043858754 >> 172.21.15.77:0/2043858754 conn(0x7fb2240d0c30 msgr2=0x7fb2240d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:29.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.173+0000 7fb229694640 1 -- 172.21.15.77:0/2043858754 shutdown_connections 2023-11-04T01:47:29.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.173+0000 7fb229694640 1 -- 172.21.15.77:0/2043858754 wait complete. 2023-11-04T01:47:29.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.174+0000 7fb229694640 1 Processor -- start 2023-11-04T01:47:29.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.174+0000 7fb229694640 1 -- start start 2023-11-04T01:47:29.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.175+0000 7fb229694640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2240b2210 0x7fb2240cd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:29.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.175+0000 7fb229694640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb2240ceda0 0x7fb2240cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:29.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.175+0000 7fb229694640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb22415d630 0x7fb2240cb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:29.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.175+0000 7fb229694640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2241e63e0 con 0x7fb2240b2210 2023-11-04T01:47:29.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.175+0000 7fb229694640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2240cca50 con 0x7fb22415d630 2023-11-04T01:47:29.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.175+0000 7fb229694640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2240cbe40 con 0x7fb2240ceda0 2023-11-04T01:47:29.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.175+0000 7fb222ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2240b2210 0x7fb2240cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:29.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.175+0000 7fb222ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2240b2210 0x7fb2240cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46052/0 (socket says 172.21.15.77:46052) 2023-11-04T01:47:29.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.175+0000 7fb222ffd640 1 -- 172.21.15.77:0/1677734346 learned_addr learned my addr 172.21.15.77:0/1677734346 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:29.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.175+0000 7fb2227fc640 1 --2- 172.21.15.77:0/1677734346 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb2240ceda0 0x7fb2240cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:29.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.175+0000 7fb2237fe640 1 --2- 172.21.15.77:0/1677734346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb22415d630 0x7fb2240cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:29.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.175+0000 7fb222ffd640 1 -- 172.21.15.77:0/1677734346 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb2240ceda0 msgr2=0x7fb2240cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:29.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.175+0000 7fb222ffd640 1 --2- 172.21.15.77:0/1677734346 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb2240ceda0 0x7fb2240cd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:29.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.175+0000 7fb222ffd640 1 -- 172.21.15.77:0/1677734346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb22415d630 msgr2=0x7fb2240cb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:29.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.175+0000 7fb222ffd640 1 --2- 172.21.15.77:0/1677734346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb22415d630 0x7fb2240cb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:29.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.175+0000 7fb222ffd640 1 -- 172.21.15.77:0/1677734346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb218009400 con 0x7fb2240b2210 2023-11-04T01:47:29.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.176+0000 7fb222ffd640 1 --2- 172.21.15.77:0/1677734346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2240b2210 0x7fb2240cd370 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fb21400c770 tx=0x7fb21400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:29.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.176+0000 7fb20b7fe640 1 -- 172.21.15.77:0/1677734346 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21400ce80 con 0x7fb2240b2210 2023-11-04T01:47:29.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.176+0000 7fb20b7fe640 1 -- 172.21.15.77:0/1677734346 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21400a640 con 0x7fb2240b2210 2023-11-04T01:47:29.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.176+0000 7fb229694640 1 -- 172.21.15.77:0/1677734346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2240cc120 con 0x7fb2240b2210 2023-11-04T01:47:29.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.176+0000 7fb20b7fe640 1 -- 172.21.15.77:0/1677734346 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21400a9f0 con 0x7fb2240b2210 2023-11-04T01:47:29.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.176+0000 7fb229694640 1 -- 172.21.15.77:0/1677734346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2240cc6e0 con 0x7fb2240b2210 2023-11-04T01:47:29.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.177+0000 7fb229694640 1 -- 172.21.15.77:0/1677734346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb224067f00 con 0x7fb2240b2210 2023-11-04T01:47:29.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.177+0000 7fb20b7fe640 1 -- 172.21.15.77:0/1677734346 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb21400ab50 con 0x7fb2240b2210 2023-11-04T01:47:29.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.177+0000 7fb20b7fe640 1 --2- 172.21.15.77:0/1677734346 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb21006ae70 0x7fb21006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:29.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.178+0000 7fb20b7fe640 1 -- 172.21.15.77:0/1677734346 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8038+0+0 (secure 0 0 0) 0x7fb2140897e0 con 0x7fb2240b2210 2023-11-04T01:47:29.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.178+0000 7fb2227fc640 1 --2- 172.21.15.77:0/1677734346 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb21006ae70 0x7fb21006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:29.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.178+0000 7fb2227fc640 1 --2- 172.21.15.77:0/1677734346 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb21006ae70 0x7fb21006d330 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fb218035000 tx=0x7fb218008030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:29.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.182+0000 7fb20b7fe640 1 -- 172.21.15.77:0/1677734346 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb214053f70 con 0x7fb2240b2210 2023-11-04T01:47:29.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.382+0000 7fb229694640 1 -- 172.21.15.77:0/1677734346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2240684b0 con 0x7fb2240b2210 2023-11-04T01:47:29.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.383+0000 7fb20b7fe640 1 -- 172.21.15.77:0/1677734346 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) v1 ==== 95+0+4944 (secure 0 0 0) 0x7fb214017070 con 0x7fb2240b2210 2023-11-04T01:47:29.385 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:47:29.385 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":110,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8583,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1157837717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1157837717},{"type":"v1","addr":"172.21.15.77:6833","nonce":1157837717}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:47:23.399800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7033,"mds_1":8343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7033":{"gid":7033,"name":"b","rank":0,"incarnation":109,"state":"up:resolve","state_seq":11,"addr":"172.21.15.122:6836/2238841748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2238841748},{"type":"v1","addr":"172.21.15.122:6836","nonce":2238841748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8343":{"gid":8343,"name":"a","rank":1,"incarnation":100,"state":"up:active","state_seq":7,"addr":"172.21.15.77:6834/4183807043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4183807043},{"type":"v1","addr":"172.21.15.77:6834","nonce":4183807043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:29.385 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 110 2023-11-04T01:47:29.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.385+0000 7fb229694640 1 -- 172.21.15.77:0/1677734346 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb21006ae70 msgr2=0x7fb21006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:29.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.385+0000 7fb229694640 1 --2- 172.21.15.77:0/1677734346 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb21006ae70 0x7fb21006d330 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fb218035000 tx=0x7fb218008030 comp rx=0 tx=0).stop 2023-11-04T01:47:29.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.385+0000 7fb229694640 1 -- 172.21.15.77:0/1677734346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2240b2210 msgr2=0x7fb2240cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:29.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.385+0000 7fb229694640 1 --2- 172.21.15.77:0/1677734346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2240b2210 0x7fb2240cd370 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fb21400c770 tx=0x7fb21400cc30 comp rx=0 tx=0).stop 2023-11-04T01:47:29.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.385+0000 7fb229694640 1 -- 172.21.15.77:0/1677734346 shutdown_connections 2023-11-04T01:47:29.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.385+0000 7fb229694640 1 --2- 172.21.15.77:0/1677734346 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb21006ae70 0x7fb21006d330 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:29.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.385+0000 7fb229694640 1 --2- 172.21.15.77:0/1677734346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb22415d630 0x7fb2240cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:29.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.385+0000 7fb229694640 1 --2- 172.21.15.77:0/1677734346 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb2240ceda0 0x7fb2240cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:29.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.385+0000 7fb229694640 1 --2- 172.21.15.77:0/1677734346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2240b2210 0x7fb2240cd370 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:29.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.385+0000 7fb229694640 1 -- 172.21.15.77:0/1677734346 >> 172.21.15.77:0/1677734346 conn(0x7fb2240d0c30 msgr2=0x7fb22406b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:29.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.385+0000 7fb229694640 1 -- 172.21.15.77:0/1677734346 shutdown_connections 2023-11-04T01:47:29.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.385+0000 7fb229694640 1 -- 172.21.15.77:0/1677734346 wait complete. 2023-11-04T01:47:29.397 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:resolve 2023-11-04T01:47:29.397 DEBUG:tasks.cephfs.filesystem:reached state 'up:resolve' in 0.32465362548828125s 2023-11-04T01:47:29.398 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:29.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.496+0000 7f60ac8d4640 1 Processor -- start 2023-11-04T01:47:29.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.496+0000 7f60ac8d4640 1 -- start start 2023-11-04T01:47:29.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.497+0000 7f60ac8d4640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f60a80b0c40 0x7f60a806fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:29.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.497+0000 7f60ac8d4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a8071500 con 0x7f60a8159e40 2023-11-04T01:47:29.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.497+0000 7f60ac8d4640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a815dae0 con 0x7f60a806bb60 2023-11-04T01:47:29.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.497+0000 7f60ac8d4640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a8070c60 con 0x7f60a80b0c40 2023-11-04T01:47:29.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.497+0000 7f60a659c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f60a8159e40 0x7f60a80b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:38576/0 (socket says 172.21.15.77:38576) 2023-11-04T01:47:29.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.497+0000 7f60a659c640 1 -- 172.21.15.77:0/1107217432 learned_addr learned my addr 172.21.15.77:0/1107217432 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:47:29.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.497+0000 7f60a5d9b640 1 --2- 172.21.15.77:0/1107217432 >> v2:172.21.15.122:3300/0 conn(0x7f60a80b0c40 0x7f60a806fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:29.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.497+0000 7f60a559a640 1 -- 172.21.15.77:0/1107217432 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2066759562 0 0) 0x7f60a8071500 con 0x7f60a8159e40 2023-11-04T01:47:29.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.497+0000 7f60a559a640 1 -- 172.21.15.77:0/1107217432 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6090003520 con 0x7f60a8159e40 2023-11-04T01:47:29.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.498+0000 7f60a559a640 1 -- 172.21.15.77:0/1107217432 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3626790477 0 0) 0x7f6090003520 con 0x7f60a8159e40 2023-11-04T01:47:29.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.498+0000 7f60a559a640 1 -- 172.21.15.77:0/1107217432 >> v2:172.21.15.122:3300/0 conn(0x7f60a80b0c40 msgr2=0x7f60a806fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:29.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.498+0000 7f60a559a640 1 --2- 172.21.15.77:0/1107217432 >> v2:172.21.15.122:3300/0 conn(0x7f60a80b0c40 0x7f60a806fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:29.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.498+0000 7f60a559a640 1 -- 172.21.15.77:0/1107217432 >> v1:172.21.15.122:6789/0 conn(0x7f60a806bb60 legacy=0x7f60a80cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:29.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.498+0000 7f60a559a640 1 -- 172.21.15.77:0/1107217432 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a8070f40 con 0x7f60a8159e40 2023-11-04T01:47:29.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.498+0000 7f60a559a640 1 -- 172.21.15.77:0/1107217432 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f60980019f0 con 0x7f60a8159e40 2023-11-04T01:47:29.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.498+0000 7f60a559a640 1 -- 172.21.15.77:0/1107217432 >> v1:172.21.15.77:6789/0 conn(0x7f60a8159e40 legacy=0x7f60a80b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:29.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.498+0000 7f60a559a640 1 --2- 172.21.15.77:0/1107217432 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6090003970 0x7f6090003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:29.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.498+0000 7f60a559a640 1 --2- 172.21.15.77:0/1107217432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60900047c0 0x7f6090004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:29.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.498+0000 7f60a559a640 1 --2- 172.21.15.77:0/1107217432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6090005180 0x7f609000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:29.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.498+0000 7f60a559a640 1 -- 172.21.15.77:0/1107217432 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a8070c60 con 0x7f60900047c0 2023-11-04T01:47:29.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.498+0000 7f60a559a640 1 -- 172.21.15.77:0/1107217432 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609000c120 con 0x7f6090005180 2023-11-04T01:47:29.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.498+0000 7f60a559a640 1 -- 172.21.15.77:0/1107217432 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609000c2e0 con 0x7f6090003970 2023-11-04T01:47:29.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.498+0000 7f60a5d9b640 1 --2- 172.21.15.77:0/1107217432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60900047c0 0x7f6090004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:29.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.498+0000 7f60a659c640 1 --2- 172.21.15.77:0/1107217432 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6090003970 0x7f6090003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:29.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.498+0000 7f60a6d9d640 1 --2- 172.21.15.77:0/1107217432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6090005180 0x7f609000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:29.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.498+0000 7f60a5d9b640 1 -- 172.21.15.77:0/1107217432 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6090003970 msgr2=0x7f6090003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:29.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.498+0000 7f60a5d9b640 1 --2- 172.21.15.77:0/1107217432 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6090003970 0x7f6090003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:29.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.498+0000 7f60a5d9b640 1 -- 172.21.15.77:0/1107217432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6090005180 msgr2=0x7f609000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:29.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.498+0000 7f60a5d9b640 1 --2- 172.21.15.77:0/1107217432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6090005180 0x7f609000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:29.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.498+0000 7f60a6d9d640 1 -- 172.21.15.77:0/1107217432 reap_dead start 2023-11-04T01:47:29.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.498+0000 7f60a5d9b640 1 -- 172.21.15.77:0/1107217432 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6090003520 con 0x7f60900047c0 2023-11-04T01:47:29.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.499+0000 7f60a5d9b640 1 --2- 172.21.15.77:0/1107217432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60900047c0 0x7f6090004c40 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f609c009ac0 tx=0x7f60900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a7c1ea42b906c77 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:29.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.499+0000 7f60a559a640 1 -- 172.21.15.77:0/1107217432 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c02c6b0 con 0x7f60900047c0 2023-11-04T01:47:29.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.499+0000 7f60a559a640 1 -- 172.21.15.77:0/1107217432 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609c02c810 con 0x7f60900047c0 2023-11-04T01:47:29.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.499+0000 7f60a559a640 1 -- 172.21.15.77:0/1107217432 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c02cba0 con 0x7f60900047c0 2023-11-04T01:47:29.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.499+0000 7f60ac8d4640 1 -- 172.21.15.77:0/1107217432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60900047c0 msgr2=0x7f6090004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:29.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.499+0000 7f60ac8d4640 1 --2- 172.21.15.77:0/1107217432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60900047c0 0x7f6090004c40 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f609c009ac0 tx=0x7f60900057f0 comp rx=0 tx=0).stop 2023-11-04T01:47:29.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.500+0000 7f60ac8d4640 1 -- 172.21.15.77:0/1107217432 shutdown_connections 2023-11-04T01:47:29.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.500+0000 7f60ac8d4640 1 --2- 172.21.15.77:0/1107217432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60900047c0 0x7f6090004c40 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:29.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.500+0000 7f60ac8d4640 1 -- 172.21.15.77:0/1107217432 >> 172.21.15.77:0/1107217432 conn(0x7f60a80cb530 msgr2=0x7f60a80cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:29.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.500+0000 7f60ac8d4640 1 -- 172.21.15.77:0/1107217432 shutdown_connections 2023-11-04T01:47:29.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.500+0000 7f60ac8d4640 1 -- 172.21.15.77:0/1107217432 wait complete. 2023-11-04T01:47:29.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.501+0000 7f60ac8d4640 1 Processor -- start 2023-11-04T01:47:29.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.501+0000 7f60ac8d4640 1 -- start start 2023-11-04T01:47:29.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.502+0000 7f60ac8d4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60900047c0 0x7f60a80c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:29.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.502+0000 7f60ac8d4640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f60a814a660 0x7f60a81f1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:29.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.502+0000 7f60ac8d4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60a81f20b0 0x7f60a81f2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:29.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.502+0000 7f60ac8d4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a80c75e0 con 0x7f60900047c0 2023-11-04T01:47:29.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.502+0000 7f60ac8d4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a80c77c0 con 0x7f60a81f20b0 2023-11-04T01:47:29.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.502+0000 7f60ac8d4640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a80c7aa0 con 0x7f60a814a660 2023-11-04T01:47:29.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.502+0000 7f60a659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60900047c0 0x7f60a80c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:29.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.502+0000 7f60a659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60900047c0 0x7f60a80c12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46068/0 (socket says 172.21.15.77:46068) 2023-11-04T01:47:29.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.502+0000 7f60a659c640 1 -- 172.21.15.77:0/3212215200 learned_addr learned my addr 172.21.15.77:0/3212215200 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:29.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.502+0000 7f60a6d9d640 1 --2- 172.21.15.77:0/3212215200 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60a81f20b0 0x7f60a81f2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:29.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.502+0000 7f60a5d9b640 1 --2- 172.21.15.77:0/3212215200 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f60a814a660 0x7f60a81f1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:29.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.502+0000 7f60a659c640 1 -- 172.21.15.77:0/3212215200 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f60a814a660 msgr2=0x7f60a81f1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:29.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.502+0000 7f60a659c640 1 --2- 172.21.15.77:0/3212215200 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f60a814a660 0x7f60a81f1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:29.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.502+0000 7f60a659c640 1 -- 172.21.15.77:0/3212215200 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60a81f20b0 msgr2=0x7f60a81f2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:29.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.502+0000 7f60a659c640 1 --2- 172.21.15.77:0/3212215200 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60a81f20b0 0x7f60a81f2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:29.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.502+0000 7f60a659c640 1 -- 172.21.15.77:0/3212215200 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a80c7d80 con 0x7f60900047c0 2023-11-04T01:47:29.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.502+0000 7f60a659c640 1 --2- 172.21.15.77:0/3212215200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60900047c0 0x7f60a80c12b0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f6098007a10 tx=0x7f609800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:29.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.502+0000 7f6096ffd640 1 -- 172.21.15.77:0/3212215200 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609800ee50 con 0x7f60900047c0 2023-11-04T01:47:29.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.502+0000 7f6096ffd640 1 -- 172.21.15.77:0/3212215200 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6098013420 con 0x7f60900047c0 2023-11-04T01:47:29.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.502+0000 7f60ac8d4640 1 -- 172.21.15.77:0/3212215200 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a80c8060 con 0x7f60900047c0 2023-11-04T01:47:29.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.502+0000 7f6096ffd640 1 -- 172.21.15.77:0/3212215200 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60980137d0 con 0x7f60900047c0 2023-11-04T01:47:29.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.502+0000 7f60ac8d4640 1 -- 172.21.15.77:0/3212215200 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a80c17f0 con 0x7f60900047c0 2023-11-04T01:47:29.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.503+0000 7f60ac8d4640 1 -- 172.21.15.77:0/3212215200 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a80684b0 con 0x7f60900047c0 2023-11-04T01:47:29.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.504+0000 7f6096ffd640 1 -- 172.21.15.77:0/3212215200 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6098013930 con 0x7f60900047c0 2023-11-04T01:47:29.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.504+0000 7f6096ffd640 1 --2- 172.21.15.77:0/3212215200 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f608806aea0 0x7f608806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:29.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.504+0000 7f6096ffd640 1 -- 172.21.15.77:0/3212215200 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8038+0+0 (secure 0 0 0) 0x7f609808a700 con 0x7f60900047c0 2023-11-04T01:47:29.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.504+0000 7f60a5d9b640 1 --2- 172.21.15.77:0/3212215200 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f608806aea0 0x7f608806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:29.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.505+0000 7f60a5d9b640 1 --2- 172.21.15.77:0/3212215200 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f608806aea0 0x7f608806d360 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f609c036000 tx=0x7f609c030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:29.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.508+0000 7f6096ffd640 1 -- 172.21.15.77:0/3212215200 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6098054e90 con 0x7f60900047c0 2023-11-04T01:47:29.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.711+0000 7f60ac8d4640 1 -- 172.21.15.77:0/3212215200 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60a80c8580 con 0x7f60900047c0 2023-11-04T01:47:29.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.711+0000 7f6096ffd640 1 -- 172.21.15.77:0/3212215200 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) v1 ==== 95+0+4944 (secure 0 0 0) 0x7f60980584b0 con 0x7f60900047c0 2023-11-04T01:47:29.713 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:47:29.713 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":110,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8583,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1157837717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1157837717},{"type":"v1","addr":"172.21.15.77:6833","nonce":1157837717}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:47:23.399800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7033,"mds_1":8343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7033":{"gid":7033,"name":"b","rank":0,"incarnation":109,"state":"up:resolve","state_seq":11,"addr":"172.21.15.122:6836/2238841748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2238841748},{"type":"v1","addr":"172.21.15.122:6836","nonce":2238841748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8343":{"gid":8343,"name":"a","rank":1,"incarnation":100,"state":"up:active","state_seq":7,"addr":"172.21.15.77:6834/4183807043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4183807043},{"type":"v1","addr":"172.21.15.77:6834","nonce":4183807043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:29.714 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 110 2023-11-04T01:47:29.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.713+0000 7f60ac8d4640 1 -- 172.21.15.77:0/3212215200 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f608806aea0 msgr2=0x7f608806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:29.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.713+0000 7f60ac8d4640 1 --2- 172.21.15.77:0/3212215200 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f608806aea0 0x7f608806d360 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f609c036000 tx=0x7f609c030000 comp rx=0 tx=0).stop 2023-11-04T01:47:29.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.713+0000 7f60ac8d4640 1 -- 172.21.15.77:0/3212215200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60900047c0 msgr2=0x7f60a80c12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:29.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.713+0000 7f60ac8d4640 1 --2- 172.21.15.77:0/3212215200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60900047c0 0x7f60a80c12b0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f6098007a10 tx=0x7f609800e530 comp rx=0 tx=0).stop 2023-11-04T01:47:29.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.713+0000 7f60ac8d4640 1 -- 172.21.15.77:0/3212215200 shutdown_connections 2023-11-04T01:47:29.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.713+0000 7f60ac8d4640 1 --2- 172.21.15.77:0/3212215200 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f608806aea0 0x7f608806d360 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:29.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.713+0000 7f60ac8d4640 1 --2- 172.21.15.77:0/3212215200 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f60a81f20b0 0x7f60a81f2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:29.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.713+0000 7f60ac8d4640 1 --2- 172.21.15.77:0/3212215200 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f60a814a660 0x7f60a81f1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:29.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.713+0000 7f60ac8d4640 1 --2- 172.21.15.77:0/3212215200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60900047c0 0x7f60a80c12b0 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:29.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.713+0000 7f60ac8d4640 1 -- 172.21.15.77:0/3212215200 >> 172.21.15.77:0/3212215200 conn(0x7f60a80cb530 msgr2=0x7f60a806bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:29.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.713+0000 7f60ac8d4640 1 -- 172.21.15.77:0/3212215200 shutdown_connections 2023-11-04T01:47:29.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.713+0000 7f60ac8d4640 1 -- 172.21.15.77:0/3212215200 wait complete. 2023-11-04T01:47:29.726 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dump snaps --server 2023-11-04T01:47:29.848 INFO:teuthology.orchestra.run.smithi122.stdout:{"last_snap":12,"last_created":12,"last_destroyed":9,"pending_noop":[],"snaps":[{"snapid":11,"ino":1099511627777,"stamp":"2023-11-04T01:46:21.837860+0000","name":"s25","metadata":{}},{"snapid":12,"ino":1099511627777,"stamp":"2023-11-04T01:47:05.961051+0000","name":"s26","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:47:29.849 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 12, "last_destroyed": 9, "last_snap": 12, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s25", "snapid": 11, "stamp": "2023-11-04T01:46:21.837860+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s26", "snapid": 12, "stamp": "2023-11-04T01:47:05.961051+0000" } ] } 2023-11-04T01:47:29.849 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:29.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.947+0000 7f8456fb0640 1 Processor -- start 2023-11-04T01:47:29.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.947+0000 7f8456fb0640 1 -- start start 2023-11-04T01:47:29.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.948+0000 7f8456fb0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f845015b330 0x7f84500cba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:29.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.948+0000 7f8456fb0640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84500b2160 0x7f845006ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:29.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.948+0000 7f8456fb0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84500cb5d0 con 0x7f845006ca60 2023-11-04T01:47:29.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.948+0000 7f8456fb0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f845006f3f0 con 0x7f845015b330 2023-11-04T01:47:29.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.948+0000 7f8456fb0640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84500c3490 con 0x7f84500b2160 2023-11-04T01:47:29.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.948+0000 7f8454d4c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f845015b330 0x7f84500cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:29.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.948+0000 7f845554d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f845006ca60 0x7f84500b29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:38590/0 (socket says 172.21.15.77:38590) 2023-11-04T01:47:29.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.948+0000 7f8454d4c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f845015b330 0x7f84500cba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46072/0 (socket says 172.21.15.77:46072) 2023-11-04T01:47:29.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.948+0000 7f845554d640 1 -- 172.21.15.77:0/848415105 learned_addr learned my addr 172.21.15.77:0/848415105 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:47:29.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.948+0000 7f844ffff640 1 --2- 172.21.15.77:0/848415105 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84500b2160 0x7f845006ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:29.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.948+0000 7f8454d4c640 1 -- 172.21.15.77:0/848415105 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84500b2160 msgr2=0x7f845006ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:29.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.948+0000 7f8454d4c640 1 --2- 172.21.15.77:0/848415105 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84500b2160 0x7f845006ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:29.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.948+0000 7f8454d4c640 1 -- 172.21.15.77:0/848415105 >> v1:172.21.15.77:6789/0 conn(0x7f845006ca60 legacy=0x7f84500b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:29.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.948+0000 7f844f7fe640 1 -- 172.21.15.77:0/848415105 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2300351410 0 0) 0x7f84500cb5d0 con 0x7f845006ca60 2023-11-04T01:47:29.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.948+0000 7f8454d4c640 1 -- 172.21.15.77:0/848415105 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84500cbfa0 con 0x7f845015b330 2023-11-04T01:47:29.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.949+0000 7f8454d4c640 1 --2- 172.21.15.77:0/848415105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f845015b330 0x7f84500cba60 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f84440097a0 tx=0x7f844402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27624403ab361f35 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:29.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.949+0000 7f844f7fe640 1 -- 172.21.15.77:0/848415105 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8444031830 con 0x7f845015b330 2023-11-04T01:47:29.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.949+0000 7f844f7fe640 1 -- 172.21.15.77:0/848415105 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8444031990 con 0x7f845015b330 2023-11-04T01:47:29.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.949+0000 7f844f7fe640 1 -- 172.21.15.77:0/848415105 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8444031d20 con 0x7f845015b330 2023-11-04T01:47:29.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.950+0000 7f8456fb0640 1 -- 172.21.15.77:0/848415105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f845015b330 msgr2=0x7f84500cba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:29.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.950+0000 7f8456fb0640 1 --2- 172.21.15.77:0/848415105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f845015b330 0x7f84500cba60 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f84440097a0 tx=0x7f844402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:47:29.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.950+0000 7f8456fb0640 1 -- 172.21.15.77:0/848415105 shutdown_connections 2023-11-04T01:47:29.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.950+0000 7f8456fb0640 1 --2- 172.21.15.77:0/848415105 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f84500b2160 0x7f845006ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:29.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.950+0000 7f8456fb0640 1 --2- 172.21.15.77:0/848415105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f845015b330 0x7f84500cba60 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:29.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.950+0000 7f8456fb0640 1 -- 172.21.15.77:0/848415105 >> 172.21.15.77:0/848415105 conn(0x7f84500b1640 msgr2=0x7f84500b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:29.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.950+0000 7f8456fb0640 1 -- 172.21.15.77:0/848415105 shutdown_connections 2023-11-04T01:47:29.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.950+0000 7f8456fb0640 1 -- 172.21.15.77:0/848415105 wait complete. 2023-11-04T01:47:29.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.951+0000 7f8456fb0640 1 Processor -- start 2023-11-04T01:47:29.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.951+0000 7f8456fb0640 1 -- start start 2023-11-04T01:47:29.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.952+0000 7f8456fb0640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f845006ca60 0x7f8450149f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:29.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.952+0000 7f8456fb0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84500b2160 0x7f84500c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:29.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.952+0000 7f8456fb0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f845015b330 0x7f845015cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:29.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.952+0000 7f8456fb0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84501f3170 con 0x7f845015b330 2023-11-04T01:47:29.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.952+0000 7f8456fb0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845014a4d0 con 0x7f84500b2160 2023-11-04T01:47:29.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.952+0000 7f8456fb0640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84501f24f0 con 0x7f845006ca60 2023-11-04T01:47:29.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.952+0000 7f845554d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f845015b330 0x7f845015cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:29.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.952+0000 7f845554d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f845015b330 0x7f845015cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46082/0 (socket says 172.21.15.77:46082) 2023-11-04T01:47:29.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.952+0000 7f845554d640 1 -- 172.21.15.77:0/2604048817 learned_addr learned my addr 172.21.15.77:0/2604048817 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:29.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.952+0000 7f844ffff640 1 --2- 172.21.15.77:0/2604048817 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84500b2160 0x7f84500c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:29.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.952+0000 7f8454d4c640 1 --2- 172.21.15.77:0/2604048817 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f845006ca60 0x7f8450149f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:29.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.952+0000 7f845554d640 1 -- 172.21.15.77:0/2604048817 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f845006ca60 msgr2=0x7f8450149f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:29.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.952+0000 7f845554d640 1 --2- 172.21.15.77:0/2604048817 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f845006ca60 0x7f8450149f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:29.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.952+0000 7f845554d640 1 -- 172.21.15.77:0/2604048817 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84500b2160 msgr2=0x7f84500c6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:29.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.952+0000 7f845554d640 1 --2- 172.21.15.77:0/2604048817 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84500b2160 0x7f84500c6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:29.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.952+0000 7f845554d640 1 -- 172.21.15.77:0/2604048817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8444009400 con 0x7f845015b330 2023-11-04T01:47:29.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.952+0000 7f8454d4c640 1 --2- 172.21.15.77:0/2604048817 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f845006ca60 0x7f8450149f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:29.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.952+0000 7f845554d640 1 --2- 172.21.15.77:0/2604048817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f845015b330 0x7f845015cc30 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f844800c700 tx=0x7f844800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:29.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.952+0000 7f844d7fa640 1 -- 172.21.15.77:0/2604048817 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844800ce10 con 0x7f845015b330 2023-11-04T01:47:29.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.952+0000 7f844d7fa640 1 -- 172.21.15.77:0/2604048817 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844800a640 con 0x7f845015b330 2023-11-04T01:47:29.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.952+0000 7f8456fb0640 1 -- 172.21.15.77:0/2604048817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84501f27d0 con 0x7f845015b330 2023-11-04T01:47:29.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.952+0000 7f844d7fa640 1 -- 172.21.15.77:0/2604048817 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844800aa30 con 0x7f845015b330 2023-11-04T01:47:29.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.952+0000 7f8456fb0640 1 -- 172.21.15.77:0/2604048817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84501f2d90 con 0x7f845015b330 2023-11-04T01:47:29.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.953+0000 7f8456fb0640 1 -- 172.21.15.77:0/2604048817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f845006da20 con 0x7f845015b330 2023-11-04T01:47:29.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.954+0000 7f844d7fa640 1 -- 172.21.15.77:0/2604048817 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f844800ab90 con 0x7f845015b330 2023-11-04T01:47:29.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.954+0000 7f844d7fa640 1 --2- 172.21.15.77:0/2604048817 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f843406ae70 0x7f843406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:29.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.954+0000 7f844d7fa640 1 -- 172.21.15.77:0/2604048817 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8038+0+0 (secure 0 0 0) 0x7f84480895b0 con 0x7f845015b330 2023-11-04T01:47:29.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.954+0000 7f8454d4c640 1 --2- 172.21.15.77:0/2604048817 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f843406ae70 0x7f843406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:29.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.955+0000 7f8454d4c640 1 --2- 172.21.15.77:0/2604048817 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f843406ae70 0x7f843406d330 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f8444036000 tx=0x7f8444008030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:29.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:29.958+0000 7f844d7fa640 1 -- 172.21.15.77:0/2604048817 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8448053e80 con 0x7f845015b330 2023-11-04T01:47:30.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.160+0000 7f8456fb0640 1 -- 172.21.15.77:0/2604048817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84501f32b0 con 0x7f845015b330 2023-11-04T01:47:30.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.160+0000 7f844d7fa640 1 -- 172.21.15.77:0/2604048817 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) v1 ==== 95+0+4944 (secure 0 0 0) 0x7f84501f32b0 con 0x7f845015b330 2023-11-04T01:47:30.162 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:47:30.163 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":110,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8583,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1157837717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1157837717},{"type":"v1","addr":"172.21.15.77:6833","nonce":1157837717}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:47:23.399800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7033,"mds_1":8343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7033":{"gid":7033,"name":"b","rank":0,"incarnation":109,"state":"up:resolve","state_seq":11,"addr":"172.21.15.122:6836/2238841748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2238841748},{"type":"v1","addr":"172.21.15.122:6836","nonce":2238841748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8343":{"gid":8343,"name":"a","rank":1,"incarnation":100,"state":"up:active","state_seq":7,"addr":"172.21.15.77:6834/4183807043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4183807043},{"type":"v1","addr":"172.21.15.77:6834","nonce":4183807043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:30.163 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 110 2023-11-04T01:47:30.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.162+0000 7f8456fb0640 1 -- 172.21.15.77:0/2604048817 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f843406ae70 msgr2=0x7f843406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:30.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.162+0000 7f8456fb0640 1 --2- 172.21.15.77:0/2604048817 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f843406ae70 0x7f843406d330 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f8444036000 tx=0x7f8444008030 comp rx=0 tx=0).stop 2023-11-04T01:47:30.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.162+0000 7f8456fb0640 1 -- 172.21.15.77:0/2604048817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f845015b330 msgr2=0x7f845015cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:30.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.162+0000 7f8456fb0640 1 --2- 172.21.15.77:0/2604048817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f845015b330 0x7f845015cc30 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f844800c700 tx=0x7f844800cbc0 comp rx=0 tx=0).stop 2023-11-04T01:47:30.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.162+0000 7f8456fb0640 1 -- 172.21.15.77:0/2604048817 shutdown_connections 2023-11-04T01:47:30.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.162+0000 7f8456fb0640 1 --2- 172.21.15.77:0/2604048817 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f843406ae70 0x7f843406d330 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:30.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.162+0000 7f8456fb0640 1 --2- 172.21.15.77:0/2604048817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f845015b330 0x7f845015cc30 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:30.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.162+0000 7f8456fb0640 1 --2- 172.21.15.77:0/2604048817 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84500b2160 0x7f84500c6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:30.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.162+0000 7f8456fb0640 1 --2- 172.21.15.77:0/2604048817 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f845006ca60 0x7f8450149f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:30.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.162+0000 7f8456fb0640 1 -- 172.21.15.77:0/2604048817 >> 172.21.15.77:0/2604048817 conn(0x7f84500b1640 msgr2=0x7f84500b4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:30.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.162+0000 7f8456fb0640 1 -- 172.21.15.77:0/2604048817 shutdown_connections 2023-11-04T01:47:30.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.162+0000 7f8456fb0640 1 -- 172.21.15.77:0/2604048817 wait complete. 2023-11-04T01:47:30.175 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dump snaps --server 2023-11-04T01:47:30.292 INFO:teuthology.orchestra.run.smithi122.stdout:{"last_snap":12,"last_created":12,"last_destroyed":9,"pending_noop":[],"snaps":[{"snapid":11,"ino":1099511627777,"stamp":"2023-11-04T01:46:21.837860+0000","name":"s25","metadata":{}},{"snapid":12,"ino":1099511627777,"stamp":"2023-11-04T01:47:05.961051+0000","name":"s26","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:47:30.293 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 12, "last_destroyed": 9, "last_snap": 12, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s25", "snapid": 11, "stamp": "2023-11-04T01:46:21.837860+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s26", "snapid": 12, "stamp": "2023-11-04T01:47:05.961051+0000" } ] } 2023-11-04T01:47:30.293 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:1 2023-11-04T01:47:30.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.393+0000 7faafbc4b640 1 Processor -- start 2023-11-04T01:47:30.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.394+0000 7faafbc4b640 1 -- start start 2023-11-04T01:47:30.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.395+0000 7faafbc4b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7faaf4159e40 0x7faaf40b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:30.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.395+0000 7faafbc4b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faaf406bb60 0x7faaf40b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:30.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.395+0000 7faafbc4b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7faaf406fff0 0x7faaf4070480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:30.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.395+0000 7faafbc4b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaf4071500 con 0x7faaf4159e40 2023-11-04T01:47:30.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.395+0000 7faafbc4b640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaf415dae0 con 0x7faaf406fff0 2023-11-04T01:47:30.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.395+0000 7faafbc4b640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf40709c0 con 0x7faaf406bb60 2023-11-04T01:47:30.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.395+0000 7faaf99e7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7faaf4159e40 0x7faaf40b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:30.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.395+0000 7faaf99e7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7faaf4159e40 0x7faaf40b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46088/0 (socket says 172.21.15.77:46088) 2023-11-04T01:47:30.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.395+0000 7faaf99e7640 1 -- 172.21.15.77:0/3363376308 learned_addr learned my addr 172.21.15.77:0/3363376308 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:30.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.395+0000 7faafa1e8640 1 --2- 172.21.15.77:0/3363376308 >> v2:172.21.15.122:3300/0 conn(0x7faaf406fff0 0x7faaf4070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:30.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.395+0000 7faaf91e6640 1 --2- 172.21.15.77:0/3363376308 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faaf406bb60 0x7faaf40b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:30.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.395+0000 7faaf99e7640 1 -- 172.21.15.77:0/3363376308 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faaf406bb60 msgr2=0x7faaf40b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:30.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.395+0000 7faaf99e7640 1 --2- 172.21.15.77:0/3363376308 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faaf406bb60 0x7faaf40b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:30.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.395+0000 7faaf99e7640 1 -- 172.21.15.77:0/3363376308 >> v2:172.21.15.122:3300/0 conn(0x7faaf406fff0 msgr2=0x7faaf4070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:30.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.395+0000 7faaf99e7640 1 --2- 172.21.15.77:0/3363376308 >> v2:172.21.15.122:3300/0 conn(0x7faaf406fff0 0x7faaf4070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:30.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.395+0000 7faaf99e7640 1 -- 172.21.15.77:0/3363376308 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf4070c60 con 0x7faaf4159e40 2023-11-04T01:47:30.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.395+0000 7faaf91e6640 1 --2- 172.21.15.77:0/3363376308 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faaf406bb60 0x7faaf40b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:30.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.395+0000 7faafa1e8640 1 --2- 172.21.15.77:0/3363376308 >> v2:172.21.15.122:3300/0 conn(0x7faaf406fff0 0x7faaf4070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:30.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.396+0000 7faaf99e7640 1 --2- 172.21.15.77:0/3363376308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaf4159e40 0x7faaf40b0530 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7faaf40cea40 tx=0x7faae802b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93265986a8e816dc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:30.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.396+0000 7faaf89e5640 1 -- 172.21.15.77:0/3363376308 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae80317d0 con 0x7faaf4159e40 2023-11-04T01:47:30.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.396+0000 7faaf89e5640 1 -- 172.21.15.77:0/3363376308 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae8031930 con 0x7faaf4159e40 2023-11-04T01:47:30.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.396+0000 7faaf89e5640 1 -- 172.21.15.77:0/3363376308 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae8031cc0 con 0x7faaf4159e40 2023-11-04T01:47:30.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.396+0000 7faafbc4b640 1 -- 172.21.15.77:0/3363376308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaf4159e40 msgr2=0x7faaf40b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:30.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.396+0000 7faafbc4b640 1 --2- 172.21.15.77:0/3363376308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaf4159e40 0x7faaf40b0530 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7faaf40cea40 tx=0x7faae802b870 comp rx=0 tx=0).stop 2023-11-04T01:47:30.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.397+0000 7faafbc4b640 1 -- 172.21.15.77:0/3363376308 shutdown_connections 2023-11-04T01:47:30.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.397+0000 7faafbc4b640 1 --2- 172.21.15.77:0/3363376308 >> v2:172.21.15.122:3300/0 conn(0x7faaf406fff0 0x7faaf4070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:30.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.397+0000 7faafbc4b640 1 --2- 172.21.15.77:0/3363376308 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faaf406bb60 0x7faaf40b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:30.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.397+0000 7faafbc4b640 1 --2- 172.21.15.77:0/3363376308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaf4159e40 0x7faaf40b0530 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:30.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.397+0000 7faafbc4b640 1 -- 172.21.15.77:0/3363376308 >> 172.21.15.77:0/3363376308 conn(0x7faaf40cb530 msgr2=0x7faaf40cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:30.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.397+0000 7faafbc4b640 1 -- 172.21.15.77:0/3363376308 shutdown_connections 2023-11-04T01:47:30.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.397+0000 7faafbc4b640 1 -- 172.21.15.77:0/3363376308 wait complete. 2023-11-04T01:47:30.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.398+0000 7faafbc4b640 1 Processor -- start 2023-11-04T01:47:30.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.398+0000 7faafbc4b640 1 -- start start 2023-11-04T01:47:30.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.398+0000 7faafbc4b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaf406bb60 0x7faaf40c6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:30.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.398+0000 7faafbc4b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faaf406fff0 0x7faaf40c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:30.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.398+0000 7faafbc4b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faaf4159e40 0x7faaf40c5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:30.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.398+0000 7faafbc4b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf40c6c20 con 0x7faaf406bb60 2023-11-04T01:47:30.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.399+0000 7faafbc4b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf40c6f00 con 0x7faaf4159e40 2023-11-04T01:47:30.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.399+0000 7faafbc4b640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf40c71e0 con 0x7faaf406fff0 2023-11-04T01:47:30.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.399+0000 7faaf99e7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaf406bb60 0x7faaf40c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:30.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.399+0000 7faaf99e7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaf406bb60 0x7faaf40c6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46094/0 (socket says 172.21.15.77:46094) 2023-11-04T01:47:30.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.399+0000 7faaf99e7640 1 -- 172.21.15.77:0/769380412 learned_addr learned my addr 172.21.15.77:0/769380412 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:30.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.399+0000 7faaf91e6640 1 --2- 172.21.15.77:0/769380412 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faaf406fff0 0x7faaf40c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:30.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.399+0000 7faafa1e8640 1 --2- 172.21.15.77:0/769380412 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faaf4159e40 0x7faaf40c5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:30.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.399+0000 7faaf99e7640 1 -- 172.21.15.77:0/769380412 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faaf406fff0 msgr2=0x7faaf40c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:30.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.399+0000 7faaf99e7640 1 --2- 172.21.15.77:0/769380412 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faaf406fff0 0x7faaf40c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:30.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.399+0000 7faaf99e7640 1 -- 172.21.15.77:0/769380412 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faaf4159e40 msgr2=0x7faaf40c5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:30.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.399+0000 7faaf99e7640 1 --2- 172.21.15.77:0/769380412 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faaf4159e40 0x7faaf40c5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:30.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.399+0000 7faaf99e7640 1 -- 172.21.15.77:0/769380412 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae80094d0 con 0x7faaf406bb60 2023-11-04T01:47:30.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.399+0000 7faaf99e7640 1 --2- 172.21.15.77:0/769380412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaf406bb60 0x7faaf40c6560 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7faae802b8b0 tx=0x7faae80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:30.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.399+0000 7faae67fc640 1 -- 172.21.15.77:0/769380412 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae8032870 con 0x7faaf406bb60 2023-11-04T01:47:30.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.399+0000 7faae67fc640 1 -- 172.21.15.77:0/769380412 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae8032a10 con 0x7faaf406bb60 2023-11-04T01:47:30.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.399+0000 7faafbc4b640 1 -- 172.21.15.77:0/769380412 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf40c74c0 con 0x7faaf406bb60 2023-11-04T01:47:30.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.399+0000 7faae67fc640 1 -- 172.21.15.77:0/769380412 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae8032dc0 con 0x7faaf406bb60 2023-11-04T01:47:30.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.399+0000 7faafbc4b640 1 -- 172.21.15.77:0/769380412 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf40c8c80 con 0x7faaf406bb60 2023-11-04T01:47:30.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.400+0000 7faafbc4b640 1 -- 172.21.15.77:0/769380412 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaf4153960 con 0x7faaf406bb60 2023-11-04T01:47:30.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.401+0000 7faae67fc640 1 -- 172.21.15.77:0/769380412 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faae8030070 con 0x7faaf406bb60 2023-11-04T01:47:30.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.401+0000 7faae67fc640 1 --2- 172.21.15.77:0/769380412 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7faad806ae70 0x7faad806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:30.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.401+0000 7faae67fc640 1 -- 172.21.15.77:0/769380412 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8038+0+0 (secure 0 0 0) 0x7faae80abe80 con 0x7faaf406bb60 2023-11-04T01:47:30.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.401+0000 7faaf91e6640 1 --2- 172.21.15.77:0/769380412 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7faad806ae70 0x7faad806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:30.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.402+0000 7faaf91e6640 1 --2- 172.21.15.77:0/769380412 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7faad806ae70 0x7faad806d330 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7faaf0006fd0 tx=0x7faaf0008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:30.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.405+0000 7faae67fc640 1 -- 172.21.15.77:0/769380412 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faaf4153960 con 0x7faaf406bb60 2023-11-04T01:47:30.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.638+0000 7faafbc4b640 1 -- 172.21.15.77:0/769380412 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:1"} v 0) v1 -- 0x7faaf4153d40 con 0x7faaf406bb60 2023-11-04T01:47:30.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.640+0000 7faae67fc640 1 -- 172.21.15.77:0/769380412 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:1"}]=0 failed mds gid 8343 v111) v1 ==== 97+0+0 (secure 0 0 0) 0x7faaf4153d40 con 0x7faaf406bb60 2023-11-04T01:47:30.642 INFO:teuthology.orchestra.run.smithi077.stderr:failed mds gid 8343 2023-11-04T01:47:30.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.643+0000 7faafbc4b640 1 -- 172.21.15.77:0/769380412 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7faad806ae70 msgr2=0x7faad806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:30.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.643+0000 7faafbc4b640 1 --2- 172.21.15.77:0/769380412 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7faad806ae70 0x7faad806d330 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7faaf0006fd0 tx=0x7faaf0008040 comp rx=0 tx=0).stop 2023-11-04T01:47:30.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.643+0000 7faafbc4b640 1 -- 172.21.15.77:0/769380412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaf406bb60 msgr2=0x7faaf40c6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:30.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.643+0000 7faafbc4b640 1 --2- 172.21.15.77:0/769380412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaf406bb60 0x7faaf40c6560 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7faae802b8b0 tx=0x7faae80046c0 comp rx=0 tx=0).stop 2023-11-04T01:47:30.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.643+0000 7faafbc4b640 1 -- 172.21.15.77:0/769380412 shutdown_connections 2023-11-04T01:47:30.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.643+0000 7faafbc4b640 1 --2- 172.21.15.77:0/769380412 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7faad806ae70 0x7faad806d330 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:30.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.643+0000 7faafbc4b640 1 --2- 172.21.15.77:0/769380412 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faaf4159e40 0x7faaf40c5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:30.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.643+0000 7faafbc4b640 1 --2- 172.21.15.77:0/769380412 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7faaf406fff0 0x7faaf40c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:30.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.643+0000 7faafbc4b640 1 --2- 172.21.15.77:0/769380412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaf406bb60 0x7faaf40c6560 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:30.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.643+0000 7faafbc4b640 1 -- 172.21.15.77:0/769380412 >> 172.21.15.77:0/769380412 conn(0x7faaf40cb530 msgr2=0x7faaf40cdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:30.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.643+0000 7faafbc4b640 1 -- 172.21.15.77:0/769380412 shutdown_connections 2023-11-04T01:47:30.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.643+0000 7faafbc4b640 1 -- 172.21.15.77:0/769380412 wait complete. 2023-11-04T01:47:30.659 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:47:30.659 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:47:30.660 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:47:30.660 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:47:30.660 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:47:30.661 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi077 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2023-11-04T01:47:30.661 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:47:30.661 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:47:30.664 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:47:30.664 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:30.739 INFO:tasks.ceph.mds.a.smithi077.stdout:starting mds.a at 2023-11-04T01:47:30.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.764+0000 7f34b25ce640 1 Processor -- start 2023-11-04T01:47:30.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.764+0000 7f34b25ce640 1 -- start start 2023-11-04T01:47:30.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.765+0000 7f34b25ce640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f34ac06e1d0 0x7f34ac0ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:30.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.765+0000 7f34b25ce640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f34ac0ce150 0x7f34ac0ace10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:30.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.765+0000 7f34b25ce640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34ac06e660 con 0x7f34ac160630 2023-11-04T01:47:30.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.765+0000 7f34b25ce640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34ac06d0e0 con 0x7f34ac06e1d0 2023-11-04T01:47:30.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.765+0000 7f34b25ce640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac06d3c0 con 0x7f34ac0ce150 2023-11-04T01:47:30.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.765+0000 7f34ab7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f34ac06e1d0 0x7f34ac0ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:30.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.765+0000 7f34abfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f34ac160630 0x7f34ac0cda40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:38598/0 (socket says 172.21.15.77:38598) 2023-11-04T01:47:30.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.765+0000 7f34abfff640 1 -- 172.21.15.77:0/2799254670 learned_addr learned my addr 172.21.15.77:0/2799254670 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:47:30.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.765+0000 7f34b0b6b640 1 --2- 172.21.15.77:0/2799254670 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f34ac0ce150 0x7f34ac0ace10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:30.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.765+0000 7f34ab7fe640 1 -- 172.21.15.77:0/2799254670 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f34ac0ce150 msgr2=0x7f34ac0ace10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:30.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.765+0000 7f34ab7fe640 1 --2- 172.21.15.77:0/2799254670 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f34ac0ce150 0x7f34ac0ace10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:30.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.765+0000 7f34ab7fe640 1 -- 172.21.15.77:0/2799254670 >> v1:172.21.15.77:6789/0 conn(0x7f34ac160630 legacy=0x7f34ac0cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:30.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.765+0000 7f34aaffd640 1 -- 172.21.15.77:0/2799254670 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1791671422 0 0) 0x7f34ac06e660 con 0x7f34ac160630 2023-11-04T01:47:30.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.765+0000 7f34ab7fe640 1 -- 172.21.15.77:0/2799254670 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ac06d6a0 con 0x7f34ac06e1d0 2023-11-04T01:47:30.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.766+0000 7f34ab7fe640 1 --2- 172.21.15.77:0/2799254670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34ac06e1d0 0x7f34ac0ac8d0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f34a00097a0 tx=0x7f34a002b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e281aa15d3a106c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:30.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.766+0000 7f34aaffd640 1 -- 172.21.15.77:0/2799254670 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a002f050 con 0x7f34ac06e1d0 2023-11-04T01:47:30.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.766+0000 7f34aaffd640 1 -- 172.21.15.77:0/2799254670 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a0031700 con 0x7f34ac06e1d0 2023-11-04T01:47:30.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.766+0000 7f34aaffd640 1 -- 172.21.15.77:0/2799254670 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a0031a90 con 0x7f34ac06e1d0 2023-11-04T01:47:30.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.766+0000 7f34b25ce640 1 -- 172.21.15.77:0/2799254670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34ac06e1d0 msgr2=0x7f34ac0ac8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:30.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.766+0000 7f34b25ce640 1 --2- 172.21.15.77:0/2799254670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34ac06e1d0 0x7f34ac0ac8d0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f34a00097a0 tx=0x7f34a002b7a0 comp rx=0 tx=0).stop 2023-11-04T01:47:30.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.766+0000 7f34b25ce640 1 -- 172.21.15.77:0/2799254670 shutdown_connections 2023-11-04T01:47:30.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.766+0000 7f34b25ce640 1 --2- 172.21.15.77:0/2799254670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34ac06e1d0 0x7f34ac0ac8d0 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:30.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.766+0000 7f34b25ce640 1 --2- 172.21.15.77:0/2799254670 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f34ac0ce150 0x7f34ac0ace10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:30.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.766+0000 7f34b25ce640 1 -- 172.21.15.77:0/2799254670 >> 172.21.15.77:0/2799254670 conn(0x7f34ac0cb8e0 msgr2=0x7f34ac0cbcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:30.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.766+0000 7f34b25ce640 1 -- 172.21.15.77:0/2799254670 shutdown_connections 2023-11-04T01:47:30.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.766+0000 7f34b25ce640 1 -- 172.21.15.77:0/2799254670 wait complete. 2023-11-04T01:47:30.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.768+0000 7f34b25ce640 1 Processor -- start 2023-11-04T01:47:30.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.768+0000 7f34b25ce640 1 -- start start 2023-11-04T01:47:30.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.768+0000 7f34b25ce640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f34ac0ce150 0x7f34ac0b1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:30.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.768+0000 7f34b25ce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34ac160630 0x7f34ac0b2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:30.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.768+0000 7f34b25ce640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34ac14c9f0 0x7f34ac14cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:30.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.768+0000 7f34b25ce640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac0b4780 con 0x7f34ac160630 2023-11-04T01:47:30.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.768+0000 7f34b25ce640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac14d3e0 con 0x7f34ac14c9f0 2023-11-04T01:47:30.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.768+0000 7f34b25ce640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac0b3b80 con 0x7f34ac0ce150 2023-11-04T01:47:30.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.769+0000 7f34ab7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34ac160630 0x7f34ac0b2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:30.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.769+0000 7f34ab7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34ac160630 0x7f34ac0b2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46100/0 (socket says 172.21.15.77:46100) 2023-11-04T01:47:30.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.769+0000 7f34ab7fe640 1 -- 172.21.15.77:0/1212223268 learned_addr learned my addr 172.21.15.77:0/1212223268 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:30.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.769+0000 7f34b0b6b640 1 --2- 172.21.15.77:0/1212223268 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34ac14c9f0 0x7f34ac14cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:30.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.769+0000 7f34abfff640 1 --2- 172.21.15.77:0/1212223268 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f34ac0ce150 0x7f34ac0b1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:30.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.769+0000 7f34ab7fe640 1 -- 172.21.15.77:0/1212223268 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f34ac0ce150 msgr2=0x7f34ac0b1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:30.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.769+0000 7f34ab7fe640 1 --2- 172.21.15.77:0/1212223268 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f34ac0ce150 0x7f34ac0b1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:30.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.769+0000 7f34ab7fe640 1 -- 172.21.15.77:0/1212223268 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34ac14c9f0 msgr2=0x7f34ac14cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:30.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.769+0000 7f34ab7fe640 1 --2- 172.21.15.77:0/1212223268 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34ac14c9f0 0x7f34ac14cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:30.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.769+0000 7f34ab7fe640 1 -- 172.21.15.77:0/1212223268 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a0009400 con 0x7f34ac160630 2023-11-04T01:47:30.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.769+0000 7f34b0b6b640 1 --2- 172.21.15.77:0/1212223268 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34ac14c9f0 0x7f34ac14cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:30.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.769+0000 7f34ab7fe640 1 --2- 172.21.15.77:0/1212223268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34ac160630 0x7f34ac0b2020 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f34a00098c0 tx=0x7f34a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:30.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.769+0000 7f34a8ff9640 1 -- 172.21.15.77:0/1212223268 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a0031500 con 0x7f34ac160630 2023-11-04T01:47:30.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.769+0000 7f34a8ff9640 1 -- 172.21.15.77:0/1212223268 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a00339b0 con 0x7f34ac160630 2023-11-04T01:47:30.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.769+0000 7f34b25ce640 1 -- 172.21.15.77:0/1212223268 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34ac0b3e00 con 0x7f34ac160630 2023-11-04T01:47:30.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.769+0000 7f34a8ff9640 1 -- 172.21.15.77:0/1212223268 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a0033d60 con 0x7f34ac160630 2023-11-04T01:47:30.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.769+0000 7f34b25ce640 1 -- 172.21.15.77:0/1212223268 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34ac0b43a0 con 0x7f34ac160630 2023-11-04T01:47:30.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.770+0000 7f34b25ce640 1 -- 172.21.15.77:0/1212223268 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34ac0cabd0 con 0x7f34ac160630 2023-11-04T01:47:30.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.771+0000 7f34a8ff9640 1 -- 172.21.15.77:0/1212223268 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f34a003a040 con 0x7f34ac160630 2023-11-04T01:47:30.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.771+0000 7f34a8ff9640 1 --2- 172.21.15.77:0/1212223268 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f349806ae70 0x7f349806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:30.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.771+0000 7f34a8ff9640 1 -- 172.21.15.77:0/1212223268 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f34a00ab070 con 0x7f34ac160630 2023-11-04T01:47:30.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.771+0000 7f34abfff640 1 --2- 172.21.15.77:0/1212223268 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f349806ae70 0x7f349806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:30.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.772+0000 7f34abfff640 1 --2- 172.21.15.77:0/1212223268 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f349806ae70 0x7f349806d330 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f349c000f60 tx=0x7f349c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:30.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.776+0000 7f34a8ff9640 1 -- 172.21.15.77:0/1212223268 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f34a0075840 con 0x7f34ac160630 2023-11-04T01:47:30.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.975+0000 7f34b25ce640 1 -- 172.21.15.77:0/1212223268 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f34ac0b48c0 con 0x7f34ac160630 2023-11-04T01:47:30.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.976+0000 7f34a8ff9640 1 -- 172.21.15.77:0/1212223268 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) v1 ==== 95+0+4152 (secure 0 0 0) 0x7f34ac0b48c0 con 0x7f34ac160630 2023-11-04T01:47:30.977 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:47:30.978 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":112,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:47:30.644000+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7033,"mds_1":8583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7033":{"gid":7033,"name":"b","rank":0,"incarnation":109,"state":"up:resolve","state_seq":11,"addr":"172.21.15.122:6836/2238841748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2238841748},{"type":"v1","addr":"172.21.15.122:6836","nonce":2238841748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8583":{"gid":8583,"name":"c","rank":1,"incarnation":112,"state":"up:replay","state_seq":1,"addr":"172.21.15.77:6833/1157837717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1157837717},{"type":"v1","addr":"172.21.15.77:6833","nonce":1157837717}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:30.978 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 112 2023-11-04T01:47:30.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.977+0000 7f34b25ce640 1 -- 172.21.15.77:0/1212223268 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f349806ae70 msgr2=0x7f349806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:30.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.977+0000 7f34b25ce640 1 --2- 172.21.15.77:0/1212223268 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f349806ae70 0x7f349806d330 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f349c000f60 tx=0x7f349c009040 comp rx=0 tx=0).stop 2023-11-04T01:47:30.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.977+0000 7f34b25ce640 1 -- 172.21.15.77:0/1212223268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34ac160630 msgr2=0x7f34ac0b2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:30.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.977+0000 7f34b25ce640 1 --2- 172.21.15.77:0/1212223268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34ac160630 0x7f34ac0b2020 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f34a00098c0 tx=0x7f34a00046c0 comp rx=0 tx=0).stop 2023-11-04T01:47:30.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.977+0000 7f34b25ce640 1 -- 172.21.15.77:0/1212223268 shutdown_connections 2023-11-04T01:47:30.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.977+0000 7f34b25ce640 1 --2- 172.21.15.77:0/1212223268 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f349806ae70 0x7f349806d330 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:30.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.977+0000 7f34b25ce640 1 --2- 172.21.15.77:0/1212223268 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34ac14c9f0 0x7f34ac14cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:30.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.977+0000 7f34b25ce640 1 --2- 172.21.15.77:0/1212223268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34ac160630 0x7f34ac0b2020 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:30.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.977+0000 7f34b25ce640 1 --2- 172.21.15.77:0/1212223268 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f34ac0ce150 0x7f34ac0b1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:30.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.977+0000 7f34b25ce640 1 -- 172.21.15.77:0/1212223268 >> 172.21.15.77:0/1212223268 conn(0x7f34ac0cb8e0 msgr2=0x7f34ac0ac8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:30.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.977+0000 7f34b25ce640 1 -- 172.21.15.77:0/1212223268 shutdown_connections 2023-11-04T01:47:30.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:30.977+0000 7f34b25ce640 1 -- 172.21.15.77:0/1212223268 wait complete. 2023-11-04T01:47:30.990 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:47:31.515 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:47:31.518 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:47:32.903 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-11-04T01:47:35.991 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:36.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.100+0000 7fd0ff687640 1 Processor -- start 2023-11-04T01:47:36.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.101+0000 7fd0ff687640 1 -- start start 2023-11-04T01:47:36.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.101+0000 7fd0ff687640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0f8159e40 0x7fd0f80b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:36.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.101+0000 7fd0ff687640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd0f8070700 0x7fd0f80b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:36.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.101+0000 7fd0ff687640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0f8071500 con 0x7fd0f806bb60 2023-11-04T01:47:36.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.101+0000 7fd0ff687640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0f815dae0 con 0x7fd0f8070700 2023-11-04T01:47:36.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.101+0000 7fd0ff687640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f8070c60 con 0x7fd0f8159e40 2023-11-04T01:47:36.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.102+0000 7fd0fd423640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0f8159e40 0x7fd0f80b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:36.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.102+0000 7fd0fdc24640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd0f8070700 0x7fd0f80b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:36.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.102+0000 7fd0fcc22640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fd0f806bb60 0x7fd0f806fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:43702/0 (socket says 172.21.15.77:43702) 2023-11-04T01:47:36.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.102+0000 7fd0fcc22640 1 -- 172.21.15.77:0/306613840 learned_addr learned my addr 172.21.15.77:0/306613840 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:47:36.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.102+0000 7fd0fd423640 1 -- 172.21.15.77:0/306613840 >> v2:172.21.15.122:3300/0 conn(0x7fd0f8070700 msgr2=0x7fd0f80b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:36.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.102+0000 7fd0fd423640 1 --2- 172.21.15.77:0/306613840 >> v2:172.21.15.122:3300/0 conn(0x7fd0f8070700 0x7fd0f80b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:36.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.102+0000 7fd0fd423640 1 -- 172.21.15.77:0/306613840 >> v1:172.21.15.122:6789/0 conn(0x7fd0f806bb60 legacy=0x7fd0f806fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:36.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.102+0000 7fd0fd423640 1 -- 172.21.15.77:0/306613840 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f8070f40 con 0x7fd0f8159e40 2023-11-04T01:47:36.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.102+0000 7fd0fdc24640 1 --2- 172.21.15.77:0/306613840 >> v2:172.21.15.122:3300/0 conn(0x7fd0f8070700 0x7fd0f80b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:47:36.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.103+0000 7fd0fd423640 1 --2- 172.21.15.77:0/306613840 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0f8159e40 0x7fd0f80b0530 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd0f40097a0 tx=0x7fd0f402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ed41c4473c9a7c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:36.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.103+0000 7fd0effff640 1 -- 172.21.15.77:0/306613840 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f402e070 con 0x7fd0f8159e40 2023-11-04T01:47:36.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.103+0000 7fd0effff640 1 -- 172.21.15.77:0/306613840 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f40315a0 con 0x7fd0f8159e40 2023-11-04T01:47:36.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.103+0000 7fd0effff640 1 -- 172.21.15.77:0/306613840 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f4031930 con 0x7fd0f8159e40 2023-11-04T01:47:36.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.104+0000 7fd0ff687640 1 -- 172.21.15.77:0/306613840 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0f8159e40 msgr2=0x7fd0f80b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:36.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.104+0000 7fd0ff687640 1 --2- 172.21.15.77:0/306613840 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0f8159e40 0x7fd0f80b0530 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd0f40097a0 tx=0x7fd0f402b840 comp rx=0 tx=0).stop 2023-11-04T01:47:36.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.104+0000 7fd0ff687640 1 -- 172.21.15.77:0/306613840 shutdown_connections 2023-11-04T01:47:36.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.104+0000 7fd0ff687640 1 --2- 172.21.15.77:0/306613840 >> v2:172.21.15.122:3300/0 conn(0x7fd0f8070700 0x7fd0f80b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:36.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.104+0000 7fd0ff687640 1 --2- 172.21.15.77:0/306613840 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0f8159e40 0x7fd0f80b0530 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:36.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.104+0000 7fd0ff687640 1 -- 172.21.15.77:0/306613840 >> 172.21.15.77:0/306613840 conn(0x7fd0f80cb530 msgr2=0x7fd0f80cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:36.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.104+0000 7fd0ff687640 1 -- 172.21.15.77:0/306613840 shutdown_connections 2023-11-04T01:47:36.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.104+0000 7fd0ff687640 1 -- 172.21.15.77:0/306613840 wait complete. 2023-11-04T01:47:36.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.105+0000 7fd0ff687640 1 Processor -- start 2023-11-04T01:47:36.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.105+0000 7fd0ff687640 1 -- start start 2023-11-04T01:47:36.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.106+0000 7fd0ff687640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0f806bb60 0x7fd0f8156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:36.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.106+0000 7fd0ff687640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0f8070700 0x7fd0f80cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:36.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.106+0000 7fd0ff687640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0f8159e40 0x7fd0f80ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:36.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.106+0000 7fd0ff687640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f80c8360 con 0x7fd0f8070700 2023-11-04T01:47:36.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.106+0000 7fd0ff687640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f80c6760 con 0x7fd0f8159e40 2023-11-04T01:47:36.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.106+0000 7fd0ff687640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f80c6a40 con 0x7fd0f806bb60 2023-11-04T01:47:36.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.106+0000 7fd0fcc22640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0f8070700 0x7fd0f80cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:36.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.106+0000 7fd0fcc22640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0f8070700 0x7fd0f80cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46102/0 (socket says 172.21.15.77:46102) 2023-11-04T01:47:36.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.106+0000 7fd0fcc22640 1 -- 172.21.15.77:0/3975949423 learned_addr learned my addr 172.21.15.77:0/3975949423 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:36.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.106+0000 7fd0fdc24640 1 --2- 172.21.15.77:0/3975949423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0f8159e40 0x7fd0f80ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:36.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.106+0000 7fd0fd423640 1 --2- 172.21.15.77:0/3975949423 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0f806bb60 0x7fd0f8156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:36.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.106+0000 7fd0fcc22640 1 -- 172.21.15.77:0/3975949423 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0f806bb60 msgr2=0x7fd0f8156e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:36.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.106+0000 7fd0fcc22640 1 --2- 172.21.15.77:0/3975949423 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0f806bb60 0x7fd0f8156e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:36.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.106+0000 7fd0fcc22640 1 -- 172.21.15.77:0/3975949423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0f8159e40 msgr2=0x7fd0f80ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:36.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.106+0000 7fd0fcc22640 1 --2- 172.21.15.77:0/3975949423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0f8159e40 0x7fd0f80ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:36.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.106+0000 7fd0fcc22640 1 -- 172.21.15.77:0/3975949423 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f0009a70 con 0x7fd0f8070700 2023-11-04T01:47:36.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.106+0000 7fd0fcc22640 1 --2- 172.21.15.77:0/3975949423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0f8070700 0x7fd0f80cc680 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fd0e800c4a0 tx=0x7fd0e800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:36.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.107+0000 7fd0edffb640 1 -- 172.21.15.77:0/3975949423 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e8005ce0 con 0x7fd0f8070700 2023-11-04T01:47:36.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.107+0000 7fd0edffb640 1 -- 172.21.15.77:0/3975949423 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e8005e40 con 0x7fd0f8070700 2023-11-04T01:47:36.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.107+0000 7fd0ff687640 1 -- 172.21.15.77:0/3975949423 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0f4009400 con 0x7fd0f8070700 2023-11-04T01:47:36.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.107+0000 7fd0edffb640 1 -- 172.21.15.77:0/3975949423 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e8007270 con 0x7fd0f8070700 2023-11-04T01:47:36.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.107+0000 7fd0ff687640 1 -- 172.21.15.77:0/3975949423 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0f80c7000 con 0x7fd0f8070700 2023-11-04T01:47:36.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.108+0000 7fd0ff687640 1 -- 172.21.15.77:0/3975949423 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0f80684b0 con 0x7fd0f8070700 2023-11-04T01:47:36.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.108+0000 7fd0edffb640 1 -- 172.21.15.77:0/3975949423 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd0e8007490 con 0x7fd0f8070700 2023-11-04T01:47:36.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.109+0000 7fd0edffb640 1 --2- 172.21.15.77:0/3975949423 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd0dc06ae70 0x7fd0dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:36.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.109+0000 7fd0edffb640 1 -- 172.21.15.77:0/3975949423 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fd0e8089330 con 0x7fd0f8070700 2023-11-04T01:47:36.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.109+0000 7fd0fd423640 1 --2- 172.21.15.77:0/3975949423 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd0dc06ae70 0x7fd0dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:36.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.110+0000 7fd0fd423640 1 --2- 172.21.15.77:0/3975949423 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd0dc06ae70 0x7fd0dc06d330 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4036000 tx=0x7fd0f403d040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:36.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.113+0000 7fd0edffb640 1 -- 172.21.15.77:0/3975949423 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd0e8053bb0 con 0x7fd0f8070700 2023-11-04T01:47:36.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.314+0000 7fd0ff687640 1 -- 172.21.15.77:0/3975949423 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0f80a9820 con 0x7fd0f8070700 2023-11-04T01:47:36.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.314+0000 7fd0edffb640 1 -- 172.21.15.77:0/3975949423 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4949 (secure 0 0 0) 0x7fd0e8017020 con 0x7fd0f8070700 2023-11-04T01:47:36.316 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:47:36.317 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":114,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2985885329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2985885329},{"type":"v1","addr":"172.21.15.77:6835","nonce":2985885329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:47:31.658164+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7033,"mds_1":8583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7033":{"gid":7033,"name":"b","rank":0,"incarnation":109,"state":"up:reconnect","state_seq":14,"addr":"172.21.15.122:6836/2238841748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2238841748},{"type":"v1","addr":"172.21.15.122:6836","nonce":2238841748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8583":{"gid":8583,"name":"c","rank":1,"incarnation":112,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.77:6833/1157837717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1157837717},{"type":"v1","addr":"172.21.15.77:6833","nonce":1157837717}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:36.317 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 114 2023-11-04T01:47:36.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.316+0000 7fd0ff687640 1 -- 172.21.15.77:0/3975949423 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd0dc06ae70 msgr2=0x7fd0dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:36.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.316+0000 7fd0ff687640 1 --2- 172.21.15.77:0/3975949423 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd0dc06ae70 0x7fd0dc06d330 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4036000 tx=0x7fd0f403d040 comp rx=0 tx=0).stop 2023-11-04T01:47:36.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.316+0000 7fd0ff687640 1 -- 172.21.15.77:0/3975949423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0f8070700 msgr2=0x7fd0f80cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:36.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.316+0000 7fd0ff687640 1 --2- 172.21.15.77:0/3975949423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0f8070700 0x7fd0f80cc680 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fd0e800c4a0 tx=0x7fd0e800c960 comp rx=0 tx=0).stop 2023-11-04T01:47:36.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.316+0000 7fd0ff687640 1 -- 172.21.15.77:0/3975949423 shutdown_connections 2023-11-04T01:47:36.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.316+0000 7fd0ff687640 1 --2- 172.21.15.77:0/3975949423 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd0dc06ae70 0x7fd0dc06d330 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:36.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.316+0000 7fd0ff687640 1 --2- 172.21.15.77:0/3975949423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0f8159e40 0x7fd0f80ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:36.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.316+0000 7fd0ff687640 1 --2- 172.21.15.77:0/3975949423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0f8070700 0x7fd0f80cc680 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:36.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.316+0000 7fd0ff687640 1 --2- 172.21.15.77:0/3975949423 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd0f806bb60 0x7fd0f8156e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:36.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.316+0000 7fd0ff687640 1 -- 172.21.15.77:0/3975949423 >> 172.21.15.77:0/3975949423 conn(0x7fd0f80cb530 msgr2=0x7fd0f815c230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:36.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.316+0000 7fd0ff687640 1 -- 172.21.15.77:0/3975949423 shutdown_connections 2023-11-04T01:47:36.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.316+0000 7fd0ff687640 1 -- 172.21.15.77:0/3975949423 wait complete. 2023-11-04T01:47:36.328 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:47:36.329 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:36.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.426+0000 7f634ccd7640 1 Processor -- start 2023-11-04T01:47:36.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.426+0000 7f634ccd7640 1 -- start start 2023-11-04T01:47:36.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.427+0000 7f634ccd7640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f63480b0c40 0x7f634806fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:36.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.427+0000 7f634ccd7640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f634806bb60 0x7f6348070530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:36.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.427+0000 7f634ccd7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6348071500 con 0x7f6348159e40 2023-11-04T01:47:36.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.427+0000 7f634ccd7640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6348070a70 con 0x7f634806bb60 2023-11-04T01:47:36.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.427+0000 7f634ccd7640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634815dae0 con 0x7f63480b0c40 2023-11-04T01:47:36.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.427+0000 7f634659c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6348159e40 0x7f63480b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:38602/0 (socket says 172.21.15.77:38602) 2023-11-04T01:47:36.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.427+0000 7f634659c640 1 -- 172.21.15.77:0/3510895041 learned_addr learned my addr 172.21.15.77:0/3510895041 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:47:36.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.427+0000 7f6346d9d640 1 --2- 172.21.15.77:0/3510895041 >> v2:172.21.15.122:3300/0 conn(0x7f634806bb60 0x7f6348070530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:36.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.427+0000 7f6345d9b640 1 --2- 172.21.15.77:0/3510895041 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f63480b0c40 0x7f634806fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:36.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.427+0000 7f634559a640 1 -- 172.21.15.77:0/3510895041 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3536930098 0 0) 0x7f6348071500 con 0x7f6348159e40 2023-11-04T01:47:36.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.427+0000 7f634559a640 1 -- 172.21.15.77:0/3510895041 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6330003520 con 0x7f6348159e40 2023-11-04T01:47:36.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.427+0000 7f634559a640 1 -- 172.21.15.77:0/3510895041 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3427627849 0 0) 0x7f6330003520 con 0x7f6348159e40 2023-11-04T01:47:36.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.428+0000 7f634559a640 1 -- 172.21.15.77:0/3510895041 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f63480b0c40 msgr2=0x7f634806fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:36.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.428+0000 7f634559a640 1 --2- 172.21.15.77:0/3510895041 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f63480b0c40 0x7f634806fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:36.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.428+0000 7f634559a640 1 -- 172.21.15.77:0/3510895041 >> v2:172.21.15.122:3300/0 conn(0x7f634806bb60 msgr2=0x7f6348070530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:36.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.428+0000 7f634559a640 1 --2- 172.21.15.77:0/3510895041 >> v2:172.21.15.122:3300/0 conn(0x7f634806bb60 0x7f6348070530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:36.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.428+0000 7f634559a640 1 -- 172.21.15.77:0/3510895041 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6348070c60 con 0x7f6348159e40 2023-11-04T01:47:36.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.428+0000 7f634559a640 1 -- 172.21.15.77:0/3510895041 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f6338001670 con 0x7f6348159e40 2023-11-04T01:47:36.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.428+0000 7f6346d9d640 1 --2- 172.21.15.77:0/3510895041 >> v2:172.21.15.122:3300/0 conn(0x7f634806bb60 0x7f6348070530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:47:36.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.428+0000 7f6345d9b640 1 --2- 172.21.15.77:0/3510895041 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f63480b0c40 0x7f634806fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:47:36.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.428+0000 7f634559a640 1 -- 172.21.15.77:0/3510895041 >> v1:172.21.15.77:6789/0 conn(0x7f6348159e40 legacy=0x7f63480b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:36.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.428+0000 7f634559a640 1 --2- 172.21.15.77:0/3510895041 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f63480b0c40 0x7f6330003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:36.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.428+0000 7f634559a640 1 --2- 172.21.15.77:0/3510895041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6330003eb0 0x7f63300047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:36.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.428+0000 7f634559a640 1 --2- 172.21.15.77:0/3510895041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6330004d00 0x7f6330005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:36.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.428+0000 7f634559a640 1 -- 172.21.15.77:0/3510895041 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634815dae0 con 0x7f6330003eb0 2023-11-04T01:47:36.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.428+0000 7f634559a640 1 -- 172.21.15.77:0/3510895041 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633000b980 con 0x7f6330004d00 2023-11-04T01:47:36.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.428+0000 7f634559a640 1 -- 172.21.15.77:0/3510895041 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633000bac0 con 0x7f63480b0c40 2023-11-04T01:47:36.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.428+0000 7f6345d9b640 1 --2- 172.21.15.77:0/3510895041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6330003eb0 0x7f63300047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:36.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.428+0000 7f634659c640 1 --2- 172.21.15.77:0/3510895041 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f63480b0c40 0x7f6330003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:36.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.428+0000 7f6346d9d640 1 --2- 172.21.15.77:0/3510895041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6330004d00 0x7f6330005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:36.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.428+0000 7f6345d9b640 1 -- 172.21.15.77:0/3510895041 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f63480b0c40 msgr2=0x7f6330003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:36.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.428+0000 7f6345d9b640 1 --2- 172.21.15.77:0/3510895041 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f63480b0c40 0x7f6330003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:36.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.428+0000 7f6345d9b640 1 -- 172.21.15.77:0/3510895041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6330004d00 msgr2=0x7f6330005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:36.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.428+0000 7f6345d9b640 1 --2- 172.21.15.77:0/3510895041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6330004d00 0x7f6330005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:36.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.428+0000 7f6345d9b640 1 -- 172.21.15.77:0/3510895041 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633c009400 con 0x7f6330003eb0 2023-11-04T01:47:36.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.428+0000 7f6346d9d640 1 --2- 172.21.15.77:0/3510895041 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6330004d00 0x7f6330005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:36.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.429+0000 7f6345d9b640 1 --2- 172.21.15.77:0/3510895041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6330003eb0 0x7f63300047c0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f633c009c90 tx=0x7f63300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53de1ee2e804733e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:36.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.429+0000 7f634559a640 1 -- 172.21.15.77:0/3510895041 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c02c8f0 con 0x7f6330003eb0 2023-11-04T01:47:36.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.429+0000 7f634559a640 1 -- 172.21.15.77:0/3510895041 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633c02ca50 con 0x7f6330003eb0 2023-11-04T01:47:36.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.429+0000 7f634559a640 1 -- 172.21.15.77:0/3510895041 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c02ce40 con 0x7f6330003eb0 2023-11-04T01:47:36.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.429+0000 7f634ccd7640 1 -- 172.21.15.77:0/3510895041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6330003eb0 msgr2=0x7f63300047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:36.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.429+0000 7f634ccd7640 1 --2- 172.21.15.77:0/3510895041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6330003eb0 0x7f63300047c0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f633c009c90 tx=0x7f63300057f0 comp rx=0 tx=0).stop 2023-11-04T01:47:36.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.429+0000 7f6346d9d640 1 -- 172.21.15.77:0/3510895041 reap_dead start 2023-11-04T01:47:36.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.429+0000 7f634ccd7640 1 -- 172.21.15.77:0/3510895041 shutdown_connections 2023-11-04T01:47:36.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.429+0000 7f634ccd7640 1 -- 172.21.15.77:0/3510895041 >> 172.21.15.77:0/3510895041 conn(0x7f63480cb530 msgr2=0x7f63480cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:36.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.429+0000 7f634ccd7640 1 -- 172.21.15.77:0/3510895041 shutdown_connections 2023-11-04T01:47:36.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.429+0000 7f634ccd7640 1 -- 172.21.15.77:0/3510895041 wait complete. 2023-11-04T01:47:36.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.431+0000 7f634ccd7640 1 Processor -- start 2023-11-04T01:47:36.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.431+0000 7f634ccd7640 1 -- start start 2023-11-04T01:47:36.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.432+0000 7f634ccd7640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6330003eb0 0x7f63481f2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:36.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.432+0000 7f634ccd7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63480c50b0 0x7f63481e4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:36.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.432+0000 7f634ccd7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63480ca280 0x7f63480ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:36.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.432+0000 7f634ccd7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63480cac40 con 0x7f63480c50b0 2023-11-04T01:47:36.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.432+0000 7f634ccd7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63481eff10 con 0x7f63480ca280 2023-11-04T01:47:36.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.432+0000 7f634ccd7640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63481f40a0 con 0x7f6330003eb0 2023-11-04T01:47:36.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.432+0000 7f6345d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63480c50b0 0x7f63481e4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:36.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.432+0000 7f6345d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63480c50b0 0x7f63481e4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46118/0 (socket says 172.21.15.77:46118) 2023-11-04T01:47:36.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.432+0000 7f6345d9b640 1 -- 172.21.15.77:0/2917382608 learned_addr learned my addr 172.21.15.77:0/2917382608 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:36.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.432+0000 7f6345d9b640 1 -- 172.21.15.77:0/2917382608 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6330003eb0 msgr2=0x7f63481f2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:36.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.432+0000 7f6345d9b640 1 --2- 172.21.15.77:0/2917382608 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6330003eb0 0x7f63481f2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:36.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.432+0000 7f6345d9b640 1 -- 172.21.15.77:0/2917382608 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63480ca280 msgr2=0x7f63480ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:36.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.432+0000 7f6345d9b640 1 --2- 172.21.15.77:0/2917382608 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63480ca280 0x7f63480ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:36.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.432+0000 7f6345d9b640 1 -- 172.21.15.77:0/2917382608 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63481e4580 con 0x7f63480c50b0 2023-11-04T01:47:36.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.432+0000 7f6345d9b640 1 --2- 172.21.15.77:0/2917382608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63480c50b0 0x7f63481e4040 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f633c009db0 tx=0x7f633c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:36.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.432+0000 7f6336ffd640 1 -- 172.21.15.77:0/2917382608 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c034c40 con 0x7f63480c50b0 2023-11-04T01:47:36.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.432+0000 7f6336ffd640 1 -- 172.21.15.77:0/2917382608 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633c034da0 con 0x7f63480c50b0 2023-11-04T01:47:36.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.432+0000 7f6336ffd640 1 -- 172.21.15.77:0/2917382608 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c004260 con 0x7f63480c50b0 2023-11-04T01:47:36.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.432+0000 7f634ccd7640 1 -- 172.21.15.77:0/2917382608 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63481f3490 con 0x7f63480c50b0 2023-11-04T01:47:36.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.432+0000 7f634ccd7640 1 -- 172.21.15.77:0/2917382608 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63481f3a50 con 0x7f63480c50b0 2023-11-04T01:47:36.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.433+0000 7f634ccd7640 1 -- 172.21.15.77:0/2917382608 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63480684b0 con 0x7f63480c50b0 2023-11-04T01:47:36.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.434+0000 7f6336ffd640 1 -- 172.21.15.77:0/2917382608 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f633c003610 con 0x7f63480c50b0 2023-11-04T01:47:36.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.434+0000 7f6336ffd640 1 --2- 172.21.15.77:0/2917382608 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f632806ae70 0x7f632806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:36.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.434+0000 7f6336ffd640 1 -- 172.21.15.77:0/2917382608 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f633c0abdb0 con 0x7f63480c50b0 2023-11-04T01:47:36.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.434+0000 7f634659c640 1 --2- 172.21.15.77:0/2917382608 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f632806ae70 0x7f632806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:36.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.435+0000 7f634659c640 1 --2- 172.21.15.77:0/2917382608 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f632806ae70 0x7f632806d330 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f6338001cc0 tx=0x7f6338001b70 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:36.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.438+0000 7f6336ffd640 1 -- 172.21.15.77:0/2917382608 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f633c076500 con 0x7f63480c50b0 2023-11-04T01:47:36.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.638+0000 7f634ccd7640 1 -- 172.21.15.77:0/2917382608 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63480c9750 con 0x7f63480c50b0 2023-11-04T01:47:36.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.638+0000 7f6336ffd640 1 -- 172.21.15.77:0/2917382608 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4949 (secure 0 0 0) 0x7f633c079b20 con 0x7f63480c50b0 2023-11-04T01:47:36.641 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:47:36.641 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":114,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2985885329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2985885329},{"type":"v1","addr":"172.21.15.77:6835","nonce":2985885329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:47:31.658164+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7033,"mds_1":8583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7033":{"gid":7033,"name":"b","rank":0,"incarnation":109,"state":"up:reconnect","state_seq":14,"addr":"172.21.15.122:6836/2238841748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2238841748},{"type":"v1","addr":"172.21.15.122:6836","nonce":2238841748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8583":{"gid":8583,"name":"c","rank":1,"incarnation":112,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.77:6833/1157837717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1157837717},{"type":"v1","addr":"172.21.15.77:6833","nonce":1157837717}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:36.641 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 114 2023-11-04T01:47:36.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.640+0000 7f634ccd7640 1 -- 172.21.15.77:0/2917382608 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f632806ae70 msgr2=0x7f632806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:36.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.640+0000 7f634ccd7640 1 --2- 172.21.15.77:0/2917382608 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f632806ae70 0x7f632806d330 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f6338001cc0 tx=0x7f6338001b70 comp rx=0 tx=0).stop 2023-11-04T01:47:36.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.640+0000 7f634ccd7640 1 -- 172.21.15.77:0/2917382608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63480c50b0 msgr2=0x7f63481e4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:36.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.640+0000 7f634ccd7640 1 --2- 172.21.15.77:0/2917382608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63480c50b0 0x7f63481e4040 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f633c009db0 tx=0x7f633c004730 comp rx=0 tx=0).stop 2023-11-04T01:47:36.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.640+0000 7f634ccd7640 1 -- 172.21.15.77:0/2917382608 shutdown_connections 2023-11-04T01:47:36.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.640+0000 7f634ccd7640 1 --2- 172.21.15.77:0/2917382608 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f632806ae70 0x7f632806d330 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:36.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.640+0000 7f634ccd7640 1 --2- 172.21.15.77:0/2917382608 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63480ca280 0x7f63480ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:36.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.640+0000 7f634ccd7640 1 --2- 172.21.15.77:0/2917382608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63480c50b0 0x7f63481e4040 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:36.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.640+0000 7f634ccd7640 1 --2- 172.21.15.77:0/2917382608 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f6330003eb0 0x7f63481f2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:36.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.640+0000 7f634ccd7640 1 -- 172.21.15.77:0/2917382608 >> 172.21.15.77:0/2917382608 conn(0x7f63480cb530 msgr2=0x7f6348070450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:36.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.640+0000 7f634ccd7640 1 -- 172.21.15.77:0/2917382608 shutdown_connections 2023-11-04T01:47:36.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:36.641+0000 7f634ccd7640 1 -- 172.21.15.77:0/2917382608 wait complete. 2023-11-04T01:47:36.653 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:47:37.654 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:37.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.764+0000 7f88d0af2640 1 Processor -- start 2023-11-04T01:47:37.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.764+0000 7f88d0af2640 1 -- start start 2023-11-04T01:47:37.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.765+0000 7f88d0af2640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f88cc0b0c40 0x7f88cc06fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:37.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.765+0000 7f88d0af2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f88cc06bb60 0x7f88cc070530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:37.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.765+0000 7f88d0af2640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88cc071500 con 0x7f88cc159e40 2023-11-04T01:47:37.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.765+0000 7f88d0af2640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88cc070a70 con 0x7f88cc06bb60 2023-11-04T01:47:37.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.765+0000 7f88d0af2640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88cc15dae0 con 0x7f88cc0b0c40 2023-11-04T01:47:37.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.765+0000 7f88cad9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f88cc06bb60 0x7f88cc070530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:37.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.765+0000 7f88cad9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f88cc06bb60 0x7f88cc070530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35196/0 (socket says 172.21.15.77:35196) 2023-11-04T01:47:37.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.765+0000 7f88cad9d640 1 -- 172.21.15.77:0/4126482520 learned_addr learned my addr 172.21.15.77:0/4126482520 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:37.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.765+0000 7f88c9d9b640 1 --2- 172.21.15.77:0/4126482520 >> v2:172.21.15.122:3300/0 conn(0x7f88cc0b0c40 0x7f88cc06fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:37.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.765+0000 7f88cad9d640 1 -- 172.21.15.77:0/4126482520 >> v2:172.21.15.122:3300/0 conn(0x7f88cc0b0c40 msgr2=0x7f88cc06fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:37.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.765+0000 7f88cad9d640 1 --2- 172.21.15.77:0/4126482520 >> v2:172.21.15.122:3300/0 conn(0x7f88cc0b0c40 0x7f88cc06fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.765+0000 7f88cad9d640 1 -- 172.21.15.77:0/4126482520 >> v1:172.21.15.122:6789/0 conn(0x7f88cc159e40 legacy=0x7f88cc0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:37.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.766+0000 7f88cad9d640 1 -- 172.21.15.77:0/4126482520 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88cc070c60 con 0x7f88cc06bb60 2023-11-04T01:47:37.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.766+0000 7f88cad9d640 1 --2- 172.21.15.77:0/4126482520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88cc06bb60 0x7f88cc070530 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f88cc06fdc0 tx=0x7f88c402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b224b3774674caf7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:37.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.766+0000 7f88c959a640 1 -- 172.21.15.77:0/4126482520 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c4031870 con 0x7f88cc06bb60 2023-11-04T01:47:37.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.766+0000 7f88c959a640 1 -- 172.21.15.77:0/4126482520 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c40319d0 con 0x7f88cc06bb60 2023-11-04T01:47:37.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.766+0000 7f88c959a640 1 -- 172.21.15.77:0/4126482520 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c4031d60 con 0x7f88cc06bb60 2023-11-04T01:47:37.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.767+0000 7f88d0af2640 1 -- 172.21.15.77:0/4126482520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88cc06bb60 msgr2=0x7f88cc070530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:37.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.767+0000 7f88d0af2640 1 --2- 172.21.15.77:0/4126482520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88cc06bb60 0x7f88cc070530 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f88cc06fdc0 tx=0x7f88c402b910 comp rx=0 tx=0).stop 2023-11-04T01:47:37.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.767+0000 7f88d0af2640 1 -- 172.21.15.77:0/4126482520 shutdown_connections 2023-11-04T01:47:37.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.767+0000 7f88d0af2640 1 --2- 172.21.15.77:0/4126482520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88cc06bb60 0x7f88cc070530 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.767+0000 7f88d0af2640 1 --2- 172.21.15.77:0/4126482520 >> v2:172.21.15.122:3300/0 conn(0x7f88cc0b0c40 0x7f88cc06fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.767+0000 7f88d0af2640 1 -- 172.21.15.77:0/4126482520 >> 172.21.15.77:0/4126482520 conn(0x7f88cc0cb530 msgr2=0x7f88cc0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:37.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.767+0000 7f88d0af2640 1 -- 172.21.15.77:0/4126482520 shutdown_connections 2023-11-04T01:47:37.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.767+0000 7f88d0af2640 1 -- 172.21.15.77:0/4126482520 wait complete. 2023-11-04T01:47:37.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.768+0000 7f88d0af2640 1 Processor -- start 2023-11-04T01:47:37.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.768+0000 7f88d0af2640 1 -- start start 2023-11-04T01:47:37.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.769+0000 7f88d0af2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88cc06bb60 0x7f88cc0c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:37.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.769+0000 7f88d0af2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88cc0b0c40 0x7f88cc0c4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:37.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.769+0000 7f88d0af2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f88cc159e40 0x7f88cc0c4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:37.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.769+0000 7f88d0af2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88cc0c4330 con 0x7f88cc0b0c40 2023-11-04T01:47:37.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.769+0000 7f88d0af2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88cc147810 con 0x7f88cc06bb60 2023-11-04T01:47:37.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.769+0000 7f88d0af2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88cc0c36b0 con 0x7f88cc159e40 2023-11-04T01:47:37.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.769+0000 7f88c9d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88cc0b0c40 0x7f88cc0c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:37.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.769+0000 7f88c9d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88cc0b0c40 0x7f88cc0c4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35210/0 (socket says 172.21.15.77:35210) 2023-11-04T01:47:37.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.769+0000 7f88c9d9b640 1 -- 172.21.15.77:0/3795753346 learned_addr learned my addr 172.21.15.77:0/3795753346 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:37.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.770+0000 7f88c9d9b640 1 -- 172.21.15.77:0/3795753346 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f88cc159e40 msgr2=0x7f88cc0c4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:37.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.770+0000 7f88c9d9b640 1 --2- 172.21.15.77:0/3795753346 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f88cc159e40 0x7f88cc0c4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.770+0000 7f88c9d9b640 1 -- 172.21.15.77:0/3795753346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88cc06bb60 msgr2=0x7f88cc0c7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:37.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.770+0000 7f88ca59c640 1 --2- 172.21.15.77:0/3795753346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88cc06bb60 0x7f88cc0c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:37.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.770+0000 7f88c9d9b640 1 --2- 172.21.15.77:0/3795753346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88cc06bb60 0x7f88cc0c7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.770+0000 7f88c9d9b640 1 -- 172.21.15.77:0/3795753346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c40094d0 con 0x7f88cc0b0c40 2023-11-04T01:47:37.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.770+0000 7f88c9d9b640 1 --2- 172.21.15.77:0/3795753346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88cc0b0c40 0x7f88cc0c4780 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f88c000d800 tx=0x7f88c000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:37.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.770+0000 7f88baffd640 1 -- 172.21.15.77:0/3795753346 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c000b6c0 con 0x7f88cc0b0c40 2023-11-04T01:47:37.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.770+0000 7f88baffd640 1 -- 172.21.15.77:0/3795753346 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c000b840 con 0x7f88cc0b0c40 2023-11-04T01:47:37.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.770+0000 7f88baffd640 1 -- 172.21.15.77:0/3795753346 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c000bbf0 con 0x7f88cc0b0c40 2023-11-04T01:47:37.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.770+0000 7f88d0af2640 1 -- 172.21.15.77:0/3795753346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88cc0c3990 con 0x7f88cc0b0c40 2023-11-04T01:47:37.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.770+0000 7f88d0af2640 1 -- 172.21.15.77:0/3795753346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88cc0c3f50 con 0x7f88cc0b0c40 2023-11-04T01:47:37.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.771+0000 7f88d0af2640 1 -- 172.21.15.77:0/3795753346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88cc0684b0 con 0x7f88cc0b0c40 2023-11-04T01:47:37.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.771+0000 7f88baffd640 1 -- 172.21.15.77:0/3795753346 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f88c000bd50 con 0x7f88cc0b0c40 2023-11-04T01:47:37.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.772+0000 7f88baffd640 1 --2- 172.21.15.77:0/3795753346 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f88ac06aea0 0x7f88ac06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:37.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.772+0000 7f88baffd640 1 -- 172.21.15.77:0/3795753346 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f88c008a4d0 con 0x7f88cc0b0c40 2023-11-04T01:47:37.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.772+0000 7f88ca59c640 1 --2- 172.21.15.77:0/3795753346 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f88ac06aea0 0x7f88ac06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:37.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.772+0000 7f88ca59c640 1 --2- 172.21.15.77:0/3795753346 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f88ac06aea0 0x7f88ac06d360 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f88bc007fd0 tx=0x7f88bc009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:37.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.776+0000 7f88baffd640 1 -- 172.21.15.77:0/3795753346 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f88c0054c10 con 0x7f88cc0b0c40 2023-11-04T01:47:37.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.976+0000 7f88d0af2640 1 -- 172.21.15.77:0/3795753346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88cc0c4110 con 0x7f88cc0b0c40 2023-11-04T01:47:37.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.977+0000 7f88baffd640 1 -- 172.21.15.77:0/3795753346 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4949 (secure 0 0 0) 0x7f88c0058230 con 0x7f88cc0b0c40 2023-11-04T01:47:37.979 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:47:37.980 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":114,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2985885329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2985885329},{"type":"v1","addr":"172.21.15.77:6835","nonce":2985885329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:47:31.658164+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7033,"mds_1":8583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7033":{"gid":7033,"name":"b","rank":0,"incarnation":109,"state":"up:reconnect","state_seq":14,"addr":"172.21.15.122:6836/2238841748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2238841748},{"type":"v1","addr":"172.21.15.122:6836","nonce":2238841748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8583":{"gid":8583,"name":"c","rank":1,"incarnation":112,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.77:6833/1157837717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1157837717},{"type":"v1","addr":"172.21.15.77:6833","nonce":1157837717}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:37.981 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 114 2023-11-04T01:47:37.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.979+0000 7f88d0af2640 1 -- 172.21.15.77:0/3795753346 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f88ac06aea0 msgr2=0x7f88ac06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:37.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.979+0000 7f88d0af2640 1 --2- 172.21.15.77:0/3795753346 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f88ac06aea0 0x7f88ac06d360 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f88bc007fd0 tx=0x7f88bc009040 comp rx=0 tx=0).stop 2023-11-04T01:47:37.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.979+0000 7f88d0af2640 1 -- 172.21.15.77:0/3795753346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88cc0b0c40 msgr2=0x7f88cc0c4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:37.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.979+0000 7f88d0af2640 1 --2- 172.21.15.77:0/3795753346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88cc0b0c40 0x7f88cc0c4780 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f88c000d800 tx=0x7f88c000dcc0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.979+0000 7f88d0af2640 1 -- 172.21.15.77:0/3795753346 shutdown_connections 2023-11-04T01:47:37.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.979+0000 7f88d0af2640 1 --2- 172.21.15.77:0/3795753346 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f88ac06aea0 0x7f88ac06d360 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.979+0000 7f88d0af2640 1 --2- 172.21.15.77:0/3795753346 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f88cc159e40 0x7f88cc0c4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.979+0000 7f88d0af2640 1 --2- 172.21.15.77:0/3795753346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88cc0b0c40 0x7f88cc0c4780 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.979+0000 7f88d0af2640 1 --2- 172.21.15.77:0/3795753346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88cc06bb60 0x7f88cc0c7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.979+0000 7f88d0af2640 1 -- 172.21.15.77:0/3795753346 >> 172.21.15.77:0/3795753346 conn(0x7f88cc0cb530 msgr2=0x7f88cc0ae4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:37.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.979+0000 7f88d0af2640 1 -- 172.21.15.77:0/3795753346 shutdown_connections 2023-11-04T01:47:37.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:37.979+0000 7f88d0af2640 1 -- 172.21.15.77:0/3795753346 wait complete. 2023-11-04T01:47:37.991 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:47:38.992 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:39.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.096+0000 7fad9ba1a640 1 Processor -- start 2023-11-04T01:47:39.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.097+0000 7fad9ba1a640 1 -- start start 2023-11-04T01:47:39.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.097+0000 7fad9ba1a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fad9415d4e0 0x7fad940ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:39.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.097+0000 7fad9ba1a640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fad940ca8b0 0x7fad9406a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:39.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.098+0000 7fad9ba1a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad940b25a0 con 0x7fad940ced90 2023-11-04T01:47:39.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.098+0000 7fad9ba1a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad940b2300 con 0x7fad9415d4e0 2023-11-04T01:47:39.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.098+0000 7fad9ba1a640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad9415d8c0 con 0x7fad940ca8b0 2023-11-04T01:47:39.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.098+0000 7fad997b6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fad9415d4e0 0x7fad940ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:39.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.098+0000 7fad98fb5640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fad940ced90 0x7fad940ca1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35964/0 (socket says 172.21.15.77:35964) 2023-11-04T01:47:39.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.098+0000 7fad98fb5640 1 -- 172.21.15.77:0/4045689400 learned_addr learned my addr 172.21.15.77:0/4045689400 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:47:39.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.098+0000 7fad997b6640 1 -- 172.21.15.77:0/4045689400 >> v2:172.21.15.122:3300/0 conn(0x7fad940ca8b0 msgr2=0x7fad9406a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:39.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.098+0000 7fad99fb7640 1 --2- 172.21.15.77:0/4045689400 >> v2:172.21.15.122:3300/0 conn(0x7fad940ca8b0 0x7fad9406a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:39.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.098+0000 7fad8bfff640 1 -- 172.21.15.77:0/4045689400 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1287391209 0 0) 0x7fad940b25a0 con 0x7fad940ced90 2023-11-04T01:47:39.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.098+0000 7fad997b6640 1 --2- 172.21.15.77:0/4045689400 >> v2:172.21.15.122:3300/0 conn(0x7fad940ca8b0 0x7fad9406a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:39.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.098+0000 7fad997b6640 1 -- 172.21.15.77:0/4045689400 >> v1:172.21.15.77:6789/0 conn(0x7fad940ced90 legacy=0x7fad940ca1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:39.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.098+0000 7fad997b6640 1 -- 172.21.15.77:0/4045689400 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9415e5f0 con 0x7fad9415d4e0 2023-11-04T01:47:39.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.098+0000 7fad99fb7640 1 --2- 172.21.15.77:0/4045689400 >> v2:172.21.15.122:3300/0 conn(0x7fad940ca8b0 0x7fad9406a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:39.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.099+0000 7fad997b6640 1 --2- 172.21.15.77:0/4045689400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad9415d4e0 0x7fad940ce850 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7fad840097a0 tx=0x7fad8402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc5171409c82d4be server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:39.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.099+0000 7fad8bfff640 1 -- 172.21.15.77:0/4045689400 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad84031830 con 0x7fad9415d4e0 2023-11-04T01:47:39.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.099+0000 7fad8bfff640 1 -- 172.21.15.77:0/4045689400 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad84031990 con 0x7fad9415d4e0 2023-11-04T01:47:39.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.099+0000 7fad8bfff640 1 -- 172.21.15.77:0/4045689400 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad84031d20 con 0x7fad9415d4e0 2023-11-04T01:47:39.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.099+0000 7fad9ba1a640 1 -- 172.21.15.77:0/4045689400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad9415d4e0 msgr2=0x7fad940ce850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:39.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.099+0000 7fad9ba1a640 1 --2- 172.21.15.77:0/4045689400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad9415d4e0 0x7fad940ce850 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7fad840097a0 tx=0x7fad8402b8d0 comp rx=0 tx=0).stop 2023-11-04T01:47:39.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.099+0000 7fad9ba1a640 1 -- 172.21.15.77:0/4045689400 shutdown_connections 2023-11-04T01:47:39.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.099+0000 7fad9ba1a640 1 --2- 172.21.15.77:0/4045689400 >> v2:172.21.15.122:3300/0 conn(0x7fad940ca8b0 0x7fad9406a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:39.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.099+0000 7fad9ba1a640 1 --2- 172.21.15.77:0/4045689400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad9415d4e0 0x7fad940ce850 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:39.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.099+0000 7fad9ba1a640 1 -- 172.21.15.77:0/4045689400 >> 172.21.15.77:0/4045689400 conn(0x7fad940b1640 msgr2=0x7fad940b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:39.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.100+0000 7fad9ba1a640 1 -- 172.21.15.77:0/4045689400 shutdown_connections 2023-11-04T01:47:39.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.100+0000 7fad9ba1a640 1 -- 172.21.15.77:0/4045689400 wait complete. 2023-11-04T01:47:39.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.101+0000 7fad9ba1a640 1 Processor -- start 2023-11-04T01:47:39.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.101+0000 7fad9ba1a640 1 -- start start 2023-11-04T01:47:39.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.101+0000 7fad9ba1a640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fad940ca8b0 0x7fad940b2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:39.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.101+0000 7fad9ba1a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad940ced90 0x7fad9414b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:39.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.101+0000 7fad9ba1a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad9415d4e0 0x7fad940c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:39.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.101+0000 7fad9ba1a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad940b3650 con 0x7fad9415d4e0 2023-11-04T01:47:39.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.101+0000 7fad9ba1a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad940c7d00 con 0x7fad940ced90 2023-11-04T01:47:39.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.101+0000 7fad9ba1a640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9414b550 con 0x7fad940ca8b0 2023-11-04T01:47:39.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.101+0000 7fad99fb7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad9415d4e0 0x7fad940c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:39.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.102+0000 7fad99fb7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad9415d4e0 0x7fad940c46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35236/0 (socket says 172.21.15.77:35236) 2023-11-04T01:47:39.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.102+0000 7fad99fb7640 1 -- 172.21.15.77:0/545355254 learned_addr learned my addr 172.21.15.77:0/545355254 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:39.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.102+0000 7fad98fb5640 1 --2- 172.21.15.77:0/545355254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad940ced90 0x7fad9414b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:39.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.102+0000 7fad997b6640 1 --2- 172.21.15.77:0/545355254 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fad940ca8b0 0x7fad940b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:39.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.102+0000 7fad99fb7640 1 -- 172.21.15.77:0/545355254 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fad940ca8b0 msgr2=0x7fad940b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:39.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.102+0000 7fad99fb7640 1 --2- 172.21.15.77:0/545355254 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fad940ca8b0 0x7fad940b2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:39.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.102+0000 7fad99fb7640 1 -- 172.21.15.77:0/545355254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad940ced90 msgr2=0x7fad9414b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:39.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.102+0000 7fad99fb7640 1 --2- 172.21.15.77:0/545355254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad940ced90 0x7fad9414b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:39.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.102+0000 7fad99fb7640 1 -- 172.21.15.77:0/545355254 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad84009400 con 0x7fad9415d4e0 2023-11-04T01:47:39.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.102+0000 7fad997b6640 1 --2- 172.21.15.77:0/545355254 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fad940ca8b0 0x7fad940b2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:39.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.102+0000 7fad99fb7640 1 --2- 172.21.15.77:0/545355254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad9415d4e0 0x7fad940c46d0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00cef0 tx=0x7fad8c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:39.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.102+0000 7fad89ffb640 1 -- 172.21.15.77:0/545355254 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c00d840 con 0x7fad9415d4e0 2023-11-04T01:47:39.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.102+0000 7fad89ffb640 1 -- 172.21.15.77:0/545355254 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8c00d9c0 con 0x7fad9415d4e0 2023-11-04T01:47:39.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.102+0000 7fad89ffb640 1 -- 172.21.15.77:0/545355254 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c00dd70 con 0x7fad9415d4e0 2023-11-04T01:47:39.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.102+0000 7fad9ba1a640 1 -- 172.21.15.77:0/545355254 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad940c7740 con 0x7fad9415d4e0 2023-11-04T01:47:39.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.102+0000 7fad9ba1a640 1 -- 172.21.15.77:0/545355254 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad940b55d0 con 0x7fad9415d4e0 2023-11-04T01:47:39.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.103+0000 7fad9ba1a640 1 -- 172.21.15.77:0/545355254 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad940b3790 con 0x7fad9415d4e0 2023-11-04T01:47:39.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.104+0000 7fad89ffb640 1 -- 172.21.15.77:0/545355254 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fad8c01e3b0 con 0x7fad9415d4e0 2023-11-04T01:47:39.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.104+0000 7fad89ffb640 1 --2- 172.21.15.77:0/545355254 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fad7806ae70 0x7fad7806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:39.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.104+0000 7fad89ffb640 1 -- 172.21.15.77:0/545355254 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8167+0+0 (secure 0 0 0) 0x7fad8c08a930 con 0x7fad9415d4e0 2023-11-04T01:47:39.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.104+0000 7fad997b6640 1 --2- 172.21.15.77:0/545355254 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fad7806ae70 0x7fad7806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:39.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.105+0000 7fad997b6640 1 --2- 172.21.15.77:0/545355254 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fad7806ae70 0x7fad7806d330 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fad84036000 tx=0x7fad8403c040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:39.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.108+0000 7fad89ffb640 1 -- 172.21.15.77:0/545355254 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fad940b3790 con 0x7fad9415d4e0 2023-11-04T01:47:39.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.310+0000 7fad9ba1a640 1 -- 172.21.15.77:0/545355254 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad940b3790 con 0x7fad9415d4e0 2023-11-04T01:47:39.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.311+0000 7fad89ffb640 1 -- 172.21.15.77:0/545355254 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4949 (secure 0 0 0) 0x7fad940b3790 con 0x7fad9415d4e0 2023-11-04T01:47:39.313 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:47:39.313 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":114,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2985885329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2985885329},{"type":"v1","addr":"172.21.15.77:6835","nonce":2985885329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:47:31.658164+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7033,"mds_1":8583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7033":{"gid":7033,"name":"b","rank":0,"incarnation":109,"state":"up:reconnect","state_seq":14,"addr":"172.21.15.122:6836/2238841748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2238841748},{"type":"v1","addr":"172.21.15.122:6836","nonce":2238841748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8583":{"gid":8583,"name":"c","rank":1,"incarnation":112,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.77:6833/1157837717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1157837717},{"type":"v1","addr":"172.21.15.77:6833","nonce":1157837717}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:39.313 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 114 2023-11-04T01:47:39.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.312+0000 7fad9ba1a640 1 -- 172.21.15.77:0/545355254 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fad7806ae70 msgr2=0x7fad7806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:39.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.312+0000 7fad9ba1a640 1 --2- 172.21.15.77:0/545355254 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fad7806ae70 0x7fad7806d330 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fad84036000 tx=0x7fad8403c040 comp rx=0 tx=0).stop 2023-11-04T01:47:39.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.312+0000 7fad9ba1a640 1 -- 172.21.15.77:0/545355254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad9415d4e0 msgr2=0x7fad940c46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:39.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.312+0000 7fad9ba1a640 1 --2- 172.21.15.77:0/545355254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad9415d4e0 0x7fad940c46d0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00cef0 tx=0x7fad8c00a710 comp rx=0 tx=0).stop 2023-11-04T01:47:39.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.312+0000 7fad9ba1a640 1 -- 172.21.15.77:0/545355254 shutdown_connections 2023-11-04T01:47:39.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.312+0000 7fad9ba1a640 1 --2- 172.21.15.77:0/545355254 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fad7806ae70 0x7fad7806d330 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:39.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.312+0000 7fad9ba1a640 1 --2- 172.21.15.77:0/545355254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad9415d4e0 0x7fad940c46d0 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:39.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.312+0000 7fad9ba1a640 1 --2- 172.21.15.77:0/545355254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad940ced90 0x7fad9414b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:39.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.312+0000 7fad9ba1a640 1 --2- 172.21.15.77:0/545355254 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fad940ca8b0 0x7fad940b2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:39.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.312+0000 7fad9ba1a640 1 -- 172.21.15.77:0/545355254 >> 172.21.15.77:0/545355254 conn(0x7fad940b1640 msgr2=0x7fad940aedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:39.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.313+0000 7fad9ba1a640 1 -- 172.21.15.77:0/545355254 shutdown_connections 2023-11-04T01:47:39.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:39.313+0000 7fad9ba1a640 1 -- 172.21.15.77:0/545355254 wait complete. 2023-11-04T01:47:39.325 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:47:40.326 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:40.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.435+0000 7f28dfc1a640 1 Processor -- start 2023-11-04T01:47:40.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.435+0000 7f28dfc1a640 1 -- start start 2023-11-04T01:47:40.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.436+0000 7f28dfc1a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f28d80ade00 0x7f28d80b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:40.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.436+0000 7f28dfc1a640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f28d806c5f0 0x7f28d80cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:40.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.436+0000 7f28dfc1a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d806cc90 con 0x7f28d806d9c0 2023-11-04T01:47:40.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.436+0000 7f28dfc1a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d80b0e60 con 0x7f28d80ade00 2023-11-04T01:47:40.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.436+0000 7f28dfc1a640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d806cee0 con 0x7f28d806c5f0 2023-11-04T01:47:40.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.436+0000 7f28dd9b6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f28d80ade00 0x7f28d80b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:40.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.436+0000 7f28dd1b5640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f28d806d9c0 0x7f28d80710d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35968/0 (socket says 172.21.15.77:35968) 2023-11-04T01:47:40.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.436+0000 7f28dd1b5640 1 -- 172.21.15.77:0/1669061840 learned_addr learned my addr 172.21.15.77:0/1669061840 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:47:40.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.437+0000 7f28de1b7640 1 --2- 172.21.15.77:0/1669061840 >> v2:172.21.15.122:3300/0 conn(0x7f28d806c5f0 0x7f28d80cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:40.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.437+0000 7f28dd9b6640 1 -- 172.21.15.77:0/1669061840 >> v2:172.21.15.122:3300/0 conn(0x7f28d806c5f0 msgr2=0x7f28d80cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:40.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.437+0000 7f28dd9b6640 1 --2- 172.21.15.77:0/1669061840 >> v2:172.21.15.122:3300/0 conn(0x7f28d806c5f0 0x7f28d80cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:40.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.437+0000 7f28dd9b6640 1 -- 172.21.15.77:0/1669061840 >> v1:172.21.15.77:6789/0 conn(0x7f28d806d9c0 legacy=0x7f28d80710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:40.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.437+0000 7f28dd9b6640 1 -- 172.21.15.77:0/1669061840 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d806d1c0 con 0x7f28d80ade00 2023-11-04T01:47:40.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.437+0000 7f28dc9b4640 1 -- 172.21.15.77:0/1669061840 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1438205150 0 0) 0x7f28d806cc90 con 0x7f28d806d9c0 2023-11-04T01:47:40.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.437+0000 7f28de1b7640 1 --2- 172.21.15.77:0/1669061840 >> v2:172.21.15.122:3300/0 conn(0x7f28d806c5f0 0x7f28d80cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:40.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.437+0000 7f28dd9b6640 1 --2- 172.21.15.77:0/1669061840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28d80ade00 0x7f28d80b0530 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f28d80b44f0 tx=0x7f28d402b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23269e34ec1f4007 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:40.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.438+0000 7f28dc9b4640 1 -- 172.21.15.77:0/1669061840 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d4031740 con 0x7f28d80ade00 2023-11-04T01:47:40.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.438+0000 7f28dc9b4640 1 -- 172.21.15.77:0/1669061840 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d40318a0 con 0x7f28d80ade00 2023-11-04T01:47:40.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.438+0000 7f28dc9b4640 1 -- 172.21.15.77:0/1669061840 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d4031c30 con 0x7f28d80ade00 2023-11-04T01:47:40.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.438+0000 7f28dfc1a640 1 -- 172.21.15.77:0/1669061840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28d80ade00 msgr2=0x7f28d80b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:40.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.438+0000 7f28dfc1a640 1 --2- 172.21.15.77:0/1669061840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28d80ade00 0x7f28d80b0530 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f28d80b44f0 tx=0x7f28d402b7e0 comp rx=0 tx=0).stop 2023-11-04T01:47:40.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.438+0000 7f28dfc1a640 1 -- 172.21.15.77:0/1669061840 shutdown_connections 2023-11-04T01:47:40.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.438+0000 7f28dfc1a640 1 --2- 172.21.15.77:0/1669061840 >> v2:172.21.15.122:3300/0 conn(0x7f28d806c5f0 0x7f28d80cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:40.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.438+0000 7f28dfc1a640 1 --2- 172.21.15.77:0/1669061840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28d80ade00 0x7f28d80b0530 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:40.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.438+0000 7f28dfc1a640 1 -- 172.21.15.77:0/1669061840 >> 172.21.15.77:0/1669061840 conn(0x7f28d80cb530 msgr2=0x7f28d80cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:40.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.438+0000 7f28dfc1a640 1 -- 172.21.15.77:0/1669061840 shutdown_connections 2023-11-04T01:47:40.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.438+0000 7f28dfc1a640 1 -- 172.21.15.77:0/1669061840 wait complete. 2023-11-04T01:47:40.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.439+0000 7f28dfc1a640 1 Processor -- start 2023-11-04T01:47:40.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.439+0000 7f28dfc1a640 1 -- start start 2023-11-04T01:47:40.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.440+0000 7f28dfc1a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28d806c5f0 0x7f28d81eff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:40.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.440+0000 7f28dfc1a640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f28d806d9c0 0x7f28d80c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:40.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.440+0000 7f28dfc1a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28d80ade00 0x7f28d80c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:40.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.440+0000 7f28dfc1a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d81f49d0 con 0x7f28d806c5f0 2023-11-04T01:47:40.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.440+0000 7f28dfc1a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d8159ca0 con 0x7f28d80ade00 2023-11-04T01:47:40.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.440+0000 7f28dfc1a640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d8159f80 con 0x7f28d806d9c0 2023-11-04T01:47:40.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.440+0000 7f28dd9b6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28d806c5f0 0x7f28d81eff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:40.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.440+0000 7f28dd9b6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28d806c5f0 0x7f28d81eff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35246/0 (socket says 172.21.15.77:35246) 2023-11-04T01:47:40.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.440+0000 7f28dd9b6640 1 -- 172.21.15.77:0/91386532 learned_addr learned my addr 172.21.15.77:0/91386532 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:40.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.440+0000 7f28de1b7640 1 --2- 172.21.15.77:0/91386532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28d80ade00 0x7f28d80c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:40.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.440+0000 7f28dd1b5640 1 --2- 172.21.15.77:0/91386532 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f28d806d9c0 0x7f28d80c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:40.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.440+0000 7f28dd9b6640 1 -- 172.21.15.77:0/91386532 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f28d806d9c0 msgr2=0x7f28d80c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:40.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.440+0000 7f28dd9b6640 1 --2- 172.21.15.77:0/91386532 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f28d806d9c0 0x7f28d80c7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:40.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.440+0000 7f28dd9b6640 1 -- 172.21.15.77:0/91386532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28d80ade00 msgr2=0x7f28d80c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:40.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.440+0000 7f28dd9b6640 1 --2- 172.21.15.77:0/91386532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28d80ade00 0x7f28d80c81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:40.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.440+0000 7f28dd9b6640 1 -- 172.21.15.77:0/91386532 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d4009400 con 0x7f28d806c5f0 2023-11-04T01:47:40.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.440+0000 7f28de1b7640 1 --2- 172.21.15.77:0/91386532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28d80ade00 0x7f28d80c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:40.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.441+0000 7f28dd9b6640 1 --2- 172.21.15.77:0/91386532 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28d806c5f0 0x7f28d81eff60 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f28d4000c00 tx=0x7f28d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:40.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.441+0000 7f28ce7fc640 1 -- 172.21.15.77:0/91386532 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d4033c70 con 0x7f28d806c5f0 2023-11-04T01:47:40.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.441+0000 7f28ce7fc640 1 -- 172.21.15.77:0/91386532 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d4033e10 con 0x7f28d806c5f0 2023-11-04T01:47:40.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.441+0000 7f28dfc1a640 1 -- 172.21.15.77:0/91386532 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d815a260 con 0x7f28d806c5f0 2023-11-04T01:47:40.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.441+0000 7f28ce7fc640 1 -- 172.21.15.77:0/91386532 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d403c640 con 0x7f28d806c5f0 2023-11-04T01:47:40.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.441+0000 7f28dfc1a640 1 -- 172.21.15.77:0/91386532 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d81f3ca0 con 0x7f28d806c5f0 2023-11-04T01:47:40.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.442+0000 7f28dfc1a640 1 -- 172.21.15.77:0/91386532 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d80684b0 con 0x7f28d806c5f0 2023-11-04T01:47:40.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.442+0000 7f28ce7fc640 1 -- 172.21.15.77:0/91386532 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f28d403a040 con 0x7f28d806c5f0 2023-11-04T01:47:40.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.443+0000 7f28ce7fc640 1 --2- 172.21.15.77:0/91386532 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f28bc06ae70 0x7f28bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:40.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.443+0000 7f28ce7fc640 1 -- 172.21.15.77:0/91386532 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f28d40abb50 con 0x7f28d806c5f0 2023-11-04T01:47:40.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.443+0000 7f28dd1b5640 1 --2- 172.21.15.77:0/91386532 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f28bc06ae70 0x7f28bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:40.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.443+0000 7f28dd1b5640 1 --2- 172.21.15.77:0/91386532 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f28bc06ae70 0x7f28bc06d330 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f28d80c5a70 tx=0x7f28c8007c00 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:40.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.447+0000 7f28ce7fc640 1 -- 172.21.15.77:0/91386532 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f28d4076260 con 0x7f28d806c5f0 2023-11-04T01:47:40.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.647+0000 7f28dfc1a640 1 -- 172.21.15.77:0/91386532 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28d80cddc0 con 0x7f28d806c5f0 2023-11-04T01:47:40.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.647+0000 7f28ce7fc640 1 -- 172.21.15.77:0/91386532 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) v1 ==== 95+0+4943 (secure 0 0 0) 0x7f28d4038090 con 0x7f28d806c5f0 2023-11-04T01:47:40.650 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:47:40.651 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":115,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2985885329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2985885329},{"type":"v1","addr":"172.21.15.77:6835","nonce":2985885329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:47:38.683528+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7033,"mds_1":8583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7033":{"gid":7033,"name":"b","rank":0,"incarnation":109,"state":"up:rejoin","state_seq":16,"addr":"172.21.15.122:6836/2238841748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2238841748},{"type":"v1","addr":"172.21.15.122:6836","nonce":2238841748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8583":{"gid":8583,"name":"c","rank":1,"incarnation":112,"state":"up:rejoin","state_seq":6,"addr":"172.21.15.77:6833/1157837717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1157837717},{"type":"v1","addr":"172.21.15.77:6833","nonce":1157837717}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:40.654 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 115 2023-11-04T01:47:40.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.649+0000 7f28dfc1a640 1 -- 172.21.15.77:0/91386532 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f28bc06ae70 msgr2=0x7f28bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:40.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.649+0000 7f28dfc1a640 1 --2- 172.21.15.77:0/91386532 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f28bc06ae70 0x7f28bc06d330 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f28d80c5a70 tx=0x7f28c8007c00 comp rx=0 tx=0).stop 2023-11-04T01:47:40.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.649+0000 7f28dfc1a640 1 -- 172.21.15.77:0/91386532 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28d806c5f0 msgr2=0x7f28d81eff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:40.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.649+0000 7f28dfc1a640 1 --2- 172.21.15.77:0/91386532 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28d806c5f0 0x7f28d81eff60 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f28d4000c00 tx=0x7f28d40046c0 comp rx=0 tx=0).stop 2023-11-04T01:47:40.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.649+0000 7f28dfc1a640 1 -- 172.21.15.77:0/91386532 shutdown_connections 2023-11-04T01:47:40.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.649+0000 7f28dfc1a640 1 --2- 172.21.15.77:0/91386532 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f28bc06ae70 0x7f28bc06d330 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:40.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.649+0000 7f28dfc1a640 1 --2- 172.21.15.77:0/91386532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f28d80ade00 0x7f28d80c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:40.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.649+0000 7f28dfc1a640 1 --2- 172.21.15.77:0/91386532 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f28d806d9c0 0x7f28d80c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:40.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.649+0000 7f28dfc1a640 1 --2- 172.21.15.77:0/91386532 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28d806c5f0 0x7f28d81eff60 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:40.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.649+0000 7f28dfc1a640 1 -- 172.21.15.77:0/91386532 >> 172.21.15.77:0/91386532 conn(0x7f28d80cb530 msgr2=0x7f28d80cc660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:40.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.649+0000 7f28dfc1a640 1 -- 172.21.15.77:0/91386532 shutdown_connections 2023-11-04T01:47:40.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:40.649+0000 7f28dfc1a640 1 -- 172.21.15.77:0/91386532 wait complete. 2023-11-04T01:47:40.662 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:rejoin 2023-11-04T01:47:41.663 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:41.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.768+0000 7fbd8c289640 1 Processor -- start 2023-11-04T01:47:41.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.768+0000 7fbd8c289640 1 -- start start 2023-11-04T01:47:41.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.769+0000 7fbd8c289640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbd8406d9c0 0x7fbd840710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:41.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.769+0000 7fbd8c289640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd8406cc90 con 0x7fbd8406c5f0 2023-11-04T01:47:41.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.769+0000 7fbd8c289640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd840b0e60 con 0x7fbd840ade00 2023-11-04T01:47:41.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.769+0000 7fbd8c289640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd840b0c40 con 0x7fbd8406d9c0 2023-11-04T01:47:41.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.769+0000 7fbd89824640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbd8406d9c0 0x7fbd840710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:41.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.769+0000 7fbd8a826640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fbd8406c5f0 0x7fbd840cc680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35972/0 (socket says 172.21.15.77:35972) 2023-11-04T01:47:41.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.769+0000 7fbd8a826640 1 -- 172.21.15.77:0/287623898 learned_addr learned my addr 172.21.15.77:0/287623898 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:47:41.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.769+0000 7fbd89824640 1 -- 172.21.15.77:0/287623898 >> v1:172.21.15.122:6789/0 conn(0x7fbd840ade00 legacy=0x7fbd840b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:41.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.769+0000 7fbd89824640 1 -- 172.21.15.77:0/287623898 >> v1:172.21.15.77:6789/0 conn(0x7fbd8406c5f0 legacy=0x7fbd840cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:41.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.769+0000 7fbd89824640 1 -- 172.21.15.77:0/287623898 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8406cee0 con 0x7fbd8406d9c0 2023-11-04T01:47:41.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.769+0000 7fbd89023640 1 -- 172.21.15.77:0/287623898 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 704958109 0 0) 0x7fbd8406cc90 con 0x7fbd8406c5f0 2023-11-04T01:47:41.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.770+0000 7fbd89824640 1 --2- 172.21.15.77:0/287623898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd8406d9c0 0x7fbd840710d0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7fbd740097a0 tx=0x7fbd7402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5be40bec423f05c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:41.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.770+0000 7fbd89023640 1 -- 172.21.15.77:0/287623898 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7402f050 con 0x7fbd8406d9c0 2023-11-04T01:47:41.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.770+0000 7fbd89023640 1 -- 172.21.15.77:0/287623898 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd74031700 con 0x7fbd8406d9c0 2023-11-04T01:47:41.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.770+0000 7fbd89023640 1 -- 172.21.15.77:0/287623898 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd74031a90 con 0x7fbd8406d9c0 2023-11-04T01:47:41.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.771+0000 7fbd8c289640 1 -- 172.21.15.77:0/287623898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd8406d9c0 msgr2=0x7fbd840710d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:41.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.771+0000 7fbd8c289640 1 --2- 172.21.15.77:0/287623898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd8406d9c0 0x7fbd840710d0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7fbd740097a0 tx=0x7fbd7402b7a0 comp rx=0 tx=0).stop 2023-11-04T01:47:41.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.771+0000 7fbd8c289640 1 -- 172.21.15.77:0/287623898 shutdown_connections 2023-11-04T01:47:41.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.771+0000 7fbd8c289640 1 --2- 172.21.15.77:0/287623898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd8406d9c0 0x7fbd840710d0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:41.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.771+0000 7fbd8c289640 1 -- 172.21.15.77:0/287623898 >> 172.21.15.77:0/287623898 conn(0x7fbd840cb530 msgr2=0x7fbd840cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:41.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.771+0000 7fbd8c289640 1 -- 172.21.15.77:0/287623898 shutdown_connections 2023-11-04T01:47:41.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.771+0000 7fbd8c289640 1 -- 172.21.15.77:0/287623898 wait complete. 2023-11-04T01:47:41.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.772+0000 7fbd8c289640 1 Processor -- start 2023-11-04T01:47:41.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.772+0000 7fbd8c289640 1 -- start start 2023-11-04T01:47:41.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.773+0000 7fbd8c289640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbd8406c5f0 0x7fbd84157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:41.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.773+0000 7fbd8c289640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbd8406d9c0 0x7fbd840c4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:41.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.773+0000 7fbd8c289640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd840ade00 0x7fbd840c4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:41.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.773+0000 7fbd8c289640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd841f1970 con 0x7fbd840ade00 2023-11-04T01:47:41.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.773+0000 7fbd8c289640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd841f0de0 con 0x7fbd8406c5f0 2023-11-04T01:47:41.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.773+0000 7fbd8c289640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd841f1d90 con 0x7fbd8406d9c0 2023-11-04T01:47:41.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.773+0000 7fbd8a826640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd840ade00 0x7fbd840c4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:41.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.773+0000 7fbd8a826640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd840ade00 0x7fbd840c4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35264/0 (socket says 172.21.15.77:35264) 2023-11-04T01:47:41.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.773+0000 7fbd8a826640 1 -- 172.21.15.77:0/3405156256 learned_addr learned my addr 172.21.15.77:0/3405156256 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:41.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.773+0000 7fbd8a826640 1 -- 172.21.15.77:0/3405156256 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbd8406d9c0 msgr2=0x7fbd840c4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:41.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.773+0000 7fbd89824640 1 --2- 172.21.15.77:0/3405156256 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbd8406d9c0 0x7fbd840c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:41.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.773+0000 7fbd8a025640 1 --2- 172.21.15.77:0/3405156256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbd8406c5f0 0x7fbd84157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:41.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.773+0000 7fbd8a826640 1 --2- 172.21.15.77:0/3405156256 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbd8406d9c0 0x7fbd840c4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:41.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.773+0000 7fbd8a826640 1 -- 172.21.15.77:0/3405156256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbd8406c5f0 msgr2=0x7fbd84157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:41.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.773+0000 7fbd8a826640 1 --2- 172.21.15.77:0/3405156256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbd8406c5f0 0x7fbd84157cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:41.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.773+0000 7fbd8a826640 1 -- 172.21.15.77:0/3405156256 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd74009400 con 0x7fbd840ade00 2023-11-04T01:47:41.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.773+0000 7fbd89824640 1 --2- 172.21.15.77:0/3405156256 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbd8406d9c0 0x7fbd840c4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:41.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.773+0000 7fbd8a025640 1 --2- 172.21.15.77:0/3405156256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbd8406c5f0 0x7fbd84157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:41.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.773+0000 7fbd8a826640 1 --2- 172.21.15.77:0/3405156256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd840ade00 0x7fbd840c4c90 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c00c780 tx=0x7fbd7c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:41.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.773+0000 7fbd7affd640 1 -- 172.21.15.77:0/3405156256 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c00ce90 con 0x7fbd840ade00 2023-11-04T01:47:41.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.773+0000 7fbd7affd640 1 -- 172.21.15.77:0/3405156256 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd7c00a640 con 0x7fbd840ade00 2023-11-04T01:47:41.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.773+0000 7fbd8c289640 1 -- 172.21.15.77:0/3405156256 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd841f0fd0 con 0x7fbd840ade00 2023-11-04T01:47:41.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.773+0000 7fbd7affd640 1 -- 172.21.15.77:0/3405156256 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c00a9d0 con 0x7fbd840ade00 2023-11-04T01:47:41.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.773+0000 7fbd8c289640 1 -- 172.21.15.77:0/3405156256 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd841f1590 con 0x7fbd840ade00 2023-11-04T01:47:41.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.774+0000 7fbd8c289640 1 -- 172.21.15.77:0/3405156256 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd841f1ab0 con 0x7fbd840ade00 2023-11-04T01:47:41.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.775+0000 7fbd7affd640 1 -- 172.21.15.77:0/3405156256 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbd7c00ab30 con 0x7fbd840ade00 2023-11-04T01:47:41.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.775+0000 7fbd7affd640 1 --2- 172.21.15.77:0/3405156256 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbd6806ae70 0x7fbd6806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:41.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.775+0000 7fbd7affd640 1 -- 172.21.15.77:0/3405156256 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8167+0+0 (secure 0 0 0) 0x7fbd7c089700 con 0x7fbd840ade00 2023-11-04T01:47:41.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.775+0000 7fbd8a025640 1 --2- 172.21.15.77:0/3405156256 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbd6806ae70 0x7fbd6806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:41.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.776+0000 7fbd8a025640 1 --2- 172.21.15.77:0/3405156256 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbd6806ae70 0x7fbd6806d330 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fbd8415bf50 tx=0x7fbd80008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:41.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.779+0000 7fbd7affd640 1 -- 172.21.15.77:0/3405156256 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbd7c053ea0 con 0x7fbd840ade00 2023-11-04T01:47:41.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.982+0000 7fbd8c289640 1 -- 172.21.15.77:0/3405156256 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd840b4100 con 0x7fbd840ade00 2023-11-04T01:47:41.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.982+0000 7fbd7affd640 1 -- 172.21.15.77:0/3405156256 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+4943 (secure 0 0 0) 0x7fbd7c018020 con 0x7fbd840ade00 2023-11-04T01:47:41.985 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:47:41.986 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":116,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2985885329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2985885329},{"type":"v1","addr":"172.21.15.77:6835","nonce":2985885329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:47:39.684056+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7033,"mds_1":8583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7033":{"gid":7033,"name":"b","rank":0,"incarnation":109,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6836/2238841748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2238841748},{"type":"v1","addr":"172.21.15.122:6836","nonce":2238841748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8583":{"gid":8583,"name":"c","rank":1,"incarnation":112,"state":"up:active","state_seq":7,"addr":"172.21.15.77:6833/1157837717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1157837717},{"type":"v1","addr":"172.21.15.77:6833","nonce":1157837717}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:41.986 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 116 2023-11-04T01:47:41.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.984+0000 7fbd8c289640 1 -- 172.21.15.77:0/3405156256 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbd6806ae70 msgr2=0x7fbd6806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:41.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.984+0000 7fbd8c289640 1 --2- 172.21.15.77:0/3405156256 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbd6806ae70 0x7fbd6806d330 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fbd8415bf50 tx=0x7fbd80008040 comp rx=0 tx=0).stop 2023-11-04T01:47:41.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.984+0000 7fbd8c289640 1 -- 172.21.15.77:0/3405156256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd840ade00 msgr2=0x7fbd840c4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:41.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.984+0000 7fbd8c289640 1 --2- 172.21.15.77:0/3405156256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd840ade00 0x7fbd840c4c90 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c00c780 tx=0x7fbd7c00cc40 comp rx=0 tx=0).stop 2023-11-04T01:47:41.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.984+0000 7fbd8c289640 1 -- 172.21.15.77:0/3405156256 shutdown_connections 2023-11-04T01:47:41.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.984+0000 7fbd8c289640 1 --2- 172.21.15.77:0/3405156256 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fbd6806ae70 0x7fbd6806d330 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:41.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.984+0000 7fbd8c289640 1 --2- 172.21.15.77:0/3405156256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd840ade00 0x7fbd840c4c90 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:41.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.984+0000 7fbd8c289640 1 --2- 172.21.15.77:0/3405156256 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fbd8406d9c0 0x7fbd840c4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:41.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.984+0000 7fbd8c289640 1 --2- 172.21.15.77:0/3405156256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbd8406c5f0 0x7fbd84157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:41.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.984+0000 7fbd8c289640 1 -- 172.21.15.77:0/3405156256 >> 172.21.15.77:0/3405156256 conn(0x7fbd840cb530 msgr2=0x7fbd840b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:41.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.984+0000 7fbd8c289640 1 -- 172.21.15.77:0/3405156256 shutdown_connections 2023-11-04T01:47:41.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:41.984+0000 7fbd8c289640 1 -- 172.21.15.77:0/3405156256 wait complete. 2023-11-04T01:47:41.997 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:active 2023-11-04T01:47:41.998 DEBUG:tasks.cephfs.filesystem:reached state 'up:active' in 5.6692845821380615s 2023-11-04T01:47:41.998 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:47:41.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:41.999 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 up 2023-11-04T01:47:42.027 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:47:42.027 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:47:42.083 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:47:42.122 INFO:tasks.ceph.mds.b.smithi122.stderr:2023-11-04T01:47:42.121+0000 7faa00ed0640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:47:42.123 INFO:tasks.ceph.mds.b.smithi122.stderr:2023-11-04T01:47:42.121+0000 7faa00ed0640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:47:42.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.219+0000 7f2e36897640 1 Processor -- start 2023-11-04T01:47:42.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.219+0000 7f2e36897640 1 -- start start 2023-11-04T01:47:42.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.220+0000 7f2e36897640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2e3006d9c0 0x7f2e300710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:42.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.220+0000 7f2e36897640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e3006cc90 con 0x7f2e300ade00 2023-11-04T01:47:42.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.220+0000 7f2e36897640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e300b0e60 con 0x7f2e3006c5f0 2023-11-04T01:47:42.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.220+0000 7f2e36897640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e300b0c40 con 0x7f2e3006d9c0 2023-11-04T01:47:42.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.220+0000 7f2e2f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2e3006d9c0 0x7f2e300710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:42.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.220+0000 7f2e2ffff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f2e300ade00 0x7f2e300b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35986/0 (socket says 172.21.15.77:35986) 2023-11-04T01:47:42.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.220+0000 7f2e2ffff640 1 -- 172.21.15.77:0/3000590287 learned_addr learned my addr 172.21.15.77:0/3000590287 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:47:42.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.221+0000 7f2e2f7fe640 1 -- 172.21.15.77:0/3000590287 >> v1:172.21.15.122:6789/0 conn(0x7f2e3006c5f0 legacy=0x7f2e300cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:42.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.221+0000 7f2e2f7fe640 1 -- 172.21.15.77:0/3000590287 >> v1:172.21.15.77:6789/0 conn(0x7f2e300ade00 legacy=0x7f2e300b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:42.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.221+0000 7f2e2effd640 1 -- 172.21.15.77:0/3000590287 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1958758378 0 0) 0x7f2e3006cc90 con 0x7f2e300ade00 2023-11-04T01:47:42.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.221+0000 7f2e2f7fe640 1 -- 172.21.15.77:0/3000590287 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e3006cee0 con 0x7f2e3006d9c0 2023-11-04T01:47:42.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.221+0000 7f2e2f7fe640 1 --2- 172.21.15.77:0/3000590287 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e3006d9c0 0x7f2e300710d0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f2e240097a0 tx=0x7f2e2402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b8c3a5c5866e435 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:42.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.221+0000 7f2e2effd640 1 -- 172.21.15.77:0/3000590287 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2402e070 con 0x7f2e3006d9c0 2023-11-04T01:47:42.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.221+0000 7f2e2effd640 1 -- 172.21.15.77:0/3000590287 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e240315a0 con 0x7f2e3006d9c0 2023-11-04T01:47:42.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.221+0000 7f2e2effd640 1 -- 172.21.15.77:0/3000590287 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e24031930 con 0x7f2e3006d9c0 2023-11-04T01:47:42.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.222+0000 7f2e36897640 1 -- 172.21.15.77:0/3000590287 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e3006d9c0 msgr2=0x7f2e300710d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:42.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.222+0000 7f2e36897640 1 --2- 172.21.15.77:0/3000590287 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e3006d9c0 0x7f2e300710d0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f2e240097a0 tx=0x7f2e2402b840 comp rx=0 tx=0).stop 2023-11-04T01:47:42.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.222+0000 7f2e36897640 1 -- 172.21.15.77:0/3000590287 shutdown_connections 2023-11-04T01:47:42.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.222+0000 7f2e36897640 1 --2- 172.21.15.77:0/3000590287 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e3006d9c0 0x7f2e300710d0 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:42.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.222+0000 7f2e36897640 1 -- 172.21.15.77:0/3000590287 >> 172.21.15.77:0/3000590287 conn(0x7f2e300cb530 msgr2=0x7f2e300cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:42.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.222+0000 7f2e36897640 1 -- 172.21.15.77:0/3000590287 shutdown_connections 2023-11-04T01:47:42.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.222+0000 7f2e36897640 1 -- 172.21.15.77:0/3000590287 wait complete. 2023-11-04T01:47:42.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.223+0000 7f2e36897640 1 Processor -- start 2023-11-04T01:47:42.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.223+0000 7f2e36897640 1 -- start start 2023-11-04T01:47:42.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.224+0000 7f2e36897640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e3006c5f0 0x7f2e3014e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:42.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.224+0000 7f2e36897640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e3006d9c0 0x7f2e30155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:42.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.224+0000 7f2e36897640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e300ade00 0x7f2e30157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:42.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.224+0000 7f2e36897640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e301561a0 con 0x7f2e3006d9c0 2023-11-04T01:47:42.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.224+0000 7f2e36897640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e30156480 con 0x7f2e300ade00 2023-11-04T01:47:42.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.224+0000 7f2e36897640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e30156760 con 0x7f2e3006c5f0 2023-11-04T01:47:42.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.224+0000 7f2e2f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e3006d9c0 0x7f2e30155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:42.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.224+0000 7f2e2f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e3006d9c0 0x7f2e30155800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35280/0 (socket says 172.21.15.77:35280) 2023-11-04T01:47:42.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.224+0000 7f2e2f7fe640 1 -- 172.21.15.77:0/536532457 learned_addr learned my addr 172.21.15.77:0/536532457 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:42.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.224+0000 7f2e2ffff640 1 --2- 172.21.15.77:0/536532457 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e3006c5f0 0x7f2e3014e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:42.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.224+0000 7f2e34e34640 1 --2- 172.21.15.77:0/536532457 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e300ade00 0x7f2e30157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:42.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.224+0000 7f2e2f7fe640 1 -- 172.21.15.77:0/536532457 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e3006c5f0 msgr2=0x7f2e3014e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:42.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.224+0000 7f2e2f7fe640 1 --2- 172.21.15.77:0/536532457 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e3006c5f0 0x7f2e3014e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:42.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.224+0000 7f2e2f7fe640 1 -- 172.21.15.77:0/536532457 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e300ade00 msgr2=0x7f2e30157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:42.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.224+0000 7f2e2f7fe640 1 --2- 172.21.15.77:0/536532457 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e300ade00 0x7f2e30157190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:42.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.224+0000 7f2e2f7fe640 1 -- 172.21.15.77:0/536532457 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e24009400 con 0x7f2e3006d9c0 2023-11-04T01:47:42.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.225+0000 7f2e2f7fe640 1 --2- 172.21.15.77:0/536532457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e3006d9c0 0x7f2e30155800 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f2e24034040 tx=0x7f2e240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:42.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.225+0000 7f2e2cff9640 1 -- 172.21.15.77:0/536532457 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e24032900 con 0x7f2e3006d9c0 2023-11-04T01:47:42.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.225+0000 7f2e2cff9640 1 -- 172.21.15.77:0/536532457 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e24032a80 con 0x7f2e3006d9c0 2023-11-04T01:47:42.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.225+0000 7f2e36897640 1 -- 172.21.15.77:0/536532457 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e30156a40 con 0x7f2e3006d9c0 2023-11-04T01:47:42.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.225+0000 7f2e2cff9640 1 -- 172.21.15.77:0/536532457 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e24032e30 con 0x7f2e3006d9c0 2023-11-04T01:47:42.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.225+0000 7f2e36897640 1 -- 172.21.15.77:0/536532457 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e3014ee10 con 0x7f2e3006d9c0 2023-11-04T01:47:42.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.226+0000 7f2e36897640 1 -- 172.21.15.77:0/536532457 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e300b1490 con 0x7f2e3006d9c0 2023-11-04T01:47:42.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.226+0000 7f2e2cff9640 1 -- 172.21.15.77:0/536532457 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2e2403b3f0 con 0x7f2e3006d9c0 2023-11-04T01:47:42.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.226+0000 7f2e2cff9640 1 --2- 172.21.15.77:0/536532457 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2e1c06aea0 0x7f2e1c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:42.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.227+0000 7f2e2cff9640 1 -- 172.21.15.77:0/536532457 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f2e240abfc0 con 0x7f2e3006d9c0 2023-11-04T01:47:42.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.227+0000 7f2e2ffff640 1 --2- 172.21.15.77:0/536532457 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2e1c06aea0 0x7f2e1c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:42.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.227+0000 7f2e2ffff640 1 --2- 172.21.15.77:0/536532457 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2e1c06aea0 0x7f2e1c06d360 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f2e20000f60 tx=0x7f2e20009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:42.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.231+0000 7f2e2cff9640 1 -- 172.21.15.77:0/536532457 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2e240deca0 con 0x7f2e3006d9c0 2023-11-04T01:47:42.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.399+0000 7f2e36897640 1 -- 172.21.15.77:0/536532457 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e300684b0 con 0x7f2e3006d9c0 2023-11-04T01:47:42.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.401+0000 7f2e2cff9640 1 -- 172.21.15.77:0/536532457 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) v1 ==== 74+0+23599 (secure 0 0 0) 0x7f2e24076760 con 0x7f2e3006d9c0 2023-11-04T01:47:42.404 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:47:42.404 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":115,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:47:38.672210+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:33.159064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:33.647358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:43:24.372767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-04T01:43:25.241976+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":9,"snap_epoch":108,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.7","mappings":[{"from":0,"to":5}]},{"pgid":"17.3f","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/2955237098":"2023-11-04T02:47:38.484200+0000","172.21.15.77:6835/2107153526":"2023-11-05T01:47:23.380657+0000","192.168.0.1:0/2249624526":"2023-11-04T02:46:54.400007+0000","172.21.15.122:6834/1450731169":"2023-11-05T01:46:46.102329+0000","172.21.15.77:6834/3276812155":"2023-11-05T01:46:39.299125+0000","172.21.15.77:6832/3276812155":"2023-11-05T01:46:39.299125+0000","172.21.15.122:6836/1450731169":"2023-11-05T01:46:46.102329+0000","172.21.15.122:6834/3699147778":"2023-11-05T01:44:11.242543+0000","172.21.15.122:6836/3699147778":"2023-11-05T01:44:11.242543+0000","172.21.15.77:6834/4241784871":"2023-11-05T01:44:36.807284+0000","172.21.15.122:6834/2908314953":"2023-11-05T01:45:01.982045+0000","172.21.15.77:6834/285184758":"2023-11-05T01:45:27.182069+0000","172.21.15.77:6833/2107153526":"2023-11-05T01:47:23.380657+0000","172.21.15.122:6836/2908314953":"2023-11-05T01:45:01.982045+0000","172.21.15.77:6834/4183807043":"2023-11-05T01:47:30.639992+0000","172.21.15.122:6836/1345816612":"2023-11-05T01:45:54.789240+0000","172.21.15.77:6832/285184758":"2023-11-05T01:45:27.182069+0000","172.21.15.122:6834/1345816612":"2023-11-05T01:45:54.789240+0000","172.21.15.77:6833/3207490604":"2023-11-05T01:46:01.591697+0000","172.21.15.77:6832/4183807043":"2023-11-05T01:47:30.639992+0000","172.21.15.77:6832/4241784871":"2023-11-05T01:44:36.807284+0000","172.21.15.77:6835/3207490604":"2023-11-05T01:46:01.591697+0000","192.168.0.1:0/3032548059":"2023-11-04T02:46:09.897134+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:47:42.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.402+0000 7f2e36897640 1 -- 172.21.15.77:0/536532457 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2e1c06aea0 msgr2=0x7f2e1c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:42.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.402+0000 7f2e36897640 1 --2- 172.21.15.77:0/536532457 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2e1c06aea0 0x7f2e1c06d360 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f2e20000f60 tx=0x7f2e20009040 comp rx=0 tx=0).stop 2023-11-04T01:47:42.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.402+0000 7f2e36897640 1 -- 172.21.15.77:0/536532457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e3006d9c0 msgr2=0x7f2e30155800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:42.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.402+0000 7f2e36897640 1 --2- 172.21.15.77:0/536532457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e3006d9c0 0x7f2e30155800 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f2e24034040 tx=0x7f2e240046c0 comp rx=0 tx=0).stop 2023-11-04T01:47:42.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.402+0000 7f2e36897640 1 -- 172.21.15.77:0/536532457 shutdown_connections 2023-11-04T01:47:42.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.402+0000 7f2e36897640 1 --2- 172.21.15.77:0/536532457 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f2e1c06aea0 0x7f2e1c06d360 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:42.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.402+0000 7f2e36897640 1 --2- 172.21.15.77:0/536532457 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e300ade00 0x7f2e30157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:42.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.402+0000 7f2e36897640 1 --2- 172.21.15.77:0/536532457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e3006d9c0 0x7f2e30155800 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:42.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.402+0000 7f2e36897640 1 --2- 172.21.15.77:0/536532457 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f2e3006c5f0 0x7f2e3014e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:42.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.402+0000 7f2e36897640 1 -- 172.21.15.77:0/536532457 >> 172.21.15.77:0/536532457 conn(0x7f2e300cb530 msgr2=0x7f2e3015b360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:42.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.403+0000 7f2e36897640 1 -- 172.21.15.77:0/536532457 shutdown_connections 2023-11-04T01:47:42.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.403+0000 7f2e36897640 1 -- 172.21.15.77:0/536532457 wait complete. 2023-11-04T01:47:42.416 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:33.142176+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:42:33.159064+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:42:33.647358+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:43:24.372767+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:43:25.241976+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 9, 'snap_epoch': 108, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:47:42.417 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:47:42.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.517+0000 7feb60215640 1 Processor -- start 2023-11-04T01:47:42.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.517+0000 7feb60215640 1 -- start start 2023-11-04T01:47:42.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.518+0000 7feb60215640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7feb580b0c40 0x7feb5806fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:42.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.518+0000 7feb60215640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feb5806bb60 0x7feb58070530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:42.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.518+0000 7feb60215640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb58071500 con 0x7feb58159e40 2023-11-04T01:47:42.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.518+0000 7feb60215640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb58070a70 con 0x7feb580b0c40 2023-11-04T01:47:42.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.518+0000 7feb60215640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb5815dae0 con 0x7feb5806bb60 2023-11-04T01:47:42.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.518+0000 7feb5d7b0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7feb580b0c40 0x7feb5806fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:42.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.518+0000 7feb5dfb1640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7feb58159e40 0x7feb580b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35994/0 (socket says 172.21.15.77:35994) 2023-11-04T01:47:42.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.518+0000 7feb5dfb1640 1 -- 172.21.15.77:0/2373171060 learned_addr learned my addr 172.21.15.77:0/2373171060 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:47:42.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.518+0000 7feb5e7b2640 1 --2- 172.21.15.77:0/2373171060 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feb5806bb60 0x7feb58070530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:42.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.518+0000 7feb5d7b0640 1 -- 172.21.15.77:0/2373171060 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feb5806bb60 msgr2=0x7feb58070530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:42.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.518+0000 7feb5d7b0640 1 --2- 172.21.15.77:0/2373171060 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feb5806bb60 0x7feb58070530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:42.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.518+0000 7feb5d7b0640 1 -- 172.21.15.77:0/2373171060 >> v1:172.21.15.77:6789/0 conn(0x7feb58159e40 legacy=0x7feb580b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:42.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.518+0000 7feb5d7b0640 1 -- 172.21.15.77:0/2373171060 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb58070c60 con 0x7feb580b0c40 2023-11-04T01:47:42.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.518+0000 7feb5cfaf640 1 -- 172.21.15.77:0/2373171060 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491419753 0 0) 0x7feb58071500 con 0x7feb58159e40 2023-11-04T01:47:42.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.519+0000 7feb5d7b0640 1 --2- 172.21.15.77:0/2373171060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb580b0c40 0x7feb5806fff0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7feb480097a0 tx=0x7feb4802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a72d66850e986a1e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:42.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.519+0000 7feb5cfaf640 1 -- 172.21.15.77:0/2373171060 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4802e070 con 0x7feb580b0c40 2023-11-04T01:47:42.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.519+0000 7feb5cfaf640 1 -- 172.21.15.77:0/2373171060 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb480315a0 con 0x7feb580b0c40 2023-11-04T01:47:42.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.519+0000 7feb5cfaf640 1 -- 172.21.15.77:0/2373171060 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb48031930 con 0x7feb580b0c40 2023-11-04T01:47:42.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.520+0000 7feb60215640 1 -- 172.21.15.77:0/2373171060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb580b0c40 msgr2=0x7feb5806fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:42.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.520+0000 7feb60215640 1 --2- 172.21.15.77:0/2373171060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb580b0c40 0x7feb5806fff0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7feb480097a0 tx=0x7feb4802b840 comp rx=0 tx=0).stop 2023-11-04T01:47:42.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.520+0000 7feb60215640 1 -- 172.21.15.77:0/2373171060 shutdown_connections 2023-11-04T01:47:42.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.520+0000 7feb60215640 1 --2- 172.21.15.77:0/2373171060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb580b0c40 0x7feb5806fff0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:42.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.520+0000 7feb60215640 1 --2- 172.21.15.77:0/2373171060 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feb5806bb60 0x7feb58070530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:42.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.520+0000 7feb60215640 1 -- 172.21.15.77:0/2373171060 >> 172.21.15.77:0/2373171060 conn(0x7feb580cb530 msgr2=0x7feb580cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:42.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.520+0000 7feb60215640 1 -- 172.21.15.77:0/2373171060 shutdown_connections 2023-11-04T01:47:42.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.520+0000 7feb60215640 1 -- 172.21.15.77:0/2373171060 wait complete. 2023-11-04T01:47:42.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.521+0000 7feb60215640 1 Processor -- start 2023-11-04T01:47:42.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.521+0000 7feb60215640 1 -- start start 2023-11-04T01:47:42.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.521+0000 7feb60215640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb5806bb60 0x7feb581f3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:42.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.521+0000 7feb60215640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feb580b0c40 0x7feb58154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:42.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.522+0000 7feb60215640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feb58159e40 0x7feb58153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:42.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.522+0000 7feb60215640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb58154c90 con 0x7feb5806bb60 2023-11-04T01:47:42.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.522+0000 7feb60215640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb58156250 con 0x7feb580b0c40 2023-11-04T01:47:42.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.522+0000 7feb60215640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb581f40c0 con 0x7feb58159e40 2023-11-04T01:47:42.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.522+0000 7feb5dfb1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb5806bb60 0x7feb581f3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:42.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.522+0000 7feb5dfb1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb5806bb60 0x7feb581f3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35302/0 (socket says 172.21.15.77:35302) 2023-11-04T01:47:42.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.522+0000 7feb5dfb1640 1 -- 172.21.15.77:0/222414862 learned_addr learned my addr 172.21.15.77:0/222414862 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:42.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.522+0000 7feb5e7b2640 1 --2- 172.21.15.77:0/222414862 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feb58159e40 0x7feb58153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:42.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.522+0000 7feb5d7b0640 1 --2- 172.21.15.77:0/222414862 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feb580b0c40 0x7feb58154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:42.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.522+0000 7feb5dfb1640 1 -- 172.21.15.77:0/222414862 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feb58159e40 msgr2=0x7feb58153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:42.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.522+0000 7feb5dfb1640 1 --2- 172.21.15.77:0/222414862 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feb58159e40 0x7feb58153f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:42.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.522+0000 7feb5dfb1640 1 -- 172.21.15.77:0/222414862 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feb580b0c40 msgr2=0x7feb58154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:42.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.522+0000 7feb5dfb1640 1 --2- 172.21.15.77:0/222414862 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feb580b0c40 0x7feb58154750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:42.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.522+0000 7feb5dfb1640 1 -- 172.21.15.77:0/222414862 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb48009400 con 0x7feb5806bb60 2023-11-04T01:47:42.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.522+0000 7feb5e7b2640 1 --2- 172.21.15.77:0/222414862 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feb58159e40 0x7feb58153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:42.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.522+0000 7feb5d7b0640 1 --2- 172.21.15.77:0/222414862 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feb580b0c40 0x7feb58154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:42.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.522+0000 7feb5dfb1640 1 --2- 172.21.15.77:0/222414862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb5806bb60 0x7feb581f3ae0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7feb5400c430 tx=0x7feb5400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:42.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.522+0000 7feb4e7fc640 1 -- 172.21.15.77:0/222414862 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb540074e0 con 0x7feb5806bb60 2023-11-04T01:47:42.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.522+0000 7feb4e7fc640 1 -- 172.21.15.77:0/222414862 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb54007660 con 0x7feb5806bb60 2023-11-04T01:47:42.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.522+0000 7feb60215640 1 -- 172.21.15.77:0/222414862 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb581f43a0 con 0x7feb5806bb60 2023-11-04T01:47:42.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.522+0000 7feb4e7fc640 1 -- 172.21.15.77:0/222414862 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb54004a20 con 0x7feb5806bb60 2023-11-04T01:47:42.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.522+0000 7feb60215640 1 -- 172.21.15.77:0/222414862 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb581f4960 con 0x7feb5806bb60 2023-11-04T01:47:42.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.523+0000 7feb60215640 1 -- 172.21.15.77:0/222414862 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb580684b0 con 0x7feb5806bb60 2023-11-04T01:47:42.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.523+0000 7feb4e7fc640 1 -- 172.21.15.77:0/222414862 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feb54004b80 con 0x7feb5806bb60 2023-11-04T01:47:42.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.524+0000 7feb4e7fc640 1 --2- 172.21.15.77:0/222414862 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7feb3c06ae70 0x7feb3c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:42.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.524+0000 7feb4e7fc640 1 -- 172.21.15.77:0/222414862 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8167+0+0 (secure 0 0 0) 0x7feb54089d50 con 0x7feb5806bb60 2023-11-04T01:47:42.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.524+0000 7feb5d7b0640 1 --2- 172.21.15.77:0/222414862 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7feb3c06ae70 0x7feb3c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:42.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.525+0000 7feb5d7b0640 1 --2- 172.21.15.77:0/222414862 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7feb3c06ae70 0x7feb3c06d330 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7feb48036000 tx=0x7feb4803d040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:42.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.528+0000 7feb4e7fc640 1 -- 172.21.15.77:0/222414862 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feb5408d030 con 0x7feb5806bb60 2023-11-04T01:47:42.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.698+0000 7feb60215640 1 -- 172.21.15.77:0/222414862 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feb580c9750 con 0x7feb5806bb60 2023-11-04T01:47:42.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.698+0000 7feb4e7fc640 1 -- 172.21.15.77:0/222414862 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v115) v1 ==== 93+0+10 (secure 0 0 0) 0x7feb540544f0 con 0x7feb5806bb60 2023-11-04T01:47:42.703 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:47:42.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.700+0000 7feb60215640 1 -- 172.21.15.77:0/222414862 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7feb3c06ae70 msgr2=0x7feb3c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:42.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.700+0000 7feb60215640 1 --2- 172.21.15.77:0/222414862 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7feb3c06ae70 0x7feb3c06d330 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7feb48036000 tx=0x7feb4803d040 comp rx=0 tx=0).stop 2023-11-04T01:47:42.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.700+0000 7feb60215640 1 -- 172.21.15.77:0/222414862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb5806bb60 msgr2=0x7feb581f3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:42.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.700+0000 7feb60215640 1 --2- 172.21.15.77:0/222414862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb5806bb60 0x7feb581f3ae0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7feb5400c430 tx=0x7feb5400c8f0 comp rx=0 tx=0).stop 2023-11-04T01:47:42.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.700+0000 7feb60215640 1 -- 172.21.15.77:0/222414862 shutdown_connections 2023-11-04T01:47:42.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.700+0000 7feb60215640 1 --2- 172.21.15.77:0/222414862 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7feb3c06ae70 0x7feb3c06d330 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:42.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.700+0000 7feb60215640 1 --2- 172.21.15.77:0/222414862 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feb58159e40 0x7feb58153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:42.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.700+0000 7feb60215640 1 --2- 172.21.15.77:0/222414862 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feb580b0c40 0x7feb58154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:42.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.700+0000 7feb60215640 1 --2- 172.21.15.77:0/222414862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb5806bb60 0x7feb581f3ae0 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:42.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.700+0000 7feb60215640 1 -- 172.21.15.77:0/222414862 >> 172.21.15.77:0/222414862 conn(0x7feb580cb530 msgr2=0x7feb580cebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:42.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.700+0000 7feb60215640 1 -- 172.21.15.77:0/222414862 shutdown_connections 2023-11-04T01:47:42.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.700+0000 7feb60215640 1 -- 172.21.15.77:0/222414862 wait complete. 2023-11-04T01:47:42.713 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:47:42.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.814+0000 7fd777644640 1 Processor -- start 2023-11-04T01:47:42.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.814+0000 7fd777644640 1 -- start start 2023-11-04T01:47:42.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.815+0000 7fd777644640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd7700ceda0 0x7fd77015cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:42.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.815+0000 7fd777644640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd7700b2210 0x7fd77015d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:42.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.815+0000 7fd777644640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd77015d9a0 con 0x7fd7700cf180 2023-11-04T01:47:42.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.815+0000 7fd777644640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7700b1df0 con 0x7fd7700b2210 2023-11-04T01:47:42.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.815+0000 7fd777644640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7700cfd20 con 0x7fd7700ceda0 2023-11-04T01:47:42.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.816+0000 7fd7753e0640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd7700ceda0 0x7fd77015cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:42.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.816+0000 7fd774bdf640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd7700b2210 0x7fd77015d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:42.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.816+0000 7fd775be1640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7fd7700cf180 0x7fd7700cf610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:51790/0 (socket says 172.21.15.77:51790) 2023-11-04T01:47:42.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.816+0000 7fd775be1640 1 -- 172.21.15.77:0/811002708 learned_addr learned my addr 172.21.15.77:0/811002708 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:47:42.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.816+0000 7fd7753e0640 1 -- 172.21.15.77:0/811002708 >> v2:172.21.15.122:3300/0 conn(0x7fd7700b2210 msgr2=0x7fd77015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:42.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.816+0000 7fd7753e0640 1 --2- 172.21.15.77:0/811002708 >> v2:172.21.15.122:3300/0 conn(0x7fd7700b2210 0x7fd77015d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:42.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.816+0000 7fd7753e0640 1 -- 172.21.15.77:0/811002708 >> v1:172.21.15.122:6789/0 conn(0x7fd7700cf180 legacy=0x7fd7700cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:42.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.816+0000 7fd7753e0640 1 -- 172.21.15.77:0/811002708 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7700b0150 con 0x7fd7700ceda0 2023-11-04T01:47:42.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.816+0000 7fd774bdf640 1 --2- 172.21.15.77:0/811002708 >> v2:172.21.15.122:3300/0 conn(0x7fd7700b2210 0x7fd77015d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:47:42.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.817+0000 7fd7753e0640 1 --2- 172.21.15.77:0/811002708 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd7700ceda0 0x7fd77015cf20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd76c009de0 tx=0x7fd76c02be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3df5911b923e08f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:42.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.817+0000 7fd767fff640 1 -- 172.21.15.77:0/811002708 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c02cc00 con 0x7fd7700ceda0 2023-11-04T01:47:42.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.817+0000 7fd767fff640 1 -- 172.21.15.77:0/811002708 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76c02cd60 con 0x7fd7700ceda0 2023-11-04T01:47:42.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.817+0000 7fd767fff640 1 -- 172.21.15.77:0/811002708 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c034660 con 0x7fd7700ceda0 2023-11-04T01:47:42.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.818+0000 7fd777644640 1 -- 172.21.15.77:0/811002708 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd7700ceda0 msgr2=0x7fd77015cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:42.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.818+0000 7fd777644640 1 --2- 172.21.15.77:0/811002708 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd7700ceda0 0x7fd77015cf20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd76c009de0 tx=0x7fd76c02be50 comp rx=0 tx=0).stop 2023-11-04T01:47:42.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.818+0000 7fd777644640 1 -- 172.21.15.77:0/811002708 shutdown_connections 2023-11-04T01:47:42.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.818+0000 7fd777644640 1 --2- 172.21.15.77:0/811002708 >> v2:172.21.15.122:3300/0 conn(0x7fd7700b2210 0x7fd77015d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:42.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.818+0000 7fd777644640 1 --2- 172.21.15.77:0/811002708 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd7700ceda0 0x7fd77015cf20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:42.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.818+0000 7fd777644640 1 -- 172.21.15.77:0/811002708 >> 172.21.15.77:0/811002708 conn(0x7fd7700d0c30 msgr2=0x7fd7700d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:42.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.818+0000 7fd777644640 1 -- 172.21.15.77:0/811002708 shutdown_connections 2023-11-04T01:47:42.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.818+0000 7fd777644640 1 -- 172.21.15.77:0/811002708 wait complete. 2023-11-04T01:47:42.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.819+0000 7fd777644640 1 Processor -- start 2023-11-04T01:47:42.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.819+0000 7fd777644640 1 -- start start 2023-11-04T01:47:42.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.820+0000 7fd777644640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7700b2210 0x7fd7700c7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:42.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.820+0000 7fd777644640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd7700ceda0 0x7fd7701e7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:42.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.820+0000 7fd777644640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7700cf180 0x7fd7701f2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:42.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.820+0000 7fd777644640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7701e61d0 con 0x7fd7700cf180 2023-11-04T01:47:42.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.820+0000 7fd777644640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7701e64b0 con 0x7fd7700b2210 2023-11-04T01:47:42.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.820+0000 7fd777644640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7701e6790 con 0x7fd7700ceda0 2023-11-04T01:47:42.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.820+0000 7fd775be1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7700cf180 0x7fd7701f2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:42.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.820+0000 7fd775be1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7700cf180 0x7fd7701f2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35318/0 (socket says 172.21.15.77:35318) 2023-11-04T01:47:42.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.820+0000 7fd775be1640 1 -- 172.21.15.77:0/3605488797 learned_addr learned my addr 172.21.15.77:0/3605488797 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:42.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.820+0000 7fd7753e0640 1 --2- 172.21.15.77:0/3605488797 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7700b2210 0x7fd7700c7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:42.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.820+0000 7fd774bdf640 1 --2- 172.21.15.77:0/3605488797 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd7700ceda0 0x7fd7701e7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:42.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.820+0000 7fd775be1640 1 -- 172.21.15.77:0/3605488797 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd7700ceda0 msgr2=0x7fd7701e7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:42.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.820+0000 7fd775be1640 1 --2- 172.21.15.77:0/3605488797 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd7700ceda0 0x7fd7701e7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:42.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.820+0000 7fd775be1640 1 -- 172.21.15.77:0/3605488797 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7700b2210 msgr2=0x7fd7700c7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:42.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.820+0000 7fd775be1640 1 --2- 172.21.15.77:0/3605488797 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7700b2210 0x7fd7700c7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:42.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.820+0000 7fd775be1640 1 -- 172.21.15.77:0/3605488797 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd760009400 con 0x7fd7700cf180 2023-11-04T01:47:42.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.820+0000 7fd774bdf640 1 --2- 172.21.15.77:0/3605488797 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd7700ceda0 0x7fd7701e7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:42.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.820+0000 7fd7753e0640 1 --2- 172.21.15.77:0/3605488797 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7700b2210 0x7fd7700c7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:42.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.820+0000 7fd775be1640 1 --2- 172.21.15.77:0/3605488797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7700cf180 0x7fd7701f2380 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7fd76800c370 tx=0x7fd76800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:42.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.820+0000 7fd765ffb640 1 -- 172.21.15.77:0/3605488797 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd768005ce0 con 0x7fd7700cf180 2023-11-04T01:47:42.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.820+0000 7fd765ffb640 1 -- 172.21.15.77:0/3605488797 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd768005e40 con 0x7fd7700cf180 2023-11-04T01:47:42.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.820+0000 7fd777644640 1 -- 172.21.15.77:0/3605488797 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd76c009a70 con 0x7fd7700cf180 2023-11-04T01:47:42.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.820+0000 7fd765ffb640 1 -- 172.21.15.77:0/3605488797 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7680072d0 con 0x7fd7700cf180 2023-11-04T01:47:42.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.821+0000 7fd777644640 1 -- 172.21.15.77:0/3605488797 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7701e6d50 con 0x7fd7700cf180 2023-11-04T01:47:42.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.822+0000 7fd777644640 1 -- 172.21.15.77:0/3605488797 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7700cb0d0 con 0x7fd7700cf180 2023-11-04T01:47:42.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.822+0000 7fd765ffb640 1 -- 172.21.15.77:0/3605488797 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd7680074f0 con 0x7fd7700cf180 2023-11-04T01:47:42.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.822+0000 7fd765ffb640 1 --2- 172.21.15.77:0/3605488797 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd75406ae70 0x7fd75406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:42.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.822+0000 7fd765ffb640 1 -- 172.21.15.77:0/3605488797 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8167+0+0 (secure 0 0 0) 0x7fd7680893d0 con 0x7fd7700cf180 2023-11-04T01:47:42.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.822+0000 7fd7753e0640 1 --2- 172.21.15.77:0/3605488797 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd75406ae70 0x7fd75406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:42.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.823+0000 7fd7753e0640 1 --2- 172.21.15.77:0/3605488797 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd75406ae70 0x7fd75406d330 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fd76c036000 tx=0x7fd76c030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:42.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.826+0000 7fd765ffb640 1 -- 172.21.15.77:0/3605488797 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd768053ba0 con 0x7fd7700cf180 2023-11-04T01:47:42.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.990+0000 7fd777644640 1 -- 172.21.15.77:0/3605488797 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fd7700684b0 con 0x7fd7700cf180 2023-11-04T01:47:42.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.990+0000 7fd765ffb640 1 -- 172.21.15.77:0/3605488797 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v115) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd7680571c0 con 0x7fd7700cf180 2023-11-04T01:47:42.993 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:47:42.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.992+0000 7fd777644640 1 -- 172.21.15.77:0/3605488797 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd75406ae70 msgr2=0x7fd75406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:42.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.992+0000 7fd777644640 1 --2- 172.21.15.77:0/3605488797 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd75406ae70 0x7fd75406d330 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fd76c036000 tx=0x7fd76c030000 comp rx=0 tx=0).stop 2023-11-04T01:47:42.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.992+0000 7fd777644640 1 -- 172.21.15.77:0/3605488797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7700cf180 msgr2=0x7fd7701f2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:42.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.992+0000 7fd777644640 1 --2- 172.21.15.77:0/3605488797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7700cf180 0x7fd7701f2380 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7fd76800c370 tx=0x7fd76800c830 comp rx=0 tx=0).stop 2023-11-04T01:47:42.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.992+0000 7fd777644640 1 -- 172.21.15.77:0/3605488797 shutdown_connections 2023-11-04T01:47:42.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.992+0000 7fd777644640 1 --2- 172.21.15.77:0/3605488797 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fd75406ae70 0x7fd75406d330 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:42.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.992+0000 7fd777644640 1 --2- 172.21.15.77:0/3605488797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7700cf180 0x7fd7701f2380 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:42.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.992+0000 7fd777644640 1 --2- 172.21.15.77:0/3605488797 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd7700ceda0 0x7fd7701e7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:42.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.992+0000 7fd777644640 1 --2- 172.21.15.77:0/3605488797 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7700b2210 0x7fd7700c7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:42.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.992+0000 7fd777644640 1 -- 172.21.15.77:0/3605488797 >> 172.21.15.77:0/3605488797 conn(0x7fd7700d0c30 msgr2=0x7fd77006f430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:42.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.992+0000 7fd777644640 1 -- 172.21.15.77:0/3605488797 shutdown_connections 2023-11-04T01:47:42.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:42.992+0000 7fd777644640 1 -- 172.21.15.77:0/3605488797 wait complete. 2023-11-04T01:47:43.006 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:47:43.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.106+0000 7efd51a1a640 1 Processor -- start 2023-11-04T01:47:43.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.106+0000 7efd51a1a640 1 -- start start 2023-11-04T01:47:43.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.106+0000 7efd51a1a640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7efd4c0b2210 0x7efd4c0cf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.106+0000 7efd51a1a640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd4c15d630 0x7efd4c0cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.106+0000 7efd51a1a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd4c0b0150 con 0x7efd4c0ceda0 2023-11-04T01:47:43.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.106+0000 7efd51a1a640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd4c0b1df0 con 0x7efd4c0b2210 2023-11-04T01:47:43.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.106+0000 7efd51a1a640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c0b1170 con 0x7efd4c15d630 2023-11-04T01:47:43.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.107+0000 7efd4affd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7efd4c0ceda0 0x7efd4c15cf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36010/0 (socket says 172.21.15.77:36010) 2023-11-04T01:47:43.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.107+0000 7efd4affd640 1 -- 172.21.15.77:0/3903375354 learned_addr learned my addr 172.21.15.77:0/3903375354 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:47:43.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.107+0000 7efd427fc640 1 --2- 172.21.15.77:0/3903375354 >> v2:172.21.15.122:3300/0 conn(0x7efd4c0b2210 0x7efd4c0cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.107+0000 7efd4b7fe640 1 --2- 172.21.15.77:0/3903375354 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd4c15d630 0x7efd4c0cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.107+0000 7efd4a7fc640 1 -- 172.21.15.77:0/3903375354 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 976148740 0 0) 0x7efd4c0b0150 con 0x7efd4c0ceda0 2023-11-04T01:47:43.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.107+0000 7efd4a7fc640 1 -- 172.21.15.77:0/3903375354 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd38003520 con 0x7efd4c0ceda0 2023-11-04T01:47:43.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.107+0000 7efd4a7fc640 1 -- 172.21.15.77:0/3903375354 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2147531495 0 0) 0x7efd38003520 con 0x7efd4c0ceda0 2023-11-04T01:47:43.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.107+0000 7efd4a7fc640 1 -- 172.21.15.77:0/3903375354 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd4c15d630 msgr2=0x7efd4c0cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:43.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.107+0000 7efd4a7fc640 1 --2- 172.21.15.77:0/3903375354 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd4c15d630 0x7efd4c0cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.107+0000 7efd4a7fc640 1 -- 172.21.15.77:0/3903375354 >> v2:172.21.15.122:3300/0 conn(0x7efd4c0b2210 msgr2=0x7efd4c0cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:43.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.107+0000 7efd4a7fc640 1 --2- 172.21.15.77:0/3903375354 >> v2:172.21.15.122:3300/0 conn(0x7efd4c0b2210 0x7efd4c0cf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.107+0000 7efd4a7fc640 1 -- 172.21.15.77:0/3903375354 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd4c0b1450 con 0x7efd4c0ceda0 2023-11-04T01:47:43.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.107+0000 7efd4a7fc640 1 -- 172.21.15.77:0/3903375354 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7efd3c0017f0 con 0x7efd4c0ceda0 2023-11-04T01:47:43.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.107+0000 7efd4a7fc640 1 -- 172.21.15.77:0/3903375354 >> v1:172.21.15.77:6789/0 conn(0x7efd4c0ceda0 legacy=0x7efd4c15cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.107+0000 7efd4a7fc640 1 --2- 172.21.15.77:0/3903375354 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd38003970 0x7efd38003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.107+0000 7efd4a7fc640 1 --2- 172.21.15.77:0/3903375354 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd4c15d630 0x7efd380047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.107+0000 7efd4a7fc640 1 --2- 172.21.15.77:0/3903375354 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd38004d00 0x7efd38005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.107+0000 7efd4a7fc640 1 -- 172.21.15.77:0/3903375354 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c0b1df0 con 0x7efd38004d00 2023-11-04T01:47:43.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.107+0000 7efd4a7fc640 1 -- 172.21.15.77:0/3903375354 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c0b1170 con 0x7efd38003970 2023-11-04T01:47:43.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.107+0000 7efd4a7fc640 1 -- 172.21.15.77:0/3903375354 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd3800b980 con 0x7efd4c15d630 2023-11-04T01:47:43.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.107+0000 7efd4b7fe640 1 --2- 172.21.15.77:0/3903375354 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd38004d00 0x7efd38005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.107+0000 7efd4affd640 1 --2- 172.21.15.77:0/3903375354 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd38003970 0x7efd38003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.107+0000 7efd427fc640 1 --2- 172.21.15.77:0/3903375354 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd4c15d630 0x7efd380047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.108+0000 7efd4b7fe640 1 -- 172.21.15.77:0/3903375354 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd4c15d630 msgr2=0x7efd380047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:43.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.108+0000 7efd4b7fe640 1 --2- 172.21.15.77:0/3903375354 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd4c15d630 0x7efd380047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.108+0000 7efd4b7fe640 1 -- 172.21.15.77:0/3903375354 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd38003970 msgr2=0x7efd38003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:43.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.108+0000 7efd4b7fe640 1 --2- 172.21.15.77:0/3903375354 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd38003970 0x7efd38003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.108+0000 7efd4b7fe640 1 -- 172.21.15.77:0/3903375354 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd38003520 con 0x7efd38004d00 2023-11-04T01:47:43.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.108+0000 7efd4b7fe640 1 --2- 172.21.15.77:0/3903375354 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd38004d00 0x7efd38005180 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7efd44009fc0 tx=0x7efd380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0f5d1e171b5e15 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:43.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.108+0000 7efd4a7fc640 1 -- 172.21.15.77:0/3903375354 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4402cc20 con 0x7efd38004d00 2023-11-04T01:47:43.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.108+0000 7efd4a7fc640 1 -- 172.21.15.77:0/3903375354 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd4400f040 con 0x7efd38004d00 2023-11-04T01:47:43.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.108+0000 7efd4a7fc640 1 -- 172.21.15.77:0/3903375354 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd44034440 con 0x7efd38004d00 2023-11-04T01:47:43.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.109+0000 7efd51a1a640 1 -- 172.21.15.77:0/3903375354 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd38004d00 msgr2=0x7efd38005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.109+0000 7efd51a1a640 1 --2- 172.21.15.77:0/3903375354 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd38004d00 0x7efd38005180 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7efd44009fc0 tx=0x7efd380057f0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.109+0000 7efd4b7fe640 1 -- 172.21.15.77:0/3903375354 reap_dead start 2023-11-04T01:47:43.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.109+0000 7efd51a1a640 1 -- 172.21.15.77:0/3903375354 shutdown_connections 2023-11-04T01:47:43.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.109+0000 7efd51a1a640 1 -- 172.21.15.77:0/3903375354 >> 172.21.15.77:0/3903375354 conn(0x7efd4c0d0c30 msgr2=0x7efd4c0d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:43.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.109+0000 7efd51a1a640 1 -- 172.21.15.77:0/3903375354 shutdown_connections 2023-11-04T01:47:43.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.109+0000 7efd51a1a640 1 -- 172.21.15.77:0/3903375354 wait complete. 2023-11-04T01:47:43.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.110+0000 7efd51a1a640 1 Processor -- start 2023-11-04T01:47:43.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.110+0000 7efd51a1a640 1 -- start start 2023-11-04T01:47:43.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.111+0000 7efd51a1a640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd38004d00 0x7efd4c0c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.111+0000 7efd51a1a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd4c0c6e50 0x7efd4c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.111+0000 7efd51a1a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd4c1e57e0 0x7efd4c1e5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.111+0000 7efd51a1a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c0c5830 con 0x7efd4c0c6e50 2023-11-04T01:47:43.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.111+0000 7efd51a1a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c0c5550 con 0x7efd4c1e57e0 2023-11-04T01:47:43.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.111+0000 7efd51a1a640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c1e6520 con 0x7efd38004d00 2023-11-04T01:47:43.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.111+0000 7efd427fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd4c0c6e50 0x7efd4c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.111+0000 7efd427fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd4c0c6e50 0x7efd4c0b6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35338/0 (socket says 172.21.15.77:35338) 2023-11-04T01:47:43.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.111+0000 7efd427fc640 1 -- 172.21.15.77:0/2018759226 learned_addr learned my addr 172.21.15.77:0/2018759226 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:43.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.111+0000 7efd4b7fe640 1 --2- 172.21.15.77:0/2018759226 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd4c1e57e0 0x7efd4c1e5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.111+0000 7efd4affd640 1 --2- 172.21.15.77:0/2018759226 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd38004d00 0x7efd4c0c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.111+0000 7efd427fc640 1 -- 172.21.15.77:0/2018759226 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd38004d00 msgr2=0x7efd4c0c4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.111+0000 7efd427fc640 1 --2- 172.21.15.77:0/2018759226 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd38004d00 0x7efd4c0c4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.111+0000 7efd427fc640 1 -- 172.21.15.77:0/2018759226 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd4c1e57e0 msgr2=0x7efd4c1e5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.111+0000 7efd427fc640 1 --2- 172.21.15.77:0/2018759226 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd4c1e57e0 0x7efd4c1e5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.111+0000 7efd427fc640 1 -- 172.21.15.77:0/2018759226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd4c1e6800 con 0x7efd4c0c6e50 2023-11-04T01:47:43.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.112+0000 7efd427fc640 1 --2- 172.21.15.77:0/2018759226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd4c0c6e50 0x7efd4c0b6110 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7efd34011a70 tx=0x7efd34011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:43.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.112+0000 7efd48ff9640 1 -- 172.21.15.77:0/2018759226 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd34009680 con 0x7efd4c0c6e50 2023-11-04T01:47:43.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.112+0000 7efd48ff9640 1 -- 172.21.15.77:0/2018759226 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd3400fb50 con 0x7efd4c0c6e50 2023-11-04T01:47:43.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.112+0000 7efd51a1a640 1 -- 172.21.15.77:0/2018759226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd4c1e6ae0 con 0x7efd4c0c6e50 2023-11-04T01:47:43.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.112+0000 7efd48ff9640 1 -- 172.21.15.77:0/2018759226 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3400fee0 con 0x7efd4c0c6e50 2023-11-04T01:47:43.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.112+0000 7efd51a1a640 1 -- 172.21.15.77:0/2018759226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd4c0b6650 con 0x7efd4c0c6e50 2023-11-04T01:47:43.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.113+0000 7efd51a1a640 1 -- 172.21.15.77:0/2018759226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd4c0684b0 con 0x7efd4c0c6e50 2023-11-04T01:47:43.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.113+0000 7efd48ff9640 1 -- 172.21.15.77:0/2018759226 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efd3401d400 con 0x7efd4c0c6e50 2023-11-04T01:47:43.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.113+0000 7efd48ff9640 1 --2- 172.21.15.77:0/2018759226 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efd2c06aea0 0x7efd2c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.113+0000 7efd48ff9640 1 -- 172.21.15.77:0/2018759226 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8167+0+0 (secure 0 0 0) 0x7efd3408a840 con 0x7efd4c0c6e50 2023-11-04T01:47:43.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.114+0000 7efd4affd640 1 --2- 172.21.15.77:0/2018759226 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efd2c06aea0 0x7efd2c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.114+0000 7efd4affd640 1 --2- 172.21.15.77:0/2018759226 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efd2c06aea0 0x7efd2c06d360 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7efd3c000ef0 tx=0x7efd3c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:43.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.117+0000 7efd48ff9640 1 -- 172.21.15.77:0/2018759226 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efd34054f70 con 0x7efd4c0c6e50 2023-11-04T01:47:43.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.284+0000 7efd51a1a640 1 -- 172.21.15.77:0/2018759226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7efd4c1e6c70 con 0x7efd4c0c6e50 2023-11-04T01:47:43.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.284+0000 7efd48ff9640 1 -- 172.21.15.77:0/2018759226 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v115) v1 ==== 103+0+11 (secure 0 0 0) 0x7efd34058590 con 0x7efd4c0c6e50 2023-11-04T01:47:43.287 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:47:43.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.286+0000 7efd51a1a640 1 -- 172.21.15.77:0/2018759226 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efd2c06aea0 msgr2=0x7efd2c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.286+0000 7efd51a1a640 1 --2- 172.21.15.77:0/2018759226 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efd2c06aea0 0x7efd2c06d360 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7efd3c000ef0 tx=0x7efd3c009040 comp rx=0 tx=0).stop 2023-11-04T01:47:43.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.286+0000 7efd51a1a640 1 -- 172.21.15.77:0/2018759226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd4c0c6e50 msgr2=0x7efd4c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.287+0000 7efd51a1a640 1 --2- 172.21.15.77:0/2018759226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd4c0c6e50 0x7efd4c0b6110 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7efd34011a70 tx=0x7efd34011f30 comp rx=0 tx=0).stop 2023-11-04T01:47:43.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.287+0000 7efd51a1a640 1 -- 172.21.15.77:0/2018759226 shutdown_connections 2023-11-04T01:47:43.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.287+0000 7efd51a1a640 1 --2- 172.21.15.77:0/2018759226 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7efd2c06aea0 0x7efd2c06d360 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.287+0000 7efd51a1a640 1 --2- 172.21.15.77:0/2018759226 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd4c1e57e0 0x7efd4c1e5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.287+0000 7efd51a1a640 1 --2- 172.21.15.77:0/2018759226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd4c0c6e50 0x7efd4c0b6110 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.287+0000 7efd51a1a640 1 --2- 172.21.15.77:0/2018759226 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7efd38004d00 0x7efd4c0c4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.287+0000 7efd51a1a640 1 -- 172.21.15.77:0/2018759226 >> 172.21.15.77:0/2018759226 conn(0x7efd4c0d0c30 msgr2=0x7efd4c0d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:43.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.287+0000 7efd51a1a640 1 -- 172.21.15.77:0/2018759226 shutdown_connections 2023-11-04T01:47:43.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.287+0000 7efd51a1a640 1 -- 172.21.15.77:0/2018759226 wait complete. 2023-11-04T01:47:43.300 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:47:43.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.400+0000 7fec3e6e1640 1 Processor -- start 2023-11-04T01:47:43.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.400+0000 7fec3e6e1640 1 -- start start 2023-11-04T01:47:43.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.400+0000 7fec3e6e1640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fec38160630 0x7fec380cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.400+0000 7fec3e6e1640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec3806e660 con 0x7fec3806e1d0 2023-11-04T01:47:43.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.400+0000 7fec3e6e1640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec3806d0e0 con 0x7fec380ca0e0 2023-11-04T01:47:43.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.400+0000 7fec3e6e1640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec3806d3c0 con 0x7fec38160630 2023-11-04T01:47:43.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.400+0000 7fec37fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fec38160630 0x7fec380cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.400+0000 7fec377fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fec3806e1d0 0x7fec3806bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36024/0 (socket says 172.21.15.77:36024) 2023-11-04T01:47:43.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.401+0000 7fec377fe640 1 -- 172.21.15.77:0/2536048486 learned_addr learned my addr 172.21.15.77:0/2536048486 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:47:43.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.401+0000 7fec37fff640 1 -- 172.21.15.77:0/2536048486 >> v1:172.21.15.122:6789/0 conn(0x7fec380ca0e0 legacy=0x7fec3806c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:43.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.401+0000 7fec37fff640 1 -- 172.21.15.77:0/2536048486 >> v1:172.21.15.77:6789/0 conn(0x7fec3806e1d0 legacy=0x7fec3806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.401+0000 7fec37fff640 1 -- 172.21.15.77:0/2536048486 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec3806d6a0 con 0x7fec38160630 2023-11-04T01:47:43.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.401+0000 7fec36ffd640 1 -- 172.21.15.77:0/2536048486 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3507249622 0 0) 0x7fec3806e660 con 0x7fec3806e1d0 2023-11-04T01:47:43.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.401+0000 7fec37fff640 1 --2- 172.21.15.77:0/2536048486 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec38160630 0x7fec380cda40 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fec280097a0 tx=0x7fec2802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c1dc0bbba3c875 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:43.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.402+0000 7fec36ffd640 1 -- 172.21.15.77:0/2536048486 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2802e070 con 0x7fec38160630 2023-11-04T01:47:43.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.402+0000 7fec36ffd640 1 -- 172.21.15.77:0/2536048486 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec280315a0 con 0x7fec38160630 2023-11-04T01:47:43.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.402+0000 7fec36ffd640 1 -- 172.21.15.77:0/2536048486 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec28031930 con 0x7fec38160630 2023-11-04T01:47:43.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.402+0000 7fec3e6e1640 1 -- 172.21.15.77:0/2536048486 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec38160630 msgr2=0x7fec380cda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.402+0000 7fec3e6e1640 1 --2- 172.21.15.77:0/2536048486 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec38160630 0x7fec380cda40 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fec280097a0 tx=0x7fec2802b840 comp rx=0 tx=0).stop 2023-11-04T01:47:43.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.402+0000 7fec3e6e1640 1 -- 172.21.15.77:0/2536048486 shutdown_connections 2023-11-04T01:47:43.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.402+0000 7fec3e6e1640 1 --2- 172.21.15.77:0/2536048486 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec38160630 0x7fec380cda40 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.402+0000 7fec3e6e1640 1 -- 172.21.15.77:0/2536048486 >> 172.21.15.77:0/2536048486 conn(0x7fec380cb8e0 msgr2=0x7fec380cbcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:43.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.402+0000 7fec3e6e1640 1 -- 172.21.15.77:0/2536048486 shutdown_connections 2023-11-04T01:47:43.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.402+0000 7fec3e6e1640 1 -- 172.21.15.77:0/2536048486 wait complete. 2023-11-04T01:47:43.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.403+0000 7fec3e6e1640 1 Processor -- start 2023-11-04T01:47:43.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.404+0000 7fec3e6e1640 1 -- start start 2023-11-04T01:47:43.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.404+0000 7fec3e6e1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec380ca0e0 0x7fec380c4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.404+0000 7fec3e6e1640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fec38160630 0x7fec380c2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.404+0000 7fec3e6e1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec380c2e70 0x7fec380b1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.404+0000 7fec3e6e1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec380b44c0 con 0x7fec380ca0e0 2023-11-04T01:47:43.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.404+0000 7fec3e6e1640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec380c34a0 con 0x7fec380c2e70 2023-11-04T01:47:43.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.404+0000 7fec3e6e1640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec380c3780 con 0x7fec38160630 2023-11-04T01:47:43.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.404+0000 7fec37fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec380ca0e0 0x7fec380c4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.404+0000 7fec37fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec380ca0e0 0x7fec380c4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35364/0 (socket says 172.21.15.77:35364) 2023-11-04T01:47:43.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.404+0000 7fec37fff640 1 -- 172.21.15.77:0/1691748333 learned_addr learned my addr 172.21.15.77:0/1691748333 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:43.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.405+0000 7fec37fff640 1 -- 172.21.15.77:0/1691748333 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fec38160630 msgr2=0x7fec380c2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.405+0000 7fec37fff640 1 --2- 172.21.15.77:0/1691748333 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fec38160630 0x7fec380c2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.405+0000 7fec37fff640 1 -- 172.21.15.77:0/1691748333 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec380c2e70 msgr2=0x7fec380b1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.405+0000 7fec3cc7e640 1 --2- 172.21.15.77:0/1691748333 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec380c2e70 0x7fec380b1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.405+0000 7fec37fff640 1 --2- 172.21.15.77:0/1691748333 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec380c2e70 0x7fec380b1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.405+0000 7fec37fff640 1 -- 172.21.15.77:0/1691748333 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec28009400 con 0x7fec380ca0e0 2023-11-04T01:47:43.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.405+0000 7fec37fff640 1 --2- 172.21.15.77:0/1691748333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec380ca0e0 0x7fec380c4ba0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fec28034040 tx=0x7fec280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:43.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.405+0000 7fec34ff9640 1 -- 172.21.15.77:0/1691748333 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec28032900 con 0x7fec380ca0e0 2023-11-04T01:47:43.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.405+0000 7fec34ff9640 1 -- 172.21.15.77:0/1691748333 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec28032a60 con 0x7fec380ca0e0 2023-11-04T01:47:43.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.405+0000 7fec3e6e1640 1 -- 172.21.15.77:0/1691748333 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec380c3a60 con 0x7fec380ca0e0 2023-11-04T01:47:43.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.405+0000 7fec34ff9640 1 -- 172.21.15.77:0/1691748333 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec28032e10 con 0x7fec380ca0e0 2023-11-04T01:47:43.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.405+0000 7fec3e6e1640 1 -- 172.21.15.77:0/1691748333 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec380c4020 con 0x7fec380ca0e0 2023-11-04T01:47:43.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.406+0000 7fec3e6e1640 1 -- 172.21.15.77:0/1691748333 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec380cabd0 con 0x7fec380ca0e0 2023-11-04T01:47:43.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.407+0000 7fec34ff9640 1 -- 172.21.15.77:0/1691748333 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fec2803b3f0 con 0x7fec380ca0e0 2023-11-04T01:47:43.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.407+0000 7fec34ff9640 1 --2- 172.21.15.77:0/1691748333 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fec2406ae70 0x7fec2406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.407+0000 7fec34ff9640 1 -- 172.21.15.77:0/1691748333 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8167+0+0 (secure 0 0 0) 0x7fec280ac0a0 con 0x7fec380ca0e0 2023-11-04T01:47:43.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.407+0000 7fec377fe640 1 --2- 172.21.15.77:0/1691748333 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fec2406ae70 0x7fec2406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.408+0000 7fec377fe640 1 --2- 172.21.15.77:0/1691748333 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fec2406ae70 0x7fec2406d330 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fec2c007fd0 tx=0x7fec2c007960 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:43.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.411+0000 7fec34ff9640 1 -- 172.21.15.77:0/1691748333 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fec280767b0 con 0x7fec380ca0e0 2023-11-04T01:47:43.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.577+0000 7fec3e6e1640 1 -- 172.21.15.77:0/1691748333 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7fec38073600 con 0x7fec380ca0e0 2023-11-04T01:47:43.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.578+0000 7fec34ff9640 1 -- 172.21.15.77:0/1691748333 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v115) v1 ==== 107+0+11 (secure 0 0 0) 0x7fec28079dd0 con 0x7fec380ca0e0 2023-11-04T01:47:43.581 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:47:43.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.579+0000 7fec3e6e1640 1 -- 172.21.15.77:0/1691748333 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fec2406ae70 msgr2=0x7fec2406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.579+0000 7fec3e6e1640 1 --2- 172.21.15.77:0/1691748333 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fec2406ae70 0x7fec2406d330 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fec2c007fd0 tx=0x7fec2c007960 comp rx=0 tx=0).stop 2023-11-04T01:47:43.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.579+0000 7fec3e6e1640 1 -- 172.21.15.77:0/1691748333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec380ca0e0 msgr2=0x7fec380c4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.579+0000 7fec3e6e1640 1 --2- 172.21.15.77:0/1691748333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec380ca0e0 0x7fec380c4ba0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fec28034040 tx=0x7fec280046c0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.580+0000 7fec3e6e1640 1 -- 172.21.15.77:0/1691748333 shutdown_connections 2023-11-04T01:47:43.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.580+0000 7fec3e6e1640 1 --2- 172.21.15.77:0/1691748333 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fec2406ae70 0x7fec2406d330 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.580+0000 7fec3e6e1640 1 --2- 172.21.15.77:0/1691748333 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec380c2e70 0x7fec380b1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.580+0000 7fec3e6e1640 1 --2- 172.21.15.77:0/1691748333 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fec38160630 0x7fec380c2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.580+0000 7fec3e6e1640 1 --2- 172.21.15.77:0/1691748333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec380ca0e0 0x7fec380c4ba0 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.580+0000 7fec3e6e1640 1 -- 172.21.15.77:0/1691748333 >> 172.21.15.77:0/1691748333 conn(0x7fec380cb8e0 msgr2=0x7fec380afa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:43.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.580+0000 7fec3e6e1640 1 -- 172.21.15.77:0/1691748333 shutdown_connections 2023-11-04T01:47:43.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.580+0000 7fec3e6e1640 1 -- 172.21.15.77:0/1691748333 wait complete. 2023-11-04T01:47:43.593 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:47:43.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.692+0000 7f41df40e640 1 Processor -- start 2023-11-04T01:47:43.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.692+0000 7f41df40e640 1 -- start start 2023-11-04T01:47:43.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.693+0000 7f41df40e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f41d815d100 0x7f41d80ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.693+0000 7f41df40e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41d815d4e0 0x7f41d80d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.693+0000 7f41df40e640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41d80b32b0 con 0x7f41d80d3b60 2023-11-04T01:47:43.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.693+0000 7f41df40e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41d80cee10 con 0x7f41d815d100 2023-11-04T01:47:43.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.693+0000 7f41df40e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d80b4750 con 0x7f41d815d4e0 2023-11-04T01:47:43.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.693+0000 7f41dd1aa640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f41d815d100 0x7f41d80ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.693+0000 7f41dd1aa640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f41d815d100 0x7f41d80ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35372/0 (socket says 172.21.15.77:35372) 2023-11-04T01:47:43.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.693+0000 7f41dd1aa640 1 -- 172.21.15.77:0/210638843 learned_addr learned my addr 172.21.15.77:0/210638843 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:43.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.693+0000 7f41dc9a9640 1 --2- 172.21.15.77:0/210638843 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41d815d4e0 0x7f41d80d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.693+0000 7f41dd1aa640 1 -- 172.21.15.77:0/210638843 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41d815d4e0 msgr2=0x7f41d80d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:43.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.693+0000 7f41dd1aa640 1 --2- 172.21.15.77:0/210638843 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41d815d4e0 0x7f41d80d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.693+0000 7f41dd1aa640 1 -- 172.21.15.77:0/210638843 >> v1:172.21.15.122:6789/0 conn(0x7f41d80d3b60 legacy=0x7f41d80cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.693+0000 7f41dd1aa640 1 -- 172.21.15.77:0/210638843 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d80b2980 con 0x7f41d815d100 2023-11-04T01:47:43.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.694+0000 7f41dd1aa640 1 --2- 172.21.15.77:0/210638843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41d815d100 0x7f41d80ce510 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f41d4009ea0 tx=0x7f41d402bfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ec07710e0907f1c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:43.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.694+0000 7f41cffff640 1 -- 172.21.15.77:0/210638843 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d402cb40 con 0x7f41d815d100 2023-11-04T01:47:43.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.694+0000 7f41cffff640 1 -- 172.21.15.77:0/210638843 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d402cca0 con 0x7f41d815d100 2023-11-04T01:47:43.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.694+0000 7f41cffff640 1 -- 172.21.15.77:0/210638843 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d4034610 con 0x7f41d815d100 2023-11-04T01:47:43.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.694+0000 7f41df40e640 1 -- 172.21.15.77:0/210638843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41d815d100 msgr2=0x7f41d80ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.694+0000 7f41df40e640 1 --2- 172.21.15.77:0/210638843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41d815d100 0x7f41d80ce510 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f41d4009ea0 tx=0x7f41d402bfa0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.695+0000 7f41df40e640 1 -- 172.21.15.77:0/210638843 shutdown_connections 2023-11-04T01:47:43.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.695+0000 7f41df40e640 1 --2- 172.21.15.77:0/210638843 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41d815d4e0 0x7f41d80d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.695+0000 7f41df40e640 1 --2- 172.21.15.77:0/210638843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41d815d100 0x7f41d80ce510 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.695+0000 7f41df40e640 1 -- 172.21.15.77:0/210638843 >> 172.21.15.77:0/210638843 conn(0x7f41d80d2ef0 msgr2=0x7f41d80d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:43.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.695+0000 7f41df40e640 1 -- 172.21.15.77:0/210638843 shutdown_connections 2023-11-04T01:47:43.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.695+0000 7f41df40e640 1 -- 172.21.15.77:0/210638843 wait complete. 2023-11-04T01:47:43.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.696+0000 7f41df40e640 1 Processor -- start 2023-11-04T01:47:43.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.696+0000 7f41df40e640 1 -- start start 2023-11-04T01:47:43.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.696+0000 7f41df40e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41d80d3b60 0x7f41d81f22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.696+0000 7f41df40e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41d815d100 0x7f41d80d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.696+0000 7f41df40e640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41d815d4e0 0x7f41d80d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.696+0000 7f41df40e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d809ef00 con 0x7f41d80d3b60 2023-11-04T01:47:43.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.696+0000 7f41df40e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d809f5f0 con 0x7f41d815d100 2023-11-04T01:47:43.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.696+0000 7f41df40e640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d81f2810 con 0x7f41d815d4e0 2023-11-04T01:47:43.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.697+0000 7f41dd1aa640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41d80d3b60 0x7f41d81f22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.697+0000 7f41dd1aa640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41d80d3b60 0x7f41d81f22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35388/0 (socket says 172.21.15.77:35388) 2023-11-04T01:47:43.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.697+0000 7f41dd1aa640 1 -- 172.21.15.77:0/2311119106 learned_addr learned my addr 172.21.15.77:0/2311119106 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:43.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.697+0000 7f41dc9a9640 1 --2- 172.21.15.77:0/2311119106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41d815d100 0x7f41d80d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.697+0000 7f41dd9ab640 1 --2- 172.21.15.77:0/2311119106 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41d815d4e0 0x7f41d80d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.697+0000 7f41dd1aa640 1 -- 172.21.15.77:0/2311119106 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41d815d4e0 msgr2=0x7f41d80d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.697+0000 7f41dd1aa640 1 --2- 172.21.15.77:0/2311119106 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41d815d4e0 0x7f41d80d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.697+0000 7f41dd1aa640 1 -- 172.21.15.77:0/2311119106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41d815d100 msgr2=0x7f41d80d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.697+0000 7f41dd1aa640 1 --2- 172.21.15.77:0/2311119106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41d815d100 0x7f41d80d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.697+0000 7f41dd1aa640 1 -- 172.21.15.77:0/2311119106 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d4009b30 con 0x7f41d80d3b60 2023-11-04T01:47:43.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.697+0000 7f41dd1aa640 1 --2- 172.21.15.77:0/2311119106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41d80d3b60 0x7f41d81f22d0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f41d4036040 tx=0x7f41d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:43.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.697+0000 7f41cdffb640 1 -- 172.21.15.77:0/2311119106 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d4009510 con 0x7f41d80d3b60 2023-11-04T01:47:43.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.697+0000 7f41cdffb640 1 -- 172.21.15.77:0/2311119106 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d403e450 con 0x7f41d80d3b60 2023-11-04T01:47:43.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.697+0000 7f41df40e640 1 -- 172.21.15.77:0/2311119106 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41d809e280 con 0x7f41d80d3b60 2023-11-04T01:47:43.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.697+0000 7f41cdffb640 1 -- 172.21.15.77:0/2311119106 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d403e800 con 0x7f41d80d3b60 2023-11-04T01:47:43.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.697+0000 7f41df40e640 1 -- 172.21.15.77:0/2311119106 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41d809e840 con 0x7f41d80d3b60 2023-11-04T01:47:43.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.699+0000 7f41df40e640 1 -- 172.21.15.77:0/2311119106 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41d809f040 con 0x7f41d80d3b60 2023-11-04T01:47:43.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.699+0000 7f41cdffb640 1 -- 172.21.15.77:0/2311119106 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f41d403e960 con 0x7f41d80d3b60 2023-11-04T01:47:43.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.699+0000 7f41cdffb640 1 --2- 172.21.15.77:0/2311119106 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f41bc06ae70 0x7f41bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.699+0000 7f41cdffb640 1 -- 172.21.15.77:0/2311119106 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f41d40accf0 con 0x7f41d80d3b60 2023-11-04T01:47:43.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.699+0000 7f41dc9a9640 1 --2- 172.21.15.77:0/2311119106 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f41bc06ae70 0x7f41bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.700+0000 7f41dc9a9640 1 --2- 172.21.15.77:0/2311119106 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f41bc06ae70 0x7f41bc06d330 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f41d80c9600 tx=0x7f41c8008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:43.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.703+0000 7f41cdffb640 1 -- 172.21.15.77:0/2311119106 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f41d809f040 con 0x7f41d80d3b60 2023-11-04T01:47:43.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.868+0000 7f41df40e640 1 -- 172.21.15.77:0/2311119106 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f41d809f040 con 0x7f41d80d3b60 2023-11-04T01:47:43.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.869+0000 7f41cdffb640 1 -- 172.21.15.77:0/2311119106 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v115) v1 ==== 104+0+11 (secure 0 0 0) 0x7f41d809f040 con 0x7f41d80d3b60 2023-11-04T01:47:43.872 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:47:43.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.870+0000 7f41df40e640 1 -- 172.21.15.77:0/2311119106 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f41bc06ae70 msgr2=0x7f41bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.870+0000 7f41df40e640 1 --2- 172.21.15.77:0/2311119106 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f41bc06ae70 0x7f41bc06d330 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f41d80c9600 tx=0x7f41c8008040 comp rx=0 tx=0).stop 2023-11-04T01:47:43.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.870+0000 7f41df40e640 1 -- 172.21.15.77:0/2311119106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41d80d3b60 msgr2=0x7f41d81f22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.870+0000 7f41df40e640 1 --2- 172.21.15.77:0/2311119106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41d80d3b60 0x7f41d81f22d0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f41d4036040 tx=0x7f41d4004a40 comp rx=0 tx=0).stop 2023-11-04T01:47:43.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.870+0000 7f41df40e640 1 -- 172.21.15.77:0/2311119106 shutdown_connections 2023-11-04T01:47:43.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.870+0000 7f41df40e640 1 --2- 172.21.15.77:0/2311119106 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f41bc06ae70 0x7f41bc06d330 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.870+0000 7f41df40e640 1 --2- 172.21.15.77:0/2311119106 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f41d815d4e0 0x7f41d80d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.870+0000 7f41df40e640 1 --2- 172.21.15.77:0/2311119106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f41d815d100 0x7f41d80d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.870+0000 7f41df40e640 1 --2- 172.21.15.77:0/2311119106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41d80d3b60 0x7f41d81f22d0 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.870+0000 7f41df40e640 1 -- 172.21.15.77:0/2311119106 >> 172.21.15.77:0/2311119106 conn(0x7f41d80d2ef0 msgr2=0x7f41d80b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:43.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.870+0000 7f41df40e640 1 -- 172.21.15.77:0/2311119106 shutdown_connections 2023-11-04T01:47:43.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.871+0000 7f41df40e640 1 -- 172.21.15.77:0/2311119106 wait complete. 2023-11-04T01:47:43.884 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:47:43.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.983+0000 7fb6fd1dc640 1 Processor -- start 2023-11-04T01:47:43.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.983+0000 7fb6fd1dc640 1 -- start start 2023-11-04T01:47:43.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.984+0000 7fb6fd1dc640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb6f815d4e0 0x7fb6f80d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.984+0000 7fb6fd1dc640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f80b32b0 con 0x7fb6f80d3b60 2023-11-04T01:47:43.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.984+0000 7fb6fd1dc640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f80cee10 con 0x7fb6f815d100 2023-11-04T01:47:43.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.984+0000 7fb6fd1dc640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f80cec20 con 0x7fb6f815d4e0 2023-11-04T01:47:43.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.984+0000 7fb6f759e640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb6f80d3b60 0x7fb6f80b3740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36028/0 (socket says 172.21.15.77:36028) 2023-11-04T01:47:43.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.984+0000 7fb6f759e640 1 -- 172.21.15.77:0/2611296228 learned_addr learned my addr 172.21.15.77:0/2611296228 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:47:43.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.984+0000 7fb6f5d9b640 1 -- 172.21.15.77:0/2611296228 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 906324191 0 0) 0x7fb6f80b32b0 con 0x7fb6f80d3b60 2023-11-04T01:47:43.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.984+0000 7fb6f5d9b640 1 -- 172.21.15.77:0/2611296228 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6e4003520 con 0x7fb6f80d3b60 2023-11-04T01:47:43.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.984+0000 7fb6f659c640 1 --2- 172.21.15.77:0/2611296228 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb6f815d4e0 0x7fb6f80d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.985+0000 7fb6f5d9b640 1 -- 172.21.15.77:0/2611296228 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3254338013 0 0) 0x7fb6e4003520 con 0x7fb6f80d3b60 2023-11-04T01:47:43.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.985+0000 7fb6f5d9b640 1 -- 172.21.15.77:0/2611296228 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb6f815d4e0 msgr2=0x7fb6f80d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:43.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.985+0000 7fb6f5d9b640 1 --2- 172.21.15.77:0/2611296228 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb6f815d4e0 0x7fb6f80d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.985+0000 7fb6f5d9b640 1 -- 172.21.15.77:0/2611296228 >> v1:172.21.15.122:6789/0 conn(0x7fb6f815d100 legacy=0x7fb6f80ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.985+0000 7fb6f5d9b640 1 -- 172.21.15.77:0/2611296228 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f80b2980 con 0x7fb6f80d3b60 2023-11-04T01:47:43.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.985+0000 7fb6f5d9b640 1 -- 172.21.15.77:0/2611296228 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7fb6f0001670 con 0x7fb6f80d3b60 2023-11-04T01:47:43.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.985+0000 7fb6f5d9b640 1 -- 172.21.15.77:0/2611296228 >> v1:172.21.15.77:6789/0 conn(0x7fb6f80d3b60 legacy=0x7fb6f80b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.985+0000 7fb6f5d9b640 1 --2- 172.21.15.77:0/2611296228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6e40039a0 0x7fb6e4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.985+0000 7fb6f5d9b640 1 --2- 172.21.15.77:0/2611296228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6e40047c0 0x7fb6e4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.985+0000 7fb6f5d9b640 1 --2- 172.21.15.77:0/2611296228 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb6f815d4e0 0x7fb6e4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.985+0000 7fb6f5d9b640 1 -- 172.21.15.77:0/2611296228 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e400ba30 con 0x7fb6e40039a0 2023-11-04T01:47:43.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.985+0000 7fb6f5d9b640 1 -- 172.21.15.77:0/2611296228 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e400bb70 con 0x7fb6e40047c0 2023-11-04T01:47:43.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.985+0000 7fb6f5d9b640 1 -- 172.21.15.77:0/2611296228 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e400bd30 con 0x7fb6f815d4e0 2023-11-04T01:47:43.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.985+0000 7fb6f6d9d640 1 --2- 172.21.15.77:0/2611296228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6e40039a0 0x7fb6e4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.985+0000 7fb6f659c640 1 --2- 172.21.15.77:0/2611296228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6e40047c0 0x7fb6e4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.985+0000 7fb6f759e640 1 --2- 172.21.15.77:0/2611296228 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb6f815d4e0 0x7fb6e4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.985+0000 7fb6f6d9d640 1 -- 172.21.15.77:0/2611296228 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb6f815d4e0 msgr2=0x7fb6e4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:43.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.985+0000 7fb6f6d9d640 1 --2- 172.21.15.77:0/2611296228 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb6f815d4e0 0x7fb6e4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.985+0000 7fb6f6d9d640 1 -- 172.21.15.77:0/2611296228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6e40047c0 msgr2=0x7fb6e4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:43.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.985+0000 7fb6f6d9d640 1 --2- 172.21.15.77:0/2611296228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6e40047c0 0x7fb6e4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.985+0000 7fb6f6d9d640 1 -- 172.21.15.77:0/2611296228 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e4003520 con 0x7fb6e40039a0 2023-11-04T01:47:43.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.986+0000 7fb6f6d9d640 1 --2- 172.21.15.77:0/2611296228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6e40039a0 0x7fb6e4003dc0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8007fd0 tx=0x7fb6e40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=424503e2f8f19331 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:43.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.986+0000 7fb6f5d9b640 1 -- 172.21.15.77:0/2611296228 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e8003bc0 con 0x7fb6e40039a0 2023-11-04T01:47:43.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.986+0000 7fb6f5d9b640 1 -- 172.21.15.77:0/2611296228 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e8003d20 con 0x7fb6e40039a0 2023-11-04T01:47:43.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.986+0000 7fb6f5d9b640 1 -- 172.21.15.77:0/2611296228 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e8005310 con 0x7fb6e40039a0 2023-11-04T01:47:43.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.986+0000 7fb6fd1dc640 1 -- 172.21.15.77:0/2611296228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6e40039a0 msgr2=0x7fb6e4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.986+0000 7fb6fd1dc640 1 --2- 172.21.15.77:0/2611296228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6e40039a0 0x7fb6e4003dc0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8007fd0 tx=0x7fb6e40057f0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.986+0000 7fb6f759e640 1 -- 172.21.15.77:0/2611296228 reap_dead start 2023-11-04T01:47:43.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.987+0000 7fb6fd1dc640 1 -- 172.21.15.77:0/2611296228 shutdown_connections 2023-11-04T01:47:43.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.987+0000 7fb6fd1dc640 1 -- 172.21.15.77:0/2611296228 >> 172.21.15.77:0/2611296228 conn(0x7fb6f80d2ef0 msgr2=0x7fb6f80d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:43.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.987+0000 7fb6fd1dc640 1 -- 172.21.15.77:0/2611296228 shutdown_connections 2023-11-04T01:47:43.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.987+0000 7fb6fd1dc640 1 -- 172.21.15.77:0/2611296228 wait complete. 2023-11-04T01:47:44.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.988+0000 7fb6fd1dc640 1 Processor -- start 2023-11-04T01:47:44.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.988+0000 7fb6fd1dc640 1 -- start start 2023-11-04T01:47:44.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.989+0000 7fb6fd1dc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6e40039a0 0x7fb6f815e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.989+0000 7fb6fd1dc640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb6f8160210 0x7fb6f81f5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.989+0000 7fb6fd1dc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6f81f6320 0x7fb6f8151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.989+0000 7fb6fd1dc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f81f67a0 con 0x7fb6e40039a0 2023-11-04T01:47:44.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.989+0000 7fb6fd1dc640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f815f540 con 0x7fb6f81f6320 2023-11-04T01:47:44.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.989+0000 7fb6fd1dc640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f815e930 con 0x7fb6f8160210 2023-11-04T01:47:44.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.989+0000 7fb6f6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6e40039a0 0x7fb6f815e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.989+0000 7fb6f6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6e40039a0 0x7fb6f815e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35398/0 (socket says 172.21.15.77:35398) 2023-11-04T01:47:44.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.989+0000 7fb6f6d9d640 1 -- 172.21.15.77:0/270884532 learned_addr learned my addr 172.21.15.77:0/270884532 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:44.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.989+0000 7fb6f759e640 1 --2- 172.21.15.77:0/270884532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6f81f6320 0x7fb6f8151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.989+0000 7fb6f659c640 1 --2- 172.21.15.77:0/270884532 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb6f8160210 0x7fb6f81f5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.989+0000 7fb6f6d9d640 1 -- 172.21.15.77:0/270884532 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb6f8160210 msgr2=0x7fb6f81f5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.989+0000 7fb6f6d9d640 1 --2- 172.21.15.77:0/270884532 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb6f8160210 0x7fb6f81f5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.989+0000 7fb6f6d9d640 1 -- 172.21.15.77:0/270884532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6f81f6320 msgr2=0x7fb6f8151a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.989+0000 7fb6f6d9d640 1 --2- 172.21.15.77:0/270884532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6f81f6320 0x7fb6f8151a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.989+0000 7fb6f6d9d640 1 -- 172.21.15.77:0/270884532 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f815ec10 con 0x7fb6e40039a0 2023-11-04T01:47:44.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.989+0000 7fb6f6d9d640 1 --2- 172.21.15.77:0/270884532 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6e40039a0 0x7fb6f815e350 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fb6e802c000 tx=0x7fb6e80014f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:44.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.990+0000 7fb6ef7fe640 1 -- 172.21.15.77:0/270884532 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e8007e00 con 0x7fb6e40039a0 2023-11-04T01:47:44.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.990+0000 7fb6ef7fe640 1 -- 172.21.15.77:0/270884532 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e8005500 con 0x7fb6e40039a0 2023-11-04T01:47:44.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.990+0000 7fb6fd1dc640 1 -- 172.21.15.77:0/270884532 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6f815eef0 con 0x7fb6e40039a0 2023-11-04T01:47:44.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.990+0000 7fb6ef7fe640 1 -- 172.21.15.77:0/270884532 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e80058b0 con 0x7fb6e40039a0 2023-11-04T01:47:44.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.990+0000 7fb6fd1dc640 1 -- 172.21.15.77:0/270884532 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6f8160690 con 0x7fb6e40039a0 2023-11-04T01:47:44.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.990+0000 7fb6fd1dc640 1 -- 172.21.15.77:0/270884532 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6f81f6700 con 0x7fb6e40039a0 2023-11-04T01:47:44.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.991+0000 7fb6ef7fe640 1 -- 172.21.15.77:0/270884532 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb6e8007030 con 0x7fb6e40039a0 2023-11-04T01:47:44.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.991+0000 7fb6ef7fe640 1 --2- 172.21.15.77:0/270884532 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb6d806ae70 0x7fb6d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.991+0000 7fb6ef7fe640 1 -- 172.21.15.77:0/270884532 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8167+0+0 (secure 0 0 0) 0x7fb6e80ab950 con 0x7fb6e40039a0 2023-11-04T01:47:44.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.992+0000 7fb6f659c640 1 --2- 172.21.15.77:0/270884532 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb6d806ae70 0x7fb6d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.992+0000 7fb6f659c640 1 --2- 172.21.15.77:0/270884532 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb6d806ae70 0x7fb6d806d330 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80c9a30 tx=0x7fb6e0008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:44.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:43.996+0000 7fb6ef7fe640 1 -- 172.21.15.77:0/270884532 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb6e8076180 con 0x7fb6e40039a0 2023-11-04T01:47:44.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.160+0000 7fb6fd1dc640 1 -- 172.21.15.77:0/270884532 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb6f80684b0 con 0x7fb6e40039a0 2023-11-04T01:47:44.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.160+0000 7fb6ef7fe640 1 -- 172.21.15.77:0/270884532 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v115) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb6e8047070 con 0x7fb6e40039a0 2023-11-04T01:47:44.163 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-04T01:47:44.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.162+0000 7fb6fd1dc640 1 -- 172.21.15.77:0/270884532 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb6d806ae70 msgr2=0x7fb6d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.162+0000 7fb6fd1dc640 1 --2- 172.21.15.77:0/270884532 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb6d806ae70 0x7fb6d806d330 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80c9a30 tx=0x7fb6e0008040 comp rx=0 tx=0).stop 2023-11-04T01:47:44.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.162+0000 7fb6fd1dc640 1 -- 172.21.15.77:0/270884532 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6e40039a0 msgr2=0x7fb6f815e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.162+0000 7fb6fd1dc640 1 --2- 172.21.15.77:0/270884532 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6e40039a0 0x7fb6f815e350 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fb6e802c000 tx=0x7fb6e80014f0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.162+0000 7fb6fd1dc640 1 -- 172.21.15.77:0/270884532 shutdown_connections 2023-11-04T01:47:44.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.162+0000 7fb6fd1dc640 1 --2- 172.21.15.77:0/270884532 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb6d806ae70 0x7fb6d806d330 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.162+0000 7fb6fd1dc640 1 --2- 172.21.15.77:0/270884532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6f81f6320 0x7fb6f8151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.162+0000 7fb6fd1dc640 1 --2- 172.21.15.77:0/270884532 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb6f8160210 0x7fb6f81f5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.162+0000 7fb6fd1dc640 1 --2- 172.21.15.77:0/270884532 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6e40039a0 0x7fb6f815e350 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.162+0000 7fb6fd1dc640 1 -- 172.21.15.77:0/270884532 >> 172.21.15.77:0/270884532 conn(0x7fb6f80d2ef0 msgr2=0x7fb6f80b50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:44.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.162+0000 7fb6fd1dc640 1 -- 172.21.15.77:0/270884532 shutdown_connections 2023-11-04T01:47:44.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.162+0000 7fb6fd1dc640 1 -- 172.21.15.77:0/270884532 wait complete. 2023-11-04T01:47:44.175 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:47:44.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.274+0000 7f8d5277d640 1 Processor -- start 2023-11-04T01:47:44.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.274+0000 7f8d5277d640 1 -- start start 2023-11-04T01:47:44.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.275+0000 7f8d5277d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8d4c06ca60 0x7f8d4c06ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.275+0000 7f8d5277d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d4c06d3f0 con 0x7f8d4c0b2160 2023-11-04T01:47:44.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.275+0000 7f8d5277d640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d4c0cb5d0 con 0x7f8d4c15b330 2023-11-04T01:47:44.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.275+0000 7f8d5277d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d4c06f3f0 con 0x7f8d4c06ca60 2023-11-04T01:47:44.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.275+0000 7f8d50d1a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8d4c06ca60 0x7f8d4c06ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.275+0000 7f8d4b7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f8d4c0b2160 0x7f8d4c06ebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36032/0 (socket says 172.21.15.77:36032) 2023-11-04T01:47:44.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.275+0000 7f8d4b7fe640 1 -- 172.21.15.77:0/2424760471 learned_addr learned my addr 172.21.15.77:0/2424760471 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:47:44.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.275+0000 7f8d50d1a640 1 -- 172.21.15.77:0/2424760471 >> v1:172.21.15.122:6789/0 conn(0x7f8d4c15b330 legacy=0x7f8d4c0cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:44.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.275+0000 7f8d50d1a640 1 -- 172.21.15.77:0/2424760471 >> v1:172.21.15.77:6789/0 conn(0x7f8d4c0b2160 legacy=0x7f8d4c06ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.275+0000 7f8d50d1a640 1 -- 172.21.15.77:0/2424760471 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d4c0c3490 con 0x7f8d4c06ca60 2023-11-04T01:47:44.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.276+0000 7f8d50d1a640 1 --2- 172.21.15.77:0/2424760471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d4c06ca60 0x7f8d4c06ceb0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f8d44009d90 tx=0x7f8d4402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64fb3a153f5938e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:44.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.276+0000 7f8d4affd640 1 -- 172.21.15.77:0/2424760471 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4402cc60 con 0x7f8d4c06ca60 2023-11-04T01:47:44.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.276+0000 7f8d4affd640 1 -- 172.21.15.77:0/2424760471 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4402cdc0 con 0x7f8d4c06ca60 2023-11-04T01:47:44.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.276+0000 7f8d4affd640 1 -- 172.21.15.77:0/2424760471 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d44034660 con 0x7f8d4c06ca60 2023-11-04T01:47:44.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.277+0000 7f8d5277d640 1 -- 172.21.15.77:0/2424760471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d4c06ca60 msgr2=0x7f8d4c06ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.277+0000 7f8d5277d640 1 --2- 172.21.15.77:0/2424760471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d4c06ca60 0x7f8d4c06ceb0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f8d44009d90 tx=0x7f8d4402beb0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.277+0000 7f8d5277d640 1 -- 172.21.15.77:0/2424760471 shutdown_connections 2023-11-04T01:47:44.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.277+0000 7f8d5277d640 1 --2- 172.21.15.77:0/2424760471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d4c06ca60 0x7f8d4c06ceb0 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.277+0000 7f8d5277d640 1 -- 172.21.15.77:0/2424760471 >> 172.21.15.77:0/2424760471 conn(0x7f8d4c0b1640 msgr2=0x7f8d4c0b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:44.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.277+0000 7f8d5277d640 1 -- 172.21.15.77:0/2424760471 shutdown_connections 2023-11-04T01:47:44.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.277+0000 7f8d5277d640 1 -- 172.21.15.77:0/2424760471 wait complete. 2023-11-04T01:47:44.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.278+0000 7f8d5277d640 1 Processor -- start 2023-11-04T01:47:44.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.278+0000 7f8d5277d640 1 -- start start 2023-11-04T01:47:44.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.279+0000 7f8d5277d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8d4c06ca60 0x7f8d4c1f04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.279+0000 7f8d5277d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d4c0b2160 0x7f8d4c0b3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.279+0000 7f8d5277d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d4c15b330 0x7f8d4c1537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.279+0000 7f8d5277d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c1528c0 con 0x7f8d4c0b2160 2023-11-04T01:47:44.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.279+0000 7f8d5277d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c0b4040 con 0x7f8d4c15b330 2023-11-04T01:47:44.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.279+0000 7f8d5277d640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c0b4320 con 0x7f8d4c06ca60 2023-11-04T01:47:44.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.279+0000 7f8d4b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d4c0b2160 0x7f8d4c0b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.279+0000 7f8d4b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d4c0b2160 0x7f8d4c0b3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35420/0 (socket says 172.21.15.77:35420) 2023-11-04T01:47:44.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.279+0000 7f8d4b7fe640 1 -- 172.21.15.77:0/815361544 learned_addr learned my addr 172.21.15.77:0/815361544 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:44.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.279+0000 7f8d50d1a640 1 --2- 172.21.15.77:0/815361544 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d4c15b330 0x7f8d4c1537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.279+0000 7f8d4bfff640 1 --2- 172.21.15.77:0/815361544 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8d4c06ca60 0x7f8d4c1f04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.279+0000 7f8d4b7fe640 1 -- 172.21.15.77:0/815361544 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8d4c06ca60 msgr2=0x7f8d4c1f04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.279+0000 7f8d4b7fe640 1 --2- 172.21.15.77:0/815361544 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8d4c06ca60 0x7f8d4c1f04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.279+0000 7f8d4b7fe640 1 -- 172.21.15.77:0/815361544 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d4c15b330 msgr2=0x7f8d4c1537b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.279+0000 7f8d4b7fe640 1 --2- 172.21.15.77:0/815361544 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d4c15b330 0x7f8d4c1537b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.279+0000 7f8d4b7fe640 1 -- 172.21.15.77:0/815361544 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d44009a70 con 0x7f8d4c0b2160 2023-11-04T01:47:44.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.279+0000 7f8d4bfff640 1 --2- 172.21.15.77:0/815361544 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8d4c06ca60 0x7f8d4c1f04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:44.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.279+0000 7f8d4b7fe640 1 --2- 172.21.15.77:0/815361544 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d4c0b2160 0x7f8d4c0b3660 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f8d4000c4a0 tx=0x7f8d4000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:44.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.279+0000 7f8d48ff9640 1 -- 172.21.15.77:0/815361544 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d40005ce0 con 0x7f8d4c0b2160 2023-11-04T01:47:44.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.279+0000 7f8d48ff9640 1 -- 172.21.15.77:0/815361544 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d40005e40 con 0x7f8d4c0b2160 2023-11-04T01:47:44.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.279+0000 7f8d5277d640 1 -- 172.21.15.77:0/815361544 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d4c0b4600 con 0x7f8d4c0b2160 2023-11-04T01:47:44.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.279+0000 7f8d48ff9640 1 -- 172.21.15.77:0/815361544 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d40007270 con 0x7f8d4c0b2160 2023-11-04T01:47:44.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.279+0000 7f8d5277d640 1 -- 172.21.15.77:0/815361544 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d4c15bc10 con 0x7f8d4c0b2160 2023-11-04T01:47:44.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.280+0000 7f8d5277d640 1 -- 172.21.15.77:0/815361544 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d4c06da20 con 0x7f8d4c0b2160 2023-11-04T01:47:44.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.281+0000 7f8d48ff9640 1 -- 172.21.15.77:0/815361544 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8d40007490 con 0x7f8d4c0b2160 2023-11-04T01:47:44.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.281+0000 7f8d48ff9640 1 --2- 172.21.15.77:0/815361544 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8d3806ae70 0x7f8d3806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.281+0000 7f8d48ff9640 1 -- 172.21.15.77:0/815361544 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f8d40089240 con 0x7f8d4c0b2160 2023-11-04T01:47:44.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.281+0000 7f8d4bfff640 1 --2- 172.21.15.77:0/815361544 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8d3806ae70 0x7f8d3806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.282+0000 7f8d4bfff640 1 --2- 172.21.15.77:0/815361544 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8d3806ae70 0x7f8d3806d330 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c003eb0 tx=0x7f8d3c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:44.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.285+0000 7f8d48ff9640 1 -- 172.21.15.77:0/815361544 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8d40053a90 con 0x7f8d4c0b2160 2023-11-04T01:47:44.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.465+0000 7f8d5277d640 1 -- 172.21.15.77:0/815361544 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8d4c06d3f0 con 0x7f8d4c0b2160 2023-11-04T01:47:44.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.466+0000 7f8d48ff9640 1 -- 172.21.15.77:0/815361544 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 23 entries v115) v1 ==== 81+0+1397 (secure 0 0 0) 0x7f8d4c06d3f0 con 0x7f8d4c0b2160 2023-11-04T01:47:44.469 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.1:0/2955237098 2023-11-04T02:47:38.484200+0000 2023-11-04T01:47:44.469 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6835/2107153526 2023-11-05T01:47:23.380657+0000 2023-11-04T01:47:44.469 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.1:0/2249624526 2023-11-04T02:46:54.400007+0000 2023-11-04T01:47:44.469 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6834/1450731169 2023-11-05T01:46:46.102329+0000 2023-11-04T01:47:44.470 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6834/3276812155 2023-11-05T01:46:39.299125+0000 2023-11-04T01:47:44.470 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6832/3276812155 2023-11-05T01:46:39.299125+0000 2023-11-04T01:47:44.470 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6836/1450731169 2023-11-05T01:46:46.102329+0000 2023-11-04T01:47:44.470 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6834/3699147778 2023-11-05T01:44:11.242543+0000 2023-11-04T01:47:44.471 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6836/3699147778 2023-11-05T01:44:11.242543+0000 2023-11-04T01:47:44.471 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6834/4241784871 2023-11-05T01:44:36.807284+0000 2023-11-04T01:47:44.471 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6834/2908314953 2023-11-05T01:45:01.982045+0000 2023-11-04T01:47:44.471 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6834/285184758 2023-11-05T01:45:27.182069+0000 2023-11-04T01:47:44.471 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6833/2107153526 2023-11-05T01:47:23.380657+0000 2023-11-04T01:47:44.471 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6836/2908314953 2023-11-05T01:45:01.982045+0000 2023-11-04T01:47:44.472 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6834/4183807043 2023-11-05T01:47:30.639992+0000 2023-11-04T01:47:44.472 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6836/1345816612 2023-11-05T01:45:54.789240+0000 2023-11-04T01:47:44.472 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6832/285184758 2023-11-05T01:45:27.182069+0000 2023-11-04T01:47:44.472 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6834/1345816612 2023-11-05T01:45:54.789240+0000 2023-11-04T01:47:44.472 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6833/3207490604 2023-11-05T01:46:01.591697+0000 2023-11-04T01:47:44.473 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6832/4183807043 2023-11-05T01:47:30.639992+0000 2023-11-04T01:47:44.473 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6832/4241784871 2023-11-05T01:44:36.807284+0000 2023-11-04T01:47:44.473 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6835/3207490604 2023-11-05T01:46:01.591697+0000 2023-11-04T01:47:44.473 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.1:0/3032548059 2023-11-04T02:46:09.897134+0000 2023-11-04T01:47:44.474 INFO:teuthology.orchestra.run.smithi077.stderr:listed 23 entries 2023-11-04T01:47:44.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.468+0000 7f8d5277d640 1 -- 172.21.15.77:0/815361544 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8d3806ae70 msgr2=0x7f8d3806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.468+0000 7f8d5277d640 1 --2- 172.21.15.77:0/815361544 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8d3806ae70 0x7f8d3806d330 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c003eb0 tx=0x7f8d3c009040 comp rx=0 tx=0).stop 2023-11-04T01:47:44.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.468+0000 7f8d5277d640 1 -- 172.21.15.77:0/815361544 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d4c0b2160 msgr2=0x7f8d4c0b3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.468+0000 7f8d5277d640 1 --2- 172.21.15.77:0/815361544 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d4c0b2160 0x7f8d4c0b3660 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f8d4000c4a0 tx=0x7f8d4000c960 comp rx=0 tx=0).stop 2023-11-04T01:47:44.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.468+0000 7f8d5277d640 1 -- 172.21.15.77:0/815361544 shutdown_connections 2023-11-04T01:47:44.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.468+0000 7f8d5277d640 1 --2- 172.21.15.77:0/815361544 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f8d3806ae70 0x7f8d3806d330 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.468+0000 7f8d5277d640 1 --2- 172.21.15.77:0/815361544 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d4c15b330 0x7f8d4c1537b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.468+0000 7f8d5277d640 1 --2- 172.21.15.77:0/815361544 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d4c0b2160 0x7f8d4c0b3660 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.468+0000 7f8d5277d640 1 --2- 172.21.15.77:0/815361544 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f8d4c06ca60 0x7f8d4c1f04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.468+0000 7f8d5277d640 1 -- 172.21.15.77:0/815361544 >> 172.21.15.77:0/815361544 conn(0x7f8d4c0b1640 msgr2=0x7f8d4c1581b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:44.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.468+0000 7f8d5277d640 1 -- 172.21.15.77:0/815361544 shutdown_connections 2023-11-04T01:47:44.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.468+0000 7f8d5277d640 1 -- 172.21.15.77:0/815361544 wait complete. 2023-11-04T01:47:44.481 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2023-11-04T01:47:44.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:44.482 DEBUG:teuthology.orchestra.run.smithi077:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2023-11-04T01:47:44.509 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[155739]: fuse finished with error 0 and tester_r 0 2023-11-04T01:47:44.510 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2023-11-04T01:47:44.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:44.511 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:47:44.565 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:47:44.565 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:47:44.619 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19534 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:47:44.620 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:47:44.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.757+0000 7feb258da640 1 Processor -- start 2023-11-04T01:47:44.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.757+0000 7feb258da640 1 -- start start 2023-11-04T01:47:44.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.758+0000 7feb258da640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7feb200b1440 0x7feb2006c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.758+0000 7feb258da640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb200ad6a0 con 0x7feb2006b740 2023-11-04T01:47:44.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.758+0000 7feb258da640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb200acaf0 con 0x7feb2015ade0 2023-11-04T01:47:44.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.758+0000 7feb258da640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb200acdd0 con 0x7feb200b1440 2023-11-04T01:47:44.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.758+0000 7feb1e7fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7feb200b1440 0x7feb2006c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.758+0000 7feb1f7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7feb2006b740 0x7feb2006a0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:36040/0 (socket says 172.21.15.77:36040) 2023-11-04T01:47:44.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.758+0000 7feb1f7fe640 1 -- 172.21.15.77:0/2211819097 learned_addr learned my addr 172.21.15.77:0/2211819097 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:47:44.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.758+0000 7feb1e7fc640 1 -- 172.21.15.77:0/2211819097 >> v1:172.21.15.122:6789/0 conn(0x7feb2015ade0 legacy=0x7feb200b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:44.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.758+0000 7feb1e7fc640 1 -- 172.21.15.77:0/2211819097 >> v1:172.21.15.77:6789/0 conn(0x7feb2006b740 legacy=0x7feb2006a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.758+0000 7feb1e7fc640 1 -- 172.21.15.77:0/2211819097 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb200ad0e0 con 0x7feb200b1440 2023-11-04T01:47:44.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.758+0000 7feb1dffb640 1 -- 172.21.15.77:0/2211819097 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1691140208 0 0) 0x7feb200ad6a0 con 0x7feb2006b740 2023-11-04T01:47:44.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.759+0000 7feb1e7fc640 1 --2- 172.21.15.77:0/2211819097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb200b1440 0x7feb2006c520 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7feb140097a0 tx=0x7feb1402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e7957f367166e64 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:44.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.759+0000 7feb1dffb640 1 -- 172.21.15.77:0/2211819097 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1402e070 con 0x7feb200b1440 2023-11-04T01:47:44.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.759+0000 7feb1dffb640 1 -- 172.21.15.77:0/2211819097 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb140315a0 con 0x7feb200b1440 2023-11-04T01:47:44.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.759+0000 7feb1dffb640 1 -- 172.21.15.77:0/2211819097 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb14031930 con 0x7feb200b1440 2023-11-04T01:47:44.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.760+0000 7feb258da640 1 -- 172.21.15.77:0/2211819097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb200b1440 msgr2=0x7feb2006c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.760+0000 7feb258da640 1 --2- 172.21.15.77:0/2211819097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb200b1440 0x7feb2006c520 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7feb140097a0 tx=0x7feb1402b840 comp rx=0 tx=0).stop 2023-11-04T01:47:44.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.760+0000 7feb258da640 1 -- 172.21.15.77:0/2211819097 shutdown_connections 2023-11-04T01:47:44.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.760+0000 7feb258da640 1 --2- 172.21.15.77:0/2211819097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb200b1440 0x7feb2006c520 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.760+0000 7feb258da640 1 -- 172.21.15.77:0/2211819097 >> 172.21.15.77:0/2211819097 conn(0x7feb200cbd30 msgr2=0x7feb200cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:44.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.760+0000 7feb258da640 1 -- 172.21.15.77:0/2211819097 shutdown_connections 2023-11-04T01:47:44.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.760+0000 7feb258da640 1 -- 172.21.15.77:0/2211819097 wait complete. 2023-11-04T01:47:44.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.761+0000 7feb258da640 1 Processor -- start 2023-11-04T01:47:44.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.761+0000 7feb258da640 1 -- start start 2023-11-04T01:47:44.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.762+0000 7feb258da640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feb2006b740 0x7feb20155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.762+0000 7feb258da640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feb200b1440 0x7feb200c5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.762+0000 7feb258da640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb2015ade0 0x7feb200c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.762+0000 7feb258da640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb200c46e0 con 0x7feb2015ade0 2023-11-04T01:47:44.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.762+0000 7feb258da640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb20156240 con 0x7feb2006b740 2023-11-04T01:47:44.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.762+0000 7feb258da640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb200c37f0 con 0x7feb200b1440 2023-11-04T01:47:44.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.762+0000 7feb1f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb2015ade0 0x7feb200c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.762+0000 7feb1f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb2015ade0 0x7feb200c5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35430/0 (socket says 172.21.15.77:35430) 2023-11-04T01:47:44.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.762+0000 7feb1f7fe640 1 -- 172.21.15.77:0/2488925999 learned_addr learned my addr 172.21.15.77:0/2488925999 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:44.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.762+0000 7feb1f7fe640 1 -- 172.21.15.77:0/2488925999 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feb200b1440 msgr2=0x7feb200c5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.762+0000 7feb1f7fe640 1 --2- 172.21.15.77:0/2488925999 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feb200b1440 0x7feb200c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.762+0000 7feb1f7fe640 1 -- 172.21.15.77:0/2488925999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feb2006b740 msgr2=0x7feb20155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.762+0000 7feb1f7fe640 1 --2- 172.21.15.77:0/2488925999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feb2006b740 0x7feb20155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.762+0000 7feb1f7fe640 1 -- 172.21.15.77:0/2488925999 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb14009400 con 0x7feb2015ade0 2023-11-04T01:47:44.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.762+0000 7feb1f7fe640 1 --2- 172.21.15.77:0/2488925999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb2015ade0 0x7feb200c5790 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7feb1800c7a0 tx=0x7feb1800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:44.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.762+0000 7feb07fff640 1 -- 172.21.15.77:0/2488925999 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1800a640 con 0x7feb2015ade0 2023-11-04T01:47:44.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.762+0000 7feb07fff640 1 -- 172.21.15.77:0/2488925999 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb1800a7a0 con 0x7feb2015ade0 2023-11-04T01:47:44.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.762+0000 7feb258da640 1 -- 172.21.15.77:0/2488925999 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb200c3ad0 con 0x7feb2015ade0 2023-11-04T01:47:44.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.762+0000 7feb07fff640 1 -- 172.21.15.77:0/2488925999 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1800ab90 con 0x7feb2015ade0 2023-11-04T01:47:44.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.762+0000 7feb258da640 1 -- 172.21.15.77:0/2488925999 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb200c4090 con 0x7feb2015ade0 2023-11-04T01:47:44.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.763+0000 7feb258da640 1 -- 172.21.15.77:0/2488925999 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb200684b0 con 0x7feb2015ade0 2023-11-04T01:47:44.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.764+0000 7feb07fff640 1 -- 172.21.15.77:0/2488925999 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feb1800acf0 con 0x7feb2015ade0 2023-11-04T01:47:44.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.764+0000 7feb07fff640 1 --2- 172.21.15.77:0/2488925999 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7feb0c06ae70 0x7feb0c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.764+0000 7feb07fff640 1 -- 172.21.15.77:0/2488925999 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8167+0+0 (secure 0 0 0) 0x7feb180896f0 con 0x7feb2015ade0 2023-11-04T01:47:44.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.764+0000 7feb1effd640 1 --2- 172.21.15.77:0/2488925999 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7feb0c06ae70 0x7feb0c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.765+0000 7feb1effd640 1 --2- 172.21.15.77:0/2488925999 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7feb0c06ae70 0x7feb0c06d330 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7feb10009650 tx=0x7feb10006bb0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:44.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.768+0000 7feb07fff640 1 -- 172.21.15.77:0/2488925999 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feb18053e90 con 0x7feb2015ade0 2023-11-04T01:47:44.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.971+0000 7feb258da640 1 -- 172.21.15.77:0/2488925999 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7feb2006af40 con 0x7feb2015ade0 2023-11-04T01:47:44.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.971+0000 7feb07fff640 1 -- 172.21.15.77:0/2488925999 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v116) v1 ==== 53+0+73 (secure 0 0 0) 0x7feb18018020 con 0x7feb2015ade0 2023-11-04T01:47:44.974 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:47:44.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.973+0000 7feb258da640 1 -- 172.21.15.77:0/2488925999 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7feb0c06ae70 msgr2=0x7feb0c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.973+0000 7feb258da640 1 --2- 172.21.15.77:0/2488925999 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7feb0c06ae70 0x7feb0c06d330 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7feb10009650 tx=0x7feb10006bb0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.973+0000 7feb258da640 1 -- 172.21.15.77:0/2488925999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb2015ade0 msgr2=0x7feb200c5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.973+0000 7feb258da640 1 --2- 172.21.15.77:0/2488925999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb2015ade0 0x7feb200c5790 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7feb1800c7a0 tx=0x7feb1800cc60 comp rx=0 tx=0).stop 2023-11-04T01:47:44.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.973+0000 7feb258da640 1 -- 172.21.15.77:0/2488925999 shutdown_connections 2023-11-04T01:47:44.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.973+0000 7feb258da640 1 --2- 172.21.15.77:0/2488925999 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7feb0c06ae70 0x7feb0c06d330 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.973+0000 7feb258da640 1 --2- 172.21.15.77:0/2488925999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb2015ade0 0x7feb200c5790 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.973+0000 7feb258da640 1 --2- 172.21.15.77:0/2488925999 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7feb200b1440 0x7feb200c5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.973+0000 7feb258da640 1 --2- 172.21.15.77:0/2488925999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feb2006b740 0x7feb20155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.973+0000 7feb258da640 1 -- 172.21.15.77:0/2488925999 >> 172.21.15.77:0/2488925999 conn(0x7feb200cbd30 msgr2=0x7feb200cab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:44.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.973+0000 7feb258da640 1 -- 172.21.15.77:0/2488925999 shutdown_connections 2023-11-04T01:47:44.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:44.973+0000 7feb258da640 1 -- 172.21.15.77:0/2488925999 wait complete. 2023-11-04T01:47:44.986 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:47:44.986 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:47:44.987 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2023-11-04T01:47:44.987 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:47:44.987 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:47:44.988 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:47:44.988 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:47:44.988 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:47:44.989 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:47:44.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:44.990 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2023-11-04T01:47:45.004 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:47:45.005 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:47:45.005 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:47:45.005 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:47:45.005 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2023-11-04T01:47:45.005 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:47:45.006 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:47:45.006 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:47:45.006 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f0 2023-11-04T01:47:45.006 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:47:45.006 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:47:45.007 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f1 2023-11-04T01:47:45.007 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T01:47:45.007 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:47:45.007 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:47:45.007 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:47:45.007 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T01:47:45.008 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 41941sec preferred_lft 41941sec 2023-11-04T01:47:45.008 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::ec4:7aff:fe8f:d3d3/64 scope link 2023-11-04T01:47:45.008 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:47:45.008 INFO:teuthology.orchestra.run.smithi077.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:47:45.008 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 06:3a:02:11:c4:57 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:47:45.009 INFO:teuthology.orchestra.run.smithi077.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:47:45.009 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:47:45.009 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::8039:1aff:fee2:109f/64 scope link 2023-11-04T01:47:45.009 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:47:45.009 INFO:teuthology.orchestra.run.smithi077.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:47:45.010 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 06:3a:02:11:c4:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:47:45.010 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::43a:2ff:fe11:c457/64 scope link 2023-11-04T01:47:45.010 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:47:45.010 INFO:teuthology.orchestra.run.smithi077.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:47:45.010 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether c2:4f:2a:69:4f:38 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:47:45.011 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::c04f:2aff:fe69:4f38/64 scope link 2023-11-04T01:47:45.011 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:47:45.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:45.012 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:47:45.062 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:2023-11-04T01:47:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:47:45.071 INFO:teuthology.orchestra.run.smithi077.stdout:1 2023-11-04T01:47:45.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:45.072 DEBUG:teuthology.orchestra.run.smithi077:> route 2023-11-04T01:47:45.127 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2023-11-04T01:47:45.127 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:47:45.127 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:47:45.127 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:47:45.128 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:47:45.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:45.128 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-11-04T01:47:45.129 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-11-04T01:47:45.129 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:47:45.129 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:47:45.130 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:47:45.130 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-11-04T01:47:45.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:45.222 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2023-11-04T01:47:45.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:47:45.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:47:45.237 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:47:45.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:45.238 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 up 2023-11-04T01:47:45.304 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:47:45.304 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:47:45.304 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:47:45.359 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:47:45.359 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:47:45.359 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:47:45.413 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:47:45.581 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2023-11-04T01:47:45.582 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2023-11-04T01:47:45.582 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2023-11-04T01:47:45.582 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2023-11-04T01:47:45.583 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2023-11-04T01:47:45.583 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2023-11-04T01:47:45.583 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2023-11-04T01:47:45.583 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2023-11-04T01:47:45.583 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2023-11-04T01:47:45.584 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2023-11-04T01:47:45.584 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2023-11-04T01:47:45.584 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2023-11-04T01:47:45.584 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:47:45.584 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2023-11-04T01:47:45.584 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2023-11-04T01:47:45.585 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2023-11-04T01:47:45.585 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2023-11-04T01:47:45.585 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2023-11-04T01:47:45.585 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2023-11-04T01:47:45.585 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:47:45.585 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:47:45.586 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:47:45.586 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:47:45.586 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2023-11-04T01:47:45.586 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2023-11-04T01:47:45.586 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:47:45.587 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:47:45.587 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:47:45.587 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:47:45.587 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2023-11-04T01:47:45.587 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:47:45.587 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:47:45.588 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:47:45.588 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:47:45.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:45.588 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-11-04T01:47:45.636 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:47:45.636 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:47:45.679 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:47:45.693 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2023-11-04T01:47:45.694 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2023-11-04T01:47:45.694 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2023-11-04T01:47:45.694 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2023-11-04T01:47:45.694 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2023-11-04T01:47:45.694 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2023-11-04T01:47:45.695 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2023-11-04T01:47:45.695 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2023-11-04T01:47:45.695 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2023-11-04T01:47:45.695 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2023-11-04T01:47:45.695 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2023-11-04T01:47:45.696 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2023-11-04T01:47:45.696 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:47:45.696 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2023-11-04T01:47:45.696 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2023-11-04T01:47:45.696 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2023-11-04T01:47:45.696 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2023-11-04T01:47:45.697 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2023-11-04T01:47:45.697 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2023-11-04T01:47:45.697 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:47:45.697 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:47:45.697 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:47:45.697 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:47:45.698 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2023-11-04T01:47:45.698 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2023-11-04T01:47:45.698 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:47:45.698 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:47:45.698 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:47:45.699 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:47:45.699 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2023-11-04T01:47:45.699 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:47:45.699 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:47:45.699 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:47:45.699 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:47:45.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:45.700 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-11-04T01:47:45.769 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:2023-11-04T01:47:45.766+0000 7fefe0040480 -1 init, newargv = 0x557f8fd1caf0 newargc=15 2023-11-04T01:47:45.769 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[157832]: starting ceph client 2023-11-04T01:47:45.778 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[157832]: starting fuse 2023-11-04T01:47:46.850 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:47:46.869 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2023-11-04T01:47:46.869 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2023-11-04T01:47:46.869 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2023-11-04T01:47:46.869 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2023-11-04T01:47:46.869 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2023-11-04T01:47:46.870 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2023-11-04T01:47:46.870 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2023-11-04T01:47:46.870 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2023-11-04T01:47:46.870 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2023-11-04T01:47:46.870 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2023-11-04T01:47:46.871 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2023-11-04T01:47:46.871 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2023-11-04T01:47:46.871 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:47:46.871 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2023-11-04T01:47:46.871 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2023-11-04T01:47:46.871 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2023-11-04T01:47:46.872 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2023-11-04T01:47:46.872 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2023-11-04T01:47:46.872 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2023-11-04T01:47:46.872 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2023-11-04T01:47:46.872 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-04T01:47:46.873 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-04T01:47:46.873 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2023-11-04T01:47:46.873 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2023-11-04T01:47:46.873 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2023-11-04T01:47:46.873 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:47:46.873 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:47:46.874 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:47:46.874 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:47:46.874 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2023-11-04T01:47:46.874 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:47:46.874 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:47:46.874 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:47:46.875 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:47:46.875 INFO:teuthology.orchestra.run.smithi077.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:47:46.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:46.875 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-11-04T01:47:46.926 INFO:teuthology.orchestra.run.smithi077.stdout:42 2023-11-04T01:47:46.927 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-11-04T01:47:46.927 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:47:46.927 DEBUG:teuthology.orchestra.run.smithi077:> import glob 2023-11-04T01:47:46.928 DEBUG:teuthology.orchestra.run.smithi077:> import re 2023-11-04T01:47:46.928 DEBUG:teuthology.orchestra.run.smithi077:> import os 2023-11-04T01:47:46.928 DEBUG:teuthology.orchestra.run.smithi077:> import subprocess 2023-11-04T01:47:46.929 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:47:46.929 DEBUG:teuthology.orchestra.run.smithi077:> def _find_admin_socket(client_name): 2023-11-04T01:47:46.929 DEBUG:teuthology.orchestra.run.smithi077:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:47:46.930 DEBUG:teuthology.orchestra.run.smithi077:> files = glob.glob(asok_path) 2023-11-04T01:47:46.930 DEBUG:teuthology.orchestra.run.smithi077:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:47:46.930 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:47:46.931 DEBUG:teuthology.orchestra.run.smithi077:> # Given a non-glob path, it better be there 2023-11-04T01:47:46.931 DEBUG:teuthology.orchestra.run.smithi077:> if "*" not in asok_path: 2023-11-04T01:47:46.931 DEBUG:teuthology.orchestra.run.smithi077:> assert(len(files) == 1) 2023-11-04T01:47:46.932 DEBUG:teuthology.orchestra.run.smithi077:> return files[0] 2023-11-04T01:47:46.932 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:47:46.932 DEBUG:teuthology.orchestra.run.smithi077:> for f in files: 2023-11-04T01:47:46.933 DEBUG:teuthology.orchestra.run.smithi077:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:47:46.933 DEBUG:teuthology.orchestra.run.smithi077:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:47:46.933 DEBUG:teuthology.orchestra.run.smithi077:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:47:46.934 DEBUG:teuthology.orchestra.run.smithi077:> contents = proc_f.read() 2023-11-04T01:47:46.934 DEBUG:teuthology.orchestra.run.smithi077:> if mountpoint in contents: 2023-11-04T01:47:46.935 DEBUG:teuthology.orchestra.run.smithi077:> return f 2023-11-04T01:47:46.935 DEBUG:teuthology.orchestra.run.smithi077:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:47:46.935 DEBUG:teuthology.orchestra.run.smithi077:> 2023-11-04T01:47:46.936 DEBUG:teuthology.orchestra.run.smithi077:> print(_find_admin_socket("client.0")) 2023-11-04T01:47:46.936 DEBUG:teuthology.orchestra.run.smithi077:> ' 2023-11-04T01:47:47.055 INFO:teuthology.orchestra.run.smithi077.stdout:/var/run/ceph/ceph-client.0.157832.asok 2023-11-04T01:47:47.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:47:47.066 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.157832.asok 2023-11-04T01:47:47.066 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:47:47.067 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.157832.asok status 2023-11-04T01:47:47.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:47:47.234 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-04T01:47:47.235 INFO:teuthology.orchestra.run.smithi077.stdout: "metadata": { 2023-11-04T01:47:47.235 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:47:47.235 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:47:47.235 INFO:teuthology.orchestra.run.smithi077.stdout: "entity_id": "0", 2023-11-04T01:47:47.236 INFO:teuthology.orchestra.run.smithi077.stdout: "hostname": "smithi077", 2023-11-04T01:47:47.236 INFO:teuthology.orchestra.run.smithi077.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:47:47.236 INFO:teuthology.orchestra.run.smithi077.stdout: "pid": "157832", 2023-11-04T01:47:47.236 INFO:teuthology.orchestra.run.smithi077.stdout: "root": "/" 2023-11-04T01:47:47.237 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:47:47.237 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_count": 0, 2023-11-04T01:47:47.237 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_pinned_count": 0, 2023-11-04T01:47:47.237 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 8754, 2023-11-04T01:47:47.237 INFO:teuthology.orchestra.run.smithi077.stdout: "inst": { 2023-11-04T01:47:47.238 INFO:teuthology.orchestra.run.smithi077.stdout: "name": { 2023-11-04T01:47:47.238 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "client", 2023-11-04T01:47:47.238 INFO:teuthology.orchestra.run.smithi077.stdout: "num": 8754 2023-11-04T01:47:47.238 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:47:47.239 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2023-11-04T01:47:47.239 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2023-11-04T01:47:47.239 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:47:47.239 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1706975499 2023-11-04T01:47:47.240 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-11-04T01:47:47.240 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:47:47.240 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2023-11-04T01:47:47.240 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2023-11-04T01:47:47.240 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:47:47.241 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1706975499 2023-11-04T01:47:47.241 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-11-04T01:47:47.241 INFO:teuthology.orchestra.run.smithi077.stdout: "inst_str": "client.8754 192.168.0.1:0/1706975499", 2023-11-04T01:47:47.241 INFO:teuthology.orchestra.run.smithi077.stdout: "addr_str": "192.168.0.1:0/1706975499", 2023-11-04T01:47:47.241 INFO:teuthology.orchestra.run.smithi077.stdout: "inode_count": 1, 2023-11-04T01:47:47.242 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_epoch": 116, 2023-11-04T01:47:47.242 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch": 115, 2023-11-04T01:47:47.242 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:47:47.242 INFO:teuthology.orchestra.run.smithi077.stdout: "blocklisted": false, 2023-11-04T01:47:47.242 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs" 2023-11-04T01:47:47.243 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-04T01:47:47.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:47:47.248 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:47:47.249 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:47:47.249 DEBUG:teuthology.orchestra.run.smithi077:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:47:47.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:47:47.308 INFO:teuthology.orchestra.run.smithi077.stdout:fuseblk 2023-11-04T01:47:47.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:47:47.314 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:47:47.315 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:47:47.315 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:47:47.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:47:47.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:47:47.381 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 flush journal 2023-11-04T01:47:47.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.482+0000 7fdeedbc9640 1 Processor -- start 2023-11-04T01:47:47.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.482+0000 7fdeedbc9640 1 -- start start 2023-11-04T01:47:47.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.482+0000 7fdeedbc9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fdee8159e40 0x7fdee80b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.482+0000 7fdeedbc9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdee8070700 0x7fdee80b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.482+0000 7fdeedbc9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdee8071500 con 0x7fdee806bb60 2023-11-04T01:47:47.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.482+0000 7fdeedbc9640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdee815dae0 con 0x7fdee8159e40 2023-11-04T01:47:47.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.482+0000 7fdeedbc9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee8070c60 con 0x7fdee8070700 2023-11-04T01:47:47.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.483+0000 7fdee6ffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fdee806bb60 0x7fdee806fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:53366/0 (socket says 172.21.15.77:53366) 2023-11-04T01:47:47.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.483+0000 7fdee6ffd640 1 -- 172.21.15.77:0/3991473642 learned_addr learned my addr 172.21.15.77:0/3991473642 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:47:47.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.483+0000 7fdee77fe640 1 --2- 172.21.15.77:0/3991473642 >> v2:172.21.15.122:3300/0 conn(0x7fdee8159e40 0x7fdee80b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.483+0000 7fdee7fff640 1 --2- 172.21.15.77:0/3991473642 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdee8070700 0x7fdee80b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.483+0000 7fdee67fc640 1 -- 172.21.15.77:0/3991473642 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2593914695 0 0) 0x7fdee8071500 con 0x7fdee806bb60 2023-11-04T01:47:47.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.483+0000 7fdee67fc640 1 -- 172.21.15.77:0/3991473642 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fded0003520 con 0x7fdee806bb60 2023-11-04T01:47:47.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.483+0000 7fdee67fc640 1 -- 172.21.15.77:0/3991473642 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3852714949 0 0) 0x7fded0003520 con 0x7fdee806bb60 2023-11-04T01:47:47.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.483+0000 7fdee67fc640 1 -- 172.21.15.77:0/3991473642 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdee8070700 msgr2=0x7fdee80b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:47.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.483+0000 7fdee67fc640 1 --2- 172.21.15.77:0/3991473642 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdee8070700 0x7fdee80b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.483+0000 7fdee67fc640 1 -- 172.21.15.77:0/3991473642 >> v2:172.21.15.122:3300/0 conn(0x7fdee8159e40 msgr2=0x7fdee80b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:47.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.483+0000 7fdee67fc640 1 --2- 172.21.15.77:0/3991473642 >> v2:172.21.15.122:3300/0 conn(0x7fdee8159e40 0x7fdee80b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.483+0000 7fdee67fc640 1 -- 172.21.15.77:0/3991473642 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee8070f40 con 0x7fdee806bb60 2023-11-04T01:47:47.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.483+0000 7fdee67fc640 1 -- 172.21.15.77:0/3991473642 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7fdedc001670 con 0x7fdee806bb60 2023-11-04T01:47:47.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.483+0000 7fdee67fc640 1 -- 172.21.15.77:0/3991473642 >> v1:172.21.15.77:6789/0 conn(0x7fdee806bb60 legacy=0x7fdee806fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:47.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.483+0000 7fdee67fc640 1 --2- 172.21.15.77:0/3991473642 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdee8070700 0x7fded0003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.483+0000 7fdee67fc640 1 --2- 172.21.15.77:0/3991473642 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fded0003ef0 0x7fded00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.483+0000 7fdee67fc640 1 --2- 172.21.15.77:0/3991473642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fded0004d00 0x7fded0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.483+0000 7fdee67fc640 1 -- 172.21.15.77:0/3991473642 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee815dae0 con 0x7fded0004d00 2023-11-04T01:47:47.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.483+0000 7fdee67fc640 1 -- 172.21.15.77:0/3991473642 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee8070c60 con 0x7fded0003ef0 2023-11-04T01:47:47.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.483+0000 7fdee67fc640 1 -- 172.21.15.77:0/3991473642 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded000b9d0 con 0x7fdee8070700 2023-11-04T01:47:47.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.483+0000 7fdee7fff640 1 --2- 172.21.15.77:0/3991473642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fded0004d00 0x7fded0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.483+0000 7fdee77fe640 1 --2- 172.21.15.77:0/3991473642 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdee8070700 0x7fded0003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.483+0000 7fdee6ffd640 1 --2- 172.21.15.77:0/3991473642 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fded0003ef0 0x7fded00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.484+0000 7fdee7fff640 1 -- 172.21.15.77:0/3991473642 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdee8070700 msgr2=0x7fded0003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:47.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.484+0000 7fdee7fff640 1 --2- 172.21.15.77:0/3991473642 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdee8070700 0x7fded0003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.484+0000 7fdee7fff640 1 -- 172.21.15.77:0/3991473642 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fded0003ef0 msgr2=0x7fded00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:47.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.484+0000 7fdee7fff640 1 --2- 172.21.15.77:0/3991473642 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fded0003ef0 0x7fded00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.484+0000 7fdee7fff640 1 -- 172.21.15.77:0/3991473642 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded0003520 con 0x7fded0004d00 2023-11-04T01:47:47.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.484+0000 7fdee7fff640 1 --2- 172.21.15.77:0/3991473642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fded0004d00 0x7fded0005180 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fdee0009a30 tx=0x7fded00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814c983d120d88ce server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:47.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.484+0000 7fdee67fc640 1 -- 172.21.15.77:0/3991473642 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee002ee00 con 0x7fded0004d00 2023-11-04T01:47:47.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.484+0000 7fdee67fc640 1 -- 172.21.15.77:0/3991473642 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee000f040 con 0x7fded0004d00 2023-11-04T01:47:47.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.484+0000 7fdee67fc640 1 -- 172.21.15.77:0/3991473642 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee0036680 con 0x7fded0004d00 2023-11-04T01:47:47.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.485+0000 7fdeedbc9640 1 -- 172.21.15.77:0/3991473642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fded0004d00 msgr2=0x7fded0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:47.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.485+0000 7fdeedbc9640 1 --2- 172.21.15.77:0/3991473642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fded0004d00 0x7fded0005180 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fdee0009a30 tx=0x7fded00057f0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.485+0000 7fdee7fff640 1 -- 172.21.15.77:0/3991473642 reap_dead start 2023-11-04T01:47:47.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.485+0000 7fdeedbc9640 1 -- 172.21.15.77:0/3991473642 shutdown_connections 2023-11-04T01:47:47.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.485+0000 7fdeedbc9640 1 -- 172.21.15.77:0/3991473642 >> 172.21.15.77:0/3991473642 conn(0x7fdee80cb530 msgr2=0x7fdee80cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:47.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.485+0000 7fdeedbc9640 1 -- 172.21.15.77:0/3991473642 shutdown_connections 2023-11-04T01:47:47.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.485+0000 7fdeedbc9640 1 -- 172.21.15.77:0/3991473642 wait complete. 2023-11-04T01:47:47.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.486+0000 7fdeedbc9640 1 Processor -- start 2023-11-04T01:47:47.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.486+0000 7fdeedbc9640 1 -- start start 2023-11-04T01:47:47.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.487+0000 7fdeedbc9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdee81465e0 0x7fdee815a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.487+0000 7fdeedbc9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdee80ac8d0 0x7fdee80acd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.487+0000 7fdeedbc9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdee80cc640 0x7fdee80ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.487+0000 7fdeedbc9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee80ad270 con 0x7fdee80ac8d0 2023-11-04T01:47:47.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.487+0000 7fdeedbc9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee815bf40 con 0x7fdee81465e0 2023-11-04T01:47:47.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.487+0000 7fdeedbc9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee815c1e0 con 0x7fdee80cc640 2023-11-04T01:47:47.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.487+0000 7fdee6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdee80ac8d0 0x7fdee80acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.487+0000 7fdee6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdee80ac8d0 0x7fdee80acd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57788/0 (socket says 172.21.15.77:57788) 2023-11-04T01:47:47.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.487+0000 7fdee6ffd640 1 -- 172.21.15.77:0/2114700523 learned_addr learned my addr 172.21.15.77:0/2114700523 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:47.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.487+0000 7fdee77fe640 1 --2- 172.21.15.77:0/2114700523 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdee81465e0 0x7fdee815a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.487+0000 7fdee7fff640 1 --2- 172.21.15.77:0/2114700523 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdee80cc640 0x7fdee80ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.487+0000 7fdee6ffd640 1 -- 172.21.15.77:0/2114700523 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdee80cc640 msgr2=0x7fdee80ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:47.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.487+0000 7fdee6ffd640 1 --2- 172.21.15.77:0/2114700523 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdee80cc640 0x7fdee80ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.487+0000 7fdee6ffd640 1 -- 172.21.15.77:0/2114700523 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdee81465e0 msgr2=0x7fdee815a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:47.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.487+0000 7fdee6ffd640 1 --2- 172.21.15.77:0/2114700523 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdee81465e0 0x7fdee815a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.487+0000 7fdee6ffd640 1 -- 172.21.15.77:0/2114700523 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee815c4c0 con 0x7fdee80ac8d0 2023-11-04T01:47:47.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.488+0000 7fdee6ffd640 1 --2- 172.21.15.77:0/2114700523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdee80ac8d0 0x7fdee80acd30 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7fdedc000c00 tx=0x7fdedc007660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:47.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.488+0000 7fdecffff640 1 -- 172.21.15.77:0/2114700523 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc00f960 con 0x7fdee80ac8d0 2023-11-04T01:47:47.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.488+0000 7fdecffff640 1 -- 172.21.15.77:0/2114700523 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdedc00fae0 con 0x7fdee80ac8d0 2023-11-04T01:47:47.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.488+0000 7fdeedbc9640 1 -- 172.21.15.77:0/2114700523 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdee815c7a0 con 0x7fdee80ac8d0 2023-11-04T01:47:47.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.488+0000 7fdecffff640 1 -- 172.21.15.77:0/2114700523 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc00fe90 con 0x7fdee80ac8d0 2023-11-04T01:47:47.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.488+0000 7fdeedbc9640 1 -- 172.21.15.77:0/2114700523 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdee815cd60 con 0x7fdee80ac8d0 2023-11-04T01:47:47.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.490+0000 7fdecffff640 1 -- 172.21.15.77:0/2114700523 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdedc01d460 con 0x7fdee80ac8d0 2023-11-04T01:47:47.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.490+0000 7fdecffff640 1 --2- 172.21.15.77:0/2114700523 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fded406aea0 0x7fded406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.490+0000 7fdecffff640 1 -- 172.21.15.77:0/2114700523 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8167+0+0 (secure 0 0 0) 0x7fdedc08a110 con 0x7fdee80ac8d0 2023-11-04T01:47:47.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.490+0000 7fdee77fe640 1 --2- 172.21.15.77:0/2114700523 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fded406aea0 0x7fded406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.491+0000 7fdee77fe640 1 --2- 172.21.15.77:0/2114700523 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fded406aea0 0x7fded406d360 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fded8009c40 tx=0x7fded8009190 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:47.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.491+0000 7fdef083a740 1 Processor -- start 2023-11-04T01:47:47.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.491+0000 7fdef083a740 1 -- start start 2023-11-04T01:47:47.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.492+0000 7fdef083a740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558a9167b4c0 0x558a9167b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.492+0000 7fdef083a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a9164b6d0 0x558a91678730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.492+0000 7fdef083a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558a9164f040 0x558a91678c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.492+0000 7fdef083a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a915bed70 con 0x558a9164b6d0 2023-11-04T01:47:47.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.492+0000 7fdef083a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a915bc460 con 0x558a9164f040 2023-11-04T01:47:47.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.492+0000 7fdef083a740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x558a915b7d50 con 0x558a9167b4c0 2023-11-04T01:47:47.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.492+0000 7fdee6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a9164b6d0 0x558a91678730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.492+0000 7fdee6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a9164b6d0 0x558a91678730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57804/0 (socket says 172.21.15.77:57804) 2023-11-04T01:47:47.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.492+0000 7fdee6ffd640 1 -- 172.21.15.77:0/3322825892 learned_addr learned my addr 172.21.15.77:0/3322825892 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:47.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.492+0000 7fdee77fe640 1 --2- 172.21.15.77:0/3322825892 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558a9167b4c0 0x558a9167b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.492+0000 7fdee7fff640 1 --2- 172.21.15.77:0/3322825892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558a9164f040 0x558a91678c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.492+0000 7fdee6ffd640 1 -- 172.21.15.77:0/3322825892 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558a9167b4c0 msgr2=0x558a9167b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:47.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.492+0000 7fdee6ffd640 1 --2- 172.21.15.77:0/3322825892 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558a9167b4c0 0x558a9167b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.492+0000 7fdee6ffd640 1 -- 172.21.15.77:0/3322825892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558a9164f040 msgr2=0x558a91678c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:47.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.492+0000 7fdee6ffd640 1 --2- 172.21.15.77:0/3322825892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558a9164f040 0x558a91678c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.492+0000 7fdee6ffd640 1 -- 172.21.15.77:0/3322825892 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a9157ae30 con 0x558a9164b6d0 2023-11-04T01:47:47.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.492+0000 7fdee6ffd640 1 --2- 172.21.15.77:0/3322825892 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a9164b6d0 0x558a91678730 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fdedc054950 tx=0x7fdedc057ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aba1e5d97574ea7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:47.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.492+0000 7fdecd7fa640 1 -- 172.21.15.77:0/3322825892 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc0607e0 con 0x558a9164b6d0 2023-11-04T01:47:47.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.492+0000 7fdecd7fa640 1 -- 172.21.15.77:0/3322825892 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdedc0567f0 con 0x558a9164b6d0 2023-11-04T01:47:47.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.492+0000 7fdecd7fa640 1 -- 172.21.15.77:0/3322825892 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc05c150 con 0x558a9164b6d0 2023-11-04T01:47:47.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.493+0000 7fdef083a740 1 -- 172.21.15.77:0/3322825892 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a9164b6d0 msgr2=0x558a91678730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:47.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.493+0000 7fdef083a740 1 --2- 172.21.15.77:0/3322825892 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a9164b6d0 0x558a91678730 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fdedc054950 tx=0x7fdedc057ee0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.493+0000 7fdef083a740 1 -- 172.21.15.77:0/3322825892 shutdown_connections 2023-11-04T01:47:47.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.493+0000 7fdef083a740 1 --2- 172.21.15.77:0/3322825892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558a9164f040 0x558a91678c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.493+0000 7fdef083a740 1 --2- 172.21.15.77:0/3322825892 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a9164b6d0 0x558a91678730 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.493+0000 7fdef083a740 1 --2- 172.21.15.77:0/3322825892 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558a9167b4c0 0x558a9167b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.493+0000 7fdef083a740 1 -- 172.21.15.77:0/3322825892 >> 172.21.15.77:0/3322825892 conn(0x558a9164d9e0 msgr2=0x558a916962d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:47.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.493+0000 7fdef083a740 1 -- 172.21.15.77:0/3322825892 shutdown_connections 2023-11-04T01:47:47.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.493+0000 7fdef083a740 1 -- 172.21.15.77:0/3322825892 wait complete. 2023-11-04T01:47:47.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.494+0000 7fdef083a740 1 -- start start 2023-11-04T01:47:47.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.494+0000 7fdef083a740 1 Processor -- start 2023-11-04T01:47:47.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.494+0000 7fdef083a740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558a9164f040 0x558a91676140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.494+0000 7fdef083a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558a9167b4c0 0x558a91680680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.494+0000 7fdef083a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a91680bc0 0x558a91681d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.494+0000 7fdef083a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a91571ee0 con 0x558a91680bc0 2023-11-04T01:47:47.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.494+0000 7fdef083a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a91571b80 con 0x558a9167b4c0 2023-11-04T01:47:47.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.494+0000 7fdef083a740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x558a915373a0 con 0x558a9164f040 2023-11-04T01:47:47.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.494+0000 7fdef083a740 10 client.0 _ll_register_callbacks cb 0x558a9153b8b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:47:47.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.494+0000 7fdee7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a91680bc0 0x558a91681d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.494+0000 7fdee7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a91680bc0 0x558a91681d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57814/0 (socket says 172.21.15.77:57814) 2023-11-04T01:47:47.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.494+0000 7fdee7fff640 1 -- 172.21.15.77:0/357782504 learned_addr learned my addr 172.21.15.77:0/357782504 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:47.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.495+0000 7fdee77fe640 1 --2- 172.21.15.77:0/357782504 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558a9164f040 0x558a91676140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.495+0000 7fdee6ffd640 1 --2- 172.21.15.77:0/357782504 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558a9167b4c0 0x558a91680680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.495+0000 7fdee7fff640 1 -- 172.21.15.77:0/357782504 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558a9164f040 msgr2=0x558a91676140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:47.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.495+0000 7fdee7fff640 1 --2- 172.21.15.77:0/357782504 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558a9164f040 0x558a91676140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.495+0000 7fdee7fff640 1 -- 172.21.15.77:0/357782504 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558a9167b4c0 msgr2=0x558a91680680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:47.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.495+0000 7fdee7fff640 1 --2- 172.21.15.77:0/357782504 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558a9167b4c0 0x558a91680680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.495+0000 7fdee7fff640 1 -- 172.21.15.77:0/357782504 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdee815cd60 con 0x558a91680bc0 2023-11-04T01:47:47.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.495+0000 7fdee6ffd640 1 --2- 172.21.15.77:0/357782504 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558a9167b4c0 0x558a91680680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:47.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.495+0000 7fdee7fff640 1 --2- 172.21.15.77:0/357782504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a91680bc0 0x558a91681d60 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fdee0002230 tx=0x7fdee0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f81d7e08d01f29b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:47.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.495+0000 7fdec67fc640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:47:47.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.495+0000 7fdec67fc640 1 -- 172.21.15.77:0/357782504 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee0011230 con 0x558a91680bc0 2023-11-04T01:47:47.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.495+0000 7fdef083a740 1 -- 172.21.15.77:0/357782504 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558a915b0d30 con 0x558a91680bc0 2023-11-04T01:47:47.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.495+0000 7fdec67fc640 1 -- 172.21.15.77:0/357782504 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8167+0+0 (secure 0 0 0) 0x7fdee0036d00 con 0x558a91680bc0 2023-11-04T01:47:47.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.495+0000 7fdec67fc640 1 -- 172.21.15.77:0/357782504 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdee0003990 con 0x558a91680bc0 2023-11-04T01:47:47.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.495+0000 7fdef083a740 10 client.8766 fetch_fsmap learned FSMap version 116 2023-11-04T01:47:47.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.495+0000 7fdef083a740 1 -- 172.21.15.77:0/357782504 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=2+}) v3 -- 0x558a915b63d0 con 0x558a91680bc0 2023-11-04T01:47:47.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.495+0000 7fdec67fc640 1 -- 172.21.15.77:0/357782504 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558a915b0d30 con 0x558a91680bc0 2023-11-04T01:47:47.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.495+0000 7fdec67fc640 1 -- 172.21.15.77:0/357782504 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 116) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fdee0003af0 con 0x558a91680bc0 2023-11-04T01:47:47.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.495+0000 7fdef083a740 10 client.8766 fetch_fsmap finished waiting for FSMap version 116 2023-11-04T01:47:47.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.495+0000 7fdef083a740 10 client.8766 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.b 2023-11-04T01:47:47.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.495+0000 7fdef083a740 20 client.8766 populate_metadata read hostname 'smithi077' 2023-11-04T01:47:47.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.495+0000 7fdef083a740 1 --2- 172.21.15.77:0/357782504 >> [v2:172.21.15.122:6834/2238841748,v1:172.21.15.122:6836/2238841748] conn(0x558a9167d3d0 0x558a916a6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.495+0000 7fdef083a740 4 client.8766 mds_command: new command op to 7033 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:47:47.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.495+0000 7fdef083a740 1 -- 172.21.15.77:0/357782504 --> [v2:172.21.15.122:6834/2238841748,v1:172.21.15.122:6836/2238841748] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558a915b0a50 con 0x558a9167d3d0 2023-11-04T01:47:47.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.496+0000 7fdee77fe640 1 --2- 172.21.15.77:0/357782504 >> [v2:172.21.15.122:6834/2238841748,v1:172.21.15.122:6836/2238841748] conn(0x558a9167d3d0 0x558a916a6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.496+0000 7fdee77fe640 1 --2- 172.21.15.77:0/357782504 >> [v2:172.21.15.122:6834/2238841748,v1:172.21.15.122:6836/2238841748] conn(0x558a9167d3d0 0x558a916a6560 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f27ba8335ee4aa8 server_cookie=9ebf7bb2dfa8c91f in_seq=0 out_seq=0 2023-11-04T01:47:47.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.496+0000 7fdec67fc640 10 client.8766 ms_handle_connect on v2:172.21.15.122:6834/2238841748 2023-11-04T01:47:47.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.497+0000 7fdec67fc640 1 -- 172.21.15.77:0/357782504 <== mds.0 v2:172.21.15.122:6834/2238841748 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558a915b0a50 con 0x558a9167d3d0 2023-11-04T01:47:47.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.497+0000 7fdec67fc640 10 client.8766 handle_command_reply: tid=0 2023-11-04T01:47:47.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.497+0000 7fdef083a740 1 client.8766 shutdown 2023-11-04T01:47:47.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.497+0000 7fdef083a740 1 -- 172.21.15.77:0/357782504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a91680bc0 msgr2=0x558a91681d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:47.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.497+0000 7fdef083a740 1 --2- 172.21.15.77:0/357782504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a91680bc0 0x558a91681d60 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fdee0002230 tx=0x7fdee0004ab0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.497+0000 7fdef083a740 1 -- 172.21.15.77:0/357782504 shutdown_connections 2023-11-04T01:47:47.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.497+0000 7fdef083a740 1 --2- 172.21.15.77:0/357782504 >> [v2:172.21.15.122:6834/2238841748,v1:172.21.15.122:6836/2238841748] conn(0x558a9167d3d0 0x558a916a6560 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.497+0000 7fdef083a740 1 --2- 172.21.15.77:0/357782504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a91680bc0 0x558a91681d60 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.497+0000 7fdef083a740 1 --2- 172.21.15.77:0/357782504 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558a9167b4c0 0x558a91680680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.497+0000 7fdec67fc640 0 client.8766 ms_handle_reset on v2:172.21.15.122:6834/2238841748 2023-11-04T01:47:47.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.497+0000 7fdef083a740 1 --2- 172.21.15.77:0/357782504 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558a9164f040 0x558a91676140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.497+0000 7fdef083a740 1 -- 172.21.15.77:0/357782504 >> 172.21.15.77:0/357782504 conn(0x558a9164b6d0 msgr2=0x558a916997e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:47.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.497+0000 7fdef083a740 1 -- 172.21.15.77:0/357782504 shutdown_connections 2023-11-04T01:47:47.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.497+0000 7fdef083a740 1 -- 172.21.15.77:0/357782504 wait complete. 2023-11-04T01:47:47.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.497+0000 7fdef083a740 20 client.8766 trim_cache size 0 max 16384 2023-11-04T01:47:47.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.510+0000 7fdef083a740 1 Processor -- start 2023-11-04T01:47:47.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.510+0000 7fdef083a740 1 -- start start 2023-11-04T01:47:47.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.511+0000 7fdef083a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a9164f040 0x558a916b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.511+0000 7fdef083a740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558a9167b4c0 0x558a91678480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.511+0000 7fdef083a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558a91680bc0 0x558a916997e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.511+0000 7fdef083a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a916520b0 con 0x558a9164f040 2023-11-04T01:47:47.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.511+0000 7fdef083a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a9167eaa0 con 0x558a91680bc0 2023-11-04T01:47:47.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.511+0000 7fdef083a740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x558a91646e20 con 0x558a9167b4c0 2023-11-04T01:47:47.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.511+0000 7fdee77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a9164f040 0x558a916b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.511+0000 7fdee77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a9164f040 0x558a916b0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57820/0 (socket says 172.21.15.77:57820) 2023-11-04T01:47:47.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.511+0000 7fdee77fe640 1 -- 172.21.15.77:0/3526042073 learned_addr learned my addr 172.21.15.77:0/3526042073 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:47.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.511+0000 7fdee7fff640 1 --2- 172.21.15.77:0/3526042073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558a91680bc0 0x558a916997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.511+0000 7fdee6ffd640 1 --2- 172.21.15.77:0/3526042073 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558a9167b4c0 0x558a91678480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.511+0000 7fdee77fe640 1 -- 172.21.15.77:0/3526042073 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558a9167b4c0 msgr2=0x558a91678480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:47.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.511+0000 7fdee77fe640 1 --2- 172.21.15.77:0/3526042073 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558a9167b4c0 0x558a91678480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.511+0000 7fdee77fe640 1 -- 172.21.15.77:0/3526042073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558a91680bc0 msgr2=0x558a916997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:47.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.511+0000 7fdee77fe640 1 --2- 172.21.15.77:0/3526042073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558a91680bc0 0x558a916997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.511+0000 7fdee77fe640 1 -- 172.21.15.77:0/3526042073 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a9164d030 con 0x558a9164f040 2023-11-04T01:47:47.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.511+0000 7fdee77fe640 1 --2- 172.21.15.77:0/3526042073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a9164f040 0x558a916b0450 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fded8004210 tx=0x7fded8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2851e7dc11534640 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:47.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.511+0000 7fdecdffb640 1 -- 172.21.15.77:0/3526042073 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded8028040 con 0x558a9164f040 2023-11-04T01:47:47.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.512+0000 7fdecdffb640 1 -- 172.21.15.77:0/3526042073 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded8019070 con 0x558a9164f040 2023-11-04T01:47:47.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.512+0000 7fdecdffb640 1 -- 172.21.15.77:0/3526042073 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded8006c10 con 0x558a9164f040 2023-11-04T01:47:47.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.512+0000 7fdef083a740 1 -- 172.21.15.77:0/3526042073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a9164f040 msgr2=0x558a916b0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:47.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.512+0000 7fdef083a740 1 --2- 172.21.15.77:0/3526042073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a9164f040 0x558a916b0450 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fded8004210 tx=0x7fded8017000 comp rx=0 tx=0).stop 2023-11-04T01:47:47.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.512+0000 7fdef083a740 1 -- 172.21.15.77:0/3526042073 shutdown_connections 2023-11-04T01:47:47.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.512+0000 7fdef083a740 1 --2- 172.21.15.77:0/3526042073 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558a91680bc0 0x558a916997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.512+0000 7fdef083a740 1 --2- 172.21.15.77:0/3526042073 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558a9167b4c0 0x558a91678480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.512+0000 7fdef083a740 1 --2- 172.21.15.77:0/3526042073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a9164f040 0x558a916b0450 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.512+0000 7fdef083a740 1 -- 172.21.15.77:0/3526042073 >> 172.21.15.77:0/3526042073 conn(0x558a9164b6d0 msgr2=0x558a9164fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:47.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.512+0000 7fdef083a740 1 -- 172.21.15.77:0/3526042073 shutdown_connections 2023-11-04T01:47:47.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.512+0000 7fdef083a740 1 -- 172.21.15.77:0/3526042073 wait complete. 2023-11-04T01:47:47.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.513+0000 7fdef083a740 1 -- start start 2023-11-04T01:47:47.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.513+0000 7fdef083a740 1 Processor -- start 2023-11-04T01:47:47.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.513+0000 7fdef083a740 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558a9164f040 0x558a91701400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.513+0000 7fdef083a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a9167b4c0 0x558a91681530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.513+0000 7fdef083a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558a91680bc0 0x558a91681a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.513+0000 7fdef083a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a916b91f0 con 0x558a9167b4c0 2023-11-04T01:47:47.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.513+0000 7fdef083a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a91677320 con 0x558a91680bc0 2023-11-04T01:47:47.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.513+0000 7fdef083a740 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x558a9164c700 con 0x558a9164f040 2023-11-04T01:47:47.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.513+0000 7fdef083a740 10 client.0 _ll_register_callbacks cb 0x7fdedc054790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:47:47.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.514+0000 7fdee6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a9167b4c0 0x558a91681530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.514+0000 7fdee6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a9167b4c0 0x558a91681530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57834/0 (socket says 172.21.15.77:57834) 2023-11-04T01:47:47.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.514+0000 7fdee6ffd640 1 -- 172.21.15.77:0/1331411052 learned_addr learned my addr 172.21.15.77:0/1331411052 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:47.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.514+0000 7fdee7fff640 1 --2- 172.21.15.77:0/1331411052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558a91680bc0 0x558a91681a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.514+0000 7fdee77fe640 1 --2- 172.21.15.77:0/1331411052 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558a9164f040 0x558a91701400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.514+0000 7fdee6ffd640 1 -- 172.21.15.77:0/1331411052 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558a9164f040 msgr2=0x558a91701400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:47.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.514+0000 7fdee6ffd640 1 --2- 172.21.15.77:0/1331411052 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558a9164f040 0x558a91701400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.514+0000 7fdee6ffd640 1 -- 172.21.15.77:0/1331411052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558a91680bc0 msgr2=0x558a91681a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:47.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.514+0000 7fdee6ffd640 1 --2- 172.21.15.77:0/1331411052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558a91680bc0 0x558a91681a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.514+0000 7fdee6ffd640 1 -- 172.21.15.77:0/1331411052 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded80042c0 con 0x558a9167b4c0 2023-11-04T01:47:47.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.514+0000 7fdee6ffd640 1 --2- 172.21.15.77:0/1331411052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a9167b4c0 0x558a91681530 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fdedc087c40 tx=0x7fdedc001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b64574f53af0379f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:47.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.514+0000 7fdec67fc640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-11-04T01:47:47.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.514+0000 7fdec67fc640 1 -- 172.21.15.77:0/1331411052 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc060550 con 0x558a9167b4c0 2023-11-04T01:47:47.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.514+0000 7fdec67fc640 1 -- 172.21.15.77:0/1331411052 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8167+0+0 (secure 0 0 0) 0x7fdedc05c360 con 0x558a9167b4c0 2023-11-04T01:47:47.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.514+0000 7fdef083a740 1 -- 172.21.15.77:0/1331411052 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdedc0567f0 con 0x558a9167b4c0 2023-11-04T01:47:47.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.514+0000 7fdec67fc640 1 -- 172.21.15.77:0/1331411052 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdedc0607e0 con 0x558a9167b4c0 2023-11-04T01:47:47.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.514+0000 7fdef083a740 10 client.8772 fetch_fsmap learned FSMap version 116 2023-11-04T01:47:47.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.514+0000 7fdef083a740 1 -- 172.21.15.77:0/1331411052 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=2+}) v3 -- 0x558a91553ea0 con 0x558a9167b4c0 2023-11-04T01:47:47.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.514+0000 7fdec67fc640 1 -- 172.21.15.77:0/1331411052 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdedc0567f0 con 0x558a9167b4c0 2023-11-04T01:47:47.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.514+0000 7fdec67fc640 1 -- 172.21.15.77:0/1331411052 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 116) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fdedc07b080 con 0x558a9167b4c0 2023-11-04T01:47:47.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.515+0000 7fdef083a740 10 client.8772 fetch_fsmap finished waiting for FSMap version 116 2023-11-04T01:47:47.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.515+0000 7fdef083a740 10 client.8772 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.b 2023-11-04T01:47:47.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.515+0000 7fdef083a740 20 client.8772 populate_metadata read hostname 'smithi077' 2023-11-04T01:47:47.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.515+0000 7fdef083a740 1 --2- 172.21.15.77:0/1331411052 >> [v2:172.21.15.122:6834/2238841748,v1:172.21.15.122:6836/2238841748] conn(0x558a9164bb60 0x558a91676050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.515+0000 7fdef083a740 4 client.8772 mds_command: new command op to 7033 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-11-04T01:47:47.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.515+0000 7fdef083a740 1 -- 172.21.15.77:0/1331411052 --> [v2:172.21.15.122:6834/2238841748,v1:172.21.15.122:6836/2238841748] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558a912b87e0 con 0x558a9164bb60 2023-11-04T01:47:47.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.515+0000 7fdee77fe640 1 --2- 172.21.15.77:0/1331411052 >> [v2:172.21.15.122:6834/2238841748,v1:172.21.15.122:6836/2238841748] conn(0x558a9164bb60 0x558a91676050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.515+0000 7fdee77fe640 1 --2- 172.21.15.77:0/1331411052 >> [v2:172.21.15.122:6834/2238841748,v1:172.21.15.122:6836/2238841748] conn(0x558a9164bb60 0x558a91676050 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3716a1ac817f698 server_cookie=bb2e2ac53b3e3ac8 in_seq=0 out_seq=0 2023-11-04T01:47:47.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.515+0000 7fdec67fc640 10 client.8772 ms_handle_connect on v2:172.21.15.122:6834/2238841748 2023-11-04T01:47:47.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.525+0000 7fdec67fc640 1 -- 172.21.15.77:0/1331411052 <== mds.0 v2:172.21.15.122:6834/2238841748 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558a912b87e0 con 0x558a9164bb60 2023-11-04T01:47:47.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.525+0000 7fdec67fc640 10 client.8772 handle_command_reply: tid=0 2023-11-04T01:47:47.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.525+0000 7fdef083a740 1 client.8772 shutdown 2023-11-04T01:47:47.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.525+0000 7fdef083a740 1 -- 172.21.15.77:0/1331411052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a9167b4c0 msgr2=0x558a91681530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:47.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.525+0000 7fdef083a740 1 --2- 172.21.15.77:0/1331411052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a9167b4c0 0x558a91681530 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fdedc087c40 tx=0x7fdedc001a00 comp rx=0 tx=0).stop 2023-11-04T01:47:47.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.525+0000 7fdef083a740 1 -- 172.21.15.77:0/1331411052 shutdown_connections 2023-11-04T01:47:47.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.525+0000 7fdef083a740 1 --2- 172.21.15.77:0/1331411052 >> [v2:172.21.15.122:6834/2238841748,v1:172.21.15.122:6836/2238841748] conn(0x558a9164bb60 0x558a91676050 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.525+0000 7fdef083a740 1 --2- 172.21.15.77:0/1331411052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558a91680bc0 0x558a91681a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.525+0000 7fdef083a740 1 --2- 172.21.15.77:0/1331411052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558a9167b4c0 0x558a91681530 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.525+0000 7fdef083a740 1 --2- 172.21.15.77:0/1331411052 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x558a9164f040 0x558a91701400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.525+0000 7fdef083a740 1 -- 172.21.15.77:0/1331411052 >> 172.21.15.77:0/1331411052 conn(0x558a9164b6d0 msgr2=0x558a9164fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:47.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.525+0000 7fdec67fc640 0 client.8772 ms_handle_reset on v2:172.21.15.122:6834/2238841748 2023-11-04T01:47:47.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.525+0000 7fdef083a740 1 -- 172.21.15.77:0/1331411052 shutdown_connections 2023-11-04T01:47:47.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.525+0000 7fdef083a740 1 -- 172.21.15.77:0/1331411052 wait complete. 2023-11-04T01:47:47.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.525+0000 7fdef083a740 20 client.8772 trim_cache size 0 max 16384 2023-11-04T01:47:47.547 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-11-04T01:47:47.547 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "", 2023-11-04T01:47:47.547 INFO:teuthology.orchestra.run.smithi077.stdout: "return_code": 0 2023-11-04T01:47:47.547 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-11-04T01:47:47.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.526+0000 7fdeedbc9640 1 -- 172.21.15.77:0/2114700523 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fded406aea0 msgr2=0x7fded406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:47.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.526+0000 7fdeedbc9640 1 --2- 172.21.15.77:0/2114700523 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fded406aea0 0x7fded406d360 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fded8009c40 tx=0x7fded8009190 comp rx=0 tx=0).stop 2023-11-04T01:47:47.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.526+0000 7fdeedbc9640 1 -- 172.21.15.77:0/2114700523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdee80ac8d0 msgr2=0x7fdee80acd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:47.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.526+0000 7fdeedbc9640 1 --2- 172.21.15.77:0/2114700523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdee80ac8d0 0x7fdee80acd30 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7fdedc000c00 tx=0x7fdedc007660 comp rx=0 tx=0).stop 2023-11-04T01:47:47.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.526+0000 7fdeedbc9640 1 -- 172.21.15.77:0/2114700523 shutdown_connections 2023-11-04T01:47:47.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.526+0000 7fdeedbc9640 1 --2- 172.21.15.77:0/2114700523 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fded406aea0 0x7fded406d360 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.526+0000 7fdeedbc9640 1 --2- 172.21.15.77:0/2114700523 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdee80cc640 0x7fdee80ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.526+0000 7fdeedbc9640 1 --2- 172.21.15.77:0/2114700523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdee80ac8d0 0x7fdee80acd30 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.526+0000 7fdeedbc9640 1 --2- 172.21.15.77:0/2114700523 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdee81465e0 0x7fdee815a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.526+0000 7fdeedbc9640 1 -- 172.21.15.77:0/2114700523 >> 172.21.15.77:0/2114700523 conn(0x7fdee80cb530 msgr2=0x7fdee806c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:47.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.526+0000 7fdeedbc9640 1 -- 172.21.15.77:0/2114700523 shutdown_connections 2023-11-04T01:47:47.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.526+0000 7fdeedbc9640 1 -- 172.21.15.77:0/2114700523 wait complete. 2023-11-04T01:47:47.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:47.552 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir d1/dir/.snap/*) 2023-11-04T01:47:47.583 INFO:tasks.cephfs.test_snapshots:testing snapclient mds_kill_mdstable_at=3 2023-11-04T01:47:47.583 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:47.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.721+0000 7fa7ab026640 1 Processor -- start 2023-11-04T01:47:47.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.721+0000 7fa7ab026640 1 -- start start 2023-11-04T01:47:47.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.721+0000 7fa7ab026640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fa7a40d1be0 0x7fa7a4167e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.721+0000 7fa7ab026640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a40b32b0 con 0x7fa7a415d4e0 2023-11-04T01:47:47.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.721+0000 7fa7ab026640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a40cee10 con 0x7fa7a415d100 2023-11-04T01:47:47.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.721+0000 7fa7ab026640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7a40cec20 con 0x7fa7a40d1be0 2023-11-04T01:47:47.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.722+0000 7fa7a3fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fa7a415d4e0 0x7fa7a40d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:53376/0 (socket says 172.21.15.77:53376) 2023-11-04T01:47:47.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.722+0000 7fa7a3fff640 1 -- 172.21.15.77:0/628791371 learned_addr learned my addr 172.21.15.77:0/628791371 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:47:47.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.722+0000 7fa7a95c3640 1 --2- 172.21.15.77:0/628791371 >> v2:172.21.15.122:3300/0 conn(0x7fa7a40d1be0 0x7fa7a4167e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.722+0000 7fa7a37fe640 1 -- 172.21.15.77:0/628791371 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2398154702 0 0) 0x7fa7a40b32b0 con 0x7fa7a415d4e0 2023-11-04T01:47:47.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.722+0000 7fa7a37fe640 1 -- 172.21.15.77:0/628791371 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa78c003520 con 0x7fa7a415d4e0 2023-11-04T01:47:47.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.722+0000 7fa7a37fe640 1 -- 172.21.15.77:0/628791371 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1871783742 0 0) 0x7fa78c003520 con 0x7fa7a415d4e0 2023-11-04T01:47:47.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.722+0000 7fa7a37fe640 1 -- 172.21.15.77:0/628791371 >> v2:172.21.15.122:3300/0 conn(0x7fa7a40d1be0 msgr2=0x7fa7a4167e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:47.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.722+0000 7fa7a37fe640 1 --2- 172.21.15.77:0/628791371 >> v2:172.21.15.122:3300/0 conn(0x7fa7a40d1be0 0x7fa7a4167e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.722+0000 7fa7a37fe640 1 -- 172.21.15.77:0/628791371 >> v1:172.21.15.122:6789/0 conn(0x7fa7a415d100 legacy=0x7fa7a40ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:47.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.722+0000 7fa7a37fe640 1 -- 172.21.15.77:0/628791371 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a40b4750 con 0x7fa7a415d4e0 2023-11-04T01:47:47.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.722+0000 7fa7a37fe640 1 -- 172.21.15.77:0/628791371 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7fa798001670 con 0x7fa7a415d4e0 2023-11-04T01:47:47.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.722+0000 7fa7a37fe640 1 -- 172.21.15.77:0/628791371 >> v1:172.21.15.77:6789/0 conn(0x7fa7a415d4e0 legacy=0x7fa7a40d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:47.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.722+0000 7fa7a37fe640 1 --2- 172.21.15.77:0/628791371 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa78c003970 0x7fa78c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.722+0000 7fa7a37fe640 1 --2- 172.21.15.77:0/628791371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa78c0047c0 0x7fa78c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.722+0000 7fa7a37fe640 1 --2- 172.21.15.77:0/628791371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa78c005180 0x7fa78c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.722+0000 7fa7a37fe640 1 -- 172.21.15.77:0/628791371 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c00bff0 con 0x7fa78c0047c0 2023-11-04T01:47:47.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.722+0000 7fa7a37fe640 1 -- 172.21.15.77:0/628791371 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c00c160 con 0x7fa78c005180 2023-11-04T01:47:47.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.722+0000 7fa7a37fe640 1 -- 172.21.15.77:0/628791371 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c00c320 con 0x7fa78c003970 2023-11-04T01:47:47.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.722+0000 7fa7a3fff640 1 --2- 172.21.15.77:0/628791371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa78c0047c0 0x7fa78c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.722+0000 7fa7a8dc2640 1 --2- 172.21.15.77:0/628791371 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa78c003970 0x7fa78c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.722+0000 7fa7a95c3640 1 --2- 172.21.15.77:0/628791371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa78c005180 0x7fa78c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.722+0000 7fa7a3fff640 1 -- 172.21.15.77:0/628791371 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa78c003970 msgr2=0x7fa78c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:47.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.722+0000 7fa7a3fff640 1 --2- 172.21.15.77:0/628791371 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa78c003970 0x7fa78c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.722+0000 7fa7a3fff640 1 -- 172.21.15.77:0/628791371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa78c005180 msgr2=0x7fa78c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:47.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.722+0000 7fa7a3fff640 1 --2- 172.21.15.77:0/628791371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa78c005180 0x7fa78c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.722+0000 7fa7a95c3640 1 -- 172.21.15.77:0/628791371 reap_dead start 2023-11-04T01:47:47.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.722+0000 7fa7a3fff640 1 -- 172.21.15.77:0/628791371 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa78c003520 con 0x7fa78c0047c0 2023-11-04T01:47:47.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.723+0000 7fa7a3fff640 1 --2- 172.21.15.77:0/628791371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa78c0047c0 0x7fa78c004c40 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7fa798007fd0 tx=0x7fa78c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3389ee107cb31d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:47.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.723+0000 7fa7a37fe640 1 -- 172.21.15.77:0/628791371 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa798005ad0 con 0x7fa78c0047c0 2023-11-04T01:47:47.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.723+0000 7fa7a37fe640 1 -- 172.21.15.77:0/628791371 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa798005c30 con 0x7fa78c0047c0 2023-11-04T01:47:47.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.723+0000 7fa7a37fe640 1 -- 172.21.15.77:0/628791371 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79802ca90 con 0x7fa78c0047c0 2023-11-04T01:47:47.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.724+0000 7fa7ab026640 1 -- 172.21.15.77:0/628791371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa78c0047c0 msgr2=0x7fa78c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:47.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.724+0000 7fa7ab026640 1 --2- 172.21.15.77:0/628791371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa78c0047c0 0x7fa78c004c40 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7fa798007fd0 tx=0x7fa78c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.724+0000 7fa7ab026640 1 -- 172.21.15.77:0/628791371 shutdown_connections 2023-11-04T01:47:47.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.724+0000 7fa7ab026640 1 --2- 172.21.15.77:0/628791371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa78c0047c0 0x7fa78c004c40 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.724+0000 7fa7ab026640 1 -- 172.21.15.77:0/628791371 >> 172.21.15.77:0/628791371 conn(0x7fa7a40d2ef0 msgr2=0x7fa7a40d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:47.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.724+0000 7fa7ab026640 1 -- 172.21.15.77:0/628791371 shutdown_connections 2023-11-04T01:47:47.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.724+0000 7fa7ab026640 1 -- 172.21.15.77:0/628791371 wait complete. 2023-11-04T01:47:47.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.725+0000 7fa7ab026640 1 Processor -- start 2023-11-04T01:47:47.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.725+0000 7fa7ab026640 1 -- start start 2023-11-04T01:47:47.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.726+0000 7fa7ab026640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa78c0047c0 0x7fa7a40c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.726+0000 7fa7ab026640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7a4160090 0x7fa7a41f60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.726+0000 7fa7ab026640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7a41f6620 0x7fa7a41f6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.726+0000 7fa7ab026640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a40c90b0 con 0x7fa7a41f6620 2023-11-04T01:47:47.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.726+0000 7fa7ab026640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a40ccb70 con 0x7fa78c0047c0 2023-11-04T01:47:47.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.726+0000 7fa7ab026640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a415dc70 con 0x7fa7a4160090 2023-11-04T01:47:47.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.726+0000 7fa7a95c3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7a41f6620 0x7fa7a41f6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.726+0000 7fa7a95c3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7a41f6620 0x7fa7a41f6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57848/0 (socket says 172.21.15.77:57848) 2023-11-04T01:47:47.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.726+0000 7fa7a95c3640 1 -- 172.21.15.77:0/1551141077 learned_addr learned my addr 172.21.15.77:0/1551141077 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:47.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.726+0000 7fa7a8dc2640 1 --2- 172.21.15.77:0/1551141077 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa78c0047c0 0x7fa7a40c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.726+0000 7fa7a3fff640 1 --2- 172.21.15.77:0/1551141077 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7a4160090 0x7fa7a41f60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.726+0000 7fa7a95c3640 1 -- 172.21.15.77:0/1551141077 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7a4160090 msgr2=0x7fa7a41f60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:47.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.726+0000 7fa7a95c3640 1 --2- 172.21.15.77:0/1551141077 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7a4160090 0x7fa7a41f60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.726+0000 7fa7a95c3640 1 -- 172.21.15.77:0/1551141077 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa78c0047c0 msgr2=0x7fa7a40c8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:47.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.726+0000 7fa7a95c3640 1 --2- 172.21.15.77:0/1551141077 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa78c0047c0 0x7fa7a40c8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.726+0000 7fa7a95c3640 1 -- 172.21.15.77:0/1551141077 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a4160630 con 0x7fa7a41f6620 2023-11-04T01:47:47.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.727+0000 7fa7a95c3640 1 --2- 172.21.15.77:0/1551141077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7a41f6620 0x7fa7a41f6aa0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fa7a415d8c0 tx=0x7fa79c0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:47.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.727+0000 7fa7a17fa640 1 -- 172.21.15.77:0/1551141077 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c00e070 con 0x7fa7a41f6620 2023-11-04T01:47:47.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.727+0000 7fa7a17fa640 1 -- 172.21.15.77:0/1551141077 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79c011e10 con 0x7fa7a41f6620 2023-11-04T01:47:47.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.727+0000 7fa7ab026640 1 -- 172.21.15.77:0/1551141077 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a40cc240 con 0x7fa7a41f6620 2023-11-04T01:47:47.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.727+0000 7fa7a17fa640 1 -- 172.21.15.77:0/1551141077 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c003990 con 0x7fa7a41f6620 2023-11-04T01:47:47.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.727+0000 7fa7ab026640 1 -- 172.21.15.77:0/1551141077 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a40cc800 con 0x7fa7a41f6620 2023-11-04T01:47:47.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.728+0000 7fa7ab026640 1 -- 172.21.15.77:0/1551141077 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a40684b0 con 0x7fa7a41f6620 2023-11-04T01:47:47.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.728+0000 7fa7a17fa640 1 -- 172.21.15.77:0/1551141077 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa79c003af0 con 0x7fa7a41f6620 2023-11-04T01:47:47.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.728+0000 7fa7a17fa640 1 --2- 172.21.15.77:0/1551141077 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa79006aea0 0x7fa79006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.729+0000 7fa7a17fa640 1 -- 172.21.15.77:0/1551141077 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8167+0+0 (secure 0 0 0) 0x7fa79c08a410 con 0x7fa7a41f6620 2023-11-04T01:47:47.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.729+0000 7fa7a8dc2640 1 --2- 172.21.15.77:0/1551141077 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa79006aea0 0x7fa79006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.729+0000 7fa7a8dc2640 1 --2- 172.21.15.77:0/1551141077 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa79006aea0 0x7fa79006d360 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fa794000c00 tx=0x7fa794009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:47.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.733+0000 7fa7a17fa640 1 -- 172.21.15.77:0/1551141077 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa79c054c60 con 0x7fa7a41f6620 2023-11-04T01:47:47.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.933+0000 7fa7ab026640 1 -- 172.21.15.77:0/1551141077 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7a40cccb0 con 0x7fa7a41f6620 2023-11-04T01:47:47.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.933+0000 7fa7a17fa640 1 -- 172.21.15.77:0/1551141077 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+4943 (secure 0 0 0) 0x7fa79c058280 con 0x7fa7a41f6620 2023-11-04T01:47:47.936 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:47:47.936 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":116,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2985885329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2985885329},{"type":"v1","addr":"172.21.15.77:6835","nonce":2985885329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:47:39.684056+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7033,"mds_1":8583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7033":{"gid":7033,"name":"b","rank":0,"incarnation":109,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6836/2238841748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2238841748},{"type":"v1","addr":"172.21.15.122:6836","nonce":2238841748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8583":{"gid":8583,"name":"c","rank":1,"incarnation":112,"state":"up:active","state_seq":7,"addr":"172.21.15.77:6833/1157837717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1157837717},{"type":"v1","addr":"172.21.15.77:6833","nonce":1157837717}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:47.937 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 116 2023-11-04T01:47:47.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.935+0000 7fa7ab026640 1 -- 172.21.15.77:0/1551141077 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa79006aea0 msgr2=0x7fa79006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:47.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.935+0000 7fa7ab026640 1 --2- 172.21.15.77:0/1551141077 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa79006aea0 0x7fa79006d360 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fa794000c00 tx=0x7fa794009040 comp rx=0 tx=0).stop 2023-11-04T01:47:47.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.935+0000 7fa7ab026640 1 -- 172.21.15.77:0/1551141077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7a41f6620 msgr2=0x7fa7a41f6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:47.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.935+0000 7fa7ab026640 1 --2- 172.21.15.77:0/1551141077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7a41f6620 0x7fa7a41f6aa0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fa7a415d8c0 tx=0x7fa79c0115a0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.935+0000 7fa7ab026640 1 -- 172.21.15.77:0/1551141077 shutdown_connections 2023-11-04T01:47:47.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.935+0000 7fa7ab026640 1 --2- 172.21.15.77:0/1551141077 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fa79006aea0 0x7fa79006d360 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.935+0000 7fa7ab026640 1 --2- 172.21.15.77:0/1551141077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7a41f6620 0x7fa7a41f6aa0 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.935+0000 7fa7ab026640 1 --2- 172.21.15.77:0/1551141077 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fa7a4160090 0x7fa7a41f60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.935+0000 7fa7ab026640 1 --2- 172.21.15.77:0/1551141077 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa78c0047c0 0x7fa7a40c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.935+0000 7fa7ab026640 1 -- 172.21.15.77:0/1551141077 >> 172.21.15.77:0/1551141077 conn(0x7fa7a40d2ef0 msgr2=0x7fa7a40c9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:47.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.935+0000 7fa7ab026640 1 -- 172.21.15.77:0/1551141077 shutdown_connections 2023-11-04T01:47:47.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:47.935+0000 7fa7ab026640 1 -- 172.21.15.77:0/1551141077 wait complete. 2023-11-04T01:47:47.948 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dump snaps --server 2023-11-04T01:47:48.072 INFO:teuthology.orchestra.run.smithi122.stdout:{"last_snap":14,"last_created":12,"last_destroyed":13,"pending_noop":[],"snaps":[{"snapid":12,"ino":1099511627777,"stamp":"2023-11-04T01:47:05.961051+0000","name":"s26","metadata":{}}],"need_to_purge":{"17":[11,13]},"pending_update":[],"pending_destroy":[{"version":28,"removed_snap":12,"seq":14}]} 2023-11-04T01:47:48.072 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 12, "last_destroyed": 13, "last_snap": 14, "need_to_purge": { "17": [ 11, 13 ] }, "pending_destroy": [ { "removed_snap": 12, "seq": 14, "version": 28 } ], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s26", "snapid": 12, "stamp": "2023-11-04T01:47:05.961051+0000" } ] } 2023-11-04T01:47:48.073 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:48.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.171+0000 7f680944b640 1 Processor -- start 2023-11-04T01:47:48.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.171+0000 7f680944b640 1 -- start start 2023-11-04T01:47:48.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.171+0000 7f680944b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f680415d4e0 0x7f68040d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:48.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.171+0000 7f680944b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f68040d3b60 0x7f68040d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:48.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.171+0000 7f680944b640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68040b32b0 con 0x7f680415d100 2023-11-04T01:47:48.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.171+0000 7f680944b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68040cec20 con 0x7f680415d4e0 2023-11-04T01:47:48.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.171+0000 7f680944b640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68040cee10 con 0x7f68040d3b60 2023-11-04T01:47:48.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.172+0000 7f68027fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f680415d4e0 0x7f68040d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:48.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.172+0000 7f68027fc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f680415d4e0 0x7f68040d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57856/0 (socket says 172.21.15.77:57856) 2023-11-04T01:47:48.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.172+0000 7f68027fc640 1 -- 172.21.15.77:0/3156711499 learned_addr learned my addr 172.21.15.77:0/3156711499 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:48.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.172+0000 7f68037fe640 1 --2- 172.21.15.77:0/3156711499 >> v2:172.21.15.122:3300/0 conn(0x7f68040d3b60 0x7f68040d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:48.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.172+0000 7f68027fc640 1 -- 172.21.15.77:0/3156711499 >> v2:172.21.15.122:3300/0 conn(0x7f68040d3b60 msgr2=0x7f68040d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:48.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.172+0000 7f68027fc640 1 --2- 172.21.15.77:0/3156711499 >> v2:172.21.15.122:3300/0 conn(0x7f68040d3b60 0x7f68040d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:48.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.172+0000 7f68027fc640 1 -- 172.21.15.77:0/3156711499 >> v1:172.21.15.122:6789/0 conn(0x7f680415d100 legacy=0x7f68040ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:48.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.172+0000 7f68027fc640 1 -- 172.21.15.77:0/3156711499 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68040b4750 con 0x7f680415d4e0 2023-11-04T01:47:48.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.173+0000 7f68027fc640 1 --2- 172.21.15.77:0/3156711499 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f680415d4e0 0x7f68040d14d0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f680408d6a0 tx=0x7f67ec02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451e213565b505d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:48.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.173+0000 7f6801ffb640 1 -- 172.21.15.77:0/3156711499 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec030860 con 0x7f680415d4e0 2023-11-04T01:47:48.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.173+0000 7f6801ffb640 1 -- 172.21.15.77:0/3156711499 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ec0309c0 con 0x7f680415d4e0 2023-11-04T01:47:48.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.173+0000 7f6801ffb640 1 -- 172.21.15.77:0/3156711499 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec030d50 con 0x7f680415d4e0 2023-11-04T01:47:48.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.173+0000 7f680944b640 1 -- 172.21.15.77:0/3156711499 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f680415d4e0 msgr2=0x7f68040d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:48.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.173+0000 7f680944b640 1 --2- 172.21.15.77:0/3156711499 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f680415d4e0 0x7f68040d14d0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f680408d6a0 tx=0x7f67ec02b9a0 comp rx=0 tx=0).stop 2023-11-04T01:47:48.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.173+0000 7f680944b640 1 -- 172.21.15.77:0/3156711499 shutdown_connections 2023-11-04T01:47:48.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.173+0000 7f680944b640 1 --2- 172.21.15.77:0/3156711499 >> v2:172.21.15.122:3300/0 conn(0x7f68040d3b60 0x7f68040d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:48.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.173+0000 7f680944b640 1 --2- 172.21.15.77:0/3156711499 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f680415d4e0 0x7f68040d14d0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:48.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.173+0000 7f680944b640 1 -- 172.21.15.77:0/3156711499 >> 172.21.15.77:0/3156711499 conn(0x7f68040d2ef0 msgr2=0x7f68040d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:48.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.173+0000 7f680944b640 1 -- 172.21.15.77:0/3156711499 shutdown_connections 2023-11-04T01:47:48.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.173+0000 7f680944b640 1 -- 172.21.15.77:0/3156711499 wait complete. 2023-11-04T01:47:48.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.175+0000 7f680944b640 1 Processor -- start 2023-11-04T01:47:48.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.175+0000 7f680944b640 1 -- start start 2023-11-04T01:47:48.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.175+0000 7f680944b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68040d3b60 0x7f680414f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:48.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.175+0000 7f680944b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f680415d100 0x7f680415fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:48.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.175+0000 7f680944b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f680415d4e0 0x7f68040b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:48.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.175+0000 7f680944b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680414f890 con 0x7f680415d4e0 2023-11-04T01:47:48.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.175+0000 7f680944b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68040b6520 con 0x7f68040d3b60 2023-11-04T01:47:48.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.175+0000 7f680944b640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68040b6800 con 0x7f680415d100 2023-11-04T01:47:48.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.176+0000 7f68037fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f680415d4e0 0x7f68040b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:48.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.176+0000 7f68037fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f680415d4e0 0x7f68040b78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57872/0 (socket says 172.21.15.77:57872) 2023-11-04T01:47:48.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.176+0000 7f68037fe640 1 -- 172.21.15.77:0/3747422055 learned_addr learned my addr 172.21.15.77:0/3747422055 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:48.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.176+0000 7f6802ffd640 1 --2- 172.21.15.77:0/3747422055 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68040d3b60 0x7f680414f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:48.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.176+0000 7f68027fc640 1 --2- 172.21.15.77:0/3747422055 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f680415d100 0x7f680415fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:48.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.176+0000 7f68037fe640 1 -- 172.21.15.77:0/3747422055 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f680415d100 msgr2=0x7f680415fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:48.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.176+0000 7f68037fe640 1 --2- 172.21.15.77:0/3747422055 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f680415d100 0x7f680415fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:48.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.176+0000 7f68037fe640 1 -- 172.21.15.77:0/3747422055 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68040d3b60 msgr2=0x7f680414f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:48.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.176+0000 7f68037fe640 1 --2- 172.21.15.77:0/3747422055 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68040d3b60 0x7f680414f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:48.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.176+0000 7f68037fe640 1 -- 172.21.15.77:0/3747422055 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67ec0094d0 con 0x7f680415d4e0 2023-11-04T01:47:48.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.176+0000 7f68037fe640 1 --2- 172.21.15.77:0/3747422055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f680415d4e0 0x7f68040b78d0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f67fc00d800 tx=0x7f67fc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:48.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.176+0000 7f67fb7fe640 1 -- 172.21.15.77:0/3747422055 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc00b6c0 con 0x7f680415d4e0 2023-11-04T01:47:48.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.176+0000 7f67fb7fe640 1 -- 172.21.15.77:0/3747422055 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67fc00b840 con 0x7f680415d4e0 2023-11-04T01:47:48.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.176+0000 7f680944b640 1 -- 172.21.15.77:0/3747422055 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68040b6ae0 con 0x7f680415d4e0 2023-11-04T01:47:48.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.176+0000 7f67fb7fe640 1 -- 172.21.15.77:0/3747422055 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc00bbf0 con 0x7f680415d4e0 2023-11-04T01:47:48.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.176+0000 7f680944b640 1 -- 172.21.15.77:0/3747422055 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6804160360 con 0x7f680415d4e0 2023-11-04T01:47:48.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.177+0000 7f680944b640 1 -- 172.21.15.77:0/3747422055 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68040684b0 con 0x7f680415d4e0 2023-11-04T01:47:48.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.177+0000 7f67fb7fe640 1 -- 172.21.15.77:0/3747422055 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f67fc00bd50 con 0x7f680415d4e0 2023-11-04T01:47:48.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.178+0000 7f67fb7fe640 1 --2- 172.21.15.77:0/3747422055 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f67e406ae70 0x7f67e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:48.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.178+0000 7f67fb7fe640 1 -- 172.21.15.77:0/3747422055 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f67fc08a2b0 con 0x7f680415d4e0 2023-11-04T01:47:48.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.178+0000 7f6802ffd640 1 --2- 172.21.15.77:0/3747422055 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f67e406ae70 0x7f67e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:48.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.178+0000 7f6802ffd640 1 --2- 172.21.15.77:0/3747422055 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f67e406ae70 0x7f67e406d330 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f67f4001330 tx=0x7f67f4009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:48.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.182+0000 7f67fb7fe640 1 -- 172.21.15.77:0/3747422055 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f67fc054b00 con 0x7f680415d4e0 2023-11-04T01:47:48.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.382+0000 7f680944b640 1 -- 172.21.15.77:0/3747422055 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68040d2cd0 con 0x7f680415d4e0 2023-11-04T01:47:48.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.382+0000 7f67fb7fe640 1 -- 172.21.15.77:0/3747422055 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+4943 (secure 0 0 0) 0x7f67fc058120 con 0x7f680415d4e0 2023-11-04T01:47:48.384 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:47:48.384 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":116,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2985885329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2985885329},{"type":"v1","addr":"172.21.15.77:6835","nonce":2985885329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:47:39.684056+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7033,"mds_1":8583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7033":{"gid":7033,"name":"b","rank":0,"incarnation":109,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6836/2238841748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2238841748},{"type":"v1","addr":"172.21.15.122:6836","nonce":2238841748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8583":{"gid":8583,"name":"c","rank":1,"incarnation":112,"state":"up:active","state_seq":7,"addr":"172.21.15.77:6833/1157837717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1157837717},{"type":"v1","addr":"172.21.15.77:6833","nonce":1157837717}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:48.385 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 116 2023-11-04T01:47:48.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.384+0000 7f680944b640 1 -- 172.21.15.77:0/3747422055 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f67e406ae70 msgr2=0x7f67e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:48.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.384+0000 7f680944b640 1 --2- 172.21.15.77:0/3747422055 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f67e406ae70 0x7f67e406d330 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f67f4001330 tx=0x7f67f4009040 comp rx=0 tx=0).stop 2023-11-04T01:47:48.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.384+0000 7f680944b640 1 -- 172.21.15.77:0/3747422055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f680415d4e0 msgr2=0x7f68040b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:48.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.384+0000 7f680944b640 1 --2- 172.21.15.77:0/3747422055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f680415d4e0 0x7f68040b78d0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f67fc00d800 tx=0x7f67fc00dcc0 comp rx=0 tx=0).stop 2023-11-04T01:47:48.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.384+0000 7f680944b640 1 -- 172.21.15.77:0/3747422055 shutdown_connections 2023-11-04T01:47:48.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.384+0000 7f680944b640 1 --2- 172.21.15.77:0/3747422055 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f67e406ae70 0x7f67e406d330 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:48.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.384+0000 7f680944b640 1 --2- 172.21.15.77:0/3747422055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f680415d4e0 0x7f68040b78d0 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:48.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.384+0000 7f680944b640 1 --2- 172.21.15.77:0/3747422055 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f680415d100 0x7f680415fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:48.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.384+0000 7f680944b640 1 --2- 172.21.15.77:0/3747422055 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68040d3b60 0x7f680414f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:48.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.384+0000 7f680944b640 1 -- 172.21.15.77:0/3747422055 >> 172.21.15.77:0/3747422055 conn(0x7f68040d2ef0 msgr2=0x7f68040cf1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:48.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.384+0000 7f680944b640 1 -- 172.21.15.77:0/3747422055 shutdown_connections 2023-11-04T01:47:48.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.384+0000 7f680944b640 1 -- 172.21.15.77:0/3747422055 wait complete. 2023-11-04T01:47:48.396 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:1 true 2023-11-04T01:47:48.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.497+0000 7f72e3383640 1 Processor -- start 2023-11-04T01:47:48.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.497+0000 7f72e3383640 1 -- start start 2023-11-04T01:47:48.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.498+0000 7f72e3383640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f72dc0ceda0 0x7f72dc15cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:48.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.498+0000 7f72e3383640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f72dc0b2210 0x7f72dc15d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:48.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.498+0000 7f72e3383640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f72dc0cf180 0x7f72dc0cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:48.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.498+0000 7f72e3383640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72dc0b1df0 con 0x7f72dc0cf180 2023-11-04T01:47:48.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.498+0000 7f72e3383640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72dc15d9a0 con 0x7f72dc0ceda0 2023-11-04T01:47:48.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.498+0000 7f72e3383640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc0b0150 con 0x7f72dc0b2210 2023-11-04T01:47:48.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.498+0000 7f72e1920640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f72dc0cf180 0x7f72dc0cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:48.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.498+0000 7f72e1920640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f72dc0cf180 0x7f72dc0cf610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57886/0 (socket says 172.21.15.77:57886) 2023-11-04T01:47:48.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.498+0000 7f72e1920640 1 -- 172.21.15.77:0/2446077468 learned_addr learned my addr 172.21.15.77:0/2446077468 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:48.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.499+0000 7f72e1920640 1 -- 172.21.15.77:0/2446077468 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f72dc0b2210 msgr2=0x7f72dc15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:48.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.499+0000 7f72e1920640 1 --2- 172.21.15.77:0/2446077468 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f72dc0b2210 0x7f72dc15d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:48.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.499+0000 7f72e111f640 1 --2- 172.21.15.77:0/2446077468 >> v2:172.21.15.122:3300/0 conn(0x7f72dc0ceda0 0x7f72dc15cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:48.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.499+0000 7f72e1920640 1 -- 172.21.15.77:0/2446077468 >> v2:172.21.15.122:3300/0 conn(0x7f72dc0ceda0 msgr2=0x7f72dc15cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:48.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.499+0000 7f72e1920640 1 --2- 172.21.15.77:0/2446077468 >> v2:172.21.15.122:3300/0 conn(0x7f72dc0ceda0 0x7f72dc15cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:48.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.499+0000 7f72e1920640 1 -- 172.21.15.77:0/2446077468 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72dc0b1170 con 0x7f72dc0cf180 2023-11-04T01:47:48.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.499+0000 7f72e1920640 1 --2- 172.21.15.77:0/2446077468 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72dc0cf180 0x7f72dc0cf610 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f72dc070130 tx=0x7f72d402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe75ef59e7ccb45 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:48.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.499+0000 7f72d3fff640 1 -- 172.21.15.77:0/2446077468 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d40317e0 con 0x7f72dc0cf180 2023-11-04T01:47:48.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.499+0000 7f72d3fff640 1 -- 172.21.15.77:0/2446077468 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d4031940 con 0x7f72dc0cf180 2023-11-04T01:47:48.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.499+0000 7f72d3fff640 1 -- 172.21.15.77:0/2446077468 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d4031cd0 con 0x7f72dc0cf180 2023-11-04T01:47:48.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.500+0000 7f72e3383640 1 -- 172.21.15.77:0/2446077468 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72dc0cf180 msgr2=0x7f72dc0cf610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:48.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.500+0000 7f72e3383640 1 --2- 172.21.15.77:0/2446077468 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72dc0cf180 0x7f72dc0cf610 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f72dc070130 tx=0x7f72d402b880 comp rx=0 tx=0).stop 2023-11-04T01:47:48.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.500+0000 7f72e3383640 1 -- 172.21.15.77:0/2446077468 shutdown_connections 2023-11-04T01:47:48.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.500+0000 7f72e3383640 1 --2- 172.21.15.77:0/2446077468 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72dc0cf180 0x7f72dc0cf610 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:48.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.500+0000 7f72e3383640 1 --2- 172.21.15.77:0/2446077468 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f72dc0b2210 0x7f72dc15d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:48.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.500+0000 7f72e3383640 1 --2- 172.21.15.77:0/2446077468 >> v2:172.21.15.122:3300/0 conn(0x7f72dc0ceda0 0x7f72dc15cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:48.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.500+0000 7f72e3383640 1 -- 172.21.15.77:0/2446077468 >> 172.21.15.77:0/2446077468 conn(0x7f72dc0d0c30 msgr2=0x7f72dc0d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:48.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.500+0000 7f72e3383640 1 -- 172.21.15.77:0/2446077468 shutdown_connections 2023-11-04T01:47:48.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.500+0000 7f72e3383640 1 -- 172.21.15.77:0/2446077468 wait complete. 2023-11-04T01:47:48.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.501+0000 7f72e3383640 1 Processor -- start 2023-11-04T01:47:48.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.501+0000 7f72e3383640 1 -- start start 2023-11-04T01:47:48.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.502+0000 7f72e3383640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f72dc0b2210 0x7f72dc1478a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:48.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.502+0000 7f72e3383640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72dc0ceda0 0x7f72dc0adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:48.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.502+0000 7f72e3383640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f72dc0cf180 0x7f72dc15db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:48.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.502+0000 7f72e3383640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc160710 con 0x7f72dc0ceda0 2023-11-04T01:47:48.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.502+0000 7f72e3383640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc15fde0 con 0x7f72dc0cf180 2023-11-04T01:47:48.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.502+0000 7f72e3383640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc1600c0 con 0x7f72dc0b2210 2023-11-04T01:47:48.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.502+0000 7f72e091e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72dc0ceda0 0x7f72dc0adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:48.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.502+0000 7f72e091e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72dc0ceda0 0x7f72dc0adfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57902/0 (socket says 172.21.15.77:57902) 2023-11-04T01:47:48.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.502+0000 7f72e091e640 1 -- 172.21.15.77:0/3792666270 learned_addr learned my addr 172.21.15.77:0/3792666270 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:48.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.502+0000 7f72e111f640 1 --2- 172.21.15.77:0/3792666270 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f72dc0b2210 0x7f72dc1478a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:48.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.502+0000 7f72e1920640 1 --2- 172.21.15.77:0/3792666270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f72dc0cf180 0x7f72dc15db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:48.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.502+0000 7f72e091e640 1 -- 172.21.15.77:0/3792666270 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f72dc0b2210 msgr2=0x7f72dc1478a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:48.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.502+0000 7f72e091e640 1 --2- 172.21.15.77:0/3792666270 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f72dc0b2210 0x7f72dc1478a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:48.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.502+0000 7f72e091e640 1 -- 172.21.15.77:0/3792666270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f72dc0cf180 msgr2=0x7f72dc15db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:48.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.502+0000 7f72e091e640 1 --2- 172.21.15.77:0/3792666270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f72dc0cf180 0x7f72dc15db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:48.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.502+0000 7f72e091e640 1 -- 172.21.15.77:0/3792666270 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d40094d0 con 0x7f72dc0ceda0 2023-11-04T01:47:48.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.503+0000 7f72e091e640 1 --2- 172.21.15.77:0/3792666270 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72dc0ceda0 0x7f72dc0adfe0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f72cc00b4a0 tx=0x7f72cc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:48.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.503+0000 7f72d1ffb640 1 -- 172.21.15.77:0/3792666270 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc010610 con 0x7f72dc0ceda0 2023-11-04T01:47:48.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.503+0000 7f72d1ffb640 1 -- 172.21.15.77:0/3792666270 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72cc010770 con 0x7f72dc0ceda0 2023-11-04T01:47:48.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.503+0000 7f72e3383640 1 -- 172.21.15.77:0/3792666270 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72dc1603a0 con 0x7f72dc0ceda0 2023-11-04T01:47:48.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.503+0000 7f72d1ffb640 1 -- 172.21.15.77:0/3792666270 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc010b20 con 0x7f72dc0ceda0 2023-11-04T01:47:48.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.503+0000 7f72e3383640 1 -- 172.21.15.77:0/3792666270 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72dc147de0 con 0x7f72dc0ceda0 2023-11-04T01:47:48.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.504+0000 7f72e3383640 1 -- 172.21.15.77:0/3792666270 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72dc160d80 con 0x7f72dc0ceda0 2023-11-04T01:47:48.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.504+0000 7f72d1ffb640 1 -- 172.21.15.77:0/3792666270 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f72cc010c80 con 0x7f72dc0ceda0 2023-11-04T01:47:48.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.505+0000 7f72d1ffb640 1 --2- 172.21.15.77:0/3792666270 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f72c006ae70 0x7f72c006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:48.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.505+0000 7f72d1ffb640 1 -- 172.21.15.77:0/3792666270 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f72cc089bb0 con 0x7f72dc0ceda0 2023-11-04T01:47:48.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.505+0000 7f72e111f640 1 --2- 172.21.15.77:0/3792666270 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f72c006ae70 0x7f72c006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:48.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.505+0000 7f72e111f640 1 --2- 172.21.15.77:0/3792666270 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f72c006ae70 0x7f72c006d330 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f72d80070b0 tx=0x7f72d8007040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:48.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.509+0000 7f72d1ffb640 1 -- 172.21.15.77:0/3792666270 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f72cc0542c0 con 0x7f72dc0ceda0 2023-11-04T01:47:48.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.739+0000 7f72e3383640 1 -- 172.21.15.77:0/3792666270 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"} v 0) v1 -- 0x7f72dc0684b0 con 0x7f72dc0ceda0 2023-11-04T01:47:48.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.814+0000 7f72d1ffb640 1 -- 172.21.15.77:0/3792666270 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"}]=0 freezing mds.8583 v117) v1 ==== 112+0+0 (secure 0 0 0) 0x7f72cc01e0a0 con 0x7f72dc0ceda0 2023-11-04T01:47:48.815 INFO:teuthology.orchestra.run.smithi077.stderr:freezing mds.8583 2023-11-04T01:47:48.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.815+0000 7f72e3383640 1 -- 172.21.15.77:0/3792666270 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f72c006ae70 msgr2=0x7f72c006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:48.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.816+0000 7f72e3383640 1 --2- 172.21.15.77:0/3792666270 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f72c006ae70 0x7f72c006d330 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f72d80070b0 tx=0x7f72d8007040 comp rx=0 tx=0).stop 2023-11-04T01:47:48.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.816+0000 7f72e3383640 1 -- 172.21.15.77:0/3792666270 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72dc0ceda0 msgr2=0x7f72dc0adfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:48.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.816+0000 7f72e3383640 1 --2- 172.21.15.77:0/3792666270 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72dc0ceda0 0x7f72dc0adfe0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f72cc00b4a0 tx=0x7f72cc00b960 comp rx=0 tx=0).stop 2023-11-04T01:47:48.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.816+0000 7f72e3383640 1 -- 172.21.15.77:0/3792666270 shutdown_connections 2023-11-04T01:47:48.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.816+0000 7f72e3383640 1 --2- 172.21.15.77:0/3792666270 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f72c006ae70 0x7f72c006d330 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:48.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.816+0000 7f72e3383640 1 --2- 172.21.15.77:0/3792666270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f72dc0cf180 0x7f72dc15db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:48.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.816+0000 7f72e3383640 1 --2- 172.21.15.77:0/3792666270 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72dc0ceda0 0x7f72dc0adfe0 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:48.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.816+0000 7f72e3383640 1 --2- 172.21.15.77:0/3792666270 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f72dc0b2210 0x7f72dc1478a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:48.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.816+0000 7f72e3383640 1 -- 172.21.15.77:0/3792666270 >> 172.21.15.77:0/3792666270 conn(0x7f72dc0d0c30 msgr2=0x7f72dc1e5cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:48.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.816+0000 7f72e3383640 1 -- 172.21.15.77:0/3792666270 shutdown_connections 2023-11-04T01:47:48.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:48.816+0000 7f72e3383640 1 -- 172.21.15.77:0/3792666270 wait complete. 2023-11-04T01:47:48.828 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_kill_mdstable_at 3 2023-11-04T01:47:48.939 INFO:teuthology.orchestra.run.smithi077.stdout:{"success":"mds_kill_mdstable_at = '3' (not observed, change may require restart) "} 2023-11-04T01:47:48.940 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '3' (not observed, change may require restart) " } 2023-11-04T01:47:48.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:48.941 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s33) 2023-11-04T01:47:48.944 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:47:48.960 INFO:tasks.ceph.mds.c.smithi077.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableClient.cc: In function 'void MDSTableClient::handle_request(ceph::cref_t&)' thread 7fe62f9e9640 time 2023-11-04T01:47:48.959857+0000 2023-11-04T01:47:48.960 INFO:tasks.ceph.mds.c.smithi077.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableClient.cc: 76: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 3) 2023-11-04T01:47:48.961 INFO:tasks.ceph.mds.c.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:48.961 INFO:tasks.ceph.mds.c.smithi077.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe63556efaf] 2023-11-04T01:47:48.962 INFO:tasks.ceph.mds.c.smithi077.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fe63556f16d] 2023-11-04T01:47:48.962 INFO:tasks.ceph.mds.c.smithi077.stderr: 3: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x1187) [0x55e54d5b11b7] 2023-11-04T01:47:48.962 INFO:tasks.ceph.mds.c.smithi077.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd55) [0x55e54d33ed15] 2023-11-04T01:47:48.962 INFO:tasks.ceph.mds.c.smithi077.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55e54d340b2b] 2023-11-04T01:47:48.963 INFO:tasks.ceph.mds.c.smithi077.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e54d34101c] 2023-11-04T01:47:48.963 INFO:tasks.ceph.mds.c.smithi077.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55e54d32a325] 2023-11-04T01:47:48.963 INFO:tasks.ceph.mds.c.smithi077.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7fe63575ff9a] 2023-11-04T01:47:48.963 INFO:tasks.ceph.mds.c.smithi077.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7fe6357f1741] 2023-11-04T01:47:48.963 INFO:tasks.ceph.mds.c.smithi077.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7fe634c9f802] 2023-11-04T01:47:48.963 INFO:tasks.ceph.mds.c.smithi077.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7fe634c3f450] 2023-11-04T01:47:48.964 INFO:tasks.ceph.mds.c.smithi077.stderr:2023-11-04T01:47:48.959+0000 7fe62f9e9640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableClient.cc: In function 'void MDSTableClient::handle_request(ceph::cref_t&)' thread 7fe62f9e9640 time 2023-11-04T01:47:48.959857+0000 2023-11-04T01:47:48.964 INFO:tasks.ceph.mds.c.smithi077.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableClient.cc: 76: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 3) 2023-11-04T01:47:48.964 INFO:tasks.ceph.mds.c.smithi077.stderr: 2023-11-04T01:47:48.964 INFO:tasks.ceph.mds.c.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:48.964 INFO:tasks.ceph.mds.c.smithi077.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe63556efaf] 2023-11-04T01:47:48.965 INFO:tasks.ceph.mds.c.smithi077.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fe63556f16d] 2023-11-04T01:47:48.965 INFO:tasks.ceph.mds.c.smithi077.stderr: 3: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x1187) [0x55e54d5b11b7] 2023-11-04T01:47:48.965 INFO:tasks.ceph.mds.c.smithi077.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd55) [0x55e54d33ed15] 2023-11-04T01:47:48.965 INFO:tasks.ceph.mds.c.smithi077.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55e54d340b2b] 2023-11-04T01:47:48.965 INFO:tasks.ceph.mds.c.smithi077.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e54d34101c] 2023-11-04T01:47:48.966 INFO:tasks.ceph.mds.c.smithi077.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55e54d32a325] 2023-11-04T01:47:48.966 INFO:tasks.ceph.mds.c.smithi077.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7fe63575ff9a] 2023-11-04T01:47:48.966 INFO:tasks.ceph.mds.c.smithi077.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7fe6357f1741] 2023-11-04T01:47:48.966 INFO:tasks.ceph.mds.c.smithi077.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7fe634c9f802] 2023-11-04T01:47:48.966 INFO:tasks.ceph.mds.c.smithi077.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7fe634c3f450] 2023-11-04T01:47:48.967 INFO:tasks.ceph.mds.c.smithi077.stderr: 2023-11-04T01:47:48.967 INFO:tasks.ceph.mds.c.smithi077.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:47:48.967 INFO:tasks.ceph.mds.c.smithi077.stderr: in thread 7fe62f9e9640 thread_name:ms_dispatch 2023-11-04T01:47:48.967 INFO:tasks.ceph.mds.c.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:48.967 INFO:tasks.ceph.mds.c.smithi077.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fe634c54db0] 2023-11-04T01:47:48.968 INFO:tasks.ceph.mds.c.smithi077.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fe634ca154c] 2023-11-04T01:47:48.968 INFO:tasks.ceph.mds.c.smithi077.stderr: 3: raise() 2023-11-04T01:47:48.968 INFO:tasks.ceph.mds.c.smithi077.stderr: 4: abort() 2023-11-04T01:47:48.968 INFO:tasks.ceph.mds.c.smithi077.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe63556f009] 2023-11-04T01:47:48.968 INFO:tasks.ceph.mds.c.smithi077.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fe63556f16d] 2023-11-04T01:47:48.968 INFO:tasks.ceph.mds.c.smithi077.stderr: 7: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x1187) [0x55e54d5b11b7] 2023-11-04T01:47:48.969 INFO:tasks.ceph.mds.c.smithi077.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd55) [0x55e54d33ed15] 2023-11-04T01:47:48.969 INFO:tasks.ceph.mds.c.smithi077.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55e54d340b2b] 2023-11-04T01:47:48.969 INFO:tasks.ceph.mds.c.smithi077.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e54d34101c] 2023-11-04T01:47:48.969 INFO:tasks.ceph.mds.c.smithi077.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55e54d32a325] 2023-11-04T01:47:48.969 INFO:tasks.ceph.mds.c.smithi077.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7fe63575ff9a] 2023-11-04T01:47:48.970 INFO:tasks.ceph.mds.c.smithi077.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7fe6357f1741] 2023-11-04T01:47:48.970 INFO:tasks.ceph.mds.c.smithi077.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7fe634c9f802] 2023-11-04T01:47:48.970 INFO:tasks.ceph.mds.c.smithi077.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7fe634c3f450] 2023-11-04T01:47:48.970 INFO:tasks.ceph.mds.c.smithi077.stderr:2023-11-04T01:47:48.960+0000 7fe62f9e9640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:47:48.970 INFO:tasks.ceph.mds.c.smithi077.stderr: in thread 7fe62f9e9640 thread_name:ms_dispatch 2023-11-04T01:47:48.971 INFO:tasks.ceph.mds.c.smithi077.stderr: 2023-11-04T01:47:48.971 INFO:tasks.ceph.mds.c.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:48.971 INFO:tasks.ceph.mds.c.smithi077.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fe634c54db0] 2023-11-04T01:47:48.971 INFO:tasks.ceph.mds.c.smithi077.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fe634ca154c] 2023-11-04T01:47:48.971 INFO:tasks.ceph.mds.c.smithi077.stderr: 3: raise() 2023-11-04T01:47:48.972 INFO:tasks.ceph.mds.c.smithi077.stderr: 4: abort() 2023-11-04T01:47:48.972 INFO:tasks.ceph.mds.c.smithi077.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe63556f009] 2023-11-04T01:47:48.972 INFO:tasks.ceph.mds.c.smithi077.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fe63556f16d] 2023-11-04T01:47:48.972 INFO:tasks.ceph.mds.c.smithi077.stderr: 7: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x1187) [0x55e54d5b11b7] 2023-11-04T01:47:48.972 INFO:tasks.ceph.mds.c.smithi077.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd55) [0x55e54d33ed15] 2023-11-04T01:47:48.973 INFO:tasks.ceph.mds.c.smithi077.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55e54d340b2b] 2023-11-04T01:47:48.973 INFO:tasks.ceph.mds.c.smithi077.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e54d34101c] 2023-11-04T01:47:48.973 INFO:tasks.ceph.mds.c.smithi077.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55e54d32a325] 2023-11-04T01:47:48.973 INFO:tasks.ceph.mds.c.smithi077.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7fe63575ff9a] 2023-11-04T01:47:48.973 INFO:tasks.ceph.mds.c.smithi077.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7fe6357f1741] 2023-11-04T01:47:48.973 INFO:tasks.ceph.mds.c.smithi077.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7fe634c9f802] 2023-11-04T01:47:48.974 INFO:tasks.ceph.mds.c.smithi077.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7fe634c3f450] 2023-11-04T01:47:48.974 INFO:tasks.ceph.mds.c.smithi077.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:47:48.974 INFO:tasks.ceph.mds.c.smithi077.stderr: 2023-11-04T01:47:48.975 INFO:tasks.ceph.mds.c.smithi077.stderr: -1> 2023-11-04T01:47:48.959+0000 7fe62f9e9640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableClient.cc: In function 'void MDSTableClient::handle_request(ceph::cref_t&)' thread 7fe62f9e9640 time 2023-11-04T01:47:48.959857+0000 2023-11-04T01:47:48.975 INFO:tasks.ceph.mds.c.smithi077.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableClient.cc: 76: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 3) 2023-11-04T01:47:48.975 INFO:tasks.ceph.mds.c.smithi077.stderr: 2023-11-04T01:47:48.975 INFO:tasks.ceph.mds.c.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:48.976 INFO:tasks.ceph.mds.c.smithi077.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe63556efaf] 2023-11-04T01:47:48.976 INFO:tasks.ceph.mds.c.smithi077.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fe63556f16d] 2023-11-04T01:47:48.976 INFO:tasks.ceph.mds.c.smithi077.stderr: 3: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x1187) [0x55e54d5b11b7] 2023-11-04T01:47:48.976 INFO:tasks.ceph.mds.c.smithi077.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd55) [0x55e54d33ed15] 2023-11-04T01:47:48.976 INFO:tasks.ceph.mds.c.smithi077.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55e54d340b2b] 2023-11-04T01:47:48.977 INFO:tasks.ceph.mds.c.smithi077.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e54d34101c] 2023-11-04T01:47:48.977 INFO:tasks.ceph.mds.c.smithi077.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55e54d32a325] 2023-11-04T01:47:48.977 INFO:tasks.ceph.mds.c.smithi077.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7fe63575ff9a] 2023-11-04T01:47:48.977 INFO:tasks.ceph.mds.c.smithi077.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7fe6357f1741] 2023-11-04T01:47:48.977 INFO:tasks.ceph.mds.c.smithi077.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7fe634c9f802] 2023-11-04T01:47:48.978 INFO:tasks.ceph.mds.c.smithi077.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7fe634c3f450] 2023-11-04T01:47:48.978 INFO:tasks.ceph.mds.c.smithi077.stderr: 2023-11-04T01:47:48.978 INFO:tasks.ceph.mds.c.smithi077.stderr: 0> 2023-11-04T01:47:48.960+0000 7fe62f9e9640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:47:48.978 INFO:tasks.ceph.mds.c.smithi077.stderr: in thread 7fe62f9e9640 thread_name:ms_dispatch 2023-11-04T01:47:48.978 INFO:tasks.ceph.mds.c.smithi077.stderr: 2023-11-04T01:47:48.979 INFO:tasks.ceph.mds.c.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:48.979 INFO:tasks.ceph.mds.c.smithi077.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fe634c54db0] 2023-11-04T01:47:48.979 INFO:tasks.ceph.mds.c.smithi077.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fe634ca154c] 2023-11-04T01:47:48.979 INFO:tasks.ceph.mds.c.smithi077.stderr: 3: raise() 2023-11-04T01:47:48.979 INFO:tasks.ceph.mds.c.smithi077.stderr: 4: abort() 2023-11-04T01:47:48.979 INFO:tasks.ceph.mds.c.smithi077.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe63556f009] 2023-11-04T01:47:48.980 INFO:tasks.ceph.mds.c.smithi077.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fe63556f16d] 2023-11-04T01:47:48.980 INFO:tasks.ceph.mds.c.smithi077.stderr: 7: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x1187) [0x55e54d5b11b7] 2023-11-04T01:47:48.980 INFO:tasks.ceph.mds.c.smithi077.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd55) [0x55e54d33ed15] 2023-11-04T01:47:48.980 INFO:tasks.ceph.mds.c.smithi077.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55e54d340b2b] 2023-11-04T01:47:48.980 INFO:tasks.ceph.mds.c.smithi077.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e54d34101c] 2023-11-04T01:47:48.981 INFO:tasks.ceph.mds.c.smithi077.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55e54d32a325] 2023-11-04T01:47:48.981 INFO:tasks.ceph.mds.c.smithi077.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7fe63575ff9a] 2023-11-04T01:47:48.981 INFO:tasks.ceph.mds.c.smithi077.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7fe6357f1741] 2023-11-04T01:47:48.981 INFO:tasks.ceph.mds.c.smithi077.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7fe634c9f802] 2023-11-04T01:47:48.981 INFO:tasks.ceph.mds.c.smithi077.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7fe634c3f450] 2023-11-04T01:47:48.982 INFO:tasks.ceph.mds.c.smithi077.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:47:48.982 INFO:tasks.ceph.mds.c.smithi077.stderr: 2023-11-04T01:47:48.982 INFO:tasks.ceph.mds.c.smithi077.stderr: -1> 2023-11-04T01:47:48.959+0000 7fe62f9e9640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableClient.cc: In function 'void MDSTableClient::handle_request(ceph::cref_t&)' thread 7fe62f9e9640 time 2023-11-04T01:47:48.959857+0000 2023-11-04T01:47:48.982 INFO:tasks.ceph.mds.c.smithi077.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7035-g7532011a/rpm/el9/BUILD/ceph-18.0.0-7035-g7532011a/src/mds/MDSTableClient.cc: 76: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 3) 2023-11-04T01:47:48.982 INFO:tasks.ceph.mds.c.smithi077.stderr: 2023-11-04T01:47:48.983 INFO:tasks.ceph.mds.c.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:48.983 INFO:tasks.ceph.mds.c.smithi077.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe63556efaf] 2023-11-04T01:47:48.983 INFO:tasks.ceph.mds.c.smithi077.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fe63556f16d] 2023-11-04T01:47:48.983 INFO:tasks.ceph.mds.c.smithi077.stderr: 3: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x1187) [0x55e54d5b11b7] 2023-11-04T01:47:48.983 INFO:tasks.ceph.mds.c.smithi077.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd55) [0x55e54d33ed15] 2023-11-04T01:47:48.984 INFO:tasks.ceph.mds.c.smithi077.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55e54d340b2b] 2023-11-04T01:47:48.984 INFO:tasks.ceph.mds.c.smithi077.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e54d34101c] 2023-11-04T01:47:48.984 INFO:tasks.ceph.mds.c.smithi077.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55e54d32a325] 2023-11-04T01:47:48.984 INFO:tasks.ceph.mds.c.smithi077.stderr: 8: (DispatchQueue::entry()+0x53a) [0x7fe63575ff9a] 2023-11-04T01:47:48.984 INFO:tasks.ceph.mds.c.smithi077.stderr: 9: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7fe6357f1741] 2023-11-04T01:47:48.984 INFO:tasks.ceph.mds.c.smithi077.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7fe634c9f802] 2023-11-04T01:47:48.985 INFO:tasks.ceph.mds.c.smithi077.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7fe634c3f450] 2023-11-04T01:47:48.985 INFO:tasks.ceph.mds.c.smithi077.stderr: 2023-11-04T01:47:48.985 INFO:tasks.ceph.mds.c.smithi077.stderr: 0> 2023-11-04T01:47:48.960+0000 7fe62f9e9640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:47:48.985 INFO:tasks.ceph.mds.c.smithi077.stderr: in thread 7fe62f9e9640 thread_name:ms_dispatch 2023-11-04T01:47:48.985 INFO:tasks.ceph.mds.c.smithi077.stderr: 2023-11-04T01:47:48.986 INFO:tasks.ceph.mds.c.smithi077.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:48.986 INFO:tasks.ceph.mds.c.smithi077.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fe634c54db0] 2023-11-04T01:47:48.986 INFO:tasks.ceph.mds.c.smithi077.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fe634ca154c] 2023-11-04T01:47:48.986 INFO:tasks.ceph.mds.c.smithi077.stderr: 3: raise() 2023-11-04T01:47:48.986 INFO:tasks.ceph.mds.c.smithi077.stderr: 4: abort() 2023-11-04T01:47:48.987 INFO:tasks.ceph.mds.c.smithi077.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe63556f009] 2023-11-04T01:47:48.987 INFO:tasks.ceph.mds.c.smithi077.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f16d) [0x7fe63556f16d] 2023-11-04T01:47:48.987 INFO:tasks.ceph.mds.c.smithi077.stderr: 7: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x1187) [0x55e54d5b11b7] 2023-11-04T01:47:48.987 INFO:tasks.ceph.mds.c.smithi077.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd55) [0x55e54d33ed15] 2023-11-04T01:47:48.987 INFO:tasks.ceph.mds.c.smithi077.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4eb) [0x55e54d340b2b] 2023-11-04T01:47:48.988 INFO:tasks.ceph.mds.c.smithi077.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e54d34101c] 2023-11-04T01:47:48.988 INFO:tasks.ceph.mds.c.smithi077.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55e54d32a325] 2023-11-04T01:47:48.988 INFO:tasks.ceph.mds.c.smithi077.stderr: 12: (DispatchQueue::entry()+0x53a) [0x7fe63575ff9a] 2023-11-04T01:47:48.988 INFO:tasks.ceph.mds.c.smithi077.stderr: 13: /usr/lib64/ceph/libceph-common.so.2(+0x3f1741) [0x7fe6357f1741] 2023-11-04T01:47:48.988 INFO:tasks.ceph.mds.c.smithi077.stderr: 14: /lib64/libc.so.6(+0x9f802) [0x7fe634c9f802] 2023-11-04T01:47:48.989 INFO:tasks.ceph.mds.c.smithi077.stderr: 15: /lib64/libc.so.6(+0x3f450) [0x7fe634c3f450] 2023-11-04T01:47:48.989 INFO:tasks.ceph.mds.c.smithi077.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:47:48.989 INFO:tasks.ceph.mds.c.smithi077.stderr: 2023-11-04T01:47:49.065 INFO:teuthology.orchestra.run.smithi077.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:47:49.066 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:47:49.066 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:49.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.203+0000 7f39b1bfc640 1 Processor -- start 2023-11-04T01:47:49.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.203+0000 7f39b1bfc640 1 -- start start 2023-11-04T01:47:49.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.204+0000 7f39b1bfc640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39ac0addd0 0x7f39ac0cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:49.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.204+0000 7f39b1bfc640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f39ac06c220 0x7f39ac0ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:49.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.204+0000 7f39b1bfc640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39ac0cd720 con 0x7f39ac0cc680 2023-11-04T01:47:49.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.204+0000 7f39b1bfc640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39ac0ae1b0 con 0x7f39ac06c220 2023-11-04T01:47:49.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.204+0000 7f39b1bfc640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac0ccb10 con 0x7f39ac0addd0 2023-11-04T01:47:49.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.204+0000 7f39ab7fe640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39ac0addd0 0x7f39ac0cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:49.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.204+0000 7f39abfff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f39ac06c220 0x7f39ac0ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:49.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.204+0000 7f39aaffd640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f39ac0cc680 0x7f39ac06bb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:47328/0 (socket says 172.21.15.77:47328) 2023-11-04T01:47:49.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.204+0000 7f39aaffd640 1 -- 172.21.15.77:0/3971756683 learned_addr learned my addr 172.21.15.77:0/3971756683 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:47:49.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.204+0000 7f39abfff640 1 -- 172.21.15.77:0/3971756683 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39ac0addd0 msgr2=0x7f39ac0cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:49.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.204+0000 7f39abfff640 1 --2- 172.21.15.77:0/3971756683 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39ac0addd0 0x7f39ac0cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:49.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.204+0000 7f39abfff640 1 -- 172.21.15.77:0/3971756683 >> v1:172.21.15.122:6789/0 conn(0x7f39ac0cc680 legacy=0x7f39ac06bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:49.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.204+0000 7f39abfff640 1 -- 172.21.15.77:0/3971756683 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ac0ccdf0 con 0x7f39ac06c220 2023-11-04T01:47:49.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.205+0000 7f39ab7fe640 1 --2- 172.21.15.77:0/3971756683 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39ac0addd0 0x7f39ac0cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:47:49.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.205+0000 7f39abfff640 1 --2- 172.21.15.77:0/3971756683 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39ac06c220 0x7f39ac0ca2d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f39a4009d90 tx=0x7f39a402bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f4794d9abddfd59 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:49.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.205+0000 7f39aa7fc640 1 -- 172.21.15.77:0/3971756683 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a402cc50 con 0x7f39ac06c220 2023-11-04T01:47:49.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.206+0000 7f39aa7fc640 1 -- 172.21.15.77:0/3971756683 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a402cdb0 con 0x7f39ac06c220 2023-11-04T01:47:49.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.206+0000 7f39aa7fc640 1 -- 172.21.15.77:0/3971756683 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a4034660 con 0x7f39ac06c220 2023-11-04T01:47:49.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.206+0000 7f39b1bfc640 1 -- 172.21.15.77:0/3971756683 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39ac06c220 msgr2=0x7f39ac0ca2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:49.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.206+0000 7f39b1bfc640 1 --2- 172.21.15.77:0/3971756683 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39ac06c220 0x7f39ac0ca2d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f39a4009d90 tx=0x7f39a402bea0 comp rx=0 tx=0).stop 2023-11-04T01:47:49.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.206+0000 7f39b1bfc640 1 -- 172.21.15.77:0/3971756683 shutdown_connections 2023-11-04T01:47:49.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.206+0000 7f39b1bfc640 1 --2- 172.21.15.77:0/3971756683 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39ac06c220 0x7f39ac0ca2d0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:49.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.206+0000 7f39b1bfc640 1 --2- 172.21.15.77:0/3971756683 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39ac0addd0 0x7f39ac0cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:49.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.206+0000 7f39b1bfc640 1 -- 172.21.15.77:0/3971756683 >> 172.21.15.77:0/3971756683 conn(0x7f39ac0cb530 msgr2=0x7f39ac0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:49.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.206+0000 7f39b1bfc640 1 -- 172.21.15.77:0/3971756683 shutdown_connections 2023-11-04T01:47:49.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.206+0000 7f39b1bfc640 1 -- 172.21.15.77:0/3971756683 wait complete. 2023-11-04T01:47:49.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.207+0000 7f39b1bfc640 1 Processor -- start 2023-11-04T01:47:49.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.207+0000 7f39b1bfc640 1 -- start start 2023-11-04T01:47:49.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.208+0000 7f39b1bfc640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39ac06c220 0x7f39ac14dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:49.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.208+0000 7f39b1bfc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39ac0addd0 0x7f39ac0b3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:49.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.208+0000 7f39b1bfc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39ac0b39b0 0x7f39ac0c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:49.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.208+0000 7f39b1bfc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac1527f0 con 0x7f39ac0b39b0 2023-11-04T01:47:49.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.208+0000 7f39b1bfc640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac0c7a30 con 0x7f39ac0addd0 2023-11-04T01:47:49.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.208+0000 7f39b1bfc640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac0c6c70 con 0x7f39ac06c220 2023-11-04T01:47:49.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.208+0000 7f39abfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39ac0b39b0 0x7f39ac0c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:49.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.208+0000 7f39abfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39ac0b39b0 0x7f39ac0c47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57914/0 (socket says 172.21.15.77:57914) 2023-11-04T01:47:49.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.208+0000 7f39abfff640 1 -- 172.21.15.77:0/3494558930 learned_addr learned my addr 172.21.15.77:0/3494558930 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:49.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.208+0000 7f39ab7fe640 1 --2- 172.21.15.77:0/3494558930 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39ac06c220 0x7f39ac14dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:49.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.208+0000 7f39aaffd640 1 --2- 172.21.15.77:0/3494558930 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39ac0addd0 0x7f39ac0b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:49.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.209+0000 7f39abfff640 1 -- 172.21.15.77:0/3494558930 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39ac06c220 msgr2=0x7f39ac14dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:49.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.209+0000 7f39abfff640 1 --2- 172.21.15.77:0/3494558930 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39ac06c220 0x7f39ac14dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:49.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.209+0000 7f39abfff640 1 -- 172.21.15.77:0/3494558930 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39ac0addd0 msgr2=0x7f39ac0b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:49.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.209+0000 7f39abfff640 1 --2- 172.21.15.77:0/3494558930 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39ac0addd0 0x7f39ac0b3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:49.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.209+0000 7f39abfff640 1 -- 172.21.15.77:0/3494558930 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399c00a5a0 con 0x7f39ac0b39b0 2023-11-04T01:47:49.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.209+0000 7f39aaffd640 1 --2- 172.21.15.77:0/3494558930 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39ac0addd0 0x7f39ac0b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:49.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.209+0000 7f39abfff640 1 --2- 172.21.15.77:0/3494558930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39ac0b39b0 0x7f39ac0c47b0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f39a4009d90 tx=0x7f39a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:49.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.209+0000 7f3993fff640 1 -- 172.21.15.77:0/3494558930 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a4040650 con 0x7f39ac0b39b0 2023-11-04T01:47:49.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.209+0000 7f3993fff640 1 -- 172.21.15.77:0/3494558930 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a40407b0 con 0x7f39ac0b39b0 2023-11-04T01:47:49.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.209+0000 7f39b1bfc640 1 -- 172.21.15.77:0/3494558930 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39a4009a70 con 0x7f39ac0b39b0 2023-11-04T01:47:49.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.209+0000 7f3993fff640 1 -- 172.21.15.77:0/3494558930 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a4040b60 con 0x7f39ac0b39b0 2023-11-04T01:47:49.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.209+0000 7f39b1bfc640 1 -- 172.21.15.77:0/3494558930 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39ac0c7230 con 0x7f39ac0b39b0 2023-11-04T01:47:49.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.210+0000 7f39b1bfc640 1 -- 172.21.15.77:0/3494558930 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39ac0684b0 con 0x7f39ac0b39b0 2023-11-04T01:47:49.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.210+0000 7f3993fff640 1 -- 172.21.15.77:0/3494558930 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f39a4040cc0 con 0x7f39ac0b39b0 2023-11-04T01:47:49.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.211+0000 7f3993fff640 1 --2- 172.21.15.77:0/3494558930 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f399806ae70 0x7f399806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:49.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.211+0000 7f3993fff640 1 -- 172.21.15.77:0/3494558930 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8167+0+0 (secure 0 0 0) 0x7f39a40acd30 con 0x7f39ac0b39b0 2023-11-04T01:47:49.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.211+0000 7f39ab7fe640 1 --2- 172.21.15.77:0/3494558930 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f399806ae70 0x7f399806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:49.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.211+0000 7f39ab7fe640 1 --2- 172.21.15.77:0/3494558930 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f399806ae70 0x7f399806d330 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f39ac1555f0 tx=0x7f399c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:49.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.215+0000 7f3993fff640 1 -- 172.21.15.77:0/3494558930 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f39a4077440 con 0x7f39ac0b39b0 2023-11-04T01:47:49.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.416+0000 7f39b1bfc640 1 -- 172.21.15.77:0/3494558930 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39ac073670 con 0x7f39ac0b39b0 2023-11-04T01:47:49.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.417+0000 7f3993fff640 1 -- 172.21.15.77:0/3494558930 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) v1 ==== 95+0+4943 (secure 0 0 0) 0x7f39a4009450 con 0x7f39ac0b39b0 2023-11-04T01:47:49.419 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:47:49.419 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":117,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2985885329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2985885329},{"type":"v1","addr":"172.21.15.77:6835","nonce":2985885329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:47:48.740905+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7033,"mds_1":8583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7033":{"gid":7033,"name":"b","rank":0,"incarnation":109,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6836/2238841748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2238841748},{"type":"v1","addr":"172.21.15.122:6836","nonce":2238841748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8583":{"gid":8583,"name":"c","rank":1,"incarnation":112,"state":"up:active","state_seq":7,"addr":"172.21.15.77:6833/1157837717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1157837717},{"type":"v1","addr":"172.21.15.77:6833","nonce":1157837717}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:49.419 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 117 2023-11-04T01:47:49.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.419+0000 7f39b1bfc640 1 -- 172.21.15.77:0/3494558930 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f399806ae70 msgr2=0x7f399806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:49.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.419+0000 7f39b1bfc640 1 --2- 172.21.15.77:0/3494558930 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f399806ae70 0x7f399806d330 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f39ac1555f0 tx=0x7f399c008040 comp rx=0 tx=0).stop 2023-11-04T01:47:49.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.419+0000 7f39b1bfc640 1 -- 172.21.15.77:0/3494558930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39ac0b39b0 msgr2=0x7f39ac0c47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:49.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.419+0000 7f39b1bfc640 1 --2- 172.21.15.77:0/3494558930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39ac0b39b0 0x7f39ac0c47b0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f39a4009d90 tx=0x7f39a4004a40 comp rx=0 tx=0).stop 2023-11-04T01:47:49.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.419+0000 7f39b1bfc640 1 -- 172.21.15.77:0/3494558930 shutdown_connections 2023-11-04T01:47:49.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.419+0000 7f39b1bfc640 1 --2- 172.21.15.77:0/3494558930 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f399806ae70 0x7f399806d330 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:49.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.419+0000 7f39b1bfc640 1 --2- 172.21.15.77:0/3494558930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39ac0b39b0 0x7f39ac0c47b0 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:49.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.419+0000 7f39b1bfc640 1 --2- 172.21.15.77:0/3494558930 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39ac0addd0 0x7f39ac0b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:49.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.419+0000 7f39b1bfc640 1 --2- 172.21.15.77:0/3494558930 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f39ac06c220 0x7f39ac14dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:49.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.419+0000 7f39b1bfc640 1 -- 172.21.15.77:0/3494558930 >> 172.21.15.77:0/3494558930 conn(0x7f39ac0cb530 msgr2=0x7f39ac0afd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:49.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.419+0000 7f39b1bfc640 1 -- 172.21.15.77:0/3494558930 shutdown_connections 2023-11-04T01:47:49.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:49.419+0000 7f39b1bfc640 1 -- 172.21.15.77:0/3494558930 wait complete. 2023-11-04T01:47:49.431 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:47:49.694 INFO:tasks.ceph.mds.c.smithi077.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:47:53.080 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-11-04T01:47:54.433 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:54.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.543+0000 7fdba5353640 1 Processor -- start 2023-11-04T01:47:54.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.543+0000 7fdba5353640 1 -- start start 2023-11-04T01:47:54.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.543+0000 7fdba5353640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdba015d100 0x7fdba00ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:54.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.543+0000 7fdba5353640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fdba00d1be0 0x7fdba00b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:54.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.543+0000 7fdba5353640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba00b32b0 con 0x7fdba015d4e0 2023-11-04T01:47:54.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.543+0000 7fdba5353640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba00cee10 con 0x7fdba015d100 2023-11-04T01:47:54.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.543+0000 7fdba5353640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba00b2980 con 0x7fdba00d1be0 2023-11-04T01:47:54.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.544+0000 7fdb9effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdba015d100 0x7fdba00ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:54.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.544+0000 7fdb9effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdba015d100 0x7fdba00ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57922/0 (socket says 172.21.15.77:57922) 2023-11-04T01:47:54.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.544+0000 7fdb9effd640 1 -- 172.21.15.77:0/3286894064 learned_addr learned my addr 172.21.15.77:0/3286894064 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:54.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.544+0000 7fdb9f7fe640 1 --2- 172.21.15.77:0/3286894064 >> v2:172.21.15.122:3300/0 conn(0x7fdba00d1be0 0x7fdba00b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:54.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.544+0000 7fdb9effd640 1 -- 172.21.15.77:0/3286894064 >> v2:172.21.15.122:3300/0 conn(0x7fdba00d1be0 msgr2=0x7fdba00b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:54.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.544+0000 7fdb9effd640 1 --2- 172.21.15.77:0/3286894064 >> v2:172.21.15.122:3300/0 conn(0x7fdba00d1be0 0x7fdba00b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:54.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.544+0000 7fdb9effd640 1 -- 172.21.15.77:0/3286894064 >> v1:172.21.15.122:6789/0 conn(0x7fdba015d4e0 legacy=0x7fdba00d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:54.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.544+0000 7fdb9effd640 1 -- 172.21.15.77:0/3286894064 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba00b2c60 con 0x7fdba015d100 2023-11-04T01:47:54.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.545+0000 7fdb9effd640 1 --2- 172.21.15.77:0/3286894064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdba015d100 0x7fdba00ce510 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fdba008d6a0 tx=0x7fdb9002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa2c715f0ee03536 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:54.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.545+0000 7fdb9dffb640 1 -- 172.21.15.77:0/3286894064 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb90004230 con 0x7fdba015d100 2023-11-04T01:47:54.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.545+0000 7fdb9dffb640 1 -- 172.21.15.77:0/3286894064 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb90004390 con 0x7fdba015d100 2023-11-04T01:47:54.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.545+0000 7fdb9dffb640 1 -- 172.21.15.77:0/3286894064 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb90003810 con 0x7fdba015d100 2023-11-04T01:47:54.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.545+0000 7fdba5353640 1 -- 172.21.15.77:0/3286894064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdba015d100 msgr2=0x7fdba00ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:54.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.545+0000 7fdba5353640 1 --2- 172.21.15.77:0/3286894064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdba015d100 0x7fdba00ce510 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fdba008d6a0 tx=0x7fdb9002b8f0 comp rx=0 tx=0).stop 2023-11-04T01:47:54.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.545+0000 7fdba5353640 1 -- 172.21.15.77:0/3286894064 shutdown_connections 2023-11-04T01:47:54.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.545+0000 7fdba5353640 1 --2- 172.21.15.77:0/3286894064 >> v2:172.21.15.122:3300/0 conn(0x7fdba00d1be0 0x7fdba00b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:54.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.546+0000 7fdba5353640 1 --2- 172.21.15.77:0/3286894064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdba015d100 0x7fdba00ce510 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:54.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.546+0000 7fdba5353640 1 -- 172.21.15.77:0/3286894064 >> 172.21.15.77:0/3286894064 conn(0x7fdba00d2ef0 msgr2=0x7fdba00d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:54.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.546+0000 7fdba5353640 1 -- 172.21.15.77:0/3286894064 shutdown_connections 2023-11-04T01:47:54.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.546+0000 7fdba5353640 1 -- 172.21.15.77:0/3286894064 wait complete. 2023-11-04T01:47:54.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.547+0000 7fdba5353640 1 Processor -- start 2023-11-04T01:47:54.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.547+0000 7fdba5353640 1 -- start start 2023-11-04T01:47:54.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.548+0000 7fdba5353640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdba00d1be0 0x7fdba01f2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:54.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.548+0000 7fdba5353640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdba015d100 0x7fdba00c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:54.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.548+0000 7fdba5353640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdba015d4e0 0x7fdba00b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:54.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.548+0000 7fdba5353640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba01f28a0 con 0x7fdba015d4e0 2023-11-04T01:47:54.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.548+0000 7fdba5353640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba0151e50 con 0x7fdba015d100 2023-11-04T01:47:54.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.548+0000 7fdba5353640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba00ca8a0 con 0x7fdba00d1be0 2023-11-04T01:47:54.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.548+0000 7fdb9f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdba015d4e0 0x7fdba00b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:54.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.548+0000 7fdb9f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdba015d4e0 0x7fdba00b78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57926/0 (socket says 172.21.15.77:57926) 2023-11-04T01:47:54.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.548+0000 7fdb9f7fe640 1 -- 172.21.15.77:0/1966198087 learned_addr learned my addr 172.21.15.77:0/1966198087 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:54.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.548+0000 7fdb9effd640 1 --2- 172.21.15.77:0/1966198087 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdba00d1be0 0x7fdba01f2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:54.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.548+0000 7fdb9e7fc640 1 --2- 172.21.15.77:0/1966198087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdba015d100 0x7fdba00c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:54.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.548+0000 7fdb9f7fe640 1 -- 172.21.15.77:0/1966198087 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdba00d1be0 msgr2=0x7fdba01f2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:54.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.548+0000 7fdb9f7fe640 1 --2- 172.21.15.77:0/1966198087 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdba00d1be0 0x7fdba01f2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:54.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.548+0000 7fdb9f7fe640 1 -- 172.21.15.77:0/1966198087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdba015d100 msgr2=0x7fdba00c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:54.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.548+0000 7fdb9f7fe640 1 --2- 172.21.15.77:0/1966198087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdba015d100 0x7fdba00c9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:54.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.548+0000 7fdb9f7fe640 1 -- 172.21.15.77:0/1966198087 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb90009460 con 0x7fdba015d4e0 2023-11-04T01:47:54.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.548+0000 7fdb9f7fe640 1 --2- 172.21.15.77:0/1966198087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdba015d4e0 0x7fdba00b78c0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fdb98007e60 tx=0x7fdb9800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:54.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.548+0000 7fdb877fe640 1 -- 172.21.15.77:0/1966198087 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb98014420 con 0x7fdba015d4e0 2023-11-04T01:47:54.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.548+0000 7fdb877fe640 1 -- 172.21.15.77:0/1966198087 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb980145a0 con 0x7fdba015d4e0 2023-11-04T01:47:54.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.548+0000 7fdba5353640 1 -- 172.21.15.77:0/1966198087 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba00cab80 con 0x7fdba015d4e0 2023-11-04T01:47:54.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.549+0000 7fdb877fe640 1 -- 172.21.15.77:0/1966198087 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb98014950 con 0x7fdba015d4e0 2023-11-04T01:47:54.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.549+0000 7fdba5353640 1 -- 172.21.15.77:0/1966198087 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba00cb140 con 0x7fdba015d4e0 2023-11-04T01:47:54.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.549+0000 7fdba5353640 1 -- 172.21.15.77:0/1966198087 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba00d11e0 con 0x7fdba015d4e0 2023-11-04T01:47:54.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.550+0000 7fdb877fe640 1 -- 172.21.15.77:0/1966198087 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdb98014ab0 con 0x7fdba015d4e0 2023-11-04T01:47:54.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.550+0000 7fdb877fe640 1 --2- 172.21.15.77:0/1966198087 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdb8c06ae70 0x7fdb8c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:54.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.550+0000 7fdb877fe640 1 -- 172.21.15.77:0/1966198087 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8223+0+0 (secure 0 0 0) 0x7fdb9808a980 con 0x7fdba015d4e0 2023-11-04T01:47:54.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.551+0000 7fdb9effd640 1 --2- 172.21.15.77:0/1966198087 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdb8c06ae70 0x7fdb8c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:54.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.551+0000 7fdb9effd640 1 --2- 172.21.15.77:0/1966198087 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdb8c06ae70 0x7fdb8c06d330 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fdb90035000 tx=0x7fdb90008030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:54.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.555+0000 7fdb877fe640 1 -- 172.21.15.77:0/1966198087 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdb98055010 con 0x7fdba015d4e0 2023-11-04T01:47:54.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.754+0000 7fdba5353640 1 -- 172.21.15.77:0/1966198087 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdba00684b0 con 0x7fdba015d4e0 2023-11-04T01:47:54.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.755+0000 7fdb877fe640 1 -- 172.21.15.77:0/1966198087 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) v1 ==== 95+0+4943 (secure 0 0 0) 0x7fdb98058630 con 0x7fdba015d4e0 2023-11-04T01:47:54.757 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:47:54.757 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":117,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2985885329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2985885329},{"type":"v1","addr":"172.21.15.77:6835","nonce":2985885329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:47:48.740905+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7033,"mds_1":8583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7033":{"gid":7033,"name":"b","rank":0,"incarnation":109,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6836/2238841748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2238841748},{"type":"v1","addr":"172.21.15.122:6836","nonce":2238841748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8583":{"gid":8583,"name":"c","rank":1,"incarnation":112,"state":"up:active","state_seq":7,"addr":"172.21.15.77:6833/1157837717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1157837717},{"type":"v1","addr":"172.21.15.77:6833","nonce":1157837717}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:54.758 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 117 2023-11-04T01:47:54.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.757+0000 7fdba5353640 1 -- 172.21.15.77:0/1966198087 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdb8c06ae70 msgr2=0x7fdb8c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:54.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.757+0000 7fdba5353640 1 --2- 172.21.15.77:0/1966198087 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdb8c06ae70 0x7fdb8c06d330 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fdb90035000 tx=0x7fdb90008030 comp rx=0 tx=0).stop 2023-11-04T01:47:54.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.757+0000 7fdba5353640 1 -- 172.21.15.77:0/1966198087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdba015d4e0 msgr2=0x7fdba00b78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:54.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.757+0000 7fdba5353640 1 --2- 172.21.15.77:0/1966198087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdba015d4e0 0x7fdba00b78c0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fdb98007e60 tx=0x7fdb9800e4b0 comp rx=0 tx=0).stop 2023-11-04T01:47:54.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.757+0000 7fdba5353640 1 -- 172.21.15.77:0/1966198087 shutdown_connections 2023-11-04T01:47:54.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.757+0000 7fdba5353640 1 --2- 172.21.15.77:0/1966198087 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdb8c06ae70 0x7fdb8c06d330 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:54.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.757+0000 7fdba5353640 1 --2- 172.21.15.77:0/1966198087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdba015d4e0 0x7fdba00b78c0 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:54.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.757+0000 7fdba5353640 1 --2- 172.21.15.77:0/1966198087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdba015d100 0x7fdba00c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:54.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.757+0000 7fdba5353640 1 --2- 172.21.15.77:0/1966198087 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdba00d1be0 0x7fdba01f2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:54.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.757+0000 7fdba5353640 1 -- 172.21.15.77:0/1966198087 >> 172.21.15.77:0/1966198087 conn(0x7fdba00d2ef0 msgr2=0x7fdba00b5130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:54.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.757+0000 7fdba5353640 1 -- 172.21.15.77:0/1966198087 shutdown_connections 2023-11-04T01:47:54.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:54.757+0000 7fdba5353640 1 -- 172.21.15.77:0/1966198087 wait complete. 2023-11-04T01:47:54.769 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:47:59.691 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~7s 2023-11-04T01:47:59.771 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:59.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.881+0000 7f15ec664640 1 Processor -- start 2023-11-04T01:47:59.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.881+0000 7f15ec664640 1 -- start start 2023-11-04T01:47:59.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.882+0000 7f15ec664640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f15e415d100 0x7f15e40ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:59.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.882+0000 7f15ec664640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f15e40d1be0 0x7f15e40b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:59.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.882+0000 7f15ec664640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e40b32b0 con 0x7f15e415d4e0 2023-11-04T01:47:59.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.882+0000 7f15ec664640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e40cee10 con 0x7f15e40d1be0 2023-11-04T01:47:59.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.882+0000 7f15ec664640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e40b2980 con 0x7f15e415d100 2023-11-04T01:47:59.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.882+0000 7f15ea400640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f15e415d100 0x7f15e40ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:59.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.882+0000 7f15eac01640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f15e40d1be0 0x7f15e40b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:59.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.882+0000 7f15ea400640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f15e415d100 0x7f15e40ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3301/0 says I am v2:172.21.15.77:58346/0 (socket says 172.21.15.77:58346) 2023-11-04T01:47:59.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.882+0000 7f15ea400640 1 -- 172.21.15.77:0/2439762564 learned_addr learned my addr 172.21.15.77:0/2439762564 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:59.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.882+0000 7f15e9bff640 1 --1- 172.21.15.77:0/2439762564 >> v1:172.21.15.122:6789/0 conn(0x7f15e415d4e0 0x7f15e40d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:52026/0 (socket says 172.21.15.77:52026) 2023-11-04T01:47:59.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.882+0000 7f15ea400640 1 -- 172.21.15.77:0/2439762564 >> v2:172.21.15.122:3300/0 conn(0x7f15e40d1be0 msgr2=0x7f15e40b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:59.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.882+0000 7f15ea400640 1 --2- 172.21.15.77:0/2439762564 >> v2:172.21.15.122:3300/0 conn(0x7f15e40d1be0 0x7f15e40b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:59.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.882+0000 7f15ea400640 1 -- 172.21.15.77:0/2439762564 >> v1:172.21.15.122:6789/0 conn(0x7f15e415d4e0 legacy=0x7f15e40d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:59.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.882+0000 7f15ea400640 1 -- 172.21.15.77:0/2439762564 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e40b2c60 con 0x7f15e415d100 2023-11-04T01:47:59.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.882+0000 7f15eac01640 1 --2- 172.21.15.77:0/2439762564 >> v2:172.21.15.122:3300/0 conn(0x7f15e40d1be0 0x7f15e40b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:47:59.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.883+0000 7f15ea400640 1 --2- 172.21.15.77:0/2439762564 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f15e415d100 0x7f15e40ce510 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f15d4009ed0 tx=0x7f15d402bf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b47cbe98019bb38 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:59.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.883+0000 7f15e93fe640 1 -- 172.21.15.77:0/2439762564 <== mon.2 v2:172.21.15.122:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d402cb30 con 0x7f15e415d100 2023-11-04T01:47:59.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.883+0000 7f15e93fe640 1 -- 172.21.15.77:0/2439762564 <== mon.2 v2:172.21.15.122:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d402cc90 con 0x7f15e415d100 2023-11-04T01:47:59.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.883+0000 7f15e93fe640 1 -- 172.21.15.77:0/2439762564 <== mon.2 v2:172.21.15.122:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d40343f0 con 0x7f15e415d100 2023-11-04T01:47:59.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.884+0000 7f15ec664640 1 -- 172.21.15.77:0/2439762564 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f15e415d100 msgr2=0x7f15e40ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:59.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.884+0000 7f15ec664640 1 --2- 172.21.15.77:0/2439762564 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f15e415d100 0x7f15e40ce510 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f15d4009ed0 tx=0x7f15d402bf90 comp rx=0 tx=0).stop 2023-11-04T01:47:59.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.884+0000 7f15ec664640 1 -- 172.21.15.77:0/2439762564 shutdown_connections 2023-11-04T01:47:59.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.884+0000 7f15ec664640 1 --2- 172.21.15.77:0/2439762564 >> v2:172.21.15.122:3300/0 conn(0x7f15e40d1be0 0x7f15e40b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:59.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.884+0000 7f15ec664640 1 --2- 172.21.15.77:0/2439762564 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f15e415d100 0x7f15e40ce510 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:59.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.884+0000 7f15ec664640 1 -- 172.21.15.77:0/2439762564 >> 172.21.15.77:0/2439762564 conn(0x7f15e40d2ef0 msgr2=0x7f15e40d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:59.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.884+0000 7f15ec664640 1 -- 172.21.15.77:0/2439762564 shutdown_connections 2023-11-04T01:47:59.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.884+0000 7f15ec664640 1 -- 172.21.15.77:0/2439762564 wait complete. 2023-11-04T01:47:59.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.886+0000 7f15ec664640 1 Processor -- start 2023-11-04T01:47:59.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.886+0000 7f15ec664640 1 -- start start 2023-11-04T01:47:59.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.886+0000 7f15ec664640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f15e40d1be0 0x7f15e40c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:59.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.886+0000 7f15ec664640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15e415d100 0x7f15e41f3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:59.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.886+0000 7f15ec664640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15e415d4e0 0x7f15e40b8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:59.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.886+0000 7f15ec664640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e40ca500 con 0x7f15e415d4e0 2023-11-04T01:47:59.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.886+0000 7f15ec664640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e40b71d0 con 0x7f15e415d100 2023-11-04T01:47:59.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.886+0000 7f15ec664640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e40b74b0 con 0x7f15e40d1be0 2023-11-04T01:47:59.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.887+0000 7f15eac01640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15e415d4e0 0x7f15e40b8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:59.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.887+0000 7f15eac01640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15e415d4e0 0x7f15e40b8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45176/0 (socket says 172.21.15.77:45176) 2023-11-04T01:47:59.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.887+0000 7f15eac01640 1 -- 172.21.15.77:0/4115696530 learned_addr learned my addr 172.21.15.77:0/4115696530 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:47:59.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.887+0000 7f15e9bff640 1 --2- 172.21.15.77:0/4115696530 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15e415d100 0x7f15e41f3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:59.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.887+0000 7f15ea400640 1 --2- 172.21.15.77:0/4115696530 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f15e40d1be0 0x7f15e40c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:59.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.887+0000 7f15eac01640 1 -- 172.21.15.77:0/4115696530 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f15e40d1be0 msgr2=0x7f15e40c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:59.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.887+0000 7f15eac01640 1 --2- 172.21.15.77:0/4115696530 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f15e40d1be0 0x7f15e40c9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:59.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.887+0000 7f15eac01640 1 -- 172.21.15.77:0/4115696530 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15e415d100 msgr2=0x7f15e41f3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:59.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.887+0000 7f15eac01640 1 --2- 172.21.15.77:0/4115696530 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15e415d100 0x7f15e41f3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:59.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.887+0000 7f15eac01640 1 -- 172.21.15.77:0/4115696530 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15dc009400 con 0x7f15e415d4e0 2023-11-04T01:47:59.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.887+0000 7f15eac01640 1 --2- 172.21.15.77:0/4115696530 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15e415d4e0 0x7f15e40b8270 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f15dc00e860 tx=0x7f15dc00ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:59.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.887+0000 7f15e2ffd640 1 -- 172.21.15.77:0/4115696530 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc00c940 con 0x7f15e415d4e0 2023-11-04T01:47:59.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.887+0000 7f15e2ffd640 1 -- 172.21.15.77:0/4115696530 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15dc00cac0 con 0x7f15e415d4e0 2023-11-04T01:47:59.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.887+0000 7f15ec664640 1 -- 172.21.15.77:0/4115696530 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15d4009b30 con 0x7f15e415d4e0 2023-11-04T01:47:59.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.887+0000 7f15e2ffd640 1 -- 172.21.15.77:0/4115696530 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc00ce70 con 0x7f15e415d4e0 2023-11-04T01:47:59.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.887+0000 7f15ec664640 1 -- 172.21.15.77:0/4115696530 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e40b7a70 con 0x7f15e415d4e0 2023-11-04T01:47:59.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.888+0000 7f15ec664640 1 -- 172.21.15.77:0/4115696530 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15e40684b0 con 0x7f15e415d4e0 2023-11-04T01:47:59.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.889+0000 7f15e2ffd640 1 -- 172.21.15.77:0/4115696530 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f15dc013470 con 0x7f15e415d4e0 2023-11-04T01:47:59.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.889+0000 7f15e2ffd640 1 --2- 172.21.15.77:0/4115696530 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f15d006ae70 0x7f15d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:59.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.889+0000 7f15e2ffd640 1 -- 172.21.15.77:0/4115696530 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8223+0+0 (secure 0 0 0) 0x7f15dc08a1a0 con 0x7f15e415d4e0 2023-11-04T01:47:59.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.889+0000 7f15ea400640 1 --2- 172.21.15.77:0/4115696530 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f15d006ae70 0x7f15d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:59.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.890+0000 7f15ea400640 1 --2- 172.21.15.77:0/4115696530 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f15d006ae70 0x7f15d006d330 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f15d4035000 tx=0x7f15d4030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:59.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:47:59.893+0000 7f15e2ffd640 1 -- 172.21.15.77:0/4115696530 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f15dc054970 con 0x7f15e415d4e0 2023-11-04T01:48:00.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:00.093+0000 7f15ec664640 1 -- 172.21.15.77:0/4115696530 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15e40d2cd0 con 0x7f15e415d4e0 2023-11-04T01:48:00.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:00.094+0000 7f15e2ffd640 1 -- 172.21.15.77:0/4115696530 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) v1 ==== 95+0+4943 (secure 0 0 0) 0x7f15dc057f90 con 0x7f15e415d4e0 2023-11-04T01:48:00.096 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:48:00.096 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":117,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2985885329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2985885329},{"type":"v1","addr":"172.21.15.77:6835","nonce":2985885329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:47:48.740905+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7033,"mds_1":8583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7033":{"gid":7033,"name":"b","rank":0,"incarnation":109,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6836/2238841748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2238841748},{"type":"v1","addr":"172.21.15.122:6836","nonce":2238841748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8583":{"gid":8583,"name":"c","rank":1,"incarnation":112,"state":"up:active","state_seq":7,"addr":"172.21.15.77:6833/1157837717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1157837717},{"type":"v1","addr":"172.21.15.77:6833","nonce":1157837717}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:48:00.097 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 117 2023-11-04T01:48:00.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:00.096+0000 7f15ec664640 1 -- 172.21.15.77:0/4115696530 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f15d006ae70 msgr2=0x7f15d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:00.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:00.096+0000 7f15ec664640 1 --2- 172.21.15.77:0/4115696530 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f15d006ae70 0x7f15d006d330 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f15d4035000 tx=0x7f15d4030000 comp rx=0 tx=0).stop 2023-11-04T01:48:00.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:00.096+0000 7f15ec664640 1 -- 172.21.15.77:0/4115696530 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15e415d4e0 msgr2=0x7f15e40b8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:00.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:00.096+0000 7f15ec664640 1 --2- 172.21.15.77:0/4115696530 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15e415d4e0 0x7f15e40b8270 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f15dc00e860 tx=0x7f15dc00ed20 comp rx=0 tx=0).stop 2023-11-04T01:48:00.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:00.096+0000 7f15ec664640 1 -- 172.21.15.77:0/4115696530 shutdown_connections 2023-11-04T01:48:00.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:00.096+0000 7f15ec664640 1 --2- 172.21.15.77:0/4115696530 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f15d006ae70 0x7f15d006d330 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:00.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:00.096+0000 7f15ec664640 1 --2- 172.21.15.77:0/4115696530 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15e415d4e0 0x7f15e40b8270 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:00.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:00.096+0000 7f15ec664640 1 --2- 172.21.15.77:0/4115696530 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15e415d100 0x7f15e41f3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:00.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:00.096+0000 7f15ec664640 1 --2- 172.21.15.77:0/4115696530 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f15e40d1be0 0x7f15e40c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:00.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:00.096+0000 7f15ec664640 1 -- 172.21.15.77:0/4115696530 >> 172.21.15.77:0/4115696530 conn(0x7f15e40d2ef0 msgr2=0x7f15e40b3740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:00.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:00.096+0000 7f15ec664640 1 -- 172.21.15.77:0/4115696530 shutdown_connections 2023-11-04T01:48:00.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:00.096+0000 7f15ec664640 1 -- 172.21.15.77:0/4115696530 wait complete. 2023-11-04T01:48:00.108 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:48:01.730 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:48:01.733 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:48:05.109 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:48:05.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.219+0000 7fdac9894640 1 Processor -- start 2023-11-04T01:48:05.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.219+0000 7fdac9894640 1 -- start start 2023-11-04T01:48:05.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.220+0000 7fdac9894640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdac40ceda0 0x7fdac415cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:05.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.220+0000 7fdac9894640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdac40cf890 0x7fdac415d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:05.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.220+0000 7fdac9894640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac415d9a0 con 0x7fdac40b2210 2023-11-04T01:48:05.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.220+0000 7fdac9894640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac40b1df0 con 0x7fdac40cf890 2023-11-04T01:48:05.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.220+0000 7fdac9894640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac40cfd20 con 0x7fdac40ceda0 2023-11-04T01:48:05.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.220+0000 7fdac37fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdac40cf890 0x7fdac415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:05.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.220+0000 7fdac37fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdac40cf890 0x7fdac415d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45190/0 (socket says 172.21.15.77:45190) 2023-11-04T01:48:05.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.220+0000 7fdac37fe640 1 -- 172.21.15.77:0/3342430597 learned_addr learned my addr 172.21.15.77:0/3342430597 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:48:05.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.220+0000 7fdac2ffd640 1 --2- 172.21.15.77:0/3342430597 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdac40ceda0 0x7fdac415cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:05.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.220+0000 7fdac37fe640 1 -- 172.21.15.77:0/3342430597 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdac40ceda0 msgr2=0x7fdac415cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:05.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.220+0000 7fdac37fe640 1 --2- 172.21.15.77:0/3342430597 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdac40ceda0 0x7fdac415cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.220+0000 7fdac37fe640 1 -- 172.21.15.77:0/3342430597 >> v1:172.21.15.77:6789/0 conn(0x7fdac40b2210 legacy=0x7fdac40cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:05.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.220+0000 7fdac37fe640 1 -- 172.21.15.77:0/3342430597 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac40b0150 con 0x7fdac40cf890 2023-11-04T01:48:05.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.221+0000 7fdac37fe640 1 --2- 172.21.15.77:0/3342430597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdac40cf890 0x7fdac415d460 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fdabc009870 tx=0x7fdabc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4de880787f1def9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:05.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.221+0000 7fdac1ffb640 1 -- 172.21.15.77:0/3342430597 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc031640 con 0x7fdac40cf890 2023-11-04T01:48:05.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.221+0000 7fdac1ffb640 1 -- 172.21.15.77:0/3342430597 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdabc0317a0 con 0x7fdac40cf890 2023-11-04T01:48:05.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.221+0000 7fdac1ffb640 1 -- 172.21.15.77:0/3342430597 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc031b30 con 0x7fdac40cf890 2023-11-04T01:48:05.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.222+0000 7fdac9894640 1 -- 172.21.15.77:0/3342430597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdac40cf890 msgr2=0x7fdac415d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:05.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.222+0000 7fdac9894640 1 --2- 172.21.15.77:0/3342430597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdac40cf890 0x7fdac415d460 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fdabc009870 tx=0x7fdabc02b8f0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.222+0000 7fdac9894640 1 -- 172.21.15.77:0/3342430597 shutdown_connections 2023-11-04T01:48:05.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.222+0000 7fdac9894640 1 --2- 172.21.15.77:0/3342430597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdac40cf890 0x7fdac415d460 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.222+0000 7fdac9894640 1 --2- 172.21.15.77:0/3342430597 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdac40ceda0 0x7fdac415cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.222+0000 7fdac9894640 1 -- 172.21.15.77:0/3342430597 >> 172.21.15.77:0/3342430597 conn(0x7fdac40d0c30 msgr2=0x7fdac40d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:05.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.222+0000 7fdac9894640 1 -- 172.21.15.77:0/3342430597 shutdown_connections 2023-11-04T01:48:05.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.222+0000 7fdac9894640 1 -- 172.21.15.77:0/3342430597 wait complete. 2023-11-04T01:48:05.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.223+0000 7fdac9894640 1 Processor -- start 2023-11-04T01:48:05.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.223+0000 7fdac9894640 1 -- start start 2023-11-04T01:48:05.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.224+0000 7fdac9894640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdac40b2210 0x7fdac415b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:05.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.224+0000 7fdac9894640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdac40ceda0 0x7fdac41e6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:05.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.224+0000 7fdac9894640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdac40cf890 0x7fdac41e6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:05.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.224+0000 7fdac9894640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac41e64c0 con 0x7fdac40ceda0 2023-11-04T01:48:05.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.224+0000 7fdac9894640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac415bb50 con 0x7fdac40cf890 2023-11-04T01:48:05.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.224+0000 7fdac9894640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac41e5840 con 0x7fdac40b2210 2023-11-04T01:48:05.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.224+0000 7fdac27fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdac40ceda0 0x7fdac41e6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:05.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.224+0000 7fdac27fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdac40ceda0 0x7fdac41e6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45206/0 (socket says 172.21.15.77:45206) 2023-11-04T01:48:05.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.224+0000 7fdac27fc640 1 -- 172.21.15.77:0/3970834100 learned_addr learned my addr 172.21.15.77:0/3970834100 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:48:05.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.224+0000 7fdac2ffd640 1 --2- 172.21.15.77:0/3970834100 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdac40b2210 0x7fdac415b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:05.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.224+0000 7fdac37fe640 1 --2- 172.21.15.77:0/3970834100 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdac40cf890 0x7fdac41e6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:05.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.224+0000 7fdac27fc640 1 -- 172.21.15.77:0/3970834100 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdac40b2210 msgr2=0x7fdac415b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:05.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.224+0000 7fdac27fc640 1 --2- 172.21.15.77:0/3970834100 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdac40b2210 0x7fdac415b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.225+0000 7fdac27fc640 1 -- 172.21.15.77:0/3970834100 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdac40cf890 msgr2=0x7fdac41e6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:05.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.225+0000 7fdac27fc640 1 --2- 172.21.15.77:0/3970834100 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdac40cf890 0x7fdac41e6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.225+0000 7fdac27fc640 1 -- 172.21.15.77:0/3970834100 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdabc0094d0 con 0x7fdac40ceda0 2023-11-04T01:48:05.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.225+0000 7fdac27fc640 1 --2- 172.21.15.77:0/3970834100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdac40ceda0 0x7fdac41e6a50 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fdab800c450 tx=0x7fdab800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:05.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.225+0000 7fdaabfff640 1 -- 172.21.15.77:0/3970834100 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab80052d0 con 0x7fdac40ceda0 2023-11-04T01:48:05.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.225+0000 7fdaabfff640 1 -- 172.21.15.77:0/3970834100 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab8005430 con 0x7fdac40ceda0 2023-11-04T01:48:05.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.225+0000 7fdac9894640 1 -- 172.21.15.77:0/3970834100 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac41e5b20 con 0x7fdac40ceda0 2023-11-04T01:48:05.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.225+0000 7fdaabfff640 1 -- 172.21.15.77:0/3970834100 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab8012870 con 0x7fdac40ceda0 2023-11-04T01:48:05.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.225+0000 7fdac9894640 1 -- 172.21.15.77:0/3970834100 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac41e60e0 con 0x7fdac40ceda0 2023-11-04T01:48:05.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.226+0000 7fdac9894640 1 -- 172.21.15.77:0/3970834100 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac41e6600 con 0x7fdac40ceda0 2023-11-04T01:48:05.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.226+0000 7fdaabfff640 1 -- 172.21.15.77:0/3970834100 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdab80129d0 con 0x7fdac40ceda0 2023-11-04T01:48:05.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.227+0000 7fdaabfff640 1 --2- 172.21.15.77:0/3970834100 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdab006ae70 0x7fdab006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:05.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.227+0000 7fdaabfff640 1 -- 172.21.15.77:0/3970834100 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8195+0+0 (secure 0 0 0) 0x7fdab8089b50 con 0x7fdac40ceda0 2023-11-04T01:48:05.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.227+0000 7fdac2ffd640 1 --2- 172.21.15.77:0/3970834100 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdab006ae70 0x7fdab006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:05.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.227+0000 7fdac2ffd640 1 --2- 172.21.15.77:0/3970834100 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdab006ae70 0x7fdab006d330 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fdac41e3170 tx=0x7fdab4009920 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:05.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.231+0000 7fdaabfff640 1 -- 172.21.15.77:0/3970834100 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdac41e6600 con 0x7fdac40ceda0 2023-11-04T01:48:05.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.432+0000 7fdac9894640 1 -- 172.21.15.77:0/3970834100 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdac41e6600 con 0x7fdac40ceda0 2023-11-04T01:48:05.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.432+0000 7fdaabfff640 1 -- 172.21.15.77:0/3970834100 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) v1 ==== 95+0+4943 (secure 0 0 0) 0x7fdac41e6600 con 0x7fdac40ceda0 2023-11-04T01:48:05.434 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:48:05.434 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":117,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2985885329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2985885329},{"type":"v1","addr":"172.21.15.77:6835","nonce":2985885329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:47:48.740905+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7033,"mds_1":8583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7033":{"gid":7033,"name":"b","rank":0,"incarnation":109,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6836/2238841748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2238841748},{"type":"v1","addr":"172.21.15.122:6836","nonce":2238841748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8583":{"gid":8583,"name":"c","rank":1,"incarnation":112,"state":"up:active","state_seq":7,"addr":"172.21.15.77:6833/1157837717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1157837717},{"type":"v1","addr":"172.21.15.77:6833","nonce":1157837717}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:48:05.435 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 117 2023-11-04T01:48:05.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.434+0000 7fdac9894640 1 -- 172.21.15.77:0/3970834100 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdab006ae70 msgr2=0x7fdab006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:05.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.434+0000 7fdac9894640 1 --2- 172.21.15.77:0/3970834100 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdab006ae70 0x7fdab006d330 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fdac41e3170 tx=0x7fdab4009920 comp rx=0 tx=0).stop 2023-11-04T01:48:05.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.434+0000 7fdac9894640 1 -- 172.21.15.77:0/3970834100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdac40ceda0 msgr2=0x7fdac41e6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:05.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.434+0000 7fdac9894640 1 --2- 172.21.15.77:0/3970834100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdac40ceda0 0x7fdac41e6a50 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fdab800c450 tx=0x7fdab800c910 comp rx=0 tx=0).stop 2023-11-04T01:48:05.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.434+0000 7fdac9894640 1 -- 172.21.15.77:0/3970834100 shutdown_connections 2023-11-04T01:48:05.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.434+0000 7fdac9894640 1 --2- 172.21.15.77:0/3970834100 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fdab006ae70 0x7fdab006d330 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.434+0000 7fdac9894640 1 --2- 172.21.15.77:0/3970834100 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdac40cf890 0x7fdac41e6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.434+0000 7fdac9894640 1 --2- 172.21.15.77:0/3970834100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdac40ceda0 0x7fdac41e6a50 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.434+0000 7fdac9894640 1 --2- 172.21.15.77:0/3970834100 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fdac40b2210 0x7fdac415b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.434+0000 7fdac9894640 1 -- 172.21.15.77:0/3970834100 >> 172.21.15.77:0/3970834100 conn(0x7fdac40d0c30 msgr2=0x7fdac415c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:05.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.434+0000 7fdac9894640 1 -- 172.21.15.77:0/3970834100 shutdown_connections 2023-11-04T01:48:05.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:05.434+0000 7fdac9894640 1 -- 172.21.15.77:0/3970834100 wait complete. 2023-11-04T01:48:05.446 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:48:06.301 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~13s 2023-11-04T01:48:10.447 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:48:10.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.557+0000 7f200554c640 1 Processor -- start 2023-11-04T01:48:10.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.557+0000 7f200554c640 1 -- start start 2023-11-04T01:48:10.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.558+0000 7f200554c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f200015d100 0x7f20000ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:10.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.558+0000 7f200554c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f200015d4e0 0x7f20000d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:10.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.558+0000 7f200554c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20000b32b0 con 0x7f20000d3b60 2023-11-04T01:48:10.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.558+0000 7f200554c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20000cee10 con 0x7f200015d100 2023-11-04T01:48:10.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.558+0000 7f200554c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20000b4750 con 0x7f200015d4e0 2023-11-04T01:48:10.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.558+0000 7f1ffeffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f200015d100 0x7f20000ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:10.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.558+0000 7f1ffeffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f200015d100 0x7f20000ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60656/0 (socket says 172.21.15.77:60656) 2023-11-04T01:48:10.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.558+0000 7f1ffeffd640 1 -- 172.21.15.77:0/911492016 learned_addr learned my addr 172.21.15.77:0/911492016 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:48:10.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.558+0000 7f1ffe7fc640 1 --2- 172.21.15.77:0/911492016 >> v2:172.21.15.122:3300/0 conn(0x7f200015d4e0 0x7f20000d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:10.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.558+0000 7f1ffeffd640 1 -- 172.21.15.77:0/911492016 >> v2:172.21.15.122:3300/0 conn(0x7f200015d4e0 msgr2=0x7f20000d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:10.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.558+0000 7f1ffeffd640 1 --2- 172.21.15.77:0/911492016 >> v2:172.21.15.122:3300/0 conn(0x7f200015d4e0 0x7f20000d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:10.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.558+0000 7f1ffeffd640 1 -- 172.21.15.77:0/911492016 >> v1:172.21.15.77:6789/0 conn(0x7f20000d3b60 legacy=0x7f20000cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:10.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.558+0000 7f1ffeffd640 1 -- 172.21.15.77:0/911492016 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20000b2980 con 0x7f200015d100 2023-11-04T01:48:10.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.558+0000 7f1ffe7fc640 1 --2- 172.21.15.77:0/911492016 >> v2:172.21.15.122:3300/0 conn(0x7f200015d4e0 0x7f20000d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:10.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.559+0000 7f1ffeffd640 1 --2- 172.21.15.77:0/911492016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f200015d100 0x7f20000ce510 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f2000160da0 tx=0x7f1ff002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ffcb15cadce4ec2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:10.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.559+0000 7f1ffdffb640 1 -- 172.21.15.77:0/911492016 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0004230 con 0x7f200015d100 2023-11-04T01:48:10.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.559+0000 7f1ffdffb640 1 -- 172.21.15.77:0/911492016 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff0004390 con 0x7f200015d100 2023-11-04T01:48:10.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.559+0000 7f1ffdffb640 1 -- 172.21.15.77:0/911492016 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0030840 con 0x7f200015d100 2023-11-04T01:48:10.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.560+0000 7f200554c640 1 -- 172.21.15.77:0/911492016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f200015d100 msgr2=0x7f20000ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:10.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.560+0000 7f200554c640 1 --2- 172.21.15.77:0/911492016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f200015d100 0x7f20000ce510 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f2000160da0 tx=0x7f1ff002b980 comp rx=0 tx=0).stop 2023-11-04T01:48:10.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.560+0000 7f200554c640 1 -- 172.21.15.77:0/911492016 shutdown_connections 2023-11-04T01:48:10.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.560+0000 7f200554c640 1 --2- 172.21.15.77:0/911492016 >> v2:172.21.15.122:3300/0 conn(0x7f200015d4e0 0x7f20000d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:10.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.560+0000 7f200554c640 1 --2- 172.21.15.77:0/911492016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f200015d100 0x7f20000ce510 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:10.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.560+0000 7f200554c640 1 -- 172.21.15.77:0/911492016 >> 172.21.15.77:0/911492016 conn(0x7f20000d2ef0 msgr2=0x7f20000d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:10.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.560+0000 7f200554c640 1 -- 172.21.15.77:0/911492016 shutdown_connections 2023-11-04T01:48:10.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.560+0000 7f200554c640 1 -- 172.21.15.77:0/911492016 wait complete. 2023-11-04T01:48:10.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.561+0000 7f200554c640 1 Processor -- start 2023-11-04T01:48:10.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.561+0000 7f200554c640 1 -- start start 2023-11-04T01:48:10.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.562+0000 7f200554c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20000d3b60 0x7f200015e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:10.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.562+0000 7f200554c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f200015d100 0x7f20001600a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:10.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.562+0000 7f200554c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f200015d4e0 0x7f20000cb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:10.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.562+0000 7f200554c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f200015fc10 con 0x7f200015d100 2023-11-04T01:48:10.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.562+0000 7f200554c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20001605e0 con 0x7f200015d4e0 2023-11-04T01:48:10.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.562+0000 7f200554c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20000cb9b0 con 0x7f20000d3b60 2023-11-04T01:48:10.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.562+0000 7f1ffe7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f200015d100 0x7f20001600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:10.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.562+0000 7f1ffe7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f200015d100 0x7f20001600a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60666/0 (socket says 172.21.15.77:60666) 2023-11-04T01:48:10.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.562+0000 7f1ffe7fc640 1 -- 172.21.15.77:0/3042261961 learned_addr learned my addr 172.21.15.77:0/3042261961 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:48:10.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.562+0000 7f1fff7fe640 1 --2- 172.21.15.77:0/3042261961 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f200015d4e0 0x7f20000cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:10.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.562+0000 7f1ffeffd640 1 --2- 172.21.15.77:0/3042261961 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20000d3b60 0x7f200015e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:10.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.562+0000 7f1ffe7fc640 1 -- 172.21.15.77:0/3042261961 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20000d3b60 msgr2=0x7f200015e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:10.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.562+0000 7f1ffe7fc640 1 --2- 172.21.15.77:0/3042261961 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20000d3b60 0x7f200015e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:10.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.562+0000 7f1ffe7fc640 1 -- 172.21.15.77:0/3042261961 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f200015d4e0 msgr2=0x7f20000cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:10.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.562+0000 7f1ffe7fc640 1 --2- 172.21.15.77:0/3042261961 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f200015d4e0 0x7f20000cb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:10.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.562+0000 7f1ffe7fc640 1 -- 172.21.15.77:0/3042261961 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff0009460 con 0x7f200015d100 2023-11-04T01:48:10.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.562+0000 7f1ffeffd640 1 --2- 172.21.15.77:0/3042261961 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20000d3b60 0x7f200015e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:10.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.562+0000 7f1fff7fe640 1 --2- 172.21.15.77:0/3042261961 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f200015d4e0 0x7f20000cb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:48:10.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.563+0000 7f1ffe7fc640 1 --2- 172.21.15.77:0/3042261961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f200015d100 0x7f20001600a0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f1ff400c7f0 tx=0x7f1ff400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:10.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.563+0000 7f1fe77fe640 1 -- 172.21.15.77:0/3042261961 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff400cea0 con 0x7f200015d100 2023-11-04T01:48:10.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.563+0000 7f1fe77fe640 1 -- 172.21.15.77:0/3042261961 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff4007a30 con 0x7f200015d100 2023-11-04T01:48:10.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.563+0000 7f1fe77fe640 1 -- 172.21.15.77:0/3042261961 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff4007dc0 con 0x7f200015d100 2023-11-04T01:48:10.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.563+0000 7f200554c640 1 -- 172.21.15.77:0/3042261961 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f200015f000 con 0x7f200015d100 2023-11-04T01:48:10.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.563+0000 7f200554c640 1 -- 172.21.15.77:0/3042261961 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f200015f5c0 con 0x7f200015d100 2023-11-04T01:48:10.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.564+0000 7f200554c640 1 -- 172.21.15.77:0/3042261961 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20000b26c0 con 0x7f200015d100 2023-11-04T01:48:10.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.564+0000 7f1fe77fe640 1 -- 172.21.15.77:0/3042261961 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1ff40113f0 con 0x7f200015d100 2023-11-04T01:48:10.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.565+0000 7f1fe77fe640 1 --2- 172.21.15.77:0/3042261961 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1fec06ae70 0x7f1fec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:10.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.565+0000 7f1fe77fe640 1 -- 172.21.15.77:0/3042261961 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f1ff408a150 con 0x7f200015d100 2023-11-04T01:48:10.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.565+0000 7f1ffeffd640 1 --2- 172.21.15.77:0/3042261961 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1fec06ae70 0x7f1fec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:10.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.565+0000 7f1ffeffd640 1 --2- 172.21.15.77:0/3042261961 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1fec06ae70 0x7f1fec06d330 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0035000 tx=0x7f1ff0008030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:10.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.569+0000 7f1fe77fe640 1 -- 172.21.15.77:0/3042261961 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1ff4054880 con 0x7f200015d100 2023-11-04T01:48:10.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.770+0000 7f200554c640 1 -- 172.21.15.77:0/3042261961 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20000684b0 con 0x7f200015d100 2023-11-04T01:48:10.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.771+0000 7f1fe77fe640 1 -- 172.21.15.77:0/3042261961 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 118 v118) v1 ==== 95+0+4991 (secure 0 0 0) 0x7f1ff401f090 con 0x7f200015d100 2023-11-04T01:48:10.773 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:48:10.773 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":118,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/1202889032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6835","nonce":1202889032},{"type":"v1","addr":"172.21.15.122:6837","nonce":1202889032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2985885329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2985885329},{"type":"v1","addr":"172.21.15.77:6835","nonce":2985885329}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":118,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:43:26.273417+0000","modified":"2023-11-04T01:48:05.636076+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7033,"mds_1":8583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7033":{"gid":7033,"name":"b","rank":0,"incarnation":109,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6836/2238841748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":2238841748},{"type":"v1","addr":"172.21.15.122:6836","nonce":2238841748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8583":{"gid":8583,"name":"c","rank":1,"incarnation":112,"state":"up:active","state_seq":7,"addr":"172.21.15.77:6833/1157837717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1157837717},{"type":"v1","addr":"172.21.15.77:6833","nonce":1157837717}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:48:05.636076+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:48:10.774 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 118 2023-11-04T01:48:10.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.773+0000 7f200554c640 1 -- 172.21.15.77:0/3042261961 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1fec06ae70 msgr2=0x7f1fec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:10.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.773+0000 7f200554c640 1 --2- 172.21.15.77:0/3042261961 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1fec06ae70 0x7f1fec06d330 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0035000 tx=0x7f1ff0008030 comp rx=0 tx=0).stop 2023-11-04T01:48:10.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.773+0000 7f200554c640 1 -- 172.21.15.77:0/3042261961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f200015d100 msgr2=0x7f20001600a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:10.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.773+0000 7f200554c640 1 --2- 172.21.15.77:0/3042261961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f200015d100 0x7f20001600a0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f1ff400c7f0 tx=0x7f1ff400ccb0 comp rx=0 tx=0).stop 2023-11-04T01:48:10.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.773+0000 7f200554c640 1 -- 172.21.15.77:0/3042261961 shutdown_connections 2023-11-04T01:48:10.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.773+0000 7f200554c640 1 --2- 172.21.15.77:0/3042261961 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f1fec06ae70 0x7f1fec06d330 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:10.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.773+0000 7f200554c640 1 --2- 172.21.15.77:0/3042261961 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f200015d4e0 0x7f20000cb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:10.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.773+0000 7f200554c640 1 --2- 172.21.15.77:0/3042261961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f200015d100 0x7f20001600a0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:10.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.773+0000 7f200554c640 1 --2- 172.21.15.77:0/3042261961 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f20000d3b60 0x7f200015e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:10.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.773+0000 7f200554c640 1 -- 172.21.15.77:0/3042261961 >> 172.21.15.77:0/3042261961 conn(0x7f20000d2ef0 msgr2=0x7f200006ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:10.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.773+0000 7f200554c640 1 -- 172.21.15.77:0/3042261961 shutdown_connections 2023-11-04T01:48:10.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:10.773+0000 7f200554c640 1 -- 172.21.15.77:0/3042261961 wait complete. 2023-11-04T01:48:10.786 DEBUG:tasks.ceph_test_case:wait_until_true: success in 20s and 0 retries 2023-11-04T01:48:10.786 DEBUG:teuthology.orchestra.run.smithi077:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:48:10.812 INFO:teuthology.orchestra.run.smithi077.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:48:10.813 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:48:10.814 DEBUG:teuthology.orchestra.run.smithi077:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:48:10.882 INFO:teuthology.orchestra.run.smithi077.stdout:1699062468.156520.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i c', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:48:10.883 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062468.156520.core'] 2023-11-04T01:48:10.884 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062468.156520.core, deleting it 2023-11-04T01:48:10.884 DEBUG:teuthology.orchestra.run.smithi077:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062468.156520.core 2023-11-04T01:48:10.953 INFO:tasks.cephfs.mount:Killing connection on ubuntu@smithi077.front.sepia.ceph.com... 2023-11-04T01:48:10.954 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:48:10.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:48:10.955 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 down 2023-11-04T01:48:11.021 INFO:tasks.cephfs.mount:Cleaning up killed connection on ubuntu@smithi077.front.sepia.ceph.com 2023-11-04T01:48:11.022 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:48:11.022 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:48:11.076 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:48:11.117 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:2023-11-04T01:48:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:48:11.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.214+0000 7fcf379cc640 1 Processor -- start 2023-11-04T01:48:11.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.214+0000 7fcf379cc640 1 -- start start 2023-11-04T01:48:11.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.215+0000 7fcf379cc640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fcf3015b200 0x7fcf300ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.215+0000 7fcf379cc640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcf300cd9c0 0x7fcf300ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.215+0000 7fcf379cc640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf300cde80 con 0x7fcf300afda0 2023-11-04T01:48:11.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.215+0000 7fcf379cc640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf300cf670 con 0x7fcf300cd9c0 2023-11-04T01:48:11.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.215+0000 7fcf379cc640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf300cf950 con 0x7fcf3015b200 2023-11-04T01:48:11.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.215+0000 7fcf35f69640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcf300cd9c0 0x7fcf300ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.215+0000 7fcf35f69640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcf300cd9c0 0x7fcf300ae2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60678/0 (socket says 172.21.15.77:60678) 2023-11-04T01:48:11.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.215+0000 7fcf35f69640 1 -- 172.21.15.77:0/248925290 learned_addr learned my addr 172.21.15.77:0/248925290 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:48:11.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.216+0000 7fcf35768640 1 --2- 172.21.15.77:0/248925290 >> v2:172.21.15.122:3300/0 conn(0x7fcf3015b200 0x7fcf300ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.216+0000 7fcf35f69640 1 -- 172.21.15.77:0/248925290 >> v2:172.21.15.122:3300/0 conn(0x7fcf3015b200 msgr2=0x7fcf300ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:11.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.216+0000 7fcf35f69640 1 --2- 172.21.15.77:0/248925290 >> v2:172.21.15.122:3300/0 conn(0x7fcf3015b200 0x7fcf300ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.216+0000 7fcf35f69640 1 -- 172.21.15.77:0/248925290 >> v1:172.21.15.122:6789/0 conn(0x7fcf300afda0 legacy=0x7fcf300cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:11.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.216+0000 7fcf35f69640 1 -- 172.21.15.77:0/248925290 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf300ce120 con 0x7fcf300cd9c0 2023-11-04T01:48:11.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.216+0000 7fcf35f69640 1 --2- 172.21.15.77:0/248925290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf300cd9c0 0x7fcf300ae2b0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fcf30070130 tx=0x7fcf2802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a8b63c440761df server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:11.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.217+0000 7fcf27fff640 1 -- 172.21.15.77:0/248925290 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf280317e0 con 0x7fcf300cd9c0 2023-11-04T01:48:11.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.217+0000 7fcf27fff640 1 -- 172.21.15.77:0/248925290 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf28031940 con 0x7fcf300cd9c0 2023-11-04T01:48:11.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.217+0000 7fcf27fff640 1 -- 172.21.15.77:0/248925290 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf28031cd0 con 0x7fcf300cd9c0 2023-11-04T01:48:11.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.217+0000 7fcf379cc640 1 -- 172.21.15.77:0/248925290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf300cd9c0 msgr2=0x7fcf300ae2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:11.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.217+0000 7fcf379cc640 1 --2- 172.21.15.77:0/248925290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf300cd9c0 0x7fcf300ae2b0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fcf30070130 tx=0x7fcf2802b880 comp rx=0 tx=0).stop 2023-11-04T01:48:11.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.217+0000 7fcf379cc640 1 -- 172.21.15.77:0/248925290 shutdown_connections 2023-11-04T01:48:11.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.217+0000 7fcf379cc640 1 --2- 172.21.15.77:0/248925290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf300cd9c0 0x7fcf300ae2b0 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.217+0000 7fcf379cc640 1 --2- 172.21.15.77:0/248925290 >> v2:172.21.15.122:3300/0 conn(0x7fcf3015b200 0x7fcf300ceb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.217+0000 7fcf379cc640 1 -- 172.21.15.77:0/248925290 >> 172.21.15.77:0/248925290 conn(0x7fcf300d0c30 msgr2=0x7fcf300d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:11.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.217+0000 7fcf379cc640 1 -- 172.21.15.77:0/248925290 shutdown_connections 2023-11-04T01:48:11.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.217+0000 7fcf379cc640 1 -- 172.21.15.77:0/248925290 wait complete. 2023-11-04T01:48:11.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.218+0000 7fcf379cc640 1 Processor -- start 2023-11-04T01:48:11.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.218+0000 7fcf379cc640 1 -- start start 2023-11-04T01:48:11.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.219+0000 7fcf379cc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf300afda0 0x7fcf300caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.219+0000 7fcf379cc640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcf300cd9c0 0x7fcf3006c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.219+0000 7fcf379cc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf3015b200 0x7fcf30151320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.219+0000 7fcf379cc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf300cb010 con 0x7fcf300afda0 2023-11-04T01:48:11.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.219+0000 7fcf379cc640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3006cb30 con 0x7fcf3015b200 2023-11-04T01:48:11.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.219+0000 7fcf379cc640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf30151860 con 0x7fcf300cd9c0 2023-11-04T01:48:11.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.219+0000 7fcf35768640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf300afda0 0x7fcf300caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.219+0000 7fcf35768640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf300afda0 0x7fcf300caad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60682/0 (socket says 172.21.15.77:60682) 2023-11-04T01:48:11.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.219+0000 7fcf35768640 1 -- 172.21.15.77:0/2523111773 learned_addr learned my addr 172.21.15.77:0/2523111773 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:48:11.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.219+0000 7fcf34f67640 1 --2- 172.21.15.77:0/2523111773 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcf300cd9c0 0x7fcf3006c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.219+0000 7fcf35f69640 1 --2- 172.21.15.77:0/2523111773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf3015b200 0x7fcf30151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.219+0000 7fcf35768640 1 -- 172.21.15.77:0/2523111773 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcf300cd9c0 msgr2=0x7fcf3006c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:11.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.219+0000 7fcf35768640 1 --2- 172.21.15.77:0/2523111773 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcf300cd9c0 0x7fcf3006c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.219+0000 7fcf35768640 1 -- 172.21.15.77:0/2523111773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf3015b200 msgr2=0x7fcf30151320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:11.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.219+0000 7fcf35768640 1 --2- 172.21.15.77:0/2523111773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf3015b200 0x7fcf30151320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.219+0000 7fcf35768640 1 -- 172.21.15.77:0/2523111773 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf280094d0 con 0x7fcf300afda0 2023-11-04T01:48:11.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.219+0000 7fcf34f67640 1 --2- 172.21.15.77:0/2523111773 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcf300cd9c0 0x7fcf3006c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:11.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.220+0000 7fcf35768640 1 --2- 172.21.15.77:0/2523111773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf300afda0 0x7fcf300caad0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c007ef0 tx=0x7fcf2c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:11.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.220+0000 7fcf25ffb640 1 -- 172.21.15.77:0/2523111773 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c014620 con 0x7fcf300afda0 2023-11-04T01:48:11.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.220+0000 7fcf25ffb640 1 -- 172.21.15.77:0/2523111773 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2c00ee90 con 0x7fcf300afda0 2023-11-04T01:48:11.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.220+0000 7fcf379cc640 1 -- 172.21.15.77:0/2523111773 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf3006b550 con 0x7fcf300afda0 2023-11-04T01:48:11.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.220+0000 7fcf25ffb640 1 -- 172.21.15.77:0/2523111773 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c0149c0 con 0x7fcf300afda0 2023-11-04T01:48:11.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.220+0000 7fcf379cc640 1 -- 172.21.15.77:0/2523111773 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf3006bb10 con 0x7fcf300afda0 2023-11-04T01:48:11.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.221+0000 7fcf379cc640 1 -- 172.21.15.77:0/2523111773 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf300684b0 con 0x7fcf300afda0 2023-11-04T01:48:11.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.221+0000 7fcf25ffb640 1 -- 172.21.15.77:0/2523111773 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcf2c014b20 con 0x7fcf300afda0 2023-11-04T01:48:11.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.222+0000 7fcf25ffb640 1 --2- 172.21.15.77:0/2523111773 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcf1406ae70 0x7fcf1406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.222+0000 7fcf25ffb640 1 -- 172.21.15.77:0/2523111773 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8195+0+0 (secure 0 0 0) 0x7fcf2c08a9d0 con 0x7fcf300afda0 2023-11-04T01:48:11.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.222+0000 7fcf34f67640 1 --2- 172.21.15.77:0/2523111773 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcf1406ae70 0x7fcf1406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.222+0000 7fcf34f67640 1 --2- 172.21.15.77:0/2523111773 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcf1406ae70 0x7fcf1406d330 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fcf300b6ba0 tx=0x7fcf20009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:11.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.226+0000 7fcf25ffb640 1 -- 172.21.15.77:0/2523111773 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcf2c055070 con 0x7fcf300afda0 2023-11-04T01:48:11.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.396+0000 7fcf379cc640 1 -- 172.21.15.77:0/2523111773 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf30073600 con 0x7fcf300afda0 2023-11-04T01:48:11.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.398+0000 7fcf25ffb640 1 -- 172.21.15.77:0/2523111773 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) v1 ==== 74+0+23645 (secure 0 0 0) 0x7fcf2c058690 con 0x7fcf300afda0 2023-11-04T01:48:11.399 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:48:11.400 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":117,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:48:00.635277+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:33.159064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:33.647358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:43:24.372767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-04T01:43:25.241976+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":14,"snap_epoch":116,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.7","mappings":[{"from":0,"to":5}]},{"pgid":"17.3f","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/2955237098":"2023-11-04T02:47:38.484200+0000","172.21.15.77:6835/2107153526":"2023-11-05T01:47:23.380657+0000","192.168.0.1:0/2249624526":"2023-11-04T02:46:54.400007+0000","172.21.15.122:6834/1450731169":"2023-11-05T01:46:46.102329+0000","172.21.15.77:6834/3276812155":"2023-11-05T01:46:39.299125+0000","172.21.15.77:6832/3276812155":"2023-11-05T01:46:39.299125+0000","172.21.15.122:6836/1450731169":"2023-11-05T01:46:46.102329+0000","172.21.15.122:6834/3699147778":"2023-11-05T01:44:11.242543+0000","172.21.15.122:6836/3699147778":"2023-11-05T01:44:11.242543+0000","172.21.15.77:6834/4241784871":"2023-11-05T01:44:36.807284+0000","172.21.15.122:6834/2908314953":"2023-11-05T01:45:01.982045+0000","172.21.15.77:6834/285184758":"2023-11-05T01:45:27.182069+0000","172.21.15.77:6833/2107153526":"2023-11-05T01:47:23.380657+0000","172.21.15.122:6836/2908314953":"2023-11-05T01:45:01.982045+0000","172.21.15.77:6834/4183807043":"2023-11-05T01:47:30.639992+0000","172.21.15.122:6836/1345816612":"2023-11-05T01:45:54.789240+0000","172.21.15.77:6832/285184758":"2023-11-05T01:45:27.182069+0000","172.21.15.122:6834/1345816612":"2023-11-05T01:45:54.789240+0000","172.21.15.77:6833/3207490604":"2023-11-05T01:46:01.591697+0000","172.21.15.77:6832/4183807043":"2023-11-05T01:47:30.639992+0000","172.21.15.77:6832/4241784871":"2023-11-05T01:44:36.807284+0000","172.21.15.77:6835/3207490604":"2023-11-05T01:46:01.591697+0000","192.168.0.1:0/3032548059":"2023-11-04T02:46:09.897134+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":17,"snaps":[{"begin":11,"length":4}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:48:11.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.400+0000 7fcf379cc640 1 -- 172.21.15.77:0/2523111773 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcf1406ae70 msgr2=0x7fcf1406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:11.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.400+0000 7fcf379cc640 1 --2- 172.21.15.77:0/2523111773 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcf1406ae70 0x7fcf1406d330 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fcf300b6ba0 tx=0x7fcf20009040 comp rx=0 tx=0).stop 2023-11-04T01:48:11.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.400+0000 7fcf379cc640 1 -- 172.21.15.77:0/2523111773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf300afda0 msgr2=0x7fcf300caad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:11.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.400+0000 7fcf379cc640 1 --2- 172.21.15.77:0/2523111773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf300afda0 0x7fcf300caad0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c007ef0 tx=0x7fcf2c00e4b0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.400+0000 7fcf379cc640 1 -- 172.21.15.77:0/2523111773 shutdown_connections 2023-11-04T01:48:11.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.400+0000 7fcf379cc640 1 --2- 172.21.15.77:0/2523111773 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fcf1406ae70 0x7fcf1406d330 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.400+0000 7fcf379cc640 1 --2- 172.21.15.77:0/2523111773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf3015b200 0x7fcf30151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.400+0000 7fcf379cc640 1 --2- 172.21.15.77:0/2523111773 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fcf300cd9c0 0x7fcf3006c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.400+0000 7fcf379cc640 1 --2- 172.21.15.77:0/2523111773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf300afda0 0x7fcf300caad0 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.400+0000 7fcf379cc640 1 -- 172.21.15.77:0/2523111773 >> 172.21.15.77:0/2523111773 conn(0x7fcf300d0c30 msgr2=0x7fcf3006dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:11.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.400+0000 7fcf379cc640 1 -- 172.21.15.77:0/2523111773 shutdown_connections 2023-11-04T01:48:11.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.400+0000 7fcf379cc640 1 -- 172.21.15.77:0/2523111773 wait complete. 2023-11-04T01:48:11.412 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:33.142176+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:42:33.159064+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:42:33.647358+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:43:24.372767+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:43:25.241976+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 14, 'snap_epoch': 116, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:48:11.413 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:48:11.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.514+0000 7f9a7257c640 1 Processor -- start 2023-11-04T01:48:11.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.514+0000 7f9a7257c640 1 -- start start 2023-11-04T01:48:11.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.515+0000 7f9a7257c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9a6c159e40 0x7f9a6c0b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.515+0000 7f9a7257c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a6c071500 con 0x7f9a6c06bb60 2023-11-04T01:48:11.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.515+0000 7f9a7257c640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a6c15dae0 con 0x7f9a6c070700 2023-11-04T01:48:11.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.515+0000 7f9a7257c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a6c070c60 con 0x7f9a6c159e40 2023-11-04T01:48:11.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.515+0000 7f9a6bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9a6c159e40 0x7f9a6c0b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.515+0000 7f9a6bfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9a6c159e40 0x7f9a6c0b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60684/0 (socket says 172.21.15.77:60684) 2023-11-04T01:48:11.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.515+0000 7f9a6bfff640 1 -- 172.21.15.77:0/2105891855 learned_addr learned my addr 172.21.15.77:0/2105891855 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:48:11.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.515+0000 7f9a6b7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f9a6c06bb60 0x7f9a6c06fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35742/0 (socket says 172.21.15.77:35742) 2023-11-04T01:48:11.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.515+0000 7f9a6bfff640 1 -- 172.21.15.77:0/2105891855 >> v1:172.21.15.122:6789/0 conn(0x7f9a6c070700 legacy=0x7f9a6c0cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:11.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.515+0000 7f9a6bfff640 1 -- 172.21.15.77:0/2105891855 >> v1:172.21.15.77:6789/0 conn(0x7f9a6c06bb60 legacy=0x7f9a6c06fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:11.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.515+0000 7f9a6bfff640 1 -- 172.21.15.77:0/2105891855 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a6c070f40 con 0x7f9a6c159e40 2023-11-04T01:48:11.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.516+0000 7f9a6bfff640 1 --2- 172.21.15.77:0/2105891855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a6c159e40 0x7f9a6c0b0530 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00bb10 tx=0x7f9a5c02e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c127b2d92618a57 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:11.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.516+0000 7f9a6affd640 1 -- 172.21.15.77:0/2105891855 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c02ee90 con 0x7f9a6c159e40 2023-11-04T01:48:11.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.516+0000 7f9a6affd640 1 -- 172.21.15.77:0/2105891855 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5c036440 con 0x7f9a6c159e40 2023-11-04T01:48:11.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.516+0000 7f9a6affd640 1 -- 172.21.15.77:0/2105891855 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c0367d0 con 0x7f9a6c159e40 2023-11-04T01:48:11.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.517+0000 7f9a7257c640 1 -- 172.21.15.77:0/2105891855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a6c159e40 msgr2=0x7f9a6c0b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:11.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.517+0000 7f9a7257c640 1 --2- 172.21.15.77:0/2105891855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a6c159e40 0x7f9a6c0b0530 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00bb10 tx=0x7f9a5c02e0e0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.517+0000 7f9a7257c640 1 -- 172.21.15.77:0/2105891855 shutdown_connections 2023-11-04T01:48:11.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.517+0000 7f9a7257c640 1 --2- 172.21.15.77:0/2105891855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a6c159e40 0x7f9a6c0b0530 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.517+0000 7f9a7257c640 1 -- 172.21.15.77:0/2105891855 >> 172.21.15.77:0/2105891855 conn(0x7f9a6c0cb530 msgr2=0x7f9a6c0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:11.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.517+0000 7f9a7257c640 1 -- 172.21.15.77:0/2105891855 shutdown_connections 2023-11-04T01:48:11.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.517+0000 7f9a7257c640 1 -- 172.21.15.77:0/2105891855 wait complete. 2023-11-04T01:48:11.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.518+0000 7f9a7257c640 1 Processor -- start 2023-11-04T01:48:11.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.518+0000 7f9a7257c640 1 -- start start 2023-11-04T01:48:11.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.519+0000 7f9a7257c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a6c06bb60 0x7f9a6c15cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.519+0000 7f9a7257c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a6c070700 0x7f9a6c0c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.519+0000 7f9a7257c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9a6c159e40 0x7f9a6c146bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.519+0000 7f9a7257c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c0c7540 con 0x7f9a6c06bb60 2023-11-04T01:48:11.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.519+0000 7f9a7257c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c0c7820 con 0x7f9a6c070700 2023-11-04T01:48:11.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.519+0000 7f9a7257c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c0c7b00 con 0x7f9a6c159e40 2023-11-04T01:48:11.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.519+0000 7f9a6bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a6c06bb60 0x7f9a6c15cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.519+0000 7f9a6bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a6c06bb60 0x7f9a6c15cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60696/0 (socket says 172.21.15.77:60696) 2023-11-04T01:48:11.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.519+0000 7f9a6bfff640 1 -- 172.21.15.77:0/35860469 learned_addr learned my addr 172.21.15.77:0/35860469 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:48:11.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.519+0000 7f9a6b7fe640 1 --2- 172.21.15.77:0/35860469 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a6c070700 0x7f9a6c0c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.519+0000 7f9a70b19640 1 --2- 172.21.15.77:0/35860469 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9a6c159e40 0x7f9a6c146bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.519+0000 7f9a6bfff640 1 -- 172.21.15.77:0/35860469 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9a6c159e40 msgr2=0x7f9a6c146bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:11.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.519+0000 7f9a6bfff640 1 --2- 172.21.15.77:0/35860469 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9a6c159e40 0x7f9a6c146bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.519+0000 7f9a6bfff640 1 -- 172.21.15.77:0/35860469 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a6c070700 msgr2=0x7f9a6c0c6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:11.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.519+0000 7f9a6bfff640 1 --2- 172.21.15.77:0/35860469 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a6c070700 0x7f9a6c0c6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.519+0000 7f9a6bfff640 1 -- 172.21.15.77:0/35860469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5c00b770 con 0x7f9a6c06bb60 2023-11-04T01:48:11.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.519+0000 7f9a70b19640 1 --2- 172.21.15.77:0/35860469 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9a6c159e40 0x7f9a6c146bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:11.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.519+0000 7f9a6bfff640 1 --2- 172.21.15.77:0/35860469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a6c06bb60 0x7f9a6c15cbf0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c02e120 tx=0x7f9a5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:11.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.520+0000 7f9a68ff9640 1 -- 172.21.15.77:0/35860469 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c034b80 con 0x7f9a6c06bb60 2023-11-04T01:48:11.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.520+0000 7f9a68ff9640 1 -- 172.21.15.77:0/35860469 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5c034ce0 con 0x7f9a6c06bb60 2023-11-04T01:48:11.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.520+0000 7f9a68ff9640 1 -- 172.21.15.77:0/35860469 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c041680 con 0x7f9a6c06bb60 2023-11-04T01:48:11.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.520+0000 7f9a7257c640 1 -- 172.21.15.77:0/35860469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a6c0c7de0 con 0x7f9a6c06bb60 2023-11-04T01:48:11.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.520+0000 7f9a7257c640 1 -- 172.21.15.77:0/35860469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a6c15d130 con 0x7f9a6c06bb60 2023-11-04T01:48:11.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.521+0000 7f9a7257c640 1 -- 172.21.15.77:0/35860469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a6c0c85e0 con 0x7f9a6c06bb60 2023-11-04T01:48:11.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.521+0000 7f9a68ff9640 1 -- 172.21.15.77:0/35860469 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9a5c03d040 con 0x7f9a6c06bb60 2023-11-04T01:48:11.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.521+0000 7f9a68ff9640 1 --2- 172.21.15.77:0/35860469 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9a5806ae70 0x7f9a5806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.522+0000 7f9a68ff9640 1 -- 172.21.15.77:0/35860469 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f9a5c0aef80 con 0x7f9a6c06bb60 2023-11-04T01:48:11.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.522+0000 7f9a6b7fe640 1 --2- 172.21.15.77:0/35860469 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9a5806ae70 0x7f9a5806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.522+0000 7f9a6b7fe640 1 --2- 172.21.15.77:0/35860469 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9a5806ae70 0x7f9a5806d330 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c0c40e0 tx=0x7f9a60007c80 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:11.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.526+0000 7f9a68ff9640 1 -- 172.21.15.77:0/35860469 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9a5c0e1ca0 con 0x7f9a6c06bb60 2023-11-04T01:48:11.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.691+0000 7f9a7257c640 1 -- 172.21.15.77:0/35860469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9a6c15d2c0 con 0x7f9a6c06bb60 2023-11-04T01:48:11.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.692+0000 7f9a68ff9640 1 -- 172.21.15.77:0/35860469 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v117) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9a5c03b020 con 0x7f9a6c06bb60 2023-11-04T01:48:11.694 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:48:11.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.694+0000 7f9a7257c640 1 -- 172.21.15.77:0/35860469 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9a5806ae70 msgr2=0x7f9a5806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:11.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.694+0000 7f9a7257c640 1 --2- 172.21.15.77:0/35860469 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9a5806ae70 0x7f9a5806d330 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c0c40e0 tx=0x7f9a60007c80 comp rx=0 tx=0).stop 2023-11-04T01:48:11.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.694+0000 7f9a7257c640 1 -- 172.21.15.77:0/35860469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a6c06bb60 msgr2=0x7f9a6c15cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:11.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.694+0000 7f9a7257c640 1 --2- 172.21.15.77:0/35860469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a6c06bb60 0x7f9a6c15cbf0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c02e120 tx=0x7f9a5c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.694+0000 7f9a7257c640 1 -- 172.21.15.77:0/35860469 shutdown_connections 2023-11-04T01:48:11.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.694+0000 7f9a7257c640 1 --2- 172.21.15.77:0/35860469 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9a5806ae70 0x7f9a5806d330 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.694+0000 7f9a7257c640 1 --2- 172.21.15.77:0/35860469 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9a6c159e40 0x7f9a6c146bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.694+0000 7f9a7257c640 1 --2- 172.21.15.77:0/35860469 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a6c070700 0x7f9a6c0c6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.694+0000 7f9a7257c640 1 --2- 172.21.15.77:0/35860469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a6c06bb60 0x7f9a6c15cbf0 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.694+0000 7f9a7257c640 1 -- 172.21.15.77:0/35860469 >> 172.21.15.77:0/35860469 conn(0x7f9a6c0cb530 msgr2=0x7f9a6c0ce9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:11.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.694+0000 7f9a7257c640 1 -- 172.21.15.77:0/35860469 shutdown_connections 2023-11-04T01:48:11.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.694+0000 7f9a7257c640 1 -- 172.21.15.77:0/35860469 wait complete. 2023-11-04T01:48:11.706 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:48:11.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.808+0000 7f0e65c44640 1 Processor -- start 2023-11-04T01:48:11.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.808+0000 7f0e65c44640 1 -- start start 2023-11-04T01:48:11.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.808+0000 7f0e65c44640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e6015d100 0x7f0e600ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.808+0000 7f0e65c44640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e600b32b0 con 0x7f0e6015d4e0 2023-11-04T01:48:11.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.808+0000 7f0e65c44640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e600cee10 con 0x7f0e600d1be0 2023-11-04T01:48:11.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.808+0000 7f0e65c44640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e600b2980 con 0x7f0e6015d100 2023-11-04T01:48:11.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.809+0000 7f0e5effd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f0e6015d4e0 0x7f0e600d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35748/0 (socket says 172.21.15.77:35748) 2023-11-04T01:48:11.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.809+0000 7f0e5effd640 1 -- 172.21.15.77:0/1366149991 learned_addr learned my addr 172.21.15.77:0/1366149991 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:48:11.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.809+0000 7f0e5e7fc640 1 -- 172.21.15.77:0/1366149991 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2982699435 0 0) 0x7f0e600b32b0 con 0x7f0e6015d4e0 2023-11-04T01:48:11.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.809+0000 7f0e5f7fe640 1 --2- 172.21.15.77:0/1366149991 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e6015d100 0x7f0e600ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.809+0000 7f0e5e7fc640 1 -- 172.21.15.77:0/1366149991 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e48003520 con 0x7f0e6015d4e0 2023-11-04T01:48:11.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.809+0000 7f0e5e7fc640 1 -- 172.21.15.77:0/1366149991 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3920634873 0 0) 0x7f0e48003520 con 0x7f0e6015d4e0 2023-11-04T01:48:11.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.809+0000 7f0e5e7fc640 1 -- 172.21.15.77:0/1366149991 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e6015d100 msgr2=0x7f0e600ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:11.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.809+0000 7f0e5e7fc640 1 --2- 172.21.15.77:0/1366149991 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e6015d100 0x7f0e600ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.809+0000 7f0e5e7fc640 1 -- 172.21.15.77:0/1366149991 >> v1:172.21.15.122:6789/0 conn(0x7f0e600d1be0 legacy=0x7f0e600b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:11.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.809+0000 7f0e5e7fc640 1 -- 172.21.15.77:0/1366149991 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e600b2c60 con 0x7f0e6015d4e0 2023-11-04T01:48:11.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.809+0000 7f0e5e7fc640 1 -- 172.21.15.77:0/1366149991 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f0e54001670 con 0x7f0e6015d4e0 2023-11-04T01:48:11.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.809+0000 7f0e5e7fc640 1 -- 172.21.15.77:0/1366149991 >> v1:172.21.15.77:6789/0 conn(0x7f0e6015d4e0 legacy=0x7f0e600d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:11.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.809+0000 7f0e5e7fc640 1 --2- 172.21.15.77:0/1366149991 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e6015d100 0x7f0e480039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.809+0000 7f0e5e7fc640 1 --2- 172.21.15.77:0/1366149991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e48003f20 0x7f0e480047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.809+0000 7f0e5e7fc640 1 --2- 172.21.15.77:0/1366149991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e48004d00 0x7f0e48005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.809+0000 7f0e5e7fc640 1 -- 172.21.15.77:0/1366149991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e600b2980 con 0x7f0e48003f20 2023-11-04T01:48:11.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.809+0000 7f0e5e7fc640 1 -- 172.21.15.77:0/1366149991 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e48014270 con 0x7f0e48004d00 2023-11-04T01:48:11.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.809+0000 7f0e5e7fc640 1 -- 172.21.15.77:0/1366149991 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e48014430 con 0x7f0e6015d100 2023-11-04T01:48:11.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.809+0000 7f0e5effd640 1 --2- 172.21.15.77:0/1366149991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e48003f20 0x7f0e480047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.809+0000 7f0e5f7fe640 1 --2- 172.21.15.77:0/1366149991 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e6015d100 0x7f0e480039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.809+0000 7f0e5ffff640 1 --2- 172.21.15.77:0/1366149991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e48004d00 0x7f0e48005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.810+0000 7f0e5effd640 1 -- 172.21.15.77:0/1366149991 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e6015d100 msgr2=0x7f0e480039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:11.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.810+0000 7f0e5effd640 1 --2- 172.21.15.77:0/1366149991 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e6015d100 0x7f0e480039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.810+0000 7f0e5effd640 1 -- 172.21.15.77:0/1366149991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e48004d00 msgr2=0x7f0e48005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:11.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.810+0000 7f0e5effd640 1 --2- 172.21.15.77:0/1366149991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e48004d00 0x7f0e48005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.810+0000 7f0e5effd640 1 -- 172.21.15.77:0/1366149991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e48003520 con 0x7f0e48003f20 2023-11-04T01:48:11.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.810+0000 7f0e5effd640 1 --2- 172.21.15.77:0/1366149991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e48003f20 0x7f0e480047c0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f0e5400c240 tx=0x7f0e480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=552ae67692569fb6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:11.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.810+0000 7f0e5e7fc640 1 -- 172.21.15.77:0/1366149991 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e54005ad0 con 0x7f0e48003f20 2023-11-04T01:48:11.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.810+0000 7f0e5e7fc640 1 -- 172.21.15.77:0/1366149991 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e54005c30 con 0x7f0e48003f20 2023-11-04T01:48:11.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.810+0000 7f0e5e7fc640 1 -- 172.21.15.77:0/1366149991 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5402caf0 con 0x7f0e48003f20 2023-11-04T01:48:11.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.811+0000 7f0e65c44640 1 -- 172.21.15.77:0/1366149991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e48003f20 msgr2=0x7f0e480047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:11.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.811+0000 7f0e65c44640 1 --2- 172.21.15.77:0/1366149991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e48003f20 0x7f0e480047c0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f0e5400c240 tx=0x7f0e480057f0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.811+0000 7f0e5ffff640 1 -- 172.21.15.77:0/1366149991 reap_dead start 2023-11-04T01:48:11.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.811+0000 7f0e65c44640 1 -- 172.21.15.77:0/1366149991 shutdown_connections 2023-11-04T01:48:11.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.811+0000 7f0e65c44640 1 -- 172.21.15.77:0/1366149991 >> 172.21.15.77:0/1366149991 conn(0x7f0e600d2ef0 msgr2=0x7f0e600d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:11.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.811+0000 7f0e65c44640 1 -- 172.21.15.77:0/1366149991 shutdown_connections 2023-11-04T01:48:11.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.811+0000 7f0e65c44640 1 -- 172.21.15.77:0/1366149991 wait complete. 2023-11-04T01:48:11.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.812+0000 7f0e65c44640 1 Processor -- start 2023-11-04T01:48:11.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.812+0000 7f0e65c44640 1 -- start start 2023-11-04T01:48:11.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.813+0000 7f0e65c44640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e48003f20 0x7f0e6015ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.813+0000 7f0e65c44640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e600cbe20 0x7f0e60158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.813+0000 7f0e65c44640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e600cc2a0 0x7f0e60158540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.813+0000 7f0e65c44640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6015dc30 con 0x7f0e48003f20 2023-11-04T01:48:11.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.813+0000 7f0e65c44640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6015df10 con 0x7f0e600cbe20 2023-11-04T01:48:11.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.813+0000 7f0e65c44640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6015e1f0 con 0x7f0e600cc2a0 2023-11-04T01:48:11.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.813+0000 7f0e5f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e48003f20 0x7f0e6015ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.813+0000 7f0e5f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e48003f20 0x7f0e6015ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60718/0 (socket says 172.21.15.77:60718) 2023-11-04T01:48:11.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.813+0000 7f0e5f7fe640 1 -- 172.21.15.77:0/3398746810 learned_addr learned my addr 172.21.15.77:0/3398746810 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:48:11.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.813+0000 7f0e5effd640 1 --2- 172.21.15.77:0/3398746810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e600cbe20 0x7f0e60158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.813+0000 7f0e5ffff640 1 --2- 172.21.15.77:0/3398746810 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e600cc2a0 0x7f0e60158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.813+0000 7f0e5f7fe640 1 -- 172.21.15.77:0/3398746810 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e600cc2a0 msgr2=0x7f0e60158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:11.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.813+0000 7f0e5f7fe640 1 --2- 172.21.15.77:0/3398746810 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e600cc2a0 0x7f0e60158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.813+0000 7f0e5f7fe640 1 -- 172.21.15.77:0/3398746810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e600cbe20 msgr2=0x7f0e60158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:11.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.813+0000 7f0e5f7fe640 1 --2- 172.21.15.77:0/3398746810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e600cbe20 0x7f0e60158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.813+0000 7f0e5f7fe640 1 -- 172.21.15.77:0/3398746810 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e6015e4d0 con 0x7f0e48003f20 2023-11-04T01:48:11.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.813+0000 7f0e5f7fe640 1 --2- 172.21.15.77:0/3398746810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e48003f20 0x7f0e6015ecd0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f0e50011960 tx=0x7f0e50011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:11.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.814+0000 7f0e47fff640 1 -- 172.21.15.77:0/3398746810 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e50005ba0 con 0x7f0e48003f20 2023-11-04T01:48:11.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.814+0000 7f0e47fff640 1 -- 172.21.15.77:0/3398746810 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e50005d00 con 0x7f0e48003f20 2023-11-04T01:48:11.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.814+0000 7f0e65c44640 1 -- 172.21.15.77:0/3398746810 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e6015e7b0 con 0x7f0e48003f20 2023-11-04T01:48:11.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.814+0000 7f0e47fff640 1 -- 172.21.15.77:0/3398746810 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5000fb00 con 0x7f0e48003f20 2023-11-04T01:48:11.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.814+0000 7f0e65c44640 1 -- 172.21.15.77:0/3398746810 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e6015d8c0 con 0x7f0e48003f20 2023-11-04T01:48:11.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.815+0000 7f0e65c44640 1 -- 172.21.15.77:0/3398746810 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e600684b0 con 0x7f0e48003f20 2023-11-04T01:48:11.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.815+0000 7f0e47fff640 1 -- 172.21.15.77:0/3398746810 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0e5000fc60 con 0x7f0e48003f20 2023-11-04T01:48:11.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.815+0000 7f0e47fff640 1 --2- 172.21.15.77:0/3398746810 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0e4c06ae70 0x7f0e4c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.815+0000 7f0e47fff640 1 -- 172.21.15.77:0/3398746810 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f0e5008a920 con 0x7f0e48003f20 2023-11-04T01:48:11.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.816+0000 7f0e5effd640 1 --2- 172.21.15.77:0/3398746810 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0e4c06ae70 0x7f0e4c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.816+0000 7f0e5effd640 1 --2- 172.21.15.77:0/3398746810 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0e4c06ae70 0x7f0e4c06d330 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f0e54034000 tx=0x7f0e54009030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:11.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.820+0000 7f0e47fff640 1 -- 172.21.15.77:0/3398746810 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0e50055130 con 0x7f0e48003f20 2023-11-04T01:48:11.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.985+0000 7f0e65c44640 1 -- 172.21.15.77:0/3398746810 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f0e600d2cd0 con 0x7f0e48003f20 2023-11-04T01:48:11.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.985+0000 7f0e47fff640 1 -- 172.21.15.77:0/3398746810 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v117) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0e50058750 con 0x7f0e48003f20 2023-11-04T01:48:11.987 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:48:11.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.987+0000 7f0e65c44640 1 -- 172.21.15.77:0/3398746810 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0e4c06ae70 msgr2=0x7f0e4c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:11.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.987+0000 7f0e65c44640 1 --2- 172.21.15.77:0/3398746810 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0e4c06ae70 0x7f0e4c06d330 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f0e54034000 tx=0x7f0e54009030 comp rx=0 tx=0).stop 2023-11-04T01:48:11.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.987+0000 7f0e65c44640 1 -- 172.21.15.77:0/3398746810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e48003f20 msgr2=0x7f0e6015ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:11.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.987+0000 7f0e65c44640 1 --2- 172.21.15.77:0/3398746810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e48003f20 0x7f0e6015ecd0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f0e50011960 tx=0x7f0e50011e20 comp rx=0 tx=0).stop 2023-11-04T01:48:11.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.987+0000 7f0e65c44640 1 -- 172.21.15.77:0/3398746810 shutdown_connections 2023-11-04T01:48:11.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.987+0000 7f0e65c44640 1 --2- 172.21.15.77:0/3398746810 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0e4c06ae70 0x7f0e4c06d330 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.987+0000 7f0e65c44640 1 --2- 172.21.15.77:0/3398746810 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0e600cc2a0 0x7f0e60158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.987+0000 7f0e65c44640 1 --2- 172.21.15.77:0/3398746810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0e600cbe20 0x7f0e60158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.987+0000 7f0e65c44640 1 --2- 172.21.15.77:0/3398746810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e48003f20 0x7f0e6015ecd0 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.987+0000 7f0e65c44640 1 -- 172.21.15.77:0/3398746810 >> 172.21.15.77:0/3398746810 conn(0x7f0e600d2ef0 msgr2=0x7f0e6015c440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:11.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.987+0000 7f0e65c44640 1 -- 172.21.15.77:0/3398746810 shutdown_connections 2023-11-04T01:48:11.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:11.987+0000 7f0e65c44640 1 -- 172.21.15.77:0/3398746810 wait complete. 2023-11-04T01:48:11.999 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:48:12.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.100+0000 7f69415c0640 1 Processor -- start 2023-11-04T01:48:12.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.100+0000 7f69415c0640 1 -- start start 2023-11-04T01:48:12.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.101+0000 7f69415c0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f693c15d100 0x7f693c0ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.101+0000 7f69415c0640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f693c0d1be0 0x7f693c0b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.101+0000 7f69415c0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f693c0b32b0 con 0x7f693c15d4e0 2023-11-04T01:48:12.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.101+0000 7f69415c0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f693c0cee10 con 0x7f693c15d100 2023-11-04T01:48:12.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.101+0000 7f69415c0640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f693c0b2980 con 0x7f693c0d1be0 2023-11-04T01:48:12.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.101+0000 7f693affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f693c15d100 0x7f693c0ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:12.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.101+0000 7f693affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f693c15d100 0x7f693c0ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60728/0 (socket says 172.21.15.77:60728) 2023-11-04T01:48:12.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.101+0000 7f693affd640 1 -- 172.21.15.77:0/4088278472 learned_addr learned my addr 172.21.15.77:0/4088278472 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:48:12.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.101+0000 7f69327fc640 1 --1- 172.21.15.77:0/4088278472 >> v1:172.21.15.77:6789/0 conn(0x7f693c15d4e0 0x7f693c0d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35758/0 (socket says 172.21.15.77:35758) 2023-11-04T01:48:12.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.102+0000 7f693b7fe640 1 --2- 172.21.15.77:0/4088278472 >> v2:172.21.15.122:3300/0 conn(0x7f693c0d1be0 0x7f693c0b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:12.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.102+0000 7f693affd640 1 -- 172.21.15.77:0/4088278472 >> v2:172.21.15.122:3300/0 conn(0x7f693c0d1be0 msgr2=0x7f693c0b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:12.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.102+0000 7f693affd640 1 --2- 172.21.15.77:0/4088278472 >> v2:172.21.15.122:3300/0 conn(0x7f693c0d1be0 0x7f693c0b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.102+0000 7f693affd640 1 -- 172.21.15.77:0/4088278472 >> v1:172.21.15.77:6789/0 conn(0x7f693c15d4e0 legacy=0x7f693c0d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:12.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.102+0000 7f693affd640 1 -- 172.21.15.77:0/4088278472 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693c0b2c60 con 0x7f693c15d100 2023-11-04T01:48:12.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.102+0000 7f693affd640 1 --2- 172.21.15.77:0/4088278472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f693c15d100 0x7f693c0ce510 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f693c08d6a0 tx=0x7f692c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef9603cd855309cb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:12.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.103+0000 7f693a7fc640 1 -- 172.21.15.77:0/4088278472 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692c004230 con 0x7f693c15d100 2023-11-04T01:48:12.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.103+0000 7f693a7fc640 1 -- 172.21.15.77:0/4088278472 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692c004390 con 0x7f693c15d100 2023-11-04T01:48:12.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.103+0000 7f693a7fc640 1 -- 172.21.15.77:0/4088278472 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692c030840 con 0x7f693c15d100 2023-11-04T01:48:12.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.103+0000 7f69415c0640 1 -- 172.21.15.77:0/4088278472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f693c15d100 msgr2=0x7f693c0ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:12.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.103+0000 7f69415c0640 1 --2- 172.21.15.77:0/4088278472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f693c15d100 0x7f693c0ce510 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f693c08d6a0 tx=0x7f692c02b980 comp rx=0 tx=0).stop 2023-11-04T01:48:12.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.103+0000 7f69415c0640 1 -- 172.21.15.77:0/4088278472 shutdown_connections 2023-11-04T01:48:12.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.103+0000 7f69415c0640 1 --2- 172.21.15.77:0/4088278472 >> v2:172.21.15.122:3300/0 conn(0x7f693c0d1be0 0x7f693c0b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.103+0000 7f69415c0640 1 --2- 172.21.15.77:0/4088278472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f693c15d100 0x7f693c0ce510 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.103+0000 7f69415c0640 1 -- 172.21.15.77:0/4088278472 >> 172.21.15.77:0/4088278472 conn(0x7f693c0d2ef0 msgr2=0x7f693c0d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:12.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.103+0000 7f69415c0640 1 -- 172.21.15.77:0/4088278472 shutdown_connections 2023-11-04T01:48:12.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.103+0000 7f69415c0640 1 -- 172.21.15.77:0/4088278472 wait complete. 2023-11-04T01:48:12.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.104+0000 7f69415c0640 1 Processor -- start 2023-11-04T01:48:12.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.105+0000 7f69415c0640 1 -- start start 2023-11-04T01:48:12.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.105+0000 7f69415c0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f693c0d1be0 0x7f693c0cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.105+0000 7f69415c0640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f693c15d100 0x7f693c1f5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.105+0000 7f69415c0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f693c15d4e0 0x7f693c1f62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.105+0000 7f69415c0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693c0a0d80 con 0x7f693c0d1be0 2023-11-04T01:48:12.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.105+0000 7f69415c0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693c1f6c50 con 0x7f693c15d4e0 2023-11-04T01:48:12.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.105+0000 7f69415c0640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f693c0ca060 con 0x7f693c15d100 2023-11-04T01:48:12.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.105+0000 7f693affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f693c0d1be0 0x7f693c0cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:12.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.105+0000 7f693affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f693c0d1be0 0x7f693c0cb0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60732/0 (socket says 172.21.15.77:60732) 2023-11-04T01:48:12.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.105+0000 7f693affd640 1 -- 172.21.15.77:0/1031014673 learned_addr learned my addr 172.21.15.77:0/1031014673 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:48:12.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.106+0000 7f693affd640 1 -- 172.21.15.77:0/1031014673 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f693c15d100 msgr2=0x7f693c1f5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:12.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.106+0000 7f693affd640 1 --2- 172.21.15.77:0/1031014673 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f693c15d100 0x7f693c1f5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.106+0000 7f693affd640 1 -- 172.21.15.77:0/1031014673 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f693c15d4e0 msgr2=0x7f693c1f62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:12.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.106+0000 7f693affd640 1 --2- 172.21.15.77:0/1031014673 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f693c15d4e0 0x7f693c1f62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.106+0000 7f693affd640 1 -- 172.21.15.77:0/1031014673 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692c009460 con 0x7f693c0d1be0 2023-11-04T01:48:12.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.106+0000 7f693affd640 1 --2- 172.21.15.77:0/1031014673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f693c0d1be0 0x7f693c0cb0a0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f692c000c00 tx=0x7f692c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:12.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.106+0000 7f6933fff640 1 -- 172.21.15.77:0/1031014673 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692c03e070 con 0x7f693c0d1be0 2023-11-04T01:48:12.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.106+0000 7f6933fff640 1 -- 172.21.15.77:0/1031014673 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692c004500 con 0x7f693c0d1be0 2023-11-04T01:48:12.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.106+0000 7f69415c0640 1 -- 172.21.15.77:0/1031014673 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f693c0cb5e0 con 0x7f693c0d1be0 2023-11-04T01:48:12.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.106+0000 7f6933fff640 1 -- 172.21.15.77:0/1031014673 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692c030dc0 con 0x7f693c0d1be0 2023-11-04T01:48:12.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.106+0000 7f69415c0640 1 -- 172.21.15.77:0/1031014673 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f693c0ca5e0 con 0x7f693c0d1be0 2023-11-04T01:48:12.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.107+0000 7f69415c0640 1 -- 172.21.15.77:0/1031014673 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f693c0684b0 con 0x7f693c0d1be0 2023-11-04T01:48:12.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.107+0000 7f6933fff640 1 -- 172.21.15.77:0/1031014673 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f692c003610 con 0x7f693c0d1be0 2023-11-04T01:48:12.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.108+0000 7f6933fff640 1 --2- 172.21.15.77:0/1031014673 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f691c06ae70 0x7f691c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.108+0000 7f6933fff640 1 -- 172.21.15.77:0/1031014673 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f692c0ac250 con 0x7f693c0d1be0 2023-11-04T01:48:12.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.108+0000 7f69327fc640 1 --2- 172.21.15.77:0/1031014673 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f691c06ae70 0x7f691c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:12.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.108+0000 7f69327fc640 1 --2- 172.21.15.77:0/1031014673 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f691c06ae70 0x7f691c06d330 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f693c160750 tx=0x7f69240079c0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:12.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.112+0000 7f6933fff640 1 -- 172.21.15.77:0/1031014673 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f692c076a10 con 0x7f693c0d1be0 2023-11-04T01:48:12.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.279+0000 7f69415c0640 1 -- 172.21.15.77:0/1031014673 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f693c0d2cd0 con 0x7f693c0d1be0 2023-11-04T01:48:12.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.280+0000 7f6933fff640 1 -- 172.21.15.77:0/1031014673 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v117) v1 ==== 103+0+11 (secure 0 0 0) 0x7f692c0480a0 con 0x7f693c0d1be0 2023-11-04T01:48:12.282 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:48:12.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.282+0000 7f69415c0640 1 -- 172.21.15.77:0/1031014673 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f691c06ae70 msgr2=0x7f691c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:12.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.282+0000 7f69415c0640 1 --2- 172.21.15.77:0/1031014673 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f691c06ae70 0x7f691c06d330 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f693c160750 tx=0x7f69240079c0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.282+0000 7f69415c0640 1 -- 172.21.15.77:0/1031014673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f693c0d1be0 msgr2=0x7f693c0cb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:12.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.282+0000 7f69415c0640 1 --2- 172.21.15.77:0/1031014673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f693c0d1be0 0x7f693c0cb0a0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f692c000c00 tx=0x7f692c0046c0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.282+0000 7f69415c0640 1 -- 172.21.15.77:0/1031014673 shutdown_connections 2023-11-04T01:48:12.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.282+0000 7f69415c0640 1 --2- 172.21.15.77:0/1031014673 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f691c06ae70 0x7f691c06d330 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.282+0000 7f69415c0640 1 --2- 172.21.15.77:0/1031014673 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f693c15d4e0 0x7f693c1f62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.282+0000 7f69415c0640 1 --2- 172.21.15.77:0/1031014673 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f693c15d100 0x7f693c1f5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.282+0000 7f69415c0640 1 --2- 172.21.15.77:0/1031014673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f693c0d1be0 0x7f693c0cb0a0 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.282+0000 7f69415c0640 1 -- 172.21.15.77:0/1031014673 >> 172.21.15.77:0/1031014673 conn(0x7f693c0d2ef0 msgr2=0x7f693c0b3740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:12.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.282+0000 7f69415c0640 1 -- 172.21.15.77:0/1031014673 shutdown_connections 2023-11-04T01:48:12.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.282+0000 7f69415c0640 1 -- 172.21.15.77:0/1031014673 wait complete. 2023-11-04T01:48:12.294 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:48:12.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.395+0000 7fb67f6c2640 1 Processor -- start 2023-11-04T01:48:12.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.396+0000 7fb67f6c2640 1 -- start start 2023-11-04T01:48:12.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.396+0000 7fb67f6c2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb67815b200 0x7fb6780ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.396+0000 7fb67f6c2640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6780cde80 con 0x7fb6780afda0 2023-11-04T01:48:12.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.396+0000 7fb67f6c2640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6780cf670 con 0x7fb6780cd9c0 2023-11-04T01:48:12.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.396+0000 7fb67f6c2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6780cf950 con 0x7fb67815b200 2023-11-04T01:48:12.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.396+0000 7fb67cc5d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb6780afda0 0x7fb6780cd2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35768/0 (socket says 172.21.15.77:35768) 2023-11-04T01:48:12.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.396+0000 7fb67cc5d640 1 -- 172.21.15.77:0/4145204505 learned_addr learned my addr 172.21.15.77:0/4145204505 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:48:12.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.397+0000 7fb67d45e640 1 --2- 172.21.15.77:0/4145204505 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb67815b200 0x7fb6780ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:12.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.397+0000 7fb66ffff640 1 -- 172.21.15.77:0/4145204505 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4286118549 0 0) 0x7fb6780cde80 con 0x7fb6780afda0 2023-11-04T01:48:12.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.397+0000 7fb66ffff640 1 -- 172.21.15.77:0/4145204505 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb664003520 con 0x7fb6780afda0 2023-11-04T01:48:12.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.397+0000 7fb66ffff640 1 -- 172.21.15.77:0/4145204505 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 519392821 0 0) 0x7fb664003520 con 0x7fb6780afda0 2023-11-04T01:48:12.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.397+0000 7fb66ffff640 1 -- 172.21.15.77:0/4145204505 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb67815b200 msgr2=0x7fb6780ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:12.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.397+0000 7fb66ffff640 1 --2- 172.21.15.77:0/4145204505 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb67815b200 0x7fb6780ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.397+0000 7fb66ffff640 1 -- 172.21.15.77:0/4145204505 >> v1:172.21.15.122:6789/0 conn(0x7fb6780cd9c0 legacy=0x7fb6780ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:12.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.397+0000 7fb66ffff640 1 -- 172.21.15.77:0/4145204505 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6780ce120 con 0x7fb6780afda0 2023-11-04T01:48:12.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.397+0000 7fb66ffff640 1 -- 172.21.15.77:0/4145204505 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7fb674001670 con 0x7fb6780afda0 2023-11-04T01:48:12.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.397+0000 7fb66ffff640 1 -- 172.21.15.77:0/4145204505 >> v1:172.21.15.77:6789/0 conn(0x7fb6780afda0 legacy=0x7fb6780cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:12.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.397+0000 7fb66ffff640 1 --2- 172.21.15.77:0/4145204505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6640039a0 0x7fb664003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.397+0000 7fb66ffff640 1 --2- 172.21.15.77:0/4145204505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6640047c0 0x7fb664004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.397+0000 7fb66ffff640 1 --2- 172.21.15.77:0/4145204505 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb67815b200 0x7fb66400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.397+0000 7fb66ffff640 1 -- 172.21.15.77:0/4145204505 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6780cf950 con 0x7fb6640047c0 2023-11-04T01:48:12.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.397+0000 7fb66ffff640 1 -- 172.21.15.77:0/4145204505 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6640054e0 con 0x7fb6640039a0 2023-11-04T01:48:12.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.397+0000 7fb66ffff640 1 -- 172.21.15.77:0/4145204505 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb66400bec0 con 0x7fb67815b200 2023-11-04T01:48:12.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.397+0000 7fb67cc5d640 1 --2- 172.21.15.77:0/4145204505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6640047c0 0x7fb664004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:12.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.397+0000 7fb67d45e640 1 --2- 172.21.15.77:0/4145204505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6640039a0 0x7fb664003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:12.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.397+0000 7fb67dc5f640 1 --2- 172.21.15.77:0/4145204505 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb67815b200 0x7fb66400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:12.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.397+0000 7fb67cc5d640 1 -- 172.21.15.77:0/4145204505 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb67815b200 msgr2=0x7fb66400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:12.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.397+0000 7fb67cc5d640 1 --2- 172.21.15.77:0/4145204505 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb67815b200 0x7fb66400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.397+0000 7fb67cc5d640 1 -- 172.21.15.77:0/4145204505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6640039a0 msgr2=0x7fb664003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:12.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.397+0000 7fb67cc5d640 1 --2- 172.21.15.77:0/4145204505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6640039a0 0x7fb664003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.397+0000 7fb67cc5d640 1 -- 172.21.15.77:0/4145204505 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb664003520 con 0x7fb6640047c0 2023-11-04T01:48:12.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.398+0000 7fb67cc5d640 1 --2- 172.21.15.77:0/4145204505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6640047c0 0x7fb664004c40 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fb67400c240 tx=0x7fb6640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3a223c9e532826f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:12.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.398+0000 7fb66ffff640 1 -- 172.21.15.77:0/4145204505 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb674005ad0 con 0x7fb6640047c0 2023-11-04T01:48:12.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.398+0000 7fb66ffff640 1 -- 172.21.15.77:0/4145204505 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb674005c50 con 0x7fb6640047c0 2023-11-04T01:48:12.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.398+0000 7fb66ffff640 1 -- 172.21.15.77:0/4145204505 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67402c8b0 con 0x7fb6640047c0 2023-11-04T01:48:12.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.399+0000 7fb67f6c2640 1 -- 172.21.15.77:0/4145204505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6640047c0 msgr2=0x7fb664004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:12.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.399+0000 7fb67f6c2640 1 --2- 172.21.15.77:0/4145204505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6640047c0 0x7fb664004c40 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fb67400c240 tx=0x7fb6640057f0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.399+0000 7fb67dc5f640 1 -- 172.21.15.77:0/4145204505 reap_dead start 2023-11-04T01:48:12.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.399+0000 7fb67f6c2640 1 -- 172.21.15.77:0/4145204505 shutdown_connections 2023-11-04T01:48:12.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.399+0000 7fb67f6c2640 1 -- 172.21.15.77:0/4145204505 >> 172.21.15.77:0/4145204505 conn(0x7fb6780d0c30 msgr2=0x7fb6780d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:12.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.399+0000 7fb67f6c2640 1 -- 172.21.15.77:0/4145204505 shutdown_connections 2023-11-04T01:48:12.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.399+0000 7fb67f6c2640 1 -- 172.21.15.77:0/4145204505 wait complete. 2023-11-04T01:48:12.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.400+0000 7fb67f6c2640 1 Processor -- start 2023-11-04T01:48:12.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.400+0000 7fb67f6c2640 1 -- start start 2023-11-04T01:48:12.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.401+0000 7fb67f6c2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6640047c0 0x7fb6781f03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.401+0000 7fb67f6c2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6780b37a0 0x7fb6780b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.401+0000 7fb67f6c2640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb6781f4070 0x7fb6781f44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.401+0000 7fb67f6c2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6781f4a30 con 0x7fb6640047c0 2023-11-04T01:48:12.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.401+0000 7fb67f6c2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6780c3f30 con 0x7fb6780b37a0 2023-11-04T01:48:12.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.401+0000 7fb67f6c2640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6780c6340 con 0x7fb6781f4070 2023-11-04T01:48:12.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.401+0000 7fb67d45e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6640047c0 0x7fb6781f03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:12.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.401+0000 7fb67d45e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6640047c0 0x7fb6781f03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60756/0 (socket says 172.21.15.77:60756) 2023-11-04T01:48:12.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.401+0000 7fb67d45e640 1 -- 172.21.15.77:0/3234667543 learned_addr learned my addr 172.21.15.77:0/3234667543 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:48:12.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.401+0000 7fb67d45e640 1 -- 172.21.15.77:0/3234667543 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb6781f4070 msgr2=0x7fb6781f44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:12.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.401+0000 7fb67d45e640 1 --2- 172.21.15.77:0/3234667543 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb6781f4070 0x7fb6781f44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.401+0000 7fb67d45e640 1 -- 172.21.15.77:0/3234667543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6780b37a0 msgr2=0x7fb6780b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:12.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.401+0000 7fb67d45e640 1 --2- 172.21.15.77:0/3234667543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6780b37a0 0x7fb6780b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.401+0000 7fb67d45e640 1 -- 172.21.15.77:0/3234667543 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6780c5730 con 0x7fb6640047c0 2023-11-04T01:48:12.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.401+0000 7fb67d45e640 1 --2- 172.21.15.77:0/3234667543 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6640047c0 0x7fb6781f03f0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7fb66800b780 tx=0x7fb66800bc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:12.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.401+0000 7fb66dffb640 1 -- 172.21.15.77:0/3234667543 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb668005b60 con 0x7fb6640047c0 2023-11-04T01:48:12.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.401+0000 7fb66dffb640 1 -- 172.21.15.77:0/3234667543 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66800be30 con 0x7fb6640047c0 2023-11-04T01:48:12.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.401+0000 7fb67f6c2640 1 -- 172.21.15.77:0/3234667543 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6780c5a10 con 0x7fb6640047c0 2023-11-04T01:48:12.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.401+0000 7fb66dffb640 1 -- 172.21.15.77:0/3234667543 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb668010c80 con 0x7fb6640047c0 2023-11-04T01:48:12.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.402+0000 7fb67f6c2640 1 -- 172.21.15.77:0/3234667543 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6780c5fd0 con 0x7fb6640047c0 2023-11-04T01:48:12.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.403+0000 7fb67f6c2640 1 -- 172.21.15.77:0/3234667543 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6780cca40 con 0x7fb6640047c0 2023-11-04T01:48:12.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.403+0000 7fb66dffb640 1 -- 172.21.15.77:0/3234667543 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb668014430 con 0x7fb6640047c0 2023-11-04T01:48:12.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.403+0000 7fb66dffb640 1 --2- 172.21.15.77:0/3234667543 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb65c06ae70 0x7fb65c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.403+0000 7fb66dffb640 1 -- 172.21.15.77:0/3234667543 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8195+0+0 (secure 0 0 0) 0x7fb66808a5b0 con 0x7fb6640047c0 2023-11-04T01:48:12.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.404+0000 7fb67cc5d640 1 --2- 172.21.15.77:0/3234667543 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb65c06ae70 0x7fb65c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:12.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.404+0000 7fb67cc5d640 1 --2- 172.21.15.77:0/3234667543 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb65c06ae70 0x7fb65c06d330 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb674034000 tx=0x7fb674007000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:12.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.407+0000 7fb66dffb640 1 -- 172.21.15.77:0/3234667543 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb668054ce0 con 0x7fb6640047c0 2023-11-04T01:48:12.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.572+0000 7fb67f6c2640 1 -- 172.21.15.77:0/3234667543 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7fb6780684b0 con 0x7fb6640047c0 2023-11-04T01:48:12.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.573+0000 7fb66dffb640 1 -- 172.21.15.77:0/3234667543 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v117) v1 ==== 107+0+11 (secure 0 0 0) 0x7fb668022020 con 0x7fb6640047c0 2023-11-04T01:48:12.575 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:48:12.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.575+0000 7fb67f6c2640 1 -- 172.21.15.77:0/3234667543 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb65c06ae70 msgr2=0x7fb65c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:12.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.575+0000 7fb67f6c2640 1 --2- 172.21.15.77:0/3234667543 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb65c06ae70 0x7fb65c06d330 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb674034000 tx=0x7fb674007000 comp rx=0 tx=0).stop 2023-11-04T01:48:12.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.575+0000 7fb67f6c2640 1 -- 172.21.15.77:0/3234667543 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6640047c0 msgr2=0x7fb6781f03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:12.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.575+0000 7fb67f6c2640 1 --2- 172.21.15.77:0/3234667543 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6640047c0 0x7fb6781f03f0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7fb66800b780 tx=0x7fb66800bc40 comp rx=0 tx=0).stop 2023-11-04T01:48:12.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.575+0000 7fb67f6c2640 1 -- 172.21.15.77:0/3234667543 shutdown_connections 2023-11-04T01:48:12.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.575+0000 7fb67f6c2640 1 --2- 172.21.15.77:0/3234667543 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fb65c06ae70 0x7fb65c06d330 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.575+0000 7fb67f6c2640 1 --2- 172.21.15.77:0/3234667543 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fb6781f4070 0x7fb6781f44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.575+0000 7fb67f6c2640 1 --2- 172.21.15.77:0/3234667543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6780b37a0 0x7fb6780b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.575+0000 7fb67f6c2640 1 --2- 172.21.15.77:0/3234667543 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6640047c0 0x7fb6781f03f0 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.575+0000 7fb67f6c2640 1 -- 172.21.15.77:0/3234667543 >> 172.21.15.77:0/3234667543 conn(0x7fb6780d0c30 msgr2=0x7fb6780af4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:12.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.575+0000 7fb67f6c2640 1 -- 172.21.15.77:0/3234667543 shutdown_connections 2023-11-04T01:48:12.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.575+0000 7fb67f6c2640 1 -- 172.21.15.77:0/3234667543 wait complete. 2023-11-04T01:48:12.587 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:48:12.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.689+0000 7fe8b0090640 1 Processor -- start 2023-11-04T01:48:12.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.689+0000 7fe8b0090640 1 -- start start 2023-11-04T01:48:12.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.690+0000 7fe8b0090640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe8a80ade00 0x7fe8a80b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.690+0000 7fe8b0090640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe8a806d9c0 0x7fe8a80710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.690+0000 7fe8b0090640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fe8a806c5f0 0x7fe8a8071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.690+0000 7fe8b0090640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a806cc90 con 0x7fe8a80ade00 2023-11-04T01:48:12.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.690+0000 7fe8b0090640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a8071b50 con 0x7fe8a806c5f0 2023-11-04T01:48:12.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.690+0000 7fe8b0090640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a80b0e60 con 0x7fe8a806d9c0 2023-11-04T01:48:12.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.690+0000 7fe8ade2c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe8a80ade00 0x7fe8a80b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:12.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.690+0000 7fe8ade2c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe8a80ade00 0x7fe8a80b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60768/0 (socket says 172.21.15.77:60768) 2023-11-04T01:48:12.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.690+0000 7fe8ade2c640 1 -- 172.21.15.77:0/2545261843 learned_addr learned my addr 172.21.15.77:0/2545261843 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:48:12.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.690+0000 7fe8ae62d640 1 --2- 172.21.15.77:0/2545261843 >> v2:172.21.15.122:3300/0 conn(0x7fe8a806c5f0 0x7fe8a8071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:12.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.690+0000 7fe8ad62b640 1 --2- 172.21.15.77:0/2545261843 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe8a806d9c0 0x7fe8a80710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:12.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.690+0000 7fe8ade2c640 1 -- 172.21.15.77:0/2545261843 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe8a806d9c0 msgr2=0x7fe8a80710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:12.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.690+0000 7fe8ade2c640 1 --2- 172.21.15.77:0/2545261843 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe8a806d9c0 0x7fe8a80710d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.690+0000 7fe8ade2c640 1 -- 172.21.15.77:0/2545261843 >> v2:172.21.15.122:3300/0 conn(0x7fe8a806c5f0 msgr2=0x7fe8a8071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:12.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.690+0000 7fe8ade2c640 1 --2- 172.21.15.77:0/2545261843 >> v2:172.21.15.122:3300/0 conn(0x7fe8a806c5f0 0x7fe8a8071610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.690+0000 7fe8ade2c640 1 -- 172.21.15.77:0/2545261843 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a806cee0 con 0x7fe8a80ade00 2023-11-04T01:48:12.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.691+0000 7fe8ade2c640 1 --2- 172.21.15.77:0/2545261843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8a80ade00 0x7fe8a80b0530 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7fe8a80c5b10 tx=0x7fe8a402b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a3c2a5cdf50416 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:12.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.691+0000 7fe8ace2a640 1 -- 172.21.15.77:0/2545261843 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a4031750 con 0x7fe8a80ade00 2023-11-04T01:48:12.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.691+0000 7fe8ace2a640 1 -- 172.21.15.77:0/2545261843 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a40318b0 con 0x7fe8a80ade00 2023-11-04T01:48:12.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.691+0000 7fe8ace2a640 1 -- 172.21.15.77:0/2545261843 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a4031c40 con 0x7fe8a80ade00 2023-11-04T01:48:12.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.692+0000 7fe8b0090640 1 -- 172.21.15.77:0/2545261843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8a80ade00 msgr2=0x7fe8a80b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:12.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.692+0000 7fe8b0090640 1 --2- 172.21.15.77:0/2545261843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8a80ade00 0x7fe8a80b0530 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7fe8a80c5b10 tx=0x7fe8a402b7f0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.692+0000 7fe8b0090640 1 -- 172.21.15.77:0/2545261843 shutdown_connections 2023-11-04T01:48:12.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.692+0000 7fe8b0090640 1 --2- 172.21.15.77:0/2545261843 >> v2:172.21.15.122:3300/0 conn(0x7fe8a806c5f0 0x7fe8a8071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.692+0000 7fe8b0090640 1 --2- 172.21.15.77:0/2545261843 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe8a806d9c0 0x7fe8a80710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.692+0000 7fe8b0090640 1 --2- 172.21.15.77:0/2545261843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8a80ade00 0x7fe8a80b0530 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.692+0000 7fe8b0090640 1 -- 172.21.15.77:0/2545261843 >> 172.21.15.77:0/2545261843 conn(0x7fe8a80cb530 msgr2=0x7fe8a80cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:12.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.692+0000 7fe8b0090640 1 -- 172.21.15.77:0/2545261843 shutdown_connections 2023-11-04T01:48:12.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.692+0000 7fe8b0090640 1 -- 172.21.15.77:0/2545261843 wait complete. 2023-11-04T01:48:12.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.693+0000 7fe8b0090640 1 Processor -- start 2023-11-04T01:48:12.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.693+0000 7fe8b0090640 1 -- start start 2023-11-04T01:48:12.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.694+0000 7fe8b0090640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8a806c5f0 0x7fe8a81f1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.694+0000 7fe8b0090640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe8a806d9c0 0x7fe8a81f3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.694+0000 7fe8b0090640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8a80ade00 0x7fe8a80b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.694+0000 7fe8b0090640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a81f0e10 con 0x7fe8a806c5f0 2023-11-04T01:48:12.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.694+0000 7fe8b0090640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a81f1770 con 0x7fe8a80ade00 2023-11-04T01:48:12.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.694+0000 7fe8b0090640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a81f0780 con 0x7fe8a806d9c0 2023-11-04T01:48:12.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.694+0000 7fe8ade2c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8a806c5f0 0x7fe8a81f1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:12.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.694+0000 7fe8ade2c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8a806c5f0 0x7fe8a81f1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60778/0 (socket says 172.21.15.77:60778) 2023-11-04T01:48:12.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.694+0000 7fe8ade2c640 1 -- 172.21.15.77:0/3616197357 learned_addr learned my addr 172.21.15.77:0/3616197357 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:48:12.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.694+0000 7fe8ae62d640 1 --2- 172.21.15.77:0/3616197357 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8a80ade00 0x7fe8a80b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:12.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.694+0000 7fe8ad62b640 1 --2- 172.21.15.77:0/3616197357 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe8a806d9c0 0x7fe8a81f3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:12.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.694+0000 7fe8ade2c640 1 -- 172.21.15.77:0/3616197357 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe8a806d9c0 msgr2=0x7fe8a81f3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:12.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.694+0000 7fe8ade2c640 1 --2- 172.21.15.77:0/3616197357 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe8a806d9c0 0x7fe8a81f3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.694+0000 7fe8ade2c640 1 -- 172.21.15.77:0/3616197357 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8a80ade00 msgr2=0x7fe8a80b2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:12.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.694+0000 7fe8ade2c640 1 --2- 172.21.15.77:0/3616197357 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8a80ade00 0x7fe8a80b2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.694+0000 7fe8ade2c640 1 -- 172.21.15.77:0/3616197357 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a40094d0 con 0x7fe8a806c5f0 2023-11-04T01:48:12.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.694+0000 7fe8ae62d640 1 --2- 172.21.15.77:0/3616197357 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8a80ade00 0x7fe8a80b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:12.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.694+0000 7fe8ad62b640 1 --2- 172.21.15.77:0/3616197357 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe8a806d9c0 0x7fe8a81f3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:12.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.694+0000 7fe8ade2c640 1 --2- 172.21.15.77:0/3616197357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8a806c5f0 0x7fe8a81f1230 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fe8a4000c00 tx=0x7fe8a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:12.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.694+0000 7fe89e7fc640 1 -- 172.21.15.77:0/3616197357 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a4033c80 con 0x7fe8a806c5f0 2023-11-04T01:48:12.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.694+0000 7fe89e7fc640 1 -- 172.21.15.77:0/3616197357 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a4033e00 con 0x7fe8a806c5f0 2023-11-04T01:48:12.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.694+0000 7fe8b0090640 1 -- 172.21.15.77:0/3616197357 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a81f4840 con 0x7fe8a806c5f0 2023-11-04T01:48:12.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.695+0000 7fe89e7fc640 1 -- 172.21.15.77:0/3616197357 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a403c640 con 0x7fe8a806c5f0 2023-11-04T01:48:12.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.695+0000 7fe8b0090640 1 -- 172.21.15.77:0/3616197357 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a81f0a30 con 0x7fe8a806c5f0 2023-11-04T01:48:12.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.695+0000 7fe8b0090640 1 -- 172.21.15.77:0/3616197357 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a81f1080 con 0x7fe8a806c5f0 2023-11-04T01:48:12.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.696+0000 7fe89e7fc640 1 -- 172.21.15.77:0/3616197357 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe8a403a040 con 0x7fe8a806c5f0 2023-11-04T01:48:12.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.696+0000 7fe89e7fc640 1 --2- 172.21.15.77:0/3616197357 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe88c06ae70 0x7fe88c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.696+0000 7fe89e7fc640 1 -- 172.21.15.77:0/3616197357 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8195+0+0 (secure 0 0 0) 0x7fe8a40abb30 con 0x7fe8a806c5f0 2023-11-04T01:48:12.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.696+0000 7fe8ad62b640 1 --2- 172.21.15.77:0/3616197357 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe88c06ae70 0x7fe88c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:12.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.697+0000 7fe8ad62b640 1 --2- 172.21.15.77:0/3616197357 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe88c06ae70 0x7fe88c06d330 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fe898006fd0 tx=0x7fe898008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:12.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.700+0000 7fe89e7fc640 1 -- 172.21.15.77:0/3616197357 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe8a40761d0 con 0x7fe8a806c5f0 2023-11-04T01:48:12.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.868+0000 7fe8b0090640 1 -- 172.21.15.77:0/3616197357 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe8a80684b0 con 0x7fe8a806c5f0 2023-11-04T01:48:12.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.868+0000 7fe89e7fc640 1 -- 172.21.15.77:0/3616197357 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v117) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe8a40380a0 con 0x7fe8a806c5f0 2023-11-04T01:48:12.870 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:48:12.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.870+0000 7fe8b0090640 1 -- 172.21.15.77:0/3616197357 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe88c06ae70 msgr2=0x7fe88c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:12.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.870+0000 7fe8b0090640 1 --2- 172.21.15.77:0/3616197357 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe88c06ae70 0x7fe88c06d330 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fe898006fd0 tx=0x7fe898008040 comp rx=0 tx=0).stop 2023-11-04T01:48:12.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.870+0000 7fe8b0090640 1 -- 172.21.15.77:0/3616197357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8a806c5f0 msgr2=0x7fe8a81f1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:12.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.870+0000 7fe8b0090640 1 --2- 172.21.15.77:0/3616197357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8a806c5f0 0x7fe8a81f1230 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fe8a4000c00 tx=0x7fe8a40046c0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.870+0000 7fe8b0090640 1 -- 172.21.15.77:0/3616197357 shutdown_connections 2023-11-04T01:48:12.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.870+0000 7fe8b0090640 1 --2- 172.21.15.77:0/3616197357 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fe88c06ae70 0x7fe88c06d330 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.870+0000 7fe8b0090640 1 --2- 172.21.15.77:0/3616197357 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8a80ade00 0x7fe8a80b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.870+0000 7fe8b0090640 1 --2- 172.21.15.77:0/3616197357 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fe8a806d9c0 0x7fe8a81f3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.870+0000 7fe8b0090640 1 --2- 172.21.15.77:0/3616197357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8a806c5f0 0x7fe8a81f1230 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.870+0000 7fe8b0090640 1 -- 172.21.15.77:0/3616197357 >> 172.21.15.77:0/3616197357 conn(0x7fe8a80cb530 msgr2=0x7fe8a80cc660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:12.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.870+0000 7fe8b0090640 1 -- 172.21.15.77:0/3616197357 shutdown_connections 2023-11-04T01:48:12.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.870+0000 7fe8b0090640 1 -- 172.21.15.77:0/3616197357 wait complete. 2023-11-04T01:48:12.883 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:48:12.922 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~20s 2023-11-04T01:48:12.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.984+0000 7fc715a94640 1 Processor -- start 2023-11-04T01:48:12.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.984+0000 7fc715a94640 1 -- start start 2023-11-04T01:48:12.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.984+0000 7fc715a94640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc71015b330 0x7fc7100cba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.984+0000 7fc715a94640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc71006ca60 0x7fc71006cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.984+0000 7fc715a94640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7100cb5d0 con 0x7fc7100b2160 2023-11-04T01:48:12.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.984+0000 7fc715a94640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc71006d430 con 0x7fc71015b330 2023-11-04T01:48:12.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.984+0000 7fc715a94640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc71006f3f0 con 0x7fc71006ca60 2023-11-04T01:48:12.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.985+0000 7fc70f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc71015b330 0x7fc7100cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:12.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.985+0000 7fc70f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc71015b330 0x7fc7100cba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60792/0 (socket says 172.21.15.77:60792) 2023-11-04T01:48:12.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.985+0000 7fc70f7fe640 1 -- 172.21.15.77:0/654339313 learned_addr learned my addr 172.21.15.77:0/654339313 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:48:12.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.985+0000 7fc70ffff640 1 --2- 172.21.15.77:0/654339313 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc71006ca60 0x7fc71006cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:12.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.985+0000 7fc70f7fe640 1 -- 172.21.15.77:0/654339313 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc71006ca60 msgr2=0x7fc71006cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:12.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.985+0000 7fc70f7fe640 1 --2- 172.21.15.77:0/654339313 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc71006ca60 0x7fc71006cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.985+0000 7fc70f7fe640 1 -- 172.21.15.77:0/654339313 >> v1:172.21.15.77:6789/0 conn(0x7fc7100b2160 legacy=0x7fc71006ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:12.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.985+0000 7fc70f7fe640 1 -- 172.21.15.77:0/654339313 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7100c3490 con 0x7fc71015b330 2023-11-04T01:48:12.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.986+0000 7fc70f7fe640 1 --2- 172.21.15.77:0/654339313 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc71015b330 0x7fc7100cba60 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fc700009870 tx=0x7fc70002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=339f3628e4bd5b1a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:12.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.986+0000 7fc70e7fc640 1 -- 172.21.15.77:0/654339313 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc700030840 con 0x7fc71015b330 2023-11-04T01:48:12.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.986+0000 7fc70e7fc640 1 -- 172.21.15.77:0/654339313 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7000309a0 con 0x7fc71015b330 2023-11-04T01:48:12.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.986+0000 7fc70e7fc640 1 -- 172.21.15.77:0/654339313 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc700030d30 con 0x7fc71015b330 2023-11-04T01:48:12.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.986+0000 7fc715a94640 1 -- 172.21.15.77:0/654339313 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc71015b330 msgr2=0x7fc7100cba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:12.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.986+0000 7fc715a94640 1 --2- 172.21.15.77:0/654339313 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc71015b330 0x7fc7100cba60 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fc700009870 tx=0x7fc70002b980 comp rx=0 tx=0).stop 2023-11-04T01:48:12.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.986+0000 7fc715a94640 1 -- 172.21.15.77:0/654339313 shutdown_connections 2023-11-04T01:48:12.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.986+0000 7fc715a94640 1 --2- 172.21.15.77:0/654339313 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc71006ca60 0x7fc71006cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.986+0000 7fc715a94640 1 --2- 172.21.15.77:0/654339313 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc71015b330 0x7fc7100cba60 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.986+0000 7fc715a94640 1 -- 172.21.15.77:0/654339313 >> 172.21.15.77:0/654339313 conn(0x7fc7100b1640 msgr2=0x7fc7100b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:12.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.986+0000 7fc715a94640 1 -- 172.21.15.77:0/654339313 shutdown_connections 2023-11-04T01:48:12.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.986+0000 7fc715a94640 1 -- 172.21.15.77:0/654339313 wait complete. 2023-11-04T01:48:12.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.987+0000 7fc715a94640 1 Processor -- start 2023-11-04T01:48:12.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.988+0000 7fc715a94640 1 -- start start 2023-11-04T01:48:12.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.988+0000 7fc715a94640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc71006ca60 0x7fc710156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.988+0000 7fc715a94640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7100b2160 0x7fc7100cef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.988+0000 7fc715a94640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc71015b330 0x7fc7100c5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.988+0000 7fc715a94640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7100ce680 con 0x7fc7100b2160 2023-11-04T01:48:12.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.988+0000 7fc715a94640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc710156c70 con 0x7fc71015b330 2023-11-04T01:48:12.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.988+0000 7fc715a94640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7100cdb00 con 0x7fc71006ca60 2023-11-04T01:48:12.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.989+0000 7fc70effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7100b2160 0x7fc7100cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:12.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.989+0000 7fc70effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7100b2160 0x7fc7100cef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60794/0 (socket says 172.21.15.77:60794) 2023-11-04T01:48:12.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.989+0000 7fc70effd640 1 -- 172.21.15.77:0/1960719263 learned_addr learned my addr 172.21.15.77:0/1960719263 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:48:12.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.989+0000 7fc70f7fe640 1 --2- 172.21.15.77:0/1960719263 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc71006ca60 0x7fc710156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:12.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.989+0000 7fc70ffff640 1 --2- 172.21.15.77:0/1960719263 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc71015b330 0x7fc7100c5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:12.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.989+0000 7fc70effd640 1 -- 172.21.15.77:0/1960719263 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc71006ca60 msgr2=0x7fc710156730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:12.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.989+0000 7fc70effd640 1 --2- 172.21.15.77:0/1960719263 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc71006ca60 0x7fc710156730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.989+0000 7fc70effd640 1 -- 172.21.15.77:0/1960719263 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc71015b330 msgr2=0x7fc7100c5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:12.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.989+0000 7fc70effd640 1 --2- 172.21.15.77:0/1960719263 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc71015b330 0x7fc7100c5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.989+0000 7fc70effd640 1 -- 172.21.15.77:0/1960719263 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7000094d0 con 0x7fc7100b2160 2023-11-04T01:48:12.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.989+0000 7fc70effd640 1 --2- 172.21.15.77:0/1960719263 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7100b2160 0x7fc7100cef70 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fc70400c450 tx=0x7fc70400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:12.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.989+0000 7fc6f7fff640 1 -- 172.21.15.77:0/1960719263 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7040052d0 con 0x7fc7100b2160 2023-11-04T01:48:12.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.989+0000 7fc6f7fff640 1 -- 172.21.15.77:0/1960719263 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc704005430 con 0x7fc7100b2160 2023-11-04T01:48:13.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.989+0000 7fc715a94640 1 -- 172.21.15.77:0/1960719263 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7100cdde0 con 0x7fc7100b2160 2023-11-04T01:48:13.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.989+0000 7fc6f7fff640 1 -- 172.21.15.77:0/1960719263 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc704012870 con 0x7fc7100b2160 2023-11-04T01:48:13.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.989+0000 7fc715a94640 1 -- 172.21.15.77:0/1960719263 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7100ce3a0 con 0x7fc7100b2160 2023-11-04T01:48:13.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.990+0000 7fc715a94640 1 -- 172.21.15.77:0/1960719263 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc71006da20 con 0x7fc7100b2160 2023-11-04T01:48:13.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.991+0000 7fc6f7fff640 1 -- 172.21.15.77:0/1960719263 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc7040129d0 con 0x7fc7100b2160 2023-11-04T01:48:13.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.991+0000 7fc6f7fff640 1 --2- 172.21.15.77:0/1960719263 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc6fc06ae70 0x7fc6fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:13.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.991+0000 7fc6f7fff640 1 -- 172.21.15.77:0/1960719263 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8195+0+0 (secure 0 0 0) 0x7fc704089ac0 con 0x7fc7100b2160 2023-11-04T01:48:13.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.991+0000 7fc70f7fe640 1 --2- 172.21.15.77:0/1960719263 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc6fc06ae70 0x7fc6fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:13.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.992+0000 7fc70f7fe640 1 --2- 172.21.15.77:0/1960719263 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc6fc06ae70 0x7fc6fc06d330 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fc700036000 tx=0x7fc700008030 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:13.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:12.995+0000 7fc6f7fff640 1 -- 172.21.15.77:0/1960719263 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc7040541f0 con 0x7fc7100b2160 2023-11-04T01:48:13.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.165+0000 7fc715a94640 1 -- 172.21.15.77:0/1960719263 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc7100684b0 con 0x7fc7100b2160 2023-11-04T01:48:13.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.166+0000 7fc6f7fff640 1 -- 172.21.15.77:0/1960719263 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v117) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc704057810 con 0x7fc7100b2160 2023-11-04T01:48:13.168 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-04T01:48:13.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.168+0000 7fc715a94640 1 -- 172.21.15.77:0/1960719263 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc6fc06ae70 msgr2=0x7fc6fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:13.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.168+0000 7fc715a94640 1 --2- 172.21.15.77:0/1960719263 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc6fc06ae70 0x7fc6fc06d330 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fc700036000 tx=0x7fc700008030 comp rx=0 tx=0).stop 2023-11-04T01:48:13.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.168+0000 7fc715a94640 1 -- 172.21.15.77:0/1960719263 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7100b2160 msgr2=0x7fc7100cef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:13.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.168+0000 7fc715a94640 1 --2- 172.21.15.77:0/1960719263 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7100b2160 0x7fc7100cef70 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fc70400c450 tx=0x7fc70400c910 comp rx=0 tx=0).stop 2023-11-04T01:48:13.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.168+0000 7fc715a94640 1 -- 172.21.15.77:0/1960719263 shutdown_connections 2023-11-04T01:48:13.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.168+0000 7fc715a94640 1 --2- 172.21.15.77:0/1960719263 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7fc6fc06ae70 0x7fc6fc06d330 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:13.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.168+0000 7fc715a94640 1 --2- 172.21.15.77:0/1960719263 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc71015b330 0x7fc7100c5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:13.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.168+0000 7fc715a94640 1 --2- 172.21.15.77:0/1960719263 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7100b2160 0x7fc7100cef70 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:13.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.168+0000 7fc715a94640 1 --2- 172.21.15.77:0/1960719263 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fc71006ca60 0x7fc710156730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:13.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.168+0000 7fc715a94640 1 -- 172.21.15.77:0/1960719263 >> 172.21.15.77:0/1960719263 conn(0x7fc7100b1640 msgr2=0x7fc7100b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:13.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.168+0000 7fc715a94640 1 -- 172.21.15.77:0/1960719263 shutdown_connections 2023-11-04T01:48:13.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.168+0000 7fc715a94640 1 -- 172.21.15.77:0/1960719263 wait complete. 2023-11-04T01:48:13.180 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:48:13.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.280+0000 7f502df97640 1 Processor -- start 2023-11-04T01:48:13.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.280+0000 7f502df97640 1 -- start start 2023-11-04T01:48:13.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.281+0000 7f502df97640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f5028159e40 0x7f50280b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:13.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.281+0000 7f502df97640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5028071500 con 0x7f502806bb60 2023-11-04T01:48:13.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.281+0000 7f502df97640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f502815dae0 con 0x7f5028070700 2023-11-04T01:48:13.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.281+0000 7f502df97640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5028070c60 con 0x7f5028159e40 2023-11-04T01:48:13.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.281+0000 7f5026ffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f502806bb60 0x7f502806fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35778/0 (socket says 172.21.15.77:35778) 2023-11-04T01:48:13.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.281+0000 7f5026ffd640 1 -- 172.21.15.77:0/192241603 learned_addr learned my addr 172.21.15.77:0/192241603 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:48:13.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.281+0000 7f50277fe640 1 --2- 172.21.15.77:0/192241603 >> v2:172.21.15.122:3300/0 conn(0x7f5028159e40 0x7f50280b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:13.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.281+0000 7f50267fc640 1 -- 172.21.15.77:0/192241603 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1832688738 0 0) 0x7f5028071500 con 0x7f502806bb60 2023-11-04T01:48:13.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.281+0000 7f50267fc640 1 -- 172.21.15.77:0/192241603 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5010003520 con 0x7f502806bb60 2023-11-04T01:48:13.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.282+0000 7f50267fc640 1 -- 172.21.15.77:0/192241603 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 962596968 0 0) 0x7f5010003520 con 0x7f502806bb60 2023-11-04T01:48:13.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.282+0000 7f50267fc640 1 -- 172.21.15.77:0/192241603 >> v2:172.21.15.122:3300/0 conn(0x7f5028159e40 msgr2=0x7f50280b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:13.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.282+0000 7f50267fc640 1 --2- 172.21.15.77:0/192241603 >> v2:172.21.15.122:3300/0 conn(0x7f5028159e40 0x7f50280b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:13.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.282+0000 7f50267fc640 1 -- 172.21.15.77:0/192241603 >> v1:172.21.15.122:6789/0 conn(0x7f5028070700 legacy=0x7f50280cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:13.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.282+0000 7f50267fc640 1 -- 172.21.15.77:0/192241603 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5028070f40 con 0x7f502806bb60 2023-11-04T01:48:13.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.282+0000 7f50267fc640 1 -- 172.21.15.77:0/192241603 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f501c001670 con 0x7f502806bb60 2023-11-04T01:48:13.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.282+0000 7f50267fc640 1 -- 172.21.15.77:0/192241603 >> v1:172.21.15.77:6789/0 conn(0x7f502806bb60 legacy=0x7f502806fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:13.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.282+0000 7f50267fc640 1 --2- 172.21.15.77:0/192241603 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5010003970 0x7f5010003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:13.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.282+0000 7f50267fc640 1 --2- 172.21.15.77:0/192241603 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f50100047c0 0x7f5010004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:13.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.282+0000 7f50267fc640 1 --2- 172.21.15.77:0/192241603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50100052a0 0x7f501000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:13.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.282+0000 7f50267fc640 1 -- 172.21.15.77:0/192241603 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5028070c60 con 0x7f50100052a0 2023-11-04T01:48:13.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.282+0000 7f50267fc640 1 -- 172.21.15.77:0/192241603 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501000c170 con 0x7f50100047c0 2023-11-04T01:48:13.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.282+0000 7f50267fc640 1 -- 172.21.15.77:0/192241603 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501000c330 con 0x7f5010003970 2023-11-04T01:48:13.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.282+0000 7f5027fff640 1 --2- 172.21.15.77:0/192241603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50100052a0 0x7f501000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:13.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.282+0000 7f50277fe640 1 --2- 172.21.15.77:0/192241603 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5010003970 0x7f5010003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:13.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.282+0000 7f5026ffd640 1 --2- 172.21.15.77:0/192241603 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f50100047c0 0x7f5010004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:13.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.282+0000 7f5027fff640 1 -- 172.21.15.77:0/192241603 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5010003970 msgr2=0x7f5010003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:13.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.282+0000 7f5027fff640 1 --2- 172.21.15.77:0/192241603 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f5010003970 0x7f5010003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:13.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.282+0000 7f5027fff640 1 -- 172.21.15.77:0/192241603 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f50100047c0 msgr2=0x7f5010004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:13.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.282+0000 7f5027fff640 1 --2- 172.21.15.77:0/192241603 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f50100047c0 0x7f5010004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:13.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.282+0000 7f5027fff640 1 -- 172.21.15.77:0/192241603 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5010003520 con 0x7f50100052a0 2023-11-04T01:48:13.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.283+0000 7f5027fff640 1 -- 172.21.15.77:0/192241603 reap_dead start 2023-11-04T01:48:13.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.283+0000 7f5027fff640 1 --2- 172.21.15.77:0/192241603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50100052a0 0x7f501000b980 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f5020001e20 tx=0x7f50100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80b1716b80571b20 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:13.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.283+0000 7f50267fc640 1 -- 172.21.15.77:0/192241603 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5020003b70 con 0x7f50100052a0 2023-11-04T01:48:13.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.283+0000 7f50267fc640 1 -- 172.21.15.77:0/192241603 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5020003cd0 con 0x7f50100052a0 2023-11-04T01:48:13.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.283+0000 7f50267fc640 1 -- 172.21.15.77:0/192241603 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5020005310 con 0x7f50100052a0 2023-11-04T01:48:13.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.283+0000 7f502df97640 1 -- 172.21.15.77:0/192241603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50100052a0 msgr2=0x7f501000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:13.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.283+0000 7f502df97640 1 --2- 172.21.15.77:0/192241603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50100052a0 0x7f501000b980 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f5020001e20 tx=0x7f50100057f0 comp rx=0 tx=0).stop 2023-11-04T01:48:13.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.283+0000 7f502df97640 1 -- 172.21.15.77:0/192241603 shutdown_connections 2023-11-04T01:48:13.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.283+0000 7f502df97640 1 --2- 172.21.15.77:0/192241603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50100052a0 0x7f501000b980 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:13.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.283+0000 7f502df97640 1 -- 172.21.15.77:0/192241603 >> 172.21.15.77:0/192241603 conn(0x7f50280cb530 msgr2=0x7f50280cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:13.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.283+0000 7f502df97640 1 -- 172.21.15.77:0/192241603 shutdown_connections 2023-11-04T01:48:13.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.284+0000 7f502df97640 1 -- 172.21.15.77:0/192241603 wait complete. 2023-11-04T01:48:13.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.285+0000 7f502df97640 1 Processor -- start 2023-11-04T01:48:13.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.285+0000 7f502df97640 1 -- start start 2023-11-04T01:48:13.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.285+0000 7f502df97640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f50100052a0 0x7f50281532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:13.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.286+0000 7f502df97640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5028151750 0x7f5028153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:13.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.286+0000 7f502df97640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50281540e0 0x7f50280cd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:13.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.286+0000 7f502df97640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50281537e0 con 0x7f50281540e0 2023-11-04T01:48:13.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.286+0000 7f502df97640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50281545f0 con 0x7f5028151750 2023-11-04T01:48:13.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.286+0000 7f502df97640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50281548d0 con 0x7f50100052a0 2023-11-04T01:48:13.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.286+0000 7f5027fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50281540e0 0x7f50280cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:13.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.286+0000 7f5027fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50281540e0 0x7f50280cd690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60806/0 (socket says 172.21.15.77:60806) 2023-11-04T01:48:13.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.286+0000 7f5027fff640 1 -- 172.21.15.77:0/1756752113 learned_addr learned my addr 172.21.15.77:0/1756752113 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:48:13.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.286+0000 7f5026ffd640 1 --2- 172.21.15.77:0/1756752113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5028151750 0x7f5028153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:13.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.286+0000 7f50277fe640 1 --2- 172.21.15.77:0/1756752113 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f50100052a0 0x7f50281532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:13.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.286+0000 7f5027fff640 1 -- 172.21.15.77:0/1756752113 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f50100052a0 msgr2=0x7f50281532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:13.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.286+0000 7f5027fff640 1 --2- 172.21.15.77:0/1756752113 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f50100052a0 0x7f50281532a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:13.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.286+0000 7f5027fff640 1 -- 172.21.15.77:0/1756752113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5028151750 msgr2=0x7f5028153ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:13.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.286+0000 7f5027fff640 1 --2- 172.21.15.77:0/1756752113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5028151750 0x7f5028153ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:13.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.286+0000 7f5027fff640 1 -- 172.21.15.77:0/1756752113 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50281527c0 con 0x7f50281540e0 2023-11-04T01:48:13.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.286+0000 7f5027fff640 1 --2- 172.21.15.77:0/1756752113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50281540e0 0x7f50280cd690 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f5020001f40 tx=0x7f50200014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:13.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.286+0000 7f500ffff640 1 -- 172.21.15.77:0/1756752113 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5020037660 con 0x7f50281540e0 2023-11-04T01:48:13.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.286+0000 7f500ffff640 1 -- 172.21.15.77:0/1756752113 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50200377c0 con 0x7f50281540e0 2023-11-04T01:48:13.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.286+0000 7f502df97640 1 -- 172.21.15.77:0/1756752113 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5028152aa0 con 0x7f50281540e0 2023-11-04T01:48:13.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.286+0000 7f500ffff640 1 -- 172.21.15.77:0/1756752113 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5020037b70 con 0x7f50281540e0 2023-11-04T01:48:13.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.286+0000 7f502df97640 1 -- 172.21.15.77:0/1756752113 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5028152130 con 0x7f50281540e0 2023-11-04T01:48:13.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.287+0000 7f502df97640 1 -- 172.21.15.77:0/1756752113 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50280684b0 con 0x7f50281540e0 2023-11-04T01:48:13.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.288+0000 7f500ffff640 1 -- 172.21.15.77:0/1756752113 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5020037cd0 con 0x7f50281540e0 2023-11-04T01:48:13.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.288+0000 7f500ffff640 1 --2- 172.21.15.77:0/1756752113 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f501406aea0 0x7f501406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:13.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.288+0000 7f500ffff640 1 -- 172.21.15.77:0/1756752113 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f50200abbb0 con 0x7f50281540e0 2023-11-04T01:48:13.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.288+0000 7f50277fe640 1 --2- 172.21.15.77:0/1756752113 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f501406aea0 0x7f501406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:13.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.289+0000 7f50277fe640 1 --2- 172.21.15.77:0/1756752113 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f501406aea0 0x7f501406d360 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f502806cb30 tx=0x7f5018009190 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:13.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.292+0000 7f500ffff640 1 -- 172.21.15.77:0/1756752113 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5020076390 con 0x7f50281540e0 2023-11-04T01:48:13.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.470+0000 7f502df97640 1 -- 172.21.15.77:0/1756752113 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f50280c9750 con 0x7f50281540e0 2023-11-04T01:48:13.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.471+0000 7f500ffff640 1 -- 172.21.15.77:0/1756752113 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 23 entries v117) v1 ==== 81+0+1397 (secure 0 0 0) 0x7f5020047080 con 0x7f50281540e0 2023-11-04T01:48:13.473 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.1:0/2955237098 2023-11-04T02:47:38.484200+0000 2023-11-04T01:48:13.473 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6835/2107153526 2023-11-05T01:47:23.380657+0000 2023-11-04T01:48:13.473 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.1:0/2249624526 2023-11-04T02:46:54.400007+0000 2023-11-04T01:48:13.474 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6834/1450731169 2023-11-05T01:46:46.102329+0000 2023-11-04T01:48:13.474 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6834/3276812155 2023-11-05T01:46:39.299125+0000 2023-11-04T01:48:13.474 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6832/3276812155 2023-11-05T01:46:39.299125+0000 2023-11-04T01:48:13.474 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6836/1450731169 2023-11-05T01:46:46.102329+0000 2023-11-04T01:48:13.474 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6834/3699147778 2023-11-05T01:44:11.242543+0000 2023-11-04T01:48:13.475 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6836/3699147778 2023-11-05T01:44:11.242543+0000 2023-11-04T01:48:13.475 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6834/4241784871 2023-11-05T01:44:36.807284+0000 2023-11-04T01:48:13.475 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6834/2908314953 2023-11-05T01:45:01.982045+0000 2023-11-04T01:48:13.475 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6834/285184758 2023-11-05T01:45:27.182069+0000 2023-11-04T01:48:13.475 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6833/2107153526 2023-11-05T01:47:23.380657+0000 2023-11-04T01:48:13.476 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6836/2908314953 2023-11-05T01:45:01.982045+0000 2023-11-04T01:48:13.476 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6834/4183807043 2023-11-05T01:47:30.639992+0000 2023-11-04T01:48:13.476 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6836/1345816612 2023-11-05T01:45:54.789240+0000 2023-11-04T01:48:13.476 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6832/285184758 2023-11-05T01:45:27.182069+0000 2023-11-04T01:48:13.476 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6834/1345816612 2023-11-05T01:45:54.789240+0000 2023-11-04T01:48:13.477 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6833/3207490604 2023-11-05T01:46:01.591697+0000 2023-11-04T01:48:13.477 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6832/4183807043 2023-11-05T01:47:30.639992+0000 2023-11-04T01:48:13.477 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6832/4241784871 2023-11-05T01:44:36.807284+0000 2023-11-04T01:48:13.477 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6835/3207490604 2023-11-05T01:46:01.591697+0000 2023-11-04T01:48:13.477 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.1:0/3032548059 2023-11-04T02:46:09.897134+0000 2023-11-04T01:48:13.478 INFO:teuthology.orchestra.run.smithi077.stderr:listed 23 entries 2023-11-04T01:48:13.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.472+0000 7f502df97640 1 -- 172.21.15.77:0/1756752113 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f501406aea0 msgr2=0x7f501406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:13.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.472+0000 7f502df97640 1 --2- 172.21.15.77:0/1756752113 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f501406aea0 0x7f501406d360 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f502806cb30 tx=0x7f5018009190 comp rx=0 tx=0).stop 2023-11-04T01:48:13.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.472+0000 7f502df97640 1 -- 172.21.15.77:0/1756752113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50281540e0 msgr2=0x7f50280cd690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:13.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.472+0000 7f502df97640 1 --2- 172.21.15.77:0/1756752113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50281540e0 0x7f50280cd690 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f5020001f40 tx=0x7f50200014a0 comp rx=0 tx=0).stop 2023-11-04T01:48:13.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.472+0000 7f502df97640 1 -- 172.21.15.77:0/1756752113 shutdown_connections 2023-11-04T01:48:13.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.472+0000 7f502df97640 1 --2- 172.21.15.77:0/1756752113 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f501406aea0 0x7f501406d360 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:13.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.472+0000 7f502df97640 1 --2- 172.21.15.77:0/1756752113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50281540e0 0x7f50280cd690 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:13.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.472+0000 7f502df97640 1 --2- 172.21.15.77:0/1756752113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5028151750 0x7f5028153ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:13.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.472+0000 7f502df97640 1 --2- 172.21.15.77:0/1756752113 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f50100052a0 0x7f50281532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:13.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.472+0000 7f502df97640 1 -- 172.21.15.77:0/1756752113 >> 172.21.15.77:0/1756752113 conn(0x7f50280cb530 msgr2=0x7f50280ae860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:13.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.473+0000 7f502df97640 1 -- 172.21.15.77:0/1756752113 shutdown_connections 2023-11-04T01:48:13.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.473+0000 7f502df97640 1 -- 172.21.15.77:0/1756752113 wait complete. 2023-11-04T01:48:13.485 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:48:13.485 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:48:13.500 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:48:13.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.638+0000 7f7b2417c640 1 Processor -- start 2023-11-04T01:48:13.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.638+0000 7f7b2417c640 1 -- start start 2023-11-04T01:48:13.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.639+0000 7f7b2417c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7b1c159e40 0x7f7b1c0b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:13.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.639+0000 7f7b2417c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f7b1c06bb60 0x7f7b1c0b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:13.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.639+0000 7f7b2417c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b1c071500 con 0x7f7b1c06fff0 2023-11-04T01:48:13.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.639+0000 7f7b2417c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b1c15dae0 con 0x7f7b1c159e40 2023-11-04T01:48:13.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.639+0000 7f7b2417c640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b1c070c60 con 0x7f7b1c06bb60 2023-11-04T01:48:13.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.639+0000 7f7b21f18640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7b1c159e40 0x7f7b1c0b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:13.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.639+0000 7f7b21f18640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7b1c159e40 0x7f7b1c0b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60822/0 (socket says 172.21.15.77:60822) 2023-11-04T01:48:13.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.639+0000 7f7b21f18640 1 -- 172.21.15.77:0/658072381 learned_addr learned my addr 172.21.15.77:0/658072381 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:48:13.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.639+0000 7f7b21717640 1 --2- 172.21.15.77:0/658072381 >> v2:172.21.15.122:3300/0 conn(0x7f7b1c06bb60 0x7f7b1c0b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:13.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.639+0000 7f7b21f18640 1 -- 172.21.15.77:0/658072381 >> v2:172.21.15.122:3300/0 conn(0x7f7b1c06bb60 msgr2=0x7f7b1c0b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:13.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.639+0000 7f7b21f18640 1 --2- 172.21.15.77:0/658072381 >> v2:172.21.15.122:3300/0 conn(0x7f7b1c06bb60 0x7f7b1c0b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:13.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.639+0000 7f7b21f18640 1 -- 172.21.15.77:0/658072381 >> v1:172.21.15.77:6789/0 conn(0x7f7b1c06fff0 legacy=0x7f7b1c070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:13.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.639+0000 7f7b21f18640 1 -- 172.21.15.77:0/658072381 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1c070f40 con 0x7f7b1c159e40 2023-11-04T01:48:13.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.639+0000 7f7b21717640 1 --2- 172.21.15.77:0/658072381 >> v2:172.21.15.122:3300/0 conn(0x7f7b1c06bb60 0x7f7b1c0b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:13.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.640+0000 7f7b21f18640 1 --2- 172.21.15.77:0/658072381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b1c159e40 0x7f7b1c0b0530 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c06fdc0 tx=0x7f7b1802e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13eb86d5c814d1f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:13.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.640+0000 7f7b20f16640 1 -- 172.21.15.77:0/658072381 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1802ee00 con 0x7f7b1c159e40 2023-11-04T01:48:13.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.640+0000 7f7b20f16640 1 -- 172.21.15.77:0/658072381 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b18036440 con 0x7f7b1c159e40 2023-11-04T01:48:13.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.640+0000 7f7b20f16640 1 -- 172.21.15.77:0/658072381 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b180367d0 con 0x7f7b1c159e40 2023-11-04T01:48:13.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.641+0000 7f7b2417c640 1 -- 172.21.15.77:0/658072381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b1c159e40 msgr2=0x7f7b1c0b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:13.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.641+0000 7f7b2417c640 1 --2- 172.21.15.77:0/658072381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b1c159e40 0x7f7b1c0b0530 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c06fdc0 tx=0x7f7b1802e050 comp rx=0 tx=0).stop 2023-11-04T01:48:13.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.641+0000 7f7b2417c640 1 -- 172.21.15.77:0/658072381 shutdown_connections 2023-11-04T01:48:13.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.641+0000 7f7b2417c640 1 --2- 172.21.15.77:0/658072381 >> v2:172.21.15.122:3300/0 conn(0x7f7b1c06bb60 0x7f7b1c0b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:13.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.641+0000 7f7b2417c640 1 --2- 172.21.15.77:0/658072381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b1c159e40 0x7f7b1c0b0530 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:13.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.641+0000 7f7b2417c640 1 -- 172.21.15.77:0/658072381 >> 172.21.15.77:0/658072381 conn(0x7f7b1c0cb530 msgr2=0x7f7b1c0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:13.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.641+0000 7f7b2417c640 1 -- 172.21.15.77:0/658072381 shutdown_connections 2023-11-04T01:48:13.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.641+0000 7f7b2417c640 1 -- 172.21.15.77:0/658072381 wait complete. 2023-11-04T01:48:13.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.642+0000 7f7b2417c640 1 Processor -- start 2023-11-04T01:48:13.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.642+0000 7f7b2417c640 1 -- start start 2023-11-04T01:48:13.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.643+0000 7f7b2417c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7b1c06bb60 0x7f7b1c14ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:13.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.643+0000 7f7b2417c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b1c06fff0 0x7f7b1c15b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:13.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.643+0000 7f7b2417c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b1c159e40 0x7f7b1c0ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:13.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.643+0000 7f7b2417c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c15c8d0 con 0x7f7b1c06fff0 2023-11-04T01:48:13.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.643+0000 7f7b2417c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c15c580 con 0x7f7b1c159e40 2023-11-04T01:48:13.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.643+0000 7f7b2417c640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c14f360 con 0x7f7b1c06bb60 2023-11-04T01:48:13.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.643+0000 7f7b21717640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b1c06fff0 0x7f7b1c15b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:13.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.643+0000 7f7b21717640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b1c06fff0 0x7f7b1c15b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60828/0 (socket says 172.21.15.77:60828) 2023-11-04T01:48:13.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.643+0000 7f7b21717640 1 -- 172.21.15.77:0/1444633216 learned_addr learned my addr 172.21.15.77:0/1444633216 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:48:13.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.643+0000 7f7b21717640 1 -- 172.21.15.77:0/1444633216 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7b1c06bb60 msgr2=0x7f7b1c14ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:13.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.643+0000 7f7b21717640 1 --2- 172.21.15.77:0/1444633216 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7b1c06bb60 0x7f7b1c14ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:13.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.643+0000 7f7b21717640 1 -- 172.21.15.77:0/1444633216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b1c159e40 msgr2=0x7f7b1c0ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:13.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.643+0000 7f7b21717640 1 --2- 172.21.15.77:0/1444633216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b1c159e40 0x7f7b1c0ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:13.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.643+0000 7f7b21717640 1 -- 172.21.15.77:0/1444633216 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1800b770 con 0x7f7b1c06fff0 2023-11-04T01:48:13.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.643+0000 7f7b21717640 1 --2- 172.21.15.77:0/1444633216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b1c06fff0 0x7f7b1c15b110 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c00c820 tx=0x7f7b0c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:13.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.643+0000 7f7b127fc640 1 -- 172.21.15.77:0/1444633216 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c007a30 con 0x7f7b1c06fff0 2023-11-04T01:48:13.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.643+0000 7f7b127fc640 1 -- 172.21.15.77:0/1444633216 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0c007b90 con 0x7f7b1c06fff0 2023-11-04T01:48:13.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.643+0000 7f7b127fc640 1 -- 172.21.15.77:0/1444633216 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c00ce70 con 0x7f7b1c06fff0 2023-11-04T01:48:13.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.643+0000 7f7b2417c640 1 -- 172.21.15.77:0/1444633216 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b1c15b970 con 0x7f7b1c06fff0 2023-11-04T01:48:13.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.643+0000 7f7b2417c640 1 -- 172.21.15.77:0/1444633216 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b1c15bf30 con 0x7f7b1c06fff0 2023-11-04T01:48:13.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.644+0000 7f7b2417c640 1 -- 172.21.15.77:0/1444633216 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b1c0684b0 con 0x7f7b1c06fff0 2023-11-04T01:48:13.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.645+0000 7f7b127fc640 1 -- 172.21.15.77:0/1444633216 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7b0c0113f0 con 0x7f7b1c06fff0 2023-11-04T01:48:13.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.645+0000 7f7b127fc640 1 --2- 172.21.15.77:0/1444633216 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7b0006ae70 0x7f7b0006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:13.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.645+0000 7f7b127fc640 1 -- 172.21.15.77:0/1444633216 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f7b0c08a200 con 0x7f7b1c06fff0 2023-11-04T01:48:13.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.645+0000 7f7b21f18640 1 --2- 172.21.15.77:0/1444633216 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7b0006ae70 0x7f7b0006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:13.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.646+0000 7f7b21f18640 1 --2- 172.21.15.77:0/1444633216 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7b0006ae70 0x7f7b0006d330 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f7b18038000 tx=0x7f7b18008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:13.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.650+0000 7f7b127fc640 1 -- 172.21.15.77:0/1444633216 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7b0c0548a0 con 0x7f7b1c06fff0 2023-11-04T01:48:13.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.819+0000 7f7b2417c640 1 -- 172.21.15.77:0/1444633216 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b1c15c6c0 con 0x7f7b1c06fff0 2023-11-04T01:48:13.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.821+0000 7f7b127fc640 1 -- 172.21.15.77:0/1444633216 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) v1 ==== 74+0+23645 (secure 0 0 0) 0x7f7b0c01f090 con 0x7f7b1c06fff0 2023-11-04T01:48:13.823 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-11-04T01:48:13.823 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":117,"fsid":"0c22c75d-0169-41ef-b663-6ac1c5b0f71f","created":"2023-11-04T01:39:40.791638+0000","modified":"2023-11-04T01:48:00.635277+0000","last_up_change":"2023-11-04T01:39:51.625501+0000","last_in_change":"2023-11-04T01:39:42.959637+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:39:51.664743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:41:33.142176+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_data_pool","create_time":"2023-11-04T01:42:33.159064+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:42:33.647358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:43:24.372767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-11-04T01:43:25.241976+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":14,"snap_epoch":116,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5517da9d-7a6c-4828-b78b-ec771446406c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6809","nonce":2904971997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6811","nonce":2904971997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6817","nonce":2904971997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2904971997},{"type":"v1","addr":"172.21.15.77:6813","nonce":2904971997}]},"public_addr":"172.21.15.77:6809/2904971997","cluster_addr":"172.21.15.77:6811/2904971997","heartbeat_back_addr":"172.21.15.77:6817/2904971997","heartbeat_front_addr":"172.21.15.77:6813/2904971997","state":["exists","up"]},{"osd":1,"uuid":"a44d5169-1315-4e8c-aab9-ef4c8b89ecb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6801","nonce":4106490517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6803","nonce":4106490517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6807","nonce":4106490517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4106490517},{"type":"v1","addr":"172.21.15.77:6805","nonce":4106490517}]},"public_addr":"172.21.15.77:6801/4106490517","cluster_addr":"172.21.15.77:6803/4106490517","heartbeat_back_addr":"172.21.15.77:6807/4106490517","heartbeat_front_addr":"172.21.15.77:6805/4106490517","state":["exists","up"]},{"osd":2,"uuid":"0fa83dc2-4041-4dc3-83cf-f2bcae58b642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6816","nonce":3962772574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6819","nonce":3962772574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6823","nonce":3962772574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3962772574},{"type":"v1","addr":"172.21.15.77:6821","nonce":3962772574}]},"public_addr":"172.21.15.77:6816/3962772574","cluster_addr":"172.21.15.77:6819/3962772574","heartbeat_back_addr":"172.21.15.77:6823/3962772574","heartbeat_front_addr":"172.21.15.77:6821/3962772574","state":["exists","up"]},{"osd":3,"uuid":"3f092780-1321-45bf-a394-423bf2e3fb08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6825","nonce":3229620085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6827","nonce":3229620085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6831","nonce":3229620085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":3229620085},{"type":"v1","addr":"172.21.15.77:6829","nonce":3229620085}]},"public_addr":"172.21.15.77:6825/3229620085","cluster_addr":"172.21.15.77:6827/3229620085","heartbeat_back_addr":"172.21.15.77:6831/3229620085","heartbeat_front_addr":"172.21.15.77:6829/3229620085","state":["exists","up"]},{"osd":4,"uuid":"a4c96f1d-c6f4-4d50-a607-b7c1fb291c33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6801","nonce":917968549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6803","nonce":917968549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6807","nonce":917968549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":917968549},{"type":"v1","addr":"172.21.15.122:6805","nonce":917968549}]},"public_addr":"172.21.15.122:6801/917968549","cluster_addr":"172.21.15.122:6803/917968549","heartbeat_back_addr":"172.21.15.122:6807/917968549","heartbeat_front_addr":"172.21.15.122:6805/917968549","state":["exists","up"]},{"osd":5,"uuid":"90bc798b-138e-4fdf-9d41-96033624e5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6809","nonce":1398878302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6811","nonce":1398878302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6815","nonce":1398878302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1398878302},{"type":"v1","addr":"172.21.15.122:6813","nonce":1398878302}]},"public_addr":"172.21.15.122:6809/1398878302","cluster_addr":"172.21.15.122:6811/1398878302","heartbeat_back_addr":"172.21.15.122:6815/1398878302","heartbeat_front_addr":"172.21.15.122:6813/1398878302","state":["exists","up"]},{"osd":6,"uuid":"389bd9eb-d184-4cef-b0b3-d394fc66d6ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6817","nonce":2755171866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6819","nonce":2755171866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6823","nonce":2755171866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":2755171866},{"type":"v1","addr":"172.21.15.122:6821","nonce":2755171866}]},"public_addr":"172.21.15.122:6817/2755171866","cluster_addr":"172.21.15.122:6819/2755171866","heartbeat_back_addr":"172.21.15.122:6823/2755171866","heartbeat_front_addr":"172.21.15.122:6821/2755171866","state":["exists","up"]},{"osd":7,"uuid":"10dc21d5-f4a9-45fe-aef7-86edd176ff05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6825","nonce":110375226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6827","nonce":110375226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6831","nonce":110375226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":110375226},{"type":"v1","addr":"172.21.15.122:6829","nonce":110375226}]},"public_addr":"172.21.15.122:6825/110375226","cluster_addr":"172.21.15.122:6827/110375226","heartbeat_back_addr":"172.21.15.122:6831/110375226","heartbeat_front_addr":"172.21.15.122:6829/110375226","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.075796+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.092644+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.118551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.176050+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.162700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.033249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.085854+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:39:48.159283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.7","mappings":[{"from":0,"to":5}]},{"pgid":"17.3f","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/2955237098":"2023-11-04T02:47:38.484200+0000","172.21.15.77:6835/2107153526":"2023-11-05T01:47:23.380657+0000","192.168.0.1:0/2249624526":"2023-11-04T02:46:54.400007+0000","172.21.15.122:6834/1450731169":"2023-11-05T01:46:46.102329+0000","172.21.15.77:6834/3276812155":"2023-11-05T01:46:39.299125+0000","172.21.15.77:6832/3276812155":"2023-11-05T01:46:39.299125+0000","172.21.15.122:6836/1450731169":"2023-11-05T01:46:46.102329+0000","172.21.15.122:6834/3699147778":"2023-11-05T01:44:11.242543+0000","172.21.15.122:6836/3699147778":"2023-11-05T01:44:11.242543+0000","172.21.15.77:6834/4241784871":"2023-11-05T01:44:36.807284+0000","172.21.15.122:6834/2908314953":"2023-11-05T01:45:01.982045+0000","172.21.15.77:6834/285184758":"2023-11-05T01:45:27.182069+0000","172.21.15.77:6833/2107153526":"2023-11-05T01:47:23.380657+0000","172.21.15.122:6836/2908314953":"2023-11-05T01:45:01.982045+0000","172.21.15.77:6834/4183807043":"2023-11-05T01:47:30.639992+0000","172.21.15.122:6836/1345816612":"2023-11-05T01:45:54.789240+0000","172.21.15.77:6832/285184758":"2023-11-05T01:45:27.182069+0000","172.21.15.122:6834/1345816612":"2023-11-05T01:45:54.789240+0000","172.21.15.77:6833/3207490604":"2023-11-05T01:46:01.591697+0000","172.21.15.77:6832/4183807043":"2023-11-05T01:47:30.639992+0000","172.21.15.77:6832/4241784871":"2023-11-05T01:44:36.807284+0000","172.21.15.77:6835/3207490604":"2023-11-05T01:46:01.591697+0000","192.168.0.1:0/3032548059":"2023-11-04T02:46:09.897134+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":17,"snaps":[{"begin":11,"length":4}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:48:13.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.823+0000 7f7b2417c640 1 -- 172.21.15.77:0/1444633216 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7b0006ae70 msgr2=0x7f7b0006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:13.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.823+0000 7f7b2417c640 1 --2- 172.21.15.77:0/1444633216 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7b0006ae70 0x7f7b0006d330 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f7b18038000 tx=0x7f7b18008040 comp rx=0 tx=0).stop 2023-11-04T01:48:13.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.823+0000 7f7b2417c640 1 -- 172.21.15.77:0/1444633216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b1c06fff0 msgr2=0x7f7b1c15b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:13.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.823+0000 7f7b2417c640 1 --2- 172.21.15.77:0/1444633216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b1c06fff0 0x7f7b1c15b110 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c00c820 tx=0x7f7b0c00cc20 comp rx=0 tx=0).stop 2023-11-04T01:48:13.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.823+0000 7f7b2417c640 1 -- 172.21.15.77:0/1444633216 shutdown_connections 2023-11-04T01:48:13.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.823+0000 7f7b2417c640 1 --2- 172.21.15.77:0/1444633216 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f7b0006ae70 0x7f7b0006d330 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:13.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.823+0000 7f7b2417c640 1 --2- 172.21.15.77:0/1444633216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7b1c159e40 0x7f7b1c0ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:13.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.823+0000 7f7b2417c640 1 --2- 172.21.15.77:0/1444633216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b1c06fff0 0x7f7b1c15b110 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:13.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.823+0000 7f7b2417c640 1 --2- 172.21.15.77:0/1444633216 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f7b1c06bb60 0x7f7b1c14ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:13.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.823+0000 7f7b2417c640 1 -- 172.21.15.77:0/1444633216 >> 172.21.15.77:0/1444633216 conn(0x7f7b1c0cb530 msgr2=0x7f7b1c159010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:13.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.823+0000 7f7b2417c640 1 -- 172.21.15.77:0/1444633216 shutdown_connections 2023-11-04T01:48:13.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.823+0000 7f7b2417c640 1 -- 172.21.15.77:0/1444633216 wait complete. 2023-11-04T01:48:13.835 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:39:51.664743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:41:33.142176+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:42:33.159064+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 70, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:42:33.647358+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:43:24.372767+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:43:25.241976+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 14, 'snap_epoch': 116, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:48:13.836 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:48:13.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.937+0000 7f7689687640 1 Processor -- start 2023-11-04T01:48:13.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.937+0000 7f7689687640 1 -- start start 2023-11-04T01:48:13.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.938+0000 7f7689687640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f768415d100 0x7f76840ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:13.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.938+0000 7f7689687640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76840b32b0 con 0x7f768415d4e0 2023-11-04T01:48:13.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.938+0000 7f7689687640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76840cee10 con 0x7f76840d1be0 2023-11-04T01:48:13.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.938+0000 7f7689687640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76840b2980 con 0x7f768415d100 2023-11-04T01:48:13.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.938+0000 7f76827fc640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f768415d4e0 0x7f76840d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35784/0 (socket says 172.21.15.77:35784) 2023-11-04T01:48:13.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.938+0000 7f76827fc640 1 -- 172.21.15.77:0/2621949764 learned_addr learned my addr 172.21.15.77:0/2621949764 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:48:13.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.938+0000 7f7682ffd640 1 --2- 172.21.15.77:0/2621949764 >> v2:172.21.15.122:3300/0 conn(0x7f768415d100 0x7f76840ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:13.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.938+0000 7f7681ffb640 1 -- 172.21.15.77:0/2621949764 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 783263653 0 0) 0x7f76840b32b0 con 0x7f768415d4e0 2023-11-04T01:48:13.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.938+0000 7f7681ffb640 1 -- 172.21.15.77:0/2621949764 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f766c003520 con 0x7f768415d4e0 2023-11-04T01:48:13.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.938+0000 7f7681ffb640 1 -- 172.21.15.77:0/2621949764 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2843744374 0 0) 0x7f766c003520 con 0x7f768415d4e0 2023-11-04T01:48:13.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.938+0000 7f7681ffb640 1 -- 172.21.15.77:0/2621949764 >> v2:172.21.15.122:3300/0 conn(0x7f768415d100 msgr2=0x7f76840ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:13.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.938+0000 7f7681ffb640 1 --2- 172.21.15.77:0/2621949764 >> v2:172.21.15.122:3300/0 conn(0x7f768415d100 0x7f76840ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:13.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.938+0000 7f7681ffb640 1 -- 172.21.15.77:0/2621949764 >> v1:172.21.15.122:6789/0 conn(0x7f76840d1be0 legacy=0x7f76840b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:13.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.938+0000 7f7681ffb640 1 -- 172.21.15.77:0/2621949764 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76840b2c60 con 0x7f768415d4e0 2023-11-04T01:48:13.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.938+0000 7f7681ffb640 1 -- 172.21.15.77:0/2621949764 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f7678001670 con 0x7f768415d4e0 2023-11-04T01:48:13.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.939+0000 7f7681ffb640 1 -- 172.21.15.77:0/2621949764 >> v1:172.21.15.77:6789/0 conn(0x7f768415d4e0 legacy=0x7f76840d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:13.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.939+0000 7f7681ffb640 1 --2- 172.21.15.77:0/2621949764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f766c003970 0x7f766c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:13.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.939+0000 7f7681ffb640 1 --2- 172.21.15.77:0/2621949764 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f766c0047c0 0x7f766c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:13.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.939+0000 7f7681ffb640 1 --2- 172.21.15.77:0/2621949764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f766c005180 0x7f766c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:13.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.939+0000 7f7681ffb640 1 -- 172.21.15.77:0/2621949764 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76840b2980 con 0x7f766c003970 2023-11-04T01:48:13.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.939+0000 7f7681ffb640 1 -- 172.21.15.77:0/2621949764 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766c00c020 con 0x7f766c005180 2023-11-04T01:48:13.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.939+0000 7f7681ffb640 1 -- 172.21.15.77:0/2621949764 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f766c00c1e0 con 0x7f766c0047c0 2023-11-04T01:48:13.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.939+0000 7f7682ffd640 1 --2- 172.21.15.77:0/2621949764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f766c003970 0x7f766c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:13.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.939+0000 7f76837fe640 1 --2- 172.21.15.77:0/2621949764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f766c005180 0x7f766c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:13.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.939+0000 7f76827fc640 1 --2- 172.21.15.77:0/2621949764 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f766c0047c0 0x7f766c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:13.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.939+0000 7f7682ffd640 1 -- 172.21.15.77:0/2621949764 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f766c0047c0 msgr2=0x7f766c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:13.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.939+0000 7f7682ffd640 1 --2- 172.21.15.77:0/2621949764 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f766c0047c0 0x7f766c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:13.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.939+0000 7f7682ffd640 1 -- 172.21.15.77:0/2621949764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f766c005180 msgr2=0x7f766c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:13.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.939+0000 7f7682ffd640 1 --2- 172.21.15.77:0/2621949764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f766c005180 0x7f766c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:13.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.939+0000 7f7682ffd640 1 -- 172.21.15.77:0/2621949764 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766c003520 con 0x7f766c003970 2023-11-04T01:48:13.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.939+0000 7f76837fe640 1 -- 172.21.15.77:0/2621949764 reap_dead start 2023-11-04T01:48:13.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.939+0000 7f76827fc640 1 --2- 172.21.15.77:0/2621949764 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f766c0047c0 0x7f766c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:48:13.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.940+0000 7f7682ffd640 1 --2- 172.21.15.77:0/2621949764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f766c003970 0x7f766c003d90 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f7674009ab0 tx=0x7f766c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b32eab03ad02fe7f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:13.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.940+0000 7f7681ffb640 1 -- 172.21.15.77:0/2621949764 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7674005990 con 0x7f766c003970 2023-11-04T01:48:13.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.940+0000 7f7681ffb640 1 -- 172.21.15.77:0/2621949764 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7674005af0 con 0x7f766c003970 2023-11-04T01:48:13.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.940+0000 7f7681ffb640 1 -- 172.21.15.77:0/2621949764 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7674005ea0 con 0x7f766c003970 2023-11-04T01:48:13.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.940+0000 7f7689687640 1 -- 172.21.15.77:0/2621949764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f766c003970 msgr2=0x7f766c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:13.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.940+0000 7f7689687640 1 --2- 172.21.15.77:0/2621949764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f766c003970 0x7f766c003d90 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f7674009ab0 tx=0x7f766c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:48:13.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.940+0000 7f7689687640 1 -- 172.21.15.77:0/2621949764 shutdown_connections 2023-11-04T01:48:13.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.940+0000 7f7689687640 1 --2- 172.21.15.77:0/2621949764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f766c003970 0x7f766c003d90 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:13.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.940+0000 7f7689687640 1 -- 172.21.15.77:0/2621949764 >> 172.21.15.77:0/2621949764 conn(0x7f76840d2ef0 msgr2=0x7f76840d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:13.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.940+0000 7f7689687640 1 -- 172.21.15.77:0/2621949764 shutdown_connections 2023-11-04T01:48:13.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.940+0000 7f7689687640 1 -- 172.21.15.77:0/2621949764 wait complete. 2023-11-04T01:48:13.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.942+0000 7f7689687640 1 Processor -- start 2023-11-04T01:48:13.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.942+0000 7f7689687640 1 -- start start 2023-11-04T01:48:13.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.943+0000 7f7689687640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f766c003970 0x7f76840cc540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:13.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.943+0000 7f7689687640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f768415a590 0x7f76840c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:13.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.943+0000 7f7689687640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f76841f30c0 0x7f76840b76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:13.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.943+0000 7f7689687640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76840c9e30 con 0x7f768415a590 2023-11-04T01:48:13.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.943+0000 7f7689687640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768415a9f0 con 0x7f766c003970 2023-11-04T01:48:13.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.943+0000 7f7689687640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76840ccb20 con 0x7f76841f30c0 2023-11-04T01:48:13.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.943+0000 7f76827fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f768415a590 0x7f76840c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:13.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.943+0000 7f76827fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f768415a590 0x7f76840c98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60846/0 (socket says 172.21.15.77:60846) 2023-11-04T01:48:13.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.943+0000 7f76827fc640 1 -- 172.21.15.77:0/1873317635 learned_addr learned my addr 172.21.15.77:0/1873317635 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:48:13.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.943+0000 7f7682ffd640 1 --2- 172.21.15.77:0/1873317635 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f766c003970 0x7f76840cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:13.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.943+0000 7f76837fe640 1 --2- 172.21.15.77:0/1873317635 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f76841f30c0 0x7f76840b76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:13.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.943+0000 7f76827fc640 1 -- 172.21.15.77:0/1873317635 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f76841f30c0 msgr2=0x7f76840b76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:13.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.943+0000 7f76827fc640 1 --2- 172.21.15.77:0/1873317635 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f76841f30c0 0x7f76840b76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:13.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.943+0000 7f76827fc640 1 -- 172.21.15.77:0/1873317635 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f766c003970 msgr2=0x7f76840cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:13.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.943+0000 7f76827fc640 1 --2- 172.21.15.77:0/1873317635 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f766c003970 0x7f76840cc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:13.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.943+0000 7f76827fc640 1 -- 172.21.15.77:0/1873317635 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76840ca060 con 0x7f768415a590 2023-11-04T01:48:13.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.943+0000 7f76837fe640 1 --2- 172.21.15.77:0/1873317635 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f76841f30c0 0x7f76840b76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:48:13.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.944+0000 7f76827fc640 1 --2- 172.21.15.77:0/1873317635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f768415a590 0x7f76840c98f0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f767800e730 tx=0x7f767800ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:13.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.944+0000 7f766b7fe640 1 -- 172.21.15.77:0/1873317635 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767800c660 con 0x7f768415a590 2023-11-04T01:48:13.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.944+0000 7f766b7fe640 1 -- 172.21.15.77:0/1873317635 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767800c7c0 con 0x7f768415a590 2023-11-04T01:48:13.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.944+0000 7f7689687640 1 -- 172.21.15.77:0/1873317635 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76840ca340 con 0x7f768415a590 2023-11-04T01:48:13.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.944+0000 7f766b7fe640 1 -- 172.21.15.77:0/1873317635 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767800cb50 con 0x7f768415a590 2023-11-04T01:48:13.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.944+0000 7f7689687640 1 -- 172.21.15.77:0/1873317635 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76840ca900 con 0x7f768415a590 2023-11-04T01:48:13.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.945+0000 7f7689687640 1 -- 172.21.15.77:0/1873317635 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76840684b0 con 0x7f768415a590 2023-11-04T01:48:13.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.945+0000 7f766b7fe640 1 -- 172.21.15.77:0/1873317635 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f767801d460 con 0x7f768415a590 2023-11-04T01:48:13.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.946+0000 7f766b7fe640 1 --2- 172.21.15.77:0/1873317635 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f767006ae70 0x7f767006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:13.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.946+0000 7f766b7fe640 1 -- 172.21.15.77:0/1873317635 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f767808a010 con 0x7f768415a590 2023-11-04T01:48:13.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.946+0000 7f7682ffd640 1 --2- 172.21.15.77:0/1873317635 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f767006ae70 0x7f767006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:13.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.946+0000 7f7682ffd640 1 --2- 172.21.15.77:0/1873317635 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f767006ae70 0x7f767006d330 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f7674035000 tx=0x7f7674030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:13.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:13.950+0000 7f766b7fe640 1 -- 172.21.15.77:0/1873317635 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f76780546b0 con 0x7f768415a590 2023-11-04T01:48:14.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.114+0000 7f7689687640 1 -- 172.21.15.77:0/1873317635 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f768415ba10 con 0x7f768415a590 2023-11-04T01:48:14.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.115+0000 7f766b7fe640 1 -- 172.21.15.77:0/1873317635 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v117) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7678057cd0 con 0x7f768415a590 2023-11-04T01:48:14.117 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-11-04T01:48:14.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.117+0000 7f7689687640 1 -- 172.21.15.77:0/1873317635 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f767006ae70 msgr2=0x7f767006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:14.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.117+0000 7f7689687640 1 --2- 172.21.15.77:0/1873317635 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f767006ae70 0x7f767006d330 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f7674035000 tx=0x7f7674030000 comp rx=0 tx=0).stop 2023-11-04T01:48:14.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.117+0000 7f7689687640 1 -- 172.21.15.77:0/1873317635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f768415a590 msgr2=0x7f76840c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:14.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.117+0000 7f7689687640 1 --2- 172.21.15.77:0/1873317635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f768415a590 0x7f76840c98f0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f767800e730 tx=0x7f767800ebf0 comp rx=0 tx=0).stop 2023-11-04T01:48:14.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.117+0000 7f7689687640 1 -- 172.21.15.77:0/1873317635 shutdown_connections 2023-11-04T01:48:14.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.117+0000 7f7689687640 1 --2- 172.21.15.77:0/1873317635 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f767006ae70 0x7f767006d330 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:14.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.117+0000 7f7689687640 1 --2- 172.21.15.77:0/1873317635 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f76841f30c0 0x7f76840b76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:14.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.117+0000 7f7689687640 1 --2- 172.21.15.77:0/1873317635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f768415a590 0x7f76840c98f0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:14.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.117+0000 7f7689687640 1 --2- 172.21.15.77:0/1873317635 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f766c003970 0x7f76840cc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:14.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.117+0000 7f7689687640 1 -- 172.21.15.77:0/1873317635 >> 172.21.15.77:0/1873317635 conn(0x7f76840d2ef0 msgr2=0x7f76840d20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:14.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.117+0000 7f7689687640 1 -- 172.21.15.77:0/1873317635 shutdown_connections 2023-11-04T01:48:14.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.117+0000 7f7689687640 1 -- 172.21.15.77:0/1873317635 wait complete. 2023-11-04T01:48:14.129 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:48:14.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.229+0000 7f53002c9640 1 Processor -- start 2023-11-04T01:48:14.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.229+0000 7f53002c9640 1 -- start start 2023-11-04T01:48:14.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.230+0000 7f53002c9640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f52f815d100 0x7f52f80ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:14.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.230+0000 7f53002c9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f52f815d4e0 0x7f52f80d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:14.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.230+0000 7f53002c9640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52f80b32b0 con 0x7f52f80d3b60 2023-11-04T01:48:14.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.230+0000 7f53002c9640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52f80cee10 con 0x7f52f815d100 2023-11-04T01:48:14.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.230+0000 7f53002c9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f80b4750 con 0x7f52f815d4e0 2023-11-04T01:48:14.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.231+0000 7f52fd864640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f52f815d4e0 0x7f52f80d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:14.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.231+0000 7f52fe065640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f52f815d100 0x7f52f80ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:14.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.231+0000 7f52fe866640 1 --1- >> v1:172.21.15.122:6789/0 conn(0x7f52f80d3b60 0x7f52f80cf520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.122:6789/0 says I am v1:172.21.15.77:46330/0 (socket says 172.21.15.77:46330) 2023-11-04T01:48:14.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.231+0000 7f52fe866640 1 -- 172.21.15.77:0/4218920142 learned_addr learned my addr 172.21.15.77:0/4218920142 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:48:14.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.231+0000 7f52fe065640 1 -- 172.21.15.77:0/4218920142 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f52f815d4e0 msgr2=0x7f52f80d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:14.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.231+0000 7f52fe065640 1 --2- 172.21.15.77:0/4218920142 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f52f815d4e0 0x7f52f80d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:14.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.231+0000 7f52fe065640 1 -- 172.21.15.77:0/4218920142 >> v1:172.21.15.122:6789/0 conn(0x7f52f80d3b60 legacy=0x7f52f80cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:14.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.231+0000 7f52fe065640 1 -- 172.21.15.77:0/4218920142 --> v2:172.21.15.122:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f80b2980 con 0x7f52f815d100 2023-11-04T01:48:14.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.231+0000 7f52fd864640 1 --2- 172.21.15.77:0/4218920142 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f52f815d4e0 0x7f52f80d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:48:14.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.232+0000 7f52fe065640 1 --2- 172.21.15.77:0/4218920142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52f815d100 0x7f52f80ce510 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f52f4009de0 tx=0x7f52f402bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a8867fe78a5a7ef server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:14.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.232+0000 7f52fd063640 1 -- 172.21.15.77:0/4218920142 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f402cc90 con 0x7f52f815d100 2023-11-04T01:48:14.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.232+0000 7f52fd063640 1 -- 172.21.15.77:0/4218920142 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f402cdf0 con 0x7f52f815d100 2023-11-04T01:48:14.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.232+0000 7f52fd063640 1 -- 172.21.15.77:0/4218920142 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f4034660 con 0x7f52f815d100 2023-11-04T01:48:14.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.232+0000 7f53002c9640 1 -- 172.21.15.77:0/4218920142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52f815d100 msgr2=0x7f52f80ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:14.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.232+0000 7f53002c9640 1 --2- 172.21.15.77:0/4218920142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52f815d100 0x7f52f80ce510 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f52f4009de0 tx=0x7f52f402bee0 comp rx=0 tx=0).stop 2023-11-04T01:48:14.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.233+0000 7f53002c9640 1 -- 172.21.15.77:0/4218920142 shutdown_connections 2023-11-04T01:48:14.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.233+0000 7f53002c9640 1 --2- 172.21.15.77:0/4218920142 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f52f815d4e0 0x7f52f80d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:14.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.233+0000 7f53002c9640 1 --2- 172.21.15.77:0/4218920142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52f815d100 0x7f52f80ce510 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:14.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.233+0000 7f53002c9640 1 -- 172.21.15.77:0/4218920142 >> 172.21.15.77:0/4218920142 conn(0x7f52f80d2ef0 msgr2=0x7f52f80d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:14.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.233+0000 7f53002c9640 1 -- 172.21.15.77:0/4218920142 shutdown_connections 2023-11-04T01:48:14.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.233+0000 7f53002c9640 1 -- 172.21.15.77:0/4218920142 wait complete. 2023-11-04T01:48:14.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.234+0000 7f53002c9640 1 Processor -- start 2023-11-04T01:48:14.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.234+0000 7f53002c9640 1 -- start start 2023-11-04T01:48:14.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.234+0000 7f53002c9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52f80d3b60 0x7f52f80cf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:14.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.234+0000 7f53002c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52f815d100 0x7f52f80cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:14.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.234+0000 7f53002c9640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f52f815d4e0 0x7f52f80c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:14.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.234+0000 7f53002c9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f81f6e70 con 0x7f52f815d100 2023-11-04T01:48:14.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.234+0000 7f53002c9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f81f61f0 con 0x7f52f80d3b60 2023-11-04T01:48:14.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.234+0000 7f53002c9640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f81f64d0 con 0x7f52f815d4e0 2023-11-04T01:48:14.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.235+0000 7f52fd864640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52f815d100 0x7f52f80cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:14.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.235+0000 7f52fd864640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52f815d100 0x7f52f80cfc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60848/0 (socket says 172.21.15.77:60848) 2023-11-04T01:48:14.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.235+0000 7f52fd864640 1 -- 172.21.15.77:0/1122467872 learned_addr learned my addr 172.21.15.77:0/1122467872 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:48:14.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.235+0000 7f52fe065640 1 --2- 172.21.15.77:0/1122467872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52f80d3b60 0x7f52f80cf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:14.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.235+0000 7f52fe866640 1 --2- 172.21.15.77:0/1122467872 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f52f815d4e0 0x7f52f80c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:14.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.235+0000 7f52fd864640 1 -- 172.21.15.77:0/1122467872 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f52f815d4e0 msgr2=0x7f52f80c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:14.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.235+0000 7f52fd864640 1 --2- 172.21.15.77:0/1122467872 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f52f815d4e0 0x7f52f80c9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:14.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.235+0000 7f52fd864640 1 -- 172.21.15.77:0/1122467872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52f80d3b60 msgr2=0x7f52f80cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:14.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.235+0000 7f52fd864640 1 --2- 172.21.15.77:0/1122467872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52f80d3b60 0x7f52f80cf6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:14.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.235+0000 7f52fd864640 1 -- 172.21.15.77:0/1122467872 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e8009400 con 0x7f52f815d100 2023-11-04T01:48:14.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.235+0000 7f52fd864640 1 --2- 172.21.15.77:0/1122467872 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52f815d100 0x7f52f80cfc20 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f52e800ebe0 tx=0x7f52e800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:14.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.235+0000 7f52eeffd640 1 -- 172.21.15.77:0/1122467872 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e8009760 con 0x7f52f815d100 2023-11-04T01:48:14.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.235+0000 7f52eeffd640 1 -- 172.21.15.77:0/1122467872 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e800cc30 con 0x7f52f815d100 2023-11-04T01:48:14.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.235+0000 7f53002c9640 1 -- 172.21.15.77:0/1122467872 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f4009a70 con 0x7f52f815d100 2023-11-04T01:48:14.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.235+0000 7f52eeffd640 1 -- 172.21.15.77:0/1122467872 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e800eee0 con 0x7f52f815d100 2023-11-04T01:48:14.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.235+0000 7f53002c9640 1 -- 172.21.15.77:0/1122467872 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f81f6a90 con 0x7f52f815d100 2023-11-04T01:48:14.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.236+0000 7f53002c9640 1 -- 172.21.15.77:0/1122467872 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f80684b0 con 0x7f52f815d100 2023-11-04T01:48:14.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.237+0000 7f52eeffd640 1 -- 172.21.15.77:0/1122467872 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f52e8013470 con 0x7f52f815d100 2023-11-04T01:48:14.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.237+0000 7f52eeffd640 1 --2- 172.21.15.77:0/1122467872 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f52dc06ae70 0x7f52dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:14.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.237+0000 7f52eeffd640 1 -- 172.21.15.77:0/1122467872 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f52e808a340 con 0x7f52f815d100 2023-11-04T01:48:14.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.237+0000 7f52fe065640 1 --2- 172.21.15.77:0/1122467872 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f52dc06ae70 0x7f52dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:14.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.238+0000 7f52fe065640 1 --2- 172.21.15.77:0/1122467872 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f52dc06ae70 0x7f52dc06d330 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f52f4036000 tx=0x7f52f4030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:14.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.241+0000 7f52eeffd640 1 -- 172.21.15.77:0/1122467872 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f52e80549f0 con 0x7f52f815d100 2023-11-04T01:48:14.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.405+0000 7f53002c9640 1 -- 172.21.15.77:0/1122467872 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f52f80d2cd0 con 0x7f52f815d100 2023-11-04T01:48:14.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.406+0000 7f52eeffd640 1 -- 172.21.15.77:0/1122467872 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v117) v1 ==== 103+0+11 (secure 0 0 0) 0x7f52e8058010 con 0x7f52f815d100 2023-11-04T01:48:14.408 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:48:14.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.407+0000 7f53002c9640 1 -- 172.21.15.77:0/1122467872 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f52dc06ae70 msgr2=0x7f52dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:14.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.407+0000 7f53002c9640 1 --2- 172.21.15.77:0/1122467872 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f52dc06ae70 0x7f52dc06d330 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f52f4036000 tx=0x7f52f4030000 comp rx=0 tx=0).stop 2023-11-04T01:48:14.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.407+0000 7f53002c9640 1 -- 172.21.15.77:0/1122467872 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52f815d100 msgr2=0x7f52f80cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:14.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.407+0000 7f53002c9640 1 --2- 172.21.15.77:0/1122467872 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52f815d100 0x7f52f80cfc20 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f52e800ebe0 tx=0x7f52e800c520 comp rx=0 tx=0).stop 2023-11-04T01:48:14.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.407+0000 7f53002c9640 1 -- 172.21.15.77:0/1122467872 shutdown_connections 2023-11-04T01:48:14.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.407+0000 7f53002c9640 1 --2- 172.21.15.77:0/1122467872 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f52dc06ae70 0x7f52dc06d330 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:14.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.407+0000 7f53002c9640 1 --2- 172.21.15.77:0/1122467872 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f52f815d4e0 0x7f52f80c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:14.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.407+0000 7f53002c9640 1 --2- 172.21.15.77:0/1122467872 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52f815d100 0x7f52f80cfc20 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:14.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.407+0000 7f53002c9640 1 --2- 172.21.15.77:0/1122467872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f52f80d3b60 0x7f52f80cf6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:14.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.407+0000 7f53002c9640 1 -- 172.21.15.77:0/1122467872 >> 172.21.15.77:0/1122467872 conn(0x7f52f80d2ef0 msgr2=0x7f52f815c460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:14.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.408+0000 7f53002c9640 1 -- 172.21.15.77:0/1122467872 shutdown_connections 2023-11-04T01:48:14.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.408+0000 7f53002c9640 1 -- 172.21.15.77:0/1122467872 wait complete. 2023-11-04T01:48:14.420 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:48:14.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.520+0000 7ff0a1ad7640 1 Processor -- start 2023-11-04T01:48:14.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.520+0000 7ff0a1ad7640 1 -- start start 2023-11-04T01:48:14.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.521+0000 7ff0a1ad7640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff09c070700 0x7ff09c164b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:14.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.521+0000 7ff0a1ad7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff09c071500 con 0x7ff09c0b0c40 2023-11-04T01:48:14.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.521+0000 7ff0a1ad7640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff09c15dae0 con 0x7ff09c159e40 2023-11-04T01:48:14.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.521+0000 7ff0a1ad7640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff09c070c60 con 0x7ff09c070700 2023-11-04T01:48:14.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.521+0000 7ff09affd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ff09c0b0c40 0x7ff09c06fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35796/0 (socket says 172.21.15.77:35796) 2023-11-04T01:48:14.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.521+0000 7ff09affd640 1 -- 172.21.15.77:0/4026714161 learned_addr learned my addr 172.21.15.77:0/4026714161 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:48:14.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.521+0000 7ff09bfff640 1 --2- 172.21.15.77:0/4026714161 >> v2:172.21.15.122:3300/0 conn(0x7ff09c070700 0x7ff09c164b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:14.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.521+0000 7ff09a7fc640 1 -- 172.21.15.77:0/4026714161 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2604155416 0 0) 0x7ff09c071500 con 0x7ff09c0b0c40 2023-11-04T01:48:14.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.521+0000 7ff09a7fc640 1 -- 172.21.15.77:0/4026714161 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff084003520 con 0x7ff09c0b0c40 2023-11-04T01:48:14.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.522+0000 7ff09a7fc640 1 -- 172.21.15.77:0/4026714161 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2568133215 0 0) 0x7ff084003520 con 0x7ff09c0b0c40 2023-11-04T01:48:14.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.522+0000 7ff09a7fc640 1 -- 172.21.15.77:0/4026714161 >> v2:172.21.15.122:3300/0 conn(0x7ff09c070700 msgr2=0x7ff09c164b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:14.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.522+0000 7ff09a7fc640 1 --2- 172.21.15.77:0/4026714161 >> v2:172.21.15.122:3300/0 conn(0x7ff09c070700 0x7ff09c164b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:14.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.522+0000 7ff09a7fc640 1 -- 172.21.15.77:0/4026714161 >> v1:172.21.15.122:6789/0 conn(0x7ff09c159e40 legacy=0x7ff09c0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:14.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.522+0000 7ff09a7fc640 1 -- 172.21.15.77:0/4026714161 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09c070f40 con 0x7ff09c0b0c40 2023-11-04T01:48:14.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.522+0000 7ff09a7fc640 1 -- 172.21.15.77:0/4026714161 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7ff090001670 con 0x7ff09c0b0c40 2023-11-04T01:48:14.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.522+0000 7ff09a7fc640 1 -- 172.21.15.77:0/4026714161 >> v1:172.21.15.77:6789/0 conn(0x7ff09c0b0c40 legacy=0x7ff09c06fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:14.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.522+0000 7ff09a7fc640 1 --2- 172.21.15.77:0/4026714161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff084003970 0x7ff084003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:14.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.522+0000 7ff09a7fc640 1 --2- 172.21.15.77:0/4026714161 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff0840047c0 0x7ff084004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:14.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.522+0000 7ff09a7fc640 1 --2- 172.21.15.77:0/4026714161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff084005180 0x7ff08400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:14.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.522+0000 7ff09a7fc640 1 -- 172.21.15.77:0/4026714161 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c070c60 con 0x7ff084003970 2023-11-04T01:48:14.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.522+0000 7ff09a7fc640 1 -- 172.21.15.77:0/4026714161 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08400c120 con 0x7ff084005180 2023-11-04T01:48:14.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.522+0000 7ff09a7fc640 1 -- 172.21.15.77:0/4026714161 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff08400c2e0 con 0x7ff0840047c0 2023-11-04T01:48:14.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.522+0000 7ff09b7fe640 1 --2- 172.21.15.77:0/4026714161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff084003970 0x7ff084003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:14.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.522+0000 7ff09bfff640 1 --2- 172.21.15.77:0/4026714161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff084005180 0x7ff08400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:14.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.522+0000 7ff09affd640 1 --2- 172.21.15.77:0/4026714161 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff0840047c0 0x7ff084004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:14.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.522+0000 7ff09b7fe640 1 -- 172.21.15.77:0/4026714161 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff0840047c0 msgr2=0x7ff084004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:14.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.522+0000 7ff09b7fe640 1 --2- 172.21.15.77:0/4026714161 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff0840047c0 0x7ff084004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:14.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.522+0000 7ff09b7fe640 1 -- 172.21.15.77:0/4026714161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff084005180 msgr2=0x7ff08400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:14.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.522+0000 7ff09b7fe640 1 --2- 172.21.15.77:0/4026714161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff084005180 0x7ff08400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:14.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.522+0000 7ff09bfff640 1 -- 172.21.15.77:0/4026714161 reap_dead start 2023-11-04T01:48:14.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.522+0000 7ff09b7fe640 1 -- 172.21.15.77:0/4026714161 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff084003520 con 0x7ff084003970 2023-11-04T01:48:14.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.522+0000 7ff09affd640 1 --2- 172.21.15.77:0/4026714161 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff0840047c0 0x7ff084004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:48:14.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.523+0000 7ff09b7fe640 1 --2- 172.21.15.77:0/4026714161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff084003970 0x7ff084003d90 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7ff08c001750 tx=0x7ff0840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d239c92b56a8d134 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:14.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.523+0000 7ff09a7fc640 1 -- 172.21.15.77:0/4026714161 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c0052d0 con 0x7ff084003970 2023-11-04T01:48:14.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.523+0000 7ff09a7fc640 1 -- 172.21.15.77:0/4026714161 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08c02e050 con 0x7ff084003970 2023-11-04T01:48:14.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.523+0000 7ff09a7fc640 1 -- 172.21.15.77:0/4026714161 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c003830 con 0x7ff084003970 2023-11-04T01:48:14.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.523+0000 7ff0a1ad7640 1 -- 172.21.15.77:0/4026714161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff084003970 msgr2=0x7ff084003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:14.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.523+0000 7ff0a1ad7640 1 --2- 172.21.15.77:0/4026714161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff084003970 0x7ff084003d90 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7ff08c001750 tx=0x7ff0840057f0 comp rx=0 tx=0).stop 2023-11-04T01:48:14.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.524+0000 7ff0a1ad7640 1 -- 172.21.15.77:0/4026714161 shutdown_connections 2023-11-04T01:48:14.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.524+0000 7ff0a1ad7640 1 --2- 172.21.15.77:0/4026714161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff084003970 0x7ff084003d90 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:14.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.524+0000 7ff0a1ad7640 1 -- 172.21.15.77:0/4026714161 >> 172.21.15.77:0/4026714161 conn(0x7ff09c0cb530 msgr2=0x7ff09c0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:14.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.524+0000 7ff0a1ad7640 1 -- 172.21.15.77:0/4026714161 shutdown_connections 2023-11-04T01:48:14.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.524+0000 7ff0a1ad7640 1 -- 172.21.15.77:0/4026714161 wait complete. 2023-11-04T01:48:14.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.525+0000 7ff0a1ad7640 1 Processor -- start 2023-11-04T01:48:14.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.525+0000 7ff0a1ad7640 1 -- start start 2023-11-04T01:48:14.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.525+0000 7ff0a1ad7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff084003970 0x7ff09c15ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:14.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.525+0000 7ff0a1ad7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff09c15ccc0 0x7ff09c1efbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:14.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.526+0000 7ff0a1ad7640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff09c0c7740 0x7ff09c0c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:14.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.526+0000 7ff0a1ad7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c0c8100 con 0x7ff084003970 2023-11-04T01:48:14.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.526+0000 7ff0a1ad7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c0c1c90 con 0x7ff09c15ccc0 2023-11-04T01:48:14.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.526+0000 7ff0a1ad7640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c1edfe0 con 0x7ff09c0c7740 2023-11-04T01:48:14.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.526+0000 7ff09b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff084003970 0x7ff09c15ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:14.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.526+0000 7ff09b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff084003970 0x7ff09c15ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60864/0 (socket says 172.21.15.77:60864) 2023-11-04T01:48:14.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.526+0000 7ff09b7fe640 1 -- 172.21.15.77:0/1975733813 learned_addr learned my addr 172.21.15.77:0/1975733813 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:48:14.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.526+0000 7ff09affd640 1 --2- 172.21.15.77:0/1975733813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff09c15ccc0 0x7ff09c1efbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:14.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.526+0000 7ff09bfff640 1 --2- 172.21.15.77:0/1975733813 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff09c0c7740 0x7ff09c0c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:14.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.526+0000 7ff09b7fe640 1 -- 172.21.15.77:0/1975733813 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff09c0c7740 msgr2=0x7ff09c0c7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:14.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.526+0000 7ff09b7fe640 1 --2- 172.21.15.77:0/1975733813 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff09c0c7740 0x7ff09c0c7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:14.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.526+0000 7ff09b7fe640 1 -- 172.21.15.77:0/1975733813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff09c15ccc0 msgr2=0x7ff09c1efbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:14.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.526+0000 7ff09b7fe640 1 --2- 172.21.15.77:0/1975733813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff09c15ccc0 0x7ff09c1efbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:14.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.526+0000 7ff09b7fe640 1 -- 172.21.15.77:0/1975733813 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09c15b210 con 0x7ff084003970 2023-11-04T01:48:14.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.526+0000 7ff09b7fe640 1 --2- 172.21.15.77:0/1975733813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff084003970 0x7ff09c15ac30 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7ff08c005040 tx=0x7ff08c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:14.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.526+0000 7ff083fff640 1 -- 172.21.15.77:0/1975733813 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c007a30 con 0x7ff084003970 2023-11-04T01:48:14.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.526+0000 7ff083fff640 1 -- 172.21.15.77:0/1975733813 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08c0069e0 con 0x7ff084003970 2023-11-04T01:48:14.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.526+0000 7ff083fff640 1 -- 172.21.15.77:0/1975733813 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c006d70 con 0x7ff084003970 2023-11-04T01:48:14.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.526+0000 7ff0a1ad7640 1 -- 172.21.15.77:0/1975733813 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff09c15b4f0 con 0x7ff084003970 2023-11-04T01:48:14.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.526+0000 7ff0a1ad7640 1 -- 172.21.15.77:0/1975733813 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff09c15bab0 con 0x7ff084003970 2023-11-04T01:48:14.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.527+0000 7ff0a1ad7640 1 -- 172.21.15.77:0/1975733813 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff09c15bc40 con 0x7ff084003970 2023-11-04T01:48:14.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.528+0000 7ff083fff640 1 -- 172.21.15.77:0/1975733813 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff08c0035f0 con 0x7ff084003970 2023-11-04T01:48:14.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.528+0000 7ff083fff640 1 --2- 172.21.15.77:0/1975733813 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff08806aea0 0x7ff08806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:14.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.528+0000 7ff083fff640 1 -- 172.21.15.77:0/1975733813 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8195+0+0 (secure 0 0 0) 0x7ff08c0ac010 con 0x7ff084003970 2023-11-04T01:48:14.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.528+0000 7ff09affd640 1 --2- 172.21.15.77:0/1975733813 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff08806aea0 0x7ff08806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:14.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.529+0000 7ff09affd640 1 --2- 172.21.15.77:0/1975733813 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff08806aea0 0x7ff08806d360 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff09c0b0190 tx=0x7ff090007040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:14.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.532+0000 7ff083fff640 1 -- 172.21.15.77:0/1975733813 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff08c0766d0 con 0x7ff084003970 2023-11-04T01:48:14.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.701+0000 7ff0a1ad7640 1 -- 172.21.15.77:0/1975733813 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7ff09c06bb30 con 0x7ff084003970 2023-11-04T01:48:14.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.701+0000 7ff083fff640 1 -- 172.21.15.77:0/1975733813 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v117) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff08c04b070 con 0x7ff084003970 2023-11-04T01:48:14.703 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:48:14.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.703+0000 7ff0a1ad7640 1 -- 172.21.15.77:0/1975733813 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff08806aea0 msgr2=0x7ff08806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:14.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.703+0000 7ff0a1ad7640 1 --2- 172.21.15.77:0/1975733813 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff08806aea0 0x7ff08806d360 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff09c0b0190 tx=0x7ff090007040 comp rx=0 tx=0).stop 2023-11-04T01:48:14.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.703+0000 7ff0a1ad7640 1 -- 172.21.15.77:0/1975733813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff084003970 msgr2=0x7ff09c15ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:14.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.703+0000 7ff0a1ad7640 1 --2- 172.21.15.77:0/1975733813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff084003970 0x7ff09c15ac30 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7ff08c005040 tx=0x7ff08c001120 comp rx=0 tx=0).stop 2023-11-04T01:48:14.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.703+0000 7ff0a1ad7640 1 -- 172.21.15.77:0/1975733813 shutdown_connections 2023-11-04T01:48:14.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.703+0000 7ff0a1ad7640 1 --2- 172.21.15.77:0/1975733813 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7ff08806aea0 0x7ff08806d360 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:14.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.703+0000 7ff0a1ad7640 1 --2- 172.21.15.77:0/1975733813 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff09c0c7740 0x7ff09c0c7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:14.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.703+0000 7ff0a1ad7640 1 --2- 172.21.15.77:0/1975733813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff09c15ccc0 0x7ff09c1efbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:14.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.703+0000 7ff0a1ad7640 1 --2- 172.21.15.77:0/1975733813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff084003970 0x7ff09c15ac30 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:14.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.703+0000 7ff0a1ad7640 1 -- 172.21.15.77:0/1975733813 >> 172.21.15.77:0/1975733813 conn(0x7ff09c0cb530 msgr2=0x7ff09c0adc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:14.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.703+0000 7ff0a1ad7640 1 -- 172.21.15.77:0/1975733813 shutdown_connections 2023-11-04T01:48:14.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.703+0000 7ff0a1ad7640 1 -- 172.21.15.77:0/1975733813 wait complete. 2023-11-04T01:48:14.715 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:48:14.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.817+0000 7f0d3ef33640 1 Processor -- start 2023-11-04T01:48:14.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.817+0000 7f0d3ef33640 1 -- start start 2023-11-04T01:48:14.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.818+0000 7f0d3ef33640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f0d3815d4e0 0x7f0d380d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:14.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.818+0000 7f0d3ef33640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d380b32b0 con 0x7f0d3815d100 2023-11-04T01:48:14.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.818+0000 7f0d3ef33640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d380cee10 con 0x7f0d380d3b60 2023-11-04T01:48:14.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.818+0000 7f0d3ef33640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d380cec20 con 0x7f0d3815d4e0 2023-11-04T01:48:14.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.818+0000 7f0d3cccf640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f0d3815d100 0x7f0d380ce510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35810/0 (socket says 172.21.15.77:35810) 2023-11-04T01:48:14.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.818+0000 7f0d3cccf640 1 -- 172.21.15.77:0/1316208384 learned_addr learned my addr 172.21.15.77:0/1316208384 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:48:14.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.818+0000 7f0d37fff640 1 --2- 172.21.15.77:0/1316208384 >> v2:172.21.15.122:3300/0 conn(0x7f0d3815d4e0 0x7f0d380d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:14.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.818+0000 7f0d377fe640 1 -- 172.21.15.77:0/1316208384 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2269745071 0 0) 0x7f0d380b32b0 con 0x7f0d3815d100 2023-11-04T01:48:14.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.819+0000 7f0d377fe640 1 -- 172.21.15.77:0/1316208384 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d20003520 con 0x7f0d3815d100 2023-11-04T01:48:14.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.819+0000 7f0d377fe640 1 -- 172.21.15.77:0/1316208384 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 88241236 0 0) 0x7f0d20003520 con 0x7f0d3815d100 2023-11-04T01:48:14.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.819+0000 7f0d377fe640 1 -- 172.21.15.77:0/1316208384 >> v2:172.21.15.122:3300/0 conn(0x7f0d3815d4e0 msgr2=0x7f0d380d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:14.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.819+0000 7f0d377fe640 1 --2- 172.21.15.77:0/1316208384 >> v2:172.21.15.122:3300/0 conn(0x7f0d3815d4e0 0x7f0d380d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:14.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.819+0000 7f0d377fe640 1 -- 172.21.15.77:0/1316208384 >> v1:172.21.15.122:6789/0 conn(0x7f0d380d3b60 legacy=0x7f0d380b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:14.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.819+0000 7f0d377fe640 1 -- 172.21.15.77:0/1316208384 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d380b2980 con 0x7f0d3815d100 2023-11-04T01:48:14.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.819+0000 7f0d377fe640 1 -- 172.21.15.77:0/1316208384 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f0d280017f0 con 0x7f0d3815d100 2023-11-04T01:48:14.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.819+0000 7f0d377fe640 1 -- 172.21.15.77:0/1316208384 >> v1:172.21.15.77:6789/0 conn(0x7f0d3815d100 legacy=0x7f0d380ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:14.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.819+0000 7f0d377fe640 1 --2- 172.21.15.77:0/1316208384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d20003970 0x7f0d20003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:14.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.819+0000 7f0d377fe640 1 --2- 172.21.15.77:0/1316208384 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d200047c0 0x7f0d20004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:14.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.819+0000 7f0d377fe640 1 --2- 172.21.15.77:0/1316208384 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0d20005180 0x7f0d2000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:14.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.819+0000 7f0d377fe640 1 -- 172.21.15.77:0/1316208384 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2000bff0 con 0x7f0d20003970 2023-11-04T01:48:14.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.819+0000 7f0d377fe640 1 -- 172.21.15.77:0/1316208384 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2000c160 con 0x7f0d200047c0 2023-11-04T01:48:14.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.819+0000 7f0d377fe640 1 -- 172.21.15.77:0/1316208384 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2000c320 con 0x7f0d20005180 2023-11-04T01:48:14.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.819+0000 7f0d3cccf640 1 --2- 172.21.15.77:0/1316208384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d20003970 0x7f0d20003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:14.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.819+0000 7f0d37fff640 1 --2- 172.21.15.77:0/1316208384 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d200047c0 0x7f0d20004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:14.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.819+0000 7f0d3d4d0640 1 --2- 172.21.15.77:0/1316208384 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0d20005180 0x7f0d2000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:14.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.819+0000 7f0d3cccf640 1 -- 172.21.15.77:0/1316208384 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0d20005180 msgr2=0x7f0d2000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:14.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.819+0000 7f0d3cccf640 1 --2- 172.21.15.77:0/1316208384 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0d20005180 0x7f0d2000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:14.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.819+0000 7f0d3cccf640 1 -- 172.21.15.77:0/1316208384 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d200047c0 msgr2=0x7f0d20004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:14.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.819+0000 7f0d3cccf640 1 --2- 172.21.15.77:0/1316208384 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d200047c0 0x7f0d20004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:14.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.819+0000 7f0d3cccf640 1 -- 172.21.15.77:0/1316208384 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d20003520 con 0x7f0d20003970 2023-11-04T01:48:14.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.819+0000 7f0d3d4d0640 1 --2- 172.21.15.77:0/1316208384 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0d20005180 0x7f0d2000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:48:14.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.819+0000 7f0d3d4d0640 1 -- 172.21.15.77:0/1316208384 reap_dead start 2023-11-04T01:48:14.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.820+0000 7f0d3cccf640 1 --2- 172.21.15.77:0/1316208384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d20003970 0x7f0d20003d90 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f0d2800c190 tx=0x7f0d200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d347b63ec508893 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:14.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.820+0000 7f0d377fe640 1 -- 172.21.15.77:0/1316208384 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d28007270 con 0x7f0d20003970 2023-11-04T01:48:14.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.820+0000 7f0d377fe640 1 -- 172.21.15.77:0/1316208384 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d280073f0 con 0x7f0d20003970 2023-11-04T01:48:14.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.820+0000 7f0d377fe640 1 -- 172.21.15.77:0/1316208384 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2802c8a0 con 0x7f0d20003970 2023-11-04T01:48:14.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.821+0000 7f0d3ef33640 1 -- 172.21.15.77:0/1316208384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d20003970 msgr2=0x7f0d20003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:14.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.821+0000 7f0d3ef33640 1 --2- 172.21.15.77:0/1316208384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d20003970 0x7f0d20003d90 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f0d2800c190 tx=0x7f0d200057f0 comp rx=0 tx=0).stop 2023-11-04T01:48:14.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.821+0000 7f0d3ef33640 1 -- 172.21.15.77:0/1316208384 shutdown_connections 2023-11-04T01:48:14.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.821+0000 7f0d3ef33640 1 --2- 172.21.15.77:0/1316208384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d20003970 0x7f0d20003d90 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:14.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.821+0000 7f0d3ef33640 1 -- 172.21.15.77:0/1316208384 >> 172.21.15.77:0/1316208384 conn(0x7f0d380d2ef0 msgr2=0x7f0d380d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:14.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.821+0000 7f0d3ef33640 1 -- 172.21.15.77:0/1316208384 shutdown_connections 2023-11-04T01:48:14.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.821+0000 7f0d3ef33640 1 -- 172.21.15.77:0/1316208384 wait complete. 2023-11-04T01:48:14.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.822+0000 7f0d3ef33640 1 Processor -- start 2023-11-04T01:48:14.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.822+0000 7f0d3ef33640 1 -- start start 2023-11-04T01:48:14.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.823+0000 7f0d3ef33640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d20003970 0x7f0d38152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:14.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.823+0000 7f0d3ef33640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d3815f930 0x7f0d3815fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:14.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.823+0000 7f0d3ef33640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0d380b1960 0x7f0d380b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:14.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.823+0000 7f0d3ef33640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d380b2320 con 0x7f0d20003970 2023-11-04T01:48:14.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.823+0000 7f0d3ef33640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d380b7bf0 con 0x7f0d3815f930 2023-11-04T01:48:14.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.823+0000 7f0d3ef33640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d380b6fe0 con 0x7f0d380b1960 2023-11-04T01:48:14.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.823+0000 7f0d3cccf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d20003970 0x7f0d38152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:14.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.823+0000 7f0d3cccf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d20003970 0x7f0d38152230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60888/0 (socket says 172.21.15.77:60888) 2023-11-04T01:48:14.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.823+0000 7f0d3cccf640 1 -- 172.21.15.77:0/2674164394 learned_addr learned my addr 172.21.15.77:0/2674164394 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:48:14.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.823+0000 7f0d3cccf640 1 -- 172.21.15.77:0/2674164394 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0d380b1960 msgr2=0x7f0d380b1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:14.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.823+0000 7f0d3cccf640 1 --2- 172.21.15.77:0/2674164394 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0d380b1960 0x7f0d380b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:14.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.823+0000 7f0d3cccf640 1 -- 172.21.15.77:0/2674164394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d3815f930 msgr2=0x7f0d3815fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:14.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.823+0000 7f0d37fff640 1 --2- 172.21.15.77:0/2674164394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d3815f930 0x7f0d3815fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:14.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.823+0000 7f0d3cccf640 1 --2- 172.21.15.77:0/2674164394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d3815f930 0x7f0d3815fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:14.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.823+0000 7f0d3cccf640 1 -- 172.21.15.77:0/2674164394 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d380b72c0 con 0x7f0d20003970 2023-11-04T01:48:14.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.823+0000 7f0d3cccf640 1 --2- 172.21.15.77:0/2674164394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d20003970 0x7f0d38152230 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f0d2802c440 tx=0x7f0d2802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:14.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.823+0000 7f0d357fa640 1 -- 172.21.15.77:0/2674164394 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2803c040 con 0x7f0d20003970 2023-11-04T01:48:14.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.823+0000 7f0d357fa640 1 -- 172.21.15.77:0/2674164394 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2802ccb0 con 0x7f0d20003970 2023-11-04T01:48:14.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.823+0000 7f0d357fa640 1 -- 172.21.15.77:0/2674164394 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d280059e0 con 0x7f0d20003970 2023-11-04T01:48:14.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.823+0000 7f0d3ef33640 1 -- 172.21.15.77:0/2674164394 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d380b75a0 con 0x7f0d20003970 2023-11-04T01:48:14.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.823+0000 7f0d3ef33640 1 -- 172.21.15.77:0/2674164394 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d380b6c90 con 0x7f0d20003970 2023-11-04T01:48:14.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.824+0000 7f0d3ef33640 1 -- 172.21.15.77:0/2674164394 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d380684b0 con 0x7f0d20003970 2023-11-04T01:48:14.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.825+0000 7f0d357fa640 1 -- 172.21.15.77:0/2674164394 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0d28032070 con 0x7f0d20003970 2023-11-04T01:48:14.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.825+0000 7f0d357fa640 1 --2- 172.21.15.77:0/2674164394 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0d2406ae70 0x7f0d2406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:14.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.825+0000 7f0d357fa640 1 -- 172.21.15.77:0/2674164394 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f0d280ab2c0 con 0x7f0d20003970 2023-11-04T01:48:14.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.825+0000 7f0d37fff640 1 --2- 172.21.15.77:0/2674164394 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0d2406ae70 0x7f0d2406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:14.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.826+0000 7f0d37fff640 1 --2- 172.21.15.77:0/2674164394 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0d2406ae70 0x7f0d2406d330 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f0d380a0ed0 tx=0x7f0d2c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:14.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.829+0000 7f0d357fa640 1 -- 172.21.15.77:0/2674164394 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0d280759f0 con 0x7f0d20003970 2023-11-04T01:48:14.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.994+0000 7f0d3ef33640 1 -- 172.21.15.77:0/2674164394 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f0d380d2cd0 con 0x7f0d20003970 2023-11-04T01:48:14.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.995+0000 7f0d357fa640 1 -- 172.21.15.77:0/2674164394 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v117) v1 ==== 107+0+11 (secure 0 0 0) 0x7f0d28079010 con 0x7f0d20003970 2023-11-04T01:48:14.997 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:48:14.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.996+0000 7f0d3ef33640 1 -- 172.21.15.77:0/2674164394 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0d2406ae70 msgr2=0x7f0d2406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:14.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.996+0000 7f0d3ef33640 1 --2- 172.21.15.77:0/2674164394 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0d2406ae70 0x7f0d2406d330 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f0d380a0ed0 tx=0x7f0d2c008040 comp rx=0 tx=0).stop 2023-11-04T01:48:14.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.996+0000 7f0d3ef33640 1 -- 172.21.15.77:0/2674164394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d20003970 msgr2=0x7f0d38152230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:14.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.996+0000 7f0d3ef33640 1 --2- 172.21.15.77:0/2674164394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d20003970 0x7f0d38152230 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f0d2802c440 tx=0x7f0d2802e070 comp rx=0 tx=0).stop 2023-11-04T01:48:14.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.997+0000 7f0d3ef33640 1 -- 172.21.15.77:0/2674164394 shutdown_connections 2023-11-04T01:48:14.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.997+0000 7f0d3ef33640 1 --2- 172.21.15.77:0/2674164394 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f0d2406ae70 0x7f0d2406d330 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.997+0000 7f0d3ef33640 1 --2- 172.21.15.77:0/2674164394 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f0d380b1960 0x7f0d380b1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.997+0000 7f0d3ef33640 1 --2- 172.21.15.77:0/2674164394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d3815f930 0x7f0d3815fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.997+0000 7f0d3ef33640 1 --2- 172.21.15.77:0/2674164394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d20003970 0x7f0d38152230 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.997+0000 7f0d3ef33640 1 -- 172.21.15.77:0/2674164394 >> 172.21.15.77:0/2674164394 conn(0x7f0d380d2ef0 msgr2=0x7f0d380cfe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:15.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.997+0000 7f0d3ef33640 1 -- 172.21.15.77:0/2674164394 shutdown_connections 2023-11-04T01:48:15.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:14.997+0000 7f0d3ef33640 1 -- 172.21.15.77:0/2674164394 wait complete. 2023-11-04T01:48:15.009 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:48:15.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.110+0000 7f9f9b200640 1 Processor -- start 2023-11-04T01:48:15.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.110+0000 7f9f9b200640 1 -- start start 2023-11-04T01:48:15.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.111+0000 7f9f9b200640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f940d1be0 0x7f9f94167e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:15.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.111+0000 7f9f9b200640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f940b32b0 con 0x7f9f9415d100 2023-11-04T01:48:15.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.111+0000 7f9f9b200640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f940cee10 con 0x7f9f9415d4e0 2023-11-04T01:48:15.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.111+0000 7f9f9b200640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f940cec20 con 0x7f9f940d1be0 2023-11-04T01:48:15.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.111+0000 7f9f98f9c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f9f9415d100 0x7f9f940ce510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35814/0 (socket says 172.21.15.77:35814) 2023-11-04T01:48:15.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.111+0000 7f9f98f9c640 1 -- 172.21.15.77:0/733454441 learned_addr learned my addr 172.21.15.77:0/733454441 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-11-04T01:48:15.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.111+0000 7f9f9979d640 1 --2- 172.21.15.77:0/733454441 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f940d1be0 0x7f9f94167e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:15.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.111+0000 7f9f937fe640 1 -- 172.21.15.77:0/733454441 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3988974629 0 0) 0x7f9f940b32b0 con 0x7f9f9415d100 2023-11-04T01:48:15.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.112+0000 7f9f937fe640 1 -- 172.21.15.77:0/733454441 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f7c003520 con 0x7f9f9415d100 2023-11-04T01:48:15.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.112+0000 7f9f937fe640 1 -- 172.21.15.77:0/733454441 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 393869289 0 0) 0x7f9f7c003520 con 0x7f9f9415d100 2023-11-04T01:48:15.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.112+0000 7f9f937fe640 1 -- 172.21.15.77:0/733454441 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f940d1be0 msgr2=0x7f9f94167e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:15.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.112+0000 7f9f937fe640 1 --2- 172.21.15.77:0/733454441 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f940d1be0 0x7f9f94167e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.112+0000 7f9f937fe640 1 -- 172.21.15.77:0/733454441 >> v1:172.21.15.122:6789/0 conn(0x7f9f9415d4e0 legacy=0x7f9f940d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:15.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.112+0000 7f9f937fe640 1 -- 172.21.15.77:0/733454441 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f940b4750 con 0x7f9f9415d100 2023-11-04T01:48:15.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.112+0000 7f9f937fe640 1 -- 172.21.15.77:0/733454441 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466605103 0 0) 0x7f9f840017f0 con 0x7f9f9415d100 2023-11-04T01:48:15.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.112+0000 7f9f937fe640 1 -- 172.21.15.77:0/733454441 >> v1:172.21.15.77:6789/0 conn(0x7f9f9415d100 legacy=0x7f9f940ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:15.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.112+0000 7f9f937fe640 1 --2- 172.21.15.77:0/733454441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f7c0039a0 0x7f9f7c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:15.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.112+0000 7f9f937fe640 1 --2- 172.21.15.77:0/733454441 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f940d1be0 0x7f9f7c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:15.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.112+0000 7f9f937fe640 1 --2- 172.21.15.77:0/733454441 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f7c004d00 0x7f9f7c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:15.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.112+0000 7f9f937fe640 1 -- 172.21.15.77:0/733454441 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c00b980 con 0x7f9f7c0039a0 2023-11-04T01:48:15.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.112+0000 7f9f937fe640 1 -- 172.21.15.77:0/733454441 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c00baf0 con 0x7f9f7c004d00 2023-11-04T01:48:15.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.112+0000 7f9f937fe640 1 -- 172.21.15.77:0/733454441 --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c00bcb0 con 0x7f9f940d1be0 2023-11-04T01:48:15.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.112+0000 7f9f98f9c640 1 --2- 172.21.15.77:0/733454441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f7c0039a0 0x7f9f7c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:15.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.112+0000 7f9f9979d640 1 --2- 172.21.15.77:0/733454441 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f7c004d00 0x7f9f7c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:15.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.112+0000 7f9f93fff640 1 --2- 172.21.15.77:0/733454441 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f940d1be0 0x7f9f7c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:15.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.112+0000 7f9f98f9c640 1 -- 172.21.15.77:0/733454441 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f940d1be0 msgr2=0x7f9f7c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:15.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.112+0000 7f9f98f9c640 1 --2- 172.21.15.77:0/733454441 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f940d1be0 0x7f9f7c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.112+0000 7f9f98f9c640 1 -- 172.21.15.77:0/733454441 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f7c004d00 msgr2=0x7f9f7c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:15.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.112+0000 7f9f98f9c640 1 --2- 172.21.15.77:0/733454441 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f7c004d00 0x7f9f7c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.112+0000 7f9f98f9c640 1 -- 172.21.15.77:0/733454441 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f7c003520 con 0x7f9f7c0039a0 2023-11-04T01:48:15.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.112+0000 7f9f93fff640 1 --2- 172.21.15.77:0/733454441 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f940d1be0 0x7f9f7c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:48:15.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.113+0000 7f9f98f9c640 1 --2- 172.21.15.77:0/733454441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f7c0039a0 0x7f9f7c003d80 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f9f8400c240 tx=0x7f9f7c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f7853fc2bc4eb9c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:15.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.113+0000 7f9f937fe640 1 -- 172.21.15.77:0/733454441 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f84007270 con 0x7f9f7c0039a0 2023-11-04T01:48:15.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.113+0000 7f9f937fe640 1 -- 172.21.15.77:0/733454441 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f840073f0 con 0x7f9f7c0039a0 2023-11-04T01:48:15.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.113+0000 7f9f937fe640 1 -- 172.21.15.77:0/733454441 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8402c810 con 0x7f9f7c0039a0 2023-11-04T01:48:15.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.114+0000 7f9f9b200640 1 -- 172.21.15.77:0/733454441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f7c0039a0 msgr2=0x7f9f7c003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:15.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.114+0000 7f9f9b200640 1 --2- 172.21.15.77:0/733454441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f7c0039a0 0x7f9f7c003d80 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f9f8400c240 tx=0x7f9f7c0057f0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.114+0000 7f9f9979d640 1 -- 172.21.15.77:0/733454441 reap_dead start 2023-11-04T01:48:15.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.114+0000 7f9f9b200640 1 -- 172.21.15.77:0/733454441 shutdown_connections 2023-11-04T01:48:15.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.114+0000 7f9f9b200640 1 -- 172.21.15.77:0/733454441 >> 172.21.15.77:0/733454441 conn(0x7f9f940d2ef0 msgr2=0x7f9f940d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:15.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.114+0000 7f9f9b200640 1 -- 172.21.15.77:0/733454441 shutdown_connections 2023-11-04T01:48:15.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.114+0000 7f9f9b200640 1 -- 172.21.15.77:0/733454441 wait complete. 2023-11-04T01:48:15.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.115+0000 7f9f9b200640 1 Processor -- start 2023-11-04T01:48:15.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.115+0000 7f9f9b200640 1 -- start start 2023-11-04T01:48:15.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.116+0000 7f9f9b200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f7c0039a0 0x7f9f940cc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:15.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.116+0000 7f9f9b200640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f94150f20 0x7f9f9406ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:15.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.116+0000 7f9f9b200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f9406bfc0 0x7f9f940b0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:15.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.116+0000 7f9f9b200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9406c440 con 0x7f9f7c0039a0 2023-11-04T01:48:15.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.116+0000 7f9f9b200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f940b23f0 con 0x7f9f9406bfc0 2023-11-04T01:48:15.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.116+0000 7f9f9b200640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f940cafb0 con 0x7f9f94150f20 2023-11-04T01:48:15.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.116+0000 7f9f98f9c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f7c0039a0 0x7f9f940cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:15.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.116+0000 7f9f98f9c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f7c0039a0 0x7f9f940cc450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60902/0 (socket says 172.21.15.77:60902) 2023-11-04T01:48:15.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.116+0000 7f9f98f9c640 1 -- 172.21.15.77:0/873456962 learned_addr learned my addr 172.21.15.77:0/873456962 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:48:15.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.116+0000 7f9f9979d640 1 --2- 172.21.15.77:0/873456962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f9406bfc0 0x7f9f940b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:15.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.116+0000 7f9f93fff640 1 --2- 172.21.15.77:0/873456962 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f94150f20 0x7f9f9406ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:15.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.116+0000 7f9f98f9c640 1 -- 172.21.15.77:0/873456962 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f94150f20 msgr2=0x7f9f9406ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:15.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.116+0000 7f9f98f9c640 1 --2- 172.21.15.77:0/873456962 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f94150f20 0x7f9f9406ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.116+0000 7f9f98f9c640 1 -- 172.21.15.77:0/873456962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f9406bfc0 msgr2=0x7f9f940b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:15.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.116+0000 7f9f98f9c640 1 --2- 172.21.15.77:0/873456962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f9406bfc0 0x7f9f940b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.116+0000 7f9f98f9c640 1 -- 172.21.15.77:0/873456962 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f941f2890 con 0x7f9f7c0039a0 2023-11-04T01:48:15.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.116+0000 7f9f98f9c640 1 --2- 172.21.15.77:0/873456962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f7c0039a0 0x7f9f940cc450 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f9f84000ef0 tx=0x7f9f940b3220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.117+0000 7f9f917fa640 1 -- 172.21.15.77:0/873456962 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8403c040 con 0x7f9f7c0039a0 2023-11-04T01:48:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.117+0000 7f9f917fa640 1 -- 172.21.15.77:0/873456962 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f84007280 con 0x7f9f7c0039a0 2023-11-04T01:48:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.117+0000 7f9f917fa640 1 -- 172.21.15.77:0/873456962 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f840059a0 con 0x7f9f7c0039a0 2023-11-04T01:48:15.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.117+0000 7f9f9b200640 1 -- 172.21.15.77:0/873456962 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f940ca3a0 con 0x7f9f7c0039a0 2023-11-04T01:48:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.117+0000 7f9f9b200640 1 -- 172.21.15.77:0/873456962 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f940ca960 con 0x7f9f7c0039a0 2023-11-04T01:48:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.118+0000 7f9f9b200640 1 -- 172.21.15.77:0/873456962 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f940684b0 con 0x7f9f7c0039a0 2023-11-04T01:48:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.118+0000 7f9f917fa640 1 -- 172.21.15.77:0/873456962 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9f84032070 con 0x7f9f7c0039a0 2023-11-04T01:48:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.118+0000 7f9f917fa640 1 --2- 172.21.15.77:0/873456962 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9f8006aea0 0x7f9f8006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.119+0000 7f9f917fa640 1 -- 172.21.15.77:0/873456962 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f9f840ab210 con 0x7f9f7c0039a0 2023-11-04T01:48:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.119+0000 7f9f93fff640 1 --2- 172.21.15.77:0/873456962 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9f8006aea0 0x7f9f8006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.119+0000 7f9f93fff640 1 --2- 172.21.15.77:0/873456962 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9f8006aea0 0x7f9f8006d360 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f9f940b10b0 tx=0x7f9f88009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.123+0000 7f9f917fa640 1 -- 172.21.15.77:0/873456962 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9f84075960 con 0x7f9f7c0039a0 2023-11-04T01:48:15.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.286+0000 7f9f9b200640 1 -- 172.21.15.77:0/873456962 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9f940d2cd0 con 0x7f9f7c0039a0 2023-11-04T01:48:15.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.287+0000 7f9f917fa640 1 -- 172.21.15.77:0/873456962 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v117) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9f840460a0 con 0x7f9f7c0039a0 2023-11-04T01:48:15.289 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-11-04T01:48:15.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.289+0000 7f9f9b200640 1 -- 172.21.15.77:0/873456962 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9f8006aea0 msgr2=0x7f9f8006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:15.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.289+0000 7f9f9b200640 1 --2- 172.21.15.77:0/873456962 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9f8006aea0 0x7f9f8006d360 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f9f940b10b0 tx=0x7f9f88009040 comp rx=0 tx=0).stop 2023-11-04T01:48:15.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.289+0000 7f9f9b200640 1 -- 172.21.15.77:0/873456962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f7c0039a0 msgr2=0x7f9f940cc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:15.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.289+0000 7f9f9b200640 1 --2- 172.21.15.77:0/873456962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f7c0039a0 0x7f9f940cc450 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f9f84000ef0 tx=0x7f9f940b3220 comp rx=0 tx=0).stop 2023-11-04T01:48:15.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.289+0000 7f9f9b200640 1 -- 172.21.15.77:0/873456962 shutdown_connections 2023-11-04T01:48:15.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.289+0000 7f9f9b200640 1 --2- 172.21.15.77:0/873456962 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f9f8006aea0 0x7f9f8006d360 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.289+0000 7f9f9b200640 1 --2- 172.21.15.77:0/873456962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f9406bfc0 0x7f9f940b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.289+0000 7f9f9b200640 1 --2- 172.21.15.77:0/873456962 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f9f94150f20 0x7f9f9406ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.289+0000 7f9f9b200640 1 --2- 172.21.15.77:0/873456962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f7c0039a0 0x7f9f940cc450 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.289+0000 7f9f9b200640 1 -- 172.21.15.77:0/873456962 >> 172.21.15.77:0/873456962 conn(0x7f9f940d2ef0 msgr2=0x7f9f940cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:15.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.289+0000 7f9f9b200640 1 -- 172.21.15.77:0/873456962 shutdown_connections 2023-11-04T01:48:15.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.289+0000 7f9f9b200640 1 -- 172.21.15.77:0/873456962 wait complete. 2023-11-04T01:48:15.301 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:48:15.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.401+0000 7f61cdb05640 1 Processor -- start 2023-11-04T01:48:15.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.401+0000 7f61cdb05640 1 -- start start 2023-11-04T01:48:15.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.402+0000 7f61cdb05640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f61c815d100 0x7f61c80ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:15.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.402+0000 7f61cdb05640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f61c80d1be0 0x7f61c80b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:15.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.402+0000 7f61cdb05640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c80b32b0 con 0x7f61c815d4e0 2023-11-04T01:48:15.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.402+0000 7f61cdb05640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c80cee10 con 0x7f61c815d100 2023-11-04T01:48:15.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.402+0000 7f61cdb05640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c80b2980 con 0x7f61c80d1be0 2023-11-04T01:48:15.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.402+0000 7f61c77fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f61c815d100 0x7f61c80ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:15.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.402+0000 7f61c77fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f61c815d100 0x7f61c80ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60904/0 (socket says 172.21.15.77:60904) 2023-11-04T01:48:15.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.402+0000 7f61c77fe640 1 -- 172.21.15.77:0/3523033271 learned_addr learned my addr 172.21.15.77:0/3523033271 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:48:15.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.403+0000 7f61c7fff640 1 --2- 172.21.15.77:0/3523033271 >> v2:172.21.15.122:3300/0 conn(0x7f61c80d1be0 0x7f61c80b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:15.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.403+0000 7f61c77fe640 1 -- 172.21.15.77:0/3523033271 >> v2:172.21.15.122:3300/0 conn(0x7f61c80d1be0 msgr2=0x7f61c80b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:15.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.403+0000 7f61c77fe640 1 --2- 172.21.15.77:0/3523033271 >> v2:172.21.15.122:3300/0 conn(0x7f61c80d1be0 0x7f61c80b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.403+0000 7f61c77fe640 1 -- 172.21.15.77:0/3523033271 >> v1:172.21.15.77:6789/0 conn(0x7f61c815d4e0 legacy=0x7f61c80d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:15.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.403+0000 7f61c77fe640 1 -- 172.21.15.77:0/3523033271 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c80b2c60 con 0x7f61c815d100 2023-11-04T01:48:15.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.403+0000 7f61c7fff640 1 --2- 172.21.15.77:0/3523033271 >> v2:172.21.15.122:3300/0 conn(0x7f61c80d1be0 0x7f61c80b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:15.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.403+0000 7f61c77fe640 1 --2- 172.21.15.77:0/3523033271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61c815d100 0x7f61c80ce510 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f61c808d6a0 tx=0x7f61b802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c30eaea4e85299 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:15.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.404+0000 7f61c67fc640 1 -- 172.21.15.77:0/3523033271 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b8004230 con 0x7f61c815d100 2023-11-04T01:48:15.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.404+0000 7f61c67fc640 1 -- 172.21.15.77:0/3523033271 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b8004390 con 0x7f61c815d100 2023-11-04T01:48:15.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.404+0000 7f61c67fc640 1 -- 172.21.15.77:0/3523033271 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b8030840 con 0x7f61c815d100 2023-11-04T01:48:15.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.404+0000 7f61cdb05640 1 -- 172.21.15.77:0/3523033271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61c815d100 msgr2=0x7f61c80ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:15.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.404+0000 7f61cdb05640 1 --2- 172.21.15.77:0/3523033271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61c815d100 0x7f61c80ce510 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f61c808d6a0 tx=0x7f61b802b980 comp rx=0 tx=0).stop 2023-11-04T01:48:15.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.404+0000 7f61cdb05640 1 -- 172.21.15.77:0/3523033271 shutdown_connections 2023-11-04T01:48:15.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.404+0000 7f61cdb05640 1 --2- 172.21.15.77:0/3523033271 >> v2:172.21.15.122:3300/0 conn(0x7f61c80d1be0 0x7f61c80b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.404+0000 7f61cdb05640 1 --2- 172.21.15.77:0/3523033271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61c815d100 0x7f61c80ce510 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.404+0000 7f61cdb05640 1 -- 172.21.15.77:0/3523033271 >> 172.21.15.77:0/3523033271 conn(0x7f61c80d2ef0 msgr2=0x7f61c80d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:15.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.404+0000 7f61cdb05640 1 -- 172.21.15.77:0/3523033271 shutdown_connections 2023-11-04T01:48:15.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.404+0000 7f61cdb05640 1 -- 172.21.15.77:0/3523033271 wait complete. 2023-11-04T01:48:15.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.405+0000 7f61cdb05640 1 Processor -- start 2023-11-04T01:48:15.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.405+0000 7f61cdb05640 1 -- start start 2023-11-04T01:48:15.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.406+0000 7f61cdb05640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f61c80d1be0 0x7f61c815a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:15.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.406+0000 7f61cdb05640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61c815d100 0x7f61c80cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:15.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.406+0000 7f61cdb05640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61c815d4e0 0x7f61c80ca720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:15.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.406+0000 7f61cdb05640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c80b6b40 con 0x7f61c815d100 2023-11-04T01:48:15.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.406+0000 7f61cdb05640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c806b850 con 0x7f61c815d4e0 2023-11-04T01:48:15.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.406+0000 7f61cdb05640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c806bb30 con 0x7f61c80d1be0 2023-11-04T01:48:15.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.406+0000 7f61c6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61c815d100 0x7f61c80cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:15.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.406+0000 7f61c6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61c815d100 0x7f61c80cca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60916/0 (socket says 172.21.15.77:60916) 2023-11-04T01:48:15.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.406+0000 7f61c6ffd640 1 -- 172.21.15.77:0/1662486780 learned_addr learned my addr 172.21.15.77:0/1662486780 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:48:15.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.406+0000 7f61c6ffd640 1 -- 172.21.15.77:0/1662486780 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f61c80d1be0 msgr2=0x7f61c815a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:15.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.406+0000 7f61c6ffd640 1 --2- 172.21.15.77:0/1662486780 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f61c80d1be0 0x7f61c815a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.406+0000 7f61c6ffd640 1 -- 172.21.15.77:0/1662486780 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61c815d4e0 msgr2=0x7f61c80ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:15.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.406+0000 7f61c7fff640 1 --2- 172.21.15.77:0/1662486780 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61c815d4e0 0x7f61c80ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:15.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.406+0000 7f61c6ffd640 1 --2- 172.21.15.77:0/1662486780 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61c815d4e0 0x7f61c80ca720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.407+0000 7f61c6ffd640 1 -- 172.21.15.77:0/1662486780 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b8009460 con 0x7f61c815d100 2023-11-04T01:48:15.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.407+0000 7f61c6ffd640 1 --2- 172.21.15.77:0/1662486780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61c815d100 0x7f61c80cca50 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00c440 tx=0x7f61bc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:15.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.407+0000 7f61affff640 1 -- 172.21.15.77:0/1662486780 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc0052d0 con 0x7f61c815d100 2023-11-04T01:48:15.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.407+0000 7f61affff640 1 -- 172.21.15.77:0/1662486780 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61bc005430 con 0x7f61c815d100 2023-11-04T01:48:15.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.407+0000 7f61cdb05640 1 -- 172.21.15.77:0/1662486780 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61c806be10 con 0x7f61c815d100 2023-11-04T01:48:15.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.407+0000 7f61affff640 1 -- 172.21.15.77:0/1662486780 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc007260 con 0x7f61c815d100 2023-11-04T01:48:15.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.407+0000 7f61cdb05640 1 -- 172.21.15.77:0/1662486780 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c815a710 con 0x7f61c815d100 2023-11-04T01:48:15.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.408+0000 7f61cdb05640 1 -- 172.21.15.77:0/1662486780 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61c80684b0 con 0x7f61c815d100 2023-11-04T01:48:15.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.408+0000 7f61affff640 1 -- 172.21.15.77:0/1662486780 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f61bc0073c0 con 0x7f61c815d100 2023-11-04T01:48:15.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.409+0000 7f61affff640 1 --2- 172.21.15.77:0/1662486780 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f61b406ae70 0x7f61b406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:15.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.409+0000 7f61affff640 1 -- 172.21.15.77:0/1662486780 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f61bc089420 con 0x7f61c815d100 2023-11-04T01:48:15.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.409+0000 7f61c77fe640 1 --2- 172.21.15.77:0/1662486780 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f61b406ae70 0x7f61b406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:15.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.409+0000 7f61c77fe640 1 --2- 172.21.15.77:0/1662486780 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f61b406ae70 0x7f61b406d330 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f61b8035000 tx=0x7f61b8030000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:15.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.413+0000 7f61affff640 1 -- 172.21.15.77:0/1662486780 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f61bc053ac0 con 0x7f61c815d100 2023-11-04T01:48:15.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.580+0000 7f61cdb05640 1 -- 172.21.15.77:0/1662486780 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f61c80d2cd0 con 0x7f61c815d100 2023-11-04T01:48:15.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.580+0000 7f61affff640 1 -- 172.21.15.77:0/1662486780 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v117) v1 ==== 100+0+11 (secure 0 0 0) 0x7f61bc0570e0 con 0x7f61c815d100 2023-11-04T01:48:15.582 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-11-04T01:48:15.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.582+0000 7f61cdb05640 1 -- 172.21.15.77:0/1662486780 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f61b406ae70 msgr2=0x7f61b406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:15.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.582+0000 7f61cdb05640 1 --2- 172.21.15.77:0/1662486780 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f61b406ae70 0x7f61b406d330 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f61b8035000 tx=0x7f61b8030000 comp rx=0 tx=0).stop 2023-11-04T01:48:15.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.582+0000 7f61cdb05640 1 -- 172.21.15.77:0/1662486780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61c815d100 msgr2=0x7f61c80cca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:15.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.582+0000 7f61cdb05640 1 --2- 172.21.15.77:0/1662486780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61c815d100 0x7f61c80cca50 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00c440 tx=0x7f61bc001e70 comp rx=0 tx=0).stop 2023-11-04T01:48:15.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.582+0000 7f61cdb05640 1 -- 172.21.15.77:0/1662486780 shutdown_connections 2023-11-04T01:48:15.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.582+0000 7f61cdb05640 1 --2- 172.21.15.77:0/1662486780 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f61b406ae70 0x7f61b406d330 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.582+0000 7f61cdb05640 1 --2- 172.21.15.77:0/1662486780 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61c815d4e0 0x7f61c80ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.582+0000 7f61cdb05640 1 --2- 172.21.15.77:0/1662486780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61c815d100 0x7f61c80cca50 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.582+0000 7f61cdb05640 1 --2- 172.21.15.77:0/1662486780 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f61c80d1be0 0x7f61c815a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.582+0000 7f61cdb05640 1 -- 172.21.15.77:0/1662486780 >> 172.21.15.77:0/1662486780 conn(0x7f61c80d2ef0 msgr2=0x7f61c80d14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:15.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.582+0000 7f61cdb05640 1 -- 172.21.15.77:0/1662486780 shutdown_connections 2023-11-04T01:48:15.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.582+0000 7f61cdb05640 1 -- 172.21.15.77:0/1662486780 wait complete. 2023-11-04T01:48:15.594 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:48:15.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.695+0000 7f26f0426640 1 Processor -- start 2023-11-04T01:48:15.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.695+0000 7f26f0426640 1 -- start start 2023-11-04T01:48:15.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.695+0000 7f26f0426640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f26e80b3ca0 0x7f26e806b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:15.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.695+0000 7f26f0426640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f26e80b2100 0x7f26e80b2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:15.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.696+0000 7f26f0426640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26e80b2a50 con 0x7f26e815d110 2023-11-04T01:48:15.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.696+0000 7f26f0426640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e80664f0 con 0x7f26e80b2100 2023-11-04T01:48:15.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.696+0000 7f26f0426640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e815d4f0 con 0x7f26e80b3ca0 2023-11-04T01:48:15.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.696+0000 7f26ee9c3640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f26e80b2100 0x7f26e80b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:15.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.696+0000 7f26ee9c3640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f26e80b2100 0x7f26e80b2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60930/0 (socket says 172.21.15.77:60930) 2023-11-04T01:48:15.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.696+0000 7f26ee9c3640 1 -- 172.21.15.77:0/444981985 learned_addr learned my addr 172.21.15.77:0/444981985 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:48:15.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.696+0000 7f26ee1c2640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f26e815d110 0x7f26e80ace70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:35844/0 (socket says 172.21.15.77:35844) 2023-11-04T01:48:15.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.696+0000 7f26ee9c3640 1 -- 172.21.15.77:0/444981985 >> v2:172.21.15.122:3300/0 conn(0x7f26e80b3ca0 msgr2=0x7f26e806b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:15.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.696+0000 7f26ee9c3640 1 --2- 172.21.15.77:0/444981985 >> v2:172.21.15.122:3300/0 conn(0x7f26e80b3ca0 0x7f26e806b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.696+0000 7f26ee9c3640 1 -- 172.21.15.77:0/444981985 >> v1:172.21.15.77:6789/0 conn(0x7f26e815d110 legacy=0x7f26e80ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:15.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.696+0000 7f26ee9c3640 1 -- 172.21.15.77:0/444981985 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e806b9f0 con 0x7f26e80b2100 2023-11-04T01:48:15.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.697+0000 7f26ee9c3640 1 --2- 172.21.15.77:0/444981985 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26e80b2100 0x7f26e80b2510 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f26e806fd80 tx=0x7f26e002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614b898f473b9c61 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:15.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.697+0000 7f26ed1c0640 1 -- 172.21.15.77:0/444981985 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e002cb20 con 0x7f26e80b2100 2023-11-04T01:48:15.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.697+0000 7f26ed1c0640 1 -- 172.21.15.77:0/444981985 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e002cc80 con 0x7f26e80b2100 2023-11-04T01:48:15.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.697+0000 7f26ed1c0640 1 -- 172.21.15.77:0/444981985 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e00343f0 con 0x7f26e80b2100 2023-11-04T01:48:15.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.697+0000 7f26f0426640 1 -- 172.21.15.77:0/444981985 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26e80b2100 msgr2=0x7f26e80b2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:15.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.697+0000 7f26f0426640 1 --2- 172.21.15.77:0/444981985 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26e80b2100 0x7f26e80b2510 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f26e806fd80 tx=0x7f26e002bf80 comp rx=0 tx=0).stop 2023-11-04T01:48:15.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.697+0000 7f26f0426640 1 -- 172.21.15.77:0/444981985 shutdown_connections 2023-11-04T01:48:15.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.697+0000 7f26f0426640 1 --2- 172.21.15.77:0/444981985 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26e80b2100 0x7f26e80b2510 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.697+0000 7f26f0426640 1 --2- 172.21.15.77:0/444981985 >> v2:172.21.15.122:3300/0 conn(0x7f26e80b3ca0 0x7f26e806b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.697+0000 7f26f0426640 1 -- 172.21.15.77:0/444981985 >> 172.21.15.77:0/444981985 conn(0x7f26e80cbd30 msgr2=0x7f26e80cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:15.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.697+0000 7f26f0426640 1 -- 172.21.15.77:0/444981985 shutdown_connections 2023-11-04T01:48:15.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.697+0000 7f26f0426640 1 -- 172.21.15.77:0/444981985 wait complete. 2023-11-04T01:48:15.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.698+0000 7f26f0426640 1 Processor -- start 2023-11-04T01:48:15.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.699+0000 7f26f0426640 1 -- start start 2023-11-04T01:48:15.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.699+0000 7f26f0426640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26e80b2100 0x7f26e814e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:15.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.699+0000 7f26f0426640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f26e80b3ca0 0x7f26e815bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:15.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.699+0000 7f26f0426640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26e815d110 0x7f26e80af870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:15.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.699+0000 7f26f0426640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e8099c70 con 0x7f26e815d110 2023-11-04T01:48:15.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.699+0000 7f26f0426640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e815c620 con 0x7f26e80b2100 2023-11-04T01:48:15.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.699+0000 7f26f0426640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e80aed90 con 0x7f26e80b3ca0 2023-11-04T01:48:15.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.699+0000 7f26ee9c3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26e815d110 0x7f26e80af870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:15.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.699+0000 7f26ee9c3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26e815d110 0x7f26e80af870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60940/0 (socket says 172.21.15.77:60940) 2023-11-04T01:48:15.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.699+0000 7f26ee9c3640 1 -- 172.21.15.77:0/3512638575 learned_addr learned my addr 172.21.15.77:0/3512638575 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-11-04T01:48:15.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.700+0000 7f26ee9c3640 1 -- 172.21.15.77:0/3512638575 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f26e80b3ca0 msgr2=0x7f26e815bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:15.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.700+0000 7f26ee9c3640 1 --2- 172.21.15.77:0/3512638575 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f26e80b3ca0 0x7f26e815bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.700+0000 7f26ee1c2640 1 --2- 172.21.15.77:0/3512638575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26e80b2100 0x7f26e814e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:15.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.700+0000 7f26ee9c3640 1 -- 172.21.15.77:0/3512638575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26e80b2100 msgr2=0x7f26e814e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:15.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.700+0000 7f26ee9c3640 1 --2- 172.21.15.77:0/3512638575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26e80b2100 0x7f26e814e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.700+0000 7f26ee9c3640 1 -- 172.21.15.77:0/3512638575 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e0009b30 con 0x7f26e815d110 2023-11-04T01:48:15.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.700+0000 7f26ee9c3640 1 --2- 172.21.15.77:0/3512638575 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26e815d110 0x7f26e80af870 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f26e0036040 tx=0x7f26e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:15.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.700+0000 7f26daffd640 1 -- 172.21.15.77:0/3512638575 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e0009510 con 0x7f26e815d110 2023-11-04T01:48:15.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.700+0000 7f26daffd640 1 -- 172.21.15.77:0/3512638575 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e0007e50 con 0x7f26e815d110 2023-11-04T01:48:15.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.700+0000 7f26f0426640 1 -- 172.21.15.77:0/3512638575 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26e80af070 con 0x7f26e815d110 2023-11-04T01:48:15.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.700+0000 7f26daffd640 1 -- 172.21.15.77:0/3512638575 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e003e690 con 0x7f26e815d110 2023-11-04T01:48:15.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.700+0000 7f26f0426640 1 -- 172.21.15.77:0/3512638575 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e815c1f0 con 0x7f26e815d110 2023-11-04T01:48:15.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.701+0000 7f26f0426640 1 -- 172.21.15.77:0/3512638575 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26e815c3e0 con 0x7f26e815d110 2023-11-04T01:48:15.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.701+0000 7f26daffd640 1 -- 172.21.15.77:0/3512638575 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f26e003e7f0 con 0x7f26e815d110 2023-11-04T01:48:15.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.702+0000 7f26daffd640 1 --2- 172.21.15.77:0/3512638575 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f26cc06aea0 0x7f26cc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:15.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.702+0000 7f26daffd640 1 -- 172.21.15.77:0/3512638575 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8195+0+0 (secure 0 0 0) 0x7f26e00ac990 con 0x7f26e815d110 2023-11-04T01:48:15.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.702+0000 7f26ee1c2640 1 --2- 172.21.15.77:0/3512638575 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f26cc06aea0 0x7f26cc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:15.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.703+0000 7f26ee1c2640 1 --2- 172.21.15.77:0/3512638575 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f26cc06aea0 0x7f26cc06d360 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f26e4001020 tx=0x7f26e4009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:15.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.706+0000 7f26daffd640 1 -- 172.21.15.77:0/3512638575 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f26e815c3e0 con 0x7f26e815d110 2023-11-04T01:48:15.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.883+0000 7f26f0426640 1 -- 172.21.15.77:0/3512638575 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f26e80af590 con 0x7f26e815d110 2023-11-04T01:48:15.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.884+0000 7f26daffd640 1 -- 172.21.15.77:0/3512638575 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 23 entries v117) v1 ==== 81+0+1397 (secure 0 0 0) 0x7f26e80af590 con 0x7f26e815d110 2023-11-04T01:48:15.886 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.1:0/2955237098 2023-11-04T02:47:38.484200+0000 2023-11-04T01:48:15.886 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6835/2107153526 2023-11-05T01:47:23.380657+0000 2023-11-04T01:48:15.886 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.1:0/2249624526 2023-11-04T02:46:54.400007+0000 2023-11-04T01:48:15.886 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6834/1450731169 2023-11-05T01:46:46.102329+0000 2023-11-04T01:48:15.887 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6834/3276812155 2023-11-05T01:46:39.299125+0000 2023-11-04T01:48:15.887 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6832/3276812155 2023-11-05T01:46:39.299125+0000 2023-11-04T01:48:15.887 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6836/1450731169 2023-11-05T01:46:46.102329+0000 2023-11-04T01:48:15.887 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6834/3699147778 2023-11-05T01:44:11.242543+0000 2023-11-04T01:48:15.887 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6836/3699147778 2023-11-05T01:44:11.242543+0000 2023-11-04T01:48:15.888 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6834/4241784871 2023-11-05T01:44:36.807284+0000 2023-11-04T01:48:15.888 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6834/2908314953 2023-11-05T01:45:01.982045+0000 2023-11-04T01:48:15.888 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6834/285184758 2023-11-05T01:45:27.182069+0000 2023-11-04T01:48:15.888 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6833/2107153526 2023-11-05T01:47:23.380657+0000 2023-11-04T01:48:15.889 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6836/2908314953 2023-11-05T01:45:01.982045+0000 2023-11-04T01:48:15.889 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6834/4183807043 2023-11-05T01:47:30.639992+0000 2023-11-04T01:48:15.889 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6836/1345816612 2023-11-05T01:45:54.789240+0000 2023-11-04T01:48:15.889 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6832/285184758 2023-11-05T01:45:27.182069+0000 2023-11-04T01:48:15.889 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.122:6834/1345816612 2023-11-05T01:45:54.789240+0000 2023-11-04T01:48:15.889 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6833/3207490604 2023-11-05T01:46:01.591697+0000 2023-11-04T01:48:15.890 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6832/4183807043 2023-11-05T01:47:30.639992+0000 2023-11-04T01:48:15.890 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6832/4241784871 2023-11-05T01:44:36.807284+0000 2023-11-04T01:48:15.890 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6835/3207490604 2023-11-05T01:46:01.591697+0000 2023-11-04T01:48:15.890 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.1:0/3032548059 2023-11-04T02:46:09.897134+0000 2023-11-04T01:48:15.891 INFO:teuthology.orchestra.run.smithi077.stderr:listed 23 entries 2023-11-04T01:48:15.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.885+0000 7f26f0426640 1 -- 172.21.15.77:0/3512638575 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f26cc06aea0 msgr2=0x7f26cc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:15.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.885+0000 7f26f0426640 1 --2- 172.21.15.77:0/3512638575 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f26cc06aea0 0x7f26cc06d360 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f26e4001020 tx=0x7f26e4009040 comp rx=0 tx=0).stop 2023-11-04T01:48:15.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.885+0000 7f26f0426640 1 -- 172.21.15.77:0/3512638575 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26e815d110 msgr2=0x7f26e80af870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:15.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.885+0000 7f26f0426640 1 --2- 172.21.15.77:0/3512638575 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26e815d110 0x7f26e80af870 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f26e0036040 tx=0x7f26e0004a40 comp rx=0 tx=0).stop 2023-11-04T01:48:15.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.885+0000 7f26f0426640 1 -- 172.21.15.77:0/3512638575 shutdown_connections 2023-11-04T01:48:15.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.885+0000 7f26f0426640 1 --2- 172.21.15.77:0/3512638575 >> [v2:172.21.15.122:6832/2275325762,v1:172.21.15.122:6833/2275325762] conn(0x7f26cc06aea0 0x7f26cc06d360 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.885+0000 7f26f0426640 1 --2- 172.21.15.77:0/3512638575 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26e815d110 0x7f26e80af870 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.885+0000 7f26f0426640 1 --2- 172.21.15.77:0/3512638575 >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f26e80b3ca0 0x7f26e815bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.885+0000 7f26f0426640 1 --2- 172.21.15.77:0/3512638575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26e80b2100 0x7f26e814e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:15.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.885+0000 7f26f0426640 1 -- 172.21.15.77:0/3512638575 >> 172.21.15.77:0/3512638575 conn(0x7f26e80cbd30 msgr2=0x7f26e806b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:15.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.885+0000 7f26f0426640 1 -- 172.21.15.77:0/3512638575 shutdown_connections 2023-11-04T01:48:15.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15.885+0000 7f26f0426640 1 -- 172.21.15.77:0/3512638575 wait complete. 2023-11-04T01:48:15.897 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi077.front.sepia.ceph.com... 2023-11-04T01:48:15.898 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:48:15.898 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T01:48:15.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:48:15.957 INFO:teuthology.orchestra.run.smithi077.stderr:fusermount: failed to unmount /home/ubuntu/cephtest/mnt.0: Device or resource busy 2023-11-04T01:48:15.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:15 stdin-killer INFO: command exited with status 1: exiting normally with same code! 2023-11-04T01:48:15.962 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:48:15.963 INFO:tasks.cephfs.fuse_mount:Failed to unmount ceph-fuse on ubuntu@smithi077.front.sepia.ceph.com, aborting... 2023-11-04T01:48:15.964 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:48:15.964 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer --timeout=300 -- env PATH=/usr/sbin:$PATH lsof ; ps auxf 2023-11-04T01:48:16.821 INFO:teuthology.orchestra.run.smithi077.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2023-11-04T01:48:16.821 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.822 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.822 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root txt REG 8,1 102120 20353 /usr/lib/systemd/systemd 2023-11-04T01:48:16.822 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root mem REG 8,1 596532 1490 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-11-04T01:48:16.822 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:16.822 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:16.823 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:48:16.823 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:16.823 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root mem REG 8,1 21219 1167 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-11-04T01:48:16.823 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:16.823 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:48:16.824 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-11-04T01:48:16.824 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:48:16.824 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:16.824 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:16.824 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:48:16.825 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:48:16.825 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:16.825 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:16.825 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:48:16.825 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:16.826 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-11-04T01:48:16.826 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:16.826 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:16.826 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root DEL REG 8,1 9806 /usr/lib64/libacl.so.1.1.2301 2023-11-04T01:48:16.826 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:48:16.827 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root mem REG 8,1 2174088 49251 /usr/lib64/systemd/libsystemd-core-252.so 2023-11-04T01:48:16.827 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:16.827 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-11-04T01:48:16.827 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:48:16.827 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:48:16.828 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-04T01:48:16.828 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:16.828 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:16.828 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-04T01:48:16.828 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:16.829 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:16.829 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:16.829 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 3w CHR 1,11 0t0 10 /dev/kmsg 2023-11-04T01:48:16.829 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 4u a_inode 0,14 0 3100 [eventpoll:5,6,8,9,11,14,15,16,17,18,42,43,44,45,50,54,58,60,75,95,96,98,99,100,101,102,103,104,105,106,107,108...] 2023-11-04T01:48:16.829 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 5u a_inode 0,14 0 3100 [signalfd] 2023-11-04T01:48:16.830 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 6r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:16.830 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 7r DIR 0,25 0 1 /sys/fs/cgroup 2023-11-04T01:48:16.830 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 8u a_inode 0,14 0 3100 [timerfd] 2023-11-04T01:48:16.830 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 9u a_inode 0,14 0 3100 [eventpoll:10,13] 2023-11-04T01:48:16.830 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 10r REG 0,20 0 30 /proc/1/mountinfo 2023-11-04T01:48:16.831 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 11r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:16.831 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 12u netlink 0t0 18830 AUDIT 2023-11-04T01:48:16.831 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 13r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:16.831 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 14r REG 0,20 0 4026532076 /proc/swaps 2023-11-04T01:48:16.831 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 15u netlink 0t0 18822 KOBJECT_UEVENT 2023-11-04T01:48:16.832 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 16u unix 0xffff9ba920034400 0t0 18824 /run/systemd/private type=STREAM (LISTEN) 2023-11-04T01:48:16.832 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 17r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:16.832 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 18u a_inode 0,14 0 3100 [timerfd] 2023-11-04T01:48:16.832 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 19r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:16.832 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 21u a_inode 0,14 0 3100 bpf-prog 2023-11-04T01:48:16.833 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 22u a_inode 0,14 0 3100 bpf-prog 2023-11-04T01:48:16.833 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 23u a_inode 0,14 0 3100 bpf-prog 2023-11-04T01:48:16.833 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 24u a_inode 0,14 0 3100 bpf-prog 2023-11-04T01:48:16.833 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 25u unix 0xffff9ba92012e600 0t0 20619 type=DGRAM (CONNECTED) 2023-11-04T01:48:16.833 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 26u a_inode 0,14 0 3100 bpf-prog 2023-11-04T01:48:16.834 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 27r CHR 10,235 0t0 111 /dev/autofs 2023-11-04T01:48:16.834 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 29u a_inode 0,14 0 3100 bpf-prog 2023-11-04T01:48:16.834 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 30u a_inode 0,14 0 3100 bpf-prog 2023-11-04T01:48:16.834 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 31u a_inode 0,14 0 3100 bpf-prog 2023-11-04T01:48:16.835 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 32u a_inode 0,14 0 3100 bpf-prog 2023-11-04T01:48:16.835 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 33u a_inode 0,14 0 3100 bpf-prog 2023-11-04T01:48:16.835 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 42u unix 0xffff9ba92024b740 0t0 32 /run/systemd/notify type=DGRAM (CONNECTED) 2023-11-04T01:48:16.835 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 43u unix 0xffff9ba92024bb80 0t0 33 type=DGRAM (CONNECTED) 2023-11-04T01:48:16.835 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 44u unix 0xffff9ba920255500 0t0 38 /run/systemd/io.system.ManagedOOM type=STREAM (LISTEN) 2023-11-04T01:48:16.836 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 45u unix 0xffff9ba920251540 0t0 37 /run/systemd/userdb/io.systemd.DynamicUser type=STREAM (LISTEN) 2023-11-04T01:48:16.836 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 46u unix 0xffff9ba92024fb40 0t0 34 type=DGRAM (CONNECTED) 2023-11-04T01:48:16.836 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 49u FIFO 0,24 0t0 441 /run/dmeventd-server 2023-11-04T01:48:16.836 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 50u FIFO 0,24 0t0 442 /run/dmeventd-client 2023-11-04T01:48:16.836 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 54u a_inode 0,14 0 3100 [timerfd] 2023-11-04T01:48:16.837 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 55u unix 0xffff9ba908685500 0t0 19551 /run/udev/control type=SEQPACKET (LISTEN) 2023-11-04T01:48:16.837 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 56u unix 0xffff9ba908683300 0t0 19549 /run/systemd/coredump type=SEQPACKET (LISTEN) 2023-11-04T01:48:16.837 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 58u unix 0xffff9ba908675500 0t0 19537 /run/lvm/lvmpolld.socket type=STREAM (LISTEN) 2023-11-04T01:48:16.837 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 60u unix 0xffff9ba9200a9100 0t0 3883 type=STREAM (CONNECTED) 2023-11-04T01:48:16.837 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 68u CHR 10,242 0t0 165 /dev/rfkill 2023-11-04T01:48:16.838 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 71u unix 0xffff9ba92024cc80 0t0 45 /run/systemd/journal/dev-log type=DGRAM (CONNECTED) 2023-11-04T01:48:16.838 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 74u FIFO 0,24 0t0 447 /run/initctl 2023-11-04T01:48:16.838 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 75u unix 0xffff9ba9200a9980 0t0 3878 /run/.heim_org.h5l.kcm-socket type=STREAM (LISTEN) 2023-11-04T01:48:16.838 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 76u netlink 0t0 19553 KOBJECT_UEVENT 2023-11-04T01:48:16.839 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 77r FIFO 0,13 0t0 19534 pipe 2023-11-04T01:48:16.839 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 78u unix 0xffff9ba9200aea40 0t0 3876 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2023-11-04T01:48:16.839 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 83u unix 0xffff9ba908670440 0t0 19539 /run/rpcbind.sock type=STREAM (LISTEN) 2023-11-04T01:48:16.839 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 87u IPv4 18838 0t0 TCP *:sunrpc (LISTEN) 2023-11-04T01:48:16.839 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 88u IPv4 18844 0t0 UDP *:sunrpc 2023-11-04T01:48:16.839 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 91u IPv6 18850 0t0 TCP *:sunrpc (LISTEN) 2023-11-04T01:48:16.840 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 92u IPv6 18856 0t0 UDP *:sunrpc 2023-11-04T01:48:16.840 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 95u unix 0xffff9ba920252640 0t0 191409 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:48:16.840 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 96u unix 0xffff9ba920036e80 0t0 16957 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:48:16.840 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 97u unix 0xffff9ba9200350c0 0t0 403 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:48:16.840 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 98u unix 0xffff9ba9201e9dc0 0t0 22682 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:48:16.841 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 99u unix 0xffff9ba908672a80 0t0 22681 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:48:16.841 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 100u unix 0xffff9ba9084a9100 0t0 19732 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:48:16.841 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 101u unix 0xffff9ba9201bfb40 0t0 16854 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:48:16.841 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 102u unix 0xffff9ba900b38000 0t0 21625 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:48:16.841 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 103u unix 0xffff9ba900b3dd80 0t0 21624 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:48:16.842 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 104u unix 0xffff9ba9084aa640 0t0 16840 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:48:16.842 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 105u unix 0xffff9ba9084aa200 0t0 21621 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:48:16.842 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 106u unix 0xffff9ba9201eb740 0t0 21620 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:48:16.842 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 107u unix 0xffff9ba900b3c840 0t0 18962 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:48:16.842 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 108u unix 0xffff9ba908671540 0t0 17659 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:48:16.843 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 113u unix 0xffff9ba92024ee80 0t0 47 /run/systemd/journal/socket type=DGRAM (CONNECTED) 2023-11-04T01:48:16.843 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1 root 115u unix 0xffff9ba920257b40 0t0 49 /run/systemd/journal/stdout type=STREAM (LISTEN) 2023-11-04T01:48:16.843 INFO:teuthology.orchestra.run.smithi077.stdout:kthreadd 2 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.843 INFO:teuthology.orchestra.run.smithi077.stdout:kthreadd 2 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.843 INFO:teuthology.orchestra.run.smithi077.stdout:kthreadd 2 root txt unknown /proc/2/exe 2023-11-04T01:48:16.843 INFO:teuthology.orchestra.run.smithi077.stdout:rcu_gp 3 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.844 INFO:teuthology.orchestra.run.smithi077.stdout:rcu_gp 3 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.844 INFO:teuthology.orchestra.run.smithi077.stdout:rcu_gp 3 root txt unknown /proc/3/exe 2023-11-04T01:48:16.844 INFO:teuthology.orchestra.run.smithi077.stdout:rcu_par_g 4 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.844 INFO:teuthology.orchestra.run.smithi077.stdout:rcu_par_g 4 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.844 INFO:teuthology.orchestra.run.smithi077.stdout:rcu_par_g 4 root txt unknown /proc/4/exe 2023-11-04T01:48:16.845 INFO:teuthology.orchestra.run.smithi077.stdout:slub_flus 5 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.845 INFO:teuthology.orchestra.run.smithi077.stdout:slub_flus 5 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.845 INFO:teuthology.orchestra.run.smithi077.stdout:slub_flus 5 root txt unknown /proc/5/exe 2023-11-04T01:48:16.845 INFO:teuthology.orchestra.run.smithi077.stdout:netns 6 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.845 INFO:teuthology.orchestra.run.smithi077.stdout:netns 6 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.846 INFO:teuthology.orchestra.run.smithi077.stdout:netns 6 root txt unknown /proc/6/exe 2023-11-04T01:48:16.846 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/0 8 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.846 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/0 8 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.846 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/0 8 root txt unknown /proc/8/exe 2023-11-04T01:48:16.847 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/u 10 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.847 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/u 10 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.847 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/u 10 root txt unknown /proc/10/exe 2023-11-04T01:48:16.847 INFO:teuthology.orchestra.run.smithi077.stdout:mm_percpu 11 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.847 INFO:teuthology.orchestra.run.smithi077.stdout:mm_percpu 11 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.847 INFO:teuthology.orchestra.run.smithi077.stdout:mm_percpu 11 root txt unknown /proc/11/exe 2023-11-04T01:48:16.848 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/u 12 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.848 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/u 12 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.848 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/u 12 root txt unknown /proc/12/exe 2023-11-04T01:48:16.848 INFO:teuthology.orchestra.run.smithi077.stdout:rcu_tasks 13 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.849 INFO:teuthology.orchestra.run.smithi077.stdout:rcu_tasks 13 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.849 INFO:teuthology.orchestra.run.smithi077.stdout:rcu_tasks 13 root txt unknown /proc/13/exe 2023-11-04T01:48:16.849 INFO:teuthology.orchestra.run.smithi077.stdout:rcu_tasks 14 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.849 INFO:teuthology.orchestra.run.smithi077.stdout:rcu_tasks 14 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.849 INFO:teuthology.orchestra.run.smithi077.stdout:rcu_tasks 14 root txt unknown /proc/14/exe 2023-11-04T01:48:16.850 INFO:teuthology.orchestra.run.smithi077.stdout:rcu_tasks 15 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.850 INFO:teuthology.orchestra.run.smithi077.stdout:rcu_tasks 15 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.850 INFO:teuthology.orchestra.run.smithi077.stdout:rcu_tasks 15 root txt unknown /proc/15/exe 2023-11-04T01:48:16.850 INFO:teuthology.orchestra.run.smithi077.stdout:ksoftirqd 16 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.850 INFO:teuthology.orchestra.run.smithi077.stdout:ksoftirqd 16 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.851 INFO:teuthology.orchestra.run.smithi077.stdout:ksoftirqd 16 root txt unknown /proc/16/exe 2023-11-04T01:48:16.851 INFO:teuthology.orchestra.run.smithi077.stdout:pr/ttyS1 17 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.851 INFO:teuthology.orchestra.run.smithi077.stdout:pr/ttyS1 17 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.851 INFO:teuthology.orchestra.run.smithi077.stdout:pr/ttyS1 17 root txt unknown /proc/17/exe 2023-11-04T01:48:16.851 INFO:teuthology.orchestra.run.smithi077.stdout:rcu_preem 18 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.852 INFO:teuthology.orchestra.run.smithi077.stdout:rcu_preem 18 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.852 INFO:teuthology.orchestra.run.smithi077.stdout:rcu_preem 18 root txt unknown /proc/18/exe 2023-11-04T01:48:16.852 INFO:teuthology.orchestra.run.smithi077.stdout:migration 19 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.852 INFO:teuthology.orchestra.run.smithi077.stdout:migration 19 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.852 INFO:teuthology.orchestra.run.smithi077.stdout:migration 19 root txt unknown /proc/19/exe 2023-11-04T01:48:16.852 INFO:teuthology.orchestra.run.smithi077.stdout:idle_inje 20 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.853 INFO:teuthology.orchestra.run.smithi077.stdout:idle_inje 20 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.853 INFO:teuthology.orchestra.run.smithi077.stdout:idle_inje 20 root txt unknown /proc/20/exe 2023-11-04T01:48:16.853 INFO:teuthology.orchestra.run.smithi077.stdout:cpuhp/0 21 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.853 INFO:teuthology.orchestra.run.smithi077.stdout:cpuhp/0 21 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.853 INFO:teuthology.orchestra.run.smithi077.stdout:cpuhp/0 21 root txt unknown /proc/21/exe 2023-11-04T01:48:16.854 INFO:teuthology.orchestra.run.smithi077.stdout:cpuhp/1 22 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.854 INFO:teuthology.orchestra.run.smithi077.stdout:cpuhp/1 22 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.854 INFO:teuthology.orchestra.run.smithi077.stdout:cpuhp/1 22 root txt unknown /proc/22/exe 2023-11-04T01:48:16.854 INFO:teuthology.orchestra.run.smithi077.stdout:idle_inje 23 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.854 INFO:teuthology.orchestra.run.smithi077.stdout:idle_inje 23 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.855 INFO:teuthology.orchestra.run.smithi077.stdout:idle_inje 23 root txt unknown /proc/23/exe 2023-11-04T01:48:16.855 INFO:teuthology.orchestra.run.smithi077.stdout:migration 24 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.855 INFO:teuthology.orchestra.run.smithi077.stdout:migration 24 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.855 INFO:teuthology.orchestra.run.smithi077.stdout:migration 24 root txt unknown /proc/24/exe 2023-11-04T01:48:16.855 INFO:teuthology.orchestra.run.smithi077.stdout:ksoftirqd 25 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.856 INFO:teuthology.orchestra.run.smithi077.stdout:ksoftirqd 25 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.856 INFO:teuthology.orchestra.run.smithi077.stdout:ksoftirqd 25 root txt unknown /proc/25/exe 2023-11-04T01:48:16.856 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/1 27 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.856 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/1 27 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.856 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/1 27 root txt unknown /proc/27/exe 2023-11-04T01:48:16.857 INFO:teuthology.orchestra.run.smithi077.stdout:cpuhp/2 28 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.857 INFO:teuthology.orchestra.run.smithi077.stdout:cpuhp/2 28 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.857 INFO:teuthology.orchestra.run.smithi077.stdout:cpuhp/2 28 root txt unknown /proc/28/exe 2023-11-04T01:48:16.857 INFO:teuthology.orchestra.run.smithi077.stdout:idle_inje 29 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.857 INFO:teuthology.orchestra.run.smithi077.stdout:idle_inje 29 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.858 INFO:teuthology.orchestra.run.smithi077.stdout:idle_inje 29 root txt unknown /proc/29/exe 2023-11-04T01:48:16.858 INFO:teuthology.orchestra.run.smithi077.stdout:migration 30 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.858 INFO:teuthology.orchestra.run.smithi077.stdout:migration 30 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.858 INFO:teuthology.orchestra.run.smithi077.stdout:migration 30 root txt unknown /proc/30/exe 2023-11-04T01:48:16.858 INFO:teuthology.orchestra.run.smithi077.stdout:ksoftirqd 31 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.859 INFO:teuthology.orchestra.run.smithi077.stdout:ksoftirqd 31 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.859 INFO:teuthology.orchestra.run.smithi077.stdout:ksoftirqd 31 root txt unknown /proc/31/exe 2023-11-04T01:48:16.859 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/2 33 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.859 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/2 33 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.859 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/2 33 root txt unknown /proc/33/exe 2023-11-04T01:48:16.860 INFO:teuthology.orchestra.run.smithi077.stdout:cpuhp/3 34 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.860 INFO:teuthology.orchestra.run.smithi077.stdout:cpuhp/3 34 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.860 INFO:teuthology.orchestra.run.smithi077.stdout:cpuhp/3 34 root txt unknown /proc/34/exe 2023-11-04T01:48:16.860 INFO:teuthology.orchestra.run.smithi077.stdout:idle_inje 35 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.860 INFO:teuthology.orchestra.run.smithi077.stdout:idle_inje 35 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.860 INFO:teuthology.orchestra.run.smithi077.stdout:idle_inje 35 root txt unknown /proc/35/exe 2023-11-04T01:48:16.861 INFO:teuthology.orchestra.run.smithi077.stdout:migration 36 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.861 INFO:teuthology.orchestra.run.smithi077.stdout:migration 36 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.861 INFO:teuthology.orchestra.run.smithi077.stdout:migration 36 root txt unknown /proc/36/exe 2023-11-04T01:48:16.861 INFO:teuthology.orchestra.run.smithi077.stdout:ksoftirqd 37 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.861 INFO:teuthology.orchestra.run.smithi077.stdout:ksoftirqd 37 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.862 INFO:teuthology.orchestra.run.smithi077.stdout:ksoftirqd 37 root txt unknown /proc/37/exe 2023-11-04T01:48:16.862 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/3 39 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.862 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/3 39 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.862 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/3 39 root txt unknown /proc/39/exe 2023-11-04T01:48:16.862 INFO:teuthology.orchestra.run.smithi077.stdout:cpuhp/4 40 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.863 INFO:teuthology.orchestra.run.smithi077.stdout:cpuhp/4 40 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.863 INFO:teuthology.orchestra.run.smithi077.stdout:cpuhp/4 40 root txt unknown /proc/40/exe 2023-11-04T01:48:16.863 INFO:teuthology.orchestra.run.smithi077.stdout:idle_inje 41 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.863 INFO:teuthology.orchestra.run.smithi077.stdout:idle_inje 41 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.863 INFO:teuthology.orchestra.run.smithi077.stdout:idle_inje 41 root txt unknown /proc/41/exe 2023-11-04T01:48:16.864 INFO:teuthology.orchestra.run.smithi077.stdout:migration 42 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.864 INFO:teuthology.orchestra.run.smithi077.stdout:migration 42 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.864 INFO:teuthology.orchestra.run.smithi077.stdout:migration 42 root txt unknown /proc/42/exe 2023-11-04T01:48:16.864 INFO:teuthology.orchestra.run.smithi077.stdout:ksoftirqd 43 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.864 INFO:teuthology.orchestra.run.smithi077.stdout:ksoftirqd 43 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.865 INFO:teuthology.orchestra.run.smithi077.stdout:ksoftirqd 43 root txt unknown /proc/43/exe 2023-11-04T01:48:16.865 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/4 45 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.865 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/4 45 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.865 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/4 45 root txt unknown /proc/45/exe 2023-11-04T01:48:16.865 INFO:teuthology.orchestra.run.smithi077.stdout:cpuhp/5 46 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.865 INFO:teuthology.orchestra.run.smithi077.stdout:cpuhp/5 46 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.866 INFO:teuthology.orchestra.run.smithi077.stdout:cpuhp/5 46 root txt unknown /proc/46/exe 2023-11-04T01:48:16.866 INFO:teuthology.orchestra.run.smithi077.stdout:idle_inje 47 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.866 INFO:teuthology.orchestra.run.smithi077.stdout:idle_inje 47 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.866 INFO:teuthology.orchestra.run.smithi077.stdout:idle_inje 47 root txt unknown /proc/47/exe 2023-11-04T01:48:16.866 INFO:teuthology.orchestra.run.smithi077.stdout:migration 48 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.867 INFO:teuthology.orchestra.run.smithi077.stdout:migration 48 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.867 INFO:teuthology.orchestra.run.smithi077.stdout:migration 48 root txt unknown /proc/48/exe 2023-11-04T01:48:16.867 INFO:teuthology.orchestra.run.smithi077.stdout:ksoftirqd 49 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.867 INFO:teuthology.orchestra.run.smithi077.stdout:ksoftirqd 49 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.867 INFO:teuthology.orchestra.run.smithi077.stdout:ksoftirqd 49 root txt unknown /proc/49/exe 2023-11-04T01:48:16.867 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/5 51 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.868 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/5 51 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.868 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/5 51 root txt unknown /proc/51/exe 2023-11-04T01:48:16.868 INFO:teuthology.orchestra.run.smithi077.stdout:cpuhp/6 52 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.868 INFO:teuthology.orchestra.run.smithi077.stdout:cpuhp/6 52 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.868 INFO:teuthology.orchestra.run.smithi077.stdout:cpuhp/6 52 root txt unknown /proc/52/exe 2023-11-04T01:48:16.869 INFO:teuthology.orchestra.run.smithi077.stdout:idle_inje 53 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.869 INFO:teuthology.orchestra.run.smithi077.stdout:idle_inje 53 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.869 INFO:teuthology.orchestra.run.smithi077.stdout:idle_inje 53 root txt unknown /proc/53/exe 2023-11-04T01:48:16.869 INFO:teuthology.orchestra.run.smithi077.stdout:migration 54 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.869 INFO:teuthology.orchestra.run.smithi077.stdout:migration 54 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.870 INFO:teuthology.orchestra.run.smithi077.stdout:migration 54 root txt unknown /proc/54/exe 2023-11-04T01:48:16.870 INFO:teuthology.orchestra.run.smithi077.stdout:ksoftirqd 55 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.870 INFO:teuthology.orchestra.run.smithi077.stdout:ksoftirqd 55 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.870 INFO:teuthology.orchestra.run.smithi077.stdout:ksoftirqd 55 root txt unknown /proc/55/exe 2023-11-04T01:48:16.870 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/6 57 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.871 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/6 57 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.871 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/6 57 root txt unknown /proc/57/exe 2023-11-04T01:48:16.871 INFO:teuthology.orchestra.run.smithi077.stdout:cpuhp/7 58 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.871 INFO:teuthology.orchestra.run.smithi077.stdout:cpuhp/7 58 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.871 INFO:teuthology.orchestra.run.smithi077.stdout:cpuhp/7 58 root txt unknown /proc/58/exe 2023-11-04T01:48:16.871 INFO:teuthology.orchestra.run.smithi077.stdout:idle_inje 59 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.872 INFO:teuthology.orchestra.run.smithi077.stdout:idle_inje 59 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.872 INFO:teuthology.orchestra.run.smithi077.stdout:idle_inje 59 root txt unknown /proc/59/exe 2023-11-04T01:48:16.872 INFO:teuthology.orchestra.run.smithi077.stdout:migration 60 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.872 INFO:teuthology.orchestra.run.smithi077.stdout:migration 60 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.872 INFO:teuthology.orchestra.run.smithi077.stdout:migration 60 root txt unknown /proc/60/exe 2023-11-04T01:48:16.872 INFO:teuthology.orchestra.run.smithi077.stdout:ksoftirqd 61 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.873 INFO:teuthology.orchestra.run.smithi077.stdout:ksoftirqd 61 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.873 INFO:teuthology.orchestra.run.smithi077.stdout:ksoftirqd 61 root txt unknown /proc/61/exe 2023-11-04T01:48:16.873 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/7 63 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.873 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/7 63 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.873 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/7 63 root txt unknown /proc/63/exe 2023-11-04T01:48:16.873 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/u 68 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.874 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/u 68 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.874 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/u 68 root txt unknown /proc/68/exe 2023-11-04T01:48:16.874 INFO:teuthology.orchestra.run.smithi077.stdout:kdevtmpfs 71 root cwd DIR 0,5 3500 1 / 2023-11-04T01:48:16.874 INFO:teuthology.orchestra.run.smithi077.stdout:kdevtmpfs 71 root rtd DIR 0,5 3500 1 / 2023-11-04T01:48:16.875 INFO:teuthology.orchestra.run.smithi077.stdout:kdevtmpfs 71 root txt unknown /proc/71/exe 2023-11-04T01:48:16.875 INFO:teuthology.orchestra.run.smithi077.stdout:inet_frag 72 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.875 INFO:teuthology.orchestra.run.smithi077.stdout:inet_frag 72 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.875 INFO:teuthology.orchestra.run.smithi077.stdout:inet_frag 72 root txt unknown /proc/72/exe 2023-11-04T01:48:16.875 INFO:teuthology.orchestra.run.smithi077.stdout:kauditd 73 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.875 INFO:teuthology.orchestra.run.smithi077.stdout:kauditd 73 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.876 INFO:teuthology.orchestra.run.smithi077.stdout:kauditd 73 root txt unknown /proc/73/exe 2023-11-04T01:48:16.876 INFO:teuthology.orchestra.run.smithi077.stdout:khungtask 75 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.876 INFO:teuthology.orchestra.run.smithi077.stdout:khungtask 75 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.876 INFO:teuthology.orchestra.run.smithi077.stdout:khungtask 75 root txt unknown /proc/75/exe 2023-11-04T01:48:16.877 INFO:teuthology.orchestra.run.smithi077.stdout:oom_reape 76 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.877 INFO:teuthology.orchestra.run.smithi077.stdout:oom_reape 76 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.877 INFO:teuthology.orchestra.run.smithi077.stdout:oom_reape 76 root txt unknown /proc/76/exe 2023-11-04T01:48:16.877 INFO:teuthology.orchestra.run.smithi077.stdout:writeback 77 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.877 INFO:teuthology.orchestra.run.smithi077.stdout:writeback 77 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.878 INFO:teuthology.orchestra.run.smithi077.stdout:writeback 77 root txt unknown /proc/77/exe 2023-11-04T01:48:16.878 INFO:teuthology.orchestra.run.smithi077.stdout:kcompactd 78 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.878 INFO:teuthology.orchestra.run.smithi077.stdout:kcompactd 78 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.878 INFO:teuthology.orchestra.run.smithi077.stdout:kcompactd 78 root txt unknown /proc/78/exe 2023-11-04T01:48:16.878 INFO:teuthology.orchestra.run.smithi077.stdout:ksmd 79 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.879 INFO:teuthology.orchestra.run.smithi077.stdout:ksmd 79 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.879 INFO:teuthology.orchestra.run.smithi077.stdout:ksmd 79 root txt unknown /proc/79/exe 2023-11-04T01:48:16.879 INFO:teuthology.orchestra.run.smithi077.stdout:khugepage 80 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.879 INFO:teuthology.orchestra.run.smithi077.stdout:khugepage 80 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.879 INFO:teuthology.orchestra.run.smithi077.stdout:khugepage 80 root txt unknown /proc/80/exe 2023-11-04T01:48:16.880 INFO:teuthology.orchestra.run.smithi077.stdout:cryptd 81 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.880 INFO:teuthology.orchestra.run.smithi077.stdout:cryptd 81 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.880 INFO:teuthology.orchestra.run.smithi077.stdout:cryptd 81 root txt unknown /proc/81/exe 2023-11-04T01:48:16.880 INFO:teuthology.orchestra.run.smithi077.stdout:kintegrit 82 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.880 INFO:teuthology.orchestra.run.smithi077.stdout:kintegrit 82 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.881 INFO:teuthology.orchestra.run.smithi077.stdout:kintegrit 82 root txt unknown /proc/82/exe 2023-11-04T01:48:16.881 INFO:teuthology.orchestra.run.smithi077.stdout:kblockd 83 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.881 INFO:teuthology.orchestra.run.smithi077.stdout:kblockd 83 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.881 INFO:teuthology.orchestra.run.smithi077.stdout:kblockd 83 root txt unknown /proc/83/exe 2023-11-04T01:48:16.881 INFO:teuthology.orchestra.run.smithi077.stdout:blkcg_pun 84 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.881 INFO:teuthology.orchestra.run.smithi077.stdout:blkcg_pun 84 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.882 INFO:teuthology.orchestra.run.smithi077.stdout:blkcg_pun 84 root txt unknown /proc/84/exe 2023-11-04T01:48:16.882 INFO:teuthology.orchestra.run.smithi077.stdout:tpm_dev_w 86 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.882 INFO:teuthology.orchestra.run.smithi077.stdout:tpm_dev_w 86 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.882 INFO:teuthology.orchestra.run.smithi077.stdout:tpm_dev_w 86 root txt unknown /proc/86/exe 2023-11-04T01:48:16.882 INFO:teuthology.orchestra.run.smithi077.stdout:md 87 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.883 INFO:teuthology.orchestra.run.smithi077.stdout:md 87 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.883 INFO:teuthology.orchestra.run.smithi077.stdout:md 87 root txt unknown /proc/87/exe 2023-11-04T01:48:16.883 INFO:teuthology.orchestra.run.smithi077.stdout:md_bitmap 88 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.883 INFO:teuthology.orchestra.run.smithi077.stdout:md_bitmap 88 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.883 INFO:teuthology.orchestra.run.smithi077.stdout:md_bitmap 88 root txt unknown /proc/88/exe 2023-11-04T01:48:16.883 INFO:teuthology.orchestra.run.smithi077.stdout:edac-poll 89 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.884 INFO:teuthology.orchestra.run.smithi077.stdout:edac-poll 89 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.884 INFO:teuthology.orchestra.run.smithi077.stdout:edac-poll 89 root txt unknown /proc/89/exe 2023-11-04T01:48:16.884 INFO:teuthology.orchestra.run.smithi077.stdout:watchdogd 90 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.884 INFO:teuthology.orchestra.run.smithi077.stdout:watchdogd 90 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.884 INFO:teuthology.orchestra.run.smithi077.stdout:watchdogd 90 root txt unknown /proc/90/exe 2023-11-04T01:48:16.885 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/4 92 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.885 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/4 92 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.885 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/4 92 root txt unknown /proc/92/exe 2023-11-04T01:48:16.885 INFO:teuthology.orchestra.run.smithi077.stdout:kswapd0 94 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.885 INFO:teuthology.orchestra.run.smithi077.stdout:kswapd0 94 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.886 INFO:teuthology.orchestra.run.smithi077.stdout:kswapd0 94 root txt unknown /proc/94/exe 2023-11-04T01:48:16.886 INFO:teuthology.orchestra.run.smithi077.stdout:kthrotld 101 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.886 INFO:teuthology.orchestra.run.smithi077.stdout:kthrotld 101 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.886 INFO:teuthology.orchestra.run.smithi077.stdout:kthrotld 101 root txt unknown /proc/101/exe 2023-11-04T01:48:16.886 INFO:teuthology.orchestra.run.smithi077.stdout:acpi_ther 109 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.887 INFO:teuthology.orchestra.run.smithi077.stdout:acpi_ther 109 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.887 INFO:teuthology.orchestra.run.smithi077.stdout:acpi_ther 109 root txt unknown /proc/109/exe 2023-11-04T01:48:16.887 INFO:teuthology.orchestra.run.smithi077.stdout:kmpath_rd 110 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.887 INFO:teuthology.orchestra.run.smithi077.stdout:kmpath_rd 110 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.887 INFO:teuthology.orchestra.run.smithi077.stdout:kmpath_rd 110 root txt unknown /proc/110/exe 2023-11-04T01:48:16.888 INFO:teuthology.orchestra.run.smithi077.stdout:kaluad 111 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.888 INFO:teuthology.orchestra.run.smithi077.stdout:kaluad 111 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.888 INFO:teuthology.orchestra.run.smithi077.stdout:kaluad 111 root txt unknown /proc/111/exe 2023-11-04T01:48:16.888 INFO:teuthology.orchestra.run.smithi077.stdout:mld 112 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.888 INFO:teuthology.orchestra.run.smithi077.stdout:mld 112 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.888 INFO:teuthology.orchestra.run.smithi077.stdout:mld 112 root txt unknown /proc/112/exe 2023-11-04T01:48:16.889 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/3 113 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.889 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/3 113 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.889 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/3 113 root txt unknown /proc/113/exe 2023-11-04T01:48:16.889 INFO:teuthology.orchestra.run.smithi077.stdout:ipv6_addr 114 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.890 INFO:teuthology.orchestra.run.smithi077.stdout:ipv6_addr 114 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.890 INFO:teuthology.orchestra.run.smithi077.stdout:ipv6_addr 114 root txt unknown /proc/114/exe 2023-11-04T01:48:16.890 INFO:teuthology.orchestra.run.smithi077.stdout:kstrp 123 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.890 INFO:teuthology.orchestra.run.smithi077.stdout:kstrp 123 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.890 INFO:teuthology.orchestra.run.smithi077.stdout:kstrp 123 root txt unknown /proc/123/exe 2023-11-04T01:48:16.890 INFO:teuthology.orchestra.run.smithi077.stdout:zswap-shr 128 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.891 INFO:teuthology.orchestra.run.smithi077.stdout:zswap-shr 128 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.891 INFO:teuthology.orchestra.run.smithi077.stdout:zswap-shr 128 root txt unknown /proc/128/exe 2023-11-04T01:48:16.891 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/u 238 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.891 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/u 238 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.891 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/u 238 root txt unknown /proc/238/exe 2023-11-04T01:48:16.892 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/0 277 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.892 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/0 277 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.892 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/0 277 root txt unknown /proc/277/exe 2023-11-04T01:48:16.892 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/1 288 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.892 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/1 288 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.893 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/1 288 root txt unknown /proc/288/exe 2023-11-04T01:48:16.893 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/5 289 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.893 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/5 289 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.893 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/5 289 root txt unknown /proc/289/exe 2023-11-04T01:48:16.893 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/6 356 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.893 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/6 356 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.894 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/6 356 root txt unknown /proc/356/exe 2023-11-04T01:48:16.894 INFO:teuthology.orchestra.run.smithi077.stdout:ata_sff 419 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.894 INFO:teuthology.orchestra.run.smithi077.stdout:ata_sff 419 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.894 INFO:teuthology.orchestra.run.smithi077.stdout:ata_sff 419 root txt unknown /proc/419/exe 2023-11-04T01:48:16.894 INFO:teuthology.orchestra.run.smithi077.stdout:ixgbe 432 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.895 INFO:teuthology.orchestra.run.smithi077.stdout:ixgbe 432 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.895 INFO:teuthology.orchestra.run.smithi077.stdout:ixgbe 432 root txt unknown /proc/432/exe 2023-11-04T01:48:16.895 INFO:teuthology.orchestra.run.smithi077.stdout:nvme-wq 434 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.895 INFO:teuthology.orchestra.run.smithi077.stdout:nvme-wq 434 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.895 INFO:teuthology.orchestra.run.smithi077.stdout:nvme-wq 434 root txt unknown /proc/434/exe 2023-11-04T01:48:16.896 INFO:teuthology.orchestra.run.smithi077.stdout:nvme-rese 435 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.896 INFO:teuthology.orchestra.run.smithi077.stdout:nvme-rese 435 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.896 INFO:teuthology.orchestra.run.smithi077.stdout:nvme-rese 435 root txt unknown /proc/435/exe 2023-11-04T01:48:16.896 INFO:teuthology.orchestra.run.smithi077.stdout:nvme-dele 436 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.896 INFO:teuthology.orchestra.run.smithi077.stdout:nvme-dele 436 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.896 INFO:teuthology.orchestra.run.smithi077.stdout:nvme-dele 436 root txt unknown /proc/436/exe 2023-11-04T01:48:16.897 INFO:teuthology.orchestra.run.smithi077.stdout:nvme-auth 437 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.897 INFO:teuthology.orchestra.run.smithi077.stdout:nvme-auth 437 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.897 INFO:teuthology.orchestra.run.smithi077.stdout:nvme-auth 437 root txt unknown /proc/437/exe 2023-11-04T01:48:16.897 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_eh_0 439 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.897 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_eh_0 439 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.898 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_eh_0 439 root txt unknown /proc/439/exe 2023-11-04T01:48:16.898 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_tmf_ 440 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.898 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_tmf_ 440 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.898 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_tmf_ 440 root txt unknown /proc/440/exe 2023-11-04T01:48:16.898 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_eh_1 441 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.899 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_eh_1 441 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.899 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_eh_1 441 root txt unknown /proc/441/exe 2023-11-04T01:48:16.899 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_tmf_ 442 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.899 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_tmf_ 442 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.899 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_tmf_ 442 root txt unknown /proc/442/exe 2023-11-04T01:48:16.900 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_eh_2 443 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.900 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_eh_2 443 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.900 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_eh_2 443 root txt unknown /proc/443/exe 2023-11-04T01:48:16.900 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_tmf_ 444 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.901 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_tmf_ 444 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.901 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_tmf_ 444 root txt unknown /proc/444/exe 2023-11-04T01:48:16.901 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_eh_3 445 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.901 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_eh_3 445 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.901 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_eh_3 445 root txt unknown /proc/445/exe 2023-11-04T01:48:16.901 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_tmf_ 446 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.902 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_tmf_ 446 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.902 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_tmf_ 446 root txt unknown /proc/446/exe 2023-11-04T01:48:16.902 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_eh_4 450 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.902 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_eh_4 450 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.902 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_eh_4 450 root txt unknown /proc/450/exe 2023-11-04T01:48:16.903 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_tmf_ 451 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.903 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_tmf_ 451 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.903 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_tmf_ 451 root txt unknown /proc/451/exe 2023-11-04T01:48:16.903 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_eh_5 452 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.903 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_eh_5 452 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.904 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_eh_5 452 root txt unknown /proc/452/exe 2023-11-04T01:48:16.904 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_tmf_ 453 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.904 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_tmf_ 453 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.904 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_tmf_ 453 root txt unknown /proc/453/exe 2023-11-04T01:48:16.904 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_eh_6 454 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.905 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_eh_6 454 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.905 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_eh_6 454 root txt unknown /proc/454/exe 2023-11-04T01:48:16.905 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_tmf_ 455 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.905 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_tmf_ 455 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.905 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_tmf_ 455 root txt unknown /proc/455/exe 2023-11-04T01:48:16.906 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_eh_7 456 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.906 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_eh_7 456 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.906 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_eh_7 456 root txt unknown /proc/456/exe 2023-11-04T01:48:16.906 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_tmf_ 457 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.906 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_tmf_ 457 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.907 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_tmf_ 457 root txt unknown /proc/457/exe 2023-11-04T01:48:16.907 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_eh_8 458 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.907 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_eh_8 458 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.907 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_eh_8 458 root txt unknown /proc/458/exe 2023-11-04T01:48:16.907 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_tmf_ 459 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.908 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_tmf_ 459 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.908 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_tmf_ 459 root txt unknown /proc/459/exe 2023-11-04T01:48:16.908 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_eh_9 460 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.908 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_eh_9 460 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.908 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_eh_9 460 root txt unknown /proc/460/exe 2023-11-04T01:48:16.909 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_tmf_ 461 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.909 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_tmf_ 461 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.909 INFO:teuthology.orchestra.run.smithi077.stdout:scsi_tmf_ 461 root txt unknown /proc/461/exe 2023-11-04T01:48:16.909 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/2 474 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.909 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/2 474 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.910 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/2 474 root txt unknown /proc/474/exe 2023-11-04T01:48:16.910 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/7 486 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.910 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/7 486 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.910 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/7 486 root txt unknown /proc/486/exe 2023-11-04T01:48:16.910 INFO:teuthology.orchestra.run.smithi077.stdout:jbd2/sda1 490 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.911 INFO:teuthology.orchestra.run.smithi077.stdout:jbd2/sda1 490 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.911 INFO:teuthology.orchestra.run.smithi077.stdout:jbd2/sda1 490 root txt unknown /proc/490/exe 2023-11-04T01:48:16.911 INFO:teuthology.orchestra.run.smithi077.stdout:ext4-rsv- 491 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.911 INFO:teuthology.orchestra.run.smithi077.stdout:ext4-rsv- 491 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.911 INFO:teuthology.orchestra.run.smithi077.stdout:ext4-rsv- 491 root txt unknown /proc/491/exe 2023-11-04T01:48:16.911 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.912 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.912 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root txt REG 8,1 185496 20360 /usr/lib/systemd/systemd-journald 2023-11-04T01:48:16.912 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-04T01:48:16.912 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:48:16.912 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:48:16.913 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:48:16.913 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:16.913 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:16.913 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:48:16.913 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:16.914 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:16.914 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:16.914 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:48:16.914 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:16.914 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-04T01:48:16.914 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:48:16.915 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:48:16.915 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:48:16.915 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:16.915 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:16.915 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-11-04T01:48:16.915 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-11-04T01:48:16.916 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:48:16.916 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:16.916 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:16.916 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:16.916 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:16.917 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-11-04T01:48:16.917 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root DEL REG 8,1 9806 /usr/lib64/libacl.so.1.1.2301 2023-11-04T01:48:16.917 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:16.917 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:16.917 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root mem REG 0,24 8 55 /run/systemd/journal/kernel-seqnum 2023-11-04T01:48:16.918 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:16.918 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root 1w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:16.918 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root 2w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:16.918 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root 3u unix 0xffff9ba92024ee80 0t0 47 /run/systemd/journal/socket type=DGRAM (CONNECTED) 2023-11-04T01:48:16.918 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root 4u unix 0xffff9ba920257b40 0t0 49 /run/systemd/journal/stdout type=STREAM (LISTEN) 2023-11-04T01:48:16.919 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root 5u unix 0xffff9ba92024cc80 0t0 45 /run/systemd/journal/dev-log type=DGRAM (CONNECTED) 2023-11-04T01:48:16.919 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root 6w CHR 1,11 0t0 10 /dev/kmsg 2023-11-04T01:48:16.919 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root 7u a_inode 0,14 0 3100 [eventpoll:3,4,5,8,9,10,11,12,13,15,17,18,19,20,23,24,25,26,27,28,29,30,31,32] 2023-11-04T01:48:16.919 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root 8u CHR 1,11 0t0 10 /dev/kmsg 2023-11-04T01:48:16.919 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root 9u unix 0xffff9ba920254c80 0t0 200 /run/systemd/journal/io.systemd.journal type=STREAM (LISTEN) 2023-11-04T01:48:16.920 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root 10r REG 0,20 0 1078 /proc/sys/kernel/hostname 2023-11-04T01:48:16.920 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root 11u a_inode 0,14 0 3100 [signalfd] 2023-11-04T01:48:16.920 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root 12u a_inode 0,14 0 3100 [signalfd] 2023-11-04T01:48:16.920 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root 13u a_inode 0,14 0 3100 [signalfd] 2023-11-04T01:48:16.920 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root 14u unix 0xffff9ba92024d500 0t0 201 type=DGRAM (CONNECTED) 2023-11-04T01:48:16.920 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root 15u a_inode 0,14 0 3100 [timerfd] 2023-11-04T01:48:16.921 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root 16u REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-04T01:48:16.921 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root 17u unix 0xffff9ba908671540 0t0 17659 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:48:16.921 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root 18u unix 0xffff9ba9201eb740 0t0 21620 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:48:16.921 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root 19u unix 0xffff9ba900b3c840 0t0 18962 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:48:16.921 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root 20u unix 0xffff9ba9084aa200 0t0 21621 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:48:16.922 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root 23u unix 0xffff9ba9084aa640 0t0 16840 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:48:16.922 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root 24u unix 0xffff9ba900b3dd80 0t0 21624 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:48:16.922 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root 25u unix 0xffff9ba900b38000 0t0 21625 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:48:16.922 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root 26u unix 0xffff9ba920252640 0t0 191409 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:48:16.922 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root 27u unix 0xffff9ba9084a9100 0t0 19732 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:48:16.923 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root 28u unix 0xffff9ba9201bfb40 0t0 16854 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:48:16.923 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root 29u unix 0xffff9ba908672a80 0t0 22681 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:48:16.923 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root 30u unix 0xffff9ba9201e9dc0 0t0 22682 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:48:16.923 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root 31u unix 0xffff9ba920036e80 0t0 16957 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:48:16.923 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-j 567 root 32u unix 0xffff9ba9200350c0 0t0 403 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-11-04T01:48:16.923 INFO:teuthology.orchestra.run.smithi077.stdout:ext4lazyi 573 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.924 INFO:teuthology.orchestra.run.smithi077.stdout:ext4lazyi 573 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.924 INFO:teuthology.orchestra.run.smithi077.stdout:ext4lazyi 573 root txt unknown /proc/573/exe 2023-11-04T01:48:16.924 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.924 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.924 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root txt REG 8,1 597744 11595 /usr/bin/udevadm 2023-11-04T01:48:16.925 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root mem REG 8,1 11730661 64128 /etc/udev/hwdb.bin 2023-11-04T01:48:16.925 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root mem REG 8,1 596532 1490 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-11-04T01:48:16.925 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root mem REG 8,1 566315 265239 /usr/lib/modules/5.14.0-378.el9.x86_64/modules.symbols.bin 2023-11-04T01:48:16.925 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root mem REG 8,1 821166 265236 /usr/lib/modules/5.14.0-378.el9.x86_64/modules.alias.bin 2023-11-04T01:48:16.925 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root mem REG 8,1 383471 265245 /usr/lib/modules/5.14.0-378.el9.x86_64/modules.dep.bin 2023-11-04T01:48:16.925 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:16.926 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:16.926 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:48:16.926 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:16.926 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root mem REG 8,1 21219 1167 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-11-04T01:48:16.926 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:48:16.927 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:48:16.927 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:48:16.927 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:48:16.927 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:16.927 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:48:16.928 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:16.928 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:16.928 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:16.928 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:16.928 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-04T01:48:16.929 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:48:16.929 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:48:16.929 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-11-04T01:48:16.929 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-11-04T01:48:16.929 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:48:16.930 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:16.930 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:16.930 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:16.930 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root DEL REG 8,1 9806 /usr/lib64/libacl.so.1.1.2301 2023-11-04T01:48:16.930 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:16.931 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:16.931 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-11-04T01:48:16.931 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root mem REG 8,1 11812 265240 /usr/lib/modules/5.14.0-378.el9.x86_64/modules.builtin.bin 2023-11-04T01:48:16.931 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:16.931 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-04T01:48:16.931 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:16.932 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root 1u unix 0xffff9ba908677b40 0t0 19588 type=STREAM (CONNECTED) 2023-11-04T01:48:16.932 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root 2u unix 0xffff9ba908677b40 0t0 19588 type=STREAM (CONNECTED) 2023-11-04T01:48:16.932 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root 3u unix 0xffff9ba908685500 0t0 19551 /run/udev/control type=SEQPACKET (LISTEN) 2023-11-04T01:48:16.932 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root 4u netlink 0t0 19553 KOBJECT_UEVENT 2023-11-04T01:48:16.933 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root 5u unix 0xffff9ba908682a80 0t0 19600 type=DGRAM (CONNECTED) 2023-11-04T01:48:16.933 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root 6u unix 0xffff9ba908685d80 0t0 19604 type=DGRAM (CONNECTED) 2023-11-04T01:48:16.933 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root 7u unix 0xffff9ba9086861c0 0t0 19605 type=DGRAM (CONNECTED) 2023-11-04T01:48:16.933 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root 8r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:16.933 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root 9u a_inode 0,14 0 3100 [eventpoll:3,4,6,8,10,11,14] 2023-11-04T01:48:16.934 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root 10u a_inode 0,14 0 3100 [signalfd] 2023-11-04T01:48:16.934 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root 11u a_inode 0,14 0 3100 [timerfd] 2023-11-04T01:48:16.934 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root 12r REG 8,1 11730661 64128 /etc/udev/hwdb.bin 2023-11-04T01:48:16.934 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-u 583 root 14u a_inode 0,14 0 3100 [timerfd] 2023-11-04T01:48:16.934 INFO:teuthology.orchestra.run.smithi077.stdout:ipmi-msgh 632 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.935 INFO:teuthology.orchestra.run.smithi077.stdout:ipmi-msgh 632 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.935 INFO:teuthology.orchestra.run.smithi077.stdout:ipmi-msgh 632 root txt unknown /proc/632/exe 2023-11-04T01:48:16.935 INFO:teuthology.orchestra.run.smithi077.stdout:rpcbind 637 rpc cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.935 INFO:teuthology.orchestra.run.smithi077.stdout:rpcbind 637 rpc rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.935 INFO:teuthology.orchestra.run.smithi077.stdout:rpcbind 637 rpc txt REG 8,1 61200 14999 /usr/bin/rpcbind 2023-11-04T01:48:16.935 INFO:teuthology.orchestra.run.smithi077.stdout:rpcbind 637 rpc mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:16.936 INFO:teuthology.orchestra.run.smithi077.stdout:rpcbind 637 rpc mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:16.936 INFO:teuthology.orchestra.run.smithi077.stdout:rpcbind 637 rpc mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:16.936 INFO:teuthology.orchestra.run.smithi077.stdout:rpcbind 637 rpc mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:16.936 INFO:teuthology.orchestra.run.smithi077.stdout:rpcbind 637 rpc mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:48:16.936 INFO:teuthology.orchestra.run.smithi077.stdout:rpcbind 637 rpc mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:16.937 INFO:teuthology.orchestra.run.smithi077.stdout:rpcbind 637 rpc mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:48:16.937 INFO:teuthology.orchestra.run.smithi077.stdout:rpcbind 637 rpc mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:48:16.937 INFO:teuthology.orchestra.run.smithi077.stdout:rpcbind 637 rpc mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:16.937 INFO:teuthology.orchestra.run.smithi077.stdout:rpcbind 637 rpc mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:16.937 INFO:teuthology.orchestra.run.smithi077.stdout:rpcbind 637 rpc mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:16.937 INFO:teuthology.orchestra.run.smithi077.stdout:rpcbind 637 rpc mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:16.938 INFO:teuthology.orchestra.run.smithi077.stdout:rpcbind 637 rpc mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:16.938 INFO:teuthology.orchestra.run.smithi077.stdout:rpcbind 637 rpc mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:16.938 INFO:teuthology.orchestra.run.smithi077.stdout:rpcbind 637 rpc mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:16.938 INFO:teuthology.orchestra.run.smithi077.stdout:rpcbind 637 rpc mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:16.938 INFO:teuthology.orchestra.run.smithi077.stdout:rpcbind 637 rpc mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:16.939 INFO:teuthology.orchestra.run.smithi077.stdout:rpcbind 637 rpc mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:16.939 INFO:teuthology.orchestra.run.smithi077.stdout:rpcbind 637 rpc mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:16.939 INFO:teuthology.orchestra.run.smithi077.stdout:rpcbind 637 rpc mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:48:16.939 INFO:teuthology.orchestra.run.smithi077.stdout:rpcbind 637 rpc mem REG 8,1 196112 11431 /usr/lib64/libtirpc.so.3.0.0 2023-11-04T01:48:16.939 INFO:teuthology.orchestra.run.smithi077.stdout:rpcbind 637 rpc mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:16.940 INFO:teuthology.orchestra.run.smithi077.stdout:rpcbind 637 rpc 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:16.940 INFO:teuthology.orchestra.run.smithi077.stdout:rpcbind 637 rpc 1u unix 0xffff9ba900b3d0c0 0t0 16800 type=STREAM (CONNECTED) 2023-11-04T01:48:16.940 INFO:teuthology.orchestra.run.smithi077.stdout:rpcbind 637 rpc 2u unix 0xffff9ba900b3d0c0 0t0 16800 type=STREAM (CONNECTED) 2023-11-04T01:48:16.940 INFO:teuthology.orchestra.run.smithi077.stdout:rpcbind 637 rpc 3u unix 0xffff9ba908670440 0t0 19539 /run/rpcbind.sock type=STREAM (LISTEN) 2023-11-04T01:48:16.940 INFO:teuthology.orchestra.run.smithi077.stdout:rpcbind 637 rpc 4u IPv4 18838 0t0 TCP *:sunrpc (LISTEN) 2023-11-04T01:48:16.940 INFO:teuthology.orchestra.run.smithi077.stdout:rpcbind 637 rpc 5u IPv4 18844 0t0 UDP *:sunrpc 2023-11-04T01:48:16.941 INFO:teuthology.orchestra.run.smithi077.stdout:rpcbind 637 rpc 6u IPv6 18850 0t0 TCP *:sunrpc (LISTEN) 2023-11-04T01:48:16.941 INFO:teuthology.orchestra.run.smithi077.stdout:rpcbind 637 rpc 7u IPv6 18856 0t0 UDP *:sunrpc 2023-11-04T01:48:16.941 INFO:teuthology.orchestra.run.smithi077.stdout:rpcbind 637 rpc 8rW REG 0,24 0 1037 /run/rpcbind/rpcbind.lock 2023-11-04T01:48:16.941 INFO:teuthology.orchestra.run.smithi077.stdout:kipmi0 646 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.941 INFO:teuthology.orchestra.run.smithi077.stdout:kipmi0 646 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.942 INFO:teuthology.orchestra.run.smithi077.stdout:kipmi0 646 root txt unknown /proc/646/exe 2023-11-04T01:48:16.942 INFO:teuthology.orchestra.run.smithi077.stdout:rpciod 659 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.942 INFO:teuthology.orchestra.run.smithi077.stdout:rpciod 659 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.942 INFO:teuthology.orchestra.run.smithi077.stdout:rpciod 659 root txt unknown /proc/659/exe 2023-11-04T01:48:16.942 INFO:teuthology.orchestra.run.smithi077.stdout:xprtiod 660 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.943 INFO:teuthology.orchestra.run.smithi077.stdout:xprtiod 660 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.943 INFO:teuthology.orchestra.run.smithi077.stdout:xprtiod 660 root txt unknown /proc/660/exe 2023-11-04T01:48:16.943 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.943 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.943 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 root txt REG 8,1 144576 11776 /usr/sbin/auditd 2023-11-04T01:48:16.943 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:16.944 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:16.944 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:16.944 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:16.944 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:16.944 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:16.945 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:16.945 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:16.945 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:16.945 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:16.945 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:48:16.945 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:16.946 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:16.946 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2023-11-04T01:48:16.946 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:48:16.946 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:16.946 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:16.947 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:16.947 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:16.947 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 root 3u netlink 0t0 19671 AUDIT 2023-11-04T01:48:16.947 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 root 4w REG 8,1 7989674 1435 /var/log/audit/audit.log 2023-11-04T01:48:16.947 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 root 6u unix 0xffff9ba908686a40 0t0 19676 type=DGRAM (CONNECTED) 2023-11-04T01:48:16.948 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 root 7u unix 0xffff9ba908676e80 0t0 19675 type=STREAM (CONNECTED) 2023-11-04T01:48:16.948 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 root 8u unix 0xffff9ba908672640 0t0 19677 type=STREAM (CONNECTED) 2023-11-04T01:48:16.948 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 root 9u unix 0xffff9ba908676a40 0t0 19678 type=STREAM (CONNECTED) 2023-11-04T01:48:16.948 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 root 10u a_inode 0,14 0 3100 [eventfd:0] 2023-11-04T01:48:16.948 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 664 auditd root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.949 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 664 auditd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.949 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 664 auditd root txt REG 8,1 144576 11776 /usr/sbin/auditd 2023-11-04T01:48:16.949 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 664 auditd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:16.949 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 664 auditd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:16.949 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 664 auditd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:16.950 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 664 auditd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:16.950 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 664 auditd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:16.950 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 664 auditd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:16.950 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 664 auditd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:16.950 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 664 auditd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:16.951 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 664 auditd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:16.951 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 664 auditd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:16.951 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 664 auditd root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:48:16.951 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 664 auditd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:16.951 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 664 auditd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:16.952 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 664 auditd root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2023-11-04T01:48:16.952 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 664 auditd root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:48:16.952 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 664 auditd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:16.952 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 664 auditd root 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:16.952 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 664 auditd root 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:16.953 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 664 auditd root 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:16.953 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 664 auditd root 3u netlink 0t0 19671 AUDIT 2023-11-04T01:48:16.953 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 664 auditd root 4w REG 8,1 7989674 1435 /var/log/audit/audit.log 2023-11-04T01:48:16.953 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 664 auditd root 6u unix 0xffff9ba908686a40 0t0 19676 type=DGRAM (CONNECTED) 2023-11-04T01:48:16.953 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 664 auditd root 7u unix 0xffff9ba908676e80 0t0 19675 type=STREAM (CONNECTED) 2023-11-04T01:48:16.954 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 664 auditd root 8u unix 0xffff9ba908672640 0t0 19677 type=STREAM (CONNECTED) 2023-11-04T01:48:16.954 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 664 auditd root 9u unix 0xffff9ba908676a40 0t0 19678 type=STREAM (CONNECTED) 2023-11-04T01:48:16.954 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 664 auditd root 10u a_inode 0,14 0 3100 [eventfd:0] 2023-11-04T01:48:16.954 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 668 auditd root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.954 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 668 auditd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.955 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 668 auditd root txt REG 8,1 144576 11776 /usr/sbin/auditd 2023-11-04T01:48:16.955 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 668 auditd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:16.955 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 668 auditd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:16.955 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 668 auditd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:16.955 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 668 auditd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:16.956 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 668 auditd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:16.956 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 668 auditd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:16.956 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 668 auditd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:16.956 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 668 auditd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:16.956 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 668 auditd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:16.957 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 668 auditd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:16.957 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 668 auditd root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:48:16.957 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 668 auditd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:16.957 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 668 auditd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:16.957 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 668 auditd root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2023-11-04T01:48:16.957 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 668 auditd root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:48:16.958 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 668 auditd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:16.958 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 668 auditd root 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:16.958 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 668 auditd root 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:16.958 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 668 auditd root 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:16.958 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 668 auditd root 3u netlink 0t0 19671 AUDIT 2023-11-04T01:48:16.959 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 668 auditd root 4w REG 8,1 7989674 1435 /var/log/audit/audit.log 2023-11-04T01:48:16.959 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 668 auditd root 6u unix 0xffff9ba908686a40 0t0 19676 type=DGRAM (CONNECTED) 2023-11-04T01:48:16.959 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 668 auditd root 7u unix 0xffff9ba908676e80 0t0 19675 type=STREAM (CONNECTED) 2023-11-04T01:48:16.959 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 668 auditd root 8u unix 0xffff9ba908672640 0t0 19677 type=STREAM (CONNECTED) 2023-11-04T01:48:16.959 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 668 auditd root 9u unix 0xffff9ba908676a40 0t0 19678 type=STREAM (CONNECTED) 2023-11-04T01:48:16.960 INFO:teuthology.orchestra.run.smithi077.stdout:auditd 663 668 auditd root 10u a_inode 0,14 0 3100 [eventfd:0] 2023-11-04T01:48:16.960 INFO:teuthology.orchestra.run.smithi077.stdout:sedispatc 667 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.960 INFO:teuthology.orchestra.run.smithi077.stdout:sedispatc 667 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.960 INFO:teuthology.orchestra.run.smithi077.stdout:sedispatc 667 root txt REG 8,1 19624 11914 /usr/sbin/sedispatch 2023-11-04T01:48:16.960 INFO:teuthology.orchestra.run.smithi077.stdout:sedispatc 667 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:48:16.961 INFO:teuthology.orchestra.run.smithi077.stdout:sedispatc 667 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:48:16.961 INFO:teuthology.orchestra.run.smithi077.stdout:sedispatc 667 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:48:16.961 INFO:teuthology.orchestra.run.smithi077.stdout:sedispatc 667 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:16.961 INFO:teuthology.orchestra.run.smithi077.stdout:sedispatc 667 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:48:16.961 INFO:teuthology.orchestra.run.smithi077.stdout:sedispatc 667 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:16.961 INFO:teuthology.orchestra.run.smithi077.stdout:sedispatc 667 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:16.962 INFO:teuthology.orchestra.run.smithi077.stdout:sedispatc 667 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:16.962 INFO:teuthology.orchestra.run.smithi077.stdout:sedispatc 667 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:16.962 INFO:teuthology.orchestra.run.smithi077.stdout:sedispatc 667 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:16.962 INFO:teuthology.orchestra.run.smithi077.stdout:sedispatc 667 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:48:16.962 INFO:teuthology.orchestra.run.smithi077.stdout:sedispatc 667 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:16.963 INFO:teuthology.orchestra.run.smithi077.stdout:sedispatc 667 root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2023-11-04T01:48:16.963 INFO:teuthology.orchestra.run.smithi077.stdout:sedispatc 667 root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-11-04T01:48:16.963 INFO:teuthology.orchestra.run.smithi077.stdout:sedispatc 667 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:48:16.963 INFO:teuthology.orchestra.run.smithi077.stdout:sedispatc 667 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:16.964 INFO:teuthology.orchestra.run.smithi077.stdout:sedispatc 667 root 0u unix 0xffff9ba908671100 0t0 19674 type=STREAM (CONNECTED) 2023-11-04T01:48:16.964 INFO:teuthology.orchestra.run.smithi077.stdout:sedispatc 667 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:16.964 INFO:teuthology.orchestra.run.smithi077.stdout:sedispatc 667 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:16.964 INFO:teuthology.orchestra.run.smithi077.stdout:sedispatc 667 root 3u unix 0xffff9ba9201ec400 0t0 26057 type=STREAM (CONNECTED) 2023-11-04T01:48:16.964 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 704 dbus cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.964 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 704 dbus rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.965 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 704 dbus txt REG 8,1 131896 11213 /usr/bin/dbus-broker-launch 2023-11-04T01:48:16.965 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 704 dbus DEL REG 0,1 3072 /memfd:dbus-broker-log 2023-11-04T01:48:16.965 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 704 dbus mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:48:16.965 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 704 dbus mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:16.965 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 704 dbus mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:16.966 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 704 dbus mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:48:16.966 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 704 dbus mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:48:16.966 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 704 dbus mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:16.966 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 704 dbus mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:16.966 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 704 dbus mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:16.967 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 704 dbus mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:16.967 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 704 dbus mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:16.967 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 704 dbus mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:16.967 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 704 dbus mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:48:16.967 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 704 dbus mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:48:16.968 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 704 dbus mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:48:16.968 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 704 dbus mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:48:16.968 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 704 dbus mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:16.968 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 704 dbus 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:16.968 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 704 dbus 1u unix 0xffff9ba9201ed0c0 0t0 17797 type=STREAM (CONNECTED) 2023-11-04T01:48:16.968 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 704 dbus 2u unix 0xffff9ba9201ed0c0 0t0 17797 type=STREAM (CONNECTED) 2023-11-04T01:48:16.969 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 704 dbus 3u unix 0xffff9ba9200aea40 0t0 3876 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2023-11-04T01:48:16.969 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 704 dbus 4u unix 0xffff9ba90bb06600 0t0 17807 type=DGRAM (CONNECTED) 2023-11-04T01:48:16.969 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 704 dbus 5u a_inode 0,14 0 3100 [eventpoll:6,7,8,9,10,11] 2023-11-04T01:48:16.969 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 704 dbus 6u a_inode 0,14 0 3100 [signalfd] 2023-11-04T01:48:16.969 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 704 dbus 7r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:16.970 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 704 dbus 8u unix 0xffff9ba9201e8880 0t0 17809 type=STREAM (CONNECTED) 2023-11-04T01:48:16.970 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 704 dbus 9u unix 0xffff9ba9201efb40 0t0 17826 type=STREAM (CONNECTED) 2023-11-04T01:48:16.970 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 704 dbus 10u a_inode 0,14 0 3100 [pidfd:705] 2023-11-04T01:48:16.970 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 704 dbus 11u a_inode 0,14 0 3100 [timerfd] 2023-11-04T01:48:16.970 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 704 dbus 12u REG 0,1 2097152 3072 /memfd:dbus-broker-log (deleted) 2023-11-04T01:48:16.971 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 705 dbus cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.971 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 705 dbus rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.971 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 705 dbus txt REG 8,1 236336 11212 /usr/bin/dbus-broker 2023-11-04T01:48:16.971 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 705 dbus mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:16.971 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 705 dbus mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:16.972 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 705 dbus mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:16.972 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 705 dbus mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:16.972 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 705 dbus mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:48:16.972 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 705 dbus mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:48:16.972 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 705 dbus mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:16.973 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 705 dbus mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:16.973 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 705 dbus mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-04T01:48:16.973 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 705 dbus 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:16.973 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 705 dbus 1u unix 0xffff9ba9201ed0c0 0t0 17797 type=STREAM (CONNECTED) 2023-11-04T01:48:16.973 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 705 dbus 2u unix 0xffff9ba9201ed0c0 0t0 17797 type=STREAM (CONNECTED) 2023-11-04T01:48:16.974 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 705 dbus 3u sock 0,8 0t0 16857 protocol: NETLINK 2023-11-04T01:48:16.974 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 705 dbus 4u unix 0xffff9ba90bb06600 0t0 17807 type=DGRAM (CONNECTED) 2023-11-04T01:48:16.974 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 705 dbus 5u a_inode 0,14 0 3100 [eventpoll:6,7,8,9,10,11,12,13,14,15,18,19] 2023-11-04T01:48:16.974 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 705 dbus 6u a_inode 0,14 0 3100 [signalfd] 2023-11-04T01:48:16.974 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 705 dbus 7u unix 0xffff9ba9200aea40 0t0 3876 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2023-11-04T01:48:16.974 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 705 dbus 8u unix 0xffff9ba9200a9540 0t0 16858 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-04T01:48:16.975 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 705 dbus 9u unix 0xffff9ba9201ea200 0t0 17810 type=STREAM (CONNECTED) 2023-11-04T01:48:16.975 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 705 dbus 10u unix 0xffff9ba9201e8440 0t0 16860 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-04T01:48:16.975 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 705 dbus 11u unix 0xffff9ba9201bd500 0t0 16866 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-04T01:48:16.975 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 705 dbus 12u unix 0xffff9ba900b39100 0t0 17851 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-04T01:48:16.975 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 705 dbus 13u unix 0xffff9ba9084ad500 0t0 17853 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-04T01:48:16.976 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 705 dbus 14u unix 0xffff9ba9201ebfc0 0t0 24937 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-04T01:48:16.976 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 705 dbus 15u unix 0xffff9ba900b3fb40 0t0 19080 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-04T01:48:16.976 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 705 dbus 18u unix 0xffff9ba9201bea40 0t0 22717 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-04T01:48:16.976 INFO:teuthology.orchestra.run.smithi077.stdout:dbus-brok 705 dbus 19u unix 0xffff9ba920030440 0t0 22775 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-11-04T01:48:16.976 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.977 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.977 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root txt REG 8,1 3644720 11633 /usr/sbin/NetworkManager (deleted) 2023-11-04T01:48:16.977 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root DEL REG 8,1 52828 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-settings-plugin-ifcfg-rh.so 2023-11-04T01:48:16.977 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-11-04T01:48:16.977 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:48:16.978 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 62456 9782 /usr/lib64/libjansson.so.4.14.0 2023-11-04T01:48:16.978 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 31792 10954 /usr/lib64/libteamdctl.so.0.1.5 2023-11-04T01:48:16.978 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root DEL REG 8,1 52811 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-device-plugin-team.so 2023-11-04T01:48:16.978 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:16.978 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:48:16.979 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:16.979 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:16.979 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:16.979 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:16.979 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:16.980 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:16.980 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:16.980 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:16.980 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:16.980 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:48:16.981 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:48:16.981 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:16.981 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:48:16.981 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:16.981 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:16.981 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:16.982 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:16.982 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:48:16.982 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:16.982 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:16.982 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:16.983 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:16.983 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:16.983 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:16.983 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:16.983 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:16.984 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:16.984 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:16.984 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:48:16.984 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:16.984 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:48:16.985 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-11-04T01:48:16.985 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:16.985 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:16.985 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:48:16.985 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:16.985 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:48:16.986 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:48:16.986 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-11-04T01:48:16.986 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:16.986 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:48:16.986 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:16.987 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:48:16.987 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:48:16.987 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:48:16.987 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:16.987 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-11-04T01:48:16.988 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:16.988 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:48:16.988 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:48:16.988 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:16.988 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 32408 11334 /usr/lib64/libndp.so.0.2.0 2023-11-04T01:48:16.989 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:48:16.989 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:16.989 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:48:16.989 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:48:16.989 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:48:16.989 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:48:16.990 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:48:16.990 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:48:16.990 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:16.990 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:48:16.990 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:16.991 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root 1u unix 0xffff9ba9084a8880 0t0 22633 type=STREAM (CONNECTED) 2023-11-04T01:48:16.991 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root 2u unix 0xffff9ba9084a8880 0t0 22633 type=STREAM (CONNECTED) 2023-11-04T01:48:16.991 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root 3u a_inode 0,14 0 3100 [eventfd:3] 2023-11-04T01:48:16.991 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root 4u a_inode 0,14 0 3100 [eventfd:4] 2023-11-04T01:48:16.991 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root 5u unix 0xffff9ba9084b1980 0t0 22666 type=DGRAM (UNCONNECTED) 2023-11-04T01:48:16.992 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root 6u unix 0xffff9ba9084a8440 0t0 22667 type=STREAM (CONNECTED) 2023-11-04T01:48:16.992 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root 7u a_inode 0,14 0 3100 [eventfd:8] 2023-11-04T01:48:16.992 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root 8r REG 0,4 0 4026531840 net 2023-11-04T01:48:16.992 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root 9r REG 0,4 0 4026532495 mnt 2023-11-04T01:48:16.992 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root 10u netlink 0t0 3919 KOBJECT_UEVENT 2023-11-04T01:48:16.992 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root 11u netlink 0t0 3920 GENERIC 2023-11-04T01:48:16.993 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root 12u netlink 0t0 3921 GENERIC 2023-11-04T01:48:16.993 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root 13u netlink 0t0 3922 ROUTE 2023-11-04T01:48:16.993 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root 14r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:16.993 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root 15r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:16.993 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root 16u netlink 0t0 16895 KOBJECT_UEVENT 2023-11-04T01:48:16.993 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root 17u unix 0xffff9ba900b38440 0t0 16900 type=STREAM (CONNECTED) 2023-11-04T01:48:16.994 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root 18u a_inode 0,14 0 3100 [eventpoll] 2023-11-04T01:48:16.994 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root 19u a_inode 0,14 0 3100 [eventpoll:21,26] 2023-11-04T01:48:16.994 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root 20w FIFO 0,24 0t0 1159 /run/systemd/inhibit/1.ref 2023-11-04T01:48:16.994 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root 21u a_inode 0,14 0 3100 [timerfd] 2023-11-04T01:48:16.994 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root 23u a_inode 0,14 0 3100 [eventpoll:24,25] 2023-11-04T01:48:16.995 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root 24u a_inode 0,14 0 3100 [timerfd] 2023-11-04T01:48:16.995 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root 25u pack 19767 0t0 ARP type=SOCK_DGRAM 2023-11-04T01:48:16.995 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 root 26u IPv4 19768 0t0 UDP smithi077.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-11-04T01:48:16.995 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:16.995 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:16.996 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root txt REG 8,1 3644720 11633 /usr/sbin/NetworkManager (deleted) 2023-11-04T01:48:16.996 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root DEL REG 8,1 52828 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-settings-plugin-ifcfg-rh.so 2023-11-04T01:48:16.996 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-11-04T01:48:16.996 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:48:16.996 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 62456 9782 /usr/lib64/libjansson.so.4.14.0 2023-11-04T01:48:16.996 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 31792 10954 /usr/lib64/libteamdctl.so.0.1.5 2023-11-04T01:48:16.997 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root DEL REG 8,1 52811 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-device-plugin-team.so 2023-11-04T01:48:16.997 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:16.997 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:48:16.997 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:16.997 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:16.998 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:16.998 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:16.998 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:16.998 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:16.998 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:16.999 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:16.999 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:16.999 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:48:16.999 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:48:16.999 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:17.000 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:48:17.000 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.000 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:17.000 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:17.000 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.001 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:48:17.001 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:17.001 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.001 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.001 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.002 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:17.002 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:17.002 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:17.002 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:17.002 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.002 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.003 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:48:17.003 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:17.003 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:48:17.003 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-11-04T01:48:17.003 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:17.004 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.004 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:48:17.004 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.004 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:48:17.004 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:48:17.005 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-11-04T01:48:17.005 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:17.005 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:48:17.005 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.005 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:48:17.005 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:48:17.006 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:48:17.006 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:17.006 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-11-04T01:48:17.006 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:17.006 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:48:17.007 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:48:17.007 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.007 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 32408 11334 /usr/lib64/libndp.so.0.2.0 2023-11-04T01:48:17.007 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:48:17.007 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:17.008 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:48:17.008 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:48:17.008 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:48:17.008 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:48:17.008 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:48:17.008 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:48:17.009 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.009 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:48:17.009 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.009 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root 1u unix 0xffff9ba9084a8880 0t0 22633 type=STREAM (CONNECTED) 2023-11-04T01:48:17.009 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root 2u unix 0xffff9ba9084a8880 0t0 22633 type=STREAM (CONNECTED) 2023-11-04T01:48:17.010 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root 3u a_inode 0,14 0 3100 [eventfd:3] 2023-11-04T01:48:17.010 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root 4u a_inode 0,14 0 3100 [eventfd:4] 2023-11-04T01:48:17.010 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root 5u unix 0xffff9ba9084b1980 0t0 22666 type=DGRAM (UNCONNECTED) 2023-11-04T01:48:17.010 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root 6u unix 0xffff9ba9084a8440 0t0 22667 type=STREAM (CONNECTED) 2023-11-04T01:48:17.011 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root 7u a_inode 0,14 0 3100 [eventfd:8] 2023-11-04T01:48:17.011 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root 8r REG 0,4 0 4026531840 net 2023-11-04T01:48:17.011 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root 9r REG 0,4 0 4026532495 mnt 2023-11-04T01:48:17.011 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root 10u netlink 0t0 3919 KOBJECT_UEVENT 2023-11-04T01:48:17.011 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root 11u netlink 0t0 3920 GENERIC 2023-11-04T01:48:17.011 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root 12u netlink 0t0 3921 GENERIC 2023-11-04T01:48:17.012 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root 13u netlink 0t0 3922 ROUTE 2023-11-04T01:48:17.012 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root 14r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.012 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root 15r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.012 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root 16u netlink 0t0 16895 KOBJECT_UEVENT 2023-11-04T01:48:17.012 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root 17u unix 0xffff9ba900b38440 0t0 16900 type=STREAM (CONNECTED) 2023-11-04T01:48:17.013 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root 18u a_inode 0,14 0 3100 [eventpoll] 2023-11-04T01:48:17.013 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root 19u a_inode 0,14 0 3100 [eventpoll:21,26] 2023-11-04T01:48:17.013 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root 20w FIFO 0,24 0t0 1159 /run/systemd/inhibit/1.ref 2023-11-04T01:48:17.013 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root 21u a_inode 0,14 0 3100 [timerfd] 2023-11-04T01:48:17.013 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root 23u a_inode 0,14 0 3100 [eventpoll:24,25] 2023-11-04T01:48:17.014 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root 24u a_inode 0,14 0 3100 [timerfd] 2023-11-04T01:48:17.014 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root 25u pack 19767 0t0 ARP type=SOCK_DGRAM 2023-11-04T01:48:17.014 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 724 gmain root 26u IPv4 19768 0t0 UDP smithi077.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-11-04T01:48:17.014 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.014 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.015 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root txt REG 8,1 3644720 11633 /usr/sbin/NetworkManager (deleted) 2023-11-04T01:48:17.015 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root DEL REG 8,1 52828 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-settings-plugin-ifcfg-rh.so 2023-11-04T01:48:17.015 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-11-04T01:48:17.015 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:48:17.015 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 62456 9782 /usr/lib64/libjansson.so.4.14.0 2023-11-04T01:48:17.016 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 31792 10954 /usr/lib64/libteamdctl.so.0.1.5 2023-11-04T01:48:17.016 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root DEL REG 8,1 52811 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-device-plugin-team.so 2023-11-04T01:48:17.016 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:17.016 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:48:17.016 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:17.017 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.017 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.017 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:17.017 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:17.017 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:17.018 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.018 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.018 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.018 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:48:17.018 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:48:17.019 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:17.019 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:48:17.019 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.019 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:17.019 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:17.019 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.020 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:48:17.020 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:17.020 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.020 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.020 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.021 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:17.021 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:17.021 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:17.021 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:17.021 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.021 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.022 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:48:17.022 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:17.022 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:48:17.022 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-11-04T01:48:17.022 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:17.023 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.023 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:48:17.023 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.023 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:48:17.023 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:48:17.024 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-11-04T01:48:17.024 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:17.024 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:48:17.024 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.024 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:48:17.024 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:48:17.025 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:48:17.025 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:17.025 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-11-04T01:48:17.025 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:17.025 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:48:17.025 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:48:17.026 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.026 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 32408 11334 /usr/lib64/libndp.so.0.2.0 2023-11-04T01:48:17.026 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:48:17.026 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:17.026 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:48:17.027 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:48:17.027 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:48:17.027 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:48:17.027 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:48:17.027 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:48:17.028 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.028 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:48:17.028 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.028 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root 1u unix 0xffff9ba9084a8880 0t0 22633 type=STREAM (CONNECTED) 2023-11-04T01:48:17.028 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root 2u unix 0xffff9ba9084a8880 0t0 22633 type=STREAM (CONNECTED) 2023-11-04T01:48:17.028 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root 3u a_inode 0,14 0 3100 [eventfd:3] 2023-11-04T01:48:17.029 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root 4u a_inode 0,14 0 3100 [eventfd:4] 2023-11-04T01:48:17.029 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root 5u unix 0xffff9ba9084b1980 0t0 22666 type=DGRAM (UNCONNECTED) 2023-11-04T01:48:17.029 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root 6u unix 0xffff9ba9084a8440 0t0 22667 type=STREAM (CONNECTED) 2023-11-04T01:48:17.029 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root 7u a_inode 0,14 0 3100 [eventfd:8] 2023-11-04T01:48:17.029 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root 8r REG 0,4 0 4026531840 net 2023-11-04T01:48:17.030 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root 9r REG 0,4 0 4026532495 mnt 2023-11-04T01:48:17.030 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root 10u netlink 0t0 3919 KOBJECT_UEVENT 2023-11-04T01:48:17.030 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root 11u netlink 0t0 3920 GENERIC 2023-11-04T01:48:17.030 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root 12u netlink 0t0 3921 GENERIC 2023-11-04T01:48:17.030 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root 13u netlink 0t0 3922 ROUTE 2023-11-04T01:48:17.031 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root 14r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.031 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root 15r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.031 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root 16u netlink 0t0 16895 KOBJECT_UEVENT 2023-11-04T01:48:17.031 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root 17u unix 0xffff9ba900b38440 0t0 16900 type=STREAM (CONNECTED) 2023-11-04T01:48:17.031 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root 18u a_inode 0,14 0 3100 [eventpoll] 2023-11-04T01:48:17.032 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root 19u a_inode 0,14 0 3100 [eventpoll:21,26] 2023-11-04T01:48:17.032 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root 20w FIFO 0,24 0t0 1159 /run/systemd/inhibit/1.ref 2023-11-04T01:48:17.032 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root 21u a_inode 0,14 0 3100 [timerfd] 2023-11-04T01:48:17.032 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root 23u a_inode 0,14 0 3100 [eventpoll:24,25] 2023-11-04T01:48:17.032 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root 24u a_inode 0,14 0 3100 [timerfd] 2023-11-04T01:48:17.032 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root 25u pack 19767 0t0 ARP type=SOCK_DGRAM 2023-11-04T01:48:17.033 INFO:teuthology.orchestra.run.smithi077.stdout:NetworkMa 706 735 gdbus root 26u IPv4 19768 0t0 UDP smithi077.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-11-04T01:48:17.033 INFO:teuthology.orchestra.run.smithi077.stdout:irqbalanc 709 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.033 INFO:teuthology.orchestra.run.smithi077.stdout:irqbalanc 709 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.033 INFO:teuthology.orchestra.run.smithi077.stdout:irqbalanc 709 root txt REG 8,1 61904 10507 /usr/sbin/irqbalance 2023-11-04T01:48:17.033 INFO:teuthology.orchestra.run.smithi077.stdout:irqbalanc 709 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.034 INFO:teuthology.orchestra.run.smithi077.stdout:irqbalanc 709 root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:48:17.034 INFO:teuthology.orchestra.run.smithi077.stdout:irqbalanc 709 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.034 INFO:teuthology.orchestra.run.smithi077.stdout:irqbalanc 709 root DEL REG 8,1 9998 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:17.034 INFO:teuthology.orchestra.run.smithi077.stdout:irqbalanc 709 root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:48:17.034 INFO:teuthology.orchestra.run.smithi077.stdout:irqbalanc 709 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:48:17.035 INFO:teuthology.orchestra.run.smithi077.stdout:irqbalanc 709 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.035 INFO:teuthology.orchestra.run.smithi077.stdout:irqbalanc 709 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.035 INFO:teuthology.orchestra.run.smithi077.stdout:irqbalanc 709 root 1u unix 0xffff9ba9084aee80 0t0 22642 type=STREAM (CONNECTED) 2023-11-04T01:48:17.035 INFO:teuthology.orchestra.run.smithi077.stdout:irqbalanc 709 root 2u unix 0xffff9ba9084aee80 0t0 22642 type=STREAM (CONNECTED) 2023-11-04T01:48:17.035 INFO:teuthology.orchestra.run.smithi077.stdout:irqbalanc 709 root 3u a_inode 0,14 0 3100 [eventfd:1] 2023-11-04T01:48:17.035 INFO:teuthology.orchestra.run.smithi077.stdout:irqbalanc 709 root 4u a_inode 0,14 0 3100 [eventfd:2] 2023-11-04T01:48:17.036 INFO:teuthology.orchestra.run.smithi077.stdout:irqbalanc 709 root 5u unix 0xffff9ba9084afb40 0t0 22654 /run/irqbalance/irqbalance709.sock type=STREAM (LISTEN) 2023-11-04T01:48:17.036 INFO:teuthology.orchestra.run.smithi077.stdout:irqbalanc 709 root 6u unix 0xffff9ba9084b1dc0 0t0 22823 type=DGRAM (CONNECTED) 2023-11-04T01:48:17.036 INFO:teuthology.orchestra.run.smithi077.stdout:irqbalanc 709 716 gmain root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.036 INFO:teuthology.orchestra.run.smithi077.stdout:irqbalanc 709 716 gmain root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.036 INFO:teuthology.orchestra.run.smithi077.stdout:irqbalanc 709 716 gmain root txt REG 8,1 61904 10507 /usr/sbin/irqbalance 2023-11-04T01:48:17.037 INFO:teuthology.orchestra.run.smithi077.stdout:irqbalanc 709 716 gmain root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.037 INFO:teuthology.orchestra.run.smithi077.stdout:irqbalanc 709 716 gmain root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:48:17.037 INFO:teuthology.orchestra.run.smithi077.stdout:irqbalanc 709 716 gmain root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.037 INFO:teuthology.orchestra.run.smithi077.stdout:irqbalanc 709 716 gmain root DEL REG 8,1 9998 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:17.037 INFO:teuthology.orchestra.run.smithi077.stdout:irqbalanc 709 716 gmain root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:48:17.038 INFO:teuthology.orchestra.run.smithi077.stdout:irqbalanc 709 716 gmain root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:48:17.038 INFO:teuthology.orchestra.run.smithi077.stdout:irqbalanc 709 716 gmain root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.038 INFO:teuthology.orchestra.run.smithi077.stdout:irqbalanc 709 716 gmain root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.038 INFO:teuthology.orchestra.run.smithi077.stdout:irqbalanc 709 716 gmain root 1u unix 0xffff9ba9084aee80 0t0 22642 type=STREAM (CONNECTED) 2023-11-04T01:48:17.038 INFO:teuthology.orchestra.run.smithi077.stdout:irqbalanc 709 716 gmain root 2u unix 0xffff9ba9084aee80 0t0 22642 type=STREAM (CONNECTED) 2023-11-04T01:48:17.039 INFO:teuthology.orchestra.run.smithi077.stdout:irqbalanc 709 716 gmain root 3u a_inode 0,14 0 3100 [eventfd:1] 2023-11-04T01:48:17.039 INFO:teuthology.orchestra.run.smithi077.stdout:irqbalanc 709 716 gmain root 4u a_inode 0,14 0 3100 [eventfd:2] 2023-11-04T01:48:17.039 INFO:teuthology.orchestra.run.smithi077.stdout:irqbalanc 709 716 gmain root 5u unix 0xffff9ba9084afb40 0t0 22654 /run/irqbalance/irqbalance709.sock type=STREAM (LISTEN) 2023-11-04T01:48:17.039 INFO:teuthology.orchestra.run.smithi077.stdout:irqbalanc 709 716 gmain root 6u unix 0xffff9ba9084b1dc0 0t0 22823 type=DGRAM (CONNECTED) 2023-11-04T01:48:17.039 INFO:teuthology.orchestra.run.smithi077.stdout:lsmd 710 libstoragemgmt cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.040 INFO:teuthology.orchestra.run.smithi077.stdout:lsmd 710 libstoragemgmt rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.040 INFO:teuthology.orchestra.run.smithi077.stdout:lsmd 710 libstoragemgmt txt REG 8,1 32280 11292 /usr/bin/lsmd 2023-11-04T01:48:17.040 INFO:teuthology.orchestra.run.smithi077.stdout:lsmd 710 libstoragemgmt mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.040 INFO:teuthology.orchestra.run.smithi077.stdout:lsmd 710 libstoragemgmt mem REG 8,1 56912 10811 /usr/lib64/libconfig.so.11.0.2 2023-11-04T01:48:17.040 INFO:teuthology.orchestra.run.smithi077.stdout:lsmd 710 libstoragemgmt mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.040 INFO:teuthology.orchestra.run.smithi077.stdout:lsmd 710 libstoragemgmt 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.041 INFO:teuthology.orchestra.run.smithi077.stdout:lsmd 710 libstoragemgmt 1u unix 0xffff9ba900b3bb80 0t0 16841 type=STREAM (CONNECTED) 2023-11-04T01:48:17.041 INFO:teuthology.orchestra.run.smithi077.stdout:lsmd 710 libstoragemgmt 2u unix 0xffff9ba900b3bb80 0t0 16841 type=STREAM (CONNECTED) 2023-11-04T01:48:17.041 INFO:teuthology.orchestra.run.smithi077.stdout:lsmd 710 libstoragemgmt 3uW REG 0,24 0 1112 /run/lsm/ipc/.lsmd-ipc-lock 2023-11-04T01:48:17.041 INFO:teuthology.orchestra.run.smithi077.stdout:lsmd 710 libstoragemgmt 5u unix 0xffff9ba900b39dc0 0t0 16865 /var/run/lsm/ipc/simc type=STREAM (LISTEN) 2023-11-04T01:48:17.041 INFO:teuthology.orchestra.run.smithi077.stdout:lsmd 710 libstoragemgmt 6u unix 0xffff9ba900b3ea40 0t0 16869 /var/run/lsm/ipc/sim type=STREAM (LISTEN) 2023-11-04T01:48:17.042 INFO:teuthology.orchestra.run.smithi077.stdout:mcelog 711 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.042 INFO:teuthology.orchestra.run.smithi077.stdout:mcelog 711 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.042 INFO:teuthology.orchestra.run.smithi077.stdout:mcelog 711 root txt REG 8,1 194568 12461 /usr/sbin/mcelog 2023-11-04T01:48:17.042 INFO:teuthology.orchestra.run.smithi077.stdout:mcelog 711 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.042 INFO:teuthology.orchestra.run.smithi077.stdout:mcelog 711 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.043 INFO:teuthology.orchestra.run.smithi077.stdout:mcelog 711 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.043 INFO:teuthology.orchestra.run.smithi077.stdout:mcelog 711 root 1u unix 0xffff9ba900b3aec0 0t0 16844 type=STREAM (CONNECTED) 2023-11-04T01:48:17.043 INFO:teuthology.orchestra.run.smithi077.stdout:mcelog 711 root 2u unix 0xffff9ba900b3aec0 0t0 16844 type=STREAM (CONNECTED) 2023-11-04T01:48:17.043 INFO:teuthology.orchestra.run.smithi077.stdout:mcelog 711 root 3r CHR 10,227 0t0 142 /dev/mcelog 2023-11-04T01:48:17.043 INFO:teuthology.orchestra.run.smithi077.stdout:mcelog 711 root 4u unix 0xffff9ba900b3e1c0 0t0 16864 /var/run/mcelog-client type=STREAM (LISTEN) 2023-11-04T01:48:17.043 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.044 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.044 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:48:17.044 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.044 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.044 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:48:17.045 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.045 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:48:17.045 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.045 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.045 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.046 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:17.046 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:48:17.046 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:48:17.046 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:17.046 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:17.047 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:48:17.047 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:17.047 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.047 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:48:17.047 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.048 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:48:17.048 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.048 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:48:17.048 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:48:17.048 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:48:17.049 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:48:17.049 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:48:17.049 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:48:17.049 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.049 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.050 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.050 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.050 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd 3r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.050 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd 4u a_inode 0,14 0 3100 [eventfd:5] 2023-11-04T01:48:17.050 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd 5u a_inode 0,14 0 3100 [eventfd:6] 2023-11-04T01:48:17.051 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd 6u unix 0xffff9ba900b39980 0t0 16893 type=STREAM (CONNECTED) 2023-11-04T01:48:17.051 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd 7u a_inode 0,14 0 3100 [eventfd:7] 2023-11-04T01:48:17.051 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd 8r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.051 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd 9u a_inode 0,14 0 3100 [eventfd:10] 2023-11-04T01:48:17.051 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 polkitd 10u unix 0xffff9ba903822ec0 0t0 16894 type=DGRAM (CONNECTED) 2023-11-04T01:48:17.051 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.052 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.052 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:48:17.052 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.052 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.052 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:48:17.053 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.053 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:48:17.053 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.053 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.053 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.054 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:17.054 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:48:17.054 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:48:17.054 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:17.054 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:17.055 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:48:17.055 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:17.055 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.055 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:48:17.055 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.055 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:48:17.056 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.056 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:48:17.056 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:48:17.056 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:48:17.056 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:48:17.057 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:48:17.057 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:48:17.057 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.057 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.057 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.058 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.058 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd 3r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.058 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd 4u a_inode 0,14 0 3100 [eventfd:5] 2023-11-04T01:48:17.058 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd 5u a_inode 0,14 0 3100 [eventfd:6] 2023-11-04T01:48:17.059 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd 6u unix 0xffff9ba900b39980 0t0 16893 type=STREAM (CONNECTED) 2023-11-04T01:48:17.059 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd 7u a_inode 0,14 0 3100 [eventfd:7] 2023-11-04T01:48:17.059 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd 8r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.059 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd 9u a_inode 0,14 0 3100 [eventfd:10] 2023-11-04T01:48:17.059 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 725 gmain polkitd 10u unix 0xffff9ba903822ec0 0t0 16894 type=DGRAM (CONNECTED) 2023-11-04T01:48:17.059 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.060 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.060 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:48:17.060 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.060 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.060 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:48:17.061 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.061 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:48:17.061 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.061 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.061 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.062 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:17.062 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:48:17.062 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:48:17.062 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:17.062 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:17.063 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:48:17.063 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:17.063 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.063 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:48:17.063 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.064 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:48:17.064 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.064 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:48:17.064 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:48:17.064 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:48:17.064 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:48:17.065 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:48:17.065 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:48:17.065 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.065 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.065 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.066 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.066 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd 3r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.066 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd 4u a_inode 0,14 0 3100 [eventfd:5] 2023-11-04T01:48:17.066 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd 5u a_inode 0,14 0 3100 [eventfd:6] 2023-11-04T01:48:17.066 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd 6u unix 0xffff9ba900b39980 0t0 16893 type=STREAM (CONNECTED) 2023-11-04T01:48:17.066 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd 7u a_inode 0,14 0 3100 [eventfd:7] 2023-11-04T01:48:17.067 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd 8r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.067 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd 9u a_inode 0,14 0 3100 [eventfd:10] 2023-11-04T01:48:17.067 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 726 gdbus polkitd 10u unix 0xffff9ba903822ec0 0t0 16894 type=DGRAM (CONNECTED) 2023-11-04T01:48:17.067 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.067 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.068 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:48:17.068 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.068 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.068 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:48:17.068 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.069 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:48:17.069 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.069 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.069 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.069 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:17.070 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:48:17.070 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:48:17.070 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:17.070 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:17.070 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:48:17.071 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:17.071 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.071 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:48:17.071 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.071 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:48:17.072 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.072 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:48:17.072 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:48:17.072 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:48:17.072 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:48:17.073 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:48:17.073 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:48:17.073 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.073 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.073 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.074 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.074 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd 3r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.074 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd 4u a_inode 0,14 0 3100 [eventfd:5] 2023-11-04T01:48:17.074 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd 5u a_inode 0,14 0 3100 [eventfd:6] 2023-11-04T01:48:17.074 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd 6u unix 0xffff9ba900b39980 0t0 16893 type=STREAM (CONNECTED) 2023-11-04T01:48:17.075 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd 7u a_inode 0,14 0 3100 [eventfd:7] 2023-11-04T01:48:17.075 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd 8r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.075 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd 9u a_inode 0,14 0 3100 [eventfd:10] 2023-11-04T01:48:17.075 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 727 JS\x20Hel polkitd 10u unix 0xffff9ba903822ec0 0t0 16894 type=DGRAM (CONNECTED) 2023-11-04T01:48:17.075 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.075 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.076 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:48:17.076 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.076 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.076 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:48:17.076 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.077 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:48:17.077 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.077 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.077 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.077 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:17.078 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:48:17.078 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:48:17.078 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:17.078 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:17.078 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:48:17.079 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:17.079 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.079 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:48:17.079 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.079 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:48:17.080 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.080 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:48:17.080 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:48:17.080 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:48:17.080 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:48:17.080 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:48:17.081 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:48:17.081 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.081 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.081 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.081 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.082 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd 3r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.082 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd 4u a_inode 0,14 0 3100 [eventfd:5] 2023-11-04T01:48:17.082 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd 5u a_inode 0,14 0 3100 [eventfd:6] 2023-11-04T01:48:17.082 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd 6u unix 0xffff9ba900b39980 0t0 16893 type=STREAM (CONNECTED) 2023-11-04T01:48:17.082 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd 7u a_inode 0,14 0 3100 [eventfd:7] 2023-11-04T01:48:17.083 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd 8r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.083 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd 9u a_inode 0,14 0 3100 [eventfd:10] 2023-11-04T01:48:17.083 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 728 JS\x20Hel polkitd 10u unix 0xffff9ba903822ec0 0t0 16894 type=DGRAM (CONNECTED) 2023-11-04T01:48:17.083 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.083 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.084 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:48:17.084 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.084 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.084 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:48:17.084 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.085 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:48:17.085 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.085 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.085 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.085 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:17.085 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:48:17.086 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:48:17.086 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:17.086 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:17.086 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:48:17.086 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:17.087 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.087 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:48:17.087 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.087 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:48:17.087 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.088 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:48:17.088 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:48:17.088 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:48:17.088 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:48:17.088 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:48:17.089 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:48:17.089 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.089 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.089 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.089 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.089 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd 3r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.090 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd 4u a_inode 0,14 0 3100 [eventfd:5] 2023-11-04T01:48:17.090 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd 5u a_inode 0,14 0 3100 [eventfd:6] 2023-11-04T01:48:17.090 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd 6u unix 0xffff9ba900b39980 0t0 16893 type=STREAM (CONNECTED) 2023-11-04T01:48:17.090 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd 7u a_inode 0,14 0 3100 [eventfd:7] 2023-11-04T01:48:17.090 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd 8r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.091 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd 9u a_inode 0,14 0 3100 [eventfd:10] 2023-11-04T01:48:17.091 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 729 JS\x20Hel polkitd 10u unix 0xffff9ba903822ec0 0t0 16894 type=DGRAM (CONNECTED) 2023-11-04T01:48:17.091 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.091 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.091 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:48:17.092 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.092 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.092 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:48:17.092 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.092 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:48:17.093 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.093 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.093 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.093 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:17.093 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:48:17.094 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:48:17.094 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:17.094 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:17.094 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:48:17.094 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:17.095 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.095 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:48:17.095 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.095 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:48:17.095 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.096 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:48:17.096 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:48:17.096 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:48:17.096 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:48:17.096 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:48:17.096 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:48:17.097 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.097 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.097 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.097 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.097 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd 3r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.098 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd 4u a_inode 0,14 0 3100 [eventfd:5] 2023-11-04T01:48:17.098 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd 5u a_inode 0,14 0 3100 [eventfd:6] 2023-11-04T01:48:17.098 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd 6u unix 0xffff9ba900b39980 0t0 16893 type=STREAM (CONNECTED) 2023-11-04T01:48:17.098 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd 7u a_inode 0,14 0 3100 [eventfd:7] 2023-11-04T01:48:17.098 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd 8r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.099 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd 9u a_inode 0,14 0 3100 [eventfd:10] 2023-11-04T01:48:17.099 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 730 JS\x20Hel polkitd 10u unix 0xffff9ba903822ec0 0t0 16894 type=DGRAM (CONNECTED) 2023-11-04T01:48:17.099 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.099 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.099 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:48:17.100 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.100 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.100 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:48:17.100 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.100 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:48:17.100 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.101 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.101 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.101 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:17.101 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:48:17.101 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:48:17.101 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:17.102 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:17.102 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:48:17.102 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:17.102 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.102 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:48:17.103 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.103 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:48:17.103 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.103 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:48:17.103 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:48:17.104 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:48:17.104 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:48:17.104 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:48:17.104 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:48:17.104 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.104 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.105 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.105 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.105 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd 3r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.105 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd 4u a_inode 0,14 0 3100 [eventfd:5] 2023-11-04T01:48:17.105 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd 5u a_inode 0,14 0 3100 [eventfd:6] 2023-11-04T01:48:17.106 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd 6u unix 0xffff9ba900b39980 0t0 16893 type=STREAM (CONNECTED) 2023-11-04T01:48:17.106 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd 7u a_inode 0,14 0 3100 [eventfd:7] 2023-11-04T01:48:17.106 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd 8r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.106 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd 9u a_inode 0,14 0 3100 [eventfd:10] 2023-11-04T01:48:17.106 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 731 JS\x20Hel polkitd 10u unix 0xffff9ba903822ec0 0t0 16894 type=DGRAM (CONNECTED) 2023-11-04T01:48:17.107 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.107 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.107 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:48:17.107 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.107 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.108 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:48:17.108 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.108 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:48:17.108 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.108 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.109 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.109 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:17.109 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:48:17.109 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:48:17.109 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:17.109 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:17.110 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:48:17.110 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:17.110 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.110 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:48:17.110 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.111 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:48:17.111 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.111 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:48:17.111 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:48:17.111 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:48:17.112 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:48:17.112 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:48:17.112 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:48:17.112 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.112 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.113 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.113 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.113 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd 3r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.113 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd 4u a_inode 0,14 0 3100 [eventfd:5] 2023-11-04T01:48:17.113 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd 5u a_inode 0,14 0 3100 [eventfd:6] 2023-11-04T01:48:17.113 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd 6u unix 0xffff9ba900b39980 0t0 16893 type=STREAM (CONNECTED) 2023-11-04T01:48:17.114 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd 7u a_inode 0,14 0 3100 [eventfd:7] 2023-11-04T01:48:17.114 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd 8r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.114 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd 9u a_inode 0,14 0 3100 [eventfd:10] 2023-11-04T01:48:17.114 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 732 JS\x20Hel polkitd 10u unix 0xffff9ba903822ec0 0t0 16894 type=DGRAM (CONNECTED) 2023-11-04T01:48:17.114 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.115 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.115 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:48:17.115 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.115 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.115 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:48:17.116 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.116 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:48:17.116 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.116 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.116 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.116 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:17.117 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:48:17.117 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:48:17.117 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:17.117 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:17.117 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:48:17.118 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:17.118 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.118 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:48:17.118 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.118 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:48:17.119 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.119 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:48:17.119 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:48:17.119 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:48:17.119 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:48:17.119 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:48:17.120 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:48:17.120 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.120 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.120 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.120 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.121 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd 3r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.121 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd 4u a_inode 0,14 0 3100 [eventfd:5] 2023-11-04T01:48:17.121 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd 5u a_inode 0,14 0 3100 [eventfd:6] 2023-11-04T01:48:17.121 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd 6u unix 0xffff9ba900b39980 0t0 16893 type=STREAM (CONNECTED) 2023-11-04T01:48:17.121 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd 7u a_inode 0,14 0 3100 [eventfd:7] 2023-11-04T01:48:17.121 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd 8r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.122 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd 9u a_inode 0,14 0 3100 [eventfd:10] 2023-11-04T01:48:17.122 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 733 JS\x20Hel polkitd 10u unix 0xffff9ba903822ec0 0t0 16894 type=DGRAM (CONNECTED) 2023-11-04T01:48:17.122 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.122 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.122 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:48:17.123 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.123 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.123 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:48:17.123 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.123 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:48:17.123 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.124 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.124 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.124 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:17.124 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:48:17.124 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:48:17.125 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:17.125 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:17.125 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:48:17.125 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:17.125 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.126 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:48:17.126 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.126 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:48:17.126 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.126 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:48:17.126 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:48:17.127 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:48:17.127 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:48:17.127 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:48:17.127 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:48:17.127 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.128 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.128 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.128 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.128 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd 3r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.128 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd 4u a_inode 0,14 0 3100 [eventfd:5] 2023-11-04T01:48:17.129 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd 5u a_inode 0,14 0 3100 [eventfd:6] 2023-11-04T01:48:17.129 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd 6u unix 0xffff9ba900b39980 0t0 16893 type=STREAM (CONNECTED) 2023-11-04T01:48:17.129 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd 7u a_inode 0,14 0 3100 [eventfd:7] 2023-11-04T01:48:17.129 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd 8r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.129 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd 9u a_inode 0,14 0 3100 [eventfd:10] 2023-11-04T01:48:17.130 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 734 JS\x20Hel polkitd 10u unix 0xffff9ba903822ec0 0t0 16894 type=DGRAM (CONNECTED) 2023-11-04T01:48:17.130 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.130 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.130 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-11-04T01:48:17.131 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.131 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.131 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:48:17.131 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.131 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:48:17.132 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.132 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.132 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.132 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:17.132 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:48:17.133 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-11-04T01:48:17.133 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:17.133 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:17.133 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:48:17.133 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:17.134 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.134 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:48:17.134 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.134 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:48:17.134 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.135 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:48:17.135 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:48:17.135 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:48:17.135 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:48:17.135 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:48:17.135 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:48:17.136 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.136 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.136 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.136 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.136 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd 3r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.137 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd 4u a_inode 0,14 0 3100 [eventfd:5] 2023-11-04T01:48:17.137 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd 5u a_inode 0,14 0 3100 [eventfd:6] 2023-11-04T01:48:17.137 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd 6u unix 0xffff9ba900b39980 0t0 16893 type=STREAM (CONNECTED) 2023-11-04T01:48:17.137 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd 7u a_inode 0,14 0 3100 [eventfd:7] 2023-11-04T01:48:17.137 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd 8r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.138 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd 9u a_inode 0,14 0 3100 [eventfd:10] 2023-11-04T01:48:17.138 INFO:teuthology.orchestra.run.smithi077.stdout:polkitd 712 738 polkitd polkitd 10u unix 0xffff9ba903822ec0 0t0 16894 type=DGRAM (CONNECTED) 2023-11-04T01:48:17.138 INFO:teuthology.orchestra.run.smithi077.stdout:smartd 713 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.138 INFO:teuthology.orchestra.run.smithi077.stdout:smartd 713 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.138 INFO:teuthology.orchestra.run.smithi077.stdout:smartd 713 root txt REG 8,1 622048 12498 /usr/sbin/smartd 2023-11-04T01:48:17.139 INFO:teuthology.orchestra.run.smithi077.stdout:smartd 713 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:48:17.139 INFO:teuthology.orchestra.run.smithi077.stdout:smartd 713 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.139 INFO:teuthology.orchestra.run.smithi077.stdout:smartd 713 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.139 INFO:teuthology.orchestra.run.smithi077.stdout:smartd 713 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:48:17.139 INFO:teuthology.orchestra.run.smithi077.stdout:smartd 713 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.140 INFO:teuthology.orchestra.run.smithi077.stdout:smartd 713 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:48:17.140 INFO:teuthology.orchestra.run.smithi077.stdout:smartd 713 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.140 INFO:teuthology.orchestra.run.smithi077.stdout:smartd 713 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:17.140 INFO:teuthology.orchestra.run.smithi077.stdout:smartd 713 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:17.140 INFO:teuthology.orchestra.run.smithi077.stdout:smartd 713 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.140 INFO:teuthology.orchestra.run.smithi077.stdout:smartd 713 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.141 INFO:teuthology.orchestra.run.smithi077.stdout:smartd 713 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.141 INFO:teuthology.orchestra.run.smithi077.stdout:smartd 713 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:48:17.141 INFO:teuthology.orchestra.run.smithi077.stdout:smartd 713 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:48:17.141 INFO:teuthology.orchestra.run.smithi077.stdout:smartd 713 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.141 INFO:teuthology.orchestra.run.smithi077.stdout:smartd 713 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.142 INFO:teuthology.orchestra.run.smithi077.stdout:smartd 713 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.142 INFO:teuthology.orchestra.run.smithi077.stdout:smartd 713 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.142 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.142 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.142 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root txt REG 8,1 306896 20362 /usr/lib/systemd/systemd-logind 2023-11-04T01:48:17.143 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root DEL REG 8,1 1168 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-11-04T01:48:17.143 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root DEL REG 8,1 1143 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-11-04T01:48:17.143 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:48:17.143 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:48:17.143 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.144 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:48:17.144 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:48:17.144 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:17.144 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.144 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:48:17.145 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.145 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:48:17.145 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.145 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-11-04T01:48:17.145 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:17.146 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.146 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-04T01:48:17.146 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:48:17.146 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:48:17.146 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.147 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:48:17.147 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.147 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-11-04T01:48:17.147 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:48:17.147 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.147 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-11-04T01:48:17.148 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:17.148 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.148 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root DEL REG 8,1 9806 /usr/lib64/libacl.so.1.1.2301 2023-11-04T01:48:17.148 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.149 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.149 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-04T01:48:17.149 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.149 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root 1u unix 0xffff9ba9201ba640 0t0 21629 type=STREAM (CONNECTED) 2023-11-04T01:48:17.149 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root 2u unix 0xffff9ba9201ba640 0t0 21629 type=STREAM (CONNECTED) 2023-11-04T01:48:17.149 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root 3u unix 0xffff9ba92012d940 0t0 21660 type=DGRAM (CONNECTED) 2023-11-04T01:48:17.150 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root 4u a_inode 0,14 0 3100 [eventpoll:5,6,7,8,9,10,11,12,13,14,15,16,17,18,20] 2023-11-04T01:48:17.150 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root 5u a_inode 0,14 0 3100 [signalfd] 2023-11-04T01:48:17.150 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root 6u a_inode 0,14 0 3100 [timerfd] 2023-11-04T01:48:17.150 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root 7r REG 0,21 4096 22919 /sys/devices/virtual/tty/tty0/active 2023-11-04T01:48:17.150 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root 8u netlink 0t0 21671 KOBJECT_UEVENT 2023-11-04T01:48:17.151 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root 9r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.151 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root 10r FIFO 0,24 0t0 1159 /run/systemd/inhibit/1.ref 2023-11-04T01:48:17.151 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root 11u netlink 0t0 21672 KOBJECT_UEVENT 2023-11-04T01:48:17.151 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root 12u netlink 0t0 21673 KOBJECT_UEVENT 2023-11-04T01:48:17.151 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root 13u netlink 0t0 21674 KOBJECT_UEVENT 2023-11-04T01:48:17.152 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root 14u unix 0xffff9ba9201b8440 0t0 21675 type=STREAM (CONNECTED) 2023-11-04T01:48:17.152 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root 15u a_inode 0,14 0 3100 [timerfd] 2023-11-04T01:48:17.152 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root 16u CHR 13,65 0t0 138 /dev/input/event1 2023-11-04T01:48:17.152 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root 17u CHR 13,64 0t0 137 /dev/input/event0 2023-11-04T01:48:17.152 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root 18u CHR 13,66 0t0 148 /dev/input/event2 2023-11-04T01:48:17.152 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root 19u CHR 4,6 0t0 25 /dev/tty6 2023-11-04T01:48:17.153 INFO:teuthology.orchestra.run.smithi077.stdout:systemd-l 715 root 20r FIFO 0,24 0t0 1611 /run/systemd/sessions/4.ref 2023-11-04T01:48:17.153 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 768 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.153 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 768 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.153 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 768 root txt REG 8,1 968800 13744 /usr/sbin/sshd 2023-11-04T01:48:17.153 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 768 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:48:17.154 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 768 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.154 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 768 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.154 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 768 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.154 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 768 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.154 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 768 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.155 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 768 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:48:17.155 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 768 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:48:17.155 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 768 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.155 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 768 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.155 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 768 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.155 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 768 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:17.156 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 768 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:17.156 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 768 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:48:17.156 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 768 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:48:17.156 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 768 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.156 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 768 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.157 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 768 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.157 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 768 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.157 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 768 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.157 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 768 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.157 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 768 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.158 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 768 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.158 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 768 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:48:17.158 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 768 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:48:17.158 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 768 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:48:17.159 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 768 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.159 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 768 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.159 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 768 root 1u unix 0xffff9ba908673fc0 0t0 19745 type=STREAM (CONNECTED) 2023-11-04T01:48:17.159 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 768 root 2u unix 0xffff9ba908673fc0 0t0 19745 type=STREAM (CONNECTED) 2023-11-04T01:48:17.159 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 768 root 3u IPv4 396 0t0 TCP *:ssh (LISTEN) 2023-11-04T01:48:17.159 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 768 root 4u IPv6 398 0t0 TCP *:ssh (LISTEN) 2023-11-04T01:48:17.160 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.160 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.160 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:48:17.160 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:17.160 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.161 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.161 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 204696 37013 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-11-04T01:48:17.161 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.161 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.161 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.162 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:48:17.162 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:48:17.162 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:48:17.162 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:17.162 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:48:17.162 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 143200 10195 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-11-04T01:48:17.163 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 357112 39324 /usr/lib64/python3.9/site-packages/gi/_gi.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.163 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:48:17.163 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:48:17.163 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:48:17.163 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.164 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:48:17.164 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.164 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.164 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:48:17.164 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:48:17.164 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:17.165 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:48:17.165 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-11-04T01:48:17.165 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.165 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 24736 39204 /usr/lib64/python3.9/site-packages/_dbus_glib_bindings.so 2023-11-04T01:48:17.165 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 171376 39203 /usr/lib64/python3.9/site-packages/_dbus_bindings.so 2023-11-04T01:48:17.165 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.166 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:17.166 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.166 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:48:17.166 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.166 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.167 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.167 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.167 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.167 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.167 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.168 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.168 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.168 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.168 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.168 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.169 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.169 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.169 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.169 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.169 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:17.170 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.170 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:48:17.170 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.170 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.170 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:17.171 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.171 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.171 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.171 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root 1u unix 0xffff9ba9201eea40 0t0 17922 type=STREAM (CONNECTED) 2023-11-04T01:48:17.171 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root 2u unix 0xffff9ba9201eea40 0t0 17922 type=STREAM (CONNECTED) 2023-11-04T01:48:17.172 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root 3w REG 8,1 10371 1216 /var/log/tuned/tuned.log 2023-11-04T01:48:17.172 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root 4u sock 0,8 0t0 21767 protocol: NETLINK 2023-11-04T01:48:17.172 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root 5u unix 0xffff9ba9201b9980 0t0 21771 type=STREAM (CONNECTED) 2023-11-04T01:48:17.172 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root 6u a_inode 0,14 0 3100 [eventfd:17] 2023-11-04T01:48:17.172 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root 7u unix 0xffff9ba9084ae600 0t0 22719 type=STREAM (CONNECTED) 2023-11-04T01:48:17.173 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 root 8u unix 0xffff9ba9084a8000 0t0 22720 type=STREAM (CONNECTED) 2023-11-04T01:48:17.173 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.173 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.173 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:48:17.174 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:17.174 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.174 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.174 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 204696 37013 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-11-04T01:48:17.174 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.175 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.175 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.175 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:48:17.175 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-11-04T01:48:17.175 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-11-04T01:48:17.176 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:17.176 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-11-04T01:48:17.176 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 143200 10195 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-11-04T01:48:17.176 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 357112 39324 /usr/lib64/python3.9/site-packages/gi/_gi.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.176 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-11-04T01:48:17.177 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-11-04T01:48:17.177 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:48:17.177 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.177 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:48:17.177 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.178 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.178 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:48:17.178 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:48:17.178 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:17.179 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:48:17.179 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-11-04T01:48:17.179 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.179 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 24736 39204 /usr/lib64/python3.9/site-packages/_dbus_glib_bindings.so 2023-11-04T01:48:17.179 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 171376 39203 /usr/lib64/python3.9/site-packages/_dbus_bindings.so 2023-11-04T01:48:17.180 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.180 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:17.180 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.180 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:48:17.181 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.181 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.181 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.181 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.181 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.181 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.182 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.182 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.182 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.182 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.182 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.183 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.183 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.183 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.183 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.183 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.183 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:17.184 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.184 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:48:17.184 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.184 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.184 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:17.184 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.185 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.185 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.185 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root 1u unix 0xffff9ba9201eea40 0t0 17922 type=STREAM (CONNECTED) 2023-11-04T01:48:17.185 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root 2u unix 0xffff9ba9201eea40 0t0 17922 type=STREAM (CONNECTED) 2023-11-04T01:48:17.185 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root 3w REG 8,1 10371 1216 /var/log/tuned/tuned.log 2023-11-04T01:48:17.186 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root 4u sock 0,8 0t0 21767 protocol: NETLINK 2023-11-04T01:48:17.186 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root 5u unix 0xffff9ba9201b9980 0t0 21771 type=STREAM (CONNECTED) 2023-11-04T01:48:17.186 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root 6u a_inode 0,14 0 3100 [eventfd:17] 2023-11-04T01:48:17.186 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root 7u unix 0xffff9ba9084ae600 0t0 22719 type=STREAM (CONNECTED) 2023-11-04T01:48:17.186 INFO:teuthology.orchestra.run.smithi077.stdout:tuned 769 854 tuned root 8u unix 0xffff9ba9084a8000 0t0 22720 type=STREAM (CONNECTED) 2023-11-04T01:48:17.187 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.187 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.187 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-11-04T01:48:17.187 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:48:17.187 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.188 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.188 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.188 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-11-04T01:48:17.188 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-11-04T01:48:17.188 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:17.189 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:48:17.189 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:48:17.189 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:48:17.189 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:17.189 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.189 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.190 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-11-04T01:48:17.190 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-11-04T01:48:17.190 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-11-04T01:48:17.190 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.190 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.191 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.191 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.191 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.191 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-11-04T01:48:17.191 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.192 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-11-04T01:48:17.192 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-11-04T01:48:17.192 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-11-04T01:48:17.192 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.192 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.192 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-11-04T01:48:17.193 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:48:17.193 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:48:17.193 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:48:17.193 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:48:17.193 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:48:17.193 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:48:17.194 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.194 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:48:17.194 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.194 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root 1u unix 0xffff9ba9084a9540 0t0 22672 type=STREAM (CONNECTED) 2023-11-04T01:48:17.194 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root 2u unix 0xffff9ba9084a9540 0t0 22672 type=STREAM (CONNECTED) 2023-11-04T01:48:17.195 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root 3u unix 0xffff9ba9084261c0 0t0 19091 type=DGRAM (CONNECTED) 2023-11-04T01:48:17.195 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root 4r FIFO 0,13 0t0 19096 pipe 2023-11-04T01:48:17.195 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root 5u a_inode 0,14 0 3100 [eventpoll:4,6,7,8] 2023-11-04T01:48:17.195 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root 6u a_inode 0,14 0 3100 [eventfd:16] 2023-11-04T01:48:17.195 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root 7u unix 0xffff9ba920036600 0t0 19092 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-11-04T01:48:17.196 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root 8u unix 0xffff9ba920037700 0t0 19093 /run/gssproxy.sock type=STREAM (LISTEN) 2023-11-04T01:48:17.196 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 root 9w FIFO 0,13 0t0 19096 pipe 2023-11-04T01:48:17.196 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.196 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.196 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-11-04T01:48:17.196 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:48:17.197 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.197 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.197 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.197 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-11-04T01:48:17.197 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-11-04T01:48:17.198 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:17.198 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:48:17.198 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:48:17.198 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:48:17.198 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:17.199 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.199 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.199 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-11-04T01:48:17.199 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-11-04T01:48:17.199 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-11-04T01:48:17.200 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.200 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.200 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.200 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.200 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.201 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-11-04T01:48:17.201 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.201 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-11-04T01:48:17.201 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-11-04T01:48:17.201 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-11-04T01:48:17.202 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.202 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.202 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-11-04T01:48:17.202 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:48:17.202 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:48:17.203 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:48:17.203 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:48:17.203 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:48:17.203 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:48:17.203 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.204 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:48:17.204 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.204 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root 1u unix 0xffff9ba9084a9540 0t0 22672 type=STREAM (CONNECTED) 2023-11-04T01:48:17.204 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root 2u unix 0xffff9ba9084a9540 0t0 22672 type=STREAM (CONNECTED) 2023-11-04T01:48:17.204 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root 3u unix 0xffff9ba9084261c0 0t0 19091 type=DGRAM (CONNECTED) 2023-11-04T01:48:17.205 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root 4r FIFO 0,13 0t0 19096 pipe 2023-11-04T01:48:17.205 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root 5u a_inode 0,14 0 3100 [eventpoll:4,6,7,8] 2023-11-04T01:48:17.205 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root 6u a_inode 0,14 0 3100 [eventfd:16] 2023-11-04T01:48:17.205 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root 7u unix 0xffff9ba920036600 0t0 19092 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-11-04T01:48:17.205 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root 8u unix 0xffff9ba920037700 0t0 19093 /run/gssproxy.sock type=STREAM (LISTEN) 2023-11-04T01:48:17.206 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 774 gssproxy root 9w FIFO 0,13 0t0 19096 pipe 2023-11-04T01:48:17.206 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.206 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.206 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-11-04T01:48:17.206 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:48:17.207 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.207 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.207 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.207 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-11-04T01:48:17.207 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-11-04T01:48:17.208 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:17.208 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:48:17.208 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:48:17.208 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:48:17.208 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:17.208 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.209 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.209 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-11-04T01:48:17.209 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-11-04T01:48:17.209 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-11-04T01:48:17.209 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.210 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.210 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.210 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.210 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.210 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-11-04T01:48:17.211 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.211 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-11-04T01:48:17.211 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-11-04T01:48:17.211 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-11-04T01:48:17.211 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.212 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.212 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-11-04T01:48:17.212 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:48:17.212 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:48:17.212 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:48:17.212 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:48:17.213 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:48:17.213 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:48:17.213 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.213 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:48:17.213 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.213 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root 1u unix 0xffff9ba9084a9540 0t0 22672 type=STREAM (CONNECTED) 2023-11-04T01:48:17.214 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root 2u unix 0xffff9ba9084a9540 0t0 22672 type=STREAM (CONNECTED) 2023-11-04T01:48:17.214 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root 3u unix 0xffff9ba9084261c0 0t0 19091 type=DGRAM (CONNECTED) 2023-11-04T01:48:17.214 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root 4r FIFO 0,13 0t0 19096 pipe 2023-11-04T01:48:17.214 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root 5u a_inode 0,14 0 3100 [eventpoll:4,6,7,8] 2023-11-04T01:48:17.214 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root 6u a_inode 0,14 0 3100 [eventfd:16] 2023-11-04T01:48:17.215 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root 7u unix 0xffff9ba920036600 0t0 19092 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-11-04T01:48:17.215 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root 8u unix 0xffff9ba920037700 0t0 19093 /run/gssproxy.sock type=STREAM (LISTEN) 2023-11-04T01:48:17.215 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 775 gssproxy root 9w FIFO 0,13 0t0 19096 pipe 2023-11-04T01:48:17.215 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.215 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.216 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-11-04T01:48:17.216 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:48:17.216 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.216 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.216 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.216 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-11-04T01:48:17.217 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-11-04T01:48:17.217 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:17.217 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:48:17.217 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:48:17.217 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:48:17.218 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:17.218 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.218 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.218 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-11-04T01:48:17.218 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-11-04T01:48:17.218 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-11-04T01:48:17.219 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.219 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.219 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.219 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.219 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.220 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-11-04T01:48:17.220 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.220 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-11-04T01:48:17.220 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-11-04T01:48:17.220 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-11-04T01:48:17.220 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.221 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.221 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-11-04T01:48:17.221 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:48:17.221 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:48:17.221 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:48:17.222 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:48:17.222 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:48:17.222 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:48:17.222 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.222 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:48:17.223 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.223 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root 1u unix 0xffff9ba9084a9540 0t0 22672 type=STREAM (CONNECTED) 2023-11-04T01:48:17.223 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root 2u unix 0xffff9ba9084a9540 0t0 22672 type=STREAM (CONNECTED) 2023-11-04T01:48:17.223 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root 3u unix 0xffff9ba9084261c0 0t0 19091 type=DGRAM (CONNECTED) 2023-11-04T01:48:17.223 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root 4r FIFO 0,13 0t0 19096 pipe 2023-11-04T01:48:17.224 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root 5u a_inode 0,14 0 3100 [eventpoll:4,6,7,8] 2023-11-04T01:48:17.224 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root 6u a_inode 0,14 0 3100 [eventfd:16] 2023-11-04T01:48:17.224 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root 7u unix 0xffff9ba920036600 0t0 19092 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-11-04T01:48:17.224 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root 8u unix 0xffff9ba920037700 0t0 19093 /run/gssproxy.sock type=STREAM (LISTEN) 2023-11-04T01:48:17.224 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 776 gssproxy root 9w FIFO 0,13 0t0 19096 pipe 2023-11-04T01:48:17.224 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.225 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.225 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-11-04T01:48:17.225 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:48:17.225 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.225 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.225 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.226 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-11-04T01:48:17.226 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-11-04T01:48:17.226 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:17.226 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:48:17.226 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:48:17.227 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:48:17.227 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:17.227 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.227 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.227 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-11-04T01:48:17.227 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-11-04T01:48:17.228 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-11-04T01:48:17.228 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.228 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.228 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.228 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.229 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.229 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-11-04T01:48:17.229 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.229 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-11-04T01:48:17.229 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-11-04T01:48:17.230 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-11-04T01:48:17.230 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.230 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.230 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-11-04T01:48:17.230 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:48:17.230 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:48:17.231 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:48:17.231 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:48:17.231 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:48:17.231 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:48:17.231 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.231 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:48:17.232 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.232 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root 1u unix 0xffff9ba9084a9540 0t0 22672 type=STREAM (CONNECTED) 2023-11-04T01:48:17.232 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root 2u unix 0xffff9ba9084a9540 0t0 22672 type=STREAM (CONNECTED) 2023-11-04T01:48:17.232 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root 3u unix 0xffff9ba9084261c0 0t0 19091 type=DGRAM (CONNECTED) 2023-11-04T01:48:17.232 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root 4r FIFO 0,13 0t0 19096 pipe 2023-11-04T01:48:17.232 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root 5u a_inode 0,14 0 3100 [eventpoll:4,6,7,8] 2023-11-04T01:48:17.233 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root 6u a_inode 0,14 0 3100 [eventfd:16] 2023-11-04T01:48:17.233 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root 7u unix 0xffff9ba920036600 0t0 19092 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-11-04T01:48:17.233 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root 8u unix 0xffff9ba920037700 0t0 19093 /run/gssproxy.sock type=STREAM (LISTEN) 2023-11-04T01:48:17.233 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 777 gssproxy root 9w FIFO 0,13 0t0 19096 pipe 2023-11-04T01:48:17.233 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.234 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.234 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-11-04T01:48:17.234 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:48:17.234 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.234 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.234 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.235 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-11-04T01:48:17.235 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-11-04T01:48:17.235 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:17.235 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:48:17.235 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:48:17.236 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:48:17.236 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:17.236 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.236 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.236 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-11-04T01:48:17.236 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-11-04T01:48:17.237 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-11-04T01:48:17.237 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.237 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.237 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.237 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.238 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.238 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-11-04T01:48:17.238 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.238 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-11-04T01:48:17.238 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-11-04T01:48:17.239 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-11-04T01:48:17.239 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.239 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.239 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-11-04T01:48:17.239 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:48:17.240 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:48:17.240 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:48:17.240 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:48:17.240 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:48:17.240 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:48:17.240 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.241 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:48:17.241 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.241 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root 1u unix 0xffff9ba9084a9540 0t0 22672 type=STREAM (CONNECTED) 2023-11-04T01:48:17.241 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root 2u unix 0xffff9ba9084a9540 0t0 22672 type=STREAM (CONNECTED) 2023-11-04T01:48:17.241 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root 3u unix 0xffff9ba9084261c0 0t0 19091 type=DGRAM (CONNECTED) 2023-11-04T01:48:17.242 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root 4r FIFO 0,13 0t0 19096 pipe 2023-11-04T01:48:17.242 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root 5u a_inode 0,14 0 3100 [eventpoll:4,6,7,8] 2023-11-04T01:48:17.242 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root 6u a_inode 0,14 0 3100 [eventfd:16] 2023-11-04T01:48:17.242 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root 7u unix 0xffff9ba920036600 0t0 19092 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-11-04T01:48:17.242 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root 8u unix 0xffff9ba920037700 0t0 19093 /run/gssproxy.sock type=STREAM (LISTEN) 2023-11-04T01:48:17.242 INFO:teuthology.orchestra.run.smithi077.stdout:gssproxy 773 778 gssproxy root 9w FIFO 0,13 0t0 19096 pipe 2023-11-04T01:48:17.243 INFO:teuthology.orchestra.run.smithi077.stdout:atd 780 root cwd DIR 8,1 4096 1657 /var/spool/at 2023-11-04T01:48:17.243 INFO:teuthology.orchestra.run.smithi077.stdout:atd 780 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.243 INFO:teuthology.orchestra.run.smithi077.stdout:atd 780 root txt REG 8,1 32680 12473 /usr/sbin/atd 2023-11-04T01:48:17.243 INFO:teuthology.orchestra.run.smithi077.stdout:atd 780 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.243 INFO:teuthology.orchestra.run.smithi077.stdout:atd 780 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.244 INFO:teuthology.orchestra.run.smithi077.stdout:atd 780 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.244 INFO:teuthology.orchestra.run.smithi077.stdout:atd 780 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:48:17.244 INFO:teuthology.orchestra.run.smithi077.stdout:atd 780 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:48:17.244 INFO:teuthology.orchestra.run.smithi077.stdout:atd 780 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:48:17.244 INFO:teuthology.orchestra.run.smithi077.stdout:atd 780 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.245 INFO:teuthology.orchestra.run.smithi077.stdout:atd 780 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:48:17.245 INFO:teuthology.orchestra.run.smithi077.stdout:atd 780 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.245 INFO:teuthology.orchestra.run.smithi077.stdout:atd 780 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.245 INFO:teuthology.orchestra.run.smithi077.stdout:atd 780 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.245 INFO:teuthology.orchestra.run.smithi077.stdout:atd 780 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.245 INFO:teuthology.orchestra.run.smithi077.stdout:atd 780 root 3uW REG 0,24 4 1181 /run/atd.pid 2023-11-04T01:48:17.246 INFO:teuthology.orchestra.run.smithi077.stdout:crond 781 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.246 INFO:teuthology.orchestra.run.smithi077.stdout:crond 781 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.246 INFO:teuthology.orchestra.run.smithi077.stdout:crond 781 root txt REG 8,1 74552 11234 /usr/sbin/crond 2023-11-04T01:48:17.246 INFO:teuthology.orchestra.run.smithi077.stdout:crond 781 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:48:17.246 INFO:teuthology.orchestra.run.smithi077.stdout:crond 781 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:17.247 INFO:teuthology.orchestra.run.smithi077.stdout:crond 781 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.247 INFO:teuthology.orchestra.run.smithi077.stdout:crond 781 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:48:17.247 INFO:teuthology.orchestra.run.smithi077.stdout:crond 781 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:48:17.247 INFO:teuthology.orchestra.run.smithi077.stdout:crond 781 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:48:17.247 INFO:teuthology.orchestra.run.smithi077.stdout:crond 781 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:17.248 INFO:teuthology.orchestra.run.smithi077.stdout:crond 781 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:48:17.248 INFO:teuthology.orchestra.run.smithi077.stdout:crond 781 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.248 INFO:teuthology.orchestra.run.smithi077.stdout:crond 781 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:48:17.248 INFO:teuthology.orchestra.run.smithi077.stdout:crond 781 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.248 INFO:teuthology.orchestra.run.smithi077.stdout:crond 781 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:48:17.249 INFO:teuthology.orchestra.run.smithi077.stdout:crond 781 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:48:17.249 INFO:teuthology.orchestra.run.smithi077.stdout:crond 781 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.249 INFO:teuthology.orchestra.run.smithi077.stdout:crond 781 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:48:17.249 INFO:teuthology.orchestra.run.smithi077.stdout:crond 781 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:48:17.249 INFO:teuthology.orchestra.run.smithi077.stdout:crond 781 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:48:17.249 INFO:teuthology.orchestra.run.smithi077.stdout:crond 781 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:48:17.250 INFO:teuthology.orchestra.run.smithi077.stdout:crond 781 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:48:17.250 INFO:teuthology.orchestra.run.smithi077.stdout:crond 781 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:48:17.250 INFO:teuthology.orchestra.run.smithi077.stdout:crond 781 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.250 INFO:teuthology.orchestra.run.smithi077.stdout:crond 781 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:48:17.250 INFO:teuthology.orchestra.run.smithi077.stdout:crond 781 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.251 INFO:teuthology.orchestra.run.smithi077.stdout:crond 781 root 1u unix 0xffff9ba920034840 0t0 19104 type=STREAM (CONNECTED) 2023-11-04T01:48:17.251 INFO:teuthology.orchestra.run.smithi077.stdout:crond 781 root 2u unix 0xffff9ba920034840 0t0 19104 type=STREAM (CONNECTED) 2023-11-04T01:48:17.251 INFO:teuthology.orchestra.run.smithi077.stdout:crond 781 root 3uW REG 0,24 4 1180 /run/crond.pid 2023-11-04T01:48:17.251 INFO:teuthology.orchestra.run.smithi077.stdout:crond 781 root 4u unix 0xffff9ba908425d80 0t0 19107 type=DGRAM (CONNECTED) 2023-11-04T01:48:17.251 INFO:teuthology.orchestra.run.smithi077.stdout:crond 781 root 5r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.251 INFO:teuthology.orchestra.run.smithi077.stdout:nrpe 874 nrpe cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.252 INFO:teuthology.orchestra.run.smithi077.stdout:nrpe 874 nrpe rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.252 INFO:teuthology.orchestra.run.smithi077.stdout:nrpe 874 nrpe txt REG 8,1 80984 12959 /usr/sbin/nrpe 2023-11-04T01:48:17.252 INFO:teuthology.orchestra.run.smithi077.stdout:nrpe 874 nrpe mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.252 INFO:teuthology.orchestra.run.smithi077.stdout:nrpe 874 nrpe mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.252 INFO:teuthology.orchestra.run.smithi077.stdout:nrpe 874 nrpe mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.253 INFO:teuthology.orchestra.run.smithi077.stdout:nrpe 874 nrpe mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:17.253 INFO:teuthology.orchestra.run.smithi077.stdout:nrpe 874 nrpe mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.253 INFO:teuthology.orchestra.run.smithi077.stdout:nrpe 874 nrpe 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.253 INFO:teuthology.orchestra.run.smithi077.stdout:nrpe 874 nrpe 1w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.253 INFO:teuthology.orchestra.run.smithi077.stdout:nrpe 874 nrpe 2w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.253 INFO:teuthology.orchestra.run.smithi077.stdout:nrpe 874 nrpe 3u IPv4 19795 0t0 TCP *:nrpe (LISTEN) 2023-11-04T01:48:17.254 INFO:teuthology.orchestra.run.smithi077.stdout:nrpe 874 nrpe 4u unix 0xffff9ba908680cc0 0t0 19787 type=DGRAM (CONNECTED) 2023-11-04T01:48:17.254 INFO:teuthology.orchestra.run.smithi077.stdout:nrpe 874 nrpe 5u IPv6 19796 0t0 TCP *:nrpe (LISTEN) 2023-11-04T01:48:17.254 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.254 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.254 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu txt REG 8,1 102120 20353 /usr/lib/systemd/systemd 2023-11-04T01:48:17.255 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.255 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.255 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:48:17.255 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.255 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu DEL REG 8,1 63926 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-11-04T01:48:17.256 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:48:17.256 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.256 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:17.256 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:48:17.256 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-11-04T01:48:17.257 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.257 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:17.257 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.257 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:48:17.257 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-11-04T01:48:17.258 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:48:17.258 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:48:17.258 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.258 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:17.258 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.259 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu mem REG 8,1 2174088 49251 /usr/lib64/systemd/libsystemd-core-252.so 2023-11-04T01:48:17.259 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu DEL REG 8,1 9806 /usr/lib64/libacl.so.1.1.2301 2023-11-04T01:48:17.259 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:48:17.259 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.259 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-11-04T01:48:17.259 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:48:17.260 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:48:17.260 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-04T01:48:17.260 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.260 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu DEL REG 8,1 63928 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-11-04T01:48:17.260 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.261 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-04T01:48:17.261 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.261 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu 1u unix 0xffff9ba920033740 0t0 19176 type=STREAM (CONNECTED) 2023-11-04T01:48:17.261 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu 2u unix 0xffff9ba920033740 0t0 19176 type=STREAM (CONNECTED) 2023-11-04T01:48:17.261 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu 3u unix 0xffff9ba90bb07700 0t0 18061 type=DGRAM (CONNECTED) 2023-11-04T01:48:17.262 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu 4u a_inode 0,14 0 3100 [eventpoll:5,6,8,9,11,12,14,15,16,17,19,20,21] 2023-11-04T01:48:17.262 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu 5u a_inode 0,14 0 3100 [signalfd] 2023-11-04T01:48:17.262 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu 6r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.262 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu 7r DIR 0,25 0 3211 /sys/fs/cgroup/user.slice/user-1000.slice/user@1000.service 2023-11-04T01:48:17.262 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu 8u a_inode 0,14 0 3100 [timerfd] 2023-11-04T01:48:17.263 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu 9u a_inode 0,14 0 3100 [eventpoll:10,13] 2023-11-04T01:48:17.263 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu 10r REG 0,20 0 22770 /proc/1151/mountinfo 2023-11-04T01:48:17.263 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu 11r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.263 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu 12u unix 0xffff9ba920030880 0t0 19204 /run/user/1000/bus type=STREAM (LISTEN) 2023-11-04T01:48:17.263 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu 13r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.263 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu 14r REG 0,20 0 4026532076 /proc/swaps 2023-11-04T01:48:17.264 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu 15u netlink 0t0 19186 KOBJECT_UEVENT 2023-11-04T01:48:17.264 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu 16u unix 0xffff9ba908423fc0 0t0 19191 /run/user/1000/systemd/notify type=DGRAM (UNCONNECTED) 2023-11-04T01:48:17.264 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu 17u unix 0xffff9ba908426600 0t0 19192 type=DGRAM (CONNECTED) 2023-11-04T01:48:17.264 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu 18u unix 0xffff9ba908426a40 0t0 19193 type=DGRAM (CONNECTED) 2023-11-04T01:48:17.264 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu 19u unix 0xffff9ba920032640 0t0 19194 /run/user/1000/systemd/private type=STREAM (LISTEN) 2023-11-04T01:48:17.264 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu 20u unix 0xffff9ba920037b40 0t0 19196 type=STREAM (CONNECTED) 2023-11-04T01:48:17.265 INFO:teuthology.orchestra.run.smithi077.stdout:systemd 1151 ubuntu 21u a_inode 0,14 0 3100 [timerfd] 2023-11-04T01:48:17.265 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.265 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.265 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu txt REG 8,1 102120 20353 /usr/lib/systemd/systemd 2023-11-04T01:48:17.265 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:48:17.266 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:48:17.266 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu DEL REG 8,1 63926 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-11-04T01:48:17.266 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.266 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.266 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:48:17.267 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.267 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:48:17.267 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:48:17.267 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:48:17.267 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:48:17.268 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2023-11-04T01:48:17.268 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2023-11-04T01:48:17.268 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:48:17.268 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2023-11-04T01:48:17.268 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2023-11-04T01:48:17.269 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:48:17.269 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:17.269 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:48:17.269 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-11-04T01:48:17.269 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:48:17.269 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.270 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.270 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:48:17.270 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:48:17.270 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:17.270 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.271 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:48:17.271 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.271 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-11-04T01:48:17.271 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:17.271 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.272 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu DEL REG 8,1 9806 /usr/lib64/libacl.so.1.1.2301 2023-11-04T01:48:17.272 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-11-04T01:48:17.272 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 2174088 49251 /usr/lib64/systemd/libsystemd-core-252.so 2023-11-04T01:48:17.272 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.272 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-11-04T01:48:17.273 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:48:17.273 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:48:17.273 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-04T01:48:17.273 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.273 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu DEL REG 8,1 63928 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-11-04T01:48:17.273 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.274 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-04T01:48:17.274 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.274 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu 1u unix 0xffff9ba920033740 0t0 19176 type=STREAM (CONNECTED) 2023-11-04T01:48:17.274 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu 2u unix 0xffff9ba920033740 0t0 19176 type=STREAM (CONNECTED) 2023-11-04T01:48:17.274 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu 3u a_inode 0,14 0 3100 [eventfd:13] 2023-11-04T01:48:17.275 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu 4u a_inode 0,14 0 3100 [eventfd:14] 2023-11-04T01:48:17.275 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu 6w FIFO 0,13 0t0 19180 pipe 2023-11-04T01:48:17.275 INFO:teuthology.orchestra.run.smithi077.stdout:(sd-pam) 1165 ubuntu 7u unix 0xffff9ba9084b2200 0t0 22773 type=DGRAM (CONNECTED) 2023-11-04T01:48:17.275 INFO:teuthology.orchestra.run.smithi077.stdout:agetty 1367 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.275 INFO:teuthology.orchestra.run.smithi077.stdout:agetty 1367 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.275 INFO:teuthology.orchestra.run.smithi077.stdout:agetty 1367 root txt REG 8,1 58072 13690 /usr/sbin/agetty 2023-11-04T01:48:17.276 INFO:teuthology.orchestra.run.smithi077.stdout:agetty 1367 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.276 INFO:teuthology.orchestra.run.smithi077.stdout:agetty 1367 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:17.276 INFO:teuthology.orchestra.run.smithi077.stdout:agetty 1367 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:17.276 INFO:teuthology.orchestra.run.smithi077.stdout:agetty 1367 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.276 INFO:teuthology.orchestra.run.smithi077.stdout:agetty 1367 root 0u CHR 4,1 0t0 20 /dev/tty1 2023-11-04T01:48:17.277 INFO:teuthology.orchestra.run.smithi077.stdout:agetty 1367 root 1u CHR 4,1 0t0 20 /dev/tty1 2023-11-04T01:48:17.277 INFO:teuthology.orchestra.run.smithi077.stdout:agetty 1367 root 2u CHR 4,1 0t0 20 /dev/tty1 2023-11-04T01:48:17.277 INFO:teuthology.orchestra.run.smithi077.stdout:agetty 1367 root 4r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.277 INFO:teuthology.orchestra.run.smithi077.stdout:agetty 1370 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.277 INFO:teuthology.orchestra.run.smithi077.stdout:agetty 1370 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.278 INFO:teuthology.orchestra.run.smithi077.stdout:agetty 1370 root txt REG 8,1 58072 13690 /usr/sbin/agetty 2023-11-04T01:48:17.278 INFO:teuthology.orchestra.run.smithi077.stdout:agetty 1370 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:48:17.278 INFO:teuthology.orchestra.run.smithi077.stdout:agetty 1370 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.278 INFO:teuthology.orchestra.run.smithi077.stdout:agetty 1370 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:17.278 INFO:teuthology.orchestra.run.smithi077.stdout:agetty 1370 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:48:17.279 INFO:teuthology.orchestra.run.smithi077.stdout:agetty 1370 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:48:17.279 INFO:teuthology.orchestra.run.smithi077.stdout:agetty 1370 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:48:17.279 INFO:teuthology.orchestra.run.smithi077.stdout:agetty 1370 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:17.279 INFO:teuthology.orchestra.run.smithi077.stdout:agetty 1370 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:48:17.279 INFO:teuthology.orchestra.run.smithi077.stdout:agetty 1370 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:48:17.279 INFO:teuthology.orchestra.run.smithi077.stdout:agetty 1370 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:48:17.280 INFO:teuthology.orchestra.run.smithi077.stdout:agetty 1370 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:48:17.280 INFO:teuthology.orchestra.run.smithi077.stdout:agetty 1370 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:48:17.280 INFO:teuthology.orchestra.run.smithi077.stdout:agetty 1370 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:48:17.280 INFO:teuthology.orchestra.run.smithi077.stdout:agetty 1370 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.280 INFO:teuthology.orchestra.run.smithi077.stdout:agetty 1370 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:48:17.281 INFO:teuthology.orchestra.run.smithi077.stdout:agetty 1370 root 0u CHR 4,65 0t0 114 /dev/ttyS1 2023-11-04T01:48:17.281 INFO:teuthology.orchestra.run.smithi077.stdout:agetty 1370 root 1u CHR 4,65 0t0 114 /dev/ttyS1 2023-11-04T01:48:17.281 INFO:teuthology.orchestra.run.smithi077.stdout:agetty 1370 root 2u CHR 4,65 0t0 114 /dev/ttyS1 2023-11-04T01:48:17.281 INFO:teuthology.orchestra.run.smithi077.stdout:agetty 1370 root 4r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.281 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.281 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.282 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 root txt REG 8,1 769928 12237 /usr/sbin/rsyslogd 2023-11-04T01:48:17.282 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-04T01:48:17.282 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 root mem REG 8,1 33592 12207 /usr/lib64/rsyslog/imjournal.so 2023-11-04T01:48:17.282 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:48:17.282 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.282 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:48:17.283 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:48:17.283 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.283 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 root mem REG 8,1 42248 12214 /usr/lib64/rsyslog/imuxsock.so 2023-11-04T01:48:17.283 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 root mem REG 8,1 32808 12215 /usr/lib64/rsyslog/lmnet.so 2023-11-04T01:48:17.283 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:17.284 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:17.284 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.284 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:48:17.284 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:48:17.284 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:48:17.284 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 root mem REG 8,1 52856 12201 /usr/lib64/libfastjson.so.4.3.0 2023-11-04T01:48:17.285 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 root mem REG 8,1 16032 12200 /usr/lib64/libestr.so.0.0.0 2023-11-04T01:48:17.285 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.285 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.285 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.285 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 root 1w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.285 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 root 2w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.286 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 root 3r CHR 1,9 0t0 9 /dev/urandom 2023-11-04T01:48:17.286 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 root 4u unix 0xffff9ba903821540 0t0 26650 type=DGRAM (CONNECTED) 2023-11-04T01:48:17.286 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 root 5w REG 8,1 1077912 1642 /var/log/secure 2023-11-04T01:48:17.286 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 root 6r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.286 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 root 8w REG 8,1 1468239 1641 /var/log/messages 2023-11-04T01:48:17.287 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 root 9r REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-04T01:48:17.287 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5122 in:imjour root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.287 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5122 in:imjour root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.287 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5122 in:imjour root txt REG 8,1 769928 12237 /usr/sbin/rsyslogd 2023-11-04T01:48:17.287 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5122 in:imjour root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-04T01:48:17.287 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5122 in:imjour root mem REG 8,1 33592 12207 /usr/lib64/rsyslog/imjournal.so 2023-11-04T01:48:17.288 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5122 in:imjour root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:48:17.288 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5122 in:imjour root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.288 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5122 in:imjour root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:48:17.288 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5122 in:imjour root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:48:17.288 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5122 in:imjour root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.289 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5122 in:imjour root mem REG 8,1 42248 12214 /usr/lib64/rsyslog/imuxsock.so 2023-11-04T01:48:17.289 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5122 in:imjour root mem REG 8,1 32808 12215 /usr/lib64/rsyslog/lmnet.so 2023-11-04T01:48:17.289 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5122 in:imjour root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:17.289 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5122 in:imjour root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:17.289 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5122 in:imjour root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.289 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5122 in:imjour root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:48:17.290 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5122 in:imjour root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:48:17.290 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5122 in:imjour root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:48:17.290 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5122 in:imjour root mem REG 8,1 52856 12201 /usr/lib64/libfastjson.so.4.3.0 2023-11-04T01:48:17.290 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5122 in:imjour root mem REG 8,1 16032 12200 /usr/lib64/libestr.so.0.0.0 2023-11-04T01:48:17.290 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5122 in:imjour root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.291 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5122 in:imjour root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.291 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5122 in:imjour root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.291 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5122 in:imjour root 1w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.291 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5122 in:imjour root 2w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.291 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5122 in:imjour root 3r CHR 1,9 0t0 9 /dev/urandom 2023-11-04T01:48:17.292 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5122 in:imjour root 4u unix 0xffff9ba903821540 0t0 26650 type=DGRAM (CONNECTED) 2023-11-04T01:48:17.292 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5122 in:imjour root 5w REG 8,1 1077912 1642 /var/log/secure 2023-11-04T01:48:17.292 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5122 in:imjour root 6r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.292 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5122 in:imjour root 8w REG 8,1 1468239 1641 /var/log/messages 2023-11-04T01:48:17.292 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5122 in:imjour root 9r REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-04T01:48:17.292 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5123 rs:main root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.293 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5123 rs:main root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.293 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5123 rs:main root txt REG 8,1 769928 12237 /usr/sbin/rsyslogd 2023-11-04T01:48:17.293 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5123 rs:main root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-04T01:48:17.293 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5123 rs:main root mem REG 8,1 33592 12207 /usr/lib64/rsyslog/imjournal.so 2023-11-04T01:48:17.293 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5123 rs:main root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:48:17.294 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5123 rs:main root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.294 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5123 rs:main root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:48:17.294 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5123 rs:main root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:48:17.294 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5123 rs:main root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.294 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5123 rs:main root mem REG 8,1 42248 12214 /usr/lib64/rsyslog/imuxsock.so 2023-11-04T01:48:17.295 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5123 rs:main root mem REG 8,1 32808 12215 /usr/lib64/rsyslog/lmnet.so 2023-11-04T01:48:17.295 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5123 rs:main root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:17.295 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5123 rs:main root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:17.295 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5123 rs:main root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.295 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5123 rs:main root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:48:17.296 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5123 rs:main root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:48:17.296 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5123 rs:main root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:48:17.296 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5123 rs:main root mem REG 8,1 52856 12201 /usr/lib64/libfastjson.so.4.3.0 2023-11-04T01:48:17.296 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5123 rs:main root mem REG 8,1 16032 12200 /usr/lib64/libestr.so.0.0.0 2023-11-04T01:48:17.296 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5123 rs:main root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.296 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5123 rs:main root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.297 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5123 rs:main root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.297 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5123 rs:main root 1w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.297 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5123 rs:main root 2w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.297 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5123 rs:main root 3r CHR 1,9 0t0 9 /dev/urandom 2023-11-04T01:48:17.297 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5123 rs:main root 4u unix 0xffff9ba903821540 0t0 26650 type=DGRAM (CONNECTED) 2023-11-04T01:48:17.298 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5123 rs:main root 5w REG 8,1 1077912 1642 /var/log/secure 2023-11-04T01:48:17.298 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5123 rs:main root 6r a_inode 0,14 0 3100 inotify 2023-11-04T01:48:17.298 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5123 rs:main root 8w REG 8,1 1468239 1641 /var/log/messages 2023-11-04T01:48:17.298 INFO:teuthology.orchestra.run.smithi077.stdout:rsyslogd 5120 5123 rs:main root 9r REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-11-04T01:48:17.298 INFO:teuthology.orchestra.run.smithi077.stdout:tls-strp 60998 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.299 INFO:teuthology.orchestra.run.smithi077.stdout:tls-strp 60998 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.299 INFO:teuthology.orchestra.run.smithi077.stdout:tls-strp 60998 root txt unknown /proc/60998/exe 2023-11-04T01:48:17.299 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/u 62184 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.299 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/u 62184 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.299 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/u 62184 root txt unknown /proc/62184/exe 2023-11-04T01:48:17.300 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/u 100059 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.300 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/u 100059 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.300 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/u 100059 root txt unknown /proc/100059/exe 2023-11-04T01:48:17.300 INFO:teuthology.orchestra.run.smithi077.stdout:kdmflush/ 100750 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.300 INFO:teuthology.orchestra.run.smithi077.stdout:kdmflush/ 100750 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.301 INFO:teuthology.orchestra.run.smithi077.stdout:kdmflush/ 100750 root txt unknown /proc/100750/exe 2023-11-04T01:48:17.301 INFO:teuthology.orchestra.run.smithi077.stdout:kdmflush/ 100871 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.301 INFO:teuthology.orchestra.run.smithi077.stdout:kdmflush/ 100871 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.301 INFO:teuthology.orchestra.run.smithi077.stdout:kdmflush/ 100871 root txt unknown /proc/100871/exe 2023-11-04T01:48:17.301 INFO:teuthology.orchestra.run.smithi077.stdout:kdmflush/ 100991 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.301 INFO:teuthology.orchestra.run.smithi077.stdout:kdmflush/ 100991 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.302 INFO:teuthology.orchestra.run.smithi077.stdout:kdmflush/ 100991 root txt unknown /proc/100991/exe 2023-11-04T01:48:17.302 INFO:teuthology.orchestra.run.smithi077.stdout:kdmflush/ 101111 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.302 INFO:teuthology.orchestra.run.smithi077.stdout:kdmflush/ 101111 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.302 INFO:teuthology.orchestra.run.smithi077.stdout:kdmflush/ 101111 root txt unknown /proc/101111/exe 2023-11-04T01:48:17.302 INFO:teuthology.orchestra.run.smithi077.stdout:kdmflush/ 101231 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.303 INFO:teuthology.orchestra.run.smithi077.stdout:kdmflush/ 101231 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.303 INFO:teuthology.orchestra.run.smithi077.stdout:kdmflush/ 101231 root txt unknown /proc/101231/exe 2023-11-04T01:48:17.303 INFO:teuthology.orchestra.run.smithi077.stdout:xfsalloc 102124 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.303 INFO:teuthology.orchestra.run.smithi077.stdout:xfsalloc 102124 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.303 INFO:teuthology.orchestra.run.smithi077.stdout:xfsalloc 102124 root txt unknown /proc/102124/exe 2023-11-04T01:48:17.304 INFO:teuthology.orchestra.run.smithi077.stdout:xfs_mru_c 102125 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.304 INFO:teuthology.orchestra.run.smithi077.stdout:xfs_mru_c 102125 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.304 INFO:teuthology.orchestra.run.smithi077.stdout:xfs_mru_c 102125 root txt unknown /proc/102125/exe 2023-11-04T01:48:17.304 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-buf/d 102126 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.304 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-buf/d 102126 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.305 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-buf/d 102126 root txt unknown /proc/102126/exe 2023-11-04T01:48:17.305 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-conv/ 102127 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.305 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-conv/ 102127 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.305 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-conv/ 102127 root txt unknown /proc/102127/exe 2023-11-04T01:48:17.305 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-recla 102128 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.305 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-recla 102128 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.306 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-recla 102128 root txt unknown /proc/102128/exe 2023-11-04T01:48:17.306 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-block 102129 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.306 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-block 102129 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.306 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-block 102129 root txt unknown /proc/102129/exe 2023-11-04T01:48:17.306 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-inode 102130 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.307 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-inode 102130 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.307 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-inode 102130 root txt unknown /proc/102130/exe 2023-11-04T01:48:17.307 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-log/d 102131 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.307 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-log/d 102131 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.307 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-log/d 102131 root txt unknown /proc/102131/exe 2023-11-04T01:48:17.308 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-cil/d 102132 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.308 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-cil/d 102132 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.308 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-cil/d 102132 root txt unknown /proc/102132/exe 2023-11-04T01:48:17.308 INFO:teuthology.orchestra.run.smithi077.stdout:xfsaild/d 102133 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.308 INFO:teuthology.orchestra.run.smithi077.stdout:xfsaild/d 102133 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.308 INFO:teuthology.orchestra.run.smithi077.stdout:xfsaild/d 102133 root txt unknown /proc/102133/exe 2023-11-04T01:48:17.309 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.309 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.309 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root txt REG 8,1 968800 13744 /usr/sbin/sshd 2023-11-04T01:48:17.309 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:48:17.309 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 19520 32283 /usr/lib64/security/pam_lastlog.so 2023-11-04T01:48:17.310 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2023-11-04T01:48:17.310 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:17.310 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:48:17.310 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:48:17.310 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:48:17.311 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:48:17.311 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:48:17.311 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 15264 32290 /usr/lib64/security/pam_motd.so 2023-11-04T01:48:17.311 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:48:17.311 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2023-11-04T01:48:17.312 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2023-11-04T01:48:17.312 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:48:17.312 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:48:17.312 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2023-11-04T01:48:17.312 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:48:17.312 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 15232 32292 /usr/lib64/security/pam_nologin.so 2023-11-04T01:48:17.313 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 19368 32301 /usr/lib64/security/pam_sepermit.so 2023-11-04T01:48:17.313 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:48:17.313 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:48:17.313 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:48:17.313 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:48:17.314 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.314 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.314 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.314 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:48:17.314 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:48:17.315 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.315 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.315 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.315 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.315 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.316 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:17.316 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:17.316 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:48:17.316 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:48:17.316 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.316 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.317 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.317 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.317 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.317 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.317 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.318 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.318 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:48:17.318 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:48:17.318 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:48:17.318 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:48:17.319 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.319 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-04T01:48:17.319 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.319 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.319 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.320 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root 3u unix 0xffff9ba903822a80 0t0 195595 type=DGRAM (CONNECTED) 2023-11-04T01:48:17.320 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root 4u IPv4 192152 0t0 TCP smithi077.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:47612 (ESTABLISHED) 2023-11-04T01:48:17.320 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root 6u unix 0xffff9ba900b3e600 0t0 179186 type=STREAM (CONNECTED) 2023-11-04T01:48:17.320 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root 7w FIFO 0,24 0t0 1611 /run/systemd/sessions/4.ref 2023-11-04T01:48:17.320 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105156 root 8u unix 0xffff9ba900b3bfc0 0t0 195599 type=STREAM (CONNECTED) 2023-11-04T01:48:17.320 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.321 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.321 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu txt REG 8,1 968800 13744 /usr/sbin/sshd 2023-11-04T01:48:17.321 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:48:17.321 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 19520 32283 /usr/lib64/security/pam_lastlog.so 2023-11-04T01:48:17.321 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2023-11-04T01:48:17.322 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:17.322 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:48:17.322 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:48:17.322 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:48:17.322 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:48:17.323 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:48:17.323 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 15264 32290 /usr/lib64/security/pam_motd.so 2023-11-04T01:48:17.323 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:48:17.323 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2023-11-04T01:48:17.323 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2023-11-04T01:48:17.323 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:48:17.324 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:48:17.324 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2023-11-04T01:48:17.324 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:48:17.324 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 15232 32292 /usr/lib64/security/pam_nologin.so 2023-11-04T01:48:17.324 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 19368 32301 /usr/lib64/security/pam_sepermit.so 2023-11-04T01:48:17.325 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:48:17.325 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:48:17.325 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:48:17.325 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-11-04T01:48:17.325 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.325 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.326 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.326 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-11-04T01:48:17.326 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-11-04T01:48:17.326 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.326 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.327 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.327 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.327 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.327 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:17.327 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:17.328 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:48:17.328 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:48:17.328 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.328 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.329 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.329 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.329 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.329 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.329 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.329 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.330 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-11-04T01:48:17.330 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:48:17.330 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:48:17.330 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:48:17.330 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.331 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2023-11-04T01:48:17.331 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu 0u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.331 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu 1u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.331 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.331 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu 3u unix 0xffff9ba903822a80 0t0 195595 type=DGRAM (CONNECTED) 2023-11-04T01:48:17.332 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu 4u IPv4 192152 0t0 TCP smithi077.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:47612 (ESTABLISHED) 2023-11-04T01:48:17.332 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu 5u unix 0xffff9ba900b3aa80 0t0 195598 type=STREAM (CONNECTED) 2023-11-04T01:48:17.332 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu 6u unix 0xffff9ba900b3e600 0t0 179186 type=STREAM (CONNECTED) 2023-11-04T01:48:17.332 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu 7w FIFO 0,24 0t0 1611 /run/systemd/sessions/4.ref 2023-11-04T01:48:17.332 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu 11w FIFO 0,13 0t0 212190 pipe 2023-11-04T01:48:17.333 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu 12r FIFO 0,13 0t0 212191 pipe 2023-11-04T01:48:17.333 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu 13w FIFO 0,13 0t0 212216 pipe 2023-11-04T01:48:17.333 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu 14r FIFO 0,13 0t0 212192 pipe 2023-11-04T01:48:17.333 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu 15r FIFO 0,13 0t0 212217 pipe 2023-11-04T01:48:17.333 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu 16w FIFO 0,13 0t0 209787 pipe 2023-11-04T01:48:17.334 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu 17r FIFO 0,13 0t0 212218 pipe 2023-11-04T01:48:17.334 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu 18r FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:17.334 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu 19w FIFO 0,13 0t0 209791 pipe 2023-11-04T01:48:17.334 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu 20r FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:17.334 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu 21r FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:17.335 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu 22w FIFO 0,13 0t0 211067 pipe 2023-11-04T01:48:17.335 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu 23r FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:17.335 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu 24r FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:17.335 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu 25w FIFO 0,13 0t0 211071 pipe 2023-11-04T01:48:17.335 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu 26r FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:17.336 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu 27r FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:17.336 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu 28w FIFO 0,13 0t0 290356 pipe 2023-11-04T01:48:17.336 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu 29r FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:17.336 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu 30r FIFO 0,13 0t0 290357 pipe 2023-11-04T01:48:17.336 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu 31w FIFO 0,13 0t0 285076 pipe 2023-11-04T01:48:17.337 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu 33r FIFO 0,13 0t0 290358 pipe 2023-11-04T01:48:17.337 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu 34r FIFO 0,13 0t0 287069 pipe 2023-11-04T01:48:17.337 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu 35r FIFO 0,13 0t0 285077 pipe 2023-11-04T01:48:17.337 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu 37r FIFO 0,13 0t0 285078 pipe 2023-11-04T01:48:17.337 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu 38r FIFO 0,13 0t0 287070 pipe 2023-11-04T01:48:17.338 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu 39r FIFO 0,13 0t0 285590 pipe 2023-11-04T01:48:17.338 INFO:teuthology.orchestra.run.smithi077.stdout:sshd 105159 ubuntu 41r FIFO 0,13 0t0 285591 pipe 2023-11-04T01:48:17.338 INFO:teuthology.orchestra.run.smithi077.stdout:chronyd 105219 chrony cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.338 INFO:teuthology.orchestra.run.smithi077.stdout:chronyd 105219 chrony rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.338 INFO:teuthology.orchestra.run.smithi077.stdout:chronyd 105219 chrony txt REG 8,1 353408 12490 /usr/sbin/chronyd 2023-11-04T01:48:17.339 INFO:teuthology.orchestra.run.smithi077.stdout:chronyd 105219 chrony mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:17.339 INFO:teuthology.orchestra.run.smithi077.stdout:chronyd 105219 chrony mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.339 INFO:teuthology.orchestra.run.smithi077.stdout:chronyd 105219 chrony mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-11-04T01:48:17.339 INFO:teuthology.orchestra.run.smithi077.stdout:chronyd 105219 chrony mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:48:17.339 INFO:teuthology.orchestra.run.smithi077.stdout:chronyd 105219 chrony mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-11-04T01:48:17.340 INFO:teuthology.orchestra.run.smithi077.stdout:chronyd 105219 chrony mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:17.340 INFO:teuthology.orchestra.run.smithi077.stdout:chronyd 105219 chrony mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:48:17.340 INFO:teuthology.orchestra.run.smithi077.stdout:chronyd 105219 chrony mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-11-04T01:48:17.340 INFO:teuthology.orchestra.run.smithi077.stdout:chronyd 105219 chrony mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:17.340 INFO:teuthology.orchestra.run.smithi077.stdout:chronyd 105219 chrony mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-11-04T01:48:17.341 INFO:teuthology.orchestra.run.smithi077.stdout:chronyd 105219 chrony mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:17.341 INFO:teuthology.orchestra.run.smithi077.stdout:chronyd 105219 chrony mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.341 INFO:teuthology.orchestra.run.smithi077.stdout:chronyd 105219 chrony mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.341 INFO:teuthology.orchestra.run.smithi077.stdout:chronyd 105219 chrony 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.341 INFO:teuthology.orchestra.run.smithi077.stdout:chronyd 105219 chrony 1w CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.341 INFO:teuthology.orchestra.run.smithi077.stdout:chronyd 105219 chrony 2u CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.342 INFO:teuthology.orchestra.run.smithi077.stdout:chronyd 105219 chrony 3u unix 0xffff9ba908420880 0t0 190362 type=DGRAM (CONNECTED) 2023-11-04T01:48:17.342 INFO:teuthology.orchestra.run.smithi077.stdout:chronyd 105219 chrony 5u IPv4 190367 0t0 UDP localhost:323 2023-11-04T01:48:17.342 INFO:teuthology.orchestra.run.smithi077.stdout:chronyd 105219 chrony 6u IPv6 190368 0t0 UDP localhost:323 2023-11-04T01:48:17.342 INFO:teuthology.orchestra.run.smithi077.stdout:chronyd 105219 chrony 7u unix 0xffff9ba908424400 0t0 190369 /run/chrony/chronyd.sock type=DGRAM (CONNECTED) 2023-11-04T01:48:17.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-cras 105473 ceph cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-cras 105473 ceph rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-cras 105473 ceph txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:48:17.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-cras 105473 ceph mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:17.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-cras 105473 ceph mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-cras 105473 ceph mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:48:17.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-cras 105473 ceph mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-cras 105473 ceph mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-cras 105473 ceph mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-cras 105473 ceph mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-cras 105473 ceph mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-cras 105473 ceph mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-cras 105473 ceph mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-cras 105473 ceph mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-cras 105473 ceph mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:48:17.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-cras 105473 ceph mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-cras 105473 ceph mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-cras 105473 ceph mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-cras 105473 ceph mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:17.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-cras 105473 ceph mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-cras 105473 ceph mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:17.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-cras 105473 ceph mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-cras 105473 ceph 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-cras 105473 ceph 1u unix 0xffff9ba920250440 0t0 192358 type=STREAM (CONNECTED) 2023-11-04T01:48:17.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-cras 105473 ceph 2u unix 0xffff9ba920250440 0t0 192358 type=STREAM (CONNECTED) 2023-11-04T01:48:17.347 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/5 106754 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.347 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/5 106754 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.347 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/5 106754 root txt unknown /proc/106754/exe 2023-11-04T01:48:17.347 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/5 106859 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.347 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/5 106859 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.348 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/5 106859 root txt unknown /proc/106859/exe 2023-11-04T01:48:17.348 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/4 107230 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.348 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/4 107230 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.348 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/4 107230 root txt unknown /proc/107230/exe 2023-11-04T01:48:17.348 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/4 107364 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.349 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/4 107364 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.349 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/4 107364 root txt unknown /proc/107364/exe 2023-11-04T01:48:17.349 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-buf/d 112635 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.349 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-buf/d 112635 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.349 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-buf/d 112635 root txt unknown /proc/112635/exe 2023-11-04T01:48:17.350 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-conv/ 112636 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.350 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-conv/ 112636 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.350 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-conv/ 112636 root txt unknown /proc/112636/exe 2023-11-04T01:48:17.350 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-recla 112637 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.350 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-recla 112637 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.351 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-recla 112637 root txt unknown /proc/112637/exe 2023-11-04T01:48:17.351 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-block 112638 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.351 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-block 112638 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.351 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-block 112638 root txt unknown /proc/112638/exe 2023-11-04T01:48:17.351 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-inode 112639 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.351 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-inode 112639 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.352 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-inode 112639 root txt unknown /proc/112639/exe 2023-11-04T01:48:17.352 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-log/d 112640 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.352 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-log/d 112640 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.352 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-log/d 112640 root txt unknown /proc/112640/exe 2023-11-04T01:48:17.352 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-cil/d 112641 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.353 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-cil/d 112641 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.353 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-cil/d 112641 root txt unknown /proc/112641/exe 2023-11-04T01:48:17.353 INFO:teuthology.orchestra.run.smithi077.stdout:xfsaild/d 112642 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.353 INFO:teuthology.orchestra.run.smithi077.stdout:xfsaild/d 112642 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.353 INFO:teuthology.orchestra.run.smithi077.stdout:xfsaild/d 112642 root txt unknown /proc/112642/exe 2023-11-04T01:48:17.354 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-buf/d 112719 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.354 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-buf/d 112719 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.354 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-buf/d 112719 root txt unknown /proc/112719/exe 2023-11-04T01:48:17.354 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-conv/ 112720 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.354 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-conv/ 112720 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.355 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-conv/ 112720 root txt unknown /proc/112720/exe 2023-11-04T01:48:17.355 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-recla 112721 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.355 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-recla 112721 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.355 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-recla 112721 root txt unknown /proc/112721/exe 2023-11-04T01:48:17.355 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-block 112722 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.356 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-block 112722 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.356 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-block 112722 root txt unknown /proc/112722/exe 2023-11-04T01:48:17.356 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-inode 112723 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.356 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-inode 112723 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.356 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-inode 112723 root txt unknown /proc/112723/exe 2023-11-04T01:48:17.357 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-log/d 112724 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.357 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-log/d 112724 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.357 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-log/d 112724 root txt unknown /proc/112724/exe 2023-11-04T01:48:17.357 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-cil/d 112725 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.357 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-cil/d 112725 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.357 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-cil/d 112725 root txt unknown /proc/112725/exe 2023-11-04T01:48:17.358 INFO:teuthology.orchestra.run.smithi077.stdout:xfsaild/d 112726 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.358 INFO:teuthology.orchestra.run.smithi077.stdout:xfsaild/d 112726 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.358 INFO:teuthology.orchestra.run.smithi077.stdout:xfsaild/d 112726 root txt unknown /proc/112726/exe 2023-11-04T01:48:17.358 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-buf/d 112803 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.358 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-buf/d 112803 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.359 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-buf/d 112803 root txt unknown /proc/112803/exe 2023-11-04T01:48:17.359 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-conv/ 112804 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.359 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-conv/ 112804 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.359 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-conv/ 112804 root txt unknown /proc/112804/exe 2023-11-04T01:48:17.359 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-recla 112805 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.360 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-recla 112805 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.360 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-recla 112805 root txt unknown /proc/112805/exe 2023-11-04T01:48:17.360 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-block 112806 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.360 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-block 112806 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.360 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-block 112806 root txt unknown /proc/112806/exe 2023-11-04T01:48:17.361 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-inode 112807 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.361 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-inode 112807 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.361 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-inode 112807 root txt unknown /proc/112807/exe 2023-11-04T01:48:17.361 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-log/d 112808 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.361 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-log/d 112808 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.361 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-log/d 112808 root txt unknown /proc/112808/exe 2023-11-04T01:48:17.362 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-cil/d 112809 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.362 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-cil/d 112809 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.362 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-cil/d 112809 root txt unknown /proc/112809/exe 2023-11-04T01:48:17.362 INFO:teuthology.orchestra.run.smithi077.stdout:xfsaild/d 112810 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.362 INFO:teuthology.orchestra.run.smithi077.stdout:xfsaild/d 112810 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.363 INFO:teuthology.orchestra.run.smithi077.stdout:xfsaild/d 112810 root txt unknown /proc/112810/exe 2023-11-04T01:48:17.363 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-buf/d 112887 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.363 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-buf/d 112887 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.363 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-buf/d 112887 root txt unknown /proc/112887/exe 2023-11-04T01:48:17.363 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-conv/ 112888 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.364 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-conv/ 112888 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.364 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-conv/ 112888 root txt unknown /proc/112888/exe 2023-11-04T01:48:17.364 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-recla 112889 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.364 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-recla 112889 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.364 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-recla 112889 root txt unknown /proc/112889/exe 2023-11-04T01:48:17.365 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-block 112890 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.365 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-block 112890 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.365 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-block 112890 root txt unknown /proc/112890/exe 2023-11-04T01:48:17.365 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-inode 112891 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.365 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-inode 112891 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.366 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-inode 112891 root txt unknown /proc/112891/exe 2023-11-04T01:48:17.366 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-log/d 112892 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.366 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-log/d 112892 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.366 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-log/d 112892 root txt unknown /proc/112892/exe 2023-11-04T01:48:17.366 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-cil/d 112893 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.367 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-cil/d 112893 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.367 INFO:teuthology.orchestra.run.smithi077.stdout:xfs-cil/d 112893 root txt unknown /proc/112893/exe 2023-11-04T01:48:17.367 INFO:teuthology.orchestra.run.smithi077.stdout:xfsaild/d 112894 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.367 INFO:teuthology.orchestra.run.smithi077.stdout:xfsaild/d 112894 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.367 INFO:teuthology.orchestra.run.smithi077.stdout:xfsaild/d 112894 root txt unknown /proc/112894/exe 2023-11-04T01:48:17.368 INFO:teuthology.orchestra.run.smithi077.stdout:dio/dm-0 112940 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.368 INFO:teuthology.orchestra.run.smithi077.stdout:dio/dm-0 112940 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.368 INFO:teuthology.orchestra.run.smithi077.stdout:dio/dm-0 112940 root txt unknown /proc/112940/exe 2023-11-04T01:48:17.368 INFO:teuthology.orchestra.run.smithi077.stdout:dio/dm-1 114102 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.368 INFO:teuthology.orchestra.run.smithi077.stdout:dio/dm-1 114102 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.368 INFO:teuthology.orchestra.run.smithi077.stdout:dio/dm-1 114102 root txt unknown /proc/114102/exe 2023-11-04T01:48:17.369 INFO:teuthology.orchestra.run.smithi077.stdout:dio/dm-2 115264 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.369 INFO:teuthology.orchestra.run.smithi077.stdout:dio/dm-2 115264 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.369 INFO:teuthology.orchestra.run.smithi077.stdout:dio/dm-2 115264 root txt unknown /proc/115264/exe 2023-11-04T01:48:17.369 INFO:teuthology.orchestra.run.smithi077.stdout:dio/dm-3 116426 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:17.369 INFO:teuthology.orchestra.run.smithi077.stdout:dio/dm-3 116426 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.370 INFO:teuthology.orchestra.run.smithi077.stdout:dio/dm-3 116426 root txt unknown /proc/116426/exe 2023-11-04T01:48:17.370 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:17.370 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.370 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:48:17.370 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:48:17.370 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:17.371 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.371 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:48:17.371 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:17.371 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:48:17.371 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:48:17.372 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:48:17.372 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:48:17.372 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:48:17.372 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:48:17.372 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:48:17.372 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:48:17.373 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:48:17.373 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:48:17.373 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.373 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.373 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.374 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.374 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.374 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:48:17.374 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.374 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.375 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.375 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:17.375 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:17.375 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:17.375 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:48:17.375 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.376 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.376 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.376 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:17.376 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:17.376 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:48:17.376 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.377 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:48:17.377 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:48:17.377 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:48:17.377 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:17.377 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:48:17.378 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:48:17.378 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:48:17.378 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:48:17.378 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:48:17.378 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:48:17.379 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:48:17.379 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:48:17.379 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:48:17.379 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.379 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:48:17.379 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:48:17.380 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.380 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:48:17.380 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:17.380 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.380 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:48:17.381 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root 0r FIFO 0,13 0t0 212190 pipe 2023-11-04T01:48:17.381 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root 1w FIFO 0,13 0t0 212191 pipe 2023-11-04T01:48:17.381 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root 2w FIFO 0,13 0t0 212192 pipe 2023-11-04T01:48:17.381 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root 3r FIFO 0,13 0t0 212202 pipe 2023-11-04T01:48:17.381 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root 4w FIFO 0,13 0t0 212202 pipe 2023-11-04T01:48:17.382 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root 5u netlink 0t0 212207 AUDIT 2023-11-04T01:48:17.382 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118226 root 6u unix 0xffff9ba903825940 0t0 212208 type=DGRAM (CONNECTED) 2023-11-04T01:48:17.382 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118243 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:17.382 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118243 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.382 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118243 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:48:17.383 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118243 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:17.383 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118243 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:48:17.383 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118243 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.383 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118243 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.383 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118243 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.383 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118243 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.384 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118243 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.384 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118243 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.384 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118243 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.384 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118243 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.384 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118243 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.385 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118243 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.385 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118243 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.385 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118243 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:48:17.385 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118243 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.385 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118243 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:17.386 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118243 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.386 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118243 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:17.386 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118243 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.386 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118243 root 0r FIFO 0,13 0t0 212190 pipe 2023-11-04T01:48:17.386 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118243 root 1w FIFO 0,13 0t0 212191 pipe 2023-11-04T01:48:17.387 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118243 root 2w FIFO 0,13 0t0 212192 pipe 2023-11-04T01:48:17.387 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:17.387 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.387 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:48:17.387 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:48:17.387 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:17.388 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.388 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:48:17.388 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:17.388 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:48:17.388 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:48:17.389 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:48:17.389 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.389 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:48:17.389 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:48:17.389 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:48:17.390 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:48:17.390 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:48:17.390 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:48:17.390 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.390 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.391 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.391 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.391 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.391 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.391 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:17.392 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:17.392 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.392 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:48:17.392 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:48:17.392 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.392 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.393 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:17.393 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:48:17.393 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.393 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:17.393 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:48:17.394 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:17.394 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.394 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:48:17.394 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:17.394 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:48:17.395 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:48:17.395 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:48:17.395 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:48:17.395 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:48:17.395 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:48:17.395 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:48:17.396 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:48:17.396 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:48:17.396 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:48:17.396 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:48:17.396 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.397 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:48:17.397 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:48:17.397 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.397 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:48:17.397 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:17.398 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.398 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:48:17.398 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root 0r FIFO 0,13 0t0 212216 pipe 2023-11-04T01:48:17.398 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root 1w FIFO 0,13 0t0 212217 pipe 2023-11-04T01:48:17.398 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root 2w FIFO 0,13 0t0 212218 pipe 2023-11-04T01:48:17.399 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root 3r FIFO 0,13 0t0 212237 pipe 2023-11-04T01:48:17.399 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root 4w FIFO 0,13 0t0 212237 pipe 2023-11-04T01:48:17.399 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root 5u netlink 0t0 212242 AUDIT 2023-11-04T01:48:17.399 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118245 root 6u unix 0xffff9ba903826a40 0t0 212243 type=DGRAM (CONNECTED) 2023-11-04T01:48:17.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:17.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root txt REG 8,1 12250256 3000 /usr/bin/ceph-mon 2023-11-04T01:48:17.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:17.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:17.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:17.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:17.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:17.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:17.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:17.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:17.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:17.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:17.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:17.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:17.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:17.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:17.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:17.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:17.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:17.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:17.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:17.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:17.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:17.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:17.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:17.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:17.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:17.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:17.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:17.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:17.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:17.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:17.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 1w FIFO 0,13 0t0 212191 pipe 2023-11-04T01:48:17.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 2w FIFO 0,13 0t0 212192 pipe 2023-11-04T01:48:17.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 3r FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 4w FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 5w REG 8,1 56346041 265464 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:17.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 6uW REG 0,24 7 1742 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:17.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 7r FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 8w FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 9u unix 0xffff9ba9084ae1c0 0t0 204497 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:17.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 10r FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 11w FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:17.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 16r REG 253,4 5622388 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:48:17.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:17.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 18u a_inode 0,14 0 3100 [eventpoll:19,27,28,37,41] 2023-11-04T01:48:17.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 19r FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 20w FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 21u a_inode 0,14 0 3100 [eventpoll:22,40,42,44] 2023-11-04T01:48:17.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 22r FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 23w FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 24u a_inode 0,14 0 3100 [eventpoll:25,38,39,43,45] 2023-11-04T01:48:17.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 25r FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 26w FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 27u IPv4 209672 0t0 TCP smithi077.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:17.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 28u IPv4 209673 0t0 TCP smithi077.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:48:17.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 29w REG 8,1 102468 265465 /var/log/ceph/ceph.log 2023-11-04T01:48:17.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 30w REG 8,1 186590 265467 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:17.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 31r FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 32w FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 33r FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 34w FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 35r FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 36w FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 37u IPv4 204526 0t0 TCP smithi077.front.sepia.ceph.com:59628->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:17.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 38u IPv4 204586 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41578 (ESTABLISHED) 2023-11-04T01:48:17.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 39u IPv4 209676 0t0 TCP smithi077.front.sepia.ceph.com:51544->smithi122.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:17.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 40u IPv4 209873 0t0 TCP smithi077.front.sepia.ceph.com:59504->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:17.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 41u IPv4 203659 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41638 (ESTABLISHED) 2023-11-04T01:48:17.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 42u IPv4 203663 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41644 (ESTABLISHED) 2023-11-04T01:48:17.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 43u IPv4 203669 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41658 (ESTABLISHED) 2023-11-04T01:48:17.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 44u IPv4 285175 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:46096 (ESTABLISHED) 2023-11-04T01:48:17.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 45u IPv4 286085 0t0 TCP smithi077.front.sepia.ceph.com:3300->192.168.0.1:60962 (ESTABLISHED) 2023-11-04T01:48:17.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 root 47w REG 253,4 2054883 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:48:17.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:17.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root txt REG 8,1 12250256 3000 /usr/bin/ceph-mon 2023-11-04T01:48:17.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:17.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:17.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:17.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:17.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:17.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:17.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:17.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:17.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:17.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:17.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:17.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:17.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:17.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:17.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:17.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:17.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:17.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:17.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:17.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:17.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:17.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:17.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:17.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:17.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:17.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:17.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:17.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:17.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:17.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:17.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 1w FIFO 0,13 0t0 212191 pipe 2023-11-04T01:48:17.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 2w FIFO 0,13 0t0 212192 pipe 2023-11-04T01:48:17.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 3r FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 4w FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 5w REG 8,1 56346041 265464 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:17.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 6uW REG 0,24 7 1742 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:17.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 7r FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 8w FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 9u unix 0xffff9ba9084ae1c0 0t0 204497 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:17.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 10r FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 11w FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:17.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 16r REG 253,4 5622388 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:48:17.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:17.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 18u a_inode 0,14 0 3100 [eventpoll:19,27,28,37,41] 2023-11-04T01:48:17.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 19r FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 20w FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 21u a_inode 0,14 0 3100 [eventpoll:22,40,42,44] 2023-11-04T01:48:17.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 22r FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 23w FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 24u a_inode 0,14 0 3100 [eventpoll:25,38,39,43,45] 2023-11-04T01:48:17.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 25r FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 26w FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 27u IPv4 209672 0t0 TCP smithi077.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:17.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 28u IPv4 209673 0t0 TCP smithi077.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:48:17.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 29w REG 8,1 102468 265465 /var/log/ceph/ceph.log 2023-11-04T01:48:17.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 30w REG 8,1 186590 265467 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:17.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 31r FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 32w FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 33r FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 34w FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 35r FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 36w FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 37u IPv4 204526 0t0 TCP smithi077.front.sepia.ceph.com:59628->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:17.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 38u IPv4 204586 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41578 (ESTABLISHED) 2023-11-04T01:48:17.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 39u IPv4 209676 0t0 TCP smithi077.front.sepia.ceph.com:51544->smithi122.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:17.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 40u IPv4 209873 0t0 TCP smithi077.front.sepia.ceph.com:59504->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:17.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 41u IPv4 203659 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41638 (ESTABLISHED) 2023-11-04T01:48:17.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 42u IPv4 203663 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41644 (ESTABLISHED) 2023-11-04T01:48:17.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 43u IPv4 203669 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41658 (ESTABLISHED) 2023-11-04T01:48:17.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 44u IPv4 285175 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:46096 (ESTABLISHED) 2023-11-04T01:48:17.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 45u IPv4 286085 0t0 TCP smithi077.front.sepia.ceph.com:3300->192.168.0.1:60962 (ESTABLISHED) 2023-11-04T01:48:17.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118282 log root 47w REG 253,4 2054883 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:48:17.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:17.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root txt REG 8,1 12250256 3000 /usr/bin/ceph-mon 2023-11-04T01:48:17.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:17.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:17.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:17.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:17.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:17.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:17.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:17.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:17.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:17.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:17.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:17.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:17.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:17.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:17.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:17.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:17.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:17.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:17.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:17.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:17.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:17.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:17.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:17.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:17.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:17.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:17.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:17.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:17.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:17.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:17.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 1w FIFO 0,13 0t0 212191 pipe 2023-11-04T01:48:17.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 2w FIFO 0,13 0t0 212192 pipe 2023-11-04T01:48:17.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 3r FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 4w FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 5w REG 8,1 56346041 265464 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:17.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 6uW REG 0,24 7 1742 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:17.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 7r FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 8w FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 9u unix 0xffff9ba9084ae1c0 0t0 204497 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:17.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 10r FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 11w FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:17.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 16r REG 253,4 5622388 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:48:17.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:17.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 18u a_inode 0,14 0 3100 [eventpoll:19,27,28,37,41] 2023-11-04T01:48:17.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 19r FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 20w FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 21u a_inode 0,14 0 3100 [eventpoll:22,40,42,44] 2023-11-04T01:48:17.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 22r FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 23w FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 24u a_inode 0,14 0 3100 [eventpoll:25,38,39,43,45] 2023-11-04T01:48:17.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 25r FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 26w FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 27u IPv4 209672 0t0 TCP smithi077.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:17.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 28u IPv4 209673 0t0 TCP smithi077.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:48:17.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 29w REG 8,1 102468 265465 /var/log/ceph/ceph.log 2023-11-04T01:48:17.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 30w REG 8,1 186590 265467 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:17.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 31r FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 32w FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 33r FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 34w FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 35r FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 36w FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 37u IPv4 204526 0t0 TCP smithi077.front.sepia.ceph.com:59628->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:17.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 38u IPv4 204586 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41578 (ESTABLISHED) 2023-11-04T01:48:17.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 39u IPv4 209676 0t0 TCP smithi077.front.sepia.ceph.com:51544->smithi122.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:17.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 40u IPv4 209873 0t0 TCP smithi077.front.sepia.ceph.com:59504->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:17.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 41u IPv4 203659 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41638 (ESTABLISHED) 2023-11-04T01:48:17.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 42u IPv4 203663 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41644 (ESTABLISHED) 2023-11-04T01:48:17.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 43u IPv4 203669 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41658 (ESTABLISHED) 2023-11-04T01:48:17.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 44u IPv4 285175 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:46096 (ESTABLISHED) 2023-11-04T01:48:17.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 45u IPv4 286085 0t0 TCP smithi077.front.sepia.ceph.com:3300->192.168.0.1:60962 (ESTABLISHED) 2023-11-04T01:48:17.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118283 service root 47w REG 253,4 2054883 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:48:17.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:17.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root txt REG 8,1 12250256 3000 /usr/bin/ceph-mon 2023-11-04T01:48:17.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:17.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:17.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:17.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:17.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:17.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:17.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:17.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:17.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:17.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:17.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:17.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:17.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:17.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:17.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:17.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:17.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:17.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:17.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:17.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:17.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:17.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:17.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:17.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:17.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:17.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:17.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:17.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:17.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:17.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:17.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 1w FIFO 0,13 0t0 212191 pipe 2023-11-04T01:48:17.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 2w FIFO 0,13 0t0 212192 pipe 2023-11-04T01:48:17.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 3r FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 4w FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 5w REG 8,1 56346041 265464 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:17.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 6uW REG 0,24 7 1742 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:17.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 7r FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 8w FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 9u unix 0xffff9ba9084ae1c0 0t0 204497 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:17.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 10r FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 11w FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:17.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 16r REG 253,4 5622388 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:48:17.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:17.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 18u a_inode 0,14 0 3100 [eventpoll:19,27,28,37,41] 2023-11-04T01:48:17.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 19r FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 20w FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 21u a_inode 0,14 0 3100 [eventpoll:22,40,42,44] 2023-11-04T01:48:17.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 22r FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 23w FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 24u a_inode 0,14 0 3100 [eventpoll:25,38,39,43,45] 2023-11-04T01:48:17.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 25r FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 26w FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 27u IPv4 209672 0t0 TCP smithi077.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:17.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 28u IPv4 209673 0t0 TCP smithi077.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:48:17.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 29w REG 8,1 102468 265465 /var/log/ceph/ceph.log 2023-11-04T01:48:17.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 30w REG 8,1 186590 265467 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:17.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 31r FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 32w FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 33r FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 34w FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 35r FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 36w FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 37u IPv4 204526 0t0 TCP smithi077.front.sepia.ceph.com:59628->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:17.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 38u IPv4 204586 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41578 (ESTABLISHED) 2023-11-04T01:48:17.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 39u IPv4 209676 0t0 TCP smithi077.front.sepia.ceph.com:51544->smithi122.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:17.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 40u IPv4 209873 0t0 TCP smithi077.front.sepia.ceph.com:59504->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:17.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 41u IPv4 203659 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41638 (ESTABLISHED) 2023-11-04T01:48:17.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 42u IPv4 203663 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41644 (ESTABLISHED) 2023-11-04T01:48:17.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 43u IPv4 203669 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41658 (ESTABLISHED) 2023-11-04T01:48:17.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 44u IPv4 285175 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:46096 (ESTABLISHED) 2023-11-04T01:48:17.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 45u IPv4 286085 0t0 TCP smithi077.front.sepia.ceph.com:3300->192.168.0.1:60962 (ESTABLISHED) 2023-11-04T01:48:17.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118284 admin_soc root 47w REG 253,4 2054883 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:48:17.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:17.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root txt REG 8,1 12250256 3000 /usr/bin/ceph-mon 2023-11-04T01:48:17.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:17.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:17.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:17.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:17.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:17.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:17.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:17.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:17.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:17.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:17.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:17.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:17.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:17.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:17.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:17.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:17.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:17.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:17.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:17.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:17.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:17.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:17.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:17.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:17.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:17.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:17.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:17.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:17.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:17.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:17.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 1w FIFO 0,13 0t0 212191 pipe 2023-11-04T01:48:17.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 2w FIFO 0,13 0t0 212192 pipe 2023-11-04T01:48:17.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 3r FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 4w FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 5w REG 8,1 56346041 265464 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:17.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 6uW REG 0,24 7 1742 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:17.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 7r FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 8w FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 9u unix 0xffff9ba9084ae1c0 0t0 204497 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:17.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 10r FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 11w FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:17.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 16r REG 253,4 5622388 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:48:17.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:17.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 18u a_inode 0,14 0 3100 [eventpoll:19,27,28,37,41] 2023-11-04T01:48:17.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 19r FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 20w FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 21u a_inode 0,14 0 3100 [eventpoll:22,40,42,44] 2023-11-04T01:48:17.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 22r FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 23w FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 24u a_inode 0,14 0 3100 [eventpoll:25,38,39,43,45] 2023-11-04T01:48:17.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 25r FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 26w FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 27u IPv4 209672 0t0 TCP smithi077.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:17.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 28u IPv4 209673 0t0 TCP smithi077.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:48:17.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 29w REG 8,1 102468 265465 /var/log/ceph/ceph.log 2023-11-04T01:48:17.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 30w REG 8,1 186590 265467 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:17.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 31r FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 32w FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 33r FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 34w FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 35r FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 36w FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 37u IPv4 204526 0t0 TCP smithi077.front.sepia.ceph.com:59628->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:17.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 38u IPv4 204586 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41578 (ESTABLISHED) 2023-11-04T01:48:17.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 39u IPv4 209676 0t0 TCP smithi077.front.sepia.ceph.com:51544->smithi122.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:17.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 40u IPv4 209873 0t0 TCP smithi077.front.sepia.ceph.com:59504->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:17.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 41u IPv4 203659 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41638 (ESTABLISHED) 2023-11-04T01:48:17.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 42u IPv4 203663 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41644 (ESTABLISHED) 2023-11-04T01:48:17.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 43u IPv4 203669 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41658 (ESTABLISHED) 2023-11-04T01:48:17.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 44u IPv4 285175 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:46096 (ESTABLISHED) 2023-11-04T01:48:17.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 45u IPv4 286085 0t0 TCP smithi077.front.sepia.ceph.com:3300->192.168.0.1:60962 (ESTABLISHED) 2023-11-04T01:48:17.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118286 signal_ha root 47w REG 253,4 2054883 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:48:17.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:17.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root txt REG 8,1 12250256 3000 /usr/bin/ceph-mon 2023-11-04T01:48:17.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:17.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:17.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:17.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:17.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:17.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:17.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:17.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:17.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:17.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:17.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:17.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:17.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:17.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:17.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:17.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:17.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:17.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:17.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:17.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:17.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:17.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:17.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:17.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:17.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:17.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:17.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:17.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:17.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:17.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:17.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 1w FIFO 0,13 0t0 212191 pipe 2023-11-04T01:48:17.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 2w FIFO 0,13 0t0 212192 pipe 2023-11-04T01:48:17.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 3r FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 4w FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 5w REG 8,1 56346041 265464 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:17.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 6uW REG 0,24 7 1742 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:17.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 7r FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 8w FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 9u unix 0xffff9ba9084ae1c0 0t0 204497 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:17.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 10r FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 11w FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:17.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 16r REG 253,4 5622388 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:48:17.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:17.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 18u a_inode 0,14 0 3100 [eventpoll:19,27,28,37,41] 2023-11-04T01:48:17.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 19r FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 20w FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 21u a_inode 0,14 0 3100 [eventpoll:22,40,42,44] 2023-11-04T01:48:17.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 22r FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 23w FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 24u a_inode 0,14 0 3100 [eventpoll:25,38,39,43,45] 2023-11-04T01:48:17.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 25r FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 26w FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 27u IPv4 209672 0t0 TCP smithi077.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:17.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 28u IPv4 209673 0t0 TCP smithi077.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:48:17.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 29w REG 8,1 102468 265465 /var/log/ceph/ceph.log 2023-11-04T01:48:17.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 30w REG 8,1 186590 265467 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:17.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 31r FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 32w FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 33r FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 34w FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 35r FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 36w FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 37u IPv4 204526 0t0 TCP smithi077.front.sepia.ceph.com:59628->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:17.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 38u IPv4 204586 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41578 (ESTABLISHED) 2023-11-04T01:48:17.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 39u IPv4 209676 0t0 TCP smithi077.front.sepia.ceph.com:51544->smithi122.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:17.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 40u IPv4 209873 0t0 TCP smithi077.front.sepia.ceph.com:59504->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:17.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 41u IPv4 203659 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41638 (ESTABLISHED) 2023-11-04T01:48:17.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 42u IPv4 203663 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41644 (ESTABLISHED) 2023-11-04T01:48:17.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 43u IPv4 203669 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41658 (ESTABLISHED) 2023-11-04T01:48:17.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 44u IPv4 285175 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:46096 (ESTABLISHED) 2023-11-04T01:48:17.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 45u IPv4 286085 0t0 TCP smithi077.front.sepia.ceph.com:3300->192.168.0.1:60962 (ESTABLISHED) 2023-11-04T01:48:17.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118287 rocksdb:l root 47w REG 253,4 2054883 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:48:17.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:17.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root txt REG 8,1 12250256 3000 /usr/bin/ceph-mon 2023-11-04T01:48:17.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:17.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:17.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:17.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:17.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:17.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:17.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:17.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:17.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:17.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:17.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:17.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:17.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:17.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:17.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:17.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:17.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:17.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:17.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:17.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:17.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:17.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:17.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:17.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:17.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:17.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:17.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:17.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:17.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:17.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:17.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 1w FIFO 0,13 0t0 212191 pipe 2023-11-04T01:48:17.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 2w FIFO 0,13 0t0 212192 pipe 2023-11-04T01:48:17.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 3r FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 4w FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 5w REG 8,1 56346041 265464 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:17.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 6uW REG 0,24 7 1742 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:17.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 7r FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 8w FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 9u unix 0xffff9ba9084ae1c0 0t0 204497 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:17.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 10r FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 11w FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:17.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 16r REG 253,4 5622388 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:48:17.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:17.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 18u a_inode 0,14 0 3100 [eventpoll:19,27,28,37,41] 2023-11-04T01:48:17.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 19r FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 20w FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 21u a_inode 0,14 0 3100 [eventpoll:22,40,42,44] 2023-11-04T01:48:17.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 22r FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 23w FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 24u a_inode 0,14 0 3100 [eventpoll:25,38,39,43,45] 2023-11-04T01:48:17.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 25r FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 26w FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 27u IPv4 209672 0t0 TCP smithi077.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:17.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 28u IPv4 209673 0t0 TCP smithi077.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:48:17.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 29w REG 8,1 102468 265465 /var/log/ceph/ceph.log 2023-11-04T01:48:17.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 30w REG 8,1 186590 265467 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:17.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 31r FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 32w FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 33r FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 34w FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 35r FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 36w FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 37u IPv4 204526 0t0 TCP smithi077.front.sepia.ceph.com:59628->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:17.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 38u IPv4 204586 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41578 (ESTABLISHED) 2023-11-04T01:48:17.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 39u IPv4 209676 0t0 TCP smithi077.front.sepia.ceph.com:51544->smithi122.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:17.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 40u IPv4 209873 0t0 TCP smithi077.front.sepia.ceph.com:59504->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:17.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 41u IPv4 203659 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41638 (ESTABLISHED) 2023-11-04T01:48:17.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 42u IPv4 203663 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41644 (ESTABLISHED) 2023-11-04T01:48:17.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 43u IPv4 203669 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41658 (ESTABLISHED) 2023-11-04T01:48:17.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 44u IPv4 285175 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:46096 (ESTABLISHED) 2023-11-04T01:48:17.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 45u IPv4 286085 0t0 TCP smithi077.front.sepia.ceph.com:3300->192.168.0.1:60962 (ESTABLISHED) 2023-11-04T01:48:17.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118288 rocksdb:h root 47w REG 253,4 2054883 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:48:17.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:17.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root txt REG 8,1 12250256 3000 /usr/bin/ceph-mon 2023-11-04T01:48:17.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:17.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:17.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:17.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:17.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:17.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:17.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:17.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:17.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:17.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:17.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:17.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:17.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:17.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:17.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:17.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:17.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:17.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:17.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:17.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:17.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:17.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:17.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:17.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:17.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:17.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:17.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:17.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:17.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:17.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:17.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 1w FIFO 0,13 0t0 212191 pipe 2023-11-04T01:48:17.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 2w FIFO 0,13 0t0 212192 pipe 2023-11-04T01:48:17.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 3r FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 4w FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 5w REG 8,1 56346041 265464 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:17.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 6uW REG 0,24 7 1742 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:17.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 7r FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 8w FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 9u unix 0xffff9ba9084ae1c0 0t0 204497 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:17.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 10r FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 11w FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:17.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 16r REG 253,4 5622388 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:48:17.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:17.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 18u a_inode 0,14 0 3100 [eventpoll:19,27,28,37,41] 2023-11-04T01:48:17.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 19r FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 20w FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 21u a_inode 0,14 0 3100 [eventpoll:22,40,42,44] 2023-11-04T01:48:17.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 22r FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 23w FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 24u a_inode 0,14 0 3100 [eventpoll:25,38,39,43,45] 2023-11-04T01:48:17.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 25r FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 26w FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 27u IPv4 209672 0t0 TCP smithi077.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:17.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 28u IPv4 209673 0t0 TCP smithi077.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:48:17.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 29w REG 8,1 102468 265465 /var/log/ceph/ceph.log 2023-11-04T01:48:17.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 30w REG 8,1 186590 265467 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:17.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 31r FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 32w FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 33r FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 34w FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 35r FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 36w FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 37u IPv4 204526 0t0 TCP smithi077.front.sepia.ceph.com:59628->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:17.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 38u IPv4 204586 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41578 (ESTABLISHED) 2023-11-04T01:48:17.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 39u IPv4 209676 0t0 TCP smithi077.front.sepia.ceph.com:51544->smithi122.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:17.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 40u IPv4 209873 0t0 TCP smithi077.front.sepia.ceph.com:59504->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:17.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 41u IPv4 203659 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41638 (ESTABLISHED) 2023-11-04T01:48:17.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 42u IPv4 203663 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41644 (ESTABLISHED) 2023-11-04T01:48:17.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 43u IPv4 203669 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41658 (ESTABLISHED) 2023-11-04T01:48:17.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 44u IPv4 285175 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:46096 (ESTABLISHED) 2023-11-04T01:48:17.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 45u IPv4 286085 0t0 TCP smithi077.front.sepia.ceph.com:3300->192.168.0.1:60962 (ESTABLISHED) 2023-11-04T01:48:17.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118304 ceph-mon root 47w REG 253,4 2054883 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:48:17.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:17.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root txt REG 8,1 12250256 3000 /usr/bin/ceph-mon 2023-11-04T01:48:17.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:17.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:17.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:17.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:17.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:17.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:17.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:17.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:17.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:17.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:17.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:17.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:17.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:17.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:17.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:17.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:17.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:17.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:17.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:17.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:17.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:17.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:17.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:17.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:17.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:17.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:17.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:17.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:17.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:17.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:17.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 1w FIFO 0,13 0t0 212191 pipe 2023-11-04T01:48:17.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 2w FIFO 0,13 0t0 212192 pipe 2023-11-04T01:48:17.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 3r FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 4w FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 5w REG 8,1 56346041 265464 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:17.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 6uW REG 0,24 7 1742 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:17.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 7r FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 8w FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 9u unix 0xffff9ba9084ae1c0 0t0 204497 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:17.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 10r FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 11w FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:17.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 16r REG 253,4 5622388 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:48:17.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:17.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 18u a_inode 0,14 0 3100 [eventpoll:19,27,28,37,41] 2023-11-04T01:48:17.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 19r FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 20w FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 21u a_inode 0,14 0 3100 [eventpoll:22,40,42,44] 2023-11-04T01:48:17.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 22r FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 23w FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 24u a_inode 0,14 0 3100 [eventpoll:25,38,39,43,45] 2023-11-04T01:48:17.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 25r FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 26w FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 27u IPv4 209672 0t0 TCP smithi077.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:17.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 28u IPv4 209673 0t0 TCP smithi077.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:48:17.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 29w REG 8,1 102468 265465 /var/log/ceph/ceph.log 2023-11-04T01:48:17.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 30w REG 8,1 186590 265467 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:17.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 31r FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 32w FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 33r FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 34w FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 35r FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 36w FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 37u IPv4 204526 0t0 TCP smithi077.front.sepia.ceph.com:59628->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:17.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 38u IPv4 204586 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41578 (ESTABLISHED) 2023-11-04T01:48:17.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 39u IPv4 209676 0t0 TCP smithi077.front.sepia.ceph.com:51544->smithi122.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:17.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 40u IPv4 209873 0t0 TCP smithi077.front.sepia.ceph.com:59504->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:17.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 41u IPv4 203659 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41638 (ESTABLISHED) 2023-11-04T01:48:17.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 42u IPv4 203663 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41644 (ESTABLISHED) 2023-11-04T01:48:17.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 43u IPv4 203669 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41658 (ESTABLISHED) 2023-11-04T01:48:17.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 44u IPv4 285175 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:46096 (ESTABLISHED) 2023-11-04T01:48:17.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 45u IPv4 286085 0t0 TCP smithi077.front.sepia.ceph.com:3300->192.168.0.1:60962 (ESTABLISHED) 2023-11-04T01:48:17.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118305 fn_monsto root 47w REG 253,4 2054883 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:48:17.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:17.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root txt REG 8,1 12250256 3000 /usr/bin/ceph-mon 2023-11-04T01:48:17.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:17.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:17.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:17.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:17.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:17.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:17.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:17.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:17.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:17.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:17.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:17.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:17.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:17.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:17.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:17.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:17.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:17.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:17.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:17.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:17.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:17.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:17.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:17.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:17.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:17.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:17.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:17.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:17.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:17.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:17.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 1w FIFO 0,13 0t0 212191 pipe 2023-11-04T01:48:17.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 2w FIFO 0,13 0t0 212192 pipe 2023-11-04T01:48:17.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 3r FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 4w FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 5w REG 8,1 56346041 265464 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:17.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 6uW REG 0,24 7 1742 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:17.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 7r FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 8w FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 9u unix 0xffff9ba9084ae1c0 0t0 204497 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:17.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 10r FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 11w FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:17.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 16r REG 253,4 5622388 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:48:17.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:17.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 18u a_inode 0,14 0 3100 [eventpoll:19,27,28,37,41] 2023-11-04T01:48:17.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 19r FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 20w FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 21u a_inode 0,14 0 3100 [eventpoll:22,40,42,44] 2023-11-04T01:48:17.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 22r FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 23w FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 24u a_inode 0,14 0 3100 [eventpoll:25,38,39,43,45] 2023-11-04T01:48:17.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 25r FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 26w FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 27u IPv4 209672 0t0 TCP smithi077.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:17.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 28u IPv4 209673 0t0 TCP smithi077.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:48:17.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 29w REG 8,1 102468 265465 /var/log/ceph/ceph.log 2023-11-04T01:48:17.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 30w REG 8,1 186590 265467 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:17.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 31r FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 32w FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 33r FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 34w FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 35r FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 36w FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 37u IPv4 204526 0t0 TCP smithi077.front.sepia.ceph.com:59628->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:17.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 38u IPv4 204586 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41578 (ESTABLISHED) 2023-11-04T01:48:17.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 39u IPv4 209676 0t0 TCP smithi077.front.sepia.ceph.com:51544->smithi122.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:17.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 40u IPv4 209873 0t0 TCP smithi077.front.sepia.ceph.com:59504->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:17.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 41u IPv4 203659 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41638 (ESTABLISHED) 2023-11-04T01:48:17.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 42u IPv4 203663 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41644 (ESTABLISHED) 2023-11-04T01:48:17.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 43u IPv4 203669 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41658 (ESTABLISHED) 2023-11-04T01:48:17.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 44u IPv4 285175 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:46096 (ESTABLISHED) 2023-11-04T01:48:17.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 45u IPv4 286085 0t0 TCP smithi077.front.sepia.ceph.com:3300->192.168.0.1:60962 (ESTABLISHED) 2023-11-04T01:48:17.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118306 msgr-work root 47w REG 253,4 2054883 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:48:17.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:17.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root txt REG 8,1 12250256 3000 /usr/bin/ceph-mon 2023-11-04T01:48:17.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:17.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:17.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:17.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:17.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:17.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:17.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:17.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:17.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:17.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:17.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:17.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:17.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:17.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:17.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:17.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:17.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:17.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:17.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:17.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:17.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:17.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:17.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:17.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:17.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:17.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:17.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:17.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:17.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:17.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:17.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 1w FIFO 0,13 0t0 212191 pipe 2023-11-04T01:48:17.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 2w FIFO 0,13 0t0 212192 pipe 2023-11-04T01:48:17.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 3r FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 4w FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 5w REG 8,1 56346041 265464 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:17.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 6uW REG 0,24 7 1742 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:17.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 7r FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 8w FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 9u unix 0xffff9ba9084ae1c0 0t0 204497 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:17.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 10r FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 11w FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:17.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 16r REG 253,4 5622388 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:48:17.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:17.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 18u a_inode 0,14 0 3100 [eventpoll:19,27,28,37,41] 2023-11-04T01:48:17.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 19r FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 20w FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 21u a_inode 0,14 0 3100 [eventpoll:22,40,42,44] 2023-11-04T01:48:17.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 22r FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 23w FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 24u a_inode 0,14 0 3100 [eventpoll:25,38,39,43,45] 2023-11-04T01:48:17.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 25r FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 26w FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 27u IPv4 209672 0t0 TCP smithi077.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:17.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 28u IPv4 209673 0t0 TCP smithi077.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:48:17.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 29w REG 8,1 102468 265465 /var/log/ceph/ceph.log 2023-11-04T01:48:17.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 30w REG 8,1 186590 265467 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:17.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 31r FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 32w FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 33r FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 34w FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 35r FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 36w FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 37u IPv4 204526 0t0 TCP smithi077.front.sepia.ceph.com:59628->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:17.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 38u IPv4 204586 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41578 (ESTABLISHED) 2023-11-04T01:48:17.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 39u IPv4 209676 0t0 TCP smithi077.front.sepia.ceph.com:51544->smithi122.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:17.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 40u IPv4 209873 0t0 TCP smithi077.front.sepia.ceph.com:59504->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:17.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 41u IPv4 203659 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41638 (ESTABLISHED) 2023-11-04T01:48:17.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 42u IPv4 203663 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41644 (ESTABLISHED) 2023-11-04T01:48:17.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 43u IPv4 203669 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41658 (ESTABLISHED) 2023-11-04T01:48:17.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 44u IPv4 285175 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:46096 (ESTABLISHED) 2023-11-04T01:48:17.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 45u IPv4 286085 0t0 TCP smithi077.front.sepia.ceph.com:3300->192.168.0.1:60962 (ESTABLISHED) 2023-11-04T01:48:17.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118307 msgr-work root 47w REG 253,4 2054883 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:48:17.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:17.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root txt REG 8,1 12250256 3000 /usr/bin/ceph-mon 2023-11-04T01:48:17.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:17.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:17.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:17.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:17.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:17.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:17.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:17.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:17.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:17.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:17.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:17.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:17.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:17.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:17.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:17.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:17.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:17.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:17.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:17.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:17.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:17.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:17.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:17.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:17.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:17.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:17.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:17.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:17.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:17.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:17.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 1w FIFO 0,13 0t0 212191 pipe 2023-11-04T01:48:17.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 2w FIFO 0,13 0t0 212192 pipe 2023-11-04T01:48:17.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 3r FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 4w FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 5w REG 8,1 56346041 265464 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:17.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 6uW REG 0,24 7 1742 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:17.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 7r FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 8w FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 9u unix 0xffff9ba9084ae1c0 0t0 204497 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:17.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 10r FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 11w FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:17.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 16r REG 253,4 5622388 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:48:17.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:17.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 18u a_inode 0,14 0 3100 [eventpoll:19,27,28,37,41] 2023-11-04T01:48:17.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 19r FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 20w FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 21u a_inode 0,14 0 3100 [eventpoll:22,40,42,44] 2023-11-04T01:48:17.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 22r FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 23w FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 24u a_inode 0,14 0 3100 [eventpoll:25,38,39,43,45] 2023-11-04T01:48:17.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 25r FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 26w FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 27u IPv4 209672 0t0 TCP smithi077.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:17.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 28u IPv4 209673 0t0 TCP smithi077.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:48:17.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 29w REG 8,1 102468 265465 /var/log/ceph/ceph.log 2023-11-04T01:48:17.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 30w REG 8,1 186590 265467 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:17.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 31r FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 32w FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 33r FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 34w FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 35r FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 36w FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 37u IPv4 204526 0t0 TCP smithi077.front.sepia.ceph.com:59628->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:17.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 38u IPv4 204586 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41578 (ESTABLISHED) 2023-11-04T01:48:17.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 39u IPv4 209676 0t0 TCP smithi077.front.sepia.ceph.com:51544->smithi122.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:17.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 40u IPv4 209873 0t0 TCP smithi077.front.sepia.ceph.com:59504->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:17.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 41u IPv4 203659 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41638 (ESTABLISHED) 2023-11-04T01:48:17.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 42u IPv4 203663 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41644 (ESTABLISHED) 2023-11-04T01:48:17.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 43u IPv4 203669 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41658 (ESTABLISHED) 2023-11-04T01:48:17.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 44u IPv4 285175 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:46096 (ESTABLISHED) 2023-11-04T01:48:17.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 45u IPv4 286085 0t0 TCP smithi077.front.sepia.ceph.com:3300->192.168.0.1:60962 (ESTABLISHED) 2023-11-04T01:48:17.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118308 msgr-work root 47w REG 253,4 2054883 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:48:17.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:17.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root txt REG 8,1 12250256 3000 /usr/bin/ceph-mon 2023-11-04T01:48:17.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:17.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:17.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:17.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:17.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:17.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:17.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:17.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:17.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:17.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:17.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:17.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:17.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:17.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:17.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:17.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:17.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:17.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:17.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:17.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:17.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:17.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:17.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:17.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:17.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:17.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:17.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:17.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:17.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:17.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:17.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 1w FIFO 0,13 0t0 212191 pipe 2023-11-04T01:48:17.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 2w FIFO 0,13 0t0 212192 pipe 2023-11-04T01:48:17.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 3r FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 4w FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 5w REG 8,1 56346041 265464 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:17.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 6uW REG 0,24 7 1742 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:17.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 7r FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 8w FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 9u unix 0xffff9ba9084ae1c0 0t0 204497 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:17.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 10r FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 11w FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:17.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 16r REG 253,4 5622388 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:48:17.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:17.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 18u a_inode 0,14 0 3100 [eventpoll:19,27,28,37,41] 2023-11-04T01:48:17.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 19r FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 20w FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 21u a_inode 0,14 0 3100 [eventpoll:22,40,42,44] 2023-11-04T01:48:17.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 22r FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 23w FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 24u a_inode 0,14 0 3100 [eventpoll:25,38,39,43,45] 2023-11-04T01:48:17.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 25r FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 26w FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 27u IPv4 209672 0t0 TCP smithi077.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:17.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 28u IPv4 209673 0t0 TCP smithi077.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:48:17.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 29w REG 8,1 102468 265465 /var/log/ceph/ceph.log 2023-11-04T01:48:17.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 30w REG 8,1 186590 265467 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:17.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 31r FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 32w FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 33r FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 34w FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 35r FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 36w FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 37u IPv4 204526 0t0 TCP smithi077.front.sepia.ceph.com:59628->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:17.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 38u IPv4 204586 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41578 (ESTABLISHED) 2023-11-04T01:48:17.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 39u IPv4 209676 0t0 TCP smithi077.front.sepia.ceph.com:51544->smithi122.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:17.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 40u IPv4 209873 0t0 TCP smithi077.front.sepia.ceph.com:59504->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:17.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 41u IPv4 203659 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41638 (ESTABLISHED) 2023-11-04T01:48:17.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 42u IPv4 203663 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41644 (ESTABLISHED) 2023-11-04T01:48:17.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 43u IPv4 203669 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41658 (ESTABLISHED) 2023-11-04T01:48:17.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 44u IPv4 285175 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:46096 (ESTABLISHED) 2023-11-04T01:48:17.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 45u IPv4 286085 0t0 TCP smithi077.front.sepia.ceph.com:3300->192.168.0.1:60962 (ESTABLISHED) 2023-11-04T01:48:17.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118309 OpHistory root 47w REG 253,4 2054883 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:48:17.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:17.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root txt REG 8,1 12250256 3000 /usr/bin/ceph-mon 2023-11-04T01:48:17.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:17.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:17.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:17.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:17.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:17.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:17.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:17.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:17.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:17.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:17.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:17.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:17.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:17.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:17.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:17.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:17.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:17.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:17.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:17.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:17.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:17.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:17.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:17.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:17.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:17.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:17.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:17.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:17.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:17.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:17.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 1w FIFO 0,13 0t0 212191 pipe 2023-11-04T01:48:17.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 2w FIFO 0,13 0t0 212192 pipe 2023-11-04T01:48:17.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 3r FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 4w FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 5w REG 8,1 56346041 265464 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:17.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 6uW REG 0,24 7 1742 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:17.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 7r FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 8w FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 9u unix 0xffff9ba9084ae1c0 0t0 204497 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:17.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 10r FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 11w FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:17.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 16r REG 253,4 5622388 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:48:17.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:17.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 18u a_inode 0,14 0 3100 [eventpoll:19,27,28,37,41] 2023-11-04T01:48:17.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 19r FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 20w FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 21u a_inode 0,14 0 3100 [eventpoll:22,40,42,44] 2023-11-04T01:48:17.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 22r FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 23w FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 24u a_inode 0,14 0 3100 [eventpoll:25,38,39,43,45] 2023-11-04T01:48:17.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 25r FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 26w FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 27u IPv4 209672 0t0 TCP smithi077.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:17.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 28u IPv4 209673 0t0 TCP smithi077.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:48:17.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 29w REG 8,1 102468 265465 /var/log/ceph/ceph.log 2023-11-04T01:48:17.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 30w REG 8,1 186590 265467 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:17.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 31r FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 32w FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 33r FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 34w FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 35r FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 36w FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 37u IPv4 204526 0t0 TCP smithi077.front.sepia.ceph.com:59628->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:17.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 38u IPv4 204586 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41578 (ESTABLISHED) 2023-11-04T01:48:17.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 39u IPv4 209676 0t0 TCP smithi077.front.sepia.ceph.com:51544->smithi122.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:17.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 40u IPv4 209873 0t0 TCP smithi077.front.sepia.ceph.com:59504->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:17.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 41u IPv4 203659 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41638 (ESTABLISHED) 2023-11-04T01:48:17.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 42u IPv4 203663 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41644 (ESTABLISHED) 2023-11-04T01:48:17.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 43u IPv4 203669 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41658 (ESTABLISHED) 2023-11-04T01:48:17.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 44u IPv4 285175 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:46096 (ESTABLISHED) 2023-11-04T01:48:17.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 45u IPv4 286085 0t0 TCP smithi077.front.sepia.ceph.com:3300->192.168.0.1:60962 (ESTABLISHED) 2023-11-04T01:48:17.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118310 fin root 47w REG 253,4 2054883 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:48:17.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:17.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root txt REG 8,1 12250256 3000 /usr/bin/ceph-mon 2023-11-04T01:48:17.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:17.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:17.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:17.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:17.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:17.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:17.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:17.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:17.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:17.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:17.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:17.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:17.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:17.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:17.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:17.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:17.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:17.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:17.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:17.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:17.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:17.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:17.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:17.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:17.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:17.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:17.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:17.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:17.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:17.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:17.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 1w FIFO 0,13 0t0 212191 pipe 2023-11-04T01:48:17.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 2w FIFO 0,13 0t0 212192 pipe 2023-11-04T01:48:17.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 3r FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 4w FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 5w REG 8,1 56346041 265464 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:17.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 6uW REG 0,24 7 1742 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:17.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 7r FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 8w FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 9u unix 0xffff9ba9084ae1c0 0t0 204497 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:17.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 10r FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 11w FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:17.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 16r REG 253,4 5622388 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:48:17.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:17.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 18u a_inode 0,14 0 3100 [eventpoll:19,27,28,37,41] 2023-11-04T01:48:17.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 19r FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 20w FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 21u a_inode 0,14 0 3100 [eventpoll:22,40,42,44] 2023-11-04T01:48:17.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 22r FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 23w FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 24u a_inode 0,14 0 3100 [eventpoll:25,38,39,43,45] 2023-11-04T01:48:17.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 25r FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 26w FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 27u IPv4 209672 0t0 TCP smithi077.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:17.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 28u IPv4 209673 0t0 TCP smithi077.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:48:17.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 29w REG 8,1 102468 265465 /var/log/ceph/ceph.log 2023-11-04T01:48:17.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 30w REG 8,1 186590 265467 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:17.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 31r FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 32w FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 33r FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 34w FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 35r FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 36w FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 37u IPv4 204526 0t0 TCP smithi077.front.sepia.ceph.com:59628->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:17.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 38u IPv4 204586 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41578 (ESTABLISHED) 2023-11-04T01:48:17.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 39u IPv4 209676 0t0 TCP smithi077.front.sepia.ceph.com:51544->smithi122.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:17.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 40u IPv4 209873 0t0 TCP smithi077.front.sepia.ceph.com:59504->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:17.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 41u IPv4 203659 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41638 (ESTABLISHED) 2023-11-04T01:48:17.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 42u IPv4 203663 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41644 (ESTABLISHED) 2023-11-04T01:48:17.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 43u IPv4 203669 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41658 (ESTABLISHED) 2023-11-04T01:48:17.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 44u IPv4 285175 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:46096 (ESTABLISHED) 2023-11-04T01:48:17.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 45u IPv4 286085 0t0 TCP smithi077.front.sepia.ceph.com:3300->192.168.0.1:60962 (ESTABLISHED) 2023-11-04T01:48:17.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118311 safe_time root 47w REG 253,4 2054883 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:48:17.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:17.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root txt REG 8,1 12250256 3000 /usr/bin/ceph-mon 2023-11-04T01:48:17.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:17.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:17.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:17.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:17.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:17.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:17.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:17.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:17.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:17.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:17.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:17.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:17.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:17.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:17.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:17.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:17.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:17.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:17.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:17.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:17.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:17.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:17.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:17.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:17.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:17.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:17.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:17.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:17.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:17.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:17.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 1w FIFO 0,13 0t0 212191 pipe 2023-11-04T01:48:17.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 2w FIFO 0,13 0t0 212192 pipe 2023-11-04T01:48:17.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 3r FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 4w FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 5w REG 8,1 56346041 265464 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:17.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 6uW REG 0,24 7 1742 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:17.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 7r FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 8w FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 9u unix 0xffff9ba9084ae1c0 0t0 204497 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:17.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 10r FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 11w FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:17.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 16r REG 253,4 5622388 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:48:17.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:17.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 18u a_inode 0,14 0 3100 [eventpoll:19,27,28,37,41] 2023-11-04T01:48:17.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 19r FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 20w FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 21u a_inode 0,14 0 3100 [eventpoll:22,40,42,44] 2023-11-04T01:48:17.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 22r FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 23w FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 24u a_inode 0,14 0 3100 [eventpoll:25,38,39,43,45] 2023-11-04T01:48:17.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 25r FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 26w FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 27u IPv4 209672 0t0 TCP smithi077.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:17.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 28u IPv4 209673 0t0 TCP smithi077.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:48:17.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 29w REG 8,1 102468 265465 /var/log/ceph/ceph.log 2023-11-04T01:48:17.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 30w REG 8,1 186590 265467 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:17.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 31r FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 32w FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 33r FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 34w FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 35r FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 36w FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 37u IPv4 204526 0t0 TCP smithi077.front.sepia.ceph.com:59628->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:17.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 38u IPv4 204586 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41578 (ESTABLISHED) 2023-11-04T01:48:17.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 39u IPv4 209676 0t0 TCP smithi077.front.sepia.ceph.com:51544->smithi122.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:17.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 40u IPv4 209873 0t0 TCP smithi077.front.sepia.ceph.com:59504->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:17.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 41u IPv4 203659 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41638 (ESTABLISHED) 2023-11-04T01:48:17.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 42u IPv4 203663 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41644 (ESTABLISHED) 2023-11-04T01:48:17.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 43u IPv4 203669 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41658 (ESTABLISHED) 2023-11-04T01:48:17.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 44u IPv4 285175 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:46096 (ESTABLISHED) 2023-11-04T01:48:17.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 45u IPv4 286085 0t0 TCP smithi077.front.sepia.ceph.com:3300->192.168.0.1:60962 (ESTABLISHED) 2023-11-04T01:48:17.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118312 cpu_tp root 47w REG 253,4 2054883 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:48:17.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:17.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root txt REG 8,1 12250256 3000 /usr/bin/ceph-mon 2023-11-04T01:48:17.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:17.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:17.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:17.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:17.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:17.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:17.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:17.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:17.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:17.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:17.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:17.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:17.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:17.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:17.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:17.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:17.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:17.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:17.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:17.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:17.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:17.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:17.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:17.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:17.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:17.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:17.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:17.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:17.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:17.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:17.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 1w FIFO 0,13 0t0 212191 pipe 2023-11-04T01:48:17.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 2w FIFO 0,13 0t0 212192 pipe 2023-11-04T01:48:17.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 3r FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 4w FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 5w REG 8,1 56346041 265464 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:17.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 6uW REG 0,24 7 1742 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:17.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 7r FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 8w FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 9u unix 0xffff9ba9084ae1c0 0t0 204497 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:17.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 10r FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 11w FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:17.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 16r REG 253,4 5622388 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:48:17.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:17.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 18u a_inode 0,14 0 3100 [eventpoll:19,27,28,37,41] 2023-11-04T01:48:17.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 19r FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 20w FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 21u a_inode 0,14 0 3100 [eventpoll:22,40,42,44] 2023-11-04T01:48:17.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 22r FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 23w FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 24u a_inode 0,14 0 3100 [eventpoll:25,38,39,43,45] 2023-11-04T01:48:17.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 25r FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 26w FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 27u IPv4 209672 0t0 TCP smithi077.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:17.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 28u IPv4 209673 0t0 TCP smithi077.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:48:17.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 29w REG 8,1 102468 265465 /var/log/ceph/ceph.log 2023-11-04T01:48:17.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 30w REG 8,1 186590 265467 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:17.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 31r FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 32w FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 33r FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 34w FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 35r FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 36w FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 37u IPv4 204526 0t0 TCP smithi077.front.sepia.ceph.com:59628->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:17.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 38u IPv4 204586 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41578 (ESTABLISHED) 2023-11-04T01:48:17.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 39u IPv4 209676 0t0 TCP smithi077.front.sepia.ceph.com:51544->smithi122.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:17.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 40u IPv4 209873 0t0 TCP smithi077.front.sepia.ceph.com:59504->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:17.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 41u IPv4 203659 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41638 (ESTABLISHED) 2023-11-04T01:48:17.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 42u IPv4 203663 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41644 (ESTABLISHED) 2023-11-04T01:48:17.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 43u IPv4 203669 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41658 (ESTABLISHED) 2023-11-04T01:48:17.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 44u IPv4 285175 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:46096 (ESTABLISHED) 2023-11-04T01:48:17.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 45u IPv4 286085 0t0 TCP smithi077.front.sepia.ceph.com:3300->192.168.0.1:60962 (ESTABLISHED) 2023-11-04T01:48:17.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118313 cpu_tp root 47w REG 253,4 2054883 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:48:17.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:17.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root txt REG 8,1 12250256 3000 /usr/bin/ceph-mon 2023-11-04T01:48:17.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:17.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:17.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:17.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:17.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:17.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:17.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:17.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:17.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:17.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:17.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:17.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:17.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:17.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:17.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:17.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:17.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:17.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:17.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:17.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:17.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:17.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:17.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:17.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:17.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:17.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:17.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:17.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:17.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:17.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:17.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 1w FIFO 0,13 0t0 212191 pipe 2023-11-04T01:48:17.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 2w FIFO 0,13 0t0 212192 pipe 2023-11-04T01:48:17.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 3r FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 4w FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 5w REG 8,1 56346041 265464 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:17.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 6uW REG 0,24 7 1742 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:17.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 7r FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 8w FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 9u unix 0xffff9ba9084ae1c0 0t0 204497 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:17.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 10r FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 11w FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:17.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 16r REG 253,4 5622388 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:48:17.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:17.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 18u a_inode 0,14 0 3100 [eventpoll:19,27,28,37,41] 2023-11-04T01:48:17.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 19r FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 20w FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 21u a_inode 0,14 0 3100 [eventpoll:22,40,42,44] 2023-11-04T01:48:17.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 22r FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 23w FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 24u a_inode 0,14 0 3100 [eventpoll:25,38,39,43,45] 2023-11-04T01:48:17.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 25r FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 26w FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 27u IPv4 209672 0t0 TCP smithi077.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:17.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 28u IPv4 209673 0t0 TCP smithi077.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:48:17.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 29w REG 8,1 102468 265465 /var/log/ceph/ceph.log 2023-11-04T01:48:17.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 30w REG 8,1 186590 265467 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:17.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 31r FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 32w FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 33r FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 34w FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 35r FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 36w FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 37u IPv4 204526 0t0 TCP smithi077.front.sepia.ceph.com:59628->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:17.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 38u IPv4 204586 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41578 (ESTABLISHED) 2023-11-04T01:48:17.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 39u IPv4 209676 0t0 TCP smithi077.front.sepia.ceph.com:51544->smithi122.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:17.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 40u IPv4 209873 0t0 TCP smithi077.front.sepia.ceph.com:59504->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:17.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 41u IPv4 203659 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41638 (ESTABLISHED) 2023-11-04T01:48:17.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 42u IPv4 203663 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41644 (ESTABLISHED) 2023-11-04T01:48:17.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 43u IPv4 203669 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41658 (ESTABLISHED) 2023-11-04T01:48:17.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 44u IPv4 285175 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:46096 (ESTABLISHED) 2023-11-04T01:48:17.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 45u IPv4 286085 0t0 TCP smithi077.front.sepia.ceph.com:3300->192.168.0.1:60962 (ESTABLISHED) 2023-11-04T01:48:17.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118314 cpu_tp root 47w REG 253,4 2054883 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:48:17.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:17.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root txt REG 8,1 12250256 3000 /usr/bin/ceph-mon 2023-11-04T01:48:17.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:17.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:17.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:17.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:17.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:17.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:17.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:17.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:17.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:17.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:17.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:17.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:17.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:17.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:17.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:17.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:17.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:17.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:17.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:17.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:17.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:17.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:17.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:17.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:17.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:17.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:17.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:17.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:17.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:17.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:17.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 1w FIFO 0,13 0t0 212191 pipe 2023-11-04T01:48:17.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 2w FIFO 0,13 0t0 212192 pipe 2023-11-04T01:48:17.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 3r FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 4w FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 5w REG 8,1 56346041 265464 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:17.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 6uW REG 0,24 7 1742 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:17.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 7r FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 8w FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 9u unix 0xffff9ba9084ae1c0 0t0 204497 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:17.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 10r FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 11w FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:17.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 16r REG 253,4 5622388 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:48:17.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:17.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 18u a_inode 0,14 0 3100 [eventpoll:19,27,28,37,41] 2023-11-04T01:48:17.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 19r FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 20w FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 21u a_inode 0,14 0 3100 [eventpoll:22,40,42,44] 2023-11-04T01:48:17.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 22r FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 23w FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 24u a_inode 0,14 0 3100 [eventpoll:25,38,39,43,45] 2023-11-04T01:48:17.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 25r FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 26w FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 27u IPv4 209672 0t0 TCP smithi077.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:17.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 28u IPv4 209673 0t0 TCP smithi077.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:48:17.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 29w REG 8,1 102468 265465 /var/log/ceph/ceph.log 2023-11-04T01:48:17.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 30w REG 8,1 186590 265467 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:17.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 31r FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 32w FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 33r FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 34w FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 35r FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 36w FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 37u IPv4 204526 0t0 TCP smithi077.front.sepia.ceph.com:59628->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:17.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 38u IPv4 204586 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41578 (ESTABLISHED) 2023-11-04T01:48:17.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 39u IPv4 209676 0t0 TCP smithi077.front.sepia.ceph.com:51544->smithi122.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:17.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 40u IPv4 209873 0t0 TCP smithi077.front.sepia.ceph.com:59504->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:17.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 41u IPv4 203659 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41638 (ESTABLISHED) 2023-11-04T01:48:17.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 42u IPv4 203663 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41644 (ESTABLISHED) 2023-11-04T01:48:17.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 43u IPv4 203669 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41658 (ESTABLISHED) 2023-11-04T01:48:17.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 44u IPv4 285175 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:46096 (ESTABLISHED) 2023-11-04T01:48:17.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 45u IPv4 286085 0t0 TCP smithi077.front.sepia.ceph.com:3300->192.168.0.1:60962 (ESTABLISHED) 2023-11-04T01:48:17.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118315 cpu_tp root 47w REG 253,4 2054883 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:48:17.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:17.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root txt REG 8,1 12250256 3000 /usr/bin/ceph-mon 2023-11-04T01:48:17.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:17.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:17.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:17.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:17.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:17.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:17.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:17.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:17.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:17.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:17.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:17.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:17.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:17.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:17.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:17.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:17.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:17.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:17.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:17.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:17.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:17.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:17.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:17.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:17.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:17.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:17.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:17.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:17.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:17.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:17.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 1w FIFO 0,13 0t0 212191 pipe 2023-11-04T01:48:17.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 2w FIFO 0,13 0t0 212192 pipe 2023-11-04T01:48:17.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 3r FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 4w FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 5w REG 8,1 56346041 265464 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:17.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 6uW REG 0,24 7 1742 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:17.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 7r FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 8w FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 9u unix 0xffff9ba9084ae1c0 0t0 204497 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:17.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 10r FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 11w FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:17.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 16r REG 253,4 5622388 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:48:17.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:17.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 18u a_inode 0,14 0 3100 [eventpoll:19,27,28,37,41] 2023-11-04T01:48:17.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 19r FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 20w FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 21u a_inode 0,14 0 3100 [eventpoll:22,40,42,44] 2023-11-04T01:48:17.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 22r FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 23w FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 24u a_inode 0,14 0 3100 [eventpoll:25,38,39,43,45] 2023-11-04T01:48:17.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 25r FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 26w FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 27u IPv4 209672 0t0 TCP smithi077.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:17.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 28u IPv4 209673 0t0 TCP smithi077.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:48:17.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 29w REG 8,1 102468 265465 /var/log/ceph/ceph.log 2023-11-04T01:48:17.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 30w REG 8,1 186590 265467 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:17.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 31r FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 32w FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 33r FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 34w FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 35r FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 36w FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 37u IPv4 204526 0t0 TCP smithi077.front.sepia.ceph.com:59628->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:17.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 38u IPv4 204586 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41578 (ESTABLISHED) 2023-11-04T01:48:17.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 39u IPv4 209676 0t0 TCP smithi077.front.sepia.ceph.com:51544->smithi122.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:17.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 40u IPv4 209873 0t0 TCP smithi077.front.sepia.ceph.com:59504->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:17.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 41u IPv4 203659 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41638 (ESTABLISHED) 2023-11-04T01:48:17.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 42u IPv4 203663 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41644 (ESTABLISHED) 2023-11-04T01:48:17.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 43u IPv4 203669 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41658 (ESTABLISHED) 2023-11-04T01:48:17.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 44u IPv4 285175 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:46096 (ESTABLISHED) 2023-11-04T01:48:17.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 45u IPv4 286085 0t0 TCP smithi077.front.sepia.ceph.com:3300->192.168.0.1:60962 (ESTABLISHED) 2023-11-04T01:48:17.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118316 ms_dispat root 47w REG 253,4 2054883 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:48:17.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:17.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root txt REG 8,1 12250256 3000 /usr/bin/ceph-mon 2023-11-04T01:48:17.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:17.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:17.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:17.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:17.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:17.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:17.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:17.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:17.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:17.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:17.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:17.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:17.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:17.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:17.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:17.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:17.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:17.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:17.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:17.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:17.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:17.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:17.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:17.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:17.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:17.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:17.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:17.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:17.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:17.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:17.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 1w FIFO 0,13 0t0 212191 pipe 2023-11-04T01:48:17.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 2w FIFO 0,13 0t0 212192 pipe 2023-11-04T01:48:17.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 3r FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 4w FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 5w REG 8,1 56346041 265464 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:17.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 6uW REG 0,24 7 1742 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:17.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 7r FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 8w FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 9u unix 0xffff9ba9084ae1c0 0t0 204497 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:17.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 10r FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 11w FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:17.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 16r REG 253,4 5622388 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:48:17.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:17.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 18u a_inode 0,14 0 3100 [eventpoll:19,27,28,37,41] 2023-11-04T01:48:17.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 19r FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 20w FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 21u a_inode 0,14 0 3100 [eventpoll:22,40,42,44] 2023-11-04T01:48:17.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 22r FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 23w FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 24u a_inode 0,14 0 3100 [eventpoll:25,38,39,43,45] 2023-11-04T01:48:17.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 25r FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 26w FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 27u IPv4 209672 0t0 TCP smithi077.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:17.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 28u IPv4 209673 0t0 TCP smithi077.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:48:17.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 29w REG 8,1 102468 265465 /var/log/ceph/ceph.log 2023-11-04T01:48:17.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 30w REG 8,1 186590 265467 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:17.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 31r FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 32w FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 33r FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 34w FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 35r FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 36w FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 37u IPv4 204526 0t0 TCP smithi077.front.sepia.ceph.com:59628->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:17.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 38u IPv4 204586 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41578 (ESTABLISHED) 2023-11-04T01:48:17.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 39u IPv4 209676 0t0 TCP smithi077.front.sepia.ceph.com:51544->smithi122.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:17.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 40u IPv4 209873 0t0 TCP smithi077.front.sepia.ceph.com:59504->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:17.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 41u IPv4 203659 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41638 (ESTABLISHED) 2023-11-04T01:48:17.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 42u IPv4 203663 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41644 (ESTABLISHED) 2023-11-04T01:48:17.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 43u IPv4 203669 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41658 (ESTABLISHED) 2023-11-04T01:48:17.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 44u IPv4 285175 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:46096 (ESTABLISHED) 2023-11-04T01:48:17.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 45u IPv4 286085 0t0 TCP smithi077.front.sepia.ceph.com:3300->192.168.0.1:60962 (ESTABLISHED) 2023-11-04T01:48:17.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118317 ms_local root 47w REG 253,4 2054883 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:48:17.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:17.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root txt REG 8,1 12250256 3000 /usr/bin/ceph-mon 2023-11-04T01:48:17.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:17.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:17.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:17.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:17.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:17.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:17.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:17.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:17.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:17.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:17.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:17.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:17.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:17.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:17.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:17.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:17.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:17.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:17.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:17.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:17.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:17.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:17.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:17.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:17.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:17.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:17.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:17.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:17.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:17.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:17.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 1w FIFO 0,13 0t0 212191 pipe 2023-11-04T01:48:17.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 2w FIFO 0,13 0t0 212192 pipe 2023-11-04T01:48:17.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 3r FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 4w FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 5w REG 8,1 56346041 265464 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:17.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 6uW REG 0,24 7 1742 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:17.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 7r FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 8w FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 9u unix 0xffff9ba9084ae1c0 0t0 204497 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:17.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 10r FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 11w FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:17.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 16r REG 253,4 5622388 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:48:17.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:17.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 18u a_inode 0,14 0 3100 [eventpoll:19,27,28,37,41] 2023-11-04T01:48:17.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 19r FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 20w FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 21u a_inode 0,14 0 3100 [eventpoll:22,40,42,44] 2023-11-04T01:48:17.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 22r FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 23w FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 24u a_inode 0,14 0 3100 [eventpoll:25,38,39,43,45] 2023-11-04T01:48:17.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 25r FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 26w FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 27u IPv4 209672 0t0 TCP smithi077.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:17.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 28u IPv4 209673 0t0 TCP smithi077.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:48:17.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 29w REG 8,1 102468 265465 /var/log/ceph/ceph.log 2023-11-04T01:48:17.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 30w REG 8,1 186590 265467 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:17.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 31r FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 32w FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 33r FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 34w FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 35r FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 36w FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 37u IPv4 204526 0t0 TCP smithi077.front.sepia.ceph.com:59628->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:17.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 38u IPv4 204586 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41578 (ESTABLISHED) 2023-11-04T01:48:17.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 39u IPv4 209676 0t0 TCP smithi077.front.sepia.ceph.com:51544->smithi122.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:17.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 40u IPv4 209873 0t0 TCP smithi077.front.sepia.ceph.com:59504->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:17.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 41u IPv4 203659 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41638 (ESTABLISHED) 2023-11-04T01:48:17.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 42u IPv4 203663 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41644 (ESTABLISHED) 2023-11-04T01:48:17.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 43u IPv4 203669 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41658 (ESTABLISHED) 2023-11-04T01:48:17.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 44u IPv4 285175 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:46096 (ESTABLISHED) 2023-11-04T01:48:17.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 45u IPv4 286085 0t0 TCP smithi077.front.sepia.ceph.com:3300->192.168.0.1:60962 (ESTABLISHED) 2023-11-04T01:48:17.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118318 safe_time root 47w REG 253,4 2054883 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:48:17.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:17.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root txt REG 8,1 12250256 3000 /usr/bin/ceph-mon 2023-11-04T01:48:17.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:17.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:17.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:17.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:17.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:17.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:17.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:17.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:17.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:17.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:17.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:17.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:17.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:17.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:17.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:17.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:17.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:17.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:17.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:17.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:17.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:17.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:17.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:17.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:17.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:17.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:17.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:17.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:17.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:17.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:17.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 1w FIFO 0,13 0t0 212191 pipe 2023-11-04T01:48:17.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 2w FIFO 0,13 0t0 212192 pipe 2023-11-04T01:48:17.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 3r FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 4w FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 5w REG 8,1 56346041 265464 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:17.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 6uW REG 0,24 7 1742 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:17.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 7r FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 8w FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 9u unix 0xffff9ba9084ae1c0 0t0 204497 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:17.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 10r FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 11w FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:17.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 16r REG 253,4 5622388 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:48:17.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:17.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 18u a_inode 0,14 0 3100 [eventpoll:19,27,28,37,41] 2023-11-04T01:48:17.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 19r FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 20w FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 21u a_inode 0,14 0 3100 [eventpoll:22,40,42,44] 2023-11-04T01:48:17.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 22r FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 23w FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 24u a_inode 0,14 0 3100 [eventpoll:25,38,39,43,45] 2023-11-04T01:48:17.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 25r FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 26w FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 27u IPv4 209672 0t0 TCP smithi077.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:17.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 28u IPv4 209673 0t0 TCP smithi077.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:48:17.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 29w REG 8,1 102468 265465 /var/log/ceph/ceph.log 2023-11-04T01:48:17.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 30w REG 8,1 186590 265467 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:17.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 31r FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 32w FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 33r FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 34w FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 35r FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 36w FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 37u IPv4 204526 0t0 TCP smithi077.front.sepia.ceph.com:59628->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:17.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 38u IPv4 204586 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41578 (ESTABLISHED) 2023-11-04T01:48:17.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 39u IPv4 209676 0t0 TCP smithi077.front.sepia.ceph.com:51544->smithi122.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:17.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 40u IPv4 209873 0t0 TCP smithi077.front.sepia.ceph.com:59504->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:17.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 41u IPv4 203659 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41638 (ESTABLISHED) 2023-11-04T01:48:17.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 42u IPv4 203663 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41644 (ESTABLISHED) 2023-11-04T01:48:17.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 43u IPv4 203669 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41658 (ESTABLISHED) 2023-11-04T01:48:17.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 44u IPv4 285175 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:46096 (ESTABLISHED) 2023-11-04T01:48:17.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 45u IPv4 286085 0t0 TCP smithi077.front.sepia.ceph.com:3300->192.168.0.1:60962 (ESTABLISHED) 2023-11-04T01:48:17.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118319 ms_dispat root 47w REG 253,4 2054883 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:48:17.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:17.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root txt REG 8,1 12250256 3000 /usr/bin/ceph-mon 2023-11-04T01:48:17.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:17.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:17.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:17.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:17.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:17.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:17.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:17.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:17.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:17.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:17.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:17.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:17.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:17.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:17.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:17.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:17.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:17.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:17.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:17.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:17.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:17.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:17.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:17.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:17.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:17.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:17.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:17.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:17.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:17.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:17.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 1w FIFO 0,13 0t0 212191 pipe 2023-11-04T01:48:17.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 2w FIFO 0,13 0t0 212192 pipe 2023-11-04T01:48:17.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 3r FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 4w FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 5w REG 8,1 56346041 265464 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:17.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 6uW REG 0,24 7 1742 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:17.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 7r FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 8w FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 9u unix 0xffff9ba9084ae1c0 0t0 204497 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:17.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 10r FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 11w FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:17.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 16r REG 253,4 5622388 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:48:17.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:17.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 18u a_inode 0,14 0 3100 [eventpoll:19,27,28,37,41] 2023-11-04T01:48:17.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 19r FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 20w FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 21u a_inode 0,14 0 3100 [eventpoll:22,40,42,44] 2023-11-04T01:48:17.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 22r FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 23w FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 24u a_inode 0,14 0 3100 [eventpoll:25,38,39,43,45] 2023-11-04T01:48:17.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 25r FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 26w FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 27u IPv4 209672 0t0 TCP smithi077.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:17.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 28u IPv4 209673 0t0 TCP smithi077.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:48:17.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 29w REG 8,1 102468 265465 /var/log/ceph/ceph.log 2023-11-04T01:48:17.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 30w REG 8,1 186590 265467 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:17.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 31r FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 32w FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 33r FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 34w FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 35r FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 36w FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 37u IPv4 204526 0t0 TCP smithi077.front.sepia.ceph.com:59628->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:17.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 38u IPv4 204586 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41578 (ESTABLISHED) 2023-11-04T01:48:17.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 39u IPv4 209676 0t0 TCP smithi077.front.sepia.ceph.com:51544->smithi122.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:17.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 40u IPv4 209873 0t0 TCP smithi077.front.sepia.ceph.com:59504->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:17.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 41u IPv4 203659 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41638 (ESTABLISHED) 2023-11-04T01:48:17.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 42u IPv4 203663 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41644 (ESTABLISHED) 2023-11-04T01:48:17.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 43u IPv4 203669 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41658 (ESTABLISHED) 2023-11-04T01:48:17.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 44u IPv4 285175 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:46096 (ESTABLISHED) 2023-11-04T01:48:17.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 45u IPv4 286085 0t0 TCP smithi077.front.sepia.ceph.com:3300->192.168.0.1:60962 (ESTABLISHED) 2023-11-04T01:48:17.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 118320 ms_local root 47w REG 253,4 2054883 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:48:17.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:17.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root txt REG 8,1 12250256 3000 /usr/bin/ceph-mon 2023-11-04T01:48:17.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:17.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:17.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:17.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:17.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:17.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:17.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:17.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:17.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:17.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:17.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:17.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:17.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:17.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:17.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:17.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:17.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:17.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:17.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:17.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:17.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:17.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:17.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:17.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:17.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:17.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:17.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:17.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:17.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:17.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:17.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:17.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 1w FIFO 0,13 0t0 212191 pipe 2023-11-04T01:48:17.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 2w FIFO 0,13 0t0 212192 pipe 2023-11-04T01:48:17.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 3r FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 4w FIFO 0,13 0t0 204494 pipe 2023-11-04T01:48:17.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 5w REG 8,1 56346041 265464 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:48:17.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 6uW REG 0,24 7 1742 /run/ceph/ceph-mon.a.pid 2023-11-04T01:48:17.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 7r FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 8w FIFO 0,13 0t0 204496 pipe 2023-11-04T01:48:17.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 9u unix 0xffff9ba9084ae1c0 0t0 204497 /var/run/ceph/ceph-mon.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:17.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 10r FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 11w FIFO 0,13 0t0 204498 pipe 2023-11-04T01:48:17.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 12r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 13uW REG 253,4 0 33816711 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:48:17.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 14r DIR 253,4 4096 33816710 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:48:17.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 16r REG 253,4 5622388 33816717 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:48:17.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 17w REG 253,4 416 33816719 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:48:17.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 18u a_inode 0,14 0 3100 [eventpoll:19,27,28,37,41] 2023-11-04T01:48:17.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 19r FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 20w FIFO 0,13 0t0 204504 pipe 2023-11-04T01:48:17.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 21u a_inode 0,14 0 3100 [eventpoll:22,40,42,44] 2023-11-04T01:48:17.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 22r FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 23w FIFO 0,13 0t0 204505 pipe 2023-11-04T01:48:17.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 24u a_inode 0,14 0 3100 [eventpoll:25,38,39,43,45] 2023-11-04T01:48:17.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 25r FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 26w FIFO 0,13 0t0 204506 pipe 2023-11-04T01:48:17.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 27u IPv4 209672 0t0 TCP smithi077.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:48:17.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 28u IPv4 209673 0t0 TCP smithi077.front.sepia.ceph.com:smc-https (LISTEN) 2023-11-04T01:48:17.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 29w REG 8,1 102468 265465 /var/log/ceph/ceph.log 2023-11-04T01:48:17.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 30w REG 8,1 186590 265467 /var/log/ceph/ceph.audit.log 2023-11-04T01:48:17.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 31r FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 32w FIFO 0,13 0t0 210386 pipe 2023-11-04T01:48:17.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 33r FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 34w FIFO 0,13 0t0 210387 pipe 2023-11-04T01:48:17.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 35r FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 36w FIFO 0,13 0t0 210388 pipe 2023-11-04T01:48:17.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 37u IPv4 204526 0t0 TCP smithi077.front.sepia.ceph.com:59628->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:17.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 38u IPv4 204586 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41578 (ESTABLISHED) 2023-11-04T01:48:17.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 39u IPv4 209676 0t0 TCP smithi077.front.sepia.ceph.com:51544->smithi122.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:17.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 40u IPv4 209873 0t0 TCP smithi077.front.sepia.ceph.com:59504->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:17.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 41u IPv4 203659 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41638 (ESTABLISHED) 2023-11-04T01:48:17.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 42u IPv4 203663 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41644 (ESTABLISHED) 2023-11-04T01:48:17.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 43u IPv4 203669 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:41658 (ESTABLISHED) 2023-11-04T01:48:17.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 44u IPv4 285175 0t0 TCP smithi077.front.sepia.ceph.com:3300->smithi077.front.sepia.ceph.com:46096 (ESTABLISHED) 2023-11-04T01:48:17.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 45u IPv4 286085 0t0 TCP smithi077.front.sepia.ceph.com:3300->192.168.0.1:60962 (ESTABLISHED) 2023-11-04T01:48:17.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mon 118268 151985 rstore_co root 47w REG 253,4 2054883 33816715 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:48:17.892 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118280 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:17.892 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118280 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.892 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118280 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:48:17.893 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118280 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:17.893 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118280 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:48:17.893 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118280 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.893 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118280 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.893 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118280 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.894 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118280 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.894 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118280 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.894 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118280 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.894 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118280 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.894 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118280 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.895 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118280 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:17.895 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118280 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.895 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118280 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:48:17.895 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118280 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.895 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118280 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.896 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118280 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.896 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118280 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.896 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118280 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:17.896 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118280 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.896 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118280 root 0r FIFO 0,13 0t0 212216 pipe 2023-11-04T01:48:17.896 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118280 root 1w FIFO 0,13 0t0 212217 pipe 2023-11-04T01:48:17.897 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118280 root 2w FIFO 0,13 0t0 212218 pipe 2023-11-04T01:48:17.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:17.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root txt REG 8,1 4625312 1455 /usr/bin/ceph-mgr 2023-11-04T01:48:17.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:48:17.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 65240 274226 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 783584 273561 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 87608 273564 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 331936 273539 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 654400 273572 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 41112936 2651 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:48:17.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 60264 273566 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 96304 273562 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 237384 273541 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 177920 273567 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 7042240 272930 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:48:17.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 70784 273563 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 73976 273347 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 155704 273449 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 2883920 2365 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:48:17.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 3870704 2663 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:48:17.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 3784896 272980 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 132136 272979 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:48:17.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 382824 272931 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:48:17.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 299952 2361 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:48:17.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 8003360 1612 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:48:17.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 20504 273450 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 40328 272928 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:48:17.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:48:17.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:48:17.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:48:17.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 1129568 2812 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:48:17.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:48:17.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:48:17.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 721976 270393 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:17.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 2154416 270395 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:48:17.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 16192 266087 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:17.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:48:17.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 2103760 1932 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:48:17.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 515320 2374 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:17.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 198136 2468 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 49328 270932 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:17.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:48:17.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 1129032 1934 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:17.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:17.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:17.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:17.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:17.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:17.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:17.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:17.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:17.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:17.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:17.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:17.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:17.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:17.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:17.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:17.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:17.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:17.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:17.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:17.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:17.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:17.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:17.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:17.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:17.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:17.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:17.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 1892920 1591 /usr/lib64/librados.so.2.0.0 2023-11-04T01:48:17.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:48:17.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:17.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:17.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:48:17.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 435816 2224 /usr/lib64/libcephsqlite.so 2023-11-04T01:48:17.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root 1w FIFO 0,13 0t0 212217 pipe 2023-11-04T01:48:17.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root 2w FIFO 0,13 0t0 212218 pipe 2023-11-04T01:48:17.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root 3r FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:17.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root 4w FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:17.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root 5u a_inode 0,14 0 3100 [eventpoll:6,25] 2023-11-04T01:48:17.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root 6r FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:17.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root 7w FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:17.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root 8u a_inode 0,14 0 3100 [eventpoll:9,23] 2023-11-04T01:48:17.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root 9r FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:17.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root 10w FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:17.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root 11u a_inode 0,14 0 3100 [eventpoll:12] 2023-11-04T01:48:17.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root 12r FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:17.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root 13w FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:17.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root 14w REG 8,1 663581 265466 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:17.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root 15uW REG 0,24 7 1745 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:17.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root 16r FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:17.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root 17w FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:17.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root 18u unix 0xffff9ba908670880 0t0 205743 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:48:17.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root 19r FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:17.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root 20w FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:17.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root 21r FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:17.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root 22w FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:17.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root 23u IPv4 205808 0t0 TCP smithi077.front.sepia.ceph.com:56722->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:17.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 root 25u IPv4 209746 0t0 TCP smithi077.front.sepia.ceph.com:41578->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:17.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:17.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root txt REG 8,1 4625312 1455 /usr/bin/ceph-mgr 2023-11-04T01:48:17.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:48:17.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 65240 274226 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 783584 273561 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 87608 273564 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 331936 273539 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 654400 273572 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 41112936 2651 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:48:17.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 60264 273566 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 96304 273562 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 237384 273541 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 177920 273567 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 7042240 272930 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:48:17.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 70784 273563 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 73976 273347 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 155704 273449 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 2883920 2365 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:48:17.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 3870704 2663 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:48:17.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 3784896 272980 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 132136 272979 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:48:17.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 382824 272931 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:48:17.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 299952 2361 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:48:17.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 8003360 1612 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:48:17.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 20504 273450 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 40328 272928 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:48:17.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:48:17.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:48:17.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:48:17.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 1129568 2812 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:48:17.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:48:17.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:48:17.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 721976 270393 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:17.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 2154416 270395 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:48:17.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 16192 266087 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:17.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:48:17.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 2103760 1932 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:48:17.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 515320 2374 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:17.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 198136 2468 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 49328 270932 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:17.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:48:17.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 1129032 1934 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:17.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:17.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:17.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:17.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:17.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:17.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:17.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:17.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:17.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:17.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:17.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:17.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:17.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:17.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:17.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:17.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:17.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:17.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:17.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:17.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:17.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:17.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:17.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:17.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:17.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:17.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:17.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 1892920 1591 /usr/lib64/librados.so.2.0.0 2023-11-04T01:48:17.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:48:17.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:17.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:17.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:48:17.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 435816 2224 /usr/lib64/libcephsqlite.so 2023-11-04T01:48:17.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root 1w FIFO 0,13 0t0 212217 pipe 2023-11-04T01:48:17.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root 2w FIFO 0,13 0t0 212218 pipe 2023-11-04T01:48:17.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root 3r FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:17.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root 4w FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:17.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root 5u a_inode 0,14 0 3100 [eventpoll:6,25] 2023-11-04T01:48:17.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root 6r FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:17.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root 7w FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:17.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root 8u a_inode 0,14 0 3100 [eventpoll:9,23] 2023-11-04T01:48:17.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root 9r FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:17.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root 10w FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:17.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root 11u a_inode 0,14 0 3100 [eventpoll:12] 2023-11-04T01:48:17.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root 12r FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:17.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root 13w FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:17.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root 14w REG 8,1 663581 265466 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:17.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root 15uW REG 0,24 7 1745 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:17.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root 16r FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:17.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root 17w FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:17.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root 18u unix 0xffff9ba908670880 0t0 205743 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:48:17.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root 19r FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:17.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root 20w FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:17.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root 21r FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:17.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root 22w FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:17.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root 23u IPv4 205808 0t0 TCP smithi077.front.sepia.ceph.com:56722->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:17.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118322 log root 25u IPv4 209746 0t0 TCP smithi077.front.sepia.ceph.com:41578->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:17.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:17.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root txt REG 8,1 4625312 1455 /usr/bin/ceph-mgr 2023-11-04T01:48:17.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:48:17.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 65240 274226 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 783584 273561 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 87608 273564 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 331936 273539 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 654400 273572 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 41112936 2651 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:48:17.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 60264 273566 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 96304 273562 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 237384 273541 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 177920 273567 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 7042240 272930 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:48:17.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 70784 273563 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 73976 273347 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 155704 273449 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 2883920 2365 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:48:17.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 3870704 2663 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:48:17.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 3784896 272980 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 132136 272979 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:48:17.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 382824 272931 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:48:17.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 299952 2361 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:48:17.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 8003360 1612 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:48:17.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 20504 273450 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 40328 272928 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:48:17.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:48:17.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:48:17.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:48:17.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 1129568 2812 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:48:17.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:48:17.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:48:17.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 721976 270393 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:17.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 2154416 270395 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:48:17.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 16192 266087 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:17.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:48:17.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 2103760 1932 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:48:17.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 515320 2374 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:17.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 198136 2468 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 49328 270932 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:17.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:48:17.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 1129032 1934 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:17.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:17.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:17.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:17.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:17.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:17.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:17.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:17.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:17.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:17.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:17.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:17.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:17.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:17.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:17.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:17.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:17.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:17.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:17.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:17.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:17.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:17.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:17.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:17.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:17.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:17.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:17.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:17.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:17.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:17.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:17.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:17.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:17.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:17.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:17.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:17.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:17.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:17.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:17.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 1892920 1591 /usr/lib64/librados.so.2.0.0 2023-11-04T01:48:17.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:48:17.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:17.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:17.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:17.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:17.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:17.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:17.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:17.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:48:17.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 435816 2224 /usr/lib64/libcephsqlite.so 2023-11-04T01:48:17.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:17.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:17.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root 1w FIFO 0,13 0t0 212217 pipe 2023-11-04T01:48:17.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root 2w FIFO 0,13 0t0 212218 pipe 2023-11-04T01:48:17.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root 3r FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:17.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root 4w FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:17.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root 5u a_inode 0,14 0 3100 [eventpoll:6,25] 2023-11-04T01:48:17.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root 6r FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:17.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root 7w FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:17.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root 8u a_inode 0,14 0 3100 [eventpoll:9,23] 2023-11-04T01:48:17.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root 9r FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:17.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root 10w FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:17.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root 11u a_inode 0,14 0 3100 [eventpoll:12] 2023-11-04T01:48:17.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root 12r FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:17.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root 13w FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:17.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root 14w REG 8,1 663581 265466 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:17.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root 15uW REG 0,24 7 1745 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:17.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root 16r FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:17.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root 17w FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:17.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root 18u unix 0xffff9ba908670880 0t0 205743 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:48:17.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root 19r FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:17.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root 20w FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:17.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root 21r FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:17.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root 22w FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:17.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root 23u IPv4 205808 0t0 TCP smithi077.front.sepia.ceph.com:56722->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:17.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118324 msgr-work root 25u IPv4 209746 0t0 TCP smithi077.front.sepia.ceph.com:41578->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:17.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:17.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:17.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root txt REG 8,1 4625312 1455 /usr/bin/ceph-mgr 2023-11-04T01:48:17.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:48:17.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 65240 274226 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 783584 273561 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 87608 273564 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 331936 273539 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 654400 273572 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 41112936 2651 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:48:17.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 60264 273566 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 96304 273562 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 237384 273541 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 177920 273567 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 7042240 272930 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:48:17.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 70784 273563 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 73976 273347 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 155704 273449 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 2883920 2365 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:48:17.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 3870704 2663 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:48:17.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 3784896 272980 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 132136 272979 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:48:17.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 382824 272931 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:48:17.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 299952 2361 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:48:17.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 8003360 1612 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:48:17.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 20504 273450 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 40328 272928 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:48:17.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:48:17.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:48:17.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:48:17.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 1129568 2812 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:48:17.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:48:17.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:48:17.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 721976 270393 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:17.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 2154416 270395 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:48:17.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 16192 266087 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:17.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:48:17.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 2103760 1932 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:48:17.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 515320 2374 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:17.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 198136 2468 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 49328 270932 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:17.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:17.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:48:18.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 1129032 1934 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:18.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:18.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:18.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:18.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:18.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:18.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:18.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:18.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:18.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:18.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:18.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:18.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:18.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:18.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:18.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:18.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:18.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:18.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:18.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:18.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:18.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:18.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:18.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:18.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:18.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:18.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:18.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:18.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:18.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:18.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:18.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:18.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:18.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:18.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:18.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:18.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:18.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:18.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 1892920 1591 /usr/lib64/librados.so.2.0.0 2023-11-04T01:48:18.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:48:18.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:18.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:18.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:18.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:18.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:18.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:48:18.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 435816 2224 /usr/lib64/libcephsqlite.so 2023-11-04T01:48:18.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:18.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root 1w FIFO 0,13 0t0 212217 pipe 2023-11-04T01:48:18.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root 2w FIFO 0,13 0t0 212218 pipe 2023-11-04T01:48:18.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root 3r FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:18.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root 4w FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:18.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root 5u a_inode 0,14 0 3100 [eventpoll:6,25] 2023-11-04T01:48:18.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root 6r FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:18.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root 7w FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:18.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root 8u a_inode 0,14 0 3100 [eventpoll:9,23] 2023-11-04T01:48:18.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root 9r FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:18.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root 10w FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:18.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root 11u a_inode 0,14 0 3100 [eventpoll:12] 2023-11-04T01:48:18.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root 12r FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:18.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root 13w FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:18.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root 14w REG 8,1 663581 265466 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:18.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root 15uW REG 0,24 7 1745 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:18.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root 16r FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:18.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root 17w FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:18.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root 18u unix 0xffff9ba908670880 0t0 205743 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:48:18.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root 19r FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:18.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root 20w FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:18.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root 21r FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:18.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root 22w FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:18.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root 23u IPv4 205808 0t0 TCP smithi077.front.sepia.ceph.com:56722->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:18.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118325 msgr-work root 25u IPv4 209746 0t0 TCP smithi077.front.sepia.ceph.com:41578->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:18.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root txt REG 8,1 4625312 1455 /usr/bin/ceph-mgr 2023-11-04T01:48:18.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:48:18.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 65240 274226 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 783584 273561 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 87608 273564 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 331936 273539 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 654400 273572 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 41112936 2651 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:48:18.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 60264 273566 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 96304 273562 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 237384 273541 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 177920 273567 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 7042240 272930 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:48:18.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 70784 273563 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 73976 273347 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 155704 273449 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 2883920 2365 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:48:18.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 3870704 2663 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:48:18.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 3784896 272980 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 132136 272979 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:48:18.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 382824 272931 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:48:18.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 299952 2361 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:48:18.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 8003360 1612 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:48:18.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 20504 273450 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 40328 272928 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:48:18.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:48:18.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:48:18.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:48:18.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 1129568 2812 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:48:18.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:48:18.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:48:18.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 721976 270393 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:18.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 2154416 270395 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:48:18.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 16192 266087 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:18.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:48:18.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 2103760 1932 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:48:18.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 515320 2374 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:18.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 198136 2468 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 49328 270932 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:18.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:48:18.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 1129032 1934 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:18.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:18.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:18.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:18.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:18.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:18.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:18.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:18.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:18.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:18.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:18.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:18.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:18.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:18.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:18.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:18.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:18.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:18.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:18.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:18.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:18.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:18.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:18.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:18.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:18.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:18.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:18.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:18.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:18.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:18.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:18.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:18.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:18.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:18.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:18.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:18.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:18.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:18.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 1892920 1591 /usr/lib64/librados.so.2.0.0 2023-11-04T01:48:18.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:48:18.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:18.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:18.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:18.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:18.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:18.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:48:18.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 435816 2224 /usr/lib64/libcephsqlite.so 2023-11-04T01:48:18.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:18.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root 1w FIFO 0,13 0t0 212217 pipe 2023-11-04T01:48:18.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root 2w FIFO 0,13 0t0 212218 pipe 2023-11-04T01:48:18.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root 3r FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:18.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root 4w FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:18.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root 5u a_inode 0,14 0 3100 [eventpoll:6,25] 2023-11-04T01:48:18.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root 6r FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:18.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root 7w FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:18.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root 8u a_inode 0,14 0 3100 [eventpoll:9,23] 2023-11-04T01:48:18.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root 9r FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:18.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root 10w FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:18.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root 11u a_inode 0,14 0 3100 [eventpoll:12] 2023-11-04T01:48:18.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root 12r FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:18.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root 13w FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:18.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root 14w REG 8,1 663581 265466 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:18.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root 15uW REG 0,24 7 1745 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:18.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root 16r FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:18.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root 17w FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:18.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root 18u unix 0xffff9ba908670880 0t0 205743 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:48:18.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root 19r FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:18.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root 20w FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:18.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root 21r FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:18.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root 22w FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:18.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root 23u IPv4 205808 0t0 TCP smithi077.front.sepia.ceph.com:56722->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:18.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118326 msgr-work root 25u IPv4 209746 0t0 TCP smithi077.front.sepia.ceph.com:41578->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:18.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root txt REG 8,1 4625312 1455 /usr/bin/ceph-mgr 2023-11-04T01:48:18.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:48:18.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 65240 274226 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 783584 273561 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 87608 273564 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 331936 273539 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 654400 273572 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 41112936 2651 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:48:18.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 60264 273566 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 96304 273562 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 237384 273541 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 177920 273567 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 7042240 272930 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:48:18.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 70784 273563 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 73976 273347 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 155704 273449 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 2883920 2365 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:48:18.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 3870704 2663 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:48:18.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 3784896 272980 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 132136 272979 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:48:18.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 382824 272931 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:48:18.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 299952 2361 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:48:18.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 8003360 1612 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:48:18.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 20504 273450 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 40328 272928 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:48:18.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:48:18.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:48:18.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:48:18.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 1129568 2812 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:48:18.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:48:18.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:48:18.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 721976 270393 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:18.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 2154416 270395 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:48:18.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 16192 266087 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:18.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:48:18.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 2103760 1932 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:48:18.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 515320 2374 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:18.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 198136 2468 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 49328 270932 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:18.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:48:18.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 1129032 1934 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:18.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:18.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:18.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:18.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:18.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:18.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:18.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:18.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:18.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:18.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:18.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:18.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:18.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:18.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:18.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:18.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:18.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:18.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:18.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:18.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:18.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:18.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:18.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:18.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:18.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:18.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:18.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:18.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:18.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:18.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:18.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:18.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:18.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:18.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:18.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:18.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:18.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:18.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 1892920 1591 /usr/lib64/librados.so.2.0.0 2023-11-04T01:48:18.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:48:18.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:18.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:18.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:18.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:18.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:18.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:48:18.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 435816 2224 /usr/lib64/libcephsqlite.so 2023-11-04T01:48:18.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:18.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root 1w FIFO 0,13 0t0 212217 pipe 2023-11-04T01:48:18.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root 2w FIFO 0,13 0t0 212218 pipe 2023-11-04T01:48:18.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root 3r FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:18.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root 4w FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:18.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root 5u a_inode 0,14 0 3100 [eventpoll:6,25] 2023-11-04T01:48:18.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root 6r FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:18.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root 7w FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:18.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root 8u a_inode 0,14 0 3100 [eventpoll:9,23] 2023-11-04T01:48:18.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root 9r FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:18.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root 10w FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:18.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root 11u a_inode 0,14 0 3100 [eventpoll:12] 2023-11-04T01:48:18.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root 12r FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:18.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root 13w FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:18.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root 14w REG 8,1 663581 265466 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:18.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root 15uW REG 0,24 7 1745 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:18.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root 16r FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:18.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root 17w FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:18.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root 18u unix 0xffff9ba908670880 0t0 205743 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:48:18.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root 19r FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:18.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root 20w FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:18.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root 21r FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:18.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root 22w FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:18.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root 23u IPv4 205808 0t0 TCP smithi077.front.sepia.ceph.com:56722->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:18.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118424 service root 25u IPv4 209746 0t0 TCP smithi077.front.sepia.ceph.com:41578->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:18.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root txt REG 8,1 4625312 1455 /usr/bin/ceph-mgr 2023-11-04T01:48:18.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:48:18.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 65240 274226 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 783584 273561 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 87608 273564 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 331936 273539 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 654400 273572 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 41112936 2651 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:48:18.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 60264 273566 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 96304 273562 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 237384 273541 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 177920 273567 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 7042240 272930 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:48:18.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 70784 273563 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 73976 273347 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 155704 273449 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 2883920 2365 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:48:18.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 3870704 2663 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:48:18.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 3784896 272980 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 132136 272979 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:48:18.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 382824 272931 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:48:18.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 299952 2361 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:48:18.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 8003360 1612 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:48:18.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 20504 273450 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 40328 272928 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:48:18.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:48:18.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:48:18.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:48:18.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 1129568 2812 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:48:18.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:48:18.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:48:18.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 721976 270393 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:18.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 2154416 270395 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:48:18.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 16192 266087 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:18.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:48:18.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 2103760 1932 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:48:18.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 515320 2374 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:18.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 198136 2468 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 49328 270932 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:18.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:48:18.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 1129032 1934 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:18.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:18.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:18.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:18.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:18.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:18.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:18.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:18.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:18.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:18.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:18.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:18.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:18.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:18.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:18.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:18.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:18.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:18.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:18.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:18.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:18.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:18.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:18.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:18.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:18.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:18.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:18.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:18.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:18.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:18.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:18.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:18.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:18.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:18.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:18.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:18.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:18.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:18.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 1892920 1591 /usr/lib64/librados.so.2.0.0 2023-11-04T01:48:18.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:48:18.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:18.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:18.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:18.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:18.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:18.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:48:18.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 435816 2224 /usr/lib64/libcephsqlite.so 2023-11-04T01:48:18.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:18.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root 1w FIFO 0,13 0t0 212217 pipe 2023-11-04T01:48:18.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root 2w FIFO 0,13 0t0 212218 pipe 2023-11-04T01:48:18.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root 3r FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:18.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root 4w FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:18.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root 5u a_inode 0,14 0 3100 [eventpoll:6,25] 2023-11-04T01:48:18.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root 6r FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:18.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root 7w FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:18.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root 8u a_inode 0,14 0 3100 [eventpoll:9,23] 2023-11-04T01:48:18.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root 9r FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:18.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root 10w FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:18.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root 11u a_inode 0,14 0 3100 [eventpoll:12] 2023-11-04T01:48:18.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root 12r FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:18.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root 13w FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:18.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root 14w REG 8,1 663581 265466 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:18.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root 15uW REG 0,24 7 1745 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:18.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root 16r FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:18.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root 17w FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:18.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root 18u unix 0xffff9ba908670880 0t0 205743 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:48:18.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root 19r FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:18.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root 20w FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:18.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root 21r FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:18.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root 22w FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:18.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root 23u IPv4 205808 0t0 TCP smithi077.front.sepia.ceph.com:56722->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:18.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118425 admin_soc root 25u IPv4 209746 0t0 TCP smithi077.front.sepia.ceph.com:41578->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:18.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root txt REG 8,1 4625312 1455 /usr/bin/ceph-mgr 2023-11-04T01:48:18.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:48:18.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 65240 274226 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 783584 273561 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 87608 273564 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 331936 273539 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 654400 273572 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 41112936 2651 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:48:18.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 60264 273566 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 96304 273562 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 237384 273541 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 177920 273567 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 7042240 272930 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:48:18.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 70784 273563 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 73976 273347 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 155704 273449 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 2883920 2365 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:48:18.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 3870704 2663 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:48:18.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 3784896 272980 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 132136 272979 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:48:18.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 382824 272931 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:48:18.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 299952 2361 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:48:18.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 8003360 1612 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:48:18.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 20504 273450 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 40328 272928 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:48:18.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:48:18.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:48:18.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:48:18.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 1129568 2812 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:48:18.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:48:18.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:48:18.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 721976 270393 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:18.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 2154416 270395 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:48:18.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 16192 266087 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:18.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:48:18.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 2103760 1932 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:48:18.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 515320 2374 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:18.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 198136 2468 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 49328 270932 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:18.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:48:18.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 1129032 1934 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:18.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:18.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:18.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:18.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:18.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:18.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:18.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:18.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:18.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:18.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:18.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:18.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:18.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:18.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:18.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:18.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:18.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:18.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:18.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:18.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:18.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:18.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:18.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:18.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:18.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:18.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:18.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:18.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:18.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:18.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:18.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:18.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:18.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:18.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:18.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:18.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:18.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:18.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 1892920 1591 /usr/lib64/librados.so.2.0.0 2023-11-04T01:48:18.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:48:18.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:18.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:18.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:18.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:18.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:18.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:48:18.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 435816 2224 /usr/lib64/libcephsqlite.so 2023-11-04T01:48:18.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:18.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root 1w FIFO 0,13 0t0 212217 pipe 2023-11-04T01:48:18.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root 2w FIFO 0,13 0t0 212218 pipe 2023-11-04T01:48:18.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root 3r FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:18.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root 4w FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:18.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root 5u a_inode 0,14 0 3100 [eventpoll:6,25] 2023-11-04T01:48:18.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root 6r FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:18.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root 7w FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:18.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root 8u a_inode 0,14 0 3100 [eventpoll:9,23] 2023-11-04T01:48:18.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root 9r FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:18.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root 10w FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:18.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root 11u a_inode 0,14 0 3100 [eventpoll:12] 2023-11-04T01:48:18.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root 12r FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:18.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root 13w FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:18.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root 14w REG 8,1 663581 265466 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:18.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root 15uW REG 0,24 7 1745 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:18.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root 16r FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:18.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root 17w FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:18.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root 18u unix 0xffff9ba908670880 0t0 205743 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:48:18.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root 19r FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:18.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root 20w FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:18.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root 21r FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:18.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root 22w FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:18.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root 23u IPv4 205808 0t0 TCP smithi077.front.sepia.ceph.com:56722->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:18.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118426 ceph_time root 25u IPv4 209746 0t0 TCP smithi077.front.sepia.ceph.com:41578->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:18.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root txt REG 8,1 4625312 1455 /usr/bin/ceph-mgr 2023-11-04T01:48:18.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:48:18.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 65240 274226 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 783584 273561 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 87608 273564 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 331936 273539 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 654400 273572 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 41112936 2651 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:48:18.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 60264 273566 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 96304 273562 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 237384 273541 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 177920 273567 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 7042240 272930 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:48:18.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 70784 273563 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 73976 273347 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 155704 273449 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 2883920 2365 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:48:18.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 3870704 2663 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:48:18.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 3784896 272980 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 132136 272979 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:48:18.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 382824 272931 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:48:18.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 299952 2361 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:48:18.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 8003360 1612 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:48:18.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 20504 273450 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 40328 272928 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:48:18.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:48:18.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:48:18.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:48:18.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 1129568 2812 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:48:18.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:48:18.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:48:18.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 721976 270393 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:18.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 2154416 270395 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:48:18.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 16192 266087 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:18.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:48:18.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 2103760 1932 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:48:18.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 515320 2374 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:18.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 198136 2468 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 49328 270932 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:18.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:48:18.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 1129032 1934 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:18.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:18.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:18.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:18.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:18.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:18.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:18.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:18.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:18.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:18.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:18.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:18.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:18.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:18.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:18.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:18.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:18.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:18.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:18.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:18.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:18.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:18.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:18.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:18.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:18.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:18.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:18.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:18.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:18.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:18.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:18.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:18.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:18.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:18.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:18.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:18.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:18.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:18.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 1892920 1591 /usr/lib64/librados.so.2.0.0 2023-11-04T01:48:18.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:48:18.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:18.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:18.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:18.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:18.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:18.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:48:18.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 435816 2224 /usr/lib64/libcephsqlite.so 2023-11-04T01:48:18.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:18.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root 1w FIFO 0,13 0t0 212217 pipe 2023-11-04T01:48:18.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root 2w FIFO 0,13 0t0 212218 pipe 2023-11-04T01:48:18.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root 3r FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:18.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root 4w FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:18.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root 5u a_inode 0,14 0 3100 [eventpoll:6,25] 2023-11-04T01:48:18.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root 6r FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:18.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root 7w FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:18.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root 8u a_inode 0,14 0 3100 [eventpoll:9,23] 2023-11-04T01:48:18.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root 9r FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:18.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root 10w FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:18.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root 11u a_inode 0,14 0 3100 [eventpoll:12] 2023-11-04T01:48:18.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root 12r FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:18.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root 13w FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:18.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root 14w REG 8,1 663581 265466 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:18.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root 15uW REG 0,24 7 1745 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:18.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root 16r FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:18.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root 17w FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:18.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root 18u unix 0xffff9ba908670880 0t0 205743 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:48:18.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root 19r FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:18.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root 20w FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:18.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root 21r FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:18.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root 22w FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:18.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root 23u IPv4 205808 0t0 TCP smithi077.front.sepia.ceph.com:56722->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:18.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118427 fn_anonym root 25u IPv4 209746 0t0 TCP smithi077.front.sepia.ceph.com:41578->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:18.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root txt REG 8,1 4625312 1455 /usr/bin/ceph-mgr 2023-11-04T01:48:18.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:48:18.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 65240 274226 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 783584 273561 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 87608 273564 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 331936 273539 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 654400 273572 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 41112936 2651 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:48:18.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 60264 273566 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 96304 273562 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 237384 273541 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 177920 273567 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 7042240 272930 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:48:18.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 70784 273563 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 73976 273347 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 155704 273449 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 2883920 2365 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:48:18.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 3870704 2663 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:48:18.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 3784896 272980 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 132136 272979 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:48:18.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 382824 272931 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:48:18.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 299952 2361 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:48:18.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 8003360 1612 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:48:18.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 20504 273450 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 40328 272928 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:48:18.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:48:18.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:48:18.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:48:18.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 1129568 2812 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:48:18.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:48:18.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:48:18.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 721976 270393 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:18.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 2154416 270395 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:48:18.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 16192 266087 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:18.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:48:18.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 2103760 1932 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:48:18.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 515320 2374 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:18.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 198136 2468 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 49328 270932 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:18.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:48:18.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 1129032 1934 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:18.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:18.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:18.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:18.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:18.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:18.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:18.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:18.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:18.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:18.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:18.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:18.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:18.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:18.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:18.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:18.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:18.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:18.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:18.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:18.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:18.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:18.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:18.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:18.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:18.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:18.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:18.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:18.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:18.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:18.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:18.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:18.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:18.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:18.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:18.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:18.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:18.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:18.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 1892920 1591 /usr/lib64/librados.so.2.0.0 2023-11-04T01:48:18.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:48:18.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:18.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:18.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:18.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:18.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:18.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:48:18.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 435816 2224 /usr/lib64/libcephsqlite.so 2023-11-04T01:48:18.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:18.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root 1w FIFO 0,13 0t0 212217 pipe 2023-11-04T01:48:18.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root 2w FIFO 0,13 0t0 212218 pipe 2023-11-04T01:48:18.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root 3r FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:18.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root 4w FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:18.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root 5u a_inode 0,14 0 3100 [eventpoll:6,25] 2023-11-04T01:48:18.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root 6r FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:18.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root 7w FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:18.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root 8u a_inode 0,14 0 3100 [eventpoll:9,23] 2023-11-04T01:48:18.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root 9r FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:18.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root 10w FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:18.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root 11u a_inode 0,14 0 3100 [eventpoll:12] 2023-11-04T01:48:18.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root 12r FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:18.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root 13w FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:18.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root 14w REG 8,1 663581 265466 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:18.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root 15uW REG 0,24 7 1745 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:18.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root 16r FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:18.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root 17w FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:18.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root 18u unix 0xffff9ba908670880 0t0 205743 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:48:18.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root 19r FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:18.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root 20w FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:18.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root 21r FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:18.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root 22w FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:18.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root 23u IPv4 205808 0t0 TCP smithi077.front.sepia.ceph.com:56722->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:18.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118428 signal_ha root 25u IPv4 209746 0t0 TCP smithi077.front.sepia.ceph.com:41578->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:18.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root txt REG 8,1 4625312 1455 /usr/bin/ceph-mgr 2023-11-04T01:48:18.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:48:18.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 65240 274226 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 783584 273561 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 87608 273564 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 331936 273539 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 654400 273572 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 41112936 2651 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:48:18.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 60264 273566 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 96304 273562 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 237384 273541 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 177920 273567 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 7042240 272930 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:48:18.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 70784 273563 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 73976 273347 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 155704 273449 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 2883920 2365 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:48:18.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 3870704 2663 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:48:18.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 3784896 272980 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 132136 272979 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:48:18.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 382824 272931 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:48:18.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 299952 2361 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:48:18.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 8003360 1612 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:48:18.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 20504 273450 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 40328 272928 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:48:18.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:48:18.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:48:18.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:48:18.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 1129568 2812 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:48:18.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:48:18.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:48:18.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 721976 270393 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:18.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 2154416 270395 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:48:18.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 16192 266087 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:18.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:48:18.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 2103760 1932 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:48:18.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 515320 2374 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:18.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 198136 2468 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 49328 270932 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:18.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:48:18.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 1129032 1934 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:18.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:18.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:18.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:18.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:18.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:18.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:18.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:18.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:18.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:18.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:18.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:18.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:18.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:18.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:18.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:18.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:18.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:18.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:18.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:18.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:18.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:18.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:18.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:18.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:18.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:18.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:18.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:18.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:18.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:18.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:18.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:18.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:18.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:18.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:18.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:18.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:18.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:18.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 1892920 1591 /usr/lib64/librados.so.2.0.0 2023-11-04T01:48:18.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:48:18.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:18.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:18.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:18.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:18.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:18.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:48:18.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 435816 2224 /usr/lib64/libcephsqlite.so 2023-11-04T01:48:18.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:18.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root 1w FIFO 0,13 0t0 212217 pipe 2023-11-04T01:48:18.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root 2w FIFO 0,13 0t0 212218 pipe 2023-11-04T01:48:18.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root 3r FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:18.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root 4w FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:18.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root 5u a_inode 0,14 0 3100 [eventpoll:6,25] 2023-11-04T01:48:18.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root 6r FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:18.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root 7w FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:18.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root 8u a_inode 0,14 0 3100 [eventpoll:9,23] 2023-11-04T01:48:18.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root 9r FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:18.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root 10w FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:18.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root 11u a_inode 0,14 0 3100 [eventpoll:12] 2023-11-04T01:48:18.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root 12r FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:18.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root 13w FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:18.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root 14w REG 8,1 663581 265466 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:18.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root 15uW REG 0,24 7 1745 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:18.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root 16r FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:18.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root 17w FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:18.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root 18u unix 0xffff9ba908670880 0t0 205743 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:48:18.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root 19r FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:18.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root 20w FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:18.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root 21r FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:18.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root 22w FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:18.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root 23u IPv4 205808 0t0 TCP smithi077.front.sepia.ceph.com:56722->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:18.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118429 mgrsb-fin root 25u IPv4 209746 0t0 TCP smithi077.front.sepia.ceph.com:41578->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:18.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root txt REG 8,1 4625312 1455 /usr/bin/ceph-mgr 2023-11-04T01:48:18.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:48:18.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 65240 274226 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 783584 273561 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 87608 273564 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 331936 273539 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 654400 273572 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 41112936 2651 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:48:18.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 60264 273566 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 96304 273562 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 237384 273541 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 177920 273567 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 7042240 272930 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:48:18.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 70784 273563 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 73976 273347 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 155704 273449 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 2883920 2365 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:48:18.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 3870704 2663 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:48:18.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 3784896 272980 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 132136 272979 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:48:18.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 382824 272931 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:48:18.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 299952 2361 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:48:18.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 8003360 1612 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:48:18.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 20504 273450 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 40328 272928 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:48:18.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:48:18.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:48:18.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:48:18.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 1129568 2812 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:48:18.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:48:18.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:48:18.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 721976 270393 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:18.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 2154416 270395 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:48:18.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 16192 266087 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:18.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:48:18.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 2103760 1932 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:48:18.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 515320 2374 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:18.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 198136 2468 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 49328 270932 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:18.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:48:18.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 1129032 1934 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:18.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:18.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:18.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:18.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:18.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:18.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:18.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:18.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:18.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:18.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:18.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:18.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:18.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:18.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:18.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:18.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:18.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:18.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:18.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:18.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:18.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:18.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:18.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:18.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:18.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:18.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:18.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:18.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:18.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:18.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:18.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:18.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:18.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:18.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:18.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:18.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:18.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:18.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 1892920 1591 /usr/lib64/librados.so.2.0.0 2023-11-04T01:48:18.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:48:18.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:18.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:18.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:18.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:18.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:18.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:48:18.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 435816 2224 /usr/lib64/libcephsqlite.so 2023-11-04T01:48:18.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:18.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root 1w FIFO 0,13 0t0 212217 pipe 2023-11-04T01:48:18.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root 2w FIFO 0,13 0t0 212218 pipe 2023-11-04T01:48:18.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root 3r FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:18.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root 4w FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:18.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root 5u a_inode 0,14 0 3100 [eventpoll:6,25] 2023-11-04T01:48:18.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root 6r FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:18.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root 7w FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:18.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root 8u a_inode 0,14 0 3100 [eventpoll:9,23] 2023-11-04T01:48:18.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root 9r FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:18.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root 10w FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:18.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root 11u a_inode 0,14 0 3100 [eventpoll:12] 2023-11-04T01:48:18.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root 12r FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:18.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root 13w FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:18.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root 14w REG 8,1 663581 265466 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:18.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root 15uW REG 0,24 7 1745 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:18.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root 16r FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:18.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root 17w FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:18.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root 18u unix 0xffff9ba908670880 0t0 205743 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:48:18.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root 19r FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:18.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root 20w FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:18.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root 21r FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:18.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root 22w FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:18.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root 23u IPv4 205808 0t0 TCP smithi077.front.sepia.ceph.com:56722->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:18.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118430 ms_dispat root 25u IPv4 209746 0t0 TCP smithi077.front.sepia.ceph.com:41578->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:18.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root txt REG 8,1 4625312 1455 /usr/bin/ceph-mgr 2023-11-04T01:48:18.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:48:18.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 65240 274226 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 783584 273561 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 87608 273564 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 331936 273539 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 654400 273572 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 41112936 2651 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:48:18.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 60264 273566 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 96304 273562 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 237384 273541 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 177920 273567 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 7042240 272930 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:48:18.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 70784 273563 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 73976 273347 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 155704 273449 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 2883920 2365 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:48:18.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 3870704 2663 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:48:18.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 3784896 272980 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 132136 272979 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:48:18.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 382824 272931 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:48:18.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 299952 2361 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:48:18.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 8003360 1612 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:48:18.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 20504 273450 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 40328 272928 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:48:18.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:48:18.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:48:18.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:48:18.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 1129568 2812 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:48:18.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:48:18.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:48:18.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 721976 270393 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:18.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 2154416 270395 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:48:18.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 16192 266087 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:18.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:48:18.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 2103760 1932 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:48:18.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 515320 2374 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:18.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 198136 2468 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 49328 270932 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:18.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:48:18.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 1129032 1934 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:18.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:18.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:18.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:18.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:18.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:18.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:18.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:18.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:18.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:18.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:18.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:18.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:18.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:18.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:18.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:18.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:18.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:18.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:18.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:18.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:18.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:18.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:18.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:18.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:18.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:18.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:18.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:18.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:18.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:18.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:18.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:18.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:18.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:18.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:18.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:18.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:18.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:18.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 1892920 1591 /usr/lib64/librados.so.2.0.0 2023-11-04T01:48:18.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:48:18.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:18.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:18.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:18.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:18.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:18.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:48:18.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 435816 2224 /usr/lib64/libcephsqlite.so 2023-11-04T01:48:18.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:18.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root 1w FIFO 0,13 0t0 212217 pipe 2023-11-04T01:48:18.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root 2w FIFO 0,13 0t0 212218 pipe 2023-11-04T01:48:18.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root 3r FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:18.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root 4w FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:18.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root 5u a_inode 0,14 0 3100 [eventpoll:6,25] 2023-11-04T01:48:18.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root 6r FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:18.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root 7w FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:18.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root 8u a_inode 0,14 0 3100 [eventpoll:9,23] 2023-11-04T01:48:18.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root 9r FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:18.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root 10w FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:18.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root 11u a_inode 0,14 0 3100 [eventpoll:12] 2023-11-04T01:48:18.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root 12r FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:18.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root 13w FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:18.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root 14w REG 8,1 663581 265466 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:18.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root 15uW REG 0,24 7 1745 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:18.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root 16r FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:18.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root 17w FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:18.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root 18u unix 0xffff9ba908670880 0t0 205743 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:48:18.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root 19r FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:18.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root 20w FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:18.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root 21r FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:18.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root 22w FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:18.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root 23u IPv4 205808 0t0 TCP smithi077.front.sepia.ceph.com:56722->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:18.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118431 ms_local root 25u IPv4 209746 0t0 TCP smithi077.front.sepia.ceph.com:41578->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:18.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root txt REG 8,1 4625312 1455 /usr/bin/ceph-mgr 2023-11-04T01:48:18.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:48:18.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 65240 274226 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 783584 273561 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 87608 273564 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 331936 273539 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 654400 273572 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 41112936 2651 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:48:18.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 60264 273566 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 96304 273562 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 237384 273541 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 177920 273567 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 7042240 272930 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:48:18.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 70784 273563 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 73976 273347 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 155704 273449 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 2883920 2365 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:48:18.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 3870704 2663 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:48:18.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 3784896 272980 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 132136 272979 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:48:18.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 382824 272931 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:48:18.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 299952 2361 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:48:18.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 8003360 1612 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:48:18.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 20504 273450 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 40328 272928 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:48:18.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:48:18.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:48:18.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:48:18.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 1129568 2812 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:48:18.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:48:18.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:48:18.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 721976 270393 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:18.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 2154416 270395 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:48:18.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 16192 266087 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:18.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:48:18.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 2103760 1932 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:48:18.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 515320 2374 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:18.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 198136 2468 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 49328 270932 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:18.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:48:18.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 1129032 1934 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:18.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:18.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:18.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:18.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:18.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:18.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:18.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:18.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:18.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:18.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:18.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:18.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:18.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:18.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:18.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:18.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:18.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:18.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:18.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:18.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:18.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:18.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:18.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:18.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:18.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:18.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:18.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:18.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:18.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:18.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:18.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:18.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:18.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:18.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:18.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:18.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:18.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:18.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 1892920 1591 /usr/lib64/librados.so.2.0.0 2023-11-04T01:48:18.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:48:18.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:18.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:18.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:18.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:18.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:18.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:48:18.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 435816 2224 /usr/lib64/libcephsqlite.so 2023-11-04T01:48:18.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:18.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root 1w FIFO 0,13 0t0 212217 pipe 2023-11-04T01:48:18.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root 2w FIFO 0,13 0t0 212218 pipe 2023-11-04T01:48:18.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root 3r FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:18.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root 4w FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:18.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root 5u a_inode 0,14 0 3100 [eventpoll:6,25] 2023-11-04T01:48:18.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root 6r FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:18.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root 7w FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:18.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root 8u a_inode 0,14 0 3100 [eventpoll:9,23] 2023-11-04T01:48:18.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root 9r FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:18.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root 10w FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:18.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root 11u a_inode 0,14 0 3100 [eventpoll:12] 2023-11-04T01:48:18.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root 12r FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:18.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root 13w FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:18.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root 14w REG 8,1 663581 265466 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:18.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root 15uW REG 0,24 7 1745 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:18.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root 16r FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:18.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root 17w FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:18.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root 18u unix 0xffff9ba908670880 0t0 205743 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:48:18.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root 19r FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:18.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root 20w FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:18.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root 21r FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:18.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root 22w FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:18.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root 23u IPv4 205808 0t0 TCP smithi077.front.sepia.ceph.com:56722->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:18.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118432 io_contex root 25u IPv4 209746 0t0 TCP smithi077.front.sepia.ceph.com:41578->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:18.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root txt REG 8,1 4625312 1455 /usr/bin/ceph-mgr 2023-11-04T01:48:18.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:48:18.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 65240 274226 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 783584 273561 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 87608 273564 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 331936 273539 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 654400 273572 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 41112936 2651 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:48:18.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 60264 273566 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 96304 273562 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 237384 273541 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 177920 273567 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 7042240 272930 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:48:18.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 70784 273563 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 73976 273347 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 155704 273449 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 2883920 2365 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:48:18.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 3870704 2663 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:48:18.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 3784896 272980 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 132136 272979 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:48:18.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 382824 272931 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:48:18.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 299952 2361 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:48:18.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 8003360 1612 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:48:18.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 20504 273450 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 40328 272928 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:48:18.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:48:18.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:48:18.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:48:18.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 1129568 2812 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:48:18.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:48:18.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:48:18.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 721976 270393 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:18.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 2154416 270395 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:48:18.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 16192 266087 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:18.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:48:18.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 2103760 1932 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:48:18.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 515320 2374 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:18.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 198136 2468 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 49328 270932 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:18.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:48:18.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 1129032 1934 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:18.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:18.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:18.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:18.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:18.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:18.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:18.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:18.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:18.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:18.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:18.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:18.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:18.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:18.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:18.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:18.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:18.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:18.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:18.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:18.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:18.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:18.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:18.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:18.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:18.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:18.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:18.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:18.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:18.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:18.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:18.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:18.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:18.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:18.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:18.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:18.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:18.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:18.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 1892920 1591 /usr/lib64/librados.so.2.0.0 2023-11-04T01:48:18.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:48:18.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:18.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:18.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:18.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:18.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:18.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:48:18.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 435816 2224 /usr/lib64/libcephsqlite.so 2023-11-04T01:48:18.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:18.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root 1w FIFO 0,13 0t0 212217 pipe 2023-11-04T01:48:18.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root 2w FIFO 0,13 0t0 212218 pipe 2023-11-04T01:48:18.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root 3r FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:18.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root 4w FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:18.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root 5u a_inode 0,14 0 3100 [eventpoll:6,25] 2023-11-04T01:48:18.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root 6r FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:18.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root 7w FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:18.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root 8u a_inode 0,14 0 3100 [eventpoll:9,23] 2023-11-04T01:48:18.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root 9r FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:18.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root 10w FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:18.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root 11u a_inode 0,14 0 3100 [eventpoll:12] 2023-11-04T01:48:18.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root 12r FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:18.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root 13w FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:18.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root 14w REG 8,1 663581 265466 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:18.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root 15uW REG 0,24 7 1745 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:18.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root 16r FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:18.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root 17w FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:18.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root 18u unix 0xffff9ba908670880 0t0 205743 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:48:18.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root 19r FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:18.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root 20w FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:18.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root 21r FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:18.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root 22w FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:18.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root 23u IPv4 205808 0t0 TCP smithi077.front.sepia.ceph.com:56722->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:18.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118433 io_contex root 25u IPv4 209746 0t0 TCP smithi077.front.sepia.ceph.com:41578->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:18.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root txt REG 8,1 4625312 1455 /usr/bin/ceph-mgr 2023-11-04T01:48:18.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:48:18.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 65240 274226 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 783584 273561 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 87608 273564 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 331936 273539 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 654400 273572 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 41112936 2651 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:48:18.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 60264 273566 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 96304 273562 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 237384 273541 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 177920 273567 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 7042240 272930 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:48:18.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 70784 273563 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 73976 273347 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 155704 273449 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 2883920 2365 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:48:18.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 3870704 2663 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:48:18.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 3784896 272980 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 132136 272979 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:48:18.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 382824 272931 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:48:18.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 299952 2361 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:48:18.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 8003360 1612 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:48:18.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 20504 273450 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 40328 272928 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:48:18.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:48:18.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:48:18.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:48:18.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 1129568 2812 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:48:18.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:48:18.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:48:18.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 721976 270393 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:18.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 2154416 270395 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:48:18.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 16192 266087 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:18.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:48:18.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 2103760 1932 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:48:18.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 515320 2374 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:18.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 198136 2468 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 49328 270932 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:18.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:48:18.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 1129032 1934 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:18.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:18.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:18.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:18.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:18.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:18.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:18.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:18.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:18.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:18.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:18.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:18.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:18.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:18.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:18.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:18.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:18.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:18.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:18.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:18.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:18.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:18.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:18.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:18.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:18.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:18.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:18.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:18.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:18.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:18.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:18.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:18.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:18.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:18.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:18.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:18.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:18.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:18.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 1892920 1591 /usr/lib64/librados.so.2.0.0 2023-11-04T01:48:18.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:48:18.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:18.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:18.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:18.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:18.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:18.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:48:18.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 435816 2224 /usr/lib64/libcephsqlite.so 2023-11-04T01:48:18.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:18.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root 1w FIFO 0,13 0t0 212217 pipe 2023-11-04T01:48:18.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root 2w FIFO 0,13 0t0 212218 pipe 2023-11-04T01:48:18.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root 3r FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:18.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root 4w FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:18.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,25] 2023-11-04T01:48:18.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root 6r FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:18.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root 7w FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:18.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,23] 2023-11-04T01:48:18.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root 9r FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:18.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root 10w FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:18.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12] 2023-11-04T01:48:18.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root 12r FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:18.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root 13w FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:18.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root 14w REG 8,1 663581 265466 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:18.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root 15uW REG 0,24 7 1745 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:18.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root 16r FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:18.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root 17w FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:18.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root 18u unix 0xffff9ba908670880 0t0 205743 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:48:18.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root 19r FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:18.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root 20w FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:18.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root 21r FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:18.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root 22w FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:18.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root 23u IPv4 205808 0t0 TCP smithi077.front.sepia.ceph.com:56722->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:18.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118434 safe_time root 25u IPv4 209746 0t0 TCP smithi077.front.sepia.ceph.com:41578->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:18.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root txt REG 8,1 4625312 1455 /usr/bin/ceph-mgr 2023-11-04T01:48:18.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:48:18.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 65240 274226 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 783584 273561 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 87608 273564 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 331936 273539 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 654400 273572 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 41112936 2651 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:48:18.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 60264 273566 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 96304 273562 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 237384 273541 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 177920 273567 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 7042240 272930 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:48:18.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 70784 273563 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 73976 273347 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 155704 273449 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 2883920 2365 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:48:18.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 3870704 2663 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:48:18.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 3784896 272980 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 132136 272979 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:48:18.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 382824 272931 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:48:18.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 299952 2361 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:48:18.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 8003360 1612 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:48:18.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 20504 273450 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 40328 272928 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:48:18.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:48:18.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:48:18.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:48:18.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 1129568 2812 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:48:18.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:48:18.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:48:18.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 721976 270393 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:18.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 2154416 270395 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:48:18.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 16192 266087 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:18.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:48:18.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 2103760 1932 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:48:18.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 515320 2374 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:18.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 198136 2468 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 49328 270932 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:18.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:48:18.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 1129032 1934 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:18.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:18.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:18.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:18.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:18.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:18.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:18.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:18.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:18.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:18.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:18.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:18.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:18.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:18.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:18.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:18.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:18.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:18.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:18.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:18.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:18.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:18.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:18.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:18.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:18.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:18.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:18.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:18.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:18.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:18.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:18.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:18.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:18.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:18.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:18.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:18.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:18.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:18.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 1892920 1591 /usr/lib64/librados.so.2.0.0 2023-11-04T01:48:18.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:48:18.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:18.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:18.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:18.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:18.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:18.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:48:18.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 435816 2224 /usr/lib64/libcephsqlite.so 2023-11-04T01:48:18.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:18.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root 1w FIFO 0,13 0t0 212217 pipe 2023-11-04T01:48:18.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root 2w FIFO 0,13 0t0 212218 pipe 2023-11-04T01:48:18.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root 3r FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:18.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root 4w FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:18.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,25] 2023-11-04T01:48:18.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root 6r FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:18.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root 7w FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:18.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,23] 2023-11-04T01:48:18.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root 9r FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:18.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root 10w FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:18.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12] 2023-11-04T01:48:18.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root 12r FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:18.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root 13w FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:18.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root 14w REG 8,1 663581 265466 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:18.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root 15uW REG 0,24 7 1745 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:18.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root 16r FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:18.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root 17w FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:18.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root 18u unix 0xffff9ba908670880 0t0 205743 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:48:18.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root 19r FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:18.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root 20w FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:18.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root 21r FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:18.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root 22w FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:18.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root 23u IPv4 205808 0t0 TCP smithi077.front.sepia.ceph.com:56722->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:18.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118435 safe_time root 25u IPv4 209746 0t0 TCP smithi077.front.sepia.ceph.com:41578->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:18.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root txt REG 8,1 4625312 1455 /usr/bin/ceph-mgr 2023-11-04T01:48:18.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:48:18.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 65240 274226 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 783584 273561 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 87608 273564 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 331936 273539 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 654400 273572 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 41112936 2651 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:48:18.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 60264 273566 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 96304 273562 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 237384 273541 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 177920 273567 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 7042240 272930 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:48:18.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 70784 273563 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 73976 273347 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 155704 273449 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 2883920 2365 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:48:18.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 3870704 2663 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:48:18.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 3784896 272980 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 132136 272979 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:48:18.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 382824 272931 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:48:18.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 299952 2361 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:48:18.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 8003360 1612 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:48:18.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 20504 273450 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 40328 272928 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:48:18.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:48:18.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:48:18.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:48:18.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 1129568 2812 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:48:18.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:48:18.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:48:18.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 721976 270393 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:18.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 2154416 270395 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:48:18.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 16192 266087 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:18.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:48:18.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 2103760 1932 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:48:18.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 515320 2374 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:18.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 198136 2468 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 49328 270932 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:18.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:48:18.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 1129032 1934 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:18.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:18.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:18.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:18.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:18.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:18.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:18.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:18.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:18.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:18.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:18.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:18.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:18.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:18.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:18.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:18.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:18.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:18.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:18.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:18.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:18.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:18.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:18.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:18.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:18.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:18.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:18.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:18.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:18.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:18.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:18.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:18.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:18.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:18.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:18.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:18.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:18.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:18.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 1892920 1591 /usr/lib64/librados.so.2.0.0 2023-11-04T01:48:18.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:48:18.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:18.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:18.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:18.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:18.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:18.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:48:18.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 435816 2224 /usr/lib64/libcephsqlite.so 2023-11-04T01:48:18.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:18.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root 1w FIFO 0,13 0t0 212217 pipe 2023-11-04T01:48:18.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root 2w FIFO 0,13 0t0 212218 pipe 2023-11-04T01:48:18.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root 3r FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:18.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root 4w FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:18.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,25] 2023-11-04T01:48:18.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root 6r FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:18.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root 7w FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:18.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,23] 2023-11-04T01:48:18.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root 9r FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:18.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root 10w FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:18.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12] 2023-11-04T01:48:18.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root 12r FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:18.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root 13w FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:18.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root 14w REG 8,1 663581 265466 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:18.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root 15uW REG 0,24 7 1745 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:18.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root 16r FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:18.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root 17w FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:18.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root 18u unix 0xffff9ba908670880 0t0 205743 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:48:18.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root 19r FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:18.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root 20w FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:18.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root 21r FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:18.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root 22w FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:18.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root 23u IPv4 205808 0t0 TCP smithi077.front.sepia.ceph.com:56722->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:18.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118436 safe_time root 25u IPv4 209746 0t0 TCP smithi077.front.sepia.ceph.com:41578->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:18.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root txt REG 8,1 4625312 1455 /usr/bin/ceph-mgr 2023-11-04T01:48:18.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:48:18.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 65240 274226 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 783584 273561 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 87608 273564 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 331936 273539 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 654400 273572 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 41112936 2651 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:48:18.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 60264 273566 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 96304 273562 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 237384 273541 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 177920 273567 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 7042240 272930 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:48:18.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 70784 273563 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 73976 273347 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 155704 273449 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 2883920 2365 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:48:18.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 3870704 2663 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:48:18.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 3784896 272980 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 132136 272979 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:48:18.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 382824 272931 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:48:18.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 299952 2361 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:48:18.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 8003360 1612 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:48:18.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 20504 273450 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 40328 272928 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:48:18.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:48:18.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:48:18.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:48:18.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 1129568 2812 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:48:18.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:48:18.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:48:18.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 721976 270393 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:18.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 2154416 270395 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:48:18.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 16192 266087 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:18.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:48:18.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 2103760 1932 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:48:18.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 515320 2374 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:18.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 198136 2468 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 49328 270932 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:18.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:48:18.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 1129032 1934 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:18.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:18.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:18.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:18.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:18.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:18.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:18.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:18.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:18.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:18.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:18.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:18.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:18.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:18.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:18.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:18.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:18.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:18.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:18.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:18.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:18.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:18.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:18.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:18.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:18.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:18.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:18.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:18.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:18.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:18.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:18.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:18.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:18.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:18.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:18.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:18.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:18.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:18.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 1892920 1591 /usr/lib64/librados.so.2.0.0 2023-11-04T01:48:18.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:48:18.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:18.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:18.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:18.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:18.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:18.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:48:18.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 435816 2224 /usr/lib64/libcephsqlite.so 2023-11-04T01:48:18.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:18.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root 1w FIFO 0,13 0t0 212217 pipe 2023-11-04T01:48:18.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root 2w FIFO 0,13 0t0 212218 pipe 2023-11-04T01:48:18.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root 3r FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:18.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root 4w FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:18.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root 5u a_inode 0,14 0 3100 [eventpoll:6,25] 2023-11-04T01:48:18.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root 6r FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:18.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root 7w FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:18.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root 8u a_inode 0,14 0 3100 [eventpoll:9,23] 2023-11-04T01:48:18.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root 9r FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:18.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root 10w FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:18.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root 11u a_inode 0,14 0 3100 [eventpoll:12] 2023-11-04T01:48:18.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root 12r FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:18.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root 13w FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:18.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root 14w REG 8,1 663581 265466 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:18.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root 15uW REG 0,24 7 1745 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:18.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root 16r FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:18.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root 17w FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:18.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root 18u unix 0xffff9ba908670880 0t0 205743 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:48:18.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root 19r FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:18.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root 20w FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:18.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root 21r FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:18.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root 22w FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:18.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root 23u IPv4 205808 0t0 TCP smithi077.front.sepia.ceph.com:56722->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:18.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118437 fn_anonym root 25u IPv4 209746 0t0 TCP smithi077.front.sepia.ceph.com:41578->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:18.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root txt REG 8,1 4625312 1455 /usr/bin/ceph-mgr 2023-11-04T01:48:18.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:48:18.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 65240 274226 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 783584 273561 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 87608 273564 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 331936 273539 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 654400 273572 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 41112936 2651 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:48:18.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 60264 273566 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 96304 273562 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 237384 273541 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 177920 273567 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 7042240 272930 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:48:18.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 70784 273563 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 73976 273347 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 155704 273449 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 2883920 2365 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:48:18.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 3870704 2663 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:48:18.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 3784896 272980 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 132136 272979 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:48:18.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 382824 272931 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:48:18.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 299952 2361 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:48:18.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 8003360 1612 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:48:18.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 20504 273450 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 40328 272928 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:48:18.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:48:18.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:48:18.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:48:18.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 1129568 2812 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:48:18.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:48:18.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:48:18.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 721976 270393 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:18.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 2154416 270395 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:48:18.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 16192 266087 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:18.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:48:18.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 2103760 1932 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:48:18.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 515320 2374 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:18.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 198136 2468 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 49328 270932 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:18.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:48:18.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 1129032 1934 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:18.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:18.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:18.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:18.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:18.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:18.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:18.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:18.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:18.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:18.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:18.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:18.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:18.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:18.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:18.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:18.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:18.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:18.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:18.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:18.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:18.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:18.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:18.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:18.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:18.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:18.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:18.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:18.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:18.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:18.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:18.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:18.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:18.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:18.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:18.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:18.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:18.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:18.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 1892920 1591 /usr/lib64/librados.so.2.0.0 2023-11-04T01:48:18.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:48:18.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:18.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:18.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:18.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:18.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:18.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:48:18.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 435816 2224 /usr/lib64/libcephsqlite.so 2023-11-04T01:48:18.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:18.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root 1w FIFO 0,13 0t0 212217 pipe 2023-11-04T01:48:18.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root 2w FIFO 0,13 0t0 212218 pipe 2023-11-04T01:48:18.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root 3r FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:18.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root 4w FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:18.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root 5u a_inode 0,14 0 3100 [eventpoll:6,25] 2023-11-04T01:48:18.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root 6r FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:18.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root 7w FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:18.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root 8u a_inode 0,14 0 3100 [eventpoll:9,23] 2023-11-04T01:48:18.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root 9r FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:18.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root 10w FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:18.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root 11u a_inode 0,14 0 3100 [eventpoll:12] 2023-11-04T01:48:18.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root 12r FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:18.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root 13w FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:18.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root 14w REG 8,1 663581 265466 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:18.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root 15uW REG 0,24 7 1745 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:18.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root 16r FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:18.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root 17w FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:18.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root 18u unix 0xffff9ba908670880 0t0 205743 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:48:18.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root 19r FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:18.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root 20w FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:18.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root 21r FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:18.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root 22w FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:18.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root 23u IPv4 205808 0t0 TCP smithi077.front.sepia.ceph.com:56722->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:18.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118438 flusher root 25u IPv4 209746 0t0 TCP smithi077.front.sepia.ceph.com:41578->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:18.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root txt REG 8,1 4625312 1455 /usr/bin/ceph-mgr 2023-11-04T01:48:18.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-11-04T01:48:18.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 64192 38198 /usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 65240 274226 /usr/lib64/python3.9/site-packages/scipy/_lib/_ccallback_c.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 783584 273561 /usr/lib64/python3.9/site-packages/numpy/random/_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 87608 273564 /usr/lib64/python3.9/site-packages/numpy/random/_philox.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 331936 273539 /usr/lib64/python3.9/site-packages/numpy/random/_bounded_integers.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 654400 273572 /usr/lib64/python3.9/site-packages/numpy/random/mtrand.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 41112936 2651 /usr/lib64/libopenblaso-r0.3.21.so 2023-11-04T01:48:18.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 60264 273566 /usr/lib64/python3.9/site-packages/numpy/random/_sfc64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 96304 273562 /usr/lib64/python3.9/site-packages/numpy/random/_mt19937.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 237384 273541 /usr/lib64/python3.9/site-packages/numpy/random/_common.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 177920 273567 /usr/lib64/python3.9/site-packages/numpy/random/bit_generator.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 7042240 272930 /usr/lib64/flexiblas/libflexiblas_fallback_lapack.so 2023-11-04T01:48:18.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 70784 273563 /usr/lib64/python3.9/site-packages/numpy/random/_pcg64.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 73976 273347 /usr/lib64/python3.9/site-packages/numpy/fft/_pocketfft_internal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 155704 273449 /usr/lib64/python3.9/site-packages/numpy/linalg/_umath_linalg.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 2883920 2365 /usr/lib64/libgfortran.so.5.0.0 2023-11-04T01:48:18.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 3870704 2663 /usr/lib64/libflexiblas.so.3.0 2023-11-04T01:48:18.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 31984 42006 /usr/lib64/python3.9/lib-dynload/termios.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 15336 38209 /usr/lib64/python3.9/lib-dynload/_contextvars.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 3784896 272980 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_umath.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 132136 272979 /usr/lib64/python3.9/site-packages/numpy/core/_multiarray_tests.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 294392 9898 /usr/lib64/libgomp.so.1.0.0 2023-11-04T01:48:18.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 382824 272931 /usr/lib64/flexiblas/libflexiblas_netlib.so 2023-11-04T01:48:18.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 299952 2361 /usr/lib64/libquadmath.so.0.0.0 2023-11-04T01:48:18.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 8003360 1612 /usr/lib64/librbd.so.1.18.0 2023-11-04T01:48:18.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 20504 273450 /usr/lib64/python3.9/site-packages/numpy/linalg/lapack_lite.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 40328 272928 /usr/lib64/flexiblas/libflexiblas_openblas-openmp.so 2023-11-04T01:48:18.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 75928 9784 /usr/lib64/libjson-c.so.5.0.0 2023-11-04T01:48:18.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 384592 11464 /usr/lib64/libdevmapper.so.1.02 2023-11-04T01:48:18.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 554440 11254 /usr/lib64/libcryptsetup.so.12.9.0 2023-11-04T01:48:18.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 1129568 2812 /usr/lib64/python3.9/site-packages/rbd.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-11-04T01:48:18.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 38744 38211 /usr/lib64/python3.9/lib-dynload/_csv.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 136048 11808 /usr/lib64/libyaml-0.so.2.0.9 2023-11-04T01:48:18.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 20832 38226 /usr/lib64/python3.9/lib-dynload/_multiprocessing.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 246392 59769 /usr/lib64/python3.9/site-packages/yaml/_yaml.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 119688 36903 /usr/lib64/ossl-modules/legacy.so 2023-11-04T01:48:18.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 721976 270393 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:48:18.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 2154416 270395 /usr/lib64/python3.9/site-packages/cryptography/hazmat/bindings/_rust.abi3.so 2023-11-04T01:48:18.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 1116856 42007 /usr/lib64/python3.9/lib-dynload/unicodedata.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 16192 266087 /usr/lib64/python3.9/site-packages/markupsafe/_speedups.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 283592 38217 /usr/lib64/python3.9/lib-dynload/_decimal.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 213376 41995 /usr/lib64/python3.9/lib-dynload/_ssl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:18.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:48:18.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 2103760 1932 /usr/lib64/libcephfs.so.2.0.0 2023-11-04T01:48:18.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 515320 2374 /usr/lib64/python3.9/site-packages/cephfs.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:18.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 198136 2468 /usr/lib64/python3.9/site-packages/_cffi_backend.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 49328 270932 /usr/lib64/python3.9/site-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:48:18.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-11-04T01:48:18.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 96936 41994 /usr/lib64/python3.9/lib-dynload/_sqlite3.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 1129032 1934 /usr/lib64/python3.9/site-packages/rados.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 50048 41986 /usr/lib64/python3.9/lib-dynload/_json.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:18.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:18.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:18.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:18.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:18.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:18.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:18.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:18.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:18.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:18.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:18.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:18.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:18.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:18.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:18.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:18.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:18.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:18.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:18.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 15504 41997 /usr/lib64/python3.9/lib-dynload/_uuid.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:18.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:18.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:18.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:18.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:18.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:18.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:18.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:18.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:18.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:18.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:18.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:18.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:18.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:18.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:18.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:18.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:18.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:18.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:18.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 1892920 1591 /usr/lib64/librados.so.2.0.0 2023-11-04T01:48:18.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:48:18.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:18.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:18.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:18.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:18.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:18.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 1294848 9721 /usr/lib64/libsqlite3.so.0.8.6 2023-11-04T01:48:18.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 435816 2224 /usr/lib64/libcephsqlite.so 2023-11-04T01:48:18.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:18.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root 1w FIFO 0,13 0t0 212217 pipe 2023-11-04T01:48:18.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root 2w FIFO 0,13 0t0 212218 pipe 2023-11-04T01:48:18.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root 3r FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:18.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root 4w FIFO 0,13 0t0 208868 pipe 2023-11-04T01:48:18.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,25] 2023-11-04T01:48:18.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root 6r FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:18.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root 7w FIFO 0,13 0t0 208870 pipe 2023-11-04T01:48:18.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,23] 2023-11-04T01:48:18.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root 9r FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:18.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root 10w FIFO 0,13 0t0 208871 pipe 2023-11-04T01:48:18.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12] 2023-11-04T01:48:18.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root 12r FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:18.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root 13w FIFO 0,13 0t0 208872 pipe 2023-11-04T01:48:18.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root 14w REG 8,1 663581 265466 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:48:18.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root 15uW REG 0,24 7 1745 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:48:18.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root 16r FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:18.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root 17w FIFO 0,13 0t0 205742 pipe 2023-11-04T01:48:18.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root 18u unix 0xffff9ba908670880 0t0 205743 /var/run/ceph/ceph-mgr.y.asok type=STREAM (LISTEN) 2023-11-04T01:48:18.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root 19r FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:18.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root 20w FIFO 0,13 0t0 205747 pipe 2023-11-04T01:48:18.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root 21r FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:18.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root 22w FIFO 0,13 0t0 205748 pipe 2023-11-04T01:48:18.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root 23u IPv4 205808 0t0 TCP smithi077.front.sepia.ceph.com:56722->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:18.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mgr 118321 118439 safe_time root 25u IPv4 209746 0t0 TCP smithi077.front.sepia.ceph.com:41578->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:18.527 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.527 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.527 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:48:18.527 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:48:18.528 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:18.528 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:18.528 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:48:18.528 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:18.528 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:48:18.528 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:48:18.529 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:48:18.529 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:48:18.529 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:48:18.529 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:48:18.529 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:48:18.530 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:48:18.530 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:48:18.530 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:18.530 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:18.530 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:18.531 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:18.531 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:18.531 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:18.531 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:18.531 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:18.531 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:18.532 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:18.532 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:48:18.532 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:48:18.532 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:18.532 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:18.533 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.533 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.533 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:18.533 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.533 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:48:18.533 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:48:18.534 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:18.534 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:48:18.534 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:48:18.534 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:48:18.534 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:18.535 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:48:18.535 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:48:18.535 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:48:18.535 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:48:18.535 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:48:18.536 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:48:18.536 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:48:18.536 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:48:18.536 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:48:18.536 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:18.537 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:48:18.537 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:48:18.537 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:18.537 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:48:18.537 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:18.537 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.538 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:48:18.538 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root 0r FIFO 0,13 0t0 209787 pipe 2023-11-04T01:48:18.538 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:18.538 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:18.538 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root 3r FIFO 0,13 0t0 213044 pipe 2023-11-04T01:48:18.539 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root 4w FIFO 0,13 0t0 213044 pipe 2023-11-04T01:48:18.539 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root 5u netlink 0t0 204614 AUDIT 2023-11-04T01:48:18.539 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118440 root 6u unix 0xffff9ba9084b72c0 0t0 204615 type=DGRAM (CONNECTED) 2023-11-04T01:48:18.539 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.539 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.540 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:48:18.540 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:48:18.540 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:18.540 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:18.540 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:48:18.540 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:18.541 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:48:18.541 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:48:18.541 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:48:18.541 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:18.541 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:48:18.542 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:48:18.542 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:48:18.542 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:48:18.542 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:48:18.542 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:48:18.542 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:48:18.543 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:48:18.543 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:18.543 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:18.543 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:18.543 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:18.544 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:18.544 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:18.544 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:18.544 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:18.544 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.544 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:48:18.545 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:18.545 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:18.545 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:48:18.545 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.545 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:18.546 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:48:18.546 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:18.546 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.546 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:18.546 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:18.547 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:48:18.547 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:48:18.547 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:48:18.547 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:48:18.547 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:48:18.548 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:48:18.548 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:48:18.548 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:48:18.548 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:48:18.548 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:48:18.549 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:48:18.549 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:18.549 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:48:18.549 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:48:18.549 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:18.550 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:48:18.550 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:18.550 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.550 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:48:18.550 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root 0r FIFO 0,13 0t0 209791 pipe 2023-11-04T01:48:18.551 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:18.551 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:18.551 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root 3r FIFO 0,13 0t0 211085 pipe 2023-11-04T01:48:18.551 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root 4w FIFO 0,13 0t0 211085 pipe 2023-11-04T01:48:18.551 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root 5u netlink 0t0 211098 AUDIT 2023-11-04T01:48:18.552 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118444 root 6u unix 0xffff9ba90bb02a80 0t0 210415 type=DGRAM (CONNECTED) 2023-11-04T01:48:18.552 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.552 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.552 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:48:18.552 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:48:18.552 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:18.553 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:18.553 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:48:18.553 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:18.553 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:48:18.553 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:48:18.554 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:48:18.554 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:48:18.554 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:48:18.554 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:48:18.555 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:48:18.555 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:48:18.555 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:18.555 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:18.555 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:48:18.556 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:48:18.556 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:48:18.556 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:18.556 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:18.556 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:18.556 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:18.557 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:18.557 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:18.557 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:18.557 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:48:18.557 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:18.558 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:18.558 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.558 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:48:18.558 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:18.558 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.559 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:18.559 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.559 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:18.559 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:48:18.559 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:48:18.560 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:48:18.560 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:18.560 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:48:18.560 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:48:18.560 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:48:18.561 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:48:18.561 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:48:18.561 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:48:18.561 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:48:18.561 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:48:18.562 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:48:18.562 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:18.562 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:48:18.562 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:48:18.562 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:18.563 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:48:18.563 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:18.563 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.563 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:48:18.563 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root 0r FIFO 0,13 0t0 211067 pipe 2023-11-04T01:48:18.564 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:18.564 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:18.564 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root 3r FIFO 0,13 0t0 204609 pipe 2023-11-04T01:48:18.564 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root 4w FIFO 0,13 0t0 204609 pipe 2023-11-04T01:48:18.564 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root 5u netlink 0t0 204625 AUDIT 2023-11-04T01:48:18.565 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118452 root 6u unix 0xffff9ba9084b7700 0t0 204626 type=DGRAM (CONNECTED) 2023-11-04T01:48:18.565 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.565 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.565 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:48:18.565 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:48:18.566 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:18.566 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:18.566 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:48:18.566 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:48:18.566 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:18.567 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:18.567 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:18.567 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:48:18.567 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:48:18.567 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:48:18.568 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:48:18.568 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:48:18.568 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:48:18.568 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:48:18.568 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:48:18.569 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:48:18.569 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:18.569 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:18.569 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:18.569 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:18.570 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:18.570 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:18.570 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:18.570 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:18.570 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:18.571 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.571 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.571 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:18.571 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:18.572 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:48:18.572 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:48:18.572 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:48:18.573 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:48:18.573 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:48:18.573 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:18.573 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:18.574 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.574 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:18.574 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:48:18.574 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:48:18.575 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:48:18.575 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:48:18.575 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:48:18.575 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:48:18.575 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:48:18.576 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:48:18.576 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:48:18.576 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:48:18.576 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:48:18.576 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:48:18.577 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:18.577 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:48:18.577 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:18.577 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.577 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:48:18.578 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root 0r FIFO 0,13 0t0 211071 pipe 2023-11-04T01:48:18.578 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:18.578 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:18.578 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root 3r FIFO 0,13 0t0 209806 pipe 2023-11-04T01:48:18.578 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root 4w FIFO 0,13 0t0 209806 pipe 2023-11-04T01:48:18.579 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root 5u netlink 0t0 212312 AUDIT 2023-11-04T01:48:18.579 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 118465 root 6u unix 0xffff9ba903826600 0t0 212313 type=DGRAM (CONNECTED) 2023-11-04T01:48:18.579 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118508 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.579 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118508 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.579 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118508 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:48:18.580 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118508 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:18.580 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118508 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:48:18.580 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118508 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.580 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118508 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.580 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118508 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.580 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118508 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.581 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118508 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.581 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118508 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.581 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118508 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.581 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118508 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.581 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118508 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.582 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118508 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.582 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118508 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:48:18.582 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118508 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.582 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118508 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.582 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118508 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.583 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118508 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:18.583 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118508 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:18.583 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118508 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.583 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118508 root 0r FIFO 0,13 0t0 209787 pipe 2023-11-04T01:48:18.583 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118508 root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:18.584 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118508 root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:18.584 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118514 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.584 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118514 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.584 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118514 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:48:18.584 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118514 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:18.585 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118514 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:48:18.585 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118514 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.585 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118514 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.585 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118514 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.585 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118514 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.586 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118514 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.586 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118514 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.586 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118514 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.586 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118514 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.586 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118514 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.587 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118514 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.587 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118514 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:48:18.587 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118514 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.587 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118514 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.587 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118514 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:18.588 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118514 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.588 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118514 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:18.588 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118514 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.588 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118514 root 0r FIFO 0,13 0t0 209791 pipe 2023-11-04T01:48:18.588 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118514 root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:18.589 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118514 root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:18.589 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118515 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.589 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118515 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.589 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118515 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:48:18.589 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118515 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:18.590 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118515 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:48:18.590 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118515 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.590 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118515 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.590 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118515 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.590 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118515 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.591 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118515 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.591 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118515 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.591 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118515 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.591 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118515 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.591 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118515 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.592 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118515 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.592 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118515 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.592 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118515 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.592 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118515 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.592 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118515 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:48:18.593 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118515 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:18.593 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118515 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:18.593 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118515 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.593 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118515 root 0r FIFO 0,13 0t0 211067 pipe 2023-11-04T01:48:18.593 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118515 root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:18.593 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118515 root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:18.594 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118525 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.594 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118525 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.594 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118525 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:48:18.594 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118525 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:18.594 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118525 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:48:18.595 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118525 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.595 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118525 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.595 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118525 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.595 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118525 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.596 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118525 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.596 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118525 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.596 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118525 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.596 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118525 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.596 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118525 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:18.596 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118525 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:48:18.597 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118525 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.597 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118525 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.597 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118525 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.597 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118525 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:18.597 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118525 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.598 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118525 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:18.598 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118525 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.598 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118525 root 0r FIFO 0,13 0t0 211071 pipe 2023-11-04T01:48:18.598 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118525 root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:18.598 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 118525 root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:18.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:18.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:18.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:18.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:18.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:18.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:18.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:18.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:18.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:18.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:18.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:18.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:18.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:18.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:18.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:18.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:18.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:18.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:18.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:18.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:18.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:18.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:18.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:18.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:18.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:18.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:18.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:18.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:18.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:18.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:18.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:18.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:18.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:18.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:18.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:18.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:18.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:18.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:18.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:18.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:18.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:18.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:18.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:18.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:18.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:18.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:18.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:18.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:18.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:18.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:18.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:18.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:18.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:18.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:18.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:18.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:18.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:18.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:18.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:18.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:18.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:18.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:18.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:18.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:18.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:18.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:18.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:18.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:18.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:18.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:18.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:18.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:18.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:18.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:18.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:18.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:18.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:18.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:18.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:18.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:18.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:18.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:18.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:18.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:18.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:18.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:18.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 14w REG 8,1 144640547 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:18.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:18.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:18.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:18.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:18.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:18.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:18.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:18.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:18.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:18.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:18.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:18.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:18.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:18.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:18.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:18.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:18.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:18.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:18.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:18.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:18.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:18.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:18.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:18.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:18.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:18.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:18.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:18.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:18.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:18.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:18.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:18.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:18.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:18.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:18.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:18.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:18.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:18.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:18.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:18.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:18.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:18.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:18.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:18.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:18.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:18.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:18.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:18.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:18.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:18.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:18.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:18.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:18.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:18.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:18.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:18.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:18.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:18.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:18.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:18.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:18.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:18.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:18.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:18.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:18.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:18.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:18.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:18.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:18.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:18.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:18.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:18.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:18.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:18.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:18.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:18.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:18.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:18.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:18.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:18.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:18.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:18.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:18.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:18.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:18.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:18.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:18.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:18.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:18.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:18.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:18.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:18.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:18.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:18.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:18.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:18.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:18.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:18.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:18.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:18.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:18.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:18.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:18.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:18.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:18.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:18.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:18.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:18.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:18.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:18.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:18.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:18.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:18.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:18.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:18.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:18.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:18.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:18.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:18.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:18.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:18.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:18.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:18.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:18.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:18.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:18.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:18.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:18.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:18.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:18.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:18.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:18.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:18.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:18.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:18.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:18.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:18.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:18.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:18.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:18.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:18.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:18.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:18.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:18.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:18.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:18.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:18.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:18.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:18.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 14w REG 8,1 144639698 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:18.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:18.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:18.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:18.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:18.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:18.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:18.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:18.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:18.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:18.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:18.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:18.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:18.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:18.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:18.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:18.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:18.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:18.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:18.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:18.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:18.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:18.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:18.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:18.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:18.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:18.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:18.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:18.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:18.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:18.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:18.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:18.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:18.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:18.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:18.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:18.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:18.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:18.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:18.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:18.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:18.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:18.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:18.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:18.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:18.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:18.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:18.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:18.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:18.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:18.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:18.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:18.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:18.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:18.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:18.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:18.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:18.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:18.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:18.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:18.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:18.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:18.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118540 log root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:18.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:18.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:18.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:18.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:18.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:18.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:18.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:18.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:18.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:18.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:18.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:18.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:18.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:18.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:18.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:18.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:18.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:18.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:18.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:18.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:18.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:18.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:18.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:18.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:18.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:18.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:18.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:18.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:18.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:18.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:18.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:18.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:18.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:18.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:18.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:18.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:18.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:18.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:18.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:18.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:18.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:18.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:18.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:18.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:18.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:18.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:18.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:18.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:18.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:18.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:18.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:18.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:18.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:18.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:18.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:18.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:18.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:18.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:18.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:18.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:18.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:18.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:18.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:18.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:18.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:18.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:18.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:18.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:18.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:18.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:18.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:18.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:18.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:18.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:18.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:18.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:18.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:18.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:18.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:18.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:18.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:18.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:18.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:18.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:18.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:18.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:18.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 14w REG 8,1 144639698 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:18.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:18.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:18.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:18.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:18.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:18.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:18.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:18.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:18.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:18.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:18.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:18.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:18.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:18.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:18.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:18.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:18.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:18.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:18.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:18.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:18.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:18.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:18.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:18.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:18.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:18.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:18.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:18.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:18.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:18.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:18.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:18.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:18.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:18.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:18.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:18.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:18.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:18.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:18.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:18.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:18.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:18.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:18.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:18.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:18.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:18.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:18.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:18.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:18.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:18.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:18.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:18.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:18.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:18.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:18.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:18.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:18.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:18.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:18.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:18.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:18.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:18.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118546 msgr-work root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:18.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:18.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:18.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:18.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:18.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:18.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:18.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:18.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:18.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:18.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:18.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:18.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:18.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:18.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:18.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:18.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:18.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:18.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:18.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:18.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:18.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:18.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:18.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:18.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:18.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:18.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:18.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:18.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:18.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:18.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:18.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:18.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:18.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:18.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:18.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:18.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:18.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:18.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:18.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:18.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:18.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:18.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:18.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:18.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:18.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:18.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:18.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:18.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:18.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:18.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:18.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:18.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:18.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:18.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:18.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:18.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:18.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:18.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:18.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:18.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:18.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:18.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:18.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:18.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:18.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:18.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:18.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:18.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:18.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:18.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:18.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:18.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:18.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:18.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:18.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:18.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:18.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:18.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:18.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:18.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:18.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:18.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:18.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:18.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:18.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:18.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:18.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 14w REG 8,1 144639698 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:18.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:18.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:18.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:18.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:18.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:18.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:18.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:18.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:18.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:18.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:18.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:18.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:18.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:18.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:18.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:18.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:18.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:18.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:18.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:18.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:18.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:18.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:18.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:18.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:18.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:18.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:18.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:18.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:18.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:18.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:18.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:18.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:18.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:18.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:18.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:18.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:18.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:18.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:18.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:18.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:18.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:18.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:18.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:18.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:18.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:18.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:18.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:18.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:18.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:18.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:18.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:18.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:18.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:18.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:18.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:18.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:18.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:18.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:18.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:18.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:18.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:18.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118548 msgr-work root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:18.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:18.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:18.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:18.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:18.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:18.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:18.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:18.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:18.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:18.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:18.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:18.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:18.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:18.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:18.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:18.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:18.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:18.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:18.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:18.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:18.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:18.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:18.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:18.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:18.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:18.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:18.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:18.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:18.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:18.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:18.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:18.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:18.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:18.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:18.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:18.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:18.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:18.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:18.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:18.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:18.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:18.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:18.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:18.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:18.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:18.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:18.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:18.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:18.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:18.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:18.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:18.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:18.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:18.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:18.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:18.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:18.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:18.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:18.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:18.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:18.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:18.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:18.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:18.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:18.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:18.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:18.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:18.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:18.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:18.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:18.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:18.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:18.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:18.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:18.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:18.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:18.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:18.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:18.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:18.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:18.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:18.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:18.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:18.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:18.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:18.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:18.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 14w REG 8,1 144639698 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:18.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:18.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:18.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:18.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:18.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:18.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:18.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:18.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:18.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:18.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:18.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:18.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:18.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:18.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:18.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:18.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:18.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:18.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:18.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:18.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:18.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:18.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:18.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:18.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:18.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:18.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:18.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:18.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:18.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:18.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:18.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:18.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:18.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:18.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:18.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:18.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:18.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:18.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:18.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:18.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:18.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:18.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:18.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:18.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:18.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:18.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:18.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:18.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:18.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:18.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:18.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:18.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:18.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:18.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:18.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:18.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:18.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:18.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:18.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:18.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:18.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:18.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118549 msgr-work root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:18.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:18.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:18.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:18.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:18.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:18.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:18.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:18.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:18.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:18.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:18.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:18.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:18.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:18.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:18.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:18.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:18.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:18.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:18.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:18.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:18.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:18.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:18.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:18.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:18.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:18.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:18.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:18.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:18.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:18.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:18.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:18.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:18.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:18.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:18.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:18.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:18.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:18.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:18.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:18.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:18.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:18.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:18.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:18.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:18.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:18.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:18.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:18.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:18.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:18.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:18.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:18.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:18.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:18.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:18.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:18.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:18.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:18.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:18.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:18.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:18.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:18.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:18.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:18.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:18.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:18.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:18.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:18.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:18.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:18.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:18.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:18.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:18.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:18.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:18.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:18.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:18.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:18.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:18.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:18.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:18.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:18.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:18.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:18.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:18.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:18.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:18.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 14w REG 8,1 144639698 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:18.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:18.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:18.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:18.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:18.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:18.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:18.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:18.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:18.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:18.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:18.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:18.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:18.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:18.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:18.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:18.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:18.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:18.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:18.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:18.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:18.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:18.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:18.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:18.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:18.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:18.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:18.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:18.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:18.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:18.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:18.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:18.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:18.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:18.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:18.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:18.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:18.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:18.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:18.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:18.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:18.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:18.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:18.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:18.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:18.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:18.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:18.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:18.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:18.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:18.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:18.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:18.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:18.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:18.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:18.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:18.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:18.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:18.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:18.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:18.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:18.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:18.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118560 service root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:18.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:18.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:18.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:18.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:18.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:18.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:18.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:18.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:18.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:18.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:18.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:18.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:18.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:18.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:18.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:18.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:18.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:18.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:18.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:18.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:18.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:18.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:18.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:18.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:18.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:18.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:18.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:18.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:18.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:18.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:18.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:18.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:18.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:18.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:18.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:18.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:18.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:18.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:18.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:18.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:18.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:18.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:18.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:18.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:18.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:18.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:18.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:18.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:18.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:18.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:18.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:18.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:18.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:18.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:18.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:18.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:18.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:18.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:18.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:18.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:18.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:18.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:18.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:18.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:18.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:18.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:18.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:18.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:18.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:18.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:18.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:18.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:18.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:18.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:18.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:18.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:18.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:18.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:18.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:18.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:18.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:18.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:18.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:18.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:18.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:18.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:18.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 14w REG 8,1 144639698 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:18.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:18.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:18.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:18.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:18.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:18.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:18.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:18.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:18.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:18.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:18.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:18.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:18.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:18.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:18.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:18.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:18.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:18.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:18.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:18.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:18.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:18.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:18.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:18.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:18.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:18.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:18.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:18.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:18.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:18.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:18.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:18.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:18.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:18.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:18.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:18.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:18.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:18.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:18.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:18.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:18.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:18.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:18.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:18.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:18.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:18.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:18.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:18.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:18.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:18.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:18.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:18.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:18.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:18.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:18.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:18.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:18.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:18.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:18.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:18.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:18.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:18.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118563 admin_soc root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:18.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:18.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:18.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:18.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:18.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:18.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:18.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:18.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:18.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:18.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:18.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:18.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:18.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:18.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:18.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:18.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:18.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:18.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:18.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:18.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:18.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:18.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:18.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:18.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:18.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:18.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:18.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:18.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:18.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:18.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:18.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:18.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:18.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:18.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:18.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:18.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:18.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:18.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:18.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:18.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:18.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:18.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:18.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:18.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:18.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:18.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:18.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:18.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:18.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:18.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:18.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:18.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:18.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:18.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:18.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:18.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:18.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:18.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:18.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:18.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:18.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:18.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:18.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:18.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:18.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:18.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:18.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:18.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:18.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:18.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:18.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:18.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:18.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:18.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:18.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:18.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:18.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:18.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:18.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:18.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:18.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:18.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:18.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:18.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:18.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:18.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:18.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 14w REG 8,1 144639698 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:18.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:18.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:18.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:18.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:18.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:18.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:18.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:18.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:18.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:18.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:18.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:18.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:18.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:18.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:18.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:18.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:18.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:18.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:18.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:18.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:18.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:18.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:18.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:18.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:18.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:18.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:18.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:18.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:18.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:18.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:18.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:18.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:18.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:18.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:18.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:18.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:18.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:18.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:18.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:18.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:18.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:18.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:18.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:18.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:18.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:18.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:18.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:18.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:18.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:18.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:18.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:18.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:18.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:18.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:18.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:18.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:18.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:18.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:18.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:18.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:18.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:18.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118613 signal_ha root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:18.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:18.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:18.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:18.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:18.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:18.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:18.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:18.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:18.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:18.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:18.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:18.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:18.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:18.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:18.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:18.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:18.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:18.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:18.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:18.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:18.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:18.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:18.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:18.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:18.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:18.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:18.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:18.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:18.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:18.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:18.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:18.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:18.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:18.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:18.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:18.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:18.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:18.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:18.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:18.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:18.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:18.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:18.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:18.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:18.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:18.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:18.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:18.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:18.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:18.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:18.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:18.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:18.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:18.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:18.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:18.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:18.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:18.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:18.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:18.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:18.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:18.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:18.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:18.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:18.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:18.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:18.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:18.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:18.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:18.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:18.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:18.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:18.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:18.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:18.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:18.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:18.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:18.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:18.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:18.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:18.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:18.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:18.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:18.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:18.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:18.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:18.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 14w REG 8,1 144639698 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:18.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:18.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:18.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:18.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:18.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:18.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:18.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:18.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:18.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:18.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:18.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:18.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:18.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:18.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:18.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:18.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:18.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:18.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:18.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:18.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:18.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:18.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:18.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:18.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:18.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:18.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:18.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:18.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:18.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:18.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:18.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:18.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:18.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:18.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:18.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:18.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:18.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:18.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:18.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:18.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:18.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:18.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:18.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:18.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:18.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:18.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:18.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:18.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:18.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:18.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:18.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:18.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:18.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:18.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:18.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:18.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:18.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:18.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:18.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:18.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:18.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:18.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118614 io_contex root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:18.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:18.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:18.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:18.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:18.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:18.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:18.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:18.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:18.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:18.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:18.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:18.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:18.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:18.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:18.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:18.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:18.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:18.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:18.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:18.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:18.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:18.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:18.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:18.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:18.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:18.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:18.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:18.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:18.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:18.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:18.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:18.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:18.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:18.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:18.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:18.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:18.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:18.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:18.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:18.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:18.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:18.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:18.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:18.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:18.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:18.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:18.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:18.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:18.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:18.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:18.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:18.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:18.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:18.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:18.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:18.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:18.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:18.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:18.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:18.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:18.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:18.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:18.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:18.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:18.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:18.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:18.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:18.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:18.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:18.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:18.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:18.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:18.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:18.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:18.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:18.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:18.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:18.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:18.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:18.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:18.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:18.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:18.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:18.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:18.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:18.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:18.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 14w REG 8,1 144639698 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:18.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:18.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:18.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:18.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:18.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:18.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:18.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:18.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:18.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:18.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:18.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:18.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:18.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:18.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:18.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:18.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:18.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:18.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:18.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:18.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:18.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:18.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:18.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:18.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:18.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:18.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:18.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:18.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:18.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:18.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:18.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:18.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:18.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:18.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:18.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:18.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:18.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:18.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:18.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:18.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:18.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:18.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:18.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:18.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:18.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:18.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:18.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:18.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:18.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:18.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:18.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:18.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:18.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:18.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:18.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:18.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:18.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:18.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:18.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:18.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:18.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:18.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118615 io_contex root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:18.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:18.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:18.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:18.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:18.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:18.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:18.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:18.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:18.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:18.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:18.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:18.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:18.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:18.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:18.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:18.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:18.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:18.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:18.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:18.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:18.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:18.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:18.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:18.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:18.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:18.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:18.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:18.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:18.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:18.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:18.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:18.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:18.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:18.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:18.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:18.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:18.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:18.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:18.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:18.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:18.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:18.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:18.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:18.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:18.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:18.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:18.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:18.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:18.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:18.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:18.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:18.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:18.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:18.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:18.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:18.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:18.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:18.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:18.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:18.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:18.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:18.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:18.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:18.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:18.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:18.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:18.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:18.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:18.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:18.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:18.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:18.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:18.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:18.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:18.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:18.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:18.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:18.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:18.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:18.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:18.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:18.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:18.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:18.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:18.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:18.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:18.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:18.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:18.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:18.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 14w REG 8,1 144639698 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:18.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:18.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:18.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:18.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:18.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:18.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:18.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:18.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:18.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:18.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:18.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:18.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:18.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:18.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:18.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:18.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:18.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:18.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:18.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:18.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:18.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:18.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:18.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:18.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:18.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:18.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:18.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:18.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:18.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:18.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:18.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:18.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:18.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:18.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:18.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:18.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:18.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:18.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:18.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:18.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:18.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:18.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:18.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:18.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:18.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:18.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:18.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:18.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:18.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:18.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:18.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:18.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:18.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:18.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:18.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:18.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:18.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:18.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:18.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:18.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:18.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:18.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:18.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118626 OpHistory root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:18.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:18.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:18.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:18.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:18.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:18.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:18.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:18.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:18.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:18.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:18.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:18.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:18.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:18.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:18.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:18.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:18.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:18.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:18.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:18.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:18.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:18.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:18.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:18.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:18.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:18.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:18.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:18.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:18.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:18.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:18.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:18.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:18.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:18.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:18.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:18.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:18.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:18.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:18.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:18.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:18.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:18.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:18.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:18.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:18.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:19.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:19.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:19.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:19.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:19.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:19.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:19.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:19.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:19.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:19.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:19.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:19.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:19.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:19.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:19.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:19.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:19.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:19.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:19.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:19.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:19.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:19.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:19.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:19.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:19.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:19.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:19.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:19.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:19.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:19.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:19.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:19.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:19.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:19.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:19.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:19.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:19.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:19.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:19.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:19.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 14w REG 8,1 144639698 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:19.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:19.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:19.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:19.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:19.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:19.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:19.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:19.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:19.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:19.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:19.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:19.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:19.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:19.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:19.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:19.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:19.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:19.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:19.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:19.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:19.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:19.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:19.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:19.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:19.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:19.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:19.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:19.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:19.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:19.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:19.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:19.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:19.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:19.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:19.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:19.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:19.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:19.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:19.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:19.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118628 ceph_time root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:19.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:19.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:19.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:19.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:19.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:19.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:19.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:19.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:19.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:19.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:19.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:19.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:19.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:19.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:19.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:19.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:19.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:19.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:19.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:19.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:19.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:19.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:19.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:19.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:19.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:19.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:19.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:19.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:19.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:19.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:19.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:19.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:19.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:19.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:19.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:19.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:19.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:19.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:19.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:19.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:19.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:19.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:19.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:19.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:19.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:19.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:19.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:19.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:19.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:19.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:19.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:19.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:19.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:19.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:19.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:19.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:19.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:19.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:19.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:19.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:19.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:19.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:19.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:19.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:19.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:19.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:19.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:19.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:19.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:19.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:19.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:19.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:19.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:19.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:19.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:19.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:19.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:19.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:19.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:19.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:19.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:19.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:19.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:19.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:19.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 14w REG 8,1 144639698 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:19.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:19.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:19.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:19.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:19.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:19.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:19.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:19.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:19.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:19.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:19.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:19.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:19.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:19.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:19.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:19.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:19.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:19.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:19.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:19.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:19.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:19.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:19.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:19.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:19.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:19.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:19.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:19.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:19.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:19.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:19.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:19.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:19.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:19.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:19.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:19.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:19.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:19.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:19.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:19.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118675 ceph-osd root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:19.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:19.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:19.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:19.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:19.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:19.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:19.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:19.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:19.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:19.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:19.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:19.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:19.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:19.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:19.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:19.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:19.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:19.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:19.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:19.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:19.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:19.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:19.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:19.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:19.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:19.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:19.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:19.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:19.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:19.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:19.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:19.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:19.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:19.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:19.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:19.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:19.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:19.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:19.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:19.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:19.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:19.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:19.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:19.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:19.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:19.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:19.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:19.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:19.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:19.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:19.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:19.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:19.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:19.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:19.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:19.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:19.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:19.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:19.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:19.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:19.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:19.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:19.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:19.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:19.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:19.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:19.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:19.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:19.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:19.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:19.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:19.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:19.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:19.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:19.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:19.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:19.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:19.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:19.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:19.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:19.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:19.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:19.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:19.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:19.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 14w REG 8,1 144639698 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:19.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:19.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:19.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:19.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:19.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:19.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:19.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:19.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:19.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:19.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:19.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:19.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:19.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:19.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:19.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:19.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:19.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:19.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:19.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:19.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:19.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:19.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:19.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:19.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:19.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:19.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:19.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:19.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:19.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:19.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:19.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:19.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:19.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:19.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:19.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:19.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:19.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:19.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:19.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:19.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118685 ceph-osd root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:19.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:19.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:19.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:19.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:19.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:19.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:19.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:19.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:19.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:19.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:19.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:19.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:19.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:19.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:19.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:19.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:19.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:19.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:19.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:19.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:19.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:19.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:19.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:19.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:19.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:19.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:19.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:19.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:19.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:19.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:19.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:19.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:19.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:19.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:19.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:19.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:19.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:19.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:19.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:19.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:19.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:19.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:19.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:19.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:19.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:19.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:19.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:19.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:19.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:19.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:19.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:19.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:19.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:19.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:19.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:19.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:19.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:19.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:19.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:19.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:19.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:19.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:19.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:19.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:19.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:19.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:19.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:19.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:19.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:19.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:19.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:19.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:19.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:19.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:19.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:19.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:19.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:19.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:19.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:19.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:19.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:19.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:19.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:19.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:19.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 14w REG 8,1 144639698 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:19.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:19.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:19.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:19.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:19.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:19.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:19.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:19.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:19.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:19.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:19.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:19.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:19.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:19.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:19.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:19.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:19.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:19.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:19.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:19.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:19.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:19.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:19.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:19.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:19.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:19.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:19.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:19.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:19.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:19.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:19.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:19.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:19.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:19.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:19.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:19.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:19.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:19.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:19.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:19.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118693 ceph-osd root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:19.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:19.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:19.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:19.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:19.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:19.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:19.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:19.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:19.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:19.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:19.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:19.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:19.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:19.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:19.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:19.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:19.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:19.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:19.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:19.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:19.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:19.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:19.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:19.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:19.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:19.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:19.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:19.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:19.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:19.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:19.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:19.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:19.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:19.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:19.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:19.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:19.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:19.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:19.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:19.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:19.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:19.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:19.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:19.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:19.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:19.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:19.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:19.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:19.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:19.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:19.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:19.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:19.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:19.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:19.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:19.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:19.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:19.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:19.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:19.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:19.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:19.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:19.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:19.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:19.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:19.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:19.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:19.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:19.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:19.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:19.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:19.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:19.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:19.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:19.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:19.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:19.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:19.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:19.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:19.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:19.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:19.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:19.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:19.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:19.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 14w REG 8,1 144639698 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:19.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:19.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:19.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:19.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:19.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:19.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:19.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:19.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:19.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:19.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:19.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:19.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:19.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:19.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:19.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:19.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:19.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:19.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:19.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:19.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:19.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:19.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:19.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:19.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:19.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:19.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:19.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:19.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:19.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:19.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:19.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:19.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:19.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:19.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:19.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:19.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:19.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:19.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:19.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:19.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118712 ceph-osd root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:19.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:19.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:19.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:19.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:19.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:19.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:19.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:19.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:19.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:19.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:19.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:19.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:19.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:19.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:19.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:19.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:19.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:19.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:19.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:19.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:19.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:19.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:19.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:19.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:19.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:19.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:19.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:19.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:19.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:19.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:19.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:19.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:19.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:19.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:19.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:19.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:19.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:19.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:19.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:19.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:19.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:19.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:19.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:19.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:19.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:19.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:19.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:19.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:19.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:19.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:19.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:19.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:19.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:19.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:19.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:19.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:19.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:19.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:19.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:19.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:19.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:19.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:19.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:19.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:19.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:19.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:19.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:19.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:19.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:19.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:19.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:19.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:19.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:19.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:19.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:19.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:19.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:19.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:19.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:19.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:19.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:19.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:19.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:19.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:19.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 14w REG 8,1 144639698 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:19.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:19.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:19.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:19.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:19.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:19.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:19.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:19.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:19.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:19.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:19.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:19.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:19.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:19.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:19.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:19.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:19.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:19.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:19.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:19.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:19.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:19.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:19.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:19.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:19.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:19.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:19.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:19.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:19.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:19.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:19.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:19.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:19.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:19.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:19.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:19.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:19.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:19.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:19.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:19.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118722 ceph-osd root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:19.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:19.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:19.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:19.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:19.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:19.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:19.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:19.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:19.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:19.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:19.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:19.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:19.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:19.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:19.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:19.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:19.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:19.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:19.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:19.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:19.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:19.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:19.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:19.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:19.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:19.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:19.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:19.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:19.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:19.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:19.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:19.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:19.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:19.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:19.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:19.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:19.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:19.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:19.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:19.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:19.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:19.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:19.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:19.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:19.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:19.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:19.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:19.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:19.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:19.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:19.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:19.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:19.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:19.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:19.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:19.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:19.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:19.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:19.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:19.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:19.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:19.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:19.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:19.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:19.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:19.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:19.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:19.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:19.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:19.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:19.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:19.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:19.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:19.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:19.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:19.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:19.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:19.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:19.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:19.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:19.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:19.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:19.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:19.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:19.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 14w REG 8,1 144639981 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:19.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:19.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:19.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:19.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:19.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:19.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:19.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:19.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:19.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:19.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:19.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:19.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:19.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:19.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:19.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:19.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:19.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:19.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:19.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:19.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:19.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:19.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:19.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:19.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:19.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:19.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:19.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:19.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:19.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:19.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:19.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:19.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:19.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:19.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:19.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:19.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:19.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:19.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:19.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:19.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118728 ceph-osd root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:19.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:19.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:19.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:19.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:19.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:19.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:19.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:19.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:19.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:19.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:19.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:19.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:19.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:19.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:19.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:19.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:19.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:19.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:19.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:19.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:19.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:19.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:19.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:19.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:19.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:19.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:19.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:19.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:19.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:19.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:19.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:19.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:19.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:19.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:19.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:19.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:19.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:19.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:19.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:19.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:19.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:19.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:19.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:19.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:19.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:19.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:19.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:19.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:19.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:19.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:19.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:19.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:19.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:19.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:19.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:19.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:19.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:19.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:19.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:19.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:19.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:19.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:19.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:19.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:19.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:19.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:19.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:19.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:19.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:19.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:19.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:19.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:19.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:19.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:19.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:19.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:19.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:19.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:19.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:19.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:19.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:19.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:19.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:19.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:19.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 14w REG 8,1 144639981 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:19.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:19.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:19.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:19.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:19.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:19.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:19.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:19.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:19.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:19.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:19.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:19.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:19.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:19.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:19.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:19.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:19.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:19.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:19.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:19.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:19.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:19.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:19.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:19.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:19.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:19.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:19.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:19.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:19.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:19.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:19.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:19.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:19.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:19.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:19.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:19.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:19.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:19.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:19.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:19.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118736 ceph-osd root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:19.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:19.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:19.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:19.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:19.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:19.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:19.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:19.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:19.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:19.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:19.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:19.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:19.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:19.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:19.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:19.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:19.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:19.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:19.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:19.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:19.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:19.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:19.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:19.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:19.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:19.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:19.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:19.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:19.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:19.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:19.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:19.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:19.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:19.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:19.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:19.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:19.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:19.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:19.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:19.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:19.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:19.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:19.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:19.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:19.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:19.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:19.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:19.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:19.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:19.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:19.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:19.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:19.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:19.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:19.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:19.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:19.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:19.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:19.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:19.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:19.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:19.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:19.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:19.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:19.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:19.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:19.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:19.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:19.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:19.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:19.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:19.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:19.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:19.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:19.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:19.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:19.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:19.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:19.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:19.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:19.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:19.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:19.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:19.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:19.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 14w REG 8,1 144639981 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:19.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:19.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:19.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:19.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:19.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:19.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:19.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:19.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:19.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:19.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:19.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:19.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:19.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:19.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:19.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:19.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:19.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:19.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:19.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:19.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:19.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:19.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:19.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:19.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:19.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:19.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:19.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:19.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:19.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:19.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:19.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:19.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:19.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:19.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:19.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:19.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:19.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:19.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:19.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:19.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118744 ceph-osd root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:19.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:19.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:19.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:19.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:19.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:19.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:19.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:19.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:19.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:19.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:19.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:19.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:19.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:19.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:19.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:19.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:19.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:19.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:19.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:19.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:19.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:19.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:19.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:19.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:19.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:19.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:19.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:19.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:19.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:19.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:19.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:19.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:19.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:19.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:19.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:19.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:19.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:19.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:19.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:19.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:19.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:19.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:19.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:19.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:19.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:19.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:19.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:19.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:19.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:19.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:19.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:19.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:19.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:19.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:19.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:19.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:19.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:19.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:19.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:19.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:19.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:19.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:19.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:19.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:19.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:19.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:19.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:19.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:19.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:19.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:19.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:19.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:19.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:19.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:19.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:19.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:19.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:19.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:19.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:19.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:19.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:19.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:19.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:19.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:19.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 14w REG 8,1 144639981 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:19.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:19.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:19.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:19.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:19.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:19.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:19.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:19.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:19.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:19.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:19.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:19.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:19.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:19.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:19.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:19.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:19.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:19.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:19.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:19.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:19.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:19.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:19.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:19.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:19.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:19.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:19.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:19.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:19.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:19.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:19.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:19.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:19.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:19.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:19.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:19.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:19.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:19.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:19.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:19.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118745 ceph-osd root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:19.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:19.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:19.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:19.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:19.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:19.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:19.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:19.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:19.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:19.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:19.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:19.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:19.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:19.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:19.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:19.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:19.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:19.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:19.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:19.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:19.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:19.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:19.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:19.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:19.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:19.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:19.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:19.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:19.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:19.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:19.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:19.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:19.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:19.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:19.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:19.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:19.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:19.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:19.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:19.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:19.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:19.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:19.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:19.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:19.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:19.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:19.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:19.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:19.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:19.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:19.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:19.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:19.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:19.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:19.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:19.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:19.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:19.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:19.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:19.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:19.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:19.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:19.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:19.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:19.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:19.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:19.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:19.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:19.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:19.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:19.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:19.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:19.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:19.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:19.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:19.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:19.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:19.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:19.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:19.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:19.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:19.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:19.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:19.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:19.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 14w REG 8,1 144639981 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:19.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:19.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:19.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:19.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:19.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:19.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:19.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:19.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:19.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:19.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:19.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:19.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:19.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:19.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:19.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:19.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:19.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:19.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:19.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:19.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:19.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:19.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:19.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:19.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:19.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:19.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:19.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:19.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:19.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:19.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:19.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:19.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:19.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:19.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:19.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:19.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:19.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:19.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:19.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:19.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118746 safe_time root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:19.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:19.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:19.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:19.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:19.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:19.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:19.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:19.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:19.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:19.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:19.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:19.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:19.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:19.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:19.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:19.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:19.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:19.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:19.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:19.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:19.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:19.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:19.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:19.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:19.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:19.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:19.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:19.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:19.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:19.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:19.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:19.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:19.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:19.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:19.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:19.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:19.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:19.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:19.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:19.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:19.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:19.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:19.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:19.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:19.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:19.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:19.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:19.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:19.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:19.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:19.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:19.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:19.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:19.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:19.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:19.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:19.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:19.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:19.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:19.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:19.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:19.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:19.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:19.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:19.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:19.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:19.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:19.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:19.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:19.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:19.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:19.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:19.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:19.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:19.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:19.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:19.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:19.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:19.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:19.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:19.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:19.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:19.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:19.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:19.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 14w REG 8,1 144639981 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:19.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:19.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:19.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:19.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:19.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:19.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:19.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:19.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:19.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:19.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:19.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:19.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:19.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:19.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:19.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:19.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:19.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:19.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:19.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:19.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:19.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:19.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:19.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:19.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:19.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:19.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:19.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:19.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:19.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:19.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:19.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:19.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:19.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:19.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:19.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:19.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:19.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:19.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:19.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:19.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118747 safe_time root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:19.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:19.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:19.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:19.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:19.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:19.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:19.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:19.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:19.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:19.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:19.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:19.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:19.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:19.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:19.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:19.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:19.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:19.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:19.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:19.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:19.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:19.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:19.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:19.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:19.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:19.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:19.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:19.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:19.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:19.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:19.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:19.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:19.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:19.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:19.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:19.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:19.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:19.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:19.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:19.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:19.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:19.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:19.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:19.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:19.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:19.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:19.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:19.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:19.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:19.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:19.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:19.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:19.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:19.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:19.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:19.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:19.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:19.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:19.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:19.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:19.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:19.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:19.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:19.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:19.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:19.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:19.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:19.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:19.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:19.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:19.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:19.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:19.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:19.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:19.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:19.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:19.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:19.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:19.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:19.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:19.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:19.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:19.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:19.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:19.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 14w REG 8,1 144639981 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:19.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:19.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:19.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:19.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:19.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:19.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:19.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:19.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:19.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:19.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:19.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:19.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:19.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:19.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:19.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:19.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:19.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:19.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:19.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:19.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:19.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:19.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:19.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:19.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:19.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:19.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:19.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:19.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:19.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:19.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:19.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:19.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:19.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:19.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:19.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:19.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:19.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:19.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:19.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:19.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118748 safe_time root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:19.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:19.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:19.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:19.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:19.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:19.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:19.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:19.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:19.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:19.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:19.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:19.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:19.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:19.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:19.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:19.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:19.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:19.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:19.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:19.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:19.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:19.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:19.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:19.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:19.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:19.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:19.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:19.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:19.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:19.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:19.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:19.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:19.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:19.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:19.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:19.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:19.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:19.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:19.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:19.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:19.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:19.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:19.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:19.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:19.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:19.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:19.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:19.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:19.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:19.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:19.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:19.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:19.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:19.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:19.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:19.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:19.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:19.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:19.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:19.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:19.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:19.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:19.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:19.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:19.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:19.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:19.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:19.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:19.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:19.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:19.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:19.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:19.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:19.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:19.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:19.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:19.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:19.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:19.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:19.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:19.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:19.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:19.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:19.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:19.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 14w REG 8,1 144639981 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:19.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:19.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:19.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:19.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:19.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:19.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:19.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:19.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:19.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:19.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:19.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:19.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:19.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:19.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:19.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:19.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:19.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:19.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:19.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:19.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:19.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:19.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:19.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:19.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:19.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:19.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:19.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:19.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:19.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:19.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:19.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:19.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:19.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:19.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:19.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:19.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:19.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:19.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:19.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:19.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118749 safe_time root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:19.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:19.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:19.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:19.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:19.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:19.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:19.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:19.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:19.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:19.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:19.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:19.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:19.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:19.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:19.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:19.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:19.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:19.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:19.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:19.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:19.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:19.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:19.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:19.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:19.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:19.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:19.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:19.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:19.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:19.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:19.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:19.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:19.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:19.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:19.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:19.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:19.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:19.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:19.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:19.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:19.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:19.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:19.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:19.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:19.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:19.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:19.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:19.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:19.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:19.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:19.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:19.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:19.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:19.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:19.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:19.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:19.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:19.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:19.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:19.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:19.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:19.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:19.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:19.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:19.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:19.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:19.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:19.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:19.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:19.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:19.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:19.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:19.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:19.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:19.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:19.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:19.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:19.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:19.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:19.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:19.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:19.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:19.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:19.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:19.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 14w REG 8,1 144639981 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:19.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:19.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:19.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:19.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:19.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:19.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:19.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:19.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:19.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:19.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:19.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:19.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:19.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:19.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:19.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:19.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:19.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:19.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:19.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:19.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:19.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:19.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:19.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:19.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:19.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:19.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:19.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:19.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:19.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:19.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:19.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:19.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:19.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:19.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:19.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:19.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:19.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:19.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:19.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:19.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118750 fn_anonym root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:19.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:19.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:19.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:19.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:19.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:19.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:19.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:19.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:19.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:19.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:19.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:19.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:19.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:19.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:19.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:19.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:19.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:19.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:19.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:19.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:19.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:19.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:19.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:19.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:19.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:19.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:19.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:19.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:19.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:19.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:19.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:19.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:19.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:19.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:19.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:19.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:19.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:19.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:19.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:19.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:19.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:19.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:19.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:19.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:19.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:19.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:19.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:19.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:19.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:19.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:19.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:19.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:19.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:19.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:19.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:19.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:19.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:19.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:19.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:19.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:19.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:19.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:19.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:19.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:19.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:19.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:19.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:19.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:19.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:19.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:19.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:19.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:19.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:19.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:19.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:19.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:19.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:19.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:19.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:19.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:19.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:19.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:19.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:19.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:19.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 14w REG 8,1 144639981 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:19.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:19.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:19.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:19.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:19.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:19.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:19.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:19.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:19.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:19.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:19.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:19.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:19.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:19.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:19.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:19.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:19.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:19.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:19.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:19.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:19.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:19.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:19.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:19.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:19.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:19.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:19.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:19.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:19.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:19.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:19.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:19.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:19.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:19.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:19.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:19.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:19.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:19.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:19.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:19.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118753 rocksdb:l root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:19.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:19.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:19.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:19.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:19.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:19.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:19.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:19.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:19.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:19.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:19.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:19.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:19.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:19.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:19.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:19.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:19.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:19.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:19.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:19.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:19.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:19.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:19.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:19.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:19.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:19.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:19.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:19.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:19.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:19.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:19.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:19.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:19.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:19.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:19.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:19.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:19.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:19.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:19.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:19.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:19.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:19.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:19.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:19.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:19.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:19.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:19.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:19.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:19.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:19.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:19.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:19.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:19.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:19.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:19.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:19.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:19.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:19.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:19.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:19.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:19.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:19.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:19.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:19.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:19.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:19.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:19.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:19.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:19.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:19.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:19.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:19.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:19.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:19.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:19.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:19.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:19.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:19.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:19.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:19.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:19.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:19.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:19.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:19.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:19.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 14w REG 8,1 144639981 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:19.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:19.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:19.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:19.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:19.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:19.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:19.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:19.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:19.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:19.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:19.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:19.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:19.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:19.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:19.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:19.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:19.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:19.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:19.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:19.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:19.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:19.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:19.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:19.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:19.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:19.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:19.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:19.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:19.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:19.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:19.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:19.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:19.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:19.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:19.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:19.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:19.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:19.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:19.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:19.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118754 rocksdb:l root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:19.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:19.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:19.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:19.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:19.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:19.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:19.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:19.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:19.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:19.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:19.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:19.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:19.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:19.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:19.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:19.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:19.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:19.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:19.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:19.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:19.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:19.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:19.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:19.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:19.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:19.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:19.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:19.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:19.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:19.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:19.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:19.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:19.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:19.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:19.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:19.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:19.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:19.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:19.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:19.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:19.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:19.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:19.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:19.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:19.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:19.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:19.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:19.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:19.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:19.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:19.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:19.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:19.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:19.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:19.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:19.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:19.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:19.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:19.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:19.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:19.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:19.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:19.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:19.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:19.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:19.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:19.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:19.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:19.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:19.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:19.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:19.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:19.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:19.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:19.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:19.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:19.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:19.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:19.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:19.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:19.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:19.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:19.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:19.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:19.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 14w REG 8,1 144639981 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:19.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:19.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:19.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:19.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:19.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:19.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:19.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:19.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:19.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:19.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:19.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:19.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:19.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:19.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:19.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:19.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:19.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:19.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:19.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:19.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:19.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:19.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:19.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:19.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:19.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:19.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:19.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:19.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:19.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:19.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:19.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:19.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:19.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:19.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:19.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:19.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:19.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:19.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:19.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:19.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118755 rocksdb:l root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:19.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:19.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:19.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:19.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:19.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:19.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:19.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:19.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:19.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:19.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:19.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:19.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:19.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:19.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:19.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:19.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:19.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:19.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:19.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:19.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:19.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:19.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:19.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:19.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:19.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:19.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:19.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:19.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:19.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:19.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:19.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:19.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:19.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:19.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:19.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:19.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:19.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:19.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:19.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:19.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:19.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:19.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:19.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:19.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:19.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:19.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:19.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:19.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:19.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:19.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:19.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:19.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:19.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:19.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:19.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:19.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:19.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:19.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:19.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:19.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:19.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:19.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:19.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:19.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:19.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:19.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:19.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:19.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:19.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:19.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:19.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:19.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:19.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:19.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:19.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:19.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:19.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:19.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:19.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:19.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:19.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:19.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:19.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:19.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:19.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 14w REG 8,1 144639981 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:19.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:19.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:19.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:19.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:19.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:19.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:19.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:19.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:19.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:19.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:19.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:19.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:19.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:19.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:19.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:19.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:19.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:19.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:19.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:19.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:19.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:19.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:19.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:19.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:19.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:19.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:19.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:19.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:19.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:19.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:19.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:19.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:19.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:19.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:19.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:19.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:19.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:19.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:19.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:19.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 118756 rocksdb:h root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:19.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:19.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:19.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:19.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:19.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:19.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:19.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:19.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:19.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:19.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:19.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:19.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:19.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:19.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:19.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:19.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:19.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:19.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:19.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:19.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:19.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:19.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:19.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:19.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:19.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:19.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:19.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:19.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:19.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:19.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:19.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:19.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:19.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:19.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:19.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:19.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:19.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:19.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:19.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:19.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:19.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:19.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:19.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:19.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:19.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:19.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:19.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:19.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:19.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:19.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:19.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:19.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:19.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:19.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:19.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:19.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:19.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:19.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:19.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:19.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:19.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:19.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:19.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:19.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:19.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:19.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:19.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:19.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:19.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:19.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:19.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:19.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:19.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:19.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:19.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:19.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:19.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:19.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:19.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:19.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:19.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:19.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:19.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:19.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:19.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 14w REG 8,1 144639981 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:19.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:19.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:19.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:19.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:19.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:19.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:19.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:19.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:19.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:19.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:19.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:19.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:19.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:19.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:19.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:19.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:19.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:19.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:19.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:19.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:19.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:19.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:19.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:19.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:19.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:19.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:19.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:19.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:19.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:19.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:19.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:19.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:19.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:19.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:19.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:19.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:19.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:19.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:19.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:19.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120244 bstore_ai root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:19.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:19.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:19.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:19.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:19.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:19.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:19.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:19.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:19.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:19.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:19.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:19.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:19.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:19.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:19.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:19.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:19.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:19.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:19.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:19.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:19.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:19.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:19.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:19.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:19.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:19.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:19.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:19.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:19.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:19.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:19.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:19.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:19.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:19.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:19.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:19.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:19.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:19.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:19.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:19.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:19.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:19.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:19.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:19.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:19.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:19.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:19.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:19.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:19.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:19.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:19.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:19.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:19.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:19.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:19.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:19.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:19.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:19.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:19.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:19.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:19.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:19.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:19.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:19.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:19.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:19.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:19.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:19.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:19.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:19.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:19.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:19.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:19.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:19.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:19.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:19.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:19.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:19.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:19.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:19.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:19.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:19.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:19.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:19.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:19.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 14w REG 8,1 144639981 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:19.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:19.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:19.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:19.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:19.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:19.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:19.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:19.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:19.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:19.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:19.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:19.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:19.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:19.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:19.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:19.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:19.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:19.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:19.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:19.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:19.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:19.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:19.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:19.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:19.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:19.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:19.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:19.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:19.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:19.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:19.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:19.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:19.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:19.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:19.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:19.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:19.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:19.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:19.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:19.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 120972 bstore_ai root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:19.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:19.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:19.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:19.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:19.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:19.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:19.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:19.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:19.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:19.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:19.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:19.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:19.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:19.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:19.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:19.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:19.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:19.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:19.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:19.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:19.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:19.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:19.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:19.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:19.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:19.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:19.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:19.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:19.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:19.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:19.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:19.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:19.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:19.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:19.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:19.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:19.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:19.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:19.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:19.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:19.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:19.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:19.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:19.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:19.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:19.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:19.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:19.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:19.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:19.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:19.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:19.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:19.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:19.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:19.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:19.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:19.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:19.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:19.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:19.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:19.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:19.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:19.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:19.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:19.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:19.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:19.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:19.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:19.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:19.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:19.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:19.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:19.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:19.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:19.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:19.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:19.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:19.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:19.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:19.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:19.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:19.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:19.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:19.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:19.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 14w REG 8,1 144639981 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:19.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:19.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:19.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:19.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:19.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:19.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:19.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:19.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:19.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:19.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:19.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:19.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:19.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:19.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:19.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:19.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:19.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:19.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:19.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:19.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:19.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:19.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:19.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:19.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:19.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:19.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:19.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:19.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:19.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:19.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:19.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:19.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:19.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:19.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:19.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:19.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:19.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:19.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:19.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:19.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121153 ceph-osd root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:19.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:19.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:19.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:19.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:19.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:19.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:19.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:19.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:19.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:19.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:19.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:19.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:19.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:19.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:19.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:19.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:19.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:19.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:19.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:19.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:19.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:19.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:19.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:19.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:19.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:19.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:19.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:19.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:19.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:19.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:19.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:19.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:19.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:19.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:19.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:19.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:19.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:19.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:19.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:19.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:19.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:19.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:19.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:19.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:19.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:19.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:19.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:19.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:19.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:19.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:19.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:19.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:19.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:19.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:19.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:19.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:19.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:19.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:19.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:19.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:19.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:19.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:19.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:19.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:19.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:19.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:19.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:19.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:19.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:19.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:19.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:19.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:19.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:19.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:19.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:19.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:19.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:19.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:19.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:19.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:19.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:19.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:19.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:19.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:19.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 14w REG 8,1 144639981 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:19.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:19.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:19.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:19.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:19.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:19.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:19.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:19.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:19.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:19.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:19.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:19.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:19.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:19.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:19.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:19.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:19.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:19.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:19.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:19.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:19.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:19.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:19.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:19.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:19.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:19.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:19.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:19.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:19.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:19.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:19.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:19.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:19.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:19.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:19.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:19.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:19.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:19.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:19.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:19.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121154 cfin root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:19.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:19.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:19.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:19.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:19.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:19.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:19.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:19.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:19.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:19.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:19.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:19.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:19.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:19.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:19.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:19.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:19.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:19.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:19.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:19.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:19.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:19.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:19.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:19.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:19.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:19.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:19.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:19.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:19.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:19.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:19.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:19.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:19.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:19.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:19.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:19.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:19.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:19.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:19.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:19.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:19.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:19.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:19.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:19.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:19.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:19.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:19.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:19.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:19.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:19.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:19.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:19.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:19.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:19.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:19.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:19.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:19.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:19.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:19.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:19.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:19.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:19.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:19.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:19.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:19.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:19.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:19.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:19.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:19.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:19.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:19.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:19.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:19.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:19.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:19.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:19.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:19.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:19.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:19.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:19.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:19.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:19.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:19.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:19.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:19.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 14w REG 8,1 144639981 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:19.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:19.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:19.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:19.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:19.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:19.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:19.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:19.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:19.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:19.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:19.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:19.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:19.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:19.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:19.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:19.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:19.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:19.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:19.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:19.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:19.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:19.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:19.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:19.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:19.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:19.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:19.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:19.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:19.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:19.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:19.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:19.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:19.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:19.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:19.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:19.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:19.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:19.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:19.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:19.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121155 bstore_kv root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:19.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:19.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:19.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:19.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:19.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:19.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:19.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:19.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:19.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:19.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:19.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:19.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:19.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:19.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:19.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:19.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:19.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:19.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:19.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:19.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:19.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:19.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:19.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:19.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:19.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:19.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:19.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:19.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:19.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:19.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:19.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:19.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:19.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:19.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:19.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:19.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:19.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:19.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:19.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:19.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:19.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:19.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:19.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:19.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:19.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:19.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:19.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:19.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:19.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:19.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:19.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:19.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:19.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:19.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:19.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:19.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:19.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:19.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:19.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:19.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:19.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:19.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:19.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:19.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:19.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:19.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:19.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:19.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:19.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:19.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:19.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:19.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:19.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:19.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:19.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:19.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:19.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:19.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:19.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:19.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:19.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:19.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:19.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:19.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:19.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 14w REG 8,1 144639981 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:19.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:19.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:19.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:19.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:19.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:19.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:19.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:19.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:19.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:19.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:19.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:19.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:19.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:19.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:19.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:19.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:19.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:19.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:19.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:19.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:19.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:19.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:19.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:19.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:19.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:19.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:19.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:19.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:19.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:19.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:19.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:19.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:19.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:19.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:19.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:19.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:19.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:19.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:19.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:19.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121156 bstore_kv root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:19.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:19.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:19.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:19.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:19.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:19.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:19.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:19.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:19.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:19.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:19.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:19.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:19.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:19.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:19.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:19.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:19.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:19.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:19.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:19.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:19.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:19.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:19.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:19.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:19.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:19.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:19.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:19.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:19.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:19.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:19.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:19.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:19.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:19.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:19.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:19.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:19.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:19.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:19.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:19.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:19.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:19.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:19.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:19.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:19.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:19.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:19.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:19.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:19.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:19.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:19.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:19.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:19.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:19.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:19.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:19.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:19.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:19.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:19.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:19.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:19.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:19.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:19.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:19.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:19.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:19.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:19.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:19.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:19.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:19.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:19.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:19.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:19.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:19.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:19.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:19.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:19.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:19.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:19.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:19.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:19.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:19.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:19.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:19.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:19.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 14w REG 8,1 144639981 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:19.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:19.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:19.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:19.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:19.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:19.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:19.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:19.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:19.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:19.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:19.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:19.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:19.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:19.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:19.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:19.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:19.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:19.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:19.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:19.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:19.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:19.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:19.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:19.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:19.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:19.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:19.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:19.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:19.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:19.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:19.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:19.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:19.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:19.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:19.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:19.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:19.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:19.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:19.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:19.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121157 bstore_me root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:19.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:19.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:19.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:19.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:19.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:19.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:19.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:19.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:19.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:19.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:19.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:19.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:19.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:19.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:19.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:19.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:19.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:19.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:19.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:19.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:19.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:19.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:19.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:19.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:19.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:19.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:19.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:19.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:19.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:19.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:19.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:19.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:19.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:19.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:19.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:19.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:19.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:19.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:19.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:19.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:19.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:19.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:19.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:19.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:19.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:19.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:19.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:19.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:19.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:19.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:19.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:19.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:19.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:19.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:19.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:19.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:19.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:19.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:19.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:19.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:19.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:19.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:19.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:19.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:19.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:19.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:19.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:19.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:19.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:19.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:19.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:19.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:19.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:19.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:19.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:19.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:19.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:19.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:19.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:19.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:19.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:19.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:19.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:19.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:19.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 14w REG 8,1 144639981 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:19.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:19.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:19.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:19.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:19.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:19.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:19.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:19.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:19.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:19.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:19.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:19.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:19.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:19.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:19.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:19.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:19.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:19.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:19.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:19.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:19.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:19.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:19.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:19.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:19.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:19.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:19.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:19.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:19.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:19.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:19.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:19.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:19.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:19.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:19.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:19.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:19.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:19.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:19.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:19.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:19.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:19.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:19.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:19.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:19.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:19.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:19.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:19.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121158 ms_dispat root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:19.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:19.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:19.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:19.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:19.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:19.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:19.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:19.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:19.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:19.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:19.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:19.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:19.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:19.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:19.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:19.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:19.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:19.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:19.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:19.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:19.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:19.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:19.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:19.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:19.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:19.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:19.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:19.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:19.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:19.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:19.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:19.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:19.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:19.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:19.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:19.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:19.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:19.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:19.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:19.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:19.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:19.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:19.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:19.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:19.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:19.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:19.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:19.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:19.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:19.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:19.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:19.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:19.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:19.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:19.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:19.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:19.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:19.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:19.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:19.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:19.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:19.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:19.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:19.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:19.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:19.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:19.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:19.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:19.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:19.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:19.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:19.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:19.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:19.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:19.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:19.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:19.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:19.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:19.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:19.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:19.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:19.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:19.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:19.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:19.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:19.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:19.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:19.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:19.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 14w REG 8,1 144639981 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:19.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:19.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:19.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:19.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:19.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:19.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:19.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:19.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:19.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:19.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:19.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:19.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:19.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:19.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:19.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:19.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:19.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:19.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:20.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:20.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:20.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:20.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:20.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:20.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:20.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:20.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:20.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:20.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:20.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:20.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:20.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:20.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:20.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:20.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:20.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:20.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:20.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:20.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:20.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:20.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:20.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:20.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:20.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:20.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121159 ms_local root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:20.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:20.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:20.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:20.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:20.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:20.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:20.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:20.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:20.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:20.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:20.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:20.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:20.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:20.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:20.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:20.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:20.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:20.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:20.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:20.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:20.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:20.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:20.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:20.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:20.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:20.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:20.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:20.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:20.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:20.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:20.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:20.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:20.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:20.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:20.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:20.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:20.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:20.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:20.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:20.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:20.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:20.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:20.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:20.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:20.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:20.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:20.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:20.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:20.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:20.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:20.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:20.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:20.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:20.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:20.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:20.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:20.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:20.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:20.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:20.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:20.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:20.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:20.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:20.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:20.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:20.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:20.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:20.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:20.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:20.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:20.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:20.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:20.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:20.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:20.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:20.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:20.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:20.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:20.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:20.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:20.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:20.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:20.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:20.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:20.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 14w REG 8,1 144639981 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:20.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:20.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:20.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:20.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:20.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:20.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:20.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:20.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:20.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:20.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:20.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:20.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:20.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:20.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:20.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:20.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:20.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:20.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:20.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:20.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:20.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:20.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:20.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:20.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:20.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:20.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:20.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:20.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:20.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:20.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:20.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:20.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:20.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:20.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:20.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:20.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:20.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:20.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:20.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:20.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121160 safe_time root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:20.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:20.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:20.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:20.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:20.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:20.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:20.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:20.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:20.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:20.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:20.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:20.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:20.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:20.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:20.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:20.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:20.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:20.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:20.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:20.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:20.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:20.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:20.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:20.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:20.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:20.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:20.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:20.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:20.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:20.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:20.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:20.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:20.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:20.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:20.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:20.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:20.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:20.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:20.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:20.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:20.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:20.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:20.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:20.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:20.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:20.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:20.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:20.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:20.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:20.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:20.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:20.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:20.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:20.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:20.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:20.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:20.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:20.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:20.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:20.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:20.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:20.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:20.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:20.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:20.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:20.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:20.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:20.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:20.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:20.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:20.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:20.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:20.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:20.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:20.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:20.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:20.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:20.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:20.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:20.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:20.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:20.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:20.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:20.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:20.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 14w REG 8,1 144639981 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:20.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:20.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:20.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:20.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:20.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:20.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:20.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:20.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:20.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:20.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:20.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:20.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:20.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:20.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:20.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:20.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:20.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:20.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:20.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:20.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:20.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:20.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:20.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:20.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:20.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:20.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:20.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:20.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:20.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:20.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:20.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:20.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:20.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:20.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:20.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:20.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:20.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:20.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:20.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:20.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121161 safe_time root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:20.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:20.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:20.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:20.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:20.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:20.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:20.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:20.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:20.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:20.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:20.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:20.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:20.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:20.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:20.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:20.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:20.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:20.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:20.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:20.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:20.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:20.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:20.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:20.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:20.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:20.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:20.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:20.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:20.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:20.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:20.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:20.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:20.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:20.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:20.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:20.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:20.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:20.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:20.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:20.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:20.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:20.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:20.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:20.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:20.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:20.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:20.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:20.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:20.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:20.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:20.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:20.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:20.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:20.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:20.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:20.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:20.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:20.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:20.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:20.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:20.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:20.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:20.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:20.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:20.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:20.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:20.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:20.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:20.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:20.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:20.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:20.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:20.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:20.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:20.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:20.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:20.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:20.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:20.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:20.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:20.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:20.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:20.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:20.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:20.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 14w REG 8,1 144639981 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:20.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:20.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:20.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:20.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:20.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:20.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:20.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:20.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:20.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:20.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:20.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:20.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:20.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:20.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:20.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:20.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:20.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:20.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:20.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:20.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:20.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:20.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:20.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:20.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:20.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:20.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:20.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:20.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:20.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:20.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:20.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:20.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:20.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:20.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:20.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:20.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:20.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:20.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:20.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:20.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121162 ms_dispat root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:20.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:20.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:20.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:20.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:20.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:20.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:20.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:20.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:20.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:20.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:20.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:20.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:20.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:20.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:20.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:20.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:20.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:20.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:20.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:20.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:20.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:20.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:20.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:20.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:20.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:20.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:20.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:20.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:20.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:20.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:20.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:20.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:20.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:20.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:20.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:20.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:20.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:20.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:20.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:20.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:20.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:20.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:20.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:20.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:20.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:20.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:20.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:20.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:20.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:20.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:20.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:20.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:20.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:20.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:20.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:20.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:20.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:20.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:20.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:20.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:20.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:20.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:20.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:20.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:20.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:20.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:20.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:20.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:20.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:20.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:20.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:20.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:20.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:20.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:20.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:20.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:20.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:20.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:20.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:20.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:20.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:20.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:20.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:20.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:20.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 14w REG 8,1 144639981 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:20.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:20.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:20.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:20.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:20.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:20.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:20.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:20.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:20.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:20.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:20.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:20.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:20.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:20.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:20.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:20.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:20.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:20.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:20.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:20.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:20.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:20.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:20.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:20.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:20.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:20.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:20.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:20.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:20.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:20.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:20.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:20.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:20.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:20.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:20.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:20.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:20.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:20.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:20.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:20.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121163 ms_local root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:20.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:20.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:20.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:20.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:20.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:20.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:20.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:20.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:20.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:20.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:20.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:20.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:20.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:20.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:20.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:20.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:20.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:20.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:20.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:20.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:20.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:20.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:20.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:20.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:20.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:20.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:20.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:20.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:20.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:20.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:20.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:20.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:20.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:20.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:20.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:20.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:20.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:20.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:20.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:20.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:20.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:20.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:20.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:20.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:20.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:20.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:20.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:20.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:20.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:20.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:20.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:20.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:20.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:20.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:20.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:20.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:20.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:20.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:20.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:20.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:20.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:20.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:20.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:20.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:20.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:20.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:20.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:20.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:20.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:20.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:20.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:20.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:20.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:20.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:20.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:20.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:20.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:20.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:20.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:20.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:20.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:20.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:20.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:20.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:20.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 14w REG 8,1 144640264 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:20.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:20.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:20.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:20.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:20.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:20.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:20.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:20.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:20.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:20.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:20.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:20.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:20.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:20.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:20.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:20.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:20.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:20.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:20.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:20.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:20.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:20.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:20.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:20.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:20.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:20.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:20.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:20.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:20.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:20.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:20.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:20.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:20.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:20.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:20.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:20.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:20.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:20.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:20.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:20.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121164 ms_dispat root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:20.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:20.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:20.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:20.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:20.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:20.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:20.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:20.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:20.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:20.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:20.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:20.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:20.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:20.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:20.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:20.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:20.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:20.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:20.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:20.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:20.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:20.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:20.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:20.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:20.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:20.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:20.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:20.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:20.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:20.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:20.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:20.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:20.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:20.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:20.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:20.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:20.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:20.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:20.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:20.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:20.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:20.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:20.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:20.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:20.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:20.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:20.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:20.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:20.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:20.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:20.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:20.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:20.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:20.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:20.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:20.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:20.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:20.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:20.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:20.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:20.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:20.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:20.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:20.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:20.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:20.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:20.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:20.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:20.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:20.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:20.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:20.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:20.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:20.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:20.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:20.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:20.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:20.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:20.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:20.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:20.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:20.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:20.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:20.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:20.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 14w REG 8,1 144640264 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:20.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:20.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:20.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:20.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:20.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:20.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:20.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:20.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:20.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:20.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:20.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:20.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:20.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:20.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:20.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:20.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:20.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:20.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:20.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:20.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:20.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:20.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:20.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:20.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:20.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:20.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:20.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:20.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:20.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:20.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:20.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:20.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:20.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:20.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:20.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:20.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:20.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:20.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:20.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:20.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121165 ms_local root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:20.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:20.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:20.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:20.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:20.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:20.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:20.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:20.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:20.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:20.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:20.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:20.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:20.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:20.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:20.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:20.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:20.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:20.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:20.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:20.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:20.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:20.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:20.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:20.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:20.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:20.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:20.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:20.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:20.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:20.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:20.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:20.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:20.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:20.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:20.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:20.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:20.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:20.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:20.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:20.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:20.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:20.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:20.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:20.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:20.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:20.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:20.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:20.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:20.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:20.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:20.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:20.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:20.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:20.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:20.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:20.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:20.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:20.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:20.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:20.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:20.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:20.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:20.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:20.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:20.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:20.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:20.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:20.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:20.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:20.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:20.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:20.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:20.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:20.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:20.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:20.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:20.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:20.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:20.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:20.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:20.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:20.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:20.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:20.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:20.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 14w REG 8,1 144640264 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:20.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:20.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:20.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:20.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:20.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:20.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:20.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:20.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:20.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:20.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:20.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:20.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:20.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:20.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:20.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:20.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:20.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:20.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:20.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:20.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:20.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:20.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:20.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:20.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:20.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:20.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:20.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:20.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:20.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:20.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:20.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:20.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:20.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:20.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:20.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:20.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:20.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:20.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:20.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:20.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121166 ms_dispat root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:20.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:20.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:20.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:20.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:20.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:20.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:20.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:20.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:20.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:20.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:20.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:20.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:20.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:20.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:20.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:20.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:20.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:20.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:20.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:20.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:20.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:20.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:20.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:20.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:20.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:20.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:20.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:20.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:20.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:20.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:20.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:20.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:20.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:20.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:20.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:20.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:20.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:20.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:20.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:20.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:20.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:20.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:20.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:20.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:20.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:20.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:20.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:20.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:20.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:20.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:20.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:20.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:20.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:20.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:20.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:20.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:20.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:20.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:20.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:20.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:20.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:20.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:20.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:20.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:20.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:20.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:20.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:20.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:20.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:20.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:20.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:20.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:20.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:20.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:20.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:20.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:20.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:20.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:20.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:20.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:20.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:20.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:20.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:20.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:20.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 14w REG 8,1 144640264 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:20.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:20.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:20.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:20.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:20.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:20.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:20.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:20.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:20.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:20.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:20.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:20.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:20.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:20.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:20.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:20.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:20.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:20.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:20.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:20.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:20.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:20.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:20.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:20.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:20.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:20.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:20.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:20.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:20.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:20.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:20.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:20.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:20.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:20.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:20.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:20.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:20.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:20.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:20.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:20.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121167 ms_local root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:20.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:20.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:20.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:20.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:20.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:20.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:20.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:20.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:20.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:20.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:20.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:20.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:20.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:20.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:20.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:20.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:20.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:20.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:20.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:20.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:20.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:20.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:20.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:20.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:20.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:20.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:20.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:20.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:20.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:20.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:20.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:20.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:20.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:20.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:20.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:20.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:20.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:20.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:20.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:20.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:20.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:20.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:20.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:20.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:20.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:20.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:20.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:20.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:20.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:20.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:20.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:20.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:20.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:20.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:20.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:20.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:20.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:20.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:20.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:20.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:20.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:20.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:20.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:20.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:20.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:20.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:20.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:20.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:20.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:20.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:20.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:20.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:20.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:20.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:20.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:20.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:20.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:20.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:20.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:20.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:20.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:20.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:20.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:20.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:20.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 14w REG 8,1 144640264 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:20.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:20.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:20.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:20.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:20.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:20.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:20.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:20.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:20.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:20.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:20.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:20.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:20.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:20.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:20.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:20.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:20.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:20.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:20.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:20.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:20.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:20.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:20.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:20.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:20.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:20.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:20.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:20.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:20.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:20.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:20.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:20.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:20.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:20.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:20.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:20.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:20.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:20.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:20.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:20.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121168 ms_dispat root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:20.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:20.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:20.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:20.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:20.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:20.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:20.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:20.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:20.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:20.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:20.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:20.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:20.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:20.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:20.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:20.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:20.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:20.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:20.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:20.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:20.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:20.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:20.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:20.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:20.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:20.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:20.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:20.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:20.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:20.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:20.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:20.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:20.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:20.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:20.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:20.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:20.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:20.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:20.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:20.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:20.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:20.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:20.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:20.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:20.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:20.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:20.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:20.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:20.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:20.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:20.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:20.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:20.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:20.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:20.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:20.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:20.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:20.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:20.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:20.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:20.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:20.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:20.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:20.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:20.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:20.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:20.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:20.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:20.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:20.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:20.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:20.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:20.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:20.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:20.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:20.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:20.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:20.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:20.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:20.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:20.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:20.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:20.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:20.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:20.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 14w REG 8,1 144640264 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:20.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:20.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:20.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:20.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:20.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:20.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:20.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:20.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:20.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:20.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:20.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:20.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:20.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:20.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:20.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:20.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:20.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:20.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:20.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:20.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:20.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:20.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:20.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:20.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:20.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:20.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:20.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:20.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:20.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:20.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:20.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:20.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:20.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:20.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:20.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:20.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:20.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:20.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:20.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:20.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121169 ms_local root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:20.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:20.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:20.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:20.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:20.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:20.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:20.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:20.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:20.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:20.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:20.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:20.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:20.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:20.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:20.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:20.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:20.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:20.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:20.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:20.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:20.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:20.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:20.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:20.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:20.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:20.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:20.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:20.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:20.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:20.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:20.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:20.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:20.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:20.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:20.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:20.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:20.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:20.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:20.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:20.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:20.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:20.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:20.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:20.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:20.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:20.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:20.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:20.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:20.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:20.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:20.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:20.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:20.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:20.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:20.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:20.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:20.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:20.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:20.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:20.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:20.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:20.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:20.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:20.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:20.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:20.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:20.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:20.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:20.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:20.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:20.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:20.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:20.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:20.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:20.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:20.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:20.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:20.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:20.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:20.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:20.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:20.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:20.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:20.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:20.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 14w REG 8,1 144640264 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:20.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:20.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:20.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:20.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:20.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:20.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:20.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:20.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:20.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:20.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:20.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:20.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:20.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:20.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:20.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:20.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:20.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:20.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:20.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:20.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:20.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:20.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:20.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:20.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:20.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:20.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:20.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:20.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:20.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:20.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:20.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:20.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:20.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:20.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:20.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:20.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:20.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:20.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:20.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:20.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121170 ms_dispat root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:20.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:20.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:20.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:20.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:20.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:20.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:20.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:20.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:20.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:20.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:20.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:20.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:20.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:20.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:20.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:20.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:20.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:20.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:20.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:20.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:20.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:20.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:20.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:20.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:20.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:20.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:20.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:20.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:20.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:20.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:20.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:20.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:20.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:20.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:20.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:20.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:20.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:20.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:20.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:20.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:20.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:20.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:20.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:20.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:20.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:20.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:20.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:20.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:20.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:20.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:20.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:20.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:20.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:20.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:20.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:20.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:20.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:20.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:20.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:20.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:20.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:20.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:20.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:20.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:20.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:20.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:20.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:20.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:20.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:20.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:20.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:20.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:20.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:20.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:20.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:20.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:20.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:20.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:20.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:20.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:20.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:20.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:20.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:20.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:20.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 14w REG 8,1 144640264 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:20.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:20.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:20.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:20.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:20.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:20.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:20.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:20.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:20.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:20.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:20.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:20.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:20.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:20.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:20.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:20.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:20.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:20.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:20.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:20.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:20.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:20.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:20.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:20.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:20.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:20.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:20.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:20.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:20.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:20.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:20.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:20.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:20.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:20.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:20.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:20.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:20.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:20.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:20.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:20.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121171 ms_local root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:20.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:20.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:20.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:20.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:20.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:20.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:20.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:20.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:20.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:20.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:20.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:20.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:20.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:20.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:20.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:20.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:20.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:20.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:20.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:20.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:20.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:20.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:20.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:20.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:20.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:20.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:20.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:20.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:20.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:20.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:20.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:20.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:20.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:20.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:20.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:20.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:20.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:20.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:20.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:20.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:20.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:20.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:20.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:20.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:20.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:20.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:20.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:20.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:20.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:20.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:20.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:20.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:20.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:20.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:20.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:20.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:20.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:20.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:20.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:20.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:20.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:20.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:20.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:20.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:20.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:20.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:20.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:20.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:20.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:20.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:20.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:20.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:20.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:20.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:20.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:20.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:20.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:20.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:20.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:20.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:20.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:20.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:20.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:20.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:20.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 14w REG 8,1 144640264 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:20.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:20.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:20.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:20.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:20.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:20.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:20.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:20.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:20.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:20.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:20.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:20.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:20.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:20.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:20.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:20.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:20.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:20.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:20.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:20.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:20.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:20.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:20.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:20.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:20.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:20.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:20.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:20.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:20.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:20.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:20.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:20.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:20.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:20.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:20.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:20.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:20.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:20.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:20.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:20.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121172 ms_dispat root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:20.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:20.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:20.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:20.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:20.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:20.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:20.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:20.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:20.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:20.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:20.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:20.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:20.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:20.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:20.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:20.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:20.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:20.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:20.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:20.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:20.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:20.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:20.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:20.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:20.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:20.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:20.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:20.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:20.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:20.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:20.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:20.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:20.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:20.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:20.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:20.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:20.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:20.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:20.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:20.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:20.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:20.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:20.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:20.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:20.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:20.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:20.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:20.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:20.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:20.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:20.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:20.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:20.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:20.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:20.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:20.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:20.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:20.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:20.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:20.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:20.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:20.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:20.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:20.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:20.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:20.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:20.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:20.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:20.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:20.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:20.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:20.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:20.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:20.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:20.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:20.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:20.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:20.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:20.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:20.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:20.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:20.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:20.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:20.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:20.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 14w REG 8,1 144640264 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:20.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:20.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:20.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:20.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:20.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:20.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:20.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:20.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:20.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:20.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:20.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:20.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:20.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:20.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:20.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:20.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:20.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:20.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:20.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:20.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:20.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:20.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:20.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:20.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:20.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:20.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:20.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:20.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:20.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:20.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:20.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:20.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:20.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:20.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:20.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:20.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:20.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:20.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:20.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:20.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121173 ms_local root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:20.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:20.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:20.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:20.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:20.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:20.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:20.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:20.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:20.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:20.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:20.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:20.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:20.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:20.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:20.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:20.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:20.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:20.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:20.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:20.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:20.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:20.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:20.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:20.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:20.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:20.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:20.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:20.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:20.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:20.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:20.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:20.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:20.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:20.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:20.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:20.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:20.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:20.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:20.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:20.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:20.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:20.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:20.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:20.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:20.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:20.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:20.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:20.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:20.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:20.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:20.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:20.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:20.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:20.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:20.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:20.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:20.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:20.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:20.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:20.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:20.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:20.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:20.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:20.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:20.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:20.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:20.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:20.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:20.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:20.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:20.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:20.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:20.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:20.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:20.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:20.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:20.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:20.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:20.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:20.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:20.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:20.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:20.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:20.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:20.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 14w REG 8,1 144640264 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:20.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:20.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:20.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:20.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:20.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:20.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:20.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:20.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:20.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:20.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:20.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:20.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:20.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:20.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:20.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:20.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:20.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:20.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:20.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:20.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:20.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:20.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:20.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:20.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:20.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:20.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:20.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:20.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:20.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:20.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:20.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:20.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:20.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:20.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:20.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:20.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:20.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:20.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:20.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:20.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121174 fn_anonym root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:20.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:20.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:20.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:20.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:20.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:20.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:20.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:20.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:20.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:20.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:20.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:20.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:20.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:20.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:20.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:20.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:20.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:20.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:20.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:20.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:20.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:20.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:20.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:20.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:20.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:20.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:20.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:20.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:20.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:20.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:20.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:20.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:20.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:20.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:20.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:20.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:20.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:20.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:20.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:20.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:20.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:20.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:20.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:20.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:20.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:20.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:20.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:20.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:20.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:20.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:20.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:20.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:20.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:20.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:20.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:20.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:20.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:20.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:20.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:20.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:20.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:20.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:20.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:20.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:20.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:20.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:20.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:20.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:20.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:20.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:20.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:20.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:20.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:20.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:20.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:20.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:20.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:20.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:20.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:20.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:20.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:20.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:20.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:20.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:20.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 14w REG 8,1 144640264 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:20.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:20.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:20.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:20.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:20.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:20.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:20.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:20.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:20.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:20.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:20.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:20.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:20.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:20.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:20.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:20.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:20.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:20.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:20.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:20.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:20.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:20.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:20.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:20.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:20.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:20.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:20.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:20.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:20.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:20.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:20.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:20.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:20.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:20.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:20.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:20.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:20.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:20.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:20.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:20.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121175 finisher root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:20.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:20.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:20.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:20.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:20.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:20.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:20.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:20.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:20.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:20.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:20.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:20.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:20.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:20.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:20.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:20.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:20.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:20.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:20.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:20.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:20.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:20.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:20.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:20.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:20.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:20.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:20.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:20.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:20.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:20.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:20.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:20.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:20.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:20.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:20.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:20.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:20.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:20.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:20.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:20.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:20.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:20.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:20.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:20.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:20.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:20.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:20.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:20.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:20.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:20.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:20.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:20.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:20.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:20.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:20.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:20.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:20.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:20.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:20.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:20.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:20.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:20.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:20.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:20.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:20.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:20.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:20.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:20.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:20.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:20.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:20.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:20.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:20.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:20.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:20.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:20.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:20.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:20.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:20.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:20.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:20.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:20.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:20.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:20.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:20.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 14w REG 8,1 144640264 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:20.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:20.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:20.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:20.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:20.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:20.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:20.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:20.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:20.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:20.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:20.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:20.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:20.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:20.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:20.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:20.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:20.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:20.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:20.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:20.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:20.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:20.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:20.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:20.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:20.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:20.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:20.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:20.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:20.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:20.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:20.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:20.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:20.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:20.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:20.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:20.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:20.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:20.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:20.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:20.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121176 safe_time root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:20.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:20.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:20.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:20.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:20.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:20.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:20.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:20.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:20.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:20.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:20.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:20.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:20.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:20.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:20.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:20.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:20.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:20.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:20.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:20.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:20.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:20.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:20.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:20.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:20.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:20.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:20.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:20.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:20.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:20.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:20.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:20.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:20.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:20.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:20.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:20.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:20.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:20.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:20.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:20.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:20.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:20.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:20.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:20.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:20.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:20.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:20.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:20.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:20.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:20.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:20.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:20.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:20.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:20.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:20.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:20.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:20.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:20.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:20.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:20.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:20.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:20.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:20.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:20.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:20.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:20.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:20.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:20.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:20.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:20.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:20.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:20.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:20.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:20.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:20.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:20.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:20.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:20.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:20.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:20.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:20.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:20.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:20.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:20.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:20.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 14w REG 8,1 144640264 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:20.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:20.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:20.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:20.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:20.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:20.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:20.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:20.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:20.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:20.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:20.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:20.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:20.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:20.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:20.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:20.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:20.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:20.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:20.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:20.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:20.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:20.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:20.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:20.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:20.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:20.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:20.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:20.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:20.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:20.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:20.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:20.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:20.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:20.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:20.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:20.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:20.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:20.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:20.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:20.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121177 safe_time root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:20.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:20.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:20.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:20.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:20.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:20.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:20.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:20.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:20.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:20.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:20.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:20.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:20.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:20.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:20.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:20.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:20.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:20.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:20.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:20.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:20.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:20.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:20.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:20.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:20.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:20.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:20.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:20.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:20.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:20.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:20.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:20.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:20.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:20.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:20.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:20.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:20.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:20.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:20.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:20.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:20.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:20.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:20.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:20.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:20.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:20.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:20.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:20.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:20.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:20.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:20.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:20.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:20.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:20.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:20.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:20.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:20.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:20.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:20.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:20.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:20.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:20.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:20.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:20.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:20.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:20.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:20.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:20.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:20.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:20.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:20.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:20.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:20.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:20.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:20.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:20.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:20.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:20.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:20.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:20.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:20.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:20.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:20.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:20.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:20.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 14w REG 8,1 144640264 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:20.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:20.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:20.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:20.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:20.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:20.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:20.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:20.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:20.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:20.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:20.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:20.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:20.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:20.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:20.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:20.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:20.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:20.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:20.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:20.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:20.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:20.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:20.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:20.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:20.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:20.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:20.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:20.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:20.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:20.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:20.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:20.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:20.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:20.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:20.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:20.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:20.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:20.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:20.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:20.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121178 ceph-osd root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:20.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:20.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:20.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:20.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:20.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:20.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:20.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:20.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:20.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:20.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:20.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:20.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:20.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:20.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:20.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:20.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:20.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:20.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:20.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:20.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:20.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:20.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:20.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:20.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:20.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:20.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:20.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:20.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:20.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:20.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:20.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:20.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:20.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:20.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:20.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:20.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:20.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:20.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:20.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:20.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:20.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:20.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:20.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:20.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:20.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:20.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:20.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:20.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:20.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:20.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:20.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:20.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:20.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:20.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:20.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:20.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:20.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:20.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:20.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:20.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:20.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:20.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:20.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:20.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:20.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:20.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:20.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:20.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:20.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:20.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:20.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:20.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:20.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:20.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:20.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:20.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:20.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:20.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:20.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:20.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:20.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:20.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:20.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:20.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:20.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 14w REG 8,1 144640264 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:20.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:20.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:20.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:20.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:20.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:20.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:20.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:20.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:20.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:20.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:20.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:20.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:20.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:20.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:20.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:20.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:20.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:20.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:20.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:20.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:20.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:20.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:20.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:20.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:20.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:20.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:20.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:20.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:20.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:20.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:20.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:20.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:20.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:20.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:20.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:20.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:20.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:20.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:20.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:20.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121179 osd_srv_a root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:20.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:20.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:20.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:20.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:20.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:20.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:20.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:20.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:20.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:20.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:20.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:20.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:20.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:20.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:20.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:20.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:20.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:20.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:20.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:20.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:20.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:20.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:20.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:20.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:20.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:20.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:20.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:20.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:20.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:20.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:20.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:20.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:20.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:20.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:20.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:20.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:20.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:20.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:20.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:20.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:20.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:20.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:20.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:20.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:20.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:20.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:20.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:20.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:20.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:20.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:20.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:20.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:20.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:20.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:20.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:20.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:20.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:20.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:20.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:20.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:20.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:20.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:20.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:20.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:20.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:20.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:20.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:20.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:20.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:20.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:20.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:20.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:20.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:20.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:20.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:20.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:20.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:20.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:20.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:20.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:20.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:20.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:20.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:20.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:20.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 14w REG 8,1 144640264 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:20.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:20.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:20.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:20.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:20.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:20.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:20.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:20.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:20.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:20.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:20.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:20.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:20.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:20.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:20.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:20.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:20.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:20.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:20.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:20.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:20.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:20.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:20.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:20.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:20.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:20.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:20.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:20.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:20.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:20.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:20.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:20.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:20.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:20.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:20.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:20.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:20.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:20.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:20.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:20.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121180 tp_osd_tp root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:20.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:20.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:20.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:20.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:20.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:20.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:20.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:20.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:20.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:20.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:20.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:20.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:20.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:20.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:20.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:20.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:20.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:20.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:20.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:20.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:20.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:20.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:20.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:20.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:20.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:20.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:20.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:20.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:20.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:20.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:20.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:20.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:20.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:20.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:20.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:20.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:20.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:20.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:20.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:20.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:20.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:20.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:20.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:20.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:20.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:20.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:20.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:20.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:20.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:20.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:20.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:20.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:20.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:20.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:20.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:20.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:20.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:20.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:20.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:20.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:20.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:20.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:20.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:20.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:20.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:20.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:20.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:20.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:20.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:20.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:20.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:20.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:20.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:20.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:20.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:20.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:20.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:20.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:20.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:20.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:20.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:20.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:20.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:20.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:20.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 14w REG 8,1 144640264 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:20.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:20.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:20.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:20.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:20.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:20.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:20.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:20.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:20.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:20.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:20.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:20.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:20.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:20.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:20.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:20.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:20.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:20.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:20.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:20.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:20.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:20.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:20.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:20.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:20.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:20.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:20.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:20.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:20.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:20.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:20.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:20.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:20.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:20.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:20.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:20.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:20.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:20.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:20.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:20.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121181 tp_osd_tp root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:20.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:20.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:20.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:20.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:20.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:20.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:20.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:20.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:20.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:20.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:20.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:20.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:20.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:20.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:20.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:20.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:20.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:20.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:20.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:20.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:20.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:20.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:20.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:20.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:20.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:20.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:20.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:20.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:20.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:20.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:20.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:20.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:20.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:20.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:20.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:20.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:20.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:20.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:20.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:20.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:20.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:20.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:20.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:20.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:20.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:20.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:20.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:20.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:20.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:20.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:20.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:20.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:20.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:20.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:20.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:20.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:20.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:20.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:20.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:20.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:20.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:20.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:20.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:20.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:20.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:20.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:20.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:20.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:20.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:20.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:20.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:20.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:20.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:20.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:20.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:20.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:20.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:20.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:20.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:20.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:20.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:20.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:20.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:20.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:20.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 14w REG 8,1 144640264 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:20.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:20.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:20.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:20.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:20.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:20.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:20.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:20.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:20.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:20.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:20.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:20.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:20.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:20.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:20.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:20.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:20.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:20.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:20.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:20.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:20.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:20.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:20.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:20.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:20.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:20.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:20.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:20.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:20.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:20.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:20.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:20.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:20.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:20.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:20.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:20.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:20.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:20.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:20.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:20.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121182 tp_osd_tp root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:20.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:20.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:20.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:20.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:20.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:20.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:20.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:20.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:20.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:20.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:20.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:20.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:20.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:20.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:20.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:20.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:20.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:20.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:20.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:20.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:20.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:20.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:20.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:20.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:20.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:20.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:20.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:20.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:20.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:20.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:20.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:20.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:20.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:20.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:20.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:20.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:20.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:20.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:20.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:20.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:20.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:20.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:20.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:20.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:20.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:20.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:20.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:20.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:20.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:20.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:20.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:20.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:20.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:20.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:20.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:20.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:20.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:20.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:20.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:20.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:20.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:20.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:20.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:20.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:20.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:20.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:20.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:20.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:20.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:20.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:20.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:20.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:20.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:20.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:20.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:20.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:20.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:20.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:20.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:20.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:20.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:20.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:20.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:20.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:20.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 14w REG 8,1 144640264 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:20.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:20.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:20.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:20.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:20.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:20.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:20.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:20.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:20.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:20.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:20.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:20.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:20.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:20.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:20.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:20.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:20.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:20.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:20.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:20.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:20.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:20.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:20.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:20.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:20.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:20.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:20.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:20.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:20.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:20.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:20.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:20.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:20.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:20.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:20.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:20.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:20.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:20.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:20.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:20.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121183 tp_osd_tp root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:20.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:20.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:20.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:20.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:20.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:20.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:20.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:20.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:20.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:20.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:20.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:20.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:20.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:20.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:20.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:20.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:20.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:20.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:20.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:20.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:20.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:20.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:20.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:20.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:20.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:20.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:20.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:20.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:20.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:20.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:20.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:20.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:20.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:20.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:20.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:20.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:20.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:20.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:20.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:20.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:20.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:20.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:20.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:20.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:20.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:20.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:20.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:20.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:20.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:20.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:20.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:20.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:20.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:20.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:20.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:20.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:20.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:20.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:20.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:20.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:20.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:20.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:20.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:20.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:20.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:20.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:20.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:20.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:20.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:20.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:20.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:20.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:20.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:20.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:20.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:20.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:20.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:20.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:20.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:20.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:20.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:20.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:20.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:20.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:20.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 14w REG 8,1 144640264 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:20.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:20.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:20.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:20.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:20.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:20.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:20.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:20.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:20.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:20.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:20.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:20.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:20.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:20.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:20.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:20.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:20.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:20.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:20.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:20.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:20.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:20.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:20.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:20.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:20.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:20.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:20.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:20.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:20.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:20.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:20.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:20.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:20.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:20.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:20.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:20.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:20.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:20.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:20.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:20.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121184 tp_osd_tp root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:20.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:20.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:20.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:20.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:20.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:20.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:20.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:20.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:20.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:20.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:20.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:20.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:20.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:20.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:20.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:20.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:20.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:20.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:20.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:20.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:20.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:20.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:20.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:20.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:20.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:20.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:20.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:20.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:20.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:20.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:20.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:20.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:20.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:20.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:20.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:20.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:20.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:20.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:20.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:20.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:20.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:20.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:20.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:20.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:20.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:20.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:20.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:20.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:20.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:20.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:20.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:20.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:20.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:20.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:20.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:20.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:20.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:20.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:20.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:20.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:20.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:20.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:20.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:20.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:20.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:20.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:20.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:20.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:20.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:20.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:20.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:20.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:20.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:20.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:20.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:20.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:20.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:20.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:20.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:20.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:20.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:20.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:20.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:20.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:20.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:20.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:20.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:20.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 14w REG 8,1 144640264 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:20.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:20.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:20.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:20.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:20.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:20.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:20.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:20.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:20.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:20.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:20.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:20.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:20.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:20.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:20.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:20.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:20.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:20.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:20.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:20.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:20.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:20.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:20.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:20.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:20.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:20.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:20.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:20.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:20.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:20.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:20.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:20.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:20.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:20.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:20.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:20.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:20.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:20.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:20.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:20.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:20.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:20.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:20.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:20.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:20.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:20.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:20.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:20.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:20.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:20.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:20.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:20.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121185 tp_osd_tp root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:20.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:20.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:20.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:20.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:20.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:20.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:20.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:20.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:20.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:20.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:20.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:20.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:20.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:20.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:20.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:20.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:20.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:20.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:20.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:20.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:20.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:20.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:20.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:20.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:20.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:20.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:20.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:20.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:20.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:20.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:20.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:20.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:20.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:20.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:20.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:20.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:20.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:20.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:20.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:20.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:20.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:20.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:20.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:20.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:20.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:20.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:20.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:20.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:20.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:20.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:20.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:20.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:20.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:20.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:20.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:20.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:20.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:20.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:20.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:20.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:20.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:20.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:20.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:20.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:20.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:20.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:20.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:20.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:20.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:20.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:20.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:20.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:20.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:20.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:20.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:20.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:20.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:20.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:20.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:20.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:20.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:20.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:20.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:20.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:21.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:21.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:21.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:21.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:21.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:21.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:21.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:21.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 14w REG 8,1 144640264 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:21.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:21.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:21.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:21.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:21.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:21.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:21.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:21.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:21.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:21.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:21.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:21.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:21.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:21.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:21.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:21.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:21.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:21.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:21.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:21.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:21.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:21.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:21.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:21.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:21.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:21.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:21.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:21.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:21.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:21.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:21.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:21.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:21.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:21.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:21.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:21.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:21.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:21.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:21.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:21.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:21.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:21.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:21.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:21.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:21.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:21.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:21.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:21.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:21.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121186 tp_osd_tp root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:21.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:21.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:21.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:21.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:21.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:21.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:21.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:21.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:21.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:21.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:21.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:21.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:21.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:21.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:21.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:21.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:21.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:21.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:21.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:21.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:21.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:21.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:21.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:21.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:21.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:21.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:21.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:21.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:21.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:21.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:21.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:21.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:21.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:21.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:21.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:21.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:21.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:21.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:21.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:21.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:21.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:21.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:21.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:21.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:21.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:21.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:21.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:21.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:21.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:21.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:21.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:21.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:21.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:21.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:21.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:21.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:21.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:21.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:21.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:21.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:21.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:21.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:21.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:21.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:21.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:21.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:21.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:21.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:21.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:21.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:21.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:21.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:21.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:21.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:21.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:21.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:21.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:21.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:21.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:21.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:21.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:21.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:21.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:21.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:21.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:21.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:21.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:21.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:21.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:21.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:21.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:21.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:21.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 14w REG 8,1 144640264 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:21.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:21.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:21.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:21.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:21.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:21.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:21.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:21.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:21.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:21.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:21.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:21.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:21.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:21.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:21.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:21.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:21.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:21.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:21.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:21.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:21.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:21.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:21.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:21.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:21.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:21.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:21.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:21.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:21.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:21.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:21.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:21.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:21.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:21.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:21.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:21.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:21.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:21.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:21.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:21.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:21.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:21.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:21.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:21.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:21.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:21.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:21.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:21.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:21.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121187 tp_osd_tp root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:21.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:21.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:21.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:21.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:21.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:21.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:21.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:21.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:21.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:21.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:21.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:21.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:21.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:21.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:21.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:21.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:21.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:21.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:21.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:21.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:21.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:21.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:21.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:21.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:21.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:21.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:21.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:21.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:21.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:21.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:21.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:21.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:21.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:21.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:21.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:21.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:21.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:21.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:21.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:21.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:21.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:21.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:21.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:21.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:21.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:21.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:21.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:21.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:21.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:21.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:21.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:21.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:21.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:21.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:21.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:21.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:21.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:21.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:21.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:21.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:21.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:21.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:21.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:21.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:21.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:21.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:21.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:21.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:21.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:21.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:21.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:21.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:21.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:21.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:21.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:21.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:21.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:21.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:21.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:21.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:21.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:21.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:21.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:21.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:21.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:21.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:21.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:21.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:21.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:21.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:21.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:21.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:21.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 14w REG 8,1 144640264 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:21.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:21.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:21.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:21.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:21.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:21.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:21.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:21.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:21.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:21.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:21.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:21.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:21.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:21.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:21.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:21.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:21.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:21.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:21.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:21.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:21.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:21.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:21.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:21.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:21.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:21.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:21.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:21.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:21.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:21.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:21.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:21.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:21.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:21.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:21.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:21.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:21.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:21.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:21.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:21.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:21.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:21.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:21.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:21.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:21.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:21.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:21.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:21.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:21.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121188 tp_osd_tp root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:21.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:21.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:21.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:21.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:21.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:21.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:21.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:21.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:21.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:21.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:21.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:21.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:21.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:21.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:21.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:21.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:21.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:21.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:21.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:21.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:21.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:21.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:21.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:21.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:21.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:21.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:21.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:21.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:21.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:21.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:21.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:21.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:21.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:21.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:21.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:21.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:21.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:21.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:21.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:21.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:21.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:21.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:21.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:21.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:21.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:21.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:21.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:21.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:21.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:21.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:21.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:21.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:21.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:21.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:21.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:21.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:21.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:21.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:21.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:21.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:21.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:21.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:21.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:21.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:21.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:21.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:21.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:21.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:21.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:21.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:21.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:21.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:21.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:21.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:21.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:21.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:21.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:21.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:21.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:21.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:21.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:21.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:21.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:21.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:21.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:21.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:21.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:21.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:21.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:21.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:21.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:21.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:21.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 14w REG 8,1 144640547 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:21.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:21.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:21.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:21.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:21.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:21.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:21.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:21.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:21.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:21.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:21.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:21.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:21.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:21.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:21.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:21.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:21.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:21.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:21.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:21.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:21.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:21.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:21.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:21.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:21.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:21.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:21.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:21.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:21.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:21.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:21.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:21.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:21.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:21.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:21.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:21.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:21.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:21.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:21.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:21.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:21.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:21.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:21.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:21.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:21.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:21.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:21.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:21.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:21.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121189 tp_osd_tp root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:21.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:21.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:21.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:21.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:21.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:21.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:21.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:21.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:21.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:21.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:21.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:21.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:21.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:21.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:21.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:21.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:21.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:21.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:21.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:21.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:21.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:21.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:21.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:21.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:21.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:21.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:21.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:21.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:21.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:21.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:21.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:21.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:21.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:21.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:21.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:21.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:21.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:21.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:21.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:21.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:21.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:21.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:21.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:21.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:21.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:21.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:21.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:21.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:21.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:21.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:21.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:21.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:21.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:21.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:21.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:21.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:21.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:21.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:21.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:21.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:21.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:21.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:21.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:21.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:21.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:21.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:21.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:21.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:21.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:21.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:21.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:21.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:21.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:21.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:21.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:21.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:21.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:21.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:21.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:21.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:21.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:21.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:21.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:21.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:21.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:21.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:21.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:21.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:21.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:21.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:21.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:21.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:21.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 14w REG 8,1 144640547 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:21.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:21.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:21.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:21.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:21.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:21.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:21.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:21.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:21.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:21.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:21.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:21.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:21.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:21.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:21.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:21.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:21.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:21.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:21.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:21.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:21.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:21.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:21.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:21.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:21.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:21.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:21.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:21.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:21.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:21.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:21.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:21.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:21.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:21.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:21.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:21.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:21.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:21.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:21.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:21.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:21.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:21.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:21.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:21.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:21.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:21.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:21.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:21.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:21.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121190 tp_osd_tp root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:21.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:21.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:21.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:21.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:21.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:21.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:21.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:21.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:21.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:21.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:21.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:21.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:21.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:21.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:21.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:21.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:21.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:21.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:21.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:21.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:21.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:21.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:21.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:21.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:21.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:21.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:21.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:21.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:21.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:21.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:21.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:21.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:21.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:21.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:21.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:21.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:21.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:21.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:21.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:21.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:21.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:21.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:21.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:21.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:21.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:21.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:21.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:21.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:21.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:21.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:21.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:21.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:21.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:21.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:21.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:21.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:21.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:21.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:21.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:21.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:21.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:21.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:21.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:21.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:21.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:21.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:21.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:21.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:21.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:21.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:21.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:21.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:21.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:21.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:21.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:21.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:21.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:21.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:21.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:21.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:21.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:21.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:21.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:21.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:21.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:21.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:21.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:21.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:21.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:21.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:21.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:21.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:21.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 14w REG 8,1 144640547 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:21.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:21.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:21.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:21.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:21.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:21.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:21.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:21.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:21.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:21.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:21.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:21.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:21.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:21.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:21.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:21.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:21.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:21.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:21.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:21.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:21.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:21.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:21.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:21.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:21.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:21.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:21.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:21.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:21.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:21.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:21.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:21.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:21.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:21.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:21.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:21.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:21.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:21.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:21.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:21.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:21.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:21.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:21.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:21.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:21.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:21.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:21.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:21.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:21.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121191 tp_osd_tp root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:21.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:21.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:21.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:21.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:21.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:21.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:21.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:21.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:21.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:21.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:21.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:21.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:21.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:21.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:21.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:21.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:21.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:21.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:21.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:21.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:21.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:21.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:21.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:21.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:21.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:21.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:21.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:21.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:21.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:21.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:21.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:21.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:21.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:21.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:21.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:21.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:21.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:21.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:21.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:21.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:21.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:21.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:21.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:21.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:21.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:21.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:21.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:21.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:21.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:21.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:21.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:21.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:21.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:21.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:21.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:21.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:21.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:21.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:21.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:21.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:21.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:21.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:21.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:21.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:21.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:21.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:21.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:21.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:21.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:21.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:21.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:21.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:21.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:21.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:21.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:21.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:21.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:21.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:21.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:21.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:21.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:21.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:21.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:21.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:21.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:21.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:21.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:21.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:21.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:21.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:21.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:21.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:21.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 14w REG 8,1 144640547 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:21.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:21.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:21.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:21.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:21.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:21.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:21.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:21.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:21.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:21.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:21.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:21.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:21.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:21.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:21.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:21.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:21.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:21.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:21.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:21.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:21.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:21.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:21.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:21.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:21.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:21.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:21.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:21.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:21.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:21.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:21.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:21.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:21.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:21.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:21.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:21.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:21.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:21.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:21.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:21.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:21.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:21.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:21.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:21.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:21.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:21.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:21.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:21.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:21.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121192 tp_osd_tp root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:21.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:21.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:21.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:21.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:21.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:21.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:21.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:21.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:21.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:21.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:21.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:21.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:21.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:21.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:21.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:21.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:21.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:21.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:21.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:21.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:21.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:21.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:21.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:21.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:21.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:21.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:21.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:21.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:21.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:21.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:21.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:21.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:21.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:21.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:21.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:21.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:21.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:21.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:21.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:21.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:21.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:21.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:21.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:21.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:21.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:21.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:21.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:21.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:21.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:21.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:21.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:21.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:21.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:21.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:21.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:21.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:21.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:21.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:21.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:21.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:21.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:21.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:21.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:21.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:21.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:21.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:21.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:21.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:21.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:21.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:21.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:21.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:21.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:21.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:21.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:21.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:21.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:21.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:21.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:21.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:21.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:21.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:21.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:21.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:21.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:21.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:21.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:21.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:21.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:21.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:21.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:21.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:21.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 14w REG 8,1 144640547 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:21.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:21.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:21.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:21.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:21.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:21.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:21.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:21.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:21.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:21.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:21.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:21.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:21.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:21.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:21.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:21.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:21.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:21.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:21.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:21.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:21.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:21.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:21.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:21.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:21.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:21.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:21.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:21.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:21.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:21.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:21.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:21.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:21.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:21.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:21.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:21.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:21.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:21.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:21.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:21.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:21.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:21.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:21.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:21.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:21.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:21.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:21.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:21.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:21.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121193 tp_osd_tp root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:21.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:21.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:21.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:21.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:21.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:21.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:21.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:21.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:21.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:21.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:21.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:21.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:21.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:21.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:21.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:21.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:21.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:21.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:21.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:21.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:21.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:21.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:21.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:21.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:21.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:21.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:21.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:21.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:21.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:21.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:21.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:21.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:21.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:21.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:21.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:21.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:21.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:21.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:21.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:21.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:21.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:21.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:21.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:21.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:21.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:21.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:21.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:21.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:21.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:21.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:21.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:21.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:21.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:21.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:21.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:21.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:21.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:21.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:21.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:21.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:21.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:21.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:21.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:21.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:21.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:21.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:21.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:21.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:21.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:21.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:21.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:21.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:21.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:21.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:21.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:21.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:21.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:21.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:21.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:21.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:21.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:21.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:21.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:21.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:21.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:21.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:21.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:21.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:21.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:21.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:21.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:21.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:21.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 14w REG 8,1 144640547 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:21.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:21.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:21.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:21.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:21.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:21.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:21.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:21.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:21.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:21.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:21.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:21.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:21.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:21.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:21.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:21.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:21.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:21.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:21.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:21.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:21.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:21.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:21.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:21.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:21.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:21.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:21.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:21.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:21.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:21.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:21.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:21.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:21.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:21.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:21.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:21.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:21.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:21.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:21.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:21.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:21.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:21.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:21.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:21.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:21.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:21.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:21.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:21.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:21.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121194 tp_osd_tp root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:21.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:21.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:21.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:21.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:21.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:21.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:21.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:21.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:21.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:21.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:21.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:21.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:21.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:21.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:21.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:21.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:21.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:21.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:21.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:21.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:21.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:21.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:21.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:21.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:21.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:21.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:21.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:21.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:21.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:21.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:21.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:21.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:21.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:21.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:21.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:21.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:21.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:21.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:21.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:21.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:21.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:21.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:21.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:21.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:21.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:21.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:21.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:21.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:21.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:21.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:21.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:21.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:21.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:21.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:21.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:21.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:21.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:21.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:21.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:21.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:21.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:21.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:21.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:21.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:21.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:21.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:21.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:21.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:21.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:21.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:21.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:21.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:21.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:21.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:21.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:21.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:21.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:21.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:21.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:21.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:21.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:21.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:21.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:21.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:21.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:21.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:21.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:21.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:21.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:21.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:21.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:21.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:21.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 14w REG 8,1 144640547 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:21.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:21.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:21.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:21.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:21.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:21.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:21.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:21.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:21.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:21.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:21.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:21.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:21.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:21.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:21.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:21.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:21.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:21.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:21.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:21.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:21.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:21.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:21.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:21.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:21.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:21.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:21.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:21.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:21.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:21.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:21.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:21.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:21.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:21.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:21.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:21.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:21.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:21.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:21.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:21.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:21.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:21.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:21.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:21.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:21.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:21.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:21.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:21.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:21.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121195 tp_osd_tp root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:21.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:21.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:21.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:21.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:21.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:21.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:21.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:21.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:21.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:21.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:21.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:21.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:21.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:21.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:21.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:21.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:21.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:21.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:21.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:21.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:21.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:21.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:21.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:21.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:21.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root DEL REG 0,17 209874 /[aio] 2023-11-04T01:48:21.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root DEL REG 0,17 203657 /[aio] 2023-11-04T01:48:21.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:21.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:21.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:21.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:21.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:21.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:21.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:21.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:21.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:21.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:21.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:21.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:21.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:21.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:21.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:21.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:21.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:21.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:21.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:21.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:21.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:21.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:21.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:21.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:21.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:21.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:21.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:21.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:21.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:21.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:21.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:21.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:21.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:21.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:21.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:21.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:21.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:21.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:21.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:21.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:21.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:21.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:21.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:21.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:21.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:21.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:21.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:21.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:21.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:21.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:21.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:21.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:21.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:21.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 1w FIFO 0,13 0t0 209788 pipe 2023-11-04T01:48:21.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 2w FIFO 0,13 0t0 209789 pipe 2023-11-04T01:48:21.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 3r FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:21.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 4w FIFO 0,13 0t0 213077 pipe 2023-11-04T01:48:21.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,60,70,73,74,79,80,82,85,88,91,94,96] 2023-11-04T01:48:21.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 6r FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:21.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 7w FIFO 0,13 0t0 213079 pipe 2023-11-04T01:48:21.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 8u a_inode 0,14 0 3100 [eventpoll:9,63,65,68,69,71,76,77,83,86,89,92,95,98,100] 2023-11-04T01:48:21.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 9r FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:21.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 10w FIFO 0,13 0t0 213080 pipe 2023-11-04T01:48:21.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 11u a_inode 0,14 0 3100 [eventpoll:12,64,66,67,72,75,78,81,84,87,90,93,97,101] 2023-11-04T01:48:21.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 12r FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:21.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 13w FIFO 0,13 0t0 213081 pipe 2023-11-04T01:48:21.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 14w REG 8,1 144640547 265460 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:48:21.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 15uW REG 0,24 7 1749 /run/ceph/ceph-osd.0.pid 2023-11-04T01:48:21.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 16r FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:21.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 17w FIFO 0,13 0t0 213089 pipe 2023-11-04T01:48:21.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 18u unix 0xffff9ba9201bd0c0 0t0 213090 /var/run/ceph/ceph-osd.0.asok type=STREAM (LISTEN) 2023-11-04T01:48:21.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 19u IPv4 213117 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:48:21.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 20u IPv4 213127 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:48:21.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 21u IPv4 213138 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:48:21.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 22u IPv4 213150 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:48:21.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 23u IPv4 213163 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:48:21.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 24u IPv4 213177 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:48:21.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 25u IPv4 213193 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:48:21.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 26u IPv4 213211 0t0 TCP *:pentbox-sim (LISTEN) 2023-11-04T01:48:21.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 27r FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:21.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 28w FIFO 0,13 0t0 203622 pipe 2023-11-04T01:48:21.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 29r FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:21.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 30w FIFO 0,13 0t0 203623 pipe 2023-11-04T01:48:21.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 31u sock 0,8 0t0 203645 protocol: UDPv6 2023-11-04T01:48:21.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:48:21.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:48:21.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:48:21.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 58r FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:21.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 59w FIFO 0,13 0t0 205817 pipe 2023-11-04T01:48:21.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 60u IPv4 205797 0t0 TCP smithi077.front.sepia.ceph.com:41638->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:21.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 61r FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:21.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 62w FIFO 0,13 0t0 205818 pipe 2023-11-04T01:48:21.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 63u IPv4 214154 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45440 (ESTABLISHED) 2023-11-04T01:48:21.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 64u IPv4 214157 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45176 (ESTABLISHED) 2023-11-04T01:48:21.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 65u IPv4 212391 0t0 TCP smithi077.front.sepia.ceph.com:48720->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 66u IPv4 210656 0t0 TCP smithi077.front.sepia.ceph.com:58172->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 67u IPv4 205824 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45190 (ESTABLISHED) 2023-11-04T01:48:21.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 68u IPv4 212392 0t0 TCP smithi077.front.sepia.ceph.com:57720->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 69u IPv4 212393 0t0 TCP smithi077.front.sepia.ceph.com:40078->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 70u IPv4 215043 0t0 TCP smithi077.front.sepia.ceph.com:48756->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:21.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 71u IPv4 212394 0t0 TCP smithi077.front.sepia.ceph.com:45770->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 72u IPv4 210657 0t0 TCP smithi077.front.sepia.ceph.com:47160->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 73u IPv4 215044 0t0 TCP smithi077.front.sepia.ceph.com:48516->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 74u IPv4 215045 0t0 TCP smithi077.front.sepia.ceph.com:56886->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 75u IPv4 210658 0t0 TCP smithi077.front.sepia.ceph.com:56776->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 76u IPv4 212395 0t0 TCP smithi077.front.sepia.ceph.com:47166->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 77u IPv4 215046 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45456 (ESTABLISHED) 2023-11-04T01:48:21.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 78u IPv4 210659 0t0 TCP smithi077.front.sepia.ceph.com:53178->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 79u IPv4 215049 0t0 TCP smithi077.front.sepia.ceph.com:35108->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 80u IPv4 215050 0t0 TCP smithi077.front.sepia.ceph.com:48026->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 81u IPv4 215051 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46080 (ESTABLISHED) 2023-11-04T01:48:21.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 82u IPv4 215054 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46686 (ESTABLISHED) 2023-11-04T01:48:21.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 83u IPv4 215057 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46690 (ESTABLISHED) 2023-11-04T01:48:21.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 84u IPv4 215060 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46082 (ESTABLISHED) 2023-11-04T01:48:21.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 85u IPv4 215063 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46088 (ESTABLISHED) 2023-11-04T01:48:21.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 86u IPv4 210663 0t0 TCP smithi077.front.sepia.ceph.com:56884->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:21.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 87u IPv4 215066 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46692 (ESTABLISHED) 2023-11-04T01:48:21.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 88u IPv4 212399 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi077.front.sepia.ceph.com:45202 (ESTABLISHED) 2023-11-04T01:48:21.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 89u IPv4 212402 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi077.front.sepia.ceph.com:45472 (ESTABLISHED) 2023-11-04T01:48:21.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 90u IPv4 212405 0t0 TCP smithi077.front.sepia.ceph.com:6812->smithi122.front.sepia.ceph.com:46090 (ESTABLISHED) 2023-11-04T01:48:21.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 91u IPv4 212408 0t0 TCP smithi077.front.sepia.ceph.com:6815->smithi122.front.sepia.ceph.com:46706 (ESTABLISHED) 2023-11-04T01:48:21.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 92u IPv4 209905 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57682 (ESTABLISHED) 2023-11-04T01:48:21.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 93u IPv4 203693 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57668 (ESTABLISHED) 2023-11-04T01:48:21.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 94u IPv4 209899 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38248 (ESTABLISHED) 2023-11-04T01:48:21.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 95u IPv4 203700 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38262 (ESTABLISHED) 2023-11-04T01:48:21.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 96u IPv4 215086 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47588 (ESTABLISHED) 2023-11-04T01:48:21.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 97u IPv4 286759 0t0 TCP smithi077.front.sepia.ceph.com:6808->smithi122.front.sepia.ceph.com:47384 (ESTABLISHED) 2023-11-04T01:48:21.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 98u IPv4 209909 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi077.front.sepia.ceph.com:57686 (ESTABLISHED) 2023-11-04T01:48:21.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 100u IPv4 209912 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38268 (ESTABLISHED) 2023-11-04T01:48:21.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118535 121196 osd_srv_h root 101u IPv4 209913 0t0 TCP smithi077.front.sepia.ceph.com:6810->smithi122.front.sepia.ceph.com:38272 (ESTABLISHED) 2023-11-04T01:48:21.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:21.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:21.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:21.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:21.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:21.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:21.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:21.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:21.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:21.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:21.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:21.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:21.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:21.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:21.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:21.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:21.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:21.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:21.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:21.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:21.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:21.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:21.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:21.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:21.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:21.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:21.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:21.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:21.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:21.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:21.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:21.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:21.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:21.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:21.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:21.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:21.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:21.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:21.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:21.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:21.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:21.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:21.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:21.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:21.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:21.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:21.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:21.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:21.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:21.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:21.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:21.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:21.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:21.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:21.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:21.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:21.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:21.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:21.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:21.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:21.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:21.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:21.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:21.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:21.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:21.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:21.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:21.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:21.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:21.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:21.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:21.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:21.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:21.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:21.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:21.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:21.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:21.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:21.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:21.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:21.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:21.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:21.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:21.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:21.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:21.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:21.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:21.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:21.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:21.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:21.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:21.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:21.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 14w REG 8,1 123795876 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:21.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:21.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:21.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:21.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:21.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:21.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:21.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:21.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:21.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:21.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:21.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:21.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:21.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:21.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:21.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:21.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:21.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:21.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:21.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:21.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:21.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:21.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:21.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:21.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:21.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:21.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:21.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:21.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:21.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:21.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:21.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:21.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:21.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:21.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:21.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:21.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:21.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:21.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:21.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:21.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:21.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:21.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:21.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:21.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:21.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:21.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:21.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:21.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:21.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:21.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:21.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:21.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:21.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:21.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:21.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:21.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:21.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:21.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:21.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:21.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:21.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:21.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:21.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:21.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:21.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:21.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:21.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:21.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:21.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:21.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:21.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:21.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:21.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:21.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:21.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:21.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:21.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:21.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:21.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:21.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:21.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:21.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:21.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:21.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:21.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:21.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:21.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:21.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:21.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:21.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:21.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:21.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:21.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:21.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:21.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:21.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:21.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:21.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:21.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:21.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:21.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:21.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:21.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:21.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:21.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:21.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:21.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:21.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:21.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:21.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:21.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:21.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:21.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:21.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:21.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:21.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:21.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:21.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:21.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:21.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:21.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:21.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:21.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:21.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:21.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:21.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:21.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:21.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:21.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:21.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:21.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:21.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:21.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:21.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:21.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:21.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:21.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:21.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:21.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:21.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:21.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:21.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:21.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 14w REG 8,1 123792411 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:21.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:21.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:21.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:21.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:21.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:21.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:21.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:21.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:21.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:21.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:21.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:21.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:21.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:21.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:21.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:21.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:21.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:21.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:21.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:21.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:21.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:21.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:21.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:21.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:21.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:21.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:21.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:21.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:21.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:21.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:21.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:21.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:21.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:21.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:21.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:21.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:21.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:21.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:21.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:21.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:21.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:21.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:21.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:21.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:21.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:21.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:21.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:21.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:21.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:21.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118539 log root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:21.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:21.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:21.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:21.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:21.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:21.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:21.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:21.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:21.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:21.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:21.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:21.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:21.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:21.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:21.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:21.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:21.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:21.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:21.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:21.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:21.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:21.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:21.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:21.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:21.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:21.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:21.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:21.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:21.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:21.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:21.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:21.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:21.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:21.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:21.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:21.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:21.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:21.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:21.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:21.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:21.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:21.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:21.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:21.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:21.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:21.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:21.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:21.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:21.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:21.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:21.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:21.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:21.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:21.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:21.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:21.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:21.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:21.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:21.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:21.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:21.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:21.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:21.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:21.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:21.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:21.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:21.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:21.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:21.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:21.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:21.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:21.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:21.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:21.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:21.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:21.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:21.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:21.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:21.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:21.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:21.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:21.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:21.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:21.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:21.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:21.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:21.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:21.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:21.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:21.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:21.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:21.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:21.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 14w REG 8,1 123792411 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:21.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:21.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:21.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:21.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:21.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:21.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:21.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:21.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:21.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:21.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:21.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:21.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:21.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:21.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:21.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:21.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:21.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:21.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:21.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:21.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:21.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:21.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:21.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:21.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:21.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:21.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:21.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:21.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:21.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:21.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:21.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:21.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:21.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:21.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:21.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:21.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:21.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:21.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:21.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:21.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:21.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:21.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:21.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:21.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:21.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:21.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:21.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:21.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:21.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:21.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118543 msgr-work root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:21.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:21.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:21.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:21.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:21.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:21.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:21.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:21.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:21.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:21.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:21.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:21.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:21.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:21.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:21.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:21.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:21.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:21.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:21.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:21.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:21.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:21.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:21.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:21.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:21.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:21.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:21.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:21.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:21.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:21.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:21.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:21.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:21.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:21.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:21.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:21.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:21.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:21.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:21.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:21.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:21.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:21.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:21.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:21.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:21.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:21.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:21.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:21.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:21.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:21.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:21.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:21.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:21.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:21.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:21.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:21.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:21.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:21.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:21.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:21.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:21.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:21.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:21.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:21.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:21.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:21.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:21.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:21.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:21.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:21.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:21.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:21.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:21.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:21.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:21.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:21.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:21.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:21.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:21.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:21.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:21.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:21.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:21.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:21.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:21.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:21.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:21.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:21.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:21.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:21.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:21.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:21.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:21.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 14w REG 8,1 123795027 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:21.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:21.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:21.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:21.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:21.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:21.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:21.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:21.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:21.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:21.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:21.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:21.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:21.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:21.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:21.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:21.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:21.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:21.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:21.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:21.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:21.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:21.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:21.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:21.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:21.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:21.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:21.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:21.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:21.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:21.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:21.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:21.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:21.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:21.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:21.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:21.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:21.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:21.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:21.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:21.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:21.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:21.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:21.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:21.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:21.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:21.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:21.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:21.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:21.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:21.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118544 msgr-work root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:21.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:21.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:21.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:21.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:21.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:21.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:21.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:21.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:21.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:21.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:21.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:21.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:21.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:21.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:21.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:21.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:21.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:21.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:21.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:21.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:21.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:21.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:21.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:21.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:21.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:21.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:21.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:21.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:21.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:21.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:21.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:21.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:21.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:21.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:21.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:21.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:21.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:21.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:21.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:21.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:21.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:21.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:21.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:21.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:21.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:21.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:21.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:21.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:21.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:21.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:21.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:21.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:21.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:21.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:21.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:21.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:21.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:21.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:21.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:21.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:21.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:21.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:21.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:21.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:21.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:21.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:21.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:21.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:21.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:21.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:21.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:21.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:21.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:21.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:21.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:21.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:21.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:21.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:21.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:21.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:21.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:21.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:21.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:21.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:21.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:21.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:21.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:21.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:21.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:21.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:21.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:21.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:21.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 14w REG 8,1 123795027 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:21.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:21.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:21.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:21.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:21.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:21.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:21.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:21.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:21.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:21.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:21.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:21.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:21.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:21.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:21.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:21.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:21.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:21.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:21.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:21.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:21.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:21.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:21.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:21.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:21.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:21.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:21.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:21.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:21.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:21.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:21.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:21.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:21.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:21.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:21.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:21.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:21.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:21.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:21.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:21.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:21.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:21.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:21.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:21.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:21.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:21.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:21.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:21.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:21.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:21.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118545 msgr-work root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:21.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:21.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:21.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:21.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:21.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:21.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:21.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:21.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:21.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:21.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:21.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:21.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:21.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:21.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:21.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:21.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:21.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:21.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:21.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:21.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:21.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:21.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:21.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:21.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:21.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:21.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:21.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:21.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:21.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:21.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:21.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:21.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:21.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:21.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:21.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:21.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:21.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:21.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:21.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:21.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:21.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:21.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:21.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:21.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:21.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:21.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:21.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:21.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:21.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:21.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:21.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:21.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:21.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:21.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:21.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:21.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:21.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:21.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:21.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:21.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:21.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:21.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:21.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:21.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:21.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:21.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:21.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:21.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:21.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:21.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:21.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:21.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:21.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:21.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:21.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:21.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:21.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:21.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:21.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:21.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:21.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:21.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:21.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:21.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:21.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:21.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:21.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:21.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:21.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:21.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:21.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:21.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:21.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 14w REG 8,1 123795027 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:21.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:21.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:21.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:21.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:21.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:21.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:21.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:21.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:21.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:21.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:21.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:21.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:21.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:21.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:21.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:21.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:21.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:21.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:21.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:21.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:21.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:21.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:21.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:21.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:21.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:21.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:21.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:21.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:21.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:21.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:21.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:21.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:21.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:21.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:21.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:21.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:21.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:21.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:21.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:21.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:21.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:21.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:21.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:21.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:21.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:21.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:21.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:21.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:21.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:21.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118556 service root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:21.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:21.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:21.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:21.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:21.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:21.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:21.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:21.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:21.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:21.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:21.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:21.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:21.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:21.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:21.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:21.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:21.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:21.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:21.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:21.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:21.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:21.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:21.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:21.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:21.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:21.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:21.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:21.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:21.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:21.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:21.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:21.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:21.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:21.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:21.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:21.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:21.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:21.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:21.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:21.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:21.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:21.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:21.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:21.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:21.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:21.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:21.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:21.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:21.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:21.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:21.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:21.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:21.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:21.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:21.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:21.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:21.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:21.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:21.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:21.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:21.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:21.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:21.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:21.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:21.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:21.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:21.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:21.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:21.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:21.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:21.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:21.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:21.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:21.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:21.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:21.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:21.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:21.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:21.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:21.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:21.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:21.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:21.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:21.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:21.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:21.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:21.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:21.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:21.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:21.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:21.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:21.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:21.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 14w REG 8,1 123795027 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:21.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:21.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:21.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:21.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:21.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:21.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:21.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:21.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:21.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:21.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:21.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:21.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:21.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:21.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:21.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:21.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:21.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:21.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:21.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:21.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:21.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:21.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:21.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:21.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:21.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:21.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:21.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:21.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:21.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:21.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:21.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:21.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:21.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:21.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:21.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:21.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:21.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:21.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:21.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:21.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:21.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:21.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:21.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:21.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:21.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:21.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:21.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:21.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:21.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:21.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118557 admin_soc root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:21.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:21.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:21.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:21.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:21.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:21.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:21.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:21.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:21.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:21.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:21.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:21.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:21.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:21.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:21.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:21.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:21.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:21.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:21.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:21.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:21.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:21.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:21.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:21.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:21.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:21.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:21.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:21.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:21.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:21.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:21.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:21.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:21.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:21.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:21.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:21.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:21.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:21.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:21.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:21.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:21.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:21.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:21.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:21.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:21.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:21.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:21.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:21.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:21.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:21.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:21.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:21.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:21.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:21.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:21.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:21.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:21.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:21.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:21.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:21.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:21.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:21.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:21.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:21.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:21.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:21.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:21.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:21.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:21.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:21.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:21.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:21.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:21.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:21.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:21.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:21.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:21.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:21.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:21.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:21.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:21.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:21.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:21.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:21.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:21.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:21.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:21.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:21.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:21.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:21.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:21.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:21.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:21.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 14w REG 8,1 123795027 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:21.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:21.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:21.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:21.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:21.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:21.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:21.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:21.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:21.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:21.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:21.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:21.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:21.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:21.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:21.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:21.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:21.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:21.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:21.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:21.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:21.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:21.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:21.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:21.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:21.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:21.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:21.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:21.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:21.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:21.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:21.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:21.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:21.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:21.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:21.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:21.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:21.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:21.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:21.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:21.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:21.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:21.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:21.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:21.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:21.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:21.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:21.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:21.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:21.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:21.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118616 signal_ha root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:21.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:21.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:21.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:21.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:21.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:21.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:21.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:21.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:21.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:21.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:21.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:21.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:21.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:21.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:21.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:21.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:21.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:21.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:21.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:21.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:21.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:21.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:21.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:21.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:21.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:21.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:21.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:21.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:21.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:21.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:21.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:21.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:21.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:21.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:21.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:21.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:21.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:21.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:21.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:21.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:21.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:21.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:21.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:21.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:21.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:21.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:21.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:21.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:21.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:21.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:21.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:21.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:21.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:21.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:21.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:21.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:21.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:21.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:21.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:21.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:21.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:21.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:21.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:21.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:21.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:21.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:21.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:21.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:21.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:21.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:21.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:21.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:21.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:21.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:21.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:21.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:21.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:21.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:21.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:21.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:21.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:21.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:21.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:21.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:21.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:21.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:21.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:21.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:21.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:21.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:21.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:21.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:21.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 14w REG 8,1 123795027 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:21.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:21.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:21.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:21.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:21.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:21.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:21.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:21.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:21.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:21.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:21.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:21.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:21.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:21.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:21.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:21.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:21.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:21.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:21.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:21.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:21.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:21.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:21.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:21.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:21.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:21.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:21.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:21.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:21.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:21.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:21.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:21.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:21.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:21.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:21.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:21.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:21.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:21.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:21.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:21.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:21.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:21.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:21.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:21.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:21.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:21.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:21.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:21.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:21.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:21.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118618 io_contex root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:21.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:21.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:21.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:21.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:21.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:21.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:21.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:21.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:21.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:21.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:21.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:21.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:21.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:21.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:21.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:21.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:21.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:21.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:21.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:21.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:21.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:21.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:21.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:21.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:21.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:21.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:21.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:21.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:21.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:21.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:21.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:21.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:21.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:21.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:21.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:21.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:21.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:21.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:21.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:21.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:21.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:21.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:21.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:21.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:21.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:21.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:21.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:21.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:21.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:21.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:21.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:21.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:21.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:21.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:21.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:21.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:21.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:21.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:21.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:21.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:21.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:21.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:21.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:21.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:21.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:21.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:21.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:21.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:21.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:21.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:21.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:21.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:21.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:21.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:21.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:21.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:21.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:21.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:21.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:21.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:21.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:21.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:21.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:21.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:21.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:21.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:21.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:21.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:21.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:21.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:21.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:21.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:21.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 14w REG 8,1 123795027 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:21.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:21.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:21.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:21.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:21.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:21.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:21.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:21.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:21.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:21.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:21.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:21.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:21.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:21.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:21.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:21.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:21.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:21.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:21.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:21.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:21.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:21.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:21.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:21.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:21.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:21.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:21.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:21.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:21.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:21.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:21.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:21.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:21.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:21.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:21.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:21.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:21.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:21.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:21.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:21.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:21.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:21.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:21.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:21.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:21.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:21.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:21.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:21.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:21.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:21.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118619 io_contex root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:21.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:21.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:21.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:21.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:21.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:21.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:21.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:21.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:21.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:21.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:21.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:21.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:21.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:21.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:21.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:21.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:21.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:21.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:21.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:21.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:21.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:21.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:21.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:21.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:21.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:21.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:21.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:21.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:21.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:21.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:21.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:21.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:21.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:21.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:21.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:21.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:21.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:21.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:21.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:21.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:21.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:21.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:21.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:21.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:21.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:21.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:21.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:21.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:21.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:21.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:21.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:21.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:21.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:21.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:21.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:21.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:21.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:21.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:21.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:21.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:21.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:21.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:21.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:21.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:21.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:21.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:21.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:21.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:21.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:21.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:21.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:21.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:21.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:21.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:21.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:21.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:21.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:21.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:21.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:21.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:21.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:21.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:21.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:21.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:21.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:21.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:21.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:21.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:21.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:21.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:21.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:21.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:21.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 14w REG 8,1 123795027 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:21.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:21.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:21.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:21.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:21.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:21.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:21.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:21.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:21.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:21.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:21.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:21.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:21.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:21.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:21.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:21.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:21.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:21.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:21.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:21.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:21.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:21.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:21.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:21.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:21.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:21.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:21.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:21.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:21.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:21.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:21.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:21.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:21.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:21.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:21.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:21.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:21.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:21.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:21.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:21.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:21.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:21.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:21.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:21.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:21.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:21.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:21.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:21.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:21.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:21.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118632 OpHistory root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:21.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:21.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:21.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:21.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:21.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:21.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:21.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:21.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:21.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:21.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:21.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:21.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:21.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:21.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:21.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:21.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:21.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:21.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:21.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:21.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:21.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:21.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:21.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:21.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:21.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:21.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:21.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:21.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:21.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:21.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:21.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:21.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:21.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:21.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:21.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:21.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:21.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:21.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:21.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:21.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:21.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:21.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:21.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:21.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:21.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:21.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:21.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:21.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:21.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:21.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:21.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:21.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:21.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:21.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:21.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:21.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:21.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:21.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:21.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:21.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:21.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:21.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:21.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:21.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:21.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:21.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:21.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:21.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:21.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:21.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:21.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:21.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:21.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:21.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:21.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:21.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:21.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:21.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:21.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:21.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:21.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:21.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:21.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:21.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:21.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:21.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:21.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:21.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:21.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:21.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:21.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:21.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:21.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 14w REG 8,1 123795027 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:21.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:21.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:21.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:21.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:21.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:21.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:21.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:21.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:21.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:21.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:21.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:21.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:21.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:21.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:21.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:21.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:21.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:21.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:21.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:21.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:21.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:21.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:21.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:21.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:21.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:21.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:21.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:21.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:21.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:21.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:21.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:21.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:21.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:21.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:21.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:21.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:21.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:21.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:21.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:21.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:21.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:21.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:21.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:21.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:21.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:21.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:21.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:21.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:21.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:21.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118633 ceph_time root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:21.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:21.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:21.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:21.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:21.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:21.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:21.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:21.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:21.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:21.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:21.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:21.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:21.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:21.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:21.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:21.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:21.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:21.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:21.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:21.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:21.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:21.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:21.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:21.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:21.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:21.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:21.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:21.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:21.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:21.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:21.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:21.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:21.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:21.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:21.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:21.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:21.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:21.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:21.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:21.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:21.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:21.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:21.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:21.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:21.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:21.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:21.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:21.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:21.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:21.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:21.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:21.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:21.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:21.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:21.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:21.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:21.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:21.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:21.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:21.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:21.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:21.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:21.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:21.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:21.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:21.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:21.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:21.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:21.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:21.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:21.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:21.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:21.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:21.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:21.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:21.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:21.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:21.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:21.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:21.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:21.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:21.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:21.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:21.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:21.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:21.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:21.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:21.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:21.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:21.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:21.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:21.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:21.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 14w REG 8,1 123795027 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:21.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:21.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:21.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:21.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:21.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:21.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:21.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:21.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:21.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:21.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:21.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:21.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:21.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:21.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:21.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:21.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:21.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:21.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:21.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:21.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:21.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:21.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:21.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:21.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:21.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:21.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:21.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:21.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:21.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:21.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:21.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:21.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:21.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:21.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:21.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:21.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:21.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:21.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:21.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:21.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:21.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:21.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:21.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:21.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:21.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:21.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:21.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:21.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:21.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:21.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118679 ceph-osd root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:21.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:21.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:21.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:21.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:21.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:21.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:21.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:21.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:21.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:21.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:21.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:21.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:21.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:21.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:21.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:21.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:21.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:21.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:21.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:21.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:21.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:21.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:21.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:21.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:21.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:21.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:21.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:21.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:21.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:21.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:21.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:21.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:21.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:21.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:21.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:21.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:21.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:21.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:21.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:21.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:21.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:21.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:21.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:21.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:21.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:21.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:21.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:21.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:21.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:21.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:21.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:21.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:21.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:21.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:21.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:21.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:21.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:21.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:21.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:21.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:21.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:21.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:21.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:21.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:21.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:21.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:21.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:21.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:21.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:21.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:21.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:21.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:21.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:21.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:21.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:21.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:21.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:21.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:21.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:21.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:21.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:21.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:21.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:21.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:21.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:21.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:21.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:21.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:21.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:21.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:21.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:21.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:21.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 14w REG 8,1 123795027 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:21.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:21.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:21.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:21.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:21.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:21.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:21.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:21.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:21.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:21.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:21.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:21.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:21.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:21.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:21.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:21.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:21.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:21.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:21.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:21.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:21.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:21.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:21.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:21.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:21.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:21.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:21.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:21.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:21.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:21.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:21.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:21.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:21.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:21.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:21.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:21.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:21.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:21.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:21.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:21.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:21.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:21.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:21.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:21.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:21.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:21.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:21.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:21.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:21.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:21.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118689 ceph-osd root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:21.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:21.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:21.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:21.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:21.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:21.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:21.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:21.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:21.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:21.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:21.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:21.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:21.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:21.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:21.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:21.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:21.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:21.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:21.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:21.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:21.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:21.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:21.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:21.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:21.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:21.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:21.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:21.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:21.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:21.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:21.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:21.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:21.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:21.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:21.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:21.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:21.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:21.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:21.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:21.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:21.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:21.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:21.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:21.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:21.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:21.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:21.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:21.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:21.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:21.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:21.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:21.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:21.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:21.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:21.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:21.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:21.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:21.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:21.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:21.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:21.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:21.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:21.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:21.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:21.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:21.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:21.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:21.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:21.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:21.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:21.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:21.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:21.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:21.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:21.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:21.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:21.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:21.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:21.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:21.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:21.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:21.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:21.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:21.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:21.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:21.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:21.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:21.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:21.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:21.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:21.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:21.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:21.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 14w REG 8,1 123795027 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:21.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:21.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:21.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:21.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:21.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:21.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:21.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:21.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:21.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:21.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:21.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:21.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:21.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:21.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:21.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:21.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:21.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:21.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:21.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:21.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:21.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:21.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:21.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:21.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:21.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:21.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:21.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:21.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:21.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:21.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:21.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:21.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:21.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:21.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:21.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:21.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:21.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:21.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:21.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:21.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:21.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:21.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:21.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:21.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:21.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:21.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:21.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:21.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:21.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:21.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118697 ceph-osd root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:21.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:21.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:21.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:21.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:21.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:21.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:21.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:21.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:21.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:21.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:21.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:21.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:21.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:21.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:21.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:21.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:21.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:21.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:21.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:21.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:21.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:21.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:21.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:21.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:21.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:21.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:21.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:21.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:21.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:21.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:21.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:21.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:21.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:21.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:21.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:21.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:21.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:21.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:21.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:21.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:21.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:21.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:21.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:21.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:21.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:21.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:21.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:21.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:21.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:21.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:21.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:21.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:21.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:21.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:21.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:21.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:21.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:21.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:21.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:21.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:21.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:21.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:21.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:21.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:21.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:21.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:21.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:21.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:21.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:21.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:21.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:21.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:21.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:21.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:21.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:21.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:21.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:21.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:21.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:21.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:21.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:21.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:21.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:21.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:21.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:21.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:21.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:21.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:21.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:21.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:21.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:21.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:21.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 14w REG 8,1 123795027 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:21.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:21.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:21.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:21.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:21.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:21.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:21.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:21.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:21.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:21.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:21.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:21.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:21.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:21.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:21.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:21.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:21.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:21.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:21.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:21.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:21.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:21.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:21.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:21.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:21.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:21.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:21.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:21.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:21.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:21.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:21.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:21.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:21.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:21.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:21.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:21.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:21.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:21.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:21.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:21.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:21.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:21.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:21.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:21.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:21.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:21.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:21.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:21.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:21.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:21.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:21.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:21.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:21.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:21.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:21.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:21.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:21.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:21.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118716 ceph-osd root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:21.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:21.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:21.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:21.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:21.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:21.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:21.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:21.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:21.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:21.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:21.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:21.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:21.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:21.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:21.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:21.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:21.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:21.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:21.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:21.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:21.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:21.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:21.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:21.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:21.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:21.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:21.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:22.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:22.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:22.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:22.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:22.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:22.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:22.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:22.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:22.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:22.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:22.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:22.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:22.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:22.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:22.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:22.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:22.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:22.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:22.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:22.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:22.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:22.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:22.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:22.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:22.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:22.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:22.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:22.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:22.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:22.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:22.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:22.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:22.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:22.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:22.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:22.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:22.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:22.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:22.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:22.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:22.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:22.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:22.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:22.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:22.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:22.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:22.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:22.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:22.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:22.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:22.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:22.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:22.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:22.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:22.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:22.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:22.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:22.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 14w REG 8,1 123795027 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:22.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:22.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:22.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:22.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:22.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:22.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:22.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:22.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:22.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:22.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:22.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:22.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:22.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:22.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:22.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:22.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:22.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:22.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:22.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:22.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:22.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:22.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:22.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:22.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:22.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:22.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:22.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:22.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:22.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:22.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:22.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:22.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:22.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:22.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:22.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:22.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:22.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:22.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118724 ceph-osd root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:22.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:22.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:22.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:22.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:22.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:22.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:22.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:22.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:22.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:22.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:22.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:22.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:22.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:22.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:22.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:22.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:22.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:22.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:22.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:22.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:22.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:22.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:22.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:22.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:22.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:22.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:22.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:22.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:22.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:22.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:22.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:22.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:22.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:22.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:22.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:22.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:22.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:22.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:22.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:22.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:22.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:22.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:22.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:22.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:22.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:22.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:22.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:22.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:22.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:22.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:22.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:22.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:22.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:22.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:22.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:22.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:22.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:22.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:22.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:22.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:22.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:22.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:22.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:22.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:22.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:22.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:22.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:22.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:22.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:22.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:22.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:22.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:22.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:22.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:22.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:22.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:22.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:22.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:22.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:22.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:22.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:22.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:22.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:22.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:22.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 14w REG 8,1 123795027 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:22.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:22.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:22.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:22.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:22.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:22.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:22.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:22.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:22.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:22.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:22.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:22.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:22.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:22.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:22.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:22.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:22.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:22.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:22.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:22.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:22.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:22.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:22.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:22.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:22.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:22.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:22.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:22.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:22.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:22.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:22.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:22.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:22.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:22.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:22.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:22.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:22.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:22.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118732 ceph-osd root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:22.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:22.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:22.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:22.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:22.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:22.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:22.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:22.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:22.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:22.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:22.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:22.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:22.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:22.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:22.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:22.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:22.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:22.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:22.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:22.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:22.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:22.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:22.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:22.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:22.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:22.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:22.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:22.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:22.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:22.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:22.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:22.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:22.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:22.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:22.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:22.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:22.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:22.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:22.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:22.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:22.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:22.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:22.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:22.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:22.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:22.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:22.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:22.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:22.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:22.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:22.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:22.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:22.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:22.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:22.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:22.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:22.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:22.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:22.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:22.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:22.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:22.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:22.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:22.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:22.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:22.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:22.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:22.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:22.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:22.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:22.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:22.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:22.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:22.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:22.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:22.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:22.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:22.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:22.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:22.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:22.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:22.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:22.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:22.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:22.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 14w REG 8,1 123795027 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:22.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:22.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:22.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:22.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:22.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:22.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:22.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:22.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:22.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:22.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:22.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:22.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:22.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:22.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:22.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:22.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:22.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:22.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:22.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:22.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:22.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:22.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:22.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:22.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:22.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:22.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:22.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:22.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:22.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:22.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:22.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:22.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:22.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:22.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:22.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:22.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:22.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:22.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118740 ceph-osd root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:22.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:22.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:22.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:22.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:22.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:22.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:22.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:22.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:22.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:22.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:22.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:22.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:22.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:22.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:22.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:22.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:22.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:22.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:22.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:22.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:22.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:22.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:22.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:22.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:22.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:22.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:22.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:22.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:22.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:22.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:22.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:22.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:22.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:22.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:22.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:22.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:22.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:22.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:22.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:22.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:22.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:22.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:22.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:22.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:22.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:22.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:22.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:22.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:22.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:22.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:22.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:22.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:22.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:22.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:22.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:22.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:22.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:22.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:22.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:22.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:22.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:22.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:22.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:22.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:22.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:22.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:22.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:22.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:22.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:22.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:22.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:22.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:22.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:22.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:22.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:22.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:22.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:22.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:22.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:22.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:22.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:22.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:22.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:22.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:22.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 14w REG 8,1 123795027 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:22.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:22.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:22.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:22.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:22.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:22.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:22.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:22.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:22.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:22.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:22.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:22.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:22.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:22.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:22.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:22.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:22.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:22.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:22.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:22.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:22.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:22.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:22.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:22.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:22.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:22.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:22.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:22.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:22.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:22.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:22.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:22.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:22.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:22.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:22.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:22.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:22.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:22.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118946 ceph-osd root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:22.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:22.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:22.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:22.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:22.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:22.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:22.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:22.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:22.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:22.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:22.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:22.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:22.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:22.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:22.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:22.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:22.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:22.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:22.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:22.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:22.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:22.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:22.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:22.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:22.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:22.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:22.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:22.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:22.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:22.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:22.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:22.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:22.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:22.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:22.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:22.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:22.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:22.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:22.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:22.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:22.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:22.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:22.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:22.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:22.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:22.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:22.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:22.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:22.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:22.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:22.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:22.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:22.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:22.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:22.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:22.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:22.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:22.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:22.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:22.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:22.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:22.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:22.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:22.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:22.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:22.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:22.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:22.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:22.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:22.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:22.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:22.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:22.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:22.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:22.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:22.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:22.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:22.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:22.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:22.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:22.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:22.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:22.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:22.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:22.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 14w REG 8,1 123795027 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:22.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:22.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:22.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:22.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:22.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:22.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:22.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:22.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:22.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:22.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:22.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:22.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:22.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:22.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:22.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:22.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:22.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:22.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:22.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:22.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:22.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:22.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:22.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:22.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:22.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:22.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:22.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:22.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:22.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:22.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:22.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:22.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:22.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:22.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:22.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:22.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:22.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:22.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118947 ceph-osd root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:22.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:22.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:22.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:22.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:22.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:22.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:22.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:22.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:22.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:22.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:22.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:22.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:22.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:22.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:22.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:22.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:22.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:22.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:22.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:22.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:22.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:22.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:22.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:22.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:22.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:22.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:22.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:22.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:22.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:22.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:22.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:22.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:22.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:22.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:22.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:22.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:22.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:22.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:22.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:22.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:22.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:22.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:22.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:22.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:22.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:22.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:22.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:22.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:22.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:22.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:22.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:22.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:22.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:22.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:22.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:22.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:22.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:22.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:22.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:22.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:22.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:22.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:22.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:22.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:22.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:22.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:22.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:22.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:22.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:22.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:22.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:22.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:22.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:22.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:22.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:22.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:22.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:22.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:22.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:22.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:22.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:22.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:22.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:22.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:22.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 14w REG 8,1 123795310 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:22.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:22.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:22.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:22.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:22.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:22.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:22.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:22.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:22.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:22.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:22.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:22.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:22.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:22.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:22.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:22.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:22.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:22.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:22.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:22.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:22.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:22.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:22.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:22.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:22.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:22.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:22.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:22.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:22.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:22.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:22.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:22.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:22.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:22.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:22.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:22.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:22.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:22.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118948 safe_time root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:22.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:22.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:22.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:22.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:22.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:22.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:22.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:22.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:22.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:22.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:22.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:22.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:22.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:22.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:22.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:22.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:22.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:22.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:22.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:22.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:22.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:22.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:22.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:22.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:22.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:22.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:22.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:22.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:22.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:22.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:22.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:22.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:22.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:22.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:22.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:22.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:22.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:22.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:22.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:22.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:22.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:22.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:22.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:22.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:22.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:22.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:22.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:22.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:22.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:22.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:22.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:22.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:22.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:22.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:22.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:22.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:22.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:22.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:22.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:22.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:22.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:22.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:22.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:22.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:22.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:22.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:22.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:22.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:22.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:22.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:22.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:22.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:22.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:22.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:22.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:22.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:22.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:22.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:22.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:22.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:22.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:22.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:22.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:22.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:22.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 14w REG 8,1 123795310 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:22.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:22.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:22.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:22.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:22.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:22.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:22.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:22.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:22.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:22.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:22.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:22.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:22.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:22.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:22.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:22.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:22.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:22.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:22.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:22.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:22.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:22.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:22.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:22.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:22.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:22.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:22.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:22.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:22.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:22.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:22.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:22.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:22.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:22.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:22.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:22.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:22.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:22.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118949 safe_time root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:22.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:22.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:22.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:22.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:22.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:22.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:22.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:22.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:22.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:22.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:22.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:22.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:22.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:22.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:22.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:22.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:22.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:22.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:22.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:22.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:22.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:22.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:22.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:22.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:22.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:22.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:22.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:22.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:22.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:22.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:22.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:22.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:22.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:22.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:22.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:22.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:22.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:22.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:22.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:22.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:22.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:22.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:22.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:22.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:22.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:22.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:22.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:22.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:22.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:22.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:22.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:22.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:22.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:22.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:22.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:22.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:22.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:22.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:22.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:22.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:22.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:22.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:22.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:22.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:22.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:22.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:22.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:22.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:22.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:22.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:22.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:22.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:22.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:22.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:22.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:22.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:22.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:22.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:22.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:22.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:22.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:22.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:22.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:22.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:22.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 14w REG 8,1 123795310 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:22.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:22.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:22.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:22.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:22.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:22.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:22.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:22.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:22.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:22.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:22.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:22.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:22.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:22.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:22.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:22.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:22.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:22.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:22.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:22.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:22.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:22.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:22.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:22.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:22.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:22.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:22.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:22.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:22.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:22.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:22.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:22.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:22.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:22.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:22.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:22.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:22.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:22.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118950 safe_time root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:22.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:22.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:22.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:22.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:22.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:22.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:22.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:22.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:22.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:22.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:22.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:22.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:22.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:22.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:22.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:22.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:22.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:22.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:22.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:22.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:22.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:22.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:22.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:22.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:22.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:22.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:22.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:22.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:22.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:22.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:22.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:22.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:22.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:22.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:22.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:22.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:22.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:22.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:22.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:22.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:22.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:22.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:22.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:22.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:22.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:22.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:22.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:22.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:22.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:22.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:22.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:22.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:22.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:22.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:22.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:22.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:22.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:22.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:22.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:22.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:22.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:22.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:22.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:22.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:22.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:22.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:22.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:22.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:22.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:22.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:22.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:22.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:22.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:22.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:22.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:22.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:22.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:22.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:22.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:22.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:22.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:22.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:22.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:22.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:22.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 14w REG 8,1 123795310 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:22.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:22.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:22.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:22.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:22.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:22.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:22.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:22.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:22.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:22.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:22.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:22.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:22.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:22.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:22.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:22.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:22.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:22.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:22.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:22.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:22.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:22.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:22.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:22.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:22.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:22.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:22.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:22.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:22.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:22.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:22.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:22.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:22.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:22.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:22.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:22.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:22.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:22.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118951 safe_time root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:22.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:22.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:22.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:22.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:22.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:22.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:22.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:22.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:22.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:22.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:22.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:22.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:22.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:22.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:22.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:22.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:22.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:22.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:22.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:22.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:22.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:22.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:22.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:22.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:22.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:22.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:22.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:22.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:22.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:22.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:22.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:22.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:22.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:22.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:22.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:22.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:22.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:22.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:22.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:22.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:22.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:22.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:22.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:22.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:22.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:22.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:22.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:22.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:22.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:22.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:22.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:22.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:22.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:22.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:22.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:22.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:22.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:22.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:22.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:22.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:22.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:22.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:22.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:22.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:22.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:22.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:22.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:22.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:22.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:22.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:22.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:22.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:22.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:22.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:22.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:22.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:22.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:22.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:22.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:22.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:22.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:22.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:22.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:22.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:22.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 14w REG 8,1 123795310 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:22.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:22.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:22.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:22.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:22.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:22.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:22.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:22.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:22.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:22.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:22.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:22.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:22.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:22.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:22.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:22.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:22.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:22.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:22.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:22.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:22.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:22.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:22.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:22.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:22.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:22.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:22.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:22.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:22.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:22.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:22.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:22.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:22.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:22.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:22.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:22.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:22.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:22.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 118952 fn_anonym root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:22.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:22.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:22.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:22.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:22.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:22.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:22.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:22.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:22.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:22.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:22.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:22.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:22.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:22.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:22.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:22.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:22.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:22.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:22.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:22.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:22.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:22.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:22.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:22.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:22.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:22.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:22.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:22.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:22.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:22.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:22.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:22.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:22.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:22.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:22.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:22.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:22.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:22.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:22.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:22.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:22.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:22.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:22.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:22.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:22.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:22.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:22.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:22.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:22.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:22.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:22.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:22.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:22.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:22.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:22.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:22.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:22.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:22.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:22.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:22.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:22.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:22.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:22.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:22.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:22.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:22.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:22.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:22.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:22.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:22.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:22.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:22.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:22.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:22.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:22.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:22.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:22.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:22.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:22.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:22.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:22.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:22.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:22.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:22.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:22.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 14w REG 8,1 123795310 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:22.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:22.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:22.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:22.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:22.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:22.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:22.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:22.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:22.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:22.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:22.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:22.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:22.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:22.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:22.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:22.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:22.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:22.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:22.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:22.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:22.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:22.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:22.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:22.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:22.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:22.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:22.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:22.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:22.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:22.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:22.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:22.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:22.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:22.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:22.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:22.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:22.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:22.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119045 rocksdb:l root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:22.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:22.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:22.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:22.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:22.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:22.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:22.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:22.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:22.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:22.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:22.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:22.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:22.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:22.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:22.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:22.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:22.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:22.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:22.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:22.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:22.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:22.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:22.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:22.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:22.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:22.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:22.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:22.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:22.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:22.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:22.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:22.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:22.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:22.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:22.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:22.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:22.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:22.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:22.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:22.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:22.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:22.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:22.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:22.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:22.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:22.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:22.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:22.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:22.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:22.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:22.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:22.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:22.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:22.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:22.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:22.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:22.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:22.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:22.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:22.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:22.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:22.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:22.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:22.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:22.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:22.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:22.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:22.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:22.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:22.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:22.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:22.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:22.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:22.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:22.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:22.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:22.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:22.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:22.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:22.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:22.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:22.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:22.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:22.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:22.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 14w REG 8,1 123795310 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:22.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:22.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:22.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:22.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:22.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:22.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:22.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:22.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:22.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:22.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:22.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:22.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:22.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:22.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:22.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:22.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:22.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:22.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:22.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:22.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:22.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:22.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:22.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:22.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:22.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:22.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:22.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:22.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:22.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:22.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:22.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:22.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:22.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:22.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:22.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:22.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:22.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:22.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119049 rocksdb:l root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:22.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:22.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:22.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:22.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:22.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:22.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:22.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:22.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:22.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:22.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:22.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:22.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:22.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:22.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:22.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:22.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:22.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:22.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:22.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:22.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:22.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:22.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:22.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:22.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:22.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:22.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:22.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:22.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:22.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:22.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:22.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:22.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:22.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:22.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:22.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:22.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:22.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:22.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:22.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:22.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:22.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:22.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:22.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:22.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:22.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:22.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:22.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:22.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:22.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:22.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:22.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:22.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:22.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:22.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:22.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:22.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:22.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:22.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:22.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:22.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:22.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:22.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:22.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:22.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:22.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:22.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:22.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:22.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:22.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:22.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:22.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:22.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:22.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:22.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:22.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:22.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:22.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:22.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:22.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:22.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:22.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:22.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:22.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:22.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:22.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 14w REG 8,1 123795310 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:22.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:22.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:22.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:22.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:22.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:22.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:22.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:22.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:22.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:22.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:22.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:22.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:22.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:22.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:22.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:22.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:22.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:22.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:22.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:22.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:22.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:22.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:22.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:22.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:22.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:22.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:22.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:22.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:22.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:22.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:22.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:22.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:22.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:22.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:22.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:22.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:22.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:22.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119051 rocksdb:l root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:22.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:22.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:22.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:22.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:22.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:22.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:22.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:22.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:22.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:22.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:22.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:22.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:22.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:22.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:22.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:22.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:22.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:22.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:22.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:22.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:22.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:22.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:22.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:22.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:22.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:22.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:22.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:22.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:22.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:22.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:22.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:22.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:22.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:22.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:22.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:22.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:22.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:22.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:22.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:22.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:22.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:22.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:22.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:22.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:22.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:22.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:22.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:22.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:22.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:22.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:22.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:22.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:22.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:22.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:22.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:22.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:22.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:22.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:22.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:22.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:22.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:22.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:22.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:22.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:22.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:22.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:22.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:22.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:22.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:22.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:22.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:22.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:22.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:22.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:22.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:22.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:22.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:22.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:22.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:22.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:22.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:22.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:22.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:22.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:22.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 14w REG 8,1 123795310 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:22.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:22.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:22.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:22.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:22.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:22.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:22.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:22.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:22.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:22.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:22.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:22.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:22.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:22.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:22.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:22.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:22.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:22.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:22.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:22.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:22.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:22.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:22.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:22.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:22.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:22.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:22.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:22.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:22.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:22.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:22.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:22.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:22.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:22.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:22.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:22.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:22.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:22.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 119053 rocksdb:h root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:22.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:22.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:22.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:22.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:22.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:22.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:22.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:22.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:22.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:22.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:22.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:22.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:22.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:22.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:22.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:22.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:22.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:22.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:22.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:22.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:22.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:22.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:22.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:22.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:22.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:22.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:22.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:22.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:22.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:22.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:22.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:22.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:22.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:22.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:22.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:22.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:22.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:22.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:22.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:22.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:22.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:22.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:22.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:22.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:22.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:22.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:22.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:22.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:22.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:22.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:22.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:22.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:22.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:22.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:22.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:22.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:22.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:22.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:22.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:22.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:22.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:22.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:22.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:22.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:22.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:22.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:22.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:22.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:22.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:22.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:22.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:22.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:22.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:22.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:22.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:22.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:22.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:22.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:22.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:22.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:22.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:22.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:22.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:22.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:22.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 14w REG 8,1 123795310 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:22.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:22.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:22.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:22.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:22.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:22.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:22.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:22.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:22.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:22.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:22.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:22.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:22.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:22.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:22.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:22.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:22.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:22.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:22.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:22.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:22.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:22.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:22.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:22.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:22.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:22.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:22.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:22.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:22.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:22.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:22.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:22.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:22.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:22.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:22.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:22.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:22.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:22.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 120428 bstore_ai root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:22.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:22.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:22.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:22.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:22.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:22.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:22.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:22.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:22.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:22.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:22.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:22.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:22.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:22.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:22.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:22.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:22.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:22.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:22.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:22.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:22.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:22.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:22.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:22.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:22.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:22.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:22.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:22.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:22.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:22.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:22.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:22.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:22.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:22.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:22.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:22.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:22.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:22.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:22.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:22.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:22.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:22.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:22.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:22.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:22.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:22.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:22.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:22.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:22.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:22.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:22.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:22.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:22.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:22.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:22.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:22.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:22.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:22.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:22.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:22.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:22.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:22.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:22.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:22.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:22.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:22.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:22.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:22.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:22.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:22.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:22.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:22.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:22.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:22.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:22.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:22.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:22.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:22.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:22.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:22.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:22.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:22.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:22.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:22.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:22.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 14w REG 8,1 123795310 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:22.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:22.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:22.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:22.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:22.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:22.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:22.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:22.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:22.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:22.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:22.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:22.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:22.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:22.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:22.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:22.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:22.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:22.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:22.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:22.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:22.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:22.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:22.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:22.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:22.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:22.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:22.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:22.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:22.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:22.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:22.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:22.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:22.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:22.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:22.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:22.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:22.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:22.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121378 bstore_ai root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:22.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:22.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:22.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:22.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:22.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:22.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:22.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:22.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:22.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:22.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:22.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:22.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:22.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:22.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:22.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:22.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:22.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:22.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:22.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:22.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:22.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:22.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:22.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:22.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:22.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:22.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:22.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:22.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:22.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:22.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:22.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:22.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:22.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:22.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:22.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:22.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:22.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:22.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:22.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:22.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:22.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:22.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:22.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:22.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:22.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:22.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:22.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:22.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:22.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:22.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:22.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:22.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:22.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:22.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:22.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:22.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:22.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:22.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:22.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:22.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:22.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:22.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:22.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:22.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:22.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:22.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:22.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:22.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:22.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:22.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:22.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:22.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:22.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:22.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:22.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:22.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:22.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:22.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:22.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:22.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:22.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:22.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:22.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:22.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:22.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 14w REG 8,1 123795310 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:22.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:22.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:22.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:22.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:22.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:22.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:22.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:22.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:22.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:22.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:22.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:22.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:22.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:22.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:22.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:22.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:22.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:22.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:22.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:22.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:22.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:22.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:22.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:22.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:22.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:22.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:22.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:22.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:22.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:22.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:22.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:22.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:22.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:22.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:22.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:22.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:22.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:22.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121602 ceph-osd root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:22.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:22.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:22.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:22.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:22.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:22.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:22.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:22.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:22.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:22.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:22.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:22.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:22.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:22.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:22.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:22.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:22.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:22.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:22.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:22.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:22.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:22.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:22.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:22.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:22.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:22.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:22.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:22.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:22.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:22.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:22.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:22.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:22.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:22.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:22.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:22.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:22.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:22.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:22.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:22.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:22.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:22.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:22.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:22.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:22.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:22.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:22.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:22.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:22.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:22.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:22.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:22.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:22.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:22.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:22.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:22.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:22.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:22.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:22.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:22.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:22.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:22.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:22.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:22.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:22.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:22.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:22.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:22.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:22.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:22.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:22.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:22.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:22.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:22.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:22.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:22.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:22.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:22.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:22.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:22.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:22.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:22.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:22.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:22.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:22.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 14w REG 8,1 123795310 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:22.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:22.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:22.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:22.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:22.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:22.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:22.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:22.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:22.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:22.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:22.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:22.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:22.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:22.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:22.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:22.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:22.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:22.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:22.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:22.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:22.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:22.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:22.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:22.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:22.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:22.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:22.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:22.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:22.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:22.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:22.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:22.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:22.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:22.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:22.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:22.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:22.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:22.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121604 cfin root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:22.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:22.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:22.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:22.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:22.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:22.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:22.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:22.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:22.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:22.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:22.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:22.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:22.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:22.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:22.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:22.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:22.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:22.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:22.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:22.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:22.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:22.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:22.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:22.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:22.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:22.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:22.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:22.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:22.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:22.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:22.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:22.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:22.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:22.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:22.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:22.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:22.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:22.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:22.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:22.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:22.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:22.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:22.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:22.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:22.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:22.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:22.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:22.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:22.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:22.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:22.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:22.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:22.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:22.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:22.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:22.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:22.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:22.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:22.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:22.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:22.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:22.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:22.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:22.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:22.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:22.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:22.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:22.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:22.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:22.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:22.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:22.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:22.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:22.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:22.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:22.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:22.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:22.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:22.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:22.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:22.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:22.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:22.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:22.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:22.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 14w REG 8,1 123795310 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:22.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:22.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:22.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:22.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:22.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:22.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:22.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:22.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:22.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:22.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:22.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:22.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:22.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:22.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:22.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:22.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:22.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:22.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:22.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:22.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:22.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:22.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:22.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:22.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:22.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:22.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:22.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:22.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:22.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:22.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:22.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:22.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:22.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:22.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:22.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:22.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:22.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:22.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121605 bstore_kv root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:22.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:22.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:22.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:22.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:22.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:22.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:22.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:22.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:22.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:22.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:22.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:22.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:22.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:22.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:22.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:22.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:22.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:22.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:22.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:22.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:22.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:22.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:22.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:22.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:22.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:22.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:22.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:22.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:22.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:22.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:22.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:22.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:22.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:22.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:22.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:22.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:22.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:22.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:22.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:22.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:22.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:22.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:22.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:22.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:22.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:22.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:22.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:22.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:22.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:22.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:22.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:22.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:22.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:22.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:22.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:22.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:22.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:22.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:22.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:22.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:22.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:22.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:22.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:22.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:22.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:22.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:22.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:22.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:22.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:22.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:22.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:22.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:22.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:22.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:22.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:22.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:22.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:22.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:22.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:22.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:22.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:22.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:22.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:22.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:22.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 14w REG 8,1 123795310 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:22.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:22.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:22.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:22.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:22.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:22.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:22.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:22.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:22.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:22.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:22.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:22.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:22.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:22.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:22.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:22.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:22.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:22.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:22.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:22.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:22.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:22.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:22.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:22.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:22.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:22.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:22.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:22.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:22.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:22.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:22.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:22.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:22.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:22.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:22.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:22.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:22.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:22.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121606 bstore_kv root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:22.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:22.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:22.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:22.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:22.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:22.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:22.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:22.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:22.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:22.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:22.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:22.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:22.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:22.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:22.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:22.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:22.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:22.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:22.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:22.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:22.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:22.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:22.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:22.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:22.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:22.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:22.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:22.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:22.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:22.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:22.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:22.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:22.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:22.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:22.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:22.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:22.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:22.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:22.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:22.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:22.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:22.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:22.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:22.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:22.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:22.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:22.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:22.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:22.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:22.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:22.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:22.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:22.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:22.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:22.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:22.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:22.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:22.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:22.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:22.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:22.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:22.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:22.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:22.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:22.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:22.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:22.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:22.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:22.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:22.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:22.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:22.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:22.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:22.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:22.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:22.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:22.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:22.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:22.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:22.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:22.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:22.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:22.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:22.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:22.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 14w REG 8,1 123795310 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:22.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:22.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:22.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:22.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:22.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:22.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:22.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:22.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:22.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:22.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:22.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:22.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:22.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:22.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:22.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:22.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:22.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:22.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:22.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:22.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:22.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:22.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:22.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:22.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:22.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:22.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:22.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:22.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:22.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:22.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:22.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:22.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:22.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:22.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:22.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:22.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:22.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:22.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121607 bstore_me root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:22.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:22.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:22.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:22.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:22.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:22.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:22.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:22.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:22.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:22.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:22.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:22.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:22.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:22.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:22.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:22.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:22.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:22.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:22.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:22.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:22.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:22.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:22.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:22.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:22.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:22.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:22.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:22.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:22.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:22.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:22.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:22.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:22.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:22.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:22.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:22.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:22.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:22.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:22.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:22.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:22.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:22.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:22.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:22.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:22.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:22.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:22.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:22.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:22.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:22.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:22.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:22.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:22.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:22.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:22.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:22.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:22.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:22.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:22.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:22.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:22.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:22.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:22.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:22.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:22.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:22.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:22.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:22.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:22.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:22.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:22.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:22.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:22.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:22.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:22.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:22.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:22.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:22.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:22.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:22.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:22.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:22.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:22.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:22.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:22.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 14w REG 8,1 123795310 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:22.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:22.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:22.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:22.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:22.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:22.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:22.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:22.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:22.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:22.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:22.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:22.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:22.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:22.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:22.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:22.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:22.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:22.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:22.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:22.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:22.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:22.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:22.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:22.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:22.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:22.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:22.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:22.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:22.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:22.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:22.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:22.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:22.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:22.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:22.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:22.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:22.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:22.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121609 ms_dispat root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:22.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:22.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:22.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:22.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:22.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:22.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:22.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:22.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:22.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:22.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:22.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:22.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:22.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:22.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:22.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:22.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:22.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:22.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:22.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:22.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:22.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:22.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:22.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:22.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:22.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:22.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:22.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:22.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:22.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:22.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:22.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:22.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:22.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:22.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:22.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:22.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:22.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:22.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:22.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:22.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:22.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:22.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:22.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:22.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:22.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:22.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:22.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:22.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:22.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:22.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:22.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:22.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:22.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:22.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:22.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:22.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:22.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:22.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:22.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:22.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:22.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:22.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:22.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:22.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:22.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:22.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:22.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:22.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:22.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:22.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:22.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:22.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:22.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:22.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:22.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:22.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:22.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:22.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:22.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:22.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:22.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:22.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:22.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:22.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:22.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 14w REG 8,1 123795310 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:22.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:22.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:22.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:22.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:22.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:22.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:22.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:22.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:22.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:22.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:22.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:22.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:22.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:22.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:22.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:22.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:22.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:22.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:22.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:22.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:22.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:22.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:22.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:22.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:22.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:22.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:22.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:22.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:22.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:22.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:22.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:22.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:22.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:22.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:22.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:22.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:22.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:22.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121610 ms_local root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:22.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:22.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:22.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:22.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:22.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:22.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:22.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:22.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:22.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:22.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:22.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:22.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:22.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:22.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:22.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:22.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:22.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:22.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:22.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:22.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:22.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:22.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:22.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:22.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:22.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:22.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:22.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:22.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:22.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:22.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:22.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:22.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:22.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:22.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:22.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:22.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:22.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:22.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:22.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:22.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:22.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:22.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:22.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:22.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:22.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:22.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:22.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:22.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:22.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:22.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:22.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:22.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:22.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:22.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:22.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:22.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:22.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:22.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:22.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:22.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:22.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:22.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:22.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:22.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:22.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:22.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:22.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:22.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:22.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:22.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:22.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:22.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:22.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:22.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:22.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:22.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:22.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:22.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:22.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:22.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:22.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:22.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:22.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:22.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:22.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 14w REG 8,1 123795310 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:22.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:22.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:22.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:22.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:22.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:22.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:22.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:22.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:22.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:22.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:22.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:22.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:22.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:22.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:22.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:22.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:22.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:22.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:22.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:22.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:22.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:22.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:22.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:22.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:22.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:22.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:22.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:22.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:22.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:22.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:22.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:22.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:22.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:22.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:22.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:22.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:22.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:22.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121611 safe_time root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:22.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:22.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:22.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:22.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:22.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:22.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:22.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:22.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:22.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:22.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:22.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:22.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:22.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:22.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:22.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:22.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:22.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:22.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:22.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:22.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:22.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:22.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:22.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:22.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:22.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:22.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:22.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:22.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:22.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:22.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:22.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:22.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:22.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:22.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:22.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:22.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:22.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:22.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:22.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:22.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:22.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:22.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:22.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:22.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:22.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:22.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:22.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:22.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:22.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:22.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:22.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:22.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:22.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:22.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:22.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:22.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:22.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:22.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:22.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:22.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:22.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:22.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:22.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:22.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:22.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:22.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:22.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:22.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:22.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:22.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:22.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:22.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:22.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:22.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:22.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:22.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:22.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:22.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:22.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:22.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:22.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:22.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:22.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:22.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:22.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 14w REG 8,1 123795310 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:22.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:22.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:22.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:22.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:22.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:22.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:22.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:22.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:22.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:22.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:22.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:22.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:22.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:22.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:22.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:22.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:22.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:22.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:22.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:22.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:22.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:22.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:22.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:22.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:22.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:22.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:22.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:22.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:22.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:22.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:22.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:22.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:22.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:22.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:22.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:22.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:22.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:22.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121612 safe_time root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:22.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:22.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:22.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:22.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:22.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:22.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:22.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:22.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:22.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:22.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:22.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:22.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:22.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:22.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:22.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:22.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:22.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:22.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:22.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:22.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:22.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:22.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:22.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:22.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:22.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:22.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:22.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:22.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:22.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:22.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:22.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:22.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:22.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:22.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:22.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:22.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:22.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:22.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:22.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:22.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:22.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:22.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:22.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:22.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:22.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:22.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:22.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:22.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:22.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:22.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:22.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:22.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:22.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:22.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:22.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:22.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:22.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:22.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:22.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:22.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:22.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:22.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:22.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:22.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:22.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:22.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:22.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:22.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:22.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:22.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:22.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:22.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:22.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:22.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:22.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:22.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:22.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:22.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:22.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:22.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:22.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:22.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:22.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:22.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:22.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 14w REG 8,1 123795310 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:22.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:22.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:22.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:22.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:22.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:22.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:22.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:22.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:22.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:22.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:22.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:22.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:22.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:22.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:22.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:22.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:22.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:22.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:22.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:22.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:22.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:22.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:22.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:22.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:22.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:22.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:22.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:22.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:22.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:22.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:22.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:22.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:22.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:22.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:22.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:22.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:22.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:22.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121613 ms_dispat root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:22.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:22.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:22.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:22.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:22.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:22.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:22.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:22.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:22.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:22.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:22.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:22.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:22.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:22.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:22.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:22.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:22.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:22.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:22.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:22.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:22.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:22.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:22.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:22.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:22.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:22.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:22.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:22.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:22.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:22.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:22.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:22.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:22.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:22.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:22.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:22.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:22.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:22.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:22.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:22.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:22.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:22.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:22.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:22.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:22.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:22.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:22.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:22.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:22.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:22.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:22.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:22.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:22.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:22.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:22.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:22.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:22.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:22.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:22.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:22.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:22.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:22.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:22.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:22.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:22.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:22.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:22.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:22.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:22.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:22.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:22.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:22.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:22.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:22.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:22.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:22.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:22.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:22.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:22.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:22.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:22.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:22.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:22.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:22.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:22.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:22.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:22.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:22.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:22.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 14w REG 8,1 123795310 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:22.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:22.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:22.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:22.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:22.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:22.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:22.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:22.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:22.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:22.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:22.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:22.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:22.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:22.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:22.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:22.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:22.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:22.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:22.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:22.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:22.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:22.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:22.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:22.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:22.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:22.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:22.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:22.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:22.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:22.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:22.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:22.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:22.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:22.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:22.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:22.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:22.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:22.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:22.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:22.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:22.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:22.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:22.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:22.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:22.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:22.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:22.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:22.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:22.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:22.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:22.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121614 ms_local root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:22.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:22.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:22.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:22.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:22.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:22.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:22.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:22.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:22.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:22.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:22.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:22.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:22.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:22.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:22.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:22.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:22.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:22.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:22.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:22.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:22.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:22.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:22.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:22.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:23.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:23.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:23.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:23.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:23.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:23.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:23.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:23.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:23.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:23.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:23.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:23.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:23.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:23.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:23.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:23.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:23.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:23.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:23.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:23.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:23.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:23.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:23.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:23.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:23.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:23.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:23.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:23.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:23.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:23.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:23.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:23.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:23.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:23.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:23.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:23.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:23.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:23.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:23.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:23.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:23.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:23.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:23.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:23.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:23.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:23.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:23.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:23.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:23.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:23.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:23.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:23.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:23.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:23.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:23.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:23.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:23.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:23.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:23.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:23.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:23.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 14w REG 8,1 123795310 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:23.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:23.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:23.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:23.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:23.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:23.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:23.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:23.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:23.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:23.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:23.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:23.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:23.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:23.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:23.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:23.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:23.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:23.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:23.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:23.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:23.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:23.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:23.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:23.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:23.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:23.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:23.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:23.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:23.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:23.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:23.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:23.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:23.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:23.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:23.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:23.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:23.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:23.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121615 ms_dispat root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:23.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:23.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:23.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:23.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:23.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:23.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:23.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:23.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:23.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:23.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:23.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:23.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:23.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:23.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:23.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:23.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:23.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:23.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:23.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:23.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:23.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:23.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:23.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:23.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:23.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:23.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:23.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:23.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:23.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:23.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:23.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:23.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:23.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:23.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:23.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:23.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:23.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:23.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:23.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:23.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:23.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:23.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:23.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:23.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:23.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:23.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:23.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:23.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:23.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:23.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:23.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:23.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:23.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:23.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:23.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:23.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:23.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:23.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:23.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:23.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:23.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:23.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:23.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:23.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:23.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:23.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:23.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:23.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:23.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:23.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:23.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:23.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:23.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:23.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:23.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:23.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:23.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:23.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:23.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:23.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:23.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:23.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:23.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:23.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:23.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 14w REG 8,1 123795310 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:23.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:23.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:23.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:23.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:23.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:23.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:23.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:23.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:23.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:23.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:23.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:23.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:23.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:23.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:23.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:23.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:23.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:23.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:23.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:23.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:23.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:23.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:23.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:23.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:23.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:23.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:23.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:23.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:23.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:23.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:23.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:23.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:23.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:23.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:23.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:23.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:23.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:23.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121616 ms_local root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:23.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:23.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:23.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:23.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:23.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:23.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:23.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:23.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:23.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:23.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:23.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:23.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:23.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:23.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:23.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:23.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:23.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:23.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:23.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:23.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:23.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:23.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:23.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:23.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:23.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:23.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:23.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:23.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:23.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:23.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:23.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:23.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:23.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:23.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:23.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:23.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:23.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:23.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:23.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:23.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:23.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:23.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:23.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:23.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:23.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:23.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:23.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:23.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:23.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:23.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:23.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:23.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:23.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:23.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:23.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:23.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:23.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:23.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:23.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:23.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:23.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:23.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:23.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:23.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:23.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:23.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:23.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:23.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:23.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:23.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:23.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:23.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:23.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:23.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:23.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:23.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:23.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:23.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:23.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:23.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:23.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:23.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:23.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:23.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:23.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 14w REG 8,1 123795310 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:23.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:23.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:23.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:23.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:23.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:23.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:23.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:23.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:23.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:23.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:23.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:23.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:23.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:23.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:23.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:23.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:23.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:23.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:23.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:23.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:23.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:23.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:23.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:23.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:23.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:23.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:23.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:23.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:23.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:23.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:23.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:23.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:23.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:23.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:23.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:23.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:23.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:23.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121617 ms_dispat root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:23.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:23.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:23.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:23.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:23.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:23.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:23.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:23.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:23.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:23.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:23.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:23.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:23.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:23.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:23.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:23.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:23.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:23.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:23.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:23.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:23.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:23.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:23.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:23.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:23.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:23.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:23.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:23.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:23.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:23.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:23.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:23.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:23.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:23.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:23.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:23.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:23.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:23.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:23.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:23.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:23.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:23.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:23.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:23.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:23.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:23.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:23.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:23.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:23.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:23.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:23.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:23.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:23.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:23.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:23.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:23.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:23.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:23.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:23.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:23.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:23.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:23.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:23.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:23.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:23.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:23.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:23.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:23.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:23.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:23.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:23.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:23.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:23.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:23.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:23.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:23.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:23.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:23.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:23.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:23.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:23.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:23.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:23.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:23.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:23.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 14w REG 8,1 123795310 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:23.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:23.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:23.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:23.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:23.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:23.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:23.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:23.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:23.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:23.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:23.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:23.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:23.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:23.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:23.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:23.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:23.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:23.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:23.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:23.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:23.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:23.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:23.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:23.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:23.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:23.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:23.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:23.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:23.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:23.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:23.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:23.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:23.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:23.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:23.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:23.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:23.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:23.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121618 ms_local root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:23.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:23.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:23.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:23.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:23.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:23.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:23.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:23.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:23.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:23.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:23.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:23.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:23.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:23.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:23.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:23.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:23.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:23.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:23.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:23.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:23.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:23.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:23.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:23.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:23.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:23.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:23.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:23.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:23.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:23.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:23.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:23.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:23.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:23.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:23.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:23.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:23.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:23.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:23.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:23.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:23.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:23.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:23.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:23.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:23.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:23.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:23.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:23.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:23.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:23.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:23.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:23.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:23.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:23.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:23.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:23.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:23.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:23.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:23.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:23.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:23.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:23.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:23.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:23.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:23.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:23.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:23.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:23.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:23.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:23.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:23.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:23.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:23.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:23.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:23.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:23.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:23.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:23.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:23.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:23.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:23.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:23.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:23.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:23.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:23.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 14w REG 8,1 123795593 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:23.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:23.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:23.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:23.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:23.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:23.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:23.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:23.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:23.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:23.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:23.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:23.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:23.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:23.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:23.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:23.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:23.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:23.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:23.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:23.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:23.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:23.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:23.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:23.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:23.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:23.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:23.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:23.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:23.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:23.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:23.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:23.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:23.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:23.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:23.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:23.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:23.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:23.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121619 ms_dispat root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:23.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:23.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:23.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:23.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:23.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:23.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:23.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:23.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:23.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:23.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:23.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:23.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:23.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:23.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:23.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:23.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:23.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:23.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:23.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:23.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:23.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:23.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:23.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:23.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:23.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:23.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:23.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:23.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:23.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:23.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:23.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:23.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:23.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:23.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:23.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:23.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:23.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:23.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:23.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:23.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:23.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:23.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:23.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:23.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:23.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:23.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:23.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:23.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:23.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:23.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:23.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:23.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:23.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:23.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:23.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:23.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:23.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:23.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:23.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:23.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:23.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:23.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:23.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:23.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:23.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:23.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:23.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:23.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:23.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:23.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:23.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:23.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:23.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:23.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:23.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:23.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:23.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:23.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:23.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:23.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:23.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:23.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:23.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:23.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:23.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 14w REG 8,1 123795593 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:23.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:23.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:23.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:23.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:23.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:23.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:23.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:23.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:23.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:23.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:23.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:23.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:23.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:23.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:23.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:23.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:23.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:23.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:23.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:23.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:23.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:23.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:23.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:23.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:23.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:23.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:23.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:23.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:23.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:23.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:23.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:23.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:23.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:23.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:23.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:23.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:23.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:23.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121620 ms_local root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:23.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:23.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:23.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:23.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:23.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:23.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:23.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:23.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:23.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:23.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:23.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:23.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:23.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:23.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:23.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:23.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:23.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:23.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:23.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:23.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:23.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:23.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:23.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:23.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:23.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:23.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:23.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:23.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:23.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:23.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:23.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:23.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:23.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:23.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:23.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:23.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:23.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:23.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:23.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:23.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:23.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:23.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:23.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:23.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:23.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:23.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:23.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:23.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:23.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:23.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:23.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:23.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:23.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:23.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:23.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:23.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:23.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:23.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:23.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:23.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:23.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:23.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:23.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:23.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:23.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:23.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:23.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:23.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:23.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:23.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:23.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:23.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:23.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:23.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:23.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:23.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:23.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:23.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:23.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:23.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:23.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:23.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:23.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:23.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:23.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 14w REG 8,1 123795593 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:23.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:23.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:23.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:23.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:23.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:23.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:23.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:23.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:23.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:23.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:23.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:23.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:23.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:23.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:23.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:23.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:23.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:23.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:23.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:23.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:23.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:23.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:23.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:23.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:23.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:23.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:23.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:23.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:23.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:23.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:23.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:23.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:23.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:23.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:23.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:23.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:23.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:23.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121621 ms_dispat root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:23.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:23.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:23.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:23.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:23.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:23.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:23.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:23.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:23.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:23.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:23.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:23.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:23.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:23.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:23.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:23.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:23.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:23.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:23.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:23.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:23.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:23.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:23.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:23.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:23.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:23.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:23.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:23.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:23.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:23.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:23.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:23.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:23.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:23.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:23.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:23.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:23.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:23.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:23.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:23.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:23.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:23.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:23.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:23.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:23.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:23.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:23.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:23.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:23.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:23.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:23.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:23.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:23.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:23.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:23.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:23.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:23.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:23.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:23.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:23.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:23.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:23.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:23.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:23.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:23.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:23.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:23.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:23.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:23.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:23.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:23.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:23.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:23.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:23.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:23.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:23.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:23.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:23.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:23.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:23.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:23.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:23.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:23.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:23.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:23.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 14w REG 8,1 123795593 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:23.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:23.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:23.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:23.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:23.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:23.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:23.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:23.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:23.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:23.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:23.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:23.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:23.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:23.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:23.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:23.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:23.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:23.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:23.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:23.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:23.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:23.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:23.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:23.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:23.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:23.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:23.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:23.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:23.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:23.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:23.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:23.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:23.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:23.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:23.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:23.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:23.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:23.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121622 ms_local root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:23.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:23.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:23.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:23.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:23.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:23.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:23.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:23.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:23.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:23.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:23.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:23.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:23.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:23.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:23.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:23.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:23.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:23.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:23.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:23.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:23.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:23.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:23.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:23.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:23.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:23.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:23.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:23.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:23.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:23.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:23.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:23.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:23.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:23.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:23.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:23.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:23.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:23.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:23.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:23.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:23.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:23.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:23.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:23.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:23.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:23.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:23.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:23.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:23.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:23.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:23.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:23.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:23.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:23.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:23.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:23.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:23.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:23.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:23.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:23.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:23.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:23.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:23.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:23.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:23.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:23.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:23.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:23.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:23.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:23.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:23.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:23.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:23.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:23.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:23.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:23.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:23.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:23.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:23.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:23.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:23.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:23.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:23.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:23.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:23.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 14w REG 8,1 123795593 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:23.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:23.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:23.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:23.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:23.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:23.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:23.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:23.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:23.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:23.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:23.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:23.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:23.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:23.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:23.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:23.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:23.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:23.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:23.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:23.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:23.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:23.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:23.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:23.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:23.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:23.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:23.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:23.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:23.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:23.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:23.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:23.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:23.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:23.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:23.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:23.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:23.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:23.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121623 ms_dispat root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:23.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:23.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:23.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:23.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:23.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:23.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:23.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:23.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:23.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:23.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:23.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:23.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:23.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:23.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:23.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:23.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:23.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:23.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:23.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:23.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:23.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:23.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:23.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:23.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:23.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:23.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:23.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:23.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:23.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:23.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:23.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:23.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:23.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:23.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:23.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:23.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:23.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:23.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:23.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:23.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:23.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:23.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:23.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:23.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:23.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:23.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:23.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:23.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:23.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:23.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:23.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:23.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:23.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:23.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:23.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:23.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:23.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:23.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:23.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:23.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:23.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:23.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:23.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:23.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:23.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:23.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:23.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:23.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:23.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:23.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:23.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:23.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:23.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:23.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:23.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:23.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:23.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:23.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:23.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:23.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:23.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:23.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:23.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:23.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:23.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 14w REG 8,1 123795593 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:23.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:23.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:23.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:23.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:23.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:23.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:23.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:23.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:23.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:23.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:23.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:23.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:23.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:23.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:23.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:23.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:23.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:23.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:23.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:23.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:23.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:23.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:23.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:23.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:23.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:23.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:23.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:23.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:23.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:23.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:23.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:23.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:23.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:23.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:23.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:23.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:23.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:23.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121624 ms_local root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:23.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:23.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:23.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:23.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:23.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:23.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:23.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:23.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:23.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:23.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:23.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:23.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:23.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:23.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:23.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:23.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:23.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:23.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:23.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:23.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:23.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:23.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:23.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:23.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:23.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:23.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:23.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:23.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:23.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:23.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:23.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:23.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:23.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:23.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:23.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:23.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:23.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:23.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:23.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:23.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:23.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:23.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:23.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:23.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:23.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:23.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:23.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:23.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:23.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:23.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:23.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:23.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:23.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:23.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:23.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:23.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:23.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:23.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:23.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:23.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:23.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:23.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:23.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:23.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:23.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:23.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:23.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:23.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:23.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:23.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:23.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:23.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:23.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:23.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:23.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:23.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:23.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:23.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:23.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:23.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:23.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:23.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:23.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:23.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:23.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 14w REG 8,1 123795593 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:23.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:23.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:23.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:23.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:23.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:23.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:23.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:23.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:23.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:23.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:23.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:23.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:23.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:23.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:23.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:23.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:23.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:23.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:23.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:23.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:23.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:23.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:23.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:23.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:23.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:23.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:23.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:23.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:23.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:23.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:23.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:23.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:23.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:23.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:23.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:23.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:23.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:23.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121625 fn_anonym root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:23.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:23.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:23.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:23.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:23.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:23.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:23.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:23.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:23.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:23.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:23.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:23.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:23.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:23.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:23.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:23.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:23.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:23.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:23.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:23.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:23.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:23.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:23.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:23.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:23.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:23.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:23.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:23.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:23.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:23.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:23.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:23.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:23.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:23.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:23.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:23.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:23.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:23.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:23.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:23.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:23.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:23.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:23.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:23.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:23.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:23.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:23.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:23.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:23.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:23.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:23.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:23.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:23.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:23.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:23.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:23.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:23.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:23.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:23.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:23.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:23.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:23.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:23.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:23.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:23.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:23.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:23.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:23.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:23.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:23.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:23.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:23.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:23.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:23.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:23.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:23.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:23.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:23.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:23.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:23.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:23.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:23.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:23.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:23.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:23.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 14w REG 8,1 123795593 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:23.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:23.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:23.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:23.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:23.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:23.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:23.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:23.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:23.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:23.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:23.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:23.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:23.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:23.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:23.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:23.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:23.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:23.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:23.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:23.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:23.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:23.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:23.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:23.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:23.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:23.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:23.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:23.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:23.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:23.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:23.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:23.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:23.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:23.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:23.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:23.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:23.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:23.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121626 finisher root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:23.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:23.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:23.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:23.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:23.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:23.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:23.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:23.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:23.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:23.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:23.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:23.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:23.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:23.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:23.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:23.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:23.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:23.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:23.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:23.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:23.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:23.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:23.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:23.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:23.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:23.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:23.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:23.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:23.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:23.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:23.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:23.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:23.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:23.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:23.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:23.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:23.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:23.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:23.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:23.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:23.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:23.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:23.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:23.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:23.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:23.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:23.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:23.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:23.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:23.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:23.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:23.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:23.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:23.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:23.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:23.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:23.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:23.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:23.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:23.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:23.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:23.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:23.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:23.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:23.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:23.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:23.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:23.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:23.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:23.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:23.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:23.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:23.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:23.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:23.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:23.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:23.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:23.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:23.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:23.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:23.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:23.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:23.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:23.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:23.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 14w REG 8,1 123795593 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:23.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:23.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:23.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:23.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:23.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:23.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:23.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:23.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:23.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:23.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:23.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:23.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:23.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:23.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:23.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:23.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:23.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:23.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:23.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:23.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:23.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:23.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:23.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:23.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:23.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:23.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:23.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:23.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:23.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:23.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:23.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:23.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:23.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:23.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:23.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:23.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:23.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:23.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121627 safe_time root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:23.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:23.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:23.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:23.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:23.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:23.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:23.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:23.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:23.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:23.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:23.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:23.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:23.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:23.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:23.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:23.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:23.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:23.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:23.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:23.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:23.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:23.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:23.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:23.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:23.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:23.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:23.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:23.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:23.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:23.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:23.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:23.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:23.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:23.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:23.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:23.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:23.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:23.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:23.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:23.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:23.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:23.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:23.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:23.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:23.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:23.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:23.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:23.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:23.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:23.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:23.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:23.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:23.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:23.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:23.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:23.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:23.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:23.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:23.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:23.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:23.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:23.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:23.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:23.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:23.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:23.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:23.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:23.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:23.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:23.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:23.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:23.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:23.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:23.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:23.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:23.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:23.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:23.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:23.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:23.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:23.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:23.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:23.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:23.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:23.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 14w REG 8,1 123795593 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:23.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:23.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:23.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:23.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:23.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:23.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:23.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:23.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:23.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:23.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:23.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:23.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:23.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:23.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:23.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:23.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:23.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:23.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:23.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:23.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:23.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:23.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:23.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:23.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:23.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:23.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:23.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:23.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:23.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:23.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:23.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:23.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:23.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:23.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:23.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:23.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:23.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:23.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121628 safe_time root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:23.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:23.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:23.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:23.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:23.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:23.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:23.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:23.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:23.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:23.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:23.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:23.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:23.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:23.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:23.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:23.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:23.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:23.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:23.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:23.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:23.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:23.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:23.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:23.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:23.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:23.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:23.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:23.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:23.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:23.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:23.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:23.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:23.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:23.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:23.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:23.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:23.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:23.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:23.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:23.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:23.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:23.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:23.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:23.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:23.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:23.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:23.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:23.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:23.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:23.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:23.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:23.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:23.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:23.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:23.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:23.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:23.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:23.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:23.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:23.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:23.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:23.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:23.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:23.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:23.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:23.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:23.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:23.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:23.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:23.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:23.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:23.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:23.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:23.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:23.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:23.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:23.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:23.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:23.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:23.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:23.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:23.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:23.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:23.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:23.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 14w REG 8,1 123795593 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:23.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:23.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:23.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:23.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:23.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:23.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:23.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:23.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:23.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:23.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:23.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:23.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:23.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:23.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:23.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:23.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:23.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:23.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:23.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:23.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:23.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:23.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:23.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:23.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:23.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:23.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:23.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:23.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:23.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:23.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:23.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:23.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:23.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:23.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:23.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:23.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:23.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:23.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121629 ceph-osd root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:23.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:23.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:23.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:23.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:23.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:23.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:23.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:23.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:23.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:23.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:23.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:23.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:23.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:23.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:23.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:23.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:23.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:23.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:23.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:23.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:23.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:23.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:23.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:23.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:23.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:23.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:23.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:23.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:23.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:23.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:23.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:23.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:23.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:23.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:23.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:23.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:23.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:23.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:23.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:23.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:23.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:23.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:23.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:23.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:23.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:23.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:23.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:23.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:23.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:23.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:23.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:23.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:23.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:23.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:23.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:23.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:23.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:23.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:23.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:23.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:23.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:23.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:23.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:23.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:23.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:23.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:23.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:23.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:23.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:23.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:23.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:23.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:23.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:23.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:23.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:23.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:23.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:23.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:23.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:23.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:23.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:23.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:23.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:23.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:23.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 14w REG 8,1 123795593 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:23.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:23.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:23.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:23.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:23.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:23.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:23.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:23.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:23.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:23.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:23.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:23.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:23.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:23.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:23.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:23.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:23.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:23.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:23.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:23.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:23.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:23.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:23.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:23.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:23.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:23.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:23.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:23.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:23.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:23.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:23.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:23.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:23.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:23.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:23.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:23.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:23.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:23.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121630 osd_srv_a root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:23.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:23.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:23.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:23.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:23.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:23.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:23.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:23.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:23.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:23.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:23.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:23.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:23.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:23.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:23.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:23.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:23.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:23.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:23.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:23.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:23.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:23.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:23.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:23.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:23.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:23.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:23.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:23.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:23.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:23.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:23.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:23.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:23.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:23.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:23.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:23.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:23.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:23.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:23.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:23.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:23.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:23.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:23.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:23.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:23.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:23.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:23.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:23.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:23.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:23.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:23.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:23.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:23.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:23.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:23.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:23.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:23.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:23.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:23.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:23.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:23.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:23.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:23.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:23.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:23.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:23.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:23.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:23.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:23.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:23.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:23.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:23.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:23.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:23.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:23.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:23.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:23.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:23.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:23.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:23.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:23.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:23.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:23.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:23.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:23.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 14w REG 8,1 123795593 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:23.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:23.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:23.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:23.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:23.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:23.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:23.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:23.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:23.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:23.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:23.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:23.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:23.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:23.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:23.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:23.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:23.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:23.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:23.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:23.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:23.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:23.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:23.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:23.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:23.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:23.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:23.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:23.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:23.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:23.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:23.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:23.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:23.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:23.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:23.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:23.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:23.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:23.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121631 tp_osd_tp root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:23.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:23.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:23.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:23.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:23.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:23.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:23.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:23.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:23.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:23.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:23.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:23.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:23.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:23.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:23.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:23.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:23.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:23.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:23.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:23.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:23.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:23.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:23.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:23.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:23.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:23.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:23.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:23.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:23.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:23.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:23.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:23.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:23.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:23.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:23.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:23.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:23.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:23.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:23.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:23.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:23.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:23.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:23.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:23.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:23.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:23.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:23.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:23.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:23.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:23.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:23.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:23.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:23.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:23.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:23.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:23.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:23.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:23.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:23.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:23.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:23.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:23.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:23.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:23.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:23.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:23.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:23.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:23.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:23.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:23.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:23.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:23.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:23.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:23.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:23.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:23.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:23.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:23.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:23.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:23.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:23.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:23.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:23.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:23.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:23.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 14w REG 8,1 123795593 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:23.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:23.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:23.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:23.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:23.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:23.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:23.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:23.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:23.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:23.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:23.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:23.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:23.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:23.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:23.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:23.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:23.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:23.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:23.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:23.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:23.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:23.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:23.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:23.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:23.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:23.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:23.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:23.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:23.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:23.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:23.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:23.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:23.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:23.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:23.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:23.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:23.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:23.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121632 tp_osd_tp root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:23.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:23.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:23.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:23.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:23.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:23.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:23.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:23.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:23.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:23.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:23.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:23.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:23.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:23.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:23.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:23.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:23.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:23.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:23.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:23.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:23.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:23.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:23.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:23.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:23.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:23.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:23.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:23.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:23.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:23.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:23.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:23.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:23.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:23.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:23.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:23.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:23.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:23.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:23.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:23.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:23.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:23.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:23.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:23.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:23.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:23.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:23.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:23.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:23.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:23.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:23.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:23.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:23.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:23.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:23.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:23.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:23.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:23.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:23.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:23.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:23.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:23.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:23.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:23.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:23.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:23.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:23.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:23.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:23.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:23.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:23.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:23.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:23.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:23.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:23.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:23.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:23.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:23.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:23.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:23.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:23.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:23.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:23.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:23.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:23.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 14w REG 8,1 123795593 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:23.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:23.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:23.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:23.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:23.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:23.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:23.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:23.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:23.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:23.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:23.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:23.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:23.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:23.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:23.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:23.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:23.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:23.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:23.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:23.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:23.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:23.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:23.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:23.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:23.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:23.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:23.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:23.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:23.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:23.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:23.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:23.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:23.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:23.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:23.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:23.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:23.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:23.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121633 tp_osd_tp root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:23.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:23.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:23.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:23.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:23.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:23.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:23.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:23.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:23.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:23.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:23.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:23.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:23.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:23.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:23.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:23.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:23.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:23.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:23.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:23.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:23.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:23.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:23.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:23.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:23.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:23.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:23.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:23.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:23.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:23.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:23.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:23.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:23.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:23.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:23.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:23.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:23.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:23.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:23.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:23.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:23.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:23.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:23.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:23.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:23.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:23.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:23.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:23.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:23.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:23.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:23.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:23.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:23.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:23.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:23.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:23.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:23.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:23.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:23.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:23.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:23.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:23.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:23.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:23.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:23.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:23.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:23.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:23.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:23.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:23.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:23.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:23.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:23.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:23.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:23.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:23.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:23.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:23.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:23.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:23.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:23.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:23.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:23.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:23.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:23.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 14w REG 8,1 123795593 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:23.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:23.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:23.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:23.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:23.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:23.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:23.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:23.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:23.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:23.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:23.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:23.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:23.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:23.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:23.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:23.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:23.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:23.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:23.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:23.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:23.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:23.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:23.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:23.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:23.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:23.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:23.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:23.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:23.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:23.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:23.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:23.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:23.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:23.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:23.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:23.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:23.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:23.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121634 tp_osd_tp root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:23.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:23.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:23.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:23.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:23.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:23.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:23.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:23.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:23.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:23.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:23.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:23.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:23.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:23.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:23.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:23.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:23.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:23.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:23.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:23.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:23.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:23.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:23.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:23.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:23.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:23.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:23.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:23.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:23.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:23.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:23.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:23.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:23.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:23.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:23.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:23.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:23.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:23.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:23.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:23.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:23.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:23.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:23.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:23.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:23.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:23.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:23.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:23.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:23.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:23.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:23.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:23.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:23.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:23.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:23.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:23.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:23.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:23.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:23.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:23.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:23.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:23.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:23.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:23.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:23.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:23.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:23.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:23.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:23.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:23.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:23.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:23.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:23.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:23.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:23.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:23.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:23.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:23.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:23.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:23.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:23.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:23.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:23.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:23.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:23.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 14w REG 8,1 123795593 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:23.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:23.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:23.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:23.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:23.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:23.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:23.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:23.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:23.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:23.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:23.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:23.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:23.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:23.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:23.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:23.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:23.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:23.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:23.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:23.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:23.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:23.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:23.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:23.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:23.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:23.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:23.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:23.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:23.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:23.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:23.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:23.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:23.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:23.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:23.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:23.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:23.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:23.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121635 tp_osd_tp root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:23.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:23.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:23.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:23.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:23.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:23.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:23.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:23.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:23.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:23.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:23.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:23.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:23.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:23.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:23.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:23.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:23.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:23.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:23.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:23.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:23.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:23.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:23.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:23.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:23.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:23.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:23.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:23.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:23.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:23.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:23.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:23.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:23.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:23.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:23.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:23.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:23.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:23.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:23.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:23.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:23.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:23.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:23.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:23.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:23.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:23.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:23.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:23.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:23.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:23.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:23.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:23.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:23.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:23.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:23.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:23.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:23.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:23.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:23.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:23.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:23.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:23.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:23.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:23.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:23.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:23.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:23.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:23.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:23.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:23.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:23.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:23.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:23.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:23.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:23.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:23.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:23.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:23.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:23.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:23.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:23.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:23.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:23.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:23.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:23.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 14w REG 8,1 123795593 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:23.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:23.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:23.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:23.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:23.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:23.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:23.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:23.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:23.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:23.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:23.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:23.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:23.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:23.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:23.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:23.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:23.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:23.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:23.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:23.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:23.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:23.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:23.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:23.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:23.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:23.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:23.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:23.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:23.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:23.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:23.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:23.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:23.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:23.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:23.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:23.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:23.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:23.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121636 tp_osd_tp root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:23.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:23.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:23.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:23.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:23.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:23.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:23.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:23.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:23.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:23.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:23.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:23.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:23.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:23.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:23.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:23.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:23.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:23.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:23.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:23.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:23.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:23.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:23.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:23.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:23.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:23.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:23.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:23.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:23.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:23.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:23.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:23.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:23.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:23.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:23.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:23.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:23.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:23.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:23.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:23.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:23.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:23.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:23.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:23.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:23.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:23.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:23.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:23.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:23.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:23.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:23.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:23.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:23.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:23.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:23.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:23.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:23.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:23.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:23.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:23.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:23.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:23.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:23.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:23.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:23.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:23.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:23.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:23.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:23.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:23.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:23.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:23.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:23.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:23.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:23.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:23.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:23.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:23.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:23.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:23.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:23.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:23.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:23.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:23.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:23.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 14w REG 8,1 123795593 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:23.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:23.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:23.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:23.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:23.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:23.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:23.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:23.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:23.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:23.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:23.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:23.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:23.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:23.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:23.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:23.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:23.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:23.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:23.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:23.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:23.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:23.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:23.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:23.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:23.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:23.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:23.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:23.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:23.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:23.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:23.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:23.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:23.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:23.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:23.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:23.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:23.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:23.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121637 tp_osd_tp root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:23.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:23.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:23.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:23.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:23.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:23.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:23.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:23.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:23.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:23.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:23.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:23.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:23.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:23.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:23.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:23.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:23.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:23.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:23.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:23.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:23.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:23.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:23.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:23.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:23.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:23.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:23.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:23.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:23.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:23.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:23.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:23.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:23.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:23.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:23.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:23.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:23.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:23.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:23.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:23.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:23.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:23.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:23.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:23.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:23.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:23.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:23.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:23.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:23.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:23.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:23.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:23.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:23.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:23.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:23.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:23.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:23.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:23.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:23.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:23.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:23.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:23.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:23.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:23.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:23.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:23.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:23.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:23.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:23.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:23.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:23.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:23.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:23.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:23.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:23.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:23.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:23.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:23.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:23.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:23.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:23.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:23.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:23.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:23.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:23.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 14w REG 8,1 123795593 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:23.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:23.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:23.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:23.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:23.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:23.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:23.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:23.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:23.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:23.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:23.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:23.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:23.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:23.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:23.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:23.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:23.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:23.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:23.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:23.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:23.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:23.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:23.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:23.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:23.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:23.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:23.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:23.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:23.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:23.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:23.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:23.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:23.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:23.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:23.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:23.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:23.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:23.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121638 tp_osd_tp root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:23.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:23.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:23.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:23.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:23.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:23.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:23.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:23.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:23.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:23.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:23.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:23.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:23.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:23.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:23.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:23.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:23.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:23.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:23.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:23.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:23.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:23.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:23.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:23.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:23.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:23.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:23.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:23.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:23.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:23.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:23.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:23.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:23.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:23.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:23.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:23.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:23.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:23.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:23.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:23.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:23.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:23.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:23.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:23.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:23.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:23.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:23.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:23.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:23.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:23.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:23.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:23.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:23.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:23.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:23.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:23.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:23.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:23.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:23.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:23.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:23.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:23.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:23.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:23.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:23.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:23.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:23.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:23.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:23.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:23.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:23.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:23.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:23.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:23.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:23.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:23.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:23.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:23.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:23.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:23.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:23.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:23.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:23.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:23.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:23.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 14w REG 8,1 123795593 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:23.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:23.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:23.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:23.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:23.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:23.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:23.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:23.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:23.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:23.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:23.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:23.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:23.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:23.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:23.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:23.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:23.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:23.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:23.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:23.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:23.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:23.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:23.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:23.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:23.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:23.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:23.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:23.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:23.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:23.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:23.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:23.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:23.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:23.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:23.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:23.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:23.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:23.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121639 tp_osd_tp root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:23.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:23.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:23.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:23.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:23.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:23.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:23.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:23.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:23.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:23.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:23.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:23.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:23.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:23.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:23.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:23.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:23.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:23.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:23.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:23.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:23.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:23.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:23.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:23.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:23.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:23.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:23.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:23.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:23.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:23.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:23.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:23.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:23.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:23.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:23.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:23.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:23.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:23.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:23.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:23.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:23.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:23.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:23.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:23.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:23.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:23.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:23.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:23.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:23.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:23.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:23.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:23.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:23.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:23.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:23.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:23.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:23.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:23.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:23.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:23.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:23.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:23.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:23.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:23.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:23.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:23.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:23.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:23.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:23.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:23.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:23.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:23.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:23.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:23.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:23.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:23.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:23.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:23.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:23.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:23.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:23.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:23.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:23.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:23.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:23.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 14w REG 8,1 123795593 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:23.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:23.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:23.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:23.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:23.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:23.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:23.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:23.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:23.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:23.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:23.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:23.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:23.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:23.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:23.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:23.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:23.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:23.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:23.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:23.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:23.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:23.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:23.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:23.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:23.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:23.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:23.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:23.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:23.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:23.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:23.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:23.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:23.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:23.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:23.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:23.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:23.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:23.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121640 tp_osd_tp root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:23.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:23.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:23.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:23.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:23.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:23.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:23.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:23.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:23.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:23.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:23.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:23.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:23.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:23.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:23.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:23.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:23.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:23.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:23.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:23.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:23.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:23.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:23.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:23.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:23.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:23.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:23.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:23.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:23.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:23.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:23.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:23.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:23.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:23.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:23.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:23.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:23.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:23.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:23.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:23.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:23.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:23.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:23.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:23.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:23.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:23.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:23.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:23.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:23.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:23.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:23.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:23.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:23.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:23.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:23.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:23.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:23.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:23.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:23.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:23.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:23.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:23.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:23.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:23.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:23.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:23.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:23.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:23.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:23.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:23.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:23.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:23.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:23.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:23.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:23.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:23.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:23.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:23.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:23.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:23.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:23.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:23.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:23.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:23.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:23.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 14w REG 8,1 123795593 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:23.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:23.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:23.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:23.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:23.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:23.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:23.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:23.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:23.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:23.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:23.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:23.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:23.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:23.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:23.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:23.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:23.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:23.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:23.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:23.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:23.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:23.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:23.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:23.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:23.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:23.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:23.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:23.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:23.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:23.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:23.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:23.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:23.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:23.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:23.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:23.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:23.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:23.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:23.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:23.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:23.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:23.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:23.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:23.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:23.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121641 tp_osd_tp root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:23.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:23.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:23.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:23.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:23.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:23.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:23.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:23.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:23.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:23.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:23.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:23.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:23.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:23.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:23.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:23.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:23.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:23.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:23.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:23.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:23.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:23.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:23.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:23.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:23.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:23.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:23.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:23.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:23.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:23.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:23.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:23.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:23.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:23.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:23.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:23.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:23.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:23.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:23.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:23.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:23.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:23.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:23.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:23.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:23.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:23.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:23.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:23.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:23.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:23.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:23.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:23.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:23.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:23.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:23.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:23.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:23.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:23.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:23.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:23.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:23.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:23.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:23.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:23.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:23.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:23.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:23.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:23.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:23.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:23.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:23.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:23.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:23.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:23.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:23.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:23.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:23.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:23.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:23.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:23.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:23.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:23.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:23.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:23.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:23.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:23.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:23.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:23.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:23.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 14w REG 8,1 123795593 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:23.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:23.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:23.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:23.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:23.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:23.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:23.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:23.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:23.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:23.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:23.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:23.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:23.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:23.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:23.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:23.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:23.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:23.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:23.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:23.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:23.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:23.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:24.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:24.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:24.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:24.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:24.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:24.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:24.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:24.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:24.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:24.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:24.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:24.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:24.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:24.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:24.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:24.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:24.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:24.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:24.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:24.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:24.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:24.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:24.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:24.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:24.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:24.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:24.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:24.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:24.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121642 tp_osd_tp root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:24.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:24.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:24.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:24.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:24.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:24.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:24.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:24.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:24.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:24.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:24.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:24.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:24.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:24.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:24.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:24.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:24.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:24.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:24.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:24.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:24.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:24.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:24.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:24.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:24.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:24.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:24.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:24.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:24.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:24.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:24.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:24.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:24.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:24.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:24.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:24.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:24.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:24.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:24.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:24.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:24.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:24.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:24.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:24.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:24.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:24.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:24.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:24.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:24.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:24.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:24.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:24.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:24.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:24.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:24.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:24.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:24.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:24.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:24.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:24.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:24.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:24.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:24.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:24.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:24.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:24.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:24.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:24.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:24.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:24.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:24.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:24.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:24.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:24.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:24.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:24.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:24.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:24.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:24.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:24.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:24.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:24.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:24.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:24.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:24.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:24.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:24.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:24.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:24.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:24.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:24.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:24.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:24.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 14w REG 8,1 123795593 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:24.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:24.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:24.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:24.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:24.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:24.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:24.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:24.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:24.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:24.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:24.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:24.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:24.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:24.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:24.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:24.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:24.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:24.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:24.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:24.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:24.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:24.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:24.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:24.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:24.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:24.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:24.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:24.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:24.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:24.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:24.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:24.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:24.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:24.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:24.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:24.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:24.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:24.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:24.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:24.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:24.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:24.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:24.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:24.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:24.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:24.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:24.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:24.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:24.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:24.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:24.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:24.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:24.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:24.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121643 tp_osd_tp root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:24.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:24.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:24.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:24.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:24.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:24.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:24.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:24.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:24.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:24.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:24.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:24.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:24.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:24.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:24.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:24.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:24.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:24.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:24.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:24.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:24.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:24.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:24.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:24.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:24.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:24.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:24.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:24.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:24.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:24.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:24.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:24.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:24.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:24.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:24.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:24.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:24.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:24.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:24.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:24.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:24.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:24.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:24.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:24.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:24.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:24.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:24.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:24.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:24.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:24.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:24.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:24.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:24.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:24.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:24.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:24.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:24.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:24.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:24.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:24.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:24.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:24.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:24.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:24.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:24.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:24.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:24.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:24.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:24.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:24.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:24.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:24.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:24.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:24.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:24.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:24.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:24.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:24.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:24.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:24.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:24.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:24.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:24.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:24.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:24.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:24.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:24.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:24.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:24.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:24.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:24.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:24.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:24.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 14w REG 8,1 123795876 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:24.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:24.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:24.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:24.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:24.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:24.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:24.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:24.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:24.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:24.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:24.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:24.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:24.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:24.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:24.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:24.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:24.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:24.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:24.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:24.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:24.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:24.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:24.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:24.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:24.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:24.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:24.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:24.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:24.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:24.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:24.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:24.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:24.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:24.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:24.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:24.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:24.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:24.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:24.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:24.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:24.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:24.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:24.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:24.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:24.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:24.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:24.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:24.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:24.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:24.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:24.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:24.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:24.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:24.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121644 tp_osd_tp root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:24.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:24.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:24.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:24.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:24.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:24.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:24.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:24.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:24.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:24.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:24.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:24.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:24.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:24.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:24.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:24.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:24.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:24.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:24.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:24.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:24.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:24.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:24.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:24.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:24.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:24.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:24.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:24.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:24.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:24.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:24.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:24.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:24.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:24.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:24.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:24.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:24.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:24.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:24.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:24.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:24.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:24.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:24.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:24.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:24.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:24.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:24.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:24.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:24.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:24.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:24.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:24.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:24.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:24.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:24.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:24.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:24.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:24.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:24.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:24.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:24.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:24.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:24.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:24.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:24.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:24.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:24.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:24.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:24.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:24.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:24.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:24.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:24.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:24.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:24.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:24.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:24.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:24.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:24.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:24.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:24.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:24.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:24.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:24.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:24.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:24.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:24.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:24.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:24.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:24.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:24.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:24.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:24.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 14w REG 8,1 123795876 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:24.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:24.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:24.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:24.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:24.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:24.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:24.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:24.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:24.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:24.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:24.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:24.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:24.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:24.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:24.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:24.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:24.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:24.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:24.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:24.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:24.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:24.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:24.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:24.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:24.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:24.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:24.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:24.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:24.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:24.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:24.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:24.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:24.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:24.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:24.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:24.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:24.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:24.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:24.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:24.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:24.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:24.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:24.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:24.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:24.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:24.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:24.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:24.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:24.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:24.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:24.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:24.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:24.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:24.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121645 tp_osd_tp root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:24.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:24.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:24.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:24.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:24.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:24.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:24.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:24.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:24.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:24.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:24.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:24.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:24.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:24.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:24.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:24.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:24.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:24.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:24.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:24.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:24.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:24.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:24.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:24.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:24.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:24.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:24.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:24.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:24.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:24.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:24.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:24.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:24.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:24.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:24.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:24.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:24.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:24.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:24.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:24.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:24.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:24.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:24.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:24.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:24.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:24.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:24.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:24.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:24.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:24.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:24.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:24.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:24.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:24.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:24.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:24.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:24.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:24.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:24.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:24.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:24.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:24.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:24.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:24.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:24.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:24.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:24.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:24.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:24.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:24.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:24.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:24.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:24.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:24.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:24.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:24.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:24.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:24.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:24.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:24.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:24.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:24.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:24.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:24.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:24.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:24.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:24.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:24.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:24.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:24.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:24.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:24.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:24.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 14w REG 8,1 123795876 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:24.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:24.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:24.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:24.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:24.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:24.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:24.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:24.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:24.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:24.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:24.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:24.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:24.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:24.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:24.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:24.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:24.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:24.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:24.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:24.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:24.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:24.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:24.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:24.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:24.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:24.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:24.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:24.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:24.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:24.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:24.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:24.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:24.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:24.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:24.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:24.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:24.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:24.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:24.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:24.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:24.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:24.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:24.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:24.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:24.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:24.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:24.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:24.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:24.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:24.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:24.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:24.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:24.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:24.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121646 tp_osd_tp root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:24.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:24.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:24.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:24.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:24.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:24.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:24.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:24.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:24.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:24.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:24.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:24.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:24.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:24.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:24.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:24.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:24.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:24.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:24.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:24.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:24.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:24.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:24.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:24.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:24.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root DEL REG 0,17 214136 /[aio] 2023-11-04T01:48:24.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root DEL REG 0,17 214134 /[aio] 2023-11-04T01:48:24.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:24.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:24.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:24.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:24.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:24.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:24.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:24.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:24.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:24.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:24.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:24.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:24.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:24.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:24.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:24.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:24.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:24.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:24.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:24.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:24.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:24.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:24.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:24.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:24.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:24.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:24.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:24.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:24.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:24.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:24.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:24.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:24.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:24.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:24.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:24.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:24.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:24.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:24.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:24.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:24.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:24.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:24.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:24.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:24.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:24.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:24.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:24.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:24.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:24.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:24.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:24.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:24.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:24.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 1w FIFO 0,13 0t0 211068 pipe 2023-11-04T01:48:24.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 2w FIFO 0,13 0t0 211069 pipe 2023-11-04T01:48:24.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 3r FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:24.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 4w FIFO 0,13 0t0 211132 pipe 2023-11-04T01:48:24.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,70,73,76,79,81,84,88,91,94,97,101] 2023-11-04T01:48:24.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 6r FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:24.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 7w FIFO 0,13 0t0 211134 pipe 2023-11-04T01:48:24.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,68,71,74,78,82,83,85,89,92,95,98] 2023-11-04T01:48:24.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 9r FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:24.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 10w FIFO 0,13 0t0 211135 pipe 2023-11-04T01:48:24.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 11u a_inode 0,14 0 3100 [eventpoll:12,61,66,69,72,75,77,80,86,87,90,93,96,99] 2023-11-04T01:48:24.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 12r FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:24.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 13w FIFO 0,13 0t0 211136 pipe 2023-11-04T01:48:24.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 14w REG 8,1 123795876 265462 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:48:24.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 15uW REG 0,24 7 1747 /run/ceph/ceph-osd.2.pid 2023-11-04T01:48:24.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 16r FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:24.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 17w FIFO 0,13 0t0 210432 pipe 2023-11-04T01:48:24.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 18u unix 0xffff9ba9201edd80 0t0 210433 /var/run/ceph/ceph-osd.2.asok type=STREAM (LISTEN) 2023-11-04T01:48:24.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 19u IPv4 209837 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:48:24.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 20u IPv4 209854 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:48:24.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 21u IPv4 210506 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:48:24.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 22u IPv4 210526 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:48:24.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 23u IPv4 210547 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:48:24.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 24u IPv4 210569 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:48:24.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 25u IPv4 210592 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:48:24.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 26u IPv4 210616 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:48:24.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 27r FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:24.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 28w FIFO 0,13 0t0 211141 pipe 2023-11-04T01:48:24.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 29r FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:24.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 30w FIFO 0,13 0t0 211142 pipe 2023-11-04T01:48:24.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 31u sock 0,8 0t0 209870 protocol: UDPv6 2023-11-04T01:48:24.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:48:24.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:48:24.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:48:24.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 58u IPv4 210646 0t0 TCP smithi077.front.sepia.ceph.com:44734->smithi122.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:48:24.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 59r FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:24.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 60w FIFO 0,13 0t0 205811 pipe 2023-11-04T01:48:24.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 61u IPv4 209884 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56876 (ESTABLISHED) 2023-11-04T01:48:24.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 62r FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:24.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 63w FIFO 0,13 0t0 205812 pipe 2023-11-04T01:48:24.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 64u IPv4 209887 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45752 (ESTABLISHED) 2023-11-04T01:48:24.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 65u IPv4 211183 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45760 (ESTABLISHED) 2023-11-04T01:48:24.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 66u IPv4 211184 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi077.front.sepia.ceph.com:45770 (ESTABLISHED) 2023-11-04T01:48:24.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 67u IPv4 211187 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56886 (ESTABLISHED) 2023-11-04T01:48:24.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 68u IPv4 211188 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi077.front.sepia.ceph.com:56898 (ESTABLISHED) 2023-11-04T01:48:24.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 69u IPv4 211191 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51078 (ESTABLISHED) 2023-11-04T01:48:24.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 70u IPv4 211194 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44182 (ESTABLISHED) 2023-11-04T01:48:24.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 71u IPv4 211197 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44194 (ESTABLISHED) 2023-11-04T01:48:24.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 72u IPv4 211200 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51088 (ESTABLISHED) 2023-11-04T01:48:24.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 73u IPv4 209891 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51104 (ESTABLISHED) 2023-11-04T01:48:24.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 74u IPv4 211206 0t0 TCP smithi077.front.sepia.ceph.com:48736->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:24.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 75u IPv4 214196 0t0 TCP smithi077.front.sepia.ceph.com:58174->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:24.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 76u IPv4 209894 0t0 TCP smithi077.front.sepia.ceph.com:47172->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 77u IPv4 214197 0t0 TCP smithi077.front.sepia.ceph.com:53198->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 78u IPv4 211207 0t0 TCP smithi077.front.sepia.ceph.com:56790->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 79u IPv4 209895 0t0 TCP smithi077.front.sepia.ceph.com:48040->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 80u IPv4 214198 0t0 TCP smithi077.front.sepia.ceph.com:47184->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:24.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 81u IPv4 209896 0t0 TCP smithi077.front.sepia.ceph.com:48770->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:24.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 82u IPv4 211208 0t0 TCP smithi077.front.sepia.ceph.com:35112->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:24.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 83u IPv4 211209 0t0 TCP smithi077.front.sepia.ceph.com:57742->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 84u IPv4 209897 0t0 TCP smithi077.front.sepia.ceph.com:40094->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 85u IPv4 211210 0t0 TCP smithi077.front.sepia.ceph.com:45202->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:24.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 86u IPv4 215075 0t0 TCP smithi077.front.sepia.ceph.com:48536->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 87u IPv4 215076 0t0 TCP smithi077.front.sepia.ceph.com:45472->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 88u IPv4 210670 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44202 (ESTABLISHED) 2023-11-04T01:48:24.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 89u IPv4 210673 0t0 TCP smithi077.front.sepia.ceph.com:56890->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:24.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 90u IPv4 211211 0t0 TCP smithi077.front.sepia.ceph.com:6820->smithi122.front.sepia.ceph.com:44212 (ESTABLISHED) 2023-11-04T01:48:24.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 91u IPv4 214202 0t0 TCP smithi077.front.sepia.ceph.com:6822->smithi122.front.sepia.ceph.com:51116 (ESTABLISHED) 2023-11-04T01:48:24.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 92u IPv4 212411 0t0 TCP smithi077.front.sepia.ceph.com:36276->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:24.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 93u IPv4 211218 0t0 TCP smithi077.front.sepia.ceph.com:56030->smithi122.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:24.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 94u IPv4 203697 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:33626 (ESTABLISHED) 2023-11-04T01:48:24.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 95u IPv4 210678 0t0 TCP smithi077.front.sepia.ceph.com:57682->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:24.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 96u IPv4 213449 0t0 TCP smithi077.front.sepia.ceph.com:41018->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:24.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 97u IPv4 212416 0t0 TCP smithi077.front.sepia.ceph.com:56798->smithi077.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:48:24.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 98u IPv4 212479 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:54384 (ESTABLISHED) 2023-11-04T01:48:24.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 99u IPv4 282972 0t0 TCP smithi077.front.sepia.ceph.com:6814->smithi122.front.sepia.ceph.com:38184 (ESTABLISHED) 2023-11-04T01:48:24.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118537 121647 osd_srv_h root 101u IPv4 214234 0t0 TCP smithi077.front.sepia.ceph.com:6818->smithi122.front.sepia.ceph.com:snip-slave (ESTABLISHED) 2023-11-04T01:48:24.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:24.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:24.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:24.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:24.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:24.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:24.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:24.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:24.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:24.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:24.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:24.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:24.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:24.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:24.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:24.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:24.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:24.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:24.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:24.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:24.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:24.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:24.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:24.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:24.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:24.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:24.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:24.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:24.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:24.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:24.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:24.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:24.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:24.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:24.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:24.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:24.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:24.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:24.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:24.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:24.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:24.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:24.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:24.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:24.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:24.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:24.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:24.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:24.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:24.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:24.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:24.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:24.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:24.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:24.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:24.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:24.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:24.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:24.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:24.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:24.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:24.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:24.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:24.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:24.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:24.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:24.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:24.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:24.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:24.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:24.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:24.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:24.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:24.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:24.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:24.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:24.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:24.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:24.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:24.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:24.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:24.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:24.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:24.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:24.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 14w REG 8,1 130054010 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:24.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:24.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:24.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:24.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:24.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:24.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:24.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:24.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:24.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:24.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:24.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:24.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:24.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:24.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:24.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:24.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:24.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:24.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:24.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:24.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:24.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:24.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:24.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:24.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:24.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:24.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:24.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:24.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:24.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:24.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:24.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:24.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:24.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:24.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:24.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:24.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:24.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:24.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:24.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:24.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:24.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:24.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:24.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:24.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:24.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:24.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:24.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:24.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:24.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:24.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:24.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:24.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:24.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:24.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:24.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:24.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:24.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:24.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:24.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:24.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:24.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:24.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:24.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:24.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:24.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:24.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:24.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:24.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:24.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:24.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:24.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:24.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:24.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:24.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:24.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:24.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:24.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:24.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:24.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:24.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:24.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:24.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:24.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:24.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:24.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:24.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:24.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:24.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:24.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:24.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:24.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:24.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:24.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:24.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:24.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:24.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:24.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:24.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:24.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:24.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:24.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:24.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:24.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:24.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:24.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:24.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:24.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:24.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:24.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:24.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:24.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:24.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:24.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:24.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:24.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:24.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:24.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:24.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:24.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:24.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:24.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:24.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:24.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:24.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:24.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:24.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:24.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 14w REG 8,1 130050332 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:24.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:24.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:24.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:24.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:24.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:24.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:24.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:24.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:24.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:24.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:24.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:24.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:24.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:24.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:24.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:24.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:24.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:24.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:24.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:24.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:24.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:24.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:24.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:24.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:24.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:24.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:24.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:24.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:24.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:24.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:24.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:24.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:24.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:24.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:24.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:24.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:24.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:24.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:24.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:24.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:24.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:24.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118561 log root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:24.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:24.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:24.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:24.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:24.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:24.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:24.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:24.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:24.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:24.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:24.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:24.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:24.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:24.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:24.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:24.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:24.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:24.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:24.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:24.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:24.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:24.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:24.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:24.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:24.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:24.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:24.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:24.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:24.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:24.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:24.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:24.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:24.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:24.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:24.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:24.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:24.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:24.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:24.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:24.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:24.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:24.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:24.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:24.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:24.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:24.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:24.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:24.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:24.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:24.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:24.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:24.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:24.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:24.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:24.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:24.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:24.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:24.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:24.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:24.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:24.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:24.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:24.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:24.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:24.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:24.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:24.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:24.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:24.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:24.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:24.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:24.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:24.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:24.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:24.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:24.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:24.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:24.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:24.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:24.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:24.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:24.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:24.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:24.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:24.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 14w REG 8,1 130050332 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:24.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:24.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:24.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:24.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:24.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:24.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:24.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:24.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:24.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:24.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:24.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:24.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:24.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:24.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:24.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:24.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:24.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:24.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:24.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:24.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:24.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:24.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:24.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:24.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:24.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:24.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:24.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:24.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:24.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:24.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:24.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:24.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:24.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:24.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:24.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:24.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:24.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:24.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:24.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:24.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:24.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:24.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118564 msgr-work root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:24.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:24.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:24.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:24.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:24.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:24.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:24.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:24.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:24.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:24.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:24.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:24.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:24.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:24.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:24.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:24.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:24.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:24.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:24.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:24.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:24.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:24.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:24.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:24.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:24.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:24.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:24.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:24.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:24.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:24.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:24.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:24.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:24.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:24.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:24.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:24.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:24.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:24.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:24.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:24.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:24.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:24.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:24.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:24.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:24.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:24.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:24.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:24.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:24.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:24.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:24.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:24.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:24.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:24.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:24.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:24.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:24.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:24.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:24.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:24.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:24.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:24.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:24.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:24.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:24.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:24.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:24.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:24.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:24.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:24.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:24.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:24.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:24.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:24.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:24.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:24.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:24.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:24.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:24.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:24.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:24.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:24.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:24.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:24.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:24.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 14w REG 8,1 130050332 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:24.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:24.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:24.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:24.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:24.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:24.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:24.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:24.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:24.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:24.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:24.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:24.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:24.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:24.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:24.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:24.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:24.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:24.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:24.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:24.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:24.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:24.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:24.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:24.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:24.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:24.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:24.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:24.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:24.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:24.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:24.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:24.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:24.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:24.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:24.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:24.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:24.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:24.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:24.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:24.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:24.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:24.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118565 msgr-work root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:24.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:24.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:24.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:24.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:24.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:24.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:24.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:24.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:24.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:24.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:24.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:24.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:24.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:24.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:24.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:24.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:24.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:24.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:24.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:24.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:24.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:24.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:24.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:24.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:24.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:24.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:24.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:24.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:24.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:24.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:24.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:24.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:24.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:24.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:24.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:24.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:24.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:24.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:24.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:24.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:24.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:24.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:24.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:24.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:24.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:24.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:24.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:24.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:24.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:24.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:24.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:24.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:24.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:24.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:24.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:24.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:24.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:24.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:24.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:24.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:24.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:24.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:24.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:24.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:24.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:24.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:24.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:24.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:24.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:24.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:24.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:24.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:24.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:24.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:24.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:24.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:24.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:24.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:24.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:24.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:24.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:24.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:24.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:24.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:24.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 14w REG 8,1 130050332 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:24.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:24.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:24.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:24.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:24.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:24.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:24.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:24.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:24.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:24.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:24.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:24.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:24.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:24.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:24.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:24.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:24.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:24.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:24.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:24.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:24.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:24.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:24.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:24.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:24.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:24.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:24.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:24.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:24.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:24.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:24.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:24.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:24.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:24.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:24.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:24.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:24.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:24.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:24.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:24.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:24.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:24.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118566 msgr-work root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:24.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:24.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:24.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:24.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:24.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:24.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:24.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:24.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:24.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:24.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:24.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:24.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:24.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:24.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:24.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:24.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:24.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:24.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:24.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:24.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:24.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:24.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:24.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:24.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:24.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:24.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:24.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:24.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:24.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:24.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:24.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:24.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:24.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:24.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:24.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:24.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:24.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:24.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:24.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:24.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:24.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:24.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:24.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:24.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:24.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:24.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:24.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:24.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:24.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:24.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:24.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:24.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:24.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:24.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:24.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:24.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:24.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:24.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:24.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:24.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:24.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:24.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:24.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:24.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:24.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:24.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:24.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:24.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:24.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:24.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:24.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:24.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:24.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:24.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:24.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:24.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:24.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:24.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:24.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:24.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:24.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:24.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:24.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:24.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:24.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 14w REG 8,1 130050332 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:24.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:24.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:24.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:24.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:24.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:24.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:24.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:24.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:24.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:24.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:24.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:24.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:24.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:24.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:24.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:24.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:24.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:24.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:24.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:24.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:24.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:24.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:24.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:24.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:24.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:24.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:24.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:24.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:24.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:24.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:24.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:24.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:24.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:24.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:24.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:24.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:24.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:24.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:24.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:24.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:24.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:24.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118572 service root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:24.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:24.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:24.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:24.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:24.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:24.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:24.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:24.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:24.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:24.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:24.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:24.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:24.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:24.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:24.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:24.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:24.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:24.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:24.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:24.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:24.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:24.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:24.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:24.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:24.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:24.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:24.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:24.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:24.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:24.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:24.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:24.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:24.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:24.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:24.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:24.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:24.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:24.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:24.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:24.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:24.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:24.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:24.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:24.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:24.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:24.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:24.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:24.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:24.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:24.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:24.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:24.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:24.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:24.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:24.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:24.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:24.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:24.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:24.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:24.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:24.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:24.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:24.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:24.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:24.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:24.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:24.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:24.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:24.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:24.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:24.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:24.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:24.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:24.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:24.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:24.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:24.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:24.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:24.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:24.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:24.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:24.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:24.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:24.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:24.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 14w REG 8,1 130050332 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:24.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:24.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:24.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:24.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:24.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:24.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:24.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:24.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:24.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:24.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:24.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:24.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:24.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:24.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:24.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:24.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:24.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:24.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:24.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:24.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:24.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:24.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:24.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:24.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:24.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:24.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:24.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:24.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:24.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:24.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:24.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:24.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:24.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:24.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:24.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:24.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:24.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:24.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:24.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:24.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:24.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:24.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118573 admin_soc root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:24.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:24.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:24.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:24.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:24.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:24.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:24.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:24.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:24.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:24.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:24.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:24.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:24.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:24.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:24.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:24.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:24.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:24.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:24.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:24.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:24.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:24.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:24.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:24.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:24.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:24.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:24.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:24.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:24.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:24.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:24.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:24.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:24.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:24.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:24.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:24.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:24.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:24.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:24.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:24.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:24.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:24.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:24.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:24.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:24.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:24.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:24.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:24.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:24.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:24.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:24.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:24.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:24.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:24.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:24.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:24.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:24.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:24.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:24.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:24.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:24.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:24.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:24.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:24.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:24.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:24.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:24.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:24.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:24.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:24.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:24.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:24.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:24.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:24.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:24.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:24.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:24.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:24.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:24.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:24.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:24.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:24.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:24.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:24.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:24.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 14w REG 8,1 130050332 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:24.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:24.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:24.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:24.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:24.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:24.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:24.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:24.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:24.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:24.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:24.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:24.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:24.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:24.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:24.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:24.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:24.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:24.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:24.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:24.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:24.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:24.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:24.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:24.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:24.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:24.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:24.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:24.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:24.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:24.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:24.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:24.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:24.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:24.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:24.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:24.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:24.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:24.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:24.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:24.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:24.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:24.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118610 signal_ha root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:24.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:24.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:24.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:24.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:24.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:24.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:24.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:24.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:24.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:24.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:24.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:24.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:24.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:24.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:24.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:24.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:24.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:24.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:24.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:24.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:24.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:24.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:24.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:24.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:24.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:24.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:24.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:24.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:24.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:24.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:24.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:24.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:24.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:24.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:24.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:24.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:24.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:24.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:24.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:24.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:24.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:24.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:24.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:24.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:24.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:24.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:24.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:24.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:24.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:24.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:24.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:24.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:24.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:24.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:24.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:24.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:24.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:24.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:24.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:24.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:24.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:24.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:24.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:24.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:24.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:24.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:24.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:24.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:24.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:24.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:24.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:24.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:24.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:24.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:24.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:24.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:24.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:24.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:24.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:24.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:24.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:24.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:24.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:24.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:24.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 14w REG 8,1 130050332 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:24.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:24.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:24.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:24.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:24.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:24.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:24.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:24.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:24.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:24.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:24.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:24.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:24.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:24.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:24.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:24.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:24.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:24.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:24.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:24.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:24.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:24.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:24.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:24.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:24.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:24.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:24.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:24.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:24.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:24.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:24.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:24.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:24.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:24.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:24.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:24.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:24.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:24.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:24.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:24.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:24.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:24.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118611 io_contex root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:24.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:24.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:24.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:24.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:24.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:24.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:24.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:24.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:24.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:24.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:24.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:24.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:24.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:24.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:24.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:24.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:24.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:24.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:24.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:24.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:24.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:24.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:24.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:24.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:24.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:24.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:24.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:24.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:24.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:24.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:24.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:24.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:24.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:24.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:24.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:24.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:24.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:24.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:24.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:24.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:24.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:24.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:24.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:24.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:24.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:24.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:24.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:24.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:24.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:24.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:24.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:24.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:24.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:24.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:24.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:24.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:24.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:24.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:24.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:24.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:24.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:24.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:24.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:24.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:24.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:24.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:24.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:24.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:24.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:24.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:24.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:24.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:24.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:24.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:24.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:24.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:24.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:24.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:24.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:24.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:24.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:24.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:24.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:24.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:24.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 14w REG 8,1 130050332 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:24.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:24.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:24.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:24.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:24.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:24.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:24.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:24.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:24.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:24.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:24.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:24.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:24.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:24.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:24.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:24.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:24.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:24.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:24.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:24.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:24.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:24.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:24.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:24.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:24.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:24.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:24.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:24.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:24.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:24.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:24.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:24.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:24.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:24.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:24.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:24.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:24.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:24.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:24.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:24.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:24.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:24.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118612 io_contex root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:24.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:24.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:24.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:24.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:24.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:24.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:24.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:24.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:24.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:24.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:24.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:24.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:24.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:24.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:24.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:24.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:24.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:24.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:24.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:24.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:24.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:24.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:24.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:24.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:24.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:24.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:24.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:24.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:24.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:24.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:24.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:24.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:24.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:24.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:24.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:24.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:24.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:24.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:24.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:24.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:24.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:24.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:24.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:24.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:24.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:24.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:24.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:24.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:24.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:24.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:24.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:24.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:24.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:24.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:24.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:24.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:24.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:24.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:24.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:24.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:24.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:24.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:24.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:24.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:24.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:24.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:24.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:24.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:24.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:24.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:24.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:24.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:24.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:24.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:24.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:24.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:24.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:24.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:24.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:24.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:24.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:24.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:24.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:24.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:24.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 14w REG 8,1 130050332 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:24.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:24.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:24.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:24.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:24.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:24.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:24.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:24.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:24.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:24.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:24.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:24.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:24.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:24.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:24.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:24.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:24.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:24.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:24.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:24.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:24.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:24.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:24.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:24.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:24.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:24.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:24.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:24.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:24.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:24.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:24.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:24.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:24.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:24.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:24.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:24.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:24.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:24.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:24.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:24.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:24.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:24.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118627 OpHistory root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:24.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:24.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:24.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:24.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:24.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:24.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:24.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:24.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:24.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:24.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:24.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:24.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:24.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:24.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:24.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:24.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:24.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:24.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:24.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:24.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:24.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:24.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:24.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:24.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:24.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:24.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:24.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:24.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:24.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:24.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:24.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:24.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:24.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:24.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:24.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:24.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:24.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:24.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:24.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:24.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:24.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:24.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:24.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:24.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:24.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:24.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:24.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:24.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:24.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:24.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:24.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:24.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:24.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:24.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:24.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:24.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:24.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:24.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:24.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:24.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:24.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:24.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:24.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:24.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:24.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:24.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:24.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:24.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:24.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:24.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:24.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:24.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:24.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:24.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:24.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:24.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:24.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:24.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:24.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:24.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:24.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:24.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:24.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:24.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:24.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 14w REG 8,1 130050332 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:24.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:24.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:24.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:24.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:24.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:24.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:24.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:24.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:24.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:24.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:24.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:24.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:24.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:24.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:24.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:24.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:24.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:24.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:24.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:24.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:24.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:24.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:24.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:24.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:24.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:24.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:24.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:24.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:24.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:24.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:24.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:24.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:24.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:24.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:24.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:24.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:24.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:24.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:24.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:24.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:24.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:24.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118629 ceph_time root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:24.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:24.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:24.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:24.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:24.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:24.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:24.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:24.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:24.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:24.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:24.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:24.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:24.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:24.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:24.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:24.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:24.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:24.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:24.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:24.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:24.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:24.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:24.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:24.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:24.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:24.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:24.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:24.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:24.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:24.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:24.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:24.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:24.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:24.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:24.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:24.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:24.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:24.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:24.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:24.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:24.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:24.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:24.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:24.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:24.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:24.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:24.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:24.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:24.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:24.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:24.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:24.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:24.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:24.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:24.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:24.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:24.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:24.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:24.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:24.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:24.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:24.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:24.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:24.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:24.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:24.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:24.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:24.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:24.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:24.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:24.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:24.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:24.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:24.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:24.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:24.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:24.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:24.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:24.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:24.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:24.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:24.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:24.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:24.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:24.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 14w REG 8,1 130050332 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:24.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:24.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:24.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:24.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:24.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:24.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:24.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:24.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:24.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:24.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:24.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:24.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:24.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:24.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:24.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:24.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:24.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:24.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:24.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:24.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:24.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:24.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:24.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:24.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:24.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:24.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:24.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:24.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:24.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:24.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:24.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:24.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:24.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:24.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:24.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:24.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:24.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:24.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:24.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:24.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:24.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:24.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118676 ceph-osd root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:24.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:24.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:24.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:24.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:24.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:24.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:24.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:24.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:24.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:24.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:24.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:24.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:24.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:24.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:24.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:24.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:24.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:24.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:24.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:24.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:24.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:24.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:24.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:24.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:24.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:24.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:24.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:24.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:24.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:24.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:24.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:24.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:24.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:24.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:24.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:24.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:24.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:24.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:24.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:24.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:24.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:24.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:24.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:24.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:24.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:24.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:24.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:24.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:24.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:24.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:24.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:24.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:24.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:24.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:24.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:24.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:24.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:24.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:24.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:24.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:24.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:24.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:24.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:24.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:24.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:24.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:24.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:24.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:24.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:24.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:24.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:24.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:24.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:24.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:24.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:24.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:24.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:24.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:24.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:24.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:24.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:24.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:24.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:24.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:24.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 14w REG 8,1 130050332 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:24.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:24.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:24.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:24.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:24.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:24.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:24.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:24.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:24.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:24.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:24.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:24.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:24.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:24.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:24.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:24.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:24.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:24.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:24.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:24.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:24.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:24.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:24.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:24.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:24.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:24.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:24.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:24.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:24.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:24.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:24.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:24.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:24.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:24.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:24.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:24.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:24.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:24.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:24.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:24.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:24.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:24.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118686 ceph-osd root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:24.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:24.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:24.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:24.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:24.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:24.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:24.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:24.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:24.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:24.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:24.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:24.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:24.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:24.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:24.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:24.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:24.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:24.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:24.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:24.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:24.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:24.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:24.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:24.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:24.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:24.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:24.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:24.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:24.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:24.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:24.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:24.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:24.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:24.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:24.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:24.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:24.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:24.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:24.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:24.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:24.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:24.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:24.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:24.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:24.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:24.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:24.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:24.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:24.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:24.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:24.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:24.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:24.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:24.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:24.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:24.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:24.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:24.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:24.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:24.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:24.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:24.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:24.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:24.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:24.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:24.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:24.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:24.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:24.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:24.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:24.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:24.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:24.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:24.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:24.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:24.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:24.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:24.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:24.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:24.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:24.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:24.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:24.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:24.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:24.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 14w REG 8,1 130050332 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:24.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:24.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:24.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:24.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:24.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:24.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:24.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:24.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:24.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:24.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:24.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:24.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:24.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:24.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:24.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:24.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:24.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:24.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:24.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:24.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:24.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:24.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:24.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:24.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:24.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:24.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:24.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:24.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:24.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:24.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:24.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:24.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:24.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:24.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:24.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:24.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:24.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:24.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:24.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:24.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:24.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:24.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118695 ceph-osd root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:24.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:24.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:24.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:24.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:24.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:24.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:24.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:24.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:24.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:24.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:24.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:24.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:24.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:24.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:24.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:24.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:24.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:24.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:24.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:24.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:24.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:24.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:24.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:24.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:24.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:24.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:24.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:24.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:24.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:24.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:24.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:24.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:24.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:24.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:24.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:24.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:24.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:24.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:24.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:24.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:24.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:24.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:24.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:24.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:24.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:24.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:24.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:24.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:24.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:24.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:24.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:24.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:24.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:24.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:24.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:24.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:24.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:24.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:24.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:24.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:24.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:24.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:24.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:24.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:24.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:24.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:24.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:24.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:24.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:24.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:24.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:24.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:24.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:24.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:24.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:24.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:24.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:24.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:24.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:24.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:24.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:24.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:24.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:24.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:24.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 14w REG 8,1 130050332 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:24.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:24.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:24.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:24.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:24.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:24.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:24.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:24.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:24.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:24.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:24.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:24.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:24.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:24.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:24.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:24.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:24.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:24.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:24.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:24.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:24.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:24.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:24.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:24.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:24.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:24.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:24.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:24.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:24.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:24.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:24.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:24.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:24.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:24.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:24.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:24.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:24.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:24.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:24.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:24.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:24.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:24.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118714 ceph-osd root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:24.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:24.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:24.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:24.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:24.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:24.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:24.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:24.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:24.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:24.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:24.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:24.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:24.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:24.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:24.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:24.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:24.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:24.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:24.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:24.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:24.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:24.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:24.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:24.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:24.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:24.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:24.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:24.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:24.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:24.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:24.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:24.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:24.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:24.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:24.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:24.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:24.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:24.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:24.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:24.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:24.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:24.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:24.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:24.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:24.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:24.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:24.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:24.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:24.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:24.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:24.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:24.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:24.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:24.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:24.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:24.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:24.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:24.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:24.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:24.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:24.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:24.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:24.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:24.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:24.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:24.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:24.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:24.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:24.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:24.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:24.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:24.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:24.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:24.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:24.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:24.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:24.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:24.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:24.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:24.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:24.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:24.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:24.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:24.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:24.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 14w REG 8,1 130050332 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:24.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:24.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:24.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:24.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:24.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:24.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:24.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:24.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:24.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:24.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:24.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:24.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:24.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:24.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:24.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:24.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:24.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:24.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:24.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:24.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:24.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:24.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:24.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:24.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:24.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:24.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:24.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:24.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:24.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:24.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:24.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:24.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:24.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:24.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:24.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:24.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:24.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:24.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:24.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:24.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:24.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:24.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118720 ceph-osd root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:24.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:24.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:24.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:24.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:24.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:24.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:24.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:24.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:24.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:24.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:24.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:24.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:24.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:24.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:24.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:24.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:24.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:24.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:24.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:24.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:24.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:24.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:24.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:24.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:24.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:24.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:24.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:24.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:24.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:24.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:24.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:24.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:24.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:24.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:24.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:24.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:24.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:24.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:24.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:24.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:24.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:24.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:24.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:24.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:24.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:24.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:24.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:24.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:24.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:24.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:24.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:24.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:24.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:24.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:24.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:24.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:24.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:24.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:24.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:24.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:24.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:24.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:24.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:24.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:24.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:24.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:24.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:24.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:24.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:24.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:24.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:24.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:24.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:24.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:24.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:24.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:24.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:24.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:24.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:24.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:24.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:24.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:24.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:24.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:24.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 14w REG 8,1 130050545 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:24.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:24.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:24.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:24.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:24.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:24.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:24.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:24.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:24.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:24.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:24.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:24.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:24.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:24.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:24.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:24.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:24.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:24.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:24.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:24.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:24.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:24.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:24.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:24.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:24.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:24.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:24.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:24.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:24.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:24.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:24.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:24.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:24.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:24.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:24.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:24.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:24.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:24.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:24.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:24.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:24.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:24.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118730 ceph-osd root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:24.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:24.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:24.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:24.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:24.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:24.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:24.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:24.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:24.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:24.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:24.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:24.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:24.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:24.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:24.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:24.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:24.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:24.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:24.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:24.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:24.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:24.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:24.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:24.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:24.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:24.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:24.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:24.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:24.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:24.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:24.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:24.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:24.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:24.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:24.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:24.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:24.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:24.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:24.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:24.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:24.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:24.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:24.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:24.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:24.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:24.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:24.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:24.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:24.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:24.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:24.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:24.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:24.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:24.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:24.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:24.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:24.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:24.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:24.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:24.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:24.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:24.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:24.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:24.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:24.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:24.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:24.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:24.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:24.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:24.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:24.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:24.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:24.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:24.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:24.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:24.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:24.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:24.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:24.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:24.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:24.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:24.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:24.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:24.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:24.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 14w REG 8,1 130050545 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:24.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:24.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:24.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:24.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:24.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:24.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:24.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:24.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:24.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:24.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:24.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:24.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:24.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:24.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:24.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:24.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:24.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:24.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:24.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:24.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:24.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:24.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:24.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:24.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:24.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:24.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:24.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:24.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:24.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:24.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:24.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:24.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:24.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:24.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:24.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:24.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:24.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:24.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:24.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:24.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:24.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:24.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118738 ceph-osd root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:24.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:24.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:24.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:24.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:24.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:24.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:24.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:24.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:24.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:24.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:24.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:24.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:24.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:24.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:24.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:24.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:24.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:24.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:24.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:24.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:24.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:24.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:24.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:24.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:24.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:24.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:24.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:24.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:24.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:24.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:24.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:24.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:24.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:24.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:24.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:24.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:24.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:24.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:24.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:24.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:24.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:24.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:24.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:24.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:24.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:24.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:24.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:24.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:24.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:24.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:24.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:24.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:24.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:24.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:24.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:24.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:24.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:24.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:24.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:24.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:24.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:24.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:24.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:24.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:24.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:24.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:24.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:24.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:24.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:24.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:24.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:24.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:24.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:24.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:24.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:24.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:24.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:24.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:24.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:24.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:24.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:24.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:24.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:24.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:24.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 14w REG 8,1 130050545 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:24.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:24.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:24.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:24.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:24.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:24.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:24.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:24.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:24.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:24.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:24.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:24.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:24.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:24.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:24.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:24.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:24.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:24.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:24.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:24.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:24.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:24.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:24.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:24.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:24.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:24.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:24.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:24.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:24.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:24.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:24.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:24.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:24.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:24.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:24.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:24.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:24.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:24.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:24.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:24.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:24.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:24.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118937 ceph-osd root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:24.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:24.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:24.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:24.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:24.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:24.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:24.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:24.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:24.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:24.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:24.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:24.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:24.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:24.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:24.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:24.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:24.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:24.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:24.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:24.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:24.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:24.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:24.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:24.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:24.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:24.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:24.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:24.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:24.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:24.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:24.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:24.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:24.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:24.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:24.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:24.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:24.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:24.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:24.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:24.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:24.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:24.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:24.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:24.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:24.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:24.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:24.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:24.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:24.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:24.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:24.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:24.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:24.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:24.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:24.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:24.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:24.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:24.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:24.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:24.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:24.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:24.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:24.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:24.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:24.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:24.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:24.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:24.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:24.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:24.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:24.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:24.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:24.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:24.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:24.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:24.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:24.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:24.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:24.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:24.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:24.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:24.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:24.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:24.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:24.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 14w REG 8,1 130050545 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:24.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:24.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:24.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:24.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:24.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:24.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:24.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:24.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:24.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:24.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:24.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:24.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:24.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:24.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:24.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:24.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:24.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:24.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:24.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:24.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:24.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:24.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:24.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:24.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:24.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:24.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:24.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:24.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:24.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:24.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:24.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:24.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:24.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:24.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:24.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:24.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:24.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:24.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:24.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:24.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:24.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:24.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118938 ceph-osd root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:24.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:24.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:24.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:24.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:24.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:24.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:24.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:24.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:24.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:24.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:24.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:24.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:24.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:24.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:24.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:24.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:24.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:24.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:24.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:24.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:24.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:24.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:24.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:24.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:24.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:24.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:24.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:24.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:24.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:24.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:24.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:24.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:24.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:24.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:24.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:24.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:24.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:24.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:24.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:24.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:24.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:24.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:24.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:24.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:24.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:24.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:24.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:24.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:24.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:24.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:24.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:24.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:24.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:24.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:24.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:24.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:24.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:24.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:24.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:24.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:24.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:24.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:24.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:24.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:24.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:24.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:24.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:24.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:24.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:24.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:24.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:24.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:24.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:24.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:24.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:24.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:24.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:24.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:24.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:24.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:24.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:24.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:24.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:24.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:24.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 14w REG 8,1 130050545 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:24.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:24.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:24.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:24.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:24.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:24.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:24.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:24.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:24.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:24.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:24.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:24.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:24.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:24.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:24.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:24.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:24.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:24.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:24.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:24.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:24.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:24.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:24.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:24.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:24.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:24.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:24.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:24.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:24.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:24.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:24.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:24.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:24.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:24.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:24.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:24.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:24.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:24.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:24.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:24.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:24.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:24.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118939 safe_time root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:24.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:24.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:24.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:24.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:24.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:24.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:24.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:24.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:24.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:24.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:24.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:24.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:24.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:24.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:24.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:24.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:24.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:24.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:24.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:24.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:24.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:24.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:24.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:24.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:24.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:24.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:24.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:24.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:24.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:24.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:24.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:24.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:24.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:24.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:24.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:24.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:24.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:24.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:24.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:24.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:24.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:24.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:24.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:24.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:24.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:24.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:24.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:24.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:24.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:24.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:24.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:24.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:24.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:24.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:24.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:24.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:24.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:24.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:24.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:24.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:24.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:24.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:24.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:24.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:24.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:24.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:24.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:24.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:24.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:24.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:24.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:24.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:24.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:24.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:24.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:24.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:24.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:24.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:24.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:24.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:24.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:24.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:24.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:24.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:24.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 14w REG 8,1 130050828 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:24.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:24.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:24.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:24.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:24.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:24.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:24.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:24.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:24.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:24.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:24.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:24.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:24.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:24.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:24.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:24.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:24.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:24.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:24.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:24.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:24.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:24.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:24.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:24.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:24.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:24.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:24.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:24.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:24.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:24.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:24.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:24.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:24.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:24.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:24.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:24.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:24.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:24.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:24.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:24.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:24.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:24.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:24.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:24.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:24.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:24.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:24.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:24.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:24.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:24.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:24.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:24.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:24.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118940 safe_time root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:24.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:24.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:24.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:24.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:24.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:24.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:24.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:24.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:24.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:24.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:24.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:24.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:24.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:24.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:24.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:24.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:24.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:24.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:24.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:24.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:24.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:24.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:24.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:24.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:24.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:24.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:24.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:24.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:24.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:24.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:24.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:24.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:24.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:24.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:24.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:24.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:24.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:24.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:24.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:24.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:24.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:24.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:24.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:24.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:24.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:24.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:24.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:24.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:24.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:24.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:24.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:24.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:24.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:24.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:24.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:24.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:24.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:24.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:24.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:24.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:24.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:24.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:24.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:24.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:24.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:24.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:24.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:24.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:24.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:24.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:24.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:24.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:24.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:24.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:24.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:24.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:24.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:24.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:24.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:24.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:24.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:24.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:24.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:24.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:24.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:24.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:24.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:24.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:24.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 14w REG 8,1 130050828 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:25.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:25.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:25.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:25.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:25.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:25.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:25.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:25.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:25.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:25.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:25.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:25.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:25.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:25.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:25.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:25.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:25.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:25.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:25.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:25.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:25.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:25.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:25.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:25.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:25.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:25.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:25.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:25.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:25.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:25.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:25.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:25.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:25.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:25.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:25.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:25.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:25.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:25.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:25.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:25.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:25.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:25.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118941 safe_time root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:25.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:25.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:25.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:25.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:25.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:25.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:25.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:25.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:25.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:25.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:25.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:25.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:25.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:25.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:25.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:25.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:25.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:25.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:25.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:25.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:25.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:25.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:25.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:25.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:25.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:25.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:25.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:25.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:25.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:25.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:25.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:25.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:25.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:25.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:25.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:25.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:25.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:25.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:25.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:25.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:25.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:25.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:25.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:25.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:25.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:25.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:25.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:25.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:25.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:25.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:25.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:25.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:25.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:25.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:25.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:25.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:25.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:25.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:25.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:25.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:25.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:25.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:25.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:25.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:25.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:25.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:25.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:25.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:25.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:25.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:25.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:25.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:25.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:25.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:25.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:25.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:25.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:25.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:25.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:25.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:25.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:25.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:25.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:25.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:25.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 14w REG 8,1 130050828 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:25.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:25.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:25.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:25.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:25.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:25.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:25.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:25.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:25.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:25.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:25.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:25.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:25.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:25.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:25.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:25.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:25.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:25.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:25.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:25.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:25.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:25.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:25.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:25.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:25.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:25.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:25.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:25.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:25.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:25.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:25.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:25.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:25.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:25.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:25.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:25.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:25.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:25.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:25.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:25.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:25.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:25.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118942 safe_time root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:25.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:25.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:25.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:25.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:25.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:25.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:25.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:25.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:25.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:25.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:25.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:25.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:25.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:25.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:25.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:25.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:25.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:25.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:25.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:25.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:25.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:25.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:25.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:25.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:25.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:25.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:25.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:25.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:25.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:25.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:25.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:25.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:25.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:25.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:25.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:25.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:25.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:25.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:25.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:25.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:25.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:25.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:25.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:25.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:25.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:25.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:25.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:25.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:25.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:25.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:25.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:25.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:25.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:25.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:25.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:25.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:25.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:25.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:25.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:25.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:25.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:25.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:25.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:25.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:25.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:25.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:25.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:25.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:25.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:25.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:25.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:25.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:25.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:25.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:25.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:25.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:25.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:25.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:25.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:25.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:25.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:25.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:25.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:25.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:25.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 14w REG 8,1 130050828 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:25.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:25.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:25.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:25.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:25.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:25.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:25.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:25.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:25.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:25.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:25.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:25.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:25.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:25.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:25.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:25.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:25.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:25.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:25.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:25.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:25.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:25.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:25.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:25.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:25.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:25.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:25.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:25.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:25.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:25.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:25.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:25.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:25.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:25.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:25.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:25.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:25.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:25.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:25.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:25.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:25.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:25.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118943 fn_anonym root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:25.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:25.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:25.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:25.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:25.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:25.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:25.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:25.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:25.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:25.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:25.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:25.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:25.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:25.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:25.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:25.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:25.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:25.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:25.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:25.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:25.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:25.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:25.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:25.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:25.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:25.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:25.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:25.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:25.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:25.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:25.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:25.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:25.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:25.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:25.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:25.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:25.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:25.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:25.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:25.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:25.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:25.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:25.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:25.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:25.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:25.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:25.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:25.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:25.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:25.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:25.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:25.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:25.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:25.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:25.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:25.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:25.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:25.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:25.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:25.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:25.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:25.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:25.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:25.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:25.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:25.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:25.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:25.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:25.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:25.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:25.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:25.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:25.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:25.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:25.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:25.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:25.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:25.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:25.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:25.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:25.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:25.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:25.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:25.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:25.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 14w REG 8,1 130050828 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:25.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:25.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:25.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:25.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:25.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:25.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:25.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:25.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:25.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:25.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:25.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:25.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:25.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:25.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:25.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:25.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:25.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:25.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:25.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:25.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:25.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:25.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:25.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:25.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:25.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:25.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:25.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:25.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:25.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:25.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:25.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:25.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:25.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:25.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:25.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:25.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:25.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:25.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:25.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:25.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:25.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:25.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118955 rocksdb:l root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:25.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:25.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:25.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:25.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:25.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:25.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:25.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:25.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:25.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:25.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:25.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:25.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:25.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:25.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:25.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:25.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:25.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:25.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:25.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:25.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:25.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:25.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:25.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:25.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:25.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:25.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:25.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:25.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:25.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:25.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:25.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:25.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:25.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:25.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:25.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:25.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:25.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:25.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:25.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:25.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:25.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:25.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:25.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:25.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:25.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:25.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:25.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:25.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:25.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:25.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:25.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:25.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:25.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:25.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:25.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:25.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:25.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:25.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:25.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:25.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:25.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:25.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:25.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:25.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:25.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:25.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:25.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:25.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:25.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:25.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:25.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:25.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:25.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:25.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:25.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:25.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:25.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:25.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:25.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:25.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:25.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:25.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:25.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:25.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:25.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 14w REG 8,1 130050828 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:25.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:25.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:25.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:25.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:25.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:25.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:25.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:25.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:25.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:25.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:25.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:25.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:25.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:25.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:25.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:25.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:25.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:25.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:25.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:25.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:25.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:25.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:25.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:25.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:25.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:25.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:25.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:25.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:25.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:25.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:25.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:25.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:25.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:25.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:25.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:25.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:25.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:25.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:25.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:25.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:25.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:25.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118956 rocksdb:l root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:25.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:25.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:25.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:25.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:25.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:25.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:25.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:25.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:25.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:25.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:25.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:25.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:25.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:25.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:25.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:25.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:25.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:25.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:25.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:25.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:25.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:25.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:25.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:25.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:25.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:25.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:25.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:25.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:25.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:25.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:25.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:25.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:25.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:25.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:25.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:25.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:25.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:25.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:25.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:25.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:25.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:25.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:25.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:25.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:25.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:25.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:25.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:25.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:25.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:25.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:25.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:25.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:25.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:25.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:25.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:25.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:25.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:25.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:25.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:25.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:25.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:25.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:25.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:25.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:25.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:25.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:25.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:25.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:25.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:25.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:25.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:25.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:25.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:25.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:25.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:25.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:25.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:25.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:25.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:25.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:25.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:25.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:25.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:25.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:25.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 14w REG 8,1 130050828 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:25.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:25.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:25.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:25.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:25.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:25.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:25.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:25.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:25.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:25.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:25.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:25.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:25.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:25.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:25.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:25.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:25.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:25.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:25.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:25.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:25.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:25.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:25.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:25.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:25.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:25.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:25.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:25.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:25.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:25.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:25.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:25.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:25.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:25.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:25.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:25.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:25.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:25.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:25.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:25.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:25.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:25.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118957 rocksdb:l root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:25.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:25.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:25.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:25.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:25.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:25.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:25.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:25.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:25.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:25.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:25.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:25.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:25.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:25.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:25.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:25.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:25.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:25.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:25.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:25.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:25.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:25.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:25.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:25.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:25.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:25.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:25.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:25.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:25.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:25.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:25.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:25.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:25.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:25.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:25.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:25.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:25.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:25.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:25.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:25.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:25.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:25.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:25.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:25.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:25.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:25.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:25.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:25.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:25.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:25.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:25.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:25.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:25.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:25.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:25.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:25.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:25.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:25.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:25.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:25.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:25.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:25.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:25.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:25.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:25.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:25.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:25.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:25.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:25.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:25.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:25.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:25.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:25.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:25.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:25.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:25.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:25.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:25.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:25.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:25.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:25.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:25.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:25.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:25.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:25.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 14w REG 8,1 130050828 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:25.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:25.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:25.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:25.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:25.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:25.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:25.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:25.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:25.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:25.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:25.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:25.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:25.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:25.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:25.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:25.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:25.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:25.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:25.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:25.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:25.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:25.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:25.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:25.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:25.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:25.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:25.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:25.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:25.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:25.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:25.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:25.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:25.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:25.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:25.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:25.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:25.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:25.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:25.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:25.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:25.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:25.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 118958 rocksdb:h root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:25.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:25.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:25.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:25.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:25.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:25.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:25.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:25.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:25.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:25.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:25.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:25.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:25.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:25.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:25.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:25.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:25.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:25.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:25.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:25.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:25.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:25.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:25.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:25.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:25.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:25.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:25.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:25.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:25.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:25.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:25.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:25.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:25.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:25.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:25.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:25.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:25.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:25.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:25.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:25.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:25.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:25.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:25.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:25.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:25.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:25.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:25.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:25.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:25.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:25.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:25.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:25.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:25.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:25.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:25.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:25.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:25.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:25.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:25.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:25.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:25.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:25.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:25.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:25.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:25.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:25.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:25.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:25.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:25.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:25.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:25.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:25.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:25.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:25.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:25.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:25.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:25.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:25.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:25.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:25.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:25.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:25.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:25.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:25.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:25.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 14w REG 8,1 130050828 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:25.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:25.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:25.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:25.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:25.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:25.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:25.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:25.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:25.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:25.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:25.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:25.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:25.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:25.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:25.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:25.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:25.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:25.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:25.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:25.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:25.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:25.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:25.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:25.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:25.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:25.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:25.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:25.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:25.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:25.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:25.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:25.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:25.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:25.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:25.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:25.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:25.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:25.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:25.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:25.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:25.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:25.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 120426 bstore_ai root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:25.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:25.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:25.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:25.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:25.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:25.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:25.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:25.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:25.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:25.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:25.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:25.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:25.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:25.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:25.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:25.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:25.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:25.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:25.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:25.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:25.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:25.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:25.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:25.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:25.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:25.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:25.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:25.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:25.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:25.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:25.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:25.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:25.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:25.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:25.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:25.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:25.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:25.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:25.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:25.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:25.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:25.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:25.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:25.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:25.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:25.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:25.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:25.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:25.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:25.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:25.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:25.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:25.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:25.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:25.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:25.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:25.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:25.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:25.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:25.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:25.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:25.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:25.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:25.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:25.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:25.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:25.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:25.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:25.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:25.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:25.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:25.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:25.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:25.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:25.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:25.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:25.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:25.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:25.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:25.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:25.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:25.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:25.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:25.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:25.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 14w REG 8,1 130050828 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:25.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:25.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:25.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:25.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:25.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:25.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:25.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:25.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:25.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:25.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:25.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:25.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:25.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:25.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:25.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:25.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:25.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:25.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:25.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:25.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:25.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:25.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:25.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:25.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:25.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:25.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:25.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:25.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:25.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:25.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:25.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:25.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:25.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:25.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:25.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:25.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:25.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:25.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:25.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:25.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:25.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:25.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121197 bstore_ai root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:25.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:25.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:25.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:25.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:25.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:25.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:25.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:25.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:25.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:25.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:25.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:25.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:25.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:25.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:25.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:25.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:25.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:25.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:25.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:25.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:25.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:25.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:25.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:25.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:25.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:25.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:25.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:25.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:25.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:25.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:25.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:25.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:25.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:25.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:25.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:25.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:25.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:25.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:25.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:25.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:25.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:25.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:25.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:25.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:25.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:25.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:25.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:25.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:25.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:25.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:25.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:25.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:25.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:25.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:25.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:25.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:25.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:25.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:25.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:25.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:25.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:25.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:25.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:25.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:25.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:25.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:25.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:25.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:25.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:25.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:25.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:25.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:25.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:25.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:25.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:25.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:25.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:25.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:25.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:25.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:25.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:25.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:25.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:25.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:25.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 14w REG 8,1 130050828 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:25.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:25.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:25.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:25.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:25.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:25.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:25.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:25.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:25.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:25.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:25.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:25.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:25.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:25.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:25.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:25.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:25.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:25.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:25.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:25.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:25.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:25.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:25.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:25.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:25.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:25.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:25.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:25.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:25.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:25.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:25.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:25.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:25.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:25.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:25.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:25.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:25.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:25.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:25.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:25.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:25.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:25.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121379 ceph-osd root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:25.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:25.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:25.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:25.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:25.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:25.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:25.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:25.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:25.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:25.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:25.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:25.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:25.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:25.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:25.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:25.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:25.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:25.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:25.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:25.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:25.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:25.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:25.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:25.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:25.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:25.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:25.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:25.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:25.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:25.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:25.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:25.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:25.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:25.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:25.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:25.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:25.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:25.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:25.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:25.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:25.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:25.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:25.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:25.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:25.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:25.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:25.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:25.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:25.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:25.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:25.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:25.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:25.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:25.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:25.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:25.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:25.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:25.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:25.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:25.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:25.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:25.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:25.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:25.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:25.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:25.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:25.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:25.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:25.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:25.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:25.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:25.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:25.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:25.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:25.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:25.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:25.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:25.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:25.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:25.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:25.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:25.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:25.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:25.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:25.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 14w REG 8,1 130050828 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:25.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:25.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:25.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:25.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:25.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:25.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:25.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:25.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:25.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:25.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:25.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:25.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:25.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:25.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:25.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:25.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:25.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:25.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:25.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:25.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:25.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:25.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:25.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:25.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:25.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:25.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:25.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:25.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:25.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:25.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:25.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:25.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:25.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:25.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:25.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:25.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:25.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:25.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:25.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:25.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:25.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:25.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121387 cfin root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:25.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:25.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:25.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:25.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:25.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:25.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:25.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:25.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:25.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:25.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:25.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:25.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:25.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:25.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:25.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:25.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:25.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:25.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:25.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:25.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:25.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:25.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:25.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:25.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:25.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:25.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:25.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:25.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:25.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:25.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:25.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:25.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:25.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:25.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:25.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:25.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:25.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:25.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:25.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:25.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:25.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:25.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:25.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:25.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:25.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:25.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:25.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:25.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:25.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:25.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:25.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:25.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:25.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:25.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:25.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:25.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:25.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:25.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:25.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:25.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:25.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:25.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:25.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:25.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:25.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:25.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:25.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:25.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:25.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:25.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:25.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:25.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:25.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:25.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:25.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:25.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:25.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:25.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:25.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:25.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:25.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:25.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:25.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:25.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:25.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 14w REG 8,1 130050828 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:25.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:25.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:25.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:25.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:25.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:25.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:25.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:25.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:25.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:25.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:25.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:25.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:25.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:25.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:25.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:25.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:25.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:25.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:25.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:25.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:25.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:25.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:25.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:25.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:25.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:25.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:25.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:25.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:25.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:25.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:25.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:25.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:25.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:25.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:25.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:25.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:25.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:25.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:25.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:25.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:25.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:25.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121389 bstore_kv root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:25.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:25.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:25.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:25.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:25.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:25.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:25.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:25.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:25.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:25.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:25.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:25.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:25.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:25.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:25.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:25.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:25.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:25.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:25.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:25.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:25.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:25.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:25.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:25.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:25.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:25.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:25.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:25.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:25.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:25.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:25.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:25.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:25.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:25.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:25.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:25.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:25.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:25.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:25.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:25.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:25.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:25.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:25.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:25.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:25.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:25.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:25.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:25.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:25.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:25.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:25.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:25.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:25.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:25.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:25.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:25.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:25.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:25.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:25.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:25.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:25.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:25.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:25.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:25.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:25.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:25.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:25.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:25.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:25.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:25.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:25.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:25.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:25.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:25.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:25.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:25.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:25.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:25.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:25.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:25.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:25.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:25.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:25.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:25.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:25.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 14w REG 8,1 130050828 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:25.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:25.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:25.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:25.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:25.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:25.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:25.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:25.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:25.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:25.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:25.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:25.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:25.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:25.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:25.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:25.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:25.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:25.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:25.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:25.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:25.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:25.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:25.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:25.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:25.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:25.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:25.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:25.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:25.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:25.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:25.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:25.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:25.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:25.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:25.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:25.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:25.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:25.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:25.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:25.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:25.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:25.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121390 bstore_kv root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:25.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:25.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:25.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:25.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:25.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:25.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:25.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:25.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:25.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:25.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:25.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:25.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:25.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:25.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:25.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:25.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:25.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:25.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:25.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:25.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:25.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:25.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:25.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:25.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:25.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:25.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:25.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:25.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:25.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:25.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:25.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:25.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:25.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:25.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:25.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:25.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:25.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:25.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:25.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:25.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:25.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:25.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:25.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:25.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:25.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:25.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:25.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:25.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:25.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:25.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:25.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:25.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:25.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:25.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:25.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:25.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:25.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:25.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:25.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:25.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:25.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:25.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:25.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:25.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:25.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:25.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:25.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:25.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:25.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:25.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:25.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:25.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:25.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:25.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:25.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:25.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:25.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:25.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:25.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:25.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:25.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:25.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:25.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:25.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:25.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 14w REG 8,1 130050828 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:25.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:25.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:25.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:25.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:25.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:25.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:25.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:25.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:25.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:25.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:25.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:25.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:25.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:25.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:25.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:25.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:25.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:25.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:25.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:25.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:25.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:25.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:25.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:25.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:25.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:25.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:25.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:25.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:25.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:25.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:25.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:25.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:25.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:25.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:25.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:25.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:25.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:25.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:25.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:25.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:25.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:25.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121394 bstore_me root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:25.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:25.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:25.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:25.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:25.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:25.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:25.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:25.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:25.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:25.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:25.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:25.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:25.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:25.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:25.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:25.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:25.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:25.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:25.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:25.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:25.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:25.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:25.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:25.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:25.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:25.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:25.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:25.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:25.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:25.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:25.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:25.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:25.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:25.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:25.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:25.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:25.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:25.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:25.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:25.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:25.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:25.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:25.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:25.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:25.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:25.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:25.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:25.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:25.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:25.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:25.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:25.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:25.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:25.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:25.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:25.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:25.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:25.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:25.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:25.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:25.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:25.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:25.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:25.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:25.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:25.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:25.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:25.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:25.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:25.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:25.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:25.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:25.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:25.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:25.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:25.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:25.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:25.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:25.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:25.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:25.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:25.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:25.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:25.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:25.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 14w REG 8,1 130050828 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:25.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:25.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:25.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:25.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:25.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:25.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:25.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:25.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:25.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:25.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:25.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:25.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:25.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:25.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:25.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:25.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:25.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:25.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:25.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:25.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:25.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:25.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:25.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:25.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:25.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:25.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:25.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:25.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:25.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:25.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:25.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:25.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:25.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:25.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:25.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:25.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:25.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:25.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:25.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:25.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:25.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:25.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121564 ms_dispat root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:25.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:25.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:25.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:25.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:25.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:25.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:25.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:25.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:25.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:25.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:25.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:25.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:25.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:25.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:25.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:25.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:25.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:25.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:25.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:25.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:25.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:25.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:25.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:25.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:25.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:25.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:25.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:25.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:25.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:25.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:25.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:25.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:25.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:25.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:25.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:25.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:25.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:25.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:25.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:25.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:25.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:25.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:25.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:25.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:25.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:25.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:25.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:25.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:25.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:25.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:25.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:25.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:25.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:25.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:25.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:25.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:25.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:25.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:25.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:25.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:25.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:25.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:25.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:25.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:25.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:25.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:25.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:25.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:25.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:25.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:25.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:25.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:25.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:25.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:25.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:25.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:25.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:25.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:25.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:25.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:25.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:25.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:25.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:25.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:25.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 14w REG 8,1 130050828 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:25.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:25.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:25.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:25.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:25.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:25.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:25.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:25.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:25.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:25.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:25.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:25.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:25.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:25.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:25.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:25.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:25.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:25.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:25.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:25.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:25.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:25.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:25.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:25.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:25.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:25.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:25.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:25.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:25.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:25.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:25.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:25.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:25.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:25.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:25.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:25.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:25.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:25.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:25.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:25.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:25.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:25.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121565 ms_local root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:25.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:25.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:25.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:25.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:25.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:25.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:25.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:25.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:25.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:25.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:25.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:25.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:25.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:25.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:25.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:25.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:25.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:25.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:25.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:25.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:25.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:25.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:25.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:25.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:25.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:25.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:25.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:25.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:25.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:25.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:25.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:25.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:25.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:25.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:25.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:25.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:25.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:25.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:25.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:25.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:25.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:25.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:25.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:25.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:25.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:25.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:25.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:25.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:25.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:25.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:25.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:25.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:25.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:25.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:25.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:25.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:25.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:25.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:25.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:25.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:25.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:25.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:25.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:25.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:25.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:25.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:25.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:25.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:25.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:25.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:25.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:25.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:25.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:25.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:25.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:25.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:25.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:25.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:25.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:25.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:25.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:25.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:25.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:25.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:25.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 14w REG 8,1 130050828 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:25.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:25.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:25.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:25.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:25.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:25.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:25.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:25.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:25.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:25.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:25.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:25.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:25.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:25.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:25.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:25.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:25.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:25.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:25.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:25.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:25.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:25.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:25.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:25.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:25.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:25.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:25.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:25.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:25.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:25.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:25.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:25.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:25.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:25.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:25.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:25.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:25.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:25.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:25.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:25.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:25.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:25.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121566 safe_time root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:25.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:25.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:25.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:25.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:25.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:25.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:25.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:25.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:25.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:25.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:25.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:25.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:25.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:25.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:25.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:25.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:25.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:25.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:25.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:25.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:25.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:25.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:25.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:25.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:25.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:25.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:25.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:25.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:25.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:25.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:25.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:25.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:25.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:25.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:25.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:25.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:25.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:25.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:25.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:25.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:25.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:25.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:25.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:25.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:25.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:25.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:25.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:25.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:25.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:25.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:25.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:25.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:25.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:25.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:25.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:25.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:25.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:25.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:25.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:25.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:25.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:25.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:25.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:25.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:25.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:25.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:25.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:25.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:25.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:25.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:25.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:25.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:25.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:25.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:25.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:25.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:25.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:25.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:25.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:25.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:25.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:25.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:25.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:25.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:25.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 14w REG 8,1 130050828 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:25.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:25.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:25.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:25.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:25.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:25.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:25.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:25.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:25.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:25.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:25.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:25.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:25.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:25.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:25.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:25.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:25.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:25.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:25.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:25.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:25.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:25.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:25.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:25.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:25.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:25.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:25.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:25.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:25.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:25.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:25.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:25.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:25.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:25.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:25.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:25.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:25.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:25.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:25.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:25.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:25.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:25.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121567 safe_time root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:25.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:25.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:25.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:25.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:25.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:25.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:25.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:25.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:25.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:25.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:25.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:25.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:25.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:25.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:25.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:25.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:25.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:25.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:25.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:25.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:25.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:25.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:25.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:25.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:25.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:25.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:25.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:25.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:25.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:25.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:25.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:25.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:25.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:25.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:25.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:25.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:25.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:25.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:25.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:25.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:25.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:25.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:25.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:25.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:25.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:25.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:25.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:25.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:25.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:25.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:25.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:25.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:25.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:25.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:25.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:25.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:25.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:25.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:25.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:25.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:25.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:25.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:25.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:25.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:25.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:25.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:25.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:25.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:25.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:25.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:25.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:25.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:25.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:25.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:25.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:25.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:25.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:25.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:25.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:25.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:25.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:25.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:25.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:25.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:25.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 14w REG 8,1 130050828 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:25.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:25.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:25.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:25.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:25.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:25.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:25.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:25.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:25.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:25.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:25.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:25.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:25.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:25.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:25.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:25.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:25.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:25.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:25.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:25.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:25.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:25.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:25.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:25.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:25.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:25.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:25.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:25.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:25.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:25.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:25.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:25.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:25.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:25.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:25.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:25.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:25.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:25.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:25.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:25.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:25.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:25.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121568 ms_dispat root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:25.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:25.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:25.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:25.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:25.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:25.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:25.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:25.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:25.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:25.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:25.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:25.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:25.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:25.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:25.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:25.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:25.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:25.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:25.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:25.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:25.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:25.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:25.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:25.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:25.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:25.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:25.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:25.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:25.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:25.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:25.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:25.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:25.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:25.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:25.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:25.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:25.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:25.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:25.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:25.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:25.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:25.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:25.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:25.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:25.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:25.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:25.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:25.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:25.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:25.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:25.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:25.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:25.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:25.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:25.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:25.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:25.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:25.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:25.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:25.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:25.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:25.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:25.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:25.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:25.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:25.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:25.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:25.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:25.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:25.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:25.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:25.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:25.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:25.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:25.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:25.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:25.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:25.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:25.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:25.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:25.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:25.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:25.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:25.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:25.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 14w REG 8,1 130050828 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:25.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:25.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:25.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:25.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:25.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:25.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:25.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:25.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:25.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:25.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:25.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:25.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:25.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:25.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:25.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:25.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:25.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:25.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:25.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:25.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:25.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:25.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:25.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:25.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:25.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:25.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:25.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:25.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:25.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:25.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:25.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:25.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:25.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:25.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:25.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:25.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:25.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:25.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:25.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:25.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:25.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:25.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121569 ms_local root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:25.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:25.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:25.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:25.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:25.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:25.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:25.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:25.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:25.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:25.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:25.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:25.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:25.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:25.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:25.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:25.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:25.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:25.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:25.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:25.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:25.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:25.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:25.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:25.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:25.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:25.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:25.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:25.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:25.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:25.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:25.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:25.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:25.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:25.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:25.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:25.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:25.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:25.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:25.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:25.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:25.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:25.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:25.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:25.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:25.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:25.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:25.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:25.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:25.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:25.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:25.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:25.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:25.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:25.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:25.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:25.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:25.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:25.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:25.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:25.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:25.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:25.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:25.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:25.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:25.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:25.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:25.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:25.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:25.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:25.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:25.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:25.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:25.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:25.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:25.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:25.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:25.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:25.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:25.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:25.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:25.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:25.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:25.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:25.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:25.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 14w REG 8,1 130050828 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:25.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:25.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:25.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:25.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:25.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:25.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:25.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:25.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:25.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:25.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:25.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:25.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:25.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:25.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:25.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:25.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:25.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:25.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:25.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:25.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:25.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:25.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:25.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:25.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:25.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:25.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:25.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:25.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:25.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:25.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:25.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:25.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:25.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:25.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:25.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:25.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:25.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:25.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:25.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:25.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:25.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:25.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121570 ms_dispat root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:25.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:25.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:25.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:25.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:25.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:25.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:25.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:25.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:25.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:25.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:25.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:25.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:25.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:25.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:25.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:25.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:25.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:25.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:25.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:25.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:25.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:25.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:25.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:25.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:25.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:25.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:25.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:25.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:25.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:25.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:25.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:25.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:25.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:25.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:25.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:25.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:25.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:25.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:25.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:25.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:25.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:25.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:25.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:25.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:25.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:25.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:25.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:25.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:25.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:25.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:25.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:25.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:25.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:25.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:25.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:25.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:25.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:25.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:25.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:25.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:25.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:25.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:25.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:25.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:25.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:25.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:25.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:25.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:25.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:25.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:25.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:25.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:25.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:25.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:25.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:25.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:25.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:25.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:25.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:25.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:25.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:25.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:25.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:25.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:25.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 14w REG 8,1 130050828 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:25.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:25.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:25.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:25.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:25.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:25.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:25.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:25.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:25.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:25.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:25.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:25.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:25.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:25.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:25.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:25.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:25.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:25.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:25.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:25.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:25.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:25.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:25.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:25.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:25.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:25.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:25.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:25.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:25.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:25.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:25.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:25.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:25.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:25.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:25.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:25.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:25.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:25.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:25.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:25.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:25.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:25.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121571 ms_local root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:25.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:25.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:25.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:25.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:25.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:25.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:25.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:25.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:25.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:25.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:25.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:25.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:25.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:25.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:25.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:25.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:25.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:25.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:25.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:25.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:25.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:25.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:25.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:25.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:25.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:25.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:25.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:25.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:25.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:25.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:25.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:25.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:25.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:25.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:25.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:25.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:25.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:25.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:25.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:25.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:25.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:25.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:25.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:25.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:25.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:25.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:25.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:25.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:25.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:25.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:25.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:25.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:25.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:25.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:25.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:25.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:25.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:25.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:25.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:25.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:25.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:25.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:25.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:25.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:25.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:25.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:25.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:25.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:25.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:25.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:25.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:25.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:25.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:25.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:25.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:25.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:25.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:25.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:25.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:25.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:25.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:25.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:25.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:25.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:25.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 14w REG 8,1 130050828 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:25.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:25.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:25.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:25.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:25.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:25.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:25.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:25.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:25.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:25.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:25.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:25.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:25.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:25.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:25.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:25.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:25.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:25.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:25.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:25.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:25.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:25.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:25.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:25.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:25.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:25.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:25.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:25.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:25.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:25.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:25.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:25.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:25.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:25.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:25.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:25.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:25.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:25.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:25.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:25.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:25.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:25.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121572 ms_dispat root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:25.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:25.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:25.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:25.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:25.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:25.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:25.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:25.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:25.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:25.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:25.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:25.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:25.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:25.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:25.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:25.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:25.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:25.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:25.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:25.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:25.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:25.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:25.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:25.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:25.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:25.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:25.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:25.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:25.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:25.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:25.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:25.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:25.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:25.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:25.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:25.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:25.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:25.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:25.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:25.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:25.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:25.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:25.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:25.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:25.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:25.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:25.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:25.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:25.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:25.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:25.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:25.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:25.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:25.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:25.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:25.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:25.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:25.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:25.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:25.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:25.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:25.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:25.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:25.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:25.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:25.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:25.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:25.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:25.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:25.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:25.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:25.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:25.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:25.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:25.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:25.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:25.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:25.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:25.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:25.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:25.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:25.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:25.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:25.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:25.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 14w REG 8,1 130050828 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:25.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:25.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:25.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:25.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:25.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:25.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:25.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:25.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:25.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:25.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:25.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:25.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:25.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:25.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:25.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:25.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:25.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:25.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:25.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:25.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:25.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:25.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:25.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:25.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:25.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:25.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:25.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:25.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:25.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:25.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:25.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:25.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:25.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:25.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:25.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:25.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:25.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:25.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:25.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:25.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:25.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:25.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121573 ms_local root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:25.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:25.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:25.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:25.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:25.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:25.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:25.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:25.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:25.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:25.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:25.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:25.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:25.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:25.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:25.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:25.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:25.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:25.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:25.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:25.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:25.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:25.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:25.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:25.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:25.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:25.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:25.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:25.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:25.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:25.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:25.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:25.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:25.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:25.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:25.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:25.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:25.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:25.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:25.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:25.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:25.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:25.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:25.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:25.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:25.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:25.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:25.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:25.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:25.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:25.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:25.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:25.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:25.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:25.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:25.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:25.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:25.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:25.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:25.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:25.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:25.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:25.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:25.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:25.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:25.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:25.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:25.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:25.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:25.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:25.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:25.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:25.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:25.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:25.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:25.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:25.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:25.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:25.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:25.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:25.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:25.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:25.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:25.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:25.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:25.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 14w REG 8,1 130051111 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:25.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:25.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:25.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:25.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:25.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:25.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:25.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:25.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:25.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:25.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:25.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:25.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:25.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:25.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:25.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:25.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:25.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:25.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:25.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:25.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:25.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:25.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:25.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:25.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:25.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:25.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:25.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:25.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:25.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:25.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:25.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:25.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:25.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:25.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:25.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:25.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:25.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:25.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:25.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:25.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:25.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:25.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121574 ms_dispat root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:25.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:25.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:25.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:25.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:25.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:25.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:25.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:25.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:25.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:25.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:25.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:25.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:25.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:25.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:25.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:25.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:25.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:25.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:25.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:25.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:25.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:25.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:25.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:25.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:25.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:25.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:25.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:25.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:25.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:25.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:25.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:25.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:25.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:25.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:25.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:25.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:25.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:25.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:25.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:25.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:25.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:25.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:25.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:25.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:25.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:25.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:25.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:25.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:25.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:25.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:25.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:25.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:25.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:25.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:25.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:25.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:25.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:25.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:25.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:25.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:25.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:25.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:25.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:25.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:25.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:25.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:25.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:25.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:25.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:25.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:25.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:25.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:25.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:25.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:25.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:25.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:25.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:25.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:25.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:25.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:25.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:25.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:25.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:25.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:25.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 14w REG 8,1 130051111 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:25.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:25.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:25.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:25.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:25.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:25.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:25.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:25.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:25.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:25.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:25.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:25.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:25.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:25.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:25.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:25.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:25.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:25.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:25.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:25.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:25.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:25.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:25.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:25.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:25.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:25.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:25.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:25.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:25.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:25.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:25.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:25.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:25.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:25.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:25.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:25.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:25.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:25.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:25.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:25.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:25.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:25.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121575 ms_local root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:25.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:25.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:25.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:25.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:25.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:25.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:25.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:25.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:25.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:25.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:25.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:25.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:25.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:25.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:25.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:25.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:25.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:25.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:25.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:25.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:25.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:25.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:25.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:25.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:25.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:25.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:25.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:25.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:25.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:25.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:25.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:25.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:25.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:25.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:25.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:25.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:25.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:25.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:25.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:25.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:25.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:25.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:25.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:25.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:25.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:25.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:25.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:25.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:25.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:25.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:25.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:25.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:25.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:25.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:25.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:25.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:25.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:25.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:25.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:25.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:25.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:25.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:25.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:25.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:25.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:25.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:25.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:25.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:25.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:25.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:25.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:25.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:25.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:25.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:25.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:25.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:25.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:25.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:25.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:25.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:25.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:25.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:25.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:25.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:25.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 14w REG 8,1 130051111 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:25.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:25.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:25.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:25.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:25.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:25.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:25.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:25.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:25.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:25.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:25.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:25.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:25.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:25.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:25.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:25.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:25.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:25.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:25.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:25.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:25.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:25.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:25.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:25.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:25.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:25.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:25.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:25.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:25.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:25.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:25.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:25.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:25.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:25.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:25.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:25.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:25.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:25.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:25.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:25.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:25.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:25.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121576 ms_dispat root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:25.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:25.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:25.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:25.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:25.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:25.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:25.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:25.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:25.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:25.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:25.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:25.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:25.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:25.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:25.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:25.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:25.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:25.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:25.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:25.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:25.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:25.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:25.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:25.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:25.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:25.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:25.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:25.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:25.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:25.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:25.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:25.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:25.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:25.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:25.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:25.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:25.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:25.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:25.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:25.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:25.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:25.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:25.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:25.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:25.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:25.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:25.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:25.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:25.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:25.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:25.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:25.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:25.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:25.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:25.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:25.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:25.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:25.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:25.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:25.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:25.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:25.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:25.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:25.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:25.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:25.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:25.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:25.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:25.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:25.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:25.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:25.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:25.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:25.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:25.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:25.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:25.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:25.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:25.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:25.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:25.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:25.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:25.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:25.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:25.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 14w REG 8,1 130051111 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:25.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:25.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:25.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:25.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:25.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:25.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:25.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:25.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:25.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:25.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:25.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:25.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:25.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:25.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:25.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:25.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:25.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:25.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:25.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:25.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:25.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:25.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:25.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:25.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:25.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:25.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:25.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:25.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:25.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:25.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:25.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:25.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:25.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:25.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:25.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:25.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:25.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:25.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:25.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:25.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:25.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:25.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121577 ms_local root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:25.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:25.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:25.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:25.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:25.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:25.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:25.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:25.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:25.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:25.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:25.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:25.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:25.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:25.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:25.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:25.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:25.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:25.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:25.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:25.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:25.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:25.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:25.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:25.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:25.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:25.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:25.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:25.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:25.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:25.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:25.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:25.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:25.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:25.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:25.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:25.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:25.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:25.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:25.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:25.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:25.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:25.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:25.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:25.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:25.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:25.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:25.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:25.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:25.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:25.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:25.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:25.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:25.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:25.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:25.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:25.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:25.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:25.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:25.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:25.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:25.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:25.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:25.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:25.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:25.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:25.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:25.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:25.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:25.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:25.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:25.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:25.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:25.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:25.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:25.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:25.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:25.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:25.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:25.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:25.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:25.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:25.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:25.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:25.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:25.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:25.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:25.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:25.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:25.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 14w REG 8,1 130051111 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:25.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:25.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:25.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:25.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:25.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:25.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:25.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:25.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:25.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:25.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:25.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:25.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:25.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:25.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:25.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:25.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:25.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:25.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:25.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:25.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:25.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:25.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:25.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:25.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:25.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:25.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:25.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:25.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:25.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:25.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:25.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:25.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:25.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:25.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:25.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:25.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:25.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:25.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:26.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:26.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:26.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:26.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:26.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:26.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:26.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:26.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:26.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:26.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:26.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:26.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:26.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:26.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:26.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121578 ms_dispat root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:26.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:26.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:26.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:26.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:26.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:26.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:26.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:26.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:26.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:26.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:26.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:26.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:26.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:26.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:26.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:26.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:26.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:26.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:26.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:26.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:26.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:26.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:26.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:26.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:26.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:26.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:26.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:26.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:26.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:26.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:26.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:26.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:26.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:26.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:26.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:26.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:26.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:26.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:26.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:26.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:26.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:26.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:26.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:26.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:26.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:26.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:26.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:26.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:26.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:26.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:26.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:26.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:26.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:26.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:26.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:26.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:26.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:26.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:26.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:26.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:26.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:26.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:26.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:26.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:26.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:26.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:26.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:26.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:26.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:26.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:26.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:26.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:26.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:26.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:26.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:26.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:26.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:26.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:26.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:26.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:26.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:26.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:26.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:26.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:26.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 14w REG 8,1 130051111 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:26.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:26.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:26.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:26.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:26.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:26.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:26.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:26.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:26.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:26.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:26.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:26.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:26.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:26.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:26.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:26.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:26.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:26.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:26.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:26.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:26.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:26.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:26.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:26.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:26.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:26.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:26.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:26.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:26.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:26.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:26.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:26.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:26.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:26.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:26.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:26.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:26.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:26.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:26.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:26.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:26.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:26.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121579 ms_local root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:26.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:26.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:26.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:26.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:26.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:26.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:26.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:26.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:26.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:26.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:26.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:26.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:26.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:26.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:26.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:26.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:26.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:26.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:26.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:26.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:26.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:26.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:26.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:26.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:26.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:26.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:26.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:26.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:26.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:26.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:26.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:26.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:26.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:26.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:26.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:26.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:26.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:26.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:26.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:26.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:26.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:26.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:26.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:26.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:26.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:26.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:26.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:26.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:26.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:26.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:26.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:26.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:26.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:26.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:26.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:26.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:26.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:26.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:26.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:26.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:26.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:26.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:26.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:26.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:26.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:26.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:26.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:26.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:26.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:26.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:26.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:26.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:26.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:26.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:26.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:26.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:26.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:26.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:26.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:26.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:26.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:26.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:26.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:26.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:26.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 14w REG 8,1 130051111 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:26.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:26.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:26.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:26.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:26.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:26.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:26.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:26.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:26.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:26.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:26.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:26.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:26.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:26.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:26.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:26.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:26.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:26.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:26.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:26.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:26.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:26.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:26.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:26.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:26.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:26.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:26.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:26.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:26.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:26.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:26.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:26.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:26.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:26.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:26.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:26.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:26.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:26.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:26.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:26.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:26.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:26.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121580 fn_anonym root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:26.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:26.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:26.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:26.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:26.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:26.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:26.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:26.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:26.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:26.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:26.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:26.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:26.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:26.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:26.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:26.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:26.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:26.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:26.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:26.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:26.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:26.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:26.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:26.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:26.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:26.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:26.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:26.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:26.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:26.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:26.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:26.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:26.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:26.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:26.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:26.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:26.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:26.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:26.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:26.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:26.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:26.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:26.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:26.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:26.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:26.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:26.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:26.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:26.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:26.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:26.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:26.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:26.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:26.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:26.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:26.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:26.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:26.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:26.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:26.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:26.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:26.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:26.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:26.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:26.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:26.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:26.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:26.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:26.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:26.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:26.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:26.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:26.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:26.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:26.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:26.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:26.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:26.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:26.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:26.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:26.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:26.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:26.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:26.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:26.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 14w REG 8,1 130051111 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:26.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:26.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:26.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:26.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:26.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:26.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:26.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:26.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:26.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:26.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:26.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:26.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:26.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:26.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:26.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:26.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:26.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:26.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:26.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:26.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:26.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:26.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:26.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:26.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:26.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:26.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:26.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:26.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:26.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:26.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:26.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:26.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:26.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:26.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:26.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:26.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:26.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:26.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:26.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:26.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:26.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:26.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121581 finisher root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:26.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:26.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:26.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:26.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:26.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:26.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:26.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:26.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:26.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:26.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:26.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:26.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:26.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:26.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:26.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:26.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:26.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:26.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:26.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:26.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:26.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:26.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:26.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:26.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:26.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:26.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:26.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:26.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:26.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:26.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:26.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:26.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:26.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:26.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:26.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:26.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:26.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:26.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:26.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:26.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:26.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:26.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:26.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:26.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:26.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:26.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:26.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:26.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:26.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:26.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:26.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:26.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:26.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:26.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:26.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:26.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:26.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:26.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:26.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:26.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:26.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:26.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:26.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:26.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:26.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:26.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:26.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:26.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:26.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:26.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:26.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:26.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:26.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:26.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:26.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:26.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:26.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:26.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:26.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:26.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:26.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:26.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:26.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:26.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:26.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 14w REG 8,1 130053727 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:26.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:26.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:26.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:26.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:26.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:26.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:26.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:26.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:26.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:26.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:26.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:26.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:26.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:26.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:26.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:26.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:26.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:26.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:26.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:26.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:26.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:26.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:26.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:26.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:26.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:26.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:26.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:26.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:26.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:26.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:26.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:26.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:26.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:26.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:26.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:26.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:26.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:26.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:26.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:26.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:26.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:26.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121582 safe_time root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:26.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:26.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:26.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:26.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:26.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:26.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:26.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:26.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:26.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:26.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:26.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:26.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:26.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:26.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:26.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:26.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:26.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:26.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:26.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:26.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:26.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:26.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:26.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:26.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:26.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:26.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:26.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:26.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:26.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:26.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:26.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:26.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:26.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:26.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:26.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:26.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:26.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:26.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:26.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:26.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:26.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:26.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:26.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:26.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:26.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:26.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:26.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:26.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:26.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:26.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:26.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:26.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:26.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:26.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:26.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:26.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:26.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:26.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:26.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:26.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:26.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:26.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:26.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:26.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:26.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:26.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:26.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:26.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:26.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:26.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:26.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:26.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:26.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:26.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:26.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:26.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:26.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:26.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:26.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:26.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:26.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:26.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:26.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:26.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:26.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 14w REG 8,1 130053727 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:26.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:26.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:26.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:26.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:26.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:26.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:26.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:26.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:26.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:26.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:26.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:26.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:26.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:26.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:26.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:26.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:26.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:26.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:26.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:26.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:26.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:26.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:26.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:26.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:26.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:26.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:26.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:26.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:26.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:26.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:26.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:26.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:26.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:26.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:26.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:26.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:26.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:26.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:26.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:26.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:26.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:26.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121583 safe_time root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:26.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:26.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:26.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:26.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:26.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:26.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:26.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:26.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:26.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:26.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:26.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:26.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:26.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:26.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:26.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:26.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:26.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:26.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:26.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:26.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:26.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:26.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:26.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:26.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:26.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:26.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:26.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:26.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:26.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:26.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:26.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:26.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:26.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:26.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:26.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:26.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:26.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:26.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:26.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:26.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:26.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:26.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:26.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:26.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:26.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:26.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:26.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:26.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:26.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:26.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:26.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:26.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:26.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:26.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:26.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:26.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:26.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:26.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:26.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:26.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:26.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:26.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:26.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:26.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:26.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:26.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:26.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:26.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:26.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:26.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:26.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:26.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:26.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:26.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:26.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:26.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:26.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:26.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:26.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:26.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:26.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:26.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:26.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:26.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:26.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 14w REG 8,1 130053727 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:26.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:26.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:26.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:26.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:26.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:26.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:26.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:26.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:26.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:26.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:26.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:26.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:26.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:26.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:26.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:26.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:26.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:26.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:26.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:26.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:26.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:26.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:26.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:26.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:26.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:26.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:26.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:26.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:26.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:26.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:26.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:26.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:26.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:26.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:26.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:26.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:26.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:26.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:26.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:26.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:26.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:26.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121584 ceph-osd root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:26.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:26.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:26.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:26.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:26.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:26.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:26.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:26.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:26.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:26.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:26.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:26.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:26.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:26.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:26.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:26.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:26.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:26.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:26.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:26.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:26.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:26.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:26.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:26.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:26.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:26.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:26.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:26.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:26.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:26.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:26.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:26.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:26.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:26.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:26.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:26.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:26.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:26.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:26.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:26.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:26.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:26.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:26.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:26.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:26.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:26.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:26.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:26.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:26.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:26.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:26.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:26.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:26.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:26.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:26.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:26.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:26.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:26.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:26.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:26.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:26.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:26.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:26.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:26.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:26.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:26.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:26.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:26.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:26.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:26.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:26.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:26.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:26.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:26.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:26.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:26.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:26.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:26.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:26.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:26.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:26.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:26.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:26.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:26.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:26.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 14w REG 8,1 130053727 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:26.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:26.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:26.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:26.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:26.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:26.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:26.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:26.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:26.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:26.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:26.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:26.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:26.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:26.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:26.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:26.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:26.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:26.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:26.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:26.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:26.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:26.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:26.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:26.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:26.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:26.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:26.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:26.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:26.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:26.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:26.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:26.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:26.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:26.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:26.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:26.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:26.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:26.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:26.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:26.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:26.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:26.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121585 osd_srv_a root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:26.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:26.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:26.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:26.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:26.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:26.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:26.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:26.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:26.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:26.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:26.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:26.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:26.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:26.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:26.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:26.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:26.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:26.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:26.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:26.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:26.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:26.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:26.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:26.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:26.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:26.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:26.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:26.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:26.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:26.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:26.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:26.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:26.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:26.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:26.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:26.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:26.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:26.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:26.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:26.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:26.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:26.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:26.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:26.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:26.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:26.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:26.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:26.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:26.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:26.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:26.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:26.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:26.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:26.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:26.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:26.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:26.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:26.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:26.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:26.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:26.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:26.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:26.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:26.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:26.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:26.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:26.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:26.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:26.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:26.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:26.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:26.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:26.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:26.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:26.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:26.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:26.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:26.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:26.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:26.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:26.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:26.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:26.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:26.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:26.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 14w REG 8,1 130053727 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:26.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:26.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:26.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:26.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:26.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:26.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:26.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:26.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:26.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:26.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:26.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:26.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:26.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:26.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:26.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:26.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:26.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:26.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:26.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:26.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:26.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:26.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:26.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:26.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:26.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:26.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:26.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:26.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:26.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:26.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:26.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:26.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:26.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:26.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:26.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:26.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:26.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:26.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:26.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:26.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:26.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:26.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121586 tp_osd_tp root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:26.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:26.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:26.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:26.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:26.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:26.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:26.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:26.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:26.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:26.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:26.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:26.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:26.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:26.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:26.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:26.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:26.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:26.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:26.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:26.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:26.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:26.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:26.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:26.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:26.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:26.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:26.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:26.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:26.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:26.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:26.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:26.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:26.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:26.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:26.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:26.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:26.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:26.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:26.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:26.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:26.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:26.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:26.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:26.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:26.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:26.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:26.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:26.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:26.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:26.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:26.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:26.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:26.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:26.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:26.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:26.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:26.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:26.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:26.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:26.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:26.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:26.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:26.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:26.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:26.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:26.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:26.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:26.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:26.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:26.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:26.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:26.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:26.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:26.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:26.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:26.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:26.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:26.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:26.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:26.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:26.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:26.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:26.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:26.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:26.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 14w REG 8,1 130053727 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:26.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:26.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:26.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:26.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:26.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:26.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:26.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:26.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:26.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:26.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:26.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:26.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:26.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:26.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:26.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:26.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:26.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:26.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:26.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:26.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:26.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:26.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:26.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:26.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:26.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:26.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:26.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:26.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:26.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:26.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:26.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:26.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:26.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:26.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:26.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:26.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:26.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:26.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:26.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:26.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:26.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:26.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121587 tp_osd_tp root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:26.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:26.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:26.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:26.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:26.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:26.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:26.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:26.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:26.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:26.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:26.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:26.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:26.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:26.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:26.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:26.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:26.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:26.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:26.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:26.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:26.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:26.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:26.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:26.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:26.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:26.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:26.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:26.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:26.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:26.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:26.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:26.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:26.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:26.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:26.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:26.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:26.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:26.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:26.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:26.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:26.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:26.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:26.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:26.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:26.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:26.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:26.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:26.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:26.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:26.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:26.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:26.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:26.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:26.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:26.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:26.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:26.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:26.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:26.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:26.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:26.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:26.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:26.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:26.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:26.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:26.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:26.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:26.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:26.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:26.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:26.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:26.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:26.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:26.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:26.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:26.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:26.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:26.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:26.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:26.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:26.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:26.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:26.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:26.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:26.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 14w REG 8,1 130053727 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:26.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:26.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:26.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:26.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:26.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:26.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:26.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:26.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:26.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:26.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:26.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:26.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:26.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:26.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:26.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:26.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:26.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:26.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:26.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:26.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:26.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:26.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:26.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:26.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:26.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:26.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:26.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:26.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:26.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:26.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:26.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:26.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:26.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:26.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:26.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:26.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:26.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:26.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:26.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:26.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:26.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:26.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121588 tp_osd_tp root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:26.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:26.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:26.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:26.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:26.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:26.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:26.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:26.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:26.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:26.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:26.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:26.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:26.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:26.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:26.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:26.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:26.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:26.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:26.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:26.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:26.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:26.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:26.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:26.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:26.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:26.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:26.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:26.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:26.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:26.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:26.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:26.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:26.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:26.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:26.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:26.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:26.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:26.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:26.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:26.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:26.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:26.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:26.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:26.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:26.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:26.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:26.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:26.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:26.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:26.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:26.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:26.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:26.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:26.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:26.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:26.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:26.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:26.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:26.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:26.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:26.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:26.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:26.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:26.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:26.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:26.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:26.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:26.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:26.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:26.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:26.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:26.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:26.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:26.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:26.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:26.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:26.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:26.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:26.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:26.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:26.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:26.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:26.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:26.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:26.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 14w REG 8,1 130053727 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:26.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:26.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:26.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:26.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:26.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:26.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:26.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:26.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:26.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:26.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:26.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:26.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:26.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:26.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:26.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:26.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:26.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:26.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:26.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:26.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:26.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:26.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:26.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:26.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:26.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:26.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:26.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:26.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:26.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:26.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:26.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:26.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:26.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:26.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:26.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:26.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:26.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:26.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:26.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:26.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:26.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:26.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121589 tp_osd_tp root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:26.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:26.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:26.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:26.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:26.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:26.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:26.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:26.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:26.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:26.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:26.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:26.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:26.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:26.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:26.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:26.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:26.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:26.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:26.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:26.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:26.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:26.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:26.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:26.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:26.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:26.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:26.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:26.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:26.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:26.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:26.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:26.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:26.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:26.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:26.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:26.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:26.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:26.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:26.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:26.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:26.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:26.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:26.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:26.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:26.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:26.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:26.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:26.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:26.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:26.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:26.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:26.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:26.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:26.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:26.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:26.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:26.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:26.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:26.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:26.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:26.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:26.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:26.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:26.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:26.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:26.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:26.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:26.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:26.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:26.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:26.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:26.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:26.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:26.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:26.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:26.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:26.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:26.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:26.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:26.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:26.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:26.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:26.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:26.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:26.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 14w REG 8,1 130053727 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:26.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:26.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:26.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:26.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:26.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:26.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:26.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:26.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:26.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:26.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:26.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:26.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:26.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:26.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:26.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:26.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:26.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:26.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:26.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:26.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:26.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:26.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:26.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:26.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:26.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:26.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:26.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:26.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:26.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:26.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:26.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:26.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:26.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:26.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:26.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:26.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:26.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:26.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:26.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:26.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:26.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:26.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121590 tp_osd_tp root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:26.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:26.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:26.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:26.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:26.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:26.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:26.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:26.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:26.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:26.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:26.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:26.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:26.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:26.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:26.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:26.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:26.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:26.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:26.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:26.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:26.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:26.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:26.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:26.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:26.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:26.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:26.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:26.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:26.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:26.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:26.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:26.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:26.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:26.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:26.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:26.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:26.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:26.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:26.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:26.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:26.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:26.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:26.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:26.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:26.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:26.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:26.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:26.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:26.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:26.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:26.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:26.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:26.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:26.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:26.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:26.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:26.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:26.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:26.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:26.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:26.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:26.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:26.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:26.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:26.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:26.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:26.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:26.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:26.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:26.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:26.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:26.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:26.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:26.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:26.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:26.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:26.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:26.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:26.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:26.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:26.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:26.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:26.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:26.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:26.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 14w REG 8,1 130053727 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:26.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:26.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:26.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:26.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:26.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:26.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:26.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:26.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:26.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:26.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:26.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:26.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:26.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:26.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:26.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:26.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:26.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:26.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:26.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:26.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:26.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:26.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:26.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:26.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:26.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:26.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:26.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:26.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:26.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:26.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:26.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:26.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:26.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:26.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:26.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:26.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:26.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:26.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:26.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:26.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:26.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:26.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121591 tp_osd_tp root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:26.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:26.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:26.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:26.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:26.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:26.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:26.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:26.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:26.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:26.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:26.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:26.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:26.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:26.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:26.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:26.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:26.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:26.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:26.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:26.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:26.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:26.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:26.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:26.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:26.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:26.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:26.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:26.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:26.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:26.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:26.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:26.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:26.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:26.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:26.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:26.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:26.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:26.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:26.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:26.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:26.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:26.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:26.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:26.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:26.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:26.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:26.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:26.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:26.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:26.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:26.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:26.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:26.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:26.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:26.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:26.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:26.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:26.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:26.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:26.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:26.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:26.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:26.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:26.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:26.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:26.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:26.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:26.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:26.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:26.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:26.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:26.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:26.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:26.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:26.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:26.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:26.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:26.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:26.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:26.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:26.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:26.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:26.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:26.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:26.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 14w REG 8,1 130053727 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:26.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:26.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:26.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:26.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:26.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:26.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:26.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:26.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:26.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:26.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:26.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:26.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:26.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:26.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:26.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:26.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:26.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:26.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:26.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:26.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:26.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:26.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:26.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:26.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:26.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:26.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:26.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:26.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:26.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:26.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:26.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:26.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:26.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:26.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:26.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:26.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:26.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:26.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:26.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:26.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:26.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:26.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121592 tp_osd_tp root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:26.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:26.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:26.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:26.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:26.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:26.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:26.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:26.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:26.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:26.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:26.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:26.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:26.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:26.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:26.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:26.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:26.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:26.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:26.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:26.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:26.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:26.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:26.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:26.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:26.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:26.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:26.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:26.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:26.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:26.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:26.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:26.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:26.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:26.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:26.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:26.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:26.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:26.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:26.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:26.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:26.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:26.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:26.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:26.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:26.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:26.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:26.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:26.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:26.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:26.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:26.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:26.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:26.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:26.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:26.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:26.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:26.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:26.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:26.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:26.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:26.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:26.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:26.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:26.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:26.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:26.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:26.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:26.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:26.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:26.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:26.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:26.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:26.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:26.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:26.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:26.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:26.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:26.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:26.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:26.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:26.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:26.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:26.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:26.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:26.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 14w REG 8,1 130053727 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:26.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:26.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:26.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:26.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:26.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:26.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:26.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:26.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:26.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:26.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:26.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:26.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:26.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:26.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:26.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:26.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:26.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:26.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:26.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:26.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:26.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:26.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:26.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:26.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:26.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:26.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:26.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:26.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:26.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:26.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:26.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:26.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:26.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:26.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:26.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:26.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:26.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:26.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:26.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:26.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:26.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:26.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121593 tp_osd_tp root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:26.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:26.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:26.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:26.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:26.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:26.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:26.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:26.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:26.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:26.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:26.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:26.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:26.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:26.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:26.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:26.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:26.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:26.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:26.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:26.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:26.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:26.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:26.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:26.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:26.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:26.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:26.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:26.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:26.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:26.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:26.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:26.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:26.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:26.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:26.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:26.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:26.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:26.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:26.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:26.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:26.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:26.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:26.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:26.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:26.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:26.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:26.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:26.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:26.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:26.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:26.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:26.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:26.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:26.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:26.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:26.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:26.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:26.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:26.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:26.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:26.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:26.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:26.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:26.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:26.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:26.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:26.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:26.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:26.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:26.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:26.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:26.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:26.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:26.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:26.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:26.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:26.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:26.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:26.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:26.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:26.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:26.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:26.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:26.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:26.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 14w REG 8,1 130053727 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:26.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:26.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:26.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:26.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:26.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:26.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:26.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:26.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:26.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:26.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:26.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:26.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:26.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:26.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:26.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:26.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:26.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:26.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:26.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:26.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:26.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:26.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:26.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:26.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:26.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:26.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:26.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:26.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:26.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:26.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:26.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:26.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:26.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:26.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:26.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:26.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:26.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:26.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:26.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:26.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:26.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:26.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121594 tp_osd_tp root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:26.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:26.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:26.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:26.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:26.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:26.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:26.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:26.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:26.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:26.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:26.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:26.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:26.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:26.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:26.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:26.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:26.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:26.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:26.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:26.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:26.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:26.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:26.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:26.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:26.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:26.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:26.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:26.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:26.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:26.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:26.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:26.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:26.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:26.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:26.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:26.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:26.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:26.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:26.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:26.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:26.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:26.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:26.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:26.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:26.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:26.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:26.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:26.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:26.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:26.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:26.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:26.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:26.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:26.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:26.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:26.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:26.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:26.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:26.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:26.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:26.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:26.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:26.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:26.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:26.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:26.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:26.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:26.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:26.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:26.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:26.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:26.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:26.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:26.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:26.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:26.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:26.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:26.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:26.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:26.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:26.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:26.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:26.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:26.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:26.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 14w REG 8,1 130053727 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:26.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:26.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:26.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:26.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:26.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:26.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:26.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:26.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:26.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:26.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:26.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:26.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:26.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:26.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:26.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:26.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:26.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:26.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:26.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:26.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:26.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:26.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:26.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:26.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:26.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:26.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:26.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:26.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:26.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:26.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:26.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:26.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:26.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:26.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:26.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:26.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:26.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:26.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:26.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:26.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:26.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:26.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121595 tp_osd_tp root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:26.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:26.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:26.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:26.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:26.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:26.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:26.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:26.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:26.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:26.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:26.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:26.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:26.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:26.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:26.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:26.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:26.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:26.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:26.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:26.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:26.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:26.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:26.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:26.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:26.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:26.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:26.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:26.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:26.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:26.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:26.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:26.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:26.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:26.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:26.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:26.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:26.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:26.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:26.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:26.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:26.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:26.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:26.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:26.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:26.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:26.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:26.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:26.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:26.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:26.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:26.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:26.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:26.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:26.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:26.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:26.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:26.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:26.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:26.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:26.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:26.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:26.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:26.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:26.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:26.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:26.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:26.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:26.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:26.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:26.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:26.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:26.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:26.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:26.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:26.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:26.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:26.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:26.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:26.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:26.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:26.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:26.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:26.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:26.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:26.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 14w REG 8,1 130053727 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:26.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:26.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:26.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:26.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:26.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:26.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:26.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:26.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:26.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:26.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:26.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:26.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:26.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:26.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:26.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:26.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:26.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:26.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:26.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:26.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:26.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:26.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:26.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:26.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:26.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:26.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:26.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:26.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:26.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:26.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:26.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:26.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:26.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:26.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:26.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:26.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:26.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:26.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:26.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:26.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:26.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:26.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121596 tp_osd_tp root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:26.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:26.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:26.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:26.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:26.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:26.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:26.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:26.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:26.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:26.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:26.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:26.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:26.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:26.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:26.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:26.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:26.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:26.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:26.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:26.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:26.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:26.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:26.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:26.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:26.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:26.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:26.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:26.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:26.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:26.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:26.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:26.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:26.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:26.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:26.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:26.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:26.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:26.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:26.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:26.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:26.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:26.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:26.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:26.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:26.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:26.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:26.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:26.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:26.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:26.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:26.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:26.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:26.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:26.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:26.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:26.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:26.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:26.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:26.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:26.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:26.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:26.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:26.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:26.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:26.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:26.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:26.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:26.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:26.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:26.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:26.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:26.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:26.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:26.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:26.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:26.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:26.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:26.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:26.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:26.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:26.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:26.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:26.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:26.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:26.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 14w REG 8,1 130053727 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:26.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:26.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:26.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:26.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:26.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:26.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:26.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:26.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:26.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:26.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:26.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:26.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:26.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:26.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:26.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:26.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:26.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:26.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:26.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:26.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:26.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:26.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:26.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:26.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:26.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:26.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:26.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:26.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:26.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:26.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:26.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:26.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:26.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:26.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:26.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:26.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:26.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:26.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:26.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:26.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:26.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:26.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121597 tp_osd_tp root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:26.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:26.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:26.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:26.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:26.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:26.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:26.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:26.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:26.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:26.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:26.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:26.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:26.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:26.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:26.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:26.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:26.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:26.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:26.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:26.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:26.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:26.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:26.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:26.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:26.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:26.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:26.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:26.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:26.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:26.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:26.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:26.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:26.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:26.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:26.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:26.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:26.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:26.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:26.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:26.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:26.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:26.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:26.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:26.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:26.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:26.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:26.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:26.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:26.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:26.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:26.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:26.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:26.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:26.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:26.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:26.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:26.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:26.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:26.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:26.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:26.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:26.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:26.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:26.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:26.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:26.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:26.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:26.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:26.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:26.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:26.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:26.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:26.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:26.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:26.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:26.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:26.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:26.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:26.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:26.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:26.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:26.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:26.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:26.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:26.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 14w REG 8,1 130053727 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:26.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:26.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:26.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:26.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:26.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:26.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:26.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:26.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:26.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:26.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:26.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:26.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:26.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:26.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:26.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:26.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:26.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:26.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:26.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:26.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:26.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:26.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:26.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:26.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:26.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:26.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:26.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:26.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:26.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:26.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:26.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:26.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:26.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:26.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:26.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:26.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:26.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:26.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:26.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:26.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:26.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:26.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121598 tp_osd_tp root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:26.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:26.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:26.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:26.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:26.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:26.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:26.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:26.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:26.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:26.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:26.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:26.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:26.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:26.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:26.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:26.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:26.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:26.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:26.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:26.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:26.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:26.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:26.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:26.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:26.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:26.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:26.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:26.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:26.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:26.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:26.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:26.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:26.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:26.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:26.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:26.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:26.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:26.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:26.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:26.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:26.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:26.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:26.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:26.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:26.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:26.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:26.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:26.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:26.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:26.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:26.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:26.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:26.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:26.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:26.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:26.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:26.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:26.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:26.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:26.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:26.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:26.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:26.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:26.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:26.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:26.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:26.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:26.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:26.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:26.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:26.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:26.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:26.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:26.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:26.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:26.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:26.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:26.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:26.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:26.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:26.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:26.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:26.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:26.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:26.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 14w REG 8,1 130053727 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:26.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:26.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:26.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:26.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:26.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:26.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:26.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:26.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:26.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:26.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:26.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:26.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:26.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:26.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:26.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:26.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:26.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:26.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:26.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:26.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:26.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:26.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:26.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:26.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:26.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:26.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:26.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:26.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:26.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:26.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:26.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:26.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:26.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:26.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:26.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:26.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:26.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:26.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:26.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:26.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:26.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:26.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121599 tp_osd_tp root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:26.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:26.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:26.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:26.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:26.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:26.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:26.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:26.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:26.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:26.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:26.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:26.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:26.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:26.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:26.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:26.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:26.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:26.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:26.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:26.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:26.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:26.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:26.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:26.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:26.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:26.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:26.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:26.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:26.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:26.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:26.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:26.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:26.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:26.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:26.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:26.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:26.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:26.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:26.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:26.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:26.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:26.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:26.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:26.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:26.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:26.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:26.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:26.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:26.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:26.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:26.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:26.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:26.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:26.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:26.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:26.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:26.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:26.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:26.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:26.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:26.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:26.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:26.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:26.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:26.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:26.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:26.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:26.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:26.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:26.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:26.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:26.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:26.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:26.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:26.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:26.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:26.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:26.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:26.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:26.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:26.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:26.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:26.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:26.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:26.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 14w REG 8,1 130054010 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:26.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:26.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:26.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:26.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:26.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:26.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:26.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:26.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:26.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:26.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:26.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:26.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:26.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:26.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:26.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:26.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:26.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:26.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:26.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:26.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:26.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:26.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:26.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:26.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:26.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:26.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:26.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:26.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:26.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:26.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:26.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:26.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:26.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:26.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:26.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:26.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:26.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:26.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:26.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:26.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:26.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:26.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121600 tp_osd_tp root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:26.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:26.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:26.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:26.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:26.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:26.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:26.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:26.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:26.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:26.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:26.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:26.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:26.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:26.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:26.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:26.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:26.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:26.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:26.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:26.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:26.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:26.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:26.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:26.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:26.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:26.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:26.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:26.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:26.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:26.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:26.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:26.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:26.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:26.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:26.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:26.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:26.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:26.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:26.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:26.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:26.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:26.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:26.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:26.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:26.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:26.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:26.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:26.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:26.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:26.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:26.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:26.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:26.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:26.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:26.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:26.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:26.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:26.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:26.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:26.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:26.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:26.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:26.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:26.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:26.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:26.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:26.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:26.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:26.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:26.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:26.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:26.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:26.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:26.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:26.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:26.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:26.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:26.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:26.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:26.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:26.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:26.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:26.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:26.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:26.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 14w REG 8,1 130054010 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:26.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:26.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:26.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:26.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:26.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:26.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:26.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:26.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:26.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:26.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:26.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:26.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:26.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:26.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:26.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:26.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:26.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:26.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:26.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:26.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:26.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:26.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:26.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:26.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:26.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:26.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:26.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:26.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:26.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:26.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:26.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:26.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:26.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:26.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:26.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:26.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:26.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:26.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:26.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:26.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:26.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:26.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121601 tp_osd_tp root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:26.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:26.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:26.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:26.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:26.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:26.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:26.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:26.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:26.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:26.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:26.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:26.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:26.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:26.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:26.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:26.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:26.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:26.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:26.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:26.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:26.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:26.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:26.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:26.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:26.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root DEL REG 0,17 211164 /[aio] 2023-11-04T01:48:26.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root DEL REG 0,17 211161 /[aio] 2023-11-04T01:48:26.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:26.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:26.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:26.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:26.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:26.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:26.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:26.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:26.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:26.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:26.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:26.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:26.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:26.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:26.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:26.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:26.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:26.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:26.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:26.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:26.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:26.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:26.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:26.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:26.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:26.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:26.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:26.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:26.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:26.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:26.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:26.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:26.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:26.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:26.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:26.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:26.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:26.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:26.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:26.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:26.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:26.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:26.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:26.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:26.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:26.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:26.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:26.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:26.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:26.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:26.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:26.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:26.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:26.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 1w FIFO 0,13 0t0 209792 pipe 2023-11-04T01:48:26.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 2w FIFO 0,13 0t0 209793 pipe 2023-11-04T01:48:26.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 3r FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 4w FIFO 0,13 0t0 204640 pipe 2023-11-04T01:48:26.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,67,72,73,75,76,77,85,88,92,93,102] 2023-11-04T01:48:26.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 6r FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 7w FIFO 0,13 0t0 204642 pipe 2023-11-04T01:48:26.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 8u a_inode 0,14 0 3100 [eventpoll:9,61,65,70,71,74,78,79,84,86,89,91,95,97,103] 2023-11-04T01:48:26.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 9r FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 10w FIFO 0,13 0t0 204643 pipe 2023-11-04T01:48:26.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 11u a_inode 0,14 0 3100 [eventpoll:12,59,66,68,69,80,81,82,83,87,90,94,96,101] 2023-11-04T01:48:26.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 12r FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 13w FIFO 0,13 0t0 204644 pipe 2023-11-04T01:48:26.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 14w REG 8,1 130054010 265461 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:48:26.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 15uW REG 0,24 7 1751 /run/ceph/ceph-osd.1.pid 2023-11-04T01:48:26.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 16r FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 17w FIFO 0,13 0t0 210436 pipe 2023-11-04T01:48:26.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 18u unix 0xffff9ba9201eb300 0t0 210437 /var/run/ceph/ceph-osd.1.asok type=STREAM (LISTEN) 2023-11-04T01:48:26.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 19u IPv4 210449 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:48:26.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 20u IPv4 210451 0t0 TCP *:acnet (LISTEN) 2023-11-04T01:48:26.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 21u IPv4 210454 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:48:26.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 22u IPv4 210458 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:48:26.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 23u IPv4 210463 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:48:26.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 24u IPv4 210469 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:48:26.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 25u IPv4 210476 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:48:26.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 26u IPv4 210484 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:48:26.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 27r FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 28w FIFO 0,13 0t0 212339 pipe 2023-11-04T01:48:26.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 29r FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 30w FIFO 0,13 0t0 212340 pipe 2023-11-04T01:48:26.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 31u sock 0,8 0t0 210634 protocol: UDPv6 2023-11-04T01:48:26.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:48:26.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:48:26.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:48:26.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 58r FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 59u IPv4 211165 0t0 TCP smithi077.front.sepia.ceph.com:41644->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:26.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 60w FIFO 0,13 0t0 213435 pipe 2023-11-04T01:48:26.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 61u IPv4 210653 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48714 (ESTABLISHED) 2023-11-04T01:48:26.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 62r FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 63w FIFO 0,13 0t0 213436 pipe 2023-11-04T01:48:26.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 64u IPv4 213439 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58166 (ESTABLISHED) 2023-11-04T01:48:26.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 65u IPv4 203687 0t0 TCP smithi077.front.sepia.ceph.com:48028->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 66u IPv4 211181 0t0 TCP smithi077.front.sepia.ceph.com:45190->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:26.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 67u IPv4 214160 0t0 TCP smithi077.front.sepia.ceph.com:45456->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 68u IPv4 211182 0t0 TCP smithi077.front.sepia.ceph.com:45760->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 69u IPv4 214161 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51622 (ESTABLISHED) 2023-11-04T01:48:26.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 70u IPv4 214162 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48720 (ESTABLISHED) 2023-11-04T01:48:26.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 71u IPv4 214165 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58172 (ESTABLISHED) 2023-11-04T01:48:26.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 72u IPv4 214168 0t0 TCP smithi077.front.sepia.ceph.com:48766->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:26.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 73u IPv4 214169 0t0 TCP smithi077.front.sepia.ceph.com:47170->smithi077.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 74u IPv4 203685 0t0 TCP smithi077.front.sepia.ceph.com:56898->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 75u IPv4 214170 0t0 TCP smithi077.front.sepia.ceph.com:axio-disc->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:26.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 76u IPv4 214171 0t0 TCP smithi077.front.sepia.ceph.com:53182->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 77u IPv4 214172 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51638 (ESTABLISHED) 2023-11-04T01:48:26.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 78u IPv4 203686 0t0 TCP smithi077.front.sepia.ceph.com:57730->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 79u IPv4 214175 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46008 (ESTABLISHED) 2023-11-04T01:48:26.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 80u IPv4 214176 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46018 (ESTABLISHED) 2023-11-04T01:48:26.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 81u IPv4 210660 0t0 TCP smithi077.front.sepia.ceph.com:56786->smithi077.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 82u IPv4 210661 0t0 TCP smithi077.front.sepia.ceph.com:47168->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:26.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 83u IPv4 210662 0t0 TCP smithi077.front.sepia.ceph.com:40088->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 84u IPv4 203688 0t0 TCP smithi077.front.sepia.ceph.com:48522->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 85u IPv4 214193 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46028 (ESTABLISHED) 2023-11-04T01:48:26.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 86u IPv4 215069 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi077.front.sepia.ceph.com:48736 (ESTABLISHED) 2023-11-04T01:48:26.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 87u IPv4 215072 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi077.front.sepia.ceph.com:58174 (ESTABLISHED) 2023-11-04T01:48:26.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 88u IPv4 215077 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51654 (ESTABLISHED) 2023-11-04T01:48:26.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 89u IPv4 203689 0t0 TCP smithi077.front.sepia.ceph.com:6806->smithi122.front.sepia.ceph.com:51670 (ESTABLISHED) 2023-11-04T01:48:26.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 90u IPv4 215080 0t0 TCP smithi077.front.sepia.ceph.com:6804->smithi122.front.sepia.ceph.com:46044 (ESTABLISHED) 2023-11-04T01:48:26.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 91u IPv4 210677 0t0 TCP smithi077.front.sepia.ceph.com:57668->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:26.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 92u IPv4 214219 0t0 TCP smithi077.front.sepia.ceph.com:56894->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:26.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 93u IPv4 214227 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:32982 (ESTABLISHED) 2023-11-04T01:48:26.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 94u IPv4 286756 0t0 TCP smithi077.front.sepia.ceph.com:6800->smithi122.front.sepia.ceph.com:59640 (ESTABLISHED) 2023-11-04T01:48:26.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 95u IPv4 214207 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36276 (ESTABLISHED) 2023-11-04T01:48:26.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 96u IPv4 214208 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi077.front.sepia.ceph.com:36284 (ESTABLISHED) 2023-11-04T01:48:26.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 97u IPv4 215083 0t0 TCP smithi077.front.sepia.ceph.com:41008->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:26.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 101u IPv4 214213 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56056 (ESTABLISHED) 2023-11-04T01:48:26.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 102u IPv4 214214 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56058 (ESTABLISHED) 2023-11-04T01:48:26.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118538 121603 osd_srv_h root 103u IPv4 214215 0t0 TCP smithi077.front.sepia.ceph.com:6802->smithi122.front.sepia.ceph.com:56068 (ESTABLISHED) 2023-11-04T01:48:26.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:26.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:26.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:26.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:26.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:26.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:26.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:26.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:26.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:26.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:26.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:26.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:26.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:26.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:26.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:26.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:26.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:26.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:26.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:26.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:26.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:26.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:26.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:26.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:26.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:26.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:26.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:26.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:26.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:26.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:26.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:26.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:26.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:26.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:26.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:26.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:26.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:26.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:26.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:26.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:26.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:26.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:26.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:26.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:26.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:26.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:26.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:26.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:26.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:26.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:26.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:26.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:26.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:26.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:26.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:26.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:26.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:26.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:26.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:26.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:26.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:26.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:26.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:26.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:26.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:26.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:26.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:26.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:26.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:26.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:26.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:26.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:26.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:26.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:26.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:26.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:26.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:26.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:26.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:26.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:26.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:26.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:26.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:26.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:26.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:26.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:26.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:26.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:26.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:26.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:26.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:26.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:26.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 14w REG 8,1 134018028 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:26.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:26.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:26.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:26.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:26.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:26.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:26.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:26.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:26.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:26.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:26.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:26.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:26.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:26.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:26.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:26.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:26.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:26.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:26.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:26.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:26.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:26.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:26.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:26.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:26.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:26.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:26.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:26.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:26.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:26.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:26.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:26.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:26.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:26.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:26.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:26.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:26.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:26.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:26.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:26.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:26.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:26.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:26.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:26.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:26.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:26.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:26.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:26.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:26.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:26.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:26.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:26.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:26.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:26.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:26.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:26.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:26.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:26.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:26.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:26.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:26.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:26.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:26.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:26.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:26.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:26.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:26.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:26.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:26.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:26.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:26.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:26.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:26.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:26.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:26.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:26.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:26.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:26.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:26.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:26.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:26.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:26.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:26.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:26.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:26.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:26.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:26.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:26.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:26.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:26.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:26.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:26.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:26.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:26.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:26.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:26.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:26.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:26.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:26.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:26.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:26.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:26.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:26.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:26.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:26.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:26.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:26.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:26.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:26.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:26.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:26.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:26.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:26.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:26.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:26.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:26.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:26.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:26.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:26.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:26.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:26.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:26.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:26.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:26.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:26.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:26.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:26.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:26.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:26.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:26.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:26.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:26.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:26.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:26.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:26.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:26.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:26.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:26.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:26.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:26.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:26.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:26.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:26.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:26.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:26.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:26.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:26.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:26.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:26.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:26.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:26.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:26.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:26.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:26.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:26.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:26.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:26.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:26.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:26.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:26.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:26.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:26.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:26.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:26.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:26.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:26.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:26.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:26.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:26.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:26.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:26.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:26.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:26.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:26.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:26.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:26.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 14w REG 8,1 134007805 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:26.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:26.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:26.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:26.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:26.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:26.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:26.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:26.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:26.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:26.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:26.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:26.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:26.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:26.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:26.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:26.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:26.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:26.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:26.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:26.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:26.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:26.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:26.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:26.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:26.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:26.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:27.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:27.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:27.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:27.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:27.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:27.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:27.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:27.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:27.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:27.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:27.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:27.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:27.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:27.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:27.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:27.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:27.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:27.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:27.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:27.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:27.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:27.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:27.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:27.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118576 log root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:27.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:27.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:27.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:27.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:27.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:27.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:27.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:27.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:27.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:27.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:27.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:27.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:27.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:27.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:27.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:27.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:27.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:27.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:27.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:27.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:27.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:27.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:27.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:27.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:27.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:27.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:27.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:27.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:27.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:27.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:27.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:27.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:27.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:27.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:27.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:27.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:27.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:27.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:27.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:27.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:27.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:27.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:27.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:27.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:27.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:27.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:27.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:27.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:27.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:27.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:27.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:27.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:27.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:27.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:27.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:27.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:27.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:27.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:27.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:27.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:27.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:27.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:27.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:27.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:27.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:27.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:27.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:27.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:27.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:27.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:27.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:27.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:27.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:27.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:27.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:27.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:27.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 14w REG 8,1 134007805 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:27.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:27.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:27.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:27.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:27.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:27.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:27.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:27.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:27.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:27.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:27.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:27.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:27.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:27.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:27.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:27.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:27.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:27.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:27.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:27.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:27.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:27.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:27.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:27.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:27.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:27.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:27.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:27.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:27.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:27.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:27.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:27.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:27.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:27.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:27.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:27.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:27.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:27.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118578 msgr-work root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:27.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:27.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:27.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:27.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:27.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:27.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:27.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:27.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:27.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:27.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:27.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:27.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:27.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:27.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:27.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:27.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:27.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:27.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:27.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:27.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:27.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:27.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:27.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:27.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:27.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:27.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:27.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:27.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:27.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:27.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:27.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:27.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:27.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:27.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:27.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:27.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:27.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:27.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:27.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:27.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:27.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:27.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:27.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:27.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:27.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:27.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:27.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:27.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:27.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:27.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:27.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:27.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:27.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:27.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:27.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:27.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:27.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:27.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:27.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:27.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:27.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:27.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:27.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:27.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:27.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:27.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:27.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:27.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:27.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:27.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:27.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:27.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:27.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:27.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:27.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:27.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:27.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 14w REG 8,1 134007805 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:27.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:27.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:27.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:27.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:27.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:27.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:27.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:27.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:27.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:27.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:27.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:27.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:27.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:27.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:27.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:27.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:27.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:27.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:27.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:27.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:27.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:27.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:27.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:27.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:27.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:27.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:27.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:27.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:27.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:27.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:27.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:27.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:27.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:27.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:27.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:27.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:27.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:27.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118579 msgr-work root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:27.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:27.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:27.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:27.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:27.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:27.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:27.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:27.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:27.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:27.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:27.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:27.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:27.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:27.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:27.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:27.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:27.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:27.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:27.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:27.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:27.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:27.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:27.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:27.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:27.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:27.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:27.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:27.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:27.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:27.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:27.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:27.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:27.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:27.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:27.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:27.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:27.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:27.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:27.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:27.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:27.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:27.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:27.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:27.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:27.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:27.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:27.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:27.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:27.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:27.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:27.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:27.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:27.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:27.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:27.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:27.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:27.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:27.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:27.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:27.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:27.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:27.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:27.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:27.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:27.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:27.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:27.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:27.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:27.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:27.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:27.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:27.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:27.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:27.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:27.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:27.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:27.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 14w REG 8,1 134007805 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:27.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:27.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:27.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:27.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:27.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:27.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:27.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:27.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:27.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:27.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:27.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:27.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:27.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:27.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:27.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:27.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:27.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:27.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:27.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:27.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:27.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:27.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:27.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:27.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:27.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:27.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:27.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:27.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:27.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:27.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:27.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:27.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:27.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:27.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:27.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:27.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:27.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:27.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118580 msgr-work root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:27.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:27.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:27.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:27.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:27.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:27.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:27.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:27.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:27.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:27.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:27.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:27.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:27.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:27.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:27.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:27.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:27.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:27.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:27.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:27.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:27.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:27.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:27.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:27.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:27.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:27.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:27.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:27.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:27.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:27.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:27.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:27.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:27.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:27.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:27.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:27.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:27.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:27.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:27.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:27.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:27.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:27.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:27.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:27.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:27.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:27.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:27.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:27.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:27.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:27.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:27.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:27.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:27.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:27.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:27.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:27.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:27.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:27.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:27.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:27.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:27.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:27.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:27.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:27.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:27.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:27.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:27.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:27.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:27.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:27.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:27.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:27.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:27.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:27.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:27.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:27.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:27.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 14w REG 8,1 134007805 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:27.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:27.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:27.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:27.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:27.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:27.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:27.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:27.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:27.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:27.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:27.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:27.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:27.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:27.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:27.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:27.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:27.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:27.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:27.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:27.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:27.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:27.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:27.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:27.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:27.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:27.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:27.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:27.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:27.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:27.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:27.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:27.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:27.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:27.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:27.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:27.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:27.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:27.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118584 service root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:27.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:27.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:27.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:27.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:27.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:27.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:27.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:27.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:27.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:27.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:27.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:27.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:27.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:27.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:27.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:27.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:27.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:27.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:27.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:27.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:27.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:27.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:27.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:27.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:27.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:27.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:27.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:27.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:27.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:27.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:27.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:27.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:27.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:27.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:27.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:27.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:27.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:27.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:27.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:27.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:27.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:27.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:27.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:27.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:27.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:27.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:27.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:27.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:27.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:27.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:27.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:27.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:27.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:27.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:27.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:27.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:27.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:27.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:27.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:27.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:27.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:27.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:27.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:27.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:27.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:27.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:27.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:27.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:27.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:27.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:27.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:27.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:27.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:27.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:27.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:27.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:27.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 14w REG 8,1 134007805 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:27.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:27.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:27.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:27.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:27.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:27.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:27.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:27.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:27.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:27.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:27.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:27.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:27.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:27.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:27.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:27.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:27.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:27.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:27.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:27.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:27.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:27.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:27.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:27.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:27.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:27.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:27.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:27.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:27.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:27.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:27.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:27.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:27.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:27.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:27.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:27.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:27.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:27.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118585 admin_soc root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:27.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:27.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:27.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:27.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:27.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:27.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:27.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:27.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:27.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:27.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:27.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:27.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:27.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:27.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:27.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:27.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:27.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:27.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:27.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:27.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:27.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:27.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:27.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:27.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:27.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:27.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:27.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:27.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:27.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:27.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:27.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:27.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:27.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:27.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:27.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:27.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:27.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:27.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:27.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:27.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:27.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:27.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:27.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:27.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:27.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:27.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:27.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:27.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:27.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:27.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:27.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:27.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:27.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:27.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:27.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:27.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:27.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:27.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:27.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:27.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:27.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:27.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:27.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:27.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:27.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:27.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:27.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:27.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:27.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:27.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:27.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:27.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:27.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:27.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:27.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:27.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:27.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 14w REG 8,1 134007805 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:27.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:27.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:27.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:27.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:27.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:27.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:27.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:27.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:27.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:27.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:27.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:27.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:27.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:27.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:27.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:27.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:27.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:27.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:27.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:27.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:27.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:27.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:27.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:27.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:27.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:27.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:27.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:27.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:27.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:27.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:27.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:27.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:27.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:27.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:27.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:27.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:27.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:27.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118622 signal_ha root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:27.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:27.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:27.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:27.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:27.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:27.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:27.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:27.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:27.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:27.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:27.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:27.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:27.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:27.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:27.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:27.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:27.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:27.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:27.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:27.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:27.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:27.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:27.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:27.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:27.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:27.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:27.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:27.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:27.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:27.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:27.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:27.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:27.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:27.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:27.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:27.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:27.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:27.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:27.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:27.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:27.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:27.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:27.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:27.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:27.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:27.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:27.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:27.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:27.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:27.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:27.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:27.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:27.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:27.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:27.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:27.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:27.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:27.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:27.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:27.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:27.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:27.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:27.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:27.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:27.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:27.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:27.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:27.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:27.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:27.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:27.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:27.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:27.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:27.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:27.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:27.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:27.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 14w REG 8,1 134007805 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:27.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:27.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:27.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:27.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:27.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:27.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:27.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:27.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:27.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:27.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:27.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:27.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:27.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:27.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:27.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:27.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:27.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:27.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:27.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:27.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:27.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:27.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:27.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:27.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:27.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:27.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:27.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:27.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:27.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:27.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:27.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:27.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:27.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:27.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:27.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:27.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:27.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:27.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118623 io_contex root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:27.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:27.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:27.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:27.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:27.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:27.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:27.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:27.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:27.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:27.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:27.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:27.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:27.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:27.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:27.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:27.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:27.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:27.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:27.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:27.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:27.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:27.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:27.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:27.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:27.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:27.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:27.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:27.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:27.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:27.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:27.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:27.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:27.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:27.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:27.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:27.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:27.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:27.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:27.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:27.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:27.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:27.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:27.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:27.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:27.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:27.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:27.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:27.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:27.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:27.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:27.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:27.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:27.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:27.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:27.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:27.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:27.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:27.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:27.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:27.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:27.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:27.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:27.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:27.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:27.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:27.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:27.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:27.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:27.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:27.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:27.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:27.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:27.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:27.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:27.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:27.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:27.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 14w REG 8,1 134007805 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:27.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:27.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:27.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:27.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:27.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:27.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:27.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:27.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:27.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:27.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:27.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:27.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:27.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:27.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:27.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:27.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:27.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:27.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:27.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:27.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:27.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:27.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:27.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:27.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:27.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:27.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:27.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:27.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:27.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:27.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:27.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:27.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:27.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:27.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:27.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:27.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:27.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:27.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118624 io_contex root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:27.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:27.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:27.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:27.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:27.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:27.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:27.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:27.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:27.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:27.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:27.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:27.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:27.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:27.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:27.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:27.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:27.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:27.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:27.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:27.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:27.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:27.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:27.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:27.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:27.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:27.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:27.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:27.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:27.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:27.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:27.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:27.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:27.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:27.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:27.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:27.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:27.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:27.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:27.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:27.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:27.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:27.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:27.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:27.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:27.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:27.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:27.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:27.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:27.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:27.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:27.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:27.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:27.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:27.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:27.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:27.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:27.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:27.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:27.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:27.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:27.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:27.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:27.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:27.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:27.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:27.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:27.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:27.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:27.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:27.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:27.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:27.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:27.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:27.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:27.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:27.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:27.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 14w REG 8,1 134007805 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:27.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:27.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:27.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:27.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:27.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:27.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:27.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:27.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:27.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:27.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:27.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:27.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:27.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:27.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:27.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:27.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:27.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:27.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:27.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:27.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:27.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:27.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:27.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:27.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:27.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:27.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:27.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:27.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:27.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:27.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:27.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:27.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:27.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:27.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:27.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:27.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:27.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:27.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118635 OpHistory root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:27.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:27.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:27.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:27.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:27.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:27.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:27.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:27.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:27.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:27.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:27.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:27.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:27.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:27.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:27.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:27.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:27.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:27.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:27.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:27.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:27.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:27.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:27.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:27.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:27.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:27.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:27.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:27.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:27.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:27.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:27.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:27.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:27.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:27.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:27.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:27.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:27.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:27.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:27.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:27.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:27.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:27.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:27.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:27.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:27.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:27.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:27.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:27.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:27.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:27.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:27.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:27.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:27.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:27.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:27.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:27.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:27.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:27.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:27.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:27.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:27.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:27.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:27.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:27.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:27.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:27.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:27.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:27.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:27.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:27.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:27.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:27.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:27.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:27.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:27.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:27.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:27.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 14w REG 8,1 134007805 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:27.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:27.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:27.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:27.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:27.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:27.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:27.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:27.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:27.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:27.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:27.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:27.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:27.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:27.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:27.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:27.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:27.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:27.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:27.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:27.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:27.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:27.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:27.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:27.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:27.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:27.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:27.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:27.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:27.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:27.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:27.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:27.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:27.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:27.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:27.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:27.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:27.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:27.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118636 ceph_time root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:27.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:27.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:27.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:27.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:27.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:27.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:27.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:27.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:27.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:27.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:27.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:27.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:27.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:27.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:27.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:27.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:27.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:27.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:27.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:27.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:27.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:27.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:27.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:27.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:27.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:27.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:27.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:27.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:27.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:27.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:27.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:27.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:27.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:27.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:27.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:27.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:27.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:27.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:27.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:27.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:27.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:27.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:27.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:27.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:27.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:27.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:27.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:27.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:27.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:27.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:27.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:27.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:27.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:27.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:27.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:27.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:27.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:27.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:27.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:27.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:27.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:27.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:27.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:27.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:27.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:27.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:27.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:27.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:27.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:27.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:27.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:27.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:27.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:27.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:27.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:27.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:27.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 14w REG 8,1 134007805 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:27.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:27.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:27.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:27.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:27.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:27.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:27.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:27.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:27.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:27.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:27.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:27.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:27.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:27.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:27.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:27.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:27.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:27.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:27.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:27.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:27.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:27.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:27.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:27.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:27.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:27.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:27.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:27.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:27.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:27.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:27.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:27.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:27.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:27.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:27.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:27.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:27.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:27.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118681 ceph-osd root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:27.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:27.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:27.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:27.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:27.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:27.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:27.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:27.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:27.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:27.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:27.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:27.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:27.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:27.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:27.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:27.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:27.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:27.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:27.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:27.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:27.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:27.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:27.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:27.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:27.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:27.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:27.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:27.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:27.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:27.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:27.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:27.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:27.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:27.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:27.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:27.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:27.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:27.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:27.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:27.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:27.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:27.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:27.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:27.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:27.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:27.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:27.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:27.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:27.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:27.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:27.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:27.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:27.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:27.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:27.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:27.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:27.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:27.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:27.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:27.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:27.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:27.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:27.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:27.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:27.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:27.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:27.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:27.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:27.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:27.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:27.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:27.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:27.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:27.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:27.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:27.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:27.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 14w REG 8,1 134007805 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:27.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:27.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:27.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:27.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:27.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:27.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:27.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:27.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:27.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:27.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:27.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:27.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:27.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:27.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:27.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:27.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:27.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:27.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:27.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:27.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:27.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:27.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:27.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:27.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:27.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:27.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:27.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:27.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:27.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:27.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:27.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:27.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:27.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:27.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:27.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:27.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:27.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:27.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118691 ceph-osd root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:27.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:27.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:27.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:27.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:27.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:27.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:27.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:27.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:27.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:27.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:27.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:27.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:27.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:27.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:27.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:27.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:27.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:27.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:27.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:27.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:27.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:27.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:27.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:27.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:27.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:27.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:27.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:27.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:27.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:27.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:27.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:27.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:27.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:27.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:27.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:27.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:27.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:27.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:27.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:27.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:27.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:27.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:27.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:27.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:27.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:27.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:27.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:27.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:27.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:27.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:27.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:27.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:27.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:27.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:27.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:27.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:27.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:27.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:27.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:27.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:27.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:27.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:27.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:27.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:27.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:27.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:27.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:27.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:27.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:27.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:27.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:27.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:27.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:27.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:27.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:27.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:27.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 14w REG 8,1 134007805 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:27.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:27.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:27.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:27.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:27.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:27.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:27.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:27.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:27.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:27.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:27.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:27.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:27.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:27.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:27.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:27.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:27.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:27.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:27.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:27.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:27.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:27.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:27.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:27.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:27.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:27.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:27.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:27.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:27.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:27.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:27.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:27.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:27.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:27.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:27.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:27.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:27.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:27.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118699 ceph-osd root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:27.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:27.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:27.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:27.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:27.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:27.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:27.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:27.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:27.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:27.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:27.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:27.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:27.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:27.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:27.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:27.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:27.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:27.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:27.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:27.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:27.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:27.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:27.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:27.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:27.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:27.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:27.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:27.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:27.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:27.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:27.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:27.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:27.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:27.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:27.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:27.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:27.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:27.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:27.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:27.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:27.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:27.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:27.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:27.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:27.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:27.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:27.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:27.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:27.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:27.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:27.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:27.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:27.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:27.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:27.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:27.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:27.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:27.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:27.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:27.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:27.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:27.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:27.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:27.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:27.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:27.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:27.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:27.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:27.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:27.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:27.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:27.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:27.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:27.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:27.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:27.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:27.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 14w REG 8,1 134007805 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:27.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:27.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:27.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:27.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:27.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:27.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:27.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:27.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:27.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:27.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:27.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:27.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:27.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:27.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:27.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:27.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:27.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:27.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:27.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:27.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:27.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:27.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:27.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:27.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:27.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:27.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:27.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:27.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:27.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:27.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:27.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:27.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:27.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:27.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:27.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:27.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:27.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:27.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118718 ceph-osd root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:27.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:27.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:27.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:27.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:27.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:27.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:27.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:27.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:27.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:27.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:27.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:27.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:27.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:27.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:27.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:27.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:27.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:27.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:27.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:27.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:27.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:27.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:27.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:27.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:27.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:27.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:27.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:27.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:27.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:27.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:27.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:27.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:27.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:27.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:27.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:27.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:27.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:27.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:27.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:27.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:27.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:27.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:27.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:27.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:27.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:27.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:27.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:27.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:27.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:27.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:27.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:27.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:27.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:27.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:27.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:27.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:27.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:27.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:27.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:27.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:27.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:27.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:27.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:27.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:27.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:27.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:27.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:27.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:27.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:27.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:27.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:27.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:27.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:27.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:27.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:27.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:27.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 14w REG 8,1 134007805 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:27.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:27.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:27.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:27.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:27.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:27.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:27.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:27.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:27.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:27.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:27.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:27.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:27.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:27.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:27.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:27.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:27.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:27.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:27.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:27.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:27.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:27.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:27.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:27.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:27.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:27.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:27.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:27.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:27.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:27.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:27.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:27.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:27.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:27.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:27.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:27.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:27.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:27.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118726 ceph-osd root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:27.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:27.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:27.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:27.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:27.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:27.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:27.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:27.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:27.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:27.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:27.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:27.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:27.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:27.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:27.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:27.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:27.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:27.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:27.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:27.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:27.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:27.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:27.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:27.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:27.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:27.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:27.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:27.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:27.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:27.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:27.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:27.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:27.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:27.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:27.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:27.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:27.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:27.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:27.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:27.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:27.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:27.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:27.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:27.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:27.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:27.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:27.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:27.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:27.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:27.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:27.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:27.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:27.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:27.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:27.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:27.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:27.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:27.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:27.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:27.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:27.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:27.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:27.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:27.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:27.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:27.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:27.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:27.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:27.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:27.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:27.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:27.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:27.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:27.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:27.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:27.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:27.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 14w REG 8,1 134007805 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:27.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:27.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:27.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:27.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:27.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:27.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:27.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:27.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:27.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:27.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:27.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:27.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:27.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:27.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:27.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:27.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:27.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:27.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:27.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:27.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:27.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:27.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:27.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:27.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:27.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:27.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:27.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:27.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:27.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:27.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:27.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:27.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:27.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:27.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:27.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:27.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:27.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:27.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118734 ceph-osd root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:27.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:27.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:27.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:27.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:27.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:27.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:27.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:27.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:27.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:27.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:27.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:27.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:27.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:27.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:27.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:27.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:27.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:27.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:27.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:27.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:27.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:27.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:27.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:27.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:27.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:27.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:27.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:27.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:27.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:27.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:27.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:27.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:27.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:27.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:27.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:27.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:27.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:27.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:27.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:27.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:27.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:27.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:27.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:27.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:27.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:27.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:27.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:27.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:27.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:27.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:27.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:27.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:27.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:27.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:27.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:27.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:27.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:27.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:27.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:27.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:27.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:27.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:27.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:27.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:27.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:27.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:27.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:27.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:27.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:27.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:27.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:27.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:27.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:27.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:27.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:27.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:27.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 14w REG 8,1 134007805 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:27.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:27.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:27.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:27.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:27.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:27.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:27.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:27.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:27.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:27.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:27.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:27.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:27.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:27.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:27.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:27.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:27.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:27.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:27.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:27.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:27.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:27.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:27.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:27.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:27.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:27.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:27.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:27.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:27.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:27.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:27.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:27.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:27.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:27.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:27.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:27.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:27.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:27.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 118742 ceph-osd root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:27.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:27.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:27.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:27.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:27.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:27.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:27.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:27.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:27.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:27.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:27.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:27.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:27.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:27.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:27.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:27.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:27.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:27.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:27.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:27.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:27.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:27.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:27.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:27.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:27.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:27.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:27.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:27.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:27.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:27.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:27.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:27.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:27.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:27.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:27.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:27.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:27.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:27.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:27.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:27.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:27.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:27.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:27.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:27.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:27.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:27.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:27.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:27.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:27.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:27.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:27.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:27.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:27.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:27.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:27.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:27.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:27.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:27.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:27.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:27.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:27.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:27.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:27.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:27.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:27.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:27.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:27.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:27.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:27.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:27.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:27.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:27.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:27.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:27.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:27.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:27.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:27.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 14w REG 8,1 134007805 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:27.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:27.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:27.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:27.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:27.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:27.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:27.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:27.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:27.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:27.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:27.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:27.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:27.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:27.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:27.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:27.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:27.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:27.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:27.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:27.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:27.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:27.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:27.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:27.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:27.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:27.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:27.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:27.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:27.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:27.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:27.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:27.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:27.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:27.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:27.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:27.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:27.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:27.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119323 ceph-osd root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:27.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:27.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:27.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:27.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:27.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:27.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:27.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:27.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:27.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:27.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:27.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:27.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:27.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:27.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:27.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:27.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:27.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:27.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:27.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:27.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:27.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:27.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:27.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:27.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:27.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:27.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:27.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:27.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:27.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:27.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:27.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:27.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:27.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:27.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:27.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:27.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:27.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:27.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:27.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:27.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:27.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:27.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:27.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:27.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:27.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:27.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:27.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:27.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:27.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:27.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:27.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:27.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:27.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:27.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:27.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:27.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:27.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:27.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:27.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:27.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:27.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:27.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:27.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:27.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:27.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:27.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:27.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:27.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:27.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:27.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:27.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:27.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:27.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:27.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:27.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:27.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:27.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 14w REG 8,1 134007805 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:27.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:27.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:27.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:27.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:27.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:27.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:27.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:27.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:27.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:27.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:27.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:27.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:27.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:27.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:27.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:27.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:27.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:27.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:27.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:27.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:27.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:27.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:27.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:27.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:27.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:27.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:27.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:27.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:27.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:27.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:27.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:27.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:27.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:27.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:27.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:27.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:27.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:27.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119324 ceph-osd root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:27.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:27.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:27.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:27.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:27.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:27.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:27.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:27.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:27.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:27.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:27.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:27.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:27.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:27.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:27.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:27.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:27.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:27.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:27.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:27.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:27.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:27.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:27.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:27.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:27.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:27.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:27.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:27.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:27.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:27.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:27.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:27.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:27.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:27.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:27.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:27.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:27.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:27.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:27.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:27.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:27.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:27.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:27.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:27.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:27.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:27.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:27.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:27.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:27.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:27.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:27.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:27.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:27.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:27.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:27.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:27.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:27.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:27.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:27.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:27.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:27.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:27.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:27.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:27.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:27.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:27.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:27.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:27.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:27.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:27.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:27.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:27.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:27.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:27.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:27.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:27.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:27.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 14w REG 8,1 134007805 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:27.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:27.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:27.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:27.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:27.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:27.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:27.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:27.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:27.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:27.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:27.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:27.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:27.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:27.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:27.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:27.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:27.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:27.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:27.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:27.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:27.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:27.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:27.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:27.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:27.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:27.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:27.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:27.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:27.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:27.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:27.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:27.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:27.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:27.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:27.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:27.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:27.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:27.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119325 safe_time root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:27.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:27.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:27.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:27.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:27.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:27.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:27.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:27.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:27.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:27.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:27.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:27.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:27.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:27.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:27.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:27.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:27.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:27.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:27.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:27.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:27.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:27.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:27.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:27.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:27.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:27.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:27.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:27.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:27.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:27.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:27.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:27.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:27.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:27.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:27.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:27.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:27.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:27.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:27.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:27.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:27.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:27.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:27.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:27.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:27.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:27.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:27.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:27.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:27.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:27.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:27.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:27.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:27.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:27.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:27.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:27.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:27.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:27.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:27.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:27.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:27.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:27.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:27.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:27.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:27.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:27.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:27.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:27.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:27.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:27.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:27.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:27.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:27.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:27.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:27.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:27.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:27.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 14w REG 8,1 134007805 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:27.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:27.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:27.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:27.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:27.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:27.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:27.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:27.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:27.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:27.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:27.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:27.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:27.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:27.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:27.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:27.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:27.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:27.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:27.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:27.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:27.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:27.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:27.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:27.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:27.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:27.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:27.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:27.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:27.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:27.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:27.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:27.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:27.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:27.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:27.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:27.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:27.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:27.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119326 safe_time root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:27.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:27.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:27.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:27.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:27.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:27.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:27.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:27.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:27.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:27.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:27.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:27.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:27.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:27.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:27.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:27.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:27.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:27.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:27.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:27.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:27.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:27.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:27.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:27.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:27.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:27.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:27.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:27.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:27.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:27.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:27.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:27.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:27.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:27.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:27.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:27.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:27.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:27.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:27.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:27.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:27.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:27.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:27.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:27.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:27.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:27.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:27.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:27.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:27.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:27.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:27.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:27.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:27.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:27.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:27.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:27.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:27.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:27.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:27.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:27.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:27.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:27.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:27.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:27.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:27.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:27.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:27.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:27.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:27.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:27.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:27.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:27.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:27.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:27.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:27.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:27.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:27.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 14w REG 8,1 134008088 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:27.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:27.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:27.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:27.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:27.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:27.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:27.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:27.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:27.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:27.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:27.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:27.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:27.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:27.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:27.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:27.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:27.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:27.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:27.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:27.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:27.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:27.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:27.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:27.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:27.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:27.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:27.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:27.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:27.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:27.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:27.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:27.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:27.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:27.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:27.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:27.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:27.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:27.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119327 safe_time root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:27.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:27.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:27.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:27.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:27.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:27.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:27.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:27.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:27.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:27.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:27.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:27.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:27.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:27.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:27.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:27.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:27.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:27.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:27.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:27.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:27.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:27.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:27.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:27.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:27.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:27.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:27.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:27.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:27.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:27.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:27.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:27.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:27.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:27.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:27.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:27.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:27.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:27.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:27.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:27.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:27.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:27.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:27.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:27.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:27.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:27.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:27.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:27.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:27.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:27.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:27.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:27.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:27.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:27.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:27.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:27.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:27.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:27.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:27.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:27.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:27.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:27.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:27.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:27.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:27.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:27.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:27.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:27.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:27.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:27.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:27.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:27.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:27.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:27.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:27.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:27.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:27.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 14w REG 8,1 134008088 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:27.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:27.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:27.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:27.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:27.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:27.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:27.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:27.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:27.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:27.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:27.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:27.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:27.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:27.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:27.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:27.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:27.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:27.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:27.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:27.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:27.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:27.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:27.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:27.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:27.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:27.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:27.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:27.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:27.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:27.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:27.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:27.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:27.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:27.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:27.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:27.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:27.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:27.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119328 safe_time root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:27.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:27.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:27.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:27.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:27.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:27.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:27.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:27.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:27.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:27.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:27.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:27.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:27.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:27.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:27.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:27.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:27.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:27.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:27.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:27.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:27.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:27.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:27.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:27.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:27.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:27.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:27.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:27.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:27.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:27.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:27.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:27.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:27.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:27.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:27.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:27.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:27.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:27.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:27.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:27.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:27.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:27.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:27.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:27.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:27.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:27.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:27.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:27.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:27.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:27.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:27.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:27.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:27.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:27.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:27.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:27.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:27.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:27.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:27.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:27.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:27.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:27.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:27.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:27.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:27.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:27.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:27.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:27.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:27.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:27.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:27.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:27.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:27.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:27.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:27.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:27.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:27.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 14w REG 8,1 134008088 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:27.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:27.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:27.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:27.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:27.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:27.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:27.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:27.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:27.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:27.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:27.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:27.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:27.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:27.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:27.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:27.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:27.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:27.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:27.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:27.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:27.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:27.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:27.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:27.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:27.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:27.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:27.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:27.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:27.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:27.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:27.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:27.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:27.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:27.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:27.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:27.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:27.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:27.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119329 fn_anonym root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:27.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:27.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:27.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:27.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:27.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:27.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:27.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:27.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:27.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:27.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:27.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:27.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:27.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:27.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:27.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:27.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:27.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:27.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:27.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:27.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:27.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:27.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:27.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:27.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:27.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:27.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:27.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:27.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:27.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:27.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:27.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:27.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:27.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:27.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:27.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:27.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:27.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:27.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:27.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:27.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:27.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:27.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:27.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:27.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:27.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:27.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:27.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:27.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:27.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:27.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:27.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:27.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:27.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:27.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:27.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:27.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:27.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:27.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:27.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:27.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:27.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:27.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:27.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:27.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:27.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:27.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:27.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:27.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:27.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:27.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:27.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:27.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:27.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:27.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:27.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:27.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:27.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:27.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:27.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:27.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:27.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:27.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 14w REG 8,1 134008088 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:27.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:27.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:27.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:27.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:27.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:27.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:27.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:27.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:27.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:27.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:27.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:27.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:27.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:27.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:27.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:27.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:27.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:27.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:27.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:27.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:27.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:27.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:27.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:27.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:27.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:27.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:27.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:27.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:27.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:27.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:27.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:27.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:27.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:27.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:27.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:27.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:27.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:27.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:27.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:27.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:27.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:27.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:27.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:27.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:27.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:27.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:27.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:27.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:27.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:27.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:27.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:27.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119332 rocksdb:l root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:27.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:27.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:27.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:27.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:27.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:27.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:27.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:27.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:27.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:27.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:27.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:27.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:27.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:27.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:27.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:27.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:27.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:27.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:27.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:27.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:27.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:27.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:27.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:27.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:27.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:27.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:27.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:27.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:27.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:27.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:27.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:27.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:27.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:27.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:27.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:27.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:27.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:27.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:27.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:27.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:27.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:27.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:27.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:27.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:27.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:27.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:27.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:27.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:27.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:27.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:27.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:27.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:27.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:27.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:28.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:28.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:28.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:28.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:28.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:28.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:28.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:28.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:28.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:28.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:28.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:28.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:28.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:28.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:28.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:28.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:28.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:28.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:28.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:28.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:28.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:28.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:28.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:28.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:28.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:28.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:28.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:28.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:28.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:28.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 14w REG 8,1 134008088 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:28.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:28.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:28.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:28.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:28.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:28.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:28.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:28.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:28.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:28.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:28.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:28.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:28.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:28.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:28.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:28.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:28.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:28.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:28.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:28.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:28.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:28.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:28.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:28.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:28.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:28.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:28.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:28.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:28.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:28.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:28.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:28.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:28.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:28.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:28.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119333 rocksdb:l root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:28.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:28.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:28.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:28.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:28.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:28.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:28.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:28.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:28.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:28.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:28.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:28.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:28.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:28.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:28.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:28.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:28.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:28.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:28.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:28.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:28.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:28.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:28.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:28.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:28.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:28.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:28.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:28.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:28.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:28.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:28.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:28.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:28.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:28.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:28.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:28.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:28.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:28.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:28.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:28.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:28.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:28.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:28.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:28.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:28.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:28.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:28.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:28.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:28.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:28.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:28.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:28.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:28.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:28.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:28.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:28.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 14w REG 8,1 134008088 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:28.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:28.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:28.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:28.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:28.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:28.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:28.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:28.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:28.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:28.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:28.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:28.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:28.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:28.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:28.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:28.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:28.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:28.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:28.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:28.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:28.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:28.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:28.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:28.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:28.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:28.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:28.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:28.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:28.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:28.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:28.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:28.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:28.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:28.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:28.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119334 rocksdb:l root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:28.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:28.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:28.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:28.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:28.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:28.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:28.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:28.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:28.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:28.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:28.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:28.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:28.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:28.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:28.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:28.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:28.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:28.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:28.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:28.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:28.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:28.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:28.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:28.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:28.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:28.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:28.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:28.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:28.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:28.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:28.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:28.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:28.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:28.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:28.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:28.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:28.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:28.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:28.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:28.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:28.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:28.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:28.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:28.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:28.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:28.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:28.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:28.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:28.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:28.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:28.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:28.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:28.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:28.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:28.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:28.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 14w REG 8,1 134008088 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:28.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:28.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:28.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:28.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:28.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:28.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:28.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:28.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:28.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:28.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:28.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:28.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:28.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:28.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:28.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:28.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:28.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:28.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:28.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:28.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:28.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:28.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:28.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:28.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:28.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:28.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:28.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:28.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:28.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:28.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:28.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:28.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:28.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:28.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:28.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 119335 rocksdb:h root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:28.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:28.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:28.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:28.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:28.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:28.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:28.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:28.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:28.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:28.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:28.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:28.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:28.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:28.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:28.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:28.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:28.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:28.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:28.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:28.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:28.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:28.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:28.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:28.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:28.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:28.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:28.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:28.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:28.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:28.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:28.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:28.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:28.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:28.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:28.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:28.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:28.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:28.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:28.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:28.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:28.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:28.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:28.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:28.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:28.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:28.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:28.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:28.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:28.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:28.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:28.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:28.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:28.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:28.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:28.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:28.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 14w REG 8,1 134008088 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:28.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:28.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:28.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:28.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:28.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:28.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:28.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:28.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:28.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:28.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:28.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:28.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:28.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:28.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:28.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:28.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:28.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:28.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:28.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:28.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:28.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:28.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:28.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:28.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:28.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:28.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:28.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:28.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:28.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:28.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:28.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:28.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:28.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:28.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:28.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 120790 bstore_ai root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:28.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:28.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:28.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:28.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:28.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:28.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:28.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:28.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:28.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:28.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:28.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:28.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:28.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:28.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:28.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:28.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:28.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:28.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:28.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:28.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:28.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:28.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:28.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:28.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:28.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:28.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:28.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:28.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:28.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:28.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:28.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:28.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:28.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:28.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:28.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:28.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:28.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:28.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:28.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:28.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:28.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:28.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:28.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:28.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:28.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:28.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:28.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:28.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:28.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:28.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:28.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:28.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:28.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:28.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:28.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:28.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 14w REG 8,1 134008088 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:28.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:28.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:28.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:28.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:28.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:28.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:28.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:28.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:28.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:28.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:28.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:28.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:28.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:28.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:28.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:28.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:28.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:28.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:28.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:28.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:28.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:28.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:28.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:28.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:28.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:28.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:28.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:28.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:28.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:28.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:28.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:28.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:28.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:28.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:28.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121608 bstore_ai root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:28.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:28.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:28.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:28.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:28.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:28.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:28.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:28.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:28.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:28.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:28.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:28.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:28.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:28.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:28.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:28.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:28.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:28.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:28.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:28.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:28.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:28.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:28.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:28.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:28.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:28.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:28.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:28.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:28.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:28.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:28.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:28.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:28.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:28.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:28.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:28.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:28.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:28.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:28.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:28.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:28.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:28.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:28.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:28.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:28.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:28.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:28.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:28.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:28.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:28.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:28.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:28.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:28.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:28.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:28.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:28.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 14w REG 8,1 134008088 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:28.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:28.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:28.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:28.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:28.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:28.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:28.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:28.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:28.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:28.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:28.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:28.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:28.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:28.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:28.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:28.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:28.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:28.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:28.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:28.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:28.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:28.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:28.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:28.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:28.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:28.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:28.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:28.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:28.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:28.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:28.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:28.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:28.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:28.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:28.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121828 ceph-osd root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:28.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:28.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:28.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:28.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:28.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:28.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:28.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:28.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:28.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:28.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:28.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:28.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:28.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:28.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:28.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:28.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:28.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:28.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:28.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:28.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:28.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:28.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:28.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:28.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:28.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:28.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:28.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:28.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:28.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:28.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:28.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:28.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:28.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:28.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:28.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:28.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:28.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:28.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:28.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:28.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:28.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:28.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:28.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:28.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:28.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:28.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:28.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:28.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:28.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:28.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:28.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:28.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:28.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:28.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:28.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:28.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 14w REG 8,1 134008088 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:28.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:28.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:28.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:28.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:28.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:28.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:28.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:28.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:28.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:28.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:28.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:28.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:28.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:28.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:28.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:28.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:28.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:28.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:28.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:28.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:28.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:28.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:28.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:28.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:28.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:28.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:28.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:28.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:28.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:28.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:28.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:28.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:28.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:28.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:28.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121829 cfin root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:28.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:28.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:28.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:28.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:28.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:28.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:28.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:28.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:28.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:28.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:28.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:28.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:28.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:28.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:28.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:28.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:28.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:28.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:28.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:28.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:28.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:28.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:28.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:28.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:28.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:28.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:28.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:28.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:28.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:28.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:28.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:28.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:28.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:28.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:28.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:28.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:28.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:28.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:28.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:28.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:28.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:28.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:28.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:28.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:28.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:28.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:28.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:28.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:28.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:28.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:28.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:28.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:28.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:28.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:28.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:28.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 14w REG 8,1 134008088 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:28.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:28.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:28.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:28.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:28.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:28.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:28.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:28.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:28.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:28.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:28.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:28.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:28.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:28.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:28.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:28.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:28.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:28.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:28.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:28.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:28.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:28.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:28.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:28.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:28.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:28.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:28.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:28.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:28.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:28.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:28.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:28.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:28.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:28.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:28.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121830 bstore_kv root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:28.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:28.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:28.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:28.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:28.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:28.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:28.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:28.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:28.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:28.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:28.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:28.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:28.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:28.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:28.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:28.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:28.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:28.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:28.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:28.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:28.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:28.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:28.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:28.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:28.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:28.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:28.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:28.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:28.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:28.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:28.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:28.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:28.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:28.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:28.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:28.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:28.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:28.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:28.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:28.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:28.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:28.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:28.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:28.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:28.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:28.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:28.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:28.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:28.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:28.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:28.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:28.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:28.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:28.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:28.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:28.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 14w REG 8,1 134008088 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:28.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:28.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:28.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:28.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:28.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:28.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:28.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:28.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:28.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:28.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:28.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:28.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:28.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:28.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:28.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:28.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:28.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:28.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:28.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:28.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:28.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:28.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:28.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:28.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:28.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:28.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:28.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:28.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:28.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:28.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:28.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:28.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:28.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:28.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:28.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121831 bstore_kv root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:28.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:28.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:28.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:28.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:28.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:28.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:28.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:28.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:28.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:28.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:28.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:28.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:28.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:28.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:28.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:28.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:28.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:28.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:28.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:28.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:28.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:28.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:28.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:28.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:28.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:28.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:28.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:28.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:28.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:28.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:28.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:28.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:28.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:28.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:28.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:28.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:28.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:28.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:28.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:28.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:28.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:28.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:28.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:28.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:28.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:28.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:28.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:28.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:28.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:28.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:28.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:28.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:28.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:28.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:28.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:28.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 14w REG 8,1 134008088 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:28.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:28.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:28.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:28.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:28.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:28.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:28.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:28.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:28.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:28.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:28.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:28.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:28.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:28.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:28.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:28.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:28.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:28.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:28.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:28.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:28.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:28.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:28.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:28.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:28.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:28.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:28.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:28.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:28.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:28.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:28.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:28.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:28.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:28.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:28.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121832 bstore_me root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:28.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:28.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:28.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:28.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:28.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:28.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:28.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:28.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:28.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:28.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:28.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:28.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:28.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:28.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:28.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:28.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:28.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:28.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:28.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:28.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:28.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:28.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:28.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:28.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:28.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:28.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:28.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:28.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:28.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:28.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:28.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:28.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:28.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:28.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:28.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:28.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:28.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:28.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:28.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:28.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:28.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:28.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:28.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:28.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:28.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:28.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:28.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:28.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:28.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:28.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:28.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:28.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:28.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:28.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:28.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:28.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 14w REG 8,1 134008088 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:28.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:28.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:28.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:28.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:28.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:28.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:28.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:28.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:28.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:28.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:28.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:28.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:28.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:28.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:28.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:28.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:28.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:28.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:28.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:28.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:28.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:28.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:28.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:28.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:28.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:28.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:28.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:28.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:28.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:28.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:28.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:28.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:28.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:28.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:28.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121833 ms_dispat root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:28.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:28.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:28.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:28.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:28.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:28.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:28.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:28.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:28.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:28.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:28.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:28.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:28.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:28.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:28.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:28.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:28.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:28.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:28.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:28.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:28.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:28.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:28.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:28.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:28.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:28.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:28.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:28.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:28.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:28.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:28.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:28.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:28.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:28.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:28.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:28.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:28.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:28.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:28.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:28.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:28.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:28.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:28.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:28.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:28.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:28.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:28.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:28.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:28.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:28.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:28.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:28.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:28.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:28.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:28.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:28.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 14w REG 8,1 134008088 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:28.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:28.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:28.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:28.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:28.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:28.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:28.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:28.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:28.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:28.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:28.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:28.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:28.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:28.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:28.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:28.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:28.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:28.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:28.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:28.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:28.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:28.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:28.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:28.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:28.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:28.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:28.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:28.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:28.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:28.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:28.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:28.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:28.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:28.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:28.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121834 ms_local root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:28.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:28.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:28.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:28.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:28.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:28.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:28.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:28.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:28.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:28.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:28.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:28.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:28.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:28.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:28.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:28.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:28.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:28.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:28.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:28.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:28.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:28.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:28.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:28.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:28.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:28.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:28.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:28.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:28.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:28.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:28.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:28.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:28.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:28.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:28.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:28.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:28.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:28.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:28.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:28.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:28.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:28.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:28.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:28.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:28.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:28.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:28.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:28.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:28.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:28.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:28.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:28.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:28.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:28.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:28.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:28.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 14w REG 8,1 134008088 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:28.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:28.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:28.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:28.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:28.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:28.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:28.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:28.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:28.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:28.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:28.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:28.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:28.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:28.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:28.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:28.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:28.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:28.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:28.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:28.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:28.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:28.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:28.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:28.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:28.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:28.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:28.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:28.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:28.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:28.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:28.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:28.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:28.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:28.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:28.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121835 safe_time root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:28.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:28.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:28.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:28.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:28.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:28.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:28.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:28.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:28.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:28.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:28.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:28.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:28.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:28.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:28.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:28.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:28.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:28.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:28.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:28.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:28.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:28.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:28.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:28.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:28.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:28.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:28.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:28.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:28.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:28.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:28.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:28.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:28.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:28.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:28.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:28.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:28.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:28.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:28.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:28.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:28.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:28.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:28.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:28.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:28.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:28.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:28.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:28.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:28.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:28.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:28.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:28.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:28.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:28.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:28.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:28.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 14w REG 8,1 134008088 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:28.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:28.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:28.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:28.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:28.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:28.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:28.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:28.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:28.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:28.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:28.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:28.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:28.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:28.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:28.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:28.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:28.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:28.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:28.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:28.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:28.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:28.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:28.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:28.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:28.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:28.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:28.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:28.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:28.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:28.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:28.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:28.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:28.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:28.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:28.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121836 safe_time root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:28.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:28.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:28.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:28.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:28.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:28.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:28.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:28.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:28.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:28.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:28.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:28.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:28.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:28.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:28.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:28.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:28.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:28.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:28.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:28.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:28.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:28.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:28.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:28.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:28.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:28.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:28.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:28.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:28.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:28.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:28.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:28.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:28.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:28.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:28.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:28.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:28.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:28.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:28.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:28.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:28.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:28.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:28.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:28.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:28.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:28.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:28.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:28.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:28.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:28.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:28.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:28.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:28.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:28.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:28.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:28.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 14w REG 8,1 134008088 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:28.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:28.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:28.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:28.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:28.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:28.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:28.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:28.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:28.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:28.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:28.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:28.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:28.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:28.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:28.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:28.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:28.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:28.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:28.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:28.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:28.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:28.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:28.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:28.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:28.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:28.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:28.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:28.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:28.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:28.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:28.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:28.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:28.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:28.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:28.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121837 ms_dispat root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:28.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:28.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:28.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:28.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:28.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:28.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:28.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:28.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:28.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:28.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:28.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:28.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:28.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:28.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:28.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:28.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:28.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:28.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:28.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:28.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:28.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:28.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:28.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:28.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:28.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:28.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:28.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:28.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:28.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:28.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:28.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:28.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:28.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:28.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:28.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:28.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:28.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:28.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:28.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:28.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:28.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:28.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:28.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:28.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:28.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:28.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:28.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:28.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:28.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:28.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:28.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:28.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:28.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:28.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:28.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:28.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 14w REG 8,1 134008088 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:28.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:28.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:28.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:28.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:28.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:28.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:28.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:28.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:28.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:28.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:28.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:28.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:28.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:28.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:28.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:28.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:28.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:28.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:28.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:28.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:28.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:28.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:28.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:28.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:28.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:28.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:28.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:28.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:28.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:28.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:28.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:28.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:28.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:28.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:28.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121838 ms_local root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:28.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:28.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:28.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:28.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:28.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:28.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:28.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:28.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:28.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:28.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:28.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:28.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:28.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:28.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:28.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:28.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:28.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:28.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:28.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:28.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:28.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:28.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:28.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:28.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:28.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:28.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:28.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:28.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:28.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:28.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:28.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:28.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:28.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:28.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:28.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:28.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:28.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:28.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:28.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:28.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:28.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:28.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:28.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:28.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:28.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:28.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:28.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:28.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:28.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:28.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:28.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:28.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:28.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:28.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:28.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:28.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 14w REG 8,1 134008088 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:28.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:28.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:28.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:28.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:28.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:28.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:28.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:28.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:28.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:28.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:28.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:28.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:28.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:28.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:28.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:28.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:28.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:28.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:28.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:28.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:28.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:28.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:28.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:28.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:28.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:28.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:28.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:28.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:28.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:28.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:28.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:28.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:28.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:28.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:28.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121839 ms_dispat root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:28.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:28.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:28.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:28.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:28.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:28.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:28.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:28.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:28.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:28.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:28.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:28.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:28.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:28.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:28.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:28.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:28.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:28.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:28.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:28.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:28.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:28.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:28.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:28.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:28.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:28.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:28.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:28.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:28.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:28.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:28.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:28.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:28.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:28.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:28.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:28.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:28.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:28.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:28.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:28.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:28.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:28.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:28.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:28.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:28.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:28.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:28.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:28.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:28.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:28.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:28.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:28.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:28.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:28.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:28.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:28.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 14w REG 8,1 134008088 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:28.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:28.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:28.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:28.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:28.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:28.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:28.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:28.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:28.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:28.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:28.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:28.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:28.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:28.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:28.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:28.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:28.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:28.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:28.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:28.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:28.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:28.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:28.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:28.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:28.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:28.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:28.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:28.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:28.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:28.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:28.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:28.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:28.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:28.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:28.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121840 ms_local root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:28.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:28.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:28.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:28.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:28.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:28.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:28.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:28.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:28.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:28.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:28.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:28.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:28.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:28.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:28.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:28.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:28.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:28.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:28.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:28.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:28.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:28.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:28.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:28.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:28.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:28.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:28.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:28.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:28.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:28.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:28.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:28.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:28.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:28.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:28.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:28.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:28.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:28.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:28.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:28.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:28.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:28.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:28.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:28.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:28.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:28.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:28.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:28.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:28.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:28.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:28.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:28.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:28.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:28.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:28.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:28.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 14w REG 8,1 134008088 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:28.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:28.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:28.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:28.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:28.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:28.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:28.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:28.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:28.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:28.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:28.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:28.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:28.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:28.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:28.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:28.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:28.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:28.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:28.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:28.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:28.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:28.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:28.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:28.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:28.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:28.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:28.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:28.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:28.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:28.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:28.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:28.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:28.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:28.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:28.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121841 ms_dispat root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:28.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:28.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:28.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:28.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:28.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:28.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:28.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:28.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:28.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:28.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:28.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:28.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:28.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:28.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:28.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:28.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:28.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:28.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:28.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:28.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:28.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:28.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:28.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:28.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:28.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:28.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:28.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:28.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:28.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:28.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:28.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:28.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:28.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:28.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:28.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:28.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:28.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:28.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:28.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:28.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:28.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:28.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:28.703 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:28.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:28.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:28.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:28.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:28.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:28.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:28.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:28.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:28.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:28.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.705 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:28.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:28.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.706 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:28.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 14w REG 8,1 134008088 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:28.707 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:28.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:28.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:28.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:28.708 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:28.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:28.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:28.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:28.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:28.709 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:28.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:28.710 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:28.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:28.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.711 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.712 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.713 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.714 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.715 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.716 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:28.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.717 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.718 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:28.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:28.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:28.719 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:28.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:28.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:28.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:28.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:28.720 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:28.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:28.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:28.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:28.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:28.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:28.721 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:28.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:28.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:28.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.722 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:28.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:28.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:28.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121842 ms_local root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:28.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:28.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.723 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:28.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.724 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.725 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:28.726 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.727 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:28.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:28.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:28.728 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:28.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:28.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:28.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:28.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:28.729 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:28.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:28.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:28.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:28.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:28.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:28.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:28.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:28.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:28.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:28.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:28.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:28.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:28.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:28.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:28.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:28.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:28.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:28.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:28.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:28.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:28.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:28.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:28.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:28.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:28.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:28.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:28.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:28.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:28.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:28.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:28.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:28.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:28.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:28.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:28.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:28.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:28.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:28.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:28.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:28.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:28.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:28.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:28.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:28.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 14w REG 8,1 134008371 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:28.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:28.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:28.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:28.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:28.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:28.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:28.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:28.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:28.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:28.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:28.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:28.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:28.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:28.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:28.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:28.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:28.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:28.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:28.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:28.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:28.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:28.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:28.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:28.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:28.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:28.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:28.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:28.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:28.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:28.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:28.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:28.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:28.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:28.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:28.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121843 ms_dispat root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:28.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:28.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:28.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:28.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:28.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:28.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:28.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:28.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:28.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:28.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:28.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:28.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:28.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:28.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:28.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:28.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:28.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.764 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:28.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:28.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:28.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:28.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:28.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:28.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:28.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:28.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:28.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:28.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:28.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:28.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:28.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:28.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:28.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:28.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:28.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:28.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:28.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:28.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:28.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:28.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:28.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:28.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:28.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:28.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:28.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:28.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:28.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:28.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:28.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:28.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:28.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:28.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:28.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:28.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:28.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:28.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:28.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 14w REG 8,1 134008371 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:28.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:28.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:28.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:28.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:28.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:28.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:28.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:28.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:28.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:28.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:28.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:28.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:28.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:28.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:28.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:28.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:28.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:28.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:28.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:28.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:28.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:28.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:28.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:28.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:28.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:28.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:28.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:28.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:28.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:28.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:28.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:28.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:28.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:28.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:28.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121844 ms_local root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:28.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:28.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:28.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:28.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:28.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:28.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:28.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:28.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:28.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:28.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:28.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:28.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:28.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:28.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:28.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:28.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:28.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:28.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:28.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:28.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:28.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:28.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:28.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:28.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:28.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:28.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:28.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:28.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:28.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:28.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:28.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:28.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:28.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:28.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:28.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:28.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:28.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:28.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:28.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:28.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:28.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:28.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:28.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:28.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:28.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:28.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:28.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:28.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:28.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:28.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:28.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:28.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:28.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:28.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:28.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:28.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 14w REG 8,1 134008371 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:28.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:28.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:28.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:28.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:28.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:28.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:28.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:28.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:28.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:28.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:28.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:28.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:28.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:28.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:28.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:28.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:28.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:28.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:28.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:28.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:28.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:28.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:28.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:28.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:28.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:28.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:28.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:28.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:28.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:28.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:28.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:28.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:28.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:28.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:28.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121845 ms_dispat root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:28.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:28.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:28.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:28.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:28.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:28.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:28.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:28.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:28.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:28.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:28.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:28.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:28.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:28.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:28.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:28.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:28.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:28.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:28.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:28.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:28.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:28.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:28.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:28.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:28.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:28.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:28.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:28.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:28.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:28.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:28.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:28.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:28.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:28.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:28.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:28.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:28.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:28.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:28.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:28.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:28.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:28.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:28.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:28.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:28.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:28.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:28.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:28.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:28.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:28.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:28.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:28.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:28.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:28.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:28.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:28.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 14w REG 8,1 134008371 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:28.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:28.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:28.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:28.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:28.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:28.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:28.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:28.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:28.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:28.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:28.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:28.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:28.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:28.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:28.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:28.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:28.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:28.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:28.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:28.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:28.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:28.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:28.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:28.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:28.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:28.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:28.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:28.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:28.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:28.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:28.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:28.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:28.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:28.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:28.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121846 ms_local root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:28.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:28.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:28.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:28.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:28.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:28.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:28.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:28.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:28.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:28.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:28.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:28.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:28.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:28.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:28.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:28.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:28.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:28.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:28.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:28.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:28.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:28.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:28.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:28.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:28.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:28.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:28.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:28.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:28.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:28.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:28.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:28.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:28.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:28.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:28.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:28.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:28.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:28.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:28.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:28.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:28.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:28.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:28.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:28.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:28.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:28.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:28.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:28.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:28.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:28.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:28.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:28.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:28.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:28.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:28.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:28.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 14w REG 8,1 134008371 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:28.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:28.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:28.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:28.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:28.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:28.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:28.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:28.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:28.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:28.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:28.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:28.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:28.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:28.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:28.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:28.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:28.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:28.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:28.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:28.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:28.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:28.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:28.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:28.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:28.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:28.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:28.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:28.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:28.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:28.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:28.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:28.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:28.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:28.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:28.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121847 ms_dispat root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:28.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:28.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:28.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:28.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:28.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:28.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:28.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:28.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:28.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:28.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:28.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:28.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:28.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:28.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:28.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:28.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:28.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:28.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:28.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:28.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:28.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:28.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:28.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:28.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:28.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:28.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:28.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:28.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:28.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:28.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:28.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:28.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:28.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:28.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:28.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:28.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:28.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:28.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:28.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:28.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:28.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:28.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:28.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:28.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:28.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:28.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:28.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:28.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:28.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:28.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:28.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:28.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:28.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:28.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:28.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:28.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 14w REG 8,1 134008371 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:28.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:28.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:28.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:28.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:28.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:28.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:28.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:28.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:28.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:28.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:28.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:28.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:28.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:28.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:28.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:28.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:28.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:28.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:28.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:28.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:28.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:28.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:28.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:28.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:28.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:28.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:28.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:28.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:28.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:28.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:28.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:28.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:28.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:28.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:28.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121848 ms_local root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:28.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:28.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:28.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:28.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:28.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:28.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:28.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:28.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:28.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:28.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:28.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:28.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:28.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:28.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:28.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:28.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:28.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:28.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:28.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:28.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:28.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:28.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:28.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:28.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:28.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:28.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:28.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:28.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:28.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:28.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:28.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:28.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:28.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:28.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:28.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:28.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:28.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:28.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:28.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:28.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:28.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:28.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:28.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:28.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:28.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:28.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:28.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:28.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:28.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:28.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:28.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:28.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:28.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:28.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:28.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:28.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 14w REG 8,1 134008371 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:28.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:28.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:28.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:28.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:28.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:28.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:28.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:28.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:28.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:28.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:28.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:28.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:28.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:28.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:28.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:28.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:28.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:28.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:28.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:28.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:28.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:28.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:28.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:28.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:28.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:28.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:28.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:28.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:28.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:28.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:28.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:28.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:28.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:28.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:28.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121849 fn_anonym root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:28.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:28.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:28.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:28.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:28.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:28.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:28.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:28.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:28.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:28.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:28.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:28.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:28.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:28.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:28.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:28.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:28.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:28.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:28.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:28.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:28.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:28.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:28.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:28.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:28.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:28.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:28.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:28.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:28.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:28.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:28.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:28.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:28.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:28.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:28.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:28.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:28.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:28.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:28.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:28.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:28.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:28.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:28.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:28.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:28.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:28.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:28.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:28.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:28.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:28.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:28.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:28.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:28.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:28.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:28.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:28.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:28.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:28.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:28.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:28.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:28.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:28.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:28.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:28.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:28.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:28.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:28.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:28.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:28.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:28.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:28.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 14w REG 8,1 134008371 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:28.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:28.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:28.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:28.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:28.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:28.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:28.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:28.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:28.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:28.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:28.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:28.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:28.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:28.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:28.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:28.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:28.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.983 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.984 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.985 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.986 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:28.987 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:28.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:28.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.988 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:28.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:28.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.989 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:28.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:28.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:28.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:28.990 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:28.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:28.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:28.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:28.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:28.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:28.991 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:28.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:28.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:28.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:28.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:28.992 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:28.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:28.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:28.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:28.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:28.993 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:28.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:28.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:28.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:28.994 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:28.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:28.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:28.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:28.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:28.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:28.995 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121850 finisher root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:28.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:28.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:28.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:28.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:28.996 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:28.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:28.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:28.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:28.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:28.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:28.997 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:28.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:28.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:28.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:28.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:28.998 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:28.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:28.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:28.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:28.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:28.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:28.999 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:29.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:29.000 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.002 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.003 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.004 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.005 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.006 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.007 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.008 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:29.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:29.009 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:29.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:29.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:29.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.010 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:29.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:29.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:29.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:29.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.012 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:29.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 14w REG 8,1 134008371 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:29.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:29.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.013 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:29.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:29.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:29.014 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:29.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:29.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:29.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:29.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:29.015 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:29.016 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:29.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:29.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.017 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:29.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:29.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:29.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:29.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:29.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:29.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:29.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:29.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:29.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:29.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:29.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:29.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:29.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:29.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:29.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:29.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:29.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:29.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:29.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:29.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:29.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121851 safe_time root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:29.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:29.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:29.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:29.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:29.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:29.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:29.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:29.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:29.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:29.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:29.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:29.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:29.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:29.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:29.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 14w REG 8,1 134017745 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:29.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:29.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:29.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:29.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:29.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:29.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:29.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:29.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:29.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:29.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:29.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:29.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:29.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:29.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:29.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:29.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:29.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:29.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:29.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:29.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:29.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:29.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:29.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:29.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:29.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:29.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:29.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:29.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:29.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:29.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:29.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:29.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:29.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:29.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121852 safe_time root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:29.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:29.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:29.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:29.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:29.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:29.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:29.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:29.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:29.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:29.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:29.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:29.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:29.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:29.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:29.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 14w REG 8,1 134017745 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:29.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:29.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:29.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:29.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:29.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:29.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:29.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:29.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:29.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:29.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:29.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:29.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:29.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:29.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:29.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:29.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:29.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:29.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:29.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:29.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:29.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:29.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:29.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:29.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:29.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:29.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:29.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:29.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:29.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:29.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:29.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:29.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:29.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:29.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121853 ceph-osd root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:29.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:29.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:29.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:29.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:29.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:29.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:29.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:29.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:29.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:29.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:29.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:29.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:29.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:29.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:29.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 14w REG 8,1 134017745 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:29.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:29.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:29.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:29.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:29.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:29.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:29.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:29.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:29.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:29.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:29.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:29.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:29.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:29.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:29.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:29.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:29.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:29.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:29.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:29.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:29.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:29.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:29.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:29.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:29.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:29.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:29.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:29.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:29.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:29.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:29.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:29.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:29.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:29.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121854 osd_srv_a root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:29.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:29.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:29.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:29.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:29.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:29.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:29.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:29.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:29.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:29.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:29.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:29.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:29.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:29.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:29.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 14w REG 8,1 134017745 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:29.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:29.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:29.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:29.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:29.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:29.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:29.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:29.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:29.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:29.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:29.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:29.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:29.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:29.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:29.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:29.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:29.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:29.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:29.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:29.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:29.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:29.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:29.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:29.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:29.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:29.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:29.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:29.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:29.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:29.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:29.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:29.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:29.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:29.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121855 tp_osd_tp root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:29.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:29.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:29.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:29.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:29.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:29.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:29.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:29.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:29.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:29.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:29.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:29.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:29.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:29.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:29.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 14w REG 8,1 134017745 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:29.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:29.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:29.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:29.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:29.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:29.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:29.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:29.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:29.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:29.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:29.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:29.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:29.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:29.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:29.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:29.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:29.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:29.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:29.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:29.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:29.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:29.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:29.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:29.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:29.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:29.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:29.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:29.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:29.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:29.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:29.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:29.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:29.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:29.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121856 tp_osd_tp root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:29.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:29.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:29.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:29.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:29.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:29.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:29.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:29.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:29.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:29.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:29.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:29.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:29.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:29.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:29.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 14w REG 8,1 134017745 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:29.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:29.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:29.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:29.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:29.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:29.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:29.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:29.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:29.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:29.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:29.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:29.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:29.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:29.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:29.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:29.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:29.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:29.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:29.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:29.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:29.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:29.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:29.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:29.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:29.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:29.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:29.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:29.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:29.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:29.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:29.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:29.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:29.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:29.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121857 tp_osd_tp root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:29.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:29.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:29.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:29.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:29.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:29.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:29.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:29.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:29.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:29.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:29.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:29.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:29.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:29.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:29.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 14w REG 8,1 134017745 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:29.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:29.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:29.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:29.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:29.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:29.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:29.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:29.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:29.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:29.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:29.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:29.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:29.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:29.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:29.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:29.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:29.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:29.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:29.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:29.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:29.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:29.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:29.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:29.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:29.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:29.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:29.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:29.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:29.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:29.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:29.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:29.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:29.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:29.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121858 tp_osd_tp root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:29.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:29.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:29.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:29.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:29.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:29.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:29.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:29.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:29.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:29.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:29.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:29.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:29.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:29.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:29.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 14w REG 8,1 134017745 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:29.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:29.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:29.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:29.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:29.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:29.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:29.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:29.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:29.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:29.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:29.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:29.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:29.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:29.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:29.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:29.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:29.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:29.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:29.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:29.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:29.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:29.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:29.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:29.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:29.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:29.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:29.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:29.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:29.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:29.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:29.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:29.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:29.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:29.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121859 tp_osd_tp root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:29.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:29.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:29.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:29.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:29.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:29.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:29.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:29.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:29.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:29.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:29.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:29.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:29.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:29.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:29.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 14w REG 8,1 134017745 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:29.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:29.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:29.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:29.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:29.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:29.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:29.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:29.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:29.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:29.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:29.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:29.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:29.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:29.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:29.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:29.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:29.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:29.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:29.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:29.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:29.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:29.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:29.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:29.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:29.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:29.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:29.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:29.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:29.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:29.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:29.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:29.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:29.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:29.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121860 tp_osd_tp root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:29.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:29.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:29.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:29.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:29.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:29.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:29.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:29.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:29.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:29.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:29.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:29.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:29.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:29.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:29.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 14w REG 8,1 134017745 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:29.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:29.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:29.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:29.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:29.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:29.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:29.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:29.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:29.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:29.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:29.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:29.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:29.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:29.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:29.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:29.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:29.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:29.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:29.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:29.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:29.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:29.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:29.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:29.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:29.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:29.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:29.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:29.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:29.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:29.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:29.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:29.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:29.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:29.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121861 tp_osd_tp root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:29.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:29.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:29.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:29.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:29.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:29.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:29.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:29.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:29.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:29.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:29.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:29.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:29.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:29.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:29.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 14w REG 8,1 134017745 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:29.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:29.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:29.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:29.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:29.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:29.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:29.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:29.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:29.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:29.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:29.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:29.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:29.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:29.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:29.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:29.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:29.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:29.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:29.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:29.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:29.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:29.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:29.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:29.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:29.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:29.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:29.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:29.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:29.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:29.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:29.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:29.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:29.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:29.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121862 tp_osd_tp root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:29.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:29.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:29.404 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.405 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:29.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:29.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.406 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.407 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.408 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.409 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.410 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.411 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.412 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.413 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.414 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:29.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:29.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:29.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:29.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:29.415 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:29.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:29.416 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:29.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.417 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:29.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:29.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.418 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 14w REG 8,1 134017745 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:29.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:29.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.419 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:29.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:29.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:29.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:29.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:29.420 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:29.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:29.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:29.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.421 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:29.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:29.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:29.422 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.423 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.424 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.425 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.426 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.427 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.428 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:29.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.429 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.430 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:29.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:29.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:29.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:29.431 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:29.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:29.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:29.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:29.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:29.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:29.432 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:29.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:29.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:29.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:29.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.433 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:29.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:29.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:29.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:29.434 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:29.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:29.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121863 tp_osd_tp root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:29.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.435 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:29.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.436 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.437 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.438 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:29.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.439 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:29.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:29.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.440 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.441 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.442 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.443 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.444 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.445 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.446 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.447 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:29.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.448 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:29.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:29.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:29.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:29.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:29.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:29.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.450 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:29.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:29.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:29.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 14w REG 8,1 134017745 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:29.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:29.452 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:29.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:29.453 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:29.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:29.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:29.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:29.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:29.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:29.454 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:29.455 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:29.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:29.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.456 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.457 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.458 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.459 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.460 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.461 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.462 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:29.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.463 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:29.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:29.464 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:29.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:29.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:29.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:29.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:29.465 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:29.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:29.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:29.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:29.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:29.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:29.466 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:29.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:29.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:29.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:29.467 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:29.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:29.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:29.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121864 tp_osd_tp root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:29.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.468 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:29.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.469 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.470 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.471 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:29.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.472 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:29.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:29.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.473 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.474 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.475 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.476 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.477 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.478 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.479 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.480 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.481 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:29.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:29.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:29.482 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:29.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:29.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.483 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:29.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:29.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:29.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.484 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:29.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:29.485 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 14w REG 8,1 134017745 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:29.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:29.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.486 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:29.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:29.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:29.487 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:29.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:29.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:29.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:29.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:29.488 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:29.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:29.489 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:29.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.490 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.491 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.492 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.495 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:29.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.496 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:29.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:29.498 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:29.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:29.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:29.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:29.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:29.499 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:29.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:29.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:29.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:29.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:29.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:29.500 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:29.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:29.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:29.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:29.501 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:29.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:29.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:29.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121865 tp_osd_tp root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:29.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.502 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:29.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.503 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.504 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.505 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:29.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:29.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:29.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.507 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.509 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.510 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.511 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.512 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.513 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.514 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.515 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:29.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:29.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:29.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:29.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:29.516 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:29.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:29.517 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:29.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:29.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:29.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.519 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 14w REG 8,1 134017745 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:29.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:29.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.520 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:29.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:29.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:29.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:29.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:29.521 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:29.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:29.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:29.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:29.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:29.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:29.523 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.524 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.525 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.526 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.527 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.528 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.529 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:29.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.530 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.531 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:29.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:29.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:29.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:29.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:29.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:29.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:29.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:29.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:29.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:29.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:29.533 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:29.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:29.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:29.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:29.534 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:29.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:29.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:29.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:29.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:29.535 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121866 tp_osd_tp root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:29.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:29.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.536 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.537 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.538 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:29.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.539 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:29.540 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:29.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.541 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.542 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.543 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.544 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.545 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.548 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:29.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:29.549 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:29.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:29.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:29.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.550 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:29.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:29.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:29.551 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:29.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:29.552 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 14w REG 8,1 134017745 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:29.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:29.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.553 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:29.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:29.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:29.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:29.554 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:29.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:29.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:29.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:29.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.555 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:29.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:29.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:29.556 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.557 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.558 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.559 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.560 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.561 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.562 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:29.563 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.564 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:29.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:29.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:29.565 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:29.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:29.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:29.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:29.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:29.566 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:29.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:29.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:29.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:29.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:29.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:29.567 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:29.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:29.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:29.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.568 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:29.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:29.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:29.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121867 tp_osd_tp root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:29.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.569 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:29.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.570 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.571 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.572 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:29.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.573 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:29.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:29.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.574 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.575 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.576 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.577 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.578 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.579 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.580 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.581 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.582 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:29.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:29.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:29.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:29.583 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:29.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:29.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:29.584 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:29.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.585 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:29.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:29.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.586 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 14w REG 8,1 134018028 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:29.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:29.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.587 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:29.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:29.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:29.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:29.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:29.588 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:29.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:29.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:29.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.589 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:29.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:29.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:29.590 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.591 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.592 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.593 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.594 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.595 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.596 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:29.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.597 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.598 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:29.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:29.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:29.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:29.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:29.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:29.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:29.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:29.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:29.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:29.600 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:29.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:29.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:29.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:29.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:29.601 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:29.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:29.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:29.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:29.602 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:29.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121868 tp_osd_tp root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:29.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:29.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.603 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.604 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.605 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:29.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.606 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:29.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:29.607 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.608 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.609 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.610 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.612 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.613 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.614 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.615 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:29.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:29.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:29.616 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:29.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:29.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:29.617 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:29.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:29.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.618 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:29.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:29.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 14w REG 8,1 134018028 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:29.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:29.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.620 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:29.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:29.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:29.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:29.621 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:29.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:29.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:29.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:29.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.622 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:29.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:29.623 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:29.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.624 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.625 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.626 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.627 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.628 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.629 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:29.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.630 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.631 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:29.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:29.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:29.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:29.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:29.632 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:29.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:29.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:29.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:29.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:29.633 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:29.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:29.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:29.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:29.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:29.634 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:29.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:29.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:29.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:29.635 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:29.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121869 tp_osd_tp root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:29.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:29.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.636 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.637 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.638 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:29.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.639 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:29.640 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:29.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.641 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.642 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.643 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.644 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.645 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.646 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.647 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.648 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:29.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.649 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:29.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:29.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:29.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:29.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.650 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:29.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:29.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.651 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:29.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:29.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.652 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:29.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 14w REG 8,1 134018028 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:29.653 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:29.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:29.654 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:29.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:29.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:29.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:29.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:29.655 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:29.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:29.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.656 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:29.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:29.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:29.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.657 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.658 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.659 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.660 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.661 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.662 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.663 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:29.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.664 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:29.665 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:29.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:29.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:29.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:29.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:29.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:29.666 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:29.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:29.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:29.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:29.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:29.667 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:29.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:29.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:29.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:29.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:29.668 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:29.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:29.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:29.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121870 tp_osd_tp root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:29.669 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root txt REG 8,1 25615776 2981 /usr/bin/ceph-osd 2023-11-04T01:48:29.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 74496 276311 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:48:29.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 116440 276338 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:48:29.670 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 128888 276290 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:48:29.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 91248 276326 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:48:29.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 83008 276308 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:48:29.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 49424 276314 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:48:29.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 1350912 276335 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:48:29.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 224600 276302 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:48:29.671 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 864280 276332 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:48:29.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 45176 276347 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:48:29.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 65968 276350 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:48:29.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 74936 276293 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:48:29.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 41168 276296 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:48:29.672 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 36976 276353 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:48:29.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 70536 276299 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:48:29.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 69736 2358 /usr/lib64/liboath.so.0.1.3 2023-11-04T01:48:29.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 70424 276323 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:48:29.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 409304 276329 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:48:29.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 37064 276305 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:48:29.673 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 32512 276320 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:48:29.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 32664 276261 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:48:29.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root DEL REG 0,17 205804 /[aio] 2023-11-04T01:48:29.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root DEL REG 0,17 205792 /[aio] 2023-11-04T01:48:29.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 1469128 276280 /usr/lib64/ceph/erasure-code/libec_lrc.so 2023-11-04T01:48:29.674 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 353384 276276 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:48:29.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 74672 276286 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:48:29.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.675 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.676 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.677 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.678 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.679 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.680 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.681 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:29.682 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-11-04T01:48:29.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2023-11-04T01:48:29.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2023-11-04T01:48:29.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:29.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.683 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 1w FIFO 0,13 0t0 211072 pipe 2023-11-04T01:48:29.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 2w FIFO 0,13 0t0 211073 pipe 2023-11-04T01:48:29.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 3r FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.684 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 4w FIFO 0,13 0t0 203592 pipe 2023-11-04T01:48:29.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20,21,22,23,24,25,26,64,68,70,74,76,79,82,85,88,91,94,97,100] 2023-11-04T01:48:29.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 6r FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 7w FIFO 0,13 0t0 203594 pipe 2023-11-04T01:48:29.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 8u a_inode 0,14 0 3100 [eventpoll:9,58,65,66,71,73,77,80,83,86,89,92,95,98] 2023-11-04T01:48:29.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 9r FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.685 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 10w FIFO 0,13 0t0 203595 pipe 2023-11-04T01:48:29.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 11u a_inode 0,14 0 3100 [eventpoll:12,61,67,69,72,75,78,81,84,87,90,93,96,99] 2023-11-04T01:48:29.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 12r FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 13w FIFO 0,13 0t0 203596 pipe 2023-11-04T01:48:29.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 14w REG 8,1 134018028 265463 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:48:29.686 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 15uW REG 0,24 7 1753 /run/ceph/ceph-osd.3.pid 2023-11-04T01:48:29.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 16r FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 17w FIFO 0,13 0t0 212331 pipe 2023-11-04T01:48:29.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 18u unix 0xffff9ba900b3b740 0t0 212332 /var/run/ceph/ceph-osd.3.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 19u IPv4 204676 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:48:29.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 20u IPv4 204702 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:48:29.687 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 21u IPv4 204729 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:48:29.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 22u IPv4 204757 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:48:29.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 23u IPv4 204786 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:48:29.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 24u IPv4 214032 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:48:29.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 25u IPv4 214063 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:48:29.688 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 26u IPv4 214095 0t0 TCP *:ambit-lm (LISTEN) 2023-11-04T01:48:29.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 27r FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 28w FIFO 0,13 0t0 213215 pipe 2023-11-04T01:48:29.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 29r FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 30w FIFO 0,13 0t0 213216 pipe 2023-11-04T01:48:29.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 31u sock 0,8 0t0 212360 protocol: UDPv6 2023-11-04T01:48:29.689 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:48:29.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:48:29.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.690 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.691 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.692 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.693 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:48:29.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 58u IPv4 213431 0t0 TCP smithi077.front.sepia.ceph.com:41658->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.694 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 59r FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 60w FIFO 0,13 0t0 212372 pipe 2023-11-04T01:48:29.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 61u IPv4 211175 0t0 TCP smithi077.front.sepia.ceph.com:56876->smithi077.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 62r FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 63w FIFO 0,13 0t0 205810 pipe 2023-11-04T01:48:29.695 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 64u IPv4 214151 0t0 TCP smithi077.front.sepia.ceph.com:45752->smithi077.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 65u IPv4 212387 0t0 TCP smithi077.front.sepia.ceph.com:35086->smithi122.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 66u IPv4 212388 0t0 TCP smithi077.front.sepia.ceph.com:40072->smithi122.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:48:29.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 67u IPv4 211176 0t0 TCP smithi077.front.sepia.ceph.com:47154->smithi122.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 68u IPv4 214152 0t0 TCP smithi077.front.sepia.ceph.com:48500->smithi122.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:48:29.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 69u IPv4 211177 0t0 TCP smithi077.front.sepia.ceph.com:48752->smithi122.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:48:29.696 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 70u IPv4 214153 0t0 TCP smithi077.front.sepia.ceph.com:57716->smithi122.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 71u IPv4 210651 0t0 TCP smithi077.front.sepia.ceph.com:53166->smithi122.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:48:29.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 72u IPv4 211178 0t0 TCP smithi077.front.sepia.ceph.com:48014->smithi122.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:48:29.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 73u IPv4 210652 0t0 TCP smithi077.front.sepia.ceph.com:45440->smithi077.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:48:29.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 74u IPv4 212389 0t0 TCP smithi077.front.sepia.ceph.com:45176->smithi077.front.sepia.ceph.com:6815 (ESTABLISHED) 2023-11-04T01:48:29.697 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 75u IPv4 211179 0t0 TCP smithi077.front.sepia.ceph.com:48714->smithi077.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:48:29.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 76u IPv4 212390 0t0 TCP smithi077.front.sepia.ceph.com:58166->smithi077.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:48:29.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 77u IPv4 209890 0t0 TCP smithi077.front.sepia.ceph.com:56874->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 78u IPv4 214179 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59526 (ESTABLISHED) 2023-11-04T01:48:29.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 79u IPv4 214180 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56776 (ESTABLISHED) 2023-11-04T01:48:29.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 80u IPv4 214181 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56786 (ESTABLISHED) 2023-11-04T01:48:29.698 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 81u IPv4 214182 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59542 (ESTABLISHED) 2023-11-04T01:48:29.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 82u IPv4 214185 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47160 (ESTABLISHED) 2023-11-04T01:48:29.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 83u IPv4 214186 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47170 (ESTABLISHED) 2023-11-04T01:48:29.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 84u IPv4 214187 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-04T01:48:29.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 85u IPv4 214190 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39860 (ESTABLISHED) 2023-11-04T01:48:29.699 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 86u IPv4 212396 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59550 (ESTABLISHED) 2023-11-04T01:48:29.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 87u IPv4 211203 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39874 (ESTABLISHED) 2023-11-04T01:48:29.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 88u IPv4 210664 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi077.front.sepia.ceph.com:47172 (ESTABLISHED) 2023-11-04T01:48:29.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 89u IPv4 210667 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi077.front.sepia.ceph.com:56790 (ESTABLISHED) 2023-11-04T01:48:29.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 90u IPv4 214199 0t0 TCP smithi077.front.sepia.ceph.com:6828->smithi122.front.sepia.ceph.com:59558 (ESTABLISHED) 2023-11-04T01:48:29.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 91u IPv4 210674 0t0 TCP smithi077.front.sepia.ceph.com:6830->smithi122.front.sepia.ceph.com:39884 (ESTABLISHED) 2023-11-04T01:48:29.700 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 92u IPv4 211214 0t0 TCP smithi077.front.sepia.ceph.com:36284->smithi077.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 93u IPv4 212414 0t0 TCP smithi077.front.sepia.ceph.com:57686->smithi077.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:48:29.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 94u IPv4 213446 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43464 (ESTABLISHED) 2023-11-04T01:48:29.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 95u IPv4 203703 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43468 (ESTABLISHED) 2023-11-04T01:48:29.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 96u IPv4 211220 0t0 TCP smithi077.front.sepia.ceph.com:41026->smithi122.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:48:29.701 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 97u IPv4 203770 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:41956 (ESTABLISHED) 2023-11-04T01:48:29.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 98u IPv4 212420 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi077.front.sepia.ceph.com:56798 (ESTABLISHED) 2023-11-04T01:48:29.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 99u IPv4 212421 0t0 TCP smithi077.front.sepia.ceph.com:6826->smithi122.front.sepia.ceph.com:43478 (ESTABLISHED) 2023-11-04T01:48:29.702 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-osd 118555 121871 osd_srv_h root 100u IPv4 284998 0t0 TCP smithi077.front.sepia.ceph.com:6824->smithi122.front.sepia.ceph.com:49102 (ESTABLISHED) 2023-11-04T01:48:29.702 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/3 121939 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:29.702 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/3 121939 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.703 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/3 121939 root txt unknown /proc/121939/exe 2023-11-04T01:48:29.703 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/7 122005 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:29.703 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/7 122005 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.703 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/7 122005 root txt unknown /proc/122005/exe 2023-11-04T01:48:29.703 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/6 122132 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:29.703 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/6 122132 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.704 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/6 122132 root txt unknown /proc/122132/exe 2023-11-04T01:48:29.704 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/6 122380 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:29.704 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/6 122380 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.704 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/6 122380 root txt unknown /proc/122380/exe 2023-11-04T01:48:29.704 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/7 122427 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:29.704 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/7 122427 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.705 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/7 122427 root txt unknown /proc/122427/exe 2023-11-04T01:48:29.705 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/3 122485 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:29.705 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/3 122485 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.705 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/3 122485 root txt unknown /proc/122485/exe 2023-11-04T01:48:29.705 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/0 123001 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:29.706 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/0 123001 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.706 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/0 123001 root txt unknown /proc/123001/exe 2023-11-04T01:48:29.706 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/2 123025 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:29.706 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/2 123025 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.706 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/2 123025 root txt unknown /proc/123025/exe 2023-11-04T01:48:29.706 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/2 123268 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:29.707 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/2 123268 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.707 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/2 123268 root txt unknown /proc/123268/exe 2023-11-04T01:48:29.707 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/0 123737 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:29.707 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/0 123737 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.707 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/0 123737 root txt unknown /proc/123737/exe 2023-11-04T01:48:29.708 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/1 123889 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:29.708 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/1 123889 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.708 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/1 123889 root txt unknown /proc/123889/exe 2023-11-04T01:48:29.708 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/1 123894 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:29.708 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/1 123894 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.708 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/1 123894 root txt unknown /proc/123894/exe 2023-11-04T01:48:29.709 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/u 150403 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:29.709 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/u 150403 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.709 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/u 150403 root txt unknown /proc/150403/exe 2023-11-04T01:48:29.709 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/3 152088 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:29.709 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/3 152088 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.710 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/3 152088 root txt unknown /proc/152088/exe 2023-11-04T01:48:29.710 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/1 152089 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:29.710 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/1 152089 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.710 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/1 152089 root txt unknown /proc/152089/exe 2023-11-04T01:48:29.710 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/0 152471 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:29.711 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/0 152471 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.711 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/0 152471 root txt unknown /proc/152471/exe 2023-11-04T01:48:29.711 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/7 152472 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:29.711 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/7 152472 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.711 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/7 152472 root txt unknown /proc/152472/exe 2023-11-04T01:48:29.711 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/0 154268 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:29.712 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/0 154268 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.712 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/0 154268 root txt unknown /proc/154268/exe 2023-11-04T01:48:29.712 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/0 154269 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:29.712 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/0 154269 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.712 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/0 154269 root txt unknown /proc/154269/exe 2023-11-04T01:48:29.713 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/5 156438 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:29.713 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/5 156438 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.713 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/5 156438 root txt unknown /proc/156438/exe 2023-11-04T01:48:29.713 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.713 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.713 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:48:29.714 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:48:29.714 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:29.714 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.714 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:48:29.714 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:29.715 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:48:29.715 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:48:29.715 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:48:29.715 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:48:29.715 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.716 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:48:29.716 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:48:29.716 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:48:29.716 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:48:29.716 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:48:29.716 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:48:29.717 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.717 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.717 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.717 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.717 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.717 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.718 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.718 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.718 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.718 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.718 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.719 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:48:29.719 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.719 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:48:29.719 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.719 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.720 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.720 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:48:29.720 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:29.720 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.720 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:48:29.720 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:48:29.721 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:48:29.721 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:48:29.721 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:48:29.721 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:48:29.721 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:48:29.722 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:48:29.722 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:48:29.722 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:48:29.722 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:48:29.722 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:48:29.723 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.723 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:48:29.723 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:48:29.723 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.723 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:48:29.723 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:29.724 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.724 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:48:29.724 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root 0r FIFO 0,13 0t0 285076 pipe 2023-11-04T01:48:29.724 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root 1w FIFO 0,13 0t0 285077 pipe 2023-11-04T01:48:29.724 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root 2w FIFO 0,13 0t0 285078 pipe 2023-11-04T01:48:29.725 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root 3r FIFO 0,13 0t0 285088 pipe 2023-11-04T01:48:29.725 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root 4w FIFO 0,13 0t0 285088 pipe 2023-11-04T01:48:29.725 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root 5u netlink 0t0 285093 AUDIT 2023-11-04T01:48:29.725 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 156782 root 6u unix 0xffff9ba908398880 0t0 285094 type=DGRAM (CONNECTED) 2023-11-04T01:48:29.725 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 156816 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.725 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 156816 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.726 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 156816 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:48:29.726 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 156816 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:29.726 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 156816 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:48:29.726 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 156816 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.726 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 156816 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:29.727 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 156816 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.727 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 156816 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:29.727 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 156816 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:29.727 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 156816 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:29.727 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 156816 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.727 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 156816 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:48:29.728 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 156816 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:29.728 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 156816 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:29.728 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 156816 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:29.728 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 156816 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:29.728 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 156816 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:29.729 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 156816 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:29.729 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 156816 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:29.729 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 156816 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:29.729 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 156816 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.729 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 156816 root 0r FIFO 0,13 0t0 285076 pipe 2023-11-04T01:48:29.730 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 156816 root 1w FIFO 0,13 0t0 285077 pipe 2023-11-04T01:48:29.730 INFO:teuthology.orchestra.run.smithi077.stdout:daemon-he 156816 root 2w FIFO 0,13 0t0 285078 pipe 2023-11-04T01:48:29.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root txt REG 8,1 6696672 2994 /usr/bin/ceph-mds 2023-11-04T01:48:29.730 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.731 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.732 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.733 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.734 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.735 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.736 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:29.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.737 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.738 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:48:29.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root 1w FIFO 0,13 0t0 285077 pipe 2023-11-04T01:48:29.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root 2w FIFO 0,13 0t0 285078 pipe 2023-11-04T01:48:29.739 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root 3r FIFO 0,13 0t0 283189 pipe 2023-11-04T01:48:29.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root 4w FIFO 0,13 0t0 283189 pipe 2023-11-04T01:48:29.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20] 2023-11-04T01:48:29.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root 6r FIFO 0,13 0t0 283191 pipe 2023-11-04T01:48:29.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root 7w FIFO 0,13 0t0 283191 pipe 2023-11-04T01:48:29.740 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root 8u a_inode 0,14 0 3100 [eventpoll:9,25] 2023-11-04T01:48:29.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root 9r FIFO 0,13 0t0 283192 pipe 2023-11-04T01:48:29.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root 10w FIFO 0,13 0t0 283192 pipe 2023-11-04T01:48:29.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root 11u a_inode 0,14 0 3100 [eventpoll:12,30] 2023-11-04T01:48:29.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root 12r FIFO 0,13 0t0 283193 pipe 2023-11-04T01:48:29.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root 13w FIFO 0,13 0t0 283193 pipe 2023-11-04T01:48:29.741 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root 14w REG 8,1 3920275 265473 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:48:29.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root 15uW REG 0,24 7 2430 /run/ceph/ceph-mds.a.pid 2023-11-04T01:48:29.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root 16r FIFO 0,13 0t0 282324 pipe 2023-11-04T01:48:29.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root 17w FIFO 0,13 0t0 282324 pipe 2023-11-04T01:48:29.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root 18u unix 0xffff9ba9201bf700 0t0 282325 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.742 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root 19u IPv4 285137 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:48:29.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root 20u IPv4 285173 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:48:29.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root 21r FIFO 0,13 0t0 282327 pipe 2023-11-04T01:48:29.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root 22w FIFO 0,13 0t0 282327 pipe 2023-11-04T01:48:29.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root 23r FIFO 0,13 0t0 282328 pipe 2023-11-04T01:48:29.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root 24w FIFO 0,13 0t0 282328 pipe 2023-11-04T01:48:29.743 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root 25u IPv4 283197 0t0 TCP smithi077.front.sepia.ceph.com:46096->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root 26r FIFO 0,13 0t0 282329 pipe 2023-11-04T01:48:29.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root 27w FIFO 0,13 0t0 282329 pipe 2023-11-04T01:48:29.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root 28r FIFO 0,13 0t0 282330 pipe 2023-11-04T01:48:29.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root 29w FIFO 0,13 0t0 282330 pipe 2023-11-04T01:48:29.744 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 root 30u IPv4 285185 0t0 TCP smithi077.front.sepia.ceph.com:36856->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root txt REG 8,1 6696672 2994 /usr/bin/ceph-mds 2023-11-04T01:48:29.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.745 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.746 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.747 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.748 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.749 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.750 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:29.751 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.752 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:48:29.753 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root 1w FIFO 0,13 0t0 285077 pipe 2023-11-04T01:48:29.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root 2w FIFO 0,13 0t0 285078 pipe 2023-11-04T01:48:29.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root 3r FIFO 0,13 0t0 283189 pipe 2023-11-04T01:48:29.754 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root 4w FIFO 0,13 0t0 283189 pipe 2023-11-04T01:48:29.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20] 2023-11-04T01:48:29.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root 6r FIFO 0,13 0t0 283191 pipe 2023-11-04T01:48:29.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root 7w FIFO 0,13 0t0 283191 pipe 2023-11-04T01:48:29.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root 8u a_inode 0,14 0 3100 [eventpoll:9,25] 2023-11-04T01:48:29.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root 9r FIFO 0,13 0t0 283192 pipe 2023-11-04T01:48:29.755 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root 10w FIFO 0,13 0t0 283192 pipe 2023-11-04T01:48:29.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root 11u a_inode 0,14 0 3100 [eventpoll:12,30] 2023-11-04T01:48:29.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root 12r FIFO 0,13 0t0 283193 pipe 2023-11-04T01:48:29.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root 13w FIFO 0,13 0t0 283193 pipe 2023-11-04T01:48:29.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root 14w REG 8,1 3920275 265473 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:48:29.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root 15uW REG 0,24 7 2430 /run/ceph/ceph-mds.a.pid 2023-11-04T01:48:29.756 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root 16r FIFO 0,13 0t0 282324 pipe 2023-11-04T01:48:29.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root 17w FIFO 0,13 0t0 282324 pipe 2023-11-04T01:48:29.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root 18u unix 0xffff9ba9201bf700 0t0 282325 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root 19u IPv4 285137 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:48:29.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root 20u IPv4 285173 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:48:29.757 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root 21r FIFO 0,13 0t0 282327 pipe 2023-11-04T01:48:29.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root 22w FIFO 0,13 0t0 282327 pipe 2023-11-04T01:48:29.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root 23r FIFO 0,13 0t0 282328 pipe 2023-11-04T01:48:29.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root 24w FIFO 0,13 0t0 282328 pipe 2023-11-04T01:48:29.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root 25u IPv4 283197 0t0 TCP smithi077.front.sepia.ceph.com:46096->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.758 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root 26r FIFO 0,13 0t0 282329 pipe 2023-11-04T01:48:29.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root 27w FIFO 0,13 0t0 282329 pipe 2023-11-04T01:48:29.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root 28r FIFO 0,13 0t0 282330 pipe 2023-11-04T01:48:29.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root 29w FIFO 0,13 0t0 282330 pipe 2023-11-04T01:48:29.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156822 log root 30u IPv4 285185 0t0 TCP smithi077.front.sepia.ceph.com:36856->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.759 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root txt REG 8,1 6696672 2994 /usr/bin/ceph-mds 2023-11-04T01:48:29.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.760 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.761 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.762 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.763 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.765 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.766 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.767 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:29.768 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.769 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:48:29.770 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root 1w FIFO 0,13 0t0 285077 pipe 2023-11-04T01:48:29.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root 2w FIFO 0,13 0t0 285078 pipe 2023-11-04T01:48:29.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root 3r FIFO 0,13 0t0 283189 pipe 2023-11-04T01:48:29.771 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root 4w FIFO 0,13 0t0 283189 pipe 2023-11-04T01:48:29.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20] 2023-11-04T01:48:29.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root 6r FIFO 0,13 0t0 283191 pipe 2023-11-04T01:48:29.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root 7w FIFO 0,13 0t0 283191 pipe 2023-11-04T01:48:29.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root 8u a_inode 0,14 0 3100 [eventpoll:9,25] 2023-11-04T01:48:29.772 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root 9r FIFO 0,13 0t0 283192 pipe 2023-11-04T01:48:29.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root 10w FIFO 0,13 0t0 283192 pipe 2023-11-04T01:48:29.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root 11u a_inode 0,14 0 3100 [eventpoll:12,30] 2023-11-04T01:48:29.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root 12r FIFO 0,13 0t0 283193 pipe 2023-11-04T01:48:29.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root 13w FIFO 0,13 0t0 283193 pipe 2023-11-04T01:48:29.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root 14w REG 8,1 3920275 265473 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:48:29.773 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root 15uW REG 0,24 7 2430 /run/ceph/ceph-mds.a.pid 2023-11-04T01:48:29.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root 16r FIFO 0,13 0t0 282324 pipe 2023-11-04T01:48:29.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root 17w FIFO 0,13 0t0 282324 pipe 2023-11-04T01:48:29.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root 18u unix 0xffff9ba9201bf700 0t0 282325 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.774 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root 19u IPv4 285137 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:48:29.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root 20u IPv4 285173 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:48:29.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root 21r FIFO 0,13 0t0 282327 pipe 2023-11-04T01:48:29.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root 22w FIFO 0,13 0t0 282327 pipe 2023-11-04T01:48:29.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root 23r FIFO 0,13 0t0 282328 pipe 2023-11-04T01:48:29.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root 24w FIFO 0,13 0t0 282328 pipe 2023-11-04T01:48:29.775 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root 25u IPv4 283197 0t0 TCP smithi077.front.sepia.ceph.com:46096->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root 26r FIFO 0,13 0t0 282329 pipe 2023-11-04T01:48:29.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root 27w FIFO 0,13 0t0 282329 pipe 2023-11-04T01:48:29.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root 28r FIFO 0,13 0t0 282330 pipe 2023-11-04T01:48:29.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root 29w FIFO 0,13 0t0 282330 pipe 2023-11-04T01:48:29.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156824 msgr-work root 30u IPv4 285185 0t0 TCP smithi077.front.sepia.ceph.com:36856->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.776 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root txt REG 8,1 6696672 2994 /usr/bin/ceph-mds 2023-11-04T01:48:29.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.777 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.778 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.779 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.780 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.781 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.783 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:29.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.785 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:48:29.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.786 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root 1w FIFO 0,13 0t0 285077 pipe 2023-11-04T01:48:29.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root 2w FIFO 0,13 0t0 285078 pipe 2023-11-04T01:48:29.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root 3r FIFO 0,13 0t0 283189 pipe 2023-11-04T01:48:29.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root 4w FIFO 0,13 0t0 283189 pipe 2023-11-04T01:48:29.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20] 2023-11-04T01:48:29.787 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root 6r FIFO 0,13 0t0 283191 pipe 2023-11-04T01:48:29.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root 7w FIFO 0,13 0t0 283191 pipe 2023-11-04T01:48:29.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root 8u a_inode 0,14 0 3100 [eventpoll:9,25] 2023-11-04T01:48:29.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root 9r FIFO 0,13 0t0 283192 pipe 2023-11-04T01:48:29.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root 10w FIFO 0,13 0t0 283192 pipe 2023-11-04T01:48:29.788 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root 11u a_inode 0,14 0 3100 [eventpoll:12,30] 2023-11-04T01:48:29.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root 12r FIFO 0,13 0t0 283193 pipe 2023-11-04T01:48:29.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root 13w FIFO 0,13 0t0 283193 pipe 2023-11-04T01:48:29.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root 14w REG 8,1 3920275 265473 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:48:29.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root 15uW REG 0,24 7 2430 /run/ceph/ceph-mds.a.pid 2023-11-04T01:48:29.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root 16r FIFO 0,13 0t0 282324 pipe 2023-11-04T01:48:29.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root 17w FIFO 0,13 0t0 282324 pipe 2023-11-04T01:48:29.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root 18u unix 0xffff9ba9201bf700 0t0 282325 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root 19u IPv4 285137 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:48:29.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root 20u IPv4 285173 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:48:29.790 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root 21r FIFO 0,13 0t0 282327 pipe 2023-11-04T01:48:29.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root 22w FIFO 0,13 0t0 282327 pipe 2023-11-04T01:48:29.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root 23r FIFO 0,13 0t0 282328 pipe 2023-11-04T01:48:29.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root 24w FIFO 0,13 0t0 282328 pipe 2023-11-04T01:48:29.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root 25u IPv4 283197 0t0 TCP smithi077.front.sepia.ceph.com:46096->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.791 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root 26r FIFO 0,13 0t0 282329 pipe 2023-11-04T01:48:29.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root 27w FIFO 0,13 0t0 282329 pipe 2023-11-04T01:48:29.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root 28r FIFO 0,13 0t0 282330 pipe 2023-11-04T01:48:29.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root 29w FIFO 0,13 0t0 282330 pipe 2023-11-04T01:48:29.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156825 msgr-work root 30u IPv4 285185 0t0 TCP smithi077.front.sepia.ceph.com:36856->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.792 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root txt REG 8,1 6696672 2994 /usr/bin/ceph-mds 2023-11-04T01:48:29.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.793 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.795 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.796 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.797 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.798 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.799 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:29.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.800 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.801 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:48:29.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root 1w FIFO 0,13 0t0 285077 pipe 2023-11-04T01:48:29.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root 2w FIFO 0,13 0t0 285078 pipe 2023-11-04T01:48:29.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root 3r FIFO 0,13 0t0 283189 pipe 2023-11-04T01:48:29.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root 4w FIFO 0,13 0t0 283189 pipe 2023-11-04T01:48:29.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20] 2023-11-04T01:48:29.803 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root 6r FIFO 0,13 0t0 283191 pipe 2023-11-04T01:48:29.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root 7w FIFO 0,13 0t0 283191 pipe 2023-11-04T01:48:29.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root 8u a_inode 0,14 0 3100 [eventpoll:9,25] 2023-11-04T01:48:29.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root 9r FIFO 0,13 0t0 283192 pipe 2023-11-04T01:48:29.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root 10w FIFO 0,13 0t0 283192 pipe 2023-11-04T01:48:29.804 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root 11u a_inode 0,14 0 3100 [eventpoll:12,30] 2023-11-04T01:48:29.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root 12r FIFO 0,13 0t0 283193 pipe 2023-11-04T01:48:29.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root 13w FIFO 0,13 0t0 283193 pipe 2023-11-04T01:48:29.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root 14w REG 8,1 3920275 265473 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:48:29.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root 15uW REG 0,24 7 2430 /run/ceph/ceph-mds.a.pid 2023-11-04T01:48:29.805 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root 16r FIFO 0,13 0t0 282324 pipe 2023-11-04T01:48:29.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root 17w FIFO 0,13 0t0 282324 pipe 2023-11-04T01:48:29.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root 18u unix 0xffff9ba9201bf700 0t0 282325 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root 19u IPv4 285137 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:48:29.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root 20u IPv4 285173 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:48:29.806 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root 21r FIFO 0,13 0t0 282327 pipe 2023-11-04T01:48:29.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root 22w FIFO 0,13 0t0 282327 pipe 2023-11-04T01:48:29.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root 23r FIFO 0,13 0t0 282328 pipe 2023-11-04T01:48:29.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root 24w FIFO 0,13 0t0 282328 pipe 2023-11-04T01:48:29.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root 25u IPv4 283197 0t0 TCP smithi077.front.sepia.ceph.com:46096->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root 26r FIFO 0,13 0t0 282329 pipe 2023-11-04T01:48:29.807 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root 27w FIFO 0,13 0t0 282329 pipe 2023-11-04T01:48:29.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root 28r FIFO 0,13 0t0 282330 pipe 2023-11-04T01:48:29.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root 29w FIFO 0,13 0t0 282330 pipe 2023-11-04T01:48:29.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156826 msgr-work root 30u IPv4 285185 0t0 TCP smithi077.front.sepia.ceph.com:36856->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.808 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root txt REG 8,1 6696672 2994 /usr/bin/ceph-mds 2023-11-04T01:48:29.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.809 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.810 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.811 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.812 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.813 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.814 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.815 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:29.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.816 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.817 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:48:29.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root 1w FIFO 0,13 0t0 285077 pipe 2023-11-04T01:48:29.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root 2w FIFO 0,13 0t0 285078 pipe 2023-11-04T01:48:29.818 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root 3r FIFO 0,13 0t0 283189 pipe 2023-11-04T01:48:29.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root 4w FIFO 0,13 0t0 283189 pipe 2023-11-04T01:48:29.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20] 2023-11-04T01:48:29.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root 6r FIFO 0,13 0t0 283191 pipe 2023-11-04T01:48:29.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root 7w FIFO 0,13 0t0 283191 pipe 2023-11-04T01:48:29.819 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root 8u a_inode 0,14 0 3100 [eventpoll:9,25] 2023-11-04T01:48:29.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root 9r FIFO 0,13 0t0 283192 pipe 2023-11-04T01:48:29.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root 10w FIFO 0,13 0t0 283192 pipe 2023-11-04T01:48:29.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root 11u a_inode 0,14 0 3100 [eventpoll:12,30] 2023-11-04T01:48:29.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root 12r FIFO 0,13 0t0 283193 pipe 2023-11-04T01:48:29.820 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root 13w FIFO 0,13 0t0 283193 pipe 2023-11-04T01:48:29.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root 14w REG 8,1 3920275 265473 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:48:29.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root 15uW REG 0,24 7 2430 /run/ceph/ceph-mds.a.pid 2023-11-04T01:48:29.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root 16r FIFO 0,13 0t0 282324 pipe 2023-11-04T01:48:29.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root 17w FIFO 0,13 0t0 282324 pipe 2023-11-04T01:48:29.821 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root 18u unix 0xffff9ba9201bf700 0t0 282325 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root 19u IPv4 285137 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:48:29.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root 20u IPv4 285173 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:48:29.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root 21r FIFO 0,13 0t0 282327 pipe 2023-11-04T01:48:29.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root 22w FIFO 0,13 0t0 282327 pipe 2023-11-04T01:48:29.822 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root 23r FIFO 0,13 0t0 282328 pipe 2023-11-04T01:48:29.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root 24w FIFO 0,13 0t0 282328 pipe 2023-11-04T01:48:29.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root 25u IPv4 283197 0t0 TCP smithi077.front.sepia.ceph.com:46096->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root 26r FIFO 0,13 0t0 282329 pipe 2023-11-04T01:48:29.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root 27w FIFO 0,13 0t0 282329 pipe 2023-11-04T01:48:29.823 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root 28r FIFO 0,13 0t0 282330 pipe 2023-11-04T01:48:29.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root 29w FIFO 0,13 0t0 282330 pipe 2023-11-04T01:48:29.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156830 service root 30u IPv4 285185 0t0 TCP smithi077.front.sepia.ceph.com:36856->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.824 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root txt REG 8,1 6696672 2994 /usr/bin/ceph-mds 2023-11-04T01:48:29.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.825 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.826 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.827 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.828 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.829 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.830 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.831 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:29.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.832 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.833 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:48:29.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root 1w FIFO 0,13 0t0 285077 pipe 2023-11-04T01:48:29.834 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root 2w FIFO 0,13 0t0 285078 pipe 2023-11-04T01:48:29.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root 3r FIFO 0,13 0t0 283189 pipe 2023-11-04T01:48:29.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root 4w FIFO 0,13 0t0 283189 pipe 2023-11-04T01:48:29.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20] 2023-11-04T01:48:29.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root 6r FIFO 0,13 0t0 283191 pipe 2023-11-04T01:48:29.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root 7w FIFO 0,13 0t0 283191 pipe 2023-11-04T01:48:29.835 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root 8u a_inode 0,14 0 3100 [eventpoll:9,25] 2023-11-04T01:48:29.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root 9r FIFO 0,13 0t0 283192 pipe 2023-11-04T01:48:29.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root 10w FIFO 0,13 0t0 283192 pipe 2023-11-04T01:48:29.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root 11u a_inode 0,14 0 3100 [eventpoll:12,30] 2023-11-04T01:48:29.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root 12r FIFO 0,13 0t0 283193 pipe 2023-11-04T01:48:29.836 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root 13w FIFO 0,13 0t0 283193 pipe 2023-11-04T01:48:29.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root 14w REG 8,1 3920275 265473 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:48:29.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root 15uW REG 0,24 7 2430 /run/ceph/ceph-mds.a.pid 2023-11-04T01:48:29.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root 16r FIFO 0,13 0t0 282324 pipe 2023-11-04T01:48:29.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root 17w FIFO 0,13 0t0 282324 pipe 2023-11-04T01:48:29.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root 18u unix 0xffff9ba9201bf700 0t0 282325 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root 19u IPv4 285137 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:48:29.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root 20u IPv4 285173 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:48:29.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root 21r FIFO 0,13 0t0 282327 pipe 2023-11-04T01:48:29.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root 22w FIFO 0,13 0t0 282327 pipe 2023-11-04T01:48:29.838 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root 23r FIFO 0,13 0t0 282328 pipe 2023-11-04T01:48:29.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root 24w FIFO 0,13 0t0 282328 pipe 2023-11-04T01:48:29.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root 25u IPv4 283197 0t0 TCP smithi077.front.sepia.ceph.com:46096->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root 26r FIFO 0,13 0t0 282329 pipe 2023-11-04T01:48:29.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root 27w FIFO 0,13 0t0 282329 pipe 2023-11-04T01:48:29.839 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root 28r FIFO 0,13 0t0 282330 pipe 2023-11-04T01:48:29.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root 29w FIFO 0,13 0t0 282330 pipe 2023-11-04T01:48:29.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156831 admin_soc root 30u IPv4 285185 0t0 TCP smithi077.front.sepia.ceph.com:36856->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.840 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root txt REG 8,1 6696672 2994 /usr/bin/ceph-mds 2023-11-04T01:48:29.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.841 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.842 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.843 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.844 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.845 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.846 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:29.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.847 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.848 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:48:29.849 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root 1w FIFO 0,13 0t0 285077 pipe 2023-11-04T01:48:29.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root 2w FIFO 0,13 0t0 285078 pipe 2023-11-04T01:48:29.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root 3r FIFO 0,13 0t0 283189 pipe 2023-11-04T01:48:29.850 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root 4w FIFO 0,13 0t0 283189 pipe 2023-11-04T01:48:29.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20] 2023-11-04T01:48:29.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root 6r FIFO 0,13 0t0 283191 pipe 2023-11-04T01:48:29.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root 7w FIFO 0,13 0t0 283191 pipe 2023-11-04T01:48:29.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root 8u a_inode 0,14 0 3100 [eventpoll:9,25] 2023-11-04T01:48:29.851 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root 9r FIFO 0,13 0t0 283192 pipe 2023-11-04T01:48:29.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root 10w FIFO 0,13 0t0 283192 pipe 2023-11-04T01:48:29.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root 11u a_inode 0,14 0 3100 [eventpoll:12,30] 2023-11-04T01:48:29.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root 12r FIFO 0,13 0t0 283193 pipe 2023-11-04T01:48:29.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root 13w FIFO 0,13 0t0 283193 pipe 2023-11-04T01:48:29.852 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root 14w REG 8,1 3920275 265473 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:48:29.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root 15uW REG 0,24 7 2430 /run/ceph/ceph-mds.a.pid 2023-11-04T01:48:29.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root 16r FIFO 0,13 0t0 282324 pipe 2023-11-04T01:48:29.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root 17w FIFO 0,13 0t0 282324 pipe 2023-11-04T01:48:29.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root 18u unix 0xffff9ba9201bf700 0t0 282325 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root 19u IPv4 285137 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:48:29.853 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root 20u IPv4 285173 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:48:29.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root 21r FIFO 0,13 0t0 282327 pipe 2023-11-04T01:48:29.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root 22w FIFO 0,13 0t0 282327 pipe 2023-11-04T01:48:29.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root 23r FIFO 0,13 0t0 282328 pipe 2023-11-04T01:48:29.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root 24w FIFO 0,13 0t0 282328 pipe 2023-11-04T01:48:29.854 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root 25u IPv4 283197 0t0 TCP smithi077.front.sepia.ceph.com:46096->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root 26r FIFO 0,13 0t0 282329 pipe 2023-11-04T01:48:29.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root 27w FIFO 0,13 0t0 282329 pipe 2023-11-04T01:48:29.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root 28r FIFO 0,13 0t0 282330 pipe 2023-11-04T01:48:29.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root 29w FIFO 0,13 0t0 282330 pipe 2023-11-04T01:48:29.855 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156832 signal_ha root 30u IPv4 285185 0t0 TCP smithi077.front.sepia.ceph.com:36856->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root txt REG 8,1 6696672 2994 /usr/bin/ceph-mds 2023-11-04T01:48:29.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.856 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.857 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.858 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.859 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.860 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.861 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.862 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:29.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.863 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.864 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:48:29.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.865 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root 1w FIFO 0,13 0t0 285077 pipe 2023-11-04T01:48:29.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root 2w FIFO 0,13 0t0 285078 pipe 2023-11-04T01:48:29.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root 3r FIFO 0,13 0t0 283189 pipe 2023-11-04T01:48:29.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root 4w FIFO 0,13 0t0 283189 pipe 2023-11-04T01:48:29.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20] 2023-11-04T01:48:29.866 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root 6r FIFO 0,13 0t0 283191 pipe 2023-11-04T01:48:29.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root 7w FIFO 0,13 0t0 283191 pipe 2023-11-04T01:48:29.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root 8u a_inode 0,14 0 3100 [eventpoll:9,25] 2023-11-04T01:48:29.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root 9r FIFO 0,13 0t0 283192 pipe 2023-11-04T01:48:29.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root 10w FIFO 0,13 0t0 283192 pipe 2023-11-04T01:48:29.867 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root 11u a_inode 0,14 0 3100 [eventpoll:12,30] 2023-11-04T01:48:29.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root 12r FIFO 0,13 0t0 283193 pipe 2023-11-04T01:48:29.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root 13w FIFO 0,13 0t0 283193 pipe 2023-11-04T01:48:29.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root 14w REG 8,1 3920275 265473 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:48:29.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root 15uW REG 0,24 7 2430 /run/ceph/ceph-mds.a.pid 2023-11-04T01:48:29.868 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root 16r FIFO 0,13 0t0 282324 pipe 2023-11-04T01:48:29.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root 17w FIFO 0,13 0t0 282324 pipe 2023-11-04T01:48:29.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root 18u unix 0xffff9ba9201bf700 0t0 282325 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root 19u IPv4 285137 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:48:29.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root 20u IPv4 285173 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:48:29.869 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root 21r FIFO 0,13 0t0 282327 pipe 2023-11-04T01:48:29.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root 22w FIFO 0,13 0t0 282327 pipe 2023-11-04T01:48:29.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root 23r FIFO 0,13 0t0 282328 pipe 2023-11-04T01:48:29.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root 24w FIFO 0,13 0t0 282328 pipe 2023-11-04T01:48:29.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root 25u IPv4 283197 0t0 TCP smithi077.front.sepia.ceph.com:46096->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.870 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root 26r FIFO 0,13 0t0 282329 pipe 2023-11-04T01:48:29.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root 27w FIFO 0,13 0t0 282329 pipe 2023-11-04T01:48:29.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root 28r FIFO 0,13 0t0 282330 pipe 2023-11-04T01:48:29.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root 29w FIFO 0,13 0t0 282330 pipe 2023-11-04T01:48:29.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156833 io_contex root 30u IPv4 285185 0t0 TCP smithi077.front.sepia.ceph.com:36856->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.871 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root txt REG 8,1 6696672 2994 /usr/bin/ceph-mds 2023-11-04T01:48:29.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.872 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.873 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.874 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.875 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.876 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.877 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.878 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:29.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.879 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.880 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:48:29.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.881 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root 1w FIFO 0,13 0t0 285077 pipe 2023-11-04T01:48:29.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root 2w FIFO 0,13 0t0 285078 pipe 2023-11-04T01:48:29.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root 3r FIFO 0,13 0t0 283189 pipe 2023-11-04T01:48:29.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root 4w FIFO 0,13 0t0 283189 pipe 2023-11-04T01:48:29.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20] 2023-11-04T01:48:29.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root 6r FIFO 0,13 0t0 283191 pipe 2023-11-04T01:48:29.882 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root 7w FIFO 0,13 0t0 283191 pipe 2023-11-04T01:48:29.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root 8u a_inode 0,14 0 3100 [eventpoll:9,25] 2023-11-04T01:48:29.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root 9r FIFO 0,13 0t0 283192 pipe 2023-11-04T01:48:29.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root 10w FIFO 0,13 0t0 283192 pipe 2023-11-04T01:48:29.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root 11u a_inode 0,14 0 3100 [eventpoll:12,30] 2023-11-04T01:48:29.883 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root 12r FIFO 0,13 0t0 283193 pipe 2023-11-04T01:48:29.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root 13w FIFO 0,13 0t0 283193 pipe 2023-11-04T01:48:29.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root 14w REG 8,1 3920275 265473 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:48:29.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root 15uW REG 0,24 7 2430 /run/ceph/ceph-mds.a.pid 2023-11-04T01:48:29.884 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root 16r FIFO 0,13 0t0 282324 pipe 2023-11-04T01:48:29.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root 17w FIFO 0,13 0t0 282324 pipe 2023-11-04T01:48:29.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root 18u unix 0xffff9ba9201bf700 0t0 282325 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root 19u IPv4 285137 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:48:29.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root 20u IPv4 285173 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:48:29.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root 21r FIFO 0,13 0t0 282327 pipe 2023-11-04T01:48:29.885 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root 22w FIFO 0,13 0t0 282327 pipe 2023-11-04T01:48:29.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root 23r FIFO 0,13 0t0 282328 pipe 2023-11-04T01:48:29.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root 24w FIFO 0,13 0t0 282328 pipe 2023-11-04T01:48:29.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root 25u IPv4 283197 0t0 TCP smithi077.front.sepia.ceph.com:46096->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root 26r FIFO 0,13 0t0 282329 pipe 2023-11-04T01:48:29.886 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root 27w FIFO 0,13 0t0 282329 pipe 2023-11-04T01:48:29.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root 28r FIFO 0,13 0t0 282330 pipe 2023-11-04T01:48:29.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root 29w FIFO 0,13 0t0 282330 pipe 2023-11-04T01:48:29.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156834 io_contex root 30u IPv4 285185 0t0 TCP smithi077.front.sepia.ceph.com:36856->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.887 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root txt REG 8,1 6696672 2994 /usr/bin/ceph-mds 2023-11-04T01:48:29.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.889 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.890 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.891 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.892 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.893 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:29.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.895 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.896 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:48:29.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root 1w FIFO 0,13 0t0 285077 pipe 2023-11-04T01:48:29.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root 2w FIFO 0,13 0t0 285078 pipe 2023-11-04T01:48:29.897 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root 3r FIFO 0,13 0t0 283189 pipe 2023-11-04T01:48:29.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root 4w FIFO 0,13 0t0 283189 pipe 2023-11-04T01:48:29.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20] 2023-11-04T01:48:29.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root 6r FIFO 0,13 0t0 283191 pipe 2023-11-04T01:48:29.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root 7w FIFO 0,13 0t0 283191 pipe 2023-11-04T01:48:29.898 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root 8u a_inode 0,14 0 3100 [eventpoll:9,25] 2023-11-04T01:48:29.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root 9r FIFO 0,13 0t0 283192 pipe 2023-11-04T01:48:29.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root 10w FIFO 0,13 0t0 283192 pipe 2023-11-04T01:48:29.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root 11u a_inode 0,14 0 3100 [eventpoll:12,30] 2023-11-04T01:48:29.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root 12r FIFO 0,13 0t0 283193 pipe 2023-11-04T01:48:29.899 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root 13w FIFO 0,13 0t0 283193 pipe 2023-11-04T01:48:29.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root 14w REG 8,1 3920275 265473 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:48:29.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root 15uW REG 0,24 7 2430 /run/ceph/ceph-mds.a.pid 2023-11-04T01:48:29.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root 16r FIFO 0,13 0t0 282324 pipe 2023-11-04T01:48:29.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root 17w FIFO 0,13 0t0 282324 pipe 2023-11-04T01:48:29.900 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root 18u unix 0xffff9ba9201bf700 0t0 282325 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root 19u IPv4 285137 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:48:29.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root 20u IPv4 285173 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:48:29.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root 21r FIFO 0,13 0t0 282327 pipe 2023-11-04T01:48:29.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root 22w FIFO 0,13 0t0 282327 pipe 2023-11-04T01:48:29.901 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root 23r FIFO 0,13 0t0 282328 pipe 2023-11-04T01:48:29.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root 24w FIFO 0,13 0t0 282328 pipe 2023-11-04T01:48:29.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root 25u IPv4 283197 0t0 TCP smithi077.front.sepia.ceph.com:46096->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root 26r FIFO 0,13 0t0 282329 pipe 2023-11-04T01:48:29.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root 27w FIFO 0,13 0t0 282329 pipe 2023-11-04T01:48:29.902 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root 28r FIFO 0,13 0t0 282330 pipe 2023-11-04T01:48:29.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root 29w FIFO 0,13 0t0 282330 pipe 2023-11-04T01:48:29.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156835 ms_dispat root 30u IPv4 285185 0t0 TCP smithi077.front.sepia.ceph.com:36856->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root txt REG 8,1 6696672 2994 /usr/bin/ceph-mds 2023-11-04T01:48:29.903 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.904 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.905 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.906 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.907 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.908 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.909 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:29.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.910 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.911 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:48:29.912 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root 1w FIFO 0,13 0t0 285077 pipe 2023-11-04T01:48:29.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root 2w FIFO 0,13 0t0 285078 pipe 2023-11-04T01:48:29.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root 3r FIFO 0,13 0t0 283189 pipe 2023-11-04T01:48:29.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root 4w FIFO 0,13 0t0 283189 pipe 2023-11-04T01:48:29.913 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20] 2023-11-04T01:48:29.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root 6r FIFO 0,13 0t0 283191 pipe 2023-11-04T01:48:29.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root 7w FIFO 0,13 0t0 283191 pipe 2023-11-04T01:48:29.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root 8u a_inode 0,14 0 3100 [eventpoll:9,25] 2023-11-04T01:48:29.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root 9r FIFO 0,13 0t0 283192 pipe 2023-11-04T01:48:29.914 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root 10w FIFO 0,13 0t0 283192 pipe 2023-11-04T01:48:29.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root 11u a_inode 0,14 0 3100 [eventpoll:12,30] 2023-11-04T01:48:29.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root 12r FIFO 0,13 0t0 283193 pipe 2023-11-04T01:48:29.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root 13w FIFO 0,13 0t0 283193 pipe 2023-11-04T01:48:29.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root 14w REG 8,1 3920275 265473 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:48:29.915 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root 15uW REG 0,24 7 2430 /run/ceph/ceph-mds.a.pid 2023-11-04T01:48:29.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root 16r FIFO 0,13 0t0 282324 pipe 2023-11-04T01:48:29.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root 17w FIFO 0,13 0t0 282324 pipe 2023-11-04T01:48:29.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root 18u unix 0xffff9ba9201bf700 0t0 282325 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root 19u IPv4 285137 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:48:29.916 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root 20u IPv4 285173 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:48:29.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root 21r FIFO 0,13 0t0 282327 pipe 2023-11-04T01:48:29.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root 22w FIFO 0,13 0t0 282327 pipe 2023-11-04T01:48:29.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root 23r FIFO 0,13 0t0 282328 pipe 2023-11-04T01:48:29.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root 24w FIFO 0,13 0t0 282328 pipe 2023-11-04T01:48:29.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root 25u IPv4 283197 0t0 TCP smithi077.front.sepia.ceph.com:46096->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.917 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root 26r FIFO 0,13 0t0 282329 pipe 2023-11-04T01:48:29.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root 27w FIFO 0,13 0t0 282329 pipe 2023-11-04T01:48:29.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root 28r FIFO 0,13 0t0 282330 pipe 2023-11-04T01:48:29.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root 29w FIFO 0,13 0t0 282330 pipe 2023-11-04T01:48:29.918 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156836 ms_local root 30u IPv4 285185 0t0 TCP smithi077.front.sepia.ceph.com:36856->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root txt REG 8,1 6696672 2994 /usr/bin/ceph-mds 2023-11-04T01:48:29.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.919 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.920 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.921 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.922 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.923 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.924 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.925 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:29.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.926 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.927 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:48:29.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root 1w FIFO 0,13 0t0 285077 pipe 2023-11-04T01:48:29.928 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root 2w FIFO 0,13 0t0 285078 pipe 2023-11-04T01:48:29.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root 3r FIFO 0,13 0t0 283189 pipe 2023-11-04T01:48:29.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root 4w FIFO 0,13 0t0 283189 pipe 2023-11-04T01:48:29.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20] 2023-11-04T01:48:29.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root 6r FIFO 0,13 0t0 283191 pipe 2023-11-04T01:48:29.929 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root 7w FIFO 0,13 0t0 283191 pipe 2023-11-04T01:48:29.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,25] 2023-11-04T01:48:29.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root 9r FIFO 0,13 0t0 283192 pipe 2023-11-04T01:48:29.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root 10w FIFO 0,13 0t0 283192 pipe 2023-11-04T01:48:29.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12,30] 2023-11-04T01:48:29.930 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root 12r FIFO 0,13 0t0 283193 pipe 2023-11-04T01:48:29.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root 13w FIFO 0,13 0t0 283193 pipe 2023-11-04T01:48:29.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root 14w REG 8,1 3920275 265473 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:48:29.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root 15uW REG 0,24 7 2430 /run/ceph/ceph-mds.a.pid 2023-11-04T01:48:29.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root 16r FIFO 0,13 0t0 282324 pipe 2023-11-04T01:48:29.931 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root 17w FIFO 0,13 0t0 282324 pipe 2023-11-04T01:48:29.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root 18u unix 0xffff9ba9201bf700 0t0 282325 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root 19u IPv4 285137 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:48:29.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root 20u IPv4 285173 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:48:29.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root 21r FIFO 0,13 0t0 282327 pipe 2023-11-04T01:48:29.932 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root 22w FIFO 0,13 0t0 282327 pipe 2023-11-04T01:48:29.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root 23r FIFO 0,13 0t0 282328 pipe 2023-11-04T01:48:29.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root 24w FIFO 0,13 0t0 282328 pipe 2023-11-04T01:48:29.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root 25u IPv4 283197 0t0 TCP smithi077.front.sepia.ceph.com:46096->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root 26r FIFO 0,13 0t0 282329 pipe 2023-11-04T01:48:29.933 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root 27w FIFO 0,13 0t0 282329 pipe 2023-11-04T01:48:29.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root 28r FIFO 0,13 0t0 282330 pipe 2023-11-04T01:48:29.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root 29w FIFO 0,13 0t0 282330 pipe 2023-11-04T01:48:29.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156837 safe_time root 30u IPv4 285185 0t0 TCP smithi077.front.sepia.ceph.com:36856->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.934 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root txt REG 8,1 6696672 2994 /usr/bin/ceph-mds 2023-11-04T01:48:29.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.935 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.936 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.937 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.938 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.939 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.940 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:29.941 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.942 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.943 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:48:29.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root 1w FIFO 0,13 0t0 285077 pipe 2023-11-04T01:48:29.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root 2w FIFO 0,13 0t0 285078 pipe 2023-11-04T01:48:29.944 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root 3r FIFO 0,13 0t0 283189 pipe 2023-11-04T01:48:29.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root 4w FIFO 0,13 0t0 283189 pipe 2023-11-04T01:48:29.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20] 2023-11-04T01:48:29.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root 6r FIFO 0,13 0t0 283191 pipe 2023-11-04T01:48:29.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root 7w FIFO 0,13 0t0 283191 pipe 2023-11-04T01:48:29.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,25] 2023-11-04T01:48:29.945 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root 9r FIFO 0,13 0t0 283192 pipe 2023-11-04T01:48:29.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root 10w FIFO 0,13 0t0 283192 pipe 2023-11-04T01:48:29.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12,30] 2023-11-04T01:48:29.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root 12r FIFO 0,13 0t0 283193 pipe 2023-11-04T01:48:29.946 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root 13w FIFO 0,13 0t0 283193 pipe 2023-11-04T01:48:29.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root 14w REG 8,1 3920275 265473 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:48:29.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root 15uW REG 0,24 7 2430 /run/ceph/ceph-mds.a.pid 2023-11-04T01:48:29.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root 16r FIFO 0,13 0t0 282324 pipe 2023-11-04T01:48:29.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root 17w FIFO 0,13 0t0 282324 pipe 2023-11-04T01:48:29.947 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root 18u unix 0xffff9ba9201bf700 0t0 282325 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root 19u IPv4 285137 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:48:29.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root 20u IPv4 285173 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:48:29.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root 21r FIFO 0,13 0t0 282327 pipe 2023-11-04T01:48:29.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root 22w FIFO 0,13 0t0 282327 pipe 2023-11-04T01:48:29.948 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root 23r FIFO 0,13 0t0 282328 pipe 2023-11-04T01:48:29.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root 24w FIFO 0,13 0t0 282328 pipe 2023-11-04T01:48:29.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root 25u IPv4 283197 0t0 TCP smithi077.front.sepia.ceph.com:46096->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root 26r FIFO 0,13 0t0 282329 pipe 2023-11-04T01:48:29.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root 27w FIFO 0,13 0t0 282329 pipe 2023-11-04T01:48:29.949 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root 28r FIFO 0,13 0t0 282330 pipe 2023-11-04T01:48:29.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root 29w FIFO 0,13 0t0 282330 pipe 2023-11-04T01:48:29.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156838 safe_time root 30u IPv4 285185 0t0 TCP smithi077.front.sepia.ceph.com:36856->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.950 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root txt REG 8,1 6696672 2994 /usr/bin/ceph-mds 2023-11-04T01:48:29.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.951 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.952 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.953 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.954 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.955 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.956 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:29.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.957 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.958 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.959 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:48:29.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root 1w FIFO 0,13 0t0 285077 pipe 2023-11-04T01:48:29.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root 2w FIFO 0,13 0t0 285078 pipe 2023-11-04T01:48:29.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root 3r FIFO 0,13 0t0 283189 pipe 2023-11-04T01:48:29.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root 4w FIFO 0,13 0t0 283189 pipe 2023-11-04T01:48:29.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20] 2023-11-04T01:48:29.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root 6r FIFO 0,13 0t0 283191 pipe 2023-11-04T01:48:29.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root 7w FIFO 0,13 0t0 283191 pipe 2023-11-04T01:48:29.961 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root 8u a_inode 0,14 0 3100 [eventpoll:9,25] 2023-11-04T01:48:29.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root 9r FIFO 0,13 0t0 283192 pipe 2023-11-04T01:48:29.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root 10w FIFO 0,13 0t0 283192 pipe 2023-11-04T01:48:29.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root 11u a_inode 0,14 0 3100 [eventpoll:12,30] 2023-11-04T01:48:29.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root 12r FIFO 0,13 0t0 283193 pipe 2023-11-04T01:48:29.962 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root 13w FIFO 0,13 0t0 283193 pipe 2023-11-04T01:48:29.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root 14w REG 8,1 3920275 265473 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:48:29.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root 15uW REG 0,24 7 2430 /run/ceph/ceph-mds.a.pid 2023-11-04T01:48:29.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root 16r FIFO 0,13 0t0 282324 pipe 2023-11-04T01:48:29.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root 17w FIFO 0,13 0t0 282324 pipe 2023-11-04T01:48:29.963 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root 18u unix 0xffff9ba9201bf700 0t0 282325 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root 19u IPv4 285137 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:48:29.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root 20u IPv4 285173 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:48:29.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root 21r FIFO 0,13 0t0 282327 pipe 2023-11-04T01:48:29.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root 22w FIFO 0,13 0t0 282327 pipe 2023-11-04T01:48:29.964 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root 23r FIFO 0,13 0t0 282328 pipe 2023-11-04T01:48:29.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root 24w FIFO 0,13 0t0 282328 pipe 2023-11-04T01:48:29.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root 25u IPv4 283197 0t0 TCP smithi077.front.sepia.ceph.com:46096->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root 26r FIFO 0,13 0t0 282329 pipe 2023-11-04T01:48:29.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root 27w FIFO 0,13 0t0 282329 pipe 2023-11-04T01:48:29.965 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root 28r FIFO 0,13 0t0 282330 pipe 2023-11-04T01:48:29.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root 29w FIFO 0,13 0t0 282330 pipe 2023-11-04T01:48:29.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156839 ceph-mds root 30u IPv4 285185 0t0 TCP smithi077.front.sepia.ceph.com:36856->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.966 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root txt REG 8,1 6696672 2994 /usr/bin/ceph-mds 2023-11-04T01:48:29.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:29.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:29.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:29.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:29.967 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:29.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.968 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:29.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:29.969 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.970 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:29.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:29.971 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:29.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:29.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:29.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:29.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:29.972 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:29.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:29.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:29.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.973 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:29.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:29.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:29.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:29.974 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 326760 2429 /usr/lib64/libtcmalloc.so.4.5.9 2023-11-04T01:48:29.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:29.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 61880 2419 /usr/lib64/libunwind.so.8.0.1 2023-11-04T01:48:29.975 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2023-11-04T01:48:29.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-04T01:48:29.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root 1w FIFO 0,13 0t0 285077 pipe 2023-11-04T01:48:29.976 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root 2w FIFO 0,13 0t0 285078 pipe 2023-11-04T01:48:29.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root 3r FIFO 0,13 0t0 283189 pipe 2023-11-04T01:48:29.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root 4w FIFO 0,13 0t0 283189 pipe 2023-11-04T01:48:29.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root 5u a_inode 0,14 0 3100 [eventpoll:6,19,20] 2023-11-04T01:48:29.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root 6r FIFO 0,13 0t0 283191 pipe 2023-11-04T01:48:29.977 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root 7w FIFO 0,13 0t0 283191 pipe 2023-11-04T01:48:29.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root 8u a_inode 0,14 0 3100 [eventpoll:9,25] 2023-11-04T01:48:29.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root 9r FIFO 0,13 0t0 283192 pipe 2023-11-04T01:48:29.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root 10w FIFO 0,13 0t0 283192 pipe 2023-11-04T01:48:29.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root 11u a_inode 0,14 0 3100 [eventpoll:12,30] 2023-11-04T01:48:29.978 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root 12r FIFO 0,13 0t0 283193 pipe 2023-11-04T01:48:29.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root 13w FIFO 0,13 0t0 283193 pipe 2023-11-04T01:48:29.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root 14w REG 8,1 3920275 265473 /var/log/ceph/ceph-mds.a.log 2023-11-04T01:48:29.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root 15uW REG 0,24 7 2430 /run/ceph/ceph-mds.a.pid 2023-11-04T01:48:29.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root 16r FIFO 0,13 0t0 282324 pipe 2023-11-04T01:48:29.979 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root 17w FIFO 0,13 0t0 282324 pipe 2023-11-04T01:48:29.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root 18u unix 0xffff9ba9201bf700 0t0 282325 /var/run/ceph/ceph-mds.a.asok type=STREAM (LISTEN) 2023-11-04T01:48:29.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root 19u IPv4 285137 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:48:29.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root 20u IPv4 285173 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:48:29.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root 21r FIFO 0,13 0t0 282327 pipe 2023-11-04T01:48:29.980 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root 22w FIFO 0,13 0t0 282327 pipe 2023-11-04T01:48:29.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root 23r FIFO 0,13 0t0 282328 pipe 2023-11-04T01:48:29.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root 24w FIFO 0,13 0t0 282328 pipe 2023-11-04T01:48:29.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root 25u IPv4 283197 0t0 TCP smithi077.front.sepia.ceph.com:46096->smithi077.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:48:29.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root 26r FIFO 0,13 0t0 282329 pipe 2023-11-04T01:48:29.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root 27w FIFO 0,13 0t0 282329 pipe 2023-11-04T01:48:29.981 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root 28r FIFO 0,13 0t0 282330 pipe 2023-11-04T01:48:29.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root 29w FIFO 0,13 0t0 282330 pipe 2023-11-04T01:48:29.982 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-mds 156821 156880 safe_time root 30u IPv4 285185 0t0 TCP smithi077.front.sepia.ceph.com:36856->smithi122.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:48:29.982 INFO:teuthology.orchestra.run.smithi077.stdout:bash 157776 ubuntu cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:29.982 INFO:teuthology.orchestra.run.smithi077.stdout:bash 157776 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.982 INFO:teuthology.orchestra.run.smithi077.stdout:bash 157776 ubuntu txt REG 8,1 1388920 9667 /usr/bin/bash 2023-11-04T01:48:29.983 INFO:teuthology.orchestra.run.smithi077.stdout:bash 157776 ubuntu mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:48:29.983 INFO:teuthology.orchestra.run.smithi077.stdout:bash 157776 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.983 INFO:teuthology.orchestra.run.smithi077.stdout:bash 157776 ubuntu mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:29.983 INFO:teuthology.orchestra.run.smithi077.stdout:bash 157776 ubuntu mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:48:29.983 INFO:teuthology.orchestra.run.smithi077.stdout:bash 157776 ubuntu mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:48:29.984 INFO:teuthology.orchestra.run.smithi077.stdout:bash 157776 ubuntu mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:48:29.984 INFO:teuthology.orchestra.run.smithi077.stdout:bash 157776 ubuntu mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:48:29.984 INFO:teuthology.orchestra.run.smithi077.stdout:bash 157776 ubuntu mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:48:29.984 INFO:teuthology.orchestra.run.smithi077.stdout:bash 157776 ubuntu mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:48:29.984 INFO:teuthology.orchestra.run.smithi077.stdout:bash 157776 ubuntu mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:48:29.984 INFO:teuthology.orchestra.run.smithi077.stdout:bash 157776 ubuntu mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:48:29.985 INFO:teuthology.orchestra.run.smithi077.stdout:bash 157776 ubuntu mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:48:29.985 INFO:teuthology.orchestra.run.smithi077.stdout:bash 157776 ubuntu mem REG 8,1 195080 9664 /usr/lib64/libtinfo.so.6.2 2023-11-04T01:48:29.985 INFO:teuthology.orchestra.run.smithi077.stdout:bash 157776 ubuntu mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:29.985 INFO:teuthology.orchestra.run.smithi077.stdout:bash 157776 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.985 INFO:teuthology.orchestra.run.smithi077.stdout:bash 157776 ubuntu mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:48:29.986 INFO:teuthology.orchestra.run.smithi077.stdout:bash 157776 ubuntu 0r FIFO 0,13 0t0 287068 pipe 2023-11-04T01:48:29.986 INFO:teuthology.orchestra.run.smithi077.stdout:bash 157776 ubuntu 1w FIFO 0,13 0t0 287069 pipe 2023-11-04T01:48:29.986 INFO:teuthology.orchestra.run.smithi077.stdout:bash 157776 ubuntu 2w FIFO 0,13 0t0 287070 pipe 2023-11-04T01:48:29.986 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root cwd DIR 8,1 4096 262170 /home/ubuntu/cephtest 2023-11-04T01:48:29.986 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:29.987 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:48:29.987 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:48:29.987 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:29.987 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:29.987 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:48:29.988 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:29.988 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:48:29.988 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:48:29.988 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:48:29.988 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:29.989 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:48:29.989 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:48:29.989 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:48:29.989 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:48:29.989 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:48:29.990 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:48:29.990 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:29.990 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:29.990 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:29.990 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:29.991 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:29.991 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:29.991 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:29.991 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:29.991 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:29.992 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:48:29.992 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:48:29.992 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:29.992 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:29.992 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:29.992 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:48:29.993 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:29.993 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:29.993 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:48:29.993 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:29.993 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:29.994 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:48:29.994 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:29.994 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:48:29.994 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:48:29.994 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:48:29.995 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:48:29.995 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:48:29.995 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:48:29.995 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:48:29.995 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:48:29.996 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:48:29.996 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:48:29.996 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:48:29.996 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:29.997 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:48:29.997 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:48:29.997 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:29.997 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:48:29.997 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:29.998 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:29.998 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:48:29.998 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root 0r FIFO 0,13 0t0 287068 pipe 2023-11-04T01:48:29.998 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root 1w FIFO 0,13 0t0 287069 pipe 2023-11-04T01:48:29.998 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root 2w FIFO 0,13 0t0 287070 pipe 2023-11-04T01:48:29.999 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root 3r FIFO 0,13 0t0 283462 pipe 2023-11-04T01:48:29.999 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root 4w FIFO 0,13 0t0 283462 pipe 2023-11-04T01:48:29.999 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root 5u netlink 0t0 283468 AUDIT 2023-11-04T01:48:29.999 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157806 root 6u unix 0xffff9ba908681540 0t0 283469 type=DGRAM (CONNECTED) 2023-11-04T01:48:29.999 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root cwd DIR 8,1 4096 262170 /home/ubuntu/cephtest 2023-11-04T01:48:30.000 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.000 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:48:30.000 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:48:30.000 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:30.000 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:30.001 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:48:30.001 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:30.001 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:48:30.001 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:48:30.001 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:48:30.002 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:48:30.002 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:48:30.002 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:48:30.002 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:48:30.002 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:48:30.003 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:48:30.003 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:48:30.003 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:48:30.003 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:30.003 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:30.004 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:30.004 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:30.004 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.004 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:30.004 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:30.005 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:30.005 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:30.005 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:30.005 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:48:30.005 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:30.006 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:30.006 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:30.006 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:30.006 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:30.006 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:30.007 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:48:30.007 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:30.007 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:48:30.007 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:48:30.007 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:48:30.008 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:30.008 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:48:30.008 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:48:30.008 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:48:30.008 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:48:30.008 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:48:30.009 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:48:30.009 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:48:30.009 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:48:30.009 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:48:30.009 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:30.010 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:48:30.010 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:48:30.010 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:30.010 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:48:30.010 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:30.011 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:30.011 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:48:30.011 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root 0r FIFO 0,13 0t0 287068 pipe 2023-11-04T01:48:30.011 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root 1w FIFO 0,13 0t0 287069 pipe 2023-11-04T01:48:30.011 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root 2w FIFO 0,13 0t0 287070 pipe 2023-11-04T01:48:30.012 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root 3r FIFO 0,13 0t0 289037 pipe 2023-11-04T01:48:30.012 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root 4w FIFO 0,13 0t0 289037 pipe 2023-11-04T01:48:30.012 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root 5u sock 0,8 0t0 289043 protocol: NETLINK 2023-11-04T01:48:30.012 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 157812 root 6u sock 0,8 0t0 289044 protocol: UNIX 2023-11-04T01:48:30.012 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 157814 root cwd DIR 8,1 4096 262170 /home/ubuntu/cephtest 2023-11-04T01:48:30.013 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 157814 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.013 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 157814 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:48:30.013 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 157814 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:30.013 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 157814 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:30.013 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 157814 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:48:30.014 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 157814 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:30.014 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 157814 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:30.014 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 157814 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:30.014 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 157814 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:30.014 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 157814 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:30.015 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 157814 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:30.015 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 157814 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:30.015 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 157814 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:30.015 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 157814 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:30.015 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 157814 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:48:30.016 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 157814 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:30.016 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 157814 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:30.016 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 157814 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:30.016 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 157814 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:30.016 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 157814 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:30.017 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 157814 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:30.017 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 157814 root 0r FIFO 0,13 0t0 287068 pipe 2023-11-04T01:48:30.017 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 157814 root 1w FIFO 0,13 0t0 287069 pipe 2023-11-04T01:48:30.017 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 157814 root 2w FIFO 0,13 0t0 287070 pipe 2023-11-04T01:48:30.017 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 157814 root 3r FIFO 0,13 0t0 285454 pipe 2023-11-04T01:48:30.017 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 157814 root 4w FIFO 0,13 0t0 285454 pipe 2023-11-04T01:48:30.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root cwd DIR 8,1 4096 262170 /home/ubuntu/cephtest 2023-11-04T01:48:30.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root txt REG 8,1 2635024 11700 /usr/bin/ceph-fuse 2023-11-04T01:48:30.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:30.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:30.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:30.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:30.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:30.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:30.019 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:30.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:30.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:30.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:30.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:30.020 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:30.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:30.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:30.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:30.021 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:30.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:30.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:30.022 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:30.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:30.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:30.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:30.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:30.023 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:30.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:30.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:30.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:30.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:30.024 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:30.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:30.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:30.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:30.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:30.025 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:30.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:30.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:30.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:30.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:30.026 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:30.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:30.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root 0r FIFO 0,13 0t0 285455 pipe 2023-11-04T01:48:30.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root 1w FIFO 0,13 0t0 287069 pipe 2023-11-04T01:48:30.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root 2w FIFO 0,13 0t0 287070 pipe 2023-11-04T01:48:30.027 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root 3w REG 8,1 302997 267541 /var/log/ceph/ceph-client.0.157832.log 2023-11-04T01:48:30.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root 4u a_inode 0,14 0 3100 [eventpoll:5,22] 2023-11-04T01:48:30.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root 5r FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root 6w FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root 7u a_inode 0,14 0 3100 [eventpoll:8,20] 2023-11-04T01:48:30.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root 8r FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.028 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root 9w FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root 10u a_inode 0,14 0 3100 [eventpoll:11] 2023-11-04T01:48:30.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root 11r FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root 12w FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root 13r FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.029 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root 14w FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root 15u sock 0,8 0t0 289862 protocol: UNIX-STREAM 2023-11-04T01:48:30.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root 16r FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root 17w FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root 18r FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.030 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root 19w FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root 20u sock 0,8 0t0 284475 protocol: TCP 2023-11-04T01:48:30.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root 22u sock 0,8 0t0 288052 protocol: TCP 2023-11-04T01:48:30.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:48:30.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root 24r FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.031 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root 25w FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root 26r FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root 27w FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root 29r FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 root 30w FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.032 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root cwd DIR 8,1 4096 262170 /home/ubuntu/cephtest 2023-11-04T01:48:30.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root txt REG 8,1 2635024 11700 /usr/bin/ceph-fuse 2023-11-04T01:48:30.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:30.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:30.033 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:30.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:30.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:30.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:30.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:30.034 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:30.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:30.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:30.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:30.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:30.035 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:30.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:30.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:30.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.036 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:30.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:30.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:30.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:30.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:30.037 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:30.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:30.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:30.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:30.038 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:30.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:30.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:30.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:30.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:30.039 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:30.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:30.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:30.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:30.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:30.040 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:30.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:30.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:30.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:30.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:30.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:30.041 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root 0r FIFO 0,13 0t0 285455 pipe 2023-11-04T01:48:30.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root 1w FIFO 0,13 0t0 287069 pipe 2023-11-04T01:48:30.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root 2w FIFO 0,13 0t0 287070 pipe 2023-11-04T01:48:30.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root 3w REG 8,1 302997 267541 /var/log/ceph/ceph-client.0.157832.log 2023-11-04T01:48:30.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root 4u a_inode 0,14 0 3100 [eventpoll:5,22] 2023-11-04T01:48:30.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root 5r FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root 6w FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root 7u a_inode 0,14 0 3100 [eventpoll:8,20] 2023-11-04T01:48:30.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root 8r FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root 9w FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.043 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root 10u a_inode 0,14 0 3100 [eventpoll:11] 2023-11-04T01:48:30.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root 11r FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root 12w FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root 13r FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root 14w FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.044 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root 15u sock 0,8 0t0 289862 protocol: UNIX-STREAM 2023-11-04T01:48:30.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root 16r FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root 17w FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root 18r FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root 19w FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.045 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root 20u sock 0,8 0t0 284475 protocol: TCP 2023-11-04T01:48:30.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root 22u sock 0,8 0t0 288052 protocol: TCP 2023-11-04T01:48:30.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:48:30.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root 24r FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root 25w FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.046 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root 26r FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root 27w FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root 29r FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157833 log root 30w FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root cwd DIR 8,1 4096 262170 /home/ubuntu/cephtest 2023-11-04T01:48:30.047 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root txt REG 8,1 2635024 11700 /usr/bin/ceph-fuse 2023-11-04T01:48:30.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:30.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:30.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:30.048 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:30.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:30.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:30.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:30.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:30.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:30.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:30.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:30.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:30.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.050 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:30.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:30.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:30.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:30.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:30.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:30.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:30.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:30.052 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:30.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:30.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:30.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:30.053 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:30.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:30.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:30.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:30.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:30.054 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:30.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:30.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:30.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:30.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:30.055 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:30.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:30.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:30.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:30.056 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:30.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:30.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root 0r FIFO 0,13 0t0 285455 pipe 2023-11-04T01:48:30.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root 1w FIFO 0,13 0t0 287069 pipe 2023-11-04T01:48:30.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root 2w FIFO 0,13 0t0 287070 pipe 2023-11-04T01:48:30.057 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root 3w REG 8,1 302997 267541 /var/log/ceph/ceph-client.0.157832.log 2023-11-04T01:48:30.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root 4u a_inode 0,14 0 3100 [eventpoll:5,22] 2023-11-04T01:48:30.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root 5r FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root 6w FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root 7u a_inode 0,14 0 3100 [eventpoll:8,20] 2023-11-04T01:48:30.058 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root 8r FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root 9w FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root 10u a_inode 0,14 0 3100 [eventpoll:11] 2023-11-04T01:48:30.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root 11r FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.059 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root 12w FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root 13r FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root 14w FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root 15u sock 0,8 0t0 289862 protocol: UNIX-STREAM 2023-11-04T01:48:30.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root 16r FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root 17w FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.060 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root 18r FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root 19w FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root 20u sock 0,8 0t0 284475 protocol: TCP 2023-11-04T01:48:30.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root 22u sock 0,8 0t0 288052 protocol: TCP 2023-11-04T01:48:30.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:48:30.061 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root 24r FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root 25w FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root 26r FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root 27w FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.062 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root 29r FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157835 msgr-work root 30w FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root cwd DIR 8,1 4096 262170 /home/ubuntu/cephtest 2023-11-04T01:48:30.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root txt REG 8,1 2635024 11700 /usr/bin/ceph-fuse 2023-11-04T01:48:30.063 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:30.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:30.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:30.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:30.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:30.064 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:30.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:30.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:30.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:30.065 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:30.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:30.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:30.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:30.066 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:30.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:30.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:30.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.067 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:30.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:30.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:30.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:30.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:30.068 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:30.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:30.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:30.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:30.069 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:30.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:30.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:30.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:30.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:30.070 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:30.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:30.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:30.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:30.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:30.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:30.071 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:30.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:30.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:30.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:30.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root 0r FIFO 0,13 0t0 285455 pipe 2023-11-04T01:48:30.072 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root 1w FIFO 0,13 0t0 287069 pipe 2023-11-04T01:48:30.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root 2w FIFO 0,13 0t0 287070 pipe 2023-11-04T01:48:30.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root 3w REG 8,1 302997 267541 /var/log/ceph/ceph-client.0.157832.log 2023-11-04T01:48:30.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root 4u a_inode 0,14 0 3100 [eventpoll:5,22] 2023-11-04T01:48:30.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root 5r FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.073 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root 6w FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root 7u a_inode 0,14 0 3100 [eventpoll:8,20] 2023-11-04T01:48:30.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root 8r FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root 9w FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root 10u a_inode 0,14 0 3100 [eventpoll:11] 2023-11-04T01:48:30.074 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root 11r FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root 12w FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root 13r FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root 14w FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root 15u sock 0,8 0t0 289862 protocol: UNIX-STREAM 2023-11-04T01:48:30.075 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root 16r FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root 17w FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root 18r FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root 19w FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root 20u sock 0,8 0t0 284475 protocol: TCP 2023-11-04T01:48:30.076 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root 22u sock 0,8 0t0 288052 protocol: TCP 2023-11-04T01:48:30.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:48:30.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root 24r FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root 25w FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root 26r FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.077 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root 27w FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root 29r FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157836 msgr-work root 30w FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root cwd DIR 8,1 4096 262170 /home/ubuntu/cephtest 2023-11-04T01:48:30.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.078 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root txt REG 8,1 2635024 11700 /usr/bin/ceph-fuse 2023-11-04T01:48:30.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:30.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:30.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:30.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:30.079 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:30.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:30.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:30.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:30.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:30.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:30.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:30.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:30.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:30.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:30.081 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:30.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:30.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:30.082 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:30.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:30.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:30.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:30.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:30.083 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:30.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:30.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:30.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:30.084 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:30.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:30.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:30.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:30.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:30.085 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:30.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:30.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:30.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:30.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:30.086 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:30.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:30.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:30.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:30.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root 0r FIFO 0,13 0t0 285455 pipe 2023-11-04T01:48:30.087 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root 1w FIFO 0,13 0t0 287069 pipe 2023-11-04T01:48:30.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root 2w FIFO 0,13 0t0 287070 pipe 2023-11-04T01:48:30.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root 3w REG 8,1 302997 267541 /var/log/ceph/ceph-client.0.157832.log 2023-11-04T01:48:30.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root 4u a_inode 0,14 0 3100 [eventpoll:5,22] 2023-11-04T01:48:30.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root 5r FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root 6w FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.088 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root 7u a_inode 0,14 0 3100 [eventpoll:8,20] 2023-11-04T01:48:30.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root 8r FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root 9w FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root 10u a_inode 0,14 0 3100 [eventpoll:11] 2023-11-04T01:48:30.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root 11r FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.089 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root 12w FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root 13r FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root 14w FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root 15u sock 0,8 0t0 289862 protocol: UNIX-STREAM 2023-11-04T01:48:30.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root 16r FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.090 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root 17w FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root 18r FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root 19w FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root 20u sock 0,8 0t0 284475 protocol: TCP 2023-11-04T01:48:30.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root 22u sock 0,8 0t0 288052 protocol: TCP 2023-11-04T01:48:30.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:48:30.091 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root 24r FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root 25w FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root 26r FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root 27w FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root 29r FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.092 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157837 msgr-work root 30w FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root cwd DIR 8,1 4096 262170 /home/ubuntu/cephtest 2023-11-04T01:48:30.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root txt REG 8,1 2635024 11700 /usr/bin/ceph-fuse 2023-11-04T01:48:30.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:30.093 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:30.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:30.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:30.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:30.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:30.094 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:30.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:30.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:30.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:30.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:30.095 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:30.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:30.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:30.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:30.096 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:30.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:30.097 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:30.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:30.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:30.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:30.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:30.098 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:30.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:30.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:30.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:30.099 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:30.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:30.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:30.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:30.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:30.100 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:30.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:30.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:30.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:30.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:30.101 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:30.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:30.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:30.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:30.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root 0r FIFO 0,13 0t0 285455 pipe 2023-11-04T01:48:30.102 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root 1w FIFO 0,13 0t0 287069 pipe 2023-11-04T01:48:30.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root 2w FIFO 0,13 0t0 287070 pipe 2023-11-04T01:48:30.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root 3w REG 8,1 302997 267541 /var/log/ceph/ceph-client.0.157832.log 2023-11-04T01:48:30.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root 4u a_inode 0,14 0 3100 [eventpoll:5,22] 2023-11-04T01:48:30.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root 5r FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.103 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root 6w FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root 7u a_inode 0,14 0 3100 [eventpoll:8,20] 2023-11-04T01:48:30.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root 8r FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root 9w FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root 10u a_inode 0,14 0 3100 [eventpoll:11] 2023-11-04T01:48:30.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root 11r FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root 12w FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root 13r FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root 14w FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root 15u sock 0,8 0t0 289862 protocol: UNIX-STREAM 2023-11-04T01:48:30.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root 16r FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.105 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root 17w FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root 18r FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root 19w FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root 20u sock 0,8 0t0 284475 protocol: TCP 2023-11-04T01:48:30.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root 22u sock 0,8 0t0 288052 protocol: TCP 2023-11-04T01:48:30.106 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:48:30.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root 24r FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root 25w FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root 26r FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root 27w FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root 29r FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.107 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157841 service root 30w FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root cwd DIR 8,1 4096 262170 /home/ubuntu/cephtest 2023-11-04T01:48:30.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root txt REG 8,1 2635024 11700 /usr/bin/ceph-fuse 2023-11-04T01:48:30.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:30.108 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:30.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:30.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:30.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:30.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:30.109 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:30.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:30.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:30.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:30.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:30.110 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:30.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:30.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:30.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:30.111 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:30.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:30.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:30.112 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:30.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:30.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:30.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:30.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:30.113 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:30.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:30.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:30.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:30.114 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:30.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:30.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:30.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:30.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:30.115 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:30.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:30.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:30.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:30.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:30.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:30.116 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:30.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:30.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root 0r FIFO 0,13 0t0 285455 pipe 2023-11-04T01:48:30.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root 1w FIFO 0,13 0t0 287069 pipe 2023-11-04T01:48:30.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root 2w FIFO 0,13 0t0 287070 pipe 2023-11-04T01:48:30.117 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root 3w REG 8,1 302997 267541 /var/log/ceph/ceph-client.0.157832.log 2023-11-04T01:48:30.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root 4u a_inode 0,14 0 3100 [eventpoll:5,22] 2023-11-04T01:48:30.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root 5r FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root 6w FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root 7u a_inode 0,14 0 3100 [eventpoll:8,20] 2023-11-04T01:48:30.118 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root 8r FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root 9w FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root 10u a_inode 0,14 0 3100 [eventpoll:11] 2023-11-04T01:48:30.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root 11r FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root 12w FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.119 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root 13r FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root 14w FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root 15u sock 0,8 0t0 289862 protocol: UNIX-STREAM 2023-11-04T01:48:30.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root 16r FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root 17w FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root 18r FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.120 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root 19w FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root 20u sock 0,8 0t0 284475 protocol: TCP 2023-11-04T01:48:30.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root 22u sock 0,8 0t0 288052 protocol: TCP 2023-11-04T01:48:30.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:48:30.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root 24r FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.121 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root 25w FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root 26r FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root 27w FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root 29r FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157842 admin_soc root 30w FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.122 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root cwd DIR 8,1 4096 262170 /home/ubuntu/cephtest 2023-11-04T01:48:30.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root txt REG 8,1 2635024 11700 /usr/bin/ceph-fuse 2023-11-04T01:48:30.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:30.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:30.123 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:30.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:30.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:30.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:30.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:30.124 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:30.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:30.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:30.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:30.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:30.125 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:30.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:30.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:30.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.126 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:30.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:30.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:30.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:30.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:30.127 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:30.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:30.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:30.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:30.128 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:30.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:30.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:30.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:30.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:30.129 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:30.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:30.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:30.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:30.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:30.130 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:30.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:30.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:30.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:30.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:30.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:30.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root 0r FIFO 0,13 0t0 285455 pipe 2023-11-04T01:48:30.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root 1w FIFO 0,13 0t0 287069 pipe 2023-11-04T01:48:30.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root 2w FIFO 0,13 0t0 287070 pipe 2023-11-04T01:48:30.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root 3w REG 8,1 302997 267541 /var/log/ceph/ceph-client.0.157832.log 2023-11-04T01:48:30.132 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root 4u a_inode 0,14 0 3100 [eventpoll:5,22] 2023-11-04T01:48:30.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root 5r FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root 6w FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root 7u a_inode 0,14 0 3100 [eventpoll:8,20] 2023-11-04T01:48:30.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root 8r FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.133 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root 9w FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root 10u a_inode 0,14 0 3100 [eventpoll:11] 2023-11-04T01:48:30.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root 11r FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root 12w FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root 13r FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.134 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root 14w FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root 15u sock 0,8 0t0 289862 protocol: UNIX-STREAM 2023-11-04T01:48:30.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root 16r FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root 17w FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root 18r FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.135 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root 19w FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root 20u sock 0,8 0t0 284475 protocol: TCP 2023-11-04T01:48:30.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root 22u sock 0,8 0t0 288052 protocol: TCP 2023-11-04T01:48:30.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:48:30.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root 24r FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.136 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root 25w FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root 26r FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root 27w FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root 29r FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157843 signal_ha root 30w FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.137 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root cwd DIR 8,1 4096 262170 /home/ubuntu/cephtest 2023-11-04T01:48:30.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root txt REG 8,1 2635024 11700 /usr/bin/ceph-fuse 2023-11-04T01:48:30.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:30.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:30.138 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:30.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:30.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:30.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:30.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:30.139 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:30.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:30.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:30.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:30.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:30.140 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:30.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:30.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:30.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.141 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:30.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:30.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:30.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:30.142 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:30.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:30.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:30.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:30.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.143 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:30.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:30.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:30.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:30.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:30.144 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:30.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:30.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:30.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:30.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:30.145 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:30.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:30.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:30.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:30.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:30.146 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:30.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:30.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root 0r FIFO 0,13 0t0 285455 pipe 2023-11-04T01:48:30.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root 1w FIFO 0,13 0t0 287069 pipe 2023-11-04T01:48:30.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root 2w FIFO 0,13 0t0 287070 pipe 2023-11-04T01:48:30.147 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root 3w REG 8,1 302997 267541 /var/log/ceph/ceph-client.0.157832.log 2023-11-04T01:48:30.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root 4u a_inode 0,14 0 3100 [eventpoll:5,22] 2023-11-04T01:48:30.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root 5r FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root 6w FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root 7u a_inode 0,14 0 3100 [eventpoll:8,20] 2023-11-04T01:48:30.148 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root 8r FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root 9w FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root 10u a_inode 0,14 0 3100 [eventpoll:11] 2023-11-04T01:48:30.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root 11r FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root 12w FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.149 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root 13r FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root 14w FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root 15u sock 0,8 0t0 289862 protocol: UNIX-STREAM 2023-11-04T01:48:30.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root 16r FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root 17w FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.150 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root 18r FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root 19w FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root 20u sock 0,8 0t0 284475 protocol: TCP 2023-11-04T01:48:30.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root 22u sock 0,8 0t0 288052 protocol: TCP 2023-11-04T01:48:30.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:48:30.151 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root 24r FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root 25w FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root 26r FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root 27w FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root 29r FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157844 io_contex root 30w FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.152 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root cwd DIR 8,1 4096 262170 /home/ubuntu/cephtest 2023-11-04T01:48:30.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root txt REG 8,1 2635024 11700 /usr/bin/ceph-fuse 2023-11-04T01:48:30.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:30.153 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:30.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:30.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:30.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:30.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:30.154 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:30.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:30.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:30.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:30.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:30.155 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:30.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:30.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:30.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:30.156 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:30.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:30.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:30.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:30.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:30.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:30.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:30.158 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:30.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:30.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:30.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:30.159 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:30.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:30.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:30.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:30.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:30.160 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:30.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:30.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:30.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:30.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:30.161 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:30.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:30.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:30.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:30.162 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root 0r FIFO 0,13 0t0 285455 pipe 2023-11-04T01:48:30.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root 1w FIFO 0,13 0t0 287069 pipe 2023-11-04T01:48:30.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root 2w FIFO 0,13 0t0 287070 pipe 2023-11-04T01:48:30.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root 3w REG 8,1 302997 267541 /var/log/ceph/ceph-client.0.157832.log 2023-11-04T01:48:30.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root 4u a_inode 0,14 0 3100 [eventpoll:5,22] 2023-11-04T01:48:30.163 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root 5r FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root 6w FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root 7u a_inode 0,14 0 3100 [eventpoll:8,20] 2023-11-04T01:48:30.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root 8r FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root 9w FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root 10u a_inode 0,14 0 3100 [eventpoll:11] 2023-11-04T01:48:30.164 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root 11r FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root 12w FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root 13r FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root 14w FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root 15u sock 0,8 0t0 289862 protocol: UNIX-STREAM 2023-11-04T01:48:30.165 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root 16r FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root 17w FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root 18r FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root 19w FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root 20u sock 0,8 0t0 284475 protocol: TCP 2023-11-04T01:48:30.166 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root 22u sock 0,8 0t0 288052 protocol: TCP 2023-11-04T01:48:30.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:48:30.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root 24r FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root 25w FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root 26r FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.167 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root 27w FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root 29r FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157845 io_contex root 30w FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root cwd DIR 8,1 4096 262170 /home/ubuntu/cephtest 2023-11-04T01:48:30.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.168 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root txt REG 8,1 2635024 11700 /usr/bin/ceph-fuse 2023-11-04T01:48:30.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:30.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:30.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:30.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:30.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:30.169 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:30.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:30.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:30.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:30.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:30.170 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:30.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:30.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:30.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:30.171 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:30.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:30.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:30.172 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:30.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:30.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:30.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:30.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:30.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:30.173 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:30.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:30.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:30.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:30.174 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:30.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:30.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:30.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:30.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:30.175 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:30.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:30.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:30.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:30.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:30.176 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:30.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:30.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:30.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root 0r FIFO 0,13 0t0 285455 pipe 2023-11-04T01:48:30.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root 1w FIFO 0,13 0t0 287069 pipe 2023-11-04T01:48:30.177 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root 2w FIFO 0,13 0t0 287070 pipe 2023-11-04T01:48:30.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root 3w REG 8,1 302997 267541 /var/log/ceph/ceph-client.0.157832.log 2023-11-04T01:48:30.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root 4u a_inode 0,14 0 3100 [eventpoll:5,22] 2023-11-04T01:48:30.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root 5r FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root 6w FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.178 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root 7u a_inode 0,14 0 3100 [eventpoll:8,20] 2023-11-04T01:48:30.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root 8r FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root 9w FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root 10u a_inode 0,14 0 3100 [eventpoll:11] 2023-11-04T01:48:30.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root 11r FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root 12w FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root 13r FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root 14w FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root 15u sock 0,8 0t0 289862 protocol: UNIX-STREAM 2023-11-04T01:48:30.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root 16r FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.180 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root 17w FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root 18r FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root 19w FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root 20u sock 0,8 0t0 284475 protocol: TCP 2023-11-04T01:48:30.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root 22u sock 0,8 0t0 288052 protocol: TCP 2023-11-04T01:48:30.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:48:30.181 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root 24r FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root 25w FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root 26r FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root 27w FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root 29r FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157846 ceph_time root 30w FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root cwd DIR 8,1 4096 262170 /home/ubuntu/cephtest 2023-11-04T01:48:30.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root txt REG 8,1 2635024 11700 /usr/bin/ceph-fuse 2023-11-04T01:48:30.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:30.183 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:30.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:30.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:30.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:30.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:30.184 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:30.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:30.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:30.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:30.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:30.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:30.185 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:30.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:30.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:30.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.186 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:30.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:30.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:30.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:30.187 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:30.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:30.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:30.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:30.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.188 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:30.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:30.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:30.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:30.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:30.189 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:30.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:30.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:30.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:30.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:30.190 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:30.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:30.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:30.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:30.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:30.191 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:30.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:30.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root 0r FIFO 0,13 0t0 285455 pipe 2023-11-04T01:48:30.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root 1w FIFO 0,13 0t0 287069 pipe 2023-11-04T01:48:30.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root 2w FIFO 0,13 0t0 287070 pipe 2023-11-04T01:48:30.192 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root 3w REG 8,1 302997 267541 /var/log/ceph/ceph-client.0.157832.log 2023-11-04T01:48:30.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root 4u a_inode 0,14 0 3100 [eventpoll:5,22] 2023-11-04T01:48:30.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root 5r FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root 6w FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root 7u a_inode 0,14 0 3100 [eventpoll:8,20] 2023-11-04T01:48:30.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root 8r FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.193 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root 9w FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root 10u a_inode 0,14 0 3100 [eventpoll:11] 2023-11-04T01:48:30.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root 11r FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root 12w FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root 13r FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.194 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root 14w FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root 15u sock 0,8 0t0 289862 protocol: UNIX-STREAM 2023-11-04T01:48:30.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root 16r FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root 17w FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root 18r FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.195 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root 19w FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root 20u sock 0,8 0t0 284475 protocol: TCP 2023-11-04T01:48:30.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root 22u sock 0,8 0t0 288052 protocol: TCP 2023-11-04T01:48:30.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:48:30.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root 24r FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.196 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root 25w FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root 26r FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root 27w FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root 29r FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157847 fn_anonym root 30w FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.197 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root cwd DIR 8,1 4096 262170 /home/ubuntu/cephtest 2023-11-04T01:48:30.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root txt REG 8,1 2635024 11700 /usr/bin/ceph-fuse 2023-11-04T01:48:30.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:30.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:30.198 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:30.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:30.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:30.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:30.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:30.199 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:30.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:30.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:30.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:30.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:30.200 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:30.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:30.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:30.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.201 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:30.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:30.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:30.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:30.202 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:30.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:30.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:30.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:30.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:30.203 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:30.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:30.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:30.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:30.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:30.204 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:30.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:30.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:30.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:30.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:30.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:30.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:30.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:30.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:30.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:30.206 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:30.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root 0r FIFO 0,13 0t0 285455 pipe 2023-11-04T01:48:30.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root 1w FIFO 0,13 0t0 287069 pipe 2023-11-04T01:48:30.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root 2w FIFO 0,13 0t0 287070 pipe 2023-11-04T01:48:30.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root 3w REG 8,1 302997 267541 /var/log/ceph/ceph-client.0.157832.log 2023-11-04T01:48:30.207 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root 4u a_inode 0,14 0 3100 [eventpoll:5,22] 2023-11-04T01:48:30.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root 5r FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root 6w FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root 7u a_inode 0,14 0 3100 [eventpoll:8,20] 2023-11-04T01:48:30.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root 8r FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.208 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root 9w FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root 10u a_inode 0,14 0 3100 [eventpoll:11] 2023-11-04T01:48:30.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root 11r FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root 12w FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root 13r FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root 14w FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.209 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root 15u sock 0,8 0t0 289862 protocol: UNIX-STREAM 2023-11-04T01:48:30.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root 16r FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root 17w FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root 18r FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root 19w FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.210 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root 20u sock 0,8 0t0 284475 protocol: TCP 2023-11-04T01:48:30.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root 22u sock 0,8 0t0 288052 protocol: TCP 2023-11-04T01:48:30.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:48:30.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root 24r FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root 25w FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.211 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root 26r FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root 27w FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root 29r FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157848 fn_anonym root 30w FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root cwd DIR 8,1 4096 262170 /home/ubuntu/cephtest 2023-11-04T01:48:30.212 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root txt REG 8,1 2635024 11700 /usr/bin/ceph-fuse 2023-11-04T01:48:30.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:30.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:30.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:30.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:30.213 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:30.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:30.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:30.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:30.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:30.214 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:30.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:30.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:30.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:30.215 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:30.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:30.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:30.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:30.216 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:30.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:30.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:30.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:30.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:30.217 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:30.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:30.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:30.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:30.218 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:30.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:30.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:30.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:30.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:30.219 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:30.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:30.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:30.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:30.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:30.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:30.220 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:30.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:30.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:30.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root 0r FIFO 0,13 0t0 285455 pipe 2023-11-04T01:48:30.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root 1w FIFO 0,13 0t0 287069 pipe 2023-11-04T01:48:30.221 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root 2w FIFO 0,13 0t0 287070 pipe 2023-11-04T01:48:30.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root 3w REG 8,1 302997 267541 /var/log/ceph/ceph-client.0.157832.log 2023-11-04T01:48:30.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root 4u a_inode 0,14 0 3100 [eventpoll:5,22] 2023-11-04T01:48:30.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root 5r FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root 6w FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root 7u a_inode 0,14 0 3100 [eventpoll:8,20] 2023-11-04T01:48:30.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root 8r FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root 9w FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root 10u a_inode 0,14 0 3100 [eventpoll:11] 2023-11-04T01:48:30.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root 11r FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.223 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root 12w FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root 13r FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root 14w FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root 15u sock 0,8 0t0 289862 protocol: UNIX-STREAM 2023-11-04T01:48:30.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root 16r FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root 17w FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root 18r FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root 19w FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root 20u sock 0,8 0t0 284475 protocol: TCP 2023-11-04T01:48:30.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root 22u sock 0,8 0t0 288052 protocol: TCP 2023-11-04T01:48:30.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:48:30.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root 24r FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root 25w FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root 26r FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root 27w FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root 29r FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157849 fn_anonym root 30w FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root cwd DIR 8,1 4096 262170 /home/ubuntu/cephtest 2023-11-04T01:48:30.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root txt REG 8,1 2635024 11700 /usr/bin/ceph-fuse 2023-11-04T01:48:30.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:30.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:30.227 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:30.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:30.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:30.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:30.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:30.228 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:30.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:30.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:30.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:30.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:30.229 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:30.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:30.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:30.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.230 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:30.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:30.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:30.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:30.231 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:30.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:30.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:30.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:30.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.232 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:30.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:30.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:30.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:30.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:30.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:30.233 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:30.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:30.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:30.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:30.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:30.234 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:30.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:30.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:30.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:30.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:30.235 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:30.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root 0r FIFO 0,13 0t0 285455 pipe 2023-11-04T01:48:30.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root 1w FIFO 0,13 0t0 287069 pipe 2023-11-04T01:48:30.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root 2w FIFO 0,13 0t0 287070 pipe 2023-11-04T01:48:30.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root 3w REG 8,1 302997 267541 /var/log/ceph/ceph-client.0.157832.log 2023-11-04T01:48:30.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root 4u a_inode 0,14 0 3100 [eventpoll:5,22] 2023-11-04T01:48:30.236 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root 5r FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root 6w FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root 7u a_inode 0,14 0 3100 [eventpoll:8,20] 2023-11-04T01:48:30.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root 8r FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root 9w FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.237 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root 10u a_inode 0,14 0 3100 [eventpoll:11] 2023-11-04T01:48:30.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root 11r FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root 12w FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root 13r FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root 14w FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.238 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root 15u sock 0,8 0t0 289862 protocol: UNIX-STREAM 2023-11-04T01:48:30.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root 16r FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root 17w FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root 18r FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root 19w FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root 20u sock 0,8 0t0 284475 protocol: TCP 2023-11-04T01:48:30.239 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root 22u sock 0,8 0t0 288052 protocol: TCP 2023-11-04T01:48:30.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:48:30.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root 24r FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root 25w FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root 26r FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.240 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root 27w FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root 29r FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157850 fn_anonym root 30w FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root cwd DIR 8,1 4096 262170 /home/ubuntu/cephtest 2023-11-04T01:48:30.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.241 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root txt REG 8,1 2635024 11700 /usr/bin/ceph-fuse 2023-11-04T01:48:30.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:30.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:30.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:30.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:30.242 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:30.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:30.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:30.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:30.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:30.243 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:30.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:30.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:30.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:30.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:30.244 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:30.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:30.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:30.245 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:30.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:30.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:30.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:30.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:30.246 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:30.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:30.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:30.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:30.247 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:30.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:30.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:30.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:30.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:30.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:30.248 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:30.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:30.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:30.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:30.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:30.249 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:30.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:30.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:30.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root 0r FIFO 0,13 0t0 285455 pipe 2023-11-04T01:48:30.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root 1w FIFO 0,13 0t0 287069 pipe 2023-11-04T01:48:30.250 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root 2w FIFO 0,13 0t0 287070 pipe 2023-11-04T01:48:30.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root 3w REG 8,1 302997 267541 /var/log/ceph/ceph-client.0.157832.log 2023-11-04T01:48:30.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root 4u a_inode 0,14 0 3100 [eventpoll:5,22] 2023-11-04T01:48:30.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root 5r FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root 6w FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.251 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root 7u a_inode 0,14 0 3100 [eventpoll:8,20] 2023-11-04T01:48:30.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root 8r FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root 9w FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root 10u a_inode 0,14 0 3100 [eventpoll:11] 2023-11-04T01:48:30.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root 11r FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root 12w FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.252 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root 13r FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root 14w FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root 15u sock 0,8 0t0 289862 protocol: UNIX-STREAM 2023-11-04T01:48:30.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root 16r FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root 17w FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.253 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root 18r FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root 19w FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root 20u sock 0,8 0t0 284475 protocol: TCP 2023-11-04T01:48:30.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root 22u sock 0,8 0t0 288052 protocol: TCP 2023-11-04T01:48:30.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:48:30.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root 24r FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root 25w FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root 26r FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root 27w FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root 29r FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.255 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157851 fn_anonym root 30w FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root cwd DIR 8,1 4096 262170 /home/ubuntu/cephtest 2023-11-04T01:48:30.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root txt REG 8,1 2635024 11700 /usr/bin/ceph-fuse 2023-11-04T01:48:30.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:30.256 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:30.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:30.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:30.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:30.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:30.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:30.257 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:30.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:30.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:30.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:30.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:30.258 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:30.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:30.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:30.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.259 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:30.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:30.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:30.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:30.260 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:30.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:30.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:30.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:30.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.261 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:30.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:30.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:30.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:30.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:30.262 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:30.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:30.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:30.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:30.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:30.263 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:30.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:30.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:30.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:30.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:30.264 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:30.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:30.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root 0r FIFO 0,13 0t0 285455 pipe 2023-11-04T01:48:30.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root 1w FIFO 0,13 0t0 287069 pipe 2023-11-04T01:48:30.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root 2w FIFO 0,13 0t0 287070 pipe 2023-11-04T01:48:30.265 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root 3w REG 8,1 302997 267541 /var/log/ceph/ceph-client.0.157832.log 2023-11-04T01:48:30.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root 4u a_inode 0,14 0 3100 [eventpoll:5,22] 2023-11-04T01:48:30.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root 5r FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root 6w FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root 7u a_inode 0,14 0 3100 [eventpoll:8,20] 2023-11-04T01:48:30.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root 8r FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.266 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root 9w FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root 10u a_inode 0,14 0 3100 [eventpoll:11] 2023-11-04T01:48:30.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root 11r FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root 12w FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root 13r FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.267 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root 14w FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root 15u sock 0,8 0t0 289862 protocol: UNIX-STREAM 2023-11-04T01:48:30.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root 16r FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root 17w FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root 18r FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.268 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root 19w FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root 20u sock 0,8 0t0 284475 protocol: TCP 2023-11-04T01:48:30.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root 22u sock 0,8 0t0 288052 protocol: TCP 2023-11-04T01:48:30.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:48:30.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root 24r FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.269 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root 25w FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root 26r FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root 27w FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root 29r FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157852 safe_time root 30w FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.270 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root cwd DIR 8,1 4096 262170 /home/ubuntu/cephtest 2023-11-04T01:48:30.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root txt REG 8,1 2635024 11700 /usr/bin/ceph-fuse 2023-11-04T01:48:30.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:30.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:30.271 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:30.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:30.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:30.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:30.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:30.272 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:30.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:30.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:30.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:30.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:30.273 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:30.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:30.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:30.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.274 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:30.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:30.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:30.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:30.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:30.275 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:30.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:30.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:30.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:30.276 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:30.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:30.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:30.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:30.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:30.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:30.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:30.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:30.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:30.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:30.278 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:30.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:30.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:30.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:30.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:30.279 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:30.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root 0r FIFO 0,13 0t0 285455 pipe 2023-11-04T01:48:30.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root 1w FIFO 0,13 0t0 287069 pipe 2023-11-04T01:48:30.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root 2w FIFO 0,13 0t0 287070 pipe 2023-11-04T01:48:30.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root 3w REG 8,1 302997 267541 /var/log/ceph/ceph-client.0.157832.log 2023-11-04T01:48:30.280 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root 4u a_inode 0,14 0 3100 [eventpoll:5,22] 2023-11-04T01:48:30.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root 5r FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root 6w FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root 7u a_inode 0,14 0 3100 [eventpoll:8,20] 2023-11-04T01:48:30.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root 8r FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.281 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root 9w FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root 10u a_inode 0,14 0 3100 [eventpoll:11] 2023-11-04T01:48:30.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root 11r FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root 12w FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root 13r FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root 14w FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.282 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root 15u sock 0,8 0t0 289862 protocol: UNIX-STREAM 2023-11-04T01:48:30.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root 16r FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root 17w FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root 18r FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root 19w FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.283 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root 20u sock 0,8 0t0 284475 protocol: TCP 2023-11-04T01:48:30.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root 22u sock 0,8 0t0 288052 protocol: TCP 2023-11-04T01:48:30.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:48:30.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root 24r FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root 25w FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.284 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root 26r FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root 27w FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root 29r FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157853 fn_anonym root 30w FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root cwd DIR 8,1 4096 262170 /home/ubuntu/cephtest 2023-11-04T01:48:30.285 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root txt REG 8,1 2635024 11700 /usr/bin/ceph-fuse 2023-11-04T01:48:30.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:30.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:30.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:30.286 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:30.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:30.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:30.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:30.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:30.287 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:30.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:30.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:30.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:30.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.288 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:30.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:30.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:30.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:30.289 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:30.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:30.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:30.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:30.290 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:30.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:30.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:30.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:30.291 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:30.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:30.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:30.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:30.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:30.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:30.292 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:30.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:30.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:30.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:30.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:30.293 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:30.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:30.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:30.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:30.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:30.294 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root 0r FIFO 0,13 0t0 285455 pipe 2023-11-04T01:48:30.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root 1w FIFO 0,13 0t0 287069 pipe 2023-11-04T01:48:30.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root 2w FIFO 0,13 0t0 287070 pipe 2023-11-04T01:48:30.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root 3w REG 8,1 302997 267541 /var/log/ceph/ceph-client.0.157832.log 2023-11-04T01:48:30.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root 4u a_inode 0,14 0 3100 [eventpoll:5,22] 2023-11-04T01:48:30.295 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root 5r FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root 6w FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root 7u a_inode 0,14 0 3100 [eventpoll:8,20] 2023-11-04T01:48:30.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root 8r FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root 9w FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.296 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root 10u a_inode 0,14 0 3100 [eventpoll:11] 2023-11-04T01:48:30.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root 11r FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root 12w FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root 13r FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root 14w FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root 15u sock 0,8 0t0 289862 protocol: UNIX-STREAM 2023-11-04T01:48:30.297 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root 16r FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root 17w FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root 18r FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root 19w FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root 20u sock 0,8 0t0 284475 protocol: TCP 2023-11-04T01:48:30.298 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root 22u sock 0,8 0t0 288052 protocol: TCP 2023-11-04T01:48:30.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:48:30.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root 24r FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root 25w FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root 26r FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.299 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root 27w FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root 29r FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157854 flusher root 30w FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root cwd DIR 8,1 4096 262170 /home/ubuntu/cephtest 2023-11-04T01:48:30.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.300 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root txt REG 8,1 2635024 11700 /usr/bin/ceph-fuse 2023-11-04T01:48:30.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:30.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:30.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:30.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:30.301 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:30.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:30.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:30.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:30.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:30.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:30.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:30.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:30.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:30.303 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:30.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:30.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:30.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.304 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:30.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:30.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:30.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:30.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:30.305 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:30.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:30.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:30.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:30.306 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:30.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:30.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:30.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:30.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:30.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:30.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:30.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:30.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:30.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:30.308 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:30.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:30.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:30.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:30.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:30.309 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root 0r FIFO 0,13 0t0 285455 pipe 2023-11-04T01:48:30.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root 1w FIFO 0,13 0t0 287069 pipe 2023-11-04T01:48:30.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root 2w FIFO 0,13 0t0 287070 pipe 2023-11-04T01:48:30.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root 3w REG 8,1 302997 267541 /var/log/ceph/ceph-client.0.157832.log 2023-11-04T01:48:30.310 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root 4u a_inode 0,14 0 3100 [eventpoll:5,22] 2023-11-04T01:48:30.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root 5r FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root 6w FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root 7u a_inode 0,14 0 3100 [eventpoll:8,20] 2023-11-04T01:48:30.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root 8r FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root 9w FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.311 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root 10u a_inode 0,14 0 3100 [eventpoll:11] 2023-11-04T01:48:30.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root 11r FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root 12w FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root 13r FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root 14w FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.312 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root 15u sock 0,8 0t0 289862 protocol: UNIX-STREAM 2023-11-04T01:48:30.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root 16r FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root 17w FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root 18r FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root 19w FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root 20u sock 0,8 0t0 284475 protocol: TCP 2023-11-04T01:48:30.313 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root 22u sock 0,8 0t0 288052 protocol: TCP 2023-11-04T01:48:30.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:48:30.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root 24r FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root 25w FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root 26r FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.314 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root 27w FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root 29r FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157855 ms_dispat root 30w FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root cwd DIR 8,1 4096 262170 /home/ubuntu/cephtest 2023-11-04T01:48:30.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.315 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root txt REG 8,1 2635024 11700 /usr/bin/ceph-fuse 2023-11-04T01:48:30.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:30.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:30.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:30.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:30.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:30.316 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:30.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:30.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:30.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:30.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:30.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:30.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:30.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:30.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:30.318 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:30.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:30.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:30.319 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:30.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:30.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:30.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:30.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:30.320 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:30.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:30.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:30.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:30.321 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:30.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:30.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:30.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:30.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:30.322 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:30.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:30.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:30.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:30.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:30.323 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:30.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:30.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:30.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:30.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root 0r FIFO 0,13 0t0 285455 pipe 2023-11-04T01:48:30.324 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root 1w FIFO 0,13 0t0 287069 pipe 2023-11-04T01:48:30.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root 2w FIFO 0,13 0t0 287070 pipe 2023-11-04T01:48:30.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root 3w REG 8,1 302997 267541 /var/log/ceph/ceph-client.0.157832.log 2023-11-04T01:48:30.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root 4u a_inode 0,14 0 3100 [eventpoll:5,22] 2023-11-04T01:48:30.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root 5r FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root 6w FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.325 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root 7u a_inode 0,14 0 3100 [eventpoll:8,20] 2023-11-04T01:48:30.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root 8r FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root 9w FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root 10u a_inode 0,14 0 3100 [eventpoll:11] 2023-11-04T01:48:30.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root 11r FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.326 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root 12w FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root 13r FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root 14w FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root 15u sock 0,8 0t0 289862 protocol: UNIX-STREAM 2023-11-04T01:48:30.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root 16r FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.327 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root 17w FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root 18r FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root 19w FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root 20u sock 0,8 0t0 284475 protocol: TCP 2023-11-04T01:48:30.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root 22u sock 0,8 0t0 288052 protocol: TCP 2023-11-04T01:48:30.328 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:48:30.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root 24r FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root 25w FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root 26r FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root 27w FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.329 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root 29r FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157856 ms_local root 30w FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root cwd DIR 8,1 4096 262170 /home/ubuntu/cephtest 2023-11-04T01:48:30.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.330 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root txt REG 8,1 2635024 11700 /usr/bin/ceph-fuse 2023-11-04T01:48:30.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:30.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:30.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:30.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:30.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:30.331 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:30.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:30.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:30.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:30.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:30.332 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:30.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:30.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:30.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:30.333 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:30.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:30.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:30.334 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:30.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:30.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:30.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:30.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:30.335 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:30.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:30.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:30.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:30.336 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:30.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:30.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:30.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:30.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:30.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:30.337 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:30.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:30.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:30.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:30.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:30.338 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:30.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:30.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:30.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root 0r FIFO 0,13 0t0 285455 pipe 2023-11-04T01:48:30.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root 1w FIFO 0,13 0t0 287069 pipe 2023-11-04T01:48:30.339 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root 2w FIFO 0,13 0t0 287070 pipe 2023-11-04T01:48:30.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root 3w REG 8,1 302997 267541 /var/log/ceph/ceph-client.0.157832.log 2023-11-04T01:48:30.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root 4u a_inode 0,14 0 3100 [eventpoll:5,22] 2023-11-04T01:48:30.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root 5r FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root 6w FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.340 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root 7u a_inode 0,14 0 3100 [eventpoll:8,20] 2023-11-04T01:48:30.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root 8r FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root 9w FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root 10u a_inode 0,14 0 3100 [eventpoll:11] 2023-11-04T01:48:30.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root 11r FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.341 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root 12w FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root 13r FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root 14w FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root 15u sock 0,8 0t0 289862 protocol: UNIX-STREAM 2023-11-04T01:48:30.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root 16r FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.342 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root 17w FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root 18r FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root 19w FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root 20u sock 0,8 0t0 284475 protocol: TCP 2023-11-04T01:48:30.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root 22u sock 0,8 0t0 288052 protocol: TCP 2023-11-04T01:48:30.343 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:48:30.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root 24r FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root 25w FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root 26r FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root 27w FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root 29r FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.344 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157857 safe_time root 30w FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root cwd DIR 8,1 4096 262170 /home/ubuntu/cephtest 2023-11-04T01:48:30.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root txt REG 8,1 2635024 11700 /usr/bin/ceph-fuse 2023-11-04T01:48:30.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:30.345 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:30.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:30.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:30.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:30.346 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:30.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:30.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:30.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:30.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:30.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:30.347 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:30.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:30.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:30.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:30.348 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:30.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:30.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:30.349 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:30.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:30.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:30.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:30.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:30.350 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:30.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:30.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:30.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:30.351 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:30.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:30.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:30.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:30.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:30.352 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:30.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:30.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:30.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:30.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:30.353 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:30.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:30.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:30.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root 0r FIFO 0,13 0t0 285455 pipe 2023-11-04T01:48:30.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root 1w FIFO 0,13 0t0 287069 pipe 2023-11-04T01:48:30.354 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root 2w FIFO 0,13 0t0 287070 pipe 2023-11-04T01:48:30.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root 3w REG 8,1 302997 267541 /var/log/ceph/ceph-client.0.157832.log 2023-11-04T01:48:30.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root 4u a_inode 0,14 0 3100 [eventpoll:5,22] 2023-11-04T01:48:30.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root 5r FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root 6w FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.355 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root 7u a_inode 0,14 0 3100 [eventpoll:8,20] 2023-11-04T01:48:30.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root 8r FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root 9w FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root 10u a_inode 0,14 0 3100 [eventpoll:11] 2023-11-04T01:48:30.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root 11r FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root 12w FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.356 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root 13r FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root 14w FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root 15u sock 0,8 0t0 289862 protocol: UNIX-STREAM 2023-11-04T01:48:30.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root 16r FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root 17w FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.357 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root 18r FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root 19w FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root 20u sock 0,8 0t0 284475 protocol: TCP 2023-11-04T01:48:30.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root 22u sock 0,8 0t0 288052 protocol: TCP 2023-11-04T01:48:30.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:48:30.358 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root 24r FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root 25w FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root 26r FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root 27w FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root 29r FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157858 ceph-fuse root 30w FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.359 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root cwd DIR 8,1 4096 262170 /home/ubuntu/cephtest 2023-11-04T01:48:30.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root txt REG 8,1 2635024 11700 /usr/bin/ceph-fuse 2023-11-04T01:48:30.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:30.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:30.360 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:30.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:30.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:30.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:30.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:30.361 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:30.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:30.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:30.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:30.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:30.362 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:30.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:30.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:30.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:30.363 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:30.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:30.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:30.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:30.364 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:30.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:30.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:30.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:30.365 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:30.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:30.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:30.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:30.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:30.366 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:30.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:30.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:30.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:30.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:30.367 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:30.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:30.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:30.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:30.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:30.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:30.368 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root 0r FIFO 0,13 0t0 285455 pipe 2023-11-04T01:48:30.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root 1w FIFO 0,13 0t0 287069 pipe 2023-11-04T01:48:30.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root 2w FIFO 0,13 0t0 287070 pipe 2023-11-04T01:48:30.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root 3w REG 8,1 302997 267541 /var/log/ceph/ceph-client.0.157832.log 2023-11-04T01:48:30.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root 4u a_inode 0,14 0 3100 [eventpoll:5,22] 2023-11-04T01:48:30.369 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root 5r FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root 6w FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root 7u a_inode 0,14 0 3100 [eventpoll:8,20] 2023-11-04T01:48:30.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root 8r FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root 9w FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.370 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root 10u a_inode 0,14 0 3100 [eventpoll:11] 2023-11-04T01:48:30.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root 11r FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root 12w FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root 13r FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root 14w FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root 15u sock 0,8 0t0 289862 protocol: UNIX-STREAM 2023-11-04T01:48:30.371 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root 16r FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root 17w FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root 18r FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root 19w FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root 20u sock 0,8 0t0 284475 protocol: TCP 2023-11-04T01:48:30.372 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root 22u sock 0,8 0t0 288052 protocol: TCP 2023-11-04T01:48:30.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:48:30.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root 24r FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root 25w FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root 26r FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.373 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root 27w FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root 29r FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157860 ceph-fuse root 30w FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root cwd DIR 8,1 4096 262170 /home/ubuntu/cephtest 2023-11-04T01:48:30.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.374 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root txt REG 8,1 2635024 11700 /usr/bin/ceph-fuse 2023-11-04T01:48:30.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:30.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:30.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:30.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:30.375 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:30.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:30.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:30.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:30.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:30.376 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:30.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:30.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:30.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:30.377 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:30.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:30.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:30.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.378 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:30.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:30.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:30.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:30.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:30.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:30.379 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:30.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:30.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:30.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:30.380 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:30.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:30.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:30.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:30.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:30.381 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:30.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:30.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:30.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:30.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:30.382 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:30.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:30.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:30.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:30.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root 0r FIFO 0,13 0t0 285455 pipe 2023-11-04T01:48:30.383 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root 1w FIFO 0,13 0t0 287069 pipe 2023-11-04T01:48:30.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root 2w FIFO 0,13 0t0 287070 pipe 2023-11-04T01:48:30.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root 3w REG 8,1 302997 267541 /var/log/ceph/ceph-client.0.157832.log 2023-11-04T01:48:30.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root 4u a_inode 0,14 0 3100 [eventpoll:5,22] 2023-11-04T01:48:30.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root 5r FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.384 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root 6w FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root 7u a_inode 0,14 0 3100 [eventpoll:8,20] 2023-11-04T01:48:30.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root 8r FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root 9w FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root 10u a_inode 0,14 0 3100 [eventpoll:11] 2023-11-04T01:48:30.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root 11r FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.385 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root 12w FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root 13r FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root 14w FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root 15u sock 0,8 0t0 289862 protocol: UNIX-STREAM 2023-11-04T01:48:30.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root 16r FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.386 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root 17w FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root 18r FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root 19w FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root 20u sock 0,8 0t0 284475 protocol: TCP 2023-11-04T01:48:30.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root 22u sock 0,8 0t0 288052 protocol: TCP 2023-11-04T01:48:30.387 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:48:30.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root 24r FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root 25w FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root 26r FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root 27w FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.388 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root 29r FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 157862 ceph-fuse root 30w FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root cwd DIR 8,1 4096 262170 /home/ubuntu/cephtest 2023-11-04T01:48:30.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root txt REG 8,1 2635024 11700 /usr/bin/ceph-fuse 2023-11-04T01:48:30.389 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2023-11-04T01:48:30.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2023-11-04T01:48:30.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2023-11-04T01:48:30.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 53816 1523 /usr/lib64/libnuma.so.1.0.0 2023-11-04T01:48:30.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 53272 1914 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2023-11-04T01:48:30.390 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:30.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:30.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:30.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:30.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-11-04T01:48:30.391 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:30.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:30.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-11-04T01:48:30.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:30.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:30.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:30.392 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-11-04T01:48:30.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:30.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:30.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:30.393 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:30.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:30.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:30.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-11-04T01:48:30.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-11-04T01:48:30.394 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2023-11-04T01:48:30.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 639224 1878 /usr/lib64/libthrift-0.15.0.so 2023-11-04T01:48:30.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-11-04T01:48:30.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-11-04T01:48:30.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-11-04T01:48:30.395 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2023-11-04T01:48:30.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-11-04T01:48:30.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:30.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2023-11-04T01:48:30.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2023-11-04T01:48:30.396 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-11-04T01:48:30.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-11-04T01:48:30.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:30.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 9894040 265631 /usr/lib64/ceph/libceph-common.so.2 2023-11-04T01:48:30.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:30.397 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:30.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2023-11-04T01:48:30.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:30.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root 0r FIFO 0,13 0t0 285455 pipe 2023-11-04T01:48:30.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root 1w FIFO 0,13 0t0 287069 pipe 2023-11-04T01:48:30.398 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root 2w FIFO 0,13 0t0 287070 pipe 2023-11-04T01:48:30.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root 3w REG 8,1 302997 267541 /var/log/ceph/ceph-client.0.157832.log 2023-11-04T01:48:30.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root 4u a_inode 0,14 0 3100 [eventpoll:5,22] 2023-11-04T01:48:30.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root 5r FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root 6w FIFO 0,13 0t0 289858 pipe 2023-11-04T01:48:30.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root 7u a_inode 0,14 0 3100 [eventpoll:8,20] 2023-11-04T01:48:30.399 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root 8r FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root 9w FIFO 0,13 0t0 289859 pipe 2023-11-04T01:48:30.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root 10u a_inode 0,14 0 3100 [eventpoll:11] 2023-11-04T01:48:30.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root 11r FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root 12w FIFO 0,13 0t0 289860 pipe 2023-11-04T01:48:30.400 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root 13r FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root 14w FIFO 0,13 0t0 289861 pipe 2023-11-04T01:48:30.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root 15u sock 0,8 0t0 289862 protocol: UNIX-STREAM 2023-11-04T01:48:30.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root 16r FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root 17w FIFO 0,13 0t0 289863 pipe 2023-11-04T01:48:30.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root 18r FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.401 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root 19w FIFO 0,13 0t0 289864 pipe 2023-11-04T01:48:30.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root 20u sock 0,8 0t0 284475 protocol: TCP 2023-11-04T01:48:30.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root 22u sock 0,8 0t0 288052 protocol: TCP 2023-11-04T01:48:30.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root 23u CHR 10,229 0t0 161 /dev/fuse 2023-11-04T01:48:30.402 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root 24r FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root 25w FIFO 0,13 0t0 287082 pipe 2023-11-04T01:48:30.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root 26r FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root 27w FIFO 0,13 0t0 283480 pipe 2023-11-04T01:48:30.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root 29r FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.403 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-fuse 157832 158057 ceph-fuse root 30w FIFO 0,13 0t0 289121 pipe 2023-11-04T01:48:30.403 INFO:teuthology.orchestra.run.smithi077.stdout:bash 158204 ubuntu cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:30.404 INFO:teuthology.orchestra.run.smithi077.stdout:bash 158204 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.404 INFO:teuthology.orchestra.run.smithi077.stdout:bash 158204 ubuntu txt REG 8,1 1388920 9667 /usr/bin/bash 2023-11-04T01:48:30.404 INFO:teuthology.orchestra.run.smithi077.stdout:bash 158204 ubuntu mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:48:30.404 INFO:teuthology.orchestra.run.smithi077.stdout:bash 158204 ubuntu mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:30.404 INFO:teuthology.orchestra.run.smithi077.stdout:bash 158204 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:30.405 INFO:teuthology.orchestra.run.smithi077.stdout:bash 158204 ubuntu mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:48:30.405 INFO:teuthology.orchestra.run.smithi077.stdout:bash 158204 ubuntu mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:48:30.405 INFO:teuthology.orchestra.run.smithi077.stdout:bash 158204 ubuntu mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:48:30.405 INFO:teuthology.orchestra.run.smithi077.stdout:bash 158204 ubuntu mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:48:30.405 INFO:teuthology.orchestra.run.smithi077.stdout:bash 158204 ubuntu mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:48:30.406 INFO:teuthology.orchestra.run.smithi077.stdout:bash 158204 ubuntu mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:48:30.406 INFO:teuthology.orchestra.run.smithi077.stdout:bash 158204 ubuntu mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:48:30.406 INFO:teuthology.orchestra.run.smithi077.stdout:bash 158204 ubuntu mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:48:30.406 INFO:teuthology.orchestra.run.smithi077.stdout:bash 158204 ubuntu mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:48:30.406 INFO:teuthology.orchestra.run.smithi077.stdout:bash 158204 ubuntu mem REG 8,1 195080 9664 /usr/lib64/libtinfo.so.6.2 2023-11-04T01:48:30.407 INFO:teuthology.orchestra.run.smithi077.stdout:bash 158204 ubuntu mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:30.407 INFO:teuthology.orchestra.run.smithi077.stdout:bash 158204 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:30.407 INFO:teuthology.orchestra.run.smithi077.stdout:bash 158204 ubuntu mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:48:30.407 INFO:teuthology.orchestra.run.smithi077.stdout:bash 158204 ubuntu 0r FIFO 0,13 0t0 285589 pipe 2023-11-04T01:48:30.407 INFO:teuthology.orchestra.run.smithi077.stdout:bash 158204 ubuntu 1w FIFO 0,13 0t0 285590 pipe 2023-11-04T01:48:30.408 INFO:teuthology.orchestra.run.smithi077.stdout:bash 158204 ubuntu 2w FIFO 0,13 0t0 285591 pipe 2023-11-04T01:48:30.408 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir 158220 ubuntu cwd DIR 0,42 0 1 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:48:30.408 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir 158220 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.408 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir 158220 ubuntu txt REG 8,1 69752 10054 /usr/bin/mkdir 2023-11-04T01:48:30.408 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir 158220 ubuntu mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:48:30.409 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir 158220 ubuntu mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:30.409 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir 158220 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:30.409 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir 158220 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:30.409 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir 158220 ubuntu mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:48:30.409 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir 158220 ubuntu mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:48:30.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:48:30.411 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir 158220 ubuntu mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:48:30.412 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir 158220 ubuntu mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:48:30.412 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir 158220 ubuntu mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:48:30.412 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir 158220 ubuntu mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:48:30.412 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir 158220 ubuntu mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:48:30.413 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir 158220 ubuntu mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:48:30.413 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir 158220 ubuntu mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:48:30.413 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir 158220 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:30.413 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir 158220 ubuntu mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:30.413 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir 158220 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:30.414 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir 158220 ubuntu mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:48:30.414 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir 158220 ubuntu 0r FIFO 0,13 0t0 285589 pipe 2023-11-04T01:48:30.414 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir 158220 ubuntu 1w FIFO 0,13 0t0 285590 pipe 2023-11-04T01:48:30.414 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir 158220 ubuntu 2w FIFO 0,13 0t0 285591 pipe 2023-11-04T01:48:30.414 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/1 158546 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:30.415 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/1 158546 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.415 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/1 158546 root txt unknown /proc/158546/exe 2023-11-04T01:48:30.415 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/1 158547 root cwd DIR 8,1 4096 2 / 2023-11-04T01:48:30.415 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/1 158547 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.416 INFO:teuthology.orchestra.run.smithi077.stdout:kworker/1 158547 root txt unknown /proc/158547/exe 2023-11-04T01:48:30.416 INFO:teuthology.orchestra.run.smithi077.stdout:bash 159271 ubuntu cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:30.416 INFO:teuthology.orchestra.run.smithi077.stdout:bash 159271 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.416 INFO:teuthology.orchestra.run.smithi077.stdout:bash 159271 ubuntu txt REG 8,1 1388920 9667 /usr/bin/bash 2023-11-04T01:48:30.416 INFO:teuthology.orchestra.run.smithi077.stdout:bash 159271 ubuntu mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:48:30.417 INFO:teuthology.orchestra.run.smithi077.stdout:bash 159271 ubuntu mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:30.417 INFO:teuthology.orchestra.run.smithi077.stdout:bash 159271 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:30.417 INFO:teuthology.orchestra.run.smithi077.stdout:bash 159271 ubuntu mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:48:30.417 INFO:teuthology.orchestra.run.smithi077.stdout:bash 159271 ubuntu mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:48:30.417 INFO:teuthology.orchestra.run.smithi077.stdout:bash 159271 ubuntu mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:48:30.418 INFO:teuthology.orchestra.run.smithi077.stdout:bash 159271 ubuntu mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:48:30.418 INFO:teuthology.orchestra.run.smithi077.stdout:bash 159271 ubuntu mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:48:30.418 INFO:teuthology.orchestra.run.smithi077.stdout:bash 159271 ubuntu mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:48:30.418 INFO:teuthology.orchestra.run.smithi077.stdout:bash 159271 ubuntu mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:48:30.418 INFO:teuthology.orchestra.run.smithi077.stdout:bash 159271 ubuntu mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:48:30.419 INFO:teuthology.orchestra.run.smithi077.stdout:bash 159271 ubuntu mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:48:30.419 INFO:teuthology.orchestra.run.smithi077.stdout:bash 159271 ubuntu mem REG 8,1 195080 9664 /usr/lib64/libtinfo.so.6.2 2023-11-04T01:48:30.419 INFO:teuthology.orchestra.run.smithi077.stdout:bash 159271 ubuntu mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:30.419 INFO:teuthology.orchestra.run.smithi077.stdout:bash 159271 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:30.420 INFO:teuthology.orchestra.run.smithi077.stdout:bash 159271 ubuntu mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:48:30.420 INFO:teuthology.orchestra.run.smithi077.stdout:bash 159271 ubuntu 0r FIFO 0,13 0t0 290356 pipe 2023-11-04T01:48:30.420 INFO:teuthology.orchestra.run.smithi077.stdout:bash 159271 ubuntu 1w FIFO 0,13 0t0 290357 pipe 2023-11-04T01:48:30.420 INFO:teuthology.orchestra.run.smithi077.stdout:bash 159271 ubuntu 2w FIFO 0,13 0t0 290358 pipe 2023-11-04T01:48:30.420 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:30.421 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.421 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-11-04T01:48:30.421 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-11-04T01:48:30.421 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-11-04T01:48:30.421 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-11-04T01:48:30.422 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-11-04T01:48:30.422 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-11-04T01:48:30.422 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-11-04T01:48:30.422 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-11-04T01:48:30.423 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-11-04T01:48:30.423 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-11-04T01:48:30.423 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-11-04T01:48:30.423 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-11-04T01:48:30.423 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-11-04T01:48:30.424 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-11-04T01:48:30.424 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-11-04T01:48:30.424 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:30.424 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-11-04T01:48:30.425 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-11-04T01:48:30.425 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:30.425 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:30.425 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:30.426 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:30.426 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:30.426 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.426 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-11-04T01:48:30.426 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-11-04T01:48:30.427 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-11-04T01:48:30.427 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-11-04T01:48:30.427 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:30.427 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-11-04T01:48:30.428 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:30.428 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-11-04T01:48:30.428 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:30.428 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-11-04T01:48:30.428 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-11-04T01:48:30.428 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-11-04T01:48:30.429 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-11-04T01:48:30.429 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-11-04T01:48:30.429 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:30.429 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-11-04T01:48:30.429 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:30.430 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-11-04T01:48:30.430 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-11-04T01:48:30.430 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-11-04T01:48:30.430 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-11-04T01:48:30.430 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-11-04T01:48:30.431 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-11-04T01:48:30.431 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-11-04T01:48:30.431 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-11-04T01:48:30.431 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:30.431 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-11-04T01:48:30.432 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:48:30.432 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:30.432 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-11-04T01:48:30.432 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:30.432 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:30.433 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-11-04T01:48:30.433 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root 0r FIFO 0,13 0t0 290356 pipe 2023-11-04T01:48:30.433 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root 1w FIFO 0,13 0t0 290357 pipe 2023-11-04T01:48:30.433 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root 2w FIFO 0,13 0t0 290358 pipe 2023-11-04T01:48:30.433 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root 3r FIFO 0,13 0t0 290364 pipe 2023-11-04T01:48:30.434 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root 4w FIFO 0,13 0t0 290364 pipe 2023-11-04T01:48:30.434 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root 5u netlink 0t0 290370 AUDIT 2023-11-04T01:48:30.434 INFO:teuthology.orchestra.run.smithi077.stdout:sudo 159287 root 6u unix 0xffff9ba920129540 0t0 290371 type=DGRAM (CONNECTED) 2023-11-04T01:48:30.434 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 159289 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:30.434 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 159289 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.435 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 159289 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-11-04T01:48:30.435 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 159289 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-11-04T01:48:30.435 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 159289 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:30.435 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 159289 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-11-04T01:48:30.435 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 159289 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:30.436 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 159289 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:30.436 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 159289 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:30.436 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 159289 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:30.436 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 159289 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:30.436 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 159289 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:30.437 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 159289 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:30.437 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 159289 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:30.437 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 159289 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:30.437 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 159289 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:30.437 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 159289 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:30.438 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 159289 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-11-04T01:48:30.438 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 159289 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-11-04T01:48:30.438 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 159289 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-11-04T01:48:30.438 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 159289 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:30.438 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 159289 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:30.439 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 159289 root 0r FIFO 0,13 0t0 290356 pipe 2023-11-04T01:48:30.439 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 159289 root 1w FIFO 0,13 0t0 290357 pipe 2023-11-04T01:48:30.439 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 159289 root 2w FIFO 0,13 0t0 290358 pipe 2023-11-04T01:48:30.439 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 159289 root 3r FIFO 0,13 0t0 289514 pipe 2023-11-04T01:48:30.439 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 159289 root 4w FIFO 0,13 0t0 289514 pipe 2023-11-04T01:48:30.439 INFO:teuthology.orchestra.run.smithi077.stdout:stdin-kil 159289 root 6w FIFO 0,13 0t0 289515 pipe 2023-11-04T01:48:30.440 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159290 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:30.440 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159290 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.440 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159290 root txt REG 8,1 179232 12343 /usr/bin/lsof 2023-11-04T01:48:30.440 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159290 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:30.441 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159290 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:30.441 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159290 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:30.441 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159290 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:30.441 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159290 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:30.441 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159290 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:30.441 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159290 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:30.442 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159290 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:30.442 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159290 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:30.442 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159290 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:30.442 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159290 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.442 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159290 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:30.443 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159290 root mem REG 8,1 196112 11431 /usr/lib64/libtirpc.so.3.0.0 2023-11-04T01:48:30.443 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159290 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:30.443 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159290 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:30.443 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159290 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:30.443 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159290 root 0r FIFO 0,13 0t0 289515 pipe 2023-11-04T01:48:30.444 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159290 root 1w FIFO 0,13 0t0 290357 pipe 2023-11-04T01:48:30.444 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159290 root 2w FIFO 0,13 0t0 290358 pipe 2023-11-04T01:48:30.444 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159290 root 3r DIR 0,20 0 1 /proc 2023-11-04T01:48:30.444 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159290 root 4r DIR 0,20 0 293035 /proc/159290/fd 2023-11-04T01:48:30.444 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159290 root 5w FIFO 0,13 0t0 293047 pipe 2023-11-04T01:48:30.445 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159290 root 6r FIFO 0,13 0t0 293048 pipe 2023-11-04T01:48:30.445 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159291 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-11-04T01:48:30.445 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159291 root rtd DIR 8,1 4096 2 / 2023-11-04T01:48:30.445 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159291 root txt REG 8,1 179232 12343 /usr/bin/lsof 2023-11-04T01:48:30.445 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159291 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-11-04T01:48:30.446 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159291 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:48:30.446 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159291 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-11-04T01:48:30.446 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159291 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-11-04T01:48:30.446 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159291 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-11-04T01:48:30.446 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159291 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-11-04T01:48:30.447 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159291 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-11-04T01:48:30.447 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159291 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-11-04T01:48:30.447 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159291 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-11-04T01:48:30.447 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159291 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-11-04T01:48:30.447 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159291 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-11-04T01:48:30.448 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159291 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-11-04T01:48:30.448 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159291 root mem REG 8,1 196112 11431 /usr/lib64/libtirpc.so.3.0.0 2023-11-04T01:48:30.448 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159291 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-11-04T01:48:30.448 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159291 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-11-04T01:48:30.448 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159291 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-11-04T01:48:30.448 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159291 root 4r FIFO 0,13 0t0 293047 pipe 2023-11-04T01:48:30.449 INFO:teuthology.orchestra.run.smithi077.stdout:lsof 159291 root 7w FIFO 0,13 0t0 293048 pipe 2023-11-04T01:48:30.449 INFO:teuthology.orchestra.run.smithi077.stdout:USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND 2023-11-04T01:48:30.449 INFO:teuthology.orchestra.run.smithi077.stdout:root 2 0.0 0.0 0 0 ? S 01:26 0:00 [kthreadd] 2023-11-04T01:48:30.449 INFO:teuthology.orchestra.run.smithi077.stdout:root 3 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [rcu_gp] 2023-11-04T01:48:30.449 INFO:teuthology.orchestra.run.smithi077.stdout:root 4 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [rcu_par_gp] 2023-11-04T01:48:30.450 INFO:teuthology.orchestra.run.smithi077.stdout:root 5 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [slub_flushwq] 2023-11-04T01:48:30.450 INFO:teuthology.orchestra.run.smithi077.stdout:root 6 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [netns] 2023-11-04T01:48:30.450 INFO:teuthology.orchestra.run.smithi077.stdout:root 8 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [kworker/0:0H-events_highpri] 2023-11-04T01:48:30.450 INFO:teuthology.orchestra.run.smithi077.stdout:root 10 0.0 0.0 0 0 ? I 01:26 0:00 \_ [kworker/u16:0-ext4-rsv-conversion] 2023-11-04T01:48:30.450 INFO:teuthology.orchestra.run.smithi077.stdout:root 11 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [mm_percpu_wq] 2023-11-04T01:48:30.451 INFO:teuthology.orchestra.run.smithi077.stdout:root 12 0.0 0.0 0 0 ? I 01:26 0:00 \_ [kworker/u16:1-events_unbound] 2023-11-04T01:48:30.451 INFO:teuthology.orchestra.run.smithi077.stdout:root 13 0.0 0.0 0 0 ? I 01:26 0:00 \_ [rcu_tasks_kthre] 2023-11-04T01:48:30.451 INFO:teuthology.orchestra.run.smithi077.stdout:root 14 0.0 0.0 0 0 ? I 01:26 0:00 \_ [rcu_tasks_rude_] 2023-11-04T01:48:30.451 INFO:teuthology.orchestra.run.smithi077.stdout:root 15 0.0 0.0 0 0 ? I 01:26 0:00 \_ [rcu_tasks_trace] 2023-11-04T01:48:30.451 INFO:teuthology.orchestra.run.smithi077.stdout:root 16 0.0 0.0 0 0 ? S 01:26 0:00 \_ [ksoftirqd/0] 2023-11-04T01:48:30.452 INFO:teuthology.orchestra.run.smithi077.stdout:root 17 0.3 0.0 0 0 ? S 01:26 0:05 \_ [pr/ttyS1] 2023-11-04T01:48:30.452 INFO:teuthology.orchestra.run.smithi077.stdout:root 18 0.0 0.0 0 0 ? I 01:26 0:00 \_ [rcu_preempt] 2023-11-04T01:48:30.452 INFO:teuthology.orchestra.run.smithi077.stdout:root 19 0.0 0.0 0 0 ? S 01:26 0:00 \_ [migration/0] 2023-11-04T01:48:30.452 INFO:teuthology.orchestra.run.smithi077.stdout:root 20 0.0 0.0 0 0 ? S 01:26 0:00 \_ [idle_inject/0] 2023-11-04T01:48:30.452 INFO:teuthology.orchestra.run.smithi077.stdout:root 21 0.0 0.0 0 0 ? S 01:26 0:00 \_ [cpuhp/0] 2023-11-04T01:48:30.453 INFO:teuthology.orchestra.run.smithi077.stdout:root 22 0.0 0.0 0 0 ? S 01:26 0:00 \_ [cpuhp/1] 2023-11-04T01:48:30.453 INFO:teuthology.orchestra.run.smithi077.stdout:root 23 0.0 0.0 0 0 ? S 01:26 0:00 \_ [idle_inject/1] 2023-11-04T01:48:30.453 INFO:teuthology.orchestra.run.smithi077.stdout:root 24 0.0 0.0 0 0 ? S 01:26 0:00 \_ [migration/1] 2023-11-04T01:48:30.453 INFO:teuthology.orchestra.run.smithi077.stdout:root 25 0.0 0.0 0 0 ? S 01:26 0:00 \_ [ksoftirqd/1] 2023-11-04T01:48:30.453 INFO:teuthology.orchestra.run.smithi077.stdout:root 27 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [kworker/1:0H-events_highpri] 2023-11-04T01:48:30.454 INFO:teuthology.orchestra.run.smithi077.stdout:root 28 0.0 0.0 0 0 ? S 01:26 0:00 \_ [cpuhp/2] 2023-11-04T01:48:30.454 INFO:teuthology.orchestra.run.smithi077.stdout:root 29 0.0 0.0 0 0 ? S 01:26 0:00 \_ [idle_inject/2] 2023-11-04T01:48:30.454 INFO:teuthology.orchestra.run.smithi077.stdout:root 30 0.0 0.0 0 0 ? S 01:26 0:00 \_ [migration/2] 2023-11-04T01:48:30.454 INFO:teuthology.orchestra.run.smithi077.stdout:root 31 0.0 0.0 0 0 ? S 01:26 0:00 \_ [ksoftirqd/2] 2023-11-04T01:48:30.454 INFO:teuthology.orchestra.run.smithi077.stdout:root 33 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [kworker/2:0H-events_highpri] 2023-11-04T01:48:30.455 INFO:teuthology.orchestra.run.smithi077.stdout:root 34 0.0 0.0 0 0 ? S 01:26 0:00 \_ [cpuhp/3] 2023-11-04T01:48:30.455 INFO:teuthology.orchestra.run.smithi077.stdout:root 35 0.0 0.0 0 0 ? S 01:26 0:00 \_ [idle_inject/3] 2023-11-04T01:48:30.455 INFO:teuthology.orchestra.run.smithi077.stdout:root 36 0.0 0.0 0 0 ? S 01:26 0:00 \_ [migration/3] 2023-11-04T01:48:30.455 INFO:teuthology.orchestra.run.smithi077.stdout:root 37 0.0 0.0 0 0 ? S 01:26 0:00 \_ [ksoftirqd/3] 2023-11-04T01:48:30.455 INFO:teuthology.orchestra.run.smithi077.stdout:root 39 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [kworker/3:0H-events_highpri] 2023-11-04T01:48:30.456 INFO:teuthology.orchestra.run.smithi077.stdout:root 40 0.0 0.0 0 0 ? S 01:26 0:00 \_ [cpuhp/4] 2023-11-04T01:48:30.456 INFO:teuthology.orchestra.run.smithi077.stdout:root 41 0.0 0.0 0 0 ? S 01:26 0:00 \_ [idle_inject/4] 2023-11-04T01:48:30.456 INFO:teuthology.orchestra.run.smithi077.stdout:root 42 0.0 0.0 0 0 ? S 01:26 0:00 \_ [migration/4] 2023-11-04T01:48:30.456 INFO:teuthology.orchestra.run.smithi077.stdout:root 43 0.0 0.0 0 0 ? S 01:26 0:00 \_ [ksoftirqd/4] 2023-11-04T01:48:30.456 INFO:teuthology.orchestra.run.smithi077.stdout:root 45 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [kworker/4:0H-events_highpri] 2023-11-04T01:48:30.456 INFO:teuthology.orchestra.run.smithi077.stdout:root 46 0.0 0.0 0 0 ? S 01:26 0:00 \_ [cpuhp/5] 2023-11-04T01:48:30.457 INFO:teuthology.orchestra.run.smithi077.stdout:root 47 0.0 0.0 0 0 ? S 01:26 0:00 \_ [idle_inject/5] 2023-11-04T01:48:30.457 INFO:teuthology.orchestra.run.smithi077.stdout:root 48 0.0 0.0 0 0 ? S 01:26 0:00 \_ [migration/5] 2023-11-04T01:48:30.457 INFO:teuthology.orchestra.run.smithi077.stdout:root 49 0.0 0.0 0 0 ? S 01:26 0:00 \_ [ksoftirqd/5] 2023-11-04T01:48:30.457 INFO:teuthology.orchestra.run.smithi077.stdout:root 51 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [kworker/5:0H-events_highpri] 2023-11-04T01:48:30.457 INFO:teuthology.orchestra.run.smithi077.stdout:root 52 0.0 0.0 0 0 ? S 01:26 0:00 \_ [cpuhp/6] 2023-11-04T01:48:30.458 INFO:teuthology.orchestra.run.smithi077.stdout:root 53 0.0 0.0 0 0 ? S 01:26 0:00 \_ [idle_inject/6] 2023-11-04T01:48:30.458 INFO:teuthology.orchestra.run.smithi077.stdout:root 54 0.0 0.0 0 0 ? S 01:26 0:00 \_ [migration/6] 2023-11-04T01:48:30.458 INFO:teuthology.orchestra.run.smithi077.stdout:root 55 0.0 0.0 0 0 ? S 01:26 0:00 \_ [ksoftirqd/6] 2023-11-04T01:48:30.458 INFO:teuthology.orchestra.run.smithi077.stdout:root 57 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [kworker/6:0H-events_highpri] 2023-11-04T01:48:30.458 INFO:teuthology.orchestra.run.smithi077.stdout:root 58 0.0 0.0 0 0 ? S 01:26 0:00 \_ [cpuhp/7] 2023-11-04T01:48:30.459 INFO:teuthology.orchestra.run.smithi077.stdout:root 59 0.0 0.0 0 0 ? S 01:26 0:00 \_ [idle_inject/7] 2023-11-04T01:48:30.459 INFO:teuthology.orchestra.run.smithi077.stdout:root 60 0.0 0.0 0 0 ? S 01:26 0:00 \_ [migration/7] 2023-11-04T01:48:30.459 INFO:teuthology.orchestra.run.smithi077.stdout:root 61 0.0 0.0 0 0 ? S 01:26 0:00 \_ [ksoftirqd/7] 2023-11-04T01:48:30.459 INFO:teuthology.orchestra.run.smithi077.stdout:root 63 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [kworker/7:0H-events_highpri] 2023-11-04T01:48:30.459 INFO:teuthology.orchestra.run.smithi077.stdout:root 68 0.0 0.0 0 0 ? I 01:26 0:00 \_ [kworker/u16:5-events_unbound] 2023-11-04T01:48:30.460 INFO:teuthology.orchestra.run.smithi077.stdout:root 71 0.0 0.0 0 0 ? S 01:26 0:00 \_ [kdevtmpfs] 2023-11-04T01:48:30.460 INFO:teuthology.orchestra.run.smithi077.stdout:root 72 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [inet_frag_wq] 2023-11-04T01:48:30.460 INFO:teuthology.orchestra.run.smithi077.stdout:root 73 0.0 0.0 0 0 ? S 01:26 0:00 \_ [kauditd] 2023-11-04T01:48:30.460 INFO:teuthology.orchestra.run.smithi077.stdout:root 75 0.0 0.0 0 0 ? S 01:26 0:00 \_ [khungtaskd] 2023-11-04T01:48:30.461 INFO:teuthology.orchestra.run.smithi077.stdout:root 76 0.0 0.0 0 0 ? S 01:26 0:00 \_ [oom_reaper] 2023-11-04T01:48:30.461 INFO:teuthology.orchestra.run.smithi077.stdout:root 77 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [writeback] 2023-11-04T01:48:30.461 INFO:teuthology.orchestra.run.smithi077.stdout:root 78 0.0 0.0 0 0 ? S 01:26 0:00 \_ [kcompactd0] 2023-11-04T01:48:30.461 INFO:teuthology.orchestra.run.smithi077.stdout:root 79 0.0 0.0 0 0 ? SN 01:26 0:00 \_ [ksmd] 2023-11-04T01:48:30.461 INFO:teuthology.orchestra.run.smithi077.stdout:root 80 0.0 0.0 0 0 ? SN 01:26 0:00 \_ [khugepaged] 2023-11-04T01:48:30.462 INFO:teuthology.orchestra.run.smithi077.stdout:root 81 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [cryptd] 2023-11-04T01:48:30.462 INFO:teuthology.orchestra.run.smithi077.stdout:root 82 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [kintegrityd] 2023-11-04T01:48:30.462 INFO:teuthology.orchestra.run.smithi077.stdout:root 83 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [kblockd] 2023-11-04T01:48:30.462 INFO:teuthology.orchestra.run.smithi077.stdout:root 84 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [blkcg_punt_bio] 2023-11-04T01:48:30.462 INFO:teuthology.orchestra.run.smithi077.stdout:root 86 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [tpm_dev_wq] 2023-11-04T01:48:30.462 INFO:teuthology.orchestra.run.smithi077.stdout:root 87 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [md] 2023-11-04T01:48:30.463 INFO:teuthology.orchestra.run.smithi077.stdout:root 88 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [md_bitmap] 2023-11-04T01:48:30.463 INFO:teuthology.orchestra.run.smithi077.stdout:root 89 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [edac-poller] 2023-11-04T01:48:30.463 INFO:teuthology.orchestra.run.smithi077.stdout:root 90 0.0 0.0 0 0 ? S 01:26 0:00 \_ [watchdogd] 2023-11-04T01:48:30.463 INFO:teuthology.orchestra.run.smithi077.stdout:root 92 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [kworker/4:1H-kblockd] 2023-11-04T01:48:30.463 INFO:teuthology.orchestra.run.smithi077.stdout:root 94 0.0 0.0 0 0 ? S 01:26 0:00 \_ [kswapd0] 2023-11-04T01:48:30.464 INFO:teuthology.orchestra.run.smithi077.stdout:root 101 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [kthrotld] 2023-11-04T01:48:30.464 INFO:teuthology.orchestra.run.smithi077.stdout:root 109 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [acpi_thermal_pm] 2023-11-04T01:48:30.464 INFO:teuthology.orchestra.run.smithi077.stdout:root 110 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [kmpath_rdacd] 2023-11-04T01:48:30.464 INFO:teuthology.orchestra.run.smithi077.stdout:root 111 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [kaluad] 2023-11-04T01:48:30.464 INFO:teuthology.orchestra.run.smithi077.stdout:root 112 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [mld] 2023-11-04T01:48:30.465 INFO:teuthology.orchestra.run.smithi077.stdout:root 113 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [kworker/3:1H-kblockd] 2023-11-04T01:48:30.465 INFO:teuthology.orchestra.run.smithi077.stdout:root 114 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [ipv6_addrconf] 2023-11-04T01:48:30.465 INFO:teuthology.orchestra.run.smithi077.stdout:root 123 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [kstrp] 2023-11-04T01:48:30.465 INFO:teuthology.orchestra.run.smithi077.stdout:root 128 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [zswap-shrink] 2023-11-04T01:48:30.465 INFO:teuthology.orchestra.run.smithi077.stdout:root 238 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [kworker/u17:0] 2023-11-04T01:48:30.466 INFO:teuthology.orchestra.run.smithi077.stdout:root 277 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [kworker/0:1H-xfs-log/dm-4] 2023-11-04T01:48:30.466 INFO:teuthology.orchestra.run.smithi077.stdout:root 288 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [kworker/1:1H-kblockd] 2023-11-04T01:48:30.466 INFO:teuthology.orchestra.run.smithi077.stdout:root 289 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [kworker/5:1H-kblockd] 2023-11-04T01:48:30.466 INFO:teuthology.orchestra.run.smithi077.stdout:root 356 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [kworker/6:1H-xfs-log/dm-4] 2023-11-04T01:48:30.466 INFO:teuthology.orchestra.run.smithi077.stdout:root 419 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [ata_sff] 2023-11-04T01:48:30.467 INFO:teuthology.orchestra.run.smithi077.stdout:root 432 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [ixgbe] 2023-11-04T01:48:30.467 INFO:teuthology.orchestra.run.smithi077.stdout:root 434 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [nvme-wq] 2023-11-04T01:48:30.467 INFO:teuthology.orchestra.run.smithi077.stdout:root 435 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [nvme-reset-wq] 2023-11-04T01:48:30.467 INFO:teuthology.orchestra.run.smithi077.stdout:root 436 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [nvme-delete-wq] 2023-11-04T01:48:30.467 INFO:teuthology.orchestra.run.smithi077.stdout:root 437 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [nvme-auth-wq] 2023-11-04T01:48:30.468 INFO:teuthology.orchestra.run.smithi077.stdout:root 439 0.0 0.0 0 0 ? S 01:26 0:00 \_ [scsi_eh_0] 2023-11-04T01:48:30.468 INFO:teuthology.orchestra.run.smithi077.stdout:root 440 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [scsi_tmf_0] 2023-11-04T01:48:30.468 INFO:teuthology.orchestra.run.smithi077.stdout:root 441 0.0 0.0 0 0 ? S 01:26 0:00 \_ [scsi_eh_1] 2023-11-04T01:48:30.468 INFO:teuthology.orchestra.run.smithi077.stdout:root 442 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [scsi_tmf_1] 2023-11-04T01:48:30.468 INFO:teuthology.orchestra.run.smithi077.stdout:root 443 0.0 0.0 0 0 ? S 01:26 0:00 \_ [scsi_eh_2] 2023-11-04T01:48:30.469 INFO:teuthology.orchestra.run.smithi077.stdout:root 444 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [scsi_tmf_2] 2023-11-04T01:48:30.469 INFO:teuthology.orchestra.run.smithi077.stdout:root 445 0.0 0.0 0 0 ? S 01:26 0:00 \_ [scsi_eh_3] 2023-11-04T01:48:30.469 INFO:teuthology.orchestra.run.smithi077.stdout:root 446 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [scsi_tmf_3] 2023-11-04T01:48:30.469 INFO:teuthology.orchestra.run.smithi077.stdout:root 450 0.0 0.0 0 0 ? S 01:26 0:00 \_ [scsi_eh_4] 2023-11-04T01:48:30.469 INFO:teuthology.orchestra.run.smithi077.stdout:root 451 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [scsi_tmf_4] 2023-11-04T01:48:30.469 INFO:teuthology.orchestra.run.smithi077.stdout:root 452 0.0 0.0 0 0 ? S 01:26 0:00 \_ [scsi_eh_5] 2023-11-04T01:48:30.470 INFO:teuthology.orchestra.run.smithi077.stdout:root 453 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [scsi_tmf_5] 2023-11-04T01:48:30.470 INFO:teuthology.orchestra.run.smithi077.stdout:root 454 0.0 0.0 0 0 ? S 01:26 0:00 \_ [scsi_eh_6] 2023-11-04T01:48:30.470 INFO:teuthology.orchestra.run.smithi077.stdout:root 455 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [scsi_tmf_6] 2023-11-04T01:48:30.470 INFO:teuthology.orchestra.run.smithi077.stdout:root 456 0.0 0.0 0 0 ? S 01:26 0:00 \_ [scsi_eh_7] 2023-11-04T01:48:30.471 INFO:teuthology.orchestra.run.smithi077.stdout:root 457 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [scsi_tmf_7] 2023-11-04T01:48:30.471 INFO:teuthology.orchestra.run.smithi077.stdout:root 458 0.0 0.0 0 0 ? S 01:26 0:00 \_ [scsi_eh_8] 2023-11-04T01:48:30.471 INFO:teuthology.orchestra.run.smithi077.stdout:root 459 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [scsi_tmf_8] 2023-11-04T01:48:30.471 INFO:teuthology.orchestra.run.smithi077.stdout:root 460 0.0 0.0 0 0 ? S 01:26 0:00 \_ [scsi_eh_9] 2023-11-04T01:48:30.471 INFO:teuthology.orchestra.run.smithi077.stdout:root 461 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [scsi_tmf_9] 2023-11-04T01:48:30.471 INFO:teuthology.orchestra.run.smithi077.stdout:root 474 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [kworker/2:1H-xfs-log/dm-4] 2023-11-04T01:48:30.472 INFO:teuthology.orchestra.run.smithi077.stdout:root 486 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [kworker/7:1H-xfs-log/dm-4] 2023-11-04T01:48:30.472 INFO:teuthology.orchestra.run.smithi077.stdout:root 490 0.0 0.0 0 0 ? S 01:26 0:00 \_ [jbd2/sda1-8] 2023-11-04T01:48:30.472 INFO:teuthology.orchestra.run.smithi077.stdout:root 491 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [ext4-rsv-conver] 2023-11-04T01:48:30.472 INFO:teuthology.orchestra.run.smithi077.stdout:root 573 0.0 0.0 0 0 ? S 01:26 0:00 \_ [ext4lazyinit] 2023-11-04T01:48:30.472 INFO:teuthology.orchestra.run.smithi077.stdout:root 632 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [ipmi-msghandler] 2023-11-04T01:48:30.473 INFO:teuthology.orchestra.run.smithi077.stdout:root 646 0.0 0.0 0 0 ? SN 01:26 0:00 \_ [kipmi0] 2023-11-04T01:48:30.473 INFO:teuthology.orchestra.run.smithi077.stdout:root 659 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [rpciod] 2023-11-04T01:48:30.473 INFO:teuthology.orchestra.run.smithi077.stdout:root 660 0.0 0.0 0 0 ? I< 01:26 0:00 \_ [xprtiod] 2023-11-04T01:48:30.473 INFO:teuthology.orchestra.run.smithi077.stdout:root 60998 0.0 0.0 0 0 ? I< 01:34 0:00 \_ [tls-strp] 2023-11-04T01:48:30.473 INFO:teuthology.orchestra.run.smithi077.stdout:root 62184 0.0 0.0 0 0 ? I 01:34 0:00 \_ [kworker/u16:2-flush-253:3] 2023-11-04T01:48:30.474 INFO:teuthology.orchestra.run.smithi077.stdout:root 100059 0.0 0.0 0 0 ? I 01:36 0:00 \_ [kworker/u16:3-events_unbound] 2023-11-04T01:48:30.474 INFO:teuthology.orchestra.run.smithi077.stdout:root 100750 0.0 0.0 0 0 ? I< 01:36 0:00 \_ [kdmflush/253:0] 2023-11-04T01:48:30.474 INFO:teuthology.orchestra.run.smithi077.stdout:root 100871 0.0 0.0 0 0 ? I< 01:36 0:00 \_ [kdmflush/253:1] 2023-11-04T01:48:30.474 INFO:teuthology.orchestra.run.smithi077.stdout:root 100991 0.0 0.0 0 0 ? I< 01:36 0:00 \_ [kdmflush/253:2] 2023-11-04T01:48:30.474 INFO:teuthology.orchestra.run.smithi077.stdout:root 101111 0.0 0.0 0 0 ? I< 01:36 0:00 \_ [kdmflush/253:3] 2023-11-04T01:48:30.475 INFO:teuthology.orchestra.run.smithi077.stdout:root 101231 0.0 0.0 0 0 ? I< 01:36 0:00 \_ [kdmflush/253:4] 2023-11-04T01:48:30.475 INFO:teuthology.orchestra.run.smithi077.stdout:root 102124 0.0 0.0 0 0 ? I< 01:36 0:00 \_ [xfsalloc] 2023-11-04T01:48:30.475 INFO:teuthology.orchestra.run.smithi077.stdout:root 102125 0.0 0.0 0 0 ? I< 01:36 0:00 \_ [xfs_mru_cache] 2023-11-04T01:48:30.475 INFO:teuthology.orchestra.run.smithi077.stdout:root 102126 0.0 0.0 0 0 ? I< 01:36 0:00 \_ [xfs-buf/dm-4] 2023-11-04T01:48:30.475 INFO:teuthology.orchestra.run.smithi077.stdout:root 102127 0.0 0.0 0 0 ? I< 01:36 0:00 \_ [xfs-conv/dm-4] 2023-11-04T01:48:30.476 INFO:teuthology.orchestra.run.smithi077.stdout:root 102128 0.0 0.0 0 0 ? I< 01:36 0:00 \_ [xfs-reclaim/dm-] 2023-11-04T01:48:30.476 INFO:teuthology.orchestra.run.smithi077.stdout:root 102129 0.0 0.0 0 0 ? I< 01:36 0:00 \_ [xfs-blockgc/dm-] 2023-11-04T01:48:30.476 INFO:teuthology.orchestra.run.smithi077.stdout:root 102130 0.0 0.0 0 0 ? I< 01:36 0:00 \_ [xfs-inodegc/dm-] 2023-11-04T01:48:30.476 INFO:teuthology.orchestra.run.smithi077.stdout:root 102131 0.0 0.0 0 0 ? I< 01:36 0:00 \_ [xfs-log/dm-4] 2023-11-04T01:48:30.476 INFO:teuthology.orchestra.run.smithi077.stdout:root 102132 0.0 0.0 0 0 ? I< 01:36 0:00 \_ [xfs-cil/dm-4] 2023-11-04T01:48:30.477 INFO:teuthology.orchestra.run.smithi077.stdout:root 102133 0.0 0.0 0 0 ? S 01:36 0:00 \_ [xfsaild/dm-4] 2023-11-04T01:48:30.477 INFO:teuthology.orchestra.run.smithi077.stdout:root 106754 0.0 0.0 0 0 ? I 01:38 0:00 \_ [kworker/5:37-mm_percpu_wq] 2023-11-04T01:48:30.477 INFO:teuthology.orchestra.run.smithi077.stdout:root 106859 0.0 0.0 0 0 ? I 01:38 0:00 \_ [kworker/5:136-rcu_gp] 2023-11-04T01:48:30.477 INFO:teuthology.orchestra.run.smithi077.stdout:root 107230 0.0 0.0 0 0 ? I 01:38 0:00 \_ [kworker/4:101-mm_percpu_wq] 2023-11-04T01:48:30.477 INFO:teuthology.orchestra.run.smithi077.stdout:root 107364 0.0 0.0 0 0 ? I 01:38 0:00 \_ [kworker/4:231-events] 2023-11-04T01:48:30.477 INFO:teuthology.orchestra.run.smithi077.stdout:root 112635 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-buf/dm-0] 2023-11-04T01:48:30.478 INFO:teuthology.orchestra.run.smithi077.stdout:root 112636 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-conv/dm-0] 2023-11-04T01:48:30.478 INFO:teuthology.orchestra.run.smithi077.stdout:root 112637 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-reclaim/dm-] 2023-11-04T01:48:30.478 INFO:teuthology.orchestra.run.smithi077.stdout:root 112638 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-blockgc/dm-] 2023-11-04T01:48:30.478 INFO:teuthology.orchestra.run.smithi077.stdout:root 112639 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-inodegc/dm-] 2023-11-04T01:48:30.478 INFO:teuthology.orchestra.run.smithi077.stdout:root 112640 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-log/dm-0] 2023-11-04T01:48:30.479 INFO:teuthology.orchestra.run.smithi077.stdout:root 112641 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-cil/dm-0] 2023-11-04T01:48:30.479 INFO:teuthology.orchestra.run.smithi077.stdout:root 112642 0.0 0.0 0 0 ? S 01:39 0:00 \_ [xfsaild/dm-0] 2023-11-04T01:48:30.479 INFO:teuthology.orchestra.run.smithi077.stdout:root 112719 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-buf/dm-1] 2023-11-04T01:48:30.479 INFO:teuthology.orchestra.run.smithi077.stdout:root 112720 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-conv/dm-1] 2023-11-04T01:48:30.480 INFO:teuthology.orchestra.run.smithi077.stdout:root 112721 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-reclaim/dm-] 2023-11-04T01:48:30.480 INFO:teuthology.orchestra.run.smithi077.stdout:root 112722 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-blockgc/dm-] 2023-11-04T01:48:30.480 INFO:teuthology.orchestra.run.smithi077.stdout:root 112723 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-inodegc/dm-] 2023-11-04T01:48:30.480 INFO:teuthology.orchestra.run.smithi077.stdout:root 112724 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-log/dm-1] 2023-11-04T01:48:30.480 INFO:teuthology.orchestra.run.smithi077.stdout:root 112725 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-cil/dm-1] 2023-11-04T01:48:30.480 INFO:teuthology.orchestra.run.smithi077.stdout:root 112726 0.0 0.0 0 0 ? S 01:39 0:00 \_ [xfsaild/dm-1] 2023-11-04T01:48:30.481 INFO:teuthology.orchestra.run.smithi077.stdout:root 112803 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-buf/dm-2] 2023-11-04T01:48:30.481 INFO:teuthology.orchestra.run.smithi077.stdout:root 112804 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-conv/dm-2] 2023-11-04T01:48:30.481 INFO:teuthology.orchestra.run.smithi077.stdout:root 112805 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-reclaim/dm-] 2023-11-04T01:48:30.481 INFO:teuthology.orchestra.run.smithi077.stdout:root 112806 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-blockgc/dm-] 2023-11-04T01:48:30.481 INFO:teuthology.orchestra.run.smithi077.stdout:root 112807 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-inodegc/dm-] 2023-11-04T01:48:30.482 INFO:teuthology.orchestra.run.smithi077.stdout:root 112808 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-log/dm-2] 2023-11-04T01:48:30.482 INFO:teuthology.orchestra.run.smithi077.stdout:root 112809 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-cil/dm-2] 2023-11-04T01:48:30.482 INFO:teuthology.orchestra.run.smithi077.stdout:root 112810 0.0 0.0 0 0 ? S 01:39 0:00 \_ [xfsaild/dm-2] 2023-11-04T01:48:30.482 INFO:teuthology.orchestra.run.smithi077.stdout:root 112887 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-buf/dm-3] 2023-11-04T01:48:30.482 INFO:teuthology.orchestra.run.smithi077.stdout:root 112888 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-conv/dm-3] 2023-11-04T01:48:30.483 INFO:teuthology.orchestra.run.smithi077.stdout:root 112889 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-reclaim/dm-] 2023-11-04T01:48:30.483 INFO:teuthology.orchestra.run.smithi077.stdout:root 112890 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-blockgc/dm-] 2023-11-04T01:48:30.483 INFO:teuthology.orchestra.run.smithi077.stdout:root 112891 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-inodegc/dm-] 2023-11-04T01:48:30.483 INFO:teuthology.orchestra.run.smithi077.stdout:root 112892 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-log/dm-3] 2023-11-04T01:48:30.483 INFO:teuthology.orchestra.run.smithi077.stdout:root 112893 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [xfs-cil/dm-3] 2023-11-04T01:48:30.484 INFO:teuthology.orchestra.run.smithi077.stdout:root 112894 0.0 0.0 0 0 ? S 01:39 0:00 \_ [xfsaild/dm-3] 2023-11-04T01:48:30.484 INFO:teuthology.orchestra.run.smithi077.stdout:root 112940 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [dio/dm-0] 2023-11-04T01:48:30.484 INFO:teuthology.orchestra.run.smithi077.stdout:root 114102 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [dio/dm-1] 2023-11-04T01:48:30.484 INFO:teuthology.orchestra.run.smithi077.stdout:root 115264 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [dio/dm-2] 2023-11-04T01:48:30.484 INFO:teuthology.orchestra.run.smithi077.stdout:root 116426 0.0 0.0 0 0 ? I< 01:39 0:00 \_ [dio/dm-3] 2023-11-04T01:48:30.485 INFO:teuthology.orchestra.run.smithi077.stdout:root 121939 0.0 0.0 0 0 ? I 01:39 0:00 \_ [kworker/3:9-mm_percpu_wq] 2023-11-04T01:48:30.485 INFO:teuthology.orchestra.run.smithi077.stdout:root 122005 0.0 0.0 0 0 ? I 01:39 0:00 \_ [kworker/7:5-mm_percpu_wq] 2023-11-04T01:48:30.485 INFO:teuthology.orchestra.run.smithi077.stdout:root 122132 0.0 0.0 0 0 ? I 01:39 0:00 \_ [kworker/6:37-mm_percpu_wq] 2023-11-04T01:48:30.485 INFO:teuthology.orchestra.run.smithi077.stdout:root 122380 0.0 0.0 0 0 ? I 01:39 0:00 \_ [kworker/6:217-cgroup_destroy] 2023-11-04T01:48:30.485 INFO:teuthology.orchestra.run.smithi077.stdout:root 122427 0.0 0.0 0 0 ? I 01:39 0:00 \_ [kworker/7:100-mm_percpu_wq] 2023-11-04T01:48:30.486 INFO:teuthology.orchestra.run.smithi077.stdout:root 122485 0.0 0.0 0 0 ? I 01:39 0:00 \_ [kworker/3:145-rcu_gp] 2023-11-04T01:48:30.486 INFO:teuthology.orchestra.run.smithi077.stdout:root 123001 0.0 0.0 0 0 ? I 01:39 0:00 \_ [kworker/0:180-mm_percpu_wq] 2023-11-04T01:48:30.486 INFO:teuthology.orchestra.run.smithi077.stdout:root 123025 0.0 0.0 0 0 ? I 01:39 0:00 \_ [kworker/2:108-events] 2023-11-04T01:48:30.486 INFO:teuthology.orchestra.run.smithi077.stdout:root 123268 0.0 0.0 0 0 ? I 01:39 0:00 \_ [kworker/2:163-mm_percpu_wq] 2023-11-04T01:48:30.486 INFO:teuthology.orchestra.run.smithi077.stdout:root 123737 0.0 0.0 0 0 ? I 01:39 0:00 \_ [kworker/0:378-rcu_gp] 2023-11-04T01:48:30.487 INFO:teuthology.orchestra.run.smithi077.stdout:root 123889 0.0 0.0 0 0 ? I 01:39 0:00 \_ [kworker/1:246-mm_percpu_wq] 2023-11-04T01:48:30.487 INFO:teuthology.orchestra.run.smithi077.stdout:root 123894 0.0 0.0 0 0 ? I 01:39 0:00 \_ [kworker/1:251-rcu_gp] 2023-11-04T01:48:30.487 INFO:teuthology.orchestra.run.smithi077.stdout:root 150403 0.0 0.0 0 0 ? I 01:44 0:00 \_ [kworker/u16:4-flush-253:0] 2023-11-04T01:48:30.487 INFO:teuthology.orchestra.run.smithi077.stdout:root 152088 0.0 0.0 0 0 ? I 01:45 0:00 \_ [kworker/3:0-mm_percpu_wq] 2023-11-04T01:48:30.487 INFO:teuthology.orchestra.run.smithi077.stdout:root 152089 0.0 0.0 0 0 ? I 01:45 0:00 \_ [kworker/1:0-events] 2023-11-04T01:48:30.488 INFO:teuthology.orchestra.run.smithi077.stdout:root 152471 0.0 0.0 0 0 ? I 01:46 0:00 \_ [kworker/0:0-events] 2023-11-04T01:48:30.488 INFO:teuthology.orchestra.run.smithi077.stdout:root 152472 0.0 0.0 0 0 ? I 01:46 0:00 \_ [kworker/7:0-mm_percpu_wq] 2023-11-04T01:48:30.488 INFO:teuthology.orchestra.run.smithi077.stdout:root 154268 0.0 0.0 0 0 ? I 01:46 0:00 \_ [kworker/0:1-events_long] 2023-11-04T01:48:30.488 INFO:teuthology.orchestra.run.smithi077.stdout:root 154269 0.0 0.0 0 0 ? I 01:46 0:00 \_ [kworker/0:2] 2023-11-04T01:48:30.488 INFO:teuthology.orchestra.run.smithi077.stdout:root 156438 0.0 0.0 0 0 ? I 01:47 0:00 \_ [kworker/5:0-mm_percpu_wq] 2023-11-04T01:48:30.489 INFO:teuthology.orchestra.run.smithi077.stdout:root 158546 0.0 0.0 0 0 ? I 01:48 0:00 \_ [kworker/1:1-events_long] 2023-11-04T01:48:30.489 INFO:teuthology.orchestra.run.smithi077.stdout:root 158547 0.0 0.0 0 0 ? I 01:48 0:00 \_ [kworker/1:2] 2023-11-04T01:48:30.489 INFO:teuthology.orchestra.run.smithi077.stdout:root 1 0.2 0.0 175984 20392 ? Ss 01:26 0:02 /usr/lib/systemd/systemd --switched-root --system --deserialize 31 2023-11-04T01:48:30.489 INFO:teuthology.orchestra.run.smithi077.stdout:root 567 0.0 0.0 26816 17204 ? Ss 01:26 0:01 /usr/lib/systemd/systemd-journald 2023-11-04T01:48:30.489 INFO:teuthology.orchestra.run.smithi077.stdout:root 583 0.0 0.0 37568 15804 ? Ss 01:26 0:00 /usr/lib/systemd/systemd-udevd 2023-11-04T01:48:30.490 INFO:teuthology.orchestra.run.smithi077.stdout:rpc 637 0.0 0.0 13244 5688 ? Ss 01:26 0:00 /usr/bin/rpcbind -w -f 2023-11-04T01:48:30.490 INFO:teuthology.orchestra.run.smithi077.stdout:root 663 0.0 0.0 91924 4644 ? S stdin-killer -- python3 -c ' 2023-11-04T01:48:30.502 DEBUG:teuthology.orchestra.run.smithi077:> import os 2023-11-04T01:48:30.502 DEBUG:teuthology.orchestra.run.smithi077:> path = "/sys/fs/fuse/connections/42/abort" 2023-11-04T01:48:30.503 DEBUG:teuthology.orchestra.run.smithi077:> if os.path.exists(path): 2023-11-04T01:48:30.503 DEBUG:teuthology.orchestra.run.smithi077:> open(path, "w").write("1") 2023-11-04T01:48:30.503 DEBUG:teuthology.orchestra.run.smithi077:> ' 2023-11-04T01:48:30.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:48:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:48:30.586 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2023-11-04T01:48:30.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:48:30.587 DEBUG:teuthology.orchestra.run.smithi077:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2023-11-04T01:48:30.655 INFO:teuthology.orchestra.run.smithi077.stderr:mkdir: cannot create directory ‘d1/dir/.snap/s33’: Software caused connection abort 2023-11-04T01:48:30.656 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:48:31.711 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~29s 2023-11-04T01:48:31.881 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:48:31.885 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:48:38.323 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~45s 2023-11-04T01:48:44.933 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~52s 2023-11-04T01:48:51.543 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~58s 2023-11-04T01:48:58.155 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~65s 2023-11-04T01:49:01.966 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:49:01.969 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:49:04.766 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~72s 2023-11-04T01:49:11.376 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~78s 2023-11-04T01:49:17.988 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~85s 2023-11-04T01:49:24.599 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~92s 2023-11-04T01:49:31.212 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~98s 2023-11-04T01:49:32.048 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:49:32.051 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:49:37.823 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~105s 2023-11-04T01:49:44.435 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~111s 2023-11-04T01:49:51.048 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~118s 2023-11-04T01:49:57.661 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~125s 2023-11-04T01:50:02.204 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:50:02.208 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:50:04.273 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~131s 2023-11-04T01:50:10.886 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~138s 2023-11-04T01:50:17.497 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~144s 2023-11-04T01:50:24.109 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~151s 2023-11-04T01:50:30.721 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~158s 2023-11-04T01:50:32.326 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:50:32.330 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:50:37.333 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~164s 2023-11-04T01:50:43.945 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~171s 2023-11-04T01:50:50.557 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~177s 2023-11-04T01:50:57.166 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~184s 2023-11-04T01:51:02.391 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:51:02.394 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:51:03.778 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~191s 2023-11-04T01:51:10.389 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~197s 2023-11-04T01:51:17.001 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~204s 2023-11-04T01:51:23.613 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~211s 2023-11-04T01:51:30.225 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~217s 2023-11-04T01:51:32.513 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:51:32.516 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:51:36.834 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~224s 2023-11-04T01:51:43.446 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~230s 2023-11-04T01:51:50.058 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~237s 2023-11-04T01:51:56.671 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~244s 2023-11-04T01:52:02.644 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:52:02.648 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:52:03.282 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~250s 2023-11-04T01:52:09.895 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~257s 2023-11-04T01:52:16.507 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~263s 2023-11-04T01:52:23.118 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~270s 2023-11-04T01:52:29.729 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~277s 2023-11-04T01:52:32.758 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:52:32.762 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:52:36.340 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~283s 2023-11-04T01:52:42.952 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~290s 2023-11-04T01:52:49.565 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~296s 2023-11-04T01:52:56.177 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~303s 2023-11-04T01:52:56.178 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-11-04T01:52:56.178 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:52:56.178 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:52:56.198 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19534 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:52:56.198 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi077.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-11-04T01:52:56.199 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2023-11-04T01:52:56.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:52:56.199 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:52:56.256 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:52:56.256 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:52:56.313 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19534 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:52:56.314 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.2 is not mounted at ubuntu@smithi077.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.2 2023-11-04T01:52:56.314 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2023-11-04T01:52:56.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:52:56.314 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:52:56.370 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:52:56.370 INFO:teuthology.orchestra.run.smithi077.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-04T01:52:56.371 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:52:56.371 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:52:56.390 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056339,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13650 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:52:56.390 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.1 is not mounted at ubuntu@smithi122.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1 2023-11-04T01:52:56.390 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi122.front.sepia.ceph.com 2023-11-04T01:52:56.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:52:56.391 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:52:56.446 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:52:56.447 INFO:teuthology.orchestra.run.smithi122.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-04T01:52:56.447 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:52:56.448 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:52:56.504 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056339,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13650 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:52:56.505 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.3 is not mounted at ubuntu@smithi122.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.3 2023-11-04T01:52:56.505 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi122.front.sepia.ceph.com 2023-11-04T01:52:56.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:52:56.505 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:52:56.561 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:52:56.561 INFO:teuthology.orchestra.run.smithi122.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-04T01:52:58.171 INFO:tasks.ceph.osd.0:Sent signal 15 2023-11-04T01:52:58.172 INFO:tasks.ceph.osd.1:Sent signal 15 2023-11-04T01:52:58.172 INFO:tasks.ceph.osd.2:Sent signal 15 2023-11-04T01:52:58.172 INFO:tasks.ceph.osd.3:Sent signal 15 2023-11-04T01:52:58.173 INFO:tasks.ceph.osd.4:Sent signal 15 2023-11-04T01:52:58.173 INFO:tasks.ceph.osd.5:Sent signal 15 2023-11-04T01:52:58.174 INFO:tasks.ceph.osd.6:Sent signal 15 2023-11-04T01:52:58.174 INFO:tasks.ceph.osd.7:Sent signal 15 2023-11-04T01:52:58.174 INFO:tasks.ceph.mds.a:Sent signal 15 2023-11-04T01:52:58.175 INFO:tasks.ceph.mds.b:Sent signal 15 2023-11-04T01:52:58.175 INFO:tasks.ceph.mds.d:Sent signal 15 2023-11-04T01:52:58.176 INFO:tasks.ceph.mon.a:Sent signal 15 2023-11-04T01:52:58.176 INFO:tasks.ceph.mon.b:Sent signal 15 2023-11-04T01:52:58.176 INFO:tasks.ceph.mon.c:Sent signal 15 2023-11-04T01:52:58.177 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-11-04T01:52:58.177 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-11-04T01:52:58.178 INFO:tasks.ceph.osd.4.smithi122.stderr:2023-11-04T01:52:58.173+0000 7f3e942a4640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 88547) UID: 0 2023-11-04T01:52:58.178 INFO:tasks.ceph.osd.4.smithi122.stderr:2023-11-04T01:52:58.173+0000 7f3e942a4640 -1 osd.4 117 *** Got signal Terminated *** 2023-11-04T01:52:58.179 INFO:tasks.ceph.osd.4.smithi122.stderr:2023-11-04T01:52:58.173+0000 7f3e942a4640 -1 osd.4 117 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:52:58.179 INFO:tasks.ceph.osd.5.smithi122.stderr:2023-11-04T01:52:58.173+0000 7f5b38c52640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 88549) UID: 0 2023-11-04T01:52:58.179 INFO:tasks.ceph.osd.5.smithi122.stderr:2023-11-04T01:52:58.173+0000 7f5b38c52640 -1 osd.5 117 *** Got signal Terminated *** 2023-11-04T01:52:58.179 INFO:tasks.ceph.osd.5.smithi122.stderr:2023-11-04T01:52:58.173+0000 7f5b38c52640 -1 osd.5 117 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:52:58.180 INFO:tasks.ceph.osd.6.smithi122.stderr:2023-11-04T01:52:58.174+0000 7f17cf85b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 88552) UID: 0 2023-11-04T01:52:58.180 INFO:tasks.ceph.osd.6.smithi122.stderr:2023-11-04T01:52:58.174+0000 7f17cf85b640 -1 osd.6 117 *** Got signal Terminated *** 2023-11-04T01:52:58.180 INFO:tasks.ceph.osd.6.smithi122.stderr:2023-11-04T01:52:58.174+0000 7f17cf85b640 -1 osd.6 117 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:52:58.180 INFO:tasks.ceph.osd.7.smithi122.stderr:2023-11-04T01:52:58.174+0000 7f0f02302640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 88554) UID: 0 2023-11-04T01:52:58.181 INFO:tasks.ceph.osd.7.smithi122.stderr:2023-11-04T01:52:58.174+0000 7f0f02302640 -1 osd.7 117 *** Got signal Terminated *** 2023-11-04T01:52:58.181 INFO:tasks.ceph.osd.7.smithi122.stderr:2023-11-04T01:52:58.174+0000 7f0f02302640 -1 osd.7 117 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:52:58.181 INFO:tasks.ceph.mds.b.smithi122.stderr:2023-11-04T01:52:58.175+0000 7faa04ed8640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 96745) UID: 0 2023-11-04T01:52:58.182 INFO:tasks.ceph.mds.b.smithi122.stderr:2023-11-04T01:52:58.175+0000 7faa04ed8640 -1 mds.b *** got signal Terminated *** 2023-11-04T01:52:58.182 INFO:tasks.ceph.mds.d.smithi122.stderr:2023-11-04T01:52:58.175+0000 7fd076a6c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 96049) UID: 0 2023-11-04T01:52:58.182 INFO:tasks.ceph.mds.d.smithi122.stderr:2023-11-04T01:52:58.175+0000 7fd076a6c640 -1 mds.d *** got signal Terminated *** 2023-11-04T01:52:58.183 INFO:tasks.ceph.mon.b.smithi122.stderr:2023-11-04T01:52:58.176+0000 7fb5a69e7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 87978) UID: 0 2023-11-04T01:52:58.183 INFO:tasks.ceph.mon.b.smithi122.stderr:2023-11-04T01:52:58.176+0000 7fb5a69e7640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-11-04T01:52:58.183 INFO:tasks.ceph.mon.c.smithi122.stderr:2023-11-04T01:52:58.176+0000 7f1ca3423640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 87981) UID: 0 2023-11-04T01:52:58.184 INFO:tasks.ceph.mon.c.smithi122.stderr:2023-11-04T01:52:58.176+0000 7f1ca3423640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-11-04T01:52:58.184 INFO:tasks.ceph.osd.0.smithi077.stderr:2023-11-04T01:52:58.171+0000 7f0147292640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 118508) UID: 0 2023-11-04T01:52:58.184 INFO:tasks.ceph.osd.0.smithi077.stderr:2023-11-04T01:52:58.171+0000 7f0147292640 -1 osd.0 117 *** Got signal Terminated *** 2023-11-04T01:52:58.185 INFO:tasks.ceph.osd.0.smithi077.stderr:2023-11-04T01:52:58.171+0000 7f0147292640 -1 osd.0 117 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:52:58.185 INFO:tasks.ceph.osd.1.smithi077.stderr:2023-11-04T01:52:58.171+0000 7fec54e71640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 118514) UID: 0 2023-11-04T01:52:58.185 INFO:tasks.ceph.osd.1.smithi077.stderr:2023-11-04T01:52:58.171+0000 7fec54e71640 -1 osd.1 117 *** Got signal Terminated *** 2023-11-04T01:52:58.186 INFO:tasks.ceph.osd.1.smithi077.stderr:2023-11-04T01:52:58.171+0000 7fec54e71640 -1 osd.1 117 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:52:58.186 INFO:tasks.ceph.osd.2.smithi077.stderr:2023-11-04T01:52:58.171+0000 7fa7c6f32640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 118515) UID: 0 2023-11-04T01:52:58.186 INFO:tasks.ceph.osd.2.smithi077.stderr:2023-11-04T01:52:58.171+0000 7fa7c6f32640 -1 osd.2 117 *** Got signal Terminated *** 2023-11-04T01:52:58.187 INFO:tasks.ceph.osd.2.smithi077.stderr:2023-11-04T01:52:58.171+0000 7fa7c6f32640 -1 osd.2 117 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:52:58.187 INFO:tasks.ceph.osd.3.smithi077.stderr:2023-11-04T01:52:58.172+0000 7fa50a376640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 118525) UID: 0 2023-11-04T01:52:58.187 INFO:tasks.ceph.osd.3.smithi077.stderr:2023-11-04T01:52:58.172+0000 7fa50a376640 -1 osd.3 117 *** Got signal Terminated *** 2023-11-04T01:52:58.187 INFO:tasks.ceph.osd.3.smithi077.stderr:2023-11-04T01:52:58.172+0000 7fa50a376640 -1 osd.3 117 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:52:58.188 INFO:tasks.ceph.mds.a.smithi077.stderr:2023-11-04T01:52:58.174+0000 7f7f05de5640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 156816) UID: 0 2023-11-04T01:52:58.188 INFO:tasks.ceph.mds.a.smithi077.stderr:2023-11-04T01:52:58.174+0000 7f7f05de5640 -1 mds.a *** got signal Terminated *** 2023-11-04T01:52:58.188 INFO:tasks.ceph.mon.a.smithi077.stderr:2023-11-04T01:52:58.175+0000 7f121cf42640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 118243) UID: 0 2023-11-04T01:52:58.189 INFO:tasks.ceph.mon.a.smithi077.stderr:2023-11-04T01:52:58.175+0000 7f121cf42640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-11-04T01:52:58.378 INFO:tasks.ceph.mgr.y.smithi077.stderr:daemon-helper: command crashed with signal 15 2023-11-04T01:53:02.864 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:53:02.868 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:53:11.186 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:2023-11-04T01:53:11 stdin-killer ERROR: timeout expired: sending signal 9 to command and myself 2023-11-04T01:53:11.190 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:bash: line 1: 157806 Killed ( cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 ) 2023-11-04T01:53:11.319 DEBUG:teuthology.orchestra.run:got remote process result: 137 2023-11-04T01:53:11.320 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2023-11-04T01:53:11.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:53:11.321 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:53:11.339 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:53:11.339 INFO:teuthology.orchestra.run.smithi077.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-11-04T01:53:11.340 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:53:11.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:11.488+0000 7ff83f6d7640 1 Processor -- start 2023-11-04T01:53:11.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:11.488+0000 7ff83f6d7640 1 -- start start 2023-11-04T01:53:11.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:11.489+0000 7ff83f6d7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff8380b0c40 0x7ff83806fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:11.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:11.489+0000 7ff83f6d7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff838071500 con 0x7ff838159e40 2023-11-04T01:53:11.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:11.489+0000 7ff83f6d7640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83815dae0 con 0x7ff83806bb60 2023-11-04T01:53:11.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:11.489+0000 7ff83f6d7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff8380b0c40 2023-11-04T01:53:11.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:11.489+0000 7ff83cc72640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff8380b0c40 msgr2=0x7ff83806fff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:53:11.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:11.489+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff838159e40 legacy=0x7ff8380b0530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:53:11.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:11.489+0000 7ff83cc72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff8380b0c40 0x7ff83806fff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:11.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:11.489+0000 7ff83dc74640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff83806bb60 legacy=0x7ff8380cd790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:53:11.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:11.690+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff838159e40 legacy=0x7ff8380b0530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:53:11.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:11.690+0000 7ff83cc72640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff8380b0c40 msgr2=0x7ff83806fff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:53:11.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:11.690+0000 7ff83cc72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff8380b0c40 0x7ff83806fff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:11.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:11.690+0000 7ff83dc74640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff83806bb60 legacy=0x7ff8380cd790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:53:12.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:12.091+0000 7ff83cc72640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff8380b0c40 msgr2=0x7ff83806fff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:53:12.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:12.091+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff838159e40 legacy=0x7ff8380b0530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:53:12.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:12.091+0000 7ff83cc72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff8380b0c40 0x7ff83806fff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:12.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:12.091+0000 7ff83dc74640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff83806bb60 legacy=0x7ff8380cd790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:53:12.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:12.892+0000 7ff83cc72640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff8380b0c40 msgr2=0x7ff83806fff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:53:12.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:12.892+0000 7ff83cc72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff8380b0c40 0x7ff83806fff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:12.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:12.892+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff838159e40 legacy=0x7ff8380b0530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:53:12.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:12.892+0000 7ff83dc74640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff83806bb60 legacy=0x7ff8380cd790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:53:14.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:14.489+0000 7ff82effd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff8380b0c40 msgr2=0x7ff83806fff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:14.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:14.489+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff8380b0c40 0x7ff83806fff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:14.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:14.489+0000 7ff82effd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff83806bb60 legacy=0x7ff8380cd790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:14.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:14.489+0000 7ff82effd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff838159e40 legacy=0x7ff8380b0530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:14.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:14.489+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c0036a0 0x7ff81c005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:14.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:14.489+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c006110 0x7ff81c0085d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:14.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:14.489+0000 7ff82effd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff81c0036a0 2023-11-04T01:53:14.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:14.489+0000 7ff82effd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff81c008cb0 con 0x7ff81c006110 2023-11-04T01:53:14.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:14.489+0000 7ff83cc72640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c006110 msgr2=0x7ff81c0085d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:53:14.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:14.489+0000 7ff83d473640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c0036a0 msgr2=0x7ff81c005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:53:14.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:14.489+0000 7ff83cc72640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c006110 0x7ff81c0085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:14.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:14.489+0000 7ff83d473640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c0036a0 0x7ff81c005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:14.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:14.690+0000 7ff83d473640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c0036a0 msgr2=0x7ff81c005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:53:14.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:14.690+0000 7ff83cc72640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c006110 msgr2=0x7ff81c0085d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:53:14.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:14.690+0000 7ff83d473640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c0036a0 0x7ff81c005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:14.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:14.690+0000 7ff83cc72640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c006110 0x7ff81c0085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:15.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:15.091+0000 7ff83d473640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c0036a0 msgr2=0x7ff81c005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:53:15.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:15.091+0000 7ff83cc72640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c006110 msgr2=0x7ff81c0085d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:53:15.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:15.091+0000 7ff83d473640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c0036a0 0x7ff81c005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:15.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:15.091+0000 7ff83cc72640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c006110 0x7ff81c0085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:15.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:15.892+0000 7ff83d473640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c0036a0 msgr2=0x7ff81c005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:53:15.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:15.892+0000 7ff83cc72640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c006110 msgr2=0x7ff81c0085d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:53:15.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:15.892+0000 7ff83d473640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c0036a0 0x7ff81c005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:15.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:15.892+0000 7ff83cc72640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c006110 0x7ff81c0085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:17.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:17.489+0000 7ff82effd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c006110 msgr2=0x7ff81c0085d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:17.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:17.489+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c006110 0x7ff81c0085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:17.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:17.489+0000 7ff82effd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c0036a0 msgr2=0x7ff81c005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:17.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:17.489+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c0036a0 0x7ff81c005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:17.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:17.489+0000 7ff83dc74640 1 -- reap_dead start 2023-11-04T01:53:17.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:17.489+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff8380b0c40 0x7ff81c00afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:17.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:17.489+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0051a0 0x7ff81c005620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:17.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:17.489+0000 7ff82effd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff838070f40 con 0x7ff81c0065c0 2023-11-04T01:53:17.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:17.489+0000 7ff82effd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff8380b0c40 2023-11-04T01:53:17.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:17.489+0000 7ff82effd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff81c008cb0 con 0x7ff81c0051a0 2023-11-04T01:53:17.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:17.489+0000 7ff83d473640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff8380b0c40 msgr2=0x7ff81c00afc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:53:17.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:17.489+0000 7ff83d473640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff8380b0c40 0x7ff81c00afc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:17.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:17.489+0000 7ff83cc72640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c0065c0 legacy=0x7ff81c003a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:53:17.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:17.489+0000 7ff83dc74640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0051a0 msgr2=0x7ff81c005620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:53:17.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:17.489+0000 7ff83dc74640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0051a0 0x7ff81c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:17.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:17.690+0000 7ff83cc72640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c0065c0 legacy=0x7ff81c003a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:53:17.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:17.690+0000 7ff83d473640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff8380b0c40 msgr2=0x7ff81c00afc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:53:17.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:17.690+0000 7ff83d473640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff8380b0c40 0x7ff81c00afc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:17.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:17.690+0000 7ff83dc74640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0051a0 msgr2=0x7ff81c005620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:53:17.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:17.690+0000 7ff83dc74640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0051a0 0x7ff81c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:18.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:18.091+0000 7ff83d473640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff8380b0c40 msgr2=0x7ff81c00afc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:53:18.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:18.091+0000 7ff83cc72640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c0065c0 legacy=0x7ff81c003a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:53:18.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:18.091+0000 7ff83d473640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff8380b0c40 0x7ff81c00afc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:18.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:18.091+0000 7ff83dc74640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0051a0 msgr2=0x7ff81c005620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:53:18.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:18.091+0000 7ff83dc74640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0051a0 0x7ff81c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:18.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:18.892+0000 7ff83cc72640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c0065c0 legacy=0x7ff81c003a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:53:18.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:18.892+0000 7ff83d473640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff8380b0c40 msgr2=0x7ff81c00afc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:53:18.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:18.892+0000 7ff83d473640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff8380b0c40 0x7ff81c00afc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:18.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:18.892+0000 7ff83dc74640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0051a0 msgr2=0x7ff81c005620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:53:18.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:18.892+0000 7ff83dc74640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0051a0 0x7ff81c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:20.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:20.490+0000 7ff82effd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0051a0 msgr2=0x7ff81c005620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:20.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:20.490+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0051a0 0x7ff81c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:20.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:20.490+0000 7ff82effd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff8380b0c40 msgr2=0x7ff81c00afc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:20.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:20.490+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff8380b0c40 0x7ff81c00afc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:20.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:20.490+0000 7ff82effd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c0065c0 legacy=0x7ff81c003a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:20.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:20.490+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c013230 0x7ff81c015620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:20.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:20.490+0000 7ff82effd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff838071500 con 0x7ff81c00f720 2023-11-04T01:53:20.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:20.490+0000 7ff82effd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff81c013230 2023-11-04T01:53:20.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:20.490+0000 7ff83d473640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c00f720 legacy=0x7ff81c011b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:53:20.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:20.490+0000 7ff83cc72640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c013230 msgr2=0x7ff81c015620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:53:20.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:20.490+0000 7ff83cc72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c013230 0x7ff81c015620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:20.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:20.691+0000 7ff83d473640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c00f720 legacy=0x7ff81c011b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:53:20.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:20.691+0000 7ff83cc72640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c013230 msgr2=0x7ff81c015620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:53:20.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:20.691+0000 7ff83cc72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c013230 0x7ff81c015620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:21.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:21.092+0000 7ff83d473640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c00f720 legacy=0x7ff81c011b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:53:21.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:21.092+0000 7ff83cc72640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c013230 msgr2=0x7ff81c015620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:53:21.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:21.092+0000 7ff83cc72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c013230 0x7ff81c015620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:21.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:21.893+0000 7ff83cc72640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c013230 msgr2=0x7ff81c015620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:53:21.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:21.893+0000 7ff83d473640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c00f720 legacy=0x7ff81c011b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:53:21.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:21.893+0000 7ff83cc72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c013230 0x7ff81c015620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:23.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:23.490+0000 7ff82effd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c013230 msgr2=0x7ff81c015620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:23.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:23.490+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c013230 0x7ff81c015620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:23.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:23.490+0000 7ff82effd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c00f720 legacy=0x7ff81c011b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:23.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:23.490+0000 7ff83dc74640 1 -- reap_dead start 2023-11-04T01:53:23.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:23.490+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016810 0x7ff81c005620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:23.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:23.490+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003a80 0x7ff81c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:23.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:23.490+0000 7ff82effd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff838070f40 con 0x7ff81c015c80 2023-11-04T01:53:23.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:23.490+0000 7ff82effd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff81c003a80 2023-11-04T01:53:23.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:23.490+0000 7ff82effd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff81c008cb0 con 0x7ff81c016810 2023-11-04T01:53:23.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:23.490+0000 7ff83dc74640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003a80 msgr2=0x7ff81c003ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:53:23.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:23.490+0000 7ff83dc74640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003a80 0x7ff81c003ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:23.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:23.490+0000 7ff83cc72640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016810 msgr2=0x7ff81c005620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:53:23.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:23.490+0000 7ff83d473640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c015c80 legacy=0x7ff81c016060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:53:23.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:23.490+0000 7ff83cc72640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016810 0x7ff81c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:23.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:23.691+0000 7ff83dc74640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003a80 msgr2=0x7ff81c003ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:53:23.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:23.691+0000 7ff83dc74640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003a80 0x7ff81c003ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:23.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:23.691+0000 7ff83cc72640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016810 msgr2=0x7ff81c005620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:53:23.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:23.691+0000 7ff83d473640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c015c80 legacy=0x7ff81c016060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:53:23.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:23.691+0000 7ff83cc72640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016810 0x7ff81c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:24.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:24.092+0000 7ff83dc74640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003a80 msgr2=0x7ff81c003ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:53:24.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:24.092+0000 7ff83dc74640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003a80 0x7ff81c003ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:24.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:24.092+0000 7ff83d473640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c015c80 legacy=0x7ff81c016060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:53:24.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:24.092+0000 7ff83cc72640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016810 msgr2=0x7ff81c005620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:53:24.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:24.092+0000 7ff83cc72640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016810 0x7ff81c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:24.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:24.893+0000 7ff83dc74640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003a80 msgr2=0x7ff81c003ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:53:24.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:24.893+0000 7ff83dc74640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003a80 0x7ff81c003ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:24.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:24.893+0000 7ff83cc72640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016810 msgr2=0x7ff81c005620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:53:24.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:24.893+0000 7ff83d473640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c015c80 legacy=0x7ff81c016060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:53:24.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:24.893+0000 7ff83cc72640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016810 0x7ff81c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:26.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:26.491+0000 7ff82effd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016810 msgr2=0x7ff81c005620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:26.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:26.491+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016810 0x7ff81c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:26.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:26.491+0000 7ff82effd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003a80 msgr2=0x7ff81c003ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:26.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:26.491+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003a80 0x7ff81c003ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:26.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:26.491+0000 7ff82effd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c015c80 legacy=0x7ff81c016060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:26.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:26.491+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c015640 0x7ff81c009fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:26.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:26.491+0000 7ff82effd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff838071500 con 0x7ff81c004410 2023-11-04T01:53:26.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:26.491+0000 7ff82effd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff81c015640 2023-11-04T01:53:26.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:26.491+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c004410 legacy=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:53:26.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:26.491+0000 7ff83cc72640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c015640 msgr2=0x7ff81c009fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:53:26.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:26.491+0000 7ff83cc72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c015640 0x7ff81c009fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:26.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:26.692+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c004410 legacy=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:53:26.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:26.692+0000 7ff83cc72640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c015640 msgr2=0x7ff81c009fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:53:26.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:26.692+0000 7ff83cc72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c015640 0x7ff81c009fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:27.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:27.093+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c004410 legacy=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:53:27.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:27.093+0000 7ff83cc72640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c015640 msgr2=0x7ff81c009fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:53:27.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:27.093+0000 7ff83cc72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c015640 0x7ff81c009fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:27.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:27.894+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c004410 legacy=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:53:27.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:27.894+0000 7ff83cc72640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c015640 msgr2=0x7ff81c009fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:53:27.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:27.894+0000 7ff83cc72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c015640 0x7ff81c009fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:29.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:29.491+0000 7ff82effd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c015640 msgr2=0x7ff81c009fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:29.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:29.491+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c015640 0x7ff81c009fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:29.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:29.491+0000 7ff82effd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c004410 legacy=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:29.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:29.491+0000 7ff83dc74640 1 -- reap_dead start 2023-11-04T01:53:29.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:29.491+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c015640 0x7ff81c004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:29.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:29.491+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c003a80 0x7ff81c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:29.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:29.491+0000 7ff82effd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff838070f40 con 0x7ff81c00a500 2023-11-04T01:53:29.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:29.491+0000 7ff82effd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff81c015640 2023-11-04T01:53:29.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:29.491+0000 7ff82effd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff81c008cb0 con 0x7ff81c003a80 2023-11-04T01:53:29.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:29.491+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c00a500 legacy=0x7ff81c00a8e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:53:29.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:29.491+0000 7ff83cc72640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c015640 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:53:29.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:29.491+0000 7ff83cc72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c015640 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:29.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:29.491+0000 7ff83dc74640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c003a80 msgr2=0x7ff81c003ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:53:29.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:29.491+0000 7ff83dc74640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c003a80 0x7ff81c003ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:29.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:29.692+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c00a500 legacy=0x7ff81c00a8e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:53:29.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:29.692+0000 7ff83dc74640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c003a80 msgr2=0x7ff81c003ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:53:29.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:29.692+0000 7ff83cc72640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c015640 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:53:29.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:29.692+0000 7ff83dc74640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c003a80 0x7ff81c003ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:29.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:29.692+0000 7ff83cc72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c015640 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:30.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:30.093+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c00a500 legacy=0x7ff81c00a8e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:53:30.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:30.093+0000 7ff83dc74640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c003a80 msgr2=0x7ff81c003ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:53:30.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:30.093+0000 7ff83dc74640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c003a80 0x7ff81c003ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:30.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:30.093+0000 7ff83cc72640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c015640 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:53:30.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:30.093+0000 7ff83cc72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c015640 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:30.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:30.894+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c00a500 legacy=0x7ff81c00a8e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:53:30.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:30.894+0000 7ff83dc74640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c003a80 msgr2=0x7ff81c003ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:53:30.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:30.894+0000 7ff83cc72640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c015640 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:53:30.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:30.894+0000 7ff83dc74640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c003a80 0x7ff81c003ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:30.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:30.894+0000 7ff83cc72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c015640 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:32.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:32.491+0000 7ff82effd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c003a80 msgr2=0x7ff81c003ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:32.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:32.491+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c003a80 0x7ff81c003ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:32.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:32.491+0000 7ff82effd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c015640 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:32.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:32.491+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c015640 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:32.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:32.491+0000 7ff82effd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c00a500 legacy=0x7ff81c00a8e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:32.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:32.491+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c016810 0x7ff81c0055e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:32.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:32.491+0000 7ff82effd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff838071500 con 0x7ff81c00aff0 2023-11-04T01:53:32.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:32.491+0000 7ff82effd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff81c016810 2023-11-04T01:53:32.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:32.491+0000 7ff83d473640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c016810 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:53:32.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:32.491+0000 7ff83d473640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c016810 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:32.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:32.491+0000 7ff83cc72640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c00aff0 legacy=0x7ff81c012b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:53:32.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:32.692+0000 7ff83d473640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c016810 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:53:32.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:32.692+0000 7ff83d473640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c016810 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:32.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:32.692+0000 7ff83cc72640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c00aff0 legacy=0x7ff81c012b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:53:33.088 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:53:33.091 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:53:33.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:33.093+0000 7ff83d473640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c016810 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:53:33.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:33.093+0000 7ff83d473640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c016810 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:33.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:33.093+0000 7ff83cc72640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c00aff0 legacy=0x7ff81c012b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:53:33.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:33.894+0000 7ff83d473640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c016810 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:53:33.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:33.894+0000 7ff83d473640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c016810 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:33.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:33.894+0000 7ff83cc72640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c00aff0 legacy=0x7ff81c012b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:53:35.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:35.491+0000 7ff82effd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c016810 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:35.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:35.491+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c016810 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:35.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:35.491+0000 7ff82effd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c00aff0 legacy=0x7ff81c012b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:35.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:35.491+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c015640 0x7ff81c004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:35.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:35.491+0000 7ff83dc74640 1 -- reap_dead start 2023-11-04T01:53:35.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:35.491+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003a80 0x7ff81c0055e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:35.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:35.491+0000 7ff82effd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff838070f40 con 0x7ff81c003e80 2023-11-04T01:53:35.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:35.491+0000 7ff82effd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff81c003a80 2023-11-04T01:53:35.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:35.491+0000 7ff82effd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff81c008cb0 con 0x7ff81c015640 2023-11-04T01:53:35.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:35.491+0000 7ff83cc72640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003a80 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:53:35.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:35.491+0000 7ff83cc72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003a80 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:35.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:35.491+0000 7ff83d473640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c015640 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:53:35.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:35.491+0000 7ff83d473640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c015640 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:35.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:35.491+0000 7ff83dc74640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c003e80 legacy=0x7ff81c015c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:53:35.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:35.692+0000 7ff83cc72640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003a80 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:53:35.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:35.692+0000 7ff83cc72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003a80 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:35.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:35.692+0000 7ff83d473640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c015640 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:53:35.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:35.692+0000 7ff83dc74640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c003e80 legacy=0x7ff81c015c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:53:35.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:35.692+0000 7ff83d473640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c015640 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:36.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:36.093+0000 7ff83cc72640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003a80 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:53:36.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:36.093+0000 7ff83cc72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003a80 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:36.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:36.093+0000 7ff83d473640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c015640 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:53:36.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:36.093+0000 7ff83dc74640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c003e80 legacy=0x7ff81c015c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:53:36.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:36.093+0000 7ff83d473640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c015640 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:36.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:36.894+0000 7ff83cc72640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003a80 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:53:36.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:36.894+0000 7ff83cc72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003a80 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:36.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:36.894+0000 7ff83d473640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c015640 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:53:36.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:36.894+0000 7ff83dc74640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c003e80 legacy=0x7ff81c015c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:53:36.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:36.894+0000 7ff83d473640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c015640 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:38.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:38.491+0000 7ff82effd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c015640 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:38.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:38.491+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c015640 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:38.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:38.491+0000 7ff82effd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003a80 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:38.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:38.491+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003a80 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:38.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:38.491+0000 7ff82effd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c003e80 legacy=0x7ff81c015c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:38.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:38.491+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c012b20 0x7ff81c016330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:38.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:38.491+0000 7ff82effd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff838071500 con 0x7ff81c008f90 2023-11-04T01:53:38.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:38.491+0000 7ff82effd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff81c012b20 2023-11-04T01:53:38.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:38.491+0000 7ff83cc72640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c008f90 legacy=0x7ff81c016ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:53:38.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:38.491+0000 7ff83d473640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c012b20 msgr2=0x7ff81c016330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:53:38.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:38.491+0000 7ff83d473640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c012b20 0x7ff81c016330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:38.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:38.692+0000 7ff83cc72640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c008f90 legacy=0x7ff81c016ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:53:38.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:38.692+0000 7ff83d473640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c012b20 msgr2=0x7ff81c016330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:53:38.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:38.692+0000 7ff83d473640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c012b20 0x7ff81c016330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:39.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:39.093+0000 7ff83cc72640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c008f90 legacy=0x7ff81c016ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:53:39.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:39.093+0000 7ff83d473640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c012b20 msgr2=0x7ff81c016330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:53:39.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:39.093+0000 7ff83d473640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c012b20 0x7ff81c016330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:39.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:39.894+0000 7ff83cc72640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c008f90 legacy=0x7ff81c016ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:53:39.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:39.894+0000 7ff83d473640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c012b20 msgr2=0x7ff81c016330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:53:39.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:39.894+0000 7ff83d473640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c012b20 0x7ff81c016330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:41.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:41.491+0000 7ff82effd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c012b20 msgr2=0x7ff81c016330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:41.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:41.491+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c012b20 0x7ff81c016330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:41.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:41.491+0000 7ff82effd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c008f90 legacy=0x7ff81c016ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:41.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:41.492+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c012b20 0x7ff81c016330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:41.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:41.492+0000 7ff83dc74640 1 -- reap_dead start 2023-11-04T01:53:41.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:41.492+0000 7ff82effd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff838070f40 con 0x7ff81c018400 2023-11-04T01:53:41.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:41.492+0000 7ff82effd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff838071500 con 0x7ff81c003a80 2023-11-04T01:53:41.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:41.492+0000 7ff82effd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff81c012b20 2023-11-04T01:53:41.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:41.492+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c018400 legacy=0x7ff81c01a7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:53:41.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:41.492+0000 7ff83dc74640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c003a80 legacy=0x7ff81c015c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:53:41.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:41.492+0000 7ff83cc72640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c012b20 msgr2=0x7ff81c016330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:53:41.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:41.492+0000 7ff83cc72640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c012b20 0x7ff81c016330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:41.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:41.693+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c018400 legacy=0x7ff81c01a7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:53:41.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:41.693+0000 7ff83cc72640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c012b20 msgr2=0x7ff81c016330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:53:41.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:41.693+0000 7ff83cc72640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c012b20 0x7ff81c016330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:41.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:41.693+0000 7ff83dc74640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c003a80 legacy=0x7ff81c015c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:53:42.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:42.094+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c018400 legacy=0x7ff81c01a7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:53:42.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:42.094+0000 7ff83cc72640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c012b20 msgr2=0x7ff81c016330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:53:42.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:42.094+0000 7ff83dc74640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c003a80 legacy=0x7ff81c015c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:53:42.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:42.094+0000 7ff83cc72640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c012b20 0x7ff81c016330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:42.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:42.895+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c018400 legacy=0x7ff81c01a7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:53:42.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:42.895+0000 7ff83dc74640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c003a80 legacy=0x7ff81c015c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:53:42.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:42.895+0000 7ff83cc72640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c012b20 msgr2=0x7ff81c016330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:53:42.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:42.895+0000 7ff83cc72640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c012b20 0x7ff81c016330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:44.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:44.492+0000 7ff82effd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c012b20 msgr2=0x7ff81c016330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:44.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:44.492+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c012b20 0x7ff81c016330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:44.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:44.492+0000 7ff82effd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c003a80 legacy=0x7ff81c015c00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:44.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:44.492+0000 7ff82effd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c018400 legacy=0x7ff81c01a7f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:44.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:44.492+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 0x7ff81c0055e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:44.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:44.492+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c015640 0x7ff81c004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:44.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:44.492+0000 7ff82effd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff81c015640 2023-11-04T01:53:44.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:44.492+0000 7ff82effd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff81c008cb0 con 0x7ff81c003e80 2023-11-04T01:53:44.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:44.492+0000 7ff83cc72640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c015640 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:53:44.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:44.492+0000 7ff83cc72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c015640 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:44.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:44.492+0000 7ff83d473640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:53:44.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:44.492+0000 7ff83d473640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:44.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:44.693+0000 7ff83cc72640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c015640 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:53:44.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:44.693+0000 7ff83cc72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c015640 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:44.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:44.693+0000 7ff83d473640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:53:44.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:44.693+0000 7ff83d473640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:45.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:45.094+0000 7ff83cc72640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c015640 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:53:45.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:45.094+0000 7ff83cc72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c015640 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:45.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:45.094+0000 7ff83d473640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:53:45.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:45.094+0000 7ff83d473640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:45.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:45.895+0000 7ff83cc72640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c015640 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:53:45.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:45.895+0000 7ff83cc72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c015640 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:45.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:45.895+0000 7ff83d473640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:53:45.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:45.895+0000 7ff83d473640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:47.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:47.492+0000 7ff82effd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:47.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:47.492+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:47.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:47.492+0000 7ff82effd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c015640 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:47.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:47.492+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c015640 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:47.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:47.492+0000 7ff83dc74640 1 -- reap_dead start 2023-11-04T01:53:47.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:47.492+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 0x7ff81c0055e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:47.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:47.492+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c015640 0x7ff81c004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:47.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:47.492+0000 7ff82effd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83815dae0 con 0x7ff81c003a80 2023-11-04T01:53:47.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:47.492+0000 7ff82effd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff81c015640 2023-11-04T01:53:47.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:47.492+0000 7ff82effd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff81c008cb0 con 0x7ff81c003e80 2023-11-04T01:53:47.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:47.492+0000 7ff83dc74640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c015640 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:53:47.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:47.492+0000 7ff83dc74640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c015640 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:47.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:47.492+0000 7ff83d473640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c003a80 legacy=0x7ff81c015c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:53:47.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:47.492+0000 7ff83cc72640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:53:47.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:47.492+0000 7ff83cc72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:47.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:47.693+0000 7ff83dc74640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c015640 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:53:47.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:47.693+0000 7ff83dc74640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c015640 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:47.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:47.693+0000 7ff83d473640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c003a80 legacy=0x7ff81c015c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:53:47.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:47.693+0000 7ff83cc72640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:53:47.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:47.693+0000 7ff83cc72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:48.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:48.094+0000 7ff83dc74640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c015640 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:53:48.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:48.094+0000 7ff83dc74640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c015640 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:48.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:48.094+0000 7ff83cc72640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:53:48.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:48.094+0000 7ff83d473640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c003a80 legacy=0x7ff81c015c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:53:48.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:48.094+0000 7ff83cc72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:48.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:48.895+0000 7ff83dc74640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c015640 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:53:48.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:48.895+0000 7ff83dc74640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c015640 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:48.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:48.895+0000 7ff83d473640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c003a80 legacy=0x7ff81c015c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:53:48.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:48.895+0000 7ff83cc72640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:53:48.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:48.895+0000 7ff83cc72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:50.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:50.492+0000 7ff82effd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:50.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:50.492+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:50.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:50.492+0000 7ff82effd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c015640 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:50.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:50.492+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c015640 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:50.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:50.492+0000 7ff82effd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c003a80 legacy=0x7ff81c015c00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:50.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:50.492+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 0x7ff81c00b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:50.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:50.492+0000 7ff82effd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff838070f40 con 0x7ff81c016730 2023-11-04T01:53:50.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:50.492+0000 7ff82effd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff81c016330 2023-11-04T01:53:50.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:50.492+0000 7ff83cc72640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c016730 legacy=0x7ff81c011b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:53:50.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:50.492+0000 7ff83d473640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 msgr2=0x7ff81c00b500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:53:50.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:50.492+0000 7ff83d473640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 0x7ff81c00b500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:50.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:50.693+0000 7ff83cc72640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c016730 legacy=0x7ff81c011b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:53:50.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:50.694+0000 7ff83d473640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 msgr2=0x7ff81c00b500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:53:50.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:50.694+0000 7ff83d473640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 0x7ff81c00b500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:51.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:51.094+0000 7ff83cc72640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c016730 legacy=0x7ff81c011b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:53:51.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:51.095+0000 7ff83d473640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 msgr2=0x7ff81c00b500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:53:51.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:51.095+0000 7ff83d473640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 0x7ff81c00b500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:51.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:51.895+0000 7ff83cc72640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c016730 legacy=0x7ff81c011b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:53:51.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:51.896+0000 7ff83d473640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 msgr2=0x7ff81c00b500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:53:51.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:51.896+0000 7ff83d473640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 0x7ff81c00b500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:53.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:53.493+0000 7ff82effd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 msgr2=0x7ff81c00b500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:53.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:53.493+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 0x7ff81c00b500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:53.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:53.493+0000 7ff82effd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c016730 legacy=0x7ff81c011b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:53.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:53.493+0000 7ff83dc74640 1 -- reap_dead start 2023-11-04T01:53:53.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:53.493+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 0x7ff81c0055e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:53.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:53.493+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c015620 0x7ff81c004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:53.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:53.493+0000 7ff82effd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83815dae0 con 0x7ff81c016730 2023-11-04T01:53:53.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:53.493+0000 7ff82effd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff81c003e80 2023-11-04T01:53:53.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:53.493+0000 7ff82effd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff81c008cb0 con 0x7ff81c015620 2023-11-04T01:53:53.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:53.493+0000 7ff83cc72640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c016730 legacy=0x7ff81c011b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:53:53.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:53.493+0000 7ff83d473640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:53:53.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:53.493+0000 7ff83dc74640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c015620 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:53:53.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:53.493+0000 7ff83d473640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:53.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:53.493+0000 7ff83dc74640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c015620 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:53.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:53.694+0000 7ff83cc72640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c016730 legacy=0x7ff81c011b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:53:53.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:53.694+0000 7ff83d473640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:53:53.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:53.694+0000 7ff83dc74640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c015620 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:53:53.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:53.694+0000 7ff83d473640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:53.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:53.694+0000 7ff83dc74640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c015620 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:54.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:54.095+0000 7ff83cc72640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c016730 legacy=0x7ff81c011b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:53:54.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:54.095+0000 7ff83d473640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:53:54.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:54.095+0000 7ff83dc74640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c015620 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:53:54.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:54.095+0000 7ff83d473640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:54.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:54.095+0000 7ff83dc74640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c015620 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:54.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:54.896+0000 7ff83cc72640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c016730 legacy=0x7ff81c011b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:53:54.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:54.896+0000 7ff83d473640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:53:54.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:54.896+0000 7ff83dc74640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c015620 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:53:54.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:54.896+0000 7ff83d473640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:54.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:54.896+0000 7ff83dc74640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c015620 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:56.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:56.493+0000 7ff82effd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c015620 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:56.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:56.493+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c015620 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:56.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:56.493+0000 7ff82effd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:56.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:56.493+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:56.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:56.493+0000 7ff82effd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c016730 legacy=0x7ff81c011b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:56.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:56.493+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c016330 0x7ff81c00b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:56.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:56.493+0000 7ff82effd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff838070f40 con 0x7ff81c003a80 2023-11-04T01:53:56.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:56.493+0000 7ff82effd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff81c016330 2023-11-04T01:53:56.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:56.493+0000 7ff83cc72640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c016330 msgr2=0x7ff81c00b500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:53:56.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:56.493+0000 7ff83cc72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c016330 0x7ff81c00b500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:56.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:56.493+0000 7ff83d473640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c003a80 legacy=0x7ff81c015c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:53:56.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:56.694+0000 7ff83cc72640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c016330 msgr2=0x7ff81c00b500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:53:56.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:56.694+0000 7ff83cc72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c016330 0x7ff81c00b500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:56.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:56.694+0000 7ff83d473640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c003a80 legacy=0x7ff81c015c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:53:57.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:57.095+0000 7ff83cc72640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c016330 msgr2=0x7ff81c00b500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:53:57.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:57.095+0000 7ff83cc72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c016330 0x7ff81c00b500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:53:57.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:57.095+0000 7ff83d473640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c003a80 legacy=0x7ff81c015c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:53:57.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:57.896+0000 7ff83cc72640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c016330 msgr2=0x7ff81c00b500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:53:57.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:57.896+0000 7ff83cc72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c016330 0x7ff81c00b500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:53:57.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:57.896+0000 7ff83d473640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c003a80 legacy=0x7ff81c015c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:53:59.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:59.493+0000 7ff82effd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c016330 msgr2=0x7ff81c00b500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:59.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:59.493+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c016330 0x7ff81c00b500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:53:59.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:59.493+0000 7ff82effd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c003a80 legacy=0x7ff81c015c00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:53:59.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:59.493+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 0x7ff81c0055e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:59.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:59.493+0000 7ff83dc74640 1 -- reap_dead start 2023-11-04T01:53:59.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:59.493+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 0x7ff81c004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:53:59.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:59.493+0000 7ff82effd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83815dae0 con 0x7ff81c00ea60 2023-11-04T01:53:59.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:59.493+0000 7ff82effd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff81c003e80 2023-11-04T01:53:59.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:59.493+0000 7ff82effd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff81c008cb0 con 0x7ff81c016330 2023-11-04T01:53:59.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:59.493+0000 7ff83dc74640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:53:59.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:59.493+0000 7ff83cc72640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:53:59.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:59.493+0000 7ff83d473640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c00ea60 legacy=0x7ff81c00ee40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:53:59.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:59.493+0000 7ff83dc74640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:59.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:59.493+0000 7ff83cc72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:53:59.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:59.694+0000 7ff83cc72640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:53:59.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:59.694+0000 7ff83d473640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c00ea60 legacy=0x7ff81c00ee40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:53:59.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:59.694+0000 7ff83dc74640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:53:59.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:59.694+0000 7ff83cc72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:53:59.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:53:59.694+0000 7ff83dc74640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:00.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:00.095+0000 7ff83dc74640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:00.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:00.095+0000 7ff83cc72640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:00.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:00.095+0000 7ff83d473640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c00ea60 legacy=0x7ff81c00ee40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:00.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:00.095+0000 7ff83dc74640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:00.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:00.095+0000 7ff83cc72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:00.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:00.896+0000 7ff83dc74640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:00.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:00.896+0000 7ff83d473640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c00ea60 legacy=0x7ff81c00ee40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:00.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:00.896+0000 7ff83cc72640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:00.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:00.896+0000 7ff83dc74640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:00.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:00.896+0000 7ff83cc72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:02.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:02.494+0000 7ff82effd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:02.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:02.494+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:02.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:02.494+0000 7ff82effd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:02.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:02.494+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c003e80 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:02.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:02.494+0000 7ff82effd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c00ea60 legacy=0x7ff81c00ee40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:02.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:02.494+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c016730 0x7ff81c015b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:02.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:02.494+0000 7ff82effd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff838070f40 con 0x7ff81c015620 2023-11-04T01:54:02.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:02.494+0000 7ff82effd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff81c016730 2023-11-04T01:54:02.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:02.494+0000 7ff83cc72640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c015620 legacy=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:02.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:02.494+0000 7ff83d473640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c016730 msgr2=0x7ff81c015b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:02.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:02.494+0000 7ff83d473640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c016730 0x7ff81c015b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:02.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:02.695+0000 7ff83d473640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c016730 msgr2=0x7ff81c015b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:02.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:02.695+0000 7ff83cc72640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c015620 legacy=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:02.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:02.695+0000 7ff83d473640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c016730 0x7ff81c015b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:03.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:03.096+0000 7ff83cc72640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c015620 legacy=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:03.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:03.096+0000 7ff83d473640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c016730 msgr2=0x7ff81c015b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:03.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:03.096+0000 7ff83d473640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c016730 0x7ff81c015b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:03.153 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:54:03.157 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:54:03.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:03.897+0000 7ff83cc72640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c015620 legacy=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:03.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:03.897+0000 7ff83d473640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c016730 msgr2=0x7ff81c015b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:03.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:03.897+0000 7ff83d473640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c016730 0x7ff81c015b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:05.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:05.494+0000 7ff82effd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c016730 msgr2=0x7ff81c015b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:05.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:05.494+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c016730 0x7ff81c015b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:05.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:05.494+0000 7ff82effd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c015620 legacy=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:05.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:05.494+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 0x7ff81c004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:05.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:05.494+0000 7ff83dc74640 1 -- reap_dead start 2023-11-04T01:54:05.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:05.494+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c0055e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:05.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:05.494+0000 7ff82effd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83815dae0 con 0x7ff81c015620 2023-11-04T01:54:05.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:05.494+0000 7ff82effd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff81c012b20 2023-11-04T01:54:05.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:05.494+0000 7ff82effd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff81c008cb0 con 0x7ff81c016330 2023-11-04T01:54:05.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:05.494+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c015620 legacy=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:05.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:05.494+0000 7ff83dc74640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:05.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:05.494+0000 7ff83cc72640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:05.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:05.494+0000 7ff83dc74640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:05.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:05.494+0000 7ff83cc72640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:05.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:05.695+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c015620 legacy=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:05.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:05.695+0000 7ff83cc72640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:05.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:05.695+0000 7ff83dc74640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:05.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:05.695+0000 7ff83cc72640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:05.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:05.695+0000 7ff83dc74640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:06.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:06.096+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c015620 legacy=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:06.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:06.096+0000 7ff83dc74640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:06.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:06.096+0000 7ff83cc72640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:06.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:06.096+0000 7ff83dc74640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:06.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:06.096+0000 7ff83cc72640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:06.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:06.897+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c015620 legacy=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:06.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:06.897+0000 7ff83cc72640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:06.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:06.897+0000 7ff83dc74640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:06.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:06.897+0000 7ff83cc72640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:06.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:06.897+0000 7ff83dc74640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:08.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:08.494+0000 7ff82effd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:08.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:08.494+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:08.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:08.494+0000 7ff82effd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:08.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:08.494+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:08.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:08.494+0000 7ff82effd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c015620 legacy=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:08.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:08.494+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0173b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:08.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:08.494+0000 7ff82effd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff838070f40 con 0x7ff81c016730 2023-11-04T01:54:08.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:08.494+0000 7ff82effd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff81c003e60 2023-11-04T01:54:08.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:08.494+0000 7ff83cc72640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 msgr2=0x7ff81c0173b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:08.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:08.494+0000 7ff83cc72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0173b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:08.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:08.494+0000 7ff83d473640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c016730 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:08.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:08.695+0000 7ff83cc72640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 msgr2=0x7ff81c0173b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:08.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:08.695+0000 7ff83cc72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0173b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:08.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:08.695+0000 7ff83d473640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c016730 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:09.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:09.096+0000 7ff83cc72640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 msgr2=0x7ff81c0173b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:09.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:09.096+0000 7ff83cc72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0173b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:09.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:09.096+0000 7ff83d473640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c016730 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:09.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:09.897+0000 7ff83cc72640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 msgr2=0x7ff81c0173b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:09.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:09.897+0000 7ff83cc72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0173b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:09.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:09.897+0000 7ff83d473640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c016730 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:11.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:11.495+0000 7ff82effd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 msgr2=0x7ff81c0173b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:11.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:11.495+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0173b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:11.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:11.495+0000 7ff82effd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c016730 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:11.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:11.495+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c0055e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:11.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:11.495+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 0x7ff81c004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:11.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:11.495+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0173b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:11.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:11.495+0000 7ff82effd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff81c003e60 2023-11-04T01:54:11.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:11.495+0000 7ff82effd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff81c008cb0 con 0x7ff81c012b20 2023-11-04T01:54:11.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:11.495+0000 7ff83dc74640 1 -- reap_dead start 2023-11-04T01:54:11.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:11.495+0000 7ff82effd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff81c012f00 con 0x7ff81c016330 2023-11-04T01:54:11.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:11.495+0000 7ff83dc74640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 msgr2=0x7ff81c0173b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:11.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:11.495+0000 7ff83dc74640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0173b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:11.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:11.495+0000 7ff83d473640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:11.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:11.495+0000 7ff83cc72640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:11.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:11.495+0000 7ff83d473640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:11.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:11.495+0000 7ff83cc72640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:11.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:11.696+0000 7ff83dc74640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 msgr2=0x7ff81c0173b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:11.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:11.696+0000 7ff83dc74640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0173b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:11.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:11.696+0000 7ff83d473640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:11.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:11.696+0000 7ff83cc72640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:11.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:11.696+0000 7ff83cc72640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:11.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:11.696+0000 7ff83d473640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:12.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:12.097+0000 7ff83dc74640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 msgr2=0x7ff81c0173b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:12.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:12.097+0000 7ff83dc74640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0173b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:12.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:12.097+0000 7ff83cc72640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:12.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:12.097+0000 7ff83d473640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:12.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:12.097+0000 7ff83d473640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:12.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:12.097+0000 7ff83cc72640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:12.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:12.898+0000 7ff83dc74640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 msgr2=0x7ff81c0173b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:12.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:12.898+0000 7ff83dc74640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0173b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:12.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:12.898+0000 7ff83cc72640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:12.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:12.898+0000 7ff83d473640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:12.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:12.898+0000 7ff83cc72640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:12.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:12.898+0000 7ff83d473640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:14.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:14.495+0000 7ff82effd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:14.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:14.495+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016330 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:14.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:14.495+0000 7ff82effd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:14.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:14.495+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:14.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:14.495+0000 7ff82effd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 msgr2=0x7ff81c0173b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:14.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:14.495+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0173b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:14.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:14.495+0000 7ff82effd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83815dae0 con 0x7ff81c016730 2023-11-04T01:54:14.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:14.495+0000 7ff82effd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff838070f40 con 0x7ff81c0178f0 2023-11-04T01:54:14.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:14.495+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c016730 legacy=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:14.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:14.495+0000 7ff83cc72640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c0178f0 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:14.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:14.696+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c016730 legacy=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:14.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:14.696+0000 7ff83cc72640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c0178f0 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:15.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:15.097+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c016730 legacy=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:15.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:15.097+0000 7ff83cc72640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c0178f0 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:15.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:15.898+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c016730 legacy=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:15.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:15.898+0000 7ff83cc72640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c0178f0 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:17.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:17.495+0000 7ff82effd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c0178f0 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:17.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:17.495+0000 7ff82effd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c016730 legacy=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:17.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:17.495+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c0055e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:17.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:17.495+0000 7ff83dc74640 1 -- reap_dead start 2023-11-04T01:54:17.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:17.495+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0173b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:17.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:17.495+0000 7ff82effd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff838071500 con 0x7ff81c0178f0 2023-11-04T01:54:17.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:17.495+0000 7ff82effd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff81c003e60 2023-11-04T01:54:17.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:17.495+0000 7ff82effd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff81c008cb0 con 0x7ff81c012b20 2023-11-04T01:54:17.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:17.495+0000 7ff83cc72640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 msgr2=0x7ff81c0173b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:17.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:17.495+0000 7ff83cc72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0173b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:17.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:17.495+0000 7ff83dc74640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c0178f0 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:17.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:17.495+0000 7ff83d473640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:17.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:17.495+0000 7ff83d473640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:17.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:17.696+0000 7ff83cc72640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 msgr2=0x7ff81c0173b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:17.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:17.696+0000 7ff83cc72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0173b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:17.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:17.696+0000 7ff83d473640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:17.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:17.696+0000 7ff83d473640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:17.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:17.696+0000 7ff83dc74640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c0178f0 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:18.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:18.097+0000 7ff83cc72640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 msgr2=0x7ff81c0173b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:18.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:18.097+0000 7ff83cc72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0173b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:18.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:18.097+0000 7ff83d473640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:18.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:18.097+0000 7ff83dc74640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c0178f0 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:18.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:18.097+0000 7ff83d473640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:18.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:18.897+0000 7ff83cc72640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 msgr2=0x7ff81c0173b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:18.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:18.897+0000 7ff83cc72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0173b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:18.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:18.897+0000 7ff83d473640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:18.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:18.897+0000 7ff83dc74640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c0178f0 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:18.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:18.897+0000 7ff83d473640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:20.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:20.494+0000 7ff82effd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:20.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:20.494+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:20.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:20.494+0000 7ff82effd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 msgr2=0x7ff81c0173b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:20.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:20.494+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0173b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:20.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:20.494+0000 7ff82effd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c0178f0 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:20.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:20.494+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016270 0x7ff81c004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:20.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:20.494+0000 7ff82effd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83815dae0 con 0x7ff81c016730 2023-11-04T01:54:20.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:20.494+0000 7ff82effd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff81c016270 2023-11-04T01:54:20.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:20.494+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c016730 legacy=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:20.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:20.494+0000 7ff83cc72640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016270 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:20.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:20.494+0000 7ff83cc72640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016270 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:20.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:20.695+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c016730 legacy=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:20.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:20.695+0000 7ff83cc72640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016270 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:20.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:20.695+0000 7ff83cc72640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016270 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:21.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:21.096+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c016730 legacy=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:21.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:21.096+0000 7ff83cc72640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016270 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:21.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:21.096+0000 7ff83cc72640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016270 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:21.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:21.897+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c016730 legacy=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:21.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:21.897+0000 7ff83cc72640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016270 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:21.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:21.897+0000 7ff83cc72640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016270 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:23.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:23.495+0000 7ff82effd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016270 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:23.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:23.495+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c016270 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:23.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:23.495+0000 7ff82effd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c016730 legacy=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:23.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:23.495+0000 7ff83dc74640 1 -- reap_dead start 2023-11-04T01:54:23.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:23.495+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c014620 0x7ff81c014a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:23.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:23.495+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0173b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:23.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:23.495+0000 7ff82effd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff838071500 con 0x7ff81c016730 2023-11-04T01:54:23.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:23.495+0000 7ff82effd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff81c003e60 2023-11-04T01:54:23.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:23.495+0000 7ff82effd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff81c008cb0 con 0x7ff81c014620 2023-11-04T01:54:23.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:23.495+0000 7ff83cc72640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c016730 legacy=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:23.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:23.495+0000 7ff83dc74640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 msgr2=0x7ff81c0173b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:23.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:23.495+0000 7ff83dc74640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0173b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:23.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:23.495+0000 7ff83d473640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c014620 msgr2=0x7ff81c014a00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:23.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:23.495+0000 7ff83d473640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c014620 0x7ff81c014a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:23.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:23.696+0000 7ff83cc72640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c016730 legacy=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:23.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:23.696+0000 7ff83dc74640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 msgr2=0x7ff81c0173b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:23.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:23.696+0000 7ff83dc74640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0173b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:23.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:23.696+0000 7ff83d473640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c014620 msgr2=0x7ff81c014a00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:23.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:23.696+0000 7ff83d473640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c014620 0x7ff81c014a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:24.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:24.097+0000 7ff83dc74640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 msgr2=0x7ff81c0173b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:24.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:24.097+0000 7ff83cc72640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c016730 legacy=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:24.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:24.097+0000 7ff83dc74640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0173b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:24.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:24.097+0000 7ff83d473640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c014620 msgr2=0x7ff81c014a00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:24.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:24.097+0000 7ff83d473640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c014620 0x7ff81c014a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:24.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:24.898+0000 7ff83dc74640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 msgr2=0x7ff81c0173b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:24.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:24.898+0000 7ff83dc74640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0173b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:24.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:24.898+0000 7ff83cc72640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c016730 legacy=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:24.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:24.898+0000 7ff83d473640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c014620 msgr2=0x7ff81c014a00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:24.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:24.898+0000 7ff83d473640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c014620 0x7ff81c014a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:26.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:26.495+0000 7ff82effd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c014620 msgr2=0x7ff81c014a00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:26.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:26.495+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c014620 0x7ff81c014a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:26.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:26.495+0000 7ff82effd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 msgr2=0x7ff81c0173b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:26.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:26.495+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0173b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:26.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:26.495+0000 7ff82effd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c016730 legacy=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:26.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:26.495+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c0055e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:26.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:26.495+0000 7ff82effd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83815dae0 con 0x7ff81c0178f0 2023-11-04T01:54:26.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:26.495+0000 7ff82effd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff81c012b20 2023-11-04T01:54:26.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:26.495+0000 7ff83d473640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c0178f0 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:26.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:26.495+0000 7ff83cc72640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:26.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:26.495+0000 7ff83cc72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:26.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:26.696+0000 7ff83cc72640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:26.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:26.696+0000 7ff83d473640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c0178f0 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:26.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:26.696+0000 7ff83cc72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:27.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:27.097+0000 7ff83cc72640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:27.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:27.097+0000 7ff83d473640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c0178f0 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:27.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:27.097+0000 7ff83cc72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:27.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:27.898+0000 7ff83cc72640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:27.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:27.898+0000 7ff83d473640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c0178f0 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:27.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:27.898+0000 7ff83cc72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:29.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:29.495+0000 7ff82effd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:29.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:29.495+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:29.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:29.495+0000 7ff82effd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c0178f0 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:29.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:29.495+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c014620 0x7ff81c004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:29.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:29.495+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0173b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:29.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:29.495+0000 7ff83dc74640 1 -- reap_dead start 2023-11-04T01:54:29.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:29.495+0000 7ff82effd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff838071500 con 0x7ff81c016730 2023-11-04T01:54:29.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:29.495+0000 7ff82effd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff81c003e60 2023-11-04T01:54:29.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:29.495+0000 7ff82effd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff81c008cb0 con 0x7ff81c014620 2023-11-04T01:54:29.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:29.495+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c016730 legacy=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:29.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:29.495+0000 7ff83dc74640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 msgr2=0x7ff81c0173b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:29.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:29.496+0000 7ff83dc74640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0173b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:29.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:29.496+0000 7ff83cc72640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c014620 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:29.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:29.496+0000 7ff83cc72640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c014620 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:29.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:29.697+0000 7ff83dc74640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 msgr2=0x7ff81c0173b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:29.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:29.697+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c016730 legacy=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:29.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:29.697+0000 7ff83dc74640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0173b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:29.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:29.697+0000 7ff83cc72640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c014620 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:29.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:29.697+0000 7ff83cc72640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c014620 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:30.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:30.098+0000 7ff83dc74640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 msgr2=0x7ff81c0173b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:30.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:30.098+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c016730 legacy=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:30.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:30.098+0000 7ff83dc74640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0173b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:30.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:30.098+0000 7ff83cc72640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c014620 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:30.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:30.098+0000 7ff83cc72640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c014620 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:30.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:30.899+0000 7ff83dc74640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 msgr2=0x7ff81c0173b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:30.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:30.899+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c016730 legacy=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:30.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:30.899+0000 7ff83dc74640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0173b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:30.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:30.899+0000 7ff83cc72640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c014620 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:30.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:30.899+0000 7ff83cc72640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c014620 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:32.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:32.496+0000 7ff82effd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c014620 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:32.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:32.496+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c014620 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:32.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:32.496+0000 7ff82effd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 msgr2=0x7ff81c0173b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:32.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:32.496+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0173b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:32.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:32.496+0000 7ff82effd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c016730 legacy=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:32.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:32.496+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c0055e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:32.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:32.496+0000 7ff82effd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83815dae0 con 0x7ff81c0178f0 2023-11-04T01:54:32.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:32.496+0000 7ff82effd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff81c012b20 2023-11-04T01:54:32.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:32.496+0000 7ff83cc72640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:32.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:32.496+0000 7ff83d473640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c0178f0 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:32.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:32.496+0000 7ff83cc72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:32.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:32.697+0000 7ff83cc72640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:32.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:32.697+0000 7ff83d473640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c0178f0 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:32.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:32.697+0000 7ff83cc72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:33.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:33.098+0000 7ff83cc72640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:33.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:33.098+0000 7ff83d473640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c0178f0 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:33.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:33.098+0000 7ff83cc72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:33.458 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:54:33.461 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:54:33.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:33.899+0000 7ff83cc72640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:33.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:33.899+0000 7ff83d473640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c0178f0 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:33.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:33.899+0000 7ff83cc72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:35.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:35.496+0000 7ff82effd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:35.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:35.496+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:35.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:35.496+0000 7ff82effd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c0178f0 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:35.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:35.496+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c0055e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:35.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:35.496+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0173b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:35.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:35.496+0000 7ff83dc74640 1 -- reap_dead start 2023-11-04T01:54:35.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:35.496+0000 7ff82effd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff838071500 con 0x7ff81c0178f0 2023-11-04T01:54:35.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:35.496+0000 7ff82effd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff81c003e60 2023-11-04T01:54:35.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:35.496+0000 7ff82effd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff81c008cb0 con 0x7ff81c012b20 2023-11-04T01:54:35.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:35.496+0000 7ff83cc72640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 msgr2=0x7ff81c0173b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:35.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:35.496+0000 7ff83cc72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0173b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:35.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:35.496+0000 7ff83d473640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:35.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:35.496+0000 7ff83dc74640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c0178f0 legacy=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:35.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:35.496+0000 7ff83d473640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:35.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:35.697+0000 7ff83cc72640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 msgr2=0x7ff81c0173b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:35.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:35.697+0000 7ff83cc72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0173b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:35.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:35.697+0000 7ff83d473640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:35.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:35.697+0000 7ff83dc74640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c0178f0 legacy=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:35.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:35.697+0000 7ff83d473640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:36.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:36.098+0000 7ff83cc72640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 msgr2=0x7ff81c0173b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:36.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:36.098+0000 7ff83cc72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0173b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:36.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:36.098+0000 7ff83d473640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:36.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:36.098+0000 7ff83dc74640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c0178f0 legacy=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:36.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:36.098+0000 7ff83d473640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:36.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:36.899+0000 7ff83cc72640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 msgr2=0x7ff81c0173b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:36.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:36.899+0000 7ff83cc72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0173b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:36.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:36.899+0000 7ff83d473640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:36.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:36.899+0000 7ff83dc74640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c0178f0 legacy=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:36.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:36.899+0000 7ff83d473640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:38.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:38.496+0000 7ff82effd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:38.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:38.496+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:38.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:38.496+0000 7ff82effd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 msgr2=0x7ff81c0173b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:38.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:38.496+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0173b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:38.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:38.496+0000 7ff82effd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c0178f0 legacy=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:38.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:38.496+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0166e0 0x7ff81c004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:38.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:38.496+0000 7ff82effd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83815dae0 con 0x7ff81c015620 2023-11-04T01:54:38.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:38.496+0000 7ff82effd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff81c0166e0 2023-11-04T01:54:38.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:38.496+0000 7ff83cc72640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c015620 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:38.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:38.496+0000 7ff83d473640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0166e0 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:38.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:38.496+0000 7ff83d473640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0166e0 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:38.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:38.697+0000 7ff83cc72640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c015620 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:38.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:38.697+0000 7ff83d473640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0166e0 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:38.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:38.697+0000 7ff83d473640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0166e0 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:39.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:39.098+0000 7ff83cc72640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c015620 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:39.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:39.098+0000 7ff83d473640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0166e0 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:39.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:39.098+0000 7ff83d473640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0166e0 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:39.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:39.899+0000 7ff83cc72640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c015620 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:39.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:39.899+0000 7ff83d473640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0166e0 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:39.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:39.899+0000 7ff83d473640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0166e0 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:41.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:41.497+0000 7ff82effd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0166e0 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:41.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:41.497+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0166e0 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:41.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:41.497+0000 7ff82effd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c015620 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:41.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:41.497+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0079e0 0x7ff81c007dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:41.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:41.497+0000 7ff83dc74640 1 -- reap_dead start 2023-11-04T01:54:41.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:41.497+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:41.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:41.497+0000 7ff82effd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff838071500 con 0x7ff81c015620 2023-11-04T01:54:41.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:41.497+0000 7ff82effd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff81c012b20 2023-11-04T01:54:41.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:41.497+0000 7ff82effd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff81c008cb0 con 0x7ff81c0079e0 2023-11-04T01:54:41.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:41.497+0000 7ff83dc74640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c015620 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:41.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:41.497+0000 7ff83cc72640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:41.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:41.497+0000 7ff83d473640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0079e0 msgr2=0x7ff81c007dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:41.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:41.497+0000 7ff83d473640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0079e0 0x7ff81c007dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:41.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:41.497+0000 7ff83cc72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:41.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:41.698+0000 7ff83dc74640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c015620 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:41.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:41.698+0000 7ff83cc72640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:41.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:41.698+0000 7ff83cc72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:41.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:41.698+0000 7ff83d473640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0079e0 msgr2=0x7ff81c007dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:41.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:41.698+0000 7ff83d473640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0079e0 0x7ff81c007dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:42.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:42.099+0000 7ff83dc74640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c015620 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:42.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:42.099+0000 7ff83cc72640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:42.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:42.099+0000 7ff83d473640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0079e0 msgr2=0x7ff81c007dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:42.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:42.099+0000 7ff83d473640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0079e0 0x7ff81c007dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:42.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:42.099+0000 7ff83cc72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:42.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:42.900+0000 7ff83dc74640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c015620 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:42.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:42.900+0000 7ff83d473640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0079e0 msgr2=0x7ff81c007dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:42.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:42.900+0000 7ff83cc72640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:42.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:42.900+0000 7ff83d473640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0079e0 0x7ff81c007dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:42.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:42.900+0000 7ff83cc72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:44.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:44.497+0000 7ff82effd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0079e0 msgr2=0x7ff81c007dc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:44.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:44.497+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0079e0 0x7ff81c007dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:44.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:44.497+0000 7ff82effd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 msgr2=0x7ff81c004820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:44.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:44.497+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c012b20 0x7ff81c004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:44.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:44.497+0000 7ff82effd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c015620 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:44.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:44.497+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0055e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:44.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:44.497+0000 7ff82effd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83815dae0 con 0x7ff81c008300 2023-11-04T01:54:44.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:44.497+0000 7ff82effd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff81c003e60 2023-11-04T01:54:44.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:44.497+0000 7ff83d473640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:44.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:44.497+0000 7ff83d473640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:44.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:44.497+0000 7ff83cc72640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c008300 legacy=0x7ff81c0069d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:44.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:44.698+0000 7ff83d473640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:44.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:44.698+0000 7ff83d473640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:44.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:44.698+0000 7ff83cc72640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c008300 legacy=0x7ff81c0069d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:45.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:45.099+0000 7ff83d473640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:45.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:45.099+0000 7ff83d473640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:45.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:45.099+0000 7ff83cc72640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c008300 legacy=0x7ff81c0069d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:45.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:45.900+0000 7ff83d473640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:45.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:45.900+0000 7ff83d473640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:45.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:45.900+0000 7ff83cc72640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c008300 legacy=0x7ff81c0069d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:47.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:47.497+0000 7ff82effd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:47.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:47.497+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c003e60 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:47.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:47.497+0000 7ff82effd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c008300 legacy=0x7ff81c0069d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:47.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:47.497+0000 7ff83dc74640 1 -- reap_dead start 2023-11-04T01:54:47.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:47.497+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0079e0 0x7ff81c007dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:47.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:47.497+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c008300 0x7ff81c0055e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:47.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:47.497+0000 7ff82effd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff838071500 con 0x7ff81c003e60 2023-11-04T01:54:47.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:47.497+0000 7ff82effd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff81c008300 2023-11-04T01:54:47.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:47.497+0000 7ff82effd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff81c008cb0 con 0x7ff81c0079e0 2023-11-04T01:54:47.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:47.497+0000 7ff83dc74640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c003e60 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:47.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:47.497+0000 7ff83d473640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0079e0 msgr2=0x7ff81c007dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:47.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:47.497+0000 7ff83cc72640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c008300 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:47.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:47.497+0000 7ff83d473640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0079e0 0x7ff81c007dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:47.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:47.497+0000 7ff83cc72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c008300 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:47.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:47.698+0000 7ff83cc72640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c008300 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:47.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:47.698+0000 7ff83dc74640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c003e60 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:47.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:47.698+0000 7ff83cc72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c008300 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:47.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:47.698+0000 7ff83d473640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0079e0 msgr2=0x7ff81c007dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:47.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:47.698+0000 7ff83d473640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0079e0 0x7ff81c007dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:48.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:48.099+0000 7ff83dc74640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c003e60 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:48.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:48.099+0000 7ff83cc72640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c008300 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:48.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:48.099+0000 7ff83cc72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c008300 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:48.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:48.099+0000 7ff83d473640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0079e0 msgr2=0x7ff81c007dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:48.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:48.099+0000 7ff83d473640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0079e0 0x7ff81c007dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:48.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:48.900+0000 7ff83dc74640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c003e60 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:48.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:48.900+0000 7ff83cc72640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c008300 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:48.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:48.900+0000 7ff83cc72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c008300 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:48.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:48.900+0000 7ff83d473640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0079e0 msgr2=0x7ff81c007dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:48.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:48.900+0000 7ff83d473640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0079e0 0x7ff81c007dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:50.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:50.498+0000 7ff82effd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0079e0 msgr2=0x7ff81c007dc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:50.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:50.498+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c0079e0 0x7ff81c007dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:50.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:50.498+0000 7ff82effd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c008300 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:50.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:50.498+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c008300 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:50.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:50.498+0000 7ff82effd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c003e60 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:50.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:50.498+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c004820 0x7ff81c016ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:50.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:50.498+0000 7ff82effd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83815dae0 con 0x7ff81c015620 2023-11-04T01:54:50.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:50.498+0000 7ff82effd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff81c004820 2023-11-04T01:54:50.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:50.498+0000 7ff83cc72640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c015620 legacy=0x7ff81c0171e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:50.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:50.498+0000 7ff83d473640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c004820 msgr2=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:50.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:50.498+0000 7ff83d473640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c004820 0x7ff81c016ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:50.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:50.699+0000 7ff83d473640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c004820 msgr2=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:50.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:50.699+0000 7ff83cc72640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c015620 legacy=0x7ff81c0171e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:50.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:50.699+0000 7ff83d473640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c004820 0x7ff81c016ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:51.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:51.100+0000 7ff83cc72640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c015620 legacy=0x7ff81c0171e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:51.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:51.100+0000 7ff83d473640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c004820 msgr2=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:51.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:51.100+0000 7ff83d473640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c004820 0x7ff81c016ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:51.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:51.901+0000 7ff83cc72640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c015620 legacy=0x7ff81c0171e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:51.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:51.901+0000 7ff83d473640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c004820 msgr2=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:51.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:51.901+0000 7ff83d473640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c004820 0x7ff81c016ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:53.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:53.498+0000 7ff82effd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c004820 msgr2=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:53.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:53.498+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c004820 0x7ff81c016ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:53.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:53.498+0000 7ff82effd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c015620 legacy=0x7ff81c0171e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:53.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:53.498+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c008300 0x7ff81c0055e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:53.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:53.498+0000 7ff83dc74640 1 -- reap_dead start 2023-11-04T01:54:53.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:53.498+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c004820 0x7ff81c016ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:53.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:53.498+0000 7ff82effd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff838071500 con 0x7ff81c003e60 2023-11-04T01:54:53.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:53.498+0000 7ff82effd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff81c008300 2023-11-04T01:54:53.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:53.498+0000 7ff82effd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff81c008cb0 con 0x7ff81c004820 2023-11-04T01:54:53.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:53.498+0000 7ff83d473640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c008300 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:53.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:53.498+0000 7ff83d473640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c008300 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:53.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:53.498+0000 7ff83dc74640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c003e60 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:53.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:53.498+0000 7ff83cc72640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c004820 msgr2=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:53.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:53.498+0000 7ff83cc72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c004820 0x7ff81c016ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:53.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:53.699+0000 7ff83dc74640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c003e60 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:53.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:53.699+0000 7ff83d473640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c008300 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:53.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:53.699+0000 7ff83d473640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c008300 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:53.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:53.699+0000 7ff83cc72640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c004820 msgr2=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:53.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:53.699+0000 7ff83cc72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c004820 0x7ff81c016ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:54.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:54.100+0000 7ff83dc74640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c003e60 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:54.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:54.100+0000 7ff83d473640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c008300 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:54.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:54.100+0000 7ff83d473640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c008300 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:54.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:54.100+0000 7ff83cc72640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c004820 msgr2=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:54.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:54.100+0000 7ff83cc72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c004820 0x7ff81c016ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:54.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:54.901+0000 7ff83d473640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c008300 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:54.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:54.901+0000 7ff83dc74640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c003e60 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:54:54.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:54.901+0000 7ff83d473640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c008300 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:54.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:54.901+0000 7ff83cc72640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c004820 msgr2=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:54.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:54.901+0000 7ff83cc72640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c004820 0x7ff81c016ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:56.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:56.498+0000 7ff82effd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c004820 msgr2=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:56.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:56.498+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c004820 0x7ff81c016ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:56.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:56.498+0000 7ff82effd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c008300 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:56.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:56.498+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c008300 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:56.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:56.498+0000 7ff82effd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c003e60 legacy=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:56.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:56.498+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c015620 0x7ff81c0079e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:56.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:56.498+0000 7ff82effd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83815dae0 con 0x7ff81c007f20 2023-11-04T01:54:56.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:56.498+0000 7ff82effd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff81c015620 2023-11-04T01:54:56.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:56.498+0000 7ff83d473640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c015620 msgr2=0x7ff81c0079e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:56.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:56.498+0000 7ff83cc72640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c007f20 legacy=0x7ff81c0171e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:56.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:56.498+0000 7ff83d473640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c015620 0x7ff81c0079e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:56.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:56.699+0000 7ff83cc72640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c007f20 legacy=0x7ff81c0171e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:56.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:56.699+0000 7ff83d473640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c015620 msgr2=0x7ff81c0079e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:56.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:56.699+0000 7ff83d473640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c015620 0x7ff81c0079e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:57.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:57.100+0000 7ff83cc72640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c007f20 legacy=0x7ff81c0171e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:57.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:57.100+0000 7ff83d473640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c015620 msgr2=0x7ff81c0079e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:57.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:57.100+0000 7ff83d473640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c015620 0x7ff81c0079e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:54:57.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:57.901+0000 7ff83cc72640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c007f20 legacy=0x7ff81c0171e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:57.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:57.901+0000 7ff83d473640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c015620 msgr2=0x7ff81c0079e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:54:57.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:57.901+0000 7ff83d473640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c015620 0x7ff81c0079e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:54:59.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:59.499+0000 7ff82effd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c015620 msgr2=0x7ff81c0079e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:59.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:59.499+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c015620 0x7ff81c0079e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:54:59.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:59.499+0000 7ff82effd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c007f20 legacy=0x7ff81c0171e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:54:59.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:59.499+0000 7ff83dc74640 1 -- reap_dead start 2023-11-04T01:54:59.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:59.499+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c004820 0x7ff81c0055e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:59.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:59.499+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c008300 0x7ff81c015b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:54:59.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:59.499+0000 7ff82effd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff838071500 con 0x7ff81c012b20 2023-11-04T01:54:59.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:59.499+0000 7ff82effd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff81c004820 2023-11-04T01:54:59.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:59.499+0000 7ff82effd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff81c008cb0 con 0x7ff81c008300 2023-11-04T01:54:59.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:59.499+0000 7ff83cc72640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c004820 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:59.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:59.499+0000 7ff83cc72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c004820 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:59.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:59.499+0000 7ff83d473640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c012b20 legacy=0x7ff81c01e110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:59.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:59.499+0000 7ff83dc74640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c008300 msgr2=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:59.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:59.499+0000 7ff83dc74640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c008300 0x7ff81c015b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:54:59.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:59.700+0000 7ff83cc72640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c004820 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:54:59.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:59.700+0000 7ff83cc72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c004820 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:54:59.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:59.700+0000 7ff83d473640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c012b20 legacy=0x7ff81c01e110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:54:59.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:59.700+0000 7ff83dc74640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c008300 msgr2=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:54:59.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:54:59.700+0000 7ff83dc74640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c008300 0x7ff81c015b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:00.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:00.101+0000 7ff83cc72640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c004820 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:00.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:00.101+0000 7ff83cc72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c004820 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:00.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:00.101+0000 7ff83dc74640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c008300 msgr2=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:00.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:00.101+0000 7ff83d473640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c012b20 legacy=0x7ff81c01e110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:00.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:00.101+0000 7ff83dc74640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c008300 0x7ff81c015b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:00.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:00.902+0000 7ff83cc72640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c004820 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:00.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:00.902+0000 7ff83cc72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c004820 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:00.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:00.902+0000 7ff83d473640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c012b20 legacy=0x7ff81c01e110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:00.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:00.902+0000 7ff83dc74640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c008300 msgr2=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:00.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:00.902+0000 7ff83dc74640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c008300 0x7ff81c015b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:02.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:02.498+0000 7ff82effd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c008300 msgr2=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:02.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:02.498+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c008300 0x7ff81c015b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:02.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:02.498+0000 7ff82effd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c004820 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:02.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:02.498+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c004820 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:02.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:02.498+0000 7ff82effd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c012b20 legacy=0x7ff81c01e110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:02.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:02.498+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c008710 0x7ff81c012220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:02.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:02.498+0000 7ff82effd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83815dae0 con 0x7ff81c015620 2023-11-04T01:55:02.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:02.498+0000 7ff82effd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff81c008710 2023-11-04T01:55:02.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:02.498+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c015620 legacy=0x7ff81c011b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:02.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:02.498+0000 7ff83cc72640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c008710 msgr2=0x7ff81c012220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:02.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:02.498+0000 7ff83cc72640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c008710 0x7ff81c012220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:02.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:02.699+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c015620 legacy=0x7ff81c011b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:02.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:02.699+0000 7ff83cc72640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c008710 msgr2=0x7ff81c012220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:02.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:02.699+0000 7ff83cc72640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c008710 0x7ff81c012220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:03.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:03.100+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c015620 legacy=0x7ff81c011b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:03.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:03.100+0000 7ff83cc72640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c008710 msgr2=0x7ff81c012220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:03.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:03.100+0000 7ff83cc72640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c008710 0x7ff81c012220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:03.597 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:55:03.600 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:55:03.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:03.901+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c015620 legacy=0x7ff81c011b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:03.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:03.901+0000 7ff83cc72640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c008710 msgr2=0x7ff81c012220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:03.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:03.901+0000 7ff83cc72640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c008710 0x7ff81c012220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:05.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:05.499+0000 7ff82effd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c008710 msgr2=0x7ff81c012220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:05.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:05.499+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c008710 0x7ff81c012220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:05.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:05.499+0000 7ff82effd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c015620 legacy=0x7ff81c011b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:05.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:05.499+0000 7ff83dc74640 1 -- reap_dead start 2023-11-04T01:55:05.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:05.499+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c008300 0x7ff81c015b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:05.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:05.499+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c008710 0x7ff81c0055e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:05.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:05.499+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c015620 0x7ff81c016ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:05.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:05.499+0000 7ff82effd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff838070c60 con 0x7ff81c015620 2023-11-04T01:55:05.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:05.499+0000 7ff82effd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff81c008cb0 con 0x7ff81c008300 2023-11-04T01:55:05.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:05.499+0000 7ff82effd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff81c012f00 con 0x7ff81c008710 2023-11-04T01:55:05.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:05.499+0000 7ff83dc74640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c015620 msgr2=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:05.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:05.499+0000 7ff83dc74640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c015620 0x7ff81c016ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:05.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:05.499+0000 7ff83d473640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c008300 msgr2=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:05.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:05.499+0000 7ff83cc72640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c008710 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:05.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:05.499+0000 7ff83d473640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c008300 0x7ff81c015b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:05.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:05.499+0000 7ff83cc72640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c008710 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:05.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:05.700+0000 7ff83dc74640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c015620 msgr2=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:05.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:05.700+0000 7ff83dc74640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c015620 0x7ff81c016ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:05.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:05.700+0000 7ff83cc72640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c008710 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:05.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:05.700+0000 7ff83d473640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c008300 msgr2=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:05.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:05.700+0000 7ff83cc72640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c008710 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:05.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:05.700+0000 7ff83d473640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c008300 0x7ff81c015b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:06.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:06.101+0000 7ff83dc74640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c015620 msgr2=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:06.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:06.101+0000 7ff83dc74640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c015620 0x7ff81c016ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:06.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:06.101+0000 7ff83cc72640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c008710 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:06.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:06.101+0000 7ff83d473640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c008300 msgr2=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:06.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:06.101+0000 7ff83cc72640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c008710 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:06.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:06.101+0000 7ff83d473640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c008300 0x7ff81c015b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:06.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:06.902+0000 7ff83dc74640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c015620 msgr2=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:06.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:06.902+0000 7ff83dc74640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c015620 0x7ff81c016ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:06.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:06.902+0000 7ff83d473640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c008300 msgr2=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:06.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:06.902+0000 7ff83cc72640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c008710 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:06.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:06.902+0000 7ff83d473640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c008300 0x7ff81c015b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:06.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:06.902+0000 7ff83cc72640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c008710 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:08.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:08.499+0000 7ff82effd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c008710 msgr2=0x7ff81c0055e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:08.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:08.499+0000 7ff82effd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7ff81c008710 0x7ff81c0055e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:08.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:08.499+0000 7ff82effd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7ff81c008300 msgr2=0x7ff81c015b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:08.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:08.499+0000 7ff82effd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7ff81c008300 0x7ff81c015b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:08.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:08.499+0000 7ff82effd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7ff81c015620 msgr2=0x7ff81c016ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:08.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:08.499+0000 7ff82effd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff81c015620 0x7ff81c016ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:08.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:08.499+0000 7ff82effd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff838071500 con 0x7ff81c004820 2023-11-04T01:55:08.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:08.499+0000 7ff82effd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83815dae0 con 0x7ff81c012b20 2023-11-04T01:55:08.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:08.499+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c004820 legacy=0x7ff81c0171e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:08.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:08.499+0000 7ff83cc72640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c012b20 legacy=0x7ff81c0069d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:08.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:08.700+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c004820 legacy=0x7ff81c0171e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:08.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:08.700+0000 7ff83cc72640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c012b20 legacy=0x7ff81c0069d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:09.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:09.101+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c004820 legacy=0x7ff81c0171e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:09.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:09.101+0000 7ff83cc72640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c012b20 legacy=0x7ff81c0069d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:09.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:09.902+0000 7ff83d473640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7ff81c004820 legacy=0x7ff81c0171e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:09.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:09.902+0000 7ff83cc72640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7ff81c012b20 legacy=0x7ff81c0069d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:11.415 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-11-04T01:55:11.417 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:55:11.417 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:55:11.462 DEBUG:teuthology.orchestra.run.smithi122:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:55:11.513 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:55:11.514 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:55:11.515 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:55:11.533 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19534 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:55:11.533 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2023-11-04T01:55:11.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:55:11.534 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:55:11.590 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:55:11.591 INFO:teuthology.orchestra.run.smithi077.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-11-04T01:55:11.591 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:55:11.592 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:55:11.610 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056339,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13650 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:55:11.610 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi122.front.sepia.ceph.com 2023-11-04T01:55:11.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:55:11.611 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:55:11.666 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:55:11.667 INFO:teuthology.orchestra.run.smithi122.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-04T01:55:11.667 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:55:11.668 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:55:11.685 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19534 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:55:11.685 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2023-11-04T01:55:11.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:55:11.686 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:55:11.742 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:55:11.743 INFO:teuthology.orchestra.run.smithi077.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-04T01:55:11.743 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:55:11.744 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:55:11.761 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056339,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13650 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:55:11.761 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi122.front.sepia.ceph.com 2023-11-04T01:55:11.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:55:11.762 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:55:11.817 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:55:11.818 INFO:teuthology.orchestra.run.smithi122.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-04T01:55:11.818 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:55:11.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:11.922+0000 7f507f3f5640 1 Processor -- start 2023-11-04T01:55:11.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:11.923+0000 7f507f3f5640 1 -- start start 2023-11-04T01:55:11.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:11.923+0000 7f507f3f5640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f50780d1be0 0x7f5078167e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:11.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:11.923+0000 7f507f3f5640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780b32b0 con 0x7f507815d100 2023-11-04T01:55:11.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:11.923+0000 7f507f3f5640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780cee10 con 0x7f507815d4e0 2023-11-04T01:55:11.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:11.923+0000 7f507f3f5640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50780cec20 con 0x7f50780d1be0 2023-11-04T01:55:11.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:11.924+0000 7f507d191640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f507815d100 legacy=0x7f50780ce510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:11.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:11.924+0000 7f507d992640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f50780d1be0 msgr2=0x7f5078167e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:11.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:11.924+0000 7f507c990640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f507815d4e0 legacy=0x7f50780d14d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:11.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:11.924+0000 7f507d992640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f50780d1be0 0x7f5078167e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:12.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:12.125+0000 7f507d191640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f507815d100 legacy=0x7f50780ce510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:12.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:12.125+0000 7f507d992640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f50780d1be0 msgr2=0x7f5078167e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:12.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:12.125+0000 7f507c990640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f507815d4e0 legacy=0x7f50780d14d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:12.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:12.125+0000 7f507d992640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f50780d1be0 0x7f5078167e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:12.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:12.526+0000 7f507d191640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f507815d100 legacy=0x7f50780ce510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:12.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:12.526+0000 7f507c990640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f507815d4e0 legacy=0x7f50780d14d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:12.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:12.526+0000 7f507d992640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f50780d1be0 msgr2=0x7f5078167e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:12.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:12.526+0000 7f507d992640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f50780d1be0 0x7f5078167e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:13.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:13.327+0000 7f507d191640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f507815d100 legacy=0x7f50780ce510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:13.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:13.327+0000 7f507d992640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f50780d1be0 msgr2=0x7f5078167e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:13.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:13.327+0000 7f507c990640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f507815d4e0 legacy=0x7f50780d14d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:13.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:13.327+0000 7f507d992640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f50780d1be0 0x7f5078167e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:14.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:14.924+0000 7f506affd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f50780d1be0 msgr2=0x7f5078167e80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:14.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:14.924+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f50780d1be0 0x7f5078167e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:14.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:14.924+0000 7f506affd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f507815d4e0 legacy=0x7f50780d14d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:14.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:14.924+0000 7f506affd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f507815d100 legacy=0x7f50780ce510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:14.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:14.924+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0036a0 0x7f505c005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:14.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:14.924+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c006110 0x7f505c0085d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:14.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:14.924+0000 7f506affd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c0036a0 2023-11-04T01:55:14.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:14.924+0000 7f506affd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505c008de0 con 0x7f505c006110 2023-11-04T01:55:14.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:14.924+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0036a0 msgr2=0x7f505c005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:14.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:14.924+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0036a0 0x7f505c005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:14.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:14.924+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c006110 msgr2=0x7f505c0085d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:14.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:14.924+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c006110 0x7f505c0085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:15.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:15.125+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0036a0 msgr2=0x7f505c005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:15.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:15.125+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0036a0 0x7f505c005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:15.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:15.125+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c006110 msgr2=0x7f505c0085d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:15.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:15.125+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c006110 0x7f505c0085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:15.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:15.526+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0036a0 msgr2=0x7f505c005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:15.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:15.526+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0036a0 0x7f505c005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:15.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:15.526+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c006110 msgr2=0x7f505c0085d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:15.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:15.526+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c006110 0x7f505c0085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:16.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:16.327+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0036a0 msgr2=0x7f505c005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:16.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:16.327+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0036a0 0x7f505c005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:16.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:16.327+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c006110 msgr2=0x7f505c0085d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:16.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:16.327+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c006110 0x7f505c0085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:17.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:17.924+0000 7f506affd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c006110 msgr2=0x7f505c0085d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:17.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:17.924+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c006110 0x7f505c0085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:17.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:17.924+0000 7f506affd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0036a0 msgr2=0x7f505c005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:17.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:17.924+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0036a0 0x7f505c005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:17.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:17.924+0000 7f507d992640 1 -- reap_dead start 2023-11-04T01:55:17.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:17.924+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c003b10 0x7f505c0065c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:17.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:17.924+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0086b0 0x7f505c00d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:17.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:17.924+0000 7f506affd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780b4750 con 0x7f505c006b00 2023-11-04T01:55:17.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:17.924+0000 7f506affd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c0086b0 2023-11-04T01:55:17.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:17.924+0000 7f506affd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008de0 con 0x7f505c003b10 2023-11-04T01:55:17.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:17.924+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c006b00 legacy=0x7f505c006f00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:17.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:17.924+0000 7f507d992640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0086b0 msgr2=0x7f505c00d1a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:17.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:17.924+0000 7f507d992640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0086b0 0x7f505c00d1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:17.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:17.924+0000 7f507d191640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c003b10 msgr2=0x7f505c0065c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:17.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:17.924+0000 7f507d191640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c003b10 0x7f505c0065c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:18.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:18.125+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c006b00 legacy=0x7f505c006f00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:18.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:18.125+0000 7f507d992640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0086b0 msgr2=0x7f505c00d1a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:18.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:18.125+0000 7f507d992640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0086b0 0x7f505c00d1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:18.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:18.125+0000 7f507d191640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c003b10 msgr2=0x7f505c0065c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:18.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:18.125+0000 7f507d191640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c003b10 0x7f505c0065c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:18.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:18.526+0000 7f507d992640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0086b0 msgr2=0x7f505c00d1a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:18.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:18.526+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c006b00 legacy=0x7f505c006f00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:18.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:18.526+0000 7f507d992640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0086b0 0x7f505c00d1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:18.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:18.526+0000 7f507d191640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c003b10 msgr2=0x7f505c0065c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:18.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:18.526+0000 7f507d191640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c003b10 0x7f505c0065c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:19.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:19.327+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c006b00 legacy=0x7f505c006f00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:19.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:19.327+0000 7f507d992640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0086b0 msgr2=0x7f505c00d1a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:19.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:19.327+0000 7f507d992640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0086b0 0x7f505c00d1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:19.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:19.327+0000 7f507d191640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c003b10 msgr2=0x7f505c0065c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:19.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:19.327+0000 7f507d191640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c003b10 0x7f505c0065c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:20.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:20.924+0000 7f506affd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c003b10 msgr2=0x7f505c0065c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:20.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:20.924+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c003b10 0x7f505c0065c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:20.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:20.924+0000 7f506affd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0086b0 msgr2=0x7f505c00d1a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:20.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:20.924+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0086b0 0x7f505c00d1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:20.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:20.924+0000 7f506affd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c006b00 legacy=0x7f505c006f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:20.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:20.924+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00e520 0x7f505c013ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:20.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:20.924+0000 7f506affd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780b32b0 con 0x7f505c00d960 2023-11-04T01:55:20.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:20.924+0000 7f506affd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c00e520 2023-11-04T01:55:20.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:20.924+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00e520 msgr2=0x7f505c013ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:20.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:20.924+0000 7f507d191640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c00d960 legacy=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:20.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:20.924+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00e520 0x7f505c013ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:21.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:21.125+0000 7f507d191640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c00d960 legacy=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:21.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:21.125+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00e520 msgr2=0x7f505c013ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:21.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:21.125+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00e520 0x7f505c013ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:21.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:21.526+0000 7f507d191640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c00d960 legacy=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:21.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:21.526+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00e520 msgr2=0x7f505c013ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:21.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:21.526+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00e520 0x7f505c013ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:22.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:22.327+0000 7f507d191640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c00d960 legacy=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:22.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:22.327+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00e520 msgr2=0x7f505c013ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:22.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:22.327+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00e520 0x7f505c013ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:23.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:23.925+0000 7f506affd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00e520 msgr2=0x7f505c013ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:23.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:23.925+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00e520 0x7f505c013ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:23.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:23.925+0000 7f506affd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c00d960 legacy=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:23.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:23.925+0000 7f507d992640 1 -- reap_dead start 2023-11-04T01:55:23.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:23.925+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014180 0x7f505c0145a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:23.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:23.925+0000 7f506affd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780b4750 con 0x7f505c006b00 2023-11-04T01:55:23.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:23.925+0000 7f506affd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780b32b0 con 0x7f505c0065a0 2023-11-04T01:55:23.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:23.925+0000 7f506affd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c014180 2023-11-04T01:55:23.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:23.925+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c006b00 legacy=0x7f505c006f00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:23.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:23.925+0000 7f507d992640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:23.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:23.925+0000 7f507d191640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014180 msgr2=0x7f505c0145a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:23.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:23.925+0000 7f507d191640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014180 0x7f505c0145a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:24.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:24.126+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c006b00 legacy=0x7f505c006f00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:24.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:24.126+0000 7f507d992640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:24.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:24.126+0000 7f507d191640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014180 msgr2=0x7f505c0145a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:24.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:24.126+0000 7f507d191640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014180 0x7f505c0145a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:24.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:24.527+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c006b00 legacy=0x7f505c006f00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:24.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:24.527+0000 7f507d191640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014180 msgr2=0x7f505c0145a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:24.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:24.527+0000 7f507d992640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:24.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:24.527+0000 7f507d191640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014180 0x7f505c0145a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:25.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:25.328+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c006b00 legacy=0x7f505c006f00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:25.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:25.328+0000 7f507d992640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:25.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:25.328+0000 7f507d191640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014180 msgr2=0x7f505c0145a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:25.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:25.328+0000 7f507d191640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014180 0x7f505c0145a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:26.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:26.925+0000 7f506affd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014180 msgr2=0x7f505c0145a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:26.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:26.925+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014180 0x7f505c0145a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:26.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:26.925+0000 7f506affd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:26.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:26.925+0000 7f506affd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c006b00 legacy=0x7f505c006f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:26.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:26.925+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c014c00 0x7f505c013ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:26.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:26.925+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c00c1a0 0x7f505c010a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:26.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:26.925+0000 7f506affd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c00c1a0 2023-11-04T01:55:26.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:26.925+0000 7f506affd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008de0 con 0x7f505c014c00 2023-11-04T01:55:26.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:26.925+0000 7f507c990640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c00c1a0 msgr2=0x7f505c010a70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:26.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:26.925+0000 7f507c990640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c00c1a0 0x7f505c010a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:26.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:26.925+0000 7f507d191640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c014c00 msgr2=0x7f505c013ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:26.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:26.925+0000 7f507d191640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c014c00 0x7f505c013ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:27.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:27.126+0000 7f507c990640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c00c1a0 msgr2=0x7f505c010a70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:27.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:27.126+0000 7f507c990640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c00c1a0 0x7f505c010a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:27.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:27.126+0000 7f507d191640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c014c00 msgr2=0x7f505c013ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:27.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:27.126+0000 7f507d191640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c014c00 0x7f505c013ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:27.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:27.527+0000 7f507c990640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c00c1a0 msgr2=0x7f505c010a70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:27.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:27.527+0000 7f507c990640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c00c1a0 0x7f505c010a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:27.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:27.527+0000 7f507d191640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c014c00 msgr2=0x7f505c013ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:27.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:27.527+0000 7f507d191640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c014c00 0x7f505c013ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:28.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:28.328+0000 7f507c990640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c00c1a0 msgr2=0x7f505c010a70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:28.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:28.328+0000 7f507c990640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c00c1a0 0x7f505c010a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:28.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:28.328+0000 7f507d191640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c014c00 msgr2=0x7f505c013ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:28.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:28.328+0000 7f507d191640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c014c00 0x7f505c013ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:29.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:29.925+0000 7f506affd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c014c00 msgr2=0x7f505c013ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:29.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:29.925+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c014c00 0x7f505c013ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:29.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:29.925+0000 7f506affd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c00c1a0 msgr2=0x7f505c010a70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:29.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:29.925+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c00c1a0 0x7f505c010a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:29.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:29.925+0000 7f507d992640 1 -- reap_dead start 2023-11-04T01:55:29.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:29.925+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c006b00 0x7f505c014560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:29.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:29.925+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 0x7f505c013ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:29.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:29.925+0000 7f506affd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780cee10 con 0x7f505c0065a0 2023-11-04T01:55:29.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:29.925+0000 7f506affd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c014180 2023-11-04T01:55:29.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:29.925+0000 7f506affd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505c008de0 con 0x7f505c006b00 2023-11-04T01:55:29.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:29.925+0000 7f507d191640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:29.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:29.925+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c006b00 msgr2=0x7f505c014560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:29.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:29.925+0000 7f507d992640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 msgr2=0x7f505c013ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:29.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:29.925+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c006b00 0x7f505c014560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:29.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:29.925+0000 7f507d992640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 0x7f505c013ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:30.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:30.126+0000 7f507d191640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:30.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:30.126+0000 7f507d992640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 msgr2=0x7f505c013ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:30.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:30.126+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c006b00 msgr2=0x7f505c014560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:30.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:30.126+0000 7f507d992640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 0x7f505c013ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:30.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:30.126+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c006b00 0x7f505c014560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:30.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:30.527+0000 7f507d191640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:30.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:30.527+0000 7f507d992640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 msgr2=0x7f505c013ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:30.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:30.527+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c006b00 msgr2=0x7f505c014560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:30.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:30.527+0000 7f507d992640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 0x7f505c013ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:30.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:30.527+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c006b00 0x7f505c014560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:31.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:31.328+0000 7f507d191640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:31.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:31.328+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c006b00 msgr2=0x7f505c014560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:31.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:31.328+0000 7f507d992640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 msgr2=0x7f505c013ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:31.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:31.328+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c006b00 0x7f505c014560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:31.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:31.328+0000 7f507d992640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 0x7f505c013ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:32.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:32.926+0000 7f506affd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c006b00 msgr2=0x7f505c014560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:32.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:32.926+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c006b00 0x7f505c014560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:32.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:32.926+0000 7f506affd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 msgr2=0x7f505c013ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:32.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:32.926+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 0x7f505c013ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:32.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:32.926+0000 7f506affd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:32.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:32.926+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c010a10 0x7f505c007ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:32.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:32.926+0000 7f506affd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780b4750 con 0x7f505c011220 2023-11-04T01:55:32.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:32.926+0000 7f506affd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c010a10 2023-11-04T01:55:32.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:32.926+0000 7f507c990640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c010a10 msgr2=0x7f505c007ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:32.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:32.926+0000 7f507c990640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c010a10 0x7f505c007ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:32.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:32.926+0000 7f507d191640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c011220 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:33.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:33.127+0000 7f507c990640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c010a10 msgr2=0x7f505c007ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:33.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:33.127+0000 7f507c990640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c010a10 0x7f505c007ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:33.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:33.127+0000 7f507d191640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c011220 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:33.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:33.528+0000 7f507c990640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c010a10 msgr2=0x7f505c007ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:33.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:33.528+0000 7f507c990640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c010a10 0x7f505c007ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:33.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:33.528+0000 7f507d191640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c011220 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:33.803 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:55:33.806 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:55:34.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:34.329+0000 7f507c990640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c010a10 msgr2=0x7f505c007ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:34.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:34.329+0000 7f507c990640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c010a10 0x7f505c007ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:34.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:34.329+0000 7f507d191640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c011220 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:35.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:35.926+0000 7f506affd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c010a10 msgr2=0x7f505c007ef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:35.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:35.926+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c010a10 0x7f505c007ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:35.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:35.926+0000 7f506affd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c011220 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:35.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:35.926+0000 7f507d992640 1 -- reap_dead start 2023-11-04T01:55:35.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:35.926+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c0116a0 0x7f505c014180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:35.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:35.926+0000 7f506affd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780cee10 con 0x7f505c0065a0 2023-11-04T01:55:35.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:35.926+0000 7f506affd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780b4750 con 0x7f505c0146c0 2023-11-04T01:55:35.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:35.926+0000 7f506affd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c0116a0 2023-11-04T01:55:35.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:35.926+0000 7f507d191640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:35.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:35.926+0000 7f507c990640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c014180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:35.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:35.926+0000 7f507c990640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c0116a0 0x7f505c014180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:35.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:35.926+0000 7f507d992640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c0146c0 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:36.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:36.127+0000 7f507d191640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:36.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:36.127+0000 7f507c990640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c014180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:36.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:36.127+0000 7f507d992640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c0146c0 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:36.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:36.127+0000 7f507c990640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c0116a0 0x7f505c014180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:36.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:36.528+0000 7f507d191640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:36.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:36.528+0000 7f507d992640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c0146c0 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:36.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:36.528+0000 7f507c990640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c014180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:36.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:36.528+0000 7f507c990640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c0116a0 0x7f505c014180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:37.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:37.329+0000 7f507d191640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:37.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:37.329+0000 7f507d992640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c0146c0 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:37.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:37.329+0000 7f507c990640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c014180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:37.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:37.329+0000 7f507c990640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c0116a0 0x7f505c014180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:38.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:38.926+0000 7f506affd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c014180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:38.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:38.926+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c0116a0 0x7f505c014180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:38.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:38.926+0000 7f506affd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c0146c0 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:38.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:38.926+0000 7f506affd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:38.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:38.926+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c010a10 0x7f505c013ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:38.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:38.926+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c007b10 0x7f505c00ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:38.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:38.926+0000 7f506affd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c010a10 2023-11-04T01:55:38.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:38.926+0000 7f506affd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505c008de0 con 0x7f505c007b10 2023-11-04T01:55:38.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:38.926+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c010a10 msgr2=0x7f505c013ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:38.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:38.926+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c010a10 0x7f505c013ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:38.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:38.926+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c007b10 msgr2=0x7f505c00ccc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:38.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:38.926+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c007b10 0x7f505c00ccc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:39.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:39.127+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c010a10 msgr2=0x7f505c013ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:39.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:39.127+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c010a10 0x7f505c013ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:39.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:39.127+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c007b10 msgr2=0x7f505c00ccc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:39.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:39.127+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c007b10 0x7f505c00ccc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:39.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:39.528+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c010a10 msgr2=0x7f505c013ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:39.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:39.528+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c010a10 0x7f505c013ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:39.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:39.528+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c007b10 msgr2=0x7f505c00ccc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:39.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:39.528+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c007b10 0x7f505c00ccc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:40.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:40.329+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c010a10 msgr2=0x7f505c013ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:40.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:40.329+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c010a10 0x7f505c013ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:40.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:40.329+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c007b10 msgr2=0x7f505c00ccc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:40.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:40.329+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c007b10 0x7f505c00ccc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:41.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:41.927+0000 7f506affd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c007b10 msgr2=0x7f505c00ccc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:41.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:41.927+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c007b10 0x7f505c00ccc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:41.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:41.927+0000 7f506affd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c010a10 msgr2=0x7f505c013ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:41.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:41.927+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c010a10 0x7f505c013ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:41.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:41.927+0000 7f507d992640 1 -- reap_dead start 2023-11-04T01:55:41.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:41.927+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c014180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:41.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:41.927+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c0146c0 0x7f505c00c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:41.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:41.927+0000 7f506affd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780b32b0 con 0x7f505c0065a0 2023-11-04T01:55:41.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:41.927+0000 7f506affd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c0116a0 2023-11-04T01:55:41.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:41.927+0000 7f506affd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008de0 con 0x7f505c0146c0 2023-11-04T01:55:41.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:41.927+0000 7f507c990640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c014180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:41.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:41.927+0000 7f507d191640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:41.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:41.927+0000 7f507c990640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c014180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:41.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:41.927+0000 7f507d992640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c0146c0 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:41.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:41.927+0000 7f507d992640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c0146c0 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:42.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:42.128+0000 7f507c990640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c014180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:42.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:42.128+0000 7f507d191640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:42.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:42.128+0000 7f507c990640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c014180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:42.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:42.128+0000 7f507d992640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c0146c0 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:42.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:42.128+0000 7f507d992640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c0146c0 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:42.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:42.529+0000 7f507c990640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c014180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:42.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:42.529+0000 7f507d191640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:42.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:42.529+0000 7f507c990640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c014180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:42.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:42.529+0000 7f507d992640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c0146c0 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:42.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:42.529+0000 7f507d992640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c0146c0 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:43.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:43.330+0000 7f507d191640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:43.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:43.330+0000 7f507c990640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c014180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:43.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:43.330+0000 7f507c990640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c014180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:43.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:43.330+0000 7f507d992640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c0146c0 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:43.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:43.330+0000 7f507d992640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c0146c0 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:44.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:44.927+0000 7f506affd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c0146c0 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:44.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:44.927+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c0146c0 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:44.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:44.927+0000 7f506affd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c014180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:44.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:44.927+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c014180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:44.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:44.927+0000 7f506affd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:44.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:44.927+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00caf0 0x7f505c013ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:44.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:44.927+0000 7f506affd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780cee10 con 0x7f505c006a70 2023-11-04T01:55:44.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:44.927+0000 7f506affd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c00caf0 2023-11-04T01:55:44.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:44.927+0000 7f507c990640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c006a70 legacy=0x7f505c006f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:44.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:44.927+0000 7f507d191640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00caf0 msgr2=0x7f505c013ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:44.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:44.927+0000 7f507d191640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00caf0 0x7f505c013ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:45.128+0000 7f507c990640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c006a70 legacy=0x7f505c006f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:45.128+0000 7f507d191640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00caf0 msgr2=0x7f505c013ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:45.128+0000 7f507d191640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00caf0 0x7f505c013ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:45.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:45.529+0000 7f507d191640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00caf0 msgr2=0x7f505c013ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:45.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:45.529+0000 7f507c990640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c006a70 legacy=0x7f505c006f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:45.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:45.529+0000 7f507d191640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00caf0 0x7f505c013ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:46.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:46.329+0000 7f507d191640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00caf0 msgr2=0x7f505c013ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:46.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:46.329+0000 7f507c990640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c006a70 legacy=0x7f505c006f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:46.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:46.329+0000 7f507d191640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00caf0 0x7f505c013ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:47.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:47.927+0000 7f506affd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00caf0 msgr2=0x7f505c013ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:47.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:47.927+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00caf0 0x7f505c013ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:47.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:47.927+0000 7f506affd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c006a70 legacy=0x7f505c006f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:47.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:47.927+0000 7f507d992640 1 -- reap_dead start 2023-11-04T01:55:47.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:47.927+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c00dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:47.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:47.927+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 0x7f505c006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:47.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:47.927+0000 7f506affd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780b32b0 con 0x7f505c0065a0 2023-11-04T01:55:47.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:47.927+0000 7f506affd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c0116a0 2023-11-04T01:55:47.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:47.927+0000 7f506affd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008de0 con 0x7f505c014180 2023-11-04T01:55:47.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:47.927+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:47.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:47.927+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:47.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:47.927+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c00dd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:47.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:47.927+0000 7f507d992640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 msgr2=0x7f505c006ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:47.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:47.927+0000 7f507d992640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 0x7f505c006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:48.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:48.128+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:48.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:48.128+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:48.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:48.128+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c00dd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:48.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:48.128+0000 7f507d992640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 msgr2=0x7f505c006ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:48.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:48.128+0000 7f507d992640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 0x7f505c006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:48.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:48.529+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:48.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:48.529+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:48.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:48.529+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c00dd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:48.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:48.529+0000 7f507d992640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 msgr2=0x7f505c006ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:48.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:48.529+0000 7f507d992640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 0x7f505c006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:49.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:49.330+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:49.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:49.330+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:49.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:49.330+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c00dd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:49.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:49.330+0000 7f507d992640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 msgr2=0x7f505c006ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:49.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:49.330+0000 7f507d992640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 0x7f505c006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:50.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:50.927+0000 7f506affd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 msgr2=0x7f505c006ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:50.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:50.927+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 0x7f505c006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:50.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:50.927+0000 7f506affd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:50.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:50.927+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c00dd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:50.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:50.927+0000 7f506affd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:50.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:50.927+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014630 0x7f505c013ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:50.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:50.927+0000 7f506affd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780cee10 con 0x7f505c0073e0 2023-11-04T01:55:50.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:50.927+0000 7f506affd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c014630 2023-11-04T01:55:50.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:50.927+0000 7f507c990640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c0073e0 legacy=0x7f505c0077f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:50.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:50.927+0000 7f507d191640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014630 msgr2=0x7f505c013ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:50.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:50.927+0000 7f507d191640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014630 0x7f505c013ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:51.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:51.128+0000 7f507d191640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014630 msgr2=0x7f505c013ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:51.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:51.128+0000 7f507c990640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c0073e0 legacy=0x7f505c0077f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:51.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:51.128+0000 7f507d191640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014630 0x7f505c013ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:51.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:51.529+0000 7f507c990640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c0073e0 legacy=0x7f505c0077f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:51.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:51.529+0000 7f507d191640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014630 msgr2=0x7f505c013ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:51.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:51.529+0000 7f507d191640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014630 0x7f505c013ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:52.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:52.331+0000 7f507d191640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014630 msgr2=0x7f505c013ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:52.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:52.331+0000 7f507c990640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c0073e0 legacy=0x7f505c0077f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:52.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:52.331+0000 7f507d191640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014630 0x7f505c013ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:53.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:53.927+0000 7f506affd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014630 msgr2=0x7f505c013ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:53.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:53.927+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014630 0x7f505c013ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:53.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:53.927+0000 7f506affd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c0073e0 legacy=0x7f505c0077f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:53.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:53.927+0000 7f507d992640 1 -- reap_dead start 2023-11-04T01:55:53.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:53.927+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0065a0 0x7f505c006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:53.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:53.927+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 0x7f505c00dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:53.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:53.927+0000 7f506affd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780b32b0 con 0x7f505c0116a0 2023-11-04T01:55:53.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:53.927+0000 7f506affd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c014180 2023-11-04T01:55:53.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:53.927+0000 7f506affd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505c008de0 con 0x7f505c0065a0 2023-11-04T01:55:53.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:53.928+0000 7f507d992640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 msgr2=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:53.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:53.928+0000 7f507c990640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c0116a0 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:53.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:53.928+0000 7f507d191640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0065a0 msgr2=0x7f505c006ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:53.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:53.928+0000 7f507d992640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 0x7f505c00dd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:53.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:53.928+0000 7f507d191640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0065a0 0x7f505c006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:54.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:54.129+0000 7f507d992640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 msgr2=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:54.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:54.129+0000 7f507d191640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0065a0 msgr2=0x7f505c006ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:54.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:54.129+0000 7f507d992640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 0x7f505c00dd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:54.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:54.129+0000 7f507d191640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0065a0 0x7f505c006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:54.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:54.129+0000 7f507c990640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c0116a0 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:54.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:54.530+0000 7f507d191640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0065a0 msgr2=0x7f505c006ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:54.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:54.530+0000 7f507c990640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c0116a0 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:54.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:54.530+0000 7f507d992640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 msgr2=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:54.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:54.530+0000 7f507d191640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0065a0 0x7f505c006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:54.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:54.530+0000 7f507d992640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 0x7f505c00dd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:55.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:55.331+0000 7f507d992640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 msgr2=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:55.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:55.331+0000 7f507d191640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0065a0 msgr2=0x7f505c006ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:55:55.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:55.331+0000 7f507c990640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c0116a0 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:55:55.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:55.331+0000 7f507d992640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 0x7f505c00dd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:55.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:55.331+0000 7f507d191640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0065a0 0x7f505c006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:56.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:56.928+0000 7f506affd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0065a0 msgr2=0x7f505c006ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:56.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:56.928+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0065a0 0x7f505c006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:56.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:56.928+0000 7f506affd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 msgr2=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:56.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:56.928+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 0x7f505c00dd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:56.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:56.928+0000 7f506affd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c0116a0 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:56.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:56.928+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0077c0 0x7f505c013ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:56.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:56.928+0000 7f506affd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780cee10 con 0x7f505c007ba0 2023-11-04T01:55:56.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:56.928+0000 7f506affd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c0077c0 2023-11-04T01:55:56.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:56.928+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c007ba0 legacy=0x7f505c0171a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:56.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:56.928+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0077c0 msgr2=0x7f505c013ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:56.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:56.928+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0077c0 0x7f505c013ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:57.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:57.129+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0077c0 msgr2=0x7f505c013ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:57.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:57.129+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c007ba0 legacy=0x7f505c0171a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:57.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:57.129+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0077c0 0x7f505c013ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:57.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:57.530+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c007ba0 legacy=0x7f505c0171a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:57.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:57.530+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0077c0 msgr2=0x7f505c013ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:57.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:57.530+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0077c0 0x7f505c013ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:58.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:58.331+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0077c0 msgr2=0x7f505c013ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:58.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:58.331+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c007ba0 legacy=0x7f505c0171a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:58.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:58.331+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0077c0 0x7f505c013ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:59.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:59.928+0000 7f506affd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0077c0 msgr2=0x7f505c013ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:59.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:59.928+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0077c0 0x7f505c013ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:59.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:59.928+0000 7f506affd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c007ba0 legacy=0x7f505c0171a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:59.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:59.928+0000 7f507d992640 1 -- reap_dead start 2023-11-04T01:55:59.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:59.928+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:59.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:59.928+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 0x7f505c00dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:59.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:59.928+0000 7f506affd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780b32b0 con 0x7f505c0065a0 2023-11-04T01:55:59.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:59.928+0000 7f506affd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c0116a0 2023-11-04T01:55:59.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:59.928+0000 7f506affd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008de0 con 0x7f505c014180 2023-11-04T01:55:59.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:59.928+0000 7f507d992640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:55:59.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:59.928+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c006ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:55:59.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:59.928+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:59.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:59.928+0000 7f507c990640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 msgr2=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:55:59.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:55:59.928+0000 7f507c990640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 0x7f505c00dd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:00.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:00.129+0000 7f507d992640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:00.129+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c006ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:00.129+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:00.129+0000 7f507c990640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 msgr2=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:00.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:00.129+0000 7f507c990640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 0x7f505c00dd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:00.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:00.530+0000 7f507d992640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:00.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:00.530+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c006ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:00.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:00.530+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:00.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:00.530+0000 7f507c990640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 msgr2=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:00.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:00.530+0000 7f507c990640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 0x7f505c00dd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:01.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:01.331+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c006ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:01.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:01.331+0000 7f507d992640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:01.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:01.331+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:01.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:01.331+0000 7f507c990640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 msgr2=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:01.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:01.331+0000 7f507c990640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 0x7f505c00dd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:02.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:02.928+0000 7f506affd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 msgr2=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:02.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:02.928+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 0x7f505c00dd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:02.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:02.928+0000 7f506affd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c006ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:02.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:02.928+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:02.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:02.928+0000 7f506affd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:02.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:02.928+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c013ac0 0x7f505c0188c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:02.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:02.928+0000 7f506affd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780cee10 con 0x7f505c007f80 2023-11-04T01:56:02.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:02.928+0000 7f506affd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c013ac0 2023-11-04T01:56:02.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:02.928+0000 7f507d191640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c007f80 legacy=0x7f505c015190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:02.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:02.928+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c013ac0 msgr2=0x7f505c0188c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:02.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:02.928+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c013ac0 0x7f505c0188c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:03.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:03.129+0000 7f507d191640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c007f80 legacy=0x7f505c015190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:03.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:03.129+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c013ac0 msgr2=0x7f505c0188c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:03.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:03.129+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c013ac0 0x7f505c0188c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:03.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:03.530+0000 7f507d191640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c007f80 legacy=0x7f505c015190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:03.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:03.530+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c013ac0 msgr2=0x7f505c0188c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:03.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:03.530+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c013ac0 0x7f505c0188c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:03.867 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:56:03.870 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:56:04.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:04.331+0000 7f507d191640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c007f80 legacy=0x7f505c015190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:04.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:04.331+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c013ac0 msgr2=0x7f505c0188c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:04.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:04.331+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c013ac0 0x7f505c0188c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:05.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:05.929+0000 7f506affd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c013ac0 msgr2=0x7f505c0188c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:05.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:05.929+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c013ac0 0x7f505c0188c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:05.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:05.929+0000 7f506affd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c007f80 legacy=0x7f505c015190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:05.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:05.929+0000 7f507d992640 1 -- reap_dead start 2023-11-04T01:56:05.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:05.929+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0065a0 0x7f505c006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:05.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:05.929+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 0x7f505c00dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:05.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:05.929+0000 7f506affd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780b32b0 con 0x7f505c0116a0 2023-11-04T01:56:05.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:05.929+0000 7f506affd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c0065a0 2023-11-04T01:56:05.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:05.929+0000 7f506affd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008de0 con 0x7f505c014180 2023-11-04T01:56:05.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:05.929+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0065a0 msgr2=0x7f505c006ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:05.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:05.929+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0065a0 0x7f505c006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:05.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:05.929+0000 7f507c990640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c0116a0 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:05.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:05.929+0000 7f507d992640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 msgr2=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:05.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:05.929+0000 7f507d992640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 0x7f505c00dd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:06.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:06.130+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0065a0 msgr2=0x7f505c006ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:06.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:06.130+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0065a0 0x7f505c006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:06.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:06.130+0000 7f507d992640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 msgr2=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:06.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:06.130+0000 7f507c990640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c0116a0 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:06.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:06.130+0000 7f507d992640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 0x7f505c00dd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:06.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:06.531+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0065a0 msgr2=0x7f505c006ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:06.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:06.531+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0065a0 0x7f505c006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:06.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:06.531+0000 7f507d992640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 msgr2=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:06.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:06.531+0000 7f507c990640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c0116a0 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:06.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:06.531+0000 7f507d992640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 0x7f505c00dd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:07.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:07.332+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0065a0 msgr2=0x7f505c006ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:07.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:07.332+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0065a0 0x7f505c006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:07.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:07.332+0000 7f507d992640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 msgr2=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:07.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:07.332+0000 7f507c990640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c0116a0 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:07.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:07.332+0000 7f507d992640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 0x7f505c00dd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:08.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:08.929+0000 7f506affd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 msgr2=0x7f505c00dd40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:08.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:08.929+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c014180 0x7f505c00dd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:08.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:08.929+0000 7f506affd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0065a0 msgr2=0x7f505c006ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:08.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:08.929+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0065a0 0x7f505c006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:08.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:08.929+0000 7f506affd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c0116a0 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:08.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:08.929+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c011ab0 0x7f505c00cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:08.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:08.929+0000 7f506affd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780cee10 con 0x7f505c015080 2023-11-04T01:56:08.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:08.929+0000 7f506affd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c011ab0 2023-11-04T01:56:08.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:08.929+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c015080 legacy=0x7f505c017470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:08.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:08.929+0000 7f507d191640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c011ab0 msgr2=0x7f505c00cff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:08.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:08.929+0000 7f507d191640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c011ab0 0x7f505c00cff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:09.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:09.130+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c015080 legacy=0x7f505c017470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:09.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:09.130+0000 7f507d191640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c011ab0 msgr2=0x7f505c00cff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:09.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:09.130+0000 7f507d191640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c011ab0 0x7f505c00cff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:09.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:09.531+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c015080 legacy=0x7f505c017470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:09.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:09.531+0000 7f507d191640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c011ab0 msgr2=0x7f505c00cff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:09.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:09.531+0000 7f507d191640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c011ab0 0x7f505c00cff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:10.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:10.332+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c015080 legacy=0x7f505c017470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:10.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:10.332+0000 7f507d191640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c011ab0 msgr2=0x7f505c00cff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:10.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:10.332+0000 7f507d191640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c011ab0 0x7f505c00cff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:11.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:11.929+0000 7f506affd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c011ab0 msgr2=0x7f505c00cff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:11.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:11.929+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c011ab0 0x7f505c00cff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:11.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:11.929+0000 7f506affd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c015080 legacy=0x7f505c017470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:11.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:11.929+0000 7f507d992640 1 -- reap_dead start 2023-11-04T01:56:11.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:11.929+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:11.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:11.929+0000 7f506affd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780b32b0 con 0x7f505c0065a0 2023-11-04T01:56:11.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:11.929+0000 7f506affd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780cee10 con 0x7f505c014180 2023-11-04T01:56:11.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:11.929+0000 7f506affd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c0116a0 2023-11-04T01:56:11.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:11.929+0000 7f507d992640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c011ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:11.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:11.929+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c006ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:11.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:11.929+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:11.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:11.930+0000 7f507c990640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c014180 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:12.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:12.130+0000 7f507d992640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c011ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:12.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:12.130+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c006ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:12.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:12.130+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:12.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:12.131+0000 7f507c990640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c014180 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:12.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:12.531+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c006ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:12.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:12.531+0000 7f507d992640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c011ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:12.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:12.531+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:12.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:12.532+0000 7f507c990640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c014180 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:13.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:13.332+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c006ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:13.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:13.332+0000 7f507d992640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c011ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:13.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:13.332+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:13.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:13.333+0000 7f507c990640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c014180 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:14.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:14.930+0000 7f506affd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c006ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:14.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:14.930+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:14.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:14.930+0000 7f506affd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c014180 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:14.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:14.930+0000 7f506affd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c011ab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:14.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:14.930+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c00dd40 0x7f505c00cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:14.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:14.930+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0131d0 0x7f505c019480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:14.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:14.930+0000 7f506affd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c00dd40 2023-11-04T01:56:14.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:14.930+0000 7f506affd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505c008de0 con 0x7f505c0131d0 2023-11-04T01:56:14.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:14.930+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0131d0 msgr2=0x7f505c019480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:14.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:14.930+0000 7f507d191640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c00dd40 msgr2=0x7f505c00cfc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:14.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:14.930+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0131d0 0x7f505c019480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:14.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:14.930+0000 7f507d191640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c00dd40 0x7f505c00cfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:15.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:15.131+0000 7f507d191640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c00dd40 msgr2=0x7f505c00cfc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:15.131+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0131d0 msgr2=0x7f505c019480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:15.131+0000 7f507d191640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c00dd40 0x7f505c00cfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:15.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:15.131+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0131d0 0x7f505c019480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:15.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:15.532+0000 7f507d191640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c00dd40 msgr2=0x7f505c00cfc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:15.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:15.532+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0131d0 msgr2=0x7f505c019480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:15.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:15.532+0000 7f507d191640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c00dd40 0x7f505c00cfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:15.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:15.532+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0131d0 0x7f505c019480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:16.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:16.333+0000 7f507d191640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c00dd40 msgr2=0x7f505c00cfc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:16.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:16.333+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0131d0 msgr2=0x7f505c019480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:16.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:16.333+0000 7f507d191640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c00dd40 0x7f505c00cfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:16.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:16.333+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0131d0 0x7f505c019480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:17.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:17.930+0000 7f506affd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0131d0 msgr2=0x7f505c019480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:17.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:17.930+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0131d0 0x7f505c019480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:17.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:17.930+0000 7f506affd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c00dd40 msgr2=0x7f505c00cfc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:17.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:17.930+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c00dd40 0x7f505c00cfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:17.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:17.930+0000 7f507d992640 1 -- reap_dead start 2023-11-04T01:56:17.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:17.930+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014180 0x7f505c006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:17.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:17.930+0000 7f506affd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780b4750 con 0x7f505c0116a0 2023-11-04T01:56:17.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:17.930+0000 7f506affd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780b32b0 con 0x7f505c0065a0 2023-11-04T01:56:17.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:17.930+0000 7f506affd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c014180 2023-11-04T01:56:17.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:17.930+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c0116a0 legacy=0x7f505c00e970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:17.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:17.930+0000 7f507d992640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014180 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:17.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:17.930+0000 7f507d992640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014180 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:17.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:17.930+0000 7f507d191640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:18.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:18.131+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c0116a0 legacy=0x7f505c00e970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:18.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:18.131+0000 7f507d992640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014180 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:18.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:18.131+0000 7f507d191640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:18.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:18.131+0000 7f507d992640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014180 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:18.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:18.532+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c0116a0 legacy=0x7f505c00e970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:18.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:18.532+0000 7f507d992640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014180 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:18.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:18.532+0000 7f507d992640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014180 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:18.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:18.532+0000 7f507d191640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:19.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:19.333+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c0116a0 legacy=0x7f505c00e970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:19.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:19.333+0000 7f507d191640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:19.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:19.333+0000 7f507d992640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014180 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:19.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:19.333+0000 7f507d992640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014180 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:20.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:20.931+0000 7f506affd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014180 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:20.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:20.931+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014180 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:20.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:20.931+0000 7f506affd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c0065a0 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:20.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:20.931+0000 7f506affd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c0116a0 legacy=0x7f505c00e970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:20.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:20.931+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c00dd40 0x7f505c00cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:20.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:20.931+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c013ac0 0x7f505c019480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:20.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:20.931+0000 7f506affd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c00dd40 2023-11-04T01:56:20.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:20.931+0000 7f506affd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008de0 con 0x7f505c013ac0 2023-11-04T01:56:20.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:20.931+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c00dd40 msgr2=0x7f505c00cfc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:20.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:20.931+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c00dd40 0x7f505c00cfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:20.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:20.931+0000 7f507c990640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c013ac0 msgr2=0x7f505c019480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:20.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:20.931+0000 7f507c990640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c013ac0 0x7f505c019480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:21.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:21.132+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c00dd40 msgr2=0x7f505c00cfc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:21.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:21.132+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c00dd40 0x7f505c00cfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:21.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:21.132+0000 7f507c990640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c013ac0 msgr2=0x7f505c019480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:21.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:21.132+0000 7f507c990640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c013ac0 0x7f505c019480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:21.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:21.533+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c00dd40 msgr2=0x7f505c00cfc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:21.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:21.533+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c00dd40 0x7f505c00cfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:21.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:21.533+0000 7f507c990640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c013ac0 msgr2=0x7f505c019480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:21.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:21.533+0000 7f507c990640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c013ac0 0x7f505c019480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:22.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:22.334+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c00dd40 msgr2=0x7f505c00cfc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:22.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:22.334+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c00dd40 0x7f505c00cfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:22.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:22.334+0000 7f507c990640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c013ac0 msgr2=0x7f505c019480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:22.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:22.334+0000 7f507c990640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c013ac0 0x7f505c019480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:23.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:23.931+0000 7f506affd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c013ac0 msgr2=0x7f505c019480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:23.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:23.931+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c013ac0 0x7f505c019480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:23.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:23.931+0000 7f506affd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c00dd40 msgr2=0x7f505c00cfc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:23.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:23.931+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c00dd40 0x7f505c00cfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:23.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:23.931+0000 7f507d992640 1 -- reap_dead start 2023-11-04T01:56:23.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:23.931+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0116a0 0x7f505c006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:23.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:23.931+0000 7f506affd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780cee10 con 0x7f505c014180 2023-11-04T01:56:23.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:23.931+0000 7f506affd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780b4750 con 0x7f505c00dd40 2023-11-04T01:56:23.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:23.931+0000 7f506affd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c0116a0 2023-11-04T01:56:23.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:23.931+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c014180 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:23.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:23.931+0000 7f507d992640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c00dd40 legacy=0x7f505c011ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:23.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:23.931+0000 7f507d191640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0116a0 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:23.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:23.931+0000 7f507d191640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0116a0 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:24.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:24.132+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c014180 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:24.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:24.132+0000 7f507d992640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c00dd40 legacy=0x7f505c011ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:24.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:24.132+0000 7f507d191640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0116a0 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:24.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:24.132+0000 7f507d191640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0116a0 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:24.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:24.533+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c014180 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:24.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:24.533+0000 7f507d191640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0116a0 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:24.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:24.533+0000 7f507d992640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c00dd40 legacy=0x7f505c011ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:24.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:24.533+0000 7f507d191640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0116a0 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:25.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:25.334+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c014180 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:25.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:25.334+0000 7f507d992640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c00dd40 legacy=0x7f505c011ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:25.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:25.334+0000 7f507d191640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0116a0 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:25.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:25.334+0000 7f507d191640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0116a0 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:26.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:26.931+0000 7f506affd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0116a0 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:26.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:26.931+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0116a0 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:26.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:26.931+0000 7f506affd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c00dd40 legacy=0x7f505c011ab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:26.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:26.931+0000 7f506affd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c014180 legacy=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:26.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:26.931+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c00cfa0 0x7f505c0131d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:26.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:26.931+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c013710 0x7f505c019480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:26.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:26.931+0000 7f506affd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c013710 2023-11-04T01:56:26.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:26.931+0000 7f506affd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008de0 con 0x7f505c00cfa0 2023-11-04T01:56:26.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:26.931+0000 7f507c990640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c013710 msgr2=0x7f505c019480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:26.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:26.931+0000 7f507c990640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c013710 0x7f505c019480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:26.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:26.931+0000 7f507d191640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c00cfa0 msgr2=0x7f505c0131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:26.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:26.931+0000 7f507d191640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c00cfa0 0x7f505c0131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:27.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:27.132+0000 7f507c990640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c013710 msgr2=0x7f505c019480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:27.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:27.132+0000 7f507c990640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c013710 0x7f505c019480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:27.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:27.132+0000 7f507d191640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c00cfa0 msgr2=0x7f505c0131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:27.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:27.132+0000 7f507d191640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c00cfa0 0x7f505c0131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:27.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:27.533+0000 7f507c990640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c013710 msgr2=0x7f505c019480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:27.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:27.533+0000 7f507c990640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c013710 0x7f505c019480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:27.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:27.533+0000 7f507d191640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c00cfa0 msgr2=0x7f505c0131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:27.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:27.533+0000 7f507d191640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c00cfa0 0x7f505c0131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:28.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:28.334+0000 7f507c990640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c013710 msgr2=0x7f505c019480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:28.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:28.334+0000 7f507c990640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c013710 0x7f505c019480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:28.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:28.334+0000 7f507d191640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c00cfa0 msgr2=0x7f505c0131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:28.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:28.334+0000 7f507d191640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c00cfa0 0x7f505c0131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:29.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:29.931+0000 7f506affd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c00cfa0 msgr2=0x7f505c0131d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:29.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:29.931+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c00cfa0 0x7f505c0131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:29.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:29.931+0000 7f506affd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c013710 msgr2=0x7f505c019480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:29.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:29.931+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c013710 0x7f505c019480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:29.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:29.931+0000 7f507d992640 1 -- reap_dead start 2023-11-04T01:56:29.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:29.931+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c00cfa0 0x7f505c006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:29.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:29.931+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 0x7f505c00c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:29.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:29.931+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c00b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:29.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:29.931+0000 7f506affd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c0116a0 2023-11-04T01:56:29.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:29.931+0000 7f506affd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008de0 con 0x7f505c00cfa0 2023-11-04T01:56:29.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:29.931+0000 7f506affd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505c00caf0 con 0x7f505c00dd40 2023-11-04T01:56:29.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:29.931+0000 7f507d992640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c00b110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:29.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:29.931+0000 7f507d992640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c00b110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:29.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:29.931+0000 7f507d191640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c00cfa0 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:29.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:29.931+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:29.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:29.931+0000 7f507d191640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c00cfa0 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:29.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:29.931+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:30.132+0000 7f507d992640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c00b110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:30.132+0000 7f507d992640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c00b110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:30.132+0000 7f507d191640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c00cfa0 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:30.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:30.132+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:30.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:30.132+0000 7f507d191640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c00cfa0 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:30.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:30.132+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:30.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:30.533+0000 7f507d992640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c00b110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:30.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:30.533+0000 7f507d992640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c00b110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:30.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:30.533+0000 7f507d191640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c00cfa0 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:30.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:30.533+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:30.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:30.533+0000 7f507d191640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c00cfa0 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:30.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:30.533+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:31.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:31.334+0000 7f507d992640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c00b110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:31.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:31.334+0000 7f507d992640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c00b110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:31.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:31.334+0000 7f507d191640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c00cfa0 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:31.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:31.334+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:31.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:31.334+0000 7f507d191640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c00cfa0 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:31.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:31.334+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:32.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:32.931+0000 7f506affd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:32.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:32.931+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:32.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:32.931+0000 7f506affd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c00cfa0 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:32.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:32.931+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c00cfa0 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:32.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:32.931+0000 7f506affd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c00b110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:32.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:32.931+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c00b110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:32.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:32.931+0000 7f506affd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780b32b0 con 0x7f505c013af0 2023-11-04T01:56:32.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:32.931+0000 7f506affd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780cee10 con 0x7f505c014180 2023-11-04T01:56:32.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:32.931+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c013af0 legacy=0x7f505c012ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:32.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:32.931+0000 7f507d191640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c014180 legacy=0x7f505c00b650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:33.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:33.132+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c013af0 legacy=0x7f505c012ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:33.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:33.132+0000 7f507d191640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c014180 legacy=0x7f505c00b650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:33.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:33.533+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c013af0 legacy=0x7f505c012ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:33.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:33.533+0000 7f507d191640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c014180 legacy=0x7f505c00b650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:34.239 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:56:34.243 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:56:34.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:34.334+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c013af0 legacy=0x7f505c012ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:34.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:34.334+0000 7f507d191640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c014180 legacy=0x7f505c00b650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:35.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:35.931+0000 7f506affd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c014180 legacy=0x7f505c00b650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:35.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:35.931+0000 7f506affd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c013af0 legacy=0x7f505c012ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:35.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:35.931+0000 7f507d992640 1 -- reap_dead start 2023-11-04T01:56:35.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:35.931+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c00c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:35.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:35.931+0000 7f506affd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780b4750 con 0x7f505c00cfa0 2023-11-04T01:56:35.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:35.931+0000 7f506affd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780b32b0 con 0x7f505c014180 2023-11-04T01:56:35.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:35.931+0000 7f506affd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c0116a0 2023-11-04T01:56:35.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:35.931+0000 7f507c990640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:35.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:35.931+0000 7f507c990640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:35.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:35.931+0000 7f507d191640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c00cfa0 legacy=0x7f505c00b110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:35.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:35.931+0000 7f507d992640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c014180 legacy=0x7f505c00b820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:36.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:36.132+0000 7f507d191640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c00cfa0 legacy=0x7f505c00b110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:36.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:36.132+0000 7f507c990640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:36.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:36.132+0000 7f507c990640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:36.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:36.132+0000 7f507d992640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c014180 legacy=0x7f505c00b820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:36.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:36.533+0000 7f507c990640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:36.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:36.533+0000 7f507d191640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c00cfa0 legacy=0x7f505c00b110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:36.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:36.533+0000 7f507c990640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:36.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:36.533+0000 7f507d992640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c014180 legacy=0x7f505c00b820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:37.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:37.335+0000 7f507c990640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:37.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:37.335+0000 7f507d191640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c00cfa0 legacy=0x7f505c00b110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:37.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:37.335+0000 7f507c990640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:37.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:37.335+0000 7f507d992640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c014180 legacy=0x7f505c00b820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:38.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:38.932+0000 7f506affd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:38.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:38.932+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:38.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:38.932+0000 7f506affd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c014180 legacy=0x7f505c00b820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:38.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:38.932+0000 7f506affd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c00cfa0 legacy=0x7f505c00b110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:38.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:38.932+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 0x7f505c006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:38.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:38.932+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c006640 0x7f505c012ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:38.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:38.932+0000 7f506affd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c006640 2023-11-04T01:56:38.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:38.932+0000 7f506affd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505c008de0 con 0x7f505c00dd40 2023-11-04T01:56:38.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:38.932+0000 7f507d191640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:38.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:38.932+0000 7f507c990640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c006640 msgr2=0x7f505c012ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:38.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:38.932+0000 7f507d191640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:38.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:38.932+0000 7f507c990640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c006640 0x7f505c012ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:39.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:39.133+0000 7f507c990640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c006640 msgr2=0x7f505c012ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:39.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:39.133+0000 7f507d191640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:39.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:39.133+0000 7f507c990640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c006640 0x7f505c012ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:39.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:39.133+0000 7f507d191640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:39.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:39.534+0000 7f507c990640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c006640 msgr2=0x7f505c012ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:39.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:39.534+0000 7f507d191640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:39.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:39.534+0000 7f507c990640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c006640 0x7f505c012ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:39.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:39.534+0000 7f507d191640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:40.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:40.335+0000 7f507d191640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:40.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:40.335+0000 7f507c990640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c006640 msgr2=0x7f505c012ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:40.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:40.335+0000 7f507d191640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:40.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:40.335+0000 7f507c990640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c006640 0x7f505c012ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:41.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:41.932+0000 7f506affd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:41.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:41.932+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:41.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:41.932+0000 7f506affd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c006640 msgr2=0x7f505c012ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:41.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:41.932+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c006640 0x7f505c012ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:41.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:41.932+0000 7f507d992640 1 -- reap_dead start 2023-11-04T01:56:41.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:41.932+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c013000 0x7f505c01c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:41.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:41.932+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 0x7f505c006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:41.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:41.932+0000 7f506affd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780cee10 con 0x7f505c00cfa0 2023-11-04T01:56:41.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:41.932+0000 7f506affd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c013000 2023-11-04T01:56:41.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:41.932+0000 7f506affd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505c008de0 con 0x7f505c00dd40 2023-11-04T01:56:41.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:41.932+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c00cfa0 legacy=0x7f505c00b110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:41.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:41.932+0000 7f507d191640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c013000 msgr2=0x7f505c01c4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:41.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:41.932+0000 7f507d992640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:41.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:41.932+0000 7f507d992640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:41.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:41.932+0000 7f507d191640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c013000 0x7f505c01c4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:42.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:42.133+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c00cfa0 legacy=0x7f505c00b110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:42.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:42.133+0000 7f507d992640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:42.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:42.133+0000 7f507d191640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c013000 msgr2=0x7f505c01c4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:42.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:42.133+0000 7f507d992640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:42.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:42.133+0000 7f507d191640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c013000 0x7f505c01c4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:42.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:42.534+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c00cfa0 legacy=0x7f505c00b110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:42.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:42.534+0000 7f507d992640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:42.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:42.534+0000 7f507d992640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:42.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:42.534+0000 7f507d191640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c013000 msgr2=0x7f505c01c4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:42.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:42.534+0000 7f507d191640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c013000 0x7f505c01c4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:43.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:43.335+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c00cfa0 legacy=0x7f505c00b110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:43.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:43.335+0000 7f507d992640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:43.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:43.335+0000 7f507d191640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c013000 msgr2=0x7f505c01c4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:43.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:43.335+0000 7f507d992640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:43.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:43.335+0000 7f507d191640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c013000 0x7f505c01c4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:44.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:44.932+0000 7f506affd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:44.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:44.932+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:44.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:44.932+0000 7f506affd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c013000 msgr2=0x7f505c01c4a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:44.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:44.932+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c013000 0x7f505c01c4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:44.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:44.932+0000 7f506affd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c00cfa0 legacy=0x7f505c00b110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:44.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:44.932+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c00c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:44.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:44.932+0000 7f506affd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780b4750 con 0x7f505c006640 2023-11-04T01:56:44.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:44.932+0000 7f506affd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c0116a0 2023-11-04T01:56:44.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:44.932+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:44.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:44.932+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:44.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:44.932+0000 7f507c990640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c006640 legacy=0x7f505c00b820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:45.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:45.133+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:45.133+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:45.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:45.133+0000 7f507c990640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c006640 legacy=0x7f505c00b820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:45.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:45.534+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:45.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:45.534+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:45.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:45.534+0000 7f507c990640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c006640 legacy=0x7f505c00b820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:46.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:46.335+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:46.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:46.335+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:46.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:46.335+0000 7f507c990640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c006640 legacy=0x7f505c00b820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:47.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:47.932+0000 7f506affd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:47.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:47.932+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:47.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:47.932+0000 7f506affd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c006640 legacy=0x7f505c00b820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:47.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:47.932+0000 7f507d992640 1 -- reap_dead start 2023-11-04T01:56:47.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:47.932+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 0x7f505c006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:47.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:47.932+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c00c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:47.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:47.932+0000 7f506affd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780cee10 con 0x7f505c014180 2023-11-04T01:56:47.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:47.932+0000 7f506affd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c0116a0 2023-11-04T01:56:47.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:47.932+0000 7f506affd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505c008de0 con 0x7f505c00dd40 2023-11-04T01:56:47.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:47.932+0000 7f507d992640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:47.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:47.932+0000 7f507d992640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:47.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:47.933+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:47.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:47.933+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:47.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:47.933+0000 7f507d191640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c014180 legacy=0x7f505c01c9e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:48.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:48.133+0000 7f507d992640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:48.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:48.133+0000 7f507d992640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:48.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:48.134+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:48.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:48.134+0000 7f507d191640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c014180 legacy=0x7f505c01c9e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:48.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:48.134+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:48.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:48.534+0000 7f507d992640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:48.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:48.534+0000 7f507d992640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:48.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:48.535+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:48.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:48.535+0000 7f507d191640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c014180 legacy=0x7f505c01c9e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:48.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:48.535+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:49.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:49.335+0000 7f507d992640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:49.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:49.335+0000 7f507d992640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:49.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:49.336+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:49.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:49.336+0000 7f507d191640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c014180 legacy=0x7f505c01c9e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:49.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:49.336+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:50.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:50.933+0000 7f506affd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:50.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:50.933+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:50.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:50.933+0000 7f506affd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:50.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:50.933+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c0116a0 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:50.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:50.933+0000 7f506affd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c014180 legacy=0x7f505c01c9e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:50.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:50.933+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c00cf70 0x7f505c01c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:50.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:50.933+0000 7f506affd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780b4750 con 0x7f505c006620 2023-11-04T01:56:50.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:50.933+0000 7f506affd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c00cf70 2023-11-04T01:56:50.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:50.933+0000 7f507d191640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c006620 legacy=0x7f505c00b0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:50.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:50.933+0000 7f507c990640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c00cf70 msgr2=0x7f505c01c4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:50.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:50.933+0000 7f507c990640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c00cf70 0x7f505c01c4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:51.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:51.134+0000 7f507d191640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c006620 legacy=0x7f505c00b0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:51.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:51.134+0000 7f507c990640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c00cf70 msgr2=0x7f505c01c4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:51.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:51.134+0000 7f507c990640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c00cf70 0x7f505c01c4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:51.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:51.535+0000 7f507d191640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c006620 legacy=0x7f505c00b0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:51.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:51.535+0000 7f507c990640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c00cf70 msgr2=0x7f505c01c4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:51.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:51.535+0000 7f507c990640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c00cf70 0x7f505c01c4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:52.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:52.336+0000 7f507d191640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c006620 legacy=0x7f505c00b0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:52.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:52.336+0000 7f507c990640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c00cf70 msgr2=0x7f505c01c4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:52.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:52.336+0000 7f507c990640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c00cf70 0x7f505c01c4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:53.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:53.933+0000 7f506affd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c00cf70 msgr2=0x7f505c01c4a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:53.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:53.933+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c00cf70 0x7f505c01c4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:53.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:53.933+0000 7f506affd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c006620 legacy=0x7f505c00b0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:53.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:53.933+0000 7f507d992640 1 -- reap_dead start 2023-11-04T01:56:53.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:53.933+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 0x7f505c0131d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:53.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:53.933+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c0116a0 0x7f505c006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:53.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:53.933+0000 7f506affd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780cee10 con 0x7f505c00cf70 2023-11-04T01:56:53.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:53.933+0000 7f506affd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c0116a0 2023-11-04T01:56:53.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:53.933+0000 7f506affd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505c008de0 con 0x7f505c00dd40 2023-11-04T01:56:53.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:53.933+0000 7f507d191640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c00cf70 legacy=0x7f505c011ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:53.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:53.933+0000 7f507d992640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:53.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:53.933+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 msgr2=0x7f505c0131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:53.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:53.933+0000 7f507d992640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c0116a0 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:53.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:53.933+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 0x7f505c0131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:54.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:54.134+0000 7f507d191640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c00cf70 legacy=0x7f505c011ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:54.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:54.134+0000 7f507d992640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:54.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:54.134+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 msgr2=0x7f505c0131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:54.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:54.134+0000 7f507d992640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c0116a0 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:54.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:54.134+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 0x7f505c0131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:54.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:54.535+0000 7f507d191640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c00cf70 legacy=0x7f505c011ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:54.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:54.535+0000 7f507d992640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:54.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:54.535+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 msgr2=0x7f505c0131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:54.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:54.535+0000 7f507d992640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c0116a0 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:54.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:54.535+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 0x7f505c0131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:55.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:55.336+0000 7f507d191640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c00cf70 legacy=0x7f505c011ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:55.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:55.336+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 msgr2=0x7f505c0131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:56:55.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:55.336+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 0x7f505c0131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:55.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:55.336+0000 7f507d992640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:55.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:55.336+0000 7f507d992640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c0116a0 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:56.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:56.933+0000 7f506affd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 msgr2=0x7f505c0131d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:56.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:56.933+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c00dd40 0x7f505c0131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:56.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:56.933+0000 7f506affd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c0116a0 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:56.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:56.933+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c0116a0 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:56.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:56.933+0000 7f506affd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c00cf70 legacy=0x7f505c011ab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:56.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:56.933+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c014180 0x7f505c00c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:56.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:56.933+0000 7f506affd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780b4750 con 0x7f505c006580 2023-11-04T01:56:56.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:56.933+0000 7f506affd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c014180 2023-11-04T01:56:56.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:56.933+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c014180 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:56.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:56.933+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c014180 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:56.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:56.933+0000 7f507c990640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c006580 legacy=0x7f505c00b0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:57.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:57.134+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c014180 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:57.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:57.134+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c014180 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:57.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:57.134+0000 7f507c990640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c006580 legacy=0x7f505c00b0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:57.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:57.535+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c014180 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:57.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:57.535+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c014180 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:57.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:57.535+0000 7f507c990640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c006580 legacy=0x7f505c00b0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:58.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:58.336+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c014180 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:58.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:58.336+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c014180 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:58.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:58.336+0000 7f507c990640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c006580 legacy=0x7f505c00b0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:56:59.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:59.934+0000 7f506affd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c014180 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:59.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:59.934+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c014180 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:59.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:59.934+0000 7f506affd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c006580 legacy=0x7f505c00b0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:59.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:59.934+0000 7f507d992640 1 -- reap_dead start 2023-11-04T01:56:59.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:59.934+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c00cf70 0x7f505c0131d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:59.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:59.934+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c00dd40 0x7f505c00c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:59.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:59.934+0000 7f506affd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780cee10 con 0x7f505c006580 2023-11-04T01:56:59.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:59.934+0000 7f506affd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c00cf70 2023-11-04T01:56:59.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:59.934+0000 7f506affd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008de0 con 0x7f505c00dd40 2023-11-04T01:56:59.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:59.934+0000 7f507c990640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c00cf70 msgr2=0x7f505c0131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:56:59.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:59.934+0000 7f507c990640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c00cf70 0x7f505c0131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:59.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:59.934+0000 7f507d191640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c006580 legacy=0x7f505c011ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:56:59.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:59.934+0000 7f507d992640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c00dd40 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:56:59.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:56:59.934+0000 7f507d992640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c00dd40 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:00.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:00.135+0000 7f507d191640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c006580 legacy=0x7f505c011ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:00.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:00.135+0000 7f507c990640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c00cf70 msgr2=0x7f505c0131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:00.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:00.135+0000 7f507c990640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c00cf70 0x7f505c0131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:00.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:00.135+0000 7f507d992640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c00dd40 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:00.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:00.135+0000 7f507d992640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c00dd40 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:00.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:00.536+0000 7f507d191640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c006580 legacy=0x7f505c011ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:00.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:00.536+0000 7f507c990640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c00cf70 msgr2=0x7f505c0131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:00.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:00.536+0000 7f507c990640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c00cf70 0x7f505c0131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:00.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:00.536+0000 7f507d992640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c00dd40 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:00.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:00.536+0000 7f507d992640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c00dd40 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:01.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:01.337+0000 7f507d191640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c006580 legacy=0x7f505c011ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:01.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:01.337+0000 7f507c990640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c00cf70 msgr2=0x7f505c0131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:01.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:01.337+0000 7f507c990640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c00cf70 0x7f505c0131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:01.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:01.337+0000 7f507d992640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c00dd40 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:01.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:01.337+0000 7f507d992640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c00dd40 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:02.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:02.934+0000 7f506affd640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c00dd40 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:02.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:02.934+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c00dd40 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:02.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:02.934+0000 7f506affd640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c00cf70 msgr2=0x7f505c0131d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:02.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:02.934+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c00cf70 0x7f505c0131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:02.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:02.934+0000 7f506affd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c006580 legacy=0x7f505c011ab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:02.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:02.934+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014100 0x7f505c006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:02.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:02.934+0000 7f506affd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780b4750 con 0x7f505c0116a0 2023-11-04T01:57:02.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:02.934+0000 7f506affd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c014100 2023-11-04T01:57:02.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:02.934+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014100 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:02.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:02.934+0000 7f507d191640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c0116a0 legacy=0x7f505c00b0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:02.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:02.934+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014100 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:03.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:03.135+0000 7f507d191640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c0116a0 legacy=0x7f505c00b0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:03.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:03.135+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014100 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:03.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:03.135+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014100 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:03.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:03.536+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014100 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:03.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:03.536+0000 7f507d191640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c0116a0 legacy=0x7f505c00b0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:03.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:03.536+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014100 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:04.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:04.337+0000 7f507d191640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c0116a0 legacy=0x7f505c00b0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:04.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:04.337+0000 7f507c990640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014100 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:04.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:04.337+0000 7f507c990640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014100 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:04.378 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:57:04.382 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:57:05.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:05.935+0000 7f506affd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014100 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:05.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:05.935+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c014100 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:05.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:05.935+0000 7f506affd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c0116a0 legacy=0x7f505c00b0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:05.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:05.935+0000 7f507d992640 1 -- reap_dead start 2023-11-04T01:57:05.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:05.935+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0116a0 0x7f505c00c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:05.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:05.935+0000 7f506affd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780cee10 con 0x7f505c00cf70 2023-11-04T01:57:05.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:05.935+0000 7f506affd640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780b4750 con 0x7f505c00dd40 2023-11-04T01:57:05.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:05.935+0000 7f506affd640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c0116a0 2023-11-04T01:57:05.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:05.935+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c00cf70 legacy=0x7f505c011ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:05.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:05.935+0000 7f507d992640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c00dd40 legacy=0x7f505c00b0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:05.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:05.935+0000 7f507d191640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0116a0 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:05.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:05.935+0000 7f507d191640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0116a0 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:06.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:06.136+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c00cf70 legacy=0x7f505c011ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:06.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:06.136+0000 7f507d992640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c00dd40 legacy=0x7f505c00b0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:06.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:06.136+0000 7f507d191640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0116a0 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:06.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:06.136+0000 7f507d191640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0116a0 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:06.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:06.537+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c00cf70 legacy=0x7f505c011ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:06.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:06.537+0000 7f507d992640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c00dd40 legacy=0x7f505c00b0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:06.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:06.537+0000 7f507d191640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0116a0 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:06.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:06.537+0000 7f507d191640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0116a0 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:07.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:07.338+0000 7f507c990640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c00cf70 legacy=0x7f505c011ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:07.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:07.338+0000 7f507d992640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c00dd40 legacy=0x7f505c00b0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:07.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:07.338+0000 7f507d191640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0116a0 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:07.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:07.338+0000 7f507d191640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0116a0 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:08.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:08.935+0000 7f506affd640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0116a0 msgr2=0x7f505c00c5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:08.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:08.935+0000 7f506affd640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7f505c0116a0 0x7f505c00c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:08.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:08.935+0000 7f506affd640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7f505c00dd40 legacy=0x7f505c00b0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:08.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:08.935+0000 7f506affd640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7f505c00cf70 legacy=0x7f505c011ab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:08.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:08.935+0000 7f506affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c014100 0x7f505c0131d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:08.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:08.935+0000 7f506affd640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c006560 0x7f505c006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:08.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:08.935+0000 7f506affd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008c70 con 0x7f505c014100 2023-11-04T01:57:08.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:08.935+0000 7f506affd640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c008de0 con 0x7f505c006560 2023-11-04T01:57:08.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:08.935+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c014100 msgr2=0x7f505c0131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:08.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:08.935+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c014100 0x7f505c0131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:08.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:08.935+0000 7f507c990640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c006560 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:08.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:08.935+0000 7f507c990640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c006560 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:09.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:09.136+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c014100 msgr2=0x7f505c0131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:09.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:09.136+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c014100 0x7f505c0131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:09.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:09.136+0000 7f507c990640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c006560 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:09.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:09.136+0000 7f507c990640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c006560 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:09.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:09.537+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c014100 msgr2=0x7f505c0131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:09.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:09.537+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c014100 0x7f505c0131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:09.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:09.537+0000 7f507c990640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c006560 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:09.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:09.537+0000 7f507c990640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c006560 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:10.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:10.338+0000 7f507d191640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7f505c014100 msgr2=0x7f505c0131d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:10.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:10.338+0000 7f507d191640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f505c014100 0x7f505c0131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:10.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:10.338+0000 7f507c990640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7f505c006560 msgr2=0x7f505c006e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:10.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:10.338+0000 7f507c990640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7f505c006560 0x7f505c006e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:11.853 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-11-04T01:57:11.854 INFO:tasks.cephfs_test_runner:check snaptable transcation ... ERROR 2023-11-04T01:57:11.855 INFO:tasks.cephfs_test_runner:ERROR 2023-11-04T01:57:11.855 INFO:tasks.cephfs_test_runner: 2023-11-04T01:57:11.856 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-04T01:57:11.856 INFO:tasks.cephfs_test_runner:ERROR: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:57:11.856 INFO:tasks.cephfs_test_runner:check snaptable transcation 2023-11-04T01:57:11.857 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-04T01:57:11.857 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-04T01:57:11.857 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/test_snapshots.py", line 174, in test_kill_mdstable 2023-11-04T01:57:11.857 INFO:tasks.cephfs_test_runner: self.assertEqual(len(self._get_pending_snap_update(rank=0)), 1) 2023-11-04T01:57:11.858 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/test_snapshots.py", line 38, in _get_pending_snap_update 2023-11-04T01:57:11.858 INFO:tasks.cephfs_test_runner: return self._get_snapserver_dump(rank,status=status)["pending_update"] 2023-11-04T01:57:11.858 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/test_snapshots.py", line 29, in _get_snapserver_dump 2023-11-04T01:57:11.859 INFO:tasks.cephfs_test_runner: return self.fs.rank_asok(["dump", "snaps", "--server"], rank=rank, status=status) 2023-11-04T01:57:11.859 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 1295, in rank_asok 2023-11-04T01:57:11.859 INFO:tasks.cephfs_test_runner: info = self.get_rank(rank=rank, status=status) 2023-11-04T01:57:11.859 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 1101, in get_rank 2023-11-04T01:57:11.860 INFO:tasks.cephfs_test_runner: status = self.getinfo() 2023-11-04T01:57:11.860 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 565, in getinfo 2023-11-04T01:57:11.860 INFO:tasks.cephfs_test_runner: status = self.status() 2023-11-04T01:57:11.860 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 396, in status 2023-11-04T01:57:11.861 INFO:tasks.cephfs_test_runner: return FSStatus(self.mon_manager, epoch) 2023-11-04T01:57:11.861 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 88, in __init__ 2023-11-04T01:57:11.861 INFO:tasks.cephfs_test_runner: self.map = json.loads(self.get_ceph_cmd_stdout(*cmd)) 2023-11-04T01:57:11.862 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2023-11-04T01:57:11.862 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2023-11-04T01:57:11.862 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2023-11-04T01:57:11.862 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2023-11-04T01:57:11.863 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd 2023-11-04T01:57:11.863 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-11-04T01:57:11.863 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run 2023-11-04T01:57:11.863 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-04T01:57:11.864 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run 2023-11-04T01:57:11.864 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-04T01:57:11.864 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait 2023-11-04T01:57:11.864 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-04T01:57:11.865 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-04T01:57:11.865 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-04T01:57:11.865 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi077 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json' 2023-11-04T01:57:11.865 INFO:tasks.cephfs_test_runner: 2023-11-04T01:57:11.866 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-04T01:57:11.866 INFO:tasks.cephfs_test_runner:ERROR: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:57:11.866 INFO:tasks.cephfs_test_runner:check snaptable transcation 2023-11-04T01:57:11.867 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-04T01:57:11.867 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-04T01:57:11.867 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/cephfs_test_case.py", line 208, in tearDown 2023-11-04T01:57:11.867 INFO:tasks.cephfs_test_runner: self.mds_cluster.delete_all_filesystems() 2023-11-04T01:57:11.868 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 493, in delete_all_filesystems 2023-11-04T01:57:11.868 INFO:tasks.cephfs_test_runner: for fs in self.status().get_filesystems(): 2023-11-04T01:57:11.868 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 396, in status 2023-11-04T01:57:11.868 INFO:tasks.cephfs_test_runner: return FSStatus(self.mon_manager, epoch) 2023-11-04T01:57:11.869 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 88, in __init__ 2023-11-04T01:57:11.869 INFO:tasks.cephfs_test_runner: self.map = json.loads(self.get_ceph_cmd_stdout(*cmd)) 2023-11-04T01:57:11.869 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2023-11-04T01:57:11.870 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2023-11-04T01:57:11.870 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2023-11-04T01:57:11.870 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2023-11-04T01:57:11.870 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd 2023-11-04T01:57:11.871 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-11-04T01:57:11.871 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run 2023-11-04T01:57:11.871 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-04T01:57:11.872 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run 2023-11-04T01:57:11.872 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-04T01:57:11.872 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait 2023-11-04T01:57:11.873 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-04T01:57:11.873 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-04T01:57:11.873 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-04T01:57:11.873 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi077 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json' 2023-11-04T01:57:11.874 INFO:tasks.cephfs_test_runner: 2023-11-04T01:57:11.874 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-04T01:57:11.874 INFO:tasks.cephfs_test_runner:Ran 5 tests in 979.846s 2023-11-04T01:57:11.874 INFO:tasks.cephfs_test_runner: 2023-11-04T01:57:11.875 INFO:tasks.cephfs_test_runner:FAILED (errors=2) 2023-11-04T01:57:11.875 INFO:tasks.cephfs_test_runner: 2023-11-04T01:57:11.875 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-04T01:57:11.876 INFO:tasks.cephfs_test_runner:ERROR: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:57:11.876 INFO:tasks.cephfs_test_runner:check snaptable transcation 2023-11-04T01:57:11.876 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-04T01:57:11.876 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-04T01:57:11.877 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/test_snapshots.py", line 174, in test_kill_mdstable 2023-11-04T01:57:11.877 INFO:tasks.cephfs_test_runner: self.assertEqual(len(self._get_pending_snap_update(rank=0)), 1) 2023-11-04T01:57:11.877 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/test_snapshots.py", line 38, in _get_pending_snap_update 2023-11-04T01:57:11.877 INFO:tasks.cephfs_test_runner: return self._get_snapserver_dump(rank,status=status)["pending_update"] 2023-11-04T01:57:11.878 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/test_snapshots.py", line 29, in _get_snapserver_dump 2023-11-04T01:57:11.878 INFO:tasks.cephfs_test_runner: return self.fs.rank_asok(["dump", "snaps", "--server"], rank=rank, status=status) 2023-11-04T01:57:11.878 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 1295, in rank_asok 2023-11-04T01:57:11.878 INFO:tasks.cephfs_test_runner: info = self.get_rank(rank=rank, status=status) 2023-11-04T01:57:11.879 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 1101, in get_rank 2023-11-04T01:57:11.879 INFO:tasks.cephfs_test_runner: status = self.getinfo() 2023-11-04T01:57:11.879 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 565, in getinfo 2023-11-04T01:57:11.879 INFO:tasks.cephfs_test_runner: status = self.status() 2023-11-04T01:57:11.880 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 396, in status 2023-11-04T01:57:11.880 INFO:tasks.cephfs_test_runner: return FSStatus(self.mon_manager, epoch) 2023-11-04T01:57:11.880 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 88, in __init__ 2023-11-04T01:57:11.880 INFO:tasks.cephfs_test_runner: self.map = json.loads(self.get_ceph_cmd_stdout(*cmd)) 2023-11-04T01:57:11.881 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2023-11-04T01:57:11.881 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2023-11-04T01:57:11.881 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2023-11-04T01:57:11.881 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2023-11-04T01:57:11.882 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd 2023-11-04T01:57:11.882 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-11-04T01:57:11.882 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run 2023-11-04T01:57:11.883 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-04T01:57:11.883 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run 2023-11-04T01:57:11.883 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-04T01:57:11.883 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait 2023-11-04T01:57:11.884 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-04T01:57:11.884 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-04T01:57:11.884 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-04T01:57:11.884 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi077 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json' 2023-11-04T01:57:11.885 INFO:tasks.cephfs_test_runner: 2023-11-04T01:57:11.885 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-04T01:57:11.885 INFO:tasks.cephfs_test_runner:ERROR: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:57:11.885 INFO:tasks.cephfs_test_runner:check snaptable transcation 2023-11-04T01:57:11.886 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-04T01:57:11.886 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-04T01:57:11.886 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/cephfs_test_case.py", line 208, in tearDown 2023-11-04T01:57:11.887 INFO:tasks.cephfs_test_runner: self.mds_cluster.delete_all_filesystems() 2023-11-04T01:57:11.887 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 493, in delete_all_filesystems 2023-11-04T01:57:11.887 INFO:tasks.cephfs_test_runner: for fs in self.status().get_filesystems(): 2023-11-04T01:57:11.887 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 396, in status 2023-11-04T01:57:11.887 INFO:tasks.cephfs_test_runner: return FSStatus(self.mon_manager, epoch) 2023-11-04T01:57:11.888 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 88, in __init__ 2023-11-04T01:57:11.888 INFO:tasks.cephfs_test_runner: self.map = json.loads(self.get_ceph_cmd_stdout(*cmd)) 2023-11-04T01:57:11.888 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2023-11-04T01:57:11.889 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2023-11-04T01:57:11.889 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2023-11-04T01:57:11.889 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2023-11-04T01:57:11.889 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd 2023-11-04T01:57:11.890 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-11-04T01:57:11.890 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run 2023-11-04T01:57:11.890 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-04T01:57:11.891 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run 2023-11-04T01:57:11.891 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-04T01:57:11.891 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait 2023-11-04T01:57:11.891 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-04T01:57:11.892 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-04T01:57:11.892 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-04T01:57:11.892 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi077 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json' 2023-11-04T01:57:11.892 INFO:tasks.cephfs_test_runner: 2023-11-04T01:57:11.893 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots), test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:57:11.992 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=342c40a650334ee4abb2eaca3120e5e7 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots), test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:57:11.994 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-04T01:57:12.003 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-11-04T01:57:12.045 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-11-04T01:57:12.046 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:57:12.046 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:57:12.067 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19534 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:57:12.068 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-11-04T01:57:12.068 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:57:12.126 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056369,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19534 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248860k,nr_inodes=812215,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497728k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:57:12.127 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:57:12.127 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:57:12.146 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056339,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13650 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:57:12.147 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2023-11-04T01:57:12.147 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:57:12.205 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056339,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13650 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:57:12.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:57:12.206 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2023-11-04T01:57:12.224 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:57:12.225 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:57:12.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:57:12.226 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:57:12.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:57:12.296 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:57:12.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:57:12.366 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link delete ceph-brx 2023-11-04T01:57:12.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:57:12.469 DEBUG:teuthology.orchestra.run.smithi122:> ip netns list 2023-11-04T01:57:12.486 INFO:teuthology.orchestra.run.smithi122.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-04T01:57:12.487 INFO:teuthology.orchestra.run.smithi122.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-04T01:57:12.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:57:12.487 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:57:12.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:57:12.558 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:57:12.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:57:12.627 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link delete ceph-brx 2023-11-04T01:57:12.723 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-04T01:57:12.733 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-04T01:57:12.734 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:57:12.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:12.836+0000 7fd40cad4640 1 Processor -- start 2023-11-04T01:57:12.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:12.836+0000 7fd40cad4640 1 -- start start 2023-11-04T01:57:12.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:12.837+0000 7fd40cad4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd4080ade00 0x7fd4080b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:12.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:12.837+0000 7fd40cad4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40806cc90 con 0x7fd40806d9c0 2023-11-04T01:57:12.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:12.837+0000 7fd40cad4640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4080b0e60 con 0x7fd40806c5f0 2023-11-04T01:57:12.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:12.837+0000 7fd40cad4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd4080ade00 2023-11-04T01:57:12.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:12.837+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd40806d9c0 legacy=0x7fd4080710d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:12.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:12.837+0000 7fd40659c640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd4080ade00 msgr2=0x7fd4080b0530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:12.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:12.837+0000 7fd40659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd4080ade00 0x7fd4080b0530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:12.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:12.837+0000 7fd406d9d640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd40806c5f0 legacy=0x7fd4080cc680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:13.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:13.038+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd40806d9c0 legacy=0x7fd4080710d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:13.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:13.038+0000 7fd40659c640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd4080ade00 msgr2=0x7fd4080b0530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:13.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:13.038+0000 7fd40659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd4080ade00 0x7fd4080b0530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:13.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:13.038+0000 7fd406d9d640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd40806c5f0 legacy=0x7fd4080cc680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:13.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:13.439+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd40806d9c0 legacy=0x7fd4080710d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:13.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:13.439+0000 7fd40659c640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd4080ade00 msgr2=0x7fd4080b0530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:13.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:13.439+0000 7fd40659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd4080ade00 0x7fd4080b0530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:13.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:13.439+0000 7fd406d9d640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd40806c5f0 legacy=0x7fd4080cc680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:14.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:14.239+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd40806d9c0 legacy=0x7fd4080710d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:14.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:14.239+0000 7fd40659c640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd4080ade00 msgr2=0x7fd4080b0530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:14.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:14.239+0000 7fd40659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd4080ade00 0x7fd4080b0530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:14.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:14.239+0000 7fd406d9d640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd40806c5f0 legacy=0x7fd4080cc680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:15.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:15.837+0000 7fd3f7fff640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd4080ade00 msgr2=0x7fd4080b0530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:15.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:15.837+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd4080ade00 0x7fd4080b0530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:15.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:15.837+0000 7fd3f7fff640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd40806c5f0 legacy=0x7fd4080cc680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:15.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:15.837+0000 7fd3f7fff640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd40806d9c0 legacy=0x7fd4080710d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:15.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:15.837+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e80036a0 0x7fd3e8005af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:15.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:15.837+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80061d0 0x7fd3e8008690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:15.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:15.837+0000 7fd3f7fff640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e80061d0 2023-11-04T01:57:15.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:15.837+0000 7fd3f7fff640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e8008d50 con 0x7fd3e80036a0 2023-11-04T01:57:15.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:15.837+0000 7fd40659c640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e80036a0 msgr2=0x7fd3e8005af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:15.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:15.837+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80061d0 msgr2=0x7fd3e8008690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:15.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:15.837+0000 7fd40659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e80036a0 0x7fd3e8005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:15.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:15.837+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80061d0 0x7fd3e8008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:16.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:16.038+0000 7fd40659c640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e80036a0 msgr2=0x7fd3e8005af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:16.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:16.038+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80061d0 msgr2=0x7fd3e8008690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:16.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:16.038+0000 7fd40659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e80036a0 0x7fd3e8005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:16.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:16.038+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80061d0 0x7fd3e8008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:16.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:16.439+0000 7fd40659c640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e80036a0 msgr2=0x7fd3e8005af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:16.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:16.439+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80061d0 msgr2=0x7fd3e8008690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:16.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:16.439+0000 7fd40659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e80036a0 0x7fd3e8005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:16.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:16.439+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80061d0 0x7fd3e8008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:17.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:17.240+0000 7fd40659c640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e80036a0 msgr2=0x7fd3e8005af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:17.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:17.240+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80061d0 msgr2=0x7fd3e8008690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:17.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:17.240+0000 7fd40659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e80036a0 0x7fd3e8005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:17.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:17.240+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80061d0 0x7fd3e8008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:18.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:18.837+0000 7fd3f7fff640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e80036a0 msgr2=0x7fd3e8005af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:18.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:18.837+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e80036a0 0x7fd3e8005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:18.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:18.837+0000 7fd3f7fff640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80061d0 msgr2=0x7fd3e8008690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:18.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:18.837+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80061d0 0x7fd3e8008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:18.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:18.837+0000 7fd406d9d640 1 -- reap_dead start 2023-11-04T01:57:18.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:18.837+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 0x7fd3e8006620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:18.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:18.837+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8008710 0x7fd3e800d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:18.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:18.837+0000 7fd3f7fff640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40806d1c0 con 0x7fd3e8006b60 2023-11-04T01:57:18.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:18.837+0000 7fd3f7fff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e8003ae0 2023-11-04T01:57:18.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:18.837+0000 7fd3f7fff640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e8008d50 con 0x7fd3e8008710 2023-11-04T01:57:18.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:18.837+0000 7fd40659c640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 msgr2=0x7fd3e8006620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:18.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:18.837+0000 7fd40659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 0x7fd3e8006620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:18.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:18.837+0000 7fd406d9d640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8008710 msgr2=0x7fd3e800d030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:18.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:18.837+0000 7fd405d9b640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8006b60 legacy=0x7fd3e8006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:18.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:18.837+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8008710 0x7fd3e800d030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:19.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:19.038+0000 7fd40659c640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 msgr2=0x7fd3e8006620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:19.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:19.038+0000 7fd40659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 0x7fd3e8006620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:19.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:19.038+0000 7fd405d9b640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8006b60 legacy=0x7fd3e8006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:19.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:19.038+0000 7fd406d9d640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8008710 msgr2=0x7fd3e800d030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:19.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:19.038+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8008710 0x7fd3e800d030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:19.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:19.439+0000 7fd40659c640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 msgr2=0x7fd3e8006620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:19.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:19.439+0000 7fd40659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 0x7fd3e8006620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:19.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:19.439+0000 7fd406d9d640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8008710 msgr2=0x7fd3e800d030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:19.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:19.439+0000 7fd405d9b640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8006b60 legacy=0x7fd3e8006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:19.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:19.439+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8008710 0x7fd3e800d030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:20.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:20.240+0000 7fd40659c640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 msgr2=0x7fd3e8006620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:20.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:20.240+0000 7fd40659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 0x7fd3e8006620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:20.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:20.240+0000 7fd406d9d640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8008710 msgr2=0x7fd3e800d030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:20.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:20.240+0000 7fd405d9b640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8006b60 legacy=0x7fd3e8006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:20.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:20.240+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8008710 0x7fd3e800d030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:21.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:21.838+0000 7fd3f7fff640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8008710 msgr2=0x7fd3e800d030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:21.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:21.838+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8008710 0x7fd3e800d030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:21.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:21.838+0000 7fd3f7fff640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 msgr2=0x7fd3e8006620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:21.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:21.838+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 0x7fd3e8006620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:21.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:21.838+0000 7fd3f7fff640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8006b60 legacy=0x7fd3e8006fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:21.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:21.838+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e800d740 0x7fd3e800db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:21.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:21.838+0000 7fd3f7fff640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40806cc90 con 0x7fd3e800e260 2023-11-04T01:57:21.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:21.838+0000 7fd3f7fff640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e800d740 2023-11-04T01:57:21.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:21.838+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e800e260 legacy=0x7fd3e8012940 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:21.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:21.838+0000 7fd40659c640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e800d740 msgr2=0x7fd3e800db70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:21.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:21.838+0000 7fd40659c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e800d740 0x7fd3e800db70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:22.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:22.039+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e800e260 legacy=0x7fd3e8012940 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:22.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:22.039+0000 7fd40659c640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e800d740 msgr2=0x7fd3e800db70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:22.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:22.039+0000 7fd40659c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e800d740 0x7fd3e800db70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:22.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:22.440+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e800e260 legacy=0x7fd3e8012940 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:22.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:22.440+0000 7fd40659c640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e800d740 msgr2=0x7fd3e800db70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:22.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:22.440+0000 7fd40659c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e800d740 0x7fd3e800db70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:23.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:23.241+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e800e260 legacy=0x7fd3e8012940 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:23.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:23.241+0000 7fd40659c640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e800d740 msgr2=0x7fd3e800db70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:23.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:23.241+0000 7fd40659c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e800d740 0x7fd3e800db70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:24.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:24.838+0000 7fd3f7fff640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e800d740 msgr2=0x7fd3e800db70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:24.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:24.838+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e800d740 0x7fd3e800db70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:24.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:24.838+0000 7fd3f7fff640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e800e260 legacy=0x7fd3e8012940 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:24.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:24.838+0000 7fd406d9d640 1 -- reap_dead start 2023-11-04T01:57:24.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:24.838+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 0x7fd3e8006620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:24.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:24.838+0000 7fd3f7fff640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40806d1c0 con 0x7fd3e8014060 2023-11-04T01:57:24.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:24.838+0000 7fd3f7fff640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40806cc90 con 0x7fd3e8006b60 2023-11-04T01:57:24.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:24.838+0000 7fd3f7fff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e8003ae0 2023-11-04T01:57:24.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:24.838+0000 7fd40659c640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8014060 legacy=0x7fd3e8014480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:24.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:24.838+0000 7fd406d9d640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 msgr2=0x7fd3e8006620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:24.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:24.838+0000 7fd406d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 0x7fd3e8006620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:24.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:24.838+0000 7fd405d9b640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8006b60 legacy=0x7fd3e8006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:25.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:25.039+0000 7fd40659c640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8014060 legacy=0x7fd3e8014480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:25.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:25.039+0000 7fd406d9d640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 msgr2=0x7fd3e8006620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:25.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:25.039+0000 7fd406d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 0x7fd3e8006620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:25.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:25.039+0000 7fd405d9b640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8006b60 legacy=0x7fd3e8006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:25.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:25.440+0000 7fd406d9d640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 msgr2=0x7fd3e8006620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:25.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:25.440+0000 7fd40659c640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8014060 legacy=0x7fd3e8014480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:25.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:25.440+0000 7fd406d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 0x7fd3e8006620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:25.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:25.440+0000 7fd405d9b640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8006b60 legacy=0x7fd3e8006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:26.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:26.241+0000 7fd40659c640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8014060 legacy=0x7fd3e8014480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:26.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:26.241+0000 7fd406d9d640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 msgr2=0x7fd3e8006620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:26.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:26.241+0000 7fd406d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 0x7fd3e8006620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:26.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:26.241+0000 7fd405d9b640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8006b60 legacy=0x7fd3e8006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:27.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:27.839+0000 7fd3f7fff640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 msgr2=0x7fd3e8006620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:27.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:27.839+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 0x7fd3e8006620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:27.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:27.839+0000 7fd3f7fff640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8006b60 legacy=0x7fd3e8006fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:27.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:27.839+0000 7fd3f7fff640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8014060 legacy=0x7fd3e8014480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:27.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:27.839+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8014cb0 0x7fd3e800d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:27.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:27.839+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e800dc90 0x7fd3e8010930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:27.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:27.839+0000 7fd3f7fff640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e800dc90 2023-11-04T01:57:27.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:27.839+0000 7fd3f7fff640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e8008d50 con 0x7fd3e8014cb0 2023-11-04T01:57:27.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:27.839+0000 7fd40659c640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8014cb0 msgr2=0x7fd3e800d030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:27.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:27.839+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e800dc90 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:27.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:27.839+0000 7fd40659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8014cb0 0x7fd3e800d030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:27.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:27.839+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e800dc90 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:28.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:28.040+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e800dc90 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:28.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:28.040+0000 7fd40659c640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8014cb0 msgr2=0x7fd3e800d030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:28.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:28.040+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e800dc90 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:28.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:28.040+0000 7fd40659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8014cb0 0x7fd3e800d030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:28.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:28.441+0000 7fd40659c640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8014cb0 msgr2=0x7fd3e800d030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:28.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:28.441+0000 7fd40659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8014cb0 0x7fd3e800d030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:28.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:28.441+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e800dc90 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:28.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:28.441+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e800dc90 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:29.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:29.242+0000 7fd40659c640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8014cb0 msgr2=0x7fd3e800d030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:29.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:29.242+0000 7fd40659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8014cb0 0x7fd3e800d030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:29.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:29.242+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e800dc90 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:29.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:29.242+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e800dc90 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:30.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:30.839+0000 7fd3f7fff640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8014cb0 msgr2=0x7fd3e800d030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:30.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:30.839+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8014cb0 0x7fd3e800d030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:30.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:30.839+0000 7fd3f7fff640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e800dc90 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:30.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:30.839+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e800dc90 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:30.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:30.839+0000 7fd406d9d640 1 -- reap_dead start 2023-11-04T01:57:30.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:30.839+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8010fa0 0x7fd3e8013390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:30.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:30.839+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 0x7fd3e8006620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:30.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:30.839+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013970 0x7fd3e800d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:30.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:30.839+0000 7fd3f7fff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e8003ae0 2023-11-04T01:57:30.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:30.839+0000 7fd3f7fff640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e8008d50 con 0x7fd3e8010fa0 2023-11-04T01:57:30.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:30.839+0000 7fd3f7fff640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e8013db0 con 0x7fd3e8013970 2023-11-04T01:57:30.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:30.839+0000 7fd405d9b640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 msgr2=0x7fd3e8006620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:30.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:30.839+0000 7fd405d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 0x7fd3e8006620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:30.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:30.839+0000 7fd40659c640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8010fa0 msgr2=0x7fd3e8013390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:30.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:30.839+0000 7fd406d9d640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013970 msgr2=0x7fd3e800d030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:30.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:30.839+0000 7fd40659c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8010fa0 0x7fd3e8013390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:30.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:30.839+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013970 0x7fd3e800d030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:31.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:31.040+0000 7fd405d9b640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 msgr2=0x7fd3e8006620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:31.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:31.040+0000 7fd405d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 0x7fd3e8006620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:31.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:31.040+0000 7fd40659c640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8010fa0 msgr2=0x7fd3e8013390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:31.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:31.040+0000 7fd406d9d640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013970 msgr2=0x7fd3e800d030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:31.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:31.040+0000 7fd40659c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8010fa0 0x7fd3e8013390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:31.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:31.040+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013970 0x7fd3e800d030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:31.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:31.441+0000 7fd405d9b640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 msgr2=0x7fd3e8006620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:31.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:31.441+0000 7fd405d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 0x7fd3e8006620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:31.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:31.441+0000 7fd40659c640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8010fa0 msgr2=0x7fd3e8013390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:31.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:31.441+0000 7fd406d9d640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013970 msgr2=0x7fd3e800d030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:31.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:31.441+0000 7fd40659c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8010fa0 0x7fd3e8013390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:31.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:31.441+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013970 0x7fd3e800d030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:32.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:32.242+0000 7fd405d9b640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 msgr2=0x7fd3e8006620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:32.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:32.242+0000 7fd405d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 0x7fd3e8006620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:32.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:32.242+0000 7fd40659c640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8010fa0 msgr2=0x7fd3e8013390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:32.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:32.242+0000 7fd40659c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8010fa0 0x7fd3e8013390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:32.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:32.242+0000 7fd406d9d640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013970 msgr2=0x7fd3e800d030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:32.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:32.242+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013970 0x7fd3e800d030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:33.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:33.839+0000 7fd3f7fff640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013970 msgr2=0x7fd3e800d030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:33.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:33.839+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013970 0x7fd3e800d030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:33.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:33.839+0000 7fd3f7fff640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8010fa0 msgr2=0x7fd3e8013390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:33.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:33.839+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8010fa0 0x7fd3e8013390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:33.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:33.839+0000 7fd3f7fff640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 msgr2=0x7fd3e8006620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:33.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:33.839+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 0x7fd3e8006620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:33.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:33.839+0000 7fd3f7fff640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4080b0e60 con 0x7fd3e8006b60 2023-11-04T01:57:33.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:33.839+0000 7fd3f7fff640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40806d1c0 con 0x7fd3e8013ef0 2023-11-04T01:57:33.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:33.839+0000 7fd40659c640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006b60 legacy=0x7fd3e8014480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:33.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:33.839+0000 7fd405d9b640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8013ef0 legacy=0x7fd3e8007fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:34.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:34.040+0000 7fd40659c640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006b60 legacy=0x7fd3e8014480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:34.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:34.040+0000 7fd405d9b640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8013ef0 legacy=0x7fd3e8007fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:34.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:34.441+0000 7fd40659c640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006b60 legacy=0x7fd3e8014480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:34.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:34.441+0000 7fd405d9b640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8013ef0 legacy=0x7fd3e8007fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:34.507 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:57:34.511 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:57:35.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:35.242+0000 7fd40659c640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006b60 legacy=0x7fd3e8014480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:35.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:35.242+0000 7fd405d9b640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8013ef0 legacy=0x7fd3e8007fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:36.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:36.839+0000 7fd3f7fff640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8013ef0 legacy=0x7fd3e8007fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:36.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:36.839+0000 7fd3f7fff640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006b60 legacy=0x7fd3e8014480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:36.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:36.839+0000 7fd406d9d640 1 -- reap_dead start 2023-11-04T01:57:36.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:36.839+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013970 0x7fd3e800d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:36.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:36.839+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 0x7fd3e8010930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:36.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:36.839+0000 7fd3f7fff640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40806cc90 con 0x7fd3e8013ef0 2023-11-04T01:57:36.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:36.839+0000 7fd3f7fff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e8003ae0 2023-11-04T01:57:36.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:36.839+0000 7fd3f7fff640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e8008d50 con 0x7fd3e8013970 2023-11-04T01:57:36.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:36.839+0000 7fd406d9d640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:36.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:36.839+0000 7fd406d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:36.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:36.839+0000 7fd40659c640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013970 msgr2=0x7fd3e800d030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:36.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:36.839+0000 7fd405d9b640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8013ef0 legacy=0x7fd3e8007fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:36.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:36.839+0000 7fd40659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013970 0x7fd3e800d030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:37.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:37.040+0000 7fd406d9d640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:37.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:37.040+0000 7fd406d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:37.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:37.040+0000 7fd40659c640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013970 msgr2=0x7fd3e800d030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:37.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:37.040+0000 7fd405d9b640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8013ef0 legacy=0x7fd3e8007fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:37.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:37.040+0000 7fd40659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013970 0x7fd3e800d030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:37.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:37.441+0000 7fd406d9d640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:37.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:37.441+0000 7fd406d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:37.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:37.441+0000 7fd40659c640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013970 msgr2=0x7fd3e800d030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:37.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:37.441+0000 7fd405d9b640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8013ef0 legacy=0x7fd3e8007fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:37.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:37.441+0000 7fd40659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013970 0x7fd3e800d030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:38.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:38.242+0000 7fd406d9d640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:38.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:38.242+0000 7fd406d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:38.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:38.242+0000 7fd40659c640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013970 msgr2=0x7fd3e800d030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:38.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:38.242+0000 7fd405d9b640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8013ef0 legacy=0x7fd3e8007fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:38.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:38.242+0000 7fd40659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013970 0x7fd3e800d030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:39.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:39.840+0000 7fd3f7fff640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013970 msgr2=0x7fd3e800d030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:39.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:39.840+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013970 0x7fd3e800d030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:39.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:39.840+0000 7fd3f7fff640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:39.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:39.840+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:39.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:39.840+0000 7fd3f7fff640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8013ef0 legacy=0x7fd3e8007fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:39.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:39.840+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8010fa0 0x7fd3e8013390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:39.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:39.840+0000 7fd3f7fff640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4080b0e60 con 0x7fd3e8014480 2023-11-04T01:57:39.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:39.840+0000 7fd3f7fff640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e8010fa0 2023-11-04T01:57:39.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:39.840+0000 7fd40659c640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8014480 legacy=0x7fd3e8006600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:39.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:39.840+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8010fa0 msgr2=0x7fd3e8013390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:39.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:39.840+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8010fa0 0x7fd3e8013390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:40.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:40.041+0000 7fd40659c640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8014480 legacy=0x7fd3e8006600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:40.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:40.041+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8010fa0 msgr2=0x7fd3e8013390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:40.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:40.041+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8010fa0 0x7fd3e8013390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:40.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:40.442+0000 7fd40659c640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8014480 legacy=0x7fd3e8006600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:40.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:40.442+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8010fa0 msgr2=0x7fd3e8013390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:40.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:40.442+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8010fa0 0x7fd3e8013390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:41.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:41.243+0000 7fd40659c640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8014480 legacy=0x7fd3e8006600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:41.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:41.243+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8010fa0 msgr2=0x7fd3e8013390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:41.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:41.243+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8010fa0 0x7fd3e8013390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:42.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:42.840+0000 7fd3f7fff640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8010fa0 msgr2=0x7fd3e8013390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:42.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:42.840+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8010fa0 0x7fd3e8013390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:42.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:42.840+0000 7fd3f7fff640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8014480 legacy=0x7fd3e8006600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:42.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:42.840+0000 7fd406d9d640 1 -- reap_dead start 2023-11-04T01:57:42.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:42.840+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 0x7fd3e8010930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:42.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:42.840+0000 7fd3f7fff640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40806cc90 con 0x7fd3e801a540 2023-11-04T01:57:42.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:42.840+0000 7fd3f7fff640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4080b0e60 con 0x7fd3e8013ef0 2023-11-04T01:57:42.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:42.840+0000 7fd3f7fff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e8003ae0 2023-11-04T01:57:42.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:42.840+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e801a540 legacy=0x7fd3e801c930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:42.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:42.840+0000 7fd406d9d640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:42.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:42.840+0000 7fd406d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:42.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:42.840+0000 7fd40659c640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8013ef0 legacy=0x7fd3e8007fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:43.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:43.041+0000 7fd406d9d640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:43.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:43.041+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e801a540 legacy=0x7fd3e801c930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:43.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:43.041+0000 7fd406d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:43.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:43.041+0000 7fd40659c640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8013ef0 legacy=0x7fd3e8007fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:43.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:43.442+0000 7fd406d9d640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:43.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:43.442+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e801a540 legacy=0x7fd3e801c930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:43.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:43.442+0000 7fd406d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:43.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:43.442+0000 7fd40659c640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8013ef0 legacy=0x7fd3e8007fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:44.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:44.243+0000 7fd406d9d640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:44.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:44.243+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e801a540 legacy=0x7fd3e801c930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:44.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:44.243+0000 7fd406d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:44.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:44.243+0000 7fd40659c640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8013ef0 legacy=0x7fd3e8007fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:45.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:45.840+0000 7fd3f7fff640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:45.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:45.840+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8003ae0 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:45.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:45.840+0000 7fd3f7fff640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8013ef0 legacy=0x7fd3e8007fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:45.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:45.840+0000 7fd3f7fff640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e801a540 legacy=0x7fd3e801c930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:45.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:45.840+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013970 0x7fd3e8012fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:45.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:45.840+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80134f0 0x7fd3e8006600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:45.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:45.840+0000 7fd3f7fff640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e80134f0 2023-11-04T01:57:45.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:45.840+0000 7fd3f7fff640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e8008d50 con 0x7fd3e8013970 2023-11-04T01:57:45.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:45.840+0000 7fd40659c640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013970 msgr2=0x7fd3e8012fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:45.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:45.840+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80134f0 msgr2=0x7fd3e8006600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:45.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:45.840+0000 7fd40659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013970 0x7fd3e8012fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:45.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:45.840+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80134f0 0x7fd3e8006600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:46.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:46.041+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80134f0 msgr2=0x7fd3e8006600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:46.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:46.041+0000 7fd40659c640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013970 msgr2=0x7fd3e8012fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:46.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:46.041+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80134f0 0x7fd3e8006600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:46.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:46.041+0000 7fd40659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013970 0x7fd3e8012fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:46.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:46.442+0000 7fd40659c640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013970 msgr2=0x7fd3e8012fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:46.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:46.442+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80134f0 msgr2=0x7fd3e8006600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:46.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:46.442+0000 7fd40659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013970 0x7fd3e8012fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:46.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:46.442+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80134f0 0x7fd3e8006600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:47.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:47.243+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80134f0 msgr2=0x7fd3e8006600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:47.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:47.243+0000 7fd40659c640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013970 msgr2=0x7fd3e8012fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:47.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:47.243+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80134f0 0x7fd3e8006600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:47.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:47.243+0000 7fd40659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013970 0x7fd3e8012fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:48.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:48.841+0000 7fd3f7fff640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013970 msgr2=0x7fd3e8012fb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:48.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:48.841+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013970 0x7fd3e8012fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:48.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:48.841+0000 7fd3f7fff640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80134f0 msgr2=0x7fd3e8006600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:48.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:48.841+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80134f0 0x7fd3e8006600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:48.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:48.841+0000 7fd406d9d640 1 -- reap_dead start 2023-11-04T01:57:48.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:48.841+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8006b40 0x7fd3e800d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:48.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:48.841+0000 7fd3f7fff640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40806d1c0 con 0x7fd3e801a540 2023-11-04T01:57:48.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:48.841+0000 7fd3f7fff640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40806cc90 con 0x7fd3e8013970 2023-11-04T01:57:48.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:48.841+0000 7fd3f7fff640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e8006b40 2023-11-04T01:57:48.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:48.841+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e801a540 legacy=0x7fd3e8006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:48.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:48.841+0000 7fd40659c640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8006b40 msgr2=0x7fd3e800d030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:48.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:48.841+0000 7fd40659c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8006b40 0x7fd3e800d030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:48.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:48.841+0000 7fd406d9d640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8013970 legacy=0x7fd3e8019530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:49.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:49.042+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e801a540 legacy=0x7fd3e8006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:49.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:49.042+0000 7fd40659c640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8006b40 msgr2=0x7fd3e800d030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:49.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:49.042+0000 7fd406d9d640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8013970 legacy=0x7fd3e8019530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:49.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:49.042+0000 7fd40659c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8006b40 0x7fd3e800d030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:49.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:49.443+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e801a540 legacy=0x7fd3e8006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:49.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:49.443+0000 7fd40659c640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8006b40 msgr2=0x7fd3e800d030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:49.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:49.443+0000 7fd406d9d640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8013970 legacy=0x7fd3e8019530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:49.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:49.443+0000 7fd40659c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8006b40 0x7fd3e800d030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:50.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:50.244+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e801a540 legacy=0x7fd3e8006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:50.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:50.244+0000 7fd406d9d640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8013970 legacy=0x7fd3e8019530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:50.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:50.244+0000 7fd40659c640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8006b40 msgr2=0x7fd3e800d030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:50.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:50.244+0000 7fd40659c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8006b40 0x7fd3e800d030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:51.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:51.841+0000 7fd3f7fff640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8006b40 msgr2=0x7fd3e800d030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:51.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:51.841+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8006b40 0x7fd3e800d030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:51.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:51.841+0000 7fd3f7fff640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8013970 legacy=0x7fd3e8019530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:51.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:51.841+0000 7fd3f7fff640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e801a540 legacy=0x7fd3e8006fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:51.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:51.841+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 0x7fd3e8010930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:51.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:51.841+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005af0 0x7fd3e8012fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:51.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:51.841+0000 7fd3f7fff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e8005af0 2023-11-04T01:57:51.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:51.841+0000 7fd3f7fff640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e8008d50 con 0x7fd3e8013ef0 2023-11-04T01:57:51.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:51.841+0000 7fd405d9b640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005af0 msgr2=0x7fd3e8012fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:51.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:51.841+0000 7fd405d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005af0 0x7fd3e8012fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:51.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:51.841+0000 7fd40659c640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:51.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:51.841+0000 7fd40659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:52.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:52.042+0000 7fd405d9b640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005af0 msgr2=0x7fd3e8012fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:52.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:52.042+0000 7fd405d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005af0 0x7fd3e8012fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:52.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:52.042+0000 7fd40659c640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:52.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:52.042+0000 7fd40659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:52.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:52.443+0000 7fd405d9b640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005af0 msgr2=0x7fd3e8012fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:52.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:52.443+0000 7fd405d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005af0 0x7fd3e8012fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:52.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:52.443+0000 7fd40659c640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:52.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:52.443+0000 7fd40659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:53.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:53.244+0000 7fd405d9b640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005af0 msgr2=0x7fd3e8012fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:53.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:53.244+0000 7fd405d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005af0 0x7fd3e8012fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:53.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:53.244+0000 7fd40659c640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:53.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:53.244+0000 7fd40659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:54.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:54.841+0000 7fd3f7fff640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:54.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:54.841+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:54.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:54.841+0000 7fd3f7fff640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005af0 msgr2=0x7fd3e8012fb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:54.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:54.841+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005af0 0x7fd3e8012fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:54.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:54.841+0000 7fd406d9d640 1 -- reap_dead start 2023-11-04T01:57:54.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:54.841+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8006b40 0x7fd3e800d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:54.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:54.841+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 0x7fd3e8010930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:54.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:54.841+0000 7fd3f7fff640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4080b0e60 con 0x7fd3e8013970 2023-11-04T01:57:54.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:54.841+0000 7fd3f7fff640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e8006b40 2023-11-04T01:57:54.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:54.841+0000 7fd3f7fff640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e8008d50 con 0x7fd3e8013ef0 2023-11-04T01:57:54.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:54.841+0000 7fd406d9d640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:54.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:54.841+0000 7fd40659c640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8013970 legacy=0x7fd3e8019530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:54.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:54.841+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8006b40 msgr2=0x7fd3e800d030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:54.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:54.841+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:54.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:54.841+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8006b40 0x7fd3e800d030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:55.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:55.042+0000 7fd406d9d640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:55.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:55.042+0000 7fd40659c640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8013970 legacy=0x7fd3e8019530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:55.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:55.042+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8006b40 msgr2=0x7fd3e800d030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:55.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:55.042+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8006b40 0x7fd3e800d030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:55.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:55.042+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:55.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:55.443+0000 7fd406d9d640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:55.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:55.443+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:55.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:55.443+0000 7fd40659c640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8013970 legacy=0x7fd3e8019530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:55.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:55.443+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8006b40 msgr2=0x7fd3e800d030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:55.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:55.443+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8006b40 0x7fd3e800d030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:56.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:56.244+0000 7fd406d9d640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:57:56.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:56.244+0000 7fd40659c640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8013970 legacy=0x7fd3e8019530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:57:56.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:56.244+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:56.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:56.244+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8006b40 msgr2=0x7fd3e800d030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:57:56.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:56.244+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8006b40 0x7fd3e800d030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:57.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:57.841+0000 7fd3f7fff640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:57.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:57.841+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:57.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:57.841+0000 7fd3f7fff640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8006b40 msgr2=0x7fd3e800d030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:57.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:57.841+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8006b40 0x7fd3e800d030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:57.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:57.841+0000 7fd3f7fff640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8013970 legacy=0x7fd3e8019530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:57.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:57.841+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005af0 0x7fd3e8012fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:57.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:57.841+0000 7fd3f7fff640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40806d1c0 con 0x7fd3e8006600 2023-11-04T01:57:57.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:57.841+0000 7fd3f7fff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e8005af0 2023-11-04T01:57:57.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:57.841+0000 7fd40659c640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005af0 msgr2=0x7fd3e8012fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:57.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:57.841+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006600 legacy=0x7fd3e8008ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:57.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:57.841+0000 7fd40659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005af0 0x7fd3e8012fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:58.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:58.042+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006600 legacy=0x7fd3e8008ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:58.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:58.042+0000 7fd40659c640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005af0 msgr2=0x7fd3e8012fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:58.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:58.042+0000 7fd40659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005af0 0x7fd3e8012fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:58.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:58.443+0000 7fd40659c640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005af0 msgr2=0x7fd3e8012fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:58.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:58.443+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006600 legacy=0x7fd3e8008ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:58.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:58.443+0000 7fd40659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005af0 0x7fd3e8012fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:59.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:59.244+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006600 legacy=0x7fd3e8008ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:57:59.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:59.244+0000 7fd40659c640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005af0 msgr2=0x7fd3e8012fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:57:59.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:57:59.244+0000 7fd40659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005af0 0x7fd3e8012fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:00.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:00.841+0000 7fd3f7fff640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005af0 msgr2=0x7fd3e8012fb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:00.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:00.841+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005af0 0x7fd3e8012fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:00.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:00.841+0000 7fd3f7fff640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006600 legacy=0x7fd3e8008ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:00.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:00.841+0000 7fd406d9d640 1 -- reap_dead start 2023-11-04T01:58:00.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:00.841+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 0x7fd3e8010930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:00.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:00.841+0000 7fd3f7fff640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4080b0e60 con 0x7fd3e8006600 2023-11-04T01:58:00.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:00.841+0000 7fd3f7fff640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40806d1c0 con 0x7fd3e8013970 2023-11-04T01:58:00.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:00.841+0000 7fd3f7fff640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e8013ef0 2023-11-04T01:58:00.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:00.841+0000 7fd406d9d640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006600 legacy=0x7fd3e8008ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:00.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:00.841+0000 7fd40659c640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:00.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:00.841+0000 7fd405d9b640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8013970 legacy=0x7fd3e8019530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:00.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:00.841+0000 7fd40659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:01.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:01.042+0000 7fd406d9d640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006600 legacy=0x7fd3e8008ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:01.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:01.042+0000 7fd40659c640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:01.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:01.042+0000 7fd405d9b640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8013970 legacy=0x7fd3e8019530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:01.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:01.042+0000 7fd40659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:01.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:01.443+0000 7fd406d9d640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006600 legacy=0x7fd3e8008ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:01.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:01.443+0000 7fd40659c640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:01.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:01.443+0000 7fd405d9b640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8013970 legacy=0x7fd3e8019530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:01.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:01.443+0000 7fd40659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:02.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:02.244+0000 7fd406d9d640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006600 legacy=0x7fd3e8008ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:02.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:02.244+0000 7fd40659c640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:02.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:02.244+0000 7fd405d9b640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8013970 legacy=0x7fd3e8019530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:02.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:02.244+0000 7fd40659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:03.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:03.841+0000 7fd3f7fff640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:03.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:03.841+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:03.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:03.841+0000 7fd3f7fff640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8013970 legacy=0x7fd3e8019530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:03.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:03.841+0000 7fd3f7fff640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006600 legacy=0x7fd3e8008ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:03.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:03.841+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006b40 0x7fd3e8012fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:03.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:03.841+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8005ac0 0x7fd3e8007fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:03.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:03.841+0000 7fd3f7fff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e8006b40 2023-11-04T01:58:03.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:03.841+0000 7fd3f7fff640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e8008d50 con 0x7fd3e8005ac0 2023-11-04T01:58:03.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:03.841+0000 7fd40659c640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006b40 msgr2=0x7fd3e8012fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:03.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:03.841+0000 7fd40659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006b40 0x7fd3e8012fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:03.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:03.841+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8005ac0 msgr2=0x7fd3e8007fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:03.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:03.841+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8005ac0 0x7fd3e8007fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:04.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:04.042+0000 7fd40659c640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006b40 msgr2=0x7fd3e8012fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:04.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:04.042+0000 7fd40659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006b40 0x7fd3e8012fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:04.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:04.042+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8005ac0 msgr2=0x7fd3e8007fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:04.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:04.042+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8005ac0 0x7fd3e8007fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:04.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:04.443+0000 7fd40659c640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006b40 msgr2=0x7fd3e8012fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:04.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:04.443+0000 7fd40659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006b40 0x7fd3e8012fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:04.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:04.443+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8005ac0 msgr2=0x7fd3e8007fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:04.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:04.443+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8005ac0 0x7fd3e8007fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:04.600 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:58:04.603 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:58:05.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:05.244+0000 7fd40659c640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006b40 msgr2=0x7fd3e8012fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:05.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:05.244+0000 7fd40659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006b40 0x7fd3e8012fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:05.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:05.244+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8005ac0 msgr2=0x7fd3e8007fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:05.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:05.244+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8005ac0 0x7fd3e8007fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:06.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:06.841+0000 7fd3f7fff640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8005ac0 msgr2=0x7fd3e8007fb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:06.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:06.841+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8005ac0 0x7fd3e8007fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:06.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:06.841+0000 7fd3f7fff640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006b40 msgr2=0x7fd3e8012fb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:06.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:06.841+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006b40 0x7fd3e8012fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:06.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:06.841+0000 7fd406d9d640 1 -- reap_dead start 2023-11-04T01:58:06.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:06.841+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006600 0x7fd3e8010930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:06.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:06.842+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8012f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:06.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:06.842+0000 7fd3f7fff640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40806cc90 con 0x7fd3e8005ac0 2023-11-04T01:58:06.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:06.842+0000 7fd3f7fff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e8006600 2023-11-04T01:58:06.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:06.842+0000 7fd3f7fff640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e8008d50 con 0x7fd3e8013ef0 2023-11-04T01:58:06.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:06.842+0000 7fd40659c640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8005ac0 legacy=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:06.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:06.842+0000 7fd405d9b640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006600 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:06.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:06.842+0000 7fd405d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006600 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:06.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:06.842+0000 7fd406d9d640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8012f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:06.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:06.842+0000 7fd406d9d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8012f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:07.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:07.043+0000 7fd40659c640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8005ac0 legacy=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:07.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:07.043+0000 7fd405d9b640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006600 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:07.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:07.043+0000 7fd405d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006600 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:07.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:07.043+0000 7fd406d9d640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8012f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:07.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:07.043+0000 7fd406d9d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8012f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:07.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:07.444+0000 7fd40659c640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8005ac0 legacy=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:07.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:07.444+0000 7fd405d9b640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006600 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:07.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:07.444+0000 7fd405d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006600 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:07.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:07.444+0000 7fd406d9d640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8012f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:07.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:07.444+0000 7fd406d9d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8012f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:08.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:08.245+0000 7fd405d9b640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006600 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:08.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:08.245+0000 7fd40659c640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8005ac0 legacy=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:08.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:08.245+0000 7fd405d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006600 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:08.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:08.245+0000 7fd406d9d640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8012f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:08.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:08.245+0000 7fd406d9d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8012f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:09.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:09.842+0000 7fd3f7fff640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8012f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:09.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:09.842+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8012f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:09.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:09.842+0000 7fd3f7fff640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006600 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:09.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:09.842+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006600 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:09.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:09.842+0000 7fd3f7fff640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8005ac0 legacy=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:09.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:09.842+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e800c700 0x7fd3e800cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:09.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:09.842+0000 7fd3f7fff640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4080b0e60 con 0x7fd3e80138d0 2023-11-04T01:58:09.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:09.842+0000 7fd3f7fff640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e800c700 2023-11-04T01:58:09.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:09.842+0000 7fd40659c640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e800afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:09.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:09.842+0000 7fd405d9b640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e800c700 msgr2=0x7fd3e800cbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:09.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:09.842+0000 7fd405d9b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e800c700 0x7fd3e800cbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:10.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:10.043+0000 7fd40659c640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e800afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:10.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:10.043+0000 7fd405d9b640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e800c700 msgr2=0x7fd3e800cbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:10.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:10.043+0000 7fd405d9b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e800c700 0x7fd3e800cbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:10.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:10.444+0000 7fd40659c640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e800afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:10.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:10.444+0000 7fd405d9b640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e800c700 msgr2=0x7fd3e800cbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:10.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:10.444+0000 7fd405d9b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e800c700 0x7fd3e800cbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:11.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:11.245+0000 7fd40659c640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e800afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:11.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:11.245+0000 7fd405d9b640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e800c700 msgr2=0x7fd3e800cbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:11.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:11.245+0000 7fd405d9b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e800c700 0x7fd3e800cbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:12.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:12.842+0000 7fd3f7fff640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e800c700 msgr2=0x7fd3e800cbb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:12.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:12.842+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e800c700 0x7fd3e800cbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:12.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:12.842+0000 7fd3f7fff640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e800afe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:12.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:12.842+0000 7fd406d9d640 1 -- reap_dead start 2023-11-04T01:58:12.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:12.842+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006600 0x7fd3e8010930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:12.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:12.842+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8012f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:12.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:12.842+0000 7fd3f7fff640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40806cc90 con 0x7fd3e80138d0 2023-11-04T01:58:12.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:12.842+0000 7fd3f7fff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e8006600 2023-11-04T01:58:12.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:12.842+0000 7fd3f7fff640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e8008d50 con 0x7fd3e8013ef0 2023-11-04T01:58:12.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:12.842+0000 7fd40659c640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006600 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:12.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:12.842+0000 7fd40659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006600 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:12.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:12.842+0000 7fd406d9d640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e800afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:12.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:12.842+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8012f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:12.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:12.842+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8012f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:13.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:13.043+0000 7fd40659c640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006600 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:13.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:13.043+0000 7fd40659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006600 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:13.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:13.043+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8012f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:13.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:13.043+0000 7fd406d9d640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e800afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:13.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:13.043+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8012f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:13.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:13.444+0000 7fd40659c640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006600 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:13.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:13.444+0000 7fd40659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006600 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:13.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:13.444+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8012f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:13.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:13.444+0000 7fd406d9d640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e800afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:13.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:13.444+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8012f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:14.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:14.245+0000 7fd40659c640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006600 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:14.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:14.245+0000 7fd40659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006600 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:14.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:14.245+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8012f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:14.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:14.245+0000 7fd406d9d640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e800afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:14.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:14.245+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8012f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:15.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:15.842+0000 7fd3f7fff640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8012f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:15.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:15.842+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8012f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:15.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:15.842+0000 7fd3f7fff640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006600 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:15.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:15.842+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006600 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:15.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:15.842+0000 7fd3f7fff640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e800afe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:15.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:15.842+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e800c700 0x7fd3e800cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:15.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:15.842+0000 7fd3f7fff640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4080b0e60 con 0x7fd3e8005ac0 2023-11-04T01:58:15.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:15.842+0000 7fd3f7fff640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e800c700 2023-11-04T01:58:15.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:15.842+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8005ac0 legacy=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:15.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:15.842+0000 7fd40659c640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e800c700 msgr2=0x7fd3e800cbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:15.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:15.842+0000 7fd40659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e800c700 0x7fd3e800cbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:16.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:16.043+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8005ac0 legacy=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:16.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:16.043+0000 7fd40659c640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e800c700 msgr2=0x7fd3e800cbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:16.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:16.043+0000 7fd40659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e800c700 0x7fd3e800cbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:16.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:16.444+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8005ac0 legacy=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:16.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:16.444+0000 7fd40659c640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e800c700 msgr2=0x7fd3e800cbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:16.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:16.444+0000 7fd40659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e800c700 0x7fd3e800cbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:17.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:17.245+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8005ac0 legacy=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:17.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:17.245+0000 7fd40659c640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e800c700 msgr2=0x7fd3e800cbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:17.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:17.245+0000 7fd40659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e800c700 0x7fd3e800cbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:18.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:18.843+0000 7fd3f7fff640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e800c700 msgr2=0x7fd3e800cbb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:18.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:18.843+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e800c700 0x7fd3e800cbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:18.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:18.843+0000 7fd3f7fff640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8005ac0 legacy=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:18.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:18.843+0000 7fd406d9d640 1 -- reap_dead start 2023-11-04T01:58:18.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:18.843+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006600 0x7fd3e8010930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:18.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:18.843+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8012f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:18.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:18.843+0000 7fd3f7fff640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40806cc90 con 0x7fd3e80138d0 2023-11-04T01:58:18.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:18.843+0000 7fd3f7fff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e8006600 2023-11-04T01:58:18.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:18.843+0000 7fd3f7fff640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e8008d50 con 0x7fd3e8013ef0 2023-11-04T01:58:18.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:18.843+0000 7fd40659c640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006600 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:18.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:18.843+0000 7fd40659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006600 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:18.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:18.843+0000 7fd405d9b640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e800afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:18.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:18.843+0000 7fd406d9d640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8012f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:18.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:18.843+0000 7fd406d9d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8012f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:19.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:19.044+0000 7fd40659c640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006600 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:19.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:19.044+0000 7fd40659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006600 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:19.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:19.044+0000 7fd405d9b640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e800afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:19.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:19.044+0000 7fd406d9d640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8012f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:19.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:19.044+0000 7fd406d9d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8012f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:19.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:19.445+0000 7fd40659c640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006600 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:19.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:19.445+0000 7fd40659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006600 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:19.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:19.445+0000 7fd405d9b640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e800afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:19.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:19.445+0000 7fd406d9d640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8012f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:19.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:19.445+0000 7fd406d9d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8012f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:20.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:20.246+0000 7fd40659c640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006600 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:20.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:20.246+0000 7fd40659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006600 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:20.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:20.246+0000 7fd406d9d640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8012f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:20.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:20.246+0000 7fd405d9b640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e800afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:20.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:20.246+0000 7fd406d9d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8012f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:21.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:21.843+0000 7fd3f7fff640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8012f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:21.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:21.843+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8012f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:21.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:21.843+0000 7fd3f7fff640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006600 msgr2=0x7fd3e8010930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:21.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:21.843+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8006600 0x7fd3e8010930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:21.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:21.843+0000 7fd3f7fff640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e800afe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:21.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:21.843+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8005ac0 0x7fd3e800cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:21.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:21.843+0000 7fd3f7fff640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4080b0e60 con 0x7fd3e800c700 2023-11-04T01:58:21.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:21.843+0000 7fd3f7fff640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e8005ac0 2023-11-04T01:58:21.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:21.843+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e800c700 legacy=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:21.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:21.843+0000 7fd40659c640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8005ac0 msgr2=0x7fd3e800cbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:21.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:21.843+0000 7fd40659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8005ac0 0x7fd3e800cbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:22.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:22.044+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e800c700 legacy=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:22.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:22.044+0000 7fd40659c640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8005ac0 msgr2=0x7fd3e800cbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:22.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:22.044+0000 7fd40659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8005ac0 0x7fd3e800cbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:22.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:22.445+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e800c700 legacy=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:22.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:22.445+0000 7fd40659c640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8005ac0 msgr2=0x7fd3e800cbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:22.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:22.445+0000 7fd40659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8005ac0 0x7fd3e800cbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:23.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:23.246+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e800c700 legacy=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:23.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:23.246+0000 7fd40659c640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8005ac0 msgr2=0x7fd3e800cbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:23.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:23.246+0000 7fd40659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8005ac0 0x7fd3e800cbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:24.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:24.843+0000 7fd3f7fff640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8005ac0 msgr2=0x7fd3e800cbb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:24.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:24.843+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8005ac0 0x7fd3e800cbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:24.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:24.843+0000 7fd3f7fff640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e800c700 legacy=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:24.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:24.843+0000 7fd406d9d640 1 -- reap_dead start 2023-11-04T01:58:24.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:24.843+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005ac0 0x7fd3e800cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:24.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:24.843+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8006600 0x7fd3e8006fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:24.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:24.843+0000 7fd3f7fff640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40806cc90 con 0x7fd3e800d150 2023-11-04T01:58:24.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:24.843+0000 7fd3f7fff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e8005ac0 2023-11-04T01:58:24.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:24.843+0000 7fd3f7fff640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e8008d50 con 0x7fd3e8006600 2023-11-04T01:58:24.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:24.843+0000 7fd40659c640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e800d150 legacy=0x7fd3e801d550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:24.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:24.843+0000 7fd405d9b640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005ac0 msgr2=0x7fd3e800cbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:24.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:24.843+0000 7fd405d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005ac0 0x7fd3e800cbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:24.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:24.843+0000 7fd406d9d640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8006600 msgr2=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:24.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:24.843+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8006600 0x7fd3e8006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:25.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:25.044+0000 7fd40659c640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e800d150 legacy=0x7fd3e801d550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:25.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:25.044+0000 7fd405d9b640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005ac0 msgr2=0x7fd3e800cbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:25.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:25.044+0000 7fd405d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005ac0 0x7fd3e800cbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:25.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:25.044+0000 7fd406d9d640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8006600 msgr2=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:25.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:25.044+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8006600 0x7fd3e8006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:25.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:25.445+0000 7fd40659c640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e800d150 legacy=0x7fd3e801d550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:25.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:25.445+0000 7fd405d9b640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005ac0 msgr2=0x7fd3e800cbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:25.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:25.445+0000 7fd405d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005ac0 0x7fd3e800cbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:25.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:25.445+0000 7fd406d9d640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8006600 msgr2=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:25.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:25.445+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8006600 0x7fd3e8006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:26.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:26.246+0000 7fd405d9b640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005ac0 msgr2=0x7fd3e800cbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:26.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:26.246+0000 7fd40659c640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e800d150 legacy=0x7fd3e801d550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:26.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:26.246+0000 7fd405d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005ac0 0x7fd3e800cbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:26.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:26.246+0000 7fd406d9d640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8006600 msgr2=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:26.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:26.246+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8006600 0x7fd3e8006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:27.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:27.843+0000 7fd3f7fff640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8006600 msgr2=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:27.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:27.843+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8006600 0x7fd3e8006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:27.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:27.843+0000 7fd3f7fff640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005ac0 msgr2=0x7fd3e800cbb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:27.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:27.843+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005ac0 0x7fd3e800cbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:27.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:27.843+0000 7fd3f7fff640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e800d150 legacy=0x7fd3e801d550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:27.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:27.843+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8010910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:27.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:27.843+0000 7fd3f7fff640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4080b0e60 con 0x7fd3e80138d0 2023-11-04T01:58:27.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:27.843+0000 7fd3f7fff640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e8013ef0 2023-11-04T01:58:27.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:27.843+0000 7fd40659c640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e80074e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:27.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:27.843+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8010910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:27.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:27.843+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8010910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:28.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:28.044+0000 7fd40659c640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e80074e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:28.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:28.044+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8010910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:28.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:28.044+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8010910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:28.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:28.445+0000 7fd40659c640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e80074e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:28.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:28.445+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8010910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:28.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:28.445+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8010910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:29.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:29.246+0000 7fd40659c640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e80074e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:29.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:29.246+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8010910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:29.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:29.246+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8010910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:30.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:30.844+0000 7fd3f7fff640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8010910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:30.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:30.844+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8010910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:30.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:30.844+0000 7fd3f7fff640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e80074e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:30.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:30.844+0000 7fd406d9d640 1 -- reap_dead start 2023-11-04T01:58:30.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:30.844+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005ac0 0x7fd3e800cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:30.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:30.844+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8006600 0x7fd3e8006fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:30.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:30.844+0000 7fd3f7fff640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40806cc90 con 0x7fd3e80138d0 2023-11-04T01:58:30.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:30.844+0000 7fd3f7fff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e8005ac0 2023-11-04T01:58:30.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:30.844+0000 7fd3f7fff640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e8008d50 con 0x7fd3e8006600 2023-11-04T01:58:30.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:30.844+0000 7fd40659c640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005ac0 msgr2=0x7fd3e800cb90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:30.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:30.844+0000 7fd40659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005ac0 0x7fd3e800cb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:30.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:30.844+0000 7fd406d9d640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8006600 msgr2=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:30.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:30.844+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8006600 0x7fd3e8006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:30.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:30.844+0000 7fd405d9b640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e80074e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:31.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:31.045+0000 7fd40659c640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005ac0 msgr2=0x7fd3e800cb90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:31.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:31.045+0000 7fd40659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005ac0 0x7fd3e800cb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:31.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:31.045+0000 7fd406d9d640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8006600 msgr2=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:31.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:31.045+0000 7fd405d9b640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e80074e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:31.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:31.045+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8006600 0x7fd3e8006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:31.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:31.446+0000 7fd40659c640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005ac0 msgr2=0x7fd3e800cb90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:31.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:31.446+0000 7fd40659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005ac0 0x7fd3e800cb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:31.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:31.446+0000 7fd405d9b640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e80074e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:31.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:31.446+0000 7fd406d9d640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8006600 msgr2=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:31.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:31.446+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8006600 0x7fd3e8006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:32.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:32.247+0000 7fd40659c640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005ac0 msgr2=0x7fd3e800cb90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:32.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:32.247+0000 7fd40659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005ac0 0x7fd3e800cb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:32.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:32.247+0000 7fd405d9b640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e80074e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:32.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:32.247+0000 7fd406d9d640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8006600 msgr2=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:32.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:32.247+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8006600 0x7fd3e8006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:33.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:33.844+0000 7fd3f7fff640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8006600 msgr2=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:33.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:33.844+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8006600 0x7fd3e8006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:33.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:33.844+0000 7fd3f7fff640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005ac0 msgr2=0x7fd3e800cb90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:33.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:33.844+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8005ac0 0x7fd3e800cb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:33.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:33.844+0000 7fd3f7fff640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e80074e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:33.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:33.844+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8010910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:33.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:33.844+0000 7fd3f7fff640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4080b0e60 con 0x7fd3e800d150 2023-11-04T01:58:33.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:33.844+0000 7fd3f7fff640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e8013ef0 2023-11-04T01:58:33.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:33.844+0000 7fd40659c640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e800d150 legacy=0x7fd3e800bff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:33.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:33.844+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8010910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:33.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:33.844+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8010910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:34.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:34.045+0000 7fd40659c640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e800d150 legacy=0x7fd3e800bff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:34.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:34.045+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8010910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:34.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:34.045+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8010910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:34.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:34.446+0000 7fd40659c640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e800d150 legacy=0x7fd3e800bff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:34.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:34.446+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8010910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:34.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:34.446+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8010910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:34.736 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:58:34.739 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:58:35.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:35.247+0000 7fd40659c640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e800d150 legacy=0x7fd3e800bff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:35.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:35.247+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8010910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:35.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:35.247+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8010910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:36.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:36.844+0000 7fd3f7fff640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8010910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:36.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:36.844+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8010910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:36.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:36.844+0000 7fd3f7fff640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e800d150 legacy=0x7fd3e800bff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:36.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:36.844+0000 7fd406d9d640 1 -- reap_dead start 2023-11-04T01:58:36.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:36.844+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e800d150 0x7fd3e8010910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:36.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:36.844+0000 7fd3f7fff640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40806cc90 con 0x7fd3e8006600 2023-11-04T01:58:36.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:36.844+0000 7fd3f7fff640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4080b0e60 con 0x7fd3e8005ac0 2023-11-04T01:58:36.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:36.844+0000 7fd3f7fff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e800d150 2023-11-04T01:58:36.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:36.844+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006600 legacy=0x7fd3e8010f70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:36.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:36.844+0000 7fd406d9d640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e800d150 msgr2=0x7fd3e8010910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:36.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:36.844+0000 7fd406d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e800d150 0x7fd3e8010910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:36.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:36.844+0000 7fd40659c640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8005ac0 legacy=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:37.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:37.045+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006600 legacy=0x7fd3e8010f70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:37.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:37.045+0000 7fd406d9d640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e800d150 msgr2=0x7fd3e8010910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:37.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:37.045+0000 7fd406d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e800d150 0x7fd3e8010910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:37.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:37.045+0000 7fd40659c640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8005ac0 legacy=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:37.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:37.446+0000 7fd406d9d640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e800d150 msgr2=0x7fd3e8010910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:37.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:37.446+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006600 legacy=0x7fd3e8010f70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:37.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:37.446+0000 7fd406d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e800d150 0x7fd3e8010910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:37.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:37.446+0000 7fd40659c640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8005ac0 legacy=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:38.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:38.247+0000 7fd406d9d640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e800d150 msgr2=0x7fd3e8010910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:38.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:38.247+0000 7fd406d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e800d150 0x7fd3e8010910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:38.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:38.247+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006600 legacy=0x7fd3e8010f70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:38.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:38.247+0000 7fd40659c640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8005ac0 legacy=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:39.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:39.845+0000 7fd3f7fff640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e800d150 msgr2=0x7fd3e8010910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:39.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:39.845+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e800d150 0x7fd3e8010910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:39.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:39.845+0000 7fd3f7fff640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8005ac0 legacy=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:39.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:39.845+0000 7fd3f7fff640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006600 legacy=0x7fd3e8010f70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:39.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:39.845+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80138d0 0x7fd3e800cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:39.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:39.845+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 0x7fd3e8012690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:39.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:39.845+0000 7fd3f7fff640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e80138d0 2023-11-04T01:58:39.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:39.845+0000 7fd3f7fff640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e8008d50 con 0x7fd3e8013ef0 2023-11-04T01:58:39.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:39.845+0000 7fd40659c640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80138d0 msgr2=0x7fd3e800cb30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:39.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:39.845+0000 7fd405d9b640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 msgr2=0x7fd3e8012690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:39.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:39.845+0000 7fd40659c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80138d0 0x7fd3e800cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:39.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:39.845+0000 7fd405d9b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 0x7fd3e8012690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:40.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:40.046+0000 7fd40659c640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80138d0 msgr2=0x7fd3e800cb30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:40.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:40.046+0000 7fd405d9b640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 msgr2=0x7fd3e8012690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:40.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:40.046+0000 7fd40659c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80138d0 0x7fd3e800cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:40.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:40.046+0000 7fd405d9b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 0x7fd3e8012690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:40.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:40.447+0000 7fd40659c640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80138d0 msgr2=0x7fd3e800cb30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:40.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:40.447+0000 7fd405d9b640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 msgr2=0x7fd3e8012690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:40.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:40.447+0000 7fd40659c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80138d0 0x7fd3e800cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:40.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:40.447+0000 7fd405d9b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 0x7fd3e8012690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:41.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:41.247+0000 7fd40659c640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80138d0 msgr2=0x7fd3e800cb30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:41.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:41.247+0000 7fd405d9b640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 msgr2=0x7fd3e8012690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:41.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:41.247+0000 7fd40659c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80138d0 0x7fd3e800cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:41.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:41.247+0000 7fd405d9b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 0x7fd3e8012690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:42.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:42.844+0000 7fd3f7fff640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 msgr2=0x7fd3e8012690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:42.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:42.844+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 0x7fd3e8012690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:42.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:42.844+0000 7fd3f7fff640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80138d0 msgr2=0x7fd3e800cb30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:42.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:42.844+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80138d0 0x7fd3e800cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:42.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:42.844+0000 7fd406d9d640 1 -- reap_dead start 2023-11-04T01:58:42.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:42.844+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 0x7fd3e8011f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:42.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:42.844+0000 7fd3f7fff640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40806d1c0 con 0x7fd3e8006600 2023-11-04T01:58:42.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:42.844+0000 7fd3f7fff640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40806cc90 con 0x7fd3e8005ac0 2023-11-04T01:58:42.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:42.844+0000 7fd3f7fff640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e8013ef0 2023-11-04T01:58:42.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:42.844+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006600 legacy=0x7fd3e8007fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:42.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:42.844+0000 7fd40659c640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8005ac0 legacy=0x7fd3e8012bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:42.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:42.844+0000 7fd406d9d640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 msgr2=0x7fd3e8011f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:42.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:42.844+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 0x7fd3e8011f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:43.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:43.045+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006600 legacy=0x7fd3e8007fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:43.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:43.045+0000 7fd40659c640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8005ac0 legacy=0x7fd3e8012bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:43.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:43.045+0000 7fd406d9d640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 msgr2=0x7fd3e8011f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:43.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:43.045+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 0x7fd3e8011f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:43.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:43.446+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006600 legacy=0x7fd3e8007fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:43.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:43.446+0000 7fd40659c640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8005ac0 legacy=0x7fd3e8012bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:43.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:43.446+0000 7fd406d9d640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 msgr2=0x7fd3e8011f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:43.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:43.446+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 0x7fd3e8011f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:44.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:44.247+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006600 legacy=0x7fd3e8007fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:44.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:44.247+0000 7fd40659c640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8005ac0 legacy=0x7fd3e8012bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:44.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:44.247+0000 7fd406d9d640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 msgr2=0x7fd3e8011f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:44.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:44.247+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 0x7fd3e8011f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:45.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:45.844+0000 7fd3f7fff640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 msgr2=0x7fd3e8011f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:45.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:45.844+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8013ef0 0x7fd3e8011f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:45.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:45.844+0000 7fd3f7fff640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e8005ac0 legacy=0x7fd3e8012bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:45.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:45.844+0000 7fd3f7fff640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006600 legacy=0x7fd3e8007fb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:45.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:45.844+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e800d150 0x7fd3e8010910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:45.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:45.844+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80138d0 0x7fd3e800cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:45.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:45.844+0000 7fd3f7fff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e800d150 2023-11-04T01:58:45.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:45.844+0000 7fd3f7fff640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e8008d50 con 0x7fd3e80138d0 2023-11-04T01:58:45.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:45.844+0000 7fd40659c640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e800d150 msgr2=0x7fd3e8010910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:45.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:45.844+0000 7fd40659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e800d150 0x7fd3e8010910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:45.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:45.844+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80138d0 msgr2=0x7fd3e800cb30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:45.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:45.844+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80138d0 0x7fd3e800cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:46.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:46.045+0000 7fd40659c640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e800d150 msgr2=0x7fd3e8010910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:46.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:46.045+0000 7fd40659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e800d150 0x7fd3e8010910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:46.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:46.045+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80138d0 msgr2=0x7fd3e800cb30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:46.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:46.045+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80138d0 0x7fd3e800cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:46.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:46.446+0000 7fd40659c640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e800d150 msgr2=0x7fd3e8010910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:46.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:46.446+0000 7fd40659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e800d150 0x7fd3e8010910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:46.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:46.446+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80138d0 msgr2=0x7fd3e800cb30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:46.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:46.446+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80138d0 0x7fd3e800cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:47.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:47.247+0000 7fd40659c640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e800d150 msgr2=0x7fd3e8010910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:47.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:47.247+0000 7fd40659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e800d150 0x7fd3e8010910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:47.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:47.247+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80138d0 msgr2=0x7fd3e800cb30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:47.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:47.247+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80138d0 0x7fd3e800cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:48.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:48.844+0000 7fd3f7fff640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80138d0 msgr2=0x7fd3e800cb30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:48.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:48.844+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80138d0 0x7fd3e800cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:48.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:48.844+0000 7fd3f7fff640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e800d150 msgr2=0x7fd3e8010910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:48.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:48.844+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e800d150 0x7fd3e8010910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:48.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:48.844+0000 7fd406d9d640 1 -- reap_dead start 2023-11-04T01:58:48.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:48.844+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8005ac0 0x7fd3e800cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:48.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:48.844+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8010910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:48.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:48.844+0000 7fd3f7fff640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4080b0e60 con 0x7fd3e8006600 2023-11-04T01:58:48.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:48.845+0000 7fd3f7fff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e8013ef0 2023-11-04T01:58:48.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:48.845+0000 7fd3f7fff640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e8008d50 con 0x7fd3e8005ac0 2023-11-04T01:58:48.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:48.845+0000 7fd40659c640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006600 legacy=0x7fd3e8007fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:48.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:48.845+0000 7fd406d9d640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8010910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:48.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:48.845+0000 7fd406d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8010910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:48.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:48.845+0000 7fd405d9b640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8005ac0 msgr2=0x7fd3e800cb30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:48.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:48.845+0000 7fd405d9b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8005ac0 0x7fd3e800cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:49.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:49.046+0000 7fd406d9d640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8010910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:49.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:49.046+0000 7fd40659c640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006600 legacy=0x7fd3e8007fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:49.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:49.046+0000 7fd406d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8010910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:49.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:49.046+0000 7fd405d9b640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8005ac0 msgr2=0x7fd3e800cb30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:49.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:49.046+0000 7fd405d9b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8005ac0 0x7fd3e800cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:49.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:49.447+0000 7fd40659c640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006600 legacy=0x7fd3e8007fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:49.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:49.447+0000 7fd406d9d640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8010910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:49.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:49.447+0000 7fd406d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8010910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:49.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:49.447+0000 7fd405d9b640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8005ac0 msgr2=0x7fd3e800cb30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:49.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:49.447+0000 7fd405d9b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8005ac0 0x7fd3e800cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:50.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:50.248+0000 7fd406d9d640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8010910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:50.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:50.248+0000 7fd40659c640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006600 legacy=0x7fd3e8007fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:50.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:50.248+0000 7fd406d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8010910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:50.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:50.248+0000 7fd405d9b640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8005ac0 msgr2=0x7fd3e800cb30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:50.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:50.248+0000 7fd405d9b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8005ac0 0x7fd3e800cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:51.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:51.845+0000 7fd3f7fff640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8005ac0 msgr2=0x7fd3e800cb30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:51.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:51.845+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8005ac0 0x7fd3e800cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:51.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:51.845+0000 7fd3f7fff640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8010910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:51.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:51.845+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8010910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:51.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:51.845+0000 7fd3f7fff640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006600 legacy=0x7fd3e8007fb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:51.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:51.845+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80076b0 0x7fd3e800afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:51.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:51.845+0000 7fd3f7fff640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40806d1c0 con 0x7fd3e80138d0 2023-11-04T01:58:51.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:51.845+0000 7fd3f7fff640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e80076b0 2023-11-04T01:58:51.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:51.845+0000 7fd40659c640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:51.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:51.845+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80076b0 msgr2=0x7fd3e800afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:51.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:51.845+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80076b0 0x7fd3e800afe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:52.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:52.046+0000 7fd40659c640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:52.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:52.046+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80076b0 msgr2=0x7fd3e800afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:52.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:52.046+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80076b0 0x7fd3e800afe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:52.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:52.447+0000 7fd40659c640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:52.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:52.447+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80076b0 msgr2=0x7fd3e800afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:52.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:52.447+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80076b0 0x7fd3e800afe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:53.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:53.248+0000 7fd40659c640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:53.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:53.248+0000 7fd405d9b640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80076b0 msgr2=0x7fd3e800afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:53.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:53.248+0000 7fd405d9b640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80076b0 0x7fd3e800afe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:54.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:54.845+0000 7fd3f7fff640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80076b0 msgr2=0x7fd3e800afe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:54.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:54.845+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80076b0 0x7fd3e800afe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:54.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:54.845+0000 7fd3f7fff640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:54.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:54.845+0000 7fd406d9d640 1 -- reap_dead start 2023-11-04T01:58:54.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:54.845+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8010910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:54.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:54.845+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80076b0 0x7fd3e800afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:54.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:54.845+0000 7fd3f7fff640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4080b0e60 con 0x7fd3e80138d0 2023-11-04T01:58:54.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:54.845+0000 7fd3f7fff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e8013ef0 2023-11-04T01:58:54.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:54.845+0000 7fd3f7fff640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e8008d50 con 0x7fd3e80076b0 2023-11-04T01:58:54.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:54.845+0000 7fd40659c640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8010910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:54.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:54.845+0000 7fd40659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8010910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:54.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:54.845+0000 7fd406d9d640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80076b0 msgr2=0x7fd3e800afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:54.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:54.845+0000 7fd406d9d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80076b0 0x7fd3e800afe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:54.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:54.845+0000 7fd405d9b640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:55.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:55.046+0000 7fd40659c640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8010910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:55.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:55.046+0000 7fd40659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8010910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:55.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:55.046+0000 7fd405d9b640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:55.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:55.046+0000 7fd406d9d640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80076b0 msgr2=0x7fd3e800afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:55.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:55.046+0000 7fd406d9d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80076b0 0x7fd3e800afe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:55.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:55.447+0000 7fd40659c640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8010910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:55.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:55.447+0000 7fd40659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8010910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:55.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:55.447+0000 7fd406d9d640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80076b0 msgr2=0x7fd3e800afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:55.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:55.447+0000 7fd405d9b640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:55.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:55.447+0000 7fd406d9d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80076b0 0x7fd3e800afe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:56.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:56.248+0000 7fd40659c640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8010910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:58:56.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:56.248+0000 7fd40659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8010910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:56.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:56.248+0000 7fd406d9d640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80076b0 msgr2=0x7fd3e800afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:58:56.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:56.248+0000 7fd405d9b640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:58:56.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:56.248+0000 7fd406d9d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80076b0 0x7fd3e800afe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:57.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:57.845+0000 7fd3f7fff640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80076b0 msgr2=0x7fd3e800afe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:57.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:57.845+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80076b0 0x7fd3e800afe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:57.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:57.845+0000 7fd3f7fff640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8010910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:57.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:57.845+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8010910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:57.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:57.845+0000 7fd3f7fff640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:57.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:57.845+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8005ac0 0x7fd3e800cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:57.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:57.845+0000 7fd3f7fff640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40806d1c0 con 0x7fd3e8006600 2023-11-04T01:58:57.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:57.845+0000 7fd3f7fff640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e8005ac0 2023-11-04T01:58:57.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:57.845+0000 7fd40659c640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006600 legacy=0x7fd3e8007ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:57.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:57.845+0000 7fd405d9b640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8005ac0 msgr2=0x7fd3e800cb30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:57.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:57.845+0000 7fd405d9b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8005ac0 0x7fd3e800cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:58.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:58.046+0000 7fd40659c640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006600 legacy=0x7fd3e8007ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:58.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:58.046+0000 7fd405d9b640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8005ac0 msgr2=0x7fd3e800cb30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:58.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:58.046+0000 7fd405d9b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8005ac0 0x7fd3e800cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:58.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:58.447+0000 7fd40659c640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006600 legacy=0x7fd3e8007ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:58.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:58.447+0000 7fd405d9b640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8005ac0 msgr2=0x7fd3e800cb30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:58.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:58.447+0000 7fd405d9b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8005ac0 0x7fd3e800cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:59.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:59.248+0000 7fd40659c640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006600 legacy=0x7fd3e8007ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:58:59.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:59.248+0000 7fd405d9b640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8005ac0 msgr2=0x7fd3e800cb30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:58:59.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:58:59.248+0000 7fd405d9b640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8005ac0 0x7fd3e800cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:00.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:00.846+0000 7fd3f7fff640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8005ac0 msgr2=0x7fd3e800cb30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:00.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:00.846+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8005ac0 0x7fd3e800cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:00.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:00.846+0000 7fd3f7fff640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006600 legacy=0x7fd3e8007ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:00.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:00.846+0000 7fd406d9d640 1 -- reap_dead start 2023-11-04T01:59:00.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:00.846+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e80081d0 0x7fd3e8012f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:00.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:00.846+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 0x7fd3e800cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:00.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:00.846+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80076b0 0x7fd3e800f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:00.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:00.846+0000 7fd3f7fff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e8013ef0 2023-11-04T01:59:00.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:00.846+0000 7fd3f7fff640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e8008d50 con 0x7fd3e80076b0 2023-11-04T01:59:00.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:00.846+0000 7fd3f7fff640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e8013db0 con 0x7fd3e80081d0 2023-11-04T01:59:00.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:00.846+0000 7fd405d9b640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e800cb30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:59:00.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:00.846+0000 7fd405d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 0x7fd3e800cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:00.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:00.846+0000 7fd406d9d640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80076b0 msgr2=0x7fd3e800f910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:59:00.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:00.846+0000 7fd40659c640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e80081d0 msgr2=0x7fd3e8012f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:59:00.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:00.846+0000 7fd406d9d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80076b0 0x7fd3e800f910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:00.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:00.846+0000 7fd40659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e80081d0 0x7fd3e8012f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:01.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:01.047+0000 7fd405d9b640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e800cb30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:59:01.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:01.047+0000 7fd405d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 0x7fd3e800cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:01.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:01.047+0000 7fd40659c640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e80081d0 msgr2=0x7fd3e8012f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:59:01.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:01.047+0000 7fd406d9d640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80076b0 msgr2=0x7fd3e800f910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:59:01.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:01.047+0000 7fd40659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e80081d0 0x7fd3e8012f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:01.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:01.047+0000 7fd406d9d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80076b0 0x7fd3e800f910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:01.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:01.448+0000 7fd405d9b640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e800cb30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:59:01.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:01.448+0000 7fd405d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 0x7fd3e800cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:01.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:01.448+0000 7fd40659c640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e80081d0 msgr2=0x7fd3e8012f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:59:01.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:01.448+0000 7fd406d9d640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80076b0 msgr2=0x7fd3e800f910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:59:01.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:01.448+0000 7fd40659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e80081d0 0x7fd3e8012f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:01.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:01.448+0000 7fd406d9d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80076b0 0x7fd3e800f910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:02.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:02.249+0000 7fd405d9b640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e800cb30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:59:02.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:02.249+0000 7fd405d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 0x7fd3e800cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:02.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:02.249+0000 7fd406d9d640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80076b0 msgr2=0x7fd3e800f910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:59:02.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:02.249+0000 7fd40659c640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e80081d0 msgr2=0x7fd3e8012f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:59:02.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:02.249+0000 7fd406d9d640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80076b0 0x7fd3e800f910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:02.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:02.249+0000 7fd40659c640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e80081d0 0x7fd3e8012f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:03.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:03.846+0000 7fd3f7fff640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e80081d0 msgr2=0x7fd3e8012f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:03.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:03.846+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e80081d0 0x7fd3e8012f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:03.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:03.846+0000 7fd3f7fff640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80076b0 msgr2=0x7fd3e800f910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:03.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:03.846+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e80076b0 0x7fd3e800f910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:03.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:03.846+0000 7fd3f7fff640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e800cb30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:03.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:03.846+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 0x7fd3e800cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:03.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:03.846+0000 7fd3f7fff640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4080b0e60 con 0x7fd3e8006600 2023-11-04T01:59:03.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:03.846+0000 7fd3f7fff640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40806d1c0 con 0x7fd3e80138d0 2023-11-04T01:59:03.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:03.846+0000 7fd40659c640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006600 legacy=0x7fd3e8007ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:59:03.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:03.846+0000 7fd405d9b640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:59:04.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:04.047+0000 7fd40659c640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006600 legacy=0x7fd3e8007ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:59:04.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:04.047+0000 7fd405d9b640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:59:04.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:04.448+0000 7fd40659c640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006600 legacy=0x7fd3e8007ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:59:04.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:04.448+0000 7fd405d9b640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:59:04.961 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:59:04.965 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:59:05.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:05.249+0000 7fd40659c640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006600 legacy=0x7fd3e8007ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:59:05.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:05.249+0000 7fd405d9b640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:59:06.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:06.846+0000 7fd3f7fff640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e8006fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:06.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:06.846+0000 7fd3f7fff640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e8006600 legacy=0x7fd3e8007ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:06.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:06.846+0000 7fd406d9d640 1 -- reap_dead start 2023-11-04T01:59:06.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:06.846+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8012f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:06.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:06.846+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8006600 0x7fd3e800cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:06.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:06.846+0000 7fd3f7fff640 1 -- --> v1:172.21.15.122:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40806cc90 con 0x7fd3e80138d0 2023-11-04T01:59:06.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:06.846+0000 7fd3f7fff640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e8013ef0 2023-11-04T01:59:06.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:06.846+0000 7fd3f7fff640 1 -- --> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e8008d50 con 0x7fd3e8006600 2023-11-04T01:59:06.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:06.846+0000 7fd405d9b640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8012f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:59:06.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:06.846+0000 7fd405d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8012f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:06.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:06.846+0000 7fd40659c640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e800e8c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:59:06.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:06.846+0000 7fd406d9d640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8006600 msgr2=0x7fd3e800cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:59:06.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:06.846+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8006600 0x7fd3e800cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:07.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:07.047+0000 7fd405d9b640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8012f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:59:07.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:07.047+0000 7fd405d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8012f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:07.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:07.047+0000 7fd40659c640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e800e8c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:59:07.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:07.047+0000 7fd406d9d640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8006600 msgr2=0x7fd3e800cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:59:07.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:07.047+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8006600 0x7fd3e800cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:07.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:07.448+0000 7fd405d9b640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8012f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:59:07.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:07.448+0000 7fd405d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8012f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:07.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:07.448+0000 7fd406d9d640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8006600 msgr2=0x7fd3e800cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:59:07.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:07.448+0000 7fd40659c640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e800e8c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:59:07.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:07.448+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8006600 0x7fd3e800cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:08.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:08.249+0000 7fd405d9b640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8012f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.77:3300/0 2023-11-04T01:59:08.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:08.249+0000 7fd405d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8012f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:08.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:08.249+0000 7fd406d9d640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8006600 msgr2=0x7fd3e800cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3301/0 2023-11-04T01:59:08.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:08.249+0000 7fd40659c640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e800e8c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.122:6789/0 2023-11-04T01:59:08.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:08.249+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8006600 0x7fd3e800cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:09.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:09.846+0000 7fd3f7fff640 1 -- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8006600 msgr2=0x7fd3e800cae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:09.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:09.846+0000 7fd3f7fff640 1 --2- >> [v2:172.21.15.122:3301/0,v1:172.21.15.122:6790/0] conn(0x7fd3e8006600 0x7fd3e800cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:09.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:09.846+0000 7fd3f7fff640 1 -- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 msgr2=0x7fd3e8012f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:09.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:09.846+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd3e8013ef0 0x7fd3e8012f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:09.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:09.846+0000 7fd3f7fff640 1 -- >> v1:172.21.15.122:6789/0 conn(0x7fd3e80138d0 legacy=0x7fd3e800e8c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:09.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:09.846+0000 7fd3f7fff640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8010920 0x7fd3e800efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:09.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:09.846+0000 7fd3f7fff640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4080b0e60 con 0x7fd3e800afe0 2023-11-04T01:59:09.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:09.846+0000 7fd3f7fff640 1 -- --> v2:172.21.15.122:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40806cee0 con 0x7fd3e8010920 2023-11-04T01:59:09.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:09.846+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e800afe0 legacy=0x7fd3e800b470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:59:09.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:09.846+0000 7fd40659c640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8010920 msgr2=0x7fd3e800efd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:59:09.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:09.846+0000 7fd40659c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8010920 0x7fd3e800efd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:10.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:10.047+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e800afe0 legacy=0x7fd3e800b470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:59:10.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:10.047+0000 7fd40659c640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8010920 msgr2=0x7fd3e800efd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:59:10.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:10.047+0000 7fd40659c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8010920 0x7fd3e800efd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:10.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:10.448+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e800afe0 legacy=0x7fd3e800b470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:59:10.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:10.448+0000 7fd40659c640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8010920 msgr2=0x7fd3e800efd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:59:10.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:10.448+0000 7fd40659c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8010920 0x7fd3e800efd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:11.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:11.249+0000 7fd405d9b640 1 -- >> v1:172.21.15.77:6789/0 conn(0x7fd3e800afe0 legacy=0x7fd3e800b470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.77:6789/0 2023-11-04T01:59:11.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:11.249+0000 7fd40659c640 1 -- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8010920 msgr2=0x7fd3e800efd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.122:3300/0 2023-11-04T01:59:11.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-11-04T01:59:11.249+0000 7fd40659c640 1 --2- >> v2:172.21.15.122:3300/0 conn(0x7fd3e8010920 0x7fd3e800efd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:12.769 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-11-04T01:59:12.770 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi077 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-04T01:59:12.781 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-04T01:59:12.781 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:59:12.782 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:59:12.784 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:59:12.785 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:59:12.785 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:59:12.786 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:59:12.786 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi077 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi077 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2023-11-04T01:59:12.795 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:59:12.796 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:59:12.796 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:59:12.797 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:59:12.797 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:59:12.798 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:59:12.798 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:59:12.799 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-04T01:59:12.799 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-04T01:59:12.800 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:59:12.800 INFO:tasks.ceph.osd.0:Stopped 2023-11-04T01:59:12.801 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-04T01:59:12.801 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:59:12.802 INFO:tasks.ceph.osd.1:Stopped 2023-11-04T01:59:12.802 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-04T01:59:12.802 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:59:12.803 INFO:tasks.ceph.osd.2:Stopped 2023-11-04T01:59:12.805 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-04T01:59:12.805 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:59:12.806 INFO:tasks.ceph.osd.3:Stopped 2023-11-04T01:59:12.806 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-04T01:59:12.807 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:59:12.807 INFO:tasks.ceph.osd.4:Stopped 2023-11-04T01:59:12.808 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-04T01:59:12.808 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:59:12.809 INFO:tasks.ceph.osd.5:Stopped 2023-11-04T01:59:12.809 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-04T01:59:12.809 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:59:12.810 INFO:tasks.ceph.osd.6:Stopped 2023-11-04T01:59:12.811 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-04T01:59:12.811 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:59:12.811 INFO:tasks.ceph.osd.7:Stopped 2023-11-04T01:59:12.812 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-04T01:59:12.812 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-04T01:59:12.813 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:59:12.813 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:59:12.814 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi077 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi077 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y' 2023-11-04T01:59:12.824 INFO:tasks.ceph.mgr.y:Stopped 2023-11-04T01:59:12.824 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-04T01:59:12.825 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:59:12.825 INFO:tasks.ceph.mgr.x:Stopped 2023-11-04T01:59:12.826 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-04T01:59:12.826 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-04T01:59:12.827 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:59:12.827 INFO:tasks.ceph.mon.a:Stopped 2023-11-04T01:59:12.828 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-04T01:59:12.828 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:59:12.829 INFO:tasks.ceph.mon.b:Stopped 2023-11-04T01:59:12.829 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-04T01:59:12.829 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:59:12.830 INFO:tasks.ceph.mon.c:Stopped 2023-11-04T01:59:12.831 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-04T01:59:12.831 DEBUG:teuthology.orchestra.run.smithi077:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'evicting unresponsive client' | egrep -v RECENT_CRASH | head -n 1 2023-11-04T01:59:12.869 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi077.front.sepia.ceph.com 2023-11-04T01:59:12.870 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-04T01:59:13.000 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi077.front.sepia.ceph.com 2023-11-04T01:59:13.001 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-04T01:59:13.098 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi077.front.sepia.ceph.com 2023-11-04T01:59:13.099 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-04T01:59:13.156 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi077.front.sepia.ceph.com 2023-11-04T01:59:13.157 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-04T01:59:13.223 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi122.front.sepia.ceph.com 2023-11-04T01:59:13.224 DEBUG:teuthology.orchestra.run.smithi122:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-04T01:59:13.387 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi122.front.sepia.ceph.com 2023-11-04T01:59:13.388 DEBUG:teuthology.orchestra.run.smithi122:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-04T01:59:13.435 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi122.front.sepia.ceph.com 2023-11-04T01:59:13.436 DEBUG:teuthology.orchestra.run.smithi122:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-04T01:59:13.484 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi122.front.sepia.ceph.com 2023-11-04T01:59:13.484 DEBUG:teuthology.orchestra.run.smithi122:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-04T01:59:13.534 INFO:tasks.ceph:Archiving mon data... 2023-11-04T01:59:13.535 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445917/data/mon.a.tgz 2023-11-04T01:59:13.536 DEBUG:teuthology.orchestra.run.smithi077:> mktemp 2023-11-04T01:59:13.552 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/tmp.Q9PMyUf8p6 2023-11-04T01:59:13.553 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Q9PMyUf8p6 2023-11-04T01:59:13.704 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0666 /tmp/tmp.Q9PMyUf8p6 2023-11-04T01:59:13.789 DEBUG:teuthology.orchestra.remote:smithi077:/tmp/tmp.Q9PMyUf8p6 is 375KB 2023-11-04T01:59:13.889 DEBUG:teuthology.orchestra.run.smithi077:> rm -fr /tmp/tmp.Q9PMyUf8p6 2023-11-04T01:59:13.904 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445917/data/mon.b.tgz 2023-11-04T01:59:13.905 DEBUG:teuthology.orchestra.run.smithi122:> mktemp 2023-11-04T01:59:13.922 INFO:teuthology.orchestra.run.smithi122.stdout:/tmp/tmp.hrOwL5jEXj 2023-11-04T01:59:13.923 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.hrOwL5jEXj 2023-11-04T01:59:14.079 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0666 /tmp/tmp.hrOwL5jEXj 2023-11-04T01:59:14.164 DEBUG:teuthology.orchestra.remote:smithi122:/tmp/tmp.hrOwL5jEXj is 379KB 2023-11-04T01:59:14.261 DEBUG:teuthology.orchestra.run.smithi122:> rm -fr /tmp/tmp.hrOwL5jEXj 2023-11-04T01:59:14.276 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445917/data/mon.c.tgz 2023-11-04T01:59:14.277 DEBUG:teuthology.orchestra.run.smithi122:> mktemp 2023-11-04T01:59:14.330 INFO:teuthology.orchestra.run.smithi122.stdout:/tmp/tmp.peJVjYDnYl 2023-11-04T01:59:14.330 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.peJVjYDnYl 2023-11-04T01:59:14.470 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0666 /tmp/tmp.peJVjYDnYl 2023-11-04T01:59:14.555 DEBUG:teuthology.orchestra.remote:smithi122:/tmp/tmp.peJVjYDnYl is 380KB 2023-11-04T01:59:14.652 DEBUG:teuthology.orchestra.run.smithi122:> rm -fr /tmp/tmp.peJVjYDnYl 2023-11-04T01:59:14.667 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-04T01:59:14.667 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-04T01:59:14.670 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-04T01:59:14.732 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-04T01:59:14.733 DEBUG:teuthology.orchestra.run.smithi077:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-04T01:59:14.738 DEBUG:teuthology.orchestra.run.smithi122:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-04T01:59:14.767 INFO:teuthology.orchestra.run.smithi077.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-04T01:59:14.800 INFO:teuthology.orchestra.run.smithi122.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-04T01:59:14.804 INFO:tasks.ceph:Archiving crash dumps... 2023-11-04T01:59:14.806 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445917/remote/smithi077/crash 2023-11-04T01:59:14.807 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-04T01:59:14.913 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445917/remote/smithi122/crash 2023-11-04T01:59:14.914 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-04T01:59:14.988 INFO:tasks.ceph:Shutting down logrotate 2023-11-04T01:59:14.989 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:59:14.992 DEBUG:teuthology.orchestra.run.smithi122:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:59:15.066 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-04T01:59:15.094 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-04T01:59:15.121 INFO:tasks.ceph:Compressing logs... 2023-11-04T01:59:15.122 DEBUG:teuthology.orchestra.run.smithi077:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-04T01:59:15.137 DEBUG:teuthology.orchestra.run.smithi122:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-04T01:59:15.216 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-04T01:59:15.216 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88297.log 2023-11-04T01:59:15.216 INFO:teuthology.orchestra.run.smithi122.stderr:gzip/var/log/ceph/ceph-osd.6.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.88337.log 2023-11-04T01:59:15.217 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.88297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.94561.log 2023-11-04T01:59:15.217 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.88337.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.88297.log.gz 2023-11-04T01:59:15.217 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-04T01:59:15.218 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-04T01:59:15.218 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.3.94561.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.88337.log.gz 2023-11-04T01:59:15.218 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-04T01:59:15.219 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88377.log 2023-11-04T01:59:15.219 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88217.log 2023-11-04T01:59:15.219 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.88377.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-04T01:59:15.219 INFO:teuthology.orchestra.run.smithi122.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.3.94561.log.gz 2023-11-04T01:59:15.220 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.88217.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-04T01:59:15.220 INFO:teuthology.orchestra.run.smithi122.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.88377.log.gz 2023-11-04T01:59:15.220 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88257.log 2023-11-04T01:59:15.220 INFO:teuthology.orchestra.run.smithi122.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.88217.log.gz 2023-11-04T01:59:15.221 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-04T01:59:15.221 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.88257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88457.log 2023-11-04T01:59:15.221 INFO:teuthology.orchestra.run.smithi122.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.88257.log.gz 2023-11-04T01:59:15.222 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.94109.log 2023-11-04T01:59:15.222 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.88457.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.88457.log.gz 2023-11-04T01:59:15.222 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-04T01:59:15.222 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.1.94109.log: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-04T01:59:15.223 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-04T01:59:15.223 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph.log: 91.1% -- replaced with /var/log/ceph/ceph-client.1.94109.log.gz 2023-11-04T01:59:15.223 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88417.log 2023-11-04T01:59:15.224 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-mon.b.log: 93.1% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-04T01:59:15.224 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88161.log 2023-11-04T01:59:15.224 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.88417.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.88417.log.gz 2023-11-04T01:59:15.224 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-11-04T01:59:15.225 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-client.admin.88161.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.88161.log.gz 2023-11-04T01:59:15.225 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-04T01:59:15.279 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.c.log: 91.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-04T01:59:15.297 INFO:teuthology.orchestra.run.smithi122.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-04T01:59:15.366 INFO:teuthology.orchestra.run.smithi122.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-04T01:59:15.424 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152660.log 2023-11-04T01:59:15.424 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131504.log 2023-11-04T01:59:15.425 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145093.log 2023-11-04T01:59:15.425 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.152660.log: /var/log/ceph/ceph-client.admin.131504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150839.log 2023-11-04T01:59:15.425 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.145093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143859.log 2023-11-04T01:59:15.426 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.152660.log.gz 2023-11-04T01:59:15.426 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.131504.log.gz 2023-11-04T01:59:15.426 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2%/var/log/ceph/ceph-client.admin.150839.log: -- replaced with /var/log/ceph/ceph-client.admin.145093.log.gz 2023-11-04T01:59:15.426 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147272.log 2023-11-04T01:59:15.427 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.143859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.129394.log 2023-11-04T01:59:15.427 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.150839.log.gz 2023-11-04T01:59:15.427 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.147272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136682.log 2023-11-04T01:59:15.427 INFO:teuthology.orchestra.run.smithi077.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.143859.log.gz 2023-11-04T01:59:15.428 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.2.129394.log: gzip -5 89.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.147272.log.gz 2023-11-04T01:59:15.428 INFO:teuthology.orchestra.run.smithi077.stderr: /var/log/ceph/ceph-client.admin.142212.log 2023-11-04T01:59:15.428 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.136682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147146.log 2023-11-04T01:59:15.429 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1%gzip/var/log/ceph/ceph-client.admin.142212.log: -- replaced with /var/log/ceph/ceph-client.admin.136682.log.gz 2023-11-04T01:59:15.429 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.140561.log 2023-11-04T01:59:15.429 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.147146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156749.log 2023-11-04T01:59:15.429 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.142212.log.gz 2023-11-04T01:59:15.430 INFO:teuthology.orchestra.run.smithi077.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.2.129394.log.gz 2023-11-04T01:59:15.430 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148223.log 2023-11-04T01:59:15.430 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.147146.log.gz 2023-11-04T01:59:15.431 INFO:teuthology.orchestra.run.smithi077.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140561.log.gz 2023-11-04T01:59:15.431 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.156749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131461.log 2023-11-04T01:59:15.431 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.148223.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.156749.log.gz 2023-11-04T01:59:15.431 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155464.log 2023-11-04T01:59:15.432 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131461.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.148223.log.gz 2023-11-04T01:59:15.432 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155966.log 2023-11-04T01:59:15.432 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.131461.log.gz 2023-11-04T01:59:15.433 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.155464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140897.log 2023-11-04T01:59:15.433 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.155966.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.155464.log.gz 2023-11-04T01:59:15.433 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131911.log 2023-11-04T01:59:15.433 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140897.log: gzip -5 --verbose -- 88.7% /var/log/ceph/ceph-client.admin.134474.log 2023-11-04T01:59:15.434 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.155966.log.gz 2023-11-04T01:59:15.434 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131911.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-04T01:59:15.434 INFO:teuthology.orchestra.run.smithi077.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.140897.log.gz 2023-11-04T01:59:15.435 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.134474.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.131911.log.gz 2023-11-04T01:59:15.435 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124573.log 2023-11-04T01:59:15.435 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126313.log 2023-11-04T01:59:15.435 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.134474.log.gz 2023-11-04T01:59:15.436 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.124573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146806.log 2023-11-04T01:59:15.436 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.126313.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.124573.log.gz 2023-11-04T01:59:15.436 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154746.log 2023-11-04T01:59:15.436 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.146806.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.126313.log.gz 2023-11-04T01:59:15.437 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146465.log 2023-11-04T01:59:15.437 INFO:teuthology.orchestra.run.smithi077.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.146806.log.gz 2023-11-04T01:59:15.437 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.154746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132752.log 2023-11-04T01:59:15.437 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.146465.log: gzip -5 88.5% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.154746.log.gz 2023-11-04T01:59:15.438 INFO:teuthology.orchestra.run.smithi077.stderr: /var/log/ceph/ceph-client.admin.132237.log 2023-11-04T01:59:15.438 INFO:teuthology.orchestra.run.smithi077.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.146465.log.gz 2023-11-04T01:59:15.438 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.132752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143561.log 2023-11-04T01:59:15.439 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.132237.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.132752.log.gz 2023-11-04T01:59:15.439 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150380.log 2023-11-04T01:59:15.439 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.143561.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.132237.log.gz 2023-11-04T01:59:15.439 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137667.log 2023-11-04T01:59:15.440 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.143561.log.gz 2023-11-04T01:59:15.440 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.150380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150623.log 2023-11-04T01:59:15.440 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.137667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148173.log 2023-11-04T01:59:15.440 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.150380.log.gz 2023-11-04T01:59:15.441 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.150623.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.137667.log.gz 2023-11-04T01:59:15.441 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142058.log 2023-11-04T01:59:15.441 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.150623.log.gz 2023-11-04T01:59:15.441 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142380.log 2023-11-04T01:59:15.442 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.148173.log: /var/log/ceph/ceph-client.admin.142058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130305.log 2023-11-04T01:59:15.442 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.148173.log.gz 2023-11-04T01:59:15.442 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.142380.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.142058.log.gz 2023-11-04T01:59:15.443 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139441.log 2023-11-04T01:59:15.443 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.142380.log.gz 2023-11-04T01:59:15.443 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140389.log 2023-11-04T01:59:15.443 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148988.log 2023-11-04T01:59:15.444 INFO:teuthology.orchestra.run.smithi077.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.130305.log.gz 2023-11-04T01:59:15.444 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140389.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.139441.log.gz 2023-11-04T01:59:15.444 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134558.log 2023-11-04T01:59:15.444 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.140389.log.gz 2023-11-04T01:59:15.445 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.148988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143815.log 2023-11-04T01:59:15.445 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.134558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143729.log 2023-11-04T01:59:15.445 INFO:teuthology.orchestra.run.smithi077.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.148988.log.gz 2023-11-04T01:59:15.445 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.143815.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.134558.log.gz 2023-11-04T01:59:15.446 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136136.log 2023-11-04T01:59:15.446 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9%/var/log/ceph/ceph-client.admin.143729.log: -- replaced with /var/log/ceph/ceph-client.admin.143815.log.gz 2023-11-04T01:59:15.446 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133798.log 2023-11-04T01:59:15.446 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.136136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133550.log 2023-11-04T01:59:15.447 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.143729.log.gz 2023-11-04T01:59:15.447 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.133798.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.136136.log.gz 2023-11-04T01:59:15.447 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132878.log 2023-11-04T01:59:15.448 INFO:teuthology.orchestra.run.smithi077.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.133798.log.gz 2023-11-04T01:59:15.448 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.133550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146682.log 2023-11-04T01:59:15.448 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.132878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146974.log 2023-11-04T01:59:15.448 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.133550.log.gz 2023-11-04T01:59:15.449 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.146682.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.132878.log.gz 2023-11-04T01:59:15.449 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125019.log 2023-11-04T01:59:15.449 INFO:teuthology.orchestra.run.smithi077.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.146682.log.gz 2023-11-04T01:59:15.449 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158793.log/var/log/ceph/ceph-client.admin.146974.log: 2023-11-04T01:59:15.450 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.125019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153200.log 2023-11-04T01:59:15.450 INFO:teuthology.orchestra.run.smithi077.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.146974.log.gz 2023-11-04T01:59:15.450 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.158793.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.125019.log.gz 2023-11-04T01:59:15.450 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124531.log 2023-11-04T01:59:15.451 INFO:teuthology.orchestra.run.smithi077.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.158793.log.gz 2023-11-04T01:59:15.451 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.153200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133424.log 2023-11-04T01:59:15.451 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.124531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131827.log 2023-11-04T01:59:15.452 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.153200.log.gz 2023-11-04T01:59:15.452 INFO:teuthology.orchestra.run.smithi077.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.124531.log.gz 2023-11-04T01:59:15.452 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.133424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143603.log 2023-11-04T01:59:15.452 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.133424.log.gz 2023-11-04T01:59:15.453 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135367.log 2023-11-04T01:59:15.453 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.143603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153882.log 2023-11-04T01:59:15.453 INFO:teuthology.orchestra.run.smithi077.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.131827.log.gz 2023-11-04T01:59:15.453 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.135367.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.143603.log.gz 2023-11-04T01:59:15.454 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139147.log 2023-11-04T01:59:15.454 INFO:teuthology.orchestra.run.smithi077.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.135367.log.gz 2023-11-04T01:59:15.454 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.153882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153712.log 2023-11-04T01:59:15.455 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137107.log 2023-11-04T01:59:15.455 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.153882.log.gz 2023-11-04T01:59:15.455 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.153712.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.139147.log.gz 2023-11-04T01:59:15.455 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147440.log 2023-11-04T01:59:15.456 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.137107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150423.log 2023-11-04T01:59:15.456 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.147440.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.137107.log.gz 2023-11-04T01:59:15.456 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157355.log 2023-11-04T01:59:15.457 INFO:teuthology.orchestra.run.smithi077.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.153712.log.gz 2023-11-04T01:59:15.457 INFO:teuthology.orchestra.run.smithi077.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.147440.log.gz 2023-11-04T01:59:15.457 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.150423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157575.log 2023-11-04T01:59:15.457 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.157355.log: gzip -5 --verbose -- 87.7% /var/log/ceph/ceph-client.admin.148475.log -- replaced with /var/log/ceph/ceph-client.admin.150423.log.gz 2023-11-04T01:59:15.458 INFO:teuthology.orchestra.run.smithi077.stderr: 2023-11-04T01:59:15.458 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.157575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140477.log 2023-11-04T01:59:15.458 INFO:teuthology.orchestra.run.smithi077.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.157355.log.gz 2023-11-04T01:59:15.459 INFO:teuthology.orchestra.run.smithi077.stderr: 87.4%/var/log/ceph/ceph-client.admin.148475.log: -- replaced with /var/log/ceph/ceph-client.admin.157575.log.gz 2023-11-04T01:59:15.459 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155117.log 2023-11-04T01:59:15.459 INFO:teuthology.orchestra.run.smithi077.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.148475.log.gz 2023-11-04T01:59:15.459 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148765.log 2023-11-04T01:59:15.460 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.155117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118536.log 2023-11-04T01:59:15.460 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.140477.log.gz 2023-11-04T01:59:15.460 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.155117.log.gz 2023-11-04T01:59:15.460 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.148765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151084.log 2023-11-04T01:59:15.461 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.118536.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.148765.log.gz 2023-11-04T01:59:15.461 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149490.log 2023-11-04T01:59:15.461 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.151084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127741.log 2023-11-04T01:59:15.461 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.118536.log.gz 2023-11-04T01:59:15.462 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.151084.log.gz 2023-11-04T01:59:15.462 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.149490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127454.log 2023-11-04T01:59:15.462 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.149490.log.gz 2023-11-04T01:59:15.463 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.127741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.153551.log 2023-11-04T01:59:15.463 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.127454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124743.log 2023-11-04T01:59:15.463 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.127741.log.gz 2023-11-04T01:59:15.463 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.0.153551.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.127454.log.gz 2023-11-04T01:59:15.464 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151878.log 2023-11-04T01:59:15.464 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.124743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142674.log 2023-11-04T01:59:15.464 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.151878.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.124743.log.gz 2023-11-04T01:59:15.465 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154830.log 2023-11-04T01:59:15.465 INFO:teuthology.orchestra.run.smithi077.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.151878.log.gz 2023-11-04T01:59:15.465 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132421.log 2023-11-04T01:59:15.465 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.142674.log: /var/log/ceph/ceph-client.admin.154830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130725.log 2023-11-04T01:59:15.466 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.132421.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.142674.log.gz 2023-11-04T01:59:15.466 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149386.log 2023-11-04T01:59:15.466 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.154830.log.gz 2023-11-04T01:59:15.467 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.132421.log.gz 2023-11-04T01:59:15.467 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133466.log 2023-11-04T01:59:15.467 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.130725.log.gz 2023-11-04T01:59:15.467 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158625.log 2023-11-04T01:59:15.468 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.149386.log: /var/log/ceph/ceph-client.admin.133466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137625.log 2023-11-04T01:59:15.468 INFO:teuthology.orchestra.run.smithi077.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.149386.log.gz 2023-11-04T01:59:15.468 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.158625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147524.log 2023-11-04T01:59:15.468 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.133466.log.gz 2023-11-04T01:59:15.469 INFO:teuthology.orchestra.run.smithi077.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.158625.log.gz 2023-11-04T01:59:15.469 INFO:teuthology.orchestra.run.smithi077.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.0.153551.log.gz 2023-11-04T01:59:15.469 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.137625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144111.log 2023-11-04T01:59:15.469 INFO:teuthology.orchestra.run.smithi077.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.137625.log.gz 2023-11-04T01:59:15.470 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.147524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130988.log 2023-11-04T01:59:15.470 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.144111.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.147524.log.gz 2023-11-04T01:59:15.470 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127459.log 2023-11-04T01:59:15.471 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.144111.log.gz 2023-11-04T01:59:15.471 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.130988.log: /var/log/ceph/ceph-client.admin.137751.log 2023-11-04T01:59:15.471 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.127459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129559.log 2023-11-04T01:59:15.471 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.130988.log.gz 2023-11-04T01:59:15.472 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.137751.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.127459.log.gz 2023-11-04T01:59:15.472 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144405.log 2023-11-04T01:59:15.472 INFO:teuthology.orchestra.run.smithi077.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.137751.log.gz 2023-11-04T01:59:15.472 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.129559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148537.log 2023-11-04T01:59:15.473 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.144405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150259.log 2023-11-04T01:59:15.473 INFO:teuthology.orchestra.run.smithi077.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.129559.log.gz 2023-11-04T01:59:15.473 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.148537.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.144405.log.gz 2023-11-04T01:59:15.473 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129759.log 2023-11-04T01:59:15.474 INFO:teuthology.orchestra.run.smithi077.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.148537.log.gz 2023-11-04T01:59:15.474 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.150259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147626.log 2023-11-04T01:59:15.474 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.129759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131072.log 2023-11-04T01:59:15.474 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.150259.log.gz 2023-11-04T01:59:15.475 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.147626.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.129759.log.gz 2023-11-04T01:59:15.475 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155201.log 2023-11-04T01:59:15.475 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133921.log 2023-11-04T01:59:15.475 INFO:teuthology.orchestra.run.smithi077.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.147626.log.gz 2023-11-04T01:59:15.476 INFO:teuthology.orchestra.run.smithi077.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.131072.log.gz 2023-11-04T01:59:15.476 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.155201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124401.log 2023-11-04T01:59:15.476 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151496.log 2023-11-04T01:59:15.477 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.133921.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.155201.log.gz 2023-11-04T01:59:15.477 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.124401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139880.log 2023-11-04T01:59:15.477 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.133921.log.gz 2023-11-04T01:59:15.477 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.151496.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.124401.log.gz 2023-11-04T01:59:15.478 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147314.log 2023-11-04T01:59:15.478 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151562.log 2023-11-04T01:59:15.478 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139880.log.gz 2023-11-04T01:59:15.479 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.147314.log: 91.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140433.log 2023-11-04T01:59:15.479 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.151496.log.gz 2023-11-04T01:59:15.479 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139922.log 2023-11-04T01:59:15.479 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.147314.log.gz 2023-11-04T01:59:15.480 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.151562.log: /var/log/ceph/ceph-client.admin.140433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137583.log 2023-11-04T01:59:15.480 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139922.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.140433.log.gz 2023-11-04T01:59:15.480 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132962.log 2023-11-04T01:59:15.480 INFO:teuthology.orchestra.run.smithi077.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.151562.log.gz 2023-11-04T01:59:15.481 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.139922.log.gz 2023-11-04T01:59:15.481 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.137583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136903.log 2023-11-04T01:59:15.481 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.137583.log.gz 2023-11-04T01:59:15.481 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.132962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146087.log 2023-11-04T01:59:15.482 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.136903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145835.log 2023-11-04T01:59:15.482 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.132962.log.gz 2023-11-04T01:59:15.482 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.146087.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.136903.log.gz 2023-11-04T01:59:15.483 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127119.log 2023-11-04T01:59:15.483 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.146087.log.gz 2023-11-04T01:59:15.483 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.145835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145667.log 2023-11-04T01:59:15.483 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.127119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133130.log 2023-11-04T01:59:15.484 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.145835.log.gz 2023-11-04T01:59:15.484 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.145667.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.127119.log.gz 2023-11-04T01:59:15.484 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130767.log 2023-11-04T01:59:15.484 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.145667.log.gz 2023-11-04T01:59:15.485 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5/var/log/ceph/ceph-client.admin.133130.log: --verbose -- /var/log/ceph/ceph-client.admin.153982.log 2023-11-04T01:59:15.485 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149959.log 2023-11-04T01:59:15.485 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.133130.log.gz 2023-11-04T01:59:15.485 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.153982.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.130767.log.gz 2023-11-04T01:59:15.486 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132836.log 2023-11-04T01:59:15.486 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.153982.log.gz 2023-11-04T01:59:15.486 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154568.log 2023-11-04T01:59:15.487 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.149959.log: /var/log/ceph/ceph-client.admin.132836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127123.log 2023-11-04T01:59:15.487 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.149959.log.gz 2023-11-04T01:59:15.487 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.154568.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.132836.log.gz 2023-11-04T01:59:15.487 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142548.log 2023-11-04T01:59:15.488 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.154568.log.gz 2023-11-04T01:59:15.488 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.127123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152492.log 2023-11-04T01:59:15.488 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.142548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126187.log 2023-11-04T01:59:15.488 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.127123.log.gz 2023-11-04T01:59:15.489 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.152492.log: gzip 89.3% -- replaced with /var/log/ceph/ceph-client.admin.142548.log.gz -5 2023-11-04T01:59:15.489 INFO:teuthology.orchestra.run.smithi077.stderr: --verbose -- /var/log/ceph/ceph-client.admin.157229.log 2023-11-04T01:59:15.489 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.126187.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.152492.log.gz 2023-11-04T01:59:15.489 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156984.log 2023-11-04T01:59:15.490 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.157229.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.126187.log.gz 2023-11-04T01:59:15.490 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151168.log 2023-11-04T01:59:15.490 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.156984.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.157229.log.gz 2023-11-04T01:59:15.491 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150109.log 2023-11-04T01:59:15.491 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156984.log.gz 2023-11-04T01:59:15.491 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.151168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154227.log 2023-11-04T01:59:15.491 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.150109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133088.log 2023-11-04T01:59:15.492 INFO:teuthology.orchestra.run.smithi077.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.151168.log.gz 2023-11-04T01:59:15.492 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.154227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126788.log 2023-11-04T01:59:15.492 INFO:teuthology.orchestra.run.smithi077.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.150109.log.gz 2023-11-04T01:59:15.492 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.133088.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.154227.log.gz 2023-11-04T01:59:15.493 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130221.log 2023-11-04T01:59:15.493 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.126788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146423.log 2023-11-04T01:59:15.493 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.133088.log.gz 2023-11-04T01:59:15.493 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142716.log 2023-11-04T01:59:15.494 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.126788.log.gz 2023-11-04T01:59:15.494 INFO:teuthology.orchestra.run.smithi077.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.130221.log.gz 2023-11-04T01:59:15.494 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.146423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159229.log 2023-11-04T01:59:15.494 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.142716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128263.log 2023-11-04T01:59:15.495 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.146423.log.gz 2023-11-04T01:59:15.495 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.159229.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.142716.log.gz 2023-11-04T01:59:15.495 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147102.log 2023-11-04T01:59:15.495 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.159229.log.gz 2023-11-04T01:59:15.496 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.128263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140687.log 2023-11-04T01:59:15.496 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.147102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136472.log 2023-11-04T01:59:15.496 INFO:teuthology.orchestra.run.smithi077.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.128263.log.gz 2023-11-04T01:59:15.497 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140687.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.147102.log.gz 2023-11-04T01:59:15.497 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141567.log 2023-11-04T01:59:15.497 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.140687.log.gz 2023-11-04T01:59:15.497 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.136472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131701.log 2023-11-04T01:59:15.498 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.141567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142884.log 2023-11-04T01:59:15.498 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.136472.log.gz 2023-11-04T01:59:15.498 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131701.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.141567.log.gz 2023-11-04T01:59:15.499 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152746.log 2023-11-04T01:59:15.499 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.131701.log.gz 2023-11-04T01:59:15.499 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.142884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130557.log 2023-11-04T01:59:15.499 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.152746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156397.log 2023-11-04T01:59:15.500 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.142884.log.gz 2023-11-04T01:59:15.500 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130557.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.152746.log.gz 2023-11-04T01:59:15.500 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154620.log 2023-11-04T01:59:15.501 INFO:teuthology.orchestra.run.smithi077.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.130557.log.gz 2023-11-04T01:59:15.501 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.156397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139670.log 2023-11-04T01:59:15.501 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.154620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133172.log 2023-11-04T01:59:15.501 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156397.log.gz 2023-11-04T01:59:15.502 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139670.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.154620.log.gz 2023-11-04T01:59:15.502 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150901.log 2023-11-04T01:59:15.502 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.139670.log.gz 2023-11-04T01:59:15.502 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.133172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124659.log 2023-11-04T01:59:15.503 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.150901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126024.log 2023-11-04T01:59:15.503 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.133172.log.gz 2023-11-04T01:59:15.503 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.124659.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.150901.log.gz 2023-11-04T01:59:15.504 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125898.log 2023-11-04T01:59:15.504 INFO:teuthology.orchestra.run.smithi077.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.124659.log.gz 2023-11-04T01:59:15.504 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.126024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144237.log 2023-11-04T01:59:15.504 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.125898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126066.log 2023-11-04T01:59:15.505 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.126024.log.gz 2023-11-04T01:59:15.505 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.144237.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.125898.log.gz 2023-11-04T01:59:15.505 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140771.log 2023-11-04T01:59:15.505 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.144237.log.gz 2023-11-04T01:59:15.506 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146602.log 2023-11-04T01:59:15.506 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.126066.log: /var/log/ceph/ceph-client.admin.140771.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.112266.log 2023-11-04T01:59:15.506 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.126066.log.gz 2023-11-04T01:59:15.507 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.146602.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.140771.log.gz 2023-11-04T01:59:15.507 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157026.log 2023-11-04T01:59:15.507 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.146602.log.gz 2023-11-04T01:59:15.508 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph.tmp-client.admin.112266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125433.log 2023-11-04T01:59:15.508 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.112266.log.gz 2023-11-04T01:59:15.508 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.157026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158835.log 2023-11-04T01:59:15.508 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.125433.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.157026.log.gz 2023-11-04T01:59:15.509 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131382.log 2023-11-04T01:59:15.509 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.158835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148308.log 2023-11-04T01:59:15.509 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131382.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.158835.log.gz 2023-11-04T01:59:15.509 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152946.log 2023-11-04T01:59:15.510 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.148308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137895.log 2023-11-04T01:59:15.510 INFO:teuthology.orchestra.run.smithi077.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.131382.log.gz 2023-11-04T01:59:15.510 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.152946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135646.log 2023-11-04T01:59:15.510 INFO:teuthology.orchestra.run.smithi077.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.125433.log.gz 2023-11-04T01:59:15.511 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.137895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127909.log 2023-11-04T01:59:15.511 INFO:teuthology.orchestra.run.smithi077.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.152946.log.gz 2023-11-04T01:59:15.511 INFO:teuthology.orchestra.run.smithi077.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.148308.log.gz 2023-11-04T01:59:15.511 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.135646.log: gzip -5 88.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.137895.log.gz 2023-11-04T01:59:15.512 INFO:teuthology.orchestra.run.smithi077.stderr: /var/log/ceph/ceph-client.admin.159103.log 2023-11-04T01:59:15.512 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.127909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127120.log 2023-11-04T01:59:15.512 INFO:teuthology.orchestra.run.smithi077.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.135646.log.gz 2023-11-04T01:59:15.513 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.159103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152576.log 2023-11-04T01:59:15.513 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.127909.log.gz 2023-11-04T01:59:15.513 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.127120.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.159103.log.gz 2023-11-04T01:59:15.513 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136262.log 2023-11-04T01:59:15.514 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.127120.log.gz 2023-11-04T01:59:15.514 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.152576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143395.log 2023-11-04T01:59:15.514 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.136262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135448.log 2023-11-04T01:59:15.514 INFO:teuthology.orchestra.run.smithi077.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.152576.log.gz 2023-11-04T01:59:15.515 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.143395.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.136262.log.gz 2023-11-04T01:59:15.515 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157313.log 2023-11-04T01:59:15.515 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.143395.log.gz 2023-11-04T01:59:15.515 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.135448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124615.log 2023-11-04T01:59:15.516 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.157313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142506.log 2023-11-04T01:59:15.516 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.135448.log.gz 2023-11-04T01:59:15.516 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.124615.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.157313.log.gz 2023-11-04T01:59:15.517 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139315.log 2023-11-04T01:59:15.517 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152904.log 2023-11-04T01:59:15.517 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.142506.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.124615.log.gz 2023-11-04T01:59:15.517 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140813.log 2023-11-04T01:59:15.518 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.142506.log.gz 2023-11-04T01:59:15.518 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.152904.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.139315.log.gz 2023-11-04T01:59:15.518 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129885.log 2023-11-04T01:59:15.519 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140813.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.152904.log.gz 2023-11-04T01:59:15.519 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158977.log 2023-11-04T01:59:15.519 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.140813.log.gz 2023-11-04T01:59:15.519 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.129885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147016.log 2023-11-04T01:59:15.520 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.158977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124317.log 2023-11-04T01:59:15.520 INFO:teuthology.orchestra.run.smithi077.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.129885.log.gz 2023-11-04T01:59:15.520 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.147016.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.158977.log.gz 2023-11-04T01:59:15.521 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145345.log 2023-11-04T01:59:15.521 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.147016.log.gz 2023-11-04T01:59:15.521 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.124317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125982.log 2023-11-04T01:59:15.521 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.145345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154506.log 2023-11-04T01:59:15.522 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.124317.log.gz 2023-11-04T01:59:15.522 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.145345.log.gz 2023-11-04T01:59:15.522 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.125982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131114.log 2023-11-04T01:59:15.522 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.125982.log.gz 2023-11-04T01:59:15.523 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.154506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134600.log 2023-11-04T01:59:15.523 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.128901.log 2023-11-04T01:59:15.523 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.154506.log.gz 2023-11-04T01:59:15.523 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.134600.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.131114.log.gz 2023-11-04T01:59:15.524 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134863.log 2023-11-04T01:59:15.524 INFO:teuthology.orchestra.run.smithi077.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.134600.log.gz 2023-11-04T01:59:15.524 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.0.128901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158119.log 2023-11-04T01:59:15.525 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.134863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127124.log 2023-11-04T01:59:15.525 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.158119.log: -- /var/log/ceph/ceph-client.admin.156942.log 2023-11-04T01:59:15.525 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.127124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127867.log 2023-11-04T01:59:15.525 INFO:teuthology.orchestra.run.smithi077.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.134863.log.gz 2023-11-04T01:59:15.526 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.158119.log.gz 2023-11-04T01:59:15.526 INFO:teuthology.orchestra.run.smithi077.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.128901.log.gz 2023-11-04T01:59:15.526 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.156942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136983.log 2023-11-04T01:59:15.526 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.127124.log.gz 2023-11-04T01:59:15.527 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.127867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153114.log 2023-11-04T01:59:15.527 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.156942.log.gz 2023-11-04T01:59:15.527 INFO:teuthology.orchestra.run.smithi077.stderr: 88.0%/var/log/ceph/ceph-client.admin.136983.log: -- replaced with /var/log/ceph/ceph-client.admin.127867.log.gz 2023-11-04T01:59:15.528 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151126.log 2023-11-04T01:59:15.528 INFO:teuthology.orchestra.run.smithi077.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.136983.log.gz 2023-11-04T01:59:15.528 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.153114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137275.log 2023-11-04T01:59:15.528 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.153114.log.gz 2023-11-04T01:59:15.529 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.151126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134344.log 2023-11-04T01:59:15.529 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.137275.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.151126.log.gz 2023-11-04T01:59:15.529 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141974.log 2023-11-04T01:59:15.529 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.134344.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.137275.log.gz 2023-11-04T01:59:15.530 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.130641.log 2023-11-04T01:59:15.530 INFO:teuthology.orchestra.run.smithi077.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.134344.log.gz 2023-11-04T01:59:15.530 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.141974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137979.log 2023-11-04T01:59:15.531 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132584.log 2023-11-04T01:59:15.531 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.141974.log.gz 2023-11-04T01:59:15.531 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.137979.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.130641.log.gz 2023-11-04T01:59:15.531 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159145.log 2023-11-04T01:59:15.532 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.137979.log.gz 2023-11-04T01:59:15.532 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.132584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130515.log 2023-11-04T01:59:15.532 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.159145.log: gzip -5 88.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.132584.log.gz 2023-11-04T01:59:15.532 INFO:teuthology.orchestra.run.smithi077.stderr: /var/log/ceph/ceph-client.admin.159187.log 2023-11-04T01:59:15.533 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130515.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.159145.log.gz 2023-11-04T01:59:15.533 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138524.log 2023-11-04T01:59:15.533 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.130515.log.gz 2023-11-04T01:59:15.533 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.159187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144027.log 2023-11-04T01:59:15.534 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.138524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137065.log 2023-11-04T01:59:15.534 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.159187.log.gz 2023-11-04T01:59:15.534 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.144027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151962.log 2023-11-04T01:59:15.535 INFO:teuthology.orchestra.run.smithi077.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.138524.log.gz 2023-11-04T01:59:15.535 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.137065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142464.log 2023-11-04T01:59:15.535 INFO:teuthology.orchestra.run.smithi077.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.144027.log.gz 2023-11-04T01:59:15.535 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.151962.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.137065.log.gz 2023-11-04T01:59:15.536 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134132.log 2023-11-04T01:59:15.536 INFO:teuthology.orchestra.run.smithi077.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.151962.log.gz 2023-11-04T01:59:15.536 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.142464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133592.log 2023-11-04T01:59:15.537 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.134132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133879.log 2023-11-04T01:59:15.537 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.142464.log.gz 2023-11-04T01:59:15.537 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.134132.log.gz 2023-11-04T01:59:15.537 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.133592.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.133592.log.gz 2023-11-04T01:59:15.538 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150773.log 2023-11-04T01:59:15.538 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.133879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144297.log 2023-11-04T01:59:15.538 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.150773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137793.log 2023-11-04T01:59:15.538 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.133879.log.gz 2023-11-04T01:59:15.539 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.144297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139231.log 2023-11-04T01:59:15.539 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.137793.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.150773.log.gz 2023-11-04T01:59:15.539 INFO:teuthology.orchestra.run.smithi077.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.144297.log.gz 2023-11-04T01:59:15.540 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135968.log 2023-11-04T01:59:15.540 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.137793.log.gz 2023-11-04T01:59:15.540 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140221.log 2023-11-04T01:59:15.540 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.135968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155075.log 2023-11-04T01:59:15.541 INFO:teuthology.orchestra.run.smithi077.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.139231.log.gz 2023-11-04T01:59:15.541 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135470.log 2023-11-04T01:59:15.541 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.135968.log.gz 2023-11-04T01:59:15.541 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.155075.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.140221.log.gz 2023-11-04T01:59:15.542 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142422.log 2023-11-04T01:59:15.542 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.135470.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.155075.log.gz 2023-11-04T01:59:15.542 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138580.log 2023-11-04T01:59:15.543 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.142422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147356.log 2023-11-04T01:59:15.543 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.135470.log.gz 2023-11-04T01:59:15.543 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.142422.log.gz 2023-11-04T01:59:15.543 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.138580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144153.log 2023-11-04T01:59:15.544 INFO:teuthology.orchestra.run.smithi077.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.138580.log.gz 2023-11-04T01:59:15.544 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.147356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143943.log 2023-11-04T01:59:15.544 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.144153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145303.log 2023-11-04T01:59:15.545 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.147356.log.gz 2023-11-04T01:59:15.545 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2%/var/log/ceph/ceph-client.admin.143943.log: -- replaced with /var/log/ceph/ceph-client.admin.144153.log.gz 2023-11-04T01:59:15.545 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150338.log 2023-11-04T01:59:15.545 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.143943.log.gz 2023-11-04T01:59:15.546 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.145303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137709.log 2023-11-04T01:59:15.546 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.150338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146381.log 2023-11-04T01:59:15.546 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.145303.log.gz 2023-11-04T01:59:15.546 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.150338.log.gz 2023-11-04T01:59:15.547 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.137709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159019.log 2023-11-04T01:59:15.547 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.146381.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.137709.log.gz 2023-11-04T01:59:15.547 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126108.log 2023-11-04T01:59:15.548 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.159019.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.146381.log.gz 2023-11-04T01:59:15.548 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134216.log 2023-11-04T01:59:15.548 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3%/var/log/ceph/ceph-client.admin.126108.log: -- replaced with /var/log/ceph/ceph-client.admin.159019.log.gz 2023-11-04T01:59:15.548 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151757.log 2023-11-04T01:59:15.549 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.134216.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.126108.log.gz 2023-11-04T01:59:15.549 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-04T01:59:15.549 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.151757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147398.log 2023-11-04T01:59:15.550 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.134216.log.gz 2023-11-04T01:59:15.550 INFO:teuthology.orchestra.run.smithi077.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.151757.log.gz 2023-11-04T01:59:15.550 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137363.log 2023-11-04T01:59:15.550 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.147398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128389.log 2023-11-04T01:59:15.551 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.137363.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.147398.log.gz 2023-11-04T01:59:15.551 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143901.log 2023-11-04T01:59:15.551 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.137363.log.gz 2023-11-04T01:59:15.552 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147482.log 2023-11-04T01:59:15.552 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.128389.log: /var/log/ceph/ceph-client.admin.143901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124275.log 2023-11-04T01:59:15.552 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.147482.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.143901.log.gzgzip 2023-11-04T01:59:15.552 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.150578.log 2023-11-04T01:59:15.553 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140855.log 2023-11-04T01:59:15.553 INFO:teuthology.orchestra.run.smithi077.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.128389.log.gz 2023-11-04T01:59:15.553 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.124275.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.147482.log.gz 2023-11-04T01:59:15.553 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.150578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139063.log 2023-11-04T01:59:15.554 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.124275.log.gz 2023-11-04T01:59:15.554 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132195.log 2023-11-04T01:59:15.554 INFO:teuthology.orchestra.run.smithi077.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.150578.log.gz 2023-11-04T01:59:15.555 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139063.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.140855.log.gz 2023-11-04T01:59:15.555 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.141280.log 2023-11-04T01:59:15.555 INFO:teuthology.orchestra.run.smithi077.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.139063.log.gz 2023-11-04T01:59:15.555 INFO:teuthology.orchestra.run.smithi077.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-04T01:59:15.556 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125714.log 2023-11-04T01:59:15.556 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.132195.log: /var/log/ceph/ceph-client.0.141280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134048.log 2023-11-04T01:59:15.556 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.132195.log.gz 2023-11-04T01:59:15.557 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.125714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140603.log 2023-11-04T01:59:15.557 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.134048.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.125714.log.gz 2023-11-04T01:59:15.557 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136724.log 2023-11-04T01:59:15.557 INFO:teuthology.orchestra.run.smithi077.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.134048.log.gz 2023-11-04T01:59:15.558 INFO:teuthology.orchestra.run.smithi077.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.0.141280.log.gz 2023-11-04T01:59:15.558 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158709.log 2023-11-04T01:59:15.558 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.140603.log.gz 2023-11-04T01:59:15.558 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.136724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132505.log 2023-11-04T01:59:15.559 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.136724.log.gz 2023-11-04T01:59:15.559 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.158709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126229.log 2023-11-04T01:59:15.559 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.132505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158404.log 2023-11-04T01:59:15.560 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.158709.log.gz 2023-11-04T01:59:15.560 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.132505.log.gz 2023-11-04T01:59:15.560 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.126229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137835.log 2023-11-04T01:59:15.561 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.126229.log.gz 2023-11-04T01:59:15.561 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.158404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144861.log 2023-11-04T01:59:15.561 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.137835.log: gzip 88.7% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.158404.log.gz -- 2023-11-04T01:59:15.561 INFO:teuthology.orchestra.run.smithi077.stderr: /var/log/ceph/ceph-client.admin.143687.log 2023-11-04T01:59:15.562 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.137835.log.gz/var/log/ceph/ceph-client.admin.144861.log: 2023-11-04T01:59:15.562 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149631.log 2023-11-04T01:59:15.562 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.144861.log.gz 2023-11-04T01:59:15.562 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.143687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138783.log 2023-11-04T01:59:15.563 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.149631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130179.log 2023-11-04T01:59:15.563 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.143687.log.gz 2023-11-04T01:59:15.563 INFO:teuthology.orchestra.run.smithi077.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.149631.log.gz 2023-11-04T01:59:15.564 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.138783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135926.log 2023-11-04T01:59:15.564 INFO:teuthology.orchestra.run.smithi077.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.138783.log.gz 2023-11-04T01:59:15.564 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138825.log 2023-11-04T01:59:15.564 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.135926.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.130179.log.gz 2023-11-04T01:59:15.565 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151799.log 2023-11-04T01:59:15.565 INFO:teuthology.orchestra.run.smithi077.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.135926.log.gz 2023-11-04T01:59:15.565 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.138825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142590.log 2023-11-04T01:59:15.565 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.138825.log.gz 2023-11-04T01:59:15.566 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.151799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152287.log 2023-11-04T01:59:15.566 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.142590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158446.log 2023-11-04T01:59:15.566 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.151799.log.gz 2023-11-04T01:59:15.567 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.152287.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.142590.log.gz 2023-11-04T01:59:15.567 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126607.log 2023-11-04T01:59:15.567 INFO:teuthology.orchestra.run.smithi077.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.152287.log.gz 2023-11-04T01:59:15.567 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152161.log 2023-11-04T01:59:15.568 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.158446.log: /var/log/ceph/ceph-client.admin.126607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128347.log 2023-11-04T01:59:15.568 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.158446.log.gz 2023-11-04T01:59:15.568 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.152161.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.126607.log.gz 2023-11-04T01:59:15.569 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151628.log 2023-11-04T01:59:15.569 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.152161.log.gz 2023-11-04T01:59:15.569 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.128347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149733.log 2023-11-04T01:59:15.569 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.151628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151042.log 2023-11-04T01:59:15.570 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.128347.log.gz 2023-11-04T01:59:15.570 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.151628.log.gz 2023-11-04T01:59:15.570 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.149733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139796.log 2023-11-04T01:59:15.570 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.149733.log.gz 2023-11-04T01:59:15.571 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.151042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126785.log 2023-11-04T01:59:15.571 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118285.log 2023-11-04T01:59:15.571 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.151042.log.gz 2023-11-04T01:59:15.571 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139796.log.gz 2023-11-04T01:59:15.572 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.126785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144921.log 2023-11-04T01:59:15.572 INFO:teuthology.orchestra.run.smithi077.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.126785.log.gz 2023-11-04T01:59:15.572 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.118285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151454.log 2023-11-04T01:59:15.573 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.144921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124953.log 2023-11-04T01:59:15.573 INFO:teuthology.orchestra.run.smithi077.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.144921.log.gz 2023-11-04T01:59:15.573 INFO:teuthology.orchestra.run.smithi077.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.118285.log.gz 2023-11-04T01:59:15.573 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.151454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138699.log 2023-11-04T01:59:15.574 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138087.log 2023-11-04T01:59:15.574 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.124953.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.151454.log.gz 2023-11-04T01:59:15.574 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.138699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153778.log 2023-11-04T01:59:15.574 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.138087.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.138699.log.gz 2023-11-04T01:59:15.575 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140305.log 2023-11-04T01:59:15.575 INFO:teuthology.orchestra.run.smithi077.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.124953.log.gz 2023-11-04T01:59:15.575 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.138087.log.gz 2023-11-04T01:59:15.575 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.153778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130389.log 2023-11-04T01:59:15.576 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140305.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.153778.log.gz 2023-11-04T01:59:15.576 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156170.log 2023-11-04T01:59:15.576 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.140305.log.gz 2023-11-04T01:59:15.577 INFO:teuthology.orchestra.run.smithi077.stderr:gzip/var/log/ceph/ceph-client.admin.130389.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.152047.log 2023-11-04T01:59:15.577 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.156170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130053.log 2023-11-04T01:59:15.577 INFO:teuthology.orchestra.run.smithi077.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.130389.log.gz 2023-11-04T01:59:15.577 INFO:teuthology.orchestra.run.smithi077.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.156170.log.gz 2023-11-04T01:59:15.578 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.152047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127455.log 2023-11-04T01:59:15.578 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.152047.log.gz 2023-11-04T01:59:15.578 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159061.log 2023-11-04T01:59:15.578 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.127455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134516.log 2023-11-04T01:59:15.579 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.130053.log.gz 2023-11-04T01:59:15.579 INFO:teuthology.orchestra.run.smithi077.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.127455.log.gz 2023-11-04T01:59:15.579 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.159061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154422.log 2023-11-04T01:59:15.580 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.159061.log.gz 2023-11-04T01:59:15.580 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.134516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136052.log 2023-11-04T01:59:15.580 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.154422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134811.log 2023-11-04T01:59:15.580 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.134516.log.gz 2023-11-04T01:59:15.581 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.154422.log.gz 2023-11-04T01:59:15.581 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.136052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149254.log 2023-11-04T01:59:15.581 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.136052.log.gz 2023-11-04T01:59:15.581 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146213.log 2023-11-04T01:59:15.582 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.134811.log: /var/log/ceph/ceph-client.admin.149254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143315.log 2023-11-04T01:59:15.582 INFO:teuthology.orchestra.run.smithi077.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.134811.log.gz 2023-11-04T01:59:15.582 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.146213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136514.log 2023-11-04T01:59:15.583 INFO:teuthology.orchestra.run.smithi077.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.149254.log.gz 2023-11-04T01:59:15.583 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146848.log 2023-11-04T01:59:15.583 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.143315.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.146213.log.gz 2023-11-04T01:59:15.583 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149320.log 2023-11-04T01:59:15.584 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.136514.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.143315.log.gz 2023-11-04T01:59:15.584 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.146848.log: gzip 89.3% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.136514.log.gz 2023-11-04T01:59:15.584 INFO:teuthology.orchestra.run.smithi077.stderr: -- /var/log/ceph/ceph-client.admin.155285.log 2023-11-04T01:59:15.585 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145919.log 2023-11-04T01:59:15.585 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.149320.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.146848.log.gz 2023-11-04T01:59:15.585 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.155285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135772.log 2023-11-04T01:59:15.585 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.145919.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.155285.log.gz 2023-11-04T01:59:15.586 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139399.log 2023-11-04T01:59:15.586 INFO:teuthology.orchestra.run.smithi077.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.149320.log.gz 2023-11-04T01:59:15.586 INFO:teuthology.orchestra.run.smithi077.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.145919.log.gz 2023-11-04T01:59:15.587 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.135772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149030.log 2023-11-04T01:59:15.587 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129517.log 2023-11-04T01:59:15.587 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.135772.log.gz 2023-11-04T01:59:15.587 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.139399.log.gz 2023-11-04T01:59:15.588 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145961.log 2023-11-04T01:59:15.588 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.149030.log: /var/log/ceph/ceph-client.admin.129517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145709.log 2023-11-04T01:59:15.588 INFO:teuthology.orchestra.run.smithi077.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.149030.log.gz 2023-11-04T01:59:15.589 INFO:teuthology.orchestra.run.smithi077.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.129517.log.gz 2023-11-04T01:59:15.589 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.145961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154289.log 2023-11-04T01:59:15.589 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143985.log 2023-11-04T01:59:15.589 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.145709.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.145961.log.gz 2023-11-04T01:59:15.590 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.154289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149072.log 2023-11-04T01:59:15.590 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.145709.log.gz 2023-11-04T01:59:15.590 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.143985.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.154289.log.gz 2023-11-04T01:59:15.590 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.143985.log.gz 2023-11-04T01:59:15.591 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158344.log 2023-11-04T01:59:15.591 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.149072.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-04T01:59:15.591 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.158344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134174.log 2023-11-04T01:59:15.591 INFO:teuthology.orchestra.run.smithi077.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.149072.log.gz 2023-11-04T01:59:15.592 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-osd.1.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.158344.log.gz 2023-11-04T01:59:15.592 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141806.log 2023-11-04T01:59:15.592 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.134174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157439.log 2023-11-04T01:59:15.593 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.134174.log.gz 2023-11-04T01:59:15.593 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.141806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148886.log 2023-11-04T01:59:15.593 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154979.log 2023-11-04T01:59:15.593 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.157439.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.141806.log.gz 2023-11-04T01:59:15.593 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.148886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140347.log 2023-11-04T01:59:15.594 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.157439.log.gz 2023-11-04T01:59:15.594 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153030.log 2023-11-04T01:59:15.594 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.154979.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.148886.log.gz 2023-11-04T01:59:15.595 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143052.log 2023-11-04T01:59:15.595 INFO:teuthology.orchestra.run.smithi077.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.154979.log.gz 2023-11-04T01:59:15.595 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128095.log 2023-11-04T01:59:15.595 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.153030.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.140347.log.gz 2023-11-04T01:59:15.596 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.143052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133676.log 2023-11-04T01:59:15.596 INFO:teuthology.orchestra.run.smithi077.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.153030.log.gz 2023-11-04T01:59:15.596 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142842.log 2023-11-04T01:59:15.596 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.128095.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.143052.log.gz 2023-11-04T01:59:15.597 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.133676.log: gzip -5 --verbose 88.2% -- -- replaced with /var/log/ceph/ceph-client.admin.128095.log.gz /var/log/ceph/ceph-client.admin.130137.log 2023-11-04T01:59:15.597 INFO:teuthology.orchestra.run.smithi077.stderr: 2023-11-04T01:59:15.597 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150665.log 2023-11-04T01:59:15.598 INFO:teuthology.orchestra.run.smithi077.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.133676.log.gz 2023-11-04T01:59:15.598 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.142842.log: /var/log/ceph/ceph-client.admin.130137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150525.log 2023-11-04T01:59:15.598 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.142842.log.gz 2023-11-04T01:59:15.598 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.150665.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.130137.log.gz 2023-11-04T01:59:15.599 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146764.log 2023-11-04T01:59:15.599 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.150665.log.gz 2023-11-04T01:59:15.599 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.150525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127460.log 2023-11-04T01:59:15.600 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.146764.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.150525.log.gz 2023-11-04T01:59:15.600 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157397.log 2023-11-04T01:59:15.600 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.127460.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.146764.log.gz 2023-11-04T01:59:15.601 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152704.log 2023-11-04T01:59:15.601 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.157397.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.127460.log.gz 2023-11-04T01:59:15.601 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131869.log 2023-11-04T01:59:15.601 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.157397.log.gz 2023-11-04T01:59:15.602 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.152704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147230.log 2023-11-04T01:59:15.602 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.152704.log.gz 2023-11-04T01:59:15.602 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132337.log 2023-11-04T01:59:15.603 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124171.log 2023-11-04T01:59:15.603 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.147230.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.131869.log.gz 2023-11-04T01:59:15.603 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.132337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156070.log 2023-11-04T01:59:15.603 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.147230.log.gz 2023-11-04T01:59:15.604 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140645.log 2023-11-04T01:59:15.604 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.124171.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.132337.log.gz 2023-11-04T01:59:15.604 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.156070.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.124171.log.gz 2023-11-04T01:59:15.605 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127121.log 2023-11-04T01:59:15.605 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158877.log 2023-11-04T01:59:15.605 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140645.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.156070.log.gz 2023-11-04T01:59:15.605 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.127121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147584.log 2023-11-04T01:59:15.606 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.140645.log.gz 2023-11-04T01:59:15.606 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.155739.log 2023-11-04T01:59:15.606 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.158877.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.127121.log.gz 2023-11-04T01:59:15.607 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.147584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124869.log 2023-11-04T01:59:15.607 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.158877.log.gz 2023-11-04T01:59:15.607 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145751.log 2023-11-04T01:59:15.608 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.0.155739.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.147584.log.gz 2023-11-04T01:59:15.608 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.124869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149212.log 2023-11-04T01:59:15.608 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.145751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136598.log 2023-11-04T01:59:15.608 INFO:teuthology.orchestra.run.smithi077.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.124869.log.gz 2023-11-04T01:59:15.609 INFO:teuthology.orchestra.run.smithi077.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.145751.log.gz 2023-11-04T01:59:15.609 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.149212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133382.log 2023-11-04T01:59:15.609 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128305.log 2023-11-04T01:59:15.610 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.136598.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.149212.log.gz 2023-11-04T01:59:15.610 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.133382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130263.log 2023-11-04T01:59:15.610 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.136598.log.gz 2023-11-04T01:59:15.610 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.128305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143519.log 2023-11-04T01:59:15.611 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.133382.log.gz 2023-11-04T01:59:15.611 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130809.log 2023-11-04T01:59:15.611 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.128305.log.gz 2023-11-04T01:59:15.612 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137455.log 2023-11-04T01:59:15.612 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.143519.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.130263.log.gz 2023-11-04T01:59:15.612 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151920.log 2023-11-04T01:59:15.612 INFO:teuthology.orchestra.run.smithi077.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.143519.log.gz 2023-11-04T01:59:15.613 INFO:teuthology.orchestra.run.smithi077.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.0.155739.log.gz 2023-11-04T01:59:15.613 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.137455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136304.log 2023-11-04T01:59:15.613 INFO:teuthology.orchestra.run.smithi077.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.130809.log.gz 2023-11-04T01:59:15.613 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.151920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154360.log 2023-11-04T01:59:15.614 INFO:teuthology.orchestra.run.smithi077.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.137455.log.gz 2023-11-04T01:59:15.614 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.136304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131743.log 2023-11-04T01:59:15.614 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.151920.log.gz 2023-11-04T01:59:15.615 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.154360.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.136304.log.gz 2023-11-04T01:59:15.615 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145499.log 2023-11-04T01:59:15.615 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.154360.log.gz 2023-11-04T01:59:15.615 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157111.log 2023-11-04T01:59:15.616 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131743.log: /var/log/ceph/ceph-client.admin.145499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154704.log 2023-11-04T01:59:15.616 INFO:teuthology.orchestra.run.smithi077.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.131743.log.gz 2023-11-04T01:59:15.616 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.157111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156707.log 88.8% 2023-11-04T01:59:15.617 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.145499.log.gz 2023-11-04T01:59:15.617 INFO:teuthology.orchestra.run.smithi077.stderr: 87.7%/var/log/ceph/ceph-client.admin.154704.log: -- replaced with /var/log/ceph/ceph-client.admin.157111.log.gz 2023-11-04T01:59:15.617 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128011.log 2023-11-04T01:59:15.617 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.156707.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.154704.log.gz 2023-11-04T01:59:15.618 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141645.log 2023-11-04T01:59:15.618 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.156707.log.gz 2023-11-04T01:59:15.618 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.128011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153158.log 2023-11-04T01:59:15.619 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.128011.log.gz 2023-11-04T01:59:15.619 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133046.log 2023-11-04T01:59:15.619 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.141645.log: /var/log/ceph/ceph-client.admin.153158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150043.log 2023-11-04T01:59:15.619 INFO:teuthology.orchestra.run.smithi077.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.141645.log.gz 2023-11-04T01:59:15.620 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.133046.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.153158.log.gz 2023-11-04T01:59:15.620 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136220.log 2023-11-04T01:59:15.620 INFO:teuthology.orchestra.run.smithi077.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.133046.log.gz 2023-11-04T01:59:15.620 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.150043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134300.log 2023-11-04T01:59:15.621 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156820.log 2023-11-04T01:59:15.621 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.136220.log: /var/log/ceph/ceph-client.admin.134300.log: gzip -5 --verbose 91.3% -- /var/log/ceph/ceph-client.admin.157481.log -- replaced with /var/log/ceph/ceph-client.admin.150043.log.gz 2023-11-04T01:59:15.621 INFO:teuthology.orchestra.run.smithi077.stderr: 2023-11-04T01:59:15.622 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.136220.log.gz 2023-11-04T01:59:15.622 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138909.log 2023-11-04T01:59:15.622 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.156820.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.134300.log.gz 2023-11-04T01:59:15.622 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.157481.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.156820.log.gz 2023-11-04T01:59:15.623 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140263.log 2023-11-04T01:59:15.623 INFO:teuthology.orchestra.run.smithi077.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.157481.log.gz 2023-11-04T01:59:15.623 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130095.log 2023-11-04T01:59:15.624 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.138909.log: /var/log/ceph/ceph-client.admin.140263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124090.log 2023-11-04T01:59:15.624 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.138909.log.gz 2023-11-04T01:59:15.624 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.140263.log.gz 2023-11-04T01:59:15.624 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124487.log 2023-11-04T01:59:15.625 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133634.log 2023-11-04T01:59:15.625 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.124090.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.130095.log.gz 2023-11-04T01:59:15.625 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.124487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139543.log 2023-11-04T01:59:15.625 INFO:teuthology.orchestra.run.smithi077.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.124090.log.gz 2023-11-04T01:59:15.626 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.133634.log: -- /var/log/ceph/ceph-client.admin.139189.log 2023-11-04T01:59:15.626 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.124487.log.gz 2023-11-04T01:59:15.626 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130347.log 2023-11-04T01:59:15.627 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.133634.log.gz 2023-11-04T01:59:15.627 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139189.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.139543.log.gzgzip 2023-11-04T01:59:15.627 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.134947.log 2023-11-04T01:59:15.628 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130347.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.139189.log.gz 2023-11-04T01:59:15.628 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149125.log 2023-11-04T01:59:15.628 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.130347.log.gz 2023-11-04T01:59:15.628 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.134947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136808.log 2023-11-04T01:59:15.629 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155243.log 2023-11-04T01:59:15.629 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.149125.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.134947.log.gz 2023-11-04T01:59:15.629 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.136808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140729.log 2023-11-04T01:59:15.630 INFO:teuthology.orchestra.run.smithi077.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.149125.log.gz 2023-11-04T01:59:15.630 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132626.log 2023-11-04T01:59:15.630 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.155243.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.136808.log.gz 2023-11-04T01:59:15.630 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145877.log 2023-11-04T01:59:15.631 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.155243.log.gz 2023-11-04T01:59:15.631 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135688.log 2023-11-04T01:59:15.631 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.132626.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.140729.log.gz 2023-11-04T01:59:15.632 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.145877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134642.log 2023-11-04T01:59:15.632 INFO:teuthology.orchestra.run.smithi077.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.132626.log.gz 2023-11-04T01:59:15.632 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158583.log 2023-11-04T01:59:15.632 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.135688.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.145877.log.gz 2023-11-04T01:59:15.633 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.134642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140179.log 2023-11-04T01:59:15.633 INFO:teuthology.orchestra.run.smithi077.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.135688.log.gz 2023-11-04T01:59:15.633 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142170.log 2023-11-04T01:59:15.634 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.158583.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.134642.log.gz 2023-11-04T01:59:15.634 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140179.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.158583.log.gz 2023-11-04T01:59:15.634 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139021.log 2023-11-04T01:59:15.634 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158935.log 2023-11-04T01:59:15.635 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.142170.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.140179.log.gz 2023-11-04T01:59:15.635 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132710.log 2023-11-04T01:59:15.635 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.142170.log.gz 2023-11-04T01:59:15.636 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128221.log 2023-11-04T01:59:15.636 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.158935.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.139021.log.gz 2023-11-04T01:59:15.636 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.132710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143136.log 2023-11-04T01:59:15.636 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.158935.log.gz 2023-11-04T01:59:15.637 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-04T01:59:15.637 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.128221.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.132710.log.gz 2023-11-04T01:59:15.637 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.143136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139105.log 2023-11-04T01:59:15.637 INFO:teuthology.orchestra.run.smithi077.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.128221.log.gz 2023-11-04T01:59:15.638 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145177.log 2023-11-04T01:59:15.638 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-osd.3.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.143136.log.gz 2023-11-04T01:59:15.638 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125798.log 2023-11-04T01:59:15.639 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.145177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144069.log 88.3% 2023-11-04T01:59:15.639 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.139105.log.gz 2023-11-04T01:59:15.639 INFO:teuthology.orchestra.run.smithi077.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.145177.log.gz 2023-11-04T01:59:15.639 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.125798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156665.log 2023-11-04T01:59:15.640 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141932.log 2023-11-04T01:59:15.640 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.144069.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.125798.log.gz 2023-11-04T01:59:15.640 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.156665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148723.log 2023-11-04T01:59:15.641 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.144069.log.gz 2023-11-04T01:59:15.641 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.156665.log.gz 2023-11-04T01:59:15.641 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.141932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126439.log 2023-11-04T01:59:15.641 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156254.log 2023-11-04T01:59:15.642 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.148723.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.141932.log.gz 2023-11-04T01:59:15.642 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.126439.log: gzip -5 --verbose -- 88.3% -- replaced with /var/log/ceph/ceph-client.admin.148723.log.gz 2023-11-04T01:59:15.642 INFO:teuthology.orchestra.run.smithi077.stderr: /var/log/ceph/ceph-client.admin.142926.log 2023-11-04T01:59:15.643 INFO:teuthology.orchestra.run.smithi077.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.126439.log.gz 2023-11-04T01:59:15.643 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.156254.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.156254.log.gz 2023-11-04T01:59:15.643 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143178.log 2023-11-04T01:59:15.643 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.142926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156623.log 2023-11-04T01:59:15.644 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.143178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.135205.log 2023-11-04T01:59:15.644 INFO:teuthology.orchestra.run.smithi077.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.142926.log.gz 2023-11-04T01:59:15.644 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.156623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159624.log 2023-11-04T01:59:15.645 INFO:teuthology.orchestra.run.smithi077.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.143178.log.gz 2023-11-04T01:59:15.645 INFO:teuthology.orchestra.run.smithi077.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.156623.log.gz 2023-11-04T01:59:15.645 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.0.135205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126787.log 2023-11-04T01:59:15.645 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.159624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139483.log 2023-11-04T01:59:15.646 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.126787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133004.log 2023-11-04T01:59:15.646 INFO:teuthology.orchestra.run.smithi077.stderr: 89.2%/var/log/ceph/ceph-client.admin.139483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130011.log 2023-11-04T01:59:15.646 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.0.135205.log.gz 2023-11-04T01:59:15.647 INFO:teuthology.orchestra.run.smithi077.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.126787.log.gz 2023-11-04T01:59:15.647 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.133004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146003.log 2023-11-04T01:59:15.647 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.139483.log.gz 2023-11-04T01:59:15.647 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123994.log 2023-11-04T01:59:15.648 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.133004.log.gz 2023-11-04T01:59:15.648 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.146003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127699.log 2023-11-04T01:59:15.648 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.130011.log.gz 2023-11-04T01:59:15.649 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5/var/log/ceph/ceph-client.admin.123994.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.146003.log.gz 2023-11-04T01:59:15.649 INFO:teuthology.orchestra.run.smithi077.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.159624.log.gz 2023-11-04T01:59:15.649 INFO:teuthology.orchestra.run.smithi077.stderr: --verbose -- /var/log/ceph/ceph-client.admin.127122.log 2023-11-04T01:59:15.649 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.127699.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.123994.log.gz 2023-11-04T01:59:15.650 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130431.log 2023-11-04T01:59:15.650 INFO:teuthology.orchestra.run.smithi077.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.127699.log.gz 2023-11-04T01:59:15.650 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148928.log 2023-11-04T01:59:15.651 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.127122.log: /var/log/ceph/ceph-client.admin.130431.log: gzip -5 --verbose -- 88.3% -- replaced with /var/log/ceph/ceph-client.admin.127122.log.gz 2023-11-04T01:59:15.651 INFO:teuthology.orchestra.run.smithi077.stderr: /var/log/ceph/ceph-client.admin.142296.log 2023-11-04T01:59:15.651 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.130431.log.gz 2023-11-04T01:59:15.651 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.148928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126481.log 2023-11-04T01:59:15.652 INFO:teuthology.orchestra.run.smithi077.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.148928.log.gz 2023-11-04T01:59:15.652 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.142296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118638.log 2023-11-04T01:59:15.652 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.126481.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.142296.log.gz 2023-11-04T01:59:15.653 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137149.log 2023-11-04T01:59:15.653 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.126481.log.gz 2023-11-04T01:59:15.653 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.118638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146255.log 2023-11-04T01:59:15.654 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129717.log 2023-11-04T01:59:15.654 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.137149.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118638.log.gz 2023-11-04T01:59:15.654 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.146255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137413.log 2023-11-04T01:59:15.654 INFO:teuthology.orchestra.run.smithi077.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.137149.log.gz 2023-11-04T01:59:15.655 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.129717.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.146255.log.gz -5 2023-11-04T01:59:15.655 INFO:teuthology.orchestra.run.smithi077.stderr: --verbose -- /var/log/ceph/ceph-client.admin.143220.log 2023-11-04T01:59:15.655 INFO:teuthology.orchestra.run.smithi077.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.129717.log.gz 2023-11-04T01:59:15.656 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156900.log 2023-11-04T01:59:15.656 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.137413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144195.log 2023-11-04T01:59:15.656 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.143220.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.137413.log.gz 2023-11-04T01:59:15.656 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.156900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158260.log 2023-11-04T01:59:15.657 INFO:teuthology.orchestra.run.smithi077.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.143220.log.gz 2023-11-04T01:59:15.657 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133508.log 2023-11-04T01:59:15.657 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.156900.log.gz 2023-11-04T01:59:15.658 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.144195.log: /var/log/ceph/ceph-client.admin.158260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132069.log 2023-11-04T01:59:15.658 INFO:teuthology.orchestra.run.smithi077.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.144195.log.gz 2023-11-04T01:59:15.658 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.133508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129969.log 2023-11-04T01:59:15.658 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.158260.log.gz 2023-11-04T01:59:15.659 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.132069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150483.log 2023-11-04T01:59:15.659 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.133508.log.gz 2023-11-04T01:59:15.659 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.129969.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.132069.log.gz 2023-11-04T01:59:15.660 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134726.log 2023-11-04T01:59:15.660 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.129969.log.gz 2023-11-04T01:59:15.660 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.150483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133718.log 2023-11-04T01:59:15.660 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.134726.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.150483.log.gz 2023-11-04T01:59:15.661 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138741.log 2023-11-04T01:59:15.661 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.157832.log 2023-11-04T01:59:15.661 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.134726.log.gz 2023-11-04T01:59:15.661 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.133718.log: /var/log/ceph/ceph-client.admin.138741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131953.log 2023-11-04T01:59:15.662 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.133718.log.gz 2023-11-04T01:59:15.662 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.0.157832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128179.log 2023-11-04T01:59:15.662 INFO:teuthology.orchestra.run.smithi077.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.138741.log.gz 2023-11-04T01:59:15.663 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146171.log 2023-11-04T01:59:15.663 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.128179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128053.log 2023-11-04T01:59:15.663 INFO:teuthology.orchestra.run.smithi077.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.131953.log.gz 2023-11-04T01:59:15.663 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose 88.7% -- replaced with /var/log/ceph/ceph-client.admin.128179.log.gz 2023-11-04T01:59:15.664 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.146171.log: -- /var/log/ceph/ceph-client.admin.145051.log 2023-11-04T01:59:15.664 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.128053.log: gzip 89.1% -- replaced with /var/log/ceph/ceph-client.admin.146171.log.gz 2023-11-04T01:59:15.664 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.157271.log 2023-11-04T01:59:15.665 INFO:teuthology.orchestra.run.smithi077.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.128053.log.gz 2023-11-04T01:59:15.665 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.145051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141005.log 2023-11-04T01:59:15.665 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.145051.log.gz 2023-11-04T01:59:15.665 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.157271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143010.log 2023-11-04T01:59:15.666 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.157271.log.gz 2023-11-04T01:59:15.666 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.141005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145793.log 2023-11-04T01:59:15.666 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.143010.log: gzip 88.9% -- replaced with /var/log/ceph/ceph-client.admin.141005.log.gz 2023-11-04T01:59:15.667 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.141764.log 2023-11-04T01:59:15.667 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.145793.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.143010.log.gz 2023-11-04T01:59:15.667 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149589.log 2023-11-04T01:59:15.668 INFO:teuthology.orchestra.run.smithi077.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.145793.log.gz 2023-11-04T01:59:15.668 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.141764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133256.log 2023-11-04T01:59:15.668 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.149589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134388.log 2023-11-04T01:59:15.668 INFO:teuthology.orchestra.run.smithi077.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.141764.log.gz 2023-11-04T01:59:15.669 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.133256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152618.log 2023-11-04T01:59:15.669 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.149589.log.gz 2023-11-04T01:59:15.669 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143094.log 2023-11-04T01:59:15.669 INFO:teuthology.orchestra.run.smithi077.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.133256.log.gz 2023-11-04T01:59:15.670 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.134388.log: /var/log/ceph/ceph-client.admin.152618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148661.log 2023-11-04T01:59:15.670 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129843.log 2023-11-04T01:59:15.670 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.143094.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.134388.log.gz 2023-11-04T01:59:15.671 INFO:teuthology.orchestra.run.smithi077.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.152618.log.gz 2023-11-04T01:59:15.671 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.148661.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.143094.log.gz 2023-11-04T01:59:15.671 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124359.log 2023-11-04T01:59:15.671 INFO:teuthology.orchestra.run.smithi077.stderr:gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.148661.log.gz 2023-11-04T01:59:15.672 INFO:teuthology.orchestra.run.smithi077.stderr: -5/var/log/ceph/ceph-client.admin.129843.log: --verbose -- /var/log/ceph/ceph-client.admin.158302.log 2023-11-04T01:59:15.672 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.124359.log: gzip -5 88.9% --verbose -- /var/log/ceph/ceph-client.admin.148131.log 2023-11-04T01:59:15.672 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.129843.log.gz 2023-11-04T01:59:15.673 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.124359.log.gz 2023-11-04T01:59:15.673 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.158302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145541.log 2023-11-04T01:59:15.673 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.158302.log.gz 2023-11-04T01:59:15.673 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.148131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142758.log 2023-11-04T01:59:15.674 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.148131.log.gz 2023-11-04T01:59:15.674 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.145541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155900.log 2023-11-04T01:59:15.674 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.142758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154875.log 2023-11-04T01:59:15.674 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.145541.log.gz 2023-11-04T01:59:15.675 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.155900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141686.log 2023-11-04T01:59:15.675 INFO:teuthology.orchestra.run.smithi077.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.142758.log.gz 2023-11-04T01:59:15.675 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154126.log 2023-11-04T01:59:15.676 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.154875.log: /var/log/ceph/ceph-client.admin.141686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143771.log 2023-11-04T01:59:15.676 INFO:teuthology.orchestra.run.smithi077.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.155900.log.gz/var/log/ceph/ceph-client.admin.154126.log: 2023-11-04T01:59:15.676 INFO:teuthology.orchestra.run.smithi077.stderr: 86.1% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.154875.log.gz 2023-11-04T01:59:15.676 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.141686.log.gz 2023-11-04T01:59:15.677 INFO:teuthology.orchestra.run.smithi077.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.0.157832.log.gz 2023-11-04T01:59:15.677 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129675.log 2023-11-04T01:59:15.677 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.154126.log.gz 2023-11-04T01:59:15.677 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.143771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144339.log 2023-11-04T01:59:15.678 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.129675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155159.log 2023-11-04T01:59:15.678 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.143771.log.gz 2023-11-04T01:59:15.678 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.144339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146339.log 2023-11-04T01:59:15.679 INFO:teuthology.orchestra.run.smithi077.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.129675.log.gz 2023-11-04T01:59:15.679 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149170.log 2023-11-04T01:59:15.679 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.155159.log: /var/log/ceph/ceph-client.admin.146339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134684.log 2023-11-04T01:59:15.679 INFO:teuthology.orchestra.run.smithi077.stderr: 91.0% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.155159.log.gz 2023-11-04T01:59:15.680 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.144339.log.gz 2023-11-04T01:59:15.680 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.149170.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.146339.log.gz 2023-11-04T01:59:15.680 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148374.log 2023-11-04T01:59:15.681 INFO:teuthology.orchestra.run.smithi077.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.149170.log.gz 2023-11-04T01:59:15.681 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137497.log 2023-11-04T01:59:15.681 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.134684.log: /var/log/ceph/ceph-client.admin.148374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153072.log 2023-11-04T01:59:15.681 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.134684.log.gz 2023-11-04T01:59:15.682 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.137497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138021.log 2023-11-04T01:59:15.682 INFO:teuthology.orchestra.run.smithi077.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.148374.log.gz 2023-11-04T01:59:15.682 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.153072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124701.log 2023-11-04T01:59:15.683 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.137497.log.gz 2023-11-04T01:59:15.683 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134258.log 2023-11-04T01:59:15.683 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.138021.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.153072.log.gz 2023-11-04T01:59:15.683 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.124701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139754.log 2023-11-04T01:59:15.684 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.124701.log.gz 2023-11-04T01:59:15.684 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.134258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152203.log 2023-11-04T01:59:15.684 INFO:teuthology.orchestra.run.smithi077.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.138021.log.gz 2023-11-04T01:59:15.684 INFO:teuthology.orchestra.run.smithi077.stderr:gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.134258.log.gz 2023-11-04T01:59:15.685 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139754.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.152005.log 2023-11-04T01:59:15.685 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.152203.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.139754.log.gz 2023-11-04T01:59:15.685 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.158667.log 2023-11-04T01:59:15.686 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.152203.log.gz 2023-11-04T01:59:15.686 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.152005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131658.log 2023-11-04T01:59:15.686 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130473.log 2023-11-04T01:59:15.686 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.152005.log.gz/var/log/ceph/ceph-client.admin.158667.log: 2023-11-04T01:59:15.687 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131658.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:59:15.687 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.158667.log.gz 2023-11-04T01:59:15.687 INFO:teuthology.orchestra.run.smithi077.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.131658.log.gz 2023-11-04T01:59:15.688 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158751.log 2023-11-04T01:59:15.688 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152428.log 2023-11-04T01:59:15.688 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-mgr.y.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.130473.log.gz 2023-11-04T01:59:15.688 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.158751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156296.log 2023-11-04T01:59:15.689 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153294.log 2023-11-04T01:59:15.689 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.158751.log.gz 2023-11-04T01:59:15.689 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.152428.log: gzip/var/log/ceph/ceph-client.admin.156296.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.127783.log 2023-11-04T01:59:15.689 INFO:teuthology.orchestra.run.smithi077.stderr: 87.5%/var/log/ceph/ceph-client.admin.153294.log: -- replaced with /var/log/ceph/ceph-client.admin.152428.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141890.log 2023-11-04T01:59:15.690 INFO:teuthology.orchestra.run.smithi077.stderr: 2023-11-04T01:59:15.690 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156296.log.gz 2023-11-04T01:59:15.690 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.153294.log.gz 2023-11-04T01:59:15.691 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142016.log 2023-11-04T01:59:15.691 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.127783.log: /var/log/ceph/ceph-client.admin.141890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124827.log 2023-11-04T01:59:15.691 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.142016.log: gzip -5 --verbose -- 89.6% /var/log/ceph/ceph-client.admin.147058.log 2023-11-04T01:59:15.691 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.127783.log.gz 2023-11-04T01:59:15.692 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.141890.log.gz 2023-11-04T01:59:15.692 INFO:teuthology.orchestra.run.smithi077.stderr:gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.142016.log.gz 2023-11-04T01:59:15.692 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.124827.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.126786.log 2023-11-04T01:59:15.693 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.147058.log: gzip 89.0% -- replaced with /var/log/ceph/ceph-client.admin.124827.log.gz 2023-11-04T01:59:15.693 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.133340.log 2023-11-04T01:59:15.693 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.147058.log.gz 2023-11-04T01:59:15.693 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.126786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132463.log 2023-11-04T01:59:15.694 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3%/var/log/ceph/ceph-client.admin.133340.log: -- replaced with /var/log/ceph/ceph-client.admin.126786.log.gz 2023-11-04T01:59:15.694 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142968.log 2023-11-04T01:59:15.694 INFO:teuthology.orchestra.run.smithi077.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.133340.log.gz 2023-11-04T01:59:15.695 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.132463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125940.log 2023-11-04T01:59:15.695 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.142968.log: gzip -5 --verbose 89.0% -- replaced with /var/log/ceph/ceph-client.admin.132463.log.gz 2023-11-04T01:59:15.695 INFO:teuthology.orchestra.run.smithi077.stderr: -- /var/log/ceph/ceph-client.admin.152245.log 2023-11-04T01:59:15.695 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.125940.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.142968.log.gz 2023-11-04T01:59:15.696 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157068.log 2023-11-04T01:59:15.696 INFO:teuthology.orchestra.run.smithi077.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.125940.log.gz 2023-11-04T01:59:15.696 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5/var/log/ceph/ceph-client.admin.152245.log: --verbose -- /var/log/ceph/ceph-client.admin.125840.log 2023-11-04T01:59:15.696 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.157068.log: gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152245.log.gz 2023-11-04T01:59:15.697 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.135392.log 2023-11-04T01:59:15.697 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.157068.log.gz 2023-11-04T01:59:15.697 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.125840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145261.log 2023-11-04T01:59:15.698 INFO:teuthology.orchestra.run.smithi077.stderr: 87.7%/var/log/ceph/ceph-client.admin.135392.log: -- replaced with /var/log/ceph/ceph-client.admin.125840.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128137.log 2023-11-04T01:59:15.698 INFO:teuthology.orchestra.run.smithi077.stderr: 2023-11-04T01:59:15.698 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.145261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136556.log 2023-11-04T01:59:15.699 INFO:teuthology.orchestra.run.smithi077.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.135392.log.gz 2023-11-04T01:59:15.699 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.128137.log: gzip -5 --verbose 87.9% -- /var/log/ceph/ceph-client.admin.126565.log -- replaced with /var/log/ceph/ceph-client.admin.145261.log.gz 2023-11-04T01:59:15.699 INFO:teuthology.orchestra.run.smithi077.stderr: 2023-11-04T01:59:15.699 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.136556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137191.log 2023-11-04T01:59:15.700 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.128137.log.gz 2023-11-04T01:59:15.700 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.126565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.144662.log 2023-11-04T01:59:15.700 INFO:teuthology.orchestra.run.smithi077.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.136556.log.gz 2023-11-04T01:59:15.700 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140519.log 2023-11-04T01:59:15.701 INFO:teuthology.orchestra.run.smithi077.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.126565.log.gz/var/log/ceph/ceph-client.admin.137191.log: 2023-11-04T01:59:15.701 INFO:teuthology.orchestra.run.smithi077.stderr:gzip/var/log/ceph/ceph-client.0.144662.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.151412.log 2023-11-04T01:59:15.701 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126271.log 2023-11-04T01:59:15.702 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140519.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.137191.log.gz 2023-11-04T01:59:15.702 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5%/var/log/ceph/ceph-client.admin.151412.log: -- replaced with /var/log/ceph/ceph-client.admin.140519.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134768.log 2023-11-04T01:59:15.702 INFO:teuthology.orchestra.run.smithi077.stderr: 2023-11-04T01:59:15.702 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.151412.log.gzgzip 2023-11-04T01:59:15.703 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.124443.log 2023-11-04T01:59:15.703 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.126271.log: /var/log/ceph/ceph-client.admin.134768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126397.log 2023-11-04T01:59:15.703 INFO:teuthology.orchestra.run.smithi077.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.126271.log.gz 2023-11-04T01:59:15.703 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.124443.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.134768.log.gz 2023-11-04T01:59:15.704 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128517.log 2023-11-04T01:59:15.704 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.124443.log.gz 2023-11-04T01:59:15.704 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145457.log 2023-11-04T01:59:15.705 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.126397.log: /var/log/ceph/ceph-client.admin.128517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126782.log 2023-11-04T01:59:15.705 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.145457.log: 89.4% 87.9% -- replaced with /var/log/ceph/ceph-client.admin.128517.log.gz 2023-11-04T01:59:15.705 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.126397.log.gz 2023-11-04T01:59:15.705 INFO:teuthology.orchestra.run.smithi077.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-04T01:59:15.706 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.145457.log.gz 2023-11-04T01:59:15.706 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132153.log 2023-11-04T01:59:15.706 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.126782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135526.log 2023-11-04T01:59:15.707 INFO:teuthology.orchestra.run.smithi077.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.0.144662.log.gz 2023-11-04T01:59:15.707 INFO:teuthology.orchestra.run.smithi077.stderr: 89.2%/var/log/ceph/ceph-client.admin.132153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133214.log 2023-11-04T01:59:15.707 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.126782.log.gz 2023-11-04T01:59:15.707 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.135526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145219.log 2023-11-04T01:59:15.708 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.132153.log.gz 2023-11-04T01:59:15.708 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.133214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154464.log 2023-11-04T01:59:15.708 INFO:teuthology.orchestra.run.smithi077.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.135526.log.gz 2023-11-04T01:59:15.708 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.145219.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.133214.log.gz 2023-11-04T01:59:15.709 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125756.log 2023-11-04T01:59:15.709 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.154464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126789.log 2023-11-04T01:59:15.709 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.145219.log.gz 2023-11-04T01:59:15.710 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.125756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152109.log 2023-11-04T01:59:15.710 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.154464.log.gz 2023-11-04T01:59:15.710 INFO:teuthology.orchestra.run.smithi077.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.125756.log.gz 2023-11-04T01:59:15.710 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.126789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131214.log 2023-11-04T01:59:15.711 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150217.log 2023-11-04T01:59:15.711 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.152109.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.126789.log.gz 2023-11-04T01:59:15.711 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147188.log 2023-11-04T01:59:15.711 INFO:teuthology.orchestra.run.smithi077.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.152109.log.gz 2023-11-04T01:59:15.712 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.150217.log: gzip -5 --verbose 87.7% -- replaced with /var/log/ceph/ceph-client.admin.131214.log.gz 2023-11-04T01:59:15.712 INFO:teuthology.orchestra.run.smithi077.stderr: -- /var/log/ceph/ceph-client.admin.136346.log 2023-11-04T01:59:15.712 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.147188.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.150217.log.gz 2023-11-04T01:59:15.713 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126355.log 2023-11-04T01:59:15.713 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.147188.log.gz 2023-11-04T01:59:15.713 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.136346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130599.log 2023-11-04T01:59:15.713 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8%/var/log/ceph/ceph-client.admin.126355.log: -- replaced with /var/log/ceph/ceph-client.admin.136346.log.gz 2023-11-04T01:59:15.714 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146129.log 87.8% -- replaced with /var/log/ceph/ceph-client.admin.126355.log.gz 2023-11-04T01:59:15.714 INFO:teuthology.orchestra.run.smithi077.stderr: 2023-11-04T01:59:15.714 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130599.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-04T01:59:15.714 INFO:teuthology.orchestra.run.smithi077.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.130599.log.gz 2023-11-04T01:59:15.715 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.146129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156212.log 2023-11-04T01:59:15.715 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-osd.0.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.146129.log.gz 2023-11-04T01:59:15.715 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152988.log 2023-11-04T01:59:15.716 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.156212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127125.log 2023-11-04T01:59:15.716 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.152988.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.156212.log.gz 2023-11-04T01:59:15.716 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141848.log 2023-11-04T01:59:15.716 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.152988.log.gz 2023-11-04T01:59:15.717 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.127125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132111.log 2023-11-04T01:59:15.717 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.127125.log.gz 2023-11-04T01:59:15.717 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.141848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156519.log 2023-11-04T01:59:15.717 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.132111.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.141848.log.gz 2023-11-04T01:59:15.718 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143645.log 2023-11-04T01:59:15.718 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.132111.log.gz 2023-11-04T01:59:15.718 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.156519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135814.log 2023-11-04T01:59:15.719 INFO:teuthology.orchestra.run.smithi077.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.156519.log.gz 2023-11-04T01:59:15.719 INFO:teuthology.orchestra.run.smithi077.stderr:gzip/var/log/ceph/ceph-client.admin.143645.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.129801.log 2023-11-04T01:59:15.719 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.135814.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.143645.log.gz 2023-11-04T01:59:15.719 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157993.log 2023-11-04T01:59:15.720 INFO:teuthology.orchestra.run.smithi077.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.135814.log.gz 2023-11-04T01:59:15.720 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.129801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136178.log 2023-11-04T01:59:15.720 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.157993.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.129801.log.gz 2023-11-04T01:59:15.721 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146890.log 2023-11-04T01:59:15.721 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.136178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142338.log 2023-11-04T01:59:15.721 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.136178.log.gz 2023-11-04T01:59:15.721 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.146890.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.157993.log.gz 2023-11-04T01:59:15.722 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132920.log 2023-11-04T01:59:15.722 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.146890.log.gz 2023-11-04T01:59:15.722 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.142338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159815.log 2023-11-04T01:59:15.723 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.142338.log.gz 2023-11-04T01:59:15.723 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.132920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127825.log 2023-11-04T01:59:15.723 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.159815.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.132920.log.gz 2023-11-04T01:59:15.723 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127453.log 2023-11-04T01:59:15.724 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.127825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146932.log 2023-11-04T01:59:15.724 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8%/var/log/ceph/ceph-client.admin.127453.log: -- replaced with /var/log/ceph/ceph-client.admin.127825.log.gz 2023-11-04T01:59:15.724 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149673.log 2023-11-04T01:59:15.724 INFO:teuthology.orchestra.run.smithi077.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.127453.log.gz 2023-11-04T01:59:15.725 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131298.log 2023-11-04T01:59:15.725 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.146932.log: /var/log/ceph/ceph-client.admin.149673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142800.log 2023-11-04T01:59:15.725 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131298.log: 87.8% 88.5% -- replaced with /var/log/ceph/ceph-client.admin.149673.log.gz 2023-11-04T01:59:15.726 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.146932.log.gz 2023-11-04T01:59:15.726 INFO:teuthology.orchestra.run.smithi077.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.159815.log.gz 2023-11-04T01:59:15.726 INFO:teuthology.orchestra.run.smithi077.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.131298.log.gz 2023-11-04T01:59:15.726 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149834.log 2023-11-04T01:59:15.727 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.142800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154662.log 2023-11-04T01:59:15.727 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.149834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153840.log 2023-11-04T01:59:15.727 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.142800.log.gz 2023-11-04T01:59:15.727 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.154662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126783.log 2023-11-04T01:59:15.728 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.149834.log.gz 2023-11-04T01:59:15.728 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.153840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137233.log 2023-11-04T01:59:15.728 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.154662.log.gz 2023-11-04T01:59:15.729 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 88.9% -- replaced with /var/log/ceph/ceph-client.admin.153840.log.gz 2023-11-04T01:59:15.729 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.126783.log: --verbose -- /var/log/ceph/ceph-client.admin.139838.log 2023-11-04T01:59:15.729 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.137233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160031.log 88.0% -- replaced with /var/log/ceph/ceph-client.admin.126783.log.gz 2023-11-04T01:59:15.729 INFO:teuthology.orchestra.run.smithi077.stderr: 2023-11-04T01:59:15.730 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139838.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.137233.log.gz 2023-11-04T01:59:15.730 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.138344.log 2023-11-04T01:59:15.730 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139838.log.gz 2023-11-04T01:59:15.730 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.160031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130683.log 2023-11-04T01:59:15.731 INFO:teuthology.orchestra.run.smithi077.stderr:gzip/var/log/ceph/ceph-client.0.138344.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.136388.log 2023-11-04T01:59:15.731 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125630.log 2023-11-04T01:59:15.731 INFO:teuthology.orchestra.run.smithi077.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.130683.log.gz 2023-11-04T01:59:15.732 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.136388.log: 88.7% -- replaced with /var/log/ceph/ceph-client.0.138344.log.gz 2023-11-04T01:59:15.732 INFO:teuthology.orchestra.run.smithi077.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.136388.log.gz 2023-11-04T01:59:15.732 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-04T01:59:15.732 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.125630.log: gzip 95.7% -- replaced with /var/log/ceph/ceph-client.admin.160031.log.gz 2023-11-04T01:59:15.733 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.152534.log 2023-11-04T01:59:15.733 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.125630.log.gz 2023-11-04T01:59:15.733 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131030.log 2023-11-04T01:59:15.733 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.152534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156581.log 2023-11-04T01:59:15.734 INFO:teuthology.orchestra.run.smithi077.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.152534.log.gz/var/log/ceph/ceph-client.admin.131030.log: 2023-11-04T01:59:15.734 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126523.log 2023-11-04T01:59:15.734 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.131030.log.gz 2023-11-04T01:59:15.734 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127461.log 2023-11-04T01:59:15.735 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.156581.log: /var/log/ceph/ceph-client.admin.126523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145583.log 2023-11-04T01:59:15.735 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.127461.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.156581.log.gz 89.3% -- replaced with /var/log/ceph/ceph-client.admin.126523.log.gz 2023-11-04T01:59:15.735 INFO:teuthology.orchestra.run.smithi077.stderr: 2023-11-04T01:59:15.736 INFO:teuthology.orchestra.run.smithi077.stderr: 87.4% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.127461.log.gz 2023-11-04T01:59:15.736 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2023-11-04T01:59:15.736 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152367.log 2023-11-04T01:59:15.736 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155327.log 2023-11-04T01:59:15.737 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.145583.log: /var/log/ceph/ceph-client.admin.152367.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-04T01:59:15.737 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.155327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123913.log 2023-11-04T01:59:15.737 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.152367.log.gz 2023-11-04T01:59:15.737 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.145583.log.gz 2023-11-04T01:59:15.738 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-osd.2.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.155327.log.gz 2023-11-04T01:59:15.738 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142632.log 2023-11-04T01:59:15.738 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.123913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149896.log 2023-11-04T01:59:15.739 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.123913.log.gz 2023-11-04T01:59:15.739 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.142632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127458.log 2023-11-04T01:59:15.739 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.142632.log.gz/var/log/ceph/ceph-client.admin.149896.log: 2023-11-04T01:59:15.739 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139586.log 2023-11-04T01:59:15.740 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.149896.log.gz 2023-11-04T01:59:15.740 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132379.log 2023-11-04T01:59:15.740 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.127458.log: /var/log/ceph/ceph-client.admin.139586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135604.log 2023-11-04T01:59:15.740 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.132379.log: 87.4% 89.1% -- replaced with /var/log/ceph/ceph-client.admin.127458.log.gz 2023-11-04T01:59:15.741 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.139586.log.gz 2023-11-04T01:59:15.741 INFO:teuthology.orchestra.run.smithi077.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.132379.log.gz 2023-11-04T01:59:15.741 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-04T01:59:15.741 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.135604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132668.log 2023-11-04T01:59:15.742 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.135604.log.gz 2023-11-04T01:59:15.742 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158161.log 2023-11-04T01:59:15.742 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148599.log 2023-11-04T01:59:15.743 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.132668.log: /var/log/ceph/ceph-client.admin.158161.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.132668.log.gz 2023-11-04T01:59:15.743 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.158161.log.gz 2023-11-04T01:59:15.743 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141486.log 2023-11-04T01:59:15.743 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133963.log 2023-11-04T01:59:15.744 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.148599.log: /var/log/ceph/ceph-client.admin.141486.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.148599.log.gz 2023-11-04T01:59:15.744 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.141486.log.gz 2023-11-04T01:59:15.744 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141442.log 2023-11-04T01:59:15.744 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134090.log 2023-11-04T01:59:15.745 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.141442.log: /var/log/ceph/ceph-client.admin.133963.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.141442.log.gz 88.8% -- replaced with /var/log/ceph/ceph-client.admin.133963.log.gz 2023-11-04T01:59:15.745 INFO:teuthology.orchestra.run.smithi077.stderr: 2023-11-04T01:59:15.745 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146045.log 2023-11-04T01:59:15.746 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136094.log 2023-11-04T01:59:15.746 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.134090.log: /var/log/ceph/ceph-client.admin.146045.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.134090.log.gz 2023-11-04T01:59:15.746 INFO:teuthology.orchestra.run.smithi077.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.146045.log.gz 2023-11-04T01:59:15.747 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135730.log 2023-11-04T01:59:15.747 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.136094.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.136094.log.gz 2023-11-04T01:59:15.747 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146297.log 2023-11-04T01:59:15.747 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140939.log 2023-11-04T01:59:15.748 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.135730.log: /var/log/ceph/ceph-client.admin.146297.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.135730.log.gz 2023-11-04T01:59:15.748 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155370.log 2023-11-04T01:59:15.748 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.146297.log.gz 2023-11-04T01:59:15.748 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140939.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.140939.log.gz 2023-11-04T01:59:15.749 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126784.log 2023-11-04T01:59:15.749 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136640.log 2023-11-04T01:59:15.749 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.155370.log: /var/log/ceph/ceph-client.admin.126784.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.155370.log.gz 2023-11-04T01:59:15.749 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.126784.log.gzgzip 2023-11-04T01:59:15.750 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.148266.log 2023-11-04T01:59:15.750 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.136640.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.136640.log.gz 2023-11-04T01:59:15.750 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131554.log 2023-11-04T01:59:15.750 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138867.log 2023-11-04T01:59:15.751 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.148266.log: /var/log/ceph/ceph-client.admin.131554.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.148266.log.gz 2023-11-04T01:59:15.751 INFO:teuthology.orchestra.run.smithi077.stderr: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124911.log 2023-11-04T01:59:15.751 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.131554.log.gz 2023-11-04T01:59:15.752 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.138867.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.138867.log.gz 2023-11-04T01:59:15.752 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127321.log 2023-11-04T01:59:15.752 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151269.log 2023-11-04T01:59:15.752 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.124911.log: /var/log/ceph/ceph-client.admin.127321.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.124911.log.gz 2023-11-04T01:59:15.753 INFO:teuthology.orchestra.run.smithi077.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.127321.log.gz 2023-11-04T01:59:15.753 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140017.log 2023-11-04T01:59:15.753 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.151269.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.151269.log.gz 2023-11-04T01:59:15.753 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154788.log 2023-11-04T01:59:15.754 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136010.log 2023-11-04T01:59:15.754 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140017.log: /var/log/ceph/ceph-client.admin.154788.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.140017.log.gz 2023-11-04T01:59:15.754 INFO:teuthology.orchestra.run.smithi077.stderr: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131172.log 2023-11-04T01:59:15.754 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.154788.log.gz 2023-11-04T01:59:15.755 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.136010.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.136010.log.gz 2023-11-04T01:59:15.755 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150001.log 2023-11-04T01:59:15.755 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124785.log 2023-11-04T01:59:15.756 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131172.log: /var/log/ceph/ceph-client.admin.150001.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.131172.log.gz 2023-11-04T01:59:15.756 INFO:teuthology.orchestra.run.smithi077.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.150001.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130946.log 2023-11-04T01:59:15.756 INFO:teuthology.orchestra.run.smithi077.stderr: 2023-11-04T01:59:15.756 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.124785.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.124785.log.gz 2023-11-04T01:59:15.757 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127111.log 2023-11-04T01:59:15.757 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137319.log 2023-11-04T01:59:15.757 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130946.log: /var/log/ceph/ceph-client.admin.127111.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.130946.log.gz 2023-11-04T01:59:15.757 INFO:teuthology.orchestra.run.smithi077.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.127111.log.gz 2023-11-04T01:59:15.758 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131256.log 2023-11-04T01:59:15.758 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.137319.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.137319.log.gz 2023-11-04T01:59:15.758 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143477.log 2023-11-04T01:59:15.758 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137541.log 2023-11-04T01:59:15.759 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131256.log: /var/log/ceph/ceph-client.admin.143477.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.131256.log.gz 2023-11-04T01:59:15.759 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.143477.log.gzgzip 2023-11-04T01:59:15.759 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.139628.log 2023-11-04T01:59:15.759 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.137541.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.137541.log.gz 2023-11-04T01:59:15.760 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150943.log 2023-11-04T01:59:15.760 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136430.log 2023-11-04T01:59:15.760 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139628.log: /var/log/ceph/ceph-client.admin.150943.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139628.log.gz 2023-11-04T01:59:15.761 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.150943.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148844.log 2023-11-04T01:59:15.761 INFO:teuthology.orchestra.run.smithi077.stderr: 2023-11-04T01:59:15.761 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.136430.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.136430.log.gz 2023-11-04T01:59:15.761 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134006.log 2023-11-04T01:59:15.762 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157187.log 2023-11-04T01:59:15.762 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.148844.log: /var/log/ceph/ceph-client.admin.134006.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.148844.log.gz 2023-11-04T01:59:15.762 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131340.log 2023-11-04T01:59:15.763 INFO:teuthology.orchestra.run.smithi077.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.134006.log.gz 2023-11-04T01:59:15.763 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.157187.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.157187.log.gz 2023-11-04T01:59:15.763 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150175.log 2023-11-04T01:59:15.763 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134431.log 2023-11-04T01:59:15.764 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131340.log: /var/log/ceph/ceph-client.admin.150175.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.131340.log.gz 2023-11-04T01:59:15.764 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.150175.log.gz 2023-11-04T01:59:15.764 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133298.log 2023-11-04T01:59:15.764 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.134431.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.134431.log.gz 2023-11-04T01:59:15.765 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142254.log 2023-11-04T01:59:15.765 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129927.log 2023-11-04T01:59:15.765 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.133298.log: /var/log/ceph/ceph-client.admin.142254.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.133298.log.gz 2023-11-04T01:59:15.765 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.142254.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154084.log 2023-11-04T01:59:15.766 INFO:teuthology.orchestra.run.smithi077.stderr: 2023-11-04T01:59:15.766 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.129927.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.129927.log.gz 2023-11-04T01:59:15.766 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129024.log 2023-11-04T01:59:15.767 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145625.log 2023-11-04T01:59:15.767 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.154084.log: /var/log/ceph/ceph-client.admin.129024.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.154084.log.gz 2023-11-04T01:59:15.767 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.129024.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137937.log 2023-11-04T01:59:15.768 INFO:teuthology.orchestra.run.smithi077.stderr: 2023-11-04T01:59:15.768 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.145625.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.145625.log.gz 2023-11-04T01:59:15.768 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138487.log 2023-11-04T01:59:15.768 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146507.log 2023-11-04T01:59:15.769 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.137937.log: /var/log/ceph/ceph-client.admin.138487.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.137937.log.gz 2023-11-04T01:59:15.769 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151331.log 2023-11-04T01:59:15.769 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.138487.log.gz 2023-11-04T01:59:15.769 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.146507.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.146507.log.gz 2023-11-04T01:59:15.770 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132027.log 2023-11-04T01:59:15.770 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127657.log 2023-11-04T01:59:15.770 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.151331.log: /var/log/ceph/ceph-client.admin.132027.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.151331.log.gz 2023-11-04T01:59:15.770 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154917.log 2023-11-04T01:59:15.771 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.132027.log.gz 2023-11-04T01:59:15.771 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.127657.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.127657.log.gz 2023-11-04T01:59:15.771 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156458.log 2023-11-04T01:59:15.772 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131785.log 2023-11-04T01:59:15.772 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.154917.log: /var/log/ceph/ceph-client.admin.156458.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.154917.log.gz 2023-11-04T01:59:15.772 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132794.log 2023-11-04T01:59:15.772 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.156458.log.gz 2023-11-04T01:59:15.773 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131785.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.131785.log.gz 2023-11-04T01:59:15.773 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132295.log 2023-11-04T01:59:15.773 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.147949.log 2023-11-04T01:59:15.773 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.132794.log: /var/log/ceph/ceph-client.admin.132295.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.132794.log.gz 2023-11-04T01:59:15.774 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.132295.log.gz 2023-11-04T01:59:15.774 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149448.log 2023-11-04T01:59:15.774 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.0.147949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154024.log 2023-11-04T01:59:15.775 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.149448.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.149448.log.gz 2023-11-04T01:59:15.775 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145135.log 2023-11-04T01:59:15.775 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.154024.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.154024.log.gz 2023-11-04T01:59:15.775 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124213.log 2023-11-04T01:59:15.776 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.145135.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.145135.log.gz 2023-11-04T01:59:15.776 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138621.log 2023-11-04T01:59:15.776 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.124213.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.124213.log.gz 2023-11-04T01:59:15.776 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158077.log 2023-11-04T01:59:15.777 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.138621.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.138621.log.gz 2023-11-04T01:59:15.777 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136766.log 2023-11-04T01:59:15.777 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.158077.log: 93.1% -- replaced with /var/log/ceph/ceph-client.0.147949.log.gz 88.8% -- replaced with /var/log/ceph/ceph-client.admin.158077.log.gz 2023-11-04T01:59:15.778 INFO:teuthology.orchestra.run.smithi077.stderr: 2023-11-04T01:59:15.778 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131616.log 2023-11-04T01:59:15.778 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.136766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156028.log 2023-11-04T01:59:15.778 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.136766.log.gz 2023-11-04T01:59:15.779 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152808.log 2023-11-04T01:59:15.779 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.156028.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.131616.log.gz 2023-11-04T01:59:15.779 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140097.log 2023-11-04T01:59:15.780 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156028.log.gz 2023-11-04T01:59:15.780 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.152808.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-11-04T01:59:15.780 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140097.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152808.log.gz 2023-11-04T01:59:15.781 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.140097.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130904.log 2023-11-04T01:59:15.781 INFO:teuthology.orchestra.run.smithi077.stderr: 2023-11-04T01:59:15.781 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139273.log 2023-11-04T01:59:15.781 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130904.log: /var/log/ceph/ceph-mds.a.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.130904.log.gz 2023-11-04T01:59:15.782 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150707.log 2023-11-04T01:59:15.782 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139273.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.139273.log.gz 2023-11-04T01:59:15.782 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147692.log 2023-11-04T01:59:15.783 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.150707.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.150707.log.gz 2023-11-04T01:59:15.783 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125672.log 2023-11-04T01:59:15.783 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.147692.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.147692.log.gz 2023-11-04T01:59:15.783 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127969.log 2023-11-04T01:59:15.784 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.125672.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.125672.log.gz 2023-11-04T01:59:15.784 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139357.log 2023-11-04T01:59:15.784 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.127969.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.127969.log.gz 2023-11-04T01:59:15.785 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141589.log 2023-11-04T01:59:15.785 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139357.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.139357.log.gz 2023-11-04T01:59:15.785 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139712.log 2023-11-04T01:59:15.785 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.141589.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.141589.log.gz 2023-11-04T01:59:15.786 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151715.log 2023-11-04T01:59:15.786 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139712.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.139712.log.gz 2023-11-04T01:59:15.786 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141511.log 2023-11-04T01:59:15.786 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.151715.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.151715.log.gz 2023-11-04T01:59:15.787 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.141511.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.141511.log.gz 2023-11-04T01:59:15.787 INFO:teuthology.orchestra.run.smithi077.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-04T01:59:15.788 INFO:teuthology.orchestra.run.smithi077.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-11-04T01:59:15.788 INFO:teuthology.orchestra.run.smithi122.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-04T01:59:15.789 INFO:teuthology.orchestra.run.smithi122.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-04T01:59:15.895 INFO:teuthology.orchestra.run.smithi077.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-04T01:59:16.446 INFO:teuthology.orchestra.run.smithi122.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-04T01:59:16.459 INFO:teuthology.orchestra.run.smithi122.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-04T01:59:16.522 INFO:teuthology.orchestra.run.smithi077.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-04T01:59:16.558 INFO:teuthology.orchestra.run.smithi122.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-04T01:59:16.562 INFO:teuthology.orchestra.run.smithi122.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-04T01:59:16.564 INFO:teuthology.orchestra.run.smithi122.stderr: 2023-11-04T01:59:16.565 INFO:teuthology.orchestra.run.smithi122.stderr:real 0m1.384s 2023-11-04T01:59:16.565 INFO:teuthology.orchestra.run.smithi122.stderr:user 0m6.051s 2023-11-04T01:59:16.565 INFO:teuthology.orchestra.run.smithi122.stderr:sys 0m0.216s 2023-11-04T01:59:16.662 INFO:teuthology.orchestra.run.smithi077.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-04T01:59:16.669 INFO:teuthology.orchestra.run.smithi077.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-04T01:59:16.692 INFO:teuthology.orchestra.run.smithi077.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-04T01:59:16.694 INFO:teuthology.orchestra.run.smithi077.stderr: 2023-11-04T01:59:16.694 INFO:teuthology.orchestra.run.smithi077.stderr:real 0m1.546s 2023-11-04T01:59:16.695 INFO:teuthology.orchestra.run.smithi077.stderr:user 0m6.394s 2023-11-04T01:59:16.695 INFO:teuthology.orchestra.run.smithi077.stderr:sys 0m0.560s 2023-11-04T01:59:16.695 INFO:tasks.ceph:Archiving logs... 2023-11-04T01:59:16.696 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445917/remote/smithi077/log 2023-11-04T01:59:16.701 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-04T01:59:18.166 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445917/remote/smithi122/log 2023-11-04T01:59:18.167 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-04T01:59:19.034 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi077 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-04T01:59:19.045 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-04T01:59:19.055 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi077 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-04T01:59:19.059 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-04T01:59:19.060 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-04T01:59:19.066 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-04T01:59:19.144 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-04T01:59:19.153 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-04T01:59:19.153 DEBUG:teuthology.orchestra.run.smithi077:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-04T01:59:19.157 DEBUG:teuthology.orchestra.run.smithi122:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-04T01:59:19.170 INFO:teuthology.orchestra.run.smithi077.stderr:bash: line 1: ntpq: command not found 2023-11-04T01:59:19.173 INFO:teuthology.orchestra.run.smithi122.stderr:bash: line 1: ntpq: command not found 2023-11-04T01:59:19.176 INFO:teuthology.orchestra.run.smithi077.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-04T01:59:19.176 INFO:teuthology.orchestra.run.smithi077.stdout:=============================================================================== 2023-11-04T01:59:19.176 INFO:teuthology.orchestra.run.smithi077.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 46 +1880us[+1898us] +/- 85ms 2023-11-04T01:59:19.177 INFO:teuthology.orchestra.run.smithi077.stdout:^* hv02.front.sepia.ceph.com 3 6 377 45 -250us[ -233us] +/- 54ms 2023-11-04T01:59:19.177 INFO:teuthology.orchestra.run.smithi077.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 47 -1131us[-1113us] +/- 64ms 2023-11-04T01:59:19.177 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:59:19.178 INFO:teuthology.orchestra.run.smithi122.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-04T01:59:19.179 INFO:teuthology.orchestra.run.smithi122.stdout:=============================================================================== 2023-11-04T01:59:19.179 INFO:teuthology.orchestra.run.smithi122.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 47 +1822us[+1843us] +/- 85ms 2023-11-04T01:59:19.179 INFO:teuthology.orchestra.run.smithi122.stdout:^* hv02.front.sepia.ceph.com 3 6 377 44 -254us[ -233us] +/- 54ms 2023-11-04T01:59:19.179 INFO:teuthology.orchestra.run.smithi122.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 46 -1179us[-1158us] +/- 64ms 2023-11-04T01:59:19.180 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T01:59:19.180 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-04T01:59:19.189 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-04T01:59:19.189 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-04T01:59:19.220 DEBUG:teuthology.orchestra.run.smithi077:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-04T01:59:19.337 DEBUG:teuthology.orchestra.run.smithi122:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-04T01:59:19.439 DEBUG:teuthology.orchestra.run.smithi077:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-04T01:59:19.473 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:59:19.474 DEBUG:teuthology.orchestra.run.smithi122:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-04T01:59:19.506 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:59:19.507 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-04T01:59:19.516 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-04T01:59:19.553 INFO:teuthology.task.internal:Duration was 1924.581045 seconds 2023-11-04T01:59:19.554 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-04T01:59:19.595 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-04T01:59:19.596 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-04T01:59:19.599 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-04T01:59:19.640 INFO:teuthology.orchestra.run.smithi077.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-04T01:59:19.642 INFO:teuthology.orchestra.run.smithi122.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-04T01:59:20.084 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-04T01:59:20.085 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi077.front.sepia.ceph.com 2023-11-04T01:59:20.086 DEBUG:teuthology.orchestra.run.smithi077:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-04T01:59:20.106 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi122.front.sepia.ceph.com 2023-11-04T01:59:20.107 DEBUG:teuthology.orchestra.run.smithi122:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-04T01:59:20.148 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-04T01:59:20.148 DEBUG:teuthology.orchestra.run.smithi077:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-04T01:59:20.151 DEBUG:teuthology.orchestra.run.smithi122:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-04T01:59:20.216 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-04T01:59:20.217 DEBUG:teuthology.orchestra.run.smithi077:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-04T01:59:20.221 DEBUG:teuthology.orchestra.run.smithi122:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-04T01:59:20.363 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-04T01:59:20.374 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-04T01:59:20.375 DEBUG:teuthology.orchestra.run.smithi077:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-04T01:59:20.402 DEBUG:teuthology.orchestra.run.smithi122:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-04T01:59:20.429 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-04T01:59:20.445 DEBUG:teuthology.orchestra.run.smithi077:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:59:20.447 DEBUG:teuthology.orchestra.run.smithi122:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:59:20.470 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = core 2023-11-04T01:59:20.495 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern = core 2023-11-04T01:59:20.510 DEBUG:teuthology.orchestra.run.smithi077:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:59:20.540 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:59:20.540 DEBUG:teuthology.orchestra.run.smithi122:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:59:20.564 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:59:20.565 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-04T01:59:20.575 INFO:teuthology.task.internal:Transferring archived files... 2023-11-04T01:59:20.576 DEBUG:teuthology.misc:Transferring archived files from smithi077:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445917/remote/smithi077 2023-11-04T01:59:20.577 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-04T01:59:20.617 DEBUG:teuthology.misc:Transferring archived files from smithi122:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445917/remote/smithi122 2023-11-04T01:59:20.618 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-04T01:59:20.653 INFO:teuthology.task.internal:Removing archive directory... 2023-11-04T01:59:20.654 DEBUG:teuthology.orchestra.run.smithi077:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-04T01:59:20.656 DEBUG:teuthology.orchestra.run.smithi122:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-04T01:59:20.703 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-04T01:59:20.715 INFO:teuthology.task.internal:Not uploading archives. 2023-11-04T01:59:20.716 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-04T01:59:20.779 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-04T01:59:20.780 DEBUG:teuthology.orchestra.run.smithi077:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-04T01:59:20.783 DEBUG:teuthology.orchestra.run.smithi122:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-04T01:59:20.794 INFO:teuthology.orchestra.run.smithi077.stdout: 262170 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 4 01:59 /home/ubuntu/cephtest 2023-11-04T01:59:20.798 INFO:teuthology.orchestra.run.smithi122.stdout: 265243 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 4 01:59 /home/ubuntu/cephtest 2023-11-04T01:59:20.799 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-04T01:59:20.821 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-04T01:59:20.863 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi077 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-04T01:59:20.864 INFO:teuthology.nuke:Checking targets against current locks 2023-11-04T01:59:20.890 DEBUG:teuthology.nuke:shortname: smithi077 2023-11-04T01:59:20.890 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-04T01:59:20.913 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi077.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445917', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 01:04:35.009027', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC98IxozWDvPWbpBYgi+MMJpRUYiX+TS5qo5Pw+bfEfcVidm/tPYmNTHzJEhNIYYLj++5c1qhc780ISibsXj09I='} 2023-11-04T01:59:20.920 DEBUG:teuthology.nuke:shortname: smithi122 2023-11-04T01:59:20.920 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-04T01:59:20.941 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi122.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445917', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 01:04:35.007367', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPanZufxhlJo6tdzQLKbEysIIY5d1iHXfpINj3rEYe3uU12EsjWl4G+TqFTz+sNIrfSqYYrpwthLc8urbPu38fE='} 2023-11-04T01:59:20.967 INFO:teuthology.orchestra.console.smithi077:Power off 2023-11-04T01:59:20.968 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-04T01:59:20.991 DEBUG:teuthology.orchestra.console.smithi077:power off output: Chassis Power Control: Down/Off 2023-11-04T01:59:20.992 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:59:21.010 INFO:teuthology.orchestra.console.smithi122:Power off 2023-11-04T01:59:21.011 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-04T01:59:21.020 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on 2023-11-04T01:59:21.032 DEBUG:teuthology.orchestra.console.smithi122:power off output: Chassis Power Control: Down/Off 2023-11-04T01:59:21.032 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:59:21.056 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is on 2023-11-04T01:59:25.021 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:59:25.058 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:59:25.132 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on 2023-11-04T01:59:25.169 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is on 2023-11-04T01:59:29.134 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:59:29.171 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:59:29.245 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on 2023-11-04T01:59:29.282 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is off 2023-11-04T01:59:29.383 INFO:teuthology.orchestra.console.smithi122:Power off completed 2023-11-04T01:59:33.250 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:59:33.360 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off 2023-11-04T01:59:33.462 INFO:teuthology.orchestra.console.smithi077:Power off completed 2023-11-04T01:59:33.567 INFO:teuthology.run:Summary data: description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} duration: 1924.5810446739197 failure_reason: 'Test failure: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots), test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots)' flavor: default owner: scheduled_pdonnell@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=342c40a650334ee4abb2eaca3120e5e7 status: fail success: false 2023-11-04T01:59:33.568 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T01:59:33.651 INFO:teuthology.run:FAIL